-- Logs begin at Sat 2022-01-15 20:01:13 UTC, end at Sat 2022-01-15 22:13:09 UTC. -- Jan 15 20:37:52.227099 ncdv-master-1 systemd[1]: Starting Devstack devstack@n-api.service... Jan 15 20:37:52.235826 ncdv-master-1 devstack@n-api.service[113660]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jan 15 20:37:52.237828 ncdv-master-1 devstack@n-api.service[113660]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Jan 15 20:37:52 2022] *** Jan 15 20:37:52.237828 ncdv-master-1 devstack@n-api.service[113660]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jan 15 20:37:52.237828 ncdv-master-1 devstack@n-api.service[113660]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jan 15 20:37:52.237828 ncdv-master-1 devstack@n-api.service[113660]: nodename: ncdv-master-1 Jan 15 20:37:52.237828 ncdv-master-1 devstack@n-api.service[113660]: machine: x86_64 Jan 15 20:37:52.237828 ncdv-master-1 devstack@n-api.service[113660]: clock source: unix Jan 15 20:37:52.237828 ncdv-master-1 devstack@n-api.service[113660]: pcre jit disabled Jan 15 20:37:52.237828 ncdv-master-1 devstack@n-api.service[113660]: detected number of CPU cores: 4 Jan 15 20:37:52.237828 ncdv-master-1 devstack@n-api.service[113660]: current working directory: / Jan 15 20:37:52.237828 ncdv-master-1 devstack@n-api.service[113660]: detected binary path: /usr/bin/uwsgi-core Jan 15 20:37:52.237828 ncdv-master-1 devstack@n-api.service[113660]: your processes number limit is 47680 Jan 15 20:37:52.238580 ncdv-master-1 devstack@n-api.service[113660]: your memory page size is 4096 bytes Jan 15 20:37:52.238580 ncdv-master-1 devstack@n-api.service[113660]: detected max file descriptor number: 2048 Jan 15 20:37:52.238580 ncdv-master-1 devstack@n-api.service[113660]: lock engine: pthread robust mutexes Jan 15 20:37:52.238580 ncdv-master-1 devstack@n-api.service[113660]: thunder lock: enabled Jan 15 20:37:52.238580 ncdv-master-1 devstack@n-api.service[113660]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jan 15 20:37:52.238580 ncdv-master-1 devstack@n-api.service[113660]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Jan 15 20:37:52.286838 ncdv-master-1 devstack@n-api.service[113660]: Python main interpreter initialized at 0x560ac89459c0 Jan 15 20:37:52.286838 ncdv-master-1 devstack@n-api.service[113660]: python threads support enabled Jan 15 20:37:52.286838 ncdv-master-1 devstack@n-api.service[113660]: your server socket listen backlog is limited to 100 connections Jan 15 20:37:52.286838 ncdv-master-1 devstack@n-api.service[113660]: your mercy for graceful operations on workers is 90 seconds Jan 15 20:37:52.287183 ncdv-master-1 devstack@n-api.service[113660]: mapped 403077 bytes (393 KB) for 2 cores Jan 15 20:37:52.287264 ncdv-master-1 devstack@n-api.service[113660]: *** Operational MODE: preforking *** Jan 15 20:37:52.287477 ncdv-master-1 devstack@n-api.service[113660]: *** uWSGI is running in multiple interpreter mode *** Jan 15 20:37:52.287477 ncdv-master-1 devstack@n-api.service[113660]: spawned uWSGI master process (pid: 113660) Jan 15 20:37:52.287661 ncdv-master-1 systemd[1]: Started Devstack devstack@n-api.service. Jan 15 20:37:52.288474 ncdv-master-1 devstack@n-api.service[113660]: spawned uWSGI worker 1 (pid: 113661, cores: 1) Jan 15 20:37:52.288585 ncdv-master-1 devstack@n-api.service[113660]: spawned uWSGI worker 2 (pid: 113662, cores: 1) Jan 15 20:37:52.288719 ncdv-master-1 devstack@n-api.service[113660]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jan 15 20:37:54.203699 ncdv-master-1 devstack@n-api.service[113661]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 15 20:37:54.203699 ncdv-master-1 devstack@n-api.service[113661]: from cryptography.utils import int_from_bytes Jan 15 20:37:54.204366 ncdv-master-1 devstack@n-api.service[113661]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 15 20:37:54.204366 ncdv-master-1 devstack@n-api.service[113661]: from cryptography.utils import int_from_bytes Jan 15 20:37:54.205476 ncdv-master-1 devstack@n-api.service[113662]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 15 20:37:54.205476 ncdv-master-1 devstack@n-api.service[113662]: from cryptography.utils import int_from_bytes Jan 15 20:37:54.205937 ncdv-master-1 devstack@n-api.service[113662]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 15 20:37:54.205937 ncdv-master-1 devstack@n-api.service[113662]: from cryptography.utils import int_from_bytes Jan 15 20:37:56.766885 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 15 20:37:56.767600 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 15 20:37:56.767600 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 15 20:37:56.767950 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 15 20:37:56.768202 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 15 20:37:56.768582 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.768763 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 15 20:37:56.769174 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.769262 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 15 20:37:56.769352 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.769540 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 15 20:37:56.769634 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.769863 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.769959 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 15 20:37:56.770152 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 15 20:37:56.770246 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.770470 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.770562 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.770785 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.770869 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.771108 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.771197 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.771365 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.771516 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.771677 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.771809 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.771996 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.772126 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.772312 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.773073 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.773608 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.773724 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.773817 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.773908 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.774006 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.774098 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.774178 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.774262 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.774462 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.774592 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.774775 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.774917 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.775228 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.775319 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.775548 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.776502 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.776651 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.776784 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.776950 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.777074 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.777205 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.777335 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.777463 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.777590 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.777590 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.777832 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.777984 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.778113 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.778244 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.778373 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.778499 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.778609 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.778736 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.778864 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.778991 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.779119 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.779251 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.779371 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.779496 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.779623 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.779742 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.779871 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.780069 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.780198 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.780324 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.780454 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.780652 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.780786 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.780995 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.781136 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.781316 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.781459 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.781621 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.781746 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.781942 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.782083 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.782259 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.782389 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.782573 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.782698 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.782890 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.783023 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.783225 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.783358 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.783480 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.783606 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.783772 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.783910 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.784087 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.784220 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.784389 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.784520 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.784691 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.784822 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.784977 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.785097 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.785284 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.785406 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.785573 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.785706 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.785890 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.786022 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.786203 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.786337 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.786470 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.786583 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.786702 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.786829 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.786983 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.787117 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.787301 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.787428 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.787607 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.787742 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.787912 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.788106 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.788920 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.789060 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.789192 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.789487 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.789621 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.789816 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.789948 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.790126 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.790254 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.790437 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.790573 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.790746 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.790876 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.791055 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.791248 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.791389 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.791518 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.791664 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.791787 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.791974 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.792097 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.792286 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.792409 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.792612 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.792749 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.792940 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.793074 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.793286 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.793425 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.793582 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.793715 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.793900 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.794032 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.794211 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.794349 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.794530 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.794648 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.794841 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.794970 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.795144 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.795268 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.795451 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.795585 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.795759 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.795892 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.796078 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.796202 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.796405 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.796535 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.796705 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.796890 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.797025 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.797154 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.797281 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.797402 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.797553 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.797686 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.797873 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.797999 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.798178 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.798309 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.798483 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.798619 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.798786 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.798916 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.799080 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.799209 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.799392 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.799527 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.799695 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.799819 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.800002 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.800162 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.800294 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.800414 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.800601 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.800733 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.800933 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.801059 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.801245 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.801381 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.801811 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.801934 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.802117 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.802243 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.802410 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.802533 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.802717 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.802842 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.803028 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.803159 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.803400 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.803535 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.803690 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.803822 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.803982 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.804108 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.804309 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.804447 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.804623 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.804747 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.804959 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.805086 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.805273 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.805399 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.805585 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.805787 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.805921 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.806049 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.806205 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.806344 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.806516 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.806640 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.806819 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.806959 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.807135 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.807257 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.807434 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.807563 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.807741 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.807873 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.808051 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.808172 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.808354 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.808484 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.808658 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.808799 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.808986 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.809124 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.809295 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.809419 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.809651 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.809795 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.809918 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.810045 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.810166 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.810286 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.810456 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.810591 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.810754 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.810886 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.811070 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.811188 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.811384 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.811509 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.811687 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.811809 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.811991 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.812115 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.812294 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.812421 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.812606 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.812731 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.812952 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.813091 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.813269 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.813395 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.813592 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.813717 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.813876 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.814010 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.814199 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:37:56.814325 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.814527 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.814657 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.814844 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.814977 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.815153 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.815279 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.815466 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.815592 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.815789 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.815923 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.816099 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.816225 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.816408 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.816534 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.816718 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.816884 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.817060 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.817193 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.817373 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.817499 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.817689 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.817807 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.818002 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.818125 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.818317 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.818448 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.818633 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.818765 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.818943 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.819075 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.819292 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.819506 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.819702 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.819822 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.819927 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.820028 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.820231 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.820365 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.820569 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.820701 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.820914 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.821043 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.821228 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.821356 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.821550 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.821677 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.821859 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.821991 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.822180 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.822317 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.822489 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.822616 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.822799 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.822925 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.823109 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.823243 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.823436 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.823577 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.823776 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.823902 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.824023 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.824158 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.824354 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.824481 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.824667 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.824800 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.825003 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.825136 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.825309 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.825435 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.825612 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.825744 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.825915 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.826050 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.826223 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.826349 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.826525 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.826658 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.826842 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.826974 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.827146 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.827272 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.827452 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.827582 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.827778 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.827901 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.828055 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.828180 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.828362 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.828487 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.828670 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.828796 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.829000 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.829127 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.829311 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.829449 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.829622 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.829759 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.829925 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.830051 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.830241 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.830375 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.830546 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.830673 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.830848 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.830974 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.831161 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.831294 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.831459 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.831593 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.831760 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.831886 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.832071 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.832205 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.832376 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.832509 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.832683 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.832809 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.833022 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.833162 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.833333 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.833458 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.833638 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.833776 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.833970 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.834106 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.834256 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.834381 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.834574 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.834700 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.835378 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.835506 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.835733 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.835961 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.836085 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.836287 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.836424 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.836628 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.836755 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.836970 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.837095 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.837272 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.837411 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.837576 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.837713 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.837878 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.838003 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.838184 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.838310 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.838487 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.838613 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.838786 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.838912 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.839087 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.839212 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.839392 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.839517 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.839693 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.839823 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.840003 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.840127 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.840304 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.840427 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.840605 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.840730 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.840929 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.841067 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.841245 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.841366 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.841534 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.841666 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.841855 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.841980 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.842162 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.842288 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.842470 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.842604 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.842781 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.842907 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.843088 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.843223 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.843393 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.843525 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.843705 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.843838 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.844039 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.844179 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.844310 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.844441 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.844605 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.844730 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.844934 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.845062 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.845251 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.845392 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.845556 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.845681 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.845870 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.845995 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.846178 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.846307 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.846495 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.846626 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.846801 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.846925 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.847116 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.847268 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.847417 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.847543 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.847727 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.847851 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.848037 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.848161 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.848363 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.848495 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.848674 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.848803 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.849016 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.849140 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.849325 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.849458 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.849633 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.849769 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.849938 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.850065 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.850244 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.850371 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.850596 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.851288 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.851416 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.851717 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.851849 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.852021 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.852148 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.852333 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.852460 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.852637 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.852763 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.852980 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.853107 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.853286 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.853412 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.853599 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.853723 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.853897 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.854049 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.854256 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.854382 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.854503 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.854631 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.854824 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.854963 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.855132 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.855257 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.855442 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.855568 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.855758 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.855897 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.856047 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.856169 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.856354 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.856480 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.856661 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.856795 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.856986 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.857112 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.857291 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.857416 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.857599 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.857800 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.857925 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.858055 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.858199 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.858330 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.858507 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.858632 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.858808 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.858940 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.859119 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.859258 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.859430 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.859556 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.859732 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.859858 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.860033 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.860159 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.860344 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.860470 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.860662 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.860787 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.860984 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.861107 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.861296 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.861429 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.861612 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.861755 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.861910 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.862042 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.862213 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.862347 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.862527 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.862650 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.862828 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.862963 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.863129 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.863261 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.863428 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.863553 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.863729 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.863864 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.864065 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.864191 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.864387 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.864517 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.864640 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.864768 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.864982 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.865118 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.865300 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.865432 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.865605 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.865739 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.865913 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.866044 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.866247 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.866372 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.866554 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.866815 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.866941 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.867135 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.867262 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.867454 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.867586 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.867760 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.867885 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.868054 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.868188 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.868357 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.868495 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.868663 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.868788 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.869007 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.869132 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.869318 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.869442 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.869624 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.869756 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.869930 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.870056 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.870232 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.870359 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.870539 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.870675 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.870851 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.870974 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.871165 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.871410 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.871537 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.871738 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.871863 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.872050 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.872183 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.872368 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.872494 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.872683 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.872807 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.873024 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.873152 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.873348 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.873482 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.873724 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.873916 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.874050 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.874260 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.874400 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.874586 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.874721 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.874899 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.875034 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.875199 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.875322 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.875507 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.875632 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.875808 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.875935 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.876111 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.876236 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.876411 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.876544 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.876717 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.876876 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.877043 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.877168 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.877344 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.877480 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.877681 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.877808 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.877982 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.878122 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.878291 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.878423 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.878592 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.878730 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.878897 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.879023 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.879232 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.879364 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.879492 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.879625 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.879801 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.879927 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.880098 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.880221 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.880397 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.880534 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.880695 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.880826 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.881059 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.881186 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.881361 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.881486 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.881683 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.881808 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.882090 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.882214 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.882430 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.882547 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.882734 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.882875 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.883036 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.883161 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.883342 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.883475 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.883647 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.883771 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.883947 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.884079 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.884248 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.884381 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.884567 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.884754 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.884937 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.885061 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.885182 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.885312 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.885461 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.885584 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.885750 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.885874 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.886056 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.886193 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.886364 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.886491 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.886662 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.886787 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.886968 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.887094 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.887267 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.887392 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.887575 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.887701 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.887879 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.888005 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.888178 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.888311 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.888476 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.888601 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.888782 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.888927 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.889115 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.889242 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.889414 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.889539 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.889719 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.889846 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.890018 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.890151 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.890329 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.890468 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.890628 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.890754 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.890928 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.891053 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.891225 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.891364 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.891532 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.891657 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.891833 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.891956 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.892128 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.892264 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.892437 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.892561 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.892740 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.892925 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.893050 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.893179 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.893352 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.893477 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.893657 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.893788 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.893953 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.894077 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.894252 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.894378 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.894558 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.894682 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.894885 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.895010 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.895166 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.895292 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.895464 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.895589 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.895769 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.895895 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.896066 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.896190 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.896366 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.896493 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.896666 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.896793 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.896996 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.897122 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.897297 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.897938 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.898203 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.898334 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.898478 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.898633 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.898795 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.898964 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.899095 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.899217 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.899401 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.899534 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.899711 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.899844 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.900026 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.900151 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.900336 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.900463 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.900644 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.900780 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.900979 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.901105 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.901288 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.901415 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.901597 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.901731 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.901924 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.902050 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.902238 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.902362 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.902547 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.902678 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.902851 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.902974 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.903154 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.903285 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.903463 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.903587 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.903765 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.903893 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.904079 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.904204 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.904386 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.904512 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.904696 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.904820 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.905009 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.905146 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.905310 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.905435 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.905632 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.905763 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.905939 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.906077 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.906247 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.906372 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.906561 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.906684 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.906874 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.907007 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.907189 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.907318 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.907487 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.907610 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.907789 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.907925 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.908091 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.908228 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.908410 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.908533 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.908687 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.908819 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.909048 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.909181 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.909303 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.909438 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.909645 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.909783 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.909906 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.910026 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.910194 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.910319 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.910512 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.910643 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.910789 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.910914 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.911095 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.911222 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.911404 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.911529 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.911704 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.911836 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.912024 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.912156 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.912330 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.912456 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.912631 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.912763 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.912963 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.913168 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.913331 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.913442 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.913648 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.913774 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.913962 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.914097 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.914271 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.914479 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.914611 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.914791 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.914917 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.915099 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.915226 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.915400 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.915533 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.915707 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.915839 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.916013 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.916195 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.916319 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.916448 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.916622 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.916789 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.916967 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.917133 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.917344 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.917471 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.917653 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.917787 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.917961 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.918086 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.918268 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.918414 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.918602 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.918736 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.918848 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.918968 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.919151 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.919284 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.919469 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.919640 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.919766 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.919957 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.920082 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.920272 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.920406 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.920588 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.920713 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.920920 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.921048 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.921231 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.921372 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.921545 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.921671 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.921870 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.921995 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.922178 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.922312 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.922487 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.922612 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.922795 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.922919 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.923120 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.923253 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.923427 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.923558 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.923750 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.923876 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.924114 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.924239 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.924416 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.924541 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.924726 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.924886 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.925062 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.925195 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.925381 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.925507 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.925699 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.925825 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.926008 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.926164 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.926320 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.926698 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.926887 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.927013 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.927206 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.927333 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.927523 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.927648 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.927833 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.927972 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.928149 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.928274 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.928504 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.929202 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.929464 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.929605 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.929712 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.929821 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.929976 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.930110 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.930304 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.930439 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.930632 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.930777 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.930951 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.931079 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.931269 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.931393 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.931572 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.931706 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.931878 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.932003 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.932199 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.932324 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.932501 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.932635 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.932812 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.932986 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.933146 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.933293 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.933453 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.933578 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.933753 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.934046 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.934182 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.934306 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.934437 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.934559 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.934688 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.934810 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.934938 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.935068 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.935242 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.935370 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.935560 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.935692 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.935875 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.936001 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.936178 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.936306 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.936489 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.936614 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.936789 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.936972 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.937099 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.937234 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.937403 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.937530 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.937704 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.937838 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.938044 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.938171 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.938349 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.938475 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.938664 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.938800 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.938987 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.939110 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.939298 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.939438 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.939625 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.939759 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.939891 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.940013 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.940195 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.940321 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.940530 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.940656 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.940886 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.941014 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.941178 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.941303 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.941480 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.942109 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.942241 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.942364 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.942486 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.942608 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.942739 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.942861 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.942992 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.943114 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.943235 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.943365 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.943487 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.943608 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.943731 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.943852 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.943973 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.944103 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.944267 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.944421 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.944551 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.944657 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.944762 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.944993 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.945124 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.945307 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.945433 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.945617 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.945751 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.945933 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.946060 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.946230 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.946355 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.946536 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.946662 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.946853 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.947005 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.947180 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.947311 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.947487 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.947620 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.947802 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.947932 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.948112 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.948243 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.948418 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.948551 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.948724 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.948883 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.949057 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.949183 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.949374 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.949515 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.949727 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.949861 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.949985 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.950107 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.950275 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.950400 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.950583 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.950710 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.950894 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.951028 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.951203 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.951330 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.951515 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.951648 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.951827 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.951953 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.952141 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.952268 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.952461 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.952656 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.952781 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.953007 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.953148 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.953319 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.953445 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.953630 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.953763 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.953939 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.954074 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.954250 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.954375 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.954559 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.954685 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.954865 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.954992 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.955170 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.955437 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.955571 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.955770 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.955904 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.956088 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.956212 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.956428 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.956556 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.956721 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.956911 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.957048 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.957170 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.957371 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.957498 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.957664 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.957788 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.957978 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.958105 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.958292 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.958418 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.958606 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.958738 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.958938 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.959065 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.959243 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.959378 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.959556 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.959683 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.960396 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.960539 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.960737 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.960902 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.961085 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.961212 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.961395 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.961521 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.961708 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.961843 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.962020 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.962146 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.962332 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.962467 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.962640 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.962766 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.962953 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.963086 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.963264 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.963398 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.963581 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.963714 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.963898 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.964024 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.964212 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.964345 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.964525 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.964653 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.964879 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.965019 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.965177 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.965313 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.965490 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.965687 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.965813 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.966000 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.966126 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.966329 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.966455 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.966651 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.966778 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.966974 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.967100 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.967289 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.967415 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.967602 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.967728 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.967926 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.968064 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.968230 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.968516 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.968642 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.968825 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.968992 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.969156 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.969289 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.969459 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.969593 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.969783 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.969911 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.970119 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.970245 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.970367 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.970489 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.970678 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.970805 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.970984 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.971115 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.971329 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.971507 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.971633 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.971849 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.971983 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.972160 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.972294 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.972478 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.972604 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.972796 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.972946 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.973135 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.973272 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.973439 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.973572 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.973757 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.973884 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.974061 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.974288 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.974421 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.974638 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.974771 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.974953 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.975084 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.975255 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.975381 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.975617 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.975755 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.975986 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.976207 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.976341 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.976463 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.976594 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.976716 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.976922 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.977048 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.977169 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.977291 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.977463 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.977599 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.977765 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.977891 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.978066 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.978370 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.978512 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.978647 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.978777 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.978900 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.979023 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.979161 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.979291 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.979414 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.979537 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.979659 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.979805 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.979941 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.980159 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.980295 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.980419 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.980549 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.980698 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.980834 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.981027 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.981154 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.981334 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.981461 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.981635 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.981774 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.981944 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.982071 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.982248 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.982384 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.982566 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.982694 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.982868 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.983003 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.983168 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.983295 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.983477 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.983611 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.983780 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.983905 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.984093 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.984229 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.984398 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.984524 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.984706 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.984833 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.985038 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.985176 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.985375 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.985501 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.985661 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.985880 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.986014 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.986255 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.986413 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.986573 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.986710 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.986900 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.987061 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.987203 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.987338 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.987519 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.987653 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.987819 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.987945 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.988123 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.988250 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.988443 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.988687 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.988815 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.989074 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.989207 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.989383 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.989518 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.989696 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.989832 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.990003 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.990131 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.990333 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.990467 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.990603 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.990729 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.990910 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.991046 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.991752 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.992003 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.992120 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.992236 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.992374 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.992499 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.992685 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.992813 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.993026 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.993231 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.993365 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.993487 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.993639 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.993772 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.993944 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.994086 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.994251 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.994378 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.994556 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.994682 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.994862 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.994997 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.995174 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.995309 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.995500 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.995635 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.995810 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.995937 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.996112 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.996246 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.996433 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.996557 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.996749 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.996940 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.997088 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.997207 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.997411 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.997537 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.997727 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.997855 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.998041 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.998167 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.998362 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.998502 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.998672 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.998799 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.998978 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.999114 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.999281 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.999429 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.999607 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.999734 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:56.999941 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:57.000068 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:57.000272 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:57.000510 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:57.000646 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:57.000771 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:57.000972 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:57.001108 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:57.001241 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:57.001366 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:57.001489 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:57.001611 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:57.001775 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:57.001910 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:57.002101 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:57.002228 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:57.002427 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:57.002582 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:57.002739 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:57.002879 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:57.003056 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:57.003185 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:57.003481 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:57.003599 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:57.003703 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:57.003832 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:57.003964 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:57.004088 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:57.004260 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:57.004394 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:57.004577 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:57.004714 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:57.004920 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:57.005049 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:57.005228 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:57.005355 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:57.005555 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:57.005696 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:57.005862 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:57.005989 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:57.006170 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:57.006305 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:57.006474 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:57.006611 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:57.006822 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:57.006957 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:57.007134 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:57.007262 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:57.007444 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:57.007576 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:57.007748 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:57.007876 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:57.008067 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:57.008194 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:57.008370 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:57.008498 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:57.008690 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:57.008876 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:57.009029 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:57.009156 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:57.009347 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:57.009482 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:57.009661 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:57.009788 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:57.009967 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:57.010094 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:57.010283 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:57.010432 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:57.010622 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:57.010748 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:57.010879 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:57.011011 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:57.011188 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:57.011315 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:57.011498 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:57.011625 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:57.011814 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:57.011950 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:57.012126 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:57.012253 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:57.012446 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:57.012581 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:57.012760 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:57.012925 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:57.013109 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:57.013235 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:57.013424 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:57.013555 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:57.013746 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:57.013874 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:57.014058 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:57.014190 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:57.014371 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:57.014503 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:57.014694 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:57.014821 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:57.015005 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:57.015131 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:57.015314 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:57.015441 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:57.015618 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:57.015745 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:57.015868 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=113662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 15 20:37:57.015991 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:57.016273 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:57.016621 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:57.017016 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:57.017323 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:57.017656 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:57.017976 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:57.018294 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:57.018606 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:37:57.018853 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=113661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 15 20:37:57.039527 ncdv-master-1 devstack@n-api.service[113662]: DEBUG oslo_db.sqlalchemy.engines [None req-32c63764-5ce5-4c84-beca-05a065096319 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=113662) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 20:37:57.042158 ncdv-master-1 devstack@n-api.service[113661]: DEBUG oslo_db.sqlalchemy.engines [None req-be7d7c8d-cc7b-41e4-b928-6e8a3a2b147a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=113661) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 20:37:57.105791 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.context [None req-32c63764-5ce5-4c84-beca-05a065096319 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2935be83-7c51-430d-8ff2-0a8179973c9a(cell1) {{(pid=113662) load_cells /opt/stack/nova/nova/context.py:464}} Jan 15 20:37:57.110060 ncdv-master-1 devstack@n-api.service[113662]: DEBUG oslo_concurrency.lockutils [None req-32c63764-5ce5-4c84-beca-05a065096319 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:37:57.110241 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.context [None req-be7d7c8d-cc7b-41e4-b928-6e8a3a2b147a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2935be83-7c51-430d-8ff2-0a8179973c9a(cell1) {{(pid=113661) load_cells /opt/stack/nova/nova/context.py:464}} Jan 15 20:37:57.111649 ncdv-master-1 devstack@n-api.service[113662]: DEBUG oslo_concurrency.lockutils [None req-32c63764-5ce5-4c84-beca-05a065096319 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=113662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:37:57.112467 ncdv-master-1 devstack@n-api.service[113662]: DEBUG oslo_concurrency.lockutils [None req-32c63764-5ce5-4c84-beca-05a065096319 None None] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:37:57.114440 ncdv-master-1 devstack@n-api.service[113661]: DEBUG oslo_concurrency.lockutils [None req-be7d7c8d-cc7b-41e4-b928-6e8a3a2b147a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:37:57.114551 ncdv-master-1 devstack@n-api.service[113662]: DEBUG oslo_concurrency.lockutils [None req-32c63764-5ce5-4c84-beca-05a065096319 None None] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=113662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:37:57.116015 ncdv-master-1 devstack@n-api.service[113661]: DEBUG oslo_concurrency.lockutils [None req-be7d7c8d-cc7b-41e4-b928-6e8a3a2b147a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=113661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:37:57.117467 ncdv-master-1 devstack@n-api.service[113661]: DEBUG oslo_concurrency.lockutils [None req-be7d7c8d-cc7b-41e4-b928-6e8a3a2b147a None None] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:37:57.119427 ncdv-master-1 devstack@n-api.service[113661]: DEBUG oslo_concurrency.lockutils [None req-be7d7c8d-cc7b-41e4-b928-6e8a3a2b147a None None] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=113661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:37:57.125047 ncdv-master-1 devstack@n-api.service[113662]: DEBUG oslo_db.sqlalchemy.engines [None req-32c63764-5ce5-4c84-beca-05a065096319 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=113662) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 20:37:57.129775 ncdv-master-1 devstack@n-api.service[113662]: DEBUG oslo_db.sqlalchemy.engines [None req-32c63764-5ce5-4c84-beca-05a065096319 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=113662) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 20:37:57.134294 ncdv-master-1 devstack@n-api.service[113661]: DEBUG oslo_db.sqlalchemy.engines [None req-be7d7c8d-cc7b-41e4-b928-6e8a3a2b147a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=113661) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 20:37:57.137566 ncdv-master-1 devstack@n-api.service[113661]: DEBUG oslo_db.sqlalchemy.engines [None req-be7d7c8d-cc7b-41e4-b928-6e8a3a2b147a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=113661) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 20:37:57.297279 ncdv-master-1 devstack@n-api.service[113662]: DEBUG oslo_db.sqlalchemy.engines [None req-32c63764-5ce5-4c84-beca-05a065096319 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=113662) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 20:37:57.310477 ncdv-master-1 devstack@n-api.service[113661]: DEBUG oslo_db.sqlalchemy.engines [None req-be7d7c8d-cc7b-41e4-b928-6e8a3a2b147a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=113661) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 20:37:57.646391 ncdv-master-1 devstack@n-api.service[113662]: WARNING keystonemiddleware.auth_token [None req-32c63764-5ce5-4c84-beca-05a065096319 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 15 20:37:57.648891 ncdv-master-1 devstack@n-api.service[113661]: WARNING keystonemiddleware.auth_token [None req-be7d7c8d-cc7b-41e4-b928-6e8a3a2b147a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 15 20:37:57.653498 ncdv-master-1 devstack@n-api.service[113662]: WARNING keystonemiddleware.auth_token [None req-32c63764-5ce5-4c84-beca-05a065096319 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 15 20:37:57.655636 ncdv-master-1 devstack@n-api.service[113661]: WARNING keystonemiddleware.auth_token [None req-be7d7c8d-cc7b-41e4-b928-6e8a3a2b147a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 15 20:37:57.998041 ncdv-master-1 devstack@n-api.service[113662]: WARNING keystonemiddleware.auth_token [None req-32c63764-5ce5-4c84-beca-05a065096319 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 15 20:37:57.998580 ncdv-master-1 devstack@n-api.service[113661]: WARNING keystonemiddleware.auth_token [None req-be7d7c8d-cc7b-41e4-b928-6e8a3a2b147a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 15 20:37:58.003326 ncdv-master-1 devstack@n-api.service[113662]: WARNING keystonemiddleware.auth_token [None req-32c63764-5ce5-4c84-beca-05a065096319 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 15 20:37:58.003705 ncdv-master-1 devstack@n-api.service[113661]: WARNING keystonemiddleware.auth_token [None req-be7d7c8d-cc7b-41e4-b928-6e8a3a2b147a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 15 20:37:58.009311 ncdv-master-1 devstack@n-api.service[113662]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x560ac89459c0 pid: 113662 (default app) Jan 15 20:37:58.009563 ncdv-master-1 devstack@n-api.service[113661]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x560ac89459c0 pid: 113661 (default app) Jan 15 20:37:58.011360 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi [None req-32c63764-5ce5-4c84-beca-05a065096319 None None] Calling method '>' {{(pid=113662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:37:58.012518 ncdv-master-1 devstack@n-api.service[113662]: INFO nova.api.openstack.requestlog [None req-32c63764-5ce5-4c84-beca-05a065096319 None None] 10.222.0.46 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001704 Jan 15 20:37:58.012958 ncdv-master-1 devstack@n-api.service[113662]: [pid: 113662|app: 0|req: 1/1] 10.222.0.46 () {50 vars in 788 bytes} [Sat Jan 15 20:37:58 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:39:26.362950 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi [None req-be7d7c8d-cc7b-41e4-b928-6e8a3a2b147a None None] Calling method '>' {{(pid=113661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:39:26.365461 ncdv-master-1 devstack@n-api.service[113661]: INFO nova.api.openstack.requestlog [None req-be7d7c8d-cc7b-41e4-b928-6e8a3a2b147a None None] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003244 Jan 15 20:39:26.367360 ncdv-master-1 devstack@n-api.service[113661]: [pid: 113661|app: 0|req: 1/2] 10.222.0.46 () {54 vars in 930 bytes} [Sat Jan 15 20:39:26 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:39:26.793138 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi [None req-efd00727-3c85-4397-8b92-55045e474b4a admin admin] Calling method '>' {{(pid=113662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:39:26.823140 ncdv-master-1 devstack@n-api.service[113662]: INFO nova.api.openstack.requestlog [None req-efd00727-3c85-4397-8b92-55045e474b4a admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.449508 Jan 15 20:39:26.823858 ncdv-master-1 devstack@n-api.service[113662]: [pid: 113662|app: 0|req: 2/3] 10.222.0.46 () {60 vars in 1291 bytes} [Sat Jan 15 20:39:26 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:39:29.176891 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi [None req-be7d7c8d-cc7b-41e4-b928-6e8a3a2b147a None None] Calling method '>' {{(pid=113661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:39:29.178158 ncdv-master-1 devstack@n-api.service[113661]: INFO nova.api.openstack.requestlog [None req-be7d7c8d-cc7b-41e4-b928-6e8a3a2b147a None None] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002216 Jan 15 20:39:29.178546 ncdv-master-1 devstack@n-api.service[113661]: [pid: 113661|app: 0|req: 2/4] 10.222.0.46 () {54 vars in 930 bytes} [Sat Jan 15 20:39:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:39:29.241861 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi [None req-971fbc77-037d-487f-b678-6dbda29bbdae admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "vcpus": 1, "id": "c1", "rxtx_factor": 1.0, "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "disk": 1}} {{(pid=113662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:39:29.260163 ncdv-master-1 devstack@n-api.service[113662]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:39:29.260163 ncdv-master-1 devstack@n-api.service[113662]: warnings.warn(msg) Jan 15 20:39:29.289348 ncdv-master-1 devstack@n-api.service[113662]: INFO nova.api.openstack.requestlog [None req-971fbc77-037d-487f-b678-6dbda29bbdae admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.104954 Jan 15 20:39:29.290061 ncdv-master-1 devstack@n-api.service[113662]: [pid: 113662|app: 0|req: 3/5] 10.222.0.46 () {64 vars in 1282 bytes} [Sat Jan 15 20:39:29 2022] POST /compute/v2.1/flavors => generated 407 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:39:29.506863 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi [None req-8514954d-164b-4de3-a511-12a1e2ec6517 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=113661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:39:29.509843 ncdv-master-1 devstack@n-api.service[113661]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:39:29.509843 ncdv-master-1 devstack@n-api.service[113661]: warnings.warn(msg) Jan 15 20:39:29.558308 ncdv-master-1 devstack@n-api.service[113661]: INFO nova.api.openstack.requestlog [None req-8514954d-164b-4de3-a511-12a1e2ec6517 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.260215 Jan 15 20:39:29.559073 ncdv-master-1 devstack@n-api.service[113661]: [pid: 113661|app: 0|req: 3/6] 10.222.0.46 () {64 vars in 1335 bytes} [Sat Jan 15 20:39:29 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:39:31.899243 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi [None req-971fbc77-037d-487f-b678-6dbda29bbdae admin admin] Calling method '>' {{(pid=113662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:39:31.900247 ncdv-master-1 devstack@n-api.service[113662]: INFO nova.api.openstack.requestlog [None req-971fbc77-037d-487f-b678-6dbda29bbdae admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Jan 15 20:39:31.900650 ncdv-master-1 devstack@n-api.service[113662]: [pid: 113662|app: 0|req: 4/7] 10.222.0.46 () {54 vars in 930 bytes} [Sat Jan 15 20:39:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:39:32.007277 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi [None req-b921875a-1519-4f5a-b4eb-c0d2e11090f9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "disk": 5, "ram": 512, "os-flavor-access:is_public": true, "id": "d1", "name": "ds512M", "vcpus": 1}} {{(pid=113661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:39:32.025146 ncdv-master-1 devstack@n-api.service[113661]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:39:32.025146 ncdv-master-1 devstack@n-api.service[113661]: warnings.warn(msg) Jan 15 20:39:32.043931 ncdv-master-1 devstack@n-api.service[113661]: INFO nova.api.openstack.requestlog [None req-b921875a-1519-4f5a-b4eb-c0d2e11090f9 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.137359 Jan 15 20:39:32.044501 ncdv-master-1 devstack@n-api.service[113661]: [pid: 113661|app: 0|req: 4/8] 10.222.0.46 () {64 vars in 1282 bytes} [Sat Jan 15 20:39:31 2022] POST /compute/v2.1/flavors => generated 404 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:39:32.056387 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi [None req-26a08760-08bf-46fe-ac2c-eb4e8c5a8c6a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=113662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:39:32.057864 ncdv-master-1 devstack@n-api.service[113662]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:39:32.057864 ncdv-master-1 devstack@n-api.service[113662]: warnings.warn(msg) Jan 15 20:39:32.090531 ncdv-master-1 devstack@n-api.service[113662]: INFO nova.api.openstack.requestlog [None req-26a08760-08bf-46fe-ac2c-eb4e8c5a8c6a admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037592 Jan 15 20:39:32.091011 ncdv-master-1 devstack@n-api.service[113662]: [pid: 113662|app: 0|req: 5/9] 10.222.0.46 () {64 vars in 1335 bytes} [Sat Jan 15 20:39:32 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:39:34.488555 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi [None req-b921875a-1519-4f5a-b4eb-c0d2e11090f9 admin admin] Calling method '>' {{(pid=113661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:39:34.490460 ncdv-master-1 devstack@n-api.service[113661]: INFO nova.api.openstack.requestlog [None req-b921875a-1519-4f5a-b4eb-c0d2e11090f9 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002382 Jan 15 20:39:34.491302 ncdv-master-1 devstack@n-api.service[113661]: [pid: 113661|app: 0|req: 5/10] 10.222.0.46 () {54 vars in 930 bytes} [Sat Jan 15 20:39:34 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:39:34.580389 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi [None req-78660dac-7909-44b2-b231-fd844060cf29 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "id": "d2", "swap": 0, "ram": 1024, "os-flavor-access:is_public": true, "vcpus": 1}} {{(pid=113662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:39:34.604287 ncdv-master-1 devstack@n-api.service[113662]: INFO nova.api.openstack.requestlog [None req-78660dac-7909-44b2-b231-fd844060cf29 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.106009 Jan 15 20:39:34.613468 ncdv-master-1 devstack@n-api.service[113662]: [pid: 113662|app: 0|req: 6/11] 10.222.0.46 () {64 vars in 1282 bytes} [Sat Jan 15 20:39:34 2022] POST /compute/v2.1/flavors => generated 404 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:39:34.619449 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi [None req-e133df9e-4d16-4fb2-8efd-96370c3cedb6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=113661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:39:34.655664 ncdv-master-1 devstack@n-api.service[113661]: INFO nova.api.openstack.requestlog [None req-e133df9e-4d16-4fb2-8efd-96370c3cedb6 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042191 Jan 15 20:39:34.657201 ncdv-master-1 devstack@n-api.service[113661]: [pid: 113661|app: 0|req: 6/12] 10.222.0.46 () {64 vars in 1335 bytes} [Sat Jan 15 20:39:34 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:39:37.342737 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi [None req-78660dac-7909-44b2-b231-fd844060cf29 admin admin] Calling method '>' {{(pid=113662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:39:37.344444 ncdv-master-1 devstack@n-api.service[113662]: INFO nova.api.openstack.requestlog [None req-78660dac-7909-44b2-b231-fd844060cf29 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002149 Jan 15 20:39:37.359738 ncdv-master-1 devstack@n-api.service[113662]: [pid: 113662|app: 0|req: 7/13] 10.222.0.46 () {54 vars in 930 bytes} [Sat Jan 15 20:39:37 2022] GET /compute/v2.1 => generated 388 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:39:37.409536 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi [None req-a9b3a08e-c7d1-4955-ab1f-5f04df62fee0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "ram": 2048, "os-flavor-access:is_public": true, "swap": 0, "vcpus": 2, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "ds2G"}} {{(pid=113661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:39:37.433546 ncdv-master-1 devstack@n-api.service[113661]: INFO nova.api.openstack.requestlog [None req-a9b3a08e-c7d1-4955-ab1f-5f04df62fee0 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.081972 Jan 15 20:39:37.440891 ncdv-master-1 devstack@n-api.service[113661]: [pid: 113661|app: 0|req: 7/14] 10.222.0.46 () {64 vars in 1282 bytes} [Sat Jan 15 20:39:37 2022] POST /compute/v2.1/flavors => generated 404 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:39:37.446246 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi [None req-0e9a905e-d58e-43f1-8379-066382de08f1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=113662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:39:37.478362 ncdv-master-1 devstack@n-api.service[113662]: INFO nova.api.openstack.requestlog [None req-0e9a905e-d58e-43f1-8379-066382de08f1 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035506 Jan 15 20:39:37.479171 ncdv-master-1 devstack@n-api.service[113662]: [pid: 113662|app: 0|req: 8/15] 10.222.0.46 () {64 vars in 1335 bytes} [Sat Jan 15 20:39:37 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:39:39.974668 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi [None req-a9b3a08e-c7d1-4955-ab1f-5f04df62fee0 admin admin] Calling method '>' {{(pid=113661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:39:39.975708 ncdv-master-1 devstack@n-api.service[113661]: INFO nova.api.openstack.requestlog [None req-a9b3a08e-c7d1-4955-ab1f-5f04df62fee0 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001738 Jan 15 20:39:39.976118 ncdv-master-1 devstack@n-api.service[113661]: [pid: 113661|app: 0|req: 8/16] 10.222.0.46 () {54 vars in 930 bytes} [Sat Jan 15 20:39:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:39:40.053796 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi [None req-f8600eda-4621-4a1e-89aa-520de7a92ad9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "os-flavor-access:is_public": true, "ram": 4096, "swap": 0, "name": "ds4G", "rxtx_factor": 1.0, "disk": 20, "vcpus": 4}} {{(pid=113662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:39:40.084461 ncdv-master-1 devstack@n-api.service[113662]: INFO nova.api.openstack.requestlog [None req-f8600eda-4621-4a1e-89aa-520de7a92ad9 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.101027 Jan 15 20:39:40.092914 ncdv-master-1 devstack@n-api.service[113662]: [pid: 113662|app: 0|req: 9/17] 10.222.0.46 () {64 vars in 1282 bytes} [Sat Jan 15 20:39:39 2022] POST /compute/v2.1/flavors => generated 404 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:39:40.100775 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi [None req-4c79e671-bfb5-4b6d-8111-737fc4c618a9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=113661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:39:40.133431 ncdv-master-1 devstack@n-api.service[113661]: INFO nova.api.openstack.requestlog [None req-4c79e671-bfb5-4b6d-8111-737fc4c618a9 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037807 Jan 15 20:39:40.134021 ncdv-master-1 devstack@n-api.service[113661]: [pid: 113661|app: 0|req: 9/18] 10.222.0.46 () {64 vars in 1335 bytes} [Sat Jan 15 20:39:40 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:39:42.502074 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi [None req-f8600eda-4621-4a1e-89aa-520de7a92ad9 admin admin] Calling method '>' {{(pid=113662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:39:42.503066 ncdv-master-1 devstack@n-api.service[113662]: INFO nova.api.openstack.requestlog [None req-f8600eda-4621-4a1e-89aa-520de7a92ad9 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 Jan 15 20:39:42.503462 ncdv-master-1 devstack@n-api.service[113662]: [pid: 113662|app: 0|req: 10/19] 10.222.0.46 () {54 vars in 930 bytes} [Sat Jan 15 20:39:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:39:42.565230 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi [None req-d8c60941-f317-4644-be1a-6ed20c3d7c7d admin admin] Calling method '>' {{(pid=113661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:39:42.591538 ncdv-master-1 devstack@n-api.service[113661]: INFO nova.api.openstack.requestlog [None req-d8c60941-f317-4644-be1a-6ed20c3d7c7d admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.081510 Jan 15 20:39:42.592096 ncdv-master-1 devstack@n-api.service[113661]: [pid: 113661|app: 0|req: 10/20] 10.222.0.46 () {60 vars in 1291 bytes} [Sat Jan 15 20:39:42 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:39:44.984943 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi [None req-f8600eda-4621-4a1e-89aa-520de7a92ad9 admin admin] Calling method '>' {{(pid=113662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:39:44.986000 ncdv-master-1 devstack@n-api.service[113662]: INFO nova.api.openstack.requestlog [None req-f8600eda-4621-4a1e-89aa-520de7a92ad9 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Jan 15 20:39:44.986424 ncdv-master-1 devstack@n-api.service[113662]: [pid: 113662|app: 0|req: 11/21] 10.222.0.46 () {54 vars in 930 bytes} [Sat Jan 15 20:39:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:39:45.049073 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi [None req-de7e0376-6f22-4f5a-917d-b4df38b3795a admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "rxtx_factor": 1.0, "vcpus": 1, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "swap": 0, "os-flavor-access:is_public": true, "id": "1"}} {{(pid=113661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:39:45.070209 ncdv-master-1 devstack@n-api.service[113661]: INFO nova.api.openstack.requestlog [None req-de7e0376-6f22-4f5a-917d-b4df38b3795a admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.077045 Jan 15 20:39:45.070855 ncdv-master-1 devstack@n-api.service[113661]: [pid: 113661|app: 0|req: 11/22] 10.222.0.46 () {64 vars in 1282 bytes} [Sat Jan 15 20:39:44 2022] POST /compute/v2.1/flavors => generated 402 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:39:45.083313 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi [None req-8e71cdc8-cf7e-4019-96c6-b894c796da67 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=113662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:39:45.107262 ncdv-master-1 devstack@n-api.service[113662]: INFO nova.api.openstack.requestlog [None req-8e71cdc8-cf7e-4019-96c6-b894c796da67 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028089 Jan 15 20:39:45.116987 ncdv-master-1 devstack@n-api.service[113662]: [pid: 113662|app: 0|req: 12/23] 10.222.0.46 () {64 vars in 1332 bytes} [Sat Jan 15 20:39:45 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:39:47.726966 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi [None req-de7e0376-6f22-4f5a-917d-b4df38b3795a admin admin] Calling method '>' {{(pid=113661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:39:47.727992 ncdv-master-1 devstack@n-api.service[113661]: INFO nova.api.openstack.requestlog [None req-de7e0376-6f22-4f5a-917d-b4df38b3795a admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001551 Jan 15 20:39:47.728401 ncdv-master-1 devstack@n-api.service[113661]: [pid: 113661|app: 0|req: 12/24] 10.222.0.46 () {54 vars in 930 bytes} [Sat Jan 15 20:39:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:39:47.802928 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi [None req-98248226-2ce1-42d3-bfd6-a69e2a1fefc5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "disk": 20, "ram": 2048, "id": "2", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=113662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:39:47.827535 ncdv-master-1 devstack@n-api.service[113662]: INFO nova.api.openstack.requestlog [None req-98248226-2ce1-42d3-bfd6-a69e2a1fefc5 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.091696 Jan 15 20:39:47.828374 ncdv-master-1 devstack@n-api.service[113662]: [pid: 113662|app: 0|req: 13/25] 10.222.0.46 () {64 vars in 1282 bytes} [Sat Jan 15 20:39:47 2022] POST /compute/v2.1/flavors => generated 405 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:39:47.843995 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi [None req-928bb700-2d57-4d28-8e63-6ad7cc8e197c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=113661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:39:47.872120 ncdv-master-1 devstack@n-api.service[113661]: INFO nova.api.openstack.requestlog [None req-928bb700-2d57-4d28-8e63-6ad7cc8e197c admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033216 Jan 15 20:39:47.872816 ncdv-master-1 devstack@n-api.service[113661]: [pid: 113661|app: 0|req: 13/26] 10.222.0.46 () {64 vars in 1332 bytes} [Sat Jan 15 20:39:47 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:39:50.755150 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi [None req-98248226-2ce1-42d3-bfd6-a69e2a1fefc5 admin admin] Calling method '>' {{(pid=113662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:39:50.756465 ncdv-master-1 devstack@n-api.service[113662]: INFO nova.api.openstack.requestlog [None req-98248226-2ce1-42d3-bfd6-a69e2a1fefc5 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002250 Jan 15 20:39:50.757088 ncdv-master-1 devstack@n-api.service[113662]: [pid: 113662|app: 0|req: 14/27] 10.222.0.46 () {54 vars in 930 bytes} [Sat Jan 15 20:39:50 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:39:50.823947 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi [None req-cb313ca0-e929-4478-a854-d45f0c6b85dd admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 2, "os-flavor-access:is_public": true, "id": "3", "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 40, "name": "m1.medium"}} {{(pid=113661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:39:50.848181 ncdv-master-1 devstack@n-api.service[113661]: INFO nova.api.openstack.requestlog [None req-cb313ca0-e929-4478-a854-d45f0c6b85dd admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.083140 Jan 15 20:39:50.849048 ncdv-master-1 devstack@n-api.service[113661]: [pid: 113661|app: 0|req: 14/28] 10.222.0.46 () {64 vars in 1282 bytes} [Sat Jan 15 20:39:50 2022] POST /compute/v2.1/flavors => generated 406 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 20:39:50.864406 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi [None req-8fa2298c-9022-43ff-a707-e34ddf8f1a6f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=113662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:39:50.900267 ncdv-master-1 devstack@n-api.service[113662]: INFO nova.api.openstack.requestlog [None req-8fa2298c-9022-43ff-a707-e34ddf8f1a6f admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039771 Jan 15 20:39:50.902941 ncdv-master-1 devstack@n-api.service[113662]: [pid: 113662|app: 0|req: 15/29] 10.222.0.46 () {64 vars in 1332 bytes} [Sat Jan 15 20:39:50 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:39:53.330661 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi [None req-cb313ca0-e929-4478-a854-d45f0c6b85dd admin admin] Calling method '>' {{(pid=113661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:39:53.331700 ncdv-master-1 devstack@n-api.service[113661]: INFO nova.api.openstack.requestlog [None req-cb313ca0-e929-4478-a854-d45f0c6b85dd admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Jan 15 20:39:53.333340 ncdv-master-1 devstack@n-api.service[113661]: [pid: 113661|app: 0|req: 15/30] 10.222.0.46 () {54 vars in 930 bytes} [Sat Jan 15 20:39:53 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:39:53.394179 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi [None req-663ff1aa-1c28-469b-964a-3ca478ec7bf6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large", "rxtx_factor": 1.0, "swap": 0, "ram": 8192, "id": "4", "vcpus": 4}} {{(pid=113662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:39:53.413111 ncdv-master-1 devstack@n-api.service[113662]: INFO nova.api.openstack.requestlog [None req-663ff1aa-1c28-469b-964a-3ca478ec7bf6 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.073734 Jan 15 20:39:53.413653 ncdv-master-1 devstack@n-api.service[113662]: [pid: 113662|app: 0|req: 16/31] 10.222.0.46 () {64 vars in 1282 bytes} [Sat Jan 15 20:39:53 2022] POST /compute/v2.1/flavors => generated 405 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:39:53.425133 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi [None req-1dd4e698-7899-4418-bf26-c7ac822c11f6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=113661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:39:53.448688 ncdv-master-1 devstack@n-api.service[113661]: INFO nova.api.openstack.requestlog [None req-1dd4e698-7899-4418-bf26-c7ac822c11f6 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026971 Jan 15 20:39:53.449305 ncdv-master-1 devstack@n-api.service[113661]: [pid: 113661|app: 0|req: 16/32] 10.222.0.46 () {64 vars in 1332 bytes} [Sat Jan 15 20:39:53 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:39:55.836570 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi [None req-663ff1aa-1c28-469b-964a-3ca478ec7bf6 admin admin] Calling method '>' {{(pid=113662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:39:55.837824 ncdv-master-1 devstack@n-api.service[113662]: INFO nova.api.openstack.requestlog [None req-663ff1aa-1c28-469b-964a-3ca478ec7bf6 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001599 Jan 15 20:39:55.838326 ncdv-master-1 devstack@n-api.service[113662]: [pid: 113662|app: 0|req: 17/33] 10.222.0.46 () {54 vars in 930 bytes} [Sat Jan 15 20:39:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 20:39:55.910562 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi [None req-bfdd930e-7575-45ea-a7eb-898b4db58898 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "ram": 16384, "disk": 160, "name": "m1.xlarge", "id": "5", "swap": 0}} {{(pid=113661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:39:55.923748 ncdv-master-1 devstack@n-api.service[113661]: INFO nova.api.openstack.requestlog [None req-bfdd930e-7575-45ea-a7eb-898b4db58898 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.078963 Jan 15 20:39:55.924341 ncdv-master-1 devstack@n-api.service[113661]: [pid: 113661|app: 0|req: 17/34] 10.222.0.46 () {64 vars in 1282 bytes} [Sat Jan 15 20:39:55 2022] POST /compute/v2.1/flavors => generated 408 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:39:55.937641 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi [None req-ba2c3950-b54f-4ab7-8d6b-d923e84292a9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=113662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:39:55.961532 ncdv-master-1 devstack@n-api.service[113662]: INFO nova.api.openstack.requestlog [None req-ba2c3950-b54f-4ab7-8d6b-d923e84292a9 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027644 Jan 15 20:39:55.962110 ncdv-master-1 devstack@n-api.service[113662]: [pid: 113662|app: 0|req: 18/35] 10.222.0.46 () {64 vars in 1332 bytes} [Sat Jan 15 20:39:55 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:40:22.532645 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi [None req-bfdd930e-7575-45ea-a7eb-898b4db58898 admin admin] Calling method '>' {{(pid=113661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:40:22.533668 ncdv-master-1 devstack@n-api.service[113661]: INFO nova.api.openstack.requestlog [None req-bfdd930e-7575-45ea-a7eb-898b4db58898 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Jan 15 20:40:22.534591 ncdv-master-1 devstack@n-api.service[113661]: [pid: 113661|app: 0|req: 18/36] 10.222.0.46 () {54 vars in 930 bytes} [Sat Jan 15 20:40:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:40:22.593868 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi [None req-555a207d-c5f5-4e39-9b75-dfb8bc71b262 admin admin] Calling method '>' {{(pid=113662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:40:22.610664 ncdv-master-1 devstack@n-api.service[113662]: INFO nova.api.openstack.requestlog [None req-555a207d-c5f5-4e39-9b75-dfb8bc71b262 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.070368 Jan 15 20:40:22.611185 ncdv-master-1 devstack@n-api.service[113662]: [pid: 113662|app: 0|req: 19/37] 10.222.0.46 () {60 vars in 1291 bytes} [Sat Jan 15 20:40:22 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:40:24.088059 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi [None req-bfdd930e-7575-45ea-a7eb-898b4db58898 admin admin] Calling method '>' {{(pid=113661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:40:24.089085 ncdv-master-1 devstack@n-api.service[113661]: INFO nova.api.openstack.requestlog [None req-bfdd930e-7575-45ea-a7eb-898b4db58898 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001398 Jan 15 20:40:24.089485 ncdv-master-1 devstack@n-api.service[113661]: [pid: 113661|app: 0|req: 19/38] 10.222.0.46 () {56 vars in 1074 bytes} [Sat Jan 15 20:40:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:40:24.344681 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi [None req-f12e41ac-9d33-4523-a7be-3e60b794a9fe admin admin] Calling method '>' {{(pid=113662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:40:24.350420 ncdv-master-1 devstack@n-api.service[113662]: INFO nova.api.openstack.wsgi [None req-f12e41ac-9d33-4523-a7be-3e60b794a9fe admin admin] HTTP exception thrown: Flavor 42 could not be found. Jan 15 20:40:24.351070 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi [None req-f12e41ac-9d33-4523-a7be-3e60b794a9fe admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=113662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:40:24.351936 ncdv-master-1 devstack@n-api.service[113662]: INFO nova.api.openstack.requestlog [None req-f12e41ac-9d33-4523-a7be-3e60b794a9fe admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.059201 Jan 15 20:40:24.352530 ncdv-master-1 devstack@n-api.service[113662]: [pid: 113662|app: 0|req: 20/39] 10.222.0.46 () {60 vars in 1190 bytes} [Sat Jan 15 20:40:24 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 15 20:40:24.362081 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi [None req-6ca94964-ea8e-420c-98d0-baaa7d2afdb1 admin admin] Calling method '>' {{(pid=113661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:40:24.383423 ncdv-master-1 devstack@n-api.service[113661]: INFO nova.api.openstack.requestlog [None req-6ca94964-ea8e-420c-98d0-baaa7d2afdb1 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025089 Jan 15 20:40:24.383972 ncdv-master-1 devstack@n-api.service[113661]: [pid: 113661|app: 0|req: 20/40] 10.222.0.46 () {60 vars in 1210 bytes} [Sat Jan 15 20:40:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:40:24.402576 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi [None req-a35f66ed-70cc-4453-bb81-a747c7298286 admin admin] Calling method '>' {{(pid=113662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:40:24.423077 ncdv-master-1 devstack@n-api.service[113662]: INFO nova.api.openstack.requestlog [None req-a35f66ed-70cc-4453-bb81-a747c7298286 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.023942 Jan 15 20:40:24.423637 ncdv-master-1 devstack@n-api.service[113662]: [pid: 113662|app: 0|req: 21/41] 10.222.0.46 () {60 vars in 1210 bytes} [Sat Jan 15 20:40:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:40:24.434392 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi [None req-e69df861-8b78-4e4f-ae62-880d04ba534b admin admin] Calling method '>' {{(pid=113661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:40:24.439952 ncdv-master-1 devstack@n-api.service[113661]: INFO nova.api.openstack.wsgi [None req-e69df861-8b78-4e4f-ae62-880d04ba534b admin admin] HTTP exception thrown: Flavor 42 could not be found. Jan 15 20:40:24.441150 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi [None req-e69df861-8b78-4e4f-ae62-880d04ba534b admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=113661) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:40:24.441929 ncdv-master-1 devstack@n-api.service[113661]: INFO nova.api.openstack.requestlog [None req-e69df861-8b78-4e4f-ae62-880d04ba534b admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.011752 Jan 15 20:40:24.442423 ncdv-master-1 devstack@n-api.service[113661]: [pid: 113661|app: 0|req: 21/42] 10.222.0.46 () {60 vars in 1190 bytes} [Sat Jan 15 20:40:24 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 15 20:40:25.765962 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi [None req-a35f66ed-70cc-4453-bb81-a747c7298286 admin admin] Calling method '>' {{(pid=113662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:40:25.766952 ncdv-master-1 devstack@n-api.service[113662]: INFO nova.api.openstack.requestlog [None req-a35f66ed-70cc-4453-bb81-a747c7298286 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 Jan 15 20:40:25.767382 ncdv-master-1 devstack@n-api.service[113662]: [pid: 113662|app: 0|req: 22/43] 10.222.0.46 () {56 vars in 1074 bytes} [Sat Jan 15 20:40:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:40:25.967624 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi [None req-4b39483c-f1c2-4c1a-b27c-fe071b3da37e admin admin] Calling method '>' {{(pid=113661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:40:25.972892 ncdv-master-1 devstack@n-api.service[113661]: INFO nova.api.openstack.wsgi [None req-4b39483c-f1c2-4c1a-b27c-fe071b3da37e admin admin] HTTP exception thrown: Flavor 84 could not be found. Jan 15 20:40:25.973447 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi [None req-4b39483c-f1c2-4c1a-b27c-fe071b3da37e admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=113661) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:40:25.974214 ncdv-master-1 devstack@n-api.service[113661]: INFO nova.api.openstack.requestlog [None req-4b39483c-f1c2-4c1a-b27c-fe071b3da37e admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.060086 Jan 15 20:40:25.974714 ncdv-master-1 devstack@n-api.service[113661]: [pid: 113661|app: 0|req: 22/44] 10.222.0.46 () {60 vars in 1190 bytes} [Sat Jan 15 20:40:25 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 15 20:40:25.984127 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi [None req-60606015-0e59-443f-b577-95be1816620c admin admin] Calling method '>' {{(pid=113662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:40:25.998033 ncdv-master-1 devstack@n-api.service[113662]: INFO nova.api.openstack.requestlog [None req-60606015-0e59-443f-b577-95be1816620c admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017557 Jan 15 20:40:25.998549 ncdv-master-1 devstack@n-api.service[113662]: [pid: 113662|app: 0|req: 23/45] 10.222.0.46 () {60 vars in 1210 bytes} [Sat Jan 15 20:40:25 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 15 20:40:26.007765 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi [None req-e12e207a-67f0-4144-b7ae-4a95eb67affa admin admin] Calling method '>' {{(pid=113661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:40:26.021644 ncdv-master-1 devstack@n-api.service[113661]: INFO nova.api.openstack.requestlog [None req-e12e207a-67f0-4144-b7ae-4a95eb67affa admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017293 Jan 15 20:40:26.022149 ncdv-master-1 devstack@n-api.service[113661]: [pid: 113661|app: 0|req: 23/46] 10.222.0.46 () {60 vars in 1210 bytes} [Sat Jan 15 20:40:26 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:40:26.030927 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi [None req-54d37ec4-8265-4f49-a228-ce7382ac9077 admin admin] Calling method '>' {{(pid=113662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:40:26.036643 ncdv-master-1 devstack@n-api.service[113662]: INFO nova.api.openstack.wsgi [None req-54d37ec4-8265-4f49-a228-ce7382ac9077 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jan 15 20:40:26.037235 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi [None req-54d37ec4-8265-4f49-a228-ce7382ac9077 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=113662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:40:26.037991 ncdv-master-1 devstack@n-api.service[113662]: INFO nova.api.openstack.requestlog [None req-54d37ec4-8265-4f49-a228-ce7382ac9077 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.010466 Jan 15 20:40:26.038469 ncdv-master-1 devstack@n-api.service[113662]: [pid: 113662|app: 0|req: 24/47] 10.222.0.46 () {60 vars in 1190 bytes} [Sat Jan 15 20:40:26 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jan 15 20:40:27.404293 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi [None req-e12e207a-67f0-4144-b7ae-4a95eb67affa admin admin] Calling method '>' {{(pid=113661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:40:27.405309 ncdv-master-1 devstack@n-api.service[113661]: INFO nova.api.openstack.requestlog [None req-e12e207a-67f0-4144-b7ae-4a95eb67affa admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Jan 15 20:40:27.405710 ncdv-master-1 devstack@n-api.service[113661]: [pid: 113661|app: 0|req: 24/48] 10.222.0.46 () {56 vars in 1074 bytes} [Sat Jan 15 20:40:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:40:27.610169 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi [None req-340471e0-a062-457d-846c-cb5007a7b8e0 admin admin] Calling method '>' {{(pid=113662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:40:27.616417 ncdv-master-1 devstack@n-api.service[113662]: INFO nova.api.openstack.wsgi [None req-340471e0-a062-457d-846c-cb5007a7b8e0 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jan 15 20:40:27.616957 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi [None req-340471e0-a062-457d-846c-cb5007a7b8e0 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=113662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:40:27.617738 ncdv-master-1 devstack@n-api.service[113662]: INFO nova.api.openstack.requestlog [None req-340471e0-a062-457d-846c-cb5007a7b8e0 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.059039 Jan 15 20:40:27.618313 ncdv-master-1 devstack@n-api.service[113662]: [pid: 113662|app: 0|req: 25/49] 10.222.0.46 () {60 vars in 1193 bytes} [Sat Jan 15 20:40:27 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 15 20:40:27.627542 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi [None req-6085479b-d687-4101-9a31-567a3bbc5296 admin admin] Calling method '>' {{(pid=113661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:40:27.641395 ncdv-master-1 devstack@n-api.service[113661]: INFO nova.api.openstack.requestlog [None req-6085479b-d687-4101-9a31-567a3bbc5296 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017365 Jan 15 20:40:27.641924 ncdv-master-1 devstack@n-api.service[113661]: [pid: 113661|app: 0|req: 25/50] 10.222.0.46 () {60 vars in 1210 bytes} [Sat Jan 15 20:40:27 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:40:27.652666 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi [None req-7426860f-0cf0-442e-b2af-29485e0cd180 admin admin] Calling method '>' {{(pid=113662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:40:27.665331 ncdv-master-1 devstack@n-api.service[113662]: INFO nova.api.openstack.requestlog [None req-7426860f-0cf0-442e-b2af-29485e0cd180 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017639 Jan 15 20:40:27.665856 ncdv-master-1 devstack@n-api.service[113662]: [pid: 113662|app: 0|req: 26/51] 10.222.0.46 () {60 vars in 1210 bytes} [Sat Jan 15 20:40:27 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:40:27.675983 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi [None req-9bb13c3e-bc91-4de1-bda0-8522845a5850 admin admin] Calling method '>' {{(pid=113661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:40:27.681588 ncdv-master-1 devstack@n-api.service[113661]: INFO nova.api.openstack.wsgi [None req-9bb13c3e-bc91-4de1-bda0-8522845a5850 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jan 15 20:40:27.682169 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi [None req-9bb13c3e-bc91-4de1-bda0-8522845a5850 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=113661) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:40:27.682948 ncdv-master-1 devstack@n-api.service[113661]: INFO nova.api.openstack.requestlog [None req-9bb13c3e-bc91-4de1-bda0-8522845a5850 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011571 Jan 15 20:40:27.683590 ncdv-master-1 devstack@n-api.service[113661]: [pid: 113661|app: 0|req: 26/52] 10.222.0.46 () {60 vars in 1193 bytes} [Sat Jan 15 20:40:27 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jan 15 20:40:29.066695 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi [None req-7426860f-0cf0-442e-b2af-29485e0cd180 admin admin] Calling method '>' {{(pid=113662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:40:29.067692 ncdv-master-1 devstack@n-api.service[113662]: INFO nova.api.openstack.requestlog [None req-7426860f-0cf0-442e-b2af-29485e0cd180 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Jan 15 20:40:29.068085 ncdv-master-1 devstack@n-api.service[113662]: [pid: 113662|app: 0|req: 27/53] 10.222.0.46 () {56 vars in 1074 bytes} [Sat Jan 15 20:40:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:40:29.267164 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi [None req-a251e2a0-1f9a-4b48-969d-a8408a0925f9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=113661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:40:29.286293 ncdv-master-1 devstack@n-api.service[113661]: INFO nova.api.openstack.requestlog [None req-a251e2a0-1f9a-4b48-969d-a8408a0925f9 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.070471 Jan 15 20:40:29.286822 ncdv-master-1 devstack@n-api.service[113661]: [pid: 113661|app: 0|req: 27/54] 10.222.0.46 () {64 vars in 1235 bytes} [Sat Jan 15 20:40:29 2022] POST /compute/v2.1/flavors => generated 404 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:40:30.641676 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi [None req-7426860f-0cf0-442e-b2af-29485e0cd180 admin admin] Calling method '>' {{(pid=113662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:40:30.642695 ncdv-master-1 devstack@n-api.service[113662]: INFO nova.api.openstack.requestlog [None req-7426860f-0cf0-442e-b2af-29485e0cd180 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Jan 15 20:40:30.643078 ncdv-master-1 devstack@n-api.service[113662]: [pid: 113662|app: 0|req: 28/55] 10.222.0.46 () {56 vars in 1074 bytes} [Sat Jan 15 20:40:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:40:30.839840 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi [None req-74d5c5bd-5981-4e50-9cf7-b6c609117ead admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=113661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:40:30.857578 ncdv-master-1 devstack@n-api.service[113661]: INFO nova.api.openstack.requestlog [None req-74d5c5bd-5981-4e50-9cf7-b6c609117ead admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.067822 Jan 15 20:40:30.858108 ncdv-master-1 devstack@n-api.service[113661]: [pid: 113661|app: 0|req: 28/56] 10.222.0.46 () {64 vars in 1235 bytes} [Sat Jan 15 20:40:30 2022] POST /compute/v2.1/flavors => generated 405 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:40:32.246662 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi [None req-7426860f-0cf0-442e-b2af-29485e0cd180 admin admin] Calling method '>' {{(pid=113662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:40:32.247645 ncdv-master-1 devstack@n-api.service[113662]: INFO nova.api.openstack.requestlog [None req-7426860f-0cf0-442e-b2af-29485e0cd180 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001388 Jan 15 20:40:32.248036 ncdv-master-1 devstack@n-api.service[113662]: [pid: 113662|app: 0|req: 29/57] 10.222.0.46 () {56 vars in 1074 bytes} [Sat Jan 15 20:40:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:40:32.451309 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi [None req-ffd70750-c2c3-4553-91c1-afe09f5dcf0a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=113661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:40:32.469765 ncdv-master-1 devstack@n-api.service[113661]: INFO nova.api.openstack.requestlog [None req-ffd70750-c2c3-4553-91c1-afe09f5dcf0a admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.069917 Jan 15 20:40:32.470241 ncdv-master-1 devstack@n-api.service[113661]: [pid: 113661|app: 0|req: 29/58] 10.222.0.46 () {64 vars in 1235 bytes} [Sat Jan 15 20:40:32 2022] POST /compute/v2.1/flavors => generated 407 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:40:33.794457 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi [None req-7426860f-0cf0-442e-b2af-29485e0cd180 admin admin] Calling method '>' {{(pid=113662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:40:33.795447 ncdv-master-1 devstack@n-api.service[113662]: INFO nova.api.openstack.requestlog [None req-7426860f-0cf0-442e-b2af-29485e0cd180 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001399 Jan 15 20:40:33.795833 ncdv-master-1 devstack@n-api.service[113662]: [pid: 113662|app: 0|req: 30/59] 10.222.0.46 () {56 vars in 1074 bytes} [Sat Jan 15 20:40:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:40:33.999664 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi [None req-e4fa50b4-96aa-41df-be55-b11a7fee8f7f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=113661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:40:34.017098 ncdv-master-1 devstack@n-api.service[113661]: INFO nova.api.openstack.requestlog [None req-e4fa50b4-96aa-41df-be55-b11a7fee8f7f admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.069231 Jan 15 20:40:34.017567 ncdv-master-1 devstack@n-api.service[113661]: [pid: 113661|app: 0|req: 30/60] 10.222.0.46 () {64 vars in 1235 bytes} [Sat Jan 15 20:40:33 2022] POST /compute/v2.1/flavors => generated 409 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:40:35.359552 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi [None req-7426860f-0cf0-442e-b2af-29485e0cd180 admin admin] Calling method '>' {{(pid=113662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:40:35.360529 ncdv-master-1 devstack@n-api.service[113662]: INFO nova.api.openstack.requestlog [None req-7426860f-0cf0-442e-b2af-29485e0cd180 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001394 Jan 15 20:40:35.360936 ncdv-master-1 devstack@n-api.service[113662]: [pid: 113662|app: 0|req: 31/61] 10.222.0.46 () {56 vars in 1074 bytes} [Sat Jan 15 20:40:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:40:35.567072 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi [None req-3125d0be-c445-474d-bc8e-99ebb7827db9 admin admin] Calling method '>' {{(pid=113661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:40:35.586611 ncdv-master-1 devstack@n-api.service[113661]: INFO nova.api.openstack.requestlog [None req-3125d0be-c445-474d-bc8e-99ebb7827db9 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.078048 Jan 15 20:40:35.587080 ncdv-master-1 devstack@n-api.service[113661]: [pid: 113661|app: 0|req: 31/62] 10.222.0.46 () {60 vars in 1202 bytes} [Sat Jan 15 20:40:35 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:41:24.864175 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi [None req-7426860f-0cf0-442e-b2af-29485e0cd180 admin admin] Calling method '>' {{(pid=113662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:41:24.865191 ncdv-master-1 devstack@n-api.service[113662]: INFO nova.api.openstack.requestlog [None req-7426860f-0cf0-442e-b2af-29485e0cd180 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001403 Jan 15 20:41:24.865591 ncdv-master-1 devstack@n-api.service[113662]: [pid: 113662|app: 0|req: 32/63] 10.222.0.46 () {54 vars in 930 bytes} [Sat Jan 15 20:41:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:41:24.921543 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi [None req-2944fd98-255d-4dfd-8ead-28718b16ed96 admin admin] Calling method '>' {{(pid=113661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:41:24.942685 ncdv-master-1 devstack@n-api.service[113661]: INFO nova.api.openstack.requestlog [None req-2944fd98-255d-4dfd-8ead-28718b16ed96 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.071349 Jan 15 20:41:24.943232 ncdv-master-1 devstack@n-api.service[113661]: [pid: 113661|app: 0|req: 32/64] 10.222.0.46 () {60 vars in 1291 bytes} [Sat Jan 15 20:41:24 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:41:24.964896 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi [None req-d1075687-c0c9-46fe-a728-78dba80df26c admin admin] Calling method '>' {{(pid=113662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:41:24.973194 ncdv-master-1 devstack@n-api.service[113662]: INFO nova.api.openstack.requestlog [None req-d1075687-c0c9-46fe-a728-78dba80df26c admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011780 Jan 15 20:41:24.973711 ncdv-master-1 devstack@n-api.service[113662]: [pid: 113662|app: 0|req: 33/65] 10.222.0.46 () {60 vars in 1282 bytes} [Sat Jan 15 20:41:24 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:41:24.985761 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi [None req-eb2cd9c9-8956-467e-85c8-7da0c6fdebac admin admin] Calling method '>' {{(pid=113661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:41:24.993616 ncdv-master-1 devstack@n-api.service[113661]: INFO nova.api.openstack.requestlog [None req-eb2cd9c9-8956-467e-85c8-7da0c6fdebac admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012221 Jan 15 20:41:24.994199 ncdv-master-1 devstack@n-api.service[113661]: [pid: 113661|app: 0|req: 33/66] 10.222.0.46 () {60 vars in 1285 bytes} [Sat Jan 15 20:41:24 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:41:25.005272 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi [None req-bbc84485-c175-42fd-8271-ff470993aaef admin admin] Calling method '>' {{(pid=113662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:41:25.012701 ncdv-master-1 devstack@n-api.service[113662]: INFO nova.api.openstack.requestlog [None req-bbc84485-c175-42fd-8271-ff470993aaef admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010824 Jan 15 20:41:25.013251 ncdv-master-1 devstack@n-api.service[113662]: [pid: 113662|app: 0|req: 34/67] 10.222.0.46 () {60 vars in 1285 bytes} [Sat Jan 15 20:41:25 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:41:25.023991 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi [None req-b8912d1a-98a1-486f-908d-8bc23c49e384 admin admin] Calling method '>' {{(pid=113661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:41:25.031310 ncdv-master-1 devstack@n-api.service[113661]: INFO nova.api.openstack.requestlog [None req-b8912d1a-98a1-486f-908d-8bc23c49e384 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010719 Jan 15 20:41:25.031813 ncdv-master-1 devstack@n-api.service[113661]: [pid: 113661|app: 0|req: 34/68] 10.222.0.46 () {60 vars in 1282 bytes} [Sat Jan 15 20:41:25 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:42:50.878310 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi [None req-5a19b3de-0048-4d94-952b-951fc8a74609 tempest-verify_tempest_config-1793621547 tempest-verify_tempest_config-1793621547-project] Calling method '>' {{(pid=113662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:42:50.880287 ncdv-master-1 devstack@n-api.service[113662]: INFO nova.api.openstack.requestlog [None req-5a19b3de-0048-4d94-952b-951fc8a74609 tempest-verify_tempest_config-1793621547 tempest-verify_tempest_config-1793621547-project] 10.222.0.46 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.104619 Jan 15 20:42:50.880815 ncdv-master-1 devstack@n-api.service[113662]: [pid: 113662|app: 0|req: 35/69] 10.222.0.46 () {58 vars in 1133 bytes} [Sat Jan 15 20:42:50 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:46:55.851816 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi [None req-b8912d1a-98a1-486f-908d-8bc23c49e384 admin admin] Calling method '>' {{(pid=113661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:46:55.852805 ncdv-master-1 devstack@n-api.service[113661]: INFO nova.api.openstack.requestlog [None req-b8912d1a-98a1-486f-908d-8bc23c49e384 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001405 Jan 15 20:46:55.853221 ncdv-master-1 devstack@n-api.service[113661]: [pid: 113661|app: 0|req: 35/70] 10.222.0.46 () {56 vars in 1074 bytes} [Sat Jan 15 20:46:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 20:46:56.122534 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi [None req-9a6dcc87-4c33-47b6-9109-a8ca7fec780f admin admin] Calling method '>' {{(pid=113662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:46:56.123693 ncdv-master-1 devstack@n-api.service[113662]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:46:56.123693 ncdv-master-1 devstack@n-api.service[113662]: warnings.warn(msg) Jan 15 20:46:56.125249 ncdv-master-1 devstack@n-api.service[113662]: DEBUG oslo_concurrency.lockutils [None req-9a6dcc87-4c33-47b6-9109-a8ca7fec780f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:46:56.125717 ncdv-master-1 devstack@n-api.service[113662]: DEBUG oslo_concurrency.lockutils [None req-9a6dcc87-4c33-47b6-9109-a8ca7fec780f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:46:56.126495 ncdv-master-1 devstack@n-api.service[113662]: DEBUG oslo_concurrency.lockutils [None req-9a6dcc87-4c33-47b6-9109-a8ca7fec780f admin admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:46:56.126913 ncdv-master-1 devstack@n-api.service[113662]: DEBUG oslo_concurrency.lockutils [None req-9a6dcc87-4c33-47b6-9109-a8ca7fec780f admin admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:46:56.166784 ncdv-master-1 devstack@n-api.service[113662]: INFO nova.api.openstack.requestlog [None req-9a6dcc87-4c33-47b6-9109-a8ca7fec780f admin admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.90 time: 0.157767 Jan 15 20:46:56.167344 ncdv-master-1 devstack@n-api.service[113662]: [pid: 113662|app: 0|req: 36/71] 10.222.0.46 () {60 vars in 1193 bytes} [Sat Jan 15 20:46:56 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:46:57.501721 ncdv-master-1 devstack@n-api.service[113661]: DEBUG nova.api.openstack.wsgi [None req-b8912d1a-98a1-486f-908d-8bc23c49e384 admin admin] Calling method '>' {{(pid=113661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:46:57.502708 ncdv-master-1 devstack@n-api.service[113661]: INFO nova.api.openstack.requestlog [None req-b8912d1a-98a1-486f-908d-8bc23c49e384 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001405 Jan 15 20:46:57.503095 ncdv-master-1 devstack@n-api.service[113661]: [pid: 113661|app: 0|req: 36/72] 10.222.0.46 () {56 vars in 1074 bytes} [Sat Jan 15 20:46:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:46:57.706396 ncdv-master-1 devstack@n-api.service[113662]: DEBUG nova.api.openstack.wsgi [None req-fca75b91-a1af-4d28-8faf-03b06b81c241 admin admin] Calling method '>' {{(pid=113662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:46:57.707558 ncdv-master-1 devstack@n-api.service[113662]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:46:57.707558 ncdv-master-1 devstack@n-api.service[113662]: warnings.warn(msg) Jan 15 20:46:57.709163 ncdv-master-1 devstack@n-api.service[113662]: DEBUG oslo_concurrency.lockutils [None req-fca75b91-a1af-4d28-8faf-03b06b81c241 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:46:57.709585 ncdv-master-1 devstack@n-api.service[113662]: DEBUG oslo_concurrency.lockutils [None req-fca75b91-a1af-4d28-8faf-03b06b81c241 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:46:57.710378 ncdv-master-1 devstack@n-api.service[113662]: DEBUG oslo_concurrency.lockutils [None req-fca75b91-a1af-4d28-8faf-03b06b81c241 admin admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:46:57.710805 ncdv-master-1 devstack@n-api.service[113662]: DEBUG oslo_concurrency.lockutils [None req-fca75b91-a1af-4d28-8faf-03b06b81c241 admin admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:46:57.732859 ncdv-master-1 devstack@n-api.service[113662]: INFO nova.api.openstack.requestlog [None req-fca75b91-a1af-4d28-8faf-03b06b81c241 admin admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.90 time: 0.084265 Jan 15 20:46:57.733403 ncdv-master-1 devstack@n-api.service[113662]: [pid: 113662|app: 0|req: 37/73] 10.222.0.46 () {60 vars in 1193 bytes} [Sat Jan 15 20:46:57 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:47:42.925479 ncdv-master-1 devstack@n-api.service[113660]: Sat Jan 15 20:47:42 2022 - graceful shutdown triggered... Jan 15 20:47:42.925599 ncdv-master-1 systemd[1]: Stopping Devstack devstack@n-api.service... Jan 15 20:47:42.926444 ncdv-master-1 devstack@n-api.service[113662]: Gracefully killing worker 2 (pid: 113662)... Jan 15 20:47:42.926819 ncdv-master-1 devstack@n-api.service[113661]: Gracefully killing worker 1 (pid: 113661)... Jan 15 20:47:43.927276 ncdv-master-1 devstack@n-api.service[113660]: worker 1 buried after 1 seconds Jan 15 20:47:43.927276 ncdv-master-1 devstack@n-api.service[113660]: worker 2 buried after 1 seconds Jan 15 20:47:43.927276 ncdv-master-1 devstack@n-api.service[113660]: goodbye to uWSGI. Jan 15 20:47:43.928888 ncdv-master-1 systemd[1]: devstack@n-api.service: Succeeded. Jan 15 20:47:43.929450 ncdv-master-1 systemd[1]: Stopped Devstack devstack@n-api.service. Jan 15 20:47:43.932219 ncdv-master-1 systemd[1]: Starting Devstack devstack@n-api.service... Jan 15 20:47:44.006629 ncdv-master-1 devstack@n-api.service[129354]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jan 15 20:47:44.021596 ncdv-master-1 devstack@n-api.service[129354]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Jan 15 20:47:44 2022] *** Jan 15 20:47:44.021596 ncdv-master-1 devstack@n-api.service[129354]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jan 15 20:47:44.021596 ncdv-master-1 devstack@n-api.service[129354]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jan 15 20:47:44.021596 ncdv-master-1 devstack@n-api.service[129354]: nodename: ncdv-master-1 Jan 15 20:47:44.021596 ncdv-master-1 devstack@n-api.service[129354]: machine: x86_64 Jan 15 20:47:44.021596 ncdv-master-1 devstack@n-api.service[129354]: clock source: unix Jan 15 20:47:44.021596 ncdv-master-1 devstack@n-api.service[129354]: pcre jit disabled Jan 15 20:47:44.021596 ncdv-master-1 devstack@n-api.service[129354]: detected number of CPU cores: 4 Jan 15 20:47:44.022277 ncdv-master-1 devstack@n-api.service[129354]: current working directory: / Jan 15 20:47:44.022277 ncdv-master-1 devstack@n-api.service[129354]: detected binary path: /usr/bin/uwsgi-core Jan 15 20:47:44.022277 ncdv-master-1 devstack@n-api.service[129354]: your processes number limit is 47680 Jan 15 20:47:44.022277 ncdv-master-1 devstack@n-api.service[129354]: your memory page size is 4096 bytes Jan 15 20:47:44.022277 ncdv-master-1 devstack@n-api.service[129354]: detected max file descriptor number: 2048 Jan 15 20:47:44.022277 ncdv-master-1 devstack@n-api.service[129354]: lock engine: pthread robust mutexes Jan 15 20:47:44.022277 ncdv-master-1 devstack@n-api.service[129354]: thunder lock: enabled Jan 15 20:47:44.022277 ncdv-master-1 devstack@n-api.service[129354]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jan 15 20:47:44.022277 ncdv-master-1 devstack@n-api.service[129354]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Jan 15 20:47:44.071916 ncdv-master-1 devstack@n-api.service[129354]: Python main interpreter initialized at 0x562091f069c0 Jan 15 20:47:44.071916 ncdv-master-1 devstack@n-api.service[129354]: python threads support enabled Jan 15 20:47:44.071916 ncdv-master-1 devstack@n-api.service[129354]: your server socket listen backlog is limited to 100 connections Jan 15 20:47:44.071916 ncdv-master-1 devstack@n-api.service[129354]: your mercy for graceful operations on workers is 90 seconds Jan 15 20:47:44.072318 ncdv-master-1 devstack@n-api.service[129354]: mapped 403077 bytes (393 KB) for 2 cores Jan 15 20:47:44.072318 ncdv-master-1 devstack@n-api.service[129354]: *** Operational MODE: preforking *** Jan 15 20:47:44.072574 ncdv-master-1 devstack@n-api.service[129354]: *** uWSGI is running in multiple interpreter mode *** Jan 15 20:47:44.072574 ncdv-master-1 devstack@n-api.service[129354]: spawned uWSGI master process (pid: 129354) Jan 15 20:47:44.072780 ncdv-master-1 systemd[1]: Started Devstack devstack@n-api.service. Jan 15 20:47:44.073386 ncdv-master-1 devstack@n-api.service[129354]: spawned uWSGI worker 1 (pid: 129365, cores: 1) Jan 15 20:47:44.075116 ncdv-master-1 devstack@n-api.service[129354]: spawned uWSGI worker 2 (pid: 129366, cores: 1) Jan 15 20:47:44.075116 ncdv-master-1 devstack@n-api.service[129354]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jan 15 20:47:46.198358 ncdv-master-1 devstack@n-api.service[129366]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 15 20:47:46.198358 ncdv-master-1 devstack@n-api.service[129366]: from cryptography.utils import int_from_bytes Jan 15 20:47:46.199054 ncdv-master-1 devstack@n-api.service[129366]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 15 20:47:46.199054 ncdv-master-1 devstack@n-api.service[129366]: from cryptography.utils import int_from_bytes Jan 15 20:47:46.261478 ncdv-master-1 devstack@n-api.service[129365]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 15 20:47:46.261478 ncdv-master-1 devstack@n-api.service[129365]: from cryptography.utils import int_from_bytes Jan 15 20:47:46.262168 ncdv-master-1 devstack@n-api.service[129365]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 15 20:47:46.262168 ncdv-master-1 devstack@n-api.service[129365]: from cryptography.utils import int_from_bytes Jan 15 20:47:48.586245 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 15 20:47:48.586778 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 15 20:47:48.586894 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 15 20:47:48.587258 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 15 20:47:48.587515 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 15 20:47:48.587901 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.588232 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.588556 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.588968 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.589310 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.589624 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.589947 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.590291 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.590603 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.590863 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.591180 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.591508 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.591835 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.592186 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.592506 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.592825 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.593154 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.593494 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.593787 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.594830 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.595258 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.595574 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.595887 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.596228 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.596549 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.596872 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.597199 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.597523 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.597841 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.598150 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.598550 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.598870 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.599201 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.599501 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.599918 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.600236 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.600562 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.600893 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.601233 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.601547 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.601877 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.602204 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.602525 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.602848 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.603154 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.603464 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.603775 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.604097 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.604406 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.604715 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.604992 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.605304 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.605629 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.605953 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.606278 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.606536 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.606776 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.607096 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.607420 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.607732 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.608042 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.608349 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.608661 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.608992 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.609304 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.610163 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.610478 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.610866 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.611115 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.611440 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.611750 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.612074 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.612542 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.612745 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.613060 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.613403 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.613724 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.614038 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.614361 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.614689 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.615007 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.615317 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.615629 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.615952 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.616291 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.616600 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.616869 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.617177 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.617486 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.617810 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.618120 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.618430 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.618739 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.619041 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.619351 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.619662 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.619971 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.620280 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.620590 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.620924 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.621237 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.621547 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.621869 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.622236 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.622531 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.622842 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.623166 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.623477 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.623787 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.624112 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.624424 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.624738 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.625086 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.625488 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.626050 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.626403 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.626713 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.627030 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.627546 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.627855 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.628164 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.628678 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.629014 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.629343 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.629655 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.629965 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.630275 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.630588 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.630896 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.631202 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.631508 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.631831 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.632155 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.632500 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.632782 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.633119 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.633451 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.633796 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.634133 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.634478 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.634803 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.635144 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.635480 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.635802 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.636124 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.636444 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.636775 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.637115 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.637435 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.637749 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.638073 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.638397 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.638732 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.639052 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.639373 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.639695 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.640010 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.640331 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.640666 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.641045 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.641363 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.641711 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.642056 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.642374 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.642704 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.643018 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.643342 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.643660 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.643977 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.644293 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.644628 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.644972 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.645291 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.645631 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.645952 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.646272 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.646581 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.646889 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.647192 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.647513 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.647821 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.648144 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.648477 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.648786 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.649156 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.649467 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.649784 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.650099 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.650423 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.650756 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.651081 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.651374 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.651702 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.652031 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.652339 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.652668 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.653007 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.653319 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.653639 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.653955 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.654270 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.654585 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.654918 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.655270 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.655545 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.655882 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.656219 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.657112 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.657457 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.657790 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.658112 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.658421 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.658729 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.659030 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.659533 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.659847 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.660158 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.660640 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.660996 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.661297 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.661609 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.661917 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.662245 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.662559 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.662865 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.663174 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.663482 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.663829 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.664137 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.664483 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.664820 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.665164 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.665495 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.665813 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.666129 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.666443 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.666759 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.667072 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.667385 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.667711 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.668027 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.668350 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.668664 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.669015 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.669331 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.669712 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.669966 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.670284 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.670629 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.670966 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.671286 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.671611 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.671926 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.673163 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.673661 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.673984 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.674301 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.674619 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.674947 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.675262 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.675593 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.675918 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.676232 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.676547 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.676893 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.677207 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.677528 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.677863 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.678200 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.678515 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.678834 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.679160 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.679477 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.679792 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.680108 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.680419 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.680723 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.681063 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.681385 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.681701 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.682016 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.682325 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.682641 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.682953 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.683259 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.683566 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.683880 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.684206 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.684520 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.684857 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.685210 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.685641 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.685922 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.686253 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.686565 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.686873 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.687181 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.687485 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.688020 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.688430 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.688747 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.689099 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.689443 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.689762 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.690086 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.690404 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.690735 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.691067 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.691387 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.691702 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.692019 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.692334 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.692651 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.692989 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.693318 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.693633 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.693951 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.694267 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.694574 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.694890 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.695214 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.695871 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.696221 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.696466 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.696802 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.697442 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.697442 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.697798 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.698144 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.698464 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.698778 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.699107 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.699417 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.699727 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.700058 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.700366 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.700676 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.701007 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.701322 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.701630 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.701939 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.702291 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.702627 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.702945 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.703292 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.703833 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.704243 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.704581 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.704923 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.705241 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.705561 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.705871 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.706223 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.706538 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.706898 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.707249 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.707596 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.707910 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.708242 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.708567 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.708940 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.709282 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.709595 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.709923 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.710236 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.710544 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.710874 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.711189 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.711503 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.711817 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.712124 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.712436 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.712744 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.713162 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.713481 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.713794 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.714104 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.714418 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.714729 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.715035 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.715354 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.715660 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.715981 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.716290 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.716602 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.716934 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.717251 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.717567 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.717873 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.718202 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.718518 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.718825 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.719658 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.719973 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.720282 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.720589 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.720928 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.721259 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.721580 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.721888 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.722202 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.722510 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.722834 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.723143 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.723455 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.723760 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.724065 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.724373 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.724678 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.725007 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.725332 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.725643 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.725955 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.726263 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.726567 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.726914 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.727222 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.727581 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.727893 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.728212 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.728536 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.728865 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.729185 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.729502 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.729810 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.730129 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.730443 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.730760 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.731071 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.731379 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.731707 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.732022 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.732337 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.732663 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.733021 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.733354 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.733667 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.733982 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.734315 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.734757 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.735079 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.735395 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.735730 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.736049 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.736186 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 15 20:47:48.736625 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.736759 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 15 20:47:48.736996 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.737116 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 15 20:47:48.737238 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.737439 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.737573 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 15 20:47:48.737573 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 15 20:47:48.738054 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.738054 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.738275 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.738398 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.738520 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.738727 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.738844 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.739991 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.740183 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.740292 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.740381 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.740473 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.740559 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.740657 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.740744 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.740869 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.741809 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.741947 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.742026 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.742115 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.742189 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.742261 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.742341 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.742427 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.742520 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.742607 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.742700 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.742791 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.742876 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.742948 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.743101 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.743193 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.743279 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.743371 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.743467 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.743568 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.743668 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.743763 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.743848 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.743933 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.744163 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.744282 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.744476 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.744577 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.744785 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.744914 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.745129 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.745232 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.745486 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.745589 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.745796 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.745897 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.746109 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.746216 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.746419 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.746514 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.746729 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.746829 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.747056 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.747178 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.747364 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.747458 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.747690 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.747783 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.748125 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.748219 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.748380 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.748474 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.748716 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.748977 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.749142 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.749236 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.749459 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.749612 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.749776 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.749996 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.750088 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.750688 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.750984 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.751316 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.751504 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.751617 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.751830 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.751925 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.752172 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.752274 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.752507 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.752609 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.752856 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.752953 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.753185 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.753278 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.753498 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.753596 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.753805 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.753904 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.754122 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.754221 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.754446 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.754551 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.754758 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.754860 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.755072 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.755165 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.755326 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.755485 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.755641 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.755822 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.755973 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.756140 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.756302 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.756468 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.756631 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.756801 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.756915 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.757144 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.757250 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.757453 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.757547 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.757770 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.757881 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.758085 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.758205 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.758399 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.758513 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.758712 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.758822 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.759023 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.759127 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.759334 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.759471 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.759648 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.759799 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.759961 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.760071 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.760270 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.760372 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.760578 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.760722 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.760926 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.761073 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.761234 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.761334 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.761558 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.761653 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.761873 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.761964 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.762200 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.762294 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.762519 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.762619 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.762827 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.762920 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.763157 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.763258 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.763472 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.763574 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.763779 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.763880 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.764087 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.764189 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.764393 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.764488 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.764723 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.764822 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.765067 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.765196 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.765379 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.765518 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.765755 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.766855 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.767038 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.767143 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.767403 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.767729 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.767993 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.768310 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.768412 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.768629 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.768724 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.769015 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.769114 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.769319 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.769414 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.769642 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.769762 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.769949 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.770075 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.770264 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.770583 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.770683 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.771008 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.771112 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.771325 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.771419 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.771633 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.771726 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.771972 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.772071 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.772257 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.772359 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.772554 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.772644 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.772885 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.772995 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.773196 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.773326 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.773513 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.773780 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.773884 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.774119 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.774214 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.774443 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.774537 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.774756 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.774852 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.775065 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.775167 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.775380 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.775475 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.775700 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.775803 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.776033 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.776130 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.776352 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.776448 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.776669 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.776779 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.777042 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.777150 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.777359 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.777465 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.777675 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.777792 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.778003 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.778164 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.778338 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.778557 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.778714 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.778876 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.779025 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.779259 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.779413 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.779574 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.779736 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.779887 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.780035 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.780208 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.780714 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.780914 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.781283 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.781679 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.781848 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.782029 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.782261 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.782427 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.782675 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.782837 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.782837 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.783144 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.783317 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.783637 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.783795 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.783943 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.784100 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.784258 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.784414 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.784577 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.784748 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.784934 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.785090 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.785240 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.785396 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.785554 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.785703 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.785859 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.786017 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.786168 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:47:48.786330 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.786480 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.786637 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.786805 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.786961 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.787113 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.787323 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.787497 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.787647 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.787803 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.787973 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.788131 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.788280 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.788429 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.788601 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.788854 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.789013 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.789183 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.789427 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.789591 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.789740 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.789897 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.790055 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.790214 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.790364 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.790879 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.791045 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.791234 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.791473 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.791628 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.791776 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.791925 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.792072 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.792245 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.792478 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.792641 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.792789 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.793164 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.793442 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.793782 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.793954 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.794105 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.794254 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.794411 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.794563 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.794726 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.794877 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.795026 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.795181 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.795341 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.795341 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.795646 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.795807 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.795955 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.796101 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.796249 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.796404 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.796561 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.796719 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.797492 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.797916 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.798074 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.798222 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.798222 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.798525 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.798674 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.798842 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.799068 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.799231 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.799404 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.799626 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.799793 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.799942 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.799942 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.799942 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.800369 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.800524 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.801064 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.801237 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.801396 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.801644 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.801807 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.802110 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.802266 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.802424 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.802661 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.802828 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.802979 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.803126 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.803274 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.803456 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.803703 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.803921 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.804175 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.804338 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.804515 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.804763 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.804963 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.805158 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.805312 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.805469 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.805626 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.805786 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.805948 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.806107 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.806263 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.806420 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.806576 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.806731 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.806893 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.807044 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.807201 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.807351 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.807498 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.807662 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.807831 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.807980 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.808127 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.808275 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.808423 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.808579 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.808730 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.808907 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.809093 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.809311 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.809465 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.809643 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.809872 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.810038 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.810194 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.810405 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.810569 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.810725 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.811182 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.811341 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.811490 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.811663 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.811967 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.812124 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.812280 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.812431 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.812591 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.813498 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.813698 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.813968 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.814212 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.814460 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.814624 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.814774 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.814932 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.815089 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.815239 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.815394 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.815545 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.815705 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.815863 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.816020 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.816176 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.816332 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.816482 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.816651 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.816804 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.816979 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.817139 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.817288 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.817444 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.817613 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.817613 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.817613 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.818038 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.818192 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.818348 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.818506 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.818655 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.818803 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.818950 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.819104 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.819261 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.819503 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.819668 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.819817 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.820114 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.820114 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.820413 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.820564 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.820712 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.820903 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.821360 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.821525 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.821690 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.821841 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.822081 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.826581 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.826762 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.826915 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.827076 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.827223 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.827367 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.827510 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.827663 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.827806 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.827961 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.828106 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.828409 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.828574 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.828726 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.828946 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.829105 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.829256 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.829399 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.829627 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.829785 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.829937 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.830100 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.830315 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.830461 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.830616 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.830774 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.830929 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.831223 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.831537 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.831686 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.831836 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.831989 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.832216 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.832375 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.832518 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.832659 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.832808 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.832987 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.833150 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.833302 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.833445 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.833593 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.833742 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.833893 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.834041 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.834190 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.834332 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.834473 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.834613 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.834810 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.834966 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.835116 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.835256 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.835440 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.835598 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.835749 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.835899 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.836048 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.836197 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.836704 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.836912 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.837064 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.837206 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.837371 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.837514 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.837656 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.837805 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.837956 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.838099 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.838248 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.838397 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.838547 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.838699 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.838841 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.838982 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.839130 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.839279 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.839435 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.839578 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.839807 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.839953 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.840102 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.840245 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.840490 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.840648 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.840801 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.840968 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.841111 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.841405 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.841735 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.841896 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.842039 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.842196 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.842420 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.842567 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.842708 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.842850 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.842999 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.843141 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.843296 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.843447 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.843609 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.843751 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.843982 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.844141 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.844293 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.844436 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.844578 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.844718 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.844885 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.845051 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.845195 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.845345 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.845496 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.845649 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.845799 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.845956 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.846100 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.846248 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.846391 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.846761 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.846995 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.847155 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.847307 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.847449 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.847598 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.847751 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.847902 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.848054 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.848196 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.848345 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.848494 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.848635 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.848795 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.848962 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.849107 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.849249 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.849400 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.849542 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.849708 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.849940 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.850088 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.850231 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.850388 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.850618 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.850779 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.850930 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.851080 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.851232 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.851520 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.851520 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.852002 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.852147 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.852297 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.852533 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.852690 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.852690 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.853040 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.853183 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.853327 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.853468 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.853619 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.853771 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.853922 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.854075 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.854224 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.854224 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.854224 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.854640 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.854789 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.854930 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.855071 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.855211 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.855361 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.855503 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.855654 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.855810 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.855969 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 15 20:47:48.856113 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.856113 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.856113 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.856113 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.856113 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.856113 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.856113 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.856113 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.857551 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.857551 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.857551 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.857551 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.857551 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.857551 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.857551 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.857551 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.858634 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.858634 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.858634 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.858634 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.858634 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.858634 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.858634 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.858634 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.860458 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.860458 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.860458 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.860458 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.860458 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.860458 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.860458 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.860458 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.862260 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.862260 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.862260 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.862260 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.862260 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.862260 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.862260 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.862260 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.863438 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.863438 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.863438 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.863438 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.863438 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.863438 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.863438 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.863438 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.864496 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.864496 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.864496 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.864496 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.864496 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.864496 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.865746 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.865746 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.865746 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.865746 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.866549 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.866549 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.867373 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.867373 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.867373 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.868005 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.868005 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.868426 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.868426 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.868814 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.869087 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.869426 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.871087 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.871087 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.871087 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.871087 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.871087 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.872611 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.873084 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_db.sqlalchemy.engines [None req-b28603cc-37f0-4775-90a9-ea72e5dd97f5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129366) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 20:47:48.873267 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.873267 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.873267 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.873267 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.873267 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.873267 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.874156 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.874156 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.874156 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.874561 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.874721 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.874934 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.875964 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.876817 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.877349 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.877727 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.877879 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.878116 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.878433 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.878794 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.879112 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.879490 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.879867 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.880120 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.880456 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.880780 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.881152 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.881449 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.881777 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.882083 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.882510 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.882719 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.883063 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.883344 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.883680 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.884000 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.884319 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.884652 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.885016 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.885355 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.885671 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.885992 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.886313 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.886630 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.887874 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.887874 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.887874 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.887874 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.888493 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.888493 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.888793 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.889119 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.889439 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.889757 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.890072 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.890404 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.891027 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.891628 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.891967 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.892288 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.892664 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.892967 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.893423 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.893742 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.894069 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.894388 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.894713 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.895038 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.895366 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.895694 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.896010 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.896443 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.896766 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.897115 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.897474 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.897752 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.898035 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.898352 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.898686 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.899001 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.899313 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.899625 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.899955 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.900266 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.900615 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.901049 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.901435 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.901778 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.902597 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.903107 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.903691 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.904304 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.905048 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.905688 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.906280 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.907221 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.907822 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.908448 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.909110 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.909723 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.910343 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.910953 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.911576 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.912206 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.912486 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.913058 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.913553 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.913906 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.914240 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.914587 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.914935 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.915258 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.915579 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.915903 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.916223 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.916542 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.916902 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.917226 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.917554 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.917980 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.918197 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.918501 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.918818 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.919154 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.919469 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.919802 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.920125 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.920459 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.920792 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.921126 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.921458 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.921781 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.923251 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.923820 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.924151 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.924517 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.924868 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.925202 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.925551 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.925894 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.926222 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.926570 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.926911 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.927241 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.927572 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.927924 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.928321 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.928577 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.928862 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.929198 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.929515 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.929832 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.930148 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.930458 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.930771 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.931157 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.931416 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.931730 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.932063 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.932380 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.932943 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.933469 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.933469 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.933905 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.934072 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.934750 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.935252 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.935853 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.936481 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.937119 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.937857 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.938430 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.939050 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.939664 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.940279 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.940925 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.941549 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.942156 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.942812 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.943689 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.943997 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.944401 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.945167 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.945338 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.context [None req-b28603cc-37f0-4775-90a9-ea72e5dd97f5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2935be83-7c51-430d-8ff2-0a8179973c9a(cell1) {{(pid=129366) load_cells /opt/stack/nova/nova/context.py:464}} Jan 15 20:47:48.945659 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.946020 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.946332 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.946666 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.947000 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.947332 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.947662 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.947989 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.948453 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.948641 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.949012 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.949348 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.949506 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b28603cc-37f0-4775-90a9-ea72e5dd97f5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:47:48.949675 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.950030 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.950361 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.950690 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.950980 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b28603cc-37f0-4775-90a9-ea72e5dd97f5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:47:48.951148 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.951330 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.951701 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.952009 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b28603cc-37f0-4775-90a9-ea72e5dd97f5 None None] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:47:48.952280 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.952446 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.952646 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.952999 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.954693 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.954884 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b28603cc-37f0-4775-90a9-ea72e5dd97f5 None None] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:47:48.955058 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.955221 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.955428 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.955760 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.956087 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.956412 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.956740 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.957096 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.957435 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.957908 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.958105 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.958580 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.958770 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.959147 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.959624 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.959949 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.960302 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.960622 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.961010 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.961322 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.961623 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.961966 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.962325 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.962595 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.962919 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.963239 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.963553 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.963893 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.964253 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.964512 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.964965 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.965184 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.965353 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_db.sqlalchemy.engines [None req-b28603cc-37f0-4775-90a9-ea72e5dd97f5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129366) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 20:47:48.965753 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.966114 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.966443 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.966783 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.967135 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.967526 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.967787 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.968118 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.968416 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.968969 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.969374 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.970197 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.970595 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.970779 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.971088 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.971418 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.971736 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.972063 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.972390 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.972707 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.973238 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.973420 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.973704 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.974018 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.974398 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.974647 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.975119 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.975287 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.975584 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.975900 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_db.sqlalchemy.engines [None req-b28603cc-37f0-4775-90a9-ea72e5dd97f5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129366) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 20:47:48.976067 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.976226 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.977921 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.977921 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.977921 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.977921 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.977921 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.978700 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.978700 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.978700 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.979475 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.979475 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.979900 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.980059 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.980270 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.980631 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.980985 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.981576 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.981975 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.982309 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.982709 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.983017 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.983336 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.983659 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.983973 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.984305 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.985394 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.986105 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.986436 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.986762 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.987086 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.987411 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.987733 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.988054 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.988377 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.988705 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.989099 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.990045 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.990045 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.990354 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.990564 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.990893 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.991834 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.991834 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.991834 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.992281 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.992476 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.992883 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.993153 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.993595 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.993921 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.994251 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.994587 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.994906 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.995268 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.995658 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.995873 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.996201 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.996522 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.996880 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.997238 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.997579 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.997915 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.998229 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.998541 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.998854 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.999223 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.999490 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:48.999834 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:49.000520 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:49.001220 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:49.002639 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:49.002980 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:49.003300 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:49.003639 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:49.003982 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:49.004318 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:49.004643 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:49.005021 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:49.005348 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:49.005671 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:49.005992 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:49.006314 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:49.006634 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:49.006955 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:49.007293 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:49.007631 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:49.007948 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:49.008285 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:49.008613 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:49.008966 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:49.009296 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:49.009615 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:49.009958 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:49.010281 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:49.010608 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:49.010929 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:49.011248 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:49.011573 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:49.011900 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:49.012240 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:49.012574 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:49.012940 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:49.013279 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:49.013641 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:49.013965 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:49.014327 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:49.014674 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:49.014997 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:49.015317 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:49.015631 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:47:49.016651 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 15 20:47:49.041513 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_db.sqlalchemy.engines [None req-247dbaad-0ef1-4e64-987b-ae3c7b8f7c92 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129365) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 20:47:49.114072 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.context [None req-247dbaad-0ef1-4e64-987b-ae3c7b8f7c92 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2935be83-7c51-430d-8ff2-0a8179973c9a(cell1) {{(pid=129365) load_cells /opt/stack/nova/nova/context.py:464}} Jan 15 20:47:49.118284 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-247dbaad-0ef1-4e64-987b-ae3c7b8f7c92 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:47:49.119897 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-247dbaad-0ef1-4e64-987b-ae3c7b8f7c92 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:47:49.120749 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-247dbaad-0ef1-4e64-987b-ae3c7b8f7c92 None None] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:47:49.122740 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-247dbaad-0ef1-4e64-987b-ae3c7b8f7c92 None None] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:47:49.134615 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_db.sqlalchemy.engines [None req-247dbaad-0ef1-4e64-987b-ae3c7b8f7c92 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129365) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 20:47:49.135599 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_db.sqlalchemy.engines [None req-247dbaad-0ef1-4e64-987b-ae3c7b8f7c92 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129365) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 20:47:49.138609 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_db.sqlalchemy.engines [None req-b28603cc-37f0-4775-90a9-ea72e5dd97f5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129366) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 20:47:49.308226 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_db.sqlalchemy.engines [None req-247dbaad-0ef1-4e64-987b-ae3c7b8f7c92 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129365) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 20:47:49.582750 ncdv-master-1 devstack@n-api.service[129366]: WARNING keystonemiddleware.auth_token [None req-b28603cc-37f0-4775-90a9-ea72e5dd97f5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 15 20:47:49.589450 ncdv-master-1 devstack@n-api.service[129366]: WARNING keystonemiddleware.auth_token [None req-b28603cc-37f0-4775-90a9-ea72e5dd97f5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 15 20:47:49.759925 ncdv-master-1 devstack@n-api.service[129365]: WARNING keystonemiddleware.auth_token [None req-247dbaad-0ef1-4e64-987b-ae3c7b8f7c92 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 15 20:47:49.767743 ncdv-master-1 devstack@n-api.service[129365]: WARNING keystonemiddleware.auth_token [None req-247dbaad-0ef1-4e64-987b-ae3c7b8f7c92 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 15 20:47:49.818521 ncdv-master-1 devstack@n-api.service[129366]: WARNING keystonemiddleware.auth_token [None req-b28603cc-37f0-4775-90a9-ea72e5dd97f5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 15 20:47:49.823752 ncdv-master-1 devstack@n-api.service[129366]: WARNING keystonemiddleware.auth_token [None req-b28603cc-37f0-4775-90a9-ea72e5dd97f5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 15 20:47:49.829487 ncdv-master-1 devstack@n-api.service[129366]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x562091f069c0 pid: 129366 (default app) Jan 15 20:47:49.993106 ncdv-master-1 devstack@n-api.service[129365]: WARNING keystonemiddleware.auth_token [None req-247dbaad-0ef1-4e64-987b-ae3c7b8f7c92 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 15 20:47:49.998255 ncdv-master-1 devstack@n-api.service[129365]: WARNING keystonemiddleware.auth_token [None req-247dbaad-0ef1-4e64-987b-ae3c7b8f7c92 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 15 20:47:50.003713 ncdv-master-1 devstack@n-api.service[129365]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x562091f069c0 pid: 129365 (default app) Jan 15 20:48:30.190347 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-70005657-a743-4770-8fcc-b86d159682c8 tempest-FlavorsAdminTestJSON-554634588 tempest-FlavorsAdminTestJSON-554634588-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1122623901", "id": 1023805521, "os-flavor-access:is_public": "True"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:48:30.209051 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:48:30.209051 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:48:30.244802 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-70005657-a743-4770-8fcc-b86d159682c8 tempest-FlavorsAdminTestJSON-554634588 tempest-FlavorsAdminTestJSON-554634588-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 1.046554 Jan 15 20:48:30.245698 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1/1] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 20:48:29 2022] POST /compute/v2.1/flavors => generated 430 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:48:30.453536 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-09c03fc8-2b4f-4c18-b86f-f895f9de5532 tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] Calling method '.version_select at 0x7f30cb796ca0>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:48:30.454339 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:48:30.454339 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:48:30.461002 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-09c03fc8-2b4f-4c18-b86f-f895f9de5532 tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2935be83-7c51-430d-8ff2-0a8179973c9a(cell1) {{(pid=129366) load_cells /opt/stack/nova/nova/compute/api.py:302}} Jan 15 20:48:30.461851 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-09c03fc8-2b4f-4c18-b86f-f895f9de5532 tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:48:30.462312 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-09c03fc8-2b4f-4c18-b86f-f895f9de5532 tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:48:30.487326 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-09c03fc8-2b4f-4c18-b86f-f895f9de5532 tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:48:30.487774 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-09c03fc8-2b4f-4c18-b86f-f895f9de5532 tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:48:30.501067 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-09c03fc8-2b4f-4c18-b86f-f895f9de5532 tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:48:30.501554 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-09c03fc8-2b4f-4c18-b86f-f895f9de5532 tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:48:30.507355 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-09c03fc8-2b4f-4c18-b86f-f895f9de5532 tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 0.253725 Jan 15 20:48:30.508128 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2/2] 10.222.0.46 () {58 vars in 1166 bytes} [Sat Jan 15 20:48:30 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:48:30.565089 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ba5d65b3-23cc-43c1-838d-1db85110a4b3 tempest-AZAdminV2TestJSON-1580821253 tempest-AZAdminV2TestJSON-1580821253-project-admin] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:48:30.566912 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ba5d65b3-23cc-43c1-838d-1db85110a4b3 tempest-AZAdminV2TestJSON-1580821253 tempest-AZAdminV2TestJSON-1580821253-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:48:30.567352 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ba5d65b3-23cc-43c1-838d-1db85110a4b3 tempest-AZAdminV2TestJSON-1580821253 tempest-AZAdminV2TestJSON-1580821253-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:48:30.568156 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ba5d65b3-23cc-43c1-838d-1db85110a4b3 tempest-AZAdminV2TestJSON-1580821253 tempest-AZAdminV2TestJSON-1580821253-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:48:30.568611 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ba5d65b3-23cc-43c1-838d-1db85110a4b3 tempest-AZAdminV2TestJSON-1580821253 tempest-AZAdminV2TestJSON-1580821253-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:48:30.609299 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ba5d65b3-23cc-43c1-838d-1db85110a4b3 tempest-AZAdminV2TestJSON-1580821253 tempest-AZAdminV2TestJSON-1580821253-project-admin] 10.222.0.46 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 1.042194 Jan 15 20:48:30.609979 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1/3] 10.222.0.46 () {58 vars in 1163 bytes} [Sat Jan 15 20:48:29 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 20:48:30.610798 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-17740c61-759b-4539-8d91-3a0adc7fcd8f tempest-FlavorMetadataValidation-362490015 tempest-FlavorMetadataValidation-362490015-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-309974686", "id": 1163547374, "os-flavor-access:is_public": "True"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:48:30.612411 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:48:30.612411 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:48:30.630520 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-17740c61-759b-4539-8d91-3a0adc7fcd8f tempest-FlavorMetadataValidation-362490015 tempest-FlavorMetadataValidation-362490015-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 470 microversion: 2.86 time: 0.121568 Jan 15 20:48:30.637944 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3/4] 10.222.0.46 () {62 vars in 1187 bytes} [Sat Jan 15 20:48:30 2022] POST /compute/v2.1/flavors => generated 470 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:48:30.642668 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-272b6988-78e8-411f-9b3a-ef3aec038d94 tempest-FlavorsAdminTestJSON-554634588 tempest-FlavorsAdminTestJSON-554634588-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:48:30.643423 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:48:30.643423 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:48:30.667642 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-272b6988-78e8-411f-9b3a-ef3aec038d94 tempest-FlavorsAdminTestJSON-554634588 tempest-FlavorsAdminTestJSON-554634588-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/1023805521" status: 202 len: 0 microversion: 2.1 time: 0.028659 Jan 15 20:48:30.668194 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4/5] 10.222.0.46 () {58 vars in 1160 bytes} [Sat Jan 15 20:48:30 2022] DELETE /compute/v2.1/flavors/1023805521 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 20:48:30.721001 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-21963a26-320b-408b-8646-f06955d1ffd9 tempest-AggregatesAdminNegativeTestJSON-238846009 tempest-AggregatesAdminNegativeTestJSON-238846009-project-admin] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:48:30.721631 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-3491561d-f194-49bc-ba95-090ae7a758f3 tempest-AggregatesAdminTestV241-1799334286 tempest-AggregatesAdminTestV241-1799334286-project-admin] Calling method '.version_select at 0x7f30cb6b7dc0>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:48:30.722950 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:48:30.722950 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:48:30.723450 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:48:30.723450 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:48:30.724522 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3491561d-f194-49bc-ba95-090ae7a758f3 tempest-AggregatesAdminTestV241-1799334286 tempest-AggregatesAdminTestV241-1799334286-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:48:30.725011 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3491561d-f194-49bc-ba95-090ae7a758f3 tempest-AggregatesAdminTestV241-1799334286 tempest-AggregatesAdminTestV241-1799334286-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:48:30.725491 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-21963a26-320b-408b-8646-f06955d1ffd9 tempest-AggregatesAdminNegativeTestJSON-238846009 tempest-AggregatesAdminNegativeTestJSON-238846009-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:48:30.725936 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-21963a26-320b-408b-8646-f06955d1ffd9 tempest-AggregatesAdminNegativeTestJSON-238846009 tempest-AggregatesAdminNegativeTestJSON-238846009-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:48:30.726749 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-21963a26-320b-408b-8646-f06955d1ffd9 tempest-AggregatesAdminNegativeTestJSON-238846009 tempest-AggregatesAdminNegativeTestJSON-238846009-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:48:30.727185 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-21963a26-320b-408b-8646-f06955d1ffd9 tempest-AggregatesAdminNegativeTestJSON-238846009 tempest-AggregatesAdminNegativeTestJSON-238846009-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:48:30.741326 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3491561d-f194-49bc-ba95-090ae7a758f3 tempest-AggregatesAdminTestV241-1799334286 tempest-AggregatesAdminTestV241-1799334286-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:48:30.741781 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3491561d-f194-49bc-ba95-090ae7a758f3 tempest-AggregatesAdminTestV241-1799334286 tempest-AggregatesAdminTestV241-1799334286-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:48:30.750616 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-21963a26-320b-408b-8646-f06955d1ffd9 tempest-AggregatesAdminNegativeTestJSON-238846009 tempest-AggregatesAdminNegativeTestJSON-238846009-project-admin] 10.222.0.46 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.139553 Jan 15 20:48:30.751192 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2/6] 10.222.0.46 () {58 vars in 1175 bytes} [Sat Jan 15 20:48:30 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:48:30.751933 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3491561d-f194-49bc-ba95-090ae7a758f3 tempest-AggregatesAdminTestV241-1799334286 tempest-AggregatesAdminTestV241-1799334286-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:48:30.752386 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3491561d-f194-49bc-ba95-090ae7a758f3 tempest-AggregatesAdminTestV241-1799334286 tempest-AggregatesAdminTestV241-1799334286-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:48:30.758958 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-3491561d-f194-49bc-ba95-090ae7a758f3 tempest-AggregatesAdminTestV241-1799334286 tempest-AggregatesAdminTestV241-1799334286-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1423 microversion: 2.41 time: 0.089724 Jan 15 20:48:30.759667 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 5/7] 10.222.0.46 () {60 vars in 1207 bytes} [Sat Jan 15 20:48:30 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1423 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:48:30.811970 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-5017f19a-8acb-49c2-8d0d-609e6c392df8 tempest-FlavorsV255TestJSON-139265408 tempest-FlavorsV255TestJSON-139265408-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-421188116", "id": 1377350396, "os-flavor-access:is_public": "True"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:48:30.813611 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:48:30.813611 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:48:30.830867 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-5017f19a-8acb-49c2-8d0d-609e6c392df8 tempest-FlavorsV255TestJSON-139265408 tempest-FlavorsV255TestJSON-139265408-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 448 microversion: 2.55 time: 0.070155 Jan 15 20:48:30.831450 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 6/8] 10.222.0.46 () {62 vars in 1187 bytes} [Sat Jan 15 20:48:30 2022] POST /compute/v2.1/flavors => generated 448 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:48:30.835692 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9903a54d-accc-4939-8b13-104efaab1525 tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1232673529", "name": "tempest-test_aggregate-1162651594"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:48:30.852321 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e25ac6b4-3b9f-4b32-ad52-00fc0511461e tempest-AZAdminNegativeTestJSON-1698524451 tempest-AZAdminNegativeTestJSON-1698524451-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:48:30.853187 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:48:30.853187 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:48:30.853807 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:48:30.853807 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:48:30.854435 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-e25ac6b4-3b9f-4b32-ad52-00fc0511461e tempest-AZAdminNegativeTestJSON-1698524451 tempest-AZAdminNegativeTestJSON-1698524451-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '19cae4d3cd9e43a1bff252e6c4c406f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce0308fb99d4074b7c5060bbf5534ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:48:30.855149 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e25ac6b4-3b9f-4b32-ad52-00fc0511461e tempest-AZAdminNegativeTestJSON-1698524451 tempest-AZAdminNegativeTestJSON-1698524451-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:48:30.855272 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.objects.aggregate [None req-9903a54d-accc-4939-8b13-104efaab1525 tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] Generated uuid 93f2250f-9bf7-4c5b-9100-513293848ef5 for aggregate {{(pid=129366) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jan 15 20:48:30.856063 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e25ac6b4-3b9f-4b32-ad52-00fc0511461e tempest-AZAdminNegativeTestJSON-1698524451 tempest-AZAdminNegativeTestJSON-1698524451-project] 10.222.0.46 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.103981 Jan 15 20:48:30.856570 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3/9] 10.222.0.46 () {58 vars in 1184 bytes} [Sat Jan 15 20:48:30 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 105 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:48:30.861154 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e49f53b7-19aa-4d48-ae2b-1a7cac58a467 tempest-AZAdminV2TestJSON-1580821253 tempest-AZAdminV2TestJSON-1580821253-project-admin] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:48:30.863745 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e49f53b7-19aa-4d48-ae2b-1a7cac58a467 tempest-AZAdminV2TestJSON-1580821253 tempest-AZAdminV2TestJSON-1580821253-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:48:30.864206 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e49f53b7-19aa-4d48-ae2b-1a7cac58a467 tempest-AZAdminV2TestJSON-1580821253 tempest-AZAdminV2TestJSON-1580821253-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:48:30.865189 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e49f53b7-19aa-4d48-ae2b-1a7cac58a467 tempest-AZAdminV2TestJSON-1580821253 tempest-AZAdminV2TestJSON-1580821253-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:48:30.865611 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e49f53b7-19aa-4d48-ae2b-1a7cac58a467 tempest-AZAdminV2TestJSON-1580821253 tempest-AZAdminV2TestJSON-1580821253-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:48:30.888605 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e49f53b7-19aa-4d48-ae2b-1a7cac58a467 tempest-AZAdminV2TestJSON-1580821253 tempest-AZAdminV2TestJSON-1580821253-project-admin] 10.222.0.46 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 613 microversion: 2.1 time: 0.030897 Jan 15 20:48:30.889839 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4/10] 10.222.0.46 () {58 vars in 1184 bytes} [Sat Jan 15 20:48:30 2022] GET /compute/v2.1/os-availability-zone/detail => generated 613 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:48:30.894361 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b099b0fc-6af7-4347-958c-0493ab731c64 tempest-FlavorMetadataValidation-362490015 tempest-FlavorMetadataValidation-362490015-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:48:30.896083 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:48:30.896083 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:48:30.971392 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-9903a54d-accc-4939-8b13-104efaab1525 tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.138344 Jan 15 20:48:30.973932 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 7/11] 10.222.0.46 () {60 vars in 1164 bytes} [Sat Jan 15 20:48:30 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:48:30.981620 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-189aa8af-4425-495f-8434-f1ac7e3b252b tempest-FlavorsAdminTestJSON-554634588 tempest-FlavorsAdminTestJSON-554634588-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:48:31.022475 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-189aa8af-4425-495f-8434-f1ac7e3b252b tempest-FlavorsAdminTestJSON-554634588 tempest-FlavorsAdminTestJSON-554634588-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 5829 microversion: 2.1 time: 0.047146 Jan 15 20:48:31.032893 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 8/12] 10.222.0.46 () {58 vars in 1145 bytes} [Sat Jan 15 20:48:30 2022] GET /compute/v2.1/flavors/detail => generated 5829 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:48:31.111138 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b099b0fc-6af7-4347-958c-0493ab731c64 tempest-FlavorMetadataValidation-362490015 tempest-FlavorMetadataValidation-362490015-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors/1163547374/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.220072 Jan 15 20:48:31.111743 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 5/13] 10.222.0.46 () {62 vars in 1264 bytes} [Sat Jan 15 20:48:30 2022] POST /compute/v2.1/flavors/1163547374/os-extra_specs => generated 62 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:48:31.117012 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a07dd159-bd56-48c4-9c11-a355649ecbfe tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:48:31.117797 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:48:31.117797 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:48:31.130485 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a07dd159-bd56-48c4-9c11-a355649ecbfe tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] 10.222.0.46 "GET /compute/v2.1/os-aggregates" status: 200 len: 303 microversion: 2.1 time: 0.017164 Jan 15 20:48:31.136421 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 6/14] 10.222.0.46 () {58 vars in 1142 bytes} [Sat Jan 15 20:48:31 2022] GET /compute/v2.1/os-aggregates => generated 303 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:48:31.136421 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-7db6192c-c356-47ad-9569-1b99e3a1d123 tempest-FlavorsAdminTestJSON-554634588 tempest-FlavorsAdminTestJSON-554634588-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-952013725", "id": 1287929883, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:48:31.153545 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:48:31.153545 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:48:31.172800 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-7db6192c-c356-47ad-9569-1b99e3a1d123 tempest-FlavorsAdminTestJSON-554634588 tempest-FlavorsAdminTestJSON-554634588-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.040700 Jan 15 20:48:31.178668 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 7/15] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 20:48:31 2022] POST /compute/v2.1/flavors => generated 416 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:48:31.178668 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8e887283-b21f-4475-8dfb-7c57becb75bb tempest-FlavorMetadataValidation-362490015 tempest-FlavorMetadataValidation-362490015-project-admin] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:48:31.179169 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:48:31.179169 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:48:31.211953 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-8e887283-b21f-4475-8dfb-7c57becb75bb tempest-FlavorMetadataValidation-362490015 tempest-FlavorMetadataValidation-362490015-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/1163547374" status: 202 len: 0 microversion: 2.86 time: 0.037047 Jan 15 20:48:31.212545 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 8/16] 10.222.0.46 () {60 vars in 1201 bytes} [Sat Jan 15 20:48:31 2022] DELETE /compute/v2.1/flavors/1163547374 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 15 20:48:31.217952 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f3da8d08-bf94-483e-a095-0ef61fb5ce2b tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:48:31.219624 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:48:31.219624 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:48:31.253100 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f3da8d08-bf94-483e-a095-0ef61fb5ce2b tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:48:31.253639 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f3da8d08-bf94-483e-a095-0ef61fb5ce2b tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:48:31.356101 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-209e8a9b-4f12-4352-9cf2-486b55cc2884 tempest-FlavorsV255TestJSON-1067369485 tempest-FlavorsV255TestJSON-1067369485-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:48:31.387913 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-209e8a9b-4f12-4352-9cf2-486b55cc2884 tempest-FlavorsV255TestJSON-1067369485 tempest-FlavorsV255TestJSON-1067369485-project] 10.222.0.46 "GET /compute/v2.1/flavors/1377350396" status: 200 len: 448 microversion: 2.55 time: 0.363617 Jan 15 20:48:31.388905 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 9/17] 10.222.0.46 () {60 vars in 1198 bytes} [Sat Jan 15 20:48:31 2022] GET /compute/v2.1/flavors/1377350396 => generated 448 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:48:31.394361 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e6e375bb-5442-4026-af76-4ae481ad5e11 tempest-FlavorsAdminTestJSON-554634588 tempest-FlavorsAdminTestJSON-554634588-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:48:31.415341 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e6e375bb-5442-4026-af76-4ae481ad5e11 tempest-FlavorsAdminTestJSON-554634588 tempest-FlavorsAdminTestJSON-554634588-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.024469 Jan 15 20:48:31.415931 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 10/18] 10.222.0.46 () {58 vars in 1145 bytes} [Sat Jan 15 20:48:31 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:48:31.422952 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-3e35f141-c1b0-4193-b31f-1c135de7a5d4 tempest-FlavorMetadataValidation-362490015 tempest-FlavorMetadataValidation-362490015-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:48:31.450528 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-3e35f141-c1b0-4193-b31f-1c135de7a5d4 tempest-FlavorMetadataValidation-362490015 tempest-FlavorMetadataValidation-362490015-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 6679 microversion: 2.86 time: 0.032262 Jan 15 20:48:31.451833 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 11/19] 10.222.0.46 () {60 vars in 1186 bytes} [Sat Jan 15 20:48:31 2022] GET /compute/v2.1/flavors/detail => generated 6679 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:48:31.478997 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-334d2fb4-6e31-4e6e-bb4c-fcba8436b1a8 tempest-FlavorsV255TestJSON-139265408 tempest-FlavorsV255TestJSON-139265408-project-admin] Action: 'update', calling method: .version_select at 0x7f30cbbe7670>, body: {"flavor": {"description": "new"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:48:31.490046 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:48:31.490046 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:48:31.526385 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-334d2fb4-6e31-4e6e-bb4c-fcba8436b1a8 tempest-FlavorsV255TestJSON-139265408 tempest-FlavorsV255TestJSON-139265408-project-admin] 10.222.0.46 "PUT /compute/v2.1/flavors/1377350396" status: 200 len: 449 microversion: 2.55 time: 0.073071 Jan 15 20:48:31.527310 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 12/20] 10.222.0.46 () {62 vars in 1218 bytes} [Sat Jan 15 20:48:31 2022] PUT /compute/v2.1/flavors/1377350396 => generated 449 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:48:31.532254 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7508ced8-1f26-47ce-9a06-d3379a02cf6c tempest-FlavorsAdminTestJSON-554634588 tempest-FlavorsAdminTestJSON-554634588-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:48:31.532977 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:48:31.532977 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:48:31.557718 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7508ced8-1f26-47ce-9a06-d3379a02cf6c tempest-FlavorsAdminTestJSON-554634588 tempest-FlavorsAdminTestJSON-554634588-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/1287929883" status: 202 len: 0 microversion: 2.1 time: 0.029278 Jan 15 20:48:31.558632 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 13/21] 10.222.0.46 () {58 vars in 1160 bytes} [Sat Jan 15 20:48:31 2022] DELETE /compute/v2.1/flavors/1287929883 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 20:48:31.565640 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-aa8d0a50-16d0-4176-adfc-1aaca5aaa354 tempest-FlavorsV255TestJSON-1067369485 tempest-FlavorsV255TestJSON-1067369485-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:48:31.604772 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-aa8d0a50-16d0-4176-adfc-1aaca5aaa354 tempest-FlavorsV255TestJSON-1067369485 tempest-FlavorsV255TestJSON-1067369485-project] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 5724 microversion: 2.55 time: 0.044855 Jan 15 20:48:31.605356 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 14/22] 10.222.0.46 () {60 vars in 1186 bytes} [Sat Jan 15 20:48:31 2022] GET /compute/v2.1/flavors/detail => generated 5724 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:48:31.614609 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-3ef2c3fd-949a-440a-97c0-ad96622fe4a7 tempest-FlavorsAdminTestJSON-554634588 tempest-FlavorsAdminTestJSON-554634588-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:48:31.641180 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-3ef2c3fd-949a-440a-97c0-ad96622fe4a7 tempest-FlavorsAdminTestJSON-554634588 tempest-FlavorsAdminTestJSON-554634588-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 5408 microversion: 2.1 time: 0.034577 Jan 15 20:48:31.649712 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 15/23] 10.222.0.46 () {58 vars in 1145 bytes} [Sat Jan 15 20:48:31 2022] GET /compute/v2.1/flavors/detail => generated 5408 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:48:31.671152 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-5da43d55-769b-4221-9d8d-0ba6a01bef28 tempest-FlavorsV255TestJSON-1067369485 tempest-FlavorsV255TestJSON-1067369485-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:48:31.700741 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f3da8d08-bf94-483e-a095-0ef61fb5ce2b tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 315 microversion: 2.1 time: 0.485105 Jan 15 20:48:31.701928 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 9/24] 10.222.0.46 () {60 vars in 1190 bytes} [Sat Jan 15 20:48:31 2022] POST /compute/v2.1/os-aggregates/1/action => generated 315 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:48:31.717695 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-0d73ad85-f6a0-4895-8695-add9c4949232 tempest-FlavorsAdminTestJSON-554634588 tempest-FlavorsAdminTestJSON-554634588-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-3419590", "id": 1463413728, "os-flavor-access:is_public": "True"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:48:31.721548 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:48:31.721548 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:48:31.724922 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-5da43d55-769b-4221-9d8d-0ba6a01bef28 tempest-FlavorsV255TestJSON-1067369485 tempest-FlavorsV255TestJSON-1067369485-project] 10.222.0.46 "GET /compute/v2.1/flavors" status: 200 len: 3156 microversion: 2.55 time: 0.078118 Jan 15 20:48:31.725702 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 16/25] 10.222.0.46 () {60 vars in 1165 bytes} [Sat Jan 15 20:48:31 2022] GET /compute/v2.1/flavors => generated 3156 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:48:31.741001 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-69edb91f-009d-4e69-a3ca-0273913956fb tempest-FlavorsV255TestJSON-139265408 tempest-FlavorsV255TestJSON-139265408-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:48:31.769361 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-69edb91f-009d-4e69-a3ca-0273913956fb tempest-FlavorsV255TestJSON-139265408 tempest-FlavorsV255TestJSON-139265408-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/1377350396" status: 202 len: 0 microversion: 2.55 time: 0.032613 Jan 15 20:48:31.770559 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 17/26] 10.222.0.46 () {60 vars in 1201 bytes} [Sat Jan 15 20:48:31 2022] DELETE /compute/v2.1/flavors/1377350396 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 15 20:48:31.773015 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-0d73ad85-f6a0-4895-8695-add9c4949232 tempest-FlavorsAdminTestJSON-554634588 tempest-FlavorsAdminTestJSON-554634588-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 426 microversion: 2.1 time: 0.062189 Jan 15 20:48:31.773914 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 10/27] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 20:48:31 2022] POST /compute/v2.1/flavors => generated 426 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:48:31.778673 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ace46b76-733a-4164-8952-8bd29626d371 tempest-FlavorsV255TestJSON-139265408 tempest-FlavorsV255TestJSON-139265408-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:48:31.786816 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d1eba6ad-463b-40a1-8e25-0ff983de225b tempest-FlavorsAdminTestJSON-554634588 tempest-FlavorsAdminTestJSON-554634588-project-admin] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:48:31.788061 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:48:31.788061 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:48:31.824085 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ace46b76-733a-4164-8952-8bd29626d371 tempest-FlavorsV255TestJSON-139265408 tempest-FlavorsV255TestJSON-139265408-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 5722 microversion: 2.55 time: 0.048893 Jan 15 20:48:31.839651 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d1eba6ad-463b-40a1-8e25-0ff983de225b tempest-FlavorsAdminTestJSON-554634588 tempest-FlavorsAdminTestJSON-554634588-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/1463413728" status: 202 len: 0 microversion: 2.1 time: 0.057381 Jan 15 20:48:31.840238 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 11/28] 10.222.0.46 () {58 vars in 1160 bytes} [Sat Jan 15 20:48:31 2022] DELETE /compute/v2.1/flavors/1463413728 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 15 20:48:31.843829 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 18/29] 10.222.0.46 () {60 vars in 1186 bytes} [Sat Jan 15 20:48:31 2022] GET /compute/v2.1/flavors/detail => generated 5722 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:48:31.849464 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5a7002ae-b4a1-4592-89a3-ecc46de8758b tempest-FlavorsAdminTestJSON-554634588 tempest-FlavorsAdminTestJSON-554634588-project-admin] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:48:31.884333 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5a7002ae-b4a1-4592-89a3-ecc46de8758b tempest-FlavorsAdminTestJSON-554634588 tempest-FlavorsAdminTestJSON-554634588-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.039559 Jan 15 20:48:31.889281 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 12/30] 10.222.0.46 () {58 vars in 1145 bytes} [Sat Jan 15 20:48:31 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:48:31.904962 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-5f65115b-8efe-482c-a3bf-d75aaddb944d tempest-FlavorsAdminTestJSON-554634588 tempest-FlavorsAdminTestJSON-554634588-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-479944185", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:48:31.907394 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:48:31.907394 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:48:31.928317 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-5f65115b-8efe-482c-a3bf-d75aaddb944d tempest-FlavorsAdminTestJSON-554634588 tempest-FlavorsAdminTestJSON-554634588-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.029675 Jan 15 20:48:31.932907 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 19/31] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 20:48:31 2022] POST /compute/v2.1/flavors => generated 506 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:48:31.942017 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-cffc9114-8592-4992-b113-63eb9929c856 tempest-FlavorsAdminTestJSON-554634588 tempest-FlavorsAdminTestJSON-554634588-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:48:31.959149 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-cffc9114-8592-4992-b113-63eb9929c856 tempest-FlavorsAdminTestJSON-554634588 tempest-FlavorsAdminTestJSON-554634588-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/4618daa3-4d69-425f-9a0e-ddc44e61894e" status: 202 len: 0 microversion: 2.1 time: 0.022086 Jan 15 20:48:31.960100 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 20/32] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 20:48:31 2022] DELETE /compute/v2.1/flavors/4618daa3-4d69-425f-9a0e-ddc44e61894e => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 20:48:31.969885 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-46a7dcaf-a620-4aa8-a1d1-b9d55370bd31 tempest-FlavorsAdminTestJSON-554634588 tempest-FlavorsAdminTestJSON-554634588-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:48:31.998784 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-46a7dcaf-a620-4aa8-a1d1-b9d55370bd31 tempest-FlavorsAdminTestJSON-554634588 tempest-FlavorsAdminTestJSON-554634588-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.033760 Jan 15 20:48:31.999337 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 21/33] 10.222.0.46 () {58 vars in 1145 bytes} [Sat Jan 15 20:48:31 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:48:32.017096 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-dd22b445-79da-4801-8d0b-7bc42a5eeb42 tempest-FlavorsAdminTestJSON-554634588 tempest-FlavorsAdminTestJSON-554634588-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-201390756", "id": "0541d718-6ee3-4012-b481-6fbf630d2d84", "os-flavor-access:is_public": "True"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:48:32.041214 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-dd22b445-79da-4801-8d0b-7bc42a5eeb42 tempest-FlavorsAdminTestJSON-554634588 tempest-FlavorsAdminTestJSON-554634588-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.029987 Jan 15 20:48:32.042056 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 22/34] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 20:48:32 2022] POST /compute/v2.1/flavors => generated 506 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:48:32.056636 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-74164ff2-903e-4d93-b560-83d16f31d260 tempest-FlavorsAdminTestJSON-554634588 tempest-FlavorsAdminTestJSON-554634588-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:48:32.073380 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-74164ff2-903e-4d93-b560-83d16f31d260 tempest-FlavorsAdminTestJSON-554634588 tempest-FlavorsAdminTestJSON-554634588-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/0541d718-6ee3-4012-b481-6fbf630d2d84" status: 202 len: 0 microversion: 2.1 time: 0.023380 Jan 15 20:48:32.074184 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 23/35] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 20:48:32 2022] DELETE /compute/v2.1/flavors/0541d718-6ee3-4012-b481-6fbf630d2d84 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 20:48:32.082135 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-6fe91ec5-dd53-444d-aad4-6c8472efe9e5 tempest-FlavorsAdminTestJSON-554634588 tempest-FlavorsAdminTestJSON-554634588-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:48:32.101109 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-6fe91ec5-dd53-444d-aad4-6c8472efe9e5 tempest-FlavorsAdminTestJSON-554634588 tempest-FlavorsAdminTestJSON-554634588-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.022398 Jan 15 20:48:32.101728 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 24/36] 10.222.0.46 () {58 vars in 1145 bytes} [Sat Jan 15 20:48:32 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:48:32.118361 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-85e77320-fc19-4539-bd66-58ec29c51fcf tempest-FlavorsAdminTestJSON-554634588 tempest-FlavorsAdminTestJSON-554634588-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1951691750", "id": 1612033172, "os-flavor-access:is_public": "True"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:48:32.137108 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-85e77320-fc19-4539-bd66-58ec29c51fcf tempest-FlavorsAdminTestJSON-554634588 tempest-FlavorsAdminTestJSON-554634588-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.022657 Jan 15 20:48:32.137710 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 25/37] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 20:48:32 2022] POST /compute/v2.1/flavors => generated 414 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:48:32.147576 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-6d2fd893-16aa-4799-9e02-aa5664306716 tempest-FlavorsAdminTestJSON-554634588 tempest-FlavorsAdminTestJSON-554634588-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:48:32.155571 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-6d2fd893-16aa-4799-9e02-aa5664306716 tempest-FlavorsAdminTestJSON-554634588 tempest-FlavorsAdminTestJSON-554634588-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/1612033172" status: 200 len: 414 microversion: 2.1 time: 0.011392 Jan 15 20:48:32.156508 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 26/38] 10.222.0.46 () {58 vars in 1157 bytes} [Sat Jan 15 20:48:32 2022] GET /compute/v2.1/flavors/1612033172 => generated 414 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:48:32.414024 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f8b36a93-9aeb-41a5-814f-30d8d2f8c774 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-204370072", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "availability_zone": "tempest-test_az-1232673529"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:48:32.436451 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f8b36a93-9aeb-41a5-814f-30d8d2f8c774 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:48:32.437287 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f8b36a93-9aeb-41a5-814f-30d8d2f8c774 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:48:32.438351 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f8b36a93-9aeb-41a5-814f-30d8d2f8c774 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:48:32.439260 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f8b36a93-9aeb-41a5-814f-30d8d2f8c774 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:48:32.595686 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-585bad31-46a3-46e6-aebe-4af57894ebf6 tempest-FlavorsAdminTestJSON-224030796 tempest-FlavorsAdminTestJSON-224030796-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:48:32.618662 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-585bad31-46a3-46e6-aebe-4af57894ebf6 tempest-FlavorsAdminTestJSON-224030796 tempest-FlavorsAdminTestJSON-224030796-project] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.455420 Jan 15 20:48:32.629540 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 27/39] 10.222.0.46 () {58 vars in 1145 bytes} [Sat Jan 15 20:48:32 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:48:32.634324 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-65f0f6e4-ff4c-4b74-be04-da0eb9fed749 tempest-FlavorsAdminTestJSON-554634588 tempest-FlavorsAdminTestJSON-554634588-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:48:32.657623 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-65f0f6e4-ff4c-4b74-be04-da0eb9fed749 tempest-FlavorsAdminTestJSON-554634588 tempest-FlavorsAdminTestJSON-554634588-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/1612033172" status: 202 len: 0 microversion: 2.1 time: 0.026743 Jan 15 20:48:32.658513 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 28/40] 10.222.0.46 () {58 vars in 1160 bytes} [Sat Jan 15 20:48:32 2022] DELETE /compute/v2.1/flavors/1612033172 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 20:48:32.666264 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b065f7d9-f9b5-4900-8d14-88fbec304c47 tempest-FlavorsAdminTestJSON-554634588 tempest-FlavorsAdminTestJSON-554634588-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:48:32.690480 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b065f7d9-f9b5-4900-8d14-88fbec304c47 tempest-FlavorsAdminTestJSON-554634588 tempest-FlavorsAdminTestJSON-554634588-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.026565 Jan 15 20:48:32.691685 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 29/41] 10.222.0.46 () {58 vars in 1145 bytes} [Sat Jan 15 20:48:32 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:48:32.710120 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e3abd624-5b80-4415-97d3-4d01d1d3f8a2 tempest-FlavorsAdminTestJSON-554634588 tempest-FlavorsAdminTestJSON-554634588-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1953947547", "id": 176615603, "os-flavor-access:is_public": "False"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:48:32.734810 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e3abd624-5b80-4415-97d3-4d01d1d3f8a2 tempest-FlavorsAdminTestJSON-554634588 tempest-FlavorsAdminTestJSON-554634588-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.030704 Jan 15 20:48:32.736165 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 30/42] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 20:48:32 2022] POST /compute/v2.1/flavors => generated 427 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:48:32.746557 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-3e22d3c5-470d-4bba-aab9-cde44bfd77e7 tempest-FlavorsAdminTestJSON-224030796 tempest-FlavorsAdminTestJSON-224030796-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "176615603"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:48:32.772199 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-3e22d3c5-470d-4bba-aab9-cde44bfd77e7 tempest-FlavorsAdminTestJSON-224030796 tempest-FlavorsAdminTestJSON-224030796-project] HTTP exception thrown: Flavor 176615603 could not be found. Jan 15 20:48:32.775103 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-3e22d3c5-470d-4bba-aab9-cde44bfd77e7 tempest-FlavorsAdminTestJSON-224030796 tempest-FlavorsAdminTestJSON-224030796-project] Returning 400 to user: Flavor 176615603 could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:48:32.777593 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-3e22d3c5-470d-4bba-aab9-cde44bfd77e7 tempest-FlavorsAdminTestJSON-224030796 tempest-FlavorsAdminTestJSON-224030796-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 400 len: 80 microversion: 2.1 time: 0.034985 Jan 15 20:48:32.782639 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 31/43] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 20:48:32 2022] POST /compute/v2.1/servers => generated 80 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Jan 15 20:48:32.788870 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0cb1a76b-7c2d-4410-ae66-74b772395f05 tempest-FlavorsAdminTestJSON-554634588 tempest-FlavorsAdminTestJSON-554634588-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:48:32.811503 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0cb1a76b-7c2d-4410-ae66-74b772395f05 tempest-FlavorsAdminTestJSON-554634588 tempest-FlavorsAdminTestJSON-554634588-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/176615603" status: 202 len: 0 microversion: 2.1 time: 0.026361 Jan 15 20:48:32.812168 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 32/44] 10.222.0.46 () {58 vars in 1157 bytes} [Sat Jan 15 20:48:32 2022] DELETE /compute/v2.1/flavors/176615603 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 20:48:32.820963 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b27fa845-7c5a-45d2-9214-7eafeddd53dd tempest-FlavorsAdminTestJSON-554634588 tempest-FlavorsAdminTestJSON-554634588-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:48:32.843579 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b27fa845-7c5a-45d2-9214-7eafeddd53dd tempest-FlavorsAdminTestJSON-554634588 tempest-FlavorsAdminTestJSON-554634588-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.026569 Jan 15 20:48:32.848906 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 33/45] 10.222.0.46 () {58 vars in 1145 bytes} [Sat Jan 15 20:48:32 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:48:32.863357 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-40b5146b-bb1e-40f7-9fc1-fc8db6e317ac tempest-FlavorsAdminTestJSON-554634588 tempest-FlavorsAdminTestJSON-554634588-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-539841333", "id": 696136706, "os-flavor-access:is_public": "False"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:48:32.898199 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-40b5146b-bb1e-40f7-9fc1-fc8db6e317ac tempest-FlavorsAdminTestJSON-554634588 tempest-FlavorsAdminTestJSON-554634588-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.041170 Jan 15 20:48:32.906473 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 34/46] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 20:48:32 2022] POST /compute/v2.1/flavors => generated 411 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:48:32.911805 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-dc3e5976-99df-4f69-be20-a006e7a7fc28 tempest-FlavorsAdminTestJSON-554634588 tempest-FlavorsAdminTestJSON-554634588-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-228188366", "id": 1504221880, "os-flavor-access:is_public": "True"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:48:32.943395 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-dc3e5976-99df-4f69-be20-a006e7a7fc28 tempest-FlavorsAdminTestJSON-554634588 tempest-FlavorsAdminTestJSON-554634588-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.033208 Jan 15 20:48:32.949206 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 35/47] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 20:48:32 2022] POST /compute/v2.1/flavors => generated 413 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:48:32.960760 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-64f480fe-184a-4029-9198-719825899ce7 tempest-FlavorsAdminTestJSON-554634588 tempest-FlavorsAdminTestJSON-554634588-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:48:32.989090 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-64f480fe-184a-4029-9198-719825899ce7 tempest-FlavorsAdminTestJSON-554634588 tempest-FlavorsAdminTestJSON-554634588-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 414 microversion: 2.1 time: 0.038456 Jan 15 20:48:32.989873 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 36/48] 10.222.0.46 () {58 vars in 1168 bytes} [Sat Jan 15 20:48:32 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 414 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 20:48:33.008108 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-fa23b085-18a7-4322-93a7-f24fd9933347 tempest-FlavorsAdminTestJSON-554634588 tempest-FlavorsAdminTestJSON-554634588-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:48:33.017230 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-fa23b085-18a7-4322-93a7-f24fd9933347 tempest-FlavorsAdminTestJSON-554634588 tempest-FlavorsAdminTestJSON-554634588-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 414 microversion: 2.1 time: 0.013082 Jan 15 20:48:33.017998 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 37/49] 10.222.0.46 () {58 vars in 1176 bytes} [Sat Jan 15 20:48:33 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 414 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 20:48:33.029057 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-67608021-aba8-444b-9eab-2222ae79461d tempest-FlavorsAdminTestJSON-554634588 tempest-FlavorsAdminTestJSON-554634588-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:48:33.038586 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-67608021-aba8-444b-9eab-2222ae79461d tempest-FlavorsAdminTestJSON-554634588 tempest-FlavorsAdminTestJSON-554634588-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 414 microversion: 2.1 time: 0.012894 Jan 15 20:48:33.045931 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 38/50] 10.222.0.46 () {58 vars in 1170 bytes} [Sat Jan 15 20:48:33 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 414 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:48:33.050641 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-19311ea1-8505-4e40-99c2-22b3a533e8df tempest-FlavorsAdminTestJSON-554634588 tempest-FlavorsAdminTestJSON-554634588-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:48:33.060318 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-19311ea1-8505-4e40-99c2-22b3a533e8df tempest-FlavorsAdminTestJSON-554634588 tempest-FlavorsAdminTestJSON-554634588-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 414 microversion: 2.1 time: 0.013248 Jan 15 20:48:33.064875 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 39/51] 10.222.0.46 () {58 vars in 1168 bytes} [Sat Jan 15 20:48:33 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 414 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:48:33.074764 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-86ecd70b-12cd-449c-b58f-fd5f1bd80d0c tempest-FlavorsAdminTestJSON-554634588 tempest-FlavorsAdminTestJSON-554634588-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:48:33.111161 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-86ecd70b-12cd-449c-b58f-fd5f1bd80d0c tempest-FlavorsAdminTestJSON-554634588 tempest-FlavorsAdminTestJSON-554634588-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5394 microversion: 2.1 time: 0.041517 Jan 15 20:48:33.121387 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 40/52] 10.222.0.46 () {58 vars in 1168 bytes} [Sat Jan 15 20:48:33 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5394 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:48:33.127592 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4c71840c-6964-4c46-9cdb-c1c046d4f72d tempest-FlavorsAdminTestJSON-554634588 tempest-FlavorsAdminTestJSON-554634588-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:48:33.148016 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-4c71840c-6964-4c46-9cdb-c1c046d4f72d tempest-FlavorsAdminTestJSON-554634588 tempest-FlavorsAdminTestJSON-554634588-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5394 microversion: 2.1 time: 0.025242 Jan 15 20:48:33.156881 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 41/53] 10.222.0.46 () {58 vars in 1174 bytes} [Sat Jan 15 20:48:33 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5394 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:48:33.165451 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ec42c5e4-b8bd-4603-94a6-847edab7405a tempest-FlavorsAdminTestJSON-554634588 tempest-FlavorsAdminTestJSON-554634588-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:48:33.191971 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ec42c5e4-b8bd-4603-94a6-847edab7405a tempest-FlavorsAdminTestJSON-554634588 tempest-FlavorsAdminTestJSON-554634588-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5394 microversion: 2.1 time: 0.030953 Jan 15 20:48:33.193346 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 42/54] 10.222.0.46 () {58 vars in 1172 bytes} [Sat Jan 15 20:48:33 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5394 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:48:33.212193 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-72246eda-803c-4b7f-aef0-3fa0d486e353 tempest-FlavorsAdminTestJSON-554634588 tempest-FlavorsAdminTestJSON-554634588-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:48:33.238971 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-72246eda-803c-4b7f-aef0-3fa0d486e353 tempest-FlavorsAdminTestJSON-554634588 tempest-FlavorsAdminTestJSON-554634588-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5394 microversion: 2.1 time: 0.033848 Jan 15 20:48:33.240469 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 43/55] 10.222.0.46 () {58 vars in 1168 bytes} [Sat Jan 15 20:48:33 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5394 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:48:33.255001 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d1d08684-5f6d-4e38-be8b-445e1fae2ca5 tempest-FlavorsAdminTestJSON-554634588 tempest-FlavorsAdminTestJSON-554634588-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:48:33.300811 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d1d08684-5f6d-4e38-be8b-445e1fae2ca5 tempest-FlavorsAdminTestJSON-554634588 tempest-FlavorsAdminTestJSON-554634588-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/1504221880" status: 202 len: 0 microversion: 2.1 time: 0.050021 Jan 15 20:48:33.305624 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 44/56] 10.222.0.46 () {58 vars in 1160 bytes} [Sat Jan 15 20:48:33 2022] DELETE /compute/v2.1/flavors/1504221880 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 20:48:33.316049 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e7dea50c-b80a-4e0f-9fde-3352b7868afb tempest-FlavorsAdminTestJSON-554634588 tempest-FlavorsAdminTestJSON-554634588-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:48:33.373421 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e7dea50c-b80a-4e0f-9fde-3352b7868afb tempest-FlavorsAdminTestJSON-554634588 tempest-FlavorsAdminTestJSON-554634588-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.060146 Jan 15 20:48:33.377427 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 45/57] 10.222.0.46 () {58 vars in 1145 bytes} [Sat Jan 15 20:48:33 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:48:33.391577 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9ca8803b-f19a-4182-ad80-77ce1eab15af tempest-FlavorsAdminTestJSON-554634588 tempest-FlavorsAdminTestJSON-554634588-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:48:33.415936 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-9ca8803b-f19a-4182-ad80-77ce1eab15af tempest-FlavorsAdminTestJSON-554634588 tempest-FlavorsAdminTestJSON-554634588-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/696136706" status: 202 len: 0 microversion: 2.1 time: 0.028020 Jan 15 20:48:33.417273 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 46/58] 10.222.0.46 () {58 vars in 1157 bytes} [Sat Jan 15 20:48:33 2022] DELETE /compute/v2.1/flavors/696136706 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 15 20:48:33.428568 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-774eba32-5ee3-40a8-9002-99de03bdf831 tempest-FlavorsAdminTestJSON-554634588 tempest-FlavorsAdminTestJSON-554634588-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:48:33.452982 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-774eba32-5ee3-40a8-9002-99de03bdf831 tempest-FlavorsAdminTestJSON-554634588 tempest-FlavorsAdminTestJSON-554634588-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.029218 Jan 15 20:48:33.455696 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 47/59] 10.222.0.46 () {58 vars in 1145 bytes} [Sat Jan 15 20:48:33 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:48:33.473668 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9d26e5e6-4262-4f67-8884-8c8a74bea5c6 tempest-FlavorsAdminTestJSON-554634588 tempest-FlavorsAdminTestJSON-554634588-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-523857218", "id": 1456899684, "os-flavor-access:is_public": "False"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:48:33.494885 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-9d26e5e6-4262-4f67-8884-8c8a74bea5c6 tempest-FlavorsAdminTestJSON-554634588 tempest-FlavorsAdminTestJSON-554634588-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.028840 Jan 15 20:48:33.502186 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 48/60] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 20:48:33 2022] POST /compute/v2.1/flavors => generated 414 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:48:33.507293 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e8764f3c-ffdb-4b26-9d52-e9b790c32cda tempest-FlavorsAdminTestJSON-554634588 tempest-FlavorsAdminTestJSON-554634588-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:48:33.543640 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e8764f3c-ffdb-4b26-9d52-e9b790c32cda tempest-FlavorsAdminTestJSON-554634588 tempest-FlavorsAdminTestJSON-554634588-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.040049 Jan 15 20:48:33.544239 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 49/61] 10.222.0.46 () {58 vars in 1145 bytes} [Sat Jan 15 20:48:33 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:48:33.558499 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-16e8ef82-2bd4-4b61-86d6-ce4c9da9c1b1 tempest-FlavorsAdminTestJSON-224030796 tempest-FlavorsAdminTestJSON-224030796-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:48:33.581378 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-16e8ef82-2bd4-4b61-86d6-ce4c9da9c1b1 tempest-FlavorsAdminTestJSON-224030796 tempest-FlavorsAdminTestJSON-224030796-project] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.026356 Jan 15 20:48:33.582134 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 50/62] 10.222.0.46 () {58 vars in 1145 bytes} [Sat Jan 15 20:48:33 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:48:33.603041 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7daca71e-8a7a-4e76-9c02-b63902f7e652 tempest-FlavorsAdminTestJSON-554634588 tempest-FlavorsAdminTestJSON-554634588-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:48:33.627087 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7daca71e-8a7a-4e76-9c02-b63902f7e652 tempest-FlavorsAdminTestJSON-554634588 tempest-FlavorsAdminTestJSON-554634588-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/1456899684" status: 202 len: 0 microversion: 2.1 time: 0.033247 Jan 15 20:48:33.628211 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 51/63] 10.222.0.46 () {58 vars in 1160 bytes} [Sat Jan 15 20:48:33 2022] DELETE /compute/v2.1/flavors/1456899684 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 20:48:33.639043 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0e00dc70-5d1b-4142-b137-7c8d0f6b5e2a tempest-FlavorsAdminTestJSON-554634588 tempest-FlavorsAdminTestJSON-554634588-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:48:33.671511 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0e00dc70-5d1b-4142-b137-7c8d0f6b5e2a tempest-FlavorsAdminTestJSON-554634588 tempest-FlavorsAdminTestJSON-554634588-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.033258 Jan 15 20:48:33.682707 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 52/64] 10.222.0.46 () {58 vars in 1145 bytes} [Sat Jan 15 20:48:33 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:48:33.688623 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-5e734790-08b8-4bf0-93ea-db0131aa5c7c tempest-FlavorsAdminTestJSON-554634588 tempest-FlavorsAdminTestJSON-554634588-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1022421565", "id": 1944940544, "os-flavor-access:is_public": "True"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:48:33.718137 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.network.neutron [None req-f8b36a93-9aeb-41a5-814f-30d8d2f8c774 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] validate_networks() for None {{(pid=129365) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 20:48:33.718852 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-5e734790-08b8-4bf0-93ea-db0131aa5c7c tempest-FlavorsAdminTestJSON-554634588 tempest-FlavorsAdminTestJSON-554634588-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.033547 Jan 15 20:48:33.719949 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 53/65] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 20:48:33 2022] POST /compute/v2.1/flavors => generated 414 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:48:33.730633 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ccaff6d5-7be3-4b69-99b4-3c48edbd9be4 tempest-FlavorsAdminTestJSON-224030796 tempest-FlavorsAdminTestJSON-224030796-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:48:33.753272 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ccaff6d5-7be3-4b69-99b4-3c48edbd9be4 tempest-FlavorsAdminTestJSON-224030796 tempest-FlavorsAdminTestJSON-224030796-project] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.026553 Jan 15 20:48:33.753967 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 54/66] 10.222.0.46 () {58 vars in 1145 bytes} [Sat Jan 15 20:48:33 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:48:33.770144 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-60e498a6-6fb8-4a38-9624-8c31710674f9 tempest-FlavorsAdminTestJSON-554634588 tempest-FlavorsAdminTestJSON-554634588-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:48:33.798418 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-60e498a6-6fb8-4a38-9624-8c31710674f9 tempest-FlavorsAdminTestJSON-554634588 tempest-FlavorsAdminTestJSON-554634588-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/1944940544" status: 202 len: 0 microversion: 2.1 time: 0.032749 Jan 15 20:48:33.799552 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 55/67] 10.222.0.46 () {58 vars in 1160 bytes} [Sat Jan 15 20:48:33 2022] DELETE /compute/v2.1/flavors/1944940544 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 20:48:33.813643 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c3249def-ca5f-46a0-82dd-10caaa0744ef tempest-FlavorsAdminTestJSON-554634588 tempest-FlavorsAdminTestJSON-554634588-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:48:33.837458 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c3249def-ca5f-46a0-82dd-10caaa0744ef tempest-FlavorsAdminTestJSON-554634588 tempest-FlavorsAdminTestJSON-554634588-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.033442 Jan 15 20:48:33.838205 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 56/68] 10.222.0.46 () {58 vars in 1145 bytes} [Sat Jan 15 20:48:33 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:48:34.164085 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-f8b36a93-9aeb-41a5-814f-30d8d2f8c774 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Flavor limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 20:48:34.164766 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-f8b36a93-9aeb-41a5-814f-30d8d2f8c774 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Image limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 20:48:34.165974 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-f8b36a93-9aeb-41a5-814f-30d8d2f8c774 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Flavor pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 20:48:34.166901 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-f8b36a93-9aeb-41a5-814f-30d8d2f8c774 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Image pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 20:48:34.167480 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-f8b36a93-9aeb-41a5-814f-30d8d2f8c774 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 20:48:34.188860 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f8b36a93-9aeb-41a5-814f-30d8d2f8c774 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:48:34.189469 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f8b36a93-9aeb-41a5-814f-30d8d2f8c774 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:48:34.190632 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f8b36a93-9aeb-41a5-814f-30d8d2f8c774 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:48:34.191242 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f8b36a93-9aeb-41a5-814f-30d8d2f8c774 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:48:34.237221 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-f8b36a93-9aeb-41a5-814f-30d8d2f8c774 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Getting quotas for project 3c9ae9cb7d2d4105a277bcaaf858b861. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:48:34.245636 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-f8b36a93-9aeb-41a5-814f-30d8d2f8c774 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Getting quotas for user 4272283f80fd440c92c605310d8a441d and project 3c9ae9cb7d2d4105a277bcaaf858b861. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:48:34.259903 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f8b36a93-9aeb-41a5-814f-30d8d2f8c774 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Going to run 1 instances... {{(pid=129365) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 20:48:34.263532 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f8b36a93-9aeb-41a5-814f-30d8d2f8c774 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] [instance: 5736e502-fb8b-43e0-8763-ec341d6f5953] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129365) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 20:48:34.326476 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f8b36a93-9aeb-41a5-814f-30d8d2f8c774 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.423424 Jan 15 20:48:34.327730 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 13/69] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 20:48:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 2425 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 20:48:34.337734 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-04754b8f-5d4e-4cd2-b6b6-1e7e61148b31 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:48:34.338932 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-04754b8f-5d4e-4cd2-b6b6-1e7e61148b31 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] [instance: 5736e502-fb8b-43e0-8763-ec341d6f5953] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:48:35.266644 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-04754b8f-5d4e-4cd2-b6b6-1e7e61148b31 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4272283f80fd440c92c605310d8a441d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c9ae9cb7d2d4105a277bcaaf858b861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:48:35.285372 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-04754b8f-5d4e-4cd2-b6b6-1e7e61148b31 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] 10.222.0.46 "GET /compute/v2.1/servers/5736e502-fb8b-43e0-8763-ec341d6f5953" status: 200 len: 1242 microversion: 2.1 time: 0.951631 Jan 15 20:48:35.286376 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 57/70] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:48:34 2022] GET /compute/v2.1/servers/5736e502-fb8b-43e0-8763-ec341d6f5953 => generated 1242 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:48:36.317735 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9d8eb332-2249-49b8-948c-a081a3994c98 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:48:36.321123 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-9d8eb332-2249-49b8-948c-a081a3994c98 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] [instance: 5736e502-fb8b-43e0-8763-ec341d6f5953] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:48:36.383688 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9d8eb332-2249-49b8-948c-a081a3994c98 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:48:36.384356 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9d8eb332-2249-49b8-948c-a081a3994c98 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:48:36.385402 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9d8eb332-2249-49b8-948c-a081a3994c98 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:48:36.387119 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9d8eb332-2249-49b8-948c-a081a3994c98 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:48:36.586352 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-9d8eb332-2249-49b8-948c-a081a3994c98 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4272283f80fd440c92c605310d8a441d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c9ae9cb7d2d4105a277bcaaf858b861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:48:36.610267 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-9d8eb332-2249-49b8-948c-a081a3994c98 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] 10.222.0.46 "GET /compute/v2.1/servers/5736e502-fb8b-43e0-8763-ec341d6f5953" status: 200 len: 1308 microversion: 2.1 time: 0.310926 Jan 15 20:48:36.612534 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 14/71] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:48:36 2022] GET /compute/v2.1/servers/5736e502-fb8b-43e0-8763-ec341d6f5953 => generated 1308 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:48:37.631132 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-83044952-90e4-4072-a858-acb23d38696e tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:48:37.632007 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-83044952-90e4-4072-a858-acb23d38696e tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] [instance: 5736e502-fb8b-43e0-8763-ec341d6f5953] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:48:37.645554 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-83044952-90e4-4072-a858-acb23d38696e tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:48:37.646817 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-83044952-90e4-4072-a858-acb23d38696e tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:48:37.649236 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-83044952-90e4-4072-a858-acb23d38696e tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:48:37.649984 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-83044952-90e4-4072-a858-acb23d38696e tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:48:37.924247 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-83044952-90e4-4072-a858-acb23d38696e tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4272283f80fd440c92c605310d8a441d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c9ae9cb7d2d4105a277bcaaf858b861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:48:37.952315 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-83044952-90e4-4072-a858-acb23d38696e tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] 10.222.0.46 "GET /compute/v2.1/servers/5736e502-fb8b-43e0-8763-ec341d6f5953" status: 200 len: 1296 microversion: 2.1 time: 0.325641 Jan 15 20:48:37.968370 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 58/72] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:48:37 2022] GET /compute/v2.1/servers/5736e502-fb8b-43e0-8763-ec341d6f5953 => generated 1296 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:48:38.503618 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9ed6654e-3de5-4c53-90cd-532193e5744e tempest-HostsAdminTestJSON-2107158735 tempest-HostsAdminTestJSON-2107158735-project-admin] Calling method '.version_select at 0x7f30cae151f0>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:48:38.505205 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:48:38.505205 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:48:38.506891 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9ed6654e-3de5-4c53-90cd-532193e5744e tempest-HostsAdminTestJSON-2107158735 tempest-HostsAdminTestJSON-2107158735-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:48:38.507345 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9ed6654e-3de5-4c53-90cd-532193e5744e tempest-HostsAdminTestJSON-2107158735 tempest-HostsAdminTestJSON-2107158735-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:48:38.508161 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9ed6654e-3de5-4c53-90cd-532193e5744e tempest-HostsAdminTestJSON-2107158735 tempest-HostsAdminTestJSON-2107158735-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:48:38.516374 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9ed6654e-3de5-4c53-90cd-532193e5744e tempest-HostsAdminTestJSON-2107158735 tempest-HostsAdminTestJSON-2107158735-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:48:38.615944 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-9ed6654e-3de5-4c53-90cd-532193e5744e tempest-HostsAdminTestJSON-2107158735 tempest-HostsAdminTestJSON-2107158735-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hosts" status: 200 len: 401 microversion: 2.1 time: 0.514941 Jan 15 20:48:38.624731 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 15/73] 10.222.0.46 () {58 vars in 1127 bytes} [Sat Jan 15 20:48:38 2022] GET /compute/v2.1/os-hosts => generated 401 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:48:38.630147 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-cf1fc7ba-287d-4502-ab30-f2e855e88c8b tempest-HostsAdminTestJSON-2107158735 tempest-HostsAdminTestJSON-2107158735-project-admin] Calling method '.version_select at 0x7f30c9dcd5e0>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:48:38.632911 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:48:38.632911 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:48:38.635276 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cf1fc7ba-287d-4502-ab30-f2e855e88c8b tempest-HostsAdminTestJSON-2107158735 tempest-HostsAdminTestJSON-2107158735-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:48:38.639023 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cf1fc7ba-287d-4502-ab30-f2e855e88c8b tempest-HostsAdminTestJSON-2107158735 tempest-HostsAdminTestJSON-2107158735-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:48:38.640070 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cf1fc7ba-287d-4502-ab30-f2e855e88c8b tempest-HostsAdminTestJSON-2107158735 tempest-HostsAdminTestJSON-2107158735-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:48:38.640691 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cf1fc7ba-287d-4502-ab30-f2e855e88c8b tempest-HostsAdminTestJSON-2107158735 tempest-HostsAdminTestJSON-2107158735-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:48:38.674534 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-346b8a72-74b7-4cff-bb15-56c9d1e2de4a tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-455588913", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:48:38.748981 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-cf1fc7ba-287d-4502-ab30-f2e855e88c8b tempest-HostsAdminTestJSON-2107158735 tempest-HostsAdminTestJSON-2107158735-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 401 microversion: 2.1 time: 0.108060 Jan 15 20:48:38.760868 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 16/74] 10.222.0.46 () {58 vars in 1138 bytes} [Sat Jan 15 20:48:38 2022] GET /compute/v2.1/os-hosts?zone= => generated 401 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 20:48:38.786865 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-53d146a0-b84a-4356-a2e5-60579607c77d tempest-HostsAdminTestJSON-2107158735 tempest-HostsAdminTestJSON-2107158735-project-admin] Calling method '.version_select at 0x7f30cae0b160>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:48:38.792905 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:48:38.792905 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:48:38.799119 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-53d146a0-b84a-4356-a2e5-60579607c77d tempest-HostsAdminTestJSON-2107158735 tempest-HostsAdminTestJSON-2107158735-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:48:38.799958 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-53d146a0-b84a-4356-a2e5-60579607c77d tempest-HostsAdminTestJSON-2107158735 tempest-HostsAdminTestJSON-2107158735-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:48:38.803270 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-53d146a0-b84a-4356-a2e5-60579607c77d tempest-HostsAdminTestJSON-2107158735 tempest-HostsAdminTestJSON-2107158735-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:48:38.804698 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-53d146a0-b84a-4356-a2e5-60579607c77d tempest-HostsAdminTestJSON-2107158735 tempest-HostsAdminTestJSON-2107158735-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:48:38.855984 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.network.neutron [None req-346b8a72-74b7-4cff-bb15-56c9d1e2de4a tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] validate_networks() for None {{(pid=129366) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 20:48:38.897282 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-53d146a0-b84a-4356-a2e5-60579607c77d tempest-HostsAdminTestJSON-2107158735 tempest-HostsAdminTestJSON-2107158735-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.126626 Jan 15 20:48:38.898278 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 17/75] 10.222.0.46 () {58 vars in 1144 bytes} [Sat Jan 15 20:48:38 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 20:48:38.976758 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-fdb36aad-aa03-4190-836b-b173ed38ab31 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:48:38.977704 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-fdb36aad-aa03-4190-836b-b173ed38ab31 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] [instance: 5736e502-fb8b-43e0-8763-ec341d6f5953] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:48:38.999731 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fdb36aad-aa03-4190-836b-b173ed38ab31 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:48:39.000468 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fdb36aad-aa03-4190-836b-b173ed38ab31 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:48:39.005773 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fdb36aad-aa03-4190-836b-b173ed38ab31 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:48:39.008526 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fdb36aad-aa03-4190-836b-b173ed38ab31 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:48:39.580307 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-fdb36aad-aa03-4190-836b-b173ed38ab31 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4272283f80fd440c92c605310d8a441d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c9ae9cb7d2d4105a277bcaaf858b861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:48:39.593736 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-fdb36aad-aa03-4190-836b-b173ed38ab31 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] 10.222.0.46 "GET /compute/v2.1/servers/5736e502-fb8b-43e0-8763-ec341d6f5953" status: 200 len: 1338 microversion: 2.1 time: 0.623577 Jan 15 20:48:39.601602 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 18/76] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:48:38 2022] GET /compute/v2.1/servers/5736e502-fb8b-43e0-8763-ec341d6f5953 => generated 1338 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:48:39.986319 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-0347a133-7dcf-420b-a785-6e2940934f38 tempest-HypervisorAdminV228Test-760177910 tempest-HypervisorAdminV228Test-760177910-project-admin] Calling method '.version_select at 0x7f30c9c47f70>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:48:39.987318 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:48:39.987318 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:48:39.997391 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-0347a133-7dcf-420b-a785-6e2940934f38 tempest-HypervisorAdminV228Test-760177910 tempest-HypervisorAdminV228Test-760177910-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2935be83-7c51-430d-8ff2-0a8179973c9a(cell1) {{(pid=129365) load_cells /opt/stack/nova/nova/compute/api.py:302}} Jan 15 20:48:40.001901 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0347a133-7dcf-420b-a785-6e2940934f38 tempest-HypervisorAdminV228Test-760177910 tempest-HypervisorAdminV228Test-760177910-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:48:40.002660 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0347a133-7dcf-420b-a785-6e2940934f38 tempest-HypervisorAdminV228Test-760177910 tempest-HypervisorAdminV228Test-760177910-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:48:40.038572 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0347a133-7dcf-420b-a785-6e2940934f38 tempest-HypervisorAdminV228Test-760177910 tempest-HypervisorAdminV228Test-760177910-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:48:40.040852 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0347a133-7dcf-420b-a785-6e2940934f38 tempest-HypervisorAdminV228Test-760177910 tempest-HypervisorAdminV228Test-760177910-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:48:40.065533 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0347a133-7dcf-420b-a785-6e2940934f38 tempest-HypervisorAdminV228Test-760177910 tempest-HypervisorAdminV228Test-760177910-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:48:40.067135 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0347a133-7dcf-420b-a785-6e2940934f38 tempest-HypervisorAdminV228Test-760177910 tempest-HypervisorAdminV228Test-760177910-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:48:40.084014 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-0347a133-7dcf-420b-a785-6e2940934f38 tempest-HypervisorAdminV228Test-760177910 tempest-HypervisorAdminV228Test-760177910-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.421049 Jan 15 20:48:40.085802 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 19/77] 10.222.0.46 () {60 vars in 1186 bytes} [Sat Jan 15 20:48:39 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:48:40.100832 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-692c90ae-0370-4b42-af38-2e3c385b813e tempest-HypervisorAdminV228Test-760177910 tempest-HypervisorAdminV228Test-760177910-project-admin] Calling method '.version_select at 0x7f30c9c47af0>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:48:40.104519 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:48:40.104519 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:48:40.116893 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-692c90ae-0370-4b42-af38-2e3c385b813e tempest-HypervisorAdminV228Test-760177910 tempest-HypervisorAdminV228Test-760177910-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:48:40.117611 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-692c90ae-0370-4b42-af38-2e3c385b813e tempest-HypervisorAdminV228Test-760177910 tempest-HypervisorAdminV228Test-760177910-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:48:40.161077 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-692c90ae-0370-4b42-af38-2e3c385b813e tempest-HypervisorAdminV228Test-760177910 tempest-HypervisorAdminV228Test-760177910-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:48:40.164267 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-692c90ae-0370-4b42-af38-2e3c385b813e tempest-HypervisorAdminV228Test-760177910 tempest-HypervisorAdminV228Test-760177910-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:48:40.187216 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-692c90ae-0370-4b42-af38-2e3c385b813e tempest-HypervisorAdminV228Test-760177910 tempest-HypervisorAdminV228Test-760177910-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.093782 Jan 15 20:48:40.190265 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 20/78] 10.222.0.46 () {60 vars in 1192 bytes} [Sat Jan 15 20:48:40 2022] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:48:40.329602 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-346b8a72-74b7-4cff-bb15-56c9d1e2de4a tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Flavor limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 20:48:40.330327 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-346b8a72-74b7-4cff-bb15-56c9d1e2de4a tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Image limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 20:48:40.330644 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-346b8a72-74b7-4cff-bb15-56c9d1e2de4a tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Flavor pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 20:48:40.331076 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-346b8a72-74b7-4cff-bb15-56c9d1e2de4a tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Image pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 20:48:40.331476 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-346b8a72-74b7-4cff-bb15-56c9d1e2de4a tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 20:48:40.352593 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-346b8a72-74b7-4cff-bb15-56c9d1e2de4a tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:48:40.353067 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-346b8a72-74b7-4cff-bb15-56c9d1e2de4a tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:48:40.355266 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-346b8a72-74b7-4cff-bb15-56c9d1e2de4a tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:48:40.355929 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-346b8a72-74b7-4cff-bb15-56c9d1e2de4a tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:48:40.424601 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-346b8a72-74b7-4cff-bb15-56c9d1e2de4a tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Getting quotas for project bd82c6b47c4140e390464b153d2fe865. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:48:40.443191 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-346b8a72-74b7-4cff-bb15-56c9d1e2de4a tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Getting quotas for user 957f85f9c6794cccad71c553fb607ad8 and project bd82c6b47c4140e390464b153d2fe865. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:48:40.472157 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-346b8a72-74b7-4cff-bb15-56c9d1e2de4a tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Going to run 1 instances... {{(pid=129366) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 20:48:40.475707 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-346b8a72-74b7-4cff-bb15-56c9d1e2de4a tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] [instance: 50205979-c437-4302-b6f0-1bb76d7ea2c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 20:48:40.617947 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2f3530d9-8380-43cd-a4bc-9deef568a684 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:48:40.619205 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-2f3530d9-8380-43cd-a4bc-9deef568a684 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] [instance: 5736e502-fb8b-43e0-8763-ec341d6f5953] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:48:40.631082 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2f3530d9-8380-43cd-a4bc-9deef568a684 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:48:40.633087 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2f3530d9-8380-43cd-a4bc-9deef568a684 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:48:40.641671 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2f3530d9-8380-43cd-a4bc-9deef568a684 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:48:40.642483 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2f3530d9-8380-43cd-a4bc-9deef568a684 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:48:40.703360 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-346b8a72-74b7-4cff-bb15-56c9d1e2de4a tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.474455 Jan 15 20:48:40.725567 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 59/79] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 20:48:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 2497 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 20:48:40.751502 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0a82c42b-9bb3-46c1-b688-9fd59bd6b25a tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:48:40.752955 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-0a82c42b-9bb3-46c1-b688-9fd59bd6b25a tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] [instance: 50205979-c437-4302-b6f0-1bb76d7ea2c9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:48:41.077877 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-0a82c42b-9bb3-46c1-b688-9fd59bd6b25a tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957f85f9c6794cccad71c553fb607ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82c6b47c4140e390464b153d2fe865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:48:41.084985 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0a82c42b-9bb3-46c1-b688-9fd59bd6b25a tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] 10.222.0.46 "GET /compute/v2.1/servers/50205979-c437-4302-b6f0-1bb76d7ea2c9" status: 200 len: 1219 microversion: 2.1 time: 0.358011 Jan 15 20:48:41.104952 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 60/80] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:48:40 2022] GET /compute/v2.1/servers/50205979-c437-4302-b6f0-1bb76d7ea2c9 => generated 1219 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:48:41.784369 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c794c7e6-2330-4851-b440-a8b936fff891 tempest-FlavorsAccessTestJSON-408886212 tempest-FlavorsAccessTestJSON-408886212-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1468330990", "id": 1703264471, "os-flavor-access:is_public": "False"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:48:41.786895 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:48:41.786895 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:48:41.824481 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-2f3530d9-8380-43cd-a4bc-9deef568a684 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4272283f80fd440c92c605310d8a441d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c9ae9cb7d2d4105a277bcaaf858b861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:48:41.829867 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c794c7e6-2330-4851-b440-a8b936fff891 tempest-FlavorsAccessTestJSON-408886212 tempest-FlavorsAccessTestJSON-408886212-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 0.723038 Jan 15 20:48:41.830856 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 61/81] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 20:48:41 2022] POST /compute/v2.1/flavors => generated 431 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:48:41.844003 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e175e48a-5997-4a3b-a1bb-3f52034c177c tempest-FlavorsAccessTestJSON-408886212 tempest-FlavorsAccessTestJSON-408886212-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "2165520386014d5cae99bc5425410621"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:48:41.847941 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:48:41.847941 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:48:41.849581 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2f3530d9-8380-43cd-a4bc-9deef568a684 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] 10.222.0.46 "GET /compute/v2.1/servers/5736e502-fb8b-43e0-8763-ec341d6f5953" status: 200 len: 1338 microversion: 2.1 time: 1.232659 Jan 15 20:48:41.853039 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 21/82] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:48:40 2022] GET /compute/v2.1/servers/5736e502-fb8b-43e0-8763-ec341d6f5953 => generated 1338 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:48:42.061796 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e175e48a-5997-4a3b-a1bb-3f52034c177c tempest-FlavorsAccessTestJSON-408886212 tempest-FlavorsAccessTestJSON-408886212-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors/1703264471/action" status: 200 len: 97 microversion: 2.1 time: 0.220220 Jan 15 20:48:42.063221 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 62/83] 10.222.0.46 () {60 vars in 1199 bytes} [Sat Jan 15 20:48:41 2022] POST /compute/v2.1/flavors/1703264471/action => generated 97 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 20:48:42.104330 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-57a5b479-4d3c-4917-bd40-c713c6482b73 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:48:42.105224 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-57a5b479-4d3c-4917-bd40-c713c6482b73 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] [instance: 50205979-c437-4302-b6f0-1bb76d7ea2c9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:48:42.300127 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b9eeb9cd-0625-4476-b079-efb1fab1aa69 tempest-FlavorsAccessTestJSON-112635523 tempest-FlavorsAccessTestJSON-112635523-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:48:42.438579 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-57a5b479-4d3c-4917-bd40-c713c6482b73 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957f85f9c6794cccad71c553fb607ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82c6b47c4140e390464b153d2fe865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:48:42.447116 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-57a5b479-4d3c-4917-bd40-c713c6482b73 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] 10.222.0.46 "GET /compute/v2.1/servers/50205979-c437-4302-b6f0-1bb76d7ea2c9" status: 200 len: 1219 microversion: 2.1 time: 0.346681 Jan 15 20:48:42.448504 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 63/84] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:48:42 2022] GET /compute/v2.1/servers/50205979-c437-4302-b6f0-1bb76d7ea2c9 => generated 1219 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:48:42.616346 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b9eeb9cd-0625-4476-b079-efb1fab1aa69 tempest-FlavorsAccessTestJSON-112635523 tempest-FlavorsAccessTestJSON-112635523-project] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 5412 microversion: 2.1 time: 0.547340 Jan 15 20:48:42.619423 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 22/85] 10.222.0.46 () {58 vars in 1145 bytes} [Sat Jan 15 20:48:42 2022] GET /compute/v2.1/flavors/detail => generated 5412 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:48:42.638200 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-080254fd-83e4-43a5-b1a7-f87e3b04200b tempest-FlavorsAccessTestJSON-408886212 tempest-FlavorsAccessTestJSON-408886212-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "2165520386014d5cae99bc5425410621"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:48:42.640212 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:48:42.640212 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:48:42.782214 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-080254fd-83e4-43a5-b1a7-f87e3b04200b tempest-FlavorsAccessTestJSON-408886212 tempest-FlavorsAccessTestJSON-408886212-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors/1703264471/action" status: 200 len: 21 microversion: 2.1 time: 0.152620 Jan 15 20:48:42.787584 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 64/86] 10.222.0.46 () {60 vars in 1199 bytes} [Sat Jan 15 20:48:42 2022] POST /compute/v2.1/flavors/1703264471/action => generated 21 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 20:48:42.792386 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ec8ff088-160b-45d0-8c99-5b1197e17694 tempest-FlavorsAccessTestJSON-112635523 tempest-FlavorsAccessTestJSON-112635523-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:48:42.828516 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ec8ff088-160b-45d0-8c99-5b1197e17694 tempest-FlavorsAccessTestJSON-112635523 tempest-FlavorsAccessTestJSON-112635523-project] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.039603 Jan 15 20:48:42.835402 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 23/87] 10.222.0.46 () {58 vars in 1145 bytes} [Sat Jan 15 20:48:42 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:48:42.850290 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4ccea513-2f17-4072-b0b9-d5471121c3da tempest-FlavorsAccessTestJSON-408886212 tempest-FlavorsAccessTestJSON-408886212-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:48:42.875965 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:48:42.875965 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:48:42.890892 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ee3c4cb8-e430-4fa6-acf2-2b96e3bdfa6c tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:48:42.899806 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ee3c4cb8-e430-4fa6-acf2-2b96e3bdfa6c tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] [instance: 5736e502-fb8b-43e0-8763-ec341d6f5953] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:48:42.934145 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ee3c4cb8-e430-4fa6-acf2-2b96e3bdfa6c tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:48:42.934618 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ee3c4cb8-e430-4fa6-acf2-2b96e3bdfa6c tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:48:42.938615 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ee3c4cb8-e430-4fa6-acf2-2b96e3bdfa6c tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:48:42.940342 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ee3c4cb8-e430-4fa6-acf2-2b96e3bdfa6c tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:48:42.945753 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-4ccea513-2f17-4072-b0b9-d5471121c3da tempest-FlavorsAccessTestJSON-408886212 tempest-FlavorsAccessTestJSON-408886212-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/1703264471" status: 202 len: 0 microversion: 2.1 time: 0.098227 Jan 15 20:48:42.951548 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 65/88] 10.222.0.46 () {58 vars in 1160 bytes} [Sat Jan 15 20:48:42 2022] DELETE /compute/v2.1/flavors/1703264471 => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 20:48:42.976717 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a0675e13-0728-4811-ba74-230949fe5f78 tempest-FlavorsAccessTestJSON-408886212 tempest-FlavorsAccessTestJSON-408886212-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:48:43.070382 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a0675e13-0728-4811-ba74-230949fe5f78 tempest-FlavorsAccessTestJSON-408886212 tempest-FlavorsAccessTestJSON-408886212-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.117252 Jan 15 20:48:43.090855 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 66/89] 10.222.0.46 () {58 vars in 1145 bytes} [Sat Jan 15 20:48:42 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:48:43.100386 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-23a553da-188f-41c1-b731-7152c666208e tempest-FlavorsAccessTestJSON-408886212 tempest-FlavorsAccessTestJSON-408886212-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-949115901", "id": 1409043011, "os-flavor-access:is_public": "False"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:48:43.123042 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:48:43.123042 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:48:43.163697 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-23a553da-188f-41c1-b731-7152c666208e tempest-FlavorsAccessTestJSON-408886212 tempest-FlavorsAccessTestJSON-408886212-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.070435 Jan 15 20:48:43.182406 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 67/90] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 20:48:43 2022] POST /compute/v2.1/flavors => generated 430 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:48:43.194540 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-70288a48-ffc2-4905-8bc3-6b064e8c158c tempest-FlavorsAccessTestJSON-408886212 tempest-FlavorsAccessTestJSON-408886212-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:48:43.196723 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:48:43.196723 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:48:43.225007 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-70288a48-ffc2-4905-8bc3-6b064e8c158c tempest-FlavorsAccessTestJSON-408886212 tempest-FlavorsAccessTestJSON-408886212-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/1409043011/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.040130 Jan 15 20:48:43.234231 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 68/91] 10.222.0.46 () {58 vars in 1208 bytes} [Sat Jan 15 20:48:43 2022] GET /compute/v2.1/flavors/1409043011/os-flavor-access => generated 21 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 20:48:43.368313 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-07df7d7d-fd32-4270-8a0a-195b151717d9 req-9ca96fcf-48ce-4760-a9c1-435e545be433 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5736e502-fb8b-43e0-8763-ec341d6f5953", "tag": "ab3b6f1e-5ff9-47f0-945c-77448dbe354e"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:48:43.377505 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:48:43.377505 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:48:43.432298 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-07df7d7d-fd32-4270-8a0a-195b151717d9 req-9ca96fcf-48ce-4760-a9c1-435e545be433 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:48:43.436123 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-07df7d7d-fd32-4270-8a0a-195b151717d9 req-9ca96fcf-48ce-4760-a9c1-435e545be433 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:48:43.491450 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-07df7d7d-fd32-4270-8a0a-195b151717d9 req-9ca96fcf-48ce-4760-a9c1-435e545be433 service nova] Creating event network-changed:ab3b6f1e-5ff9-47f0-945c-77448dbe354e for instance 5736e502-fb8b-43e0-8763-ec341d6f5953 on nch2-master-1 Jan 15 20:48:43.492601 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-07df7d7d-fd32-4270-8a0a-195b151717d9 req-9ca96fcf-48ce-4760-a9c1-435e545be433 service nova] Acquired lock "compute-rpcapi-router" {{(pid=129366) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jan 15 20:48:43.496130 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a9b43a0e-aca4-486e-95d8-958ce9cbeb00 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:48:43.497001 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a9b43a0e-aca4-486e-95d8-958ce9cbeb00 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:48:43.502776 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a9b43a0e-aca4-486e-95d8-958ce9cbeb00 None None] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:48:43.505550 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a9b43a0e-aca4-486e-95d8-958ce9cbeb00 None None] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:48:43.532555 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.compute.rpcapi [None req-a9b43a0e-aca4-486e-95d8-958ce9cbeb00 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Jan 15 20:48:43.539002 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a9b43a0e-aca4-486e-95d8-958ce9cbeb00 None None] Releasing lock "compute-rpcapi-router" {{(pid=129366) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jan 15 20:48:43.568439 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-ee3c4cb8-e430-4fa6-acf2-2b96e3bdfa6c tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4272283f80fd440c92c605310d8a441d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c9ae9cb7d2d4105a277bcaaf858b861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:48:43.578617 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ee3c4cb8-e430-4fa6-acf2-2b96e3bdfa6c tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] 10.222.0.46 "GET /compute/v2.1/servers/5736e502-fb8b-43e0-8763-ec341d6f5953" status: 200 len: 1338 microversion: 2.1 time: 0.708956 Jan 15 20:48:43.584025 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 24/92] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:48:42 2022] GET /compute/v2.1/servers/5736e502-fb8b-43e0-8763-ec341d6f5953 => generated 1338 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:48:43.595911 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5b0522cd-9835-4a58-83b1-ae82bbf4a3ae tempest-FlavorsAccessTestJSON-408886212 tempest-FlavorsAccessTestJSON-408886212-project-admin] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:48:43.596787 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:48:43.596787 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:48:43.622008 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a9b43a0e-aca4-486e-95d8-958ce9cbeb00 None None] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.385212 Jan 15 20:48:43.623403 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 69/93] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:48:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:48:43.628901 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-3461f8de-6c57-434e-83f0-a38b93f26dd7 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:48:43.630848 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-3461f8de-6c57-434e-83f0-a38b93f26dd7 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] [instance: 50205979-c437-4302-b6f0-1bb76d7ea2c9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:48:43.661957 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3461f8de-6c57-434e-83f0-a38b93f26dd7 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:48:43.663204 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3461f8de-6c57-434e-83f0-a38b93f26dd7 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:48:43.667946 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3461f8de-6c57-434e-83f0-a38b93f26dd7 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:48:43.672256 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3461f8de-6c57-434e-83f0-a38b93f26dd7 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:48:43.693559 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5b0522cd-9835-4a58-83b1-ae82bbf4a3ae tempest-FlavorsAccessTestJSON-408886212 tempest-FlavorsAccessTestJSON-408886212-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/1409043011" status: 202 len: 0 microversion: 2.1 time: 0.107543 Jan 15 20:48:43.694167 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 25/94] 10.222.0.46 () {58 vars in 1160 bytes} [Sat Jan 15 20:48:43 2022] DELETE /compute/v2.1/flavors/1409043011 => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 20:48:43.727606 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2e7bf2cb-54cb-4eac-9c65-9f723126269b tempest-FlavorsAccessTestJSON-408886212 tempest-FlavorsAccessTestJSON-408886212-project-admin] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:48:43.816282 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2e7bf2cb-54cb-4eac-9c65-9f723126269b tempest-FlavorsAccessTestJSON-408886212 tempest-FlavorsAccessTestJSON-408886212-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.115434 Jan 15 20:48:43.828242 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 26/95] 10.222.0.46 () {58 vars in 1145 bytes} [Sat Jan 15 20:48:43 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:48:43.880629 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-3461f8de-6c57-434e-83f0-a38b93f26dd7 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957f85f9c6794cccad71c553fb607ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82c6b47c4140e390464b153d2fe865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:48:43.901545 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-3461f8de-6c57-434e-83f0-a38b93f26dd7 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] 10.222.0.46 "GET /compute/v2.1/servers/50205979-c437-4302-b6f0-1bb76d7ea2c9" status: 200 len: 1271 microversion: 2.1 time: 0.275949 Jan 15 20:48:43.907387 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 70/96] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:48:43 2022] GET /compute/v2.1/servers/50205979-c437-4302-b6f0-1bb76d7ea2c9 => generated 1271 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:48:44.601935 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9b23e3c7-41a4-4147-87b5-6222a05bc972 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:48:44.603587 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-9b23e3c7-41a4-4147-87b5-6222a05bc972 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] [instance: 5736e502-fb8b-43e0-8763-ec341d6f5953] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:48:44.622937 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9b23e3c7-41a4-4147-87b5-6222a05bc972 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:48:44.623262 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9b23e3c7-41a4-4147-87b5-6222a05bc972 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:48:44.629986 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9b23e3c7-41a4-4147-87b5-6222a05bc972 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:48:44.634062 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9b23e3c7-41a4-4147-87b5-6222a05bc972 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:48:44.926646 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a6a84e03-249e-472e-8cbc-4ab02f4f31b9 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:48:44.928194 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a6a84e03-249e-472e-8cbc-4ab02f4f31b9 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] [instance: 50205979-c437-4302-b6f0-1bb76d7ea2c9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:48:44.941611 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a6a84e03-249e-472e-8cbc-4ab02f4f31b9 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:48:44.964000 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a6a84e03-249e-472e-8cbc-4ab02f4f31b9 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:48:44.970979 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a6a84e03-249e-472e-8cbc-4ab02f4f31b9 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:48:44.971447 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a6a84e03-249e-472e-8cbc-4ab02f4f31b9 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:48:45.222661 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-a6a84e03-249e-472e-8cbc-4ab02f4f31b9 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957f85f9c6794cccad71c553fb607ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82c6b47c4140e390464b153d2fe865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:48:45.233636 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a6a84e03-249e-472e-8cbc-4ab02f4f31b9 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] 10.222.0.46 "GET /compute/v2.1/servers/50205979-c437-4302-b6f0-1bb76d7ea2c9" status: 200 len: 1277 microversion: 2.1 time: 0.312328 Jan 15 20:48:45.236396 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 71/97] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:48:44 2022] GET /compute/v2.1/servers/50205979-c437-4302-b6f0-1bb76d7ea2c9 => generated 1277 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:48:45.619146 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-9b23e3c7-41a4-4147-87b5-6222a05bc972 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4272283f80fd440c92c605310d8a441d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c9ae9cb7d2d4105a277bcaaf858b861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:48:45.627009 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-9b23e3c7-41a4-4147-87b5-6222a05bc972 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] 10.222.0.46 "GET /compute/v2.1/servers/5736e502-fb8b-43e0-8763-ec341d6f5953" status: 200 len: 1338 microversion: 2.1 time: 1.029458 Jan 15 20:48:45.641361 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 27/98] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:48:44 2022] GET /compute/v2.1/servers/5736e502-fb8b-43e0-8763-ec341d6f5953 => generated 1338 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:48:46.253476 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-449c1af2-2a34-42a7-b47d-c00d676c7ff7 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:48:46.254422 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-449c1af2-2a34-42a7-b47d-c00d676c7ff7 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] [instance: 50205979-c437-4302-b6f0-1bb76d7ea2c9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:48:46.268512 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-449c1af2-2a34-42a7-b47d-c00d676c7ff7 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:48:46.269046 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-449c1af2-2a34-42a7-b47d-c00d676c7ff7 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:48:46.269856 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-449c1af2-2a34-42a7-b47d-c00d676c7ff7 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:48:46.273451 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-449c1af2-2a34-42a7-b47d-c00d676c7ff7 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:48:46.645904 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-55eb186b-9b75-483b-a41e-b5628a447080 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:48:46.646529 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-55eb186b-9b75-483b-a41e-b5628a447080 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] [instance: 5736e502-fb8b-43e0-8763-ec341d6f5953] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:48:46.653678 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-55eb186b-9b75-483b-a41e-b5628a447080 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:48:46.654621 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-55eb186b-9b75-483b-a41e-b5628a447080 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:48:46.655000 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-55eb186b-9b75-483b-a41e-b5628a447080 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:48:46.655493 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-55eb186b-9b75-483b-a41e-b5628a447080 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:48:46.761758 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-449c1af2-2a34-42a7-b47d-c00d676c7ff7 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957f85f9c6794cccad71c553fb607ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82c6b47c4140e390464b153d2fe865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:48:46.783037 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-449c1af2-2a34-42a7-b47d-c00d676c7ff7 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] 10.222.0.46 "GET /compute/v2.1/servers/50205979-c437-4302-b6f0-1bb76d7ea2c9" status: 200 len: 1277 microversion: 2.1 time: 0.527866 Jan 15 20:48:46.783795 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 72/99] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:48:46 2022] GET /compute/v2.1/servers/50205979-c437-4302-b6f0-1bb76d7ea2c9 => generated 1277 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:48:47.387222 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-55eb186b-9b75-483b-a41e-b5628a447080 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4272283f80fd440c92c605310d8a441d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c9ae9cb7d2d4105a277bcaaf858b861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:48:47.400001 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-55eb186b-9b75-483b-a41e-b5628a447080 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] 10.222.0.46 "GET /compute/v2.1/servers/5736e502-fb8b-43e0-8763-ec341d6f5953" status: 200 len: 1338 microversion: 2.1 time: 0.757647 Jan 15 20:48:47.400915 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 28/100] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:48:46 2022] GET /compute/v2.1/servers/5736e502-fb8b-43e0-8763-ec341d6f5953 => generated 1338 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:48:47.803170 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-5d01acd6-d367-4081-82e2-33c786f39cc9 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:48:47.804641 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-5d01acd6-d367-4081-82e2-33c786f39cc9 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] [instance: 50205979-c437-4302-b6f0-1bb76d7ea2c9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:48:47.846876 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5d01acd6-d367-4081-82e2-33c786f39cc9 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:48:47.847434 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5d01acd6-d367-4081-82e2-33c786f39cc9 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:48:47.853408 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5d01acd6-d367-4081-82e2-33c786f39cc9 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:48:47.853921 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5d01acd6-d367-4081-82e2-33c786f39cc9 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:48:48.253014 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-5d01acd6-d367-4081-82e2-33c786f39cc9 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957f85f9c6794cccad71c553fb607ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82c6b47c4140e390464b153d2fe865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:48:48.261745 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-5d01acd6-d367-4081-82e2-33c786f39cc9 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] 10.222.0.46 "GET /compute/v2.1/servers/50205979-c437-4302-b6f0-1bb76d7ea2c9" status: 200 len: 1319 microversion: 2.1 time: 0.463263 Jan 15 20:48:48.274588 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 73/101] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:48:47 2022] GET /compute/v2.1/servers/50205979-c437-4302-b6f0-1bb76d7ea2c9 => generated 1319 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:48:48.418636 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3315983d-4688-4141-86e0-ff8882839dad tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:48:48.420377 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-3315983d-4688-4141-86e0-ff8882839dad tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] [instance: 5736e502-fb8b-43e0-8763-ec341d6f5953] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:48:48.436981 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3315983d-4688-4141-86e0-ff8882839dad tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:48:48.438837 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3315983d-4688-4141-86e0-ff8882839dad tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:48:48.439820 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3315983d-4688-4141-86e0-ff8882839dad tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:48:48.443507 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3315983d-4688-4141-86e0-ff8882839dad tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:48:49.174010 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-3315983d-4688-4141-86e0-ff8882839dad tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4272283f80fd440c92c605310d8a441d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c9ae9cb7d2d4105a277bcaaf858b861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:48:49.196604 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3315983d-4688-4141-86e0-ff8882839dad tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] 10.222.0.46 "GET /compute/v2.1/servers/5736e502-fb8b-43e0-8763-ec341d6f5953" status: 200 len: 1338 microversion: 2.1 time: 0.782443 Jan 15 20:48:49.200387 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 29/102] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:48:48 2022] GET /compute/v2.1/servers/5736e502-fb8b-43e0-8763-ec341d6f5953 => generated 1338 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:48:49.287168 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-537ed94f-f72f-4676-ac13-d5b697fdff92 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:48:49.288561 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-537ed94f-f72f-4676-ac13-d5b697fdff92 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] [instance: 50205979-c437-4302-b6f0-1bb76d7ea2c9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:48:49.299568 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-537ed94f-f72f-4676-ac13-d5b697fdff92 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:48:49.301569 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-537ed94f-f72f-4676-ac13-d5b697fdff92 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:48:49.305075 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-537ed94f-f72f-4676-ac13-d5b697fdff92 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:48:49.307558 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-537ed94f-f72f-4676-ac13-d5b697fdff92 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:48:50.010853 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-537ed94f-f72f-4676-ac13-d5b697fdff92 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957f85f9c6794cccad71c553fb607ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82c6b47c4140e390464b153d2fe865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:48:50.024907 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-537ed94f-f72f-4676-ac13-d5b697fdff92 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] 10.222.0.46 "GET /compute/v2.1/servers/50205979-c437-4302-b6f0-1bb76d7ea2c9" status: 200 len: 1319 microversion: 2.1 time: 0.745756 Jan 15 20:48:50.033014 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 74/103] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:48:49 2022] GET /compute/v2.1/servers/50205979-c437-4302-b6f0-1bb76d7ea2c9 => generated 1319 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:48:50.218819 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-fdf1ca06-15cd-4e24-b163-691fa85fb5f0 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:48:50.219809 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-fdf1ca06-15cd-4e24-b163-691fa85fb5f0 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] [instance: 5736e502-fb8b-43e0-8763-ec341d6f5953] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:48:50.238474 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fdf1ca06-15cd-4e24-b163-691fa85fb5f0 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:48:50.239119 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fdf1ca06-15cd-4e24-b163-691fa85fb5f0 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:48:50.241003 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fdf1ca06-15cd-4e24-b163-691fa85fb5f0 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:48:50.245992 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fdf1ca06-15cd-4e24-b163-691fa85fb5f0 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:48:50.272878 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-58f29a40-0359-49b9-a87e-fb32ee87c171 tempest-InstanceUsageAuditLogTestJSON-256808966 tempest-InstanceUsageAuditLogTestJSON-256808966-project-admin] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:48:50.274612 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:48:50.274612 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:48:50.329557 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-58f29a40-0359-49b9-a87e-fb32ee87c171 tempest-InstanceUsageAuditLogTestJSON-256808966 tempest-InstanceUsageAuditLogTestJSON-256808966-project-admin] 10.222.0.46 "GET /compute/v2.1/os-instance_usage_audit_log/2022-01-15 20:48:49" status: 200 len: 318 microversion: 2.1 time: 0.538696 Jan 15 20:48:50.340431 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 30/104] 10.222.0.46 () {58 vars in 1250 bytes} [Sat Jan 15 20:48:49 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-01-15%2020%3A48%3A49 => generated 318 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:48:50.360422 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c2792bb6-5f03-451d-ac0d-554fdb616527 tempest-InstanceUsageAuditLogTestJSON-256808966 tempest-InstanceUsageAuditLogTestJSON-256808966-project-admin] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:48:50.363110 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:48:50.363110 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:48:50.402529 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c2792bb6-5f03-451d-ac0d-554fdb616527 tempest-InstanceUsageAuditLogTestJSON-256808966 tempest-InstanceUsageAuditLogTestJSON-256808966-project-admin] 10.222.0.46 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.060566 Jan 15 20:48:50.422914 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 31/105] 10.222.0.46 () {58 vars in 1184 bytes} [Sat Jan 15 20:48:50 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:48:50.534684 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c2792bb6-5f03-451d-ac0d-554fdb616527 tempest-InstanceUsageAuditLogTestJSON-256808966 tempest-InstanceUsageAuditLogTestJSON-256808966-project-admin] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:48:50.536275 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c2792bb6-5f03-451d-ac0d-554fdb616527 tempest-InstanceUsageAuditLogTestJSON-256808966 tempest-InstanceUsageAuditLogTestJSON-256808966-project-admin] 10.222.0.46 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001877 Jan 15 20:48:50.542594 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 32/106] 10.222.0.46 () {56 vars in 885 bytes} [Sat Jan 15 20:48:50 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jan 15 20:48:50.869340 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-fdf1ca06-15cd-4e24-b163-691fa85fb5f0 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4272283f80fd440c92c605310d8a441d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c9ae9cb7d2d4105a277bcaaf858b861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:48:50.892500 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-fdf1ca06-15cd-4e24-b163-691fa85fb5f0 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] 10.222.0.46 "GET /compute/v2.1/servers/5736e502-fb8b-43e0-8763-ec341d6f5953" status: 200 len: 1338 microversion: 2.1 time: 0.678152 Jan 15 20:48:50.894973 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 75/107] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:48:50 2022] GET /compute/v2.1/servers/5736e502-fb8b-43e0-8763-ec341d6f5953 => generated 1338 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:48:51.048266 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a2b351de-77a9-4059-b701-e08f97b0309b tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:48:51.049040 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a2b351de-77a9-4059-b701-e08f97b0309b tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] [instance: 50205979-c437-4302-b6f0-1bb76d7ea2c9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:48:51.075152 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a2b351de-77a9-4059-b701-e08f97b0309b tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:48:51.078756 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a2b351de-77a9-4059-b701-e08f97b0309b tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:48:51.085419 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a2b351de-77a9-4059-b701-e08f97b0309b tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:48:51.091154 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a2b351de-77a9-4059-b701-e08f97b0309b tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:48:51.098224 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-8accbf85-53a4-4d5d-888f-af86710311d9 req-c60ce877-f4ce-491b-bbeb-6ad71d7854bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50205979-c437-4302-b6f0-1bb76d7ea2c9", "tag": "41cea26c-65de-4cc6-a1d6-701315bcd28f"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:48:51.099926 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:48:51.099926 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:48:51.134495 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-8accbf85-53a4-4d5d-888f-af86710311d9 req-c60ce877-f4ce-491b-bbeb-6ad71d7854bc service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:48:51.134994 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-8accbf85-53a4-4d5d-888f-af86710311d9 req-c60ce877-f4ce-491b-bbeb-6ad71d7854bc service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:48:51.186004 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-8accbf85-53a4-4d5d-888f-af86710311d9 req-c60ce877-f4ce-491b-bbeb-6ad71d7854bc service nova] Creating event network-changed:41cea26c-65de-4cc6-a1d6-701315bcd28f for instance 50205979-c437-4302-b6f0-1bb76d7ea2c9 on nch1-master-1 Jan 15 20:48:51.217907 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-8accbf85-53a4-4d5d-888f-af86710311d9 req-c60ce877-f4ce-491b-bbeb-6ad71d7854bc service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119636 Jan 15 20:48:51.222134 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 76/108] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:48:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:48:51.913007 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e13a4034-da4f-481c-ace0-a2b727779c4d tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:48:51.914563 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e13a4034-da4f-481c-ace0-a2b727779c4d tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] [instance: 5736e502-fb8b-43e0-8763-ec341d6f5953] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:48:51.927539 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e13a4034-da4f-481c-ace0-a2b727779c4d tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:48:51.928666 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e13a4034-da4f-481c-ace0-a2b727779c4d tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:48:51.931739 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e13a4034-da4f-481c-ace0-a2b727779c4d tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:48:51.932352 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e13a4034-da4f-481c-ace0-a2b727779c4d tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:48:51.947036 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-a2b351de-77a9-4059-b701-e08f97b0309b tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957f85f9c6794cccad71c553fb607ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82c6b47c4140e390464b153d2fe865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:48:51.964250 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a2b351de-77a9-4059-b701-e08f97b0309b tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] 10.222.0.46 "GET /compute/v2.1/servers/50205979-c437-4302-b6f0-1bb76d7ea2c9" status: 200 len: 1319 microversion: 2.1 time: 0.920668 Jan 15 20:48:51.966486 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 33/109] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:48:51 2022] GET /compute/v2.1/servers/50205979-c437-4302-b6f0-1bb76d7ea2c9 => generated 1319 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:48:52.731491 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-e13a4034-da4f-481c-ace0-a2b727779c4d tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4272283f80fd440c92c605310d8a441d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c9ae9cb7d2d4105a277bcaaf858b861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:48:52.745721 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e13a4034-da4f-481c-ace0-a2b727779c4d tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] 10.222.0.46 "GET /compute/v2.1/servers/5736e502-fb8b-43e0-8763-ec341d6f5953" status: 200 len: 1338 microversion: 2.1 time: 0.834800 Jan 15 20:48:52.747142 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 77/110] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:48:51 2022] GET /compute/v2.1/servers/5736e502-fb8b-43e0-8763-ec341d6f5953 => generated 1338 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:48:52.986799 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-0852fd74-9fd0-49f1-99e7-4ec76fa28a20 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:48:52.987698 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-0852fd74-9fd0-49f1-99e7-4ec76fa28a20 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] [instance: 50205979-c437-4302-b6f0-1bb76d7ea2c9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:48:53.013922 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0852fd74-9fd0-49f1-99e7-4ec76fa28a20 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:48:53.017421 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0852fd74-9fd0-49f1-99e7-4ec76fa28a20 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:48:53.024507 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0852fd74-9fd0-49f1-99e7-4ec76fa28a20 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:48:53.026541 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0852fd74-9fd0-49f1-99e7-4ec76fa28a20 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:48:53.469244 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-0852fd74-9fd0-49f1-99e7-4ec76fa28a20 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957f85f9c6794cccad71c553fb607ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82c6b47c4140e390464b153d2fe865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:48:53.482241 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-0852fd74-9fd0-49f1-99e7-4ec76fa28a20 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] 10.222.0.46 "GET /compute/v2.1/servers/50205979-c437-4302-b6f0-1bb76d7ea2c9" status: 200 len: 1319 microversion: 2.1 time: 0.499968 Jan 15 20:48:53.482950 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 34/111] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:48:52 2022] GET /compute/v2.1/servers/50205979-c437-4302-b6f0-1bb76d7ea2c9 => generated 1319 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:48:53.765364 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-129e201a-f30b-451c-ab8f-2bda8c90e63b tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:48:53.766943 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-129e201a-f30b-451c-ab8f-2bda8c90e63b tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] [instance: 5736e502-fb8b-43e0-8763-ec341d6f5953] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:48:53.776578 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-129e201a-f30b-451c-ab8f-2bda8c90e63b tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:48:53.779644 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-129e201a-f30b-451c-ab8f-2bda8c90e63b tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:48:53.785982 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-129e201a-f30b-451c-ab8f-2bda8c90e63b tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:48:53.788697 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-129e201a-f30b-451c-ab8f-2bda8c90e63b tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:48:54.508164 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-7f89e288-3e88-49ec-926c-fff889b4845d tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:48:54.509888 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-7f89e288-3e88-49ec-926c-fff889b4845d tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] [instance: 50205979-c437-4302-b6f0-1bb76d7ea2c9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:48:54.529711 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7f89e288-3e88-49ec-926c-fff889b4845d tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:48:54.537843 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7f89e288-3e88-49ec-926c-fff889b4845d tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:48:54.539531 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7f89e288-3e88-49ec-926c-fff889b4845d tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:48:54.540206 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7f89e288-3e88-49ec-926c-fff889b4845d tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:48:54.587221 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-129e201a-f30b-451c-ab8f-2bda8c90e63b tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4272283f80fd440c92c605310d8a441d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c9ae9cb7d2d4105a277bcaaf858b861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:48:54.592772 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-129e201a-f30b-451c-ab8f-2bda8c90e63b tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] 10.222.0.46 "GET /compute/v2.1/servers/5736e502-fb8b-43e0-8763-ec341d6f5953" status: 200 len: 1338 microversion: 2.1 time: 0.832688 Jan 15 20:48:54.596674 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 78/112] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:48:53 2022] GET /compute/v2.1/servers/5736e502-fb8b-43e0-8763-ec341d6f5953 => generated 1338 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:48:55.315688 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-7f89e288-3e88-49ec-926c-fff889b4845d tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957f85f9c6794cccad71c553fb607ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82c6b47c4140e390464b153d2fe865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:48:55.327381 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-7f89e288-3e88-49ec-926c-fff889b4845d tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] 10.222.0.46 "GET /compute/v2.1/servers/50205979-c437-4302-b6f0-1bb76d7ea2c9" status: 200 len: 1319 microversion: 2.1 time: 0.830068 Jan 15 20:48:55.329590 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 35/113] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:48:54 2022] GET /compute/v2.1/servers/50205979-c437-4302-b6f0-1bb76d7ea2c9 => generated 1319 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:48:55.614412 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-356e247b-16d8-4c60-8d61-055a38bc9e55 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:48:55.616047 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-356e247b-16d8-4c60-8d61-055a38bc9e55 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] [instance: 5736e502-fb8b-43e0-8763-ec341d6f5953] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:48:55.632302 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-356e247b-16d8-4c60-8d61-055a38bc9e55 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:48:55.635532 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-356e247b-16d8-4c60-8d61-055a38bc9e55 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:48:55.636762 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-356e247b-16d8-4c60-8d61-055a38bc9e55 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:48:55.641752 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-356e247b-16d8-4c60-8d61-055a38bc9e55 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:48:55.947768 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-356e247b-16d8-4c60-8d61-055a38bc9e55 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4272283f80fd440c92c605310d8a441d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c9ae9cb7d2d4105a277bcaaf858b861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:48:55.959172 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-356e247b-16d8-4c60-8d61-055a38bc9e55 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] 10.222.0.46 "GET /compute/v2.1/servers/5736e502-fb8b-43e0-8763-ec341d6f5953" status: 200 len: 1338 microversion: 2.1 time: 0.349067 Jan 15 20:48:55.972964 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 79/114] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:48:55 2022] GET /compute/v2.1/servers/5736e502-fb8b-43e0-8763-ec341d6f5953 => generated 1338 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:48:56.421381 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3555469b-b39f-4302-b097-8e3725ffbca1 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:48:56.427343 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-3555469b-b39f-4302-b097-8e3725ffbca1 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] [instance: 50205979-c437-4302-b6f0-1bb76d7ea2c9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:48:56.456309 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3555469b-b39f-4302-b097-8e3725ffbca1 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:48:56.456759 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3555469b-b39f-4302-b097-8e3725ffbca1 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:48:56.462505 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3555469b-b39f-4302-b097-8e3725ffbca1 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:48:56.463029 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3555469b-b39f-4302-b097-8e3725ffbca1 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:48:56.986465 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-071ce661-de9d-4f1d-8bb4-2d2ac330547e tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:48:56.994028 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-071ce661-de9d-4f1d-8bb4-2d2ac330547e tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] [instance: 5736e502-fb8b-43e0-8763-ec341d6f5953] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:48:57.018126 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-071ce661-de9d-4f1d-8bb4-2d2ac330547e tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:48:57.021150 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-071ce661-de9d-4f1d-8bb4-2d2ac330547e tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:48:57.024881 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-071ce661-de9d-4f1d-8bb4-2d2ac330547e tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:48:57.025631 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-071ce661-de9d-4f1d-8bb4-2d2ac330547e tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:48:57.473903 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-3555469b-b39f-4302-b097-8e3725ffbca1 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957f85f9c6794cccad71c553fb607ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82c6b47c4140e390464b153d2fe865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:48:57.485518 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3555469b-b39f-4302-b097-8e3725ffbca1 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] 10.222.0.46 "GET /compute/v2.1/servers/50205979-c437-4302-b6f0-1bb76d7ea2c9" status: 200 len: 1319 microversion: 2.1 time: 1.141134 Jan 15 20:48:57.491471 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 36/115] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:48:56 2022] GET /compute/v2.1/servers/50205979-c437-4302-b6f0-1bb76d7ea2c9 => generated 1319 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:48:57.551767 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-071ce661-de9d-4f1d-8bb4-2d2ac330547e tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4272283f80fd440c92c605310d8a441d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c9ae9cb7d2d4105a277bcaaf858b861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:48:57.561592 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-071ce661-de9d-4f1d-8bb4-2d2ac330547e tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] 10.222.0.46 "GET /compute/v2.1/servers/5736e502-fb8b-43e0-8763-ec341d6f5953" status: 200 len: 1338 microversion: 2.1 time: 0.584239 Jan 15 20:48:57.581258 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 80/116] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:48:56 2022] GET /compute/v2.1/servers/5736e502-fb8b-43e0-8763-ec341d6f5953 => generated 1338 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:48:58.509549 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-77e96cab-7e2a-4d1e-96c5-ad74bc66b128 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:48:58.510294 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-77e96cab-7e2a-4d1e-96c5-ad74bc66b128 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] [instance: 50205979-c437-4302-b6f0-1bb76d7ea2c9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:48:58.526454 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-77e96cab-7e2a-4d1e-96c5-ad74bc66b128 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:48:58.527621 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-77e96cab-7e2a-4d1e-96c5-ad74bc66b128 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:48:58.535750 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-77e96cab-7e2a-4d1e-96c5-ad74bc66b128 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:48:58.537337 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-77e96cab-7e2a-4d1e-96c5-ad74bc66b128 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:48:58.579565 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7d2165ab-bfa0-47ed-8e69-d393c75a5d93 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:48:58.580337 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-7d2165ab-bfa0-47ed-8e69-d393c75a5d93 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] [instance: 5736e502-fb8b-43e0-8763-ec341d6f5953] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:48:58.589779 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7d2165ab-bfa0-47ed-8e69-d393c75a5d93 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:48:58.590240 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7d2165ab-bfa0-47ed-8e69-d393c75a5d93 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:48:58.591641 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7d2165ab-bfa0-47ed-8e69-d393c75a5d93 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:48:58.592090 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7d2165ab-bfa0-47ed-8e69-d393c75a5d93 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:48:58.984492 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-7d2165ab-bfa0-47ed-8e69-d393c75a5d93 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4272283f80fd440c92c605310d8a441d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c9ae9cb7d2d4105a277bcaaf858b861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:48:58.995109 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7d2165ab-bfa0-47ed-8e69-d393c75a5d93 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] 10.222.0.46 "GET /compute/v2.1/servers/5736e502-fb8b-43e0-8763-ec341d6f5953" status: 200 len: 1338 microversion: 2.1 time: 0.420785 Jan 15 20:48:58.995681 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 81/117] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:48:58 2022] GET /compute/v2.1/servers/5736e502-fb8b-43e0-8763-ec341d6f5953 => generated 1338 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:48:59.024051 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-77e96cab-7e2a-4d1e-96c5-ad74bc66b128 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957f85f9c6794cccad71c553fb607ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82c6b47c4140e390464b153d2fe865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:48:59.033333 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-77e96cab-7e2a-4d1e-96c5-ad74bc66b128 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] 10.222.0.46 "GET /compute/v2.1/servers/50205979-c437-4302-b6f0-1bb76d7ea2c9" status: 200 len: 1319 microversion: 2.1 time: 0.527921 Jan 15 20:48:59.035571 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 37/118] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:48:58 2022] GET /compute/v2.1/servers/50205979-c437-4302-b6f0-1bb76d7ea2c9 => generated 1319 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:48:59.514963 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-6651ae14-6595-4226-8f21-8f0934e33003 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:48:59.528417 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-6651ae14-6595-4226-8f21-8f0934e33003 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.333754 Jan 15 20:48:59.530005 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 82/119] 10.222.0.46 () {58 vars in 1136 bytes} [Sat Jan 15 20:48:59 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:48:59.752249 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5b06252b-15e3-4e3f-bcca-4c5170ddd007 tempest-ServersWithSpecificFlavorTestJSON-1166388665 tempest-ServersWithSpecificFlavorTestJSON-1166388665-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-1470379444", "id": 1777501818, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:48:59.755080 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:48:59.755080 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:48:59.836190 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5b06252b-15e3-4e3f-bcca-4c5170ddd007 tempest-ServersWithSpecificFlavorTestJSON-1166388665 tempest-ServersWithSpecificFlavorTestJSON-1166388665-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.299286 Jan 15 20:48:59.844161 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 38/120] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 20:48:59 2022] POST /compute/v2.1/flavors => generated 425 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:48:59.849907 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-cfa7a2de-877b-4936-abe5-9764eee87b67 tempest-ServersWithSpecificFlavorTestJSON-1166388665 tempest-ServersWithSpecificFlavorTestJSON-1166388665-project-admin] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:48:59.859241 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-cfa7a2de-877b-4936-abe5-9764eee87b67 tempest-ServersWithSpecificFlavorTestJSON-1166388665 tempest-ServersWithSpecificFlavorTestJSON-1166388665-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.013939 Jan 15 20:48:59.859833 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 39/121] 10.222.0.46 () {58 vars in 1181 bytes} [Sat Jan 15 20:48:59 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 20:48:59.868599 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3e116dd7-0001-41a1-ace7-4b85565cee00 tempest-ServersWithSpecificFlavorTestJSON-1166388665 tempest-ServersWithSpecificFlavorTestJSON-1166388665-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-378770473", "id": 1139881125, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:48:59.890293 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3e116dd7-0001-41a1-ace7-4b85565cee00 tempest-ServersWithSpecificFlavorTestJSON-1166388665 tempest-ServersWithSpecificFlavorTestJSON-1166388665-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 424 microversion: 2.1 time: 0.024844 Jan 15 20:48:59.892030 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 40/122] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 20:48:59 2022] POST /compute/v2.1/flavors => generated 424 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 20:48:59.902531 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-6ed58a5e-2f16-412a-9160-983a0e8f7ff5 tempest-ServersWithSpecificFlavorTestJSON-1166388665 tempest-ServersWithSpecificFlavorTestJSON-1166388665-project-admin] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:48:59.912932 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-6ed58a5e-2f16-412a-9160-983a0e8f7ff5 tempest-ServersWithSpecificFlavorTestJSON-1166388665 tempest-ServersWithSpecificFlavorTestJSON-1166388665-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.013812 Jan 15 20:48:59.913527 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 41/123] 10.222.0.46 () {58 vars in 1181 bytes} [Sat Jan 15 20:48:59 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 20:48:59.923557 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8f4be8a2-a820-42fc-b7ae-04d7ee573c24 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'create', calling method: .version_select at 0x7f30c9c47e50>, body: {"keypair": {"name": "tempest-keypair-2097977498"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:48:59.925203 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0ed67b0c-d0db-4a7d-9256-c52bedc09486 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1757888796", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:48:59.946796 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-8f4be8a2-a820-42fc-b7ae-04d7ee573c24 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Getting quotas for project 71c95e4b5695439dbc3f66a911264026. Resources: {'key_pairs'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:48:59.951262 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-8f4be8a2-a820-42fc-b7ae-04d7ee573c24 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Getting quotas for user 19d60caf368842b2aec08f0f5e14353a and project 71c95e4b5695439dbc3f66a911264026. Resources: {'key_pairs'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:49:00.012497 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.network.neutron [None req-0ed67b0c-d0db-4a7d-9256-c52bedc09486 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] validate_networks() for None {{(pid=129366) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 20:49:00.162665 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-8f4be8a2-a820-42fc-b7ae-04d7ee573c24 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Getting quotas for project 71c95e4b5695439dbc3f66a911264026. Resources: {'key_pairs'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:49:00.166546 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-8f4be8a2-a820-42fc-b7ae-04d7ee573c24 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Getting quotas for user 19d60caf368842b2aec08f0f5e14353a and project 71c95e4b5695439dbc3f66a911264026. Resources: {'key_pairs'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:49:00.181353 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-8f4be8a2-a820-42fc-b7ae-04d7ee573c24 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.261756 Jan 15 20:49:00.181965 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 42/124] 10.222.0.46 () {60 vars in 1157 bytes} [Sat Jan 15 20:48:59 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:49:00.188234 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e7044b1f-e7ab-441e-a473-7a1d6eec7514 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:00.188739 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e7044b1f-e7ab-441e-a473-7a1d6eec7514 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] [instance: 5736e502-fb8b-43e0-8763-ec341d6f5953] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:00.195250 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e7044b1f-e7ab-441e-a473-7a1d6eec7514 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:00.195910 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e7044b1f-e7ab-441e-a473-7a1d6eec7514 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:00.196776 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e7044b1f-e7ab-441e-a473-7a1d6eec7514 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:00.197493 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e7044b1f-e7ab-441e-a473-7a1d6eec7514 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:00.223547 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-0ed67b0c-d0db-4a7d-9256-c52bedc09486 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Flavor limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 20:49:00.223969 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-0ed67b0c-d0db-4a7d-9256-c52bedc09486 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Image limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 20:49:00.224444 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-0ed67b0c-d0db-4a7d-9256-c52bedc09486 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Flavor pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 20:49:00.224875 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-0ed67b0c-d0db-4a7d-9256-c52bedc09486 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Image pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 20:49:00.225456 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-0ed67b0c-d0db-4a7d-9256-c52bedc09486 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 20:49:00.245067 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0ed67b0c-d0db-4a7d-9256-c52bedc09486 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:00.246203 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0ed67b0c-d0db-4a7d-9256-c52bedc09486 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:00.247987 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0ed67b0c-d0db-4a7d-9256-c52bedc09486 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:00.248647 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0ed67b0c-d0db-4a7d-9256-c52bedc09486 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:00.272361 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-0ed67b0c-d0db-4a7d-9256-c52bedc09486 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Getting quotas for project 8ac923ea754345a9b79457833bd72da4. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:49:00.278689 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-0ed67b0c-d0db-4a7d-9256-c52bedc09486 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Getting quotas for user 0079c95473594ee9ada5a4bc6820a111 and project 8ac923ea754345a9b79457833bd72da4. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:49:00.303880 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-0ed67b0c-d0db-4a7d-9256-c52bedc09486 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Going to run 1 instances... {{(pid=129366) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 20:49:00.306929 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-0ed67b0c-d0db-4a7d-9256-c52bedc09486 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] [instance: d5416a14-72ee-4a24-80d3-9fe459a801d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 20:49:00.349532 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-e7044b1f-e7ab-441e-a473-7a1d6eec7514 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4272283f80fd440c92c605310d8a441d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c9ae9cb7d2d4105a277bcaaf858b861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:00.359801 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e7044b1f-e7ab-441e-a473-7a1d6eec7514 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] 10.222.0.46 "GET /compute/v2.1/servers/5736e502-fb8b-43e0-8763-ec341d6f5953" status: 200 len: 1338 microversion: 2.1 time: 0.176791 Jan 15 20:49:00.369434 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 43/125] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:00 2022] GET /compute/v2.1/servers/5736e502-fb8b-43e0-8763-ec341d6f5953 => generated 1338 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:00.375085 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-7a9f42e3-5bef-4814-b1ab-5a9d659111ed tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:00.376083 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-7a9f42e3-5bef-4814-b1ab-5a9d659111ed tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] [instance: 50205979-c437-4302-b6f0-1bb76d7ea2c9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:00.384050 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7a9f42e3-5bef-4814-b1ab-5a9d659111ed tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:00.384257 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0ed67b0c-d0db-4a7d-9256-c52bedc09486 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.758984 Jan 15 20:49:00.384968 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7a9f42e3-5bef-4814-b1ab-5a9d659111ed tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:00.385922 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7a9f42e3-5bef-4814-b1ab-5a9d659111ed tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:00.386527 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7a9f42e3-5bef-4814-b1ab-5a9d659111ed tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:00.391346 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 83/126] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 20:48:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 760 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 20:49:00.580910 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-7a9f42e3-5bef-4814-b1ab-5a9d659111ed tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957f85f9c6794cccad71c553fb607ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82c6b47c4140e390464b153d2fe865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:00.590002 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-bdaf20a1-1a11-4ca3-877f-e5b4910ec80c tempest-InstanceUsageAuditLogNegativeTestJSON-1082461641 tempest-InstanceUsageAuditLogNegativeTestJSON-1082461641-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:00.593609 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:00.593609 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:49:00.598690 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-7a9f42e3-5bef-4814-b1ab-5a9d659111ed tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] 10.222.0.46 "GET /compute/v2.1/servers/50205979-c437-4302-b6f0-1bb76d7ea2c9" status: 200 len: 1319 microversion: 2.1 time: 0.228065 Jan 15 20:49:00.601295 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-bdaf20a1-1a11-4ca3-877f-e5b4910ec80c tempest-InstanceUsageAuditLogNegativeTestJSON-1082461641 tempest-InstanceUsageAuditLogNegativeTestJSON-1082461641-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Jan 15 20:49:00.603501 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-bdaf20a1-1a11-4ca3-877f-e5b4910ec80c tempest-InstanceUsageAuditLogNegativeTestJSON-1082461641 tempest-InstanceUsageAuditLogNegativeTestJSON-1082461641-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:49:00.604556 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-bdaf20a1-1a11-4ca3-877f-e5b4910ec80c tempest-InstanceUsageAuditLogNegativeTestJSON-1082461641 tempest-InstanceUsageAuditLogNegativeTestJSON-1082461641-project-admin] 10.222.0.46 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.204766 Jan 15 20:49:00.610370 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 44/127] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:00 2022] GET /compute/v2.1/servers/50205979-c437-4302-b6f0-1bb76d7ea2c9 => generated 1319 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:00.612776 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 84/128] 10.222.0.46 () {58 vars in 1223 bytes} [Sat Jan 15 20:49:00 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 213 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jan 15 20:49:00.616361 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2c27d492-d6ff-4b5c-999c-a5093775fbd1 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:00.617270 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-2c27d492-d6ff-4b5c-999c-a5093775fbd1 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] [instance: d5416a14-72ee-4a24-80d3-9fe459a801d8] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:00.756534 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-2c27d492-d6ff-4b5c-999c-a5093775fbd1 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0079c95473594ee9ada5a4bc6820a111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac923ea754345a9b79457833bd72da4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:00.771008 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2c27d492-d6ff-4b5c-999c-a5093775fbd1 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] 10.222.0.46 "GET /compute/v2.1/servers/d5416a14-72ee-4a24-80d3-9fe459a801d8" status: 200 len: 1219 microversion: 2.1 time: 0.159186 Jan 15 20:49:00.771606 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 45/129] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:00 2022] GET /compute/v2.1/servers/d5416a14-72ee-4a24-80d3-9fe459a801d8 => generated 1219 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:00.807646 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c5e05e1b-d0ab-4eb7-a5ad-fc8fd1be6473 tempest-InstanceUsageAuditLogNegativeTestJSON-1854437593 tempest-InstanceUsageAuditLogNegativeTestJSON-1854437593-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:00.808401 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:00.808401 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:49:00.810291 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-c5e05e1b-d0ab-4eb7-a5ad-fc8fd1be6473 tempest-InstanceUsageAuditLogNegativeTestJSON-1854437593 tempest-InstanceUsageAuditLogNegativeTestJSON-1854437593-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': 'acd91ef954754e4c8a28612fb98a48f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933eb5ae594344569f91c10e3df0e2f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:00.810945 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c5e05e1b-d0ab-4eb7-a5ad-fc8fd1be6473 tempest-InstanceUsageAuditLogNegativeTestJSON-1854437593 tempest-InstanceUsageAuditLogNegativeTestJSON-1854437593-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:49:00.811870 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c5e05e1b-d0ab-4eb7-a5ad-fc8fd1be6473 tempest-InstanceUsageAuditLogNegativeTestJSON-1854437593 tempest-InstanceUsageAuditLogNegativeTestJSON-1854437593-project] 10.222.0.46 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.197937 Jan 15 20:49:00.812329 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 85/130] 10.222.0.46 () {58 vars in 1184 bytes} [Sat Jan 15 20:49:00 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 199 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:49:00.824627 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-476253a6-fa81-46b1-8e8d-159a244ec458 tempest-InstanceUsageAuditLogNegativeTestJSON-1854437593 tempest-InstanceUsageAuditLogNegativeTestJSON-1854437593-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:00.826633 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:00.826633 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:49:00.828271 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-476253a6-fa81-46b1-8e8d-159a244ec458 tempest-InstanceUsageAuditLogNegativeTestJSON-1854437593 tempest-InstanceUsageAuditLogNegativeTestJSON-1854437593-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': 'acd91ef954754e4c8a28612fb98a48f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933eb5ae594344569f91c10e3df0e2f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:00.829057 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-476253a6-fa81-46b1-8e8d-159a244ec458 tempest-InstanceUsageAuditLogNegativeTestJSON-1854437593 tempest-InstanceUsageAuditLogNegativeTestJSON-1854437593-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:49:00.829974 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-476253a6-fa81-46b1-8e8d-159a244ec458 tempest-InstanceUsageAuditLogNegativeTestJSON-1854437593 tempest-InstanceUsageAuditLogNegativeTestJSON-1854437593-project] 10.222.0.46 "GET /compute/v2.1/os-instance_usage_audit_log/2022-01-15 20:49:00" status: 403 len: 128 microversion: 2.1 time: 0.012612 Jan 15 20:49:00.830580 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 46/131] 10.222.0.46 () {58 vars in 1250 bytes} [Sat Jan 15 20:49:00 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-01-15%2020%3A49%3A00 => generated 128 bytes in 14 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jan 15 20:49:01.379056 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a7942af1-168c-46b5-9f09-b72108162daf tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:01.380623 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a7942af1-168c-46b5-9f09-b72108162daf tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] [instance: 5736e502-fb8b-43e0-8763-ec341d6f5953] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:01.394094 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a7942af1-168c-46b5-9f09-b72108162daf tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:01.395625 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a7942af1-168c-46b5-9f09-b72108162daf tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:01.397968 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a7942af1-168c-46b5-9f09-b72108162daf tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:01.399222 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a7942af1-168c-46b5-9f09-b72108162daf tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:01.617424 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d33782cf-3435-43b9-be92-db4602c8309c tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:01.618505 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d33782cf-3435-43b9-be92-db4602c8309c tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] [instance: 50205979-c437-4302-b6f0-1bb76d7ea2c9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:01.631009 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d33782cf-3435-43b9-be92-db4602c8309c tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:01.631881 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d33782cf-3435-43b9-be92-db4602c8309c tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:01.632883 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d33782cf-3435-43b9-be92-db4602c8309c tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:01.633268 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d33782cf-3435-43b9-be92-db4602c8309c tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:01.870616 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-a7942af1-168c-46b5-9f09-b72108162daf tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4272283f80fd440c92c605310d8a441d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c9ae9cb7d2d4105a277bcaaf858b861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:01.878657 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a7942af1-168c-46b5-9f09-b72108162daf tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] 10.222.0.46 "GET /compute/v2.1/servers/5736e502-fb8b-43e0-8763-ec341d6f5953" status: 200 len: 1338 microversion: 2.1 time: 0.504099 Jan 15 20:49:01.886454 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 86/132] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:01 2022] GET /compute/v2.1/servers/5736e502-fb8b-43e0-8763-ec341d6f5953 => generated 1338 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:01.891261 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ad0677f6-760f-40c4-95bf-25f802900d1d tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:01.896694 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ad0677f6-760f-40c4-95bf-25f802900d1d tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] [instance: d5416a14-72ee-4a24-80d3-9fe459a801d8] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:01.902946 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ad0677f6-760f-40c4-95bf-25f802900d1d tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:01.911741 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ad0677f6-760f-40c4-95bf-25f802900d1d tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:01.912812 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ad0677f6-760f-40c4-95bf-25f802900d1d tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:01.913385 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ad0677f6-760f-40c4-95bf-25f802900d1d tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:02.116735 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-ad0677f6-760f-40c4-95bf-25f802900d1d tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0079c95473594ee9ada5a4bc6820a111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac923ea754345a9b79457833bd72da4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:02.133362 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-d33782cf-3435-43b9-be92-db4602c8309c tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957f85f9c6794cccad71c553fb607ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82c6b47c4140e390464b153d2fe865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:02.137502 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ad0677f6-760f-40c4-95bf-25f802900d1d tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] 10.222.0.46 "GET /compute/v2.1/servers/d5416a14-72ee-4a24-80d3-9fe459a801d8" status: 200 len: 1289 microversion: 2.1 time: 0.249252 Jan 15 20:49:02.139937 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 87/133] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:01 2022] GET /compute/v2.1/servers/d5416a14-72ee-4a24-80d3-9fe459a801d8 => generated 1289 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:02.153823 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d33782cf-3435-43b9-be92-db4602c8309c tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] 10.222.0.46 "GET /compute/v2.1/servers/50205979-c437-4302-b6f0-1bb76d7ea2c9" status: 200 len: 1319 microversion: 2.1 time: 0.540449 Jan 15 20:49:02.155662 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 47/134] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:01 2022] GET /compute/v2.1/servers/50205979-c437-4302-b6f0-1bb76d7ea2c9 => generated 1319 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:49:02.698540 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b364e98a-88ce-49c4-9d47-aa51900278ed tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1837135319", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "1139881125", "adminPass": "***", "networks": [{"uuid": "f500117d-1a95-41f2-bf61-8c0369c6db83"}], "security_groups": [{"name": "tempest-securitygroup--1648149025"}], "key_name": "tempest-keypair-2097977498", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:02.894926 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.network.neutron [None req-b364e98a-88ce-49c4-9d47-aa51900278ed tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] validate_networks() for [('f500117d-1a95-41f2-bf61-8c0369c6db83', None, None, None, None, None)] {{(pid=129366) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 20:49:02.908563 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ea5830de-75bb-4d1a-a579-e2f5fa1fbf0e tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:02.909849 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ea5830de-75bb-4d1a-a579-e2f5fa1fbf0e tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] [instance: 5736e502-fb8b-43e0-8763-ec341d6f5953] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:02.938164 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ea5830de-75bb-4d1a-a579-e2f5fa1fbf0e tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:02.949056 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ea5830de-75bb-4d1a-a579-e2f5fa1fbf0e tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:02.953755 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ea5830de-75bb-4d1a-a579-e2f5fa1fbf0e tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:02.956449 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ea5830de-75bb-4d1a-a579-e2f5fa1fbf0e tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:03.476761 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-ea5830de-75bb-4d1a-a579-e2f5fa1fbf0e tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4272283f80fd440c92c605310d8a441d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c9ae9cb7d2d4105a277bcaaf858b861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:03.501511 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ea5830de-75bb-4d1a-a579-e2f5fa1fbf0e tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] 10.222.0.46 "GET /compute/v2.1/servers/5736e502-fb8b-43e0-8763-ec341d6f5953" status: 200 len: 1338 microversion: 2.1 time: 0.601227 Jan 15 20:49:03.523192 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 48/135] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:02 2022] GET /compute/v2.1/servers/5736e502-fb8b-43e0-8763-ec341d6f5953 => generated 1338 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:03.538812 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-7fdced7b-e9a6-4134-9c93-20b1d9ec4b0e tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:03.542120 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-7fdced7b-e9a6-4134-9c93-20b1d9ec4b0e tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] [instance: d5416a14-72ee-4a24-80d3-9fe459a801d8] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:03.554014 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7fdced7b-e9a6-4134-9c93-20b1d9ec4b0e tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:03.555517 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7fdced7b-e9a6-4134-9c93-20b1d9ec4b0e tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:03.556539 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7fdced7b-e9a6-4134-9c93-20b1d9ec4b0e tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:03.562492 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7fdced7b-e9a6-4134-9c93-20b1d9ec4b0e tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:03.996508 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-7fdced7b-e9a6-4134-9c93-20b1d9ec4b0e tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0079c95473594ee9ada5a4bc6820a111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac923ea754345a9b79457833bd72da4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:04.009872 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-7fdced7b-e9a6-4134-9c93-20b1d9ec4b0e tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] 10.222.0.46 "GET /compute/v2.1/servers/d5416a14-72ee-4a24-80d3-9fe459a801d8" status: 200 len: 1319 microversion: 2.1 time: 0.481113 Jan 15 20:49:04.010748 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 49/136] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:03 2022] GET /compute/v2.1/servers/d5416a14-72ee-4a24-80d3-9fe459a801d8 => generated 1319 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:04.027122 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-092aedf4-4f47-48bf-9d2d-0421bf837e48 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:04.028118 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-092aedf4-4f47-48bf-9d2d-0421bf837e48 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] [instance: 50205979-c437-4302-b6f0-1bb76d7ea2c9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:04.036161 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-092aedf4-4f47-48bf-9d2d-0421bf837e48 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:04.037050 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-092aedf4-4f47-48bf-9d2d-0421bf837e48 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:04.038411 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-092aedf4-4f47-48bf-9d2d-0421bf837e48 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:04.039049 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-092aedf4-4f47-48bf-9d2d-0421bf837e48 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:04.407953 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-b364e98a-88ce-49c4-9d47-aa51900278ed tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Flavor limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 20:49:04.409046 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-b364e98a-88ce-49c4-9d47-aa51900278ed tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Image limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 20:49:04.409859 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-b364e98a-88ce-49c4-9d47-aa51900278ed tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Flavor pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 20:49:04.410605 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-b364e98a-88ce-49c4-9d47-aa51900278ed tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Image pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 20:49:04.411204 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-b364e98a-88ce-49c4-9d47-aa51900278ed tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 20:49:04.422203 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b364e98a-88ce-49c4-9d47-aa51900278ed tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:04.423013 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b364e98a-88ce-49c4-9d47-aa51900278ed tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:04.424154 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b364e98a-88ce-49c4-9d47-aa51900278ed tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:04.424785 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b364e98a-88ce-49c4-9d47-aa51900278ed tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:04.460618 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-b364e98a-88ce-49c4-9d47-aa51900278ed tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Getting quotas for project 71c95e4b5695439dbc3f66a911264026. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:49:04.464996 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-b364e98a-88ce-49c4-9d47-aa51900278ed tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Getting quotas for user 19d60caf368842b2aec08f0f5e14353a and project 71c95e4b5695439dbc3f66a911264026. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:49:04.468219 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-092aedf4-4f47-48bf-9d2d-0421bf837e48 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957f85f9c6794cccad71c553fb607ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82c6b47c4140e390464b153d2fe865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:04.478550 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-092aedf4-4f47-48bf-9d2d-0421bf837e48 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] 10.222.0.46 "GET /compute/v2.1/servers/50205979-c437-4302-b6f0-1bb76d7ea2c9" status: 200 len: 1319 microversion: 2.1 time: 0.466608 Jan 15 20:49:04.479157 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 50/137] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:04 2022] GET /compute/v2.1/servers/50205979-c437-4302-b6f0-1bb76d7ea2c9 => generated 1319 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:04.486059 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b364e98a-88ce-49c4-9d47-aa51900278ed tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Going to run 1 instances... {{(pid=129366) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 20:49:04.489941 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b364e98a-88ce-49c4-9d47-aa51900278ed tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 98d0ca37-0175-44e2-8a1d-965cdc517daf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 20:49:04.528717 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f797be21-3968-4691-9a4c-45823945e873 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:04.530922 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f797be21-3968-4691-9a4c-45823945e873 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] [instance: 5736e502-fb8b-43e0-8763-ec341d6f5953] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:04.537533 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f797be21-3968-4691-9a4c-45823945e873 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:04.538016 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f797be21-3968-4691-9a4c-45823945e873 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:04.538811 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f797be21-3968-4691-9a4c-45823945e873 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:04.539248 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f797be21-3968-4691-9a4c-45823945e873 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:04.545736 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b364e98a-88ce-49c4-9d47-aa51900278ed tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.853240 Jan 15 20:49:04.547229 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 88/138] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 20:49:02 2022] POST /compute/v2.1/servers => generated 402 bytes in 1855 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 20:49:04.557116 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8fc9c3b8-b962-413b-8148-04aacb0adf50 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:04.557953 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-8fc9c3b8-b962-413b-8148-04aacb0adf50 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 98d0ca37-0175-44e2-8a1d-965cdc517daf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:04.633174 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-8fc9c3b8-b962-413b-8148-04aacb0adf50 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d60caf368842b2aec08f0f5e14353a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c95e4b5695439dbc3f66a911264026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:04.652053 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-8fc9c3b8-b962-413b-8148-04aacb0adf50 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "GET /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf" status: 200 len: 1265 microversion: 2.1 time: 0.095598 Jan 15 20:49:04.653954 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 89/139] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:04 2022] GET /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf => generated 1265 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:49:05.054647 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8fd09f32-4505-4d51-90d1-914cb9b221b5 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-831694970", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:05.104320 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-f797be21-3968-4691-9a4c-45823945e873 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4272283f80fd440c92c605310d8a441d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c9ae9cb7d2d4105a277bcaaf858b861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:05.117884 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f797be21-3968-4691-9a4c-45823945e873 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] 10.222.0.46 "GET /compute/v2.1/servers/5736e502-fb8b-43e0-8763-ec341d6f5953" status: 200 len: 1338 microversion: 2.1 time: 0.595613 Jan 15 20:49:05.121441 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 51/140] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:04 2022] GET /compute/v2.1/servers/5736e502-fb8b-43e0-8763-ec341d6f5953 => generated 1338 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:05.140166 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.network.neutron [None req-8fd09f32-4505-4d51-90d1-914cb9b221b5 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] validate_networks() for None {{(pid=129366) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 20:49:05.150033 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-16118010-498a-4c8f-85ec-ebef206b8854 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:05.151163 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-16118010-498a-4c8f-85ec-ebef206b8854 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] [instance: d5416a14-72ee-4a24-80d3-9fe459a801d8] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:05.161391 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-16118010-498a-4c8f-85ec-ebef206b8854 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:05.161915 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-16118010-498a-4c8f-85ec-ebef206b8854 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:05.162975 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-16118010-498a-4c8f-85ec-ebef206b8854 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:05.163467 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-16118010-498a-4c8f-85ec-ebef206b8854 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:05.631832 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-16118010-498a-4c8f-85ec-ebef206b8854 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0079c95473594ee9ada5a4bc6820a111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac923ea754345a9b79457833bd72da4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:05.652623 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-16118010-498a-4c8f-85ec-ebef206b8854 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] 10.222.0.46 "GET /compute/v2.1/servers/d5416a14-72ee-4a24-80d3-9fe459a801d8" status: 200 len: 1319 microversion: 2.1 time: 0.526390 Jan 15 20:49:05.669682 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 52/141] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:05 2022] GET /compute/v2.1/servers/d5416a14-72ee-4a24-80d3-9fe459a801d8 => generated 1319 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:05.714183 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-8fd09f32-4505-4d51-90d1-914cb9b221b5 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Flavor limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 20:49:05.714708 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-8fd09f32-4505-4d51-90d1-914cb9b221b5 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Image limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 20:49:05.715227 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-8fd09f32-4505-4d51-90d1-914cb9b221b5 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Flavor pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 20:49:05.715940 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-8fd09f32-4505-4d51-90d1-914cb9b221b5 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Image pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 20:49:05.716698 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-8fd09f32-4505-4d51-90d1-914cb9b221b5 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 20:49:05.737654 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8fd09f32-4505-4d51-90d1-914cb9b221b5 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:05.744194 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8fd09f32-4505-4d51-90d1-914cb9b221b5 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:05.745583 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8fd09f32-4505-4d51-90d1-914cb9b221b5 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:05.747344 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8fd09f32-4505-4d51-90d1-914cb9b221b5 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:05.787514 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-5c7a84fa-5b1c-4864-b438-81cac7bf26fb req-4dc16062-b48f-40c8-bde3-9086a484904c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5736e502-fb8b-43e0-8763-ec341d6f5953", "name": "network-vif-plugged", "status": "completed", "tag": "ab3b6f1e-5ff9-47f0-945c-77448dbe354e"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:05.789132 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:05.789132 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:49:05.806395 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-5c7a84fa-5b1c-4864-b438-81cac7bf26fb req-4dc16062-b48f-40c8-bde3-9086a484904c service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:05.807386 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-5c7a84fa-5b1c-4864-b438-81cac7bf26fb req-4dc16062-b48f-40c8-bde3-9086a484904c service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:05.809587 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-8fd09f32-4505-4d51-90d1-914cb9b221b5 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Getting quotas for project 8e6badf41af14266b626a14241efaf88. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:49:05.814449 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-8fd09f32-4505-4d51-90d1-914cb9b221b5 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Getting quotas for user 9245b10067884c428525283137ca04c6 and project 8e6badf41af14266b626a14241efaf88. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:49:05.827740 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-8fd09f32-4505-4d51-90d1-914cb9b221b5 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Going to run 1 instances... {{(pid=129366) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 20:49:05.830364 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-8fd09f32-4505-4d51-90d1-914cb9b221b5 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: 4d527369-954d-4ccc-9105-03b209d3523e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 20:49:05.831160 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-5c7a84fa-5b1c-4864-b438-81cac7bf26fb req-4dc16062-b48f-40c8-bde3-9086a484904c service nova] Creating event network-vif-plugged:ab3b6f1e-5ff9-47f0-945c-77448dbe354e for instance 5736e502-fb8b-43e0-8763-ec341d6f5953 on nch2-master-1 Jan 15 20:49:05.831697 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-5c7a84fa-5b1c-4864-b438-81cac7bf26fb req-4dc16062-b48f-40c8-bde3-9086a484904c service nova] Acquired lock "compute-rpcapi-router" {{(pid=129365) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jan 15 20:49:05.832824 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-43f87ac9-8e5f-44de-960b-31c225847848 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:05.833513 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-43f87ac9-8e5f-44de-960b-31c225847848 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:05.835104 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-43f87ac9-8e5f-44de-960b-31c225847848 None None] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:05.835542 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-43f87ac9-8e5f-44de-960b-31c225847848 None None] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:05.846579 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.compute.rpcapi [None req-43f87ac9-8e5f-44de-960b-31c225847848 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Jan 15 20:49:05.847535 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-43f87ac9-8e5f-44de-960b-31c225847848 None None] Releasing lock "compute-rpcapi-router" {{(pid=129365) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jan 15 20:49:05.866402 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-43f87ac9-8e5f-44de-960b-31c225847848 None None] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.195083 Jan 15 20:49:05.867139 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 53/142] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:49:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:49:05.876196 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-1d5e2cf5-5d2c-4744-83a4-c4e1dd362e6a req-813c8e03-9ca9-421a-bfe8-659941dfd3bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5416a14-72ee-4a24-80d3-9fe459a801d8", "tag": "5a8eebf2-aebe-45dc-86b0-8add6202f632"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:05.878005 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:05.878005 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:49:05.888680 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-1d5e2cf5-5d2c-4744-83a4-c4e1dd362e6a req-813c8e03-9ca9-421a-bfe8-659941dfd3bb service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:05.890594 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-1d5e2cf5-5d2c-4744-83a4-c4e1dd362e6a req-813c8e03-9ca9-421a-bfe8-659941dfd3bb service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:05.908960 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-1d5e2cf5-5d2c-4744-83a4-c4e1dd362e6a req-813c8e03-9ca9-421a-bfe8-659941dfd3bb service nova] Creating event network-changed:5a8eebf2-aebe-45dc-86b0-8add6202f632 for instance d5416a14-72ee-4a24-80d3-9fe459a801d8 on nch1-master-1 Jan 15 20:49:05.915531 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-1d5e2cf5-5d2c-4744-83a4-c4e1dd362e6a req-813c8e03-9ca9-421a-bfe8-659941dfd3bb service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045411 Jan 15 20:49:05.916615 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 54/143] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:49:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:49:05.922473 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-1f8d80ed-d0ff-42fd-a983-483a23a33bc8 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:05.923387 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-1f8d80ed-d0ff-42fd-a983-483a23a33bc8 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] [instance: 50205979-c437-4302-b6f0-1bb76d7ea2c9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:05.934730 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1f8d80ed-d0ff-42fd-a983-483a23a33bc8 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:05.935589 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1f8d80ed-d0ff-42fd-a983-483a23a33bc8 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:05.936668 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1f8d80ed-d0ff-42fd-a983-483a23a33bc8 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:05.937285 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1f8d80ed-d0ff-42fd-a983-483a23a33bc8 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:05.945774 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-8fd09f32-4505-4d51-90d1-914cb9b221b5 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.147015 Jan 15 20:49:05.953711 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 90/144] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 20:49:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1155 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 15 20:49:05.958948 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-565f4e49-7526-41a3-9126-3d85d91bafd4 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:05.961350 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-565f4e49-7526-41a3-9126-3d85d91bafd4 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 98d0ca37-0175-44e2-8a1d-965cdc517daf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:05.969464 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-565f4e49-7526-41a3-9126-3d85d91bafd4 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:05.970130 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-565f4e49-7526-41a3-9126-3d85d91bafd4 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:05.971189 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-565f4e49-7526-41a3-9126-3d85d91bafd4 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:05.971629 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-565f4e49-7526-41a3-9126-3d85d91bafd4 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:06.127916 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-565f4e49-7526-41a3-9126-3d85d91bafd4 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d60caf368842b2aec08f0f5e14353a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c95e4b5695439dbc3f66a911264026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:06.139205 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-565f4e49-7526-41a3-9126-3d85d91bafd4 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "GET /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf" status: 200 len: 1339 microversion: 2.1 time: 0.183984 Jan 15 20:49:06.140490 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 91/145] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:05 2022] GET /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf => generated 1339 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:06.145817 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-70501628-a481-4855-a5eb-8f57367f4232 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:06.146688 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-70501628-a481-4855-a5eb-8f57367f4232 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: 4d527369-954d-4ccc-9105-03b209d3523e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:06.240029 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-70501628-a481-4855-a5eb-8f57367f4232 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:06.271943 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-70501628-a481-4855-a5eb-8f57367f4232 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/4d527369-954d-4ccc-9105-03b209d3523e" status: 200 len: 1212 microversion: 2.1 time: 0.127082 Jan 15 20:49:06.286502 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 92/146] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:06 2022] GET /compute/v2.1/servers/4d527369-954d-4ccc-9105-03b209d3523e => generated 1212 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:06.293335 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e60f94ad-b573-431e-9b83-71efc1d44cb3 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:06.297503 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e60f94ad-b573-431e-9b83-71efc1d44cb3 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] [instance: 5736e502-fb8b-43e0-8763-ec341d6f5953] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:06.308934 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e60f94ad-b573-431e-9b83-71efc1d44cb3 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:06.310088 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e60f94ad-b573-431e-9b83-71efc1d44cb3 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:06.311151 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e60f94ad-b573-431e-9b83-71efc1d44cb3 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:06.311747 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e60f94ad-b573-431e-9b83-71efc1d44cb3 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:06.423725 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-1f8d80ed-d0ff-42fd-a983-483a23a33bc8 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957f85f9c6794cccad71c553fb607ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82c6b47c4140e390464b153d2fe865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:06.436762 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-1f8d80ed-d0ff-42fd-a983-483a23a33bc8 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] 10.222.0.46 "GET /compute/v2.1/servers/50205979-c437-4302-b6f0-1bb76d7ea2c9" status: 200 len: 1319 microversion: 2.1 time: 0.518391 Jan 15 20:49:06.438229 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 55/147] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:05 2022] GET /compute/v2.1/servers/50205979-c437-4302-b6f0-1bb76d7ea2c9 => generated 1319 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:06.673181 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9e842319-56e7-4105-a627-e91a52af4a89 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:06.676648 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-9e842319-56e7-4105-a627-e91a52af4a89 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] [instance: d5416a14-72ee-4a24-80d3-9fe459a801d8] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:06.676772 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-e60f94ad-b573-431e-9b83-71efc1d44cb3 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4272283f80fd440c92c605310d8a441d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c9ae9cb7d2d4105a277bcaaf858b861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:06.686217 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9e842319-56e7-4105-a627-e91a52af4a89 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:06.687430 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9e842319-56e7-4105-a627-e91a52af4a89 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:06.688454 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9e842319-56e7-4105-a627-e91a52af4a89 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:06.689121 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9e842319-56e7-4105-a627-e91a52af4a89 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:06.690205 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e60f94ad-b573-431e-9b83-71efc1d44cb3 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] 10.222.0.46 "GET /compute/v2.1/servers/5736e502-fb8b-43e0-8763-ec341d6f5953" status: 200 len: 1338 microversion: 2.1 time: 0.402241 Jan 15 20:49:06.691145 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 93/148] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:06 2022] GET /compute/v2.1/servers/5736e502-fb8b-43e0-8763-ec341d6f5953 => generated 1338 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:06.957217 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-9e842319-56e7-4105-a627-e91a52af4a89 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0079c95473594ee9ada5a4bc6820a111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac923ea754345a9b79457833bd72da4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:06.964715 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-9e842319-56e7-4105-a627-e91a52af4a89 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] 10.222.0.46 "GET /compute/v2.1/servers/d5416a14-72ee-4a24-80d3-9fe459a801d8" status: 200 len: 1319 microversion: 2.1 time: 0.296975 Jan 15 20:49:06.966946 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 56/149] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:06 2022] GET /compute/v2.1/servers/d5416a14-72ee-4a24-80d3-9fe459a801d8 => generated 1319 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:49:07.159341 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1f846c2a-51dd-438a-962d-85756fbf6be7 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:07.160549 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-1f846c2a-51dd-438a-962d-85756fbf6be7 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 98d0ca37-0175-44e2-8a1d-965cdc517daf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:07.170907 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1f846c2a-51dd-438a-962d-85756fbf6be7 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:07.172550 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1f846c2a-51dd-438a-962d-85756fbf6be7 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:07.174791 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1f846c2a-51dd-438a-962d-85756fbf6be7 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:07.175462 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1f846c2a-51dd-438a-962d-85756fbf6be7 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:07.289701 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a6f57e9e-e8a8-43d0-8b36-abb50d1bbb15 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:07.290415 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a6f57e9e-e8a8-43d0-8b36-abb50d1bbb15 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: 4d527369-954d-4ccc-9105-03b209d3523e] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:07.296029 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-1f846c2a-51dd-438a-962d-85756fbf6be7 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d60caf368842b2aec08f0f5e14353a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c95e4b5695439dbc3f66a911264026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:07.298280 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a6f57e9e-e8a8-43d0-8b36-abb50d1bbb15 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:07.298787 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a6f57e9e-e8a8-43d0-8b36-abb50d1bbb15 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:07.300167 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a6f57e9e-e8a8-43d0-8b36-abb50d1bbb15 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:07.300614 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a6f57e9e-e8a8-43d0-8b36-abb50d1bbb15 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:07.306321 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-1f846c2a-51dd-438a-962d-85756fbf6be7 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "GET /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf" status: 200 len: 1345 microversion: 2.1 time: 0.151498 Jan 15 20:49:07.319958 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 94/150] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:07 2022] GET /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf => generated 1345 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:07.417642 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-a6f57e9e-e8a8-43d0-8b36-abb50d1bbb15 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:07.428580 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a6f57e9e-e8a8-43d0-8b36-abb50d1bbb15 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/4d527369-954d-4ccc-9105-03b209d3523e" status: 200 len: 1272 microversion: 2.1 time: 0.142370 Jan 15 20:49:07.439795 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 57/151] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:07 2022] GET /compute/v2.1/servers/4d527369-954d-4ccc-9105-03b209d3523e => generated 1272 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:07.454864 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-bccbfb12-1c22-4222-aa84-72730502acf6 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:07.455788 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-bccbfb12-1c22-4222-aa84-72730502acf6 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] [instance: 50205979-c437-4302-b6f0-1bb76d7ea2c9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:07.465270 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bccbfb12-1c22-4222-aa84-72730502acf6 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:07.466132 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bccbfb12-1c22-4222-aa84-72730502acf6 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:07.467180 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bccbfb12-1c22-4222-aa84-72730502acf6 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:07.467633 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bccbfb12-1c22-4222-aa84-72730502acf6 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:07.703232 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-bccbfb12-1c22-4222-aa84-72730502acf6 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957f85f9c6794cccad71c553fb607ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82c6b47c4140e390464b153d2fe865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:07.707267 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9c30165e-7478-4919-ba46-4ff8784761d3 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:07.708471 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-9c30165e-7478-4919-ba46-4ff8784761d3 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] [instance: 5736e502-fb8b-43e0-8763-ec341d6f5953] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:07.713914 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-bccbfb12-1c22-4222-aa84-72730502acf6 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] 10.222.0.46 "GET /compute/v2.1/servers/50205979-c437-4302-b6f0-1bb76d7ea2c9" status: 200 len: 1319 microversion: 2.1 time: 0.263518 Jan 15 20:49:07.714780 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9c30165e-7478-4919-ba46-4ff8784761d3 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:07.715214 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 95/152] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:07 2022] GET /compute/v2.1/servers/50205979-c437-4302-b6f0-1bb76d7ea2c9 => generated 1319 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:07.724328 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9c30165e-7478-4919-ba46-4ff8784761d3 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:07.725179 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9c30165e-7478-4919-ba46-4ff8784761d3 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:07.725629 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9c30165e-7478-4919-ba46-4ff8784761d3 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:07.883158 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-6081820b-b4a8-47a6-9fcb-47064ae3d847 req-f69c51b7-7119-408b-91cf-994dd67d33d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50205979-c437-4302-b6f0-1bb76d7ea2c9", "name": "network-vif-plugged", "status": "completed", "tag": "41cea26c-65de-4cc6-a1d6-701315bcd28f"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:07.885532 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:07.885532 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:49:07.894134 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-6081820b-b4a8-47a6-9fcb-47064ae3d847 req-f69c51b7-7119-408b-91cf-994dd67d33d3 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:07.894623 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-6081820b-b4a8-47a6-9fcb-47064ae3d847 req-f69c51b7-7119-408b-91cf-994dd67d33d3 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:07.907638 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-6081820b-b4a8-47a6-9fcb-47064ae3d847 req-f69c51b7-7119-408b-91cf-994dd67d33d3 service nova] Creating event network-vif-plugged:41cea26c-65de-4cc6-a1d6-701315bcd28f for instance 50205979-c437-4302-b6f0-1bb76d7ea2c9 on nch1-master-1 Jan 15 20:49:07.912954 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-6081820b-b4a8-47a6-9fcb-47064ae3d847 req-f69c51b7-7119-408b-91cf-994dd67d33d3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033531 Jan 15 20:49:07.913781 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 96/153] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:49:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 20:49:07.981858 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-9c30165e-7478-4919-ba46-4ff8784761d3 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4272283f80fd440c92c605310d8a441d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c9ae9cb7d2d4105a277bcaaf858b861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:07.986375 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ef608e39-0f6c-4372-b3ff-174302e98950 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:07.987083 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ef608e39-0f6c-4372-b3ff-174302e98950 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] [instance: d5416a14-72ee-4a24-80d3-9fe459a801d8] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:07.989787 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-9c30165e-7478-4919-ba46-4ff8784761d3 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] 10.222.0.46 "GET /compute/v2.1/servers/5736e502-fb8b-43e0-8763-ec341d6f5953" status: 200 len: 1338 microversion: 2.1 time: 0.286042 Jan 15 20:49:07.993241 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 58/154] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:07 2022] GET /compute/v2.1/servers/5736e502-fb8b-43e0-8763-ec341d6f5953 => generated 1338 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:08.006486 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ef608e39-0f6c-4372-b3ff-174302e98950 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:08.006945 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ef608e39-0f6c-4372-b3ff-174302e98950 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:08.007753 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ef608e39-0f6c-4372-b3ff-174302e98950 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:08.008204 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ef608e39-0f6c-4372-b3ff-174302e98950 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:08.326276 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f32a7e41-20a9-4af6-846c-5ac4e09a3cb8 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:08.327044 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f32a7e41-20a9-4af6-846c-5ac4e09a3cb8 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 98d0ca37-0175-44e2-8a1d-965cdc517daf] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:08.342827 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f32a7e41-20a9-4af6-846c-5ac4e09a3cb8 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:08.343585 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f32a7e41-20a9-4af6-846c-5ac4e09a3cb8 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:08.344828 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f32a7e41-20a9-4af6-846c-5ac4e09a3cb8 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:08.345285 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f32a7e41-20a9-4af6-846c-5ac4e09a3cb8 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:08.483129 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-ef608e39-0f6c-4372-b3ff-174302e98950 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0079c95473594ee9ada5a4bc6820a111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac923ea754345a9b79457833bd72da4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:08.491569 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ef608e39-0f6c-4372-b3ff-174302e98950 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] 10.222.0.46 "GET /compute/v2.1/servers/d5416a14-72ee-4a24-80d3-9fe459a801d8" status: 200 len: 1319 microversion: 2.1 time: 0.511458 Jan 15 20:49:08.499933 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 97/155] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:07 2022] GET /compute/v2.1/servers/d5416a14-72ee-4a24-80d3-9fe459a801d8 => generated 1319 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:49:08.504769 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f6013829-18d6-40d7-ae0b-1d4d7173721b tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:08.505566 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f6013829-18d6-40d7-ae0b-1d4d7173721b tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: 4d527369-954d-4ccc-9105-03b209d3523e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:08.523314 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f6013829-18d6-40d7-ae0b-1d4d7173721b tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:08.524095 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f6013829-18d6-40d7-ae0b-1d4d7173721b tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:08.525159 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f6013829-18d6-40d7-ae0b-1d4d7173721b tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:08.525827 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f6013829-18d6-40d7-ae0b-1d4d7173721b tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:08.638250 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-f6013829-18d6-40d7-ae0b-1d4d7173721b tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:08.649461 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f6013829-18d6-40d7-ae0b-1d4d7173721b tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/4d527369-954d-4ccc-9105-03b209d3523e" status: 200 len: 1270 microversion: 2.1 time: 0.148065 Jan 15 20:49:08.650867 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 98/156] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:08 2022] GET /compute/v2.1/servers/4d527369-954d-4ccc-9105-03b209d3523e => generated 1270 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:08.682167 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-f32a7e41-20a9-4af6-846c-5ac4e09a3cb8 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d60caf368842b2aec08f0f5e14353a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c95e4b5695439dbc3f66a911264026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:08.690868 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f32a7e41-20a9-4af6-846c-5ac4e09a3cb8 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "GET /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf" status: 200 len: 1413 microversion: 2.1 time: 0.369456 Jan 15 20:49:08.692573 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 59/157] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:08 2022] GET /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf => generated 1413 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:08.735274 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-4c756ab7-3a98-4a6d-9315-1f2310acf876 req-be01dd25-49b8-4332-8d21-f8f86f2733c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98d0ca37-0175-44e2-8a1d-965cdc517daf", "tag": "621b3781-18ee-45e7-aefe-ae6ec4d044ae"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:08.735801 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3042e42a-b2ab-42e7-a0d1-f8a0cc3cd19b tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:08.738529 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:08.738529 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:49:08.754536 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-3042e42a-b2ab-42e7-a0d1-f8a0cc3cd19b tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] [instance: 50205979-c437-4302-b6f0-1bb76d7ea2c9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:08.757720 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-4c756ab7-3a98-4a6d-9315-1f2310acf876 req-be01dd25-49b8-4332-8d21-f8f86f2733c9 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:08.758276 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-4c756ab7-3a98-4a6d-9315-1f2310acf876 req-be01dd25-49b8-4332-8d21-f8f86f2733c9 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:08.770660 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3042e42a-b2ab-42e7-a0d1-f8a0cc3cd19b tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:08.771111 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3042e42a-b2ab-42e7-a0d1-f8a0cc3cd19b tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:08.771899 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3042e42a-b2ab-42e7-a0d1-f8a0cc3cd19b tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:08.772332 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3042e42a-b2ab-42e7-a0d1-f8a0cc3cd19b tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:08.791159 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-4c756ab7-3a98-4a6d-9315-1f2310acf876 req-be01dd25-49b8-4332-8d21-f8f86f2733c9 service nova] Creating event network-changed:621b3781-18ee-45e7-aefe-ae6ec4d044ae for instance 98d0ca37-0175-44e2-8a1d-965cdc517daf on nch2-master-1 Jan 15 20:49:08.799623 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-4c756ab7-3a98-4a6d-9315-1f2310acf876 req-be01dd25-49b8-4332-8d21-f8f86f2733c9 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.146832 Jan 15 20:49:08.800537 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 99/158] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:49:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:49:09.012797 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1ad8c663-f861-46aa-bad9-d74b15699a32 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:09.013668 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-1ad8c663-f861-46aa-bad9-d74b15699a32 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] [instance: 5736e502-fb8b-43e0-8763-ec341d6f5953] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:09.021625 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1ad8c663-f861-46aa-bad9-d74b15699a32 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:09.022492 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1ad8c663-f861-46aa-bad9-d74b15699a32 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:09.023431 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1ad8c663-f861-46aa-bad9-d74b15699a32 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:09.023967 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1ad8c663-f861-46aa-bad9-d74b15699a32 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:09.047211 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-3042e42a-b2ab-42e7-a0d1-f8a0cc3cd19b tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957f85f9c6794cccad71c553fb607ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82c6b47c4140e390464b153d2fe865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:09.057592 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3042e42a-b2ab-42e7-a0d1-f8a0cc3cd19b tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] 10.222.0.46 "GET /compute/v2.1/servers/50205979-c437-4302-b6f0-1bb76d7ea2c9" status: 200 len: 1319 microversion: 2.1 time: 0.328206 Jan 15 20:49:09.058779 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 60/159] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:08 2022] GET /compute/v2.1/servers/50205979-c437-4302-b6f0-1bb76d7ea2c9 => generated 1319 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:09.287855 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-1ad8c663-f861-46aa-bad9-d74b15699a32 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4272283f80fd440c92c605310d8a441d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c9ae9cb7d2d4105a277bcaaf858b861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:09.296003 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-1ad8c663-f861-46aa-bad9-d74b15699a32 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] 10.222.0.46 "GET /compute/v2.1/servers/5736e502-fb8b-43e0-8763-ec341d6f5953" status: 200 len: 1488 microversion: 2.1 time: 0.289059 Jan 15 20:49:09.296902 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 100/160] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:09 2022] GET /compute/v2.1/servers/5736e502-fb8b-43e0-8763-ec341d6f5953 => generated 1488 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:49:09.314208 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-86e76603-7fcf-44d1-9bf8-f4a3bd8133de tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:09.315154 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-86e76603-7fcf-44d1-9bf8-f4a3bd8133de tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] [instance: 5736e502-fb8b-43e0-8763-ec341d6f5953] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:09.322615 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-86e76603-7fcf-44d1-9bf8-f4a3bd8133de tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:09.323382 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-86e76603-7fcf-44d1-9bf8-f4a3bd8133de tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:09.324268 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-86e76603-7fcf-44d1-9bf8-f4a3bd8133de tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:09.325375 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-86e76603-7fcf-44d1-9bf8-f4a3bd8133de tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:09.515697 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-fe73d6ba-d22c-4878-9952-47f8ad9ea9ab tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:09.517521 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-fe73d6ba-d22c-4878-9952-47f8ad9ea9ab tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] [instance: d5416a14-72ee-4a24-80d3-9fe459a801d8] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:09.528414 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fe73d6ba-d22c-4878-9952-47f8ad9ea9ab tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:09.530023 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fe73d6ba-d22c-4878-9952-47f8ad9ea9ab tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:09.532764 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fe73d6ba-d22c-4878-9952-47f8ad9ea9ab tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:09.533887 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fe73d6ba-d22c-4878-9952-47f8ad9ea9ab tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:09.954326 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-fe73d6ba-d22c-4878-9952-47f8ad9ea9ab tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0079c95473594ee9ada5a4bc6820a111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac923ea754345a9b79457833bd72da4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:09.962279 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-fe73d6ba-d22c-4878-9952-47f8ad9ea9ab tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] 10.222.0.46 "GET /compute/v2.1/servers/d5416a14-72ee-4a24-80d3-9fe459a801d8" status: 200 len: 1319 microversion: 2.1 time: 0.450601 Jan 15 20:49:09.963800 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 101/161] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:09 2022] GET /compute/v2.1/servers/d5416a14-72ee-4a24-80d3-9fe459a801d8 => generated 1319 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:09.969233 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b8855630-b76f-4239-8316-0bbdd62d0819 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:09.970126 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b8855630-b76f-4239-8316-0bbdd62d0819 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: 4d527369-954d-4ccc-9105-03b209d3523e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:09.978664 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b8855630-b76f-4239-8316-0bbdd62d0819 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:09.979865 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b8855630-b76f-4239-8316-0bbdd62d0819 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:09.980883 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b8855630-b76f-4239-8316-0bbdd62d0819 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:09.981753 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b8855630-b76f-4239-8316-0bbdd62d0819 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:10.035093 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-86e76603-7fcf-44d1-9bf8-f4a3bd8133de tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/5736e502-fb8b-43e0-8763-ec341d6f5953" status: 200 len: 1639 microversion: 2.1 time: 0.724065 Jan 15 20:49:10.039129 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 61/162] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:09 2022] GET /compute/v2.1/servers/5736e502-fb8b-43e0-8763-ec341d6f5953 => generated 1639 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:10.049628 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-37582cf5-0240-40d1-8b0d-a9f557a07d07 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:10.051025 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-37582cf5-0240-40d1-8b0d-a9f557a07d07 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 98d0ca37-0175-44e2-8a1d-965cdc517daf] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:10.062605 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-37582cf5-0240-40d1-8b0d-a9f557a07d07 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:10.063062 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-37582cf5-0240-40d1-8b0d-a9f557a07d07 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:10.063988 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-37582cf5-0240-40d1-8b0d-a9f557a07d07 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:10.064632 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-37582cf5-0240-40d1-8b0d-a9f557a07d07 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:10.315338 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-b8855630-b76f-4239-8316-0bbdd62d0819 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:10.323109 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b8855630-b76f-4239-8316-0bbdd62d0819 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/4d527369-954d-4ccc-9105-03b209d3523e" status: 200 len: 1312 microversion: 2.1 time: 0.358085 Jan 15 20:49:10.324434 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 102/163] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:09 2022] GET /compute/v2.1/servers/4d527369-954d-4ccc-9105-03b209d3523e => generated 1312 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:10.337397 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-0a327ec6-c05b-4bc6-ae68-613e0a112b30 req-cf7cb63d-3fff-4708-972a-431037fda6ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d527369-954d-4ccc-9105-03b209d3523e", "tag": "8fbebb13-bd94-4e21-bda4-a22a2589b5db"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:10.338230 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-37582cf5-0240-40d1-8b0d-a9f557a07d07 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d60caf368842b2aec08f0f5e14353a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c95e4b5695439dbc3f66a911264026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:10.339652 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:10.339652 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:49:10.348280 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-37582cf5-0240-40d1-8b0d-a9f557a07d07 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "GET /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf" status: 200 len: 1413 microversion: 2.1 time: 0.307369 Jan 15 20:49:10.349454 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-0a327ec6-c05b-4bc6-ae68-613e0a112b30 req-cf7cb63d-3fff-4708-972a-431037fda6ca service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:10.349606 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 62/164] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:10 2022] GET /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf => generated 1413 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:10.350275 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-0a327ec6-c05b-4bc6-ae68-613e0a112b30 req-cf7cb63d-3fff-4708-972a-431037fda6ca service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:10.354231 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5eebaed7-72d1-45e0-9e4c-6050c53c800d tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:10.355702 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:10.355702 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:49:10.366486 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5eebaed7-72d1-45e0-9e4c-6050c53c800d tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:10.367240 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5eebaed7-72d1-45e0-9e4c-6050c53c800d tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:10.370619 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-0a327ec6-c05b-4bc6-ae68-613e0a112b30 req-cf7cb63d-3fff-4708-972a-431037fda6ca service nova] Creating event network-changed:8fbebb13-bd94-4e21-bda4-a22a2589b5db for instance 4d527369-954d-4ccc-9105-03b209d3523e on nch1-master-1 Jan 15 20:49:10.380110 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-0a327ec6-c05b-4bc6-ae68-613e0a112b30 req-cf7cb63d-3fff-4708-972a-431037fda6ca service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054277 Jan 15 20:49:10.381063 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 103/165] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:49:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:49:10.388436 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-29a6676c-b2ff-4c53-93ba-9f1a54216546 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:10.389564 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-29a6676c-b2ff-4c53-93ba-9f1a54216546 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] [instance: 50205979-c437-4302-b6f0-1bb76d7ea2c9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:10.399314 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-29a6676c-b2ff-4c53-93ba-9f1a54216546 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:10.399964 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-29a6676c-b2ff-4c53-93ba-9f1a54216546 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:10.400757 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-29a6676c-b2ff-4c53-93ba-9f1a54216546 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:10.401393 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-29a6676c-b2ff-4c53-93ba-9f1a54216546 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:10.498103 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5eebaed7-72d1-45e0-9e4c-6050c53c800d tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 300 microversion: 2.1 time: 0.146112 Jan 15 20:49:10.498709 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 63/166] 10.222.0.46 () {60 vars in 1190 bytes} [Sat Jan 15 20:49:10 2022] POST /compute/v2.1/os-aggregates/1/action => generated 300 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:49:10.509754 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d52ce063-e5d5-4ec8-9d5a-5117ae7f392b tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:10.510559 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:10.510559 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:49:10.535917 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d52ce063-e5d5-4ec8-9d5a-5117ae7f392b tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] 10.222.0.46 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.029499 Jan 15 20:49:10.546714 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 64/167] 10.222.0.46 () {58 vars in 1151 bytes} [Sat Jan 15 20:49:10 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jan 15 20:49:10.553748 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ac9f614e-aaf2-4e68-a0f3-5d07286be9c8 tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1047553530"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:10.555066 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:10.555066 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:49:10.556242 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.objects.aggregate [None req-ac9f614e-aaf2-4e68-a0f3-5d07286be9c8 tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] Generated uuid b602d838-9289-4be4-bec5-f6e1586e7f94 for aggregate {{(pid=129365) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jan 15 20:49:10.582448 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ac9f614e-aaf2-4e68-a0f3-5d07286be9c8 tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.032378 Jan 15 20:49:10.583231 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 65/168] 10.222.0.46 () {60 vars in 1163 bytes} [Sat Jan 15 20:49:10 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:49:10.593099 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5794429b-798c-46e8-afb2-fbbcc1599bd0 tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:10.594325 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:10.594325 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:49:10.603473 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5794429b-798c-46e8-afb2-fbbcc1599bd0 tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:10.603916 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5794429b-798c-46e8-afb2-fbbcc1599bd0 tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:10.620536 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-29a6676c-b2ff-4c53-93ba-9f1a54216546 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957f85f9c6794cccad71c553fb607ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82c6b47c4140e390464b153d2fe865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:10.638143 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-29a6676c-b2ff-4c53-93ba-9f1a54216546 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] 10.222.0.46 "GET /compute/v2.1/servers/50205979-c437-4302-b6f0-1bb76d7ea2c9" status: 200 len: 1469 microversion: 2.1 time: 0.255117 Jan 15 20:49:10.639388 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 104/169] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:10 2022] GET /compute/v2.1/servers/50205979-c437-4302-b6f0-1bb76d7ea2c9 => generated 1469 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:10.712402 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5794429b-798c-46e8-afb2-fbbcc1599bd0 tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 242 microversion: 2.1 time: 0.123180 Jan 15 20:49:10.713029 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 66/170] 10.222.0.46 () {60 vars in 1190 bytes} [Sat Jan 15 20:49:10 2022] POST /compute/v2.1/os-aggregates/2/action => generated 242 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:49:10.722935 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f58ecc25-a6c5-4a62-a401-50852f4cffe6 tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:10.723827 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:10.723827 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:49:10.732159 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f58ecc25-a6c5-4a62-a401-50852f4cffe6 tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] 10.222.0.46 "GET /compute/v2.1/os-aggregates/2" status: 200 len: 242 microversion: 2.1 time: 0.012758 Jan 15 20:49:10.733041 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 67/171] 10.222.0.46 () {58 vars in 1148 bytes} [Sat Jan 15 20:49:10 2022] GET /compute/v2.1/os-aggregates/2 => generated 242 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:49:10.748092 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-fa8bfecf-8a87-41e1-a94d-04c468158e12 tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:10.750170 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:10.750170 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:49:10.762154 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fa8bfecf-8a87-41e1-a94d-04c468158e12 tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:10.762923 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fa8bfecf-8a87-41e1-a94d-04c468158e12 tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:10.780775 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-78a9d04a-a3a2-4fde-87b2-475810543554 tempest-DeleteServersAdminTestJSON-11303861 tempest-DeleteServersAdminTestJSON-11303861-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:10.781725 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-78a9d04a-a3a2-4fde-87b2-475810543554 tempest-DeleteServersAdminTestJSON-11303861 tempest-DeleteServersAdminTestJSON-11303861-project-admin] [instance: 50205979-c437-4302-b6f0-1bb76d7ea2c9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:10.791058 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-78a9d04a-a3a2-4fde-87b2-475810543554 tempest-DeleteServersAdminTestJSON-11303861 tempest-DeleteServersAdminTestJSON-11303861-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:10.791760 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-78a9d04a-a3a2-4fde-87b2-475810543554 tempest-DeleteServersAdminTestJSON-11303861 tempest-DeleteServersAdminTestJSON-11303861-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:10.793014 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-78a9d04a-a3a2-4fde-87b2-475810543554 tempest-DeleteServersAdminTestJSON-11303861 tempest-DeleteServersAdminTestJSON-11303861-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:10.794250 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-78a9d04a-a3a2-4fde-87b2-475810543554 tempest-DeleteServersAdminTestJSON-11303861 tempest-DeleteServersAdminTestJSON-11303861-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:10.876933 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-78a9d04a-a3a2-4fde-87b2-475810543554 tempest-DeleteServersAdminTestJSON-11303861 tempest-DeleteServersAdminTestJSON-11303861-project-admin] [instance: 50205979-c437-4302-b6f0-1bb76d7ea2c9] Going to try to terminate instance {{(pid=129366) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 20:49:10.881187 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-fa8bfecf-8a87-41e1-a94d-04c468158e12 tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 227 microversion: 2.1 time: 0.138531 Jan 15 20:49:10.881799 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 68/172] 10.222.0.46 () {60 vars in 1190 bytes} [Sat Jan 15 20:49:10 2022] POST /compute/v2.1/os-aggregates/2/action => generated 227 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:49:10.892503 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2c3b94eb-1034-43e0-b3ff-80444b2fe24a tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:10.893438 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:10.893438 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:49:10.914082 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2c3b94eb-1034-43e0-b3ff-80444b2fe24a tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] 10.222.0.46 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.025404 Jan 15 20:49:10.920385 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 69/173] 10.222.0.46 () {58 vars in 1151 bytes} [Sat Jan 15 20:49:10 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jan 15 20:49:10.926521 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3c47f930-77c5-49c3-93a2-b147cfd64348 tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-493138585"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:10.928027 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:10.928027 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:49:10.929223 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.objects.aggregate [None req-3c47f930-77c5-49c3-93a2-b147cfd64348 tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] Generated uuid 75b3e023-1aad-4d2c-bacd-fa2ec2a3ea06 for aggregate {{(pid=129365) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jan 15 20:49:10.956489 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3c47f930-77c5-49c3-93a2-b147cfd64348 tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.033438 Jan 15 20:49:10.961325 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 70/174] 10.222.0.46 () {60 vars in 1163 bytes} [Sat Jan 15 20:49:10 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:49:10.967986 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b5590503-f870-46f3-b620-fe16dfbf1013 tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:10.969331 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:10.969331 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:49:10.979343 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b5590503-f870-46f3-b620-fe16dfbf1013 tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:10.979814 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b5590503-f870-46f3-b620-fe16dfbf1013 tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:11.034434 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-78a9d04a-a3a2-4fde-87b2-475810543554 tempest-DeleteServersAdminTestJSON-11303861 tempest-DeleteServersAdminTestJSON-11303861-project-admin] 10.222.0.46 "DELETE /compute/v2.1/servers/50205979-c437-4302-b6f0-1bb76d7ea2c9" status: 204 len: 0 microversion: 2.1 time: 0.382062 Jan 15 20:49:11.035217 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 105/175] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 20:49:10 2022] DELETE /compute/v2.1/servers/50205979-c437-4302-b6f0-1bb76d7ea2c9 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 20:49:11.042519 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0e03f604-91ef-43dd-973d-e100cf8e21ff tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:11.043305 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-0e03f604-91ef-43dd-973d-e100cf8e21ff tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] [instance: d5416a14-72ee-4a24-80d3-9fe459a801d8] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:11.050228 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0e03f604-91ef-43dd-973d-e100cf8e21ff tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:11.050606 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0e03f604-91ef-43dd-973d-e100cf8e21ff tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:11.051380 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0e03f604-91ef-43dd-973d-e100cf8e21ff tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:11.051814 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0e03f604-91ef-43dd-973d-e100cf8e21ff tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:11.096418 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b5590503-f870-46f3-b620-fe16dfbf1013 tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 241 microversion: 2.1 time: 0.132790 Jan 15 20:49:11.097113 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 71/176] 10.222.0.46 () {60 vars in 1190 bytes} [Sat Jan 15 20:49:10 2022] POST /compute/v2.1/os-aggregates/3/action => generated 241 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 20:49:11.106492 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2f13930a-7c15-475b-8969-1155d160324e tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:11.107091 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-2f13930a-7c15-475b-8969-1155d160324e tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] [instance: 50205979-c437-4302-b6f0-1bb76d7ea2c9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:11.115435 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2f13930a-7c15-475b-8969-1155d160324e tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:11.115883 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2f13930a-7c15-475b-8969-1155d160324e tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:11.116708 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2f13930a-7c15-475b-8969-1155d160324e tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:11.117186 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2f13930a-7c15-475b-8969-1155d160324e tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:11.326811 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-0e03f604-91ef-43dd-973d-e100cf8e21ff tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0079c95473594ee9ada5a4bc6820a111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac923ea754345a9b79457833bd72da4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:11.335747 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0e03f604-91ef-43dd-973d-e100cf8e21ff tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] 10.222.0.46 "GET /compute/v2.1/servers/d5416a14-72ee-4a24-80d3-9fe459a801d8" status: 200 len: 1319 microversion: 2.1 time: 0.298092 Jan 15 20:49:11.335747 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 106/177] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:11 2022] GET /compute/v2.1/servers/d5416a14-72ee-4a24-80d3-9fe459a801d8 => generated 1319 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:11.339578 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-105b282c-1a26-499d-bf95-8f4b12fc51f6 tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:11.340485 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-2f13930a-7c15-475b-8969-1155d160324e tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957f85f9c6794cccad71c553fb607ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82c6b47c4140e390464b153d2fe865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:11.340627 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:11.340627 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:49:11.349799 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2f13930a-7c15-475b-8969-1155d160324e tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] 10.222.0.46 "GET /compute/v2.1/servers/50205979-c437-4302-b6f0-1bb76d7ea2c9" status: 200 len: 1475 microversion: 2.1 time: 0.246834 Jan 15 20:49:11.350516 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 72/178] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:11 2022] GET /compute/v2.1/servers/50205979-c437-4302-b6f0-1bb76d7ea2c9 => generated 1475 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:11.354959 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-105b282c-1a26-499d-bf95-8f4b12fc51f6 tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] 10.222.0.46 "GET /compute/v2.1/os-aggregates" status: 200 len: 244 microversion: 2.1 time: 0.018782 Jan 15 20:49:11.356161 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 107/179] 10.222.0.46 () {58 vars in 1142 bytes} [Sat Jan 15 20:49:11 2022] GET /compute/v2.1/os-aggregates => generated 244 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:49:11.360384 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-7a9caa4a-6193-4a01-9775-48da2c884327 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:11.361031 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-7a9caa4a-6193-4a01-9775-48da2c884327 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: 4d527369-954d-4ccc-9105-03b209d3523e] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:11.365766 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-57092ca2-abfb-4668-85bd-87d9a41e22ca tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:11.366301 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-57092ca2-abfb-4668-85bd-87d9a41e22ca tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 98d0ca37-0175-44e2-8a1d-965cdc517daf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:11.367022 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7a9caa4a-6193-4a01-9775-48da2c884327 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:11.367464 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7a9caa4a-6193-4a01-9775-48da2c884327 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:11.368242 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7a9caa4a-6193-4a01-9775-48da2c884327 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:11.368736 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7a9caa4a-6193-4a01-9775-48da2c884327 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:11.373261 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-57092ca2-abfb-4668-85bd-87d9a41e22ca tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:11.373904 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-57092ca2-abfb-4668-85bd-87d9a41e22ca tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:11.374693 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-57092ca2-abfb-4668-85bd-87d9a41e22ca tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:11.375123 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-57092ca2-abfb-4668-85bd-87d9a41e22ca tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:11.707145 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-7a9caa4a-6193-4a01-9775-48da2c884327 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:11.710513 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-57092ca2-abfb-4668-85bd-87d9a41e22ca tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d60caf368842b2aec08f0f5e14353a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c95e4b5695439dbc3f66a911264026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:11.716068 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-7a9caa4a-6193-4a01-9775-48da2c884327 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/4d527369-954d-4ccc-9105-03b209d3523e" status: 200 len: 1312 microversion: 2.1 time: 0.364734 Jan 15 20:49:11.716633 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 73/180] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:11 2022] GET /compute/v2.1/servers/4d527369-954d-4ccc-9105-03b209d3523e => generated 1312 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:11.718916 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-57092ca2-abfb-4668-85bd-87d9a41e22ca tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "GET /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf" status: 200 len: 1391 microversion: 2.1 time: 0.356672 Jan 15 20:49:11.719477 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 108/181] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:11 2022] GET /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf => generated 1391 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:11.727677 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-7277c839-8450-4b02-9190-9d0101650c34 tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:11.728991 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:11.728991 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:49:11.738005 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7277c839-8450-4b02-9190-9d0101650c34 tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:11.738482 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7277c839-8450-4b02-9190-9d0101650c34 tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:11.846284 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-7277c839-8450-4b02-9190-9d0101650c34 tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 226 microversion: 2.1 time: 0.121759 Jan 15 20:49:11.847824 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 74/182] 10.222.0.46 () {60 vars in 1190 bytes} [Sat Jan 15 20:49:11 2022] POST /compute/v2.1/os-aggregates/3/action => generated 226 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:49:11.857732 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-466d1bba-b7f3-404f-ae5e-e076823cee81 tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:11.858505 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:11.858505 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:49:11.886226 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-466d1bba-b7f3-404f-ae5e-e076823cee81 tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] 10.222.0.46 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.032645 Jan 15 20:49:11.892932 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 109/183] 10.222.0.46 () {58 vars in 1151 bytes} [Sat Jan 15 20:49:11 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Jan 15 20:49:11.897370 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-001e3b6d-ffd7-4012-8f34-b95ea16f4e7b tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-229776125"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:11.898731 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:11.898731 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:49:11.900278 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.objects.aggregate [None req-001e3b6d-ffd7-4012-8f34-b95ea16f4e7b tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] Generated uuid bc7e2f84-8612-4ca6-ac83-cc62aebb11e9 for aggregate {{(pid=129365) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jan 15 20:49:11.922345 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-001e3b6d-ffd7-4012-8f34-b95ea16f4e7b tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.028543 Jan 15 20:49:11.924586 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 75/184] 10.222.0.46 () {60 vars in 1163 bytes} [Sat Jan 15 20:49:11 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:49:11.926308 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-d73a61ee-f5c5-4f61-bec7-c391293ac794 req-d284a862-1c84-46f9-86eb-2ab3f9bd672d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5416a14-72ee-4a24-80d3-9fe459a801d8", "name": "network-vif-plugged", "status": "completed", "tag": "5a8eebf2-aebe-45dc-86b0-8add6202f632"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:11.928748 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:11.928748 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:49:11.936340 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-d73a61ee-f5c5-4f61-bec7-c391293ac794 req-d284a862-1c84-46f9-86eb-2ab3f9bd672d service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:11.936549 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ade2a840-80c8-478b-a295-6d458bec0345 tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:11.936782 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-d73a61ee-f5c5-4f61-bec7-c391293ac794 req-d284a862-1c84-46f9-86eb-2ab3f9bd672d service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:11.937594 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:11.937594 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:49:11.948633 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ade2a840-80c8-478b-a295-6d458bec0345 tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:11.949138 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ade2a840-80c8-478b-a295-6d458bec0345 tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:11.950110 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-d73a61ee-f5c5-4f61-bec7-c391293ac794 req-d284a862-1c84-46f9-86eb-2ab3f9bd672d service nova] Creating event network-vif-plugged:5a8eebf2-aebe-45dc-86b0-8add6202f632 for instance d5416a14-72ee-4a24-80d3-9fe459a801d8 on nch1-master-1 Jan 15 20:49:11.956388 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-d73a61ee-f5c5-4f61-bec7-c391293ac794 req-d284a862-1c84-46f9-86eb-2ab3f9bd672d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040765 Jan 15 20:49:11.958247 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 110/185] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:49:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 20:49:12.060002 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ade2a840-80c8-478b-a295-6d458bec0345 tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 241 microversion: 2.1 time: 0.129388 Jan 15 20:49:12.060603 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 76/186] 10.222.0.46 () {60 vars in 1190 bytes} [Sat Jan 15 20:49:11 2022] POST /compute/v2.1/os-aggregates/4/action => generated 241 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:49:12.071219 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-64de8a39-f2cc-4af6-b28f-9caa187a4750 tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:12.072829 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:12.072829 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:49:12.081795 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-64de8a39-f2cc-4af6-b28f-9caa187a4750 tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:12.082412 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-64de8a39-f2cc-4af6-b28f-9caa187a4750 tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:12.351162 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8acdb040-0d4c-4a89-a35a-c2afefdd0553 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:12.351977 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-8acdb040-0d4c-4a89-a35a-c2afefdd0553 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] [instance: d5416a14-72ee-4a24-80d3-9fe459a801d8] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:12.358146 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8acdb040-0d4c-4a89-a35a-c2afefdd0553 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:12.358704 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8acdb040-0d4c-4a89-a35a-c2afefdd0553 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:12.359482 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8acdb040-0d4c-4a89-a35a-c2afefdd0553 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:12.359912 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8acdb040-0d4c-4a89-a35a-c2afefdd0553 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:12.369226 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-64de8a39-f2cc-4af6-b28f-9caa187a4750 tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 226 microversion: 2.1 time: 0.302054 Jan 15 20:49:12.375232 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 111/187] 10.222.0.46 () {60 vars in 1190 bytes} [Sat Jan 15 20:49:12 2022] POST /compute/v2.1/os-aggregates/4/action => generated 226 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:49:12.376069 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-233a2dab-5eb0-430b-9606-7ff19a930c36 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:12.376777 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-233a2dab-5eb0-430b-9606-7ff19a930c36 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] [instance: 50205979-c437-4302-b6f0-1bb76d7ea2c9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:12.383331 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-233a2dab-5eb0-430b-9606-7ff19a930c36 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:12.383428 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-233a2dab-5eb0-430b-9606-7ff19a930c36 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:12.384161 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-233a2dab-5eb0-430b-9606-7ff19a930c36 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:12.384600 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-233a2dab-5eb0-430b-9606-7ff19a930c36 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:12.563719 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-8acdb040-0d4c-4a89-a35a-c2afefdd0553 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0079c95473594ee9ada5a4bc6820a111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac923ea754345a9b79457833bd72da4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:12.566930 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-233a2dab-5eb0-430b-9606-7ff19a930c36 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957f85f9c6794cccad71c553fb607ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82c6b47c4140e390464b153d2fe865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:12.570975 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-8acdb040-0d4c-4a89-a35a-c2afefdd0553 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] 10.222.0.46 "GET /compute/v2.1/servers/d5416a14-72ee-4a24-80d3-9fe459a801d8" status: 200 len: 1319 microversion: 2.1 time: 0.223442 Jan 15 20:49:12.571625 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 77/188] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:12 2022] GET /compute/v2.1/servers/d5416a14-72ee-4a24-80d3-9fe459a801d8 => generated 1319 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:49:12.575344 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-233a2dab-5eb0-430b-9606-7ff19a930c36 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] 10.222.0.46 "GET /compute/v2.1/servers/50205979-c437-4302-b6f0-1bb76d7ea2c9" status: 200 len: 1475 microversion: 2.1 time: 0.203400 Jan 15 20:49:12.576019 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 112/189] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:12 2022] GET /compute/v2.1/servers/50205979-c437-4302-b6f0-1bb76d7ea2c9 => generated 1475 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:12.576742 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-400ff2c3-78fa-45df-865a-545dc3e711e4 tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:12.577754 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:12.577754 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:49:12.597742 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-400ff2c3-78fa-45df-865a-545dc3e711e4 tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] 10.222.0.46 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.025051 Jan 15 20:49:12.598313 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 78/190] 10.222.0.46 () {58 vars in 1151 bytes} [Sat Jan 15 20:49:12 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jan 15 20:49:12.607573 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-816ee4fa-e150-4c9d-a23c-a3693b0698f3 tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1481063511"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:12.609019 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:12.609019 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:49:12.610074 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-889b3b3f-2780-4d42-bb13-af592debbd3d tempest-AggregatesAdminNegativeTestJSON-238846009 tempest-AggregatesAdminNegativeTestJSON-238846009-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1117084131"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:12.610186 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.objects.aggregate [None req-816ee4fa-e150-4c9d-a23c-a3693b0698f3 tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] Generated uuid 7b2f11bf-6464-48ce-b1d4-6b092ebd5eb1 for aggregate {{(pid=129366) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jan 15 20:49:12.611409 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:12.611409 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:49:12.612747 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.objects.aggregate [None req-889b3b3f-2780-4d42-bb13-af592debbd3d tempest-AggregatesAdminNegativeTestJSON-238846009 tempest-AggregatesAdminNegativeTestJSON-238846009-project-admin] Generated uuid 3fadb098-c91a-4361-ad98-e327bbd54f9d for aggregate {{(pid=129365) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jan 15 20:49:12.632187 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-816ee4fa-e150-4c9d-a23c-a3693b0698f3 tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.028347 Jan 15 20:49:12.637518 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 113/191] 10.222.0.46 () {60 vars in 1163 bytes} [Sat Jan 15 20:49:12 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:49:12.637911 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-889b3b3f-2780-4d42-bb13-af592debbd3d tempest-AggregatesAdminNegativeTestJSON-238846009 tempest-AggregatesAdminNegativeTestJSON-238846009-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.027721 Jan 15 20:49:12.638780 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 79/192] 10.222.0.46 () {60 vars in 1163 bytes} [Sat Jan 15 20:49:12 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 20:49:12.647902 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b59e6186-fee3-4c9b-894a-716f8fd23c05 tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:12.648515 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d9f2d15d-846c-4f2f-a707-54a83b919044 tempest-AggregatesAdminNegativeTestJSON-238846009 tempest-AggregatesAdminNegativeTestJSON-238846009-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:12.648668 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:12.648668 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:49:12.649773 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:12.649773 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:49:12.658811 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d9f2d15d-846c-4f2f-a707-54a83b919044 tempest-AggregatesAdminNegativeTestJSON-238846009 tempest-AggregatesAdminNegativeTestJSON-238846009-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:12.659249 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d9f2d15d-846c-4f2f-a707-54a83b919044 tempest-AggregatesAdminNegativeTestJSON-238846009 tempest-AggregatesAdminNegativeTestJSON-238846009-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:12.669289 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b59e6186-fee3-4c9b-894a-716f8fd23c05 tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] 10.222.0.46 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.025119 Jan 15 20:49:12.669880 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 114/193] 10.222.0.46 () {58 vars in 1151 bytes} [Sat Jan 15 20:49:12 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jan 15 20:49:12.677709 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1ad6b4c8-fb87-4d46-8195-d59dd4dc6aa6 tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:12.678851 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:12.678851 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:49:12.687433 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-1ad6b4c8-fb87-4d46-8195-d59dd4dc6aa6 tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] HTTP exception thrown: Aggregate 5 could not be found. Jan 15 20:49:12.688008 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1ad6b4c8-fb87-4d46-8195-d59dd4dc6aa6 tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] Returning 404 to user: Aggregate 5 could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:49:12.688832 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-1ad6b4c8-fb87-4d46-8195-d59dd4dc6aa6 tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] 10.222.0.46 "GET /compute/v2.1/os-aggregates/5" status: 404 len: 77 microversion: 2.1 time: 0.014708 Jan 15 20:49:12.692528 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 115/194] 10.222.0.46 () {58 vars in 1148 bytes} [Sat Jan 15 20:49:12 2022] GET /compute/v2.1/os-aggregates/5 => generated 77 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jan 15 20:49:12.696870 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-17abfc13-7747-426f-aa72-075519a63ceb tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:12.697631 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:12.697631 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:49:12.714374 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-17abfc13-7747-426f-aa72-075519a63ceb tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] HTTP exception thrown: Aggregate 5 could not be found. Jan 15 20:49:12.716130 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-17abfc13-7747-426f-aa72-075519a63ceb tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] Returning 404 to user: Aggregate 5 could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:49:12.718418 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-17abfc13-7747-426f-aa72-075519a63ceb tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] 10.222.0.46 "DELETE /compute/v2.1/os-aggregates/5" status: 404 len: 77 microversion: 2.1 time: 0.024904 Jan 15 20:49:12.719699 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 116/195] 10.222.0.46 () {58 vars in 1151 bytes} [Sat Jan 15 20:49:12 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 77 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jan 15 20:49:12.728486 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7dd72eaa-acb9-423c-8c2d-b22822488286 tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1256857936", "name": "tempest-test_aggregate-2039498369"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:12.730693 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:12.730693 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:49:12.731550 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.objects.aggregate [None req-7dd72eaa-acb9-423c-8c2d-b22822488286 tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] Generated uuid 29787a2c-c54c-4319-9d86-8671a358179c for aggregate {{(pid=129366) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jan 15 20:49:12.757149 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7dd72eaa-acb9-423c-8c2d-b22822488286 tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.032244 Jan 15 20:49:12.757744 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 117/196] 10.222.0.46 () {60 vars in 1164 bytes} [Sat Jan 15 20:49:12 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:49:12.763116 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-6974673f-9594-4a0b-9bb0-ab221e076c2b tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:12.763993 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-6974673f-9594-4a0b-9bb0-ab221e076c2b tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: 4d527369-954d-4ccc-9105-03b209d3523e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:12.770383 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6974673f-9594-4a0b-9bb0-ab221e076c2b tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:12.771082 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6974673f-9594-4a0b-9bb0-ab221e076c2b tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:12.771599 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6974673f-9594-4a0b-9bb0-ab221e076c2b tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:12.772495 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6974673f-9594-4a0b-9bb0-ab221e076c2b tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:12.786684 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d9f2d15d-846c-4f2f-a707-54a83b919044 tempest-AggregatesAdminNegativeTestJSON-238846009 tempest-AggregatesAdminNegativeTestJSON-238846009-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 242 microversion: 2.1 time: 0.142358 Jan 15 20:49:12.793121 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 80/197] 10.222.0.46 () {60 vars in 1190 bytes} [Sat Jan 15 20:49:12 2022] POST /compute/v2.1/os-aggregates/6/action => generated 242 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:49:12.793121 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2047f6e0-3436-4e53-b11e-c4de0c8eb32f tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:12.794476 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-2047f6e0-3436-4e53-b11e-c4de0c8eb32f tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 98d0ca37-0175-44e2-8a1d-965cdc517daf] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:12.800805 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2047f6e0-3436-4e53-b11e-c4de0c8eb32f tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:12.801296 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2047f6e0-3436-4e53-b11e-c4de0c8eb32f tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:12.802098 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2047f6e0-3436-4e53-b11e-c4de0c8eb32f tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:12.802522 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2047f6e0-3436-4e53-b11e-c4de0c8eb32f tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:13.052069 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-6974673f-9594-4a0b-9bb0-ab221e076c2b tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:13.060818 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-6974673f-9594-4a0b-9bb0-ab221e076c2b tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/4d527369-954d-4ccc-9105-03b209d3523e" status: 200 len: 1312 microversion: 2.1 time: 0.302069 Jan 15 20:49:13.061428 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 118/198] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:12 2022] GET /compute/v2.1/servers/4d527369-954d-4ccc-9105-03b209d3523e => generated 1312 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:13.066087 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d51ab614-65b3-4dfc-ba31-857fd13d3ae3 tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:13.066860 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:13.066860 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:49:13.092284 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-2047f6e0-3436-4e53-b11e-c4de0c8eb32f tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d60caf368842b2aec08f0f5e14353a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c95e4b5695439dbc3f66a911264026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:13.107145 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2047f6e0-3436-4e53-b11e-c4de0c8eb32f tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "GET /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf" status: 200 len: 1391 microversion: 2.1 time: 0.316205 Jan 15 20:49:13.116517 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 81/199] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:12 2022] GET /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf => generated 1391 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:13.116705 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d51ab614-65b3-4dfc-ba31-857fd13d3ae3 tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] 10.222.0.46 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.049548 Jan 15 20:49:13.125793 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 119/200] 10.222.0.46 () {58 vars in 1151 bytes} [Sat Jan 15 20:49:13 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jan 15 20:49:13.125977 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-0bb2ec0a-2b4d-4fad-b225-2429d6f9abe1 tempest-AggregatesAdminNegativeTestJSON-238846009 tempest-AggregatesAdminNegativeTestJSON-238846009-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:13.134075 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:13.134075 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:49:13.136016 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7fb3939d-11a5-4c4a-b2ba-13a593d6fdc9 tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:13.136894 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:13.136894 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:49:13.151350 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-7fb3939d-11a5-4c4a-b2ba-13a593d6fdc9 tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Jan 15 20:49:13.151943 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7fb3939d-11a5-4c4a-b2ba-13a593d6fdc9 tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:49:13.153328 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7fb3939d-11a5-4c4a-b2ba-13a593d6fdc9 tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] 10.222.0.46 "GET /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.025506 Jan 15 20:49:13.156864 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0bb2ec0a-2b4d-4fad-b225-2429d6f9abe1 tempest-AggregatesAdminNegativeTestJSON-238846009 tempest-AggregatesAdminNegativeTestJSON-238846009-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:13.156864 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0bb2ec0a-2b4d-4fad-b225-2429d6f9abe1 tempest-AggregatesAdminNegativeTestJSON-238846009 tempest-AggregatesAdminNegativeTestJSON-238846009-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:13.157096 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 120/201] 10.222.0.46 () {58 vars in 1148 bytes} [Sat Jan 15 20:49:13 2022] GET /compute/v2.1/os-aggregates/7 => generated 77 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jan 15 20:49:13.165910 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-71b1e653-d786-45a3-83b2-3ce842d830c3 tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:13.166846 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:13.166846 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:49:13.180793 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-71b1e653-d786-45a3-83b2-3ce842d830c3 tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Jan 15 20:49:13.181423 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-71b1e653-d786-45a3-83b2-3ce842d830c3 tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:49:13.182641 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-71b1e653-d786-45a3-83b2-3ce842d830c3 tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] 10.222.0.46 "DELETE /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.022038 Jan 15 20:49:13.182845 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 121/202] 10.222.0.46 () {58 vars in 1151 bytes} [Sat Jan 15 20:49:13 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 77 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jan 15 20:49:13.197311 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-cce017db-0104-44c2-81ca-4c42b5b4ae52 tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1133161855"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:13.203655 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-0bb2ec0a-2b4d-4fad-b225-2429d6f9abe1 tempest-AggregatesAdminNegativeTestJSON-238846009 tempest-AggregatesAdminNegativeTestJSON-238846009-project-admin] HTTP exception thrown: Aggregate 6 already has host nch2-master-1. Jan 15 20:49:13.204443 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:13.204443 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:49:13.204717 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-0bb2ec0a-2b4d-4fad-b225-2429d6f9abe1 tempest-AggregatesAdminNegativeTestJSON-238846009 tempest-AggregatesAdminNegativeTestJSON-238846009-project-admin] Returning 409 to user: Aggregate 6 already has host nch2-master-1. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:49:13.205778 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-0bb2ec0a-2b4d-4fad-b225-2429d6f9abe1 tempest-AggregatesAdminNegativeTestJSON-238846009 tempest-AggregatesAdminNegativeTestJSON-238846009-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates/6/action" status: 409 len: 95 microversion: 2.1 time: 0.095500 Jan 15 20:49:13.211672 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.objects.aggregate [None req-cce017db-0104-44c2-81ca-4c42b5b4ae52 tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] Generated uuid 654d5a3c-d990-4d3a-80fc-f9bd12b0d2b2 for aggregate {{(pid=129366) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jan 15 20:49:13.214618 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 82/203] 10.222.0.46 () {60 vars in 1190 bytes} [Sat Jan 15 20:49:13 2022] POST /compute/v2.1/os-aggregates/6/action => generated 95 bytes in 105 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Jan 15 20:49:13.220959 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-cc6389b1-c549-4596-b101-4e869667bde1 tempest-AggregatesAdminNegativeTestJSON-238846009 tempest-AggregatesAdminNegativeTestJSON-238846009-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:13.223034 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:13.223034 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:49:13.232777 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cc6389b1-c549-4596-b101-4e869667bde1 tempest-AggregatesAdminNegativeTestJSON-238846009 tempest-AggregatesAdminNegativeTestJSON-238846009-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:13.233305 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cc6389b1-c549-4596-b101-4e869667bde1 tempest-AggregatesAdminNegativeTestJSON-238846009 tempest-AggregatesAdminNegativeTestJSON-238846009-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:13.240362 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-cce017db-0104-44c2-81ca-4c42b5b4ae52 tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.048623 Jan 15 20:49:13.246811 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 122/204] 10.222.0.46 () {60 vars in 1163 bytes} [Sat Jan 15 20:49:13 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:49:13.252040 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a322d2cf-1edb-459d-8313-a47b50b8b1a6 tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:13.253183 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:13.253183 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:49:13.261034 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a322d2cf-1edb-459d-8313-a47b50b8b1a6 tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] 10.222.0.46 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 227 microversion: 2.1 time: 0.012891 Jan 15 20:49:13.263099 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 123/205] 10.222.0.46 () {58 vars in 1148 bytes} [Sat Jan 15 20:49:13 2022] GET /compute/v2.1/os-aggregates/8 => generated 227 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 20:49:13.273940 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-25ad1a7b-f00a-4883-83a6-4610d7d3feff tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:13.275045 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:13.275045 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:49:13.306132 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-25ad1a7b-f00a-4883-83a6-4610d7d3feff tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 265 microversion: 2.1 time: 0.036571 Jan 15 20:49:13.307586 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 124/206] 10.222.0.46 () {60 vars in 1190 bytes} [Sat Jan 15 20:49:13 2022] POST /compute/v2.1/os-aggregates/8/action => generated 265 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:49:13.321053 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ce3cfc2a-1b50-4a06-bce2-271400e67735 tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:13.322145 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:13.322145 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:49:13.332615 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ce3cfc2a-1b50-4a06-bce2-271400e67735 tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] 10.222.0.46 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 241 microversion: 2.1 time: 0.017769 Jan 15 20:49:13.333526 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 125/207] 10.222.0.46 () {58 vars in 1148 bytes} [Sat Jan 15 20:49:13 2022] GET /compute/v2.1/os-aggregates/8 => generated 241 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 20:49:13.346269 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-495365aa-5cbc-404f-9401-b8ce0e4e04c3 tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:13.347157 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:13.347157 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:49:13.378497 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-495365aa-5cbc-404f-9401-b8ce0e4e04c3 tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] 10.222.0.46 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.038376 Jan 15 20:49:13.379329 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 126/208] 10.222.0.46 () {58 vars in 1151 bytes} [Sat Jan 15 20:49:13 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Jan 15 20:49:13.391515 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-72946a31-ba00-4d8e-8f93-5f2064515ac9 tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-423907873", "availability_zone": "tempest-test_az-436799482"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:13.393192 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:13.393192 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:49:13.394600 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.objects.aggregate [None req-72946a31-ba00-4d8e-8f93-5f2064515ac9 tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] Generated uuid b40e96c3-2dc2-41af-a5a0-7164e462e164 for aggregate {{(pid=129366) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jan 15 20:49:13.422350 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-cc6389b1-c549-4596-b101-4e869667bde1 tempest-AggregatesAdminNegativeTestJSON-238846009 tempest-AggregatesAdminNegativeTestJSON-238846009-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 227 microversion: 2.1 time: 0.204242 Jan 15 20:49:13.429692 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 83/209] 10.222.0.46 () {60 vars in 1190 bytes} [Sat Jan 15 20:49:13 2022] POST /compute/v2.1/os-aggregates/6/action => generated 227 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:49:13.435959 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-7ba592e0-e640-40c4-8797-3dfec3fdd000 tempest-AggregatesAdminNegativeTestJSON-238846009 tempest-AggregatesAdminNegativeTestJSON-238846009-project-admin] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:13.436964 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:13.436964 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:49:13.444149 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-72946a31-ba00-4d8e-8f93-5f2064515ac9 tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates" status: 200 len: 220 microversion: 2.1 time: 0.056880 Jan 15 20:49:13.445353 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 127/210] 10.222.0.46 () {60 vars in 1164 bytes} [Sat Jan 15 20:49:13 2022] POST /compute/v2.1/os-aggregates => generated 220 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 20:49:13.457902 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7580feda-c08c-46f8-8840-3c011d1f9687 tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-423907873_new", "availability_zone": "tempest-test_az-436799482_new"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:13.495081 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-7ba592e0-e640-40c4-8797-3dfec3fdd000 tempest-AggregatesAdminNegativeTestJSON-238846009 tempest-AggregatesAdminNegativeTestJSON-238846009-project-admin] 10.222.0.46 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.064100 Jan 15 20:49:13.495803 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 84/211] 10.222.0.46 () {58 vars in 1151 bytes} [Sat Jan 15 20:49:13 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jan 15 20:49:13.505110 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-942a7a48-179c-4942-9a8e-460e5d690fd9 req-b181e3a6-984e-45bb-8882-f85e55caa9de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50205979-c437-4302-b6f0-1bb76d7ea2c9", "name": "network-vif-deleted", "tag": "41cea26c-65de-4cc6-a1d6-701315bcd28f"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:13.506663 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:13.506663 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:49:13.517700 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-942a7a48-179c-4942-9a8e-460e5d690fd9 req-b181e3a6-984e-45bb-8882-f85e55caa9de service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:13.518244 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-942a7a48-179c-4942-9a8e-460e5d690fd9 req-b181e3a6-984e-45bb-8882-f85e55caa9de service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:13.534501 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-942a7a48-179c-4942-9a8e-460e5d690fd9 req-b181e3a6-984e-45bb-8882-f85e55caa9de service nova] Creating event network-vif-deleted:41cea26c-65de-4cc6-a1d6-701315bcd28f for instance 50205979-c437-4302-b6f0-1bb76d7ea2c9 on nch1-master-1 Jan 15 20:49:13.542775 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-942a7a48-179c-4942-9a8e-460e5d690fd9 req-b181e3a6-984e-45bb-8882-f85e55caa9de service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044398 Jan 15 20:49:13.546141 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 85/212] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:49:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:49:13.550596 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:13.550596 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:49:13.558272 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-03ecf8a3-d9a3-420e-a9f7-e2a9557961cb tempest-AggregatesAdminNegativeTestJSON-238846009 tempest-AggregatesAdminNegativeTestJSON-238846009-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1271160744"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:13.563293 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:13.563293 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:49:13.568307 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.objects.aggregate [None req-03ecf8a3-d9a3-420e-a9f7-e2a9557961cb tempest-AggregatesAdminNegativeTestJSON-238846009 tempest-AggregatesAdminNegativeTestJSON-238846009-project-admin] Generated uuid 4f802e78-ca6d-4b80-bd0c-26cd90848897 for aggregate {{(pid=129365) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jan 15 20:49:13.601581 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-03ecf8a3-d9a3-420e-a9f7-e2a9557961cb tempest-AggregatesAdminNegativeTestJSON-238846009 tempest-AggregatesAdminNegativeTestJSON-238846009-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.052895 Jan 15 20:49:13.604573 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 86/213] 10.222.0.46 () {60 vars in 1163 bytes} [Sat Jan 15 20:49:13 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:49:13.615437 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-73d3be3d-6a4a-43a5-8fbf-2f55c9e54f87 tempest-AggregatesAdminTestV241-1799334286 tempest-AggregatesAdminTestV241-1799334286-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-971071757"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:13.616776 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:13.616776 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:49:13.618661 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7580feda-c08c-46f8-8840-3c011d1f9687 tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:13.619156 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7580feda-c08c-46f8-8840-3c011d1f9687 tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:13.622223 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.objects.aggregate [None req-73d3be3d-6a4a-43a5-8fbf-2f55c9e54f87 tempest-AggregatesAdminTestV241-1799334286 tempest-AggregatesAdminTestV241-1799334286-project-admin] Generated uuid 83d9da39-4101-4cbe-b6ca-26aaa6c44abf for aggregate {{(pid=129365) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jan 15 20:49:13.659561 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7580feda-c08c-46f8-8840-3c011d1f9687 tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] 10.222.0.46 "PUT /compute/v2.1/os-aggregates/9" status: 200 len: 333 microversion: 2.1 time: 0.205348 Jan 15 20:49:13.665118 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 128/214] 10.222.0.46 () {60 vars in 1169 bytes} [Sat Jan 15 20:49:13 2022] PUT /compute/v2.1/os-aggregates/9 => generated 333 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:49:13.665252 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-73d3be3d-6a4a-43a5-8fbf-2f55c9e54f87 tempest-AggregatesAdminTestV241-1799334286 tempest-AggregatesAdminTestV241-1799334286-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.41 time: 0.050899 Jan 15 20:49:13.665252 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 87/215] 10.222.0.46 () {62 vars in 1204 bytes} [Sat Jan 15 20:49:13 2022] POST /compute/v2.1/os-aggregates => generated 246 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:49:13.672926 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-bf36700c-16d5-4cd3-91a7-a17c3025a896 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:13.674707 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8ea5da34-8240-45c4-8dcf-4c950420970c tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:13.674963 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-bf36700c-16d5-4cd3-91a7-a17c3025a896 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] [instance: 50205979-c437-4302-b6f0-1bb76d7ea2c9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:13.675613 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-8ea5da34-8240-45c4-8dcf-4c950420970c tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] [instance: d5416a14-72ee-4a24-80d3-9fe459a801d8] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:13.682026 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bf36700c-16d5-4cd3-91a7-a17c3025a896 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:13.682570 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bf36700c-16d5-4cd3-91a7-a17c3025a896 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:13.682887 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8ea5da34-8240-45c4-8dcf-4c950420970c tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:13.683328 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8ea5da34-8240-45c4-8dcf-4c950420970c tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:13.683546 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bf36700c-16d5-4cd3-91a7-a17c3025a896 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:13.684097 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bf36700c-16d5-4cd3-91a7-a17c3025a896 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:13.684294 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8ea5da34-8240-45c4-8dcf-4c950420970c tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:13.684726 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8ea5da34-8240-45c4-8dcf-4c950420970c tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:13.719319 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bf36700c-16d5-4cd3-91a7-a17c3025a896 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:13.719758 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bf36700c-16d5-4cd3-91a7-a17c3025a896 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:13.720224 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.objects.instance [None req-bf36700c-16d5-4cd3-91a7-a17c3025a896 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lazy-loading 'fault' on Instance uuid 50205979-c437-4302-b6f0-1bb76d7ea2c9 {{(pid=129365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 20:49:13.781214 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-bf36700c-16d5-4cd3-91a7-a17c3025a896 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957f85f9c6794cccad71c553fb607ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82c6b47c4140e390464b153d2fe865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:13.788597 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-bf36700c-16d5-4cd3-91a7-a17c3025a896 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] 10.222.0.46 "GET /compute/v2.1/servers/50205979-c437-4302-b6f0-1bb76d7ea2c9" status: 200 len: 1309 microversion: 2.1 time: 0.125733 Jan 15 20:49:13.789658 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 88/216] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:13 2022] GET /compute/v2.1/servers/50205979-c437-4302-b6f0-1bb76d7ea2c9 => generated 1309 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:13.851854 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-8ea5da34-8240-45c4-8dcf-4c950420970c tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0079c95473594ee9ada5a4bc6820a111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac923ea754345a9b79457833bd72da4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:13.859778 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-8ea5da34-8240-45c4-8dcf-4c950420970c tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] 10.222.0.46 "GET /compute/v2.1/servers/d5416a14-72ee-4a24-80d3-9fe459a801d8" status: 200 len: 1469 microversion: 2.1 time: 0.197891 Jan 15 20:49:13.860575 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 129/217] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:13 2022] GET /compute/v2.1/servers/d5416a14-72ee-4a24-80d3-9fe459a801d8 => generated 1469 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:13.877301 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d5e2483a-2831-4f85-a6a9-8f2f8ea537f4 tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:13.878071 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:13.878071 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:49:13.887099 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d5e2483a-2831-4f85-a6a9-8f2f8ea537f4 tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] 10.222.0.46 "GET /compute/v2.1/os-aggregates" status: 200 len: 765 microversion: 2.1 time: 0.013234 Jan 15 20:49:13.887720 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 130/218] 10.222.0.46 () {58 vars in 1142 bytes} [Sat Jan 15 20:49:13 2022] GET /compute/v2.1/os-aggregates => generated 765 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:49:13.897455 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-fb23ff4e-8959-4c85-8d32-f4f7f1592bad tempest-AggregatesAdminTestV241-1799334286 tempest-AggregatesAdminTestV241-1799334286-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1049343792"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:13.898825 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:13.898825 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:49:13.907773 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9fba4092-888c-4580-a2dc-073573f6c2d8 tempest-AggregatesAdminNegativeTestJSON-1894226231 tempest-AggregatesAdminNegativeTestJSON-1894226231-project] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:13.909733 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:13.909733 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:49:13.910801 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-9fba4092-888c-4580-a2dc-073573f6c2d8 tempest-AggregatesAdminNegativeTestJSON-1894226231 tempest-AggregatesAdminNegativeTestJSON-1894226231-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '87b7045f39424d27b1f1d2b1b8292308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ab1e9106654fccab088c31f19c9eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:13.911459 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9fba4092-888c-4580-a2dc-073573f6c2d8 tempest-AggregatesAdminNegativeTestJSON-1894226231 tempest-AggregatesAdminNegativeTestJSON-1894226231-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:49:13.912260 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-9fba4092-888c-4580-a2dc-073573f6c2d8 tempest-AggregatesAdminNegativeTestJSON-1894226231 tempest-AggregatesAdminNegativeTestJSON-1894226231-project] 10.222.0.46 "POST /compute/v2.1/os-aggregates/10/action" status: 403 len: 118 microversion: 2.1 time: 0.122084 Jan 15 20:49:13.913114 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 89/219] 10.222.0.46 () {60 vars in 1193 bytes} [Sat Jan 15 20:49:13 2022] POST /compute/v2.1/os-aggregates/10/action => generated 118 bytes in 123 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:49:13.939286 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-fb23ff4e-8959-4c85-8d32-f4f7f1592bad tempest-AggregatesAdminTestV241-1799334286 tempest-AggregatesAdminTestV241-1799334286-project-admin] 10.222.0.46 "PUT /compute/v2.1/os-aggregates/11" status: 200 len: 300 microversion: 2.41 time: 0.050276 Jan 15 20:49:13.940288 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 131/220] 10.222.0.46 () {62 vars in 1212 bytes} [Sat Jan 15 20:49:13 2022] PUT /compute/v2.1/os-aggregates/11 => generated 300 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:49:13.945590 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-37631c28-7e22-48fc-b2fd-9b40a7283455 tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:13.946366 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:13.946366 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:49:13.979624 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-37631c28-7e22-48fc-b2fd-9b40a7283455 tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] 10.222.0.46 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.038114 Jan 15 20:49:13.980830 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 132/221] 10.222.0.46 () {58 vars in 1151 bytes} [Sat Jan 15 20:49:13 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jan 15 20:49:13.986914 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ca61acd3-e204-4438-b637-002af031baac tempest-AggregatesAdminNegativeTestJSON-238846009 tempest-AggregatesAdminNegativeTestJSON-238846009-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:13.988276 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:13.988276 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:49:14.023447 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ca61acd3-e204-4438-b637-002af031baac tempest-AggregatesAdminNegativeTestJSON-238846009 tempest-AggregatesAdminNegativeTestJSON-238846009-project-admin] 10.222.0.46 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.040504 Jan 15 20:49:14.023447 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 133/222] 10.222.0.46 () {58 vars in 1154 bytes} [Sat Jan 15 20:49:13 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jan 15 20:49:14.034123 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d1c22f25-e4bd-4dd6-8662-738732fe1865 tempest-AggregatesAdminTestV241-1799334286 tempest-AggregatesAdminTestV241-1799334286-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:14.034957 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:14.034957 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:49:14.045556 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d1c22f25-e4bd-4dd6-8662-738732fe1865 tempest-AggregatesAdminTestV241-1799334286 tempest-AggregatesAdminTestV241-1799334286-project-admin] 10.222.0.46 "GET /compute/v2.1/os-aggregates/11" status: 200 len: 300 microversion: 2.41 time: 0.020738 Jan 15 20:49:14.047532 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 134/223] 10.222.0.46 () {60 vars in 1192 bytes} [Sat Jan 15 20:49:14 2022] GET /compute/v2.1/os-aggregates/11 => generated 300 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:49:14.053014 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1f44dbe5-a46b-47d4-bce5-414cc8deaf39 tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1239343124"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:14.054594 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:14.054594 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:49:14.056305 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.objects.aggregate [None req-1f44dbe5-a46b-47d4-bce5-414cc8deaf39 tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] Generated uuid c4efdf54-b4e3-4cde-b0e7-e0a5d7e287eb for aggregate {{(pid=129366) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jan 15 20:49:14.084610 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-1f44dbe5-a46b-47d4-bce5-414cc8deaf39 tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.035753 Jan 15 20:49:14.090642 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 135/224] 10.222.0.46 () {60 vars in 1163 bytes} [Sat Jan 15 20:49:14 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:49:14.097146 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e355153d-d08f-4f4a-bb22-c7bf8e6c34b4 tempest-AggregatesAdminNegativeTestJSON-238846009 tempest-AggregatesAdminNegativeTestJSON-238846009-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1646390792"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:14.098430 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:14.098430 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:49:14.099597 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.objects.aggregate [None req-e355153d-d08f-4f4a-bb22-c7bf8e6c34b4 tempest-AggregatesAdminNegativeTestJSON-238846009 tempest-AggregatesAdminNegativeTestJSON-238846009-project-admin] Generated uuid c1887098-33ee-4042-9945-a79c6afc709f for aggregate {{(pid=129366) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jan 15 20:49:14.118644 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f7989a0f-6165-4b69-a915-586c095ef9bc tempest-LiveMigrationNegativeTest-1496050294 tempest-LiveMigrationNegativeTest-1496050294-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-1787636800", "block_migration": true, "disk_over_commit": false}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:14.120789 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f7989a0f-6165-4b69-a915-586c095ef9bc tempest-LiveMigrationNegativeTest-1496050294 tempest-LiveMigrationNegativeTest-1496050294-project-admin] [instance: d5416a14-72ee-4a24-80d3-9fe459a801d8] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:14.125836 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e355153d-d08f-4f4a-bb22-c7bf8e6c34b4 tempest-AggregatesAdminNegativeTestJSON-238846009 tempest-AggregatesAdminNegativeTestJSON-238846009-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.033843 Jan 15 20:49:14.126670 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 136/225] 10.222.0.46 () {60 vars in 1163 bytes} [Sat Jan 15 20:49:14 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:49:14.131295 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f7989a0f-6165-4b69-a915-586c095ef9bc tempest-LiveMigrationNegativeTest-1496050294 tempest-LiveMigrationNegativeTest-1496050294-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:14.131739 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f7989a0f-6165-4b69-a915-586c095ef9bc tempest-LiveMigrationNegativeTest-1496050294 tempest-LiveMigrationNegativeTest-1496050294-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:14.132533 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f7989a0f-6165-4b69-a915-586c095ef9bc tempest-LiveMigrationNegativeTest-1496050294 tempest-LiveMigrationNegativeTest-1496050294-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:14.132992 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f7989a0f-6165-4b69-a915-586c095ef9bc tempest-LiveMigrationNegativeTest-1496050294 tempest-LiveMigrationNegativeTest-1496050294-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:14.136375 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-6bef2339-163b-47b3-8cb8-24cccd0d8d53 tempest-AggregatesAdminTestV241-1799334286 tempest-AggregatesAdminTestV241-1799334286-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:14.137772 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:14.137772 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:49:14.146228 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6bef2339-163b-47b3-8cb8-24cccd0d8d53 tempest-AggregatesAdminTestV241-1799334286 tempest-AggregatesAdminTestV241-1799334286-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:14.146680 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6bef2339-163b-47b3-8cb8-24cccd0d8d53 tempest-AggregatesAdminTestV241-1799334286 tempest-AggregatesAdminTestV241-1799334286-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:14.271307 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-6bef2339-163b-47b3-8cb8-24cccd0d8d53 tempest-AggregatesAdminTestV241-1799334286 tempest-AggregatesAdminTestV241-1799334286-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 315 microversion: 2.41 time: 0.143824 Jan 15 20:49:14.271933 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 137/226] 10.222.0.46 () {62 vars in 1234 bytes} [Sat Jan 15 20:49:14 2022] POST /compute/v2.1/os-aggregates/11/action => generated 315 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:49:14.276989 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f1c84380-5fe1-4f59-8843-72f089de92bf tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:14.277594 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f1c84380-5fe1-4f59-8843-72f089de92bf tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: 4d527369-954d-4ccc-9105-03b209d3523e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:14.283823 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f1c84380-5fe1-4f59-8843-72f089de92bf tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:14.284334 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f1c84380-5fe1-4f59-8843-72f089de92bf tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:14.285086 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f1c84380-5fe1-4f59-8843-72f089de92bf tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:14.285522 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f1c84380-5fe1-4f59-8843-72f089de92bf tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:14.396029 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.objects.instance [None req-f7989a0f-6165-4b69-a915-586c095ef9bc tempest-LiveMigrationNegativeTest-1496050294 tempest-LiveMigrationNegativeTest-1496050294-project-admin] Lazy-loading 'flavor' on Instance uuid d5416a14-72ee-4a24-80d3-9fe459a801d8 {{(pid=129365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 20:49:14.440530 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-f1c84380-5fe1-4f59-8843-72f089de92bf tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:14.443061 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f7989a0f-6165-4b69-a915-586c095ef9bc tempest-LiveMigrationNegativeTest-1496050294 tempest-LiveMigrationNegativeTest-1496050294-project-admin] [instance: d5416a14-72ee-4a24-80d3-9fe459a801d8] Going to try to live migrate instance to tempest-host-1787636800 {{(pid=129365) live_migrate /opt/stack/nova/nova/compute/api.py:5255}} Jan 15 20:49:14.448048 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f1c84380-5fe1-4f59-8843-72f089de92bf tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/4d527369-954d-4ccc-9105-03b209d3523e" status: 200 len: 1312 microversion: 2.1 time: 0.175161 Jan 15 20:49:14.448827 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 138/227] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:14 2022] GET /compute/v2.1/servers/4d527369-954d-4ccc-9105-03b209d3523e => generated 1312 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:14.450025 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-f7989a0f-6165-4b69-a915-586c095ef9bc tempest-LiveMigrationNegativeTest-1496050294 tempest-LiveMigrationNegativeTest-1496050294-project-admin] HTTP exception thrown: Compute host tempest-host-1787636800 could not be found. Jan 15 20:49:14.450712 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f7989a0f-6165-4b69-a915-586c095ef9bc tempest-LiveMigrationNegativeTest-1496050294 tempest-LiveMigrationNegativeTest-1496050294-project-admin] Returning 400 to user: Compute host tempest-host-1787636800 could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:49:14.451613 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f7989a0f-6165-4b69-a915-586c095ef9bc tempest-LiveMigrationNegativeTest-1496050294 tempest-LiveMigrationNegativeTest-1496050294-project-admin] 10.222.0.46 "POST /compute/v2.1/servers/d5416a14-72ee-4a24-80d3-9fe459a801d8/action" status: 400 len: 100 microversion: 2.1 time: 0.537563 Jan 15 20:49:14.455077 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 90/228] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Jan 15 20:49:13 2022] POST /compute/v2.1/servers/d5416a14-72ee-4a24-80d3-9fe459a801d8/action => generated 100 bytes in 538 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 15 20:49:14.455213 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a53d57ea-c213-4b10-b006-8ef01066b0a6 tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:14.455213 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:14.455213 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:49:14.461461 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e2be8ffa-ff48-451a-85cf-931609986db9 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:14.462143 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e2be8ffa-ff48-451a-85cf-931609986db9 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 98d0ca37-0175-44e2-8a1d-965cdc517daf] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:14.462375 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a53d57ea-c213-4b10-b006-8ef01066b0a6 tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] 10.222.0.46 "GET /compute/v2.1/os-aggregates" status: 200 len: 700 microversion: 2.1 time: 0.012778 Jan 15 20:49:14.463089 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 139/229] 10.222.0.46 () {58 vars in 1142 bytes} [Sat Jan 15 20:49:14 2022] GET /compute/v2.1/os-aggregates => generated 700 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:49:14.467712 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8528fb3f-901d-4706-831a-54fd12f5ac0f tempest-AggregatesAdminNegativeTestJSON-238846009 tempest-AggregatesAdminNegativeTestJSON-238846009-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-733701197"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:14.468862 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e2be8ffa-ff48-451a-85cf-931609986db9 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:14.469082 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:14.469082 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:49:14.469316 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e2be8ffa-ff48-451a-85cf-931609986db9 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:14.470214 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e2be8ffa-ff48-451a-85cf-931609986db9 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:14.470585 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e2be8ffa-ff48-451a-85cf-931609986db9 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:14.476797 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8528fb3f-901d-4706-831a-54fd12f5ac0f tempest-AggregatesAdminNegativeTestJSON-238846009 tempest-AggregatesAdminNegativeTestJSON-238846009-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:14.477285 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8528fb3f-901d-4706-831a-54fd12f5ac0f tempest-AggregatesAdminNegativeTestJSON-238846009 tempest-AggregatesAdminNegativeTestJSON-238846009-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:14.486923 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8528fb3f-901d-4706-831a-54fd12f5ac0f tempest-AggregatesAdminNegativeTestJSON-238846009 tempest-AggregatesAdminNegativeTestJSON-238846009-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:14.487368 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8528fb3f-901d-4706-831a-54fd12f5ac0f tempest-AggregatesAdminNegativeTestJSON-238846009 tempest-AggregatesAdminNegativeTestJSON-238846009-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:14.494493 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-8528fb3f-901d-4706-831a-54fd12f5ac0f tempest-AggregatesAdminNegativeTestJSON-238846009 tempest-AggregatesAdminNegativeTestJSON-238846009-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-733701197 could not be found. Jan 15 20:49:14.495074 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8528fb3f-901d-4706-831a-54fd12f5ac0f tempest-AggregatesAdminNegativeTestJSON-238846009 tempest-AggregatesAdminNegativeTestJSON-238846009-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-733701197 could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:49:14.495874 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-8528fb3f-901d-4706-831a-54fd12f5ac0f tempest-AggregatesAdminNegativeTestJSON-238846009 tempest-AggregatesAdminNegativeTestJSON-238846009-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates/13/action" status: 404 len: 110 microversion: 2.1 time: 0.032095 Jan 15 20:49:14.497595 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 140/230] 10.222.0.46 () {60 vars in 1193 bytes} [Sat Jan 15 20:49:14 2022] POST /compute/v2.1/os-aggregates/13/action => generated 110 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:49:14.502022 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-dae03703-52d3-4cc9-9147-dc39f0f0bedd tempest-AggregatesAdminTestV241-1799334286 tempest-AggregatesAdminTestV241-1799334286-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:14.503235 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:14.503235 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:49:14.511130 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dae03703-52d3-4cc9-9147-dc39f0f0bedd tempest-AggregatesAdminTestV241-1799334286 tempest-AggregatesAdminTestV241-1799334286-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:14.511576 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dae03703-52d3-4cc9-9147-dc39f0f0bedd tempest-AggregatesAdminTestV241-1799334286 tempest-AggregatesAdminTestV241-1799334286-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:14.607926 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-e2be8ffa-ff48-451a-85cf-931609986db9 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d60caf368842b2aec08f0f5e14353a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c95e4b5695439dbc3f66a911264026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:14.612423 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-dae03703-52d3-4cc9-9147-dc39f0f0bedd tempest-AggregatesAdminTestV241-1799334286 tempest-AggregatesAdminTestV241-1799334286-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 300 microversion: 2.41 time: 0.113592 Jan 15 20:49:14.612988 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 141/231] 10.222.0.46 () {62 vars in 1234 bytes} [Sat Jan 15 20:49:14 2022] POST /compute/v2.1/os-aggregates/11/action => generated 300 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:49:14.616816 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e2be8ffa-ff48-451a-85cf-931609986db9 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "GET /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf" status: 200 len: 1391 microversion: 2.1 time: 0.163600 Jan 15 20:49:14.617212 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-22049342-da80-4c3b-9c43-f177a8d6c8bd tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:14.617813 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-22049342-da80-4c3b-9c43-f177a8d6c8bd tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] [instance: d5416a14-72ee-4a24-80d3-9fe459a801d8] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:14.623988 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-22049342-da80-4c3b-9c43-f177a8d6c8bd tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:14.624439 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-22049342-da80-4c3b-9c43-f177a8d6c8bd tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:14.625251 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-22049342-da80-4c3b-9c43-f177a8d6c8bd tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:14.625687 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-22049342-da80-4c3b-9c43-f177a8d6c8bd tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:14.626926 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 91/232] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:14 2022] GET /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf => generated 1391 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:14.631366 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-1885ce65-9c82-4d50-b0fd-38fe775f3a64 tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:14.632208 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:14.632208 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:49:14.651508 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-1885ce65-9c82-4d50-b0fd-38fe775f3a64 tempest-AggregatesAdminTestJSON-708906125 tempest-AggregatesAdminTestJSON-708906125-project-admin] 10.222.0.46 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.023509 Jan 15 20:49:14.653016 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 92/233] 10.222.0.46 () {58 vars in 1154 bytes} [Sat Jan 15 20:49:14 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jan 15 20:49:14.659203 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-076000ab-128c-4be3-bef0-03d230478161 tempest-AggregatesAdminNegativeTestJSON-238846009 tempest-AggregatesAdminNegativeTestJSON-238846009-project-admin] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:14.659967 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:14.659967 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:49:14.683735 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-076000ab-128c-4be3-bef0-03d230478161 tempest-AggregatesAdminNegativeTestJSON-238846009 tempest-AggregatesAdminNegativeTestJSON-238846009-project-admin] 10.222.0.46 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.029489 Jan 15 20:49:14.684511 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 93/234] 10.222.0.46 () {58 vars in 1154 bytes} [Sat Jan 15 20:49:14 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jan 15 20:49:14.692002 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b4b830af-ede6-488a-ab71-e13cd0880324 tempest-AggregatesAdminTestV241-1799334286 tempest-AggregatesAdminTestV241-1799334286-project-admin] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:14.692770 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:14.692770 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:49:14.713135 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b4b830af-ede6-488a-ab71-e13cd0880324 tempest-AggregatesAdminTestV241-1799334286 tempest-AggregatesAdminTestV241-1799334286-project-admin] 10.222.0.46 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.41 time: 0.027488 Jan 15 20:49:14.718723 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 94/235] 10.222.0.46 () {60 vars in 1195 bytes} [Sat Jan 15 20:49:14 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:49:14.723649 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-34ac2a4c-2d9c-4a18-aad5-b4d240f553b9 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:14.724266 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-34ac2a4c-2d9c-4a18-aad5-b4d240f553b9 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] [instance: 5736e502-fb8b-43e0-8763-ec341d6f5953] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:14.730452 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-34ac2a4c-2d9c-4a18-aad5-b4d240f553b9 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:14.732033 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-34ac2a4c-2d9c-4a18-aad5-b4d240f553b9 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:14.732791 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-34ac2a4c-2d9c-4a18-aad5-b4d240f553b9 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:14.733253 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-34ac2a4c-2d9c-4a18-aad5-b4d240f553b9 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:14.758908 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-34ac2a4c-2d9c-4a18-aad5-b4d240f553b9 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] [instance: 5736e502-fb8b-43e0-8763-ec341d6f5953] Going to try to terminate instance {{(pid=129365) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 20:49:14.775276 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-22049342-da80-4c3b-9c43-f177a8d6c8bd tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0079c95473594ee9ada5a4bc6820a111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac923ea754345a9b79457833bd72da4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:14.783815 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-22049342-da80-4c3b-9c43-f177a8d6c8bd tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] 10.222.0.46 "GET /compute/v2.1/servers/d5416a14-72ee-4a24-80d3-9fe459a801d8" status: 200 len: 1469 microversion: 2.1 time: 0.169689 Jan 15 20:49:14.784614 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 142/236] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:14 2022] GET /compute/v2.1/servers/d5416a14-72ee-4a24-80d3-9fe459a801d8 => generated 1469 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:14.804214 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-eb61b9d8-f07a-4d92-b244-a0c8f1cf8c8d tempest-AggregatesAdminNegativeTestJSON-238846009 tempest-AggregatesAdminNegativeTestJSON-238846009-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:14.806094 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-eb61b9d8-f07a-4d92-b244-a0c8f1cf8c8d tempest-AggregatesAdminNegativeTestJSON-238846009 tempest-AggregatesAdminNegativeTestJSON-238846009-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:49:14.816202 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-eb61b9d8-f07a-4d92-b244-a0c8f1cf8c8d tempest-AggregatesAdminNegativeTestJSON-238846009 tempest-AggregatesAdminNegativeTestJSON-238846009-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.018158 Jan 15 20:49:14.822021 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 143/237] 10.222.0.46 () {60 vars in 1164 bytes} [Sat Jan 15 20:49:14 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 15 20:49:14.822209 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-681b9501-fbb5-4521-9211-8b3673e2a9f1 tempest-HostsAdminTestJSON-2107158735 tempest-HostsAdminTestJSON-2107158735-project-admin] Calling method '.version_select at 0x7f30c9b18e50>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:14.828288 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:14.828288 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:49:14.829914 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-681b9501-fbb5-4521-9211-8b3673e2a9f1 tempest-HostsAdminTestJSON-2107158735 tempest-HostsAdminTestJSON-2107158735-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:14.830368 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-681b9501-fbb5-4521-9211-8b3673e2a9f1 tempest-HostsAdminTestJSON-2107158735 tempest-HostsAdminTestJSON-2107158735-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:14.831172 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-681b9501-fbb5-4521-9211-8b3673e2a9f1 tempest-HostsAdminTestJSON-2107158735 tempest-HostsAdminTestJSON-2107158735-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:14.831593 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-681b9501-fbb5-4521-9211-8b3673e2a9f1 tempest-HostsAdminTestJSON-2107158735 tempest-HostsAdminTestJSON-2107158735-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:14.863792 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-681b9501-fbb5-4521-9211-8b3673e2a9f1 tempest-HostsAdminTestJSON-2107158735 tempest-HostsAdminTestJSON-2107158735-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.044949 Jan 15 20:49:14.864667 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 144/238] 10.222.0.46 () {58 vars in 1127 bytes} [Sat Jan 15 20:49:14 2022] GET /compute/v2.1/os-hosts => generated 379 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:49:14.872129 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a99d32b2-e11e-4d9b-ba80-9e7dc07e480e tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:14.872761 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a99d32b2-e11e-4d9b-ba80-9e7dc07e480e tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] [instance: 50205979-c437-4302-b6f0-1bb76d7ea2c9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:14.878697 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a99d32b2-e11e-4d9b-ba80-9e7dc07e480e tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:14.879143 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a99d32b2-e11e-4d9b-ba80-9e7dc07e480e tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:14.879926 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a99d32b2-e11e-4d9b-ba80-9e7dc07e480e tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:14.880361 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a99d32b2-e11e-4d9b-ba80-9e7dc07e480e tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:14.903994 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-a99d32b2-e11e-4d9b-ba80-9e7dc07e480e tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] HTTP exception thrown: Instance 50205979-c437-4302-b6f0-1bb76d7ea2c9 could not be found. Jan 15 20:49:14.905654 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a99d32b2-e11e-4d9b-ba80-9e7dc07e480e tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Returning 404 to user: Instance 50205979-c437-4302-b6f0-1bb76d7ea2c9 could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:49:14.906431 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a99d32b2-e11e-4d9b-ba80-9e7dc07e480e tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] 10.222.0.46 "GET /compute/v2.1/servers/50205979-c437-4302-b6f0-1bb76d7ea2c9" status: 404 len: 111 microversion: 2.1 time: 0.039358 Jan 15 20:49:14.908652 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-34ac2a4c-2d9c-4a18-aad5-b4d240f553b9 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] 10.222.0.46 "DELETE /compute/v2.1/servers/5736e502-fb8b-43e0-8763-ec341d6f5953" status: 204 len: 0 microversion: 2.1 time: 0.187974 Jan 15 20:49:14.909878 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 95/239] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 20:49:14 2022] DELETE /compute/v2.1/servers/5736e502-fb8b-43e0-8763-ec341d6f5953 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 20:49:14.919835 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 145/240] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:14 2022] GET /compute/v2.1/servers/50205979-c437-4302-b6f0-1bb76d7ea2c9 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:49:14.925220 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8ac9a055-aefb-4f44-9f02-c9481e196109 tempest-HostsAdminTestJSON-2107158735 tempest-HostsAdminTestJSON-2107158735-project-admin] Calling method '.version_select at 0x7f30c9b181f0>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:14.926455 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:14.926455 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:49:14.928268 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8ac9a055-aefb-4f44-9f02-c9481e196109 tempest-HostsAdminTestJSON-2107158735 tempest-HostsAdminTestJSON-2107158735-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:14.928719 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8ac9a055-aefb-4f44-9f02-c9481e196109 tempest-HostsAdminTestJSON-2107158735 tempest-HostsAdminTestJSON-2107158735-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:14.929574 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8ac9a055-aefb-4f44-9f02-c9481e196109 tempest-HostsAdminTestJSON-2107158735 tempest-HostsAdminTestJSON-2107158735-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:14.930003 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8ac9a055-aefb-4f44-9f02-c9481e196109 tempest-HostsAdminTestJSON-2107158735 tempest-HostsAdminTestJSON-2107158735-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:14.939950 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-cdb87a36-1111-4ad8-a607-a7522b0d38dd tempest-AggregatesAdminNegativeTestJSON-238846009 tempest-AggregatesAdminNegativeTestJSON-238846009-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:14.941544 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-cdb87a36-1111-4ad8-a607-a7522b0d38dd tempest-AggregatesAdminNegativeTestJSON-238846009 tempest-AggregatesAdminNegativeTestJSON-238846009-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:49:14.942360 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-cdb87a36-1111-4ad8-a607-a7522b0d38dd tempest-AggregatesAdminNegativeTestJSON-238846009 tempest-AggregatesAdminNegativeTestJSON-238846009-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.031183 Jan 15 20:49:14.947726 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 96/241] 10.222.0.46 () {60 vars in 1163 bytes} [Sat Jan 15 20:49:14 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 15 20:49:14.953039 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f5474864-5f00-4e45-8fcd-af4f2b727255 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:14.953818 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f5474864-5f00-4e45-8fcd-af4f2b727255 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] [instance: 5736e502-fb8b-43e0-8763-ec341d6f5953] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:14.958729 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-8ac9a055-aefb-4f44-9f02-c9481e196109 tempest-HostsAdminTestJSON-2107158735 tempest-HostsAdminTestJSON-2107158735-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 239 microversion: 2.1 time: 0.037211 Jan 15 20:49:14.959203 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 146/242] 10.222.0.46 () {58 vars in 1154 bytes} [Sat Jan 15 20:49:14 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 239 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:49:14.964196 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a4a969f8-8f6d-496a-a552-0b32f5fa2ae9 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-676769241", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:14.973347 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f5474864-5f00-4e45-8fcd-af4f2b727255 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:14.973531 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f5474864-5f00-4e45-8fcd-af4f2b727255 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:14.974234 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f5474864-5f00-4e45-8fcd-af4f2b727255 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:14.974667 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f5474864-5f00-4e45-8fcd-af4f2b727255 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:15.022901 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.network.neutron [None req-a4a969f8-8f6d-496a-a552-0b32f5fa2ae9 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] validate_networks() for None {{(pid=129366) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 20:49:15.269057 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-f5474864-5f00-4e45-8fcd-af4f2b727255 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4272283f80fd440c92c605310d8a441d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c9ae9cb7d2d4105a277bcaaf858b861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:15.277147 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f5474864-5f00-4e45-8fcd-af4f2b727255 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] 10.222.0.46 "GET /compute/v2.1/servers/5736e502-fb8b-43e0-8763-ec341d6f5953" status: 200 len: 1472 microversion: 2.1 time: 0.329105 Jan 15 20:49:15.278126 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 97/243] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:14 2022] GET /compute/v2.1/servers/5736e502-fb8b-43e0-8763-ec341d6f5953 => generated 1472 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:15.282740 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-207ba9a5-7280-45c3-81e8-69597174bce4 tempest-AggregatesAdminNegativeTestJSON-1894226231 tempest-AggregatesAdminNegativeTestJSON-1894226231-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-388495045"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:15.284160 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:15.284160 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:49:15.285135 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-207ba9a5-7280-45c3-81e8-69597174bce4 tempest-AggregatesAdminNegativeTestJSON-1894226231 tempest-AggregatesAdminNegativeTestJSON-1894226231-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '87b7045f39424d27b1f1d2b1b8292308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ab1e9106654fccab088c31f19c9eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:15.285819 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-207ba9a5-7280-45c3-81e8-69597174bce4 tempest-AggregatesAdminNegativeTestJSON-1894226231 tempest-AggregatesAdminNegativeTestJSON-1894226231-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:49:15.287083 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-207ba9a5-7280-45c3-81e8-69597174bce4 tempest-AggregatesAdminNegativeTestJSON-1894226231 tempest-AggregatesAdminNegativeTestJSON-1894226231-project] 10.222.0.46 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.007406 Jan 15 20:49:15.287531 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 98/244] 10.222.0.46 () {60 vars in 1163 bytes} [Sat Jan 15 20:49:15 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 9 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:49:15.292102 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-00b935d7-de14-45c2-8572-369e426e3e13 tempest-HostsAdminTestJSON-2107158735 tempest-HostsAdminTestJSON-2107158735-project-admin] Calling method '.version_select at 0x7f30c9a47820>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:15.293834 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:15.293834 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:49:15.295315 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-00b935d7-de14-45c2-8572-369e426e3e13 tempest-HostsAdminTestJSON-2107158735 tempest-HostsAdminTestJSON-2107158735-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:15.295759 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-00b935d7-de14-45c2-8572-369e426e3e13 tempest-HostsAdminTestJSON-2107158735 tempest-HostsAdminTestJSON-2107158735-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:15.296823 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-00b935d7-de14-45c2-8572-369e426e3e13 tempest-HostsAdminTestJSON-2107158735 tempest-HostsAdminTestJSON-2107158735-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:15.297378 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-00b935d7-de14-45c2-8572-369e426e3e13 tempest-HostsAdminTestJSON-2107158735 tempest-HostsAdminTestJSON-2107158735-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:15.325809 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-00b935d7-de14-45c2-8572-369e426e3e13 tempest-HostsAdminTestJSON-2107158735 tempest-HostsAdminTestJSON-2107158735-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.036263 Jan 15 20:49:15.326061 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 99/245] 10.222.0.46 () {58 vars in 1127 bytes} [Sat Jan 15 20:49:15 2022] GET /compute/v2.1/os-hosts => generated 379 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:49:15.330576 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ed895e87-04fb-4ac7-a05e-f6d954d2e756 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-509339246", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:15.351020 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-a4a969f8-8f6d-496a-a552-0b32f5fa2ae9 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Flavor limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 20:49:15.351352 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-a4a969f8-8f6d-496a-a552-0b32f5fa2ae9 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Image limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 20:49:15.351732 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-a4a969f8-8f6d-496a-a552-0b32f5fa2ae9 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Flavor pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 20:49:15.352138 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-a4a969f8-8f6d-496a-a552-0b32f5fa2ae9 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Image pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 20:49:15.352540 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-a4a969f8-8f6d-496a-a552-0b32f5fa2ae9 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 20:49:15.369894 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a4a969f8-8f6d-496a-a552-0b32f5fa2ae9 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:15.370351 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a4a969f8-8f6d-496a-a552-0b32f5fa2ae9 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:15.371725 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a4a969f8-8f6d-496a-a552-0b32f5fa2ae9 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:15.377312 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a4a969f8-8f6d-496a-a552-0b32f5fa2ae9 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:15.396094 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.network.neutron [None req-ed895e87-04fb-4ac7-a05e-f6d954d2e756 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] validate_networks() for None {{(pid=129365) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 20:49:15.396970 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-a4a969f8-8f6d-496a-a552-0b32f5fa2ae9 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Getting quotas for project 8ac923ea754345a9b79457833bd72da4. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:49:15.400976 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-a4a969f8-8f6d-496a-a552-0b32f5fa2ae9 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Getting quotas for user 0079c95473594ee9ada5a4bc6820a111 and project 8ac923ea754345a9b79457833bd72da4. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:49:15.412361 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a4a969f8-8f6d-496a-a552-0b32f5fa2ae9 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Going to run 1 instances... {{(pid=129366) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 20:49:15.414728 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a4a969f8-8f6d-496a-a552-0b32f5fa2ae9 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] [instance: 114ccb23-d953-4735-b61e-f0d62e19dce2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 20:49:15.459942 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a4a969f8-8f6d-496a-a552-0b32f5fa2ae9 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.499586 Jan 15 20:49:15.460888 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 147/246] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 20:49:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 501 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 20:49:15.465437 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-628c3ed7-12ff-418a-8174-2bb6de9b2bc7 req-d0f304c3-1706-4f97-b636-3c708c83db89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98d0ca37-0175-44e2-8a1d-965cdc517daf", "name": "network-vif-plugged", "status": "completed", "tag": "621b3781-18ee-45e7-aefe-ae6ec4d044ae"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:15.467196 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:15.467196 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:49:15.474369 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-628c3ed7-12ff-418a-8174-2bb6de9b2bc7 req-d0f304c3-1706-4f97-b636-3c708c83db89 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:15.474996 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-628c3ed7-12ff-418a-8174-2bb6de9b2bc7 req-d0f304c3-1706-4f97-b636-3c708c83db89 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:15.486247 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-628c3ed7-12ff-418a-8174-2bb6de9b2bc7 req-d0f304c3-1706-4f97-b636-3c708c83db89 service nova] Creating event network-vif-plugged:621b3781-18ee-45e7-aefe-ae6ec4d044ae for instance 98d0ca37-0175-44e2-8a1d-965cdc517daf on nch2-master-1 Jan 15 20:49:15.492927 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-628c3ed7-12ff-418a-8174-2bb6de9b2bc7 req-d0f304c3-1706-4f97-b636-3c708c83db89 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030745 Jan 15 20:49:15.493513 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 148/247] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:49:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:49:15.499687 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-cedbb227-3c72-4e0a-902d-fd1552fa075e tempest-AggregatesAdminNegativeTestJSON-238846009 tempest-AggregatesAdminNegativeTestJSON-238846009-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-649717545"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:15.501150 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:15.501150 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:49:15.502612 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.objects.aggregate [None req-cedbb227-3c72-4e0a-902d-fd1552fa075e tempest-AggregatesAdminNegativeTestJSON-238846009 tempest-AggregatesAdminNegativeTestJSON-238846009-project-admin] Generated uuid c9a45983-6af8-46a3-b0b8-5f7e03d64d38 for aggregate {{(pid=129366) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jan 15 20:49:15.539098 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-cedbb227-3c72-4e0a-902d-fd1552fa075e tempest-AggregatesAdminNegativeTestJSON-238846009 tempest-AggregatesAdminNegativeTestJSON-238846009-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.043754 Jan 15 20:49:15.540154 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 149/248] 10.222.0.46 () {60 vars in 1163 bytes} [Sat Jan 15 20:49:15 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:49:15.552745 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d6409876-e9b3-40be-a42d-c8a23c2ea17f tempest-HostsAdminTestJSON-2107158735 tempest-HostsAdminTestJSON-2107158735-project-admin] Calling method '.version_select at 0x7f30c9a2c9d0>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:15.557920 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:15.557920 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:49:15.570777 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d6409876-e9b3-40be-a42d-c8a23c2ea17f tempest-HostsAdminTestJSON-2107158735 tempest-HostsAdminTestJSON-2107158735-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:15.571301 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d6409876-e9b3-40be-a42d-c8a23c2ea17f tempest-HostsAdminTestJSON-2107158735 tempest-HostsAdminTestJSON-2107158735-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:15.591391 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d6409876-e9b3-40be-a42d-c8a23c2ea17f tempest-HostsAdminTestJSON-2107158735 tempest-HostsAdminTestJSON-2107158735-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:15.592191 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d6409876-e9b3-40be-a42d-c8a23c2ea17f tempest-HostsAdminTestJSON-2107158735 tempest-HostsAdminTestJSON-2107158735-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:15.626906 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d6409876-e9b3-40be-a42d-c8a23c2ea17f tempest-HostsAdminTestJSON-2107158735 tempest-HostsAdminTestJSON-2107158735-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hosts/nch2-master-1" status: 200 len: 598 microversion: 2.1 time: 0.080831 Jan 15 20:49:15.629150 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 150/249] 10.222.0.46 () {58 vars in 1169 bytes} [Sat Jan 15 20:49:15 2022] GET /compute/v2.1/os-hosts/nch2-master-1 => generated 598 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:49:15.633792 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a3f863c9-11e7-4cc4-b4af-5036509abcb4 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:15.634821 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a3f863c9-11e7-4cc4-b4af-5036509abcb4 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: 4d527369-954d-4ccc-9105-03b209d3523e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:15.641779 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a3f863c9-11e7-4cc4-b4af-5036509abcb4 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:15.642371 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a3f863c9-11e7-4cc4-b4af-5036509abcb4 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:15.644597 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a3f863c9-11e7-4cc4-b4af-5036509abcb4 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:15.645106 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a3f863c9-11e7-4cc4-b4af-5036509abcb4 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:15.707767 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-ed895e87-04fb-4ac7-a05e-f6d954d2e756 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Flavor limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 20:49:15.708253 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-ed895e87-04fb-4ac7-a05e-f6d954d2e756 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Image limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 20:49:15.708623 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-ed895e87-04fb-4ac7-a05e-f6d954d2e756 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Flavor pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 20:49:15.709051 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-ed895e87-04fb-4ac7-a05e-f6d954d2e756 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Image pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 20:49:15.709472 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-ed895e87-04fb-4ac7-a05e-f6d954d2e756 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 20:49:15.722677 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ed895e87-04fb-4ac7-a05e-f6d954d2e756 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:15.723420 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ed895e87-04fb-4ac7-a05e-f6d954d2e756 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:15.724771 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ed895e87-04fb-4ac7-a05e-f6d954d2e756 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:15.725370 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ed895e87-04fb-4ac7-a05e-f6d954d2e756 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:15.768991 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-ed895e87-04fb-4ac7-a05e-f6d954d2e756 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Getting quotas for project bd82c6b47c4140e390464b153d2fe865. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:49:15.777880 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-ed895e87-04fb-4ac7-a05e-f6d954d2e756 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Getting quotas for user 957f85f9c6794cccad71c553fb607ad8 and project bd82c6b47c4140e390464b153d2fe865. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:49:15.804761 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ed895e87-04fb-4ac7-a05e-f6d954d2e756 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Going to run 1 instances... {{(pid=129365) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 20:49:15.808328 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ed895e87-04fb-4ac7-a05e-f6d954d2e756 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] [instance: 2b68335f-a94c-4801-8d8b-2fd387d1ced9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129365) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 20:49:15.881833 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-a3f863c9-11e7-4cc4-b4af-5036509abcb4 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:15.893139 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a3f863c9-11e7-4cc4-b4af-5036509abcb4 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/4d527369-954d-4ccc-9105-03b209d3523e" status: 200 len: 1312 microversion: 2.1 time: 0.262863 Jan 15 20:49:15.893732 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 151/250] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:15 2022] GET /compute/v2.1/servers/4d527369-954d-4ccc-9105-03b209d3523e => generated 1312 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:15.894866 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ed895e87-04fb-4ac7-a05e-f6d954d2e756 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.567814 Jan 15 20:49:15.895805 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 100/251] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 20:49:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 569 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 20:49:15.899270 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d7fe3079-d99a-40ed-8967-c59ac5d70531 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:15.899877 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-d7fe3079-d99a-40ed-8967-c59ac5d70531 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] [instance: 114ccb23-d953-4735-b61e-f0d62e19dce2] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:15.907753 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-fed9d3c6-dc86-4895-ad8b-9f9e83026af0 tempest-AggregatesAdminNegativeTestJSON-238846009 tempest-AggregatesAdminNegativeTestJSON-238846009-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-649717545"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:15.909135 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:15.909135 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:49:15.910311 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.objects.aggregate [None req-fed9d3c6-dc86-4895-ad8b-9f9e83026af0 tempest-AggregatesAdminNegativeTestJSON-238846009 tempest-AggregatesAdminNegativeTestJSON-238846009-project-admin] Generated uuid 8a7fc346-3e90-4862-9013-751966756b76 for aggregate {{(pid=129365) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jan 15 20:49:15.937588 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-fed9d3c6-dc86-4895-ad8b-9f9e83026af0 tempest-AggregatesAdminNegativeTestJSON-238846009 tempest-AggregatesAdminNegativeTestJSON-238846009-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-649717545 already exists. Jan 15 20:49:15.938215 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-fed9d3c6-dc86-4895-ad8b-9f9e83026af0 tempest-AggregatesAdminNegativeTestJSON-238846009 tempest-AggregatesAdminNegativeTestJSON-238846009-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-649717545 already exists. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:49:15.939032 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-fed9d3c6-dc86-4895-ad8b-9f9e83026af0 tempest-AggregatesAdminNegativeTestJSON-238846009 tempest-AggregatesAdminNegativeTestJSON-238846009-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates" status: 409 len: 110 microversion: 2.1 time: 0.034929 Jan 15 20:49:15.941185 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 101/252] 10.222.0.46 () {60 vars in 1163 bytes} [Sat Jan 15 20:49:15 2022] POST /compute/v2.1/os-aggregates => generated 110 bytes in 45 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jan 15 20:49:15.949821 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-016ef814-aa9b-4a10-8aaf-ed05a6675176 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:15.950429 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-016ef814-aa9b-4a10-8aaf-ed05a6675176 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 98d0ca37-0175-44e2-8a1d-965cdc517daf] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:15.976331 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-016ef814-aa9b-4a10-8aaf-ed05a6675176 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:15.976782 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-016ef814-aa9b-4a10-8aaf-ed05a6675176 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:15.977621 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-016ef814-aa9b-4a10-8aaf-ed05a6675176 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:15.977792 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-d7fe3079-d99a-40ed-8967-c59ac5d70531 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0079c95473594ee9ada5a4bc6820a111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac923ea754345a9b79457833bd72da4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:15.978055 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-016ef814-aa9b-4a10-8aaf-ed05a6675176 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:15.989321 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d7fe3079-d99a-40ed-8967-c59ac5d70531 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] 10.222.0.46 "GET /compute/v2.1/servers/114ccb23-d953-4735-b61e-f0d62e19dce2" status: 200 len: 1218 microversion: 2.1 time: 0.094475 Jan 15 20:49:15.990240 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 152/253] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:15 2022] GET /compute/v2.1/servers/114ccb23-d953-4735-b61e-f0d62e19dce2 => generated 1218 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:15.995779 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-66b13ac1-e105-4afd-8a0c-4184c591eca1 tempest-HostsAdminTestJSON-2107158735 tempest-HostsAdminTestJSON-2107158735-project-admin] Calling method '.version_select at 0x7f30c9b18a60>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:15.997533 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:15.997533 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:49:16.006917 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-66b13ac1-e105-4afd-8a0c-4184c591eca1 tempest-HostsAdminTestJSON-2107158735 tempest-HostsAdminTestJSON-2107158735-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:16.007483 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-66b13ac1-e105-4afd-8a0c-4184c591eca1 tempest-HostsAdminTestJSON-2107158735 tempest-HostsAdminTestJSON-2107158735-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:16.028974 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-66b13ac1-e105-4afd-8a0c-4184c591eca1 tempest-HostsAdminTestJSON-2107158735 tempest-HostsAdminTestJSON-2107158735-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:16.029765 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-66b13ac1-e105-4afd-8a0c-4184c591eca1 tempest-HostsAdminTestJSON-2107158735 tempest-HostsAdminTestJSON-2107158735-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:16.053228 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-66b13ac1-e105-4afd-8a0c-4184c591eca1 tempest-HostsAdminTestJSON-2107158735 tempest-HostsAdminTestJSON-2107158735-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hosts/nch1-master-1" status: 200 len: 598 microversion: 2.1 time: 0.061648 Jan 15 20:49:16.054191 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 153/254] 10.222.0.46 () {58 vars in 1169 bytes} [Sat Jan 15 20:49:15 2022] GET /compute/v2.1/os-hosts/nch1-master-1 => generated 598 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:49:16.076044 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9edf0d5f-251b-49de-95e4-49a411a7fa51 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:16.078684 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-9edf0d5f-251b-49de-95e4-49a411a7fa51 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] [instance: 2b68335f-a94c-4801-8d8b-2fd387d1ced9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:16.260519 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-9edf0d5f-251b-49de-95e4-49a411a7fa51 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957f85f9c6794cccad71c553fb607ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82c6b47c4140e390464b153d2fe865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:16.268452 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-9edf0d5f-251b-49de-95e4-49a411a7fa51 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] 10.222.0.46 "GET /compute/v2.1/servers/2b68335f-a94c-4801-8d8b-2fd387d1ced9" status: 200 len: 1219 microversion: 2.1 time: 0.212768 Jan 15 20:49:16.279240 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 154/255] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:16 2022] GET /compute/v2.1/servers/2b68335f-a94c-4801-8d8b-2fd387d1ced9 => generated 1219 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:16.284116 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-daa55717-c748-48df-b21b-e8e9fc277c9b tempest-AggregatesAdminNegativeTestJSON-238846009 tempest-AggregatesAdminNegativeTestJSON-238846009-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:16.285485 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:16.285485 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:49:16.312972 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-daa55717-c748-48df-b21b-e8e9fc277c9b tempest-AggregatesAdminNegativeTestJSON-238846009 tempest-AggregatesAdminNegativeTestJSON-238846009-project-admin] 10.222.0.46 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.032292 Jan 15 20:49:16.315468 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 155/256] 10.222.0.46 () {58 vars in 1154 bytes} [Sat Jan 15 20:49:16 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jan 15 20:49:16.320126 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-63766936-27cc-4095-be9e-bed2537ae7e8 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:16.320944 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-63766936-27cc-4095-be9e-bed2537ae7e8 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] [instance: 5736e502-fb8b-43e0-8763-ec341d6f5953] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:16.345109 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-63766936-27cc-4095-be9e-bed2537ae7e8 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:16.346271 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-63766936-27cc-4095-be9e-bed2537ae7e8 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:16.348444 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-63766936-27cc-4095-be9e-bed2537ae7e8 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:16.356140 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-63766936-27cc-4095-be9e-bed2537ae7e8 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:16.357259 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-016ef814-aa9b-4a10-8aaf-ed05a6675176 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d60caf368842b2aec08f0f5e14353a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c95e4b5695439dbc3f66a911264026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:16.385295 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-016ef814-aa9b-4a10-8aaf-ed05a6675176 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "GET /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf" status: 200 len: 1391 microversion: 2.1 time: 0.442585 Jan 15 20:49:16.385850 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 102/257] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:15 2022] GET /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf => generated 1391 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:16.399345 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-6e3e3e2e-1b8d-4091-9f02-70cfa369d1be tempest-AggregatesAdminNegativeTestJSON-238846009 tempest-AggregatesAdminNegativeTestJSON-238846009-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-289296602"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:16.415976 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:16.415976 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:49:16.424081 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.objects.aggregate [None req-6e3e3e2e-1b8d-4091-9f02-70cfa369d1be tempest-AggregatesAdminNegativeTestJSON-238846009 tempest-AggregatesAdminNegativeTestJSON-238846009-project-admin] Generated uuid e4a6df8c-5241-4a45-95a5-170e0954b6c5 for aggregate {{(pid=129365) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jan 15 20:49:16.480016 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-6e3e3e2e-1b8d-4091-9f02-70cfa369d1be tempest-AggregatesAdminNegativeTestJSON-238846009 tempest-AggregatesAdminNegativeTestJSON-238846009-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.088289 Jan 15 20:49:16.485345 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 103/258] 10.222.0.46 () {60 vars in 1163 bytes} [Sat Jan 15 20:49:16 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:49:16.497014 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-fba17095-7af9-47c4-bff7-4079d89d889f tempest-AggregatesAdminNegativeTestJSON-1894226231 tempest-AggregatesAdminNegativeTestJSON-1894226231-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:16.498424 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:16.498424 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:49:16.500698 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-fba17095-7af9-47c4-bff7-4079d89d889f tempest-AggregatesAdminNegativeTestJSON-1894226231 tempest-AggregatesAdminNegativeTestJSON-1894226231-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '87b7045f39424d27b1f1d2b1b8292308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ab1e9106654fccab088c31f19c9eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:16.505274 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-fba17095-7af9-47c4-bff7-4079d89d889f tempest-AggregatesAdminNegativeTestJSON-1894226231 tempest-AggregatesAdminNegativeTestJSON-1894226231-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:49:16.506458 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-fba17095-7af9-47c4-bff7-4079d89d889f tempest-AggregatesAdminNegativeTestJSON-1894226231 tempest-AggregatesAdminNegativeTestJSON-1894226231-project] 10.222.0.46 "DELETE /compute/v2.1/os-aggregates/15" status: 403 len: 116 microversion: 2.1 time: 0.016016 Jan 15 20:49:16.511636 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 104/259] 10.222.0.46 () {58 vars in 1154 bytes} [Sat Jan 15 20:49:16 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 116 bytes in 22 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jan 15 20:49:16.521186 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-885b75be-8138-4940-a3b3-57aa482b7471 tempest-AggregatesAdminNegativeTestJSON-238846009 tempest-AggregatesAdminNegativeTestJSON-238846009-project-admin] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:16.574161 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-885b75be-8138-4940-a3b3-57aa482b7471 tempest-AggregatesAdminNegativeTestJSON-238846009 tempest-AggregatesAdminNegativeTestJSON-238846009-project-admin] 10.222.0.46 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.059208 Jan 15 20:49:16.581523 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 105/260] 10.222.0.46 () {58 vars in 1154 bytes} [Sat Jan 15 20:49:16 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jan 15 20:49:16.586173 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-fb105770-850e-4b50-a765-1d48b2e56607 tempest-AggregatesAdminNegativeTestJSON-238846009 tempest-AggregatesAdminNegativeTestJSON-238846009-project-admin] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:16.593870 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:16.593870 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:49:16.615919 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-fb105770-850e-4b50-a765-1d48b2e56607 tempest-AggregatesAdminNegativeTestJSON-238846009 tempest-AggregatesAdminNegativeTestJSON-238846009-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Jan 15 20:49:16.621978 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-fb105770-850e-4b50-a765-1d48b2e56607 tempest-AggregatesAdminNegativeTestJSON-238846009 tempest-AggregatesAdminNegativeTestJSON-238846009-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:49:16.623032 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-fb105770-850e-4b50-a765-1d48b2e56607 tempest-AggregatesAdminNegativeTestJSON-238846009 tempest-AggregatesAdminNegativeTestJSON-238846009-project-admin] 10.222.0.46 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.040436 Jan 15 20:49:16.628177 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 106/261] 10.222.0.46 () {58 vars in 1154 bytes} [Sat Jan 15 20:49:16 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jan 15 20:49:16.639102 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e2189b93-a3c3-4c8f-b157-9c0fdb155cf4 tempest-AggregatesAdminNegativeTestJSON-238846009 tempest-AggregatesAdminNegativeTestJSON-238846009-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1342078099"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:16.642563 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:16.642563 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:49:16.643858 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.objects.aggregate [None req-e2189b93-a3c3-4c8f-b157-9c0fdb155cf4 tempest-AggregatesAdminNegativeTestJSON-238846009 tempest-AggregatesAdminNegativeTestJSON-238846009-project-admin] Generated uuid 95a8bc10-3100-4116-9fc0-b1ab64e04ef9 for aggregate {{(pid=129365) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jan 15 20:49:16.671457 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e2189b93-a3c3-4c8f-b157-9c0fdb155cf4 tempest-AggregatesAdminNegativeTestJSON-238846009 tempest-AggregatesAdminNegativeTestJSON-238846009-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.041665 Jan 15 20:49:16.672409 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 107/262] 10.222.0.46 () {60 vars in 1163 bytes} [Sat Jan 15 20:49:16 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 20:49:16.678314 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-63766936-27cc-4095-be9e-bed2537ae7e8 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4272283f80fd440c92c605310d8a441d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c9ae9cb7d2d4105a277bcaaf858b861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:16.682959 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9711cc08-2d0b-485d-ae46-38269300d8a0 tempest-AggregatesAdminNegativeTestJSON-1894226231 tempest-AggregatesAdminNegativeTestJSON-1894226231-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:16.684107 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:16.684107 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:49:16.685719 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-9711cc08-2d0b-485d-ae46-38269300d8a0 tempest-AggregatesAdminNegativeTestJSON-1894226231 tempest-AggregatesAdminNegativeTestJSON-1894226231-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '87b7045f39424d27b1f1d2b1b8292308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ab1e9106654fccab088c31f19c9eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:16.686527 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9711cc08-2d0b-485d-ae46-38269300d8a0 tempest-AggregatesAdminNegativeTestJSON-1894226231 tempest-AggregatesAdminNegativeTestJSON-1894226231-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:49:16.687475 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-9711cc08-2d0b-485d-ae46-38269300d8a0 tempest-AggregatesAdminNegativeTestJSON-1894226231 tempest-AggregatesAdminNegativeTestJSON-1894226231-project] 10.222.0.46 "GET /compute/v2.1/os-aggregates/16" status: 403 len: 114 microversion: 2.1 time: 0.008777 Jan 15 20:49:16.688117 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 108/263] 10.222.0.46 () {58 vars in 1151 bytes} [Sat Jan 15 20:49:16 2022] GET /compute/v2.1/os-aggregates/16 => generated 114 bytes in 10 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:49:16.698635 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5f076999-6674-4470-8916-ec148ee8b46a tempest-AggregatesAdminNegativeTestJSON-238846009 tempest-AggregatesAdminNegativeTestJSON-238846009-project-admin] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:16.699934 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:16.699934 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:49:16.714265 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-63766936-27cc-4095-be9e-bed2537ae7e8 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] 10.222.0.46 "GET /compute/v2.1/servers/5736e502-fb8b-43e0-8763-ec341d6f5953" status: 200 len: 1472 microversion: 2.1 time: 0.398093 Jan 15 20:49:16.720193 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 156/264] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:16 2022] GET /compute/v2.1/servers/5736e502-fb8b-43e0-8763-ec341d6f5953 => generated 1472 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:16.726649 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5f076999-6674-4470-8916-ec148ee8b46a tempest-AggregatesAdminNegativeTestJSON-238846009 tempest-AggregatesAdminNegativeTestJSON-238846009-project-admin] 10.222.0.46 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.031682 Jan 15 20:49:16.728207 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 109/265] 10.222.0.46 () {58 vars in 1154 bytes} [Sat Jan 15 20:49:16 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jan 15 20:49:16.737784 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4bc86938-ba7b-4126-886c-e35ff630b22c tempest-AggregatesAdminNegativeTestJSON-238846009 tempest-AggregatesAdminNegativeTestJSON-238846009-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:16.738652 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:16.738652 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:49:16.750622 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-4bc86938-ba7b-4126-886c-e35ff630b22c tempest-AggregatesAdminNegativeTestJSON-238846009 tempest-AggregatesAdminNegativeTestJSON-238846009-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Jan 15 20:49:16.752649 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4bc86938-ba7b-4126-886c-e35ff630b22c tempest-AggregatesAdminNegativeTestJSON-238846009 tempest-AggregatesAdminNegativeTestJSON-238846009-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:49:16.754953 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-4bc86938-ba7b-4126-886c-e35ff630b22c tempest-AggregatesAdminNegativeTestJSON-238846009 tempest-AggregatesAdminNegativeTestJSON-238846009-project-admin] 10.222.0.46 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.021047 Jan 15 20:49:16.755738 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 157/266] 10.222.0.46 () {58 vars in 1151 bytes} [Sat Jan 15 20:49:16 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jan 15 20:49:16.767182 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-55c1c5a5-e4d2-4ef9-808b-ab4fc3a37206 tempest-AggregatesAdminNegativeTestJSON-1894226231 tempest-AggregatesAdminNegativeTestJSON-1894226231-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:16.768827 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:16.768827 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:49:16.784600 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-55c1c5a5-e4d2-4ef9-808b-ab4fc3a37206 tempest-AggregatesAdminNegativeTestJSON-1894226231 tempest-AggregatesAdminNegativeTestJSON-1894226231-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '87b7045f39424d27b1f1d2b1b8292308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ab1e9106654fccab088c31f19c9eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:16.786756 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-55c1c5a5-e4d2-4ef9-808b-ab4fc3a37206 tempest-AggregatesAdminNegativeTestJSON-1894226231 tempest-AggregatesAdminNegativeTestJSON-1894226231-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:49:16.788659 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-55c1c5a5-e4d2-4ef9-808b-ab4fc3a37206 tempest-AggregatesAdminNegativeTestJSON-1894226231 tempest-AggregatesAdminNegativeTestJSON-1894226231-project] 10.222.0.46 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.025991 Jan 15 20:49:16.791783 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 110/267] 10.222.0.46 () {58 vars in 1142 bytes} [Sat Jan 15 20:49:16 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 30 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jan 15 20:49:16.804262 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-38f1cd6a-df32-4f9c-81ba-eb3e9ad18035 tempest-AggregatesAdminNegativeTestJSON-238846009 tempest-AggregatesAdminNegativeTestJSON-238846009-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1214876527"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:16.806240 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:16.806240 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:49:16.809941 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.objects.aggregate [None req-38f1cd6a-df32-4f9c-81ba-eb3e9ad18035 tempest-AggregatesAdminNegativeTestJSON-238846009 tempest-AggregatesAdminNegativeTestJSON-238846009-project-admin] Generated uuid 32a7cdb5-2e44-45cc-90c1-030f9bd43575 for aggregate {{(pid=129366) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jan 15 20:49:16.842665 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-38f1cd6a-df32-4f9c-81ba-eb3e9ad18035 tempest-AggregatesAdminNegativeTestJSON-238846009 tempest-AggregatesAdminNegativeTestJSON-238846009-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.043545 Jan 15 20:49:16.843750 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 158/268] 10.222.0.46 () {60 vars in 1163 bytes} [Sat Jan 15 20:49:16 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:49:16.856367 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-877e17bb-d40f-4600-b6aa-91199a473d4e tempest-AggregatesAdminNegativeTestJSON-238846009 tempest-AggregatesAdminNegativeTestJSON-238846009-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:16.857734 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:16.857734 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:49:16.881512 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-877e17bb-d40f-4600-b6aa-91199a473d4e tempest-AggregatesAdminNegativeTestJSON-238846009 tempest-AggregatesAdminNegativeTestJSON-238846009-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:16.883268 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-877e17bb-d40f-4600-b6aa-91199a473d4e tempest-AggregatesAdminNegativeTestJSON-238846009 tempest-AggregatesAdminNegativeTestJSON-238846009-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:16.911487 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-3f398a1c-7fbb-4c6e-920c-e276e885af59 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:16.912731 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-3f398a1c-7fbb-4c6e-920c-e276e885af59 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: 4d527369-954d-4ccc-9105-03b209d3523e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:16.920735 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3f398a1c-7fbb-4c6e-920c-e276e885af59 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:16.921626 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3f398a1c-7fbb-4c6e-920c-e276e885af59 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:16.922741 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3f398a1c-7fbb-4c6e-920c-e276e885af59 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:16.923337 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3f398a1c-7fbb-4c6e-920c-e276e885af59 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:17.128572 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-877e17bb-d40f-4600-b6aa-91199a473d4e tempest-AggregatesAdminNegativeTestJSON-238846009 tempest-AggregatesAdminNegativeTestJSON-238846009-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 243 microversion: 2.1 time: 0.278678 Jan 15 20:49:17.129400 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 111/269] 10.222.0.46 () {60 vars in 1193 bytes} [Sat Jan 15 20:49:16 2022] POST /compute/v2.1/os-aggregates/17/action => generated 243 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 20:49:17.134296 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d068a97a-5801-40f5-b7fc-57c3f363f954 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:17.134902 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d068a97a-5801-40f5-b7fc-57c3f363f954 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] [instance: 114ccb23-d953-4735-b61e-f0d62e19dce2] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:17.148146 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d068a97a-5801-40f5-b7fc-57c3f363f954 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:17.155509 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d068a97a-5801-40f5-b7fc-57c3f363f954 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:17.156459 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d068a97a-5801-40f5-b7fc-57c3f363f954 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:17.156957 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d068a97a-5801-40f5-b7fc-57c3f363f954 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:17.301359 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-d068a97a-5801-40f5-b7fc-57c3f363f954 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0079c95473594ee9ada5a4bc6820a111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac923ea754345a9b79457833bd72da4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:17.310570 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d068a97a-5801-40f5-b7fc-57c3f363f954 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] 10.222.0.46 "GET /compute/v2.1/servers/114ccb23-d953-4735-b61e-f0d62e19dce2" status: 200 len: 1278 microversion: 2.1 time: 0.180255 Jan 15 20:49:17.311460 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 112/270] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:17 2022] GET /compute/v2.1/servers/114ccb23-d953-4735-b61e-f0d62e19dce2 => generated 1278 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:17.315890 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a5dfb622-bd5e-43a5-9b49-f08206dbcaf0 tempest-AggregatesAdminNegativeTestJSON-1894226231 tempest-AggregatesAdminNegativeTestJSON-1894226231-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:17.317240 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:17.317240 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:49:17.317986 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-a5dfb622-bd5e-43a5-9b49-f08206dbcaf0 tempest-AggregatesAdminNegativeTestJSON-1894226231 tempest-AggregatesAdminNegativeTestJSON-1894226231-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '87b7045f39424d27b1f1d2b1b8292308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ab1e9106654fccab088c31f19c9eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:17.318627 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a5dfb622-bd5e-43a5-9b49-f08206dbcaf0 tempest-AggregatesAdminNegativeTestJSON-1894226231 tempest-AggregatesAdminNegativeTestJSON-1894226231-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:49:17.325679 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a5dfb622-bd5e-43a5-9b49-f08206dbcaf0 tempest-AggregatesAdminNegativeTestJSON-1894226231 tempest-AggregatesAdminNegativeTestJSON-1894226231-project] 10.222.0.46 "POST /compute/v2.1/os-aggregates/17/action" status: 403 len: 121 microversion: 2.1 time: 0.007036 Jan 15 20:49:17.325842 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 113/271] 10.222.0.46 () {60 vars in 1193 bytes} [Sat Jan 15 20:49:17 2022] POST /compute/v2.1/os-aggregates/17/action => generated 121 bytes in 14 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:49:17.333731 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ded7c372-e6b7-4694-91e4-fd3328ed12ae tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:17.334559 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ded7c372-e6b7-4694-91e4-fd3328ed12ae tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] [instance: 2b68335f-a94c-4801-8d8b-2fd387d1ced9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:17.350807 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ded7c372-e6b7-4694-91e4-fd3328ed12ae tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:17.352029 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ded7c372-e6b7-4694-91e4-fd3328ed12ae tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:17.352821 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ded7c372-e6b7-4694-91e4-fd3328ed12ae tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:17.353406 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ded7c372-e6b7-4694-91e4-fd3328ed12ae tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:17.450392 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-ded7c372-e6b7-4694-91e4-fd3328ed12ae tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957f85f9c6794cccad71c553fb607ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82c6b47c4140e390464b153d2fe865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:17.462213 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ded7c372-e6b7-4694-91e4-fd3328ed12ae tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] 10.222.0.46 "GET /compute/v2.1/servers/2b68335f-a94c-4801-8d8b-2fd387d1ced9" status: 200 len: 1271 microversion: 2.1 time: 0.135293 Jan 15 20:49:17.463330 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 114/272] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:17 2022] GET /compute/v2.1/servers/2b68335f-a94c-4801-8d8b-2fd387d1ced9 => generated 1271 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:17.470146 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-93bd8356-89ef-408b-b583-2d0aa0f81ffd tempest-AggregatesAdminNegativeTestJSON-238846009 tempest-AggregatesAdminNegativeTestJSON-238846009-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:17.471733 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:17.471733 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:49:17.485461 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-93bd8356-89ef-408b-b583-2d0aa0f81ffd tempest-AggregatesAdminNegativeTestJSON-238846009 tempest-AggregatesAdminNegativeTestJSON-238846009-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:17.485907 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-93bd8356-89ef-408b-b583-2d0aa0f81ffd tempest-AggregatesAdminNegativeTestJSON-238846009 tempest-AggregatesAdminNegativeTestJSON-238846009-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:17.534140 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-3f398a1c-7fbb-4c6e-920c-e276e885af59 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:17.551457 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-3f398a1c-7fbb-4c6e-920c-e276e885af59 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/4d527369-954d-4ccc-9105-03b209d3523e" status: 200 len: 1312 microversion: 2.1 time: 0.644773 Jan 15 20:49:17.552175 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 159/273] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:16 2022] GET /compute/v2.1/servers/4d527369-954d-4ccc-9105-03b209d3523e => generated 1312 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:17.557994 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ab594f6b-3fa0-430a-9a70-749361ed4a13 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:17.566973 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ab594f6b-3fa0-430a-9a70-749361ed4a13 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 98d0ca37-0175-44e2-8a1d-965cdc517daf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:17.578778 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ab594f6b-3fa0-430a-9a70-749361ed4a13 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:17.582277 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ab594f6b-3fa0-430a-9a70-749361ed4a13 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:17.585646 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ab594f6b-3fa0-430a-9a70-749361ed4a13 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:17.586511 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ab594f6b-3fa0-430a-9a70-749361ed4a13 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:17.666858 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-93bd8356-89ef-408b-b583-2d0aa0f81ffd tempest-AggregatesAdminNegativeTestJSON-238846009 tempest-AggregatesAdminNegativeTestJSON-238846009-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 228 microversion: 2.1 time: 0.202176 Jan 15 20:49:17.668759 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 115/274] 10.222.0.46 () {60 vars in 1193 bytes} [Sat Jan 15 20:49:17 2022] POST /compute/v2.1/os-aggregates/17/action => generated 228 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:49:17.694837 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-5177214c-def4-4cfb-a659-0b3e0184146d req-8f78fa37-9b5f-420f-8e85-c0fecdb3912b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d527369-954d-4ccc-9105-03b209d3523e", "name": "network-vif-plugged", "status": "completed", "tag": "8fbebb13-bd94-4e21-bda4-a22a2589b5db"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:17.704062 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:17.704062 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:49:17.731943 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-5177214c-def4-4cfb-a659-0b3e0184146d req-8f78fa37-9b5f-420f-8e85-c0fecdb3912b service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:17.733423 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-5177214c-def4-4cfb-a659-0b3e0184146d req-8f78fa37-9b5f-420f-8e85-c0fecdb3912b service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:17.769113 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-5177214c-def4-4cfb-a659-0b3e0184146d req-8f78fa37-9b5f-420f-8e85-c0fecdb3912b service nova] Creating event network-vif-plugged:8fbebb13-bd94-4e21-bda4-a22a2589b5db for instance 4d527369-954d-4ccc-9105-03b209d3523e on nch1-master-1 Jan 15 20:49:17.779607 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-5177214c-def4-4cfb-a659-0b3e0184146d req-8f78fa37-9b5f-420f-8e85-c0fecdb3912b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108193 Jan 15 20:49:17.780571 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 116/275] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:49:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:49:17.788406 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3245ea79-2190-4cc1-a815-f8c7824b5f60 tempest-AggregatesAdminNegativeTestJSON-238846009 tempest-AggregatesAdminNegativeTestJSON-238846009-project-admin] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:17.789276 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:17.789276 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:49:17.883376 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3245ea79-2190-4cc1-a815-f8c7824b5f60 tempest-AggregatesAdminNegativeTestJSON-238846009 tempest-AggregatesAdminNegativeTestJSON-238846009-project-admin] 10.222.0.46 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.101582 Jan 15 20:49:17.885298 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 117/276] 10.222.0.46 () {58 vars in 1154 bytes} [Sat Jan 15 20:49:17 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jan 15 20:49:17.892499 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3f606a6a-cacc-4752-97d6-e96002dbe790 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:17.894081 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-3f606a6a-cacc-4752-97d6-e96002dbe790 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] [instance: 5736e502-fb8b-43e0-8763-ec341d6f5953] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:17.903969 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3f606a6a-cacc-4752-97d6-e96002dbe790 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:17.904622 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3f606a6a-cacc-4752-97d6-e96002dbe790 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:17.905687 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3f606a6a-cacc-4752-97d6-e96002dbe790 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:17.906266 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3f606a6a-cacc-4752-97d6-e96002dbe790 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:18.238791 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-3f606a6a-cacc-4752-97d6-e96002dbe790 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4272283f80fd440c92c605310d8a441d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c9ae9cb7d2d4105a277bcaaf858b861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:18.242365 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-ab594f6b-3fa0-430a-9a70-749361ed4a13 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d60caf368842b2aec08f0f5e14353a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c95e4b5695439dbc3f66a911264026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:18.249644 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3f606a6a-cacc-4752-97d6-e96002dbe790 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] 10.222.0.46 "GET /compute/v2.1/servers/5736e502-fb8b-43e0-8763-ec341d6f5953" status: 200 len: 1472 microversion: 2.1 time: 0.363285 Jan 15 20:49:18.250585 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 118/277] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:17 2022] GET /compute/v2.1/servers/5736e502-fb8b-43e0-8763-ec341d6f5953 => generated 1472 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:18.266993 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ab594f6b-3fa0-430a-9a70-749361ed4a13 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "GET /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf" status: 200 len: 1589 microversion: 2.1 time: 0.712237 Jan 15 20:49:18.267545 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-6534d51f-1dd7-4ca2-a0fc-749597c7c04a tempest-AggregatesAdminNegativeTestJSON-238846009 tempest-AggregatesAdminNegativeTestJSON-238846009-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-272486215"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:18.269203 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:18.269203 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:49:18.270978 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.objects.aggregate [None req-6534d51f-1dd7-4ca2-a0fc-749597c7c04a tempest-AggregatesAdminNegativeTestJSON-238846009 tempest-AggregatesAdminNegativeTestJSON-238846009-project-admin] Generated uuid 01e27917-24ca-4d6d-96e8-06b8878bbdbf for aggregate {{(pid=129365) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jan 15 20:49:18.276242 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 160/278] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:17 2022] GET /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf => generated 1589 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:18.286944 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-6110c2ed-c4bc-4a9e-8507-4ebd3cb014b1 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:18.287504 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-6110c2ed-c4bc-4a9e-8507-4ebd3cb014b1 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 98d0ca37-0175-44e2-8a1d-965cdc517daf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:18.294678 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6110c2ed-c4bc-4a9e-8507-4ebd3cb014b1 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:18.295280 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6110c2ed-c4bc-4a9e-8507-4ebd3cb014b1 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:18.297537 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6110c2ed-c4bc-4a9e-8507-4ebd3cb014b1 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:18.299092 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6110c2ed-c4bc-4a9e-8507-4ebd3cb014b1 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:18.306618 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-6534d51f-1dd7-4ca2-a0fc-749597c7c04a tempest-AggregatesAdminNegativeTestJSON-238846009 tempest-AggregatesAdminNegativeTestJSON-238846009-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.043820 Jan 15 20:49:18.308284 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 119/279] 10.222.0.46 () {60 vars in 1163 bytes} [Sat Jan 15 20:49:18 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:49:18.321454 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-85b229ac-c1da-45c0-82ba-159d9d89e0ff tempest-AggregatesAdminNegativeTestJSON-238846009 tempest-AggregatesAdminNegativeTestJSON-238846009-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:18.323889 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:18.323889 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:49:18.335245 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-85b229ac-c1da-45c0-82ba-159d9d89e0ff tempest-AggregatesAdminNegativeTestJSON-238846009 tempest-AggregatesAdminNegativeTestJSON-238846009-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:18.336359 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-85b229ac-c1da-45c0-82ba-159d9d89e0ff tempest-AggregatesAdminNegativeTestJSON-238846009 tempest-AggregatesAdminNegativeTestJSON-238846009-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:18.348979 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-85b229ac-c1da-45c0-82ba-159d9d89e0ff tempest-AggregatesAdminNegativeTestJSON-238846009 tempest-AggregatesAdminNegativeTestJSON-238846009-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:18.357205 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-85b229ac-c1da-45c0-82ba-159d9d89e0ff tempest-AggregatesAdminNegativeTestJSON-238846009 tempest-AggregatesAdminNegativeTestJSON-238846009-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:18.386310 ncdv-master-1 devstack@n-api.service[129365]: ERROR nova.api.openstack.compute.aggregates [None req-85b229ac-c1da-45c0-82ba-159d9d89e0ff tempest-AggregatesAdminNegativeTestJSON-238846009 tempest-AggregatesAdminNegativeTestJSON-238846009-project-admin] Failed to remove host nonexist_host from aggregate 18. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Jan 15 20:49:18.387830 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-85b229ac-c1da-45c0-82ba-159d9d89e0ff tempest-AggregatesAdminNegativeTestJSON-238846009 tempest-AggregatesAdminNegativeTestJSON-238846009-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 18 Jan 15 20:49:18.388681 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-85b229ac-c1da-45c0-82ba-159d9d89e0ff tempest-AggregatesAdminNegativeTestJSON-238846009 tempest-AggregatesAdminNegativeTestJSON-238846009-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 18 {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:49:18.390444 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-85b229ac-c1da-45c0-82ba-159d9d89e0ff tempest-AggregatesAdminNegativeTestJSON-238846009 tempest-AggregatesAdminNegativeTestJSON-238846009-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates/18/action" status: 404 len: 94 microversion: 2.1 time: 0.072549 Jan 15 20:49:18.390444 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 120/280] 10.222.0.46 () {60 vars in 1193 bytes} [Sat Jan 15 20:49:18 2022] POST /compute/v2.1/os-aggregates/18/action => generated 94 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jan 15 20:49:18.408873 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-31da8988-8254-4696-9635-5fbbf11c011d tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:18.411046 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-31da8988-8254-4696-9635-5fbbf11c011d tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] [instance: 114ccb23-d953-4735-b61e-f0d62e19dce2] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:18.432385 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-31da8988-8254-4696-9635-5fbbf11c011d tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:18.433994 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-31da8988-8254-4696-9635-5fbbf11c011d tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:18.435538 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-31da8988-8254-4696-9635-5fbbf11c011d tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:18.437383 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-31da8988-8254-4696-9635-5fbbf11c011d tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:18.564373 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-31da8988-8254-4696-9635-5fbbf11c011d tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0079c95473594ee9ada5a4bc6820a111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac923ea754345a9b79457833bd72da4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:18.579755 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-31da8988-8254-4696-9635-5fbbf11c011d tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] 10.222.0.46 "GET /compute/v2.1/servers/114ccb23-d953-4735-b61e-f0d62e19dce2" status: 200 len: 1276 microversion: 2.1 time: 0.188002 Jan 15 20:49:18.581924 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 121/281] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:18 2022] GET /compute/v2.1/servers/114ccb23-d953-4735-b61e-f0d62e19dce2 => generated 1276 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:18.588940 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ee9c89b7-3b6c-40bd-8cc4-d9a3ce05b24d tempest-AggregatesAdminNegativeTestJSON-238846009 tempest-AggregatesAdminNegativeTestJSON-238846009-project-admin] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:18.590423 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:18.590423 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:49:18.645297 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ee9c89b7-3b6c-40bd-8cc4-d9a3ce05b24d tempest-AggregatesAdminNegativeTestJSON-238846009 tempest-AggregatesAdminNegativeTestJSON-238846009-project-admin] 10.222.0.46 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.061738 Jan 15 20:49:18.646070 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 122/282] 10.222.0.46 () {58 vars in 1154 bytes} [Sat Jan 15 20:49:18 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jan 15 20:49:18.655920 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b2946dfd-08be-46c3-8de3-9eae128cbf49 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:18.656540 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b2946dfd-08be-46c3-8de3-9eae128cbf49 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] [instance: 2b68335f-a94c-4801-8d8b-2fd387d1ced9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:18.664299 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b2946dfd-08be-46c3-8de3-9eae128cbf49 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:18.664746 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b2946dfd-08be-46c3-8de3-9eae128cbf49 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:18.665564 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b2946dfd-08be-46c3-8de3-9eae128cbf49 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:18.665995 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b2946dfd-08be-46c3-8de3-9eae128cbf49 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:18.727803 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-6110c2ed-c4bc-4a9e-8507-4ebd3cb014b1 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "GET /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.445196 Jan 15 20:49:18.728751 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 161/283] 10.222.0.46 () {58 vars in 1274 bytes} [Sat Jan 15 20:49:18 2022] GET /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/os-interface => generated 284 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:49:18.738116 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-6f257ed0-3835-4829-87ed-7a100725814e tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:18.738973 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-6f257ed0-3835-4829-87ed-7a100725814e tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: 4d527369-954d-4ccc-9105-03b209d3523e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:18.749271 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6f257ed0-3835-4829-87ed-7a100725814e tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:18.749907 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6f257ed0-3835-4829-87ed-7a100725814e tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:18.750850 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6f257ed0-3835-4829-87ed-7a100725814e tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:18.751430 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6f257ed0-3835-4829-87ed-7a100725814e tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:18.930832 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-b2946dfd-08be-46c3-8de3-9eae128cbf49 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957f85f9c6794cccad71c553fb607ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82c6b47c4140e390464b153d2fe865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:18.939624 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b2946dfd-08be-46c3-8de3-9eae128cbf49 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] 10.222.0.46 "GET /compute/v2.1/servers/2b68335f-a94c-4801-8d8b-2fd387d1ced9" status: 200 len: 1277 microversion: 2.1 time: 0.292398 Jan 15 20:49:18.946833 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 123/284] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:18 2022] GET /compute/v2.1/servers/2b68335f-a94c-4801-8d8b-2fd387d1ced9 => generated 1277 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:18.961494 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-560bc8d5-abcf-4906-adbd-db7a58e68f15 req-9d245a7f-b939-4c67-8456-c9d5de5ad959 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5736e502-fb8b-43e0-8763-ec341d6f5953", "name": "network-vif-deleted", "tag": "ab3b6f1e-5ff9-47f0-945c-77448dbe354e"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:18.963091 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:18.963091 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:49:18.973526 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-560bc8d5-abcf-4906-adbd-db7a58e68f15 req-9d245a7f-b939-4c67-8456-c9d5de5ad959 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:18.976029 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-560bc8d5-abcf-4906-adbd-db7a58e68f15 req-9d245a7f-b939-4c67-8456-c9d5de5ad959 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:19.003307 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-560bc8d5-abcf-4906-adbd-db7a58e68f15 req-9d245a7f-b939-4c67-8456-c9d5de5ad959 service nova] Creating event network-vif-deleted:ab3b6f1e-5ff9-47f0-945c-77448dbe354e for instance 5736e502-fb8b-43e0-8763-ec341d6f5953 on nch2-master-1 Jan 15 20:49:19.021773 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-560bc8d5-abcf-4906-adbd-db7a58e68f15 req-9d245a7f-b939-4c67-8456-c9d5de5ad959 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073095 Jan 15 20:49:19.027138 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 124/285] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:49:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:49:19.294788 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5e099f2f-fb71-4f5b-8982-ebd77fa29bb8 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:19.304971 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-5e099f2f-fb71-4f5b-8982-ebd77fa29bb8 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] [instance: 5736e502-fb8b-43e0-8763-ec341d6f5953] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:19.371587 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5e099f2f-fb71-4f5b-8982-ebd77fa29bb8 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:19.382158 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5e099f2f-fb71-4f5b-8982-ebd77fa29bb8 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:19.384832 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5e099f2f-fb71-4f5b-8982-ebd77fa29bb8 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:19.387998 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5e099f2f-fb71-4f5b-8982-ebd77fa29bb8 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:19.452229 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5e099f2f-fb71-4f5b-8982-ebd77fa29bb8 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:19.453339 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5e099f2f-fb71-4f5b-8982-ebd77fa29bb8 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:19.454376 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.objects.instance [None req-5e099f2f-fb71-4f5b-8982-ebd77fa29bb8 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Lazy-loading 'fault' on Instance uuid 5736e502-fb8b-43e0-8763-ec341d6f5953 {{(pid=129365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 20:49:19.459818 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-6f257ed0-3835-4829-87ed-7a100725814e tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:19.467967 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-6f257ed0-3835-4829-87ed-7a100725814e tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/4d527369-954d-4ccc-9105-03b209d3523e" status: 200 len: 1312 microversion: 2.1 time: 0.737999 Jan 15 20:49:19.468548 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 162/286] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:18 2022] GET /compute/v2.1/servers/4d527369-954d-4ccc-9105-03b209d3523e => generated 1312 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:19.578468 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-5e099f2f-fb71-4f5b-8982-ebd77fa29bb8 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4272283f80fd440c92c605310d8a441d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c9ae9cb7d2d4105a277bcaaf858b861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:19.603076 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8edc9f52-9543-46c7-98c2-3b90574095f5 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:19.605956 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-8edc9f52-9543-46c7-98c2-3b90574095f5 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] [instance: 114ccb23-d953-4735-b61e-f0d62e19dce2] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:19.619948 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5e099f2f-fb71-4f5b-8982-ebd77fa29bb8 tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] 10.222.0.46 "GET /compute/v2.1/servers/5736e502-fb8b-43e0-8763-ec341d6f5953" status: 200 len: 1306 microversion: 2.1 time: 0.326882 Jan 15 20:49:19.634190 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8edc9f52-9543-46c7-98c2-3b90574095f5 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:19.634865 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8edc9f52-9543-46c7-98c2-3b90574095f5 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:19.636514 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8edc9f52-9543-46c7-98c2-3b90574095f5 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:19.637205 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8edc9f52-9543-46c7-98c2-3b90574095f5 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:19.642196 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 125/287] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:19 2022] GET /compute/v2.1/servers/5736e502-fb8b-43e0-8763-ec341d6f5953 => generated 1306 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:19.963447 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-77c6ebb4-92ca-44e1-bd85-b8527b1fdeee tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:19.964115 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-77c6ebb4-92ca-44e1-bd85-b8527b1fdeee tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] [instance: 2b68335f-a94c-4801-8d8b-2fd387d1ced9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:19.974782 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-77c6ebb4-92ca-44e1-bd85-b8527b1fdeee tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:19.974997 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-77c6ebb4-92ca-44e1-bd85-b8527b1fdeee tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:19.976750 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-77c6ebb4-92ca-44e1-bd85-b8527b1fdeee tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:19.977414 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-77c6ebb4-92ca-44e1-bd85-b8527b1fdeee tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:20.536564 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-8edc9f52-9543-46c7-98c2-3b90574095f5 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0079c95473594ee9ada5a4bc6820a111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac923ea754345a9b79457833bd72da4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:20.544947 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-8edc9f52-9543-46c7-98c2-3b90574095f5 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] 10.222.0.46 "GET /compute/v2.1/servers/114ccb23-d953-4735-b61e-f0d62e19dce2" status: 200 len: 1318 microversion: 2.1 time: 0.948759 Jan 15 20:49:20.547553 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 163/288] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:19 2022] GET /compute/v2.1/servers/114ccb23-d953-4735-b61e-f0d62e19dce2 => generated 1318 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:20.553164 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-84c44516-8037-45d6-bfa0-a0416b0c6654 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:20.557387 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-84c44516-8037-45d6-bfa0-a0416b0c6654 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: 4d527369-954d-4ccc-9105-03b209d3523e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:20.570295 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-84c44516-8037-45d6-bfa0-a0416b0c6654 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:20.570761 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-84c44516-8037-45d6-bfa0-a0416b0c6654 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:20.572521 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-84c44516-8037-45d6-bfa0-a0416b0c6654 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:20.572991 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-84c44516-8037-45d6-bfa0-a0416b0c6654 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:20.986238 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-77c6ebb4-92ca-44e1-bd85-b8527b1fdeee tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957f85f9c6794cccad71c553fb607ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82c6b47c4140e390464b153d2fe865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:20.997226 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-77c6ebb4-92ca-44e1-bd85-b8527b1fdeee tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] 10.222.0.46 "GET /compute/v2.1/servers/2b68335f-a94c-4801-8d8b-2fd387d1ced9" status: 200 len: 1319 microversion: 2.1 time: 1.037326 Jan 15 20:49:21.007255 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 126/289] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:19 2022] GET /compute/v2.1/servers/2b68335f-a94c-4801-8d8b-2fd387d1ced9 => generated 1319 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:49:21.012929 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-1e6c8aa6-2dc7-48fd-8eec-808e7208a05d tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:21.013739 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-1e6c8aa6-2dc7-48fd-8eec-808e7208a05d tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] [instance: 5736e502-fb8b-43e0-8763-ec341d6f5953] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:21.019978 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1e6c8aa6-2dc7-48fd-8eec-808e7208a05d tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:21.020620 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1e6c8aa6-2dc7-48fd-8eec-808e7208a05d tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:21.021607 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1e6c8aa6-2dc7-48fd-8eec-808e7208a05d tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:21.022179 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1e6c8aa6-2dc7-48fd-8eec-808e7208a05d tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:21.037282 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-1e6c8aa6-2dc7-48fd-8eec-808e7208a05d tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] HTTP exception thrown: Instance 5736e502-fb8b-43e0-8763-ec341d6f5953 could not be found. Jan 15 20:49:21.038279 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-1e6c8aa6-2dc7-48fd-8eec-808e7208a05d tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] Returning 404 to user: Instance 5736e502-fb8b-43e0-8763-ec341d6f5953 could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:49:21.039322 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-1e6c8aa6-2dc7-48fd-8eec-808e7208a05d tempest-AggregatesAdminTestJSON-963610503 tempest-AggregatesAdminTestJSON-963610503-project] 10.222.0.46 "GET /compute/v2.1/servers/5736e502-fb8b-43e0-8763-ec341d6f5953" status: 404 len: 111 microversion: 2.1 time: 0.030810 Jan 15 20:49:21.040022 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 127/290] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:21 2022] GET /compute/v2.1/servers/5736e502-fb8b-43e0-8763-ec341d6f5953 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:49:21.347608 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-84c44516-8037-45d6-bfa0-a0416b0c6654 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:21.364221 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-84c44516-8037-45d6-bfa0-a0416b0c6654 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/4d527369-954d-4ccc-9105-03b209d3523e" status: 200 len: 1462 microversion: 2.1 time: 0.815634 Jan 15 20:49:21.378276 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-80826b75-b7ac-47a1-aab0-b80f8dbaf2bd tempest-HypervisorAdminTestJSON-967183866 tempest-HypervisorAdminTestJSON-967183866-project-admin] Calling method '.version_select at 0x7f30c984e5e0>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:21.379411 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:21.379411 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:49:21.381312 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-80826b75-b7ac-47a1-aab0-b80f8dbaf2bd tempest-HypervisorAdminTestJSON-967183866 tempest-HypervisorAdminTestJSON-967183866-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:21.381995 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-80826b75-b7ac-47a1-aab0-b80f8dbaf2bd tempest-HypervisorAdminTestJSON-967183866 tempest-HypervisorAdminTestJSON-967183866-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:21.385695 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 164/291] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:20 2022] GET /compute/v2.1/servers/4d527369-954d-4ccc-9105-03b209d3523e => generated 1462 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:21.409163 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-3d5db474-dd1c-43a9-9542-3279a26739a6 req-e7fb90e2-e161-4e95-9cde-7bf4c331a27e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b68335f-a94c-4801-8d8b-2fd387d1ced9", "tag": "83c60043-b7da-47fc-8806-0fb74103c15c"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:21.411279 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:21.411279 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:49:21.412671 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-80826b75-b7ac-47a1-aab0-b80f8dbaf2bd tempest-HypervisorAdminTestJSON-967183866 tempest-HypervisorAdminTestJSON-967183866-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:21.414731 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-80826b75-b7ac-47a1-aab0-b80f8dbaf2bd tempest-HypervisorAdminTestJSON-967183866 tempest-HypervisorAdminTestJSON-967183866-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:21.423938 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-3d5db474-dd1c-43a9-9542-3279a26739a6 req-e7fb90e2-e161-4e95-9cde-7bf4c331a27e service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:21.424695 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-3d5db474-dd1c-43a9-9542-3279a26739a6 req-e7fb90e2-e161-4e95-9cde-7bf4c331a27e service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:21.440911 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-3d5db474-dd1c-43a9-9542-3279a26739a6 req-e7fb90e2-e161-4e95-9cde-7bf4c331a27e service nova] Creating event network-changed:83c60043-b7da-47fc-8806-0fb74103c15c for instance 2b68335f-a94c-4801-8d8b-2fd387d1ced9 on nch1-master-1 Jan 15 20:49:21.442496 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-80826b75-b7ac-47a1-aab0-b80f8dbaf2bd tempest-HypervisorAdminTestJSON-967183866 tempest-HypervisorAdminTestJSON-967183866-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:21.443323 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-80826b75-b7ac-47a1-aab0-b80f8dbaf2bd tempest-HypervisorAdminTestJSON-967183866 tempest-HypervisorAdminTestJSON-967183866-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:21.447780 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-3d5db474-dd1c-43a9-9542-3279a26739a6 req-e7fb90e2-e161-4e95-9cde-7bf4c331a27e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061084 Jan 15 20:49:21.449878 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 165/292] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:49:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:49:21.460933 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-80826b75-b7ac-47a1-aab0-b80f8dbaf2bd tempest-HypervisorAdminTestJSON-967183866 tempest-HypervisorAdminTestJSON-967183866-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.317234 Jan 15 20:49:21.465196 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 128/293] 10.222.0.46 () {58 vars in 1145 bytes} [Sat Jan 15 20:49:21 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 20:49:21.474058 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-32493734-95ee-4309-8d71-f9ff9861dd3f tempest-HypervisorAdminTestJSON-967183866 tempest-HypervisorAdminTestJSON-967183866-project-admin] Calling method '.version_select at 0x7f30c984e4c0>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:21.474984 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:21.474984 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:49:21.478167 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-32493734-95ee-4309-8d71-f9ff9861dd3f tempest-HypervisorAdminTestJSON-967183866 tempest-HypervisorAdminTestJSON-967183866-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:21.479156 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-32493734-95ee-4309-8d71-f9ff9861dd3f tempest-HypervisorAdminTestJSON-967183866 tempest-HypervisorAdminTestJSON-967183866-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:21.501909 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-32493734-95ee-4309-8d71-f9ff9861dd3f tempest-HypervisorAdminTestJSON-967183866 tempest-HypervisorAdminTestJSON-967183866-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:21.503310 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-32493734-95ee-4309-8d71-f9ff9861dd3f tempest-HypervisorAdminTestJSON-967183866 tempest-HypervisorAdminTestJSON-967183866-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:21.529994 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-32493734-95ee-4309-8d71-f9ff9861dd3f tempest-HypervisorAdminTestJSON-967183866 tempest-HypervisorAdminTestJSON-967183866-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:21.530816 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-32493734-95ee-4309-8d71-f9ff9861dd3f tempest-HypervisorAdminTestJSON-967183866 tempest-HypervisorAdminTestJSON-967183866-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:21.554742 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-32493734-95ee-4309-8d71-f9ff9861dd3f tempest-HypervisorAdminTestJSON-967183866 tempest-HypervisorAdminTestJSON-967183866-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1505 microversion: 2.1 time: 0.083639 Jan 15 20:49:21.566043 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 129/294] 10.222.0.46 () {58 vars in 1166 bytes} [Sat Jan 15 20:49:21 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1505 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:21.575531 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-0c849c67-3844-43f0-86be-770380270c76 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:21.576438 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-0c849c67-3844-43f0-86be-770380270c76 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] [instance: 114ccb23-d953-4735-b61e-f0d62e19dce2] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:21.591333 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0c849c67-3844-43f0-86be-770380270c76 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:21.591719 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0c849c67-3844-43f0-86be-770380270c76 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:21.592572 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0c849c67-3844-43f0-86be-770380270c76 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:21.593057 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0c849c67-3844-43f0-86be-770380270c76 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:21.808177 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d62a3cea-6e86-45e3-a81c-b03c7a2394f8 tempest-MigrationsAdminTest-1503274595 tempest-MigrationsAdminTest-1503274595-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:21.809755 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-d62a3cea-6e86-45e3-a81c-b03c7a2394f8 tempest-MigrationsAdminTest-1503274595 tempest-MigrationsAdminTest-1503274595-project-admin] [instance: 4d527369-954d-4ccc-9105-03b209d3523e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:21.833465 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d62a3cea-6e86-45e3-a81c-b03c7a2394f8 tempest-MigrationsAdminTest-1503274595 tempest-MigrationsAdminTest-1503274595-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:21.836939 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d62a3cea-6e86-45e3-a81c-b03c7a2394f8 tempest-MigrationsAdminTest-1503274595 tempest-MigrationsAdminTest-1503274595-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:21.838306 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d62a3cea-6e86-45e3-a81c-b03c7a2394f8 tempest-MigrationsAdminTest-1503274595 tempest-MigrationsAdminTest-1503274595-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:21.838748 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d62a3cea-6e86-45e3-a81c-b03c7a2394f8 tempest-MigrationsAdminTest-1503274595 tempest-MigrationsAdminTest-1503274595-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:22.283073 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-0c849c67-3844-43f0-86be-770380270c76 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0079c95473594ee9ada5a4bc6820a111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac923ea754345a9b79457833bd72da4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:22.294767 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-0c849c67-3844-43f0-86be-770380270c76 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] 10.222.0.46 "GET /compute/v2.1/servers/114ccb23-d953-4735-b61e-f0d62e19dce2" status: 200 len: 1318 microversion: 2.1 time: 0.725914 Jan 15 20:49:22.295773 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 130/295] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:21 2022] GET /compute/v2.1/servers/114ccb23-d953-4735-b61e-f0d62e19dce2 => generated 1318 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:22.301606 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-67208240-dbaa-45e0-b7dc-8362993f4f65 tempest-HypervisorAdminTestJSON-967183866 tempest-HypervisorAdminTestJSON-967183866-project-admin] Calling method '.version_select at 0x7f30c9af40d0>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:22.302617 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:22.302617 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:49:22.304335 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-67208240-dbaa-45e0-b7dc-8362993f4f65 tempest-HypervisorAdminTestJSON-967183866 tempest-HypervisorAdminTestJSON-967183866-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:22.312324 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-67208240-dbaa-45e0-b7dc-8362993f4f65 tempest-HypervisorAdminTestJSON-967183866 tempest-HypervisorAdminTestJSON-967183866-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:22.335199 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-67208240-dbaa-45e0-b7dc-8362993f4f65 tempest-HypervisorAdminTestJSON-967183866 tempest-HypervisorAdminTestJSON-967183866-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:22.337043 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-67208240-dbaa-45e0-b7dc-8362993f4f65 tempest-HypervisorAdminTestJSON-967183866 tempest-HypervisorAdminTestJSON-967183866-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:22.361725 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-67208240-dbaa-45e0-b7dc-8362993f4f65 tempest-HypervisorAdminTestJSON-967183866 tempest-HypervisorAdminTestJSON-967183866-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:22.362419 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-67208240-dbaa-45e0-b7dc-8362993f4f65 tempest-HypervisorAdminTestJSON-967183866 tempest-HypervisorAdminTestJSON-967183866-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:22.370608 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-67208240-dbaa-45e0-b7dc-8362993f4f65 tempest-HypervisorAdminTestJSON-967183866 tempest-HypervisorAdminTestJSON-967183866-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.073359 Jan 15 20:49:22.380664 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 131/296] 10.222.0.46 () {58 vars in 1145 bytes} [Sat Jan 15 20:49:22 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:49:22.391324 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-15290639-f8eb-4f99-ba67-0feadbed02d7 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:22.399830 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-15290639-f8eb-4f99-ba67-0feadbed02d7 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] [instance: 2b68335f-a94c-4801-8d8b-2fd387d1ced9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:22.413961 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-15290639-f8eb-4f99-ba67-0feadbed02d7 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:22.414564 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-15290639-f8eb-4f99-ba67-0feadbed02d7 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:22.415501 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-15290639-f8eb-4f99-ba67-0feadbed02d7 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:22.416081 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-15290639-f8eb-4f99-ba67-0feadbed02d7 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:23.033796 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d62a3cea-6e86-45e3-a81c-b03c7a2394f8 tempest-MigrationsAdminTest-1503274595 tempest-MigrationsAdminTest-1503274595-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/4d527369-954d-4ccc-9105-03b209d3523e" status: 200 len: 1613 microversion: 2.1 time: 1.582302 Jan 15 20:49:23.037286 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 166/297] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:21 2022] GET /compute/v2.1/servers/4d527369-954d-4ccc-9105-03b209d3523e => generated 1613 bytes in 1587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:23.052369 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0cd8d675-6bff-4806-b1ab-105790a0e909 tempest-HypervisorAdminTestJSON-967183866 tempest-HypervisorAdminTestJSON-967183866-project-admin] Calling method '.version_select at 0x7f30c9b0b670>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:23.056025 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:23.056025 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:49:23.060580 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0cd8d675-6bff-4806-b1ab-105790a0e909 tempest-HypervisorAdminTestJSON-967183866 tempest-HypervisorAdminTestJSON-967183866-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:23.062352 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0cd8d675-6bff-4806-b1ab-105790a0e909 tempest-HypervisorAdminTestJSON-967183866 tempest-HypervisorAdminTestJSON-967183866-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:23.102646 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0cd8d675-6bff-4806-b1ab-105790a0e909 tempest-HypervisorAdminTestJSON-967183866 tempest-HypervisorAdminTestJSON-967183866-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:23.103103 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0cd8d675-6bff-4806-b1ab-105790a0e909 tempest-HypervisorAdminTestJSON-967183866 tempest-HypervisorAdminTestJSON-967183866-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:23.122367 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0cd8d675-6bff-4806-b1ab-105790a0e909 tempest-HypervisorAdminTestJSON-967183866 tempest-HypervisorAdminTestJSON-967183866-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.082368 Jan 15 20:49:23.126027 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 167/298] 10.222.0.46 () {58 vars in 1151 bytes} [Sat Jan 15 20:49:23 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:49:23.140140 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-553bf219-1851-4b42-8654-39754a93bb8b tempest-MigrationsAdminTest-1503274595 tempest-MigrationsAdminTest-1503274595-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:23.140591 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-553bf219-1851-4b42-8654-39754a93bb8b tempest-MigrationsAdminTest-1503274595 tempest-MigrationsAdminTest-1503274595-project-admin] [instance: 4d527369-954d-4ccc-9105-03b209d3523e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:23.159691 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-553bf219-1851-4b42-8654-39754a93bb8b tempest-MigrationsAdminTest-1503274595 tempest-MigrationsAdminTest-1503274595-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:23.160216 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-553bf219-1851-4b42-8654-39754a93bb8b tempest-MigrationsAdminTest-1503274595 tempest-MigrationsAdminTest-1503274595-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:23.166760 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-553bf219-1851-4b42-8654-39754a93bb8b tempest-MigrationsAdminTest-1503274595 tempest-MigrationsAdminTest-1503274595-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:23.166760 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-553bf219-1851-4b42-8654-39754a93bb8b tempest-MigrationsAdminTest-1503274595 tempest-MigrationsAdminTest-1503274595-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:23.178017 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-15290639-f8eb-4f99-ba67-0feadbed02d7 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957f85f9c6794cccad71c553fb607ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82c6b47c4140e390464b153d2fe865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:23.187026 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-15290639-f8eb-4f99-ba67-0feadbed02d7 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] 10.222.0.46 "GET /compute/v2.1/servers/2b68335f-a94c-4801-8d8b-2fd387d1ced9" status: 200 len: 1319 microversion: 2.1 time: 0.804473 Jan 15 20:49:23.191464 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 132/299] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:22 2022] GET /compute/v2.1/servers/2b68335f-a94c-4801-8d8b-2fd387d1ced9 => generated 1319 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:23.218919 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a57409e8-ce1b-4f7e-b1a6-aa80964d7a95 tempest-HypervisorAdminTestJSON-967183866 tempest-HypervisorAdminTestJSON-967183866-project-admin] Calling method '.version_select at 0x7f30c984ef70>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:23.219724 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:23.219724 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:49:23.221208 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a57409e8-ce1b-4f7e-b1a6-aa80964d7a95 tempest-HypervisorAdminTestJSON-967183866 tempest-HypervisorAdminTestJSON-967183866-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:23.235848 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a57409e8-ce1b-4f7e-b1a6-aa80964d7a95 tempest-HypervisorAdminTestJSON-967183866 tempest-HypervisorAdminTestJSON-967183866-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:23.304522 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a57409e8-ce1b-4f7e-b1a6-aa80964d7a95 tempest-HypervisorAdminTestJSON-967183866 tempest-HypervisorAdminTestJSON-967183866-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.109967 Jan 15 20:49:23.317688 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 133/300] 10.222.0.46 () {58 vars in 1178 bytes} [Sat Jan 15 20:49:23 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:49:23.322424 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-f4578f5d-2e90-4ce8-8861-ac32316496d3 req-6f02b118-bcde-4dd6-883c-d9ddbffaced8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "114ccb23-d953-4735-b61e-f0d62e19dce2", "tag": "dabee046-cd8e-45f7-9b2d-67a08fbc1ace"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:23.328081 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:23.328081 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:49:23.348035 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-f4578f5d-2e90-4ce8-8861-ac32316496d3 req-6f02b118-bcde-4dd6-883c-d9ddbffaced8 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:23.348456 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-f4578f5d-2e90-4ce8-8861-ac32316496d3 req-6f02b118-bcde-4dd6-883c-d9ddbffaced8 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:23.383063 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-f4578f5d-2e90-4ce8-8861-ac32316496d3 req-6f02b118-bcde-4dd6-883c-d9ddbffaced8 service nova] Creating event network-changed:dabee046-cd8e-45f7-9b2d-67a08fbc1ace for instance 114ccb23-d953-4735-b61e-f0d62e19dce2 on nch1-master-1 Jan 15 20:49:23.393652 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-f4578f5d-2e90-4ce8-8861-ac32316496d3 req-6f02b118-bcde-4dd6-883c-d9ddbffaced8 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074642 Jan 15 20:49:23.399055 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 134/301] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:49:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:49:23.411763 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ac490418-9078-4144-b19c-40a592432964 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:23.412799 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ac490418-9078-4144-b19c-40a592432964 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 98d0ca37-0175-44e2-8a1d-965cdc517daf] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:23.426545 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ac490418-9078-4144-b19c-40a592432964 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:23.426994 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ac490418-9078-4144-b19c-40a592432964 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:23.427786 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ac490418-9078-4144-b19c-40a592432964 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:23.428212 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ac490418-9078-4144-b19c-40a592432964 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:23.428741 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-553bf219-1851-4b42-8654-39754a93bb8b tempest-MigrationsAdminTest-1503274595 tempest-MigrationsAdminTest-1503274595-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '555abb28cee245bb8a7d6574dc498445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2918f33afb6a4ef4a03edd106f9057d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:23.429376 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-553bf219-1851-4b42-8654-39754a93bb8b tempest-MigrationsAdminTest-1503274595 tempest-MigrationsAdminTest-1503274595-project-admin] [instance: 4d527369-954d-4ccc-9105-03b209d3523e] flavor_id is None. Assuming migration. {{(pid=129366) resize /opt/stack/nova/nova/compute/api.py:4073}} Jan 15 20:49:23.430000 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-553bf219-1851-4b42-8654-39754a93bb8b tempest-MigrationsAdminTest-1503274595 tempest-MigrationsAdminTest-1503274595-project-admin] [instance: 4d527369-954d-4ccc-9105-03b209d3523e] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=129366) resize /opt/stack/nova/nova/compute/api.py:4097}} Jan 15 20:49:23.531982 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ac490418-9078-4144-b19c-40a592432964 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action" status: 200 len: 14 microversion: 2.1 time: 0.128052 Jan 15 20:49:23.536330 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 135/302] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:49:23 2022] POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action => generated 14 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 20:49:23.541774 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-75428b5c-81bb-46fb-b8ff-62b394da102c tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:23.553883 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-75428b5c-81bb-46fb-b8ff-62b394da102c tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] [instance: 114ccb23-d953-4735-b61e-f0d62e19dce2] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:23.565945 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-75428b5c-81bb-46fb-b8ff-62b394da102c tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:23.567126 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-75428b5c-81bb-46fb-b8ff-62b394da102c tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:23.568093 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-75428b5c-81bb-46fb-b8ff-62b394da102c tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:23.568679 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-75428b5c-81bb-46fb-b8ff-62b394da102c tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:23.854795 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-75428b5c-81bb-46fb-b8ff-62b394da102c tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0079c95473594ee9ada5a4bc6820a111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac923ea754345a9b79457833bd72da4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:23.863920 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-75428b5c-81bb-46fb-b8ff-62b394da102c tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] 10.222.0.46 "GET /compute/v2.1/servers/114ccb23-d953-4735-b61e-f0d62e19dce2" status: 200 len: 1318 microversion: 2.1 time: 0.326087 Jan 15 20:49:23.871554 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 136/303] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:23 2022] GET /compute/v2.1/servers/114ccb23-d953-4735-b61e-f0d62e19dce2 => generated 1318 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:23.885430 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f2f2553b-8c66-4594-8826-9921edcc7323 tempest-HypervisorAdminTestJSON-967183866 tempest-HypervisorAdminTestJSON-967183866-project-admin] Calling method '.version_select at 0x7f30c97f80d0>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:23.886320 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:23.886320 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:49:23.893092 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f2f2553b-8c66-4594-8826-9921edcc7323 tempest-HypervisorAdminTestJSON-967183866 tempest-HypervisorAdminTestJSON-967183866-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:23.903003 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f2f2553b-8c66-4594-8826-9921edcc7323 tempest-HypervisorAdminTestJSON-967183866 tempest-HypervisorAdminTestJSON-967183866-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:23.927141 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f2f2553b-8c66-4594-8826-9921edcc7323 tempest-HypervisorAdminTestJSON-967183866 tempest-HypervisorAdminTestJSON-967183866-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:23.927796 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f2f2553b-8c66-4594-8826-9921edcc7323 tempest-HypervisorAdminTestJSON-967183866 tempest-HypervisorAdminTestJSON-967183866-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:23.953032 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f2f2553b-8c66-4594-8826-9921edcc7323 tempest-HypervisorAdminTestJSON-967183866 tempest-HypervisorAdminTestJSON-967183866-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:23.953712 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f2f2553b-8c66-4594-8826-9921edcc7323 tempest-HypervisorAdminTestJSON-967183866 tempest-HypervisorAdminTestJSON-967183866-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:23.960188 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f2f2553b-8c66-4594-8826-9921edcc7323 tempest-HypervisorAdminTestJSON-967183866 tempest-HypervisorAdminTestJSON-967183866-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.079266 Jan 15 20:49:23.965822 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 137/304] 10.222.0.46 () {58 vars in 1145 bytes} [Sat Jan 15 20:49:23 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:49:23.974677 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-80e68d02-2e77-48b0-b80b-fd470919e61e tempest-HypervisorAdminTestJSON-967183866 tempest-HypervisorAdminTestJSON-967183866-project-admin] Calling method '.version_select at 0x7f30c984e0d0>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:23.977471 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:23.977471 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:49:23.983292 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-80e68d02-2e77-48b0-b80b-fd470919e61e tempest-HypervisorAdminTestJSON-967183866 tempest-HypervisorAdminTestJSON-967183866-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:23.985053 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-80e68d02-2e77-48b0-b80b-fd470919e61e tempest-HypervisorAdminTestJSON-967183866 tempest-HypervisorAdminTestJSON-967183866-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:24.034178 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-80e68d02-2e77-48b0-b80b-fd470919e61e tempest-HypervisorAdminTestJSON-967183866 tempest-HypervisorAdminTestJSON-967183866-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:24.034656 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-80e68d02-2e77-48b0-b80b-fd470919e61e tempest-HypervisorAdminTestJSON-967183866 tempest-HypervisorAdminTestJSON-967183866-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:24.055216 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-80e68d02-2e77-48b0-b80b-fd470919e61e tempest-HypervisorAdminTestJSON-967183866 tempest-HypervisorAdminTestJSON-967183866-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.083855 Jan 15 20:49:24.056467 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 138/305] 10.222.0.46 () {58 vars in 1151 bytes} [Sat Jan 15 20:49:23 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:49:24.070241 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-26afbdce-2c67-4b3d-a01d-d4d8516cdae5 tempest-HypervisorAdminTestJSON-967183866 tempest-HypervisorAdminTestJSON-967183866-project-admin] Calling method '.version_select at 0x7f30c984ea60>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:24.070982 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:24.070982 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:49:24.073310 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-26afbdce-2c67-4b3d-a01d-d4d8516cdae5 tempest-HypervisorAdminTestJSON-967183866 tempest-HypervisorAdminTestJSON-967183866-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:24.073973 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-26afbdce-2c67-4b3d-a01d-d4d8516cdae5 tempest-HypervisorAdminTestJSON-967183866 tempest-HypervisorAdminTestJSON-967183866-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:24.097779 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-26afbdce-2c67-4b3d-a01d-d4d8516cdae5 tempest-HypervisorAdminTestJSON-967183866 tempest-HypervisorAdminTestJSON-967183866-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:24.097967 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-26afbdce-2c67-4b3d-a01d-d4d8516cdae5 tempest-HypervisorAdminTestJSON-967183866 tempest-HypervisorAdminTestJSON-967183866-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:24.106247 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-26afbdce-2c67-4b3d-a01d-d4d8516cdae5 tempest-HypervisorAdminTestJSON-967183866 tempest-HypervisorAdminTestJSON-967183866-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 758 microversion: 2.1 time: 0.039860 Jan 15 20:49:24.107395 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 139/306] 10.222.0.46 () {58 vars in 1151 bytes} [Sat Jan 15 20:49:24 2022] GET /compute/v2.1/os-hypervisors/2 => generated 758 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 20:49:24.122788 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-77467d94-5c5d-4d9c-bb0a-67dc911e7759 tempest-HypervisorAdminTestJSON-967183866 tempest-HypervisorAdminTestJSON-967183866-project-admin] Calling method '.version_select at 0x7f30c97b2c10>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:24.125427 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:24.125427 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:49:24.131224 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-77467d94-5c5d-4d9c-bb0a-67dc911e7759 tempest-HypervisorAdminTestJSON-967183866 tempest-HypervisorAdminTestJSON-967183866-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:24.131951 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-77467d94-5c5d-4d9c-bb0a-67dc911e7759 tempest-HypervisorAdminTestJSON-967183866 tempest-HypervisorAdminTestJSON-967183866-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:24.198266 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-77467d94-5c5d-4d9c-bb0a-67dc911e7759 tempest-HypervisorAdminTestJSON-967183866 tempest-HypervisorAdminTestJSON-967183866-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:24.203444 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-77467d94-5c5d-4d9c-bb0a-67dc911e7759 tempest-HypervisorAdminTestJSON-967183866 tempest-HypervisorAdminTestJSON-967183866-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:24.243257 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-77467d94-5c5d-4d9c-bb0a-67dc911e7759 tempest-HypervisorAdminTestJSON-967183866 tempest-HypervisorAdminTestJSON-967183866-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:24.244956 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-77467d94-5c5d-4d9c-bb0a-67dc911e7759 tempest-HypervisorAdminTestJSON-967183866 tempest-HypervisorAdminTestJSON-967183866-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:24.280752 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-77467d94-5c5d-4d9c-bb0a-67dc911e7759 tempest-HypervisorAdminTestJSON-967183866 tempest-HypervisorAdminTestJSON-967183866-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.164653 Jan 15 20:49:24.285177 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 140/307] 10.222.0.46 () {58 vars in 1172 bytes} [Sat Jan 15 20:49:24 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:49:24.316500 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-1631a0a7-76d4-49da-ba58-76f3e49ccf9e tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:24.317266 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-1631a0a7-76d4-49da-ba58-76f3e49ccf9e tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] [instance: 2b68335f-a94c-4801-8d8b-2fd387d1ced9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:24.349853 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1631a0a7-76d4-49da-ba58-76f3e49ccf9e tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:24.350312 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1631a0a7-76d4-49da-ba58-76f3e49ccf9e tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:24.357927 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1631a0a7-76d4-49da-ba58-76f3e49ccf9e tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:24.358378 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1631a0a7-76d4-49da-ba58-76f3e49ccf9e tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:24.507269 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-553bf219-1851-4b42-8654-39754a93bb8b tempest-MigrationsAdminTest-1503274595 tempest-MigrationsAdminTest-1503274595-project-admin] 10.222.0.46 "POST /compute/v2.1/servers/4d527369-954d-4ccc-9105-03b209d3523e/action" status: 202 len: 0 microversion: 2.1 time: 1.379645 Jan 15 20:49:24.512142 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 168/308] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:49:23 2022] POST /compute/v2.1/servers/4d527369-954d-4ccc-9105-03b209d3523e/action => generated 0 bytes in 1385 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 20:49:24.519020 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-6b833f0e-0aad-4fe9-9f4f-1073b53d096e tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:24.520292 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-6b833f0e-0aad-4fe9-9f4f-1073b53d096e tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: 4d527369-954d-4ccc-9105-03b209d3523e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:24.542958 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6b833f0e-0aad-4fe9-9f4f-1073b53d096e tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:24.544008 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6b833f0e-0aad-4fe9-9f4f-1073b53d096e tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:24.545700 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6b833f0e-0aad-4fe9-9f4f-1073b53d096e tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:24.547098 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6b833f0e-0aad-4fe9-9f4f-1073b53d096e tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:24.787350 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-1631a0a7-76d4-49da-ba58-76f3e49ccf9e tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957f85f9c6794cccad71c553fb607ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82c6b47c4140e390464b153d2fe865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:24.795318 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-1631a0a7-76d4-49da-ba58-76f3e49ccf9e tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] 10.222.0.46 "GET /compute/v2.1/servers/2b68335f-a94c-4801-8d8b-2fd387d1ced9" status: 200 len: 1319 microversion: 2.1 time: 0.503099 Jan 15 20:49:24.806428 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 141/309] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:24 2022] GET /compute/v2.1/servers/2b68335f-a94c-4801-8d8b-2fd387d1ced9 => generated 1319 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:24.807351 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-4667c255-c848-4926-b898-5d9ed7e5a548 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:24.808222 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-4667c255-c848-4926-b898-5d9ed7e5a548 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 98d0ca37-0175-44e2-8a1d-965cdc517daf] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:24.820466 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4667c255-c848-4926-b898-5d9ed7e5a548 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:24.821248 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4667c255-c848-4926-b898-5d9ed7e5a548 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:24.821742 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4667c255-c848-4926-b898-5d9ed7e5a548 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:24.822164 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4667c255-c848-4926-b898-5d9ed7e5a548 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:24.863912 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-4667c255-c848-4926-b898-5d9ed7e5a548 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action" status: 200 len: 14 microversion: 2.1 time: 0.066476 Jan 15 20:49:24.867320 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 142/310] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:49:24 2022] POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action => generated 14 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 20:49:24.926051 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-6b833f0e-0aad-4fe9-9f4f-1073b53d096e tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:24.941315 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-6b833f0e-0aad-4fe9-9f4f-1073b53d096e tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/4d527369-954d-4ccc-9105-03b209d3523e" status: 200 len: 1471 microversion: 2.1 time: 0.421757 Jan 15 20:49:24.942160 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 169/311] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:24 2022] GET /compute/v2.1/servers/4d527369-954d-4ccc-9105-03b209d3523e => generated 1471 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:24.956570 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-92594663-d949-486f-aa85-aed772b5a472 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:24.959754 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-92594663-d949-486f-aa85-aed772b5a472 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] [instance: 114ccb23-d953-4735-b61e-f0d62e19dce2] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:24.973981 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-92594663-d949-486f-aa85-aed772b5a472 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:24.975476 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-92594663-d949-486f-aa85-aed772b5a472 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:24.977550 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-92594663-d949-486f-aa85-aed772b5a472 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:24.978183 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-92594663-d949-486f-aa85-aed772b5a472 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:25.271544 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-92594663-d949-486f-aa85-aed772b5a472 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0079c95473594ee9ada5a4bc6820a111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac923ea754345a9b79457833bd72da4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:25.279952 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-92594663-d949-486f-aa85-aed772b5a472 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] 10.222.0.46 "GET /compute/v2.1/servers/114ccb23-d953-4735-b61e-f0d62e19dce2" status: 200 len: 1318 microversion: 2.1 time: 0.334998 Jan 15 20:49:25.284750 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 170/312] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:24 2022] GET /compute/v2.1/servers/114ccb23-d953-4735-b61e-f0d62e19dce2 => generated 1318 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:25.357875 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9baac773-91d2-4b6f-86ce-7a83930428a9 tempest-FlavorsExtraSpecsTestJSON-585635201 tempest-FlavorsExtraSpecsTestJSON-585635201-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1014422123", "ram": 512, "vcpus": 1, "disk": 10, "id": 1831560561, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:25.360931 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:25.360931 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:49:25.424924 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-e4ec5577-a1c2-47ae-a266-39d354806873 req-2e340b6b-12c8-4c0e-b7ab-91810823d13a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98d0ca37-0175-44e2-8a1d-965cdc517daf", "tag": "621b3781-18ee-45e7-aefe-ae6ec4d044ae"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:25.432114 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:25.432114 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:49:25.437836 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-9baac773-91d2-4b6f-86ce-7a83930428a9 tempest-FlavorsExtraSpecsTestJSON-585635201 tempest-FlavorsExtraSpecsTestJSON-585635201-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.561881 Jan 15 20:49:25.440849 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 143/313] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 20:49:24 2022] POST /compute/v2.1/flavors => generated 416 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 20:49:25.445701 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-e4ec5577-a1c2-47ae-a266-39d354806873 req-2e340b6b-12c8-4c0e-b7ab-91810823d13a service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:25.446542 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-e4ec5577-a1c2-47ae-a266-39d354806873 req-2e340b6b-12c8-4c0e-b7ab-91810823d13a service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:25.458482 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3f56727d-f437-4833-938d-286b148bb8e1 tempest-FlavorsExtraSpecsTestJSON-585635201 tempest-FlavorsExtraSpecsTestJSON-585635201-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:25.462232 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:25.462232 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:49:25.465848 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-e4ec5577-a1c2-47ae-a266-39d354806873 req-2e340b6b-12c8-4c0e-b7ab-91810823d13a service nova] Creating event network-changed:621b3781-18ee-45e7-aefe-ae6ec4d044ae for instance 98d0ca37-0175-44e2-8a1d-965cdc517daf on nch2-master-1 Jan 15 20:49:25.477370 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-e4ec5577-a1c2-47ae-a266-39d354806873 req-2e340b6b-12c8-4c0e-b7ab-91810823d13a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058973 Jan 15 20:49:25.481181 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 171/314] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:49:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:49:25.519107 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3f56727d-f437-4833-938d-286b148bb8e1 tempest-FlavorsExtraSpecsTestJSON-585635201 tempest-FlavorsExtraSpecsTestJSON-585635201-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors/1831560561/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.072052 Jan 15 20:49:25.521948 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 144/315] 10.222.0.46 () {60 vars in 1223 bytes} [Sat Jan 15 20:49:25 2022] POST /compute/v2.1/flavors/1831560561/os-extra_specs => generated 66 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 20:49:25.816392 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c534fd1a-7617-4e2a-b687-6cfc5e491a88 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:25.817423 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c534fd1a-7617-4e2a-b687-6cfc5e491a88 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] [instance: 2b68335f-a94c-4801-8d8b-2fd387d1ced9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:25.824129 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d3e60a04-7af4-44cb-b813-f1cbfb8d2bb9 tempest-FlavorsExtraSpecsTestJSON-232178988 tempest-FlavorsExtraSpecsTestJSON-232178988-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:25.828580 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c534fd1a-7617-4e2a-b687-6cfc5e491a88 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:25.829268 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c534fd1a-7617-4e2a-b687-6cfc5e491a88 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:25.830328 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c534fd1a-7617-4e2a-b687-6cfc5e491a88 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:25.830901 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c534fd1a-7617-4e2a-b687-6cfc5e491a88 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:25.839223 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d3e60a04-7af4-44cb-b813-f1cbfb8d2bb9 tempest-FlavorsExtraSpecsTestJSON-232178988 tempest-FlavorsExtraSpecsTestJSON-232178988-project] 10.222.0.46 "GET /compute/v2.1/flavors/1831560561/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.310920 Jan 15 20:49:25.842752 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 172/316] 10.222.0.46 () {58 vars in 1202 bytes} [Sat Jan 15 20:49:25 2022] GET /compute/v2.1/flavors/1831560561/os-extra_specs => generated 66 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 20:49:25.857812 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-875fd319-ee6d-46ee-9009-1c8024417d2c tempest-FlavorsExtraSpecsTestJSON-585635201 tempest-FlavorsExtraSpecsTestJSON-585635201-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:25.862996 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:25.862996 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:49:25.892088 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-875fd319-ee6d-46ee-9009-1c8024417d2c tempest-FlavorsExtraSpecsTestJSON-585635201 tempest-FlavorsExtraSpecsTestJSON-585635201-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors/1831560561/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.042889 Jan 15 20:49:25.893643 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 173/317] 10.222.0.46 () {60 vars in 1223 bytes} [Sat Jan 15 20:49:25 2022] POST /compute/v2.1/flavors/1831560561/os-extra_specs => generated 66 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 20:49:25.915050 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7802c07a-2508-47f0-bbed-bf0c090ae0d5 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:25.916452 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-7802c07a-2508-47f0-bbed-bf0c090ae0d5 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 98d0ca37-0175-44e2-8a1d-965cdc517daf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:25.934855 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7802c07a-2508-47f0-bbed-bf0c090ae0d5 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:25.935738 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7802c07a-2508-47f0-bbed-bf0c090ae0d5 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:25.937687 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7802c07a-2508-47f0-bbed-bf0c090ae0d5 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:25.938789 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7802c07a-2508-47f0-bbed-bf0c090ae0d5 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:26.017278 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7802c07a-2508-47f0-bbed-bf0c090ae0d5 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action" status: 200 len: 14 microversion: 2.1 time: 0.121960 Jan 15 20:49:26.021235 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 174/318] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:49:25 2022] POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action => generated 14 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 20:49:26.032701 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7169b762-ee30-4eb9-b4f3-fefd1152d25b tempest-FlavorsExtraSpecsTestJSON-232178988 tempest-FlavorsExtraSpecsTestJSON-232178988-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:26.056216 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-c534fd1a-7617-4e2a-b687-6cfc5e491a88 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957f85f9c6794cccad71c553fb607ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82c6b47c4140e390464b153d2fe865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:26.061406 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7169b762-ee30-4eb9-b4f3-fefd1152d25b tempest-FlavorsExtraSpecsTestJSON-232178988 tempest-FlavorsExtraSpecsTestJSON-232178988-project] 10.222.0.46 "GET /compute/v2.1/flavors/1831560561/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.038200 Jan 15 20:49:26.064825 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 175/319] 10.222.0.46 () {58 vars in 1244 bytes} [Sat Jan 15 20:49:26 2022] GET /compute/v2.1/flavors/1831560561/os-extra_specs/hw:numa_nodes => generated 22 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 20:49:26.069432 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c534fd1a-7617-4e2a-b687-6cfc5e491a88 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] 10.222.0.46 "GET /compute/v2.1/servers/2b68335f-a94c-4801-8d8b-2fd387d1ced9" status: 200 len: 1319 microversion: 2.1 time: 0.256852 Jan 15 20:49:26.078647 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 145/320] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:25 2022] GET /compute/v2.1/servers/2b68335f-a94c-4801-8d8b-2fd387d1ced9 => generated 1319 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:26.083926 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b8535943-66e9-4aec-9d6e-01c81668d07d tempest-FlavorsExtraSpecsTestJSON-585635201 tempest-FlavorsExtraSpecsTestJSON-585635201-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:26.085657 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:26.085657 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:49:26.098524 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-83fac7be-66d2-456c-be28-6fa35d3c39e6 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:26.102944 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-83fac7be-66d2-456c-be28-6fa35d3c39e6 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: 4d527369-954d-4ccc-9105-03b209d3523e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:26.112030 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b8535943-66e9-4aec-9d6e-01c81668d07d tempest-FlavorsExtraSpecsTestJSON-585635201 tempest-FlavorsExtraSpecsTestJSON-585635201-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors/1831560561/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.032014 Jan 15 20:49:26.116921 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 146/321] 10.222.0.46 () {60 vars in 1223 bytes} [Sat Jan 15 20:49:26 2022] POST /compute/v2.1/flavors/1831560561/os-extra_specs => generated 66 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 20:49:26.122935 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-86174332-8a5e-4ad4-b32c-d07cc8cc3874 tempest-FlavorsExtraSpecsTestJSON-585635201 tempest-FlavorsExtraSpecsTestJSON-585635201-project-admin] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:26.126990 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-83fac7be-66d2-456c-be28-6fa35d3c39e6 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:26.127721 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-83fac7be-66d2-456c-be28-6fa35d3c39e6 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:26.128525 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-83fac7be-66d2-456c-be28-6fa35d3c39e6 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:26.128988 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-83fac7be-66d2-456c-be28-6fa35d3c39e6 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:26.132653 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-86174332-8a5e-4ad4-b32c-d07cc8cc3874 tempest-FlavorsExtraSpecsTestJSON-585635201 tempest-FlavorsExtraSpecsTestJSON-585635201-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/1831560561/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.014344 Jan 15 20:49:26.133923 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 147/322] 10.222.0.46 () {58 vars in 1202 bytes} [Sat Jan 15 20:49:26 2022] GET /compute/v2.1/flavors/1831560561/os-extra_specs => generated 66 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 20:49:26.154286 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b405d773-02de-4367-b714-52fa3f8d09ac tempest-FlavorsExtraSpecsTestJSON-585635201 tempest-FlavorsExtraSpecsTestJSON-585635201-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:26.160647 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:26.160647 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:49:26.227196 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b405d773-02de-4367-b714-52fa3f8d09ac tempest-FlavorsExtraSpecsTestJSON-585635201 tempest-FlavorsExtraSpecsTestJSON-585635201-project-admin] 10.222.0.46 "PUT /compute/v2.1/flavors/1831560561/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.083512 Jan 15 20:49:26.229674 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 148/323] 10.222.0.46 () {60 vars in 1264 bytes} [Sat Jan 15 20:49:26 2022] PUT /compute/v2.1/flavors/1831560561/os-extra_specs/hw:numa_nodes => generated 22 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 20:49:26.242544 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c279dcb6-766f-4fe2-a016-6629ec10d2c4 tempest-FlavorsExtraSpecsTestJSON-585635201 tempest-FlavorsExtraSpecsTestJSON-585635201-project-admin] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:26.262708 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c279dcb6-766f-4fe2-a016-6629ec10d2c4 tempest-FlavorsExtraSpecsTestJSON-585635201 tempest-FlavorsExtraSpecsTestJSON-585635201-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/1831560561/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.028073 Jan 15 20:49:26.264391 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 149/324] 10.222.0.46 () {58 vars in 1202 bytes} [Sat Jan 15 20:49:26 2022] GET /compute/v2.1/flavors/1831560561/os-extra_specs => generated 66 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 20:49:26.273566 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d6a3d330-e65b-48ef-a809-6da7316eb91a tempest-FlavorsExtraSpecsTestJSON-585635201 tempest-FlavorsExtraSpecsTestJSON-585635201-project-admin] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:26.275015 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:26.275015 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:49:26.315300 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d6a3d330-e65b-48ef-a809-6da7316eb91a tempest-FlavorsExtraSpecsTestJSON-585635201 tempest-FlavorsExtraSpecsTestJSON-585635201-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/1831560561/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.045729 Jan 15 20:49:26.320132 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 150/325] 10.222.0.46 () {58 vars in 1247 bytes} [Sat Jan 15 20:49:26 2022] DELETE /compute/v2.1/flavors/1831560561/os-extra_specs/hw:numa_nodes => generated 0 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jan 15 20:49:26.331886 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c7e3b0b8-cb0b-4705-8223-4ac5b5458ed0 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:26.332737 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c7e3b0b8-cb0b-4705-8223-4ac5b5458ed0 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] [instance: 114ccb23-d953-4735-b61e-f0d62e19dce2] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:26.349845 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c7e3b0b8-cb0b-4705-8223-4ac5b5458ed0 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:26.350576 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c7e3b0b8-cb0b-4705-8223-4ac5b5458ed0 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:26.351785 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c7e3b0b8-cb0b-4705-8223-4ac5b5458ed0 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:26.353141 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c7e3b0b8-cb0b-4705-8223-4ac5b5458ed0 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:26.377688 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-83fac7be-66d2-456c-be28-6fa35d3c39e6 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:26.388402 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-83fac7be-66d2-456c-be28-6fa35d3c39e6 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/4d527369-954d-4ccc-9105-03b209d3523e" status: 200 len: 1471 microversion: 2.1 time: 0.315395 Jan 15 20:49:26.389018 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 176/326] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:26 2022] GET /compute/v2.1/servers/4d527369-954d-4ccc-9105-03b209d3523e => generated 1471 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:26.405374 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e7e2734a-c498-453e-bce8-1a4d20e814fa tempest-FlavorsExtraSpecsTestJSON-585635201 tempest-FlavorsExtraSpecsTestJSON-585635201-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:26.406413 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:26.406413 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:49:26.448528 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e7e2734a-c498-453e-bce8-1a4d20e814fa tempest-FlavorsExtraSpecsTestJSON-585635201 tempest-FlavorsExtraSpecsTestJSON-585635201-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/1831560561/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.057781 Jan 15 20:49:26.451979 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 177/327] 10.222.0.46 () {58 vars in 1247 bytes} [Sat Jan 15 20:49:26 2022] DELETE /compute/v2.1/flavors/1831560561/os-extra_specs/hw:cpu_policy => generated 0 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jan 15 20:49:26.476177 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4f9f8df1-4af9-4b30-bab9-a149411d723c tempest-FlavorsExtraSpecsTestJSON-585635201 tempest-FlavorsExtraSpecsTestJSON-585635201-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:26.485893 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-4f9f8df1-4af9-4b30-bab9-a149411d723c tempest-FlavorsExtraSpecsTestJSON-585635201 tempest-FlavorsExtraSpecsTestJSON-585635201-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/1831560561/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.017583 Jan 15 20:49:26.492060 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 178/328] 10.222.0.46 () {58 vars in 1202 bytes} [Sat Jan 15 20:49:26 2022] GET /compute/v2.1/flavors/1831560561/os-extra_specs => generated 19 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 20:49:26.498973 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0a754075-4590-45f0-9e9c-389299573070 tempest-FlavorsExtraSpecsTestJSON-585635201 tempest-FlavorsExtraSpecsTestJSON-585635201-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:26.499775 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:26.499775 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:49:26.525011 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0a754075-4590-45f0-9e9c-389299573070 tempest-FlavorsExtraSpecsTestJSON-585635201 tempest-FlavorsExtraSpecsTestJSON-585635201-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/1831560561" status: 202 len: 0 microversion: 2.1 time: 0.031342 Jan 15 20:49:26.528869 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 179/329] 10.222.0.46 () {58 vars in 1160 bytes} [Sat Jan 15 20:49:26 2022] DELETE /compute/v2.1/flavors/1831560561 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 20:49:26.536609 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c8f5e4d7-db48-46a3-8fab-18e89691a28b tempest-FlavorsExtraSpecsTestJSON-585635201 tempest-FlavorsExtraSpecsTestJSON-585635201-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:26.580163 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c8f5e4d7-db48-46a3-8fab-18e89691a28b tempest-FlavorsExtraSpecsTestJSON-585635201 tempest-FlavorsExtraSpecsTestJSON-585635201-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.048492 Jan 15 20:49:26.581088 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 180/330] 10.222.0.46 () {58 vars in 1145 bytes} [Sat Jan 15 20:49:26 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:26.649136 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-c7e3b0b8-cb0b-4705-8223-4ac5b5458ed0 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0079c95473594ee9ada5a4bc6820a111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac923ea754345a9b79457833bd72da4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:26.657982 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c7e3b0b8-cb0b-4705-8223-4ac5b5458ed0 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] 10.222.0.46 "GET /compute/v2.1/servers/114ccb23-d953-4735-b61e-f0d62e19dce2" status: 200 len: 1318 microversion: 2.1 time: 0.336437 Jan 15 20:49:26.663123 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 151/331] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:26 2022] GET /compute/v2.1/servers/114ccb23-d953-4735-b61e-f0d62e19dce2 => generated 1318 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:27.029425 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b800d5f7-6df6-472b-97df-210acbe79dbe tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:27.030996 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b800d5f7-6df6-472b-97df-210acbe79dbe tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 98d0ca37-0175-44e2-8a1d-965cdc517daf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:27.038698 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b800d5f7-6df6-472b-97df-210acbe79dbe tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:27.039142 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b800d5f7-6df6-472b-97df-210acbe79dbe tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:27.039923 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b800d5f7-6df6-472b-97df-210acbe79dbe tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:27.040345 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b800d5f7-6df6-472b-97df-210acbe79dbe tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:27.086957 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9aa93f7e-e299-48a6-8604-0fbdc829cd19 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:27.087569 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-9aa93f7e-e299-48a6-8604-0fbdc829cd19 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] [instance: 2b68335f-a94c-4801-8d8b-2fd387d1ced9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:27.094030 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b800d5f7-6df6-472b-97df-210acbe79dbe tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action" status: 200 len: 14 microversion: 2.1 time: 0.068887 Jan 15 20:49:27.100132 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 181/332] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:49:27 2022] POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action => generated 14 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 20:49:27.102947 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9aa93f7e-e299-48a6-8604-0fbdc829cd19 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:27.103590 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9aa93f7e-e299-48a6-8604-0fbdc829cd19 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:27.104703 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9aa93f7e-e299-48a6-8604-0fbdc829cd19 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:27.105770 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9aa93f7e-e299-48a6-8604-0fbdc829cd19 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:27.317907 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-9aa93f7e-e299-48a6-8604-0fbdc829cd19 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957f85f9c6794cccad71c553fb607ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82c6b47c4140e390464b153d2fe865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:27.337821 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-9aa93f7e-e299-48a6-8604-0fbdc829cd19 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] 10.222.0.46 "GET /compute/v2.1/servers/2b68335f-a94c-4801-8d8b-2fd387d1ced9" status: 200 len: 1319 microversion: 2.1 time: 0.256768 Jan 15 20:49:27.340308 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 152/333] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:27 2022] GET /compute/v2.1/servers/2b68335f-a94c-4801-8d8b-2fd387d1ced9 => generated 1319 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:27.408250 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-2b4f7d46-c9a0-4a70-99d8-0daa7f0dbb95 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:27.409434 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-2b4f7d46-c9a0-4a70-99d8-0daa7f0dbb95 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: 4d527369-954d-4ccc-9105-03b209d3523e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:27.419246 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2b4f7d46-c9a0-4a70-99d8-0daa7f0dbb95 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:27.419705 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2b4f7d46-c9a0-4a70-99d8-0daa7f0dbb95 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:27.420578 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2b4f7d46-c9a0-4a70-99d8-0daa7f0dbb95 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:27.420999 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2b4f7d46-c9a0-4a70-99d8-0daa7f0dbb95 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:27.643871 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-2b4f7d46-c9a0-4a70-99d8-0daa7f0dbb95 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:27.652749 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-2b4f7d46-c9a0-4a70-99d8-0daa7f0dbb95 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/4d527369-954d-4ccc-9105-03b209d3523e" status: 200 len: 1471 microversion: 2.1 time: 0.250450 Jan 15 20:49:27.663974 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 182/334] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:27 2022] GET /compute/v2.1/servers/4d527369-954d-4ccc-9105-03b209d3523e => generated 1471 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:27.678706 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1f3342a3-f8b2-42e5-9ce3-934fbdbe96a6 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:27.679482 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-1f3342a3-f8b2-42e5-9ce3-934fbdbe96a6 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] [instance: 114ccb23-d953-4735-b61e-f0d62e19dce2] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:27.690841 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1f3342a3-f8b2-42e5-9ce3-934fbdbe96a6 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:27.691564 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1f3342a3-f8b2-42e5-9ce3-934fbdbe96a6 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:27.692619 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1f3342a3-f8b2-42e5-9ce3-934fbdbe96a6 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:27.693336 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1f3342a3-f8b2-42e5-9ce3-934fbdbe96a6 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:27.904934 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-1f3342a3-f8b2-42e5-9ce3-934fbdbe96a6 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0079c95473594ee9ada5a4bc6820a111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac923ea754345a9b79457833bd72da4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:27.917961 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-1f3342a3-f8b2-42e5-9ce3-934fbdbe96a6 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] 10.222.0.46 "GET /compute/v2.1/servers/114ccb23-d953-4735-b61e-f0d62e19dce2" status: 200 len: 1318 microversion: 2.1 time: 0.241628 Jan 15 20:49:27.918628 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 183/335] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:27 2022] GET /compute/v2.1/servers/114ccb23-d953-4735-b61e-f0d62e19dce2 => generated 1318 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:28.084567 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-15b245b6-d5bd-4440-bd29-ceabba9092f1 tempest-HostsAdminNegativeTestJSON-2147473813 tempest-HostsAdminNegativeTestJSON-2147473813-project-admin] Calling method '.version_select at 0x7f30c984e040>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:28.086361 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:28.086361 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:49:28.089352 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-15b245b6-d5bd-4440-bd29-ceabba9092f1 tempest-HostsAdminNegativeTestJSON-2147473813 tempest-HostsAdminNegativeTestJSON-2147473813-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:28.089894 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-15b245b6-d5bd-4440-bd29-ceabba9092f1 tempest-HostsAdminNegativeTestJSON-2147473813 tempest-HostsAdminNegativeTestJSON-2147473813-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:28.090705 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-15b245b6-d5bd-4440-bd29-ceabba9092f1 tempest-HostsAdminNegativeTestJSON-2147473813 tempest-HostsAdminNegativeTestJSON-2147473813-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:28.092942 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-15b245b6-d5bd-4440-bd29-ceabba9092f1 tempest-HostsAdminNegativeTestJSON-2147473813 tempest-HostsAdminNegativeTestJSON-2147473813-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:28.109570 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-babf5aed-f2a2-41f8-9c9d-7d248d2df069 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:28.111676 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-babf5aed-f2a2-41f8-9c9d-7d248d2df069 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 98d0ca37-0175-44e2-8a1d-965cdc517daf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:28.138490 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-babf5aed-f2a2-41f8-9c9d-7d248d2df069 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:28.138938 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-babf5aed-f2a2-41f8-9c9d-7d248d2df069 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:28.139740 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-babf5aed-f2a2-41f8-9c9d-7d248d2df069 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:28.140168 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-babf5aed-f2a2-41f8-9c9d-7d248d2df069 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:28.161156 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-15b245b6-d5bd-4440-bd29-ceabba9092f1 tempest-HostsAdminNegativeTestJSON-2147473813 tempest-HostsAdminNegativeTestJSON-2147473813-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.541812 Jan 15 20:49:28.174391 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 153/336] 10.222.0.46 () {58 vars in 1127 bytes} [Sat Jan 15 20:49:27 2022] GET /compute/v2.1/os-hosts => generated 379 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:49:28.216815 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-babf5aed-f2a2-41f8-9c9d-7d248d2df069 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action" status: 200 len: 14 microversion: 2.1 time: 0.113431 Jan 15 20:49:28.217618 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 184/337] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:49:28 2022] POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action => generated 14 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 20:49:28.337112 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-57626a06-7f57-42a4-9353-8fc7dd3d9d1c req-a715a77a-a655-4244-9a65-5af47a8bda54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b68335f-a94c-4801-8d8b-2fd387d1ced9", "name": "network-vif-plugged", "status": "completed", "tag": "83c60043-b7da-47fc-8806-0fb74103c15c"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:28.338698 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:28.338698 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:49:28.351039 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-57626a06-7f57-42a4-9353-8fc7dd3d9d1c req-a715a77a-a655-4244-9a65-5af47a8bda54 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:28.351225 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-57626a06-7f57-42a4-9353-8fc7dd3d9d1c req-a715a77a-a655-4244-9a65-5af47a8bda54 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:28.375847 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-57626a06-7f57-42a4-9353-8fc7dd3d9d1c req-a715a77a-a655-4244-9a65-5af47a8bda54 service nova] Creating event network-vif-plugged:83c60043-b7da-47fc-8806-0fb74103c15c for instance 2b68335f-a94c-4801-8d8b-2fd387d1ced9 on nch1-master-1 Jan 15 20:49:28.390051 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-57626a06-7f57-42a4-9353-8fc7dd3d9d1c req-a715a77a-a655-4244-9a65-5af47a8bda54 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059325 Jan 15 20:49:28.390933 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 185/338] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:49:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 20:49:28.395961 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7541b86c-a9e5-4970-a468-78186f81ff11 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:28.396659 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-7541b86c-a9e5-4970-a468-78186f81ff11 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] [instance: 2b68335f-a94c-4801-8d8b-2fd387d1ced9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:28.414118 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7541b86c-a9e5-4970-a468-78186f81ff11 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:28.415001 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7541b86c-a9e5-4970-a468-78186f81ff11 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:28.416417 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7541b86c-a9e5-4970-a468-78186f81ff11 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:28.416971 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7541b86c-a9e5-4970-a468-78186f81ff11 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:28.617237 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-4096e619-b9fe-4deb-aae1-11fa903f1629 tempest-HostsAdminNegativeTestJSON-1879506541 tempest-HostsAdminNegativeTestJSON-1879506541-project] Calling method '.version_select at 0x7f30c9af44c0>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:28.619009 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:28.619009 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:49:28.621573 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-4096e619-b9fe-4deb-aae1-11fa903f1629 tempest-HostsAdminNegativeTestJSON-1879506541 tempest-HostsAdminNegativeTestJSON-1879506541-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': 'dd3495e7791e45bc93144cd0f6f3c2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048da2207e7148a29f374daa6f68538b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:28.624459 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-4096e619-b9fe-4deb-aae1-11fa903f1629 tempest-HostsAdminNegativeTestJSON-1879506541 tempest-HostsAdminNegativeTestJSON-1879506541-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:49:28.626277 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-4096e619-b9fe-4deb-aae1-11fa903f1629 tempest-HostsAdminNegativeTestJSON-1879506541 tempest-HostsAdminNegativeTestJSON-1879506541-project] 10.222.0.46 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.447032 Jan 15 20:49:28.629020 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 154/339] 10.222.0.46 () {58 vars in 1127 bytes} [Sat Jan 15 20:49:28 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 451 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:49:28.702697 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-7541b86c-a9e5-4970-a468-78186f81ff11 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957f85f9c6794cccad71c553fb607ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82c6b47c4140e390464b153d2fe865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:28.714300 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7541b86c-a9e5-4970-a468-78186f81ff11 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] 10.222.0.46 "GET /compute/v2.1/servers/2b68335f-a94c-4801-8d8b-2fd387d1ced9" status: 200 len: 1319 microversion: 2.1 time: 0.320741 Jan 15 20:49:28.724810 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 186/340] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:28 2022] GET /compute/v2.1/servers/2b68335f-a94c-4801-8d8b-2fd387d1ced9 => generated 1319 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:28.730438 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-21cd1b93-45cc-4018-9504-6255d8adfc86 tempest-HostsAdminNegativeTestJSON-1879506541 tempest-HostsAdminNegativeTestJSON-1879506541-project] Calling method '.version_select at 0x7f30c9c2f8b0>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:28.731600 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:28.731600 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:49:28.733063 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-21cd1b93-45cc-4018-9504-6255d8adfc86 tempest-HostsAdminNegativeTestJSON-1879506541 tempest-HostsAdminNegativeTestJSON-1879506541-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': 'dd3495e7791e45bc93144cd0f6f3c2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048da2207e7148a29f374daa6f68538b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:28.733928 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-21cd1b93-45cc-4018-9504-6255d8adfc86 tempest-HostsAdminNegativeTestJSON-1879506541 tempest-HostsAdminNegativeTestJSON-1879506541-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:49:28.734725 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-21cd1b93-45cc-4018-9504-6255d8adfc86 tempest-HostsAdminNegativeTestJSON-1879506541 tempest-HostsAdminNegativeTestJSON-1879506541-project] 10.222.0.46 "GET /compute/v2.1/os-hosts/ncdv-master-1/reboot" status: 403 len: 111 microversion: 2.1 time: 0.008651 Jan 15 20:49:28.735742 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 187/341] 10.222.0.46 () {58 vars in 1190 bytes} [Sat Jan 15 20:49:28 2022] GET /compute/v2.1/os-hosts/ncdv-master-1/reboot => generated 111 bytes in 10 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:49:28.742684 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-06ae090b-f275-4816-b030-d48e8f278aca tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:28.743491 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-06ae090b-f275-4816-b030-d48e8f278aca tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: 4d527369-954d-4ccc-9105-03b209d3523e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:28.750826 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-06ae090b-f275-4816-b030-d48e8f278aca tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:28.751490 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-06ae090b-f275-4816-b030-d48e8f278aca tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:28.752050 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-06ae090b-f275-4816-b030-d48e8f278aca tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:28.752527 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-06ae090b-f275-4816-b030-d48e8f278aca tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:28.862952 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-4842b033-8c86-44c6-a04f-6f920a5d87c0 tempest-HypervisorAdminNegativeTestJSON-1537827277 tempest-HypervisorAdminNegativeTestJSON-1537827277-project] Calling method '.version_select at 0x7f30c984e4c0>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:28.864180 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:28.864180 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:49:28.866253 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-4842b033-8c86-44c6-a04f-6f920a5d87c0 tempest-HypervisorAdminNegativeTestJSON-1537827277 tempest-HypervisorAdminNegativeTestJSON-1537827277-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': '26e2fe1486854076bce95bcf5719ecf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f99a1ca26c4f3c8ac14630850eca40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:28.867183 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-4842b033-8c86-44c6-a04f-6f920a5d87c0 tempest-HypervisorAdminNegativeTestJSON-1537827277 tempest-HypervisorAdminNegativeTestJSON-1537827277-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:49:28.868012 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-4842b033-8c86-44c6-a04f-6f920a5d87c0 tempest-HypervisorAdminNegativeTestJSON-1537827277 tempest-HypervisorAdminNegativeTestJSON-1537827277-project] 10.222.0.46 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.237934 Jan 15 20:49:28.868924 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 155/342] 10.222.0.46 () {58 vars in 1166 bytes} [Sat Jan 15 20:49:28 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 239 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:49:28.877340 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2b950f8f-65e8-47d5-983f-420c46c1a3df tempest-HostsAdminNegativeTestJSON-2147473813 tempest-HostsAdminNegativeTestJSON-2147473813-project-admin] Calling method '.version_select at 0x7f30c994a310>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:28.878587 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:28.878587 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:49:28.888143 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-2b950f8f-65e8-47d5-983f-420c46c1a3df tempest-HostsAdminNegativeTestJSON-2147473813 tempest-HostsAdminNegativeTestJSON-2147473813-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jan 15 20:49:28.889121 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2b950f8f-65e8-47d5-983f-420c46c1a3df tempest-HostsAdminNegativeTestJSON-2147473813 tempest-HostsAdminNegativeTestJSON-2147473813-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:49:28.890214 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2b950f8f-65e8-47d5-983f-420c46c1a3df tempest-HostsAdminNegativeTestJSON-2147473813 tempest-HostsAdminNegativeTestJSON-2147473813-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.020125 Jan 15 20:49:28.891017 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 156/343] 10.222.0.46 () {58 vars in 1211 bytes} [Sat Jan 15 20:49:28 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jan 15 20:49:28.896566 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-45bcb2c1-1af1-44f3-9cc7-bbcdfe8f1dae tempest-HypervisorAdminNegativeTestJSON-1537827277 tempest-HypervisorAdminNegativeTestJSON-1537827277-project] Calling method '.version_select at 0x7f30c97b25e0>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:28.897684 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:28.897684 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:49:28.899294 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-45bcb2c1-1af1-44f3-9cc7-bbcdfe8f1dae tempest-HypervisorAdminNegativeTestJSON-1537827277 tempest-HypervisorAdminNegativeTestJSON-1537827277-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': '26e2fe1486854076bce95bcf5719ecf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f99a1ca26c4f3c8ac14630850eca40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:28.900189 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-45bcb2c1-1af1-44f3-9cc7-bbcdfe8f1dae tempest-HypervisorAdminNegativeTestJSON-1537827277 tempest-HypervisorAdminNegativeTestJSON-1537827277-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:49:28.901610 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-45bcb2c1-1af1-44f3-9cc7-bbcdfe8f1dae tempest-HypervisorAdminNegativeTestJSON-1537827277 tempest-HypervisorAdminNegativeTestJSON-1537827277-project] 10.222.0.46 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.009097 Jan 15 20:49:28.902808 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 157/344] 10.222.0.46 () {58 vars in 1145 bytes} [Sat Jan 15 20:49:28 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 11 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:49:28.908677 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a3d8c1bb-df65-44d4-84c3-9b192481fdfd tempest-HostsAdminNegativeTestJSON-1879506541 tempest-HostsAdminNegativeTestJSON-1879506541-project] Calling method '.version_select at 0x7f30c97cc0d0>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:28.909941 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:28.909941 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:49:28.911570 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-a3d8c1bb-df65-44d4-84c3-9b192481fdfd tempest-HostsAdminNegativeTestJSON-1879506541 tempest-HostsAdminNegativeTestJSON-1879506541-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': 'dd3495e7791e45bc93144cd0f6f3c2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048da2207e7148a29f374daa6f68538b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:28.913098 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a3d8c1bb-df65-44d4-84c3-9b192481fdfd tempest-HostsAdminNegativeTestJSON-1879506541 tempest-HostsAdminNegativeTestJSON-1879506541-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:49:28.914017 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a3d8c1bb-df65-44d4-84c3-9b192481fdfd tempest-HostsAdminNegativeTestJSON-1879506541 tempest-HostsAdminNegativeTestJSON-1879506541-project] 10.222.0.46 "GET /compute/v2.1/os-hosts/ncdv-master-1" status: 403 len: 109 microversion: 2.1 time: 0.010127 Jan 15 20:49:28.915072 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 158/345] 10.222.0.46 () {58 vars in 1169 bytes} [Sat Jan 15 20:49:28 2022] GET /compute/v2.1/os-hosts/ncdv-master-1 => generated 109 bytes in 11 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:49:28.920318 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-87e7ec1a-13d3-4fe1-979b-451fcc138d52 tempest-HypervisorAdminNegativeTestJSON-1537827277 tempest-HypervisorAdminNegativeTestJSON-1537827277-project] Calling method '.version_select at 0x7f30c9af4280>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:28.921553 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:28.921553 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:49:28.922941 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-87e7ec1a-13d3-4fe1-979b-451fcc138d52 tempest-HypervisorAdminNegativeTestJSON-1537827277 tempest-HypervisorAdminNegativeTestJSON-1537827277-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': '26e2fe1486854076bce95bcf5719ecf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f99a1ca26c4f3c8ac14630850eca40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:28.923663 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-87e7ec1a-13d3-4fe1-979b-451fcc138d52 tempest-HypervisorAdminNegativeTestJSON-1537827277 tempest-HypervisorAdminNegativeTestJSON-1537827277-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:49:28.924558 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-87e7ec1a-13d3-4fe1-979b-451fcc138d52 tempest-HypervisorAdminNegativeTestJSON-1537827277 tempest-HypervisorAdminNegativeTestJSON-1537827277-project] 10.222.0.46 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.008300 Jan 15 20:49:28.925196 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 159/346] 10.222.0.46 () {58 vars in 1178 bytes} [Sat Jan 15 20:49:28 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 9 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:49:28.932802 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f07b6c75-04d5-452b-9415-cbf20fe9ccd9 tempest-HostsAdminNegativeTestJSON-2147473813 tempest-HostsAdminNegativeTestJSON-2147473813-project-admin] Calling method '.version_select at 0x7f30c984eb80>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:28.941219 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-f07b6c75-04d5-452b-9415-cbf20fe9ccd9 tempest-HostsAdminNegativeTestJSON-2147473813 tempest-HostsAdminNegativeTestJSON-2147473813-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jan 15 20:49:28.942193 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f07b6c75-04d5-452b-9415-cbf20fe9ccd9 tempest-HostsAdminNegativeTestJSON-2147473813 tempest-HostsAdminNegativeTestJSON-2147473813-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:49:28.943240 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f07b6c75-04d5-452b-9415-cbf20fe9ccd9 tempest-HostsAdminNegativeTestJSON-2147473813 tempest-HostsAdminNegativeTestJSON-2147473813-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.016906 Jan 15 20:49:28.944196 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 160/347] 10.222.0.46 () {58 vars in 1190 bytes} [Sat Jan 15 20:49:28 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jan 15 20:49:29.144815 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-7cb6f927-b5ac-4393-8c7a-497276bc9de0 tempest-HypervisorAdminNegativeTestJSON-138994452 tempest-HypervisorAdminNegativeTestJSON-138994452-project-admin] Calling method '.version_select at 0x7f30c994ab80>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:29.150841 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7cb6f927-b5ac-4393-8c7a-497276bc9de0 tempest-HypervisorAdminNegativeTestJSON-138994452 tempest-HypervisorAdminNegativeTestJSON-138994452-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:29.151491 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7cb6f927-b5ac-4393-8c7a-497276bc9de0 tempest-HypervisorAdminNegativeTestJSON-138994452 tempest-HypervisorAdminNegativeTestJSON-138994452-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:29.172483 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7cb6f927-b5ac-4393-8c7a-497276bc9de0 tempest-HypervisorAdminNegativeTestJSON-138994452 tempest-HypervisorAdminNegativeTestJSON-138994452-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:29.173289 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7cb6f927-b5ac-4393-8c7a-497276bc9de0 tempest-HypervisorAdminNegativeTestJSON-138994452 tempest-HypervisorAdminNegativeTestJSON-138994452-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:29.200639 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-06ae090b-f275-4816-b030-d48e8f278aca tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:29.206062 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7cb6f927-b5ac-4393-8c7a-497276bc9de0 tempest-HypervisorAdminNegativeTestJSON-138994452 tempest-HypervisorAdminNegativeTestJSON-138994452-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:29.207589 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7cb6f927-b5ac-4393-8c7a-497276bc9de0 tempest-HypervisorAdminNegativeTestJSON-138994452 tempest-HypervisorAdminNegativeTestJSON-138994452-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:29.209352 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-06ae090b-f275-4816-b030-d48e8f278aca tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/4d527369-954d-4ccc-9105-03b209d3523e" status: 200 len: 1471 microversion: 2.1 time: 0.472379 Jan 15 20:49:29.209920 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 188/348] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:28 2022] GET /compute/v2.1/servers/4d527369-954d-4ccc-9105-03b209d3523e => generated 1471 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:29.216590 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-7cb6f927-b5ac-4393-8c7a-497276bc9de0 tempest-HypervisorAdminNegativeTestJSON-138994452 tempest-HypervisorAdminNegativeTestJSON-138994452-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.271007 Jan 15 20:49:29.217602 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 161/349] 10.222.0.46 () {58 vars in 1145 bytes} [Sat Jan 15 20:49:28 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:49:29.223615 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b99856ef-1a32-4419-821b-437bfc47bd17 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:29.224890 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2c30ae42-85db-46c0-979d-cfb841b27423 tempest-HostsAdminNegativeTestJSON-1879506541 tempest-HostsAdminNegativeTestJSON-1879506541-project] Calling method '.version_select at 0x7f30c97b25e0>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:29.225711 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:shutdown": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:29.225711 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:49:29.226571 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b99856ef-1a32-4419-821b-437bfc47bd17 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] [instance: 114ccb23-d953-4735-b61e-f0d62e19dce2] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:29.227339 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-2c30ae42-85db-46c0-979d-cfb841b27423 tempest-HostsAdminNegativeTestJSON-1879506541 tempest-HostsAdminNegativeTestJSON-1879506541-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': 'dd3495e7791e45bc93144cd0f6f3c2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048da2207e7148a29f374daa6f68538b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:29.228183 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2c30ae42-85db-46c0-979d-cfb841b27423 tempest-HostsAdminNegativeTestJSON-1879506541 tempest-HostsAdminNegativeTestJSON-1879506541-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:49:29.229399 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2c30ae42-85db-46c0-979d-cfb841b27423 tempest-HostsAdminNegativeTestJSON-1879506541 tempest-HostsAdminNegativeTestJSON-1879506541-project] 10.222.0.46 "GET /compute/v2.1/os-hosts/ncdv-master-1/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.010457 Jan 15 20:49:29.234590 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 162/350] 10.222.0.46 () {58 vars in 1196 bytes} [Sat Jan 15 20:49:29 2022] GET /compute/v2.1/os-hosts/ncdv-master-1/shutdown => generated 113 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:49:29.239846 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-79d21749-dd95-4959-b5df-084fdecd0e4a tempest-HypervisorAdminNegativeTestJSON-1537827277 tempest-HypervisorAdminNegativeTestJSON-1537827277-project] Calling method '.version_select at 0x7f30c97f8790>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:29.241007 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:29.241007 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:49:29.242578 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-79d21749-dd95-4959-b5df-084fdecd0e4a tempest-HypervisorAdminNegativeTestJSON-1537827277 tempest-HypervisorAdminNegativeTestJSON-1537827277-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': '26e2fe1486854076bce95bcf5719ecf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f99a1ca26c4f3c8ac14630850eca40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:29.243037 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b99856ef-1a32-4419-821b-437bfc47bd17 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:29.243495 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b99856ef-1a32-4419-821b-437bfc47bd17 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:29.243824 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-79d21749-dd95-4959-b5df-084fdecd0e4a tempest-HypervisorAdminNegativeTestJSON-1537827277 tempest-HypervisorAdminNegativeTestJSON-1537827277-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:49:29.244302 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b99856ef-1a32-4419-821b-437bfc47bd17 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:29.245165 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-79d21749-dd95-4959-b5df-084fdecd0e4a tempest-HypervisorAdminNegativeTestJSON-1537827277 tempest-HypervisorAdminNegativeTestJSON-1537827277-project] 10.222.0.46 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.009411 Jan 15 20:49:29.246458 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 163/351] 10.222.0.46 () {58 vars in 1172 bytes} [Sat Jan 15 20:49:29 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 11 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:49:29.250456 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b99856ef-1a32-4419-821b-437bfc47bd17 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:29.252830 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-eebab383-38b2-4304-ba07-e16f650eef86 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:29.254260 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-eebab383-38b2-4304-ba07-e16f650eef86 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 98d0ca37-0175-44e2-8a1d-965cdc517daf] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:29.263586 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-eebab383-38b2-4304-ba07-e16f650eef86 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:29.264156 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-eebab383-38b2-4304-ba07-e16f650eef86 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:29.265359 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-eebab383-38b2-4304-ba07-e16f650eef86 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:29.266180 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-eebab383-38b2-4304-ba07-e16f650eef86 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:29.329900 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-eebab383-38b2-4304-ba07-e16f650eef86 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action" status: 200 len: 8204 microversion: 2.1 time: 0.080220 Jan 15 20:49:29.333967 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 164/352] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:49:29 2022] POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action => generated 8204 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:29.341968 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b9a591e2-b3aa-423f-9540-b3e5b107fd4c tempest-HostsAdminNegativeTestJSON-2147473813 tempest-HostsAdminNegativeTestJSON-2147473813-project-admin] Calling method '.version_select at 0x7f30c984e940>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:29.343058 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:shutdown": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:29.343058 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:49:29.355820 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-b9a591e2-b3aa-423f-9540-b3e5b107fd4c tempest-HostsAdminNegativeTestJSON-2147473813 tempest-HostsAdminNegativeTestJSON-2147473813-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jan 15 20:49:29.355820 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b9a591e2-b3aa-423f-9540-b3e5b107fd4c tempest-HostsAdminNegativeTestJSON-2147473813 tempest-HostsAdminNegativeTestJSON-2147473813-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:49:29.361251 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b9a591e2-b3aa-423f-9540-b3e5b107fd4c tempest-HostsAdminNegativeTestJSON-2147473813 tempest-HostsAdminNegativeTestJSON-2147473813-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.024679 Jan 15 20:49:29.365776 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 165/353] 10.222.0.46 () {58 vars in 1217 bytes} [Sat Jan 15 20:49:29 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jan 15 20:49:29.373593 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ec30c60a-28ee-420e-bc30-6d693eacda24 tempest-HypervisorAdminNegativeTestJSON-138994452 tempest-HypervisorAdminNegativeTestJSON-138994452-project-admin] Calling method '.version_select at 0x7f30c97ace50>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:29.373786 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:29.373786 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:49:29.380865 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-ec30c60a-28ee-420e-bc30-6d693eacda24 tempest-HypervisorAdminNegativeTestJSON-138994452 tempest-HypervisorAdminNegativeTestJSON-138994452-project-admin] HTTP exception thrown: Hypervisor with ID 'efd1b87b-59e8-44ed-aa8a-cc14c0860b5c' could not be found. Jan 15 20:49:29.381639 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ec30c60a-28ee-420e-bc30-6d693eacda24 tempest-HypervisorAdminNegativeTestJSON-138994452 tempest-HypervisorAdminNegativeTestJSON-138994452-project-admin] Returning 404 to user: Hypervisor with ID 'efd1b87b-59e8-44ed-aa8a-cc14c0860b5c' could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:49:29.382297 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ec30c60a-28ee-420e-bc30-6d693eacda24 tempest-HypervisorAdminNegativeTestJSON-138994452 tempest-HypervisorAdminNegativeTestJSON-138994452-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hypervisors/efd1b87b-59e8-44ed-aa8a-cc14c0860b5c/uptime" status: 404 len: 123 microversion: 2.1 time: 0.013338 Jan 15 20:49:29.387380 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 166/354] 10.222.0.46 () {58 vars in 1277 bytes} [Sat Jan 15 20:49:29 2022] GET /compute/v2.1/os-hypervisors/efd1b87b-59e8-44ed-aa8a-cc14c0860b5c/uptime => generated 123 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:49:29.396614 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-0e8a8a17-4beb-4566-9f9c-25c4510e4a5f tempest-HostsAdminNegativeTestJSON-1879506541 tempest-HostsAdminNegativeTestJSON-1879506541-project] Calling method '.version_select at 0x7f30c97ac3a0>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:29.397510 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:start": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:29.397510 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:49:29.398564 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-0e8a8a17-4beb-4566-9f9c-25c4510e4a5f tempest-HostsAdminNegativeTestJSON-1879506541 tempest-HostsAdminNegativeTestJSON-1879506541-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': 'dd3495e7791e45bc93144cd0f6f3c2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048da2207e7148a29f374daa6f68538b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:29.399189 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-0e8a8a17-4beb-4566-9f9c-25c4510e4a5f tempest-HostsAdminNegativeTestJSON-1879506541 tempest-HostsAdminNegativeTestJSON-1879506541-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:49:29.399980 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-0e8a8a17-4beb-4566-9f9c-25c4510e4a5f tempest-HostsAdminNegativeTestJSON-1879506541 tempest-HostsAdminNegativeTestJSON-1879506541-project] 10.222.0.46 "GET /compute/v2.1/os-hosts/ncdv-master-1/startup" status: 403 len: 110 microversion: 2.1 time: 0.011669 Jan 15 20:49:29.400900 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 167/355] 10.222.0.46 () {58 vars in 1193 bytes} [Sat Jan 15 20:49:29 2022] GET /compute/v2.1/os-hosts/ncdv-master-1/startup => generated 110 bytes in 13 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:49:29.406458 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-4e9b433f-2ade-4b23-82fa-1aee57b06198 tempest-HypervisorAdminNegativeTestJSON-138994452 tempest-HypervisorAdminNegativeTestJSON-138994452-project-admin] Calling method '.version_select at 0x7f30c97ccf70>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:29.407261 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:29.407261 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:49:29.408769 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4e9b433f-2ade-4b23-82fa-1aee57b06198 tempest-HypervisorAdminNegativeTestJSON-138994452 tempest-HypervisorAdminNegativeTestJSON-138994452-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:29.409228 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4e9b433f-2ade-4b23-82fa-1aee57b06198 tempest-HypervisorAdminNegativeTestJSON-138994452 tempest-HypervisorAdminNegativeTestJSON-138994452-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:29.425534 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4e9b433f-2ade-4b23-82fa-1aee57b06198 tempest-HypervisorAdminNegativeTestJSON-138994452 tempest-HypervisorAdminNegativeTestJSON-138994452-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:29.425982 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4e9b433f-2ade-4b23-82fa-1aee57b06198 tempest-HypervisorAdminNegativeTestJSON-138994452 tempest-HypervisorAdminNegativeTestJSON-138994452-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:29.440771 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4e9b433f-2ade-4b23-82fa-1aee57b06198 tempest-HypervisorAdminNegativeTestJSON-138994452 tempest-HypervisorAdminNegativeTestJSON-138994452-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:29.440771 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4e9b433f-2ade-4b23-82fa-1aee57b06198 tempest-HypervisorAdminNegativeTestJSON-138994452 tempest-HypervisorAdminNegativeTestJSON-138994452-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:29.444420 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-4e9b433f-2ade-4b23-82fa-1aee57b06198 tempest-HypervisorAdminNegativeTestJSON-138994452 tempest-HypervisorAdminNegativeTestJSON-138994452-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.042524 Jan 15 20:49:29.449704 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-b99856ef-1a32-4419-821b-437bfc47bd17 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0079c95473594ee9ada5a4bc6820a111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac923ea754345a9b79457833bd72da4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:29.450132 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 168/356] 10.222.0.46 () {58 vars in 1145 bytes} [Sat Jan 15 20:49:29 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:49:29.454745 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5525f08d-a4c4-45b8-a0e4-6bb50cffd2df tempest-HostsAdminNegativeTestJSON-2147473813 tempest-HostsAdminNegativeTestJSON-2147473813-project-admin] Calling method '.version_select at 0x7f30c97cc790>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:29.455537 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:start": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:29.455537 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:49:29.458785 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b99856ef-1a32-4419-821b-437bfc47bd17 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] 10.222.0.46 "GET /compute/v2.1/servers/114ccb23-d953-4735-b61e-f0d62e19dce2" status: 200 len: 1318 microversion: 2.1 time: 0.246426 Jan 15 20:49:29.459432 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 189/357] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:29 2022] GET /compute/v2.1/servers/114ccb23-d953-4735-b61e-f0d62e19dce2 => generated 1318 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:29.463775 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c22e650d-7ee8-4225-8e21-218080ae29e5 tempest-HypervisorAdminNegativeTestJSON-1537827277 tempest-HypervisorAdminNegativeTestJSON-1537827277-project] Calling method '.version_select at 0x7f30c97ec0d0>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:29.465329 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:29.465329 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:49:29.466698 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-c22e650d-7ee8-4225-8e21-218080ae29e5 tempest-HypervisorAdminNegativeTestJSON-1537827277 tempest-HypervisorAdminNegativeTestJSON-1537827277-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': '26e2fe1486854076bce95bcf5719ecf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f99a1ca26c4f3c8ac14630850eca40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:29.467315 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c22e650d-7ee8-4225-8e21-218080ae29e5 tempest-HypervisorAdminNegativeTestJSON-1537827277 tempest-HypervisorAdminNegativeTestJSON-1537827277-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:49:29.468080 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c22e650d-7ee8-4225-8e21-218080ae29e5 tempest-HypervisorAdminNegativeTestJSON-1537827277 tempest-HypervisorAdminNegativeTestJSON-1537827277-project] 10.222.0.46 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.007723 Jan 15 20:49:29.468564 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 190/358] 10.222.0.46 () {58 vars in 1151 bytes} [Sat Jan 15 20:49:29 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 9 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:49:29.474489 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-5525f08d-a4c4-45b8-a0e4-6bb50cffd2df tempest-HostsAdminNegativeTestJSON-2147473813 tempest-HostsAdminNegativeTestJSON-2147473813-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jan 15 20:49:29.475402 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5525f08d-a4c4-45b8-a0e4-6bb50cffd2df tempest-HostsAdminNegativeTestJSON-2147473813 tempest-HostsAdminNegativeTestJSON-2147473813-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:49:29.476467 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5525f08d-a4c4-45b8-a0e4-6bb50cffd2df tempest-HostsAdminNegativeTestJSON-2147473813 tempest-HostsAdminNegativeTestJSON-2147473813-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.025328 Jan 15 20:49:29.477609 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-39b4f5f2-30f4-4e31-994b-c190366ceb99 tempest-HypervisorAdminNegativeTestJSON-138994452 tempest-HypervisorAdminNegativeTestJSON-138994452-project-admin] Calling method '.version_select at 0x7f30c99e7280>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:29.479404 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-39b4f5f2-30f4-4e31-994b-c190366ceb99 tempest-HypervisorAdminNegativeTestJSON-138994452 tempest-HypervisorAdminNegativeTestJSON-138994452-project-admin] HTTP exception thrown: Hypervisor with ID '24b0ac90-8606-4f70-afdd-88529a3064fb' could not be found. Jan 15 20:49:29.481043 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-39b4f5f2-30f4-4e31-994b-c190366ceb99 tempest-HypervisorAdminNegativeTestJSON-138994452 tempest-HypervisorAdminNegativeTestJSON-138994452-project-admin] Returning 404 to user: Hypervisor with ID '24b0ac90-8606-4f70-afdd-88529a3064fb' could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:49:29.481219 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-39b4f5f2-30f4-4e31-994b-c190366ceb99 tempest-HypervisorAdminNegativeTestJSON-138994452 tempest-HypervisorAdminNegativeTestJSON-138994452-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hypervisors/24b0ac90-8606-4f70-afdd-88529a3064fb" status: 404 len: 123 microversion: 2.1 time: 0.007452 Jan 15 20:49:29.482416 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 169/359] 10.222.0.46 () {58 vars in 1214 bytes} [Sat Jan 15 20:49:29 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jan 15 20:49:29.485817 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 191/360] 10.222.0.46 () {58 vars in 1256 bytes} [Sat Jan 15 20:49:29 2022] GET /compute/v2.1/os-hypervisors/24b0ac90-8606-4f70-afdd-88529a3064fb => generated 123 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 15 20:49:29.488905 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-24f46656-cc96-46b3-8ac7-cb47ab2cd9bb tempest-HostsAdminNegativeTestJSON-2147473813 tempest-HostsAdminNegativeTestJSON-2147473813-project-admin] Action: 'update', calling method: .version_select at 0x7f30c97b2820>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:29.490043 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-24f46656-cc96-46b3-8ac7-cb47ab2cd9bb tempest-HostsAdminNegativeTestJSON-2147473813 tempest-HostsAdminNegativeTestJSON-2147473813-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:49:29.491067 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-24f46656-cc96-46b3-8ac7-cb47ab2cd9bb tempest-HostsAdminNegativeTestJSON-2147473813 tempest-HostsAdminNegativeTestJSON-2147473813-project-admin] 10.222.0.46 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 400 len: 199 microversion: 2.1 time: 0.007457 Jan 15 20:49:29.493526 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 170/361] 10.222.0.46 () {60 vars in 1189 bytes} [Sat Jan 15 20:49:29 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 199 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 15 20:49:29.501554 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a659ad9b-e485-4eab-b2fa-7a3655e88215 tempest-HostsAdminNegativeTestJSON-2147473813 tempest-HostsAdminNegativeTestJSON-2147473813-project-admin] Action: 'update', calling method: .version_select at 0x7f30c9b18a60>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:29.502905 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a659ad9b-e485-4eab-b2fa-7a3655e88215 tempest-HostsAdminNegativeTestJSON-2147473813 tempest-HostsAdminNegativeTestJSON-2147473813-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:49:29.504136 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a659ad9b-e485-4eab-b2fa-7a3655e88215 tempest-HostsAdminNegativeTestJSON-2147473813 tempest-HostsAdminNegativeTestJSON-2147473813-project-admin] 10.222.0.46 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 400 len: 189 microversion: 2.1 time: 0.007400 Jan 15 20:49:29.504810 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 192/362] 10.222.0.46 () {60 vars in 1189 bytes} [Sat Jan 15 20:49:29 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 189 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jan 15 20:49:29.516273 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a30e22e3-a882-4e8b-a56b-d7eb8f98fc34 tempest-HostsAdminNegativeTestJSON-1879506541 tempest-HostsAdminNegativeTestJSON-1879506541-project] Action: 'update', calling method: .version_select at 0x7f30c984e430>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:29.517811 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:29.517811 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:49:29.520941 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-a30e22e3-a882-4e8b-a56b-d7eb8f98fc34 tempest-HostsAdminNegativeTestJSON-1879506541 tempest-HostsAdminNegativeTestJSON-1879506541-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': 'dd3495e7791e45bc93144cd0f6f3c2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048da2207e7148a29f374daa6f68538b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:29.520941 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a30e22e3-a882-4e8b-a56b-d7eb8f98fc34 tempest-HostsAdminNegativeTestJSON-1879506541 tempest-HostsAdminNegativeTestJSON-1879506541-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:49:29.521269 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a30e22e3-a882-4e8b-a56b-d7eb8f98fc34 tempest-HostsAdminNegativeTestJSON-1879506541 tempest-HostsAdminNegativeTestJSON-1879506541-project] 10.222.0.46 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 403 len: 111 microversion: 2.1 time: 0.009430 Jan 15 20:49:29.521991 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 171/363] 10.222.0.46 () {60 vars in 1189 bytes} [Sat Jan 15 20:49:29 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 111 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:49:29.531386 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0222ee4d-ae5b-4e5f-b28d-32d02ac28f38 tempest-HostsAdminNegativeTestJSON-2147473813 tempest-HostsAdminNegativeTestJSON-2147473813-project-admin] Action: 'update', calling method: .version_select at 0x7f30c9c03430>, body: {"status": null, "maintenance_mode": null} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:29.532455 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0222ee4d-ae5b-4e5f-b28d-32d02ac28f38 tempest-HostsAdminNegativeTestJSON-2147473813 tempest-HostsAdminNegativeTestJSON-2147473813-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:49:29.533498 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0222ee4d-ae5b-4e5f-b28d-32d02ac28f38 tempest-HostsAdminNegativeTestJSON-2147473813 tempest-HostsAdminNegativeTestJSON-2147473813-project-admin] 10.222.0.46 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 400 len: 127 microversion: 2.1 time: 0.006587 Jan 15 20:49:29.533956 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 193/364] 10.222.0.46 () {60 vars in 1189 bytes} [Sat Jan 15 20:49:29 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 127 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 15 20:49:29.543574 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-155572a4-a08b-456f-8829-ae839904b207 tempest-HostsAdminNegativeTestJSON-2147473813 tempest-HostsAdminNegativeTestJSON-2147473813-project-admin] Action: 'update', calling method: .version_select at 0x7f30c97ac790>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:29.548401 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.hosts [None req-155572a4-a08b-456f-8829-ae839904b207 tempest-HostsAdminNegativeTestJSON-2147473813 tempest-HostsAdminNegativeTestJSON-2147473813-project-admin] Enabling host nonexistent_hostname. Jan 15 20:49:29.554443 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-155572a4-a08b-456f-8829-ae839904b207 tempest-HostsAdminNegativeTestJSON-2147473813 tempest-HostsAdminNegativeTestJSON-2147473813-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jan 15 20:49:29.555026 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-155572a4-a08b-456f-8829-ae839904b207 tempest-HostsAdminNegativeTestJSON-2147473813 tempest-HostsAdminNegativeTestJSON-2147473813-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:49:29.555830 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-155572a4-a08b-456f-8829-ae839904b207 tempest-HostsAdminNegativeTestJSON-2147473813 tempest-HostsAdminNegativeTestJSON-2147473813-project-admin] 10.222.0.46 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.016544 Jan 15 20:49:29.556361 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 172/365] 10.222.0.46 () {60 vars in 1210 bytes} [Sat Jan 15 20:49:29 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jan 15 20:49:29.731457 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-09bf6ffb-726b-44b4-b4ae-2b37420a3eef tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:29.732047 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-09bf6ffb-726b-44b4-b4ae-2b37420a3eef tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] [instance: 2b68335f-a94c-4801-8d8b-2fd387d1ced9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:29.738904 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-09bf6ffb-726b-44b4-b4ae-2b37420a3eef tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:29.739393 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-09bf6ffb-726b-44b4-b4ae-2b37420a3eef tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:29.740123 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-09bf6ffb-726b-44b4-b4ae-2b37420a3eef tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:29.740549 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-09bf6ffb-726b-44b4-b4ae-2b37420a3eef tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:29.894409 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-09bf6ffb-726b-44b4-b4ae-2b37420a3eef tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957f85f9c6794cccad71c553fb607ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82c6b47c4140e390464b153d2fe865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:29.903933 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-09bf6ffb-726b-44b4-b4ae-2b37420a3eef tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] 10.222.0.46 "GET /compute/v2.1/servers/2b68335f-a94c-4801-8d8b-2fd387d1ced9" status: 200 len: 1319 microversion: 2.1 time: 0.175383 Jan 15 20:49:29.904521 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 194/366] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:29 2022] GET /compute/v2.1/servers/2b68335f-a94c-4801-8d8b-2fd387d1ced9 => generated 1319 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:49:30.226610 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7138dd58-574c-4d60-b5a5-0e1fcb4c6bd2 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:30.227220 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-7138dd58-574c-4d60-b5a5-0e1fcb4c6bd2 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: 4d527369-954d-4ccc-9105-03b209d3523e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:30.237693 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7138dd58-574c-4d60-b5a5-0e1fcb4c6bd2 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:30.238144 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7138dd58-574c-4d60-b5a5-0e1fcb4c6bd2 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:30.239048 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7138dd58-574c-4d60-b5a5-0e1fcb4c6bd2 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:30.239477 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7138dd58-574c-4d60-b5a5-0e1fcb4c6bd2 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:30.505564 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-7138dd58-574c-4d60-b5a5-0e1fcb4c6bd2 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:30.513612 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7138dd58-574c-4d60-b5a5-0e1fcb4c6bd2 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/4d527369-954d-4ccc-9105-03b209d3523e" status: 200 len: 1476 microversion: 2.1 time: 0.290875 Jan 15 20:49:30.514387 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 195/367] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:30 2022] GET /compute/v2.1/servers/4d527369-954d-4ccc-9105-03b209d3523e => generated 1476 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:30.529372 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ed1cc8f8-7fdb-41b1-8f9c-3b4699ac3fea tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:30.530769 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ed1cc8f8-7fdb-41b1-8f9c-3b4699ac3fea tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 98d0ca37-0175-44e2-8a1d-965cdc517daf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:30.549514 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ed1cc8f8-7fdb-41b1-8f9c-3b4699ac3fea tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:30.552018 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ed1cc8f8-7fdb-41b1-8f9c-3b4699ac3fea tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:30.553077 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ed1cc8f8-7fdb-41b1-8f9c-3b4699ac3fea tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:30.553518 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ed1cc8f8-7fdb-41b1-8f9c-3b4699ac3fea tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:30.577016 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9bd59ec6-adb4-42c0-b351-eb6349279e12 tempest-HypervisorAdminUnderV252Test-1649119380 tempest-HypervisorAdminUnderV252Test-1649119380-project-admin] Calling method '.version_select at 0x7f30c984e040>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:30.578304 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:30.578304 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:49:30.580355 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9bd59ec6-adb4-42c0-b351-eb6349279e12 tempest-HypervisorAdminUnderV252Test-1649119380 tempest-HypervisorAdminUnderV252Test-1649119380-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:30.581350 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9bd59ec6-adb4-42c0-b351-eb6349279e12 tempest-HypervisorAdminUnderV252Test-1649119380 tempest-HypervisorAdminUnderV252Test-1649119380-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:30.597137 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9bd59ec6-adb4-42c0-b351-eb6349279e12 tempest-HypervisorAdminUnderV252Test-1649119380 tempest-HypervisorAdminUnderV252Test-1649119380-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:30.597724 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9bd59ec6-adb4-42c0-b351-eb6349279e12 tempest-HypervisorAdminUnderV252Test-1649119380 tempest-HypervisorAdminUnderV252Test-1649119380-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:30.610123 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9bd59ec6-adb4-42c0-b351-eb6349279e12 tempest-HypervisorAdminUnderV252Test-1649119380 tempest-HypervisorAdminUnderV252Test-1649119380-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:30.610725 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9bd59ec6-adb4-42c0-b351-eb6349279e12 tempest-HypervisorAdminUnderV252Test-1649119380 tempest-HypervisorAdminUnderV252Test-1649119380-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:30.615914 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ed1cc8f8-7fdb-41b1-8f9c-3b4699ac3fea tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action" status: 200 len: 16395 microversion: 2.1 time: 0.089702 Jan 15 20:49:30.617990 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 196/368] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:49:30 2022] POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action => generated 16395 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:49:30.619285 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-9bd59ec6-adb4-42c0-b351-eb6349279e12 tempest-HypervisorAdminUnderV252Test-1649119380 tempest-HypervisorAdminUnderV252Test-1649119380-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.457439 Jan 15 20:49:30.620301 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 173/369] 10.222.0.46 () {58 vars in 1145 bytes} [Sat Jan 15 20:49:30 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:49:30.624726 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-cc1bb78a-7ce5-47f7-8ec4-658f97a474bc req-451cc0fb-2c29-484f-a7c9-507e63405fc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "114ccb23-d953-4735-b61e-f0d62e19dce2", "name": "network-vif-plugged", "status": "completed", "tag": "dabee046-cd8e-45f7-9b2d-67a08fbc1ace"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:30.626792 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:30.626792 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:49:30.631608 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9134628a-db8e-4e3b-9e0a-a874bcff7053 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:30.632568 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-9134628a-db8e-4e3b-9e0a-a874bcff7053 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] [instance: 114ccb23-d953-4735-b61e-f0d62e19dce2] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:30.635932 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-cc1bb78a-7ce5-47f7-8ec4-658f97a474bc req-451cc0fb-2c29-484f-a7c9-507e63405fc9 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:30.636632 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-cc1bb78a-7ce5-47f7-8ec4-658f97a474bc req-451cc0fb-2c29-484f-a7c9-507e63405fc9 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:30.639077 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9134628a-db8e-4e3b-9e0a-a874bcff7053 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:30.639834 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9134628a-db8e-4e3b-9e0a-a874bcff7053 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:30.641027 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9134628a-db8e-4e3b-9e0a-a874bcff7053 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:30.644310 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9134628a-db8e-4e3b-9e0a-a874bcff7053 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:30.651228 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-cc1bb78a-7ce5-47f7-8ec4-658f97a474bc req-451cc0fb-2c29-484f-a7c9-507e63405fc9 service nova] Creating event network-vif-plugged:dabee046-cd8e-45f7-9b2d-67a08fbc1ace for instance 114ccb23-d953-4735-b61e-f0d62e19dce2 on nch1-master-1 Jan 15 20:49:30.660198 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-cc1bb78a-7ce5-47f7-8ec4-658f97a474bc req-451cc0fb-2c29-484f-a7c9-507e63405fc9 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040166 Jan 15 20:49:30.680988 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 197/370] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:49:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:49:30.723012 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-cad3d499-279e-408b-b3b2-e52f170abaf3 tempest-HypervisorAdminUnderV252Test-1649119380 tempest-HypervisorAdminUnderV252Test-1649119380-project-admin] Calling method '.version_select at 0x7f30c9848040>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:30.724387 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:30.724387 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:49:30.728766 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cad3d499-279e-408b-b3b2-e52f170abaf3 tempest-HypervisorAdminUnderV252Test-1649119380 tempest-HypervisorAdminUnderV252Test-1649119380-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:30.729686 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cad3d499-279e-408b-b3b2-e52f170abaf3 tempest-HypervisorAdminUnderV252Test-1649119380 tempest-HypervisorAdminUnderV252Test-1649119380-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:30.773050 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cad3d499-279e-408b-b3b2-e52f170abaf3 tempest-HypervisorAdminUnderV252Test-1649119380 tempest-HypervisorAdminUnderV252Test-1649119380-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:30.773936 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cad3d499-279e-408b-b3b2-e52f170abaf3 tempest-HypervisorAdminUnderV252Test-1649119380 tempest-HypervisorAdminUnderV252Test-1649119380-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:30.810486 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cad3d499-279e-408b-b3b2-e52f170abaf3 tempest-HypervisorAdminUnderV252Test-1649119380 tempest-HypervisorAdminUnderV252Test-1649119380-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:30.811095 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cad3d499-279e-408b-b3b2-e52f170abaf3 tempest-HypervisorAdminUnderV252Test-1649119380 tempest-HypervisorAdminUnderV252Test-1649119380-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:30.820122 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-cad3d499-279e-408b-b3b2-e52f170abaf3 tempest-HypervisorAdminUnderV252Test-1649119380 tempest-HypervisorAdminUnderV252Test-1649119380-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hypervisors/nch2-master-1/servers" status: 200 len: 196 microversion: 2.1 time: 0.136432 Jan 15 20:49:30.828599 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 198/371] 10.222.0.46 () {58 vars in 1211 bytes} [Sat Jan 15 20:49:30 2022] GET /compute/v2.1/os-hypervisors/nch2-master-1/servers => generated 196 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:49:30.833596 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-86faf8cf-a89e-4a44-8f3a-949116827d8d tempest-HypervisorAdminUnderV252Test-1649119380 tempest-HypervisorAdminUnderV252Test-1649119380-project-admin] Calling method '.version_select at 0x7f30c9803160>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:30.834666 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:30.834666 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:49:30.836388 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-86faf8cf-a89e-4a44-8f3a-949116827d8d tempest-HypervisorAdminUnderV252Test-1649119380 tempest-HypervisorAdminUnderV252Test-1649119380-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:30.836832 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-86faf8cf-a89e-4a44-8f3a-949116827d8d tempest-HypervisorAdminUnderV252Test-1649119380 tempest-HypervisorAdminUnderV252Test-1649119380-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:30.853782 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-86faf8cf-a89e-4a44-8f3a-949116827d8d tempest-HypervisorAdminUnderV252Test-1649119380 tempest-HypervisorAdminUnderV252Test-1649119380-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:30.854708 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-86faf8cf-a89e-4a44-8f3a-949116827d8d tempest-HypervisorAdminUnderV252Test-1649119380 tempest-HypervisorAdminUnderV252Test-1649119380-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:30.870224 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-86faf8cf-a89e-4a44-8f3a-949116827d8d tempest-HypervisorAdminUnderV252Test-1649119380 tempest-HypervisorAdminUnderV252Test-1649119380-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:30.872761 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-86faf8cf-a89e-4a44-8f3a-949116827d8d tempest-HypervisorAdminUnderV252Test-1649119380 tempest-HypervisorAdminUnderV252Test-1649119380-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:30.882200 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-86faf8cf-a89e-4a44-8f3a-949116827d8d tempest-HypervisorAdminUnderV252Test-1649119380 tempest-HypervisorAdminUnderV252Test-1649119380-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.051675 Jan 15 20:49:30.884087 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 199/372] 10.222.0.46 () {58 vars in 1145 bytes} [Sat Jan 15 20:49:30 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:49:30.893671 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-eb28d7b6-ecba-4aab-8338-b6097491d0c0 tempest-HypervisorAdminUnderV252Test-1649119380 tempest-HypervisorAdminUnderV252Test-1649119380-project-admin] Calling method '.version_select at 0x7f30c98989d0>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:30.895378 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:30.895378 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:49:30.897556 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-eb28d7b6-ecba-4aab-8338-b6097491d0c0 tempest-HypervisorAdminUnderV252Test-1649119380 tempest-HypervisorAdminUnderV252Test-1649119380-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:30.898226 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-eb28d7b6-ecba-4aab-8338-b6097491d0c0 tempest-HypervisorAdminUnderV252Test-1649119380 tempest-HypervisorAdminUnderV252Test-1649119380-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:30.911878 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-eb28d7b6-ecba-4aab-8338-b6097491d0c0 tempest-HypervisorAdminUnderV252Test-1649119380 tempest-HypervisorAdminUnderV252Test-1649119380-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:30.912521 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-eb28d7b6-ecba-4aab-8338-b6097491d0c0 tempest-HypervisorAdminUnderV252Test-1649119380 tempest-HypervisorAdminUnderV252Test-1649119380-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:30.920172 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-eb28d7b6-ecba-4aab-8338-b6097491d0c0 tempest-HypervisorAdminUnderV252Test-1649119380 tempest-HypervisorAdminUnderV252Test-1649119380-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hypervisors/nch2-master-1/search" status: 200 len: 104 microversion: 2.1 time: 0.030517 Jan 15 20:49:30.921651 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 200/373] 10.222.0.46 () {58 vars in 1208 bytes} [Sat Jan 15 20:49:30 2022] GET /compute/v2.1/os-hypervisors/nch2-master-1/search => generated 104 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:49:30.926616 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c57d6c83-c056-44ee-9a7b-1d62192acc99 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:30.927502 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c57d6c83-c056-44ee-9a7b-1d62192acc99 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] [instance: 2b68335f-a94c-4801-8d8b-2fd387d1ced9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:30.934111 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c57d6c83-c056-44ee-9a7b-1d62192acc99 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:30.934948 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c57d6c83-c056-44ee-9a7b-1d62192acc99 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:30.936170 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c57d6c83-c056-44ee-9a7b-1d62192acc99 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:30.936799 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c57d6c83-c056-44ee-9a7b-1d62192acc99 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:30.947729 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-9134628a-db8e-4e3b-9e0a-a874bcff7053 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0079c95473594ee9ada5a4bc6820a111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac923ea754345a9b79457833bd72da4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:30.960720 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-9134628a-db8e-4e3b-9e0a-a874bcff7053 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] 10.222.0.46 "GET /compute/v2.1/servers/114ccb23-d953-4735-b61e-f0d62e19dce2" status: 200 len: 1318 microversion: 2.1 time: 0.338702 Jan 15 20:49:30.973306 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 174/374] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:30 2022] GET /compute/v2.1/servers/114ccb23-d953-4735-b61e-f0d62e19dce2 => generated 1318 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:31.098056 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-c57d6c83-c056-44ee-9a7b-1d62192acc99 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957f85f9c6794cccad71c553fb607ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82c6b47c4140e390464b153d2fe865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:31.110416 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c57d6c83-c056-44ee-9a7b-1d62192acc99 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] 10.222.0.46 "GET /compute/v2.1/servers/2b68335f-a94c-4801-8d8b-2fd387d1ced9" status: 200 len: 1469 microversion: 2.1 time: 0.187295 Jan 15 20:49:31.121189 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 201/375] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:30 2022] GET /compute/v2.1/servers/2b68335f-a94c-4801-8d8b-2fd387d1ced9 => generated 1469 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:31.128193 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-bf496189-e258-4dc9-b137-f168f6068965 tempest-DeleteServersAdminTestJSON-11303861 tempest-DeleteServersAdminTestJSON-11303861-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:31.129319 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-bf496189-e258-4dc9-b137-f168f6068965 tempest-DeleteServersAdminTestJSON-11303861 tempest-DeleteServersAdminTestJSON-11303861-project-admin] [instance: 2b68335f-a94c-4801-8d8b-2fd387d1ced9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:31.135177 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bf496189-e258-4dc9-b137-f168f6068965 tempest-DeleteServersAdminTestJSON-11303861 tempest-DeleteServersAdminTestJSON-11303861-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:31.135632 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bf496189-e258-4dc9-b137-f168f6068965 tempest-DeleteServersAdminTestJSON-11303861 tempest-DeleteServersAdminTestJSON-11303861-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:31.136554 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bf496189-e258-4dc9-b137-f168f6068965 tempest-DeleteServersAdminTestJSON-11303861 tempest-DeleteServersAdminTestJSON-11303861-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:31.137029 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bf496189-e258-4dc9-b137-f168f6068965 tempest-DeleteServersAdminTestJSON-11303861 tempest-DeleteServersAdminTestJSON-11303861-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:31.269922 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-bf496189-e258-4dc9-b137-f168f6068965 tempest-DeleteServersAdminTestJSON-11303861 tempest-DeleteServersAdminTestJSON-11303861-project-admin] 10.222.0.46 "POST /compute/v2.1/servers/2b68335f-a94c-4801-8d8b-2fd387d1ced9/action" status: 202 len: 0 microversion: 2.1 time: 0.145278 Jan 15 20:49:31.270940 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 175/376] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:49:31 2022] POST /compute/v2.1/servers/2b68335f-a94c-4801-8d8b-2fd387d1ced9/action => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 20:49:31.278455 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d0ed6c80-072d-4f03-8fee-515ec4435240 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:31.279194 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-d0ed6c80-072d-4f03-8fee-515ec4435240 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] [instance: 2b68335f-a94c-4801-8d8b-2fd387d1ced9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:31.290986 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d0ed6c80-072d-4f03-8fee-515ec4435240 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:31.291623 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d0ed6c80-072d-4f03-8fee-515ec4435240 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:31.292579 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d0ed6c80-072d-4f03-8fee-515ec4435240 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:31.293141 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d0ed6c80-072d-4f03-8fee-515ec4435240 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:31.347921 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d0ed6c80-072d-4f03-8fee-515ec4435240 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:31.348371 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d0ed6c80-072d-4f03-8fee-515ec4435240 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:31.348829 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.objects.instance [None req-d0ed6c80-072d-4f03-8fee-515ec4435240 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lazy-loading 'fault' on Instance uuid 2b68335f-a94c-4801-8d8b-2fd387d1ced9 {{(pid=129366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 20:49:31.531368 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f43486bf-9fa2-4ef0-b6d1-d121d8a4602f tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:31.531988 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f43486bf-9fa2-4ef0-b6d1-d121d8a4602f tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: 4d527369-954d-4ccc-9105-03b209d3523e] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:31.546855 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f43486bf-9fa2-4ef0-b6d1-d121d8a4602f tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:31.547306 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f43486bf-9fa2-4ef0-b6d1-d121d8a4602f tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:31.552389 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f43486bf-9fa2-4ef0-b6d1-d121d8a4602f tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:31.553372 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f43486bf-9fa2-4ef0-b6d1-d121d8a4602f tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:31.610465 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-d0ed6c80-072d-4f03-8fee-515ec4435240 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957f85f9c6794cccad71c553fb607ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82c6b47c4140e390464b153d2fe865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:31.618438 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d0ed6c80-072d-4f03-8fee-515ec4435240 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] 10.222.0.46 "GET /compute/v2.1/servers/2b68335f-a94c-4801-8d8b-2fd387d1ced9" status: 200 len: 1452 microversion: 2.1 time: 0.343048 Jan 15 20:49:31.629313 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 202/377] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:31 2022] GET /compute/v2.1/servers/2b68335f-a94c-4801-8d8b-2fd387d1ced9 => generated 1452 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:31.634220 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-de43ec65-b9a3-4d96-994f-9bfa0d6932db tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:31.635313 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-de43ec65-b9a3-4d96-994f-9bfa0d6932db tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 98d0ca37-0175-44e2-8a1d-965cdc517daf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:31.642256 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-de43ec65-b9a3-4d96-994f-9bfa0d6932db tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:31.642879 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-de43ec65-b9a3-4d96-994f-9bfa0d6932db tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:31.643830 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-de43ec65-b9a3-4d96-994f-9bfa0d6932db tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:31.644399 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-de43ec65-b9a3-4d96-994f-9bfa0d6932db tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:31.700006 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-de43ec65-b9a3-4d96-994f-9bfa0d6932db tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action" status: 200 len: 16395 microversion: 2.1 time: 0.069252 Jan 15 20:49:31.701543 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 203/378] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:49:31 2022] POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action => generated 16395 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:49:31.709346 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-96539709-d3bb-44a7-9f3e-4fe17c1f0b1f tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:31.710966 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-96539709-d3bb-44a7-9f3e-4fe17c1f0b1f tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] [instance: 2b68335f-a94c-4801-8d8b-2fd387d1ced9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:31.721254 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-96539709-d3bb-44a7-9f3e-4fe17c1f0b1f tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:31.722068 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-96539709-d3bb-44a7-9f3e-4fe17c1f0b1f tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:31.724665 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-96539709-d3bb-44a7-9f3e-4fe17c1f0b1f tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:31.725369 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-96539709-d3bb-44a7-9f3e-4fe17c1f0b1f tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:31.759896 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-96539709-d3bb-44a7-9f3e-4fe17c1f0b1f tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] [instance: 2b68335f-a94c-4801-8d8b-2fd387d1ced9] Going to try to terminate instance {{(pid=129366) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 20:49:31.865652 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-96539709-d3bb-44a7-9f3e-4fe17c1f0b1f tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] 10.222.0.46 "DELETE /compute/v2.1/servers/2b68335f-a94c-4801-8d8b-2fd387d1ced9" status: 204 len: 0 microversion: 2.1 time: 0.161288 Jan 15 20:49:31.866819 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 204/379] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 20:49:31 2022] DELETE /compute/v2.1/servers/2b68335f-a94c-4801-8d8b-2fd387d1ced9 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 20:49:31.918342 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-f43486bf-9fa2-4ef0-b6d1-d121d8a4602f tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:31.928824 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f43486bf-9fa2-4ef0-b6d1-d121d8a4602f tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/4d527369-954d-4ccc-9105-03b209d3523e" status: 200 len: 1476 microversion: 2.1 time: 0.401761 Jan 15 20:49:31.929989 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 176/380] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:31 2022] GET /compute/v2.1/servers/4d527369-954d-4ccc-9105-03b209d3523e => generated 1476 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:31.947349 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-580398c4-2570-4547-9e34-a66a12372bf4 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:31.948083 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-580398c4-2570-4547-9e34-a66a12372bf4 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] [instance: 2b68335f-a94c-4801-8d8b-2fd387d1ced9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:31.959073 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-580398c4-2570-4547-9e34-a66a12372bf4 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:31.960629 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-580398c4-2570-4547-9e34-a66a12372bf4 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:31.961883 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-580398c4-2570-4547-9e34-a66a12372bf4 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:31.963024 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-580398c4-2570-4547-9e34-a66a12372bf4 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:32.025761 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-580398c4-2570-4547-9e34-a66a12372bf4 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:32.030023 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-580398c4-2570-4547-9e34-a66a12372bf4 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:32.031008 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.objects.instance [None req-580398c4-2570-4547-9e34-a66a12372bf4 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lazy-loading 'fault' on Instance uuid 2b68335f-a94c-4801-8d8b-2fd387d1ced9 {{(pid=129365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 20:49:32.197914 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-580398c4-2570-4547-9e34-a66a12372bf4 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957f85f9c6794cccad71c553fb607ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82c6b47c4140e390464b153d2fe865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:32.211784 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-580398c4-2570-4547-9e34-a66a12372bf4 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] 10.222.0.46 "GET /compute/v2.1/servers/2b68335f-a94c-4801-8d8b-2fd387d1ced9" status: 200 len: 1458 microversion: 2.1 time: 0.280062 Jan 15 20:49:32.212934 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e1921254-d165-4865-8080-e3d1f86a9506 tempest-FlavorsExtraSpecsNegativeTestJSON-455901947 tempest-FlavorsExtraSpecsNegativeTestJSON-455901947-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-893109913", "ram": 512, "vcpus": 1, "disk": 10, "id": 1242436321, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:32.214200 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 177/381] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:31 2022] GET /compute/v2.1/servers/2b68335f-a94c-4801-8d8b-2fd387d1ced9 => generated 1458 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:32.215252 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:32.215252 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:49:32.219437 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9fc9253f-5696-400e-84a7-226588f06e02 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:32.220393 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-9fc9253f-5696-400e-84a7-226588f06e02 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] [instance: 114ccb23-d953-4735-b61e-f0d62e19dce2] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:32.230654 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9fc9253f-5696-400e-84a7-226588f06e02 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:32.231296 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9fc9253f-5696-400e-84a7-226588f06e02 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:32.232241 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9fc9253f-5696-400e-84a7-226588f06e02 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:32.232670 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9fc9253f-5696-400e-84a7-226588f06e02 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:32.256513 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e1921254-d165-4865-8080-e3d1f86a9506 tempest-FlavorsExtraSpecsNegativeTestJSON-455901947 tempest-FlavorsExtraSpecsNegativeTestJSON-455901947-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.386956 Jan 15 20:49:32.258334 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 205/382] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 20:49:31 2022] POST /compute/v2.1/flavors => generated 415 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:49:32.398657 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-9fc9253f-5696-400e-84a7-226588f06e02 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0079c95473594ee9ada5a4bc6820a111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac923ea754345a9b79457833bd72da4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:32.407237 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-9fc9253f-5696-400e-84a7-226588f06e02 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] 10.222.0.46 "GET /compute/v2.1/servers/114ccb23-d953-4735-b61e-f0d62e19dce2" status: 200 len: 1318 microversion: 2.1 time: 0.191227 Jan 15 20:49:32.408015 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 178/383] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:32 2022] GET /compute/v2.1/servers/114ccb23-d953-4735-b61e-f0d62e19dce2 => generated 1318 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:32.597682 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-df33142d-44dd-4568-a347-802acda34f43 tempest-FlavorsExtraSpecsNegativeTestJSON-586501182 tempest-FlavorsExtraSpecsNegativeTestJSON-586501182-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:32.608109 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-df33142d-44dd-4568-a347-802acda34f43 tempest-FlavorsExtraSpecsNegativeTestJSON-586501182 tempest-FlavorsExtraSpecsNegativeTestJSON-586501182-project] HTTP exception thrown: Flavor 1242436321 has no extra specs with key hw:cpu_thread_policy. Jan 15 20:49:32.609328 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-df33142d-44dd-4568-a347-802acda34f43 tempest-FlavorsExtraSpecsNegativeTestJSON-586501182 tempest-FlavorsExtraSpecsNegativeTestJSON-586501182-project] Returning 404 to user: Flavor 1242436321 has no extra specs with key hw:cpu_thread_policy. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:49:32.611275 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-df33142d-44dd-4568-a347-802acda34f43 tempest-FlavorsExtraSpecsNegativeTestJSON-586501182 tempest-FlavorsExtraSpecsNegativeTestJSON-586501182-project] 10.222.0.46 "GET /compute/v2.1/flavors/1242436321/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.345771 Jan 15 20:49:32.617302 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 206/384] 10.222.0.46 () {58 vars in 1265 bytes} [Sat Jan 15 20:49:32 2022] GET /compute/v2.1/flavors/1242436321/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 352 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 15 20:49:32.622770 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-27616d96-ad2f-459a-b985-6b2365277795 tempest-FlavorsExtraSpecsNegativeTestJSON-586501182 tempest-FlavorsExtraSpecsNegativeTestJSON-586501182-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:32.624103 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:32.624103 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:49:32.625309 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-27616d96-ad2f-459a-b985-6b2365277795 tempest-FlavorsExtraSpecsNegativeTestJSON-586501182 tempest-FlavorsExtraSpecsNegativeTestJSON-586501182-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': '531196ba6521420398ae51fbf33e5534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c4ad7c78c714501a5d5629a7930e9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:32.625953 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-27616d96-ad2f-459a-b985-6b2365277795 tempest-FlavorsExtraSpecsNegativeTestJSON-586501182 tempest-FlavorsExtraSpecsNegativeTestJSON-586501182-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:49:32.626736 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-27616d96-ad2f-459a-b985-6b2365277795 tempest-FlavorsExtraSpecsNegativeTestJSON-586501182 tempest-FlavorsExtraSpecsNegativeTestJSON-586501182-project] 10.222.0.46 "POST /compute/v2.1/flavors/1242436321/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.008041 Jan 15 20:49:32.627243 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 179/385] 10.222.0.46 () {60 vars in 1223 bytes} [Sat Jan 15 20:49:32 2022] POST /compute/v2.1/flavors/1242436321/os-extra_specs => generated 124 bytes in 10 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:49:32.636348 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-868ce23f-5ac1-4b49-af2c-9eb31d04e94f tempest-FlavorsExtraSpecsNegativeTestJSON-455901947 tempest-FlavorsExtraSpecsNegativeTestJSON-455901947-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:32.637854 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:32.637854 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:49:32.663789 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-868ce23f-5ac1-4b49-af2c-9eb31d04e94f tempest-FlavorsExtraSpecsNegativeTestJSON-455901947 tempest-FlavorsExtraSpecsNegativeTestJSON-455901947-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors/1242436321/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.031126 Jan 15 20:49:32.664371 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 207/386] 10.222.0.46 () {60 vars in 1223 bytes} [Sat Jan 15 20:49:32 2022] POST /compute/v2.1/flavors/1242436321/os-extra_specs => generated 66 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 20:49:32.674192 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f5236ec6-dd97-40f9-884d-9e0671fc9083 tempest-FlavorsExtraSpecsNegativeTestJSON-586501182 tempest-FlavorsExtraSpecsNegativeTestJSON-586501182-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:32.674966 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:32.674966 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:49:32.675881 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-f5236ec6-dd97-40f9-884d-9e0671fc9083 tempest-FlavorsExtraSpecsNegativeTestJSON-586501182 tempest-FlavorsExtraSpecsNegativeTestJSON-586501182-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': '531196ba6521420398ae51fbf33e5534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c4ad7c78c714501a5d5629a7930e9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:32.676499 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f5236ec6-dd97-40f9-884d-9e0671fc9083 tempest-FlavorsExtraSpecsNegativeTestJSON-586501182 tempest-FlavorsExtraSpecsNegativeTestJSON-586501182-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:49:32.677490 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f5236ec6-dd97-40f9-884d-9e0671fc9083 tempest-FlavorsExtraSpecsNegativeTestJSON-586501182 tempest-FlavorsExtraSpecsNegativeTestJSON-586501182-project] 10.222.0.46 "DELETE /compute/v2.1/flavors/1242436321/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.007205 Jan 15 20:49:32.682418 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 180/387] 10.222.0.46 () {58 vars in 1247 bytes} [Sat Jan 15 20:49:32 2022] DELETE /compute/v2.1/flavors/1242436321/os-extra_specs/hw:numa_nodes => generated 124 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:49:32.688059 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a204d96e-19de-4e5f-9328-475fad06f133 tempest-FlavorsExtraSpecsNegativeTestJSON-455901947 tempest-FlavorsExtraSpecsNegativeTestJSON-455901947-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:32.711951 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-326d30a3-8e36-4e7a-9a8f-a9ab6d3eb433 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:32.713456 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a204d96e-19de-4e5f-9328-475fad06f133 tempest-FlavorsExtraSpecsNegativeTestJSON-455901947 tempest-FlavorsExtraSpecsNegativeTestJSON-455901947-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors/1242436321/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.028043 Jan 15 20:49:32.715198 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-326d30a3-8e36-4e7a-9a8f-a9ab6d3eb433 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 98d0ca37-0175-44e2-8a1d-965cdc517daf] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:32.721016 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 208/388] 10.222.0.46 () {60 vars in 1223 bytes} [Sat Jan 15 20:49:32 2022] POST /compute/v2.1/flavors/1242436321/os-extra_specs => generated 66 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 20:49:32.721625 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-326d30a3-8e36-4e7a-9a8f-a9ab6d3eb433 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:32.722278 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-326d30a3-8e36-4e7a-9a8f-a9ab6d3eb433 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:32.723492 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-326d30a3-8e36-4e7a-9a8f-a9ab6d3eb433 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:32.724113 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-326d30a3-8e36-4e7a-9a8f-a9ab6d3eb433 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:32.726513 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8df58782-caa8-4a61-8cbb-6ed906098ac4 tempest-FlavorsExtraSpecsNegativeTestJSON-586501182 tempest-FlavorsExtraSpecsNegativeTestJSON-586501182-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:32.728082 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:32.728082 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:49:32.729065 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-8df58782-caa8-4a61-8cbb-6ed906098ac4 tempest-FlavorsExtraSpecsNegativeTestJSON-586501182 tempest-FlavorsExtraSpecsNegativeTestJSON-586501182-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': '531196ba6521420398ae51fbf33e5534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c4ad7c78c714501a5d5629a7930e9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:32.729764 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8df58782-caa8-4a61-8cbb-6ed906098ac4 tempest-FlavorsExtraSpecsNegativeTestJSON-586501182 tempest-FlavorsExtraSpecsNegativeTestJSON-586501182-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:49:32.732568 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-8df58782-caa8-4a61-8cbb-6ed906098ac4 tempest-FlavorsExtraSpecsNegativeTestJSON-586501182 tempest-FlavorsExtraSpecsNegativeTestJSON-586501182-project] 10.222.0.46 "PUT /compute/v2.1/flavors/1242436321/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.010109 Jan 15 20:49:32.738070 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 209/389] 10.222.0.46 () {60 vars in 1264 bytes} [Sat Jan 15 20:49:32 2022] PUT /compute/v2.1/flavors/1242436321/os-extra_specs/hw:numa_nodes => generated 124 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:49:32.743632 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-6b0b89e0-9496-43be-af82-0739c06cf03a tempest-FlavorsExtraSpecsNegativeTestJSON-455901947 tempest-FlavorsExtraSpecsNegativeTestJSON-455901947-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:32.744585 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:32.744585 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:49:32.754627 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-6b0b89e0-9496-43be-af82-0739c06cf03a tempest-FlavorsExtraSpecsNegativeTestJSON-455901947 tempest-FlavorsExtraSpecsNegativeTestJSON-455901947-project-admin] HTTP exception thrown: Flavor 1242436321 has no extra specs with key hw:cpu_thread_policy. Jan 15 20:49:32.755460 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-6b0b89e0-9496-43be-af82-0739c06cf03a tempest-FlavorsExtraSpecsNegativeTestJSON-455901947 tempest-FlavorsExtraSpecsNegativeTestJSON-455901947-project-admin] Returning 404 to user: Flavor 1242436321 has no extra specs with key hw:cpu_thread_policy. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:49:32.756511 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-6b0b89e0-9496-43be-af82-0739c06cf03a tempest-FlavorsExtraSpecsNegativeTestJSON-455901947 tempest-FlavorsExtraSpecsNegativeTestJSON-455901947-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/1242436321/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.017298 Jan 15 20:49:32.757240 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 210/390] 10.222.0.46 () {58 vars in 1268 bytes} [Sat Jan 15 20:49:32 2022] DELETE /compute/v2.1/flavors/1242436321/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:49:32.769553 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-32809322-3124-42d7-8888-df2ecfac7d85 tempest-FlavorsExtraSpecsNegativeTestJSON-455901947 tempest-FlavorsExtraSpecsNegativeTestJSON-455901947-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:32.775285 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-326d30a3-8e36-4e7a-9a8f-a9ab6d3eb433 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action" status: 200 len: 16395 microversion: 2.1 time: 0.067965 Jan 15 20:49:32.776109 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 181/391] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:49:32 2022] POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action => generated 16395 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 20:49:32.779829 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-32809322-3124-42d7-8888-df2ecfac7d85 tempest-FlavorsExtraSpecsNegativeTestJSON-455901947 tempest-FlavorsExtraSpecsNegativeTestJSON-455901947-project-admin] HTTP exception thrown: Request body and URI mismatch Jan 15 20:49:32.781225 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-32809322-3124-42d7-8888-df2ecfac7d85 tempest-FlavorsExtraSpecsNegativeTestJSON-455901947 tempest-FlavorsExtraSpecsNegativeTestJSON-455901947-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:49:32.782240 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-32809322-3124-42d7-8888-df2ecfac7d85 tempest-FlavorsExtraSpecsNegativeTestJSON-455901947 tempest-FlavorsExtraSpecsNegativeTestJSON-455901947-project-admin] 10.222.0.46 "PUT /compute/v2.1/flavors/1242436321/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.017154 Jan 15 20:49:32.783009 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 211/392] 10.222.0.46 () {60 vars in 1264 bytes} [Sat Jan 15 20:49:32 2022] PUT /compute/v2.1/flavors/1242436321/os-extra_specs/hw:numa_nodes => generated 73 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jan 15 20:49:32.793550 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-fd136ede-146f-4ab6-8cb2-de8d8f9d0996 tempest-FlavorsExtraSpecsNegativeTestJSON-455901947 tempest-FlavorsExtraSpecsNegativeTestJSON-455901947-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:32.795270 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-fd136ede-146f-4ab6-8cb2-de8d8f9d0996 tempest-FlavorsExtraSpecsNegativeTestJSON-455901947 tempest-FlavorsExtraSpecsNegativeTestJSON-455901947-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:49:32.796873 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-fd136ede-146f-4ab6-8cb2-de8d8f9d0996 tempest-FlavorsExtraSpecsNegativeTestJSON-455901947 tempest-FlavorsExtraSpecsNegativeTestJSON-455901947-project-admin] 10.222.0.46 "PUT /compute/v2.1/flavors/1242436321/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.007624 Jan 15 20:49:32.797979 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 182/393] 10.222.0.46 () {60 vars in 1264 bytes} [Sat Jan 15 20:49:32 2022] PUT /compute/v2.1/flavors/1242436321/os-extra_specs/hw:numa_nodes => generated 117 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 15 20:49:32.809070 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0dd59379-a695-4c6b-96e9-ac06f10ec4df tempest-FlavorsExtraSpecsNegativeTestJSON-455901947 tempest-FlavorsExtraSpecsNegativeTestJSON-455901947-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:32.809976 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:32.809976 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:49:32.831591 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0dd59379-a695-4c6b-96e9-ac06f10ec4df tempest-FlavorsExtraSpecsNegativeTestJSON-455901947 tempest-FlavorsExtraSpecsNegativeTestJSON-455901947-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/1242436321" status: 202 len: 0 microversion: 2.1 time: 0.027728 Jan 15 20:49:32.837332 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 212/394] 10.222.0.46 () {58 vars in 1160 bytes} [Sat Jan 15 20:49:32 2022] DELETE /compute/v2.1/flavors/1242436321 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 20:49:32.843617 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-0be0419d-4e32-4674-b75b-5dae21fb56c9 tempest-FlavorsExtraSpecsNegativeTestJSON-455901947 tempest-FlavorsExtraSpecsNegativeTestJSON-455901947-project-admin] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:32.870614 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-0be0419d-4e32-4674-b75b-5dae21fb56c9 tempest-FlavorsExtraSpecsNegativeTestJSON-455901947 tempest-FlavorsExtraSpecsNegativeTestJSON-455901947-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.032141 Jan 15 20:49:32.871200 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 183/395] 10.222.0.46 () {58 vars in 1145 bytes} [Sat Jan 15 20:49:32 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:32.949406 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-2e3a88dc-48c6-44b4-b87d-c5dc7bcdc678 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:32.950405 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-2e3a88dc-48c6-44b4-b87d-c5dc7bcdc678 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: 4d527369-954d-4ccc-9105-03b209d3523e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:32.958444 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2e3a88dc-48c6-44b4-b87d-c5dc7bcdc678 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:32.959215 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2e3a88dc-48c6-44b4-b87d-c5dc7bcdc678 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:32.960135 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2e3a88dc-48c6-44b4-b87d-c5dc7bcdc678 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:32.960787 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2e3a88dc-48c6-44b4-b87d-c5dc7bcdc678 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:33.173978 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-2e3a88dc-48c6-44b4-b87d-c5dc7bcdc678 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:33.181996 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-2e3a88dc-48c6-44b4-b87d-c5dc7bcdc678 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/4d527369-954d-4ccc-9105-03b209d3523e" status: 200 len: 1476 microversion: 2.1 time: 0.238672 Jan 15 20:49:33.182763 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 213/396] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:32 2022] GET /compute/v2.1/servers/4d527369-954d-4ccc-9105-03b209d3523e => generated 1476 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:33.230266 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e23b2141-7dd0-4a4d-9d7f-77c8f45ad06b tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:33.231050 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e23b2141-7dd0-4a4d-9d7f-77c8f45ad06b tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] [instance: 2b68335f-a94c-4801-8d8b-2fd387d1ced9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:33.238237 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e23b2141-7dd0-4a4d-9d7f-77c8f45ad06b tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:33.238870 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e23b2141-7dd0-4a4d-9d7f-77c8f45ad06b tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:33.239826 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e23b2141-7dd0-4a4d-9d7f-77c8f45ad06b tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:33.240431 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e23b2141-7dd0-4a4d-9d7f-77c8f45ad06b tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:33.278901 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e23b2141-7dd0-4a4d-9d7f-77c8f45ad06b tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:33.279352 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e23b2141-7dd0-4a4d-9d7f-77c8f45ad06b tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:33.279804 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.objects.instance [None req-e23b2141-7dd0-4a4d-9d7f-77c8f45ad06b tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lazy-loading 'fault' on Instance uuid 2b68335f-a94c-4801-8d8b-2fd387d1ced9 {{(pid=129365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 20:49:33.416648 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-e23b2141-7dd0-4a4d-9d7f-77c8f45ad06b tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957f85f9c6794cccad71c553fb607ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82c6b47c4140e390464b153d2fe865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:33.424352 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-6db4ec86-2aae-4461-a47d-c0f77ed2fc6b tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:33.425185 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-6db4ec86-2aae-4461-a47d-c0f77ed2fc6b tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] [instance: 114ccb23-d953-4735-b61e-f0d62e19dce2] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:33.425861 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e23b2141-7dd0-4a4d-9d7f-77c8f45ad06b tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] 10.222.0.46 "GET /compute/v2.1/servers/2b68335f-a94c-4801-8d8b-2fd387d1ced9" status: 200 len: 1458 microversion: 2.1 time: 0.199464 Jan 15 20:49:33.426607 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 184/397] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:33 2022] GET /compute/v2.1/servers/2b68335f-a94c-4801-8d8b-2fd387d1ced9 => generated 1458 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:33.432076 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6db4ec86-2aae-4461-a47d-c0f77ed2fc6b tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:33.433406 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6db4ec86-2aae-4461-a47d-c0f77ed2fc6b tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:33.434607 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6db4ec86-2aae-4461-a47d-c0f77ed2fc6b tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:33.435250 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6db4ec86-2aae-4461-a47d-c0f77ed2fc6b tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:33.725968 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-6db4ec86-2aae-4461-a47d-c0f77ed2fc6b tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0079c95473594ee9ada5a4bc6820a111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac923ea754345a9b79457833bd72da4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:33.734638 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-6db4ec86-2aae-4461-a47d-c0f77ed2fc6b tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] 10.222.0.46 "GET /compute/v2.1/servers/114ccb23-d953-4735-b61e-f0d62e19dce2" status: 200 len: 1467 microversion: 2.1 time: 0.314337 Jan 15 20:49:33.736627 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 214/398] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:33 2022] GET /compute/v2.1/servers/114ccb23-d953-4735-b61e-f0d62e19dce2 => generated 1467 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:49:33.754432 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e352c5e1-154d-4ac0-b466-8461729c8835 tempest-LiveMigrationNegativeTest-1496050294 tempest-LiveMigrationNegativeTest-1496050294-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:33.758930 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e352c5e1-154d-4ac0-b466-8461729c8835 tempest-LiveMigrationNegativeTest-1496050294 tempest-LiveMigrationNegativeTest-1496050294-project-admin] [instance: 114ccb23-d953-4735-b61e-f0d62e19dce2] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:33.767952 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e352c5e1-154d-4ac0-b466-8461729c8835 tempest-LiveMigrationNegativeTest-1496050294 tempest-LiveMigrationNegativeTest-1496050294-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:33.768629 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e352c5e1-154d-4ac0-b466-8461729c8835 tempest-LiveMigrationNegativeTest-1496050294 tempest-LiveMigrationNegativeTest-1496050294-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:33.769815 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e352c5e1-154d-4ac0-b466-8461729c8835 tempest-LiveMigrationNegativeTest-1496050294 tempest-LiveMigrationNegativeTest-1496050294-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:33.770460 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e352c5e1-154d-4ac0-b466-8461729c8835 tempest-LiveMigrationNegativeTest-1496050294 tempest-LiveMigrationNegativeTest-1496050294-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:33.791767 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9995f5d6-19bf-4197-8476-1feb95f5632a tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:33.793906 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-9995f5d6-19bf-4197-8476-1feb95f5632a tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 98d0ca37-0175-44e2-8a1d-965cdc517daf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:33.801391 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9995f5d6-19bf-4197-8476-1feb95f5632a tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:33.802197 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9995f5d6-19bf-4197-8476-1feb95f5632a tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:33.803129 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9995f5d6-19bf-4197-8476-1feb95f5632a tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:33.803735 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9995f5d6-19bf-4197-8476-1feb95f5632a tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:33.830866 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.objects.instance [None req-e352c5e1-154d-4ac0-b466-8461729c8835 tempest-LiveMigrationNegativeTest-1496050294 tempest-LiveMigrationNegativeTest-1496050294-project-admin] Lazy-loading 'flavor' on Instance uuid 114ccb23-d953-4735-b61e-f0d62e19dce2 {{(pid=129365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 20:49:33.858841 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-9995f5d6-19bf-4197-8476-1feb95f5632a tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action" status: 200 len: 16395 microversion: 2.1 time: 0.075856 Jan 15 20:49:33.859484 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 215/399] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:49:33 2022] POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action => generated 16395 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:49:33.950710 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e352c5e1-154d-4ac0-b466-8461729c8835 tempest-LiveMigrationNegativeTest-1496050294 tempest-LiveMigrationNegativeTest-1496050294-project-admin] 10.222.0.46 "POST /compute/v2.1/servers/114ccb23-d953-4735-b61e-f0d62e19dce2/action" status: 202 len: 0 microversion: 2.1 time: 0.200077 Jan 15 20:49:33.956417 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 185/400] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:49:33 2022] POST /compute/v2.1/servers/114ccb23-d953-4735-b61e-f0d62e19dce2/action => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 20:49:33.971268 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d39efe80-bb67-41c7-8c13-0f7d5ab4287a tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:33.972064 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-d39efe80-bb67-41c7-8c13-0f7d5ab4287a tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] [instance: 114ccb23-d953-4735-b61e-f0d62e19dce2] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:33.987909 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d39efe80-bb67-41c7-8c13-0f7d5ab4287a tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:33.990774 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d39efe80-bb67-41c7-8c13-0f7d5ab4287a tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:33.993858 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d39efe80-bb67-41c7-8c13-0f7d5ab4287a tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:33.996275 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d39efe80-bb67-41c7-8c13-0f7d5ab4287a tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:34.202576 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9fde7270-8c80-4d13-a910-7f7fea887b79 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:34.203386 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-9fde7270-8c80-4d13-a910-7f7fea887b79 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: 4d527369-954d-4ccc-9105-03b209d3523e] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:34.217079 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9fde7270-8c80-4d13-a910-7f7fea887b79 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:34.217651 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9fde7270-8c80-4d13-a910-7f7fea887b79 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:34.218928 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9fde7270-8c80-4d13-a910-7f7fea887b79 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:34.224919 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9fde7270-8c80-4d13-a910-7f7fea887b79 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:34.462222 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-d39efe80-bb67-41c7-8c13-0f7d5ab4287a tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0079c95473594ee9ada5a4bc6820a111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac923ea754345a9b79457833bd72da4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:34.476064 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d39efe80-bb67-41c7-8c13-0f7d5ab4287a tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] 10.222.0.46 "GET /compute/v2.1/servers/114ccb23-d953-4735-b61e-f0d62e19dce2" status: 200 len: 1475 microversion: 2.1 time: 0.514543 Jan 15 20:49:34.478696 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 216/401] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:33 2022] GET /compute/v2.1/servers/114ccb23-d953-4735-b61e-f0d62e19dce2 => generated 1475 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:34.500591 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-a5a336fd-b734-4b43-8046-61ef536780d1 req-0f3b4073-e75f-4dc8-ab48-887cb8264094 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b68335f-a94c-4801-8d8b-2fd387d1ced9", "name": "network-vif-deleted", "tag": "83c60043-b7da-47fc-8806-0fb74103c15c"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:34.502248 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:34.502248 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:49:34.538273 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-a5a336fd-b734-4b43-8046-61ef536780d1 req-0f3b4073-e75f-4dc8-ab48-887cb8264094 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:34.538720 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-a5a336fd-b734-4b43-8046-61ef536780d1 req-0f3b4073-e75f-4dc8-ab48-887cb8264094 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:34.577808 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-a5a336fd-b734-4b43-8046-61ef536780d1 req-0f3b4073-e75f-4dc8-ab48-887cb8264094 service nova] Creating event network-vif-deleted:83c60043-b7da-47fc-8806-0fb74103c15c for instance 2b68335f-a94c-4801-8d8b-2fd387d1ced9 on nch1-master-1 Jan 15 20:49:34.594723 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-a5a336fd-b734-4b43-8046-61ef536780d1 req-0f3b4073-e75f-4dc8-ab48-887cb8264094 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112793 Jan 15 20:49:34.595332 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 217/402] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:49:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:49:34.600127 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8c65196d-5dcd-4a92-a88b-000f9205ef8d tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:34.607245 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-8c65196d-5dcd-4a92-a88b-000f9205ef8d tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] [instance: 2b68335f-a94c-4801-8d8b-2fd387d1ced9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:34.620634 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8c65196d-5dcd-4a92-a88b-000f9205ef8d tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:34.621370 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8c65196d-5dcd-4a92-a88b-000f9205ef8d tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:34.623985 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8c65196d-5dcd-4a92-a88b-000f9205ef8d tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:34.624604 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8c65196d-5dcd-4a92-a88b-000f9205ef8d tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:34.695901 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8c65196d-5dcd-4a92-a88b-000f9205ef8d tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:34.696353 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8c65196d-5dcd-4a92-a88b-000f9205ef8d tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:34.696811 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.objects.instance [None req-8c65196d-5dcd-4a92-a88b-000f9205ef8d tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lazy-loading 'fault' on Instance uuid 2b68335f-a94c-4801-8d8b-2fd387d1ced9 {{(pid=129366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 20:49:34.734724 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-9fde7270-8c80-4d13-a910-7f7fea887b79 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:34.743324 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-9fde7270-8c80-4d13-a910-7f7fea887b79 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/4d527369-954d-4ccc-9105-03b209d3523e" status: 200 len: 1476 microversion: 2.1 time: 0.547145 Jan 15 20:49:34.746508 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 186/403] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:34 2022] GET /compute/v2.1/servers/4d527369-954d-4ccc-9105-03b209d3523e => generated 1476 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:34.818434 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-8c65196d-5dcd-4a92-a88b-000f9205ef8d tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957f85f9c6794cccad71c553fb607ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd82c6b47c4140e390464b153d2fe865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:34.827111 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-8c65196d-5dcd-4a92-a88b-000f9205ef8d tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] 10.222.0.46 "GET /compute/v2.1/servers/2b68335f-a94c-4801-8d8b-2fd387d1ced9" status: 200 len: 1309 microversion: 2.1 time: 0.230600 Jan 15 20:49:34.830551 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 218/404] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:34 2022] GET /compute/v2.1/servers/2b68335f-a94c-4801-8d8b-2fd387d1ced9 => generated 1309 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:34.869825 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-57ed8f14-cf0f-4e0d-af4e-9b30ef36fe7b tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:34.870989 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-57ed8f14-cf0f-4e0d-af4e-9b30ef36fe7b tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 98d0ca37-0175-44e2-8a1d-965cdc517daf] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:34.879952 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-57ed8f14-cf0f-4e0d-af4e-9b30ef36fe7b tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:34.882119 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-57ed8f14-cf0f-4e0d-af4e-9b30ef36fe7b tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:34.884098 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-57ed8f14-cf0f-4e0d-af4e-9b30ef36fe7b tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:34.884555 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-57ed8f14-cf0f-4e0d-af4e-9b30ef36fe7b tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:34.970251 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-57ed8f14-cf0f-4e0d-af4e-9b30ef36fe7b tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action" status: 200 len: 24562 microversion: 2.1 time: 0.103945 Jan 15 20:49:34.970902 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 187/405] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:49:34 2022] POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action => generated 24562 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 20:49:35.359596 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-22e8d9d8-452e-4cd0-a4a4-032e77c40e59 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-271590738", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:35.431266 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.network.neutron [None req-22e8d9d8-452e-4cd0-a4a4-032e77c40e59 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] validate_networks() for None {{(pid=129366) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 20:49:35.496419 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2dae4858-669b-4f22-9a35-80bfb025d555 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:35.497523 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-2dae4858-669b-4f22-9a35-80bfb025d555 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] [instance: 114ccb23-d953-4735-b61e-f0d62e19dce2] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:35.504634 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2dae4858-669b-4f22-9a35-80bfb025d555 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:35.505421 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2dae4858-669b-4f22-9a35-80bfb025d555 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:35.506405 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2dae4858-669b-4f22-9a35-80bfb025d555 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:35.507029 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2dae4858-669b-4f22-9a35-80bfb025d555 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:35.696603 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-22e8d9d8-452e-4cd0-a4a4-032e77c40e59 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Flavor limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 20:49:35.698250 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-22e8d9d8-452e-4cd0-a4a4-032e77c40e59 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Image limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 20:49:35.699187 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-22e8d9d8-452e-4cd0-a4a4-032e77c40e59 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Flavor pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 20:49:35.700441 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-22e8d9d8-452e-4cd0-a4a4-032e77c40e59 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Image pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 20:49:35.701981 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-22e8d9d8-452e-4cd0-a4a4-032e77c40e59 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 20:49:35.718012 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-22e8d9d8-452e-4cd0-a4a4-032e77c40e59 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:35.719193 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-22e8d9d8-452e-4cd0-a4a4-032e77c40e59 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:35.720239 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-22e8d9d8-452e-4cd0-a4a4-032e77c40e59 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:35.720945 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-22e8d9d8-452e-4cd0-a4a4-032e77c40e59 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:35.721374 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-2dae4858-669b-4f22-9a35-80bfb025d555 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0079c95473594ee9ada5a4bc6820a111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac923ea754345a9b79457833bd72da4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:35.730858 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2dae4858-669b-4f22-9a35-80bfb025d555 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] 10.222.0.46 "GET /compute/v2.1/servers/114ccb23-d953-4735-b61e-f0d62e19dce2" status: 200 len: 1458 microversion: 2.1 time: 0.239855 Jan 15 20:49:35.731604 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 188/406] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:35 2022] GET /compute/v2.1/servers/114ccb23-d953-4735-b61e-f0d62e19dce2 => generated 1458 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:49:35.742538 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-22e8d9d8-452e-4cd0-a4a4-032e77c40e59 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Getting quotas for project a89aabae1afe4a5a88ed97e87b5266ac. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:49:35.747918 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-22e8d9d8-452e-4cd0-a4a4-032e77c40e59 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Getting quotas for user d06a1f6896564bb58b457d0642f8302c and project a89aabae1afe4a5a88ed97e87b5266ac. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:49:35.748658 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-772cfc5a-3e29-487d-86e9-d360d00c2555 tempest-LiveMigrationNegativeTest-1496050294 tempest-LiveMigrationNegativeTest-1496050294-project-admin] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:35.749562 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-772cfc5a-3e29-487d-86e9-d360d00c2555 tempest-LiveMigrationNegativeTest-1496050294 tempest-LiveMigrationNegativeTest-1496050294-project-admin] [instance: 114ccb23-d953-4735-b61e-f0d62e19dce2] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:35.758749 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-772cfc5a-3e29-487d-86e9-d360d00c2555 tempest-LiveMigrationNegativeTest-1496050294 tempest-LiveMigrationNegativeTest-1496050294-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:35.759203 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-772cfc5a-3e29-487d-86e9-d360d00c2555 tempest-LiveMigrationNegativeTest-1496050294 tempest-LiveMigrationNegativeTest-1496050294-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:35.760005 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-772cfc5a-3e29-487d-86e9-d360d00c2555 tempest-LiveMigrationNegativeTest-1496050294 tempest-LiveMigrationNegativeTest-1496050294-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:35.760451 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-772cfc5a-3e29-487d-86e9-d360d00c2555 tempest-LiveMigrationNegativeTest-1496050294 tempest-LiveMigrationNegativeTest-1496050294-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:35.770144 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-22e8d9d8-452e-4cd0-a4a4-032e77c40e59 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Going to run 1 instances... {{(pid=129366) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 20:49:35.773860 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-22e8d9d8-452e-4cd0-a4a4-032e77c40e59 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] [instance: 6d487317-4968-4a06-ad7b-4484e8d50f10] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 20:49:35.834275 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-22e8d9d8-452e-4cd0-a4a4-032e77c40e59 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.777100 Jan 15 20:49:35.837025 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 219/407] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 20:49:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 781 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 20:49:35.846853 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-5eb5f3f2-3602-4a7d-91fc-e9d73abb1d65 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:35.847532 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-5eb5f3f2-3602-4a7d-91fc-e9d73abb1d65 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: 4d527369-954d-4ccc-9105-03b209d3523e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:35.859344 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5eb5f3f2-3602-4a7d-91fc-e9d73abb1d65 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:35.860006 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5eb5f3f2-3602-4a7d-91fc-e9d73abb1d65 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:35.863036 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5eb5f3f2-3602-4a7d-91fc-e9d73abb1d65 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:35.863622 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5eb5f3f2-3602-4a7d-91fc-e9d73abb1d65 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:36.152219 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-772cfc5a-3e29-487d-86e9-d360d00c2555 tempest-LiveMigrationNegativeTest-1496050294 tempest-LiveMigrationNegativeTest-1496050294-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/114ccb23-d953-4735-b61e-f0d62e19dce2" status: 200 len: 1609 microversion: 2.1 time: 0.404407 Jan 15 20:49:36.152903 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 189/408] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:35 2022] GET /compute/v2.1/servers/114ccb23-d953-4735-b61e-f0d62e19dce2 => generated 1609 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:49:36.158453 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b89a76f0-095b-41dd-ac30-0ac95b96d5ea tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:36.159070 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b89a76f0-095b-41dd-ac30-0ac95b96d5ea tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] [instance: 6d487317-4968-4a06-ad7b-4484e8d50f10] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:36.165065 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-5eb5f3f2-3602-4a7d-91fc-e9d73abb1d65 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:36.173325 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-5eb5f3f2-3602-4a7d-91fc-e9d73abb1d65 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/4d527369-954d-4ccc-9105-03b209d3523e" status: 200 len: 1476 microversion: 2.1 time: 0.333433 Jan 15 20:49:36.173906 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 220/409] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:35 2022] GET /compute/v2.1/servers/4d527369-954d-4ccc-9105-03b209d3523e => generated 1476 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:36.186396 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-61031f69-b260-48a8-8312-b8a3d6654301 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:36.186999 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-61031f69-b260-48a8-8312-b8a3d6654301 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] [instance: 2b68335f-a94c-4801-8d8b-2fd387d1ced9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:36.196137 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-61031f69-b260-48a8-8312-b8a3d6654301 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:36.196606 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-61031f69-b260-48a8-8312-b8a3d6654301 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:36.197792 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-61031f69-b260-48a8-8312-b8a3d6654301 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:36.198921 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-61031f69-b260-48a8-8312-b8a3d6654301 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:36.220793 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-61031f69-b260-48a8-8312-b8a3d6654301 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] HTTP exception thrown: Instance 2b68335f-a94c-4801-8d8b-2fd387d1ced9 could not be found. Jan 15 20:49:36.237806 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-61031f69-b260-48a8-8312-b8a3d6654301 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Returning 404 to user: Instance 2b68335f-a94c-4801-8d8b-2fd387d1ced9 could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:49:36.246243 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-61031f69-b260-48a8-8312-b8a3d6654301 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] 10.222.0.46 "GET /compute/v2.1/servers/2b68335f-a94c-4801-8d8b-2fd387d1ced9" status: 404 len: 111 microversion: 2.1 time: 0.064085 Jan 15 20:49:36.247050 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 221/410] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:36 2022] GET /compute/v2.1/servers/2b68335f-a94c-4801-8d8b-2fd387d1ced9 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:49:36.255790 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9a2f3ab0-6e7a-4d3b-ac14-16f125e3e588 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:36.270074 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-b89a76f0-095b-41dd-ac30-0ac95b96d5ea tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd06a1f6896564bb58b457d0642f8302c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89aabae1afe4a5a88ed97e87b5266ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:36.275136 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-9a2f3ab0-6e7a-4d3b-ac14-16f125e3e588 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 98d0ca37-0175-44e2-8a1d-965cdc517daf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:36.281366 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b89a76f0-095b-41dd-ac30-0ac95b96d5ea tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] 10.222.0.46 "GET /compute/v2.1/servers/6d487317-4968-4a06-ad7b-4484e8d50f10" status: 200 len: 1221 microversion: 2.1 time: 0.127368 Jan 15 20:49:36.282253 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 190/411] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:36 2022] GET /compute/v2.1/servers/6d487317-4968-4a06-ad7b-4484e8d50f10 => generated 1221 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:36.290215 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-391e17d1-d3b9-474a-9d62-281452494bb5 tempest-LiveMigrationNegativeTest-1496050294 tempest-LiveMigrationNegativeTest-1496050294-project-admin] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:36.291766 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:36.291766 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:49:36.296896 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9a2f3ab0-6e7a-4d3b-ac14-16f125e3e588 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:36.297366 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9a2f3ab0-6e7a-4d3b-ac14-16f125e3e588 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:36.298157 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9a2f3ab0-6e7a-4d3b-ac14-16f125e3e588 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:36.298594 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9a2f3ab0-6e7a-4d3b-ac14-16f125e3e588 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:36.299758 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-391e17d1-d3b9-474a-9d62-281452494bb5 tempest-LiveMigrationNegativeTest-1496050294 tempest-LiveMigrationNegativeTest-1496050294-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:36.300393 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-391e17d1-d3b9-474a-9d62-281452494bb5 tempest-LiveMigrationNegativeTest-1496050294 tempest-LiveMigrationNegativeTest-1496050294-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:36.301299 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-391e17d1-d3b9-474a-9d62-281452494bb5 tempest-LiveMigrationNegativeTest-1496050294 tempest-LiveMigrationNegativeTest-1496050294-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:36.301734 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-391e17d1-d3b9-474a-9d62-281452494bb5 tempest-LiveMigrationNegativeTest-1496050294 tempest-LiveMigrationNegativeTest-1496050294-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:36.327999 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-391e17d1-d3b9-474a-9d62-281452494bb5 tempest-LiveMigrationNegativeTest-1496050294 tempest-LiveMigrationNegativeTest-1496050294-project-admin] 10.222.0.46 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.044556 Jan 15 20:49:36.328607 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 191/412] 10.222.0.46 () {58 vars in 1175 bytes} [Sat Jan 15 20:49:36 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:49:36.333386 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e4d6841e-fa96-4cb2-8787-ad7d3eee71a5 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:36.334233 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e4d6841e-fa96-4cb2-8787-ad7d3eee71a5 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] [instance: 2b68335f-a94c-4801-8d8b-2fd387d1ced9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:36.342719 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e4d6841e-fa96-4cb2-8787-ad7d3eee71a5 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:36.343448 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e4d6841e-fa96-4cb2-8787-ad7d3eee71a5 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:36.344428 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e4d6841e-fa96-4cb2-8787-ad7d3eee71a5 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:36.345118 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e4d6841e-fa96-4cb2-8787-ad7d3eee71a5 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:36.361195 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-e4d6841e-fa96-4cb2-8787-ad7d3eee71a5 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] HTTP exception thrown: Instance 2b68335f-a94c-4801-8d8b-2fd387d1ced9 could not be found. Jan 15 20:49:36.362078 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e4d6841e-fa96-4cb2-8787-ad7d3eee71a5 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Returning 404 to user: Instance 2b68335f-a94c-4801-8d8b-2fd387d1ced9 could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:49:36.363158 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e4d6841e-fa96-4cb2-8787-ad7d3eee71a5 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] 10.222.0.46 "DELETE /compute/v2.1/servers/2b68335f-a94c-4801-8d8b-2fd387d1ced9" status: 404 len: 111 microversion: 2.1 time: 0.033391 Jan 15 20:49:36.364207 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 192/413] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 20:49:36 2022] DELETE /compute/v2.1/servers/2b68335f-a94c-4801-8d8b-2fd387d1ced9 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:49:36.369471 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a7d0f14f-998f-4f70-ac7c-fb50d2aa2062 tempest-LiveMigrationNegativeTest-1496050294 tempest-LiveMigrationNegativeTest-1496050294-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:36.371562 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a7d0f14f-998f-4f70-ac7c-fb50d2aa2062 tempest-LiveMigrationNegativeTest-1496050294 tempest-LiveMigrationNegativeTest-1496050294-project-admin] [instance: 114ccb23-d953-4735-b61e-f0d62e19dce2] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:36.378621 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a7d0f14f-998f-4f70-ac7c-fb50d2aa2062 tempest-LiveMigrationNegativeTest-1496050294 tempest-LiveMigrationNegativeTest-1496050294-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:36.379398 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a7d0f14f-998f-4f70-ac7c-fb50d2aa2062 tempest-LiveMigrationNegativeTest-1496050294 tempest-LiveMigrationNegativeTest-1496050294-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:36.380390 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a7d0f14f-998f-4f70-ac7c-fb50d2aa2062 tempest-LiveMigrationNegativeTest-1496050294 tempest-LiveMigrationNegativeTest-1496050294-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:36.381882 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a7d0f14f-998f-4f70-ac7c-fb50d2aa2062 tempest-LiveMigrationNegativeTest-1496050294 tempest-LiveMigrationNegativeTest-1496050294-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:36.387005 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-9a2f3ab0-6e7a-4d3b-ac14-16f125e3e588 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action" status: 200 len: 24562 microversion: 2.1 time: 0.137368 Jan 15 20:49:36.390432 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 222/414] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:49:36 2022] POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action => generated 24562 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:49:36.401559 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-42a5604f-70cf-4492-97fd-24341fa79800 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:36.403780 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-42a5604f-70cf-4492-97fd-24341fa79800 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] [instance: 2b68335f-a94c-4801-8d8b-2fd387d1ced9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:36.412250 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-42a5604f-70cf-4492-97fd-24341fa79800 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:36.412943 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-42a5604f-70cf-4492-97fd-24341fa79800 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:36.413880 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-42a5604f-70cf-4492-97fd-24341fa79800 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:36.414501 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-42a5604f-70cf-4492-97fd-24341fa79800 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:36.429255 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.objects.instance [None req-a7d0f14f-998f-4f70-ac7c-fb50d2aa2062 tempest-LiveMigrationNegativeTest-1496050294 tempest-LiveMigrationNegativeTest-1496050294-project-admin] Lazy-loading 'flavor' on Instance uuid 114ccb23-d953-4735-b61e-f0d62e19dce2 {{(pid=129365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 20:49:36.437816 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-42a5604f-70cf-4492-97fd-24341fa79800 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] HTTP exception thrown: Instance 2b68335f-a94c-4801-8d8b-2fd387d1ced9 could not be found. Jan 15 20:49:36.438687 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-42a5604f-70cf-4492-97fd-24341fa79800 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Returning 404 to user: Instance 2b68335f-a94c-4801-8d8b-2fd387d1ced9 could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:49:36.440357 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-42a5604f-70cf-4492-97fd-24341fa79800 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] 10.222.0.46 "GET /compute/v2.1/servers/2b68335f-a94c-4801-8d8b-2fd387d1ced9" status: 404 len: 111 microversion: 2.1 time: 0.048591 Jan 15 20:49:36.441590 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 223/415] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:36 2022] GET /compute/v2.1/servers/2b68335f-a94c-4801-8d8b-2fd387d1ced9 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:49:36.443529 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-a7d0f14f-998f-4f70-ac7c-fb50d2aa2062 tempest-LiveMigrationNegativeTest-1496050294 tempest-LiveMigrationNegativeTest-1496050294-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance 114ccb23-d953-4735-b61e-f0d62e19dce2 while it is in vm_state suspended Jan 15 20:49:36.444274 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a7d0f14f-998f-4f70-ac7c-fb50d2aa2062 tempest-LiveMigrationNegativeTest-1496050294 tempest-LiveMigrationNegativeTest-1496050294-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance 114ccb23-d953-4735-b61e-f0d62e19dce2 while it is in vm_state suspended {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:49:36.445167 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a7d0f14f-998f-4f70-ac7c-fb50d2aa2062 tempest-LiveMigrationNegativeTest-1496050294 tempest-LiveMigrationNegativeTest-1496050294-project-admin] 10.222.0.46 "POST /compute/v2.1/servers/114ccb23-d953-4735-b61e-f0d62e19dce2/action" status: 409 len: 155 microversion: 2.1 time: 0.079798 Jan 15 20:49:36.446099 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 193/416] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:49:36 2022] POST /compute/v2.1/servers/114ccb23-d953-4735-b61e-f0d62e19dce2/action => generated 155 bytes in 81 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jan 15 20:49:36.457029 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8541994a-7774-4cfc-875a-03f36075bb06 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:36.457975 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-8541994a-7774-4cfc-875a-03f36075bb06 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] [instance: 50205979-c437-4302-b6f0-1bb76d7ea2c9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:36.462857 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-62a1c18b-c3b3-418d-876b-94819bffd521 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:36.463446 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-62a1c18b-c3b3-418d-876b-94819bffd521 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] [instance: 114ccb23-d953-4735-b61e-f0d62e19dce2] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:36.467324 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8541994a-7774-4cfc-875a-03f36075bb06 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:36.468113 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8541994a-7774-4cfc-875a-03f36075bb06 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:36.470624 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8541994a-7774-4cfc-875a-03f36075bb06 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:36.471694 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8541994a-7774-4cfc-875a-03f36075bb06 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:36.472665 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-62a1c18b-c3b3-418d-876b-94819bffd521 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:36.473158 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-62a1c18b-c3b3-418d-876b-94819bffd521 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:36.474061 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-62a1c18b-c3b3-418d-876b-94819bffd521 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:36.474503 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-62a1c18b-c3b3-418d-876b-94819bffd521 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:36.492799 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-8541994a-7774-4cfc-875a-03f36075bb06 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] HTTP exception thrown: Instance 50205979-c437-4302-b6f0-1bb76d7ea2c9 could not be found. Jan 15 20:49:36.494185 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8541994a-7774-4cfc-875a-03f36075bb06 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Returning 404 to user: Instance 50205979-c437-4302-b6f0-1bb76d7ea2c9 could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:49:36.497311 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-8541994a-7774-4cfc-875a-03f36075bb06 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] 10.222.0.46 "DELETE /compute/v2.1/servers/50205979-c437-4302-b6f0-1bb76d7ea2c9" status: 404 len: 111 microversion: 2.1 time: 0.050567 Jan 15 20:49:36.498382 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 224/417] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 20:49:36 2022] DELETE /compute/v2.1/servers/50205979-c437-4302-b6f0-1bb76d7ea2c9 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:49:36.504361 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-62a1c18b-c3b3-418d-876b-94819bffd521 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] [instance: 114ccb23-d953-4735-b61e-f0d62e19dce2] Going to try to terminate instance {{(pid=129365) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 20:49:36.525231 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9e11f665-6889-4a5e-a8ff-c9a8eed091c6 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:36.525972 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-9e11f665-6889-4a5e-a8ff-c9a8eed091c6 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] [instance: 50205979-c437-4302-b6f0-1bb76d7ea2c9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:36.544771 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9e11f665-6889-4a5e-a8ff-c9a8eed091c6 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:36.545328 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9e11f665-6889-4a5e-a8ff-c9a8eed091c6 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:36.546481 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9e11f665-6889-4a5e-a8ff-c9a8eed091c6 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:36.546868 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9e11f665-6889-4a5e-a8ff-c9a8eed091c6 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:36.573728 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-9e11f665-6889-4a5e-a8ff-c9a8eed091c6 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] HTTP exception thrown: Instance 50205979-c437-4302-b6f0-1bb76d7ea2c9 could not be found. Jan 15 20:49:36.574326 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9e11f665-6889-4a5e-a8ff-c9a8eed091c6 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] Returning 404 to user: Instance 50205979-c437-4302-b6f0-1bb76d7ea2c9 could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:49:36.575359 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-9e11f665-6889-4a5e-a8ff-c9a8eed091c6 tempest-DeleteServersAdminTestJSON-1364207935 tempest-DeleteServersAdminTestJSON-1364207935-project] 10.222.0.46 "GET /compute/v2.1/servers/50205979-c437-4302-b6f0-1bb76d7ea2c9" status: 404 len: 111 microversion: 2.1 time: 0.072559 Jan 15 20:49:36.575904 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 225/418] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:36 2022] GET /compute/v2.1/servers/50205979-c437-4302-b6f0-1bb76d7ea2c9 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:49:36.635306 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-62a1c18b-c3b3-418d-876b-94819bffd521 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] 10.222.0.46 "DELETE /compute/v2.1/servers/114ccb23-d953-4735-b61e-f0d62e19dce2" status: 204 len: 0 microversion: 2.1 time: 0.182217 Jan 15 20:49:36.636272 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 194/419] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 20:49:36 2022] DELETE /compute/v2.1/servers/114ccb23-d953-4735-b61e-f0d62e19dce2 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 20:49:36.648600 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3fa10bf0-6ea8-421f-a68a-47808d19d197 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:36.650608 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-3fa10bf0-6ea8-421f-a68a-47808d19d197 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] [instance: 114ccb23-d953-4735-b61e-f0d62e19dce2] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:36.659090 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3fa10bf0-6ea8-421f-a68a-47808d19d197 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:36.659579 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3fa10bf0-6ea8-421f-a68a-47808d19d197 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:36.660373 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3fa10bf0-6ea8-421f-a68a-47808d19d197 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:36.661036 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3fa10bf0-6ea8-421f-a68a-47808d19d197 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:36.846900 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-3fa10bf0-6ea8-421f-a68a-47808d19d197 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0079c95473594ee9ada5a4bc6820a111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac923ea754345a9b79457833bd72da4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:36.854481 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3fa10bf0-6ea8-421f-a68a-47808d19d197 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] 10.222.0.46 "GET /compute/v2.1/servers/114ccb23-d953-4735-b61e-f0d62e19dce2" status: 200 len: 1464 microversion: 2.1 time: 0.212440 Jan 15 20:49:36.857239 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 195/420] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:36 2022] GET /compute/v2.1/servers/114ccb23-d953-4735-b61e-f0d62e19dce2 => generated 1464 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:36.898303 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-71d53648-69ba-41e9-ab34-fc07cd41e77d tempest-HypervisorAdminNegativeUnderV252Test-341593644 tempest-HypervisorAdminNegativeUnderV252Test-341593644-project-admin] Calling method '.version_select at 0x7f30c97a5940>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:36.899377 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:36.899377 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:49:36.901003 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-71d53648-69ba-41e9-ab34-fc07cd41e77d tempest-HypervisorAdminNegativeUnderV252Test-341593644 tempest-HypervisorAdminNegativeUnderV252Test-341593644-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:36.901477 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-71d53648-69ba-41e9-ab34-fc07cd41e77d tempest-HypervisorAdminNegativeUnderV252Test-341593644 tempest-HypervisorAdminNegativeUnderV252Test-341593644-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:36.920419 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-71d53648-69ba-41e9-ab34-fc07cd41e77d tempest-HypervisorAdminNegativeUnderV252Test-341593644 tempest-HypervisorAdminNegativeUnderV252Test-341593644-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:36.921402 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-71d53648-69ba-41e9-ab34-fc07cd41e77d tempest-HypervisorAdminNegativeUnderV252Test-341593644 tempest-HypervisorAdminNegativeUnderV252Test-341593644-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:36.947749 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-71d53648-69ba-41e9-ab34-fc07cd41e77d tempest-HypervisorAdminNegativeUnderV252Test-341593644 tempest-HypervisorAdminNegativeUnderV252Test-341593644-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:36.947749 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-71d53648-69ba-41e9-ab34-fc07cd41e77d tempest-HypervisorAdminNegativeUnderV252Test-341593644 tempest-HypervisorAdminNegativeUnderV252Test-341593644-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:36.955982 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-71d53648-69ba-41e9-ab34-fc07cd41e77d tempest-HypervisorAdminNegativeUnderV252Test-341593644 tempest-HypervisorAdminNegativeUnderV252Test-341593644-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.374404 Jan 15 20:49:36.957642 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 226/421] 10.222.0.46 () {58 vars in 1145 bytes} [Sat Jan 15 20:49:36 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:49:37.191462 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b125b16b-2d5b-4e6c-99d4-222380adb9de tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:37.192093 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b125b16b-2d5b-4e6c-99d4-222380adb9de tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: 4d527369-954d-4ccc-9105-03b209d3523e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:37.199458 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b125b16b-2d5b-4e6c-99d4-222380adb9de tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:37.202988 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b125b16b-2d5b-4e6c-99d4-222380adb9de tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:37.203844 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b125b16b-2d5b-4e6c-99d4-222380adb9de tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:37.204284 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b125b16b-2d5b-4e6c-99d4-222380adb9de tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:37.283266 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-4bab5e91-62c1-4515-8757-93be3f1f7939 tempest-HypervisorAdminNegativeUnderV252Test-364273947 tempest-HypervisorAdminNegativeUnderV252Test-364273947-project] Calling method '.version_select at 0x7f30c97df4c0>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:37.285178 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:37.285178 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:49:37.288688 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-4bab5e91-62c1-4515-8757-93be3f1f7939 tempest-HypervisorAdminNegativeUnderV252Test-364273947 tempest-HypervisorAdminNegativeUnderV252Test-364273947-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '054110cfe68247e8934b5bf1b31faacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d80de1d57c54f8e9d87fcad5755e8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:37.290130 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-4bab5e91-62c1-4515-8757-93be3f1f7939 tempest-HypervisorAdminNegativeUnderV252Test-364273947 tempest-HypervisorAdminNegativeUnderV252Test-364273947-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:49:37.291406 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-4bab5e91-62c1-4515-8757-93be3f1f7939 tempest-HypervisorAdminNegativeUnderV252Test-364273947 tempest-HypervisorAdminNegativeUnderV252Test-364273947-project] 10.222.0.46 "GET /compute/v2.1/os-hypervisors/nch2-master-1/search" status: 403 len: 117 microversion: 2.1 time: 0.327883 Jan 15 20:49:37.305248 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 196/422] 10.222.0.46 () {58 vars in 1208 bytes} [Sat Jan 15 20:49:36 2022] GET /compute/v2.1/os-hypervisors/nch2-master-1/search => generated 117 bytes in 338 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:49:37.314105 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ea2da035-8de5-41d7-a461-03f23ed5edb4 tempest-HypervisorAdminNegativeUnderV252Test-341593644 tempest-HypervisorAdminNegativeUnderV252Test-341593644-project-admin] Calling method '.version_select at 0x7f30c9745820>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:37.317610 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ea2da035-8de5-41d7-a461-03f23ed5edb4 tempest-HypervisorAdminNegativeUnderV252Test-341593644 tempest-HypervisorAdminNegativeUnderV252Test-341593644-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:37.318449 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ea2da035-8de5-41d7-a461-03f23ed5edb4 tempest-HypervisorAdminNegativeUnderV252Test-341593644 tempest-HypervisorAdminNegativeUnderV252Test-341593644-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:37.342598 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-ea2da035-8de5-41d7-a461-03f23ed5edb4 tempest-HypervisorAdminNegativeUnderV252Test-341593644 tempest-HypervisorAdminNegativeUnderV252Test-341593644-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jan 15 20:49:37.343872 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ea2da035-8de5-41d7-a461-03f23ed5edb4 tempest-HypervisorAdminNegativeUnderV252Test-341593644 tempest-HypervisorAdminNegativeUnderV252Test-341593644-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:49:37.345455 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ea2da035-8de5-41d7-a461-03f23ed5edb4 tempest-HypervisorAdminNegativeUnderV252Test-341593644 tempest-HypervisorAdminNegativeUnderV252Test-341593644-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.038141 Jan 15 20:49:37.351664 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 197/423] 10.222.0.46 () {58 vars in 1250 bytes} [Sat Jan 15 20:49:37 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:49:37.359868 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e79802ca-1047-4922-a822-8d06abab2225 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:37.359868 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e79802ca-1047-4922-a822-8d06abab2225 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] [instance: 6d487317-4968-4a06-ad7b-4484e8d50f10] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:37.366025 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e79802ca-1047-4922-a822-8d06abab2225 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:37.366359 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e79802ca-1047-4922-a822-8d06abab2225 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:37.367567 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e79802ca-1047-4922-a822-8d06abab2225 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:37.368539 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e79802ca-1047-4922-a822-8d06abab2225 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:37.449945 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-e79802ca-1047-4922-a822-8d06abab2225 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd06a1f6896564bb58b457d0642f8302c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89aabae1afe4a5a88ed97e87b5266ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:37.458306 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-b125b16b-2d5b-4e6c-99d4-222380adb9de tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:37.459002 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e79802ca-1047-4922-a822-8d06abab2225 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] 10.222.0.46 "GET /compute/v2.1/servers/6d487317-4968-4a06-ad7b-4484e8d50f10" status: 200 len: 1279 microversion: 2.1 time: 0.110140 Jan 15 20:49:37.459837 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 198/424] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:37 2022] GET /compute/v2.1/servers/6d487317-4968-4a06-ad7b-4484e8d50f10 => generated 1279 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:37.464670 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ad74212b-8c7d-4ca4-98b2-dbd087815506 tempest-HypervisorAdminNegativeUnderV252Test-341593644 tempest-HypervisorAdminNegativeUnderV252Test-341593644-project-admin] Calling method '.version_select at 0x7f30c977b790>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:37.465718 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:37.465718 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:49:37.467424 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ad74212b-8c7d-4ca4-98b2-dbd087815506 tempest-HypervisorAdminNegativeUnderV252Test-341593644 tempest-HypervisorAdminNegativeUnderV252Test-341593644-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:37.467874 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ad74212b-8c7d-4ca4-98b2-dbd087815506 tempest-HypervisorAdminNegativeUnderV252Test-341593644 tempest-HypervisorAdminNegativeUnderV252Test-341593644-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:37.476092 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b125b16b-2d5b-4e6c-99d4-222380adb9de tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/4d527369-954d-4ccc-9105-03b209d3523e" status: 200 len: 1476 microversion: 2.1 time: 0.289482 Jan 15 20:49:37.477880 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 227/425] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:37 2022] GET /compute/v2.1/servers/4d527369-954d-4ccc-9105-03b209d3523e => generated 1476 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:49:37.482719 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b4729225-9628-48a4-8b92-ca8a8baa8006 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:37.483877 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b4729225-9628-48a4-8b92-ca8a8baa8006 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 98d0ca37-0175-44e2-8a1d-965cdc517daf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:37.488252 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ad74212b-8c7d-4ca4-98b2-dbd087815506 tempest-HypervisorAdminNegativeUnderV252Test-341593644 tempest-HypervisorAdminNegativeUnderV252Test-341593644-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:37.489038 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ad74212b-8c7d-4ca4-98b2-dbd087815506 tempest-HypervisorAdminNegativeUnderV252Test-341593644 tempest-HypervisorAdminNegativeUnderV252Test-341593644-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:37.493048 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b4729225-9628-48a4-8b92-ca8a8baa8006 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:37.493700 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b4729225-9628-48a4-8b92-ca8a8baa8006 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:37.494879 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b4729225-9628-48a4-8b92-ca8a8baa8006 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:37.496497 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b4729225-9628-48a4-8b92-ca8a8baa8006 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:37.506534 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ad74212b-8c7d-4ca4-98b2-dbd087815506 tempest-HypervisorAdminNegativeUnderV252Test-341593644 tempest-HypervisorAdminNegativeUnderV252Test-341593644-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:37.507110 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ad74212b-8c7d-4ca4-98b2-dbd087815506 tempest-HypervisorAdminNegativeUnderV252Test-341593644 tempest-HypervisorAdminNegativeUnderV252Test-341593644-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:37.516459 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ad74212b-8c7d-4ca4-98b2-dbd087815506 tempest-HypervisorAdminNegativeUnderV252Test-341593644 tempest-HypervisorAdminNegativeUnderV252Test-341593644-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.055209 Jan 15 20:49:37.521216 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 199/426] 10.222.0.46 () {58 vars in 1145 bytes} [Sat Jan 15 20:49:37 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:49:37.528326 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-421191aa-b93e-4f48-a7fb-b8e8fa6e7700 tempest-HypervisorAdminNegativeUnderV252Test-364273947 tempest-HypervisorAdminNegativeUnderV252Test-364273947-project] Calling method '.version_select at 0x7f30c97f8550>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:37.529303 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:37.529303 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:49:37.530715 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-421191aa-b93e-4f48-a7fb-b8e8fa6e7700 tempest-HypervisorAdminNegativeUnderV252Test-364273947 tempest-HypervisorAdminNegativeUnderV252Test-364273947-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '054110cfe68247e8934b5bf1b31faacc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d80de1d57c54f8e9d87fcad5755e8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:37.531577 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-421191aa-b93e-4f48-a7fb-b8e8fa6e7700 tempest-HypervisorAdminNegativeUnderV252Test-364273947 tempest-HypervisorAdminNegativeUnderV252Test-364273947-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:49:37.532637 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-421191aa-b93e-4f48-a7fb-b8e8fa6e7700 tempest-HypervisorAdminNegativeUnderV252Test-364273947 tempest-HypervisorAdminNegativeUnderV252Test-364273947-project] 10.222.0.46 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.008319 Jan 15 20:49:37.533604 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 200/427] 10.222.0.46 () {58 vars in 1175 bytes} [Sat Jan 15 20:49:37 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 11 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jan 15 20:49:37.546485 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-afb30e56-5f1c-40cf-9a25-73b52dde7bf1 tempest-HypervisorAdminNegativeUnderV252Test-341593644 tempest-HypervisorAdminNegativeUnderV252Test-341593644-project-admin] Calling method '.version_select at 0x7f30c972ba60>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:37.548731 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-afb30e56-5f1c-40cf-9a25-73b52dde7bf1 tempest-HypervisorAdminNegativeUnderV252Test-341593644 tempest-HypervisorAdminNegativeUnderV252Test-341593644-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:37.549201 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-afb30e56-5f1c-40cf-9a25-73b52dde7bf1 tempest-HypervisorAdminNegativeUnderV252Test-341593644 tempest-HypervisorAdminNegativeUnderV252Test-341593644-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:37.558165 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b4729225-9628-48a4-8b92-ca8a8baa8006 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action" status: 200 len: 24562 microversion: 2.1 time: 0.078690 Jan 15 20:49:37.558983 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-afb30e56-5f1c-40cf-9a25-73b52dde7bf1 tempest-HypervisorAdminNegativeUnderV252Test-341593644 tempest-HypervisorAdminNegativeUnderV252Test-341593644-project-admin] HTTP exception thrown: No hypervisor matching 'fd454c59-d87f-49c3-b314-66f3a7fc69af' could be found. Jan 15 20:49:37.559573 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-afb30e56-5f1c-40cf-9a25-73b52dde7bf1 tempest-HypervisorAdminNegativeUnderV252Test-341593644 tempest-HypervisorAdminNegativeUnderV252Test-341593644-project-admin] Returning 404 to user: No hypervisor matching 'fd454c59-d87f-49c3-b314-66f3a7fc69af' could be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:49:37.562901 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-afb30e56-5f1c-40cf-9a25-73b52dde7bf1 tempest-HypervisorAdminNegativeUnderV252Test-341593644 tempest-HypervisorAdminNegativeUnderV252Test-341593644-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hypervisors/fd454c59-d87f-49c3-b314-66f3a7fc69af/servers" status: 404 len: 123 microversion: 2.1 time: 0.021653 Jan 15 20:49:37.563031 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 228/428] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:49:37 2022] POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action => generated 24562 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:49:37.563139 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 201/429] 10.222.0.46 () {58 vars in 1280 bytes} [Sat Jan 15 20:49:37 2022] GET /compute/v2.1/os-hypervisors/fd454c59-d87f-49c3-b314-66f3a7fc69af/servers => generated 123 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 15 20:49:37.876879 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-6aefe405-63c9-4a2e-9fb9-f7d96420f12e tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:37.878358 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-6aefe405-63c9-4a2e-9fb9-f7d96420f12e tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] [instance: 114ccb23-d953-4735-b61e-f0d62e19dce2] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:37.888547 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6aefe405-63c9-4a2e-9fb9-f7d96420f12e tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:37.889656 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6aefe405-63c9-4a2e-9fb9-f7d96420f12e tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:37.890888 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6aefe405-63c9-4a2e-9fb9-f7d96420f12e tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:37.892695 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6aefe405-63c9-4a2e-9fb9-f7d96420f12e tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:38.117754 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-6aefe405-63c9-4a2e-9fb9-f7d96420f12e tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0079c95473594ee9ada5a4bc6820a111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac923ea754345a9b79457833bd72da4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:38.131007 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-6aefe405-63c9-4a2e-9fb9-f7d96420f12e tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] 10.222.0.46 "GET /compute/v2.1/servers/114ccb23-d953-4735-b61e-f0d62e19dce2" status: 200 len: 1464 microversion: 2.1 time: 0.258661 Jan 15 20:49:38.132317 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 229/430] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:37 2022] GET /compute/v2.1/servers/114ccb23-d953-4735-b61e-f0d62e19dce2 => generated 1464 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:38.484477 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-102a0c16-d7b4-48c8-9b75-06597db46e53 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:38.487039 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-102a0c16-d7b4-48c8-9b75-06597db46e53 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] [instance: 6d487317-4968-4a06-ad7b-4484e8d50f10] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:38.523136 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-102a0c16-d7b4-48c8-9b75-06597db46e53 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:38.527234 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-102a0c16-d7b4-48c8-9b75-06597db46e53 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:38.531061 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-102a0c16-d7b4-48c8-9b75-06597db46e53 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:38.532573 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-102a0c16-d7b4-48c8-9b75-06597db46e53 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:38.825899 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-0e34c33b-c064-4e4b-b905-56fb7c5c2a06 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-270609782", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "networks": [{"uuid": "3ee7d78d-61a7-4a1d-ba2d-976bd0bf9fe2"}]}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:38.889527 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.network.neutron [None req-0e34c33b-c064-4e4b-b905-56fb7c5c2a06 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] validate_networks() for [('3ee7d78d-61a7-4a1d-ba2d-976bd0bf9fe2', None, None, None, None, None)] {{(pid=129365) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 20:49:39.247635 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-102a0c16-d7b4-48c8-9b75-06597db46e53 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd06a1f6896564bb58b457d0642f8302c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89aabae1afe4a5a88ed97e87b5266ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:39.266460 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-102a0c16-d7b4-48c8-9b75-06597db46e53 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] 10.222.0.46 "GET /compute/v2.1/servers/6d487317-4968-4a06-ad7b-4484e8d50f10" status: 200 len: 1321 microversion: 2.1 time: 0.793380 Jan 15 20:49:39.267397 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 230/431] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:38 2022] GET /compute/v2.1/servers/6d487317-4968-4a06-ad7b-4484e8d50f10 => generated 1321 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:39.281082 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-59833d41-5473-4504-a5bf-66d9b06eb48a tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:39.281876 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-59833d41-5473-4504-a5bf-66d9b06eb48a tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: 4d527369-954d-4ccc-9105-03b209d3523e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:39.297207 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-59833d41-5473-4504-a5bf-66d9b06eb48a tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:39.297866 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-59833d41-5473-4504-a5bf-66d9b06eb48a tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:39.298793 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-59833d41-5473-4504-a5bf-66d9b06eb48a tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:39.309458 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-59833d41-5473-4504-a5bf-66d9b06eb48a tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:39.856927 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-59833d41-5473-4504-a5bf-66d9b06eb48a tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:39.865737 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-59833d41-5473-4504-a5bf-66d9b06eb48a tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/4d527369-954d-4ccc-9105-03b209d3523e" status: 200 len: 1476 microversion: 2.1 time: 0.597093 Jan 15 20:49:39.871655 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 231/432] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:39 2022] GET /compute/v2.1/servers/4d527369-954d-4ccc-9105-03b209d3523e => generated 1476 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:39.941604 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-0e34c33b-c064-4e4b-b905-56fb7c5c2a06 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Flavor limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 20:49:39.944143 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-0e34c33b-c064-4e4b-b905-56fb7c5c2a06 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Image limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 20:49:39.945604 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-0e34c33b-c064-4e4b-b905-56fb7c5c2a06 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Flavor pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 20:49:39.946498 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-0e34c33b-c064-4e4b-b905-56fb7c5c2a06 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Image pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 20:49:39.947109 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-0e34c33b-c064-4e4b-b905-56fb7c5c2a06 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 20:49:39.959757 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0e34c33b-c064-4e4b-b905-56fb7c5c2a06 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:39.960245 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0e34c33b-c064-4e4b-b905-56fb7c5c2a06 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:39.961162 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0e34c33b-c064-4e4b-b905-56fb7c5c2a06 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:39.961764 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0e34c33b-c064-4e4b-b905-56fb7c5c2a06 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:39.989055 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-0e34c33b-c064-4e4b-b905-56fb7c5c2a06 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Getting quotas for project c3ede5f7e26d484fb1c6f18819a90e3f. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:49:39.997902 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-0e34c33b-c064-4e4b-b905-56fb7c5c2a06 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Getting quotas for user a15f22e0573c4433b35a46c5245e30f9 and project c3ede5f7e26d484fb1c6f18819a90e3f. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:49:40.020251 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-0e34c33b-c064-4e4b-b905-56fb7c5c2a06 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Going to run 1 instances... {{(pid=129365) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 20:49:40.023417 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-0e34c33b-c064-4e4b-b905-56fb7c5c2a06 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] [instance: 770bfdbf-2ac6-4ab9-b2e3-f9e43ae88af6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129365) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 20:49:40.106981 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-0e34c33b-c064-4e4b-b905-56fb7c5c2a06 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.779864 Jan 15 20:49:40.108701 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 202/433] 10.222.0.46 () {62 vars in 1187 bytes} [Sat Jan 15 20:49:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1782 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jan 15 20:49:40.119930 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-898305aa-103c-4e29-908d-2b960d4dc936 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:40.127695 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-898305aa-103c-4e29-908d-2b960d4dc936 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 98d0ca37-0175-44e2-8a1d-965cdc517daf] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:40.147357 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-898305aa-103c-4e29-908d-2b960d4dc936 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:40.148163 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-898305aa-103c-4e29-908d-2b960d4dc936 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:40.149226 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-898305aa-103c-4e29-908d-2b960d4dc936 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:40.149825 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-898305aa-103c-4e29-908d-2b960d4dc936 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:40.226633 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-898305aa-103c-4e29-908d-2b960d4dc936 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action" status: 200 len: 24562 microversion: 2.1 time: 0.110250 Jan 15 20:49:40.231884 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 203/434] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:49:40 2022] POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action => generated 24562 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:49:40.239866 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5502b9cb-75d4-4152-aec9-b9ca519344a9 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:40.240684 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-5502b9cb-75d4-4152-aec9-b9ca519344a9 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] [instance: 114ccb23-d953-4735-b61e-f0d62e19dce2] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:40.250565 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5502b9cb-75d4-4152-aec9-b9ca519344a9 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:40.251970 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5502b9cb-75d4-4152-aec9-b9ca519344a9 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:40.252956 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5502b9cb-75d4-4152-aec9-b9ca519344a9 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:40.253544 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5502b9cb-75d4-4152-aec9-b9ca519344a9 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:40.303997 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5502b9cb-75d4-4152-aec9-b9ca519344a9 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:40.304513 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5502b9cb-75d4-4152-aec9-b9ca519344a9 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:40.305086 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.objects.instance [None req-5502b9cb-75d4-4152-aec9-b9ca519344a9 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lazy-loading 'fault' on Instance uuid 114ccb23-d953-4735-b61e-f0d62e19dce2 {{(pid=129365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 20:49:40.369937 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-5502b9cb-75d4-4152-aec9-b9ca519344a9 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0079c95473594ee9ada5a4bc6820a111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac923ea754345a9b79457833bd72da4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:40.383640 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5502b9cb-75d4-4152-aec9-b9ca519344a9 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] 10.222.0.46 "GET /compute/v2.1/servers/114ccb23-d953-4735-b61e-f0d62e19dce2" status: 200 len: 1308 microversion: 2.1 time: 0.150259 Jan 15 20:49:40.384559 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 204/435] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:40 2022] GET /compute/v2.1/servers/114ccb23-d953-4735-b61e-f0d62e19dce2 => generated 1308 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:40.390115 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-99d3a9cc-474f-4770-b751-a52a5c67025f req-35504efa-5907-4b3c-bf1a-ae0ee5153b5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d487317-4968-4a06-ad7b-4484e8d50f10", "tag": "efa38908-68d7-44e3-a60f-24a9f554d75e"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:40.392307 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:40.392307 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:49:40.402895 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-99d3a9cc-474f-4770-b751-a52a5c67025f req-35504efa-5907-4b3c-bf1a-ae0ee5153b5a service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:40.404686 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-99d3a9cc-474f-4770-b751-a52a5c67025f req-35504efa-5907-4b3c-bf1a-ae0ee5153b5a service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:40.419872 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-99d3a9cc-474f-4770-b751-a52a5c67025f req-35504efa-5907-4b3c-bf1a-ae0ee5153b5a service nova] Creating event network-changed:efa38908-68d7-44e3-a60f-24a9f554d75e for instance 6d487317-4968-4a06-ad7b-4484e8d50f10 on nch2-master-1 Jan 15 20:49:40.430427 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-99d3a9cc-474f-4770-b751-a52a5c67025f req-35504efa-5907-4b3c-bf1a-ae0ee5153b5a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044259 Jan 15 20:49:40.431959 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 205/436] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:49:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:49:40.440421 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-14323244-ef34-43e5-933e-ac4d6fc50b84 req-661e9ae5-a1aa-4069-9433-632bfe2dccb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "114ccb23-d953-4735-b61e-f0d62e19dce2", "name": "network-vif-deleted", "tag": "dabee046-cd8e-45f7-9b2d-67a08fbc1ace"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:40.442437 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:40.442437 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:49:40.453145 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-14323244-ef34-43e5-933e-ac4d6fc50b84 req-661e9ae5-a1aa-4069-9433-632bfe2dccb0 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:40.454015 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-14323244-ef34-43e5-933e-ac4d6fc50b84 req-661e9ae5-a1aa-4069-9433-632bfe2dccb0 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:40.466945 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-14323244-ef34-43e5-933e-ac4d6fc50b84 req-661e9ae5-a1aa-4069-9433-632bfe2dccb0 service nova] Creating event network-vif-deleted:dabee046-cd8e-45f7-9b2d-67a08fbc1ace for instance 114ccb23-d953-4735-b61e-f0d62e19dce2 on nch1-master-1 Jan 15 20:49:40.473404 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-14323244-ef34-43e5-933e-ac4d6fc50b84 req-661e9ae5-a1aa-4069-9433-632bfe2dccb0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038579 Jan 15 20:49:40.475043 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 206/437] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:49:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:49:40.481643 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d4ecd7a5-c612-4d5c-9072-a6440f5112c9 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:40.482496 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d4ecd7a5-c612-4d5c-9072-a6440f5112c9 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] [instance: 770bfdbf-2ac6-4ab9-b2e3-f9e43ae88af6] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:40.567783 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-d4ecd7a5-c612-4d5c-9072-a6440f5112c9 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:40.596639 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-d4ecd7a5-c612-4d5c-9072-a6440f5112c9 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:40.602134 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-d4ecd7a5-c612-4d5c-9072-a6440f5112c9 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:40.603738 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d4ecd7a5-c612-4d5c-9072-a6440f5112c9 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] 10.222.0.46 "GET /compute/v2.1/servers/770bfdbf-2ac6-4ab9-b2e3-f9e43ae88af6" status: 200 len: 1261 microversion: 2.25 time: 0.127548 Jan 15 20:49:40.607001 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 207/438] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:49:40 2022] GET /compute/v2.1/servers/770bfdbf-2ac6-4ab9-b2e3-f9e43ae88af6 => generated 1261 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:49:40.616803 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-0420f164-0dd1-4e96-b0aa-01b7ee830961 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:40.617722 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-0420f164-0dd1-4e96-b0aa-01b7ee830961 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] [instance: 6d487317-4968-4a06-ad7b-4484e8d50f10] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:40.630671 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0420f164-0dd1-4e96-b0aa-01b7ee830961 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:40.632252 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0420f164-0dd1-4e96-b0aa-01b7ee830961 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:40.634127 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0420f164-0dd1-4e96-b0aa-01b7ee830961 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:40.636390 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0420f164-0dd1-4e96-b0aa-01b7ee830961 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:40.676495 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0d03956f-6d64-48b2-bddf-845312f9e3fb tempest-NetworksTest-1595127725 tempest-NetworksTest-1595127725-project-admin] Calling method '.version_select at 0x7f30c9c2fd30>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:41.035953 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0d03956f-6d64-48b2-bddf-845312f9e3fb tempest-NetworksTest-1595127725 tempest-NetworksTest-1595127725-project-admin] 10.222.0.46 "GET /compute/v2.1/os-networks" status: 200 len: 4710 microversion: 2.1 time: 1.162949 Jan 15 20:49:41.036872 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 232/439] 10.222.0.46 () {58 vars in 1136 bytes} [Sat Jan 15 20:49:39 2022] GET /compute/v2.1/os-networks => generated 4710 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:41.044392 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-109f9f8a-b3d5-4a0f-990f-9f04f42fc901 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:41.045288 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-109f9f8a-b3d5-4a0f-990f-9f04f42fc901 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: 4d527369-954d-4ccc-9105-03b209d3523e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:41.062671 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-109f9f8a-b3d5-4a0f-990f-9f04f42fc901 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:41.069036 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-109f9f8a-b3d5-4a0f-990f-9f04f42fc901 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:41.070225 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-109f9f8a-b3d5-4a0f-990f-9f04f42fc901 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:41.070849 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-109f9f8a-b3d5-4a0f-990f-9f04f42fc901 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:41.313584 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-0420f164-0dd1-4e96-b0aa-01b7ee830961 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd06a1f6896564bb58b457d0642f8302c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89aabae1afe4a5a88ed97e87b5266ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:41.331181 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-0420f164-0dd1-4e96-b0aa-01b7ee830961 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] 10.222.0.46 "GET /compute/v2.1/servers/6d487317-4968-4a06-ad7b-4484e8d50f10" status: 200 len: 1321 microversion: 2.1 time: 0.714484 Jan 15 20:49:41.332120 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 208/440] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:40 2022] GET /compute/v2.1/servers/6d487317-4968-4a06-ad7b-4484e8d50f10 => generated 1321 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:41.336768 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b5a51fbf-b82b-4123-8c5f-5899f8d879a2 tempest-NetworksTest-1595127725 tempest-NetworksTest-1595127725-project-admin] Calling method '.version_select at 0x7f30c97acee0>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:41.441496 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-109f9f8a-b3d5-4a0f-990f-9f04f42fc901 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:41.450147 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-109f9f8a-b3d5-4a0f-990f-9f04f42fc901 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/4d527369-954d-4ccc-9105-03b209d3523e" status: 200 len: 1476 microversion: 2.1 time: 0.411884 Jan 15 20:49:41.450736 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 233/441] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:41 2022] GET /compute/v2.1/servers/4d527369-954d-4ccc-9105-03b209d3523e => generated 1476 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:41.467147 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d33a4252-68da-4e45-9873-d3e3ec7ade07 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:41.470198 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-d33a4252-68da-4e45-9873-d3e3ec7ade07 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 98d0ca37-0175-44e2-8a1d-965cdc517daf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:41.482572 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d33a4252-68da-4e45-9873-d3e3ec7ade07 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:41.483547 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d33a4252-68da-4e45-9873-d3e3ec7ade07 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:41.484457 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d33a4252-68da-4e45-9873-d3e3ec7ade07 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:41.485183 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d33a4252-68da-4e45-9873-d3e3ec7ade07 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:41.528174 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b5a51fbf-b82b-4123-8c5f-5899f8d879a2 tempest-NetworksTest-1595127725 tempest-NetworksTest-1595127725-project-admin] 10.222.0.46 "GET /compute/v2.1/os-networks/8352f5d9-3635-4bc2-9859-c634bbd8ef52" status: 200 len: 652 microversion: 2.1 time: 0.194344 Jan 15 20:49:41.528791 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 209/442] 10.222.0.46 () {58 vars in 1247 bytes} [Sat Jan 15 20:49:41 2022] GET /compute/v2.1/os-networks/8352f5d9-3635-4bc2-9859-c634bbd8ef52 => generated 652 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:49:41.536175 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e4d3bd13-d927-4ab4-8735-b9b12844ad85 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:41.536701 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e4d3bd13-d927-4ab4-8735-b9b12844ad85 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] [instance: 114ccb23-d953-4735-b61e-f0d62e19dce2] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:41.543475 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d33a4252-68da-4e45-9873-d3e3ec7ade07 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action" status: 200 len: 24562 microversion: 2.1 time: 0.091385 Jan 15 20:49:41.544856 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e4d3bd13-d927-4ab4-8735-b9b12844ad85 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:41.545515 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e4d3bd13-d927-4ab4-8735-b9b12844ad85 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:41.546742 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e4d3bd13-d927-4ab4-8735-b9b12844ad85 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:41.547165 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e4d3bd13-d927-4ab4-8735-b9b12844ad85 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:41.551175 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 234/443] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:49:41 2022] POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action => generated 24562 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:49:41.558780 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b16a6bf1-d8cf-43ed-a808-051013ee2f96 tempest-NetworksTest-1595127725 tempest-NetworksTest-1595127725-project-admin] Calling method '.version_select at 0x7f30c9781a60>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:41.571397 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-e4d3bd13-d927-4ab4-8735-b9b12844ad85 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] HTTP exception thrown: Instance 114ccb23-d953-4735-b61e-f0d62e19dce2 could not be found. Jan 15 20:49:41.572256 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e4d3bd13-d927-4ab4-8735-b9b12844ad85 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Returning 404 to user: Instance 114ccb23-d953-4735-b61e-f0d62e19dce2 could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:49:41.573985 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e4d3bd13-d927-4ab4-8735-b9b12844ad85 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] 10.222.0.46 "GET /compute/v2.1/servers/114ccb23-d953-4735-b61e-f0d62e19dce2" status: 404 len: 111 microversion: 2.1 time: 0.043560 Jan 15 20:49:41.578221 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 210/444] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:41 2022] GET /compute/v2.1/servers/114ccb23-d953-4735-b61e-f0d62e19dce2 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:49:41.583068 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-55fedf14-3fe6-405e-b7ed-5e06fa69da48 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:41.583755 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-55fedf14-3fe6-405e-b7ed-5e06fa69da48 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] [instance: d5416a14-72ee-4a24-80d3-9fe459a801d8] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:41.600776 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-55fedf14-3fe6-405e-b7ed-5e06fa69da48 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:41.601467 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-55fedf14-3fe6-405e-b7ed-5e06fa69da48 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:41.602397 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-55fedf14-3fe6-405e-b7ed-5e06fa69da48 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:41.603447 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-55fedf14-3fe6-405e-b7ed-5e06fa69da48 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:41.637101 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-55fedf14-3fe6-405e-b7ed-5e06fa69da48 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] [instance: d5416a14-72ee-4a24-80d3-9fe459a801d8] Going to try to terminate instance {{(pid=129365) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 20:49:41.727231 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b16a6bf1-d8cf-43ed-a808-051013ee2f96 tempest-NetworksTest-1595127725 tempest-NetworksTest-1595127725-project-admin] 10.222.0.46 "GET /compute/v2.1/os-networks" status: 200 len: 4710 microversion: 2.1 time: 0.174968 Jan 15 20:49:41.728191 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 235/445] 10.222.0.46 () {58 vars in 1136 bytes} [Sat Jan 15 20:49:41 2022] GET /compute/v2.1/os-networks => generated 4710 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:41.739244 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-156f86fc-412a-4111-9e50-3df4abde7e86 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:41.740184 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-156f86fc-412a-4111-9e50-3df4abde7e86 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] [instance: 770bfdbf-2ac6-4ab9-b2e3-f9e43ae88af6] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:41.751937 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-156f86fc-412a-4111-9e50-3df4abde7e86 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:41.753671 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-156f86fc-412a-4111-9e50-3df4abde7e86 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:41.755492 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-156f86fc-412a-4111-9e50-3df4abde7e86 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:41.757161 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-156f86fc-412a-4111-9e50-3df4abde7e86 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:41.773453 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-55fedf14-3fe6-405e-b7ed-5e06fa69da48 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] 10.222.0.46 "DELETE /compute/v2.1/servers/d5416a14-72ee-4a24-80d3-9fe459a801d8" status: 204 len: 0 microversion: 2.1 time: 0.193440 Jan 15 20:49:41.774800 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 211/446] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 20:49:41 2022] DELETE /compute/v2.1/servers/d5416a14-72ee-4a24-80d3-9fe459a801d8 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 20:49:41.787795 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-adfe3d73-f029-4562-980f-292a98f5caab tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:41.791058 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-adfe3d73-f029-4562-980f-292a98f5caab tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] [instance: d5416a14-72ee-4a24-80d3-9fe459a801d8] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:41.806194 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-adfe3d73-f029-4562-980f-292a98f5caab tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:41.806648 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-adfe3d73-f029-4562-980f-292a98f5caab tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:41.808882 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-adfe3d73-f029-4562-980f-292a98f5caab tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:41.809322 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-adfe3d73-f029-4562-980f-292a98f5caab tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:41.897121 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-156f86fc-412a-4111-9e50-3df4abde7e86 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:41.908710 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-156f86fc-412a-4111-9e50-3df4abde7e86 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:41.911064 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-156f86fc-412a-4111-9e50-3df4abde7e86 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:41.913640 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-156f86fc-412a-4111-9e50-3df4abde7e86 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] 10.222.0.46 "GET /compute/v2.1/servers/770bfdbf-2ac6-4ab9-b2e3-f9e43ae88af6" status: 200 len: 1321 microversion: 2.25 time: 0.184119 Jan 15 20:49:41.915029 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 236/447] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:49:41 2022] GET /compute/v2.1/servers/770bfdbf-2ac6-4ab9-b2e3-f9e43ae88af6 => generated 1321 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:49:42.113831 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-adfe3d73-f029-4562-980f-292a98f5caab tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0079c95473594ee9ada5a4bc6820a111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac923ea754345a9b79457833bd72da4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:42.123485 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-adfe3d73-f029-4562-980f-292a98f5caab tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] 10.222.0.46 "GET /compute/v2.1/servers/d5416a14-72ee-4a24-80d3-9fe459a801d8" status: 200 len: 1475 microversion: 2.1 time: 0.343477 Jan 15 20:49:42.124173 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 212/448] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:41 2022] GET /compute/v2.1/servers/d5416a14-72ee-4a24-80d3-9fe459a801d8 => generated 1475 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:42.352467 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a1285592-62d2-49f5-9d6d-11d9bf9e3fa1 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:42.355723 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a1285592-62d2-49f5-9d6d-11d9bf9e3fa1 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] [instance: 6d487317-4968-4a06-ad7b-4484e8d50f10] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:42.365724 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a1285592-62d2-49f5-9d6d-11d9bf9e3fa1 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:42.366628 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a1285592-62d2-49f5-9d6d-11d9bf9e3fa1 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:42.367900 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a1285592-62d2-49f5-9d6d-11d9bf9e3fa1 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:42.368717 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a1285592-62d2-49f5-9d6d-11d9bf9e3fa1 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:42.396224 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-769a5201-2ba6-40ae-9e19-add099600b22 tempest-KeyPairsV210TestJSON-431098461 tempest-KeyPairsV210TestJSON-431098461-project-admin] Action: 'create', calling method: .version_select at 0x7f30c97ecaf0>, body: {"keypair": {"name": "tempest-keypair-737600514", "type": "ssh", "user_id": "d258493ae5ae4bde9e282ab6411d8ef1"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:42.435237 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-769a5201-2ba6-40ae-9e19-add099600b22 tempest-KeyPairsV210TestJSON-431098461 tempest-KeyPairsV210TestJSON-431098461-project-admin] Getting quotas for project 163a61c934ae4f5dbf357c96942e1acf. Resources: {'key_pairs'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:49:42.439941 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-769a5201-2ba6-40ae-9e19-add099600b22 tempest-KeyPairsV210TestJSON-431098461 tempest-KeyPairsV210TestJSON-431098461-project-admin] Getting quotas for user d2918975d866407bbf7cb133ed24e19b and project 163a61c934ae4f5dbf357c96942e1acf. Resources: {'key_pairs'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:49:42.705957 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-a1285592-62d2-49f5-9d6d-11d9bf9e3fa1 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd06a1f6896564bb58b457d0642f8302c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89aabae1afe4a5a88ed97e87b5266ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:42.722551 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a1285592-62d2-49f5-9d6d-11d9bf9e3fa1 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] 10.222.0.46 "GET /compute/v2.1/servers/6d487317-4968-4a06-ad7b-4484e8d50f10" status: 200 len: 1321 microversion: 2.1 time: 0.377491 Jan 15 20:49:42.724045 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 213/449] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:42 2022] GET /compute/v2.1/servers/6d487317-4968-4a06-ad7b-4484e8d50f10 => generated 1321 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:42.730636 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ef0ac646-041e-427d-96e9-3bd163375fb8 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:42.731445 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ef0ac646-041e-427d-96e9-3bd163375fb8 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: 4d527369-954d-4ccc-9105-03b209d3523e] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:42.738625 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ef0ac646-041e-427d-96e9-3bd163375fb8 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:42.740183 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ef0ac646-041e-427d-96e9-3bd163375fb8 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:42.741469 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ef0ac646-041e-427d-96e9-3bd163375fb8 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:42.742048 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ef0ac646-041e-427d-96e9-3bd163375fb8 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:42.824956 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-769a5201-2ba6-40ae-9e19-add099600b22 tempest-KeyPairsV210TestJSON-431098461 tempest-KeyPairsV210TestJSON-431098461-project-admin] Getting quotas for project 163a61c934ae4f5dbf357c96942e1acf. Resources: {'key_pairs'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:49:42.830314 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-769a5201-2ba6-40ae-9e19-add099600b22 tempest-KeyPairsV210TestJSON-431098461 tempest-KeyPairsV210TestJSON-431098461-project-admin] Getting quotas for user d2918975d866407bbf7cb133ed24e19b and project 163a61c934ae4f5dbf357c96942e1acf. Resources: {'key_pairs'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:49:42.848496 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-769a5201-2ba6-40ae-9e19-add099600b22 tempest-KeyPairsV210TestJSON-431098461 tempest-KeyPairsV210TestJSON-431098461-project-admin] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.10 time: 0.771935 Jan 15 20:49:42.849067 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 237/450] 10.222.0.46 () {62 vars in 1199 bytes} [Sat Jan 15 20:49:42 2022] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 773 msecs (HTTP/1.1 201) 9 headers in 365 bytes (2 switches on core 0) Jan 15 20:49:42.860447 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-86f52e4d-310e-4f60-a66b-4a0217e10e6e tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:42.861401 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-86f52e4d-310e-4f60-a66b-4a0217e10e6e tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 98d0ca37-0175-44e2-8a1d-965cdc517daf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:42.869078 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-86f52e4d-310e-4f60-a66b-4a0217e10e6e tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:42.869531 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-86f52e4d-310e-4f60-a66b-4a0217e10e6e tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:42.870497 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-86f52e4d-310e-4f60-a66b-4a0217e10e6e tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:42.870979 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-86f52e4d-310e-4f60-a66b-4a0217e10e6e tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:42.926950 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-86f52e4d-310e-4f60-a66b-4a0217e10e6e tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action" status: 200 len: 24562 microversion: 2.1 time: 0.070306 Jan 15 20:49:42.928912 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 238/451] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:49:42 2022] POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action => generated 24562 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:49:42.934934 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f82b13eb-64d4-48d8-a634-fc7a6b71ba64 tempest-KeyPairsV210TestJSON-431098461 tempest-KeyPairsV210TestJSON-431098461-project-admin] Action: 'create', calling method: .version_select at 0x7f30c97ec3a0>, body: {"keypair": {"name": "tempest-keypair-1765329764", "type": "ssh", "user_id": "d258493ae5ae4bde9e282ab6411d8ef1"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:42.951291 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-f82b13eb-64d4-48d8-a634-fc7a6b71ba64 tempest-KeyPairsV210TestJSON-431098461 tempest-KeyPairsV210TestJSON-431098461-project-admin] Getting quotas for project 163a61c934ae4f5dbf357c96942e1acf. Resources: {'key_pairs'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:49:42.955392 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-f82b13eb-64d4-48d8-a634-fc7a6b71ba64 tempest-KeyPairsV210TestJSON-431098461 tempest-KeyPairsV210TestJSON-431098461-project-admin] Getting quotas for user d2918975d866407bbf7cb133ed24e19b and project 163a61c934ae4f5dbf357c96942e1acf. Resources: {'key_pairs'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:49:43.096317 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-f82b13eb-64d4-48d8-a634-fc7a6b71ba64 tempest-KeyPairsV210TestJSON-431098461 tempest-KeyPairsV210TestJSON-431098461-project-admin] Getting quotas for project 163a61c934ae4f5dbf357c96942e1acf. Resources: {'key_pairs'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:49:43.102846 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-f82b13eb-64d4-48d8-a634-fc7a6b71ba64 tempest-KeyPairsV210TestJSON-431098461 tempest-KeyPairsV210TestJSON-431098461-project-admin] Getting quotas for user d2918975d866407bbf7cb133ed24e19b and project 163a61c934ae4f5dbf357c96942e1acf. Resources: {'key_pairs'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:49:43.121050 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f82b13eb-64d4-48d8-a634-fc7a6b71ba64 tempest-KeyPairsV210TestJSON-431098461 tempest-KeyPairsV210TestJSON-431098461-project-admin] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.10 time: 0.190752 Jan 15 20:49:43.121988 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 239/452] 10.222.0.46 () {62 vars in 1199 bytes} [Sat Jan 15 20:49:42 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 192 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Jan 15 20:49:43.126972 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-208f1405-cc25-49ea-b2f6-dc1cb7e35cda tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:43.127933 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-208f1405-cc25-49ea-b2f6-dc1cb7e35cda tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] [instance: 770bfdbf-2ac6-4ab9-b2e3-f9e43ae88af6] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:43.138369 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-208f1405-cc25-49ea-b2f6-dc1cb7e35cda tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:43.139053 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-208f1405-cc25-49ea-b2f6-dc1cb7e35cda tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:43.140066 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-208f1405-cc25-49ea-b2f6-dc1cb7e35cda tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:43.140977 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-208f1405-cc25-49ea-b2f6-dc1cb7e35cda tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:43.258572 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-ef0ac646-041e-427d-96e9-3bd163375fb8 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:43.268383 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ef0ac646-041e-427d-96e9-3bd163375fb8 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/4d527369-954d-4ccc-9105-03b209d3523e" status: 200 len: 1476 microversion: 2.1 time: 0.543020 Jan 15 20:49:43.278357 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 214/453] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:42 2022] GET /compute/v2.1/servers/4d527369-954d-4ccc-9105-03b209d3523e => generated 1476 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:43.280368 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-6ecdd254-78a6-4a62-b6d0-66ec07dcb42d tempest-KeyPairsV210TestJSON-431098461 tempest-KeyPairsV210TestJSON-431098461-project-admin] Calling method '.version_select at 0x7f30c97161f0>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:43.302877 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-6ecdd254-78a6-4a62-b6d0-66ec07dcb42d tempest-KeyPairsV210TestJSON-431098461 tempest-KeyPairsV210TestJSON-431098461-project-admin] 10.222.0.46 "GET /compute/v2.1/os-keypairs/tempest-keypair-737600514?user_id=d258493ae5ae4bde9e282ab6411d8ef1" status: 200 len: 705 microversion: 2.10 time: 0.031575 Jan 15 20:49:43.303910 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 215/454] 10.222.0.46 () {60 vars in 1336 bytes} [Sat Jan 15 20:49:43 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-737600514?user_id=d258493ae5ae4bde9e282ab6411d8ef1 => generated 705 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:49:43.313750 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-64ece28d-630c-4e0e-85de-b169caf33617 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:43.314946 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-64ece28d-630c-4e0e-85de-b169caf33617 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] [instance: d5416a14-72ee-4a24-80d3-9fe459a801d8] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:43.328020 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-64ece28d-630c-4e0e-85de-b169caf33617 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:43.328550 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-64ece28d-630c-4e0e-85de-b169caf33617 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:43.329306 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-64ece28d-630c-4e0e-85de-b169caf33617 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:43.329743 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-64ece28d-630c-4e0e-85de-b169caf33617 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:43.674715 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-208f1405-cc25-49ea-b2f6-dc1cb7e35cda tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:43.683123 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-208f1405-cc25-49ea-b2f6-dc1cb7e35cda tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:43.684615 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-208f1405-cc25-49ea-b2f6-dc1cb7e35cda tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:43.685743 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-208f1405-cc25-49ea-b2f6-dc1cb7e35cda tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] 10.222.0.46 "GET /compute/v2.1/servers/770bfdbf-2ac6-4ab9-b2e3-f9e43ae88af6" status: 200 len: 1361 microversion: 2.25 time: 0.562645 Jan 15 20:49:43.686298 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 240/455] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:49:43 2022] GET /compute/v2.1/servers/770bfdbf-2ac6-4ab9-b2e3-f9e43ae88af6 => generated 1361 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:49:43.709205 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-95647cc1-5107-4b2e-a9aa-7f0c5320c318 tempest-KeyPairsV210TestJSON-431098461 tempest-KeyPairsV210TestJSON-431098461-project-admin] Action: 'create', calling method: .version_select at 0x7f30c9781e50>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-1053013448", "type": "ssh"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:43.738780 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-95647cc1-5107-4b2e-a9aa-7f0c5320c318 tempest-KeyPairsV210TestJSON-431098461 tempest-KeyPairsV210TestJSON-431098461-project-admin] Getting quotas for project 163a61c934ae4f5dbf357c96942e1acf. Resources: {'key_pairs'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:49:43.751268 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-95647cc1-5107-4b2e-a9aa-7f0c5320c318 tempest-KeyPairsV210TestJSON-431098461 tempest-KeyPairsV210TestJSON-431098461-project-admin] Getting quotas for user d2918975d866407bbf7cb133ed24e19b and project 163a61c934ae4f5dbf357c96942e1acf. Resources: {'key_pairs'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:49:43.805525 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-64ece28d-630c-4e0e-85de-b169caf33617 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0079c95473594ee9ada5a4bc6820a111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac923ea754345a9b79457833bd72da4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:43.820292 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-64ece28d-630c-4e0e-85de-b169caf33617 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] 10.222.0.46 "GET /compute/v2.1/servers/d5416a14-72ee-4a24-80d3-9fe459a801d8" status: 200 len: 1475 microversion: 2.1 time: 0.511436 Jan 15 20:49:43.833071 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 216/456] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:43 2022] GET /compute/v2.1/servers/d5416a14-72ee-4a24-80d3-9fe459a801d8 => generated 1475 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:43.837590 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3b348850-0d0e-4b35-80d5-b12b3c544494 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:43.838205 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-3b348850-0d0e-4b35-80d5-b12b3c544494 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] [instance: 6d487317-4968-4a06-ad7b-4484e8d50f10] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:43.845877 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3b348850-0d0e-4b35-80d5-b12b3c544494 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:43.846332 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3b348850-0d0e-4b35-80d5-b12b3c544494 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:43.847118 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3b348850-0d0e-4b35-80d5-b12b3c544494 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:43.847554 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3b348850-0d0e-4b35-80d5-b12b3c544494 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:44.021051 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-95647cc1-5107-4b2e-a9aa-7f0c5320c318 tempest-KeyPairsV210TestJSON-431098461 tempest-KeyPairsV210TestJSON-431098461-project-admin] Getting quotas for project 163a61c934ae4f5dbf357c96942e1acf. Resources: {'key_pairs'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:49:44.042469 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-95647cc1-5107-4b2e-a9aa-7f0c5320c318 tempest-KeyPairsV210TestJSON-431098461 tempest-KeyPairsV210TestJSON-431098461-project-admin] Getting quotas for user d2918975d866407bbf7cb133ed24e19b and project 163a61c934ae4f5dbf357c96942e1acf. Resources: {'key_pairs'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:49:44.074583 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-95647cc1-5107-4b2e-a9aa-7f0c5320c318 tempest-KeyPairsV210TestJSON-431098461 tempest-KeyPairsV210TestJSON-431098461-project-admin] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 201 len: 2337 microversion: 2.10 time: 0.381119 Jan 15 20:49:44.081498 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 241/457] 10.222.0.46 () {62 vars in 1198 bytes} [Sat Jan 15 20:49:43 2022] POST /compute/v2.1/os-keypairs => generated 2337 bytes in 383 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Jan 15 20:49:44.081498 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0e74de8e-e79a-456c-9fdd-0085cb81318c tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:44.081498 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-0e74de8e-e79a-456c-9fdd-0085cb81318c tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 98d0ca37-0175-44e2-8a1d-965cdc517daf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:44.089525 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0e74de8e-e79a-456c-9fdd-0085cb81318c tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:44.089985 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0e74de8e-e79a-456c-9fdd-0085cb81318c tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:44.090783 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0e74de8e-e79a-456c-9fdd-0085cb81318c tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:44.091358 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0e74de8e-e79a-456c-9fdd-0085cb81318c tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:44.142759 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0e74de8e-e79a-456c-9fdd-0085cb81318c tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action" status: 200 len: 24562 microversion: 2.1 time: 0.065205 Jan 15 20:49:44.143595 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 242/458] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:49:44 2022] POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action => generated 24562 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:49:44.150917 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-5ef64b0f-3b17-408c-8c24-25f0862c3954 tempest-KeyPairsV210TestJSON-431098461 tempest-KeyPairsV210TestJSON-431098461-project-admin] Calling method '.version_select at 0x7f30c9795310>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:44.157079 ncdv-master-1 devstack@n-api.service[129366]: WARNING oslo_db.sqlalchemy.utils [None req-5ef64b0f-3b17-408c-8c24-25f0862c3954 tempest-KeyPairsV210TestJSON-431098461 tempest-KeyPairsV210TestJSON-431098461-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Jan 15 20:49:44.169003 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-5ef64b0f-3b17-408c-8c24-25f0862c3954 tempest-KeyPairsV210TestJSON-431098461 tempest-KeyPairsV210TestJSON-431098461-project-admin] 10.222.0.46 "GET /compute/v2.1/os-keypairs?user_id=d258493ae5ae4bde9e282ab6411d8ef1" status: 200 len: 1113 microversion: 2.10 time: 0.022988 Jan 15 20:49:44.170031 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 243/459] 10.222.0.46 () {60 vars in 1258 bytes} [Sat Jan 15 20:49:44 2022] GET /compute/v2.1/os-keypairs?user_id=d258493ae5ae4bde9e282ab6411d8ef1 => generated 1113 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:49:44.177067 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-95567cb1-9e35-4586-83d8-de3c4a195655 req-90cf6eec-8382-4d65-adee-ea34c57145b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5416a14-72ee-4a24-80d3-9fe459a801d8", "name": "network-vif-deleted", "tag": "5a8eebf2-aebe-45dc-86b0-8add6202f632"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:44.179578 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:44.179578 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:49:44.201160 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-95567cb1-9e35-4586-83d8-de3c4a195655 req-90cf6eec-8382-4d65-adee-ea34c57145b3 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:44.201973 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-95567cb1-9e35-4586-83d8-de3c4a195655 req-90cf6eec-8382-4d65-adee-ea34c57145b3 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:44.222173 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-95567cb1-9e35-4586-83d8-de3c4a195655 req-90cf6eec-8382-4d65-adee-ea34c57145b3 service nova] Creating event network-vif-deleted:5a8eebf2-aebe-45dc-86b0-8add6202f632 for instance d5416a14-72ee-4a24-80d3-9fe459a801d8 on nch1-master-1 Jan 15 20:49:44.230818 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-95567cb1-9e35-4586-83d8-de3c4a195655 req-90cf6eec-8382-4d65-adee-ea34c57145b3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057453 Jan 15 20:49:44.232559 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 244/460] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:49:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:49:44.242704 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ccb7942c-b96e-4ccf-a093-a739a866bec9 tempest-KeyPairsV210TestJSON-431098461 tempest-KeyPairsV210TestJSON-431098461-project-admin] Calling method '.version_select at 0x7f30c97ab280>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:44.288740 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ccb7942c-b96e-4ccf-a093-a739a866bec9 tempest-KeyPairsV210TestJSON-431098461 tempest-KeyPairsV210TestJSON-431098461-project-admin] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1053013448" status: 204 len: 0 microversion: 2.10 time: 0.053908 Jan 15 20:49:44.289387 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 245/461] 10.222.0.46 () {60 vars in 1324 bytes} [Sat Jan 15 20:49:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1053013448 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 15 20:49:44.297183 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c9e5572f-d4c4-470a-8621-4a6e7ab97ec6 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:44.301293 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c9e5572f-d4c4-470a-8621-4a6e7ab97ec6 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: 4d527369-954d-4ccc-9105-03b209d3523e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:44.313446 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c9e5572f-d4c4-470a-8621-4a6e7ab97ec6 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:44.323486 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c9e5572f-d4c4-470a-8621-4a6e7ab97ec6 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:44.330189 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c9e5572f-d4c4-470a-8621-4a6e7ab97ec6 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:44.330869 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c9e5572f-d4c4-470a-8621-4a6e7ab97ec6 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:44.549529 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-3b348850-0d0e-4b35-80d5-b12b3c544494 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd06a1f6896564bb58b457d0642f8302c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89aabae1afe4a5a88ed97e87b5266ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:44.557617 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3b348850-0d0e-4b35-80d5-b12b3c544494 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] 10.222.0.46 "GET /compute/v2.1/servers/6d487317-4968-4a06-ad7b-4484e8d50f10" status: 200 len: 1321 microversion: 2.1 time: 0.729985 Jan 15 20:49:44.561909 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 217/462] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:43 2022] GET /compute/v2.1/servers/6d487317-4968-4a06-ad7b-4484e8d50f10 => generated 1321 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:44.575914 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-664abcc1-e44f-4feb-b42a-ff217da7e110 tempest-KeyPairsV210TestJSON-431098461 tempest-KeyPairsV210TestJSON-431098461-project-admin] Calling method '.version_select at 0x7f30c96a1790>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:44.623103 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-664abcc1-e44f-4feb-b42a-ff217da7e110 tempest-KeyPairsV210TestJSON-431098461 tempest-KeyPairsV210TestJSON-431098461-project-admin] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1765329764?user_id=d258493ae5ae4bde9e282ab6411d8ef1" status: 204 len: 0 microversion: 2.10 time: 0.060032 Jan 15 20:49:44.624242 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 218/463] 10.222.0.46 () {60 vars in 1342 bytes} [Sat Jan 15 20:49:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1765329764?user_id=d258493ae5ae4bde9e282ab6411d8ef1 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 15 20:49:44.631914 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-45352ce8-ac8a-453e-b3c1-6f45cfe2f312 tempest-KeyPairsV210TestJSON-431098461 tempest-KeyPairsV210TestJSON-431098461-project-admin] Calling method '.version_select at 0x7f30c97164c0>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:44.659059 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-45352ce8-ac8a-453e-b3c1-6f45cfe2f312 tempest-KeyPairsV210TestJSON-431098461 tempest-KeyPairsV210TestJSON-431098461-project-admin] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-737600514?user_id=d258493ae5ae4bde9e282ab6411d8ef1" status: 204 len: 0 microversion: 2.10 time: 0.030696 Jan 15 20:49:44.659789 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 219/464] 10.222.0.46 () {60 vars in 1339 bytes} [Sat Jan 15 20:49:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-737600514?user_id=d258493ae5ae4bde9e282ab6411d8ef1 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jan 15 20:49:44.704509 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d02ef774-d780-4b04-8dd4-ba57aa5dca62 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:44.705664 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d02ef774-d780-4b04-8dd4-ba57aa5dca62 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] [instance: 770bfdbf-2ac6-4ab9-b2e3-f9e43ae88af6] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:44.717412 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d02ef774-d780-4b04-8dd4-ba57aa5dca62 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:44.718933 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d02ef774-d780-4b04-8dd4-ba57aa5dca62 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:44.721725 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d02ef774-d780-4b04-8dd4-ba57aa5dca62 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:44.722991 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d02ef774-d780-4b04-8dd4-ba57aa5dca62 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:44.779903 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-c9e5572f-d4c4-470a-8621-4a6e7ab97ec6 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:44.791305 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c9e5572f-d4c4-470a-8621-4a6e7ab97ec6 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/4d527369-954d-4ccc-9105-03b209d3523e" status: 200 len: 1476 microversion: 2.1 time: 0.500594 Jan 15 20:49:44.799777 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 246/465] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:44 2022] GET /compute/v2.1/servers/4d527369-954d-4ccc-9105-03b209d3523e => generated 1476 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:44.843618 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c5931a9c-a711-417a-9a52-8fb0a3c7e536 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:44.845130 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c5931a9c-a711-417a-9a52-8fb0a3c7e536 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] [instance: d5416a14-72ee-4a24-80d3-9fe459a801d8] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:44.851922 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c5931a9c-a711-417a-9a52-8fb0a3c7e536 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:44.852677 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c5931a9c-a711-417a-9a52-8fb0a3c7e536 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:44.853693 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c5931a9c-a711-417a-9a52-8fb0a3c7e536 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:44.854587 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c5931a9c-a711-417a-9a52-8fb0a3c7e536 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:44.885087 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-c5931a9c-a711-417a-9a52-8fb0a3c7e536 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] HTTP exception thrown: Instance d5416a14-72ee-4a24-80d3-9fe459a801d8 could not be found. Jan 15 20:49:44.888588 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c5931a9c-a711-417a-9a52-8fb0a3c7e536 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] Returning 404 to user: Instance d5416a14-72ee-4a24-80d3-9fe459a801d8 could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:49:44.890093 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c5931a9c-a711-417a-9a52-8fb0a3c7e536 tempest-LiveMigrationNegativeTest-264390158 tempest-LiveMigrationNegativeTest-264390158-project] 10.222.0.46 "GET /compute/v2.1/servers/d5416a14-72ee-4a24-80d3-9fe459a801d8" status: 404 len: 111 microversion: 2.1 time: 0.053008 Jan 15 20:49:44.891154 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 247/466] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:44 2022] GET /compute/v2.1/servers/d5416a14-72ee-4a24-80d3-9fe459a801d8 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 15 20:49:45.056285 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-f2e7a7e7-631c-4bb3-8283-c9448d4b8e27 req-96869f57-364e-4767-ab8c-d942b37283ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "770bfdbf-2ac6-4ab9-b2e3-f9e43ae88af6", "tag": "6a747998-2bca-46bb-a26f-e7c31a2aa686"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:45.058890 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:45.058890 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:49:45.072257 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-f2e7a7e7-631c-4bb3-8283-c9448d4b8e27 req-96869f57-364e-4767-ab8c-d942b37283ad service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:45.072697 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-f2e7a7e7-631c-4bb3-8283-c9448d4b8e27 req-96869f57-364e-4767-ab8c-d942b37283ad service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:45.108662 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-f2e7a7e7-631c-4bb3-8283-c9448d4b8e27 req-96869f57-364e-4767-ab8c-d942b37283ad service nova] Creating event network-changed:6a747998-2bca-46bb-a26f-e7c31a2aa686 for instance 770bfdbf-2ac6-4ab9-b2e3-f9e43ae88af6 on nch1-master-1 Jan 15 20:49:45.113677 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-f2e7a7e7-631c-4bb3-8283-c9448d4b8e27 req-96869f57-364e-4767-ab8c-d942b37283ad service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061071 Jan 15 20:49:45.114273 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 248/467] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:49:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 20:49:45.155006 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-202565c8-cfe9-425b-aee8-d30ec3c18f9b tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:45.156324 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-202565c8-cfe9-425b-aee8-d30ec3c18f9b tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 98d0ca37-0175-44e2-8a1d-965cdc517daf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:45.166176 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-202565c8-cfe9-425b-aee8-d30ec3c18f9b tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:45.171484 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-202565c8-cfe9-425b-aee8-d30ec3c18f9b tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:45.172459 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-202565c8-cfe9-425b-aee8-d30ec3c18f9b tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:45.173210 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-202565c8-cfe9-425b-aee8-d30ec3c18f9b tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:45.216966 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-d02ef774-d780-4b04-8dd4-ba57aa5dca62 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:45.238454 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-d02ef774-d780-4b04-8dd4-ba57aa5dca62 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:45.240361 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-d02ef774-d780-4b04-8dd4-ba57aa5dca62 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:45.241715 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d02ef774-d780-4b04-8dd4-ba57aa5dca62 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] 10.222.0.46 "GET /compute/v2.1/servers/770bfdbf-2ac6-4ab9-b2e3-f9e43ae88af6" status: 200 len: 1361 microversion: 2.25 time: 0.541986 Jan 15 20:49:45.243082 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 220/468] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:49:44 2022] GET /compute/v2.1/servers/770bfdbf-2ac6-4ab9-b2e3-f9e43ae88af6 => generated 1361 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 15 20:49:45.252338 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-202565c8-cfe9-425b-aee8-d30ec3c18f9b tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action" status: 200 len: 24562 microversion: 2.1 time: 0.101657 Jan 15 20:49:45.253448 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 249/469] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:49:45 2022] POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action => generated 24562 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 20:49:45.574672 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-0c217519-9a88-462b-958f-d50ae507198d req-a6ab4c80-ea0c-4b57-9fcf-4b44fc3801b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d487317-4968-4a06-ad7b-4484e8d50f10", "name": "network-vif-plugged", "status": "completed", "tag": "efa38908-68d7-44e3-a60f-24a9f554d75e"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:45.576321 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:45.576321 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:49:45.580395 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d5134258-1ad2-462d-94f9-20519e5274b3 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:45.581551 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-d5134258-1ad2-462d-94f9-20519e5274b3 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] [instance: 6d487317-4968-4a06-ad7b-4484e8d50f10] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:45.596908 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-0c217519-9a88-462b-958f-d50ae507198d req-a6ab4c80-ea0c-4b57-9fcf-4b44fc3801b8 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:45.597356 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-0c217519-9a88-462b-958f-d50ae507198d req-a6ab4c80-ea0c-4b57-9fcf-4b44fc3801b8 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:45.598398 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d5134258-1ad2-462d-94f9-20519e5274b3 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:45.600622 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d5134258-1ad2-462d-94f9-20519e5274b3 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:45.603853 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d5134258-1ad2-462d-94f9-20519e5274b3 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:45.605810 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d5134258-1ad2-462d-94f9-20519e5274b3 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:45.636217 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-0c217519-9a88-462b-958f-d50ae507198d req-a6ab4c80-ea0c-4b57-9fcf-4b44fc3801b8 service nova] Creating event network-vif-plugged:efa38908-68d7-44e3-a60f-24a9f554d75e for instance 6d487317-4968-4a06-ad7b-4484e8d50f10 on nch2-master-1 Jan 15 20:49:45.647590 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-0c217519-9a88-462b-958f-d50ae507198d req-a6ab4c80-ea0c-4b57-9fcf-4b44fc3801b8 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076770 Jan 15 20:49:45.655801 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 221/470] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:49:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:49:45.818307 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-0ffb2922-21b9-4944-b0f0-bc703f2e64b8 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:45.819363 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-0ffb2922-21b9-4944-b0f0-bc703f2e64b8 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: 4d527369-954d-4ccc-9105-03b209d3523e] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:45.835871 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0ffb2922-21b9-4944-b0f0-bc703f2e64b8 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:45.844592 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0ffb2922-21b9-4944-b0f0-bc703f2e64b8 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:45.845674 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0ffb2922-21b9-4944-b0f0-bc703f2e64b8 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:45.848068 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0ffb2922-21b9-4944-b0f0-bc703f2e64b8 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:46.188627 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-d5134258-1ad2-462d-94f9-20519e5274b3 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd06a1f6896564bb58b457d0642f8302c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89aabae1afe4a5a88ed97e87b5266ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:46.196629 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d5134258-1ad2-462d-94f9-20519e5274b3 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] 10.222.0.46 "GET /compute/v2.1/servers/6d487317-4968-4a06-ad7b-4484e8d50f10" status: 200 len: 1321 microversion: 2.1 time: 0.620965 Jan 15 20:49:46.199251 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 250/471] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:45 2022] GET /compute/v2.1/servers/6d487317-4968-4a06-ad7b-4484e8d50f10 => generated 1321 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:46.260480 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-385b03b8-bc19-4253-9e2f-31ad2f85b63b tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:46.262039 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-385b03b8-bc19-4253-9e2f-31ad2f85b63b tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] [instance: 770bfdbf-2ac6-4ab9-b2e3-f9e43ae88af6] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:46.268577 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-385b03b8-bc19-4253-9e2f-31ad2f85b63b tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:46.272014 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-385b03b8-bc19-4253-9e2f-31ad2f85b63b tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:46.274722 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-385b03b8-bc19-4253-9e2f-31ad2f85b63b tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:46.276593 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-385b03b8-bc19-4253-9e2f-31ad2f85b63b tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:46.285657 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-0ffb2922-21b9-4944-b0f0-bc703f2e64b8 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:46.293292 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-0ffb2922-21b9-4944-b0f0-bc703f2e64b8 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/4d527369-954d-4ccc-9105-03b209d3523e" status: 200 len: 1476 microversion: 2.1 time: 0.479249 Jan 15 20:49:46.305236 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 222/472] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:45 2022] GET /compute/v2.1/servers/4d527369-954d-4ccc-9105-03b209d3523e => generated 1476 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:46.310911 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-fe0dcf40-7798-4b2b-ae41-9caea0a489a2 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:46.312019 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-fe0dcf40-7798-4b2b-ae41-9caea0a489a2 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 98d0ca37-0175-44e2-8a1d-965cdc517daf] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:46.329130 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fe0dcf40-7798-4b2b-ae41-9caea0a489a2 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:46.329998 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fe0dcf40-7798-4b2b-ae41-9caea0a489a2 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:46.331142 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fe0dcf40-7798-4b2b-ae41-9caea0a489a2 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:46.331883 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fe0dcf40-7798-4b2b-ae41-9caea0a489a2 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:46.396475 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-fe0dcf40-7798-4b2b-ae41-9caea0a489a2 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action" status: 200 len: 24562 microversion: 2.1 time: 0.088545 Jan 15 20:49:46.404776 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 223/473] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:49:46 2022] POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action => generated 24562 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:49:46.639688 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-385b03b8-bc19-4253-9e2f-31ad2f85b63b tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:46.653036 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-385b03b8-bc19-4253-9e2f-31ad2f85b63b tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:46.654841 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-385b03b8-bc19-4253-9e2f-31ad2f85b63b tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:46.661475 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-385b03b8-bc19-4253-9e2f-31ad2f85b63b tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] 10.222.0.46 "GET /compute/v2.1/servers/770bfdbf-2ac6-4ab9-b2e3-f9e43ae88af6" status: 200 len: 1361 microversion: 2.25 time: 0.402484 Jan 15 20:49:46.662802 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 251/474] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:49:46 2022] GET /compute/v2.1/servers/770bfdbf-2ac6-4ab9-b2e3-f9e43ae88af6 => generated 1361 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 15 20:49:47.218406 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-db5c464d-0a23-4fed-ab42-adf897682a68 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:47.219135 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-db5c464d-0a23-4fed-ab42-adf897682a68 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] [instance: 6d487317-4968-4a06-ad7b-4484e8d50f10] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:47.230001 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-db5c464d-0a23-4fed-ab42-adf897682a68 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:47.238412 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-db5c464d-0a23-4fed-ab42-adf897682a68 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:47.239315 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-db5c464d-0a23-4fed-ab42-adf897682a68 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:47.239830 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-db5c464d-0a23-4fed-ab42-adf897682a68 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:47.312947 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c32c3c98-adae-4b37-9afd-aedbdaf38af2 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:47.316598 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c32c3c98-adae-4b37-9afd-aedbdaf38af2 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: 4d527369-954d-4ccc-9105-03b209d3523e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:47.331423 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c32c3c98-adae-4b37-9afd-aedbdaf38af2 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:47.332448 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c32c3c98-adae-4b37-9afd-aedbdaf38af2 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:47.333778 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c32c3c98-adae-4b37-9afd-aedbdaf38af2 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:47.337083 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c32c3c98-adae-4b37-9afd-aedbdaf38af2 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:47.760692 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-db5c464d-0a23-4fed-ab42-adf897682a68 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd06a1f6896564bb58b457d0642f8302c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89aabae1afe4a5a88ed97e87b5266ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:47.770954 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-db5c464d-0a23-4fed-ab42-adf897682a68 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] 10.222.0.46 "GET /compute/v2.1/servers/6d487317-4968-4a06-ad7b-4484e8d50f10" status: 200 len: 1471 microversion: 2.1 time: 0.557427 Jan 15 20:49:47.771782 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 224/475] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:47 2022] GET /compute/v2.1/servers/6d487317-4968-4a06-ad7b-4484e8d50f10 => generated 1471 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:47.778730 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-7ff78cc4-d043-44d2-9e68-554706ea6059 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:47.780321 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-7ff78cc4-d043-44d2-9e68-554706ea6059 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 98d0ca37-0175-44e2-8a1d-965cdc517daf] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:47.796747 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7ff78cc4-d043-44d2-9e68-554706ea6059 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:47.796747 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7ff78cc4-d043-44d2-9e68-554706ea6059 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:47.797687 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7ff78cc4-d043-44d2-9e68-554706ea6059 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:47.798257 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7ff78cc4-d043-44d2-9e68-554706ea6059 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:47.850834 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-7ff78cc4-d043-44d2-9e68-554706ea6059 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action" status: 200 len: 24562 microversion: 2.1 time: 0.077637 Jan 15 20:49:47.851866 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 225/476] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:49:47 2022] POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action => generated 24562 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:49:47.862824 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-7caa1655-8e30-4ab8-96b6-ae8c35b9a64f tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:47.878552 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-7caa1655-8e30-4ab8-96b6-ae8c35b9a64f tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] [instance: 770bfdbf-2ac6-4ab9-b2e3-f9e43ae88af6] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:47.899311 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7caa1655-8e30-4ab8-96b6-ae8c35b9a64f tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:47.900571 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7caa1655-8e30-4ab8-96b6-ae8c35b9a64f tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:47.902708 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7caa1655-8e30-4ab8-96b6-ae8c35b9a64f tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:47.904667 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7caa1655-8e30-4ab8-96b6-ae8c35b9a64f tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:47.927847 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-c32c3c98-adae-4b37-9afd-aedbdaf38af2 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:47.935777 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c32c3c98-adae-4b37-9afd-aedbdaf38af2 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/4d527369-954d-4ccc-9105-03b209d3523e" status: 200 len: 1476 microversion: 2.1 time: 0.628800 Jan 15 20:49:47.936357 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 252/477] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:47 2022] GET /compute/v2.1/servers/4d527369-954d-4ccc-9105-03b209d3523e => generated 1476 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:48.216490 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-7caa1655-8e30-4ab8-96b6-ae8c35b9a64f tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:48.224508 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-7caa1655-8e30-4ab8-96b6-ae8c35b9a64f tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:48.226048 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-7caa1655-8e30-4ab8-96b6-ae8c35b9a64f tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:48.227144 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-7caa1655-8e30-4ab8-96b6-ae8c35b9a64f tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] 10.222.0.46 "GET /compute/v2.1/servers/770bfdbf-2ac6-4ab9-b2e3-f9e43ae88af6" status: 200 len: 1361 microversion: 2.25 time: 0.369818 Jan 15 20:49:48.239153 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 226/478] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:49:47 2022] GET /compute/v2.1/servers/770bfdbf-2ac6-4ab9-b2e3-f9e43ae88af6 => generated 1361 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:49:48.381868 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a9abf4ff-e9bb-4dda-aeef-fe6dedccf4d0 tempest-ServersAdminNegativeTestJSON-496905829 tempest-ServersAdminNegativeTestJSON-496905829-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:48.383038 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a9abf4ff-e9bb-4dda-aeef-fe6dedccf4d0 tempest-ServersAdminNegativeTestJSON-496905829 tempest-ServersAdminNegativeTestJSON-496905829-project-admin] [instance: 0603397b-3409-4099-9149-509e62c723b1] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:48.389230 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-a9abf4ff-e9bb-4dda-aeef-fe6dedccf4d0 tempest-ServersAdminNegativeTestJSON-496905829 tempest-ServersAdminNegativeTestJSON-496905829-project-admin] HTTP exception thrown: Instance 0603397b-3409-4099-9149-509e62c723b1 could not be found. Jan 15 20:49:48.390027 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a9abf4ff-e9bb-4dda-aeef-fe6dedccf4d0 tempest-ServersAdminNegativeTestJSON-496905829 tempest-ServersAdminNegativeTestJSON-496905829-project-admin] Returning 404 to user: Instance 0603397b-3409-4099-9149-509e62c723b1 could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:49:48.391158 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a9abf4ff-e9bb-4dda-aeef-fe6dedccf4d0 tempest-ServersAdminNegativeTestJSON-496905829 tempest-ServersAdminNegativeTestJSON-496905829-project-admin] 10.222.0.46 "POST /compute/v2.1/servers/0603397b-3409-4099-9149-509e62c723b1/action" status: 404 len: 111 microversion: 2.1 time: 0.448822 Jan 15 20:49:48.391733 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 253/479] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:49:47 2022] POST /compute/v2.1/servers/0603397b-3409-4099-9149-509e62c723b1/action => generated 111 bytes in 450 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:49:48.628732 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-73f9e84b-d66e-4a0a-aa77-f3318d329885 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-409695095", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:48.680301 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.network.neutron [None req-73f9e84b-d66e-4a0a-aa77-f3318d329885 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] validate_networks() for None {{(pid=129365) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 20:49:48.863220 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-14dce30c-58da-4fd8-8c20-33cecf9f54db tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:48.864206 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-14dce30c-58da-4fd8-8c20-33cecf9f54db tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 98d0ca37-0175-44e2-8a1d-965cdc517daf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:48.874259 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-14dce30c-58da-4fd8-8c20-33cecf9f54db tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:48.874705 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-14dce30c-58da-4fd8-8c20-33cecf9f54db tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:48.886126 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-14dce30c-58da-4fd8-8c20-33cecf9f54db tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:48.886614 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-14dce30c-58da-4fd8-8c20-33cecf9f54db tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:48.973579 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-14dce30c-58da-4fd8-8c20-33cecf9f54db tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action" status: 200 len: 32634 microversion: 2.1 time: 0.114128 Jan 15 20:49:48.974874 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 254/480] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:49:48 2022] POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action => generated 32634 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 20:49:48.982441 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-73f9e84b-d66e-4a0a-aa77-f3318d329885 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Flavor limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 20:49:48.983040 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-73f9e84b-d66e-4a0a-aa77-f3318d329885 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Image limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 20:49:48.983723 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-73f9e84b-d66e-4a0a-aa77-f3318d329885 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Flavor pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 20:49:48.984329 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-73f9e84b-d66e-4a0a-aa77-f3318d329885 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Image pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 20:49:48.985316 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-60495d6b-a075-47f9-b196-01d6a50748d6 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:48.985835 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-73f9e84b-d66e-4a0a-aa77-f3318d329885 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 20:49:48.986114 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-60495d6b-a075-47f9-b196-01d6a50748d6 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: 4d527369-954d-4ccc-9105-03b209d3523e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:49.002045 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-73f9e84b-d66e-4a0a-aa77-f3318d329885 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:49.002326 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-60495d6b-a075-47f9-b196-01d6a50748d6 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:49.002475 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-73f9e84b-d66e-4a0a-aa77-f3318d329885 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:49.003289 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-73f9e84b-d66e-4a0a-aa77-f3318d329885 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:49.003906 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-73f9e84b-d66e-4a0a-aa77-f3318d329885 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:49.007867 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-60495d6b-a075-47f9-b196-01d6a50748d6 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:49.008701 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-60495d6b-a075-47f9-b196-01d6a50748d6 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:49.009176 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-60495d6b-a075-47f9-b196-01d6a50748d6 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:49.024783 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-73f9e84b-d66e-4a0a-aa77-f3318d329885 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Getting quotas for project a89aabae1afe4a5a88ed97e87b5266ac. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:49:49.030240 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-73f9e84b-d66e-4a0a-aa77-f3318d329885 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Getting quotas for user d06a1f6896564bb58b457d0642f8302c and project a89aabae1afe4a5a88ed97e87b5266ac. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:49:49.046040 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-73f9e84b-d66e-4a0a-aa77-f3318d329885 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Going to run 1 instances... {{(pid=129365) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 20:49:49.049028 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-73f9e84b-d66e-4a0a-aa77-f3318d329885 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] [instance: a5c419d5-7255-4ab1-8ada-6bb413faa169] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129365) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 20:49:49.138883 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-73f9e84b-d66e-4a0a-aa77-f3318d329885 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.514071 Jan 15 20:49:49.140099 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 227/481] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 20:49:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 516 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 20:49:49.163940 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-25ab3c04-05d7-42c2-ba05-edd9758e82e8 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:49.163940 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-25ab3c04-05d7-42c2-ba05-edd9758e82e8 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] [instance: a5c419d5-7255-4ab1-8ada-6bb413faa169] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:49.244190 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-25ab3c04-05d7-42c2-ba05-edd9758e82e8 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd06a1f6896564bb58b457d0642f8302c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89aabae1afe4a5a88ed97e87b5266ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:49.258557 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-25ab3c04-05d7-42c2-ba05-edd9758e82e8 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] 10.222.0.46 "GET /compute/v2.1/servers/a5c419d5-7255-4ab1-8ada-6bb413faa169" status: 200 len: 1221 microversion: 2.1 time: 0.103255 Jan 15 20:49:49.259125 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 228/482] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:49 2022] GET /compute/v2.1/servers/a5c419d5-7255-4ab1-8ada-6bb413faa169 => generated 1221 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:49:49.279242 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-60495d6b-a075-47f9-b196-01d6a50748d6 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:49.287100 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-60495d6b-a075-47f9-b196-01d6a50748d6 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/4d527369-954d-4ccc-9105-03b209d3523e" status: 200 len: 1476 microversion: 2.1 time: 0.310886 Jan 15 20:49:49.288244 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 255/483] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:48 2022] GET /compute/v2.1/servers/4d527369-954d-4ccc-9105-03b209d3523e => generated 1476 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:49.300372 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-fda62cc3-4960-4e8e-8415-459e56a9e71d tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:49.303238 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-fda62cc3-4960-4e8e-8415-459e56a9e71d tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] [instance: 770bfdbf-2ac6-4ab9-b2e3-f9e43ae88af6] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:49.312558 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fda62cc3-4960-4e8e-8415-459e56a9e71d tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:49.313674 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fda62cc3-4960-4e8e-8415-459e56a9e71d tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:49.314419 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fda62cc3-4960-4e8e-8415-459e56a9e71d tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:49.314812 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fda62cc3-4960-4e8e-8415-459e56a9e71d tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:49.508791 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-fda62cc3-4960-4e8e-8415-459e56a9e71d tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:49.524040 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-fda62cc3-4960-4e8e-8415-459e56a9e71d tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:49.526537 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-fda62cc3-4960-4e8e-8415-459e56a9e71d tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:49.527883 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-fda62cc3-4960-4e8e-8415-459e56a9e71d tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] 10.222.0.46 "GET /compute/v2.1/servers/770bfdbf-2ac6-4ab9-b2e3-f9e43ae88af6" status: 200 len: 1361 microversion: 2.25 time: 0.238628 Jan 15 20:49:49.529062 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 256/484] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:49:49 2022] GET /compute/v2.1/servers/770bfdbf-2ac6-4ab9-b2e3-f9e43ae88af6 => generated 1361 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:49:49.636709 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b1364796-1502-4d2a-b7c0-f3dff15b8ea0 tempest-QuotasAdminTestJSON-974873640 tempest-QuotasAdminTestJSON-974873640-project-admin] Calling method '.version_select at 0x7f30c984e700>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:49.986944 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f3592b03-6716-4028-8cb7-03a327e3eb61 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:49.988112 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f3592b03-6716-4028-8cb7-03a327e3eb61 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 98d0ca37-0175-44e2-8a1d-965cdc517daf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:49.997456 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f3592b03-6716-4028-8cb7-03a327e3eb61 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:49.997893 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f3592b03-6716-4028-8cb7-03a327e3eb61 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:49.998795 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f3592b03-6716-4028-8cb7-03a327e3eb61 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:49.999231 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f3592b03-6716-4028-8cb7-03a327e3eb61 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:50.056733 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f3592b03-6716-4028-8cb7-03a327e3eb61 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action" status: 200 len: 32634 microversion: 2.1 time: 0.074196 Jan 15 20:49:50.057948 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 257/485] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:49:49 2022] POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action => generated 32634 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 20:49:50.081536 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b1364796-1502-4d2a-b7c0-f3dff15b8ea0 tempest-QuotasAdminTestJSON-974873640 tempest-QuotasAdminTestJSON-974873640-project-admin] 10.222.0.46 "GET /compute/v2.1/os-quota-sets/50b3fcfdaf254d7f837cf27ee8347b2b" status: 200 len: 371 microversion: 2.1 time: 0.820287 Jan 15 20:49:50.083825 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 229/486] 10.222.0.46 () {58 vars in 1241 bytes} [Sat Jan 15 20:49:49 2022] GET /compute/v2.1/os-quota-sets/50b3fcfdaf254d7f837cf27ee8347b2b => generated 371 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:49:50.096782 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d6273be8-0f67-488f-bf69-49c162fead54 tempest-QuotasAdminTestJSON-974873640 tempest-QuotasAdminTestJSON-974873640-project-admin] Action: 'update', calling method: .version_select at 0x7f30c98183a0>, body: {"quota_set": {"ram": "5120"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:50.098699 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-sets:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:50.098699 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:49:50.279921 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-eb55d983-cf53-437f-9803-3628c89d9e3c tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:50.280525 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-eb55d983-cf53-437f-9803-3628c89d9e3c tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] [instance: a5c419d5-7255-4ab1-8ada-6bb413faa169] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:50.297785 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-eb55d983-cf53-437f-9803-3628c89d9e3c tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:50.298465 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-eb55d983-cf53-437f-9803-3628c89d9e3c tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:50.300222 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-eb55d983-cf53-437f-9803-3628c89d9e3c tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:50.300815 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-eb55d983-cf53-437f-9803-3628c89d9e3c tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:50.432348 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-eb55d983-cf53-437f-9803-3628c89d9e3c tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd06a1f6896564bb58b457d0642f8302c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89aabae1afe4a5a88ed97e87b5266ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:50.445075 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-eb55d983-cf53-437f-9803-3628c89d9e3c tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] 10.222.0.46 "GET /compute/v2.1/servers/a5c419d5-7255-4ab1-8ada-6bb413faa169" status: 200 len: 1281 microversion: 2.1 time: 0.172776 Jan 15 20:49:50.445819 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 230/487] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:50 2022] GET /compute/v2.1/servers/a5c419d5-7255-4ab1-8ada-6bb413faa169 => generated 1281 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:50.458862 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a6ee6837-409a-4104-91b2-766871c94c08 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:50.460644 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a6ee6837-409a-4104-91b2-766871c94c08 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: 4d527369-954d-4ccc-9105-03b209d3523e] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:50.476939 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a6ee6837-409a-4104-91b2-766871c94c08 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:50.477394 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a6ee6837-409a-4104-91b2-766871c94c08 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:50.481031 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a6ee6837-409a-4104-91b2-766871c94c08 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:50.481484 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a6ee6837-409a-4104-91b2-766871c94c08 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:50.685587 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d6273be8-0f67-488f-bf69-49c162fead54 tempest-QuotasAdminTestJSON-974873640 tempest-QuotasAdminTestJSON-974873640-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:50.687340 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d6273be8-0f67-488f-bf69-49c162fead54 tempest-QuotasAdminTestJSON-974873640 tempest-QuotasAdminTestJSON-974873640-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:50.688559 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d6273be8-0f67-488f-bf69-49c162fead54 tempest-QuotasAdminTestJSON-974873640 tempest-QuotasAdminTestJSON-974873640-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:50.689245 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d6273be8-0f67-488f-bf69-49c162fead54 tempest-QuotasAdminTestJSON-974873640 tempest-QuotasAdminTestJSON-974873640-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:50.775113 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d6273be8-0f67-488f-bf69-49c162fead54 tempest-QuotasAdminTestJSON-974873640 tempest-QuotasAdminTestJSON-974873640-project-admin] 10.222.0.46 "PUT /compute/v2.1/os-quota-sets/50b3fcfdaf254d7f837cf27ee8347b2b" status: 200 len: 328 microversion: 2.1 time: 0.682560 Jan 15 20:49:50.776553 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 258/488] 10.222.0.46 () {60 vars in 1261 bytes} [Sat Jan 15 20:49:50 2022] PUT /compute/v2.1/os-quota-sets/50b3fcfdaf254d7f837cf27ee8347b2b => generated 328 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:49:50.781300 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-04bf3b8c-c3e0-42a6-bb65-4a60ed117c16 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:50.782263 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-04bf3b8c-c3e0-42a6-bb65-4a60ed117c16 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] [instance: 770bfdbf-2ac6-4ab9-b2e3-f9e43ae88af6] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:50.789765 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-04bf3b8c-c3e0-42a6-bb65-4a60ed117c16 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:50.790395 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-04bf3b8c-c3e0-42a6-bb65-4a60ed117c16 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:50.791325 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-04bf3b8c-c3e0-42a6-bb65-4a60ed117c16 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:50.792244 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-04bf3b8c-c3e0-42a6-bb65-4a60ed117c16 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:50.984680 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-a6ee6837-409a-4104-91b2-766871c94c08 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:50.998670 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a6ee6837-409a-4104-91b2-766871c94c08 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/4d527369-954d-4ccc-9105-03b209d3523e" status: 200 len: 1476 microversion: 2.1 time: 0.548403 Jan 15 20:49:50.999650 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 231/489] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:50 2022] GET /compute/v2.1/servers/4d527369-954d-4ccc-9105-03b209d3523e => generated 1476 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:51.011820 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-397463eb-0fdf-4fe9-ba38-2980ba345bc7 tempest-QuotasAdminTestJSON-974873640 tempest-QuotasAdminTestJSON-974873640-project-admin] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:51.015342 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-sets:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:51.015342 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:49:51.037371 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-397463eb-0fdf-4fe9-ba38-2980ba345bc7 tempest-QuotasAdminTestJSON-974873640 tempest-QuotasAdminTestJSON-974873640-project-admin] 10.222.0.46 "DELETE /compute/v2.1/os-quota-sets/50b3fcfdaf254d7f837cf27ee8347b2b" status: 202 len: 0 microversion: 2.1 time: 0.036283 Jan 15 20:49:51.043395 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 232/490] 10.222.0.46 () {58 vars in 1244 bytes} [Sat Jan 15 20:49:50 2022] DELETE /compute/v2.1/os-quota-sets/50b3fcfdaf254d7f837cf27ee8347b2b => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 20:49:51.053975 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b1ad5347-cb4d-45c8-b452-75a991863c1c tempest-QuotasAdminTestJSON-974873640 tempest-QuotasAdminTestJSON-974873640-project-admin] Calling method '.version_select at 0x7f30c97cc790>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:51.072765 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-04bf3b8c-c3e0-42a6-bb65-4a60ed117c16 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:51.084829 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-04bf3b8c-c3e0-42a6-bb65-4a60ed117c16 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:51.086832 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-04bf3b8c-c3e0-42a6-bb65-4a60ed117c16 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:51.088610 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-04bf3b8c-c3e0-42a6-bb65-4a60ed117c16 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] 10.222.0.46 "GET /compute/v2.1/servers/770bfdbf-2ac6-4ab9-b2e3-f9e43ae88af6" status: 200 len: 1361 microversion: 2.25 time: 0.310829 Jan 15 20:49:51.089611 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 259/491] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:49:50 2022] GET /compute/v2.1/servers/770bfdbf-2ac6-4ab9-b2e3-f9e43ae88af6 => generated 1361 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:49:51.108287 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7ac9e09f-f207-4644-98ba-89f41eb51e49 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:51.109915 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-7ac9e09f-f207-4644-98ba-89f41eb51e49 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 98d0ca37-0175-44e2-8a1d-965cdc517daf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:51.125479 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7ac9e09f-f207-4644-98ba-89f41eb51e49 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:51.126479 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7ac9e09f-f207-4644-98ba-89f41eb51e49 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:51.128252 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7ac9e09f-f207-4644-98ba-89f41eb51e49 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:51.128910 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7ac9e09f-f207-4644-98ba-89f41eb51e49 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:51.180034 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7ac9e09f-f207-4644-98ba-89f41eb51e49 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action" status: 200 len: 32634 microversion: 2.1 time: 0.077337 Jan 15 20:49:51.181009 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 260/492] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:49:51 2022] POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action => generated 32634 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:49:51.465036 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7ffb51c9-6556-4b7a-b9b0-017e6eddb4a1 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:51.465856 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-7ffb51c9-6556-4b7a-b9b0-017e6eddb4a1 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] [instance: a5c419d5-7255-4ab1-8ada-6bb413faa169] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:51.477194 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7ffb51c9-6556-4b7a-b9b0-017e6eddb4a1 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:51.477864 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7ffb51c9-6556-4b7a-b9b0-017e6eddb4a1 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:51.482498 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7ffb51c9-6556-4b7a-b9b0-017e6eddb4a1 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:51.484756 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7ffb51c9-6556-4b7a-b9b0-017e6eddb4a1 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:51.650133 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b1ad5347-cb4d-45c8-b452-75a991863c1c tempest-QuotasAdminTestJSON-974873640 tempest-QuotasAdminTestJSON-974873640-project-admin] 10.222.0.46 "GET /compute/v2.1/os-quota-sets/50b3fcfdaf254d7f837cf27ee8347b2b" status: 200 len: 371 microversion: 2.1 time: 0.606065 Jan 15 20:49:51.650760 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 233/493] 10.222.0.46 () {58 vars in 1241 bytes} [Sat Jan 15 20:49:51 2022] GET /compute/v2.1/os-quota-sets/50b3fcfdaf254d7f837cf27ee8347b2b => generated 371 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:49:51.824709 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-7ffb51c9-6556-4b7a-b9b0-017e6eddb4a1 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd06a1f6896564bb58b457d0642f8302c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89aabae1afe4a5a88ed97e87b5266ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:51.845139 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7ffb51c9-6556-4b7a-b9b0-017e6eddb4a1 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] 10.222.0.46 "GET /compute/v2.1/servers/a5c419d5-7255-4ab1-8ada-6bb413faa169" status: 200 len: 1321 microversion: 2.1 time: 0.384601 Jan 15 20:49:51.849456 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 261/494] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:51 2022] GET /compute/v2.1/servers/a5c419d5-7255-4ab1-8ada-6bb413faa169 => generated 1321 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:51.983127 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9f251018-bf07-4993-b90e-fdce13438fef tempest-QuotasAdminTestJSON-974873640 tempest-QuotasAdminTestJSON-974873640-project-admin] Calling method '.version_select at 0x7f30c96d0af0>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:52.021775 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-16541a67-74a9-4076-9331-d18088b87fb8 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:52.022662 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-16541a67-74a9-4076-9331-d18088b87fb8 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: 4d527369-954d-4ccc-9105-03b209d3523e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:52.033962 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-16541a67-74a9-4076-9331-d18088b87fb8 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:52.035747 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-16541a67-74a9-4076-9331-d18088b87fb8 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:52.040971 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-16541a67-74a9-4076-9331-d18088b87fb8 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:52.042424 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-16541a67-74a9-4076-9331-d18088b87fb8 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:52.349413 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-16541a67-74a9-4076-9331-d18088b87fb8 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:52.361694 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-16541a67-74a9-4076-9331-d18088b87fb8 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/4d527369-954d-4ccc-9105-03b209d3523e" status: 200 len: 1475 microversion: 2.1 time: 0.345121 Jan 15 20:49:52.370004 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 262/495] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:52 2022] GET /compute/v2.1/servers/4d527369-954d-4ccc-9105-03b209d3523e => generated 1475 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:52.504161 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-9f251018-bf07-4993-b90e-fdce13438fef tempest-QuotasAdminTestJSON-974873640 tempest-QuotasAdminTestJSON-974873640-project-admin] 10.222.0.46 "GET /compute/v2.1/os-quota-sets/8991bb387aab4672a924db7ffbf8f7ec/defaults" status: 200 len: 371 microversion: 2.1 time: 0.524503 Jan 15 20:49:52.506475 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 234/496] 10.222.0.46 () {58 vars in 1268 bytes} [Sat Jan 15 20:49:51 2022] GET /compute/v2.1/os-quota-sets/8991bb387aab4672a924db7ffbf8f7ec/defaults => generated 371 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:49:52.516047 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-83bb33d6-f466-4d28-99c0-7dee4c0efdb1 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:52.517828 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-83bb33d6-f466-4d28-99c0-7dee4c0efdb1 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] [instance: 770bfdbf-2ac6-4ab9-b2e3-f9e43ae88af6] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:52.536491 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-83bb33d6-f466-4d28-99c0-7dee4c0efdb1 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:52.543365 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-83bb33d6-f466-4d28-99c0-7dee4c0efdb1 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:52.544524 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-83bb33d6-f466-4d28-99c0-7dee4c0efdb1 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:52.545139 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-83bb33d6-f466-4d28-99c0-7dee4c0efdb1 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:52.823308 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7b71d096-8614-4f48-8c85-8c8458e7b612 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-774715203", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:52.908500 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.network.neutron [None req-7b71d096-8614-4f48-8c85-8c8458e7b612 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] validate_networks() for None {{(pid=129366) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 20:49:53.028640 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-83bb33d6-f466-4d28-99c0-7dee4c0efdb1 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:53.046299 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-83bb33d6-f466-4d28-99c0-7dee4c0efdb1 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:53.048347 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-83bb33d6-f466-4d28-99c0-7dee4c0efdb1 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:53.049905 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-83bb33d6-f466-4d28-99c0-7dee4c0efdb1 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] 10.222.0.46 "GET /compute/v2.1/servers/770bfdbf-2ac6-4ab9-b2e3-f9e43ae88af6" status: 200 len: 1361 microversion: 2.25 time: 0.542321 Jan 15 20:49:53.055539 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 235/497] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:49:52 2022] GET /compute/v2.1/servers/770bfdbf-2ac6-4ab9-b2e3-f9e43ae88af6 => generated 1361 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:49:53.062444 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-862681d2-ef98-43ad-b0b3-4cffee2bf9d8 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:53.063870 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-862681d2-ef98-43ad-b0b3-4cffee2bf9d8 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 98d0ca37-0175-44e2-8a1d-965cdc517daf] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:53.079145 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-862681d2-ef98-43ad-b0b3-4cffee2bf9d8 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:53.080001 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-862681d2-ef98-43ad-b0b3-4cffee2bf9d8 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:53.081021 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-862681d2-ef98-43ad-b0b3-4cffee2bf9d8 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:53.081600 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-862681d2-ef98-43ad-b0b3-4cffee2bf9d8 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:53.158997 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-862681d2-ef98-43ad-b0b3-4cffee2bf9d8 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action" status: 200 len: 32634 microversion: 2.1 time: 0.100286 Jan 15 20:49:53.160378 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 236/498] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:49:53 2022] POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action => generated 32634 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:49:53.166995 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-4b31356e-5f1c-4d72-aaee-3dfb8b19b341 req-8addfff9-f2e1-4bfd-9987-83af41c6b925 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "770bfdbf-2ac6-4ab9-b2e3-f9e43ae88af6", "name": "network-vif-plugged", "status": "completed", "tag": "6a747998-2bca-46bb-a26f-e7c31a2aa686"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:53.168948 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:53.168948 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:49:53.178440 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-4b31356e-5f1c-4d72-aaee-3dfb8b19b341 req-8addfff9-f2e1-4bfd-9987-83af41c6b925 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:53.179245 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-4b31356e-5f1c-4d72-aaee-3dfb8b19b341 req-8addfff9-f2e1-4bfd-9987-83af41c6b925 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:53.195095 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-4b31356e-5f1c-4d72-aaee-3dfb8b19b341 req-8addfff9-f2e1-4bfd-9987-83af41c6b925 service nova] Creating event network-vif-plugged:6a747998-2bca-46bb-a26f-e7c31a2aa686 for instance 770bfdbf-2ac6-4ab9-b2e3-f9e43ae88af6 on nch1-master-1 Jan 15 20:49:53.203446 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-4b31356e-5f1c-4d72-aaee-3dfb8b19b341 req-8addfff9-f2e1-4bfd-9987-83af41c6b925 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041000 Jan 15 20:49:53.204479 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 237/499] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:49:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:49:53.210501 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-cf61b67d-5b93-4812-9fe2-2bfe9df726f9 req-c6109498-e00d-4fc8-8538-a7476eae25b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5c419d5-7255-4ab1-8ada-6bb413faa169", "tag": "74a42162-ce85-4da2-9310-a6708b9b7983"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:53.212803 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:53.212803 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:49:53.224042 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-cf61b67d-5b93-4812-9fe2-2bfe9df726f9 req-c6109498-e00d-4fc8-8538-a7476eae25b3 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:53.224936 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-cf61b67d-5b93-4812-9fe2-2bfe9df726f9 req-c6109498-e00d-4fc8-8538-a7476eae25b3 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:53.255874 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-cf61b67d-5b93-4812-9fe2-2bfe9df726f9 req-c6109498-e00d-4fc8-8538-a7476eae25b3 service nova] Creating event network-changed:74a42162-ce85-4da2-9310-a6708b9b7983 for instance a5c419d5-7255-4ab1-8ada-6bb413faa169 on nch1-master-1 Jan 15 20:49:53.260952 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-cf61b67d-5b93-4812-9fe2-2bfe9df726f9 req-c6109498-e00d-4fc8-8538-a7476eae25b3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054706 Jan 15 20:49:53.261673 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 238/500] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:49:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:49:53.267824 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-ddb16a61-d0d0-49a3-a6cd-34f6c38b1aad req-73ed689e-0f18-4f71-a10a-59dcd3661b47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d527369-954d-4ccc-9105-03b209d3523e", "name": "network-vif-unplugged", "status": "completed", "tag": "8fbebb13-bd94-4e21-bda4-a22a2589b5db"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:53.269418 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:53.269418 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:49:53.279702 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-ddb16a61-d0d0-49a3-a6cd-34f6c38b1aad req-73ed689e-0f18-4f71-a10a-59dcd3661b47 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:53.280199 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-ddb16a61-d0d0-49a3-a6cd-34f6c38b1aad req-73ed689e-0f18-4f71-a10a-59dcd3661b47 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:53.299154 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-ddb16a61-d0d0-49a3-a6cd-34f6c38b1aad req-73ed689e-0f18-4f71-a10a-59dcd3661b47 service nova] Creating event network-vif-unplugged:8fbebb13-bd94-4e21-bda4-a22a2589b5db for instance 4d527369-954d-4ccc-9105-03b209d3523e on nch2-master-1 Jan 15 20:49:53.328222 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [req-ddb16a61-d0d0-49a3-a6cd-34f6c38b1aad req-73ed689e-0f18-4f71-a10a-59dcd3661b47 service nova] Instance 4d527369-954d-4ccc-9105-03b209d3523e is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=129365) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Jan 15 20:49:53.354315 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-7b71d096-8614-4f48-8c85-8c8458e7b612 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Flavor limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 20:49:53.355975 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-7b71d096-8614-4f48-8c85-8c8458e7b612 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Image limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 20:49:53.356366 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-7b71d096-8614-4f48-8c85-8c8458e7b612 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Flavor pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 20:49:53.356776 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-7b71d096-8614-4f48-8c85-8c8458e7b612 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Image pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 20:49:53.357216 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-7b71d096-8614-4f48-8c85-8c8458e7b612 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 20:49:53.365139 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-ddb16a61-d0d0-49a3-a6cd-34f6c38b1aad req-73ed689e-0f18-4f71-a10a-59dcd3661b47 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.101388 Jan 15 20:49:53.367604 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 239/501] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:49:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:49:53.376677 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7b71d096-8614-4f48-8c85-8c8458e7b612 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:53.377145 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7b71d096-8614-4f48-8c85-8c8458e7b612 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:53.378015 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7b71d096-8614-4f48-8c85-8c8458e7b612 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:53.378388 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7b71d096-8614-4f48-8c85-8c8458e7b612 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:53.386609 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-739ea9de-3481-4e7d-a397-67660817398a tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:53.388091 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-739ea9de-3481-4e7d-a397-67660817398a tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] [instance: a5c419d5-7255-4ab1-8ada-6bb413faa169] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:53.395405 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-739ea9de-3481-4e7d-a397-67660817398a tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:53.395859 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-739ea9de-3481-4e7d-a397-67660817398a tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:53.397341 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-739ea9de-3481-4e7d-a397-67660817398a tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:53.398310 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-739ea9de-3481-4e7d-a397-67660817398a tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:53.419522 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-7b71d096-8614-4f48-8c85-8c8458e7b612 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Getting quotas for project e8cfe33be708428abef52f5e8e25621b. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:49:53.434472 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-7b71d096-8614-4f48-8c85-8c8458e7b612 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Getting quotas for user bc38f86758f9416b9e7f6915de0359d6 and project e8cfe33be708428abef52f5e8e25621b. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:49:53.458244 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-7b71d096-8614-4f48-8c85-8c8458e7b612 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Going to run 1 instances... {{(pid=129366) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 20:49:53.461210 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-7b71d096-8614-4f48-8c85-8c8458e7b612 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] [instance: 1e63485c-6290-4e1d-82cf-5ae73069dd2e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 20:49:53.536132 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7b71d096-8614-4f48-8c85-8c8458e7b612 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.165040 Jan 15 20:49:53.544533 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 263/502] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 20:49:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1174 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 20:49:53.641972 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-739ea9de-3481-4e7d-a397-67660817398a tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd06a1f6896564bb58b457d0642f8302c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89aabae1afe4a5a88ed97e87b5266ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:53.661838 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-739ea9de-3481-4e7d-a397-67660817398a tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] 10.222.0.46 "GET /compute/v2.1/servers/a5c419d5-7255-4ab1-8ada-6bb413faa169" status: 200 len: 1321 microversion: 2.1 time: 0.290572 Jan 15 20:49:53.663953 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 240/503] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:53 2022] GET /compute/v2.1/servers/a5c419d5-7255-4ab1-8ada-6bb413faa169 => generated 1321 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:53.681299 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8e396d3e-6179-43a6-b362-0d25f17eb3e2 tempest-QuotasAdminTestJSON-974873640 tempest-QuotasAdminTestJSON-974873640-project-admin] Action: 'update', calling method: .version_select at 0x7f30c96bb040>, body: {"quota_set": {"ram": "5120"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:53.683865 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-sets:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:53.683865 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:49:53.769917 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8e396d3e-6179-43a6-b362-0d25f17eb3e2 tempest-QuotasAdminTestJSON-974873640 tempest-QuotasAdminTestJSON-974873640-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:53.770654 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8e396d3e-6179-43a6-b362-0d25f17eb3e2 tempest-QuotasAdminTestJSON-974873640 tempest-QuotasAdminTestJSON-974873640-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:53.776238 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-fa1656ac-da0b-46c9-b186-5280a7c95710 tempest-SecurityGroupsTestAdminJSON-333788988 tempest-SecurityGroupsTestAdminJSON-333788988-project] Action: 'create', calling method: .version_select at 0x7f30c983cd30>, body: {"security_group": {"name": "tempest-securitygroup-2103103798", "description": "tempest-description-9226375"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:53.783396 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8e396d3e-6179-43a6-b362-0d25f17eb3e2 tempest-QuotasAdminTestJSON-974873640 tempest-QuotasAdminTestJSON-974873640-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:53.783855 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8e396d3e-6179-43a6-b362-0d25f17eb3e2 tempest-QuotasAdminTestJSON-974873640 tempest-QuotasAdminTestJSON-974873640-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:53.852987 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-8e396d3e-6179-43a6-b362-0d25f17eb3e2 tempest-QuotasAdminTestJSON-974873640 tempest-QuotasAdminTestJSON-974873640-project-admin] 10.222.0.46 "PUT /compute/v2.1/os-quota-sets/70bcd9c4a09049f28c235e9889db282e" status: 200 len: 328 microversion: 2.1 time: 0.187502 Jan 15 20:49:53.859611 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 241/504] 10.222.0.46 () {60 vars in 1261 bytes} [Sat Jan 15 20:49:53 2022] PUT /compute/v2.1/os-quota-sets/70bcd9c4a09049f28c235e9889db282e => generated 328 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:49:53.864221 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8f4fde57-c08c-4cd5-94ed-9eb9b75f922f tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:53.865431 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-8f4fde57-c08c-4cd5-94ed-9eb9b75f922f tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: 4d527369-954d-4ccc-9105-03b209d3523e] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:53.874437 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8f4fde57-c08c-4cd5-94ed-9eb9b75f922f tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:53.875108 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8f4fde57-c08c-4cd5-94ed-9eb9b75f922f tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:53.876751 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8f4fde57-c08c-4cd5-94ed-9eb9b75f922f tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:53.877389 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8f4fde57-c08c-4cd5-94ed-9eb9b75f922f tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:54.130002 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-8f4fde57-c08c-4cd5-94ed-9eb9b75f922f tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:54.141946 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-8f4fde57-c08c-4cd5-94ed-9eb9b75f922f tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/4d527369-954d-4ccc-9105-03b209d3523e" status: 200 len: 1475 microversion: 2.1 time: 0.281195 Jan 15 20:49:54.142767 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 242/505] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:53 2022] GET /compute/v2.1/servers/4d527369-954d-4ccc-9105-03b209d3523e => generated 1475 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:54.150138 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b62859e7-0c6b-4ab7-85d4-f9f895066acd tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:54.152217 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b62859e7-0c6b-4ab7-85d4-f9f895066acd tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] [instance: 1e63485c-6290-4e1d-82cf-5ae73069dd2e] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:54.171817 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-fa1656ac-da0b-46c9-b186-5280a7c95710 tempest-SecurityGroupsTestAdminJSON-333788988 tempest-SecurityGroupsTestAdminJSON-333788988-project] 10.222.0.46 "POST /compute/v2.1/os-security-groups" status: 200 len: 218 microversion: 2.1 time: 0.625853 Jan 15 20:49:54.172753 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 264/506] 10.222.0.46 () {60 vars in 1179 bytes} [Sat Jan 15 20:49:53 2022] POST /compute/v2.1/os-security-groups => generated 218 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:49:54.177199 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0682b04b-7afd-4c95-bb78-8168bfb526da tempest-QuotasAdminTestJSON-974873640 tempest-QuotasAdminTestJSON-974873640-project-admin] Calling method '.version_select at 0x7f30c97289d0>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:54.192368 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b62859e7-0c6b-4ab7-85d4-f9f895066acd tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:54.199963 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b62859e7-0c6b-4ab7-85d4-f9f895066acd tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:54.207684 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b62859e7-0c6b-4ab7-85d4-f9f895066acd tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:54.208409 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b62859e7-0c6b-4ab7-85d4-f9f895066acd tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:54.277512 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0682b04b-7afd-4c95-bb78-8168bfb526da tempest-QuotasAdminTestJSON-974873640 tempest-QuotasAdminTestJSON-974873640-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:54.278230 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0682b04b-7afd-4c95-bb78-8168bfb526da tempest-QuotasAdminTestJSON-974873640 tempest-QuotasAdminTestJSON-974873640-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:54.279307 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0682b04b-7afd-4c95-bb78-8168bfb526da tempest-QuotasAdminTestJSON-974873640 tempest-QuotasAdminTestJSON-974873640-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:54.279966 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0682b04b-7afd-4c95-bb78-8168bfb526da tempest-QuotasAdminTestJSON-974873640 tempest-QuotasAdminTestJSON-974873640-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:54.299766 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-b62859e7-0c6b-4ab7-85d4-f9f895066acd tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc38f86758f9416b9e7f6915de0359d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8cfe33be708428abef52f5e8e25621b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:54.301743 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0682b04b-7afd-4c95-bb78-8168bfb526da tempest-QuotasAdminTestJSON-974873640 tempest-QuotasAdminTestJSON-974873640-project-admin] 10.222.0.46 "GET /compute/v2.1/os-quota-sets/70bcd9c4a09049f28c235e9889db282e/detail" status: 200 len: 916 microversion: 2.1 time: 0.127721 Jan 15 20:49:54.302552 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 265/507] 10.222.0.46 () {58 vars in 1262 bytes} [Sat Jan 15 20:49:54 2022] GET /compute/v2.1/os-quota-sets/70bcd9c4a09049f28c235e9889db282e/detail => generated 916 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:49:54.308077 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4bc19e23-6008-4f57-ae08-0370cb86176e tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:54.309225 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-4bc19e23-6008-4f57-ae08-0370cb86176e tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] [instance: 770bfdbf-2ac6-4ab9-b2e3-f9e43ae88af6] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:54.318555 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4bc19e23-6008-4f57-ae08-0370cb86176e tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:54.319059 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b62859e7-0c6b-4ab7-85d4-f9f895066acd tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] 10.222.0.46 "GET /compute/v2.1/servers/1e63485c-6290-4e1d-82cf-5ae73069dd2e" status: 200 len: 1212 microversion: 2.1 time: 0.174770 Jan 15 20:49:54.319419 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4bc19e23-6008-4f57-ae08-0370cb86176e tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:54.320404 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4bc19e23-6008-4f57-ae08-0370cb86176e tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:54.321033 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4bc19e23-6008-4f57-ae08-0370cb86176e tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:54.329263 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 243/508] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:54 2022] GET /compute/v2.1/servers/1e63485c-6290-4e1d-82cf-5ae73069dd2e => generated 1212 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:54.334330 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-19ef6fed-054a-47cd-bb9f-4da28231321b tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:54.335422 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-19ef6fed-054a-47cd-bb9f-4da28231321b tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 98d0ca37-0175-44e2-8a1d-965cdc517daf] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:54.342502 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-19ef6fed-054a-47cd-bb9f-4da28231321b tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:54.343146 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-19ef6fed-054a-47cd-bb9f-4da28231321b tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:54.344271 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-19ef6fed-054a-47cd-bb9f-4da28231321b tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:54.344971 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-19ef6fed-054a-47cd-bb9f-4da28231321b tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:54.406976 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-19ef6fed-054a-47cd-bb9f-4da28231321b tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action" status: 200 len: 32634 microversion: 2.1 time: 0.076361 Jan 15 20:49:54.408294 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 244/509] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:49:54 2022] POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action => generated 32634 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:49:54.416019 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-40868da2-bc37-49ab-af87-6c57935bacad tempest-SecurityGroupsTestAdminJSON-333788988 tempest-SecurityGroupsTestAdminJSON-333788988-project] Action: 'create', calling method: .version_select at 0x7f30c96bb040>, body: {"security_group": {"name": "tempest-securitygroup-1620539020", "description": "tempest-description-1618835096"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:54.533530 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-4bc19e23-6008-4f57-ae08-0370cb86176e tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:54.544597 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-4bc19e23-6008-4f57-ae08-0370cb86176e tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:54.547400 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-4bc19e23-6008-4f57-ae08-0370cb86176e tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:54.548520 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-4bc19e23-6008-4f57-ae08-0370cb86176e tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] 10.222.0.46 "GET /compute/v2.1/servers/770bfdbf-2ac6-4ab9-b2e3-f9e43ae88af6" status: 200 len: 1361 microversion: 2.25 time: 0.244886 Jan 15 20:49:54.549123 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 266/510] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:49:54 2022] GET /compute/v2.1/servers/770bfdbf-2ac6-4ab9-b2e3-f9e43ae88af6 => generated 1361 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:49:54.559070 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f584bc49-46bd-46ea-b1e8-58609e2c3ebf tempest-QuotasAdminTestJSON-974873640 tempest-QuotasAdminTestJSON-974873640-project-admin] Action: 'update', calling method: .version_select at 0x7f30c97ec3a0>, body: {"quota_set": {"ram": "2048"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:54.559070 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-sets:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:54.559070 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:49:54.632371 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f584bc49-46bd-46ea-b1e8-58609e2c3ebf tempest-QuotasAdminTestJSON-974873640 tempest-QuotasAdminTestJSON-974873640-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:54.632833 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f584bc49-46bd-46ea-b1e8-58609e2c3ebf tempest-QuotasAdminTestJSON-974873640 tempest-QuotasAdminTestJSON-974873640-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:54.633659 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f584bc49-46bd-46ea-b1e8-58609e2c3ebf tempest-QuotasAdminTestJSON-974873640 tempest-QuotasAdminTestJSON-974873640-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:54.634086 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f584bc49-46bd-46ea-b1e8-58609e2c3ebf tempest-QuotasAdminTestJSON-974873640 tempest-QuotasAdminTestJSON-974873640-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:54.639288 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-40868da2-bc37-49ab-af87-6c57935bacad tempest-SecurityGroupsTestAdminJSON-333788988 tempest-SecurityGroupsTestAdminJSON-333788988-project] 10.222.0.46 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.228901 Jan 15 20:49:54.641482 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 245/511] 10.222.0.46 () {60 vars in 1179 bytes} [Sat Jan 15 20:49:54 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:49:54.673063 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f584bc49-46bd-46ea-b1e8-58609e2c3ebf tempest-QuotasAdminTestJSON-974873640 tempest-QuotasAdminTestJSON-974873640-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:54.673507 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f584bc49-46bd-46ea-b1e8-58609e2c3ebf tempest-QuotasAdminTestJSON-974873640 tempest-QuotasAdminTestJSON-974873640-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:54.674314 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f584bc49-46bd-46ea-b1e8-58609e2c3ebf tempest-QuotasAdminTestJSON-974873640 tempest-QuotasAdminTestJSON-974873640-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:54.674745 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f584bc49-46bd-46ea-b1e8-58609e2c3ebf tempest-QuotasAdminTestJSON-974873640 tempest-QuotasAdminTestJSON-974873640-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:54.715529 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-005267e0-cc71-4f32-8c24-4bae69749927 tempest-SecurityGroupsTestAdminJSON-1418126108 tempest-SecurityGroupsTestAdminJSON-1418126108-project-admin] Action: 'create', calling method: .version_select at 0x7f30c96d0ee0>, body: {"security_group": {"name": "tempest-securitygroup-713328165", "description": "tempest-description-1186697712"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:54.742203 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f584bc49-46bd-46ea-b1e8-58609e2c3ebf tempest-QuotasAdminTestJSON-974873640 tempest-QuotasAdminTestJSON-974873640-project-admin] 10.222.0.46 "PUT /compute/v2.1/os-quota-sets/70bcd9c4a09049f28c235e9889db282e?user_id=618411f576784eb0a502bede6e63aefa" status: 200 len: 328 microversion: 2.1 time: 0.191945 Jan 15 20:49:54.743268 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 267/512] 10.222.0.46 () {60 vars in 1342 bytes} [Sat Jan 15 20:49:54 2022] PUT /compute/v2.1/os-quota-sets/70bcd9c4a09049f28c235e9889db282e?user_id=618411f576784eb0a502bede6e63aefa => generated 328 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:49:54.750110 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-6997c482-c638-4433-9f38-9690015e60da tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:54.750787 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-6997c482-c638-4433-9f38-9690015e60da tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] [instance: a5c419d5-7255-4ab1-8ada-6bb413faa169] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:54.759028 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6997c482-c638-4433-9f38-9690015e60da tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:54.759472 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6997c482-c638-4433-9f38-9690015e60da tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:54.760785 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6997c482-c638-4433-9f38-9690015e60da tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:54.761502 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6997c482-c638-4433-9f38-9690015e60da tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:54.986356 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-6997c482-c638-4433-9f38-9690015e60da tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd06a1f6896564bb58b457d0642f8302c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89aabae1afe4a5a88ed97e87b5266ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:54.999505 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-6997c482-c638-4433-9f38-9690015e60da tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] 10.222.0.46 "GET /compute/v2.1/servers/a5c419d5-7255-4ab1-8ada-6bb413faa169" status: 200 len: 1321 microversion: 2.1 time: 0.252994 Jan 15 20:49:55.009826 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 268/513] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:54 2022] GET /compute/v2.1/servers/a5c419d5-7255-4ab1-8ada-6bb413faa169 => generated 1321 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:55.015043 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ce806453-0333-40af-802f-8d968b510b81 tempest-QuotasAdminTestJSON-974873640 tempest-QuotasAdminTestJSON-974873640-project-admin] Calling method '.version_select at 0x7f30c9728280>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:55.067277 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-005267e0-cc71-4f32-8c24-4bae69749927 tempest-SecurityGroupsTestAdminJSON-1418126108 tempest-SecurityGroupsTestAdminJSON-1418126108-project-admin] 10.222.0.46 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.419447 Jan 15 20:49:55.069568 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 246/514] 10.222.0.46 () {60 vars in 1179 bytes} [Sat Jan 15 20:49:54 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:49:55.078640 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3799d70c-bc73-46bf-82c6-35a881069e32 tempest-SecurityGroupsTestAdminJSON-1418126108 tempest-SecurityGroupsTestAdminJSON-1418126108-project-admin] Action: 'create', calling method: .version_select at 0x7f30c96d03a0>, body: {"security_group": {"name": "tempest-securitygroup-1805952085", "description": "tempest-description-2018667569"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:55.099981 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ce806453-0333-40af-802f-8d968b510b81 tempest-QuotasAdminTestJSON-974873640 tempest-QuotasAdminTestJSON-974873640-project-admin] 10.222.0.46 "GET /compute/v2.1/os-quota-sets/70bcd9c4a09049f28c235e9889db282e?user_id=618411f576784eb0a502bede6e63aefa" status: 200 len: 370 microversion: 2.1 time: 0.088777 Jan 15 20:49:55.107030 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 269/515] 10.222.0.46 () {58 vars in 1322 bytes} [Sat Jan 15 20:49:55 2022] GET /compute/v2.1/os-quota-sets/70bcd9c4a09049f28c235e9889db282e?user_id=618411f576784eb0a502bede6e63aefa => generated 370 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:49:55.159969 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-95d31db2-4d78-431d-8ede-a8e4d63c821f tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:55.160569 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-95d31db2-4d78-431d-8ede-a8e4d63c821f tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: 4d527369-954d-4ccc-9105-03b209d3523e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:55.169409 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-95d31db2-4d78-431d-8ede-a8e4d63c821f tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:55.170034 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-95d31db2-4d78-431d-8ede-a8e4d63c821f tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:55.171105 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-95d31db2-4d78-431d-8ede-a8e4d63c821f tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:55.171655 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-95d31db2-4d78-431d-8ede-a8e4d63c821f tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:55.285315 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3799d70c-bc73-46bf-82c6-35a881069e32 tempest-SecurityGroupsTestAdminJSON-1418126108 tempest-SecurityGroupsTestAdminJSON-1418126108-project-admin] 10.222.0.46 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.210287 Jan 15 20:49:55.294254 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 247/516] 10.222.0.46 () {60 vars in 1179 bytes} [Sat Jan 15 20:49:55 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 20:49:55.301781 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-1136511d-9c79-4029-9f31-f60bc0457c5b tempest-SecurityGroupsTestAdminJSON-1418126108 tempest-SecurityGroupsTestAdminJSON-1418126108-project-admin] Calling method '.version_select at 0x7f30c97163a0>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:55.441442 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-95d31db2-4d78-431d-8ede-a8e4d63c821f tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:55.454746 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-95d31db2-4d78-431d-8ede-a8e4d63c821f tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/4d527369-954d-4ccc-9105-03b209d3523e" status: 200 len: 1473 microversion: 2.1 time: 0.297157 Jan 15 20:49:55.466732 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 270/517] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:55 2022] GET /compute/v2.1/servers/4d527369-954d-4ccc-9105-03b209d3523e => generated 1473 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:49:55.474871 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-611c7a22-ef83-4e2f-9cc1-337b96a12b81 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:55.475647 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-611c7a22-ef83-4e2f-9cc1-337b96a12b81 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] [instance: 1e63485c-6290-4e1d-82cf-5ae73069dd2e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:55.484874 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-611c7a22-ef83-4e2f-9cc1-337b96a12b81 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:55.485348 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-611c7a22-ef83-4e2f-9cc1-337b96a12b81 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:55.486183 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-611c7a22-ef83-4e2f-9cc1-337b96a12b81 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:55.486648 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-611c7a22-ef83-4e2f-9cc1-337b96a12b81 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:55.565327 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-611c7a22-ef83-4e2f-9cc1-337b96a12b81 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc38f86758f9416b9e7f6915de0359d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8cfe33be708428abef52f5e8e25621b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:55.575137 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-611c7a22-ef83-4e2f-9cc1-337b96a12b81 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] 10.222.0.46 "GET /compute/v2.1/servers/1e63485c-6290-4e1d-82cf-5ae73069dd2e" status: 200 len: 1274 microversion: 2.1 time: 0.106893 Jan 15 20:49:55.575773 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 271/518] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:55 2022] GET /compute/v2.1/servers/1e63485c-6290-4e1d-82cf-5ae73069dd2e => generated 1274 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:55.581422 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b169d0bb-7766-427f-a697-3c9bae8eb325 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:55.582380 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b169d0bb-7766-427f-a697-3c9bae8eb325 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 98d0ca37-0175-44e2-8a1d-965cdc517daf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:55.589149 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b169d0bb-7766-427f-a697-3c9bae8eb325 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:55.589598 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b169d0bb-7766-427f-a697-3c9bae8eb325 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:55.590387 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b169d0bb-7766-427f-a697-3c9bae8eb325 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:55.590856 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b169d0bb-7766-427f-a697-3c9bae8eb325 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:55.634509 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b169d0bb-7766-427f-a697-3c9bae8eb325 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action" status: 200 len: 32634 microversion: 2.1 time: 0.056479 Jan 15 20:49:55.636035 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 272/519] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:49:55 2022] POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action => generated 32634 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:49:55.642116 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-06e00b4b-20f0-4859-b9df-c73e8657cd2f req-af99eb21-d7af-45a5-b7ee-7a3a99ceb56f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d527369-954d-4ccc-9105-03b209d3523e", "tag": "8fbebb13-bd94-4e21-bda4-a22a2589b5db"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:55.643598 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:55.643598 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:49:55.651507 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-06e00b4b-20f0-4859-b9df-c73e8657cd2f req-af99eb21-d7af-45a5-b7ee-7a3a99ceb56f service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:55.652079 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-06e00b4b-20f0-4859-b9df-c73e8657cd2f req-af99eb21-d7af-45a5-b7ee-7a3a99ceb56f service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:55.664141 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-06e00b4b-20f0-4859-b9df-c73e8657cd2f req-af99eb21-d7af-45a5-b7ee-7a3a99ceb56f service nova] Creating event network-changed:8fbebb13-bd94-4e21-bda4-a22a2589b5db for instance 4d527369-954d-4ccc-9105-03b209d3523e on nch2-master-1 Jan 15 20:49:55.677813 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [req-06e00b4b-20f0-4859-b9df-c73e8657cd2f req-af99eb21-d7af-45a5-b7ee-7a3a99ceb56f service nova] Instance 4d527369-954d-4ccc-9105-03b209d3523e is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=129366) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Jan 15 20:49:55.689146 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-06e00b4b-20f0-4859-b9df-c73e8657cd2f req-af99eb21-d7af-45a5-b7ee-7a3a99ceb56f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050843 Jan 15 20:49:55.689828 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 273/520] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:49:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:49:55.695058 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f8a5613f-f78e-458e-bc9f-8666cbe2c78d tempest-QuotasAdminTestJSON-974873640 tempest-QuotasAdminTestJSON-974873640-project-admin] Calling method '.version_select at 0x7f30c9781820>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:55.964641 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f8a5613f-f78e-458e-bc9f-8666cbe2c78d tempest-QuotasAdminTestJSON-974873640 tempest-QuotasAdminTestJSON-974873640-project-admin] 10.222.0.46 "GET /compute/v2.1/os-quota-sets/8991bb387aab4672a924db7ffbf8f7ec/defaults" status: 200 len: 371 microversion: 2.1 time: 0.272208 Jan 15 20:49:55.965937 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 274/521] 10.222.0.46 () {58 vars in 1268 bytes} [Sat Jan 15 20:49:55 2022] GET /compute/v2.1/os-quota-sets/8991bb387aab4672a924db7ffbf8f7ec/defaults => generated 371 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:49:55.971250 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b4e06eb9-149c-427c-9b79-d24ad25374ad tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:55.972218 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b4e06eb9-149c-427c-9b79-d24ad25374ad tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] [instance: 770bfdbf-2ac6-4ab9-b2e3-f9e43ae88af6] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:55.981933 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b4e06eb9-149c-427c-9b79-d24ad25374ad tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:55.982911 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b4e06eb9-149c-427c-9b79-d24ad25374ad tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:56.000249 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b4e06eb9-149c-427c-9b79-d24ad25374ad tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:56.002378 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b4e06eb9-149c-427c-9b79-d24ad25374ad tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:56.318020 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-b4e06eb9-149c-427c-9b79-d24ad25374ad tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:56.327961 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-b4e06eb9-149c-427c-9b79-d24ad25374ad tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:56.329476 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-b4e06eb9-149c-427c-9b79-d24ad25374ad tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:56.331102 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b4e06eb9-149c-427c-9b79-d24ad25374ad tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] 10.222.0.46 "GET /compute/v2.1/servers/770bfdbf-2ac6-4ab9-b2e3-f9e43ae88af6" status: 200 len: 1556 microversion: 2.25 time: 0.363476 Jan 15 20:49:56.337555 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 275/522] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:49:55 2022] GET /compute/v2.1/servers/770bfdbf-2ac6-4ab9-b2e3-f9e43ae88af6 => generated 1556 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:49:56.339994 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-85184357-c3a8-4f67-8e2d-c19ba0dc8433 tempest-QuotasAdminTestJSON-974873640 tempest-QuotasAdminTestJSON-974873640-project-admin] Action: 'update', calling method: .version_select at 0x7f30c96def70>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:56.342290 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-sets:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:56.342290 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:49:56.424397 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-85184357-c3a8-4f67-8e2d-c19ba0dc8433 tempest-QuotasAdminTestJSON-974873640 tempest-QuotasAdminTestJSON-974873640-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:56.425676 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-85184357-c3a8-4f67-8e2d-c19ba0dc8433 tempest-QuotasAdminTestJSON-974873640 tempest-QuotasAdminTestJSON-974873640-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:56.426706 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-85184357-c3a8-4f67-8e2d-c19ba0dc8433 tempest-QuotasAdminTestJSON-974873640 tempest-QuotasAdminTestJSON-974873640-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:56.427354 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-85184357-c3a8-4f67-8e2d-c19ba0dc8433 tempest-QuotasAdminTestJSON-974873640 tempest-QuotasAdminTestJSON-974873640-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:56.652815 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-85184357-c3a8-4f67-8e2d-c19ba0dc8433 tempest-QuotasAdminTestJSON-974873640 tempest-QuotasAdminTestJSON-974873640-project-admin] 10.222.0.46 "PUT /compute/v2.1/os-quota-sets/8991bb387aab4672a924db7ffbf8f7ec" status: 200 len: 329 microversion: 2.1 time: 0.319659 Jan 15 20:49:56.654025 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 276/523] 10.222.0.46 () {60 vars in 1262 bytes} [Sat Jan 15 20:49:56 2022] PUT /compute/v2.1/os-quota-sets/8991bb387aab4672a924db7ffbf8f7ec => generated 329 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:49:56.667999 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-fa3308de-fcbd-4c4b-b403-8b655662ea4d tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:56.668671 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-fa3308de-fcbd-4c4b-b403-8b655662ea4d tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] [instance: a5c419d5-7255-4ab1-8ada-6bb413faa169] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:56.675679 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fa3308de-fcbd-4c4b-b403-8b655662ea4d tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:56.675987 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fa3308de-fcbd-4c4b-b403-8b655662ea4d tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:56.676806 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fa3308de-fcbd-4c4b-b403-8b655662ea4d tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:56.677273 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fa3308de-fcbd-4c4b-b403-8b655662ea4d tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:56.904509 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-fa3308de-fcbd-4c4b-b403-8b655662ea4d tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd06a1f6896564bb58b457d0642f8302c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89aabae1afe4a5a88ed97e87b5266ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:56.912902 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-fa3308de-fcbd-4c4b-b403-8b655662ea4d tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] 10.222.0.46 "GET /compute/v2.1/servers/a5c419d5-7255-4ab1-8ada-6bb413faa169" status: 200 len: 1321 microversion: 2.1 time: 0.257968 Jan 15 20:49:56.913683 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 277/524] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:56 2022] GET /compute/v2.1/servers/a5c419d5-7255-4ab1-8ada-6bb413faa169 => generated 1321 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:57.108239 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-cce8c65b-7ef1-43fe-99a6-b7e0a6a9bd10 tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:57.109118 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-cce8c65b-7ef1-43fe-99a6-b7e0a6a9bd10 tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] [instance: 770bfdbf-2ac6-4ab9-b2e3-f9e43ae88af6] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:57.117138 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cce8c65b-7ef1-43fe-99a6-b7e0a6a9bd10 tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:57.117846 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cce8c65b-7ef1-43fe-99a6-b7e0a6a9bd10 tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:57.118648 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cce8c65b-7ef1-43fe-99a6-b7e0a6a9bd10 tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:57.119126 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cce8c65b-7ef1-43fe-99a6-b7e0a6a9bd10 tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:57.332195 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.objects.instance [None req-cce8c65b-7ef1-43fe-99a6-b7e0a6a9bd10 tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Lazy-loading 'services' on Instance uuid 770bfdbf-2ac6-4ab9-b2e3-f9e43ae88af6 {{(pid=129366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 20:49:57.392908 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-cce8c65b-7ef1-43fe-99a6-b7e0a6a9bd10 tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/770bfdbf-2ac6-4ab9-b2e3-f9e43ae88af6" status: 200 len: 2048 microversion: 2.25 time: 0.478091 Jan 15 20:49:57.393934 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 278/525] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:49:56 2022] GET /compute/v2.1/servers/770bfdbf-2ac6-4ab9-b2e3-f9e43ae88af6 => generated 2048 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:49:57.406536 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b728bc35-eda1-4c50-8931-2cd602a94815 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:57.407169 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b728bc35-eda1-4c50-8931-2cd602a94815 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: 4d527369-954d-4ccc-9105-03b209d3523e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:57.413248 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b728bc35-eda1-4c50-8931-2cd602a94815 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:57.413881 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b728bc35-eda1-4c50-8931-2cd602a94815 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:57.414994 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b728bc35-eda1-4c50-8931-2cd602a94815 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:57.415436 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b728bc35-eda1-4c50-8931-2cd602a94815 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:57.806277 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-b728bc35-eda1-4c50-8931-2cd602a94815 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:57.814890 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b728bc35-eda1-4c50-8931-2cd602a94815 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/4d527369-954d-4ccc-9105-03b209d3523e" status: 200 len: 1470 microversion: 2.1 time: 0.419305 Jan 15 20:49:57.822132 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 279/526] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:57 2022] GET /compute/v2.1/servers/4d527369-954d-4ccc-9105-03b209d3523e => generated 1470 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:57.822132 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8f2a5f1b-ee1e-4435-b59f-69b130c260e7 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:57.822132 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-8f2a5f1b-ee1e-4435-b59f-69b130c260e7 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] [instance: 1e63485c-6290-4e1d-82cf-5ae73069dd2e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:57.828041 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8f2a5f1b-ee1e-4435-b59f-69b130c260e7 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:57.828533 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8f2a5f1b-ee1e-4435-b59f-69b130c260e7 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:57.829351 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8f2a5f1b-ee1e-4435-b59f-69b130c260e7 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:57.829857 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8f2a5f1b-ee1e-4435-b59f-69b130c260e7 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:58.024104 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-8f2a5f1b-ee1e-4435-b59f-69b130c260e7 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc38f86758f9416b9e7f6915de0359d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8cfe33be708428abef52f5e8e25621b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:58.033678 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-8f2a5f1b-ee1e-4435-b59f-69b130c260e7 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] 10.222.0.46 "GET /compute/v2.1/servers/1e63485c-6290-4e1d-82cf-5ae73069dd2e" status: 200 len: 1316 microversion: 2.1 time: 0.217131 Jan 15 20:49:58.034671 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 280/527] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:57 2022] GET /compute/v2.1/servers/1e63485c-6290-4e1d-82cf-5ae73069dd2e => generated 1316 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:58.039221 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a9e6bcfa-934a-427b-9078-ff0621b1114d tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:58.040288 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a9e6bcfa-934a-427b-9078-ff0621b1114d tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 98d0ca37-0175-44e2-8a1d-965cdc517daf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:58.044044 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-1136511d-9c79-4029-9f31-f60bc0457c5b tempest-SecurityGroupsTestAdminJSON-1418126108 tempest-SecurityGroupsTestAdminJSON-1418126108-project-admin] 10.222.0.46 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 10367 microversion: 2.1 time: 2.748002 Jan 15 20:49:58.047413 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a9e6bcfa-934a-427b-9078-ff0621b1114d tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:58.047964 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a9e6bcfa-934a-427b-9078-ff0621b1114d tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:58.048878 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a9e6bcfa-934a-427b-9078-ff0621b1114d tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:58.049432 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a9e6bcfa-934a-427b-9078-ff0621b1114d tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:58.052581 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 248/528] 10.222.0.46 () {58 vars in 1190 bytes} [Sat Jan 15 20:49:55 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 10367 bytes in 2757 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:49:58.059637 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2e805a3d-bd1c-4d07-8ee1-0dfac3d65dff tempest-QuotasAdminTestJSON-974873640 tempest-QuotasAdminTestJSON-974873640-project-admin] Action: 'update', calling method: .version_select at 0x7f30c973daf0>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:58.061891 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-sets:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:58.061891 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:49:58.098754 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a9e6bcfa-934a-427b-9078-ff0621b1114d tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action" status: 200 len: 32634 microversion: 2.1 time: 0.062674 Jan 15 20:49:58.099408 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 281/529] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:49:58 2022] POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action => generated 32634 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:49:58.104874 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-781296ba-1aa4-42a5-a0a3-74b77969ddfd tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:58.105939 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-781296ba-1aa4-42a5-a0a3-74b77969ddfd tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] [instance: 770bfdbf-2ac6-4ab9-b2e3-f9e43ae88af6] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:58.111968 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-781296ba-1aa4-42a5-a0a3-74b77969ddfd tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:58.112414 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-781296ba-1aa4-42a5-a0a3-74b77969ddfd tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:58.113277 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-781296ba-1aa4-42a5-a0a3-74b77969ddfd tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:58.113694 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-781296ba-1aa4-42a5-a0a3-74b77969ddfd tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:58.133862 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2e805a3d-bd1c-4d07-8ee1-0dfac3d65dff tempest-QuotasAdminTestJSON-974873640 tempest-QuotasAdminTestJSON-974873640-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:58.134566 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2e805a3d-bd1c-4d07-8ee1-0dfac3d65dff tempest-QuotasAdminTestJSON-974873640 tempest-QuotasAdminTestJSON-974873640-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:58.136112 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2e805a3d-bd1c-4d07-8ee1-0dfac3d65dff tempest-QuotasAdminTestJSON-974873640 tempest-QuotasAdminTestJSON-974873640-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:58.136793 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2e805a3d-bd1c-4d07-8ee1-0dfac3d65dff tempest-QuotasAdminTestJSON-974873640 tempest-QuotasAdminTestJSON-974873640-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:58.259721 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.objects.instance [None req-781296ba-1aa4-42a5-a0a3-74b77969ddfd tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Lazy-loading 'services' on Instance uuid 770bfdbf-2ac6-4ab9-b2e3-f9e43ae88af6 {{(pid=129366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 20:49:58.275346 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-781296ba-1aa4-42a5-a0a3-74b77969ddfd tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/770bfdbf-2ac6-4ab9-b2e3-f9e43ae88af6" status: 200 len: 2048 microversion: 2.25 time: 0.174730 Jan 15 20:49:58.276734 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 282/530] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:49:58 2022] GET /compute/v2.1/servers/770bfdbf-2ac6-4ab9-b2e3-f9e43ae88af6 => generated 2048 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:49:58.281701 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-6e290c43-99d3-42db-bbb4-7f18518df03c req-43c6dbf5-3f9e-485c-8646-f24c6c8965d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e63485c-6290-4e1d-82cf-5ae73069dd2e", "tag": "ed4307c4-7bfe-4c59-80a3-243181296020"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:58.283459 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:58.283459 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:49:58.290441 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-6e290c43-99d3-42db-bbb4-7f18518df03c req-43c6dbf5-3f9e-485c-8646-f24c6c8965d8 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:58.290881 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-6e290c43-99d3-42db-bbb4-7f18518df03c req-43c6dbf5-3f9e-485c-8646-f24c6c8965d8 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:58.303283 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-6e290c43-99d3-42db-bbb4-7f18518df03c req-43c6dbf5-3f9e-485c-8646-f24c6c8965d8 service nova] Creating event network-changed:ed4307c4-7bfe-4c59-80a3-243181296020 for instance 1e63485c-6290-4e1d-82cf-5ae73069dd2e on nch2-master-1 Jan 15 20:49:58.309126 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-6e290c43-99d3-42db-bbb4-7f18518df03c req-43c6dbf5-3f9e-485c-8646-f24c6c8965d8 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030845 Jan 15 20:49:58.309743 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 283/531] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:49:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:49:58.314730 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c4899910-3dd4-4a16-bf1c-e4c329df0ced tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:58.315336 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c4899910-3dd4-4a16-bf1c-e4c329df0ced tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: 4d527369-954d-4ccc-9105-03b209d3523e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:58.322254 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c4899910-3dd4-4a16-bf1c-e4c329df0ced tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:58.322708 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c4899910-3dd4-4a16-bf1c-e4c329df0ced tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:58.323695 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c4899910-3dd4-4a16-bf1c-e4c329df0ced tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:58.324168 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c4899910-3dd4-4a16-bf1c-e4c329df0ced tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:58.404574 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c4899910-3dd4-4a16-bf1c-e4c329df0ced tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "POST /compute/v2.1/servers/4d527369-954d-4ccc-9105-03b209d3523e/action" status: 204 len: 0 microversion: 2.1 time: 0.093328 Jan 15 20:49:58.405803 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 284/532] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:49:58 2022] POST /compute/v2.1/servers/4d527369-954d-4ccc-9105-03b209d3523e/action => generated 0 bytes in 95 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 20:49:58.411949 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9a23ba49-bcb9-489b-9f7c-cd5d0dde1d3d tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:58.413203 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-9a23ba49-bcb9-489b-9f7c-cd5d0dde1d3d tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] [instance: a5c419d5-7255-4ab1-8ada-6bb413faa169] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:58.434178 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9a23ba49-bcb9-489b-9f7c-cd5d0dde1d3d tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:58.435075 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9a23ba49-bcb9-489b-9f7c-cd5d0dde1d3d tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:58.438377 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9a23ba49-bcb9-489b-9f7c-cd5d0dde1d3d tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:58.438877 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9a23ba49-bcb9-489b-9f7c-cd5d0dde1d3d tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:58.506765 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2e805a3d-bd1c-4d07-8ee1-0dfac3d65dff tempest-QuotasAdminTestJSON-974873640 tempest-QuotasAdminTestJSON-974873640-project-admin] 10.222.0.46 "PUT /compute/v2.1/os-quota-sets/8991bb387aab4672a924db7ffbf8f7ec" status: 200 len: 329 microversion: 2.1 time: 0.451099 Jan 15 20:49:58.507270 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 249/533] 10.222.0.46 () {60 vars in 1262 bytes} [Sat Jan 15 20:49:58 2022] PUT /compute/v2.1/os-quota-sets/8991bb387aab4672a924db7ffbf8f7ec => generated 329 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:49:58.529587 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-14c7fe71-646e-444b-b904-4714d7e68712 tempest-SecurityGroupsTestAdminJSON-333788988 tempest-SecurityGroupsTestAdminJSON-333788988-project] Calling method '.version_select at 0x7f30c9758310>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:58.704142 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-9a23ba49-bcb9-489b-9f7c-cd5d0dde1d3d tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd06a1f6896564bb58b457d0642f8302c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89aabae1afe4a5a88ed97e87b5266ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:58.717381 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-9a23ba49-bcb9-489b-9f7c-cd5d0dde1d3d tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] 10.222.0.46 "GET /compute/v2.1/servers/a5c419d5-7255-4ab1-8ada-6bb413faa169" status: 200 len: 1321 microversion: 2.1 time: 0.309923 Jan 15 20:49:58.727876 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 285/534] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:58 2022] GET /compute/v2.1/servers/a5c419d5-7255-4ab1-8ada-6bb413faa169 => generated 1321 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:58.738026 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e7d2c0fe-0980-4563-b80d-36cba94ba079 tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:58.741547 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:58.741547 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:49:58.743210 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e7d2c0fe-0980-4563-b80d-36cba94ba079 tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:58.743740 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e7d2c0fe-0980-4563-b80d-36cba94ba079 tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:58.752505 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e7d2c0fe-0980-4563-b80d-36cba94ba079 tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:58.753128 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e7d2c0fe-0980-4563-b80d-36cba94ba079 tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:58.814340 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e7d2c0fe-0980-4563-b80d-36cba94ba079 tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] 10.222.0.46 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.095079 Jan 15 20:49:58.817802 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 286/535] 10.222.0.46 () {60 vars in 1216 bytes} [Sat Jan 15 20:49:58 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:49:58.829643 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-82f70aa1-ddd0-4631-a132-aa8f3d60b8ce tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:58.831865 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-82f70aa1-ddd0-4631-a132-aa8f3d60b8ce tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: 4d527369-954d-4ccc-9105-03b209d3523e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:58.845891 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-82f70aa1-ddd0-4631-a132-aa8f3d60b8ce tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:58.846333 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-82f70aa1-ddd0-4631-a132-aa8f3d60b8ce tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:58.847128 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-82f70aa1-ddd0-4631-a132-aa8f3d60b8ce tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:58.847557 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-82f70aa1-ddd0-4631-a132-aa8f3d60b8ce tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:58.932620 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-14c7fe71-646e-444b-b904-4714d7e68712 tempest-SecurityGroupsTestAdminJSON-333788988 tempest-SecurityGroupsTestAdminJSON-333788988-project] 10.222.0.46 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1110 microversion: 2.1 time: 0.422993 Jan 15 20:49:58.934680 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 250/536] 10.222.0.46 () {58 vars in 1190 bytes} [Sat Jan 15 20:49:58 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1110 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:58.941363 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2fa7644e-6f0b-403c-815d-598ae4ebc12e tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": "auto"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:58.945792 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-2fa7644e-6f0b-403c-815d-598ae4ebc12e tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] [instance: 770bfdbf-2ac6-4ab9-b2e3-f9e43ae88af6] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:58.959491 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2fa7644e-6f0b-403c-815d-598ae4ebc12e tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:58.960177 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2fa7644e-6f0b-403c-815d-598ae4ebc12e tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:58.961844 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2fa7644e-6f0b-403c-815d-598ae4ebc12e tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:58.962612 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2fa7644e-6f0b-403c-815d-598ae4ebc12e tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:58.991651 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.objects.instance [None req-2fa7644e-6f0b-403c-815d-598ae4ebc12e tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Lazy-loading 'flavor' on Instance uuid 770bfdbf-2ac6-4ab9-b2e3-f9e43ae88af6 {{(pid=129365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 20:49:59.006663 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-2fa7644e-6f0b-403c-815d-598ae4ebc12e tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] [instance: 770bfdbf-2ac6-4ab9-b2e3-f9e43ae88af6] Going to try to live migrate instance to nch2-master-1 {{(pid=129365) live_migrate /opt/stack/nova/nova/compute/api.py:5255}} Jan 15 20:49:59.040339 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-82f70aa1-ddd0-4631-a132-aa8f3d60b8ce tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:59.049370 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-82f70aa1-ddd0-4631-a132-aa8f3d60b8ce tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/4d527369-954d-4ccc-9105-03b209d3523e" status: 200 len: 1470 microversion: 2.1 time: 0.230438 Jan 15 20:49:59.060168 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 287/537] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:58 2022] GET /compute/v2.1/servers/4d527369-954d-4ccc-9105-03b209d3523e => generated 1470 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:59.060168 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d1a1d401-3c55-4301-9b37-d9b32658d11b tempest-SecurityGroupsTestAdminJSON-1418126108 tempest-SecurityGroupsTestAdminJSON-1418126108-project-admin] Calling method '.version_select at 0x7f30c983cd30>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:59.240054 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d1a1d401-3c55-4301-9b37-d9b32658d11b tempest-SecurityGroupsTestAdminJSON-1418126108 tempest-SecurityGroupsTestAdminJSON-1418126108-project-admin] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/1c2b1b1b-d6d1-4406-bd98-bec8fb22d0b2" status: 202 len: 0 microversion: 2.1 time: 0.188554 Jan 15 20:49:59.241274 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 288/538] 10.222.0.46 () {58 vars in 1271 bytes} [Sat Jan 15 20:49:59 2022] DELETE /compute/v2.1/os-security-groups/1c2b1b1b-d6d1-4406-bd98-bec8fb22d0b2 => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 20:49:59.429665 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e429d8d4-7c73-47da-9f2f-3782094e8ff9 tempest-QuotasAdminTestV236-2061972182 tempest-QuotasAdminTestV236-2061972182-project-admin] Action: 'update', calling method: .version_select at 0x7f30c974a160>, body: {"quota_set": {"ram": "5120"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:59.431584 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-sets:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:49:59.431584 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:49:59.525187 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e429d8d4-7c73-47da-9f2f-3782094e8ff9 tempest-QuotasAdminTestV236-2061972182 tempest-QuotasAdminTestV236-2061972182-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:59.526941 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e429d8d4-7c73-47da-9f2f-3782094e8ff9 tempest-QuotasAdminTestV236-2061972182 tempest-QuotasAdminTestV236-2061972182-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:59.527731 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e429d8d4-7c73-47da-9f2f-3782094e8ff9 tempest-QuotasAdminTestV236-2061972182 tempest-QuotasAdminTestV236-2061972182-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:59.528440 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e429d8d4-7c73-47da-9f2f-3782094e8ff9 tempest-QuotasAdminTestV236-2061972182 tempest-QuotasAdminTestV236-2061972182-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:59.602618 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e429d8d4-7c73-47da-9f2f-3782094e8ff9 tempest-QuotasAdminTestV236-2061972182 tempest-QuotasAdminTestV236-2061972182-project-admin] 10.222.0.46 "PUT /compute/v2.1/os-quota-sets/df812230698546fc896fa2152f128f62" status: 200 len: 240 microversion: 2.36 time: 0.359818 Jan 15 20:49:59.607041 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 289/539] 10.222.0.46 () {62 vars in 1302 bytes} [Sat Jan 15 20:49:59 2022] PUT /compute/v2.1/os-quota-sets/df812230698546fc896fa2152f128f62 => generated 240 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:49:59.616157 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-14b5e398-e355-41e3-940e-3e0050238137 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:49:59.616761 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-14b5e398-e355-41e3-940e-3e0050238137 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] [instance: 1e63485c-6290-4e1d-82cf-5ae73069dd2e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:59.625175 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-14b5e398-e355-41e3-940e-3e0050238137 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:59.625751 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-14b5e398-e355-41e3-940e-3e0050238137 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:59.627412 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-14b5e398-e355-41e3-940e-3e0050238137 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:59.628452 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-14b5e398-e355-41e3-940e-3e0050238137 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:59.838451 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-14b5e398-e355-41e3-940e-3e0050238137 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc38f86758f9416b9e7f6915de0359d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8cfe33be708428abef52f5e8e25621b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:49:59.848775 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-14b5e398-e355-41e3-940e-3e0050238137 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] 10.222.0.46 "GET /compute/v2.1/servers/1e63485c-6290-4e1d-82cf-5ae73069dd2e" status: 200 len: 1316 microversion: 2.1 time: 0.240165 Jan 15 20:49:59.853633 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 290/540] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:49:59 2022] GET /compute/v2.1/servers/1e63485c-6290-4e1d-82cf-5ae73069dd2e => generated 1316 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:49:59.862382 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-736575a2-3640-4145-b715-8fac5d1807da tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:49:59.863515 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-736575a2-3640-4145-b715-8fac5d1807da tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 98d0ca37-0175-44e2-8a1d-965cdc517daf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:49:59.870268 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-736575a2-3640-4145-b715-8fac5d1807da tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:59.870728 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-736575a2-3640-4145-b715-8fac5d1807da tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:59.871624 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-736575a2-3640-4145-b715-8fac5d1807da tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:49:59.872068 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-736575a2-3640-4145-b715-8fac5d1807da tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:49:59.917964 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-736575a2-3640-4145-b715-8fac5d1807da tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action" status: 200 len: 32634 microversion: 2.1 time: 0.064773 Jan 15 20:49:59.926929 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 291/541] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:49:59 2022] POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action => generated 32634 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:49:59.932773 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-2ff71d05-1e88-41cb-bca4-ff46d55355da tempest-SecurityGroupsTestAdminJSON-1418126108 tempest-SecurityGroupsTestAdminJSON-1418126108-project-admin] Calling method '.version_select at 0x7f30c974a550>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:00.137287 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-2ff71d05-1e88-41cb-bca4-ff46d55355da tempest-SecurityGroupsTestAdminJSON-1418126108 tempest-SecurityGroupsTestAdminJSON-1418126108-project-admin] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/b549fc30-25be-4290-a650-f0d7760a5138" status: 202 len: 0 microversion: 2.1 time: 0.208334 Jan 15 20:50:00.142952 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 292/542] 10.222.0.46 () {58 vars in 1271 bytes} [Sat Jan 15 20:49:59 2022] DELETE /compute/v2.1/os-security-groups/b549fc30-25be-4290-a650-f0d7760a5138 => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 20:50:00.152728 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-55bf14b6-07cc-4231-8f4e-1925eb41bf42 req-a8a8905f-005d-4c85-bd05-584ed3c16dfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d527369-954d-4ccc-9105-03b209d3523e", "name": "network-vif-plugged", "status": "completed", "tag": "8fbebb13-bd94-4e21-bda4-a22a2589b5db"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:50:00.156515 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:50:00.156515 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:50:00.167061 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-55bf14b6-07cc-4231-8f4e-1925eb41bf42 req-a8a8905f-005d-4c85-bd05-584ed3c16dfd service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:00.167503 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-55bf14b6-07cc-4231-8f4e-1925eb41bf42 req-a8a8905f-005d-4c85-bd05-584ed3c16dfd service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:00.185890 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-55bf14b6-07cc-4231-8f4e-1925eb41bf42 req-a8a8905f-005d-4c85-bd05-584ed3c16dfd service nova] Creating event network-vif-plugged:8fbebb13-bd94-4e21-bda4-a22a2589b5db for instance 4d527369-954d-4ccc-9105-03b209d3523e on nch2-master-1 Jan 15 20:50:00.192175 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [req-55bf14b6-07cc-4231-8f4e-1925eb41bf42 req-a8a8905f-005d-4c85-bd05-584ed3c16dfd service nova] Instance 4d527369-954d-4ccc-9105-03b209d3523e is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=129366) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Jan 15 20:50:00.204376 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-55bf14b6-07cc-4231-8f4e-1925eb41bf42 req-a8a8905f-005d-4c85-bd05-584ed3c16dfd service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059484 Jan 15 20:50:00.205044 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 293/543] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:50:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:50:00.210137 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-33def638-1dcf-4644-a7f7-2c68fdb64a53 tempest-QuotasAdminTestV236-2061972182 tempest-QuotasAdminTestV236-2061972182-project-admin] Calling method '.version_select at 0x7f30c9728790>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:00.444461 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-33def638-1dcf-4644-a7f7-2c68fdb64a53 tempest-QuotasAdminTestV236-2061972182 tempest-QuotasAdminTestV236-2061972182-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:00.445018 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-33def638-1dcf-4644-a7f7-2c68fdb64a53 tempest-QuotasAdminTestV236-2061972182 tempest-QuotasAdminTestV236-2061972182-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:00.445807 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-33def638-1dcf-4644-a7f7-2c68fdb64a53 tempest-QuotasAdminTestV236-2061972182 tempest-QuotasAdminTestV236-2061972182-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:00.446244 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-33def638-1dcf-4644-a7f7-2c68fdb64a53 tempest-QuotasAdminTestV236-2061972182 tempest-QuotasAdminTestV236-2061972182-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:00.470218 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-33def638-1dcf-4644-a7f7-2c68fdb64a53 tempest-QuotasAdminTestV236-2061972182 tempest-QuotasAdminTestV236-2061972182-project-admin] 10.222.0.46 "GET /compute/v2.1/os-quota-sets/df812230698546fc896fa2152f128f62/detail" status: 200 len: 672 microversion: 2.36 time: 0.263765 Jan 15 20:50:00.479406 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 294/544] 10.222.0.46 () {60 vars in 1303 bytes} [Sat Jan 15 20:50:00 2022] GET /compute/v2.1/os-quota-sets/df812230698546fc896fa2152f128f62/detail => generated 672 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:50:00.484339 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-13c574bd-73d3-497e-bd1f-e376c585f1b7 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:00.485334 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-13c574bd-73d3-497e-bd1f-e376c585f1b7 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] [instance: a5c419d5-7255-4ab1-8ada-6bb413faa169] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:00.493112 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-13c574bd-73d3-497e-bd1f-e376c585f1b7 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:00.493963 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-13c574bd-73d3-497e-bd1f-e376c585f1b7 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:00.495609 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-13c574bd-73d3-497e-bd1f-e376c585f1b7 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:00.496279 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-13c574bd-73d3-497e-bd1f-e376c585f1b7 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:00.721648 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-13c574bd-73d3-497e-bd1f-e376c585f1b7 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd06a1f6896564bb58b457d0642f8302c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89aabae1afe4a5a88ed97e87b5266ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:00.729215 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-13c574bd-73d3-497e-bd1f-e376c585f1b7 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] 10.222.0.46 "GET /compute/v2.1/servers/a5c419d5-7255-4ab1-8ada-6bb413faa169" status: 200 len: 1321 microversion: 2.1 time: 0.248270 Jan 15 20:50:00.729959 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 295/545] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:00 2022] GET /compute/v2.1/servers/a5c419d5-7255-4ab1-8ada-6bb413faa169 => generated 1321 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:00.737399 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-cbd64bb3-017f-416b-98b7-57319b9d2864 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:00.737988 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-cbd64bb3-017f-416b-98b7-57319b9d2864 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: 4d527369-954d-4ccc-9105-03b209d3523e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:00.749251 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cbd64bb3-017f-416b-98b7-57319b9d2864 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:00.750995 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cbd64bb3-017f-416b-98b7-57319b9d2864 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:00.752407 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cbd64bb3-017f-416b-98b7-57319b9d2864 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:00.753071 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cbd64bb3-017f-416b-98b7-57319b9d2864 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:00.976419 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-cbd64bb3-017f-416b-98b7-57319b9d2864 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:00.986755 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-cbd64bb3-017f-416b-98b7-57319b9d2864 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/4d527369-954d-4ccc-9105-03b209d3523e" status: 200 len: 1462 microversion: 2.1 time: 0.252604 Jan 15 20:50:00.987582 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 296/546] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:00 2022] GET /compute/v2.1/servers/4d527369-954d-4ccc-9105-03b209d3523e => generated 1462 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:00.992387 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1834089e-0a7e-4ed2-bdf1-25d59a3440f9 tempest-SecurityGroupsTestAdminJSON-333788988 tempest-SecurityGroupsTestAdminJSON-333788988-project] Calling method '.version_select at 0x7f30c9686310>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:01.253224 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2fa7644e-6f0b-403c-815d-598ae4ebc12e tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] 10.222.0.46 "POST /compute/v2.1/servers/770bfdbf-2ac6-4ab9-b2e3-f9e43ae88af6/action" status: 202 len: 0 microversion: 2.25 time: 2.316561 Jan 15 20:50:01.254846 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 251/547] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 20:49:58 2022] POST /compute/v2.1/servers/770bfdbf-2ac6-4ab9-b2e3-f9e43ae88af6/action => generated 0 bytes in 2319 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 15 20:50:01.258019 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-1834089e-0a7e-4ed2-bdf1-25d59a3440f9 tempest-SecurityGroupsTestAdminJSON-333788988 tempest-SecurityGroupsTestAdminJSON-333788988-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/76f36a4c-a030-49dd-809f-c82be2d94ff6" status: 202 len: 0 microversion: 2.1 time: 0.269033 Jan 15 20:50:01.258992 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 297/548] 10.222.0.46 () {58 vars in 1271 bytes} [Sat Jan 15 20:50:00 2022] DELETE /compute/v2.1/os-security-groups/76f36a4c-a030-49dd-809f-c82be2d94ff6 => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 20:50:01.265768 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-271e65e1-e563-46c2-a0e9-f485b86e28e1 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:01.266603 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-271e65e1-e563-46c2-a0e9-f485b86e28e1 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] [instance: 1e63485c-6290-4e1d-82cf-5ae73069dd2e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:01.272443 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-02195682-bb80-4150-b1ce-6207247459cb tempest-QuotasAdminTestV236-2061972182 tempest-QuotasAdminTestV236-2061972182-project-admin] Action: 'update', calling method: .version_select at 0x7f30c968e3a0>, body: {"quota_set": {"ram": "2048"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:50:01.277586 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-271e65e1-e563-46c2-a0e9-f485b86e28e1 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:01.278614 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-271e65e1-e563-46c2-a0e9-f485b86e28e1 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:01.280038 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-271e65e1-e563-46c2-a0e9-f485b86e28e1 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:01.280642 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-271e65e1-e563-46c2-a0e9-f485b86e28e1 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:01.283092 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-sets:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:50:01.283092 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:50:01.555118 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-271e65e1-e563-46c2-a0e9-f485b86e28e1 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc38f86758f9416b9e7f6915de0359d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8cfe33be708428abef52f5e8e25621b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:01.570076 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-271e65e1-e563-46c2-a0e9-f485b86e28e1 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] 10.222.0.46 "GET /compute/v2.1/servers/1e63485c-6290-4e1d-82cf-5ae73069dd2e" status: 200 len: 1316 microversion: 2.1 time: 0.309198 Jan 15 20:50:01.571129 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 298/549] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:01 2022] GET /compute/v2.1/servers/1e63485c-6290-4e1d-82cf-5ae73069dd2e => generated 1316 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:01.587456 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-5e9d3f80-04d3-4b81-923f-02087b36e476 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:50:01.591160 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-5e9d3f80-04d3-4b81-923f-02087b36e476 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 98d0ca37-0175-44e2-8a1d-965cdc517daf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:01.602144 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5e9d3f80-04d3-4b81-923f-02087b36e476 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:01.603234 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5e9d3f80-04d3-4b81-923f-02087b36e476 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:01.606244 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5e9d3f80-04d3-4b81-923f-02087b36e476 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:01.607206 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5e9d3f80-04d3-4b81-923f-02087b36e476 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:01.621021 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-02195682-bb80-4150-b1ce-6207247459cb tempest-QuotasAdminTestV236-2061972182 tempest-QuotasAdminTestV236-2061972182-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:01.621560 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-02195682-bb80-4150-b1ce-6207247459cb tempest-QuotasAdminTestV236-2061972182 tempest-QuotasAdminTestV236-2061972182-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:01.623349 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-02195682-bb80-4150-b1ce-6207247459cb tempest-QuotasAdminTestV236-2061972182 tempest-QuotasAdminTestV236-2061972182-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:01.623349 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-02195682-bb80-4150-b1ce-6207247459cb tempest-QuotasAdminTestV236-2061972182 tempest-QuotasAdminTestV236-2061972182-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:01.673936 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-5e9d3f80-04d3-4b81-923f-02087b36e476 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action" status: 200 len: 32634 microversion: 2.1 time: 0.101170 Jan 15 20:50:01.674742 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 299/550] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:50:01 2022] POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action => generated 32634 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:50:01.680048 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-fbbed184-5f96-4029-aa37-c6a204c2f5c7 tempest-MigrationsAdminTest-1503274595 tempest-MigrationsAdminTest-1503274595-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:01.682252 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-fbbed184-5f96-4029-aa37-c6a204c2f5c7 tempest-MigrationsAdminTest-1503274595 tempest-MigrationsAdminTest-1503274595-project-admin] [instance: 4d527369-954d-4ccc-9105-03b209d3523e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:01.691705 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fbbed184-5f96-4029-aa37-c6a204c2f5c7 tempest-MigrationsAdminTest-1503274595 tempest-MigrationsAdminTest-1503274595-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:01.692591 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fbbed184-5f96-4029-aa37-c6a204c2f5c7 tempest-MigrationsAdminTest-1503274595 tempest-MigrationsAdminTest-1503274595-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:01.694403 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fbbed184-5f96-4029-aa37-c6a204c2f5c7 tempest-MigrationsAdminTest-1503274595 tempest-MigrationsAdminTest-1503274595-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:01.695341 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fbbed184-5f96-4029-aa37-c6a204c2f5c7 tempest-MigrationsAdminTest-1503274595 tempest-MigrationsAdminTest-1503274595-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:01.697021 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-02195682-bb80-4150-b1ce-6207247459cb tempest-QuotasAdminTestV236-2061972182 tempest-QuotasAdminTestV236-2061972182-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:01.698209 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-02195682-bb80-4150-b1ce-6207247459cb tempest-QuotasAdminTestV236-2061972182 tempest-QuotasAdminTestV236-2061972182-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:01.699138 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-02195682-bb80-4150-b1ce-6207247459cb tempest-QuotasAdminTestV236-2061972182 tempest-QuotasAdminTestV236-2061972182-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:01.700282 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-02195682-bb80-4150-b1ce-6207247459cb tempest-QuotasAdminTestV236-2061972182 tempest-QuotasAdminTestV236-2061972182-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:01.786430 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-02195682-bb80-4150-b1ce-6207247459cb tempest-QuotasAdminTestV236-2061972182 tempest-QuotasAdminTestV236-2061972182-project-admin] 10.222.0.46 "PUT /compute/v2.1/os-quota-sets/df812230698546fc896fa2152f128f62?user_id=0f19fb1c49c6499c88dc0003acccb4ae" status: 200 len: 240 microversion: 2.36 time: 0.530017 Jan 15 20:50:01.789131 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 252/551] 10.222.0.46 () {62 vars in 1383 bytes} [Sat Jan 15 20:50:01 2022] PUT /compute/v2.1/os-quota-sets/df812230698546fc896fa2152f128f62?user_id=0f19fb1c49c6499c88dc0003acccb4ae => generated 240 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:50:01.795847 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c4845902-1a3b-4691-ba13-3e79f2236cfa tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:01.796648 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c4845902-1a3b-4691-ba13-3e79f2236cfa tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] [instance: 770bfdbf-2ac6-4ab9-b2e3-f9e43ae88af6] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:01.803354 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c4845902-1a3b-4691-ba13-3e79f2236cfa tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:01.803802 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c4845902-1a3b-4691-ba13-3e79f2236cfa tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:01.804586 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c4845902-1a3b-4691-ba13-3e79f2236cfa tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:01.805416 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c4845902-1a3b-4691-ba13-3e79f2236cfa tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:01.872678 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-fbbed184-5f96-4029-aa37-c6a204c2f5c7 tempest-MigrationsAdminTest-1503274595 tempest-MigrationsAdminTest-1503274595-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/4d527369-954d-4ccc-9105-03b209d3523e" status: 200 len: 1613 microversion: 2.1 time: 0.196497 Jan 15 20:50:01.873874 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 300/552] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:01 2022] GET /compute/v2.1/servers/4d527369-954d-4ccc-9105-03b209d3523e => generated 1613 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:01.881955 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-6ec45cc7-1309-4cc2-a431-9a865cca0b19 tempest-SecurityGroupsTestAdminJSON-333788988 tempest-SecurityGroupsTestAdminJSON-333788988-project] Calling method '.version_select at 0x7f30c9728670>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:02.064991 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-c4845902-1a3b-4691-ba13-3e79f2236cfa tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:02.077580 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-c4845902-1a3b-4691-ba13-3e79f2236cfa tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:02.079760 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-c4845902-1a3b-4691-ba13-3e79f2236cfa tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:02.081585 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c4845902-1a3b-4691-ba13-3e79f2236cfa tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] 10.222.0.46 "GET /compute/v2.1/servers/770bfdbf-2ac6-4ab9-b2e3-f9e43ae88af6" status: 200 len: 1566 microversion: 2.25 time: 0.290886 Jan 15 20:50:02.082397 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 253/553] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:50:01 2022] GET /compute/v2.1/servers/770bfdbf-2ac6-4ab9-b2e3-f9e43ae88af6 => generated 1566 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:50:02.090383 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e8a049f9-3dd8-40b2-a297-daaf6a01f704 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:02.090986 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e8a049f9-3dd8-40b2-a297-daaf6a01f704 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] [instance: a5c419d5-7255-4ab1-8ada-6bb413faa169] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:02.098490 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e8a049f9-3dd8-40b2-a297-daaf6a01f704 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:02.099138 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e8a049f9-3dd8-40b2-a297-daaf6a01f704 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:02.100271 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e8a049f9-3dd8-40b2-a297-daaf6a01f704 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:02.100869 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e8a049f9-3dd8-40b2-a297-daaf6a01f704 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:02.252793 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-6ec45cc7-1309-4cc2-a431-9a865cca0b19 tempest-SecurityGroupsTestAdminJSON-333788988 tempest-SecurityGroupsTestAdminJSON-333788988-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/a0a75c24-614b-41cd-a469-8d4c14c0eaf3" status: 202 len: 0 microversion: 2.1 time: 0.377713 Jan 15 20:50:02.253395 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 301/554] 10.222.0.46 () {58 vars in 1271 bytes} [Sat Jan 15 20:50:01 2022] DELETE /compute/v2.1/os-security-groups/a0a75c24-614b-41cd-a469-8d4c14c0eaf3 => generated 0 bytes in 379 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 20:50:02.263410 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9078a1c9-52b5-471e-8b6d-d7abf2b05434 tempest-QuotasAdminTestV236-2061972182 tempest-QuotasAdminTestV236-2061972182-project-admin] Calling method '.version_select at 0x7f30c985d940>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:02.299026 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-e8a049f9-3dd8-40b2-a297-daaf6a01f704 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd06a1f6896564bb58b457d0642f8302c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89aabae1afe4a5a88ed97e87b5266ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:02.309915 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e8a049f9-3dd8-40b2-a297-daaf6a01f704 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] 10.222.0.46 "GET /compute/v2.1/servers/a5c419d5-7255-4ab1-8ada-6bb413faa169" status: 200 len: 1321 microversion: 2.1 time: 0.223632 Jan 15 20:50:02.311288 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 254/555] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:02 2022] GET /compute/v2.1/servers/a5c419d5-7255-4ab1-8ada-6bb413faa169 => generated 1321 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:02.316273 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5cab03c3-d866-4b1c-917d-1352e7cbfa96 tempest-MigrationsAdminTest-1503274595 tempest-MigrationsAdminTest-1503274595-project-admin] Calling method '.version_select at 0x7f30c96494c0>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:02.318005 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-migrations:index": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:50:02.318005 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:50:02.319757 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5cab03c3-d866-4b1c-917d-1352e7cbfa96 tempest-MigrationsAdminTest-1503274595 tempest-MigrationsAdminTest-1503274595-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:02.320421 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5cab03c3-d866-4b1c-917d-1352e7cbfa96 tempest-MigrationsAdminTest-1503274595 tempest-MigrationsAdminTest-1503274595-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:02.336492 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5cab03c3-d866-4b1c-917d-1352e7cbfa96 tempest-MigrationsAdminTest-1503274595 tempest-MigrationsAdminTest-1503274595-project-admin] 10.222.0.46 "GET /compute/v2.1/os-migrations" status: 200 len: 793 microversion: 2.1 time: 0.023486 Jan 15 20:50:02.349338 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 255/556] 10.222.0.46 () {58 vars in 1142 bytes} [Sat Jan 15 20:50:02 2022] GET /compute/v2.1/os-migrations => generated 793 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:50:02.349338 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-df90f5df-6fc7-4e4a-9f97-b46752be5bae req-a251f64f-01ee-4eef-a497-c576c6b930ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5c419d5-7255-4ab1-8ada-6bb413faa169", "name": "network-vif-plugged", "status": "completed", "tag": "74a42162-ce85-4da2-9310-a6708b9b7983"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:50:02.349338 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:50:02.349338 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:50:02.367501 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-df90f5df-6fc7-4e4a-9f97-b46752be5bae req-a251f64f-01ee-4eef-a497-c576c6b930ac service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:02.367873 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-df90f5df-6fc7-4e4a-9f97-b46752be5bae req-a251f64f-01ee-4eef-a497-c576c6b930ac service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:02.383400 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-df90f5df-6fc7-4e4a-9f97-b46752be5bae req-a251f64f-01ee-4eef-a497-c576c6b930ac service nova] Creating event network-vif-plugged:74a42162-ce85-4da2-9310-a6708b9b7983 for instance a5c419d5-7255-4ab1-8ada-6bb413faa169 on nch1-master-1 Jan 15 20:50:02.390245 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-df90f5df-6fc7-4e4a-9f97-b46752be5bae req-a251f64f-01ee-4eef-a497-c576c6b930ac service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046007 Jan 15 20:50:02.395772 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 256/557] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:50:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:50:02.493183 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-888af06f-89b7-4202-8a36-107fe0dca388 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1385472421", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:50:02.553450 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.network.neutron [None req-888af06f-89b7-4202-8a36-107fe0dca388 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] validate_networks() for None {{(pid=129365) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 20:50:02.777150 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-9078a1c9-52b5-471e-8b6d-d7abf2b05434 tempest-QuotasAdminTestV236-2061972182 tempest-QuotasAdminTestV236-2061972182-project-admin] 10.222.0.46 "GET /compute/v2.1/os-quota-sets/df812230698546fc896fa2152f128f62?user_id=0f19fb1c49c6499c88dc0003acccb4ae" status: 200 len: 282 microversion: 2.36 time: 0.518209 Jan 15 20:50:02.778694 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 302/558] 10.222.0.46 () {60 vars in 1363 bytes} [Sat Jan 15 20:50:02 2022] GET /compute/v2.1/os-quota-sets/df812230698546fc896fa2152f128f62?user_id=0f19fb1c49c6499c88dc0003acccb4ae => generated 282 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:50:02.783985 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-2c49c139-5a2c-4c9d-9ebc-282fcb0c07a7 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:02.785017 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-2c49c139-5a2c-4c9d-9ebc-282fcb0c07a7 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] [instance: 1e63485c-6290-4e1d-82cf-5ae73069dd2e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:02.792398 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2c49c139-5a2c-4c9d-9ebc-282fcb0c07a7 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:02.793256 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2c49c139-5a2c-4c9d-9ebc-282fcb0c07a7 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:02.794270 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2c49c139-5a2c-4c9d-9ebc-282fcb0c07a7 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:02.794927 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2c49c139-5a2c-4c9d-9ebc-282fcb0c07a7 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:02.820213 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-888af06f-89b7-4202-8a36-107fe0dca388 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Flavor limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 20:50:02.820956 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-888af06f-89b7-4202-8a36-107fe0dca388 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Image limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 20:50:02.821498 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-888af06f-89b7-4202-8a36-107fe0dca388 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Flavor pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 20:50:02.822245 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-888af06f-89b7-4202-8a36-107fe0dca388 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Image pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 20:50:02.822987 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-888af06f-89b7-4202-8a36-107fe0dca388 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 20:50:02.837507 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-888af06f-89b7-4202-8a36-107fe0dca388 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:02.841166 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-888af06f-89b7-4202-8a36-107fe0dca388 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:02.843113 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-888af06f-89b7-4202-8a36-107fe0dca388 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:02.843631 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-888af06f-89b7-4202-8a36-107fe0dca388 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:02.868196 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-888af06f-89b7-4202-8a36-107fe0dca388 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Getting quotas for project 8e6badf41af14266b626a14241efaf88. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:50:02.880412 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-888af06f-89b7-4202-8a36-107fe0dca388 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Getting quotas for user 9245b10067884c428525283137ca04c6 and project 8e6badf41af14266b626a14241efaf88. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:50:02.897092 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-888af06f-89b7-4202-8a36-107fe0dca388 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Going to run 1 instances... {{(pid=129365) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 20:50:02.899774 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-888af06f-89b7-4202-8a36-107fe0dca388 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: e3fa2f27-df7a-4ecb-9bba-c970e3e7d106] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129365) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 20:50:02.969150 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-888af06f-89b7-4202-8a36-107fe0dca388 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.479890 Jan 15 20:50:02.971860 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 257/559] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 20:50:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 484 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 15 20:50:02.977575 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-6136427d-8e7a-4856-b797-758de8d62e31 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:50:02.979697 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-6136427d-8e7a-4856-b797-758de8d62e31 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 98d0ca37-0175-44e2-8a1d-965cdc517daf] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:02.987779 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6136427d-8e7a-4856-b797-758de8d62e31 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:02.988521 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6136427d-8e7a-4856-b797-758de8d62e31 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:02.990188 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6136427d-8e7a-4856-b797-758de8d62e31 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:02.991001 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6136427d-8e7a-4856-b797-758de8d62e31 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:03.009928 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-2c49c139-5a2c-4c9d-9ebc-282fcb0c07a7 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc38f86758f9416b9e7f6915de0359d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8cfe33be708428abef52f5e8e25621b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:03.026081 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-2c49c139-5a2c-4c9d-9ebc-282fcb0c07a7 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] 10.222.0.46 "GET /compute/v2.1/servers/1e63485c-6290-4e1d-82cf-5ae73069dd2e" status: 200 len: 1316 microversion: 2.1 time: 0.245942 Jan 15 20:50:03.036629 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 303/560] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:02 2022] GET /compute/v2.1/servers/1e63485c-6290-4e1d-82cf-5ae73069dd2e => generated 1316 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:03.043020 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-9b5e4c83-cdc8-4601-869e-4b5437f075ef req-bd31f9d6-d497-4b1e-a1fe-359c25c54cbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "770bfdbf-2ac6-4ab9-b2e3-f9e43ae88af6", "name": "network-vif-unplugged", "status": "completed", "tag": "6a747998-2bca-46bb-a26f-e7c31a2aa686"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:50:03.047773 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:50:03.047773 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:50:03.062420 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-9b5e4c83-cdc8-4601-869e-4b5437f075ef req-bd31f9d6-d497-4b1e-a1fe-359c25c54cbb service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:03.065274 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-9b5e4c83-cdc8-4601-869e-4b5437f075ef req-bd31f9d6-d497-4b1e-a1fe-359c25c54cbb service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:03.085741 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-6136427d-8e7a-4856-b797-758de8d62e31 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action" status: 200 len: 32634 microversion: 2.1 time: 0.111797 Jan 15 20:50:03.086612 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 258/561] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:50:02 2022] POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action => generated 32634 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:50:03.090868 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-9b5e4c83-cdc8-4601-869e-4b5437f075ef req-bd31f9d6-d497-4b1e-a1fe-359c25c54cbb service nova] Creating event network-vif-unplugged:6a747998-2bca-46bb-a26f-e7c31a2aa686 for instance 770bfdbf-2ac6-4ab9-b2e3-f9e43ae88af6 on nch1-master-1 Jan 15 20:50:03.101376 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-9b5e4c83-cdc8-4601-869e-4b5437f075ef req-bd31f9d6-d497-4b1e-a1fe-359c25c54cbb service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.063130 Jan 15 20:50:03.104095 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 304/562] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:50:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:50:03.111147 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1d207509-03e0-4eae-9247-670cf2024eb5 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:03.112026 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-1d207509-03e0-4eae-9247-670cf2024eb5 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: e3fa2f27-df7a-4ecb-9bba-c970e3e7d106] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:03.208149 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-1d207509-03e0-4eae-9247-670cf2024eb5 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:03.224157 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-1d207509-03e0-4eae-9247-670cf2024eb5 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/e3fa2f27-df7a-4ecb-9bba-c970e3e7d106" status: 200 len: 1213 microversion: 2.1 time: 0.117480 Jan 15 20:50:03.226225 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 305/563] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:03 2022] GET /compute/v2.1/servers/e3fa2f27-df7a-4ecb-9bba-c970e3e7d106 => generated 1213 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:03.235727 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-82997c3b-46ec-492e-b793-0ef190f36bcb tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:03.236348 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-82997c3b-46ec-492e-b793-0ef190f36bcb tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] [instance: 770bfdbf-2ac6-4ab9-b2e3-f9e43ae88af6] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:03.260158 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-82997c3b-46ec-492e-b793-0ef190f36bcb tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:03.260821 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-82997c3b-46ec-492e-b793-0ef190f36bcb tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:03.261425 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-82997c3b-46ec-492e-b793-0ef190f36bcb tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:03.271341 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-82997c3b-46ec-492e-b793-0ef190f36bcb tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:03.552905 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-81d3d7d1-8c61-49f4-802d-0ca3032ab053 tempest-QuotasAdminNegativeTest-2031557919 tempest-QuotasAdminNegativeTest-2031557919-project-admin] Calling method '.version_select at 0x7f30c96c6af0>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:03.645432 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-82997c3b-46ec-492e-b793-0ef190f36bcb tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:03.654893 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-82997c3b-46ec-492e-b793-0ef190f36bcb tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:03.656397 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-82997c3b-46ec-492e-b793-0ef190f36bcb tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:03.657583 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-82997c3b-46ec-492e-b793-0ef190f36bcb tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] 10.222.0.46 "GET /compute/v2.1/servers/770bfdbf-2ac6-4ab9-b2e3-f9e43ae88af6" status: 200 len: 1566 microversion: 2.25 time: 0.429739 Jan 15 20:50:03.664978 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 306/564] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:50:03 2022] GET /compute/v2.1/servers/770bfdbf-2ac6-4ab9-b2e3-f9e43ae88af6 => generated 1566 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:50:03.674434 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-255c90cb-0156-47de-9b79-e814706a5422 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:03.675281 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-255c90cb-0156-47de-9b79-e814706a5422 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] [instance: a5c419d5-7255-4ab1-8ada-6bb413faa169] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:03.688048 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-255c90cb-0156-47de-9b79-e814706a5422 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:03.689414 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-255c90cb-0156-47de-9b79-e814706a5422 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:03.690227 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-255c90cb-0156-47de-9b79-e814706a5422 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:03.690682 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-255c90cb-0156-47de-9b79-e814706a5422 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:03.882742 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-255c90cb-0156-47de-9b79-e814706a5422 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd06a1f6896564bb58b457d0642f8302c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89aabae1afe4a5a88ed97e87b5266ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:03.893456 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-255c90cb-0156-47de-9b79-e814706a5422 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] 10.222.0.46 "GET /compute/v2.1/servers/a5c419d5-7255-4ab1-8ada-6bb413faa169" status: 200 len: 1321 microversion: 2.1 time: 0.233739 Jan 15 20:50:03.894705 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 307/565] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:03 2022] GET /compute/v2.1/servers/a5c419d5-7255-4ab1-8ada-6bb413faa169 => generated 1321 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:04.046546 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-68e44a4e-6f15-4606-8151-60fcc6125f33 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:04.047148 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-68e44a4e-6f15-4606-8151-60fcc6125f33 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] [instance: 1e63485c-6290-4e1d-82cf-5ae73069dd2e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:04.053548 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-68e44a4e-6f15-4606-8151-60fcc6125f33 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:04.054170 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-68e44a4e-6f15-4606-8151-60fcc6125f33 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:04.054950 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-68e44a4e-6f15-4606-8151-60fcc6125f33 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:04.055535 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-68e44a4e-6f15-4606-8151-60fcc6125f33 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:04.218788 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-81d3d7d1-8c61-49f4-802d-0ca3032ab053 tempest-QuotasAdminNegativeTest-2031557919 tempest-QuotasAdminNegativeTest-2031557919-project-admin] 10.222.0.46 "GET /compute/v2.1/os-quota-sets/80320b43ceca400cbbbc96ae80c4b845" status: 200 len: 371 microversion: 2.1 time: 1.130325 Jan 15 20:50:04.219935 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 259/566] 10.222.0.46 () {58 vars in 1241 bytes} [Sat Jan 15 20:50:03 2022] GET /compute/v2.1/os-quota-sets/80320b43ceca400cbbbc96ae80c4b845 => generated 371 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:50:04.231369 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-6f4bef2a-0f97-48ed-981b-42cd60b48bbf tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:50:04.232721 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-6f4bef2a-0f97-48ed-981b-42cd60b48bbf tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 98d0ca37-0175-44e2-8a1d-965cdc517daf] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:04.242120 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6f4bef2a-0f97-48ed-981b-42cd60b48bbf tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:04.242915 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6f4bef2a-0f97-48ed-981b-42cd60b48bbf tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:04.244490 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6f4bef2a-0f97-48ed-981b-42cd60b48bbf tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:04.245380 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6f4bef2a-0f97-48ed-981b-42cd60b48bbf tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:04.297726 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-6f4bef2a-0f97-48ed-981b-42cd60b48bbf tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action" status: 200 len: 32634 microversion: 2.1 time: 0.075845 Jan 15 20:50:04.299255 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 260/567] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:50:04 2022] POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action => generated 32634 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:50:04.303060 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-68e44a4e-6f15-4606-8151-60fcc6125f33 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc38f86758f9416b9e7f6915de0359d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8cfe33be708428abef52f5e8e25621b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:04.304173 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-dece3651-f977-4c50-90f1-3a3537331118 tempest-QuotasAdminNegativeTest-2031557919 tempest-QuotasAdminNegativeTest-2031557919-project-admin] Action: 'update', calling method: .version_select at 0x7f30c9685ca0>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:50:04.305913 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-sets:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:50:04.305913 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:50:04.321101 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-68e44a4e-6f15-4606-8151-60fcc6125f33 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] 10.222.0.46 "GET /compute/v2.1/servers/1e63485c-6290-4e1d-82cf-5ae73069dd2e" status: 200 len: 1316 microversion: 2.1 time: 0.280827 Jan 15 20:50:04.324920 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 308/568] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:04 2022] GET /compute/v2.1/servers/1e63485c-6290-4e1d-82cf-5ae73069dd2e => generated 1316 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:04.332650 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d8c1f303-468c-4c85-a6c2-aeffb5565e0e tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:04.333893 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-d8c1f303-468c-4c85-a6c2-aeffb5565e0e tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: e3fa2f27-df7a-4ecb-9bba-c970e3e7d106] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:04.342622 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d8c1f303-468c-4c85-a6c2-aeffb5565e0e tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:04.343891 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d8c1f303-468c-4c85-a6c2-aeffb5565e0e tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:04.345310 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d8c1f303-468c-4c85-a6c2-aeffb5565e0e tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:04.346652 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d8c1f303-468c-4c85-a6c2-aeffb5565e0e tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:04.484090 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-d8c1f303-468c-4c85-a6c2-aeffb5565e0e tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:04.517437 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d8c1f303-468c-4c85-a6c2-aeffb5565e0e tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/e3fa2f27-df7a-4ecb-9bba-c970e3e7d106" status: 200 len: 1273 microversion: 2.1 time: 0.189181 Jan 15 20:50:04.522855 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dece3651-f977-4c50-90f1-3a3537331118 tempest-QuotasAdminNegativeTest-2031557919 tempest-QuotasAdminNegativeTest-2031557919-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:04.523313 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dece3651-f977-4c50-90f1-3a3537331118 tempest-QuotasAdminNegativeTest-2031557919 tempest-QuotasAdminNegativeTest-2031557919-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:04.524168 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dece3651-f977-4c50-90f1-3a3537331118 tempest-QuotasAdminNegativeTest-2031557919 tempest-QuotasAdminNegativeTest-2031557919-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:04.524605 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dece3651-f977-4c50-90f1-3a3537331118 tempest-QuotasAdminNegativeTest-2031557919 tempest-QuotasAdminNegativeTest-2031557919-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:04.529726 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 309/569] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:04 2022] GET /compute/v2.1/servers/e3fa2f27-df7a-4ecb-9bba-c970e3e7d106 => generated 1273 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:04.537453 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-bf77b4fa-e10f-49f4-a92c-fbbf4a11b827 req-79388581-0347-4af3-a3ad-aa3dc042cfdb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e63485c-6290-4e1d-82cf-5ae73069dd2e", "name": "network-vif-plugged", "status": "completed", "tag": "ed4307c4-7bfe-4c59-80a3-243181296020"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:50:04.540752 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:50:04.540752 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:50:04.559843 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-bf77b4fa-e10f-49f4-a92c-fbbf4a11b827 req-79388581-0347-4af3-a3ad-aa3dc042cfdb service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:04.560350 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-bf77b4fa-e10f-49f4-a92c-fbbf4a11b827 req-79388581-0347-4af3-a3ad-aa3dc042cfdb service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:04.574646 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-bf77b4fa-e10f-49f4-a92c-fbbf4a11b827 req-79388581-0347-4af3-a3ad-aa3dc042cfdb service nova] Creating event network-vif-plugged:ed4307c4-7bfe-4c59-80a3-243181296020 for instance 1e63485c-6290-4e1d-82cf-5ae73069dd2e on nch2-master-1 Jan 15 20:50:04.581849 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-bf77b4fa-e10f-49f4-a92c-fbbf4a11b827 req-79388581-0347-4af3-a3ad-aa3dc042cfdb service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050115 Jan 15 20:50:04.583046 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 310/570] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:50:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:50:04.637806 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-dece3651-f977-4c50-90f1-3a3537331118 tempest-QuotasAdminNegativeTest-2031557919 tempest-QuotasAdminNegativeTest-2031557919-project-admin] 10.222.0.46 "PUT /compute/v2.1/os-quota-sets/80320b43ceca400cbbbc96ae80c4b845" status: 200 len: 328 microversion: 2.1 time: 0.337683 Jan 15 20:50:04.639264 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 261/571] 10.222.0.46 () {60 vars in 1261 bytes} [Sat Jan 15 20:50:04 2022] PUT /compute/v2.1/os-quota-sets/80320b43ceca400cbbbc96ae80c4b845 => generated 328 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:50:04.677621 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-99b4574d-7f9f-4912-8278-e579ae2cac9d tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:04.678574 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-99b4574d-7f9f-4912-8278-e579ae2cac9d tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] [instance: 770bfdbf-2ac6-4ab9-b2e3-f9e43ae88af6] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:04.690114 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-99b4574d-7f9f-4912-8278-e579ae2cac9d tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:04.692583 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-99b4574d-7f9f-4912-8278-e579ae2cac9d tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:04.694790 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-99b4574d-7f9f-4912-8278-e579ae2cac9d tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:04.698058 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-99b4574d-7f9f-4912-8278-e579ae2cac9d tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:04.942039 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-99b4574d-7f9f-4912-8278-e579ae2cac9d tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:04.953850 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-99b4574d-7f9f-4912-8278-e579ae2cac9d tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:04.955700 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-99b4574d-7f9f-4912-8278-e579ae2cac9d tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:04.957065 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-99b4574d-7f9f-4912-8278-e579ae2cac9d tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] 10.222.0.46 "GET /compute/v2.1/servers/770bfdbf-2ac6-4ab9-b2e3-f9e43ae88af6" status: 200 len: 1566 microversion: 2.25 time: 0.284546 Jan 15 20:50:04.957974 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 311/572] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:50:04 2022] GET /compute/v2.1/servers/770bfdbf-2ac6-4ab9-b2e3-f9e43ae88af6 => generated 1566 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 15 20:50:04.963758 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e2500b22-a02f-4525-bba6-c14e6b6c826d tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:04.965388 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e2500b22-a02f-4525-bba6-c14e6b6c826d tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] [instance: a5c419d5-7255-4ab1-8ada-6bb413faa169] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:04.972649 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e2500b22-a02f-4525-bba6-c14e6b6c826d tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:04.973422 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e2500b22-a02f-4525-bba6-c14e6b6c826d tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:04.974433 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e2500b22-a02f-4525-bba6-c14e6b6c826d tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:04.975084 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e2500b22-a02f-4525-bba6-c14e6b6c826d tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:04.991670 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3113ad96-f0c6-41d1-8e5c-511370d9bcd3 tempest-QuotasAdminNegativeTest-337910980 tempest-QuotasAdminNegativeTest-337910980-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1163015927", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:50:05.068037 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.network.neutron [None req-3113ad96-f0c6-41d1-8e5c-511370d9bcd3 tempest-QuotasAdminNegativeTest-337910980 tempest-QuotasAdminNegativeTest-337910980-project] validate_networks() for None {{(pid=129365) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 20:50:05.282418 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-e2500b22-a02f-4525-bba6-c14e6b6c826d tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd06a1f6896564bb58b457d0642f8302c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89aabae1afe4a5a88ed97e87b5266ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:05.294003 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e2500b22-a02f-4525-bba6-c14e6b6c826d tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] 10.222.0.46 "GET /compute/v2.1/servers/a5c419d5-7255-4ab1-8ada-6bb413faa169" status: 200 len: 1470 microversion: 2.1 time: 0.334792 Jan 15 20:50:05.312492 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 312/573] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:04 2022] GET /compute/v2.1/servers/a5c419d5-7255-4ab1-8ada-6bb413faa169 => generated 1470 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:05.319554 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-c7d5d069-87ff-4215-b9a2-e91b78f1bc98 req-00bad249-6d41-48de-9bb4-4f0fa087ef11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "770bfdbf-2ac6-4ab9-b2e3-f9e43ae88af6", "tag": "6a747998-2bca-46bb-a26f-e7c31a2aa686"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:50:05.321754 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:50:05.321754 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:50:05.332300 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-c7d5d069-87ff-4215-b9a2-e91b78f1bc98 req-00bad249-6d41-48de-9bb4-4f0fa087ef11 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:05.336965 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-c7d5d069-87ff-4215-b9a2-e91b78f1bc98 req-00bad249-6d41-48de-9bb4-4f0fa087ef11 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:05.357633 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-c7d5d069-87ff-4215-b9a2-e91b78f1bc98 req-00bad249-6d41-48de-9bb4-4f0fa087ef11 service nova] Creating event network-changed:6a747998-2bca-46bb-a26f-e7c31a2aa686 for instance 770bfdbf-2ac6-4ab9-b2e3-f9e43ae88af6 on nch1-master-1 Jan 15 20:50:05.381122 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-c7d5d069-87ff-4215-b9a2-e91b78f1bc98 req-00bad249-6d41-48de-9bb4-4f0fa087ef11 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066044 Jan 15 20:50:05.382169 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 313/574] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:50:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:50:05.394478 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-06953cdb-8e48-4cfa-98eb-5a8d3f14e749 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:50:05.398708 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-06953cdb-8e48-4cfa-98eb-5a8d3f14e749 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 98d0ca37-0175-44e2-8a1d-965cdc517daf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:05.413766 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-06953cdb-8e48-4cfa-98eb-5a8d3f14e749 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:05.414270 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-06953cdb-8e48-4cfa-98eb-5a8d3f14e749 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:05.415184 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-06953cdb-8e48-4cfa-98eb-5a8d3f14e749 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:05.418033 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-06953cdb-8e48-4cfa-98eb-5a8d3f14e749 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:05.493637 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-06953cdb-8e48-4cfa-98eb-5a8d3f14e749 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action" status: 200 len: 32634 microversion: 2.1 time: 0.109158 Jan 15 20:50:05.494887 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 314/575] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:50:05 2022] POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action => generated 32634 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:50:05.500046 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-46fdf4c3-809a-405a-95f6-e921202a0ed0 tempest-ServersAdminNegativeTestJSON-496905829 tempest-ServersAdminNegativeTestJSON-496905829-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:50:05.500665 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-46fdf4c3-809a-405a-95f6-e921202a0ed0 tempest-ServersAdminNegativeTestJSON-496905829 tempest-ServersAdminNegativeTestJSON-496905829-project-admin] [instance: a5c419d5-7255-4ab1-8ada-6bb413faa169] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:05.529665 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-3113ad96-f0c6-41d1-8e5c-511370d9bcd3 tempest-QuotasAdminNegativeTest-337910980 tempest-QuotasAdminNegativeTest-337910980-project] Flavor limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 20:50:05.530356 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-3113ad96-f0c6-41d1-8e5c-511370d9bcd3 tempest-QuotasAdminNegativeTest-337910980 tempest-QuotasAdminNegativeTest-337910980-project] Image limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 20:50:05.530954 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-3113ad96-f0c6-41d1-8e5c-511370d9bcd3 tempest-QuotasAdminNegativeTest-337910980 tempest-QuotasAdminNegativeTest-337910980-project] Flavor pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 20:50:05.531518 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-3113ad96-f0c6-41d1-8e5c-511370d9bcd3 tempest-QuotasAdminNegativeTest-337910980 tempest-QuotasAdminNegativeTest-337910980-project] Image pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 20:50:05.532084 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-3113ad96-f0c6-41d1-8e5c-511370d9bcd3 tempest-QuotasAdminNegativeTest-337910980 tempest-QuotasAdminNegativeTest-337910980-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 20:50:05.535642 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-46fdf4c3-809a-405a-95f6-e921202a0ed0 tempest-ServersAdminNegativeTestJSON-496905829 tempest-ServersAdminNegativeTestJSON-496905829-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:05.536216 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-46fdf4c3-809a-405a-95f6-e921202a0ed0 tempest-ServersAdminNegativeTestJSON-496905829 tempest-ServersAdminNegativeTestJSON-496905829-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:05.537528 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-46fdf4c3-809a-405a-95f6-e921202a0ed0 tempest-ServersAdminNegativeTestJSON-496905829 tempest-ServersAdminNegativeTestJSON-496905829-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:05.538422 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-46fdf4c3-809a-405a-95f6-e921202a0ed0 tempest-ServersAdminNegativeTestJSON-496905829 tempest-ServersAdminNegativeTestJSON-496905829-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:05.545369 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3113ad96-f0c6-41d1-8e5c-511370d9bcd3 tempest-QuotasAdminNegativeTest-337910980 tempest-QuotasAdminNegativeTest-337910980-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:05.549127 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3113ad96-f0c6-41d1-8e5c-511370d9bcd3 tempest-QuotasAdminNegativeTest-337910980 tempest-QuotasAdminNegativeTest-337910980-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:05.550028 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3113ad96-f0c6-41d1-8e5c-511370d9bcd3 tempest-QuotasAdminNegativeTest-337910980 tempest-QuotasAdminNegativeTest-337910980-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:05.550516 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3113ad96-f0c6-41d1-8e5c-511370d9bcd3 tempest-QuotasAdminNegativeTest-337910980 tempest-QuotasAdminNegativeTest-337910980-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:05.592047 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-3113ad96-f0c6-41d1-8e5c-511370d9bcd3 tempest-QuotasAdminNegativeTest-337910980 tempest-QuotasAdminNegativeTest-337910980-project] Getting quotas for project 80320b43ceca400cbbbc96ae80c4b845. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:50:05.594121 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.objects.instance [None req-46fdf4c3-809a-405a-95f6-e921202a0ed0 tempest-ServersAdminNegativeTestJSON-496905829 tempest-ServersAdminNegativeTestJSON-496905829-project-admin] Lazy-loading 'flavor' on Instance uuid a5c419d5-7255-4ab1-8ada-6bb413faa169 {{(pid=129366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 20:50:05.603125 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-3113ad96-f0c6-41d1-8e5c-511370d9bcd3 tempest-QuotasAdminNegativeTest-337910980 tempest-QuotasAdminNegativeTest-337910980-project] Getting quotas for user 7d3ebea4a4d04b878f01e3ebba2504f2 and project 80320b43ceca400cbbbc96ae80c4b845. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:50:05.628685 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.utils [None req-3113ad96-f0c6-41d1-8e5c-511370d9bcd3 tempest-QuotasAdminNegativeTest-337910980 tempest-QuotasAdminNegativeTest-337910980-project] cores quota exceeded for 80320b43ceca400cbbbc96ae80c4b845, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=129365) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1171}} Jan 15 20:50:05.641881 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-3113ad96-f0c6-41d1-8e5c-511370d9bcd3 tempest-QuotasAdminNegativeTest-337910980 tempest-QuotasAdminNegativeTest-337910980-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jan 15 20:50:05.642467 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3113ad96-f0c6-41d1-8e5c-511370d9bcd3 tempest-QuotasAdminNegativeTest-337910980 tempest-QuotasAdminNegativeTest-337910980-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:50:05.643335 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3113ad96-f0c6-41d1-8e5c-511370d9bcd3 tempest-QuotasAdminNegativeTest-337910980 tempest-QuotasAdminNegativeTest-337910980-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 0.854897 Jan 15 20:50:05.647778 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 262/576] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 20:50:04 2022] POST /compute/v2.1/servers => generated 111 bytes in 863 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:50:05.653280 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-23ac9b1d-4a6a-4f33-a00d-e6d63049d964 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:05.654610 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-23ac9b1d-4a6a-4f33-a00d-e6d63049d964 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] [instance: 1e63485c-6290-4e1d-82cf-5ae73069dd2e] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:05.662263 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-23ac9b1d-4a6a-4f33-a00d-e6d63049d964 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:05.662917 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-23ac9b1d-4a6a-4f33-a00d-e6d63049d964 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:05.663893 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-23ac9b1d-4a6a-4f33-a00d-e6d63049d964 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:05.664474 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-23ac9b1d-4a6a-4f33-a00d-e6d63049d964 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:05.761248 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-46fdf4c3-809a-405a-95f6-e921202a0ed0 tempest-ServersAdminNegativeTestJSON-496905829 tempest-ServersAdminNegativeTestJSON-496905829-project-admin] 10.222.0.46 "POST /compute/v2.1/servers/a5c419d5-7255-4ab1-8ada-6bb413faa169/action" status: 202 len: 0 microversion: 2.1 time: 0.264738 Jan 15 20:50:05.762277 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 315/577] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:50:05 2022] POST /compute/v2.1/servers/a5c419d5-7255-4ab1-8ada-6bb413faa169/action => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 20:50:05.767902 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-911bdbef-5de5-4fcb-8882-71196ca17878 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:05.768595 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-911bdbef-5de5-4fcb-8882-71196ca17878 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: e3fa2f27-df7a-4ecb-9bba-c970e3e7d106] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:05.778254 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-911bdbef-5de5-4fcb-8882-71196ca17878 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:05.778964 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-911bdbef-5de5-4fcb-8882-71196ca17878 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:05.780645 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-911bdbef-5de5-4fcb-8882-71196ca17878 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:05.781335 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-911bdbef-5de5-4fcb-8882-71196ca17878 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:06.188914 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-23ac9b1d-4a6a-4f33-a00d-e6d63049d964 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc38f86758f9416b9e7f6915de0359d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8cfe33be708428abef52f5e8e25621b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:06.197842 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-23ac9b1d-4a6a-4f33-a00d-e6d63049d964 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] 10.222.0.46 "GET /compute/v2.1/servers/1e63485c-6290-4e1d-82cf-5ae73069dd2e" status: 200 len: 1316 microversion: 2.1 time: 0.548470 Jan 15 20:50:06.210519 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 263/578] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:05 2022] GET /compute/v2.1/servers/1e63485c-6290-4e1d-82cf-5ae73069dd2e => generated 1316 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:06.215951 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-6478b2d6-4af4-4271-80fb-95b310a477f3 tempest-QuotasAdminNegativeTest-2031557919 tempest-QuotasAdminNegativeTest-2031557919-project-admin] Action: 'update', calling method: .version_select at 0x7f30c961e160>, body: {"quota_set": {"cores": 20}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:50:06.218512 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-sets:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:50:06.218512 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:50:06.291863 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-911bdbef-5de5-4fcb-8882-71196ca17878 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:06.299460 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-911bdbef-5de5-4fcb-8882-71196ca17878 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/e3fa2f27-df7a-4ecb-9bba-c970e3e7d106" status: 200 len: 1313 microversion: 2.1 time: 0.536026 Jan 15 20:50:06.300044 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 316/579] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:05 2022] GET /compute/v2.1/servers/e3fa2f27-df7a-4ecb-9bba-c970e3e7d106 => generated 1313 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:06.304262 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-24635810-aa9c-48f7-9027-4f6ff9c8c2f4 tempest-ServersAdminNegativeTestJSON-496905829 tempest-ServersAdminNegativeTestJSON-496905829-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:06.313844 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-24635810-aa9c-48f7-9027-4f6ff9c8c2f4 tempest-ServersAdminNegativeTestJSON-496905829 tempest-ServersAdminNegativeTestJSON-496905829-project-admin] [instance: a5c419d5-7255-4ab1-8ada-6bb413faa169] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:06.336771 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-24635810-aa9c-48f7-9027-4f6ff9c8c2f4 tempest-ServersAdminNegativeTestJSON-496905829 tempest-ServersAdminNegativeTestJSON-496905829-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:06.337455 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-24635810-aa9c-48f7-9027-4f6ff9c8c2f4 tempest-ServersAdminNegativeTestJSON-496905829 tempest-ServersAdminNegativeTestJSON-496905829-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:06.339615 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-24635810-aa9c-48f7-9027-4f6ff9c8c2f4 tempest-ServersAdminNegativeTestJSON-496905829 tempest-ServersAdminNegativeTestJSON-496905829-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:06.340059 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-24635810-aa9c-48f7-9027-4f6ff9c8c2f4 tempest-ServersAdminNegativeTestJSON-496905829 tempest-ServersAdminNegativeTestJSON-496905829-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:06.692932 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6478b2d6-4af4-4271-80fb-95b310a477f3 tempest-QuotasAdminNegativeTest-2031557919 tempest-QuotasAdminNegativeTest-2031557919-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:06.693645 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6478b2d6-4af4-4271-80fb-95b310a477f3 tempest-QuotasAdminNegativeTest-2031557919 tempest-QuotasAdminNegativeTest-2031557919-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:06.694306 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6478b2d6-4af4-4271-80fb-95b310a477f3 tempest-QuotasAdminNegativeTest-2031557919 tempest-QuotasAdminNegativeTest-2031557919-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:06.694795 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6478b2d6-4af4-4271-80fb-95b310a477f3 tempest-QuotasAdminNegativeTest-2031557919 tempest-QuotasAdminNegativeTest-2031557919-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:06.811798 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-6478b2d6-4af4-4271-80fb-95b310a477f3 tempest-QuotasAdminNegativeTest-2031557919 tempest-QuotasAdminNegativeTest-2031557919-project-admin] 10.222.0.46 "PUT /compute/v2.1/os-quota-sets/80320b43ceca400cbbbc96ae80c4b845" status: 200 len: 329 microversion: 2.1 time: 0.599927 Jan 15 20:50:06.812384 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 264/580] 10.222.0.46 () {60 vars in 1261 bytes} [Sat Jan 15 20:50:06 2022] PUT /compute/v2.1/os-quota-sets/80320b43ceca400cbbbc96ae80c4b845 => generated 329 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:50:06.817401 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5468baf0-ae0c-4921-b611-7492db8e3b25 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:06.818171 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-5468baf0-ae0c-4921-b611-7492db8e3b25 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] [instance: 770bfdbf-2ac6-4ab9-b2e3-f9e43ae88af6] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:06.838936 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5468baf0-ae0c-4921-b611-7492db8e3b25 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:06.839380 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5468baf0-ae0c-4921-b611-7492db8e3b25 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:06.840557 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5468baf0-ae0c-4921-b611-7492db8e3b25 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:06.841333 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5468baf0-ae0c-4921-b611-7492db8e3b25 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:07.114508 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-5468baf0-ae0c-4921-b611-7492db8e3b25 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:07.128983 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-5468baf0-ae0c-4921-b611-7492db8e3b25 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:07.133249 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-5468baf0-ae0c-4921-b611-7492db8e3b25 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:07.135433 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5468baf0-ae0c-4921-b611-7492db8e3b25 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] 10.222.0.46 "GET /compute/v2.1/servers/770bfdbf-2ac6-4ab9-b2e3-f9e43ae88af6" status: 200 len: 1566 microversion: 2.25 time: 0.321041 Jan 15 20:50:07.136822 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 265/581] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:50:06 2022] GET /compute/v2.1/servers/770bfdbf-2ac6-4ab9-b2e3-f9e43ae88af6 => generated 1566 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:50:07.142297 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-37cc1a88-1e6e-4e7d-8141-19cd2723b01a tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:50:07.143537 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-37cc1a88-1e6e-4e7d-8141-19cd2723b01a tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 98d0ca37-0175-44e2-8a1d-965cdc517daf] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:07.152456 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-37cc1a88-1e6e-4e7d-8141-19cd2723b01a tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:07.153197 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-37cc1a88-1e6e-4e7d-8141-19cd2723b01a tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:07.155062 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-37cc1a88-1e6e-4e7d-8141-19cd2723b01a tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:07.155741 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-37cc1a88-1e6e-4e7d-8141-19cd2723b01a tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:07.200407 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-24635810-aa9c-48f7-9027-4f6ff9c8c2f4 tempest-ServersAdminNegativeTestJSON-496905829 tempest-ServersAdminNegativeTestJSON-496905829-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/a5c419d5-7255-4ab1-8ada-6bb413faa169" status: 200 len: 1629 microversion: 2.1 time: 0.899339 Jan 15 20:50:07.201117 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 317/582] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:06 2022] GET /compute/v2.1/servers/a5c419d5-7255-4ab1-8ada-6bb413faa169 => generated 1629 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:07.213609 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-738cfd64-4b46-45cf-be9c-feea86b69599 tempest-QuotasAdminNegativeTest-2031557919 tempest-QuotasAdminNegativeTest-2031557919-project-admin] Calling method '.version_select at 0x7f30c974a0d0>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:07.219159 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-37cc1a88-1e6e-4e7d-8141-19cd2723b01a tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action" status: 200 len: 32634 microversion: 2.1 time: 0.080274 Jan 15 20:50:07.220033 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 266/583] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:50:07 2022] POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action => generated 32634 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:50:07.487418 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-738cfd64-4b46-45cf-be9c-feea86b69599 tempest-QuotasAdminNegativeTest-2031557919 tempest-QuotasAdminNegativeTest-2031557919-project-admin] 10.222.0.46 "GET /compute/v2.1/os-quota-sets/80320b43ceca400cbbbc96ae80c4b845" status: 200 len: 371 microversion: 2.1 time: 0.284951 Jan 15 20:50:07.487902 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 318/584] 10.222.0.46 () {58 vars in 1241 bytes} [Sat Jan 15 20:50:07 2022] GET /compute/v2.1/os-quota-sets/80320b43ceca400cbbbc96ae80c4b845 => generated 371 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:50:07.492167 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-fff823ca-7930-4c04-bee1-fa2a955c5e00 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:07.492768 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-fff823ca-7930-4c04-bee1-fa2a955c5e00 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] [instance: 1e63485c-6290-4e1d-82cf-5ae73069dd2e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:07.499579 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fff823ca-7930-4c04-bee1-fa2a955c5e00 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:07.500027 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fff823ca-7930-4c04-bee1-fa2a955c5e00 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:07.501047 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fff823ca-7930-4c04-bee1-fa2a955c5e00 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:07.501646 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fff823ca-7930-4c04-bee1-fa2a955c5e00 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:07.513065 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f3f1eeb6-4c23-4c18-99e4-a1916dc14e69 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1687385245", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:50:07.568951 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.network.neutron [None req-f3f1eeb6-4c23-4c18-99e4-a1916dc14e69 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] validate_networks() for None {{(pid=129365) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 20:50:07.914906 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-fff823ca-7930-4c04-bee1-fa2a955c5e00 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc38f86758f9416b9e7f6915de0359d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8cfe33be708428abef52f5e8e25621b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:07.922860 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-fff823ca-7930-4c04-bee1-fa2a955c5e00 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] 10.222.0.46 "GET /compute/v2.1/servers/1e63485c-6290-4e1d-82cf-5ae73069dd2e" status: 200 len: 1466 microversion: 2.1 time: 0.434047 Jan 15 20:50:07.923539 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 319/585] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:07 2022] GET /compute/v2.1/servers/1e63485c-6290-4e1d-82cf-5ae73069dd2e => generated 1466 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:07.942812 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4206d0ec-bce7-487f-bc44-ab85b2d699f0 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:07.943446 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-4206d0ec-bce7-487f-bc44-ab85b2d699f0 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: e3fa2f27-df7a-4ecb-9bba-c970e3e7d106] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:07.950614 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4206d0ec-bce7-487f-bc44-ab85b2d699f0 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:07.951014 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4206d0ec-bce7-487f-bc44-ab85b2d699f0 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:07.951793 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4206d0ec-bce7-487f-bc44-ab85b2d699f0 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:07.952377 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4206d0ec-bce7-487f-bc44-ab85b2d699f0 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:07.988130 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-f3f1eeb6-4c23-4c18-99e4-a1916dc14e69 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Flavor limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 20:50:07.989833 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-f3f1eeb6-4c23-4c18-99e4-a1916dc14e69 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Image limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 20:50:07.990736 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-f3f1eeb6-4c23-4c18-99e4-a1916dc14e69 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Flavor pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 20:50:07.991988 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-f3f1eeb6-4c23-4c18-99e4-a1916dc14e69 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Image pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 20:50:07.992359 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-f3f1eeb6-4c23-4c18-99e4-a1916dc14e69 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 20:50:08.004047 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f3f1eeb6-4c23-4c18-99e4-a1916dc14e69 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:08.004496 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f3f1eeb6-4c23-4c18-99e4-a1916dc14e69 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:08.005347 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f3f1eeb6-4c23-4c18-99e4-a1916dc14e69 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:08.005817 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f3f1eeb6-4c23-4c18-99e4-a1916dc14e69 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:08.025711 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-f3f1eeb6-4c23-4c18-99e4-a1916dc14e69 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Getting quotas for project 2f4a26c8edac44c8b26fd4e43813412d. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:50:08.030006 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-f3f1eeb6-4c23-4c18-99e4-a1916dc14e69 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Getting quotas for user 32d4a57cfaa145009ba9cc8f21d9e8ac and project 2f4a26c8edac44c8b26fd4e43813412d. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:50:08.042662 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f3f1eeb6-4c23-4c18-99e4-a1916dc14e69 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Going to run 1 instances... {{(pid=129365) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 20:50:08.045985 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f3f1eeb6-4c23-4c18-99e4-a1916dc14e69 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] [instance: b191ed6c-040a-4702-8e15-86272f9d1847] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129365) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 20:50:08.093095 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f3f1eeb6-4c23-4c18-99e4-a1916dc14e69 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.871567 Jan 15 20:50:08.094390 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 267/586] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 20:50:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 873 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 20:50:08.099170 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-538d7241-6935-43d6-9db1-c8691f7ad286 req-c389e13a-7793-42e5-8d79-1719698b83c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3fa2f27-df7a-4ecb-9bba-c970e3e7d106", "tag": "3c8e5ec9-ee60-4c8e-b5ce-d77245088af1"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:50:08.099755 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-4206d0ec-bce7-487f-bc44-ab85b2d699f0 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:08.100727 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:50:08.100727 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:50:08.109657 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-538d7241-6935-43d6-9db1-c8691f7ad286 req-c389e13a-7793-42e5-8d79-1719698b83c6 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:08.110252 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-538d7241-6935-43d6-9db1-c8691f7ad286 req-c389e13a-7793-42e5-8d79-1719698b83c6 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:08.110699 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-4206d0ec-bce7-487f-bc44-ab85b2d699f0 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/e3fa2f27-df7a-4ecb-9bba-c970e3e7d106" status: 200 len: 1313 microversion: 2.1 time: 0.185934 Jan 15 20:50:08.111377 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 320/587] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:07 2022] GET /compute/v2.1/servers/e3fa2f27-df7a-4ecb-9bba-c970e3e7d106 => generated 1313 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:08.122228 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ed710cf1-fa68-4aa6-98b4-773c3fe28d55 tempest-QuotasAdminNegativeTest-2031557919 tempest-QuotasAdminNegativeTest-2031557919-project-admin] Action: 'update', calling method: .version_select at 0x7f30c95f6670>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:50:08.135171 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-538d7241-6935-43d6-9db1-c8691f7ad286 req-c389e13a-7793-42e5-8d79-1719698b83c6 service nova] Creating event network-changed:3c8e5ec9-ee60-4c8e-b5ce-d77245088af1 for instance e3fa2f27-df7a-4ecb-9bba-c970e3e7d106 on nch1-master-1 Jan 15 20:50:08.136787 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-sets:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:50:08.136787 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:50:08.140778 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-538d7241-6935-43d6-9db1-c8691f7ad286 req-c389e13a-7793-42e5-8d79-1719698b83c6 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045139 Jan 15 20:50:08.141870 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 268/588] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:50:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:50:08.396425 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b4d3bce0-f467-4af9-87a5-1059347543f3 tempest-ServersOnMultiNodesTest-1194618714 tempest-ServersOnMultiNodesTest-1194618714-project-admin] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:08.397503 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b4d3bce0-f467-4af9-87a5-1059347543f3 tempest-ServersOnMultiNodesTest-1194618714 tempest-ServersOnMultiNodesTest-1194618714-project-admin] [instance: 1e63485c-6290-4e1d-82cf-5ae73069dd2e] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:08.410519 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b4d3bce0-f467-4af9-87a5-1059347543f3 tempest-ServersOnMultiNodesTest-1194618714 tempest-ServersOnMultiNodesTest-1194618714-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:08.411212 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b4d3bce0-f467-4af9-87a5-1059347543f3 tempest-ServersOnMultiNodesTest-1194618714 tempest-ServersOnMultiNodesTest-1194618714-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:08.412210 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b4d3bce0-f467-4af9-87a5-1059347543f3 tempest-ServersOnMultiNodesTest-1194618714 tempest-ServersOnMultiNodesTest-1194618714-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:08.413044 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b4d3bce0-f467-4af9-87a5-1059347543f3 tempest-ServersOnMultiNodesTest-1194618714 tempest-ServersOnMultiNodesTest-1194618714-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:08.537627 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ed710cf1-fa68-4aa6-98b4-773c3fe28d55 tempest-QuotasAdminNegativeTest-2031557919 tempest-QuotasAdminNegativeTest-2031557919-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:08.539986 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ed710cf1-fa68-4aa6-98b4-773c3fe28d55 tempest-QuotasAdminNegativeTest-2031557919 tempest-QuotasAdminNegativeTest-2031557919-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:08.541608 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ed710cf1-fa68-4aa6-98b4-773c3fe28d55 tempest-QuotasAdminNegativeTest-2031557919 tempest-QuotasAdminNegativeTest-2031557919-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:08.545379 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ed710cf1-fa68-4aa6-98b4-773c3fe28d55 tempest-QuotasAdminNegativeTest-2031557919 tempest-QuotasAdminNegativeTest-2031557919-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:08.630160 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ed710cf1-fa68-4aa6-98b4-773c3fe28d55 tempest-QuotasAdminNegativeTest-2031557919 tempest-QuotasAdminNegativeTest-2031557919-project-admin] 10.222.0.46 "PUT /compute/v2.1/os-quota-sets/80320b43ceca400cbbbc96ae80c4b845" status: 200 len: 328 microversion: 2.1 time: 0.517673 Jan 15 20:50:08.631007 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 321/589] 10.222.0.46 () {60 vars in 1261 bytes} [Sat Jan 15 20:50:08 2022] PUT /compute/v2.1/os-quota-sets/80320b43ceca400cbbbc96ae80c4b845 => generated 328 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:50:08.637047 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9ffa3d02-9a11-4434-9fdf-688aea6b5d7d tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:08.638599 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-9ffa3d02-9a11-4434-9fdf-688aea6b5d7d tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] [instance: 770bfdbf-2ac6-4ab9-b2e3-f9e43ae88af6] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:08.658203 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9ffa3d02-9a11-4434-9fdf-688aea6b5d7d tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:08.659745 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9ffa3d02-9a11-4434-9fdf-688aea6b5d7d tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:08.660778 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9ffa3d02-9a11-4434-9fdf-688aea6b5d7d tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:08.661387 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9ffa3d02-9a11-4434-9fdf-688aea6b5d7d tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:08.789539 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b4d3bce0-f467-4af9-87a5-1059347543f3 tempest-ServersOnMultiNodesTest-1194618714 tempest-ServersOnMultiNodesTest-1194618714-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/1e63485c-6290-4e1d-82cf-5ae73069dd2e" status: 200 len: 1617 microversion: 2.1 time: 0.637968 Jan 15 20:50:08.790525 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 269/590] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:08 2022] GET /compute/v2.1/servers/1e63485c-6290-4e1d-82cf-5ae73069dd2e => generated 1617 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:08.795961 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5e99f4a8-a27d-4c7e-ad00-9b6908e093b9 tempest-ServersAdminNegativeTestJSON-496905829 tempest-ServersAdminNegativeTestJSON-496905829-project-admin] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:08.796565 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-5e99f4a8-a27d-4c7e-ad00-9b6908e093b9 tempest-ServersAdminNegativeTestJSON-496905829 tempest-ServersAdminNegativeTestJSON-496905829-project-admin] [instance: a5c419d5-7255-4ab1-8ada-6bb413faa169] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:08.812059 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5e99f4a8-a27d-4c7e-ad00-9b6908e093b9 tempest-ServersAdminNegativeTestJSON-496905829 tempest-ServersAdminNegativeTestJSON-496905829-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:08.812518 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5e99f4a8-a27d-4c7e-ad00-9b6908e093b9 tempest-ServersAdminNegativeTestJSON-496905829 tempest-ServersAdminNegativeTestJSON-496905829-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:08.813916 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5e99f4a8-a27d-4c7e-ad00-9b6908e093b9 tempest-ServersAdminNegativeTestJSON-496905829 tempest-ServersAdminNegativeTestJSON-496905829-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:08.813916 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5e99f4a8-a27d-4c7e-ad00-9b6908e093b9 tempest-ServersAdminNegativeTestJSON-496905829 tempest-ServersAdminNegativeTestJSON-496905829-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:09.020858 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-9ffa3d02-9a11-4434-9fdf-688aea6b5d7d tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:09.029558 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-9ffa3d02-9a11-4434-9fdf-688aea6b5d7d tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:09.031053 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-9ffa3d02-9a11-4434-9fdf-688aea6b5d7d tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:09.032206 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-9ffa3d02-9a11-4434-9fdf-688aea6b5d7d tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] 10.222.0.46 "GET /compute/v2.1/servers/770bfdbf-2ac6-4ab9-b2e3-f9e43ae88af6" status: 200 len: 1566 microversion: 2.25 time: 0.400382 Jan 15 20:50:09.032766 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 322/591] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:50:08 2022] GET /compute/v2.1/servers/770bfdbf-2ac6-4ab9-b2e3-f9e43ae88af6 => generated 1566 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:50:09.037343 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-941893ab-d9fe-41a9-8a8e-92aef5a25c94 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1386290758", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:50:09.090425 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5e99f4a8-a27d-4c7e-ad00-9b6908e093b9 tempest-ServersAdminNegativeTestJSON-496905829 tempest-ServersAdminNegativeTestJSON-496905829-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/a5c419d5-7255-4ab1-8ada-6bb413faa169" status: 200 len: 1612 microversion: 2.1 time: 0.298113 Jan 15 20:50:09.091277 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 270/592] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:08 2022] GET /compute/v2.1/servers/a5c419d5-7255-4ab1-8ada-6bb413faa169 => generated 1612 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:09.095969 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f0a74465-6aa3-4f5a-9417-97f2bac9c779 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:50:09.096903 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.network.neutron [None req-941893ab-d9fe-41a9-8a8e-92aef5a25c94 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] validate_networks() for None {{(pid=129366) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 20:50:09.097504 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f0a74465-6aa3-4f5a-9417-97f2bac9c779 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 98d0ca37-0175-44e2-8a1d-965cdc517daf] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:09.104206 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f0a74465-6aa3-4f5a-9417-97f2bac9c779 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:09.104738 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f0a74465-6aa3-4f5a-9417-97f2bac9c779 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:09.105655 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f0a74465-6aa3-4f5a-9417-97f2bac9c779 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:09.106082 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f0a74465-6aa3-4f5a-9417-97f2bac9c779 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:09.152635 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f0a74465-6aa3-4f5a-9417-97f2bac9c779 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action" status: 200 len: 32634 microversion: 2.1 time: 0.059902 Jan 15 20:50:09.153458 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 271/593] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:50:09 2022] POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action => generated 32634 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:50:09.159027 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-24927e25-9722-4c5c-b961-aa56278bb9c7 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Action: 'create', calling method: .version_select at 0x7f30c9678700>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1076803108", "policies": ["affinity"]}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:50:09.175506 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-24927e25-9722-4c5c-b961-aa56278bb9c7 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Getting quotas for project e8cfe33be708428abef52f5e8e25621b. Resources: {'server_groups'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:50:09.180292 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-24927e25-9722-4c5c-b961-aa56278bb9c7 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Getting quotas for user bc38f86758f9416b9e7f6915de0359d6 and project e8cfe33be708428abef52f5e8e25621b. Resources: {'server_groups'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:50:09.230968 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-24927e25-9722-4c5c-b961-aa56278bb9c7 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Getting quotas for project e8cfe33be708428abef52f5e8e25621b. Resources: {'server_groups'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:50:09.234665 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-24927e25-9722-4c5c-b961-aa56278bb9c7 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Getting quotas for user bc38f86758f9416b9e7f6915de0359d6 and project e8cfe33be708428abef52f5e8e25621b. Resources: {'server_groups'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:50:09.247139 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-24927e25-9722-4c5c-b961-aa56278bb9c7 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] 10.222.0.46 "POST /compute/v2.1/os-server-groups" status: 200 len: 188 microversion: 2.1 time: 0.092487 Jan 15 20:50:09.248026 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 272/594] 10.222.0.46 () {60 vars in 1173 bytes} [Sat Jan 15 20:50:09 2022] POST /compute/v2.1/os-server-groups => generated 188 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:50:09.253510 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-7484f433-0ff9-4be4-a8eb-71158dfaf342 tempest-QuotasAdminNegativeTest-337910980 tempest-QuotasAdminNegativeTest-337910980-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-159944505", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:50:09.308937 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.network.neutron [None req-7484f433-0ff9-4be4-a8eb-71158dfaf342 tempest-QuotasAdminNegativeTest-337910980 tempest-QuotasAdminNegativeTest-337910980-project] validate_networks() for None {{(pid=129365) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 20:50:09.422205 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-941893ab-d9fe-41a9-8a8e-92aef5a25c94 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Flavor limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 20:50:09.422700 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-941893ab-d9fe-41a9-8a8e-92aef5a25c94 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Image limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 20:50:09.423272 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-941893ab-d9fe-41a9-8a8e-92aef5a25c94 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Flavor pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 20:50:09.423748 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-941893ab-d9fe-41a9-8a8e-92aef5a25c94 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Image pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 20:50:09.424222 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-941893ab-d9fe-41a9-8a8e-92aef5a25c94 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 20:50:09.434019 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-941893ab-d9fe-41a9-8a8e-92aef5a25c94 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:09.434561 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-941893ab-d9fe-41a9-8a8e-92aef5a25c94 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:09.435467 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-941893ab-d9fe-41a9-8a8e-92aef5a25c94 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:09.435971 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-941893ab-d9fe-41a9-8a8e-92aef5a25c94 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:09.456075 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-941893ab-d9fe-41a9-8a8e-92aef5a25c94 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Getting quotas for project 2f4a26c8edac44c8b26fd4e43813412d. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:50:09.460711 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-941893ab-d9fe-41a9-8a8e-92aef5a25c94 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Getting quotas for user 32d4a57cfaa145009ba9cc8f21d9e8ac and project 2f4a26c8edac44c8b26fd4e43813412d. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:50:09.472804 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-941893ab-d9fe-41a9-8a8e-92aef5a25c94 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Going to run 1 instances... {{(pid=129366) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 20:50:09.475386 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-941893ab-d9fe-41a9-8a8e-92aef5a25c94 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] [instance: e3b7a713-3f0d-43e2-b466-6637bc567256] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 20:50:09.535074 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-941893ab-d9fe-41a9-8a8e-92aef5a25c94 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.500869 Jan 15 20:50:09.535962 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 323/595] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 20:50:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 502 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 20:50:09.695895 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-7484f433-0ff9-4be4-a8eb-71158dfaf342 tempest-QuotasAdminNegativeTest-337910980 tempest-QuotasAdminNegativeTest-337910980-project] Flavor limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 20:50:09.696325 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-7484f433-0ff9-4be4-a8eb-71158dfaf342 tempest-QuotasAdminNegativeTest-337910980 tempest-QuotasAdminNegativeTest-337910980-project] Image limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 20:50:09.697067 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-7484f433-0ff9-4be4-a8eb-71158dfaf342 tempest-QuotasAdminNegativeTest-337910980 tempest-QuotasAdminNegativeTest-337910980-project] Flavor pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 20:50:09.697725 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-7484f433-0ff9-4be4-a8eb-71158dfaf342 tempest-QuotasAdminNegativeTest-337910980 tempest-QuotasAdminNegativeTest-337910980-project] Image pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 20:50:09.698561 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-7484f433-0ff9-4be4-a8eb-71158dfaf342 tempest-QuotasAdminNegativeTest-337910980 tempest-QuotasAdminNegativeTest-337910980-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 20:50:09.698678 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c42031f5-5e60-46fc-8478-44648fa977c8 tempest-QuotasAdminTestV257-148047986 tempest-QuotasAdminTestV257-148047986-project-admin] Action: 'update', calling method: .version_select at 0x7f30c974a160>, body: {"quota_set": {"ram": "5120"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:50:09.700433 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-sets:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:50:09.700433 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:50:09.714368 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7484f433-0ff9-4be4-a8eb-71158dfaf342 tempest-QuotasAdminNegativeTest-337910980 tempest-QuotasAdminNegativeTest-337910980-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:09.715125 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7484f433-0ff9-4be4-a8eb-71158dfaf342 tempest-QuotasAdminNegativeTest-337910980 tempest-QuotasAdminNegativeTest-337910980-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:09.719831 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7484f433-0ff9-4be4-a8eb-71158dfaf342 tempest-QuotasAdminNegativeTest-337910980 tempest-QuotasAdminNegativeTest-337910980-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:09.724736 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7484f433-0ff9-4be4-a8eb-71158dfaf342 tempest-QuotasAdminNegativeTest-337910980 tempest-QuotasAdminNegativeTest-337910980-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:09.774481 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-7484f433-0ff9-4be4-a8eb-71158dfaf342 tempest-QuotasAdminNegativeTest-337910980 tempest-QuotasAdminNegativeTest-337910980-project] Getting quotas for project 80320b43ceca400cbbbc96ae80c4b845. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:50:09.781426 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c42031f5-5e60-46fc-8478-44648fa977c8 tempest-QuotasAdminTestV257-148047986 tempest-QuotasAdminTestV257-148047986-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:09.782022 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c42031f5-5e60-46fc-8478-44648fa977c8 tempest-QuotasAdminTestV257-148047986 tempest-QuotasAdminTestV257-148047986-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:09.783062 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c42031f5-5e60-46fc-8478-44648fa977c8 tempest-QuotasAdminTestV257-148047986 tempest-QuotasAdminTestV257-148047986-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:09.783590 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c42031f5-5e60-46fc-8478-44648fa977c8 tempest-QuotasAdminTestV257-148047986 tempest-QuotasAdminTestV257-148047986-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:09.783771 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-7484f433-0ff9-4be4-a8eb-71158dfaf342 tempest-QuotasAdminNegativeTest-337910980 tempest-QuotasAdminNegativeTest-337910980-project] Getting quotas for user 7d3ebea4a4d04b878f01e3ebba2504f2 and project 80320b43ceca400cbbbc96ae80c4b845. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:50:09.816861 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.utils [None req-7484f433-0ff9-4be4-a8eb-71158dfaf342 tempest-QuotasAdminNegativeTest-337910980 tempest-QuotasAdminNegativeTest-337910980-project] instances quota exceeded for 80320b43ceca400cbbbc96ae80c4b845, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=129365) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1171}} Jan 15 20:50:09.817740 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-7484f433-0ff9-4be4-a8eb-71158dfaf342 tempest-QuotasAdminNegativeTest-337910980 tempest-QuotasAdminNegativeTest-337910980-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jan 15 20:50:09.818566 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-7484f433-0ff9-4be4-a8eb-71158dfaf342 tempest-QuotasAdminNegativeTest-337910980 tempest-QuotasAdminNegativeTest-337910980-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:50:09.819905 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-7484f433-0ff9-4be4-a8eb-71158dfaf342 tempest-QuotasAdminNegativeTest-337910980 tempest-QuotasAdminNegativeTest-337910980-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.570622 Jan 15 20:50:09.821059 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 273/596] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 20:50:09 2022] POST /compute/v2.1/servers => generated 119 bytes in 572 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:50:09.826909 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-221a2351-6328-4eda-9e6d-468cbcaeb6bd tempest-ServersAdminNegativeTestJSON-496905829 tempest-ServersAdminNegativeTestJSON-496905829-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:50:09.828699 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-221a2351-6328-4eda-9e6d-468cbcaeb6bd tempest-ServersAdminNegativeTestJSON-496905829 tempest-ServersAdminNegativeTestJSON-496905829-project-admin] [instance: a5c419d5-7255-4ab1-8ada-6bb413faa169] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:09.848778 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c42031f5-5e60-46fc-8478-44648fa977c8 tempest-QuotasAdminTestV257-148047986 tempest-QuotasAdminTestV257-148047986-project-admin] 10.222.0.46 "PUT /compute/v2.1/os-quota-sets/eda920f39c414b7abd01ea16664708de" status: 200 len: 148 microversion: 2.57 time: 0.306928 Jan 15 20:50:09.849847 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 324/597] 10.222.0.46 () {62 vars in 1302 bytes} [Sat Jan 15 20:50:09 2022] PUT /compute/v2.1/os-quota-sets/eda920f39c414b7abd01ea16664708de => generated 148 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:50:09.854526 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-221a2351-6328-4eda-9e6d-468cbcaeb6bd tempest-ServersAdminNegativeTestJSON-496905829 tempest-ServersAdminNegativeTestJSON-496905829-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:09.854975 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-221a2351-6328-4eda-9e6d-468cbcaeb6bd tempest-ServersAdminNegativeTestJSON-496905829 tempest-ServersAdminNegativeTestJSON-496905829-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:09.856055 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-221a2351-6328-4eda-9e6d-468cbcaeb6bd tempest-ServersAdminNegativeTestJSON-496905829 tempest-ServersAdminNegativeTestJSON-496905829-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:09.856176 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-743ae593-0046-46ba-b479-4f445ad449f2 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:09.856498 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-221a2351-6328-4eda-9e6d-468cbcaeb6bd tempest-ServersAdminNegativeTestJSON-496905829 tempest-ServersAdminNegativeTestJSON-496905829-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:09.857118 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-743ae593-0046-46ba-b479-4f445ad449f2 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: e3fa2f27-df7a-4ecb-9bba-c970e3e7d106] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:09.864950 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-743ae593-0046-46ba-b479-4f445ad449f2 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:09.865535 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-743ae593-0046-46ba-b479-4f445ad449f2 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:09.866585 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-743ae593-0046-46ba-b479-4f445ad449f2 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:09.867073 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-743ae593-0046-46ba-b479-4f445ad449f2 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:10.014858 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-221a2351-6328-4eda-9e6d-468cbcaeb6bd tempest-ServersAdminNegativeTestJSON-496905829 tempest-ServersAdminNegativeTestJSON-496905829-project-admin] HTTP exception thrown: Cannot 'migrate' instance a5c419d5-7255-4ab1-8ada-6bb413faa169 while it is in vm_state suspended Jan 15 20:50:10.016034 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-221a2351-6328-4eda-9e6d-468cbcaeb6bd tempest-ServersAdminNegativeTestJSON-496905829 tempest-ServersAdminNegativeTestJSON-496905829-project-admin] Returning 409 to user: Cannot 'migrate' instance a5c419d5-7255-4ab1-8ada-6bb413faa169 while it is in vm_state suspended {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:50:10.017374 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-221a2351-6328-4eda-9e6d-468cbcaeb6bd tempest-ServersAdminNegativeTestJSON-496905829 tempest-ServersAdminNegativeTestJSON-496905829-project-admin] 10.222.0.46 "POST /compute/v2.1/servers/a5c419d5-7255-4ab1-8ada-6bb413faa169/action" status: 409 len: 148 microversion: 2.1 time: 0.194959 Jan 15 20:50:10.023012 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 274/598] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:50:09 2022] POST /compute/v2.1/servers/a5c419d5-7255-4ab1-8ada-6bb413faa169/action => generated 148 bytes in 197 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jan 15 20:50:10.028866 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-0016087a-1f4c-48cd-9780-7b4dd41478ef tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1138661993", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "fea8424e-67ca-4452-9e88-e044ef8eadf9"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:50:10.089586 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.network.neutron [None req-0016087a-1f4c-48cd-9780-7b4dd41478ef tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] validate_networks() for None {{(pid=129365) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 20:50:10.299649 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-743ae593-0046-46ba-b479-4f445ad449f2 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:10.307046 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-743ae593-0046-46ba-b479-4f445ad449f2 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/e3fa2f27-df7a-4ecb-9bba-c970e3e7d106" status: 200 len: 1313 microversion: 2.1 time: 0.455926 Jan 15 20:50:10.313698 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 325/599] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:09 2022] GET /compute/v2.1/servers/e3fa2f27-df7a-4ecb-9bba-c970e3e7d106 => generated 1313 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:10.319119 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8897fbd6-9d3e-42d4-b4d1-368b0b0f0790 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:10.319732 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-8897fbd6-9d3e-42d4-b4d1-368b0b0f0790 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] [instance: e3b7a713-3f0d-43e2-b466-6637bc567256] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:10.342833 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8897fbd6-9d3e-42d4-b4d1-368b0b0f0790 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:10.343281 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8897fbd6-9d3e-42d4-b4d1-368b0b0f0790 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:10.344079 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8897fbd6-9d3e-42d4-b4d1-368b0b0f0790 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:10.344506 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8897fbd6-9d3e-42d4-b4d1-368b0b0f0790 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:10.465928 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-8897fbd6-9d3e-42d4-b4d1-368b0b0f0790 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d4a57cfaa145009ba9cc8f21d9e8ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4a26c8edac44c8b26fd4e43813412d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:10.477341 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-8897fbd6-9d3e-42d4-b4d1-368b0b0f0790 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] 10.222.0.46 "GET /compute/v2.1/servers/e3b7a713-3f0d-43e2-b466-6637bc567256" status: 200 len: 1210 microversion: 2.1 time: 0.161690 Jan 15 20:50:10.479349 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 326/600] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:10 2022] GET /compute/v2.1/servers/e3b7a713-3f0d-43e2-b466-6637bc567256 => generated 1210 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:10.492664 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1a733caf-9535-405f-93e0-68ead7aeccd0 tempest-QuotasAdminNegativeTest-2031557919 tempest-QuotasAdminNegativeTest-2031557919-project-admin] Action: 'update', calling method: .version_select at 0x7f30c977f4c0>, body: {"quota_set": {"instances": 10}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:50:10.494490 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-sets:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:50:10.494490 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:50:10.629997 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1a733caf-9535-405f-93e0-68ead7aeccd0 tempest-QuotasAdminNegativeTest-2031557919 tempest-QuotasAdminNegativeTest-2031557919-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:10.630813 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1a733caf-9535-405f-93e0-68ead7aeccd0 tempest-QuotasAdminNegativeTest-2031557919 tempest-QuotasAdminNegativeTest-2031557919-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:10.632556 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1a733caf-9535-405f-93e0-68ead7aeccd0 tempest-QuotasAdminNegativeTest-2031557919 tempest-QuotasAdminNegativeTest-2031557919-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:10.633619 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1a733caf-9535-405f-93e0-68ead7aeccd0 tempest-QuotasAdminNegativeTest-2031557919 tempest-QuotasAdminNegativeTest-2031557919-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:10.648127 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-0016087a-1f4c-48cd-9780-7b4dd41478ef tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Flavor limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 20:50:10.648631 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-0016087a-1f4c-48cd-9780-7b4dd41478ef tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Image limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 20:50:10.649047 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-0016087a-1f4c-48cd-9780-7b4dd41478ef tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Flavor pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 20:50:10.649454 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-0016087a-1f4c-48cd-9780-7b4dd41478ef tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Image pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 20:50:10.651493 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-0016087a-1f4c-48cd-9780-7b4dd41478ef tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 20:50:10.684050 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0016087a-1f4c-48cd-9780-7b4dd41478ef tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:10.684490 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0016087a-1f4c-48cd-9780-7b4dd41478ef tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:10.685321 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0016087a-1f4c-48cd-9780-7b4dd41478ef tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:10.685753 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0016087a-1f4c-48cd-9780-7b4dd41478ef tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:10.717286 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-0016087a-1f4c-48cd-9780-7b4dd41478ef tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Getting quotas for project e8cfe33be708428abef52f5e8e25621b. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:50:10.731506 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-0016087a-1f4c-48cd-9780-7b4dd41478ef tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Getting quotas for user bc38f86758f9416b9e7f6915de0359d6 and project e8cfe33be708428abef52f5e8e25621b. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:50:10.744672 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-0016087a-1f4c-48cd-9780-7b4dd41478ef tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Going to run 2 instances... {{(pid=129365) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 20:50:10.762174 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-0016087a-1f4c-48cd-9780-7b4dd41478ef tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] [instance: 3934550f-0131-4bd3-890b-edbaf4ccac0e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129365) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 20:50:10.773999 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-1a733caf-9535-405f-93e0-68ead7aeccd0 tempest-QuotasAdminNegativeTest-2031557919 tempest-QuotasAdminNegativeTest-2031557919-project-admin] 10.222.0.46 "PUT /compute/v2.1/os-quota-sets/80320b43ceca400cbbbc96ae80c4b845" status: 200 len: 329 microversion: 2.1 time: 0.291611 Jan 15 20:50:10.775849 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 327/601] 10.222.0.46 () {60 vars in 1261 bytes} [Sat Jan 15 20:50:10 2022] PUT /compute/v2.1/os-quota-sets/80320b43ceca400cbbbc96ae80c4b845 => generated 329 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:50:10.785854 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-2603ee1b-8bd0-4636-b1ae-511bf3241ca8 tempest-QuotasAdminTestV257-148047986 tempest-QuotasAdminTestV257-148047986-project-admin] Calling method '.version_select at 0x7f30c971b9d0>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:10.861233 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-0016087a-1f4c-48cd-9780-7b4dd41478ef tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=129365) _server_group_count_members_by_user /opt/stack/nova/nova/quota.py:1154}} Jan 15 20:50:10.897566 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-0016087a-1f4c-48cd-9780-7b4dd41478ef tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Getting quotas for project e8cfe33be708428abef52f5e8e25621b. Resources: {'server_group_members'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:50:10.903766 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-0016087a-1f4c-48cd-9780-7b4dd41478ef tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Getting quotas for user bc38f86758f9416b9e7f6915de0359d6 and project e8cfe33be708428abef52f5e8e25621b. Resources: {'server_group_members'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:50:10.917421 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2603ee1b-8bd0-4636-b1ae-511bf3241ca8 tempest-QuotasAdminTestV257-148047986 tempest-QuotasAdminTestV257-148047986-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:10.918021 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2603ee1b-8bd0-4636-b1ae-511bf3241ca8 tempest-QuotasAdminTestV257-148047986 tempest-QuotasAdminTestV257-148047986-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:10.918957 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2603ee1b-8bd0-4636-b1ae-511bf3241ca8 tempest-QuotasAdminTestV257-148047986 tempest-QuotasAdminTestV257-148047986-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:10.921427 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2603ee1b-8bd0-4636-b1ae-511bf3241ca8 tempest-QuotasAdminTestV257-148047986 tempest-QuotasAdminTestV257-148047986-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:10.967650 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-2603ee1b-8bd0-4636-b1ae-511bf3241ca8 tempest-QuotasAdminTestV257-148047986 tempest-QuotasAdminTestV257-148047986-project-admin] 10.222.0.46 "GET /compute/v2.1/os-quota-sets/eda920f39c414b7abd01ea16664708de/detail" status: 200 len: 463 microversion: 2.57 time: 0.190052 Jan 15 20:50:10.968662 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 328/602] 10.222.0.46 () {60 vars in 1303 bytes} [Sat Jan 15 20:50:10 2022] GET /compute/v2.1/os-quota-sets/eda920f39c414b7abd01ea16664708de/detail => generated 463 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:50:10.981774 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-2350e5d9-f3b1-4b69-8cc7-edf7af357805 tempest-ServersAdminNegativeTestJSON-496905829 tempest-ServersAdminNegativeTestJSON-496905829-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:50:10.986147 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-2350e5d9-f3b1-4b69-8cc7-edf7af357805 tempest-ServersAdminNegativeTestJSON-496905829 tempest-ServersAdminNegativeTestJSON-496905829-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:50:10.987655 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-2350e5d9-f3b1-4b69-8cc7-edf7af357805 tempest-ServersAdminNegativeTestJSON-496905829 tempest-ServersAdminNegativeTestJSON-496905829-project-admin] 10.222.0.46 "POST /compute/v2.1/servers/6d487317-4968-4a06-ad7b-4484e8d50f10/action" status: 400 len: 144 microversion: 2.1 time: 0.011258 Jan 15 20:50:10.990241 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 329/603] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:50:10 2022] POST /compute/v2.1/servers/6d487317-4968-4a06-ad7b-4484e8d50f10/action => generated 144 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 15 20:50:11.002282 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7ffdb7e6-631c-487f-b49a-2b115e866bb5 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:11.008099 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-0016087a-1f4c-48cd-9780-7b4dd41478ef tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Getting quotas for project e8cfe33be708428abef52f5e8e25621b. Resources: {'server_group_members'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:50:11.008228 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-7ffdb7e6-631c-487f-b49a-2b115e866bb5 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] [instance: 770bfdbf-2ac6-4ab9-b2e3-f9e43ae88af6] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:11.017435 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7ffdb7e6-631c-487f-b49a-2b115e866bb5 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:11.024280 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-0016087a-1f4c-48cd-9780-7b4dd41478ef tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Getting quotas for user bc38f86758f9416b9e7f6915de0359d6 and project e8cfe33be708428abef52f5e8e25621b. Resources: {'server_group_members'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:50:11.030353 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7ffdb7e6-631c-487f-b49a-2b115e866bb5 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:11.034198 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7ffdb7e6-631c-487f-b49a-2b115e866bb5 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:11.034811 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7ffdb7e6-631c-487f-b49a-2b115e866bb5 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:11.076467 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-0016087a-1f4c-48cd-9780-7b4dd41478ef tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] [instance: eb4f55a3-96ef-4194-8506-e430b262c1f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=3934550f-0131-4bd3-890b-edbaf4ccac0e,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129365) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 20:50:11.154323 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-0016087a-1f4c-48cd-9780-7b4dd41478ef tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Getting quotas for project e8cfe33be708428abef52f5e8e25621b. Resources: {'server_group_members'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:50:11.160482 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-0016087a-1f4c-48cd-9780-7b4dd41478ef tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Getting quotas for user bc38f86758f9416b9e7f6915de0359d6 and project e8cfe33be708428abef52f5e8e25621b. Resources: {'server_group_members'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:50:11.232709 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-0016087a-1f4c-48cd-9780-7b4dd41478ef tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Getting quotas for project e8cfe33be708428abef52f5e8e25621b. Resources: {'server_group_members'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:50:11.240018 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-0016087a-1f4c-48cd-9780-7b4dd41478ef tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Getting quotas for user bc38f86758f9416b9e7f6915de0359d6 and project e8cfe33be708428abef52f5e8e25621b. Resources: {'server_group_members'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:50:11.278844 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-0016087a-1f4c-48cd-9780-7b4dd41478ef tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.254435 Jan 15 20:50:11.282468 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 275/604] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 20:50:10 2022] POST /compute/v2.1/servers => generated 32 bytes in 1256 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Jan 15 20:50:11.284235 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-27ed0283-bb8c-4d69-8cc7-11eaf3ab8d97 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:50:11.285229 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-27ed0283-bb8c-4d69-8cc7-11eaf3ab8d97 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 98d0ca37-0175-44e2-8a1d-965cdc517daf] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:11.294980 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-27ed0283-bb8c-4d69-8cc7-11eaf3ab8d97 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:11.295708 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-27ed0283-bb8c-4d69-8cc7-11eaf3ab8d97 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:11.296482 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-27ed0283-bb8c-4d69-8cc7-11eaf3ab8d97 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:11.297631 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-27ed0283-bb8c-4d69-8cc7-11eaf3ab8d97 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:11.347623 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-27ed0283-bb8c-4d69-8cc7-11eaf3ab8d97 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action" status: 200 len: 32634 microversion: 2.1 time: 0.066313 Jan 15 20:50:11.349103 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 276/605] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:50:11 2022] POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action => generated 32634 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:50:11.370934 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a037852d-fc5f-44b6-9553-2c35caa8294d tempest-QuotasAdminNegativeTest-2031557919 tempest-QuotasAdminNegativeTest-2031557919-project-admin] Calling method '.version_select at 0x7f30c968eee0>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:11.518116 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a037852d-fc5f-44b6-9553-2c35caa8294d tempest-QuotasAdminNegativeTest-2031557919 tempest-QuotasAdminNegativeTest-2031557919-project-admin] 10.222.0.46 "GET /compute/v2.1/os-quota-sets/80320b43ceca400cbbbc96ae80c4b845" status: 200 len: 371 microversion: 2.1 time: 0.166568 Jan 15 20:50:11.524680 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 277/606] 10.222.0.46 () {58 vars in 1241 bytes} [Sat Jan 15 20:50:11 2022] GET /compute/v2.1/os-quota-sets/80320b43ceca400cbbbc96ae80c4b845 => generated 371 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:50:11.530030 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-97e5bbae-f465-4f2b-871f-efe89043b80c tempest-ServersAdminNegativeTestJSON-496905829 tempest-ServersAdminNegativeTestJSON-496905829-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:50:11.532448 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-97e5bbae-f465-4f2b-871f-efe89043b80c tempest-ServersAdminNegativeTestJSON-496905829 tempest-ServersAdminNegativeTestJSON-496905829-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:50:11.533615 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-97e5bbae-f465-4f2b-871f-efe89043b80c tempest-ServersAdminNegativeTestJSON-496905829 tempest-ServersAdminNegativeTestJSON-496905829-project-admin] 10.222.0.46 "POST /compute/v2.1/servers/6d487317-4968-4a06-ad7b-4484e8d50f10/action" status: 400 len: 120 microversion: 2.1 time: 0.011942 Jan 15 20:50:11.534143 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 278/607] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:50:11 2022] POST /compute/v2.1/servers/6d487317-4968-4a06-ad7b-4484e8d50f10/action => generated 120 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 15 20:50:11.541540 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b3e1b744-d43e-45ec-a876-e70b0644691b tempest-QuotasAdminTestV257-148047986 tempest-QuotasAdminTestV257-148047986-project-admin] Action: 'update', calling method: .version_select at 0x7f30c968e310>, body: {"quota_set": {"ram": "2048"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:50:11.547399 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-sets:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:50:11.547399 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:50:11.644012 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b3e1b744-d43e-45ec-a876-e70b0644691b tempest-QuotasAdminTestV257-148047986 tempest-QuotasAdminTestV257-148047986-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:11.644384 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b3e1b744-d43e-45ec-a876-e70b0644691b tempest-QuotasAdminTestV257-148047986 tempest-QuotasAdminTestV257-148047986-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:11.645361 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b3e1b744-d43e-45ec-a876-e70b0644691b tempest-QuotasAdminTestV257-148047986 tempest-QuotasAdminTestV257-148047986-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:11.646020 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b3e1b744-d43e-45ec-a876-e70b0644691b tempest-QuotasAdminTestV257-148047986 tempest-QuotasAdminTestV257-148047986-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:11.708803 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b3e1b744-d43e-45ec-a876-e70b0644691b tempest-QuotasAdminTestV257-148047986 tempest-QuotasAdminTestV257-148047986-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:11.709442 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b3e1b744-d43e-45ec-a876-e70b0644691b tempest-QuotasAdminTestV257-148047986 tempest-QuotasAdminTestV257-148047986-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:11.710122 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b3e1b744-d43e-45ec-a876-e70b0644691b tempest-QuotasAdminTestV257-148047986 tempest-QuotasAdminTestV257-148047986-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:11.710562 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b3e1b744-d43e-45ec-a876-e70b0644691b tempest-QuotasAdminTestV257-148047986 tempest-QuotasAdminTestV257-148047986-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:11.817600 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-7ffdb7e6-631c-487f-b49a-2b115e866bb5 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:11.829810 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-7ffdb7e6-631c-487f-b49a-2b115e866bb5 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:11.844105 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-7ffdb7e6-631c-487f-b49a-2b115e866bb5 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:11.847237 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7ffdb7e6-631c-487f-b49a-2b115e866bb5 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] 10.222.0.46 "GET /compute/v2.1/servers/770bfdbf-2ac6-4ab9-b2e3-f9e43ae88af6" status: 200 len: 1566 microversion: 2.25 time: 0.855699 Jan 15 20:50:11.853973 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 330/608] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:50:10 2022] GET /compute/v2.1/servers/770bfdbf-2ac6-4ab9-b2e3-f9e43ae88af6 => generated 1566 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:50:11.860468 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e61350bd-d297-4a67-bd89-a332d30354c5 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:11.871097 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b3e1b744-d43e-45ec-a876-e70b0644691b tempest-QuotasAdminTestV257-148047986 tempest-QuotasAdminTestV257-148047986-project-admin] 10.222.0.46 "PUT /compute/v2.1/os-quota-sets/eda920f39c414b7abd01ea16664708de?user_id=e1f0fd19ee5e451894d796646cfdf219" status: 200 len: 148 microversion: 2.57 time: 0.335470 Jan 15 20:50:11.871876 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 279/609] 10.222.0.46 () {62 vars in 1383 bytes} [Sat Jan 15 20:50:11 2022] PUT /compute/v2.1/os-quota-sets/eda920f39c414b7abd01ea16664708de?user_id=e1f0fd19ee5e451894d796646cfdf219 => generated 148 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:50:11.884617 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-fce14a44-b993-45c4-95f3-5f370ee647a5 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:11.885718 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:50:11.885718 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:50:11.886010 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-fce14a44-b993-45c4-95f3-5f370ee647a5 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: e3fa2f27-df7a-4ecb-9bba-c970e3e7d106] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:11.893277 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-e61350bd-d297-4a67-bd89-a332d30354c5 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bc38f86758f9416b9e7f6915de0359d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8cfe33be708428abef52f5e8e25621b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:11.894106 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e61350bd-d297-4a67-bd89-a332d30354c5 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Searching by: {'deleted': False, 'project_id': 'e8cfe33be708428abef52f5e8e25621b'} {{(pid=129366) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 15 20:50:11.923840 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fce14a44-b993-45c4-95f3-5f370ee647a5 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:11.924577 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fce14a44-b993-45c4-95f3-5f370ee647a5 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:11.925626 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fce14a44-b993-45c4-95f3-5f370ee647a5 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:11.926422 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fce14a44-b993-45c4-95f3-5f370ee647a5 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:11.929016 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e61350bd-d297-4a67-bd89-a332d30354c5 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:11.929472 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e61350bd-d297-4a67-bd89-a332d30354c5 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:11.938712 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e61350bd-d297-4a67-bd89-a332d30354c5 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:11.939159 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e61350bd-d297-4a67-bd89-a332d30354c5 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:12.101331 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.multi_cell_list [None req-e61350bd-d297-4a67-bd89-a332d30354c5 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=129366) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jan 15 20:50:12.252381 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e61350bd-d297-4a67-bd89-a332d30354c5 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] 10.222.0.46 "GET /compute/v2.1/servers" status: 200 len: 1003 microversion: 2.1 time: 0.396836 Jan 15 20:50:12.253160 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 331/610] 10.222.0.46 () {58 vars in 1124 bytes} [Sat Jan 15 20:50:11 2022] GET /compute/v2.1/servers => generated 1003 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:12.260916 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d7da10ba-50a8-4fa2-984d-fab471120b7f tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:12.262152 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-d7da10ba-50a8-4fa2-984d-fab471120b7f tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] [instance: e3b7a713-3f0d-43e2-b466-6637bc567256] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:12.269308 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d7da10ba-50a8-4fa2-984d-fab471120b7f tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:12.270019 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d7da10ba-50a8-4fa2-984d-fab471120b7f tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:12.270975 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d7da10ba-50a8-4fa2-984d-fab471120b7f tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:12.271553 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d7da10ba-50a8-4fa2-984d-fab471120b7f tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:12.308166 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-fce14a44-b993-45c4-95f3-5f370ee647a5 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:12.322604 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-fce14a44-b993-45c4-95f3-5f370ee647a5 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/e3fa2f27-df7a-4ecb-9bba-c970e3e7d106" status: 200 len: 1313 microversion: 2.1 time: 0.443807 Jan 15 20:50:12.323843 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 280/611] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:11 2022] GET /compute/v2.1/servers/e3fa2f27-df7a-4ecb-9bba-c970e3e7d106 => generated 1313 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:12.328512 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8f18d753-c077-494a-bc58-723bfc19ac39 tempest-QuotasAdminNegativeTest-2031557919 tempest-QuotasAdminNegativeTest-2031557919-project-admin] Action: 'update', calling method: .version_select at 0x7f30c96c6430>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:50:12.332585 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-sets:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:50:12.332585 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:50:12.421576 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-d7da10ba-50a8-4fa2-984d-fab471120b7f tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d4a57cfaa145009ba9cc8f21d9e8ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4a26c8edac44c8b26fd4e43813412d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:12.435274 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d7da10ba-50a8-4fa2-984d-fab471120b7f tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] 10.222.0.46 "GET /compute/v2.1/servers/e3b7a713-3f0d-43e2-b466-6637bc567256" status: 200 len: 1272 microversion: 2.1 time: 0.180842 Jan 15 20:50:12.445231 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 332/612] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:12 2022] GET /compute/v2.1/servers/e3b7a713-3f0d-43e2-b466-6637bc567256 => generated 1272 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:12.462181 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8f18d753-c077-494a-bc58-723bfc19ac39 tempest-QuotasAdminNegativeTest-2031557919 tempest-QuotasAdminNegativeTest-2031557919-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:12.463645 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8f18d753-c077-494a-bc58-723bfc19ac39 tempest-QuotasAdminNegativeTest-2031557919 tempest-QuotasAdminNegativeTest-2031557919-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:12.466132 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-71b5bdcb-23e0-4ef6-880c-6a5e41c19b0d tempest-ServersAdminNegativeTestJSON-496905829 tempest-ServersAdminNegativeTestJSON-496905829-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:50:12.468334 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8f18d753-c077-494a-bc58-723bfc19ac39 tempest-QuotasAdminNegativeTest-2031557919 tempest-QuotasAdminNegativeTest-2031557919-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:12.468981 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8f18d753-c077-494a-bc58-723bfc19ac39 tempest-QuotasAdminNegativeTest-2031557919 tempest-QuotasAdminNegativeTest-2031557919-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:12.472620 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-71b5bdcb-23e0-4ef6-880c-6a5e41c19b0d tempest-ServersAdminNegativeTestJSON-496905829 tempest-ServersAdminNegativeTestJSON-496905829-project-admin] Failed to fetch instance by id 999 {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2871}} Jan 15 20:50:12.473726 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-71b5bdcb-23e0-4ef6-880c-6a5e41c19b0d tempest-ServersAdminNegativeTestJSON-496905829 tempest-ServersAdminNegativeTestJSON-496905829-project-admin] HTTP exception thrown: Instance 999 could not be found. Jan 15 20:50:12.475069 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-71b5bdcb-23e0-4ef6-880c-6a5e41c19b0d tempest-ServersAdminNegativeTestJSON-496905829 tempest-ServersAdminNegativeTestJSON-496905829-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:50:12.476033 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-71b5bdcb-23e0-4ef6-880c-6a5e41c19b0d tempest-ServersAdminNegativeTestJSON-496905829 tempest-ServersAdminNegativeTestJSON-496905829-project-admin] 10.222.0.46 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.034408 Jan 15 20:50:12.479482 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 333/613] 10.222.0.46 () {60 vars in 1178 bytes} [Sat Jan 15 20:50:12 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jan 15 20:50:12.489362 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-aae93b9f-1dc9-44a9-9989-cd4707ed5f0e req-fc329789-c7ed-439f-b460-93860e08bdd7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b191ed6c-040a-4702-8e15-86272f9d1847", "tag": "bbe8394e-08fc-445b-a162-0e40259702ca"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:50:12.490922 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:50:12.490922 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:50:12.512593 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-aae93b9f-1dc9-44a9-9989-cd4707ed5f0e req-fc329789-c7ed-439f-b460-93860e08bdd7 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:12.514196 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-aae93b9f-1dc9-44a9-9989-cd4707ed5f0e req-fc329789-c7ed-439f-b460-93860e08bdd7 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:12.536442 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-aae93b9f-1dc9-44a9-9989-cd4707ed5f0e req-fc329789-c7ed-439f-b460-93860e08bdd7 service nova] Creating event network-changed:bbe8394e-08fc-445b-a162-0e40259702ca for instance b191ed6c-040a-4702-8e15-86272f9d1847 on nch2-master-1 Jan 15 20:50:12.542562 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-aae93b9f-1dc9-44a9-9989-cd4707ed5f0e req-fc329789-c7ed-439f-b460-93860e08bdd7 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061519 Jan 15 20:50:12.544891 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 334/614] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:50:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:50:12.556817 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-72b3c041-ffa8-4a2c-86f4-f6df80764f61 tempest-QuotasAdminTestV257-148047986 tempest-QuotasAdminTestV257-148047986-project-admin] Calling method '.version_select at 0x7f30c971bc10>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:12.590634 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-8f18d753-c077-494a-bc58-723bfc19ac39 tempest-QuotasAdminNegativeTest-2031557919 tempest-QuotasAdminNegativeTest-2031557919-project-admin] 10.222.0.46 "PUT /compute/v2.1/os-quota-sets/80320b43ceca400cbbbc96ae80c4b845" status: 200 len: 325 microversion: 2.1 time: 0.263892 Jan 15 20:50:12.602629 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 281/615] 10.222.0.46 () {60 vars in 1261 bytes} [Sat Jan 15 20:50:12 2022] PUT /compute/v2.1/os-quota-sets/80320b43ceca400cbbbc96ae80c4b845 => generated 325 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:50:12.608872 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3bc2bb9e-0e85-4d78-ac2b-4236c83d649e tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:12.611603 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-3bc2bb9e-0e85-4d78-ac2b-4236c83d649e tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] [instance: eb4f55a3-96ef-4194-8506-e430b262c1f0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:12.628990 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3bc2bb9e-0e85-4d78-ac2b-4236c83d649e tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:12.632155 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3bc2bb9e-0e85-4d78-ac2b-4236c83d649e tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:12.638184 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3bc2bb9e-0e85-4d78-ac2b-4236c83d649e tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:12.638750 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3bc2bb9e-0e85-4d78-ac2b-4236c83d649e tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:12.724811 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-72b3c041-ffa8-4a2c-86f4-f6df80764f61 tempest-QuotasAdminTestV257-148047986 tempest-QuotasAdminTestV257-148047986-project-admin] 10.222.0.46 "GET /compute/v2.1/os-quota-sets/eda920f39c414b7abd01ea16664708de?user_id=e1f0fd19ee5e451894d796646cfdf219" status: 200 len: 190 microversion: 2.57 time: 0.176011 Jan 15 20:50:12.725770 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 335/616] 10.222.0.46 () {60 vars in 1363 bytes} [Sat Jan 15 20:50:12 2022] GET /compute/v2.1/os-quota-sets/eda920f39c414b7abd01ea16664708de?user_id=e1f0fd19ee5e451894d796646cfdf219 => generated 190 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:50:12.740570 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4016dad0-4075-44f0-b2e9-127f958f9ac4 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:50:12.743021 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-4016dad0-4075-44f0-b2e9-127f958f9ac4 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 98d0ca37-0175-44e2-8a1d-965cdc517daf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:12.757915 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4016dad0-4075-44f0-b2e9-127f958f9ac4 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:12.758380 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4016dad0-4075-44f0-b2e9-127f958f9ac4 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:12.769906 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4016dad0-4075-44f0-b2e9-127f958f9ac4 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:12.771663 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4016dad0-4075-44f0-b2e9-127f958f9ac4 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:12.814500 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-3bc2bb9e-0e85-4d78-ac2b-4236c83d649e tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc38f86758f9416b9e7f6915de0359d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8cfe33be708428abef52f5e8e25621b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:12.824239 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3bc2bb9e-0e85-4d78-ac2b-4236c83d649e tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] 10.222.0.46 "GET /compute/v2.1/servers/eb4f55a3-96ef-4194-8506-e430b262c1f0" status: 200 len: 1215 microversion: 2.1 time: 0.230047 Jan 15 20:50:12.830699 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 282/617] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:12 2022] GET /compute/v2.1/servers/eb4f55a3-96ef-4194-8506-e430b262c1f0 => generated 1215 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:12.842007 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-01bb9ece-1255-420b-92df-b8c68505a3d7 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:12.844898 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-4016dad0-4075-44f0-b2e9-127f958f9ac4 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action" status: 200 len: 32634 microversion: 2.1 time: 0.115491 Jan 15 20:50:12.846049 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-01bb9ece-1255-420b-92df-b8c68505a3d7 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] [instance: a5c419d5-7255-4ab1-8ada-6bb413faa169] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:12.846374 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 336/618] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:50:12 2022] POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action => generated 32634 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:50:12.856173 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-f5813818-dde7-4647-b0c2-a31c4b65b9e9 req-c2d80b0c-2fb4-4f3e-a1e5-2d5521c1ab12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3fa2f27-df7a-4ecb-9bba-c970e3e7d106", "name": "network-vif-plugged", "status": "completed", "tag": "3c8e5ec9-ee60-4c8e-b5ce-d77245088af1"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:50:12.857334 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-01bb9ece-1255-420b-92df-b8c68505a3d7 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:12.858074 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-01bb9ece-1255-420b-92df-b8c68505a3d7 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:12.858200 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:50:12.858200 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:50:12.869958 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-01bb9ece-1255-420b-92df-b8c68505a3d7 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:12.871122 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-01bb9ece-1255-420b-92df-b8c68505a3d7 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:12.875074 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-f5813818-dde7-4647-b0c2-a31c4b65b9e9 req-c2d80b0c-2fb4-4f3e-a1e5-2d5521c1ab12 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:12.875523 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-f5813818-dde7-4647-b0c2-a31c4b65b9e9 req-c2d80b0c-2fb4-4f3e-a1e5-2d5521c1ab12 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:12.944649 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-01bb9ece-1255-420b-92df-b8c68505a3d7 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] [instance: a5c419d5-7255-4ab1-8ada-6bb413faa169] Going to try to terminate instance {{(pid=129365) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 20:50:13.136928 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-01bb9ece-1255-420b-92df-b8c68505a3d7 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] 10.222.0.46 "DELETE /compute/v2.1/servers/a5c419d5-7255-4ab1-8ada-6bb413faa169" status: 204 len: 0 microversion: 2.1 time: 0.303571 Jan 15 20:50:13.137539 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 283/619] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 20:50:12 2022] DELETE /compute/v2.1/servers/a5c419d5-7255-4ab1-8ada-6bb413faa169 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 20:50:13.138816 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-f5813818-dde7-4647-b0c2-a31c4b65b9e9 req-c2d80b0c-2fb4-4f3e-a1e5-2d5521c1ab12 service nova] Creating event network-vif-plugged:3c8e5ec9-ee60-4c8e-b5ce-d77245088af1 for instance e3fa2f27-df7a-4ecb-9bba-c970e3e7d106 on nch1-master-1 Jan 15 20:50:13.145069 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-f5813818-dde7-4647-b0c2-a31c4b65b9e9 req-c2d80b0c-2fb4-4f3e-a1e5-2d5521c1ab12 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.296509 Jan 15 20:50:13.148168 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f8d1fba0-869a-42ee-863b-5e6bb8e7402f tempest-QuotasAdminNegativeTest-337910980 tempest-QuotasAdminNegativeTest-337910980-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-449301241", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:50:13.148681 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 337/620] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:50:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:50:13.173964 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7dbbd5e5-795a-4f8c-9c35-9213591c9936 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:13.180195 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-7dbbd5e5-795a-4f8c-9c35-9213591c9936 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] [instance: 770bfdbf-2ac6-4ab9-b2e3-f9e43ae88af6] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:13.201335 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7dbbd5e5-795a-4f8c-9c35-9213591c9936 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:13.202403 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7dbbd5e5-795a-4f8c-9c35-9213591c9936 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:13.203641 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7dbbd5e5-795a-4f8c-9c35-9213591c9936 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:13.206226 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7dbbd5e5-795a-4f8c-9c35-9213591c9936 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:13.263080 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.network.neutron [None req-f8d1fba0-869a-42ee-863b-5e6bb8e7402f tempest-QuotasAdminNegativeTest-337910980 tempest-QuotasAdminNegativeTest-337910980-project] validate_networks() for None {{(pid=129365) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 20:50:13.784260 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-f8d1fba0-869a-42ee-863b-5e6bb8e7402f tempest-QuotasAdminNegativeTest-337910980 tempest-QuotasAdminNegativeTest-337910980-project] Flavor limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 20:50:13.785103 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-f8d1fba0-869a-42ee-863b-5e6bb8e7402f tempest-QuotasAdminNegativeTest-337910980 tempest-QuotasAdminNegativeTest-337910980-project] Image limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 20:50:13.785799 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-f8d1fba0-869a-42ee-863b-5e6bb8e7402f tempest-QuotasAdminNegativeTest-337910980 tempest-QuotasAdminNegativeTest-337910980-project] Flavor pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 20:50:13.786405 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-f8d1fba0-869a-42ee-863b-5e6bb8e7402f tempest-QuotasAdminNegativeTest-337910980 tempest-QuotasAdminNegativeTest-337910980-project] Image pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 20:50:13.787039 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-f8d1fba0-869a-42ee-863b-5e6bb8e7402f tempest-QuotasAdminNegativeTest-337910980 tempest-QuotasAdminNegativeTest-337910980-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 20:50:13.803384 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f8d1fba0-869a-42ee-863b-5e6bb8e7402f tempest-QuotasAdminNegativeTest-337910980 tempest-QuotasAdminNegativeTest-337910980-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:13.804139 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f8d1fba0-869a-42ee-863b-5e6bb8e7402f tempest-QuotasAdminNegativeTest-337910980 tempest-QuotasAdminNegativeTest-337910980-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:13.805166 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f8d1fba0-869a-42ee-863b-5e6bb8e7402f tempest-QuotasAdminNegativeTest-337910980 tempest-QuotasAdminNegativeTest-337910980-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:13.805815 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f8d1fba0-869a-42ee-863b-5e6bb8e7402f tempest-QuotasAdminNegativeTest-337910980 tempest-QuotasAdminNegativeTest-337910980-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:13.832106 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-f8d1fba0-869a-42ee-863b-5e6bb8e7402f tempest-QuotasAdminNegativeTest-337910980 tempest-QuotasAdminNegativeTest-337910980-project] Getting quotas for project 80320b43ceca400cbbbc96ae80c4b845. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:50:13.839033 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-f8d1fba0-869a-42ee-863b-5e6bb8e7402f tempest-QuotasAdminNegativeTest-337910980 tempest-QuotasAdminNegativeTest-337910980-project] Getting quotas for user 7d3ebea4a4d04b878f01e3ebba2504f2 and project 80320b43ceca400cbbbc96ae80c4b845. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:50:13.858630 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.utils [None req-f8d1fba0-869a-42ee-863b-5e6bb8e7402f tempest-QuotasAdminNegativeTest-337910980 tempest-QuotasAdminNegativeTest-337910980-project] ram quota exceeded for 80320b43ceca400cbbbc96ae80c4b845, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=129365) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1171}} Jan 15 20:50:13.859622 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-f8d1fba0-869a-42ee-863b-5e6bb8e7402f tempest-QuotasAdminNegativeTest-337910980 tempest-QuotasAdminNegativeTest-337910980-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jan 15 20:50:13.861068 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f8d1fba0-869a-42ee-863b-5e6bb8e7402f tempest-QuotasAdminNegativeTest-337910980 tempest-QuotasAdminNegativeTest-337910980-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:50:13.862925 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f8d1fba0-869a-42ee-863b-5e6bb8e7402f tempest-QuotasAdminNegativeTest-337910980 tempest-QuotasAdminNegativeTest-337910980-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.720777 Jan 15 20:50:13.867697 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 284/621] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 20:50:13 2022] POST /compute/v2.1/servers => generated 110 bytes in 729 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:50:13.874079 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-957a7e95-5fa2-407b-84bd-1c3cedc73a2c tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:13.875238 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-957a7e95-5fa2-407b-84bd-1c3cedc73a2c tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] [instance: a5c419d5-7255-4ab1-8ada-6bb413faa169] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:13.882664 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-957a7e95-5fa2-407b-84bd-1c3cedc73a2c tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:13.883483 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-957a7e95-5fa2-407b-84bd-1c3cedc73a2c tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:13.885450 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-957a7e95-5fa2-407b-84bd-1c3cedc73a2c tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:13.886387 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-957a7e95-5fa2-407b-84bd-1c3cedc73a2c tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:13.929451 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-7dbbd5e5-795a-4f8c-9c35-9213591c9936 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:13.940792 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-7dbbd5e5-795a-4f8c-9c35-9213591c9936 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:13.942764 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-7dbbd5e5-795a-4f8c-9c35-9213591c9936 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:13.944208 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7dbbd5e5-795a-4f8c-9c35-9213591c9936 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] 10.222.0.46 "GET /compute/v2.1/servers/770bfdbf-2ac6-4ab9-b2e3-f9e43ae88af6" status: 200 len: 1556 microversion: 2.25 time: 0.793411 Jan 15 20:50:13.945308 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 338/622] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:50:13 2022] GET /compute/v2.1/servers/770bfdbf-2ac6-4ab9-b2e3-f9e43ae88af6 => generated 1556 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:50:13.953748 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d1074a61-f344-4a05-9a99-66f2dab2c70a tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:13.954811 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-d1074a61-f344-4a05-9a99-66f2dab2c70a tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: e3fa2f27-df7a-4ecb-9bba-c970e3e7d106] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:13.964525 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d1074a61-f344-4a05-9a99-66f2dab2c70a tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:13.965337 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d1074a61-f344-4a05-9a99-66f2dab2c70a tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:13.966434 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d1074a61-f344-4a05-9a99-66f2dab2c70a tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:13.967076 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d1074a61-f344-4a05-9a99-66f2dab2c70a tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:14.210008 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-957a7e95-5fa2-407b-84bd-1c3cedc73a2c tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd06a1f6896564bb58b457d0642f8302c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89aabae1afe4a5a88ed97e87b5266ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:14.220036 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-957a7e95-5fa2-407b-84bd-1c3cedc73a2c tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] 10.222.0.46 "GET /compute/v2.1/servers/a5c419d5-7255-4ab1-8ada-6bb413faa169" status: 200 len: 1467 microversion: 2.1 time: 0.350118 Jan 15 20:50:14.221061 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 285/623] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:13 2022] GET /compute/v2.1/servers/a5c419d5-7255-4ab1-8ada-6bb413faa169 => generated 1467 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:14.226324 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3ca6bd29-65c3-453a-886f-3ad2db19efa9 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:14.227028 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-3ca6bd29-65c3-453a-886f-3ad2db19efa9 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] [instance: e3b7a713-3f0d-43e2-b466-6637bc567256] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:14.233755 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3ca6bd29-65c3-453a-886f-3ad2db19efa9 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:14.234216 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3ca6bd29-65c3-453a-886f-3ad2db19efa9 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:14.235257 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3ca6bd29-65c3-453a-886f-3ad2db19efa9 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:14.235641 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3ca6bd29-65c3-453a-886f-3ad2db19efa9 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:14.277715 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-d1074a61-f344-4a05-9a99-66f2dab2c70a tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:14.285871 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d1074a61-f344-4a05-9a99-66f2dab2c70a tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/e3fa2f27-df7a-4ecb-9bba-c970e3e7d106" status: 200 len: 1313 microversion: 2.1 time: 0.339134 Jan 15 20:50:14.286659 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 339/624] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:13 2022] GET /compute/v2.1/servers/e3fa2f27-df7a-4ecb-9bba-c970e3e7d106 => generated 1313 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:14.292477 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-6a2afa99-c136-4f24-aca0-fe6f9d4733ad tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:14.293326 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-6a2afa99-c136-4f24-aca0-fe6f9d4733ad tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] [instance: eb4f55a3-96ef-4194-8506-e430b262c1f0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:14.302768 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6a2afa99-c136-4f24-aca0-fe6f9d4733ad tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:14.303321 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6a2afa99-c136-4f24-aca0-fe6f9d4733ad tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:14.304206 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6a2afa99-c136-4f24-aca0-fe6f9d4733ad tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:14.304719 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6a2afa99-c136-4f24-aca0-fe6f9d4733ad tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:14.408659 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-6a2afa99-c136-4f24-aca0-fe6f9d4733ad tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc38f86758f9416b9e7f6915de0359d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8cfe33be708428abef52f5e8e25621b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:14.424858 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-6a2afa99-c136-4f24-aca0-fe6f9d4733ad tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] 10.222.0.46 "GET /compute/v2.1/servers/eb4f55a3-96ef-4194-8506-e430b262c1f0" status: 200 len: 1277 microversion: 2.1 time: 0.136858 Jan 15 20:50:14.437803 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 340/625] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:14 2022] GET /compute/v2.1/servers/eb4f55a3-96ef-4194-8506-e430b262c1f0 => generated 1277 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:14.450504 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e9c86e78-8adf-4c27-ab14-c8e8e13192b0 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:50:14.451747 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e9c86e78-8adf-4c27-ab14-c8e8e13192b0 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 98d0ca37-0175-44e2-8a1d-965cdc517daf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:14.458665 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e9c86e78-8adf-4c27-ab14-c8e8e13192b0 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:14.459336 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e9c86e78-8adf-4c27-ab14-c8e8e13192b0 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:14.460282 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e9c86e78-8adf-4c27-ab14-c8e8e13192b0 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:14.460913 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e9c86e78-8adf-4c27-ab14-c8e8e13192b0 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:14.538628 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e9c86e78-8adf-4c27-ab14-c8e8e13192b0 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action" status: 200 len: 32634 microversion: 2.1 time: 0.098463 Jan 15 20:50:14.546376 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 341/626] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:50:14 2022] POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action => generated 32634 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:50:14.556096 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a13e9e6b-74aa-448d-8155-9eee02b56a7d tempest-QuotasAdminNegativeTest-2031557919 tempest-QuotasAdminNegativeTest-2031557919-project-admin] Action: 'update', calling method: .version_select at 0x7f30c967d160>, body: {"quota_set": {"ram": 51200}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:50:14.559185 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-sets:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:50:14.559185 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:50:14.562454 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-3ca6bd29-65c3-453a-886f-3ad2db19efa9 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d4a57cfaa145009ba9cc8f21d9e8ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4a26c8edac44c8b26fd4e43813412d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:14.610387 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3ca6bd29-65c3-453a-886f-3ad2db19efa9 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] 10.222.0.46 "GET /compute/v2.1/servers/e3b7a713-3f0d-43e2-b466-6637bc567256" status: 200 len: 1314 microversion: 2.1 time: 0.388025 Jan 15 20:50:14.615615 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 286/627] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:14 2022] GET /compute/v2.1/servers/e3b7a713-3f0d-43e2-b466-6637bc567256 => generated 1314 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:14.635406 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-51f76a7b-5094-4048-920d-5d5dc1170f2b tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Calling method '.version_select at 0x7f30c954a940>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:14.639352 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-migrations:index": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:50:14.639352 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:50:14.645847 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-51f76a7b-5094-4048-920d-5d5dc1170f2b tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:14.650324 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-51f76a7b-5094-4048-920d-5d5dc1170f2b tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:14.679820 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-51f76a7b-5094-4048-920d-5d5dc1170f2b tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] 10.222.0.46 "GET /compute/v2.1/os-migrations" status: 200 len: 860 microversion: 2.25 time: 0.046710 Jan 15 20:50:14.682757 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 287/628] 10.222.0.46 () {60 vars in 1183 bytes} [Sat Jan 15 20:50:14 2022] GET /compute/v2.1/os-migrations => generated 860 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:50:14.704140 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-0e4aabaa-aca4-46f6-8eb7-f827511bbafa tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:14.706546 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-0e4aabaa-aca4-46f6-8eb7-f827511bbafa tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] [instance: 770bfdbf-2ac6-4ab9-b2e3-f9e43ae88af6] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:14.733215 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0e4aabaa-aca4-46f6-8eb7-f827511bbafa tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:14.734030 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0e4aabaa-aca4-46f6-8eb7-f827511bbafa tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:14.734957 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0e4aabaa-aca4-46f6-8eb7-f827511bbafa tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:14.736107 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0e4aabaa-aca4-46f6-8eb7-f827511bbafa tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:14.895742 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a13e9e6b-74aa-448d-8155-9eee02b56a7d tempest-QuotasAdminNegativeTest-2031557919 tempest-QuotasAdminNegativeTest-2031557919-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:14.896194 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a13e9e6b-74aa-448d-8155-9eee02b56a7d tempest-QuotasAdminNegativeTest-2031557919 tempest-QuotasAdminNegativeTest-2031557919-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:14.897084 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a13e9e6b-74aa-448d-8155-9eee02b56a7d tempest-QuotasAdminNegativeTest-2031557919 tempest-QuotasAdminNegativeTest-2031557919-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:14.897520 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a13e9e6b-74aa-448d-8155-9eee02b56a7d tempest-QuotasAdminNegativeTest-2031557919 tempest-QuotasAdminNegativeTest-2031557919-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:14.992165 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a13e9e6b-74aa-448d-8155-9eee02b56a7d tempest-QuotasAdminNegativeTest-2031557919 tempest-QuotasAdminNegativeTest-2031557919-project-admin] 10.222.0.46 "PUT /compute/v2.1/os-quota-sets/80320b43ceca400cbbbc96ae80c4b845" status: 200 len: 329 microversion: 2.1 time: 0.444261 Jan 15 20:50:14.995471 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 342/629] 10.222.0.46 () {60 vars in 1261 bytes} [Sat Jan 15 20:50:14 2022] PUT /compute/v2.1/os-quota-sets/80320b43ceca400cbbbc96ae80c4b845 => generated 329 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:50:15.001043 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-d26fe760-433d-4cd2-b79d-2f83489fcc15 req-f7e1c187-11a4-4adb-b197-503a6e179f7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3b7a713-3f0d-43e2-b466-6637bc567256", "tag": "b6f66c62-4ffd-4b3d-b12d-4d0ef6d8d0d4"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:50:15.006857 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:50:15.006857 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:50:15.017600 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-d26fe760-433d-4cd2-b79d-2f83489fcc15 req-f7e1c187-11a4-4adb-b197-503a6e179f7c service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:15.018356 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-d26fe760-433d-4cd2-b79d-2f83489fcc15 req-f7e1c187-11a4-4adb-b197-503a6e179f7c service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:15.032530 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-d26fe760-433d-4cd2-b79d-2f83489fcc15 req-f7e1c187-11a4-4adb-b197-503a6e179f7c service nova] Creating event network-changed:b6f66c62-4ffd-4b3d-b12d-4d0ef6d8d0d4 for instance e3b7a713-3f0d-43e2-b466-6637bc567256 on nch1-master-1 Jan 15 20:50:15.042512 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-d26fe760-433d-4cd2-b79d-2f83489fcc15 req-f7e1c187-11a4-4adb-b197-503a6e179f7c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043446 Jan 15 20:50:15.043658 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 343/630] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:50:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:50:15.051594 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a7d97b09-ffc6-4acd-b39b-a81d2b51c62d tempest-QuotasAdminNegativeTest-337910980 tempest-QuotasAdminNegativeTest-337910980-project] Action: 'update', calling method: .version_select at 0x7f30c9c08dc0>, body: {"quota_set": {"ram": 0}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:50:15.054273 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-sets:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:50:15.054273 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:50:15.055867 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-a7d97b09-ffc6-4acd-b39b-a81d2b51c62d tempest-QuotasAdminNegativeTest-337910980 tempest-QuotasAdminNegativeTest-337910980-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': '7d3ebea4a4d04b878f01e3ebba2504f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80320b43ceca400cbbbc96ae80c4b845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:15.057285 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a7d97b09-ffc6-4acd-b39b-a81d2b51c62d tempest-QuotasAdminNegativeTest-337910980 tempest-QuotasAdminNegativeTest-337910980-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:50:15.058354 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a7d97b09-ffc6-4acd-b39b-a81d2b51c62d tempest-QuotasAdminNegativeTest-337910980 tempest-QuotasAdminNegativeTest-337910980-project] 10.222.0.46 "PUT /compute/v2.1/os-quota-sets/80320b43ceca400cbbbc96ae80c4b845" status: 403 len: 116 microversion: 2.1 time: 0.013149 Jan 15 20:50:15.059813 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 344/631] 10.222.0.46 () {60 vars in 1261 bytes} [Sat Jan 15 20:50:15 2022] PUT /compute/v2.1/os-quota-sets/80320b43ceca400cbbbc96ae80c4b845 => generated 116 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:50:15.060989 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.objects.instance [None req-0e4aabaa-aca4-46f6-8eb7-f827511bbafa tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Lazy-loading 'services' on Instance uuid 770bfdbf-2ac6-4ab9-b2e3-f9e43ae88af6 {{(pid=129365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 20:50:15.134975 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-0e4aabaa-aca4-46f6-8eb7-f827511bbafa tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/770bfdbf-2ac6-4ab9-b2e3-f9e43ae88af6" status: 200 len: 2048 microversion: 2.25 time: 0.444010 Jan 15 20:50:15.136069 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 288/632] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:50:14 2022] GET /compute/v2.1/servers/770bfdbf-2ac6-4ab9-b2e3-f9e43ae88af6 => generated 2048 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 15 20:50:15.239118 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-3bcdbd41-943f-4b0e-b437-42cd37d49616 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:15.240077 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-3bcdbd41-943f-4b0e-b437-42cd37d49616 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] [instance: a5c419d5-7255-4ab1-8ada-6bb413faa169] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:15.251291 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3bcdbd41-943f-4b0e-b437-42cd37d49616 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:15.252075 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3bcdbd41-943f-4b0e-b437-42cd37d49616 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:15.256556 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3bcdbd41-943f-4b0e-b437-42cd37d49616 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:15.257544 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3bcdbd41-943f-4b0e-b437-42cd37d49616 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:15.304093 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-85b9f910-d237-4068-b801-867fadef2bad tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:15.304700 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-85b9f910-d237-4068-b801-867fadef2bad tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: e3fa2f27-df7a-4ecb-9bba-c970e3e7d106] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:15.319739 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-85b9f910-d237-4068-b801-867fadef2bad tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:15.320441 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-85b9f910-d237-4068-b801-867fadef2bad tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:15.322067 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-85b9f910-d237-4068-b801-867fadef2bad tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:15.322597 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-85b9f910-d237-4068-b801-867fadef2bad tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:15.681799 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-3bcdbd41-943f-4b0e-b437-42cd37d49616 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd06a1f6896564bb58b457d0642f8302c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89aabae1afe4a5a88ed97e87b5266ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:15.699239 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-3bcdbd41-943f-4b0e-b437-42cd37d49616 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] 10.222.0.46 "GET /compute/v2.1/servers/a5c419d5-7255-4ab1-8ada-6bb413faa169" status: 200 len: 1467 microversion: 2.1 time: 0.464820 Jan 15 20:50:15.700806 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 345/633] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:15 2022] GET /compute/v2.1/servers/a5c419d5-7255-4ab1-8ada-6bb413faa169 => generated 1467 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:50:15.740793 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-570bbcb0-f009-4a0d-a774-86c572546857 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-2109056671", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "networks": [{"uuid": "3ee7d78d-61a7-4a1d-ba2d-976bd0bf9fe2"}]}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:50:15.784802 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-85b9f910-d237-4068-b801-867fadef2bad tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:15.793336 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-85b9f910-d237-4068-b801-867fadef2bad tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/e3fa2f27-df7a-4ecb-9bba-c970e3e7d106" status: 200 len: 1462 microversion: 2.1 time: 0.492712 Jan 15 20:50:15.794108 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 289/634] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:15 2022] GET /compute/v2.1/servers/e3fa2f27-df7a-4ecb-9bba-c970e3e7d106 => generated 1462 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:15.807528 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-1e34ae01-276e-4c42-b250-baa341509d82 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:15.811524 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-1e34ae01-276e-4c42-b250-baa341509d82 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] [instance: eb4f55a3-96ef-4194-8506-e430b262c1f0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:15.828202 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1e34ae01-276e-4c42-b250-baa341509d82 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:15.832814 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1e34ae01-276e-4c42-b250-baa341509d82 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:15.833910 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1e34ae01-276e-4c42-b250-baa341509d82 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:15.834602 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1e34ae01-276e-4c42-b250-baa341509d82 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:15.877911 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.network.neutron [None req-570bbcb0-f009-4a0d-a774-86c572546857 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] validate_networks() for [('3ee7d78d-61a7-4a1d-ba2d-976bd0bf9fe2', None, None, None, None, None)] {{(pid=129366) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 20:50:16.054675 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-1e34ae01-276e-4c42-b250-baa341509d82 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc38f86758f9416b9e7f6915de0359d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8cfe33be708428abef52f5e8e25621b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:16.069225 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-1e34ae01-276e-4c42-b250-baa341509d82 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] 10.222.0.46 "GET /compute/v2.1/servers/eb4f55a3-96ef-4194-8506-e430b262c1f0" status: 200 len: 1277 microversion: 2.1 time: 0.271391 Jan 15 20:50:16.069886 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 290/635] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:15 2022] GET /compute/v2.1/servers/eb4f55a3-96ef-4194-8506-e430b262c1f0 => generated 1277 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:16.081910 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ceae69fa-4b52-4350-af9f-7722d14ee7c4 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:50:16.082905 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ceae69fa-4b52-4350-af9f-7722d14ee7c4 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 98d0ca37-0175-44e2-8a1d-965cdc517daf] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:16.092657 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ceae69fa-4b52-4350-af9f-7722d14ee7c4 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:16.093362 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ceae69fa-4b52-4350-af9f-7722d14ee7c4 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:16.094250 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ceae69fa-4b52-4350-af9f-7722d14ee7c4 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:16.095082 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ceae69fa-4b52-4350-af9f-7722d14ee7c4 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:16.161474 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ceae69fa-4b52-4350-af9f-7722d14ee7c4 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action" status: 200 len: 32634 microversion: 2.1 time: 0.090315 Jan 15 20:50:16.162576 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 291/636] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:50:16 2022] POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action => generated 32634 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:50:16.168086 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-85fca125-a1c6-4e07-9211-7eb6ba0c6d4d tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:16.168786 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-85fca125-a1c6-4e07-9211-7eb6ba0c6d4d tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] [instance: e3b7a713-3f0d-43e2-b466-6637bc567256] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:16.179532 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-85fca125-a1c6-4e07-9211-7eb6ba0c6d4d tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:16.180225 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-85fca125-a1c6-4e07-9211-7eb6ba0c6d4d tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:16.181991 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-85fca125-a1c6-4e07-9211-7eb6ba0c6d4d tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:16.182586 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-85fca125-a1c6-4e07-9211-7eb6ba0c6d4d tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:16.899407 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-85fca125-a1c6-4e07-9211-7eb6ba0c6d4d tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d4a57cfaa145009ba9cc8f21d9e8ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4a26c8edac44c8b26fd4e43813412d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:16.909687 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-85fca125-a1c6-4e07-9211-7eb6ba0c6d4d tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] 10.222.0.46 "GET /compute/v2.1/servers/e3b7a713-3f0d-43e2-b466-6637bc567256" status: 200 len: 1314 microversion: 2.1 time: 0.745385 Jan 15 20:50:16.910452 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 292/637] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:16 2022] GET /compute/v2.1/servers/e3b7a713-3f0d-43e2-b466-6637bc567256 => generated 1314 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:16.916461 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-295d0289-93c2-48df-b8b1-65c39708230d tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:50:16.918728 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-295d0289-93c2-48df-b8b1-65c39708230d tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: e3fa2f27-df7a-4ecb-9bba-c970e3e7d106] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:16.932601 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-295d0289-93c2-48df-b8b1-65c39708230d tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:16.933879 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-295d0289-93c2-48df-b8b1-65c39708230d tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:16.935024 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-295d0289-93c2-48df-b8b1-65c39708230d tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:16.936146 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-295d0289-93c2-48df-b8b1-65c39708230d tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:17.108087 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-295d0289-93c2-48df-b8b1-65c39708230d tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:17.122012 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-295d0289-93c2-48df-b8b1-65c39708230d tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: e3fa2f27-df7a-4ecb-9bba-c970e3e7d106] Old instance type m1.heat2, new instance type m1.heat {{(pid=129365) resize /opt/stack/nova/nova/compute/api.py:4097}} Jan 15 20:50:17.133581 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-295d0289-93c2-48df-b8b1-65c39708230d tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Flavor limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 20:50:17.135081 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-295d0289-93c2-48df-b8b1-65c39708230d tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Image limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 20:50:17.136748 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-295d0289-93c2-48df-b8b1-65c39708230d tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Flavor pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 20:50:17.137998 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-295d0289-93c2-48df-b8b1-65c39708230d tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Image pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 20:50:17.138605 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-295d0289-93c2-48df-b8b1-65c39708230d tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 20:50:17.377338 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-295d0289-93c2-48df-b8b1-65c39708230d tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "POST /compute/v2.1/servers/e3fa2f27-df7a-4ecb-9bba-c970e3e7d106/action" status: 202 len: 0 microversion: 2.1 time: 0.465114 Jan 15 20:50:17.381096 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 293/638] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:50:16 2022] POST /compute/v2.1/servers/e3fa2f27-df7a-4ecb-9bba-c970e3e7d106/action => generated 0 bytes in 467 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 20:50:17.385289 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f291cf00-8b73-48c3-940c-2949964c939a tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:17.386737 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f291cf00-8b73-48c3-940c-2949964c939a tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] [instance: a5c419d5-7255-4ab1-8ada-6bb413faa169] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:17.405780 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f291cf00-8b73-48c3-940c-2949964c939a tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:17.406532 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f291cf00-8b73-48c3-940c-2949964c939a tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:17.407947 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f291cf00-8b73-48c3-940c-2949964c939a tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:17.408961 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f291cf00-8b73-48c3-940c-2949964c939a tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:17.564052 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-570bbcb0-f009-4a0d-a774-86c572546857 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Flavor limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 20:50:17.564614 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-570bbcb0-f009-4a0d-a774-86c572546857 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Image limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 20:50:17.565020 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-570bbcb0-f009-4a0d-a774-86c572546857 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Flavor pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 20:50:17.565593 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-570bbcb0-f009-4a0d-a774-86c572546857 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Image pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 20:50:17.566230 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-570bbcb0-f009-4a0d-a774-86c572546857 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 20:50:17.597734 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-570bbcb0-f009-4a0d-a774-86c572546857 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:17.599273 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-570bbcb0-f009-4a0d-a774-86c572546857 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:17.605793 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-570bbcb0-f009-4a0d-a774-86c572546857 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:17.606412 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-570bbcb0-f009-4a0d-a774-86c572546857 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:17.664687 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-570bbcb0-f009-4a0d-a774-86c572546857 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Getting quotas for project c3ede5f7e26d484fb1c6f18819a90e3f. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:50:17.676496 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-570bbcb0-f009-4a0d-a774-86c572546857 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Getting quotas for user a15f22e0573c4433b35a46c5245e30f9 and project c3ede5f7e26d484fb1c6f18819a90e3f. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:50:17.691423 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-570bbcb0-f009-4a0d-a774-86c572546857 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Going to run 1 instances... {{(pid=129366) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 20:50:17.693882 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-570bbcb0-f009-4a0d-a774-86c572546857 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] [instance: 1085522d-3ccc-4de0-b9dd-01c374e1f0ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 20:50:17.765133 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-f291cf00-8b73-48c3-940c-2949964c939a tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd06a1f6896564bb58b457d0642f8302c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89aabae1afe4a5a88ed97e87b5266ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:17.780685 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f291cf00-8b73-48c3-940c-2949964c939a tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] 10.222.0.46 "GET /compute/v2.1/servers/a5c419d5-7255-4ab1-8ada-6bb413faa169" status: 200 len: 1425 microversion: 2.1 time: 0.400654 Jan 15 20:50:17.783316 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 294/639] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:17 2022] GET /compute/v2.1/servers/a5c419d5-7255-4ab1-8ada-6bb413faa169 => generated 1425 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:17.790846 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-171daabd-2318-430e-b302-4dc7951b3766 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:17.792236 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-171daabd-2318-430e-b302-4dc7951b3766 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] [instance: eb4f55a3-96ef-4194-8506-e430b262c1f0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:17.800349 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-171daabd-2318-430e-b302-4dc7951b3766 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:17.802494 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-171daabd-2318-430e-b302-4dc7951b3766 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:17.804254 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-171daabd-2318-430e-b302-4dc7951b3766 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:17.804707 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-171daabd-2318-430e-b302-4dc7951b3766 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:17.812345 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-570bbcb0-f009-4a0d-a774-86c572546857 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.110520 Jan 15 20:50:17.814658 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 346/640] 10.222.0.46 () {62 vars in 1187 bytes} [Sat Jan 15 20:50:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 2113 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jan 15 20:50:17.865774 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f0a17423-207b-44eb-ab97-742cebc28336 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:50:17.879078 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f0a17423-207b-44eb-ab97-742cebc28336 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 98d0ca37-0175-44e2-8a1d-965cdc517daf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:17.890682 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f0a17423-207b-44eb-ab97-742cebc28336 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:17.891136 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f0a17423-207b-44eb-ab97-742cebc28336 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:17.891941 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f0a17423-207b-44eb-ab97-742cebc28336 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:17.892375 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f0a17423-207b-44eb-ab97-742cebc28336 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:18.013294 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f0a17423-207b-44eb-ab97-742cebc28336 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action" status: 200 len: 32634 microversion: 2.1 time: 0.180486 Jan 15 20:50:18.020718 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 347/641] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:50:17 2022] POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action => generated 32634 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:50:18.047721 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ddf3b718-0832-4aab-a48d-b30291e4d4e9 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:18.050280 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ddf3b718-0832-4aab-a48d-b30291e4d4e9 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: e3fa2f27-df7a-4ecb-9bba-c970e3e7d106] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:18.067380 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ddf3b718-0832-4aab-a48d-b30291e4d4e9 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:18.068970 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ddf3b718-0832-4aab-a48d-b30291e4d4e9 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:18.071170 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ddf3b718-0832-4aab-a48d-b30291e4d4e9 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:18.071814 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ddf3b718-0832-4aab-a48d-b30291e4d4e9 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:18.254903 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-171daabd-2318-430e-b302-4dc7951b3766 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc38f86758f9416b9e7f6915de0359d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8cfe33be708428abef52f5e8e25621b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:18.271408 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-171daabd-2318-430e-b302-4dc7951b3766 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] 10.222.0.46 "GET /compute/v2.1/servers/eb4f55a3-96ef-4194-8506-e430b262c1f0" status: 200 len: 1319 microversion: 2.1 time: 0.481315 Jan 15 20:50:18.272104 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 295/642] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:17 2022] GET /compute/v2.1/servers/eb4f55a3-96ef-4194-8506-e430b262c1f0 => generated 1319 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:18.292708 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-f7347e46-e4f1-41f1-a902-1dd814ca44e2 req-3b7b2861-6111-40c9-b88a-20935494a6f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5c419d5-7255-4ab1-8ada-6bb413faa169", "name": "network-vif-deleted", "tag": "74a42162-ce85-4da2-9310-a6708b9b7983"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:50:18.305808 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:50:18.305808 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:50:18.326338 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-f7347e46-e4f1-41f1-a902-1dd814ca44e2 req-3b7b2861-6111-40c9-b88a-20935494a6f9 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:18.326707 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-f7347e46-e4f1-41f1-a902-1dd814ca44e2 req-3b7b2861-6111-40c9-b88a-20935494a6f9 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:18.358605 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-f7347e46-e4f1-41f1-a902-1dd814ca44e2 req-3b7b2861-6111-40c9-b88a-20935494a6f9 service nova] Creating event network-vif-deleted:74a42162-ce85-4da2-9310-a6708b9b7983 for instance a5c419d5-7255-4ab1-8ada-6bb413faa169 on nch1-master-1 Jan 15 20:50:18.364234 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-f7347e46-e4f1-41f1-a902-1dd814ca44e2 req-3b7b2861-6111-40c9-b88a-20935494a6f9 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090961 Jan 15 20:50:18.365492 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 296/643] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:50:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:50:18.386097 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-1d018f1c-fe27-407b-b9b2-029275dacae1 req-d579b9e7-ca48-4a00-a8d6-0ecbb8ebc5a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b191ed6c-040a-4702-8e15-86272f9d1847", "name": "network-vif-plugged", "status": "completed", "tag": "bbe8394e-08fc-445b-a162-0e40259702ca"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:50:18.391581 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:50:18.391581 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:50:18.424265 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-1d018f1c-fe27-407b-b9b2-029275dacae1 req-d579b9e7-ca48-4a00-a8d6-0ecbb8ebc5a0 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:18.425575 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-1d018f1c-fe27-407b-b9b2-029275dacae1 req-d579b9e7-ca48-4a00-a8d6-0ecbb8ebc5a0 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:18.439548 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-1d018f1c-fe27-407b-b9b2-029275dacae1 req-d579b9e7-ca48-4a00-a8d6-0ecbb8ebc5a0 service nova] Creating event network-vif-plugged:bbe8394e-08fc-445b-a162-0e40259702ca for instance b191ed6c-040a-4702-8e15-86272f9d1847 on nch2-master-1 Jan 15 20:50:18.447090 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-1d018f1c-fe27-407b-b9b2-029275dacae1 req-d579b9e7-ca48-4a00-a8d6-0ecbb8ebc5a0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080021 Jan 15 20:50:18.447955 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 297/644] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:50:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:50:18.453788 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-adb9bbdc-8af1-4788-b845-6bcbfdb65180 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:18.454818 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-adb9bbdc-8af1-4788-b845-6bcbfdb65180 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] [instance: 1085522d-3ccc-4de0-b9dd-01c374e1f0ca] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:18.615653 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-adb9bbdc-8af1-4788-b845-6bcbfdb65180 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:18.637472 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-adb9bbdc-8af1-4788-b845-6bcbfdb65180 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:18.646087 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-adb9bbdc-8af1-4788-b845-6bcbfdb65180 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:18.653195 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-adb9bbdc-8af1-4788-b845-6bcbfdb65180 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] 10.222.0.46 "GET /compute/v2.1/servers/1085522d-3ccc-4de0-b9dd-01c374e1f0ca" status: 200 len: 1262 microversion: 2.25 time: 0.198231 Jan 15 20:50:18.655913 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 298/645] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:50:18 2022] GET /compute/v2.1/servers/1085522d-3ccc-4de0-b9dd-01c374e1f0ca => generated 1262 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:50:18.676920 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3000ea11-d71e-442f-9946-11c90f565bb3 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:18.680094 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-3000ea11-d71e-442f-9946-11c90f565bb3 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] [instance: e3b7a713-3f0d-43e2-b466-6637bc567256] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:18.698517 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3000ea11-d71e-442f-9946-11c90f565bb3 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:18.703226 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3000ea11-d71e-442f-9946-11c90f565bb3 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:18.703344 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-ddf3b718-0832-4aab-a48d-b30291e4d4e9 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:18.707709 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3000ea11-d71e-442f-9946-11c90f565bb3 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:18.708189 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3000ea11-d71e-442f-9946-11c90f565bb3 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:18.715396 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ddf3b718-0832-4aab-a48d-b30291e4d4e9 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/e3fa2f27-df7a-4ecb-9bba-c970e3e7d106" status: 200 len: 1471 microversion: 2.1 time: 0.693084 Jan 15 20:50:18.719820 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 348/646] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:18 2022] GET /compute/v2.1/servers/e3fa2f27-df7a-4ecb-9bba-c970e3e7d106 => generated 1471 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:18.798400 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8bc23483-dcb9-4289-8e3b-62a6f2e0b87a tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:18.799012 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-8bc23483-dcb9-4289-8e3b-62a6f2e0b87a tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] [instance: a5c419d5-7255-4ab1-8ada-6bb413faa169] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:18.811563 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8bc23483-dcb9-4289-8e3b-62a6f2e0b87a tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:18.812177 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8bc23483-dcb9-4289-8e3b-62a6f2e0b87a tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:18.813011 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8bc23483-dcb9-4289-8e3b-62a6f2e0b87a tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:18.813452 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8bc23483-dcb9-4289-8e3b-62a6f2e0b87a tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:18.847480 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-8bc23483-dcb9-4289-8e3b-62a6f2e0b87a tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] HTTP exception thrown: Instance a5c419d5-7255-4ab1-8ada-6bb413faa169 could not be found. Jan 15 20:50:18.848085 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8bc23483-dcb9-4289-8e3b-62a6f2e0b87a tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Returning 404 to user: Instance a5c419d5-7255-4ab1-8ada-6bb413faa169 could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:50:18.848955 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-8bc23483-dcb9-4289-8e3b-62a6f2e0b87a tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] 10.222.0.46 "GET /compute/v2.1/servers/a5c419d5-7255-4ab1-8ada-6bb413faa169" status: 404 len: 111 microversion: 2.1 time: 0.054498 Jan 15 20:50:18.850280 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 349/647] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:18 2022] GET /compute/v2.1/servers/a5c419d5-7255-4ab1-8ada-6bb413faa169 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 15 20:50:18.866943 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-77ca740c-e4c8-465e-802c-477ef4b6753f tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:18.874167 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-77ca740c-e4c8-465e-802c-477ef4b6753f tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] [instance: 6d487317-4968-4a06-ad7b-4484e8d50f10] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:18.889446 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-77ca740c-e4c8-465e-802c-477ef4b6753f tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:18.890098 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-77ca740c-e4c8-465e-802c-477ef4b6753f tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:18.891094 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-77ca740c-e4c8-465e-802c-477ef4b6753f tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:18.895112 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-77ca740c-e4c8-465e-802c-477ef4b6753f tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:18.957827 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-77ca740c-e4c8-465e-802c-477ef4b6753f tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] [instance: 6d487317-4968-4a06-ad7b-4484e8d50f10] Going to try to terminate instance {{(pid=129366) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 20:50:19.111459 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-77ca740c-e4c8-465e-802c-477ef4b6753f tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] 10.222.0.46 "DELETE /compute/v2.1/servers/6d487317-4968-4a06-ad7b-4484e8d50f10" status: 204 len: 0 microversion: 2.1 time: 0.251249 Jan 15 20:50:19.113650 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 350/648] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 20:50:18 2022] DELETE /compute/v2.1/servers/6d487317-4968-4a06-ad7b-4484e8d50f10 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 20:50:19.128150 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7155cbda-961a-4a5e-b23f-8ce170213097 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:50:19.129736 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-7155cbda-961a-4a5e-b23f-8ce170213097 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 98d0ca37-0175-44e2-8a1d-965cdc517daf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:19.145216 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7155cbda-961a-4a5e-b23f-8ce170213097 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:19.145584 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-3000ea11-d71e-442f-9946-11c90f565bb3 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d4a57cfaa145009ba9cc8f21d9e8ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4a26c8edac44c8b26fd4e43813412d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:19.146294 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7155cbda-961a-4a5e-b23f-8ce170213097 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:19.147187 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7155cbda-961a-4a5e-b23f-8ce170213097 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:19.148661 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7155cbda-961a-4a5e-b23f-8ce170213097 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:19.161803 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3000ea11-d71e-442f-9946-11c90f565bb3 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] 10.222.0.46 "GET /compute/v2.1/servers/e3b7a713-3f0d-43e2-b466-6637bc567256" status: 200 len: 1314 microversion: 2.1 time: 0.502871 Jan 15 20:50:19.162400 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 299/649] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:18 2022] GET /compute/v2.1/servers/e3b7a713-3f0d-43e2-b466-6637bc567256 => generated 1314 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:19.179652 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ced9190a-02d4-4934-9122-ce733761f31b tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:19.180587 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ced9190a-02d4-4934-9122-ce733761f31b tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] [instance: 6d487317-4968-4a06-ad7b-4484e8d50f10] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:19.194764 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ced9190a-02d4-4934-9122-ce733761f31b tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:19.195482 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ced9190a-02d4-4934-9122-ce733761f31b tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:19.197515 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ced9190a-02d4-4934-9122-ce733761f31b tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:19.198648 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ced9190a-02d4-4934-9122-ce733761f31b tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:19.205600 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7155cbda-961a-4a5e-b23f-8ce170213097 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action" status: 200 len: 32634 microversion: 2.1 time: 0.088538 Jan 15 20:50:19.211809 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 351/650] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:50:19 2022] POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action => generated 32634 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:50:19.297004 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7b385f2a-1499-4cba-9407-8bbf6c79709a tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:19.299015 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-7b385f2a-1499-4cba-9407-8bbf6c79709a tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] [instance: eb4f55a3-96ef-4194-8506-e430b262c1f0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:19.316831 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7b385f2a-1499-4cba-9407-8bbf6c79709a tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:19.318787 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7b385f2a-1499-4cba-9407-8bbf6c79709a tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:19.320638 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7b385f2a-1499-4cba-9407-8bbf6c79709a tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:19.322666 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7b385f2a-1499-4cba-9407-8bbf6c79709a tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:19.545672 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-ced9190a-02d4-4934-9122-ce733761f31b tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd06a1f6896564bb58b457d0642f8302c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89aabae1afe4a5a88ed97e87b5266ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:19.566833 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ced9190a-02d4-4934-9122-ce733761f31b tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] 10.222.0.46 "GET /compute/v2.1/servers/6d487317-4968-4a06-ad7b-4484e8d50f10" status: 200 len: 1477 microversion: 2.1 time: 0.401597 Jan 15 20:50:19.569497 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 300/651] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:19 2022] GET /compute/v2.1/servers/6d487317-4968-4a06-ad7b-4484e8d50f10 => generated 1477 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:19.638322 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-7b385f2a-1499-4cba-9407-8bbf6c79709a tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc38f86758f9416b9e7f6915de0359d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8cfe33be708428abef52f5e8e25621b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:19.656292 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7b385f2a-1499-4cba-9407-8bbf6c79709a tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] 10.222.0.46 "GET /compute/v2.1/servers/eb4f55a3-96ef-4194-8506-e430b262c1f0" status: 200 len: 1319 microversion: 2.1 time: 0.370492 Jan 15 20:50:19.658910 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 352/652] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:19 2022] GET /compute/v2.1/servers/eb4f55a3-96ef-4194-8506-e430b262c1f0 => generated 1319 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:19.674060 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-925c115f-e5a3-48c7-b637-da659004440b tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:19.675294 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-925c115f-e5a3-48c7-b637-da659004440b tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] [instance: 1085522d-3ccc-4de0-b9dd-01c374e1f0ca] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:19.686302 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-925c115f-e5a3-48c7-b637-da659004440b tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:19.686796 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-925c115f-e5a3-48c7-b637-da659004440b tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:19.687603 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-925c115f-e5a3-48c7-b637-da659004440b tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:19.688243 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-925c115f-e5a3-48c7-b637-da659004440b tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:19.738210 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8fde6fb9-931c-4a25-b036-e0370e7dcc16 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:19.739658 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-8fde6fb9-931c-4a25-b036-e0370e7dcc16 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: e3fa2f27-df7a-4ecb-9bba-c970e3e7d106] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:19.754347 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8fde6fb9-931c-4a25-b036-e0370e7dcc16 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:19.755775 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8fde6fb9-931c-4a25-b036-e0370e7dcc16 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:19.760484 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8fde6fb9-931c-4a25-b036-e0370e7dcc16 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:19.761350 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8fde6fb9-931c-4a25-b036-e0370e7dcc16 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:19.857025 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-925c115f-e5a3-48c7-b637-da659004440b tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:19.878924 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-925c115f-e5a3-48c7-b637-da659004440b tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:19.908760 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-925c115f-e5a3-48c7-b637-da659004440b tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:19.910335 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-925c115f-e5a3-48c7-b637-da659004440b tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] 10.222.0.46 "GET /compute/v2.1/servers/1085522d-3ccc-4de0-b9dd-01c374e1f0ca" status: 200 len: 1314 microversion: 2.25 time: 0.240876 Jan 15 20:50:19.912766 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 301/653] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:50:19 2022] GET /compute/v2.1/servers/1085522d-3ccc-4de0-b9dd-01c374e1f0ca => generated 1314 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:50:20.179812 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e1af67b7-c15f-44b5-a877-8e36896462a9 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:20.181399 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e1af67b7-c15f-44b5-a877-8e36896462a9 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] [instance: e3b7a713-3f0d-43e2-b466-6637bc567256] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:20.204320 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e1af67b7-c15f-44b5-a877-8e36896462a9 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:20.206895 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e1af67b7-c15f-44b5-a877-8e36896462a9 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:20.208508 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e1af67b7-c15f-44b5-a877-8e36896462a9 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:20.216542 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e1af67b7-c15f-44b5-a877-8e36896462a9 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:20.281507 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-8fde6fb9-931c-4a25-b036-e0370e7dcc16 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:20.297826 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-8fde6fb9-931c-4a25-b036-e0370e7dcc16 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/e3fa2f27-df7a-4ecb-9bba-c970e3e7d106" status: 200 len: 1471 microversion: 2.1 time: 0.566922 Jan 15 20:50:20.307622 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 353/654] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:19 2022] GET /compute/v2.1/servers/e3fa2f27-df7a-4ecb-9bba-c970e3e7d106 => generated 1471 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:20.330663 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1b04aaec-44a8-431a-9ed9-1fcbc173b6e2 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:50:20.334881 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-1b04aaec-44a8-431a-9ed9-1fcbc173b6e2 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 98d0ca37-0175-44e2-8a1d-965cdc517daf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:20.355799 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1b04aaec-44a8-431a-9ed9-1fcbc173b6e2 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:20.356927 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1b04aaec-44a8-431a-9ed9-1fcbc173b6e2 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:20.359822 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1b04aaec-44a8-431a-9ed9-1fcbc173b6e2 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:20.362001 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1b04aaec-44a8-431a-9ed9-1fcbc173b6e2 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:20.494999 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-1b04aaec-44a8-431a-9ed9-1fcbc173b6e2 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action" status: 200 len: 32634 microversion: 2.1 time: 0.180399 Jan 15 20:50:20.495740 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 354/655] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:50:20 2022] POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action => generated 32634 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:50:20.518014 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-b6b7ac7d-11c6-4459-aa34-80ace1d3cf20 req-591a9e14-451c-48e9-83d9-997c8dac5bd8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3934550f-0131-4bd3-890b-edbaf4ccac0e", "tag": "d2632d9a-333c-439e-b179-55d658dedee2"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:50:20.521647 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:50:20.521647 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:50:20.548595 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-b6b7ac7d-11c6-4459-aa34-80ace1d3cf20 req-591a9e14-451c-48e9-83d9-997c8dac5bd8 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:20.561084 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-b6b7ac7d-11c6-4459-aa34-80ace1d3cf20 req-591a9e14-451c-48e9-83d9-997c8dac5bd8 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:20.631378 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-b6b7ac7d-11c6-4459-aa34-80ace1d3cf20 req-591a9e14-451c-48e9-83d9-997c8dac5bd8 service nova] Creating event network-changed:d2632d9a-333c-439e-b179-55d658dedee2 for instance 3934550f-0131-4bd3-890b-edbaf4ccac0e on nch2-master-1 Jan 15 20:50:20.642176 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-b6b7ac7d-11c6-4459-aa34-80ace1d3cf20 req-591a9e14-451c-48e9-83d9-997c8dac5bd8 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.140419 Jan 15 20:50:20.654891 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 355/656] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:50:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:50:20.674959 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7425dde6-10f5-4837-83cb-0d3a69daa90c tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:20.679662 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-7425dde6-10f5-4837-83cb-0d3a69daa90c tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] [instance: 6d487317-4968-4a06-ad7b-4484e8d50f10] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:20.708194 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7425dde6-10f5-4837-83cb-0d3a69daa90c tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:20.708706 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7425dde6-10f5-4837-83cb-0d3a69daa90c tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:20.711274 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7425dde6-10f5-4837-83cb-0d3a69daa90c tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:20.711774 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7425dde6-10f5-4837-83cb-0d3a69daa90c tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:20.910457 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-e1af67b7-c15f-44b5-a877-8e36896462a9 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d4a57cfaa145009ba9cc8f21d9e8ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4a26c8edac44c8b26fd4e43813412d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:20.918813 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e1af67b7-c15f-44b5-a877-8e36896462a9 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] 10.222.0.46 "GET /compute/v2.1/servers/e3b7a713-3f0d-43e2-b466-6637bc567256" status: 200 len: 1314 microversion: 2.1 time: 0.742983 Jan 15 20:50:20.926681 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 302/657] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:20 2022] GET /compute/v2.1/servers/e3b7a713-3f0d-43e2-b466-6637bc567256 => generated 1314 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:20.932613 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8497e6e3-2d1b-4620-a32c-f047947a55e9 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:20.937697 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-8497e6e3-2d1b-4620-a32c-f047947a55e9 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] [instance: eb4f55a3-96ef-4194-8506-e430b262c1f0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:20.950605 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8497e6e3-2d1b-4620-a32c-f047947a55e9 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:20.951590 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8497e6e3-2d1b-4620-a32c-f047947a55e9 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:20.954076 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8497e6e3-2d1b-4620-a32c-f047947a55e9 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:20.955425 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8497e6e3-2d1b-4620-a32c-f047947a55e9 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:21.232572 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-7425dde6-10f5-4837-83cb-0d3a69daa90c tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd06a1f6896564bb58b457d0642f8302c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89aabae1afe4a5a88ed97e87b5266ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:21.241100 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7425dde6-10f5-4837-83cb-0d3a69daa90c tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] 10.222.0.46 "GET /compute/v2.1/servers/6d487317-4968-4a06-ad7b-4484e8d50f10" status: 200 len: 1477 microversion: 2.1 time: 0.583293 Jan 15 20:50:21.243612 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 356/658] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:20 2022] GET /compute/v2.1/servers/6d487317-4968-4a06-ad7b-4484e8d50f10 => generated 1477 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:21.248918 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-4e780932-4384-4875-a05a-34aa963d558e req-0decbd17-f3ff-4ab3-af2e-ae715dcc6e64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3b7a713-3f0d-43e2-b466-6637bc567256", "name": "network-vif-plugged", "status": "completed", "tag": "b6f66c62-4ffd-4b3d-b12d-4d0ef6d8d0d4"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:50:21.253082 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:50:21.253082 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:50:21.281096 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-4e780932-4384-4875-a05a-34aa963d558e req-0decbd17-f3ff-4ab3-af2e-ae715dcc6e64 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:21.283052 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-4e780932-4384-4875-a05a-34aa963d558e req-0decbd17-f3ff-4ab3-af2e-ae715dcc6e64 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:21.311078 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-4e780932-4384-4875-a05a-34aa963d558e req-0decbd17-f3ff-4ab3-af2e-ae715dcc6e64 service nova] Creating event network-vif-plugged:b6f66c62-4ffd-4b3d-b12d-4d0ef6d8d0d4 for instance e3b7a713-3f0d-43e2-b466-6637bc567256 on nch1-master-1 Jan 15 20:50:21.313730 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-8497e6e3-2d1b-4620-a32c-f047947a55e9 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc38f86758f9416b9e7f6915de0359d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8cfe33be708428abef52f5e8e25621b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:21.317500 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-4e780932-4384-4875-a05a-34aa963d558e req-0decbd17-f3ff-4ab3-af2e-ae715dcc6e64 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071298 Jan 15 20:50:21.319406 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 357/659] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:50:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:50:21.327416 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-8497e6e3-2d1b-4620-a32c-f047947a55e9 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] 10.222.0.46 "GET /compute/v2.1/servers/eb4f55a3-96ef-4194-8506-e430b262c1f0" status: 200 len: 1319 microversion: 2.1 time: 0.399164 Jan 15 20:50:21.328017 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 303/660] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:20 2022] GET /compute/v2.1/servers/eb4f55a3-96ef-4194-8506-e430b262c1f0 => generated 1319 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:21.329932 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1fd67778-2285-4ed3-8719-e0ac5c78cbc4 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:21.331017 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-1fd67778-2285-4ed3-8719-e0ac5c78cbc4 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] [instance: 1085522d-3ccc-4de0-b9dd-01c374e1f0ca] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:21.336896 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-4caee9b9-069c-43e1-8b3a-486292fe7c68 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:21.340633 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-4caee9b9-069c-43e1-8b3a-486292fe7c68 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: e3fa2f27-df7a-4ecb-9bba-c970e3e7d106] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:21.355938 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1fd67778-2285-4ed3-8719-e0ac5c78cbc4 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:21.356203 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4caee9b9-069c-43e1-8b3a-486292fe7c68 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:21.356403 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1fd67778-2285-4ed3-8719-e0ac5c78cbc4 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:21.356653 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4caee9b9-069c-43e1-8b3a-486292fe7c68 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:21.357261 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1fd67778-2285-4ed3-8719-e0ac5c78cbc4 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:21.357701 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4caee9b9-069c-43e1-8b3a-486292fe7c68 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:21.357808 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1fd67778-2285-4ed3-8719-e0ac5c78cbc4 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:21.358165 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4caee9b9-069c-43e1-8b3a-486292fe7c68 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:21.550950 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-1fd67778-2285-4ed3-8719-e0ac5c78cbc4 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:21.560974 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-1fd67778-2285-4ed3-8719-e0ac5c78cbc4 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:21.565559 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-1fd67778-2285-4ed3-8719-e0ac5c78cbc4 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:21.567164 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-1fd67778-2285-4ed3-8719-e0ac5c78cbc4 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] 10.222.0.46 "GET /compute/v2.1/servers/1085522d-3ccc-4de0-b9dd-01c374e1f0ca" status: 200 len: 1320 microversion: 2.25 time: 0.245959 Jan 15 20:50:21.569873 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 358/661] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:50:21 2022] GET /compute/v2.1/servers/1085522d-3ccc-4de0-b9dd-01c374e1f0ca => generated 1320 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:50:21.580355 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-15a65c08-fb06-4664-a80f-a0c933907a1f tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:50:21.582831 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-15a65c08-fb06-4664-a80f-a0c933907a1f tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 98d0ca37-0175-44e2-8a1d-965cdc517daf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:21.595656 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-15a65c08-fb06-4664-a80f-a0c933907a1f tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:21.596485 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-15a65c08-fb06-4664-a80f-a0c933907a1f tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:21.598588 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-15a65c08-fb06-4664-a80f-a0c933907a1f tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:21.599281 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-15a65c08-fb06-4664-a80f-a0c933907a1f tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:21.652016 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-15a65c08-fb06-4664-a80f-a0c933907a1f tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action" status: 200 len: 32634 microversion: 2.1 time: 0.079714 Jan 15 20:50:21.653220 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 359/662] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:50:21 2022] POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action => generated 32634 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:50:21.671475 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-4caee9b9-069c-43e1-8b3a-486292fe7c68 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:21.682109 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-4caee9b9-069c-43e1-8b3a-486292fe7c68 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/e3fa2f27-df7a-4ecb-9bba-c970e3e7d106" status: 200 len: 1471 microversion: 2.1 time: 0.349833 Jan 15 20:50:21.683239 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 304/663] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:21 2022] GET /compute/v2.1/servers/e3fa2f27-df7a-4ecb-9bba-c970e3e7d106 => generated 1471 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:21.948994 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-eeea6d36-b421-4a5d-b3ee-107865ed41ee tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:21.950071 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-eeea6d36-b421-4a5d-b3ee-107865ed41ee tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] [instance: e3b7a713-3f0d-43e2-b466-6637bc567256] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:21.970970 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-eeea6d36-b421-4a5d-b3ee-107865ed41ee tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:21.972189 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-eeea6d36-b421-4a5d-b3ee-107865ed41ee tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:21.975802 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-eeea6d36-b421-4a5d-b3ee-107865ed41ee tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:21.976599 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-eeea6d36-b421-4a5d-b3ee-107865ed41ee tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:22.256348 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-eeea6d36-b421-4a5d-b3ee-107865ed41ee tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d4a57cfaa145009ba9cc8f21d9e8ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4a26c8edac44c8b26fd4e43813412d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:22.259336 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-765b07ba-348e-4760-bed1-505a7ae359d6 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:22.260627 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-765b07ba-348e-4760-bed1-505a7ae359d6 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] [instance: 6d487317-4968-4a06-ad7b-4484e8d50f10] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:22.266938 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-765b07ba-348e-4760-bed1-505a7ae359d6 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:22.267767 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-765b07ba-348e-4760-bed1-505a7ae359d6 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:22.268828 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-765b07ba-348e-4760-bed1-505a7ae359d6 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:22.269550 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-765b07ba-348e-4760-bed1-505a7ae359d6 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:22.273186 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-eeea6d36-b421-4a5d-b3ee-107865ed41ee tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] 10.222.0.46 "GET /compute/v2.1/servers/e3b7a713-3f0d-43e2-b466-6637bc567256" status: 200 len: 1314 microversion: 2.1 time: 0.331067 Jan 15 20:50:22.273786 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 360/664] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:21 2022] GET /compute/v2.1/servers/e3b7a713-3f0d-43e2-b466-6637bc567256 => generated 1314 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:22.452688 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-dba50dba-a41b-466c-afe9-d16d2f6cc22c tempest-ServicesAdminTestJSON-544901174 tempest-ServicesAdminTestJSON-544901174-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:22.456013 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:50:22.456013 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:50:22.462531 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dba50dba-a41b-466c-afe9-d16d2f6cc22c tempest-ServicesAdminTestJSON-544901174 tempest-ServicesAdminTestJSON-544901174-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:22.463781 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dba50dba-a41b-466c-afe9-d16d2f6cc22c tempest-ServicesAdminTestJSON-544901174 tempest-ServicesAdminTestJSON-544901174-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:22.465218 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dba50dba-a41b-466c-afe9-d16d2f6cc22c tempest-ServicesAdminTestJSON-544901174 tempest-ServicesAdminTestJSON-544901174-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:22.465899 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dba50dba-a41b-466c-afe9-d16d2f6cc22c tempest-ServicesAdminTestJSON-544901174 tempest-ServicesAdminTestJSON-544901174-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:22.498890 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-dba50dba-a41b-466c-afe9-d16d2f6cc22c tempest-ServicesAdminTestJSON-544901174 tempest-ServicesAdminTestJSON-544901174-project-admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.206306 Jan 15 20:50:22.499785 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 361/665] 10.222.0.46 () {58 vars in 1136 bytes} [Sat Jan 15 20:50:22 2022] GET /compute/v2.1/os-services => generated 947 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 20:50:22.506798 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0a592316-b14a-4443-b521-583c290fb37d tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:22.507877 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-0a592316-b14a-4443-b521-583c290fb37d tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] [instance: eb4f55a3-96ef-4194-8506-e430b262c1f0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:22.517632 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0a592316-b14a-4443-b521-583c290fb37d tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:22.518385 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0a592316-b14a-4443-b521-583c290fb37d tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:22.522686 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-765b07ba-348e-4760-bed1-505a7ae359d6 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd06a1f6896564bb58b457d0642f8302c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89aabae1afe4a5a88ed97e87b5266ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:22.522884 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0a592316-b14a-4443-b521-583c290fb37d tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:22.525160 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0a592316-b14a-4443-b521-583c290fb37d tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:22.534816 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-765b07ba-348e-4760-bed1-505a7ae359d6 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] 10.222.0.46 "GET /compute/v2.1/servers/6d487317-4968-4a06-ad7b-4484e8d50f10" status: 200 len: 1477 microversion: 2.1 time: 0.279135 Jan 15 20:50:22.535846 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 305/666] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:22 2022] GET /compute/v2.1/servers/6d487317-4968-4a06-ad7b-4484e8d50f10 => generated 1477 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:50:22.550937 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-1fa61c2c-5ebc-403b-82c8-c1f9cfd796a1 tempest-ServicesAdminTestJSON-544901174 tempest-ServicesAdminTestJSON-544901174-project-admin] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:22.552953 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:50:22.552953 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:50:22.554876 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1fa61c2c-5ebc-403b-82c8-c1f9cfd796a1 tempest-ServicesAdminTestJSON-544901174 tempest-ServicesAdminTestJSON-544901174-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:22.555697 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1fa61c2c-5ebc-403b-82c8-c1f9cfd796a1 tempest-ServicesAdminTestJSON-544901174 tempest-ServicesAdminTestJSON-544901174-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:22.557126 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1fa61c2c-5ebc-403b-82c8-c1f9cfd796a1 tempest-ServicesAdminTestJSON-544901174 tempest-ServicesAdminTestJSON-544901174-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:22.557781 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1fa61c2c-5ebc-403b-82c8-c1f9cfd796a1 tempest-ServicesAdminTestJSON-544901174 tempest-ServicesAdminTestJSON-544901174-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:22.589464 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-1fa61c2c-5ebc-403b-82c8-c1f9cfd796a1 tempest-ServicesAdminTestJSON-544901174 tempest-ServicesAdminTestJSON-544901174-project-admin] 10.222.0.46 "GET /compute/v2.1/os-services?host=ncdv-master-1" status: 200 len: 581 microversion: 2.1 time: 0.042564 Jan 15 20:50:22.590412 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 306/667] 10.222.0.46 () {58 vars in 1173 bytes} [Sat Jan 15 20:50:22 2022] GET /compute/v2.1/os-services?host=ncdv-master-1 => generated 581 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:50:22.594997 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b85b48db-86eb-4508-8b4c-46531560b5bc tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:22.595853 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b85b48db-86eb-4508-8b4c-46531560b5bc tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] [instance: 1085522d-3ccc-4de0-b9dd-01c374e1f0ca] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:22.603865 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b85b48db-86eb-4508-8b4c-46531560b5bc tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:22.604649 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b85b48db-86eb-4508-8b4c-46531560b5bc tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:22.605757 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b85b48db-86eb-4508-8b4c-46531560b5bc tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:22.606411 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b85b48db-86eb-4508-8b4c-46531560b5bc tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:22.844779 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-0a592316-b14a-4443-b521-583c290fb37d tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc38f86758f9416b9e7f6915de0359d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8cfe33be708428abef52f5e8e25621b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:22.854938 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0a592316-b14a-4443-b521-583c290fb37d tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] 10.222.0.46 "GET /compute/v2.1/servers/eb4f55a3-96ef-4194-8506-e430b262c1f0" status: 200 len: 1319 microversion: 2.1 time: 0.352968 Jan 15 20:50:22.866188 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 362/668] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:22 2022] GET /compute/v2.1/servers/eb4f55a3-96ef-4194-8506-e430b262c1f0 => generated 1319 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:22.871126 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-32973e03-c469-4c62-9fea-5cfbf494bab0 tempest-ServicesAdminTestJSON-544901174 tempest-ServicesAdminTestJSON-544901174-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:22.873252 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:50:22.873252 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:50:22.875370 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-32973e03-c469-4c62-9fea-5cfbf494bab0 tempest-ServicesAdminTestJSON-544901174 tempest-ServicesAdminTestJSON-544901174-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:22.876681 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-32973e03-c469-4c62-9fea-5cfbf494bab0 tempest-ServicesAdminTestJSON-544901174 tempest-ServicesAdminTestJSON-544901174-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:22.878089 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-32973e03-c469-4c62-9fea-5cfbf494bab0 tempest-ServicesAdminTestJSON-544901174 tempest-ServicesAdminTestJSON-544901174-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:22.882622 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-32973e03-c469-4c62-9fea-5cfbf494bab0 tempest-ServicesAdminTestJSON-544901174 tempest-ServicesAdminTestJSON-544901174-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:22.910934 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-32973e03-c469-4c62-9fea-5cfbf494bab0 tempest-ServicesAdminTestJSON-544901174 tempest-ServicesAdminTestJSON-544901174-project-admin] 10.222.0.46 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.043486 Jan 15 20:50:22.918486 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 363/669] 10.222.0.46 () {58 vars in 1175 bytes} [Sat Jan 15 20:50:22 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:50:22.923296 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-b85b48db-86eb-4508-8b4c-46531560b5bc tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:22.926791 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-299c77f4-7b35-40b1-8ad3-758c2860f08e tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:50:22.932407 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-b85b48db-86eb-4508-8b4c-46531560b5bc tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:22.933760 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-299c77f4-7b35-40b1-8ad3-758c2860f08e tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 98d0ca37-0175-44e2-8a1d-965cdc517daf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:22.934007 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-b85b48db-86eb-4508-8b4c-46531560b5bc tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:22.935330 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b85b48db-86eb-4508-8b4c-46531560b5bc tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] 10.222.0.46 "GET /compute/v2.1/servers/1085522d-3ccc-4de0-b9dd-01c374e1f0ca" status: 200 len: 1362 microversion: 2.25 time: 0.343800 Jan 15 20:50:22.936098 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 307/670] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:50:22 2022] GET /compute/v2.1/servers/1085522d-3ccc-4de0-b9dd-01c374e1f0ca => generated 1362 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:50:22.940162 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-299c77f4-7b35-40b1-8ad3-758c2860f08e tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:22.940616 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-299c77f4-7b35-40b1-8ad3-758c2860f08e tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:22.941455 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-299c77f4-7b35-40b1-8ad3-758c2860f08e tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:22.941848 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e73eacf8-72a4-4d11-bffa-966f0adc1730 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:22.941976 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-299c77f4-7b35-40b1-8ad3-758c2860f08e tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:22.942783 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e73eacf8-72a4-4d11-bffa-966f0adc1730 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: e3fa2f27-df7a-4ecb-9bba-c970e3e7d106] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:22.950187 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e73eacf8-72a4-4d11-bffa-966f0adc1730 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:22.950636 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e73eacf8-72a4-4d11-bffa-966f0adc1730 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:22.951525 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e73eacf8-72a4-4d11-bffa-966f0adc1730 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:22.951963 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e73eacf8-72a4-4d11-bffa-966f0adc1730 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:22.985123 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-299c77f4-7b35-40b1-8ad3-758c2860f08e tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action" status: 200 len: 32634 microversion: 2.1 time: 0.069608 Jan 15 20:50:22.987112 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 364/671] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:50:22 2022] POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action => generated 32634 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:50:22.993684 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-2a6b15af-5b36-4e5c-a218-acea0d49e3ed req-0d89acd5-866e-4b4f-877d-edcfc121bf8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb4f55a3-96ef-4194-8506-e430b262c1f0", "tag": "5a7af53b-c710-4979-b238-041a49a6e6d6"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:50:22.996219 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:50:22.996219 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:50:23.008007 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-2a6b15af-5b36-4e5c-a218-acea0d49e3ed req-0d89acd5-866e-4b4f-877d-edcfc121bf8d service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:23.008542 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-2a6b15af-5b36-4e5c-a218-acea0d49e3ed req-0d89acd5-866e-4b4f-877d-edcfc121bf8d service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:23.021775 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-2a6b15af-5b36-4e5c-a218-acea0d49e3ed req-0d89acd5-866e-4b4f-877d-edcfc121bf8d service nova] Creating event network-changed:5a7af53b-c710-4979-b238-041a49a6e6d6 for instance eb4f55a3-96ef-4194-8506-e430b262c1f0 on nch2-master-1 Jan 15 20:50:23.027769 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-2a6b15af-5b36-4e5c-a218-acea0d49e3ed req-0d89acd5-866e-4b4f-877d-edcfc121bf8d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038870 Jan 15 20:50:23.028506 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 365/672] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:50:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:50:23.033729 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-888518f2-38fa-4ed4-9929-093d8a663e7f tempest-ServicesAdminTestJSON-544901174 tempest-ServicesAdminTestJSON-544901174-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:23.035367 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:50:23.035367 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:50:23.041771 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-888518f2-38fa-4ed4-9929-093d8a663e7f tempest-ServicesAdminTestJSON-544901174 tempest-ServicesAdminTestJSON-544901174-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:23.042649 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-888518f2-38fa-4ed4-9929-093d8a663e7f tempest-ServicesAdminTestJSON-544901174 tempest-ServicesAdminTestJSON-544901174-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:23.051077 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-888518f2-38fa-4ed4-9929-093d8a663e7f tempest-ServicesAdminTestJSON-544901174 tempest-ServicesAdminTestJSON-544901174-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:23.052154 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-888518f2-38fa-4ed4-9929-093d8a663e7f tempest-ServicesAdminTestJSON-544901174 tempest-ServicesAdminTestJSON-544901174-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:23.134788 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-888518f2-38fa-4ed4-9929-093d8a663e7f tempest-ServicesAdminTestJSON-544901174 tempest-ServicesAdminTestJSON-544901174-project-admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.104754 Jan 15 20:50:23.136018 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 366/673] 10.222.0.46 () {58 vars in 1136 bytes} [Sat Jan 15 20:50:23 2022] GET /compute/v2.1/os-services => generated 947 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:50:23.153677 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-6d5d2292-769e-4a41-ab00-09d0da49c246 req-070737bb-44de-4d0b-a42d-f7d8cdac5ef1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1085522d-3ccc-4de0-b9dd-01c374e1f0ca", "tag": "fd65475a-f2b6-4fd5-b84f-f1f5f96b1f50"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:50:23.159435 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:50:23.159435 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:50:23.185472 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-6d5d2292-769e-4a41-ab00-09d0da49c246 req-070737bb-44de-4d0b-a42d-f7d8cdac5ef1 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:23.186299 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-6d5d2292-769e-4a41-ab00-09d0da49c246 req-070737bb-44de-4d0b-a42d-f7d8cdac5ef1 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:23.216613 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-6d5d2292-769e-4a41-ab00-09d0da49c246 req-070737bb-44de-4d0b-a42d-f7d8cdac5ef1 service nova] Creating event network-changed:fd65475a-f2b6-4fd5-b84f-f1f5f96b1f50 for instance 1085522d-3ccc-4de0-b9dd-01c374e1f0ca on nch1-master-1 Jan 15 20:50:23.230657 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-6d5d2292-769e-4a41-ab00-09d0da49c246 req-070737bb-44de-4d0b-a42d-f7d8cdac5ef1 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082097 Jan 15 20:50:23.235447 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 367/674] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:50:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 20:50:23.294756 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-68184def-01f0-4b81-b557-acf0f48cf20d tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:23.299351 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-68184def-01f0-4b81-b557-acf0f48cf20d tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] [instance: e3b7a713-3f0d-43e2-b466-6637bc567256] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:23.299794 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-e73eacf8-72a4-4d11-bffa-966f0adc1730 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:23.312412 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e73eacf8-72a4-4d11-bffa-966f0adc1730 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/e3fa2f27-df7a-4ecb-9bba-c970e3e7d106" status: 200 len: 1471 microversion: 2.1 time: 0.375088 Jan 15 20:50:23.314694 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 308/675] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:22 2022] GET /compute/v2.1/servers/e3fa2f27-df7a-4ecb-9bba-c970e3e7d106 => generated 1471 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:23.325144 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-68184def-01f0-4b81-b557-acf0f48cf20d tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:23.325808 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-68184def-01f0-4b81-b557-acf0f48cf20d tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:23.326603 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-68184def-01f0-4b81-b557-acf0f48cf20d tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:23.327332 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-68184def-01f0-4b81-b557-acf0f48cf20d tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:23.551604 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-353eebb4-2a6f-4a7a-9e66-59f17de5f4e1 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:23.552751 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-353eebb4-2a6f-4a7a-9e66-59f17de5f4e1 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] [instance: 6d487317-4968-4a06-ad7b-4484e8d50f10] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:23.562594 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-353eebb4-2a6f-4a7a-9e66-59f17de5f4e1 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:23.565543 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-353eebb4-2a6f-4a7a-9e66-59f17de5f4e1 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:23.566587 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-353eebb4-2a6f-4a7a-9e66-59f17de5f4e1 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:23.568220 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-353eebb4-2a6f-4a7a-9e66-59f17de5f4e1 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:23.653802 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-353eebb4-2a6f-4a7a-9e66-59f17de5f4e1 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:23.657691 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-353eebb4-2a6f-4a7a-9e66-59f17de5f4e1 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:23.658724 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.objects.instance [None req-353eebb4-2a6f-4a7a-9e66-59f17de5f4e1 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Lazy-loading 'fault' on Instance uuid 6d487317-4968-4a06-ad7b-4484e8d50f10 {{(pid=129365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 20:50:23.865807 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-353eebb4-2a6f-4a7a-9e66-59f17de5f4e1 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd06a1f6896564bb58b457d0642f8302c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89aabae1afe4a5a88ed97e87b5266ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:23.876710 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-353eebb4-2a6f-4a7a-9e66-59f17de5f4e1 tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] 10.222.0.46 "GET /compute/v2.1/servers/6d487317-4968-4a06-ad7b-4484e8d50f10" status: 200 len: 1311 microversion: 2.1 time: 0.328736 Jan 15 20:50:23.880094 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 309/676] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:23 2022] GET /compute/v2.1/servers/6d487317-4968-4a06-ad7b-4484e8d50f10 => generated 1311 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:23.890555 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3bdc58b7-7fe8-493c-880e-34fcd43b13b5 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:23.890555 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-3bdc58b7-7fe8-493c-880e-34fcd43b13b5 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] [instance: eb4f55a3-96ef-4194-8506-e430b262c1f0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:23.908321 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3bdc58b7-7fe8-493c-880e-34fcd43b13b5 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:23.912694 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3bdc58b7-7fe8-493c-880e-34fcd43b13b5 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:23.914742 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3bdc58b7-7fe8-493c-880e-34fcd43b13b5 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:23.916866 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3bdc58b7-7fe8-493c-880e-34fcd43b13b5 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:24.138076 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-68184def-01f0-4b81-b557-acf0f48cf20d tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d4a57cfaa145009ba9cc8f21d9e8ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4a26c8edac44c8b26fd4e43813412d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:24.147144 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-68184def-01f0-4b81-b557-acf0f48cf20d tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] 10.222.0.46 "GET /compute/v2.1/servers/e3b7a713-3f0d-43e2-b466-6637bc567256" status: 200 len: 1464 microversion: 2.1 time: 0.859411 Jan 15 20:50:24.148693 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 368/677] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:23 2022] GET /compute/v2.1/servers/e3b7a713-3f0d-43e2-b466-6637bc567256 => generated 1464 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:24.155380 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0ed6629b-847d-4324-822a-252bde747a53 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:24.156268 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-0ed6629b-847d-4324-822a-252bde747a53 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] [instance: 1085522d-3ccc-4de0-b9dd-01c374e1f0ca] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:24.163968 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0ed6629b-847d-4324-822a-252bde747a53 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:24.164420 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0ed6629b-847d-4324-822a-252bde747a53 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:24.166054 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0ed6629b-847d-4324-822a-252bde747a53 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:24.166502 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0ed6629b-847d-4324-822a-252bde747a53 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:24.476911 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-3bdc58b7-7fe8-493c-880e-34fcd43b13b5 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc38f86758f9416b9e7f6915de0359d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8cfe33be708428abef52f5e8e25621b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:24.488001 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3bdc58b7-7fe8-493c-880e-34fcd43b13b5 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] 10.222.0.46 "GET /compute/v2.1/servers/eb4f55a3-96ef-4194-8506-e430b262c1f0" status: 200 len: 1319 microversion: 2.1 time: 0.605501 Jan 15 20:50:24.488594 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 310/678] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:23 2022] GET /compute/v2.1/servers/eb4f55a3-96ef-4194-8506-e430b262c1f0 => generated 1319 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:24.503450 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-03d32cb3-fd00-4763-a332-c1ece11a0073 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:50:24.504831 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-03d32cb3-fd00-4763-a332-c1ece11a0073 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 98d0ca37-0175-44e2-8a1d-965cdc517daf] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:24.511734 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-03d32cb3-fd00-4763-a332-c1ece11a0073 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:24.512384 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-03d32cb3-fd00-4763-a332-c1ece11a0073 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:24.513249 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-03d32cb3-fd00-4763-a332-c1ece11a0073 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:24.513702 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-03d32cb3-fd00-4763-a332-c1ece11a0073 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:24.560780 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-03d32cb3-fd00-4763-a332-c1ece11a0073 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action" status: 200 len: 32634 microversion: 2.1 time: 0.060210 Jan 15 20:50:24.561805 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 311/679] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:50:24 2022] POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action => generated 32634 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:50:24.567373 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-69dff8e3-3761-43a3-badc-f3d087fffe20 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:24.568316 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-69dff8e3-3761-43a3-badc-f3d087fffe20 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] [instance: b191ed6c-040a-4702-8e15-86272f9d1847] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:24.576476 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-69dff8e3-3761-43a3-badc-f3d087fffe20 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:24.578982 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-69dff8e3-3761-43a3-badc-f3d087fffe20 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:24.579358 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-69dff8e3-3761-43a3-badc-f3d087fffe20 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:24.579752 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-0ed6629b-847d-4324-822a-252bde747a53 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:24.580569 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-69dff8e3-3761-43a3-badc-f3d087fffe20 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:24.608782 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-0ed6629b-847d-4324-822a-252bde747a53 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:24.615302 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-0ed6629b-847d-4324-822a-252bde747a53 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:24.616620 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0ed6629b-847d-4324-822a-252bde747a53 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] 10.222.0.46 "GET /compute/v2.1/servers/1085522d-3ccc-4de0-b9dd-01c374e1f0ca" status: 200 len: 1362 microversion: 2.25 time: 0.465761 Jan 15 20:50:24.619254 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 369/680] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:50:24 2022] GET /compute/v2.1/servers/1085522d-3ccc-4de0-b9dd-01c374e1f0ca => generated 1362 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:50:24.626593 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-5ae3c6ca-86a6-4b2b-84b3-106678c6b7d3 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:24.627213 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-5ae3c6ca-86a6-4b2b-84b3-106678c6b7d3 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: e3fa2f27-df7a-4ecb-9bba-c970e3e7d106] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:24.634310 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5ae3c6ca-86a6-4b2b-84b3-106678c6b7d3 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:24.635123 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5ae3c6ca-86a6-4b2b-84b3-106678c6b7d3 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:24.636088 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5ae3c6ca-86a6-4b2b-84b3-106678c6b7d3 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:24.636796 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5ae3c6ca-86a6-4b2b-84b3-106678c6b7d3 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:25.019082 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-69dff8e3-3761-43a3-badc-f3d087fffe20 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d4a57cfaa145009ba9cc8f21d9e8ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4a26c8edac44c8b26fd4e43813412d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:25.027052 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-69dff8e3-3761-43a3-badc-f3d087fffe20 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] 10.222.0.46 "GET /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847" status: 200 len: 1463 microversion: 2.1 time: 0.463893 Jan 15 20:50:25.027611 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 312/681] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:24 2022] GET /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847 => generated 1463 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:25.045915 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-023dbc68-1512-484e-bcec-c13037c8547b tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:25.047747 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-023dbc68-1512-484e-bcec-c13037c8547b tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] [instance: 6d487317-4968-4a06-ad7b-4484e8d50f10] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:25.055580 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-023dbc68-1512-484e-bcec-c13037c8547b tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:25.056019 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-023dbc68-1512-484e-bcec-c13037c8547b tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:25.057317 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-023dbc68-1512-484e-bcec-c13037c8547b tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:25.058329 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-023dbc68-1512-484e-bcec-c13037c8547b tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:25.074047 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-023dbc68-1512-484e-bcec-c13037c8547b tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] HTTP exception thrown: Instance 6d487317-4968-4a06-ad7b-4484e8d50f10 could not be found. Jan 15 20:50:25.074889 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-023dbc68-1512-484e-bcec-c13037c8547b tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] Returning 404 to user: Instance 6d487317-4968-4a06-ad7b-4484e8d50f10 could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:50:25.075875 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-023dbc68-1512-484e-bcec-c13037c8547b tempest-ServersAdminNegativeTestJSON-267829026 tempest-ServersAdminNegativeTestJSON-267829026-project] 10.222.0.46 "GET /compute/v2.1/servers/6d487317-4968-4a06-ad7b-4484e8d50f10" status: 404 len: 111 microversion: 2.1 time: 0.047282 Jan 15 20:50:25.076428 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 313/682] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:25 2022] GET /compute/v2.1/servers/6d487317-4968-4a06-ad7b-4484e8d50f10 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:50:25.081313 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-8d42e76a-7d2a-429f-bcb5-6ba6ac5dd994 req-246d4be8-4ad0-4d80-8a9c-18d48e9889a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d487317-4968-4a06-ad7b-4484e8d50f10", "name": "network-vif-deleted", "tag": "efa38908-68d7-44e3-a60f-24a9f554d75e"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:50:25.082557 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-5ae3c6ca-86a6-4b2b-84b3-106678c6b7d3 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:25.084157 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:50:25.084157 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:50:25.091911 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-5ae3c6ca-86a6-4b2b-84b3-106678c6b7d3 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/e3fa2f27-df7a-4ecb-9bba-c970e3e7d106" status: 200 len: 1471 microversion: 2.1 time: 0.470918 Jan 15 20:50:25.092701 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-8d42e76a-7d2a-429f-bcb5-6ba6ac5dd994 req-246d4be8-4ad0-4d80-8a9c-18d48e9889a2 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:25.092825 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 370/683] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:24 2022] GET /compute/v2.1/servers/e3fa2f27-df7a-4ecb-9bba-c970e3e7d106 => generated 1471 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:25.093422 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-8d42e76a-7d2a-429f-bcb5-6ba6ac5dd994 req-246d4be8-4ad0-4d80-8a9c-18d48e9889a2 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:25.106594 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-8d42e76a-7d2a-429f-bcb5-6ba6ac5dd994 req-246d4be8-4ad0-4d80-8a9c-18d48e9889a2 service nova] Creating event network-vif-deleted:efa38908-68d7-44e3-a60f-24a9f554d75e for instance 6d487317-4968-4a06-ad7b-4484e8d50f10 on nch2-master-1 Jan 15 20:50:25.114530 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-8d42e76a-7d2a-429f-bcb5-6ba6ac5dd994 req-246d4be8-4ad0-4d80-8a9c-18d48e9889a2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035980 Jan 15 20:50:25.115643 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 314/684] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:50:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:50:25.156633 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f7e58446-508d-4bb6-998c-1d615b14d179 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-618409583", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "b191ed6c-040a-4702-8e15-86272f9d1847"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:50:25.218263 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.network.neutron [None req-f7e58446-508d-4bb6-998c-1d615b14d179 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] validate_networks() for None {{(pid=129366) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 20:50:25.506238 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-71293cba-d8b7-4a96-a1ff-deb7a412c571 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:25.506935 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-71293cba-d8b7-4a96-a1ff-deb7a412c571 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] [instance: eb4f55a3-96ef-4194-8506-e430b262c1f0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:25.519639 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-71293cba-d8b7-4a96-a1ff-deb7a412c571 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:25.520186 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-71293cba-d8b7-4a96-a1ff-deb7a412c571 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:25.521378 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-71293cba-d8b7-4a96-a1ff-deb7a412c571 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:25.521995 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-71293cba-d8b7-4a96-a1ff-deb7a412c571 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:25.655650 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-f7e58446-508d-4bb6-998c-1d615b14d179 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Flavor limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 20:50:25.656765 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-f7e58446-508d-4bb6-998c-1d615b14d179 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Image limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 20:50:25.657304 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-f7e58446-508d-4bb6-998c-1d615b14d179 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Flavor pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 20:50:25.657772 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-f7e58446-508d-4bb6-998c-1d615b14d179 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Image pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 20:50:25.658793 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-f7e58446-508d-4bb6-998c-1d615b14d179 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 20:50:25.682780 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f7e58446-508d-4bb6-998c-1d615b14d179 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:25.683229 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f7e58446-508d-4bb6-998c-1d615b14d179 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:25.684044 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f7e58446-508d-4bb6-998c-1d615b14d179 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:25.684482 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f7e58446-508d-4bb6-998c-1d615b14d179 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:25.726872 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-f7e58446-508d-4bb6-998c-1d615b14d179 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Getting quotas for project 2f4a26c8edac44c8b26fd4e43813412d. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:50:25.732872 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-f7e58446-508d-4bb6-998c-1d615b14d179 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Getting quotas for user 32d4a57cfaa145009ba9cc8f21d9e8ac and project 2f4a26c8edac44c8b26fd4e43813412d. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:50:25.773840 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f7e58446-508d-4bb6-998c-1d615b14d179 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Going to run 1 instances... {{(pid=129366) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 20:50:25.783752 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f7e58446-508d-4bb6-998c-1d615b14d179 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] [instance: f89db7df-a7e8-4138-8949-d76e2ccd282d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 20:50:25.830129 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-71293cba-d8b7-4a96-a1ff-deb7a412c571 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc38f86758f9416b9e7f6915de0359d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8cfe33be708428abef52f5e8e25621b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:25.841409 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-71293cba-d8b7-4a96-a1ff-deb7a412c571 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] 10.222.0.46 "GET /compute/v2.1/servers/eb4f55a3-96ef-4194-8506-e430b262c1f0" status: 200 len: 1319 microversion: 2.1 time: 0.339546 Jan 15 20:50:25.851195 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 315/685] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:25 2022] GET /compute/v2.1/servers/eb4f55a3-96ef-4194-8506-e430b262c1f0 => generated 1319 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:25.856553 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b582b3b2-14f3-4248-b5a2-94f24a33c0f7 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:50:25.857512 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b582b3b2-14f3-4248-b5a2-94f24a33c0f7 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 98d0ca37-0175-44e2-8a1d-965cdc517daf] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:25.872187 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b582b3b2-14f3-4248-b5a2-94f24a33c0f7 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:25.872812 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b582b3b2-14f3-4248-b5a2-94f24a33c0f7 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:25.893946 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b582b3b2-14f3-4248-b5a2-94f24a33c0f7 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:25.894432 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f7e58446-508d-4bb6-998c-1d615b14d179 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.742419 Jan 15 20:50:25.897254 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 371/686] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 20:50:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 746 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 20:50:25.901004 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b582b3b2-14f3-4248-b5a2-94f24a33c0f7 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:25.908261 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-32ad2180-eeb4-4374-93ee-a0f2369b6854 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:25.911625 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-32ad2180-eeb4-4374-93ee-a0f2369b6854 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] [instance: 1085522d-3ccc-4de0-b9dd-01c374e1f0ca] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:25.920991 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-32ad2180-eeb4-4374-93ee-a0f2369b6854 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:25.921919 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-32ad2180-eeb4-4374-93ee-a0f2369b6854 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:25.923075 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-32ad2180-eeb4-4374-93ee-a0f2369b6854 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:25.923582 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-32ad2180-eeb4-4374-93ee-a0f2369b6854 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:26.005753 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b582b3b2-14f3-4248-b5a2-94f24a33c0f7 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action" status: 200 len: 32634 microversion: 2.1 time: 0.159144 Jan 15 20:50:26.007947 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 316/687] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:50:25 2022] POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action => generated 32634 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:50:26.015388 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-abf30e2f-11a3-49b7-bb15-ffe0e5804dad tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:26.016256 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-abf30e2f-11a3-49b7-bb15-ffe0e5804dad tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] [instance: f89db7df-a7e8-4138-8949-d76e2ccd282d] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:26.166890 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-abf30e2f-11a3-49b7-bb15-ffe0e5804dad tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d4a57cfaa145009ba9cc8f21d9e8ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4a26c8edac44c8b26fd4e43813412d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:26.174045 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-abf30e2f-11a3-49b7-bb15-ffe0e5804dad tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] 10.222.0.46 "GET /compute/v2.1/servers/f89db7df-a7e8-4138-8949-d76e2ccd282d" status: 200 len: 1213 microversion: 2.1 time: 0.163704 Jan 15 20:50:26.174628 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 317/688] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:26 2022] GET /compute/v2.1/servers/f89db7df-a7e8-4138-8949-d76e2ccd282d => generated 1213 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:26.181433 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2b7d8127-039c-41dc-a558-7790d52a4c1f tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:26.184439 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-2b7d8127-039c-41dc-a558-7790d52a4c1f tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: e3fa2f27-df7a-4ecb-9bba-c970e3e7d106] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:26.201964 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2b7d8127-039c-41dc-a558-7790d52a4c1f tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:26.203369 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2b7d8127-039c-41dc-a558-7790d52a4c1f tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:26.205118 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2b7d8127-039c-41dc-a558-7790d52a4c1f tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:26.221555 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2b7d8127-039c-41dc-a558-7790d52a4c1f tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:26.470896 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-32ad2180-eeb4-4374-93ee-a0f2369b6854 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:26.483884 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-32ad2180-eeb4-4374-93ee-a0f2369b6854 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:26.489763 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-32ad2180-eeb4-4374-93ee-a0f2369b6854 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:26.493794 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-32ad2180-eeb4-4374-93ee-a0f2369b6854 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] 10.222.0.46 "GET /compute/v2.1/servers/1085522d-3ccc-4de0-b9dd-01c374e1f0ca" status: 200 len: 1362 microversion: 2.25 time: 0.592515 Jan 15 20:50:26.504644 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 372/689] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:50:25 2022] GET /compute/v2.1/servers/1085522d-3ccc-4de0-b9dd-01c374e1f0ca => generated 1362 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:50:26.599344 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-2b7d8127-039c-41dc-a558-7790d52a4c1f tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:26.620691 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2b7d8127-039c-41dc-a558-7790d52a4c1f tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/e3fa2f27-df7a-4ecb-9bba-c970e3e7d106" status: 200 len: 1476 microversion: 2.1 time: 0.442548 Jan 15 20:50:26.622307 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 318/690] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:26 2022] GET /compute/v2.1/servers/e3fa2f27-df7a-4ecb-9bba-c970e3e7d106 => generated 1476 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:26.859256 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-fc33b9e9-e5f2-4cb7-9d62-34321e337a5f tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:26.859860 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-fc33b9e9-e5f2-4cb7-9d62-34321e337a5f tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] [instance: eb4f55a3-96ef-4194-8506-e430b262c1f0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:26.866558 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fc33b9e9-e5f2-4cb7-9d62-34321e337a5f tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:26.867011 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fc33b9e9-e5f2-4cb7-9d62-34321e337a5f tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:26.867824 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fc33b9e9-e5f2-4cb7-9d62-34321e337a5f tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:26.868262 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fc33b9e9-e5f2-4cb7-9d62-34321e337a5f tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:27.019534 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f3c3af55-468a-40a6-ae54-fb902ec7f109 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:50:27.020874 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f3c3af55-468a-40a6-ae54-fb902ec7f109 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 98d0ca37-0175-44e2-8a1d-965cdc517daf] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:27.028450 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f3c3af55-468a-40a6-ae54-fb902ec7f109 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:27.029197 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f3c3af55-468a-40a6-ae54-fb902ec7f109 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:27.030159 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f3c3af55-468a-40a6-ae54-fb902ec7f109 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:27.030751 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f3c3af55-468a-40a6-ae54-fb902ec7f109 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:27.057783 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-fc33b9e9-e5f2-4cb7-9d62-34321e337a5f tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc38f86758f9416b9e7f6915de0359d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8cfe33be708428abef52f5e8e25621b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:27.066063 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-fc33b9e9-e5f2-4cb7-9d62-34321e337a5f tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] 10.222.0.46 "GET /compute/v2.1/servers/eb4f55a3-96ef-4194-8506-e430b262c1f0" status: 200 len: 1319 microversion: 2.1 time: 0.210368 Jan 15 20:50:27.068892 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 373/691] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:26 2022] GET /compute/v2.1/servers/eb4f55a3-96ef-4194-8506-e430b262c1f0 => generated 1319 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:27.098080 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f3c3af55-468a-40a6-ae54-fb902ec7f109 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action" status: 200 len: 32634 microversion: 2.1 time: 0.082931 Jan 15 20:50:27.099268 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 319/692] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:50:27 2022] POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action => generated 32634 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 20:50:27.194982 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-221af228-ec01-40fd-baba-094acfc1330a tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:27.196450 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-221af228-ec01-40fd-baba-094acfc1330a tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] [instance: f89db7df-a7e8-4138-8949-d76e2ccd282d] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:27.204416 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-221af228-ec01-40fd-baba-094acfc1330a tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:27.204964 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-221af228-ec01-40fd-baba-094acfc1330a tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:27.206730 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-221af228-ec01-40fd-baba-094acfc1330a tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:27.207455 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-221af228-ec01-40fd-baba-094acfc1330a tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:27.289327 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-221af228-ec01-40fd-baba-094acfc1330a tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d4a57cfaa145009ba9cc8f21d9e8ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4a26c8edac44c8b26fd4e43813412d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:27.299679 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-221af228-ec01-40fd-baba-094acfc1330a tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] 10.222.0.46 "GET /compute/v2.1/servers/f89db7df-a7e8-4138-8949-d76e2ccd282d" status: 200 len: 1265 microversion: 2.1 time: 0.108625 Jan 15 20:50:27.300884 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 374/693] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:27 2022] GET /compute/v2.1/servers/f89db7df-a7e8-4138-8949-d76e2ccd282d => generated 1265 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:27.513316 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d604dc55-45f2-4372-a82f-cd3013a1f49d tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:27.514358 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d604dc55-45f2-4372-a82f-cd3013a1f49d tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] [instance: 1085522d-3ccc-4de0-b9dd-01c374e1f0ca] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:27.528034 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d604dc55-45f2-4372-a82f-cd3013a1f49d tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:27.528803 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d604dc55-45f2-4372-a82f-cd3013a1f49d tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:27.529843 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d604dc55-45f2-4372-a82f-cd3013a1f49d tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:27.530471 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d604dc55-45f2-4372-a82f-cd3013a1f49d tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:27.644064 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f74c288a-7293-45b1-82af-46d2a208dac7 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:27.645063 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f74c288a-7293-45b1-82af-46d2a208dac7 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: e3fa2f27-df7a-4ecb-9bba-c970e3e7d106] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:27.654713 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f74c288a-7293-45b1-82af-46d2a208dac7 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:27.656178 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f74c288a-7293-45b1-82af-46d2a208dac7 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:27.657462 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f74c288a-7293-45b1-82af-46d2a208dac7 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:27.658383 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f74c288a-7293-45b1-82af-46d2a208dac7 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:27.996702 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-d604dc55-45f2-4372-a82f-cd3013a1f49d tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:28.012370 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-d604dc55-45f2-4372-a82f-cd3013a1f49d tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:28.017097 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-d604dc55-45f2-4372-a82f-cd3013a1f49d tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:28.018531 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d604dc55-45f2-4372-a82f-cd3013a1f49d tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] 10.222.0.46 "GET /compute/v2.1/servers/1085522d-3ccc-4de0-b9dd-01c374e1f0ca" status: 200 len: 1362 microversion: 2.25 time: 0.510275 Jan 15 20:50:28.021722 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 320/694] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:50:27 2022] GET /compute/v2.1/servers/1085522d-3ccc-4de0-b9dd-01c374e1f0ca => generated 1362 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:50:28.055524 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-f74c288a-7293-45b1-82af-46d2a208dac7 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:28.063614 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f74c288a-7293-45b1-82af-46d2a208dac7 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/e3fa2f27-df7a-4ecb-9bba-c970e3e7d106" status: 200 len: 1476 microversion: 2.1 time: 0.425960 Jan 15 20:50:28.064195 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 375/695] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:27 2022] GET /compute/v2.1/servers/e3fa2f27-df7a-4ecb-9bba-c970e3e7d106 => generated 1476 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:28.084899 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-bf069242-b77f-4c0f-8847-eb62fdf193f4 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:28.085909 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-bf069242-b77f-4c0f-8847-eb62fdf193f4 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] [instance: eb4f55a3-96ef-4194-8506-e430b262c1f0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:28.110946 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-fb9d5af4-c051-4579-b0cd-d8a8334c0276 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:50:28.112340 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-fb9d5af4-c051-4579-b0cd-d8a8334c0276 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 98d0ca37-0175-44e2-8a1d-965cdc517daf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:28.117912 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bf069242-b77f-4c0f-8847-eb62fdf193f4 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:28.121930 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fb9d5af4-c051-4579-b0cd-d8a8334c0276 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:28.122385 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fb9d5af4-c051-4579-b0cd-d8a8334c0276 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:28.123178 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fb9d5af4-c051-4579-b0cd-d8a8334c0276 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:28.123639 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fb9d5af4-c051-4579-b0cd-d8a8334c0276 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:28.124335 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bf069242-b77f-4c0f-8847-eb62fdf193f4 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:28.128225 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bf069242-b77f-4c0f-8847-eb62fdf193f4 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:28.129384 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bf069242-b77f-4c0f-8847-eb62fdf193f4 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:28.201503 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-fb9d5af4-c051-4579-b0cd-d8a8334c0276 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action" status: 200 len: 32634 microversion: 2.1 time: 0.093944 Jan 15 20:50:28.203141 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 376/696] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:50:28 2022] POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action => generated 32634 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:50:28.329390 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1f771dad-8868-40fa-9353-8926b98da5c9 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:28.330429 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-1f771dad-8868-40fa-9353-8926b98da5c9 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] [instance: f89db7df-a7e8-4138-8949-d76e2ccd282d] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:28.351734 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1f771dad-8868-40fa-9353-8926b98da5c9 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:28.352940 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1f771dad-8868-40fa-9353-8926b98da5c9 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:28.355391 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1f771dad-8868-40fa-9353-8926b98da5c9 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:28.356410 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1f771dad-8868-40fa-9353-8926b98da5c9 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:28.515925 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-1f771dad-8868-40fa-9353-8926b98da5c9 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d4a57cfaa145009ba9cc8f21d9e8ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4a26c8edac44c8b26fd4e43813412d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:28.530694 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-1f771dad-8868-40fa-9353-8926b98da5c9 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] 10.222.0.46 "GET /compute/v2.1/servers/f89db7df-a7e8-4138-8949-d76e2ccd282d" status: 200 len: 1271 microversion: 2.1 time: 0.216287 Jan 15 20:50:28.532909 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 377/697] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:28 2022] GET /compute/v2.1/servers/f89db7df-a7e8-4138-8949-d76e2ccd282d => generated 1271 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:50:28.568589 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-bf069242-b77f-4c0f-8847-eb62fdf193f4 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc38f86758f9416b9e7f6915de0359d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8cfe33be708428abef52f5e8e25621b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:28.582175 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-bf069242-b77f-4c0f-8847-eb62fdf193f4 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] 10.222.0.46 "GET /compute/v2.1/servers/eb4f55a3-96ef-4194-8506-e430b262c1f0" status: 200 len: 1319 microversion: 2.1 time: 0.502486 Jan 15 20:50:28.583094 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 321/698] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:28 2022] GET /compute/v2.1/servers/eb4f55a3-96ef-4194-8506-e430b262c1f0 => generated 1319 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:29.055113 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e30a2ccd-325b-49d0-876a-0ea589997809 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:29.061396 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e30a2ccd-325b-49d0-876a-0ea589997809 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] [instance: 1085522d-3ccc-4de0-b9dd-01c374e1f0ca] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:29.081372 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-22cd63cc-ac85-4f5f-8d86-74cf5a66ea86 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:29.082612 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-22cd63cc-ac85-4f5f-8d86-74cf5a66ea86 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: e3fa2f27-df7a-4ecb-9bba-c970e3e7d106] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:29.090827 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e30a2ccd-325b-49d0-876a-0ea589997809 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:29.092854 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e30a2ccd-325b-49d0-876a-0ea589997809 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:29.094341 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e30a2ccd-325b-49d0-876a-0ea589997809 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:29.095426 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-22cd63cc-ac85-4f5f-8d86-74cf5a66ea86 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:29.098796 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e30a2ccd-325b-49d0-876a-0ea589997809 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:29.099694 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-22cd63cc-ac85-4f5f-8d86-74cf5a66ea86 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:29.100708 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-22cd63cc-ac85-4f5f-8d86-74cf5a66ea86 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:29.101322 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-22cd63cc-ac85-4f5f-8d86-74cf5a66ea86 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:29.614576 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-e30a2ccd-325b-49d0-876a-0ea589997809 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:29.623584 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-e30a2ccd-325b-49d0-876a-0ea589997809 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:29.625636 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-e30a2ccd-325b-49d0-876a-0ea589997809 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:29.626926 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e30a2ccd-325b-49d0-876a-0ea589997809 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] 10.222.0.46 "GET /compute/v2.1/servers/1085522d-3ccc-4de0-b9dd-01c374e1f0ca" status: 200 len: 1362 microversion: 2.25 time: 0.583465 Jan 15 20:50:29.638332 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 378/699] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:50:29 2022] GET /compute/v2.1/servers/1085522d-3ccc-4de0-b9dd-01c374e1f0ca => generated 1362 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:50:29.643847 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-3e4c7092-275f-4d90-b7b4-4eb18ea49ed0 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:50:29.645250 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-3e4c7092-275f-4d90-b7b4-4eb18ea49ed0 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 98d0ca37-0175-44e2-8a1d-965cdc517daf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:29.647111 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-22cd63cc-ac85-4f5f-8d86-74cf5a66ea86 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:29.652556 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3e4c7092-275f-4d90-b7b4-4eb18ea49ed0 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:29.653443 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3e4c7092-275f-4d90-b7b4-4eb18ea49ed0 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:29.654427 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3e4c7092-275f-4d90-b7b4-4eb18ea49ed0 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:29.655042 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3e4c7092-275f-4d90-b7b4-4eb18ea49ed0 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:29.658285 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-22cd63cc-ac85-4f5f-8d86-74cf5a66ea86 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/e3fa2f27-df7a-4ecb-9bba-c970e3e7d106" status: 200 len: 1476 microversion: 2.1 time: 0.580572 Jan 15 20:50:29.663559 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 322/700] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:29 2022] GET /compute/v2.1/servers/e3fa2f27-df7a-4ecb-9bba-c970e3e7d106 => generated 1476 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:50:29.722135 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-3e4c7092-275f-4d90-b7b4-4eb18ea49ed0 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action" status: 200 len: 32634 microversion: 2.1 time: 0.082049 Jan 15 20:50:29.726125 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 379/701] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:50:29 2022] POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action => generated 32634 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:50:29.732106 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-bb739292-c58a-43c6-b31d-92ccbd5566b3 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:29.733757 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-bb739292-c58a-43c6-b31d-92ccbd5566b3 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] [instance: f89db7df-a7e8-4138-8949-d76e2ccd282d] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:29.776810 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bb739292-c58a-43c6-b31d-92ccbd5566b3 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:29.777650 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bb739292-c58a-43c6-b31d-92ccbd5566b3 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:29.781689 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bb739292-c58a-43c6-b31d-92ccbd5566b3 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:29.782318 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bb739292-c58a-43c6-b31d-92ccbd5566b3 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:29.942554 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-af7b106d-2d2c-40b9-94e5-8f386c571f9d tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-477397825", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:50:30.030768 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.network.neutron [None req-af7b106d-2d2c-40b9-94e5-8f386c571f9d tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] validate_networks() for None {{(pid=129365) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 20:50:30.370972 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-bb739292-c58a-43c6-b31d-92ccbd5566b3 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d4a57cfaa145009ba9cc8f21d9e8ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4a26c8edac44c8b26fd4e43813412d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:30.382046 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-bb739292-c58a-43c6-b31d-92ccbd5566b3 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] 10.222.0.46 "GET /compute/v2.1/servers/f89db7df-a7e8-4138-8949-d76e2ccd282d" status: 200 len: 1313 microversion: 2.1 time: 0.653879 Jan 15 20:50:30.383118 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 380/702] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:29 2022] GET /compute/v2.1/servers/f89db7df-a7e8-4138-8949-d76e2ccd282d => generated 1313 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:30.388728 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c086017b-25f0-40c3-817c-2b656f318772 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:30.389517 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c086017b-25f0-40c3-817c-2b656f318772 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] [instance: eb4f55a3-96ef-4194-8506-e430b262c1f0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:30.396081 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c086017b-25f0-40c3-817c-2b656f318772 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:30.397439 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c086017b-25f0-40c3-817c-2b656f318772 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:30.398653 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c086017b-25f0-40c3-817c-2b656f318772 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:30.401200 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c086017b-25f0-40c3-817c-2b656f318772 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:30.486778 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-af7b106d-2d2c-40b9-94e5-8f386c571f9d tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] Flavor limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 20:50:30.487800 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-af7b106d-2d2c-40b9-94e5-8f386c571f9d tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] Image limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 20:50:30.488460 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-af7b106d-2d2c-40b9-94e5-8f386c571f9d tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] Flavor pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 20:50:30.488901 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-af7b106d-2d2c-40b9-94e5-8f386c571f9d tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] Image pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 20:50:30.489477 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-af7b106d-2d2c-40b9-94e5-8f386c571f9d tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 20:50:30.501150 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-af7b106d-2d2c-40b9-94e5-8f386c571f9d tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:30.501893 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-af7b106d-2d2c-40b9-94e5-8f386c571f9d tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:30.502881 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-af7b106d-2d2c-40b9-94e5-8f386c571f9d tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:30.503479 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-af7b106d-2d2c-40b9-94e5-8f386c571f9d tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:30.529923 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-af7b106d-2d2c-40b9-94e5-8f386c571f9d tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] Getting quotas for project 25de5a60ff6f48aebb27a1ef9cbe0606. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:50:30.535194 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-af7b106d-2d2c-40b9-94e5-8f386c571f9d tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] Getting quotas for user f311520925464d1a8c7d7302a1ef4bba and project 25de5a60ff6f48aebb27a1ef9cbe0606. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:50:30.550802 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-af7b106d-2d2c-40b9-94e5-8f386c571f9d tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] Going to run 1 instances... {{(pid=129365) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 20:50:30.553654 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-af7b106d-2d2c-40b9-94e5-8f386c571f9d tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] [instance: 7a5972c0-eea6-4198-8532-1efff379b087] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129365) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 20:50:30.606743 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-af7b106d-2d2c-40b9-94e5-8f386c571f9d tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.941829 Jan 15 20:50:30.613413 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 323/703] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 20:50:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 949 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 20:50:30.625658 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-9dcf57bd-b9a9-43c3-9676-02e9a66cd26d req-d2863598-6df3-446c-946f-f9cb52bf3a9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f89db7df-a7e8-4138-8949-d76e2ccd282d", "tag": "903fc68a-fde5-420c-8bcf-272fee77950b"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:50:30.629199 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:50:30.629199 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:50:30.643598 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-9dcf57bd-b9a9-43c3-9676-02e9a66cd26d req-d2863598-6df3-446c-946f-f9cb52bf3a9a service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:30.644286 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-9dcf57bd-b9a9-43c3-9676-02e9a66cd26d req-d2863598-6df3-446c-946f-f9cb52bf3a9a service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:30.660392 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-9dcf57bd-b9a9-43c3-9676-02e9a66cd26d req-d2863598-6df3-446c-946f-f9cb52bf3a9a service nova] Creating event network-changed:903fc68a-fde5-420c-8bcf-272fee77950b for instance f89db7df-a7e8-4138-8949-d76e2ccd282d on nch2-master-1 Jan 15 20:50:30.667075 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-9dcf57bd-b9a9-43c3-9676-02e9a66cd26d req-d2863598-6df3-446c-946f-f9cb52bf3a9a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051644 Jan 15 20:50:30.667912 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 324/704] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:50:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:50:30.741663 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-778bd4e3-5025-43d9-9e72-4ab30d5d51ee tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1364430852", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "networks": [{"uuid": "364a58d7-d200-4c35-b6bd-a666c20a1fe8"}]}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:50:30.749737 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-c086017b-25f0-40c3-817c-2b656f318772 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc38f86758f9416b9e7f6915de0359d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8cfe33be708428abef52f5e8e25621b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:30.759986 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c086017b-25f0-40c3-817c-2b656f318772 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] 10.222.0.46 "GET /compute/v2.1/servers/eb4f55a3-96ef-4194-8506-e430b262c1f0" status: 200 len: 1319 microversion: 2.1 time: 0.374186 Jan 15 20:50:30.772424 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 381/705] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:30 2022] GET /compute/v2.1/servers/eb4f55a3-96ef-4194-8506-e430b262c1f0 => generated 1319 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:30.781028 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-7df0526b-b29d-4807-88d8-ae032dc552bd req-b407f007-c5d1-4b36-ac2d-5ac8487cb79f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3934550f-0131-4bd3-890b-edbaf4ccac0e", "name": "network-vif-plugged", "status": "completed", "tag": "d2632d9a-333c-439e-b179-55d658dedee2"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:50:30.783149 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:50:30.783149 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:50:30.791462 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-7df0526b-b29d-4807-88d8-ae032dc552bd req-b407f007-c5d1-4b36-ac2d-5ac8487cb79f service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:30.792219 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-7df0526b-b29d-4807-88d8-ae032dc552bd req-b407f007-c5d1-4b36-ac2d-5ac8487cb79f service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:30.811482 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.network.neutron [None req-778bd4e3-5025-43d9-9e72-4ab30d5d51ee tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] validate_networks() for [('364a58d7-d200-4c35-b6bd-a666c20a1fe8', None, None, None, None, None)] {{(pid=129365) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 20:50:30.824261 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-7df0526b-b29d-4807-88d8-ae032dc552bd req-b407f007-c5d1-4b36-ac2d-5ac8487cb79f service nova] Creating event network-vif-plugged:d2632d9a-333c-439e-b179-55d658dedee2 for instance 3934550f-0131-4bd3-890b-edbaf4ccac0e on nch2-master-1 Jan 15 20:50:30.830742 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-7df0526b-b29d-4807-88d8-ae032dc552bd req-b407f007-c5d1-4b36-ac2d-5ac8487cb79f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056697 Jan 15 20:50:30.831377 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 382/706] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:50:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:50:30.838067 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-6a87e13f-71c8-401d-8a10-554380964c8f tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:30.839552 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-6a87e13f-71c8-401d-8a10-554380964c8f tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] [instance: 7a5972c0-eea6-4198-8532-1efff379b087] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:30.971030 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-6a87e13f-71c8-401d-8a10-554380964c8f tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f311520925464d1a8c7d7302a1ef4bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25de5a60ff6f48aebb27a1ef9cbe0606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:30.983092 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-6a87e13f-71c8-401d-8a10-554380964c8f tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] 10.222.0.46 "GET /compute/v2.1/servers/7a5972c0-eea6-4198-8532-1efff379b087" status: 200 len: 1213 microversion: 2.1 time: 0.150290 Jan 15 20:50:30.983704 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 383/707] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:30 2022] GET /compute/v2.1/servers/7a5972c0-eea6-4198-8532-1efff379b087 => generated 1213 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:30.992497 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4e0a9643-f202-4609-bf2e-68c89af39698 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:30.997294 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-4e0a9643-f202-4609-bf2e-68c89af39698 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] [instance: 1085522d-3ccc-4de0-b9dd-01c374e1f0ca] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:31.009864 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4e0a9643-f202-4609-bf2e-68c89af39698 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:31.010320 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4e0a9643-f202-4609-bf2e-68c89af39698 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:31.011137 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4e0a9643-f202-4609-bf2e-68c89af39698 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:31.011555 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4e0a9643-f202-4609-bf2e-68c89af39698 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:31.429734 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-4e0a9643-f202-4609-bf2e-68c89af39698 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:31.439378 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-4e0a9643-f202-4609-bf2e-68c89af39698 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:31.441139 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-4e0a9643-f202-4609-bf2e-68c89af39698 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:31.442468 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-4e0a9643-f202-4609-bf2e-68c89af39698 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] 10.222.0.46 "GET /compute/v2.1/servers/1085522d-3ccc-4de0-b9dd-01c374e1f0ca" status: 200 len: 1362 microversion: 2.25 time: 0.457854 Jan 15 20:50:31.445849 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 384/708] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:50:30 2022] GET /compute/v2.1/servers/1085522d-3ccc-4de0-b9dd-01c374e1f0ca => generated 1362 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:50:31.461578 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-70be1c18-5c81-438c-ba6e-4e88dafc0b8c tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:31.462188 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-70be1c18-5c81-438c-ba6e-4e88dafc0b8c tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: e3fa2f27-df7a-4ecb-9bba-c970e3e7d106] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:31.472727 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-70be1c18-5c81-438c-ba6e-4e88dafc0b8c tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:31.473274 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-70be1c18-5c81-438c-ba6e-4e88dafc0b8c tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:31.474285 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-70be1c18-5c81-438c-ba6e-4e88dafc0b8c tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:31.474877 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-70be1c18-5c81-438c-ba6e-4e88dafc0b8c tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:32.189564 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-778bd4e3-5025-43d9-9e72-4ab30d5d51ee tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Flavor limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 20:50:32.190571 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-778bd4e3-5025-43d9-9e72-4ab30d5d51ee tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Image limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 20:50:32.191083 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-778bd4e3-5025-43d9-9e72-4ab30d5d51ee tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Flavor pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 20:50:32.191629 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-778bd4e3-5025-43d9-9e72-4ab30d5d51ee tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Image pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 20:50:32.192431 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-778bd4e3-5025-43d9-9e72-4ab30d5d51ee tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 20:50:32.202902 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-778bd4e3-5025-43d9-9e72-4ab30d5d51ee tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:32.203512 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-778bd4e3-5025-43d9-9e72-4ab30d5d51ee tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:32.204538 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-778bd4e3-5025-43d9-9e72-4ab30d5d51ee tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:32.205040 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-70be1c18-5c81-438c-ba6e-4e88dafc0b8c tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:32.205194 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-778bd4e3-5025-43d9-9e72-4ab30d5d51ee tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:32.224516 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-70be1c18-5c81-438c-ba6e-4e88dafc0b8c tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/e3fa2f27-df7a-4ecb-9bba-c970e3e7d106" status: 200 len: 1476 microversion: 2.1 time: 0.775387 Jan 15 20:50:32.225140 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 385/709] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:31 2022] GET /compute/v2.1/servers/e3fa2f27-df7a-4ecb-9bba-c970e3e7d106 => generated 1476 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:32.232071 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ae92bf44-1e25-45cd-b4b6-9b2925d7a499 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:50:32.233357 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ae92bf44-1e25-45cd-b4b6-9b2925d7a499 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 98d0ca37-0175-44e2-8a1d-965cdc517daf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:32.235511 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-778bd4e3-5025-43d9-9e72-4ab30d5d51ee tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Getting quotas for project 31dd217e7fd648b4a78c0c32ff1c95f4. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:50:32.241076 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ae92bf44-1e25-45cd-b4b6-9b2925d7a499 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:32.241925 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ae92bf44-1e25-45cd-b4b6-9b2925d7a499 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:32.243428 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ae92bf44-1e25-45cd-b4b6-9b2925d7a499 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:32.244022 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ae92bf44-1e25-45cd-b4b6-9b2925d7a499 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:32.250723 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-778bd4e3-5025-43d9-9e72-4ab30d5d51ee tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Getting quotas for user b55be87ae7f14b499ab2cd6fc5538988 and project 31dd217e7fd648b4a78c0c32ff1c95f4. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:50:32.269582 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-778bd4e3-5025-43d9-9e72-4ab30d5d51ee tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Going to run 1 instances... {{(pid=129365) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 20:50:32.272196 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-778bd4e3-5025-43d9-9e72-4ab30d5d51ee tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] [instance: ecba885c-f344-480e-9efc-707d1c542d42] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129365) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 20:50:32.312103 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ae92bf44-1e25-45cd-b4b6-9b2925d7a499 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action" status: 200 len: 32634 microversion: 2.1 time: 0.084252 Jan 15 20:50:32.314252 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 386/710] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:50:32 2022] POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action => generated 32634 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:50:32.328535 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-3056ea50-dd02-436e-9184-27d50afbf4f6 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:32.329561 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-3056ea50-dd02-436e-9184-27d50afbf4f6 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] [instance: f89db7df-a7e8-4138-8949-d76e2ccd282d] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:32.330979 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-778bd4e3-5025-43d9-9e72-4ab30d5d51ee tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.661752 Jan 15 20:50:32.337048 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 325/711] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 20:50:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1668 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 20:50:32.338098 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3056ea50-dd02-436e-9184-27d50afbf4f6 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:32.338683 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3056ea50-dd02-436e-9184-27d50afbf4f6 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:32.341263 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3056ea50-dd02-436e-9184-27d50afbf4f6 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:32.341846 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3056ea50-dd02-436e-9184-27d50afbf4f6 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:32.343307 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8b8da8eb-654f-4eda-96e9-af631a0fafd4 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:32.344150 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-8b8da8eb-654f-4eda-96e9-af631a0fafd4 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] [instance: eb4f55a3-96ef-4194-8506-e430b262c1f0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:32.352751 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8b8da8eb-654f-4eda-96e9-af631a0fafd4 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:32.353491 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8b8da8eb-654f-4eda-96e9-af631a0fafd4 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:32.354463 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8b8da8eb-654f-4eda-96e9-af631a0fafd4 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:32.355076 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8b8da8eb-654f-4eda-96e9-af631a0fafd4 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:32.803398 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-8b8da8eb-654f-4eda-96e9-af631a0fafd4 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc38f86758f9416b9e7f6915de0359d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8cfe33be708428abef52f5e8e25621b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:32.812432 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-8b8da8eb-654f-4eda-96e9-af631a0fafd4 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] 10.222.0.46 "GET /compute/v2.1/servers/eb4f55a3-96ef-4194-8506-e430b262c1f0" status: 200 len: 1319 microversion: 2.1 time: 0.473989 Jan 15 20:50:32.813036 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 326/712] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:32 2022] GET /compute/v2.1/servers/eb4f55a3-96ef-4194-8506-e430b262c1f0 => generated 1319 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:32.823634 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c72bd674-5cbb-4e62-a56f-9755e4333fdf tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:32.824248 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c72bd674-5cbb-4e62-a56f-9755e4333fdf tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] [instance: 7a5972c0-eea6-4198-8532-1efff379b087] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:32.844813 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c72bd674-5cbb-4e62-a56f-9755e4333fdf tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:32.845303 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c72bd674-5cbb-4e62-a56f-9755e4333fdf tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:32.850099 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c72bd674-5cbb-4e62-a56f-9755e4333fdf tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:32.850593 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c72bd674-5cbb-4e62-a56f-9755e4333fdf tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:32.884454 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-3056ea50-dd02-436e-9184-27d50afbf4f6 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d4a57cfaa145009ba9cc8f21d9e8ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4a26c8edac44c8b26fd4e43813412d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:32.905351 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-3056ea50-dd02-436e-9184-27d50afbf4f6 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] 10.222.0.46 "GET /compute/v2.1/servers/f89db7df-a7e8-4138-8949-d76e2ccd282d" status: 200 len: 1313 microversion: 2.1 time: 0.588984 Jan 15 20:50:32.906268 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 387/713] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:32 2022] GET /compute/v2.1/servers/f89db7df-a7e8-4138-8949-d76e2ccd282d => generated 1313 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:32.913559 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-90a910c4-ebe5-455e-b86f-91fac3a7a9ac tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:32.914245 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-90a910c4-ebe5-455e-b86f-91fac3a7a9ac tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] [instance: ecba885c-f344-480e-9efc-707d1c542d42] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:33.023369 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-c72bd674-5cbb-4e62-a56f-9755e4333fdf tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f311520925464d1a8c7d7302a1ef4bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25de5a60ff6f48aebb27a1ef9cbe0606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:33.028599 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-90a910c4-ebe5-455e-b86f-91fac3a7a9ac tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55be87ae7f14b499ab2cd6fc5538988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd217e7fd648b4a78c0c32ff1c95f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:33.038238 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c72bd674-5cbb-4e62-a56f-9755e4333fdf tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] 10.222.0.46 "GET /compute/v2.1/servers/7a5972c0-eea6-4198-8532-1efff379b087" status: 200 len: 1271 microversion: 2.1 time: 0.220080 Jan 15 20:50:33.048881 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 327/714] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:32 2022] GET /compute/v2.1/servers/7a5972c0-eea6-4198-8532-1efff379b087 => generated 1271 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:33.049197 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-90a910c4-ebe5-455e-b86f-91fac3a7a9ac tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "GET /compute/v2.1/servers/ecba885c-f344-480e-9efc-707d1c542d42" status: 200 len: 1208 microversion: 2.1 time: 0.139785 Jan 15 20:50:33.051826 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 388/715] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:32 2022] GET /compute/v2.1/servers/ecba885c-f344-480e-9efc-707d1c542d42 => generated 1208 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:33.061116 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-07365bf7-9cbe-4c35-8266-f58f7473a5a1 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:33.061728 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-07365bf7-9cbe-4c35-8266-f58f7473a5a1 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] [instance: 1085522d-3ccc-4de0-b9dd-01c374e1f0ca] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:33.069913 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-07365bf7-9cbe-4c35-8266-f58f7473a5a1 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:33.070372 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-07365bf7-9cbe-4c35-8266-f58f7473a5a1 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:33.072693 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-07365bf7-9cbe-4c35-8266-f58f7473a5a1 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:33.073414 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-07365bf7-9cbe-4c35-8266-f58f7473a5a1 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:33.083264 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-6e842529-32d2-4a3b-8062-b6bfcd941d99 req-83f36257-b240-44b6-85fa-743dc509803b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb4f55a3-96ef-4194-8506-e430b262c1f0", "name": "network-vif-plugged", "status": "completed", "tag": "5a7af53b-c710-4979-b238-041a49a6e6d6"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:50:33.087503 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:50:33.087503 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:50:33.105501 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-6e842529-32d2-4a3b-8062-b6bfcd941d99 req-83f36257-b240-44b6-85fa-743dc509803b service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:33.106222 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-6e842529-32d2-4a3b-8062-b6bfcd941d99 req-83f36257-b240-44b6-85fa-743dc509803b service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:33.118018 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-6e842529-32d2-4a3b-8062-b6bfcd941d99 req-83f36257-b240-44b6-85fa-743dc509803b service nova] Creating event network-vif-plugged:5a7af53b-c710-4979-b238-041a49a6e6d6 for instance eb4f55a3-96ef-4194-8506-e430b262c1f0 on nch2-master-1 Jan 15 20:50:33.123080 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-6e842529-32d2-4a3b-8062-b6bfcd941d99 req-83f36257-b240-44b6-85fa-743dc509803b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069478 Jan 15 20:50:33.123976 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 389/716] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:50:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:50:33.244535 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-238b49f6-1e34-4ab1-ba0e-a7b439ecde8a tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:33.245292 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-238b49f6-1e34-4ab1-ba0e-a7b439ecde8a tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: e3fa2f27-df7a-4ecb-9bba-c970e3e7d106] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:33.257450 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-238b49f6-1e34-4ab1-ba0e-a7b439ecde8a tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:33.258227 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-238b49f6-1e34-4ab1-ba0e-a7b439ecde8a tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:33.259895 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-238b49f6-1e34-4ab1-ba0e-a7b439ecde8a tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:33.260578 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-238b49f6-1e34-4ab1-ba0e-a7b439ecde8a tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:33.527947 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-07365bf7-9cbe-4c35-8266-f58f7473a5a1 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:33.548673 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-07365bf7-9cbe-4c35-8266-f58f7473a5a1 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:33.554574 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-07365bf7-9cbe-4c35-8266-f58f7473a5a1 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:33.558600 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-07365bf7-9cbe-4c35-8266-f58f7473a5a1 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] 10.222.0.46 "GET /compute/v2.1/servers/1085522d-3ccc-4de0-b9dd-01c374e1f0ca" status: 200 len: 1362 microversion: 2.25 time: 0.513966 Jan 15 20:50:33.560696 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 328/717] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:50:33 2022] GET /compute/v2.1/servers/1085522d-3ccc-4de0-b9dd-01c374e1f0ca => generated 1362 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:50:33.573931 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-feeab88d-2c40-4e2e-83a9-414084dbf08f tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:50:33.576397 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-238b49f6-1e34-4ab1-ba0e-a7b439ecde8a tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:33.576811 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-feeab88d-2c40-4e2e-83a9-414084dbf08f tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 98d0ca37-0175-44e2-8a1d-965cdc517daf] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:33.584567 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-238b49f6-1e34-4ab1-ba0e-a7b439ecde8a tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/e3fa2f27-df7a-4ecb-9bba-c970e3e7d106" status: 200 len: 1476 microversion: 2.1 time: 0.346419 Jan 15 20:50:33.592065 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 390/718] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:33 2022] GET /compute/v2.1/servers/e3fa2f27-df7a-4ecb-9bba-c970e3e7d106 => generated 1476 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:50:33.595920 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-feeab88d-2c40-4e2e-83a9-414084dbf08f tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:33.598079 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-feeab88d-2c40-4e2e-83a9-414084dbf08f tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:33.599108 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-feeab88d-2c40-4e2e-83a9-414084dbf08f tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:33.608764 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-feeab88d-2c40-4e2e-83a9-414084dbf08f tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:33.677960 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-feeab88d-2c40-4e2e-83a9-414084dbf08f tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action" status: 200 len: 32634 microversion: 2.1 time: 0.115591 Jan 15 20:50:33.679315 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 329/719] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:50:33 2022] POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action => generated 32634 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:50:33.829658 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0aa88ac3-e0c9-4b77-9895-2310b5d3d3da tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:33.830250 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-0aa88ac3-e0c9-4b77-9895-2310b5d3d3da tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] [instance: eb4f55a3-96ef-4194-8506-e430b262c1f0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:33.840076 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0aa88ac3-e0c9-4b77-9895-2310b5d3d3da tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:33.851247 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0aa88ac3-e0c9-4b77-9895-2310b5d3d3da tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:33.853651 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0aa88ac3-e0c9-4b77-9895-2310b5d3d3da tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:33.854256 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0aa88ac3-e0c9-4b77-9895-2310b5d3d3da tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:33.924343 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-89fcd067-ff4c-4f3d-8aa3-aeb0b6094af0 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:33.925081 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-89fcd067-ff4c-4f3d-8aa3-aeb0b6094af0 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] [instance: f89db7df-a7e8-4138-8949-d76e2ccd282d] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:33.935188 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-89fcd067-ff4c-4f3d-8aa3-aeb0b6094af0 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:33.935939 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-89fcd067-ff4c-4f3d-8aa3-aeb0b6094af0 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:33.936967 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-89fcd067-ff4c-4f3d-8aa3-aeb0b6094af0 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:33.937593 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-89fcd067-ff4c-4f3d-8aa3-aeb0b6094af0 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:34.286607 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-0aa88ac3-e0c9-4b77-9895-2310b5d3d3da tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc38f86758f9416b9e7f6915de0359d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8cfe33be708428abef52f5e8e25621b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:34.295466 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0aa88ac3-e0c9-4b77-9895-2310b5d3d3da tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] 10.222.0.46 "GET /compute/v2.1/servers/eb4f55a3-96ef-4194-8506-e430b262c1f0" status: 200 len: 1319 microversion: 2.1 time: 0.469186 Jan 15 20:50:34.302186 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-89fcd067-ff4c-4f3d-8aa3-aeb0b6094af0 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d4a57cfaa145009ba9cc8f21d9e8ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4a26c8edac44c8b26fd4e43813412d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:34.311929 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-89fcd067-ff4c-4f3d-8aa3-aeb0b6094af0 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] 10.222.0.46 "GET /compute/v2.1/servers/f89db7df-a7e8-4138-8949-d76e2ccd282d" status: 200 len: 1313 microversion: 2.1 time: 0.392219 Jan 15 20:50:34.317450 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 330/720] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:33 2022] GET /compute/v2.1/servers/f89db7df-a7e8-4138-8949-d76e2ccd282d => generated 1313 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:34.325516 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 391/721] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:33 2022] GET /compute/v2.1/servers/eb4f55a3-96ef-4194-8506-e430b262c1f0 => generated 1319 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:34.333632 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f5706293-1ea8-46f0-8494-188d68e8de52 tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:34.334372 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f5706293-1ea8-46f0-8494-188d68e8de52 tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] [instance: 7a5972c0-eea6-4198-8532-1efff379b087] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:34.338628 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-19bd22c3-d008-4280-b24e-6808e687d14f tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:34.340587 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-19bd22c3-d008-4280-b24e-6808e687d14f tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] [instance: ecba885c-f344-480e-9efc-707d1c542d42] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:34.349953 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f5706293-1ea8-46f0-8494-188d68e8de52 tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:34.350694 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f5706293-1ea8-46f0-8494-188d68e8de52 tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:34.351719 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f5706293-1ea8-46f0-8494-188d68e8de52 tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:34.354299 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f5706293-1ea8-46f0-8494-188d68e8de52 tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:34.357712 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-19bd22c3-d008-4280-b24e-6808e687d14f tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:34.358168 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-19bd22c3-d008-4280-b24e-6808e687d14f tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:34.358979 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-19bd22c3-d008-4280-b24e-6808e687d14f tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:34.359425 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-19bd22c3-d008-4280-b24e-6808e687d14f tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:34.524464 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-19bd22c3-d008-4280-b24e-6808e687d14f tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55be87ae7f14b499ab2cd6fc5538988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd217e7fd648b4a78c0c32ff1c95f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:34.535312 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-19bd22c3-d008-4280-b24e-6808e687d14f tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "GET /compute/v2.1/servers/ecba885c-f344-480e-9efc-707d1c542d42" status: 200 len: 1266 microversion: 2.1 time: 0.207871 Jan 15 20:50:34.552123 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 392/722] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:34 2022] GET /compute/v2.1/servers/ecba885c-f344-480e-9efc-707d1c542d42 => generated 1266 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:34.580827 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-452c89bb-6c6a-4fbc-9e33-0485aafd51c6 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:34.581522 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-452c89bb-6c6a-4fbc-9e33-0485aafd51c6 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] [instance: 1085522d-3ccc-4de0-b9dd-01c374e1f0ca] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:34.598713 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-452c89bb-6c6a-4fbc-9e33-0485aafd51c6 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:34.600162 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-452c89bb-6c6a-4fbc-9e33-0485aafd51c6 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:34.603350 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-452c89bb-6c6a-4fbc-9e33-0485aafd51c6 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:34.605004 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-452c89bb-6c6a-4fbc-9e33-0485aafd51c6 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:34.752134 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-f5706293-1ea8-46f0-8494-188d68e8de52 tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f311520925464d1a8c7d7302a1ef4bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25de5a60ff6f48aebb27a1ef9cbe0606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:34.760332 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f5706293-1ea8-46f0-8494-188d68e8de52 tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] 10.222.0.46 "GET /compute/v2.1/servers/7a5972c0-eea6-4198-8532-1efff379b087" status: 200 len: 1313 microversion: 2.1 time: 0.441637 Jan 15 20:50:34.770223 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 331/723] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:34 2022] GET /compute/v2.1/servers/7a5972c0-eea6-4198-8532-1efff379b087 => generated 1313 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:34.777131 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c18e72cf-a534-4f5b-a443-2f1a3ca46834 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:34.778081 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c18e72cf-a534-4f5b-a443-2f1a3ca46834 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: e3fa2f27-df7a-4ecb-9bba-c970e3e7d106] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:34.786000 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c18e72cf-a534-4f5b-a443-2f1a3ca46834 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:34.786820 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c18e72cf-a534-4f5b-a443-2f1a3ca46834 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:34.787914 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c18e72cf-a534-4f5b-a443-2f1a3ca46834 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:34.788615 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c18e72cf-a534-4f5b-a443-2f1a3ca46834 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:35.213759 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-452c89bb-6c6a-4fbc-9e33-0485aafd51c6 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:35.223556 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-452c89bb-6c6a-4fbc-9e33-0485aafd51c6 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:35.225041 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-452c89bb-6c6a-4fbc-9e33-0485aafd51c6 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:35.226259 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-452c89bb-6c6a-4fbc-9e33-0485aafd51c6 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] 10.222.0.46 "GET /compute/v2.1/servers/1085522d-3ccc-4de0-b9dd-01c374e1f0ca" status: 200 len: 1362 microversion: 2.25 time: 0.652063 Jan 15 20:50:35.237037 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 393/724] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:50:34 2022] GET /compute/v2.1/servers/1085522d-3ccc-4de0-b9dd-01c374e1f0ca => generated 1362 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 15 20:50:35.242212 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1777d7a0-77cf-416d-b866-83ccb79779aa tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:50:35.244058 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-1777d7a0-77cf-416d-b866-83ccb79779aa tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 98d0ca37-0175-44e2-8a1d-965cdc517daf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:35.256975 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1777d7a0-77cf-416d-b866-83ccb79779aa tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:35.257576 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1777d7a0-77cf-416d-b866-83ccb79779aa tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:35.258914 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1777d7a0-77cf-416d-b866-83ccb79779aa tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:35.259697 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1777d7a0-77cf-416d-b866-83ccb79779aa tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:35.316064 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-1777d7a0-77cf-416d-b866-83ccb79779aa tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action" status: 200 len: 32634 microversion: 2.1 time: 0.076478 Jan 15 20:50:35.323371 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 394/725] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:50:35 2022] POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action => generated 32634 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:50:35.330489 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-c7c087a6-e9ea-4e04-b9bf-12ef67e1ce12 req-02cb534b-ca58-4188-a012-7df172e92770 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1085522d-3ccc-4de0-b9dd-01c374e1f0ca", "name": "network-vif-plugged", "status": "completed", "tag": "fd65475a-f2b6-4fd5-b84f-f1f5f96b1f50"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:50:35.332565 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:50:35.332565 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:50:35.334751 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-c18e72cf-a534-4f5b-a443-2f1a3ca46834 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:35.345235 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-c7c087a6-e9ea-4e04-b9bf-12ef67e1ce12 req-02cb534b-ca58-4188-a012-7df172e92770 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:35.345992 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-c7c087a6-e9ea-4e04-b9bf-12ef67e1ce12 req-02cb534b-ca58-4188-a012-7df172e92770 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:35.360958 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-c7c087a6-e9ea-4e04-b9bf-12ef67e1ce12 req-02cb534b-ca58-4188-a012-7df172e92770 service nova] Creating event network-vif-plugged:fd65475a-f2b6-4fd5-b84f-f1f5f96b1f50 for instance 1085522d-3ccc-4de0-b9dd-01c374e1f0ca on nch1-master-1 Jan 15 20:50:35.368455 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-c7c087a6-e9ea-4e04-b9bf-12ef67e1ce12 req-02cb534b-ca58-4188-a012-7df172e92770 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043297 Jan 15 20:50:35.369554 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 395/726] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:50:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:50:35.369686 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c18e72cf-a534-4f5b-a443-2f1a3ca46834 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/e3fa2f27-df7a-4ecb-9bba-c970e3e7d106" status: 200 len: 1476 microversion: 2.1 time: 0.590608 Jan 15 20:50:35.376559 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-48b07de3-944b-4923-a652-12a6af90cb85 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:35.380633 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 332/727] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:34 2022] GET /compute/v2.1/servers/e3fa2f27-df7a-4ecb-9bba-c970e3e7d106 => generated 1476 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:35.381774 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-48b07de3-944b-4923-a652-12a6af90cb85 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] [instance: eb4f55a3-96ef-4194-8506-e430b262c1f0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:35.400020 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-48b07de3-944b-4923-a652-12a6af90cb85 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:35.400734 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-48b07de3-944b-4923-a652-12a6af90cb85 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:35.403431 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-6f56d3c5-bedf-4552-b28e-63825aa578d7 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:35.406816 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-6f56d3c5-bedf-4552-b28e-63825aa578d7 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] [instance: f89db7df-a7e8-4138-8949-d76e2ccd282d] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:35.410100 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-48b07de3-944b-4923-a652-12a6af90cb85 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:35.410814 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-48b07de3-944b-4923-a652-12a6af90cb85 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:35.418969 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6f56d3c5-bedf-4552-b28e-63825aa578d7 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:35.428483 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6f56d3c5-bedf-4552-b28e-63825aa578d7 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:35.432066 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6f56d3c5-bedf-4552-b28e-63825aa578d7 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:35.433160 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6f56d3c5-bedf-4552-b28e-63825aa578d7 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:35.784639 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-48b07de3-944b-4923-a652-12a6af90cb85 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc38f86758f9416b9e7f6915de0359d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8cfe33be708428abef52f5e8e25621b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:35.793477 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-48b07de3-944b-4923-a652-12a6af90cb85 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] 10.222.0.46 "GET /compute/v2.1/servers/eb4f55a3-96ef-4194-8506-e430b262c1f0" status: 200 len: 1467 microversion: 2.1 time: 0.422110 Jan 15 20:50:35.794238 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 396/728] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:35 2022] GET /compute/v2.1/servers/eb4f55a3-96ef-4194-8506-e430b262c1f0 => generated 1467 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:35.799180 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7e5c972b-d816-41ba-aacd-e5c36228034f tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:35.799782 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-7e5c972b-d816-41ba-aacd-e5c36228034f tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] [instance: ecba885c-f344-480e-9efc-707d1c542d42] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:35.807978 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7e5c972b-d816-41ba-aacd-e5c36228034f tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:35.808343 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7e5c972b-d816-41ba-aacd-e5c36228034f tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:35.812355 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7e5c972b-d816-41ba-aacd-e5c36228034f tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:35.813238 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7e5c972b-d816-41ba-aacd-e5c36228034f tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:35.985182 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-6f56d3c5-bedf-4552-b28e-63825aa578d7 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d4a57cfaa145009ba9cc8f21d9e8ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4a26c8edac44c8b26fd4e43813412d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:35.996330 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-6f56d3c5-bedf-4552-b28e-63825aa578d7 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] 10.222.0.46 "GET /compute/v2.1/servers/f89db7df-a7e8-4138-8949-d76e2ccd282d" status: 200 len: 1313 microversion: 2.1 time: 0.614260 Jan 15 20:50:35.996890 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 333/729] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:35 2022] GET /compute/v2.1/servers/f89db7df-a7e8-4138-8949-d76e2ccd282d => generated 1313 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:36.005992 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-0dbf8286-499e-4aa7-a6b0-3cf650678ada tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:36.010520 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-0dbf8286-499e-4aa7-a6b0-3cf650678ada tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] [instance: 7a5972c0-eea6-4198-8532-1efff379b087] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:36.018861 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0dbf8286-499e-4aa7-a6b0-3cf650678ada tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:36.019413 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0dbf8286-499e-4aa7-a6b0-3cf650678ada tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:36.020281 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0dbf8286-499e-4aa7-a6b0-3cf650678ada tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:36.020924 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0dbf8286-499e-4aa7-a6b0-3cf650678ada tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:36.139269 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-7e5c972b-d816-41ba-aacd-e5c36228034f tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55be87ae7f14b499ab2cd6fc5538988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd217e7fd648b4a78c0c32ff1c95f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:36.153711 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7e5c972b-d816-41ba-aacd-e5c36228034f tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "GET /compute/v2.1/servers/ecba885c-f344-480e-9efc-707d1c542d42" status: 200 len: 1308 microversion: 2.1 time: 0.357835 Jan 15 20:50:36.156114 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 397/730] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:35 2022] GET /compute/v2.1/servers/ecba885c-f344-480e-9efc-707d1c542d42 => generated 1308 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:36.168044 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-611713e7-06fe-43ab-8f5b-bd3c20f7cbcb tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:36.169747 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-611713e7-06fe-43ab-8f5b-bd3c20f7cbcb tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] [instance: 3934550f-0131-4bd3-890b-edbaf4ccac0e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:36.176641 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-611713e7-06fe-43ab-8f5b-bd3c20f7cbcb tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:36.178303 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-611713e7-06fe-43ab-8f5b-bd3c20f7cbcb tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:36.179330 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-611713e7-06fe-43ab-8f5b-bd3c20f7cbcb tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:36.180069 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-611713e7-06fe-43ab-8f5b-bd3c20f7cbcb tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:36.326030 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-0dbf8286-499e-4aa7-a6b0-3cf650678ada tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f311520925464d1a8c7d7302a1ef4bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25de5a60ff6f48aebb27a1ef9cbe0606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:36.334277 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-0dbf8286-499e-4aa7-a6b0-3cf650678ada tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] 10.222.0.46 "GET /compute/v2.1/servers/7a5972c0-eea6-4198-8532-1efff379b087" status: 200 len: 1313 microversion: 2.1 time: 0.335116 Jan 15 20:50:36.335411 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 334/731] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:35 2022] GET /compute/v2.1/servers/7a5972c0-eea6-4198-8532-1efff379b087 => generated 1313 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:36.348390 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-4d3472c0-72e2-41ef-8162-ae9f213deb3d req-d87498ee-a365-4e53-acea-0540a4cef0f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a5972c0-eea6-4198-8532-1efff379b087", "tag": "46119a94-d225-4199-97ac-4a0048ddd01c"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:50:36.350409 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:50:36.350409 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:50:36.362156 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-4d3472c0-72e2-41ef-8162-ae9f213deb3d req-d87498ee-a365-4e53-acea-0540a4cef0f3 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:36.362605 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-4d3472c0-72e2-41ef-8162-ae9f213deb3d req-d87498ee-a365-4e53-acea-0540a4cef0f3 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:36.396671 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-4d3472c0-72e2-41ef-8162-ae9f213deb3d req-d87498ee-a365-4e53-acea-0540a4cef0f3 service nova] Creating event network-changed:46119a94-d225-4199-97ac-4a0048ddd01c for instance 7a5972c0-eea6-4198-8532-1efff379b087 on nch1-master-1 Jan 15 20:50:36.407602 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-4d3472c0-72e2-41ef-8162-ae9f213deb3d req-d87498ee-a365-4e53-acea-0540a4cef0f3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070493 Jan 15 20:50:36.408968 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 335/732] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:50:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:50:36.417749 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-791fb07d-6986-4941-8063-792665b72e99 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:36.418627 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-791fb07d-6986-4941-8063-792665b72e99 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] [instance: 1085522d-3ccc-4de0-b9dd-01c374e1f0ca] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:36.429118 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-791fb07d-6986-4941-8063-792665b72e99 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:36.430871 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-791fb07d-6986-4941-8063-792665b72e99 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:36.432287 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-791fb07d-6986-4941-8063-792665b72e99 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:36.433057 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-791fb07d-6986-4941-8063-792665b72e99 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:36.468980 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-611713e7-06fe-43ab-8f5b-bd3c20f7cbcb tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc38f86758f9416b9e7f6915de0359d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8cfe33be708428abef52f5e8e25621b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:36.495397 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-611713e7-06fe-43ab-8f5b-bd3c20f7cbcb tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] 10.222.0.46 "GET /compute/v2.1/servers/3934550f-0131-4bd3-890b-edbaf4ccac0e" status: 200 len: 1469 microversion: 2.1 time: 0.337325 Jan 15 20:50:36.501496 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 398/733] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:36 2022] GET /compute/v2.1/servers/3934550f-0131-4bd3-890b-edbaf4ccac0e => generated 1469 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:36.522461 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-219db1cc-a133-4b30-ad27-63ad5867c5fe tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:50:36.523116 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-219db1cc-a133-4b30-ad27-63ad5867c5fe tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 98d0ca37-0175-44e2-8a1d-965cdc517daf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:36.532178 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-219db1cc-a133-4b30-ad27-63ad5867c5fe tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:36.532767 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-219db1cc-a133-4b30-ad27-63ad5867c5fe tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:36.533711 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-219db1cc-a133-4b30-ad27-63ad5867c5fe tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:36.534262 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-219db1cc-a133-4b30-ad27-63ad5867c5fe tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:36.592154 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-219db1cc-a133-4b30-ad27-63ad5867c5fe tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action" status: 200 len: 32634 microversion: 2.1 time: 0.086066 Jan 15 20:50:36.593527 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 399/734] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:50:36 2022] POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action => generated 32634 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:50:36.601064 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ee322c05-6e7e-45b2-973f-18f44efeac02 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:36.603771 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ee322c05-6e7e-45b2-973f-18f44efeac02 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: e3fa2f27-df7a-4ecb-9bba-c970e3e7d106] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:36.611865 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ee322c05-6e7e-45b2-973f-18f44efeac02 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:36.612470 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ee322c05-6e7e-45b2-973f-18f44efeac02 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:36.613405 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ee322c05-6e7e-45b2-973f-18f44efeac02 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:36.613945 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ee322c05-6e7e-45b2-973f-18f44efeac02 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:36.719310 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-791fb07d-6986-4941-8063-792665b72e99 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:36.732479 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-791fb07d-6986-4941-8063-792665b72e99 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:36.736342 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-791fb07d-6986-4941-8063-792665b72e99 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:36.738807 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-791fb07d-6986-4941-8063-792665b72e99 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] 10.222.0.46 "GET /compute/v2.1/servers/1085522d-3ccc-4de0-b9dd-01c374e1f0ca" status: 200 len: 1362 microversion: 2.25 time: 0.328373 Jan 15 20:50:36.753927 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 336/735] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:50:36 2022] GET /compute/v2.1/servers/1085522d-3ccc-4de0-b9dd-01c374e1f0ca => generated 1362 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:50:36.764406 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9f10a284-23bd-42e4-ad0b-8ccb5a11b2ce tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:36.768479 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:50:36.768479 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:50:36.769905 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-9f10a284-23bd-42e4-ad0b-8ccb5a11b2ce tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bc38f86758f9416b9e7f6915de0359d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8cfe33be708428abef52f5e8e25621b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:36.771717 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-9f10a284-23bd-42e4-ad0b-8ccb5a11b2ce tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Searching by: {'reservation_id': 'r-btsvflry', 'deleted': False, 'project_id': 'e8cfe33be708428abef52f5e8e25621b'} {{(pid=129365) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 15 20:50:36.785797 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9f10a284-23bd-42e4-ad0b-8ccb5a11b2ce tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:36.786540 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9f10a284-23bd-42e4-ad0b-8ccb5a11b2ce tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:36.787545 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9f10a284-23bd-42e4-ad0b-8ccb5a11b2ce tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:36.788165 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9f10a284-23bd-42e4-ad0b-8ccb5a11b2ce tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:36.860794 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-ee322c05-6e7e-45b2-973f-18f44efeac02 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:36.870496 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ee322c05-6e7e-45b2-973f-18f44efeac02 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/e3fa2f27-df7a-4ecb-9bba-c970e3e7d106" status: 200 len: 1476 microversion: 2.1 time: 0.275496 Jan 15 20:50:36.871506 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 400/736] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:36 2022] GET /compute/v2.1/servers/e3fa2f27-df7a-4ecb-9bba-c970e3e7d106 => generated 1476 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:36.942602 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.multi_cell_list [None req-9f10a284-23bd-42e4-ad0b-8ccb5a11b2ce tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=129365) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jan 15 20:50:37.014350 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e7f21856-adc1-4ca3-b4d4-9c3ffb9ddfcb tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:37.014962 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e7f21856-adc1-4ca3-b4d4-9c3ffb9ddfcb tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] [instance: f89db7df-a7e8-4138-8949-d76e2ccd282d] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:37.029621 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e7f21856-adc1-4ca3-b4d4-9c3ffb9ddfcb tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:37.030411 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e7f21856-adc1-4ca3-b4d4-9c3ffb9ddfcb tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:37.031234 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e7f21856-adc1-4ca3-b4d4-9c3ffb9ddfcb tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:37.039920 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e7f21856-adc1-4ca3-b4d4-9c3ffb9ddfcb tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:37.098122 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-9f10a284-23bd-42e4-ad0b-8ccb5a11b2ce tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc38f86758f9416b9e7f6915de0359d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8cfe33be708428abef52f5e8e25621b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:37.108523 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9f10a284-23bd-42e4-ad0b-8ccb5a11b2ce tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:37.109447 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9f10a284-23bd-42e4-ad0b-8ccb5a11b2ce tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:37.466273 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-9f10a284-23bd-42e4-ad0b-8ccb5a11b2ce tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] 10.222.0.46 "GET /compute/v2.1/servers/detail?reservation_id=r-btsvflry" status: 200 len: 2929 microversion: 2.1 time: 0.710527 Jan 15 20:50:37.470891 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-e7f21856-adc1-4ca3-b4d4-9c3ffb9ddfcb tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d4a57cfaa145009ba9cc8f21d9e8ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4a26c8edac44c8b26fd4e43813412d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:37.472993 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 337/737] 10.222.0.46 () {58 vars in 1196 bytes} [Sat Jan 15 20:50:36 2022] GET /compute/v2.1/servers/detail?reservation_id=r-btsvflry => generated 2929 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:37.482792 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e7f21856-adc1-4ca3-b4d4-9c3ffb9ddfcb tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] 10.222.0.46 "GET /compute/v2.1/servers/f89db7df-a7e8-4138-8949-d76e2ccd282d" status: 200 len: 1313 microversion: 2.1 time: 0.472048 Jan 15 20:50:37.483374 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 401/738] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:37 2022] GET /compute/v2.1/servers/f89db7df-a7e8-4138-8949-d76e2ccd282d => generated 1313 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:37.487668 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c6c6ac3c-9a76-4caa-bf54-874eeee816b1 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:37.488478 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c6c6ac3c-9a76-4caa-bf54-874eeee816b1 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] [instance: ecba885c-f344-480e-9efc-707d1c542d42] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:37.501428 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c6c6ac3c-9a76-4caa-bf54-874eeee816b1 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:37.502138 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c6c6ac3c-9a76-4caa-bf54-874eeee816b1 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:37.503425 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-e8c8c566-a39d-4d73-a750-b428a6055917 req-3cf483f6-26fa-45d5-8e78-e1cea6a69c21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecba885c-f344-480e-9efc-707d1c542d42", "tag": "6896d9fc-c7c9-4e4b-8bf1-aaae0b89dd3f"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:50:37.504608 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c6c6ac3c-9a76-4caa-bf54-874eeee816b1 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:37.506091 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c6c6ac3c-9a76-4caa-bf54-874eeee816b1 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:37.509811 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:50:37.509811 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:50:37.531269 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-e8c8c566-a39d-4d73-a750-b428a6055917 req-3cf483f6-26fa-45d5-8e78-e1cea6a69c21 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:37.531726 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-e8c8c566-a39d-4d73-a750-b428a6055917 req-3cf483f6-26fa-45d5-8e78-e1cea6a69c21 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:37.557286 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-e8c8c566-a39d-4d73-a750-b428a6055917 req-3cf483f6-26fa-45d5-8e78-e1cea6a69c21 service nova] Creating event network-changed:6896d9fc-c7c9-4e4b-8bf1-aaae0b89dd3f for instance ecba885c-f344-480e-9efc-707d1c542d42 on nch1-master-1 Jan 15 20:50:37.566752 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-e8c8c566-a39d-4d73-a750-b428a6055917 req-3cf483f6-26fa-45d5-8e78-e1cea6a69c21 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074167 Jan 15 20:50:37.567645 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 402/739] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:50:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:50:37.574912 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0a17873d-0e57-43c2-93fc-268e93231e28 tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:37.575833 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-0a17873d-0e57-43c2-93fc-268e93231e28 tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] [instance: 7a5972c0-eea6-4198-8532-1efff379b087] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:37.582545 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0a17873d-0e57-43c2-93fc-268e93231e28 tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:37.583197 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0a17873d-0e57-43c2-93fc-268e93231e28 tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:37.584158 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0a17873d-0e57-43c2-93fc-268e93231e28 tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:37.585278 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0a17873d-0e57-43c2-93fc-268e93231e28 tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:37.935518 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-0a17873d-0e57-43c2-93fc-268e93231e28 tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f311520925464d1a8c7d7302a1ef4bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25de5a60ff6f48aebb27a1ef9cbe0606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:37.949653 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0a17873d-0e57-43c2-93fc-268e93231e28 tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] 10.222.0.46 "GET /compute/v2.1/servers/7a5972c0-eea6-4198-8532-1efff379b087" status: 200 len: 1313 microversion: 2.1 time: 0.380467 Jan 15 20:50:37.951016 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 403/740] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:37 2022] GET /compute/v2.1/servers/7a5972c0-eea6-4198-8532-1efff379b087 => generated 1313 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:37.962298 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7a01ea8c-4edf-4def-81c1-6d941ccfdbff tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:37.969569 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-c6c6ac3c-9a76-4caa-bf54-874eeee816b1 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55be87ae7f14b499ab2cd6fc5538988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd217e7fd648b4a78c0c32ff1c95f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:37.996896 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c6c6ac3c-9a76-4caa-bf54-874eeee816b1 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "GET /compute/v2.1/servers/ecba885c-f344-480e-9efc-707d1c542d42" status: 200 len: 1308 microversion: 2.1 time: 0.522472 Jan 15 20:50:38.000911 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 338/741] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:37 2022] GET /compute/v2.1/servers/ecba885c-f344-480e-9efc-707d1c542d42 => generated 1308 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:38.005838 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.compute.server_groups [None req-7a01ea8c-4edf-4def-81c1-6d941ccfdbff tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Querying cell 2935be83-7c51-430d-8ff2-0a8179973c9a(cell1) for 2 instances {{(pid=129366) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:68}} Jan 15 20:50:38.007015 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7a01ea8c-4edf-4def-81c1-6d941ccfdbff tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:38.009002 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7a01ea8c-4edf-4def-81c1-6d941ccfdbff tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:38.077285 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7a01ea8c-4edf-4def-81c1-6d941ccfdbff tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] 10.222.0.46 "GET /compute/v2.1/os-server-groups/fea8424e-67ca-4452-9e88-e044ef8eadf9" status: 200 len: 266 microversion: 2.1 time: 0.124507 Jan 15 20:50:38.077814 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 404/742] 10.222.0.46 () {58 vars in 1262 bytes} [Sat Jan 15 20:50:37 2022] GET /compute/v2.1/os-server-groups/fea8424e-67ca-4452-9e88-e044ef8eadf9 => generated 266 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:50:38.083692 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e9b8c6d2-d8b0-4020-91bd-d9e712f52ae9 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:50:38.084806 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e9b8c6d2-d8b0-4020-91bd-d9e712f52ae9 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 98d0ca37-0175-44e2-8a1d-965cdc517daf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:38.092591 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e9b8c6d2-d8b0-4020-91bd-d9e712f52ae9 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:38.093130 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e9b8c6d2-d8b0-4020-91bd-d9e712f52ae9 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:38.094132 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e9b8c6d2-d8b0-4020-91bd-d9e712f52ae9 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:38.094638 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e9b8c6d2-d8b0-4020-91bd-d9e712f52ae9 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:38.112084 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d623b341-6fa2-476f-abdf-4c1085c1a2a8 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-1612105764", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "networks": [{"uuid": "1ddf3f52-4b62-4e63-a9e4-50ec9015529c"}]}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:50:38.146368 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e9b8c6d2-d8b0-4020-91bd-d9e712f52ae9 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action" status: 200 len: 32634 microversion: 2.1 time: 0.066633 Jan 15 20:50:38.147146 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 405/743] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:50:38 2022] POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action => generated 32634 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:50:38.154708 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-2faf0449-7006-4590-82f9-ea86f209e2e2 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:38.155720 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-2faf0449-7006-4590-82f9-ea86f209e2e2 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] [instance: 1085522d-3ccc-4de0-b9dd-01c374e1f0ca] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:38.164548 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2faf0449-7006-4590-82f9-ea86f209e2e2 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:38.165395 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2faf0449-7006-4590-82f9-ea86f209e2e2 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:38.166475 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2faf0449-7006-4590-82f9-ea86f209e2e2 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:38.167116 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2faf0449-7006-4590-82f9-ea86f209e2e2 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:38.181465 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.network.neutron [None req-d623b341-6fa2-476f-abdf-4c1085c1a2a8 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] validate_networks() for [('1ddf3f52-4b62-4e63-a9e4-50ec9015529c', None, None, None, None, None)] {{(pid=129365) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 20:50:38.427617 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-2faf0449-7006-4590-82f9-ea86f209e2e2 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:38.438769 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-2faf0449-7006-4590-82f9-ea86f209e2e2 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:38.440267 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-2faf0449-7006-4590-82f9-ea86f209e2e2 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:38.441578 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-2faf0449-7006-4590-82f9-ea86f209e2e2 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] 10.222.0.46 "GET /compute/v2.1/servers/1085522d-3ccc-4de0-b9dd-01c374e1f0ca" status: 200 len: 1557 microversion: 2.25 time: 0.293102 Jan 15 20:50:38.460723 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 406/744] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:50:38 2022] GET /compute/v2.1/servers/1085522d-3ccc-4de0-b9dd-01c374e1f0ca => generated 1557 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:50:38.465491 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-1eb45ff2-e3b7-464d-854f-410fc0641de8 req-9b602ab0-b600-4cf5-87a1-ca031052b38a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f89db7df-a7e8-4138-8949-d76e2ccd282d", "name": "network-vif-plugged", "status": "completed", "tag": "903fc68a-fde5-420c-8bcf-272fee77950b"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:50:38.467283 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:50:38.467283 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:50:38.474662 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-1eb45ff2-e3b7-464d-854f-410fc0641de8 req-9b602ab0-b600-4cf5-87a1-ca031052b38a service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:38.475739 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-1eb45ff2-e3b7-464d-854f-410fc0641de8 req-9b602ab0-b600-4cf5-87a1-ca031052b38a service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:38.488061 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-1eb45ff2-e3b7-464d-854f-410fc0641de8 req-9b602ab0-b600-4cf5-87a1-ca031052b38a service nova] Creating event network-vif-plugged:903fc68a-fde5-420c-8bcf-272fee77950b for instance f89db7df-a7e8-4138-8949-d76e2ccd282d on nch2-master-1 Jan 15 20:50:38.494039 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-1eb45ff2-e3b7-464d-854f-410fc0641de8 req-9b602ab0-b600-4cf5-87a1-ca031052b38a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031945 Jan 15 20:50:38.495156 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 407/745] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:50:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:50:38.500146 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ff92bc9e-a4ff-48eb-a6c7-0389fe768401 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:38.501046 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ff92bc9e-a4ff-48eb-a6c7-0389fe768401 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: e3fa2f27-df7a-4ecb-9bba-c970e3e7d106] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:38.507633 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ff92bc9e-a4ff-48eb-a6c7-0389fe768401 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:38.508613 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ff92bc9e-a4ff-48eb-a6c7-0389fe768401 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:38.509500 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ff92bc9e-a4ff-48eb-a6c7-0389fe768401 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:38.510117 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ff92bc9e-a4ff-48eb-a6c7-0389fe768401 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:38.755547 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-d623b341-6fa2-476f-abdf-4c1085c1a2a8 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Flavor limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 20:50:38.756297 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-d623b341-6fa2-476f-abdf-4c1085c1a2a8 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Image limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 20:50:38.756779 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-d623b341-6fa2-476f-abdf-4c1085c1a2a8 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Flavor pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 20:50:38.757338 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-d623b341-6fa2-476f-abdf-4c1085c1a2a8 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Image pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 20:50:38.758004 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-d623b341-6fa2-476f-abdf-4c1085c1a2a8 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 20:50:38.767753 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-ff92bc9e-a4ff-48eb-a6c7-0389fe768401 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:38.773115 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d623b341-6fa2-476f-abdf-4c1085c1a2a8 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:38.774274 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d623b341-6fa2-476f-abdf-4c1085c1a2a8 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:38.775232 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d623b341-6fa2-476f-abdf-4c1085c1a2a8 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:38.775730 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ff92bc9e-a4ff-48eb-a6c7-0389fe768401 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/e3fa2f27-df7a-4ecb-9bba-c970e3e7d106" status: 200 len: 1476 microversion: 2.1 time: 0.279284 Jan 15 20:50:38.776014 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d623b341-6fa2-476f-abdf-4c1085c1a2a8 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:38.776316 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 408/746] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:38 2022] GET /compute/v2.1/servers/e3fa2f27-df7a-4ecb-9bba-c970e3e7d106 => generated 1476 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:38.785028 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c12d74fc-85dc-4cb4-85a3-d728105059e7 tempest-ServersOnMultiNodesTest-1194618714 tempest-ServersOnMultiNodesTest-1194618714-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:38.785028 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c12d74fc-85dc-4cb4-85a3-d728105059e7 tempest-ServersOnMultiNodesTest-1194618714 tempest-ServersOnMultiNodesTest-1194618714-project-admin] [instance: eb4f55a3-96ef-4194-8506-e430b262c1f0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:38.787445 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c12d74fc-85dc-4cb4-85a3-d728105059e7 tempest-ServersOnMultiNodesTest-1194618714 tempest-ServersOnMultiNodesTest-1194618714-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:38.787899 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c12d74fc-85dc-4cb4-85a3-d728105059e7 tempest-ServersOnMultiNodesTest-1194618714 tempest-ServersOnMultiNodesTest-1194618714-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:38.788679 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c12d74fc-85dc-4cb4-85a3-d728105059e7 tempest-ServersOnMultiNodesTest-1194618714 tempest-ServersOnMultiNodesTest-1194618714-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:38.790214 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c12d74fc-85dc-4cb4-85a3-d728105059e7 tempest-ServersOnMultiNodesTest-1194618714 tempest-ServersOnMultiNodesTest-1194618714-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:38.805583 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-d623b341-6fa2-476f-abdf-4c1085c1a2a8 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Getting quotas for project 63f60a2e220b479abf4b04536ed406e9. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:50:38.809889 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-d623b341-6fa2-476f-abdf-4c1085c1a2a8 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Getting quotas for user c02b23752962428b825b6f7757f54007 and project 63f60a2e220b479abf4b04536ed406e9. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:50:38.822510 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d623b341-6fa2-476f-abdf-4c1085c1a2a8 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Going to run 1 instances... {{(pid=129365) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 20:50:38.824747 ncdv-master-1 devstack@n-api.service[129365]: WARNING nova.utils [None req-d623b341-6fa2-476f-abdf-4c1085c1a2a8 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Hostname tempest-FloatingIPsAssociationNegativeTestJSON-server-1612105764 is longer than 63, truncate it to tempest-FloatingIPsAssociationNegativeTestJSON-server-161210576 Jan 15 20:50:38.825464 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d623b341-6fa2-476f-abdf-4c1085c1a2a8 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] [instance: 69b95b86-744d-4552-a0fc-6ced4d9ef38d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129365) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 20:50:38.889061 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d623b341-6fa2-476f-abdf-4c1085c1a2a8 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.886396 Jan 15 20:50:38.890207 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 339/747] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 20:50:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 888 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 20:50:38.899907 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-de56d6a3-20a4-4758-8147-453164aeda1b tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:38.900759 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-de56d6a3-20a4-4758-8147-453164aeda1b tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] [instance: 1085522d-3ccc-4de0-b9dd-01c374e1f0ca] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:38.907867 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-de56d6a3-20a4-4758-8147-453164aeda1b tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:38.908312 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-de56d6a3-20a4-4758-8147-453164aeda1b tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:38.909312 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-de56d6a3-20a4-4758-8147-453164aeda1b tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:38.909886 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-de56d6a3-20a4-4758-8147-453164aeda1b tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:38.975882 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c12d74fc-85dc-4cb4-85a3-d728105059e7 tempest-ServersOnMultiNodesTest-1194618714 tempest-ServersOnMultiNodesTest-1194618714-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/eb4f55a3-96ef-4194-8506-e430b262c1f0" status: 200 len: 1618 microversion: 2.1 time: 0.198406 Jan 15 20:50:38.986679 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 409/748] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:38 2022] GET /compute/v2.1/servers/eb4f55a3-96ef-4194-8506-e430b262c1f0 => generated 1618 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:38.986679 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a3ef971d-1eee-41ad-90b2-98ae146e2767 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:38.986679 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a3ef971d-1eee-41ad-90b2-98ae146e2767 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] [instance: f89db7df-a7e8-4138-8949-d76e2ccd282d] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:38.991983 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a3ef971d-1eee-41ad-90b2-98ae146e2767 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:38.992993 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a3ef971d-1eee-41ad-90b2-98ae146e2767 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:38.994200 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a3ef971d-1eee-41ad-90b2-98ae146e2767 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:38.994850 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a3ef971d-1eee-41ad-90b2-98ae146e2767 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:39.128901 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.objects.instance [None req-de56d6a3-20a4-4758-8147-453164aeda1b tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Lazy-loading 'services' on Instance uuid 1085522d-3ccc-4de0-b9dd-01c374e1f0ca {{(pid=129365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 20:50:39.151714 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-de56d6a3-20a4-4758-8147-453164aeda1b tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/1085522d-3ccc-4de0-b9dd-01c374e1f0ca" status: 200 len: 2050 microversion: 2.25 time: 0.260306 Jan 15 20:50:39.155652 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 340/749] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:50:38 2022] GET /compute/v2.1/servers/1085522d-3ccc-4de0-b9dd-01c374e1f0ca => generated 2050 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:50:39.161240 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-03137f74-f79a-42aa-bc42-254b54941fb3 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:39.162220 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-03137f74-f79a-42aa-bc42-254b54941fb3 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] [instance: 69b95b86-744d-4552-a0fc-6ced4d9ef38d] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:39.213946 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-a3ef971d-1eee-41ad-90b2-98ae146e2767 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d4a57cfaa145009ba9cc8f21d9e8ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4a26c8edac44c8b26fd4e43813412d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:39.229719 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-03137f74-f79a-42aa-bc42-254b54941fb3 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02b23752962428b825b6f7757f54007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f60a2e220b479abf4b04536ed406e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:39.230136 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a3ef971d-1eee-41ad-90b2-98ae146e2767 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] 10.222.0.46 "GET /compute/v2.1/servers/f89db7df-a7e8-4138-8949-d76e2ccd282d" status: 200 len: 1313 microversion: 2.1 time: 0.246575 Jan 15 20:50:39.231810 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 410/750] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:38 2022] GET /compute/v2.1/servers/f89db7df-a7e8-4138-8949-d76e2ccd282d => generated 1313 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:39.239418 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e01461e5-78a1-4081-b0be-2c8e78f2223d tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:39.244705 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e01461e5-78a1-4081-b0be-2c8e78f2223d tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] [instance: 7a5972c0-eea6-4198-8532-1efff379b087] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:39.247130 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-03137f74-f79a-42aa-bc42-254b54941fb3 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] 10.222.0.46 "GET /compute/v2.1/servers/69b95b86-744d-4552-a0fc-6ced4d9ef38d" status: 200 len: 1232 microversion: 2.1 time: 0.089750 Jan 15 20:50:39.255681 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e01461e5-78a1-4081-b0be-2c8e78f2223d tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:39.256347 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e01461e5-78a1-4081-b0be-2c8e78f2223d tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:39.257781 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 341/751] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:39 2022] GET /compute/v2.1/servers/69b95b86-744d-4552-a0fc-6ced4d9ef38d => generated 1232 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:39.261537 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e01461e5-78a1-4081-b0be-2c8e78f2223d tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:39.264966 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-fe88f595-abb2-42f7-a608-ed9f69a8084c tempest-ServersOnMultiNodesTest-1194618714 tempest-ServersOnMultiNodesTest-1194618714-project-admin] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:39.265786 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e01461e5-78a1-4081-b0be-2c8e78f2223d tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:39.266183 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-fe88f595-abb2-42f7-a608-ed9f69a8084c tempest-ServersOnMultiNodesTest-1194618714 tempest-ServersOnMultiNodesTest-1194618714-project-admin] [instance: 3934550f-0131-4bd3-890b-edbaf4ccac0e] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:39.275405 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fe88f595-abb2-42f7-a608-ed9f69a8084c tempest-ServersOnMultiNodesTest-1194618714 tempest-ServersOnMultiNodesTest-1194618714-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:39.275859 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fe88f595-abb2-42f7-a608-ed9f69a8084c tempest-ServersOnMultiNodesTest-1194618714 tempest-ServersOnMultiNodesTest-1194618714-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:39.276906 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fe88f595-abb2-42f7-a608-ed9f69a8084c tempest-ServersOnMultiNodesTest-1194618714 tempest-ServersOnMultiNodesTest-1194618714-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:39.278040 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fe88f595-abb2-42f7-a608-ed9f69a8084c tempest-ServersOnMultiNodesTest-1194618714 tempest-ServersOnMultiNodesTest-1194618714-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:39.517625 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-fe88f595-abb2-42f7-a608-ed9f69a8084c tempest-ServersOnMultiNodesTest-1194618714 tempest-ServersOnMultiNodesTest-1194618714-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/3934550f-0131-4bd3-890b-edbaf4ccac0e" status: 200 len: 1620 microversion: 2.1 time: 0.257111 Jan 15 20:50:39.521387 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 342/752] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:39 2022] GET /compute/v2.1/servers/3934550f-0131-4bd3-890b-edbaf4ccac0e => generated 1620 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:39.526667 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3dc84169-bd2d-458c-a4be-c19c9e00f1e5 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:39.529223 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-3dc84169-bd2d-458c-a4be-c19c9e00f1e5 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] [instance: ecba885c-f344-480e-9efc-707d1c542d42] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:39.539132 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3dc84169-bd2d-458c-a4be-c19c9e00f1e5 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:39.540160 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3dc84169-bd2d-458c-a4be-c19c9e00f1e5 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:39.540870 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3dc84169-bd2d-458c-a4be-c19c9e00f1e5 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:39.541467 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3dc84169-bd2d-458c-a4be-c19c9e00f1e5 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:39.574053 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-e01461e5-78a1-4081-b0be-2c8e78f2223d tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f311520925464d1a8c7d7302a1ef4bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25de5a60ff6f48aebb27a1ef9cbe0606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:39.581520 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e01461e5-78a1-4081-b0be-2c8e78f2223d tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] 10.222.0.46 "GET /compute/v2.1/servers/7a5972c0-eea6-4198-8532-1efff379b087" status: 200 len: 1313 microversion: 2.1 time: 0.348462 Jan 15 20:50:39.592044 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 411/753] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:39 2022] GET /compute/v2.1/servers/7a5972c0-eea6-4198-8532-1efff379b087 => generated 1313 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:39.597147 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-439856f2-3974-4a2d-a928-78722aca5e22 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:50:39.598122 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-439856f2-3974-4a2d-a928-78722aca5e22 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 98d0ca37-0175-44e2-8a1d-965cdc517daf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:39.604803 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-439856f2-3974-4a2d-a928-78722aca5e22 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:39.605283 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-439856f2-3974-4a2d-a928-78722aca5e22 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:39.606069 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-439856f2-3974-4a2d-a928-78722aca5e22 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:39.606674 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-439856f2-3974-4a2d-a928-78722aca5e22 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:39.657526 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-439856f2-3974-4a2d-a928-78722aca5e22 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action" status: 200 len: 32634 microversion: 2.1 time: 0.063801 Jan 15 20:50:39.658178 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 412/754] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:50:39 2022] POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action => generated 32634 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:50:39.663674 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8113bc96-42d4-4b2e-8152-833416d6fb27 tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:39.664426 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-8113bc96-42d4-4b2e-8152-833416d6fb27 tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] [instance: 1085522d-3ccc-4de0-b9dd-01c374e1f0ca] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:39.672799 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8113bc96-42d4-4b2e-8152-833416d6fb27 tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:39.673284 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8113bc96-42d4-4b2e-8152-833416d6fb27 tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:39.674064 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8113bc96-42d4-4b2e-8152-833416d6fb27 tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:39.674495 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8113bc96-42d4-4b2e-8152-833416d6fb27 tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:39.710591 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-3dc84169-bd2d-458c-a4be-c19c9e00f1e5 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55be87ae7f14b499ab2cd6fc5538988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd217e7fd648b4a78c0c32ff1c95f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:39.719336 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3dc84169-bd2d-458c-a4be-c19c9e00f1e5 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "GET /compute/v2.1/servers/ecba885c-f344-480e-9efc-707d1c542d42" status: 200 len: 1308 microversion: 2.1 time: 0.196402 Jan 15 20:50:39.720051 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 343/755] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:39 2022] GET /compute/v2.1/servers/ecba885c-f344-480e-9efc-707d1c542d42 => generated 1308 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:39.725683 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-1a2b48d8-9b01-4c35-975c-b12b580cc033 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Action: 'create', calling method: .version_select at 0x7f30c96bb9d0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-752331516", "policies": ["anti-affinity"]}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:50:39.756789 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-1a2b48d8-9b01-4c35-975c-b12b580cc033 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Getting quotas for project e8cfe33be708428abef52f5e8e25621b. Resources: {'server_groups'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:50:39.764231 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-1a2b48d8-9b01-4c35-975c-b12b580cc033 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Getting quotas for user bc38f86758f9416b9e7f6915de0359d6 and project e8cfe33be708428abef52f5e8e25621b. Resources: {'server_groups'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:50:39.833636 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.objects.instance [None req-8113bc96-42d4-4b2e-8152-833416d6fb27 tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Lazy-loading 'services' on Instance uuid 1085522d-3ccc-4de0-b9dd-01c374e1f0ca {{(pid=129366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 20:50:39.838897 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-1a2b48d8-9b01-4c35-975c-b12b580cc033 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Getting quotas for project e8cfe33be708428abef52f5e8e25621b. Resources: {'server_groups'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:50:39.848879 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-8113bc96-42d4-4b2e-8152-833416d6fb27 tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/1085522d-3ccc-4de0-b9dd-01c374e1f0ca" status: 200 len: 2050 microversion: 2.25 time: 0.189336 Jan 15 20:50:39.854215 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-1a2b48d8-9b01-4c35-975c-b12b580cc033 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Getting quotas for user bc38f86758f9416b9e7f6915de0359d6 and project e8cfe33be708428abef52f5e8e25621b. Resources: {'server_groups'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:50:39.863366 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 413/756] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:50:39 2022] GET /compute/v2.1/servers/1085522d-3ccc-4de0-b9dd-01c374e1f0ca => generated 2050 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:50:39.870977 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-5a40c305-342d-4b16-a6a2-f1105768ac3b tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:39.871634 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-5a40c305-342d-4b16-a6a2-f1105768ac3b tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: e3fa2f27-df7a-4ecb-9bba-c970e3e7d106] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:39.875172 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-1a2b48d8-9b01-4c35-975c-b12b580cc033 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] 10.222.0.46 "POST /compute/v2.1/os-server-groups" status: 200 len: 192 microversion: 2.1 time: 0.153580 Jan 15 20:50:39.878320 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5a40c305-342d-4b16-a6a2-f1105768ac3b tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:39.878967 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5a40c305-342d-4b16-a6a2-f1105768ac3b tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:39.879916 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5a40c305-342d-4b16-a6a2-f1105768ac3b tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:39.880342 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5a40c305-342d-4b16-a6a2-f1105768ac3b tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:39.883962 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 344/757] 10.222.0.46 () {60 vars in 1173 bytes} [Sat Jan 15 20:50:39 2022] POST /compute/v2.1/os-server-groups => generated 192 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:50:39.892762 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8353fe78-e8a3-43a3-92fd-0247c59bbd22 tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:39.894271 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:50:39.894271 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:50:39.895830 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8353fe78-e8a3-43a3-92fd-0247c59bbd22 tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:39.896272 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8353fe78-e8a3-43a3-92fd-0247c59bbd22 tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:39.897143 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8353fe78-e8a3-43a3-92fd-0247c59bbd22 tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:39.897566 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8353fe78-e8a3-43a3-92fd-0247c59bbd22 tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:39.922474 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-8353fe78-e8a3-43a3-92fd-0247c59bbd22 tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] 10.222.0.46 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.037148 Jan 15 20:50:39.923103 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 345/758] 10.222.0.46 () {60 vars in 1216 bytes} [Sat Jan 15 20:50:39 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:50:39.933442 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a257647f-6269-4be0-b545-cc42007bbcc1 tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:50:39.934186 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a257647f-6269-4be0-b545-cc42007bbcc1 tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] [instance: 1085522d-3ccc-4de0-b9dd-01c374e1f0ca] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:39.940892 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a257647f-6269-4be0-b545-cc42007bbcc1 tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:39.941345 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a257647f-6269-4be0-b545-cc42007bbcc1 tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:39.942127 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a257647f-6269-4be0-b545-cc42007bbcc1 tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:39.942559 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a257647f-6269-4be0-b545-cc42007bbcc1 tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:40.070002 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a257647f-6269-4be0-b545-cc42007bbcc1 tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] 10.222.0.46 "POST /compute/v2.1/servers/1085522d-3ccc-4de0-b9dd-01c374e1f0ca/action" status: 202 len: 0 microversion: 2.25 time: 0.139868 Jan 15 20:50:40.073908 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 346/759] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 20:50:39 2022] POST /compute/v2.1/servers/1085522d-3ccc-4de0-b9dd-01c374e1f0ca/action => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 15 20:50:40.091588 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-00ceb2b0-4181-4f34-bb3a-4dffc602e9bb tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:40.092739 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-00ceb2b0-4181-4f34-bb3a-4dffc602e9bb tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] [instance: 1085522d-3ccc-4de0-b9dd-01c374e1f0ca] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:40.102389 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-5a40c305-342d-4b16-a6a2-f1105768ac3b tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:40.111357 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-5a40c305-342d-4b16-a6a2-f1105768ac3b tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/e3fa2f27-df7a-4ecb-9bba-c970e3e7d106" status: 200 len: 1476 microversion: 2.1 time: 0.246119 Jan 15 20:50:40.124403 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 414/760] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:39 2022] GET /compute/v2.1/servers/e3fa2f27-df7a-4ecb-9bba-c970e3e7d106 => generated 1476 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:40.124613 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-00ceb2b0-4181-4f34-bb3a-4dffc602e9bb tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:40.124613 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-00ceb2b0-4181-4f34-bb3a-4dffc602e9bb tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:40.124613 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-00ceb2b0-4181-4f34-bb3a-4dffc602e9bb tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:40.124923 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-00ceb2b0-4181-4f34-bb3a-4dffc602e9bb tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:40.125016 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-837f0d61-3404-4e98-92d5-4c17ca404368 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1659414783", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "3fea0289-5bb6-4136-acf4-b883ed4fc4ee"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:50:40.194865 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.network.neutron [None req-837f0d61-3404-4e98-92d5-4c17ca404368 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] validate_networks() for None {{(pid=129366) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 20:50:40.388570 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.objects.instance [None req-00ceb2b0-4181-4f34-bb3a-4dffc602e9bb tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Lazy-loading 'services' on Instance uuid 1085522d-3ccc-4de0-b9dd-01c374e1f0ca {{(pid=129365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 20:50:40.417082 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-00ceb2b0-4181-4f34-bb3a-4dffc602e9bb tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/1085522d-3ccc-4de0-b9dd-01c374e1f0ca" status: 200 len: 2055 microversion: 2.25 time: 0.337990 Jan 15 20:50:40.419098 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 347/761] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:50:40 2022] GET /compute/v2.1/servers/1085522d-3ccc-4de0-b9dd-01c374e1f0ca => generated 2055 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:50:40.436519 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5802195f-28a9-45df-bbc5-07024f6052f0 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:40.439487 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-5802195f-28a9-45df-bbc5-07024f6052f0 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] [instance: f89db7df-a7e8-4138-8949-d76e2ccd282d] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:40.448899 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5802195f-28a9-45df-bbc5-07024f6052f0 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:40.451190 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5802195f-28a9-45df-bbc5-07024f6052f0 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:40.452519 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5802195f-28a9-45df-bbc5-07024f6052f0 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:40.453218 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5802195f-28a9-45df-bbc5-07024f6052f0 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:40.671085 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-837f0d61-3404-4e98-92d5-4c17ca404368 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Flavor limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 20:50:40.671602 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-837f0d61-3404-4e98-92d5-4c17ca404368 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Image limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 20:50:40.671964 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-837f0d61-3404-4e98-92d5-4c17ca404368 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Flavor pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 20:50:40.672373 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-837f0d61-3404-4e98-92d5-4c17ca404368 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Image pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 20:50:40.672782 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-837f0d61-3404-4e98-92d5-4c17ca404368 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 20:50:40.698162 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-837f0d61-3404-4e98-92d5-4c17ca404368 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:40.698807 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-837f0d61-3404-4e98-92d5-4c17ca404368 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:40.700427 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-837f0d61-3404-4e98-92d5-4c17ca404368 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:40.701065 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-837f0d61-3404-4e98-92d5-4c17ca404368 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:40.727027 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-837f0d61-3404-4e98-92d5-4c17ca404368 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Getting quotas for project e8cfe33be708428abef52f5e8e25621b. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:50:40.731402 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-837f0d61-3404-4e98-92d5-4c17ca404368 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Getting quotas for user bc38f86758f9416b9e7f6915de0359d6 and project e8cfe33be708428abef52f5e8e25621b. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:50:40.744563 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-837f0d61-3404-4e98-92d5-4c17ca404368 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Going to run 2 instances... {{(pid=129366) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 20:50:40.747223 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-837f0d61-3404-4e98-92d5-4c17ca404368 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] [instance: c0916b98-698b-448b-9b06-95791cbf533c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 20:50:40.756970 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-5802195f-28a9-45df-bbc5-07024f6052f0 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d4a57cfaa145009ba9cc8f21d9e8ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4a26c8edac44c8b26fd4e43813412d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:40.771666 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5802195f-28a9-45df-bbc5-07024f6052f0 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] 10.222.0.46 "GET /compute/v2.1/servers/f89db7df-a7e8-4138-8949-d76e2ccd282d" status: 200 len: 1463 microversion: 2.1 time: 0.349902 Jan 15 20:50:40.785660 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 348/762] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:40 2022] GET /compute/v2.1/servers/f89db7df-a7e8-4138-8949-d76e2ccd282d => generated 1463 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:40.791689 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-837f0d61-3404-4e98-92d5-4c17ca404368 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=129366) _server_group_count_members_by_user /opt/stack/nova/nova/quota.py:1154}} Jan 15 20:50:40.791983 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b220e84f-3414-4666-b9e4-d25fc588502e tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:40.792541 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b220e84f-3414-4666-b9e4-d25fc588502e tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] [instance: 69b95b86-744d-4552-a0fc-6ced4d9ef38d] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:40.804084 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b220e84f-3414-4666-b9e4-d25fc588502e tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:40.805526 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b220e84f-3414-4666-b9e4-d25fc588502e tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:40.808191 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b220e84f-3414-4666-b9e4-d25fc588502e tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:40.809845 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b220e84f-3414-4666-b9e4-d25fc588502e tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:40.822844 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-837f0d61-3404-4e98-92d5-4c17ca404368 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Getting quotas for project e8cfe33be708428abef52f5e8e25621b. Resources: {'server_group_members'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:50:40.827154 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-837f0d61-3404-4e98-92d5-4c17ca404368 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Getting quotas for user bc38f86758f9416b9e7f6915de0359d6 and project e8cfe33be708428abef52f5e8e25621b. Resources: {'server_group_members'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:50:40.890583 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-837f0d61-3404-4e98-92d5-4c17ca404368 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Getting quotas for project e8cfe33be708428abef52f5e8e25621b. Resources: {'server_group_members'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:50:40.894640 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-837f0d61-3404-4e98-92d5-4c17ca404368 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Getting quotas for user bc38f86758f9416b9e7f6915de0359d6 and project e8cfe33be708428abef52f5e8e25621b. Resources: {'server_group_members'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:50:40.911298 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-837f0d61-3404-4e98-92d5-4c17ca404368 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] [instance: c4b0aaad-91ee-4e37-9a34-0b4d56e282d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=c0916b98-698b-448b-9b06-95791cbf533c,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 20:50:40.928293 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-b220e84f-3414-4666-b9e4-d25fc588502e tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02b23752962428b825b6f7757f54007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f60a2e220b479abf4b04536ed406e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:40.942908 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b220e84f-3414-4666-b9e4-d25fc588502e tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] 10.222.0.46 "GET /compute/v2.1/servers/69b95b86-744d-4552-a0fc-6ced4d9ef38d" status: 200 len: 1290 microversion: 2.1 time: 0.168979 Jan 15 20:50:40.943535 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 349/763] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:40 2022] GET /compute/v2.1/servers/69b95b86-744d-4552-a0fc-6ced4d9ef38d => generated 1290 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:40.959540 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-854bd86a-1cdb-4d81-903a-4e5872c089d5 tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:40.964200 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-854bd86a-1cdb-4d81-903a-4e5872c089d5 tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] [instance: 7a5972c0-eea6-4198-8532-1efff379b087] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:40.979428 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-854bd86a-1cdb-4d81-903a-4e5872c089d5 tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:40.979907 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-854bd86a-1cdb-4d81-903a-4e5872c089d5 tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:40.980713 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-854bd86a-1cdb-4d81-903a-4e5872c089d5 tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:40.981177 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-854bd86a-1cdb-4d81-903a-4e5872c089d5 tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:41.033163 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-837f0d61-3404-4e98-92d5-4c17ca404368 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Getting quotas for project e8cfe33be708428abef52f5e8e25621b. Resources: {'server_group_members'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:50:41.040809 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-837f0d61-3404-4e98-92d5-4c17ca404368 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Getting quotas for user bc38f86758f9416b9e7f6915de0359d6 and project e8cfe33be708428abef52f5e8e25621b. Resources: {'server_group_members'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:50:41.105577 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-837f0d61-3404-4e98-92d5-4c17ca404368 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Getting quotas for project e8cfe33be708428abef52f5e8e25621b. Resources: {'server_group_members'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:50:41.110253 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-837f0d61-3404-4e98-92d5-4c17ca404368 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Getting quotas for user bc38f86758f9416b9e7f6915de0359d6 and project e8cfe33be708428abef52f5e8e25621b. Resources: {'server_group_members'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:50:41.147303 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-837f0d61-3404-4e98-92d5-4c17ca404368 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.026405 Jan 15 20:50:41.151543 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 415/764] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 20:50:40 2022] POST /compute/v2.1/servers => generated 32 bytes in 1032 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Jan 15 20:50:41.153858 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-07b51d3c-2df0-4ac3-8c8e-6dbd0d39bbf2 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:50:41.155545 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-07b51d3c-2df0-4ac3-8c8e-6dbd0d39bbf2 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 98d0ca37-0175-44e2-8a1d-965cdc517daf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:41.167281 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-07b51d3c-2df0-4ac3-8c8e-6dbd0d39bbf2 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:41.167820 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-07b51d3c-2df0-4ac3-8c8e-6dbd0d39bbf2 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:41.168963 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-07b51d3c-2df0-4ac3-8c8e-6dbd0d39bbf2 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:41.170422 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-07b51d3c-2df0-4ac3-8c8e-6dbd0d39bbf2 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:41.194642 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-854bd86a-1cdb-4d81-903a-4e5872c089d5 tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f311520925464d1a8c7d7302a1ef4bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25de5a60ff6f48aebb27a1ef9cbe0606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:41.205778 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-854bd86a-1cdb-4d81-903a-4e5872c089d5 tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] 10.222.0.46 "GET /compute/v2.1/servers/7a5972c0-eea6-4198-8532-1efff379b087" status: 200 len: 1313 microversion: 2.1 time: 0.258067 Jan 15 20:50:41.206377 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 350/765] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:40 2022] GET /compute/v2.1/servers/7a5972c0-eea6-4198-8532-1efff379b087 => generated 1313 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:41.216446 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-facbca02-869b-4944-8d3a-f1b95efed94a tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:41.217350 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-facbca02-869b-4944-8d3a-f1b95efed94a tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] [instance: ecba885c-f344-480e-9efc-707d1c542d42] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:41.225846 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-07b51d3c-2df0-4ac3-8c8e-6dbd0d39bbf2 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action" status: 200 len: 32634 microversion: 2.1 time: 0.075407 Jan 15 20:50:41.226212 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-facbca02-869b-4944-8d3a-f1b95efed94a tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:41.227698 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 416/766] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:50:41 2022] POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action => generated 32634 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:50:41.228081 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-facbca02-869b-4944-8d3a-f1b95efed94a tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:41.229073 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-facbca02-869b-4944-8d3a-f1b95efed94a tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:41.229688 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-facbca02-869b-4944-8d3a-f1b95efed94a tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:41.439271 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ea1eaf4f-74e1-4b66-a23a-7cc7e547999d tempest-ServersAdminTestJSON-212694955 tempest-ServersAdminTestJSON-212694955-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:41.446455 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:50:41.446455 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:50:41.448593 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ea1eaf4f-74e1-4b66-a23a-7cc7e547999d tempest-ServersAdminTestJSON-212694955 tempest-ServersAdminTestJSON-212694955-project-admin] Searching by: {'deleted': False, 'project_id': '03d06487a1a94bda819cda6185561a52'} {{(pid=129366) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 15 20:50:41.488539 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ea1eaf4f-74e1-4b66-a23a-7cc7e547999d tempest-ServersAdminTestJSON-212694955 tempest-ServersAdminTestJSON-212694955-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:41.489050 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ea1eaf4f-74e1-4b66-a23a-7cc7e547999d tempest-ServersAdminTestJSON-212694955 tempest-ServersAdminTestJSON-212694955-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:41.489893 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ea1eaf4f-74e1-4b66-a23a-7cc7e547999d tempest-ServersAdminTestJSON-212694955 tempest-ServersAdminTestJSON-212694955-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:41.493157 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ea1eaf4f-74e1-4b66-a23a-7cc7e547999d tempest-ServersAdminTestJSON-212694955 tempest-ServersAdminTestJSON-212694955-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:41.513717 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-facbca02-869b-4944-8d3a-f1b95efed94a tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55be87ae7f14b499ab2cd6fc5538988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd217e7fd648b4a78c0c32ff1c95f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:41.541315 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-facbca02-869b-4944-8d3a-f1b95efed94a tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "GET /compute/v2.1/servers/ecba885c-f344-480e-9efc-707d1c542d42" status: 200 len: 1308 microversion: 2.1 time: 0.330452 Jan 15 20:50:41.543090 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 351/767] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:41 2022] GET /compute/v2.1/servers/ecba885c-f344-480e-9efc-707d1c542d42 => generated 1308 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:41.551510 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-7292e877-f3b3-40e9-abc4-ee18b1100d17 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:41.553013 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-7292e877-f3b3-40e9-abc4-ee18b1100d17 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: e3fa2f27-df7a-4ecb-9bba-c970e3e7d106] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:41.559850 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7292e877-f3b3-40e9-abc4-ee18b1100d17 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:41.560777 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7292e877-f3b3-40e9-abc4-ee18b1100d17 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:41.563774 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7292e877-f3b3-40e9-abc4-ee18b1100d17 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:41.564722 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7292e877-f3b3-40e9-abc4-ee18b1100d17 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:41.658800 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ea1eaf4f-74e1-4b66-a23a-7cc7e547999d tempest-ServersAdminTestJSON-212694955 tempest-ServersAdminTestJSON-212694955-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.429634 Jan 15 20:50:41.659823 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 417/768] 10.222.0.46 () {58 vars in 1145 bytes} [Sat Jan 15 20:50:41 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 20:50:41.671993 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-99f14395-bf48-4111-853f-47ec7d1b4048 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:41.675867 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:50:41.675867 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:50:41.677121 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-99f14395-bf48-4111-853f-47ec7d1b4048 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bc38f86758f9416b9e7f6915de0359d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8cfe33be708428abef52f5e8e25621b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:41.677965 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-99f14395-bf48-4111-853f-47ec7d1b4048 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Searching by: {'deleted': False, 'project_id': 'e8cfe33be708428abef52f5e8e25621b'} {{(pid=129366) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 15 20:50:41.704965 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-99f14395-bf48-4111-853f-47ec7d1b4048 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:41.705529 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-99f14395-bf48-4111-853f-47ec7d1b4048 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:41.706604 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-99f14395-bf48-4111-853f-47ec7d1b4048 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:41.707052 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-99f14395-bf48-4111-853f-47ec7d1b4048 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:41.750940 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.multi_cell_list [None req-99f14395-bf48-4111-853f-47ec7d1b4048 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=129366) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jan 15 20:50:41.791427 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-99f14395-bf48-4111-853f-47ec7d1b4048 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] 10.222.0.46 "GET /compute/v2.1/servers" status: 200 len: 1665 microversion: 2.1 time: 0.130517 Jan 15 20:50:41.792416 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 418/769] 10.222.0.46 () {58 vars in 1124 bytes} [Sat Jan 15 20:50:41 2022] GET /compute/v2.1/servers => generated 1665 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:41.808056 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-54d7f4ac-7534-4c3c-bed8-319c07946e4b tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:41.810443 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-54d7f4ac-7534-4c3c-bed8-319c07946e4b tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] [instance: 1085522d-3ccc-4de0-b9dd-01c374e1f0ca] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:41.849580 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-54d7f4ac-7534-4c3c-bed8-319c07946e4b tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:41.850310 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-54d7f4ac-7534-4c3c-bed8-319c07946e4b tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:41.851010 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-54d7f4ac-7534-4c3c-bed8-319c07946e4b tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:41.851471 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-54d7f4ac-7534-4c3c-bed8-319c07946e4b tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:42.119601 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-7292e877-f3b3-40e9-abc4-ee18b1100d17 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:42.129480 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-7292e877-f3b3-40e9-abc4-ee18b1100d17 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/e3fa2f27-df7a-4ecb-9bba-c970e3e7d106" status: 200 len: 1476 microversion: 2.1 time: 0.584080 Jan 15 20:50:42.130687 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 352/770] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:41 2022] GET /compute/v2.1/servers/e3fa2f27-df7a-4ecb-9bba-c970e3e7d106 => generated 1476 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:42.137234 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f2364b77-510f-4f21-b7d9-85ffa81c7af0 tempest-ServersAdminTestJSON-212694955 tempest-ServersAdminTestJSON-212694955-project-admin] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:42.141550 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:50:42.141550 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:50:42.143298 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:detail:get_all_tenants": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:50:42.143298 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:50:42.144990 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f2364b77-510f-4f21-b7d9-85ffa81c7af0 tempest-ServersAdminTestJSON-212694955 tempest-ServersAdminTestJSON-212694955-project-admin] Searching by: {'deleted': False} {{(pid=129365) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 15 20:50:42.165125 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f2364b77-510f-4f21-b7d9-85ffa81c7af0 tempest-ServersAdminTestJSON-212694955 tempest-ServersAdminTestJSON-212694955-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:42.165586 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f2364b77-510f-4f21-b7d9-85ffa81c7af0 tempest-ServersAdminTestJSON-212694955 tempest-ServersAdminTestJSON-212694955-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:42.166431 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f2364b77-510f-4f21-b7d9-85ffa81c7af0 tempest-ServersAdminTestJSON-212694955 tempest-ServersAdminTestJSON-212694955-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:42.166849 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f2364b77-510f-4f21-b7d9-85ffa81c7af0 tempest-ServersAdminTestJSON-212694955 tempest-ServersAdminTestJSON-212694955-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:42.254052 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.objects.instance [None req-54d7f4ac-7534-4c3c-bed8-319c07946e4b tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Lazy-loading 'services' on Instance uuid 1085522d-3ccc-4de0-b9dd-01c374e1f0ca {{(pid=129366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 20:50:42.306392 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-54d7f4ac-7534-4c3c-bed8-319c07946e4b tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/1085522d-3ccc-4de0-b9dd-01c374e1f0ca" status: 200 len: 2035 microversion: 2.25 time: 0.512298 Jan 15 20:50:42.307587 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 419/771] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:50:41 2022] GET /compute/v2.1/servers/1085522d-3ccc-4de0-b9dd-01c374e1f0ca => generated 2035 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:50:42.315629 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ccce22b2-c2ef-4edd-99ea-7043742383cc tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:42.319754 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ccce22b2-c2ef-4edd-99ea-7043742383cc tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] [instance: c4b0aaad-91ee-4e37-9a34-0b4d56e282d5] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:42.328027 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ccce22b2-c2ef-4edd-99ea-7043742383cc tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:42.328522 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ccce22b2-c2ef-4edd-99ea-7043742383cc tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:42.329365 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ccce22b2-c2ef-4edd-99ea-7043742383cc tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:42.329959 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ccce22b2-c2ef-4edd-99ea-7043742383cc tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:42.413906 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-ccce22b2-c2ef-4edd-99ea-7043742383cc tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc38f86758f9416b9e7f6915de0359d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8cfe33be708428abef52f5e8e25621b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:42.427012 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.multi_cell_list [None req-f2364b77-510f-4f21-b7d9-85ffa81c7af0 tempest-ServersAdminTestJSON-212694955 tempest-ServersAdminTestJSON-212694955-project-admin] Listed batch of 16 results from cell out of 998 limit. Returned 16 total so far. {{(pid=129365) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jan 15 20:50:42.429544 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ccce22b2-c2ef-4edd-99ea-7043742383cc tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] 10.222.0.46 "GET /compute/v2.1/servers/c4b0aaad-91ee-4e37-9a34-0b4d56e282d5" status: 200 len: 1223 microversion: 2.1 time: 0.119505 Jan 15 20:50:42.436454 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 420/772] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:42 2022] GET /compute/v2.1/servers/c4b0aaad-91ee-4e37-9a34-0b4d56e282d5 => generated 1223 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:42.447874 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-331504cb-6ce4-4b12-833d-eefcd718f8cf tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:42.448614 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-331504cb-6ce4-4b12-833d-eefcd718f8cf tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] [instance: 69b95b86-744d-4552-a0fc-6ced4d9ef38d] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:42.455816 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-331504cb-6ce4-4b12-833d-eefcd718f8cf tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:42.456398 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-331504cb-6ce4-4b12-833d-eefcd718f8cf tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:42.457319 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-331504cb-6ce4-4b12-833d-eefcd718f8cf tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:42.457992 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-331504cb-6ce4-4b12-833d-eefcd718f8cf tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:42.590749 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f2364b77-510f-4f21-b7d9-85ffa81c7af0 tempest-ServersAdminTestJSON-212694955 tempest-ServersAdminTestJSON-212694955-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:42.591991 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f2364b77-510f-4f21-b7d9-85ffa81c7af0 tempest-ServersAdminTestJSON-212694955 tempest-ServersAdminTestJSON-212694955-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:42.815544 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-331504cb-6ce4-4b12-833d-eefcd718f8cf tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02b23752962428b825b6f7757f54007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f60a2e220b479abf4b04536ed406e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:42.825170 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-331504cb-6ce4-4b12-833d-eefcd718f8cf tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] 10.222.0.46 "GET /compute/v2.1/servers/69b95b86-744d-4552-a0fc-6ced4d9ef38d" status: 200 len: 1332 microversion: 2.1 time: 0.387289 Jan 15 20:50:42.825815 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 421/773] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:42 2022] GET /compute/v2.1/servers/69b95b86-744d-4552-a0fc-6ced4d9ef38d => generated 1332 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:42.835053 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-134b2da9-125c-4cdb-af55-fa2f6bbb36e1 tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:42.835053 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-134b2da9-125c-4cdb-af55-fa2f6bbb36e1 tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] [instance: 7a5972c0-eea6-4198-8532-1efff379b087] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:42.845066 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-134b2da9-125c-4cdb-af55-fa2f6bbb36e1 tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:42.845447 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-134b2da9-125c-4cdb-af55-fa2f6bbb36e1 tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:42.846239 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-134b2da9-125c-4cdb-af55-fa2f6bbb36e1 tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:42.846672 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-134b2da9-125c-4cdb-af55-fa2f6bbb36e1 tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:43.206175 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-134b2da9-125c-4cdb-af55-fa2f6bbb36e1 tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f311520925464d1a8c7d7302a1ef4bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25de5a60ff6f48aebb27a1ef9cbe0606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:43.216741 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-134b2da9-125c-4cdb-af55-fa2f6bbb36e1 tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] 10.222.0.46 "GET /compute/v2.1/servers/7a5972c0-eea6-4198-8532-1efff379b087" status: 200 len: 1313 microversion: 2.1 time: 0.389750 Jan 15 20:50:43.218390 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 422/774] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:42 2022] GET /compute/v2.1/servers/7a5972c0-eea6-4198-8532-1efff379b087 => generated 1313 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:43.224916 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a48b2b4b-60c2-42f4-b5f0-674c6de898a3 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:50:43.225879 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a48b2b4b-60c2-42f4-b5f0-674c6de898a3 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 98d0ca37-0175-44e2-8a1d-965cdc517daf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:43.241096 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a48b2b4b-60c2-42f4-b5f0-674c6de898a3 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:43.241550 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a48b2b4b-60c2-42f4-b5f0-674c6de898a3 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:43.243055 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a48b2b4b-60c2-42f4-b5f0-674c6de898a3 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:43.243055 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a48b2b4b-60c2-42f4-b5f0-674c6de898a3 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:43.328729 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a48b2b4b-60c2-42f4-b5f0-674c6de898a3 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action" status: 200 len: 32634 microversion: 2.1 time: 0.108056 Jan 15 20:50:43.340689 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 423/775] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:50:43 2022] POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action => generated 32634 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:50:43.363045 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-283edd5d-94e7-4e78-ad07-f396310c27af tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": "auto"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:50:43.364083 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-283edd5d-94e7-4e78-ad07-f396310c27af tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] [instance: 1085522d-3ccc-4de0-b9dd-01c374e1f0ca] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:43.389361 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-283edd5d-94e7-4e78-ad07-f396310c27af tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:43.389854 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-283edd5d-94e7-4e78-ad07-f396310c27af tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:43.390657 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-283edd5d-94e7-4e78-ad07-f396310c27af tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:43.391851 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-283edd5d-94e7-4e78-ad07-f396310c27af tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:43.488803 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.objects.instance [None req-283edd5d-94e7-4e78-ad07-f396310c27af tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Lazy-loading 'flavor' on Instance uuid 1085522d-3ccc-4de0-b9dd-01c374e1f0ca {{(pid=129366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 20:50:43.505832 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-283edd5d-94e7-4e78-ad07-f396310c27af tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] [instance: 1085522d-3ccc-4de0-b9dd-01c374e1f0ca] Going to try to live migrate instance to nch2-master-1 {{(pid=129366) live_migrate /opt/stack/nova/nova/compute/api.py:5255}} Jan 15 20:50:43.546120 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f2364b77-510f-4f21-b7d9-85ffa81c7af0 tempest-ServersAdminTestJSON-212694955 tempest-ServersAdminTestJSON-212694955-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 25041 microversion: 2.1 time: 1.413464 Jan 15 20:50:43.546931 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 353/776] 10.222.0.46 () {58 vars in 1170 bytes} [Sat Jan 15 20:50:42 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 25041 bytes in 1416 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:50:43.551816 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-6808fdaf-a7fe-44ee-8ca8-17a2f32b850f tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:43.553395 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-6808fdaf-a7fe-44ee-8ca8-17a2f32b850f tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] [instance: ecba885c-f344-480e-9efc-707d1c542d42] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:43.560780 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6808fdaf-a7fe-44ee-8ca8-17a2f32b850f tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:43.561391 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6808fdaf-a7fe-44ee-8ca8-17a2f32b850f tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:43.562532 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6808fdaf-a7fe-44ee-8ca8-17a2f32b850f tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:43.563322 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6808fdaf-a7fe-44ee-8ca8-17a2f32b850f tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:43.728083 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-6808fdaf-a7fe-44ee-8ca8-17a2f32b850f tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55be87ae7f14b499ab2cd6fc5538988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd217e7fd648b4a78c0c32ff1c95f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:43.738031 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-6808fdaf-a7fe-44ee-8ca8-17a2f32b850f tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "GET /compute/v2.1/servers/ecba885c-f344-480e-9efc-707d1c542d42" status: 200 len: 1308 microversion: 2.1 time: 0.189764 Jan 15 20:50:43.738885 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 354/777] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:43 2022] GET /compute/v2.1/servers/ecba885c-f344-480e-9efc-707d1c542d42 => generated 1308 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:43.744353 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-152ed7b1-841a-4c4e-ba6e-5a96a1e51dcc req-e20ab14b-33c6-457b-a743-524d64ef2057 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a5972c0-eea6-4198-8532-1efff379b087", "name": "network-vif-plugged", "status": "completed", "tag": "46119a94-d225-4199-97ac-4a0048ddd01c"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:50:43.746352 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:50:43.746352 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:50:43.754749 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-152ed7b1-841a-4c4e-ba6e-5a96a1e51dcc req-e20ab14b-33c6-457b-a743-524d64ef2057 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:43.755189 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-152ed7b1-841a-4c4e-ba6e-5a96a1e51dcc req-e20ab14b-33c6-457b-a743-524d64ef2057 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:43.766768 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-152ed7b1-841a-4c4e-ba6e-5a96a1e51dcc req-e20ab14b-33c6-457b-a743-524d64ef2057 service nova] Creating event network-vif-plugged:46119a94-d225-4199-97ac-4a0048ddd01c for instance 7a5972c0-eea6-4198-8532-1efff379b087 on nch1-master-1 Jan 15 20:50:43.772433 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-152ed7b1-841a-4c4e-ba6e-5a96a1e51dcc req-e20ab14b-33c6-457b-a743-524d64ef2057 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032079 Jan 15 20:50:43.773671 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 355/778] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:50:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:50:43.778496 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-90eaa0ae-2109-459c-853d-ca7c260fd9bb req-f37613cd-6375-497a-ad7d-c8c146b6076e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69b95b86-744d-4552-a0fc-6ced4d9ef38d", "tag": "66fcf159-d8ef-45e6-9c7c-4dba94d06566"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:50:43.780494 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:50:43.780494 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:50:43.787817 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-90eaa0ae-2109-459c-853d-ca7c260fd9bb req-f37613cd-6375-497a-ad7d-c8c146b6076e service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:43.788247 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-90eaa0ae-2109-459c-853d-ca7c260fd9bb req-f37613cd-6375-497a-ad7d-c8c146b6076e service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:43.807143 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-90eaa0ae-2109-459c-853d-ca7c260fd9bb req-f37613cd-6375-497a-ad7d-c8c146b6076e service nova] Creating event network-changed:66fcf159-d8ef-45e6-9c7c-4dba94d06566 for instance 69b95b86-744d-4552-a0fc-6ced4d9ef38d on nch2-master-1 Jan 15 20:50:43.813099 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-90eaa0ae-2109-459c-853d-ca7c260fd9bb req-f37613cd-6375-497a-ad7d-c8c146b6076e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038098 Jan 15 20:50:43.814157 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 356/779] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:50:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:50:43.819084 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-af275720-cfc6-47f2-9327-a2e1fb301d9c tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:43.819946 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-af275720-cfc6-47f2-9327-a2e1fb301d9c tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: e3fa2f27-df7a-4ecb-9bba-c970e3e7d106] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:43.827386 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-af275720-cfc6-47f2-9327-a2e1fb301d9c tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:43.828518 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-af275720-cfc6-47f2-9327-a2e1fb301d9c tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:43.829484 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-af275720-cfc6-47f2-9327-a2e1fb301d9c tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:43.830065 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-af275720-cfc6-47f2-9327-a2e1fb301d9c tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:44.027690 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-af275720-cfc6-47f2-9327-a2e1fb301d9c tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:44.038332 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-af275720-cfc6-47f2-9327-a2e1fb301d9c tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/e3fa2f27-df7a-4ecb-9bba-c970e3e7d106" status: 200 len: 1476 microversion: 2.1 time: 0.222805 Jan 15 20:50:44.040631 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 357/780] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:43 2022] GET /compute/v2.1/servers/e3fa2f27-df7a-4ecb-9bba-c970e3e7d106 => generated 1476 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:44.046110 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5735c19b-e9de-4593-a9b4-9a437e3306e0 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:44.047465 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-5735c19b-e9de-4593-a9b4-9a437e3306e0 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] [instance: c4b0aaad-91ee-4e37-9a34-0b4d56e282d5] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:44.053960 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5735c19b-e9de-4593-a9b4-9a437e3306e0 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:44.054369 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5735c19b-e9de-4593-a9b4-9a437e3306e0 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:44.055554 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5735c19b-e9de-4593-a9b4-9a437e3306e0 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:44.055986 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5735c19b-e9de-4593-a9b4-9a437e3306e0 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:44.137147 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-5735c19b-e9de-4593-a9b4-9a437e3306e0 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc38f86758f9416b9e7f6915de0359d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8cfe33be708428abef52f5e8e25621b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:44.147332 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5735c19b-e9de-4593-a9b4-9a437e3306e0 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] 10.222.0.46 "GET /compute/v2.1/servers/c4b0aaad-91ee-4e37-9a34-0b4d56e282d5" status: 200 len: 1277 microversion: 2.1 time: 0.104967 Jan 15 20:50:44.153221 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 358/781] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:44 2022] GET /compute/v2.1/servers/c4b0aaad-91ee-4e37-9a34-0b4d56e282d5 => generated 1277 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:44.159734 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-446318e3-967c-4973-b95e-aebaa678f213 tempest-ServersAdminTestJSON-212694955 tempest-ServersAdminTestJSON-212694955-project-admin] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:44.163713 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:50:44.163713 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:50:44.165469 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-446318e3-967c-4973-b95e-aebaa678f213 tempest-ServersAdminTestJSON-212694955 tempest-ServersAdminTestJSON-212694955-project-admin] Searching by: {'deleted': False, 'project_id': '03d06487a1a94bda819cda6185561a52'} {{(pid=129365) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 15 20:50:44.171966 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-446318e3-967c-4973-b95e-aebaa678f213 tempest-ServersAdminTestJSON-212694955 tempest-ServersAdminTestJSON-212694955-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:44.172731 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-446318e3-967c-4973-b95e-aebaa678f213 tempest-ServersAdminTestJSON-212694955 tempest-ServersAdminTestJSON-212694955-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:44.173792 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-446318e3-967c-4973-b95e-aebaa678f213 tempest-ServersAdminTestJSON-212694955 tempest-ServersAdminTestJSON-212694955-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:44.174425 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-446318e3-967c-4973-b95e-aebaa678f213 tempest-ServersAdminTestJSON-212694955 tempest-ServersAdminTestJSON-212694955-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:44.284854 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-446318e3-967c-4973-b95e-aebaa678f213 tempest-ServersAdminTestJSON-212694955 tempest-ServersAdminTestJSON-212694955-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/detail?tenant_id=2f4a26c8edac44c8b26fd4e43813412d" status: 200 len: 15 microversion: 2.1 time: 0.129426 Jan 15 20:50:44.285435 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 359/782] 10.222.0.46 () {58 vars in 1230 bytes} [Sat Jan 15 20:50:44 2022] GET /compute/v2.1/servers/detail?tenant_id=2f4a26c8edac44c8b26fd4e43813412d => generated 15 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 20:50:44.290219 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-62513216-0d54-4c07-8716-bdd63b7672f7 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:44.290801 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-62513216-0d54-4c07-8716-bdd63b7672f7 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] [instance: 69b95b86-744d-4552-a0fc-6ced4d9ef38d] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:44.297582 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-62513216-0d54-4c07-8716-bdd63b7672f7 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:44.298048 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-62513216-0d54-4c07-8716-bdd63b7672f7 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:44.298845 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-62513216-0d54-4c07-8716-bdd63b7672f7 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:44.299279 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-62513216-0d54-4c07-8716-bdd63b7672f7 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:44.489121 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-62513216-0d54-4c07-8716-bdd63b7672f7 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02b23752962428b825b6f7757f54007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f60a2e220b479abf4b04536ed406e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:44.496970 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-62513216-0d54-4c07-8716-bdd63b7672f7 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] 10.222.0.46 "GET /compute/v2.1/servers/69b95b86-744d-4552-a0fc-6ced4d9ef38d" status: 200 len: 1332 microversion: 2.1 time: 0.210470 Jan 15 20:50:44.506557 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 360/783] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:44 2022] GET /compute/v2.1/servers/69b95b86-744d-4552-a0fc-6ced4d9ef38d => generated 1332 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:44.512584 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-149a8cf6-bc81-4d53-8386-fc3b999ad9f1 tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:44.513258 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-149a8cf6-bc81-4d53-8386-fc3b999ad9f1 tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] [instance: 7a5972c0-eea6-4198-8532-1efff379b087] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:44.520315 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-149a8cf6-bc81-4d53-8386-fc3b999ad9f1 tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:44.520315 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-149a8cf6-bc81-4d53-8386-fc3b999ad9f1 tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:44.521251 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-149a8cf6-bc81-4d53-8386-fc3b999ad9f1 tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:44.521957 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-149a8cf6-bc81-4d53-8386-fc3b999ad9f1 tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:44.679005 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-149a8cf6-bc81-4d53-8386-fc3b999ad9f1 tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f311520925464d1a8c7d7302a1ef4bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25de5a60ff6f48aebb27a1ef9cbe0606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:44.686921 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-149a8cf6-bc81-4d53-8386-fc3b999ad9f1 tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] 10.222.0.46 "GET /compute/v2.1/servers/7a5972c0-eea6-4198-8532-1efff379b087" status: 200 len: 1313 microversion: 2.1 time: 0.178990 Jan 15 20:50:44.687783 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 361/784] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:44 2022] GET /compute/v2.1/servers/7a5972c0-eea6-4198-8532-1efff379b087 => generated 1313 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:44.692386 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-54157d90-45fb-43b7-b428-e05935fde4ac tempest-ServersAdminTestJSON-212694955 tempest-ServersAdminTestJSON-212694955-project-admin] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:44.696382 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:50:44.696382 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:50:44.698612 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:detail:get_all_tenants": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:50:44.698612 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:50:44.700189 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-54157d90-45fb-43b7-b428-e05935fde4ac tempest-ServersAdminTestJSON-212694955 tempest-ServersAdminTestJSON-212694955-project-admin] Searching by: {'tenant_id': '2f4a26c8edac44c8b26fd4e43813412d', 'deleted': False} {{(pid=129365) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 15 20:50:44.705011 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-54157d90-45fb-43b7-b428-e05935fde4ac tempest-ServersAdminTestJSON-212694955 tempest-ServersAdminTestJSON-212694955-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:44.705533 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-54157d90-45fb-43b7-b428-e05935fde4ac tempest-ServersAdminTestJSON-212694955 tempest-ServersAdminTestJSON-212694955-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:44.706405 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-54157d90-45fb-43b7-b428-e05935fde4ac tempest-ServersAdminTestJSON-212694955 tempest-ServersAdminTestJSON-212694955-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:44.706897 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-54157d90-45fb-43b7-b428-e05935fde4ac tempest-ServersAdminTestJSON-212694955 tempest-ServersAdminTestJSON-212694955-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:44.742182 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.multi_cell_list [None req-54157d90-45fb-43b7-b428-e05935fde4ac tempest-ServersAdminTestJSON-212694955 tempest-ServersAdminTestJSON-212694955-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=129365) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jan 15 20:50:44.827504 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-54157d90-45fb-43b7-b428-e05935fde4ac tempest-ServersAdminTestJSON-212694955 tempest-ServersAdminTestJSON-212694955-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:44.828068 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-54157d90-45fb-43b7-b428-e05935fde4ac tempest-ServersAdminTestJSON-212694955 tempest-ServersAdminTestJSON-212694955-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:44.965474 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-54157d90-45fb-43b7-b428-e05935fde4ac tempest-ServersAdminTestJSON-212694955 tempest-ServersAdminTestJSON-212694955-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=2f4a26c8edac44c8b26fd4e43813412d" status: 200 len: 4826 microversion: 2.1 time: 0.276310 Jan 15 20:50:44.966313 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 362/785] 10.222.0.46 () {58 vars in 1256 bytes} [Sat Jan 15 20:50:44 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=2f4a26c8edac44c8b26fd4e43813412d => generated 4826 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:44.973001 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-4a1f58e3-a724-44f4-bd1f-c930684acafb tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:50:44.975024 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-4a1f58e3-a724-44f4-bd1f-c930684acafb tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 98d0ca37-0175-44e2-8a1d-965cdc517daf] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:44.986680 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4a1f58e3-a724-44f4-bd1f-c930684acafb tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:44.987675 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4a1f58e3-a724-44f4-bd1f-c930684acafb tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:44.988778 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4a1f58e3-a724-44f4-bd1f-c930684acafb tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:44.989396 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4a1f58e3-a724-44f4-bd1f-c930684acafb tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:45.052674 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-4a1f58e3-a724-44f4-bd1f-c930684acafb tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action" status: 200 len: 32634 microversion: 2.1 time: 0.084576 Jan 15 20:50:45.053866 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 363/786] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:50:44 2022] POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action => generated 32634 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:50:45.059668 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e4df0c79-d15f-4c31-9e05-84a96c46d94f tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:45.060383 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e4df0c79-d15f-4c31-9e05-84a96c46d94f tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] [instance: ecba885c-f344-480e-9efc-707d1c542d42] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:45.068983 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e4df0c79-d15f-4c31-9e05-84a96c46d94f tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:45.069437 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e4df0c79-d15f-4c31-9e05-84a96c46d94f tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:45.071618 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e4df0c79-d15f-4c31-9e05-84a96c46d94f tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:45.072015 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e4df0c79-d15f-4c31-9e05-84a96c46d94f tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:45.219673 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-e4df0c79-d15f-4c31-9e05-84a96c46d94f tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55be87ae7f14b499ab2cd6fc5538988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd217e7fd648b4a78c0c32ff1c95f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:45.228410 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e4df0c79-d15f-4c31-9e05-84a96c46d94f tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "GET /compute/v2.1/servers/ecba885c-f344-480e-9efc-707d1c542d42" status: 200 len: 1308 microversion: 2.1 time: 0.173203 Jan 15 20:50:45.229020 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 364/787] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:45 2022] GET /compute/v2.1/servers/ecba885c-f344-480e-9efc-707d1c542d42 => generated 1308 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:45.234382 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a3e0797f-0f3c-49f8-8e1d-e0cfb13a8082 tempest-ServersAdminTestJSON-212694955 tempest-ServersAdminTestJSON-212694955-project-admin] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:45.238141 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:50:45.238141 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:50:45.239445 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:detail:get_all_tenants": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:50:45.239445 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:50:45.240800 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a3e0797f-0f3c-49f8-8e1d-e0cfb13a8082 tempest-ServersAdminTestJSON-212694955 tempest-ServersAdminTestJSON-212694955-project-admin] Searching by: {'tenant_id': '03d06487a1a94bda819cda6185561a52', 'deleted': False} {{(pid=129365) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 15 20:50:45.247070 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a3e0797f-0f3c-49f8-8e1d-e0cfb13a8082 tempest-ServersAdminTestJSON-212694955 tempest-ServersAdminTestJSON-212694955-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:45.247507 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a3e0797f-0f3c-49f8-8e1d-e0cfb13a8082 tempest-ServersAdminTestJSON-212694955 tempest-ServersAdminTestJSON-212694955-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:45.248307 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a3e0797f-0f3c-49f8-8e1d-e0cfb13a8082 tempest-ServersAdminTestJSON-212694955 tempest-ServersAdminTestJSON-212694955-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:45.248734 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a3e0797f-0f3c-49f8-8e1d-e0cfb13a8082 tempest-ServersAdminTestJSON-212694955 tempest-ServersAdminTestJSON-212694955-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:45.279786 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a3e0797f-0f3c-49f8-8e1d-e0cfb13a8082 tempest-ServersAdminTestJSON-212694955 tempest-ServersAdminTestJSON-212694955-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=03d06487a1a94bda819cda6185561a52" status: 200 len: 15 microversion: 2.1 time: 0.049680 Jan 15 20:50:45.280738 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 365/788] 10.222.0.46 () {58 vars in 1256 bytes} [Sat Jan 15 20:50:45 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=03d06487a1a94bda819cda6185561a52 => generated 15 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 20:50:45.292239 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-de8d09bb-04f4-4c3d-9271-875bfee2e65f tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:45.292239 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-de8d09bb-04f4-4c3d-9271-875bfee2e65f tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: e3fa2f27-df7a-4ecb-9bba-c970e3e7d106] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:45.299385 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-de8d09bb-04f4-4c3d-9271-875bfee2e65f tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:45.299923 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-de8d09bb-04f4-4c3d-9271-875bfee2e65f tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:45.300834 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-de8d09bb-04f4-4c3d-9271-875bfee2e65f tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:45.301948 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-de8d09bb-04f4-4c3d-9271-875bfee2e65f tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:45.456088 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-de8d09bb-04f4-4c3d-9271-875bfee2e65f tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:45.465691 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-de8d09bb-04f4-4c3d-9271-875bfee2e65f tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/e3fa2f27-df7a-4ecb-9bba-c970e3e7d106" status: 200 len: 1476 microversion: 2.1 time: 0.183825 Jan 15 20:50:45.466271 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 366/789] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:45 2022] GET /compute/v2.1/servers/e3fa2f27-df7a-4ecb-9bba-c970e3e7d106 => generated 1476 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:45.470992 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-228d998c-8cb5-40d9-9b56-17b29aac23ce tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:45.471593 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-228d998c-8cb5-40d9-9b56-17b29aac23ce tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] [instance: c4b0aaad-91ee-4e37-9a34-0b4d56e282d5] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:45.480107 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-228d998c-8cb5-40d9-9b56-17b29aac23ce tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:45.480557 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-228d998c-8cb5-40d9-9b56-17b29aac23ce tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:45.481438 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-228d998c-8cb5-40d9-9b56-17b29aac23ce tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:45.481872 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-228d998c-8cb5-40d9-9b56-17b29aac23ce tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:45.543378 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-228d998c-8cb5-40d9-9b56-17b29aac23ce tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc38f86758f9416b9e7f6915de0359d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8cfe33be708428abef52f5e8e25621b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:45.551192 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-228d998c-8cb5-40d9-9b56-17b29aac23ce tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] 10.222.0.46 "GET /compute/v2.1/servers/c4b0aaad-91ee-4e37-9a34-0b4d56e282d5" status: 200 len: 1277 microversion: 2.1 time: 0.083962 Jan 15 20:50:45.551766 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 367/790] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:45 2022] GET /compute/v2.1/servers/c4b0aaad-91ee-4e37-9a34-0b4d56e282d5 => generated 1277 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:45.565469 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e7cd5880-09f2-448f-9bd0-7c5bf370b594 tempest-ServersAdminTestJSON-212694955 tempest-ServersAdminTestJSON-212694955-project-admin] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:45.568368 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:50:45.568368 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:50:45.569780 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e7cd5880-09f2-448f-9bd0-7c5bf370b594 tempest-ServersAdminTestJSON-212694955 tempest-ServersAdminTestJSON-212694955-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.007829 Jan 15 20:50:45.581827 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 368/791] 10.222.0.46 () {58 vars in 1188 bytes} [Sat Jan 15 20:50:45 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 20:50:45.581827 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-0a10ae51-74b1-41a6-abd3-5ebe842b98d6 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:45.581827 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-0a10ae51-74b1-41a6-abd3-5ebe842b98d6 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] [instance: 69b95b86-744d-4552-a0fc-6ced4d9ef38d] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:45.582215 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0a10ae51-74b1-41a6-abd3-5ebe842b98d6 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:45.582570 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0a10ae51-74b1-41a6-abd3-5ebe842b98d6 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:45.583365 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0a10ae51-74b1-41a6-abd3-5ebe842b98d6 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:45.583801 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0a10ae51-74b1-41a6-abd3-5ebe842b98d6 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:45.719776 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-0a10ae51-74b1-41a6-abd3-5ebe842b98d6 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02b23752962428b825b6f7757f54007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f60a2e220b479abf4b04536ed406e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:45.728251 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-0a10ae51-74b1-41a6-abd3-5ebe842b98d6 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] 10.222.0.46 "GET /compute/v2.1/servers/69b95b86-744d-4552-a0fc-6ced4d9ef38d" status: 200 len: 1332 microversion: 2.1 time: 0.156254 Jan 15 20:50:45.729407 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 369/792] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:45 2022] GET /compute/v2.1/servers/69b95b86-744d-4552-a0fc-6ced4d9ef38d => generated 1332 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:45.734226 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-edb79c36-5188-43e2-ae34-c66e230c86d4 tempest-ServersAdminTestJSON-212694955 tempest-ServersAdminTestJSON-212694955-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:50:45.735260 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-edb79c36-5188-43e2-ae34-c66e230c86d4 tempest-ServersAdminTestJSON-212694955 tempest-ServersAdminTestJSON-212694955-project-admin] [instance: b191ed6c-040a-4702-8e15-86272f9d1847] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:45.741318 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-edb79c36-5188-43e2-ae34-c66e230c86d4 tempest-ServersAdminTestJSON-212694955 tempest-ServersAdminTestJSON-212694955-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:45.741766 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-edb79c36-5188-43e2-ae34-c66e230c86d4 tempest-ServersAdminTestJSON-212694955 tempest-ServersAdminTestJSON-212694955-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:45.743339 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-edb79c36-5188-43e2-ae34-c66e230c86d4 tempest-ServersAdminTestJSON-212694955 tempest-ServersAdminTestJSON-212694955-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:45.743910 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-edb79c36-5188-43e2-ae34-c66e230c86d4 tempest-ServersAdminTestJSON-212694955 tempest-ServersAdminTestJSON-212694955-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:45.820385 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-edb79c36-5188-43e2-ae34-c66e230c86d4 tempest-ServersAdminTestJSON-212694955 tempest-ServersAdminTestJSON-212694955-project-admin] 10.222.0.46 "POST /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847/action" status: 202 len: 0 microversion: 2.1 time: 0.089673 Jan 15 20:50:45.824528 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 370/793] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:50:45 2022] POST /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 20:50:45.838991 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-07b58926-9fca-4b04-b2a3-23094687ced4 tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:45.839672 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-07b58926-9fca-4b04-b2a3-23094687ced4 tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] [instance: 7a5972c0-eea6-4198-8532-1efff379b087] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:45.859114 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-07b58926-9fca-4b04-b2a3-23094687ced4 tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:45.859969 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-07b58926-9fca-4b04-b2a3-23094687ced4 tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:45.861099 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-07b58926-9fca-4b04-b2a3-23094687ced4 tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:45.862077 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-07b58926-9fca-4b04-b2a3-23094687ced4 tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:45.873064 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-283edd5d-94e7-4e78-ad07-f396310c27af tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] 10.222.0.46 "POST /compute/v2.1/servers/1085522d-3ccc-4de0-b9dd-01c374e1f0ca/action" status: 202 len: 0 microversion: 2.25 time: 2.528533 Jan 15 20:50:45.874009 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 424/794] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 20:50:43 2022] POST /compute/v2.1/servers/1085522d-3ccc-4de0-b9dd-01c374e1f0ca/action => generated 0 bytes in 2532 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 15 20:50:45.879117 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-c40090b1-d0dc-42da-9f02-d3f247c46874 req-b2b993e8-bcc0-474d-b124-d237ace81f68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecba885c-f344-480e-9efc-707d1c542d42", "name": "network-vif-plugged", "status": "completed", "tag": "6896d9fc-c7c9-4e4b-8bf1-aaae0b89dd3f"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:50:45.881066 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:50:45.881066 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:50:45.904436 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-c40090b1-d0dc-42da-9f02-d3f247c46874 req-b2b993e8-bcc0-474d-b124-d237ace81f68 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:45.905239 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-c40090b1-d0dc-42da-9f02-d3f247c46874 req-b2b993e8-bcc0-474d-b124-d237ace81f68 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:45.964710 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-c40090b1-d0dc-42da-9f02-d3f247c46874 req-b2b993e8-bcc0-474d-b124-d237ace81f68 service nova] Creating event network-vif-plugged:6896d9fc-c7c9-4e4b-8bf1-aaae0b89dd3f for instance ecba885c-f344-480e-9efc-707d1c542d42 on nch1-master-1 Jan 15 20:50:45.974433 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-c40090b1-d0dc-42da-9f02-d3f247c46874 req-b2b993e8-bcc0-474d-b124-d237ace81f68 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098963 Jan 15 20:50:45.975720 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 425/795] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:50:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:50:45.998317 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-111017d9-f2d7-4a49-b178-88e3072f2771 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:46.004602 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:50:46.004602 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:50:46.008287 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-111017d9-f2d7-4a49-b178-88e3072f2771 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '32d4a57cfaa145009ba9cc8f21d9e8ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4a26c8edac44c8b26fd4e43813412d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:46.009800 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-111017d9-f2d7-4a49-b178-88e3072f2771 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '2f4a26c8edac44c8b26fd4e43813412d'} {{(pid=129366) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 15 20:50:46.017376 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-111017d9-f2d7-4a49-b178-88e3072f2771 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:46.018252 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-111017d9-f2d7-4a49-b178-88e3072f2771 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:46.019235 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-111017d9-f2d7-4a49-b178-88e3072f2771 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:46.019834 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-111017d9-f2d7-4a49-b178-88e3072f2771 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:46.143333 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-07b58926-9fca-4b04-b2a3-23094687ced4 tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f311520925464d1a8c7d7302a1ef4bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25de5a60ff6f48aebb27a1ef9cbe0606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:46.152666 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-07b58926-9fca-4b04-b2a3-23094687ced4 tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] 10.222.0.46 "GET /compute/v2.1/servers/7a5972c0-eea6-4198-8532-1efff379b087" status: 200 len: 1463 microversion: 2.1 time: 0.327091 Jan 15 20:50:46.153278 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 371/796] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:45 2022] GET /compute/v2.1/servers/7a5972c0-eea6-4198-8532-1efff379b087 => generated 1463 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:46.160231 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-992d9195-4bb3-4f82-908f-8714f48b951d tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:46.160865 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-992d9195-4bb3-4f82-908f-8714f48b951d tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] [instance: 1085522d-3ccc-4de0-b9dd-01c374e1f0ca] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:46.173843 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-992d9195-4bb3-4f82-908f-8714f48b951d tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:46.174305 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-992d9195-4bb3-4f82-908f-8714f48b951d tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:46.175195 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-992d9195-4bb3-4f82-908f-8714f48b951d tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:46.175640 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-992d9195-4bb3-4f82-908f-8714f48b951d tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:46.181110 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.multi_cell_list [None req-111017d9-f2d7-4a49-b178-88e3072f2771 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=129366) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jan 15 20:50:46.305914 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-111017d9-f2d7-4a49-b178-88e3072f2771 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] 10.222.0.46 "GET /compute/v2.1/servers?status=error" status: 200 len: 339 microversion: 2.1 time: 0.324776 Jan 15 20:50:46.314488 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 426/797] 10.222.0.46 () {58 vars in 1149 bytes} [Sat Jan 15 20:50:45 2022] GET /compute/v2.1/servers?status=error => generated 339 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:50:46.321934 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-fd75d00f-2906-42ea-8aa3-38e6ae38b45f tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:50:46.323387 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-fd75d00f-2906-42ea-8aa3-38e6ae38b45f tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 98d0ca37-0175-44e2-8a1d-965cdc517daf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:46.330772 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fd75d00f-2906-42ea-8aa3-38e6ae38b45f tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:46.331231 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fd75d00f-2906-42ea-8aa3-38e6ae38b45f tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:46.332283 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fd75d00f-2906-42ea-8aa3-38e6ae38b45f tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:46.335053 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fd75d00f-2906-42ea-8aa3-38e6ae38b45f tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:46.378897 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-992d9195-4bb3-4f82-908f-8714f48b951d tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:46.387922 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-992d9195-4bb3-4f82-908f-8714f48b951d tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:46.389842 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-992d9195-4bb3-4f82-908f-8714f48b951d tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:46.390969 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-992d9195-4bb3-4f82-908f-8714f48b951d tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] 10.222.0.46 "GET /compute/v2.1/servers/1085522d-3ccc-4de0-b9dd-01c374e1f0ca" status: 200 len: 1567 microversion: 2.25 time: 0.236689 Jan 15 20:50:46.392119 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 372/798] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:50:46 2022] GET /compute/v2.1/servers/1085522d-3ccc-4de0-b9dd-01c374e1f0ca => generated 1567 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:50:46.397687 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-fd75d00f-2906-42ea-8aa3-38e6ae38b45f tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action" status: 200 len: 32634 microversion: 2.1 time: 0.081106 Jan 15 20:50:46.401488 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 427/799] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:50:46 2022] POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action => generated 32634 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:50:46.406621 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8ca06e62-7098-4a47-a177-afe34f9ef7eb tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:46.407408 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-8ca06e62-7098-4a47-a177-afe34f9ef7eb tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] [instance: ecba885c-f344-480e-9efc-707d1c542d42] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:46.419251 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8ca06e62-7098-4a47-a177-afe34f9ef7eb tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:46.420490 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8ca06e62-7098-4a47-a177-afe34f9ef7eb tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:46.421461 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8ca06e62-7098-4a47-a177-afe34f9ef7eb tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:46.421965 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8ca06e62-7098-4a47-a177-afe34f9ef7eb tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:46.475315 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-cd997788-4b76-42a4-9122-b511a6dc3b01 tempest-TenantUsagesTestJSON-2006448069 tempest-TenantUsagesTestJSON-2006448069-project-admin] Calling method '.version_select at 0x7f30c913eca0>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:46.493028 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cd997788-4b76-42a4-9122-b511a6dc3b01 tempest-TenantUsagesTestJSON-2006448069 tempest-TenantUsagesTestJSON-2006448069-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:46.493832 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cd997788-4b76-42a4-9122-b511a6dc3b01 tempest-TenantUsagesTestJSON-2006448069 tempest-TenantUsagesTestJSON-2006448069-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:46.511814 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cd997788-4b76-42a4-9122-b511a6dc3b01 tempest-TenantUsagesTestJSON-2006448069 tempest-TenantUsagesTestJSON-2006448069-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:46.512272 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cd997788-4b76-42a4-9122-b511a6dc3b01 tempest-TenantUsagesTestJSON-2006448069 tempest-TenantUsagesTestJSON-2006448069-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:46.531012 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-cd997788-4b76-42a4-9122-b511a6dc3b01 tempest-TenantUsagesTestJSON-2006448069 tempest-TenantUsagesTestJSON-2006448069-project-admin] 10.222.0.46 "GET /compute/v2.1/os-simple-tenant-usage/25de5a60ff6f48aebb27a1ef9cbe0606?start=2022-01-14T20%3A50%3A46.162914&end=2022-01-16T20%3A50%3A46.162914" status: 200 len: 694 microversion: 2.1 time: 0.137387 Jan 15 20:50:46.531637 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 373/800] 10.222.0.46 () {58 vars in 1411 bytes} [Sat Jan 15 20:50:46 2022] GET /compute/v2.1/os-simple-tenant-usage/25de5a60ff6f48aebb27a1ef9cbe0606?start=2022-01-14T20%3A50%3A46.162914&end=2022-01-16T20%3A50%3A46.162914 => generated 694 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:50:46.536472 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d7f699c6-880a-4dea-8cb0-450df7f0d08a tempest-ServersAdminTestJSON-212694955 tempest-ServersAdminTestJSON-212694955-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:50:46.537687 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d7f699c6-880a-4dea-8cb0-450df7f0d08a tempest-ServersAdminTestJSON-212694955 tempest-ServersAdminTestJSON-212694955-project-admin] [instance: b191ed6c-040a-4702-8e15-86272f9d1847] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:46.548106 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d7f699c6-880a-4dea-8cb0-450df7f0d08a tempest-ServersAdminTestJSON-212694955 tempest-ServersAdminTestJSON-212694955-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:46.548619 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d7f699c6-880a-4dea-8cb0-450df7f0d08a tempest-ServersAdminTestJSON-212694955 tempest-ServersAdminTestJSON-212694955-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:46.549711 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d7f699c6-880a-4dea-8cb0-450df7f0d08a tempest-ServersAdminTestJSON-212694955 tempest-ServersAdminTestJSON-212694955-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:46.550149 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d7f699c6-880a-4dea-8cb0-450df7f0d08a tempest-ServersAdminTestJSON-212694955 tempest-ServersAdminTestJSON-212694955-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:46.670522 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d7f699c6-880a-4dea-8cb0-450df7f0d08a tempest-ServersAdminTestJSON-212694955 tempest-ServersAdminTestJSON-212694955-project-admin] 10.222.0.46 "POST /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847/action" status: 202 len: 0 microversion: 2.1 time: 0.137480 Jan 15 20:50:46.675279 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 374/801] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:50:46 2022] POST /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847/action => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 20:50:46.681523 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-89ab0463-9924-461a-bff6-2c2e94086026 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:46.682170 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-89ab0463-9924-461a-bff6-2c2e94086026 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: e3fa2f27-df7a-4ecb-9bba-c970e3e7d106] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:46.696517 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-89ab0463-9924-461a-bff6-2c2e94086026 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:46.697038 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-89ab0463-9924-461a-bff6-2c2e94086026 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:46.697857 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-89ab0463-9924-461a-bff6-2c2e94086026 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:46.698295 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-89ab0463-9924-461a-bff6-2c2e94086026 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:46.722850 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-8ca06e62-7098-4a47-a177-afe34f9ef7eb tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55be87ae7f14b499ab2cd6fc5538988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd217e7fd648b4a78c0c32ff1c95f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:46.732436 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-8ca06e62-7098-4a47-a177-afe34f9ef7eb tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "GET /compute/v2.1/servers/ecba885c-f344-480e-9efc-707d1c542d42" status: 200 len: 1308 microversion: 2.1 time: 0.330187 Jan 15 20:50:46.733170 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 428/802] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:46 2022] GET /compute/v2.1/servers/ecba885c-f344-480e-9efc-707d1c542d42 => generated 1308 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:46.744713 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-5838488a-87e0-454e-afbc-b3d76fab0205 tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] Calling method '.version_select at 0x7f30cb678af0>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:46.753746 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5838488a-87e0-454e-afbc-b3d76fab0205 tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:46.754380 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5838488a-87e0-454e-afbc-b3d76fab0205 tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:46.781333 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5838488a-87e0-454e-afbc-b3d76fab0205 tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:46.781887 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5838488a-87e0-454e-afbc-b3d76fab0205 tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:46.802396 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-5838488a-87e0-454e-afbc-b3d76fab0205 tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] 10.222.0.46 "GET /compute/v2.1/os-simple-tenant-usage/25de5a60ff6f48aebb27a1ef9cbe0606?start=2022-01-14T20%3A50%3A46.162914&end=2022-01-16T20%3A50%3A46.162914" status: 200 len: 699 microversion: 2.1 time: 0.067720 Jan 15 20:50:46.803282 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 429/803] 10.222.0.46 () {58 vars in 1411 bytes} [Sat Jan 15 20:50:46 2022] GET /compute/v2.1/os-simple-tenant-usage/25de5a60ff6f48aebb27a1ef9cbe0606?start=2022-01-14T20%3A50%3A46.162914&end=2022-01-16T20%3A50%3A46.162914 => generated 699 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:50:46.809974 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-fb26da38-cc81-41e6-b9cd-01c35f214bf7 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:46.810817 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-fb26da38-cc81-41e6-b9cd-01c35f214bf7 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] [instance: c4b0aaad-91ee-4e37-9a34-0b4d56e282d5] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:46.817110 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fb26da38-cc81-41e6-b9cd-01c35f214bf7 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:46.817640 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fb26da38-cc81-41e6-b9cd-01c35f214bf7 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:46.818512 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fb26da38-cc81-41e6-b9cd-01c35f214bf7 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:46.820211 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fb26da38-cc81-41e6-b9cd-01c35f214bf7 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:46.930001 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-89ab0463-9924-461a-bff6-2c2e94086026 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:46.938442 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-89ab0463-9924-461a-bff6-2c2e94086026 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/e3fa2f27-df7a-4ecb-9bba-c970e3e7d106" status: 200 len: 1476 microversion: 2.1 time: 0.262013 Jan 15 20:50:46.948569 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 375/804] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:46 2022] GET /compute/v2.1/servers/e3fa2f27-df7a-4ecb-9bba-c970e3e7d106 => generated 1476 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:46.953750 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-7c29e5be-9941-4f5f-98bf-0da1bd201efd tempest-ServersAdminTestJSON-212694955 tempest-ServersAdminTestJSON-212694955-project-admin] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:46.954627 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-7c29e5be-9941-4f5f-98bf-0da1bd201efd tempest-ServersAdminTestJSON-212694955 tempest-ServersAdminTestJSON-212694955-project-admin] [instance: b191ed6c-040a-4702-8e15-86272f9d1847] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:46.964404 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7c29e5be-9941-4f5f-98bf-0da1bd201efd tempest-ServersAdminTestJSON-212694955 tempest-ServersAdminTestJSON-212694955-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:46.965011 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7c29e5be-9941-4f5f-98bf-0da1bd201efd tempest-ServersAdminTestJSON-212694955 tempest-ServersAdminTestJSON-212694955-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:46.965999 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7c29e5be-9941-4f5f-98bf-0da1bd201efd tempest-ServersAdminTestJSON-212694955 tempest-ServersAdminTestJSON-212694955-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:46.966530 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7c29e5be-9941-4f5f-98bf-0da1bd201efd tempest-ServersAdminTestJSON-212694955 tempest-ServersAdminTestJSON-212694955-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:47.073879 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-fb26da38-cc81-41e6-b9cd-01c35f214bf7 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc38f86758f9416b9e7f6915de0359d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8cfe33be708428abef52f5e8e25621b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:47.082683 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-fb26da38-cc81-41e6-b9cd-01c35f214bf7 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] 10.222.0.46 "GET /compute/v2.1/servers/c4b0aaad-91ee-4e37-9a34-0b4d56e282d5" status: 200 len: 1319 microversion: 2.1 time: 0.276605 Jan 15 20:50:47.092342 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 430/805] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:46 2022] GET /compute/v2.1/servers/c4b0aaad-91ee-4e37-9a34-0b4d56e282d5 => generated 1319 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:47.092342 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-46349a0c-d04c-4c97-ac14-6f9c54819642 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:47.092342 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-46349a0c-d04c-4c97-ac14-6f9c54819642 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] [instance: 69b95b86-744d-4552-a0fc-6ced4d9ef38d] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:47.095716 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-46349a0c-d04c-4c97-ac14-6f9c54819642 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:47.096163 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-46349a0c-d04c-4c97-ac14-6f9c54819642 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:47.096976 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-46349a0c-d04c-4c97-ac14-6f9c54819642 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:47.097413 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-46349a0c-d04c-4c97-ac14-6f9c54819642 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:47.166245 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-7c29e5be-9941-4f5f-98bf-0da1bd201efd tempest-ServersAdminTestJSON-212694955 tempest-ServersAdminTestJSON-212694955-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847" status: 200 len: 1614 microversion: 2.1 time: 0.216549 Jan 15 20:50:47.179288 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 376/806] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:46 2022] GET /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847 => generated 1614 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:47.184605 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e74a3c8c-03cf-4ce5-bd85-8828467f82c4 tempest-TenantUsagesTestJSON-2006448069 tempest-TenantUsagesTestJSON-2006448069-project-admin] Calling method '.version_select at 0x7f30c913e8b0>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:47.186003 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-simple-tenant-usage:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:50:47.186003 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:50:47.193678 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e74a3c8c-03cf-4ce5-bd85-8828467f82c4 tempest-TenantUsagesTestJSON-2006448069 tempest-TenantUsagesTestJSON-2006448069-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:47.194044 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e74a3c8c-03cf-4ce5-bd85-8828467f82c4 tempest-TenantUsagesTestJSON-2006448069 tempest-TenantUsagesTestJSON-2006448069-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:47.224021 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e74a3c8c-03cf-4ce5-bd85-8828467f82c4 tempest-TenantUsagesTestJSON-2006448069 tempest-TenantUsagesTestJSON-2006448069-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:47.224648 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e74a3c8c-03cf-4ce5-bd85-8828467f82c4 tempest-TenantUsagesTestJSON-2006448069 tempest-TenantUsagesTestJSON-2006448069-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:47.277057 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e74a3c8c-03cf-4ce5-bd85-8828467f82c4 tempest-TenantUsagesTestJSON-2006448069 tempest-TenantUsagesTestJSON-2006448069-project-admin] 10.222.0.46 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-01-14T20%3A50%3A46.162914&end=2022-01-16T20%3A50%3A46.162914&detailed=1" status: 200 len: 10226 microversion: 2.1 time: 0.095893 Jan 15 20:50:47.277542 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 377/807] 10.222.0.46 () {58 vars in 1334 bytes} [Sat Jan 15 20:50:47 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-01-14T20%3A50%3A46.162914&end=2022-01-16T20%3A50%3A46.162914&detailed=1 => generated 10226 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:50:47.283604 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-4c9d574f-9cdb-4b2b-bcec-6b5167356a0a tempest-ServersAdminTestJSON-212694955 tempest-ServersAdminTestJSON-212694955-project-admin] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:47.284214 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-4c9d574f-9cdb-4b2b-bcec-6b5167356a0a tempest-ServersAdminTestJSON-212694955 tempest-ServersAdminTestJSON-212694955-project-admin] [instance: b191ed6c-040a-4702-8e15-86272f9d1847] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:47.300787 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4c9d574f-9cdb-4b2b-bcec-6b5167356a0a tempest-ServersAdminTestJSON-212694955 tempest-ServersAdminTestJSON-212694955-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:47.301529 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4c9d574f-9cdb-4b2b-bcec-6b5167356a0a tempest-ServersAdminTestJSON-212694955 tempest-ServersAdminTestJSON-212694955-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:47.302563 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4c9d574f-9cdb-4b2b-bcec-6b5167356a0a tempest-ServersAdminTestJSON-212694955 tempest-ServersAdminTestJSON-212694955-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:47.303167 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4c9d574f-9cdb-4b2b-bcec-6b5167356a0a tempest-ServersAdminTestJSON-212694955 tempest-ServersAdminTestJSON-212694955-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:47.360260 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-46349a0c-d04c-4c97-ac14-6f9c54819642 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02b23752962428b825b6f7757f54007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f60a2e220b479abf4b04536ed406e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:47.387125 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-46349a0c-d04c-4c97-ac14-6f9c54819642 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] 10.222.0.46 "GET /compute/v2.1/servers/69b95b86-744d-4552-a0fc-6ced4d9ef38d" status: 200 len: 1332 microversion: 2.1 time: 0.302304 Jan 15 20:50:47.388098 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 431/808] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:47 2022] GET /compute/v2.1/servers/69b95b86-744d-4552-a0fc-6ced4d9ef38d => generated 1332 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:47.393460 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-3434c113-0106-439d-8228-c99aaba62d54 tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:47.394168 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-3434c113-0106-439d-8228-c99aaba62d54 tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] [instance: 7a5972c0-eea6-4198-8532-1efff379b087] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:47.401857 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3434c113-0106-439d-8228-c99aaba62d54 tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:47.402816 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3434c113-0106-439d-8228-c99aaba62d54 tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:47.403777 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3434c113-0106-439d-8228-c99aaba62d54 tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:47.404392 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3434c113-0106-439d-8228-c99aaba62d54 tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:47.452577 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-3434c113-0106-439d-8228-c99aaba62d54 tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] [instance: 7a5972c0-eea6-4198-8532-1efff379b087] Going to try to terminate instance {{(pid=129366) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 20:50:47.598004 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-3434c113-0106-439d-8228-c99aaba62d54 tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] 10.222.0.46 "DELETE /compute/v2.1/servers/7a5972c0-eea6-4198-8532-1efff379b087" status: 204 len: 0 microversion: 2.1 time: 0.206278 Jan 15 20:50:47.599958 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 432/809] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 20:50:47 2022] DELETE /compute/v2.1/servers/7a5972c0-eea6-4198-8532-1efff379b087 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 20:50:47.612565 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-38024ff2-a1bc-49c2-81f3-3f30543c18f1 req-e483c27c-20d6-4bce-bf63-c2c8fbf1d112 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0916b98-698b-448b-9b06-95791cbf533c", "tag": "4fe1e733-915f-402a-bdcb-042d55337395"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:50:47.614278 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:50:47.614278 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:50:47.625028 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-38024ff2-a1bc-49c2-81f3-3f30543c18f1 req-e483c27c-20d6-4bce-bf63-c2c8fbf1d112 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:47.625654 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-38024ff2-a1bc-49c2-81f3-3f30543c18f1 req-e483c27c-20d6-4bce-bf63-c2c8fbf1d112 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:47.641041 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-38024ff2-a1bc-49c2-81f3-3f30543c18f1 req-e483c27c-20d6-4bce-bf63-c2c8fbf1d112 service nova] Creating event network-changed:4fe1e733-915f-402a-bdcb-042d55337395 for instance c0916b98-698b-448b-9b06-95791cbf533c on nch1-master-1 Jan 15 20:50:47.649988 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-4c9d574f-9cdb-4b2b-bcec-6b5167356a0a tempest-ServersAdminTestJSON-212694955 tempest-ServersAdminTestJSON-212694955-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847" status: 200 len: 1614 microversion: 2.1 time: 0.371366 Jan 15 20:50:47.650220 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-38024ff2-a1bc-49c2-81f3-3f30543c18f1 req-e483c27c-20d6-4bce-bf63-c2c8fbf1d112 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046731 Jan 15 20:50:47.650986 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 433/810] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:50:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:50:47.656590 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9f675a61-55b4-498c-9e1d-55b2921b2c4e tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:50:47.657629 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-9f675a61-55b4-498c-9e1d-55b2921b2c4e tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 98d0ca37-0175-44e2-8a1d-965cdc517daf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:47.661352 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 378/811] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:47 2022] GET /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847 => generated 1614 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:47.666446 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9e1cc627-d562-4d3f-b92d-eb00a0a901c0 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:47.667796 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9f675a61-55b4-498c-9e1d-55b2921b2c4e tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:47.667796 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9f675a61-55b4-498c-9e1d-55b2921b2c4e tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:47.668463 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9f675a61-55b4-498c-9e1d-55b2921b2c4e tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:47.668911 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9f675a61-55b4-498c-9e1d-55b2921b2c4e tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:47.670119 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-9e1cc627-d562-4d3f-b92d-eb00a0a901c0 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] [instance: 1085522d-3ccc-4de0-b9dd-01c374e1f0ca] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:47.683452 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9e1cc627-d562-4d3f-b92d-eb00a0a901c0 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:47.695344 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9e1cc627-d562-4d3f-b92d-eb00a0a901c0 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:47.698504 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9e1cc627-d562-4d3f-b92d-eb00a0a901c0 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:47.699768 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9e1cc627-d562-4d3f-b92d-eb00a0a901c0 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:47.723485 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-9f675a61-55b4-498c-9e1d-55b2921b2c4e tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action" status: 200 len: 32634 microversion: 2.1 time: 0.070863 Jan 15 20:50:47.727958 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 434/812] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:50:47 2022] POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action => generated 32634 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:50:47.739503 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-3258a77e-cd82-4ed9-b1a6-80b9fd81175f tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:47.740340 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-3258a77e-cd82-4ed9-b1a6-80b9fd81175f tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] [instance: 7a5972c0-eea6-4198-8532-1efff379b087] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:47.767089 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3258a77e-cd82-4ed9-b1a6-80b9fd81175f tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:47.767649 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3258a77e-cd82-4ed9-b1a6-80b9fd81175f tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:47.768758 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3258a77e-cd82-4ed9-b1a6-80b9fd81175f tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:47.769558 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3258a77e-cd82-4ed9-b1a6-80b9fd81175f tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:48.082863 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-9e1cc627-d562-4d3f-b92d-eb00a0a901c0 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:48.090275 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-3258a77e-cd82-4ed9-b1a6-80b9fd81175f tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f311520925464d1a8c7d7302a1ef4bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25de5a60ff6f48aebb27a1ef9cbe0606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:48.103988 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-9e1cc627-d562-4d3f-b92d-eb00a0a901c0 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:48.105692 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-3258a77e-cd82-4ed9-b1a6-80b9fd81175f tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] 10.222.0.46 "GET /compute/v2.1/servers/7a5972c0-eea6-4198-8532-1efff379b087" status: 200 len: 1469 microversion: 2.1 time: 0.375673 Jan 15 20:50:48.106826 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 435/813] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:47 2022] GET /compute/v2.1/servers/7a5972c0-eea6-4198-8532-1efff379b087 => generated 1469 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:48.113451 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-9e1cc627-d562-4d3f-b92d-eb00a0a901c0 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:48.114942 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-9e1cc627-d562-4d3f-b92d-eb00a0a901c0 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] 10.222.0.46 "GET /compute/v2.1/servers/1085522d-3ccc-4de0-b9dd-01c374e1f0ca" status: 200 len: 1567 microversion: 2.25 time: 0.452471 Jan 15 20:50:48.116342 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f5977b9f-ea46-4e29-b206-c4cdcea0e15f tempest-ServersAdminTestJSON-212694955 tempest-ServersAdminTestJSON-212694955-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:48.118619 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 379/814] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:50:47 2022] GET /compute/v2.1/servers/1085522d-3ccc-4de0-b9dd-01c374e1f0ca => generated 1567 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:50:48.121408 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:50:48.121408 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:50:48.126634 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9492230b-bedb-4ba4-b63f-0415fc6ab63c tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:48.128117 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:index:get_all_tenants": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:50:48.128117 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:50:48.129755 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f5977b9f-ea46-4e29-b206-c4cdcea0e15f tempest-ServersAdminTestJSON-212694955 tempest-ServersAdminTestJSON-212694955-project-admin] Searching by: {'host': 'nch2-master-1', 'deleted': False} {{(pid=129366) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 15 20:50:48.130554 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-9492230b-bedb-4ba4-b63f-0415fc6ab63c tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] [instance: ecba885c-f344-480e-9efc-707d1c542d42] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:48.141047 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9492230b-bedb-4ba4-b63f-0415fc6ab63c tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:48.143485 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9492230b-bedb-4ba4-b63f-0415fc6ab63c tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:48.145556 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f5977b9f-ea46-4e29-b206-c4cdcea0e15f tempest-ServersAdminTestJSON-212694955 tempest-ServersAdminTestJSON-212694955-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:48.146114 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f5977b9f-ea46-4e29-b206-c4cdcea0e15f tempest-ServersAdminTestJSON-212694955 tempest-ServersAdminTestJSON-212694955-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:48.147046 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f5977b9f-ea46-4e29-b206-c4cdcea0e15f tempest-ServersAdminTestJSON-212694955 tempest-ServersAdminTestJSON-212694955-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:48.147611 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f5977b9f-ea46-4e29-b206-c4cdcea0e15f tempest-ServersAdminTestJSON-212694955 tempest-ServersAdminTestJSON-212694955-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:48.148980 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9492230b-bedb-4ba4-b63f-0415fc6ab63c tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:48.153084 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9492230b-bedb-4ba4-b63f-0415fc6ab63c tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:48.284432 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.multi_cell_list [None req-f5977b9f-ea46-4e29-b206-c4cdcea0e15f tempest-ServersAdminTestJSON-212694955 tempest-ServersAdminTestJSON-212694955-project-admin] Listed batch of 10 results from cell out of 1000 limit. Returned 10 total so far. {{(pid=129366) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jan 15 20:50:48.353508 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-9492230b-bedb-4ba4-b63f-0415fc6ab63c tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55be87ae7f14b499ab2cd6fc5538988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd217e7fd648b4a78c0c32ff1c95f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:48.365734 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-9492230b-bedb-4ba4-b63f-0415fc6ab63c tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "GET /compute/v2.1/servers/ecba885c-f344-480e-9efc-707d1c542d42" status: 200 len: 1488 microversion: 2.1 time: 0.242376 Jan 15 20:50:48.379866 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 380/815] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:48 2022] GET /compute/v2.1/servers/ecba885c-f344-480e-9efc-707d1c542d42 => generated 1488 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:48.391178 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b1a4d69e-363f-4fe8-a43c-b8c100977ee6 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:48.392057 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b1a4d69e-363f-4fe8-a43c-b8c100977ee6 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: e3fa2f27-df7a-4ecb-9bba-c970e3e7d106] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:48.402007 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b1a4d69e-363f-4fe8-a43c-b8c100977ee6 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:48.402812 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b1a4d69e-363f-4fe8-a43c-b8c100977ee6 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:48.403762 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b1a4d69e-363f-4fe8-a43c-b8c100977ee6 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:48.404342 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b1a4d69e-363f-4fe8-a43c-b8c100977ee6 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:48.417680 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f5977b9f-ea46-4e29-b206-c4cdcea0e15f tempest-ServersAdminTestJSON-212694955 tempest-ServersAdminTestJSON-212694955-project-admin] 10.222.0.46 "GET /compute/v2.1/servers?host=nch2-master-1&all_tenants=1" status: 200 len: 3327 microversion: 2.1 time: 0.309631 Jan 15 20:50:48.418821 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 436/816] 10.222.0.46 () {58 vars in 1189 bytes} [Sat Jan 15 20:50:48 2022] GET /compute/v2.1/servers?host=nch2-master-1&all_tenants=1 => generated 3327 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:48.423915 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f35b7b61-08e1-47bb-96a7-bda7a916f0b2 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:48.424705 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f35b7b61-08e1-47bb-96a7-bda7a916f0b2 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] [instance: c4b0aaad-91ee-4e37-9a34-0b4d56e282d5] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:48.432526 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f35b7b61-08e1-47bb-96a7-bda7a916f0b2 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:48.433019 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f35b7b61-08e1-47bb-96a7-bda7a916f0b2 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:48.433839 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f35b7b61-08e1-47bb-96a7-bda7a916f0b2 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:48.434274 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f35b7b61-08e1-47bb-96a7-bda7a916f0b2 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:48.773658 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-b1a4d69e-363f-4fe8-a43c-b8c100977ee6 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:48.781923 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b1a4d69e-363f-4fe8-a43c-b8c100977ee6 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/e3fa2f27-df7a-4ecb-9bba-c970e3e7d106" status: 200 len: 1475 microversion: 2.1 time: 0.395801 Jan 15 20:50:48.782613 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 381/817] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:48 2022] GET /compute/v2.1/servers/e3fa2f27-df7a-4ecb-9bba-c970e3e7d106 => generated 1475 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:48.783285 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-f35b7b61-08e1-47bb-96a7-bda7a916f0b2 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc38f86758f9416b9e7f6915de0359d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8cfe33be708428abef52f5e8e25621b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:48.789969 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-71f4c16e-761b-4693-9514-947ac6f19473 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:50:48.790801 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-71f4c16e-761b-4693-9514-947ac6f19473 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] [instance: ecba885c-f344-480e-9efc-707d1c542d42] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:48.792036 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f35b7b61-08e1-47bb-96a7-bda7a916f0b2 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] 10.222.0.46 "GET /compute/v2.1/servers/c4b0aaad-91ee-4e37-9a34-0b4d56e282d5" status: 200 len: 1319 microversion: 2.1 time: 0.372018 Jan 15 20:50:48.792664 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 437/818] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:48 2022] GET /compute/v2.1/servers/c4b0aaad-91ee-4e37-9a34-0b4d56e282d5 => generated 1319 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:48.808750 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a53ca846-73d1-4c94-811a-4d82c109705c tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:48.809394 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a53ca846-73d1-4c94-811a-4d82c109705c tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] [instance: 69b95b86-744d-4552-a0fc-6ced4d9ef38d] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:48.810538 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-71f4c16e-761b-4693-9514-947ac6f19473 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:48.811446 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-71f4c16e-761b-4693-9514-947ac6f19473 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:48.812482 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-71f4c16e-761b-4693-9514-947ac6f19473 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:48.813115 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-71f4c16e-761b-4693-9514-947ac6f19473 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:48.816172 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a53ca846-73d1-4c94-811a-4d82c109705c tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:48.816624 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a53ca846-73d1-4c94-811a-4d82c109705c tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:48.817453 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a53ca846-73d1-4c94-811a-4d82c109705c tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:48.817887 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a53ca846-73d1-4c94-811a-4d82c109705c tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:48.905079 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-71f4c16e-761b-4693-9514-947ac6f19473 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "POST /compute/v2.1/servers/ecba885c-f344-480e-9efc-707d1c542d42/action" status: 202 len: 0 microversion: 2.1 time: 0.120574 Jan 15 20:50:48.906142 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 382/819] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:50:48 2022] POST /compute/v2.1/servers/ecba885c-f344-480e-9efc-707d1c542d42/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 20:50:48.912488 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-1bed74ad-b25d-4309-bbe1-eb8ce551612d tempest-ServersAdminTestJSON-212694955 tempest-ServersAdminTestJSON-212694955-project-admin] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:48.916407 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:50:48.916407 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:50:48.919524 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:index:get_all_tenants": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:50:48.919524 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:50:48.921301 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-1bed74ad-b25d-4309-bbe1-eb8ce551612d tempest-ServersAdminTestJSON-212694955 tempest-ServersAdminTestJSON-212694955-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=129365) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 15 20:50:48.928052 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1bed74ad-b25d-4309-bbe1-eb8ce551612d tempest-ServersAdminTestJSON-212694955 tempest-ServersAdminTestJSON-212694955-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:48.928512 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1bed74ad-b25d-4309-bbe1-eb8ce551612d tempest-ServersAdminTestJSON-212694955 tempest-ServersAdminTestJSON-212694955-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:48.931306 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1bed74ad-b25d-4309-bbe1-eb8ce551612d tempest-ServersAdminTestJSON-212694955 tempest-ServersAdminTestJSON-212694955-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:48.932001 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1bed74ad-b25d-4309-bbe1-eb8ce551612d tempest-ServersAdminTestJSON-212694955 tempest-ServersAdminTestJSON-212694955-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:49.028209 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-1bed74ad-b25d-4309-bbe1-eb8ce551612d tempest-ServersAdminTestJSON-212694955 tempest-ServersAdminTestJSON-212694955-project-admin] 10.222.0.46 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.120655 Jan 15 20:50:49.034676 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 383/820] 10.222.0.46 () {58 vars in 1195 bytes} [Sat Jan 15 20:50:48 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 20:50:49.035985 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f0215523-0b71-46fe-899c-173d9354746f tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:50:49.037489 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f0215523-0b71-46fe-899c-173d9354746f tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 98d0ca37-0175-44e2-8a1d-965cdc517daf] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:49.045226 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f0215523-0b71-46fe-899c-173d9354746f tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:49.045732 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f0215523-0b71-46fe-899c-173d9354746f tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:49.046580 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f0215523-0b71-46fe-899c-173d9354746f tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:49.047016 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f0215523-0b71-46fe-899c-173d9354746f tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:49.087800 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-a53ca846-73d1-4c94-811a-4d82c109705c tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02b23752962428b825b6f7757f54007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f60a2e220b479abf4b04536ed406e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:49.100615 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a53ca846-73d1-4c94-811a-4d82c109705c tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] 10.222.0.46 "GET /compute/v2.1/servers/69b95b86-744d-4552-a0fc-6ced4d9ef38d" status: 200 len: 1332 microversion: 2.1 time: 0.297207 Jan 15 20:50:49.111138 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 438/821] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:48 2022] GET /compute/v2.1/servers/69b95b86-744d-4552-a0fc-6ced4d9ef38d => generated 1332 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:49.115931 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d152c387-e777-4815-8428-a602c61b36ee tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:49.116433 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-d152c387-e777-4815-8428-a602c61b36ee tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] [instance: ecba885c-f344-480e-9efc-707d1c542d42] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:49.121452 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f0215523-0b71-46fe-899c-173d9354746f tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action" status: 200 len: 32634 microversion: 2.1 time: 0.090742 Jan 15 20:50:49.125187 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 384/822] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:50:49 2022] POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action => generated 32634 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:50:49.127949 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d152c387-e777-4815-8428-a602c61b36ee tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:49.128499 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d152c387-e777-4815-8428-a602c61b36ee tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:49.130401 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d152c387-e777-4815-8428-a602c61b36ee tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:49.130401 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d152c387-e777-4815-8428-a602c61b36ee tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:49.137749 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-dbe81be9-c8d1-4f14-a52c-cf00c19fbe8b tempest-ServersAdminTestJSON-212694955 tempest-ServersAdminTestJSON-212694955-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:50:49.139015 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-dbe81be9-c8d1-4f14-a52c-cf00c19fbe8b tempest-ServersAdminTestJSON-212694955 tempest-ServersAdminTestJSON-212694955-project-admin] [instance: b191ed6c-040a-4702-8e15-86272f9d1847] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:49.151388 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dbe81be9-c8d1-4f14-a52c-cf00c19fbe8b tempest-ServersAdminTestJSON-212694955 tempest-ServersAdminTestJSON-212694955-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:49.152112 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dbe81be9-c8d1-4f14-a52c-cf00c19fbe8b tempest-ServersAdminTestJSON-212694955 tempest-ServersAdminTestJSON-212694955-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:49.156514 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dbe81be9-c8d1-4f14-a52c-cf00c19fbe8b tempest-ServersAdminTestJSON-212694955 tempest-ServersAdminTestJSON-212694955-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:49.157029 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dbe81be9-c8d1-4f14-a52c-cf00c19fbe8b tempest-ServersAdminTestJSON-212694955 tempest-ServersAdminTestJSON-212694955-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:49.259634 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-dbe81be9-c8d1-4f14-a52c-cf00c19fbe8b tempest-ServersAdminTestJSON-212694955 tempest-ServersAdminTestJSON-212694955-project-admin] 10.222.0.46 "POST /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847/action" status: 202 len: 0 microversion: 2.1 time: 0.132856 Jan 15 20:50:49.265223 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 385/823] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:50:49 2022] POST /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847/action => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 20:50:49.271550 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c8ba71e8-fff9-42e3-8b30-3b0f419c857e tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:49.272595 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c8ba71e8-fff9-42e3-8b30-3b0f419c857e tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] [instance: 7a5972c0-eea6-4198-8532-1efff379b087] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:49.279949 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c8ba71e8-fff9-42e3-8b30-3b0f419c857e tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:49.280627 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c8ba71e8-fff9-42e3-8b30-3b0f419c857e tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:49.281674 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c8ba71e8-fff9-42e3-8b30-3b0f419c857e tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:49.282261 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c8ba71e8-fff9-42e3-8b30-3b0f419c857e tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:49.427682 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-d152c387-e777-4815-8428-a602c61b36ee tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55be87ae7f14b499ab2cd6fc5538988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd217e7fd648b4a78c0c32ff1c95f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:49.437457 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d152c387-e777-4815-8428-a602c61b36ee tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "GET /compute/v2.1/servers/ecba885c-f344-480e-9efc-707d1c542d42" status: 200 len: 1493 microversion: 2.1 time: 0.325161 Jan 15 20:50:49.438975 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 439/824] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:49 2022] GET /compute/v2.1/servers/ecba885c-f344-480e-9efc-707d1c542d42 => generated 1493 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:49.445473 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d7fddfb0-0dd9-48c8-ac3c-d4dda3347959 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:49.446723 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-d7fddfb0-0dd9-48c8-ac3c-d4dda3347959 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] [instance: 1085522d-3ccc-4de0-b9dd-01c374e1f0ca] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:49.454336 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d7fddfb0-0dd9-48c8-ac3c-d4dda3347959 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:49.454930 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d7fddfb0-0dd9-48c8-ac3c-d4dda3347959 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:49.456269 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d7fddfb0-0dd9-48c8-ac3c-d4dda3347959 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:49.456775 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d7fddfb0-0dd9-48c8-ac3c-d4dda3347959 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:49.476215 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-c8ba71e8-fff9-42e3-8b30-3b0f419c857e tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f311520925464d1a8c7d7302a1ef4bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25de5a60ff6f48aebb27a1ef9cbe0606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:49.486309 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c8ba71e8-fff9-42e3-8b30-3b0f419c857e tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] 10.222.0.46 "GET /compute/v2.1/servers/7a5972c0-eea6-4198-8532-1efff379b087" status: 200 len: 1469 microversion: 2.1 time: 0.219409 Jan 15 20:50:49.487372 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 386/825] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:49 2022] GET /compute/v2.1/servers/7a5972c0-eea6-4198-8532-1efff379b087 => generated 1469 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:49.493017 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-519989e8-b8d3-46a1-89bd-03500dc58894 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:50:49.494582 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-519989e8-b8d3-46a1-89bd-03500dc58894 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] [instance: b191ed6c-040a-4702-8e15-86272f9d1847] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:49.501729 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-519989e8-b8d3-46a1-89bd-03500dc58894 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:49.502253 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-519989e8-b8d3-46a1-89bd-03500dc58894 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:49.503251 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-519989e8-b8d3-46a1-89bd-03500dc58894 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:49.503772 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-519989e8-b8d3-46a1-89bd-03500dc58894 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:49.585829 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-519989e8-b8d3-46a1-89bd-03500dc58894 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Flavor limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 20:50:49.586410 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-519989e8-b8d3-46a1-89bd-03500dc58894 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Image limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 20:50:49.586877 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-519989e8-b8d3-46a1-89bd-03500dc58894 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Flavor pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 20:50:49.587284 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-519989e8-b8d3-46a1-89bd-03500dc58894 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Image pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 20:50:49.587690 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-519989e8-b8d3-46a1-89bd-03500dc58894 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 20:50:49.620857 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-d7fddfb0-0dd9-48c8-ac3c-d4dda3347959 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:49.635344 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-d7fddfb0-0dd9-48c8-ac3c-d4dda3347959 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:49.637098 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-d7fddfb0-0dd9-48c8-ac3c-d4dda3347959 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:49.638377 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d7fddfb0-0dd9-48c8-ac3c-d4dda3347959 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] 10.222.0.46 "GET /compute/v2.1/servers/1085522d-3ccc-4de0-b9dd-01c374e1f0ca" status: 200 len: 1567 microversion: 2.25 time: 0.197381 Jan 15 20:50:49.639137 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 440/826] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:50:49 2022] GET /compute/v2.1/servers/1085522d-3ccc-4de0-b9dd-01c374e1f0ca => generated 1567 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:50:49.661500 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-519989e8-b8d3-46a1-89bd-03500dc58894 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] [instance: b191ed6c-040a-4702-8e15-86272f9d1847] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:49.668078 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-519989e8-b8d3-46a1-89bd-03500dc58894 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:49.668460 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-519989e8-b8d3-46a1-89bd-03500dc58894 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:49.669366 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-519989e8-b8d3-46a1-89bd-03500dc58894 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:49.670367 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-519989e8-b8d3-46a1-89bd-03500dc58894 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:49.699109 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-519989e8-b8d3-46a1-89bd-03500dc58894 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] 10.222.0.46 "POST /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847/action" status: 202 len: 1067 microversion: 2.1 time: 0.210589 Jan 15 20:50:49.699948 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 387/827] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:50:49 2022] POST /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847/action => generated 1067 bytes in 212 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 15 20:50:49.702513 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-4805ff66-023b-476c-a54c-88c6f7fc7d05 req-3600899e-01d8-47e6-9515-16ad11fe556f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4b0aaad-91ee-4e37-9a34-0b4d56e282d5", "tag": "b044e748-14c3-4e19-b93b-659f2cfe547b"}, {"server_uuid": "1085522d-3ccc-4de0-b9dd-01c374e1f0ca", "name": "network-vif-unplugged", "status": "completed", "tag": "fd65475a-f2b6-4fd5-b84f-f1f5f96b1f50"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:50:49.706012 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:50:49.706012 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:50:49.714507 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-33b05e26-4534-4a2d-a5ff-4ad75d95384c tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:49.715117 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-33b05e26-4534-4a2d-a5ff-4ad75d95384c tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] [instance: b191ed6c-040a-4702-8e15-86272f9d1847] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:49.722640 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-33b05e26-4534-4a2d-a5ff-4ad75d95384c tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:49.723976 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-33b05e26-4534-4a2d-a5ff-4ad75d95384c tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:49.723976 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-33b05e26-4534-4a2d-a5ff-4ad75d95384c tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:49.724596 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-33b05e26-4534-4a2d-a5ff-4ad75d95384c tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:49.749005 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-4805ff66-023b-476c-a54c-88c6f7fc7d05 req-3600899e-01d8-47e6-9515-16ad11fe556f service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:49.749580 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-4805ff66-023b-476c-a54c-88c6f7fc7d05 req-3600899e-01d8-47e6-9515-16ad11fe556f service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:49.772474 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-4805ff66-023b-476c-a54c-88c6f7fc7d05 req-3600899e-01d8-47e6-9515-16ad11fe556f service nova] Creating event network-changed:b044e748-14c3-4e19-b93b-659f2cfe547b for instance c4b0aaad-91ee-4e37-9a34-0b4d56e282d5 on nch2-master-1 Jan 15 20:50:49.774782 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-4805ff66-023b-476c-a54c-88c6f7fc7d05 req-3600899e-01d8-47e6-9515-16ad11fe556f service nova] Creating event network-vif-unplugged:fd65475a-f2b6-4fd5-b84f-f1f5f96b1f50 for instance 1085522d-3ccc-4de0-b9dd-01c374e1f0ca on nch1-master-1 Jan 15 20:50:49.787309 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-4805ff66-023b-476c-a54c-88c6f7fc7d05 req-3600899e-01d8-47e6-9515-16ad11fe556f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.090561 Jan 15 20:50:49.788737 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 441/828] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:50:49 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 20:50:49.813322 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a17eebd7-77a9-487a-ae3b-8f7ceac92d41 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:49.820989 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a17eebd7-77a9-487a-ae3b-8f7ceac92d41 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: e3fa2f27-df7a-4ecb-9bba-c970e3e7d106] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:49.836722 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a17eebd7-77a9-487a-ae3b-8f7ceac92d41 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:49.837473 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a17eebd7-77a9-487a-ae3b-8f7ceac92d41 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:49.841044 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a17eebd7-77a9-487a-ae3b-8f7ceac92d41 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:49.841855 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a17eebd7-77a9-487a-ae3b-8f7ceac92d41 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:49.979974 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-33b05e26-4534-4a2d-a5ff-4ad75d95384c tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d4a57cfaa145009ba9cc8f21d9e8ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4a26c8edac44c8b26fd4e43813412d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:49.990292 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-33b05e26-4534-4a2d-a5ff-4ad75d95384c tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] 10.222.0.46 "GET /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847" status: 200 len: 1471 microversion: 2.1 time: 0.280275 Jan 15 20:50:49.991194 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 388/829] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:49 2022] GET /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847 => generated 1471 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:49.998337 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-868ccc25-b706-47bf-8cf8-8857f3081120 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:49.999081 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-868ccc25-b706-47bf-8cf8-8857f3081120 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] [instance: c4b0aaad-91ee-4e37-9a34-0b4d56e282d5] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:50.011446 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-868ccc25-b706-47bf-8cf8-8857f3081120 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:50.012319 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-868ccc25-b706-47bf-8cf8-8857f3081120 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:50.012950 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-868ccc25-b706-47bf-8cf8-8857f3081120 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:50.013501 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-868ccc25-b706-47bf-8cf8-8857f3081120 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:50.066289 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-a17eebd7-77a9-487a-ae3b-8f7ceac92d41 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:50.076282 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a17eebd7-77a9-487a-ae3b-8f7ceac92d41 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/e3fa2f27-df7a-4ecb-9bba-c970e3e7d106" status: 200 len: 1473 microversion: 2.1 time: 0.268539 Jan 15 20:50:50.086956 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 442/830] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:49 2022] GET /compute/v2.1/servers/e3fa2f27-df7a-4ecb-9bba-c970e3e7d106 => generated 1473 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:50.121691 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-454a57ec-5729-4a65-8bd3-49c5aa4c9cca tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:50.124497 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-454a57ec-5729-4a65-8bd3-49c5aa4c9cca tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] [instance: 69b95b86-744d-4552-a0fc-6ced4d9ef38d] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:50.131688 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-454a57ec-5729-4a65-8bd3-49c5aa4c9cca tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:50.131899 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-454a57ec-5729-4a65-8bd3-49c5aa4c9cca tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:50.134151 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-454a57ec-5729-4a65-8bd3-49c5aa4c9cca tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:50.134756 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-454a57ec-5729-4a65-8bd3-49c5aa4c9cca tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:50.222655 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-868ccc25-b706-47bf-8cf8-8857f3081120 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc38f86758f9416b9e7f6915de0359d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8cfe33be708428abef52f5e8e25621b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:50.230180 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-868ccc25-b706-47bf-8cf8-8857f3081120 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] 10.222.0.46 "GET /compute/v2.1/servers/c4b0aaad-91ee-4e37-9a34-0b4d56e282d5" status: 200 len: 1319 microversion: 2.1 time: 0.237062 Jan 15 20:50:50.230794 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 389/831] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:49 2022] GET /compute/v2.1/servers/c4b0aaad-91ee-4e37-9a34-0b4d56e282d5 => generated 1319 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:50.235977 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2e4f379d-a520-4960-af1d-d143fa26cc96 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:50:50.236935 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-2e4f379d-a520-4960-af1d-d143fa26cc96 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 98d0ca37-0175-44e2-8a1d-965cdc517daf] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:50.243412 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2e4f379d-a520-4960-af1d-d143fa26cc96 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:50.243863 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2e4f379d-a520-4960-af1d-d143fa26cc96 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:50.244636 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2e4f379d-a520-4960-af1d-d143fa26cc96 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:50.245103 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2e4f379d-a520-4960-af1d-d143fa26cc96 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:50.293072 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2e4f379d-a520-4960-af1d-d143fa26cc96 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action" status: 200 len: 32634 microversion: 2.1 time: 0.060428 Jan 15 20:50:50.294276 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 390/832] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:50:50 2022] POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action => generated 32634 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:50:50.300011 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-454a57ec-5729-4a65-8bd3-49c5aa4c9cca tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02b23752962428b825b6f7757f54007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f60a2e220b479abf4b04536ed406e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:50.308274 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-454a57ec-5729-4a65-8bd3-49c5aa4c9cca tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] 10.222.0.46 "GET /compute/v2.1/servers/69b95b86-744d-4552-a0fc-6ced4d9ef38d" status: 200 len: 1332 microversion: 2.1 time: 0.193288 Jan 15 20:50:50.309161 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 443/833] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:50 2022] GET /compute/v2.1/servers/69b95b86-744d-4552-a0fc-6ced4d9ef38d => generated 1332 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:50.456681 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-cf81e174-b12b-4159-ba81-4a4d33e8bf79 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:50.457268 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-cf81e174-b12b-4159-ba81-4a4d33e8bf79 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] [instance: ecba885c-f344-480e-9efc-707d1c542d42] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:50.465362 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cf81e174-b12b-4159-ba81-4a4d33e8bf79 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:50.465811 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cf81e174-b12b-4159-ba81-4a4d33e8bf79 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:50.466798 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cf81e174-b12b-4159-ba81-4a4d33e8bf79 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:50.467235 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cf81e174-b12b-4159-ba81-4a4d33e8bf79 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:50.503184 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c4f2413b-0238-4489-bddf-e1364a23d1d1 tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:50.503938 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c4f2413b-0238-4489-bddf-e1364a23d1d1 tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] [instance: 7a5972c0-eea6-4198-8532-1efff379b087] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:50.516653 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c4f2413b-0238-4489-bddf-e1364a23d1d1 tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:50.517044 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c4f2413b-0238-4489-bddf-e1364a23d1d1 tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:50.517864 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c4f2413b-0238-4489-bddf-e1364a23d1d1 tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:50.518335 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c4f2413b-0238-4489-bddf-e1364a23d1d1 tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:50.556207 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c4f2413b-0238-4489-bddf-e1364a23d1d1 tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:50.557011 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c4f2413b-0238-4489-bddf-e1364a23d1d1 tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:50.557468 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.objects.instance [None req-c4f2413b-0238-4489-bddf-e1364a23d1d1 tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] Lazy-loading 'fault' on Instance uuid 7a5972c0-eea6-4198-8532-1efff379b087 {{(pid=129366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 20:50:50.600439 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-c4f2413b-0238-4489-bddf-e1364a23d1d1 tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f311520925464d1a8c7d7302a1ef4bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25de5a60ff6f48aebb27a1ef9cbe0606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:50.609151 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c4f2413b-0238-4489-bddf-e1364a23d1d1 tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] 10.222.0.46 "GET /compute/v2.1/servers/7a5972c0-eea6-4198-8532-1efff379b087" status: 200 len: 1303 microversion: 2.1 time: 0.109491 Jan 15 20:50:50.618859 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 444/834] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:50 2022] GET /compute/v2.1/servers/7a5972c0-eea6-4198-8532-1efff379b087 => generated 1303 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:50:50.656466 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-31da7a66-d294-41a7-a905-66efdcd7b7a3 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:50.657115 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-31da7a66-d294-41a7-a905-66efdcd7b7a3 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] [instance: 1085522d-3ccc-4de0-b9dd-01c374e1f0ca] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:50.663017 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-31da7a66-d294-41a7-a905-66efdcd7b7a3 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:50.663468 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-31da7a66-d294-41a7-a905-66efdcd7b7a3 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:50.665020 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-31da7a66-d294-41a7-a905-66efdcd7b7a3 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:50.665463 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-31da7a66-d294-41a7-a905-66efdcd7b7a3 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:50.666026 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-cf81e174-b12b-4159-ba81-4a4d33e8bf79 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55be87ae7f14b499ab2cd6fc5538988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd217e7fd648b4a78c0c32ff1c95f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:50.673720 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-cf81e174-b12b-4159-ba81-4a4d33e8bf79 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "GET /compute/v2.1/servers/ecba885c-f344-480e-9efc-707d1c542d42" status: 200 len: 1473 microversion: 2.1 time: 0.222612 Jan 15 20:50:50.674284 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 391/835] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:50 2022] GET /compute/v2.1/servers/ecba885c-f344-480e-9efc-707d1c542d42 => generated 1473 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:50.690493 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-378d9798-1783-427e-a1cc-5449b4e56d83 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-611480264"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:50:50.691578 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-378d9798-1783-427e-a1cc-5449b4e56d83 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] [instance: ecba885c-f344-480e-9efc-707d1c542d42] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:50.697718 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-378d9798-1783-427e-a1cc-5449b4e56d83 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:50.698236 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-378d9798-1783-427e-a1cc-5449b4e56d83 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:50.699102 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-378d9798-1783-427e-a1cc-5449b4e56d83 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:50.699601 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-378d9798-1783-427e-a1cc-5449b4e56d83 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:50.801760 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-31da7a66-d294-41a7-a905-66efdcd7b7a3 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:50.813613 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-31da7a66-d294-41a7-a905-66efdcd7b7a3 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:50.815310 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-31da7a66-d294-41a7-a905-66efdcd7b7a3 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:50.816901 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-31da7a66-d294-41a7-a905-66efdcd7b7a3 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] 10.222.0.46 "GET /compute/v2.1/servers/1085522d-3ccc-4de0-b9dd-01c374e1f0ca" status: 200 len: 1567 microversion: 2.25 time: 0.163935 Jan 15 20:50:50.817563 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 445/836] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:50:50 2022] GET /compute/v2.1/servers/1085522d-3ccc-4de0-b9dd-01c374e1f0ca => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 15 20:50:50.975412 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-378d9798-1783-427e-a1cc-5449b4e56d83 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "POST /compute/v2.1/servers/ecba885c-f344-480e-9efc-707d1c542d42/action" status: 202 len: 0 microversion: 2.1 time: 0.288352 Jan 15 20:50:50.976097 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 392/837] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:50:50 2022] POST /compute/v2.1/servers/ecba885c-f344-480e-9efc-707d1c542d42/action => generated 0 bytes in 290 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Jan 15 20:50:50.986666 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e8a524b0-eb6a-4e9c-8143-d955787154a5 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '.version_select at 0x7f30c9341940>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:51.009060 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5f5746d8-a9a4-40e0-9a3b-52313bdba398 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:51.009793 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-5f5746d8-a9a4-40e0-9a3b-52313bdba398 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] [instance: b191ed6c-040a-4702-8e15-86272f9d1847] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:51.015914 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5f5746d8-a9a4-40e0-9a3b-52313bdba398 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:51.016393 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5f5746d8-a9a4-40e0-9a3b-52313bdba398 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:51.017205 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5f5746d8-a9a4-40e0-9a3b-52313bdba398 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:51.017643 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5f5746d8-a9a4-40e0-9a3b-52313bdba398 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:51.040623 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e8a524b0-eb6a-4e9c-8143-d955787154a5 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "GET /compute/v2.1/images/106585ed-7081-4635-b265-1e7bf3b59ff9" status: 200 len: 1413 microversion: 2.1 time: 0.058027 Jan 15 20:50:51.041221 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 446/838] 10.222.0.46 () {58 vars in 1232 bytes} [Sat Jan 15 20:50:50 2022] GET /compute/v2.1/images/106585ed-7081-4635-b265-1e7bf3b59ff9 => generated 1413 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:51.094059 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-6b7bccf8-c61b-415c-83fb-316feddf78e2 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:51.094670 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-6b7bccf8-c61b-415c-83fb-316feddf78e2 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: e3fa2f27-df7a-4ecb-9bba-c970e3e7d106] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:51.102359 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6b7bccf8-c61b-415c-83fb-316feddf78e2 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:51.102817 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6b7bccf8-c61b-415c-83fb-316feddf78e2 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:51.103617 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6b7bccf8-c61b-415c-83fb-316feddf78e2 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:51.104242 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6b7bccf8-c61b-415c-83fb-316feddf78e2 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:51.192226 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-5f5746d8-a9a4-40e0-9a3b-52313bdba398 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d4a57cfaa145009ba9cc8f21d9e8ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4a26c8edac44c8b26fd4e43813412d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:51.201552 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5f5746d8-a9a4-40e0-9a3b-52313bdba398 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] 10.222.0.46 "GET /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847" status: 200 len: 1471 microversion: 2.1 time: 0.197604 Jan 15 20:50:51.202137 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 393/839] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:51 2022] GET /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847 => generated 1471 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:51.247631 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-34309f9b-0c85-4e83-acc0-0a8f0aaa1891 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:51.248245 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-34309f9b-0c85-4e83-acc0-0a8f0aaa1891 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] [instance: c4b0aaad-91ee-4e37-9a34-0b4d56e282d5] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:51.254230 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-34309f9b-0c85-4e83-acc0-0a8f0aaa1891 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:51.254679 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-34309f9b-0c85-4e83-acc0-0a8f0aaa1891 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:51.255464 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-34309f9b-0c85-4e83-acc0-0a8f0aaa1891 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:51.255898 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-34309f9b-0c85-4e83-acc0-0a8f0aaa1891 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:51.260210 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-6b7bccf8-c61b-415c-83fb-316feddf78e2 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:51.267747 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-6b7bccf8-c61b-415c-83fb-316feddf78e2 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/e3fa2f27-df7a-4ecb-9bba-c970e3e7d106" status: 200 len: 1473 microversion: 2.1 time: 0.177445 Jan 15 20:50:51.268403 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 447/840] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:51 2022] GET /compute/v2.1/servers/e3fa2f27-df7a-4ecb-9bba-c970e3e7d106 => generated 1473 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:50:51.305095 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b3c6fa1b-3239-444e-a59c-8f03d11250ab tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:50:51.305941 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b3c6fa1b-3239-444e-a59c-8f03d11250ab tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 98d0ca37-0175-44e2-8a1d-965cdc517daf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:51.312097 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b3c6fa1b-3239-444e-a59c-8f03d11250ab tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:51.312546 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b3c6fa1b-3239-444e-a59c-8f03d11250ab tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:51.313353 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b3c6fa1b-3239-444e-a59c-8f03d11250ab tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:51.313791 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b3c6fa1b-3239-444e-a59c-8f03d11250ab tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:51.361649 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b3c6fa1b-3239-444e-a59c-8f03d11250ab tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action" status: 200 len: 32634 microversion: 2.1 time: 0.060355 Jan 15 20:50:51.365522 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 448/841] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:50:51 2022] POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action => generated 32634 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 20:50:51.368122 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b0f92181-081e-4d07-b313-2e1f3a40e254 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:51.368834 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b0f92181-081e-4d07-b313-2e1f3a40e254 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] [instance: 69b95b86-744d-4552-a0fc-6ced4d9ef38d] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:51.381442 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b0f92181-081e-4d07-b313-2e1f3a40e254 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:51.381891 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b0f92181-081e-4d07-b313-2e1f3a40e254 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:51.383998 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b0f92181-081e-4d07-b313-2e1f3a40e254 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:51.384490 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b0f92181-081e-4d07-b313-2e1f3a40e254 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:51.399532 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-34309f9b-0c85-4e83-acc0-0a8f0aaa1891 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc38f86758f9416b9e7f6915de0359d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8cfe33be708428abef52f5e8e25621b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:51.406941 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-34309f9b-0c85-4e83-acc0-0a8f0aaa1891 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] 10.222.0.46 "GET /compute/v2.1/servers/c4b0aaad-91ee-4e37-9a34-0b4d56e282d5" status: 200 len: 1319 microversion: 2.1 time: 0.163283 Jan 15 20:50:51.407520 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 394/842] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:51 2022] GET /compute/v2.1/servers/c4b0aaad-91ee-4e37-9a34-0b4d56e282d5 => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:50:51.527670 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-b0f92181-081e-4d07-b313-2e1f3a40e254 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02b23752962428b825b6f7757f54007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f60a2e220b479abf4b04536ed406e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:51.535138 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b0f92181-081e-4d07-b313-2e1f3a40e254 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] 10.222.0.46 "GET /compute/v2.1/servers/69b95b86-744d-4552-a0fc-6ced4d9ef38d" status: 200 len: 1332 microversion: 2.1 time: 0.171737 Jan 15 20:50:51.535704 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 449/843] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:51 2022] GET /compute/v2.1/servers/69b95b86-744d-4552-a0fc-6ced4d9ef38d => generated 1332 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:51.627682 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b766bab6-a26c-4deb-b5c6-b8e0522c71ac tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:51.628399 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b766bab6-a26c-4deb-b5c6-b8e0522c71ac tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] [instance: 7a5972c0-eea6-4198-8532-1efff379b087] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:51.635190 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b766bab6-a26c-4deb-b5c6-b8e0522c71ac tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:51.635728 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b766bab6-a26c-4deb-b5c6-b8e0522c71ac tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:51.636523 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b766bab6-a26c-4deb-b5c6-b8e0522c71ac tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:51.636991 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b766bab6-a26c-4deb-b5c6-b8e0522c71ac tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:51.653542 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-b766bab6-a26c-4deb-b5c6-b8e0522c71ac tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] HTTP exception thrown: Instance 7a5972c0-eea6-4198-8532-1efff379b087 could not be found. Jan 15 20:50:51.654134 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b766bab6-a26c-4deb-b5c6-b8e0522c71ac tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] Returning 404 to user: Instance 7a5972c0-eea6-4198-8532-1efff379b087 could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:50:51.654961 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b766bab6-a26c-4deb-b5c6-b8e0522c71ac tempest-TenantUsagesTestJSON-531741456 tempest-TenantUsagesTestJSON-531741456-project] 10.222.0.46 "GET /compute/v2.1/servers/7a5972c0-eea6-4198-8532-1efff379b087" status: 404 len: 111 microversion: 2.1 time: 0.031394 Jan 15 20:50:51.655517 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 395/844] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:51 2022] GET /compute/v2.1/servers/7a5972c0-eea6-4198-8532-1efff379b087 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:50:51.715891 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-f4bc546b-a870-4507-b12b-9162d4a8ce3a req-87efb451-2cea-4e65-858a-44395e3103ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69b95b86-744d-4552-a0fc-6ced4d9ef38d", "name": "network-vif-plugged", "status": "completed", "tag": "66fcf159-d8ef-45e6-9c7c-4dba94d06566"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:50:51.717843 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:50:51.717843 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:50:51.728175 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-f4bc546b-a870-4507-b12b-9162d4a8ce3a req-87efb451-2cea-4e65-858a-44395e3103ed service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:51.728862 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-f4bc546b-a870-4507-b12b-9162d4a8ce3a req-87efb451-2cea-4e65-858a-44395e3103ed service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:51.743624 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-f4bc546b-a870-4507-b12b-9162d4a8ce3a req-87efb451-2cea-4e65-858a-44395e3103ed service nova] Creating event network-vif-plugged:66fcf159-d8ef-45e6-9c7c-4dba94d06566 for instance 69b95b86-744d-4552-a0fc-6ced4d9ef38d on nch2-master-1 Jan 15 20:50:51.748775 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-f4bc546b-a870-4507-b12b-9162d4a8ce3a req-87efb451-2cea-4e65-858a-44395e3103ed service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038471 Jan 15 20:50:51.749582 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 450/845] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:50:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:50:51.817787 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-94ae8d2e-5a5f-4b30-8866-05460dba0d95 req-dd1668b8-4be2-422f-96ce-bcd7be6da4ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1085522d-3ccc-4de0-b9dd-01c374e1f0ca", "tag": "fd65475a-f2b6-4fd5-b84f-f1f5f96b1f50"}, {"server_uuid": "7a5972c0-eea6-4198-8532-1efff379b087", "name": "network-vif-deleted", "tag": "46119a94-d225-4199-97ac-4a0048ddd01c"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:50:51.819528 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:50:51.819528 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:50:51.829002 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-94ae8d2e-5a5f-4b30-8866-05460dba0d95 req-dd1668b8-4be2-422f-96ce-bcd7be6da4ce service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:51.831908 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-94ae8d2e-5a5f-4b30-8866-05460dba0d95 req-dd1668b8-4be2-422f-96ce-bcd7be6da4ce service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:51.836780 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a9b555d5-1e8e-431b-8313-99fc90932f21 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:51.837806 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a9b555d5-1e8e-431b-8313-99fc90932f21 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] [instance: 1085522d-3ccc-4de0-b9dd-01c374e1f0ca] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:51.846470 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-94ae8d2e-5a5f-4b30-8866-05460dba0d95 req-dd1668b8-4be2-422f-96ce-bcd7be6da4ce service nova] Creating event network-changed:fd65475a-f2b6-4fd5-b84f-f1f5f96b1f50 for instance 1085522d-3ccc-4de0-b9dd-01c374e1f0ca on nch1-master-1 Jan 15 20:50:51.846985 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-94ae8d2e-5a5f-4b30-8866-05460dba0d95 req-dd1668b8-4be2-422f-96ce-bcd7be6da4ce service nova] Creating event network-vif-deleted:46119a94-d225-4199-97ac-4a0048ddd01c for instance 7a5972c0-eea6-4198-8532-1efff379b087 on nch1-master-1 Jan 15 20:50:51.855584 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-94ae8d2e-5a5f-4b30-8866-05460dba0d95 req-dd1668b8-4be2-422f-96ce-bcd7be6da4ce service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.042760 Jan 15 20:50:51.856511 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 396/846] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:50:51 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:50:51.858950 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a9b555d5-1e8e-431b-8313-99fc90932f21 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:51.859400 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a9b555d5-1e8e-431b-8313-99fc90932f21 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:51.860196 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a9b555d5-1e8e-431b-8313-99fc90932f21 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:51.860625 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a9b555d5-1e8e-431b-8313-99fc90932f21 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:52.040467 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-a9b555d5-1e8e-431b-8313-99fc90932f21 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:52.055843 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a4af2461-1091-469a-8d30-c2935dabaa9d tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '.version_select at 0x7f30c9d5aaf0>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:52.057017 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-a9b555d5-1e8e-431b-8313-99fc90932f21 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:52.058859 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-a9b555d5-1e8e-431b-8313-99fc90932f21 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:52.060177 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a9b555d5-1e8e-431b-8313-99fc90932f21 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] 10.222.0.46 "GET /compute/v2.1/servers/1085522d-3ccc-4de0-b9dd-01c374e1f0ca" status: 200 len: 1567 microversion: 2.25 time: 0.228172 Jan 15 20:50:52.064880 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 451/847] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:50:51 2022] GET /compute/v2.1/servers/1085522d-3ccc-4de0-b9dd-01c374e1f0ca => generated 1567 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 15 20:50:52.100915 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a4af2461-1091-469a-8d30-c2935dabaa9d tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "GET /compute/v2.1/images/106585ed-7081-4635-b265-1e7bf3b59ff9" status: 200 len: 1413 microversion: 2.1 time: 0.049595 Jan 15 20:50:52.102311 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 397/848] 10.222.0.46 () {58 vars in 1232 bytes} [Sat Jan 15 20:50:52 2022] GET /compute/v2.1/images/106585ed-7081-4635-b265-1e7bf3b59ff9 => generated 1413 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:52.218920 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ecd9b3da-a344-4308-8a3b-d865d51438e5 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:52.219627 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ecd9b3da-a344-4308-8a3b-d865d51438e5 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] [instance: b191ed6c-040a-4702-8e15-86272f9d1847] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:52.225590 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ecd9b3da-a344-4308-8a3b-d865d51438e5 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:52.226690 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ecd9b3da-a344-4308-8a3b-d865d51438e5 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:52.227537 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ecd9b3da-a344-4308-8a3b-d865d51438e5 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:52.227968 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ecd9b3da-a344-4308-8a3b-d865d51438e5 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:52.287169 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d436d105-7f31-402d-81b8-0cfb5d530599 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:52.288260 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d436d105-7f31-402d-81b8-0cfb5d530599 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: e3fa2f27-df7a-4ecb-9bba-c970e3e7d106] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:52.296786 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d436d105-7f31-402d-81b8-0cfb5d530599 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:52.297474 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d436d105-7f31-402d-81b8-0cfb5d530599 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:52.298575 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d436d105-7f31-402d-81b8-0cfb5d530599 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:52.299115 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d436d105-7f31-402d-81b8-0cfb5d530599 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:52.417263 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-ecd9b3da-a344-4308-8a3b-d865d51438e5 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d4a57cfaa145009ba9cc8f21d9e8ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4a26c8edac44c8b26fd4e43813412d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:52.425611 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ecd9b3da-a344-4308-8a3b-d865d51438e5 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] 10.222.0.46 "GET /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847" status: 200 len: 1471 microversion: 2.1 time: 0.210234 Jan 15 20:50:52.426597 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 452/849] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:52 2022] GET /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847 => generated 1471 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:52.441645 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-31b46d24-4752-4511-8cde-d3ed750b6adc tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:50:52.442841 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-31b46d24-4752-4511-8cde-d3ed750b6adc tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 98d0ca37-0175-44e2-8a1d-965cdc517daf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:52.450672 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-31b46d24-4752-4511-8cde-d3ed750b6adc tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:52.451219 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-31b46d24-4752-4511-8cde-d3ed750b6adc tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:52.452132 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-31b46d24-4752-4511-8cde-d3ed750b6adc tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:52.452704 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-31b46d24-4752-4511-8cde-d3ed750b6adc tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:52.516762 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-d436d105-7f31-402d-81b8-0cfb5d530599 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:52.518430 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-31b46d24-4752-4511-8cde-d3ed750b6adc tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action" status: 200 len: 32634 microversion: 2.1 time: 0.077901 Jan 15 20:50:52.519188 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 453/850] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:50:52 2022] POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action => generated 32634 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:50:52.531521 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d436d105-7f31-402d-81b8-0cfb5d530599 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/e3fa2f27-df7a-4ecb-9bba-c970e3e7d106" status: 200 len: 1470 microversion: 2.1 time: 0.249725 Jan 15 20:50:52.541669 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-01c7e224-0d9a-4cce-b894-7b531e616c74 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:52.542040 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 398/851] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:52 2022] GET /compute/v2.1/servers/e3fa2f27-df7a-4ecb-9bba-c970e3e7d106 => generated 1470 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:50:52.542852 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-01c7e224-0d9a-4cce-b894-7b531e616c74 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] [instance: c4b0aaad-91ee-4e37-9a34-0b4d56e282d5] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:52.549410 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-60f3e90c-14a2-4af0-97c8-8b5760f918af tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:50:52.549916 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-60f3e90c-14a2-4af0-97c8-8b5760f918af tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: e3fa2f27-df7a-4ecb-9bba-c970e3e7d106] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:52.557326 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-60f3e90c-14a2-4af0-97c8-8b5760f918af tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:52.558075 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-60f3e90c-14a2-4af0-97c8-8b5760f918af tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:52.559133 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-60f3e90c-14a2-4af0-97c8-8b5760f918af tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:52.559725 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-60f3e90c-14a2-4af0-97c8-8b5760f918af tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:52.563546 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-01c7e224-0d9a-4cce-b894-7b531e616c74 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:52.564765 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-01c7e224-0d9a-4cce-b894-7b531e616c74 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:52.565067 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-01c7e224-0d9a-4cce-b894-7b531e616c74 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:52.565656 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-01c7e224-0d9a-4cce-b894-7b531e616c74 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:52.656052 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-60f3e90c-14a2-4af0-97c8-8b5760f918af tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "POST /compute/v2.1/servers/e3fa2f27-df7a-4ecb-9bba-c970e3e7d106/action" status: 204 len: 0 microversion: 2.1 time: 0.110592 Jan 15 20:50:52.656791 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 399/852] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:50:52 2022] POST /compute/v2.1/servers/e3fa2f27-df7a-4ecb-9bba-c970e3e7d106/action => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 20:50:52.667969 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d2de3638-6150-4e0e-8743-4de125bbe279 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:52.668770 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d2de3638-6150-4e0e-8743-4de125bbe279 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] [instance: 69b95b86-744d-4552-a0fc-6ced4d9ef38d] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:52.691758 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d2de3638-6150-4e0e-8743-4de125bbe279 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:52.692221 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d2de3638-6150-4e0e-8743-4de125bbe279 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:52.693498 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d2de3638-6150-4e0e-8743-4de125bbe279 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:52.694086 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d2de3638-6150-4e0e-8743-4de125bbe279 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:52.765031 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-01c7e224-0d9a-4cce-b894-7b531e616c74 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc38f86758f9416b9e7f6915de0359d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8cfe33be708428abef52f5e8e25621b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:52.773280 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-01c7e224-0d9a-4cce-b894-7b531e616c74 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] 10.222.0.46 "GET /compute/v2.1/servers/c4b0aaad-91ee-4e37-9a34-0b4d56e282d5" status: 200 len: 1319 microversion: 2.1 time: 0.251158 Jan 15 20:50:52.774383 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 454/853] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:52 2022] GET /compute/v2.1/servers/c4b0aaad-91ee-4e37-9a34-0b4d56e282d5 => generated 1319 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:52.780223 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a2d5dcc1-c4ca-4851-a5cc-dfe4d7f2d358 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:52.781172 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a2d5dcc1-c4ca-4851-a5cc-dfe4d7f2d358 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: e3fa2f27-df7a-4ecb-9bba-c970e3e7d106] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:52.788194 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a2d5dcc1-c4ca-4851-a5cc-dfe4d7f2d358 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:52.789583 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a2d5dcc1-c4ca-4851-a5cc-dfe4d7f2d358 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:52.790576 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a2d5dcc1-c4ca-4851-a5cc-dfe4d7f2d358 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:52.791173 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a2d5dcc1-c4ca-4851-a5cc-dfe4d7f2d358 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:52.917547 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-d2de3638-6150-4e0e-8743-4de125bbe279 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02b23752962428b825b6f7757f54007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f60a2e220b479abf4b04536ed406e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:52.927684 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d2de3638-6150-4e0e-8743-4de125bbe279 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] 10.222.0.46 "GET /compute/v2.1/servers/69b95b86-744d-4552-a0fc-6ced4d9ef38d" status: 200 len: 1332 microversion: 2.1 time: 0.266789 Jan 15 20:50:52.929906 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 400/854] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:52 2022] GET /compute/v2.1/servers/69b95b86-744d-4552-a0fc-6ced4d9ef38d => generated 1332 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:53.079409 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-273c8005-2dfc-4905-93af-e07caa3699f7 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:53.080055 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-273c8005-2dfc-4905-93af-e07caa3699f7 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] [instance: 1085522d-3ccc-4de0-b9dd-01c374e1f0ca] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:53.088245 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-273c8005-2dfc-4905-93af-e07caa3699f7 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:53.088582 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-273c8005-2dfc-4905-93af-e07caa3699f7 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:53.090795 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-273c8005-2dfc-4905-93af-e07caa3699f7 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:53.091784 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-273c8005-2dfc-4905-93af-e07caa3699f7 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:53.223360 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-a2d5dcc1-c4ca-4851-a5cc-dfe4d7f2d358 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:53.232964 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a2d5dcc1-c4ca-4851-a5cc-dfe4d7f2d358 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/e3fa2f27-df7a-4ecb-9bba-c970e3e7d106" status: 200 len: 1470 microversion: 2.1 time: 0.457507 Jan 15 20:50:53.243354 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 455/855] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:52 2022] GET /compute/v2.1/servers/e3fa2f27-df7a-4ecb-9bba-c970e3e7d106 => generated 1470 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:53.248121 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9464a9e2-10a2-455a-b552-93013d898946 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '.version_select at 0x7f30c93e0550>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:53.296448 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-273c8005-2dfc-4905-93af-e07caa3699f7 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:53.297388 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-9464a9e2-10a2-455a-b552-93013d898946 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "GET /compute/v2.1/images/106585ed-7081-4635-b265-1e7bf3b59ff9" status: 200 len: 1413 microversion: 2.1 time: 0.052632 Jan 15 20:50:53.298161 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 456/856] 10.222.0.46 () {58 vars in 1232 bytes} [Sat Jan 15 20:50:53 2022] GET /compute/v2.1/images/106585ed-7081-4635-b265-1e7bf3b59ff9 => generated 1413 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:53.311217 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-273c8005-2dfc-4905-93af-e07caa3699f7 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:53.312782 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-273c8005-2dfc-4905-93af-e07caa3699f7 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:53.314042 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-273c8005-2dfc-4905-93af-e07caa3699f7 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] 10.222.0.46 "GET /compute/v2.1/servers/1085522d-3ccc-4de0-b9dd-01c374e1f0ca" status: 200 len: 1567 microversion: 2.25 time: 0.239057 Jan 15 20:50:53.325883 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 401/857] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:50:53 2022] GET /compute/v2.1/servers/1085522d-3ccc-4de0-b9dd-01c374e1f0ca => generated 1567 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 15 20:50:53.444759 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-22d3e71a-023c-42c2-8bff-f85a119109f4 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:53.446383 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-22d3e71a-023c-42c2-8bff-f85a119109f4 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] [instance: b191ed6c-040a-4702-8e15-86272f9d1847] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:53.456908 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-22d3e71a-023c-42c2-8bff-f85a119109f4 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:53.457835 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-22d3e71a-023c-42c2-8bff-f85a119109f4 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:53.458201 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-22d3e71a-023c-42c2-8bff-f85a119109f4 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:53.458639 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-22d3e71a-023c-42c2-8bff-f85a119109f4 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:53.530982 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-0035ef17-5d89-4f68-bdf7-1bbdd8b6ae2c tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:50:53.532011 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-0035ef17-5d89-4f68-bdf7-1bbdd8b6ae2c tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 98d0ca37-0175-44e2-8a1d-965cdc517daf] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:53.545225 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0035ef17-5d89-4f68-bdf7-1bbdd8b6ae2c tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:53.546415 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0035ef17-5d89-4f68-bdf7-1bbdd8b6ae2c tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:53.547339 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0035ef17-5d89-4f68-bdf7-1bbdd8b6ae2c tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:53.547777 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0035ef17-5d89-4f68-bdf7-1bbdd8b6ae2c tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:53.621622 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-0035ef17-5d89-4f68-bdf7-1bbdd8b6ae2c tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action" status: 200 len: 32634 microversion: 2.1 time: 0.094672 Jan 15 20:50:53.622887 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 402/858] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:50:53 2022] POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action => generated 32634 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 20:50:53.683096 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-22d3e71a-023c-42c2-8bff-f85a119109f4 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d4a57cfaa145009ba9cc8f21d9e8ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4a26c8edac44c8b26fd4e43813412d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:53.693162 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-22d3e71a-023c-42c2-8bff-f85a119109f4 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] 10.222.0.46 "GET /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847" status: 200 len: 1471 microversion: 2.1 time: 0.253493 Jan 15 20:50:53.694086 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 457/859] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:53 2022] GET /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847 => generated 1471 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:53.794488 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9e6c0239-9e44-4958-9122-8de567a3b5a4 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:53.796126 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-9e6c0239-9e44-4958-9122-8de567a3b5a4 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] [instance: c4b0aaad-91ee-4e37-9a34-0b4d56e282d5] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:53.804890 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9e6c0239-9e44-4958-9122-8de567a3b5a4 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:53.806435 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9e6c0239-9e44-4958-9122-8de567a3b5a4 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:53.807499 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9e6c0239-9e44-4958-9122-8de567a3b5a4 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:53.808238 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9e6c0239-9e44-4958-9122-8de567a3b5a4 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:53.826991 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-03d18985-959b-48a7-b629-73c02628d0f6 req-01b95d09-b530-4a03-8ed2-e96a57900675 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3fa2f27-df7a-4ecb-9bba-c970e3e7d106", "name": "network-vif-unplugged", "status": "completed", "tag": "3c8e5ec9-ee60-4c8e-b5ce-d77245088af1"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:50:53.829300 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:50:53.829300 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:50:53.843444 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-03d18985-959b-48a7-b629-73c02628d0f6 req-01b95d09-b530-4a03-8ed2-e96a57900675 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:53.845714 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-03d18985-959b-48a7-b629-73c02628d0f6 req-01b95d09-b530-4a03-8ed2-e96a57900675 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:53.874286 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-03d18985-959b-48a7-b629-73c02628d0f6 req-01b95d09-b530-4a03-8ed2-e96a57900675 service nova] Creating event network-vif-unplugged:3c8e5ec9-ee60-4c8e-b5ce-d77245088af1 for instance e3fa2f27-df7a-4ecb-9bba-c970e3e7d106 on nch1-master-1 Jan 15 20:50:53.893909 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [req-03d18985-959b-48a7-b629-73c02628d0f6 req-01b95d09-b530-4a03-8ed2-e96a57900675 service nova] Instance e3fa2f27-df7a-4ecb-9bba-c970e3e7d106 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1'} {{(pid=129366) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Jan 15 20:50:53.906542 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-03d18985-959b-48a7-b629-73c02628d0f6 req-01b95d09-b530-4a03-8ed2-e96a57900675 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.083606 Jan 15 20:50:53.907446 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 458/860] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:50:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 20:50:53.946978 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-3eeb20d1-46d3-47cd-a6b4-ea9f48379757 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:53.947824 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-3eeb20d1-46d3-47cd-a6b4-ea9f48379757 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] [instance: 69b95b86-744d-4552-a0fc-6ced4d9ef38d] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:53.955213 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3eeb20d1-46d3-47cd-a6b4-ea9f48379757 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:53.955986 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3eeb20d1-46d3-47cd-a6b4-ea9f48379757 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:53.957189 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3eeb20d1-46d3-47cd-a6b4-ea9f48379757 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:53.958044 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3eeb20d1-46d3-47cd-a6b4-ea9f48379757 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:54.061677 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-9e6c0239-9e44-4958-9122-8de567a3b5a4 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc38f86758f9416b9e7f6915de0359d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8cfe33be708428abef52f5e8e25621b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:54.072009 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-9e6c0239-9e44-4958-9122-8de567a3b5a4 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] 10.222.0.46 "GET /compute/v2.1/servers/c4b0aaad-91ee-4e37-9a34-0b4d56e282d5" status: 200 len: 1319 microversion: 2.1 time: 0.285171 Jan 15 20:50:54.072833 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 403/861] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:53 2022] GET /compute/v2.1/servers/c4b0aaad-91ee-4e37-9a34-0b4d56e282d5 => generated 1319 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:54.232149 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-3eeb20d1-46d3-47cd-a6b4-ea9f48379757 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02b23752962428b825b6f7757f54007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f60a2e220b479abf4b04536ed406e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:54.245439 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-3eeb20d1-46d3-47cd-a6b4-ea9f48379757 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] 10.222.0.46 "GET /compute/v2.1/servers/69b95b86-744d-4552-a0fc-6ced4d9ef38d" status: 200 len: 1332 microversion: 2.1 time: 0.300731 Jan 15 20:50:54.251538 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5ceb41f1-5adf-4ffd-9f5f-727ac908a691 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:54.252318 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-5ceb41f1-5adf-4ffd-9f5f-727ac908a691 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: e3fa2f27-df7a-4ecb-9bba-c970e3e7d106] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:54.259476 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 459/862] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:53 2022] GET /compute/v2.1/servers/69b95b86-744d-4552-a0fc-6ced4d9ef38d => generated 1332 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:54.269008 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5ceb41f1-5adf-4ffd-9f5f-727ac908a691 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:54.270794 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5ceb41f1-5adf-4ffd-9f5f-727ac908a691 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:54.271838 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5ceb41f1-5adf-4ffd-9f5f-727ac908a691 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:54.275252 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5ceb41f1-5adf-4ffd-9f5f-727ac908a691 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:54.311116 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f707b760-ad66-40b5-86c1-620cb8a84292 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '.version_select at 0x7f30c9728af0>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:54.428713 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f707b760-ad66-40b5-86c1-620cb8a84292 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "GET /compute/v2.1/images/106585ed-7081-4635-b265-1e7bf3b59ff9" status: 200 len: 1413 microversion: 2.1 time: 0.121310 Jan 15 20:50:54.439612 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 460/863] 10.222.0.46 () {58 vars in 1232 bytes} [Sat Jan 15 20:50:54 2022] GET /compute/v2.1/images/106585ed-7081-4635-b265-1e7bf3b59ff9 => generated 1413 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:50:54.458648 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-acf9152f-794b-4c72-bd21-12f4d15a9116 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:54.459306 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-acf9152f-794b-4c72-bd21-12f4d15a9116 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] [instance: 1085522d-3ccc-4de0-b9dd-01c374e1f0ca] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:54.487322 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-acf9152f-794b-4c72-bd21-12f4d15a9116 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:54.494014 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-acf9152f-794b-4c72-bd21-12f4d15a9116 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:54.501992 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-acf9152f-794b-4c72-bd21-12f4d15a9116 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:54.502869 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-acf9152f-794b-4c72-bd21-12f4d15a9116 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:54.698285 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-5ceb41f1-5adf-4ffd-9f5f-727ac908a691 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:54.717038 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5ceb41f1-5adf-4ffd-9f5f-727ac908a691 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/e3fa2f27-df7a-4ecb-9bba-c970e3e7d106" status: 200 len: 1470 microversion: 2.1 time: 0.470238 Jan 15 20:50:54.721673 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 404/864] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:54 2022] GET /compute/v2.1/servers/e3fa2f27-df7a-4ecb-9bba-c970e3e7d106 => generated 1470 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:54.734585 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-0c7a16f6-7006-477f-a8fb-d64922f8d690 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:50:54.735844 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-0c7a16f6-7006-477f-a8fb-d64922f8d690 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 98d0ca37-0175-44e2-8a1d-965cdc517daf] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:54.752922 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0c7a16f6-7006-477f-a8fb-d64922f8d690 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:54.753704 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0c7a16f6-7006-477f-a8fb-d64922f8d690 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:54.754879 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0c7a16f6-7006-477f-a8fb-d64922f8d690 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:54.755515 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0c7a16f6-7006-477f-a8fb-d64922f8d690 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:54.886807 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-0c7a16f6-7006-477f-a8fb-d64922f8d690 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action" status: 200 len: 32634 microversion: 2.1 time: 0.159913 Jan 15 20:50:54.890949 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 405/865] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:50:54 2022] POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action => generated 32634 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:50:54.895759 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-870018b5-57dd-4e6e-a956-4d5e3ee12e32 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:54.898319 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-870018b5-57dd-4e6e-a956-4d5e3ee12e32 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] [instance: b191ed6c-040a-4702-8e15-86272f9d1847] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:54.915402 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-870018b5-57dd-4e6e-a956-4d5e3ee12e32 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:54.916169 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-870018b5-57dd-4e6e-a956-4d5e3ee12e32 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:54.917185 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-870018b5-57dd-4e6e-a956-4d5e3ee12e32 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:54.917968 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-870018b5-57dd-4e6e-a956-4d5e3ee12e32 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:55.021940 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-acf9152f-794b-4c72-bd21-12f4d15a9116 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:55.030770 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-acf9152f-794b-4c72-bd21-12f4d15a9116 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:55.034819 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-acf9152f-794b-4c72-bd21-12f4d15a9116 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:55.038265 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-acf9152f-794b-4c72-bd21-12f4d15a9116 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] 10.222.0.46 "GET /compute/v2.1/servers/1085522d-3ccc-4de0-b9dd-01c374e1f0ca" status: 200 len: 1567 microversion: 2.25 time: 0.593866 Jan 15 20:50:55.054621 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 461/866] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:50:54 2022] GET /compute/v2.1/servers/1085522d-3ccc-4de0-b9dd-01c374e1f0ca => generated 1567 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:50:55.091383 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-22fb67f9-502c-4257-9ba6-878dd0890006 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:55.092236 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-22fb67f9-502c-4257-9ba6-878dd0890006 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] [instance: c4b0aaad-91ee-4e37-9a34-0b4d56e282d5] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:55.119715 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-22fb67f9-502c-4257-9ba6-878dd0890006 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:55.121074 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-22fb67f9-502c-4257-9ba6-878dd0890006 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:55.126644 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-22fb67f9-502c-4257-9ba6-878dd0890006 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:55.129987 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-22fb67f9-502c-4257-9ba6-878dd0890006 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:55.240521 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-870018b5-57dd-4e6e-a956-4d5e3ee12e32 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d4a57cfaa145009ba9cc8f21d9e8ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4a26c8edac44c8b26fd4e43813412d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:55.274614 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-870018b5-57dd-4e6e-a956-4d5e3ee12e32 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] 10.222.0.46 "GET /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847" status: 200 len: 1471 microversion: 2.1 time: 0.383164 Jan 15 20:50:55.299669 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 406/867] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:54 2022] GET /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847 => generated 1471 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:55.312199 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-189fc211-2623-4c33-930c-450726354a1e tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:55.314296 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-189fc211-2623-4c33-930c-450726354a1e tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] [instance: 69b95b86-744d-4552-a0fc-6ced4d9ef38d] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:55.324296 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-189fc211-2623-4c33-930c-450726354a1e tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:55.325375 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-189fc211-2623-4c33-930c-450726354a1e tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:55.327727 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-189fc211-2623-4c33-930c-450726354a1e tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:55.328322 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-189fc211-2623-4c33-930c-450726354a1e tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:55.596625 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-22fb67f9-502c-4257-9ba6-878dd0890006 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc38f86758f9416b9e7f6915de0359d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8cfe33be708428abef52f5e8e25621b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:55.609825 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-22fb67f9-502c-4257-9ba6-878dd0890006 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] 10.222.0.46 "GET /compute/v2.1/servers/c4b0aaad-91ee-4e37-9a34-0b4d56e282d5" status: 200 len: 1319 microversion: 2.1 time: 0.524486 Jan 15 20:50:55.620858 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 462/868] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:55 2022] GET /compute/v2.1/servers/c4b0aaad-91ee-4e37-9a34-0b4d56e282d5 => generated 1319 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:50:55.629300 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1498e929-d7ff-4e5d-911f-6a45f73a86e0 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '.version_select at 0x7f30c9728940>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:55.695167 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-1498e929-d7ff-4e5d-911f-6a45f73a86e0 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "GET /compute/v2.1/images/106585ed-7081-4635-b265-1e7bf3b59ff9" status: 200 len: 1413 microversion: 2.1 time: 0.073153 Jan 15 20:50:55.701282 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 463/869] 10.222.0.46 () {58 vars in 1232 bytes} [Sat Jan 15 20:50:55 2022] GET /compute/v2.1/images/106585ed-7081-4635-b265-1e7bf3b59ff9 => generated 1413 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:55.745779 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-189fc211-2623-4c33-930c-450726354a1e tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02b23752962428b825b6f7757f54007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f60a2e220b479abf4b04536ed406e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:55.755405 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-189fc211-2623-4c33-930c-450726354a1e tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] 10.222.0.46 "GET /compute/v2.1/servers/69b95b86-744d-4552-a0fc-6ced4d9ef38d" status: 200 len: 1332 microversion: 2.1 time: 0.447373 Jan 15 20:50:55.756555 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 407/870] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:55 2022] GET /compute/v2.1/servers/69b95b86-744d-4552-a0fc-6ced4d9ef38d => generated 1332 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:55.762692 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-03e2b1ac-e083-4864-a12d-f4721150ef9b tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:55.763696 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-03e2b1ac-e083-4864-a12d-f4721150ef9b tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: e3fa2f27-df7a-4ecb-9bba-c970e3e7d106] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:55.771162 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-03e2b1ac-e083-4864-a12d-f4721150ef9b tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:55.772001 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-03e2b1ac-e083-4864-a12d-f4721150ef9b tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:55.773205 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-03e2b1ac-e083-4864-a12d-f4721150ef9b tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:55.773944 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-03e2b1ac-e083-4864-a12d-f4721150ef9b tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:55.833930 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-87a16133-c00f-4405-9d8c-c4aae9762059 tempest-TenantUsagesNegativeTestJSON-790984640 tempest-TenantUsagesNegativeTestJSON-790984640-project-admin] 10.222.0.46 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-01-14T20%3A50%3A55.661885&end=2022-01-16T20%3A50%3A55.661885" status: 404 len: 112 microversion: - time: 0.131296 Jan 15 20:50:55.835009 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 464/871] 10.222.0.46 () {58 vars in 1315 bytes} [Sat Jan 15 20:50:55 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-01-14T20%3A50%3A55.661885&end=2022-01-16T20%3A50%3A55.661885 => generated 112 bytes in 133 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jan 15 20:50:55.846862 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-42084002-ec63-4df2-8b30-7374ab998c09 tempest-TenantUsagesNegativeTestJSON-790984640 tempest-TenantUsagesNegativeTestJSON-790984640-project-admin] Calling method '.version_select at 0x7f30cae25e50>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:55.849809 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-42084002-ec63-4df2-8b30-7374ab998c09 tempest-TenantUsagesNegativeTestJSON-790984640 tempest-TenantUsagesNegativeTestJSON-790984640-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Jan 15 20:50:55.850371 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-42084002-ec63-4df2-8b30-7374ab998c09 tempest-TenantUsagesNegativeTestJSON-790984640 tempest-TenantUsagesNegativeTestJSON-790984640-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:50:55.851773 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-42084002-ec63-4df2-8b30-7374ab998c09 tempest-TenantUsagesNegativeTestJSON-790984640 tempest-TenantUsagesNegativeTestJSON-790984640-project-admin] 10.222.0.46 "GET /compute/v2.1/os-simple-tenant-usage/0e302d879537443cadf6a5fffbe80df0?start=2022-01-16T20%3A50%3A55.661885&end=2022-01-14T20%3A50%3A55.661885" status: 400 len: 111 microversion: 2.1 time: 0.007960 Jan 15 20:50:55.859066 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 465/872] 10.222.0.46 () {58 vars in 1411 bytes} [Sat Jan 15 20:50:55 2022] GET /compute/v2.1/os-simple-tenant-usage/0e302d879537443cadf6a5fffbe80df0?start=2022-01-16T20%3A50%3A55.661885&end=2022-01-14T20%3A50%3A55.661885 => generated 111 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 15 20:50:55.983842 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-03e2b1ac-e083-4864-a12d-f4721150ef9b tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:56.006502 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-03e2b1ac-e083-4864-a12d-f4721150ef9b tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/e3fa2f27-df7a-4ecb-9bba-c970e3e7d106" status: 200 len: 1462 microversion: 2.1 time: 0.247334 Jan 15 20:50:56.008942 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 408/873] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:55 2022] GET /compute/v2.1/servers/e3fa2f27-df7a-4ecb-9bba-c970e3e7d106 => generated 1462 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:56.016437 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8d348e72-ff9f-4e27-8db8-40475c5f6639 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:50:56.017535 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-8d348e72-ff9f-4e27-8db8-40475c5f6639 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 98d0ca37-0175-44e2-8a1d-965cdc517daf] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:56.025453 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e644da2c-a059-4cca-84ad-6e60772707a9 tempest-TenantUsagesNegativeTestJSON-1780866975 tempest-TenantUsagesNegativeTestJSON-1780866975-project] Calling method '.version_select at 0x7f30c9c080d0>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:56.027356 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-simple-tenant-usage:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:50:56.027356 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:50:56.030513 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-e644da2c-a059-4cca-84ad-6e60772707a9 tempest-TenantUsagesNegativeTestJSON-1780866975 tempest-TenantUsagesNegativeTestJSON-1780866975-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '15fba926bc9c4453adaf59d627f4d8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e302d879537443cadf6a5fffbe80df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:56.031606 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e644da2c-a059-4cca-84ad-6e60772707a9 tempest-TenantUsagesNegativeTestJSON-1780866975 tempest-TenantUsagesNegativeTestJSON-1780866975-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:50:56.034525 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8d348e72-ff9f-4e27-8db8-40475c5f6639 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:56.035410 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e644da2c-a059-4cca-84ad-6e60772707a9 tempest-TenantUsagesNegativeTestJSON-1780866975 tempest-TenantUsagesNegativeTestJSON-1780866975-project] 10.222.0.46 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-01-14T20%3A50%3A55.661885&end=2022-01-16T20%3A50%3A55.661885&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.174177 Jan 15 20:50:56.042281 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 466/874] 10.222.0.46 () {58 vars in 1334 bytes} [Sat Jan 15 20:50:55 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-01-14T20%3A50%3A55.661885&end=2022-01-16T20%3A50%3A55.661885&detailed=1 => generated 123 bytes in 183 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:50:56.052352 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-2958159a-0d62-4b42-a682-dbcba1ce621b tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:56.054529 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-2958159a-0d62-4b42-a682-dbcba1ce621b tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: e3fa2f27-df7a-4ecb-9bba-c970e3e7d106] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:56.063055 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8d348e72-ff9f-4e27-8db8-40475c5f6639 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:56.064796 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2958159a-0d62-4b42-a682-dbcba1ce621b tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:56.065446 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2958159a-0d62-4b42-a682-dbcba1ce621b tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:56.066473 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2958159a-0d62-4b42-a682-dbcba1ce621b tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:56.067056 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2958159a-0d62-4b42-a682-dbcba1ce621b tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:56.072389 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8d348e72-ff9f-4e27-8db8-40475c5f6639 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:56.072954 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8d348e72-ff9f-4e27-8db8-40475c5f6639 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:56.164491 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-8d348e72-ff9f-4e27-8db8-40475c5f6639 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action" status: 200 len: 32634 microversion: 2.1 time: 0.144099 Jan 15 20:50:56.171963 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 409/875] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:50:56 2022] POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action => generated 32634 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:50:56.182664 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2f3d5670-aa3b-436f-9787-8b42da6e4db7 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:56.219844 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-2f3d5670-aa3b-436f-9787-8b42da6e4db7 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] [instance: 1085522d-3ccc-4de0-b9dd-01c374e1f0ca] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:56.240109 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-2958159a-0d62-4b42-a682-dbcba1ce621b tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:56.248750 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-2958159a-0d62-4b42-a682-dbcba1ce621b tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/e3fa2f27-df7a-4ecb-9bba-c970e3e7d106" status: 200 len: 1462 microversion: 2.1 time: 0.204866 Jan 15 20:50:56.249951 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 467/876] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:56 2022] GET /compute/v2.1/servers/e3fa2f27-df7a-4ecb-9bba-c970e3e7d106 => generated 1462 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:56.258878 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2f3d5670-aa3b-436f-9787-8b42da6e4db7 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:56.259395 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2f3d5670-aa3b-436f-9787-8b42da6e4db7 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:56.261685 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2f3d5670-aa3b-436f-9787-8b42da6e4db7 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:56.263516 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2f3d5670-aa3b-436f-9787-8b42da6e4db7 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:56.267964 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ec8636f3-4a28-4605-b5fa-5047ea1d40e5 tempest-MigrationsAdminTest-1503274595 tempest-MigrationsAdminTest-1503274595-project-admin] Calling method '.version_select at 0x7f30c9246dc0>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:56.269417 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-migrations:index": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:50:56.269417 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:50:56.276607 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ec8636f3-4a28-4605-b5fa-5047ea1d40e5 tempest-MigrationsAdminTest-1503274595 tempest-MigrationsAdminTest-1503274595-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:56.277115 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ec8636f3-4a28-4605-b5fa-5047ea1d40e5 tempest-MigrationsAdminTest-1503274595 tempest-MigrationsAdminTest-1503274595-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:56.309215 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ec8636f3-4a28-4605-b5fa-5047ea1d40e5 tempest-MigrationsAdminTest-1503274595 tempest-MigrationsAdminTest-1503274595-project-admin] 10.222.0.46 "GET /compute/v2.1/os-migrations" status: 200 len: 1568 microversion: 2.1 time: 0.046359 Jan 15 20:50:56.316864 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 468/877] 10.222.0.46 () {58 vars in 1142 bytes} [Sat Jan 15 20:50:56 2022] GET /compute/v2.1/os-migrations => generated 1568 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:50:56.316864 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-3b8c031a-d483-483b-962d-8b4bbee074b2 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:56.328122 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-3b8c031a-d483-483b-962d-8b4bbee074b2 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] [instance: b191ed6c-040a-4702-8e15-86272f9d1847] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:56.334569 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3b8c031a-d483-483b-962d-8b4bbee074b2 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:56.335730 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3b8c031a-d483-483b-962d-8b4bbee074b2 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:56.336691 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3b8c031a-d483-483b-962d-8b4bbee074b2 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:56.338053 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3b8c031a-d483-483b-962d-8b4bbee074b2 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:56.632072 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-2f3d5670-aa3b-436f-9787-8b42da6e4db7 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:56.643742 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-2f3d5670-aa3b-436f-9787-8b42da6e4db7 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:56.645422 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-2f3d5670-aa3b-436f-9787-8b42da6e4db7 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:56.646607 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2f3d5670-aa3b-436f-9787-8b42da6e4db7 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] 10.222.0.46 "GET /compute/v2.1/servers/1085522d-3ccc-4de0-b9dd-01c374e1f0ca" status: 200 len: 1567 microversion: 2.25 time: 0.474871 Jan 15 20:50:56.658267 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 410/878] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:50:56 2022] GET /compute/v2.1/servers/1085522d-3ccc-4de0-b9dd-01c374e1f0ca => generated 1567 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:50:56.658526 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-6676e612-f3ee-48cd-acad-764e6c29e069 tempest-MigrationsAdminTest-1503274595 tempest-MigrationsAdminTest-1503274595-project-admin] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:56.673952 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-6676e612-f3ee-48cd-acad-764e6c29e069 tempest-MigrationsAdminTest-1503274595 tempest-MigrationsAdminTest-1503274595-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.020203 Jan 15 20:50:56.681558 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 411/879] 10.222.0.46 () {58 vars in 1136 bytes} [Sat Jan 15 20:50:56 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:50:56.687560 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-fb52a105-92b3-4aef-9442-89f52f46b276 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:56.688119 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-fb52a105-92b3-4aef-9442-89f52f46b276 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] [instance: c4b0aaad-91ee-4e37-9a34-0b4d56e282d5] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:56.697139 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fb52a105-92b3-4aef-9442-89f52f46b276 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:56.697587 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fb52a105-92b3-4aef-9442-89f52f46b276 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:56.698386 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fb52a105-92b3-4aef-9442-89f52f46b276 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:56.698823 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fb52a105-92b3-4aef-9442-89f52f46b276 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:56.711187 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-3b8c031a-d483-483b-962d-8b4bbee074b2 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d4a57cfaa145009ba9cc8f21d9e8ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4a26c8edac44c8b26fd4e43813412d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:56.727573 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-3b8c031a-d483-483b-962d-8b4bbee074b2 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] 10.222.0.46 "GET /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847" status: 200 len: 1471 microversion: 2.1 time: 0.408773 Jan 15 20:50:56.728363 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 469/880] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:56 2022] GET /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847 => generated 1471 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:56.733125 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-adbf9ace-1fd2-465c-8cfb-331f00681daf tempest-MigrationsAdminTest-1503274595 tempest-MigrationsAdminTest-1503274595-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-109036701", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:50:56.736105 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:50:56.736105 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:50:56.770065 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-adbf9ace-1fd2-465c-8cfb-331f00681daf tempest-MigrationsAdminTest-1503274595 tempest-MigrationsAdminTest-1503274595-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 498 microversion: 2.1 time: 0.040244 Jan 15 20:50:56.770935 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 470/881] 10.222.0.46 () {60 vars in 1145 bytes} [Sat Jan 15 20:50:56 2022] POST /compute/v2.1/flavors => generated 498 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:50:56.780428 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-77fa56b5-a869-4cd7-96b6-5d52af76cc35 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '.version_select at 0x7f30c9289160>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:56.855755 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-77fa56b5-a869-4cd7-96b6-5d52af76cc35 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "GET /compute/v2.1/images/106585ed-7081-4635-b265-1e7bf3b59ff9" status: 200 len: 1413 microversion: 2.1 time: 0.081505 Jan 15 20:50:56.856327 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 471/882] 10.222.0.46 () {58 vars in 1232 bytes} [Sat Jan 15 20:50:56 2022] GET /compute/v2.1/images/106585ed-7081-4635-b265-1e7bf3b59ff9 => generated 1413 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:56.860929 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-90bd3c7d-9e06-4e1b-b880-b99fb86c4ed3 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:56.867088 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-90bd3c7d-9e06-4e1b-b880-b99fb86c4ed3 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] [instance: 69b95b86-744d-4552-a0fc-6ced4d9ef38d] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:56.889577 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-90bd3c7d-9e06-4e1b-b880-b99fb86c4ed3 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:56.890390 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-90bd3c7d-9e06-4e1b-b880-b99fb86c4ed3 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:56.891413 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-90bd3c7d-9e06-4e1b-b880-b99fb86c4ed3 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:56.892031 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-90bd3c7d-9e06-4e1b-b880-b99fb86c4ed3 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:57.070397 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-fb52a105-92b3-4aef-9442-89f52f46b276 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc38f86758f9416b9e7f6915de0359d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8cfe33be708428abef52f5e8e25621b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:57.079282 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-fb52a105-92b3-4aef-9442-89f52f46b276 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] 10.222.0.46 "GET /compute/v2.1/servers/c4b0aaad-91ee-4e37-9a34-0b4d56e282d5" status: 200 len: 1319 microversion: 2.1 time: 0.403742 Jan 15 20:50:57.086154 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 412/883] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:56 2022] GET /compute/v2.1/servers/c4b0aaad-91ee-4e37-9a34-0b4d56e282d5 => generated 1319 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:57.095113 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-afe99b2c-6e00-44c4-bb56-3078d1c75ab8 tempest-MigrationsAdminTest-1503274595 tempest-MigrationsAdminTest-1503274595-project-admin] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:57.128192 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-afe99b2c-6e00-44c4-bb56-3078d1c75ab8 tempest-MigrationsAdminTest-1503274595 tempest-MigrationsAdminTest-1503274595-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.040573 Jan 15 20:50:57.130147 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 413/884] 10.222.0.46 () {58 vars in 1181 bytes} [Sat Jan 15 20:50:57 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 20:50:57.138408 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-21f3cb50-3389-4057-9bc6-3883e9032dda req-a376265d-2127-474e-8854-9606012837d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3fa2f27-df7a-4ecb-9bba-c970e3e7d106", "name": "network-vif-plugged", "status": "completed", "tag": "3c8e5ec9-ee60-4c8e-b5ce-d77245088af1"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:50:57.159473 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:50:57.159473 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:50:57.181847 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-21f3cb50-3389-4057-9bc6-3883e9032dda req-a376265d-2127-474e-8854-9606012837d8 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:57.191762 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-21f3cb50-3389-4057-9bc6-3883e9032dda req-a376265d-2127-474e-8854-9606012837d8 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:57.217806 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-21f3cb50-3389-4057-9bc6-3883e9032dda req-a376265d-2127-474e-8854-9606012837d8 service nova] Creating event network-vif-plugged:3c8e5ec9-ee60-4c8e-b5ce-d77245088af1 for instance e3fa2f27-df7a-4ecb-9bba-c970e3e7d106 on nch1-master-1 Jan 15 20:50:57.223838 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-21f3cb50-3389-4057-9bc6-3883e9032dda req-a376265d-2127-474e-8854-9606012837d8 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091207 Jan 15 20:50:57.225224 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 414/885] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:50:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:50:57.234048 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ae737d63-fd01-4060-872e-00b6f764abc7 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:50:57.237988 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ae737d63-fd01-4060-872e-00b6f764abc7 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 98d0ca37-0175-44e2-8a1d-965cdc517daf] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:57.250376 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ae737d63-fd01-4060-872e-00b6f764abc7 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:57.251403 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ae737d63-fd01-4060-872e-00b6f764abc7 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:57.265667 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ae737d63-fd01-4060-872e-00b6f764abc7 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:57.266088 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ae737d63-fd01-4060-872e-00b6f764abc7 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:57.367883 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ae737d63-fd01-4060-872e-00b6f764abc7 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action" status: 200 len: 32634 microversion: 2.1 time: 0.139314 Jan 15 20:50:57.380735 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 415/886] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:50:57 2022] POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action => generated 32634 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:50:57.384943 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-90bd3c7d-9e06-4e1b-b880-b99fb86c4ed3 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02b23752962428b825b6f7757f54007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f60a2e220b479abf4b04536ed406e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:57.386608 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b439b7e7-e6e3-4671-9639-b978b5719dbb tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-746917179", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "b7625772-7b20-4764-8508-589665228f46"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:50:57.395485 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-90bd3c7d-9e06-4e1b-b880-b99fb86c4ed3 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] 10.222.0.46 "GET /compute/v2.1/servers/69b95b86-744d-4552-a0fc-6ced4d9ef38d" status: 200 len: 1536 microversion: 2.1 time: 0.537943 Jan 15 20:50:57.412442 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 472/887] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:56 2022] GET /compute/v2.1/servers/69b95b86-744d-4552-a0fc-6ced4d9ef38d => generated 1536 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:57.440164 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a3ec0adb-5e26-4e99-b603-4f2a2f916e1a tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Action: 'create', calling method: .version_select at 0x7f30c925ae50>, body: {"pool": "8352f5d9-3635-4bc2-9859-c634bbd8ef52"} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:50:57.475037 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.network.neutron [None req-b439b7e7-e6e3-4671-9639-b978b5719dbb tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] validate_networks() for None {{(pid=129365) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 20:50:58.041947 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-b439b7e7-e6e3-4671-9639-b978b5719dbb tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Flavor limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 20:50:58.042248 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-b439b7e7-e6e3-4671-9639-b978b5719dbb tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Image limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 20:50:58.042904 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-b439b7e7-e6e3-4671-9639-b978b5719dbb tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Flavor pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 20:50:58.043647 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-b439b7e7-e6e3-4671-9639-b978b5719dbb tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Image pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 20:50:58.044307 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-b439b7e7-e6e3-4671-9639-b978b5719dbb tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 20:50:58.059250 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b439b7e7-e6e3-4671-9639-b978b5719dbb tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:58.061944 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b439b7e7-e6e3-4671-9639-b978b5719dbb tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:58.064478 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b439b7e7-e6e3-4671-9639-b978b5719dbb tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:58.065385 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b439b7e7-e6e3-4671-9639-b978b5719dbb tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:58.115242 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-b439b7e7-e6e3-4671-9639-b978b5719dbb tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Getting quotas for project 8e6badf41af14266b626a14241efaf88. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:50:58.125153 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-b439b7e7-e6e3-4671-9639-b978b5719dbb tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Getting quotas for user 9245b10067884c428525283137ca04c6 and project 8e6badf41af14266b626a14241efaf88. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:50:58.150669 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b439b7e7-e6e3-4671-9639-b978b5719dbb tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Going to run 1 instances... {{(pid=129365) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 20:50:58.159731 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b439b7e7-e6e3-4671-9639-b978b5719dbb tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: d603f11b-5d49-492b-b541-1826486876ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129365) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 20:50:58.251719 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b439b7e7-e6e3-4671-9639-b978b5719dbb tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.867648 Jan 15 20:50:58.253161 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 416/888] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 20:50:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 872 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 20:50:58.264194 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-1856a5a3-bad2-4bef-8f62-2187a1a7ca09 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:58.265126 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-1856a5a3-bad2-4bef-8f62-2187a1a7ca09 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] [instance: 1085522d-3ccc-4de0-b9dd-01c374e1f0ca] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:58.278803 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1856a5a3-bad2-4bef-8f62-2187a1a7ca09 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:58.279248 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1856a5a3-bad2-4bef-8f62-2187a1a7ca09 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:58.280042 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1856a5a3-bad2-4bef-8f62-2187a1a7ca09 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:58.280469 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1856a5a3-bad2-4bef-8f62-2187a1a7ca09 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:58.842584 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-1856a5a3-bad2-4bef-8f62-2187a1a7ca09 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:58.852194 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-1856a5a3-bad2-4bef-8f62-2187a1a7ca09 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:58.868734 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-1856a5a3-bad2-4bef-8f62-2187a1a7ca09 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:58.870532 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-1856a5a3-bad2-4bef-8f62-2187a1a7ca09 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] 10.222.0.46 "GET /compute/v2.1/servers/1085522d-3ccc-4de0-b9dd-01c374e1f0ca" status: 200 len: 1542 microversion: 2.25 time: 0.616161 Jan 15 20:50:58.885033 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 417/889] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:50:58 2022] GET /compute/v2.1/servers/1085522d-3ccc-4de0-b9dd-01c374e1f0ca => generated 1542 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:50:58.892517 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f8e0a8ea-e4a5-44a7-a81c-dba4049f5a32 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:58.895595 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f8e0a8ea-e4a5-44a7-a81c-dba4049f5a32 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] [instance: b191ed6c-040a-4702-8e15-86272f9d1847] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:58.915545 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f8e0a8ea-e4a5-44a7-a81c-dba4049f5a32 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:58.916626 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f8e0a8ea-e4a5-44a7-a81c-dba4049f5a32 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:58.924116 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f8e0a8ea-e4a5-44a7-a81c-dba4049f5a32 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:58.925821 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f8e0a8ea-e4a5-44a7-a81c-dba4049f5a32 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:59.202797 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-f8e0a8ea-e4a5-44a7-a81c-dba4049f5a32 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d4a57cfaa145009ba9cc8f21d9e8ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4a26c8edac44c8b26fd4e43813412d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:59.212321 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f8e0a8ea-e4a5-44a7-a81c-dba4049f5a32 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] 10.222.0.46 "GET /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847" status: 200 len: 1471 microversion: 2.1 time: 0.329297 Jan 15 20:50:59.217349 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 418/890] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:58 2022] GET /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847 => generated 1471 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:59.223304 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8c13eb9e-57c3-4381-b0d9-07313f279ffc tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '.version_select at 0x7f30c94eb4c0>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:59.342809 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-8c13eb9e-57c3-4381-b0d9-07313f279ffc tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "GET /compute/v2.1/images/106585ed-7081-4635-b265-1e7bf3b59ff9" status: 200 len: 1413 microversion: 2.1 time: 0.122963 Jan 15 20:50:59.352052 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 419/891] 10.222.0.46 () {58 vars in 1232 bytes} [Sat Jan 15 20:50:59 2022] GET /compute/v2.1/images/106585ed-7081-4635-b265-1e7bf3b59ff9 => generated 1413 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:59.361350 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d19d300f-4e2d-4133-bcbd-1b5ead6b20d8 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:59.364230 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d19d300f-4e2d-4133-bcbd-1b5ead6b20d8 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] [instance: c4b0aaad-91ee-4e37-9a34-0b4d56e282d5] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:59.376998 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d19d300f-4e2d-4133-bcbd-1b5ead6b20d8 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:59.379857 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d19d300f-4e2d-4133-bcbd-1b5ead6b20d8 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:59.386145 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d19d300f-4e2d-4133-bcbd-1b5ead6b20d8 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:59.386614 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d19d300f-4e2d-4133-bcbd-1b5ead6b20d8 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:59.750543 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-d19d300f-4e2d-4133-bcbd-1b5ead6b20d8 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc38f86758f9416b9e7f6915de0359d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8cfe33be708428abef52f5e8e25621b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:59.759723 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d19d300f-4e2d-4133-bcbd-1b5ead6b20d8 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] 10.222.0.46 "GET /compute/v2.1/servers/c4b0aaad-91ee-4e37-9a34-0b4d56e282d5" status: 200 len: 1319 microversion: 2.1 time: 0.406165 Jan 15 20:50:59.771496 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 420/892] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:59 2022] GET /compute/v2.1/servers/c4b0aaad-91ee-4e37-9a34-0b4d56e282d5 => generated 1319 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:59.782457 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-439fc712-61c5-4249-bbad-24602df8baa8 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:59.783782 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-439fc712-61c5-4249-bbad-24602df8baa8 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: d603f11b-5d49-492b-b541-1826486876ef] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:59.787157 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a3ec0adb-5e26-4e99-b603-4f2a2f916e1a tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] 10.222.0.46 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.365705 Jan 15 20:50:59.787788 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 473/893] 10.222.0.46 () {60 vars in 1169 bytes} [Sat Jan 15 20:50:57 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2374 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:50:59.795090 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-cf79414b-a020-40a2-878f-33ae524248cb tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:50:59.796402 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-cf79414b-a020-40a2-878f-33ae524248cb tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 98d0ca37-0175-44e2-8a1d-965cdc517daf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:59.798597 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-439fc712-61c5-4249-bbad-24602df8baa8 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:59.799304 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-439fc712-61c5-4249-bbad-24602df8baa8 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:59.800377 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-439fc712-61c5-4249-bbad-24602df8baa8 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:59.801101 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-439fc712-61c5-4249-bbad-24602df8baa8 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:59.814951 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cf79414b-a020-40a2-878f-33ae524248cb tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:59.815596 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cf79414b-a020-40a2-878f-33ae524248cb tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:59.816407 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cf79414b-a020-40a2-878f-33ae524248cb tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:59.817092 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cf79414b-a020-40a2-878f-33ae524248cb tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:59.874798 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-439fc712-61c5-4249-bbad-24602df8baa8 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:50:59.883404 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-439fc712-61c5-4249-bbad-24602df8baa8 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/d603f11b-5d49-492b-b541-1826486876ef" status: 200 len: 1330 microversion: 2.1 time: 0.110453 Jan 15 20:50:59.913324 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-cf79414b-a020-40a2-878f-33ae524248cb tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action" status: 200 len: 40780 microversion: 2.1 time: 0.122603 Jan 15 20:50:59.914744 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 474/894] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:50:59 2022] POST /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf/action => generated 40780 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:50:59.916944 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 421/895] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:50:59 2022] GET /compute/v2.1/servers/d603f11b-5d49-492b-b541-1826486876ef => generated 1330 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:50:59.923009 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-5feb0b07-3cf2-4c81-940a-459c92995382 tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Calling method '.version_select at 0x7f30c92469d0>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:50:59.924532 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-migrations:index": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:50:59.924532 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:50:59.926112 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5feb0b07-3cf2-4c81-940a-459c92995382 tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:59.926787 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5feb0b07-3cf2-4c81-940a-459c92995382 tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:59.929881 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-63b2be48-8fd7-47b8-b893-31eac8a73b3a req-082c1578-c57f-4fa7-a67f-e541aff960d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecba885c-f344-480e-9efc-707d1c542d42", "name": "network-vif-plugged", "status": "completed", "tag": "6896d9fc-c7c9-4e4b-8bf1-aaae0b89dd3f"}, {"server_uuid": "c4b0aaad-91ee-4e37-9a34-0b4d56e282d5", "name": "network-vif-plugged", "status": "completed", "tag": "b044e748-14c3-4e19-b93b-659f2cfe547b"}, {"server_uuid": "c0916b98-698b-448b-9b06-95791cbf533c", "name": "network-vif-plugged", "status": "completed", "tag": "4fe1e733-915f-402a-bdcb-042d55337395"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:50:59.940604 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-5feb0b07-3cf2-4c81-940a-459c92995382 tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] 10.222.0.46 "GET /compute/v2.1/os-migrations" status: 200 len: 1701 microversion: 2.25 time: 0.023937 Jan 15 20:50:59.941280 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 475/896] 10.222.0.46 () {60 vars in 1183 bytes} [Sat Jan 15 20:50:59 2022] GET /compute/v2.1/os-migrations => generated 1701 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:50:59.954827 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-3402ff9f-79c8-4bc1-bbe1-402e49d91c83 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Action: 'action', calling method: .version_select at 0x7f30cba25820>, body: {"addFloatingIp": {"address": "172.35.1.107"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:50:59.955087 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:50:59.955087 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:50:59.956038 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-3402ff9f-79c8-4bc1-bbe1-402e49d91c83 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] [instance: 69b95b86-744d-4552-a0fc-6ced4d9ef38d] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:50:59.966816 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3402ff9f-79c8-4bc1-bbe1-402e49d91c83 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:59.967270 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3402ff9f-79c8-4bc1-bbe1-402e49d91c83 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:59.968084 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3402ff9f-79c8-4bc1-bbe1-402e49d91c83 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:59.968763 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3402ff9f-79c8-4bc1-bbe1-402e49d91c83 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:50:59.973809 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-63b2be48-8fd7-47b8-b893-31eac8a73b3a req-082c1578-c57f-4fa7-a67f-e541aff960d9 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:50:59.974852 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-63b2be48-8fd7-47b8-b893-31eac8a73b3a req-082c1578-c57f-4fa7-a67f-e541aff960d9 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:00.001859 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-63b2be48-8fd7-47b8-b893-31eac8a73b3a req-082c1578-c57f-4fa7-a67f-e541aff960d9 service nova] Creating event network-vif-plugged:6896d9fc-c7c9-4e4b-8bf1-aaae0b89dd3f for instance ecba885c-f344-480e-9efc-707d1c542d42 on nch1-master-1 Jan 15 20:51:00.005643 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-63b2be48-8fd7-47b8-b893-31eac8a73b3a req-082c1578-c57f-4fa7-a67f-e541aff960d9 service nova] Creating event network-vif-plugged:b044e748-14c3-4e19-b93b-659f2cfe547b for instance c4b0aaad-91ee-4e37-9a34-0b4d56e282d5 on nch2-master-1 Jan 15 20:51:00.006502 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-63b2be48-8fd7-47b8-b893-31eac8a73b3a req-082c1578-c57f-4fa7-a67f-e541aff960d9 service nova] Creating event network-vif-plugged:4fe1e733-915f-402a-bdcb-042d55337395 for instance c0916b98-698b-448b-9b06-95791cbf533c on nch1-master-1 Jan 15 20:51:00.036277 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-63b2be48-8fd7-47b8-b893-31eac8a73b3a req-082c1578-c57f-4fa7-a67f-e541aff960d9 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.112957 Jan 15 20:51:00.040088 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 422/897] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:50:59 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:51:00.075834 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-7bd2ff58-34e4-465f-bc11-aa6dc832665f tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:00.076619 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-7bd2ff58-34e4-465f-bc11-aa6dc832665f tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 98d0ca37-0175-44e2-8a1d-965cdc517daf] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:00.087035 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7bd2ff58-34e4-465f-bc11-aa6dc832665f tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:00.089977 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7bd2ff58-34e4-465f-bc11-aa6dc832665f tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:00.091607 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7bd2ff58-34e4-465f-bc11-aa6dc832665f tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:00.092067 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7bd2ff58-34e4-465f-bc11-aa6dc832665f tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:00.111376 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3402ff9f-79c8-4bc1-bbe1-402e49d91c83 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Acquired lock "refresh_cache-69b95b86-744d-4552-a0fc-6ced4d9ef38d" {{(pid=129366) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jan 15 20:51:00.935533 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-7bd2ff58-34e4-465f-bc11-aa6dc832665f tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d60caf368842b2aec08f0f5e14353a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c95e4b5695439dbc3f66a911264026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:00.952533 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-7bd2ff58-34e4-465f-bc11-aa6dc832665f tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "GET /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf" status: 200 len: 1707 microversion: 2.1 time: 0.908822 Jan 15 20:51:00.954357 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 423/898] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:00 2022] GET /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf => generated 1707 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:00.963205 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e9b1ae65-23fc-444c-b67e-09707e94969c tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:00.964220 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e9b1ae65-23fc-444c-b67e-09707e94969c tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] [instance: 1085522d-3ccc-4de0-b9dd-01c374e1f0ca] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:00.978687 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e9b1ae65-23fc-444c-b67e-09707e94969c tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:00.979531 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e9b1ae65-23fc-444c-b67e-09707e94969c tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:00.980726 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e9b1ae65-23fc-444c-b67e-09707e94969c tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:00.981403 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e9b1ae65-23fc-444c-b67e-09707e94969c tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:01.839845 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.objects.instance [None req-e9b1ae65-23fc-444c-b67e-09707e94969c tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Lazy-loading 'services' on Instance uuid 1085522d-3ccc-4de0-b9dd-01c374e1f0ca {{(pid=129365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 20:51:01.867155 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e9b1ae65-23fc-444c-b67e-09707e94969c tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/1085522d-3ccc-4de0-b9dd-01c374e1f0ca" status: 200 len: 2035 microversion: 2.25 time: 0.911040 Jan 15 20:51:01.867976 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 424/899] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:51:00 2022] GET /compute/v2.1/servers/1085522d-3ccc-4de0-b9dd-01c374e1f0ca => generated 2035 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:51:01.879341 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-481d7b28-7e33-44ac-8ed7-7757f3546dff tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:01.879780 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-481d7b28-7e33-44ac-8ed7-7757f3546dff tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] [instance: b191ed6c-040a-4702-8e15-86272f9d1847] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:01.894645 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-481d7b28-7e33-44ac-8ed7-7757f3546dff tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:01.899084 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-481d7b28-7e33-44ac-8ed7-7757f3546dff tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:01.900611 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-481d7b28-7e33-44ac-8ed7-7757f3546dff tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:01.902625 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-481d7b28-7e33-44ac-8ed7-7757f3546dff tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:02.588675 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-481d7b28-7e33-44ac-8ed7-7757f3546dff tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d4a57cfaa145009ba9cc8f21d9e8ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4a26c8edac44c8b26fd4e43813412d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:02.605238 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-481d7b28-7e33-44ac-8ed7-7757f3546dff tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] 10.222.0.46 "GET /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847" status: 200 len: 1471 microversion: 2.1 time: 0.736312 Jan 15 20:51:02.615807 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 425/900] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:01 2022] GET /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847 => generated 1471 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:02.633033 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-377f434f-1f30-4b35-9b3a-62df5a12eb8a tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '.version_select at 0x7f30c913b5e0>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:02.753836 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-377f434f-1f30-4b35-9b3a-62df5a12eb8a tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "GET /compute/v2.1/images/106585ed-7081-4635-b265-1e7bf3b59ff9" status: 200 len: 1413 microversion: 2.1 time: 0.136693 Jan 15 20:51:02.759602 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 426/901] 10.222.0.46 () {58 vars in 1232 bytes} [Sat Jan 15 20:51:02 2022] GET /compute/v2.1/images/106585ed-7081-4635-b265-1e7bf3b59ff9 => generated 1413 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:02.764776 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a4d370b6-82b7-4828-a71d-b1f1dec64281 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:02.766195 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a4d370b6-82b7-4828-a71d-b1f1dec64281 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] [instance: c4b0aaad-91ee-4e37-9a34-0b4d56e282d5] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:02.774505 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a4d370b6-82b7-4828-a71d-b1f1dec64281 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:02.775186 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a4d370b6-82b7-4828-a71d-b1f1dec64281 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:02.776271 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a4d370b6-82b7-4828-a71d-b1f1dec64281 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:02.776719 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a4d370b6-82b7-4828-a71d-b1f1dec64281 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:03.323988 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-a4d370b6-82b7-4828-a71d-b1f1dec64281 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc38f86758f9416b9e7f6915de0359d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8cfe33be708428abef52f5e8e25621b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:03.335561 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a4d370b6-82b7-4828-a71d-b1f1dec64281 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] 10.222.0.46 "GET /compute/v2.1/servers/c4b0aaad-91ee-4e37-9a34-0b4d56e282d5" status: 200 len: 1469 microversion: 2.1 time: 0.579130 Jan 15 20:51:03.353202 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 427/902] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:02 2022] GET /compute/v2.1/servers/c4b0aaad-91ee-4e37-9a34-0b4d56e282d5 => generated 1469 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:03.358070 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-69d2a43b-65f0-4eb6-a6d4-b5196e8de362 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:03.358872 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-69d2a43b-65f0-4eb6-a6d4-b5196e8de362 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: d603f11b-5d49-492b-b541-1826486876ef] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:03.367776 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-69d2a43b-65f0-4eb6-a6d4-b5196e8de362 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:03.368506 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-69d2a43b-65f0-4eb6-a6d4-b5196e8de362 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:03.369782 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-69d2a43b-65f0-4eb6-a6d4-b5196e8de362 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:03.372151 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-69d2a43b-65f0-4eb6-a6d4-b5196e8de362 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:03.661406 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-69d2a43b-65f0-4eb6-a6d4-b5196e8de362 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:03.663250 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.network.neutron [None req-3402ff9f-79c8-4bc1-bbe1-402e49d91c83 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] [instance: 69b95b86-744d-4552-a0fc-6ced4d9ef38d] Building network info cache for instance {{(pid=129366) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1883}} Jan 15 20:51:03.674857 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-69d2a43b-65f0-4eb6-a6d4-b5196e8de362 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/d603f11b-5d49-492b-b541-1826486876ef" status: 200 len: 1378 microversion: 2.1 time: 0.320258 Jan 15 20:51:03.678359 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 428/903] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:03 2022] GET /compute/v2.1/servers/d603f11b-5d49-492b-b541-1826486876ef => generated 1378 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:03.684689 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-7904faa4-ed22-4241-90a6-add0124eb748 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:03.687146 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-7904faa4-ed22-4241-90a6-add0124eb748 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 98d0ca37-0175-44e2-8a1d-965cdc517daf] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:03.702678 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7904faa4-ed22-4241-90a6-add0124eb748 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:03.710795 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7904faa4-ed22-4241-90a6-add0124eb748 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:03.711916 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7904faa4-ed22-4241-90a6-add0124eb748 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:03.712526 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7904faa4-ed22-4241-90a6-add0124eb748 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:03.765423 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-7904faa4-ed22-4241-90a6-add0124eb748 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 98d0ca37-0175-44e2-8a1d-965cdc517daf] Going to try to terminate instance {{(pid=129365) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 20:51:03.924405 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-7904faa4-ed22-4241-90a6-add0124eb748 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "DELETE /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf" status: 204 len: 0 microversion: 2.1 time: 0.243171 Jan 15 20:51:03.925229 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 429/904] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 20:51:03 2022] DELETE /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 20:51:03.930293 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-51725038-3b32-414e-acbb-a93b0d58b07c tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-2009377633", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "networks": [{"uuid": "3ee7d78d-61a7-4a1d-ba2d-976bd0bf9fe2"}]}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:51:04.051324 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.network.neutron [None req-51725038-3b32-414e-acbb-a93b0d58b07c tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] validate_networks() for [('3ee7d78d-61a7-4a1d-ba2d-976bd0bf9fe2', None, None, None, None, None)] {{(pid=129365) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 20:51:05.399028 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.network.neutron [None req-3402ff9f-79c8-4bc1-bbe1-402e49d91c83 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] [instance: 69b95b86-744d-4552-a0fc-6ced4d9ef38d] Updating instance_info_cache with network_info: [{"id": "66fcf159-d8ef-45e6-9c7c-4dba94d06566", "address": "fa:16:3e:6b:3d:6d", "network": {"id": "1ddf3f52-4b62-4e63-a9e4-50ec9015529c", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1083503271-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.1.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "63f60a2e220b479abf4b04536ed406e9", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap66fcf159-d8", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=129366) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jan 15 20:51:05.424973 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3402ff9f-79c8-4bc1-bbe1-402e49d91c83 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Releasing lock "refresh_cache-69b95b86-744d-4552-a0fc-6ced4d9ef38d" {{(pid=129366) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jan 15 20:51:05.431200 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-3402ff9f-79c8-4bc1-bbe1-402e49d91c83 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] 10.222.0.46 "POST /compute/v2.1/servers/69b95b86-744d-4552-a0fc-6ced4d9ef38d/action" status: 202 len: 0 microversion: 2.1 time: 5.478667 Jan 15 20:51:05.439910 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 476/905] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:50:59 2022] POST /compute/v2.1/servers/69b95b86-744d-4552-a0fc-6ced4d9ef38d/action => generated 0 bytes in 5490 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jan 15 20:51:05.449063 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-95c0195e-13fa-4eb6-8203-7d8cb890da70 req-95d8ef74-437e-4d29-bb6d-a59a9ced9efa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d603f11b-5d49-492b-b541-1826486876ef", "tag": "29144689-f6e8-49ab-886d-3bedd21d555f"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:51:05.454540 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:51:05.454540 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:51:05.465513 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-51725038-3b32-414e-acbb-a93b0d58b07c tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Flavor limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 20:51:05.466097 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-51725038-3b32-414e-acbb-a93b0d58b07c tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Image limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 20:51:05.466775 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-51725038-3b32-414e-acbb-a93b0d58b07c tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Flavor pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 20:51:05.467625 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-51725038-3b32-414e-acbb-a93b0d58b07c tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Image pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 20:51:05.468232 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-51725038-3b32-414e-acbb-a93b0d58b07c tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 20:51:05.497569 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-95c0195e-13fa-4eb6-8203-7d8cb890da70 req-95d8ef74-437e-4d29-bb6d-a59a9ced9efa service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:05.499790 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-95c0195e-13fa-4eb6-8203-7d8cb890da70 req-95d8ef74-437e-4d29-bb6d-a59a9ced9efa service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:05.504128 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-51725038-3b32-414e-acbb-a93b0d58b07c tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:05.511830 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-51725038-3b32-414e-acbb-a93b0d58b07c tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:05.514408 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-51725038-3b32-414e-acbb-a93b0d58b07c tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:05.515230 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-51725038-3b32-414e-acbb-a93b0d58b07c tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:05.526322 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-95c0195e-13fa-4eb6-8203-7d8cb890da70 req-95d8ef74-437e-4d29-bb6d-a59a9ced9efa service nova] Creating event network-changed:29144689-f6e8-49ab-886d-3bedd21d555f for instance d603f11b-5d49-492b-b541-1826486876ef on nch1-master-1 Jan 15 20:51:05.532763 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-95c0195e-13fa-4eb6-8203-7d8cb890da70 req-95d8ef74-437e-4d29-bb6d-a59a9ced9efa service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090713 Jan 15 20:51:05.555018 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-51725038-3b32-414e-acbb-a93b0d58b07c tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Getting quotas for project c3ede5f7e26d484fb1c6f18819a90e3f. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:51:05.577651 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 477/906] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:51:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:51:05.591397 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-51725038-3b32-414e-acbb-a93b0d58b07c tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Getting quotas for user a15f22e0573c4433b35a46c5245e30f9 and project c3ede5f7e26d484fb1c6f18819a90e3f. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:51:05.599384 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e54a6774-6041-49db-9dfd-212812774cb2 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:05.604069 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e54a6774-6041-49db-9dfd-212812774cb2 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] [instance: c0916b98-698b-448b-9b06-95791cbf533c] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:05.633702 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-51725038-3b32-414e-acbb-a93b0d58b07c tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Going to run 1 instances... {{(pid=129365) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 20:51:05.636207 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-51725038-3b32-414e-acbb-a93b0d58b07c tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] [instance: 42618a48-fe11-4f55-bed2-738d2cc8a07f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129365) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 20:51:05.648478 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e54a6774-6041-49db-9dfd-212812774cb2 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:05.648957 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e54a6774-6041-49db-9dfd-212812774cb2 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:05.649771 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e54a6774-6041-49db-9dfd-212812774cb2 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:05.650211 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e54a6774-6041-49db-9dfd-212812774cb2 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:05.736183 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-51725038-3b32-414e-acbb-a93b0d58b07c tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.809901 Jan 15 20:51:05.745313 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 430/907] 10.222.0.46 () {62 vars in 1187 bytes} [Sat Jan 15 20:51:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1820 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jan 15 20:51:05.750692 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5d1bbe4a-2e73-4cb0-aab3-0adec6086b70 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:05.751239 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-5d1bbe4a-2e73-4cb0-aab3-0adec6086b70 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] [instance: b191ed6c-040a-4702-8e15-86272f9d1847] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:05.799098 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5d1bbe4a-2e73-4cb0-aab3-0adec6086b70 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:05.799553 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5d1bbe4a-2e73-4cb0-aab3-0adec6086b70 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:05.800403 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5d1bbe4a-2e73-4cb0-aab3-0adec6086b70 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:05.800867 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5d1bbe4a-2e73-4cb0-aab3-0adec6086b70 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:06.070210 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-e54a6774-6041-49db-9dfd-212812774cb2 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc38f86758f9416b9e7f6915de0359d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8cfe33be708428abef52f5e8e25621b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:06.085722 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e54a6774-6041-49db-9dfd-212812774cb2 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] 10.222.0.46 "GET /compute/v2.1/servers/c0916b98-698b-448b-9b06-95791cbf533c" status: 200 len: 1468 microversion: 2.1 time: 0.494352 Jan 15 20:51:06.087879 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 478/908] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:05 2022] GET /compute/v2.1/servers/c0916b98-698b-448b-9b06-95791cbf533c => generated 1468 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:06.099528 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-308b4203-477e-4360-9aa7-0f07355f78ca req-c8e1c4a3-abe6-4c7e-8a14-8274afa297d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69b95b86-744d-4552-a0fc-6ced4d9ef38d", "tag": "66fcf159-d8ef-45e6-9c7c-4dba94d06566"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:51:06.105108 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:51:06.105108 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:51:06.127831 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-308b4203-477e-4360-9aa7-0f07355f78ca req-c8e1c4a3-abe6-4c7e-8a14-8274afa297d4 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:06.128276 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-308b4203-477e-4360-9aa7-0f07355f78ca req-c8e1c4a3-abe6-4c7e-8a14-8274afa297d4 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:06.153383 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-308b4203-477e-4360-9aa7-0f07355f78ca req-c8e1c4a3-abe6-4c7e-8a14-8274afa297d4 service nova] Creating event network-changed:66fcf159-d8ef-45e6-9c7c-4dba94d06566 for instance 69b95b86-744d-4552-a0fc-6ced4d9ef38d on nch2-master-1 Jan 15 20:51:06.170941 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-308b4203-477e-4360-9aa7-0f07355f78ca req-c8e1c4a3-abe6-4c7e-8a14-8274afa297d4 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081600 Jan 15 20:51:06.189118 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 479/909] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:51:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:51:06.203132 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-98486088-951b-4fa7-82eb-0fe93b38ae7e tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '.version_select at 0x7f30c91a6c10>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:06.247296 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-5d1bbe4a-2e73-4cb0-aab3-0adec6086b70 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d4a57cfaa145009ba9cc8f21d9e8ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4a26c8edac44c8b26fd4e43813412d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:06.255241 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5d1bbe4a-2e73-4cb0-aab3-0adec6086b70 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] 10.222.0.46 "GET /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847" status: 200 len: 1477 microversion: 2.1 time: 0.508684 Jan 15 20:51:06.258443 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 431/910] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:05 2022] GET /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847 => generated 1477 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:06.279486 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9230835f-53e8-45de-be4f-c1693ca02cda tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1972971856", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "1777501818", "adminPass": "***", "networks": [{"uuid": "f500117d-1a95-41f2-bf61-8c0369c6db83"}], "security_groups": [{"name": "tempest-securitygroup--1648149025"}], "key_name": "tempest-keypair-2097977498", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:51:06.287253 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-98486088-951b-4fa7-82eb-0fe93b38ae7e tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "GET /compute/v2.1/images/106585ed-7081-4635-b265-1e7bf3b59ff9" status: 200 len: 1413 microversion: 2.1 time: 0.096156 Jan 15 20:51:06.288730 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 480/911] 10.222.0.46 () {58 vars in 1232 bytes} [Sat Jan 15 20:51:06 2022] GET /compute/v2.1/images/106585ed-7081-4635-b265-1e7bf3b59ff9 => generated 1413 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:06.301213 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e57724ec-ef71-4580-81f5-d907e0f777a6 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:06.302181 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e57724ec-ef71-4580-81f5-d907e0f777a6 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: d603f11b-5d49-492b-b541-1826486876ef] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:06.348244 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e57724ec-ef71-4580-81f5-d907e0f777a6 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:06.349610 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e57724ec-ef71-4580-81f5-d907e0f777a6 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:06.351294 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e57724ec-ef71-4580-81f5-d907e0f777a6 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:06.352132 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e57724ec-ef71-4580-81f5-d907e0f777a6 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:06.590915 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.network.neutron [None req-9230835f-53e8-45de-be4f-c1693ca02cda tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] validate_networks() for [('f500117d-1a95-41f2-bf61-8c0369c6db83', None, None, None, None, None)] {{(pid=129365) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 20:51:07.075690 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-e57724ec-ef71-4580-81f5-d907e0f777a6 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:07.090201 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e57724ec-ef71-4580-81f5-d907e0f777a6 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/d603f11b-5d49-492b-b541-1826486876ef" status: 200 len: 1378 microversion: 2.1 time: 0.791829 Jan 15 20:51:07.090817 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 481/912] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:06 2022] GET /compute/v2.1/servers/d603f11b-5d49-492b-b541-1826486876ef => generated 1378 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:07.116793 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9d7854af-691b-43d2-8ec3-e266602fa1ae tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Action: 'create', calling method: .version_select at 0x7f30c9191040>, body: {"pool": "8352f5d9-3635-4bc2-9859-c634bbd8ef52"} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:51:07.531102 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-9230835f-53e8-45de-be4f-c1693ca02cda tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Flavor limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 20:51:07.531781 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-9230835f-53e8-45de-be4f-c1693ca02cda tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Image limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 20:51:07.532469 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-9230835f-53e8-45de-be4f-c1693ca02cda tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Flavor pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 20:51:07.533327 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-9230835f-53e8-45de-be4f-c1693ca02cda tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Image pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 20:51:07.534112 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-9230835f-53e8-45de-be4f-c1693ca02cda tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 20:51:07.558022 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9230835f-53e8-45de-be4f-c1693ca02cda tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:07.559021 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9230835f-53e8-45de-be4f-c1693ca02cda tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:07.561976 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9230835f-53e8-45de-be4f-c1693ca02cda tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:07.564830 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9230835f-53e8-45de-be4f-c1693ca02cda tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:07.630824 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-9230835f-53e8-45de-be4f-c1693ca02cda tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Getting quotas for project 71c95e4b5695439dbc3f66a911264026. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:51:07.649354 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-9230835f-53e8-45de-be4f-c1693ca02cda tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Getting quotas for user 19d60caf368842b2aec08f0f5e14353a and project 71c95e4b5695439dbc3f66a911264026. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:51:07.673509 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-9230835f-53e8-45de-be4f-c1693ca02cda tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Going to run 1 instances... {{(pid=129365) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 20:51:07.679330 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-9230835f-53e8-45de-be4f-c1693ca02cda tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 57bd310f-a604-40de-9c25-882284f4a17b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=129365) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 20:51:07.797136 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-9230835f-53e8-45de-be4f-c1693ca02cda tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.537494 Jan 15 20:51:07.807379 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 432/913] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 20:51:06 2022] POST /compute/v2.1/servers => generated 402 bytes in 1548 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 20:51:07.812079 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5566c5a7-a719-4da4-bed7-72255f5591e1 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:07.812695 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-5566c5a7-a719-4da4-bed7-72255f5591e1 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] [instance: 42618a48-fe11-4f55-bed2-738d2cc8a07f] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:07.836545 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5566c5a7-a719-4da4-bed7-72255f5591e1 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:07.837039 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5566c5a7-a719-4da4-bed7-72255f5591e1 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:07.837859 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5566c5a7-a719-4da4-bed7-72255f5591e1 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:07.838300 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5566c5a7-a719-4da4-bed7-72255f5591e1 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:08.461634 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-5566c5a7-a719-4da4-bed7-72255f5591e1 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:08.478423 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-5566c5a7-a719-4da4-bed7-72255f5591e1 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:08.485224 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-5566c5a7-a719-4da4-bed7-72255f5591e1 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:08.494691 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5566c5a7-a719-4da4-bed7-72255f5591e1 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] 10.222.0.46 "GET /compute/v2.1/servers/42618a48-fe11-4f55-bed2-738d2cc8a07f" status: 200 len: 1322 microversion: 2.25 time: 0.682189 Jan 15 20:51:08.496518 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 433/914] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:51:07 2022] GET /compute/v2.1/servers/42618a48-fe11-4f55-bed2-738d2cc8a07f => generated 1322 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:51:08.508882 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-183afd9a-79d6-4a09-b713-f00549e43a95 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:08.530355 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:51:08.530355 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:51:08.535300 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-183afd9a-79d6-4a09-b713-f00549e43a95 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bc38f86758f9416b9e7f6915de0359d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8cfe33be708428abef52f5e8e25621b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:08.540712 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-183afd9a-79d6-4a09-b713-f00549e43a95 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Searching by: {'reservation_id': 'r-6obvlrui', 'deleted': False, 'project_id': 'e8cfe33be708428abef52f5e8e25621b'} {{(pid=129365) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 15 20:51:08.559246 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-183afd9a-79d6-4a09-b713-f00549e43a95 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:08.559740 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-183afd9a-79d6-4a09-b713-f00549e43a95 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:08.560629 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-183afd9a-79d6-4a09-b713-f00549e43a95 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:08.561106 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-183afd9a-79d6-4a09-b713-f00549e43a95 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:08.813960 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.multi_cell_list [None req-183afd9a-79d6-4a09-b713-f00549e43a95 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=129365) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jan 15 20:51:08.931250 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-183afd9a-79d6-4a09-b713-f00549e43a95 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc38f86758f9416b9e7f6915de0359d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8cfe33be708428abef52f5e8e25621b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:08.938571 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-183afd9a-79d6-4a09-b713-f00549e43a95 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:08.939246 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-183afd9a-79d6-4a09-b713-f00549e43a95 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:09.555533 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-183afd9a-79d6-4a09-b713-f00549e43a95 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] 10.222.0.46 "GET /compute/v2.1/servers/detail?reservation_id=r-6obvlrui" status: 200 len: 2930 microversion: 2.1 time: 1.055290 Jan 15 20:51:09.556718 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 434/915] 10.222.0.46 () {58 vars in 1196 bytes} [Sat Jan 15 20:51:08 2022] GET /compute/v2.1/servers/detail?reservation_id=r-6obvlrui => generated 2930 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:09.562378 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-2fa855f5-080b-425c-9897-d228b2daa1b1 req-a5435f6b-5b23-403d-a28a-0ab51a404fdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b191ed6c-040a-4702-8e15-86272f9d1847", "name": "network-vif-unplugged", "status": "completed", "tag": "bbe8394e-08fc-445b-a162-0e40259702ca"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:51:09.564084 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:51:09.564084 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:51:09.579207 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-2fa855f5-080b-425c-9897-d228b2daa1b1 req-a5435f6b-5b23-403d-a28a-0ab51a404fdc service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:09.581821 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-2fa855f5-080b-425c-9897-d228b2daa1b1 req-a5435f6b-5b23-403d-a28a-0ab51a404fdc service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:09.610554 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-2fa855f5-080b-425c-9897-d228b2daa1b1 req-a5435f6b-5b23-403d-a28a-0ab51a404fdc service nova] Creating event network-vif-unplugged:bbe8394e-08fc-445b-a162-0e40259702ca for instance b191ed6c-040a-4702-8e15-86272f9d1847 on nch2-master-1 Jan 15 20:51:09.626711 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-2fa855f5-080b-425c-9897-d228b2daa1b1 req-a5435f6b-5b23-403d-a28a-0ab51a404fdc service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.068501 Jan 15 20:51:09.627324 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 435/916] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:51:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:51:09.639139 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e9db386b-c023-4050-a00b-dd5f2a6448fb tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:09.639833 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e9db386b-c023-4050-a00b-dd5f2a6448fb tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] [instance: b191ed6c-040a-4702-8e15-86272f9d1847] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:09.664878 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e9db386b-c023-4050-a00b-dd5f2a6448fb tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:09.665330 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e9db386b-c023-4050-a00b-dd5f2a6448fb tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:09.666127 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e9db386b-c023-4050-a00b-dd5f2a6448fb tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:09.666608 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e9db386b-c023-4050-a00b-dd5f2a6448fb tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:09.758798 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-9d7854af-691b-43d2-8ec3-e266602fa1ae tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] 10.222.0.46 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.650320 Jan 15 20:51:09.760417 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 482/917] 10.222.0.46 () {60 vars in 1169 bytes} [Sat Jan 15 20:51:07 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2652 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:51:09.770752 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a9fc2b75-d11e-4a8e-8fc5-b22ba405f657 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '.version_select at 0x7f30c9246790>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:09.844550 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a9fc2b75-d11e-4a8e-8fc5-b22ba405f657 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "GET /compute/v2.1/images/106585ed-7081-4635-b265-1e7bf3b59ff9" status: 200 len: 1413 microversion: 2.1 time: 0.082696 Jan 15 20:51:09.845396 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 483/918] 10.222.0.46 () {58 vars in 1232 bytes} [Sat Jan 15 20:51:09 2022] GET /compute/v2.1/images/106585ed-7081-4635-b265-1e7bf3b59ff9 => generated 1413 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:09.855510 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-5cf98ad7-62fc-4fdc-a3a5-56d91a681978 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:09.858405 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-5cf98ad7-62fc-4fdc-a3a5-56d91a681978 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 57bd310f-a604-40de-9c25-882284f4a17b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:09.866027 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5cf98ad7-62fc-4fdc-a3a5-56d91a681978 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:09.867227 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5cf98ad7-62fc-4fdc-a3a5-56d91a681978 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:09.868050 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5cf98ad7-62fc-4fdc-a3a5-56d91a681978 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:09.868491 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5cf98ad7-62fc-4fdc-a3a5-56d91a681978 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:10.020054 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-5cf98ad7-62fc-4fdc-a3a5-56d91a681978 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d60caf368842b2aec08f0f5e14353a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c95e4b5695439dbc3f66a911264026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:10.042002 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-5cf98ad7-62fc-4fdc-a3a5-56d91a681978 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "GET /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b" status: 200 len: 1335 microversion: 2.1 time: 0.190004 Jan 15 20:51:10.055587 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 484/919] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:09 2022] GET /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b => generated 1335 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:10.061242 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f0b85a4d-33c5-453c-a944-6d71c6bfba03 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:10.062838 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f0b85a4d-33c5-453c-a944-6d71c6bfba03 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: d603f11b-5d49-492b-b541-1826486876ef] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:10.090595 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f0b85a4d-33c5-453c-a944-6d71c6bfba03 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:10.093069 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f0b85a4d-33c5-453c-a944-6d71c6bfba03 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:10.095682 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f0b85a4d-33c5-453c-a944-6d71c6bfba03 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:10.096294 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f0b85a4d-33c5-453c-a944-6d71c6bfba03 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:10.118118 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-e9db386b-c023-4050-a00b-dd5f2a6448fb tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d4a57cfaa145009ba9cc8f21d9e8ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4a26c8edac44c8b26fd4e43813412d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:10.126303 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e9db386b-c023-4050-a00b-dd5f2a6448fb tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] 10.222.0.46 "GET /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847" status: 200 len: 1477 microversion: 2.1 time: 0.491056 Jan 15 20:51:10.136217 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 436/920] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:09 2022] GET /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847 => generated 1477 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:10.145225 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-1ba2f027-df71-4178-9661-61fae28dd999 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:10.145827 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-1ba2f027-df71-4178-9661-61fae28dd999 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] [instance: 42618a48-fe11-4f55-bed2-738d2cc8a07f] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:10.170253 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1ba2f027-df71-4178-9661-61fae28dd999 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:10.170707 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1ba2f027-df71-4178-9661-61fae28dd999 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:10.171512 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1ba2f027-df71-4178-9661-61fae28dd999 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:10.171946 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1ba2f027-df71-4178-9661-61fae28dd999 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:10.416411 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-1ba2f027-df71-4178-9661-61fae28dd999 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:10.429336 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-1ba2f027-df71-4178-9661-61fae28dd999 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:10.437013 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-1ba2f027-df71-4178-9661-61fae28dd999 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:10.440038 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-1ba2f027-df71-4178-9661-61fae28dd999 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] 10.222.0.46 "GET /compute/v2.1/servers/42618a48-fe11-4f55-bed2-738d2cc8a07f" status: 200 len: 1320 microversion: 2.25 time: 0.305890 Jan 15 20:51:10.445287 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 437/921] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:51:10 2022] GET /compute/v2.1/servers/42618a48-fe11-4f55-bed2-738d2cc8a07f => generated 1320 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:51:10.462557 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-633e2f7c-2ed3-46e1-9c0e-eb34c3406bf0 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:10.494397 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.compute.server_groups [None req-633e2f7c-2ed3-46e1-9c0e-eb34c3406bf0 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Querying cell 2935be83-7c51-430d-8ff2-0a8179973c9a(cell1) for 2 instances {{(pid=129365) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:68}} Jan 15 20:51:10.497818 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-633e2f7c-2ed3-46e1-9c0e-eb34c3406bf0 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:10.498545 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-633e2f7c-2ed3-46e1-9c0e-eb34c3406bf0 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:10.584543 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-633e2f7c-2ed3-46e1-9c0e-eb34c3406bf0 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] 10.222.0.46 "GET /compute/v2.1/os-server-groups/3fea0289-5bb6-4136-acf4-b883ed4fc4ee" status: 200 len: 270 microversion: 2.1 time: 0.137478 Jan 15 20:51:10.590997 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 438/922] 10.222.0.46 () {58 vars in 1262 bytes} [Sat Jan 15 20:51:10 2022] GET /compute/v2.1/os-server-groups/3fea0289-5bb6-4136-acf4-b883ed4fc4ee => generated 270 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:51:10.601935 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-08c75a26-9227-4d80-8ede-104a36af85cb tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Action: 'action', calling method: .version_select at 0x7f30cba26820>, body: {"addFloatingIp": {"address": "172.35.1.171"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:51:10.607273 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-08c75a26-9227-4d80-8ede-104a36af85cb tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] [instance: 69b95b86-744d-4552-a0fc-6ced4d9ef38d] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:10.634060 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-08c75a26-9227-4d80-8ede-104a36af85cb tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:10.635938 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-08c75a26-9227-4d80-8ede-104a36af85cb tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:10.638704 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-08c75a26-9227-4d80-8ede-104a36af85cb tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:10.640075 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-08c75a26-9227-4d80-8ede-104a36af85cb tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:10.692537 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-f0b85a4d-33c5-453c-a944-6d71c6bfba03 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:10.700938 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f0b85a4d-33c5-453c-a944-6d71c6bfba03 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/d603f11b-5d49-492b-b541-1826486876ef" status: 200 len: 1378 microversion: 2.1 time: 0.644002 Jan 15 20:51:10.705083 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 485/923] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:10 2022] GET /compute/v2.1/servers/d603f11b-5d49-492b-b541-1826486876ef => generated 1378 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:10.709795 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-85d0df82-6c49-48cf-967d-cd4fe2c84f79 tempest-ServersOnMultiNodesTest-1194618714 tempest-ServersOnMultiNodesTest-1194618714-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:10.719586 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-85d0df82-6c49-48cf-967d-cd4fe2c84f79 tempest-ServersOnMultiNodesTest-1194618714 tempest-ServersOnMultiNodesTest-1194618714-project-admin] [instance: c0916b98-698b-448b-9b06-95791cbf533c] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:10.737013 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-85d0df82-6c49-48cf-967d-cd4fe2c84f79 tempest-ServersOnMultiNodesTest-1194618714 tempest-ServersOnMultiNodesTest-1194618714-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:10.737467 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-85d0df82-6c49-48cf-967d-cd4fe2c84f79 tempest-ServersOnMultiNodesTest-1194618714 tempest-ServersOnMultiNodesTest-1194618714-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:10.738155 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-85d0df82-6c49-48cf-967d-cd4fe2c84f79 tempest-ServersOnMultiNodesTest-1194618714 tempest-ServersOnMultiNodesTest-1194618714-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:10.738652 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-85d0df82-6c49-48cf-967d-cd4fe2c84f79 tempest-ServersOnMultiNodesTest-1194618714 tempest-ServersOnMultiNodesTest-1194618714-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:10.866447 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-08c75a26-9227-4d80-8ede-104a36af85cb tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Acquired lock "refresh_cache-69b95b86-744d-4552-a0fc-6ced4d9ef38d" {{(pid=129365) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jan 15 20:51:11.710403 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-85d0df82-6c49-48cf-967d-cd4fe2c84f79 tempest-ServersOnMultiNodesTest-1194618714 tempest-ServersOnMultiNodesTest-1194618714-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/c0916b98-698b-448b-9b06-95791cbf533c" status: 200 len: 1619 microversion: 2.1 time: 1.000909 Jan 15 20:51:11.725297 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 486/924] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:10 2022] GET /compute/v2.1/servers/c0916b98-698b-448b-9b06-95791cbf533c => generated 1619 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:11.731491 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-34b37db1-a180-471b-8f9c-9e1370d73bba tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '.version_select at 0x7f30c91a0a60>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:11.779099 ncdv-master-1 devstack@n-api.service[129365]: DEBUG neutronclient.v2_0.client [None req-08c75a26-9227-4d80-8ede-104a36af85cb tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.35.1.171 (0f3da3a4-39b8-4e74-9d2e-f073084cfc30) with port 66fcf159-d8ef-45e6-9c7c-4dba94d06566 using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network 8352f5d9-3635-4bc2-9859-c634bbd8ef52.", "detail": ""}} {{(pid=129365) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jan 15 20:51:11.779719 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-08c75a26-9227-4d80-8ede-104a36af85cb tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Releasing lock "refresh_cache-69b95b86-744d-4552-a0fc-6ced4d9ef38d" {{(pid=129365) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jan 15 20:51:11.781554 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-08c75a26-9227-4d80-8ede-104a36af85cb tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] HTTP exception thrown: Cannot associate floating IP 172.35.1.171 (0f3da3a4-39b8-4e74-9d2e-f073084cfc30) with port 66fcf159-d8ef-45e6-9c7c-4dba94d06566 using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network 8352f5d9-3635-4bc2-9859-c634bbd8ef52. Jan 15 20:51:11.781554 ncdv-master-1 devstack@n-api.service[129365]: Neutron server returns request_ids: ['req-846f8523-7f45-42d7-945b-66ddb959f249'] Jan 15 20:51:11.783238 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-08c75a26-9227-4d80-8ede-104a36af85cb tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Returning 400 to user: Cannot associate floating IP 172.35.1.171 (0f3da3a4-39b8-4e74-9d2e-f073084cfc30) with port 66fcf159-d8ef-45e6-9c7c-4dba94d06566 using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network 8352f5d9-3635-4bc2-9859-c634bbd8ef52. Jan 15 20:51:11.783238 ncdv-master-1 devstack@n-api.service[129365]: Neutron server returns request_ids: ['req-846f8523-7f45-42d7-945b-66ddb959f249'] {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:51:11.784194 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-08c75a26-9227-4d80-8ede-104a36af85cb tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] 10.222.0.46 "POST /compute/v2.1/servers/69b95b86-744d-4552-a0fc-6ced4d9ef38d/action" status: 400 len: 381 microversion: 2.1 time: 1.191722 Jan 15 20:51:11.784797 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 439/925] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:51:10 2022] POST /compute/v2.1/servers/69b95b86-744d-4552-a0fc-6ced4d9ef38d/action => generated 381 bytes in 1193 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 15 20:51:11.792635 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-187adcb2-731a-42c1-80b9-2e8eb5e83bdd tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:11.793554 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-187adcb2-731a-42c1-80b9-2e8eb5e83bdd tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 57bd310f-a604-40de-9c25-882284f4a17b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:11.818175 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-187adcb2-731a-42c1-80b9-2e8eb5e83bdd tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:11.819431 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-187adcb2-731a-42c1-80b9-2e8eb5e83bdd tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:11.822263 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-187adcb2-731a-42c1-80b9-2e8eb5e83bdd tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:11.823145 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-187adcb2-731a-42c1-80b9-2e8eb5e83bdd tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:11.860422 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-34b37db1-a180-471b-8f9c-9e1370d73bba tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "GET /compute/v2.1/images/106585ed-7081-4635-b265-1e7bf3b59ff9" status: 200 len: 1413 microversion: 2.1 time: 0.133688 Jan 15 20:51:11.861454 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 487/926] 10.222.0.46 () {58 vars in 1232 bytes} [Sat Jan 15 20:51:11 2022] GET /compute/v2.1/images/106585ed-7081-4635-b265-1e7bf3b59ff9 => generated 1413 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:11.882187 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-0661783a-c199-423d-9cfc-525d389c6449 req-43e54f6e-fce1-432c-b841-e4f638feb7b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98d0ca37-0175-44e2-8a1d-965cdc517daf", "name": "network-vif-deleted", "tag": "621b3781-18ee-45e7-aefe-ae6ec4d044ae"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:51:11.894577 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:51:11.894577 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:51:11.951101 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-0661783a-c199-423d-9cfc-525d389c6449 req-43e54f6e-fce1-432c-b841-e4f638feb7b6 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:11.960367 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-0661783a-c199-423d-9cfc-525d389c6449 req-43e54f6e-fce1-432c-b841-e4f638feb7b6 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:11.964366 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-187adcb2-731a-42c1-80b9-2e8eb5e83bdd tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d60caf368842b2aec08f0f5e14353a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c95e4b5695439dbc3f66a911264026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:11.976322 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-187adcb2-731a-42c1-80b9-2e8eb5e83bdd tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "GET /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b" status: 200 len: 1323 microversion: 2.1 time: 0.188374 Jan 15 20:51:11.979312 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 440/927] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:11 2022] GET /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b => generated 1323 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:11.998138 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-381bbf6a-39df-4d9c-a494-71f6415c76ce tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:12.000755 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-381bbf6a-39df-4d9c-a494-71f6415c76ce tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] [instance: b191ed6c-040a-4702-8e15-86272f9d1847] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:12.011112 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-0661783a-c199-423d-9cfc-525d389c6449 req-43e54f6e-fce1-432c-b841-e4f638feb7b6 service nova] Creating event network-vif-deleted:621b3781-18ee-45e7-aefe-ae6ec4d044ae for instance 98d0ca37-0175-44e2-8a1d-965cdc517daf on nch2-master-1 Jan 15 20:51:12.019641 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-381bbf6a-39df-4d9c-a494-71f6415c76ce tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:12.020735 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-381bbf6a-39df-4d9c-a494-71f6415c76ce tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:12.027825 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-381bbf6a-39df-4d9c-a494-71f6415c76ce tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:12.028995 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-381bbf6a-39df-4d9c-a494-71f6415c76ce tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:12.046503 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-0661783a-c199-423d-9cfc-525d389c6449 req-43e54f6e-fce1-432c-b841-e4f638feb7b6 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.176645 Jan 15 20:51:12.047923 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 488/928] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:51:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:51:12.086713 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-95c7bcfa-3ddb-4d97-8705-f17fdde55d23 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:12.094774 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-95c7bcfa-3ddb-4d97-8705-f17fdde55d23 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] [instance: 42618a48-fe11-4f55-bed2-738d2cc8a07f] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:12.114331 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-95c7bcfa-3ddb-4d97-8705-f17fdde55d23 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:12.114780 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-95c7bcfa-3ddb-4d97-8705-f17fdde55d23 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:12.115579 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-95c7bcfa-3ddb-4d97-8705-f17fdde55d23 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:12.120912 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-95c7bcfa-3ddb-4d97-8705-f17fdde55d23 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:12.675565 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-95c7bcfa-3ddb-4d97-8705-f17fdde55d23 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:12.692223 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-95c7bcfa-3ddb-4d97-8705-f17fdde55d23 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:12.694384 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-95c7bcfa-3ddb-4d97-8705-f17fdde55d23 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:12.695943 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-95c7bcfa-3ddb-4d97-8705-f17fdde55d23 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] 10.222.0.46 "GET /compute/v2.1/servers/42618a48-fe11-4f55-bed2-738d2cc8a07f" status: 200 len: 1320 microversion: 2.25 time: 0.646246 Jan 15 20:51:12.699418 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 489/929] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:51:12 2022] GET /compute/v2.1/servers/42618a48-fe11-4f55-bed2-738d2cc8a07f => generated 1320 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:51:12.718871 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-2456b0cf-6daf-460a-9394-e4a448a334e3 req-431db2ae-0434-413d-aee4-1e809439db6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d603f11b-5d49-492b-b541-1826486876ef", "name": "network-vif-plugged", "status": "completed", "tag": "29144689-f6e8-49ab-886d-3bedd21d555f"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:51:12.720886 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:51:12.720886 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:51:12.751286 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-2456b0cf-6daf-460a-9394-e4a448a334e3 req-431db2ae-0434-413d-aee4-1e809439db6d service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:12.751786 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-2456b0cf-6daf-460a-9394-e4a448a334e3 req-431db2ae-0434-413d-aee4-1e809439db6d service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:12.798215 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-2456b0cf-6daf-460a-9394-e4a448a334e3 req-431db2ae-0434-413d-aee4-1e809439db6d service nova] Creating event network-vif-plugged:29144689-f6e8-49ab-886d-3bedd21d555f for instance d603f11b-5d49-492b-b541-1826486876ef on nch1-master-1 Jan 15 20:51:12.826255 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-2456b0cf-6daf-460a-9394-e4a448a334e3 req-431db2ae-0434-413d-aee4-1e809439db6d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123114 Jan 15 20:51:12.834707 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 490/930] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:51:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:51:12.853271 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a4f7bd98-ef46-4a1b-8d46-88568dc53849 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:12.853985 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a4f7bd98-ef46-4a1b-8d46-88568dc53849 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: d603f11b-5d49-492b-b541-1826486876ef] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:12.867221 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a4f7bd98-ef46-4a1b-8d46-88568dc53849 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:12.885764 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a4f7bd98-ef46-4a1b-8d46-88568dc53849 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:12.886801 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a4f7bd98-ef46-4a1b-8d46-88568dc53849 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:12.887255 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a4f7bd98-ef46-4a1b-8d46-88568dc53849 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:13.057969 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-381bbf6a-39df-4d9c-a494-71f6415c76ce tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d4a57cfaa145009ba9cc8f21d9e8ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4a26c8edac44c8b26fd4e43813412d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:13.066030 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-381bbf6a-39df-4d9c-a494-71f6415c76ce tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] 10.222.0.46 "GET /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847" status: 200 len: 1477 microversion: 2.1 time: 1.084302 Jan 15 20:51:13.066631 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 441/931] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:11 2022] GET /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847 => generated 1477 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:13.071137 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-79f042c1-3ac4-40fe-b502-8c619f89f4c5 tempest-ServersOnMultiNodesTest-1194618714 tempest-ServersOnMultiNodesTest-1194618714-project-admin] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:13.071731 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-79f042c1-3ac4-40fe-b502-8c619f89f4c5 tempest-ServersOnMultiNodesTest-1194618714 tempest-ServersOnMultiNodesTest-1194618714-project-admin] [instance: c4b0aaad-91ee-4e37-9a34-0b4d56e282d5] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:13.109594 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-79f042c1-3ac4-40fe-b502-8c619f89f4c5 tempest-ServersOnMultiNodesTest-1194618714 tempest-ServersOnMultiNodesTest-1194618714-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:13.116621 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-79f042c1-3ac4-40fe-b502-8c619f89f4c5 tempest-ServersOnMultiNodesTest-1194618714 tempest-ServersOnMultiNodesTest-1194618714-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:13.118036 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-79f042c1-3ac4-40fe-b502-8c619f89f4c5 tempest-ServersOnMultiNodesTest-1194618714 tempest-ServersOnMultiNodesTest-1194618714-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:13.118581 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-79f042c1-3ac4-40fe-b502-8c619f89f4c5 tempest-ServersOnMultiNodesTest-1194618714 tempest-ServersOnMultiNodesTest-1194618714-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:13.246679 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-a4f7bd98-ef46-4a1b-8d46-88568dc53849 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:13.260321 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a4f7bd98-ef46-4a1b-8d46-88568dc53849 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/d603f11b-5d49-492b-b541-1826486876ef" status: 200 len: 1378 microversion: 2.1 time: 0.417159 Jan 15 20:51:13.270522 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 491/932] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:12 2022] GET /compute/v2.1/servers/d603f11b-5d49-492b-b541-1826486876ef => generated 1378 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:13.271706 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1afc8e1c-db3f-4c60-bd4b-ac74ef0bd1c1 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Calling method '.version_select at 0x7f30c9140280>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:13.627765 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-79f042c1-3ac4-40fe-b502-8c619f89f4c5 tempest-ServersOnMultiNodesTest-1194618714 tempest-ServersOnMultiNodesTest-1194618714-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/c4b0aaad-91ee-4e37-9a34-0b4d56e282d5" status: 200 len: 1620 microversion: 2.1 time: 0.559829 Jan 15 20:51:13.628366 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 442/933] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:13 2022] GET /compute/v2.1/servers/c4b0aaad-91ee-4e37-9a34-0b4d56e282d5 => generated 1620 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:13.641738 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2317e7e8-fabe-4a67-bfd7-8181dcb4f00e tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '.version_select at 0x7f30c8eceaf0>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:13.727429 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2317e7e8-fabe-4a67-bfd7-8181dcb4f00e tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "GET /compute/v2.1/images/106585ed-7081-4635-b265-1e7bf3b59ff9" status: 200 len: 1413 microversion: 2.1 time: 0.097936 Jan 15 20:51:13.728021 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 443/934] 10.222.0.46 () {58 vars in 1232 bytes} [Sat Jan 15 20:51:13 2022] GET /compute/v2.1/images/106585ed-7081-4635-b265-1e7bf3b59ff9 => generated 1413 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:13.749712 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-0e40a012-d007-45d4-931c-bf07d816ec66 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:13.752236 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-0e40a012-d007-45d4-931c-bf07d816ec66 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 57bd310f-a604-40de-9c25-882284f4a17b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:13.766774 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0e40a012-d007-45d4-931c-bf07d816ec66 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:13.767484 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0e40a012-d007-45d4-931c-bf07d816ec66 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:13.768490 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0e40a012-d007-45d4-931c-bf07d816ec66 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:13.772149 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0e40a012-d007-45d4-931c-bf07d816ec66 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:14.747807 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-0e40a012-d007-45d4-931c-bf07d816ec66 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d60caf368842b2aec08f0f5e14353a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c95e4b5695439dbc3f66a911264026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:14.768735 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-0e40a012-d007-45d4-931c-bf07d816ec66 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "GET /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b" status: 200 len: 1391 microversion: 2.1 time: 1.026675 Jan 15 20:51:14.771233 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 444/935] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:13 2022] GET /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b => generated 1391 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:14.790191 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-67aa5d44-67bb-4a7d-94b8-0c7080be9ce0 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:14.790826 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-67aa5d44-67bb-4a7d-94b8-0c7080be9ce0 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] [instance: 42618a48-fe11-4f55-bed2-738d2cc8a07f] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:14.807643 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-67aa5d44-67bb-4a7d-94b8-0c7080be9ce0 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:14.808396 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-67aa5d44-67bb-4a7d-94b8-0c7080be9ce0 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:14.809438 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-67aa5d44-67bb-4a7d-94b8-0c7080be9ce0 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:14.813968 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-67aa5d44-67bb-4a7d-94b8-0c7080be9ce0 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:15.344025 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-67aa5d44-67bb-4a7d-94b8-0c7080be9ce0 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:15.383444 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-67aa5d44-67bb-4a7d-94b8-0c7080be9ce0 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:15.385426 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-67aa5d44-67bb-4a7d-94b8-0c7080be9ce0 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:15.398780 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-67aa5d44-67bb-4a7d-94b8-0c7080be9ce0 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] 10.222.0.46 "GET /compute/v2.1/servers/42618a48-fe11-4f55-bed2-738d2cc8a07f" status: 200 len: 1362 microversion: 2.25 time: 0.621104 Jan 15 20:51:15.400152 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 445/936] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:51:14 2022] GET /compute/v2.1/servers/42618a48-fe11-4f55-bed2-738d2cc8a07f => generated 1362 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:51:15.405117 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-18df0d5a-f857-44aa-a6d2-8c8c7ae1c812 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1640279365", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "1e63485c-6290-4e1d-82cf-5ae73069dd2e"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:51:15.521547 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.network.neutron [None req-18df0d5a-f857-44aa-a6d2-8c8c7ae1c812 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] validate_networks() for None {{(pid=129365) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 20:51:16.071969 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-1afc8e1c-db3f-4c60-bd4b-ac74ef0bd1c1 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] 10.222.0.46 "DELETE /compute/v2.1/os-floating-ips/0f3da3a4-39b8-4e74-9d2e-f073084cfc30" status: 202 len: 0 microversion: 2.1 time: 2.809057 Jan 15 20:51:16.072893 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 492/937] 10.222.0.46 () {58 vars in 1262 bytes} [Sat Jan 15 20:51:13 2022] DELETE /compute/v2.1/os-floating-ips/0f3da3a4-39b8-4e74-9d2e-f073084cfc30 => generated 0 bytes in 2810 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 20:51:16.077370 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c6714107-0554-4511-8938-8f81acc14082 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:16.077972 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c6714107-0554-4511-8938-8f81acc14082 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] [instance: b191ed6c-040a-4702-8e15-86272f9d1847] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:16.098441 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c6714107-0554-4511-8938-8f81acc14082 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:16.098896 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c6714107-0554-4511-8938-8f81acc14082 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:16.099471 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-18df0d5a-f857-44aa-a6d2-8c8c7ae1c812 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Flavor limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 20:51:16.100593 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c6714107-0554-4511-8938-8f81acc14082 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:16.100744 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c6714107-0554-4511-8938-8f81acc14082 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:16.100923 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-18df0d5a-f857-44aa-a6d2-8c8c7ae1c812 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Image limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 20:51:16.101229 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-18df0d5a-f857-44aa-a6d2-8c8c7ae1c812 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Flavor pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 20:51:16.102054 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-18df0d5a-f857-44aa-a6d2-8c8c7ae1c812 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Image pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 20:51:16.105462 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-18df0d5a-f857-44aa-a6d2-8c8c7ae1c812 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 20:51:16.121642 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-18df0d5a-f857-44aa-a6d2-8c8c7ae1c812 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:16.123310 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-18df0d5a-f857-44aa-a6d2-8c8c7ae1c812 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:16.124383 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-18df0d5a-f857-44aa-a6d2-8c8c7ae1c812 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:16.125346 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-18df0d5a-f857-44aa-a6d2-8c8c7ae1c812 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:16.151913 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-18df0d5a-f857-44aa-a6d2-8c8c7ae1c812 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Getting quotas for project e8cfe33be708428abef52f5e8e25621b. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:51:16.157715 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-18df0d5a-f857-44aa-a6d2-8c8c7ae1c812 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Getting quotas for user bc38f86758f9416b9e7f6915de0359d6 and project e8cfe33be708428abef52f5e8e25621b. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:51:16.173103 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-18df0d5a-f857-44aa-a6d2-8c8c7ae1c812 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Going to run 1 instances... {{(pid=129365) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 20:51:16.176251 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-18df0d5a-f857-44aa-a6d2-8c8c7ae1c812 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] [instance: 61233bc7-f90a-439f-b0c6-e6856c8c71a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129365) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 20:51:16.238619 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-18df0d5a-f857-44aa-a6d2-8c8c7ae1c812 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.837035 Jan 15 20:51:16.246477 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 446/938] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 20:51:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 845 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 20:51:16.252328 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-359104a7-db1f-4b35-8504-25f02f4e8e41 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:16.253270 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-359104a7-db1f-4b35-8504-25f02f4e8e41 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: d603f11b-5d49-492b-b541-1826486876ef] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:16.304333 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-359104a7-db1f-4b35-8504-25f02f4e8e41 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:16.305376 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-359104a7-db1f-4b35-8504-25f02f4e8e41 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:16.307149 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-359104a7-db1f-4b35-8504-25f02f4e8e41 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:16.309628 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-359104a7-db1f-4b35-8504-25f02f4e8e41 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:16.651034 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-c6714107-0554-4511-8938-8f81acc14082 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d4a57cfaa145009ba9cc8f21d9e8ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4a26c8edac44c8b26fd4e43813412d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:16.665236 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c6714107-0554-4511-8938-8f81acc14082 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] 10.222.0.46 "GET /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847" status: 200 len: 1477 microversion: 2.1 time: 0.591197 Jan 15 20:51:16.672890 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 493/939] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:16 2022] GET /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847 => generated 1477 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:16.681066 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4a26b74a-7b62-4311-aae1-98d236e83c00 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '.version_select at 0x7f30c93419d0>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:16.751948 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-359104a7-db1f-4b35-8504-25f02f4e8e41 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:16.771396 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-359104a7-db1f-4b35-8504-25f02f4e8e41 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/d603f11b-5d49-492b-b541-1826486876ef" status: 200 len: 1527 microversion: 2.1 time: 0.522369 Jan 15 20:51:16.783311 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 447/940] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:16 2022] GET /compute/v2.1/servers/d603f11b-5d49-492b-b541-1826486876ef => generated 1527 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:16.789590 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-aac31a31-4afd-4112-8804-66539e5cba30 req-d5d6f640-ce5c-4eda-a450-5804490001d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b191ed6c-040a-4702-8e15-86272f9d1847", "name": "network-vif-plugged", "status": "completed", "tag": "bbe8394e-08fc-445b-a162-0e40259702ca"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:51:16.791255 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:51:16.791255 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:51:16.799600 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-aac31a31-4afd-4112-8804-66539e5cba30 req-d5d6f640-ce5c-4eda-a450-5804490001d2 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:16.799898 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-aac31a31-4afd-4112-8804-66539e5cba30 req-d5d6f640-ce5c-4eda-a450-5804490001d2 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:16.800002 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-4a26b74a-7b62-4311-aae1-98d236e83c00 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "GET /compute/v2.1/images/106585ed-7081-4635-b265-1e7bf3b59ff9" status: 200 len: 1422 microversion: 2.1 time: 0.131336 Jan 15 20:51:16.801003 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 494/941] 10.222.0.46 () {58 vars in 1232 bytes} [Sat Jan 15 20:51:16 2022] GET /compute/v2.1/images/106585ed-7081-4635-b265-1e7bf3b59ff9 => generated 1422 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:16.805807 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-ce5fc6a8-5d47-48c6-a679-aa1845be6da0 req-9d9c948f-a396-4d5b-8186-d2a961fb8d06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57bd310f-a604-40de-9c25-882284f4a17b", "tag": "b8144bdd-0e36-42d0-ae5a-b27a87dabd70"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:51:16.821484 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:51:16.821484 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:51:16.823951 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-aac31a31-4afd-4112-8804-66539e5cba30 req-d5d6f640-ce5c-4eda-a450-5804490001d2 service nova] Creating event network-vif-plugged:bbe8394e-08fc-445b-a162-0e40259702ca for instance b191ed6c-040a-4702-8e15-86272f9d1847 on nch2-master-1 Jan 15 20:51:16.833302 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-aac31a31-4afd-4112-8804-66539e5cba30 req-d5d6f640-ce5c-4eda-a450-5804490001d2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046550 Jan 15 20:51:16.835458 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 448/942] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:51:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:51:16.856050 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-ce5fc6a8-5d47-48c6-a679-aa1845be6da0 req-9d9c948f-a396-4d5b-8186-d2a961fb8d06 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:16.856648 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-ce5fc6a8-5d47-48c6-a679-aa1845be6da0 req-9d9c948f-a396-4d5b-8186-d2a961fb8d06 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:16.862242 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-aa65cab7-931f-4be8-b904-bbd204f23116 req-6c56197e-f311-4376-afec-94a4260efc53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42618a48-fe11-4f55-bed2-738d2cc8a07f", "tag": "21a10db9-cd2b-430c-a0f4-3a2be36756f3"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:51:16.872012 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:51:16.872012 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:51:16.893137 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-ce5fc6a8-5d47-48c6-a679-aa1845be6da0 req-9d9c948f-a396-4d5b-8186-d2a961fb8d06 service nova] Creating event network-changed:b8144bdd-0e36-42d0-ae5a-b27a87dabd70 for instance 57bd310f-a604-40de-9c25-882284f4a17b on nch1-master-1 Jan 15 20:51:16.898856 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-aa65cab7-931f-4be8-b904-bbd204f23116 req-6c56197e-f311-4376-afec-94a4260efc53 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:16.899311 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-aa65cab7-931f-4be8-b904-bbd204f23116 req-6c56197e-f311-4376-afec-94a4260efc53 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:16.903497 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-ce5fc6a8-5d47-48c6-a679-aa1845be6da0 req-9d9c948f-a396-4d5b-8186-d2a961fb8d06 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101347 Jan 15 20:51:16.904740 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 495/943] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:51:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:51:16.936460 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-aa65cab7-931f-4be8-b904-bbd204f23116 req-6c56197e-f311-4376-afec-94a4260efc53 service nova] Creating event network-changed:21a10db9-cd2b-430c-a0f4-3a2be36756f3 for instance 42618a48-fe11-4f55-bed2-738d2cc8a07f on nch1-master-1 Jan 15 20:51:16.954599 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-aa65cab7-931f-4be8-b904-bbd204f23116 req-6c56197e-f311-4376-afec-94a4260efc53 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115087 Jan 15 20:51:16.955840 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 449/944] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:51:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:51:16.969542 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-6d9c4041-40b9-4c06-a745-4dacec2fa792 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:16.970259 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-6d9c4041-40b9-4c06-a745-4dacec2fa792 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 57bd310f-a604-40de-9c25-882284f4a17b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:16.992877 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6d9c4041-40b9-4c06-a745-4dacec2fa792 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:16.993790 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6d9c4041-40b9-4c06-a745-4dacec2fa792 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:16.997028 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6d9c4041-40b9-4c06-a745-4dacec2fa792 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:16.998526 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6d9c4041-40b9-4c06-a745-4dacec2fa792 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:17.224940 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-3ba1b872-f674-4ac3-b502-a7f233d516a6 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1625759320", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "networks": [{"uuid": "d11eef3f-f6e5-43d1-bf0a-1a5337d2e062"}]}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:51:17.300263 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.network.neutron [None req-3ba1b872-f674-4ac3-b502-a7f233d516a6 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] validate_networks() for [('d11eef3f-f6e5-43d1-bf0a-1a5337d2e062', None, None, None, None, None)] {{(pid=129366) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 20:51:17.344732 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-6d9c4041-40b9-4c06-a745-4dacec2fa792 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d60caf368842b2aec08f0f5e14353a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c95e4b5695439dbc3f66a911264026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:17.358754 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-6d9c4041-40b9-4c06-a745-4dacec2fa792 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "GET /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b" status: 200 len: 1391 microversion: 2.1 time: 0.399431 Jan 15 20:51:17.373526 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 450/945] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:16 2022] GET /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b => generated 1391 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:17.378897 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-cba01fa0-f84e-4cd8-9338-e94c619148dc tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Action: 'action', calling method: .version_select at 0x7f30cba268b0>, body: {"removeFloatingIp": {"address": "172.35.1.107"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:51:18.088054 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-cba01fa0-f84e-4cd8-9338-e94c619148dc tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] [instance: 69b95b86-744d-4552-a0fc-6ced4d9ef38d] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:18.094057 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cba01fa0-f84e-4cd8-9338-e94c619148dc tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:18.094506 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cba01fa0-f84e-4cd8-9338-e94c619148dc tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:18.095295 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cba01fa0-f84e-4cd8-9338-e94c619148dc tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:18.095927 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cba01fa0-f84e-4cd8-9338-e94c619148dc tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:18.684886 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cba01fa0-f84e-4cd8-9338-e94c619148dc tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Acquired lock "refresh_cache-69b95b86-744d-4552-a0fc-6ced4d9ef38d" {{(pid=129365) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jan 15 20:51:18.692260 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-3ba1b872-f674-4ac3-b502-a7f233d516a6 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Flavor limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 20:51:18.692819 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-3ba1b872-f674-4ac3-b502-a7f233d516a6 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Image limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 20:51:18.693361 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-3ba1b872-f674-4ac3-b502-a7f233d516a6 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Flavor pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 20:51:18.693871 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-3ba1b872-f674-4ac3-b502-a7f233d516a6 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Image pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 20:51:18.694308 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-3ba1b872-f674-4ac3-b502-a7f233d516a6 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 20:51:18.744804 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3ba1b872-f674-4ac3-b502-a7f233d516a6 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:18.746101 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3ba1b872-f674-4ac3-b502-a7f233d516a6 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:18.750909 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3ba1b872-f674-4ac3-b502-a7f233d516a6 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:18.751548 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3ba1b872-f674-4ac3-b502-a7f233d516a6 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:18.806483 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-3ba1b872-f674-4ac3-b502-a7f233d516a6 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Getting quotas for project f471d81a59824fc8afaf454a65e99933. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:51:18.813017 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-3ba1b872-f674-4ac3-b502-a7f233d516a6 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Getting quotas for user 25473d022e7f438fa6495288f53caa7e and project f471d81a59824fc8afaf454a65e99933. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:51:18.836175 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-3ba1b872-f674-4ac3-b502-a7f233d516a6 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Going to run 1 instances... {{(pid=129366) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 20:51:18.839100 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-3ba1b872-f674-4ac3-b502-a7f233d516a6 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] [instance: b18c4fdc-6965-4c52-85f5-824ba94b4ad8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 20:51:18.911167 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-3ba1b872-f674-4ac3-b502-a7f233d516a6 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.004217 Jan 15 20:51:18.912005 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 496/946] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 20:51:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 2007 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 20:51:18.922290 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1b1e6e29-a5f0-4566-96b8-28a2b01d6e39 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:18.923133 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-1b1e6e29-a5f0-4566-96b8-28a2b01d6e39 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] [instance: 61233bc7-f90a-439f-b0c6-e6856c8c71a0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:18.931394 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1b1e6e29-a5f0-4566-96b8-28a2b01d6e39 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:18.932102 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1b1e6e29-a5f0-4566-96b8-28a2b01d6e39 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:18.935446 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1b1e6e29-a5f0-4566-96b8-28a2b01d6e39 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:18.936329 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1b1e6e29-a5f0-4566-96b8-28a2b01d6e39 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:19.558333 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-1b1e6e29-a5f0-4566-96b8-28a2b01d6e39 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc38f86758f9416b9e7f6915de0359d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8cfe33be708428abef52f5e8e25621b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:19.572168 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-1b1e6e29-a5f0-4566-96b8-28a2b01d6e39 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] 10.222.0.46 "GET /compute/v2.1/servers/61233bc7-f90a-439f-b0c6-e6856c8c71a0" status: 200 len: 1317 microversion: 2.1 time: 0.656831 Jan 15 20:51:19.572756 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 497/947] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:18 2022] GET /compute/v2.1/servers/61233bc7-f90a-439f-b0c6-e6856c8c71a0 => generated 1317 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:19.581789 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8146d054-36d1-45c1-8623-3c51f2afa6d7 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:19.582399 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-8146d054-36d1-45c1-8623-3c51f2afa6d7 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] [instance: 42618a48-fe11-4f55-bed2-738d2cc8a07f] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:19.609162 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8146d054-36d1-45c1-8623-3c51f2afa6d7 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:19.611460 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8146d054-36d1-45c1-8623-3c51f2afa6d7 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:19.613628 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8146d054-36d1-45c1-8623-3c51f2afa6d7 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:19.616555 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8146d054-36d1-45c1-8623-3c51f2afa6d7 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:19.969134 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-8146d054-36d1-45c1-8623-3c51f2afa6d7 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:19.981493 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-8146d054-36d1-45c1-8623-3c51f2afa6d7 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:19.983162 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-8146d054-36d1-45c1-8623-3c51f2afa6d7 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:19.987606 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-8146d054-36d1-45c1-8623-3c51f2afa6d7 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] 10.222.0.46 "GET /compute/v2.1/servers/42618a48-fe11-4f55-bed2-738d2cc8a07f" status: 200 len: 1362 microversion: 2.25 time: 0.406456 Jan 15 20:51:19.988236 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 498/948] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:51:19 2022] GET /compute/v2.1/servers/42618a48-fe11-4f55-bed2-738d2cc8a07f => generated 1362 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:51:19.994039 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8f18ef67-81eb-4031-aba1-9b5ab63f56e0 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:20.006342 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-8f18ef67-81eb-4031-aba1-9b5ab63f56e0 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: d603f11b-5d49-492b-b541-1826486876ef] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:20.017639 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8f18ef67-81eb-4031-aba1-9b5ab63f56e0 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:20.021140 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8f18ef67-81eb-4031-aba1-9b5ab63f56e0 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:20.022670 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8f18ef67-81eb-4031-aba1-9b5ab63f56e0 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:20.025397 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8f18ef67-81eb-4031-aba1-9b5ab63f56e0 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:20.176361 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.network.neutron [None req-cba01fa0-f84e-4cd8-9338-e94c619148dc tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] [instance: 69b95b86-744d-4552-a0fc-6ced4d9ef38d] Building network info cache for instance {{(pid=129365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1883}} Jan 15 20:51:20.422559 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-8f18ef67-81eb-4031-aba1-9b5ab63f56e0 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:20.437508 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-8f18ef67-81eb-4031-aba1-9b5ab63f56e0 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/d603f11b-5d49-492b-b541-1826486876ef" status: 200 len: 1527 microversion: 2.1 time: 0.447505 Jan 15 20:51:20.438919 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 499/949] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:19 2022] GET /compute/v2.1/servers/d603f11b-5d49-492b-b541-1826486876ef => generated 1527 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:20.445839 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-550d103d-e285-4410-9d23-2b0d9e13cb3d tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '.version_select at 0x7f30c91fca60>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:20.507854 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-550d103d-e285-4410-9d23-2b0d9e13cb3d tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "GET /compute/v2.1/images/106585ed-7081-4635-b265-1e7bf3b59ff9" status: 200 len: 1422 microversion: 2.1 time: 0.067234 Jan 15 20:51:20.509739 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 500/950] 10.222.0.46 () {58 vars in 1232 bytes} [Sat Jan 15 20:51:20 2022] GET /compute/v2.1/images/106585ed-7081-4635-b265-1e7bf3b59ff9 => generated 1422 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:20.524136 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-6f8333d8-8bc3-41fb-8203-149e563d822e tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:20.525091 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-6f8333d8-8bc3-41fb-8203-149e563d822e tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] [instance: b191ed6c-040a-4702-8e15-86272f9d1847] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:20.535253 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6f8333d8-8bc3-41fb-8203-149e563d822e tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:20.548813 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6f8333d8-8bc3-41fb-8203-149e563d822e tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:20.549960 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6f8333d8-8bc3-41fb-8203-149e563d822e tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:20.550868 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6f8333d8-8bc3-41fb-8203-149e563d822e tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:20.881437 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-6f8333d8-8bc3-41fb-8203-149e563d822e tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d4a57cfaa145009ba9cc8f21d9e8ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4a26c8edac44c8b26fd4e43813412d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:20.898542 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-6f8333d8-8bc3-41fb-8203-149e563d822e tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] 10.222.0.46 "GET /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847" status: 200 len: 1463 microversion: 2.1 time: 0.387562 Jan 15 20:51:20.899290 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 501/951] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:20 2022] GET /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847 => generated 1463 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:20.903681 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b821b568-45af-4962-aaa3-8fc5091c9663 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:20.917484 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b821b568-45af-4962-aaa3-8fc5091c9663 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 57bd310f-a604-40de-9c25-882284f4a17b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:20.925691 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b821b568-45af-4962-aaa3-8fc5091c9663 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:20.926144 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b821b568-45af-4962-aaa3-8fc5091c9663 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:20.926950 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b821b568-45af-4962-aaa3-8fc5091c9663 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:20.936862 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b821b568-45af-4962-aaa3-8fc5091c9663 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:21.612698 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.network.neutron [None req-cba01fa0-f84e-4cd8-9338-e94c619148dc tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] [instance: 69b95b86-744d-4552-a0fc-6ced4d9ef38d] Updating instance_info_cache with network_info: [{"id": "66fcf159-d8ef-45e6-9c7c-4dba94d06566", "address": "fa:16:3e:6b:3d:6d", "network": {"id": "1ddf3f52-4b62-4e63-a9e4-50ec9015529c", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1083503271-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "63f60a2e220b479abf4b04536ed406e9", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap66fcf159-d8", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=129365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jan 15 20:51:21.629095 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cba01fa0-f84e-4cd8-9338-e94c619148dc tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Releasing lock "refresh_cache-69b95b86-744d-4552-a0fc-6ced4d9ef38d" {{(pid=129365) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jan 15 20:51:21.630367 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-cba01fa0-f84e-4cd8-9338-e94c619148dc tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] 10.222.0.46 "POST /compute/v2.1/servers/69b95b86-744d-4552-a0fc-6ced4d9ef38d/action" status: 202 len: 0 microversion: 2.1 time: 4.255423 Jan 15 20:51:21.632120 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 451/952] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:51:17 2022] POST /compute/v2.1/servers/69b95b86-744d-4552-a0fc-6ced4d9ef38d/action => generated 0 bytes in 4258 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jan 15 20:51:21.637773 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-7598b640-674b-42de-ae7d-44be5b552576 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:21.638643 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-7598b640-674b-42de-ae7d-44be5b552576 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] [instance: b18c4fdc-6965-4c52-85f5-824ba94b4ad8] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:21.651327 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7598b640-674b-42de-ae7d-44be5b552576 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:21.652095 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7598b640-674b-42de-ae7d-44be5b552576 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:21.653129 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7598b640-674b-42de-ae7d-44be5b552576 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:21.653837 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7598b640-674b-42de-ae7d-44be5b552576 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:21.663735 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-b821b568-45af-4962-aaa3-8fc5091c9663 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d60caf368842b2aec08f0f5e14353a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c95e4b5695439dbc3f66a911264026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:21.675025 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b821b568-45af-4962-aaa3-8fc5091c9663 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "GET /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b" status: 200 len: 1391 microversion: 2.1 time: 0.774481 Jan 15 20:51:21.676560 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 502/953] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:20 2022] GET /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b => generated 1391 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:21.683360 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-fc848e9f-ef4e-446f-857f-e636ae768f09 req-16ef544e-770b-4d9f-94f8-133344aaff09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69b95b86-744d-4552-a0fc-6ced4d9ef38d", "tag": "66fcf159-d8ef-45e6-9c7c-4dba94d06566"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:51:21.685800 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:51:21.685800 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:51:21.694460 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-fc848e9f-ef4e-446f-857f-e636ae768f09 req-16ef544e-770b-4d9f-94f8-133344aaff09 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:21.695217 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-fc848e9f-ef4e-446f-857f-e636ae768f09 req-16ef544e-770b-4d9f-94f8-133344aaff09 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:21.709773 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-fc848e9f-ef4e-446f-857f-e636ae768f09 req-16ef544e-770b-4d9f-94f8-133344aaff09 service nova] Creating event network-changed:66fcf159-d8ef-45e6-9c7c-4dba94d06566 for instance 69b95b86-744d-4552-a0fc-6ced4d9ef38d on nch2-master-1 Jan 15 20:51:21.714830 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-fc848e9f-ef4e-446f-857f-e636ae768f09 req-16ef544e-770b-4d9f-94f8-133344aaff09 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036541 Jan 15 20:51:21.715439 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 503/954] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:51:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:51:21.720765 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-a1f65a16-c66b-41bf-9a73-069a0a07d29d req-eeae12bf-458a-4e30-8b07-31565425ae4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61233bc7-f90a-439f-b0c6-e6856c8c71a0", "tag": "efc2bb82-77b6-4192-a231-cc667bccea96"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:51:21.722589 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:51:21.722589 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:51:21.736928 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-a1f65a16-c66b-41bf-9a73-069a0a07d29d req-eeae12bf-458a-4e30-8b07-31565425ae4a service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:21.737379 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-a1f65a16-c66b-41bf-9a73-069a0a07d29d req-eeae12bf-458a-4e30-8b07-31565425ae4a service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:21.750198 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-a1f65a16-c66b-41bf-9a73-069a0a07d29d req-eeae12bf-458a-4e30-8b07-31565425ae4a service nova] Creating event network-changed:efc2bb82-77b6-4192-a231-cc667bccea96 for instance 61233bc7-f90a-439f-b0c6-e6856c8c71a0 on nch1-master-1 Jan 15 20:51:21.759256 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-a1f65a16-c66b-41bf-9a73-069a0a07d29d req-eeae12bf-458a-4e30-8b07-31565425ae4a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042089 Jan 15 20:51:21.760516 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 504/955] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:51:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:51:21.766017 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f4798c24-8c75-4309-8c4b-65374d405917 tempest-MigrationsAdminTest-1503274595 tempest-MigrationsAdminTest-1503274595-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:21.766841 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:51:21.766841 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:51:21.785206 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-7598b640-674b-42de-ae7d-44be5b552576 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25473d022e7f438fa6495288f53caa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f471d81a59824fc8afaf454a65e99933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:21.796795 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-7598b640-674b-42de-ae7d-44be5b552576 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] 10.222.0.46 "GET /compute/v2.1/servers/b18c4fdc-6965-4c52-85f5-824ba94b4ad8" status: 200 len: 1282 microversion: 2.1 time: 0.162987 Jan 15 20:51:21.797342 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 452/956] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:21 2022] GET /compute/v2.1/servers/b18c4fdc-6965-4c52-85f5-824ba94b4ad8 => generated 1282 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:21.798257 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f4798c24-8c75-4309-8c4b-65374d405917 tempest-MigrationsAdminTest-1503274595 tempest-MigrationsAdminTest-1503274595-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/b7625772-7b20-4764-8508-589665228f46" status: 202 len: 0 microversion: 2.1 time: 0.036238 Jan 15 20:51:21.798848 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 505/957] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 20:51:21 2022] DELETE /compute/v2.1/flavors/b7625772-7b20-4764-8508-589665228f46 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 20:51:21.806084 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-47950c07-0d3f-4de2-a159-e6f881680df4 req-d011492e-9c92-41ef-9947-b532983c6c3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecba885c-f344-480e-9efc-707d1c542d42", "name": "network-vif-unplugged", "status": "completed", "tag": "6896d9fc-c7c9-4e4b-8bf1-aaae0b89dd3f"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:51:21.809126 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-13dc2e1d-a6b9-4c3a-b62b-48da3fb37f2c tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '.version_select at 0x7f30c917d040>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:21.817554 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:51:21.817554 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:51:21.832802 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-47950c07-0d3f-4de2-a159-e6f881680df4 req-d011492e-9c92-41ef-9947-b532983c6c3f service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:21.833764 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-47950c07-0d3f-4de2-a159-e6f881680df4 req-d011492e-9c92-41ef-9947-b532983c6c3f service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:21.856452 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-47950c07-0d3f-4de2-a159-e6f881680df4 req-d011492e-9c92-41ef-9947-b532983c6c3f service nova] Creating event network-vif-unplugged:6896d9fc-c7c9-4e4b-8bf1-aaae0b89dd3f for instance ecba885c-f344-480e-9efc-707d1c542d42 on nch1-master-1 Jan 15 20:51:21.872188 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-47950c07-0d3f-4de2-a159-e6f881680df4 req-d011492e-9c92-41ef-9947-b532983c6c3f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.069880 Jan 15 20:51:21.872816 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 506/958] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:51:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:51:21.883454 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d8ec02e8-df85-49d4-8997-3598604ca41e tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:21.884388 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-d8ec02e8-df85-49d4-8997-3598604ca41e tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] [instance: 61233bc7-f90a-439f-b0c6-e6856c8c71a0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:21.896428 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d8ec02e8-df85-49d4-8997-3598604ca41e tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:21.896968 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d8ec02e8-df85-49d4-8997-3598604ca41e tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:21.901784 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d8ec02e8-df85-49d4-8997-3598604ca41e tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:21.901904 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d8ec02e8-df85-49d4-8997-3598604ca41e tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:22.204538 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-d8ec02e8-df85-49d4-8997-3598604ca41e tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc38f86758f9416b9e7f6915de0359d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8cfe33be708428abef52f5e8e25621b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:22.214881 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d8ec02e8-df85-49d4-8997-3598604ca41e tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] 10.222.0.46 "GET /compute/v2.1/servers/61233bc7-f90a-439f-b0c6-e6856c8c71a0" status: 200 len: 1317 microversion: 2.1 time: 0.339215 Jan 15 20:51:22.215776 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 507/959] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:21 2022] GET /compute/v2.1/servers/61233bc7-f90a-439f-b0c6-e6856c8c71a0 => generated 1317 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:22.227633 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-3d6a2511-e4a1-4b01-b83a-69f0f270d087 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:22.231058 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-3d6a2511-e4a1-4b01-b83a-69f0f270d087 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] [instance: b191ed6c-040a-4702-8e15-86272f9d1847] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:22.245568 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3d6a2511-e4a1-4b01-b83a-69f0f270d087 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:22.246664 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3d6a2511-e4a1-4b01-b83a-69f0f270d087 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:22.247870 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3d6a2511-e4a1-4b01-b83a-69f0f270d087 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:22.249368 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3d6a2511-e4a1-4b01-b83a-69f0f270d087 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:22.464945 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-3d6a2511-e4a1-4b01-b83a-69f0f270d087 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d4a57cfaa145009ba9cc8f21d9e8ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4a26c8edac44c8b26fd4e43813412d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:22.472775 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-3d6a2511-e4a1-4b01-b83a-69f0f270d087 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] 10.222.0.46 "GET /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847" status: 200 len: 1463 microversion: 2.1 time: 0.255829 Jan 15 20:51:22.483007 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 508/960] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:22 2022] GET /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847 => generated 1463 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:22.483007 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d4511ddd-6948-4aee-96ac-10c6f9aa33e3 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:22.483007 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-d4511ddd-6948-4aee-96ac-10c6f9aa33e3 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] [instance: 42618a48-fe11-4f55-bed2-738d2cc8a07f] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:22.504031 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d4511ddd-6948-4aee-96ac-10c6f9aa33e3 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:22.509228 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d4511ddd-6948-4aee-96ac-10c6f9aa33e3 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:22.515338 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d4511ddd-6948-4aee-96ac-10c6f9aa33e3 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:22.515794 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d4511ddd-6948-4aee-96ac-10c6f9aa33e3 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:22.772939 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-13dc2e1d-a6b9-4c3a-b62b-48da3fb37f2c tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "DELETE /compute/v2.1/images/106585ed-7081-4635-b265-1e7bf3b59ff9" status: 204 len: 0 microversion: 2.1 time: 0.971827 Jan 15 20:51:22.775403 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 453/961] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:21 2022] DELETE /compute/v2.1/images/106585ed-7081-4635-b265-1e7bf3b59ff9 => generated 0 bytes in 976 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 20:51:22.781590 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3a793b95-9acf-48da-885a-a6d199e3b337 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Calling method '.version_select at 0x7f30c8e6a9d0>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:22.973192 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-d4511ddd-6948-4aee-96ac-10c6f9aa33e3 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:22.988641 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-d4511ddd-6948-4aee-96ac-10c6f9aa33e3 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:22.990861 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-d4511ddd-6948-4aee-96ac-10c6f9aa33e3 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:22.992265 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d4511ddd-6948-4aee-96ac-10c6f9aa33e3 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] 10.222.0.46 "GET /compute/v2.1/servers/42618a48-fe11-4f55-bed2-738d2cc8a07f" status: 200 len: 1362 microversion: 2.25 time: 0.515998 Jan 15 20:51:22.993088 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 509/962] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:51:22 2022] GET /compute/v2.1/servers/42618a48-fe11-4f55-bed2-738d2cc8a07f => generated 1362 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:51:22.999369 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a406ca52-ca13-4189-8060-5bf54273cd33 tempest-MigrationsAdminTest-1503274595 tempest-MigrationsAdminTest-1503274595-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:23.029065 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a406ca52-ca13-4189-8060-5bf54273cd33 tempest-MigrationsAdminTest-1503274595 tempest-MigrationsAdminTest-1503274595-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.034268 Jan 15 20:51:23.030410 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 510/963] 10.222.0.46 () {58 vars in 1145 bytes} [Sat Jan 15 20:51:22 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:23.035619 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-445a3f87-4ad2-4757-b082-7eb166035853 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:51:23.038121 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-445a3f87-4ad2-4757-b082-7eb166035853 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] [instance: b191ed6c-040a-4702-8e15-86272f9d1847] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:23.045611 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-445a3f87-4ad2-4757-b082-7eb166035853 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:23.046309 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-445a3f87-4ad2-4757-b082-7eb166035853 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:23.047596 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-445a3f87-4ad2-4757-b082-7eb166035853 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:23.048214 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-445a3f87-4ad2-4757-b082-7eb166035853 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:23.148736 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-445a3f87-4ad2-4757-b082-7eb166035853 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Flavor limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 20:51:23.149200 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-445a3f87-4ad2-4757-b082-7eb166035853 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Image limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 20:51:23.149677 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-445a3f87-4ad2-4757-b082-7eb166035853 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Flavor pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 20:51:23.150106 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-445a3f87-4ad2-4757-b082-7eb166035853 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Image pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 20:51:23.150498 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-445a3f87-4ad2-4757-b082-7eb166035853 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 20:51:23.230166 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-445a3f87-4ad2-4757-b082-7eb166035853 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] [instance: b191ed6c-040a-4702-8e15-86272f9d1847] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:23.247556 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-445a3f87-4ad2-4757-b082-7eb166035853 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:23.248146 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-445a3f87-4ad2-4757-b082-7eb166035853 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:23.261214 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-445a3f87-4ad2-4757-b082-7eb166035853 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:23.262434 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-445a3f87-4ad2-4757-b082-7eb166035853 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:23.297889 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-445a3f87-4ad2-4757-b082-7eb166035853 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] 10.222.0.46 "POST /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847/action" status: 202 len: 1067 microversion: 2.1 time: 0.265959 Jan 15 20:51:23.298705 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 511/964] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:51:23 2022] POST /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847/action => generated 1067 bytes in 268 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 15 20:51:23.304541 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a8598457-2d99-4569-940d-8cd2f3445bc5 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:23.305494 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a8598457-2d99-4569-940d-8cd2f3445bc5 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 57bd310f-a604-40de-9c25-882284f4a17b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:23.313255 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a8598457-2d99-4569-940d-8cd2f3445bc5 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:23.313957 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a8598457-2d99-4569-940d-8cd2f3445bc5 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:23.314849 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a8598457-2d99-4569-940d-8cd2f3445bc5 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:23.315541 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a8598457-2d99-4569-940d-8cd2f3445bc5 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:23.738242 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-a8598457-2d99-4569-940d-8cd2f3445bc5 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d60caf368842b2aec08f0f5e14353a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c95e4b5695439dbc3f66a911264026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:23.746257 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a8598457-2d99-4569-940d-8cd2f3445bc5 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "GET /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b" status: 200 len: 1391 microversion: 2.1 time: 0.446571 Jan 15 20:51:23.746920 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 512/965] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:23 2022] GET /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b => generated 1391 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:23.751470 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b6576158-f6ae-4f4c-a1b3-6550b7686878 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:23.752023 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b6576158-f6ae-4f4c-a1b3-6550b7686878 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] [instance: ecba885c-f344-480e-9efc-707d1c542d42] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:23.757977 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b6576158-f6ae-4f4c-a1b3-6550b7686878 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:23.758489 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b6576158-f6ae-4f4c-a1b3-6550b7686878 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:23.759333 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b6576158-f6ae-4f4c-a1b3-6550b7686878 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:23.759847 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b6576158-f6ae-4f4c-a1b3-6550b7686878 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:23.792133 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b6576158-f6ae-4f4c-a1b3-6550b7686878 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] [instance: ecba885c-f344-480e-9efc-707d1c542d42] Going to try to terminate instance {{(pid=129366) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 20:51:23.875539 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b6576158-f6ae-4f4c-a1b3-6550b7686878 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "DELETE /compute/v2.1/servers/ecba885c-f344-480e-9efc-707d1c542d42" status: 204 len: 0 microversion: 2.1 time: 0.127193 Jan 15 20:51:23.876235 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 513/966] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 20:51:23 2022] DELETE /compute/v2.1/servers/ecba885c-f344-480e-9efc-707d1c542d42 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 20:51:23.883238 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-63619dfb-89dd-427c-aeee-07d08bc1b6d9 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:23.884184 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-63619dfb-89dd-427c-aeee-07d08bc1b6d9 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] [instance: b18c4fdc-6965-4c52-85f5-824ba94b4ad8] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:23.895334 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-63619dfb-89dd-427c-aeee-07d08bc1b6d9 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:23.896081 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-63619dfb-89dd-427c-aeee-07d08bc1b6d9 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:23.897271 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-63619dfb-89dd-427c-aeee-07d08bc1b6d9 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:23.897806 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-63619dfb-89dd-427c-aeee-07d08bc1b6d9 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:24.239991 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-63619dfb-89dd-427c-aeee-07d08bc1b6d9 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25473d022e7f438fa6495288f53caa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f471d81a59824fc8afaf454a65e99933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:24.248176 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-63619dfb-89dd-427c-aeee-07d08bc1b6d9 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] 10.222.0.46 "GET /compute/v2.1/servers/b18c4fdc-6965-4c52-85f5-824ba94b4ad8" status: 200 len: 1324 microversion: 2.1 time: 0.370504 Jan 15 20:51:24.248860 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 514/967] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:23 2022] GET /compute/v2.1/servers/b18c4fdc-6965-4c52-85f5-824ba94b4ad8 => generated 1324 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:24.253363 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-31c14e0b-5f0e-472b-95b1-ddf2578ac117 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:51:24.254557 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-31c14e0b-5f0e-472b-95b1-ddf2578ac117 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: d603f11b-5d49-492b-b541-1826486876ef] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:24.260785 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-31c14e0b-5f0e-472b-95b1-ddf2578ac117 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:24.261308 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-31c14e0b-5f0e-472b-95b1-ddf2578ac117 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:24.262102 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-31c14e0b-5f0e-472b-95b1-ddf2578ac117 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:24.262566 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-31c14e0b-5f0e-472b-95b1-ddf2578ac117 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:24.342856 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3a793b95-9acf-48da-885a-a6d199e3b337 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] 10.222.0.46 "DELETE /compute/v2.1/os-floating-ips/4bd356c2-3fa8-4ea1-8efb-2f7bdbf77f6f" status: 202 len: 0 microversion: 2.1 time: 1.565951 Jan 15 20:51:24.343448 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 454/968] 10.222.0.46 () {58 vars in 1262 bytes} [Sat Jan 15 20:51:22 2022] DELETE /compute/v2.1/os-floating-ips/4bd356c2-3fa8-4ea1-8efb-2f7bdbf77f6f => generated 0 bytes in 1567 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 20:51:24.348161 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-6176505d-bc24-4288-b43c-423e30f56015 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:24.348762 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-6176505d-bc24-4288-b43c-423e30f56015 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] [instance: 61233bc7-f90a-439f-b0c6-e6856c8c71a0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:24.358483 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-31c14e0b-5f0e-472b-95b1-ddf2578ac117 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:24.358841 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6176505d-bc24-4288-b43c-423e30f56015 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:24.359512 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6176505d-bc24-4288-b43c-423e30f56015 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:24.360738 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6176505d-bc24-4288-b43c-423e30f56015 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:24.361662 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6176505d-bc24-4288-b43c-423e30f56015 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:24.365513 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-31c14e0b-5f0e-472b-95b1-ddf2578ac117 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: d603f11b-5d49-492b-b541-1826486876ef] Old instance type tempest-test_resize_flavor_-109036701, new instance type m1.heat {{(pid=129366) resize /opt/stack/nova/nova/compute/api.py:4097}} Jan 15 20:51:24.371824 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-31c14e0b-5f0e-472b-95b1-ddf2578ac117 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Flavor limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 20:51:24.372243 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-31c14e0b-5f0e-472b-95b1-ddf2578ac117 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Image limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 20:51:24.372892 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-31c14e0b-5f0e-472b-95b1-ddf2578ac117 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Flavor pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 20:51:24.373473 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-31c14e0b-5f0e-472b-95b1-ddf2578ac117 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Image pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 20:51:24.374023 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-31c14e0b-5f0e-472b-95b1-ddf2578ac117 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 20:51:24.497468 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-31c14e0b-5f0e-472b-95b1-ddf2578ac117 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "POST /compute/v2.1/servers/d603f11b-5d49-492b-b541-1826486876ef/action" status: 202 len: 0 microversion: 2.1 time: 0.247354 Jan 15 20:51:24.498685 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 515/969] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:51:24 2022] POST /compute/v2.1/servers/d603f11b-5d49-492b-b541-1826486876ef/action => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 20:51:24.503494 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-72fb0b65-75d2-4ff2-adac-fe904cb0e9ab tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:24.504282 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-72fb0b65-75d2-4ff2-adac-fe904cb0e9ab tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] [instance: b191ed6c-040a-4702-8e15-86272f9d1847] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:24.512099 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-72fb0b65-75d2-4ff2-adac-fe904cb0e9ab tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:24.512556 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-72fb0b65-75d2-4ff2-adac-fe904cb0e9ab tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:24.513389 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-72fb0b65-75d2-4ff2-adac-fe904cb0e9ab tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:24.513988 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-72fb0b65-75d2-4ff2-adac-fe904cb0e9ab tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:24.688657 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-6176505d-bc24-4288-b43c-423e30f56015 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc38f86758f9416b9e7f6915de0359d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8cfe33be708428abef52f5e8e25621b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:24.698947 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-6176505d-bc24-4288-b43c-423e30f56015 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] 10.222.0.46 "GET /compute/v2.1/servers/61233bc7-f90a-439f-b0c6-e6856c8c71a0" status: 200 len: 1317 microversion: 2.1 time: 0.354425 Jan 15 20:51:24.700180 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 455/970] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:24 2022] GET /compute/v2.1/servers/61233bc7-f90a-439f-b0c6-e6856c8c71a0 => generated 1317 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:24.708279 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-a047e113-33b6-4c63-a866-e4fb3955415b req-45c0c557-06c2-49d8-bff9-848447dcca70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b18c4fdc-6965-4c52-85f5-824ba94b4ad8", "tag": "37191f5f-92f4-4372-9435-1f2eddb92f24"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:51:24.714613 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:51:24.714613 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:51:24.722998 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-a047e113-33b6-4c63-a866-e4fb3955415b req-45c0c557-06c2-49d8-bff9-848447dcca70 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:24.723640 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-a047e113-33b6-4c63-a866-e4fb3955415b req-45c0c557-06c2-49d8-bff9-848447dcca70 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:24.738037 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-a047e113-33b6-4c63-a866-e4fb3955415b req-45c0c557-06c2-49d8-bff9-848447dcca70 service nova] Creating event network-changed:37191f5f-92f4-4372-9435-1f2eddb92f24 for instance b18c4fdc-6965-4c52-85f5-824ba94b4ad8 on nch1-master-1 Jan 15 20:51:24.744787 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-a047e113-33b6-4c63-a866-e4fb3955415b req-45c0c557-06c2-49d8-bff9-848447dcca70 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040361 Jan 15 20:51:24.746406 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 456/971] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:51:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:51:24.761115 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-038cc47b-1de6-4047-98d5-dbb5b2e3af5e tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-668107273", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "networks": [{"uuid": "364a58d7-d200-4c35-b6bd-a666c20a1fe8"}]}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:51:24.796254 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-72fb0b65-75d2-4ff2-adac-fe904cb0e9ab tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d4a57cfaa145009ba9cc8f21d9e8ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4a26c8edac44c8b26fd4e43813412d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:24.815418 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-72fb0b65-75d2-4ff2-adac-fe904cb0e9ab tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] 10.222.0.46 "GET /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847" status: 200 len: 1472 microversion: 2.1 time: 0.315427 Jan 15 20:51:24.825123 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 516/972] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:24 2022] GET /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847 => generated 1472 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:24.825123 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-151098b7-1603-41d7-a15a-75a45a444055 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:24.825123 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-151098b7-1603-41d7-a15a-75a45a444055 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] [instance: 42618a48-fe11-4f55-bed2-738d2cc8a07f] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:24.837591 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-151098b7-1603-41d7-a15a-75a45a444055 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:24.838244 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-151098b7-1603-41d7-a15a-75a45a444055 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:24.847080 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.network.neutron [None req-038cc47b-1de6-4047-98d5-dbb5b2e3af5e tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] validate_networks() for [('364a58d7-d200-4c35-b6bd-a666c20a1fe8', None, None, None, None, None)] {{(pid=129365) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 20:51:24.847406 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-151098b7-1603-41d7-a15a-75a45a444055 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:24.847854 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-151098b7-1603-41d7-a15a-75a45a444055 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:25.488035 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-151098b7-1603-41d7-a15a-75a45a444055 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:25.498840 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-151098b7-1603-41d7-a15a-75a45a444055 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:25.500711 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-151098b7-1603-41d7-a15a-75a45a444055 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:25.502171 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-151098b7-1603-41d7-a15a-75a45a444055 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] 10.222.0.46 "GET /compute/v2.1/servers/42618a48-fe11-4f55-bed2-738d2cc8a07f" status: 200 len: 1362 microversion: 2.25 time: 0.684394 Jan 15 20:51:25.502736 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 517/973] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:51:24 2022] GET /compute/v2.1/servers/42618a48-fe11-4f55-bed2-738d2cc8a07f => generated 1362 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:51:25.508967 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0ef1310d-5fe3-47a4-8bd9-d3e7d808f91e tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:51:25.510457 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0ef1310d-5fe3-47a4-8bd9-d3e7d808f91e tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:51:25.511566 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0ef1310d-5fe3-47a4-8bd9-d3e7d808f91e tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] 10.222.0.46 "POST /compute/v2.1/servers/69b95b86-744d-4552-a0fc-6ced4d9ef38d/action" status: 400 len: 142 microversion: 2.1 time: 0.007925 Jan 15 20:51:25.516881 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 518/974] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:51:25 2022] POST /compute/v2.1/servers/69b95b86-744d-4552-a0fc-6ced4d9ef38d/action => generated 142 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 15 20:51:25.522230 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c3de22cf-d82c-4df6-8b0c-9a6cc7c87e8d tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:25.522833 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c3de22cf-d82c-4df6-8b0c-9a6cc7c87e8d tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: d603f11b-5d49-492b-b541-1826486876ef] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:25.529473 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c3de22cf-d82c-4df6-8b0c-9a6cc7c87e8d tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:25.529918 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c3de22cf-d82c-4df6-8b0c-9a6cc7c87e8d tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:25.530694 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c3de22cf-d82c-4df6-8b0c-9a6cc7c87e8d tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:25.531122 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c3de22cf-d82c-4df6-8b0c-9a6cc7c87e8d tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:25.901514 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-c3de22cf-d82c-4df6-8b0c-9a6cc7c87e8d tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:25.909712 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c3de22cf-d82c-4df6-8b0c-9a6cc7c87e8d tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/d603f11b-5d49-492b-b541-1826486876ef" status: 200 len: 1536 microversion: 2.1 time: 0.391663 Jan 15 20:51:25.910286 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 519/975] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:25 2022] GET /compute/v2.1/servers/d603f11b-5d49-492b-b541-1826486876ef => generated 1536 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:25.915292 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-48831a68-fe4a-4259-af2e-2d9017bc58c1 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:25.915888 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-48831a68-fe4a-4259-af2e-2d9017bc58c1 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 57bd310f-a604-40de-9c25-882284f4a17b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:25.922784 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-48831a68-fe4a-4259-af2e-2d9017bc58c1 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:25.923232 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-48831a68-fe4a-4259-af2e-2d9017bc58c1 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:25.924003 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-48831a68-fe4a-4259-af2e-2d9017bc58c1 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:25.924437 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-48831a68-fe4a-4259-af2e-2d9017bc58c1 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:25.951721 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-038cc47b-1de6-4047-98d5-dbb5b2e3af5e tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Flavor limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 20:51:25.952747 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-038cc47b-1de6-4047-98d5-dbb5b2e3af5e tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Image limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 20:51:25.953694 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-038cc47b-1de6-4047-98d5-dbb5b2e3af5e tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Flavor pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 20:51:25.954261 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-038cc47b-1de6-4047-98d5-dbb5b2e3af5e tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Image pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 20:51:25.955503 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-038cc47b-1de6-4047-98d5-dbb5b2e3af5e tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 20:51:25.969260 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-038cc47b-1de6-4047-98d5-dbb5b2e3af5e tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:25.970123 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-038cc47b-1de6-4047-98d5-dbb5b2e3af5e tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:25.971074 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-038cc47b-1de6-4047-98d5-dbb5b2e3af5e tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:25.971767 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-038cc47b-1de6-4047-98d5-dbb5b2e3af5e tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:25.997001 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-038cc47b-1de6-4047-98d5-dbb5b2e3af5e tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Getting quotas for project 31dd217e7fd648b4a78c0c32ff1c95f4. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:51:26.001012 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-038cc47b-1de6-4047-98d5-dbb5b2e3af5e tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Getting quotas for user b55be87ae7f14b499ab2cd6fc5538988 and project 31dd217e7fd648b4a78c0c32ff1c95f4. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:51:26.017647 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-038cc47b-1de6-4047-98d5-dbb5b2e3af5e tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Going to run 1 instances... {{(pid=129365) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 20:51:26.020368 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-038cc47b-1de6-4047-98d5-dbb5b2e3af5e tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] [instance: 067b97a2-ee1a-4d43-926c-11a8bfa2e332] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129365) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 20:51:26.068162 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-038cc47b-1de6-4047-98d5-dbb5b2e3af5e tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.319792 Jan 15 20:51:26.069607 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 457/976] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 20:51:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1322 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 20:51:26.074327 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-2e164d4d-2058-46d8-8f49-2ee3a606e9d2 req-6915c8d5-a577-47d1-bd1d-aaef621080b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42618a48-fe11-4f55-bed2-738d2cc8a07f", "name": "network-vif-plugged", "status": "completed", "tag": "21a10db9-cd2b-430c-a0f4-3a2be36756f3"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:51:26.076226 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:51:26.076226 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:51:26.091171 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-2e164d4d-2058-46d8-8f49-2ee3a606e9d2 req-6915c8d5-a577-47d1-bd1d-aaef621080b0 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:26.091404 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-2e164d4d-2058-46d8-8f49-2ee3a606e9d2 req-6915c8d5-a577-47d1-bd1d-aaef621080b0 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:26.112491 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-2e164d4d-2058-46d8-8f49-2ee3a606e9d2 req-6915c8d5-a577-47d1-bd1d-aaef621080b0 service nova] Creating event network-vif-plugged:21a10db9-cd2b-430c-a0f4-3a2be36756f3 for instance 42618a48-fe11-4f55-bed2-738d2cc8a07f on nch1-master-1 Jan 15 20:51:26.120349 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-2e164d4d-2058-46d8-8f49-2ee3a606e9d2 req-6915c8d5-a577-47d1-bd1d-aaef621080b0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049295 Jan 15 20:51:26.125433 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 458/977] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:51:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:51:26.132872 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b03961db-1211-4642-8b5a-c8644648704f tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:26.133714 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b03961db-1211-4642-8b5a-c8644648704f tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] [instance: b18c4fdc-6965-4c52-85f5-824ba94b4ad8] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:26.141823 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b03961db-1211-4642-8b5a-c8644648704f tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:26.142342 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b03961db-1211-4642-8b5a-c8644648704f tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:26.143205 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b03961db-1211-4642-8b5a-c8644648704f tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:26.143710 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b03961db-1211-4642-8b5a-c8644648704f tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:26.177446 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-48831a68-fe4a-4259-af2e-2d9017bc58c1 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d60caf368842b2aec08f0f5e14353a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c95e4b5695439dbc3f66a911264026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:26.203898 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-48831a68-fe4a-4259-af2e-2d9017bc58c1 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "GET /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b" status: 200 len: 1391 microversion: 2.1 time: 0.291613 Jan 15 20:51:26.204517 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 520/978] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:25 2022] GET /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b => generated 1391 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:26.217586 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7a638f46-ef60-4ea8-8bad-74a8ee1eaf83 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:51:26.219423 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-7a638f46-ef60-4ea8-8bad-74a8ee1eaf83 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] [instance: 69b95b86-744d-4552-a0fc-6ced4d9ef38d] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:26.228252 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7a638f46-ef60-4ea8-8bad-74a8ee1eaf83 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:26.230246 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7a638f46-ef60-4ea8-8bad-74a8ee1eaf83 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:26.231296 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7a638f46-ef60-4ea8-8bad-74a8ee1eaf83 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:26.231698 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7a638f46-ef60-4ea8-8bad-74a8ee1eaf83 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:26.263734 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7a638f46-ef60-4ea8-8bad-74a8ee1eaf83 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Acquired lock "refresh_cache-69b95b86-744d-4552-a0fc-6ced4d9ef38d" {{(pid=129366) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jan 15 20:51:26.494686 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7a638f46-ef60-4ea8-8bad-74a8ee1eaf83 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Releasing lock "refresh_cache-69b95b86-744d-4552-a0fc-6ced4d9ef38d" {{(pid=129366) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jan 15 20:51:26.496316 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-7a638f46-ef60-4ea8-8bad-74a8ee1eaf83 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] HTTP exception thrown: floating IP not found Jan 15 20:51:26.497216 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7a638f46-ef60-4ea8-8bad-74a8ee1eaf83 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Returning 404 to user: floating IP not found {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:51:26.498066 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7a638f46-ef60-4ea8-8bad-74a8ee1eaf83 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] 10.222.0.46 "POST /compute/v2.1/servers/69b95b86-744d-4552-a0fc-6ced4d9ef38d/action" status: 404 len: 67 microversion: 2.1 time: 0.290858 Jan 15 20:51:26.499025 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 521/979] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:51:26 2022] POST /compute/v2.1/servers/69b95b86-744d-4552-a0fc-6ced4d9ef38d/action => generated 67 bytes in 292 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jan 15 20:51:26.504003 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-14691a5f-9033-4eb5-87fa-612584501c72 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:26.506501 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-14691a5f-9033-4eb5-87fa-612584501c72 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] [instance: 61233bc7-f90a-439f-b0c6-e6856c8c71a0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:26.516701 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-14691a5f-9033-4eb5-87fa-612584501c72 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:26.517477 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-14691a5f-9033-4eb5-87fa-612584501c72 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:26.518440 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-14691a5f-9033-4eb5-87fa-612584501c72 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:26.519316 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-14691a5f-9033-4eb5-87fa-612584501c72 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:26.548131 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-b03961db-1211-4642-8b5a-c8644648704f tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25473d022e7f438fa6495288f53caa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f471d81a59824fc8afaf454a65e99933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:26.558655 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b03961db-1211-4642-8b5a-c8644648704f tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] 10.222.0.46 "GET /compute/v2.1/servers/b18c4fdc-6965-4c52-85f5-824ba94b4ad8" status: 200 len: 1324 microversion: 2.1 time: 0.431901 Jan 15 20:51:26.573257 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 459/980] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:26 2022] GET /compute/v2.1/servers/b18c4fdc-6965-4c52-85f5-824ba94b4ad8 => generated 1324 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:26.580440 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-abee9c75-eb3b-4bca-86e1-04e86978b1c6 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:26.581071 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-abee9c75-eb3b-4bca-86e1-04e86978b1c6 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] [instance: b191ed6c-040a-4702-8e15-86272f9d1847] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:26.595346 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-abee9c75-eb3b-4bca-86e1-04e86978b1c6 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:26.595801 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-abee9c75-eb3b-4bca-86e1-04e86978b1c6 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:26.596593 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-abee9c75-eb3b-4bca-86e1-04e86978b1c6 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:26.598440 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-abee9c75-eb3b-4bca-86e1-04e86978b1c6 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:26.755119 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-14691a5f-9033-4eb5-87fa-612584501c72 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc38f86758f9416b9e7f6915de0359d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8cfe33be708428abef52f5e8e25621b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:26.770864 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-14691a5f-9033-4eb5-87fa-612584501c72 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] 10.222.0.46 "GET /compute/v2.1/servers/61233bc7-f90a-439f-b0c6-e6856c8c71a0" status: 200 len: 1317 microversion: 2.1 time: 0.268756 Jan 15 20:51:26.772591 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 522/981] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:26 2022] GET /compute/v2.1/servers/61233bc7-f90a-439f-b0c6-e6856c8c71a0 => generated 1317 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:26.780082 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-002a0ddb-2e81-4201-b758-31c6deb2e384 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:26.781028 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-002a0ddb-2e81-4201-b758-31c6deb2e384 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] [instance: 067b97a2-ee1a-4d43-926c-11a8bfa2e332] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:26.789693 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-002a0ddb-2e81-4201-b758-31c6deb2e384 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:26.790382 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-002a0ddb-2e81-4201-b758-31c6deb2e384 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:26.791396 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-002a0ddb-2e81-4201-b758-31c6deb2e384 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:26.792046 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-002a0ddb-2e81-4201-b758-31c6deb2e384 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:26.874154 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-002a0ddb-2e81-4201-b758-31c6deb2e384 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55be87ae7f14b499ab2cd6fc5538988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd217e7fd648b4a78c0c32ff1c95f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:26.879962 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-abee9c75-eb3b-4bca-86e1-04e86978b1c6 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d4a57cfaa145009ba9cc8f21d9e8ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4a26c8edac44c8b26fd4e43813412d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:26.882292 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-002a0ddb-2e81-4201-b758-31c6deb2e384 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "GET /compute/v2.1/servers/067b97a2-ee1a-4d43-926c-11a8bfa2e332" status: 200 len: 1203 microversion: 2.1 time: 0.108407 Jan 15 20:51:26.883403 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 523/982] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:26 2022] GET /compute/v2.1/servers/067b97a2-ee1a-4d43-926c-11a8bfa2e332 => generated 1203 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:26.887898 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-5af81ccb-4fe3-4531-9000-f3700a2e3819 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Action: 'action', calling method: .version_select at 0x7f30cba258b0>, body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:51:26.900506 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-abee9c75-eb3b-4bca-86e1-04e86978b1c6 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] 10.222.0.46 "GET /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847" status: 200 len: 1472 microversion: 2.1 time: 0.325584 Jan 15 20:51:26.901790 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 460/983] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:26 2022] GET /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847 => generated 1472 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:26.906651 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-1cc5fa9d-55db-454c-9507-15088ab815a4 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:26.909812 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-1cc5fa9d-55db-454c-9507-15088ab815a4 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] [instance: 42618a48-fe11-4f55-bed2-738d2cc8a07f] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:26.919653 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1cc5fa9d-55db-454c-9507-15088ab815a4 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:26.920251 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1cc5fa9d-55db-454c-9507-15088ab815a4 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:26.921092 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1cc5fa9d-55db-454c-9507-15088ab815a4 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:26.921535 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1cc5fa9d-55db-454c-9507-15088ab815a4 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:26.967666 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-5af81ccb-4fe3-4531-9000-f3700a2e3819 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Jan 15 20:51:26.968499 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-5af81ccb-4fe3-4531-9000-f3700a2e3819 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:51:26.969572 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-5af81ccb-4fe3-4531-9000-f3700a2e3819 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] 10.222.0.46 "POST /compute/v2.1/servers/69b95b86-744d-4552-a0fc-6ced4d9ef38d/action" status: 404 len: 88 microversion: 2.1 time: 0.084983 Jan 15 20:51:26.970549 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 524/984] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:51:26 2022] POST /compute/v2.1/servers/69b95b86-744d-4552-a0fc-6ced4d9ef38d/action => generated 88 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jan 15 20:51:26.978398 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-2b9b4a8e-172a-448a-aa37-4ab2e5c460aa tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:26.979376 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-2b9b4a8e-172a-448a-aa37-4ab2e5c460aa tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: d603f11b-5d49-492b-b541-1826486876ef] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:26.988647 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2b9b4a8e-172a-448a-aa37-4ab2e5c460aa tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:26.989215 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2b9b4a8e-172a-448a-aa37-4ab2e5c460aa tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:26.990226 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2b9b4a8e-172a-448a-aa37-4ab2e5c460aa tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:26.991442 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2b9b4a8e-172a-448a-aa37-4ab2e5c460aa tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:27.107949 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-1cc5fa9d-55db-454c-9507-15088ab815a4 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:27.118142 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-1cc5fa9d-55db-454c-9507-15088ab815a4 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:27.120932 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-1cc5fa9d-55db-454c-9507-15088ab815a4 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:27.122279 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-1cc5fa9d-55db-454c-9507-15088ab815a4 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] 10.222.0.46 "GET /compute/v2.1/servers/42618a48-fe11-4f55-bed2-738d2cc8a07f" status: 200 len: 1362 microversion: 2.25 time: 0.219207 Jan 15 20:51:27.123564 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 461/985] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:51:26 2022] GET /compute/v2.1/servers/42618a48-fe11-4f55-bed2-738d2cc8a07f => generated 1362 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:51:27.128727 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e3dfb2e3-4ee8-40bb-9467-08a1dbea4c35 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:27.129271 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e3dfb2e3-4ee8-40bb-9467-08a1dbea4c35 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] [instance: 69b95b86-744d-4552-a0fc-6ced4d9ef38d] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:27.135778 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e3dfb2e3-4ee8-40bb-9467-08a1dbea4c35 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:27.136479 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e3dfb2e3-4ee8-40bb-9467-08a1dbea4c35 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:27.138153 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e3dfb2e3-4ee8-40bb-9467-08a1dbea4c35 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:27.138755 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e3dfb2e3-4ee8-40bb-9467-08a1dbea4c35 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:27.167802 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e3dfb2e3-4ee8-40bb-9467-08a1dbea4c35 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] [instance: 69b95b86-744d-4552-a0fc-6ced4d9ef38d] Going to try to terminate instance {{(pid=129365) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 20:51:27.186699 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-2b9b4a8e-172a-448a-aa37-4ab2e5c460aa tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:27.198407 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-2b9b4a8e-172a-448a-aa37-4ab2e5c460aa tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/d603f11b-5d49-492b-b541-1826486876ef" status: 200 len: 1536 microversion: 2.1 time: 0.226539 Jan 15 20:51:27.199357 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 525/986] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:26 2022] GET /compute/v2.1/servers/d603f11b-5d49-492b-b541-1826486876ef => generated 1536 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:27.204542 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-e79ff189-b884-483d-b556-7935f51f3c69 req-0805a1e8-14ae-4b18-a7ef-2686937dffef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecba885c-f344-480e-9efc-707d1c542d42", "name": "network-vif-deleted", "tag": "6896d9fc-c7c9-4e4b-8bf1-aaae0b89dd3f"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:51:27.206143 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:51:27.206143 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:51:27.217286 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-e79ff189-b884-483d-b556-7935f51f3c69 req-0805a1e8-14ae-4b18-a7ef-2686937dffef service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:27.217780 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-e79ff189-b884-483d-b556-7935f51f3c69 req-0805a1e8-14ae-4b18-a7ef-2686937dffef service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:27.231287 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-e79ff189-b884-483d-b556-7935f51f3c69 req-0805a1e8-14ae-4b18-a7ef-2686937dffef service nova] Creating event network-vif-deleted:6896d9fc-c7c9-4e4b-8bf1-aaae0b89dd3f for instance ecba885c-f344-480e-9efc-707d1c542d42 on nch1-master-1 Jan 15 20:51:27.238166 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-e79ff189-b884-483d-b556-7935f51f3c69 req-0805a1e8-14ae-4b18-a7ef-2686937dffef service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037341 Jan 15 20:51:27.239310 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 526/987] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:51:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:51:27.245422 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f806ad65-66f4-40f5-b90b-c484985620d7 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:27.246121 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f806ad65-66f4-40f5-b90b-c484985620d7 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 57bd310f-a604-40de-9c25-882284f4a17b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:27.252346 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f806ad65-66f4-40f5-b90b-c484985620d7 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:27.252799 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f806ad65-66f4-40f5-b90b-c484985620d7 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:27.253670 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f806ad65-66f4-40f5-b90b-c484985620d7 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:27.254198 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f806ad65-66f4-40f5-b90b-c484985620d7 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:27.267933 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e3dfb2e3-4ee8-40bb-9467-08a1dbea4c35 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] 10.222.0.46 "DELETE /compute/v2.1/servers/69b95b86-744d-4552-a0fc-6ced4d9ef38d" status: 204 len: 0 microversion: 2.1 time: 0.142801 Jan 15 20:51:27.272938 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 462/988] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 20:51:27 2022] DELETE /compute/v2.1/servers/69b95b86-744d-4552-a0fc-6ced4d9ef38d => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 20:51:27.278560 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8195f398-710f-4092-b87b-12f70e9667a1 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:27.279407 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-8195f398-710f-4092-b87b-12f70e9667a1 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] [instance: 69b95b86-744d-4552-a0fc-6ced4d9ef38d] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:27.286531 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8195f398-710f-4092-b87b-12f70e9667a1 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:27.287152 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8195f398-710f-4092-b87b-12f70e9667a1 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:27.288326 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8195f398-710f-4092-b87b-12f70e9667a1 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:27.288823 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8195f398-710f-4092-b87b-12f70e9667a1 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:27.460813 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-f806ad65-66f4-40f5-b90b-c484985620d7 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d60caf368842b2aec08f0f5e14353a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c95e4b5695439dbc3f66a911264026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:27.479749 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f806ad65-66f4-40f5-b90b-c484985620d7 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "GET /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b" status: 200 len: 1391 microversion: 2.1 time: 0.238701 Jan 15 20:51:27.481833 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 527/989] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:27 2022] GET /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b => generated 1391 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:27.502053 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-8195f398-710f-4092-b87b-12f70e9667a1 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02b23752962428b825b6f7757f54007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f60a2e220b479abf4b04536ed406e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:27.513435 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-8195f398-710f-4092-b87b-12f70e9667a1 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] 10.222.0.46 "GET /compute/v2.1/servers/69b95b86-744d-4552-a0fc-6ced4d9ef38d" status: 200 len: 1542 microversion: 2.1 time: 0.239147 Jan 15 20:51:27.514100 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 463/990] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:27 2022] GET /compute/v2.1/servers/69b95b86-744d-4552-a0fc-6ced4d9ef38d => generated 1542 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:27.580406 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-91e59822-d2c9-4a05-9e6f-36bdc44e0dd9 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:27.581708 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-91e59822-d2c9-4a05-9e6f-36bdc44e0dd9 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] [instance: b18c4fdc-6965-4c52-85f5-824ba94b4ad8] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:27.590173 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-91e59822-d2c9-4a05-9e6f-36bdc44e0dd9 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:27.590859 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-91e59822-d2c9-4a05-9e6f-36bdc44e0dd9 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:27.591839 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-91e59822-d2c9-4a05-9e6f-36bdc44e0dd9 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:27.592266 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-91e59822-d2c9-4a05-9e6f-36bdc44e0dd9 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:27.735154 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-91e59822-d2c9-4a05-9e6f-36bdc44e0dd9 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25473d022e7f438fa6495288f53caa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f471d81a59824fc8afaf454a65e99933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:27.742801 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-91e59822-d2c9-4a05-9e6f-36bdc44e0dd9 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] 10.222.0.46 "GET /compute/v2.1/servers/b18c4fdc-6965-4c52-85f5-824ba94b4ad8" status: 200 len: 1324 microversion: 2.1 time: 0.167576 Jan 15 20:51:27.743382 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 528/991] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:27 2022] GET /compute/v2.1/servers/b18c4fdc-6965-4c52-85f5-824ba94b4ad8 => generated 1324 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:27.789214 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-1f80dfc7-d073-4ef6-af02-4350fb63ccc5 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:27.789807 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-1f80dfc7-d073-4ef6-af02-4350fb63ccc5 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] [instance: 61233bc7-f90a-439f-b0c6-e6856c8c71a0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:27.796199 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1f80dfc7-d073-4ef6-af02-4350fb63ccc5 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:27.796639 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1f80dfc7-d073-4ef6-af02-4350fb63ccc5 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:27.797464 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1f80dfc7-d073-4ef6-af02-4350fb63ccc5 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:27.797895 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1f80dfc7-d073-4ef6-af02-4350fb63ccc5 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:27.899555 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-827915ac-b5eb-4bff-8209-b0d6848f18b5 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:27.900296 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-827915ac-b5eb-4bff-8209-b0d6848f18b5 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] [instance: 067b97a2-ee1a-4d43-926c-11a8bfa2e332] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:27.906921 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-827915ac-b5eb-4bff-8209-b0d6848f18b5 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:27.907508 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-827915ac-b5eb-4bff-8209-b0d6848f18b5 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:27.908312 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-827915ac-b5eb-4bff-8209-b0d6848f18b5 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:27.909007 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-827915ac-b5eb-4bff-8209-b0d6848f18b5 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:27.935847 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-1f80dfc7-d073-4ef6-af02-4350fb63ccc5 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc38f86758f9416b9e7f6915de0359d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8cfe33be708428abef52f5e8e25621b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:27.944262 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-1f80dfc7-d073-4ef6-af02-4350fb63ccc5 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] 10.222.0.46 "GET /compute/v2.1/servers/61233bc7-f90a-439f-b0c6-e6856c8c71a0" status: 200 len: 1317 microversion: 2.1 time: 0.159192 Jan 15 20:51:27.948979 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 464/992] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:27 2022] GET /compute/v2.1/servers/61233bc7-f90a-439f-b0c6-e6856c8c71a0 => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:27.950658 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e4c76abe-fa2a-4819-b916-74261c2bb891 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:27.951435 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e4c76abe-fa2a-4819-b916-74261c2bb891 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] [instance: b191ed6c-040a-4702-8e15-86272f9d1847] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:27.958320 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e4c76abe-fa2a-4819-b916-74261c2bb891 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:27.959321 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e4c76abe-fa2a-4819-b916-74261c2bb891 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:27.960234 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e4c76abe-fa2a-4819-b916-74261c2bb891 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:27.960905 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e4c76abe-fa2a-4819-b916-74261c2bb891 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:27.989190 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-827915ac-b5eb-4bff-8209-b0d6848f18b5 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55be87ae7f14b499ab2cd6fc5538988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd217e7fd648b4a78c0c32ff1c95f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:27.997714 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-827915ac-b5eb-4bff-8209-b0d6848f18b5 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "GET /compute/v2.1/servers/067b97a2-ee1a-4d43-926c-11a8bfa2e332" status: 200 len: 1265 microversion: 2.1 time: 0.101966 Jan 15 20:51:28.009019 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 529/993] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:27 2022] GET /compute/v2.1/servers/067b97a2-ee1a-4d43-926c-11a8bfa2e332 => generated 1265 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:51:28.125275 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-e4c76abe-fa2a-4819-b916-74261c2bb891 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d4a57cfaa145009ba9cc8f21d9e8ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4a26c8edac44c8b26fd4e43813412d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:28.133811 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e4c76abe-fa2a-4819-b916-74261c2bb891 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] 10.222.0.46 "GET /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847" status: 200 len: 1472 microversion: 2.1 time: 0.187570 Jan 15 20:51:28.134511 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 465/994] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:27 2022] GET /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847 => generated 1472 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:28.137721 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-b678f8ef-7470-4d81-8aad-c7e1799ba351 req-15b43de7-c206-4e48-89f5-3e07f656628a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57bd310f-a604-40de-9c25-882284f4a17b", "name": "network-vif-plugged", "status": "completed", "tag": "b8144bdd-0e36-42d0-ae5a-b27a87dabd70"}, {"server_uuid": "61233bc7-f90a-439f-b0c6-e6856c8c71a0", "name": "network-vif-plugged", "status": "completed", "tag": "efc2bb82-77b6-4192-a231-cc667bccea96"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:51:28.139828 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:51:28.139828 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:51:28.141088 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-1d0b57e7-e521-4814-b880-c15a3eacfb3f tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:28.141993 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-1d0b57e7-e521-4814-b880-c15a3eacfb3f tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] [instance: 42618a48-fe11-4f55-bed2-738d2cc8a07f] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:28.150603 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-b678f8ef-7470-4d81-8aad-c7e1799ba351 req-15b43de7-c206-4e48-89f5-3e07f656628a service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:28.151135 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-b678f8ef-7470-4d81-8aad-c7e1799ba351 req-15b43de7-c206-4e48-89f5-3e07f656628a service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:28.151426 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1d0b57e7-e521-4814-b880-c15a3eacfb3f tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:28.152540 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1d0b57e7-e521-4814-b880-c15a3eacfb3f tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:28.153452 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1d0b57e7-e521-4814-b880-c15a3eacfb3f tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:28.153872 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1d0b57e7-e521-4814-b880-c15a3eacfb3f tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:28.165513 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-b678f8ef-7470-4d81-8aad-c7e1799ba351 req-15b43de7-c206-4e48-89f5-3e07f656628a service nova] Creating event network-vif-plugged:b8144bdd-0e36-42d0-ae5a-b27a87dabd70 for instance 57bd310f-a604-40de-9c25-882284f4a17b on nch1-master-1 Jan 15 20:51:28.166027 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-b678f8ef-7470-4d81-8aad-c7e1799ba351 req-15b43de7-c206-4e48-89f5-3e07f656628a service nova] Creating event network-vif-plugged:efc2bb82-77b6-4192-a231-cc667bccea96 for instance 61233bc7-f90a-439f-b0c6-e6856c8c71a0 on nch1-master-1 Jan 15 20:51:28.172668 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-b678f8ef-7470-4d81-8aad-c7e1799ba351 req-15b43de7-c206-4e48-89f5-3e07f656628a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.038773 Jan 15 20:51:28.173493 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 530/995] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:51:28 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:51:28.216828 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-625f56ab-2b0e-441e-8007-f1b16be3b143 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:28.217483 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-625f56ab-2b0e-441e-8007-f1b16be3b143 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: d603f11b-5d49-492b-b541-1826486876ef] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:28.229186 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-625f56ab-2b0e-441e-8007-f1b16be3b143 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:28.229749 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-625f56ab-2b0e-441e-8007-f1b16be3b143 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:28.230609 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-625f56ab-2b0e-441e-8007-f1b16be3b143 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:28.231051 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-625f56ab-2b0e-441e-8007-f1b16be3b143 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:28.348637 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-1d0b57e7-e521-4814-b880-c15a3eacfb3f tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:28.360226 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-1d0b57e7-e521-4814-b880-c15a3eacfb3f tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:28.361776 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-1d0b57e7-e521-4814-b880-c15a3eacfb3f tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:28.363314 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-1d0b57e7-e521-4814-b880-c15a3eacfb3f tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] 10.222.0.46 "GET /compute/v2.1/servers/42618a48-fe11-4f55-bed2-738d2cc8a07f" status: 200 len: 1557 microversion: 2.25 time: 0.226855 Jan 15 20:51:28.363880 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 466/996] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:51:28 2022] GET /compute/v2.1/servers/42618a48-fe11-4f55-bed2-738d2cc8a07f => generated 1557 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:51:28.385346 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-0f677689-9c4d-4b44-84ed-ae5e8532576f tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:28.386083 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-0f677689-9c4d-4b44-84ed-ae5e8532576f tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] [instance: 42618a48-fe11-4f55-bed2-738d2cc8a07f] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:28.392535 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0f677689-9c4d-4b44-84ed-ae5e8532576f tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:28.393166 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0f677689-9c4d-4b44-84ed-ae5e8532576f tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:28.394115 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0f677689-9c4d-4b44-84ed-ae5e8532576f tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:28.394970 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0f677689-9c4d-4b44-84ed-ae5e8532576f tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:28.428271 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-625f56ab-2b0e-441e-8007-f1b16be3b143 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:28.436067 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-625f56ab-2b0e-441e-8007-f1b16be3b143 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/d603f11b-5d49-492b-b541-1826486876ef" status: 200 len: 1541 microversion: 2.1 time: 0.223494 Jan 15 20:51:28.447961 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 531/997] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:28 2022] GET /compute/v2.1/servers/d603f11b-5d49-492b-b541-1826486876ef => generated 1541 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:51:28.501548 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-011a3d99-faab-473a-a73e-9525895fc3c5 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:28.502434 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-011a3d99-faab-473a-a73e-9525895fc3c5 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 57bd310f-a604-40de-9c25-882284f4a17b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:28.510591 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-011a3d99-faab-473a-a73e-9525895fc3c5 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:28.511281 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-011a3d99-faab-473a-a73e-9525895fc3c5 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:28.512739 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-011a3d99-faab-473a-a73e-9525895fc3c5 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:28.513728 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-011a3d99-faab-473a-a73e-9525895fc3c5 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:28.558594 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.objects.instance [None req-0f677689-9c4d-4b44-84ed-ae5e8532576f tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Lazy-loading 'services' on Instance uuid 42618a48-fe11-4f55-bed2-738d2cc8a07f {{(pid=129365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 20:51:28.574312 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-0f677689-9c4d-4b44-84ed-ae5e8532576f tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/42618a48-fe11-4f55-bed2-738d2cc8a07f" status: 200 len: 2050 microversion: 2.25 time: 0.193065 Jan 15 20:51:28.575172 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 467/998] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:51:28 2022] GET /compute/v2.1/servers/42618a48-fe11-4f55-bed2-738d2cc8a07f => generated 2050 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 15 20:51:28.579710 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d9eb86dc-891e-4b50-879f-0fb5f1bcd1e3 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:28.580519 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d9eb86dc-891e-4b50-879f-0fb5f1bcd1e3 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] [instance: 69b95b86-744d-4552-a0fc-6ced4d9ef38d] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:28.588160 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d9eb86dc-891e-4b50-879f-0fb5f1bcd1e3 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:28.588866 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d9eb86dc-891e-4b50-879f-0fb5f1bcd1e3 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:28.589828 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d9eb86dc-891e-4b50-879f-0fb5f1bcd1e3 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:28.590429 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d9eb86dc-891e-4b50-879f-0fb5f1bcd1e3 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:28.725146 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-011a3d99-faab-473a-a73e-9525895fc3c5 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d60caf368842b2aec08f0f5e14353a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c95e4b5695439dbc3f66a911264026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:28.734216 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-011a3d99-faab-473a-a73e-9525895fc3c5 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "GET /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b" status: 200 len: 1391 microversion: 2.1 time: 0.237214 Jan 15 20:51:28.741307 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 532/999] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:28 2022] GET /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b => generated 1391 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:28.741307 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9bc95e5c-110b-438c-ba5c-dcd1c28b2630 tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:28.742270 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:51:28.742270 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:51:28.744306 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9bc95e5c-110b-438c-ba5c-dcd1c28b2630 tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:28.744754 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9bc95e5c-110b-438c-ba5c-dcd1c28b2630 tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:28.745761 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9bc95e5c-110b-438c-ba5c-dcd1c28b2630 tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:28.746306 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9bc95e5c-110b-438c-ba5c-dcd1c28b2630 tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:28.773995 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-9bc95e5c-110b-438c-ba5c-dcd1c28b2630 tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] 10.222.0.46 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.037445 Jan 15 20:51:28.780622 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 533/1000] 10.222.0.46 () {60 vars in 1216 bytes} [Sat Jan 15 20:51:28 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:51:28.788066 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-6e69df21-5824-48fe-9950-909cdf371bd4 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:28.788674 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-6e69df21-5824-48fe-9950-909cdf371bd4 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] [instance: b18c4fdc-6965-4c52-85f5-824ba94b4ad8] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:28.795678 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6e69df21-5824-48fe-9950-909cdf371bd4 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:28.796397 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6e69df21-5824-48fe-9950-909cdf371bd4 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:28.797460 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6e69df21-5824-48fe-9950-909cdf371bd4 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:28.798128 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6e69df21-5824-48fe-9950-909cdf371bd4 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:28.816963 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-d9eb86dc-891e-4b50-879f-0fb5f1bcd1e3 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02b23752962428b825b6f7757f54007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f60a2e220b479abf4b04536ed406e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:28.825325 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d9eb86dc-891e-4b50-879f-0fb5f1bcd1e3 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] 10.222.0.46 "GET /compute/v2.1/servers/69b95b86-744d-4552-a0fc-6ced4d9ef38d" status: 200 len: 1542 microversion: 2.1 time: 0.248771 Jan 15 20:51:28.836021 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 468/1001] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:28 2022] GET /compute/v2.1/servers/69b95b86-744d-4552-a0fc-6ced4d9ef38d => generated 1542 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:28.957714 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-6e69df21-5824-48fe-9950-909cdf371bd4 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25473d022e7f438fa6495288f53caa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f471d81a59824fc8afaf454a65e99933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:28.961335 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-34e4962f-aea2-4874-82cd-893d5d6b3403 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:28.962168 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-34e4962f-aea2-4874-82cd-893d5d6b3403 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] [instance: 61233bc7-f90a-439f-b0c6-e6856c8c71a0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:28.965745 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-6e69df21-5824-48fe-9950-909cdf371bd4 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] 10.222.0.46 "GET /compute/v2.1/servers/b18c4fdc-6965-4c52-85f5-824ba94b4ad8" status: 200 len: 1324 microversion: 2.1 time: 0.183524 Jan 15 20:51:28.966331 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 534/1002] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:28 2022] GET /compute/v2.1/servers/b18c4fdc-6965-4c52-85f5-824ba94b4ad8 => generated 1324 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:28.972477 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-34e4962f-aea2-4874-82cd-893d5d6b3403 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:28.974649 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-34e4962f-aea2-4874-82cd-893d5d6b3403 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:28.975862 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-34e4962f-aea2-4874-82cd-893d5d6b3403 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:28.976472 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-34e4962f-aea2-4874-82cd-893d5d6b3403 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:29.016434 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-fe8de9c0-da27-49ea-9743-8aa27f7cd35b tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:29.017380 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-fe8de9c0-da27-49ea-9743-8aa27f7cd35b tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] [instance: 067b97a2-ee1a-4d43-926c-11a8bfa2e332] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:29.026558 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fe8de9c0-da27-49ea-9743-8aa27f7cd35b tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:29.027315 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fe8de9c0-da27-49ea-9743-8aa27f7cd35b tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:29.028952 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fe8de9c0-da27-49ea-9743-8aa27f7cd35b tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:29.029578 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fe8de9c0-da27-49ea-9743-8aa27f7cd35b tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:29.273871 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-34e4962f-aea2-4874-82cd-893d5d6b3403 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc38f86758f9416b9e7f6915de0359d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8cfe33be708428abef52f5e8e25621b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:29.281727 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-34e4962f-aea2-4874-82cd-893d5d6b3403 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] 10.222.0.46 "GET /compute/v2.1/servers/61233bc7-f90a-439f-b0c6-e6856c8c71a0" status: 200 len: 1317 microversion: 2.1 time: 0.324458 Jan 15 20:51:29.282320 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 469/1003] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:28 2022] GET /compute/v2.1/servers/61233bc7-f90a-439f-b0c6-e6856c8c71a0 => generated 1317 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:29.305948 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-361e66b9-0a16-4f20-bf44-dc5162080900 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:29.306574 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-361e66b9-0a16-4f20-bf44-dc5162080900 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] [instance: b191ed6c-040a-4702-8e15-86272f9d1847] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:29.317538 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-361e66b9-0a16-4f20-bf44-dc5162080900 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:29.318501 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-361e66b9-0a16-4f20-bf44-dc5162080900 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:29.319297 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-361e66b9-0a16-4f20-bf44-dc5162080900 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:29.319840 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-361e66b9-0a16-4f20-bf44-dc5162080900 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:29.365954 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-fe8de9c0-da27-49ea-9743-8aa27f7cd35b tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55be87ae7f14b499ab2cd6fc5538988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd217e7fd648b4a78c0c32ff1c95f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:29.375221 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-fe8de9c0-da27-49ea-9743-8aa27f7cd35b tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "GET /compute/v2.1/servers/067b97a2-ee1a-4d43-926c-11a8bfa2e332" status: 200 len: 1307 microversion: 2.1 time: 0.362937 Jan 15 20:51:29.376509 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 535/1004] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:29 2022] GET /compute/v2.1/servers/067b97a2-ee1a-4d43-926c-11a8bfa2e332 => generated 1307 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:29.454356 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-46cd0888-662c-48ec-b3d3-aff8ac0def8d tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:29.455226 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-46cd0888-662c-48ec-b3d3-aff8ac0def8d tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: d603f11b-5d49-492b-b541-1826486876ef] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:29.468050 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-46cd0888-662c-48ec-b3d3-aff8ac0def8d tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:29.468771 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-46cd0888-662c-48ec-b3d3-aff8ac0def8d tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:29.469759 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-46cd0888-662c-48ec-b3d3-aff8ac0def8d tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:29.471475 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-46cd0888-662c-48ec-b3d3-aff8ac0def8d tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:29.559047 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-361e66b9-0a16-4f20-bf44-dc5162080900 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d4a57cfaa145009ba9cc8f21d9e8ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4a26c8edac44c8b26fd4e43813412d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:29.566695 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-361e66b9-0a16-4f20-bf44-dc5162080900 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] 10.222.0.46 "GET /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847" status: 200 len: 1472 microversion: 2.1 time: 0.268600 Jan 15 20:51:29.567286 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 470/1005] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:29 2022] GET /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847 => generated 1472 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:29.585626 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-817820ba-a23f-4bbc-8583-2c87ce995bdc req-84ec7757-4660-49fe-baa6-64b6c32747b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "067b97a2-ee1a-4d43-926c-11a8bfa2e332", "tag": "2dedf195-b886-49e9-99b8-57405251268c"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:51:29.587267 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:51:29.587267 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:51:29.596660 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-817820ba-a23f-4bbc-8583-2c87ce995bdc req-84ec7757-4660-49fe-baa6-64b6c32747b5 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:29.597129 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-817820ba-a23f-4bbc-8583-2c87ce995bdc req-84ec7757-4660-49fe-baa6-64b6c32747b5 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:29.618656 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-817820ba-a23f-4bbc-8583-2c87ce995bdc req-84ec7757-4660-49fe-baa6-64b6c32747b5 service nova] Creating event network-changed:2dedf195-b886-49e9-99b8-57405251268c for instance 067b97a2-ee1a-4d43-926c-11a8bfa2e332 on nch2-master-1 Jan 15 20:51:29.632712 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-817820ba-a23f-4bbc-8583-2c87ce995bdc req-84ec7757-4660-49fe-baa6-64b6c32747b5 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061246 Jan 15 20:51:29.633879 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 471/1006] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:51:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:51:29.692861 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-46cd0888-662c-48ec-b3d3-aff8ac0def8d tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:29.701548 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-46cd0888-662c-48ec-b3d3-aff8ac0def8d tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/d603f11b-5d49-492b-b541-1826486876ef" status: 200 len: 1541 microversion: 2.1 time: 0.250866 Jan 15 20:51:29.702205 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 536/1007] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:29 2022] GET /compute/v2.1/servers/d603f11b-5d49-492b-b541-1826486876ef => generated 1541 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:51:29.752028 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-238aeea1-975d-4724-af33-f6fd17770cb7 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:29.752888 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-238aeea1-975d-4724-af33-f6fd17770cb7 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 57bd310f-a604-40de-9c25-882284f4a17b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:29.759759 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-238aeea1-975d-4724-af33-f6fd17770cb7 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:29.760210 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-238aeea1-975d-4724-af33-f6fd17770cb7 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:29.761404 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-238aeea1-975d-4724-af33-f6fd17770cb7 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:29.762013 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-238aeea1-975d-4724-af33-f6fd17770cb7 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:29.845443 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-5aeb335f-5031-4f28-bdf5-7c9ea8f69249 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:29.846627 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-5aeb335f-5031-4f28-bdf5-7c9ea8f69249 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] [instance: 69b95b86-744d-4552-a0fc-6ced4d9ef38d] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:29.855909 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5aeb335f-5031-4f28-bdf5-7c9ea8f69249 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:29.856566 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5aeb335f-5031-4f28-bdf5-7c9ea8f69249 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:29.857605 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5aeb335f-5031-4f28-bdf5-7c9ea8f69249 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:29.858263 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5aeb335f-5031-4f28-bdf5-7c9ea8f69249 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:29.952171 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-238aeea1-975d-4724-af33-f6fd17770cb7 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d60caf368842b2aec08f0f5e14353a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c95e4b5695439dbc3f66a911264026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:29.964727 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-238aeea1-975d-4724-af33-f6fd17770cb7 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "GET /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b" status: 200 len: 1391 microversion: 2.1 time: 0.216758 Jan 15 20:51:29.970154 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 472/1008] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:29 2022] GET /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b => generated 1391 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:29.983982 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-74f2b1bc-071c-4a29-b5cc-14d87054c0b3 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:29.984935 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-74f2b1bc-071c-4a29-b5cc-14d87054c0b3 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] [instance: b18c4fdc-6965-4c52-85f5-824ba94b4ad8] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:29.992583 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-74f2b1bc-071c-4a29-b5cc-14d87054c0b3 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:29.993699 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-74f2b1bc-071c-4a29-b5cc-14d87054c0b3 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:29.995306 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-74f2b1bc-071c-4a29-b5cc-14d87054c0b3 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:29.995884 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-74f2b1bc-071c-4a29-b5cc-14d87054c0b3 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:30.045313 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-5aeb335f-5031-4f28-bdf5-7c9ea8f69249 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02b23752962428b825b6f7757f54007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f60a2e220b479abf4b04536ed406e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:30.055518 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-5aeb335f-5031-4f28-bdf5-7c9ea8f69249 tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] 10.222.0.46 "GET /compute/v2.1/servers/69b95b86-744d-4552-a0fc-6ced4d9ef38d" status: 200 len: 1542 microversion: 2.1 time: 0.214962 Jan 15 20:51:30.062347 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 537/1009] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:29 2022] GET /compute/v2.1/servers/69b95b86-744d-4552-a0fc-6ced4d9ef38d => generated 1542 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:30.203709 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-74f2b1bc-071c-4a29-b5cc-14d87054c0b3 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25473d022e7f438fa6495288f53caa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f471d81a59824fc8afaf454a65e99933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:30.213455 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-74f2b1bc-071c-4a29-b5cc-14d87054c0b3 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] 10.222.0.46 "GET /compute/v2.1/servers/b18c4fdc-6965-4c52-85f5-824ba94b4ad8" status: 200 len: 1324 microversion: 2.1 time: 0.233768 Jan 15 20:51:30.214471 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 473/1010] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:29 2022] GET /compute/v2.1/servers/b18c4fdc-6965-4c52-85f5-824ba94b4ad8 => generated 1324 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:51:30.299730 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b2568728-310a-4e4f-ac00-9a3a688a4375 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:30.300256 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b2568728-310a-4e4f-ac00-9a3a688a4375 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] [instance: 61233bc7-f90a-439f-b0c6-e6856c8c71a0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:30.307500 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b2568728-310a-4e4f-ac00-9a3a688a4375 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:30.307946 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b2568728-310a-4e4f-ac00-9a3a688a4375 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:30.308790 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b2568728-310a-4e4f-ac00-9a3a688a4375 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:30.309260 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b2568728-310a-4e4f-ac00-9a3a688a4375 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:30.392429 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-53438717-f3b9-4b40-8ea0-6af37ef10dae tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:30.393073 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-53438717-f3b9-4b40-8ea0-6af37ef10dae tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] [instance: 067b97a2-ee1a-4d43-926c-11a8bfa2e332] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:30.400114 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-53438717-f3b9-4b40-8ea0-6af37ef10dae tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:30.400567 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-53438717-f3b9-4b40-8ea0-6af37ef10dae tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:30.401382 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-53438717-f3b9-4b40-8ea0-6af37ef10dae tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:30.401847 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-53438717-f3b9-4b40-8ea0-6af37ef10dae tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:30.461584 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-b2568728-310a-4e4f-ac00-9a3a688a4375 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc38f86758f9416b9e7f6915de0359d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8cfe33be708428abef52f5e8e25621b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:30.482357 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b2568728-310a-4e4f-ac00-9a3a688a4375 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] 10.222.0.46 "GET /compute/v2.1/servers/61233bc7-f90a-439f-b0c6-e6856c8c71a0" status: 200 len: 1317 microversion: 2.1 time: 0.185932 Jan 15 20:51:30.485854 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 538/1011] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:30 2022] GET /compute/v2.1/servers/61233bc7-f90a-439f-b0c6-e6856c8c71a0 => generated 1317 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:30.562701 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-53438717-f3b9-4b40-8ea0-6af37ef10dae tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55be87ae7f14b499ab2cd6fc5538988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd217e7fd648b4a78c0c32ff1c95f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:30.571229 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-53438717-f3b9-4b40-8ea0-6af37ef10dae tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "GET /compute/v2.1/servers/067b97a2-ee1a-4d43-926c-11a8bfa2e332" status: 200 len: 1307 microversion: 2.1 time: 0.182495 Jan 15 20:51:30.572125 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 474/1012] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:30 2022] GET /compute/v2.1/servers/067b97a2-ee1a-4d43-926c-11a8bfa2e332 => generated 1307 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:51:30.586915 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-aad21bb4-b096-43bd-a7cc-67be5c6b4fd8 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:30.587542 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-aad21bb4-b096-43bd-a7cc-67be5c6b4fd8 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] [instance: b191ed6c-040a-4702-8e15-86272f9d1847] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:30.593944 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-aad21bb4-b096-43bd-a7cc-67be5c6b4fd8 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:30.594648 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-aad21bb4-b096-43bd-a7cc-67be5c6b4fd8 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:30.595604 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-aad21bb4-b096-43bd-a7cc-67be5c6b4fd8 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:30.596185 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-aad21bb4-b096-43bd-a7cc-67be5c6b4fd8 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:30.637941 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e6852b8f-c054-4b91-a593-0d34e1772d26 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "53534861-c45e-4186-a9c4-9bd3a661cb59", "device": "/dev/xvdb"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:51:30.643224 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e6852b8f-c054-4b91-a593-0d34e1772d26 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] [instance: 42618a48-fe11-4f55-bed2-738d2cc8a07f] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:30.651919 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e6852b8f-c054-4b91-a593-0d34e1772d26 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:30.659454 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e6852b8f-c054-4b91-a593-0d34e1772d26 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:30.660339 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e6852b8f-c054-4b91-a593-0d34e1772d26 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:30.660774 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e6852b8f-c054-4b91-a593-0d34e1772d26 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:30.813887 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-aad21bb4-b096-43bd-a7cc-67be5c6b4fd8 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d4a57cfaa145009ba9cc8f21d9e8ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4a26c8edac44c8b26fd4e43813412d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:30.826037 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-aad21bb4-b096-43bd-a7cc-67be5c6b4fd8 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] 10.222.0.46 "GET /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847" status: 200 len: 1472 microversion: 2.1 time: 0.243977 Jan 15 20:51:30.829292 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 539/1013] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:30 2022] GET /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847 => generated 1472 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:30.835949 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9e9f0d21-fd53-4f5d-a937-e6354feb449a tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:30.836668 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-9e9f0d21-fd53-4f5d-a937-e6354feb449a tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: d603f11b-5d49-492b-b541-1826486876ef] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:30.845116 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9e9f0d21-fd53-4f5d-a937-e6354feb449a tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:30.845563 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9e9f0d21-fd53-4f5d-a937-e6354feb449a tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:30.846448 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9e9f0d21-fd53-4f5d-a937-e6354feb449a tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:30.846884 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9e9f0d21-fd53-4f5d-a937-e6354feb449a tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:31.000618 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-9e9f0d21-fd53-4f5d-a937-e6354feb449a tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:31.008803 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-9e9f0d21-fd53-4f5d-a937-e6354feb449a tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/d603f11b-5d49-492b-b541-1826486876ef" status: 200 len: 1541 microversion: 2.1 time: 0.178098 Jan 15 20:51:31.009610 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 540/1014] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:30 2022] GET /compute/v2.1/servers/d603f11b-5d49-492b-b541-1826486876ef => generated 1541 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:31.013970 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-3b532d3c-f8b7-4892-8084-ff16e61232f3 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:31.014726 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-3b532d3c-f8b7-4892-8084-ff16e61232f3 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 57bd310f-a604-40de-9c25-882284f4a17b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:31.021563 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3b532d3c-f8b7-4892-8084-ff16e61232f3 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:31.022047 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3b532d3c-f8b7-4892-8084-ff16e61232f3 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:31.022839 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3b532d3c-f8b7-4892-8084-ff16e61232f3 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:31.023276 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3b532d3c-f8b7-4892-8084-ff16e61232f3 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:31.032609 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e6852b8f-c054-4b91-a593-0d34e1772d26 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] 10.222.0.46 "POST /compute/v2.1/servers/42618a48-fe11-4f55-bed2-738d2cc8a07f/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.400002 Jan 15 20:51:31.033747 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 475/1015] 10.222.0.46 () {62 vars in 1363 bytes} [Sat Jan 15 20:51:30 2022] POST /compute/v2.1/servers/42618a48-fe11-4f55-bed2-738d2cc8a07f/os-volume_attachments => generated 194 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:51:31.073366 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-bd46664f-3b4c-4936-8118-db2d1886478b tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:31.074180 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-bd46664f-3b4c-4936-8118-db2d1886478b tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] [instance: 69b95b86-744d-4552-a0fc-6ced4d9ef38d] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:31.080501 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bd46664f-3b4c-4936-8118-db2d1886478b tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:31.080961 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bd46664f-3b4c-4936-8118-db2d1886478b tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:31.081809 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bd46664f-3b4c-4936-8118-db2d1886478b tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:31.082238 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bd46664f-3b4c-4936-8118-db2d1886478b tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:31.096878 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-bd46664f-3b4c-4936-8118-db2d1886478b tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] HTTP exception thrown: Instance 69b95b86-744d-4552-a0fc-6ced4d9ef38d could not be found. Jan 15 20:51:31.097466 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-bd46664f-3b4c-4936-8118-db2d1886478b tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] Returning 404 to user: Instance 69b95b86-744d-4552-a0fc-6ced4d9ef38d could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:51:31.098281 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-bd46664f-3b4c-4936-8118-db2d1886478b tempest-FloatingIPsAssociationNegativeTestJSON-407881836 tempest-FloatingIPsAssociationNegativeTestJSON-407881836-project] 10.222.0.46 "GET /compute/v2.1/servers/69b95b86-744d-4552-a0fc-6ced4d9ef38d" status: 404 len: 111 microversion: 2.1 time: 0.029993 Jan 15 20:51:31.098860 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 476/1016] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:31 2022] GET /compute/v2.1/servers/69b95b86-744d-4552-a0fc-6ced4d9ef38d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:51:31.160128 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-3b532d3c-f8b7-4892-8084-ff16e61232f3 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d60caf368842b2aec08f0f5e14353a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c95e4b5695439dbc3f66a911264026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:31.169672 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-3b532d3c-f8b7-4892-8084-ff16e61232f3 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "GET /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b" status: 200 len: 1590 microversion: 2.1 time: 0.158769 Jan 15 20:51:31.170261 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 541/1017] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:31 2022] GET /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b => generated 1590 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:31.185977 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-7df028a0-4a1a-493f-bd74-62369b91440e tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:31.186572 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-7df028a0-4a1a-493f-bd74-62369b91440e tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 57bd310f-a604-40de-9c25-882284f4a17b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:31.193474 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7df028a0-4a1a-493f-bd74-62369b91440e tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:31.194052 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7df028a0-4a1a-493f-bd74-62369b91440e tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:31.194900 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7df028a0-4a1a-493f-bd74-62369b91440e tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:31.195394 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7df028a0-4a1a-493f-bd74-62369b91440e tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:31.230425 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-6d19b84c-3d2c-4d4f-9f68-a7e1c7f6c85a tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:31.231032 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-6d19b84c-3d2c-4d4f-9f68-a7e1c7f6c85a tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] [instance: b18c4fdc-6965-4c52-85f5-824ba94b4ad8] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:31.243338 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6d19b84c-3d2c-4d4f-9f68-a7e1c7f6c85a tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:31.243797 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6d19b84c-3d2c-4d4f-9f68-a7e1c7f6c85a tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:31.244600 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6d19b84c-3d2c-4d4f-9f68-a7e1c7f6c85a tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:31.245069 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6d19b84c-3d2c-4d4f-9f68-a7e1c7f6c85a tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:31.282078 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-7df028a0-4a1a-493f-bd74-62369b91440e tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "GET /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.099774 Jan 15 20:51:31.282738 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 477/1018] 10.222.0.46 () {58 vars in 1274 bytes} [Sat Jan 15 20:51:31 2022] GET /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/os-interface => generated 285 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:51:31.502431 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b3bf01da-026e-4c9c-92c1-1e96f2e9710c tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:31.503062 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b3bf01da-026e-4c9c-92c1-1e96f2e9710c tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] [instance: 61233bc7-f90a-439f-b0c6-e6856c8c71a0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:31.511822 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b3bf01da-026e-4c9c-92c1-1e96f2e9710c tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:31.512508 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b3bf01da-026e-4c9c-92c1-1e96f2e9710c tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:31.513418 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b3bf01da-026e-4c9c-92c1-1e96f2e9710c tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:31.513941 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b3bf01da-026e-4c9c-92c1-1e96f2e9710c tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:31.654076 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-6d19b84c-3d2c-4d4f-9f68-a7e1c7f6c85a tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25473d022e7f438fa6495288f53caa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f471d81a59824fc8afaf454a65e99933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:31.664345 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-6d19b84c-3d2c-4d4f-9f68-a7e1c7f6c85a tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] 10.222.0.46 "GET /compute/v2.1/servers/b18c4fdc-6965-4c52-85f5-824ba94b4ad8" status: 200 len: 1324 microversion: 2.1 time: 0.437539 Jan 15 20:51:31.666137 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 542/1019] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:31 2022] GET /compute/v2.1/servers/b18c4fdc-6965-4c52-85f5-824ba94b4ad8 => generated 1324 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:51:31.673039 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-82ae7494-091d-4c14-a96d-8dafba1bb473 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:31.674455 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-82ae7494-091d-4c14-a96d-8dafba1bb473 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] [instance: 067b97a2-ee1a-4d43-926c-11a8bfa2e332] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:31.685690 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-82ae7494-091d-4c14-a96d-8dafba1bb473 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:31.686490 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-82ae7494-091d-4c14-a96d-8dafba1bb473 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:31.688057 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-82ae7494-091d-4c14-a96d-8dafba1bb473 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:31.689672 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-82ae7494-091d-4c14-a96d-8dafba1bb473 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:32.167523 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-b3bf01da-026e-4c9c-92c1-1e96f2e9710c tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc38f86758f9416b9e7f6915de0359d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8cfe33be708428abef52f5e8e25621b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:32.186473 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b3bf01da-026e-4c9c-92c1-1e96f2e9710c tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] 10.222.0.46 "GET /compute/v2.1/servers/61233bc7-f90a-439f-b0c6-e6856c8c71a0" status: 200 len: 1467 microversion: 2.1 time: 0.690404 Jan 15 20:51:32.197419 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 478/1020] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:31 2022] GET /compute/v2.1/servers/61233bc7-f90a-439f-b0c6-e6856c8c71a0 => generated 1467 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:32.205189 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-f68a2858-e158-4608-9c33-c33a0ea34ef3 req-b4fcdf92-cc26-4b33-b668-e702e5410744 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69b95b86-744d-4552-a0fc-6ced4d9ef38d", "name": "network-vif-deleted", "tag": "66fcf159-d8ef-45e6-9c7c-4dba94d06566"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:51:32.207351 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:51:32.207351 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:51:32.219119 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-f68a2858-e158-4608-9c33-c33a0ea34ef3 req-b4fcdf92-cc26-4b33-b668-e702e5410744 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:32.219883 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-f68a2858-e158-4608-9c33-c33a0ea34ef3 req-b4fcdf92-cc26-4b33-b668-e702e5410744 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:32.232935 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-f68a2858-e158-4608-9c33-c33a0ea34ef3 req-b4fcdf92-cc26-4b33-b668-e702e5410744 service nova] Creating event network-vif-deleted:66fcf159-d8ef-45e6-9c7c-4dba94d06566 for instance 69b95b86-744d-4552-a0fc-6ced4d9ef38d on nch2-master-1 Jan 15 20:51:32.235079 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-82ae7494-091d-4c14-a96d-8dafba1bb473 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55be87ae7f14b499ab2cd6fc5538988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd217e7fd648b4a78c0c32ff1c95f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:32.239206 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-f68a2858-e158-4608-9c33-c33a0ea34ef3 req-b4fcdf92-cc26-4b33-b668-e702e5410744 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037548 Jan 15 20:51:32.242125 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 479/1021] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:51:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:51:32.243414 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-82ae7494-091d-4c14-a96d-8dafba1bb473 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "GET /compute/v2.1/servers/067b97a2-ee1a-4d43-926c-11a8bfa2e332" status: 200 len: 1307 microversion: 2.1 time: 0.576029 Jan 15 20:51:32.244155 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 543/1022] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:31 2022] GET /compute/v2.1/servers/067b97a2-ee1a-4d43-926c-11a8bfa2e332 => generated 1307 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:32.251428 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-afa36f0c-ed12-42ef-88d2-a6ee50d9f40a tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:32.252036 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-afa36f0c-ed12-42ef-88d2-a6ee50d9f40a tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: d603f11b-5d49-492b-b541-1826486876ef] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:32.257554 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-12b8df3d-51dc-495d-b8f3-43cdeb5f0e92 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:32.257859 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-12b8df3d-51dc-495d-b8f3-43cdeb5f0e92 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] [instance: b191ed6c-040a-4702-8e15-86272f9d1847] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:32.266050 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-afa36f0c-ed12-42ef-88d2-a6ee50d9f40a tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:32.266499 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-afa36f0c-ed12-42ef-88d2-a6ee50d9f40a tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:32.269090 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-12b8df3d-51dc-495d-b8f3-43cdeb5f0e92 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:32.269540 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-12b8df3d-51dc-495d-b8f3-43cdeb5f0e92 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:32.270480 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-12b8df3d-51dc-495d-b8f3-43cdeb5f0e92 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:32.270736 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-afa36f0c-ed12-42ef-88d2-a6ee50d9f40a tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:32.271946 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-12b8df3d-51dc-495d-b8f3-43cdeb5f0e92 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:32.272796 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-afa36f0c-ed12-42ef-88d2-a6ee50d9f40a tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:32.626106 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-12b8df3d-51dc-495d-b8f3-43cdeb5f0e92 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d4a57cfaa145009ba9cc8f21d9e8ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4a26c8edac44c8b26fd4e43813412d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:32.636380 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-12b8df3d-51dc-495d-b8f3-43cdeb5f0e92 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] 10.222.0.46 "GET /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847" status: 200 len: 1472 microversion: 2.1 time: 0.392886 Jan 15 20:51:32.647141 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 480/1023] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:32 2022] GET /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847 => generated 1472 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:32.652456 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-34a99a3b-277c-4e0e-b97e-0c365437819c tempest-ServersOnMultiNodesTest-1194618714 tempest-ServersOnMultiNodesTest-1194618714-project-admin] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:32.653421 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-34a99a3b-277c-4e0e-b97e-0c365437819c tempest-ServersOnMultiNodesTest-1194618714 tempest-ServersOnMultiNodesTest-1194618714-project-admin] [instance: 61233bc7-f90a-439f-b0c6-e6856c8c71a0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:32.660022 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-34a99a3b-277c-4e0e-b97e-0c365437819c tempest-ServersOnMultiNodesTest-1194618714 tempest-ServersOnMultiNodesTest-1194618714-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:32.660868 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-34a99a3b-277c-4e0e-b97e-0c365437819c tempest-ServersOnMultiNodesTest-1194618714 tempest-ServersOnMultiNodesTest-1194618714-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:32.662132 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-34a99a3b-277c-4e0e-b97e-0c365437819c tempest-ServersOnMultiNodesTest-1194618714 tempest-ServersOnMultiNodesTest-1194618714-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:32.662838 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-34a99a3b-277c-4e0e-b97e-0c365437819c tempest-ServersOnMultiNodesTest-1194618714 tempest-ServersOnMultiNodesTest-1194618714-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:32.707850 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-afa36f0c-ed12-42ef-88d2-a6ee50d9f40a tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:32.716384 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-afa36f0c-ed12-42ef-88d2-a6ee50d9f40a tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/d603f11b-5d49-492b-b541-1826486876ef" status: 200 len: 1541 microversion: 2.1 time: 0.471299 Jan 15 20:51:32.727536 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 544/1024] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:32 2022] GET /compute/v2.1/servers/d603f11b-5d49-492b-b541-1826486876ef => generated 1541 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:32.736209 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-b328692a-dc3e-4a23-b9ad-88425ad18342 req-4ddddcc6-14ca-4a27-b395-849ab0f80a05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b18c4fdc-6965-4c52-85f5-824ba94b4ad8", "name": "network-vif-plugged", "status": "completed", "tag": "37191f5f-92f4-4372-9435-1f2eddb92f24"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:51:32.748853 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:51:32.748853 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:51:32.773495 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-b328692a-dc3e-4a23-b9ad-88425ad18342 req-4ddddcc6-14ca-4a27-b395-849ab0f80a05 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:32.773947 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-b328692a-dc3e-4a23-b9ad-88425ad18342 req-4ddddcc6-14ca-4a27-b395-849ab0f80a05 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:32.792481 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-b328692a-dc3e-4a23-b9ad-88425ad18342 req-4ddddcc6-14ca-4a27-b395-849ab0f80a05 service nova] Creating event network-vif-plugged:37191f5f-92f4-4372-9435-1f2eddb92f24 for instance b18c4fdc-6965-4c52-85f5-824ba94b4ad8 on nch1-master-1 Jan 15 20:51:32.804554 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-b328692a-dc3e-4a23-b9ad-88425ad18342 req-4ddddcc6-14ca-4a27-b395-849ab0f80a05 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072485 Jan 15 20:51:32.810689 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 545/1025] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:51:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:51:32.816398 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d4ba0525-9c63-455a-9b09-4eef580d0abb tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:32.817175 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-d4ba0525-9c63-455a-9b09-4eef580d0abb tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] [instance: b18c4fdc-6965-4c52-85f5-824ba94b4ad8] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:32.828801 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d4ba0525-9c63-455a-9b09-4eef580d0abb tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:32.829818 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d4ba0525-9c63-455a-9b09-4eef580d0abb tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:32.830852 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d4ba0525-9c63-455a-9b09-4eef580d0abb tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:32.831324 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d4ba0525-9c63-455a-9b09-4eef580d0abb tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:32.933707 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-34a99a3b-277c-4e0e-b97e-0c365437819c tempest-ServersOnMultiNodesTest-1194618714 tempest-ServersOnMultiNodesTest-1194618714-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/61233bc7-f90a-439f-b0c6-e6856c8c71a0" status: 200 len: 1618 microversion: 2.1 time: 0.285001 Jan 15 20:51:32.934381 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 481/1026] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:32 2022] GET /compute/v2.1/servers/61233bc7-f90a-439f-b0c6-e6856c8c71a0 => generated 1618 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:33.002584 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5f5c95ec-dc6b-46e5-9534-a6bcf784bae4 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-711271262", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["1e63485c-6290-4e1d-82cf-5ae73069dd2e"]}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:51:33.069883 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.network.neutron [None req-5f5c95ec-dc6b-46e5-9534-a6bcf784bae4 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] validate_networks() for None {{(pid=129365) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 20:51:33.106918 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-d4ba0525-9c63-455a-9b09-4eef580d0abb tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25473d022e7f438fa6495288f53caa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f471d81a59824fc8afaf454a65e99933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:33.120283 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d4ba0525-9c63-455a-9b09-4eef580d0abb tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] 10.222.0.46 "GET /compute/v2.1/servers/b18c4fdc-6965-4c52-85f5-824ba94b4ad8" status: 200 len: 1324 microversion: 2.1 time: 0.308208 Jan 15 20:51:33.127657 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 546/1027] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:32 2022] GET /compute/v2.1/servers/b18c4fdc-6965-4c52-85f5-824ba94b4ad8 => generated 1324 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:33.218190 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0b128660-fdcc-4163-9598-76a2de1f1f2d tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:51:33.219387 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-0b128660-fdcc-4163-9598-76a2de1f1f2d tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 57bd310f-a604-40de-9c25-882284f4a17b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:33.232552 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0b128660-fdcc-4163-9598-76a2de1f1f2d tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:33.237375 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0b128660-fdcc-4163-9598-76a2de1f1f2d tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:33.239511 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0b128660-fdcc-4163-9598-76a2de1f1f2d tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:33.242167 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0b128660-fdcc-4163-9598-76a2de1f1f2d tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:33.321876 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0b128660-fdcc-4163-9598-76a2de1f1f2d tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/action" status: 200 len: 14 microversion: 2.1 time: 0.109937 Jan 15 20:51:33.322725 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 547/1028] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:51:33 2022] POST /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/action => generated 14 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 20:51:33.328553 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-e9715026-fff5-4602-84c1-77e6e0cbb4fe req-39ba24ec-1d81-43f6-86ca-de9c6840a67b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57bd310f-a604-40de-9c25-882284f4a17b", "tag": "b8144bdd-0e36-42d0-ae5a-b27a87dabd70"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:51:33.333135 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:51:33.333135 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:51:33.341562 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-e9715026-fff5-4602-84c1-77e6e0cbb4fe req-39ba24ec-1d81-43f6-86ca-de9c6840a67b service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:33.342221 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-e9715026-fff5-4602-84c1-77e6e0cbb4fe req-39ba24ec-1d81-43f6-86ca-de9c6840a67b service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:33.367228 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-e9715026-fff5-4602-84c1-77e6e0cbb4fe req-39ba24ec-1d81-43f6-86ca-de9c6840a67b service nova] Creating event network-changed:b8144bdd-0e36-42d0-ae5a-b27a87dabd70 for instance 57bd310f-a604-40de-9c25-882284f4a17b on nch1-master-1 Jan 15 20:51:33.378385 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-e9715026-fff5-4602-84c1-77e6e0cbb4fe req-39ba24ec-1d81-43f6-86ca-de9c6840a67b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054413 Jan 15 20:51:33.380221 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 548/1029] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:51:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:51:33.386424 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0ed90916-d3f1-4b87-9088-1d1eb9ba9996 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:33.387135 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-0ed90916-d3f1-4b87-9088-1d1eb9ba9996 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] [instance: 067b97a2-ee1a-4d43-926c-11a8bfa2e332] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:33.400862 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0ed90916-d3f1-4b87-9088-1d1eb9ba9996 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:33.401339 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0ed90916-d3f1-4b87-9088-1d1eb9ba9996 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:33.402144 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0ed90916-d3f1-4b87-9088-1d1eb9ba9996 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:33.402584 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0ed90916-d3f1-4b87-9088-1d1eb9ba9996 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:33.444989 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-5f5c95ec-dc6b-46e5-9534-a6bcf784bae4 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Flavor limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 20:51:33.446387 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-5f5c95ec-dc6b-46e5-9534-a6bcf784bae4 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Image limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 20:51:33.447094 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-5f5c95ec-dc6b-46e5-9534-a6bcf784bae4 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Flavor pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 20:51:33.447853 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-5f5c95ec-dc6b-46e5-9534-a6bcf784bae4 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Image pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 20:51:33.448468 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-5f5c95ec-dc6b-46e5-9534-a6bcf784bae4 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 20:51:33.459134 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5f5c95ec-dc6b-46e5-9534-a6bcf784bae4 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:33.459936 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5f5c95ec-dc6b-46e5-9534-a6bcf784bae4 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:33.461201 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5f5c95ec-dc6b-46e5-9534-a6bcf784bae4 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:33.461845 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5f5c95ec-dc6b-46e5-9534-a6bcf784bae4 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:33.484159 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-5f5c95ec-dc6b-46e5-9534-a6bcf784bae4 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Getting quotas for project e8cfe33be708428abef52f5e8e25621b. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:51:33.490746 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-5f5c95ec-dc6b-46e5-9534-a6bcf784bae4 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Getting quotas for user bc38f86758f9416b9e7f6915de0359d6 and project e8cfe33be708428abef52f5e8e25621b. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:51:33.504405 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-5f5c95ec-dc6b-46e5-9534-a6bcf784bae4 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Going to run 1 instances... {{(pid=129365) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 20:51:33.507973 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-5f5c95ec-dc6b-46e5-9534-a6bcf784bae4 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] [instance: 231780ff-26d8-4f4a-b52b-eba09aa1a0e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129365) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 20:51:33.574785 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5f5c95ec-dc6b-46e5-9534-a6bcf784bae4 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.575925 Jan 15 20:51:33.579932 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 482/1030] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 20:51:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 582 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 20:51:33.591241 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-09ca8f24-7819-4f50-82b9-02376c5760e9 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:33.594300 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-09ca8f24-7819-4f50-82b9-02376c5760e9 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] [instance: 231780ff-26d8-4f4a-b52b-eba09aa1a0e8] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:33.610290 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-0ed90916-d3f1-4b87-9088-1d1eb9ba9996 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55be87ae7f14b499ab2cd6fc5538988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd217e7fd648b4a78c0c32ff1c95f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:33.619552 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0ed90916-d3f1-4b87-9088-1d1eb9ba9996 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "GET /compute/v2.1/servers/067b97a2-ee1a-4d43-926c-11a8bfa2e332" status: 200 len: 1307 microversion: 2.1 time: 0.237829 Jan 15 20:51:33.620348 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 549/1031] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:33 2022] GET /compute/v2.1/servers/067b97a2-ee1a-4d43-926c-11a8bfa2e332 => generated 1307 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:33.654341 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-306e9a25-e149-4e43-9f85-3e09b819e4eb tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:33.655237 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-306e9a25-e149-4e43-9f85-3e09b819e4eb tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] [instance: b191ed6c-040a-4702-8e15-86272f9d1847] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:33.668995 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-306e9a25-e149-4e43-9f85-3e09b819e4eb tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:33.669581 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-09ca8f24-7819-4f50-82b9-02376c5760e9 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc38f86758f9416b9e7f6915de0359d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8cfe33be708428abef52f5e8e25621b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:33.673427 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-306e9a25-e149-4e43-9f85-3e09b819e4eb tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:33.674262 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-306e9a25-e149-4e43-9f85-3e09b819e4eb tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:33.678296 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-306e9a25-e149-4e43-9f85-3e09b819e4eb tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:33.686784 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-09ca8f24-7819-4f50-82b9-02376c5760e9 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] 10.222.0.46 "GET /compute/v2.1/servers/231780ff-26d8-4f4a-b52b-eba09aa1a0e8" status: 200 len: 1216 microversion: 2.1 time: 0.100089 Jan 15 20:51:33.687386 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 483/1032] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:33 2022] GET /compute/v2.1/servers/231780ff-26d8-4f4a-b52b-eba09aa1a0e8 => generated 1216 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:51:33.734787 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8ac6068e-da7e-4b15-bc6e-516af4e23eea tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:33.735698 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-8ac6068e-da7e-4b15-bc6e-516af4e23eea tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: d603f11b-5d49-492b-b541-1826486876ef] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:33.748532 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8ac6068e-da7e-4b15-bc6e-516af4e23eea tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:33.751090 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8ac6068e-da7e-4b15-bc6e-516af4e23eea tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:33.751929 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8ac6068e-da7e-4b15-bc6e-516af4e23eea tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:33.752367 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8ac6068e-da7e-4b15-bc6e-516af4e23eea tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:34.193280 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-306e9a25-e149-4e43-9f85-3e09b819e4eb tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d4a57cfaa145009ba9cc8f21d9e8ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4a26c8edac44c8b26fd4e43813412d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:34.207421 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-306e9a25-e149-4e43-9f85-3e09b819e4eb tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] 10.222.0.46 "GET /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847" status: 200 len: 1472 microversion: 2.1 time: 0.556370 Jan 15 20:51:34.209149 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 550/1033] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:33 2022] GET /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847 => generated 1472 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:51:34.219255 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9deeb600-0dac-42a6-bad1-723ccbdac62c tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:34.220739 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-9deeb600-0dac-42a6-bad1-723ccbdac62c tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] [instance: b18c4fdc-6965-4c52-85f5-824ba94b4ad8] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:34.227229 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-8ac6068e-da7e-4b15-bc6e-516af4e23eea tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:34.239008 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-8ac6068e-da7e-4b15-bc6e-516af4e23eea tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/d603f11b-5d49-492b-b541-1826486876ef" status: 200 len: 1541 microversion: 2.1 time: 0.509065 Jan 15 20:51:34.240710 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 484/1034] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:33 2022] GET /compute/v2.1/servers/d603f11b-5d49-492b-b541-1826486876ef => generated 1541 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:34.252344 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9deeb600-0dac-42a6-bad1-723ccbdac62c tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:34.252960 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9deeb600-0dac-42a6-bad1-723ccbdac62c tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:34.254079 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9deeb600-0dac-42a6-bad1-723ccbdac62c tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:34.254624 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9deeb600-0dac-42a6-bad1-723ccbdac62c tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:34.335490 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-88f7fafe-56f5-4d08-a9a3-7bfce1904ed7 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:51:34.336799 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-88f7fafe-56f5-4d08-a9a3-7bfce1904ed7 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 57bd310f-a604-40de-9c25-882284f4a17b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:34.350927 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-88f7fafe-56f5-4d08-a9a3-7bfce1904ed7 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:34.356526 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-88f7fafe-56f5-4d08-a9a3-7bfce1904ed7 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:34.357839 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-88f7fafe-56f5-4d08-a9a3-7bfce1904ed7 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:34.359695 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-88f7fafe-56f5-4d08-a9a3-7bfce1904ed7 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:34.474800 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-9deeb600-0dac-42a6-bad1-723ccbdac62c tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25473d022e7f438fa6495288f53caa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f471d81a59824fc8afaf454a65e99933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:34.486582 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-9deeb600-0dac-42a6-bad1-723ccbdac62c tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] 10.222.0.46 "GET /compute/v2.1/servers/b18c4fdc-6965-4c52-85f5-824ba94b4ad8" status: 200 len: 1324 microversion: 2.1 time: 0.275356 Jan 15 20:51:34.488088 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-88f7fafe-56f5-4d08-a9a3-7bfce1904ed7 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/action" status: 200 len: 14 microversion: 2.1 time: 0.157545 Jan 15 20:51:34.490741 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 485/1035] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:51:34 2022] POST /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/action => generated 14 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 15 20:51:34.499653 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 551/1036] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:34 2022] GET /compute/v2.1/servers/b18c4fdc-6965-4c52-85f5-824ba94b4ad8 => generated 1324 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:34.642415 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d531e5ec-59c1-472d-b977-4760e41e1463 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:34.643609 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d531e5ec-59c1-472d-b977-4760e41e1463 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] [instance: 067b97a2-ee1a-4d43-926c-11a8bfa2e332] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:34.652196 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d531e5ec-59c1-472d-b977-4760e41e1463 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:34.652971 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d531e5ec-59c1-472d-b977-4760e41e1463 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:34.654452 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d531e5ec-59c1-472d-b977-4760e41e1463 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:34.654895 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d531e5ec-59c1-472d-b977-4760e41e1463 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:34.707469 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a3a94c66-8990-4206-a22a-ebbb9a6c1812 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:34.708094 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a3a94c66-8990-4206-a22a-ebbb9a6c1812 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] [instance: 231780ff-26d8-4f4a-b52b-eba09aa1a0e8] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:34.720411 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a3a94c66-8990-4206-a22a-ebbb9a6c1812 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:34.720875 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a3a94c66-8990-4206-a22a-ebbb9a6c1812 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:34.721704 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a3a94c66-8990-4206-a22a-ebbb9a6c1812 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:34.722133 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a3a94c66-8990-4206-a22a-ebbb9a6c1812 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:34.874573 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-a3a94c66-8990-4206-a22a-ebbb9a6c1812 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc38f86758f9416b9e7f6915de0359d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8cfe33be708428abef52f5e8e25621b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:34.889489 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a3a94c66-8990-4206-a22a-ebbb9a6c1812 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] 10.222.0.46 "GET /compute/v2.1/servers/231780ff-26d8-4f4a-b52b-eba09aa1a0e8" status: 200 len: 1212 microversion: 2.1 time: 0.189294 Jan 15 20:51:34.892013 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 552/1037] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:34 2022] GET /compute/v2.1/servers/231780ff-26d8-4f4a-b52b-eba09aa1a0e8 => generated 1212 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:51:35.092126 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-d531e5ec-59c1-472d-b977-4760e41e1463 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55be87ae7f14b499ab2cd6fc5538988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd217e7fd648b4a78c0c32ff1c95f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:35.100255 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d531e5ec-59c1-472d-b977-4760e41e1463 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "GET /compute/v2.1/servers/067b97a2-ee1a-4d43-926c-11a8bfa2e332" status: 200 len: 1307 microversion: 2.1 time: 0.466784 Jan 15 20:51:35.100881 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 486/1038] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:34 2022] GET /compute/v2.1/servers/067b97a2-ee1a-4d43-926c-11a8bfa2e332 => generated 1307 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:35.227017 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-24cd9d9e-ca91-4bcd-a73d-76982fd01b28 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:35.227911 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-24cd9d9e-ca91-4bcd-a73d-76982fd01b28 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] [instance: b191ed6c-040a-4702-8e15-86272f9d1847] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:35.235485 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-24cd9d9e-ca91-4bcd-a73d-76982fd01b28 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:35.235943 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-24cd9d9e-ca91-4bcd-a73d-76982fd01b28 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:35.237066 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-24cd9d9e-ca91-4bcd-a73d-76982fd01b28 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:35.237805 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-24cd9d9e-ca91-4bcd-a73d-76982fd01b28 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:35.258562 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-82861a28-2412-4dae-be76-6e7c10b6a04b tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:35.259180 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-82861a28-2412-4dae-be76-6e7c10b6a04b tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: d603f11b-5d49-492b-b541-1826486876ef] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:35.305038 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-82861a28-2412-4dae-be76-6e7c10b6a04b tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:35.305516 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-82861a28-2412-4dae-be76-6e7c10b6a04b tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:35.309326 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-82861a28-2412-4dae-be76-6e7c10b6a04b tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:35.309871 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-82861a28-2412-4dae-be76-6e7c10b6a04b tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:35.575096 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-24cd9d9e-ca91-4bcd-a73d-76982fd01b28 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d4a57cfaa145009ba9cc8f21d9e8ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4a26c8edac44c8b26fd4e43813412d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:35.582609 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-24cd9d9e-ca91-4bcd-a73d-76982fd01b28 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] 10.222.0.46 "GET /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847" status: 200 len: 1472 microversion: 2.1 time: 0.360451 Jan 15 20:51:35.585633 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 553/1039] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:35 2022] GET /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847 => generated 1472 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:51:35.598340 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d76d1ac8-f94f-4fba-b9fd-74ddc6726104 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:51:35.600262 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-d76d1ac8-f94f-4fba-b9fd-74ddc6726104 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 57bd310f-a604-40de-9c25-882284f4a17b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:35.613277 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-82861a28-2412-4dae-be76-6e7c10b6a04b tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:35.621087 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d76d1ac8-f94f-4fba-b9fd-74ddc6726104 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:35.626019 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-82861a28-2412-4dae-be76-6e7c10b6a04b tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/d603f11b-5d49-492b-b541-1826486876ef" status: 200 len: 1541 microversion: 2.1 time: 0.371661 Jan 15 20:51:35.636257 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 487/1040] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:35 2022] GET /compute/v2.1/servers/d603f11b-5d49-492b-b541-1826486876ef => generated 1541 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:51:35.638538 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d76d1ac8-f94f-4fba-b9fd-74ddc6726104 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:35.639511 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d76d1ac8-f94f-4fba-b9fd-74ddc6726104 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:35.641800 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d76d1ac8-f94f-4fba-b9fd-74ddc6726104 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:35.644159 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-21e3a5e0-bce6-4c1f-b9ef-ca5da9c7fe81 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:35.649379 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-21e3a5e0-bce6-4c1f-b9ef-ca5da9c7fe81 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] [instance: b18c4fdc-6965-4c52-85f5-824ba94b4ad8] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:35.663962 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-21e3a5e0-bce6-4c1f-b9ef-ca5da9c7fe81 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:35.665429 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-21e3a5e0-bce6-4c1f-b9ef-ca5da9c7fe81 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:35.666262 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-21e3a5e0-bce6-4c1f-b9ef-ca5da9c7fe81 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:35.666693 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-21e3a5e0-bce6-4c1f-b9ef-ca5da9c7fe81 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:35.710877 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d76d1ac8-f94f-4fba-b9fd-74ddc6726104 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/action" status: 200 len: 14 microversion: 2.1 time: 0.120274 Jan 15 20:51:35.711765 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 554/1041] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:51:35 2022] POST /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/action => generated 14 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 20:51:35.825257 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-21e3a5e0-bce6-4c1f-b9ef-ca5da9c7fe81 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25473d022e7f438fa6495288f53caa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f471d81a59824fc8afaf454a65e99933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:35.835276 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-21e3a5e0-bce6-4c1f-b9ef-ca5da9c7fe81 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] 10.222.0.46 "GET /compute/v2.1/servers/b18c4fdc-6965-4c52-85f5-824ba94b4ad8" status: 200 len: 1520 microversion: 2.1 time: 0.197603 Jan 15 20:51:35.836182 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 488/1042] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:35 2022] GET /compute/v2.1/servers/b18c4fdc-6965-4c52-85f5-824ba94b4ad8 => generated 1520 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:35.852785 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7a98711c-3261-4ea5-81ec-fc3c705bd365 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Action: 'create', calling method: .version_select at 0x7f30c9137e50>, body: {"pool": null} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:51:35.910863 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-7db42bf3-35fb-4ac9-9887-2b264c508868 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:35.912722 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-7db42bf3-35fb-4ac9-9887-2b264c508868 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] [instance: 231780ff-26d8-4f4a-b52b-eba09aa1a0e8] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:35.919821 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7db42bf3-35fb-4ac9-9887-2b264c508868 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:35.920351 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7db42bf3-35fb-4ac9-9887-2b264c508868 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:35.921242 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7db42bf3-35fb-4ac9-9887-2b264c508868 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:35.921928 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7db42bf3-35fb-4ac9-9887-2b264c508868 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:36.015861 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-7db42bf3-35fb-4ac9-9887-2b264c508868 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc38f86758f9416b9e7f6915de0359d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8cfe33be708428abef52f5e8e25621b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:36.027627 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-7db42bf3-35fb-4ac9-9887-2b264c508868 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] 10.222.0.46 "GET /compute/v2.1/servers/231780ff-26d8-4f4a-b52b-eba09aa1a0e8" status: 200 len: 1274 microversion: 2.1 time: 0.121728 Jan 15 20:51:36.028116 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 489/1043] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:35 2022] GET /compute/v2.1/servers/231780ff-26d8-4f4a-b52b-eba09aa1a0e8 => generated 1274 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:51:36.117645 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c5fe8409-b294-4496-bae0-0b180f05ab45 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:36.118275 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c5fe8409-b294-4496-bae0-0b180f05ab45 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] [instance: 067b97a2-ee1a-4d43-926c-11a8bfa2e332] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:36.124395 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c5fe8409-b294-4496-bae0-0b180f05ab45 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:36.125096 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c5fe8409-b294-4496-bae0-0b180f05ab45 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:36.126083 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c5fe8409-b294-4496-bae0-0b180f05ab45 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:36.126716 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c5fe8409-b294-4496-bae0-0b180f05ab45 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:36.323508 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-c5fe8409-b294-4496-bae0-0b180f05ab45 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55be87ae7f14b499ab2cd6fc5538988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd217e7fd648b4a78c0c32ff1c95f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:36.343966 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c5fe8409-b294-4496-bae0-0b180f05ab45 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "GET /compute/v2.1/servers/067b97a2-ee1a-4d43-926c-11a8bfa2e332" status: 200 len: 1307 microversion: 2.1 time: 0.230131 Jan 15 20:51:36.353769 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 490/1044] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:36 2022] GET /compute/v2.1/servers/067b97a2-ee1a-4d43-926c-11a8bfa2e332 => generated 1307 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:51:36.602193 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2dae6280-d041-4d49-b42e-3eb3672c6d8a tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:36.602863 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-2dae6280-d041-4d49-b42e-3eb3672c6d8a tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] [instance: b191ed6c-040a-4702-8e15-86272f9d1847] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:36.612934 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2dae6280-d041-4d49-b42e-3eb3672c6d8a tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:36.613687 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2dae6280-d041-4d49-b42e-3eb3672c6d8a tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:36.615713 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2dae6280-d041-4d49-b42e-3eb3672c6d8a tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:36.619660 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2dae6280-d041-4d49-b42e-3eb3672c6d8a tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:37.150511 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-2dae6280-d041-4d49-b42e-3eb3672c6d8a tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d4a57cfaa145009ba9cc8f21d9e8ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4a26c8edac44c8b26fd4e43813412d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:37.167793 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2dae6280-d041-4d49-b42e-3eb3672c6d8a tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] 10.222.0.46 "GET /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847" status: 200 len: 1472 microversion: 2.1 time: 0.570024 Jan 15 20:51:37.170910 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 491/1045] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:36 2022] GET /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847 => generated 1472 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:37.181243 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-37f97a49-b328-4f9c-9251-a964dc8565f6 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:37.183647 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-37f97a49-b328-4f9c-9251-a964dc8565f6 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: d603f11b-5d49-492b-b541-1826486876ef] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:37.203274 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-37f97a49-b328-4f9c-9251-a964dc8565f6 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:37.206264 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-37f97a49-b328-4f9c-9251-a964dc8565f6 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:37.209887 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-37f97a49-b328-4f9c-9251-a964dc8565f6 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:37.210761 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-37f97a49-b328-4f9c-9251-a964dc8565f6 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:37.621518 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-37f97a49-b328-4f9c-9251-a964dc8565f6 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:37.635084 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-37f97a49-b328-4f9c-9251-a964dc8565f6 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/d603f11b-5d49-492b-b541-1826486876ef" status: 200 len: 1541 microversion: 2.1 time: 0.458025 Jan 15 20:51:37.636880 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 492/1046] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:37 2022] GET /compute/v2.1/servers/d603f11b-5d49-492b-b541-1826486876ef => generated 1541 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:37.645237 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-0b05e304-0370-459e-b4cb-e837fdf81225 tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:37.652246 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-0b05e304-0370-459e-b4cb-e837fdf81225 tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] [instance: 42618a48-fe11-4f55-bed2-738d2cc8a07f] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:37.667995 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0b05e304-0370-459e-b4cb-e837fdf81225 tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:37.668880 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0b05e304-0370-459e-b4cb-e837fdf81225 tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:37.671223 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0b05e304-0370-459e-b4cb-e837fdf81225 tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:37.673470 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0b05e304-0370-459e-b4cb-e837fdf81225 tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:37.982167 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.objects.instance [None req-0b05e304-0370-459e-b4cb-e837fdf81225 tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Lazy-loading 'services' on Instance uuid 42618a48-fe11-4f55-bed2-738d2cc8a07f {{(pid=129365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 20:51:38.018844 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-0b05e304-0370-459e-b4cb-e837fdf81225 tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/42618a48-fe11-4f55-bed2-738d2cc8a07f" status: 200 len: 2128 microversion: 2.25 time: 0.379524 Jan 15 20:51:38.022287 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 493/1047] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:51:37 2022] GET /compute/v2.1/servers/42618a48-fe11-4f55-bed2-738d2cc8a07f => generated 2128 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:51:38.028704 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c1fb337a-f141-4d65-a6f9-18fef953f19f tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:51:38.032374 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c1fb337a-f141-4d65-a6f9-18fef953f19f tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 57bd310f-a604-40de-9c25-882284f4a17b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:38.039617 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c1fb337a-f141-4d65-a6f9-18fef953f19f tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:38.040384 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c1fb337a-f141-4d65-a6f9-18fef953f19f tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:38.042144 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c1fb337a-f141-4d65-a6f9-18fef953f19f tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:38.042974 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c1fb337a-f141-4d65-a6f9-18fef953f19f tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:38.090864 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c1fb337a-f141-4d65-a6f9-18fef953f19f tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/action" status: 200 len: 14 microversion: 2.1 time: 0.067057 Jan 15 20:51:38.091526 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 494/1048] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:51:38 2022] POST /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/action => generated 14 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 20:51:38.105503 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-7fd5502a-0da5-4a05-954d-5883d3a02949 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:38.106287 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-7fd5502a-0da5-4a05-954d-5883d3a02949 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] [instance: 231780ff-26d8-4f4a-b52b-eba09aa1a0e8] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:38.117630 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7fd5502a-0da5-4a05-954d-5883d3a02949 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:38.118381 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7fd5502a-0da5-4a05-954d-5883d3a02949 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:38.119198 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7fd5502a-0da5-4a05-954d-5883d3a02949 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:38.119833 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7fd5502a-0da5-4a05-954d-5883d3a02949 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:38.150954 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7a98711c-3261-4ea5-81ec-fc3c705bd365 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] 10.222.0.46 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.302498 Jan 15 20:51:38.152314 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 555/1049] 10.222.0.46 () {60 vars in 1169 bytes} [Sat Jan 15 20:51:35 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:51:38.157505 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4c73fdc0-31ff-4436-a989-8eba01c6cb61 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:38.158417 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-4c73fdc0-31ff-4436-a989-8eba01c6cb61 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] [instance: 067b97a2-ee1a-4d43-926c-11a8bfa2e332] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:38.168183 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4c73fdc0-31ff-4436-a989-8eba01c6cb61 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:38.168787 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4c73fdc0-31ff-4436-a989-8eba01c6cb61 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:38.170844 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4c73fdc0-31ff-4436-a989-8eba01c6cb61 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:38.171627 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4c73fdc0-31ff-4436-a989-8eba01c6cb61 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:38.429449 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-7fd5502a-0da5-4a05-954d-5883d3a02949 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc38f86758f9416b9e7f6915de0359d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8cfe33be708428abef52f5e8e25621b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:38.440066 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-7fd5502a-0da5-4a05-954d-5883d3a02949 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] 10.222.0.46 "GET /compute/v2.1/servers/231780ff-26d8-4f4a-b52b-eba09aa1a0e8" status: 200 len: 1316 microversion: 2.1 time: 0.347336 Jan 15 20:51:38.441021 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 495/1050] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:38 2022] GET /compute/v2.1/servers/231780ff-26d8-4f4a-b52b-eba09aa1a0e8 => generated 1316 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:38.454071 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-4c73fdc0-31ff-4436-a989-8eba01c6cb61 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55be87ae7f14b499ab2cd6fc5538988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd217e7fd648b4a78c0c32ff1c95f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:38.462079 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-4c73fdc0-31ff-4436-a989-8eba01c6cb61 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "GET /compute/v2.1/servers/067b97a2-ee1a-4d43-926c-11a8bfa2e332" status: 200 len: 1307 microversion: 2.1 time: 0.308589 Jan 15 20:51:38.465390 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 556/1051] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:38 2022] GET /compute/v2.1/servers/067b97a2-ee1a-4d43-926c-11a8bfa2e332 => generated 1307 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:38.469164 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-95f221a8-9d4c-45e1-8a36-3fd622b6ba24 req-5971f257-76dd-4fed-aa9c-568e0bbcc246 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "231780ff-26d8-4f4a-b52b-eba09aa1a0e8", "tag": "7880a0f5-0cf7-4766-9699-5a2f4c04bd45"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:51:38.470917 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:51:38.470917 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:51:38.478460 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-875be608-c5cb-44e2-a05c-bfc660e6dde1 tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": "auto"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:51:38.480023 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-875be608-c5cb-44e2-a05c-bfc660e6dde1 tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] [instance: 42618a48-fe11-4f55-bed2-738d2cc8a07f] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:38.487446 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-875be608-c5cb-44e2-a05c-bfc660e6dde1 tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:38.487899 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-875be608-c5cb-44e2-a05c-bfc660e6dde1 tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:38.488163 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-95f221a8-9d4c-45e1-8a36-3fd622b6ba24 req-5971f257-76dd-4fed-aa9c-568e0bbcc246 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:38.488690 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-875be608-c5cb-44e2-a05c-bfc660e6dde1 tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:38.488959 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-95f221a8-9d4c-45e1-8a36-3fd622b6ba24 req-5971f257-76dd-4fed-aa9c-568e0bbcc246 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:38.489151 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-875be608-c5cb-44e2-a05c-bfc660e6dde1 tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:38.501829 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-95f221a8-9d4c-45e1-8a36-3fd622b6ba24 req-5971f257-76dd-4fed-aa9c-568e0bbcc246 service nova] Creating event network-changed:7880a0f5-0cf7-4766-9699-5a2f4c04bd45 for instance 231780ff-26d8-4f4a-b52b-eba09aa1a0e8 on nch1-master-1 Jan 15 20:51:38.507275 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-95f221a8-9d4c-45e1-8a36-3fd622b6ba24 req-5971f257-76dd-4fed-aa9c-568e0bbcc246 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043980 Jan 15 20:51:38.507869 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 496/1052] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:51:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:51:38.512652 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-cd4c99c6-9dc6-4a2b-8aed-e0f120d2b7a3 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:38.513366 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-cd4c99c6-9dc6-4a2b-8aed-e0f120d2b7a3 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] [instance: b191ed6c-040a-4702-8e15-86272f9d1847] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:38.519495 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cd4c99c6-9dc6-4a2b-8aed-e0f120d2b7a3 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:38.519940 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cd4c99c6-9dc6-4a2b-8aed-e0f120d2b7a3 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:38.520870 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cd4c99c6-9dc6-4a2b-8aed-e0f120d2b7a3 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:38.521476 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cd4c99c6-9dc6-4a2b-8aed-e0f120d2b7a3 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:38.522345 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.objects.instance [None req-875be608-c5cb-44e2-a05c-bfc660e6dde1 tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Lazy-loading 'flavor' on Instance uuid 42618a48-fe11-4f55-bed2-738d2cc8a07f {{(pid=129366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 20:51:38.534530 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-875be608-c5cb-44e2-a05c-bfc660e6dde1 tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] [instance: 42618a48-fe11-4f55-bed2-738d2cc8a07f] Going to try to live migrate instance to nch2-master-1 {{(pid=129366) live_migrate /opt/stack/nova/nova/compute/api.py:5255}} Jan 15 20:51:38.663633 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-cd4c99c6-9dc6-4a2b-8aed-e0f120d2b7a3 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d4a57cfaa145009ba9cc8f21d9e8ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4a26c8edac44c8b26fd4e43813412d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:38.673612 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-cd4c99c6-9dc6-4a2b-8aed-e0f120d2b7a3 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] 10.222.0.46 "GET /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847" status: 200 len: 1472 microversion: 2.1 time: 0.164596 Jan 15 20:51:38.674248 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 497/1053] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:38 2022] GET /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847 => generated 1472 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:38.680584 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-7569392b-b36e-46a9-9f2a-11960242b70a req-83a88eb9-4e2c-4d67-9a39-5be55ffd44fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "067b97a2-ee1a-4d43-926c-11a8bfa2e332", "name": "network-vif-plugged", "status": "completed", "tag": "2dedf195-b886-49e9-99b8-57405251268c"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:51:38.682456 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:51:38.682456 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:51:38.689704 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-7569392b-b36e-46a9-9f2a-11960242b70a req-83a88eb9-4e2c-4d67-9a39-5be55ffd44fa service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:38.690150 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-7569392b-b36e-46a9-9f2a-11960242b70a req-83a88eb9-4e2c-4d67-9a39-5be55ffd44fa service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:38.704448 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-7569392b-b36e-46a9-9f2a-11960242b70a req-83a88eb9-4e2c-4d67-9a39-5be55ffd44fa service nova] Creating event network-vif-plugged:2dedf195-b886-49e9-99b8-57405251268c for instance 067b97a2-ee1a-4d43-926c-11a8bfa2e332 on nch2-master-1 Jan 15 20:51:38.709889 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-7569392b-b36e-46a9-9f2a-11960242b70a req-83a88eb9-4e2c-4d67-9a39-5be55ffd44fa service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034144 Jan 15 20:51:38.710664 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 498/1054] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:51:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:51:38.715521 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-69ebe0c2-64c2-4e8e-835e-7db5245d0866 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-756480187", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "networks": [{"uuid": "d11eef3f-f6e5-43d1-bf0a-1a5337d2e062"}]}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:51:38.781489 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.network.neutron [None req-69ebe0c2-64c2-4e8e-835e-7db5245d0866 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] validate_networks() for [('d11eef3f-f6e5-43d1-bf0a-1a5337d2e062', None, None, None, None, None)] {{(pid=129365) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 20:51:39.187517 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-69ebe0c2-64c2-4e8e-835e-7db5245d0866 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Flavor limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 20:51:39.187928 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-69ebe0c2-64c2-4e8e-835e-7db5245d0866 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Image limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 20:51:39.188642 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-69ebe0c2-64c2-4e8e-835e-7db5245d0866 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Flavor pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 20:51:39.189173 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-69ebe0c2-64c2-4e8e-835e-7db5245d0866 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Image pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 20:51:39.189665 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-69ebe0c2-64c2-4e8e-835e-7db5245d0866 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 20:51:39.203953 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-69ebe0c2-64c2-4e8e-835e-7db5245d0866 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:39.204510 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-69ebe0c2-64c2-4e8e-835e-7db5245d0866 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:39.205476 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-69ebe0c2-64c2-4e8e-835e-7db5245d0866 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:39.205918 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-69ebe0c2-64c2-4e8e-835e-7db5245d0866 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:39.223543 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-69ebe0c2-64c2-4e8e-835e-7db5245d0866 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Getting quotas for project f471d81a59824fc8afaf454a65e99933. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:51:39.228600 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-69ebe0c2-64c2-4e8e-835e-7db5245d0866 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Getting quotas for user 25473d022e7f438fa6495288f53caa7e and project f471d81a59824fc8afaf454a65e99933. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:51:39.240354 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-69ebe0c2-64c2-4e8e-835e-7db5245d0866 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Going to run 1 instances... {{(pid=129365) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 20:51:39.242903 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-69ebe0c2-64c2-4e8e-835e-7db5245d0866 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] [instance: d45d5893-c22a-4b0c-ae7d-26e205a98643] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129365) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 20:51:39.288989 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-69ebe0c2-64c2-4e8e-835e-7db5245d0866 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.576916 Jan 15 20:51:39.289784 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 499/1055] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 20:51:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 579 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 20:51:39.439249 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-cdc46379-6c14-4bbe-b69b-7f0eae85e9d9 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-258427435", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:51:39.496980 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.network.neutron [None req-cdc46379-6c14-4bbe-b69b-7f0eae85e9d9 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] validate_networks() for None {{(pid=129365) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 20:51:39.709822 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-cdc46379-6c14-4bbe-b69b-7f0eae85e9d9 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Flavor limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 20:51:39.711825 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-cdc46379-6c14-4bbe-b69b-7f0eae85e9d9 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Image limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 20:51:39.712373 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-cdc46379-6c14-4bbe-b69b-7f0eae85e9d9 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Flavor pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 20:51:39.712867 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-cdc46379-6c14-4bbe-b69b-7f0eae85e9d9 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Image pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 20:51:39.713587 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-cdc46379-6c14-4bbe-b69b-7f0eae85e9d9 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 20:51:39.722859 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cdc46379-6c14-4bbe-b69b-7f0eae85e9d9 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:39.723422 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cdc46379-6c14-4bbe-b69b-7f0eae85e9d9 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:39.724729 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cdc46379-6c14-4bbe-b69b-7f0eae85e9d9 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:39.725308 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cdc46379-6c14-4bbe-b69b-7f0eae85e9d9 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:39.751250 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-cdc46379-6c14-4bbe-b69b-7f0eae85e9d9 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Getting quotas for project 9f7b489c290846f48384c65e977ed644. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:51:39.755915 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-cdc46379-6c14-4bbe-b69b-7f0eae85e9d9 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Getting quotas for user 3352815cdc914c15b656b4d0d9511010 and project 9f7b489c290846f48384c65e977ed644. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:51:39.767097 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-cdc46379-6c14-4bbe-b69b-7f0eae85e9d9 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Going to run 1 instances... {{(pid=129365) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 20:51:39.769659 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-cdc46379-6c14-4bbe-b69b-7f0eae85e9d9 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] [instance: 1d163f47-49a0-41c9-991b-f42d16af67d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129365) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 20:51:39.816355 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-cdc46379-6c14-4bbe-b69b-7f0eae85e9d9 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.522443 Jan 15 20:51:39.817111 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 500/1056] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 20:51:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 527 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 20:51:39.824651 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-1f43f3bc-39f0-4b20-8486-90577bab13e3 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:39.825301 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-1f43f3bc-39f0-4b20-8486-90577bab13e3 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: d603f11b-5d49-492b-b541-1826486876ef] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:39.835464 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1f43f3bc-39f0-4b20-8486-90577bab13e3 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:39.836447 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1f43f3bc-39f0-4b20-8486-90577bab13e3 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:39.837696 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1f43f3bc-39f0-4b20-8486-90577bab13e3 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:39.838040 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1f43f3bc-39f0-4b20-8486-90577bab13e3 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:40.012966 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-1f43f3bc-39f0-4b20-8486-90577bab13e3 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:40.013964 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-875be608-c5cb-44e2-a05c-bfc660e6dde1 tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] 10.222.0.46 "POST /compute/v2.1/servers/42618a48-fe11-4f55-bed2-738d2cc8a07f/action" status: 202 len: 0 microversion: 2.25 time: 1.547214 Jan 15 20:51:40.018084 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 557/1057] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 20:51:38 2022] POST /compute/v2.1/servers/42618a48-fe11-4f55-bed2-738d2cc8a07f/action => generated 0 bytes in 1552 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 15 20:51:40.024015 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-1f43f3bc-39f0-4b20-8486-90577bab13e3 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/d603f11b-5d49-492b-b541-1826486876ef" status: 200 len: 1541 microversion: 2.1 time: 0.205117 Jan 15 20:51:40.025005 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 501/1058] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:39 2022] GET /compute/v2.1/servers/d603f11b-5d49-492b-b541-1826486876ef => generated 1541 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:40.030773 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-fd4a44b8-c65a-46b8-825f-99eaba78a92e tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:40.031379 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-fd4a44b8-c65a-46b8-825f-99eaba78a92e tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] [instance: d45d5893-c22a-4b0c-ae7d-26e205a98643] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:40.035815 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c06a677f-39f1-4c13-a7dd-63deeebdffe0 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:51:40.037400 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c06a677f-39f1-4c13-a7dd-63deeebdffe0 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 57bd310f-a604-40de-9c25-882284f4a17b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:40.038283 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fd4a44b8-c65a-46b8-825f-99eaba78a92e tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:40.038960 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fd4a44b8-c65a-46b8-825f-99eaba78a92e tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:40.040302 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fd4a44b8-c65a-46b8-825f-99eaba78a92e tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:40.040975 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fd4a44b8-c65a-46b8-825f-99eaba78a92e tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:40.046490 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c06a677f-39f1-4c13-a7dd-63deeebdffe0 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:40.047030 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c06a677f-39f1-4c13-a7dd-63deeebdffe0 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:40.047903 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c06a677f-39f1-4c13-a7dd-63deeebdffe0 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:40.048682 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c06a677f-39f1-4c13-a7dd-63deeebdffe0 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:40.095398 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c06a677f-39f1-4c13-a7dd-63deeebdffe0 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/action" status: 200 len: 14 microversion: 2.1 time: 0.075512 Jan 15 20:51:40.096503 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 558/1059] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:51:40 2022] POST /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/action => generated 14 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 20:51:40.103093 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-dced5ec6-0b1a-45e6-b99b-ae95b8b657fe tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:40.104108 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-dced5ec6-0b1a-45e6-b99b-ae95b8b657fe tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] [instance: 231780ff-26d8-4f4a-b52b-eba09aa1a0e8] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:40.112566 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dced5ec6-0b1a-45e6-b99b-ae95b8b657fe tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:40.113334 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dced5ec6-0b1a-45e6-b99b-ae95b8b657fe tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:40.114488 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dced5ec6-0b1a-45e6-b99b-ae95b8b657fe tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:40.120713 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-fd4a44b8-c65a-46b8-825f-99eaba78a92e tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25473d022e7f438fa6495288f53caa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f471d81a59824fc8afaf454a65e99933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:40.122954 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dced5ec6-0b1a-45e6-b99b-ae95b8b657fe tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:40.132361 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-fd4a44b8-c65a-46b8-825f-99eaba78a92e tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] 10.222.0.46 "GET /compute/v2.1/servers/d45d5893-c22a-4b0c-ae7d-26e205a98643" status: 200 len: 1275 microversion: 2.1 time: 0.105083 Jan 15 20:51:40.135252 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 502/1060] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:40 2022] GET /compute/v2.1/servers/d45d5893-c22a-4b0c-ae7d-26e205a98643 => generated 1275 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:40.141369 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b97e5a98-aab8-4e0a-844d-c2da58d74e35 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:40.141973 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b97e5a98-aab8-4e0a-844d-c2da58d74e35 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] [instance: 067b97a2-ee1a-4d43-926c-11a8bfa2e332] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:40.151048 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b97e5a98-aab8-4e0a-844d-c2da58d74e35 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:40.151604 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b97e5a98-aab8-4e0a-844d-c2da58d74e35 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:40.152429 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b97e5a98-aab8-4e0a-844d-c2da58d74e35 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:40.152864 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b97e5a98-aab8-4e0a-844d-c2da58d74e35 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:40.369501 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-dced5ec6-0b1a-45e6-b99b-ae95b8b657fe tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc38f86758f9416b9e7f6915de0359d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8cfe33be708428abef52f5e8e25621b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:40.389925 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-dced5ec6-0b1a-45e6-b99b-ae95b8b657fe tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] 10.222.0.46 "GET /compute/v2.1/servers/231780ff-26d8-4f4a-b52b-eba09aa1a0e8" status: 200 len: 1316 microversion: 2.1 time: 0.292051 Jan 15 20:51:40.391320 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 559/1061] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:40 2022] GET /compute/v2.1/servers/231780ff-26d8-4f4a-b52b-eba09aa1a0e8 => generated 1316 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:40.398579 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a5e5276d-0435-4a37-9216-a8f1c217186e tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:40.399409 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a5e5276d-0435-4a37-9216-a8f1c217186e tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] [instance: b191ed6c-040a-4702-8e15-86272f9d1847] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:40.400509 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-b97e5a98-aab8-4e0a-844d-c2da58d74e35 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55be87ae7f14b499ab2cd6fc5538988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd217e7fd648b4a78c0c32ff1c95f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:40.409993 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a5e5276d-0435-4a37-9216-a8f1c217186e tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:40.412883 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a5e5276d-0435-4a37-9216-a8f1c217186e tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:40.414870 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a5e5276d-0435-4a37-9216-a8f1c217186e tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:40.415177 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b97e5a98-aab8-4e0a-844d-c2da58d74e35 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "GET /compute/v2.1/servers/067b97a2-ee1a-4d43-926c-11a8bfa2e332" status: 200 len: 1307 microversion: 2.1 time: 0.278629 Jan 15 20:51:40.415836 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 503/1062] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:40 2022] GET /compute/v2.1/servers/067b97a2-ee1a-4d43-926c-11a8bfa2e332 => generated 1307 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:40.418187 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a5e5276d-0435-4a37-9216-a8f1c217186e tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:40.437319 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-dafe9668-765a-49fb-a069-f83eb7155e70 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:40.438093 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-dafe9668-765a-49fb-a069-f83eb7155e70 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] [instance: 1d163f47-49a0-41c9-991b-f42d16af67d1] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:40.446219 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dafe9668-765a-49fb-a069-f83eb7155e70 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:40.447157 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dafe9668-765a-49fb-a069-f83eb7155e70 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:40.447705 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dafe9668-765a-49fb-a069-f83eb7155e70 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:40.448155 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dafe9668-765a-49fb-a069-f83eb7155e70 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:40.528396 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-dafe9668-765a-49fb-a069-f83eb7155e70 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3352815cdc914c15b656b4d0d9511010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7b489c290846f48384c65e977ed644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:40.536023 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-dafe9668-765a-49fb-a069-f83eb7155e70 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] 10.222.0.46 "GET /compute/v2.1/servers/1d163f47-49a0-41c9-991b-f42d16af67d1" status: 200 len: 1220 microversion: 2.1 time: 0.108222 Jan 15 20:51:40.537764 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 504/1063] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:40 2022] GET /compute/v2.1/servers/1d163f47-49a0-41c9-991b-f42d16af67d1 => generated 1220 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:40.542062 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-743f0f0c-1eca-44b7-8942-be1c63416edb tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:40.542734 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-743f0f0c-1eca-44b7-8942-be1c63416edb tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] [instance: 42618a48-fe11-4f55-bed2-738d2cc8a07f] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:40.551630 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-743f0f0c-1eca-44b7-8942-be1c63416edb tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:40.552738 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-743f0f0c-1eca-44b7-8942-be1c63416edb tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:40.553566 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-743f0f0c-1eca-44b7-8942-be1c63416edb tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:40.554005 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-743f0f0c-1eca-44b7-8942-be1c63416edb tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:40.660594 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-a5e5276d-0435-4a37-9216-a8f1c217186e tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d4a57cfaa145009ba9cc8f21d9e8ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4a26c8edac44c8b26fd4e43813412d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:40.674642 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a5e5276d-0435-4a37-9216-a8f1c217186e tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] 10.222.0.46 "GET /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847" status: 200 len: 1472 microversion: 2.1 time: 0.281948 Jan 15 20:51:40.676059 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 560/1064] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:40 2022] GET /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847 => generated 1472 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:40.747566 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-743f0f0c-1eca-44b7-8942-be1c63416edb tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:40.759395 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-743f0f0c-1eca-44b7-8942-be1c63416edb tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:40.761163 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-743f0f0c-1eca-44b7-8942-be1c63416edb tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:40.762670 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-743f0f0c-1eca-44b7-8942-be1c63416edb tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] 10.222.0.46 "GET /compute/v2.1/servers/42618a48-fe11-4f55-bed2-738d2cc8a07f" status: 200 len: 1645 microversion: 2.25 time: 0.224090 Jan 15 20:51:40.763502 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 505/1065] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:51:40 2022] GET /compute/v2.1/servers/42618a48-fe11-4f55-bed2-738d2cc8a07f => generated 1645 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:51:41.041023 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-004f3c6b-8b53-4495-ae36-0c0653ce2b55 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:41.041587 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-004f3c6b-8b53-4495-ae36-0c0653ce2b55 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: d603f11b-5d49-492b-b541-1826486876ef] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:41.048243 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-004f3c6b-8b53-4495-ae36-0c0653ce2b55 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:41.048692 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-004f3c6b-8b53-4495-ae36-0c0653ce2b55 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:41.049505 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-004f3c6b-8b53-4495-ae36-0c0653ce2b55 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:41.049950 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-004f3c6b-8b53-4495-ae36-0c0653ce2b55 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:41.107357 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-90cad55e-2c8c-4ca0-8cb7-faae9662e9c4 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:51:41.108510 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-90cad55e-2c8c-4ca0-8cb7-faae9662e9c4 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 57bd310f-a604-40de-9c25-882284f4a17b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:41.119651 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-90cad55e-2c8c-4ca0-8cb7-faae9662e9c4 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:41.119651 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-90cad55e-2c8c-4ca0-8cb7-faae9662e9c4 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:41.120667 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-90cad55e-2c8c-4ca0-8cb7-faae9662e9c4 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:41.121672 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-90cad55e-2c8c-4ca0-8cb7-faae9662e9c4 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:41.190696 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-90cad55e-2c8c-4ca0-8cb7-faae9662e9c4 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/action" status: 200 len: 14 microversion: 2.1 time: 0.087223 Jan 15 20:51:41.194487 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 506/1066] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:51:41 2022] POST /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/action => generated 14 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 15 20:51:41.204233 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-004f3c6b-8b53-4495-ae36-0c0653ce2b55 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:41.207411 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-1d695a87-cd09-42f9-8abe-bca16e563c88 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:41.208782 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-1d695a87-cd09-42f9-8abe-bca16e563c88 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] [instance: d45d5893-c22a-4b0c-ae7d-26e205a98643] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:41.214505 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-004f3c6b-8b53-4495-ae36-0c0653ce2b55 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/d603f11b-5d49-492b-b541-1826486876ef" status: 200 len: 1541 microversion: 2.1 time: 0.177804 Jan 15 20:51:41.215433 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 561/1067] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:41 2022] GET /compute/v2.1/servers/d603f11b-5d49-492b-b541-1826486876ef => generated 1541 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:41.215689 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1d695a87-cd09-42f9-8abe-bca16e563c88 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:41.216201 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1d695a87-cd09-42f9-8abe-bca16e563c88 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:41.217015 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1d695a87-cd09-42f9-8abe-bca16e563c88 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:41.217445 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1d695a87-cd09-42f9-8abe-bca16e563c88 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:41.281011 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-1d695a87-cd09-42f9-8abe-bca16e563c88 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25473d022e7f438fa6495288f53caa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f471d81a59824fc8afaf454a65e99933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:41.289502 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-1d695a87-cd09-42f9-8abe-bca16e563c88 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] 10.222.0.46 "GET /compute/v2.1/servers/d45d5893-c22a-4b0c-ae7d-26e205a98643" status: 200 len: 1281 microversion: 2.1 time: 0.088681 Jan 15 20:51:41.290287 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 507/1068] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:41 2022] GET /compute/v2.1/servers/d45d5893-c22a-4b0c-ae7d-26e205a98643 => generated 1281 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:41.408039 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b79a67de-f450-4646-9380-304138616329 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:41.408968 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b79a67de-f450-4646-9380-304138616329 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] [instance: 231780ff-26d8-4f4a-b52b-eba09aa1a0e8] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:41.416037 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b79a67de-f450-4646-9380-304138616329 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:41.416742 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b79a67de-f450-4646-9380-304138616329 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:41.417786 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b79a67de-f450-4646-9380-304138616329 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:41.418405 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b79a67de-f450-4646-9380-304138616329 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:41.433879 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ec347438-f9d5-479b-b45d-2476960def48 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:41.434652 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ec347438-f9d5-479b-b45d-2476960def48 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] [instance: 067b97a2-ee1a-4d43-926c-11a8bfa2e332] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:41.444216 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ec347438-f9d5-479b-b45d-2476960def48 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:41.444809 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ec347438-f9d5-479b-b45d-2476960def48 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:41.446140 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ec347438-f9d5-479b-b45d-2476960def48 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:41.446693 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ec347438-f9d5-479b-b45d-2476960def48 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:41.610531 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-b79a67de-f450-4646-9380-304138616329 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc38f86758f9416b9e7f6915de0359d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8cfe33be708428abef52f5e8e25621b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:41.618890 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b79a67de-f450-4646-9380-304138616329 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] 10.222.0.46 "GET /compute/v2.1/servers/231780ff-26d8-4f4a-b52b-eba09aa1a0e8" status: 200 len: 1316 microversion: 2.1 time: 0.215013 Jan 15 20:51:41.620481 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 562/1069] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:41 2022] GET /compute/v2.1/servers/231780ff-26d8-4f4a-b52b-eba09aa1a0e8 => generated 1316 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:41.625572 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-55441e6a-3484-4553-a84a-bc65780025d9 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:41.626381 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-55441e6a-3484-4553-a84a-bc65780025d9 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] [instance: 1d163f47-49a0-41c9-991b-f42d16af67d1] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:41.633335 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-55441e6a-3484-4553-a84a-bc65780025d9 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:41.634527 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-55441e6a-3484-4553-a84a-bc65780025d9 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:41.635655 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-55441e6a-3484-4553-a84a-bc65780025d9 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:41.636254 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-55441e6a-3484-4553-a84a-bc65780025d9 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:41.677725 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-ec347438-f9d5-479b-b45d-2476960def48 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55be87ae7f14b499ab2cd6fc5538988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd217e7fd648b4a78c0c32ff1c95f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:41.688647 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ec347438-f9d5-479b-b45d-2476960def48 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "GET /compute/v2.1/servers/067b97a2-ee1a-4d43-926c-11a8bfa2e332" status: 200 len: 1486 microversion: 2.1 time: 0.257598 Jan 15 20:51:41.689285 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 508/1070] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:41 2022] GET /compute/v2.1/servers/067b97a2-ee1a-4d43-926c-11a8bfa2e332 => generated 1486 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:41.709033 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2c21b8b2-03ba-4934-8663-5e5c2a79776f tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:41.709885 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-2c21b8b2-03ba-4934-8663-5e5c2a79776f tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] [instance: b191ed6c-040a-4702-8e15-86272f9d1847] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:41.718020 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2c21b8b2-03ba-4934-8663-5e5c2a79776f tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:41.718471 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2c21b8b2-03ba-4934-8663-5e5c2a79776f tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:41.719269 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2c21b8b2-03ba-4934-8663-5e5c2a79776f tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:41.719701 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2c21b8b2-03ba-4934-8663-5e5c2a79776f tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:41.746295 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-55441e6a-3484-4553-a84a-bc65780025d9 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3352815cdc914c15b656b4d0d9511010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7b489c290846f48384c65e977ed644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:41.756335 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-55441e6a-3484-4553-a84a-bc65780025d9 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] 10.222.0.46 "GET /compute/v2.1/servers/1d163f47-49a0-41c9-991b-f42d16af67d1" status: 200 len: 1274 microversion: 2.1 time: 0.133794 Jan 15 20:51:41.758472 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 563/1071] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:41 2022] GET /compute/v2.1/servers/1d163f47-49a0-41c9-991b-f42d16af67d1 => generated 1274 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:41.781289 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-91299ad3-47f2-4895-97ef-87c2c2e71deb tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:51:41.788176 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-91299ad3-47f2-4895-97ef-87c2c2e71deb tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:41.789127 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-91299ad3-47f2-4895-97ef-87c2c2e71deb tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:41.907667 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-91299ad3-47f2-4895-97ef-87c2c2e71deb tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] [instance: 067b97a2-ee1a-4d43-926c-11a8bfa2e332] Going to try to stop instance {{(pid=129366) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Jan 15 20:51:41.982656 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-91299ad3-47f2-4895-97ef-87c2c2e71deb tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "POST /compute/v2.1/servers/067b97a2-ee1a-4d43-926c-11a8bfa2e332/action" status: 202 len: 0 microversion: 2.1 time: 0.212534 Jan 15 20:51:41.983924 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 564/1072] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:51:41 2022] POST /compute/v2.1/servers/067b97a2-ee1a-4d43-926c-11a8bfa2e332/action => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 20:51:41.994562 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c6659098-e0a1-40cb-ab12-5ef1a26b3c0d tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:41.995827 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c6659098-e0a1-40cb-ab12-5ef1a26b3c0d tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] [instance: 42618a48-fe11-4f55-bed2-738d2cc8a07f] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:42.000168 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-2c21b8b2-03ba-4934-8663-5e5c2a79776f tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d4a57cfaa145009ba9cc8f21d9e8ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4a26c8edac44c8b26fd4e43813412d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:42.008319 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c6659098-e0a1-40cb-ab12-5ef1a26b3c0d tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:42.008821 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2c21b8b2-03ba-4934-8663-5e5c2a79776f tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] 10.222.0.46 "GET /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847" status: 200 len: 1472 microversion: 2.1 time: 0.303936 Jan 15 20:51:42.009340 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c6659098-e0a1-40cb-ab12-5ef1a26b3c0d tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:42.010834 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c6659098-e0a1-40cb-ab12-5ef1a26b3c0d tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:42.011838 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c6659098-e0a1-40cb-ab12-5ef1a26b3c0d tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:42.014252 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 509/1073] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:41 2022] GET /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847 => generated 1472 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:42.025361 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a600eac8-bb3f-4c7e-820e-357cc00d6b7b tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:42.026046 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a600eac8-bb3f-4c7e-820e-357cc00d6b7b tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] [instance: 067b97a2-ee1a-4d43-926c-11a8bfa2e332] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:42.044568 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a600eac8-bb3f-4c7e-820e-357cc00d6b7b tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:42.045095 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a600eac8-bb3f-4c7e-820e-357cc00d6b7b tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:42.045915 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a600eac8-bb3f-4c7e-820e-357cc00d6b7b tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:42.046353 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a600eac8-bb3f-4c7e-820e-357cc00d6b7b tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:42.198848 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-c6659098-e0a1-40cb-ab12-5ef1a26b3c0d tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:42.207447 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-c6659098-e0a1-40cb-ab12-5ef1a26b3c0d tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:42.209349 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-c6659098-e0a1-40cb-ab12-5ef1a26b3c0d tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:42.210512 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c6659098-e0a1-40cb-ab12-5ef1a26b3c0d tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] 10.222.0.46 "GET /compute/v2.1/servers/42618a48-fe11-4f55-bed2-738d2cc8a07f" status: 200 len: 1645 microversion: 2.25 time: 0.225045 Jan 15 20:51:42.211074 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 565/1074] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:51:41 2022] GET /compute/v2.1/servers/42618a48-fe11-4f55-bed2-738d2cc8a07f => generated 1645 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:51:42.215998 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-14d167ad-5c9e-4f2e-96b4-a25a9dea01e3 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:51:42.217008 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-14d167ad-5c9e-4f2e-96b4-a25a9dea01e3 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 57bd310f-a604-40de-9c25-882284f4a17b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:42.223019 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-14d167ad-5c9e-4f2e-96b4-a25a9dea01e3 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:42.223465 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-14d167ad-5c9e-4f2e-96b4-a25a9dea01e3 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:42.224766 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-14d167ad-5c9e-4f2e-96b4-a25a9dea01e3 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:42.226671 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-14d167ad-5c9e-4f2e-96b4-a25a9dea01e3 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:42.272330 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-14d167ad-5c9e-4f2e-96b4-a25a9dea01e3 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/action" status: 200 len: 14 microversion: 2.1 time: 0.059986 Jan 15 20:51:42.273187 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 566/1075] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:51:42 2022] POST /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/action => generated 14 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 20:51:42.280487 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1974e8d2-3cfe-4fdf-813a-874ae44e5700 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:42.281689 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-1974e8d2-3cfe-4fdf-813a-874ae44e5700 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: d603f11b-5d49-492b-b541-1826486876ef] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:42.291826 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-a600eac8-bb3f-4c7e-820e-357cc00d6b7b tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55be87ae7f14b499ab2cd6fc5538988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd217e7fd648b4a78c0c32ff1c95f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:42.296336 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1974e8d2-3cfe-4fdf-813a-874ae44e5700 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:42.297369 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1974e8d2-3cfe-4fdf-813a-874ae44e5700 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:42.298509 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1974e8d2-3cfe-4fdf-813a-874ae44e5700 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:42.299441 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1974e8d2-3cfe-4fdf-813a-874ae44e5700 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:42.303392 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a600eac8-bb3f-4c7e-820e-357cc00d6b7b tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "GET /compute/v2.1/servers/067b97a2-ee1a-4d43-926c-11a8bfa2e332" status: 200 len: 1496 microversion: 2.1 time: 0.286392 Jan 15 20:51:42.304202 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 510/1076] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:42 2022] GET /compute/v2.1/servers/067b97a2-ee1a-4d43-926c-11a8bfa2e332 => generated 1496 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:42.311405 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2d7afd83-a46e-45fd-8705-38d7c36cc41b tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:42.312318 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-2d7afd83-a46e-45fd-8705-38d7c36cc41b tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] [instance: d45d5893-c22a-4b0c-ae7d-26e205a98643] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:42.331375 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2d7afd83-a46e-45fd-8705-38d7c36cc41b tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:42.332002 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2d7afd83-a46e-45fd-8705-38d7c36cc41b tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:42.333799 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2d7afd83-a46e-45fd-8705-38d7c36cc41b tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:42.334451 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2d7afd83-a46e-45fd-8705-38d7c36cc41b tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:42.556244 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-2d7afd83-a46e-45fd-8705-38d7c36cc41b tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25473d022e7f438fa6495288f53caa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f471d81a59824fc8afaf454a65e99933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:42.565460 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2d7afd83-a46e-45fd-8705-38d7c36cc41b tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] 10.222.0.46 "GET /compute/v2.1/servers/d45d5893-c22a-4b0c-ae7d-26e205a98643" status: 200 len: 1323 microversion: 2.1 time: 0.257721 Jan 15 20:51:42.566281 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 511/1077] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:42 2022] GET /compute/v2.1/servers/d45d5893-c22a-4b0c-ae7d-26e205a98643 => generated 1323 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:42.582330 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-1974e8d2-3cfe-4fdf-813a-874ae44e5700 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:42.598846 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-1974e8d2-3cfe-4fdf-813a-874ae44e5700 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/d603f11b-5d49-492b-b541-1826486876ef" status: 200 len: 1541 microversion: 2.1 time: 0.323610 Jan 15 20:51:42.600149 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 567/1078] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:42 2022] GET /compute/v2.1/servers/d603f11b-5d49-492b-b541-1826486876ef => generated 1541 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:42.635468 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-728f57d6-9b89-40a7-a325-9a37311ce4bc tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:42.635977 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-728f57d6-9b89-40a7-a325-9a37311ce4bc tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] [instance: 231780ff-26d8-4f4a-b52b-eba09aa1a0e8] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:42.642332 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-728f57d6-9b89-40a7-a325-9a37311ce4bc tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:42.642959 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-728f57d6-9b89-40a7-a325-9a37311ce4bc tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:42.644400 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-728f57d6-9b89-40a7-a325-9a37311ce4bc tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:42.645094 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-728f57d6-9b89-40a7-a325-9a37311ce4bc tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:42.777320 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0b766327-24c9-44db-9351-8c29222352eb tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:42.778811 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-0b766327-24c9-44db-9351-8c29222352eb tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] [instance: 1d163f47-49a0-41c9-991b-f42d16af67d1] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:42.792275 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0b766327-24c9-44db-9351-8c29222352eb tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:42.793260 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0b766327-24c9-44db-9351-8c29222352eb tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:42.795471 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0b766327-24c9-44db-9351-8c29222352eb tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:42.796059 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0b766327-24c9-44db-9351-8c29222352eb tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:42.828717 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-728f57d6-9b89-40a7-a325-9a37311ce4bc tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc38f86758f9416b9e7f6915de0359d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8cfe33be708428abef52f5e8e25621b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:42.854941 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-728f57d6-9b89-40a7-a325-9a37311ce4bc tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] 10.222.0.46 "GET /compute/v2.1/servers/231780ff-26d8-4f4a-b52b-eba09aa1a0e8" status: 200 len: 1316 microversion: 2.1 time: 0.222308 Jan 15 20:51:42.855949 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 512/1079] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:42 2022] GET /compute/v2.1/servers/231780ff-26d8-4f4a-b52b-eba09aa1a0e8 => generated 1316 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:42.889540 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-0b766327-24c9-44db-9351-8c29222352eb tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3352815cdc914c15b656b4d0d9511010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7b489c290846f48384c65e977ed644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:42.903877 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0b766327-24c9-44db-9351-8c29222352eb tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] 10.222.0.46 "GET /compute/v2.1/servers/1d163f47-49a0-41c9-991b-f42d16af67d1" status: 200 len: 1274 microversion: 2.1 time: 0.131891 Jan 15 20:51:42.904475 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 568/1080] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:42 2022] GET /compute/v2.1/servers/1d163f47-49a0-41c9-991b-f42d16af67d1 => generated 1274 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:43.030484 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-554b7688-f130-48bd-bc1e-012efc9285a1 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:43.031082 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-554b7688-f130-48bd-bc1e-012efc9285a1 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] [instance: b191ed6c-040a-4702-8e15-86272f9d1847] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:43.038548 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-554b7688-f130-48bd-bc1e-012efc9285a1 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:43.040002 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-554b7688-f130-48bd-bc1e-012efc9285a1 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:43.040998 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-554b7688-f130-48bd-bc1e-012efc9285a1 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:43.041521 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-554b7688-f130-48bd-bc1e-012efc9285a1 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:43.117194 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-2a5ea1cf-ae55-4cd9-8313-db5c031a6c39 req-76585f01-61b2-4753-aec9-1090fa87236c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d45d5893-c22a-4b0c-ae7d-26e205a98643", "tag": "1ca16880-699b-4753-b30c-773b6af5f27f"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:51:43.118985 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:51:43.118985 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:51:43.135426 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-2a5ea1cf-ae55-4cd9-8313-db5c031a6c39 req-76585f01-61b2-4753-aec9-1090fa87236c service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:43.139272 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-2a5ea1cf-ae55-4cd9-8313-db5c031a6c39 req-76585f01-61b2-4753-aec9-1090fa87236c service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:43.159281 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-2a5ea1cf-ae55-4cd9-8313-db5c031a6c39 req-76585f01-61b2-4753-aec9-1090fa87236c service nova] Creating event network-changed:1ca16880-699b-4753-b30c-773b6af5f27f for instance d45d5893-c22a-4b0c-ae7d-26e205a98643 on nch2-master-1 Jan 15 20:51:43.165922 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-2a5ea1cf-ae55-4cd9-8313-db5c031a6c39 req-76585f01-61b2-4753-aec9-1090fa87236c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062999 Jan 15 20:51:43.167054 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 569/1081] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:51:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:51:43.230391 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-021f4349-e23c-4157-bb43-0d694e9eb5d4 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:43.232221 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-021f4349-e23c-4157-bb43-0d694e9eb5d4 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] [instance: 42618a48-fe11-4f55-bed2-738d2cc8a07f] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:43.242768 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-021f4349-e23c-4157-bb43-0d694e9eb5d4 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:43.243122 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-021f4349-e23c-4157-bb43-0d694e9eb5d4 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:43.243677 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-554b7688-f130-48bd-bc1e-012efc9285a1 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d4a57cfaa145009ba9cc8f21d9e8ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4a26c8edac44c8b26fd4e43813412d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:43.243902 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-021f4349-e23c-4157-bb43-0d694e9eb5d4 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:43.244338 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-021f4349-e23c-4157-bb43-0d694e9eb5d4 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:43.252355 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-554b7688-f130-48bd-bc1e-012efc9285a1 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] 10.222.0.46 "GET /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847" status: 200 len: 1472 microversion: 2.1 time: 0.225647 Jan 15 20:51:43.256222 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 513/1082] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:43 2022] GET /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847 => generated 1472 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:43.288941 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-62d034d1-25ec-45c0-9168-0ef54aec39b4 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:51:43.290300 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-62d034d1-25ec-45c0-9168-0ef54aec39b4 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 57bd310f-a604-40de-9c25-882284f4a17b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:43.303348 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-62d034d1-25ec-45c0-9168-0ef54aec39b4 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:43.304659 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-62d034d1-25ec-45c0-9168-0ef54aec39b4 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:43.306814 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-62d034d1-25ec-45c0-9168-0ef54aec39b4 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:43.307794 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-62d034d1-25ec-45c0-9168-0ef54aec39b4 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:43.378753 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-62d034d1-25ec-45c0-9168-0ef54aec39b4 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/action" status: 200 len: 14 microversion: 2.1 time: 0.098518 Jan 15 20:51:43.380659 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 514/1083] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:51:43 2022] POST /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/action => generated 14 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 15 20:51:43.386959 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-6ccdffb6-945b-4b6b-8f81-5b9133bda445 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:43.387908 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-6ccdffb6-945b-4b6b-8f81-5b9133bda445 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] [instance: 067b97a2-ee1a-4d43-926c-11a8bfa2e332] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:43.401392 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6ccdffb6-945b-4b6b-8f81-5b9133bda445 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:43.402082 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6ccdffb6-945b-4b6b-8f81-5b9133bda445 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:43.403193 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6ccdffb6-945b-4b6b-8f81-5b9133bda445 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:43.403792 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6ccdffb6-945b-4b6b-8f81-5b9133bda445 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:43.476444 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-021f4349-e23c-4157-bb43-0d694e9eb5d4 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:43.490229 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-021f4349-e23c-4157-bb43-0d694e9eb5d4 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:43.492399 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-021f4349-e23c-4157-bb43-0d694e9eb5d4 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:43.493958 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-021f4349-e23c-4157-bb43-0d694e9eb5d4 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] 10.222.0.46 "GET /compute/v2.1/servers/42618a48-fe11-4f55-bed2-738d2cc8a07f" status: 200 len: 1645 microversion: 2.25 time: 0.268189 Jan 15 20:51:43.494730 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 570/1084] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:51:43 2022] GET /compute/v2.1/servers/42618a48-fe11-4f55-bed2-738d2cc8a07f => generated 1645 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 15 20:51:43.575088 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-6ccdffb6-945b-4b6b-8f81-5b9133bda445 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55be87ae7f14b499ab2cd6fc5538988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd217e7fd648b4a78c0c32ff1c95f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:43.582162 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ffe588a2-45b3-475c-9108-0725ea2ac11d tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:43.583061 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ffe588a2-45b3-475c-9108-0725ea2ac11d tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] [instance: d45d5893-c22a-4b0c-ae7d-26e205a98643] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:43.583262 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-6ccdffb6-945b-4b6b-8f81-5b9133bda445 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "GET /compute/v2.1/servers/067b97a2-ee1a-4d43-926c-11a8bfa2e332" status: 200 len: 1496 microversion: 2.1 time: 0.200893 Jan 15 20:51:43.583645 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 515/1085] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:43 2022] GET /compute/v2.1/servers/067b97a2-ee1a-4d43-926c-11a8bfa2e332 => generated 1496 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:43.589796 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ffe588a2-45b3-475c-9108-0725ea2ac11d tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:43.598037 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ffe588a2-45b3-475c-9108-0725ea2ac11d tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:43.599520 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ffe588a2-45b3-475c-9108-0725ea2ac11d tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:43.600045 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ffe588a2-45b3-475c-9108-0725ea2ac11d tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:43.617456 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-fa8fadb0-81b6-48dd-9162-c2d62a837b80 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:43.619647 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-fa8fadb0-81b6-48dd-9162-c2d62a837b80 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: d603f11b-5d49-492b-b541-1826486876ef] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:43.626927 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fa8fadb0-81b6-48dd-9162-c2d62a837b80 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:43.627516 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fa8fadb0-81b6-48dd-9162-c2d62a837b80 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:43.628517 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fa8fadb0-81b6-48dd-9162-c2d62a837b80 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:43.629195 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fa8fadb0-81b6-48dd-9162-c2d62a837b80 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:43.790423 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-ffe588a2-45b3-475c-9108-0725ea2ac11d tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25473d022e7f438fa6495288f53caa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f471d81a59824fc8afaf454a65e99933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:43.799159 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ffe588a2-45b3-475c-9108-0725ea2ac11d tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] 10.222.0.46 "GET /compute/v2.1/servers/d45d5893-c22a-4b0c-ae7d-26e205a98643" status: 200 len: 1323 microversion: 2.1 time: 0.220597 Jan 15 20:51:43.799917 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 571/1086] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:43 2022] GET /compute/v2.1/servers/d45d5893-c22a-4b0c-ae7d-26e205a98643 => generated 1323 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:51:43.841527 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-fa8fadb0-81b6-48dd-9162-c2d62a837b80 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:43.850701 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-fa8fadb0-81b6-48dd-9162-c2d62a837b80 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/d603f11b-5d49-492b-b541-1826486876ef" status: 200 len: 1541 microversion: 2.1 time: 0.238947 Jan 15 20:51:43.851325 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 516/1087] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:43 2022] GET /compute/v2.1/servers/d603f11b-5d49-492b-b541-1826486876ef => generated 1541 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:51:43.871609 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4bc715a1-25fd-4767-9e2e-9bf2ef67621f tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:43.872216 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-4bc715a1-25fd-4767-9e2e-9bf2ef67621f tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] [instance: 231780ff-26d8-4f4a-b52b-eba09aa1a0e8] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:43.878409 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4bc715a1-25fd-4767-9e2e-9bf2ef67621f tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:43.878859 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4bc715a1-25fd-4767-9e2e-9bf2ef67621f tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:43.879651 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4bc715a1-25fd-4767-9e2e-9bf2ef67621f tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:43.880087 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4bc715a1-25fd-4767-9e2e-9bf2ef67621f tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:43.923333 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e512ee69-de08-42c2-80cb-6dd509e761cc tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:43.924501 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e512ee69-de08-42c2-80cb-6dd509e761cc tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] [instance: 1d163f47-49a0-41c9-991b-f42d16af67d1] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:43.934502 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e512ee69-de08-42c2-80cb-6dd509e761cc tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:43.938989 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e512ee69-de08-42c2-80cb-6dd509e761cc tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:43.938989 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e512ee69-de08-42c2-80cb-6dd509e761cc tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:43.938989 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e512ee69-de08-42c2-80cb-6dd509e761cc tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:44.084778 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-4bc715a1-25fd-4767-9e2e-9bf2ef67621f tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc38f86758f9416b9e7f6915de0359d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8cfe33be708428abef52f5e8e25621b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:44.092460 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-4bc715a1-25fd-4767-9e2e-9bf2ef67621f tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] 10.222.0.46 "GET /compute/v2.1/servers/231780ff-26d8-4f4a-b52b-eba09aa1a0e8" status: 200 len: 1316 microversion: 2.1 time: 0.224503 Jan 15 20:51:44.093299 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 572/1088] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:43 2022] GET /compute/v2.1/servers/231780ff-26d8-4f4a-b52b-eba09aa1a0e8 => generated 1316 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:44.136770 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-e512ee69-de08-42c2-80cb-6dd509e761cc tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3352815cdc914c15b656b4d0d9511010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7b489c290846f48384c65e977ed644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:44.144227 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e512ee69-de08-42c2-80cb-6dd509e761cc tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] 10.222.0.46 "GET /compute/v2.1/servers/1d163f47-49a0-41c9-991b-f42d16af67d1" status: 200 len: 1316 microversion: 2.1 time: 0.227296 Jan 15 20:51:44.144805 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 517/1089] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:43 2022] GET /compute/v2.1/servers/1d163f47-49a0-41c9-991b-f42d16af67d1 => generated 1316 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:51:44.271609 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ca19ff7a-fbb6-4be4-af78-f9a32b2f6354 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:44.272210 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ca19ff7a-fbb6-4be4-af78-f9a32b2f6354 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] [instance: b191ed6c-040a-4702-8e15-86272f9d1847] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:44.278864 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ca19ff7a-fbb6-4be4-af78-f9a32b2f6354 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:44.279311 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ca19ff7a-fbb6-4be4-af78-f9a32b2f6354 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:44.280094 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ca19ff7a-fbb6-4be4-af78-f9a32b2f6354 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:44.280529 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ca19ff7a-fbb6-4be4-af78-f9a32b2f6354 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:44.391461 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-94b69293-327a-427d-ad4a-efefe1ac7c17 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:51:44.392964 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-94b69293-327a-427d-ad4a-efefe1ac7c17 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 57bd310f-a604-40de-9c25-882284f4a17b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:44.403767 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-94b69293-327a-427d-ad4a-efefe1ac7c17 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:44.404227 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-94b69293-327a-427d-ad4a-efefe1ac7c17 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:44.405462 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-94b69293-327a-427d-ad4a-efefe1ac7c17 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:44.405462 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-94b69293-327a-427d-ad4a-efefe1ac7c17 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:44.441363 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-ca19ff7a-fbb6-4be4-af78-f9a32b2f6354 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d4a57cfaa145009ba9cc8f21d9e8ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4a26c8edac44c8b26fd4e43813412d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:44.459112 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ca19ff7a-fbb6-4be4-af78-f9a32b2f6354 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] 10.222.0.46 "GET /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847" status: 200 len: 1472 microversion: 2.1 time: 0.186419 Jan 15 20:51:44.469181 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 573/1090] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:44 2022] GET /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847 => generated 1472 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:44.479719 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-94b69293-327a-427d-ad4a-efefe1ac7c17 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/action" status: 200 len: 14 microversion: 2.1 time: 0.091824 Jan 15 20:51:44.482281 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 518/1091] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:51:44 2022] POST /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/action => generated 14 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 20:51:44.512670 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4d5b1a74-67fc-47f4-a50f-3eaa2152a384 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:44.513387 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-4d5b1a74-67fc-47f4-a50f-3eaa2152a384 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] [instance: 42618a48-fe11-4f55-bed2-738d2cc8a07f] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:44.519671 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4d5b1a74-67fc-47f4-a50f-3eaa2152a384 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:44.520444 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4d5b1a74-67fc-47f4-a50f-3eaa2152a384 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:44.522350 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4d5b1a74-67fc-47f4-a50f-3eaa2152a384 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:44.522733 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4d5b1a74-67fc-47f4-a50f-3eaa2152a384 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:44.601937 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3916d4c6-7e18-499c-9345-621c8c8dae31 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:44.603226 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-3916d4c6-7e18-499c-9345-621c8c8dae31 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] [instance: 067b97a2-ee1a-4d43-926c-11a8bfa2e332] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:44.612317 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3916d4c6-7e18-499c-9345-621c8c8dae31 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:44.612970 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3916d4c6-7e18-499c-9345-621c8c8dae31 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:44.613921 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3916d4c6-7e18-499c-9345-621c8c8dae31 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:44.614619 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3916d4c6-7e18-499c-9345-621c8c8dae31 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:44.694419 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-4d5b1a74-67fc-47f4-a50f-3eaa2152a384 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:44.718437 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-4d5b1a74-67fc-47f4-a50f-3eaa2152a384 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:44.721444 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-4d5b1a74-67fc-47f4-a50f-3eaa2152a384 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:44.726161 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-4d5b1a74-67fc-47f4-a50f-3eaa2152a384 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] 10.222.0.46 "GET /compute/v2.1/servers/42618a48-fe11-4f55-bed2-738d2cc8a07f" status: 200 len: 1645 microversion: 2.25 time: 0.216847 Jan 15 20:51:44.737244 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 574/1092] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:51:44 2022] GET /compute/v2.1/servers/42618a48-fe11-4f55-bed2-738d2cc8a07f => generated 1645 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:51:44.794914 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-3916d4c6-7e18-499c-9345-621c8c8dae31 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55be87ae7f14b499ab2cd6fc5538988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd217e7fd648b4a78c0c32ff1c95f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:44.804319 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3916d4c6-7e18-499c-9345-621c8c8dae31 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "GET /compute/v2.1/servers/067b97a2-ee1a-4d43-926c-11a8bfa2e332" status: 200 len: 1496 microversion: 2.1 time: 0.207414 Jan 15 20:51:44.805114 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 519/1093] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:44 2022] GET /compute/v2.1/servers/067b97a2-ee1a-4d43-926c-11a8bfa2e332 => generated 1496 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:44.816602 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4577e8f7-fa02-4fdb-b2f0-c129512ab368 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:44.819893 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-4577e8f7-fa02-4fdb-b2f0-c129512ab368 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] [instance: d45d5893-c22a-4b0c-ae7d-26e205a98643] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:44.828985 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4577e8f7-fa02-4fdb-b2f0-c129512ab368 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:44.829441 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4577e8f7-fa02-4fdb-b2f0-c129512ab368 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:44.830580 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4577e8f7-fa02-4fdb-b2f0-c129512ab368 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:44.831426 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4577e8f7-fa02-4fdb-b2f0-c129512ab368 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:44.868726 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-807bc235-fd44-4395-8efa-5e3d4891e10e tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:44.869425 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-807bc235-fd44-4395-8efa-5e3d4891e10e tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: d603f11b-5d49-492b-b541-1826486876ef] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:44.875701 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-807bc235-fd44-4395-8efa-5e3d4891e10e tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:44.878723 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-807bc235-fd44-4395-8efa-5e3d4891e10e tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:44.878723 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-807bc235-fd44-4395-8efa-5e3d4891e10e tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:44.878723 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-807bc235-fd44-4395-8efa-5e3d4891e10e tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:45.064662 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-4577e8f7-fa02-4fdb-b2f0-c129512ab368 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25473d022e7f438fa6495288f53caa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f471d81a59824fc8afaf454a65e99933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:45.081154 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-4577e8f7-fa02-4fdb-b2f0-c129512ab368 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] 10.222.0.46 "GET /compute/v2.1/servers/d45d5893-c22a-4b0c-ae7d-26e205a98643" status: 200 len: 1323 microversion: 2.1 time: 0.267535 Jan 15 20:51:45.082049 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 575/1094] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:44 2022] GET /compute/v2.1/servers/d45d5893-c22a-4b0c-ae7d-26e205a98643 => generated 1323 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:45.105522 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-807bc235-fd44-4395-8efa-5e3d4891e10e tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:45.111351 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1e8e3409-99ce-4128-980f-2e527f9ad382 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:45.111957 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-1e8e3409-99ce-4128-980f-2e527f9ad382 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] [instance: 231780ff-26d8-4f4a-b52b-eba09aa1a0e8] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:45.116747 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-807bc235-fd44-4395-8efa-5e3d4891e10e tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/d603f11b-5d49-492b-b541-1826486876ef" status: 200 len: 1540 microversion: 2.1 time: 0.252813 Jan 15 20:51:45.117866 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 520/1095] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:44 2022] GET /compute/v2.1/servers/d603f11b-5d49-492b-b541-1826486876ef => generated 1540 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:45.119570 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1e8e3409-99ce-4128-980f-2e527f9ad382 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:45.120017 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1e8e3409-99ce-4128-980f-2e527f9ad382 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:45.121455 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1e8e3409-99ce-4128-980f-2e527f9ad382 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:45.121957 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1e8e3409-99ce-4128-980f-2e527f9ad382 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:45.162324 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e9aac84c-0c32-4da8-b7a1-13e3c9a9ddae tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:45.163382 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e9aac84c-0c32-4da8-b7a1-13e3c9a9ddae tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] [instance: 1d163f47-49a0-41c9-991b-f42d16af67d1] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:45.173485 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e9aac84c-0c32-4da8-b7a1-13e3c9a9ddae tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:45.174171 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e9aac84c-0c32-4da8-b7a1-13e3c9a9ddae tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:45.175477 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e9aac84c-0c32-4da8-b7a1-13e3c9a9ddae tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:45.176209 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e9aac84c-0c32-4da8-b7a1-13e3c9a9ddae tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:45.302543 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-1e8e3409-99ce-4128-980f-2e527f9ad382 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc38f86758f9416b9e7f6915de0359d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8cfe33be708428abef52f5e8e25621b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:45.315847 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-1e8e3409-99ce-4128-980f-2e527f9ad382 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] 10.222.0.46 "GET /compute/v2.1/servers/231780ff-26d8-4f4a-b52b-eba09aa1a0e8" status: 200 len: 1316 microversion: 2.1 time: 0.209603 Jan 15 20:51:45.317097 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 576/1096] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:45 2022] GET /compute/v2.1/servers/231780ff-26d8-4f4a-b52b-eba09aa1a0e8 => generated 1316 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:45.326905 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-9619f572-83d9-40cd-8f2d-9e3ab5c278bd req-6f2680e4-20f1-4a0f-8a52-a87331468c11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d163f47-49a0-41c9-991b-f42d16af67d1", "tag": "26758887-8e21-4143-9b13-3eccf74a0d5b"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:51:45.326905 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:51:45.326905 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:51:45.341081 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-9619f572-83d9-40cd-8f2d-9e3ab5c278bd req-6f2680e4-20f1-4a0f-8a52-a87331468c11 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:45.341081 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-9619f572-83d9-40cd-8f2d-9e3ab5c278bd req-6f2680e4-20f1-4a0f-8a52-a87331468c11 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:45.358024 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-9619f572-83d9-40cd-8f2d-9e3ab5c278bd req-6f2680e4-20f1-4a0f-8a52-a87331468c11 service nova] Creating event network-changed:26758887-8e21-4143-9b13-3eccf74a0d5b for instance 1d163f47-49a0-41c9-991b-f42d16af67d1 on nch2-master-1 Jan 15 20:51:45.364741 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-9619f572-83d9-40cd-8f2d-9e3ab5c278bd req-6f2680e4-20f1-4a0f-8a52-a87331468c11 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044770 Jan 15 20:51:45.365599 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 577/1097] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:51:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:51:45.394565 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-e9aac84c-0c32-4da8-b7a1-13e3c9a9ddae tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3352815cdc914c15b656b4d0d9511010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7b489c290846f48384c65e977ed644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:45.403972 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e9aac84c-0c32-4da8-b7a1-13e3c9a9ddae tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] 10.222.0.46 "GET /compute/v2.1/servers/1d163f47-49a0-41c9-991b-f42d16af67d1" status: 200 len: 1316 microversion: 2.1 time: 0.245890 Jan 15 20:51:45.405564 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 521/1098] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:45 2022] GET /compute/v2.1/servers/1d163f47-49a0-41c9-991b-f42d16af67d1 => generated 1316 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:51:45.479355 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f555c801-7e8f-49fc-9390-3b041acc5271 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:45.480357 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f555c801-7e8f-49fc-9390-3b041acc5271 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] [instance: b191ed6c-040a-4702-8e15-86272f9d1847] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:45.486664 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f555c801-7e8f-49fc-9390-3b041acc5271 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:45.487121 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f555c801-7e8f-49fc-9390-3b041acc5271 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:45.487908 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f555c801-7e8f-49fc-9390-3b041acc5271 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:45.488349 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f555c801-7e8f-49fc-9390-3b041acc5271 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:45.491528 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e7b9687e-ec3c-4d60-95a8-7b60b3caaa8c tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:51:45.492476 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e7b9687e-ec3c-4d60-95a8-7b60b3caaa8c tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 57bd310f-a604-40de-9c25-882284f4a17b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:45.498351 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e7b9687e-ec3c-4d60-95a8-7b60b3caaa8c tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:45.499050 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e7b9687e-ec3c-4d60-95a8-7b60b3caaa8c tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:45.499832 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e7b9687e-ec3c-4d60-95a8-7b60b3caaa8c tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:45.500260 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e7b9687e-ec3c-4d60-95a8-7b60b3caaa8c tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:45.542858 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e7b9687e-ec3c-4d60-95a8-7b60b3caaa8c tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/action" status: 200 len: 14 microversion: 2.1 time: 0.056005 Jan 15 20:51:45.546475 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 522/1099] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:51:45 2022] POST /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/action => generated 14 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 20:51:45.630797 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-f555c801-7e8f-49fc-9390-3b041acc5271 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d4a57cfaa145009ba9cc8f21d9e8ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4a26c8edac44c8b26fd4e43813412d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:45.638464 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f555c801-7e8f-49fc-9390-3b041acc5271 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] 10.222.0.46 "GET /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847" status: 200 len: 1472 microversion: 2.1 time: 0.165689 Jan 15 20:51:45.639040 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 578/1100] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:45 2022] GET /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847 => generated 1472 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:45.744682 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-7c11abe5-3f3a-47ae-970f-d4441dfbfe96 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:45.745414 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-7c11abe5-3f3a-47ae-970f-d4441dfbfe96 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] [instance: 42618a48-fe11-4f55-bed2-738d2cc8a07f] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:45.752803 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7c11abe5-3f3a-47ae-970f-d4441dfbfe96 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:45.753275 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7c11abe5-3f3a-47ae-970f-d4441dfbfe96 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:45.754063 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7c11abe5-3f3a-47ae-970f-d4441dfbfe96 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:45.754500 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7c11abe5-3f3a-47ae-970f-d4441dfbfe96 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:45.821394 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-28d81c5c-1fe4-4934-bbdb-d931e37cc6d5 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:45.822403 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-28d81c5c-1fe4-4934-bbdb-d931e37cc6d5 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] [instance: 067b97a2-ee1a-4d43-926c-11a8bfa2e332] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:45.830631 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-28d81c5c-1fe4-4934-bbdb-d931e37cc6d5 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:45.831107 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-28d81c5c-1fe4-4934-bbdb-d931e37cc6d5 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:45.834683 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-28d81c5c-1fe4-4934-bbdb-d931e37cc6d5 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:45.836050 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-28d81c5c-1fe4-4934-bbdb-d931e37cc6d5 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:45.991075 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-7c11abe5-3f3a-47ae-970f-d4441dfbfe96 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:46.001280 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-7c11abe5-3f3a-47ae-970f-d4441dfbfe96 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:46.003332 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-7c11abe5-3f3a-47ae-970f-d4441dfbfe96 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:46.005339 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-7c11abe5-3f3a-47ae-970f-d4441dfbfe96 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] 10.222.0.46 "GET /compute/v2.1/servers/42618a48-fe11-4f55-bed2-738d2cc8a07f" status: 200 len: 1645 microversion: 2.25 time: 0.264242 Jan 15 20:51:46.017828 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 523/1101] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:51:45 2022] GET /compute/v2.1/servers/42618a48-fe11-4f55-bed2-738d2cc8a07f => generated 1645 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:51:46.033249 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-28d81c5c-1fe4-4934-bbdb-d931e37cc6d5 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55be87ae7f14b499ab2cd6fc5538988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd217e7fd648b4a78c0c32ff1c95f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:46.051774 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-28d81c5c-1fe4-4934-bbdb-d931e37cc6d5 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "GET /compute/v2.1/servers/067b97a2-ee1a-4d43-926c-11a8bfa2e332" status: 200 len: 1496 microversion: 2.1 time: 0.234213 Jan 15 20:51:46.052371 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 579/1102] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:45 2022] GET /compute/v2.1/servers/067b97a2-ee1a-4d43-926c-11a8bfa2e332 => generated 1496 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:46.101554 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-bf4f956c-1f12-4738-ad85-38bea9d1d2bc tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:46.102164 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-bf4f956c-1f12-4738-ad85-38bea9d1d2bc tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] [instance: d45d5893-c22a-4b0c-ae7d-26e205a98643] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:46.108221 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bf4f956c-1f12-4738-ad85-38bea9d1d2bc tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:46.108670 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bf4f956c-1f12-4738-ad85-38bea9d1d2bc tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:46.109602 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bf4f956c-1f12-4738-ad85-38bea9d1d2bc tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:46.110018 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bf4f956c-1f12-4738-ad85-38bea9d1d2bc tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:46.135468 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-147ce39c-8ab1-459c-84e2-95f6cdf460c0 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:46.136419 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-147ce39c-8ab1-459c-84e2-95f6cdf460c0 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: d603f11b-5d49-492b-b541-1826486876ef] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:46.142965 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-147ce39c-8ab1-459c-84e2-95f6cdf460c0 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:46.143446 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-147ce39c-8ab1-459c-84e2-95f6cdf460c0 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:46.144263 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-147ce39c-8ab1-459c-84e2-95f6cdf460c0 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:46.144723 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-147ce39c-8ab1-459c-84e2-95f6cdf460c0 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:46.305335 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-bf4f956c-1f12-4738-ad85-38bea9d1d2bc tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25473d022e7f438fa6495288f53caa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f471d81a59824fc8afaf454a65e99933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:46.313154 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-bf4f956c-1f12-4738-ad85-38bea9d1d2bc tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] 10.222.0.46 "GET /compute/v2.1/servers/d45d5893-c22a-4b0c-ae7d-26e205a98643" status: 200 len: 1323 microversion: 2.1 time: 0.216448 Jan 15 20:51:46.314023 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 524/1103] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:46 2022] GET /compute/v2.1/servers/d45d5893-c22a-4b0c-ae7d-26e205a98643 => generated 1323 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:46.337965 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e825853e-9262-4cc8-9041-165df6903271 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:46.338853 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e825853e-9262-4cc8-9041-165df6903271 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] [instance: 231780ff-26d8-4f4a-b52b-eba09aa1a0e8] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:46.345694 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e825853e-9262-4cc8-9041-165df6903271 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:46.346396 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e825853e-9262-4cc8-9041-165df6903271 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:46.347348 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e825853e-9262-4cc8-9041-165df6903271 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:46.348061 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e825853e-9262-4cc8-9041-165df6903271 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:46.367692 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-147ce39c-8ab1-459c-84e2-95f6cdf460c0 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:46.393080 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-147ce39c-8ab1-459c-84e2-95f6cdf460c0 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/d603f11b-5d49-492b-b541-1826486876ef" status: 200 len: 1540 microversion: 2.1 time: 0.262628 Jan 15 20:51:46.404799 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 580/1104] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:46 2022] GET /compute/v2.1/servers/d603f11b-5d49-492b-b541-1826486876ef => generated 1540 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:51:46.422234 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b80446a0-c442-4bbf-b58a-91ad2390d25e tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:46.422839 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b80446a0-c442-4bbf-b58a-91ad2390d25e tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] [instance: 1d163f47-49a0-41c9-991b-f42d16af67d1] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:46.430056 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b80446a0-c442-4bbf-b58a-91ad2390d25e tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:46.430656 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b80446a0-c442-4bbf-b58a-91ad2390d25e tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:46.431555 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b80446a0-c442-4bbf-b58a-91ad2390d25e tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:46.431992 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b80446a0-c442-4bbf-b58a-91ad2390d25e tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:46.592397 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-e825853e-9262-4cc8-9041-165df6903271 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc38f86758f9416b9e7f6915de0359d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8cfe33be708428abef52f5e8e25621b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:46.601860 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e825853e-9262-4cc8-9041-165df6903271 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] 10.222.0.46 "GET /compute/v2.1/servers/231780ff-26d8-4f4a-b52b-eba09aa1a0e8" status: 200 len: 1316 microversion: 2.1 time: 0.268630 Jan 15 20:51:46.602448 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 525/1105] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:46 2022] GET /compute/v2.1/servers/231780ff-26d8-4f4a-b52b-eba09aa1a0e8 => generated 1316 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:46.611509 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-40227b57-23f7-424b-9b07-aa3ef57520b2 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:51:46.612858 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-40227b57-23f7-424b-9b07-aa3ef57520b2 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 57bd310f-a604-40de-9c25-882284f4a17b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:46.620501 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-40227b57-23f7-424b-9b07-aa3ef57520b2 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:46.621001 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-40227b57-23f7-424b-9b07-aa3ef57520b2 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:46.622109 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-40227b57-23f7-424b-9b07-aa3ef57520b2 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:46.622552 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-40227b57-23f7-424b-9b07-aa3ef57520b2 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:46.626232 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-b80446a0-c442-4bbf-b58a-91ad2390d25e tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3352815cdc914c15b656b4d0d9511010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7b489c290846f48384c65e977ed644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:46.634735 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b80446a0-c442-4bbf-b58a-91ad2390d25e tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] 10.222.0.46 "GET /compute/v2.1/servers/1d163f47-49a0-41c9-991b-f42d16af67d1" status: 200 len: 1316 microversion: 2.1 time: 0.216606 Jan 15 20:51:46.643865 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 581/1106] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:46 2022] GET /compute/v2.1/servers/1d163f47-49a0-41c9-991b-f42d16af67d1 => generated 1316 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:51:46.657403 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1f892240-6860-424d-ba79-e91ba28e6d92 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:46.658234 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-1f892240-6860-424d-ba79-e91ba28e6d92 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] [instance: b191ed6c-040a-4702-8e15-86272f9d1847] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:46.665812 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1f892240-6860-424d-ba79-e91ba28e6d92 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:46.666346 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1f892240-6860-424d-ba79-e91ba28e6d92 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:46.667671 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1f892240-6860-424d-ba79-e91ba28e6d92 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:46.668369 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1f892240-6860-424d-ba79-e91ba28e6d92 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:46.678913 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-40227b57-23f7-424b-9b07-aa3ef57520b2 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/action" status: 200 len: 14 microversion: 2.1 time: 0.072149 Jan 15 20:51:46.682249 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 526/1107] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:51:46 2022] POST /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/action => generated 14 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 20:51:46.738329 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-5a47d831-e61c-45a5-a8fd-69f4b0f4388e req-f48c570f-7674-4a25-8ce0-de49df43a972 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "231780ff-26d8-4f4a-b52b-eba09aa1a0e8", "name": "network-vif-plugged", "status": "completed", "tag": "7880a0f5-0cf7-4766-9699-5a2f4c04bd45"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:51:46.741365 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:51:46.741365 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:51:46.755598 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-5a47d831-e61c-45a5-a8fd-69f4b0f4388e req-f48c570f-7674-4a25-8ce0-de49df43a972 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:46.757720 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-5a47d831-e61c-45a5-a8fd-69f4b0f4388e req-f48c570f-7674-4a25-8ce0-de49df43a972 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:46.776515 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-5a47d831-e61c-45a5-a8fd-69f4b0f4388e req-f48c570f-7674-4a25-8ce0-de49df43a972 service nova] Creating event network-vif-plugged:7880a0f5-0cf7-4766-9699-5a2f4c04bd45 for instance 231780ff-26d8-4f4a-b52b-eba09aa1a0e8 on nch1-master-1 Jan 15 20:51:46.787757 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-5a47d831-e61c-45a5-a8fd-69f4b0f4388e req-f48c570f-7674-4a25-8ce0-de49df43a972 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055779 Jan 15 20:51:46.793687 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 527/1108] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:51:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 20:51:46.854751 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-1f892240-6860-424d-ba79-e91ba28e6d92 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d4a57cfaa145009ba9cc8f21d9e8ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4a26c8edac44c8b26fd4e43813412d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:46.871485 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-1f892240-6860-424d-ba79-e91ba28e6d92 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] 10.222.0.46 "GET /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847" status: 200 len: 1472 microversion: 2.1 time: 0.219002 Jan 15 20:51:46.872450 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 582/1109] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:46 2022] GET /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847 => generated 1472 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:47.025845 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b929b6fe-7dba-4b2e-a4c2-96dddeed34f9 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:47.026542 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b929b6fe-7dba-4b2e-a4c2-96dddeed34f9 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] [instance: 42618a48-fe11-4f55-bed2-738d2cc8a07f] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:47.033029 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b929b6fe-7dba-4b2e-a4c2-96dddeed34f9 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:47.033478 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b929b6fe-7dba-4b2e-a4c2-96dddeed34f9 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:47.034273 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b929b6fe-7dba-4b2e-a4c2-96dddeed34f9 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:47.034709 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b929b6fe-7dba-4b2e-a4c2-96dddeed34f9 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:47.069151 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e7c84de2-677f-45e9-b855-d9fe2aa4d4af tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:47.070055 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e7c84de2-677f-45e9-b855-d9fe2aa4d4af tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] [instance: 067b97a2-ee1a-4d43-926c-11a8bfa2e332] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:47.076449 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e7c84de2-677f-45e9-b855-d9fe2aa4d4af tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:47.076950 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e7c84de2-677f-45e9-b855-d9fe2aa4d4af tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:47.077855 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e7c84de2-677f-45e9-b855-d9fe2aa4d4af tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:47.078445 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e7c84de2-677f-45e9-b855-d9fe2aa4d4af tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:47.210595 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-b929b6fe-7dba-4b2e-a4c2-96dddeed34f9 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:47.219540 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-b929b6fe-7dba-4b2e-a4c2-96dddeed34f9 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:47.221457 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-b929b6fe-7dba-4b2e-a4c2-96dddeed34f9 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:47.222638 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b929b6fe-7dba-4b2e-a4c2-96dddeed34f9 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] 10.222.0.46 "GET /compute/v2.1/servers/42618a48-fe11-4f55-bed2-738d2cc8a07f" status: 200 len: 1645 microversion: 2.25 time: 0.202651 Jan 15 20:51:47.223207 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 528/1110] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:51:47 2022] GET /compute/v2.1/servers/42618a48-fe11-4f55-bed2-738d2cc8a07f => generated 1645 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:51:47.283862 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-e7c84de2-677f-45e9-b855-d9fe2aa4d4af tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55be87ae7f14b499ab2cd6fc5538988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd217e7fd648b4a78c0c32ff1c95f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:47.294263 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e7c84de2-677f-45e9-b855-d9fe2aa4d4af tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "GET /compute/v2.1/servers/067b97a2-ee1a-4d43-926c-11a8bfa2e332" status: 200 len: 1496 microversion: 2.1 time: 0.228401 Jan 15 20:51:47.295067 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 583/1111] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:47 2022] GET /compute/v2.1/servers/067b97a2-ee1a-4d43-926c-11a8bfa2e332 => generated 1496 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:51:47.330975 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-dd1a2b37-6ec4-45f2-b03b-70736810f0f7 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:47.331582 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-dd1a2b37-6ec4-45f2-b03b-70736810f0f7 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] [instance: d45d5893-c22a-4b0c-ae7d-26e205a98643] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:47.338367 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dd1a2b37-6ec4-45f2-b03b-70736810f0f7 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:47.338791 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dd1a2b37-6ec4-45f2-b03b-70736810f0f7 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:47.339613 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dd1a2b37-6ec4-45f2-b03b-70736810f0f7 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:47.340051 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dd1a2b37-6ec4-45f2-b03b-70736810f0f7 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:47.413550 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c60ca4b8-4577-43c1-af16-ddd7a8557fce tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:47.414495 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c60ca4b8-4577-43c1-af16-ddd7a8557fce tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: d603f11b-5d49-492b-b541-1826486876ef] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:47.421606 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c60ca4b8-4577-43c1-af16-ddd7a8557fce tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:47.422484 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c60ca4b8-4577-43c1-af16-ddd7a8557fce tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:47.423591 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c60ca4b8-4577-43c1-af16-ddd7a8557fce tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:47.424154 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c60ca4b8-4577-43c1-af16-ddd7a8557fce tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:47.512827 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-dd1a2b37-6ec4-45f2-b03b-70736810f0f7 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25473d022e7f438fa6495288f53caa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f471d81a59824fc8afaf454a65e99933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:47.522519 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-dd1a2b37-6ec4-45f2-b03b-70736810f0f7 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] 10.222.0.46 "GET /compute/v2.1/servers/d45d5893-c22a-4b0c-ae7d-26e205a98643" status: 200 len: 1323 microversion: 2.1 time: 0.195139 Jan 15 20:51:47.530600 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 529/1112] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:47 2022] GET /compute/v2.1/servers/d45d5893-c22a-4b0c-ae7d-26e205a98643 => generated 1323 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:47.543001 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-63cd56dd-358b-4a31-8f25-c9569b0de9d2 req-094af033-e2c6-4fc9-8a3b-cd5e67b35532 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d603f11b-5d49-492b-b541-1826486876ef", "name": "network-vif-unplugged", "status": "completed", "tag": "29144689-f6e8-49ab-886d-3bedd21d555f"}, {"name": "network-changed", "server_uuid": "d603f11b-5d49-492b-b541-1826486876ef", "tag": "29144689-f6e8-49ab-886d-3bedd21d555f"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:51:47.546078 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:51:47.546078 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:51:47.555041 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-63cd56dd-358b-4a31-8f25-c9569b0de9d2 req-094af033-e2c6-4fc9-8a3b-cd5e67b35532 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:47.556409 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-63cd56dd-358b-4a31-8f25-c9569b0de9d2 req-094af033-e2c6-4fc9-8a3b-cd5e67b35532 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:47.571139 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-63cd56dd-358b-4a31-8f25-c9569b0de9d2 req-094af033-e2c6-4fc9-8a3b-cd5e67b35532 service nova] Creating event network-vif-unplugged:29144689-f6e8-49ab-886d-3bedd21d555f for instance d603f11b-5d49-492b-b541-1826486876ef on nch2-master-1 Jan 15 20:51:47.571852 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-63cd56dd-358b-4a31-8f25-c9569b0de9d2 req-094af033-e2c6-4fc9-8a3b-cd5e67b35532 service nova] Creating event network-changed:29144689-f6e8-49ab-886d-3bedd21d555f for instance d603f11b-5d49-492b-b541-1826486876ef on nch2-master-1 Jan 15 20:51:47.578949 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [req-63cd56dd-358b-4a31-8f25-c9569b0de9d2 req-094af033-e2c6-4fc9-8a3b-cd5e67b35532 service nova] Instance d603f11b-5d49-492b-b541-1826486876ef is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=129365) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Jan 15 20:51:47.590542 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-63cd56dd-358b-4a31-8f25-c9569b0de9d2 req-094af033-e2c6-4fc9-8a3b-cd5e67b35532 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.057920 Jan 15 20:51:47.591509 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 530/1113] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:51:47 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:51:47.599938 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-c60ca4b8-4577-43c1-af16-ddd7a8557fce tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:47.608820 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c60ca4b8-4577-43c1-af16-ddd7a8557fce tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/d603f11b-5d49-492b-b541-1826486876ef" status: 200 len: 1540 microversion: 2.1 time: 0.200979 Jan 15 20:51:47.610086 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 584/1114] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:47 2022] GET /compute/v2.1/servers/d603f11b-5d49-492b-b541-1826486876ef => generated 1540 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:47.625453 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-60f90067-9bb1-4e6b-a694-321752964ecb tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:47.626150 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-60f90067-9bb1-4e6b-a694-321752964ecb tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] [instance: 231780ff-26d8-4f4a-b52b-eba09aa1a0e8] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:47.633545 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-60f90067-9bb1-4e6b-a694-321752964ecb tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:47.633922 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-60f90067-9bb1-4e6b-a694-321752964ecb tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:47.634774 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-60f90067-9bb1-4e6b-a694-321752964ecb tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:47.635237 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-60f90067-9bb1-4e6b-a694-321752964ecb tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:47.652511 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9f48fa59-fad8-4cb8-b9b7-73f0d21301d7 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:47.653257 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-9f48fa59-fad8-4cb8-b9b7-73f0d21301d7 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] [instance: 1d163f47-49a0-41c9-991b-f42d16af67d1] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:47.659777 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9f48fa59-fad8-4cb8-b9b7-73f0d21301d7 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:47.660358 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9f48fa59-fad8-4cb8-b9b7-73f0d21301d7 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:47.662300 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9f48fa59-fad8-4cb8-b9b7-73f0d21301d7 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:47.662975 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9f48fa59-fad8-4cb8-b9b7-73f0d21301d7 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:47.862362 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-60f90067-9bb1-4e6b-a694-321752964ecb tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc38f86758f9416b9e7f6915de0359d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8cfe33be708428abef52f5e8e25621b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:47.872598 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-60f90067-9bb1-4e6b-a694-321752964ecb tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] 10.222.0.46 "GET /compute/v2.1/servers/231780ff-26d8-4f4a-b52b-eba09aa1a0e8" status: 200 len: 1316 microversion: 2.1 time: 0.251280 Jan 15 20:51:47.873832 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 531/1115] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:47 2022] GET /compute/v2.1/servers/231780ff-26d8-4f4a-b52b-eba09aa1a0e8 => generated 1316 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:47.881265 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-0bd72bd4-8234-40e4-bf04-22dc2117242b tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:51:47.882489 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-0bd72bd4-8234-40e4-bf04-22dc2117242b tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 57bd310f-a604-40de-9c25-882284f4a17b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:47.889318 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-9f48fa59-fad8-4cb8-b9b7-73f0d21301d7 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3352815cdc914c15b656b4d0d9511010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7b489c290846f48384c65e977ed644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:47.891000 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0bd72bd4-8234-40e4-bf04-22dc2117242b tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:47.891689 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0bd72bd4-8234-40e4-bf04-22dc2117242b tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:47.892491 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0bd72bd4-8234-40e4-bf04-22dc2117242b tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:47.892963 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0bd72bd4-8234-40e4-bf04-22dc2117242b tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:47.899613 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-9f48fa59-fad8-4cb8-b9b7-73f0d21301d7 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] 10.222.0.46 "GET /compute/v2.1/servers/1d163f47-49a0-41c9-991b-f42d16af67d1" status: 200 len: 1316 microversion: 2.1 time: 0.251076 Jan 15 20:51:47.902077 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 585/1116] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:47 2022] GET /compute/v2.1/servers/1d163f47-49a0-41c9-991b-f42d16af67d1 => generated 1316 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:51:47.909004 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b7b266b1-4cbb-4265-9231-69bff0d8f2a1 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:47.912687 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b7b266b1-4cbb-4265-9231-69bff0d8f2a1 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] [instance: b191ed6c-040a-4702-8e15-86272f9d1847] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:47.920590 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b7b266b1-4cbb-4265-9231-69bff0d8f2a1 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:47.922818 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b7b266b1-4cbb-4265-9231-69bff0d8f2a1 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:47.924035 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b7b266b1-4cbb-4265-9231-69bff0d8f2a1 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:47.925072 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b7b266b1-4cbb-4265-9231-69bff0d8f2a1 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:47.954863 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-0bd72bd4-8234-40e4-bf04-22dc2117242b tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/action" status: 200 len: 8183 microversion: 2.1 time: 0.078837 Jan 15 20:51:47.956573 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 532/1117] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:51:47 2022] POST /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/action => generated 8183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:48.069764 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-b7b266b1-4cbb-4265-9231-69bff0d8f2a1 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d4a57cfaa145009ba9cc8f21d9e8ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4a26c8edac44c8b26fd4e43813412d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:48.077361 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b7b266b1-4cbb-4265-9231-69bff0d8f2a1 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] 10.222.0.46 "GET /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847" status: 200 len: 1472 microversion: 2.1 time: 0.173709 Jan 15 20:51:48.078177 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 586/1118] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:47 2022] GET /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847 => generated 1472 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:48.242147 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-68ddf3ae-167f-4c93-af14-f6f814727ee3 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:48.243013 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-68ddf3ae-167f-4c93-af14-f6f814727ee3 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] [instance: 42618a48-fe11-4f55-bed2-738d2cc8a07f] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:48.251517 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-68ddf3ae-167f-4c93-af14-f6f814727ee3 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:48.252654 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-68ddf3ae-167f-4c93-af14-f6f814727ee3 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:48.253036 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-68ddf3ae-167f-4c93-af14-f6f814727ee3 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:48.253800 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-68ddf3ae-167f-4c93-af14-f6f814727ee3 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:48.312019 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7bf12857-bff0-4e8c-ac70-767a58864cdc tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:48.312696 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-7bf12857-bff0-4e8c-ac70-767a58864cdc tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] [instance: 067b97a2-ee1a-4d43-926c-11a8bfa2e332] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:48.333227 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7bf12857-bff0-4e8c-ac70-767a58864cdc tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:48.335036 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7bf12857-bff0-4e8c-ac70-767a58864cdc tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:48.336154 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7bf12857-bff0-4e8c-ac70-767a58864cdc tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:48.337142 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7bf12857-bff0-4e8c-ac70-767a58864cdc tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:48.506426 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-7bf12857-bff0-4e8c-ac70-767a58864cdc tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55be87ae7f14b499ab2cd6fc5538988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd217e7fd648b4a78c0c32ff1c95f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:48.522193 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7bf12857-bff0-4e8c-ac70-767a58864cdc tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "GET /compute/v2.1/servers/067b97a2-ee1a-4d43-926c-11a8bfa2e332" status: 200 len: 1496 microversion: 2.1 time: 0.213882 Jan 15 20:51:48.538867 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 587/1119] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:48 2022] GET /compute/v2.1/servers/067b97a2-ee1a-4d43-926c-11a8bfa2e332 => generated 1496 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:51:48.544506 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7e3cbe74-a14c-4c01-8911-13a515dc0cab tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:48.545657 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-7e3cbe74-a14c-4c01-8911-13a515dc0cab tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] [instance: d45d5893-c22a-4b0c-ae7d-26e205a98643] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:48.554657 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7e3cbe74-a14c-4c01-8911-13a515dc0cab tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:48.555343 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7e3cbe74-a14c-4c01-8911-13a515dc0cab tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:48.556168 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7e3cbe74-a14c-4c01-8911-13a515dc0cab tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:48.556718 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7e3cbe74-a14c-4c01-8911-13a515dc0cab tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:48.798471 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-68ddf3ae-167f-4c93-af14-f6f814727ee3 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:48.799701 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-7e3cbe74-a14c-4c01-8911-13a515dc0cab tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25473d022e7f438fa6495288f53caa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f471d81a59824fc8afaf454a65e99933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:48.809247 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7e3cbe74-a14c-4c01-8911-13a515dc0cab tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] 10.222.0.46 "GET /compute/v2.1/servers/d45d5893-c22a-4b0c-ae7d-26e205a98643" status: 200 len: 1323 microversion: 2.1 time: 0.273227 Jan 15 20:51:48.814775 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-68ddf3ae-167f-4c93-af14-f6f814727ee3 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:48.816635 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-68ddf3ae-167f-4c93-af14-f6f814727ee3 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:48.819135 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 588/1120] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:48 2022] GET /compute/v2.1/servers/d45d5893-c22a-4b0c-ae7d-26e205a98643 => generated 1323 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:51:48.819647 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-68ddf3ae-167f-4c93-af14-f6f814727ee3 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] 10.222.0.46 "GET /compute/v2.1/servers/42618a48-fe11-4f55-bed2-738d2cc8a07f" status: 200 len: 1645 microversion: 2.25 time: 0.582375 Jan 15 20:51:48.820905 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 533/1121] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:51:48 2022] GET /compute/v2.1/servers/42618a48-fe11-4f55-bed2-738d2cc8a07f => generated 1645 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:51:48.833963 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-36932150-733b-4442-87c3-3453077505f9 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:48.834914 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-36932150-733b-4442-87c3-3453077505f9 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: d603f11b-5d49-492b-b541-1826486876ef] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:48.841797 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-36932150-733b-4442-87c3-3453077505f9 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:48.842482 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-36932150-733b-4442-87c3-3453077505f9 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:48.843268 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-36932150-733b-4442-87c3-3453077505f9 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:48.844217 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-36932150-733b-4442-87c3-3453077505f9 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:48.892102 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c5fe84fd-9ebc-46b0-9fd8-2e3a6f8a8d09 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:48.892711 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c5fe84fd-9ebc-46b0-9fd8-2e3a6f8a8d09 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] [instance: 231780ff-26d8-4f4a-b52b-eba09aa1a0e8] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:48.899005 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c5fe84fd-9ebc-46b0-9fd8-2e3a6f8a8d09 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:48.899460 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c5fe84fd-9ebc-46b0-9fd8-2e3a6f8a8d09 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:48.900252 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c5fe84fd-9ebc-46b0-9fd8-2e3a6f8a8d09 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:48.900718 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c5fe84fd-9ebc-46b0-9fd8-2e3a6f8a8d09 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:49.029551 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-36932150-733b-4442-87c3-3453077505f9 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:49.042013 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-36932150-733b-4442-87c3-3453077505f9 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/d603f11b-5d49-492b-b541-1826486876ef" status: 200 len: 1472 microversion: 2.1 time: 0.221344 Jan 15 20:51:49.054216 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 589/1122] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:48 2022] GET /compute/v2.1/servers/d603f11b-5d49-492b-b541-1826486876ef => generated 1472 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:49.059241 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c69666a1-84bc-4e73-a240-b59dd2d27ae0 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:49.060072 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c69666a1-84bc-4e73-a240-b59dd2d27ae0 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] [instance: 1d163f47-49a0-41c9-991b-f42d16af67d1] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:49.066563 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c69666a1-84bc-4e73-a240-b59dd2d27ae0 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:49.067339 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c69666a1-84bc-4e73-a240-b59dd2d27ae0 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:49.068140 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c69666a1-84bc-4e73-a240-b59dd2d27ae0 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:49.068580 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c69666a1-84bc-4e73-a240-b59dd2d27ae0 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:49.097347 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-c5fe84fd-9ebc-46b0-9fd8-2e3a6f8a8d09 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc38f86758f9416b9e7f6915de0359d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8cfe33be708428abef52f5e8e25621b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:49.106715 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c5fe84fd-9ebc-46b0-9fd8-2e3a6f8a8d09 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] 10.222.0.46 "GET /compute/v2.1/servers/231780ff-26d8-4f4a-b52b-eba09aa1a0e8" status: 200 len: 1316 microversion: 2.1 time: 0.219047 Jan 15 20:51:49.107647 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 534/1123] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:48 2022] GET /compute/v2.1/servers/231780ff-26d8-4f4a-b52b-eba09aa1a0e8 => generated 1316 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:49.112610 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8b8640e1-91af-4dbc-b233-2343273d4f6c tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:51:49.113607 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-8b8640e1-91af-4dbc-b233-2343273d4f6c tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 57bd310f-a604-40de-9c25-882284f4a17b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:49.119854 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8b8640e1-91af-4dbc-b233-2343273d4f6c tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:49.120314 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8b8640e1-91af-4dbc-b233-2343273d4f6c tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:49.121136 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8b8640e1-91af-4dbc-b233-2343273d4f6c tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:49.121578 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8b8640e1-91af-4dbc-b233-2343273d4f6c tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:49.162200 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-8b8640e1-91af-4dbc-b233-2343273d4f6c tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/action" status: 200 len: 8183 microversion: 2.1 time: 0.052431 Jan 15 20:51:49.162832 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 535/1124] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:51:49 2022] POST /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/action => generated 8183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:49.168217 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-0b7f4da6-be9a-45ba-a6d2-76b07bd88429 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:49.169201 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-0b7f4da6-be9a-45ba-a6d2-76b07bd88429 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] [instance: b191ed6c-040a-4702-8e15-86272f9d1847] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:49.176009 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0b7f4da6-be9a-45ba-a6d2-76b07bd88429 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:49.176501 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0b7f4da6-be9a-45ba-a6d2-76b07bd88429 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:49.177316 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0b7f4da6-be9a-45ba-a6d2-76b07bd88429 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:49.177732 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0b7f4da6-be9a-45ba-a6d2-76b07bd88429 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:49.216941 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-c69666a1-84bc-4e73-a240-b59dd2d27ae0 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3352815cdc914c15b656b4d0d9511010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7b489c290846f48384c65e977ed644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:49.224928 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c69666a1-84bc-4e73-a240-b59dd2d27ae0 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] 10.222.0.46 "GET /compute/v2.1/servers/1d163f47-49a0-41c9-991b-f42d16af67d1" status: 200 len: 1316 microversion: 2.1 time: 0.169155 Jan 15 20:51:49.225513 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 590/1125] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:49 2022] GET /compute/v2.1/servers/1d163f47-49a0-41c9-991b-f42d16af67d1 => generated 1316 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:49.314743 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-0b7f4da6-be9a-45ba-a6d2-76b07bd88429 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d4a57cfaa145009ba9cc8f21d9e8ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4a26c8edac44c8b26fd4e43813412d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:49.322778 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-0b7f4da6-be9a-45ba-a6d2-76b07bd88429 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] 10.222.0.46 "GET /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847" status: 200 len: 1472 microversion: 2.1 time: 0.158859 Jan 15 20:51:49.323335 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 536/1126] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:49 2022] GET /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847 => generated 1472 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:49.546506 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-34a349c0-f2e0-4c6b-9b31-74c728d2e2f3 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:49.547147 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-34a349c0-f2e0-4c6b-9b31-74c728d2e2f3 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] [instance: 067b97a2-ee1a-4d43-926c-11a8bfa2e332] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:49.554594 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-34a349c0-f2e0-4c6b-9b31-74c728d2e2f3 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:49.555126 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-34a349c0-f2e0-4c6b-9b31-74c728d2e2f3 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:49.555971 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-34a349c0-f2e0-4c6b-9b31-74c728d2e2f3 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:49.556411 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-34a349c0-f2e0-4c6b-9b31-74c728d2e2f3 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:49.636362 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-07b4a418-d178-4fbf-a470-a70709f5becf req-736dc044-acb8-43b0-867c-43b64f7c606e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42618a48-fe11-4f55-bed2-738d2cc8a07f", "name": "network-vif-unplugged", "status": "completed", "tag": "21a10db9-cd2b-430c-a0f4-3a2be36756f3"}, {"name": "network-changed", "server_uuid": "42618a48-fe11-4f55-bed2-738d2cc8a07f", "tag": "21a10db9-cd2b-430c-a0f4-3a2be36756f3"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:51:49.638177 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:51:49.638177 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:51:49.647083 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-07b4a418-d178-4fbf-a470-a70709f5becf req-736dc044-acb8-43b0-867c-43b64f7c606e service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:49.647642 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-07b4a418-d178-4fbf-a470-a70709f5becf req-736dc044-acb8-43b0-867c-43b64f7c606e service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:49.657965 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-07b4a418-d178-4fbf-a470-a70709f5becf req-736dc044-acb8-43b0-867c-43b64f7c606e service nova] Creating event network-vif-unplugged:21a10db9-cd2b-430c-a0f4-3a2be36756f3 for instance 42618a48-fe11-4f55-bed2-738d2cc8a07f on nch1-master-1 Jan 15 20:51:49.658473 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-07b4a418-d178-4fbf-a470-a70709f5becf req-736dc044-acb8-43b0-867c-43b64f7c606e service nova] Creating event network-changed:21a10db9-cd2b-430c-a0f4-3a2be36756f3 for instance 42618a48-fe11-4f55-bed2-738d2cc8a07f on nch1-master-1 Jan 15 20:51:49.664268 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-07b4a418-d178-4fbf-a470-a70709f5becf req-736dc044-acb8-43b0-867c-43b64f7c606e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.031787 Jan 15 20:51:49.665009 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 537/1127] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:51:49 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 20:51:49.687438 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-34a349c0-f2e0-4c6b-9b31-74c728d2e2f3 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55be87ae7f14b499ab2cd6fc5538988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd217e7fd648b4a78c0c32ff1c95f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:49.695269 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-34a349c0-f2e0-4c6b-9b31-74c728d2e2f3 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "GET /compute/v2.1/servers/067b97a2-ee1a-4d43-926c-11a8bfa2e332" status: 200 len: 1496 microversion: 2.1 time: 0.152676 Jan 15 20:51:49.695839 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 591/1128] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:49 2022] GET /compute/v2.1/servers/067b97a2-ee1a-4d43-926c-11a8bfa2e332 => generated 1496 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:49.826802 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-36b0e8a9-c6c5-405a-aaf5-26fb86a9c8e8 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:49.827497 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-36b0e8a9-c6c5-405a-aaf5-26fb86a9c8e8 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] [instance: d45d5893-c22a-4b0c-ae7d-26e205a98643] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:49.834048 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-36b0e8a9-c6c5-405a-aaf5-26fb86a9c8e8 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:49.834502 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-36b0e8a9-c6c5-405a-aaf5-26fb86a9c8e8 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:49.835409 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-36b0e8a9-c6c5-405a-aaf5-26fb86a9c8e8 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:49.835851 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-36b0e8a9-c6c5-405a-aaf5-26fb86a9c8e8 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:49.838511 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-2fc84d01-862d-47c4-b9ef-78edd3993394 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:49.839249 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-2fc84d01-862d-47c4-b9ef-78edd3993394 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] [instance: 42618a48-fe11-4f55-bed2-738d2cc8a07f] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:49.845238 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2fc84d01-862d-47c4-b9ef-78edd3993394 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:49.845683 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2fc84d01-862d-47c4-b9ef-78edd3993394 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:49.846465 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2fc84d01-862d-47c4-b9ef-78edd3993394 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:49.846896 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2fc84d01-862d-47c4-b9ef-78edd3993394 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:50.075814 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-36b0e8a9-c6c5-405a-aaf5-26fb86a9c8e8 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25473d022e7f438fa6495288f53caa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f471d81a59824fc8afaf454a65e99933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:50.077080 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-2fc84d01-862d-47c4-b9ef-78edd3993394 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:50.088225 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-2fc84d01-862d-47c4-b9ef-78edd3993394 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:50.088661 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-36b0e8a9-c6c5-405a-aaf5-26fb86a9c8e8 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] 10.222.0.46 "GET /compute/v2.1/servers/d45d5893-c22a-4b0c-ae7d-26e205a98643" status: 200 len: 1323 microversion: 2.1 time: 0.265659 Jan 15 20:51:50.098437 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-2fc84d01-862d-47c4-b9ef-78edd3993394 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:50.098674 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 538/1129] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:49 2022] GET /compute/v2.1/servers/d45d5893-c22a-4b0c-ae7d-26e205a98643 => generated 1323 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:50.098777 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-2fc84d01-862d-47c4-b9ef-78edd3993394 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] 10.222.0.46 "GET /compute/v2.1/servers/42618a48-fe11-4f55-bed2-738d2cc8a07f" status: 200 len: 1645 microversion: 2.25 time: 0.256599 Jan 15 20:51:50.098868 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d876ed24-931e-40eb-bd3a-006fd42bb658 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:50.098868 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d876ed24-931e-40eb-bd3a-006fd42bb658 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: d603f11b-5d49-492b-b541-1826486876ef] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:50.101312 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 592/1130] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:51:49 2022] GET /compute/v2.1/servers/42618a48-fe11-4f55-bed2-738d2cc8a07f => generated 1645 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 15 20:51:50.105341 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d876ed24-931e-40eb-bd3a-006fd42bb658 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:50.105834 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d876ed24-931e-40eb-bd3a-006fd42bb658 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:50.106689 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d876ed24-931e-40eb-bd3a-006fd42bb658 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:50.107188 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d876ed24-931e-40eb-bd3a-006fd42bb658 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:50.125363 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8f0f3674-ef26-47c6-bb7c-3c44e0508d68 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:50.125972 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-8f0f3674-ef26-47c6-bb7c-3c44e0508d68 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] [instance: 231780ff-26d8-4f4a-b52b-eba09aa1a0e8] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:50.132218 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8f0f3674-ef26-47c6-bb7c-3c44e0508d68 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:50.132659 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8f0f3674-ef26-47c6-bb7c-3c44e0508d68 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:50.133694 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8f0f3674-ef26-47c6-bb7c-3c44e0508d68 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:50.134276 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8f0f3674-ef26-47c6-bb7c-3c44e0508d68 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:50.339285 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-d876ed24-931e-40eb-bd3a-006fd42bb658 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:50.343966 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-8f0f3674-ef26-47c6-bb7c-3c44e0508d68 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc38f86758f9416b9e7f6915de0359d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8cfe33be708428abef52f5e8e25621b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:50.348629 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d876ed24-931e-40eb-bd3a-006fd42bb658 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/d603f11b-5d49-492b-b541-1826486876ef" status: 200 len: 1469 microversion: 2.1 time: 0.256981 Jan 15 20:51:50.354546 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 539/1131] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:50 2022] GET /compute/v2.1/servers/d603f11b-5d49-492b-b541-1826486876ef => generated 1469 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:50.357702 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-35c3eb78-3491-487f-a23e-aca908e18fea tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:51:50.358660 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-35c3eb78-3491-487f-a23e-aca908e18fea tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 57bd310f-a604-40de-9c25-882284f4a17b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:50.360198 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-8f0f3674-ef26-47c6-bb7c-3c44e0508d68 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] 10.222.0.46 "GET /compute/v2.1/servers/231780ff-26d8-4f4a-b52b-eba09aa1a0e8" status: 200 len: 1465 microversion: 2.1 time: 0.238574 Jan 15 20:51:50.360991 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 593/1132] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:50 2022] GET /compute/v2.1/servers/231780ff-26d8-4f4a-b52b-eba09aa1a0e8 => generated 1465 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:51:50.365108 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-35c3eb78-3491-487f-a23e-aca908e18fea tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:50.365559 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-35c3eb78-3491-487f-a23e-aca908e18fea tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:50.366521 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-35c3eb78-3491-487f-a23e-aca908e18fea tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:50.366960 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-35c3eb78-3491-487f-a23e-aca908e18fea tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:50.375973 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e8cafc4f-3b06-4f33-b783-c1a3e02c7c99 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:50.376868 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e8cafc4f-3b06-4f33-b783-c1a3e02c7c99 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] [instance: 1d163f47-49a0-41c9-991b-f42d16af67d1] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:50.384570 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e8cafc4f-3b06-4f33-b783-c1a3e02c7c99 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:50.385111 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e8cafc4f-3b06-4f33-b783-c1a3e02c7c99 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:50.386005 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e8cafc4f-3b06-4f33-b783-c1a3e02c7c99 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:50.386546 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e8cafc4f-3b06-4f33-b783-c1a3e02c7c99 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:50.445612 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-35c3eb78-3491-487f-a23e-aca908e18fea tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/action" status: 200 len: 16369 microversion: 2.1 time: 0.094341 Jan 15 20:51:50.446643 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 540/1133] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:51:50 2022] POST /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/action => generated 16369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:51:50.451464 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-bcdbaf79-2d72-494b-bf49-a105b44901ce tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:50.452251 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-bcdbaf79-2d72-494b-bf49-a105b44901ce tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] [instance: b191ed6c-040a-4702-8e15-86272f9d1847] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:50.459569 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bcdbaf79-2d72-494b-bf49-a105b44901ce tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:50.460749 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bcdbaf79-2d72-494b-bf49-a105b44901ce tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:50.461648 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bcdbaf79-2d72-494b-bf49-a105b44901ce tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:50.462087 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bcdbaf79-2d72-494b-bf49-a105b44901ce tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:50.558818 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-e8cafc4f-3b06-4f33-b783-c1a3e02c7c99 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3352815cdc914c15b656b4d0d9511010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7b489c290846f48384c65e977ed644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:50.566149 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e8cafc4f-3b06-4f33-b783-c1a3e02c7c99 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] 10.222.0.46 "GET /compute/v2.1/servers/1d163f47-49a0-41c9-991b-f42d16af67d1" status: 200 len: 1316 microversion: 2.1 time: 0.195654 Jan 15 20:51:50.566717 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 594/1134] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:50 2022] GET /compute/v2.1/servers/1d163f47-49a0-41c9-991b-f42d16af67d1 => generated 1316 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:50.571697 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-67288ab3-d9b5-43b1-8a3f-e07e7cbe8b75 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:51:50.572217 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-67288ab3-d9b5-43b1-8a3f-e07e7cbe8b75 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: d603f11b-5d49-492b-b541-1826486876ef] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:50.577929 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-67288ab3-d9b5-43b1-8a3f-e07e7cbe8b75 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:50.578374 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-67288ab3-d9b5-43b1-8a3f-e07e7cbe8b75 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:50.579141 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-67288ab3-d9b5-43b1-8a3f-e07e7cbe8b75 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:50.579596 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-67288ab3-d9b5-43b1-8a3f-e07e7cbe8b75 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:50.611108 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-67288ab3-d9b5-43b1-8a3f-e07e7cbe8b75 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:50.611577 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-67288ab3-d9b5-43b1-8a3f-e07e7cbe8b75 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:50.612375 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-67288ab3-d9b5-43b1-8a3f-e07e7cbe8b75 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:50.612798 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-67288ab3-d9b5-43b1-8a3f-e07e7cbe8b75 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:50.628269 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-bcdbaf79-2d72-494b-bf49-a105b44901ce tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d4a57cfaa145009ba9cc8f21d9e8ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4a26c8edac44c8b26fd4e43813412d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:50.636248 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-67288ab3-d9b5-43b1-8a3f-e07e7cbe8b75 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Getting quotas for project 8e6badf41af14266b626a14241efaf88. Resources: {'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:51:50.636405 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-bcdbaf79-2d72-494b-bf49-a105b44901ce tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] 10.222.0.46 "GET /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847" status: 200 len: 1472 microversion: 2.1 time: 0.188759 Jan 15 20:51:50.636819 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 541/1135] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:50 2022] GET /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847 => generated 1472 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:50.640480 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-67288ab3-d9b5-43b1-8a3f-e07e7cbe8b75 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Getting quotas for user 9245b10067884c428525283137ca04c6 and project 8e6badf41af14266b626a14241efaf88. Resources: {'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:51:50.641245 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-6cec112b-e5a1-4ccc-9513-aabcf15678a4 tempest-ServersOnMultiNodesTest-1194618714 tempest-ServersOnMultiNodesTest-1194618714-project-admin] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:50.641843 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-6cec112b-e5a1-4ccc-9513-aabcf15678a4 tempest-ServersOnMultiNodesTest-1194618714 tempest-ServersOnMultiNodesTest-1194618714-project-admin] [instance: 231780ff-26d8-4f4a-b52b-eba09aa1a0e8] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:50.648074 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6cec112b-e5a1-4ccc-9513-aabcf15678a4 tempest-ServersOnMultiNodesTest-1194618714 tempest-ServersOnMultiNodesTest-1194618714-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:50.648518 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6cec112b-e5a1-4ccc-9513-aabcf15678a4 tempest-ServersOnMultiNodesTest-1194618714 tempest-ServersOnMultiNodesTest-1194618714-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:50.650287 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6cec112b-e5a1-4ccc-9513-aabcf15678a4 tempest-ServersOnMultiNodesTest-1194618714 tempest-ServersOnMultiNodesTest-1194618714-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:50.650947 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6cec112b-e5a1-4ccc-9513-aabcf15678a4 tempest-ServersOnMultiNodesTest-1194618714 tempest-ServersOnMultiNodesTest-1194618714-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:50.753367 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-67288ab3-d9b5-43b1-8a3f-e07e7cbe8b75 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "POST /compute/v2.1/servers/d603f11b-5d49-492b-b541-1826486876ef/action" status: 202 len: 0 microversion: 2.1 time: 0.184892 Jan 15 20:51:50.753980 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 595/1136] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:51:50 2022] POST /compute/v2.1/servers/d603f11b-5d49-492b-b541-1826486876ef/action => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 20:51:50.760008 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c4c65003-d295-41af-a1af-b2a374b19a18 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:50.760720 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c4c65003-d295-41af-a1af-b2a374b19a18 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] [instance: 067b97a2-ee1a-4d43-926c-11a8bfa2e332] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:50.768527 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c4c65003-d295-41af-a1af-b2a374b19a18 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:50.769018 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c4c65003-d295-41af-a1af-b2a374b19a18 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:50.769801 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c4c65003-d295-41af-a1af-b2a374b19a18 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:50.770328 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c4c65003-d295-41af-a1af-b2a374b19a18 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:50.787153 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-6cec112b-e5a1-4ccc-9513-aabcf15678a4 tempest-ServersOnMultiNodesTest-1194618714 tempest-ServersOnMultiNodesTest-1194618714-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/231780ff-26d8-4f4a-b52b-eba09aa1a0e8" status: 200 len: 1616 microversion: 2.1 time: 0.149171 Jan 15 20:51:50.787727 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 542/1137] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:50 2022] GET /compute/v2.1/servers/231780ff-26d8-4f4a-b52b-eba09aa1a0e8 => generated 1616 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:50.792178 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-cd5138e0-356b-4046-b57c-c0d6cfa2a48d tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:50.792769 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-cd5138e0-356b-4046-b57c-c0d6cfa2a48d tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: d603f11b-5d49-492b-b541-1826486876ef] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:50.802195 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cd5138e0-356b-4046-b57c-c0d6cfa2a48d tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:50.802195 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cd5138e0-356b-4046-b57c-c0d6cfa2a48d tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:50.802195 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cd5138e0-356b-4046-b57c-c0d6cfa2a48d tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:50.802195 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cd5138e0-356b-4046-b57c-c0d6cfa2a48d tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:50.997762 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-c4c65003-d295-41af-a1af-b2a374b19a18 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55be87ae7f14b499ab2cd6fc5538988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd217e7fd648b4a78c0c32ff1c95f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:51.006650 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c4c65003-d295-41af-a1af-b2a374b19a18 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "GET /compute/v2.1/servers/067b97a2-ee1a-4d43-926c-11a8bfa2e332" status: 200 len: 1496 microversion: 2.1 time: 0.250696 Jan 15 20:51:51.018201 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 596/1138] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:50 2022] GET /compute/v2.1/servers/067b97a2-ee1a-4d43-926c-11a8bfa2e332 => generated 1496 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:51.024684 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-bc4376a3-8554-4d31-921f-ddc4a1593b6b tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-400347032", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "1e63485c-6290-4e1d-82cf-5ae73069dd2e"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:51:51.031758 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-cd5138e0-356b-4046-b57c-c0d6cfa2a48d tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:51.045288 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-cd5138e0-356b-4046-b57c-c0d6cfa2a48d tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/d603f11b-5d49-492b-b541-1826486876ef" status: 200 len: 1468 microversion: 2.1 time: 0.252259 Jan 15 20:51:51.053034 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 543/1139] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:50 2022] GET /compute/v2.1/servers/d603f11b-5d49-492b-b541-1826486876ef => generated 1468 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:51.093349 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.network.neutron [None req-bc4376a3-8554-4d31-921f-ddc4a1593b6b tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] validate_networks() for None {{(pid=129366) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 20:51:51.106091 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a45a1eaa-4fee-4779-ab80-e67ac5486fbf tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:51.106647 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a45a1eaa-4fee-4779-ab80-e67ac5486fbf tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] [instance: d45d5893-c22a-4b0c-ae7d-26e205a98643] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:51.112966 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a45a1eaa-4fee-4779-ab80-e67ac5486fbf tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:51.113419 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a45a1eaa-4fee-4779-ab80-e67ac5486fbf tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:51.114244 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a45a1eaa-4fee-4779-ab80-e67ac5486fbf tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:51.114675 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a45a1eaa-4fee-4779-ab80-e67ac5486fbf tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:51.340322 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-a45a1eaa-4fee-4779-ab80-e67ac5486fbf tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25473d022e7f438fa6495288f53caa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f471d81a59824fc8afaf454a65e99933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:51.348776 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a45a1eaa-4fee-4779-ab80-e67ac5486fbf tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] 10.222.0.46 "GET /compute/v2.1/servers/d45d5893-c22a-4b0c-ae7d-26e205a98643" status: 200 len: 1323 microversion: 2.1 time: 0.245977 Jan 15 20:51:51.350259 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 544/1140] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:51 2022] GET /compute/v2.1/servers/d45d5893-c22a-4b0c-ae7d-26e205a98643 => generated 1323 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:51.354730 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f002d80c-1ede-4e0f-bb5e-045d4bf39ec9 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:51.355327 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f002d80c-1ede-4e0f-bb5e-045d4bf39ec9 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] [instance: 42618a48-fe11-4f55-bed2-738d2cc8a07f] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:51.362419 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f002d80c-1ede-4e0f-bb5e-045d4bf39ec9 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:51.363062 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f002d80c-1ede-4e0f-bb5e-045d4bf39ec9 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:51.365700 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f002d80c-1ede-4e0f-bb5e-045d4bf39ec9 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:51.366323 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f002d80c-1ede-4e0f-bb5e-045d4bf39ec9 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:51.415588 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-bc4376a3-8554-4d31-921f-ddc4a1593b6b tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Flavor limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 20:51:51.416113 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-bc4376a3-8554-4d31-921f-ddc4a1593b6b tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Image limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 20:51:51.416683 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-bc4376a3-8554-4d31-921f-ddc4a1593b6b tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Flavor pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 20:51:51.417219 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-bc4376a3-8554-4d31-921f-ddc4a1593b6b tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Image pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 20:51:51.418072 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-bc4376a3-8554-4d31-921f-ddc4a1593b6b tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 20:51:51.427296 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bc4376a3-8554-4d31-921f-ddc4a1593b6b tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:51.427873 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bc4376a3-8554-4d31-921f-ddc4a1593b6b tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:51.428792 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bc4376a3-8554-4d31-921f-ddc4a1593b6b tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:51.429733 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bc4376a3-8554-4d31-921f-ddc4a1593b6b tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:51.447689 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-bc4376a3-8554-4d31-921f-ddc4a1593b6b tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Getting quotas for project e8cfe33be708428abef52f5e8e25621b. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:51:51.453659 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-bc4376a3-8554-4d31-921f-ddc4a1593b6b tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Getting quotas for user bc38f86758f9416b9e7f6915de0359d6 and project e8cfe33be708428abef52f5e8e25621b. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:51:51.468628 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-bc4376a3-8554-4d31-921f-ddc4a1593b6b tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Going to run 1 instances... {{(pid=129366) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 20:51:51.471140 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-bc4376a3-8554-4d31-921f-ddc4a1593b6b tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] [instance: 2a53ed48-4f31-4c7d-9b10-39a8648314d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 20:51:51.517390 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-bc4376a3-8554-4d31-921f-ddc4a1593b6b tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.497239 Jan 15 20:51:51.518238 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 597/1141] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 20:51:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 499 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 20:51:51.523196 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a7e8c312-111d-42ab-bea0-5c1ef3a79f4d tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:51:51.524173 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a7e8c312-111d-42ab-bea0-5c1ef3a79f4d tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 57bd310f-a604-40de-9c25-882284f4a17b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:51.531877 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-f002d80c-1ede-4e0f-bb5e-045d4bf39ec9 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:51.537371 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a7e8c312-111d-42ab-bea0-5c1ef3a79f4d tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:51.537822 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a7e8c312-111d-42ab-bea0-5c1ef3a79f4d tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:51.538610 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a7e8c312-111d-42ab-bea0-5c1ef3a79f4d tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:51.539039 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a7e8c312-111d-42ab-bea0-5c1ef3a79f4d tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:51.542897 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-f002d80c-1ede-4e0f-bb5e-045d4bf39ec9 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:51.545554 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-f002d80c-1ede-4e0f-bb5e-045d4bf39ec9 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:51.560622 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f002d80c-1ede-4e0f-bb5e-045d4bf39ec9 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] 10.222.0.46 "GET /compute/v2.1/servers/42618a48-fe11-4f55-bed2-738d2cc8a07f" status: 200 len: 1645 microversion: 2.25 time: 0.209566 Jan 15 20:51:51.561288 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 545/1142] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:51:51 2022] GET /compute/v2.1/servers/42618a48-fe11-4f55-bed2-738d2cc8a07f => generated 1645 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:51:51.572672 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2f43e4b6-6c88-40d4-a6ba-b20e313fcb63 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:51.572672 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-2f43e4b6-6c88-40d4-a6ba-b20e313fcb63 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] [instance: 2a53ed48-4f31-4c7d-9b10-39a8648314d2] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:51.601524 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a7e8c312-111d-42ab-bea0-5c1ef3a79f4d tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/action" status: 200 len: 16369 microversion: 2.1 time: 0.081990 Jan 15 20:51:51.605333 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 598/1143] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:51:51 2022] POST /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/action => generated 16369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:51:51.608822 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-3b4651e1-d59d-4675-96cb-f4fe681b89ed tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:51.609579 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-3b4651e1-d59d-4675-96cb-f4fe681b89ed tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] [instance: 1d163f47-49a0-41c9-991b-f42d16af67d1] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:51.618352 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3b4651e1-d59d-4675-96cb-f4fe681b89ed tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:51.618908 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3b4651e1-d59d-4675-96cb-f4fe681b89ed tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:51.619630 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3b4651e1-d59d-4675-96cb-f4fe681b89ed tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:51.620059 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3b4651e1-d59d-4675-96cb-f4fe681b89ed tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:51.632142 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-2f43e4b6-6c88-40d4-a6ba-b20e313fcb63 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc38f86758f9416b9e7f6915de0359d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8cfe33be708428abef52f5e8e25621b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:51.639721 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2f43e4b6-6c88-40d4-a6ba-b20e313fcb63 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] 10.222.0.46 "GET /compute/v2.1/servers/2a53ed48-4f31-4c7d-9b10-39a8648314d2" status: 200 len: 1216 microversion: 2.1 time: 0.077420 Jan 15 20:51:51.640558 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 546/1144] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:51 2022] GET /compute/v2.1/servers/2a53ed48-4f31-4c7d-9b10-39a8648314d2 => generated 1216 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:51.654719 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a2ce347c-655f-4a61-9fc7-f9b70667e28f tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:51.655321 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a2ce347c-655f-4a61-9fc7-f9b70667e28f tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] [instance: b191ed6c-040a-4702-8e15-86272f9d1847] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:51.662208 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a2ce347c-655f-4a61-9fc7-f9b70667e28f tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:51.662664 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a2ce347c-655f-4a61-9fc7-f9b70667e28f tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:51.663452 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a2ce347c-655f-4a61-9fc7-f9b70667e28f tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:51.663956 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a2ce347c-655f-4a61-9fc7-f9b70667e28f tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:51.855474 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-3b4651e1-d59d-4675-96cb-f4fe681b89ed tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3352815cdc914c15b656b4d0d9511010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7b489c290846f48384c65e977ed644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:51.862626 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-3b4651e1-d59d-4675-96cb-f4fe681b89ed tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] 10.222.0.46 "GET /compute/v2.1/servers/1d163f47-49a0-41c9-991b-f42d16af67d1" status: 200 len: 1316 microversion: 2.1 time: 0.259325 Jan 15 20:51:51.863192 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 599/1145] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:51 2022] GET /compute/v2.1/servers/1d163f47-49a0-41c9-991b-f42d16af67d1 => generated 1316 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:51.863741 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-a2ce347c-655f-4a61-9fc7-f9b70667e28f tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d4a57cfaa145009ba9cc8f21d9e8ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4a26c8edac44c8b26fd4e43813412d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:51.872387 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a2ce347c-655f-4a61-9fc7-f9b70667e28f tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] 10.222.0.46 "GET /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847" status: 200 len: 1472 microversion: 2.1 time: 0.221920 Jan 15 20:51:51.873196 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 547/1146] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:51 2022] GET /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847 => generated 1472 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:51:52.025227 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-2a24c011-e59a-43a8-b690-db13cac34a6c tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:52.025769 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-2a24c011-e59a-43a8-b690-db13cac34a6c tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] [instance: 067b97a2-ee1a-4d43-926c-11a8bfa2e332] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:52.031951 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2a24c011-e59a-43a8-b690-db13cac34a6c tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:52.032577 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2a24c011-e59a-43a8-b690-db13cac34a6c tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:52.033388 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2a24c011-e59a-43a8-b690-db13cac34a6c tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:52.033824 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2a24c011-e59a-43a8-b690-db13cac34a6c tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:52.062128 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ac231af6-b36a-4203-adea-41db909e737b tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:52.063206 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ac231af6-b36a-4203-adea-41db909e737b tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: d603f11b-5d49-492b-b541-1826486876ef] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:52.071292 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ac231af6-b36a-4203-adea-41db909e737b tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:52.072026 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ac231af6-b36a-4203-adea-41db909e737b tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:52.073082 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ac231af6-b36a-4203-adea-41db909e737b tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:52.073826 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ac231af6-b36a-4203-adea-41db909e737b tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:52.448318 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-2a24c011-e59a-43a8-b690-db13cac34a6c tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55be87ae7f14b499ab2cd6fc5538988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd217e7fd648b4a78c0c32ff1c95f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:52.455892 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-2a24c011-e59a-43a8-b690-db13cac34a6c tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "GET /compute/v2.1/servers/067b97a2-ee1a-4d43-926c-11a8bfa2e332" status: 200 len: 1496 microversion: 2.1 time: 0.435337 Jan 15 20:51:52.460177 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 600/1147] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:52 2022] GET /compute/v2.1/servers/067b97a2-ee1a-4d43-926c-11a8bfa2e332 => generated 1496 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:52.461578 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-18a428e2-7946-47c5-85fe-6db7d0c77160 req-2a8798da-c3a9-4097-9336-32c6b2e14f99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d45d5893-c22a-4b0c-ae7d-26e205a98643", "name": "network-vif-plugged", "status": "completed", "tag": "1ca16880-699b-4753-b30c-773b6af5f27f"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:51:52.463222 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:51:52.463222 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:51:52.471002 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-18a428e2-7946-47c5-85fe-6db7d0c77160 req-2a8798da-c3a9-4097-9336-32c6b2e14f99 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:52.471444 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-18a428e2-7946-47c5-85fe-6db7d0c77160 req-2a8798da-c3a9-4097-9336-32c6b2e14f99 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:52.482401 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-18a428e2-7946-47c5-85fe-6db7d0c77160 req-2a8798da-c3a9-4097-9336-32c6b2e14f99 service nova] Creating event network-vif-plugged:1ca16880-699b-4753-b30c-773b6af5f27f for instance d45d5893-c22a-4b0c-ae7d-26e205a98643 on nch2-master-1 Jan 15 20:51:52.487151 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-18a428e2-7946-47c5-85fe-6db7d0c77160 req-2a8798da-c3a9-4097-9336-32c6b2e14f99 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029580 Jan 15 20:51:52.487747 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 601/1148] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:51:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:51:52.492630 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-ac231af6-b36a-4203-adea-41db909e737b tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:52.493511 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7f1944e1-09cb-4411-915c-acc8b4c19e59 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:52.494189 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-7f1944e1-09cb-4411-915c-acc8b4c19e59 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] [instance: d45d5893-c22a-4b0c-ae7d-26e205a98643] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:52.500083 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7f1944e1-09cb-4411-915c-acc8b4c19e59 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:52.500526 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7f1944e1-09cb-4411-915c-acc8b4c19e59 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:52.501525 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7f1944e1-09cb-4411-915c-acc8b4c19e59 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:52.501954 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7f1944e1-09cb-4411-915c-acc8b4c19e59 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:52.510465 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ac231af6-b36a-4203-adea-41db909e737b tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/d603f11b-5d49-492b-b541-1826486876ef" status: 200 len: 1468 microversion: 2.1 time: 0.451994 Jan 15 20:51:52.511074 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 548/1149] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:52 2022] GET /compute/v2.1/servers/d603f11b-5d49-492b-b541-1826486876ef => generated 1468 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:51:52.579622 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-92de04cf-b437-455a-89f4-4257ab978403 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:52.580418 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-92de04cf-b437-455a-89f4-4257ab978403 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] [instance: 42618a48-fe11-4f55-bed2-738d2cc8a07f] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:52.587984 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-92de04cf-b437-455a-89f4-4257ab978403 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:52.588551 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-92de04cf-b437-455a-89f4-4257ab978403 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:52.589483 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-92de04cf-b437-455a-89f4-4257ab978403 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:52.590050 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-92de04cf-b437-455a-89f4-4257ab978403 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:52.646419 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-7f1944e1-09cb-4411-915c-acc8b4c19e59 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25473d022e7f438fa6495288f53caa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f471d81a59824fc8afaf454a65e99933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:52.655671 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7f1944e1-09cb-4411-915c-acc8b4c19e59 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] 10.222.0.46 "GET /compute/v2.1/servers/d45d5893-c22a-4b0c-ae7d-26e205a98643" status: 200 len: 1323 microversion: 2.1 time: 0.166667 Jan 15 20:51:52.656560 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 602/1150] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:52 2022] GET /compute/v2.1/servers/d45d5893-c22a-4b0c-ae7d-26e205a98643 => generated 1323 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:52.662602 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a848ecdc-d0ef-4127-b52e-c4dc49bbcdbc tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:51:52.664202 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a848ecdc-d0ef-4127-b52e-c4dc49bbcdbc tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 57bd310f-a604-40de-9c25-882284f4a17b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:52.670571 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a848ecdc-d0ef-4127-b52e-c4dc49bbcdbc tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:52.671179 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a848ecdc-d0ef-4127-b52e-c4dc49bbcdbc tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:52.671969 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a848ecdc-d0ef-4127-b52e-c4dc49bbcdbc tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:52.672398 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a848ecdc-d0ef-4127-b52e-c4dc49bbcdbc tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:52.717417 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a848ecdc-d0ef-4127-b52e-c4dc49bbcdbc tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/action" status: 200 len: 16369 microversion: 2.1 time: 0.059381 Jan 15 20:51:52.718061 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 603/1151] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:51:52 2022] POST /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/action => generated 16369 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:51:52.722871 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-daf0b11a-665e-4fae-ac8a-9d49b01fb479 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:52.724313 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-daf0b11a-665e-4fae-ac8a-9d49b01fb479 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] [instance: 2a53ed48-4f31-4c7d-9b10-39a8648314d2] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:52.731100 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-daf0b11a-665e-4fae-ac8a-9d49b01fb479 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:52.731541 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-daf0b11a-665e-4fae-ac8a-9d49b01fb479 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:52.732322 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-daf0b11a-665e-4fae-ac8a-9d49b01fb479 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:52.732749 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-daf0b11a-665e-4fae-ac8a-9d49b01fb479 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:52.737864 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-92de04cf-b437-455a-89f4-4257ab978403 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:52.747103 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-92de04cf-b437-455a-89f4-4257ab978403 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:52.748696 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-92de04cf-b437-455a-89f4-4257ab978403 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:52.749953 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-92de04cf-b437-455a-89f4-4257ab978403 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] 10.222.0.46 "GET /compute/v2.1/servers/42618a48-fe11-4f55-bed2-738d2cc8a07f" status: 200 len: 1645 microversion: 2.25 time: 0.174093 Jan 15 20:51:52.750592 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 549/1152] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:51:52 2022] GET /compute/v2.1/servers/42618a48-fe11-4f55-bed2-738d2cc8a07f => generated 1645 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 15 20:51:52.793629 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-daf0b11a-665e-4fae-ac8a-9d49b01fb479 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc38f86758f9416b9e7f6915de0359d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8cfe33be708428abef52f5e8e25621b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:52.803493 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-daf0b11a-665e-4fae-ac8a-9d49b01fb479 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] 10.222.0.46 "GET /compute/v2.1/servers/2a53ed48-4f31-4c7d-9b10-39a8648314d2" status: 200 len: 1268 microversion: 2.1 time: 0.082430 Jan 15 20:51:52.804100 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 604/1153] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:52 2022] GET /compute/v2.1/servers/2a53ed48-4f31-4c7d-9b10-39a8648314d2 => generated 1268 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:52.879316 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-26538053-c18a-4cb9-ae04-bc47d7ea2871 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:52.879956 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-26538053-c18a-4cb9-ae04-bc47d7ea2871 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] [instance: 1d163f47-49a0-41c9-991b-f42d16af67d1] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:52.886988 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-26538053-c18a-4cb9-ae04-bc47d7ea2871 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:52.887584 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-26538053-c18a-4cb9-ae04-bc47d7ea2871 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:52.888787 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-26538053-c18a-4cb9-ae04-bc47d7ea2871 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:52.889245 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-26538053-c18a-4cb9-ae04-bc47d7ea2871 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:52.890643 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-696f4985-2332-4837-8b49-2bcd1eab1dc3 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:52.891243 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-696f4985-2332-4837-8b49-2bcd1eab1dc3 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] [instance: b191ed6c-040a-4702-8e15-86272f9d1847] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:52.898447 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-696f4985-2332-4837-8b49-2bcd1eab1dc3 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:52.898826 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-696f4985-2332-4837-8b49-2bcd1eab1dc3 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:52.899607 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-696f4985-2332-4837-8b49-2bcd1eab1dc3 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:52.900034 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-696f4985-2332-4837-8b49-2bcd1eab1dc3 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:53.092581 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-26538053-c18a-4cb9-ae04-bc47d7ea2871 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3352815cdc914c15b656b4d0d9511010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7b489c290846f48384c65e977ed644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:53.098052 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-696f4985-2332-4837-8b49-2bcd1eab1dc3 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d4a57cfaa145009ba9cc8f21d9e8ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4a26c8edac44c8b26fd4e43813412d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:53.103608 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-26538053-c18a-4cb9-ae04-bc47d7ea2871 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] 10.222.0.46 "GET /compute/v2.1/servers/1d163f47-49a0-41c9-991b-f42d16af67d1" status: 200 len: 1316 microversion: 2.1 time: 0.227523 Jan 15 20:51:53.104258 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 550/1154] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:52 2022] GET /compute/v2.1/servers/1d163f47-49a0-41c9-991b-f42d16af67d1 => generated 1316 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:53.109321 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-696f4985-2332-4837-8b49-2bcd1eab1dc3 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] 10.222.0.46 "GET /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847" status: 200 len: 1472 microversion: 2.1 time: 0.222164 Jan 15 20:51:53.109899 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 605/1155] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:52 2022] GET /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847 => generated 1472 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:51:53.473836 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-839cfbb4-1388-4e0a-8a3f-c8242b46cc94 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:53.474488 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-839cfbb4-1388-4e0a-8a3f-c8242b46cc94 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] [instance: 067b97a2-ee1a-4d43-926c-11a8bfa2e332] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:53.480898 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-839cfbb4-1388-4e0a-8a3f-c8242b46cc94 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:53.481361 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-839cfbb4-1388-4e0a-8a3f-c8242b46cc94 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:53.482157 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-839cfbb4-1388-4e0a-8a3f-c8242b46cc94 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:53.482634 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-839cfbb4-1388-4e0a-8a3f-c8242b46cc94 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:53.527497 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9279ae47-11d1-41aa-be41-aeacb9f1ebac tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:53.528101 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-9279ae47-11d1-41aa-be41-aeacb9f1ebac tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: d603f11b-5d49-492b-b541-1826486876ef] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:53.534440 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9279ae47-11d1-41aa-be41-aeacb9f1ebac tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:53.534890 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9279ae47-11d1-41aa-be41-aeacb9f1ebac tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:53.536204 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9279ae47-11d1-41aa-be41-aeacb9f1ebac tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:53.537059 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9279ae47-11d1-41aa-be41-aeacb9f1ebac tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:53.659332 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-839cfbb4-1388-4e0a-8a3f-c8242b46cc94 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55be87ae7f14b499ab2cd6fc5538988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd217e7fd648b4a78c0c32ff1c95f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:53.670946 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-839cfbb4-1388-4e0a-8a3f-c8242b46cc94 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "GET /compute/v2.1/servers/067b97a2-ee1a-4d43-926c-11a8bfa2e332" status: 200 len: 1496 microversion: 2.1 time: 0.201423 Jan 15 20:51:53.671736 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 551/1156] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:53 2022] GET /compute/v2.1/servers/067b97a2-ee1a-4d43-926c-11a8bfa2e332 => generated 1496 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:53.687167 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9b31ebb8-f937-4dd0-ae32-a353020ab6eb tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:53.687774 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-9b31ebb8-f937-4dd0-ae32-a353020ab6eb tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] [instance: d45d5893-c22a-4b0c-ae7d-26e205a98643] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:53.695221 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9b31ebb8-f937-4dd0-ae32-a353020ab6eb tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:53.695757 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9b31ebb8-f937-4dd0-ae32-a353020ab6eb tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:53.697344 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9b31ebb8-f937-4dd0-ae32-a353020ab6eb tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:53.698010 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9b31ebb8-f937-4dd0-ae32-a353020ab6eb tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:53.706906 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-9279ae47-11d1-41aa-be41-aeacb9f1ebac tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:53.715389 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-9279ae47-11d1-41aa-be41-aeacb9f1ebac tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/d603f11b-5d49-492b-b541-1826486876ef" status: 200 len: 1468 microversion: 2.1 time: 0.191529 Jan 15 20:51:53.716260 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 606/1157] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:53 2022] GET /compute/v2.1/servers/d603f11b-5d49-492b-b541-1826486876ef => generated 1468 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:51:53.729461 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b26c6726-a483-42b9-b217-6497ff57f57d tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:51:53.730554 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b26c6726-a483-42b9-b217-6497ff57f57d tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 57bd310f-a604-40de-9c25-882284f4a17b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:53.736732 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b26c6726-a483-42b9-b217-6497ff57f57d tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:53.737293 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b26c6726-a483-42b9-b217-6497ff57f57d tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:53.738209 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b26c6726-a483-42b9-b217-6497ff57f57d tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:53.739285 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b26c6726-a483-42b9-b217-6497ff57f57d tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:53.787009 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b26c6726-a483-42b9-b217-6497ff57f57d tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/action" status: 200 len: 16369 microversion: 2.1 time: 0.061429 Jan 15 20:51:53.788085 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 607/1158] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:51:53 2022] POST /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/action => generated 16369 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:51:53.795092 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-63ea31a8-7800-4b8a-a547-7a5c94a8ba79 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:53.796081 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-63ea31a8-7800-4b8a-a547-7a5c94a8ba79 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] [instance: 42618a48-fe11-4f55-bed2-738d2cc8a07f] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:53.805728 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-63ea31a8-7800-4b8a-a547-7a5c94a8ba79 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:53.806475 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-63ea31a8-7800-4b8a-a547-7a5c94a8ba79 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:53.807517 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-63ea31a8-7800-4b8a-a547-7a5c94a8ba79 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:53.808427 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-63ea31a8-7800-4b8a-a547-7a5c94a8ba79 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:53.864235 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-9b31ebb8-f937-4dd0-ae32-a353020ab6eb tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25473d022e7f438fa6495288f53caa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f471d81a59824fc8afaf454a65e99933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:53.876243 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-9b31ebb8-f937-4dd0-ae32-a353020ab6eb tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] 10.222.0.46 "GET /compute/v2.1/servers/d45d5893-c22a-4b0c-ae7d-26e205a98643" status: 200 len: 1323 microversion: 2.1 time: 0.193583 Jan 15 20:51:53.876859 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 552/1159] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:53 2022] GET /compute/v2.1/servers/d45d5893-c22a-4b0c-ae7d-26e205a98643 => generated 1323 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:53.884715 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3bbce4a0-e34f-4559-bc9c-bf863229a941 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:53.885717 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-3bbce4a0-e34f-4559-bc9c-bf863229a941 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] [instance: 2a53ed48-4f31-4c7d-9b10-39a8648314d2] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:53.901553 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3bbce4a0-e34f-4559-bc9c-bf863229a941 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:53.903329 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3bbce4a0-e34f-4559-bc9c-bf863229a941 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:53.904355 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3bbce4a0-e34f-4559-bc9c-bf863229a941 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:53.908648 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3bbce4a0-e34f-4559-bc9c-bf863229a941 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:54.064054 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-63ea31a8-7800-4b8a-a547-7a5c94a8ba79 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:54.077652 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-63ea31a8-7800-4b8a-a547-7a5c94a8ba79 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:54.082681 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-63ea31a8-7800-4b8a-a547-7a5c94a8ba79 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:54.083670 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-63ea31a8-7800-4b8a-a547-7a5c94a8ba79 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] 10.222.0.46 "GET /compute/v2.1/servers/42618a48-fe11-4f55-bed2-738d2cc8a07f" status: 200 len: 1645 microversion: 2.25 time: 0.294306 Jan 15 20:51:54.084449 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 608/1160] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:51:53 2022] GET /compute/v2.1/servers/42618a48-fe11-4f55-bed2-738d2cc8a07f => generated 1645 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:51:54.119603 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-18e9f3ca-a884-416a-a5c2-8b4a873d703e tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:54.120134 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-18e9f3ca-a884-416a-a5c2-8b4a873d703e tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] [instance: 1d163f47-49a0-41c9-991b-f42d16af67d1] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:54.130823 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-18e9f3ca-a884-416a-a5c2-8b4a873d703e tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:54.136767 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-18e9f3ca-a884-416a-a5c2-8b4a873d703e tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:54.137663 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-18e9f3ca-a884-416a-a5c2-8b4a873d703e tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:54.138118 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-18e9f3ca-a884-416a-a5c2-8b4a873d703e tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:54.153435 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-3bbce4a0-e34f-4559-bc9c-bf863229a941 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc38f86758f9416b9e7f6915de0359d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8cfe33be708428abef52f5e8e25621b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:54.163120 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3bbce4a0-e34f-4559-bc9c-bf863229a941 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] 10.222.0.46 "GET /compute/v2.1/servers/2a53ed48-4f31-4c7d-9b10-39a8648314d2" status: 200 len: 1316 microversion: 2.1 time: 0.283592 Jan 15 20:51:54.164354 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 553/1161] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:53 2022] GET /compute/v2.1/servers/2a53ed48-4f31-4c7d-9b10-39a8648314d2 => generated 1316 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:54.169367 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b21bbf9c-5159-4cf2-abc7-a18753685bc8 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:54.170166 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b21bbf9c-5159-4cf2-abc7-a18753685bc8 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] [instance: b191ed6c-040a-4702-8e15-86272f9d1847] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:54.177358 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b21bbf9c-5159-4cf2-abc7-a18753685bc8 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:54.178079 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b21bbf9c-5159-4cf2-abc7-a18753685bc8 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:54.179028 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b21bbf9c-5159-4cf2-abc7-a18753685bc8 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:54.179464 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b21bbf9c-5159-4cf2-abc7-a18753685bc8 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:54.437875 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-18e9f3ca-a884-416a-a5c2-8b4a873d703e tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3352815cdc914c15b656b4d0d9511010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7b489c290846f48384c65e977ed644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:54.456128 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-b21bbf9c-5159-4cf2-abc7-a18753685bc8 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d4a57cfaa145009ba9cc8f21d9e8ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4a26c8edac44c8b26fd4e43813412d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:54.457095 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-18e9f3ca-a884-416a-a5c2-8b4a873d703e tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] 10.222.0.46 "GET /compute/v2.1/servers/1d163f47-49a0-41c9-991b-f42d16af67d1" status: 200 len: 1316 microversion: 2.1 time: 0.338912 Jan 15 20:51:54.458715 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 609/1162] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:54 2022] GET /compute/v2.1/servers/1d163f47-49a0-41c9-991b-f42d16af67d1 => generated 1316 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:54.476363 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b21bbf9c-5159-4cf2-abc7-a18753685bc8 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] 10.222.0.46 "GET /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847" status: 200 len: 1472 microversion: 2.1 time: 0.310361 Jan 15 20:51:54.486199 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 554/1163] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:54 2022] GET /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847 => generated 1472 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:54.589167 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-aa62d716-9574-44b5-a1bf-37d53dd921ce req-4c84db07-1c82-499f-b69e-a75624e09ed5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d603f11b-5d49-492b-b541-1826486876ef", "name": "network-vif-plugged", "status": "completed", "tag": "29144689-f6e8-49ab-886d-3bedd21d555f"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:51:54.591218 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:51:54.591218 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:51:54.600455 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-aa62d716-9574-44b5-a1bf-37d53dd921ce req-4c84db07-1c82-499f-b69e-a75624e09ed5 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:54.601093 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-aa62d716-9574-44b5-a1bf-37d53dd921ce req-4c84db07-1c82-499f-b69e-a75624e09ed5 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:54.621671 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-aa62d716-9574-44b5-a1bf-37d53dd921ce req-4c84db07-1c82-499f-b69e-a75624e09ed5 service nova] Creating event network-vif-plugged:29144689-f6e8-49ab-886d-3bedd21d555f for instance d603f11b-5d49-492b-b541-1826486876ef on nch2-master-1 Jan 15 20:51:54.645400 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [req-aa62d716-9574-44b5-a1bf-37d53dd921ce req-4c84db07-1c82-499f-b69e-a75624e09ed5 service nova] Instance d603f11b-5d49-492b-b541-1826486876ef is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=129366) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Jan 15 20:51:54.665197 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-aa62d716-9574-44b5-a1bf-37d53dd921ce req-4c84db07-1c82-499f-b69e-a75624e09ed5 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079697 Jan 15 20:51:54.666174 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 610/1164] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:51:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:51:54.690958 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2befa1c4-1522-46ac-b4e5-24ecd498eef3 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:54.692365 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-2befa1c4-1522-46ac-b4e5-24ecd498eef3 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] [instance: 067b97a2-ee1a-4d43-926c-11a8bfa2e332] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:54.701223 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2befa1c4-1522-46ac-b4e5-24ecd498eef3 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:54.702138 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2befa1c4-1522-46ac-b4e5-24ecd498eef3 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:54.703160 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2befa1c4-1522-46ac-b4e5-24ecd498eef3 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:54.703873 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2befa1c4-1522-46ac-b4e5-24ecd498eef3 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:54.738451 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-962fb078-bcd5-4224-b7ca-6f74a571bb2d tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:54.739362 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-962fb078-bcd5-4224-b7ca-6f74a571bb2d tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: d603f11b-5d49-492b-b541-1826486876ef] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:54.749891 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-962fb078-bcd5-4224-b7ca-6f74a571bb2d tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:54.755838 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-962fb078-bcd5-4224-b7ca-6f74a571bb2d tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:54.761397 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-962fb078-bcd5-4224-b7ca-6f74a571bb2d tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:54.761972 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-962fb078-bcd5-4224-b7ca-6f74a571bb2d tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:55.021543 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-2befa1c4-1522-46ac-b4e5-24ecd498eef3 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55be87ae7f14b499ab2cd6fc5538988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd217e7fd648b4a78c0c32ff1c95f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:55.041592 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-962fb078-bcd5-4224-b7ca-6f74a571bb2d tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:55.046512 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2befa1c4-1522-46ac-b4e5-24ecd498eef3 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "GET /compute/v2.1/servers/067b97a2-ee1a-4d43-926c-11a8bfa2e332" status: 200 len: 1496 microversion: 2.1 time: 0.359587 Jan 15 20:51:55.049885 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-962fb078-bcd5-4224-b7ca-6f74a571bb2d tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/d603f11b-5d49-492b-b541-1826486876ef" status: 200 len: 1468 microversion: 2.1 time: 0.316706 Jan 15 20:51:55.053016 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 555/1165] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:54 2022] GET /compute/v2.1/servers/067b97a2-ee1a-4d43-926c-11a8bfa2e332 => generated 1496 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:55.061059 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-bfda5cc9-d7b0-4fae-a658-79f307b18e2f req-ece1b764-41b7-4565-a204-d2d61996f420 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a53ed48-4f31-4c7d-9b10-39a8648314d2", "tag": "be26730f-1c78-49d2-b708-69a94845942e"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:51:55.063084 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:51:55.063084 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:51:55.063943 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 611/1166] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:54 2022] GET /compute/v2.1/servers/d603f11b-5d49-492b-b541-1826486876ef => generated 1468 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:51:55.072075 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-bfda5cc9-d7b0-4fae-a658-79f307b18e2f req-ece1b764-41b7-4565-a204-d2d61996f420 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:55.072734 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ca61fd45-bd1e-4b7f-b06e-410cb428b619 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:51:55.073166 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-bfda5cc9-d7b0-4fae-a658-79f307b18e2f req-ece1b764-41b7-4565-a204-d2d61996f420 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:55.074061 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ca61fd45-bd1e-4b7f-b06e-410cb428b619 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 57bd310f-a604-40de-9c25-882284f4a17b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:55.086423 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-bfda5cc9-d7b0-4fae-a658-79f307b18e2f req-ece1b764-41b7-4565-a204-d2d61996f420 service nova] Creating event network-changed:be26730f-1c78-49d2-b708-69a94845942e for instance 2a53ed48-4f31-4c7d-9b10-39a8648314d2 on nch2-master-1 Jan 15 20:51:55.087840 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ca61fd45-bd1e-4b7f-b06e-410cb428b619 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:55.091392 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ca61fd45-bd1e-4b7f-b06e-410cb428b619 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:55.092009 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ca61fd45-bd1e-4b7f-b06e-410cb428b619 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:55.092459 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ca61fd45-bd1e-4b7f-b06e-410cb428b619 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:55.094151 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-bfda5cc9-d7b0-4fae-a658-79f307b18e2f req-ece1b764-41b7-4565-a204-d2d61996f420 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039458 Jan 15 20:51:55.095090 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 556/1167] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:51:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:51:55.103611 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2b17a034-2749-46e8-b76a-09c435b50c69 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:55.105017 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-2b17a034-2749-46e8-b76a-09c435b50c69 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] [instance: d45d5893-c22a-4b0c-ae7d-26e205a98643] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:55.113053 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2b17a034-2749-46e8-b76a-09c435b50c69 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:55.114297 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2b17a034-2749-46e8-b76a-09c435b50c69 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:55.115416 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2b17a034-2749-46e8-b76a-09c435b50c69 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:55.116099 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2b17a034-2749-46e8-b76a-09c435b50c69 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:55.171002 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ca61fd45-bd1e-4b7f-b06e-410cb428b619 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/action" status: 200 len: 16369 microversion: 2.1 time: 0.105651 Jan 15 20:51:55.183799 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 612/1168] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:51:55 2022] POST /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/action => generated 16369 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:51:55.193207 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-436e80b9-2fea-4278-9529-2f0bae1a32ea tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:55.194478 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-436e80b9-2fea-4278-9529-2f0bae1a32ea tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] [instance: 42618a48-fe11-4f55-bed2-738d2cc8a07f] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:55.204199 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-436e80b9-2fea-4278-9529-2f0bae1a32ea tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:55.206379 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-436e80b9-2fea-4278-9529-2f0bae1a32ea tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:55.209663 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-436e80b9-2fea-4278-9529-2f0bae1a32ea tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:55.212209 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-436e80b9-2fea-4278-9529-2f0bae1a32ea tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:55.322497 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-2b17a034-2749-46e8-b76a-09c435b50c69 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25473d022e7f438fa6495288f53caa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f471d81a59824fc8afaf454a65e99933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:55.332025 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2b17a034-2749-46e8-b76a-09c435b50c69 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] 10.222.0.46 "GET /compute/v2.1/servers/d45d5893-c22a-4b0c-ae7d-26e205a98643" status: 200 len: 1518 microversion: 2.1 time: 0.235570 Jan 15 20:51:55.337777 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 557/1169] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:55 2022] GET /compute/v2.1/servers/d45d5893-c22a-4b0c-ae7d-26e205a98643 => generated 1518 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:55.351536 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-842aa0e4-be1f-4757-838e-eeb0ec467d65 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:55.352150 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-842aa0e4-be1f-4757-838e-eeb0ec467d65 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] [instance: 2a53ed48-4f31-4c7d-9b10-39a8648314d2] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:55.365390 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-842aa0e4-be1f-4757-838e-eeb0ec467d65 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:55.365898 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-842aa0e4-be1f-4757-838e-eeb0ec467d65 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:55.370514 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-842aa0e4-be1f-4757-838e-eeb0ec467d65 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:55.376892 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-842aa0e4-be1f-4757-838e-eeb0ec467d65 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:55.463590 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-436e80b9-2fea-4278-9529-2f0bae1a32ea tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:55.476494 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-436e80b9-2fea-4278-9529-2f0bae1a32ea tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:55.477742 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-436e80b9-2fea-4278-9529-2f0bae1a32ea tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:55.479608 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-436e80b9-2fea-4278-9529-2f0bae1a32ea tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] 10.222.0.46 "GET /compute/v2.1/servers/42618a48-fe11-4f55-bed2-738d2cc8a07f" status: 200 len: 1645 microversion: 2.25 time: 0.293354 Jan 15 20:51:55.480200 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 613/1170] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:51:55 2022] GET /compute/v2.1/servers/42618a48-fe11-4f55-bed2-738d2cc8a07f => generated 1645 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:51:55.493327 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b4ad0539-3e36-42ac-812f-dda27d8b4f70 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.1.179"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:51:55.494413 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b4ad0539-3e36-42ac-812f-dda27d8b4f70 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] [instance: b18c4fdc-6965-4c52-85f5-824ba94b4ad8] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:55.503415 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b4ad0539-3e36-42ac-812f-dda27d8b4f70 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:55.504043 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b4ad0539-3e36-42ac-812f-dda27d8b4f70 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:55.505525 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b4ad0539-3e36-42ac-812f-dda27d8b4f70 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:55.505964 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b4ad0539-3e36-42ac-812f-dda27d8b4f70 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:55.543022 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b4ad0539-3e36-42ac-812f-dda27d8b4f70 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Acquired lock "refresh_cache-b18c4fdc-6965-4c52-85f5-824ba94b4ad8" {{(pid=129366) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jan 15 20:51:55.608767 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-842aa0e4-be1f-4757-838e-eeb0ec467d65 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc38f86758f9416b9e7f6915de0359d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8cfe33be708428abef52f5e8e25621b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:55.619062 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-842aa0e4-be1f-4757-838e-eeb0ec467d65 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] 10.222.0.46 "GET /compute/v2.1/servers/2a53ed48-4f31-4c7d-9b10-39a8648314d2" status: 200 len: 1316 microversion: 2.1 time: 0.279902 Jan 15 20:51:55.619657 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 558/1171] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:55 2022] GET /compute/v2.1/servers/2a53ed48-4f31-4c7d-9b10-39a8648314d2 => generated 1316 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:55.625170 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3d190e9b-a7be-4871-815e-5897691dcd71 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:55.625952 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-3d190e9b-a7be-4871-815e-5897691dcd71 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] [instance: 1d163f47-49a0-41c9-991b-f42d16af67d1] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:55.632807 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3d190e9b-a7be-4871-815e-5897691dcd71 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:55.633755 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3d190e9b-a7be-4871-815e-5897691dcd71 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:55.634788 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3d190e9b-a7be-4871-815e-5897691dcd71 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:55.635441 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3d190e9b-a7be-4871-815e-5897691dcd71 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:55.927228 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-3d190e9b-a7be-4871-815e-5897691dcd71 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3352815cdc914c15b656b4d0d9511010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7b489c290846f48384c65e977ed644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:55.935579 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3d190e9b-a7be-4871-815e-5897691dcd71 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] 10.222.0.46 "GET /compute/v2.1/servers/1d163f47-49a0-41c9-991b-f42d16af67d1" status: 200 len: 1316 microversion: 2.1 time: 0.314690 Jan 15 20:51:55.936568 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 559/1172] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:55 2022] GET /compute/v2.1/servers/1d163f47-49a0-41c9-991b-f42d16af67d1 => generated 1316 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:55.950062 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b57b9b50-61ef-4503-81d1-96333d9f20b2 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:55.952567 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b57b9b50-61ef-4503-81d1-96333d9f20b2 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] [instance: b191ed6c-040a-4702-8e15-86272f9d1847] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:55.963003 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b57b9b50-61ef-4503-81d1-96333d9f20b2 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:55.964253 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b57b9b50-61ef-4503-81d1-96333d9f20b2 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:55.965313 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b57b9b50-61ef-4503-81d1-96333d9f20b2 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:55.965768 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b57b9b50-61ef-4503-81d1-96333d9f20b2 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:56.259066 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-b57b9b50-61ef-4503-81d1-96333d9f20b2 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d4a57cfaa145009ba9cc8f21d9e8ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4a26c8edac44c8b26fd4e43813412d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:56.284201 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b57b9b50-61ef-4503-81d1-96333d9f20b2 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] 10.222.0.46 "GET /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847" status: 200 len: 1472 microversion: 2.1 time: 0.334176 Jan 15 20:51:56.294920 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 560/1173] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:55 2022] GET /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847 => generated 1472 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:56.294920 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ca8cde7b-022f-498e-b6e2-efe5eaebfa86 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:56.294920 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ca8cde7b-022f-498e-b6e2-efe5eaebfa86 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] [instance: 067b97a2-ee1a-4d43-926c-11a8bfa2e332] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:56.302140 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ca8cde7b-022f-498e-b6e2-efe5eaebfa86 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:56.302749 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ca8cde7b-022f-498e-b6e2-efe5eaebfa86 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:56.303558 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ca8cde7b-022f-498e-b6e2-efe5eaebfa86 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:56.303991 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ca8cde7b-022f-498e-b6e2-efe5eaebfa86 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:56.552877 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-ca8cde7b-022f-498e-b6e2-efe5eaebfa86 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55be87ae7f14b499ab2cd6fc5538988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd217e7fd648b4a78c0c32ff1c95f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:56.565343 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ca8cde7b-022f-498e-b6e2-efe5eaebfa86 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "GET /compute/v2.1/servers/067b97a2-ee1a-4d43-926c-11a8bfa2e332" status: 200 len: 1496 microversion: 2.1 time: 0.279380 Jan 15 20:51:56.582063 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 561/1174] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:56 2022] GET /compute/v2.1/servers/067b97a2-ee1a-4d43-926c-11a8bfa2e332 => generated 1496 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:56.589003 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-538161ea-8462-47c1-8c1f-35aea31a53ae tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:56.589952 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-538161ea-8462-47c1-8c1f-35aea31a53ae tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: d603f11b-5d49-492b-b541-1826486876ef] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:56.596920 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-538161ea-8462-47c1-8c1f-35aea31a53ae tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:56.597698 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-538161ea-8462-47c1-8c1f-35aea31a53ae tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:56.599129 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-538161ea-8462-47c1-8c1f-35aea31a53ae tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:56.599784 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-538161ea-8462-47c1-8c1f-35aea31a53ae tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:56.879359 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-538161ea-8462-47c1-8c1f-35aea31a53ae tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:56.889527 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-538161ea-8462-47c1-8c1f-35aea31a53ae tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/d603f11b-5d49-492b-b541-1826486876ef" status: 200 len: 1534 microversion: 2.1 time: 0.305312 Jan 15 20:51:56.890772 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 562/1175] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:56 2022] GET /compute/v2.1/servers/d603f11b-5d49-492b-b541-1826486876ef => generated 1534 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:56.898576 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-827b886f-ad8f-4b0c-97e3-8e7ee9847c27 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:51:56.899719 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-827b886f-ad8f-4b0c-97e3-8e7ee9847c27 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 57bd310f-a604-40de-9c25-882284f4a17b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:56.908534 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-827b886f-ad8f-4b0c-97e3-8e7ee9847c27 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:56.908926 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-827b886f-ad8f-4b0c-97e3-8e7ee9847c27 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:56.909821 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-827b886f-ad8f-4b0c-97e3-8e7ee9847c27 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:56.910306 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-827b886f-ad8f-4b0c-97e3-8e7ee9847c27 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:56.983217 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-827b886f-ad8f-4b0c-97e3-8e7ee9847c27 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/action" status: 200 len: 24543 microversion: 2.1 time: 0.090869 Jan 15 20:51:56.988110 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 563/1176] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:51:56 2022] POST /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/action => generated 24543 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:51:56.994292 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c8754d98-e58c-4e27-801e-6844c767415a tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:57.006138 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c8754d98-e58c-4e27-801e-6844c767415a tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] [instance: 42618a48-fe11-4f55-bed2-738d2cc8a07f] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:57.013443 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c8754d98-e58c-4e27-801e-6844c767415a tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:57.014138 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c8754d98-e58c-4e27-801e-6844c767415a tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:57.015100 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c8754d98-e58c-4e27-801e-6844c767415a tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:57.015680 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c8754d98-e58c-4e27-801e-6844c767415a tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:57.157031 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.network.neutron [None req-b4ad0539-3e36-42ac-812f-dda27d8b4f70 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] [instance: b18c4fdc-6965-4c52-85f5-824ba94b4ad8] Building network info cache for instance {{(pid=129366) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1883}} Jan 15 20:51:57.282263 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-c8754d98-e58c-4e27-801e-6844c767415a tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:57.292291 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-c8754d98-e58c-4e27-801e-6844c767415a tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:57.294109 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-c8754d98-e58c-4e27-801e-6844c767415a tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:57.295494 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c8754d98-e58c-4e27-801e-6844c767415a tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] 10.222.0.46 "GET /compute/v2.1/servers/42618a48-fe11-4f55-bed2-738d2cc8a07f" status: 200 len: 1645 microversion: 2.25 time: 0.305241 Jan 15 20:51:57.306014 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 564/1177] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:51:56 2022] GET /compute/v2.1/servers/42618a48-fe11-4f55-bed2-738d2cc8a07f => generated 1645 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:51:57.314080 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-99a6aec9-6886-4508-ba4d-d75eea1bb7ef tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:57.315530 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-99a6aec9-6886-4508-ba4d-d75eea1bb7ef tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] [instance: 2a53ed48-4f31-4c7d-9b10-39a8648314d2] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:57.323312 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-99a6aec9-6886-4508-ba4d-d75eea1bb7ef tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:57.324067 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-99a6aec9-6886-4508-ba4d-d75eea1bb7ef tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:57.325275 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-99a6aec9-6886-4508-ba4d-d75eea1bb7ef tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:57.325947 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-99a6aec9-6886-4508-ba4d-d75eea1bb7ef tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:57.605098 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-99a6aec9-6886-4508-ba4d-d75eea1bb7ef tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc38f86758f9416b9e7f6915de0359d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8cfe33be708428abef52f5e8e25621b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:57.624002 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-99a6aec9-6886-4508-ba4d-d75eea1bb7ef tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] 10.222.0.46 "GET /compute/v2.1/servers/2a53ed48-4f31-4c7d-9b10-39a8648314d2" status: 200 len: 1316 microversion: 2.1 time: 0.317666 Jan 15 20:51:57.625508 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 565/1178] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:57 2022] GET /compute/v2.1/servers/2a53ed48-4f31-4c7d-9b10-39a8648314d2 => generated 1316 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:57.630632 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-ac5b9fcf-4e48-4c34-aad2-a9d3fd752dc3 req-51772c9a-1ecd-4d62-8ac3-ff21201ab374 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d163f47-49a0-41c9-991b-f42d16af67d1", "name": "network-vif-plugged", "status": "completed", "tag": "26758887-8e21-4143-9b13-3eccf74a0d5b"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:51:57.632579 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:51:57.632579 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:51:57.646691 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-ac5b9fcf-4e48-4c34-aad2-a9d3fd752dc3 req-51772c9a-1ecd-4d62-8ac3-ff21201ab374 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:57.648401 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-ac5b9fcf-4e48-4c34-aad2-a9d3fd752dc3 req-51772c9a-1ecd-4d62-8ac3-ff21201ab374 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:57.665576 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-ac5b9fcf-4e48-4c34-aad2-a9d3fd752dc3 req-51772c9a-1ecd-4d62-8ac3-ff21201ab374 service nova] Creating event network-vif-plugged:26758887-8e21-4143-9b13-3eccf74a0d5b for instance 1d163f47-49a0-41c9-991b-f42d16af67d1 on nch2-master-1 Jan 15 20:51:57.673264 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-ac5b9fcf-4e48-4c34-aad2-a9d3fd752dc3 req-51772c9a-1ecd-4d62-8ac3-ff21201ab374 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045889 Jan 15 20:51:57.673885 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 566/1179] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:51:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:51:57.681129 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d7fca63d-6f50-418a-888b-5bce00a75e11 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:57.682291 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d7fca63d-6f50-418a-888b-5bce00a75e11 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] [instance: 1d163f47-49a0-41c9-991b-f42d16af67d1] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:57.691049 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d7fca63d-6f50-418a-888b-5bce00a75e11 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:57.691797 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d7fca63d-6f50-418a-888b-5bce00a75e11 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:57.693665 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d7fca63d-6f50-418a-888b-5bce00a75e11 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:57.694295 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d7fca63d-6f50-418a-888b-5bce00a75e11 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:57.982954 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-d7fca63d-6f50-418a-888b-5bce00a75e11 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3352815cdc914c15b656b4d0d9511010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7b489c290846f48384c65e977ed644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:57.996196 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.network.neutron [None req-b4ad0539-3e36-42ac-812f-dda27d8b4f70 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] [instance: b18c4fdc-6965-4c52-85f5-824ba94b4ad8] Updating instance_info_cache with network_info: [{"id": "37191f5f-92f4-4372-9435-1f2eddb92f24", "address": "fa:16:3e:b6:e4:fe", "network": {"id": "d11eef3f-f6e5-43d1-bf0a-1a5337d2e062", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-167279773-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.1.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "f471d81a59824fc8afaf454a65e99933", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap37191f5f-92", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=129366) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jan 15 20:51:58.007088 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d7fca63d-6f50-418a-888b-5bce00a75e11 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] 10.222.0.46 "GET /compute/v2.1/servers/1d163f47-49a0-41c9-991b-f42d16af67d1" status: 200 len: 1316 microversion: 2.1 time: 0.331636 Jan 15 20:51:58.008298 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 567/1180] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:57 2022] GET /compute/v2.1/servers/1d163f47-49a0-41c9-991b-f42d16af67d1 => generated 1316 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:58.010932 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b4ad0539-3e36-42ac-812f-dda27d8b4f70 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Releasing lock "refresh_cache-b18c4fdc-6965-4c52-85f5-824ba94b4ad8" {{(pid=129366) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jan 15 20:51:58.012311 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b4ad0539-3e36-42ac-812f-dda27d8b4f70 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] 10.222.0.46 "POST /compute/v2.1/servers/b18c4fdc-6965-4c52-85f5-824ba94b4ad8/action" status: 202 len: 0 microversion: 2.1 time: 2.530921 Jan 15 20:51:58.015883 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 614/1181] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:51:55 2022] POST /compute/v2.1/servers/b18c4fdc-6965-4c52-85f5-824ba94b4ad8/action => generated 0 bytes in 2532 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jan 15 20:51:58.017811 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-542c65a5-8564-4df6-a29e-d282d7a2139b req-e1c826bf-d3da-4ee5-b5ca-27992b796c66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d603f11b-5d49-492b-b541-1826486876ef", "name": "network-vif-unplugged", "status": "completed", "tag": "29144689-f6e8-49ab-886d-3bedd21d555f"}, {"name": "network-changed", "server_uuid": "d603f11b-5d49-492b-b541-1826486876ef", "tag": "29144689-f6e8-49ab-886d-3bedd21d555f"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:51:58.020366 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:51:58.020366 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:51:58.023680 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-1ce3bd07-a9c8-4426-a14d-753c3fb32755 req-2b3054f4-87ec-4626-8871-6125065c8deb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b18c4fdc-6965-4c52-85f5-824ba94b4ad8", "tag": "37191f5f-92f4-4372-9435-1f2eddb92f24"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:51:58.026764 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:51:58.026764 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:51:58.030852 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-542c65a5-8564-4df6-a29e-d282d7a2139b req-e1c826bf-d3da-4ee5-b5ca-27992b796c66 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:58.031634 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-542c65a5-8564-4df6-a29e-d282d7a2139b req-e1c826bf-d3da-4ee5-b5ca-27992b796c66 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:58.037794 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-1ce3bd07-a9c8-4426-a14d-753c3fb32755 req-2b3054f4-87ec-4626-8871-6125065c8deb service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:58.038609 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-1ce3bd07-a9c8-4426-a14d-753c3fb32755 req-2b3054f4-87ec-4626-8871-6125065c8deb service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:58.050736 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-542c65a5-8564-4df6-a29e-d282d7a2139b req-e1c826bf-d3da-4ee5-b5ca-27992b796c66 service nova] Creating event network-vif-unplugged:29144689-f6e8-49ab-886d-3bedd21d555f for instance d603f11b-5d49-492b-b541-1826486876ef on nch1-master-1 Jan 15 20:51:58.051438 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-1ce3bd07-a9c8-4426-a14d-753c3fb32755 req-2b3054f4-87ec-4626-8871-6125065c8deb service nova] Creating event network-changed:37191f5f-92f4-4372-9435-1f2eddb92f24 for instance b18c4fdc-6965-4c52-85f5-824ba94b4ad8 on nch1-master-1 Jan 15 20:51:58.052129 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-542c65a5-8564-4df6-a29e-d282d7a2139b req-e1c826bf-d3da-4ee5-b5ca-27992b796c66 service nova] Creating event network-changed:29144689-f6e8-49ab-886d-3bedd21d555f for instance d603f11b-5d49-492b-b541-1826486876ef on nch1-master-1 Jan 15 20:51:58.057372 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-1ce3bd07-a9c8-4426-a14d-753c3fb32755 req-2b3054f4-87ec-4626-8871-6125065c8deb service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041399 Jan 15 20:51:58.058263 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 615/1182] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:51:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:51:58.059375 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [req-542c65a5-8564-4df6-a29e-d282d7a2139b req-e1c826bf-d3da-4ee5-b5ca-27992b796c66 service nova] Instance d603f11b-5d49-492b-b541-1826486876ef is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=129365) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Jan 15 20:51:58.074725 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-542c65a5-8564-4df6-a29e-d282d7a2139b req-e1c826bf-d3da-4ee5-b5ca-27992b796c66 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.064568 Jan 15 20:51:58.075656 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 568/1183] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:51:58 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:51:58.078886 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8d8a5565-6339-4f25-9d80-a2c5f39459a9 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:58.080274 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-8d8a5565-6339-4f25-9d80-a2c5f39459a9 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] [instance: b191ed6c-040a-4702-8e15-86272f9d1847] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:58.082022 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-630cb359-0575-4cab-8a38-8e89b9d0f086 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:58.083009 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-630cb359-0575-4cab-8a38-8e89b9d0f086 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] [instance: 067b97a2-ee1a-4d43-926c-11a8bfa2e332] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:58.090787 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-630cb359-0575-4cab-8a38-8e89b9d0f086 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:58.091201 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8d8a5565-6339-4f25-9d80-a2c5f39459a9 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:58.091360 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-630cb359-0575-4cab-8a38-8e89b9d0f086 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:58.091889 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8d8a5565-6339-4f25-9d80-a2c5f39459a9 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:58.092300 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-630cb359-0575-4cab-8a38-8e89b9d0f086 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:58.092783 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8d8a5565-6339-4f25-9d80-a2c5f39459a9 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:58.093253 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8d8a5565-6339-4f25-9d80-a2c5f39459a9 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:58.094022 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-630cb359-0575-4cab-8a38-8e89b9d0f086 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:58.310265 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-8d8a5565-6339-4f25-9d80-a2c5f39459a9 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d4a57cfaa145009ba9cc8f21d9e8ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4a26c8edac44c8b26fd4e43813412d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:58.317863 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-630cb359-0575-4cab-8a38-8e89b9d0f086 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55be87ae7f14b499ab2cd6fc5538988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd217e7fd648b4a78c0c32ff1c95f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:58.320826 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-8d8a5565-6339-4f25-9d80-a2c5f39459a9 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] 10.222.0.46 "GET /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847" status: 200 len: 1472 microversion: 2.1 time: 0.258216 Jan 15 20:51:58.321472 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 616/1184] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:58 2022] GET /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847 => generated 1472 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:58.326809 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0e7fa9fd-c4e7-46ca-8a72-4401fd841ab4 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:58.327143 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-630cb359-0575-4cab-8a38-8e89b9d0f086 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "GET /compute/v2.1/servers/067b97a2-ee1a-4d43-926c-11a8bfa2e332" status: 200 len: 1496 microversion: 2.1 time: 0.250012 Jan 15 20:51:58.327412 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-0e7fa9fd-c4e7-46ca-8a72-4401fd841ab4 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: d603f11b-5d49-492b-b541-1826486876ef] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:58.335069 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0e7fa9fd-c4e7-46ca-8a72-4401fd841ab4 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:58.335822 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0e7fa9fd-c4e7-46ca-8a72-4401fd841ab4 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:58.336888 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0e7fa9fd-c4e7-46ca-8a72-4401fd841ab4 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:58.337567 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0e7fa9fd-c4e7-46ca-8a72-4401fd841ab4 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:58.338278 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 569/1185] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:58 2022] GET /compute/v2.1/servers/067b97a2-ee1a-4d43-926c-11a8bfa2e332 => generated 1496 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:58.343228 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-017b15cc-512d-4a74-94cd-6f742ef0a193 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:51:58.344543 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-017b15cc-512d-4a74-94cd-6f742ef0a193 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 57bd310f-a604-40de-9c25-882284f4a17b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:58.361783 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-017b15cc-512d-4a74-94cd-6f742ef0a193 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:58.362365 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-017b15cc-512d-4a74-94cd-6f742ef0a193 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:58.363415 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-017b15cc-512d-4a74-94cd-6f742ef0a193 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:58.365115 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-017b15cc-512d-4a74-94cd-6f742ef0a193 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:58.417267 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-017b15cc-512d-4a74-94cd-6f742ef0a193 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/action" status: 200 len: 24543 microversion: 2.1 time: 0.077292 Jan 15 20:51:58.418051 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 570/1186] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:51:58 2022] POST /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/action => generated 24543 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:51:58.424899 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e0526239-0b07-4434-9ec1-197f0c878c5c tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.1.179"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:51:58.426802 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e0526239-0b07-4434-9ec1-197f0c878c5c tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] [instance: d45d5893-c22a-4b0c-ae7d-26e205a98643] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:58.436057 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e0526239-0b07-4434-9ec1-197f0c878c5c tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:58.436513 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e0526239-0b07-4434-9ec1-197f0c878c5c tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:58.437383 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e0526239-0b07-4434-9ec1-197f0c878c5c tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:58.437977 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e0526239-0b07-4434-9ec1-197f0c878c5c tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:58.473136 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e0526239-0b07-4434-9ec1-197f0c878c5c tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Acquired lock "refresh_cache-d45d5893-c22a-4b0c-ae7d-26e205a98643" {{(pid=129365) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jan 15 20:51:58.810276 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-0e7fa9fd-c4e7-46ca-8a72-4401fd841ab4 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:58.818726 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0e7fa9fd-c4e7-46ca-8a72-4401fd841ab4 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/d603f11b-5d49-492b-b541-1826486876ef" status: 200 len: 1534 microversion: 2.1 time: 0.495665 Jan 15 20:51:58.828615 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 617/1187] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:58 2022] GET /compute/v2.1/servers/d603f11b-5d49-492b-b541-1826486876ef => generated 1534 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:58.833347 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-00ca77ce-08df-4f1e-bd18-d2c77c9d72b2 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:58.834217 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-00ca77ce-08df-4f1e-bd18-d2c77c9d72b2 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] [instance: 42618a48-fe11-4f55-bed2-738d2cc8a07f] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:58.840107 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-00ca77ce-08df-4f1e-bd18-d2c77c9d72b2 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:58.840634 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-00ca77ce-08df-4f1e-bd18-d2c77c9d72b2 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:58.841996 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-00ca77ce-08df-4f1e-bd18-d2c77c9d72b2 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:58.841996 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-00ca77ce-08df-4f1e-bd18-d2c77c9d72b2 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:59.090999 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-00ca77ce-08df-4f1e-bd18-d2c77c9d72b2 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:59.100952 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-00ca77ce-08df-4f1e-bd18-d2c77c9d72b2 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:59.102592 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-00ca77ce-08df-4f1e-bd18-d2c77c9d72b2 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:59.103995 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-00ca77ce-08df-4f1e-bd18-d2c77c9d72b2 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] 10.222.0.46 "GET /compute/v2.1/servers/42618a48-fe11-4f55-bed2-738d2cc8a07f" status: 200 len: 1645 microversion: 2.25 time: 0.274298 Jan 15 20:51:59.115316 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 618/1188] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:51:58 2022] GET /compute/v2.1/servers/42618a48-fe11-4f55-bed2-738d2cc8a07f => generated 1645 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:51:59.115316 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b4af35ab-2397-41c1-a06b-bb3059f9a3f9 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:59.115316 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b4af35ab-2397-41c1-a06b-bb3059f9a3f9 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] [instance: 2a53ed48-4f31-4c7d-9b10-39a8648314d2] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:59.118374 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b4af35ab-2397-41c1-a06b-bb3059f9a3f9 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:59.118929 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b4af35ab-2397-41c1-a06b-bb3059f9a3f9 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:59.119793 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b4af35ab-2397-41c1-a06b-bb3059f9a3f9 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:59.120296 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b4af35ab-2397-41c1-a06b-bb3059f9a3f9 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:59.387848 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-b4af35ab-2397-41c1-a06b-bb3059f9a3f9 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc38f86758f9416b9e7f6915de0359d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8cfe33be708428abef52f5e8e25621b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:59.395303 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b4af35ab-2397-41c1-a06b-bb3059f9a3f9 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] 10.222.0.46 "GET /compute/v2.1/servers/2a53ed48-4f31-4c7d-9b10-39a8648314d2" status: 200 len: 1316 microversion: 2.1 time: 0.289161 Jan 15 20:51:59.404936 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 619/1189] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:59 2022] GET /compute/v2.1/servers/2a53ed48-4f31-4c7d-9b10-39a8648314d2 => generated 1316 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:59.404936 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b5879db0-e2bb-493c-8283-775c0dfb0298 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:59.404936 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b5879db0-e2bb-493c-8283-775c0dfb0298 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] [instance: 1d163f47-49a0-41c9-991b-f42d16af67d1] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:59.406934 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b5879db0-e2bb-493c-8283-775c0dfb0298 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:59.407380 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b5879db0-e2bb-493c-8283-775c0dfb0298 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:59.408280 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b5879db0-e2bb-493c-8283-775c0dfb0298 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:59.408715 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b5879db0-e2bb-493c-8283-775c0dfb0298 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:59.669546 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-b5879db0-e2bb-493c-8283-775c0dfb0298 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3352815cdc914c15b656b4d0d9511010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7b489c290846f48384c65e977ed644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:59.677794 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b5879db0-e2bb-493c-8283-775c0dfb0298 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] 10.222.0.46 "GET /compute/v2.1/servers/1d163f47-49a0-41c9-991b-f42d16af67d1" status: 200 len: 1316 microversion: 2.1 time: 0.280779 Jan 15 20:51:59.678586 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 620/1190] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:59 2022] GET /compute/v2.1/servers/1d163f47-49a0-41c9-991b-f42d16af67d1 => generated 1316 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:59.693339 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-95a73dc8-33bb-444d-b869-868442b366b5 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:59.694025 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-95a73dc8-33bb-444d-b869-868442b366b5 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] [instance: b191ed6c-040a-4702-8e15-86272f9d1847] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:59.700467 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-95a73dc8-33bb-444d-b869-868442b366b5 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:59.700980 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-95a73dc8-33bb-444d-b869-868442b366b5 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:59.702477 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-95a73dc8-33bb-444d-b869-868442b366b5 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:59.702477 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-95a73dc8-33bb-444d-b869-868442b366b5 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:59.955075 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-95a73dc8-33bb-444d-b869-868442b366b5 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d4a57cfaa145009ba9cc8f21d9e8ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4a26c8edac44c8b26fd4e43813412d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:51:59.967395 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-95a73dc8-33bb-444d-b869-868442b366b5 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] 10.222.0.46 "GET /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847" status: 200 len: 1472 microversion: 2.1 time: 0.278826 Jan 15 20:51:59.968896 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 621/1191] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:59 2022] GET /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847 => generated 1472 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:51:59.979114 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-89f35339-758a-4c6b-8fdc-db352ef6fdd6 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:51:59.980051 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-89f35339-758a-4c6b-8fdc-db352ef6fdd6 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] [instance: 067b97a2-ee1a-4d43-926c-11a8bfa2e332] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:51:59.995078 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-89f35339-758a-4c6b-8fdc-db352ef6fdd6 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:59.995864 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-89f35339-758a-4c6b-8fdc-db352ef6fdd6 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:51:59.996702 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-89f35339-758a-4c6b-8fdc-db352ef6fdd6 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:51:59.997160 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-89f35339-758a-4c6b-8fdc-db352ef6fdd6 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:00.245621 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-89f35339-758a-4c6b-8fdc-db352ef6fdd6 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55be87ae7f14b499ab2cd6fc5538988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd217e7fd648b4a78c0c32ff1c95f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:52:00.257484 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-89f35339-758a-4c6b-8fdc-db352ef6fdd6 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "GET /compute/v2.1/servers/067b97a2-ee1a-4d43-926c-11a8bfa2e332" status: 200 len: 1496 microversion: 2.1 time: 0.285293 Jan 15 20:52:00.262368 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 622/1192] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:51:59 2022] GET /compute/v2.1/servers/067b97a2-ee1a-4d43-926c-11a8bfa2e332 => generated 1496 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:52:00.269655 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b0c6c4c3-5ea4-4b3c-b3b5-6c08f8964826 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:52:00.271791 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b0c6c4c3-5ea4-4b3c-b3b5-6c08f8964826 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 57bd310f-a604-40de-9c25-882284f4a17b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:00.282398 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b0c6c4c3-5ea4-4b3c-b3b5-6c08f8964826 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:00.282882 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b0c6c4c3-5ea4-4b3c-b3b5-6c08f8964826 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:00.283762 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b0c6c4c3-5ea4-4b3c-b3b5-6c08f8964826 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:00.284250 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b0c6c4c3-5ea4-4b3c-b3b5-6c08f8964826 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:00.329015 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b0c6c4c3-5ea4-4b3c-b3b5-6c08f8964826 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/action" status: 200 len: 24543 microversion: 2.1 time: 0.064873 Jan 15 20:52:00.334172 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 623/1193] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:52:00 2022] POST /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/action => generated 24543 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:52:00.337853 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-750d58b3-b716-47e2-970d-fdd0d2975f76 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:00.339041 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-750d58b3-b716-47e2-970d-fdd0d2975f76 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: d603f11b-5d49-492b-b541-1826486876ef] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:00.348872 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-750d58b3-b716-47e2-970d-fdd0d2975f76 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:00.349322 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-750d58b3-b716-47e2-970d-fdd0d2975f76 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:00.352879 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-750d58b3-b716-47e2-970d-fdd0d2975f76 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:00.352879 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-750d58b3-b716-47e2-970d-fdd0d2975f76 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:00.636692 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-750d58b3-b716-47e2-970d-fdd0d2975f76 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:52:00.645858 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-750d58b3-b716-47e2-970d-fdd0d2975f76 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/d603f11b-5d49-492b-b541-1826486876ef" status: 200 len: 1527 microversion: 2.1 time: 0.314695 Jan 15 20:52:00.656867 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 624/1194] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:52:00 2022] GET /compute/v2.1/servers/d603f11b-5d49-492b-b541-1826486876ef => generated 1527 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:52:00.656867 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-472e91b9-b992-42b2-b9d4-e72fcc388d11 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:00.656867 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-472e91b9-b992-42b2-b9d4-e72fcc388d11 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] [instance: 42618a48-fe11-4f55-bed2-738d2cc8a07f] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:00.678301 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-472e91b9-b992-42b2-b9d4-e72fcc388d11 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:00.679092 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-472e91b9-b992-42b2-b9d4-e72fcc388d11 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:00.683701 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-472e91b9-b992-42b2-b9d4-e72fcc388d11 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:00.684508 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-472e91b9-b992-42b2-b9d4-e72fcc388d11 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:00.997273 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.network.neutron [None req-e0526239-0b07-4434-9ec1-197f0c878c5c tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] [instance: d45d5893-c22a-4b0c-ae7d-26e205a98643] re-assign floating IP 172.35.1.179 from instance b18c4fdc-6965-4c52-85f5-824ba94b4ad8 Jan 15 20:52:01.045888 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.network.neutron [None req-e0526239-0b07-4434-9ec1-197f0c878c5c tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] [instance: b18c4fdc-6965-4c52-85f5-824ba94b4ad8] Building network info cache for instance {{(pid=129365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1883}} Jan 15 20:52:01.097671 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-472e91b9-b992-42b2-b9d4-e72fcc388d11 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:52:01.112329 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-472e91b9-b992-42b2-b9d4-e72fcc388d11 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:52:01.113986 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-472e91b9-b992-42b2-b9d4-e72fcc388d11 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:52:01.115353 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-472e91b9-b992-42b2-b9d4-e72fcc388d11 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] 10.222.0.46 "GET /compute/v2.1/servers/42618a48-fe11-4f55-bed2-738d2cc8a07f" status: 200 len: 1635 microversion: 2.25 time: 0.467358 Jan 15 20:52:01.116100 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 625/1195] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:52:00 2022] GET /compute/v2.1/servers/42618a48-fe11-4f55-bed2-738d2cc8a07f => generated 1635 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:52:01.127754 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-773cf4d5-6441-4fb1-8b7a-b43d6785a5cc tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:01.127754 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-773cf4d5-6441-4fb1-8b7a-b43d6785a5cc tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] [instance: 2a53ed48-4f31-4c7d-9b10-39a8648314d2] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:01.141083 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-773cf4d5-6441-4fb1-8b7a-b43d6785a5cc tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:01.141448 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-773cf4d5-6441-4fb1-8b7a-b43d6785a5cc tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:01.142275 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-773cf4d5-6441-4fb1-8b7a-b43d6785a5cc tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:01.142722 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-773cf4d5-6441-4fb1-8b7a-b43d6785a5cc tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:01.641818 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-773cf4d5-6441-4fb1-8b7a-b43d6785a5cc tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc38f86758f9416b9e7f6915de0359d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8cfe33be708428abef52f5e8e25621b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:52:01.652087 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-773cf4d5-6441-4fb1-8b7a-b43d6785a5cc tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] 10.222.0.46 "GET /compute/v2.1/servers/2a53ed48-4f31-4c7d-9b10-39a8648314d2" status: 200 len: 1316 microversion: 2.1 time: 0.534521 Jan 15 20:52:01.663231 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 626/1196] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:52:01 2022] GET /compute/v2.1/servers/2a53ed48-4f31-4c7d-9b10-39a8648314d2 => generated 1316 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:52:01.669421 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c3821abb-7759-4da9-9c8c-be58ee0ef087 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:01.670290 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c3821abb-7759-4da9-9c8c-be58ee0ef087 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: d603f11b-5d49-492b-b541-1826486876ef] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:01.677745 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c3821abb-7759-4da9-9c8c-be58ee0ef087 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:01.678393 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c3821abb-7759-4da9-9c8c-be58ee0ef087 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:01.679297 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c3821abb-7759-4da9-9c8c-be58ee0ef087 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:01.679804 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c3821abb-7759-4da9-9c8c-be58ee0ef087 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:01.994141 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-c3821abb-7759-4da9-9c8c-be58ee0ef087 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:52:02.002520 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c3821abb-7759-4da9-9c8c-be58ee0ef087 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/d603f11b-5d49-492b-b541-1826486876ef" status: 200 len: 1527 microversion: 2.1 time: 0.337603 Jan 15 20:52:02.003468 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 627/1197] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:52:01 2022] GET /compute/v2.1/servers/d603f11b-5d49-492b-b541-1826486876ef => generated 1527 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:52:02.020292 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a3ecb359-adf4-44fb-b994-47b433dca276 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:02.021510 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a3ecb359-adf4-44fb-b994-47b433dca276 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] [instance: 1d163f47-49a0-41c9-991b-f42d16af67d1] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:02.028296 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a3ecb359-adf4-44fb-b994-47b433dca276 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:02.028987 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a3ecb359-adf4-44fb-b994-47b433dca276 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:02.029727 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a3ecb359-adf4-44fb-b994-47b433dca276 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:02.030166 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a3ecb359-adf4-44fb-b994-47b433dca276 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:02.034043 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.network.neutron [None req-e0526239-0b07-4434-9ec1-197f0c878c5c tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] [instance: b18c4fdc-6965-4c52-85f5-824ba94b4ad8] Updating instance_info_cache with network_info: [{"id": "37191f5f-92f4-4372-9435-1f2eddb92f24", "address": "fa:16:3e:b6:e4:fe", "network": {"id": "d11eef3f-f6e5-43d1-bf0a-1a5337d2e062", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-167279773-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "f471d81a59824fc8afaf454a65e99933", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap37191f5f-92", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=129365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jan 15 20:52:02.053196 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.network.neutron [None req-e0526239-0b07-4434-9ec1-197f0c878c5c tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] [instance: d45d5893-c22a-4b0c-ae7d-26e205a98643] Building network info cache for instance {{(pid=129365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1883}} Jan 15 20:52:02.252968 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-a3ecb359-adf4-44fb-b994-47b433dca276 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3352815cdc914c15b656b4d0d9511010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7b489c290846f48384c65e977ed644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:52:02.261261 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a3ecb359-adf4-44fb-b994-47b433dca276 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] 10.222.0.46 "GET /compute/v2.1/servers/1d163f47-49a0-41c9-991b-f42d16af67d1" status: 200 len: 1316 microversion: 2.1 time: 0.245243 Jan 15 20:52:02.261909 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 628/1198] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:52:02 2022] GET /compute/v2.1/servers/1d163f47-49a0-41c9-991b-f42d16af67d1 => generated 1316 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:52:02.266496 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-6c5bd13d-6fe2-41b3-9403-f99e53fecaa6 req-79f1a862-68be-444f-bac4-5832db4d4e2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b18c4fdc-6965-4c52-85f5-824ba94b4ad8", "tag": "37191f5f-92f4-4372-9435-1f2eddb92f24"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:52:02.268176 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:52:02.268176 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:52:02.275792 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-6c5bd13d-6fe2-41b3-9403-f99e53fecaa6 req-79f1a862-68be-444f-bac4-5832db4d4e2e service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:02.276287 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-6c5bd13d-6fe2-41b3-9403-f99e53fecaa6 req-79f1a862-68be-444f-bac4-5832db4d4e2e service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:02.289000 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-6c5bd13d-6fe2-41b3-9403-f99e53fecaa6 req-79f1a862-68be-444f-bac4-5832db4d4e2e service nova] Creating event network-changed:37191f5f-92f4-4372-9435-1f2eddb92f24 for instance b18c4fdc-6965-4c52-85f5-824ba94b4ad8 on nch1-master-1 Jan 15 20:52:02.300510 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-6c5bd13d-6fe2-41b3-9403-f99e53fecaa6 req-79f1a862-68be-444f-bac4-5832db4d4e2e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037239 Jan 15 20:52:02.302571 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 629/1199] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:52:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:52:02.307106 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-cac5470e-d1f7-486a-b5e7-7b42b6e2563a tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:02.307692 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-cac5470e-d1f7-486a-b5e7-7b42b6e2563a tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] [instance: b191ed6c-040a-4702-8e15-86272f9d1847] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:02.324443 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cac5470e-d1f7-486a-b5e7-7b42b6e2563a tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:02.325242 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cac5470e-d1f7-486a-b5e7-7b42b6e2563a tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:02.326045 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cac5470e-d1f7-486a-b5e7-7b42b6e2563a tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:02.326482 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cac5470e-d1f7-486a-b5e7-7b42b6e2563a tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:02.555324 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-cac5470e-d1f7-486a-b5e7-7b42b6e2563a tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d4a57cfaa145009ba9cc8f21d9e8ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4a26c8edac44c8b26fd4e43813412d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:52:02.567302 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-cac5470e-d1f7-486a-b5e7-7b42b6e2563a tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] 10.222.0.46 "GET /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847" status: 200 len: 1472 microversion: 2.1 time: 0.263554 Jan 15 20:52:02.577886 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 630/1200] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:52:02 2022] GET /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847 => generated 1472 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:52:02.583080 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d0076b55-9730-4175-83ac-b63bf72018a6 tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Calling method '.version_select at 0x7f30c905a940>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:02.584680 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-migrations:index": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:52:02.584680 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:52:02.586303 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d0076b55-9730-4175-83ac-b63bf72018a6 tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:02.587061 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d0076b55-9730-4175-83ac-b63bf72018a6 tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:02.599888 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d0076b55-9730-4175-83ac-b63bf72018a6 tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] 10.222.0.46 "GET /compute/v2.1/os-migrations" status: 200 len: 2541 microversion: 2.25 time: 0.020679 Jan 15 20:52:02.601026 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 631/1201] 10.222.0.46 () {60 vars in 1183 bytes} [Sat Jan 15 20:52:02 2022] GET /compute/v2.1/os-migrations => generated 2541 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:52:02.605809 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-081791ec-2de8-4f31-8855-19434e7dfa1e tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:02.606560 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-081791ec-2de8-4f31-8855-19434e7dfa1e tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] [instance: 067b97a2-ee1a-4d43-926c-11a8bfa2e332] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:02.612699 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-081791ec-2de8-4f31-8855-19434e7dfa1e tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:02.613366 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-081791ec-2de8-4f31-8855-19434e7dfa1e tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:02.614366 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-081791ec-2de8-4f31-8855-19434e7dfa1e tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:02.615743 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-081791ec-2de8-4f31-8855-19434e7dfa1e tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:02.837603 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.network.neutron [None req-e0526239-0b07-4434-9ec1-197f0c878c5c tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] [instance: d45d5893-c22a-4b0c-ae7d-26e205a98643] Updating instance_info_cache with network_info: [{"id": "1ca16880-699b-4753-b30c-773b6af5f27f", "address": "fa:16:3e:b5:3d:95", "network": {"id": "d11eef3f-f6e5-43d1-bf0a-1a5337d2e062", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-167279773-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.1.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "f471d81a59824fc8afaf454a65e99933", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap1ca16880-69", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=129365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jan 15 20:52:02.851300 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-081791ec-2de8-4f31-8855-19434e7dfa1e tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55be87ae7f14b499ab2cd6fc5538988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd217e7fd648b4a78c0c32ff1c95f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:52:02.856016 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e0526239-0b07-4434-9ec1-197f0c878c5c tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Releasing lock "refresh_cache-d45d5893-c22a-4b0c-ae7d-26e205a98643" {{(pid=129365) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jan 15 20:52:02.856992 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e0526239-0b07-4434-9ec1-197f0c878c5c tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] 10.222.0.46 "POST /compute/v2.1/servers/d45d5893-c22a-4b0c-ae7d-26e205a98643/action" status: 202 len: 0 microversion: 2.1 time: 4.436832 Jan 15 20:52:02.859090 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-081791ec-2de8-4f31-8855-19434e7dfa1e tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "GET /compute/v2.1/servers/067b97a2-ee1a-4d43-926c-11a8bfa2e332" status: 200 len: 1496 microversion: 2.1 time: 0.256961 Jan 15 20:52:02.861279 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 571/1202] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:51:58 2022] POST /compute/v2.1/servers/d45d5893-c22a-4b0c-ae7d-26e205a98643/action => generated 0 bytes in 4443 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jan 15 20:52:02.866151 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 632/1203] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:52:02 2022] GET /compute/v2.1/servers/067b97a2-ee1a-4d43-926c-11a8bfa2e332 => generated 1496 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:52:02.868185 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9d94af88-ff6b-4235-9922-f22d59ab56a3 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:52:02.870051 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-9d94af88-ff6b-4235-9922-f22d59ab56a3 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 57bd310f-a604-40de-9c25-882284f4a17b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:02.872879 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e8ddf62c-2ec6-43b1-ab4b-b40e1499f61e tempest-MigrationsAdminTest-1503274595 tempest-MigrationsAdminTest-1503274595-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:02.873715 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:52:02.873715 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:52:02.878381 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9d94af88-ff6b-4235-9922-f22d59ab56a3 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:02.879731 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9d94af88-ff6b-4235-9922-f22d59ab56a3 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:02.880464 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-e8ddf62c-2ec6-43b1-ab4b-b40e1499f61e tempest-MigrationsAdminTest-1503274595 tempest-MigrationsAdminTest-1503274595-project-admin] HTTP exception thrown: Flavor b7625772-7b20-4764-8508-589665228f46 could not be found. Jan 15 20:52:02.881344 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9d94af88-ff6b-4235-9922-f22d59ab56a3 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:02.881495 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e8ddf62c-2ec6-43b1-ab4b-b40e1499f61e tempest-MigrationsAdminTest-1503274595 tempest-MigrationsAdminTest-1503274595-project-admin] Returning 404 to user: Flavor b7625772-7b20-4764-8508-589665228f46 could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:52:02.882085 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9d94af88-ff6b-4235-9922-f22d59ab56a3 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:02.882213 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e8ddf62c-2ec6-43b1-ab4b-b40e1499f61e tempest-MigrationsAdminTest-1503274595 tempest-MigrationsAdminTest-1503274595-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/b7625772-7b20-4764-8508-589665228f46" status: 404 len: 109 microversion: 2.1 time: 0.014788 Jan 15 20:52:02.883185 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 633/1204] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 20:52:02 2022] DELETE /compute/v2.1/flavors/b7625772-7b20-4764-8508-589665228f46 => generated 109 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:52:02.889314 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-84a29658-6809-4dfa-a069-ab1ce23bc9d5 tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:02.890319 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-84a29658-6809-4dfa-a069-ab1ce23bc9d5 tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] [instance: 42618a48-fe11-4f55-bed2-738d2cc8a07f] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:02.899603 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-84a29658-6809-4dfa-a069-ab1ce23bc9d5 tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:02.900336 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-84a29658-6809-4dfa-a069-ab1ce23bc9d5 tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:02.901375 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-84a29658-6809-4dfa-a069-ab1ce23bc9d5 tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:02.901819 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-84a29658-6809-4dfa-a069-ab1ce23bc9d5 tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:02.962183 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-9d94af88-ff6b-4235-9922-f22d59ab56a3 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/action" status: 200 len: 24543 microversion: 2.1 time: 0.099376 Jan 15 20:52:02.963349 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 572/1205] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:52:02 2022] POST /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/action => generated 24543 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:52:02.970584 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-504c3560-6b34-43aa-b61a-b2472cf78693 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:02.971297 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-504c3560-6b34-43aa-b61a-b2472cf78693 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] [instance: 2a53ed48-4f31-4c7d-9b10-39a8648314d2] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:02.978572 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-504c3560-6b34-43aa-b61a-b2472cf78693 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:02.979326 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-504c3560-6b34-43aa-b61a-b2472cf78693 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:02.980131 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-504c3560-6b34-43aa-b61a-b2472cf78693 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:02.980784 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-504c3560-6b34-43aa-b61a-b2472cf78693 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:03.086899 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.objects.instance [None req-84a29658-6809-4dfa-a069-ab1ce23bc9d5 tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Lazy-loading 'services' on Instance uuid 42618a48-fe11-4f55-bed2-738d2cc8a07f {{(pid=129366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 20:52:03.101164 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-84a29658-6809-4dfa-a069-ab1ce23bc9d5 tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/42618a48-fe11-4f55-bed2-738d2cc8a07f" status: 200 len: 2128 microversion: 2.25 time: 0.216552 Jan 15 20:52:03.101896 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 634/1206] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:52:02 2022] GET /compute/v2.1/servers/42618a48-fe11-4f55-bed2-738d2cc8a07f => generated 2128 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:52:03.106655 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-5742af61-205c-4872-9981-767ec88ff102 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.1.179"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:52:03.214827 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-504c3560-6b34-43aa-b61a-b2472cf78693 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc38f86758f9416b9e7f6915de0359d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8cfe33be708428abef52f5e8e25621b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:52:03.224125 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-504c3560-6b34-43aa-b61a-b2472cf78693 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] 10.222.0.46 "GET /compute/v2.1/servers/2a53ed48-4f31-4c7d-9b10-39a8648314d2" status: 200 len: 1316 microversion: 2.1 time: 0.258638 Jan 15 20:52:03.234688 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 573/1207] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:52:02 2022] GET /compute/v2.1/servers/2a53ed48-4f31-4c7d-9b10-39a8648314d2 => generated 1316 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:52:03.234688 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-fea1890f-7da0-4b75-bbe0-8663152e9ed1 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1710718840", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:52:03.260472 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-5742af61-205c-4872-9981-767ec88ff102 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] [instance: d45d5893-c22a-4b0c-ae7d-26e205a98643] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:03.267118 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5742af61-205c-4872-9981-767ec88ff102 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:03.267673 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5742af61-205c-4872-9981-767ec88ff102 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:03.268589 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5742af61-205c-4872-9981-767ec88ff102 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:03.269228 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5742af61-205c-4872-9981-767ec88ff102 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:03.284297 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.network.neutron [None req-fea1890f-7da0-4b75-bbe0-8663152e9ed1 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] validate_networks() for None {{(pid=129365) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 20:52:03.580584 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-5742af61-205c-4872-9981-767ec88ff102 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] HTTP exception thrown: Floating IP 172.35.1.179 is not associated with instance b18c4fdc-6965-4c52-85f5-824ba94b4ad8. Jan 15 20:52:03.581240 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-5742af61-205c-4872-9981-767ec88ff102 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Returning 409 to user: Floating IP 172.35.1.179 is not associated with instance b18c4fdc-6965-4c52-85f5-824ba94b4ad8. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:52:03.582877 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-5742af61-205c-4872-9981-767ec88ff102 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] 10.222.0.46 "POST /compute/v2.1/servers/b18c4fdc-6965-4c52-85f5-824ba94b4ad8/action" status: 409 len: 146 microversion: 2.1 time: 0.479098 Jan 15 20:52:03.583995 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 635/1208] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:52:03 2022] POST /compute/v2.1/servers/b18c4fdc-6965-4c52-85f5-824ba94b4ad8/action => generated 146 bytes in 481 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jan 15 20:52:03.588708 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f75f6000-726a-42d1-93a8-0a9caa1d0758 tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:03.589343 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f75f6000-726a-42d1-93a8-0a9caa1d0758 tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] [instance: 42618a48-fe11-4f55-bed2-738d2cc8a07f] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:03.595518 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f75f6000-726a-42d1-93a8-0a9caa1d0758 tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:03.595965 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f75f6000-726a-42d1-93a8-0a9caa1d0758 tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:03.596787 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f75f6000-726a-42d1-93a8-0a9caa1d0758 tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:03.597256 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f75f6000-726a-42d1-93a8-0a9caa1d0758 tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:03.630638 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-fea1890f-7da0-4b75-bbe0-8663152e9ed1 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Flavor limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 20:52:03.631055 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-fea1890f-7da0-4b75-bbe0-8663152e9ed1 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Image limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 20:52:03.631599 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-fea1890f-7da0-4b75-bbe0-8663152e9ed1 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Flavor pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 20:52:03.632007 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-fea1890f-7da0-4b75-bbe0-8663152e9ed1 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Image pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 20:52:03.632414 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-fea1890f-7da0-4b75-bbe0-8663152e9ed1 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 20:52:03.641427 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fea1890f-7da0-4b75-bbe0-8663152e9ed1 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:03.641870 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fea1890f-7da0-4b75-bbe0-8663152e9ed1 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:03.642689 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fea1890f-7da0-4b75-bbe0-8663152e9ed1 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:03.643122 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fea1890f-7da0-4b75-bbe0-8663152e9ed1 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:03.663594 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-fea1890f-7da0-4b75-bbe0-8663152e9ed1 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Getting quotas for project 8e6badf41af14266b626a14241efaf88. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:52:03.667564 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-fea1890f-7da0-4b75-bbe0-8663152e9ed1 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Getting quotas for user 9245b10067884c428525283137ca04c6 and project 8e6badf41af14266b626a14241efaf88. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:52:03.679787 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-fea1890f-7da0-4b75-bbe0-8663152e9ed1 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Going to run 1 instances... {{(pid=129365) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 20:52:03.682458 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-fea1890f-7da0-4b75-bbe0-8663152e9ed1 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: e983108d-66c6-472e-bfc1-761f8a333569] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129365) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 20:52:03.726247 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.objects.instance [None req-f75f6000-726a-42d1-93a8-0a9caa1d0758 tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Lazy-loading 'services' on Instance uuid 42618a48-fe11-4f55-bed2-738d2cc8a07f {{(pid=129366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 20:52:03.728269 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-fea1890f-7da0-4b75-bbe0-8663152e9ed1 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.501935 Jan 15 20:52:03.733812 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 574/1209] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 20:52:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 503 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 20:52:03.733812 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8946b722-6798-437f-880c-38e08f2279a3 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:03.734086 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-8946b722-6798-437f-880c-38e08f2279a3 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] [instance: 1d163f47-49a0-41c9-991b-f42d16af67d1] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:03.740505 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8946b722-6798-437f-880c-38e08f2279a3 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:03.740992 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8946b722-6798-437f-880c-38e08f2279a3 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:03.741791 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8946b722-6798-437f-880c-38e08f2279a3 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:03.742234 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8946b722-6798-437f-880c-38e08f2279a3 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:03.748271 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f75f6000-726a-42d1-93a8-0a9caa1d0758 tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/42618a48-fe11-4f55-bed2-738d2cc8a07f" status: 200 len: 2128 microversion: 2.25 time: 0.163225 Jan 15 20:52:03.749407 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 636/1210] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:52:03 2022] GET /compute/v2.1/servers/42618a48-fe11-4f55-bed2-738d2cc8a07f => generated 2128 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:52:03.754806 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7713989c-44e1-4661-876d-3195aeaa7df8 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:03.756067 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-7713989c-44e1-4661-876d-3195aeaa7df8 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] [instance: b191ed6c-040a-4702-8e15-86272f9d1847] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:03.762537 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7713989c-44e1-4661-876d-3195aeaa7df8 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:03.762982 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7713989c-44e1-4661-876d-3195aeaa7df8 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:03.779357 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7713989c-44e1-4661-876d-3195aeaa7df8 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:03.779813 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7713989c-44e1-4661-876d-3195aeaa7df8 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:03.989883 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-7713989c-44e1-4661-876d-3195aeaa7df8 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d4a57cfaa145009ba9cc8f21d9e8ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4a26c8edac44c8b26fd4e43813412d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:52:03.993411 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-8946b722-6798-437f-880c-38e08f2279a3 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3352815cdc914c15b656b4d0d9511010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7b489c290846f48384c65e977ed644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:52:03.997765 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7713989c-44e1-4661-876d-3195aeaa7df8 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] 10.222.0.46 "GET /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847" status: 200 len: 1472 microversion: 2.1 time: 0.247281 Jan 15 20:52:03.998426 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 637/1211] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:52:03 2022] GET /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847 => generated 1472 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:52:04.001232 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-8946b722-6798-437f-880c-38e08f2279a3 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] 10.222.0.46 "GET /compute/v2.1/servers/1d163f47-49a0-41c9-991b-f42d16af67d1" status: 200 len: 1316 microversion: 2.1 time: 0.271223 Jan 15 20:52:04.001808 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 575/1212] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:52:03 2022] GET /compute/v2.1/servers/1d163f47-49a0-41c9-991b-f42d16af67d1 => generated 1316 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:52:04.003551 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b3d8b2cf-85af-47ee-a308-7add4dab5498 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.1.179"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:52:04.007754 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-1aa2a8fd-8a3f-478f-bb6d-26ad4ad9ba4c tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:04.008422 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-1aa2a8fd-8a3f-478f-bb6d-26ad4ad9ba4c tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: e983108d-66c6-472e-bfc1-761f8a333569] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:04.104980 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-1aa2a8fd-8a3f-478f-bb6d-26ad4ad9ba4c tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:52:04.118076 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-1aa2a8fd-8a3f-478f-bb6d-26ad4ad9ba4c tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/e983108d-66c6-472e-bfc1-761f8a333569" status: 200 len: 1213 microversion: 2.1 time: 0.114845 Jan 15 20:52:04.119375 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 576/1213] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:52:04 2022] GET /compute/v2.1/servers/e983108d-66c6-472e-bfc1-761f8a333569 => generated 1213 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:52:04.125971 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a3cb6210-dfa7-42a2-a677-720076c256b8 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:04.126882 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a3cb6210-dfa7-42a2-a677-720076c256b8 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] [instance: 067b97a2-ee1a-4d43-926c-11a8bfa2e332] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:04.135911 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a3cb6210-dfa7-42a2-a677-720076c256b8 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:04.136493 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a3cb6210-dfa7-42a2-a677-720076c256b8 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:04.137621 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a3cb6210-dfa7-42a2-a677-720076c256b8 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:04.138556 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a3cb6210-dfa7-42a2-a677-720076c256b8 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:04.186112 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b3d8b2cf-85af-47ee-a308-7add4dab5498 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] [instance: d45d5893-c22a-4b0c-ae7d-26e205a98643] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:04.193665 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b3d8b2cf-85af-47ee-a308-7add4dab5498 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:04.194551 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b3d8b2cf-85af-47ee-a308-7add4dab5498 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:04.195750 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b3d8b2cf-85af-47ee-a308-7add4dab5498 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:04.199395 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b3d8b2cf-85af-47ee-a308-7add4dab5498 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:04.415759 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-a3cb6210-dfa7-42a2-a677-720076c256b8 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55be87ae7f14b499ab2cd6fc5538988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd217e7fd648b4a78c0c32ff1c95f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:52:04.427004 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a3cb6210-dfa7-42a2-a677-720076c256b8 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "GET /compute/v2.1/servers/067b97a2-ee1a-4d43-926c-11a8bfa2e332" status: 200 len: 1496 microversion: 2.1 time: 0.305349 Jan 15 20:52:04.428540 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 577/1214] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:52:04 2022] GET /compute/v2.1/servers/067b97a2-ee1a-4d43-926c-11a8bfa2e332 => generated 1496 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:52:04.433667 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5e0edd2a-2305-45bd-9dfd-a80adf38db65 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:04.434273 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-5e0edd2a-2305-45bd-9dfd-a80adf38db65 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] [instance: 42618a48-fe11-4f55-bed2-738d2cc8a07f] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:04.440826 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5e0edd2a-2305-45bd-9dfd-a80adf38db65 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:04.441198 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5e0edd2a-2305-45bd-9dfd-a80adf38db65 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:04.442620 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5e0edd2a-2305-45bd-9dfd-a80adf38db65 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:04.443568 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5e0edd2a-2305-45bd-9dfd-a80adf38db65 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:04.481494 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b3d8b2cf-85af-47ee-a308-7add4dab5498 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Acquired lock "refresh_cache-d45d5893-c22a-4b0c-ae7d-26e205a98643" {{(pid=129366) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jan 15 20:52:04.582877 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.objects.instance [None req-5e0edd2a-2305-45bd-9dfd-a80adf38db65 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lazy-loading 'services' on Instance uuid 42618a48-fe11-4f55-bed2-738d2cc8a07f {{(pid=129365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 20:52:04.708942 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5e0edd2a-2305-45bd-9dfd-a80adf38db65 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] 10.222.0.46 "DELETE /compute/v2.1/servers/42618a48-fe11-4f55-bed2-738d2cc8a07f/os-volume_attachments/53534861-c45e-4186-a9c4-9bd3a661cb59" status: 202 len: 0 microversion: 2.25 time: 0.278803 Jan 15 20:52:04.709920 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 578/1215] 10.222.0.46 () {60 vars in 1456 bytes} [Sat Jan 15 20:52:04 2022] DELETE /compute/v2.1/servers/42618a48-fe11-4f55-bed2-738d2cc8a07f/os-volume_attachments/53534861-c45e-4186-a9c4-9bd3a661cb59 => generated 0 bytes in 281 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 15 20:52:04.718687 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8eeb3927-694e-4669-a634-665836e02dfd tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:52:04.719777 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-8eeb3927-694e-4669-a634-665836e02dfd tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 57bd310f-a604-40de-9c25-882284f4a17b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:04.727323 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8eeb3927-694e-4669-a634-665836e02dfd tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:04.727887 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8eeb3927-694e-4669-a634-665836e02dfd tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:04.728789 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8eeb3927-694e-4669-a634-665836e02dfd tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:04.729521 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8eeb3927-694e-4669-a634-665836e02dfd tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:04.782761 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-8eeb3927-694e-4669-a634-665836e02dfd tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/action" status: 200 len: 24543 microversion: 2.1 time: 0.066095 Jan 15 20:52:04.786271 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 579/1216] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:52:04 2022] POST /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/action => generated 24543 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:52:04.792528 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5839f0e0-d0bb-4a05-b2a7-1a98d5f4dd86 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:04.793088 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-5839f0e0-d0bb-4a05-b2a7-1a98d5f4dd86 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] [instance: 2a53ed48-4f31-4c7d-9b10-39a8648314d2] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:04.800240 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5839f0e0-d0bb-4a05-b2a7-1a98d5f4dd86 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:04.800829 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5839f0e0-d0bb-4a05-b2a7-1a98d5f4dd86 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:04.801617 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5839f0e0-d0bb-4a05-b2a7-1a98d5f4dd86 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:04.802160 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5839f0e0-d0bb-4a05-b2a7-1a98d5f4dd86 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:05.109769 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-5839f0e0-d0bb-4a05-b2a7-1a98d5f4dd86 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc38f86758f9416b9e7f6915de0359d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8cfe33be708428abef52f5e8e25621b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:52:05.119290 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5839f0e0-d0bb-4a05-b2a7-1a98d5f4dd86 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] 10.222.0.46 "GET /compute/v2.1/servers/2a53ed48-4f31-4c7d-9b10-39a8648314d2" status: 200 len: 1316 microversion: 2.1 time: 0.330866 Jan 15 20:52:05.119966 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 580/1217] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:52:04 2022] GET /compute/v2.1/servers/2a53ed48-4f31-4c7d-9b10-39a8648314d2 => generated 1316 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:52:05.125179 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-21a2d210-1d92-4348-8068-cff126721eac req-9cf0a15e-3447-40d6-b455-8b034f415342 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d45d5893-c22a-4b0c-ae7d-26e205a98643", "tag": "1ca16880-699b-4753-b30c-773b6af5f27f"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:52:05.126932 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:52:05.126932 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:52:05.135649 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-21a2d210-1d92-4348-8068-cff126721eac req-9cf0a15e-3447-40d6-b455-8b034f415342 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:05.136243 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-21a2d210-1d92-4348-8068-cff126721eac req-9cf0a15e-3447-40d6-b455-8b034f415342 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:05.148214 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-21a2d210-1d92-4348-8068-cff126721eac req-9cf0a15e-3447-40d6-b455-8b034f415342 service nova] Creating event network-changed:1ca16880-699b-4753-b30c-773b6af5f27f for instance d45d5893-c22a-4b0c-ae7d-26e205a98643 on nch2-master-1 Jan 15 20:52:05.153851 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-21a2d210-1d92-4348-8068-cff126721eac req-9cf0a15e-3447-40d6-b455-8b034f415342 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032454 Jan 15 20:52:05.154596 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 581/1218] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:52:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:52:05.161604 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-0b9f5870-85ea-45f4-b68c-89f50427f7e0 req-ec4d3a1e-0368-4ad1-b265-4a111f2336fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a53ed48-4f31-4c7d-9b10-39a8648314d2", "name": "network-vif-plugged", "status": "completed", "tag": "be26730f-1c78-49d2-b708-69a94845942e"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:52:05.163788 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:52:05.163788 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:52:05.173178 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-0b9f5870-85ea-45f4-b68c-89f50427f7e0 req-ec4d3a1e-0368-4ad1-b265-4a111f2336fb service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:05.173860 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-0b9f5870-85ea-45f4-b68c-89f50427f7e0 req-ec4d3a1e-0368-4ad1-b265-4a111f2336fb service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:05.193304 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-0b9f5870-85ea-45f4-b68c-89f50427f7e0 req-ec4d3a1e-0368-4ad1-b265-4a111f2336fb service nova] Creating event network-vif-plugged:be26730f-1c78-49d2-b708-69a94845942e for instance 2a53ed48-4f31-4c7d-9b10-39a8648314d2 on nch2-master-1 Jan 15 20:52:05.199075 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-0b9f5870-85ea-45f4-b68c-89f50427f7e0 req-ec4d3a1e-0368-4ad1-b265-4a111f2336fb service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042970 Jan 15 20:52:05.200677 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 582/1219] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:52:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:52:05.207802 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-744fa440-1d06-4e47-bc6a-289c1fa0e18a tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:05.209118 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-744fa440-1d06-4e47-bc6a-289c1fa0e18a tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] [instance: 42618a48-fe11-4f55-bed2-738d2cc8a07f] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:05.216463 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-744fa440-1d06-4e47-bc6a-289c1fa0e18a tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:05.217195 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-744fa440-1d06-4e47-bc6a-289c1fa0e18a tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:05.218207 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-744fa440-1d06-4e47-bc6a-289c1fa0e18a tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:05.218798 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-744fa440-1d06-4e47-bc6a-289c1fa0e18a tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:05.274094 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-744fa440-1d06-4e47-bc6a-289c1fa0e18a tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] 10.222.0.46 "GET /compute/v2.1/servers/42618a48-fe11-4f55-bed2-738d2cc8a07f/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.071978 Jan 15 20:52:05.275013 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 583/1220] 10.222.0.46 () {60 vars in 1342 bytes} [Sat Jan 15 20:52:05 2022] GET /compute/v2.1/servers/42618a48-fe11-4f55-bed2-738d2cc8a07f/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:52:05.281701 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2c988b5b-ffd8-4ff7-840b-cc736fb45e47 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:05.282479 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-2c988b5b-ffd8-4ff7-840b-cc736fb45e47 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] [instance: b191ed6c-040a-4702-8e15-86272f9d1847] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:05.289044 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2c988b5b-ffd8-4ff7-840b-cc736fb45e47 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:05.289612 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2c988b5b-ffd8-4ff7-840b-cc736fb45e47 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:05.290790 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2c988b5b-ffd8-4ff7-840b-cc736fb45e47 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:05.291553 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2c988b5b-ffd8-4ff7-840b-cc736fb45e47 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:05.414248 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.network.neutron [None req-b3d8b2cf-85af-47ee-a308-7add4dab5498 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] [instance: d45d5893-c22a-4b0c-ae7d-26e205a98643] Building network info cache for instance {{(pid=129366) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1883}} Jan 15 20:52:05.522252 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-2c988b5b-ffd8-4ff7-840b-cc736fb45e47 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d4a57cfaa145009ba9cc8f21d9e8ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4a26c8edac44c8b26fd4e43813412d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:52:05.539313 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2c988b5b-ffd8-4ff7-840b-cc736fb45e47 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] 10.222.0.46 "GET /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847" status: 200 len: 1472 microversion: 2.1 time: 0.262944 Jan 15 20:52:05.540146 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 584/1221] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:52:05 2022] GET /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847 => generated 1472 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:52:05.554021 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a23daa3b-cc39-454b-b4e3-cf6134664974 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:05.554737 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a23daa3b-cc39-454b-b4e3-cf6134664974 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] [instance: 1d163f47-49a0-41c9-991b-f42d16af67d1] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:05.562113 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a23daa3b-cc39-454b-b4e3-cf6134664974 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:05.562787 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a23daa3b-cc39-454b-b4e3-cf6134664974 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:05.565382 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a23daa3b-cc39-454b-b4e3-cf6134664974 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:05.566787 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a23daa3b-cc39-454b-b4e3-cf6134664974 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:06.141049 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-a23daa3b-cc39-454b-b4e3-cf6134664974 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3352815cdc914c15b656b4d0d9511010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7b489c290846f48384c65e977ed644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:52:06.163543 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a23daa3b-cc39-454b-b4e3-cf6134664974 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] 10.222.0.46 "GET /compute/v2.1/servers/1d163f47-49a0-41c9-991b-f42d16af67d1" status: 200 len: 1316 microversion: 2.1 time: 0.621753 Jan 15 20:52:06.175920 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 585/1222] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:52:05 2022] GET /compute/v2.1/servers/1d163f47-49a0-41c9-991b-f42d16af67d1 => generated 1316 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:52:06.181389 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c9c77a54-1f13-4b64-a4db-f5835136c17c tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:06.182455 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c9c77a54-1f13-4b64-a4db-f5835136c17c tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: e983108d-66c6-472e-bfc1-761f8a333569] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:06.190213 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c9c77a54-1f13-4b64-a4db-f5835136c17c tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:06.190915 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c9c77a54-1f13-4b64-a4db-f5835136c17c tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:06.192402 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c9c77a54-1f13-4b64-a4db-f5835136c17c tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:06.193025 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c9c77a54-1f13-4b64-a4db-f5835136c17c tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:06.319633 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-c9c77a54-1f13-4b64-a4db-f5835136c17c tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:52:06.335029 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c9c77a54-1f13-4b64-a4db-f5835136c17c tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/e983108d-66c6-472e-bfc1-761f8a333569" status: 200 len: 1271 microversion: 2.1 time: 0.157323 Jan 15 20:52:06.336691 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 586/1223] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:52:06 2022] GET /compute/v2.1/servers/e983108d-66c6-472e-bfc1-761f8a333569 => generated 1271 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:52:06.341763 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8dab21b9-9646-4af5-ad29-dc583348a8c6 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:06.342764 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-8dab21b9-9646-4af5-ad29-dc583348a8c6 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] [instance: 067b97a2-ee1a-4d43-926c-11a8bfa2e332] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:06.351159 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8dab21b9-9646-4af5-ad29-dc583348a8c6 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:06.351761 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8dab21b9-9646-4af5-ad29-dc583348a8c6 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:06.352687 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8dab21b9-9646-4af5-ad29-dc583348a8c6 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:06.354231 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8dab21b9-9646-4af5-ad29-dc583348a8c6 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:06.579712 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.network.neutron [None req-b3d8b2cf-85af-47ee-a308-7add4dab5498 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] [instance: d45d5893-c22a-4b0c-ae7d-26e205a98643] Updating instance_info_cache with network_info: [{"id": "1ca16880-699b-4753-b30c-773b6af5f27f", "address": "fa:16:3e:b5:3d:95", "network": {"id": "d11eef3f-f6e5-43d1-bf0a-1a5337d2e062", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-167279773-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "f471d81a59824fc8afaf454a65e99933", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap1ca16880-69", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=129366) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jan 15 20:52:06.597796 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b3d8b2cf-85af-47ee-a308-7add4dab5498 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Releasing lock "refresh_cache-d45d5893-c22a-4b0c-ae7d-26e205a98643" {{(pid=129366) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jan 15 20:52:06.598912 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b3d8b2cf-85af-47ee-a308-7add4dab5498 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] 10.222.0.46 "POST /compute/v2.1/servers/d45d5893-c22a-4b0c-ae7d-26e205a98643/action" status: 202 len: 0 microversion: 2.1 time: 2.599018 Jan 15 20:52:06.599565 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 638/1224] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:52:03 2022] POST /compute/v2.1/servers/d45d5893-c22a-4b0c-ae7d-26e205a98643/action => generated 0 bytes in 2600 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jan 15 20:52:06.615062 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-82522ea3-d7fd-40e7-99dd-5104cfffa225 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:52:06.618185 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-82522ea3-d7fd-40e7-99dd-5104cfffa225 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 57bd310f-a604-40de-9c25-882284f4a17b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:06.634617 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-82522ea3-d7fd-40e7-99dd-5104cfffa225 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:06.635358 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-82522ea3-d7fd-40e7-99dd-5104cfffa225 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:06.637910 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-82522ea3-d7fd-40e7-99dd-5104cfffa225 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:06.638626 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-82522ea3-d7fd-40e7-99dd-5104cfffa225 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:06.714156 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-82522ea3-d7fd-40e7-99dd-5104cfffa225 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/action" status: 200 len: 24543 microversion: 2.1 time: 0.113119 Jan 15 20:52:06.714915 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 639/1225] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:52:06 2022] POST /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/action => generated 24543 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:52:06.723453 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d1a0d6fa-3ce4-474d-8052-dedbc3a1e196 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:06.723673 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-8dab21b9-9646-4af5-ad29-dc583348a8c6 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55be87ae7f14b499ab2cd6fc5538988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd217e7fd648b4a78c0c32ff1c95f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:52:06.735109 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-d1a0d6fa-3ce4-474d-8052-dedbc3a1e196 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] [instance: 2a53ed48-4f31-4c7d-9b10-39a8648314d2] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:06.741511 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-8dab21b9-9646-4af5-ad29-dc583348a8c6 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "GET /compute/v2.1/servers/067b97a2-ee1a-4d43-926c-11a8bfa2e332" status: 200 len: 1496 microversion: 2.1 time: 0.402591 Jan 15 20:52:06.744012 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d1a0d6fa-3ce4-474d-8052-dedbc3a1e196 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:06.744717 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d1a0d6fa-3ce4-474d-8052-dedbc3a1e196 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:06.745497 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 587/1226] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:52:06 2022] GET /compute/v2.1/servers/067b97a2-ee1a-4d43-926c-11a8bfa2e332 => generated 1496 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:52:06.746023 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d1a0d6fa-3ce4-474d-8052-dedbc3a1e196 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:06.746674 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d1a0d6fa-3ce4-474d-8052-dedbc3a1e196 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:06.766068 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-70a55188-2f89-47a0-8560-5cab183d6f8b tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:06.767209 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-70a55188-2f89-47a0-8560-5cab183d6f8b tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] [instance: 42618a48-fe11-4f55-bed2-738d2cc8a07f] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:06.779883 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-70a55188-2f89-47a0-8560-5cab183d6f8b tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:06.780619 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-70a55188-2f89-47a0-8560-5cab183d6f8b tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:06.781754 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-70a55188-2f89-47a0-8560-5cab183d6f8b tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:06.782511 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-70a55188-2f89-47a0-8560-5cab183d6f8b tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:06.834699 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-70a55188-2f89-47a0-8560-5cab183d6f8b tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] 10.222.0.46 "GET /compute/v2.1/servers/42618a48-fe11-4f55-bed2-738d2cc8a07f/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.088043 Jan 15 20:52:06.840946 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 588/1227] 10.222.0.46 () {60 vars in 1342 bytes} [Sat Jan 15 20:52:06 2022] GET /compute/v2.1/servers/42618a48-fe11-4f55-bed2-738d2cc8a07f/os-volume_attachments => generated 25 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:52:06.846913 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3ddcf801-1ef1-458d-9755-1c12e5df740e tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:06.848977 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-3ddcf801-1ef1-458d-9755-1c12e5df740e tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] [instance: b191ed6c-040a-4702-8e15-86272f9d1847] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:06.865845 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3ddcf801-1ef1-458d-9755-1c12e5df740e tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:06.866319 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3ddcf801-1ef1-458d-9755-1c12e5df740e tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:06.867161 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3ddcf801-1ef1-458d-9755-1c12e5df740e tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:06.867606 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3ddcf801-1ef1-458d-9755-1c12e5df740e tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:07.032403 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-d1a0d6fa-3ce4-474d-8052-dedbc3a1e196 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc38f86758f9416b9e7f6915de0359d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8cfe33be708428abef52f5e8e25621b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:52:07.046656 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d1a0d6fa-3ce4-474d-8052-dedbc3a1e196 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] 10.222.0.46 "GET /compute/v2.1/servers/2a53ed48-4f31-4c7d-9b10-39a8648314d2" status: 200 len: 1316 microversion: 2.1 time: 0.327240 Jan 15 20:52:07.047783 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 640/1228] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:52:06 2022] GET /compute/v2.1/servers/2a53ed48-4f31-4c7d-9b10-39a8648314d2 => generated 1316 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:52:07.052759 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-2cda689f-e832-4724-9155-896de13b6e50 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:07.058729 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-2cda689f-e832-4724-9155-896de13b6e50 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] [instance: d45d5893-c22a-4b0c-ae7d-26e205a98643] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:07.073616 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2cda689f-e832-4724-9155-896de13b6e50 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:07.074022 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2cda689f-e832-4724-9155-896de13b6e50 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:07.074814 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2cda689f-e832-4724-9155-896de13b6e50 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:07.075272 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2cda689f-e832-4724-9155-896de13b6e50 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:07.124437 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-2cda689f-e832-4724-9155-896de13b6e50 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] [instance: d45d5893-c22a-4b0c-ae7d-26e205a98643] Going to try to terminate instance {{(pid=129366) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 20:52:07.149070 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-3ddcf801-1ef1-458d-9755-1c12e5df740e tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d4a57cfaa145009ba9cc8f21d9e8ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4a26c8edac44c8b26fd4e43813412d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:52:07.161489 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3ddcf801-1ef1-458d-9755-1c12e5df740e tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] 10.222.0.46 "GET /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847" status: 200 len: 1478 microversion: 2.1 time: 0.317483 Jan 15 20:52:07.163569 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 589/1229] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:52:06 2022] GET /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847 => generated 1478 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:52:07.179629 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-41e3ab9f-d264-4d76-9939-521ff4f74efe req-5d9a9786-31ef-43f6-92e7-335654acec90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d45d5893-c22a-4b0c-ae7d-26e205a98643", "tag": "1ca16880-699b-4753-b30c-773b6af5f27f"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:52:07.182201 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:52:07.182201 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:52:07.194403 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-41e3ab9f-d264-4d76-9939-521ff4f74efe req-5d9a9786-31ef-43f6-92e7-335654acec90 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:07.194853 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-41e3ab9f-d264-4d76-9939-521ff4f74efe req-5d9a9786-31ef-43f6-92e7-335654acec90 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:07.210873 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-41e3ab9f-d264-4d76-9939-521ff4f74efe req-5d9a9786-31ef-43f6-92e7-335654acec90 service nova] Creating event network-changed:1ca16880-699b-4753-b30c-773b6af5f27f for instance d45d5893-c22a-4b0c-ae7d-26e205a98643 on nch2-master-1 Jan 15 20:52:07.217542 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-41e3ab9f-d264-4d76-9939-521ff4f74efe req-5d9a9786-31ef-43f6-92e7-335654acec90 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046654 Jan 15 20:52:07.222593 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 590/1230] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:52:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 20:52:07.231313 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c29e7b84-9e15-4d51-8a6b-bb9cb2723b97 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:07.233098 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c29e7b84-9e15-4d51-8a6b-bb9cb2723b97 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] [instance: 1d163f47-49a0-41c9-991b-f42d16af67d1] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:07.243355 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c29e7b84-9e15-4d51-8a6b-bb9cb2723b97 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:07.243947 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c29e7b84-9e15-4d51-8a6b-bb9cb2723b97 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:07.245240 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c29e7b84-9e15-4d51-8a6b-bb9cb2723b97 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:07.245744 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c29e7b84-9e15-4d51-8a6b-bb9cb2723b97 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:07.343691 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-2cda689f-e832-4724-9155-896de13b6e50 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] 10.222.0.46 "DELETE /compute/v2.1/servers/d45d5893-c22a-4b0c-ae7d-26e205a98643" status: 204 len: 0 microversion: 2.1 time: 0.293505 Jan 15 20:52:07.355137 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 641/1231] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 20:52:07 2022] DELETE /compute/v2.1/servers/d45d5893-c22a-4b0c-ae7d-26e205a98643 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 20:52:07.375705 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-d0e9045f-220e-412e-b306-cafd6cbd6ca2 req-0a77b606-a037-4e6a-8490-e23cb014e5f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d603f11b-5d49-492b-b541-1826486876ef", "name": "network-vif-plugged", "status": "completed", "tag": "29144689-f6e8-49ab-886d-3bedd21d555f"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:52:07.389915 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:52:07.389915 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:52:07.403113 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-d0e9045f-220e-412e-b306-cafd6cbd6ca2 req-0a77b606-a037-4e6a-8490-e23cb014e5f1 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:07.403543 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-d0e9045f-220e-412e-b306-cafd6cbd6ca2 req-0a77b606-a037-4e6a-8490-e23cb014e5f1 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:07.415923 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-d0e9045f-220e-412e-b306-cafd6cbd6ca2 req-0a77b606-a037-4e6a-8490-e23cb014e5f1 service nova] Creating event network-vif-plugged:29144689-f6e8-49ab-886d-3bedd21d555f for instance d603f11b-5d49-492b-b541-1826486876ef on nch1-master-1 Jan 15 20:52:07.422892 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-d0e9045f-220e-412e-b306-cafd6cbd6ca2 req-0a77b606-a037-4e6a-8490-e23cb014e5f1 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062088 Jan 15 20:52:07.424030 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 642/1232] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:52:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:52:07.430371 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-731a7522-0fb6-4d86-9e0a-2dab3a23431e tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:07.431210 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-731a7522-0fb6-4d86-9e0a-2dab3a23431e tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: e983108d-66c6-472e-bfc1-761f8a333569] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:07.438827 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-731a7522-0fb6-4d86-9e0a-2dab3a23431e tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:07.439504 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-731a7522-0fb6-4d86-9e0a-2dab3a23431e tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:07.441458 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-731a7522-0fb6-4d86-9e0a-2dab3a23431e tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:07.442054 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-731a7522-0fb6-4d86-9e0a-2dab3a23431e tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:07.612030 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-c29e7b84-9e15-4d51-8a6b-bb9cb2723b97 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3352815cdc914c15b656b4d0d9511010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7b489c290846f48384c65e977ed644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:52:07.621956 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c29e7b84-9e15-4d51-8a6b-bb9cb2723b97 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] 10.222.0.46 "GET /compute/v2.1/servers/1d163f47-49a0-41c9-991b-f42d16af67d1" status: 200 len: 1466 microversion: 2.1 time: 0.396806 Jan 15 20:52:07.628017 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 591/1233] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:52:07 2022] GET /compute/v2.1/servers/1d163f47-49a0-41c9-991b-f42d16af67d1 => generated 1466 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:52:07.644680 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ff066272-86ba-485d-acf2-73567cf7d17c tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.1.179"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:52:07.645880 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ff066272-86ba-485d-acf2-73567cf7d17c tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] [instance: b18c4fdc-6965-4c52-85f5-824ba94b4ad8] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:07.652276 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ff066272-86ba-485d-acf2-73567cf7d17c tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:07.652748 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ff066272-86ba-485d-acf2-73567cf7d17c tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:07.653681 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ff066272-86ba-485d-acf2-73567cf7d17c tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:07.654186 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ff066272-86ba-485d-acf2-73567cf7d17c tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:07.683384 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ff066272-86ba-485d-acf2-73567cf7d17c tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Acquired lock "refresh_cache-b18c4fdc-6965-4c52-85f5-824ba94b4ad8" {{(pid=129365) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jan 15 20:52:07.756214 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-731a7522-0fb6-4d86-9e0a-2dab3a23431e tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:52:07.767012 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-731a7522-0fb6-4d86-9e0a-2dab3a23431e tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/e983108d-66c6-472e-bfc1-761f8a333569" status: 200 len: 1313 microversion: 2.1 time: 0.342180 Jan 15 20:52:07.768131 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 643/1234] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:52:07 2022] GET /compute/v2.1/servers/e983108d-66c6-472e-bfc1-761f8a333569 => generated 1313 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:52:07.773022 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d38d9a7f-1dac-4ee7-955d-69cee662e204 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-1661727790", "metadata": {"image_type": "test"}}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:52:07.774186 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-d38d9a7f-1dac-4ee7-955d-69cee662e204 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] [instance: 1d163f47-49a0-41c9-991b-f42d16af67d1] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:07.793203 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d38d9a7f-1dac-4ee7-955d-69cee662e204 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:07.794237 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d38d9a7f-1dac-4ee7-955d-69cee662e204 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:07.795097 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d38d9a7f-1dac-4ee7-955d-69cee662e204 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:07.795731 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d38d9a7f-1dac-4ee7-955d-69cee662e204 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:07.856412 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-d38d9a7f-1dac-4ee7-955d-69cee662e204 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Getting quotas for project 9f7b489c290846f48384c65e977ed644. Resources: dict_keys(['metadata_items']) {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:52:07.862096 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-d38d9a7f-1dac-4ee7-955d-69cee662e204 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Getting quotas for user 3352815cdc914c15b656b4d0d9511010 and project 9f7b489c290846f48384c65e977ed644. Resources: dict_keys(['metadata_items']) {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:52:08.220636 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d38d9a7f-1dac-4ee7-955d-69cee662e204 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] 10.222.0.46 "POST /compute/v2.1/servers/1d163f47-49a0-41c9-991b-f42d16af67d1/action" status: 202 len: 0 microversion: 2.1 time: 0.450937 Jan 15 20:52:08.225137 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 644/1235] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:52:07 2022] POST /compute/v2.1/servers/1d163f47-49a0-41c9-991b-f42d16af67d1/action => generated 0 bytes in 455 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jan 15 20:52:08.241444 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-5053584f-c17d-4ab2-b4a7-5dfbc03b7319 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:52:08.243623 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-5053584f-c17d-4ab2-b4a7-5dfbc03b7319 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 57bd310f-a604-40de-9c25-882284f4a17b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:08.258042 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5053584f-c17d-4ab2-b4a7-5dfbc03b7319 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:08.258515 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5053584f-c17d-4ab2-b4a7-5dfbc03b7319 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:08.259321 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5053584f-c17d-4ab2-b4a7-5dfbc03b7319 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:08.259761 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5053584f-c17d-4ab2-b4a7-5dfbc03b7319 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:08.330094 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-5053584f-c17d-4ab2-b4a7-5dfbc03b7319 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/action" status: 200 len: 24543 microversion: 2.1 time: 0.103285 Jan 15 20:52:08.330921 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 645/1236] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:52:08 2022] POST /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/action => generated 24543 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:52:08.342094 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ea34b3de-76a0-49a7-abf5-48596513a93a tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:08.345807 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ea34b3de-76a0-49a7-abf5-48596513a93a tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] [instance: 067b97a2-ee1a-4d43-926c-11a8bfa2e332] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:08.362625 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ea34b3de-76a0-49a7-abf5-48596513a93a tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:08.362801 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ea34b3de-76a0-49a7-abf5-48596513a93a tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:08.363718 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ea34b3de-76a0-49a7-abf5-48596513a93a tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:08.367916 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ea34b3de-76a0-49a7-abf5-48596513a93a tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:08.720122 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-ea34b3de-76a0-49a7-abf5-48596513a93a tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55be87ae7f14b499ab2cd6fc5538988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd217e7fd648b4a78c0c32ff1c95f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:52:08.731202 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ea34b3de-76a0-49a7-abf5-48596513a93a tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "GET /compute/v2.1/servers/067b97a2-ee1a-4d43-926c-11a8bfa2e332" status: 200 len: 1473 microversion: 2.1 time: 0.397254 Jan 15 20:52:08.731792 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 646/1237] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:52:08 2022] GET /compute/v2.1/servers/067b97a2-ee1a-4d43-926c-11a8bfa2e332 => generated 1473 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:52:08.737733 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d9f8ab31-a1c1-4f2d-9e7e-cf37cf2d86c5 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:08.739328 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-d9f8ab31-a1c1-4f2d-9e7e-cf37cf2d86c5 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] [instance: 2a53ed48-4f31-4c7d-9b10-39a8648314d2] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:08.746469 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d9f8ab31-a1c1-4f2d-9e7e-cf37cf2d86c5 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:08.747136 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d9f8ab31-a1c1-4f2d-9e7e-cf37cf2d86c5 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:08.748424 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d9f8ab31-a1c1-4f2d-9e7e-cf37cf2d86c5 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:08.749274 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d9f8ab31-a1c1-4f2d-9e7e-cf37cf2d86c5 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:09.053491 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-d9f8ab31-a1c1-4f2d-9e7e-cf37cf2d86c5 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc38f86758f9416b9e7f6915de0359d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8cfe33be708428abef52f5e8e25621b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:52:09.061311 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d9f8ab31-a1c1-4f2d-9e7e-cf37cf2d86c5 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] 10.222.0.46 "GET /compute/v2.1/servers/2a53ed48-4f31-4c7d-9b10-39a8648314d2" status: 200 len: 1465 microversion: 2.1 time: 0.328165 Jan 15 20:52:09.062254 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 647/1238] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:52:08 2022] GET /compute/v2.1/servers/2a53ed48-4f31-4c7d-9b10-39a8648314d2 => generated 1465 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:52:09.066889 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-fc5d2eb5-073a-4a8b-9ad6-3d4c82e4f762 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:09.067911 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-fc5d2eb5-073a-4a8b-9ad6-3d4c82e4f762 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] [instance: b191ed6c-040a-4702-8e15-86272f9d1847] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:09.074556 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fc5d2eb5-073a-4a8b-9ad6-3d4c82e4f762 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:09.075443 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fc5d2eb5-073a-4a8b-9ad6-3d4c82e4f762 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:09.076737 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fc5d2eb5-073a-4a8b-9ad6-3d4c82e4f762 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:09.077583 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fc5d2eb5-073a-4a8b-9ad6-3d4c82e4f762 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:09.326040 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-fc5d2eb5-073a-4a8b-9ad6-3d4c82e4f762 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d4a57cfaa145009ba9cc8f21d9e8ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4a26c8edac44c8b26fd4e43813412d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:52:09.336285 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-fc5d2eb5-073a-4a8b-9ad6-3d4c82e4f762 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] 10.222.0.46 "GET /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847" status: 200 len: 1478 microversion: 2.1 time: 0.272724 Jan 15 20:52:09.336992 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 648/1239] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:52:09 2022] GET /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847 => generated 1478 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:52:09.343030 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-19290d5a-c6ab-417c-bef2-6380f9e62f32 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Calling method '.version_select at 0x7f30c9686430>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:09.419055 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-19290d5a-c6ab-417c-bef2-6380f9e62f32 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] 10.222.0.46 "GET /compute/v2.1/images/3ce24e4a-9608-4d9f-919f-c52be69dac7b" status: 200 len: 1422 microversion: 2.1 time: 0.080451 Jan 15 20:52:09.420107 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 649/1240] 10.222.0.46 () {58 vars in 1232 bytes} [Sat Jan 15 20:52:09 2022] GET /compute/v2.1/images/3ce24e4a-9608-4d9f-919f-c52be69dac7b => generated 1422 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:52:09.429971 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-7889d419-a0ab-470a-836a-ff591bdc6991 req-c055fd5c-dbb9-4a0a-94d5-5fecc9a92897 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e983108d-66c6-472e-bfc1-761f8a333569", "tag": "5d3688c4-ca00-4b8e-9475-e69603c54112"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:52:09.431053 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:52:09.431053 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:52:09.449969 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-7889d419-a0ab-470a-836a-ff591bdc6991 req-c055fd5c-dbb9-4a0a-94d5-5fecc9a92897 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:09.450505 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-7889d419-a0ab-470a-836a-ff591bdc6991 req-c055fd5c-dbb9-4a0a-94d5-5fecc9a92897 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:09.464046 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-7889d419-a0ab-470a-836a-ff591bdc6991 req-c055fd5c-dbb9-4a0a-94d5-5fecc9a92897 service nova] Creating event network-changed:5d3688c4-ca00-4b8e-9475-e69603c54112 for instance e983108d-66c6-472e-bfc1-761f8a333569 on nch1-master-1 Jan 15 20:52:09.469636 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-7889d419-a0ab-470a-836a-ff591bdc6991 req-c055fd5c-dbb9-4a0a-94d5-5fecc9a92897 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048608 Jan 15 20:52:09.470860 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 650/1241] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:52:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:52:09.485156 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-765b65cc-9bc5-4084-84d8-13324bea757f tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1901500249"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:52:09.486428 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-765b65cc-9bc5-4084-84d8-13324bea757f tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] [instance: 067b97a2-ee1a-4d43-926c-11a8bfa2e332] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:09.495853 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-765b65cc-9bc5-4084-84d8-13324bea757f tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:09.496571 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-765b65cc-9bc5-4084-84d8-13324bea757f tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:09.497567 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-765b65cc-9bc5-4084-84d8-13324bea757f tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:09.498180 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-765b65cc-9bc5-4084-84d8-13324bea757f tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:09.588295 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.network.neutron [None req-ff066272-86ba-485d-acf2-73567cf7d17c tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] [instance: b18c4fdc-6965-4c52-85f5-824ba94b4ad8] Building network info cache for instance {{(pid=129365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1883}} Jan 15 20:52:09.965045 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-765b65cc-9bc5-4084-84d8-13324bea757f tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "POST /compute/v2.1/servers/067b97a2-ee1a-4d43-926c-11a8bfa2e332/action" status: 202 len: 0 microversion: 2.1 time: 0.489505 Jan 15 20:52:09.978421 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 651/1242] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:52:09 2022] POST /compute/v2.1/servers/067b97a2-ee1a-4d43-926c-11a8bfa2e332/action => generated 0 bytes in 506 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jan 15 20:52:09.988585 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-491785ef-9f39-4860-b0eb-bcbed67d4e53 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:09.989553 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-491785ef-9f39-4860-b0eb-bcbed67d4e53 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: e983108d-66c6-472e-bfc1-761f8a333569] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:09.997629 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-491785ef-9f39-4860-b0eb-bcbed67d4e53 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:09.998124 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-491785ef-9f39-4860-b0eb-bcbed67d4e53 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:09.998939 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-491785ef-9f39-4860-b0eb-bcbed67d4e53 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:09.999380 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-491785ef-9f39-4860-b0eb-bcbed67d4e53 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:10.459089 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-491785ef-9f39-4860-b0eb-bcbed67d4e53 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:52:10.471083 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-491785ef-9f39-4860-b0eb-bcbed67d4e53 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/e983108d-66c6-472e-bfc1-761f8a333569" status: 200 len: 1313 microversion: 2.1 time: 0.490429 Jan 15 20:52:10.471908 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 652/1243] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:52:09 2022] GET /compute/v2.1/servers/e983108d-66c6-472e-bfc1-761f8a333569 => generated 1313 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:52:10.494000 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-efd19683-92a2-4986-a332-455937afbc87 tempest-ServersOnMultiNodesTest-1194618714 tempest-ServersOnMultiNodesTest-1194618714-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:10.505871 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-efd19683-92a2-4986-a332-455937afbc87 tempest-ServersOnMultiNodesTest-1194618714 tempest-ServersOnMultiNodesTest-1194618714-project-admin] [instance: 2a53ed48-4f31-4c7d-9b10-39a8648314d2] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:10.523089 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-efd19683-92a2-4986-a332-455937afbc87 tempest-ServersOnMultiNodesTest-1194618714 tempest-ServersOnMultiNodesTest-1194618714-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:10.527246 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-efd19683-92a2-4986-a332-455937afbc87 tempest-ServersOnMultiNodesTest-1194618714 tempest-ServersOnMultiNodesTest-1194618714-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:10.528284 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-efd19683-92a2-4986-a332-455937afbc87 tempest-ServersOnMultiNodesTest-1194618714 tempest-ServersOnMultiNodesTest-1194618714-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:10.529360 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-efd19683-92a2-4986-a332-455937afbc87 tempest-ServersOnMultiNodesTest-1194618714 tempest-ServersOnMultiNodesTest-1194618714-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:10.743741 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.network.neutron [None req-ff066272-86ba-485d-acf2-73567cf7d17c tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] [instance: b18c4fdc-6965-4c52-85f5-824ba94b4ad8] Updating instance_info_cache with network_info: [{"id": "37191f5f-92f4-4372-9435-1f2eddb92f24", "address": "fa:16:3e:b6:e4:fe", "network": {"id": "d11eef3f-f6e5-43d1-bf0a-1a5337d2e062", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-167279773-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.1.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "f471d81a59824fc8afaf454a65e99933", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap37191f5f-92", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=129365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jan 15 20:52:10.761514 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ff066272-86ba-485d-acf2-73567cf7d17c tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Releasing lock "refresh_cache-b18c4fdc-6965-4c52-85f5-824ba94b4ad8" {{(pid=129365) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jan 15 20:52:10.762425 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ff066272-86ba-485d-acf2-73567cf7d17c tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] 10.222.0.46 "POST /compute/v2.1/servers/b18c4fdc-6965-4c52-85f5-824ba94b4ad8/action" status: 202 len: 0 microversion: 2.1 time: 3.121898 Jan 15 20:52:10.763401 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 592/1244] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:52:07 2022] POST /compute/v2.1/servers/b18c4fdc-6965-4c52-85f5-824ba94b4ad8/action => generated 0 bytes in 3135 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jan 15 20:52:10.768868 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-7ecb1d97-34f2-432c-a8c8-5d80939c0205 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:52:10.772881 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-7ecb1d97-34f2-432c-a8c8-5d80939c0205 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 57bd310f-a604-40de-9c25-882284f4a17b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:10.801353 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7ecb1d97-34f2-432c-a8c8-5d80939c0205 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:10.801824 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7ecb1d97-34f2-432c-a8c8-5d80939c0205 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:10.802660 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7ecb1d97-34f2-432c-a8c8-5d80939c0205 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:10.803105 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7ecb1d97-34f2-432c-a8c8-5d80939c0205 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:10.803304 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-efd19683-92a2-4986-a332-455937afbc87 tempest-ServersOnMultiNodesTest-1194618714 tempest-ServersOnMultiNodesTest-1194618714-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/2a53ed48-4f31-4c7d-9b10-39a8648314d2" status: 200 len: 1616 microversion: 2.1 time: 0.312984 Jan 15 20:52:10.818462 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 653/1245] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:52:10 2022] GET /compute/v2.1/servers/2a53ed48-4f31-4c7d-9b10-39a8648314d2 => generated 1616 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:52:10.823128 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-5169acbe-6af5-4bc3-9310-338230ee566e req-ed135814-a8d9-4885-bc6c-4a0256426ece service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b18c4fdc-6965-4c52-85f5-824ba94b4ad8", "tag": "37191f5f-92f4-4372-9435-1f2eddb92f24"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:52:10.825391 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:52:10.825391 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:52:10.837517 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-5169acbe-6af5-4bc3-9310-338230ee566e req-ed135814-a8d9-4885-bc6c-4a0256426ece service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:10.838303 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-5169acbe-6af5-4bc3-9310-338230ee566e req-ed135814-a8d9-4885-bc6c-4a0256426ece service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:10.853115 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-5169acbe-6af5-4bc3-9310-338230ee566e req-ed135814-a8d9-4885-bc6c-4a0256426ece service nova] Creating event network-changed:37191f5f-92f4-4372-9435-1f2eddb92f24 for instance b18c4fdc-6965-4c52-85f5-824ba94b4ad8 on nch1-master-1 Jan 15 20:52:10.860019 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-5169acbe-6af5-4bc3-9310-338230ee566e req-ed135814-a8d9-4885-bc6c-4a0256426ece service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040084 Jan 15 20:52:10.865604 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 654/1246] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:52:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:52:10.877870 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a4ed44da-2482-4a39-a48a-c167caadbbdf tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '.version_select at 0x7f30c8effdc0>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:10.895986 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-7ecb1d97-34f2-432c-a8c8-5d80939c0205 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/action" status: 200 len: 24543 microversion: 2.1 time: 0.130950 Jan 15 20:52:10.896661 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 593/1247] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:52:10 2022] POST /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/action => generated 24543 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:52:10.909220 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3698496c-7175-41a4-bef4-ad49166671ac tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:10.913244 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-3698496c-7175-41a4-bef4-ad49166671ac tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] [instance: b191ed6c-040a-4702-8e15-86272f9d1847] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:10.928830 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3698496c-7175-41a4-bef4-ad49166671ac tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:10.933180 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3698496c-7175-41a4-bef4-ad49166671ac tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:10.934894 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3698496c-7175-41a4-bef4-ad49166671ac tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:10.937157 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3698496c-7175-41a4-bef4-ad49166671ac tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:10.958339 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a4ed44da-2482-4a39-a48a-c167caadbbdf tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "GET /compute/v2.1/images/02c98032-11ad-4694-be3b-e856797c5802" status: 200 len: 1414 microversion: 2.1 time: 0.091210 Jan 15 20:52:10.966079 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 655/1248] 10.222.0.46 () {58 vars in 1232 bytes} [Sat Jan 15 20:52:10 2022] GET /compute/v2.1/images/02c98032-11ad-4694-be3b-e856797c5802 => generated 1414 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:52:10.980897 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f6ead239-3d97-4bda-8ea5-2bb7bb2e052e tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Calling method '.version_select at 0x7f30c90e1c10>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:11.066397 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f6ead239-3d97-4bda-8ea5-2bb7bb2e052e tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] 10.222.0.46 "GET /compute/v2.1/images/3ce24e4a-9608-4d9f-919f-c52be69dac7b" status: 200 len: 1422 microversion: 2.1 time: 0.095542 Jan 15 20:52:11.072547 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 656/1249] 10.222.0.46 () {58 vars in 1232 bytes} [Sat Jan 15 20:52:10 2022] GET /compute/v2.1/images/3ce24e4a-9608-4d9f-919f-c52be69dac7b => generated 1422 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:52:11.080752 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-ad830e9a-bb57-4965-923b-d2500a9e4747 req-b3e1a399-0cfd-4a4d-b639-d6b51b3795d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b191ed6c-040a-4702-8e15-86272f9d1847", "name": "network-vif-unplugged", "status": "completed", "tag": "bbe8394e-08fc-445b-a162-0e40259702ca"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:52:11.086726 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:52:11.086726 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:52:11.105412 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-ad830e9a-bb57-4965-923b-d2500a9e4747 req-b3e1a399-0cfd-4a4d-b639-d6b51b3795d2 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:11.106006 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-ad830e9a-bb57-4965-923b-d2500a9e4747 req-b3e1a399-0cfd-4a4d-b639-d6b51b3795d2 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:11.154251 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-ad830e9a-bb57-4965-923b-d2500a9e4747 req-b3e1a399-0cfd-4a4d-b639-d6b51b3795d2 service nova] Creating event network-vif-unplugged:bbe8394e-08fc-445b-a162-0e40259702ca for instance b191ed6c-040a-4702-8e15-86272f9d1847 on nch2-master-1 Jan 15 20:52:11.162924 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-ad830e9a-bb57-4965-923b-d2500a9e4747 req-b3e1a399-0cfd-4a4d-b639-d6b51b3795d2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.088658 Jan 15 20:52:11.163753 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 657/1250] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:52:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:52:11.179410 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-66723395-938e-45fe-af43-7a4c7e7e97b7 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Calling method '.version_select at 0x7f30c9032550>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:11.572960 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-3698496c-7175-41a4-bef4-ad49166671ac tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d4a57cfaa145009ba9cc8f21d9e8ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4a26c8edac44c8b26fd4e43813412d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:52:11.595059 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3698496c-7175-41a4-bef4-ad49166671ac tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] 10.222.0.46 "GET /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847" status: 200 len: 1478 microversion: 2.1 time: 0.694285 Jan 15 20:52:11.599145 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 594/1251] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:52:10 2022] GET /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847 => generated 1478 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:52:11.610535 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-6e54c24d-b4e8-4219-859f-7fab0308deb6 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:11.611451 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-6e54c24d-b4e8-4219-859f-7fab0308deb6 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] [instance: 2a53ed48-4f31-4c7d-9b10-39a8648314d2] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:11.624885 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6e54c24d-b4e8-4219-859f-7fab0308deb6 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:11.624885 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6e54c24d-b4e8-4219-859f-7fab0308deb6 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:11.624885 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6e54c24d-b4e8-4219-859f-7fab0308deb6 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:11.624885 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6e54c24d-b4e8-4219-859f-7fab0308deb6 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:11.718468 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-6e54c24d-b4e8-4219-859f-7fab0308deb6 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] [instance: 2a53ed48-4f31-4c7d-9b10-39a8648314d2] Going to try to terminate instance {{(pid=129365) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 20:52:11.861280 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-66723395-938e-45fe-af43-7a4c7e7e97b7 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] 10.222.0.46 "GET /compute/v2.1/os-floating-ips/18f33b3a-5d73-4e19-ae06-90827362a4d4" status: 200 len: 185 microversion: 2.1 time: 0.696116 Jan 15 20:52:11.862299 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 658/1252] 10.222.0.46 () {58 vars in 1259 bytes} [Sat Jan 15 20:52:11 2022] GET /compute/v2.1/os-floating-ips/18f33b3a-5d73-4e19-ae06-90827362a4d4 => generated 185 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:52:11.867527 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0d70003e-0163-4ccb-b56a-faf1061d325b tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:11.868321 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-0d70003e-0163-4ccb-b56a-faf1061d325b tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: e983108d-66c6-472e-bfc1-761f8a333569] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:11.883027 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0d70003e-0163-4ccb-b56a-faf1061d325b tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:11.886226 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0d70003e-0163-4ccb-b56a-faf1061d325b tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:11.890609 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0d70003e-0163-4ccb-b56a-faf1061d325b tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:11.891286 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0d70003e-0163-4ccb-b56a-faf1061d325b tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:11.908302 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-6e54c24d-b4e8-4219-859f-7fab0308deb6 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] 10.222.0.46 "DELETE /compute/v2.1/servers/2a53ed48-4f31-4c7d-9b10-39a8648314d2" status: 204 len: 0 microversion: 2.1 time: 0.306893 Jan 15 20:52:11.909315 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 595/1253] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 20:52:11 2022] DELETE /compute/v2.1/servers/2a53ed48-4f31-4c7d-9b10-39a8648314d2 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 20:52:11.915519 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-ba04bbf8-04a2-4fc6-9f71-0cffe3c7efab req-6e8bb4cf-ab47-43ca-9f63-6c1bb805f07d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d45d5893-c22a-4b0c-ae7d-26e205a98643", "name": "network-vif-deleted", "tag": "1ca16880-699b-4753-b30c-773b6af5f27f"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:52:11.917296 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:52:11.917296 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:52:11.925211 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-ba04bbf8-04a2-4fc6-9f71-0cffe3c7efab req-6e8bb4cf-ab47-43ca-9f63-6c1bb805f07d service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:11.926783 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-ba04bbf8-04a2-4fc6-9f71-0cffe3c7efab req-6e8bb4cf-ab47-43ca-9f63-6c1bb805f07d service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:11.943470 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-ba04bbf8-04a2-4fc6-9f71-0cffe3c7efab req-6e8bb4cf-ab47-43ca-9f63-6c1bb805f07d service nova] Creating event network-vif-deleted:1ca16880-699b-4753-b30c-773b6af5f27f for instance d45d5893-c22a-4b0c-ae7d-26e205a98643 on nch2-master-1 Jan 15 20:52:11.952771 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-ba04bbf8-04a2-4fc6-9f71-0cffe3c7efab req-6e8bb4cf-ab47-43ca-9f63-6c1bb805f07d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039361 Jan 15 20:52:11.955995 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 596/1254] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:52:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:52:11.975799 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ca3fc623-646d-4523-8ae4-45731336d45b tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.1.179"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:52:12.180773 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-0d70003e-0163-4ccb-b56a-faf1061d325b tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:52:12.194403 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0d70003e-0163-4ccb-b56a-faf1061d325b tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/e983108d-66c6-472e-bfc1-761f8a333569" status: 200 len: 1313 microversion: 2.1 time: 0.331008 Jan 15 20:52:12.195601 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 659/1255] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:52:11 2022] GET /compute/v2.1/servers/e983108d-66c6-472e-bfc1-761f8a333569 => generated 1313 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:52:12.202691 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9a9f3e8c-71c6-44d0-ae39-777b2c8968d4 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:52:12.205132 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-9a9f3e8c-71c6-44d0-ae39-777b2c8968d4 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 57bd310f-a604-40de-9c25-882284f4a17b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:12.210393 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ca3fc623-646d-4523-8ae4-45731336d45b tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] [instance: b18c4fdc-6965-4c52-85f5-824ba94b4ad8] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:12.214522 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9a9f3e8c-71c6-44d0-ae39-777b2c8968d4 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:12.215194 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9a9f3e8c-71c6-44d0-ae39-777b2c8968d4 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:12.216576 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ca3fc623-646d-4523-8ae4-45731336d45b tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:12.216885 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9a9f3e8c-71c6-44d0-ae39-777b2c8968d4 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:12.217318 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ca3fc623-646d-4523-8ae4-45731336d45b tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:12.218105 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ca3fc623-646d-4523-8ae4-45731336d45b tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:12.218448 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9a9f3e8c-71c6-44d0-ae39-777b2c8968d4 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:12.218582 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ca3fc623-646d-4523-8ae4-45731336d45b tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:12.291153 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-9a9f3e8c-71c6-44d0-ae39-777b2c8968d4 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/action" status: 200 len: 24543 microversion: 2.1 time: 0.094068 Jan 15 20:52:12.291811 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 660/1256] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:52:12 2022] POST /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/action => generated 24543 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:52:12.303752 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-80224420-3d10-4795-9d59-e717eaba6be9 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:12.304597 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-80224420-3d10-4795-9d59-e717eaba6be9 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] [instance: 2a53ed48-4f31-4c7d-9b10-39a8648314d2] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:12.319425 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-80224420-3d10-4795-9d59-e717eaba6be9 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:12.320220 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-80224420-3d10-4795-9d59-e717eaba6be9 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:12.321270 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-80224420-3d10-4795-9d59-e717eaba6be9 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:12.322168 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-80224420-3d10-4795-9d59-e717eaba6be9 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:12.608131 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ca3fc623-646d-4523-8ae4-45731336d45b tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Acquired lock "refresh_cache-b18c4fdc-6965-4c52-85f5-824ba94b4ad8" {{(pid=129365) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jan 15 20:52:12.717758 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-80224420-3d10-4795-9d59-e717eaba6be9 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc38f86758f9416b9e7f6915de0359d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8cfe33be708428abef52f5e8e25621b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:52:12.732971 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-80224420-3d10-4795-9d59-e717eaba6be9 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] 10.222.0.46 "GET /compute/v2.1/servers/2a53ed48-4f31-4c7d-9b10-39a8648314d2" status: 200 len: 1471 microversion: 2.1 time: 0.438306 Jan 15 20:52:12.734359 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 661/1257] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:52:12 2022] GET /compute/v2.1/servers/2a53ed48-4f31-4c7d-9b10-39a8648314d2 => generated 1471 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:52:12.740365 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4c515eb1-cec9-4559-9b6a-ecec87cb2dbc tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '.version_select at 0x7f30c9040ca0>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:13.893937 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.network.neutron [None req-ca3fc623-646d-4523-8ae4-45731336d45b tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] [instance: b18c4fdc-6965-4c52-85f5-824ba94b4ad8] Building network info cache for instance {{(pid=129365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1883}} Jan 15 20:52:14.928742 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.network.neutron [None req-ca3fc623-646d-4523-8ae4-45731336d45b tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] [instance: b18c4fdc-6965-4c52-85f5-824ba94b4ad8] Updating instance_info_cache with network_info: [{"id": "37191f5f-92f4-4372-9435-1f2eddb92f24", "address": "fa:16:3e:b6:e4:fe", "network": {"id": "d11eef3f-f6e5-43d1-bf0a-1a5337d2e062", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-167279773-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "f471d81a59824fc8afaf454a65e99933", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap37191f5f-92", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=129365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jan 15 20:52:14.943871 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ca3fc623-646d-4523-8ae4-45731336d45b tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Releasing lock "refresh_cache-b18c4fdc-6965-4c52-85f5-824ba94b4ad8" {{(pid=129365) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jan 15 20:52:14.945166 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ca3fc623-646d-4523-8ae4-45731336d45b tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] 10.222.0.46 "POST /compute/v2.1/servers/b18c4fdc-6965-4c52-85f5-824ba94b4ad8/action" status: 202 len: 0 microversion: 2.1 time: 2.985960 Jan 15 20:52:14.946293 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 597/1258] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:52:11 2022] POST /compute/v2.1/servers/b18c4fdc-6965-4c52-85f5-824ba94b4ad8/action => generated 0 bytes in 2990 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jan 15 20:52:14.950974 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-649ff733-7d96-4151-97ac-e27e948cab22 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Calling method '.version_select at 0x7f30c8d1ef70>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:23.323956 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-4c515eb1-cec9-4559-9b6a-ecec87cb2dbc tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "GET /compute/v2.1/images/02c98032-11ad-4694-be3b-e856797c5802" status: 200 len: 1414 microversion: 2.1 time: 10.588003 Jan 15 20:52:23.325280 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 662/1259] 10.222.0.46 () {58 vars in 1232 bytes} [Sat Jan 15 20:52:12 2022] GET /compute/v2.1/images/02c98032-11ad-4694-be3b-e856797c5802 => generated 1414 bytes in 10590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:52:23.330120 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e27ac722-8980-4f5a-b824-65233e5db2ef tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:23.340121 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e27ac722-8980-4f5a-b824-65233e5db2ef tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] [instance: b191ed6c-040a-4702-8e15-86272f9d1847] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:23.348026 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-649ff733-7d96-4151-97ac-e27e948cab22 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] 10.222.0.46 "GET /compute/v2.1/images/3ce24e4a-9608-4d9f-919f-c52be69dac7b" status: 200 len: 1422 microversion: 2.1 time: 8.400383 Jan 15 20:52:23.351759 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e27ac722-8980-4f5a-b824-65233e5db2ef tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:23.353008 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e27ac722-8980-4f5a-b824-65233e5db2ef tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:23.354002 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e27ac722-8980-4f5a-b824-65233e5db2ef tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:23.355180 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e27ac722-8980-4f5a-b824-65233e5db2ef tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:23.359945 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 598/1260] 10.222.0.46 () {58 vars in 1232 bytes} [Sat Jan 15 20:52:14 2022] GET /compute/v2.1/images/3ce24e4a-9608-4d9f-919f-c52be69dac7b => generated 1422 bytes in 8413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:52:23.365538 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-84414a6e-8110-4c6b-aa5a-b702a979bcda tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:23.366348 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-84414a6e-8110-4c6b-aa5a-b702a979bcda tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: e983108d-66c6-472e-bfc1-761f8a333569] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:23.376267 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-84414a6e-8110-4c6b-aa5a-b702a979bcda tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:23.376719 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-84414a6e-8110-4c6b-aa5a-b702a979bcda tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:23.377706 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-84414a6e-8110-4c6b-aa5a-b702a979bcda tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:23.378499 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-84414a6e-8110-4c6b-aa5a-b702a979bcda tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:23.592406 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-84414a6e-8110-4c6b-aa5a-b702a979bcda tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:52:23.613169 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-84414a6e-8110-4c6b-aa5a-b702a979bcda tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/e983108d-66c6-472e-bfc1-761f8a333569" status: 200 len: 1313 microversion: 2.1 time: 0.251158 Jan 15 20:52:23.617204 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 599/1261] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:52:23 2022] GET /compute/v2.1/servers/e983108d-66c6-472e-bfc1-761f8a333569 => generated 1313 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:52:23.617728 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-e27ac722-8980-4f5a-b824-65233e5db2ef tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d4a57cfaa145009ba9cc8f21d9e8ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4a26c8edac44c8b26fd4e43813412d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:52:23.622492 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e3000cd9-6856-475c-b2cb-a2cf4378c1ab tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:52:23.623485 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e3000cd9-6856-475c-b2cb-a2cf4378c1ab tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 57bd310f-a604-40de-9c25-882284f4a17b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:23.629905 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e27ac722-8980-4f5a-b824-65233e5db2ef tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] 10.222.0.46 "GET /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847" status: 200 len: 1478 microversion: 2.1 time: 0.300399 Jan 15 20:52:23.630755 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 663/1262] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:52:23 2022] GET /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847 => generated 1478 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:52:23.631280 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e3000cd9-6856-475c-b2cb-a2cf4378c1ab tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:23.631808 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e3000cd9-6856-475c-b2cb-a2cf4378c1ab tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:23.632609 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e3000cd9-6856-475c-b2cb-a2cf4378c1ab tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:23.633239 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e3000cd9-6856-475c-b2cb-a2cf4378c1ab tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:23.641208 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-83ec523c-4683-4a66-a3d5-7ebd4040f62a tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:23.643420 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-83ec523c-4683-4a66-a3d5-7ebd4040f62a tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] [instance: 2a53ed48-4f31-4c7d-9b10-39a8648314d2] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:23.657657 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-83ec523c-4683-4a66-a3d5-7ebd4040f62a tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:23.660931 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-83ec523c-4683-4a66-a3d5-7ebd4040f62a tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:23.662164 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-83ec523c-4683-4a66-a3d5-7ebd4040f62a tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:23.664617 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-83ec523c-4683-4a66-a3d5-7ebd4040f62a tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:23.686304 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-83ec523c-4683-4a66-a3d5-7ebd4040f62a tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] HTTP exception thrown: Instance 2a53ed48-4f31-4c7d-9b10-39a8648314d2 could not be found. Jan 15 20:52:23.686901 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-83ec523c-4683-4a66-a3d5-7ebd4040f62a tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Returning 404 to user: Instance 2a53ed48-4f31-4c7d-9b10-39a8648314d2 could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:52:23.689657 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-83ec523c-4683-4a66-a3d5-7ebd4040f62a tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] 10.222.0.46 "GET /compute/v2.1/servers/2a53ed48-4f31-4c7d-9b10-39a8648314d2" status: 404 len: 111 microversion: 2.1 time: 0.056810 Jan 15 20:52:23.690360 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 664/1263] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:52:23 2022] GET /compute/v2.1/servers/2a53ed48-4f31-4c7d-9b10-39a8648314d2 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:52:23.696870 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-c042c46c-0296-4a79-947d-527dc31d5341 req-31a20391-57c9-4232-a60e-a1a048a4695b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b18c4fdc-6965-4c52-85f5-824ba94b4ad8", "tag": "37191f5f-92f4-4372-9435-1f2eddb92f24"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:52:23.698526 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:52:23.698526 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:52:23.706227 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e3000cd9-6856-475c-b2cb-a2cf4378c1ab tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/action" status: 200 len: 32621 microversion: 2.1 time: 0.087629 Jan 15 20:52:23.707926 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 600/1264] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:52:23 2022] POST /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/action => generated 32621 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:52:23.708699 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-c042c46c-0296-4a79-947d-527dc31d5341 req-31a20391-57c9-4232-a60e-a1a048a4695b service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:23.709239 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-c042c46c-0296-4a79-947d-527dc31d5341 req-31a20391-57c9-4232-a60e-a1a048a4695b service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:23.713770 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-c249c310-4d6a-4285-983b-d8164a69a896 req-e4a2a5c7-4fa9-4c92-808d-ddfe7a394449 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a53ed48-4f31-4c7d-9b10-39a8648314d2", "name": "network-vif-deleted", "tag": "be26730f-1c78-49d2-b708-69a94845942e"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:52:23.715498 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:52:23.715498 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:52:23.722473 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-c042c46c-0296-4a79-947d-527dc31d5341 req-31a20391-57c9-4232-a60e-a1a048a4695b service nova] Creating event network-changed:37191f5f-92f4-4372-9435-1f2eddb92f24 for instance b18c4fdc-6965-4c52-85f5-824ba94b4ad8 on nch1-master-1 Jan 15 20:52:23.724495 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-c249c310-4d6a-4285-983b-d8164a69a896 req-e4a2a5c7-4fa9-4c92-808d-ddfe7a394449 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:23.725037 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-c249c310-4d6a-4285-983b-d8164a69a896 req-e4a2a5c7-4fa9-4c92-808d-ddfe7a394449 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:23.728599 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-c042c46c-0296-4a79-947d-527dc31d5341 req-31a20391-57c9-4232-a60e-a1a048a4695b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035985 Jan 15 20:52:23.730769 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 665/1265] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:52:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:52:23.737055 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-f502a449-4cbc-403e-8231-cd3cffa398a2 req-1e4de87a-4569-40ed-9464-cd89115963e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "067b97a2-ee1a-4d43-926c-11a8bfa2e332", "name": "network-vif-plugged", "status": "completed", "tag": "2dedf195-b886-49e9-99b8-57405251268c"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:52:23.738470 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-c249c310-4d6a-4285-983b-d8164a69a896 req-e4a2a5c7-4fa9-4c92-808d-ddfe7a394449 service nova] Creating event network-vif-deleted:be26730f-1c78-49d2-b708-69a94845942e for instance 2a53ed48-4f31-4c7d-9b10-39a8648314d2 on nch2-master-1 Jan 15 20:52:23.745518 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-c249c310-4d6a-4285-983b-d8164a69a896 req-e4a2a5c7-4fa9-4c92-808d-ddfe7a394449 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035668 Jan 15 20:52:23.746429 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 601/1266] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:52:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:52:23.754492 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:52:23.754492 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:52:23.756756 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b6b3555c-3ec3-435c-8a46-ed7aac101bcf tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:23.757397 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b6b3555c-3ec3-435c-8a46-ed7aac101bcf tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] [instance: d45d5893-c22a-4b0c-ae7d-26e205a98643] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:23.762516 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-f502a449-4cbc-403e-8231-cd3cffa398a2 req-1e4de87a-4569-40ed-9464-cd89115963e6 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:23.762958 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-f502a449-4cbc-403e-8231-cd3cffa398a2 req-1e4de87a-4569-40ed-9464-cd89115963e6 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:23.774278 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b6b3555c-3ec3-435c-8a46-ed7aac101bcf tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:23.774855 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b6b3555c-3ec3-435c-8a46-ed7aac101bcf tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:23.775715 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b6b3555c-3ec3-435c-8a46-ed7aac101bcf tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:23.776156 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b6b3555c-3ec3-435c-8a46-ed7aac101bcf tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:23.776722 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-f502a449-4cbc-403e-8231-cd3cffa398a2 req-1e4de87a-4569-40ed-9464-cd89115963e6 service nova] Creating event network-vif-plugged:2dedf195-b886-49e9-99b8-57405251268c for instance 067b97a2-ee1a-4d43-926c-11a8bfa2e332 on nch2-master-1 Jan 15 20:52:23.782011 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-f502a449-4cbc-403e-8231-cd3cffa398a2 req-1e4de87a-4569-40ed-9464-cd89115963e6 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049696 Jan 15 20:52:23.783260 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 666/1267] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:52:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:52:23.791346 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c55dad83-5531-437e-9e2b-84ecaed41d2f tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:23.792135 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c55dad83-5531-437e-9e2b-84ecaed41d2f tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] [instance: 231780ff-26d8-4f4a-b52b-eba09aa1a0e8] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:23.799182 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c55dad83-5531-437e-9e2b-84ecaed41d2f tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:23.799646 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c55dad83-5531-437e-9e2b-84ecaed41d2f tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:23.801349 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c55dad83-5531-437e-9e2b-84ecaed41d2f tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:23.801789 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c55dad83-5531-437e-9e2b-84ecaed41d2f tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:23.826459 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-b6b3555c-3ec3-435c-8a46-ed7aac101bcf tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] HTTP exception thrown: Instance d45d5893-c22a-4b0c-ae7d-26e205a98643 could not be found. Jan 15 20:52:23.827038 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b6b3555c-3ec3-435c-8a46-ed7aac101bcf tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Returning 404 to user: Instance d45d5893-c22a-4b0c-ae7d-26e205a98643 could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:52:23.828581 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b6b3555c-3ec3-435c-8a46-ed7aac101bcf tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] 10.222.0.46 "DELETE /compute/v2.1/servers/d45d5893-c22a-4b0c-ae7d-26e205a98643" status: 404 len: 111 microversion: 2.1 time: 0.080557 Jan 15 20:52:23.829629 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 602/1268] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 20:52:23 2022] DELETE /compute/v2.1/servers/d45d5893-c22a-4b0c-ae7d-26e205a98643 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:52:23.834498 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c55dad83-5531-437e-9e2b-84ecaed41d2f tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] [instance: 231780ff-26d8-4f4a-b52b-eba09aa1a0e8] Going to try to terminate instance {{(pid=129366) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 20:52:23.838984 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-7c6934dd-dcf0-4f62-a20a-50525026ab5d tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:23.839699 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-7c6934dd-dcf0-4f62-a20a-50525026ab5d tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] [instance: d45d5893-c22a-4b0c-ae7d-26e205a98643] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:23.846360 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7c6934dd-dcf0-4f62-a20a-50525026ab5d tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:23.849969 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7c6934dd-dcf0-4f62-a20a-50525026ab5d tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:23.849969 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7c6934dd-dcf0-4f62-a20a-50525026ab5d tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:23.849969 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7c6934dd-dcf0-4f62-a20a-50525026ab5d tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:23.863756 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-7c6934dd-dcf0-4f62-a20a-50525026ab5d tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] HTTP exception thrown: Instance d45d5893-c22a-4b0c-ae7d-26e205a98643 could not be found. Jan 15 20:52:23.864354 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-7c6934dd-dcf0-4f62-a20a-50525026ab5d tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Returning 404 to user: Instance d45d5893-c22a-4b0c-ae7d-26e205a98643 could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:52:23.865711 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-7c6934dd-dcf0-4f62-a20a-50525026ab5d tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] 10.222.0.46 "GET /compute/v2.1/servers/d45d5893-c22a-4b0c-ae7d-26e205a98643" status: 404 len: 111 microversion: 2.1 time: 0.030863 Jan 15 20:52:23.867404 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 603/1269] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:52:23 2022] GET /compute/v2.1/servers/d45d5893-c22a-4b0c-ae7d-26e205a98643 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:52:23.883083 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8a5197f1-d3f8-4f65-bd67-d22a24b6567f tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Calling method '.version_select at 0x7f30c8d64550>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:23.975924 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c55dad83-5531-437e-9e2b-84ecaed41d2f tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] 10.222.0.46 "DELETE /compute/v2.1/servers/231780ff-26d8-4f4a-b52b-eba09aa1a0e8" status: 204 len: 0 microversion: 2.1 time: 0.190434 Jan 15 20:52:23.978144 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 667/1270] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 20:52:23 2022] DELETE /compute/v2.1/servers/231780ff-26d8-4f4a-b52b-eba09aa1a0e8 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 20:52:23.990743 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e81066c3-f52c-4150-a6c0-0863078a1ecf tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:23.992115 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e81066c3-f52c-4150-a6c0-0863078a1ecf tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] [instance: 231780ff-26d8-4f4a-b52b-eba09aa1a0e8] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:24.001478 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e81066c3-f52c-4150-a6c0-0863078a1ecf tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:24.002262 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e81066c3-f52c-4150-a6c0-0863078a1ecf tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:24.003789 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e81066c3-f52c-4150-a6c0-0863078a1ecf tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:24.004429 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e81066c3-f52c-4150-a6c0-0863078a1ecf tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:24.278760 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-e81066c3-f52c-4150-a6c0-0863078a1ecf tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc38f86758f9416b9e7f6915de0359d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8cfe33be708428abef52f5e8e25621b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:52:24.292495 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e81066c3-f52c-4150-a6c0-0863078a1ecf tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] 10.222.0.46 "GET /compute/v2.1/servers/231780ff-26d8-4f4a-b52b-eba09aa1a0e8" status: 200 len: 1471 microversion: 2.1 time: 0.307530 Jan 15 20:52:24.294470 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 668/1271] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:52:23 2022] GET /compute/v2.1/servers/231780ff-26d8-4f4a-b52b-eba09aa1a0e8 => generated 1471 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:52:24.337841 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-5fbadafb-682b-45bf-8351-dd01acc00fc6 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '.version_select at 0x7f30c90001f0>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:24.415258 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-5fbadafb-682b-45bf-8351-dd01acc00fc6 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "GET /compute/v2.1/images/02c98032-11ad-4694-be3b-e856797c5802" status: 200 len: 1414 microversion: 2.1 time: 0.081060 Jan 15 20:52:24.416123 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 669/1272] 10.222.0.46 () {58 vars in 1232 bytes} [Sat Jan 15 20:52:24 2022] GET /compute/v2.1/images/02c98032-11ad-4694-be3b-e856797c5802 => generated 1414 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:52:24.424711 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-bfb0bb93-fbdc-4cab-9466-07e9444da6b3 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Calling method '.version_select at 0x7f30c9140b80>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:24.507873 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-bfb0bb93-fbdc-4cab-9466-07e9444da6b3 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] 10.222.0.46 "GET /compute/v2.1/images/3ce24e4a-9608-4d9f-919f-c52be69dac7b" status: 200 len: 1431 microversion: 2.1 time: 0.090694 Jan 15 20:52:24.514833 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 670/1273] 10.222.0.46 () {58 vars in 1232 bytes} [Sat Jan 15 20:52:24 2022] GET /compute/v2.1/images/3ce24e4a-9608-4d9f-919f-c52be69dac7b => generated 1431 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:52:24.525967 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-792f9eba-cc39-41c0-ba34-b1bcde546db9 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Calling method '.version_select at 0x7f30c9000040>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:24.602766 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-792f9eba-cc39-41c0-ba34-b1bcde546db9 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] 10.222.0.46 "GET /compute/v2.1/images/3ce24e4a-9608-4d9f-919f-c52be69dac7b" status: 200 len: 1431 microversion: 2.1 time: 0.086235 Jan 15 20:52:24.603343 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 671/1274] 10.222.0.46 () {58 vars in 1232 bytes} [Sat Jan 15 20:52:24 2022] GET /compute/v2.1/images/3ce24e4a-9608-4d9f-919f-c52be69dac7b => generated 1431 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:52:24.618282 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-17b384e3-4cb9-4120-8b1a-0c799c93900d tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:24.618902 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-17b384e3-4cb9-4120-8b1a-0c799c93900d tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] [instance: 1d163f47-49a0-41c9-991b-f42d16af67d1] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:24.625737 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-17b384e3-4cb9-4120-8b1a-0c799c93900d tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:24.625921 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-17b384e3-4cb9-4120-8b1a-0c799c93900d tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:24.626721 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-17b384e3-4cb9-4120-8b1a-0c799c93900d tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:24.627159 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-17b384e3-4cb9-4120-8b1a-0c799c93900d tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:24.861547 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-17b384e3-4cb9-4120-8b1a-0c799c93900d tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3352815cdc914c15b656b4d0d9511010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7b489c290846f48384c65e977ed644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:52:24.874695 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-17b384e3-4cb9-4120-8b1a-0c799c93900d tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] 10.222.0.46 "GET /compute/v2.1/servers/1d163f47-49a0-41c9-991b-f42d16af67d1" status: 200 len: 1466 microversion: 2.1 time: 0.262920 Jan 15 20:52:24.876523 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 672/1275] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:52:24 2022] GET /compute/v2.1/servers/1d163f47-49a0-41c9-991b-f42d16af67d1 => generated 1466 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:52:24.887101 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-627e066f-edf8-4f6a-92cb-924d247b1d50 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:24.888027 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-627e066f-edf8-4f6a-92cb-924d247b1d50 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: e983108d-66c6-472e-bfc1-761f8a333569] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:24.900953 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-627e066f-edf8-4f6a-92cb-924d247b1d50 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:24.902297 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-627e066f-edf8-4f6a-92cb-924d247b1d50 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:24.908370 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-627e066f-edf8-4f6a-92cb-924d247b1d50 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:24.909710 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-627e066f-edf8-4f6a-92cb-924d247b1d50 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:25.016260 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-8a5197f1-d3f8-4f65-bd67-d22a24b6567f tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] 10.222.0.46 "DELETE /compute/v2.1/os-floating-ips/18f33b3a-5d73-4e19-ae06-90827362a4d4" status: 202 len: 0 microversion: 2.1 time: 1.142062 Jan 15 20:52:25.022347 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 604/1276] 10.222.0.46 () {58 vars in 1262 bytes} [Sat Jan 15 20:52:23 2022] DELETE /compute/v2.1/os-floating-ips/18f33b3a-5d73-4e19-ae06-90827362a4d4 => generated 0 bytes in 1149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 20:52:25.028319 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a70b8635-9ac3-4122-a877-d63f5ffb3a55 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:25.029264 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a70b8635-9ac3-4122-a877-d63f5ffb3a55 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] [instance: b191ed6c-040a-4702-8e15-86272f9d1847] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:25.049611 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a70b8635-9ac3-4122-a877-d63f5ffb3a55 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:25.054481 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a70b8635-9ac3-4122-a877-d63f5ffb3a55 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:25.055559 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a70b8635-9ac3-4122-a877-d63f5ffb3a55 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:25.058463 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a70b8635-9ac3-4122-a877-d63f5ffb3a55 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:25.241552 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-627e066f-edf8-4f6a-92cb-924d247b1d50 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:52:25.251704 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-627e066f-edf8-4f6a-92cb-924d247b1d50 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/e983108d-66c6-472e-bfc1-761f8a333569" status: 200 len: 1313 microversion: 2.1 time: 0.372508 Jan 15 20:52:25.251704 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 673/1277] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:52:24 2022] GET /compute/v2.1/servers/e983108d-66c6-472e-bfc1-761f8a333569 => generated 1313 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:52:25.259247 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c6e7e7b6-d035-4fc6-b846-f7b5ed487fb0 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:52:25.260528 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c6e7e7b6-d035-4fc6-b846-f7b5ed487fb0 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 57bd310f-a604-40de-9c25-882284f4a17b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:25.267331 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c6e7e7b6-d035-4fc6-b846-f7b5ed487fb0 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:25.267916 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c6e7e7b6-d035-4fc6-b846-f7b5ed487fb0 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:25.269590 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c6e7e7b6-d035-4fc6-b846-f7b5ed487fb0 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:25.270882 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c6e7e7b6-d035-4fc6-b846-f7b5ed487fb0 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:25.294192 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-a70b8635-9ac3-4122-a877-d63f5ffb3a55 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d4a57cfaa145009ba9cc8f21d9e8ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4a26c8edac44c8b26fd4e43813412d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:52:25.302363 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a70b8635-9ac3-4122-a877-d63f5ffb3a55 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] 10.222.0.46 "GET /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847" status: 200 len: 1478 microversion: 2.1 time: 0.278618 Jan 15 20:52:25.303314 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 605/1278] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:52:25 2022] GET /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847 => generated 1478 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:52:25.309258 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-66fb57eb-cc39-4435-9dce-25ec1c01b958 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Calling method '.version_select at 0x7f30c91b1790>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:25.330251 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c6e7e7b6-d035-4fc6-b846-f7b5ed487fb0 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/action" status: 200 len: 32621 microversion: 2.1 time: 0.076867 Jan 15 20:52:25.331417 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 674/1279] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:52:25 2022] POST /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/action => generated 32621 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:52:25.341277 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9376b49b-3c71-4861-90cb-9f1ebb546c60 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:25.341864 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-9376b49b-3c71-4861-90cb-9f1ebb546c60 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] [instance: b18c4fdc-6965-4c52-85f5-824ba94b4ad8] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:25.355522 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9376b49b-3c71-4861-90cb-9f1ebb546c60 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:25.355522 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9376b49b-3c71-4861-90cb-9f1ebb546c60 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:25.355522 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9376b49b-3c71-4861-90cb-9f1ebb546c60 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:25.355522 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9376b49b-3c71-4861-90cb-9f1ebb546c60 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:25.375287 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-66fb57eb-cc39-4435-9dce-25ec1c01b958 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] 10.222.0.46 "GET /compute/v2.1/images/1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815" status: 200 len: 784 microversion: 2.1 time: 0.069360 Jan 15 20:52:25.387024 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 606/1280] 10.222.0.46 () {58 vars in 1232 bytes} [Sat Jan 15 20:52:25 2022] GET /compute/v2.1/images/1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815 => generated 784 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:52:25.387024 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-7196ccda-4286-45ba-bf46-b80c7d0bb783 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:25.387746 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-7196ccda-4286-45ba-bf46-b80c7d0bb783 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] [instance: 231780ff-26d8-4f4a-b52b-eba09aa1a0e8] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:25.394234 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-9376b49b-3c71-4861-90cb-9f1ebb546c60 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] [instance: b18c4fdc-6965-4c52-85f5-824ba94b4ad8] Going to try to terminate instance {{(pid=129366) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 20:52:25.398831 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7196ccda-4286-45ba-bf46-b80c7d0bb783 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:25.399368 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7196ccda-4286-45ba-bf46-b80c7d0bb783 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:25.401740 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7196ccda-4286-45ba-bf46-b80c7d0bb783 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:25.402392 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7196ccda-4286-45ba-bf46-b80c7d0bb783 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:25.545483 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-9376b49b-3c71-4861-90cb-9f1ebb546c60 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] 10.222.0.46 "DELETE /compute/v2.1/servers/b18c4fdc-6965-4c52-85f5-824ba94b4ad8" status: 204 len: 0 microversion: 2.1 time: 0.208354 Jan 15 20:52:25.546680 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 675/1281] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 20:52:25 2022] DELETE /compute/v2.1/servers/b18c4fdc-6965-4c52-85f5-824ba94b4ad8 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 20:52:25.554811 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-036e0439-fd33-40a1-b4b4-9b5375236fd9 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:25.571517 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-036e0439-fd33-40a1-b4b4-9b5375236fd9 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] 10.222.0.46 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.023432 Jan 15 20:52:25.577855 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 676/1282] 10.222.0.46 () {58 vars in 1136 bytes} [Sat Jan 15 20:52:25 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:52:25.579980 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-cee42768-37a8-4865-b916-619e8aa57a8b tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '.version_select at 0x7f30c9032f70>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:25.658289 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-cee42768-37a8-4865-b916-619e8aa57a8b tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "GET /compute/v2.1/images/02c98032-11ad-4694-be3b-e856797c5802" status: 200 len: 1414 microversion: 2.1 time: 0.078323 Jan 15 20:52:25.658968 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 677/1283] 10.222.0.46 () {58 vars in 1232 bytes} [Sat Jan 15 20:52:25 2022] GET /compute/v2.1/images/02c98032-11ad-4694-be3b-e856797c5802 => generated 1414 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:52:25.667263 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-056b10a6-cc75-4d58-b46b-b6c88eb57f90 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:25.668042 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-056b10a6-cc75-4d58-b46b-b6c88eb57f90 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] [instance: b18c4fdc-6965-4c52-85f5-824ba94b4ad8] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:25.681086 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-7196ccda-4286-45ba-bf46-b80c7d0bb783 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc38f86758f9416b9e7f6915de0359d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8cfe33be708428abef52f5e8e25621b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:52:25.682819 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-056b10a6-cc75-4d58-b46b-b6c88eb57f90 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:25.683262 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-056b10a6-cc75-4d58-b46b-b6c88eb57f90 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:25.684351 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-056b10a6-cc75-4d58-b46b-b6c88eb57f90 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:25.684993 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-056b10a6-cc75-4d58-b46b-b6c88eb57f90 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:25.693164 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-7196ccda-4286-45ba-bf46-b80c7d0bb783 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] 10.222.0.46 "GET /compute/v2.1/servers/231780ff-26d8-4f4a-b52b-eba09aa1a0e8" status: 200 len: 1471 microversion: 2.1 time: 0.312112 Jan 15 20:52:25.702633 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 607/1284] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:52:25 2022] GET /compute/v2.1/servers/231780ff-26d8-4f4a-b52b-eba09aa1a0e8 => generated 1471 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:52:25.702633 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a3511f8a-3c2e-47a2-bda7-3d25b1401ddd tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Calling method '.version_select at 0x7f30c8fc5280>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:25.871897 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-056b10a6-cc75-4d58-b46b-b6c88eb57f90 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25473d022e7f438fa6495288f53caa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f471d81a59824fc8afaf454a65e99933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:52:25.882016 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-056b10a6-cc75-4d58-b46b-b6c88eb57f90 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] 10.222.0.46 "GET /compute/v2.1/servers/b18c4fdc-6965-4c52-85f5-824ba94b4ad8" status: 200 len: 1526 microversion: 2.1 time: 0.221420 Jan 15 20:52:25.884096 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 678/1285] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:52:25 2022] GET /compute/v2.1/servers/b18c4fdc-6965-4c52-85f5-824ba94b4ad8 => generated 1526 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:52:25.892503 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-86a1efe4-24ef-4ed3-b7c4-5dcf5761447b req-49df6307-b079-4a46-8580-22714a956a39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b191ed6c-040a-4702-8e15-86272f9d1847", "name": "network-vif-plugged", "status": "completed", "tag": "bbe8394e-08fc-445b-a162-0e40259702ca"}, {"server_uuid": "1d163f47-49a0-41c9-991b-f42d16af67d1", "name": "network-vif-plugged", "status": "completed", "tag": "26758887-8e21-4143-9b13-3eccf74a0d5b"}, {"server_uuid": "e983108d-66c6-472e-bfc1-761f8a333569", "name": "network-vif-plugged", "status": "completed", "tag": "5d3688c4-ca00-4b8e-9475-e69603c54112"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:52:25.895582 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:52:25.895582 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:52:25.905151 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-86a1efe4-24ef-4ed3-b7c4-5dcf5761447b req-49df6307-b079-4a46-8580-22714a956a39 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:25.905920 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-86a1efe4-24ef-4ed3-b7c4-5dcf5761447b req-49df6307-b079-4a46-8580-22714a956a39 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:25.931194 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-86a1efe4-24ef-4ed3-b7c4-5dcf5761447b req-49df6307-b079-4a46-8580-22714a956a39 service nova] Creating event network-vif-plugged:bbe8394e-08fc-445b-a162-0e40259702ca for instance b191ed6c-040a-4702-8e15-86272f9d1847 on nch2-master-1 Jan 15 20:52:25.931711 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-86a1efe4-24ef-4ed3-b7c4-5dcf5761447b req-49df6307-b079-4a46-8580-22714a956a39 service nova] Creating event network-vif-plugged:26758887-8e21-4143-9b13-3eccf74a0d5b for instance 1d163f47-49a0-41c9-991b-f42d16af67d1 on nch2-master-1 Jan 15 20:52:25.932418 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-86a1efe4-24ef-4ed3-b7c4-5dcf5761447b req-49df6307-b079-4a46-8580-22714a956a39 service nova] Creating event network-vif-plugged:5d3688c4-ca00-4b8e-9475-e69603c54112 for instance e983108d-66c6-472e-bfc1-761f8a333569 on nch1-master-1 Jan 15 20:52:25.957525 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-86a1efe4-24ef-4ed3-b7c4-5dcf5761447b req-49df6307-b079-4a46-8580-22714a956a39 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.063881 Jan 15 20:52:25.958742 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 679/1286] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:52:25 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:52:26.268794 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-cb3cd9a4-1a0d-4eaf-8251-ca0c5d2a3adb tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:26.269932 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-cb3cd9a4-1a0d-4eaf-8251-ca0c5d2a3adb tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: e983108d-66c6-472e-bfc1-761f8a333569] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:26.280299 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cb3cd9a4-1a0d-4eaf-8251-ca0c5d2a3adb tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:26.281670 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cb3cd9a4-1a0d-4eaf-8251-ca0c5d2a3adb tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:26.282852 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cb3cd9a4-1a0d-4eaf-8251-ca0c5d2a3adb tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:26.283444 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cb3cd9a4-1a0d-4eaf-8251-ca0c5d2a3adb tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:26.605407 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-cb3cd9a4-1a0d-4eaf-8251-ca0c5d2a3adb tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:52:26.618640 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-cb3cd9a4-1a0d-4eaf-8251-ca0c5d2a3adb tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/e983108d-66c6-472e-bfc1-761f8a333569" status: 200 len: 1313 microversion: 2.1 time: 0.354358 Jan 15 20:52:26.630614 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 680/1287] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:52:26 2022] GET /compute/v2.1/servers/e983108d-66c6-472e-bfc1-761f8a333569 => generated 1313 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:52:26.641345 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ec821530-b180-4000-b561-98ef52ecd886 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:26.642271 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ec821530-b180-4000-b561-98ef52ecd886 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] [instance: b191ed6c-040a-4702-8e15-86272f9d1847] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:26.649589 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ec821530-b180-4000-b561-98ef52ecd886 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:26.651310 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ec821530-b180-4000-b561-98ef52ecd886 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:26.652319 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ec821530-b180-4000-b561-98ef52ecd886 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:26.652927 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ec821530-b180-4000-b561-98ef52ecd886 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:26.747978 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a3511f8a-3c2e-47a2-bda7-3d25b1401ddd tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] 10.222.0.46 "DELETE /compute/v2.1/images/3ce24e4a-9608-4d9f-919f-c52be69dac7b" status: 204 len: 0 microversion: 2.1 time: 1.051092 Jan 15 20:52:26.749448 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 608/1288] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:52:25 2022] DELETE /compute/v2.1/images/3ce24e4a-9608-4d9f-919f-c52be69dac7b => generated 0 bytes in 1053 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 20:52:26.775412 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-7eecbce3-a998-48b4-8c1c-26b2101a755c tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:52:26.777270 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-7eecbce3-a998-48b4-8c1c-26b2101a755c tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 57bd310f-a604-40de-9c25-882284f4a17b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:26.846061 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7eecbce3-a998-48b4-8c1c-26b2101a755c tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:26.847086 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7eecbce3-a998-48b4-8c1c-26b2101a755c tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:26.848363 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7eecbce3-a998-48b4-8c1c-26b2101a755c tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:26.851461 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7eecbce3-a998-48b4-8c1c-26b2101a755c tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:26.887759 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-ec821530-b180-4000-b561-98ef52ecd886 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d4a57cfaa145009ba9cc8f21d9e8ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4a26c8edac44c8b26fd4e43813412d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:52:26.919824 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ec821530-b180-4000-b561-98ef52ecd886 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] 10.222.0.46 "GET /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847" status: 200 len: 1478 microversion: 2.1 time: 0.287175 Jan 15 20:52:26.935270 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 681/1289] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:52:26 2022] GET /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847 => generated 1478 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:52:26.947675 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1d74f36d-f943-4cf7-8bd3-06d577804f45 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '.version_select at 0x7f30c90e1430>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:26.955800 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-7eecbce3-a998-48b4-8c1c-26b2101a755c tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/action" status: 200 len: 32621 microversion: 2.1 time: 0.201626 Jan 15 20:52:26.963752 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 609/1290] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:52:26 2022] POST /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/action => generated 32621 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:52:26.976244 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a6cd2c6d-980d-4c63-852e-f5ac9bd5e5e6 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:26.979152 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a6cd2c6d-980d-4c63-852e-f5ac9bd5e5e6 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] [instance: 231780ff-26d8-4f4a-b52b-eba09aa1a0e8] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:27.012386 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a6cd2c6d-980d-4c63-852e-f5ac9bd5e5e6 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:27.021638 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a6cd2c6d-980d-4c63-852e-f5ac9bd5e5e6 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:27.023716 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a6cd2c6d-980d-4c63-852e-f5ac9bd5e5e6 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:27.025018 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a6cd2c6d-980d-4c63-852e-f5ac9bd5e5e6 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:27.028251 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-1d74f36d-f943-4cf7-8bd3-06d577804f45 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "GET /compute/v2.1/images/02c98032-11ad-4694-be3b-e856797c5802" status: 200 len: 1414 microversion: 2.1 time: 0.091548 Jan 15 20:52:27.029121 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 682/1291] 10.222.0.46 () {58 vars in 1232 bytes} [Sat Jan 15 20:52:26 2022] GET /compute/v2.1/images/02c98032-11ad-4694-be3b-e856797c5802 => generated 1414 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:52:27.043106 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9a17c276-3c97-4490-816a-b45705912c0f tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Calling method '.version_select at 0x7f30c9140430>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:27.076616 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-9a17c276-3c97-4490-816a-b45705912c0f tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] HTTP exception thrown: Image not found. Jan 15 20:52:27.077263 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9a17c276-3c97-4490-816a-b45705912c0f tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Returning 404 to user: Image not found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:52:27.078092 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-9a17c276-3c97-4490-816a-b45705912c0f tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] 10.222.0.46 "GET /compute/v2.1/images/3ce24e4a-9608-4d9f-919f-c52be69dac7b" status: 404 len: 62 microversion: 2.1 time: 0.047910 Jan 15 20:52:27.079193 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 683/1292] 10.222.0.46 () {58 vars in 1232 bytes} [Sat Jan 15 20:52:27 2022] GET /compute/v2.1/images/3ce24e4a-9608-4d9f-919f-c52be69dac7b => generated 62 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jan 15 20:52:27.089766 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-698e5bd0-b695-47a2-b532-3b0047c879a2 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:27.091763 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-698e5bd0-b695-47a2-b532-3b0047c879a2 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] [instance: b18c4fdc-6965-4c52-85f5-824ba94b4ad8] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:27.117914 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-698e5bd0-b695-47a2-b532-3b0047c879a2 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:27.118625 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-698e5bd0-b695-47a2-b532-3b0047c879a2 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:27.119632 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-698e5bd0-b695-47a2-b532-3b0047c879a2 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:27.120222 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-698e5bd0-b695-47a2-b532-3b0047c879a2 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:27.180390 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-a6cd2c6d-980d-4c63-852e-f5ac9bd5e5e6 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc38f86758f9416b9e7f6915de0359d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8cfe33be708428abef52f5e8e25621b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:52:27.195516 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a6cd2c6d-980d-4c63-852e-f5ac9bd5e5e6 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] 10.222.0.46 "GET /compute/v2.1/servers/231780ff-26d8-4f4a-b52b-eba09aa1a0e8" status: 200 len: 1301 microversion: 2.1 time: 0.224684 Jan 15 20:52:27.209411 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 610/1293] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:52:26 2022] GET /compute/v2.1/servers/231780ff-26d8-4f4a-b52b-eba09aa1a0e8 => generated 1301 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:52:27.233142 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-2e73380e-9b15-4ef0-a6eb-440db8850443 req-d04f70cf-09e1-4ac5-ba63-d8a41614bd05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "231780ff-26d8-4f4a-b52b-eba09aa1a0e8", "name": "network-vif-deleted", "tag": "7880a0f5-0cf7-4766-9699-5a2f4c04bd45"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:52:27.234842 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:52:27.234842 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:52:27.271665 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-2e73380e-9b15-4ef0-a6eb-440db8850443 req-d04f70cf-09e1-4ac5-ba63-d8a41614bd05 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:27.272488 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-2e73380e-9b15-4ef0-a6eb-440db8850443 req-d04f70cf-09e1-4ac5-ba63-d8a41614bd05 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:27.299592 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-2e73380e-9b15-4ef0-a6eb-440db8850443 req-d04f70cf-09e1-4ac5-ba63-d8a41614bd05 service nova] Creating event network-vif-deleted:7880a0f5-0cf7-4766-9699-5a2f4c04bd45 for instance 231780ff-26d8-4f4a-b52b-eba09aa1a0e8 on nch1-master-1 Jan 15 20:52:27.305452 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-2e73380e-9b15-4ef0-a6eb-440db8850443 req-d04f70cf-09e1-4ac5-ba63-d8a41614bd05 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093629 Jan 15 20:52:27.306788 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 611/1294] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:52:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:52:27.312909 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d372d8c6-07eb-4f89-9aa4-af33711b26e9 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-2054304220"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:52:27.314221 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d372d8c6-07eb-4f89-9aa4-af33711b26e9 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] [instance: 1d163f47-49a0-41c9-991b-f42d16af67d1] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:27.321884 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d372d8c6-07eb-4f89-9aa4-af33711b26e9 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:27.322593 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d372d8c6-07eb-4f89-9aa4-af33711b26e9 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:27.323714 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d372d8c6-07eb-4f89-9aa4-af33711b26e9 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:27.324308 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d372d8c6-07eb-4f89-9aa4-af33711b26e9 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:27.463628 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-698e5bd0-b695-47a2-b532-3b0047c879a2 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25473d022e7f438fa6495288f53caa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f471d81a59824fc8afaf454a65e99933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:52:27.472333 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-698e5bd0-b695-47a2-b532-3b0047c879a2 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] 10.222.0.46 "GET /compute/v2.1/servers/b18c4fdc-6965-4c52-85f5-824ba94b4ad8" status: 200 len: 1526 microversion: 2.1 time: 0.391853 Jan 15 20:52:27.490150 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 684/1295] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:52:27 2022] GET /compute/v2.1/servers/b18c4fdc-6965-4c52-85f5-824ba94b4ad8 => generated 1526 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:52:27.636965 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e75a1184-a1e0-4c2a-80c5-7855ff8b0dad tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:27.637598 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e75a1184-a1e0-4c2a-80c5-7855ff8b0dad tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: e983108d-66c6-472e-bfc1-761f8a333569] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:27.648870 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e75a1184-a1e0-4c2a-80c5-7855ff8b0dad tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:27.650140 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e75a1184-a1e0-4c2a-80c5-7855ff8b0dad tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:27.651732 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e75a1184-a1e0-4c2a-80c5-7855ff8b0dad tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:27.653161 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e75a1184-a1e0-4c2a-80c5-7855ff8b0dad tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:27.913729 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d372d8c6-07eb-4f89-9aa4-af33711b26e9 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] 10.222.0.46 "POST /compute/v2.1/servers/1d163f47-49a0-41c9-991b-f42d16af67d1/action" status: 202 len: 0 microversion: 2.1 time: 0.604084 Jan 15 20:52:27.918163 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 612/1296] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:52:27 2022] POST /compute/v2.1/servers/1d163f47-49a0-41c9-991b-f42d16af67d1/action => generated 0 bytes in 611 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jan 15 20:52:27.932823 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2b1901a0-2f14-4cb9-8c9e-fd8146436ff2 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Calling method '.version_select at 0x7f30c8d1eca0>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:27.987617 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-e75a1184-a1e0-4c2a-80c5-7855ff8b0dad tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:52:28.005016 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e75a1184-a1e0-4c2a-80c5-7855ff8b0dad tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/e983108d-66c6-472e-bfc1-761f8a333569" status: 200 len: 1313 microversion: 2.1 time: 0.371402 Jan 15 20:52:28.005775 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 685/1297] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:52:27 2022] GET /compute/v2.1/servers/e983108d-66c6-472e-bfc1-761f8a333569 => generated 1313 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:52:28.023357 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c661f560-0d1c-4f89-ace1-9f4307e17912 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:28.024466 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c661f560-0d1c-4f89-ace1-9f4307e17912 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] [instance: b191ed6c-040a-4702-8e15-86272f9d1847] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:28.025619 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2b1901a0-2f14-4cb9-8c9e-fd8146436ff2 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] 10.222.0.46 "GET /compute/v2.1/images/a6c696b9-7dd9-4e26-aa78-20da08a049b8" status: 200 len: 1427 microversion: 2.1 time: 0.103927 Jan 15 20:52:28.026278 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 613/1298] 10.222.0.46 () {58 vars in 1232 bytes} [Sat Jan 15 20:52:27 2022] GET /compute/v2.1/images/a6c696b9-7dd9-4e26-aa78-20da08a049b8 => generated 1427 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:52:28.031756 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a0b3aaaf-4f8d-4f48-b6ab-01ddbbbb0056 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:52:28.033915 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c661f560-0d1c-4f89-ace1-9f4307e17912 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:28.035247 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c661f560-0d1c-4f89-ace1-9f4307e17912 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:28.037200 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c661f560-0d1c-4f89-ace1-9f4307e17912 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:28.038108 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c661f560-0d1c-4f89-ace1-9f4307e17912 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:28.039620 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a0b3aaaf-4f8d-4f48-b6ab-01ddbbbb0056 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 57bd310f-a604-40de-9c25-882284f4a17b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:28.060779 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a0b3aaaf-4f8d-4f48-b6ab-01ddbbbb0056 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:28.061628 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a0b3aaaf-4f8d-4f48-b6ab-01ddbbbb0056 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:28.062671 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a0b3aaaf-4f8d-4f48-b6ab-01ddbbbb0056 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:28.064400 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a0b3aaaf-4f8d-4f48-b6ab-01ddbbbb0056 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:28.165674 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a0b3aaaf-4f8d-4f48-b6ab-01ddbbbb0056 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/action" status: 200 len: 32621 microversion: 2.1 time: 0.137840 Jan 15 20:52:28.170933 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 614/1299] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:52:28 2022] POST /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/action => generated 32621 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:52:28.179629 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2071f770-2400-4fe9-93fe-0be80660b820 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '.version_select at 0x7f30c8d1ec10>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:28.256771 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2071f770-2400-4fe9-93fe-0be80660b820 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "GET /compute/v2.1/images/02c98032-11ad-4694-be3b-e856797c5802" status: 200 len: 1414 microversion: 2.1 time: 0.084020 Jan 15 20:52:28.265111 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 615/1300] 10.222.0.46 () {58 vars in 1232 bytes} [Sat Jan 15 20:52:28 2022] GET /compute/v2.1/images/02c98032-11ad-4694-be3b-e856797c5802 => generated 1414 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:52:28.283854 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5ef72a71-ee9b-49b6-b5a9-35fab99b3e6f tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:28.287311 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-5ef72a71-ee9b-49b6-b5a9-35fab99b3e6f tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] [instance: 231780ff-26d8-4f4a-b52b-eba09aa1a0e8] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:28.298694 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5ef72a71-ee9b-49b6-b5a9-35fab99b3e6f tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:28.299451 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5ef72a71-ee9b-49b6-b5a9-35fab99b3e6f tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:28.301068 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5ef72a71-ee9b-49b6-b5a9-35fab99b3e6f tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:28.301886 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5ef72a71-ee9b-49b6-b5a9-35fab99b3e6f tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:28.318272 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-5ef72a71-ee9b-49b6-b5a9-35fab99b3e6f tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] HTTP exception thrown: Instance 231780ff-26d8-4f4a-b52b-eba09aa1a0e8 could not be found. Jan 15 20:52:28.319229 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5ef72a71-ee9b-49b6-b5a9-35fab99b3e6f tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Returning 404 to user: Instance 231780ff-26d8-4f4a-b52b-eba09aa1a0e8 could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:52:28.320334 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5ef72a71-ee9b-49b6-b5a9-35fab99b3e6f tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] 10.222.0.46 "GET /compute/v2.1/servers/231780ff-26d8-4f4a-b52b-eba09aa1a0e8" status: 404 len: 111 microversion: 2.1 time: 0.053501 Jan 15 20:52:28.321118 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 616/1301] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:52:28 2022] GET /compute/v2.1/servers/231780ff-26d8-4f4a-b52b-eba09aa1a0e8 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:52:28.329554 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-fb4bdade-df8c-4838-bebb-f3b285957c72 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:28.330314 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-fb4bdade-df8c-4838-bebb-f3b285957c72 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] [instance: 61233bc7-f90a-439f-b0c6-e6856c8c71a0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:28.340142 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fb4bdade-df8c-4838-bebb-f3b285957c72 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:28.341442 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fb4bdade-df8c-4838-bebb-f3b285957c72 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:28.343017 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fb4bdade-df8c-4838-bebb-f3b285957c72 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:28.343718 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fb4bdade-df8c-4838-bebb-f3b285957c72 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:28.384580 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-fb4bdade-df8c-4838-bebb-f3b285957c72 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] [instance: 61233bc7-f90a-439f-b0c6-e6856c8c71a0] Going to try to terminate instance {{(pid=129365) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 20:52:28.449130 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-c661f560-0d1c-4f89-ace1-9f4307e17912 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d4a57cfaa145009ba9cc8f21d9e8ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4a26c8edac44c8b26fd4e43813412d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:52:28.472048 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c661f560-0d1c-4f89-ace1-9f4307e17912 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] 10.222.0.46 "GET /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847" status: 200 len: 1478 microversion: 2.1 time: 0.453704 Jan 15 20:52:28.478795 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 686/1302] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:52:28 2022] GET /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847 => generated 1478 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:52:28.497743 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-69608a0d-212a-4421-99d9-54fd12c1a2a2 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:28.505417 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-69608a0d-212a-4421-99d9-54fd12c1a2a2 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] [instance: b18c4fdc-6965-4c52-85f5-824ba94b4ad8] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:28.538148 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-69608a0d-212a-4421-99d9-54fd12c1a2a2 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:28.540607 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-69608a0d-212a-4421-99d9-54fd12c1a2a2 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:28.544703 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-69608a0d-212a-4421-99d9-54fd12c1a2a2 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:28.546979 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-69608a0d-212a-4421-99d9-54fd12c1a2a2 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:28.578565 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-fb4bdade-df8c-4838-bebb-f3b285957c72 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] 10.222.0.46 "DELETE /compute/v2.1/servers/61233bc7-f90a-439f-b0c6-e6856c8c71a0" status: 204 len: 0 microversion: 2.1 time: 0.251173 Jan 15 20:52:28.580500 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 617/1303] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 20:52:28 2022] DELETE /compute/v2.1/servers/61233bc7-f90a-439f-b0c6-e6856c8c71a0 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 15 20:52:28.590442 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-b295f988-79b8-476f-935a-6e4d657c877f req-c88e3f5d-138e-42d0-95b4-42f1852801ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d163f47-49a0-41c9-991b-f42d16af67d1", "name": "network-vif-unplugged", "status": "completed", "tag": "26758887-8e21-4143-9b13-3eccf74a0d5b"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:52:28.592514 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:52:28.592514 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:52:28.602418 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-b295f988-79b8-476f-935a-6e4d657c877f req-c88e3f5d-138e-42d0-95b4-42f1852801ca service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:28.603174 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-b295f988-79b8-476f-935a-6e4d657c877f req-c88e3f5d-138e-42d0-95b4-42f1852801ca service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:28.618105 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-b295f988-79b8-476f-935a-6e4d657c877f req-c88e3f5d-138e-42d0-95b4-42f1852801ca service nova] Creating event network-vif-unplugged:26758887-8e21-4143-9b13-3eccf74a0d5b for instance 1d163f47-49a0-41c9-991b-f42d16af67d1 on nch2-master-1 Jan 15 20:52:28.623525 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-b295f988-79b8-476f-935a-6e4d657c877f req-c88e3f5d-138e-42d0-95b4-42f1852801ca service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039855 Jan 15 20:52:28.625171 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 618/1304] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:52:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:52:28.631639 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-435b337a-3c4a-4364-8fe2-8550239d768c tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:28.632621 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-435b337a-3c4a-4364-8fe2-8550239d768c tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] [instance: 61233bc7-f90a-439f-b0c6-e6856c8c71a0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:28.641750 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-435b337a-3c4a-4364-8fe2-8550239d768c tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:28.642512 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-435b337a-3c4a-4364-8fe2-8550239d768c tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:28.644319 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-435b337a-3c4a-4364-8fe2-8550239d768c tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:28.645981 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-435b337a-3c4a-4364-8fe2-8550239d768c tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:28.750297 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-69608a0d-212a-4421-99d9-54fd12c1a2a2 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25473d022e7f438fa6495288f53caa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f471d81a59824fc8afaf454a65e99933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:52:28.760583 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-69608a0d-212a-4421-99d9-54fd12c1a2a2 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] 10.222.0.46 "GET /compute/v2.1/servers/b18c4fdc-6965-4c52-85f5-824ba94b4ad8" status: 200 len: 1484 microversion: 2.1 time: 0.275132 Jan 15 20:52:28.761903 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 687/1305] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:52:28 2022] GET /compute/v2.1/servers/b18c4fdc-6965-4c52-85f5-824ba94b4ad8 => generated 1484 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:52:28.904681 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-435b337a-3c4a-4364-8fe2-8550239d768c tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc38f86758f9416b9e7f6915de0359d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8cfe33be708428abef52f5e8e25621b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:52:28.917287 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-435b337a-3c4a-4364-8fe2-8550239d768c tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] 10.222.0.46 "GET /compute/v2.1/servers/61233bc7-f90a-439f-b0c6-e6856c8c71a0" status: 200 len: 1473 microversion: 2.1 time: 0.290558 Jan 15 20:52:28.919619 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 619/1306] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:52:28 2022] GET /compute/v2.1/servers/61233bc7-f90a-439f-b0c6-e6856c8c71a0 => generated 1473 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:52:29.024372 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-2c78dd32-ba2d-47b6-bc81-5e4e984bc43e tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:29.025130 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-2c78dd32-ba2d-47b6-bc81-5e4e984bc43e tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: e983108d-66c6-472e-bfc1-761f8a333569] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:29.039319 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f22ef546-1262-4b35-b050-f92f30699ace tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Calling method '.version_select at 0x7f30c8fff700>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:29.051400 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2c78dd32-ba2d-47b6-bc81-5e4e984bc43e tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:29.051856 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2c78dd32-ba2d-47b6-bc81-5e4e984bc43e tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:29.052656 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2c78dd32-ba2d-47b6-bc81-5e4e984bc43e tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:29.053119 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2c78dd32-ba2d-47b6-bc81-5e4e984bc43e tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:29.111030 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f22ef546-1262-4b35-b050-f92f30699ace tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] 10.222.0.46 "GET /compute/v2.1/images/a6c696b9-7dd9-4e26-aa78-20da08a049b8" status: 200 len: 1427 microversion: 2.1 time: 0.075308 Jan 15 20:52:29.111927 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 620/1307] 10.222.0.46 () {58 vars in 1232 bytes} [Sat Jan 15 20:52:29 2022] GET /compute/v2.1/images/a6c696b9-7dd9-4e26-aa78-20da08a049b8 => generated 1427 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:52:29.186490 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c348f598-9113-4438-a2c3-45694b3999be tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:52:29.188658 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c348f598-9113-4438-a2c3-45694b3999be tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 57bd310f-a604-40de-9c25-882284f4a17b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:29.197453 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c348f598-9113-4438-a2c3-45694b3999be tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:29.198331 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c348f598-9113-4438-a2c3-45694b3999be tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:29.199308 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c348f598-9113-4438-a2c3-45694b3999be tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:29.199896 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c348f598-9113-4438-a2c3-45694b3999be tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:29.275746 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c348f598-9113-4438-a2c3-45694b3999be tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/action" status: 200 len: 32621 microversion: 2.1 time: 0.100920 Jan 15 20:52:29.277341 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 621/1308] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:52:29 2022] POST /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/action => generated 32621 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:52:29.283300 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c4e483d6-aff6-4911-9bb6-a93d87f7755a tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '.version_select at 0x7f30c91b1790>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:29.336704 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-2c78dd32-ba2d-47b6-bc81-5e4e984bc43e tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:52:29.344912 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-2c78dd32-ba2d-47b6-bc81-5e4e984bc43e tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/e983108d-66c6-472e-bfc1-761f8a333569" status: 200 len: 1462 microversion: 2.1 time: 0.324617 Jan 15 20:52:29.350024 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 688/1309] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:52:29 2022] GET /compute/v2.1/servers/e983108d-66c6-472e-bfc1-761f8a333569 => generated 1462 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:52:29.355736 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-622a5262-22ff-435f-a523-e122351d7769 req-81e1128d-89aa-4c1a-8990-dd6307b27ae3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b18c4fdc-6965-4c52-85f5-824ba94b4ad8", "name": "network-vif-deleted", "tag": "37191f5f-92f4-4372-9435-1f2eddb92f24"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:52:29.358217 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:52:29.358217 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:52:29.366369 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-622a5262-22ff-435f-a523-e122351d7769 req-81e1128d-89aa-4c1a-8990-dd6307b27ae3 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:29.367163 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-622a5262-22ff-435f-a523-e122351d7769 req-81e1128d-89aa-4c1a-8990-dd6307b27ae3 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:29.378904 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c4e483d6-aff6-4911-9bb6-a93d87f7755a tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "GET /compute/v2.1/images/02c98032-11ad-4694-be3b-e856797c5802" status: 200 len: 1414 microversion: 2.1 time: 0.093563 Jan 15 20:52:29.379983 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 622/1310] 10.222.0.46 () {58 vars in 1232 bytes} [Sat Jan 15 20:52:29 2022] GET /compute/v2.1/images/02c98032-11ad-4694-be3b-e856797c5802 => generated 1414 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:52:29.387214 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-622a5262-22ff-435f-a523-e122351d7769 req-81e1128d-89aa-4c1a-8990-dd6307b27ae3 service nova] Creating event network-vif-deleted:37191f5f-92f4-4372-9435-1f2eddb92f24 for instance b18c4fdc-6965-4c52-85f5-824ba94b4ad8 on nch1-master-1 Jan 15 20:52:29.390918 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-33573472-0dfd-4051-a76a-303dd6102d5b tempest-MigrationsAdminTest-1503274595 tempest-MigrationsAdminTest-1503274595-project-admin] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:29.391675 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-33573472-0dfd-4051-a76a-303dd6102d5b tempest-MigrationsAdminTest-1503274595 tempest-MigrationsAdminTest-1503274595-project-admin] [instance: e983108d-66c6-472e-bfc1-761f8a333569] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:29.395843 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-622a5262-22ff-435f-a523-e122351d7769 req-81e1128d-89aa-4c1a-8990-dd6307b27ae3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044297 Jan 15 20:52:29.397205 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 689/1311] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:52:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:52:29.402027 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-33573472-0dfd-4051-a76a-303dd6102d5b tempest-MigrationsAdminTest-1503274595 tempest-MigrationsAdminTest-1503274595-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:29.402479 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-33573472-0dfd-4051-a76a-303dd6102d5b tempest-MigrationsAdminTest-1503274595 tempest-MigrationsAdminTest-1503274595-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:29.403283 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-33573472-0dfd-4051-a76a-303dd6102d5b tempest-MigrationsAdminTest-1503274595 tempest-MigrationsAdminTest-1503274595-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:29.403716 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-33573472-0dfd-4051-a76a-303dd6102d5b tempest-MigrationsAdminTest-1503274595 tempest-MigrationsAdminTest-1503274595-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:29.498778 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8a567910-92ba-4825-b6ab-948d16985638 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:29.499700 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-8a567910-92ba-4825-b6ab-948d16985638 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] [instance: b191ed6c-040a-4702-8e15-86272f9d1847] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:29.521922 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8a567910-92ba-4825-b6ab-948d16985638 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:29.523810 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8a567910-92ba-4825-b6ab-948d16985638 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:29.524913 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8a567910-92ba-4825-b6ab-948d16985638 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:29.525584 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8a567910-92ba-4825-b6ab-948d16985638 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:29.602086 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-33573472-0dfd-4051-a76a-303dd6102d5b tempest-MigrationsAdminTest-1503274595 tempest-MigrationsAdminTest-1503274595-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/e983108d-66c6-472e-bfc1-761f8a333569" status: 200 len: 1613 microversion: 2.1 time: 0.215619 Jan 15 20:52:29.602896 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 623/1312] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:52:29 2022] GET /compute/v2.1/servers/e983108d-66c6-472e-bfc1-761f8a333569 => generated 1613 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:52:29.621913 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-7b6b4899-0135-4381-9500-ebb228e8f331 tempest-MigrationsAdminTest-1503274595 tempest-MigrationsAdminTest-1503274595-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:52:29.622472 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-7b6b4899-0135-4381-9500-ebb228e8f331 tempest-MigrationsAdminTest-1503274595 tempest-MigrationsAdminTest-1503274595-project-admin] [instance: e983108d-66c6-472e-bfc1-761f8a333569] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:29.640265 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7b6b4899-0135-4381-9500-ebb228e8f331 tempest-MigrationsAdminTest-1503274595 tempest-MigrationsAdminTest-1503274595-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:29.640728 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7b6b4899-0135-4381-9500-ebb228e8f331 tempest-MigrationsAdminTest-1503274595 tempest-MigrationsAdminTest-1503274595-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:29.645555 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7b6b4899-0135-4381-9500-ebb228e8f331 tempest-MigrationsAdminTest-1503274595 tempest-MigrationsAdminTest-1503274595-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:29.646021 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7b6b4899-0135-4381-9500-ebb228e8f331 tempest-MigrationsAdminTest-1503274595 tempest-MigrationsAdminTest-1503274595-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:29.695136 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-7b6b4899-0135-4381-9500-ebb228e8f331 tempest-MigrationsAdminTest-1503274595 tempest-MigrationsAdminTest-1503274595-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '555abb28cee245bb8a7d6574dc498445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2918f33afb6a4ef4a03edd106f9057d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:52:29.696189 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-7b6b4899-0135-4381-9500-ebb228e8f331 tempest-MigrationsAdminTest-1503274595 tempest-MigrationsAdminTest-1503274595-project-admin] [instance: e983108d-66c6-472e-bfc1-761f8a333569] flavor_id is None. Assuming migration. {{(pid=129365) resize /opt/stack/nova/nova/compute/api.py:4073}} Jan 15 20:52:29.696826 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-7b6b4899-0135-4381-9500-ebb228e8f331 tempest-MigrationsAdminTest-1503274595 tempest-MigrationsAdminTest-1503274595-project-admin] [instance: e983108d-66c6-472e-bfc1-761f8a333569] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=129365) resize /opt/stack/nova/nova/compute/api.py:4097}} Jan 15 20:52:29.763125 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-8a567910-92ba-4825-b6ab-948d16985638 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d4a57cfaa145009ba9cc8f21d9e8ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4a26c8edac44c8b26fd4e43813412d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:52:29.772348 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-8a567910-92ba-4825-b6ab-948d16985638 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] 10.222.0.46 "GET /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847" status: 200 len: 1463 microversion: 2.1 time: 0.278769 Jan 15 20:52:29.773817 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 690/1313] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:52:29 2022] GET /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847 => generated 1463 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:52:29.778352 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-2521e190-1465-4627-84b8-d4498ce40922 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:29.779195 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-2521e190-1465-4627-84b8-d4498ce40922 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] [instance: b18c4fdc-6965-4c52-85f5-824ba94b4ad8] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:29.785514 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2521e190-1465-4627-84b8-d4498ce40922 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:29.786583 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2521e190-1465-4627-84b8-d4498ce40922 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:29.787631 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2521e190-1465-4627-84b8-d4498ce40922 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:29.788292 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2521e190-1465-4627-84b8-d4498ce40922 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:29.805447 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-2521e190-1465-4627-84b8-d4498ce40922 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] HTTP exception thrown: Instance b18c4fdc-6965-4c52-85f5-824ba94b4ad8 could not be found. Jan 15 20:52:29.805771 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-2521e190-1465-4627-84b8-d4498ce40922 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] Returning 404 to user: Instance b18c4fdc-6965-4c52-85f5-824ba94b4ad8 could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:52:29.806967 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-2521e190-1465-4627-84b8-d4498ce40922 tempest-FloatingIPsAssociationTestJSON-211763619 tempest-FloatingIPsAssociationTestJSON-211763619-project] 10.222.0.46 "GET /compute/v2.1/servers/b18c4fdc-6965-4c52-85f5-824ba94b4ad8" status: 404 len: 111 microversion: 2.1 time: 0.031708 Jan 15 20:52:29.807446 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 691/1314] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:52:29 2022] GET /compute/v2.1/servers/b18c4fdc-6965-4c52-85f5-824ba94b4ad8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:52:29.818695 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-464f490d-97a1-4d6b-a989-f22fb9cf2145 tempest-ServersAdminTestJSON-212694955 tempest-ServersAdminTestJSON-212694955-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:52:29.826907 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-464f490d-97a1-4d6b-a989-f22fb9cf2145 tempest-ServersAdminTestJSON-212694955 tempest-ServersAdminTestJSON-212694955-project-admin] [instance: b191ed6c-040a-4702-8e15-86272f9d1847] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:29.844375 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-464f490d-97a1-4d6b-a989-f22fb9cf2145 tempest-ServersAdminTestJSON-212694955 tempest-ServersAdminTestJSON-212694955-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:29.844825 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-464f490d-97a1-4d6b-a989-f22fb9cf2145 tempest-ServersAdminTestJSON-212694955 tempest-ServersAdminTestJSON-212694955-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:29.845645 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-464f490d-97a1-4d6b-a989-f22fb9cf2145 tempest-ServersAdminTestJSON-212694955 tempest-ServersAdminTestJSON-212694955-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:29.846080 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-464f490d-97a1-4d6b-a989-f22fb9cf2145 tempest-ServersAdminTestJSON-212694955 tempest-ServersAdminTestJSON-212694955-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:29.974789 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-464f490d-97a1-4d6b-a989-f22fb9cf2145 tempest-ServersAdminTestJSON-212694955 tempest-ServersAdminTestJSON-212694955-project-admin] 10.222.0.46 "POST /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847/action" status: 202 len: 0 microversion: 2.1 time: 0.166241 Jan 15 20:52:29.975975 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 692/1315] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:52:29 2022] POST /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847/action => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 20:52:29.980729 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-5c24228f-b6d0-424b-b02e-0b74dcec3866 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:29.981396 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-5c24228f-b6d0-424b-b02e-0b74dcec3866 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] [instance: 61233bc7-f90a-439f-b0c6-e6856c8c71a0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:29.989424 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5c24228f-b6d0-424b-b02e-0b74dcec3866 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:29.990307 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5c24228f-b6d0-424b-b02e-0b74dcec3866 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:29.991358 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5c24228f-b6d0-424b-b02e-0b74dcec3866 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:29.992141 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5c24228f-b6d0-424b-b02e-0b74dcec3866 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:30.150213 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-7b6b4899-0135-4381-9500-ebb228e8f331 tempest-MigrationsAdminTest-1503274595 tempest-MigrationsAdminTest-1503274595-project-admin] 10.222.0.46 "POST /compute/v2.1/servers/e983108d-66c6-472e-bfc1-761f8a333569/action" status: 202 len: 0 microversion: 2.1 time: 0.531780 Jan 15 20:52:30.152133 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 624/1316] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:52:29 2022] POST /compute/v2.1/servers/e983108d-66c6-472e-bfc1-761f8a333569/action => generated 0 bytes in 534 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 20:52:30.157698 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-88f5bee0-87c7-4ab1-a82c-59c22d88fb52 tempest-ServersAdminTestJSON-212694955 tempest-ServersAdminTestJSON-212694955-project-admin] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:30.158685 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-88f5bee0-87c7-4ab1-a82c-59c22d88fb52 tempest-ServersAdminTestJSON-212694955 tempest-ServersAdminTestJSON-212694955-project-admin] [instance: b191ed6c-040a-4702-8e15-86272f9d1847] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:30.166284 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-88f5bee0-87c7-4ab1-a82c-59c22d88fb52 tempest-ServersAdminTestJSON-212694955 tempest-ServersAdminTestJSON-212694955-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:30.166997 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-88f5bee0-87c7-4ab1-a82c-59c22d88fb52 tempest-ServersAdminTestJSON-212694955 tempest-ServersAdminTestJSON-212694955-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:30.169073 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-88f5bee0-87c7-4ab1-a82c-59c22d88fb52 tempest-ServersAdminTestJSON-212694955 tempest-ServersAdminTestJSON-212694955-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:30.169697 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-88f5bee0-87c7-4ab1-a82c-59c22d88fb52 tempest-ServersAdminTestJSON-212694955 tempest-ServersAdminTestJSON-212694955-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:30.215908 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-88f5bee0-87c7-4ab1-a82c-59c22d88fb52 tempest-ServersAdminTestJSON-212694955 tempest-ServersAdminTestJSON-212694955-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:30.219552 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-88f5bee0-87c7-4ab1-a82c-59c22d88fb52 tempest-ServersAdminTestJSON-212694955 tempest-ServersAdminTestJSON-212694955-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:30.220335 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.objects.instance [None req-88f5bee0-87c7-4ab1-a82c-59c22d88fb52 tempest-ServersAdminTestJSON-212694955 tempest-ServersAdminTestJSON-212694955-project-admin] Lazy-loading 'fault' on Instance uuid b191ed6c-040a-4702-8e15-86272f9d1847 {{(pid=129365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 20:52:31.166549 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-5c24228f-b6d0-424b-b02e-0b74dcec3866 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc38f86758f9416b9e7f6915de0359d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8cfe33be708428abef52f5e8e25621b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:52:31.176491 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-5c24228f-b6d0-424b-b02e-0b74dcec3866 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] 10.222.0.46 "GET /compute/v2.1/servers/61233bc7-f90a-439f-b0c6-e6856c8c71a0" status: 200 len: 1473 microversion: 2.1 time: 1.199408 Jan 15 20:52:31.183007 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 693/1317] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:52:29 2022] GET /compute/v2.1/servers/61233bc7-f90a-439f-b0c6-e6856c8c71a0 => generated 1473 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:52:31.202941 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-3ebc0e96-53cf-4ec4-9d37-9f1803319de6 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Calling method '.version_select at 0x7f30c925a8b0>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:31.250157 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-88f5bee0-87c7-4ab1-a82c-59c22d88fb52 tempest-ServersAdminTestJSON-212694955 tempest-ServersAdminTestJSON-212694955-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847" status: 200 len: 1597 microversion: 2.1 time: 1.096392 Jan 15 20:52:31.254236 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 625/1318] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:52:30 2022] GET /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847 => generated 1597 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:52:31.260567 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-79f711fd-89e2-47a9-a6c6-2d2c657f4bd5 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:31.275032 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-79f711fd-89e2-47a9-a6c6-2d2c657f4bd5 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: e983108d-66c6-472e-bfc1-761f8a333569] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:31.308146 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-79f711fd-89e2-47a9-a6c6-2d2c657f4bd5 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:31.311858 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-79f711fd-89e2-47a9-a6c6-2d2c657f4bd5 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:31.320922 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-79f711fd-89e2-47a9-a6c6-2d2c657f4bd5 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:31.321571 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-79f711fd-89e2-47a9-a6c6-2d2c657f4bd5 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:31.352946 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-3ebc0e96-53cf-4ec4-9d37-9f1803319de6 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] 10.222.0.46 "GET /compute/v2.1/images/a6c696b9-7dd9-4e26-aa78-20da08a049b8" status: 200 len: 1427 microversion: 2.1 time: 0.168435 Jan 15 20:52:31.359412 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 694/1319] 10.222.0.46 () {58 vars in 1232 bytes} [Sat Jan 15 20:52:31 2022] GET /compute/v2.1/images/a6c696b9-7dd9-4e26-aa78-20da08a049b8 => generated 1427 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:52:31.385169 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-661ac22b-c3d6-4cdc-96d6-dca636c075e2 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:52:31.386470 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-661ac22b-c3d6-4cdc-96d6-dca636c075e2 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 57bd310f-a604-40de-9c25-882284f4a17b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:31.402901 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-661ac22b-c3d6-4cdc-96d6-dca636c075e2 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:31.403643 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-661ac22b-c3d6-4cdc-96d6-dca636c075e2 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:31.407725 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-661ac22b-c3d6-4cdc-96d6-dca636c075e2 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:31.408741 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-661ac22b-c3d6-4cdc-96d6-dca636c075e2 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:31.481097 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-661ac22b-c3d6-4cdc-96d6-dca636c075e2 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/action" status: 200 len: 32621 microversion: 2.1 time: 0.119961 Jan 15 20:52:31.483407 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 695/1320] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:52:31 2022] POST /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/action => generated 32621 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:52:31.490654 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ad28ae39-f917-43bd-aa3f-e324948951a3 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '.version_select at 0x7f30c9140ca0>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:31.563626 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ad28ae39-f917-43bd-aa3f-e324948951a3 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "GET /compute/v2.1/images/02c98032-11ad-4694-be3b-e856797c5802" status: 200 len: 1414 microversion: 2.1 time: 0.078576 Jan 15 20:52:31.566167 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 696/1321] 10.222.0.46 () {58 vars in 1232 bytes} [Sat Jan 15 20:52:31 2022] GET /compute/v2.1/images/02c98032-11ad-4694-be3b-e856797c5802 => generated 1414 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:52:31.573977 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-5526fae3-478c-4051-9d90-4c2fba31d0ee tempest-ServersAdminTestJSON-212694955 tempest-ServersAdminTestJSON-212694955-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:52:31.576092 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-5526fae3-478c-4051-9d90-4c2fba31d0ee tempest-ServersAdminTestJSON-212694955 tempest-ServersAdminTestJSON-212694955-project-admin] [instance: b191ed6c-040a-4702-8e15-86272f9d1847] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:31.587657 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5526fae3-478c-4051-9d90-4c2fba31d0ee tempest-ServersAdminTestJSON-212694955 tempest-ServersAdminTestJSON-212694955-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:31.591370 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5526fae3-478c-4051-9d90-4c2fba31d0ee tempest-ServersAdminTestJSON-212694955 tempest-ServersAdminTestJSON-212694955-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:31.602728 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5526fae3-478c-4051-9d90-4c2fba31d0ee tempest-ServersAdminTestJSON-212694955 tempest-ServersAdminTestJSON-212694955-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:31.604044 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5526fae3-478c-4051-9d90-4c2fba31d0ee tempest-ServersAdminTestJSON-212694955 tempest-ServersAdminTestJSON-212694955-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:31.822555 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-5526fae3-478c-4051-9d90-4c2fba31d0ee tempest-ServersAdminTestJSON-212694955 tempest-ServersAdminTestJSON-212694955-project-admin] 10.222.0.46 "POST /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847/action" status: 202 len: 0 microversion: 2.1 time: 0.254706 Jan 15 20:52:31.826747 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 697/1322] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:52:31 2022] POST /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847/action => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 20:52:31.834238 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-17855299-8c04-4a02-9bad-fd31d709700b req-5407a2fd-098a-4beb-8c74-e4fd9da78d60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61233bc7-f90a-439f-b0c6-e6856c8c71a0", "name": "network-vif-deleted", "tag": "efc2bb82-77b6-4192-a231-cc667bccea96"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:52:31.844156 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:52:31.844156 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:52:31.860461 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-17855299-8c04-4a02-9bad-fd31d709700b req-5407a2fd-098a-4beb-8c74-e4fd9da78d60 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:31.865718 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-17855299-8c04-4a02-9bad-fd31d709700b req-5407a2fd-098a-4beb-8c74-e4fd9da78d60 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:31.889840 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-17855299-8c04-4a02-9bad-fd31d709700b req-5407a2fd-098a-4beb-8c74-e4fd9da78d60 service nova] Creating event network-vif-deleted:efc2bb82-77b6-4192-a231-cc667bccea96 for instance 61233bc7-f90a-439f-b0c6-e6856c8c71a0 on nch1-master-1 Jan 15 20:52:31.905241 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-17855299-8c04-4a02-9bad-fd31d709700b req-5407a2fd-098a-4beb-8c74-e4fd9da78d60 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076683 Jan 15 20:52:31.907572 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 698/1323] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:52:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:52:31.919440 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b2ebe4a4-5181-4b90-a213-58aa80c7dbbb tempest-ServersAdminTestJSON-212694955 tempest-ServersAdminTestJSON-212694955-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:31.923637 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b2ebe4a4-5181-4b90-a213-58aa80c7dbbb tempest-ServersAdminTestJSON-212694955 tempest-ServersAdminTestJSON-212694955-project-admin] [instance: b191ed6c-040a-4702-8e15-86272f9d1847] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:31.972609 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b2ebe4a4-5181-4b90-a213-58aa80c7dbbb tempest-ServersAdminTestJSON-212694955 tempest-ServersAdminTestJSON-212694955-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:31.974751 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b2ebe4a4-5181-4b90-a213-58aa80c7dbbb tempest-ServersAdminTestJSON-212694955 tempest-ServersAdminTestJSON-212694955-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:31.976647 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b2ebe4a4-5181-4b90-a213-58aa80c7dbbb tempest-ServersAdminTestJSON-212694955 tempest-ServersAdminTestJSON-212694955-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:31.979137 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b2ebe4a4-5181-4b90-a213-58aa80c7dbbb tempest-ServersAdminTestJSON-212694955 tempest-ServersAdminTestJSON-212694955-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:32.365067 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-79f711fd-89e2-47a9-a6c6-2d2c657f4bd5 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:52:32.373035 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-79f711fd-89e2-47a9-a6c6-2d2c657f4bd5 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/e983108d-66c6-472e-bfc1-761f8a333569" status: 200 len: 1471 microversion: 2.1 time: 1.116137 Jan 15 20:52:32.391632 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 626/1324] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:52:31 2022] GET /compute/v2.1/servers/e983108d-66c6-472e-bfc1-761f8a333569 => generated 1471 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:52:32.397454 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-03a9bdcc-83fe-41a1-bcdb-be760ed97376 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:32.398063 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-03a9bdcc-83fe-41a1-bcdb-be760ed97376 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] [instance: 61233bc7-f90a-439f-b0c6-e6856c8c71a0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:32.410964 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-03a9bdcc-83fe-41a1-bcdb-be760ed97376 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:32.413081 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-03a9bdcc-83fe-41a1-bcdb-be760ed97376 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:32.415947 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-03a9bdcc-83fe-41a1-bcdb-be760ed97376 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:32.419782 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-03a9bdcc-83fe-41a1-bcdb-be760ed97376 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:32.451008 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-03a9bdcc-83fe-41a1-bcdb-be760ed97376 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] HTTP exception thrown: Instance 61233bc7-f90a-439f-b0c6-e6856c8c71a0 could not be found. Jan 15 20:52:32.451615 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-03a9bdcc-83fe-41a1-bcdb-be760ed97376 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Returning 404 to user: Instance 61233bc7-f90a-439f-b0c6-e6856c8c71a0 could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:52:32.452454 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-03a9bdcc-83fe-41a1-bcdb-be760ed97376 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] 10.222.0.46 "GET /compute/v2.1/servers/61233bc7-f90a-439f-b0c6-e6856c8c71a0" status: 404 len: 111 microversion: 2.1 time: 0.059769 Jan 15 20:52:32.453477 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 627/1325] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:52:32 2022] GET /compute/v2.1/servers/61233bc7-f90a-439f-b0c6-e6856c8c71a0 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:52:32.458549 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e61f2191-ed11-4e25-9760-459a35b05872 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Calling method '.version_select at 0x7f30c913ee50>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:32.506236 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e61f2191-ed11-4e25-9760-459a35b05872 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] 10.222.0.46 "GET /compute/v2.1/images/a6c696b9-7dd9-4e26-aa78-20da08a049b8" status: 200 len: 1427 microversion: 2.1 time: 0.051523 Jan 15 20:52:32.512522 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 628/1326] 10.222.0.46 () {58 vars in 1232 bytes} [Sat Jan 15 20:52:32 2022] GET /compute/v2.1/images/a6c696b9-7dd9-4e26-aa78-20da08a049b8 => generated 1427 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:52:32.518185 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f4acc0b6-6be9-4736-9972-66abc1b43246 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:32.519166 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f4acc0b6-6be9-4736-9972-66abc1b43246 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] [instance: c0916b98-698b-448b-9b06-95791cbf533c] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:32.526312 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f4acc0b6-6be9-4736-9972-66abc1b43246 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:32.526988 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f4acc0b6-6be9-4736-9972-66abc1b43246 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:32.527948 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f4acc0b6-6be9-4736-9972-66abc1b43246 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:32.528536 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f4acc0b6-6be9-4736-9972-66abc1b43246 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:32.593114 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f4acc0b6-6be9-4736-9972-66abc1b43246 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] [instance: c0916b98-698b-448b-9b06-95791cbf533c] Going to try to terminate instance {{(pid=129365) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 20:52:32.730623 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f4acc0b6-6be9-4736-9972-66abc1b43246 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] 10.222.0.46 "DELETE /compute/v2.1/servers/c0916b98-698b-448b-9b06-95791cbf533c" status: 204 len: 0 microversion: 2.1 time: 0.216480 Jan 15 20:52:32.736648 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 629/1327] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 20:52:32 2022] DELETE /compute/v2.1/servers/c0916b98-698b-448b-9b06-95791cbf533c => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 20:52:32.743053 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5e62c031-b0b8-475f-ba2a-2d76b11939a4 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:52:32.744120 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-5e62c031-b0b8-475f-ba2a-2d76b11939a4 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 57bd310f-a604-40de-9c25-882284f4a17b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:32.751595 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5e62c031-b0b8-475f-ba2a-2d76b11939a4 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:32.752043 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5e62c031-b0b8-475f-ba2a-2d76b11939a4 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:32.754071 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5e62c031-b0b8-475f-ba2a-2d76b11939a4 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:32.754537 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5e62c031-b0b8-475f-ba2a-2d76b11939a4 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:32.763937 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b2ebe4a4-5181-4b90-a213-58aa80c7dbbb tempest-ServersAdminTestJSON-212694955 tempest-ServersAdminTestJSON-212694955-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847" status: 200 len: 1614 microversion: 2.1 time: 0.853134 Jan 15 20:52:32.766707 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 699/1328] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:52:31 2022] GET /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847 => generated 1614 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:52:32.784500 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d7eb1464-8f4b-4586-83b6-541339aec306 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '.version_select at 0x7f30c96864c0>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:32.829657 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5e62c031-b0b8-475f-ba2a-2d76b11939a4 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/action" status: 200 len: 32621 microversion: 2.1 time: 0.090561 Jan 15 20:52:32.832450 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 630/1329] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:52:32 2022] POST /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/action => generated 32621 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:52:32.839386 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f0529f5c-5edf-44f5-a677-2d9995f357aa tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:32.840327 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f0529f5c-5edf-44f5-a677-2d9995f357aa tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] [instance: c4b0aaad-91ee-4e37-9a34-0b4d56e282d5] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:32.849067 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f0529f5c-5edf-44f5-a677-2d9995f357aa tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:32.849868 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f0529f5c-5edf-44f5-a677-2d9995f357aa tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:32.850974 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f0529f5c-5edf-44f5-a677-2d9995f357aa tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:32.851625 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f0529f5c-5edf-44f5-a677-2d9995f357aa tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:32.885752 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f0529f5c-5edf-44f5-a677-2d9995f357aa tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] [instance: c4b0aaad-91ee-4e37-9a34-0b4d56e282d5] Going to try to terminate instance {{(pid=129365) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 20:52:33.033086 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f0529f5c-5edf-44f5-a677-2d9995f357aa tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] 10.222.0.46 "DELETE /compute/v2.1/servers/c4b0aaad-91ee-4e37-9a34-0b4d56e282d5" status: 204 len: 0 microversion: 2.1 time: 0.197486 Jan 15 20:52:33.039525 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 631/1330] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 20:52:32 2022] DELETE /compute/v2.1/servers/c4b0aaad-91ee-4e37-9a34-0b4d56e282d5 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 20:52:33.046083 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-bec77575-2646-4abd-9cec-215db6442027 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:33.046802 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-bec77575-2646-4abd-9cec-215db6442027 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] [instance: f89db7df-a7e8-4138-8949-d76e2ccd282d] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:33.055868 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bec77575-2646-4abd-9cec-215db6442027 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:33.056524 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bec77575-2646-4abd-9cec-215db6442027 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:33.058288 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bec77575-2646-4abd-9cec-215db6442027 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:33.058874 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bec77575-2646-4abd-9cec-215db6442027 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:33.071385 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d7eb1464-8f4b-4586-83b6-541339aec306 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "GET /compute/v2.1/images/02c98032-11ad-4694-be3b-e856797c5802" status: 200 len: 1414 microversion: 2.1 time: 0.301017 Jan 15 20:52:33.074544 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 700/1331] 10.222.0.46 () {58 vars in 1232 bytes} [Sat Jan 15 20:52:32 2022] GET /compute/v2.1/images/02c98032-11ad-4694-be3b-e856797c5802 => generated 1414 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:52:33.079664 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-86d61ca2-5fa4-4c3c-98f7-92d9dc715506 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:33.082757 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-86d61ca2-5fa4-4c3c-98f7-92d9dc715506 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] [instance: c0916b98-698b-448b-9b06-95791cbf533c] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:33.103738 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-86d61ca2-5fa4-4c3c-98f7-92d9dc715506 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:33.106153 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-86d61ca2-5fa4-4c3c-98f7-92d9dc715506 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:33.108142 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-86d61ca2-5fa4-4c3c-98f7-92d9dc715506 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:33.110285 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-bec77575-2646-4abd-9cec-215db6442027 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] [instance: f89db7df-a7e8-4138-8949-d76e2ccd282d] Going to try to terminate instance {{(pid=129365) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 20:52:33.110977 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-86d61ca2-5fa4-4c3c-98f7-92d9dc715506 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:33.259723 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-bec77575-2646-4abd-9cec-215db6442027 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] 10.222.0.46 "DELETE /compute/v2.1/servers/f89db7df-a7e8-4138-8949-d76e2ccd282d" status: 204 len: 0 microversion: 2.1 time: 0.216696 Jan 15 20:52:33.263430 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 632/1332] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 20:52:33 2022] DELETE /compute/v2.1/servers/f89db7df-a7e8-4138-8949-d76e2ccd282d => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 20:52:33.273480 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9d85bd0d-b505-461d-b32a-89a4b4ee191e tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:33.276450 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-9d85bd0d-b505-461d-b32a-89a4b4ee191e tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] [instance: f89db7df-a7e8-4138-8949-d76e2ccd282d] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:33.309283 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9d85bd0d-b505-461d-b32a-89a4b4ee191e tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:33.309878 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9d85bd0d-b505-461d-b32a-89a4b4ee191e tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:33.311209 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9d85bd0d-b505-461d-b32a-89a4b4ee191e tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:33.311209 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9d85bd0d-b505-461d-b32a-89a4b4ee191e tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:33.727168 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-86d61ca2-5fa4-4c3c-98f7-92d9dc715506 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc38f86758f9416b9e7f6915de0359d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8cfe33be708428abef52f5e8e25621b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:52:33.734885 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-86d61ca2-5fa4-4c3c-98f7-92d9dc715506 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] 10.222.0.46 "GET /compute/v2.1/servers/c0916b98-698b-448b-9b06-95791cbf533c" status: 200 len: 1474 microversion: 2.1 time: 0.659315 Jan 15 20:52:33.749201 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 701/1333] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:52:33 2022] GET /compute/v2.1/servers/c0916b98-698b-448b-9b06-95791cbf533c => generated 1474 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:52:33.754997 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-54e1f6e6-67bc-43e7-b7ec-1b4c2d333158 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:33.755936 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-54e1f6e6-67bc-43e7-b7ec-1b4c2d333158 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: e983108d-66c6-472e-bfc1-761f8a333569] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:33.770079 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-54e1f6e6-67bc-43e7-b7ec-1b4c2d333158 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:33.771397 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-54e1f6e6-67bc-43e7-b7ec-1b4c2d333158 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:33.772454 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-54e1f6e6-67bc-43e7-b7ec-1b4c2d333158 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:33.773162 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-54e1f6e6-67bc-43e7-b7ec-1b4c2d333158 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:33.809139 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-9d85bd0d-b505-461d-b32a-89a4b4ee191e tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d4a57cfaa145009ba9cc8f21d9e8ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4a26c8edac44c8b26fd4e43813412d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:52:33.821313 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-9d85bd0d-b505-461d-b32a-89a4b4ee191e tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] 10.222.0.46 "GET /compute/v2.1/servers/f89db7df-a7e8-4138-8949-d76e2ccd282d" status: 200 len: 1469 microversion: 2.1 time: 0.555886 Jan 15 20:52:33.825316 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 633/1334] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:52:33 2022] GET /compute/v2.1/servers/f89db7df-a7e8-4138-8949-d76e2ccd282d => generated 1469 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:52:33.834962 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5d144a21-202e-40a3-b146-5d8e598c88cd tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Calling method '.version_select at 0x7f30c911e040>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:34.546281 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-54e1f6e6-67bc-43e7-b7ec-1b4c2d333158 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:52:34.555889 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-54e1f6e6-67bc-43e7-b7ec-1b4c2d333158 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/e983108d-66c6-472e-bfc1-761f8a333569" status: 200 len: 1471 microversion: 2.1 time: 0.804961 Jan 15 20:52:34.556417 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 702/1335] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:52:33 2022] GET /compute/v2.1/servers/e983108d-66c6-472e-bfc1-761f8a333569 => generated 1471 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:52:34.574805 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8f59e0b4-8c92-49ec-960a-5e9f4ff750ba tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:52:34.575700 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-8f59e0b4-8c92-49ec-960a-5e9f4ff750ba tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 57bd310f-a604-40de-9c25-882284f4a17b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:34.602743 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8f59e0b4-8c92-49ec-960a-5e9f4ff750ba tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:34.603211 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8f59e0b4-8c92-49ec-960a-5e9f4ff750ba tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:34.604069 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8f59e0b4-8c92-49ec-960a-5e9f4ff750ba tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:34.604533 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8f59e0b4-8c92-49ec-960a-5e9f4ff750ba tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:34.766934 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-8f59e0b4-8c92-49ec-960a-5e9f4ff750ba tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/action" status: 200 len: 32621 microversion: 2.1 time: 0.209125 Jan 15 20:52:34.772249 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 703/1336] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:52:34 2022] POST /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/action => generated 32621 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:52:34.780736 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b831239c-dbe1-4705-94e1-3bfd500097f6 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '.version_select at 0x7f30c9215790>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:43.872699 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5d144a21-202e-40a3-b146-5d8e598c88cd tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] 10.222.0.46 "GET /compute/v2.1/images/a6c696b9-7dd9-4e26-aa78-20da08a049b8" status: 200 len: 1427 microversion: 2.1 time: 10.042059 Jan 15 20:52:43.882181 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 634/1337] 10.222.0.46 () {58 vars in 1232 bytes} [Sat Jan 15 20:52:33 2022] GET /compute/v2.1/images/a6c696b9-7dd9-4e26-aa78-20da08a049b8 => generated 1427 bytes in 10051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:52:43.896462 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9d1ae404-6a9c-46c3-a979-4ef58c20e672 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:43.897115 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-9d1ae404-6a9c-46c3-a979-4ef58c20e672 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] [instance: c0916b98-698b-448b-9b06-95791cbf533c] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:43.912953 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b831239c-dbe1-4705-94e1-3bfd500097f6 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "GET /compute/v2.1/images/02c98032-11ad-4694-be3b-e856797c5802" status: 200 len: 1423 microversion: 2.1 time: 9.138513 Jan 15 20:52:43.913550 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 704/1338] 10.222.0.46 () {58 vars in 1232 bytes} [Sat Jan 15 20:52:34 2022] GET /compute/v2.1/images/02c98032-11ad-4694-be3b-e856797c5802 => generated 1423 bytes in 9140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:52:43.918531 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4035d5b2-f56d-40f5-8044-4d152eeaec11 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:43.919319 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-4035d5b2-f56d-40f5-8044-4d152eeaec11 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] [instance: f89db7df-a7e8-4138-8949-d76e2ccd282d] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:43.927758 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4035d5b2-f56d-40f5-8044-4d152eeaec11 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:43.928467 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4035d5b2-f56d-40f5-8044-4d152eeaec11 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:43.929485 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4035d5b2-f56d-40f5-8044-4d152eeaec11 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:43.932656 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4035d5b2-f56d-40f5-8044-4d152eeaec11 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:43.932804 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9d1ae404-6a9c-46c3-a979-4ef58c20e672 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:43.935383 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9d1ae404-6a9c-46c3-a979-4ef58c20e672 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:43.937219 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9d1ae404-6a9c-46c3-a979-4ef58c20e672 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:43.937671 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9d1ae404-6a9c-46c3-a979-4ef58c20e672 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:43.949828 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-4035d5b2-f56d-40f5-8044-4d152eeaec11 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] HTTP exception thrown: Instance f89db7df-a7e8-4138-8949-d76e2ccd282d could not be found. Jan 15 20:52:43.953858 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4035d5b2-f56d-40f5-8044-4d152eeaec11 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Returning 404 to user: Instance f89db7df-a7e8-4138-8949-d76e2ccd282d could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:52:43.956270 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-4035d5b2-f56d-40f5-8044-4d152eeaec11 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] 10.222.0.46 "GET /compute/v2.1/servers/f89db7df-a7e8-4138-8949-d76e2ccd282d" status: 404 len: 111 microversion: 2.1 time: 0.040602 Jan 15 20:52:43.957163 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 705/1339] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:52:43 2022] GET /compute/v2.1/servers/f89db7df-a7e8-4138-8949-d76e2ccd282d => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:52:43.962021 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-3f75611e-f86b-4170-b48a-23f8c176c1bf req-939e9ad8-1e57-4335-84eb-1c0eea57717f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d163f47-49a0-41c9-991b-f42d16af67d1", "name": "network-vif-plugged", "status": "completed", "tag": "26758887-8e21-4143-9b13-3eccf74a0d5b"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:52:43.964146 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:52:43.964146 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:52:43.967652 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-9d1ae404-6a9c-46c3-a979-4ef58c20e672 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] HTTP exception thrown: Instance c0916b98-698b-448b-9b06-95791cbf533c could not be found. Jan 15 20:52:43.968334 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9d1ae404-6a9c-46c3-a979-4ef58c20e672 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Returning 404 to user: Instance c0916b98-698b-448b-9b06-95791cbf533c could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:52:43.975293 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-9d1ae404-6a9c-46c3-a979-4ef58c20e672 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] 10.222.0.46 "GET /compute/v2.1/servers/c0916b98-698b-448b-9b06-95791cbf533c" status: 404 len: 111 microversion: 2.1 time: 0.083426 Jan 15 20:52:43.977074 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-3f75611e-f86b-4170-b48a-23f8c176c1bf req-939e9ad8-1e57-4335-84eb-1c0eea57717f service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:43.977781 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-3f75611e-f86b-4170-b48a-23f8c176c1bf req-939e9ad8-1e57-4335-84eb-1c0eea57717f service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:43.978600 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 635/1340] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:52:43 2022] GET /compute/v2.1/servers/c0916b98-698b-448b-9b06-95791cbf533c => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:52:43.990797 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5476447a-212a-42f2-a409-67acbf113c32 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:43.991151 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-3f75611e-f86b-4170-b48a-23f8c176c1bf req-939e9ad8-1e57-4335-84eb-1c0eea57717f service nova] Creating event network-vif-plugged:26758887-8e21-4143-9b13-3eccf74a0d5b for instance 1d163f47-49a0-41c9-991b-f42d16af67d1 on nch2-master-1 Jan 15 20:52:43.991888 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-5476447a-212a-42f2-a409-67acbf113c32 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: e983108d-66c6-472e-bfc1-761f8a333569] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:43.996702 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-3f75611e-f86b-4170-b48a-23f8c176c1bf req-939e9ad8-1e57-4335-84eb-1c0eea57717f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037989 Jan 15 20:52:43.997971 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 706/1341] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:52:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:52:44.004715 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5476447a-212a-42f2-a409-67acbf113c32 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:44.005297 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5476447a-212a-42f2-a409-67acbf113c32 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:44.006104 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-53706cfd-515d-4e07-9dcd-8719188a2db7 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:52:44.006242 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5476447a-212a-42f2-a409-67acbf113c32 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:44.006704 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5476447a-212a-42f2-a409-67acbf113c32 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:44.007939 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-53706cfd-515d-4e07-9dcd-8719188a2db7 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 57bd310f-a604-40de-9c25-882284f4a17b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:44.014817 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-53706cfd-515d-4e07-9dcd-8719188a2db7 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:44.015973 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-53706cfd-515d-4e07-9dcd-8719188a2db7 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:44.017206 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-53706cfd-515d-4e07-9dcd-8719188a2db7 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:44.018579 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-53706cfd-515d-4e07-9dcd-8719188a2db7 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:44.097259 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-53706cfd-515d-4e07-9dcd-8719188a2db7 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/action" status: 200 len: 32621 microversion: 2.1 time: 0.087273 Jan 15 20:52:44.099961 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 707/1342] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:52:43 2022] POST /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/action => generated 32621 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:52:44.113009 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-ad89093b-53a9-4450-ad44-52b692cb95f4 req-d89ffe20-757e-4d81-9fa6-6d3724421776 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0916b98-698b-448b-9b06-95791cbf533c", "name": "network-vif-deleted", "tag": "4fe1e733-915f-402a-bdcb-042d55337395"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:52:44.115690 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:52:44.115690 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:52:44.135639 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-ad89093b-53a9-4450-ad44-52b692cb95f4 req-d89ffe20-757e-4d81-9fa6-6d3724421776 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:44.136164 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-ad89093b-53a9-4450-ad44-52b692cb95f4 req-d89ffe20-757e-4d81-9fa6-6d3724421776 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:44.173760 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-ad89093b-53a9-4450-ad44-52b692cb95f4 req-d89ffe20-757e-4d81-9fa6-6d3724421776 service nova] Creating event network-vif-deleted:4fe1e733-915f-402a-bdcb-042d55337395 for instance c0916b98-698b-448b-9b06-95791cbf533c on nch1-master-1 Jan 15 20:52:44.181134 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-ad89093b-53a9-4450-ad44-52b692cb95f4 req-d89ffe20-757e-4d81-9fa6-6d3724421776 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078660 Jan 15 20:52:44.182525 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 708/1343] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:52:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:52:44.191276 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a9a0fc5c-0222-4508-a713-90d0a43fdc08 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '.version_select at 0x7f30c91a6430>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:44.282020 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a9a0fc5c-0222-4508-a713-90d0a43fdc08 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "GET /compute/v2.1/images/02c98032-11ad-4694-be3b-e856797c5802" status: 200 len: 1423 microversion: 2.1 time: 0.097858 Jan 15 20:52:44.290898 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 709/1344] 10.222.0.46 () {58 vars in 1232 bytes} [Sat Jan 15 20:52:44 2022] GET /compute/v2.1/images/02c98032-11ad-4694-be3b-e856797c5802 => generated 1423 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:52:44.299633 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-2a98f3d7-68e5-40a9-85db-f39c43128cc9 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:44.302518 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-2a98f3d7-68e5-40a9-85db-f39c43128cc9 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] [instance: e3b7a713-3f0d-43e2-b466-6637bc567256] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:44.314206 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2a98f3d7-68e5-40a9-85db-f39c43128cc9 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:44.315104 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2a98f3d7-68e5-40a9-85db-f39c43128cc9 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:44.316160 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2a98f3d7-68e5-40a9-85db-f39c43128cc9 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:44.317026 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2a98f3d7-68e5-40a9-85db-f39c43128cc9 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:44.353236 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-5476447a-212a-42f2-a409-67acbf113c32 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:52:44.383184 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5476447a-212a-42f2-a409-67acbf113c32 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/e983108d-66c6-472e-bfc1-761f8a333569" status: 200 len: 1476 microversion: 2.1 time: 0.400036 Jan 15 20:52:44.383923 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 636/1345] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:52:43 2022] GET /compute/v2.1/servers/e983108d-66c6-472e-bfc1-761f8a333569 => generated 1476 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:52:44.420730 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-2a98f3d7-68e5-40a9-85db-f39c43128cc9 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] [instance: e3b7a713-3f0d-43e2-b466-6637bc567256] Going to try to terminate instance {{(pid=129366) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 20:52:44.449167 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-343f93fc-ad1c-44d1-9375-28826aa50336 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:44.452159 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-343f93fc-ad1c-44d1-9375-28826aa50336 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] [instance: c4b0aaad-91ee-4e37-9a34-0b4d56e282d5] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:44.485988 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-343f93fc-ad1c-44d1-9375-28826aa50336 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:44.489077 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-343f93fc-ad1c-44d1-9375-28826aa50336 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:44.490043 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-343f93fc-ad1c-44d1-9375-28826aa50336 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:44.490498 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-343f93fc-ad1c-44d1-9375-28826aa50336 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:44.539957 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-343f93fc-ad1c-44d1-9375-28826aa50336 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] HTTP exception thrown: Instance c4b0aaad-91ee-4e37-9a34-0b4d56e282d5 could not be found. Jan 15 20:52:44.543255 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-343f93fc-ad1c-44d1-9375-28826aa50336 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Returning 404 to user: Instance c4b0aaad-91ee-4e37-9a34-0b4d56e282d5 could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:52:44.546390 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-343f93fc-ad1c-44d1-9375-28826aa50336 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] 10.222.0.46 "GET /compute/v2.1/servers/c4b0aaad-91ee-4e37-9a34-0b4d56e282d5" status: 404 len: 111 microversion: 2.1 time: 0.151929 Jan 15 20:52:44.549501 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 637/1346] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:52:44 2022] GET /compute/v2.1/servers/c4b0aaad-91ee-4e37-9a34-0b4d56e282d5 => generated 111 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:52:44.568156 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a18054ca-1cec-489b-8c36-66ff2eae2da5 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '.version_select at 0x7f30c911e820>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:44.644393 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-2a98f3d7-68e5-40a9-85db-f39c43128cc9 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] 10.222.0.46 "DELETE /compute/v2.1/servers/e3b7a713-3f0d-43e2-b466-6637bc567256" status: 204 len: 0 microversion: 2.1 time: 0.349824 Jan 15 20:52:44.647242 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 710/1347] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 20:52:44 2022] DELETE /compute/v2.1/servers/e3b7a713-3f0d-43e2-b466-6637bc567256 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 20:52:44.661866 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-aeba05ea-c9ad-4fa6-96b6-4a040d37d1ca tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:44.716077 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-aeba05ea-c9ad-4fa6-96b6-4a040d37d1ca tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] 10.222.0.46 "DELETE /compute/v2.1/os-server-groups/3fea0289-5bb6-4136-acf4-b883ed4fc4ee" status: 204 len: 0 microversion: 2.1 time: 0.067188 Jan 15 20:52:44.722325 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 711/1348] 10.222.0.46 () {58 vars in 1265 bytes} [Sat Jan 15 20:52:44 2022] DELETE /compute/v2.1/os-server-groups/3fea0289-5bb6-4136-acf4-b883ed4fc4ee => generated 0 bytes in 70 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 20:52:44.724806 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0a89099d-227e-49d0-bd63-f5a4308eed71 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:44.726807 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-0a89099d-227e-49d0-bd63-f5a4308eed71 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] [instance: e3b7a713-3f0d-43e2-b466-6637bc567256] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:44.744295 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0a89099d-227e-49d0-bd63-f5a4308eed71 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:44.745252 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0a89099d-227e-49d0-bd63-f5a4308eed71 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:44.747712 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0a89099d-227e-49d0-bd63-f5a4308eed71 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:44.748003 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0a89099d-227e-49d0-bd63-f5a4308eed71 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:44.946954 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-0a89099d-227e-49d0-bd63-f5a4308eed71 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d4a57cfaa145009ba9cc8f21d9e8ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4a26c8edac44c8b26fd4e43813412d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:52:44.958897 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0a89099d-227e-49d0-bd63-f5a4308eed71 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] 10.222.0.46 "GET /compute/v2.1/servers/e3b7a713-3f0d-43e2-b466-6637bc567256" status: 200 len: 1470 microversion: 2.1 time: 0.239538 Jan 15 20:52:44.960331 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 712/1349] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:52:44 2022] GET /compute/v2.1/servers/e3b7a713-3f0d-43e2-b466-6637bc567256 => generated 1470 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:52:44.965097 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1d73075f-9e81-4bbc-94da-4a2b33e73b26 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:44.965936 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-1d73075f-9e81-4bbc-94da-4a2b33e73b26 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] [instance: 3934550f-0131-4bd3-890b-edbaf4ccac0e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:44.973612 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1d73075f-9e81-4bbc-94da-4a2b33e73b26 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:44.974352 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1d73075f-9e81-4bbc-94da-4a2b33e73b26 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:44.975374 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1d73075f-9e81-4bbc-94da-4a2b33e73b26 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:44.976781 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1d73075f-9e81-4bbc-94da-4a2b33e73b26 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:45.005218 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-1d73075f-9e81-4bbc-94da-4a2b33e73b26 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] [instance: 3934550f-0131-4bd3-890b-edbaf4ccac0e] Going to try to terminate instance {{(pid=129366) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 20:52:45.151707 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-1d73075f-9e81-4bbc-94da-4a2b33e73b26 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] 10.222.0.46 "DELETE /compute/v2.1/servers/3934550f-0131-4bd3-890b-edbaf4ccac0e" status: 204 len: 0 microversion: 2.1 time: 0.188693 Jan 15 20:52:45.156611 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 713/1350] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 20:52:44 2022] DELETE /compute/v2.1/servers/3934550f-0131-4bd3-890b-edbaf4ccac0e => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 20:52:45.161816 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-18745cbe-a540-4159-8b3f-76203e90bd7c tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Calling method '.version_select at 0x7f30c983c310>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:45.959618 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a18054ca-1cec-489b-8c36-66ff2eae2da5 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "DELETE /compute/v2.1/images/02c98032-11ad-4694-be3b-e856797c5802" status: 204 len: 0 microversion: 2.1 time: 1.406655 Jan 15 20:52:45.960408 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 638/1351] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:52:44 2022] DELETE /compute/v2.1/images/02c98032-11ad-4694-be3b-e856797c5802 => generated 0 bytes in 1410 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 20:52:45.965358 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-544fab63-366b-4f32-8d42-f94bb39e9e7e tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:52:45.966938 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-544fab63-366b-4f32-8d42-f94bb39e9e7e tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 57bd310f-a604-40de-9c25-882284f4a17b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:45.977763 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-544fab63-366b-4f32-8d42-f94bb39e9e7e tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:45.978342 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-544fab63-366b-4f32-8d42-f94bb39e9e7e tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:45.980243 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-544fab63-366b-4f32-8d42-f94bb39e9e7e tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:45.980754 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-544fab63-366b-4f32-8d42-f94bb39e9e7e tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:46.027868 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-18745cbe-a540-4159-8b3f-76203e90bd7c tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] 10.222.0.46 "GET /compute/v2.1/images/a6c696b9-7dd9-4e26-aa78-20da08a049b8" status: 200 len: 1427 microversion: 2.1 time: 0.868924 Jan 15 20:52:46.030640 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 714/1352] 10.222.0.46 () {58 vars in 1232 bytes} [Sat Jan 15 20:52:45 2022] GET /compute/v2.1/images/a6c696b9-7dd9-4e26-aa78-20da08a049b8 => generated 1427 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:52:46.041266 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-89aa2bb9-9a0e-4d6e-a1a1-232da4161f77 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:46.043201 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-89aa2bb9-9a0e-4d6e-a1a1-232da4161f77 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] [instance: eb4f55a3-96ef-4194-8506-e430b262c1f0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:46.054191 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-89aa2bb9-9a0e-4d6e-a1a1-232da4161f77 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:46.054789 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-89aa2bb9-9a0e-4d6e-a1a1-232da4161f77 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:46.055656 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-89aa2bb9-9a0e-4d6e-a1a1-232da4161f77 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:46.056160 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-89aa2bb9-9a0e-4d6e-a1a1-232da4161f77 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:46.062212 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-544fab63-366b-4f32-8d42-f94bb39e9e7e tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/action" status: 200 len: 32621 microversion: 2.1 time: 0.100354 Jan 15 20:52:46.066896 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 639/1353] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:52:45 2022] POST /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/action => generated 32621 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:52:46.078195 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d844ea58-1bf9-494f-8fe4-03813dd0300c tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:46.081017 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d844ea58-1bf9-494f-8fe4-03813dd0300c tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: e983108d-66c6-472e-bfc1-761f8a333569] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:46.088978 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-89aa2bb9-9a0e-4d6e-a1a1-232da4161f77 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] [instance: eb4f55a3-96ef-4194-8506-e430b262c1f0] Going to try to terminate instance {{(pid=129366) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 20:52:46.097374 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d844ea58-1bf9-494f-8fe4-03813dd0300c tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:46.097951 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d844ea58-1bf9-494f-8fe4-03813dd0300c tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:46.100213 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d844ea58-1bf9-494f-8fe4-03813dd0300c tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:46.100804 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d844ea58-1bf9-494f-8fe4-03813dd0300c tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:46.215244 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-89aa2bb9-9a0e-4d6e-a1a1-232da4161f77 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] 10.222.0.46 "DELETE /compute/v2.1/servers/eb4f55a3-96ef-4194-8506-e430b262c1f0" status: 204 len: 0 microversion: 2.1 time: 0.181886 Jan 15 20:52:46.216133 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 715/1354] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 20:52:46 2022] DELETE /compute/v2.1/servers/eb4f55a3-96ef-4194-8506-e430b262c1f0 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 20:52:46.222103 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b9a98657-7cda-440f-b821-a0912ae39dc7 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:46.223156 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b9a98657-7cda-440f-b821-a0912ae39dc7 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] [instance: 067b97a2-ee1a-4d43-926c-11a8bfa2e332] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:46.238892 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b9a98657-7cda-440f-b821-a0912ae39dc7 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:46.239348 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b9a98657-7cda-440f-b821-a0912ae39dc7 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:46.240235 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b9a98657-7cda-440f-b821-a0912ae39dc7 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:46.240680 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b9a98657-7cda-440f-b821-a0912ae39dc7 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:46.290080 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b9a98657-7cda-440f-b821-a0912ae39dc7 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] [instance: 067b97a2-ee1a-4d43-926c-11a8bfa2e332] Going to try to terminate instance {{(pid=129366) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 20:52:46.393657 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-d844ea58-1bf9-494f-8fe4-03813dd0300c tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:52:46.403941 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d844ea58-1bf9-494f-8fe4-03813dd0300c tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/e983108d-66c6-472e-bfc1-761f8a333569" status: 200 len: 1476 microversion: 2.1 time: 0.335361 Jan 15 20:52:46.413972 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 640/1355] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:52:46 2022] GET /compute/v2.1/servers/e983108d-66c6-472e-bfc1-761f8a333569 => generated 1476 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:52:46.416587 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5be034ad-838c-4e5d-a705-011c7ed81ea8 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:46.419058 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-5be034ad-838c-4e5d-a705-011c7ed81ea8 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] [instance: e3b7a713-3f0d-43e2-b466-6637bc567256] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:46.436406 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5be034ad-838c-4e5d-a705-011c7ed81ea8 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:46.437262 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5be034ad-838c-4e5d-a705-011c7ed81ea8 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:46.440159 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5be034ad-838c-4e5d-a705-011c7ed81ea8 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:46.441708 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5be034ad-838c-4e5d-a705-011c7ed81ea8 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:46.472762 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b9a98657-7cda-440f-b821-a0912ae39dc7 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "DELETE /compute/v2.1/servers/067b97a2-ee1a-4d43-926c-11a8bfa2e332" status: 204 len: 0 microversion: 2.1 time: 0.253173 Jan 15 20:52:46.474642 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 716/1356] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 20:52:46 2022] DELETE /compute/v2.1/servers/067b97a2-ee1a-4d43-926c-11a8bfa2e332 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 20:52:46.494617 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-cfbd9d24-1668-4d5d-b185-3a00f844a847 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:46.495932 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-cfbd9d24-1668-4d5d-b185-3a00f844a847 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] [instance: 3934550f-0131-4bd3-890b-edbaf4ccac0e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:46.510632 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cfbd9d24-1668-4d5d-b185-3a00f844a847 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:46.512593 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cfbd9d24-1668-4d5d-b185-3a00f844a847 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:46.513704 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cfbd9d24-1668-4d5d-b185-3a00f844a847 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:46.517459 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cfbd9d24-1668-4d5d-b185-3a00f844a847 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:47.026514 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-5be034ad-838c-4e5d-a705-011c7ed81ea8 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d4a57cfaa145009ba9cc8f21d9e8ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4a26c8edac44c8b26fd4e43813412d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:52:47.040088 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5be034ad-838c-4e5d-a705-011c7ed81ea8 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] 10.222.0.46 "GET /compute/v2.1/servers/e3b7a713-3f0d-43e2-b466-6637bc567256" status: 200 len: 1470 microversion: 2.1 time: 0.629349 Jan 15 20:52:47.043155 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 641/1357] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:52:46 2022] GET /compute/v2.1/servers/e3b7a713-3f0d-43e2-b466-6637bc567256 => generated 1470 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:52:47.053527 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-19034948-99ef-4014-b07f-b93957a92702 req-04b1714b-7fc0-4d3c-b357-07c0a2ca8d36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4b0aaad-91ee-4e37-9a34-0b4d56e282d5", "name": "network-vif-deleted", "tag": "b044e748-14c3-4e19-b93b-659f2cfe547b"}, {"server_uuid": "f89db7df-a7e8-4138-8949-d76e2ccd282d", "name": "network-vif-deleted", "tag": "903fc68a-fde5-420c-8bcf-272fee77950b"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:52:47.059050 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:52:47.059050 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:52:47.084775 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-19034948-99ef-4014-b07f-b93957a92702 req-04b1714b-7fc0-4d3c-b357-07c0a2ca8d36 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:47.085782 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-19034948-99ef-4014-b07f-b93957a92702 req-04b1714b-7fc0-4d3c-b357-07c0a2ca8d36 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:47.123757 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-19034948-99ef-4014-b07f-b93957a92702 req-04b1714b-7fc0-4d3c-b357-07c0a2ca8d36 service nova] Creating event network-vif-deleted:b044e748-14c3-4e19-b93b-659f2cfe547b for instance c4b0aaad-91ee-4e37-9a34-0b4d56e282d5 on nch2-master-1 Jan 15 20:52:47.124575 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-19034948-99ef-4014-b07f-b93957a92702 req-04b1714b-7fc0-4d3c-b357-07c0a2ca8d36 service nova] Creating event network-vif-deleted:903fc68a-fde5-420c-8bcf-272fee77950b for instance f89db7df-a7e8-4138-8949-d76e2ccd282d on nch2-master-1 Jan 15 20:52:47.141232 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-19034948-99ef-4014-b07f-b93957a92702 req-04b1714b-7fc0-4d3c-b357-07c0a2ca8d36 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.095065 Jan 15 20:52:47.144416 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 642/1358] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:52:47 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:52:47.151997 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-51f7f868-b770-4eb7-a6d0-eb7df6526018 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-863117720", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "networks": [{"uuid": "364a58d7-d200-4c35-b6bd-a666c20a1fe8"}]}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:52:47.257837 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-cfbd9d24-1668-4d5d-b185-3a00f844a847 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc38f86758f9416b9e7f6915de0359d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8cfe33be708428abef52f5e8e25621b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:52:47.264250 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.network.neutron [None req-51f7f868-b770-4eb7-a6d0-eb7df6526018 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] validate_networks() for [('364a58d7-d200-4c35-b6bd-a666c20a1fe8', None, None, None, None, None)] {{(pid=129365) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 20:52:47.289162 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-cfbd9d24-1668-4d5d-b185-3a00f844a847 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] 10.222.0.46 "GET /compute/v2.1/servers/3934550f-0131-4bd3-890b-edbaf4ccac0e" status: 200 len: 1475 microversion: 2.1 time: 0.810352 Jan 15 20:52:47.304419 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 717/1359] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:52:46 2022] GET /compute/v2.1/servers/3934550f-0131-4bd3-890b-edbaf4ccac0e => generated 1475 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:52:47.317839 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-df213d6b-c084-490f-a860-2f241cd1ec83 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Calling method '.version_select at 0x7f30c92893a0>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:47.441765 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-df213d6b-c084-490f-a860-2f241cd1ec83 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] 10.222.0.46 "GET /compute/v2.1/images/a6c696b9-7dd9-4e26-aa78-20da08a049b8" status: 200 len: 1427 microversion: 2.1 time: 0.133188 Jan 15 20:52:47.447436 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 718/1360] 10.222.0.46 () {58 vars in 1232 bytes} [Sat Jan 15 20:52:47 2022] GET /compute/v2.1/images/a6c696b9-7dd9-4e26-aa78-20da08a049b8 => generated 1427 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:52:47.452203 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4ce99091-2696-415d-b326-2f492436de45 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:52:47.453662 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-4ce99091-2696-415d-b326-2f492436de45 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 57bd310f-a604-40de-9c25-882284f4a17b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:47.473169 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4ce99091-2696-415d-b326-2f492436de45 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:47.473960 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4ce99091-2696-415d-b326-2f492436de45 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:47.476612 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4ce99091-2696-415d-b326-2f492436de45 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:47.478156 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4ce99091-2696-415d-b326-2f492436de45 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:47.585155 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-4ce99091-2696-415d-b326-2f492436de45 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/action" status: 200 len: 32621 microversion: 2.1 time: 0.140231 Jan 15 20:52:47.588685 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 719/1361] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:52:47 2022] POST /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/action => generated 32621 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:52:47.614429 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-204d4878-c816-4416-a414-eb7e817467c5 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:47.619484 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-204d4878-c816-4416-a414-eb7e817467c5 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: e983108d-66c6-472e-bfc1-761f8a333569] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:47.646215 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-204d4878-c816-4416-a414-eb7e817467c5 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:47.648072 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-204d4878-c816-4416-a414-eb7e817467c5 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:47.652372 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-204d4878-c816-4416-a414-eb7e817467c5 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:47.654352 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-204d4878-c816-4416-a414-eb7e817467c5 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:48.771548 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-204d4878-c816-4416-a414-eb7e817467c5 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:52:48.797335 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-204d4878-c816-4416-a414-eb7e817467c5 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/e983108d-66c6-472e-bfc1-761f8a333569" status: 200 len: 1476 microversion: 2.1 time: 1.189094 Jan 15 20:52:48.798016 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 720/1362] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:52:47 2022] GET /compute/v2.1/servers/e983108d-66c6-472e-bfc1-761f8a333569 => generated 1476 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:52:48.817753 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-2df464b3-e1c8-4c97-9b09-e0ce4c1ee5aa tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:48.827446 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-2df464b3-e1c8-4c97-9b09-e0ce4c1ee5aa tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] [instance: e3b7a713-3f0d-43e2-b466-6637bc567256] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:48.860649 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2df464b3-e1c8-4c97-9b09-e0ce4c1ee5aa tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:48.864242 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2df464b3-e1c8-4c97-9b09-e0ce4c1ee5aa tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:48.866696 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2df464b3-e1c8-4c97-9b09-e0ce4c1ee5aa tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:48.867162 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2df464b3-e1c8-4c97-9b09-e0ce4c1ee5aa tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:48.892593 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-2df464b3-e1c8-4c97-9b09-e0ce4c1ee5aa tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] HTTP exception thrown: Instance e3b7a713-3f0d-43e2-b466-6637bc567256 could not be found. Jan 15 20:52:48.893779 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-2df464b3-e1c8-4c97-9b09-e0ce4c1ee5aa tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Returning 404 to user: Instance e3b7a713-3f0d-43e2-b466-6637bc567256 could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:52:48.901027 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-2df464b3-e1c8-4c97-9b09-e0ce4c1ee5aa tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] 10.222.0.46 "GET /compute/v2.1/servers/e3b7a713-3f0d-43e2-b466-6637bc567256" status: 404 len: 111 microversion: 2.1 time: 0.092963 Jan 15 20:52:48.905568 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 721/1363] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:52:48 2022] GET /compute/v2.1/servers/e3b7a713-3f0d-43e2-b466-6637bc567256 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:52:48.911648 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4674d010-a637-4b6f-84f3-2239f1a19f63 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-158756682", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "3ee7d78d-61a7-4a1d-ba2d-976bd0bf9fe2"}], "block_device_mapping_v2": [{"uuid": "de865fb1-204c-482c-a650-62332e1f854e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:52:49.047583 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.network.neutron [None req-4674d010-a637-4b6f-84f3-2239f1a19f63 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] validate_networks() for [('3ee7d78d-61a7-4a1d-ba2d-976bd0bf9fe2', None, None, None, None, None)] {{(pid=129366) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 20:52:49.088797 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-51f7f868-b770-4eb7-a6d0-eb7df6526018 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Flavor limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 20:52:49.098258 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-51f7f868-b770-4eb7-a6d0-eb7df6526018 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Image limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 20:52:49.099352 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-51f7f868-b770-4eb7-a6d0-eb7df6526018 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Flavor pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 20:52:49.100055 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-51f7f868-b770-4eb7-a6d0-eb7df6526018 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Image pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 20:52:49.100690 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-51f7f868-b770-4eb7-a6d0-eb7df6526018 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 20:52:49.124207 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-51f7f868-b770-4eb7-a6d0-eb7df6526018 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:49.124980 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-51f7f868-b770-4eb7-a6d0-eb7df6526018 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:49.128425 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-51f7f868-b770-4eb7-a6d0-eb7df6526018 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:49.129267 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-51f7f868-b770-4eb7-a6d0-eb7df6526018 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:49.182099 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-51f7f868-b770-4eb7-a6d0-eb7df6526018 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Getting quotas for project 31dd217e7fd648b4a78c0c32ff1c95f4. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:52:49.193605 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-51f7f868-b770-4eb7-a6d0-eb7df6526018 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Getting quotas for user b55be87ae7f14b499ab2cd6fc5538988 and project 31dd217e7fd648b4a78c0c32ff1c95f4. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:52:49.218572 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-51f7f868-b770-4eb7-a6d0-eb7df6526018 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Going to run 1 instances... {{(pid=129365) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 20:52:49.222801 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-51f7f868-b770-4eb7-a6d0-eb7df6526018 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] [instance: b1d27142-a9e4-440b-a719-d2059db11e79] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129365) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 20:52:49.294795 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-51f7f868-b770-4eb7-a6d0-eb7df6526018 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.147867 Jan 15 20:52:49.296040 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 643/1364] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 20:52:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 2151 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 20:52:49.300730 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3caa85bc-6a06-456d-ae29-0cac332c9a6b tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:49.301818 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-3caa85bc-6a06-456d-ae29-0cac332c9a6b tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] [instance: 3934550f-0131-4bd3-890b-edbaf4ccac0e] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:49.309409 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3caa85bc-6a06-456d-ae29-0cac332c9a6b tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:49.310390 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3caa85bc-6a06-456d-ae29-0cac332c9a6b tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:49.311413 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3caa85bc-6a06-456d-ae29-0cac332c9a6b tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:49.311999 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3caa85bc-6a06-456d-ae29-0cac332c9a6b tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:49.331277 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-3caa85bc-6a06-456d-ae29-0cac332c9a6b tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] HTTP exception thrown: Instance 3934550f-0131-4bd3-890b-edbaf4ccac0e could not be found. Jan 15 20:52:49.332368 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3caa85bc-6a06-456d-ae29-0cac332c9a6b tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Returning 404 to user: Instance 3934550f-0131-4bd3-890b-edbaf4ccac0e could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:52:49.333575 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3caa85bc-6a06-456d-ae29-0cac332c9a6b tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] 10.222.0.46 "GET /compute/v2.1/servers/3934550f-0131-4bd3-890b-edbaf4ccac0e" status: 404 len: 111 microversion: 2.1 time: 0.036271 Jan 15 20:52:49.334749 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 644/1365] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:52:49 2022] GET /compute/v2.1/servers/3934550f-0131-4bd3-890b-edbaf4ccac0e => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:52:49.341107 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d89b71de-4129-45db-85c0-d4fbdb2a241d tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Calling method '.version_select at 0x7f30c8ff4940>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:49.436424 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d89b71de-4129-45db-85c0-d4fbdb2a241d tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] 10.222.0.46 "GET /compute/v2.1/images/a6c696b9-7dd9-4e26-aa78-20da08a049b8" status: 200 len: 1427 microversion: 2.1 time: 0.100209 Jan 15 20:52:49.437122 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 645/1366] 10.222.0.46 () {58 vars in 1232 bytes} [Sat Jan 15 20:52:49 2022] GET /compute/v2.1/images/a6c696b9-7dd9-4e26-aa78-20da08a049b8 => generated 1427 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:52:49.460320 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-12358b35-24e0-4013-9610-e674970bdaf1 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:52:49.464427 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-12358b35-24e0-4013-9610-e674970bdaf1 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 57bd310f-a604-40de-9c25-882284f4a17b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:49.482571 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-12358b35-24e0-4013-9610-e674970bdaf1 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:49.487922 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-12358b35-24e0-4013-9610-e674970bdaf1 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:49.489153 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-12358b35-24e0-4013-9610-e674970bdaf1 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:49.489768 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-12358b35-24e0-4013-9610-e674970bdaf1 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:49.589725 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-12358b35-24e0-4013-9610-e674970bdaf1 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/action" status: 200 len: 32621 microversion: 2.1 time: 0.145694 Jan 15 20:52:49.594366 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 646/1367] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:52:49 2022] POST /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/action => generated 32621 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:52:49.609902 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-b83d347a-85db-47af-ae63-467a7b318c6d req-93dd3a1e-0c0b-42af-a087-71dac7aea11b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "067b97a2-ee1a-4d43-926c-11a8bfa2e332", "name": "network-vif-unplugged", "status": "completed", "tag": "2dedf195-b886-49e9-99b8-57405251268c"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:52:49.612788 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:52:49.612788 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:52:49.632229 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-b83d347a-85db-47af-ae63-467a7b318c6d req-93dd3a1e-0c0b-42af-a087-71dac7aea11b service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:49.633093 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-b83d347a-85db-47af-ae63-467a7b318c6d req-93dd3a1e-0c0b-42af-a087-71dac7aea11b service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:49.656524 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-b83d347a-85db-47af-ae63-467a7b318c6d req-93dd3a1e-0c0b-42af-a087-71dac7aea11b service nova] Creating event network-vif-unplugged:2dedf195-b886-49e9-99b8-57405251268c for instance 067b97a2-ee1a-4d43-926c-11a8bfa2e332 on nch2-master-1 Jan 15 20:52:49.674248 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-b83d347a-85db-47af-ae63-467a7b318c6d req-93dd3a1e-0c0b-42af-a087-71dac7aea11b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.077576 Jan 15 20:52:49.678718 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 647/1368] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:52:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:52:49.692915 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8cf7ad4f-c09d-48dc-ab53-cdef0dc14673 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:49.693694 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-8cf7ad4f-c09d-48dc-ab53-cdef0dc14673 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] [instance: b191ed6c-040a-4702-8e15-86272f9d1847] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:49.710211 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8cf7ad4f-c09d-48dc-ab53-cdef0dc14673 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:49.710985 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8cf7ad4f-c09d-48dc-ab53-cdef0dc14673 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:49.712345 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8cf7ad4f-c09d-48dc-ab53-cdef0dc14673 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:49.714057 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8cf7ad4f-c09d-48dc-ab53-cdef0dc14673 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:49.777562 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-8cf7ad4f-c09d-48dc-ab53-cdef0dc14673 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] [instance: b191ed6c-040a-4702-8e15-86272f9d1847] Going to try to terminate instance {{(pid=129365) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 20:52:49.950104 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-8cf7ad4f-c09d-48dc-ab53-cdef0dc14673 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] 10.222.0.46 "DELETE /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847" status: 204 len: 0 microversion: 2.1 time: 0.268996 Jan 15 20:52:49.951045 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 648/1369] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 20:52:49 2022] DELETE /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 20:52:49.957283 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-a08f77e6-7858-460b-b402-d3997a313ab2 req-6806f6d9-ad8c-4114-92d6-775304660045 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3b7a713-3f0d-43e2-b466-6637bc567256", "name": "network-vif-deleted", "tag": "b6f66c62-4ffd-4b3d-b12d-4d0ef6d8d0d4"}, {"server_uuid": "3934550f-0131-4bd3-890b-edbaf4ccac0e", "name": "network-vif-deleted", "tag": "d2632d9a-333c-439e-b179-55d658dedee2"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:52:49.961925 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:52:49.961925 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:52:50.002406 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-a08f77e6-7858-460b-b402-d3997a313ab2 req-6806f6d9-ad8c-4114-92d6-775304660045 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:50.002994 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-a08f77e6-7858-460b-b402-d3997a313ab2 req-6806f6d9-ad8c-4114-92d6-775304660045 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:50.033432 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-a08f77e6-7858-460b-b402-d3997a313ab2 req-6806f6d9-ad8c-4114-92d6-775304660045 service nova] Creating event network-vif-deleted:b6f66c62-4ffd-4b3d-b12d-4d0ef6d8d0d4 for instance e3b7a713-3f0d-43e2-b466-6637bc567256 on nch1-master-1 Jan 15 20:52:50.045503 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-a08f77e6-7858-460b-b402-d3997a313ab2 req-6806f6d9-ad8c-4114-92d6-775304660045 service nova] Creating event network-vif-deleted:d2632d9a-333c-439e-b179-55d658dedee2 for instance 3934550f-0131-4bd3-890b-edbaf4ccac0e on nch2-master-1 Jan 15 20:52:50.058547 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-a08f77e6-7858-460b-b402-d3997a313ab2 req-6806f6d9-ad8c-4114-92d6-775304660045 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.105916 Jan 15 20:52:50.062196 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 649/1370] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:52:49 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:52:50.087223 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-cd66b140-2f32-465a-bd47-72e4f99d6780 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:50.089943 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-cd66b140-2f32-465a-bd47-72e4f99d6780 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] [instance: b1d27142-a9e4-440b-a719-d2059db11e79] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:50.341624 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-cd66b140-2f32-465a-bd47-72e4f99d6780 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55be87ae7f14b499ab2cd6fc5538988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd217e7fd648b4a78c0c32ff1c95f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:52:50.382656 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-cd66b140-2f32-465a-bd47-72e4f99d6780 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "GET /compute/v2.1/servers/b1d27142-a9e4-440b-a719-d2059db11e79" status: 200 len: 1207 microversion: 2.1 time: 0.307805 Jan 15 20:52:50.398340 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 650/1371] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:52:50 2022] GET /compute/v2.1/servers/b1d27142-a9e4-440b-a719-d2059db11e79 => generated 1207 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:52:50.404484 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-843ccafd-340c-4b9d-9e74-39dcf7b6dfed tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:50.405130 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-843ccafd-340c-4b9d-9e74-39dcf7b6dfed tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] [instance: eb4f55a3-96ef-4194-8506-e430b262c1f0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:50.441558 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-843ccafd-340c-4b9d-9e74-39dcf7b6dfed tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:50.442143 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-843ccafd-340c-4b9d-9e74-39dcf7b6dfed tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:50.442949 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-843ccafd-340c-4b9d-9e74-39dcf7b6dfed tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:50.443592 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-843ccafd-340c-4b9d-9e74-39dcf7b6dfed tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:50.480738 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-843ccafd-340c-4b9d-9e74-39dcf7b6dfed tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] HTTP exception thrown: Instance eb4f55a3-96ef-4194-8506-e430b262c1f0 could not be found. Jan 15 20:52:50.481393 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-843ccafd-340c-4b9d-9e74-39dcf7b6dfed tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Returning 404 to user: Instance eb4f55a3-96ef-4194-8506-e430b262c1f0 could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:52:50.482288 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-843ccafd-340c-4b9d-9e74-39dcf7b6dfed tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] 10.222.0.46 "GET /compute/v2.1/servers/eb4f55a3-96ef-4194-8506-e430b262c1f0" status: 404 len: 111 microversion: 2.1 time: 0.082151 Jan 15 20:52:50.486022 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 651/1372] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:52:50 2022] GET /compute/v2.1/servers/eb4f55a3-96ef-4194-8506-e430b262c1f0 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:52:50.490803 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-870ce121-945b-469f-a785-61ed9653c19c tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:50.491411 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-870ce121-945b-469f-a785-61ed9653c19c tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: e983108d-66c6-472e-bfc1-761f8a333569] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:50.506167 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-870ce121-945b-469f-a785-61ed9653c19c tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:50.506971 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-870ce121-945b-469f-a785-61ed9653c19c tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:50.507793 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-870ce121-945b-469f-a785-61ed9653c19c tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:50.508258 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-870ce121-945b-469f-a785-61ed9653c19c tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:50.928874 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-870ce121-945b-469f-a785-61ed9653c19c tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:52:50.940916 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-870ce121-945b-469f-a785-61ed9653c19c tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/e983108d-66c6-472e-bfc1-761f8a333569" status: 200 len: 1476 microversion: 2.1 time: 0.450111 Jan 15 20:52:50.942145 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 652/1373] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:52:50 2022] GET /compute/v2.1/servers/e983108d-66c6-472e-bfc1-761f8a333569 => generated 1476 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:52:50.952313 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-fff90484-210f-4316-b800-881ecc4a46a0 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:50.957659 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-fff90484-210f-4316-b800-881ecc4a46a0 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] [instance: b191ed6c-040a-4702-8e15-86272f9d1847] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:50.975150 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fff90484-210f-4316-b800-881ecc4a46a0 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:50.986799 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fff90484-210f-4316-b800-881ecc4a46a0 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:50.990753 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fff90484-210f-4316-b800-881ecc4a46a0 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:50.991209 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fff90484-210f-4316-b800-881ecc4a46a0 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:51.130158 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-4674d010-a637-4b6f-84f3-2239f1a19f63 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Flavor limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 20:52:51.131169 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-4674d010-a637-4b6f-84f3-2239f1a19f63 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Image limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 20:52:51.132132 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-4674d010-a637-4b6f-84f3-2239f1a19f63 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Flavor pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 20:52:51.132704 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-4674d010-a637-4b6f-84f3-2239f1a19f63 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Image pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 20:52:51.133339 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-4674d010-a637-4b6f-84f3-2239f1a19f63 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 20:52:51.149894 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4674d010-a637-4b6f-84f3-2239f1a19f63 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:51.150734 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4674d010-a637-4b6f-84f3-2239f1a19f63 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:51.155969 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4674d010-a637-4b6f-84f3-2239f1a19f63 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:51.156778 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4674d010-a637-4b6f-84f3-2239f1a19f63 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:51.196686 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-4674d010-a637-4b6f-84f3-2239f1a19f63 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Getting quotas for project c3ede5f7e26d484fb1c6f18819a90e3f. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:52:51.215239 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-4674d010-a637-4b6f-84f3-2239f1a19f63 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Getting quotas for user a15f22e0573c4433b35a46c5245e30f9 and project c3ede5f7e26d484fb1c6f18819a90e3f. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:52:51.367327 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-4674d010-a637-4b6f-84f3-2239f1a19f63 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Going to run 1 instances... {{(pid=129366) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 20:52:51.370034 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-4674d010-a637-4b6f-84f3-2239f1a19f63 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] [instance: d94de6c9-be7d-4101-9f88-304b8a4ce8d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='de865fb1-204c-482c-a650-62332e1f854e',volume_size=None,volume_type=None)] {{(pid=129366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 20:52:51.503194 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-fff90484-210f-4316-b800-881ecc4a46a0 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d4a57cfaa145009ba9cc8f21d9e8ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4a26c8edac44c8b26fd4e43813412d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:52:51.510786 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-fff90484-210f-4316-b800-881ecc4a46a0 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] 10.222.0.46 "GET /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847" status: 200 len: 1469 microversion: 2.1 time: 0.567429 Jan 15 20:52:51.511333 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 653/1374] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:52:50 2022] GET /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847 => generated 1469 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:52:51.520605 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-029f1b5f-a11c-48e3-9e6f-d05b410715cd tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Calling method '.version_select at 0x7f30c9031af0>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:51.593139 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-4674d010-a637-4b6f-84f3-2239f1a19f63 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.686175 Jan 15 20:52:51.594459 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 722/1375] 10.222.0.46 () {62 vars in 1187 bytes} [Sat Jan 15 20:52:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 2688 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jan 15 20:52:51.599773 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f4413f8d-1331-4d9b-843a-9b31330e9837 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:51.616339 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-029f1b5f-a11c-48e3-9e6f-d05b410715cd tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] 10.222.0.46 "GET /compute/v2.1/images/a6c696b9-7dd9-4e26-aa78-20da08a049b8" status: 200 len: 1427 microversion: 2.1 time: 0.101119 Jan 15 20:52:51.617884 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 654/1376] 10.222.0.46 () {58 vars in 1232 bytes} [Sat Jan 15 20:52:51 2022] GET /compute/v2.1/images/a6c696b9-7dd9-4e26-aa78-20da08a049b8 => generated 1427 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:52:51.628999 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-531c44d9-d29a-4497-9353-9bf40423f695 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:52:51.630385 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-531c44d9-d29a-4497-9353-9bf40423f695 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 57bd310f-a604-40de-9c25-882284f4a17b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:51.644479 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f4413f8d-1331-4d9b-843a-9b31330e9837 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] 10.222.0.46 "DELETE /compute/v2.1/os-server-groups/fea8424e-67ca-4452-9e88-e044ef8eadf9" status: 204 len: 0 microversion: 2.1 time: 0.048600 Jan 15 20:52:51.646020 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 723/1377] 10.222.0.46 () {58 vars in 1265 bytes} [Sat Jan 15 20:52:51 2022] DELETE /compute/v2.1/os-server-groups/fea8424e-67ca-4452-9e88-e044ef8eadf9 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 20:52:51.652064 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b6d222dc-c91e-4a2b-9dc4-bf0d5034dc65 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:51.655898 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b6d222dc-c91e-4a2b-9dc4-bf0d5034dc65 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] [instance: b1d27142-a9e4-440b-a719-d2059db11e79] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:51.665383 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b6d222dc-c91e-4a2b-9dc4-bf0d5034dc65 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:51.666504 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b6d222dc-c91e-4a2b-9dc4-bf0d5034dc65 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:51.667077 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-531c44d9-d29a-4497-9353-9bf40423f695 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:51.667544 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-531c44d9-d29a-4497-9353-9bf40423f695 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:51.668535 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b6d222dc-c91e-4a2b-9dc4-bf0d5034dc65 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:51.669273 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b6d222dc-c91e-4a2b-9dc4-bf0d5034dc65 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:51.676424 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-531c44d9-d29a-4497-9353-9bf40423f695 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:51.676973 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-531c44d9-d29a-4497-9353-9bf40423f695 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:51.746039 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-531c44d9-d29a-4497-9353-9bf40423f695 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/action" status: 200 len: 32621 microversion: 2.1 time: 0.124002 Jan 15 20:52:51.748493 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 655/1378] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:52:51 2022] POST /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/action => generated 32621 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:52:51.762800 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ed1ce417-4f2d-4b51-9b41-2dee03a0732a tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:51.766747 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ed1ce417-4f2d-4b51-9b41-2dee03a0732a tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] [instance: d94de6c9-be7d-4101-9f88-304b8a4ce8d7] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:51.817710 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-b6d222dc-c91e-4a2b-9dc4-bf0d5034dc65 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55be87ae7f14b499ab2cd6fc5538988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd217e7fd648b4a78c0c32ff1c95f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:52:51.829479 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b6d222dc-c91e-4a2b-9dc4-bf0d5034dc65 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "GET /compute/v2.1/servers/b1d27142-a9e4-440b-a719-d2059db11e79" status: 200 len: 1265 microversion: 2.1 time: 0.181903 Jan 15 20:52:51.830149 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 724/1379] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:52:51 2022] GET /compute/v2.1/servers/b1d27142-a9e4-440b-a719-d2059db11e79 => generated 1265 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:52:51.848624 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7b18c8ec-860f-4643-9a30-7172717c3cfe tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:51.849166 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-7b18c8ec-860f-4643-9a30-7172717c3cfe tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] [instance: 1e63485c-6290-4e1d-82cf-5ae73069dd2e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:51.862883 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7b18c8ec-860f-4643-9a30-7172717c3cfe tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:51.868686 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7b18c8ec-860f-4643-9a30-7172717c3cfe tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:51.871247 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7b18c8ec-860f-4643-9a30-7172717c3cfe tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:51.872259 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7b18c8ec-860f-4643-9a30-7172717c3cfe tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:51.886640 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-ed1ce417-4f2d-4b51-9b41-2dee03a0732a tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:52:51.897151 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-ed1ce417-4f2d-4b51-9b41-2dee03a0732a tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:52:51.903569 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-ed1ce417-4f2d-4b51-9b41-2dee03a0732a tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:52:51.905616 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ed1ce417-4f2d-4b51-9b41-2dee03a0732a tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] 10.222.0.46 "GET /compute/v2.1/servers/d94de6c9-be7d-4101-9f88-304b8a4ce8d7" status: 200 len: 1103 microversion: 2.25 time: 0.155209 Jan 15 20:52:51.920439 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 656/1380] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:52:51 2022] GET /compute/v2.1/servers/d94de6c9-be7d-4101-9f88-304b8a4ce8d7 => generated 1103 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:52:51.924947 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-7b18c8ec-860f-4643-9a30-7172717c3cfe tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] [instance: 1e63485c-6290-4e1d-82cf-5ae73069dd2e] Going to try to terminate instance {{(pid=129366) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 20:52:51.961053 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-98dcee9e-6ac5-4030-ba16-7a3e7a06b353 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:51.961671 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-98dcee9e-6ac5-4030-ba16-7a3e7a06b353 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: e983108d-66c6-472e-bfc1-761f8a333569] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:51.978134 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-98dcee9e-6ac5-4030-ba16-7a3e7a06b353 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:51.978583 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-98dcee9e-6ac5-4030-ba16-7a3e7a06b353 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:51.980042 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-98dcee9e-6ac5-4030-ba16-7a3e7a06b353 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:51.980493 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-98dcee9e-6ac5-4030-ba16-7a3e7a06b353 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:52.118011 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7b18c8ec-860f-4643-9a30-7172717c3cfe tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] 10.222.0.46 "DELETE /compute/v2.1/servers/1e63485c-6290-4e1d-82cf-5ae73069dd2e" status: 204 len: 0 microversion: 2.1 time: 0.279815 Jan 15 20:52:52.120820 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 725/1381] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 20:52:51 2022] DELETE /compute/v2.1/servers/1e63485c-6290-4e1d-82cf-5ae73069dd2e => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 20:52:52.133737 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-2bcdee41-4645-42be-9691-cbce2e05b76a tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:52.135570 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-2bcdee41-4645-42be-9691-cbce2e05b76a tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] [instance: 1e63485c-6290-4e1d-82cf-5ae73069dd2e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:52.143174 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2bcdee41-4645-42be-9691-cbce2e05b76a tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:52.144195 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2bcdee41-4645-42be-9691-cbce2e05b76a tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:52.145606 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2bcdee41-4645-42be-9691-cbce2e05b76a tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:52.146273 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2bcdee41-4645-42be-9691-cbce2e05b76a tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:52.666885 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-98dcee9e-6ac5-4030-ba16-7a3e7a06b353 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:52:52.682731 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-98dcee9e-6ac5-4030-ba16-7a3e7a06b353 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/e983108d-66c6-472e-bfc1-761f8a333569" status: 200 len: 1476 microversion: 2.1 time: 0.725714 Jan 15 20:52:52.683645 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 657/1382] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:52:51 2022] GET /compute/v2.1/servers/e983108d-66c6-472e-bfc1-761f8a333569 => generated 1476 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:52:52.691135 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-2bcdee41-4645-42be-9691-cbce2e05b76a tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc38f86758f9416b9e7f6915de0359d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8cfe33be708428abef52f5e8e25621b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:52:52.707297 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-775dc8cf-dfa0-48f0-acbb-0b25115d7298 req-0db99f9d-4436-42d7-ac82-1a155a3dd562 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "067b97a2-ee1a-4d43-926c-11a8bfa2e332", "name": "network-vif-deleted", "tag": "2dedf195-b886-49e9-99b8-57405251268c"}, {"server_uuid": "eb4f55a3-96ef-4194-8506-e430b262c1f0", "name": "network-vif-deleted", "tag": "5a7af53b-c710-4979-b238-041a49a6e6d6"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:52:52.708291 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-2bcdee41-4645-42be-9691-cbce2e05b76a tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] 10.222.0.46 "GET /compute/v2.1/servers/1e63485c-6290-4e1d-82cf-5ae73069dd2e" status: 200 len: 1472 microversion: 2.1 time: 0.582182 Jan 15 20:52:52.709687 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 726/1383] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:52:52 2022] GET /compute/v2.1/servers/1e63485c-6290-4e1d-82cf-5ae73069dd2e => generated 1472 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:52:52.725435 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:52:52.725435 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:52:52.739687 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-6247b1da-89c1-4e59-8e87-9898c26ee49b tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:52.754792 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-6247b1da-89c1-4e59-8e87-9898c26ee49b tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] [instance: b191ed6c-040a-4702-8e15-86272f9d1847] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:52.766349 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6247b1da-89c1-4e59-8e87-9898c26ee49b tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:52.767960 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6247b1da-89c1-4e59-8e87-9898c26ee49b tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:52.768084 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-775dc8cf-dfa0-48f0-acbb-0b25115d7298 req-0db99f9d-4436-42d7-ac82-1a155a3dd562 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:52.768426 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-775dc8cf-dfa0-48f0-acbb-0b25115d7298 req-0db99f9d-4436-42d7-ac82-1a155a3dd562 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:52.769896 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6247b1da-89c1-4e59-8e87-9898c26ee49b tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:52.770530 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6247b1da-89c1-4e59-8e87-9898c26ee49b tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:52.805696 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-775dc8cf-dfa0-48f0-acbb-0b25115d7298 req-0db99f9d-4436-42d7-ac82-1a155a3dd562 service nova] Creating event network-vif-deleted:2dedf195-b886-49e9-99b8-57405251268c for instance 067b97a2-ee1a-4d43-926c-11a8bfa2e332 on nch2-master-1 Jan 15 20:52:52.806218 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-775dc8cf-dfa0-48f0-acbb-0b25115d7298 req-0db99f9d-4436-42d7-ac82-1a155a3dd562 service nova] Creating event network-vif-deleted:5a7af53b-c710-4979-b238-041a49a6e6d6 for instance eb4f55a3-96ef-4194-8506-e430b262c1f0 on nch2-master-1 Jan 15 20:52:52.822691 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-775dc8cf-dfa0-48f0-acbb-0b25115d7298 req-0db99f9d-4436-42d7-ac82-1a155a3dd562 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.136951 Jan 15 20:52:52.823623 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 658/1384] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:52:52 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:52:52.829518 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e4f1ba4e-7c70-40ff-b82b-73beb3847193 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Calling method '.version_select at 0x7f30c911ea60>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:52.896501 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e4f1ba4e-7c70-40ff-b82b-73beb3847193 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] 10.222.0.46 "GET /compute/v2.1/images/a6c696b9-7dd9-4e26-aa78-20da08a049b8" status: 200 len: 1427 microversion: 2.1 time: 0.071666 Jan 15 20:52:52.898285 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 659/1385] 10.222.0.46 () {58 vars in 1232 bytes} [Sat Jan 15 20:52:52 2022] GET /compute/v2.1/images/a6c696b9-7dd9-4e26-aa78-20da08a049b8 => generated 1427 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:52:52.903226 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-686af700-2f19-4b20-bb26-380faa7c1809 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:52:52.904247 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-686af700-2f19-4b20-bb26-380faa7c1809 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 57bd310f-a604-40de-9c25-882284f4a17b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:52.931260 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-686af700-2f19-4b20-bb26-380faa7c1809 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:52.932013 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-686af700-2f19-4b20-bb26-380faa7c1809 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:52.933074 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-686af700-2f19-4b20-bb26-380faa7c1809 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:52.933694 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-686af700-2f19-4b20-bb26-380faa7c1809 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:53.000685 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-686af700-2f19-4b20-bb26-380faa7c1809 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/action" status: 200 len: 32621 microversion: 2.1 time: 0.100816 Jan 15 20:52:53.006234 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 660/1386] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:52:52 2022] POST /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/action => generated 32621 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:52:53.012463 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f38b9505-75f1-4bda-abbf-3e901161e4a1 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:53.020492 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f38b9505-75f1-4bda-abbf-3e901161e4a1 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] [instance: b1d27142-a9e4-440b-a719-d2059db11e79] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:53.032038 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f38b9505-75f1-4bda-abbf-3e901161e4a1 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:53.040482 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f38b9505-75f1-4bda-abbf-3e901161e4a1 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:53.041698 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f38b9505-75f1-4bda-abbf-3e901161e4a1 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:53.047609 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f38b9505-75f1-4bda-abbf-3e901161e4a1 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:53.500085 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-6247b1da-89c1-4e59-8e87-9898c26ee49b tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d4a57cfaa145009ba9cc8f21d9e8ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4a26c8edac44c8b26fd4e43813412d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:52:53.510162 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-6247b1da-89c1-4e59-8e87-9898c26ee49b tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] 10.222.0.46 "GET /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847" status: 200 len: 1469 microversion: 2.1 time: 0.783663 Jan 15 20:52:53.515470 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 727/1387] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:52:52 2022] GET /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847 => generated 1469 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:52:53.520676 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8c46ce01-77f1-4516-92d5-9d16e840a200 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:53.525982 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-8c46ce01-77f1-4516-92d5-9d16e840a200 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] [instance: d94de6c9-be7d-4101-9f88-304b8a4ce8d7] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:53.540674 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8c46ce01-77f1-4516-92d5-9d16e840a200 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:53.546259 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8c46ce01-77f1-4516-92d5-9d16e840a200 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:53.547306 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8c46ce01-77f1-4516-92d5-9d16e840a200 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:53.558370 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8c46ce01-77f1-4516-92d5-9d16e840a200 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:53.884926 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-f38b9505-75f1-4bda-abbf-3e901161e4a1 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55be87ae7f14b499ab2cd6fc5538988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd217e7fd648b4a78c0c32ff1c95f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:52:53.905626 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f38b9505-75f1-4bda-abbf-3e901161e4a1 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "GET /compute/v2.1/servers/b1d27142-a9e4-440b-a719-d2059db11e79" status: 200 len: 1307 microversion: 2.1 time: 0.897449 Jan 15 20:52:53.906907 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 661/1388] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:52:53 2022] GET /compute/v2.1/servers/b1d27142-a9e4-440b-a719-d2059db11e79 => generated 1307 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:52:53.922752 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-184f9c0d-4bd5-46fd-9d6d-2c8c9bfb7bcf tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:53.925731 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-184f9c0d-4bd5-46fd-9d6d-2c8c9bfb7bcf tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: e983108d-66c6-472e-bfc1-761f8a333569] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:53.957080 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-184f9c0d-4bd5-46fd-9d6d-2c8c9bfb7bcf tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:53.958806 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-184f9c0d-4bd5-46fd-9d6d-2c8c9bfb7bcf tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:53.960366 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-184f9c0d-4bd5-46fd-9d6d-2c8c9bfb7bcf tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:53.961440 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-184f9c0d-4bd5-46fd-9d6d-2c8c9bfb7bcf tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:54.069889 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-8c46ce01-77f1-4516-92d5-9d16e840a200 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:52:54.082201 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-8c46ce01-77f1-4516-92d5-9d16e840a200 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:52:54.084201 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-8c46ce01-77f1-4516-92d5-9d16e840a200 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:52:54.085404 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-8c46ce01-77f1-4516-92d5-9d16e840a200 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] 10.222.0.46 "GET /compute/v2.1/servers/d94de6c9-be7d-4101-9f88-304b8a4ce8d7" status: 200 len: 1250 microversion: 2.25 time: 0.568527 Jan 15 20:52:54.086652 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 728/1389] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:52:53 2022] GET /compute/v2.1/servers/d94de6c9-be7d-4101-9f88-304b8a4ce8d7 => generated 1250 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:52:54.091224 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b4f9c89c-a404-49bb-b586-6d117e3b6092 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:54.106194 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b4f9c89c-a404-49bb-b586-6d117e3b6092 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] [instance: 1e63485c-6290-4e1d-82cf-5ae73069dd2e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:54.124611 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b4f9c89c-a404-49bb-b586-6d117e3b6092 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:54.125616 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b4f9c89c-a404-49bb-b586-6d117e3b6092 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:54.126483 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b4f9c89c-a404-49bb-b586-6d117e3b6092 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:54.132462 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b4f9c89c-a404-49bb-b586-6d117e3b6092 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:54.705752 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-184f9c0d-4bd5-46fd-9d6d-2c8c9bfb7bcf tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:52:54.725200 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-184f9c0d-4bd5-46fd-9d6d-2c8c9bfb7bcf tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/e983108d-66c6-472e-bfc1-761f8a333569" status: 200 len: 1476 microversion: 2.1 time: 0.806913 Jan 15 20:52:54.726449 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 662/1390] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:52:53 2022] GET /compute/v2.1/servers/e983108d-66c6-472e-bfc1-761f8a333569 => generated 1476 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:52:54.732142 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-44f328ca-4ef5-4b12-aaaf-83078fe47e70 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Calling method '.version_select at 0x7f30c97f81f0>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:54.798873 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-44f328ca-4ef5-4b12-aaaf-83078fe47e70 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] 10.222.0.46 "GET /compute/v2.1/images/a6c696b9-7dd9-4e26-aa78-20da08a049b8" status: 200 len: 1427 microversion: 2.1 time: 0.070825 Jan 15 20:52:54.799932 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 663/1391] 10.222.0.46 () {58 vars in 1232 bytes} [Sat Jan 15 20:52:54 2022] GET /compute/v2.1/images/a6c696b9-7dd9-4e26-aa78-20da08a049b8 => generated 1427 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:52:54.804582 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a2454137-04b1-4148-b8aa-00b05f14f350 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:52:54.806292 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a2454137-04b1-4148-b8aa-00b05f14f350 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 57bd310f-a604-40de-9c25-882284f4a17b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:54.813095 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-b4f9c89c-a404-49bb-b586-6d117e3b6092 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc38f86758f9416b9e7f6915de0359d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8cfe33be708428abef52f5e8e25621b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:52:54.834404 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b4f9c89c-a404-49bb-b586-6d117e3b6092 tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] 10.222.0.46 "GET /compute/v2.1/servers/1e63485c-6290-4e1d-82cf-5ae73069dd2e" status: 200 len: 1472 microversion: 2.1 time: 0.746578 Jan 15 20:52:54.853155 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a2454137-04b1-4148-b8aa-00b05f14f350 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:54.854431 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 729/1392] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:52:54 2022] GET /compute/v2.1/servers/1e63485c-6290-4e1d-82cf-5ae73069dd2e => generated 1472 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:52:54.857036 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a2454137-04b1-4148-b8aa-00b05f14f350 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:54.858148 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a2454137-04b1-4148-b8aa-00b05f14f350 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:54.861945 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a2454137-04b1-4148-b8aa-00b05f14f350 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:54.867094 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-bcd0d0b4-1d3b-4981-b45b-0d211585c989 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:54.868005 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-bcd0d0b4-1d3b-4981-b45b-0d211585c989 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] [instance: b191ed6c-040a-4702-8e15-86272f9d1847] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:54.884730 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bcd0d0b4-1d3b-4981-b45b-0d211585c989 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:54.885515 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bcd0d0b4-1d3b-4981-b45b-0d211585c989 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:54.886485 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bcd0d0b4-1d3b-4981-b45b-0d211585c989 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:54.887080 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bcd0d0b4-1d3b-4981-b45b-0d211585c989 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:54.917004 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-bcd0d0b4-1d3b-4981-b45b-0d211585c989 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] HTTP exception thrown: Instance b191ed6c-040a-4702-8e15-86272f9d1847 could not be found. Jan 15 20:52:54.918139 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-bcd0d0b4-1d3b-4981-b45b-0d211585c989 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] Returning 404 to user: Instance b191ed6c-040a-4702-8e15-86272f9d1847 could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:52:54.927540 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-bcd0d0b4-1d3b-4981-b45b-0d211585c989 tempest-ServersAdminTestJSON-1733858753 tempest-ServersAdminTestJSON-1733858753-project] 10.222.0.46 "GET /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847" status: 404 len: 111 microversion: 2.1 time: 0.071360 Jan 15 20:52:54.934414 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 730/1393] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:52:54 2022] GET /compute/v2.1/servers/b191ed6c-040a-4702-8e15-86272f9d1847 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:52:54.940120 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a2454137-04b1-4148-b8aa-00b05f14f350 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/action" status: 200 len: 32621 microversion: 2.1 time: 0.137474 Jan 15 20:52:54.944821 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 664/1394] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:52:54 2022] POST /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/action => generated 32621 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:52:54.945467 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-3fcdb0b7-7ae6-43fa-86ee-fac58d0a3189 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:54.946313 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-3fcdb0b7-7ae6-43fa-86ee-fac58d0a3189 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] [instance: b1d27142-a9e4-440b-a719-d2059db11e79] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:54.957074 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3fcdb0b7-7ae6-43fa-86ee-fac58d0a3189 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:54.958865 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3fcdb0b7-7ae6-43fa-86ee-fac58d0a3189 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:54.961846 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3fcdb0b7-7ae6-43fa-86ee-fac58d0a3189 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:54.962579 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3fcdb0b7-7ae6-43fa-86ee-fac58d0a3189 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:54.970089 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-242741d9-888c-419b-abfa-b88f2e4eef4d req-a8b93c75-e4e6-4c6a-8b73-8d3a6258df02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b191ed6c-040a-4702-8e15-86272f9d1847", "name": "network-vif-deleted", "tag": "bbe8394e-08fc-445b-a162-0e40259702ca"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:52:54.972395 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:52:54.972395 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:52:54.991697 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-242741d9-888c-419b-abfa-b88f2e4eef4d req-a8b93c75-e4e6-4c6a-8b73-8d3a6258df02 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:54.992153 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-242741d9-888c-419b-abfa-b88f2e4eef4d req-a8b93c75-e4e6-4c6a-8b73-8d3a6258df02 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:55.020494 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-242741d9-888c-419b-abfa-b88f2e4eef4d req-a8b93c75-e4e6-4c6a-8b73-8d3a6258df02 service nova] Creating event network-vif-deleted:bbe8394e-08fc-445b-a162-0e40259702ca for instance b191ed6c-040a-4702-8e15-86272f9d1847 on nch2-master-1 Jan 15 20:52:55.038551 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-242741d9-888c-419b-abfa-b88f2e4eef4d req-a8b93c75-e4e6-4c6a-8b73-8d3a6258df02 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077352 Jan 15 20:52:55.041183 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 665/1395] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:52:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:52:55.106175 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-dd5a490a-863f-4b76-84f8-db5c2a0a5df2 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:55.107148 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-dd5a490a-863f-4b76-84f8-db5c2a0a5df2 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] [instance: d94de6c9-be7d-4101-9f88-304b8a4ce8d7] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:55.125732 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dd5a490a-863f-4b76-84f8-db5c2a0a5df2 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:55.126222 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dd5a490a-863f-4b76-84f8-db5c2a0a5df2 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:55.127564 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dd5a490a-863f-4b76-84f8-db5c2a0a5df2 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:55.128003 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dd5a490a-863f-4b76-84f8-db5c2a0a5df2 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:55.520326 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-dd5a490a-863f-4b76-84f8-db5c2a0a5df2 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:52:55.550675 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-dd5a490a-863f-4b76-84f8-db5c2a0a5df2 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:52:55.554297 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-dd5a490a-863f-4b76-84f8-db5c2a0a5df2 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:52:55.557579 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-dd5a490a-863f-4b76-84f8-db5c2a0a5df2 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] 10.222.0.46 "GET /compute/v2.1/servers/d94de6c9-be7d-4101-9f88-304b8a4ce8d7" status: 200 len: 1250 microversion: 2.25 time: 0.456424 Jan 15 20:52:55.558209 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 666/1396] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:52:55 2022] GET /compute/v2.1/servers/d94de6c9-be7d-4101-9f88-304b8a4ce8d7 => generated 1250 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 15 20:52:55.684442 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-3fcdb0b7-7ae6-43fa-86ee-fac58d0a3189 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55be87ae7f14b499ab2cd6fc5538988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd217e7fd648b4a78c0c32ff1c95f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:52:55.697077 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-3fcdb0b7-7ae6-43fa-86ee-fac58d0a3189 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "GET /compute/v2.1/servers/b1d27142-a9e4-440b-a719-d2059db11e79" status: 200 len: 1307 microversion: 2.1 time: 0.761101 Jan 15 20:52:55.697671 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 731/1397] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:52:54 2022] GET /compute/v2.1/servers/b1d27142-a9e4-440b-a719-d2059db11e79 => generated 1307 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:52:55.748797 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9bc6d0f6-0a1c-4727-96af-328cff79fc69 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:55.749799 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-9bc6d0f6-0a1c-4727-96af-328cff79fc69 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: e983108d-66c6-472e-bfc1-761f8a333569] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:55.763050 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9bc6d0f6-0a1c-4727-96af-328cff79fc69 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:55.764155 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9bc6d0f6-0a1c-4727-96af-328cff79fc69 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:55.765013 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9bc6d0f6-0a1c-4727-96af-328cff79fc69 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:55.765659 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9bc6d0f6-0a1c-4727-96af-328cff79fc69 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:55.811298 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4adcd0db-af9b-4f9e-8f8e-5c7356c7db7e tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Calling method '.version_select at 0x7f30c8f96ca0>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:55.907375 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-4adcd0db-af9b-4f9e-8f8e-5c7356c7db7e tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] 10.222.0.46 "GET /compute/v2.1/images/a6c696b9-7dd9-4e26-aa78-20da08a049b8" status: 200 len: 1436 microversion: 2.1 time: 0.099585 Jan 15 20:52:55.908482 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 732/1398] 10.222.0.46 () {58 vars in 1232 bytes} [Sat Jan 15 20:52:55 2022] GET /compute/v2.1/images/a6c696b9-7dd9-4e26-aa78-20da08a049b8 => generated 1436 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:52:55.926792 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8754605e-5399-4025-ab00-40fbbb6804fc tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:55.927807 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-8754605e-5399-4025-ab00-40fbbb6804fc tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] [instance: 1e63485c-6290-4e1d-82cf-5ae73069dd2e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:55.935049 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8754605e-5399-4025-ab00-40fbbb6804fc tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:55.935739 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8754605e-5399-4025-ab00-40fbbb6804fc tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:55.936756 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8754605e-5399-4025-ab00-40fbbb6804fc tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:55.937456 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8754605e-5399-4025-ab00-40fbbb6804fc tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:56.137350 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-8754605e-5399-4025-ab00-40fbbb6804fc tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc38f86758f9416b9e7f6915de0359d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8cfe33be708428abef52f5e8e25621b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:52:56.147365 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-8754605e-5399-4025-ab00-40fbbb6804fc tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] 10.222.0.46 "GET /compute/v2.1/servers/1e63485c-6290-4e1d-82cf-5ae73069dd2e" status: 200 len: 1430 microversion: 2.1 time: 0.237453 Jan 15 20:52:56.147948 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 733/1399] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:52:55 2022] GET /compute/v2.1/servers/1e63485c-6290-4e1d-82cf-5ae73069dd2e => generated 1430 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:52:56.167227 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-bac5fc75-a1f8-4e3a-a70c-fe40a84cbcf3 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Calling method '.version_select at 0x7f30c935ddc0>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:56.231306 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-9bc6d0f6-0a1c-4727-96af-328cff79fc69 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:52:56.244304 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-bac5fc75-a1f8-4e3a-a70c-fe40a84cbcf3 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] 10.222.0.46 "GET /compute/v2.1/images/a6c696b9-7dd9-4e26-aa78-20da08a049b8" status: 200 len: 1436 microversion: 2.1 time: 0.095276 Jan 15 20:52:56.248427 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 734/1400] 10.222.0.46 () {58 vars in 1232 bytes} [Sat Jan 15 20:52:56 2022] GET /compute/v2.1/images/a6c696b9-7dd9-4e26-aa78-20da08a049b8 => generated 1436 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:52:56.254834 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-9bc6d0f6-0a1c-4727-96af-328cff79fc69 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/e983108d-66c6-472e-bfc1-761f8a333569" status: 200 len: 1476 microversion: 2.1 time: 0.515515 Jan 15 20:52:56.258278 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 667/1401] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:52:55 2022] GET /compute/v2.1/servers/e983108d-66c6-472e-bfc1-761f8a333569 => generated 1476 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:52:56.277360 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8873ef1e-4ca3-4001-8c4a-5c93d5c3208c tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:52:56.280664 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-7d63b1a2-251c-415a-9b02-2741db8f60cd tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:56.285445 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-8873ef1e-4ca3-4001-8c4a-5c93d5c3208c tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 57bd310f-a604-40de-9c25-882284f4a17b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:56.286344 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-7d63b1a2-251c-415a-9b02-2741db8f60cd tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] [instance: 1d163f47-49a0-41c9-991b-f42d16af67d1] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:56.316416 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8873ef1e-4ca3-4001-8c4a-5c93d5c3208c tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:56.317443 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7d63b1a2-251c-415a-9b02-2741db8f60cd tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:56.317902 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7d63b1a2-251c-415a-9b02-2741db8f60cd tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:56.320291 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8873ef1e-4ca3-4001-8c4a-5c93d5c3208c tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:56.321353 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8873ef1e-4ca3-4001-8c4a-5c93d5c3208c tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:56.324091 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8873ef1e-4ca3-4001-8c4a-5c93d5c3208c tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:56.325384 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7d63b1a2-251c-415a-9b02-2741db8f60cd tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:56.325842 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7d63b1a2-251c-415a-9b02-2741db8f60cd tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:56.425991 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-8873ef1e-4ca3-4001-8c4a-5c93d5c3208c tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/action" status: 200 len: 32621 microversion: 2.1 time: 0.173910 Jan 15 20:52:56.427533 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 735/1402] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:52:56 2022] POST /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/action => generated 32621 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:52:56.552077 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-e0c4b4a1-0b31-4cd1-9029-8578ed1dd7f9 req-e5ff507e-f099-4028-97e1-8d52458eef5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d163f47-49a0-41c9-991b-f42d16af67d1", "name": "network-vif-unplugged", "status": "completed", "tag": "26758887-8e21-4143-9b13-3eccf74a0d5b"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:52:56.556811 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:52:56.556811 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:52:56.599111 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-e0c4b4a1-0b31-4cd1-9029-8578ed1dd7f9 req-e5ff507e-f099-4028-97e1-8d52458eef5c service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:56.602001 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-e0c4b4a1-0b31-4cd1-9029-8578ed1dd7f9 req-e5ff507e-f099-4028-97e1-8d52458eef5c service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:56.644412 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-e0c4b4a1-0b31-4cd1-9029-8578ed1dd7f9 req-e5ff507e-f099-4028-97e1-8d52458eef5c service nova] Creating event network-vif-unplugged:26758887-8e21-4143-9b13-3eccf74a0d5b for instance 1d163f47-49a0-41c9-991b-f42d16af67d1 on nch2-master-1 Jan 15 20:52:56.663645 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-e0c4b4a1-0b31-4cd1-9029-8578ed1dd7f9 req-e5ff507e-f099-4028-97e1-8d52458eef5c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.119308 Jan 15 20:52:56.665496 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 736/1403] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:52:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:52:56.673182 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-61e838f4-c896-464a-9732-dc89ec602041 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:56.675919 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-61e838f4-c896-464a-9732-dc89ec602041 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] [instance: d94de6c9-be7d-4101-9f88-304b8a4ce8d7] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:56.689192 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-61e838f4-c896-464a-9732-dc89ec602041 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:56.690301 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-61e838f4-c896-464a-9732-dc89ec602041 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:56.693777 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-61e838f4-c896-464a-9732-dc89ec602041 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:56.694496 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-61e838f4-c896-464a-9732-dc89ec602041 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:56.809021 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-7d63b1a2-251c-415a-9b02-2741db8f60cd tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3352815cdc914c15b656b4d0d9511010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7b489c290846f48384c65e977ed644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:52:56.818589 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-7d63b1a2-251c-415a-9b02-2741db8f60cd tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] 10.222.0.46 "GET /compute/v2.1/servers/1d163f47-49a0-41c9-991b-f42d16af67d1" status: 200 len: 1466 microversion: 2.1 time: 0.547115 Jan 15 20:52:56.819586 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 668/1404] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:52:56 2022] GET /compute/v2.1/servers/1d163f47-49a0-41c9-991b-f42d16af67d1 => generated 1466 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:52:56.826631 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-853e747c-d782-4a97-a06f-066ca18c3e61 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:56.827252 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-853e747c-d782-4a97-a06f-066ca18c3e61 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] [instance: b1d27142-a9e4-440b-a719-d2059db11e79] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:56.841411 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-853e747c-d782-4a97-a06f-066ca18c3e61 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:56.842183 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-853e747c-d782-4a97-a06f-066ca18c3e61 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:56.843191 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-853e747c-d782-4a97-a06f-066ca18c3e61 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:56.843640 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-853e747c-d782-4a97-a06f-066ca18c3e61 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:57.162878 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-61e838f4-c896-464a-9732-dc89ec602041 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:52:57.173927 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-61e838f4-c896-464a-9732-dc89ec602041 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:52:57.175824 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-61e838f4-c896-464a-9732-dc89ec602041 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:52:57.177415 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-61e838f4-c896-464a-9732-dc89ec602041 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] 10.222.0.46 "GET /compute/v2.1/servers/d94de6c9-be7d-4101-9f88-304b8a4ce8d7" status: 200 len: 1280 microversion: 2.25 time: 0.510450 Jan 15 20:52:57.189414 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 737/1405] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:52:56 2022] GET /compute/v2.1/servers/d94de6c9-be7d-4101-9f88-304b8a4ce8d7 => generated 1280 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:52:57.207626 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9f46fa4e-e636-4ce2-a8db-b2f79c59cb7b tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Calling method '.version_select at 0x7f30c9150940>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:57.346144 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-853e747c-d782-4a97-a06f-066ca18c3e61 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55be87ae7f14b499ab2cd6fc5538988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd217e7fd648b4a78c0c32ff1c95f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:52:57.357660 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-853e747c-d782-4a97-a06f-066ca18c3e61 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "GET /compute/v2.1/servers/b1d27142-a9e4-440b-a719-d2059db11e79" status: 200 len: 1307 microversion: 2.1 time: 0.535464 Jan 15 20:52:57.361848 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 669/1406] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:52:56 2022] GET /compute/v2.1/servers/b1d27142-a9e4-440b-a719-d2059db11e79 => generated 1307 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:52:57.373089 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3965213e-75ad-4da9-baa3-cb707795f21d tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:57.377051 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-3965213e-75ad-4da9-baa3-cb707795f21d tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] [instance: 1e63485c-6290-4e1d-82cf-5ae73069dd2e] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:57.391526 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3965213e-75ad-4da9-baa3-cb707795f21d tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:57.393212 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3965213e-75ad-4da9-baa3-cb707795f21d tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:57.395668 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3965213e-75ad-4da9-baa3-cb707795f21d tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:57.398202 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3965213e-75ad-4da9-baa3-cb707795f21d tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:57.430377 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-3965213e-75ad-4da9-baa3-cb707795f21d tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] HTTP exception thrown: Instance 1e63485c-6290-4e1d-82cf-5ae73069dd2e could not be found. Jan 15 20:52:57.434589 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3965213e-75ad-4da9-baa3-cb707795f21d tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] Returning 404 to user: Instance 1e63485c-6290-4e1d-82cf-5ae73069dd2e could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:52:57.435727 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3965213e-75ad-4da9-baa3-cb707795f21d tempest-ServersOnMultiNodesTest-330031531 tempest-ServersOnMultiNodesTest-330031531-project] 10.222.0.46 "GET /compute/v2.1/servers/1e63485c-6290-4e1d-82cf-5ae73069dd2e" status: 404 len: 111 microversion: 2.1 time: 0.072039 Jan 15 20:52:57.436413 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 670/1407] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:52:57 2022] GET /compute/v2.1/servers/1e63485c-6290-4e1d-82cf-5ae73069dd2e => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:52:57.462717 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b85c3aa0-410e-4112-96f8-56eb6d7f9d99 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:57.463478 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b85c3aa0-410e-4112-96f8-56eb6d7f9d99 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: e983108d-66c6-472e-bfc1-761f8a333569] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:57.489821 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b85c3aa0-410e-4112-96f8-56eb6d7f9d99 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:57.490283 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b85c3aa0-410e-4112-96f8-56eb6d7f9d99 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:57.491104 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b85c3aa0-410e-4112-96f8-56eb6d7f9d99 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:57.491532 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b85c3aa0-410e-4112-96f8-56eb6d7f9d99 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:58.134978 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-b85c3aa0-410e-4112-96f8-56eb6d7f9d99 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:52:58.159608 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b85c3aa0-410e-4112-96f8-56eb6d7f9d99 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/e983108d-66c6-472e-bfc1-761f8a333569" status: 200 len: 1476 microversion: 2.1 time: 0.721289 Jan 15 20:52:58.160455 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 671/1408] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:52:57 2022] GET /compute/v2.1/servers/e983108d-66c6-472e-bfc1-761f8a333569 => generated 1476 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:52:58.177604 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-9f46fa4e-e636-4ce2-a8db-b2f79c59cb7b tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] 10.222.0.46 "DELETE /compute/v2.1/images/a6c696b9-7dd9-4e26-aa78-20da08a049b8" status: 204 len: 0 microversion: 2.1 time: 0.985083 Jan 15 20:52:58.178197 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 738/1409] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:52:57 2022] DELETE /compute/v2.1/images/a6c696b9-7dd9-4e26-aa78-20da08a049b8 => generated 0 bytes in 988 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 20:52:58.196040 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-7fba1f26-eeed-4ebc-80cb-e4fd508bd5e8 req-a128d21b-3766-4940-afd8-cf4f355b5d7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e63485c-6290-4e1d-82cf-5ae73069dd2e", "name": "network-vif-deleted", "tag": "ed4307c4-7bfe-4c59-80a3-243181296020"}, {"name": "network-changed", "server_uuid": "b1d27142-a9e4-440b-a719-d2059db11e79", "tag": "4c6a0728-da9a-48ee-98ad-d11ebf6c8030"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:52:58.198024 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:52:58.198024 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:52:58.202088 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ba8049d7-872d-42f6-a7b3-433422b6c8f4 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:52:58.203335 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ba8049d7-872d-42f6-a7b3-433422b6c8f4 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 57bd310f-a604-40de-9c25-882284f4a17b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:58.211348 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ba8049d7-872d-42f6-a7b3-433422b6c8f4 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:58.211825 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ba8049d7-872d-42f6-a7b3-433422b6c8f4 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:58.212815 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ba8049d7-872d-42f6-a7b3-433422b6c8f4 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:58.213425 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ba8049d7-872d-42f6-a7b3-433422b6c8f4 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:58.228642 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-7fba1f26-eeed-4ebc-80cb-e4fd508bd5e8 req-a128d21b-3766-4940-afd8-cf4f355b5d7d service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:58.229144 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-7fba1f26-eeed-4ebc-80cb-e4fd508bd5e8 req-a128d21b-3766-4940-afd8-cf4f355b5d7d service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:58.271699 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ba8049d7-872d-42f6-a7b3-433422b6c8f4 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/action" status: 200 len: 32621 microversion: 2.1 time: 0.091067 Jan 15 20:52:58.272986 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 672/1410] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:52:58 2022] POST /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/action => generated 32621 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:52:58.274783 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-7fba1f26-eeed-4ebc-80cb-e4fd508bd5e8 req-a128d21b-3766-4940-afd8-cf4f355b5d7d service nova] Creating event network-vif-deleted:ed4307c4-7bfe-4c59-80a3-243181296020 for instance 1e63485c-6290-4e1d-82cf-5ae73069dd2e on nch2-master-1 Jan 15 20:52:58.275594 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-7fba1f26-eeed-4ebc-80cb-e4fd508bd5e8 req-a128d21b-3766-4940-afd8-cf4f355b5d7d service nova] Creating event network-changed:4c6a0728-da9a-48ee-98ad-d11ebf6c8030 for instance b1d27142-a9e4-440b-a719-d2059db11e79 on nch2-master-1 Jan 15 20:52:58.287481 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-31a34b07-f724-4d0a-8913-a019f37ec5d9 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Calling method '.version_select at 0x7f30c917dc10>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:58.314316 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-7fba1f26-eeed-4ebc-80cb-e4fd508bd5e8 req-a128d21b-3766-4940-afd8-cf4f355b5d7d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.130070 Jan 15 20:52:58.319971 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 739/1411] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:52:58 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:52:58.342655 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b4246da4-a1b5-4e46-8e3f-18f8eb81f7e9 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:58.343896 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b4246da4-a1b5-4e46-8e3f-18f8eb81f7e9 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] [instance: d94de6c9-be7d-4101-9f88-304b8a4ce8d7] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:58.366908 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b4246da4-a1b5-4e46-8e3f-18f8eb81f7e9 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:58.367396 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b4246da4-a1b5-4e46-8e3f-18f8eb81f7e9 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:58.369503 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b4246da4-a1b5-4e46-8e3f-18f8eb81f7e9 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:58.370354 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b4246da4-a1b5-4e46-8e3f-18f8eb81f7e9 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:58.373626 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-31a34b07-f724-4d0a-8913-a019f37ec5d9 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] HTTP exception thrown: Image not found. Jan 15 20:52:58.375395 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-31a34b07-f724-4d0a-8913-a019f37ec5d9 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Returning 404 to user: Image not found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:52:58.377680 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-31a34b07-f724-4d0a-8913-a019f37ec5d9 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] 10.222.0.46 "DELETE /compute/v2.1/images/3ce24e4a-9608-4d9f-919f-c52be69dac7b" status: 404 len: 62 microversion: 2.1 time: 0.102227 Jan 15 20:52:58.378805 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 673/1412] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:52:58 2022] DELETE /compute/v2.1/images/3ce24e4a-9608-4d9f-919f-c52be69dac7b => generated 62 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jan 15 20:52:58.384709 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d5fb7d95-b660-4382-ad59-d4b4a488fbf1 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:58.389827 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d5fb7d95-b660-4382-ad59-d4b4a488fbf1 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] [instance: b1d27142-a9e4-440b-a719-d2059db11e79] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:58.403002 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d5fb7d95-b660-4382-ad59-d4b4a488fbf1 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:58.403454 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d5fb7d95-b660-4382-ad59-d4b4a488fbf1 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:58.404722 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d5fb7d95-b660-4382-ad59-d4b4a488fbf1 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:58.406824 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d5fb7d95-b660-4382-ad59-d4b4a488fbf1 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:58.754062 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-d5fb7d95-b660-4382-ad59-d4b4a488fbf1 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55be87ae7f14b499ab2cd6fc5538988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd217e7fd648b4a78c0c32ff1c95f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:52:58.765188 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d5fb7d95-b660-4382-ad59-d4b4a488fbf1 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "GET /compute/v2.1/servers/b1d27142-a9e4-440b-a719-d2059db11e79" status: 200 len: 1307 microversion: 2.1 time: 0.382202 Jan 15 20:52:58.766046 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 674/1413] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:52:58 2022] GET /compute/v2.1/servers/b1d27142-a9e4-440b-a719-d2059db11e79 => generated 1307 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:52:58.772622 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8c11ccb8-1a86-4f72-82ea-79dad6055bc7 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:58.773142 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-8c11ccb8-1a86-4f72-82ea-79dad6055bc7 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] [instance: 1d163f47-49a0-41c9-991b-f42d16af67d1] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:58.785468 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-b4246da4-a1b5-4e46-8e3f-18f8eb81f7e9 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:52:58.787485 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8c11ccb8-1a86-4f72-82ea-79dad6055bc7 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:58.787937 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8c11ccb8-1a86-4f72-82ea-79dad6055bc7 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:58.788734 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8c11ccb8-1a86-4f72-82ea-79dad6055bc7 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:58.792626 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8c11ccb8-1a86-4f72-82ea-79dad6055bc7 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:58.801455 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-b4246da4-a1b5-4e46-8e3f-18f8eb81f7e9 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:52:58.803996 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-b4246da4-a1b5-4e46-8e3f-18f8eb81f7e9 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:52:58.806264 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b4246da4-a1b5-4e46-8e3f-18f8eb81f7e9 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] 10.222.0.46 "GET /compute/v2.1/servers/d94de6c9-be7d-4101-9f88-304b8a4ce8d7" status: 200 len: 1280 microversion: 2.25 time: 0.480398 Jan 15 20:52:58.807697 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 740/1414] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:52:58 2022] GET /compute/v2.1/servers/d94de6c9-be7d-4101-9f88-304b8a4ce8d7 => generated 1280 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:52:58.854332 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-8c11ccb8-1a86-4f72-82ea-79dad6055bc7 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] [instance: 1d163f47-49a0-41c9-991b-f42d16af67d1] Going to try to terminate instance {{(pid=129365) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 20:52:59.012295 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-8c11ccb8-1a86-4f72-82ea-79dad6055bc7 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] 10.222.0.46 "DELETE /compute/v2.1/servers/1d163f47-49a0-41c9-991b-f42d16af67d1" status: 204 len: 0 microversion: 2.1 time: 0.244676 Jan 15 20:52:59.016211 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 675/1415] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 20:52:58 2022] DELETE /compute/v2.1/servers/1d163f47-49a0-41c9-991b-f42d16af67d1 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 20:52:59.035922 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-4271f41c-31ef-4f7a-a777-ddf224e8e417 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:59.037043 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-4271f41c-31ef-4f7a-a777-ddf224e8e417 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] [instance: 1d163f47-49a0-41c9-991b-f42d16af67d1] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:59.054859 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4271f41c-31ef-4f7a-a777-ddf224e8e417 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:59.056559 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4271f41c-31ef-4f7a-a777-ddf224e8e417 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:59.057906 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4271f41c-31ef-4f7a-a777-ddf224e8e417 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:59.060189 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4271f41c-31ef-4f7a-a777-ddf224e8e417 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:59.190563 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1e01ac1a-b041-421e-9d11-046b4702107f tempest-FloatingIPsTestJSON-1217128180 tempest-FloatingIPsTestJSON-1217128180-project] Action: 'create', calling method: .version_select at 0x7f30c91409d0>, body: {"pool": null} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:52:59.498561 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-4271f41c-31ef-4f7a-a777-ddf224e8e417 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3352815cdc914c15b656b4d0d9511010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7b489c290846f48384c65e977ed644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:52:59.508676 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-4271f41c-31ef-4f7a-a777-ddf224e8e417 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] 10.222.0.46 "GET /compute/v2.1/servers/1d163f47-49a0-41c9-991b-f42d16af67d1" status: 200 len: 1472 microversion: 2.1 time: 0.490026 Jan 15 20:52:59.509313 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 676/1416] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:52:59 2022] GET /compute/v2.1/servers/1d163f47-49a0-41c9-991b-f42d16af67d1 => generated 1472 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:52:59.518063 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3013a888-01bd-41bc-bafe-bd90e193818e tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:52:59.521369 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-3013a888-01bd-41bc-bafe-bd90e193818e tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: e983108d-66c6-472e-bfc1-761f8a333569] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:52:59.545218 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3013a888-01bd-41bc-bafe-bd90e193818e tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:59.545819 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3013a888-01bd-41bc-bafe-bd90e193818e tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:52:59.546833 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3013a888-01bd-41bc-bafe-bd90e193818e tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:52:59.548948 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3013a888-01bd-41bc-bafe-bd90e193818e tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:00.071948 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-3013a888-01bd-41bc-bafe-bd90e193818e tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:53:00.082731 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3013a888-01bd-41bc-bafe-bd90e193818e tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/e983108d-66c6-472e-bfc1-761f8a333569" status: 200 len: 1476 microversion: 2.1 time: 0.571969 Jan 15 20:53:00.095740 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 677/1417] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:52:59 2022] GET /compute/v2.1/servers/e983108d-66c6-472e-bfc1-761f8a333569 => generated 1476 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:53:00.097699 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-7f63ddfc-c690-46b2-80d5-25dc9f62f567 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:53:00.098833 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-7f63ddfc-c690-46b2-80d5-25dc9f62f567 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 57bd310f-a604-40de-9c25-882284f4a17b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:00.112509 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7f63ddfc-c690-46b2-80d5-25dc9f62f567 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:00.113213 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7f63ddfc-c690-46b2-80d5-25dc9f62f567 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:00.114873 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7f63ddfc-c690-46b2-80d5-25dc9f62f567 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:00.115407 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7f63ddfc-c690-46b2-80d5-25dc9f62f567 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:00.206296 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-7f63ddfc-c690-46b2-80d5-25dc9f62f567 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/action" status: 200 len: 32621 microversion: 2.1 time: 0.116081 Jan 15 20:53:00.207814 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 678/1418] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:53:00 2022] POST /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/action => generated 32621 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:53:00.229069 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-34f1c02f-1f4b-444f-8de1-758c8b28e736 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:00.231282 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-34f1c02f-1f4b-444f-8de1-758c8b28e736 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] [instance: b1d27142-a9e4-440b-a719-d2059db11e79] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:00.254172 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-34f1c02f-1f4b-444f-8de1-758c8b28e736 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:00.257435 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-34f1c02f-1f4b-444f-8de1-758c8b28e736 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:00.258415 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-34f1c02f-1f4b-444f-8de1-758c8b28e736 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:00.262590 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-34f1c02f-1f4b-444f-8de1-758c8b28e736 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:00.713576 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-34f1c02f-1f4b-444f-8de1-758c8b28e736 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55be87ae7f14b499ab2cd6fc5538988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd217e7fd648b4a78c0c32ff1c95f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:53:00.723770 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-34f1c02f-1f4b-444f-8de1-758c8b28e736 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "GET /compute/v2.1/servers/b1d27142-a9e4-440b-a719-d2059db11e79" status: 200 len: 1307 microversion: 2.1 time: 0.512893 Jan 15 20:53:00.725158 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 679/1419] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:53:00 2022] GET /compute/v2.1/servers/b1d27142-a9e4-440b-a719-d2059db11e79 => generated 1307 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:53:00.732527 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-812be383-e6c8-4ba5-aeb7-87a8230180f8 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:00.733156 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-812be383-e6c8-4ba5-aeb7-87a8230180f8 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] [instance: d94de6c9-be7d-4101-9f88-304b8a4ce8d7] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:00.755022 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-812be383-e6c8-4ba5-aeb7-87a8230180f8 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:00.755483 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-812be383-e6c8-4ba5-aeb7-87a8230180f8 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:00.757465 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-812be383-e6c8-4ba5-aeb7-87a8230180f8 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:00.759172 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-812be383-e6c8-4ba5-aeb7-87a8230180f8 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:01.132144 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-812be383-e6c8-4ba5-aeb7-87a8230180f8 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:53:01.145158 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-812be383-e6c8-4ba5-aeb7-87a8230180f8 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:53:01.149670 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-812be383-e6c8-4ba5-aeb7-87a8230180f8 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:53:01.150840 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-812be383-e6c8-4ba5-aeb7-87a8230180f8 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] 10.222.0.46 "GET /compute/v2.1/servers/d94de6c9-be7d-4101-9f88-304b8a4ce8d7" status: 200 len: 1280 microversion: 2.25 time: 0.424731 Jan 15 20:53:01.151402 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 680/1420] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:53:00 2022] GET /compute/v2.1/servers/d94de6c9-be7d-4101-9f88-304b8a4ce8d7 => generated 1280 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:53:01.159235 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-e3c440d6-aea3-47b4-bb25-94701d90ff9a req-b9d658ec-cbb7-41c5-868b-1f11b05a22f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d94de6c9-be7d-4101-9f88-304b8a4ce8d7", "tag": "9ae7fa8e-01aa-4321-8949-4398f2fc1b57"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:53:01.161212 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:53:01.161212 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:53:01.182095 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-e3c440d6-aea3-47b4-bb25-94701d90ff9a req-b9d658ec-cbb7-41c5-868b-1f11b05a22f2 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:01.182536 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-e3c440d6-aea3-47b4-bb25-94701d90ff9a req-b9d658ec-cbb7-41c5-868b-1f11b05a22f2 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:01.240142 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-e3c440d6-aea3-47b4-bb25-94701d90ff9a req-b9d658ec-cbb7-41c5-868b-1f11b05a22f2 service nova] Creating event network-changed:9ae7fa8e-01aa-4321-8949-4398f2fc1b57 for instance d94de6c9-be7d-4101-9f88-304b8a4ce8d7 on nch1-master-1 Jan 15 20:53:01.260265 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-e3c440d6-aea3-47b4-bb25-94701d90ff9a req-b9d658ec-cbb7-41c5-868b-1f11b05a22f2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104293 Jan 15 20:53:01.265598 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 681/1421] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:53:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:53:01.282193 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3e5c567d-6885-437b-bcbc-d7fe5e836b78 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:01.285717 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-3e5c567d-6885-437b-bcbc-d7fe5e836b78 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] [instance: 1d163f47-49a0-41c9-991b-f42d16af67d1] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:01.305775 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3e5c567d-6885-437b-bcbc-d7fe5e836b78 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:01.306772 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3e5c567d-6885-437b-bcbc-d7fe5e836b78 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:01.309890 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3e5c567d-6885-437b-bcbc-d7fe5e836b78 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:01.310730 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3e5c567d-6885-437b-bcbc-d7fe5e836b78 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:01.809019 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-3e5c567d-6885-437b-bcbc-d7fe5e836b78 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3352815cdc914c15b656b4d0d9511010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7b489c290846f48384c65e977ed644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:53:01.821496 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3e5c567d-6885-437b-bcbc-d7fe5e836b78 tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] 10.222.0.46 "GET /compute/v2.1/servers/1d163f47-49a0-41c9-991b-f42d16af67d1" status: 200 len: 1472 microversion: 2.1 time: 0.554378 Jan 15 20:53:01.833987 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 682/1422] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:53:01 2022] GET /compute/v2.1/servers/1d163f47-49a0-41c9-991b-f42d16af67d1 => generated 1472 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:53:01.839928 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-59c0bbdd-9ada-4ff1-8283-ae3f66657f2c tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:01.840917 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-59c0bbdd-9ada-4ff1-8283-ae3f66657f2c tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: e983108d-66c6-472e-bfc1-761f8a333569] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:01.850284 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-59c0bbdd-9ada-4ff1-8283-ae3f66657f2c tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:01.851448 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-59c0bbdd-9ada-4ff1-8283-ae3f66657f2c tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:01.852478 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-59c0bbdd-9ada-4ff1-8283-ae3f66657f2c tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:01.853138 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-59c0bbdd-9ada-4ff1-8283-ae3f66657f2c tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:02.643331 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-59c0bbdd-9ada-4ff1-8283-ae3f66657f2c tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:53:02.653506 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-59c0bbdd-9ada-4ff1-8283-ae3f66657f2c tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/e983108d-66c6-472e-bfc1-761f8a333569" status: 200 len: 1476 microversion: 2.1 time: 0.817524 Jan 15 20:53:02.661146 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 683/1423] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:53:01 2022] GET /compute/v2.1/servers/e983108d-66c6-472e-bfc1-761f8a333569 => generated 1476 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:53:02.661995 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b9f11fa6-a6e9-4315-a8b6-ce7c705a885a tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:53:02.663413 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b9f11fa6-a6e9-4315-a8b6-ce7c705a885a tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 57bd310f-a604-40de-9c25-882284f4a17b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:02.675304 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b9f11fa6-a6e9-4315-a8b6-ce7c705a885a tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:02.675766 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b9f11fa6-a6e9-4315-a8b6-ce7c705a885a tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:02.676793 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b9f11fa6-a6e9-4315-a8b6-ce7c705a885a tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:02.677267 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b9f11fa6-a6e9-4315-a8b6-ce7c705a885a tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:02.738761 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b9f11fa6-a6e9-4315-a8b6-ce7c705a885a tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/action" status: 200 len: 32621 microversion: 2.1 time: 0.081642 Jan 15 20:53:02.740770 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 684/1424] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:53:02 2022] POST /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/action => generated 32621 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:53:02.758108 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b6b5990a-a876-4b3f-8326-348b4c96c57d tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:02.759502 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b6b5990a-a876-4b3f-8326-348b4c96c57d tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] [instance: b1d27142-a9e4-440b-a719-d2059db11e79] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:02.770864 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b6b5990a-a876-4b3f-8326-348b4c96c57d tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:02.771880 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b6b5990a-a876-4b3f-8326-348b4c96c57d tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:02.773192 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b6b5990a-a876-4b3f-8326-348b4c96c57d tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:02.774126 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b6b5990a-a876-4b3f-8326-348b4c96c57d tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:02.803418 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-1e01ac1a-b041-421e-9d11-046b4702107f tempest-FloatingIPsTestJSON-1217128180 tempest-FloatingIPsTestJSON-1217128180-project] 10.222.0.46 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.993567 Jan 15 20:53:02.805570 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 741/1425] 10.222.0.46 () {60 vars in 1169 bytes} [Sat Jan 15 20:52:58 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3997 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:53:02.829234 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0281bee8-aece-47e2-8d03-a7bf2a1a47c7 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:02.830240 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-0281bee8-aece-47e2-8d03-a7bf2a1a47c7 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] [instance: d94de6c9-be7d-4101-9f88-304b8a4ce8d7] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:02.843902 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0281bee8-aece-47e2-8d03-a7bf2a1a47c7 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:02.844360 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0281bee8-aece-47e2-8d03-a7bf2a1a47c7 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:02.848317 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0281bee8-aece-47e2-8d03-a7bf2a1a47c7 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:02.849000 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0281bee8-aece-47e2-8d03-a7bf2a1a47c7 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:03.215892 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-b6b5990a-a876-4b3f-8326-348b4c96c57d tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55be87ae7f14b499ab2cd6fc5538988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd217e7fd648b4a78c0c32ff1c95f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:53:03.224708 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b6b5990a-a876-4b3f-8326-348b4c96c57d tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "GET /compute/v2.1/servers/b1d27142-a9e4-440b-a719-d2059db11e79" status: 200 len: 1307 microversion: 2.1 time: 0.473743 Jan 15 20:53:03.235136 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 685/1426] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:53:02 2022] GET /compute/v2.1/servers/b1d27142-a9e4-440b-a719-d2059db11e79 => generated 1307 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:53:03.238816 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-fa725dd3-7c02-4f3c-be01-ab797a905d1f tempest-FloatingIPsTestJSON-1217128180 tempest-FloatingIPsTestJSON-1217128180-project] Calling method '.version_select at 0x7f30c91b1940>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:03.389469 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-0281bee8-aece-47e2-8d03-a7bf2a1a47c7 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:53:03.404769 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-0281bee8-aece-47e2-8d03-a7bf2a1a47c7 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:53:03.409261 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-0281bee8-aece-47e2-8d03-a7bf2a1a47c7 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:53:03.411787 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0281bee8-aece-47e2-8d03-a7bf2a1a47c7 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] 10.222.0.46 "GET /compute/v2.1/servers/d94de6c9-be7d-4101-9f88-304b8a4ce8d7" status: 200 len: 1280 microversion: 2.25 time: 0.603774 Jan 15 20:53:03.414244 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 742/1427] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:53:02 2022] GET /compute/v2.1/servers/d94de6c9-be7d-4101-9f88-304b8a4ce8d7 => generated 1280 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:53:03.423641 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-923b43ec-62ad-4532-b97e-d618602eb51e tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:03.425296 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-923b43ec-62ad-4532-b97e-d618602eb51e tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] [instance: 1d163f47-49a0-41c9-991b-f42d16af67d1] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:03.436870 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-923b43ec-62ad-4532-b97e-d618602eb51e tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:03.437318 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-923b43ec-62ad-4532-b97e-d618602eb51e tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:03.438436 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-923b43ec-62ad-4532-b97e-d618602eb51e tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:03.451020 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-923b43ec-62ad-4532-b97e-d618602eb51e tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:03.478012 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-923b43ec-62ad-4532-b97e-d618602eb51e tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] HTTP exception thrown: Instance 1d163f47-49a0-41c9-991b-f42d16af67d1 could not be found. Jan 15 20:53:03.478629 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-923b43ec-62ad-4532-b97e-d618602eb51e tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] Returning 404 to user: Instance 1d163f47-49a0-41c9-991b-f42d16af67d1 could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:53:03.479733 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-923b43ec-62ad-4532-b97e-d618602eb51e tempest-ImagesOneServerTestJSON-224125163 tempest-ImagesOneServerTestJSON-224125163-project] 10.222.0.46 "GET /compute/v2.1/servers/1d163f47-49a0-41c9-991b-f42d16af67d1" status: 404 len: 111 microversion: 2.1 time: 0.064047 Jan 15 20:53:03.480320 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 743/1428] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:53:03 2022] GET /compute/v2.1/servers/1d163f47-49a0-41c9-991b-f42d16af67d1 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:53:03.487051 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-0da16996-cb87-48fd-b8cf-a3b88527f520 req-4d13a0ab-610d-4c15-866c-c02d9444aca5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d163f47-49a0-41c9-991b-f42d16af67d1", "name": "network-vif-deleted", "tag": "26758887-8e21-4143-9b13-3eccf74a0d5b"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:53:03.489952 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:53:03.489952 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:53:03.498873 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-0da16996-cb87-48fd-b8cf-a3b88527f520 req-4d13a0ab-610d-4c15-866c-c02d9444aca5 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:03.499553 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-0da16996-cb87-48fd-b8cf-a3b88527f520 req-4d13a0ab-610d-4c15-866c-c02d9444aca5 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:03.517377 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-0da16996-cb87-48fd-b8cf-a3b88527f520 req-4d13a0ab-610d-4c15-866c-c02d9444aca5 service nova] Creating event network-vif-deleted:26758887-8e21-4143-9b13-3eccf74a0d5b for instance 1d163f47-49a0-41c9-991b-f42d16af67d1 on nch2-master-1 Jan 15 20:53:03.526816 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-0da16996-cb87-48fd-b8cf-a3b88527f520 req-4d13a0ab-610d-4c15-866c-c02d9444aca5 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044505 Jan 15 20:53:03.528088 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 744/1429] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:53:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:53:03.653367 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-fa725dd3-7c02-4f3c-be01-ab797a905d1f tempest-FloatingIPsTestJSON-1217128180 tempest-FloatingIPsTestJSON-1217128180-project] 10.222.0.46 "GET /compute/v2.1/os-floating-ips/a8a76f02-36e4-4dee-a868-1e2ce06dd446" status: 200 len: 142 microversion: 2.1 time: 0.426960 Jan 15 20:53:03.654506 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 686/1430] 10.222.0.46 () {58 vars in 1259 bytes} [Sat Jan 15 20:53:03 2022] GET /compute/v2.1/os-floating-ips/a8a76f02-36e4-4dee-a868-1e2ce06dd446 => generated 142 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:53:03.671893 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0c53b0bb-578b-41fb-bf42-1b8b34c93271 tempest-FloatingIPsTestJSON-1217128180 tempest-FloatingIPsTestJSON-1217128180-project] Calling method '.version_select at 0x7f30c9150700>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:03.679472 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a461c4c1-ea01-4a1b-a9f5-fcf7d1b0799c tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:03.680486 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a461c4c1-ea01-4a1b-a9f5-fcf7d1b0799c tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: e983108d-66c6-472e-bfc1-761f8a333569] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:03.703701 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a461c4c1-ea01-4a1b-a9f5-fcf7d1b0799c tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:03.705053 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a461c4c1-ea01-4a1b-a9f5-fcf7d1b0799c tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:03.706674 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a461c4c1-ea01-4a1b-a9f5-fcf7d1b0799c tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:03.707422 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a461c4c1-ea01-4a1b-a9f5-fcf7d1b0799c tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:04.161704 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-a461c4c1-ea01-4a1b-a9f5-fcf7d1b0799c tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:53:04.174915 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a461c4c1-ea01-4a1b-a9f5-fcf7d1b0799c tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/e983108d-66c6-472e-bfc1-761f8a333569" status: 200 len: 1476 microversion: 2.1 time: 0.504984 Jan 15 20:53:04.176627 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 687/1431] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:53:03 2022] GET /compute/v2.1/servers/e983108d-66c6-472e-bfc1-761f8a333569 => generated 1476 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:53:04.187998 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-4c89ae79-f772-454b-8453-c19fdf3ca011 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:53:04.193568 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-4c89ae79-f772-454b-8453-c19fdf3ca011 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 57bd310f-a604-40de-9c25-882284f4a17b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:04.207911 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4c89ae79-f772-454b-8453-c19fdf3ca011 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:04.211884 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4c89ae79-f772-454b-8453-c19fdf3ca011 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:04.213606 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4c89ae79-f772-454b-8453-c19fdf3ca011 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:04.214263 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4c89ae79-f772-454b-8453-c19fdf3ca011 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:04.256169 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0c53b0bb-578b-41fb-bf42-1b8b34c93271 tempest-FloatingIPsTestJSON-1217128180 tempest-FloatingIPsTestJSON-1217128180-project] 10.222.0.46 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 0.593901 Jan 15 20:53:04.256761 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 745/1432] 10.222.0.46 () {58 vars in 1148 bytes} [Sat Jan 15 20:53:03 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:53:04.261167 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-45ef1e57-6ada-4654-9a4e-1f6f05d280da tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:04.262669 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-45ef1e57-6ada-4654-9a4e-1f6f05d280da tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] [instance: b1d27142-a9e4-440b-a719-d2059db11e79] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:04.278714 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-45ef1e57-6ada-4654-9a4e-1f6f05d280da tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:04.283375 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-45ef1e57-6ada-4654-9a4e-1f6f05d280da tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:04.285168 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-45ef1e57-6ada-4654-9a4e-1f6f05d280da tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:04.286543 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-45ef1e57-6ada-4654-9a4e-1f6f05d280da tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:04.301731 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-4c89ae79-f772-454b-8453-c19fdf3ca011 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/action" status: 200 len: 32621 microversion: 2.1 time: 0.122462 Jan 15 20:53:04.305844 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 688/1433] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:53:04 2022] POST /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/action => generated 32621 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:53:04.317436 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-40264f35-2b33-4a45-a5ea-87c3bc782627 tempest-FloatingIPsTestJSON-1217128180 tempest-FloatingIPsTestJSON-1217128180-project] Calling method '.version_select at 0x7f30c972b670>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:04.693531 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-45ef1e57-6ada-4654-9a4e-1f6f05d280da tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55be87ae7f14b499ab2cd6fc5538988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd217e7fd648b4a78c0c32ff1c95f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:53:04.706452 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-45ef1e57-6ada-4654-9a4e-1f6f05d280da tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "GET /compute/v2.1/servers/b1d27142-a9e4-440b-a719-d2059db11e79" status: 200 len: 1307 microversion: 2.1 time: 0.448580 Jan 15 20:53:04.714499 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 746/1434] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:53:04 2022] GET /compute/v2.1/servers/b1d27142-a9e4-440b-a719-d2059db11e79 => generated 1307 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:53:04.719510 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9e75d1b2-f32d-40f5-ab56-b027a2c49228 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:04.720829 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-9e75d1b2-f32d-40f5-ab56-b027a2c49228 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] [instance: d94de6c9-be7d-4101-9f88-304b8a4ce8d7] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:04.739622 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9e75d1b2-f32d-40f5-ab56-b027a2c49228 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:04.740087 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9e75d1b2-f32d-40f5-ab56-b027a2c49228 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:04.741799 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9e75d1b2-f32d-40f5-ab56-b027a2c49228 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:04.742456 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9e75d1b2-f32d-40f5-ab56-b027a2c49228 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:05.169091 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-9e75d1b2-f32d-40f5-ab56-b027a2c49228 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:53:05.194173 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-9e75d1b2-f32d-40f5-ab56-b027a2c49228 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:53:05.198228 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-9e75d1b2-f32d-40f5-ab56-b027a2c49228 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:53:05.200960 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-9e75d1b2-f32d-40f5-ab56-b027a2c49228 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] 10.222.0.46 "GET /compute/v2.1/servers/d94de6c9-be7d-4101-9f88-304b8a4ce8d7" status: 200 len: 1280 microversion: 2.25 time: 0.484367 Jan 15 20:53:05.203698 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 747/1435] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:53:04 2022] GET /compute/v2.1/servers/d94de6c9-be7d-4101-9f88-304b8a4ce8d7 => generated 1280 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:53:05.769587 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-40264f35-2b33-4a45-a5ea-87c3bc782627 tempest-FloatingIPsTestJSON-1217128180 tempest-FloatingIPsTestJSON-1217128180-project] 10.222.0.46 "DELETE /compute/v2.1/os-floating-ips/a8a76f02-36e4-4dee-a868-1e2ce06dd446" status: 202 len: 0 microversion: 2.1 time: 1.462426 Jan 15 20:53:05.771478 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 689/1436] 10.222.0.46 () {58 vars in 1262 bytes} [Sat Jan 15 20:53:04 2022] DELETE /compute/v2.1/os-floating-ips/a8a76f02-36e4-4dee-a868-1e2ce06dd446 => generated 0 bytes in 1465 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 20:53:05.777928 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-4d20c8c4-c26b-47a9-a4e5-5205b010fae7 req-c20035f8-85ba-49ce-aafc-6a091ce53bbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1d27142-a9e4-440b-a719-d2059db11e79", "name": "network-vif-plugged", "status": "completed", "tag": "4c6a0728-da9a-48ee-98ad-d11ebf6c8030"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:53:05.786919 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:53:05.786919 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:53:05.802697 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-4d20c8c4-c26b-47a9-a4e5-5205b010fae7 req-c20035f8-85ba-49ce-aafc-6a091ce53bbf service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:05.803155 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-4d20c8c4-c26b-47a9-a4e5-5205b010fae7 req-c20035f8-85ba-49ce-aafc-6a091ce53bbf service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:05.806498 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-3aa40cd3-97e9-485a-921b-c58d9179c48e tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1165877453", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "networks": [{"uuid": "694e9d9d-1c46-4dca-8c3f-cefb74824185"}]}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:53:05.824698 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-4d20c8c4-c26b-47a9-a4e5-5205b010fae7 req-c20035f8-85ba-49ce-aafc-6a091ce53bbf service nova] Creating event network-vif-plugged:4c6a0728-da9a-48ee-98ad-d11ebf6c8030 for instance b1d27142-a9e4-440b-a719-d2059db11e79 on nch2-master-1 Jan 15 20:53:05.842472 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-4d20c8c4-c26b-47a9-a4e5-5205b010fae7 req-c20035f8-85ba-49ce-aafc-6a091ce53bbf service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069601 Jan 15 20:53:05.843750 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 690/1437] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:53:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:53:05.855307 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-06601790-06ae-4170-afd5-3318444109fd tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:05.857625 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-06601790-06ae-4170-afd5-3318444109fd tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: e983108d-66c6-472e-bfc1-761f8a333569] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:05.872765 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-06601790-06ae-4170-afd5-3318444109fd tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:05.873429 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-06601790-06ae-4170-afd5-3318444109fd tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:05.874942 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-06601790-06ae-4170-afd5-3318444109fd tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:05.875450 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-06601790-06ae-4170-afd5-3318444109fd tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:05.887542 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.network.neutron [None req-3aa40cd3-97e9-485a-921b-c58d9179c48e tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] validate_networks() for [('694e9d9d-1c46-4dca-8c3f-cefb74824185', None, None, None, None, None)] {{(pid=129366) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 20:53:06.183681 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-06601790-06ae-4170-afd5-3318444109fd tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:53:06.203696 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-06601790-06ae-4170-afd5-3318444109fd tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/e983108d-66c6-472e-bfc1-761f8a333569" status: 200 len: 1476 microversion: 2.1 time: 0.357943 Jan 15 20:53:06.208652 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 691/1438] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:53:05 2022] GET /compute/v2.1/servers/e983108d-66c6-472e-bfc1-761f8a333569 => generated 1476 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:53:06.216685 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a4a04c14-ecef-4742-9eae-68682dce974f tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:53:06.217788 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a4a04c14-ecef-4742-9eae-68682dce974f tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 57bd310f-a604-40de-9c25-882284f4a17b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:06.225922 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a4a04c14-ecef-4742-9eae-68682dce974f tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:06.226675 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a4a04c14-ecef-4742-9eae-68682dce974f tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:06.227704 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a4a04c14-ecef-4742-9eae-68682dce974f tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:06.228321 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a4a04c14-ecef-4742-9eae-68682dce974f tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:06.290638 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a4a04c14-ecef-4742-9eae-68682dce974f tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/action" status: 200 len: 32621 microversion: 2.1 time: 0.079369 Jan 15 20:53:06.296222 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 692/1439] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:53:06 2022] POST /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/action => generated 32621 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:53:06.314255 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3393de56-f13c-4de8-ba3d-2435cf181a9b tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:06.315077 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-3393de56-f13c-4de8-ba3d-2435cf181a9b tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] [instance: b1d27142-a9e4-440b-a719-d2059db11e79] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:06.324733 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3393de56-f13c-4de8-ba3d-2435cf181a9b tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:06.327649 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3393de56-f13c-4de8-ba3d-2435cf181a9b tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:06.331629 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3393de56-f13c-4de8-ba3d-2435cf181a9b tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:06.332360 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3393de56-f13c-4de8-ba3d-2435cf181a9b tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:06.518794 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-3aa40cd3-97e9-485a-921b-c58d9179c48e tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] Flavor limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 20:53:06.519222 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-3aa40cd3-97e9-485a-921b-c58d9179c48e tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] Image limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 20:53:06.519693 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-3aa40cd3-97e9-485a-921b-c58d9179c48e tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] Flavor pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 20:53:06.520103 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-3aa40cd3-97e9-485a-921b-c58d9179c48e tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] Image pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 20:53:06.520513 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-3aa40cd3-97e9-485a-921b-c58d9179c48e tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 20:53:06.549812 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3aa40cd3-97e9-485a-921b-c58d9179c48e tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:06.550535 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3aa40cd3-97e9-485a-921b-c58d9179c48e tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:06.551656 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3aa40cd3-97e9-485a-921b-c58d9179c48e tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:06.552273 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3aa40cd3-97e9-485a-921b-c58d9179c48e tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:06.580544 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-3aa40cd3-97e9-485a-921b-c58d9179c48e tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] Getting quotas for project f021c66112bf49f685a34c55841857bd. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:53:06.589493 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-3393de56-f13c-4de8-ba3d-2435cf181a9b tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55be87ae7f14b499ab2cd6fc5538988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd217e7fd648b4a78c0c32ff1c95f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:53:06.597678 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3393de56-f13c-4de8-ba3d-2435cf181a9b tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "GET /compute/v2.1/servers/b1d27142-a9e4-440b-a719-d2059db11e79" status: 200 len: 1307 microversion: 2.1 time: 0.300092 Jan 15 20:53:06.601217 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 693/1440] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:53:06 2022] GET /compute/v2.1/servers/b1d27142-a9e4-440b-a719-d2059db11e79 => generated 1307 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:53:06.603566 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-3aa40cd3-97e9-485a-921b-c58d9179c48e tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] Getting quotas for user 68bf33c7cdd84129a5544916a7dc3410 and project f021c66112bf49f685a34c55841857bd. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:53:06.608563 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-07c13946-9793-4e43-8f96-d09a0099d326 tempest-FloatingIPsTestJSON-1217128180 tempest-FloatingIPsTestJSON-1217128180-project] Action: 'create', calling method: .version_select at 0x7f30c8d1ec10>, body: {"pool": null} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:53:06.644285 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-3aa40cd3-97e9-485a-921b-c58d9179c48e tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] Going to run 1 instances... {{(pid=129366) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 20:53:06.650222 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-3aa40cd3-97e9-485a-921b-c58d9179c48e tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] [instance: ababfa7a-a809-4151-882d-0c3038b84ee0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 20:53:06.732242 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-3aa40cd3-97e9-485a-921b-c58d9179c48e tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.525789 Jan 15 20:53:06.738510 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 748/1441] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 20:53:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1531 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 20:53:06.964478 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-eeb2480a-1fd9-4f51-9adf-d6f587044e1f tempest-AbsoluteLimitsNegativeTestJSON-118879302 tempest-AbsoluteLimitsNegativeTestJSON-118879302-project] Calling method '.version_select at 0x7f30c935daf0>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:06.989037 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-eeb2480a-1fd9-4f51-9adf-d6f587044e1f tempest-AbsoluteLimitsNegativeTestJSON-118879302 tempest-AbsoluteLimitsNegativeTestJSON-118879302-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:06.989494 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-eeb2480a-1fd9-4f51-9adf-d6f587044e1f tempest-AbsoluteLimitsNegativeTestJSON-118879302 tempest-AbsoluteLimitsNegativeTestJSON-118879302-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:06.990311 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-eeb2480a-1fd9-4f51-9adf-d6f587044e1f tempest-AbsoluteLimitsNegativeTestJSON-118879302 tempest-AbsoluteLimitsNegativeTestJSON-118879302-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:06.990756 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-eeb2480a-1fd9-4f51-9adf-d6f587044e1f tempest-AbsoluteLimitsNegativeTestJSON-118879302 tempest-AbsoluteLimitsNegativeTestJSON-118879302-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:07.084261 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-eeb2480a-1fd9-4f51-9adf-d6f587044e1f tempest-AbsoluteLimitsNegativeTestJSON-118879302 tempest-AbsoluteLimitsNegativeTestJSON-118879302-project] 10.222.0.46 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.346039 Jan 15 20:53:07.084892 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 749/1442] 10.222.0.46 () {58 vars in 1121 bytes} [Sat Jan 15 20:53:06 2022] GET /compute/v2.1/limits => generated 511 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:53:07.114464 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c3b0299d-a6c8-4e33-9e7e-556106cabf80 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:07.116402 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c3b0299d-a6c8-4e33-9e7e-556106cabf80 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] [instance: d94de6c9-be7d-4101-9f88-304b8a4ce8d7] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:07.136533 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c3b0299d-a6c8-4e33-9e7e-556106cabf80 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:07.141312 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c3b0299d-a6c8-4e33-9e7e-556106cabf80 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:07.143119 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c3b0299d-a6c8-4e33-9e7e-556106cabf80 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:07.145270 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c3b0299d-a6c8-4e33-9e7e-556106cabf80 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:07.396432 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-c3b0299d-a6c8-4e33-9e7e-556106cabf80 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:53:07.407740 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-c3b0299d-a6c8-4e33-9e7e-556106cabf80 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:53:07.409647 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-c3b0299d-a6c8-4e33-9e7e-556106cabf80 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:53:07.411448 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c3b0299d-a6c8-4e33-9e7e-556106cabf80 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] 10.222.0.46 "GET /compute/v2.1/servers/d94de6c9-be7d-4101-9f88-304b8a4ce8d7" status: 200 len: 1280 microversion: 2.25 time: 0.304583 Jan 15 20:53:07.413011 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 750/1443] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:53:07 2022] GET /compute/v2.1/servers/d94de6c9-be7d-4101-9f88-304b8a4ce8d7 => generated 1280 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:53:07.418470 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7894b80e-f63b-4d4b-a2fb-091da84ada0a tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:07.419289 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-7894b80e-f63b-4d4b-a2fb-091da84ada0a tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] [instance: ababfa7a-a809-4151-882d-0c3038b84ee0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:07.505747 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-7894b80e-f63b-4d4b-a2fb-091da84ada0a tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68bf33c7cdd84129a5544916a7dc3410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021c66112bf49f685a34c55841857bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:53:07.514600 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7894b80e-f63b-4d4b-a2fb-091da84ada0a tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] 10.222.0.46 "GET /compute/v2.1/servers/ababfa7a-a809-4151-882d-0c3038b84ee0" status: 200 len: 1218 microversion: 2.1 time: 0.100298 Jan 15 20:53:07.516673 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 751/1444] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:53:07 2022] GET /compute/v2.1/servers/ababfa7a-a809-4151-882d-0c3038b84ee0 => generated 1218 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:53:07.528434 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9dac0946-a80e-47ca-a774-c0199d896027 tempest-AbsoluteLimitsNegativeTestJSON-118879302 tempest-AbsoluteLimitsNegativeTestJSON-118879302-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1439182106", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:53:07.639335 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.network.neutron [None req-9dac0946-a80e-47ca-a774-c0199d896027 tempest-AbsoluteLimitsNegativeTestJSON-118879302 tempest-AbsoluteLimitsNegativeTestJSON-118879302-project] validate_networks() for None {{(pid=129366) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 20:53:08.039933 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-9dac0946-a80e-47ca-a774-c0199d896027 tempest-AbsoluteLimitsNegativeTestJSON-118879302 tempest-AbsoluteLimitsNegativeTestJSON-118879302-project] Getting quotas for project 28ea503f9af74c24bf698eb90d7bd637. Resources: dict_keys(['metadata_items']) {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:53:08.046875 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-9dac0946-a80e-47ca-a774-c0199d896027 tempest-AbsoluteLimitsNegativeTestJSON-118879302 tempest-AbsoluteLimitsNegativeTestJSON-118879302-project] Getting quotas for user 304938896f074f0194ee82828586db75 and project 28ea503f9af74c24bf698eb90d7bd637. Resources: dict_keys(['metadata_items']) {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:53:08.068188 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-9dac0946-a80e-47ca-a774-c0199d896027 tempest-AbsoluteLimitsNegativeTestJSON-118879302 tempest-AbsoluteLimitsNegativeTestJSON-118879302-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Jan 15 20:53:08.069108 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9dac0946-a80e-47ca-a774-c0199d896027 tempest-AbsoluteLimitsNegativeTestJSON-118879302 tempest-AbsoluteLimitsNegativeTestJSON-118879302-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:53:08.070414 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-9dac0946-a80e-47ca-a774-c0199d896027 tempest-AbsoluteLimitsNegativeTestJSON-118879302 tempest-AbsoluteLimitsNegativeTestJSON-118879302-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.551732 Jan 15 20:53:08.071594 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 752/1445] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Jan 15 20:53:07 2022] POST /compute/v2.1/servers => generated 87 bytes in 553 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Jan 15 20:53:08.092881 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-923b5bcf-2854-4b6c-936e-b9e140e508a4 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:08.093732 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-923b5bcf-2854-4b6c-936e-b9e140e508a4 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: e983108d-66c6-472e-bfc1-761f8a333569] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:08.104480 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-923b5bcf-2854-4b6c-936e-b9e140e508a4 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:08.104980 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-923b5bcf-2854-4b6c-936e-b9e140e508a4 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:08.106488 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-923b5bcf-2854-4b6c-936e-b9e140e508a4 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:08.107211 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-923b5bcf-2854-4b6c-936e-b9e140e508a4 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:08.696965 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-923b5bcf-2854-4b6c-936e-b9e140e508a4 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:53:08.712312 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-923b5bcf-2854-4b6c-936e-b9e140e508a4 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/e983108d-66c6-472e-bfc1-761f8a333569" status: 200 len: 1475 microversion: 2.1 time: 0.627580 Jan 15 20:53:08.715005 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 753/1446] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:53:08 2022] GET /compute/v2.1/servers/e983108d-66c6-472e-bfc1-761f8a333569 => generated 1475 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:53:08.720191 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-fd6344a8-bf26-44dc-aac2-fced87dcfea2 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:53:08.730315 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-fd6344a8-bf26-44dc-aac2-fced87dcfea2 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 57bd310f-a604-40de-9c25-882284f4a17b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:08.742079 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fd6344a8-bf26-44dc-aac2-fced87dcfea2 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:08.746244 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fd6344a8-bf26-44dc-aac2-fced87dcfea2 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:08.747365 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fd6344a8-bf26-44dc-aac2-fced87dcfea2 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:08.747841 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fd6344a8-bf26-44dc-aac2-fced87dcfea2 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:08.795532 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-fd6344a8-bf26-44dc-aac2-fced87dcfea2 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/action" status: 200 len: 32621 microversion: 2.1 time: 0.077653 Jan 15 20:53:08.803301 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 754/1447] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:53:08 2022] POST /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/action => generated 32621 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:53:08.815201 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9fd36b92-b618-4477-9493-6ad9e75c3519 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:08.819019 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-9fd36b92-b618-4477-9493-6ad9e75c3519 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] [instance: b1d27142-a9e4-440b-a719-d2059db11e79] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:08.832527 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9fd36b92-b618-4477-9493-6ad9e75c3519 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:08.833085 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9fd36b92-b618-4477-9493-6ad9e75c3519 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:08.835106 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9fd36b92-b618-4477-9493-6ad9e75c3519 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:08.835795 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9fd36b92-b618-4477-9493-6ad9e75c3519 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:09.146640 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-9fd36b92-b618-4477-9493-6ad9e75c3519 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55be87ae7f14b499ab2cd6fc5538988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd217e7fd648b4a78c0c32ff1c95f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:53:09.165578 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-9fd36b92-b618-4477-9493-6ad9e75c3519 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "GET /compute/v2.1/servers/b1d27142-a9e4-440b-a719-d2059db11e79" status: 200 len: 1486 microversion: 2.1 time: 0.360067 Jan 15 20:53:09.179480 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 755/1448] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:53:08 2022] GET /compute/v2.1/servers/b1d27142-a9e4-440b-a719-d2059db11e79 => generated 1486 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:53:09.194346 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-57f05c63-423b-4e53-b4b1-efdb002959b1 req-c8624bf8-481d-4e89-b600-44108281dcbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d94de6c9-be7d-4101-9f88-304b8a4ce8d7", "name": "network-vif-plugged", "status": "completed", "tag": "9ae7fa8e-01aa-4321-8949-4398f2fc1b57"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:53:09.200936 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:53:09.200936 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:53:09.219427 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-57f05c63-423b-4e53-b4b1-efdb002959b1 req-c8624bf8-481d-4e89-b600-44108281dcbc service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:09.223353 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-57f05c63-423b-4e53-b4b1-efdb002959b1 req-c8624bf8-481d-4e89-b600-44108281dcbc service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:09.248518 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-57f05c63-423b-4e53-b4b1-efdb002959b1 req-c8624bf8-481d-4e89-b600-44108281dcbc service nova] Creating event network-vif-plugged:9ae7fa8e-01aa-4321-8949-4398f2fc1b57 for instance d94de6c9-be7d-4101-9f88-304b8a4ce8d7 on nch1-master-1 Jan 15 20:53:09.263434 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-57f05c63-423b-4e53-b4b1-efdb002959b1 req-c8624bf8-481d-4e89-b600-44108281dcbc service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077553 Jan 15 20:53:09.264666 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 756/1449] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:53:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:53:09.279397 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-289102f8-8247-469c-a301-b1a39f80804f req-cf71e28a-080f-4700-880a-f9f1a5cbaac2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e983108d-66c6-472e-bfc1-761f8a333569", "name": "network-vif-unplugged", "status": "completed", "tag": "5d3688c4-ca00-4b8e-9475-e69603c54112"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:53:09.284708 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:53:09.284708 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:53:09.305828 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-289102f8-8247-469c-a301-b1a39f80804f req-cf71e28a-080f-4700-880a-f9f1a5cbaac2 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:09.309447 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-289102f8-8247-469c-a301-b1a39f80804f req-cf71e28a-080f-4700-880a-f9f1a5cbaac2 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:09.338589 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-289102f8-8247-469c-a301-b1a39f80804f req-cf71e28a-080f-4700-880a-f9f1a5cbaac2 service nova] Creating event network-vif-unplugged:5d3688c4-ca00-4b8e-9475-e69603c54112 for instance e983108d-66c6-472e-bfc1-761f8a333569 on nch2-master-1 Jan 15 20:53:09.362920 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [req-289102f8-8247-469c-a301-b1a39f80804f req-cf71e28a-080f-4700-880a-f9f1a5cbaac2 service nova] Instance e983108d-66c6-472e-bfc1-761f8a333569 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=129366) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Jan 15 20:53:09.378386 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-289102f8-8247-469c-a301-b1a39f80804f req-cf71e28a-080f-4700-880a-f9f1a5cbaac2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.111443 Jan 15 20:53:09.380591 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 757/1450] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:53:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:53:09.386598 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-16cbfb7c-f270-4b57-bece-17ead1d1f5a2 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:09.387545 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-16cbfb7c-f270-4b57-bece-17ead1d1f5a2 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] [instance: d94de6c9-be7d-4101-9f88-304b8a4ce8d7] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:09.396916 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-16cbfb7c-f270-4b57-bece-17ead1d1f5a2 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:09.397614 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-16cbfb7c-f270-4b57-bece-17ead1d1f5a2 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:09.398567 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-16cbfb7c-f270-4b57-bece-17ead1d1f5a2 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:09.399360 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-16cbfb7c-f270-4b57-bece-17ead1d1f5a2 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:09.744285 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-16cbfb7c-f270-4b57-bece-17ead1d1f5a2 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:53:09.756388 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-16cbfb7c-f270-4b57-bece-17ead1d1f5a2 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:53:09.758266 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-16cbfb7c-f270-4b57-bece-17ead1d1f5a2 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:53:09.760055 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-16cbfb7c-f270-4b57-bece-17ead1d1f5a2 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] 10.222.0.46 "GET /compute/v2.1/servers/d94de6c9-be7d-4101-9f88-304b8a4ce8d7" status: 200 len: 1280 microversion: 2.25 time: 0.377784 Jan 15 20:53:09.761198 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 758/1451] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:53:09 2022] GET /compute/v2.1/servers/d94de6c9-be7d-4101-9f88-304b8a4ce8d7 => generated 1280 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:53:09.766382 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f39dcd4b-ad79-43a4-b916-76d14098c831 tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:09.768266 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f39dcd4b-ad79-43a4-b916-76d14098c831 tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] [instance: ababfa7a-a809-4151-882d-0c3038b84ee0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:09.772166 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-07c13946-9793-4e43-8f96-d09a0099d326 tempest-FloatingIPsTestJSON-1217128180 tempest-FloatingIPsTestJSON-1217128180-project] 10.222.0.46 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.169829 Jan 15 20:53:09.772792 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 694/1452] 10.222.0.46 () {60 vars in 1169 bytes} [Sat Jan 15 20:53:06 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:53:09.779964 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f39dcd4b-ad79-43a4-b916-76d14098c831 tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:09.780508 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f39dcd4b-ad79-43a4-b916-76d14098c831 tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:09.781569 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f39dcd4b-ad79-43a4-b916-76d14098c831 tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:09.784086 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-430af668-507f-4b1b-9f17-81a41b39ddce tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:53:09.784361 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f39dcd4b-ad79-43a4-b916-76d14098c831 tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:09.784619 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-430af668-507f-4b1b-9f17-81a41b39ddce tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] [instance: b1d27142-a9e4-440b-a719-d2059db11e79] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:09.792004 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-430af668-507f-4b1b-9f17-81a41b39ddce tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:09.792999 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-430af668-507f-4b1b-9f17-81a41b39ddce tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:09.793955 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-430af668-507f-4b1b-9f17-81a41b39ddce tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:09.794550 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-430af668-507f-4b1b-9f17-81a41b39ddce tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:09.822434 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.objects.instance [None req-430af668-507f-4b1b-9f17-81a41b39ddce tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lazy-loading 'flavor' on Instance uuid b1d27142-a9e4-440b-a719-d2059db11e79 {{(pid=129365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 20:53:09.902711 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-f39dcd4b-ad79-43a4-b916-76d14098c831 tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68bf33c7cdd84129a5544916a7dc3410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021c66112bf49f685a34c55841857bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:53:09.914139 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f39dcd4b-ad79-43a4-b916-76d14098c831 tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] 10.222.0.46 "GET /compute/v2.1/servers/ababfa7a-a809-4151-882d-0c3038b84ee0" status: 200 len: 1276 microversion: 2.1 time: 0.151145 Jan 15 20:53:09.916922 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 759/1453] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:53:09 2022] GET /compute/v2.1/servers/ababfa7a-a809-4151-882d-0c3038b84ee0 => generated 1276 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:53:09.931790 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a16463c8-907e-48c6-8ce9-50619bce5ab7 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:09.934682 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a16463c8-907e-48c6-8ce9-50619bce5ab7 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: e983108d-66c6-472e-bfc1-761f8a333569] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:09.960161 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a16463c8-907e-48c6-8ce9-50619bce5ab7 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:09.960579 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a16463c8-907e-48c6-8ce9-50619bce5ab7 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:09.961866 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a16463c8-907e-48c6-8ce9-50619bce5ab7 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:09.962368 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a16463c8-907e-48c6-8ce9-50619bce5ab7 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:09.962853 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-430af668-507f-4b1b-9f17-81a41b39ddce tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "POST /compute/v2.1/servers/b1d27142-a9e4-440b-a719-d2059db11e79/action" status: 202 len: 0 microversion: 2.1 time: 0.182539 Jan 15 20:53:09.965689 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 695/1454] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:53:09 2022] POST /compute/v2.1/servers/b1d27142-a9e4-440b-a719-d2059db11e79/action => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 20:53:09.984596 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f69f630d-8099-4e5c-b9b9-6ee83eba95ce tempest-FloatingIPsTestJSON-1217128180 tempest-FloatingIPsTestJSON-1217128180-project] Calling method '.version_select at 0x7f30c917db80>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:10.239527 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-a16463c8-907e-48c6-8ce9-50619bce5ab7 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:53:10.248478 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a16463c8-907e-48c6-8ce9-50619bce5ab7 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/e983108d-66c6-472e-bfc1-761f8a333569" status: 200 len: 1475 microversion: 2.1 time: 0.327276 Jan 15 20:53:10.260672 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 760/1455] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:53:09 2022] GET /compute/v2.1/servers/e983108d-66c6-472e-bfc1-761f8a333569 => generated 1475 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:53:10.273198 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0c2ac681-50aa-4f34-8fc5-063802031037 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:53:10.276037 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-0c2ac681-50aa-4f34-8fc5-063802031037 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 57bd310f-a604-40de-9c25-882284f4a17b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:10.283496 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0c2ac681-50aa-4f34-8fc5-063802031037 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:10.284008 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0c2ac681-50aa-4f34-8fc5-063802031037 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:10.284872 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0c2ac681-50aa-4f34-8fc5-063802031037 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:10.285322 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0c2ac681-50aa-4f34-8fc5-063802031037 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:10.364955 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0c2ac681-50aa-4f34-8fc5-063802031037 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/action" status: 200 len: 32621 microversion: 2.1 time: 0.101790 Jan 15 20:53:10.372240 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 761/1456] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:53:10 2022] POST /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/action => generated 32621 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:53:10.379416 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-443674dd-d5a0-4b56-9b17-db7e2978fcf2 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:10.382995 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-443674dd-d5a0-4b56-9b17-db7e2978fcf2 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] [instance: b1d27142-a9e4-440b-a719-d2059db11e79] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:10.410081 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-443674dd-d5a0-4b56-9b17-db7e2978fcf2 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:10.410529 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-443674dd-d5a0-4b56-9b17-db7e2978fcf2 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:10.411335 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-443674dd-d5a0-4b56-9b17-db7e2978fcf2 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:10.411769 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-443674dd-d5a0-4b56-9b17-db7e2978fcf2 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:11.062149 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-443674dd-d5a0-4b56-9b17-db7e2978fcf2 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55be87ae7f14b499ab2cd6fc5538988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd217e7fd648b4a78c0c32ff1c95f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:53:11.071671 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-443674dd-d5a0-4b56-9b17-db7e2978fcf2 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "GET /compute/v2.1/servers/b1d27142-a9e4-440b-a719-d2059db11e79" status: 200 len: 1494 microversion: 2.1 time: 0.701061 Jan 15 20:53:11.087680 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 762/1457] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:53:10 2022] GET /compute/v2.1/servers/b1d27142-a9e4-440b-a719-d2059db11e79 => generated 1494 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:53:11.097633 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-641aacf3-5415-4eb3-a656-35654f515a60 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:11.098150 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-641aacf3-5415-4eb3-a656-35654f515a60 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] [instance: d94de6c9-be7d-4101-9f88-304b8a4ce8d7] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:11.132497 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-641aacf3-5415-4eb3-a656-35654f515a60 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:11.135098 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-641aacf3-5415-4eb3-a656-35654f515a60 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:11.140110 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-641aacf3-5415-4eb3-a656-35654f515a60 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:11.140766 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-641aacf3-5415-4eb3-a656-35654f515a60 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:11.554603 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-641aacf3-5415-4eb3-a656-35654f515a60 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:53:11.566047 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-641aacf3-5415-4eb3-a656-35654f515a60 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:53:11.569115 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-641aacf3-5415-4eb3-a656-35654f515a60 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:53:11.570534 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-641aacf3-5415-4eb3-a656-35654f515a60 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] 10.222.0.46 "GET /compute/v2.1/servers/d94de6c9-be7d-4101-9f88-304b8a4ce8d7" status: 200 len: 1280 microversion: 2.25 time: 0.481568 Jan 15 20:53:11.571647 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 763/1458] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:53:11 2022] GET /compute/v2.1/servers/d94de6c9-be7d-4101-9f88-304b8a4ce8d7 => generated 1280 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:53:11.576893 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9317ee6e-69cc-4051-b20a-d10934508961 tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:11.578006 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-9317ee6e-69cc-4051-b20a-d10934508961 tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] [instance: ababfa7a-a809-4151-882d-0c3038b84ee0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:11.589593 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9317ee6e-69cc-4051-b20a-d10934508961 tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:11.590712 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9317ee6e-69cc-4051-b20a-d10934508961 tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:11.593530 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9317ee6e-69cc-4051-b20a-d10934508961 tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:11.595052 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9317ee6e-69cc-4051-b20a-d10934508961 tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:11.864473 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f69f630d-8099-4e5c-b9b9-6ee83eba95ce tempest-FloatingIPsTestJSON-1217128180 tempest-FloatingIPsTestJSON-1217128180-project] 10.222.0.46 "DELETE /compute/v2.1/os-floating-ips/b3f4708c-4ccd-4196-aacf-e4b5c4ea5851" status: 202 len: 0 microversion: 2.1 time: 1.892547 Jan 15 20:53:11.865093 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 696/1459] 10.222.0.46 () {58 vars in 1262 bytes} [Sat Jan 15 20:53:09 2022] DELETE /compute/v2.1/os-floating-ips/b3f4708c-4ccd-4196-aacf-e4b5c4ea5851 => generated 0 bytes in 1899 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 20:53:11.870214 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2d895678-2c61-436c-b40a-e46142ee13cb tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:11.870548 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-9317ee6e-69cc-4051-b20a-d10934508961 tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68bf33c7cdd84129a5544916a7dc3410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021c66112bf49f685a34c55841857bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:53:11.870946 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-2d895678-2c61-436c-b40a-e46142ee13cb tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: e983108d-66c6-472e-bfc1-761f8a333569] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:11.878374 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2d895678-2c61-436c-b40a-e46142ee13cb tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:11.878746 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2d895678-2c61-436c-b40a-e46142ee13cb tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:11.879137 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-9317ee6e-69cc-4051-b20a-d10934508961 tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] 10.222.0.46 "GET /compute/v2.1/servers/ababfa7a-a809-4151-882d-0c3038b84ee0" status: 200 len: 1318 microversion: 2.1 time: 0.306077 Jan 15 20:53:11.879550 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2d895678-2c61-436c-b40a-e46142ee13cb tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:11.879993 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2d895678-2c61-436c-b40a-e46142ee13cb tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:11.880355 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 764/1460] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:53:11 2022] GET /compute/v2.1/servers/ababfa7a-a809-4151-882d-0c3038b84ee0 => generated 1318 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:53:11.885612 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-bf9f9c8b-a21d-4ed1-8f9a-9f6d7a5851fe tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:53:11.887336 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-bf9f9c8b-a21d-4ed1-8f9a-9f6d7a5851fe tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 57bd310f-a604-40de-9c25-882284f4a17b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:11.895614 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bf9f9c8b-a21d-4ed1-8f9a-9f6d7a5851fe tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:11.896570 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bf9f9c8b-a21d-4ed1-8f9a-9f6d7a5851fe tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:11.897582 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bf9f9c8b-a21d-4ed1-8f9a-9f6d7a5851fe tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:11.908077 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bf9f9c8b-a21d-4ed1-8f9a-9f6d7a5851fe tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:11.983810 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-bf9f9c8b-a21d-4ed1-8f9a-9f6d7a5851fe tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/action" status: 200 len: 32621 microversion: 2.1 time: 0.101511 Jan 15 20:53:11.985053 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 765/1461] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:53:11 2022] POST /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/action => generated 32621 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:53:11.994899 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-e8d4b352-6e89-4ef9-b807-1f85eff20d9e req-ad9154a9-ad93-4ba1-bed9-06d65453b796 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e983108d-66c6-472e-bfc1-761f8a333569", "tag": "5d3688c4-ca00-4b8e-9475-e69603c54112"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:53:11.998935 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:53:11.998935 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:53:12.017243 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-e8d4b352-6e89-4ef9-b807-1f85eff20d9e req-ad9154a9-ad93-4ba1-bed9-06d65453b796 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:12.024660 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-e8d4b352-6e89-4ef9-b807-1f85eff20d9e req-ad9154a9-ad93-4ba1-bed9-06d65453b796 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:12.060647 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-e8d4b352-6e89-4ef9-b807-1f85eff20d9e req-ad9154a9-ad93-4ba1-bed9-06d65453b796 service nova] Creating event network-changed:5d3688c4-ca00-4b8e-9475-e69603c54112 for instance e983108d-66c6-472e-bfc1-761f8a333569 on nch2-master-1 Jan 15 20:53:12.078178 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [req-e8d4b352-6e89-4ef9-b807-1f85eff20d9e req-ad9154a9-ad93-4ba1-bed9-06d65453b796 service nova] Instance e983108d-66c6-472e-bfc1-761f8a333569 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=129366) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Jan 15 20:53:12.103306 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-e8d4b352-6e89-4ef9-b807-1f85eff20d9e req-ad9154a9-ad93-4ba1-bed9-06d65453b796 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116591 Jan 15 20:53:12.107792 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 766/1462] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:53:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:53:12.121097 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b5acdd9a-8d72-4c90-a62d-3463a0e73f6d tempest-FloatingIPsTestJSON-1217128180 tempest-FloatingIPsTestJSON-1217128180-project] Calling method '.version_select at 0x7f30c8f3e940>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:12.131546 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-2d895678-2c61-436c-b40a-e46142ee13cb tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:53:12.140123 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2d895678-2c61-436c-b40a-e46142ee13cb tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/e983108d-66c6-472e-bfc1-761f8a333569" status: 200 len: 1473 microversion: 2.1 time: 0.273633 Jan 15 20:53:12.141079 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 697/1463] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:53:11 2022] GET /compute/v2.1/servers/e983108d-66c6-472e-bfc1-761f8a333569 => generated 1473 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:53:12.146716 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-20be0e04-ea09-4cfe-ba8c-62121a0ce907 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:12.147905 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-20be0e04-ea09-4cfe-ba8c-62121a0ce907 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] [instance: b1d27142-a9e4-440b-a719-d2059db11e79] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:12.155564 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-20be0e04-ea09-4cfe-ba8c-62121a0ce907 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:12.156370 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-20be0e04-ea09-4cfe-ba8c-62121a0ce907 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:12.158957 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-20be0e04-ea09-4cfe-ba8c-62121a0ce907 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:12.160338 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-20be0e04-ea09-4cfe-ba8c-62121a0ce907 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:12.197079 ncdv-master-1 devstack@n-api.service[129366]: DEBUG neutronclient.v2_0.client [None req-b5acdd9a-8d72-4c90-a62d-3463a0e73f6d tempest-FloatingIPsTestJSON-1217128180 tempest-FloatingIPsTestJSON-1217128180-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP b3f4708c-4ccd-4196-aacf-e4b5c4ea5851 could not be found", "detail": ""}} {{(pid=129366) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jan 15 20:53:12.197974 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-b5acdd9a-8d72-4c90-a62d-3463a0e73f6d tempest-FloatingIPsTestJSON-1217128180 tempest-FloatingIPsTestJSON-1217128180-project] HTTP exception thrown: Floating IP not found for ID b3f4708c-4ccd-4196-aacf-e4b5c4ea5851 Jan 15 20:53:12.198715 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b5acdd9a-8d72-4c90-a62d-3463a0e73f6d tempest-FloatingIPsTestJSON-1217128180 tempest-FloatingIPsTestJSON-1217128180-project] Returning 404 to user: Floating IP not found for ID b3f4708c-4ccd-4196-aacf-e4b5c4ea5851 {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:53:12.199720 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b5acdd9a-8d72-4c90-a62d-3463a0e73f6d tempest-FloatingIPsTestJSON-1217128180 tempest-FloatingIPsTestJSON-1217128180-project] 10.222.0.46 "GET /compute/v2.1/os-floating-ips/b3f4708c-4ccd-4196-aacf-e4b5c4ea5851" status: 404 len: 111 microversion: 2.1 time: 0.090562 Jan 15 20:53:12.200743 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 767/1464] 10.222.0.46 () {58 vars in 1259 bytes} [Sat Jan 15 20:53:12 2022] GET /compute/v2.1/os-floating-ips/b3f4708c-4ccd-4196-aacf-e4b5c4ea5851 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:53:12.208510 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-74e4d47c-4074-4123-b24c-1da627e0cda0 tempest-FloatingIPsTestJSON-1217128180 tempest-FloatingIPsTestJSON-1217128180-project] Calling method '.version_select at 0x7f30c923e550>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:12.294494 ncdv-master-1 devstack@n-api.service[129366]: DEBUG neutronclient.v2_0.client [None req-74e4d47c-4074-4123-b24c-1da627e0cda0 tempest-FloatingIPsTestJSON-1217128180 tempest-FloatingIPsTestJSON-1217128180-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP b3f4708c-4ccd-4196-aacf-e4b5c4ea5851 could not be found", "detail": ""}} {{(pid=129366) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jan 15 20:53:12.295382 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-74e4d47c-4074-4123-b24c-1da627e0cda0 tempest-FloatingIPsTestJSON-1217128180 tempest-FloatingIPsTestJSON-1217128180-project] HTTP exception thrown: Floating IP not found for ID b3f4708c-4ccd-4196-aacf-e4b5c4ea5851 Jan 15 20:53:12.296268 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-74e4d47c-4074-4123-b24c-1da627e0cda0 tempest-FloatingIPsTestJSON-1217128180 tempest-FloatingIPsTestJSON-1217128180-project] Returning 404 to user: Floating IP not found for ID b3f4708c-4ccd-4196-aacf-e4b5c4ea5851 {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:53:12.297332 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-74e4d47c-4074-4123-b24c-1da627e0cda0 tempest-FloatingIPsTestJSON-1217128180 tempest-FloatingIPsTestJSON-1217128180-project] 10.222.0.46 "DELETE /compute/v2.1/os-floating-ips/b3f4708c-4ccd-4196-aacf-e4b5c4ea5851" status: 404 len: 111 microversion: 2.1 time: 0.092319 Jan 15 20:53:12.298366 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 768/1465] 10.222.0.46 () {58 vars in 1262 bytes} [Sat Jan 15 20:53:12 2022] DELETE /compute/v2.1/os-floating-ips/b3f4708c-4ccd-4196-aacf-e4b5c4ea5851 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:53:12.422242 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-20be0e04-ea09-4cfe-ba8c-62121a0ce907 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55be87ae7f14b499ab2cd6fc5538988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd217e7fd648b4a78c0c32ff1c95f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:53:12.433077 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-20be0e04-ea09-4cfe-ba8c-62121a0ce907 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "GET /compute/v2.1/servers/b1d27142-a9e4-440b-a719-d2059db11e79" status: 200 len: 1477 microversion: 2.1 time: 0.290329 Jan 15 20:53:12.446907 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 698/1466] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:53:12 2022] GET /compute/v2.1/servers/b1d27142-a9e4-440b-a719-d2059db11e79 => generated 1477 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:53:12.452315 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-5071aab3-080f-4c82-8012-034ece9c33a2 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-57592748"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:53:12.453558 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-5071aab3-080f-4c82-8012-034ece9c33a2 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] [instance: b1d27142-a9e4-440b-a719-d2059db11e79] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:12.461288 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5071aab3-080f-4c82-8012-034ece9c33a2 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:12.461777 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5071aab3-080f-4c82-8012-034ece9c33a2 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:12.462603 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5071aab3-080f-4c82-8012-034ece9c33a2 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:12.463052 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5071aab3-080f-4c82-8012-034ece9c33a2 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:12.589401 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-6a13a5f7-e302-4fb1-be61-4264bb2402e3 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:12.590038 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-6a13a5f7-e302-4fb1-be61-4264bb2402e3 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] [instance: d94de6c9-be7d-4101-9f88-304b8a4ce8d7] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:12.598938 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6a13a5f7-e302-4fb1-be61-4264bb2402e3 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:12.599476 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6a13a5f7-e302-4fb1-be61-4264bb2402e3 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:12.600356 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6a13a5f7-e302-4fb1-be61-4264bb2402e3 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:12.600884 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6a13a5f7-e302-4fb1-be61-4264bb2402e3 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:12.970378 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-5071aab3-080f-4c82-8012-034ece9c33a2 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "POST /compute/v2.1/servers/b1d27142-a9e4-440b-a719-d2059db11e79/action" status: 202 len: 0 microversion: 2.1 time: 0.520664 Jan 15 20:53:12.974537 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 769/1467] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:53:12 2022] POST /compute/v2.1/servers/b1d27142-a9e4-440b-a719-d2059db11e79/action => generated 0 bytes in 527 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Jan 15 20:53:12.993637 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-df688abf-302a-439d-8cea-80776abeafb8 tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:12.994357 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-df688abf-302a-439d-8cea-80776abeafb8 tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] [instance: ababfa7a-a809-4151-882d-0c3038b84ee0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:13.006044 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-df688abf-302a-439d-8cea-80776abeafb8 tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:13.006968 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-df688abf-302a-439d-8cea-80776abeafb8 tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:13.012301 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-df688abf-302a-439d-8cea-80776abeafb8 tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:13.013088 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-df688abf-302a-439d-8cea-80776abeafb8 tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:13.210382 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-6a13a5f7-e302-4fb1-be61-4264bb2402e3 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:53:13.218452 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-6a13a5f7-e302-4fb1-be61-4264bb2402e3 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:53:13.220043 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-6a13a5f7-e302-4fb1-be61-4264bb2402e3 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:53:13.222035 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-6a13a5f7-e302-4fb1-be61-4264bb2402e3 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] 10.222.0.46 "GET /compute/v2.1/servers/d94de6c9-be7d-4101-9f88-304b8a4ce8d7" status: 200 len: 1475 microversion: 2.25 time: 0.635837 Jan 15 20:53:13.222035 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 699/1468] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:53:12 2022] GET /compute/v2.1/servers/d94de6c9-be7d-4101-9f88-304b8a4ce8d7 => generated 1475 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 15 20:53:13.249140 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f1b982a6-b259-445a-a446-8f060f784abe tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '.version_select at 0x7f30c96bbdc0>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:13.314186 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f1b982a6-b259-445a-a446-8f060f784abe tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "GET /compute/v2.1/images/07eb66c4-9522-4f02-aad6-44189090dfa5" status: 200 len: 1438 microversion: 2.1 time: 0.090810 Jan 15 20:53:13.329326 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 700/1469] 10.222.0.46 () {58 vars in 1232 bytes} [Sat Jan 15 20:53:13 2022] GET /compute/v2.1/images/07eb66c4-9522-4f02-aad6-44189090dfa5 => generated 1438 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:53:13.334272 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-83215b78-771d-43ca-9416-3aeae108c33f tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:53:13.335249 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-83215b78-771d-43ca-9416-3aeae108c33f tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 57bd310f-a604-40de-9c25-882284f4a17b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:13.346761 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-83215b78-771d-43ca-9416-3aeae108c33f tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:13.347217 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-83215b78-771d-43ca-9416-3aeae108c33f tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:13.348022 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-83215b78-771d-43ca-9416-3aeae108c33f tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:13.348454 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-83215b78-771d-43ca-9416-3aeae108c33f tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:13.447776 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-83215b78-771d-43ca-9416-3aeae108c33f tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/action" status: 200 len: 32621 microversion: 2.1 time: 0.113395 Jan 15 20:53:13.448481 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 701/1470] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:53:13 2022] POST /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/action => generated 32621 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:53:13.460894 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3663f042-0bee-45c8-8872-afc57a543284 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:13.463737 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-3663f042-0bee-45c8-8872-afc57a543284 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: e983108d-66c6-472e-bfc1-761f8a333569] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:13.480184 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3663f042-0bee-45c8-8872-afc57a543284 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:13.481033 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3663f042-0bee-45c8-8872-afc57a543284 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:13.485475 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3663f042-0bee-45c8-8872-afc57a543284 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:13.486295 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3663f042-0bee-45c8-8872-afc57a543284 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:13.787154 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-df688abf-302a-439d-8cea-80776abeafb8 tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68bf33c7cdd84129a5544916a7dc3410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021c66112bf49f685a34c55841857bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:53:13.800048 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-df688abf-302a-439d-8cea-80776abeafb8 tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] 10.222.0.46 "GET /compute/v2.1/servers/ababfa7a-a809-4151-882d-0c3038b84ee0" status: 200 len: 1318 microversion: 2.1 time: 0.821447 Jan 15 20:53:13.801317 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 770/1471] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:53:12 2022] GET /compute/v2.1/servers/ababfa7a-a809-4151-882d-0c3038b84ee0 => generated 1318 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:53:13.806200 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-73c92be2-480d-4ca6-aeb1-146a2bf75e5f tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:13.811465 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-73c92be2-480d-4ca6-aeb1-146a2bf75e5f tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] [instance: d94de6c9-be7d-4101-9f88-304b8a4ce8d7] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:13.831096 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-73c92be2-480d-4ca6-aeb1-146a2bf75e5f tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:13.831971 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-73c92be2-480d-4ca6-aeb1-146a2bf75e5f tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:13.838702 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-73c92be2-480d-4ca6-aeb1-146a2bf75e5f tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:13.839527 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-73c92be2-480d-4ca6-aeb1-146a2bf75e5f tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:14.112160 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-3663f042-0bee-45c8-8872-afc57a543284 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:53:14.126727 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3663f042-0bee-45c8-8872-afc57a543284 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/e983108d-66c6-472e-bfc1-761f8a333569" status: 200 len: 1473 microversion: 2.1 time: 0.668086 Jan 15 20:53:14.127434 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 702/1472] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:53:13 2022] GET /compute/v2.1/servers/e983108d-66c6-472e-bfc1-761f8a333569 => generated 1473 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:53:14.243329 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.objects.instance [None req-73c92be2-480d-4ca6-aeb1-146a2bf75e5f tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Lazy-loading 'services' on Instance uuid d94de6c9-be7d-4101-9f88-304b8a4ce8d7 {{(pid=129366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 20:53:14.263256 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-73c92be2-480d-4ca6-aeb1-146a2bf75e5f tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/d94de6c9-be7d-4101-9f88-304b8a4ce8d7" status: 200 len: 1967 microversion: 2.25 time: 0.460577 Jan 15 20:53:14.265089 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 771/1473] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:53:13 2022] GET /compute/v2.1/servers/d94de6c9-be7d-4101-9f88-304b8a4ce8d7 => generated 1967 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:53:14.284049 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-63147068-7dd7-4f5e-a0e4-d6e7251e7c73 tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:14.286761 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-63147068-7dd7-4f5e-a0e4-d6e7251e7c73 tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] [instance: d94de6c9-be7d-4101-9f88-304b8a4ce8d7] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:14.312247 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-63147068-7dd7-4f5e-a0e4-d6e7251e7c73 tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:14.314109 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-63147068-7dd7-4f5e-a0e4-d6e7251e7c73 tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:14.315257 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-63147068-7dd7-4f5e-a0e4-d6e7251e7c73 tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:14.316190 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-63147068-7dd7-4f5e-a0e4-d6e7251e7c73 tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:14.328086 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-3391dee7-163e-4bca-9a1f-32a7a2b51a94 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '.version_select at 0x7f30c8f3edc0>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:14.388208 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-3391dee7-163e-4bca-9a1f-32a7a2b51a94 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "GET /compute/v2.1/images/07eb66c4-9522-4f02-aad6-44189090dfa5" status: 200 len: 1438 microversion: 2.1 time: 0.064294 Jan 15 20:53:14.388811 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 772/1474] 10.222.0.46 () {58 vars in 1232 bytes} [Sat Jan 15 20:53:14 2022] GET /compute/v2.1/images/07eb66c4-9522-4f02-aad6-44189090dfa5 => generated 1438 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:53:14.461894 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-3a60d40d-9f9f-48ca-a267-9b634752d8f1 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:53:14.462862 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-3a60d40d-9f9f-48ca-a267-9b634752d8f1 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 57bd310f-a604-40de-9c25-882284f4a17b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:14.476922 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3a60d40d-9f9f-48ca-a267-9b634752d8f1 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:14.477663 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3a60d40d-9f9f-48ca-a267-9b634752d8f1 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:14.478646 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3a60d40d-9f9f-48ca-a267-9b634752d8f1 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:14.480540 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3a60d40d-9f9f-48ca-a267-9b634752d8f1 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:14.572343 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-3a60d40d-9f9f-48ca-a267-9b634752d8f1 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/action" status: 200 len: 32621 microversion: 2.1 time: 0.113875 Jan 15 20:53:14.573910 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 773/1475] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:53:14 2022] POST /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/action => generated 32621 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 20:53:14.649680 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.objects.instance [None req-63147068-7dd7-4f5e-a0e4-d6e7251e7c73 tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Lazy-loading 'services' on Instance uuid d94de6c9-be7d-4101-9f88-304b8a4ce8d7 {{(pid=129365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 20:53:14.684770 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-63147068-7dd7-4f5e-a0e4-d6e7251e7c73 tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/d94de6c9-be7d-4101-9f88-304b8a4ce8d7" status: 200 len: 1967 microversion: 2.25 time: 0.406428 Jan 15 20:53:14.685723 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 703/1476] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:53:14 2022] GET /compute/v2.1/servers/d94de6c9-be7d-4101-9f88-304b8a4ce8d7 => generated 1967 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:53:14.705991 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d39f0166-bb0a-4b44-b782-ac89db9d9c0f tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:14.707691 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:53:14.707691 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:53:14.709550 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d39f0166-bb0a-4b44-b782-ac89db9d9c0f tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:14.710182 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d39f0166-bb0a-4b44-b782-ac89db9d9c0f tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:14.710990 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d39f0166-bb0a-4b44-b782-ac89db9d9c0f tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:14.714489 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d39f0166-bb0a-4b44-b782-ac89db9d9c0f tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:14.760736 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b31ec84a-a5b0-4bb3-931f-c78c80028ac1 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Action: 'create', calling method: .version_select at 0x7f30c8f44c10>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2004995086", "description": "tempest-description-371575632"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:53:14.771261 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d39f0166-bb0a-4b44-b782-ac89db9d9c0f tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] 10.222.0.46 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.069530 Jan 15 20:53:14.777485 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 704/1477] 10.222.0.46 () {60 vars in 1216 bytes} [Sat Jan 15 20:53:14 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:53:14.782921 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-6484a0fb-955f-4719-80c3-0aa7c9b74df4 tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": "auto"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:53:14.784012 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-6484a0fb-955f-4719-80c3-0aa7c9b74df4 tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] [instance: d94de6c9-be7d-4101-9f88-304b8a4ce8d7] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:14.792329 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6484a0fb-955f-4719-80c3-0aa7c9b74df4 tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:14.805642 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6484a0fb-955f-4719-80c3-0aa7c9b74df4 tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:14.806805 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6484a0fb-955f-4719-80c3-0aa7c9b74df4 tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:14.807419 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6484a0fb-955f-4719-80c3-0aa7c9b74df4 tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:14.858155 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.objects.instance [None req-6484a0fb-955f-4719-80c3-0aa7c9b74df4 tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Lazy-loading 'flavor' on Instance uuid d94de6c9-be7d-4101-9f88-304b8a4ce8d7 {{(pid=129365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 20:53:14.879234 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-6484a0fb-955f-4719-80c3-0aa7c9b74df4 tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] [instance: d94de6c9-be7d-4101-9f88-304b8a4ce8d7] Going to try to live migrate instance to nch2-master-1 {{(pid=129365) live_migrate /opt/stack/nova/nova/compute/api.py:5255}} Jan 15 20:53:15.093328 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b31ec84a-a5b0-4bb3-931f-c78c80028ac1 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] 10.222.0.46 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.518047 Jan 15 20:53:15.100622 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 774/1478] 10.222.0.46 () {60 vars in 1179 bytes} [Sat Jan 15 20:53:14 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:53:15.100622 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0660532b-4321-4ee7-88eb-78e0981944c7 tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:15.101338 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-0660532b-4321-4ee7-88eb-78e0981944c7 tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] [instance: ababfa7a-a809-4151-882d-0c3038b84ee0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:15.117346 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0660532b-4321-4ee7-88eb-78e0981944c7 tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:15.117821 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0660532b-4321-4ee7-88eb-78e0981944c7 tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:15.129464 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0660532b-4321-4ee7-88eb-78e0981944c7 tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:15.129986 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0660532b-4321-4ee7-88eb-78e0981944c7 tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:15.364389 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-0660532b-4321-4ee7-88eb-78e0981944c7 tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68bf33c7cdd84129a5544916a7dc3410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021c66112bf49f685a34c55841857bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:53:15.380120 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0660532b-4321-4ee7-88eb-78e0981944c7 tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] 10.222.0.46 "GET /compute/v2.1/servers/ababfa7a-a809-4151-882d-0c3038b84ee0" status: 200 len: 1318 microversion: 2.1 time: 0.283237 Jan 15 20:53:15.389951 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 775/1479] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:53:15 2022] GET /compute/v2.1/servers/ababfa7a-a809-4151-882d-0c3038b84ee0 => generated 1318 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:53:15.389951 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-fc8e0457-b30e-442b-a539-311fceae7fae req-d0e5f50c-206b-4f30-9260-a0f33705baa3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ababfa7a-a809-4151-882d-0c3038b84ee0", "tag": "2a9f43b8-de6a-4b89-898a-8021a4807d97"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:53:15.389951 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:53:15.389951 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:53:15.395005 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-fc8e0457-b30e-442b-a539-311fceae7fae req-d0e5f50c-206b-4f30-9260-a0f33705baa3 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:15.395439 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-fc8e0457-b30e-442b-a539-311fceae7fae req-d0e5f50c-206b-4f30-9260-a0f33705baa3 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:15.412760 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-fc8e0457-b30e-442b-a539-311fceae7fae req-d0e5f50c-206b-4f30-9260-a0f33705baa3 service nova] Creating event network-changed:2a9f43b8-de6a-4b89-898a-8021a4807d97 for instance ababfa7a-a809-4151-882d-0c3038b84ee0 on nch2-master-1 Jan 15 20:53:15.434293 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-fc8e0457-b30e-442b-a539-311fceae7fae req-d0e5f50c-206b-4f30-9260-a0f33705baa3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052123 Jan 15 20:53:15.438322 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 776/1480] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:53:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:53:15.445488 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c6af3a11-8c51-4ba8-ada8-96f24d612936 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Action: 'create', calling method: .version_select at 0x7f30c8f84790>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1457502985", "description": "tempest-description-670198727"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:53:15.691723 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c6af3a11-8c51-4ba8-ada8-96f24d612936 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] 10.222.0.46 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.251561 Jan 15 20:53:15.692462 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 777/1481] 10.222.0.46 () {60 vars in 1179 bytes} [Sat Jan 15 20:53:15 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:53:15.697616 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c8f5ed82-e4b9-44d2-9fb6-2c792809dec8 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:15.698709 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c8f5ed82-e4b9-44d2-9fb6-2c792809dec8 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: e983108d-66c6-472e-bfc1-761f8a333569] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:15.721947 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c8f5ed82-e4b9-44d2-9fb6-2c792809dec8 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:15.722840 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c8f5ed82-e4b9-44d2-9fb6-2c792809dec8 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:15.728405 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c8f5ed82-e4b9-44d2-9fb6-2c792809dec8 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:15.731476 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c8f5ed82-e4b9-44d2-9fb6-2c792809dec8 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:16.160599 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-c8f5ed82-e4b9-44d2-9fb6-2c792809dec8 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:53:16.168784 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c8f5ed82-e4b9-44d2-9fb6-2c792809dec8 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/e983108d-66c6-472e-bfc1-761f8a333569" status: 200 len: 1470 microversion: 2.1 time: 0.474895 Jan 15 20:53:16.187674 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 778/1482] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:53:15 2022] GET /compute/v2.1/servers/e983108d-66c6-472e-bfc1-761f8a333569 => generated 1470 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:53:16.195788 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ffab919a-a4c1-4cd5-b8e9-5146004a284d tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '.version_select at 0x7f30c8efb9d0>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:16.307854 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ffab919a-a4c1-4cd5-b8e9-5146004a284d tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "GET /compute/v2.1/images/07eb66c4-9522-4f02-aad6-44189090dfa5" status: 200 len: 1438 microversion: 2.1 time: 0.118660 Jan 15 20:53:16.308757 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 779/1483] 10.222.0.46 () {58 vars in 1232 bytes} [Sat Jan 15 20:53:16 2022] GET /compute/v2.1/images/07eb66c4-9522-4f02-aad6-44189090dfa5 => generated 1438 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:53:16.316373 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8e4ec6fb-15bc-43b8-9ad3-92a4d41e7fbb tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:53:16.322173 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-8e4ec6fb-15bc-43b8-9ad3-92a4d41e7fbb tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 57bd310f-a604-40de-9c25-882284f4a17b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:16.337061 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8e4ec6fb-15bc-43b8-9ad3-92a4d41e7fbb tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:16.341738 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8e4ec6fb-15bc-43b8-9ad3-92a4d41e7fbb tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:16.343021 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8e4ec6fb-15bc-43b8-9ad3-92a4d41e7fbb tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:16.343699 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8e4ec6fb-15bc-43b8-9ad3-92a4d41e7fbb tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:16.428248 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-8e4ec6fb-15bc-43b8-9ad3-92a4d41e7fbb tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/action" status: 200 len: 32621 microversion: 2.1 time: 0.116290 Jan 15 20:53:16.430140 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 780/1484] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:53:16 2022] POST /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/action => generated 32621 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:53:16.437744 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-97ed3c38-fc72-4601-8290-cc343fb30210 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1116768424", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "networks": [{"uuid": "1860aada-e54b-435b-befe-aece2a8913ae"}]}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:53:16.529262 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.network.neutron [None req-97ed3c38-fc72-4601-8290-cc343fb30210 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] validate_networks() for [('1860aada-e54b-435b-befe-aece2a8913ae', None, None, None, None, None)] {{(pid=129366) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 20:53:17.331300 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-97ed3c38-fc72-4601-8290-cc343fb30210 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Flavor limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 20:53:17.331956 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-97ed3c38-fc72-4601-8290-cc343fb30210 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Image limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 20:53:17.333665 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-97ed3c38-fc72-4601-8290-cc343fb30210 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Flavor pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 20:53:17.334248 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-97ed3c38-fc72-4601-8290-cc343fb30210 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Image pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 20:53:17.336681 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-97ed3c38-fc72-4601-8290-cc343fb30210 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 20:53:17.364108 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-97ed3c38-fc72-4601-8290-cc343fb30210 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:17.366269 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-97ed3c38-fc72-4601-8290-cc343fb30210 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:17.367358 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-97ed3c38-fc72-4601-8290-cc343fb30210 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:17.369360 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-97ed3c38-fc72-4601-8290-cc343fb30210 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:17.426226 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-97ed3c38-fc72-4601-8290-cc343fb30210 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Getting quotas for project 5515bef049574d4ea4c70f90ab8c4444. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:53:17.437101 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-97ed3c38-fc72-4601-8290-cc343fb30210 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Getting quotas for user b17e2708b6fc41b1ae6f70bcf99a0170 and project 5515bef049574d4ea4c70f90ab8c4444. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:53:17.492075 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-97ed3c38-fc72-4601-8290-cc343fb30210 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Going to run 1 instances... {{(pid=129366) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 20:53:17.502075 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-97ed3c38-fc72-4601-8290-cc343fb30210 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] [instance: 3fd1fac4-6c41-4230-9eb5-4fd5a4d82c15] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 20:53:17.655162 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-97ed3c38-fc72-4601-8290-cc343fb30210 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.221285 Jan 15 20:53:17.655872 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 781/1485] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 20:53:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1225 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 20:53:17.681868 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ecce4606-3c09-4f62-8872-502f32d830a0 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:53:17.686256 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ecce4606-3c09-4f62-8872-502f32d830a0 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: e983108d-66c6-472e-bfc1-761f8a333569] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:17.716333 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ecce4606-3c09-4f62-8872-502f32d830a0 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:17.718946 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ecce4606-3c09-4f62-8872-502f32d830a0 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:17.721790 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ecce4606-3c09-4f62-8872-502f32d830a0 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:17.724078 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ecce4606-3c09-4f62-8872-502f32d830a0 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:17.753521 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-6484a0fb-955f-4719-80c3-0aa7c9b74df4 tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] 10.222.0.46 "POST /compute/v2.1/servers/d94de6c9-be7d-4101-9f88-304b8a4ce8d7/action" status: 202 len: 0 microversion: 2.25 time: 2.973419 Jan 15 20:53:17.757659 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 705/1486] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 20:53:14 2022] POST /compute/v2.1/servers/d94de6c9-be7d-4101-9f88-304b8a4ce8d7/action => generated 0 bytes in 2978 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jan 15 20:53:17.763529 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3696dd9a-84d9-46f1-b9c1-60bfb71c59ed tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:17.764404 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-3696dd9a-84d9-46f1-b9c1-60bfb71c59ed tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] [instance: ababfa7a-a809-4151-882d-0c3038b84ee0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:17.782984 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3696dd9a-84d9-46f1-b9c1-60bfb71c59ed tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:17.784828 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3696dd9a-84d9-46f1-b9c1-60bfb71c59ed tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:17.788659 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3696dd9a-84d9-46f1-b9c1-60bfb71c59ed tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:17.789375 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3696dd9a-84d9-46f1-b9c1-60bfb71c59ed tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:18.074634 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ecce4606-3c09-4f62-8872-502f32d830a0 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "POST /compute/v2.1/servers/e983108d-66c6-472e-bfc1-761f8a333569/action" status: 202 len: 0 microversion: 2.1 time: 0.401745 Jan 15 20:53:18.078332 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 782/1487] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:53:17 2022] POST /compute/v2.1/servers/e983108d-66c6-472e-bfc1-761f8a333569/action => generated 0 bytes in 420 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 20:53:18.085147 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-222aa519-5d36-4120-8685-7309c6a3d4a3 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '.version_select at 0x7f30c8f04ee0>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:18.156314 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-222aa519-5d36-4120-8685-7309c6a3d4a3 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "GET /compute/v2.1/images/07eb66c4-9522-4f02-aad6-44189090dfa5" status: 200 len: 1438 microversion: 2.1 time: 0.075003 Jan 15 20:53:18.159345 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 783/1488] 10.222.0.46 () {58 vars in 1232 bytes} [Sat Jan 15 20:53:18 2022] GET /compute/v2.1/images/07eb66c4-9522-4f02-aad6-44189090dfa5 => generated 1438 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:53:18.171606 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7ddf15c1-f73b-438c-8338-351ab6485234 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:53:18.175538 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-7ddf15c1-f73b-438c-8338-351ab6485234 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 57bd310f-a604-40de-9c25-882284f4a17b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:18.192829 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7ddf15c1-f73b-438c-8338-351ab6485234 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:18.196935 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7ddf15c1-f73b-438c-8338-351ab6485234 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:18.197879 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7ddf15c1-f73b-438c-8338-351ab6485234 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:18.199537 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7ddf15c1-f73b-438c-8338-351ab6485234 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:18.227508 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-3696dd9a-84d9-46f1-b9c1-60bfb71c59ed tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68bf33c7cdd84129a5544916a7dc3410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021c66112bf49f685a34c55841857bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:53:18.236343 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3696dd9a-84d9-46f1-b9c1-60bfb71c59ed tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] 10.222.0.46 "GET /compute/v2.1/servers/ababfa7a-a809-4151-882d-0c3038b84ee0" status: 200 len: 1318 microversion: 2.1 time: 0.476734 Jan 15 20:53:18.236984 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 706/1489] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:53:17 2022] GET /compute/v2.1/servers/ababfa7a-a809-4151-882d-0c3038b84ee0 => generated 1318 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:53:18.261028 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-7b4fb693-033c-44b7-9838-6f9ab4cc3b49 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:18.261932 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-7b4fb693-033c-44b7-9838-6f9ab4cc3b49 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] [instance: 3fd1fac4-6c41-4230-9eb5-4fd5a4d82c15] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:18.302007 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7ddf15c1-f73b-438c-8338-351ab6485234 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/action" status: 200 len: 32621 microversion: 2.1 time: 0.140468 Jan 15 20:53:18.310697 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 784/1490] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:53:18 2022] POST /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/action => generated 32621 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:53:18.316882 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d299b81e-4d13-4240-a0a7-bf580c84c429 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:18.336963 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-d299b81e-4d13-4240-a0a7-bf580c84c429 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] [instance: d94de6c9-be7d-4101-9f88-304b8a4ce8d7] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:18.358180 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d299b81e-4d13-4240-a0a7-bf580c84c429 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:18.359992 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d299b81e-4d13-4240-a0a7-bf580c84c429 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:18.362218 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d299b81e-4d13-4240-a0a7-bf580c84c429 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:18.362899 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d299b81e-4d13-4240-a0a7-bf580c84c429 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:18.399730 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-7b4fb693-033c-44b7-9838-6f9ab4cc3b49 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17e2708b6fc41b1ae6f70bcf99a0170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515bef049574d4ea4c70f90ab8c4444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:53:18.408428 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-7b4fb693-033c-44b7-9838-6f9ab4cc3b49 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] 10.222.0.46 "GET /compute/v2.1/servers/3fd1fac4-6c41-4230-9eb5-4fd5a4d82c15" status: 200 len: 1216 microversion: 2.1 time: 0.170356 Jan 15 20:53:18.411609 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 707/1491] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:53:18 2022] GET /compute/v2.1/servers/3fd1fac4-6c41-4230-9eb5-4fd5a4d82c15 => generated 1216 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:53:18.441267 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-94a9e52e-f8ff-4693-9749-4afad7148506 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:18.446768 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-94a9e52e-f8ff-4693-9749-4afad7148506 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: e983108d-66c6-472e-bfc1-761f8a333569] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:18.474379 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-94a9e52e-f8ff-4693-9749-4afad7148506 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:18.476544 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-94a9e52e-f8ff-4693-9749-4afad7148506 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:18.477624 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-94a9e52e-f8ff-4693-9749-4afad7148506 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:18.488856 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-94a9e52e-f8ff-4693-9749-4afad7148506 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:19.442854 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-94a9e52e-f8ff-4693-9749-4afad7148506 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:53:19.451365 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-94a9e52e-f8ff-4693-9749-4afad7148506 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/e983108d-66c6-472e-bfc1-761f8a333569" status: 200 len: 1469 microversion: 2.1 time: 1.035894 Jan 15 20:53:19.461371 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 708/1492] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:53:18 2022] GET /compute/v2.1/servers/e983108d-66c6-472e-bfc1-761f8a333569 => generated 1469 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:53:19.461371 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f995ac8b-02cd-4e09-a9af-0896dcc916e6 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '.version_select at 0x7f30c95a03a0>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:19.605445 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f995ac8b-02cd-4e09-a9af-0896dcc916e6 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "GET /compute/v2.1/images/07eb66c4-9522-4f02-aad6-44189090dfa5" status: 200 len: 1438 microversion: 2.1 time: 0.150021 Jan 15 20:53:19.607339 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 709/1493] 10.222.0.46 () {58 vars in 1232 bytes} [Sat Jan 15 20:53:19 2022] GET /compute/v2.1/images/07eb66c4-9522-4f02-aad6-44189090dfa5 => generated 1438 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:53:19.625979 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-610adce0-de03-4bfc-a9c8-7c2ff71f5aa4 tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:19.633882 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-610adce0-de03-4bfc-a9c8-7c2ff71f5aa4 tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] [instance: ababfa7a-a809-4151-882d-0c3038b84ee0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:19.640509 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-610adce0-de03-4bfc-a9c8-7c2ff71f5aa4 tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:19.644211 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-610adce0-de03-4bfc-a9c8-7c2ff71f5aa4 tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:19.645285 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-610adce0-de03-4bfc-a9c8-7c2ff71f5aa4 tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:19.645875 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-610adce0-de03-4bfc-a9c8-7c2ff71f5aa4 tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:19.690342 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-d299b81e-4d13-4240-a0a7-bf580c84c429 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:53:19.713692 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-d299b81e-4d13-4240-a0a7-bf580c84c429 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:53:19.722918 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-d299b81e-4d13-4240-a0a7-bf580c84c429 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:53:19.724660 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d299b81e-4d13-4240-a0a7-bf580c84c429 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] 10.222.0.46 "GET /compute/v2.1/servers/d94de6c9-be7d-4101-9f88-304b8a4ce8d7" status: 200 len: 1485 microversion: 2.25 time: 1.412456 Jan 15 20:53:19.725849 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 785/1494] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:53:18 2022] GET /compute/v2.1/servers/d94de6c9-be7d-4101-9f88-304b8a4ce8d7 => generated 1485 bytes in 1414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:53:19.733995 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-898f27d4-05ab-4568-992e-d86ca8d0b12c tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:53:19.737984 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-898f27d4-05ab-4568-992e-d86ca8d0b12c tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 57bd310f-a604-40de-9c25-882284f4a17b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:19.765187 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-898f27d4-05ab-4568-992e-d86ca8d0b12c tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:19.766810 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-898f27d4-05ab-4568-992e-d86ca8d0b12c tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:19.769186 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-898f27d4-05ab-4568-992e-d86ca8d0b12c tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:19.770000 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-898f27d4-05ab-4568-992e-d86ca8d0b12c tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:19.853480 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-898f27d4-05ab-4568-992e-d86ca8d0b12c tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/action" status: 200 len: 32621 microversion: 2.1 time: 0.125828 Jan 15 20:53:19.858788 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 786/1495] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:53:19 2022] POST /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/action => generated 32621 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:53:19.869344 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-04457372-36d3-4b01-967d-47b735493aa0 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:19.874075 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-04457372-36d3-4b01-967d-47b735493aa0 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] [instance: 3fd1fac4-6c41-4230-9eb5-4fd5a4d82c15] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:19.889874 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-04457372-36d3-4b01-967d-47b735493aa0 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:19.890727 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-04457372-36d3-4b01-967d-47b735493aa0 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:19.895719 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-04457372-36d3-4b01-967d-47b735493aa0 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:19.896470 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-04457372-36d3-4b01-967d-47b735493aa0 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:20.081723 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-04457372-36d3-4b01-967d-47b735493aa0 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17e2708b6fc41b1ae6f70bcf99a0170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515bef049574d4ea4c70f90ab8c4444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:53:20.093130 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-04457372-36d3-4b01-967d-47b735493aa0 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] 10.222.0.46 "GET /compute/v2.1/servers/3fd1fac4-6c41-4230-9eb5-4fd5a4d82c15" status: 200 len: 1274 microversion: 2.1 time: 0.231369 Jan 15 20:53:20.097285 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 787/1496] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:53:19 2022] GET /compute/v2.1/servers/3fd1fac4-6c41-4230-9eb5-4fd5a4d82c15 => generated 1274 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:53:20.104093 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-17b38a3e-ef21-40bb-b426-caceec3a875f req-d3df76f2-b01a-4e25-8c94-98aa03d52cfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e983108d-66c6-472e-bfc1-761f8a333569", "name": "network-vif-plugged", "status": "completed", "tag": "5d3688c4-ca00-4b8e-9475-e69603c54112"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:53:20.107257 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:53:20.107257 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:53:20.130126 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-17b38a3e-ef21-40bb-b426-caceec3a875f req-d3df76f2-b01a-4e25-8c94-98aa03d52cfa service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:20.131393 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-17b38a3e-ef21-40bb-b426-caceec3a875f req-d3df76f2-b01a-4e25-8c94-98aa03d52cfa service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:20.165601 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-610adce0-de03-4bfc-a9c8-7c2ff71f5aa4 tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68bf33c7cdd84129a5544916a7dc3410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021c66112bf49f685a34c55841857bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:53:20.168189 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-17b38a3e-ef21-40bb-b426-caceec3a875f req-d3df76f2-b01a-4e25-8c94-98aa03d52cfa service nova] Creating event network-vif-plugged:5d3688c4-ca00-4b8e-9475-e69603c54112 for instance e983108d-66c6-472e-bfc1-761f8a333569 on nch2-master-1 Jan 15 20:53:20.178256 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-610adce0-de03-4bfc-a9c8-7c2ff71f5aa4 tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] 10.222.0.46 "GET /compute/v2.1/servers/ababfa7a-a809-4151-882d-0c3038b84ee0" status: 200 len: 1318 microversion: 2.1 time: 0.569654 Jan 15 20:53:20.179123 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 710/1497] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:53:19 2022] GET /compute/v2.1/servers/ababfa7a-a809-4151-882d-0c3038b84ee0 => generated 1318 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:53:20.182481 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [req-17b38a3e-ef21-40bb-b426-caceec3a875f req-d3df76f2-b01a-4e25-8c94-98aa03d52cfa service nova] Instance e983108d-66c6-472e-bfc1-761f8a333569 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=129366) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Jan 15 20:53:20.210936 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-17b38a3e-ef21-40bb-b426-caceec3a875f req-d3df76f2-b01a-4e25-8c94-98aa03d52cfa service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111799 Jan 15 20:53:20.211644 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 788/1498] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:53:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:53:20.468085 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f617a948-a7fc-45d5-9ce9-3deafe82d8d9 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:20.469896 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f617a948-a7fc-45d5-9ce9-3deafe82d8d9 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: e983108d-66c6-472e-bfc1-761f8a333569] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:20.490117 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f617a948-a7fc-45d5-9ce9-3deafe82d8d9 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:20.491672 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f617a948-a7fc-45d5-9ce9-3deafe82d8d9 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:20.495948 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f617a948-a7fc-45d5-9ce9-3deafe82d8d9 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:20.498938 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f617a948-a7fc-45d5-9ce9-3deafe82d8d9 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:20.620857 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-3666d5b2-7393-4a4e-98bd-ff9f6e39351c tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '.version_select at 0x7f30c8f3ee50>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:20.691646 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-3666d5b2-7393-4a4e-98bd-ff9f6e39351c tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "GET /compute/v2.1/images/07eb66c4-9522-4f02-aad6-44189090dfa5" status: 200 len: 1438 microversion: 2.1 time: 0.075128 Jan 15 20:53:20.692356 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 789/1499] 10.222.0.46 () {58 vars in 1232 bytes} [Sat Jan 15 20:53:20 2022] GET /compute/v2.1/images/07eb66c4-9522-4f02-aad6-44189090dfa5 => generated 1438 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:53:20.744244 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e81a7ca0-6beb-49bf-b673-89720c1457cb tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:20.745134 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e81a7ca0-6beb-49bf-b673-89720c1457cb tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] [instance: d94de6c9-be7d-4101-9f88-304b8a4ce8d7] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:20.762687 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e81a7ca0-6beb-49bf-b673-89720c1457cb tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:20.765881 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e81a7ca0-6beb-49bf-b673-89720c1457cb tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:20.767577 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e81a7ca0-6beb-49bf-b673-89720c1457cb tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:20.771102 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e81a7ca0-6beb-49bf-b673-89720c1457cb tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:20.852411 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-f617a948-a7fc-45d5-9ce9-3deafe82d8d9 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:53:20.862434 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f617a948-a7fc-45d5-9ce9-3deafe82d8d9 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/e983108d-66c6-472e-bfc1-761f8a333569" status: 200 len: 1469 microversion: 2.1 time: 0.398102 Jan 15 20:53:20.863044 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 711/1500] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:53:20 2022] GET /compute/v2.1/servers/e983108d-66c6-472e-bfc1-761f8a333569 => generated 1469 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:53:20.879462 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-21448907-8fd6-42a1-b5ba-34a90474e919 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:53:20.880441 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-21448907-8fd6-42a1-b5ba-34a90474e919 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 57bd310f-a604-40de-9c25-882284f4a17b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:20.916624 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-21448907-8fd6-42a1-b5ba-34a90474e919 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:20.918241 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-21448907-8fd6-42a1-b5ba-34a90474e919 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:20.921340 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-21448907-8fd6-42a1-b5ba-34a90474e919 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:20.925538 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-21448907-8fd6-42a1-b5ba-34a90474e919 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:21.045378 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-21448907-8fd6-42a1-b5ba-34a90474e919 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/action" status: 200 len: 32621 microversion: 2.1 time: 0.181036 Jan 15 20:53:21.046038 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 712/1501] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:53:20 2022] POST /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/action => generated 32621 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:53:21.114986 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2ef68253-eb79-46e5-beb3-788c1a2c856d tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:21.116160 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-2ef68253-eb79-46e5-beb3-788c1a2c856d tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] [instance: 3fd1fac4-6c41-4230-9eb5-4fd5a4d82c15] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:21.135760 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2ef68253-eb79-46e5-beb3-788c1a2c856d tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:21.136703 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2ef68253-eb79-46e5-beb3-788c1a2c856d tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:21.137694 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2ef68253-eb79-46e5-beb3-788c1a2c856d tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:21.140244 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2ef68253-eb79-46e5-beb3-788c1a2c856d tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:21.413742 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-2ef68253-eb79-46e5-beb3-788c1a2c856d tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17e2708b6fc41b1ae6f70bcf99a0170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515bef049574d4ea4c70f90ab8c4444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:53:21.427254 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2ef68253-eb79-46e5-beb3-788c1a2c856d tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] 10.222.0.46 "GET /compute/v2.1/servers/3fd1fac4-6c41-4230-9eb5-4fd5a4d82c15" status: 200 len: 1274 microversion: 2.1 time: 0.316818 Jan 15 20:53:21.436870 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 713/1502] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:53:21 2022] GET /compute/v2.1/servers/3fd1fac4-6c41-4230-9eb5-4fd5a4d82c15 => generated 1274 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:53:21.443809 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-21643458-b954-4933-bab9-0baa42ed57ef tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:21.444486 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-21643458-b954-4933-bab9-0baa42ed57ef tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] [instance: ababfa7a-a809-4151-882d-0c3038b84ee0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:21.460808 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-21643458-b954-4933-bab9-0baa42ed57ef tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:21.461288 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-21643458-b954-4933-bab9-0baa42ed57ef tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:21.465182 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-21643458-b954-4933-bab9-0baa42ed57ef tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:21.466361 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-21643458-b954-4933-bab9-0baa42ed57ef tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:21.490734 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-e81a7ca0-6beb-49bf-b673-89720c1457cb tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:53:21.503606 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-e81a7ca0-6beb-49bf-b673-89720c1457cb tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:53:21.505372 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-e81a7ca0-6beb-49bf-b673-89720c1457cb tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:53:21.515232 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e81a7ca0-6beb-49bf-b673-89720c1457cb tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] 10.222.0.46 "GET /compute/v2.1/servers/d94de6c9-be7d-4101-9f88-304b8a4ce8d7" status: 200 len: 1485 microversion: 2.25 time: 0.771912 Jan 15 20:53:21.516343 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 790/1503] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:53:20 2022] GET /compute/v2.1/servers/d94de6c9-be7d-4101-9f88-304b8a4ce8d7 => generated 1485 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 15 20:53:21.706269 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-17a6cccc-8d0d-45eb-955d-62b0fb1ba47e tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '.version_select at 0x7f30c8f020d0>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:21.817969 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-17a6cccc-8d0d-45eb-955d-62b0fb1ba47e tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "GET /compute/v2.1/images/07eb66c4-9522-4f02-aad6-44189090dfa5" status: 200 len: 1438 microversion: 2.1 time: 0.116363 Jan 15 20:53:21.819067 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 791/1504] 10.222.0.46 () {58 vars in 1232 bytes} [Sat Jan 15 20:53:21 2022] GET /compute/v2.1/images/07eb66c4-9522-4f02-aad6-44189090dfa5 => generated 1438 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:53:21.880247 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-aed1d5f5-bcdb-4d0e-9631-65be3908be1c tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:21.880879 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-aed1d5f5-bcdb-4d0e-9631-65be3908be1c tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: e983108d-66c6-472e-bfc1-761f8a333569] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:21.893017 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-aed1d5f5-bcdb-4d0e-9631-65be3908be1c tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:21.893812 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-aed1d5f5-bcdb-4d0e-9631-65be3908be1c tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:21.897112 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-aed1d5f5-bcdb-4d0e-9631-65be3908be1c tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:21.897810 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-aed1d5f5-bcdb-4d0e-9631-65be3908be1c tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:22.320468 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-21643458-b954-4933-bab9-0baa42ed57ef tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68bf33c7cdd84129a5544916a7dc3410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021c66112bf49f685a34c55841857bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:53:22.335312 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-21643458-b954-4933-bab9-0baa42ed57ef tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] 10.222.0.46 "GET /compute/v2.1/servers/ababfa7a-a809-4151-882d-0c3038b84ee0" status: 200 len: 1318 microversion: 2.1 time: 0.901704 Jan 15 20:53:22.351847 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 714/1505] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:53:21 2022] GET /compute/v2.1/servers/ababfa7a-a809-4151-882d-0c3038b84ee0 => generated 1318 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:53:22.365723 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5fcf2b31-9474-4e2f-b6d8-6b6e011c8896 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:53:22.367165 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-5fcf2b31-9474-4e2f-b6d8-6b6e011c8896 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 57bd310f-a604-40de-9c25-882284f4a17b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:22.388500 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5fcf2b31-9474-4e2f-b6d8-6b6e011c8896 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:22.397693 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5fcf2b31-9474-4e2f-b6d8-6b6e011c8896 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:22.400607 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5fcf2b31-9474-4e2f-b6d8-6b6e011c8896 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:22.401950 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5fcf2b31-9474-4e2f-b6d8-6b6e011c8896 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:22.483163 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5fcf2b31-9474-4e2f-b6d8-6b6e011c8896 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/action" status: 200 len: 32621 microversion: 2.1 time: 0.128453 Jan 15 20:53:22.488590 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 715/1506] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:53:22 2022] POST /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/action => generated 32621 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:53:22.506552 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b89e05c0-34f1-459a-bb00-02c809497d33 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:22.507456 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b89e05c0-34f1-459a-bb00-02c809497d33 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] [instance: 3fd1fac4-6c41-4230-9eb5-4fd5a4d82c15] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:22.514801 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b89e05c0-34f1-459a-bb00-02c809497d33 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:22.516479 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b89e05c0-34f1-459a-bb00-02c809497d33 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:22.522518 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b89e05c0-34f1-459a-bb00-02c809497d33 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:22.523148 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b89e05c0-34f1-459a-bb00-02c809497d33 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:22.640466 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-aed1d5f5-bcdb-4d0e-9631-65be3908be1c tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:53:22.659991 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-aed1d5f5-bcdb-4d0e-9631-65be3908be1c tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/e983108d-66c6-472e-bfc1-761f8a333569" status: 200 len: 1469 microversion: 2.1 time: 0.783576 Jan 15 20:53:22.661113 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 792/1507] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:53:21 2022] GET /compute/v2.1/servers/e983108d-66c6-472e-bfc1-761f8a333569 => generated 1469 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:53:22.670411 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-46276162-88a7-4961-815a-740f9a526c96 req-ff49d402-3234-4fb4-81b1-5e2ca657b2c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1d27142-a9e4-440b-a719-d2059db11e79", "name": "network-vif-plugged", "status": "completed", "tag": "4c6a0728-da9a-48ee-98ad-d11ebf6c8030"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:53:22.672503 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:53:22.672503 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:53:22.691710 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-46276162-88a7-4961-815a-740f9a526c96 req-ff49d402-3234-4fb4-81b1-5e2ca657b2c0 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:22.693129 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-46276162-88a7-4961-815a-740f9a526c96 req-ff49d402-3234-4fb4-81b1-5e2ca657b2c0 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:22.708512 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-b89e05c0-34f1-459a-bb00-02c809497d33 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17e2708b6fc41b1ae6f70bcf99a0170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515bef049574d4ea4c70f90ab8c4444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:53:22.724469 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b89e05c0-34f1-459a-bb00-02c809497d33 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] 10.222.0.46 "GET /compute/v2.1/servers/3fd1fac4-6c41-4230-9eb5-4fd5a4d82c15" status: 200 len: 1274 microversion: 2.1 time: 0.232862 Jan 15 20:53:22.737168 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 716/1508] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:53:22 2022] GET /compute/v2.1/servers/3fd1fac4-6c41-4230-9eb5-4fd5a4d82c15 => generated 1274 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:53:22.749887 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-46276162-88a7-4961-815a-740f9a526c96 req-ff49d402-3234-4fb4-81b1-5e2ca657b2c0 service nova] Creating event network-vif-plugged:4c6a0728-da9a-48ee-98ad-d11ebf6c8030 for instance b1d27142-a9e4-440b-a719-d2059db11e79 on nch2-master-1 Jan 15 20:53:22.753618 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-df7334fd-6450-4945-8a29-b7c663578bef tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:22.756431 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-df7334fd-6450-4945-8a29-b7c663578bef tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] [instance: d94de6c9-be7d-4101-9f88-304b8a4ce8d7] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:22.772992 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-46276162-88a7-4961-815a-740f9a526c96 req-ff49d402-3234-4fb4-81b1-5e2ca657b2c0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110463 Jan 15 20:53:22.777050 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 793/1509] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:53:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:53:22.778862 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-df7334fd-6450-4945-8a29-b7c663578bef tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:22.781720 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-df7334fd-6450-4945-8a29-b7c663578bef tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:22.784095 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-df7334fd-6450-4945-8a29-b7c663578bef tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:22.784789 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-df7334fd-6450-4945-8a29-b7c663578bef tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:22.832811 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-313a2f31-e14e-4391-8aa4-d3853fd45df4 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '.version_select at 0x7f30c90e1af0>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:22.970130 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-313a2f31-e14e-4391-8aa4-d3853fd45df4 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "GET /compute/v2.1/images/07eb66c4-9522-4f02-aad6-44189090dfa5" status: 200 len: 1438 microversion: 2.1 time: 0.141589 Jan 15 20:53:22.971004 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 794/1510] 10.222.0.46 () {58 vars in 1232 bytes} [Sat Jan 15 20:53:22 2022] GET /compute/v2.1/images/07eb66c4-9522-4f02-aad6-44189090dfa5 => generated 1438 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:53:23.244942 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-df7334fd-6450-4945-8a29-b7c663578bef tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:53:23.258426 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-df7334fd-6450-4945-8a29-b7c663578bef tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:53:23.262460 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-df7334fd-6450-4945-8a29-b7c663578bef tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:53:23.266303 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-df7334fd-6450-4945-8a29-b7c663578bef tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] 10.222.0.46 "GET /compute/v2.1/servers/d94de6c9-be7d-4101-9f88-304b8a4ce8d7" status: 200 len: 1485 microversion: 2.25 time: 0.525773 Jan 15 20:53:23.268462 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 717/1511] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:53:22 2022] GET /compute/v2.1/servers/d94de6c9-be7d-4101-9f88-304b8a4ce8d7 => generated 1485 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:53:23.364379 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-611c9006-d702-4673-98c5-7f65f00ad0de tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:23.365524 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-611c9006-d702-4673-98c5-7f65f00ad0de tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] [instance: ababfa7a-a809-4151-882d-0c3038b84ee0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:23.385525 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-611c9006-d702-4673-98c5-7f65f00ad0de tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:23.389927 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-611c9006-d702-4673-98c5-7f65f00ad0de tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:23.392851 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-611c9006-d702-4673-98c5-7f65f00ad0de tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:23.395023 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-611c9006-d702-4673-98c5-7f65f00ad0de tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:23.496897 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-eb193a92-5256-44e3-a77b-22caf954713f tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:53:23.498841 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-eb193a92-5256-44e3-a77b-22caf954713f tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 57bd310f-a604-40de-9c25-882284f4a17b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:23.512490 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-eb193a92-5256-44e3-a77b-22caf954713f tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:23.513395 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-eb193a92-5256-44e3-a77b-22caf954713f tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:23.514946 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-eb193a92-5256-44e3-a77b-22caf954713f tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:23.517747 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-eb193a92-5256-44e3-a77b-22caf954713f tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:23.652427 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-eb193a92-5256-44e3-a77b-22caf954713f tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/action" status: 200 len: 32621 microversion: 2.1 time: 0.160315 Jan 15 20:53:23.657148 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 718/1512] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:53:23 2022] POST /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/action => generated 32621 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:53:23.679839 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b45cb75c-e04c-4f00-854a-6d19707a2dbe tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:23.691076 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b45cb75c-e04c-4f00-854a-6d19707a2dbe tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: e983108d-66c6-472e-bfc1-761f8a333569] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:23.716232 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b45cb75c-e04c-4f00-854a-6d19707a2dbe tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:23.718598 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b45cb75c-e04c-4f00-854a-6d19707a2dbe tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:23.721772 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b45cb75c-e04c-4f00-854a-6d19707a2dbe tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:23.722485 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b45cb75c-e04c-4f00-854a-6d19707a2dbe tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:24.049514 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-611c9006-d702-4673-98c5-7f65f00ad0de tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68bf33c7cdd84129a5544916a7dc3410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021c66112bf49f685a34c55841857bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:53:24.058017 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-611c9006-d702-4673-98c5-7f65f00ad0de tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] 10.222.0.46 "GET /compute/v2.1/servers/ababfa7a-a809-4151-882d-0c3038b84ee0" status: 200 len: 1318 microversion: 2.1 time: 0.698296 Jan 15 20:53:24.064666 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 795/1513] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:53:23 2022] GET /compute/v2.1/servers/ababfa7a-a809-4151-882d-0c3038b84ee0 => generated 1318 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:53:24.074550 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-17859ca8-eb21-4970-b7c7-4bfedcb48dc8 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:24.075181 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-17859ca8-eb21-4970-b7c7-4bfedcb48dc8 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] [instance: 3fd1fac4-6c41-4230-9eb5-4fd5a4d82c15] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:24.091246 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-17859ca8-eb21-4970-b7c7-4bfedcb48dc8 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:24.091769 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-17859ca8-eb21-4970-b7c7-4bfedcb48dc8 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:24.092776 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-17859ca8-eb21-4970-b7c7-4bfedcb48dc8 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:24.097424 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-17859ca8-eb21-4970-b7c7-4bfedcb48dc8 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:24.164602 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-b45cb75c-e04c-4f00-854a-6d19707a2dbe tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:53:24.178046 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b45cb75c-e04c-4f00-854a-6d19707a2dbe tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/e983108d-66c6-472e-bfc1-761f8a333569" status: 200 len: 1469 microversion: 2.1 time: 0.502704 Jan 15 20:53:24.179017 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 719/1514] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:53:23 2022] GET /compute/v2.1/servers/e983108d-66c6-472e-bfc1-761f8a333569 => generated 1469 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:53:24.192500 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-40e7c916-2874-48a9-8575-d0b33a70e0eb tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '.version_select at 0x7f30c8dfae50>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:24.273637 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-40e7c916-2874-48a9-8575-d0b33a70e0eb tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "GET /compute/v2.1/images/07eb66c4-9522-4f02-aad6-44189090dfa5" status: 200 len: 1438 microversion: 2.1 time: 0.093322 Jan 15 20:53:24.274945 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 720/1515] 10.222.0.46 () {58 vars in 1232 bytes} [Sat Jan 15 20:53:24 2022] GET /compute/v2.1/images/07eb66c4-9522-4f02-aad6-44189090dfa5 => generated 1438 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:53:24.286386 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-60e16e85-015c-4101-9866-40a94fbf9979 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:24.291390 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-60e16e85-015c-4101-9866-40a94fbf9979 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] [instance: d94de6c9-be7d-4101-9f88-304b8a4ce8d7] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:24.303057 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-60e16e85-015c-4101-9866-40a94fbf9979 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:24.306194 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-60e16e85-015c-4101-9866-40a94fbf9979 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:24.307539 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-60e16e85-015c-4101-9866-40a94fbf9979 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:24.309363 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-60e16e85-015c-4101-9866-40a94fbf9979 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:24.361891 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-17859ca8-eb21-4970-b7c7-4bfedcb48dc8 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17e2708b6fc41b1ae6f70bcf99a0170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515bef049574d4ea4c70f90ab8c4444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:53:24.371359 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-17859ca8-eb21-4970-b7c7-4bfedcb48dc8 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] 10.222.0.46 "GET /compute/v2.1/servers/3fd1fac4-6c41-4230-9eb5-4fd5a4d82c15" status: 200 len: 1316 microversion: 2.1 time: 0.305544 Jan 15 20:53:24.375794 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 796/1516] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:53:24 2022] GET /compute/v2.1/servers/3fd1fac4-6c41-4230-9eb5-4fd5a4d82c15 => generated 1316 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:53:24.567033 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-60e16e85-015c-4101-9866-40a94fbf9979 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:53:24.575948 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-60e16e85-015c-4101-9866-40a94fbf9979 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:53:24.587085 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-60e16e85-015c-4101-9866-40a94fbf9979 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:53:24.588571 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-60e16e85-015c-4101-9866-40a94fbf9979 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] 10.222.0.46 "GET /compute/v2.1/servers/d94de6c9-be7d-4101-9f88-304b8a4ce8d7" status: 200 len: 1485 microversion: 2.25 time: 0.306229 Jan 15 20:53:24.589405 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 721/1517] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:53:24 2022] GET /compute/v2.1/servers/d94de6c9-be7d-4101-9f88-304b8a4ce8d7 => generated 1485 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 15 20:53:24.666578 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4d824a7a-f661-4323-b4f0-ce69260b76af tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:53:24.667882 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-4d824a7a-f661-4323-b4f0-ce69260b76af tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 57bd310f-a604-40de-9c25-882284f4a17b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:24.689020 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4d824a7a-f661-4323-b4f0-ce69260b76af tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:24.695268 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4d824a7a-f661-4323-b4f0-ce69260b76af tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:24.701998 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4d824a7a-f661-4323-b4f0-ce69260b76af tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:24.711915 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4d824a7a-f661-4323-b4f0-ce69260b76af tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:24.819185 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-4d824a7a-f661-4323-b4f0-ce69260b76af tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/action" status: 200 len: 32621 microversion: 2.1 time: 0.156747 Jan 15 20:53:24.820585 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 797/1518] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:53:24 2022] POST /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/action => generated 32621 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:53:25.108292 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-32925157-19fe-4c16-a375-c9d1f09b9a1c tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:25.113385 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-32925157-19fe-4c16-a375-c9d1f09b9a1c tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] [instance: ababfa7a-a809-4151-882d-0c3038b84ee0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:25.128693 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-32925157-19fe-4c16-a375-c9d1f09b9a1c tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:25.129225 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-32925157-19fe-4c16-a375-c9d1f09b9a1c tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:25.145851 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-32925157-19fe-4c16-a375-c9d1f09b9a1c tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:25.146310 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-32925157-19fe-4c16-a375-c9d1f09b9a1c tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:25.174007 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-3c0af10c-004f-4137-a8b0-0e253a801b59 req-f5126988-154c-4ae3-860c-90a7e00f2e6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ababfa7a-a809-4151-882d-0c3038b84ee0", "name": "network-vif-plugged", "status": "completed", "tag": "2a9f43b8-de6a-4b89-898a-8021a4807d97"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:53:25.175579 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:53:25.175579 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:53:25.190779 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-3c0af10c-004f-4137-a8b0-0e253a801b59 req-f5126988-154c-4ae3-860c-90a7e00f2e6c service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:25.193378 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-3c0af10c-004f-4137-a8b0-0e253a801b59 req-f5126988-154c-4ae3-860c-90a7e00f2e6c service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:25.219762 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-3c0af10c-004f-4137-a8b0-0e253a801b59 req-f5126988-154c-4ae3-860c-90a7e00f2e6c service nova] Creating event network-vif-plugged:2a9f43b8-de6a-4b89-898a-8021a4807d97 for instance ababfa7a-a809-4151-882d-0c3038b84ee0 on nch2-master-1 Jan 15 20:53:25.234239 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-3c0af10c-004f-4137-a8b0-0e253a801b59 req-f5126988-154c-4ae3-860c-90a7e00f2e6c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064629 Jan 15 20:53:25.235627 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 798/1519] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:53:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:53:25.248428 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-5c8b5eac-46e1-44ab-a353-22cdd47b474e tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:25.249793 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-5c8b5eac-46e1-44ab-a353-22cdd47b474e tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: e983108d-66c6-472e-bfc1-761f8a333569] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:25.260268 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5c8b5eac-46e1-44ab-a353-22cdd47b474e tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:25.261845 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5c8b5eac-46e1-44ab-a353-22cdd47b474e tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:25.262834 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5c8b5eac-46e1-44ab-a353-22cdd47b474e tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:25.263436 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5c8b5eac-46e1-44ab-a353-22cdd47b474e tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:26.339956 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-32925157-19fe-4c16-a375-c9d1f09b9a1c tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68bf33c7cdd84129a5544916a7dc3410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021c66112bf49f685a34c55841857bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:53:26.374629 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-32925157-19fe-4c16-a375-c9d1f09b9a1c tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] 10.222.0.46 "GET /compute/v2.1/servers/ababfa7a-a809-4151-882d-0c3038b84ee0" status: 200 len: 1318 microversion: 2.1 time: 1.289004 Jan 15 20:53:26.377395 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 722/1520] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:53:25 2022] GET /compute/v2.1/servers/ababfa7a-a809-4151-882d-0c3038b84ee0 => generated 1318 bytes in 1295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:53:26.400120 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-fb081520-dc73-42b6-8330-45fcabb31e4a tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '.version_select at 0x7f30c917db80>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:26.413902 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-5c8b5eac-46e1-44ab-a353-22cdd47b474e tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:53:26.425554 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-5c8b5eac-46e1-44ab-a353-22cdd47b474e tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/e983108d-66c6-472e-bfc1-761f8a333569" status: 200 len: 1469 microversion: 2.1 time: 1.182929 Jan 15 20:53:26.429185 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 799/1521] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:53:25 2022] GET /compute/v2.1/servers/e983108d-66c6-472e-bfc1-761f8a333569 => generated 1469 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:53:26.455291 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-46c0e50c-2e1e-4eab-b447-5e22ef14af2e tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:26.459196 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-46c0e50c-2e1e-4eab-b447-5e22ef14af2e tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] [instance: 3fd1fac4-6c41-4230-9eb5-4fd5a4d82c15] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:26.475568 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-fb081520-dc73-42b6-8330-45fcabb31e4a tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "GET /compute/v2.1/images/07eb66c4-9522-4f02-aad6-44189090dfa5" status: 200 len: 1438 microversion: 2.1 time: 0.085546 Jan 15 20:53:26.481307 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 723/1522] 10.222.0.46 () {58 vars in 1232 bytes} [Sat Jan 15 20:53:26 2022] GET /compute/v2.1/images/07eb66c4-9522-4f02-aad6-44189090dfa5 => generated 1438 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:53:26.495153 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-46c0e50c-2e1e-4eab-b447-5e22ef14af2e tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:26.495612 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-46c0e50c-2e1e-4eab-b447-5e22ef14af2e tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:26.497853 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c1e30aee-3033-4c10-970b-7c4c3409bf85 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:26.498161 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-46c0e50c-2e1e-4eab-b447-5e22ef14af2e tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:26.498482 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c1e30aee-3033-4c10-970b-7c4c3409bf85 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] [instance: d94de6c9-be7d-4101-9f88-304b8a4ce8d7] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:26.506007 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-46c0e50c-2e1e-4eab-b447-5e22ef14af2e tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:26.520553 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c1e30aee-3033-4c10-970b-7c4c3409bf85 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:26.526233 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c1e30aee-3033-4c10-970b-7c4c3409bf85 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:26.527907 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c1e30aee-3033-4c10-970b-7c4c3409bf85 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:26.528508 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c1e30aee-3033-4c10-970b-7c4c3409bf85 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:26.929906 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-46c0e50c-2e1e-4eab-b447-5e22ef14af2e tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17e2708b6fc41b1ae6f70bcf99a0170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515bef049574d4ea4c70f90ab8c4444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:53:26.938207 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-46c0e50c-2e1e-4eab-b447-5e22ef14af2e tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] 10.222.0.46 "GET /compute/v2.1/servers/3fd1fac4-6c41-4230-9eb5-4fd5a4d82c15" status: 200 len: 1316 microversion: 2.1 time: 0.507941 Jan 15 20:53:26.945699 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 800/1523] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:53:26 2022] GET /compute/v2.1/servers/3fd1fac4-6c41-4230-9eb5-4fd5a4d82c15 => generated 1316 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:53:26.951628 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7c1c8f00-308b-44b3-94c6-86ba21a86e38 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:53:26.954608 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-7c1c8f00-308b-44b3-94c6-86ba21a86e38 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 57bd310f-a604-40de-9c25-882284f4a17b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:26.968568 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7c1c8f00-308b-44b3-94c6-86ba21a86e38 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:26.975319 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7c1c8f00-308b-44b3-94c6-86ba21a86e38 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:26.977880 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7c1c8f00-308b-44b3-94c6-86ba21a86e38 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:26.978722 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7c1c8f00-308b-44b3-94c6-86ba21a86e38 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:27.026449 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-c1e30aee-3033-4c10-970b-7c4c3409bf85 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:53:27.044543 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-c1e30aee-3033-4c10-970b-7c4c3409bf85 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:53:27.047461 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-c1e30aee-3033-4c10-970b-7c4c3409bf85 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:53:27.051804 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c1e30aee-3033-4c10-970b-7c4c3409bf85 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] 10.222.0.46 "GET /compute/v2.1/servers/d94de6c9-be7d-4101-9f88-304b8a4ce8d7" status: 200 len: 1485 microversion: 2.25 time: 0.569062 Jan 15 20:53:27.056082 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7c1c8f00-308b-44b3-94c6-86ba21a86e38 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/action" status: 200 len: 32621 microversion: 2.1 time: 0.108142 Jan 15 20:53:27.056659 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 724/1524] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:53:26 2022] GET /compute/v2.1/servers/d94de6c9-be7d-4101-9f88-304b8a4ce8d7 => generated 1485 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:53:27.057241 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 801/1525] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:53:26 2022] POST /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/action => generated 32621 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:53:27.070798 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-fc63e2fd-e036-46fc-8184-047d7b6de6a2 req-1c490c05-0f63-4af3-a762-1f71be030441 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3fd1fac4-6c41-4230-9eb5-4fd5a4d82c15", "tag": "f6190630-2b92-456a-a85f-b69eb4ffcb81"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:53:27.073104 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:53:27.073104 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:53:27.086821 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-fc63e2fd-e036-46fc-8184-047d7b6de6a2 req-1c490c05-0f63-4af3-a762-1f71be030441 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:27.087289 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-fc63e2fd-e036-46fc-8184-047d7b6de6a2 req-1c490c05-0f63-4af3-a762-1f71be030441 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:27.113698 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-fc63e2fd-e036-46fc-8184-047d7b6de6a2 req-1c490c05-0f63-4af3-a762-1f71be030441 service nova] Creating event network-changed:f6190630-2b92-456a-a85f-b69eb4ffcb81 for instance 3fd1fac4-6c41-4230-9eb5-4fd5a4d82c15 on nch1-master-1 Jan 15 20:53:27.124831 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-fc63e2fd-e036-46fc-8184-047d7b6de6a2 req-1c490c05-0f63-4af3-a762-1f71be030441 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062699 Jan 15 20:53:27.126016 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 725/1526] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:53:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:53:27.331821 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-32e1920d-83f1-411e-b710-17ea9bf29e1e req-d9114d69-5599-4c16-8d61-5bddd72d935b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e983108d-66c6-472e-bfc1-761f8a333569", "name": "network-vif-unplugged", "status": "completed", "tag": "5d3688c4-ca00-4b8e-9475-e69603c54112"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:53:27.333406 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:53:27.333406 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:53:27.349511 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-32e1920d-83f1-411e-b710-17ea9bf29e1e req-d9114d69-5599-4c16-8d61-5bddd72d935b service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:27.349511 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-32e1920d-83f1-411e-b710-17ea9bf29e1e req-d9114d69-5599-4c16-8d61-5bddd72d935b service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:27.378583 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-32e1920d-83f1-411e-b710-17ea9bf29e1e req-d9114d69-5599-4c16-8d61-5bddd72d935b service nova] Creating event network-vif-unplugged:5d3688c4-ca00-4b8e-9475-e69603c54112 for instance e983108d-66c6-472e-bfc1-761f8a333569 on nch1-master-1 Jan 15 20:53:27.395568 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [req-32e1920d-83f1-411e-b710-17ea9bf29e1e req-d9114d69-5599-4c16-8d61-5bddd72d935b service nova] Instance e983108d-66c6-472e-bfc1-761f8a333569 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=129366) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Jan 15 20:53:27.399259 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9b0f81c4-a76d-4b94-91f8-6e8298ab8336 tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:27.399967 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-9b0f81c4-a76d-4b94-91f8-6e8298ab8336 tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] [instance: ababfa7a-a809-4151-882d-0c3038b84ee0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:27.438492 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-32e1920d-83f1-411e-b710-17ea9bf29e1e req-d9114d69-5599-4c16-8d61-5bddd72d935b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.110880 Jan 15 20:53:27.440482 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 802/1527] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:53:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:53:27.462704 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-3017d8a0-a93f-4fc7-b88b-824c2030fea7 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:27.464531 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-3017d8a0-a93f-4fc7-b88b-824c2030fea7 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: e983108d-66c6-472e-bfc1-761f8a333569] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:27.464801 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9b0f81c4-a76d-4b94-91f8-6e8298ab8336 tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:27.466262 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9b0f81c4-a76d-4b94-91f8-6e8298ab8336 tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:27.473860 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9b0f81c4-a76d-4b94-91f8-6e8298ab8336 tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:27.478789 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9b0f81c4-a76d-4b94-91f8-6e8298ab8336 tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:27.490838 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3017d8a0-a93f-4fc7-b88b-824c2030fea7 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:27.491524 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3017d8a0-a93f-4fc7-b88b-824c2030fea7 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:27.492982 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3017d8a0-a93f-4fc7-b88b-824c2030fea7 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:27.493596 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3017d8a0-a93f-4fc7-b88b-824c2030fea7 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:28.296386 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-3017d8a0-a93f-4fc7-b88b-824c2030fea7 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:53:28.314930 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-9b0f81c4-a76d-4b94-91f8-6e8298ab8336 tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68bf33c7cdd84129a5544916a7dc3410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021c66112bf49f685a34c55841857bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:53:28.324447 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-9b0f81c4-a76d-4b94-91f8-6e8298ab8336 tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] 10.222.0.46 "GET /compute/v2.1/servers/ababfa7a-a809-4151-882d-0c3038b84ee0" status: 200 len: 1318 microversion: 2.1 time: 0.935567 Jan 15 20:53:28.349021 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 726/1528] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:53:27 2022] GET /compute/v2.1/servers/ababfa7a-a809-4151-882d-0c3038b84ee0 => generated 1318 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:53:28.364200 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-3017d8a0-a93f-4fc7-b88b-824c2030fea7 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/e983108d-66c6-472e-bfc1-761f8a333569" status: 200 len: 1469 microversion: 2.1 time: 0.921888 Jan 15 20:53:28.368281 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 803/1529] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:53:27 2022] GET /compute/v2.1/servers/e983108d-66c6-472e-bfc1-761f8a333569 => generated 1469 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:53:28.375305 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-535fd1c9-1059-4e6b-ac23-f6f02b3a6d40 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '.version_select at 0x7f30c97ac280>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:28.378899 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-fc6fda3d-0628-478b-8fa4-dedda5a93ee4 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:28.379880 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-fc6fda3d-0628-478b-8fa4-dedda5a93ee4 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] [instance: 3fd1fac4-6c41-4230-9eb5-4fd5a4d82c15] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:28.399085 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fc6fda3d-0628-478b-8fa4-dedda5a93ee4 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:28.402105 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fc6fda3d-0628-478b-8fa4-dedda5a93ee4 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:28.403305 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fc6fda3d-0628-478b-8fa4-dedda5a93ee4 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:28.404705 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fc6fda3d-0628-478b-8fa4-dedda5a93ee4 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:28.730056 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-fc6fda3d-0628-478b-8fa4-dedda5a93ee4 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17e2708b6fc41b1ae6f70bcf99a0170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515bef049574d4ea4c70f90ab8c4444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:53:28.744782 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-fc6fda3d-0628-478b-8fa4-dedda5a93ee4 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] 10.222.0.46 "GET /compute/v2.1/servers/3fd1fac4-6c41-4230-9eb5-4fd5a4d82c15" status: 200 len: 1316 microversion: 2.1 time: 0.369299 Jan 15 20:53:28.746089 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 804/1530] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:53:28 2022] GET /compute/v2.1/servers/3fd1fac4-6c41-4230-9eb5-4fd5a4d82c15 => generated 1316 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:53:28.755168 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-13fad5b2-f54c-40d5-92a1-d1788442c9fa tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:53:28.757270 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-13fad5b2-f54c-40d5-92a1-d1788442c9fa tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 57bd310f-a604-40de-9c25-882284f4a17b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:28.775456 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-13fad5b2-f54c-40d5-92a1-d1788442c9fa tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:28.783142 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-13fad5b2-f54c-40d5-92a1-d1788442c9fa tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:28.784376 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-13fad5b2-f54c-40d5-92a1-d1788442c9fa tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:28.785077 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-13fad5b2-f54c-40d5-92a1-d1788442c9fa tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:28.894109 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-13fad5b2-f54c-40d5-92a1-d1788442c9fa tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "POST /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/action" status: 200 len: 40756 microversion: 2.1 time: 0.146397 Jan 15 20:53:28.901665 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 805/1531] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:53:28 2022] POST /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b/action => generated 40756 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:53:28.908465 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-35d0590e-b3ee-4f40-8e3b-3d076a5cfe00 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:28.909857 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-35d0590e-b3ee-4f40-8e3b-3d076a5cfe00 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] [instance: d94de6c9-be7d-4101-9f88-304b8a4ce8d7] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:28.917677 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-35d0590e-b3ee-4f40-8e3b-3d076a5cfe00 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:28.921575 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-35d0590e-b3ee-4f40-8e3b-3d076a5cfe00 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:28.923213 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-35d0590e-b3ee-4f40-8e3b-3d076a5cfe00 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:28.923883 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-35d0590e-b3ee-4f40-8e3b-3d076a5cfe00 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:29.580316 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-35d0590e-b3ee-4f40-8e3b-3d076a5cfe00 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:53:29.605670 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-35d0590e-b3ee-4f40-8e3b-3d076a5cfe00 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:53:29.626944 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-35d0590e-b3ee-4f40-8e3b-3d076a5cfe00 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:53:29.627787 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-35d0590e-b3ee-4f40-8e3b-3d076a5cfe00 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] 10.222.0.46 "GET /compute/v2.1/servers/d94de6c9-be7d-4101-9f88-304b8a4ce8d7" status: 200 len: 1485 microversion: 2.25 time: 0.724504 Jan 15 20:53:29.636185 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 806/1532] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:53:28 2022] GET /compute/v2.1/servers/d94de6c9-be7d-4101-9f88-304b8a4ce8d7 => generated 1485 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:53:29.650974 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-3946279b-7968-43c4-b59e-d3f482974186 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:29.653468 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-3946279b-7968-43c4-b59e-d3f482974186 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 57bd310f-a604-40de-9c25-882284f4a17b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:29.676681 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3946279b-7968-43c4-b59e-d3f482974186 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:29.677990 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3946279b-7968-43c4-b59e-d3f482974186 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:29.680097 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3946279b-7968-43c4-b59e-d3f482974186 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:29.682269 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3946279b-7968-43c4-b59e-d3f482974186 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:30.182576 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-3946279b-7968-43c4-b59e-d3f482974186 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d60caf368842b2aec08f0f5e14353a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c95e4b5695439dbc3f66a911264026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:53:30.203539 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-3946279b-7968-43c4-b59e-d3f482974186 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "GET /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b" status: 200 len: 1708 microversion: 2.1 time: 0.564735 Jan 15 20:53:30.222133 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 807/1533] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:53:29 2022] GET /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b => generated 1708 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:53:30.256237 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-91f7d32e-91e1-4567-9bbe-8c4ccda4ca73 tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:30.262819 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-91f7d32e-91e1-4567-9bbe-8c4ccda4ca73 tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] [instance: ababfa7a-a809-4151-882d-0c3038b84ee0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:30.299010 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-91f7d32e-91e1-4567-9bbe-8c4ccda4ca73 tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:30.299469 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-91f7d32e-91e1-4567-9bbe-8c4ccda4ca73 tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:30.300547 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-91f7d32e-91e1-4567-9bbe-8c4ccda4ca73 tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:30.301036 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-91f7d32e-91e1-4567-9bbe-8c4ccda4ca73 tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:30.982060 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-91f7d32e-91e1-4567-9bbe-8c4ccda4ca73 tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68bf33c7cdd84129a5544916a7dc3410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021c66112bf49f685a34c55841857bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:53:30.990921 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-91f7d32e-91e1-4567-9bbe-8c4ccda4ca73 tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] 10.222.0.46 "GET /compute/v2.1/servers/ababfa7a-a809-4151-882d-0c3038b84ee0" status: 200 len: 1508 microversion: 2.1 time: 0.767612 Jan 15 20:53:30.993066 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 808/1534] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:53:30 2022] GET /compute/v2.1/servers/ababfa7a-a809-4151-882d-0c3038b84ee0 => generated 1508 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:53:30.997590 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-106836f5-16b5-427d-a182-92e80a0d6bfe tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:30.998529 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-106836f5-16b5-427d-a182-92e80a0d6bfe tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: e983108d-66c6-472e-bfc1-761f8a333569] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:31.006241 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-106836f5-16b5-427d-a182-92e80a0d6bfe tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:31.006901 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-106836f5-16b5-427d-a182-92e80a0d6bfe tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:31.008219 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-106836f5-16b5-427d-a182-92e80a0d6bfe tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:31.008825 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-106836f5-16b5-427d-a182-92e80a0d6bfe tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:31.238889 ncdv-master-1 devstack@n-api.service[129365]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 15 20:53:31.239721 ncdv-master-1 devstack@n-api.service[129365]: Sat Jan 15 20:53:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/images/07eb66c4-9522-4f02-aad6-44189090dfa5 (ip 10.222.0.46) !!! Jan 15 20:53:31.260731 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-106836f5-16b5-427d-a182-92e80a0d6bfe tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:53:31.275616 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-106836f5-16b5-427d-a182-92e80a0d6bfe tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/e983108d-66c6-472e-bfc1-761f8a333569" status: 200 len: 1469 microversion: 2.1 time: 0.280508 Jan 15 20:53:31.275994 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 809/1535] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:53:30 2022] GET /compute/v2.1/servers/e983108d-66c6-472e-bfc1-761f8a333569 => generated 1469 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:53:31.293074 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-658c0382-2f4d-4064-ac7f-4ed787e4adaa req-345c0f0c-227d-4ba4-928c-1ae3401c0f91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e983108d-66c6-472e-bfc1-761f8a333569", "tag": "5d3688c4-ca00-4b8e-9475-e69603c54112"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:53:31.294769 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:53:31.294769 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:53:31.304129 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-658c0382-2f4d-4064-ac7f-4ed787e4adaa req-345c0f0c-227d-4ba4-928c-1ae3401c0f91 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:31.304873 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-658c0382-2f4d-4064-ac7f-4ed787e4adaa req-345c0f0c-227d-4ba4-928c-1ae3401c0f91 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:31.324687 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-658c0382-2f4d-4064-ac7f-4ed787e4adaa req-345c0f0c-227d-4ba4-928c-1ae3401c0f91 service nova] Creating event network-changed:5d3688c4-ca00-4b8e-9475-e69603c54112 for instance e983108d-66c6-472e-bfc1-761f8a333569 on nch1-master-1 Jan 15 20:53:31.335437 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [req-658c0382-2f4d-4064-ac7f-4ed787e4adaa req-345c0f0c-227d-4ba4-928c-1ae3401c0f91 service nova] Instance e983108d-66c6-472e-bfc1-761f8a333569 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=129366) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Jan 15 20:53:31.412981 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-658c0382-2f4d-4064-ac7f-4ed787e4adaa req-345c0f0c-227d-4ba4-928c-1ae3401c0f91 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124526 Jan 15 20:53:31.413774 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 810/1536] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:53:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:53:31.487945 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-03093776-99b0-4dba-9000-10bdf62ab96d req-59c0d59f-eb82-4dfe-83cc-297d8914ee46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d94de6c9-be7d-4101-9f88-304b8a4ce8d7", "name": "network-vif-unplugged", "status": "completed", "tag": "9ae7fa8e-01aa-4321-8949-4398f2fc1b57"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:53:31.489962 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:53:31.489962 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:53:31.508106 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-03093776-99b0-4dba-9000-10bdf62ab96d req-59c0d59f-eb82-4dfe-83cc-297d8914ee46 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:31.511402 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-03093776-99b0-4dba-9000-10bdf62ab96d req-59c0d59f-eb82-4dfe-83cc-297d8914ee46 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:31.538612 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-03093776-99b0-4dba-9000-10bdf62ab96d req-59c0d59f-eb82-4dfe-83cc-297d8914ee46 service nova] Creating event network-vif-unplugged:9ae7fa8e-01aa-4321-8949-4398f2fc1b57 for instance d94de6c9-be7d-4101-9f88-304b8a4ce8d7 on nch1-master-1 Jan 15 20:53:31.554550 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-03093776-99b0-4dba-9000-10bdf62ab96d req-59c0d59f-eb82-4dfe-83cc-297d8914ee46 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.108728 Jan 15 20:53:31.556322 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 811/1537] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:53:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:53:31.566657 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-5479d701-152a-4268-ac1e-a831b2b28c33 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:31.574415 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-5479d701-152a-4268-ac1e-a831b2b28c33 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] [instance: 3fd1fac4-6c41-4230-9eb5-4fd5a4d82c15] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:31.590064 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5479d701-152a-4268-ac1e-a831b2b28c33 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:31.595400 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5479d701-152a-4268-ac1e-a831b2b28c33 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:31.596490 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5479d701-152a-4268-ac1e-a831b2b28c33 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:31.597162 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5479d701-152a-4268-ac1e-a831b2b28c33 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:32.371598 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-5479d701-152a-4268-ac1e-a831b2b28c33 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17e2708b6fc41b1ae6f70bcf99a0170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515bef049574d4ea4c70f90ab8c4444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:53:32.396706 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-5479d701-152a-4268-ac1e-a831b2b28c33 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] 10.222.0.46 "GET /compute/v2.1/servers/3fd1fac4-6c41-4230-9eb5-4fd5a4d82c15" status: 200 len: 1316 microversion: 2.1 time: 0.822991 Jan 15 20:53:32.409750 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 812/1538] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:53:31 2022] GET /compute/v2.1/servers/3fd1fac4-6c41-4230-9eb5-4fd5a4d82c15 => generated 1316 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:53:32.440822 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8cb8b8ca-7810-4bbe-b9ae-a45a665d6ca1 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:32.449276 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-8cb8b8ca-7810-4bbe-b9ae-a45a665d6ca1 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] [instance: d94de6c9-be7d-4101-9f88-304b8a4ce8d7] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:32.475567 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-535fd1c9-1059-4e6b-ac23-f6f02b3a6d40 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "GET /compute/v2.1/images/07eb66c4-9522-4f02-aad6-44189090dfa5" status: 200 len: 1438 microversion: 2.1 time: 4.110003 Jan 15 20:53:32.482613 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 727/1539] 10.222.0.46 () {58 vars in 1232 bytes} [Sat Jan 15 20:53:28 2022] GET /compute/v2.1/images/07eb66c4-9522-4f02-aad6-44189090dfa5 => generated 1438 bytes in 4127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:53:32.489849 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-de551365-55ac-4ab9-b017-c1a2ad2e4382 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:32.491818 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8cb8b8ca-7810-4bbe-b9ae-a45a665d6ca1 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:32.493667 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-de551365-55ac-4ab9-b017-c1a2ad2e4382 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 57bd310f-a604-40de-9c25-882284f4a17b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:32.501283 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8cb8b8ca-7810-4bbe-b9ae-a45a665d6ca1 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:32.513884 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8cb8b8ca-7810-4bbe-b9ae-a45a665d6ca1 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:32.524393 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8cb8b8ca-7810-4bbe-b9ae-a45a665d6ca1 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:32.564152 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-de551365-55ac-4ab9-b017-c1a2ad2e4382 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:32.566428 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-de551365-55ac-4ab9-b017-c1a2ad2e4382 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:32.567822 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-de551365-55ac-4ab9-b017-c1a2ad2e4382 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:32.571606 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-de551365-55ac-4ab9-b017-c1a2ad2e4382 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:32.691832 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-de551365-55ac-4ab9-b017-c1a2ad2e4382 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 57bd310f-a604-40de-9c25-882284f4a17b] Going to try to terminate instance {{(pid=129365) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 20:53:33.053861 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-de551365-55ac-4ab9-b017-c1a2ad2e4382 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "DELETE /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b" status: 204 len: 0 microversion: 2.1 time: 0.569238 Jan 15 20:53:33.064373 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 728/1540] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 20:53:32 2022] DELETE /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b => generated 0 bytes in 577 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 20:53:33.081306 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-98701087-263a-4238-9409-78c753302379 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:33.082018 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-98701087-263a-4238-9409-78c753302379 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: e983108d-66c6-472e-bfc1-761f8a333569] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:33.106441 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-98701087-263a-4238-9409-78c753302379 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:33.112981 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-98701087-263a-4238-9409-78c753302379 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:33.114181 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-98701087-263a-4238-9409-78c753302379 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:33.117396 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-98701087-263a-4238-9409-78c753302379 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:33.277680 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-8cb8b8ca-7810-4bbe-b9ae-a45a665d6ca1 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:53:33.290846 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-8cb8b8ca-7810-4bbe-b9ae-a45a665d6ca1 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:53:33.299008 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-8cb8b8ca-7810-4bbe-b9ae-a45a665d6ca1 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:53:33.303066 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-8cb8b8ca-7810-4bbe-b9ae-a45a665d6ca1 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] 10.222.0.46 "GET /compute/v2.1/servers/d94de6c9-be7d-4101-9f88-304b8a4ce8d7" status: 200 len: 1485 microversion: 2.25 time: 0.891821 Jan 15 20:53:33.315242 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 813/1541] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:53:32 2022] GET /compute/v2.1/servers/d94de6c9-be7d-4101-9f88-304b8a4ce8d7 => generated 1485 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:53:33.332252 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-621de5e4-c12d-48ea-8512-a08c6b37febe tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:33.333368 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-621de5e4-c12d-48ea-8512-a08c6b37febe tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 57bd310f-a604-40de-9c25-882284f4a17b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:33.352927 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-621de5e4-c12d-48ea-8512-a08c6b37febe tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:33.354237 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-621de5e4-c12d-48ea-8512-a08c6b37febe tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:33.357594 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-621de5e4-c12d-48ea-8512-a08c6b37febe tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:33.359454 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-621de5e4-c12d-48ea-8512-a08c6b37febe tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:34.000899 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-621de5e4-c12d-48ea-8512-a08c6b37febe tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d60caf368842b2aec08f0f5e14353a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c95e4b5695439dbc3f66a911264026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:53:34.011582 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-621de5e4-c12d-48ea-8512-a08c6b37febe tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "GET /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b" status: 200 len: 1714 microversion: 2.1 time: 0.689510 Jan 15 20:53:34.020639 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 814/1542] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:53:33 2022] GET /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b => generated 1714 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:53:34.035762 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-697321e7-0359-4dc7-95b4-57e2dc2c8b05 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:34.040683 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-697321e7-0359-4dc7-95b4-57e2dc2c8b05 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] [instance: 3fd1fac4-6c41-4230-9eb5-4fd5a4d82c15] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:34.081046 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-697321e7-0359-4dc7-95b4-57e2dc2c8b05 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:34.082619 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-697321e7-0359-4dc7-95b4-57e2dc2c8b05 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:34.085458 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-697321e7-0359-4dc7-95b4-57e2dc2c8b05 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:34.086710 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-697321e7-0359-4dc7-95b4-57e2dc2c8b05 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:34.394335 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-697321e7-0359-4dc7-95b4-57e2dc2c8b05 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17e2708b6fc41b1ae6f70bcf99a0170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515bef049574d4ea4c70f90ab8c4444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:53:34.404150 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-697321e7-0359-4dc7-95b4-57e2dc2c8b05 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] 10.222.0.46 "GET /compute/v2.1/servers/3fd1fac4-6c41-4230-9eb5-4fd5a4d82c15" status: 200 len: 1316 microversion: 2.1 time: 0.381670 Jan 15 20:53:34.408132 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 815/1543] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:53:34 2022] GET /compute/v2.1/servers/3fd1fac4-6c41-4230-9eb5-4fd5a4d82c15 => generated 1316 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:53:34.424649 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-54e23e0f-1d09-4feb-8cb7-d1cb9fbedb52 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '.version_select at 0x7f30c932eee0>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:34.548726 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-54e23e0f-1d09-4feb-8cb7-d1cb9fbedb52 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "GET /compute/v2.1/images/07eb66c4-9522-4f02-aad6-44189090dfa5" status: 200 len: 1438 microversion: 2.1 time: 0.135805 Jan 15 20:53:34.549592 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 816/1544] 10.222.0.46 () {58 vars in 1232 bytes} [Sat Jan 15 20:53:34 2022] GET /compute/v2.1/images/07eb66c4-9522-4f02-aad6-44189090dfa5 => generated 1438 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:53:34.563881 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-dd536ad0-bd5d-4103-93d2-aa3ceda9964e tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2bdef2ab-ec70-41f0-8baa-f2d47689a8ab"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:53:34.565095 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-dd536ad0-bd5d-4103-93d2-aa3ceda9964e tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] [instance: ababfa7a-a809-4151-882d-0c3038b84ee0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:34.580751 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dd536ad0-bd5d-4103-93d2-aa3ceda9964e tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:34.581235 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dd536ad0-bd5d-4103-93d2-aa3ceda9964e tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:34.582046 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dd536ad0-bd5d-4103-93d2-aa3ceda9964e tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:34.582486 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dd536ad0-bd5d-4103-93d2-aa3ceda9964e tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:34.638374 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-98701087-263a-4238-9409-78c753302379 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:53:34.646442 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-98701087-263a-4238-9409-78c753302379 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/e983108d-66c6-472e-bfc1-761f8a333569" status: 200 len: 1462 microversion: 2.1 time: 1.580738 Jan 15 20:53:34.665231 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 729/1545] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:53:33 2022] GET /compute/v2.1/servers/e983108d-66c6-472e-bfc1-761f8a333569 => generated 1462 bytes in 1600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:53:34.685410 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-08199e33-75c8-4830-9bfb-417b8d23b6fa req-6ba4a794-a339-4cf3-ab7e-98933b6d0e59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d94de6c9-be7d-4101-9f88-304b8a4ce8d7", "tag": "9ae7fa8e-01aa-4321-8949-4398f2fc1b57"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:53:34.688695 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:53:34.688695 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:53:34.696744 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-08199e33-75c8-4830-9bfb-417b8d23b6fa req-6ba4a794-a339-4cf3-ab7e-98933b6d0e59 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:34.697518 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-08199e33-75c8-4830-9bfb-417b8d23b6fa req-6ba4a794-a339-4cf3-ab7e-98933b6d0e59 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:34.723331 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-08199e33-75c8-4830-9bfb-417b8d23b6fa req-6ba4a794-a339-4cf3-ab7e-98933b6d0e59 service nova] Creating event network-changed:9ae7fa8e-01aa-4321-8949-4398f2fc1b57 for instance d94de6c9-be7d-4101-9f88-304b8a4ce8d7 on nch1-master-1 Jan 15 20:53:34.728752 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-08199e33-75c8-4830-9bfb-417b8d23b6fa req-6ba4a794-a339-4cf3-ab7e-98933b6d0e59 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062013 Jan 15 20:53:34.733976 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 730/1546] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:53:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:53:34.742257 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-dc15f2bf-7a7f-4e0e-ad4d-92d6f763f5fc tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:34.743308 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-dc15f2bf-7a7f-4e0e-ad4d-92d6f763f5fc tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] [instance: d94de6c9-be7d-4101-9f88-304b8a4ce8d7] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:34.759865 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dc15f2bf-7a7f-4e0e-ad4d-92d6f763f5fc tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:34.761207 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dc15f2bf-7a7f-4e0e-ad4d-92d6f763f5fc tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:34.762443 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dc15f2bf-7a7f-4e0e-ad4d-92d6f763f5fc tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:34.763257 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dc15f2bf-7a7f-4e0e-ad4d-92d6f763f5fc tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:35.376363 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-dd536ad0-bd5d-4103-93d2-aa3ceda9964e tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] 10.222.0.46 "POST /compute/v2.1/servers/ababfa7a-a809-4151-882d-0c3038b84ee0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.819652 Jan 15 20:53:35.380894 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 817/1547] 10.222.0.46 () {60 vars in 1322 bytes} [Sat Jan 15 20:53:34 2022] POST /compute/v2.1/servers/ababfa7a-a809-4151-882d-0c3038b84ee0/os-volume_attachments => generated 194 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:53:35.397104 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1ef73717-a786-465c-b9d3-fceff869649e tempest-MigrationsAdminTest-1503274595 tempest-MigrationsAdminTest-1503274595-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:35.399336 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-1ef73717-a786-465c-b9d3-fceff869649e tempest-MigrationsAdminTest-1503274595 tempest-MigrationsAdminTest-1503274595-project-admin] [instance: e983108d-66c6-472e-bfc1-761f8a333569] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:35.419857 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1ef73717-a786-465c-b9d3-fceff869649e tempest-MigrationsAdminTest-1503274595 tempest-MigrationsAdminTest-1503274595-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:35.423290 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1ef73717-a786-465c-b9d3-fceff869649e tempest-MigrationsAdminTest-1503274595 tempest-MigrationsAdminTest-1503274595-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:35.426409 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1ef73717-a786-465c-b9d3-fceff869649e tempest-MigrationsAdminTest-1503274595 tempest-MigrationsAdminTest-1503274595-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:35.428193 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1ef73717-a786-465c-b9d3-fceff869649e tempest-MigrationsAdminTest-1503274595 tempest-MigrationsAdminTest-1503274595-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:36.027816 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-dc15f2bf-7a7f-4e0e-ad4d-92d6f763f5fc tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:53:36.074019 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-dc15f2bf-7a7f-4e0e-ad4d-92d6f763f5fc tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:53:36.091465 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-dc15f2bf-7a7f-4e0e-ad4d-92d6f763f5fc tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:53:36.103035 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-dc15f2bf-7a7f-4e0e-ad4d-92d6f763f5fc tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] 10.222.0.46 "GET /compute/v2.1/servers/d94de6c9-be7d-4101-9f88-304b8a4ce8d7" status: 200 len: 1485 microversion: 2.25 time: 1.362368 Jan 15 20:53:36.104601 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 731/1548] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:53:34 2022] GET /compute/v2.1/servers/d94de6c9-be7d-4101-9f88-304b8a4ce8d7 => generated 1485 bytes in 1370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:53:36.126396 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-026bde44-fdff-4de3-9628-3dcf95c90bef tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:36.127570 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-026bde44-fdff-4de3-9628-3dcf95c90bef tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 57bd310f-a604-40de-9c25-882284f4a17b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:36.145671 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-026bde44-fdff-4de3-9628-3dcf95c90bef tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:36.154539 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-026bde44-fdff-4de3-9628-3dcf95c90bef tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:36.155592 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-026bde44-fdff-4de3-9628-3dcf95c90bef tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:36.163514 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-026bde44-fdff-4de3-9628-3dcf95c90bef tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:37.569592 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-1ef73717-a786-465c-b9d3-fceff869649e tempest-MigrationsAdminTest-1503274595 tempest-MigrationsAdminTest-1503274595-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/e983108d-66c6-472e-bfc1-761f8a333569" status: 200 len: 1613 microversion: 2.1 time: 2.181775 Jan 15 20:53:37.583929 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 818/1549] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:53:35 2022] GET /compute/v2.1/servers/e983108d-66c6-472e-bfc1-761f8a333569 => generated 1613 bytes in 2197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:53:37.613932 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1146d642-bedc-4968-ae87-0e62a9d015a2 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:37.615158 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-1146d642-bedc-4968-ae87-0e62a9d015a2 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] [instance: 3fd1fac4-6c41-4230-9eb5-4fd5a4d82c15] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:37.639560 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1146d642-bedc-4968-ae87-0e62a9d015a2 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:37.644739 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1146d642-bedc-4968-ae87-0e62a9d015a2 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:37.646994 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1146d642-bedc-4968-ae87-0e62a9d015a2 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:37.650756 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1146d642-bedc-4968-ae87-0e62a9d015a2 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:37.692747 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-026bde44-fdff-4de3-9628-3dcf95c90bef tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d60caf368842b2aec08f0f5e14353a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c95e4b5695439dbc3f66a911264026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:53:37.707444 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-026bde44-fdff-4de3-9628-3dcf95c90bef tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "GET /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b" status: 200 len: 1714 microversion: 2.1 time: 1.595244 Jan 15 20:53:37.718911 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 732/1550] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:53:36 2022] GET /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b => generated 1714 bytes in 1609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:53:37.730720 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b284b44a-b0e5-4bda-9aa3-fa09ccea07e6 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '.version_select at 0x7f30c917d940>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:37.873869 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b284b44a-b0e5-4bda-9aa3-fa09ccea07e6 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "GET /compute/v2.1/images/07eb66c4-9522-4f02-aad6-44189090dfa5" status: 200 len: 1438 microversion: 2.1 time: 0.153347 Jan 15 20:53:37.877754 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 733/1551] 10.222.0.46 () {58 vars in 1232 bytes} [Sat Jan 15 20:53:37 2022] GET /compute/v2.1/images/07eb66c4-9522-4f02-aad6-44189090dfa5 => generated 1438 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:53:37.894633 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ffa481a1-252f-40fe-878f-eb97f9b73d7f tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:37.913050 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ffa481a1-252f-40fe-878f-eb97f9b73d7f tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] [instance: d94de6c9-be7d-4101-9f88-304b8a4ce8d7] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:37.946488 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ffa481a1-252f-40fe-878f-eb97f9b73d7f tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:37.953525 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ffa481a1-252f-40fe-878f-eb97f9b73d7f tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:37.954994 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ffa481a1-252f-40fe-878f-eb97f9b73d7f tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:37.962419 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ffa481a1-252f-40fe-878f-eb97f9b73d7f tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:40.649765 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-1146d642-bedc-4968-ae87-0e62a9d015a2 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17e2708b6fc41b1ae6f70bcf99a0170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515bef049574d4ea4c70f90ab8c4444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:53:40.671073 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-1146d642-bedc-4968-ae87-0e62a9d015a2 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] 10.222.0.46 "GET /compute/v2.1/servers/3fd1fac4-6c41-4230-9eb5-4fd5a4d82c15" status: 200 len: 1316 microversion: 2.1 time: 3.084751 Jan 15 20:53:40.687475 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 819/1552] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:53:37 2022] GET /compute/v2.1/servers/3fd1fac4-6c41-4230-9eb5-4fd5a4d82c15 => generated 1316 bytes in 3102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:53:40.719504 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-65374d2b-6283-4b87-a729-158924f6014f tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:40.720013 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-65374d2b-6283-4b87-a729-158924f6014f tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: e983108d-66c6-472e-bfc1-761f8a333569] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:40.786541 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-65374d2b-6283-4b87-a729-158924f6014f tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:40.787302 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-65374d2b-6283-4b87-a729-158924f6014f tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:40.788218 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-65374d2b-6283-4b87-a729-158924f6014f tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:40.803825 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-65374d2b-6283-4b87-a729-158924f6014f tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:40.958569 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-65374d2b-6283-4b87-a729-158924f6014f tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: e983108d-66c6-472e-bfc1-761f8a333569] Going to try to terminate instance {{(pid=129366) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 20:53:41.236486 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-ffa481a1-252f-40fe-878f-eb97f9b73d7f tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:53:41.261119 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-ffa481a1-252f-40fe-878f-eb97f9b73d7f tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:53:41.263429 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-ffa481a1-252f-40fe-878f-eb97f9b73d7f tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:53:41.270342 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ffa481a1-252f-40fe-878f-eb97f9b73d7f tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] 10.222.0.46 "GET /compute/v2.1/servers/d94de6c9-be7d-4101-9f88-304b8a4ce8d7" status: 200 len: 1485 microversion: 2.25 time: 3.388801 Jan 15 20:53:41.273850 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 734/1553] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:53:37 2022] GET /compute/v2.1/servers/d94de6c9-be7d-4101-9f88-304b8a4ce8d7 => generated 1485 bytes in 3394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:53:41.296663 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ce77adea-4f48-4eea-8e2d-1e30d0711974 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:41.298001 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-65374d2b-6283-4b87-a729-158924f6014f tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "DELETE /compute/v2.1/servers/e983108d-66c6-472e-bfc1-761f8a333569" status: 204 len: 0 microversion: 2.1 time: 0.577558 Jan 15 20:53:41.298135 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ce77adea-4f48-4eea-8e2d-1e30d0711974 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 57bd310f-a604-40de-9c25-882284f4a17b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:41.301725 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 820/1554] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 20:53:40 2022] DELETE /compute/v2.1/servers/e983108d-66c6-472e-bfc1-761f8a333569 => generated 0 bytes in 607 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 20:53:41.328253 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-90c4acb5-5007-4197-905a-ba57d55436c9 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '.version_select at 0x7f30c8f04430>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:41.332040 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ce77adea-4f48-4eea-8e2d-1e30d0711974 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:41.334496 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ce77adea-4f48-4eea-8e2d-1e30d0711974 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:41.337953 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ce77adea-4f48-4eea-8e2d-1e30d0711974 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:41.339582 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ce77adea-4f48-4eea-8e2d-1e30d0711974 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:41.469800 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ce77adea-4f48-4eea-8e2d-1e30d0711974 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:41.472181 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ce77adea-4f48-4eea-8e2d-1e30d0711974 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:41.473909 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.objects.instance [None req-ce77adea-4f48-4eea-8e2d-1e30d0711974 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lazy-loading 'fault' on Instance uuid 57bd310f-a604-40de-9c25-882284f4a17b {{(pid=129365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 20:53:41.570181 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-90c4acb5-5007-4197-905a-ba57d55436c9 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "GET /compute/v2.1/images/07eb66c4-9522-4f02-aad6-44189090dfa5" status: 200 len: 1438 microversion: 2.1 time: 0.259700 Jan 15 20:53:41.570860 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 821/1555] 10.222.0.46 () {58 vars in 1232 bytes} [Sat Jan 15 20:53:41 2022] GET /compute/v2.1/images/07eb66c4-9522-4f02-aad6-44189090dfa5 => generated 1438 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:53:41.587488 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-af478b3f-af31-4d68-8d6d-7fc14fc888ef req-6a413508-0c98-4c1a-9342-31ae2ae4aad5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57bd310f-a604-40de-9c25-882284f4a17b", "name": "network-vif-deleted", "tag": "b8144bdd-0e36-42d0-ae5a-b27a87dabd70"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:53:41.589440 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:53:41.589440 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:53:41.645221 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-af478b3f-af31-4d68-8d6d-7fc14fc888ef req-6a413508-0c98-4c1a-9342-31ae2ae4aad5 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:41.645810 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-af478b3f-af31-4d68-8d6d-7fc14fc888ef req-6a413508-0c98-4c1a-9342-31ae2ae4aad5 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:41.676161 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-af478b3f-af31-4d68-8d6d-7fc14fc888ef req-6a413508-0c98-4c1a-9342-31ae2ae4aad5 service nova] Creating event network-vif-deleted:b8144bdd-0e36-42d0-ae5a-b27a87dabd70 for instance 57bd310f-a604-40de-9c25-882284f4a17b on nch1-master-1 Jan 15 20:53:41.694021 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-af478b3f-af31-4d68-8d6d-7fc14fc888ef req-6a413508-0c98-4c1a-9342-31ae2ae4aad5 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118975 Jan 15 20:53:41.695150 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 822/1556] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:53:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:53:41.725250 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a22c58c2-00c9-448a-afa4-5b8926001c80 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:41.748646 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a22c58c2-00c9-448a-afa4-5b8926001c80 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: e983108d-66c6-472e-bfc1-761f8a333569] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:41.773384 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a22c58c2-00c9-448a-afa4-5b8926001c80 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:41.779970 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a22c58c2-00c9-448a-afa4-5b8926001c80 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:41.783962 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a22c58c2-00c9-448a-afa4-5b8926001c80 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:41.786590 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a22c58c2-00c9-448a-afa4-5b8926001c80 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:41.882692 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-ce77adea-4f48-4eea-8e2d-1e30d0711974 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d60caf368842b2aec08f0f5e14353a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c95e4b5695439dbc3f66a911264026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:53:41.897579 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ce77adea-4f48-4eea-8e2d-1e30d0711974 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "GET /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b" status: 200 len: 1355 microversion: 2.1 time: 0.620848 Jan 15 20:53:41.907240 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 735/1557] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:53:41 2022] GET /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b => generated 1355 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:53:41.928719 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-94ae8f25-fe86-4fad-8fab-c2ca0bac16a5 req-39d4164d-bc4f-404d-9603-c36de5acc801 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fd1fac4-6c41-4230-9eb5-4fd5a4d82c15", "name": "network-vif-plugged", "status": "completed", "tag": "f6190630-2b92-456a-a85f-b69eb4ffcb81"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:53:41.934002 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:53:41.934002 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:53:41.986982 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-94ae8f25-fe86-4fad-8fab-c2ca0bac16a5 req-39d4164d-bc4f-404d-9603-c36de5acc801 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:41.987463 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-94ae8f25-fe86-4fad-8fab-c2ca0bac16a5 req-39d4164d-bc4f-404d-9603-c36de5acc801 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:42.029518 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-94ae8f25-fe86-4fad-8fab-c2ca0bac16a5 req-39d4164d-bc4f-404d-9603-c36de5acc801 service nova] Creating event network-vif-plugged:f6190630-2b92-456a-a85f-b69eb4ffcb81 for instance 3fd1fac4-6c41-4230-9eb5-4fd5a4d82c15 on nch1-master-1 Jan 15 20:53:42.054080 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-94ae8f25-fe86-4fad-8fab-c2ca0bac16a5 req-39d4164d-bc4f-404d-9603-c36de5acc801 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130388 Jan 15 20:53:42.059592 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 736/1558] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:53:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:53:42.081383 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-96e938d1-eac7-47ad-9257-5694345f6c92 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:42.082853 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-96e938d1-eac7-47ad-9257-5694345f6c92 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] [instance: 3fd1fac4-6c41-4230-9eb5-4fd5a4d82c15] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:42.098761 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-96e938d1-eac7-47ad-9257-5694345f6c92 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:42.101951 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-96e938d1-eac7-47ad-9257-5694345f6c92 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:42.103527 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-96e938d1-eac7-47ad-9257-5694345f6c92 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:42.105146 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-96e938d1-eac7-47ad-9257-5694345f6c92 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:42.516950 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-a22c58c2-00c9-448a-afa4-5b8926001c80 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:53:42.537841 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a22c58c2-00c9-448a-afa4-5b8926001c80 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/e983108d-66c6-472e-bfc1-761f8a333569" status: 200 len: 1468 microversion: 2.1 time: 0.840115 Jan 15 20:53:42.551566 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 823/1559] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:53:41 2022] GET /compute/v2.1/servers/e983108d-66c6-472e-bfc1-761f8a333569 => generated 1468 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:53:42.763696 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-96e938d1-eac7-47ad-9257-5694345f6c92 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17e2708b6fc41b1ae6f70bcf99a0170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515bef049574d4ea4c70f90ab8c4444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:53:42.780551 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-96e938d1-eac7-47ad-9257-5694345f6c92 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] 10.222.0.46 "GET /compute/v2.1/servers/3fd1fac4-6c41-4230-9eb5-4fd5a4d82c15" status: 200 len: 1316 microversion: 2.1 time: 0.719109 Jan 15 20:53:42.794432 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 737/1560] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:53:42 2022] GET /compute/v2.1/servers/3fd1fac4-6c41-4230-9eb5-4fd5a4d82c15 => generated 1316 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:53:42.816270 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-43e93b60-d63e-4fa3-a022-b7d098171be0 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:42.816910 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-43e93b60-d63e-4fa3-a022-b7d098171be0 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] [instance: d94de6c9-be7d-4101-9f88-304b8a4ce8d7] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:42.843576 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-43e93b60-d63e-4fa3-a022-b7d098171be0 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:42.851284 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-43e93b60-d63e-4fa3-a022-b7d098171be0 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:42.854158 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-43e93b60-d63e-4fa3-a022-b7d098171be0 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:42.854697 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-43e93b60-d63e-4fa3-a022-b7d098171be0 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:43.065140 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9d2e4422-8b0b-4631-a984-31d417115d59 tempest-VolumesAdminNegativeTest-739280013 tempest-VolumesAdminNegativeTest-739280013-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "9e2f7227-cd31-458f-94a8-b0cb93b4b148"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:53:43.066242 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-9d2e4422-8b0b-4631-a984-31d417115d59 tempest-VolumesAdminNegativeTest-739280013 tempest-VolumesAdminNegativeTest-739280013-project-admin] [instance: ababfa7a-a809-4151-882d-0c3038b84ee0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:43.083711 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9d2e4422-8b0b-4631-a984-31d417115d59 tempest-VolumesAdminNegativeTest-739280013 tempest-VolumesAdminNegativeTest-739280013-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:43.086173 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9d2e4422-8b0b-4631-a984-31d417115d59 tempest-VolumesAdminNegativeTest-739280013 tempest-VolumesAdminNegativeTest-739280013-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:43.090649 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9d2e4422-8b0b-4631-a984-31d417115d59 tempest-VolumesAdminNegativeTest-739280013 tempest-VolumesAdminNegativeTest-739280013-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:43.091491 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9d2e4422-8b0b-4631-a984-31d417115d59 tempest-VolumesAdminNegativeTest-739280013 tempest-VolumesAdminNegativeTest-739280013-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:43.160688 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-volumes-attachments:swap": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:53:43.160688 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:53:43.327051 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-9d2e4422-8b0b-4631-a984-31d417115d59 tempest-VolumesAdminNegativeTest-739280013 tempest-VolumesAdminNegativeTest-739280013-project-admin] HTTP exception thrown: Volume 9e2f7227-cd31-458f-94a8-b0cb93b4b148 could not be found. Jan 15 20:53:43.328232 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9d2e4422-8b0b-4631-a984-31d417115d59 tempest-VolumesAdminNegativeTest-739280013 tempest-VolumesAdminNegativeTest-739280013-project-admin] Returning 400 to user: Volume 9e2f7227-cd31-458f-94a8-b0cb93b4b148 could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:53:43.329441 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-9d2e4422-8b0b-4631-a984-31d417115d59 tempest-VolumesAdminNegativeTest-739280013 tempest-VolumesAdminNegativeTest-739280013-project-admin] 10.222.0.46 "PUT /compute/v2.1/servers/ababfa7a-a809-4151-882d-0c3038b84ee0/os-volume_attachments/2bdef2ab-ec70-41f0-8baa-f2d47689a8ab" status: 400 len: 107 microversion: 2.1 time: 0.776473 Jan 15 20:53:43.330536 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 824/1561] 10.222.0.46 () {60 vars in 1432 bytes} [Sat Jan 15 20:53:42 2022] PUT /compute/v2.1/servers/ababfa7a-a809-4151-882d-0c3038b84ee0/os-volume_attachments/2bdef2ab-ec70-41f0-8baa-f2d47689a8ab => generated 107 bytes in 778 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 15 20:53:43.335468 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4ede523e-bc92-4e05-924f-2a5993fd1084 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '.version_select at 0x7f30c8ef5280>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:43.567462 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-43e93b60-d63e-4fa3-a022-b7d098171be0 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:53:43.591664 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-43e93b60-d63e-4fa3-a022-b7d098171be0 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:53:43.595933 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-43e93b60-d63e-4fa3-a022-b7d098171be0 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:53:43.598241 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-43e93b60-d63e-4fa3-a022-b7d098171be0 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] 10.222.0.46 "GET /compute/v2.1/servers/d94de6c9-be7d-4101-9f88-304b8a4ce8d7" status: 200 len: 1485 microversion: 2.25 time: 0.802477 Jan 15 20:53:43.610591 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 738/1562] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:53:42 2022] GET /compute/v2.1/servers/d94de6c9-be7d-4101-9f88-304b8a4ce8d7 => generated 1485 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:53:43.617364 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-0d8cfd11-0c41-4c53-aff6-5ef6fb9d43a9 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:43.618312 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-0d8cfd11-0c41-4c53-aff6-5ef6fb9d43a9 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 57bd310f-a604-40de-9c25-882284f4a17b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:43.641188 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0d8cfd11-0c41-4c53-aff6-5ef6fb9d43a9 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:43.642095 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0d8cfd11-0c41-4c53-aff6-5ef6fb9d43a9 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:43.644686 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0d8cfd11-0c41-4c53-aff6-5ef6fb9d43a9 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:43.645205 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0d8cfd11-0c41-4c53-aff6-5ef6fb9d43a9 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:43.689236 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-0d8cfd11-0c41-4c53-aff6-5ef6fb9d43a9 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] HTTP exception thrown: Instance 57bd310f-a604-40de-9c25-882284f4a17b could not be found. Jan 15 20:53:43.689834 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-0d8cfd11-0c41-4c53-aff6-5ef6fb9d43a9 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Returning 404 to user: Instance 57bd310f-a604-40de-9c25-882284f4a17b could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:53:43.690676 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-0d8cfd11-0c41-4c53-aff6-5ef6fb9d43a9 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "GET /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b" status: 404 len: 111 microversion: 2.1 time: 0.078636 Jan 15 20:53:43.691484 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 739/1563] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:53:43 2022] GET /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:53:43.721933 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-624a72f2-c7e9-4047-8cb3-9d33bb940dde tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:43.727598 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-624a72f2-c7e9-4047-8cb3-9d33bb940dde tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] [instance: ababfa7a-a809-4151-882d-0c3038b84ee0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:43.761009 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-624a72f2-c7e9-4047-8cb3-9d33bb940dde tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:43.763160 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-624a72f2-c7e9-4047-8cb3-9d33bb940dde tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:43.764418 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-624a72f2-c7e9-4047-8cb3-9d33bb940dde tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:43.765792 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-624a72f2-c7e9-4047-8cb3-9d33bb940dde tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:43.909754 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.objects.instance [None req-624a72f2-c7e9-4047-8cb3-9d33bb940dde tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] Lazy-loading 'services' on Instance uuid ababfa7a-a809-4151-882d-0c3038b84ee0 {{(pid=129365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 20:53:44.094781 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-624a72f2-c7e9-4047-8cb3-9d33bb940dde tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] 10.222.0.46 "DELETE /compute/v2.1/servers/ababfa7a-a809-4151-882d-0c3038b84ee0/os-volume_attachments/2bdef2ab-ec70-41f0-8baa-f2d47689a8ab" status: 202 len: 0 microversion: 2.1 time: 0.398495 Jan 15 20:53:44.096830 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 740/1564] 10.222.0.46 () {58 vars in 1415 bytes} [Sat Jan 15 20:53:43 2022] DELETE /compute/v2.1/servers/ababfa7a-a809-4151-882d-0c3038b84ee0/os-volume_attachments/2bdef2ab-ec70-41f0-8baa-f2d47689a8ab => generated 0 bytes in 405 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 20:53:44.128494 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8f636fcf-65cf-4389-a0cc-0ffec038ec9a tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:44.129576 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-8f636fcf-65cf-4389-a0cc-0ffec038ec9a tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: e983108d-66c6-472e-bfc1-761f8a333569] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:44.164217 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8f636fcf-65cf-4389-a0cc-0ffec038ec9a tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:44.187103 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8f636fcf-65cf-4389-a0cc-0ffec038ec9a tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:44.194967 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8f636fcf-65cf-4389-a0cc-0ffec038ec9a tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:44.195878 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8f636fcf-65cf-4389-a0cc-0ffec038ec9a tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:44.821613 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-8f636fcf-65cf-4389-a0cc-0ffec038ec9a tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:53:44.834911 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-8f636fcf-65cf-4389-a0cc-0ffec038ec9a tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/e983108d-66c6-472e-bfc1-761f8a333569" status: 200 len: 1468 microversion: 2.1 time: 0.733983 Jan 15 20:53:44.837374 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 741/1565] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:53:44 2022] GET /compute/v2.1/servers/e983108d-66c6-472e-bfc1-761f8a333569 => generated 1468 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:53:44.843085 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-47149734-ee39-43ac-b7f5-6dcab7b71041 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:44.844106 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-47149734-ee39-43ac-b7f5-6dcab7b71041 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 98d0ca37-0175-44e2-8a1d-965cdc517daf] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:44.852590 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-47149734-ee39-43ac-b7f5-6dcab7b71041 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:44.853466 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-47149734-ee39-43ac-b7f5-6dcab7b71041 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:44.854604 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-47149734-ee39-43ac-b7f5-6dcab7b71041 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:44.855405 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-47149734-ee39-43ac-b7f5-6dcab7b71041 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:44.988003 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-47149734-ee39-43ac-b7f5-6dcab7b71041 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] HTTP exception thrown: Instance 98d0ca37-0175-44e2-8a1d-965cdc517daf could not be found. Jan 15 20:53:44.988469 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-47149734-ee39-43ac-b7f5-6dcab7b71041 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Returning 404 to user: Instance 98d0ca37-0175-44e2-8a1d-965cdc517daf could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:53:44.989681 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-47149734-ee39-43ac-b7f5-6dcab7b71041 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "DELETE /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf" status: 404 len: 111 microversion: 2.1 time: 0.150658 Jan 15 20:53:44.995787 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 742/1566] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 20:53:44 2022] DELETE /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf => generated 111 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:53:45.014008 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-dca130bc-98ca-4883-b8a6-9720be86d42d tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:45.021680 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-dca130bc-98ca-4883-b8a6-9720be86d42d tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] [instance: 3fd1fac4-6c41-4230-9eb5-4fd5a4d82c15] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:45.031098 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dca130bc-98ca-4883-b8a6-9720be86d42d tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:45.036133 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dca130bc-98ca-4883-b8a6-9720be86d42d tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:45.036133 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dca130bc-98ca-4883-b8a6-9720be86d42d tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:45.036133 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dca130bc-98ca-4883-b8a6-9720be86d42d tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:45.431402 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-dca130bc-98ca-4883-b8a6-9720be86d42d tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17e2708b6fc41b1ae6f70bcf99a0170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515bef049574d4ea4c70f90ab8c4444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:53:45.454257 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-dca130bc-98ca-4883-b8a6-9720be86d42d tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] 10.222.0.46 "GET /compute/v2.1/servers/3fd1fac4-6c41-4230-9eb5-4fd5a4d82c15" status: 200 len: 1505 microversion: 2.1 time: 0.454977 Jan 15 20:53:45.461153 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 743/1567] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:53:44 2022] GET /compute/v2.1/servers/3fd1fac4-6c41-4230-9eb5-4fd5a4d82c15 => generated 1505 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:53:45.479298 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-cb9174a4-770e-487a-9667-fcfbfa4fe2a8 tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:45.482023 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-cb9174a4-770e-487a-9667-fcfbfa4fe2a8 tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] [instance: ababfa7a-a809-4151-882d-0c3038b84ee0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:45.510153 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cb9174a4-770e-487a-9667-fcfbfa4fe2a8 tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:45.510941 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cb9174a4-770e-487a-9667-fcfbfa4fe2a8 tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:45.511950 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cb9174a4-770e-487a-9667-fcfbfa4fe2a8 tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:45.512583 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cb9174a4-770e-487a-9667-fcfbfa4fe2a8 tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:45.578077 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-cb9174a4-770e-487a-9667-fcfbfa4fe2a8 tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] 10.222.0.46 "GET /compute/v2.1/servers/ababfa7a-a809-4151-882d-0c3038b84ee0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.114022 Jan 15 20:53:45.580044 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 744/1568] 10.222.0.46 () {58 vars in 1301 bytes} [Sat Jan 15 20:53:45 2022] GET /compute/v2.1/servers/ababfa7a-a809-4151-882d-0c3038b84ee0/os-volume_attachments => generated 25 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 20:53:45.585896 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-e3065fd9-c69d-4eb6-b957-77756c66c7e6 req-d5158424-c879-443d-a9a7-4a0317a05e9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e983108d-66c6-472e-bfc1-761f8a333569", "name": "network-vif-plugged", "status": "completed", "tag": "5d3688c4-ca00-4b8e-9475-e69603c54112"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:53:45.588430 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:53:45.588430 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:53:45.603730 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-e3065fd9-c69d-4eb6-b957-77756c66c7e6 req-d5158424-c879-443d-a9a7-4a0317a05e9d service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:45.605250 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-e3065fd9-c69d-4eb6-b957-77756c66c7e6 req-d5158424-c879-443d-a9a7-4a0317a05e9d service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:45.622309 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-e3065fd9-c69d-4eb6-b957-77756c66c7e6 req-d5158424-c879-443d-a9a7-4a0317a05e9d service nova] Creating event network-vif-plugged:5d3688c4-ca00-4b8e-9475-e69603c54112 for instance e983108d-66c6-472e-bfc1-761f8a333569 on nch1-master-1 Jan 15 20:53:45.630256 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-e3065fd9-c69d-4eb6-b957-77756c66c7e6 req-d5158424-c879-443d-a9a7-4a0317a05e9d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047710 Jan 15 20:53:45.631389 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 745/1569] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:53:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:53:45.637683 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-fd5b1418-6830-4c1a-95f7-dd5fa787737b tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:45.638836 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-fd5b1418-6830-4c1a-95f7-dd5fa787737b tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] [instance: d94de6c9-be7d-4101-9f88-304b8a4ce8d7] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:45.647116 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fd5b1418-6830-4c1a-95f7-dd5fa787737b tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:45.648401 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fd5b1418-6830-4c1a-95f7-dd5fa787737b tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:45.653696 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fd5b1418-6830-4c1a-95f7-dd5fa787737b tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:45.654251 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fd5b1418-6830-4c1a-95f7-dd5fa787737b tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:46.001962 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-fd5b1418-6830-4c1a-95f7-dd5fa787737b tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:53:46.022711 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-fd5b1418-6830-4c1a-95f7-dd5fa787737b tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:53:46.028365 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-fd5b1418-6830-4c1a-95f7-dd5fa787737b tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:53:46.032620 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-fd5b1418-6830-4c1a-95f7-dd5fa787737b tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] 10.222.0.46 "GET /compute/v2.1/servers/d94de6c9-be7d-4101-9f88-304b8a4ce8d7" status: 200 len: 1475 microversion: 2.25 time: 0.399602 Jan 15 20:53:46.035380 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 746/1570] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:53:45 2022] GET /compute/v2.1/servers/d94de6c9-be7d-4101-9f88-304b8a4ce8d7 => generated 1475 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:53:46.193760 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-66b7a988-d414-47f6-a555-0678ad526d94 req-bc2a4e1d-0dde-47ab-bc23-e50e597aedb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e983108d-66c6-472e-bfc1-761f8a333569", "name": "network-vif-deleted", "tag": "5d3688c4-ca00-4b8e-9475-e69603c54112"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:53:46.213770 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:53:46.213770 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:53:46.254392 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-66b7a988-d414-47f6-a555-0678ad526d94 req-bc2a4e1d-0dde-47ab-bc23-e50e597aedb7 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:46.255390 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-66b7a988-d414-47f6-a555-0678ad526d94 req-bc2a4e1d-0dde-47ab-bc23-e50e597aedb7 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:46.314517 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-66b7a988-d414-47f6-a555-0678ad526d94 req-bc2a4e1d-0dde-47ab-bc23-e50e597aedb7 service nova] Creating event network-vif-deleted:5d3688c4-ca00-4b8e-9475-e69603c54112 for instance e983108d-66c6-472e-bfc1-761f8a333569 on nch1-master-1 Jan 15 20:53:46.327868 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-66b7a988-d414-47f6-a555-0678ad526d94 req-bc2a4e1d-0dde-47ab-bc23-e50e597aedb7 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.288784 Jan 15 20:53:46.335155 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 747/1571] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:53:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:53:46.366695 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-eb26be32-ae3a-41ee-8a28-cc885c3e3ae4 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:46.368320 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-eb26be32-ae3a-41ee-8a28-cc885c3e3ae4 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 98d0ca37-0175-44e2-8a1d-965cdc517daf] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:46.386974 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-eb26be32-ae3a-41ee-8a28-cc885c3e3ae4 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:46.388221 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-eb26be32-ae3a-41ee-8a28-cc885c3e3ae4 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:46.389359 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-eb26be32-ae3a-41ee-8a28-cc885c3e3ae4 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:46.392624 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-eb26be32-ae3a-41ee-8a28-cc885c3e3ae4 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:46.433943 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-eb26be32-ae3a-41ee-8a28-cc885c3e3ae4 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] HTTP exception thrown: Instance 98d0ca37-0175-44e2-8a1d-965cdc517daf could not be found. Jan 15 20:53:46.433943 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-eb26be32-ae3a-41ee-8a28-cc885c3e3ae4 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Returning 404 to user: Instance 98d0ca37-0175-44e2-8a1d-965cdc517daf could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:53:46.434856 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-eb26be32-ae3a-41ee-8a28-cc885c3e3ae4 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "GET /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf" status: 404 len: 111 microversion: 2.1 time: 0.097854 Jan 15 20:53:46.435939 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 748/1572] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:53:46 2022] GET /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:53:46.451855 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d49eae76-290a-43a5-b5ec-0d07a08ba4bf tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2004995086"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:53:46.454061 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d49eae76-290a-43a5-b5ec-0d07a08ba4bf tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] [instance: 3fd1fac4-6c41-4230-9eb5-4fd5a4d82c15] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:46.475770 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d49eae76-290a-43a5-b5ec-0d07a08ba4bf tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:46.478687 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d49eae76-290a-43a5-b5ec-0d07a08ba4bf tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:46.479746 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d49eae76-290a-43a5-b5ec-0d07a08ba4bf tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:46.480286 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d49eae76-290a-43a5-b5ec-0d07a08ba4bf tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:46.946556 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.network.security_group_api [None req-d49eae76-290a-43a5-b5ec-0d07a08ba4bf tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Adding security group 0a330bbb-88d9-44eb-a060-ef87d8ba5601 to port f6190630-2b92-456a-a85f-b69eb4ffcb81 Jan 15 20:53:47.957973 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d49eae76-290a-43a5-b5ec-0d07a08ba4bf tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] 10.222.0.46 "POST /compute/v2.1/servers/3fd1fac4-6c41-4230-9eb5-4fd5a4d82c15/action" status: 202 len: 0 microversion: 2.1 time: 1.520351 Jan 15 20:53:47.960114 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 749/1573] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:53:46 2022] POST /compute/v2.1/servers/3fd1fac4-6c41-4230-9eb5-4fd5a4d82c15/action => generated 0 bytes in 1523 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 20:53:47.966233 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c6a22084-ee70-4e92-bf25-fdd509f6a98a tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:47.967946 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c6a22084-ee70-4e92-bf25-fdd509f6a98a tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: e983108d-66c6-472e-bfc1-761f8a333569] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:47.991774 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c6a22084-ee70-4e92-bf25-fdd509f6a98a tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:47.995236 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c6a22084-ee70-4e92-bf25-fdd509f6a98a tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:48.002884 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c6a22084-ee70-4e92-bf25-fdd509f6a98a tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:48.003822 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c6a22084-ee70-4e92-bf25-fdd509f6a98a tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:48.066354 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-c6a22084-ee70-4e92-bf25-fdd509f6a98a tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] HTTP exception thrown: Instance e983108d-66c6-472e-bfc1-761f8a333569 could not be found. Jan 15 20:53:48.069528 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c6a22084-ee70-4e92-bf25-fdd509f6a98a tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Returning 404 to user: Instance e983108d-66c6-472e-bfc1-761f8a333569 could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:53:48.071834 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c6a22084-ee70-4e92-bf25-fdd509f6a98a tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/e983108d-66c6-472e-bfc1-761f8a333569" status: 404 len: 111 microversion: 2.1 time: 0.109066 Jan 15 20:53:48.074101 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 750/1574] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:53:47 2022] GET /compute/v2.1/servers/e983108d-66c6-472e-bfc1-761f8a333569 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:53:48.088601 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-731af338-8774-48bf-ab83-1407063961be tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Calling method '.version_select at 0x7f30c90a7310>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:48.093505 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-migrations:index": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:53:48.093505 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:53:48.098887 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-731af338-8774-48bf-ab83-1407063961be tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:48.100175 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-731af338-8774-48bf-ab83-1407063961be tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:48.108021 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-4ede523e-bc92-4e05-924f-2a5993fd1084 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "GET /compute/v2.1/images/07eb66c4-9522-4f02-aad6-44189090dfa5" status: 200 len: 1447 microversion: 2.1 time: 4.776199 Jan 15 20:53:48.109030 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 825/1575] 10.222.0.46 () {58 vars in 1232 bytes} [Sat Jan 15 20:53:43 2022] GET /compute/v2.1/images/07eb66c4-9522-4f02-aad6-44189090dfa5 => generated 1447 bytes in 4778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:53:48.125453 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a753b9fd-65ea-4ef3-847a-bd340394b59c tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Calling method '.version_select at 0x7f30c983cc10>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:48.138643 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-731af338-8774-48bf-ab83-1407063961be tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] 10.222.0.46 "GET /compute/v2.1/os-migrations" status: 200 len: 2961 microversion: 2.25 time: 0.060909 Jan 15 20:53:48.140491 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 751/1576] 10.222.0.46 () {60 vars in 1183 bytes} [Sat Jan 15 20:53:48 2022] GET /compute/v2.1/os-migrations => generated 2961 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:53:48.147289 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-36965ee9-f01a-457f-9172-1bdad4d6bd18 tempest-VolumesAdminNegativeTest-739280013 tempest-VolumesAdminNegativeTest-739280013-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "c52db4ae-fb74-4e0e-aed1-302a359bf9e1"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:53:48.163640 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-36965ee9-f01a-457f-9172-1bdad4d6bd18 tempest-VolumesAdminNegativeTest-739280013 tempest-VolumesAdminNegativeTest-739280013-project-admin] [instance: ababfa7a-a809-4151-882d-0c3038b84ee0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:48.168504 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a753b9fd-65ea-4ef3-847a-bd340394b59c tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2097977498" status: 202 len: 0 microversion: 2.1 time: 0.058405 Jan 15 20:53:48.171708 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 826/1577] 10.222.0.46 () {58 vars in 1220 bytes} [Sat Jan 15 20:53:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2097977498 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 20:53:48.189475 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-36965ee9-f01a-457f-9172-1bdad4d6bd18 tempest-VolumesAdminNegativeTest-739280013 tempest-VolumesAdminNegativeTest-739280013-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:48.190947 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-36965ee9-f01a-457f-9172-1bdad4d6bd18 tempest-VolumesAdminNegativeTest-739280013 tempest-VolumesAdminNegativeTest-739280013-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:48.193864 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-36965ee9-f01a-457f-9172-1bdad4d6bd18 tempest-VolumesAdminNegativeTest-739280013 tempest-VolumesAdminNegativeTest-739280013-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:48.194540 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-36965ee9-f01a-457f-9172-1bdad4d6bd18 tempest-VolumesAdminNegativeTest-739280013 tempest-VolumesAdminNegativeTest-739280013-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:48.204451 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-642c5224-d992-4e32-b77c-5719d915a090 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1457502985"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:53:48.205055 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-642c5224-d992-4e32-b77c-5719d915a090 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] [instance: 3fd1fac4-6c41-4230-9eb5-4fd5a4d82c15] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:48.240198 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-volumes-attachments:swap": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:53:48.240198 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:53:48.259188 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-642c5224-d992-4e32-b77c-5719d915a090 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:48.261359 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-642c5224-d992-4e32-b77c-5719d915a090 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:48.267946 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-642c5224-d992-4e32-b77c-5719d915a090 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:48.269392 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-642c5224-d992-4e32-b77c-5719d915a090 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:48.288450 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-36965ee9-f01a-457f-9172-1bdad4d6bd18 tempest-VolumesAdminNegativeTest-739280013 tempest-VolumesAdminNegativeTest-739280013-project-admin] HTTP exception thrown: Volume 73f85e24-fcd9-48f8-b966-2756c4a34854 could not be found. Jan 15 20:53:48.289575 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-36965ee9-f01a-457f-9172-1bdad4d6bd18 tempest-VolumesAdminNegativeTest-739280013 tempest-VolumesAdminNegativeTest-739280013-project-admin] Returning 404 to user: Volume 73f85e24-fcd9-48f8-b966-2756c4a34854 could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:53:48.290766 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-36965ee9-f01a-457f-9172-1bdad4d6bd18 tempest-VolumesAdminNegativeTest-739280013 tempest-VolumesAdminNegativeTest-739280013-project-admin] 10.222.0.46 "PUT /compute/v2.1/servers/ababfa7a-a809-4151-882d-0c3038b84ee0/os-volume_attachments/73f85e24-fcd9-48f8-b966-2756c4a34854" status: 404 len: 109 microversion: 2.1 time: 0.148687 Jan 15 20:53:48.298548 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 752/1578] 10.222.0.46 () {60 vars in 1432 bytes} [Sat Jan 15 20:53:48 2022] PUT /compute/v2.1/servers/ababfa7a-a809-4151-882d-0c3038b84ee0/os-volume_attachments/73f85e24-fcd9-48f8-b966-2756c4a34854 => generated 109 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:53:48.307841 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f0217861-59a4-4fef-ab15-8f780849d5eb tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:48.310497 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f0217861-59a4-4fef-ab15-8f780849d5eb tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: d603f11b-5d49-492b-b541-1826486876ef] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:48.321668 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f0217861-59a4-4fef-ab15-8f780849d5eb tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:48.323220 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f0217861-59a4-4fef-ab15-8f780849d5eb tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:48.324325 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f0217861-59a4-4fef-ab15-8f780849d5eb tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:48.325074 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f0217861-59a4-4fef-ab15-8f780849d5eb tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:48.370189 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f0217861-59a4-4fef-ab15-8f780849d5eb tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: d603f11b-5d49-492b-b541-1826486876ef] Going to try to terminate instance {{(pid=129365) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 20:53:48.588598 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f0217861-59a4-4fef-ab15-8f780849d5eb tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "DELETE /compute/v2.1/servers/d603f11b-5d49-492b-b541-1826486876ef" status: 204 len: 0 microversion: 2.1 time: 0.287770 Jan 15 20:53:48.590571 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 753/1579] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 20:53:48 2022] DELETE /compute/v2.1/servers/d603f11b-5d49-492b-b541-1826486876ef => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 20:53:48.618776 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8be2c24f-ff1d-4767-818b-01c558dbeec1 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '.version_select at 0x7f30c97cc820>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:48.719561 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-8be2c24f-ff1d-4767-818b-01c558dbeec1 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "GET /compute/v2.1/images/07eb66c4-9522-4f02-aad6-44189090dfa5" status: 200 len: 1447 microversion: 2.1 time: 0.124039 Jan 15 20:53:48.737756 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 754/1580] 10.222.0.46 () {58 vars in 1232 bytes} [Sat Jan 15 20:53:48 2022] GET /compute/v2.1/images/07eb66c4-9522-4f02-aad6-44189090dfa5 => generated 1447 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:53:48.767708 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-1d725bad-bec5-4ff3-a31b-7fd43b9f83a2 tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:48.769745 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-1d725bad-bec5-4ff3-a31b-7fd43b9f83a2 tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] [instance: d94de6c9-be7d-4101-9f88-304b8a4ce8d7] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:48.781503 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1d725bad-bec5-4ff3-a31b-7fd43b9f83a2 tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:48.784544 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1d725bad-bec5-4ff3-a31b-7fd43b9f83a2 tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:48.785925 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1d725bad-bec5-4ff3-a31b-7fd43b9f83a2 tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:48.786656 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1d725bad-bec5-4ff3-a31b-7fd43b9f83a2 tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:49.466894 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.network.security_group_api [None req-642c5224-d992-4e32-b77c-5719d915a090 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Adding security group 6fcd6844-3261-41cc-9071-34a253ce8007 to port f6190630-2b92-456a-a85f-b69eb4ffcb81 Jan 15 20:53:49.493592 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.objects.instance [None req-1d725bad-bec5-4ff3-a31b-7fd43b9f83a2 tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] Lazy-loading 'services' on Instance uuid d94de6c9-be7d-4101-9f88-304b8a4ce8d7 {{(pid=129365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 20:53:49.548149 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-1d725bad-bec5-4ff3-a31b-7fd43b9f83a2 tempest-LiveAutoBlockMigrationV225Test-75508502 tempest-LiveAutoBlockMigrationV225Test-75508502-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/d94de6c9-be7d-4101-9f88-304b8a4ce8d7" status: 200 len: 1967 microversion: 2.25 time: 0.799133 Jan 15 20:53:49.552708 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 755/1581] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:53:48 2022] GET /compute/v2.1/servers/d94de6c9-be7d-4101-9f88-304b8a4ce8d7 => generated 1967 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:53:49.563917 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-33438760-0f1f-41c5-870a-d97b2473dbcd req-839e5722-d475-48dd-adf4-c24337aa0dc3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3fd1fac4-6c41-4230-9eb5-4fd5a4d82c15", "tag": "f6190630-2b92-456a-a85f-b69eb4ffcb81"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:53:49.590942 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:53:49.590942 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:53:49.611885 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-33438760-0f1f-41c5-870a-d97b2473dbcd req-839e5722-d475-48dd-adf4-c24337aa0dc3 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:49.621472 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-33438760-0f1f-41c5-870a-d97b2473dbcd req-839e5722-d475-48dd-adf4-c24337aa0dc3 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:49.691599 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-33438760-0f1f-41c5-870a-d97b2473dbcd req-839e5722-d475-48dd-adf4-c24337aa0dc3 service nova] Creating event network-changed:f6190630-2b92-456a-a85f-b69eb4ffcb81 for instance 3fd1fac4-6c41-4230-9eb5-4fd5a4d82c15 on nch1-master-1 Jan 15 20:53:49.711415 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-33438760-0f1f-41c5-870a-d97b2473dbcd req-839e5722-d475-48dd-adf4-c24337aa0dc3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.155347 Jan 15 20:53:49.713509 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 756/1582] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:53:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:53:49.746629 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c70992b2-4bfc-4c2e-8b6b-48bfeca87aad tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:49.750854 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c70992b2-4bfc-4c2e-8b6b-48bfeca87aad tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: d603f11b-5d49-492b-b541-1826486876ef] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:49.777349 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c70992b2-4bfc-4c2e-8b6b-48bfeca87aad tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:49.778766 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c70992b2-4bfc-4c2e-8b6b-48bfeca87aad tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:49.781966 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c70992b2-4bfc-4c2e-8b6b-48bfeca87aad tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:49.782629 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c70992b2-4bfc-4c2e-8b6b-48bfeca87aad tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:50.619964 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-c70992b2-4bfc-4c2e-8b6b-48bfeca87aad tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:53:50.635793 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c70992b2-4bfc-4c2e-8b6b-48bfeca87aad tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/d603f11b-5d49-492b-b541-1826486876ef" status: 200 len: 1533 microversion: 2.1 time: 0.918195 Jan 15 20:53:50.636419 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 757/1583] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:53:49 2022] GET /compute/v2.1/servers/d603f11b-5d49-492b-b541-1826486876ef => generated 1533 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:53:50.648938 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f7f631c2-ede1-440b-92c7-4fe556b69928 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '.version_select at 0x7f30c97f81f0>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:51.725040 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-642c5224-d992-4e32-b77c-5719d915a090 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] 10.222.0.46 "POST /compute/v2.1/servers/3fd1fac4-6c41-4230-9eb5-4fd5a4d82c15/action" status: 202 len: 0 microversion: 2.1 time: 3.551960 Jan 15 20:53:51.725658 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 827/1584] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:53:48 2022] POST /compute/v2.1/servers/3fd1fac4-6c41-4230-9eb5-4fd5a4d82c15/action => generated 0 bytes in 3553 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 20:53:51.732611 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ddce7330-c765-44f5-a0e3-435ffb58da6f tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:51.733662 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ddce7330-c765-44f5-a0e3-435ffb58da6f tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] [instance: d94de6c9-be7d-4101-9f88-304b8a4ce8d7] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:51.755828 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ddce7330-c765-44f5-a0e3-435ffb58da6f tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:51.763934 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ddce7330-c765-44f5-a0e3-435ffb58da6f tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:51.765454 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ddce7330-c765-44f5-a0e3-435ffb58da6f tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:51.769585 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ddce7330-c765-44f5-a0e3-435ffb58da6f tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:51.853717 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ddce7330-c765-44f5-a0e3-435ffb58da6f tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] [instance: d94de6c9-be7d-4101-9f88-304b8a4ce8d7] Going to try to terminate instance {{(pid=129366) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 20:53:51.928328 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f7f631c2-ede1-440b-92c7-4fe556b69928 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "DELETE /compute/v2.1/images/07eb66c4-9522-4f02-aad6-44189090dfa5" status: 204 len: 0 microversion: 2.1 time: 1.290666 Jan 15 20:53:51.929128 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 758/1585] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:53:50 2022] DELETE /compute/v2.1/images/07eb66c4-9522-4f02-aad6-44189090dfa5 => generated 0 bytes in 1292 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 20:53:51.933834 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a5da7aac-04ab-4542-be79-856b54c3e45c tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:51.934814 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a5da7aac-04ab-4542-be79-856b54c3e45c tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] [instance: ababfa7a-a809-4151-882d-0c3038b84ee0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:51.948271 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a5da7aac-04ab-4542-be79-856b54c3e45c tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:51.959434 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a5da7aac-04ab-4542-be79-856b54c3e45c tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:51.961731 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a5da7aac-04ab-4542-be79-856b54c3e45c tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:51.965249 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a5da7aac-04ab-4542-be79-856b54c3e45c tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:52.065134 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a5da7aac-04ab-4542-be79-856b54c3e45c tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] [instance: ababfa7a-a809-4151-882d-0c3038b84ee0] Going to try to terminate instance {{(pid=129365) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 20:53:52.168306 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ddce7330-c765-44f5-a0e3-435ffb58da6f tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] 10.222.0.46 "DELETE /compute/v2.1/servers/d94de6c9-be7d-4101-9f88-304b8a4ce8d7" status: 204 len: 0 microversion: 2.25 time: 0.441246 Jan 15 20:53:52.174746 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 828/1586] 10.222.0.46 () {60 vars in 1279 bytes} [Sat Jan 15 20:53:51 2022] DELETE /compute/v2.1/servers/d94de6c9-be7d-4101-9f88-304b8a4ce8d7 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 15 20:53:52.184671 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ca81c736-b942-47a0-8f4c-36194a607b19 tempest-ServersWithSpecificFlavorTestJSON-1166388665 tempest-ServersWithSpecificFlavorTestJSON-1166388665-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:52.185702 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:53:52.185702 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:53:52.265503 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ca81c736-b942-47a0-8f4c-36194a607b19 tempest-ServersWithSpecificFlavorTestJSON-1166388665 tempest-ServersWithSpecificFlavorTestJSON-1166388665-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/1139881125" status: 202 len: 0 microversion: 2.1 time: 0.088214 Jan 15 20:53:52.266122 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 829/1587] 10.222.0.46 () {58 vars in 1160 bytes} [Sat Jan 15 20:53:52 2022] DELETE /compute/v2.1/flavors/1139881125 => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 20:53:52.286721 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-dd51368d-7442-49ce-9cdc-b2dd3e250016 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:52.312270 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-dd51368d-7442-49ce-9cdc-b2dd3e250016 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: d603f11b-5d49-492b-b541-1826486876ef] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:52.330202 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dd51368d-7442-49ce-9cdc-b2dd3e250016 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:52.330544 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dd51368d-7442-49ce-9cdc-b2dd3e250016 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:52.331507 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dd51368d-7442-49ce-9cdc-b2dd3e250016 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:52.331947 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dd51368d-7442-49ce-9cdc-b2dd3e250016 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:52.397633 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a5da7aac-04ab-4542-be79-856b54c3e45c tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] 10.222.0.46 "DELETE /compute/v2.1/servers/ababfa7a-a809-4151-882d-0c3038b84ee0" status: 204 len: 0 microversion: 2.1 time: 0.465454 Jan 15 20:53:52.403057 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 759/1588] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 20:53:51 2022] DELETE /compute/v2.1/servers/ababfa7a-a809-4151-882d-0c3038b84ee0 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 20:53:52.407709 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dd51368d-7442-49ce-9cdc-b2dd3e250016 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:52.408167 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dd51368d-7442-49ce-9cdc-b2dd3e250016 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:52.408628 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.objects.instance [None req-dd51368d-7442-49ce-9cdc-b2dd3e250016 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lazy-loading 'fault' on Instance uuid d603f11b-5d49-492b-b541-1826486876ef {{(pid=129366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 20:53:52.421788 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ed6f7314-68ae-48cf-8ba0-bccc8aa0568d tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:52.424808 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ed6f7314-68ae-48cf-8ba0-bccc8aa0568d tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] [instance: 3fd1fac4-6c41-4230-9eb5-4fd5a4d82c15] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:52.439913 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ed6f7314-68ae-48cf-8ba0-bccc8aa0568d tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:52.441634 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ed6f7314-68ae-48cf-8ba0-bccc8aa0568d tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:52.445876 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ed6f7314-68ae-48cf-8ba0-bccc8aa0568d tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:52.448258 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ed6f7314-68ae-48cf-8ba0-bccc8aa0568d tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:52.986433 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-dd51368d-7442-49ce-9cdc-b2dd3e250016 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:53:53.005721 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-dd51368d-7442-49ce-9cdc-b2dd3e250016 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/d603f11b-5d49-492b-b541-1826486876ef" status: 200 len: 1368 microversion: 2.1 time: 0.737797 Jan 15 20:53:53.007539 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 830/1589] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:53:52 2022] GET /compute/v2.1/servers/d603f11b-5d49-492b-b541-1826486876ef => generated 1368 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:53:53.020389 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-b4b81b73-0d24-4ae3-a3f5-82b94ccbae5d req-f69193c1-9f8c-4eee-a0e7-474e625f8828 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d603f11b-5d49-492b-b541-1826486876ef", "name": "network-vif-deleted", "tag": "29144689-f6e8-49ab-886d-3bedd21d555f"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:53:53.022125 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:53:53.022125 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:53:53.029800 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-b4b81b73-0d24-4ae3-a3f5-82b94ccbae5d req-f69193c1-9f8c-4eee-a0e7-474e625f8828 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:53.030707 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-b4b81b73-0d24-4ae3-a3f5-82b94ccbae5d req-f69193c1-9f8c-4eee-a0e7-474e625f8828 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:53.059838 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-b4b81b73-0d24-4ae3-a3f5-82b94ccbae5d req-f69193c1-9f8c-4eee-a0e7-474e625f8828 service nova] Creating event network-vif-deleted:29144689-f6e8-49ab-886d-3bedd21d555f for instance d603f11b-5d49-492b-b541-1826486876ef on nch1-master-1 Jan 15 20:53:53.067570 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-b4b81b73-0d24-4ae3-a3f5-82b94ccbae5d req-f69193c1-9f8c-4eee-a0e7-474e625f8828 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058419 Jan 15 20:53:53.073238 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 831/1590] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:53:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:53:53.080240 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-13e968f3-2b6b-4b01-bb2a-880fb15dbe99 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:53.081635 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-13e968f3-2b6b-4b01-bb2a-880fb15dbe99 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] [instance: b1d27142-a9e4-440b-a719-d2059db11e79] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:53.135118 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-13e968f3-2b6b-4b01-bb2a-880fb15dbe99 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:53.137294 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-13e968f3-2b6b-4b01-bb2a-880fb15dbe99 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:53.140626 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-13e968f3-2b6b-4b01-bb2a-880fb15dbe99 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:53.141506 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-13e968f3-2b6b-4b01-bb2a-880fb15dbe99 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:53.179952 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-13e968f3-2b6b-4b01-bb2a-880fb15dbe99 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] [instance: b1d27142-a9e4-440b-a719-d2059db11e79] Going to try to terminate instance {{(pid=129366) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 20:53:53.347042 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-13e968f3-2b6b-4b01-bb2a-880fb15dbe99 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "DELETE /compute/v2.1/servers/b1d27142-a9e4-440b-a719-d2059db11e79" status: 204 len: 0 microversion: 2.1 time: 0.267252 Jan 15 20:53:53.348599 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 832/1591] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 20:53:53 2022] DELETE /compute/v2.1/servers/b1d27142-a9e4-440b-a719-d2059db11e79 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 20:53:53.359777 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-dcc746d2-b95c-441a-a849-1fdd0eeed4c3 req-02977011-6121-4158-8739-7ae4308c3ae7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3fd1fac4-6c41-4230-9eb5-4fd5a4d82c15", "tag": "f6190630-2b92-456a-a85f-b69eb4ffcb81"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:53:53.362485 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:53:53.362485 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:53:53.392511 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-dcc746d2-b95c-441a-a849-1fdd0eeed4c3 req-02977011-6121-4158-8739-7ae4308c3ae7 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:53.396318 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-dcc746d2-b95c-441a-a849-1fdd0eeed4c3 req-02977011-6121-4158-8739-7ae4308c3ae7 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:53.436705 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-dcc746d2-b95c-441a-a849-1fdd0eeed4c3 req-02977011-6121-4158-8739-7ae4308c3ae7 service nova] Creating event network-changed:f6190630-2b92-456a-a85f-b69eb4ffcb81 for instance 3fd1fac4-6c41-4230-9eb5-4fd5a4d82c15 on nch1-master-1 Jan 15 20:53:53.450424 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-dcc746d2-b95c-441a-a849-1fdd0eeed4c3 req-02977011-6121-4158-8739-7ae4308c3ae7 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096127 Jan 15 20:53:53.453438 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ed6f7314-68ae-48cf-8ba0-bccc8aa0568d tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] 10.222.0.46 "GET /compute/v2.1/servers/3fd1fac4-6c41-4230-9eb5-4fd5a4d82c15/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 1.046787 Jan 15 20:53:53.455204 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 760/1592] 10.222.0.46 () {58 vars in 1292 bytes} [Sat Jan 15 20:53:52 2022] GET /compute/v2.1/servers/3fd1fac4-6c41-4230-9eb5-4fd5a4d82c15/os-security-groups => generated 1157 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:53:53.468620 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-81c7895e-3a47-493b-b79c-9231eb02af6a tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:53.469315 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-81c7895e-3a47-493b-b79c-9231eb02af6a tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] [instance: d94de6c9-be7d-4101-9f88-304b8a4ce8d7] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:53.477936 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 833/1593] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:53:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:53:53.489008 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-88a0f559-395e-437f-8cbe-e207bedbf113 tempest-ServersWithSpecificFlavorTestJSON-1166388665 tempest-ServersWithSpecificFlavorTestJSON-1166388665-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:53.497434 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-81c7895e-3a47-493b-b79c-9231eb02af6a tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:53.499931 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-81c7895e-3a47-493b-b79c-9231eb02af6a tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:53.500801 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-81c7895e-3a47-493b-b79c-9231eb02af6a tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:53.501266 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-81c7895e-3a47-493b-b79c-9231eb02af6a tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:53.535143 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-88a0f559-395e-437f-8cbe-e207bedbf113 tempest-ServersWithSpecificFlavorTestJSON-1166388665 tempest-ServersWithSpecificFlavorTestJSON-1166388665-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 5406 microversion: 2.1 time: 0.054658 Jan 15 20:53:53.536897 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 834/1594] 10.222.0.46 () {58 vars in 1145 bytes} [Sat Jan 15 20:53:53 2022] GET /compute/v2.1/flavors/detail => generated 5406 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:53:53.541766 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c85bfcaf-77b3-4260-9e8e-c5b4cb87b743 tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:53.543827 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c85bfcaf-77b3-4260-9e8e-c5b4cb87b743 tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] [instance: ababfa7a-a809-4151-882d-0c3038b84ee0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:53.555260 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c85bfcaf-77b3-4260-9e8e-c5b4cb87b743 tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:53.565001 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c85bfcaf-77b3-4260-9e8e-c5b4cb87b743 tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:53.566741 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c85bfcaf-77b3-4260-9e8e-c5b4cb87b743 tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:53.567509 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c85bfcaf-77b3-4260-9e8e-c5b4cb87b743 tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:54.291164 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-81c7895e-3a47-493b-b79c-9231eb02af6a tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:53:54.319915 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-81c7895e-3a47-493b-b79c-9231eb02af6a tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:53:54.321981 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-81c7895e-3a47-493b-b79c-9231eb02af6a tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:53:54.325503 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-81c7895e-3a47-493b-b79c-9231eb02af6a tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] 10.222.0.46 "GET /compute/v2.1/servers/d94de6c9-be7d-4101-9f88-304b8a4ce8d7" status: 200 len: 1481 microversion: 2.25 time: 0.868329 Jan 15 20:53:54.326363 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 761/1595] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:53:53 2022] GET /compute/v2.1/servers/d94de6c9-be7d-4101-9f88-304b8a4ce8d7 => generated 1481 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:53:54.333256 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-4d4b6650-244d-457d-b0ef-b80c069742e8 req-1ba8ebc8-9a40-4834-a1ef-92dd9d8f4ff2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1d27142-a9e4-440b-a719-d2059db11e79", "name": "network-vif-unplugged", "status": "completed", "tag": "4c6a0728-da9a-48ee-98ad-d11ebf6c8030"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:53:54.335427 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:53:54.335427 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:53:54.347849 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-4d4b6650-244d-457d-b0ef-b80c069742e8 req-1ba8ebc8-9a40-4834-a1ef-92dd9d8f4ff2 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:54.348756 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-4d4b6650-244d-457d-b0ef-b80c069742e8 req-1ba8ebc8-9a40-4834-a1ef-92dd9d8f4ff2 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:54.368719 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-4d4b6650-244d-457d-b0ef-b80c069742e8 req-1ba8ebc8-9a40-4834-a1ef-92dd9d8f4ff2 service nova] Creating event network-vif-unplugged:4c6a0728-da9a-48ee-98ad-d11ebf6c8030 for instance b1d27142-a9e4-440b-a719-d2059db11e79 on nch2-master-1 Jan 15 20:53:54.374279 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-4d4b6650-244d-457d-b0ef-b80c069742e8 req-1ba8ebc8-9a40-4834-a1ef-92dd9d8f4ff2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045456 Jan 15 20:53:54.375492 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 762/1596] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:53:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:53:54.381982 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-0ffba59c-afec-47c6-892e-f6a41f9b44dc tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Action: 'create', calling method: .version_select at 0x7f30c97cc670>, body: {"security_group": {"name": " tempest-securitygroup -2125237833 ", "description": "tempest-description-674400303"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:53:54.433386 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-c85bfcaf-77b3-4260-9e8e-c5b4cb87b743 tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68bf33c7cdd84129a5544916a7dc3410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021c66112bf49f685a34c55841857bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:53:54.447717 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c85bfcaf-77b3-4260-9e8e-c5b4cb87b743 tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] 10.222.0.46 "GET /compute/v2.1/servers/ababfa7a-a809-4151-882d-0c3038b84ee0" status: 200 len: 1514 microversion: 2.1 time: 0.909165 Jan 15 20:53:54.459309 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 835/1597] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:53:53 2022] GET /compute/v2.1/servers/ababfa7a-a809-4151-882d-0c3038b84ee0 => generated 1514 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:53:54.464344 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e4a213e9-0855-470b-ab54-35e7413b7ca2 tempest-ServersWithSpecificFlavorTestJSON-1166388665 tempest-ServersWithSpecificFlavorTestJSON-1166388665-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:54.465709 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:53:54.465709 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:53:54.488347 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e4a213e9-0855-470b-ab54-35e7413b7ca2 tempest-ServersWithSpecificFlavorTestJSON-1166388665 tempest-ServersWithSpecificFlavorTestJSON-1166388665-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/1777501818" status: 202 len: 0 microversion: 2.1 time: 0.027500 Jan 15 20:53:54.490973 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 836/1598] 10.222.0.46 () {58 vars in 1160 bytes} [Sat Jan 15 20:53:54 2022] DELETE /compute/v2.1/flavors/1777501818 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 20:53:54.504076 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-06868263-c2f9-4908-b649-44a2bb9d9302 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1141391981", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "networks": [{"uuid": "364a58d7-d200-4c35-b6bd-a666c20a1fe8"}]}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:53:54.615946 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.network.neutron [None req-06868263-c2f9-4908-b649-44a2bb9d9302 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] validate_networks() for [('364a58d7-d200-4c35-b6bd-a666c20a1fe8', None, None, None, None, None)] {{(pid=129366) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 20:53:55.458756 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-0ffba59c-afec-47c6-892e-f6a41f9b44dc tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] 10.222.0.46 "POST /compute/v2.1/os-security-groups" status: 200 len: 223 microversion: 2.1 time: 1.081575 Jan 15 20:53:55.459875 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 763/1599] 10.222.0.46 () {60 vars in 1179 bytes} [Sat Jan 15 20:53:54 2022] POST /compute/v2.1/os-security-groups => generated 223 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:53:55.467084 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-7a831a4b-7e13-4aac-b86e-a9d5bd0099a5 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:55.468398 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-7a831a4b-7e13-4aac-b86e-a9d5bd0099a5 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: d603f11b-5d49-492b-b541-1826486876ef] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:55.477123 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7a831a4b-7e13-4aac-b86e-a9d5bd0099a5 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:55.478606 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7a831a4b-7e13-4aac-b86e-a9d5bd0099a5 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:55.480386 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7a831a4b-7e13-4aac-b86e-a9d5bd0099a5 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:55.481382 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7a831a4b-7e13-4aac-b86e-a9d5bd0099a5 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:55.506710 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-7a831a4b-7e13-4aac-b86e-a9d5bd0099a5 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] HTTP exception thrown: Instance d603f11b-5d49-492b-b541-1826486876ef could not be found. Jan 15 20:53:55.510353 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-7a831a4b-7e13-4aac-b86e-a9d5bd0099a5 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Returning 404 to user: Instance d603f11b-5d49-492b-b541-1826486876ef could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:53:55.511568 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-7a831a4b-7e13-4aac-b86e-a9d5bd0099a5 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/d603f11b-5d49-492b-b541-1826486876ef" status: 404 len: 111 microversion: 2.1 time: 0.050182 Jan 15 20:53:55.516931 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 764/1600] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:53:55 2022] GET /compute/v2.1/servers/d603f11b-5d49-492b-b541-1826486876ef => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:53:55.523664 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-afbdbd5e-5bb5-4e03-ac5a-113e6c277355 tempest-ServersWithSpecificFlavorTestJSON-1166388665 tempest-ServersWithSpecificFlavorTestJSON-1166388665-project-admin] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:55.551986 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-afbdbd5e-5bb5-4e03-ac5a-113e6c277355 tempest-ServersWithSpecificFlavorTestJSON-1166388665 tempest-ServersWithSpecificFlavorTestJSON-1166388665-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.033839 Jan 15 20:53:55.552588 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 765/1601] 10.222.0.46 () {58 vars in 1145 bytes} [Sat Jan 15 20:53:55 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:53:55.557400 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-d7787c82-7718-4dd4-aad4-2499f6adac13 req-2b54bba6-5fd3-4fcb-9848-d04e4f7eeb4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d94de6c9-be7d-4101-9f88-304b8a4ce8d7", "name": "network-vif-deleted", "tag": "9ae7fa8e-01aa-4321-8949-4398f2fc1b57"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:53:55.559173 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:53:55.559173 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:53:55.580050 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-d7787c82-7718-4dd4-aad4-2499f6adac13 req-2b54bba6-5fd3-4fcb-9848-d04e4f7eeb4d service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:55.580756 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-d7787c82-7718-4dd4-aad4-2499f6adac13 req-2b54bba6-5fd3-4fcb-9848-d04e4f7eeb4d service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:55.604276 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-d7787c82-7718-4dd4-aad4-2499f6adac13 req-2b54bba6-5fd3-4fcb-9848-d04e4f7eeb4d service nova] Creating event network-vif-deleted:9ae7fa8e-01aa-4321-8949-4398f2fc1b57 for instance d94de6c9-be7d-4101-9f88-304b8a4ce8d7 on nch2-master-1 Jan 15 20:53:55.614598 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-d7787c82-7718-4dd4-aad4-2499f6adac13 req-2b54bba6-5fd3-4fcb-9848-d04e4f7eeb4d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060462 Jan 15 20:53:55.615789 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 766/1602] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:53:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:53:55.620803 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-0228f5a0-760f-4f7f-984c-9ee938f429a1 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:55.626156 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-0228f5a0-760f-4f7f-984c-9ee938f429a1 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] [instance: d94de6c9-be7d-4101-9f88-304b8a4ce8d7] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:55.641090 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0228f5a0-760f-4f7f-984c-9ee938f429a1 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:55.646531 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0228f5a0-760f-4f7f-984c-9ee938f429a1 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:55.649780 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0228f5a0-760f-4f7f-984c-9ee938f429a1 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:55.650484 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0228f5a0-760f-4f7f-984c-9ee938f429a1 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:55.671054 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-0228f5a0-760f-4f7f-984c-9ee938f429a1 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] HTTP exception thrown: Instance d94de6c9-be7d-4101-9f88-304b8a4ce8d7 could not be found. Jan 15 20:53:55.672196 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-0228f5a0-760f-4f7f-984c-9ee938f429a1 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Returning 404 to user: Instance d94de6c9-be7d-4101-9f88-304b8a4ce8d7 could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:53:55.673335 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-0228f5a0-760f-4f7f-984c-9ee938f429a1 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] 10.222.0.46 "GET /compute/v2.1/servers/d94de6c9-be7d-4101-9f88-304b8a4ce8d7" status: 404 len: 111 microversion: 2.25 time: 0.056301 Jan 15 20:53:55.674553 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 767/1603] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:53:55 2022] GET /compute/v2.1/servers/d94de6c9-be7d-4101-9f88-304b8a4ce8d7 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 15 20:53:55.680280 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f64b2ff1-e610-4f83-8e45-97d0d14a2997 tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:55.683093 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f64b2ff1-e610-4f83-8e45-97d0d14a2997 tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] [instance: ababfa7a-a809-4151-882d-0c3038b84ee0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:55.692077 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f64b2ff1-e610-4f83-8e45-97d0d14a2997 tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:55.692893 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f64b2ff1-e610-4f83-8e45-97d0d14a2997 tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:55.693956 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f64b2ff1-e610-4f83-8e45-97d0d14a2997 tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:55.694626 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f64b2ff1-e610-4f83-8e45-97d0d14a2997 tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:55.771256 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f64b2ff1-e610-4f83-8e45-97d0d14a2997 tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:55.772898 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f64b2ff1-e610-4f83-8e45-97d0d14a2997 tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:55.773723 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.objects.instance [None req-f64b2ff1-e610-4f83-8e45-97d0d14a2997 tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] Lazy-loading 'fault' on Instance uuid ababfa7a-a809-4151-882d-0c3038b84ee0 {{(pid=129365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 20:53:55.913650 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-f64b2ff1-e610-4f83-8e45-97d0d14a2997 tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68bf33c7cdd84129a5544916a7dc3410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021c66112bf49f685a34c55841857bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:53:55.927735 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f64b2ff1-e610-4f83-8e45-97d0d14a2997 tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] 10.222.0.46 "GET /compute/v2.1/servers/ababfa7a-a809-4151-882d-0c3038b84ee0" status: 200 len: 1308 microversion: 2.1 time: 0.251677 Jan 15 20:53:55.928523 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 768/1604] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:53:55 2022] GET /compute/v2.1/servers/ababfa7a-a809-4151-882d-0c3038b84ee0 => generated 1308 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:53:55.934444 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c7766465-97f3-42c2-9e19-689e77da2cdf tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Calling method '.version_select at 0x7f30c972b9d0>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:56.170057 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c7766465-97f3-42c2-9e19-689e77da2cdf tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] 10.222.0.46 "GET /compute/v2.1/os-security-groups/e0f75dca-2a13-47e2-b483-39719ff6eae9" status: 200 len: 223 microversion: 2.1 time: 0.240345 Jan 15 20:53:56.172804 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 769/1605] 10.222.0.46 () {58 vars in 1268 bytes} [Sat Jan 15 20:53:55 2022] GET /compute/v2.1/os-security-groups/e0f75dca-2a13-47e2-b483-39719ff6eae9 => generated 223 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:53:56.184570 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f7dbcb52-3b33-43b5-932d-5528dfe4a41c tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:56.185115 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f7dbcb52-3b33-43b5-932d-5528dfe4a41c tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: e3fa2f27-df7a-4ecb-9bba-c970e3e7d106] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:56.204059 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f7dbcb52-3b33-43b5-932d-5528dfe4a41c tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:56.204391 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f7dbcb52-3b33-43b5-932d-5528dfe4a41c tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:56.205281 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f7dbcb52-3b33-43b5-932d-5528dfe4a41c tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:56.208799 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f7dbcb52-3b33-43b5-932d-5528dfe4a41c tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:56.262930 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-06868263-c2f9-4908-b649-44a2bb9d9302 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Flavor limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 20:53:56.263546 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-06868263-c2f9-4908-b649-44a2bb9d9302 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Image limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 20:53:56.263922 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-06868263-c2f9-4908-b649-44a2bb9d9302 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Flavor pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 20:53:56.264573 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-06868263-c2f9-4908-b649-44a2bb9d9302 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Image pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 20:53:56.265110 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-06868263-c2f9-4908-b649-44a2bb9d9302 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 20:53:56.321722 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f7dbcb52-3b33-43b5-932d-5528dfe4a41c tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: e3fa2f27-df7a-4ecb-9bba-c970e3e7d106] Going to try to terminate instance {{(pid=129365) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 20:53:56.326172 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-06868263-c2f9-4908-b649-44a2bb9d9302 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:56.326642 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-06868263-c2f9-4908-b649-44a2bb9d9302 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:56.327781 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-06868263-c2f9-4908-b649-44a2bb9d9302 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:56.328247 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-06868263-c2f9-4908-b649-44a2bb9d9302 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:56.409658 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-06868263-c2f9-4908-b649-44a2bb9d9302 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Getting quotas for project 31dd217e7fd648b4a78c0c32ff1c95f4. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:53:56.429140 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-06868263-c2f9-4908-b649-44a2bb9d9302 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Getting quotas for user b55be87ae7f14b499ab2cd6fc5538988 and project 31dd217e7fd648b4a78c0c32ff1c95f4. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:53:56.478637 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-06868263-c2f9-4908-b649-44a2bb9d9302 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Going to run 1 instances... {{(pid=129366) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 20:53:56.481286 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-06868263-c2f9-4908-b649-44a2bb9d9302 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] [instance: eec0d897-b487-4021-8cc1-b94824339dc4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 20:53:56.576018 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f7dbcb52-3b33-43b5-932d-5528dfe4a41c tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "DELETE /compute/v2.1/servers/e3fa2f27-df7a-4ecb-9bba-c970e3e7d106" status: 204 len: 0 microversion: 2.1 time: 0.399477 Jan 15 20:53:56.581988 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 770/1606] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 20:53:56 2022] DELETE /compute/v2.1/servers/e3fa2f27-df7a-4ecb-9bba-c970e3e7d106 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 20:53:56.607530 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-123baf07-7081-4510-90f4-a99330a854f5 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:56.612268 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-123baf07-7081-4510-90f4-a99330a854f5 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 57bd310f-a604-40de-9c25-882284f4a17b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:56.619312 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-06868263-c2f9-4908-b649-44a2bb9d9302 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.126778 Jan 15 20:53:56.623870 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 837/1607] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 20:53:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 2129 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 20:53:56.638581 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-123baf07-7081-4510-90f4-a99330a854f5 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:56.640134 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-123baf07-7081-4510-90f4-a99330a854f5 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:56.640299 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-833c2993-2502-4ba0-a3e3-15e724724e50 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Calling method '.version_select at 0x7f30c923e4c0>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:56.645543 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-123baf07-7081-4510-90f4-a99330a854f5 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:56.647618 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-123baf07-7081-4510-90f4-a99330a854f5 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:56.695101 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-123baf07-7081-4510-90f4-a99330a854f5 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] HTTP exception thrown: Instance 57bd310f-a604-40de-9c25-882284f4a17b could not be found. Jan 15 20:53:56.696207 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-123baf07-7081-4510-90f4-a99330a854f5 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Returning 404 to user: Instance 57bd310f-a604-40de-9c25-882284f4a17b could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:53:56.697450 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-123baf07-7081-4510-90f4-a99330a854f5 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "DELETE /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b" status: 404 len: 111 microversion: 2.1 time: 0.113977 Jan 15 20:53:56.698631 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 771/1608] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 20:53:56 2022] DELETE /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:53:56.707356 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-69ca9b5d-3113-4528-b3df-d54f4c4412c7 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:56.708336 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-69ca9b5d-3113-4528-b3df-d54f4c4412c7 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: e3fa2f27-df7a-4ecb-9bba-c970e3e7d106] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:56.728775 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-69ca9b5d-3113-4528-b3df-d54f4c4412c7 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:56.730727 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-69ca9b5d-3113-4528-b3df-d54f4c4412c7 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:56.735864 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-69ca9b5d-3113-4528-b3df-d54f4c4412c7 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:56.736634 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-69ca9b5d-3113-4528-b3df-d54f4c4412c7 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:57.147921 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-69ca9b5d-3113-4528-b3df-d54f4c4412c7 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:53:57.159647 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-69ca9b5d-3113-4528-b3df-d54f4c4412c7 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/e3fa2f27-df7a-4ecb-9bba-c970e3e7d106" status: 200 len: 1468 microversion: 2.1 time: 0.458723 Jan 15 20:53:57.166600 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-833c2993-2502-4ba0-a3e3-15e724724e50 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/e0f75dca-2a13-47e2-b483-39719ff6eae9" status: 202 len: 0 microversion: 2.1 time: 0.544098 Jan 15 20:53:57.167451 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 838/1609] 10.222.0.46 () {58 vars in 1271 bytes} [Sat Jan 15 20:53:56 2022] DELETE /compute/v2.1/os-security-groups/e0f75dca-2a13-47e2-b483-39719ff6eae9 => generated 0 bytes in 546 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 20:53:57.175692 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 772/1610] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:53:56 2022] GET /compute/v2.1/servers/e3fa2f27-df7a-4ecb-9bba-c970e3e7d106 => generated 1468 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:53:57.189793 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-fa0dc402-359d-4dc9-9602-b35b194e46bb tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:57.190190 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-fa0dc402-359d-4dc9-9602-b35b194e46bb tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] [instance: eec0d897-b487-4021-8cc1-b94824339dc4] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:57.263571 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-fd34906f-42b5-4092-9a57-b02e591bf1ca tempest-FloatingIPDetailsNegativeTestJSON-1773501939 tempest-FloatingIPDetailsNegativeTestJSON-1773501939-project] Calling method '.version_select at 0x7f30c8f13f70>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:57.299109 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-fa0dc402-359d-4dc9-9602-b35b194e46bb tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55be87ae7f14b499ab2cd6fc5538988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd217e7fd648b4a78c0c32ff1c95f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:53:57.306168 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-fa0dc402-359d-4dc9-9602-b35b194e46bb tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "GET /compute/v2.1/servers/eec0d897-b487-4021-8cc1-b94824339dc4" status: 200 len: 1208 microversion: 2.1 time: 0.129369 Jan 15 20:53:57.309171 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 773/1611] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:53:57 2022] GET /compute/v2.1/servers/eec0d897-b487-4021-8cc1-b94824339dc4 => generated 1208 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:53:57.319222 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f7a6c60b-cdf1-4220-aae6-9e58a8568229 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:57.319993 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f7a6c60b-cdf1-4220-aae6-9e58a8568229 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 57bd310f-a604-40de-9c25-882284f4a17b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:57.361537 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f7a6c60b-cdf1-4220-aae6-9e58a8568229 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:57.361932 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f7a6c60b-cdf1-4220-aae6-9e58a8568229 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:57.362781 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f7a6c60b-cdf1-4220-aae6-9e58a8568229 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:57.363218 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f7a6c60b-cdf1-4220-aae6-9e58a8568229 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:57.413923 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-f7a6c60b-cdf1-4220-aae6-9e58a8568229 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] HTTP exception thrown: Instance 57bd310f-a604-40de-9c25-882284f4a17b could not be found. Jan 15 20:53:57.416110 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f7a6c60b-cdf1-4220-aae6-9e58a8568229 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Returning 404 to user: Instance 57bd310f-a604-40de-9c25-882284f4a17b could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:53:57.418178 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f7a6c60b-cdf1-4220-aae6-9e58a8568229 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "GET /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b" status: 404 len: 111 microversion: 2.1 time: 0.106881 Jan 15 20:53:57.419239 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 774/1612] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:53:57 2022] GET /compute/v2.1/servers/57bd310f-a604-40de-9c25-882284f4a17b => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:53:57.429687 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3387ec51-3d12-44e5-b5d2-f3c7f667f6c1 tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:57.431154 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-3387ec51-3d12-44e5-b5d2-f3c7f667f6c1 tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] [instance: ababfa7a-a809-4151-882d-0c3038b84ee0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:57.434696 ncdv-master-1 devstack@n-api.service[129366]: DEBUG neutronclient.v2_0.client [None req-fd34906f-42b5-4092-9a57-b02e591bf1ca tempest-FloatingIPDetailsNegativeTestJSON-1773501939 tempest-FloatingIPDetailsNegativeTestJSON-1773501939-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 9a8e761a-0bf4-4c24-8fd4-1d6cd05c527c could not be found", "detail": ""}} {{(pid=129366) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jan 15 20:53:57.435920 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-fd34906f-42b5-4092-9a57-b02e591bf1ca tempest-FloatingIPDetailsNegativeTestJSON-1773501939 tempest-FloatingIPDetailsNegativeTestJSON-1773501939-project] HTTP exception thrown: Floating IP not found for ID 9a8e761a-0bf4-4c24-8fd4-1d6cd05c527c Jan 15 20:53:57.436895 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-fd34906f-42b5-4092-9a57-b02e591bf1ca tempest-FloatingIPDetailsNegativeTestJSON-1773501939 tempest-FloatingIPDetailsNegativeTestJSON-1773501939-project] Returning 404 to user: Floating IP not found for ID 9a8e761a-0bf4-4c24-8fd4-1d6cd05c527c {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:53:57.438263 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-fd34906f-42b5-4092-9a57-b02e591bf1ca tempest-FloatingIPDetailsNegativeTestJSON-1773501939 tempest-FloatingIPDetailsNegativeTestJSON-1773501939-project] 10.222.0.46 "GET /compute/v2.1/os-floating-ips/9a8e761a-0bf4-4c24-8fd4-1d6cd05c527c" status: 404 len: 111 microversion: 2.1 time: 0.269431 Jan 15 20:53:57.439046 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 839/1613] 10.222.0.46 () {58 vars in 1259 bytes} [Sat Jan 15 20:53:57 2022] GET /compute/v2.1/os-floating-ips/9a8e761a-0bf4-4c24-8fd4-1d6cd05c527c => generated 111 bytes in 271 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:53:57.440109 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3387ec51-3d12-44e5-b5d2-f3c7f667f6c1 tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:57.440978 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3387ec51-3d12-44e5-b5d2-f3c7f667f6c1 tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:57.442044 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3387ec51-3d12-44e5-b5d2-f3c7f667f6c1 tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:57.442878 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3387ec51-3d12-44e5-b5d2-f3c7f667f6c1 tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:57.449713 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-2f96da9e-276a-4f5a-a757-e17e7c73baf1 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:57.456956 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-2f96da9e-276a-4f5a-a757-e17e7c73baf1 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] [instance: 42618a48-fe11-4f55-bed2-738d2cc8a07f] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:57.461516 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-3387ec51-3d12-44e5-b5d2-f3c7f667f6c1 tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] HTTP exception thrown: Instance ababfa7a-a809-4151-882d-0c3038b84ee0 could not be found. Jan 15 20:53:57.462310 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3387ec51-3d12-44e5-b5d2-f3c7f667f6c1 tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] Returning 404 to user: Instance ababfa7a-a809-4151-882d-0c3038b84ee0 could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:53:57.463294 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3387ec51-3d12-44e5-b5d2-f3c7f667f6c1 tempest-VolumesAdminNegativeTest-1682858856 tempest-VolumesAdminNegativeTest-1682858856-project] 10.222.0.46 "GET /compute/v2.1/servers/ababfa7a-a809-4151-882d-0c3038b84ee0" status: 404 len: 111 microversion: 2.1 time: 0.042934 Jan 15 20:53:57.468412 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 775/1614] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:53:57 2022] GET /compute/v2.1/servers/ababfa7a-a809-4151-882d-0c3038b84ee0 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:53:57.475104 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-cbd86dbf-8840-411c-86dc-489bf4d64ae1 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Calling method '.version_select at 0x7f30c972b9d0>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:57.485918 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2f96da9e-276a-4f5a-a757-e17e7c73baf1 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:57.486644 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2f96da9e-276a-4f5a-a757-e17e7c73baf1 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:57.488339 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2f96da9e-276a-4f5a-a757-e17e7c73baf1 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:57.491537 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2f96da9e-276a-4f5a-a757-e17e7c73baf1 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:57.574144 ncdv-master-1 devstack@n-api.service[129365]: DEBUG neutronclient.v2_0.client [None req-cbd86dbf-8840-411c-86dc-489bf4d64ae1 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group e0f75dca-2a13-47e2-b483-39719ff6eae9 does not exist", "detail": ""}} {{(pid=129365) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jan 15 20:53:57.574754 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.network.security_group_api [None req-cbd86dbf-8840-411c-86dc-489bf4d64ae1 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Neutron security group e0f75dca-2a13-47e2-b483-39719ff6eae9 not found {{(pid=129365) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jan 15 20:53:57.575300 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-cbd86dbf-8840-411c-86dc-489bf4d64ae1 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] HTTP exception thrown: Security group e0f75dca-2a13-47e2-b483-39719ff6eae9 does not exist Jan 15 20:53:57.575300 ncdv-master-1 devstack@n-api.service[129365]: Neutron server returns request_ids: ['req-eeafd558-6a85-4f86-8f71-0dffd7fd57a1'] Jan 15 20:53:57.576247 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-cbd86dbf-8840-411c-86dc-489bf4d64ae1 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Returning 404 to user: Security group e0f75dca-2a13-47e2-b483-39719ff6eae9 does not exist Jan 15 20:53:57.576247 ncdv-master-1 devstack@n-api.service[129365]: Neutron server returns request_ids: ['req-eeafd558-6a85-4f86-8f71-0dffd7fd57a1'] {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:53:57.578522 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-cbd86dbf-8840-411c-86dc-489bf4d64ae1 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] 10.222.0.46 "GET /compute/v2.1/os-security-groups/e0f75dca-2a13-47e2-b483-39719ff6eae9" status: 404 len: 194 microversion: 2.1 time: 0.108351 Jan 15 20:53:57.579577 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 776/1615] 10.222.0.46 () {58 vars in 1268 bytes} [Sat Jan 15 20:53:57 2022] GET /compute/v2.1/os-security-groups/e0f75dca-2a13-47e2-b483-39719ff6eae9 => generated 194 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:53:57.588190 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-0f00e7cc-93fb-4a2e-8987-76f4484eb5e9 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:57.588694 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-0f00e7cc-93fb-4a2e-8987-76f4484eb5e9 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 98d0ca37-0175-44e2-8a1d-965cdc517daf] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:57.609357 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0f00e7cc-93fb-4a2e-8987-76f4484eb5e9 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:57.610425 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0f00e7cc-93fb-4a2e-8987-76f4484eb5e9 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:57.614754 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0f00e7cc-93fb-4a2e-8987-76f4484eb5e9 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:57.615461 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0f00e7cc-93fb-4a2e-8987-76f4484eb5e9 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:57.634362 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-2f96da9e-276a-4f5a-a757-e17e7c73baf1 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] [instance: 42618a48-fe11-4f55-bed2-738d2cc8a07f] Going to try to terminate instance {{(pid=129366) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 20:53:57.663714 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-0f00e7cc-93fb-4a2e-8987-76f4484eb5e9 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] HTTP exception thrown: Instance 98d0ca37-0175-44e2-8a1d-965cdc517daf could not be found. Jan 15 20:53:57.664606 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-0f00e7cc-93fb-4a2e-8987-76f4484eb5e9 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Returning 404 to user: Instance 98d0ca37-0175-44e2-8a1d-965cdc517daf could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:53:57.666294 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-0f00e7cc-93fb-4a2e-8987-76f4484eb5e9 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "DELETE /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf" status: 404 len: 111 microversion: 2.1 time: 0.084812 Jan 15 20:53:57.670770 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 777/1616] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 20:53:57 2022] DELETE /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:53:57.681627 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-1a9a5d89-b83d-4519-836f-a16f78d2085e tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Action: 'create', calling method: .version_select at 0x7f30c9c085e0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1694135826", "description": "tempest-description-1658483830"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:53:57.893911 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-2f96da9e-276a-4f5a-a757-e17e7c73baf1 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] 10.222.0.46 "DELETE /compute/v2.1/servers/42618a48-fe11-4f55-bed2-738d2cc8a07f" status: 204 len: 0 microversion: 2.25 time: 0.451317 Jan 15 20:53:57.895064 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 840/1617] 10.222.0.46 () {60 vars in 1279 bytes} [Sat Jan 15 20:53:57 2022] DELETE /compute/v2.1/servers/42618a48-fe11-4f55-bed2-738d2cc8a07f => generated 0 bytes in 455 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 15 20:53:57.901480 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0cb2421f-b108-4368-ba26-db3f0de9b0c5 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:57.904321 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-0cb2421f-b108-4368-ba26-db3f0de9b0c5 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] [instance: 98d0ca37-0175-44e2-8a1d-965cdc517daf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:57.911717 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0cb2421f-b108-4368-ba26-db3f0de9b0c5 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:57.912426 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0cb2421f-b108-4368-ba26-db3f0de9b0c5 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:57.913447 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0cb2421f-b108-4368-ba26-db3f0de9b0c5 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:57.914533 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0cb2421f-b108-4368-ba26-db3f0de9b0c5 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:57.932385 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-0cb2421f-b108-4368-ba26-db3f0de9b0c5 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] HTTP exception thrown: Instance 98d0ca37-0175-44e2-8a1d-965cdc517daf could not be found. Jan 15 20:53:57.933279 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0cb2421f-b108-4368-ba26-db3f0de9b0c5 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] Returning 404 to user: Instance 98d0ca37-0175-44e2-8a1d-965cdc517daf could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:53:57.934262 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0cb2421f-b108-4368-ba26-db3f0de9b0c5 tempest-ServersWithSpecificFlavorTestJSON-1717223005 tempest-ServersWithSpecificFlavorTestJSON-1717223005-project] 10.222.0.46 "GET /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf" status: 404 len: 111 microversion: 2.1 time: 0.037052 Jan 15 20:53:57.935298 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 841/1618] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:53:57 2022] GET /compute/v2.1/servers/98d0ca37-0175-44e2-8a1d-965cdc517daf => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:53:57.940556 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-0595a94b-77e7-4b5e-8310-93bbfa5c9a0b req-c3fa2452-4da9-4f5e-8dc8-1c140411067e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ababfa7a-a809-4151-882d-0c3038b84ee0", "name": "network-vif-deleted", "tag": "2a9f43b8-de6a-4b89-898a-8021a4807d97"}, {"server_uuid": "b1d27142-a9e4-440b-a719-d2059db11e79", "name": "network-vif-deleted", "tag": "4c6a0728-da9a-48ee-98ad-d11ebf6c8030"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:53:57.942567 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:53:57.942567 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:53:57.959425 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-0595a94b-77e7-4b5e-8310-93bbfa5c9a0b req-c3fa2452-4da9-4f5e-8dc8-1c140411067e service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:57.960213 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-0595a94b-77e7-4b5e-8310-93bbfa5c9a0b req-c3fa2452-4da9-4f5e-8dc8-1c140411067e service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:57.992207 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-0595a94b-77e7-4b5e-8310-93bbfa5c9a0b req-c3fa2452-4da9-4f5e-8dc8-1c140411067e service nova] Creating event network-vif-deleted:2a9f43b8-de6a-4b89-898a-8021a4807d97 for instance ababfa7a-a809-4151-882d-0c3038b84ee0 on nch2-master-1 Jan 15 20:53:57.993639 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-0595a94b-77e7-4b5e-8310-93bbfa5c9a0b req-c3fa2452-4da9-4f5e-8dc8-1c140411067e service nova] Creating event network-vif-deleted:4c6a0728-da9a-48ee-98ad-d11ebf6c8030 for instance b1d27142-a9e4-440b-a719-d2059db11e79 on nch2-master-1 Jan 15 20:53:58.004874 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-0595a94b-77e7-4b5e-8310-93bbfa5c9a0b req-c3fa2452-4da9-4f5e-8dc8-1c140411067e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.067250 Jan 15 20:53:58.006544 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 842/1619] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:53:57 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:53:58.013552 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0bc4e0c7-b301-48cb-a0f3-01d3b5c4c712 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:58.014745 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-0bc4e0c7-b301-48cb-a0f3-01d3b5c4c712 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] [instance: 42618a48-fe11-4f55-bed2-738d2cc8a07f] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:58.023728 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0bc4e0c7-b301-48cb-a0f3-01d3b5c4c712 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:58.024357 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0bc4e0c7-b301-48cb-a0f3-01d3b5c4c712 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:58.025767 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0bc4e0c7-b301-48cb-a0f3-01d3b5c4c712 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:58.026363 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0bc4e0c7-b301-48cb-a0f3-01d3b5c4c712 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:58.611910 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-1a9a5d89-b83d-4519-836f-a16f78d2085e tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] 10.222.0.46 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.939653 Jan 15 20:53:58.613605 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 778/1620] 10.222.0.46 () {60 vars in 1179 bytes} [Sat Jan 15 20:53:57 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:53:58.623537 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9a33848f-6fa9-4805-a905-564dc7383491 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:58.625968 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-9a33848f-6fa9-4805-a905-564dc7383491 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: e3fa2f27-df7a-4ecb-9bba-c970e3e7d106] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:58.641011 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9a33848f-6fa9-4805-a905-564dc7383491 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:58.642211 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9a33848f-6fa9-4805-a905-564dc7383491 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:58.643143 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9a33848f-6fa9-4805-a905-564dc7383491 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:58.643521 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9a33848f-6fa9-4805-a905-564dc7383491 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:58.801969 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-0bc4e0c7-b301-48cb-a0f3-01d3b5c4c712 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:53:58.814689 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-0bc4e0c7-b301-48cb-a0f3-01d3b5c4c712 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:53:58.818365 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-0bc4e0c7-b301-48cb-a0f3-01d3b5c4c712 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:53:58.819903 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0bc4e0c7-b301-48cb-a0f3-01d3b5c4c712 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] 10.222.0.46 "GET /compute/v2.1/servers/42618a48-fe11-4f55-bed2-738d2cc8a07f" status: 200 len: 1563 microversion: 2.25 time: 0.812092 Jan 15 20:53:58.822622 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 843/1621] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:53:58 2022] GET /compute/v2.1/servers/42618a48-fe11-4f55-bed2-738d2cc8a07f => generated 1563 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:53:58.845556 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-71dcb5af-1ce0-4e59-b809-445322430d61 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:58.849114 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-71dcb5af-1ce0-4e59-b809-445322430d61 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] [instance: eec0d897-b487-4021-8cc1-b94824339dc4] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:58.860568 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-71dcb5af-1ce0-4e59-b809-445322430d61 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:58.864505 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-71dcb5af-1ce0-4e59-b809-445322430d61 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:58.865739 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-71dcb5af-1ce0-4e59-b809-445322430d61 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:58.875008 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-71dcb5af-1ce0-4e59-b809-445322430d61 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:59.009640 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-71dcb5af-1ce0-4e59-b809-445322430d61 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55be87ae7f14b499ab2cd6fc5538988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd217e7fd648b4a78c0c32ff1c95f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:53:59.021818 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-71dcb5af-1ce0-4e59-b809-445322430d61 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "GET /compute/v2.1/servers/eec0d897-b487-4021-8cc1-b94824339dc4" status: 200 len: 1278 microversion: 2.1 time: 0.187361 Jan 15 20:53:59.022682 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 844/1622] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:53:58 2022] GET /compute/v2.1/servers/eec0d897-b487-4021-8cc1-b94824339dc4 => generated 1278 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:53:59.030669 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f8dcd39a-e95e-44e2-9cdd-37fe2c9cdc23 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Action: 'create', calling method: .version_select at 0x7f30c8f133a0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1311249221", "description": "tempest-description-1333532371"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:53:59.634588 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-9a33848f-6fa9-4805-a905-564dc7383491 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:53:59.647788 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-9a33848f-6fa9-4805-a905-564dc7383491 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/e3fa2f27-df7a-4ecb-9bba-c970e3e7d106" status: 200 len: 1468 microversion: 2.1 time: 1.032021 Jan 15 20:53:59.648429 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 779/1623] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:53:58 2022] GET /compute/v2.1/servers/e3fa2f27-df7a-4ecb-9bba-c970e3e7d106 => generated 1468 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:53:59.845677 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-bbc89920-bf98-401f-80ce-2d7a7a39c4e5 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:53:59.846331 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-bbc89920-bf98-401f-80ce-2d7a7a39c4e5 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] [instance: 42618a48-fe11-4f55-bed2-738d2cc8a07f] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:53:59.859402 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bbc89920-bf98-401f-80ce-2d7a7a39c4e5 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:59.866191 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bbc89920-bf98-401f-80ce-2d7a7a39c4e5 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:53:59.867434 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bbc89920-bf98-401f-80ce-2d7a7a39c4e5 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:53:59.867910 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bbc89920-bf98-401f-80ce-2d7a7a39c4e5 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:00.091081 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f8dcd39a-e95e-44e2-9cdd-37fe2c9cdc23 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] 10.222.0.46 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 1.066487 Jan 15 20:54:00.099354 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 845/1624] 10.222.0.46 () {60 vars in 1179 bytes} [Sat Jan 15 20:53:59 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:54:00.099354 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-baf2b479-c2f2-4ad5-90ab-81e9f81226ff tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:00.100075 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-baf2b479-c2f2-4ad5-90ab-81e9f81226ff tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] [instance: eec0d897-b487-4021-8cc1-b94824339dc4] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:00.128965 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-baf2b479-c2f2-4ad5-90ab-81e9f81226ff tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:00.129424 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-baf2b479-c2f2-4ad5-90ab-81e9f81226ff tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:00.130247 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-baf2b479-c2f2-4ad5-90ab-81e9f81226ff tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:00.130673 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-baf2b479-c2f2-4ad5-90ab-81e9f81226ff tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:00.370296 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-baf2b479-c2f2-4ad5-90ab-81e9f81226ff tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55be87ae7f14b499ab2cd6fc5538988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd217e7fd648b4a78c0c32ff1c95f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:00.397290 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-baf2b479-c2f2-4ad5-90ab-81e9f81226ff tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "GET /compute/v2.1/servers/eec0d897-b487-4021-8cc1-b94824339dc4" status: 200 len: 1266 microversion: 2.1 time: 0.304454 Jan 15 20:54:00.409099 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 846/1625] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:54:00 2022] GET /compute/v2.1/servers/eec0d897-b487-4021-8cc1-b94824339dc4 => generated 1266 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:54:00.415036 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-6dd6be4e-864b-4893-8233-1c2d7a7736bb tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Action: 'create', calling method: .version_select at 0x7f30c9289280>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2018337995", "description": "tempest-description-11370684"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:54:00.493944 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-bbc89920-bf98-401f-80ce-2d7a7a39c4e5 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:00.512415 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-bbc89920-bf98-401f-80ce-2d7a7a39c4e5 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:00.514082 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-bbc89920-bf98-401f-80ce-2d7a7a39c4e5 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:00.517983 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-bbc89920-bf98-401f-80ce-2d7a7a39c4e5 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] 10.222.0.46 "GET /compute/v2.1/servers/42618a48-fe11-4f55-bed2-738d2cc8a07f" status: 200 len: 1563 microversion: 2.25 time: 0.681946 Jan 15 20:54:00.540062 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 780/1626] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:53:59 2022] GET /compute/v2.1/servers/42618a48-fe11-4f55-bed2-738d2cc8a07f => generated 1563 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:54:00.545988 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-a3c53630-85ff-46c9-ab62-4a54b18b8c55 req-f48ac801-4bdf-4bfd-aed5-1dafbe6b4a27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3fa2f27-df7a-4ecb-9bba-c970e3e7d106", "name": "network-vif-deleted", "tag": "3c8e5ec9-ee60-4c8e-b5ce-d77245088af1"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:54:00.556628 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:54:00.556628 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:54:00.590672 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-a3c53630-85ff-46c9-ab62-4a54b18b8c55 req-f48ac801-4bdf-4bfd-aed5-1dafbe6b4a27 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:00.591046 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-a3c53630-85ff-46c9-ab62-4a54b18b8c55 req-f48ac801-4bdf-4bfd-aed5-1dafbe6b4a27 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:00.641369 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-a3c53630-85ff-46c9-ab62-4a54b18b8c55 req-f48ac801-4bdf-4bfd-aed5-1dafbe6b4a27 service nova] Creating event network-vif-deleted:3c8e5ec9-ee60-4c8e-b5ce-d77245088af1 for instance e3fa2f27-df7a-4ecb-9bba-c970e3e7d106 on nch1-master-1 Jan 15 20:54:00.655067 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-a3c53630-85ff-46c9-ab62-4a54b18b8c55 req-f48ac801-4bdf-4bfd-aed5-1dafbe6b4a27 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113277 Jan 15 20:54:00.655686 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 781/1627] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:54:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:54:00.691027 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-677d9dac-8f3a-4406-a02c-f3612e6aa537 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:00.696694 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-677d9dac-8f3a-4406-a02c-f3612e6aa537 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: e3fa2f27-df7a-4ecb-9bba-c970e3e7d106] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:00.724981 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-677d9dac-8f3a-4406-a02c-f3612e6aa537 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:00.725279 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-677d9dac-8f3a-4406-a02c-f3612e6aa537 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:00.726091 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-677d9dac-8f3a-4406-a02c-f3612e6aa537 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:00.726534 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-677d9dac-8f3a-4406-a02c-f3612e6aa537 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:00.805723 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-6dd6be4e-864b-4893-8233-1c2d7a7736bb tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] 10.222.0.46 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.395066 Jan 15 20:54:00.806691 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 847/1628] 10.222.0.46 () {60 vars in 1179 bytes} [Sat Jan 15 20:54:00 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:54:00.825307 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-cea3bc54-890d-47f6-81d4-9d56f65296e2 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Calling method '.version_select at 0x7f30c8ec9790>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:00.860028 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-677d9dac-8f3a-4406-a02c-f3612e6aa537 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:00.861051 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-677d9dac-8f3a-4406-a02c-f3612e6aa537 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:00.885997 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.objects.instance [None req-677d9dac-8f3a-4406-a02c-f3612e6aa537 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lazy-loading 'fault' on Instance uuid e3fa2f27-df7a-4ecb-9bba-c970e3e7d106 {{(pid=129365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 20:54:01.026097 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-677d9dac-8f3a-4406-a02c-f3612e6aa537 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:01.039068 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-677d9dac-8f3a-4406-a02c-f3612e6aa537 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/e3fa2f27-df7a-4ecb-9bba-c970e3e7d106" status: 200 len: 1303 microversion: 2.1 time: 0.370266 Jan 15 20:54:01.041737 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 782/1629] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:54:00 2022] GET /compute/v2.1/servers/e3fa2f27-df7a-4ecb-9bba-c970e3e7d106 => generated 1303 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:54:01.301971 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-cea3bc54-890d-47f6-81d4-9d56f65296e2 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] 10.222.0.46 "GET /compute/v2.1/os-security-groups" status: 200 len: 1833 microversion: 2.1 time: 0.483360 Jan 15 20:54:01.302547 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 848/1630] 10.222.0.46 () {58 vars in 1157 bytes} [Sat Jan 15 20:54:00 2022] GET /compute/v2.1/os-security-groups => generated 1833 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:54:01.314896 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-1497ab89-28ba-4efa-8577-baab5076a638 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Calling method '.version_select at 0x7f30c972bdc0>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:01.415447 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-fe811ab4-8255-4644-9d44-85e0dda2f670 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:01.416071 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-fe811ab4-8255-4644-9d44-85e0dda2f670 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] [instance: eec0d897-b487-4021-8cc1-b94824339dc4] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:01.424747 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fe811ab4-8255-4644-9d44-85e0dda2f670 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:01.425525 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fe811ab4-8255-4644-9d44-85e0dda2f670 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:01.426717 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fe811ab4-8255-4644-9d44-85e0dda2f670 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:01.427353 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fe811ab4-8255-4644-9d44-85e0dda2f670 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:01.553429 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-fe811ab4-8255-4644-9d44-85e0dda2f670 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55be87ae7f14b499ab2cd6fc5538988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd217e7fd648b4a78c0c32ff1c95f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:01.573955 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-fe811ab4-8255-4644-9d44-85e0dda2f670 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "GET /compute/v2.1/servers/eec0d897-b487-4021-8cc1-b94824339dc4" status: 200 len: 1266 microversion: 2.1 time: 0.161436 Jan 15 20:54:01.583705 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 849/1631] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:54:01 2022] GET /compute/v2.1/servers/eec0d897-b487-4021-8cc1-b94824339dc4 => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:54:01.589760 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-be3dc48f-6e0e-4f0b-90e4-947985ff2d79 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:01.590964 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-be3dc48f-6e0e-4f0b-90e4-947985ff2d79 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] [instance: 42618a48-fe11-4f55-bed2-738d2cc8a07f] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:01.599637 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-be3dc48f-6e0e-4f0b-90e4-947985ff2d79 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:01.600297 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-be3dc48f-6e0e-4f0b-90e4-947985ff2d79 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:01.600927 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-1497ab89-28ba-4efa-8577-baab5076a638 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/48e93c44-f35b-4e83-9ae2-5afca960383f" status: 202 len: 0 microversion: 2.1 time: 0.290161 Jan 15 20:54:01.601544 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 783/1632] 10.222.0.46 () {58 vars in 1271 bytes} [Sat Jan 15 20:54:01 2022] DELETE /compute/v2.1/os-security-groups/48e93c44-f35b-4e83-9ae2-5afca960383f => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 20:54:01.606554 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-be3dc48f-6e0e-4f0b-90e4-947985ff2d79 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:01.607313 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-be3dc48f-6e0e-4f0b-90e4-947985ff2d79 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:01.611365 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9f83f097-3052-4847-a9c6-0d6d0034ba58 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Calling method '.version_select at 0x7f30c8d96ca0>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:01.655586 ncdv-master-1 devstack@n-api.service[129365]: DEBUG neutronclient.v2_0.client [None req-9f83f097-3052-4847-a9c6-0d6d0034ba58 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 48e93c44-f35b-4e83-9ae2-5afca960383f does not exist", "detail": ""}} {{(pid=129365) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jan 15 20:54:01.656554 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.network.security_group_api [None req-9f83f097-3052-4847-a9c6-0d6d0034ba58 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Neutron security group 48e93c44-f35b-4e83-9ae2-5afca960383f not found {{(pid=129365) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jan 15 20:54:01.657265 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-9f83f097-3052-4847-a9c6-0d6d0034ba58 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] HTTP exception thrown: Security group 48e93c44-f35b-4e83-9ae2-5afca960383f does not exist Jan 15 20:54:01.657265 ncdv-master-1 devstack@n-api.service[129365]: Neutron server returns request_ids: ['req-777e3b51-6b32-423d-85a6-54cc99c4ffcf'] Jan 15 20:54:01.658247 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9f83f097-3052-4847-a9c6-0d6d0034ba58 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Returning 404 to user: Security group 48e93c44-f35b-4e83-9ae2-5afca960383f does not exist Jan 15 20:54:01.658247 ncdv-master-1 devstack@n-api.service[129365]: Neutron server returns request_ids: ['req-777e3b51-6b32-423d-85a6-54cc99c4ffcf'] {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:54:01.659414 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-9f83f097-3052-4847-a9c6-0d6d0034ba58 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] 10.222.0.46 "GET /compute/v2.1/os-security-groups/48e93c44-f35b-4e83-9ae2-5afca960383f" status: 404 len: 194 microversion: 2.1 time: 0.053518 Jan 15 20:54:01.663205 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 784/1633] 10.222.0.46 () {58 vars in 1268 bytes} [Sat Jan 15 20:54:01 2022] GET /compute/v2.1/os-security-groups/48e93c44-f35b-4e83-9ae2-5afca960383f => generated 194 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 15 20:54:01.669635 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8a275fc4-2a97-4bff-ac09-9b5566d198d0 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Calling method '.version_select at 0x7f30c8e6a940>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:01.897974 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-be3dc48f-6e0e-4f0b-90e4-947985ff2d79 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:01.910235 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-be3dc48f-6e0e-4f0b-90e4-947985ff2d79 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:01.935898 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-be3dc48f-6e0e-4f0b-90e4-947985ff2d79 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:01.941337 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-be3dc48f-6e0e-4f0b-90e4-947985ff2d79 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] 10.222.0.46 "GET /compute/v2.1/servers/42618a48-fe11-4f55-bed2-738d2cc8a07f" status: 200 len: 1563 microversion: 2.25 time: 0.352187 Jan 15 20:54:01.942521 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 850/1634] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:54:01 2022] GET /compute/v2.1/servers/42618a48-fe11-4f55-bed2-738d2cc8a07f => generated 1563 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:54:01.992005 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-8a275fc4-2a97-4bff-ac09-9b5566d198d0 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/017593ab-28f4-40d5-bb6a-7223ece3d24e" status: 202 len: 0 microversion: 2.1 time: 0.324628 Jan 15 20:54:01.993102 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 785/1635] 10.222.0.46 () {58 vars in 1271 bytes} [Sat Jan 15 20:54:01 2022] DELETE /compute/v2.1/os-security-groups/017593ab-28f4-40d5-bb6a-7223ece3d24e => generated 0 bytes in 329 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 20:54:02.004717 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f5af178c-772d-4bd2-ab1e-8b073aa6b183 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Calling method '.version_select at 0x7f30c8f1daf0>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:02.059351 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e98660f7-432a-4616-a4f7-a7e795f7f895 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:02.060135 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e98660f7-432a-4616-a4f7-a7e795f7f895 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: e3fa2f27-df7a-4ecb-9bba-c970e3e7d106] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:02.072344 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e98660f7-432a-4616-a4f7-a7e795f7f895 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:02.074686 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e98660f7-432a-4616-a4f7-a7e795f7f895 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:02.078542 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e98660f7-432a-4616-a4f7-a7e795f7f895 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:02.084987 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e98660f7-432a-4616-a4f7-a7e795f7f895 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:02.119706 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-e98660f7-432a-4616-a4f7-a7e795f7f895 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] HTTP exception thrown: Instance e3fa2f27-df7a-4ecb-9bba-c970e3e7d106 could not be found. Jan 15 20:54:02.120486 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e98660f7-432a-4616-a4f7-a7e795f7f895 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Returning 404 to user: Instance e3fa2f27-df7a-4ecb-9bba-c970e3e7d106 could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:54:02.122219 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e98660f7-432a-4616-a4f7-a7e795f7f895 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/e3fa2f27-df7a-4ecb-9bba-c970e3e7d106" status: 404 len: 111 microversion: 2.1 time: 0.066220 Jan 15 20:54:02.124990 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 786/1636] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:54:02 2022] GET /compute/v2.1/servers/e3fa2f27-df7a-4ecb-9bba-c970e3e7d106 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 15 20:54:02.134156 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f2d51002-2838-4693-ae5c-b8d780ba208f tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:02.134863 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f2d51002-2838-4693-ae5c-b8d780ba208f tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: 4d527369-954d-4ccc-9105-03b209d3523e] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:02.143487 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f2d51002-2838-4693-ae5c-b8d780ba208f tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:02.144185 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f2d51002-2838-4693-ae5c-b8d780ba208f tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:02.145864 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f2d51002-2838-4693-ae5c-b8d780ba208f tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:02.146500 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f2d51002-2838-4693-ae5c-b8d780ba208f tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:02.152494 ncdv-master-1 devstack@n-api.service[129366]: DEBUG neutronclient.v2_0.client [None req-f5af178c-772d-4bd2-ab1e-8b073aa6b183 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 017593ab-28f4-40d5-bb6a-7223ece3d24e does not exist", "detail": ""}} {{(pid=129366) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jan 15 20:54:02.154213 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.network.security_group_api [None req-f5af178c-772d-4bd2-ab1e-8b073aa6b183 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Neutron security group 017593ab-28f4-40d5-bb6a-7223ece3d24e not found {{(pid=129366) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jan 15 20:54:02.155242 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-f5af178c-772d-4bd2-ab1e-8b073aa6b183 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] HTTP exception thrown: Security group 017593ab-28f4-40d5-bb6a-7223ece3d24e does not exist Jan 15 20:54:02.155242 ncdv-master-1 devstack@n-api.service[129366]: Neutron server returns request_ids: ['req-c0a35288-33cb-4301-98c7-e8e8d72e81b6'] Jan 15 20:54:02.156783 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f5af178c-772d-4bd2-ab1e-8b073aa6b183 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Returning 404 to user: Security group 017593ab-28f4-40d5-bb6a-7223ece3d24e does not exist Jan 15 20:54:02.156783 ncdv-master-1 devstack@n-api.service[129366]: Neutron server returns request_ids: ['req-c0a35288-33cb-4301-98c7-e8e8d72e81b6'] {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:54:02.157892 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f5af178c-772d-4bd2-ab1e-8b073aa6b183 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] 10.222.0.46 "GET /compute/v2.1/os-security-groups/017593ab-28f4-40d5-bb6a-7223ece3d24e" status: 404 len: 194 microversion: 2.1 time: 0.160562 Jan 15 20:54:02.164351 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 851/1637] 10.222.0.46 () {58 vars in 1268 bytes} [Sat Jan 15 20:54:01 2022] GET /compute/v2.1/os-security-groups/017593ab-28f4-40d5-bb6a-7223ece3d24e => generated 194 bytes in 167 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:54:02.172728 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a8708acc-5266-4024-a17c-b2c846d7341b tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Calling method '.version_select at 0x7f30c8ec9f70>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:02.211984 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f2d51002-2838-4693-ae5c-b8d780ba208f tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: 4d527369-954d-4ccc-9105-03b209d3523e] Going to try to terminate instance {{(pid=129365) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 20:54:02.378159 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f2d51002-2838-4693-ae5c-b8d780ba208f tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "DELETE /compute/v2.1/servers/4d527369-954d-4ccc-9105-03b209d3523e" status: 204 len: 0 microversion: 2.1 time: 0.250164 Jan 15 20:54:02.378727 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 787/1638] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 20:54:02 2022] DELETE /compute/v2.1/servers/4d527369-954d-4ccc-9105-03b209d3523e => generated 0 bytes in 252 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 20:54:02.385827 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-24186c77-753e-4abd-96c7-23c5a688f372 req-4dc9ecee-176f-484b-8629-a86ea2c60d03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42618a48-fe11-4f55-bed2-738d2cc8a07f", "name": "network-vif-deleted", "tag": "21a10db9-cd2b-430c-a0f4-3a2be36756f3"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:54:02.388723 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:54:02.388723 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:54:02.399285 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-24186c77-753e-4abd-96c7-23c5a688f372 req-4dc9ecee-176f-484b-8629-a86ea2c60d03 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:02.400200 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-24186c77-753e-4abd-96c7-23c5a688f372 req-4dc9ecee-176f-484b-8629-a86ea2c60d03 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:02.416497 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-24186c77-753e-4abd-96c7-23c5a688f372 req-4dc9ecee-176f-484b-8629-a86ea2c60d03 service nova] Creating event network-vif-deleted:21a10db9-cd2b-430c-a0f4-3a2be36756f3 for instance 42618a48-fe11-4f55-bed2-738d2cc8a07f on nch2-master-1 Jan 15 20:54:02.424073 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-24186c77-753e-4abd-96c7-23c5a688f372 req-4dc9ecee-176f-484b-8629-a86ea2c60d03 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043485 Jan 15 20:54:02.425586 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 788/1639] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:54:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:54:02.431697 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f9433b52-015d-42be-b47a-9f610f65f2a7 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:02.433700 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f9433b52-015d-42be-b47a-9f610f65f2a7 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: 4d527369-954d-4ccc-9105-03b209d3523e] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:02.455267 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f9433b52-015d-42be-b47a-9f610f65f2a7 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:02.456142 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f9433b52-015d-42be-b47a-9f610f65f2a7 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:02.457409 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f9433b52-015d-42be-b47a-9f610f65f2a7 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:02.458145 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f9433b52-015d-42be-b47a-9f610f65f2a7 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:02.887676 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a8708acc-5266-4024-a17c-b2c846d7341b tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/4df05402-0f5f-41b0-bd2d-d7f0ffb5fad9" status: 202 len: 0 microversion: 2.1 time: 0.721876 Jan 15 20:54:02.888257 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 852/1640] 10.222.0.46 () {58 vars in 1271 bytes} [Sat Jan 15 20:54:02 2022] DELETE /compute/v2.1/os-security-groups/4df05402-0f5f-41b0-bd2d-d7f0ffb5fad9 => generated 0 bytes in 723 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 20:54:02.910960 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-2d1fc2f6-1156-4852-a75c-1c39f7d5f5a7 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:02.914078 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-2d1fc2f6-1156-4852-a75c-1c39f7d5f5a7 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] [instance: eec0d897-b487-4021-8cc1-b94824339dc4] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:02.938323 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2d1fc2f6-1156-4852-a75c-1c39f7d5f5a7 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:02.940147 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2d1fc2f6-1156-4852-a75c-1c39f7d5f5a7 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:02.942638 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2d1fc2f6-1156-4852-a75c-1c39f7d5f5a7 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:02.945745 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2d1fc2f6-1156-4852-a75c-1c39f7d5f5a7 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:02.964278 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-f9433b52-015d-42be-b47a-9f610f65f2a7 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:02.976296 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f9433b52-015d-42be-b47a-9f610f65f2a7 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/4d527369-954d-4ccc-9105-03b209d3523e" status: 200 len: 1468 microversion: 2.1 time: 0.549190 Jan 15 20:54:02.979673 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 789/1641] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:54:02 2022] GET /compute/v2.1/servers/4d527369-954d-4ccc-9105-03b209d3523e => generated 1468 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:54:02.998875 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b3188cda-2be3-4105-bae6-729b387d7369 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Calling method '.version_select at 0x7f30c90a7c10>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:03.052378 ncdv-master-1 devstack@n-api.service[129365]: DEBUG neutronclient.v2_0.client [None req-b3188cda-2be3-4105-bae6-729b387d7369 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 4df05402-0f5f-41b0-bd2d-d7f0ffb5fad9 does not exist", "detail": ""}} {{(pid=129365) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jan 15 20:54:03.053459 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.network.security_group_api [None req-b3188cda-2be3-4105-bae6-729b387d7369 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Neutron security group 4df05402-0f5f-41b0-bd2d-d7f0ffb5fad9 not found {{(pid=129365) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jan 15 20:54:03.054420 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-b3188cda-2be3-4105-bae6-729b387d7369 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] HTTP exception thrown: Security group 4df05402-0f5f-41b0-bd2d-d7f0ffb5fad9 does not exist Jan 15 20:54:03.054420 ncdv-master-1 devstack@n-api.service[129365]: Neutron server returns request_ids: ['req-0e335148-de81-4210-989f-16f606f7d9d7'] Jan 15 20:54:03.055617 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b3188cda-2be3-4105-bae6-729b387d7369 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Returning 404 to user: Security group 4df05402-0f5f-41b0-bd2d-d7f0ffb5fad9 does not exist Jan 15 20:54:03.055617 ncdv-master-1 devstack@n-api.service[129365]: Neutron server returns request_ids: ['req-0e335148-de81-4210-989f-16f606f7d9d7'] {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:54:03.056994 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b3188cda-2be3-4105-bae6-729b387d7369 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] 10.222.0.46 "GET /compute/v2.1/os-security-groups/4df05402-0f5f-41b0-bd2d-d7f0ffb5fad9" status: 404 len: 194 microversion: 2.1 time: 0.075366 Jan 15 20:54:03.062500 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 790/1642] 10.222.0.46 () {58 vars in 1268 bytes} [Sat Jan 15 20:54:02 2022] GET /compute/v2.1/os-security-groups/4df05402-0f5f-41b0-bd2d-d7f0ffb5fad9 => generated 194 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:54:03.069744 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-604c47f6-3ea9-45fa-b58e-bf83f4ea460c tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:03.074170 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-604c47f6-3ea9-45fa-b58e-bf83f4ea460c tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] [instance: 42618a48-fe11-4f55-bed2-738d2cc8a07f] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:03.094408 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-604c47f6-3ea9-45fa-b58e-bf83f4ea460c tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:03.095156 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-604c47f6-3ea9-45fa-b58e-bf83f4ea460c tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:03.099399 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-604c47f6-3ea9-45fa-b58e-bf83f4ea460c tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:03.101197 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-604c47f6-3ea9-45fa-b58e-bf83f4ea460c tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:03.138294 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-604c47f6-3ea9-45fa-b58e-bf83f4ea460c tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] HTTP exception thrown: Instance 42618a48-fe11-4f55-bed2-738d2cc8a07f could not be found. Jan 15 20:54:03.140351 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-604c47f6-3ea9-45fa-b58e-bf83f4ea460c tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Returning 404 to user: Instance 42618a48-fe11-4f55-bed2-738d2cc8a07f could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:54:03.141759 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-604c47f6-3ea9-45fa-b58e-bf83f4ea460c tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] 10.222.0.46 "GET /compute/v2.1/servers/42618a48-fe11-4f55-bed2-738d2cc8a07f" status: 404 len: 111 microversion: 2.25 time: 0.078033 Jan 15 20:54:03.143385 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 791/1643] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:54:03 2022] GET /compute/v2.1/servers/42618a48-fe11-4f55-bed2-738d2cc8a07f => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 15 20:54:03.154160 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-687051a6-a0fa-49f2-aefb-86092fc6c1cd tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Calling method '.version_select at 0x7f30c90a7c10>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:03.275851 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-2d1fc2f6-1156-4852-a75c-1c39f7d5f5a7 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55be87ae7f14b499ab2cd6fc5538988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd217e7fd648b4a78c0c32ff1c95f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:03.300569 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-2d1fc2f6-1156-4852-a75c-1c39f7d5f5a7 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "GET /compute/v2.1/servers/eec0d897-b487-4021-8cc1-b94824339dc4" status: 200 len: 1308 microversion: 2.1 time: 0.406618 Jan 15 20:54:03.301779 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 853/1644] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:54:02 2022] GET /compute/v2.1/servers/eec0d897-b487-4021-8cc1-b94824339dc4 => generated 1308 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:54:03.310842 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b483a05c-05c9-48b3-90c2-7e36c8065dbb tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:03.312326 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b483a05c-05c9-48b3-90c2-7e36c8065dbb tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] [instance: 1085522d-3ccc-4de0-b9dd-01c374e1f0ca] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:03.323699 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b483a05c-05c9-48b3-90c2-7e36c8065dbb tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:03.324483 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b483a05c-05c9-48b3-90c2-7e36c8065dbb tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:03.327845 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b483a05c-05c9-48b3-90c2-7e36c8065dbb tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:03.334674 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b483a05c-05c9-48b3-90c2-7e36c8065dbb tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:03.375725 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b483a05c-05c9-48b3-90c2-7e36c8065dbb tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] [instance: 1085522d-3ccc-4de0-b9dd-01c374e1f0ca] Going to try to terminate instance {{(pid=129366) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 20:54:03.420008 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-687051a6-a0fa-49f2-aefb-86092fc6c1cd tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] 10.222.0.46 "GET /compute/v2.1/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 0.274791 Jan 15 20:54:03.421556 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 792/1645] 10.222.0.46 () {58 vars in 1157 bytes} [Sat Jan 15 20:54:03 2022] GET /compute/v2.1/os-security-groups => generated 1157 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:54:03.435879 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-73daf2a8-c229-4d90-8361-fa15e80b7fd0 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Action: 'create', calling method: .version_select at 0x7f30c9022ee0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-21067796", "description": "tempest-description-471724792"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:54:03.507403 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b483a05c-05c9-48b3-90c2-7e36c8065dbb tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] 10.222.0.46 "DELETE /compute/v2.1/servers/1085522d-3ccc-4de0-b9dd-01c374e1f0ca" status: 204 len: 0 microversion: 2.25 time: 0.203753 Jan 15 20:54:03.509367 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 854/1646] 10.222.0.46 () {60 vars in 1279 bytes} [Sat Jan 15 20:54:03 2022] DELETE /compute/v2.1/servers/1085522d-3ccc-4de0-b9dd-01c374e1f0ca => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 15 20:54:03.523108 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e42baa6f-6d06-452b-9450-14bb95500df7 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:03.525251 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e42baa6f-6d06-452b-9450-14bb95500df7 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] [instance: 1085522d-3ccc-4de0-b9dd-01c374e1f0ca] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:03.536752 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e42baa6f-6d06-452b-9450-14bb95500df7 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:03.540078 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e42baa6f-6d06-452b-9450-14bb95500df7 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:03.541198 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e42baa6f-6d06-452b-9450-14bb95500df7 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:03.542527 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e42baa6f-6d06-452b-9450-14bb95500df7 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:03.769894 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-73daf2a8-c229-4d90-8361-fa15e80b7fd0 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] 10.222.0.46 "POST /compute/v2.1/os-security-groups" status: 200 len: 241 microversion: 2.1 time: 0.337158 Jan 15 20:54:03.770708 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 793/1647] 10.222.0.46 () {60 vars in 1179 bytes} [Sat Jan 15 20:54:03 2022] POST /compute/v2.1/os-security-groups => generated 241 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:54:03.783277 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-dbb3791b-b606-470c-9f0e-329092058558 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Action: 'create', calling method: .version_select at 0x7f30c953a310>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1281489077", "description": "tempest-description-1372183468"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:54:03.865417 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-e42baa6f-6d06-452b-9450-14bb95500df7 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:03.898927 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-e42baa6f-6d06-452b-9450-14bb95500df7 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:03.904405 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-e42baa6f-6d06-452b-9450-14bb95500df7 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:03.912884 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e42baa6f-6d06-452b-9450-14bb95500df7 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] 10.222.0.46 "GET /compute/v2.1/servers/1085522d-3ccc-4de0-b9dd-01c374e1f0ca" status: 200 len: 1548 microversion: 2.25 time: 0.393668 Jan 15 20:54:03.912884 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 855/1648] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:54:03 2022] GET /compute/v2.1/servers/1085522d-3ccc-4de0-b9dd-01c374e1f0ca => generated 1548 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 15 20:54:04.004094 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-fc4a34fb-5258-4f5c-9ed6-4ac775fe2e94 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:04.007951 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-fc4a34fb-5258-4f5c-9ed6-4ac775fe2e94 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: 4d527369-954d-4ccc-9105-03b209d3523e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:04.019361 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fc4a34fb-5258-4f5c-9ed6-4ac775fe2e94 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:04.020250 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fc4a34fb-5258-4f5c-9ed6-4ac775fe2e94 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:04.021435 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fc4a34fb-5258-4f5c-9ed6-4ac775fe2e94 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:04.022094 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fc4a34fb-5258-4f5c-9ed6-4ac775fe2e94 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:04.076424 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-dbb3791b-b606-470c-9f0e-329092058558 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] 10.222.0.46 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.297742 Jan 15 20:54:04.077291 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 794/1649] 10.222.0.46 () {60 vars in 1179 bytes} [Sat Jan 15 20:54:03 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:54:04.234545 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-887f1561-06f1-47bf-a474-d991a43843e2 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1369307431", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "networks": [{"uuid": "1860aada-e54b-435b-befe-aece2a8913ae"}]}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:54:04.315767 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.network.neutron [None req-887f1561-06f1-47bf-a474-d991a43843e2 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] validate_networks() for [('1860aada-e54b-435b-befe-aece2a8913ae', None, None, None, None, None)] {{(pid=129365) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 20:54:04.329253 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-fc4a34fb-5258-4f5c-9ed6-4ac775fe2e94 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:04.341612 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-fc4a34fb-5258-4f5c-9ed6-4ac775fe2e94 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/4d527369-954d-4ccc-9105-03b209d3523e" status: 200 len: 1468 microversion: 2.1 time: 0.346267 Jan 15 20:54:04.345684 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 856/1650] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:54:03 2022] GET /compute/v2.1/servers/4d527369-954d-4ccc-9105-03b209d3523e => generated 1468 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:54:04.359887 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8e8757c1-cef7-4b3c-a82a-c9c7f17e6272 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:04.365374 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-8e8757c1-cef7-4b3c-a82a-c9c7f17e6272 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] [instance: eec0d897-b487-4021-8cc1-b94824339dc4] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:04.388713 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8e8757c1-cef7-4b3c-a82a-c9c7f17e6272 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:04.389538 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8e8757c1-cef7-4b3c-a82a-c9c7f17e6272 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:04.397225 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8e8757c1-cef7-4b3c-a82a-c9c7f17e6272 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:04.397900 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8e8757c1-cef7-4b3c-a82a-c9c7f17e6272 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:04.632060 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-8e8757c1-cef7-4b3c-a82a-c9c7f17e6272 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55be87ae7f14b499ab2cd6fc5538988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd217e7fd648b4a78c0c32ff1c95f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:04.652441 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-8e8757c1-cef7-4b3c-a82a-c9c7f17e6272 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "GET /compute/v2.1/servers/eec0d897-b487-4021-8cc1-b94824339dc4" status: 200 len: 1308 microversion: 2.1 time: 0.305325 Jan 15 20:54:04.662820 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 857/1651] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:54:04 2022] GET /compute/v2.1/servers/eec0d897-b487-4021-8cc1-b94824339dc4 => generated 1308 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:54:04.930178 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b644c865-0cc8-4c64-afea-37253cbfb922 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:04.931993 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b644c865-0cc8-4c64-afea-37253cbfb922 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] [instance: 1085522d-3ccc-4de0-b9dd-01c374e1f0ca] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:04.939259 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-887f1561-06f1-47bf-a474-d991a43843e2 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Flavor limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 20:54:04.939673 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-887f1561-06f1-47bf-a474-d991a43843e2 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Image limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 20:54:04.940140 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-887f1561-06f1-47bf-a474-d991a43843e2 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Flavor pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 20:54:04.940640 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-887f1561-06f1-47bf-a474-d991a43843e2 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Image pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 20:54:04.941112 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-887f1561-06f1-47bf-a474-d991a43843e2 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 20:54:04.952669 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b644c865-0cc8-4c64-afea-37253cbfb922 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:04.956273 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b644c865-0cc8-4c64-afea-37253cbfb922 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:04.959050 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b644c865-0cc8-4c64-afea-37253cbfb922 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:04.959945 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b644c865-0cc8-4c64-afea-37253cbfb922 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:04.960622 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-887f1561-06f1-47bf-a474-d991a43843e2 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:04.964998 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-887f1561-06f1-47bf-a474-d991a43843e2 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:04.966183 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-887f1561-06f1-47bf-a474-d991a43843e2 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:04.966808 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-887f1561-06f1-47bf-a474-d991a43843e2 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:05.015361 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-887f1561-06f1-47bf-a474-d991a43843e2 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Getting quotas for project 5515bef049574d4ea4c70f90ab8c4444. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:54:05.020869 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-887f1561-06f1-47bf-a474-d991a43843e2 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Getting quotas for user b17e2708b6fc41b1ae6f70bcf99a0170 and project 5515bef049574d4ea4c70f90ab8c4444. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:54:05.049150 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-887f1561-06f1-47bf-a474-d991a43843e2 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Going to run 1 instances... {{(pid=129365) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 20:54:05.062119 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-887f1561-06f1-47bf-a474-d991a43843e2 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] [instance: f6a6025e-5439-4ba5-a8b8-20019413661b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129365) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 20:54:05.174654 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-887f1561-06f1-47bf-a474-d991a43843e2 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.944386 Jan 15 20:54:05.175662 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 795/1652] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 20:54:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 946 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 20:54:05.226057 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-b644c865-0cc8-4c64-afea-37253cbfb922 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:05.238336 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-b644c865-0cc8-4c64-afea-37253cbfb922 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:05.241758 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-b644c865-0cc8-4c64-afea-37253cbfb922 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:05.244074 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b644c865-0cc8-4c64-afea-37253cbfb922 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] 10.222.0.46 "GET /compute/v2.1/servers/1085522d-3ccc-4de0-b9dd-01c374e1f0ca" status: 200 len: 1548 microversion: 2.25 time: 0.317368 Jan 15 20:54:05.246240 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 858/1653] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:54:04 2022] GET /compute/v2.1/servers/1085522d-3ccc-4de0-b9dd-01c374e1f0ca => generated 1548 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 15 20:54:05.252151 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b9ce7230-2f95-47f9-a3a4-79ca7f1dbe99 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:05.253123 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b9ce7230-2f95-47f9-a3a4-79ca7f1dbe99 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] [instance: f6a6025e-5439-4ba5-a8b8-20019413661b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:05.332710 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-b9ce7230-2f95-47f9-a3a4-79ca7f1dbe99 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17e2708b6fc41b1ae6f70bcf99a0170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515bef049574d4ea4c70f90ab8c4444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:05.342134 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b9ce7230-2f95-47f9-a3a4-79ca7f1dbe99 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] 10.222.0.46 "GET /compute/v2.1/servers/f6a6025e-5439-4ba5-a8b8-20019413661b" status: 200 len: 1216 microversion: 2.1 time: 0.093350 Jan 15 20:54:05.347488 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 859/1654] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:54:05 2022] GET /compute/v2.1/servers/f6a6025e-5439-4ba5-a8b8-20019413661b => generated 1216 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:54:05.445126 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-bf5cb12e-5b5c-4b26-ba21-f9db6be10465 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-284061244", "imageRef": "9630c0cb-41c6-40f8-995f-08ac35d4178a", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "675fbeb5-98b9-4775-9365-0cac427b063d"}]}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:54:05.526292 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.network.neutron [None req-bf5cb12e-5b5c-4b26-ba21-f9db6be10465 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] validate_networks() for [('675fbeb5-98b9-4775-9365-0cac427b063d', None, None, None, None, None)] {{(pid=129365) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 20:54:05.633342 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a55779a9-f791-4e27-99f0-4f99850b8085 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:05.634108 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a55779a9-f791-4e27-99f0-4f99850b8085 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: 4d527369-954d-4ccc-9105-03b209d3523e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:05.645895 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a55779a9-f791-4e27-99f0-4f99850b8085 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:05.646342 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a55779a9-f791-4e27-99f0-4f99850b8085 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:05.649966 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a55779a9-f791-4e27-99f0-4f99850b8085 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:05.651308 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a55779a9-f791-4e27-99f0-4f99850b8085 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:06.087777 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-a55779a9-f791-4e27-99f0-4f99850b8085 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:06.095924 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a55779a9-f791-4e27-99f0-4f99850b8085 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/4d527369-954d-4ccc-9105-03b209d3523e" status: 200 len: 1468 microversion: 2.1 time: 0.736249 Jan 15 20:54:06.096711 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 860/1655] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:54:05 2022] GET /compute/v2.1/servers/4d527369-954d-4ccc-9105-03b209d3523e => generated 1468 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:54:06.111043 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-fc535b52-f8b5-4033-9f9a-bd9efefb32a2 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:06.111662 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-fc535b52-f8b5-4033-9f9a-bd9efefb32a2 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] [instance: eec0d897-b487-4021-8cc1-b94824339dc4] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:06.125944 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fc535b52-f8b5-4033-9f9a-bd9efefb32a2 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:06.133169 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fc535b52-f8b5-4033-9f9a-bd9efefb32a2 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:06.133983 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fc535b52-f8b5-4033-9f9a-bd9efefb32a2 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:06.134431 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fc535b52-f8b5-4033-9f9a-bd9efefb32a2 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:06.337360 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-bf5cb12e-5b5c-4b26-ba21-f9db6be10465 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Flavor limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 20:54:06.340415 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-bf5cb12e-5b5c-4b26-ba21-f9db6be10465 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Image limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 20:54:06.340999 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-bf5cb12e-5b5c-4b26-ba21-f9db6be10465 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Flavor pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 20:54:06.341420 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-bf5cb12e-5b5c-4b26-ba21-f9db6be10465 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Image pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 20:54:06.341837 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-bf5cb12e-5b5c-4b26-ba21-f9db6be10465 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 20:54:06.356468 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bf5cb12e-5b5c-4b26-ba21-f9db6be10465 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:06.357476 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bf5cb12e-5b5c-4b26-ba21-f9db6be10465 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:06.359240 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bf5cb12e-5b5c-4b26-ba21-f9db6be10465 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:06.360448 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bf5cb12e-5b5c-4b26-ba21-f9db6be10465 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:06.370757 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-fc535b52-f8b5-4033-9f9a-bd9efefb32a2 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55be87ae7f14b499ab2cd6fc5538988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd217e7fd648b4a78c0c32ff1c95f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:06.387756 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-fc535b52-f8b5-4033-9f9a-bd9efefb32a2 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "GET /compute/v2.1/servers/eec0d897-b487-4021-8cc1-b94824339dc4" status: 200 len: 1308 microversion: 2.1 time: 0.290146 Jan 15 20:54:06.401018 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 861/1656] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:54:06 2022] GET /compute/v2.1/servers/eec0d897-b487-4021-8cc1-b94824339dc4 => generated 1308 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:54:06.402057 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-bf5cb12e-5b5c-4b26-ba21-f9db6be10465 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Getting quotas for project 0e7b99384e224302b8ad9303f560cc4c. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:54:06.407142 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ddea653d-e3ac-4354-b16b-39fd0df33648 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:06.408737 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ddea653d-e3ac-4354-b16b-39fd0df33648 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] [instance: 1085522d-3ccc-4de0-b9dd-01c374e1f0ca] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:06.415708 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ddea653d-e3ac-4354-b16b-39fd0df33648 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:06.416146 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-bf5cb12e-5b5c-4b26-ba21-f9db6be10465 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Getting quotas for user 97b8081a7f0446389dd03a3182585b4b and project 0e7b99384e224302b8ad9303f560cc4c. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:54:06.416882 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ddea653d-e3ac-4354-b16b-39fd0df33648 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:06.417905 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ddea653d-e3ac-4354-b16b-39fd0df33648 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:06.418337 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ddea653d-e3ac-4354-b16b-39fd0df33648 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:06.441688 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-bf5cb12e-5b5c-4b26-ba21-f9db6be10465 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Going to run 1 instances... {{(pid=129365) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 20:54:06.448952 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-bf5cb12e-5b5c-4b26-ba21-f9db6be10465 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] [instance: b5943844-32ec-464b-b08f-7a618260f817] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9630c0cb-41c6-40f8-995f-08ac35d4178a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129365) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 20:54:06.523288 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-bf5cb12e-5b5c-4b26-ba21-f9db6be10465 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.345187 Jan 15 20:54:06.523982 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 796/1657] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 20:54:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1348 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 20:54:06.535631 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-39b215d4-773d-4164-bc33-6e780a93886e tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:06.536228 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-39b215d4-773d-4164-bc33-6e780a93886e tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] [instance: f6a6025e-5439-4ba5-a8b8-20019413661b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:06.553299 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-39b215d4-773d-4164-bc33-6e780a93886e tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:06.553299 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-39b215d4-773d-4164-bc33-6e780a93886e tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:06.560519 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-39b215d4-773d-4164-bc33-6e780a93886e tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:06.561064 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-39b215d4-773d-4164-bc33-6e780a93886e tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:06.668710 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-39b215d4-773d-4164-bc33-6e780a93886e tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17e2708b6fc41b1ae6f70bcf99a0170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515bef049574d4ea4c70f90ab8c4444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:06.675025 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-ddea653d-e3ac-4354-b16b-39fd0df33648 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:06.691150 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-39b215d4-773d-4164-bc33-6e780a93886e tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] 10.222.0.46 "GET /compute/v2.1/servers/f6a6025e-5439-4ba5-a8b8-20019413661b" status: 200 len: 1276 microversion: 2.1 time: 0.166081 Jan 15 20:54:06.692073 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-ddea653d-e3ac-4354-b16b-39fd0df33648 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:06.694865 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-ddea653d-e3ac-4354-b16b-39fd0df33648 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:06.705613 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 797/1658] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:54:06 2022] GET /compute/v2.1/servers/f6a6025e-5439-4ba5-a8b8-20019413661b => generated 1276 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:54:06.710666 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ddea653d-e3ac-4354-b16b-39fd0df33648 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] 10.222.0.46 "GET /compute/v2.1/servers/1085522d-3ccc-4de0-b9dd-01c374e1f0ca" status: 200 len: 1548 microversion: 2.25 time: 0.308214 Jan 15 20:54:06.711934 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 862/1659] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:54:06 2022] GET /compute/v2.1/servers/1085522d-3ccc-4de0-b9dd-01c374e1f0ca => generated 1548 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:54:06.713926 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-80f0d9f3-6a73-4b86-9712-f86e18202802 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:06.714849 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-80f0d9f3-6a73-4b86-9712-f86e18202802 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] [instance: b5943844-32ec-464b-b08f-7a618260f817] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:06.821079 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-80f0d9f3-6a73-4b86-9712-f86e18202802 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b8081a7f0446389dd03a3182585b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e7b99384e224302b8ad9303f560cc4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:06.831387 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-80f0d9f3-6a73-4b86-9712-f86e18202802 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] 10.222.0.46 "GET /compute/v2.1/servers/b5943844-32ec-464b-b08f-7a618260f817" status: 200 len: 1221 microversion: 2.1 time: 0.124381 Jan 15 20:54:06.832449 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 798/1660] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:54:06 2022] GET /compute/v2.1/servers/b5943844-32ec-464b-b08f-7a618260f817 => generated 1221 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:54:07.115954 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7e937023-c537-4cc5-9fd8-e53583b805c8 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:07.117843 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-7e937023-c537-4cc5-9fd8-e53583b805c8 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: 4d527369-954d-4ccc-9105-03b209d3523e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:07.132767 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7e937023-c537-4cc5-9fd8-e53583b805c8 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:07.133248 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7e937023-c537-4cc5-9fd8-e53583b805c8 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:07.134049 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7e937023-c537-4cc5-9fd8-e53583b805c8 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:07.134486 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7e937023-c537-4cc5-9fd8-e53583b805c8 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:07.349555 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-7e937023-c537-4cc5-9fd8-e53583b805c8 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9245b10067884c428525283137ca04c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6badf41af14266b626a14241efaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:07.368572 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7e937023-c537-4cc5-9fd8-e53583b805c8 tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/4d527369-954d-4ccc-9105-03b209d3523e" status: 200 len: 1426 microversion: 2.1 time: 0.256732 Jan 15 20:54:07.377021 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 863/1661] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:54:07 2022] GET /compute/v2.1/servers/4d527369-954d-4ccc-9105-03b209d3523e => generated 1426 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:54:07.406546 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1cba92e7-2951-4579-b68a-f4739bf99768 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:07.407205 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-1cba92e7-2951-4579-b68a-f4739bf99768 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] [instance: eec0d897-b487-4021-8cc1-b94824339dc4] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:07.421530 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1cba92e7-2951-4579-b68a-f4739bf99768 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:07.422406 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1cba92e7-2951-4579-b68a-f4739bf99768 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:07.423444 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1cba92e7-2951-4579-b68a-f4739bf99768 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:07.424211 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1cba92e7-2951-4579-b68a-f4739bf99768 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:07.609680 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-dd4cdc80-da89-4558-9bd8-81b6b95a121c tempest-FlavorsV2TestJSON-819267991 tempest-FlavorsV2TestJSON-819267991-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:07.621613 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-dd4cdc80-da89-4558-9bd8-81b6b95a121c tempest-FlavorsV2TestJSON-819267991 tempest-FlavorsV2TestJSON-819267991-project] 10.222.0.46 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.219275 Jan 15 20:54:07.622375 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 799/1662] 10.222.0.46 () {58 vars in 1136 bytes} [Sat Jan 15 20:54:07 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:54:07.645679 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-f7c572dc-b01f-4c02-8948-05f6ca8fa50b req-49dcb07c-a1d5-457d-bf3b-5109a627211b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d527369-954d-4ccc-9105-03b209d3523e", "name": "network-vif-deleted", "tag": "8fbebb13-bd94-4e21-bda4-a22a2589b5db"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:54:07.647812 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:54:07.647812 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:54:07.657261 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-f7c572dc-b01f-4c02-8948-05f6ca8fa50b req-49dcb07c-a1d5-457d-bf3b-5109a627211b service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:07.658904 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-f7c572dc-b01f-4c02-8948-05f6ca8fa50b req-49dcb07c-a1d5-457d-bf3b-5109a627211b service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:07.683581 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-f7c572dc-b01f-4c02-8948-05f6ca8fa50b req-49dcb07c-a1d5-457d-bf3b-5109a627211b service nova] Creating event network-vif-deleted:8fbebb13-bd94-4e21-bda4-a22a2589b5db for instance 4d527369-954d-4ccc-9105-03b209d3523e on nch2-master-1 Jan 15 20:54:07.695496 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-f7c572dc-b01f-4c02-8948-05f6ca8fa50b req-49dcb07c-a1d5-457d-bf3b-5109a627211b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062845 Jan 15 20:54:07.698172 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 800/1663] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:54:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:54:07.708415 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-1b29be22-cea2-4ad3-95dc-673dd7ab9ef1 tempest-FlavorsV2TestJSON-819267991 tempest-FlavorsV2TestJSON-819267991-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:07.756728 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-1b29be22-cea2-4ad3-95dc-673dd7ab9ef1 tempest-FlavorsV2TestJSON-819267991 tempest-FlavorsV2TestJSON-819267991-project] 10.222.0.46 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.056940 Jan 15 20:54:07.770910 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 801/1664] 10.222.0.46 () {58 vars in 1124 bytes} [Sat Jan 15 20:54:07 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:54:07.775980 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d343a76a-e236-4af3-9c8f-bd8257a9556b tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:07.792604 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d343a76a-e236-4af3-9c8f-bd8257a9556b tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] [instance: f6a6025e-5439-4ba5-a8b8-20019413661b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:07.800052 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d343a76a-e236-4af3-9c8f-bd8257a9556b tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:07.800726 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d343a76a-e236-4af3-9c8f-bd8257a9556b tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:07.801999 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d343a76a-e236-4af3-9c8f-bd8257a9556b tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:07.802621 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d343a76a-e236-4af3-9c8f-bd8257a9556b tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:08.008523 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-d343a76a-e236-4af3-9c8f-bd8257a9556b tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17e2708b6fc41b1ae6f70bcf99a0170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515bef049574d4ea4c70f90ab8c4444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:08.026075 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d343a76a-e236-4af3-9c8f-bd8257a9556b tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] 10.222.0.46 "GET /compute/v2.1/servers/f6a6025e-5439-4ba5-a8b8-20019413661b" status: 200 len: 1274 microversion: 2.1 time: 0.253553 Jan 15 20:54:08.027720 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 802/1665] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:54:07 2022] GET /compute/v2.1/servers/f6a6025e-5439-4ba5-a8b8-20019413661b => generated 1274 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:54:08.044036 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5368a166-456d-48b7-8100-230781abb3bd tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:08.044828 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-5368a166-456d-48b7-8100-230781abb3bd tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] [instance: 1085522d-3ccc-4de0-b9dd-01c374e1f0ca] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:08.072470 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5368a166-456d-48b7-8100-230781abb3bd tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:08.072956 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5368a166-456d-48b7-8100-230781abb3bd tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:08.078996 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5368a166-456d-48b7-8100-230781abb3bd tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:08.079455 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5368a166-456d-48b7-8100-230781abb3bd tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:08.160503 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5368a166-456d-48b7-8100-230781abb3bd tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:08.166467 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5368a166-456d-48b7-8100-230781abb3bd tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:08.167772 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.objects.instance [None req-5368a166-456d-48b7-8100-230781abb3bd tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lazy-loading 'fault' on Instance uuid 1085522d-3ccc-4de0-b9dd-01c374e1f0ca {{(pid=129365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 20:54:08.716348 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-5368a166-456d-48b7-8100-230781abb3bd tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:08.724674 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-5368a166-456d-48b7-8100-230781abb3bd tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:08.728351 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-5368a166-456d-48b7-8100-230781abb3bd tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:08.751348 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5368a166-456d-48b7-8100-230781abb3bd tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] 10.222.0.46 "GET /compute/v2.1/servers/1085522d-3ccc-4de0-b9dd-01c374e1f0ca" status: 200 len: 1352 microversion: 2.25 time: 0.717909 Jan 15 20:54:08.753977 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 803/1666] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:54:08 2022] GET /compute/v2.1/servers/1085522d-3ccc-4de0-b9dd-01c374e1f0ca => generated 1352 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:54:08.763332 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-4a9fa625-87fb-4012-b082-01188edd4df2 tempest-FlavorsV2TestJSON-819267991 tempest-FlavorsV2TestJSON-819267991-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:08.791450 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-4a9fa625-87fb-4012-b082-01188edd4df2 tempest-FlavorsV2TestJSON-819267991 tempest-FlavorsV2TestJSON-819267991-project] 10.222.0.46 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.032857 Jan 15 20:54:08.794953 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 804/1667] 10.222.0.46 () {58 vars in 1136 bytes} [Sat Jan 15 20:54:08 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:54:08.827941 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d086dd75-2008-4f6c-a5ba-0fcee959fea5 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:08.829711 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d086dd75-2008-4f6c-a5ba-0fcee959fea5 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] [instance: b5943844-32ec-464b-b08f-7a618260f817] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:08.848417 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-1cba92e7-2951-4579-b68a-f4739bf99768 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55be87ae7f14b499ab2cd6fc5538988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd217e7fd648b4a78c0c32ff1c95f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:08.855433 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d086dd75-2008-4f6c-a5ba-0fcee959fea5 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:08.857400 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-1cba92e7-2951-4579-b68a-f4739bf99768 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "GET /compute/v2.1/servers/eec0d897-b487-4021-8cc1-b94824339dc4" status: 200 len: 1308 microversion: 2.1 time: 1.455090 Jan 15 20:54:08.857707 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d086dd75-2008-4f6c-a5ba-0fcee959fea5 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:08.859475 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d086dd75-2008-4f6c-a5ba-0fcee959fea5 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:08.861151 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 864/1668] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:54:07 2022] GET /compute/v2.1/servers/eec0d897-b487-4021-8cc1-b94824339dc4 => generated 1308 bytes in 1459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:54:08.865191 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d086dd75-2008-4f6c-a5ba-0fcee959fea5 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:08.867001 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-3a40f782-95bb-47cd-ace0-19b4cfb1f37f tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:08.868281 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-3a40f782-95bb-47cd-ace0-19b4cfb1f37f tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] [instance: 4d527369-954d-4ccc-9105-03b209d3523e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:08.874509 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3a40f782-95bb-47cd-ace0-19b4cfb1f37f tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:08.875210 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3a40f782-95bb-47cd-ace0-19b4cfb1f37f tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:08.876154 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3a40f782-95bb-47cd-ace0-19b4cfb1f37f tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:08.876733 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3a40f782-95bb-47cd-ace0-19b4cfb1f37f tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:08.895313 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-3a40f782-95bb-47cd-ace0-19b4cfb1f37f tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] HTTP exception thrown: Instance 4d527369-954d-4ccc-9105-03b209d3523e could not be found. Jan 15 20:54:08.896198 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-3a40f782-95bb-47cd-ace0-19b4cfb1f37f tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] Returning 404 to user: Instance 4d527369-954d-4ccc-9105-03b209d3523e could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:54:08.897069 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-3a40f782-95bb-47cd-ace0-19b4cfb1f37f tempest-MigrationsAdminTest-1259579526 tempest-MigrationsAdminTest-1259579526-project] 10.222.0.46 "GET /compute/v2.1/servers/4d527369-954d-4ccc-9105-03b209d3523e" status: 404 len: 111 microversion: 2.1 time: 0.034736 Jan 15 20:54:08.897636 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 865/1669] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:54:08 2022] GET /compute/v2.1/servers/4d527369-954d-4ccc-9105-03b209d3523e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:54:08.927850 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-137c048c-a51b-4d13-ab21-183a87731379 tempest-FlavorsV2TestJSON-819267991 tempest-FlavorsV2TestJSON-819267991-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:08.953149 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-137c048c-a51b-4d13-ab21-183a87731379 tempest-FlavorsV2TestJSON-819267991 tempest-FlavorsV2TestJSON-819267991-project] 10.222.0.46 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.054045 Jan 15 20:54:08.958873 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 866/1670] 10.222.0.46 () {58 vars in 1136 bytes} [Sat Jan 15 20:54:08 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:54:08.982636 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-6ae2ed72-044d-4186-8e1c-74082241ba1c tempest-FlavorsV2TestJSON-819267991 tempest-FlavorsV2TestJSON-819267991-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:09.054005 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-6ae2ed72-044d-4186-8e1c-74082241ba1c tempest-FlavorsV2TestJSON-819267991 tempest-FlavorsV2TestJSON-819267991-project] 10.222.0.46 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.081963 Jan 15 20:54:09.069729 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 867/1671] 10.222.0.46 () {58 vars in 1164 bytes} [Sat Jan 15 20:54:08 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:54:09.074769 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-90f5417a-45ff-40c1-ac7c-c90bba2ed026 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:09.075381 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-90f5417a-45ff-40c1-ac7c-c90bba2ed026 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] [instance: f6a6025e-5439-4ba5-a8b8-20019413661b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:09.084246 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-90f5417a-45ff-40c1-ac7c-c90bba2ed026 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:09.084588 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-90f5417a-45ff-40c1-ac7c-c90bba2ed026 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:09.086570 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-90f5417a-45ff-40c1-ac7c-c90bba2ed026 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:09.087669 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-90f5417a-45ff-40c1-ac7c-c90bba2ed026 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:09.673814 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-d086dd75-2008-4f6c-a5ba-0fcee959fea5 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b8081a7f0446389dd03a3182585b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e7b99384e224302b8ad9303f560cc4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:09.690897 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d086dd75-2008-4f6c-a5ba-0fcee959fea5 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] 10.222.0.46 "GET /compute/v2.1/servers/b5943844-32ec-464b-b08f-7a618260f817" status: 200 len: 1279 microversion: 2.1 time: 0.889825 Jan 15 20:54:09.698338 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 805/1672] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:54:08 2022] GET /compute/v2.1/servers/b5943844-32ec-464b-b08f-7a618260f817 => generated 1279 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:54:09.716037 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ed638748-6584-49f3-9db5-dff12ebac6b7 tempest-FlavorsV2TestJSON-819267991 tempest-FlavorsV2TestJSON-819267991-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:09.741169 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ed638748-6584-49f3-9db5-dff12ebac6b7 tempest-FlavorsV2TestJSON-819267991 tempest-FlavorsV2TestJSON-819267991-project] 10.222.0.46 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.039433 Jan 15 20:54:09.749655 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 806/1673] 10.222.0.46 () {58 vars in 1136 bytes} [Sat Jan 15 20:54:09 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:54:09.761943 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a7f357a5-bf6a-4910-9813-93ae12e84491 tempest-FlavorsV2TestJSON-819267991 tempest-FlavorsV2TestJSON-819267991-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:09.841868 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a7f357a5-bf6a-4910-9813-93ae12e84491 tempest-FlavorsV2TestJSON-819267991 tempest-FlavorsV2TestJSON-819267991-project] 10.222.0.46 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.087814 Jan 15 20:54:09.844712 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 807/1674] 10.222.0.46 () {58 vars in 1168 bytes} [Sat Jan 15 20:54:09 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:54:09.856208 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-df0c6a74-3129-434a-bf60-588421e22595 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:09.860796 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-df0c6a74-3129-434a-bf60-588421e22595 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] [instance: 1085522d-3ccc-4de0-b9dd-01c374e1f0ca] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:09.879574 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-df0c6a74-3129-434a-bf60-588421e22595 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:09.882756 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-df0c6a74-3129-434a-bf60-588421e22595 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:09.885057 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-df0c6a74-3129-434a-bf60-588421e22595 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:09.886994 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-df0c6a74-3129-434a-bf60-588421e22595 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:09.928126 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-df0c6a74-3129-434a-bf60-588421e22595 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] HTTP exception thrown: Instance 1085522d-3ccc-4de0-b9dd-01c374e1f0ca could not be found. Jan 15 20:54:09.930795 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-df0c6a74-3129-434a-bf60-588421e22595 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Returning 404 to user: Instance 1085522d-3ccc-4de0-b9dd-01c374e1f0ca could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:54:09.935509 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-df0c6a74-3129-434a-bf60-588421e22595 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] 10.222.0.46 "GET /compute/v2.1/servers/1085522d-3ccc-4de0-b9dd-01c374e1f0ca" status: 404 len: 111 microversion: 2.25 time: 0.086758 Jan 15 20:54:09.938050 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 808/1675] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:54:09 2022] GET /compute/v2.1/servers/1085522d-3ccc-4de0-b9dd-01c374e1f0ca => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 15 20:54:10.103175 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-90f5417a-45ff-40c1-ac7c-c90bba2ed026 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17e2708b6fc41b1ae6f70bcf99a0170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515bef049574d4ea4c70f90ab8c4444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:10.143223 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-90f5417a-45ff-40c1-ac7c-c90bba2ed026 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] 10.222.0.46 "GET /compute/v2.1/servers/f6a6025e-5439-4ba5-a8b8-20019413661b" status: 200 len: 1316 microversion: 2.1 time: 1.070250 Jan 15 20:54:10.147829 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 868/1676] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:54:09 2022] GET /compute/v2.1/servers/f6a6025e-5439-4ba5-a8b8-20019413661b => generated 1316 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:54:10.173775 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c6e25b2c-6736-4bd8-b79a-0721346bde10 tempest-FlavorsV2TestJSON-819267991 tempest-FlavorsV2TestJSON-819267991-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:10.206945 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c6e25b2c-6736-4bd8-b79a-0721346bde10 tempest-FlavorsV2TestJSON-819267991 tempest-FlavorsV2TestJSON-819267991-project] 10.222.0.46 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.054120 Jan 15 20:54:10.209199 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 869/1677] 10.222.0.46 () {58 vars in 1160 bytes} [Sat Jan 15 20:54:10 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:54:10.220759 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-41174bd8-b151-4ccb-890d-9e3709f3ba43 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:10.221639 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-41174bd8-b151-4ccb-890d-9e3709f3ba43 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] [instance: eec0d897-b487-4021-8cc1-b94824339dc4] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:10.231931 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-94511224-0a3f-4fea-a212-691fce742e7a req-887905e4-d779-4efc-90a3-c229332f18f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1085522d-3ccc-4de0-b9dd-01c374e1f0ca", "name": "network-vif-deleted", "tag": "fd65475a-f2b6-4fd5-b84f-f1f5f96b1f50"}, {"name": "network-changed", "server_uuid": "eec0d897-b487-4021-8cc1-b94824339dc4", "tag": "f35ca04a-094e-42bc-a7ee-c8ee9d748f3f"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:54:10.234274 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:54:10.234274 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:54:10.259075 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-41174bd8-b151-4ccb-890d-9e3709f3ba43 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:10.260765 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-94511224-0a3f-4fea-a212-691fce742e7a req-887905e4-d779-4efc-90a3-c229332f18f9 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:10.269232 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-41174bd8-b151-4ccb-890d-9e3709f3ba43 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:10.269905 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-94511224-0a3f-4fea-a212-691fce742e7a req-887905e4-d779-4efc-90a3-c229332f18f9 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:10.273302 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-41174bd8-b151-4ccb-890d-9e3709f3ba43 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:10.276069 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-41174bd8-b151-4ccb-890d-9e3709f3ba43 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:10.306718 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-94511224-0a3f-4fea-a212-691fce742e7a req-887905e4-d779-4efc-90a3-c229332f18f9 service nova] Creating event network-vif-deleted:fd65475a-f2b6-4fd5-b84f-f1f5f96b1f50 for instance 1085522d-3ccc-4de0-b9dd-01c374e1f0ca on nch2-master-1 Jan 15 20:54:10.307322 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-94511224-0a3f-4fea-a212-691fce742e7a req-887905e4-d779-4efc-90a3-c229332f18f9 service nova] Creating event network-changed:f35ca04a-094e-42bc-a7ee-c8ee9d748f3f for instance eec0d897-b487-4021-8cc1-b94824339dc4 on nch1-master-1 Jan 15 20:54:10.329319 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-94511224-0a3f-4fea-a212-691fce742e7a req-887905e4-d779-4efc-90a3-c229332f18f9 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.386260 Jan 15 20:54:10.334785 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 809/1678] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:54:09 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:54:10.340167 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-584e0e04-b07e-4b72-a4b6-6f20216ce4ec tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:10.344252 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-584e0e04-b07e-4b72-a4b6-6f20216ce4ec tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] [instance: 770bfdbf-2ac6-4ab9-b2e3-f9e43ae88af6] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:10.356216 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-584e0e04-b07e-4b72-a4b6-6f20216ce4ec tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:10.357380 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-584e0e04-b07e-4b72-a4b6-6f20216ce4ec tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:10.359358 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-584e0e04-b07e-4b72-a4b6-6f20216ce4ec tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:10.360005 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-584e0e04-b07e-4b72-a4b6-6f20216ce4ec tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:10.404580 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-584e0e04-b07e-4b72-a4b6-6f20216ce4ec tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] [instance: 770bfdbf-2ac6-4ab9-b2e3-f9e43ae88af6] Going to try to terminate instance {{(pid=129365) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 20:54:10.536263 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-584e0e04-b07e-4b72-a4b6-6f20216ce4ec tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] 10.222.0.46 "DELETE /compute/v2.1/servers/770bfdbf-2ac6-4ab9-b2e3-f9e43ae88af6" status: 204 len: 0 microversion: 2.25 time: 0.198880 Jan 15 20:54:10.537596 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 810/1679] 10.222.0.46 () {60 vars in 1279 bytes} [Sat Jan 15 20:54:10 2022] DELETE /compute/v2.1/servers/770bfdbf-2ac6-4ab9-b2e3-f9e43ae88af6 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 15 20:54:10.547359 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c130a42a-a76b-4187-924a-9e15387683a0 tempest-FlavorsV2TestJSON-819267991 tempest-FlavorsV2TestJSON-819267991-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:10.563811 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c130a42a-a76b-4187-924a-9e15387683a0 tempest-FlavorsV2TestJSON-819267991 tempest-FlavorsV2TestJSON-819267991-project] 10.222.0.46 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.023854 Jan 15 20:54:10.565787 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 811/1680] 10.222.0.46 () {58 vars in 1136 bytes} [Sat Jan 15 20:54:10 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:54:10.574725 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f67e0bf6-33b6-4881-b25b-6ec94a2c672a tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:10.578918 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f67e0bf6-33b6-4881-b25b-6ec94a2c672a tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] [instance: 770bfdbf-2ac6-4ab9-b2e3-f9e43ae88af6] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:10.594795 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f67e0bf6-33b6-4881-b25b-6ec94a2c672a tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:10.595804 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f67e0bf6-33b6-4881-b25b-6ec94a2c672a tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:10.597030 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f67e0bf6-33b6-4881-b25b-6ec94a2c672a tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:10.598874 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f67e0bf6-33b6-4881-b25b-6ec94a2c672a tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:11.957162 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-41174bd8-b151-4ccb-890d-9e3709f3ba43 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55be87ae7f14b499ab2cd6fc5538988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd217e7fd648b4a78c0c32ff1c95f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:11.975175 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-41174bd8-b151-4ccb-890d-9e3709f3ba43 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "GET /compute/v2.1/servers/eec0d897-b487-4021-8cc1-b94824339dc4" status: 200 len: 1308 microversion: 2.1 time: 1.761805 Jan 15 20:54:11.980006 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 870/1681] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:54:10 2022] GET /compute/v2.1/servers/eec0d897-b487-4021-8cc1-b94824339dc4 => generated 1308 bytes in 1770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:54:11.988373 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-deaf759f-7ed6-4643-834a-984239cd0770 tempest-FlavorsV2TestJSON-819267991 tempest-FlavorsV2TestJSON-819267991-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:12.118301 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-deaf759f-7ed6-4643-834a-984239cd0770 tempest-FlavorsV2TestJSON-819267991 tempest-FlavorsV2TestJSON-819267991-project] 10.222.0.46 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.134284 Jan 15 20:54:12.121160 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 871/1682] 10.222.0.46 () {58 vars in 1166 bytes} [Sat Jan 15 20:54:11 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:54:12.133762 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8afb5d06-ab0b-48af-8b08-f8381316ef3f tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:12.138081 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-8afb5d06-ab0b-48af-8b08-f8381316ef3f tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] [instance: b5943844-32ec-464b-b08f-7a618260f817] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:12.157230 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8afb5d06-ab0b-48af-8b08-f8381316ef3f tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:12.157683 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8afb5d06-ab0b-48af-8b08-f8381316ef3f tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:12.161024 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8afb5d06-ab0b-48af-8b08-f8381316ef3f tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:12.161699 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8afb5d06-ab0b-48af-8b08-f8381316ef3f tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:12.266357 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-f67e0bf6-33b6-4881-b25b-6ec94a2c672a tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:12.286216 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-f67e0bf6-33b6-4881-b25b-6ec94a2c672a tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:12.295639 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-f67e0bf6-33b6-4881-b25b-6ec94a2c672a tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:12.298895 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f67e0bf6-33b6-4881-b25b-6ec94a2c672a tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] 10.222.0.46 "GET /compute/v2.1/servers/770bfdbf-2ac6-4ab9-b2e3-f9e43ae88af6" status: 200 len: 1562 microversion: 2.25 time: 1.731604 Jan 15 20:54:12.301844 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 812/1683] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:54:10 2022] GET /compute/v2.1/servers/770bfdbf-2ac6-4ab9-b2e3-f9e43ae88af6 => generated 1562 bytes in 1735 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:54:12.330046 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-26a8fc03-2e5d-41f8-9727-bd0c44f687cb tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:12.331684 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-26a8fc03-2e5d-41f8-9727-bd0c44f687cb tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] [instance: f6a6025e-5439-4ba5-a8b8-20019413661b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:12.362465 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-26a8fc03-2e5d-41f8-9727-bd0c44f687cb tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:12.363355 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-26a8fc03-2e5d-41f8-9727-bd0c44f687cb tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:12.363922 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-26a8fc03-2e5d-41f8-9727-bd0c44f687cb tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:12.364361 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-26a8fc03-2e5d-41f8-9727-bd0c44f687cb tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:13.628992 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-8afb5d06-ab0b-48af-8b08-f8381316ef3f tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b8081a7f0446389dd03a3182585b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e7b99384e224302b8ad9303f560cc4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:13.637895 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-8afb5d06-ab0b-48af-8b08-f8381316ef3f tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] 10.222.0.46 "GET /compute/v2.1/servers/b5943844-32ec-464b-b08f-7a618260f817" status: 200 len: 1321 microversion: 2.1 time: 1.515597 Jan 15 20:54:13.641891 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 872/1684] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:54:12 2022] GET /compute/v2.1/servers/b5943844-32ec-464b-b08f-7a618260f817 => generated 1321 bytes in 1520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:54:13.652799 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e7a620b4-cadf-4807-b5a7-1d3888a7e932 tempest-FlavorsV2TestJSON-819267991 tempest-FlavorsV2TestJSON-819267991-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:13.673935 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e7a620b4-cadf-4807-b5a7-1d3888a7e932 tempest-FlavorsV2TestJSON-819267991 tempest-FlavorsV2TestJSON-819267991-project] 10.222.0.46 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.030567 Jan 15 20:54:13.675123 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 873/1685] 10.222.0.46 () {58 vars in 1136 bytes} [Sat Jan 15 20:54:13 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:54:13.682029 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f08da01a-86ba-40ef-a1ce-1109e85324f3 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:13.689217 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f08da01a-86ba-40ef-a1ce-1109e85324f3 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] [instance: eec0d897-b487-4021-8cc1-b94824339dc4] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:13.696205 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f08da01a-86ba-40ef-a1ce-1109e85324f3 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:13.699422 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f08da01a-86ba-40ef-a1ce-1109e85324f3 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:13.700424 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f08da01a-86ba-40ef-a1ce-1109e85324f3 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:13.701946 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f08da01a-86ba-40ef-a1ce-1109e85324f3 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:13.702231 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-26a8fc03-2e5d-41f8-9727-bd0c44f687cb tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17e2708b6fc41b1ae6f70bcf99a0170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515bef049574d4ea4c70f90ab8c4444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:13.711577 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-26a8fc03-2e5d-41f8-9727-bd0c44f687cb tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] 10.222.0.46 "GET /compute/v2.1/servers/f6a6025e-5439-4ba5-a8b8-20019413661b" status: 200 len: 1316 microversion: 2.1 time: 1.394693 Jan 15 20:54:13.715844 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 813/1686] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:54:12 2022] GET /compute/v2.1/servers/f6a6025e-5439-4ba5-a8b8-20019413661b => generated 1316 bytes in 1413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:54:13.730270 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-1e2cf104-8903-4290-b263-dca880f5f541 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:13.731877 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-1e2cf104-8903-4290-b263-dca880f5f541 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] [instance: 770bfdbf-2ac6-4ab9-b2e3-f9e43ae88af6] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:13.766893 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1e2cf104-8903-4290-b263-dca880f5f541 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:13.769279 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1e2cf104-8903-4290-b263-dca880f5f541 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:13.772590 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1e2cf104-8903-4290-b263-dca880f5f541 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:13.774308 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1e2cf104-8903-4290-b263-dca880f5f541 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:14.403228 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-f08da01a-86ba-40ef-a1ce-1109e85324f3 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55be87ae7f14b499ab2cd6fc5538988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd217e7fd648b4a78c0c32ff1c95f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:14.422324 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f08da01a-86ba-40ef-a1ce-1109e85324f3 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "GET /compute/v2.1/servers/eec0d897-b487-4021-8cc1-b94824339dc4" status: 200 len: 1308 microversion: 2.1 time: 0.743284 Jan 15 20:54:14.425981 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 874/1687] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:54:13 2022] GET /compute/v2.1/servers/eec0d897-b487-4021-8cc1-b94824339dc4 => generated 1308 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:54:14.430937 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-03b9a6e1-671a-4070-8caf-3fe7d5f828a7 req-c2b980eb-cd52-4843-ba42-50da2e955e98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6a6025e-5439-4ba5-a8b8-20019413661b", "tag": "cf311698-e345-42ab-8508-0fa2a6da33ab"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:54:14.437588 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:54:14.437588 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:54:14.461864 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-03b9a6e1-671a-4070-8caf-3fe7d5f828a7 req-c2b980eb-cd52-4843-ba42-50da2e955e98 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:14.463299 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-03b9a6e1-671a-4070-8caf-3fe7d5f828a7 req-c2b980eb-cd52-4843-ba42-50da2e955e98 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:14.504453 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-03b9a6e1-671a-4070-8caf-3fe7d5f828a7 req-c2b980eb-cd52-4843-ba42-50da2e955e98 service nova] Creating event network-changed:cf311698-e345-42ab-8508-0fa2a6da33ab for instance f6a6025e-5439-4ba5-a8b8-20019413661b on nch2-master-1 Jan 15 20:54:14.521992 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-03b9a6e1-671a-4070-8caf-3fe7d5f828a7 req-c2b980eb-cd52-4843-ba42-50da2e955e98 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089597 Jan 15 20:54:14.523819 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 875/1688] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:54:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:54:14.546954 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-65eb798c-0b72-4c47-8dd8-eb00d49ed3e0 tempest-FlavorsV2TestJSON-819267991 tempest-FlavorsV2TestJSON-819267991-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:14.599465 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-65eb798c-0b72-4c47-8dd8-eb00d49ed3e0 tempest-FlavorsV2TestJSON-819267991 tempest-FlavorsV2TestJSON-819267991-project] 10.222.0.46 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.072381 Jan 15 20:54:14.601474 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 876/1689] 10.222.0.46 () {58 vars in 1143 bytes} [Sat Jan 15 20:54:14 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:54:14.616591 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-69ee054a-f7a8-4acc-80f7-b8943ecfdcd4 tempest-FlavorsV2TestJSON-819267991 tempest-FlavorsV2TestJSON-819267991-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:14.636114 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-69ee054a-f7a8-4acc-80f7-b8943ecfdcd4 tempest-FlavorsV2TestJSON-819267991 tempest-FlavorsV2TestJSON-819267991-project] 10.222.0.46 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.024124 Jan 15 20:54:14.646041 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 877/1690] 10.222.0.46 () {58 vars in 1136 bytes} [Sat Jan 15 20:54:14 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:54:14.649935 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-1e2cf104-8903-4290-b263-dca880f5f541 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:14.656245 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-5512ce81-cc16-42f7-bf96-05e44172a6cb tempest-FlavorsV2TestJSON-819267991 tempest-FlavorsV2TestJSON-819267991-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:14.664055 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-1e2cf104-8903-4290-b263-dca880f5f541 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:14.672955 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-1e2cf104-8903-4290-b263-dca880f5f541 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:14.676239 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-1e2cf104-8903-4290-b263-dca880f5f541 tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] 10.222.0.46 "GET /compute/v2.1/servers/770bfdbf-2ac6-4ab9-b2e3-f9e43ae88af6" status: 200 len: 1562 microversion: 2.25 time: 0.958991 Jan 15 20:54:14.680528 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 814/1691] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:54:13 2022] GET /compute/v2.1/servers/770bfdbf-2ac6-4ab9-b2e3-f9e43ae88af6 => generated 1562 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:54:14.693426 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-4a479d86-88ed-4f54-a787-615cb75630f0 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:14.694042 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-4a479d86-88ed-4f54-a787-615cb75630f0 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] [instance: b5943844-32ec-464b-b08f-7a618260f817] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:14.715746 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4a479d86-88ed-4f54-a787-615cb75630f0 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:14.733435 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4a479d86-88ed-4f54-a787-615cb75630f0 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:14.735486 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4a479d86-88ed-4f54-a787-615cb75630f0 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:14.738369 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4a479d86-88ed-4f54-a787-615cb75630f0 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:14.751243 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-5512ce81-cc16-42f7-bf96-05e44172a6cb tempest-FlavorsV2TestJSON-819267991 tempest-FlavorsV2TestJSON-819267991-project] 10.222.0.46 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.098834 Jan 15 20:54:14.759184 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 878/1692] 10.222.0.46 () {58 vars in 1147 bytes} [Sat Jan 15 20:54:14 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:54:14.771182 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-dadac736-f253-46da-8abc-3cc1fb84d098 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:14.772998 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-dadac736-f253-46da-8abc-3cc1fb84d098 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] [instance: f6a6025e-5439-4ba5-a8b8-20019413661b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:14.798140 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dadac736-f253-46da-8abc-3cc1fb84d098 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:14.798140 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dadac736-f253-46da-8abc-3cc1fb84d098 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:14.800542 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dadac736-f253-46da-8abc-3cc1fb84d098 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:14.801298 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dadac736-f253-46da-8abc-3cc1fb84d098 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:15.732691 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-dadac736-f253-46da-8abc-3cc1fb84d098 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17e2708b6fc41b1ae6f70bcf99a0170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515bef049574d4ea4c70f90ab8c4444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:15.739241 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-dadac736-f253-46da-8abc-3cc1fb84d098 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] 10.222.0.46 "GET /compute/v2.1/servers/f6a6025e-5439-4ba5-a8b8-20019413661b" status: 200 len: 1316 microversion: 2.1 time: 0.973120 Jan 15 20:54:15.744018 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 879/1693] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:54:14 2022] GET /compute/v2.1/servers/f6a6025e-5439-4ba5-a8b8-20019413661b => generated 1316 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:54:15.748787 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a2fbe2f8-313d-48d0-a050-bcbb115dabfd tempest-FlavorsV2TestJSON-819267991 tempest-FlavorsV2TestJSON-819267991-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:15.754180 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-4a479d86-88ed-4f54-a787-615cb75630f0 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b8081a7f0446389dd03a3182585b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e7b99384e224302b8ad9303f560cc4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:15.762754 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-4a479d86-88ed-4f54-a787-615cb75630f0 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] 10.222.0.46 "GET /compute/v2.1/servers/b5943844-32ec-464b-b08f-7a618260f817" status: 200 len: 1321 microversion: 2.1 time: 1.080904 Jan 15 20:54:15.784461 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 815/1694] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:54:14 2022] GET /compute/v2.1/servers/b5943844-32ec-464b-b08f-7a618260f817 => generated 1321 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:54:15.789763 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a2fbe2f8-313d-48d0-a050-bcbb115dabfd tempest-FlavorsV2TestJSON-819267991 tempest-FlavorsV2TestJSON-819267991-project] 10.222.0.46 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.044463 Jan 15 20:54:15.790537 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 880/1695] 10.222.0.46 () {58 vars in 1139 bytes} [Sat Jan 15 20:54:15 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:54:15.803179 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d5ef023a-dfc5-4540-bc14-9696aab60016 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:15.803784 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-d5ef023a-dfc5-4540-bc14-9696aab60016 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] [instance: eec0d897-b487-4021-8cc1-b94824339dc4] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:15.826176 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d5ef023a-dfc5-4540-bc14-9696aab60016 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:15.826845 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d5ef023a-dfc5-4540-bc14-9696aab60016 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:15.828112 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d5ef023a-dfc5-4540-bc14-9696aab60016 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:15.828603 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d5ef023a-dfc5-4540-bc14-9696aab60016 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:16.297140 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-d5ef023a-dfc5-4540-bc14-9696aab60016 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55be87ae7f14b499ab2cd6fc5538988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd217e7fd648b4a78c0c32ff1c95f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:16.307352 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d5ef023a-dfc5-4540-bc14-9696aab60016 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "GET /compute/v2.1/servers/eec0d897-b487-4021-8cc1-b94824339dc4" status: 200 len: 1308 microversion: 2.1 time: 0.507682 Jan 15 20:54:16.315949 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 881/1696] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:54:15 2022] GET /compute/v2.1/servers/eec0d897-b487-4021-8cc1-b94824339dc4 => generated 1308 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:54:16.321708 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-648515e4-96da-4572-b626-dbac4539e25e tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:16.324617 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-648515e4-96da-4572-b626-dbac4539e25e tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] [instance: 770bfdbf-2ac6-4ab9-b2e3-f9e43ae88af6] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:16.349765 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-648515e4-96da-4572-b626-dbac4539e25e tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:16.351359 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-648515e4-96da-4572-b626-dbac4539e25e tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:16.352253 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-648515e4-96da-4572-b626-dbac4539e25e tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:16.352632 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-648515e4-96da-4572-b626-dbac4539e25e tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:16.382134 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-7e1c3663-c009-4e1f-818b-236720e75677 req-4b11208c-825c-4a5d-ad4c-85b6557c2c76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eec0d897-b487-4021-8cc1-b94824339dc4", "name": "network-vif-plugged", "status": "completed", "tag": "f35ca04a-094e-42bc-a7ee-c8ee9d748f3f"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:54:16.383852 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:54:16.383852 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:54:16.398482 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-648515e4-96da-4572-b626-dbac4539e25e tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:16.399076 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-648515e4-96da-4572-b626-dbac4539e25e tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:16.399508 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.objects.instance [None req-648515e4-96da-4572-b626-dbac4539e25e tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lazy-loading 'fault' on Instance uuid 770bfdbf-2ac6-4ab9-b2e3-f9e43ae88af6 {{(pid=129366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 20:54:16.435684 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-7e1c3663-c009-4e1f-818b-236720e75677 req-4b11208c-825c-4a5d-ad4c-85b6557c2c76 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:16.437387 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-7e1c3663-c009-4e1f-818b-236720e75677 req-4b11208c-825c-4a5d-ad4c-85b6557c2c76 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:16.464623 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-7e1c3663-c009-4e1f-818b-236720e75677 req-4b11208c-825c-4a5d-ad4c-85b6557c2c76 service nova] Creating event network-vif-plugged:f35ca04a-094e-42bc-a7ee-c8ee9d748f3f for instance eec0d897-b487-4021-8cc1-b94824339dc4 on nch1-master-1 Jan 15 20:54:16.485216 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-7e1c3663-c009-4e1f-818b-236720e75677 req-4b11208c-825c-4a5d-ad4c-85b6557c2c76 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.687675 Jan 15 20:54:16.501153 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 816/1697] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:54:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:54:16.551641 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-28261bf0-c604-46c5-b30e-116fd9dbd70a tempest-FlavorsV2TestJSON-819267991 tempest-FlavorsV2TestJSON-819267991-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:16.594914 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-28261bf0-c604-46c5-b30e-116fd9dbd70a tempest-FlavorsV2TestJSON-819267991 tempest-FlavorsV2TestJSON-819267991-project] 10.222.0.46 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.065883 Jan 15 20:54:16.595869 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 817/1698] 10.222.0.46 () {58 vars in 1136 bytes} [Sat Jan 15 20:54:16 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:54:16.607332 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-6f84afcd-c2df-4b37-a42d-a037605fcf2d req-eed8382e-632f-4912-8902-7821f1f6ac9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5943844-32ec-464b-b08f-7a618260f817", "tag": "7372087d-b55f-45da-b646-85a04a10f042"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:54:16.611295 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:54:16.611295 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:54:16.621488 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-6f84afcd-c2df-4b37-a42d-a037605fcf2d req-eed8382e-632f-4912-8902-7821f1f6ac9f service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:16.622259 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-6f84afcd-c2df-4b37-a42d-a037605fcf2d req-eed8382e-632f-4912-8902-7821f1f6ac9f service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:16.638609 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-6f84afcd-c2df-4b37-a42d-a037605fcf2d req-eed8382e-632f-4912-8902-7821f1f6ac9f service nova] Creating event network-changed:7372087d-b55f-45da-b646-85a04a10f042 for instance b5943844-32ec-464b-b08f-7a618260f817 on nch1-master-1 Jan 15 20:54:16.681596 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-6f84afcd-c2df-4b37-a42d-a037605fcf2d req-eed8382e-632f-4912-8902-7821f1f6ac9f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077020 Jan 15 20:54:16.684998 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 818/1699] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:54:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:54:16.703292 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-5964236b-0322-4567-816a-baabf8a82e73 req-3f4d49a8-4e0c-433c-b211-471a9d26c46e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "770bfdbf-2ac6-4ab9-b2e3-f9e43ae88af6", "name": "network-vif-deleted", "tag": "6a747998-2bca-46bb-a26f-e7c31a2aa686"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:54:16.708817 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:54:16.708817 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:54:16.729381 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-5964236b-0322-4567-816a-baabf8a82e73 req-3f4d49a8-4e0c-433c-b211-471a9d26c46e service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:16.731348 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-5964236b-0322-4567-816a-baabf8a82e73 req-3f4d49a8-4e0c-433c-b211-471a9d26c46e service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:16.763876 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-5964236b-0322-4567-816a-baabf8a82e73 req-3f4d49a8-4e0c-433c-b211-471a9d26c46e service nova] Creating event network-vif-deleted:6a747998-2bca-46bb-a26f-e7c31a2aa686 for instance 770bfdbf-2ac6-4ab9-b2e3-f9e43ae88af6 on nch2-master-1 Jan 15 20:54:16.781046 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-5964236b-0322-4567-816a-baabf8a82e73 req-3f4d49a8-4e0c-433c-b211-471a9d26c46e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088881 Jan 15 20:54:16.782463 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 819/1700] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:54:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:54:16.796286 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-243293a7-10bb-4162-aab5-2fc3f5368b64 tempest-FlavorsV2TestJSON-819267991 tempest-FlavorsV2TestJSON-819267991-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:16.915912 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-243293a7-10bb-4162-aab5-2fc3f5368b64 tempest-FlavorsV2TestJSON-819267991 tempest-FlavorsV2TestJSON-819267991-project] 10.222.0.46 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.131839 Jan 15 20:54:16.929492 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 820/1701] 10.222.0.46 () {58 vars in 1145 bytes} [Sat Jan 15 20:54:16 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:54:16.934952 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-dca15f47-a15f-475f-89f7-7c63d569f197 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:16.936096 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-dca15f47-a15f-475f-89f7-7c63d569f197 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] [instance: f6a6025e-5439-4ba5-a8b8-20019413661b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:16.949575 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dca15f47-a15f-475f-89f7-7c63d569f197 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:16.950121 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dca15f47-a15f-475f-89f7-7c63d569f197 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:16.951387 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dca15f47-a15f-475f-89f7-7c63d569f197 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:16.953122 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dca15f47-a15f-475f-89f7-7c63d569f197 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:17.380510 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-648515e4-96da-4572-b626-dbac4539e25e tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:17.395573 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-648515e4-96da-4572-b626-dbac4539e25e tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:17.400943 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-648515e4-96da-4572-b626-dbac4539e25e tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ede5f7e26d484fb1c6f18819a90e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:17.407904 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-648515e4-96da-4572-b626-dbac4539e25e tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] 10.222.0.46 "GET /compute/v2.1/servers/770bfdbf-2ac6-4ab9-b2e3-f9e43ae88af6" status: 200 len: 1351 microversion: 2.25 time: 1.090563 Jan 15 20:54:17.411177 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 882/1702] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:54:16 2022] GET /compute/v2.1/servers/770bfdbf-2ac6-4ab9-b2e3-f9e43ae88af6 => generated 1351 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:54:17.427854 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-393ebddc-7f45-4306-96c5-454cd0060156 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:17.432041 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-393ebddc-7f45-4306-96c5-454cd0060156 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] [instance: b5943844-32ec-464b-b08f-7a618260f817] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:17.445855 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-393ebddc-7f45-4306-96c5-454cd0060156 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:17.447448 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-393ebddc-7f45-4306-96c5-454cd0060156 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:17.448639 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-393ebddc-7f45-4306-96c5-454cd0060156 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:17.449273 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-393ebddc-7f45-4306-96c5-454cd0060156 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:17.541615 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-dca15f47-a15f-475f-89f7-7c63d569f197 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17e2708b6fc41b1ae6f70bcf99a0170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515bef049574d4ea4c70f90ab8c4444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:17.551207 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-dca15f47-a15f-475f-89f7-7c63d569f197 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] 10.222.0.46 "GET /compute/v2.1/servers/f6a6025e-5439-4ba5-a8b8-20019413661b" status: 200 len: 1316 microversion: 2.1 time: 0.619976 Jan 15 20:54:17.551805 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 821/1703] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:54:16 2022] GET /compute/v2.1/servers/f6a6025e-5439-4ba5-a8b8-20019413661b => generated 1316 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:54:17.559014 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-45ed6546-907d-43e5-a31d-377b29aee125 tempest-FlavorsV2TestJSON-819267991 tempest-FlavorsV2TestJSON-819267991-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:17.599268 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-45ed6546-907d-43e5-a31d-377b29aee125 tempest-FlavorsV2TestJSON-819267991 tempest-FlavorsV2TestJSON-819267991-project] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.046388 Jan 15 20:54:17.616274 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 822/1704] 10.222.0.46 () {58 vars in 1145 bytes} [Sat Jan 15 20:54:17 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:54:17.674067 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-393ebddc-7f45-4306-96c5-454cd0060156 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b8081a7f0446389dd03a3182585b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e7b99384e224302b8ad9303f560cc4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:17.684613 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-393ebddc-7f45-4306-96c5-454cd0060156 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] 10.222.0.46 "GET /compute/v2.1/servers/b5943844-32ec-464b-b08f-7a618260f817" status: 200 len: 1321 microversion: 2.1 time: 0.271067 Jan 15 20:54:17.686176 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 883/1705] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:54:17 2022] GET /compute/v2.1/servers/b5943844-32ec-464b-b08f-7a618260f817 => generated 1321 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:54:17.691289 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-2c95bcae-09ca-4f8a-b9ad-ea0aac1660db tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:17.692100 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-2c95bcae-09ca-4f8a-b9ad-ea0aac1660db tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] [instance: eec0d897-b487-4021-8cc1-b94824339dc4] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:17.702107 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2c95bcae-09ca-4f8a-b9ad-ea0aac1660db tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:17.703445 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2c95bcae-09ca-4f8a-b9ad-ea0aac1660db tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:17.705032 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2c95bcae-09ca-4f8a-b9ad-ea0aac1660db tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:17.705726 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2c95bcae-09ca-4f8a-b9ad-ea0aac1660db tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:17.979836 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-759a1010-fb3b-44fa-a0ec-313001d159d8 tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-1452246829", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:54:18.067194 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.network.neutron [None req-759a1010-fb3b-44fa-a0ec-313001d159d8 tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] validate_networks() for None {{(pid=129365) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 20:54:18.204320 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-2c95bcae-09ca-4f8a-b9ad-ea0aac1660db tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55be87ae7f14b499ab2cd6fc5538988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd217e7fd648b4a78c0c32ff1c95f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:18.212232 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-2c95bcae-09ca-4f8a-b9ad-ea0aac1660db tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "GET /compute/v2.1/servers/eec0d897-b487-4021-8cc1-b94824339dc4" status: 200 len: 1308 microversion: 2.1 time: 0.524819 Jan 15 20:54:18.216492 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 884/1706] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:54:17 2022] GET /compute/v2.1/servers/eec0d897-b487-4021-8cc1-b94824339dc4 => generated 1308 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:54:18.228257 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0059f884-0b88-46c6-abda-785a39349a4a tempest-FlavorsV2TestJSON-819267991 tempest-FlavorsV2TestJSON-819267991-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:18.246699 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0059f884-0b88-46c6-abda-785a39349a4a tempest-FlavorsV2TestJSON-819267991 tempest-FlavorsV2TestJSON-819267991-project] 10.222.0.46 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.025890 Jan 15 20:54:18.251697 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 885/1707] 10.222.0.46 () {58 vars in 1136 bytes} [Sat Jan 15 20:54:18 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:54:18.432187 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-759e4101-7381-4acd-897e-722f1ea8423f tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:18.432962 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-759e4101-7381-4acd-897e-722f1ea8423f tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] [instance: 770bfdbf-2ac6-4ab9-b2e3-f9e43ae88af6] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:18.455676 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-759e4101-7381-4acd-897e-722f1ea8423f tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:18.456141 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-759e4101-7381-4acd-897e-722f1ea8423f tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:18.456993 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-759e4101-7381-4acd-897e-722f1ea8423f tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:18.457433 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-759e4101-7381-4acd-897e-722f1ea8423f tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:18.524596 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-759e4101-7381-4acd-897e-722f1ea8423f tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] HTTP exception thrown: Instance 770bfdbf-2ac6-4ab9-b2e3-f9e43ae88af6 could not be found. Jan 15 20:54:18.533996 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-759e4101-7381-4acd-897e-722f1ea8423f tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] Returning 404 to user: Instance 770bfdbf-2ac6-4ab9-b2e3-f9e43ae88af6 could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:54:18.535488 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-759e4101-7381-4acd-897e-722f1ea8423f tempest-LiveAutoBlockMigrationV225Test-561034217 tempest-LiveAutoBlockMigrationV225Test-561034217-project] 10.222.0.46 "GET /compute/v2.1/servers/770bfdbf-2ac6-4ab9-b2e3-f9e43ae88af6" status: 404 len: 111 microversion: 2.25 time: 0.110378 Jan 15 20:54:18.540497 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 886/1708] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:54:18 2022] GET /compute/v2.1/servers/770bfdbf-2ac6-4ab9-b2e3-f9e43ae88af6 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jan 15 20:54:18.568057 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-5ea1026e-2b78-4b56-8256-04343391968a tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:18.568955 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-5ea1026e-2b78-4b56-8256-04343391968a tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] [instance: f6a6025e-5439-4ba5-a8b8-20019413661b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:18.584152 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5ea1026e-2b78-4b56-8256-04343391968a tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:18.599909 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5ea1026e-2b78-4b56-8256-04343391968a tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:18.601312 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5ea1026e-2b78-4b56-8256-04343391968a tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:18.602052 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5ea1026e-2b78-4b56-8256-04343391968a tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:18.736576 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-759a1010-fb3b-44fa-a0ec-313001d159d8 tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] Flavor limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 20:54:18.737034 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-759a1010-fb3b-44fa-a0ec-313001d159d8 tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] Image limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 20:54:18.737687 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-759a1010-fb3b-44fa-a0ec-313001d159d8 tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] Flavor pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 20:54:18.738537 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-759a1010-fb3b-44fa-a0ec-313001d159d8 tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] Image pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 20:54:18.738972 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-759a1010-fb3b-44fa-a0ec-313001d159d8 tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 20:54:18.765022 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-759a1010-fb3b-44fa-a0ec-313001d159d8 tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:18.767527 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-759a1010-fb3b-44fa-a0ec-313001d159d8 tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:18.770418 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-759a1010-fb3b-44fa-a0ec-313001d159d8 tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:18.772156 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-759a1010-fb3b-44fa-a0ec-313001d159d8 tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:18.824248 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-759a1010-fb3b-44fa-a0ec-313001d159d8 tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] Getting quotas for project 08c18cfa337f4413afcb5b0741441512. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:54:18.841325 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-759a1010-fb3b-44fa-a0ec-313001d159d8 tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] Getting quotas for user 9f600415e36a4c909b49948cbae3f34f and project 08c18cfa337f4413afcb5b0741441512. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:54:18.876571 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-759a1010-fb3b-44fa-a0ec-313001d159d8 tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] Going to run 1 instances... {{(pid=129365) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 20:54:18.884556 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-759a1010-fb3b-44fa-a0ec-313001d159d8 tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] [instance: 41de38d6-3f2c-4912-adae-bef0ad0ffbb1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129365) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 20:54:19.002823 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-759a1010-fb3b-44fa-a0ec-313001d159d8 tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.380503 Jan 15 20:54:19.005161 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 823/1709] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 20:54:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1388 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 20:54:19.016556 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c5923b3d-a800-403e-8ced-57928e701079 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:19.018512 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c5923b3d-a800-403e-8ced-57928e701079 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] [instance: b5943844-32ec-464b-b08f-7a618260f817] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:19.038809 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c5923b3d-a800-403e-8ced-57928e701079 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:19.040314 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c5923b3d-a800-403e-8ced-57928e701079 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:19.043553 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c5923b3d-a800-403e-8ced-57928e701079 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:19.044780 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c5923b3d-a800-403e-8ced-57928e701079 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:19.436972 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-5ea1026e-2b78-4b56-8256-04343391968a tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17e2708b6fc41b1ae6f70bcf99a0170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515bef049574d4ea4c70f90ab8c4444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:19.452058 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-5ea1026e-2b78-4b56-8256-04343391968a tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] 10.222.0.46 "GET /compute/v2.1/servers/f6a6025e-5439-4ba5-a8b8-20019413661b" status: 200 len: 1316 microversion: 2.1 time: 0.885096 Jan 15 20:54:19.453533 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 887/1710] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:54:18 2022] GET /compute/v2.1/servers/f6a6025e-5439-4ba5-a8b8-20019413661b => generated 1316 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:54:19.465267 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-726bd2a2-db6b-47dd-a247-92707addd9d1 tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:19.466543 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-726bd2a2-db6b-47dd-a247-92707addd9d1 tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] [instance: 41de38d6-3f2c-4912-adae-bef0ad0ffbb1] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:19.635431 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-726bd2a2-db6b-47dd-a247-92707addd9d1 tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f600415e36a4c909b49948cbae3f34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c18cfa337f4413afcb5b0741441512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:19.659751 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-726bd2a2-db6b-47dd-a247-92707addd9d1 tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] 10.222.0.46 "GET /compute/v2.1/servers/41de38d6-3f2c-4912-adae-bef0ad0ffbb1" status: 200 len: 1223 microversion: 2.1 time: 0.202996 Jan 15 20:54:19.663789 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 888/1711] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:54:19 2022] GET /compute/v2.1/servers/41de38d6-3f2c-4912-adae-bef0ad0ffbb1 => generated 1223 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:54:19.679542 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-2048baf4-33b3-441f-9c3a-1c6636c12cec req-adab11fb-b0de-4d76-a26c-973b9eac11d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6a6025e-5439-4ba5-a8b8-20019413661b", "name": "network-vif-plugged", "status": "completed", "tag": "cf311698-e345-42ab-8508-0fa2a6da33ab"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:54:19.688579 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:54:19.688579 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:54:19.714793 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-2048baf4-33b3-441f-9c3a-1c6636c12cec req-adab11fb-b0de-4d76-a26c-973b9eac11d4 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:19.718045 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-2048baf4-33b3-441f-9c3a-1c6636c12cec req-adab11fb-b0de-4d76-a26c-973b9eac11d4 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:19.755719 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-2048baf4-33b3-441f-9c3a-1c6636c12cec req-adab11fb-b0de-4d76-a26c-973b9eac11d4 service nova] Creating event network-vif-plugged:cf311698-e345-42ab-8508-0fa2a6da33ab for instance f6a6025e-5439-4ba5-a8b8-20019413661b on nch2-master-1 Jan 15 20:54:19.793627 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-2048baf4-33b3-441f-9c3a-1c6636c12cec req-adab11fb-b0de-4d76-a26c-973b9eac11d4 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125221 Jan 15 20:54:19.806404 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 889/1712] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:54:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:54:19.816516 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ddea2d1c-6b76-4d19-9962-6d145720ba00 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:19.847913 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ddea2d1c-6b76-4d19-9962-6d145720ba00 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] [instance: eec0d897-b487-4021-8cc1-b94824339dc4] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:19.874419 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ddea2d1c-6b76-4d19-9962-6d145720ba00 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:19.875218 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ddea2d1c-6b76-4d19-9962-6d145720ba00 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:19.876310 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ddea2d1c-6b76-4d19-9962-6d145720ba00 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:19.878132 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ddea2d1c-6b76-4d19-9962-6d145720ba00 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:20.243671 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-c5923b3d-a800-403e-8ced-57928e701079 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b8081a7f0446389dd03a3182585b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e7b99384e224302b8ad9303f560cc4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:20.272075 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c5923b3d-a800-403e-8ced-57928e701079 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] 10.222.0.46 "GET /compute/v2.1/servers/b5943844-32ec-464b-b08f-7a618260f817" status: 200 len: 1321 microversion: 2.1 time: 1.265467 Jan 15 20:54:20.274266 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 824/1713] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:54:19 2022] GET /compute/v2.1/servers/b5943844-32ec-464b-b08f-7a618260f817 => generated 1321 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:54:20.488977 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a6d194a6-dcd9-4509-948e-ae5071dc0a98 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:20.493529 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a6d194a6-dcd9-4509-948e-ae5071dc0a98 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] [instance: f6a6025e-5439-4ba5-a8b8-20019413661b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:20.539828 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a6d194a6-dcd9-4509-948e-ae5071dc0a98 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:20.550036 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a6d194a6-dcd9-4509-948e-ae5071dc0a98 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:20.553526 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a6d194a6-dcd9-4509-948e-ae5071dc0a98 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:20.566970 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a6d194a6-dcd9-4509-948e-ae5071dc0a98 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:20.926245 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-ddea2d1c-6b76-4d19-9962-6d145720ba00 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55be87ae7f14b499ab2cd6fc5538988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd217e7fd648b4a78c0c32ff1c95f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:20.940008 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ddea2d1c-6b76-4d19-9962-6d145720ba00 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "GET /compute/v2.1/servers/eec0d897-b487-4021-8cc1-b94824339dc4" status: 200 len: 1488 microversion: 2.1 time: 1.127404 Jan 15 20:54:20.940619 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 890/1714] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:54:19 2022] GET /compute/v2.1/servers/eec0d897-b487-4021-8cc1-b94824339dc4 => generated 1488 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:54:20.963956 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-cff3f1d7-6d5e-4553-9570-406c28ff35eb tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:20.973317 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-cff3f1d7-6d5e-4553-9570-406c28ff35eb tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] [instance: 41de38d6-3f2c-4912-adae-bef0ad0ffbb1] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:20.999379 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cff3f1d7-6d5e-4553-9570-406c28ff35eb tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:21.001458 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cff3f1d7-6d5e-4553-9570-406c28ff35eb tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:21.013071 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cff3f1d7-6d5e-4553-9570-406c28ff35eb tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:21.013539 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cff3f1d7-6d5e-4553-9570-406c28ff35eb tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:21.183455 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-cff3f1d7-6d5e-4553-9570-406c28ff35eb tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f600415e36a4c909b49948cbae3f34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c18cfa337f4413afcb5b0741441512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:21.195097 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-cff3f1d7-6d5e-4553-9570-406c28ff35eb tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] 10.222.0.46 "GET /compute/v2.1/servers/41de38d6-3f2c-4912-adae-bef0ad0ffbb1" status: 200 len: 1283 microversion: 2.1 time: 0.241975 Jan 15 20:54:21.197094 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 891/1715] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:54:20 2022] GET /compute/v2.1/servers/41de38d6-3f2c-4912-adae-bef0ad0ffbb1 => generated 1283 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:54:21.205053 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ecfcd21f-4998-4a83-bdad-2a049476bc47 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-2141375216"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:54:21.206342 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ecfcd21f-4998-4a83-bdad-2a049476bc47 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] [instance: eec0d897-b487-4021-8cc1-b94824339dc4] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:21.214585 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ecfcd21f-4998-4a83-bdad-2a049476bc47 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:21.215432 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ecfcd21f-4998-4a83-bdad-2a049476bc47 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:21.218535 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ecfcd21f-4998-4a83-bdad-2a049476bc47 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:21.219669 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ecfcd21f-4998-4a83-bdad-2a049476bc47 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:21.263406 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-a6d194a6-dcd9-4509-948e-ae5071dc0a98 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17e2708b6fc41b1ae6f70bcf99a0170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515bef049574d4ea4c70f90ab8c4444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:21.273319 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a6d194a6-dcd9-4509-948e-ae5071dc0a98 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] 10.222.0.46 "GET /compute/v2.1/servers/f6a6025e-5439-4ba5-a8b8-20019413661b" status: 200 len: 1316 microversion: 2.1 time: 0.805279 Jan 15 20:54:21.274026 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 825/1716] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:54:20 2022] GET /compute/v2.1/servers/f6a6025e-5439-4ba5-a8b8-20019413661b => generated 1316 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:54:21.442025 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-cf8392a3-926b-4c04-b7c5-cbc3c4e38ba4 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-571285025", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "networks": [{"uuid": "b7ee6eaf-eda1-43c9-9d45-4bb747012a97"}]}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:54:21.520158 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.network.neutron [None req-cf8392a3-926b-4c04-b7c5-cbc3c4e38ba4 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] validate_networks() for [('b7ee6eaf-eda1-43c9-9d45-4bb747012a97', None, None, None, None, None)] {{(pid=129365) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 20:54:21.567026 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ecfcd21f-4998-4a83-bdad-2a049476bc47 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "POST /compute/v2.1/servers/eec0d897-b487-4021-8cc1-b94824339dc4/action" status: 202 len: 0 microversion: 2.1 time: 0.368315 Jan 15 20:54:21.568131 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 892/1717] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:54:21 2022] POST /compute/v2.1/servers/eec0d897-b487-4021-8cc1-b94824339dc4/action => generated 0 bytes in 370 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jan 15 20:54:21.582255 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a5715f7f-47a5-4ba0-9861-bd24f6e575fd tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:21.583635 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a5715f7f-47a5-4ba0-9861-bd24f6e575fd tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] [instance: b5943844-32ec-464b-b08f-7a618260f817] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:21.599977 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a5715f7f-47a5-4ba0-9861-bd24f6e575fd tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:21.600784 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a5715f7f-47a5-4ba0-9861-bd24f6e575fd tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:21.602103 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a5715f7f-47a5-4ba0-9861-bd24f6e575fd tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:21.602747 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a5715f7f-47a5-4ba0-9861-bd24f6e575fd tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:21.957664 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-a5715f7f-47a5-4ba0-9861-bd24f6e575fd tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b8081a7f0446389dd03a3182585b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e7b99384e224302b8ad9303f560cc4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:21.971438 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a5715f7f-47a5-4ba0-9861-bd24f6e575fd tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] 10.222.0.46 "GET /compute/v2.1/servers/b5943844-32ec-464b-b08f-7a618260f817" status: 200 len: 1321 microversion: 2.1 time: 0.401913 Jan 15 20:54:21.972180 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 893/1718] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:54:21 2022] GET /compute/v2.1/servers/b5943844-32ec-464b-b08f-7a618260f817 => generated 1321 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:54:21.978864 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-01628ef9-7a05-4a5d-ad08-4d6f9a5fe499 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '.version_select at 0x7f30c8e95940>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:22.067729 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-01628ef9-7a05-4a5d-ad08-4d6f9a5fe499 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "GET /compute/v2.1/images/d6fbd57d-1ddc-4c6d-900a-55535bb8d408" status: 200 len: 1414 microversion: 2.1 time: 0.093991 Jan 15 20:54:22.068305 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 894/1719] 10.222.0.46 () {58 vars in 1232 bytes} [Sat Jan 15 20:54:21 2022] GET /compute/v2.1/images/d6fbd57d-1ddc-4c6d-900a-55535bb8d408 => generated 1414 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:54:22.081157 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-fa813193-cdd9-492a-a738-66528db167d5 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '.version_select at 0x7f30c8e35b80>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:22.144933 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-fa813193-cdd9-492a-a738-66528db167d5 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "GET /compute/v2.1/images/d6fbd57d-1ddc-4c6d-900a-55535bb8d408" status: 200 len: 1414 microversion: 2.1 time: 0.068325 Jan 15 20:54:22.152626 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 895/1720] 10.222.0.46 () {58 vars in 1232 bytes} [Sat Jan 15 20:54:22 2022] GET /compute/v2.1/images/d6fbd57d-1ddc-4c6d-900a-55535bb8d408 => generated 1414 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:54:22.161937 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-5f73e73a-df00-4a68-b1c9-64ac38fc1537 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '.version_select at 0x7f30c8ed1430>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:22.384922 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-5f73e73a-df00-4a68-b1c9-64ac38fc1537 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "DELETE /compute/v2.1/images/d6fbd57d-1ddc-4c6d-900a-55535bb8d408" status: 204 len: 0 microversion: 2.1 time: 0.230544 Jan 15 20:54:22.385587 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 896/1721] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:54:22 2022] DELETE /compute/v2.1/images/d6fbd57d-1ddc-4c6d-900a-55535bb8d408 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 20:54:22.395487 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-26680edf-2639-46dd-b86b-8b21acf122dc tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:22.396532 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-26680edf-2639-46dd-b86b-8b21acf122dc tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] [instance: 41de38d6-3f2c-4912-adae-bef0ad0ffbb1] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:22.412732 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-26680edf-2639-46dd-b86b-8b21acf122dc tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:22.414928 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-26680edf-2639-46dd-b86b-8b21acf122dc tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:22.416122 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-26680edf-2639-46dd-b86b-8b21acf122dc tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:22.418295 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-26680edf-2639-46dd-b86b-8b21acf122dc tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:22.431224 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-cf8392a3-926b-4c04-b7c5-cbc3c4e38ba4 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Flavor limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 20:54:22.431224 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-cf8392a3-926b-4c04-b7c5-cbc3c4e38ba4 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Image limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 20:54:22.432048 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-cf8392a3-926b-4c04-b7c5-cbc3c4e38ba4 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Flavor pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 20:54:22.432389 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-cf8392a3-926b-4c04-b7c5-cbc3c4e38ba4 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Image pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 20:54:22.433565 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-cf8392a3-926b-4c04-b7c5-cbc3c4e38ba4 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 20:54:22.447917 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cf8392a3-926b-4c04-b7c5-cbc3c4e38ba4 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:22.448766 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cf8392a3-926b-4c04-b7c5-cbc3c4e38ba4 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:22.450326 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cf8392a3-926b-4c04-b7c5-cbc3c4e38ba4 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:22.450970 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cf8392a3-926b-4c04-b7c5-cbc3c4e38ba4 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:22.478063 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-cf8392a3-926b-4c04-b7c5-cbc3c4e38ba4 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Getting quotas for project f6d5d92c87544c4d8080e19c1f6429bf. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:54:22.486827 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-cf8392a3-926b-4c04-b7c5-cbc3c4e38ba4 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Getting quotas for user 2e1b423e1a9146c8bb202ba012e2ee2a and project f6d5d92c87544c4d8080e19c1f6429bf. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:54:22.501655 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-cf8392a3-926b-4c04-b7c5-cbc3c4e38ba4 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Going to run 1 instances... {{(pid=129365) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 20:54:22.504153 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-cf8392a3-926b-4c04-b7c5-cbc3c4e38ba4 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] [instance: 21c7200b-cace-49b4-ab7f-bf43771825ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129365) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 20:54:22.596530 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-26680edf-2639-46dd-b86b-8b21acf122dc tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f600415e36a4c909b49948cbae3f34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c18cfa337f4413afcb5b0741441512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:22.620689 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-26680edf-2639-46dd-b86b-8b21acf122dc tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] 10.222.0.46 "GET /compute/v2.1/servers/41de38d6-3f2c-4912-adae-bef0ad0ffbb1" status: 200 len: 1281 microversion: 2.1 time: 0.229637 Jan 15 20:54:22.634379 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 897/1722] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:54:22 2022] GET /compute/v2.1/servers/41de38d6-3f2c-4912-adae-bef0ad0ffbb1 => generated 1281 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:54:22.649605 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-2d246bdb-5d0b-49c8-a471-2f6dce024a5d tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:22.651107 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-2d246bdb-5d0b-49c8-a471-2f6dce024a5d tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] [instance: f6a6025e-5439-4ba5-a8b8-20019413661b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:22.671885 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2d246bdb-5d0b-49c8-a471-2f6dce024a5d tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:22.672652 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2d246bdb-5d0b-49c8-a471-2f6dce024a5d tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:22.675831 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2d246bdb-5d0b-49c8-a471-2f6dce024a5d tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:22.676638 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2d246bdb-5d0b-49c8-a471-2f6dce024a5d tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:22.690229 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-cf8392a3-926b-4c04-b7c5-cbc3c4e38ba4 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.413373 Jan 15 20:54:22.697985 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 826/1723] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 20:54:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1423 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 20:54:22.719162 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b680f583-f03c-46c0-b92a-5e83b8d88455 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '.version_select at 0x7f30ceb794c0>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:22.751058 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-b680f583-f03c-46c0-b92a-5e83b8d88455 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] HTTP exception thrown: Image not found. Jan 15 20:54:22.751991 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b680f583-f03c-46c0-b92a-5e83b8d88455 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Returning 404 to user: Image not found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:54:22.753293 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b680f583-f03c-46c0-b92a-5e83b8d88455 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "GET /compute/v2.1/images/d6fbd57d-1ddc-4c6d-900a-55535bb8d408" status: 404 len: 62 microversion: 2.1 time: 0.053136 Jan 15 20:54:22.755058 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 827/1724] 10.222.0.46 () {58 vars in 1232 bytes} [Sat Jan 15 20:54:22 2022] GET /compute/v2.1/images/d6fbd57d-1ddc-4c6d-900a-55535bb8d408 => generated 62 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jan 15 20:54:22.763248 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8c99db2d-87c2-4b27-a3e9-8d0c69a08cc1 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:22.764341 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-8c99db2d-87c2-4b27-a3e9-8d0c69a08cc1 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] [instance: 21c7200b-cace-49b4-ab7f-bf43771825ed] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:22.884486 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-8c99db2d-87c2-4b27-a3e9-8d0c69a08cc1 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e1b423e1a9146c8bb202ba012e2ee2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d5d92c87544c4d8080e19c1f6429bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:22.895973 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-8c99db2d-87c2-4b27-a3e9-8d0c69a08cc1 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] 10.222.0.46 "GET /compute/v2.1/servers/21c7200b-cace-49b4-ab7f-bf43771825ed" status: 200 len: 1224 microversion: 2.1 time: 0.136770 Jan 15 20:54:22.907219 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 828/1725] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:54:22 2022] GET /compute/v2.1/servers/21c7200b-cace-49b4-ab7f-bf43771825ed => generated 1224 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:54:22.914581 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b8f132b1-ddbe-447e-9679-6c262d57cc87 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:22.915591 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b8f132b1-ddbe-447e-9679-6c262d57cc87 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] [instance: eec0d897-b487-4021-8cc1-b94824339dc4] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:22.924677 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b8f132b1-ddbe-447e-9679-6c262d57cc87 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:22.925407 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b8f132b1-ddbe-447e-9679-6c262d57cc87 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:22.926931 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b8f132b1-ddbe-447e-9679-6c262d57cc87 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:22.929063 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b8f132b1-ddbe-447e-9679-6c262d57cc87 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:23.163974 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-2d246bdb-5d0b-49c8-a471-2f6dce024a5d tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17e2708b6fc41b1ae6f70bcf99a0170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515bef049574d4ea4c70f90ab8c4444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:23.173126 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-2d246bdb-5d0b-49c8-a471-2f6dce024a5d tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] 10.222.0.46 "GET /compute/v2.1/servers/f6a6025e-5439-4ba5-a8b8-20019413661b" status: 200 len: 1505 microversion: 2.1 time: 0.536278 Jan 15 20:54:23.175718 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 898/1726] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:54:22 2022] GET /compute/v2.1/servers/f6a6025e-5439-4ba5-a8b8-20019413661b => generated 1505 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:54:23.189744 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-57eb5c14-e2b9-41de-9168-d1330ea9decf tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:23.190541 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-57eb5c14-e2b9-41de-9168-d1330ea9decf tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] [instance: b5943844-32ec-464b-b08f-7a618260f817] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:23.196719 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-57eb5c14-e2b9-41de-9168-d1330ea9decf tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:23.197416 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-57eb5c14-e2b9-41de-9168-d1330ea9decf tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:23.198497 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-57eb5c14-e2b9-41de-9168-d1330ea9decf tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:23.199086 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-57eb5c14-e2b9-41de-9168-d1330ea9decf tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:23.338330 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-b8f132b1-ddbe-447e-9679-6c262d57cc87 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55be87ae7f14b499ab2cd6fc5538988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd217e7fd648b4a78c0c32ff1c95f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:23.348536 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b8f132b1-ddbe-447e-9679-6c262d57cc87 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "GET /compute/v2.1/servers/eec0d897-b487-4021-8cc1-b94824339dc4" status: 200 len: 1506 microversion: 2.1 time: 0.439772 Jan 15 20:54:23.353196 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 829/1727] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:54:22 2022] GET /compute/v2.1/servers/eec0d897-b487-4021-8cc1-b94824339dc4 => generated 1506 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:54:23.463215 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-57eb5c14-e2b9-41de-9168-d1330ea9decf tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b8081a7f0446389dd03a3182585b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e7b99384e224302b8ad9303f560cc4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:23.478441 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-57eb5c14-e2b9-41de-9168-d1330ea9decf tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] 10.222.0.46 "GET /compute/v2.1/servers/b5943844-32ec-464b-b08f-7a618260f817" status: 200 len: 1321 microversion: 2.1 time: 0.300290 Jan 15 20:54:23.479264 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 899/1728] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:54:23 2022] GET /compute/v2.1/servers/b5943844-32ec-464b-b08f-7a618260f817 => generated 1321 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:54:23.496702 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a905e6d9-2c0d-42c6-b15b-13c96d29477f tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-21067796"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:54:23.497645 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a905e6d9-2c0d-42c6-b15b-13c96d29477f tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] [instance: f6a6025e-5439-4ba5-a8b8-20019413661b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:23.511076 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a905e6d9-2c0d-42c6-b15b-13c96d29477f tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:23.511804 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a905e6d9-2c0d-42c6-b15b-13c96d29477f tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:23.515105 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a905e6d9-2c0d-42c6-b15b-13c96d29477f tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:23.516046 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a905e6d9-2c0d-42c6-b15b-13c96d29477f tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:23.911422 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.network.security_group_api [None req-a905e6d9-2c0d-42c6-b15b-13c96d29477f tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Adding security group e251adca-5ba6-4b03-828d-e26b6bdb42fb to port cf311698-e345-42ab-8508-0fa2a6da33ab Jan 15 20:54:23.942784 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2ef002f1-e940-4443-a123-d5dc835831c7 tempest-FlavorsV2NegativeTest-464557771 tempest-FlavorsV2NegativeTest-464557771-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:23.953897 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2ef002f1-e940-4443-a123-d5dc835831c7 tempest-FlavorsV2NegativeTest-464557771 tempest-FlavorsV2NegativeTest-464557771-project] 10.222.0.46 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.599263 Jan 15 20:54:23.955154 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 830/1729] 10.222.0.46 () {58 vars in 1136 bytes} [Sat Jan 15 20:54:23 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:54:23.960241 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f81d5f93-7ef3-4343-905b-f1bf395c5121 tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:23.961612 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f81d5f93-7ef3-4343-905b-f1bf395c5121 tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] [instance: 41de38d6-3f2c-4912-adae-bef0ad0ffbb1] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:24.000763 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f81d5f93-7ef3-4343-905b-f1bf395c5121 tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:24.001877 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f81d5f93-7ef3-4343-905b-f1bf395c5121 tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:24.030074 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f81d5f93-7ef3-4343-905b-f1bf395c5121 tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:24.031053 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f81d5f93-7ef3-4343-905b-f1bf395c5121 tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:25.091057 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-f81d5f93-7ef3-4343-905b-f1bf395c5121 tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f600415e36a4c909b49948cbae3f34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c18cfa337f4413afcb5b0741441512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:25.108480 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f81d5f93-7ef3-4343-905b-f1bf395c5121 tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] 10.222.0.46 "GET /compute/v2.1/servers/41de38d6-3f2c-4912-adae-bef0ad0ffbb1" status: 200 len: 1323 microversion: 2.1 time: 1.151977 Jan 15 20:54:25.109327 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 831/1730] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:54:23 2022] GET /compute/v2.1/servers/41de38d6-3f2c-4912-adae-bef0ad0ffbb1 => generated 1323 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:54:25.120768 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3930eaef-f65f-4dd2-b8ae-0057ce120b3c tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:25.121863 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-3930eaef-f65f-4dd2-b8ae-0057ce120b3c tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] [instance: 21c7200b-cace-49b4-ab7f-bf43771825ed] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:25.136129 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3930eaef-f65f-4dd2-b8ae-0057ce120b3c tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:25.136834 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3930eaef-f65f-4dd2-b8ae-0057ce120b3c tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:25.137853 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3930eaef-f65f-4dd2-b8ae-0057ce120b3c tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:25.138465 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3930eaef-f65f-4dd2-b8ae-0057ce120b3c tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:25.333581 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-3930eaef-f65f-4dd2-b8ae-0057ce120b3c tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e1b423e1a9146c8bb202ba012e2ee2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d5d92c87544c4d8080e19c1f6429bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:25.347113 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3930eaef-f65f-4dd2-b8ae-0057ce120b3c tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] 10.222.0.46 "GET /compute/v2.1/servers/21c7200b-cace-49b4-ab7f-bf43771825ed" status: 200 len: 1282 microversion: 2.1 time: 0.236549 Jan 15 20:54:25.348435 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 832/1731] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:54:25 2022] GET /compute/v2.1/servers/21c7200b-cace-49b4-ab7f-bf43771825ed => generated 1282 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:54:25.361647 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9d1e2fb2-3fde-4eab-b578-a9db8032032c tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:25.362573 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-9d1e2fb2-3fde-4eab-b578-a9db8032032c tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] [instance: eec0d897-b487-4021-8cc1-b94824339dc4] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:25.387316 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9d1e2fb2-3fde-4eab-b578-a9db8032032c tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:25.388085 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9d1e2fb2-3fde-4eab-b578-a9db8032032c tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:25.389885 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9d1e2fb2-3fde-4eab-b578-a9db8032032c tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:25.390675 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9d1e2fb2-3fde-4eab-b578-a9db8032032c tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:25.668537 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a905e6d9-2c0d-42c6-b15b-13c96d29477f tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] 10.222.0.46 "POST /compute/v2.1/servers/f6a6025e-5439-4ba5-a8b8-20019413661b/action" status: 202 len: 0 microversion: 2.1 time: 2.188024 Jan 15 20:54:25.670190 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 900/1732] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:54:23 2022] POST /compute/v2.1/servers/f6a6025e-5439-4ba5-a8b8-20019413661b/action => generated 0 bytes in 2190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 20:54:25.675400 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ba4b1063-7064-4129-b447-d3e88f0f4ac7 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:25.676002 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ba4b1063-7064-4129-b447-d3e88f0f4ac7 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] [instance: b5943844-32ec-464b-b08f-7a618260f817] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:25.682849 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ba4b1063-7064-4129-b447-d3e88f0f4ac7 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:25.683457 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ba4b1063-7064-4129-b447-d3e88f0f4ac7 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:25.684420 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ba4b1063-7064-4129-b447-d3e88f0f4ac7 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:25.685046 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ba4b1063-7064-4129-b447-d3e88f0f4ac7 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:26.063400 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-9d1e2fb2-3fde-4eab-b578-a9db8032032c tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55be87ae7f14b499ab2cd6fc5538988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd217e7fd648b4a78c0c32ff1c95f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:26.104051 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-9d1e2fb2-3fde-4eab-b578-a9db8032032c tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "GET /compute/v2.1/servers/eec0d897-b487-4021-8cc1-b94824339dc4" status: 200 len: 1488 microversion: 2.1 time: 0.753603 Jan 15 20:54:26.106632 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-ba4b1063-7064-4129-b447-d3e88f0f4ac7 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b8081a7f0446389dd03a3182585b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e7b99384e224302b8ad9303f560cc4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:26.109033 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 833/1733] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:54:25 2022] GET /compute/v2.1/servers/eec0d897-b487-4021-8cc1-b94824339dc4 => generated 1488 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:54:26.115468 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ba4b1063-7064-4129-b447-d3e88f0f4ac7 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] 10.222.0.46 "GET /compute/v2.1/servers/b5943844-32ec-464b-b08f-7a618260f817" status: 200 len: 1321 microversion: 2.1 time: 0.444050 Jan 15 20:54:26.116144 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-340d3be1-48d1-41cc-9d2c-cea5368fbddd tempest-FlavorsV2NegativeTest-464557771 tempest-FlavorsV2NegativeTest-464557771-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1876858792", "imageRef": "3bdda38f-5572-406b-a6f8-2e1ca095de16", "flavorRef": "452"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:54:26.120820 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 901/1734] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:54:25 2022] GET /compute/v2.1/servers/b5943844-32ec-464b-b08f-7a618260f817 => generated 1321 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:54:26.134177 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c3f601e1-7091-4a21-8374-ec0d53564ea8 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Calling method '.version_select at 0x7f30c8e350d0>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:26.237287 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.network.neutron [None req-340d3be1-48d1-41cc-9d2c-cea5368fbddd tempest-FlavorsV2NegativeTest-464557771 tempest-FlavorsV2NegativeTest-464557771-project] validate_networks() for None {{(pid=129365) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 20:54:26.424916 ncdv-master-1 devstack@n-api.service[129366]: DEBUG neutronclient.v2_0.client [None req-c3f601e1-7091-4a21-8374-ec0d53564ea8 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group e251adca-5ba6-4b03-828d-e26b6bdb42fb in use.", "detail": ""}} {{(pid=129366) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jan 15 20:54:26.425945 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-c3f601e1-7091-4a21-8374-ec0d53564ea8 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] HTTP exception thrown: Security Group e251adca-5ba6-4b03-828d-e26b6bdb42fb in use. Jan 15 20:54:26.425945 ncdv-master-1 devstack@n-api.service[129366]: Neutron server returns request_ids: ['req-70dd76f8-2e70-4001-b579-f4812a3c3139'] Jan 15 20:54:26.426711 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c3f601e1-7091-4a21-8374-ec0d53564ea8 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Returning 400 to user: Security Group e251adca-5ba6-4b03-828d-e26b6bdb42fb in use. Jan 15 20:54:26.426711 ncdv-master-1 devstack@n-api.service[129366]: Neutron server returns request_ids: ['req-70dd76f8-2e70-4001-b579-f4812a3c3139'] {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:54:26.427734 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c3f601e1-7091-4a21-8374-ec0d53564ea8 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/e251adca-5ba6-4b03-828d-e26b6bdb42fb" status: 400 len: 185 microversion: 2.1 time: 0.305523 Jan 15 20:54:26.433365 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 902/1735] 10.222.0.46 () {58 vars in 1271 bytes} [Sat Jan 15 20:54:26 2022] DELETE /compute/v2.1/os-security-groups/e251adca-5ba6-4b03-828d-e26b6bdb42fb => generated 185 bytes in 311 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 15 20:54:26.442189 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-5314f339-a520-4724-a47f-da5becb9be56 req-37856ea9-1f81-43fd-948f-f0c3cd7802c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6a6025e-5439-4ba5-a8b8-20019413661b", "tag": "cf311698-e345-42ab-8508-0fa2a6da33ab"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:54:26.446171 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:54:26.446171 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:54:26.463051 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-5314f339-a520-4724-a47f-da5becb9be56 req-37856ea9-1f81-43fd-948f-f0c3cd7802c4 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:26.463472 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-5314f339-a520-4724-a47f-da5becb9be56 req-37856ea9-1f81-43fd-948f-f0c3cd7802c4 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:26.505323 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-5314f339-a520-4724-a47f-da5becb9be56 req-37856ea9-1f81-43fd-948f-f0c3cd7802c4 service nova] Creating event network-changed:cf311698-e345-42ab-8508-0fa2a6da33ab for instance f6a6025e-5439-4ba5-a8b8-20019413661b on nch2-master-1 Jan 15 20:54:26.516353 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-5314f339-a520-4724-a47f-da5becb9be56 req-37856ea9-1f81-43fd-948f-f0c3cd7802c4 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077680 Jan 15 20:54:26.517615 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 903/1736] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:54:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:54:26.527671 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-dc63a47b-26f8-4bda-9eb9-262dc7630ef4 tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:26.529994 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-dc63a47b-26f8-4bda-9eb9-262dc7630ef4 tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] [instance: 41de38d6-3f2c-4912-adae-bef0ad0ffbb1] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:26.546397 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dc63a47b-26f8-4bda-9eb9-262dc7630ef4 tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:26.554259 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dc63a47b-26f8-4bda-9eb9-262dc7630ef4 tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:26.555399 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dc63a47b-26f8-4bda-9eb9-262dc7630ef4 tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:26.555991 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dc63a47b-26f8-4bda-9eb9-262dc7630ef4 tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:26.684883 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-340d3be1-48d1-41cc-9d2c-cea5368fbddd tempest-FlavorsV2NegativeTest-464557771 tempest-FlavorsV2NegativeTest-464557771-project] HTTP exception thrown: Flavor's memory is too small for requested image. Jan 15 20:54:26.686679 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-340d3be1-48d1-41cc-9d2c-cea5368fbddd tempest-FlavorsV2NegativeTest-464557771 tempest-FlavorsV2NegativeTest-464557771-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:54:26.687701 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-340d3be1-48d1-41cc-9d2c-cea5368fbddd tempest-FlavorsV2NegativeTest-464557771 tempest-FlavorsV2NegativeTest-464557771-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.576616 Jan 15 20:54:26.689574 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 834/1737] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 20:54:26 2022] POST /compute/v2.1/servers => generated 93 bytes in 579 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jan 15 20:54:26.705417 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-6fdf6242-38ff-4a92-9cca-dc5d573d817c tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:26.706311 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-6fdf6242-38ff-4a92-9cca-dc5d573d817c tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] [instance: eec0d897-b487-4021-8cc1-b94824339dc4] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:26.747911 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6fdf6242-38ff-4a92-9cca-dc5d573d817c tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:26.750340 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6fdf6242-38ff-4a92-9cca-dc5d573d817c tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:26.769235 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6fdf6242-38ff-4a92-9cca-dc5d573d817c tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:26.772368 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6fdf6242-38ff-4a92-9cca-dc5d573d817c tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:26.850763 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-6fdf6242-38ff-4a92-9cca-dc5d573d817c tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] [instance: eec0d897-b487-4021-8cc1-b94824339dc4] Going to try to terminate instance {{(pid=129365) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 20:54:26.898036 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-dc63a47b-26f8-4bda-9eb9-262dc7630ef4 tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f600415e36a4c909b49948cbae3f34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c18cfa337f4413afcb5b0741441512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:26.909179 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-dc63a47b-26f8-4bda-9eb9-262dc7630ef4 tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] 10.222.0.46 "GET /compute/v2.1/servers/41de38d6-3f2c-4912-adae-bef0ad0ffbb1" status: 200 len: 1323 microversion: 2.1 time: 0.389947 Jan 15 20:54:26.909773 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 904/1738] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:54:26 2022] GET /compute/v2.1/servers/41de38d6-3f2c-4912-adae-bef0ad0ffbb1 => generated 1323 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:54:26.915702 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-50da3244-d56a-4a73-9b87-b1693d75533b req-5e08898a-1019-4c56-8da4-d6c18cde8399 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41de38d6-3f2c-4912-adae-bef0ad0ffbb1", "tag": "e9008cdf-b62f-4f84-8aec-da321150af1c"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:54:26.917811 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:54:26.917811 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:54:26.937826 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-50da3244-d56a-4a73-9b87-b1693d75533b req-5e08898a-1019-4c56-8da4-d6c18cde8399 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:26.938650 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-50da3244-d56a-4a73-9b87-b1693d75533b req-5e08898a-1019-4c56-8da4-d6c18cde8399 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:26.966018 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-50da3244-d56a-4a73-9b87-b1693d75533b req-5e08898a-1019-4c56-8da4-d6c18cde8399 service nova] Creating event network-changed:e9008cdf-b62f-4f84-8aec-da321150af1c for instance 41de38d6-3f2c-4912-adae-bef0ad0ffbb1 on nch2-master-1 Jan 15 20:54:26.993187 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-50da3244-d56a-4a73-9b87-b1693d75533b req-5e08898a-1019-4c56-8da4-d6c18cde8399 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072450 Jan 15 20:54:26.996878 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 905/1739] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:54:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:54:27.010538 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d3074acd-2b40-4ba0-9f03-64a2fd704e0d tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:27.012818 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-d3074acd-2b40-4ba0-9f03-64a2fd704e0d tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] [instance: 21c7200b-cace-49b4-ab7f-bf43771825ed] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:27.026569 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d3074acd-2b40-4ba0-9f03-64a2fd704e0d tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:27.030107 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d3074acd-2b40-4ba0-9f03-64a2fd704e0d tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:27.031937 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d3074acd-2b40-4ba0-9f03-64a2fd704e0d tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:27.034338 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d3074acd-2b40-4ba0-9f03-64a2fd704e0d tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:27.035214 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-6fdf6242-38ff-4a92-9cca-dc5d573d817c tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "DELETE /compute/v2.1/servers/eec0d897-b487-4021-8cc1-b94824339dc4" status: 204 len: 0 microversion: 2.1 time: 0.341686 Jan 15 20:54:27.040673 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 835/1740] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 20:54:26 2022] DELETE /compute/v2.1/servers/eec0d897-b487-4021-8cc1-b94824339dc4 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 20:54:27.047330 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-0a02e397-2b0c-4127-8b54-6df59abe3989 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:54:27.048442 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-0a02e397-2b0c-4127-8b54-6df59abe3989 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] [instance: f6a6025e-5439-4ba5-a8b8-20019413661b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:27.062121 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0a02e397-2b0c-4127-8b54-6df59abe3989 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:27.062573 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0a02e397-2b0c-4127-8b54-6df59abe3989 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:27.063372 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0a02e397-2b0c-4127-8b54-6df59abe3989 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:27.063810 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0a02e397-2b0c-4127-8b54-6df59abe3989 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:27.195270 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-d3074acd-2b40-4ba0-9f03-64a2fd704e0d tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e1b423e1a9146c8bb202ba012e2ee2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d5d92c87544c4d8080e19c1f6429bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:27.205774 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d3074acd-2b40-4ba0-9f03-64a2fd704e0d tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] 10.222.0.46 "GET /compute/v2.1/servers/21c7200b-cace-49b4-ab7f-bf43771825ed" status: 200 len: 1282 microversion: 2.1 time: 0.206435 Jan 15 20:54:27.206371 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 906/1741] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:54:26 2022] GET /compute/v2.1/servers/21c7200b-cace-49b4-ab7f-bf43771825ed => generated 1282 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:54:27.227492 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d9c6db47-098d-46e3-b536-cae48d257173 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '.version_select at 0x7f30c8efbc10>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:27.240392 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-0a02e397-2b0c-4127-8b54-6df59abe3989 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] 10.222.0.46 "POST /compute/v2.1/servers/f6a6025e-5439-4ba5-a8b8-20019413661b/action" status: 202 len: 0 microversion: 2.1 time: 0.202667 Jan 15 20:54:27.245105 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 836/1742] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:54:27 2022] POST /compute/v2.1/servers/f6a6025e-5439-4ba5-a8b8-20019413661b/action => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 20:54:27.252048 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d419dcb4-4183-4906-8f60-42217df2f693 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:27.252962 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d419dcb4-4183-4906-8f60-42217df2f693 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] [instance: b5943844-32ec-464b-b08f-7a618260f817] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:27.262921 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d419dcb4-4183-4906-8f60-42217df2f693 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:27.263375 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d419dcb4-4183-4906-8f60-42217df2f693 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:27.264258 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d419dcb4-4183-4906-8f60-42217df2f693 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:27.269903 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-d9c6db47-098d-46e3-b536-cae48d257173 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] HTTP exception thrown: Image not found. Jan 15 20:54:27.270493 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d9c6db47-098d-46e3-b536-cae48d257173 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Returning 404 to user: Image not found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:54:27.271313 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d9c6db47-098d-46e3-b536-cae48d257173 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "DELETE /compute/v2.1/images/d6fbd57d-1ddc-4c6d-900a-55535bb8d408" status: 404 len: 62 microversion: 2.1 time: 0.057532 Jan 15 20:54:27.271872 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 907/1743] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:54:27 2022] DELETE /compute/v2.1/images/d6fbd57d-1ddc-4c6d-900a-55535bb8d408 => generated 62 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jan 15 20:54:27.277377 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-9efcbb0b-2d02-4dd6-9b01-ca1d25e94da3 req-63a9be6b-01d3-4a57-b0a7-43796b9e77bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eec0d897-b487-4021-8cc1-b94824339dc4", "name": "network-vif-plugged", "status": "completed", "tag": "f35ca04a-094e-42bc-a7ee-c8ee9d748f3f"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:54:27.280014 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:54:27.280014 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:54:27.282243 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d419dcb4-4183-4906-8f60-42217df2f693 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:27.315241 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-9efcbb0b-2d02-4dd6-9b01-ca1d25e94da3 req-63a9be6b-01d3-4a57-b0a7-43796b9e77bd service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:27.319940 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-9efcbb0b-2d02-4dd6-9b01-ca1d25e94da3 req-63a9be6b-01d3-4a57-b0a7-43796b9e77bd service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:27.360214 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-9efcbb0b-2d02-4dd6-9b01-ca1d25e94da3 req-63a9be6b-01d3-4a57-b0a7-43796b9e77bd service nova] Creating event network-vif-plugged:f35ca04a-094e-42bc-a7ee-c8ee9d748f3f for instance eec0d897-b487-4021-8cc1-b94824339dc4 on nch1-master-1 Jan 15 20:54:27.378819 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-9efcbb0b-2d02-4dd6-9b01-ca1d25e94da3 req-63a9be6b-01d3-4a57-b0a7-43796b9e77bd service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105354 Jan 15 20:54:27.380100 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 908/1744] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:54:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:54:27.386032 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a7ce7ead-7039-4471-81d8-c9bbe4270cec tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:27.386409 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a7ce7ead-7039-4471-81d8-c9bbe4270cec tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] [instance: f6a6025e-5439-4ba5-a8b8-20019413661b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:27.413885 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a7ce7ead-7039-4471-81d8-c9bbe4270cec tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:27.414521 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a7ce7ead-7039-4471-81d8-c9bbe4270cec tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:27.416777 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a7ce7ead-7039-4471-81d8-c9bbe4270cec tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:27.417666 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a7ce7ead-7039-4471-81d8-c9bbe4270cec tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:27.606168 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-d419dcb4-4183-4906-8f60-42217df2f693 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b8081a7f0446389dd03a3182585b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e7b99384e224302b8ad9303f560cc4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:27.617517 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d419dcb4-4183-4906-8f60-42217df2f693 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] 10.222.0.46 "GET /compute/v2.1/servers/b5943844-32ec-464b-b08f-7a618260f817" status: 200 len: 1321 microversion: 2.1 time: 0.370394 Jan 15 20:54:27.618112 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 837/1745] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:54:27 2022] GET /compute/v2.1/servers/b5943844-32ec-464b-b08f-7a618260f817 => generated 1321 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:54:27.625948 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-aac419c1-ab06-41c7-9d0d-ce4f324f5a64 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:27.626429 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-aac419c1-ab06-41c7-9d0d-ce4f324f5a64 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] [instance: eec0d897-b487-4021-8cc1-b94824339dc4] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:27.648095 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-aac419c1-ab06-41c7-9d0d-ce4f324f5a64 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:27.648555 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-aac419c1-ab06-41c7-9d0d-ce4f324f5a64 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:27.649381 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-aac419c1-ab06-41c7-9d0d-ce4f324f5a64 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:27.649821 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-aac419c1-ab06-41c7-9d0d-ce4f324f5a64 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:27.676869 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-aac419c1-ab06-41c7-9d0d-ce4f324f5a64 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] [instance: eec0d897-b487-4021-8cc1-b94824339dc4] Going to try to terminate instance {{(pid=129365) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 20:54:27.716489 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-a7ce7ead-7039-4471-81d8-c9bbe4270cec tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17e2708b6fc41b1ae6f70bcf99a0170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515bef049574d4ea4c70f90ab8c4444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:27.725695 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a7ce7ead-7039-4471-81d8-c9bbe4270cec tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] 10.222.0.46 "GET /compute/v2.1/servers/f6a6025e-5439-4ba5-a8b8-20019413661b" status: 200 len: 1574 microversion: 2.1 time: 0.344360 Jan 15 20:54:27.726599 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 909/1746] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:54:27 2022] GET /compute/v2.1/servers/f6a6025e-5439-4ba5-a8b8-20019413661b => generated 1574 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:54:27.734335 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.compute.api [None req-aac419c1-ab06-41c7-9d0d-ce4f324f5a64 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] [instance: eec0d897-b487-4021-8cc1-b94824339dc4] Instance is already in deleting state, ignoring this request Jan 15 20:54:27.735187 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-aac419c1-ab06-41c7-9d0d-ce4f324f5a64 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "DELETE /compute/v2.1/servers/eec0d897-b487-4021-8cc1-b94824339dc4" status: 204 len: 0 microversion: 2.1 time: 0.114837 Jan 15 20:54:27.735899 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 838/1747] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 20:54:27 2022] DELETE /compute/v2.1/servers/eec0d897-b487-4021-8cc1-b94824339dc4 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 20:54:27.743895 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4618351c-91ca-42b0-a912-b4557045d862 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:27.750689 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-4618351c-91ca-42b0-a912-b4557045d862 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] [instance: eec0d897-b487-4021-8cc1-b94824339dc4] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:27.757297 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4618351c-91ca-42b0-a912-b4557045d862 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:27.757996 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4618351c-91ca-42b0-a912-b4557045d862 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:27.759112 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4618351c-91ca-42b0-a912-b4557045d862 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:27.759841 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4618351c-91ca-42b0-a912-b4557045d862 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:27.929297 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-77f45086-b54f-4f7c-a523-3fbd303a61e6 tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:27.930902 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-77f45086-b54f-4f7c-a523-3fbd303a61e6 tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] [instance: 41de38d6-3f2c-4912-adae-bef0ad0ffbb1] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:27.939981 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-77f45086-b54f-4f7c-a523-3fbd303a61e6 tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:27.940947 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-77f45086-b54f-4f7c-a523-3fbd303a61e6 tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:27.941877 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-4618351c-91ca-42b0-a912-b4557045d862 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55be87ae7f14b499ab2cd6fc5538988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd217e7fd648b4a78c0c32ff1c95f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:27.943500 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-77f45086-b54f-4f7c-a523-3fbd303a61e6 tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:27.944749 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-77f45086-b54f-4f7c-a523-3fbd303a61e6 tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:27.949991 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-4618351c-91ca-42b0-a912-b4557045d862 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "GET /compute/v2.1/servers/eec0d897-b487-4021-8cc1-b94824339dc4" status: 200 len: 1494 microversion: 2.1 time: 0.209922 Jan 15 20:54:27.960055 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 910/1748] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:54:27 2022] GET /compute/v2.1/servers/eec0d897-b487-4021-8cc1-b94824339dc4 => generated 1494 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:54:28.168482 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-77f45086-b54f-4f7c-a523-3fbd303a61e6 tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f600415e36a4c909b49948cbae3f34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c18cfa337f4413afcb5b0741441512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:28.177992 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-77f45086-b54f-4f7c-a523-3fbd303a61e6 tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] 10.222.0.46 "GET /compute/v2.1/servers/41de38d6-3f2c-4912-adae-bef0ad0ffbb1" status: 200 len: 1323 microversion: 2.1 time: 0.253583 Jan 15 20:54:28.182526 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 839/1749] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:54:27 2022] GET /compute/v2.1/servers/41de38d6-3f2c-4912-adae-bef0ad0ffbb1 => generated 1323 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:54:28.223108 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-6caa115e-bb9b-4e68-b26c-5bd7748c50e0 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:28.224206 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-6caa115e-bb9b-4e68-b26c-5bd7748c50e0 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] [instance: 21c7200b-cace-49b4-ab7f-bf43771825ed] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:28.235994 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6caa115e-bb9b-4e68-b26c-5bd7748c50e0 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:28.237091 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6caa115e-bb9b-4e68-b26c-5bd7748c50e0 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:28.241140 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6caa115e-bb9b-4e68-b26c-5bd7748c50e0 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:28.247343 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6caa115e-bb9b-4e68-b26c-5bd7748c50e0 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:28.613818 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-6caa115e-bb9b-4e68-b26c-5bd7748c50e0 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e1b423e1a9146c8bb202ba012e2ee2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d5d92c87544c4d8080e19c1f6429bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:28.621962 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-6caa115e-bb9b-4e68-b26c-5bd7748c50e0 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] 10.222.0.46 "GET /compute/v2.1/servers/21c7200b-cace-49b4-ab7f-bf43771825ed" status: 200 len: 1324 microversion: 2.1 time: 0.403017 Jan 15 20:54:28.631077 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 911/1750] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:54:28 2022] GET /compute/v2.1/servers/21c7200b-cace-49b4-ab7f-bf43771825ed => generated 1324 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:54:28.641605 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e17e89d1-925f-4fe0-8c16-3f5ca277318c tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:28.642303 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e17e89d1-925f-4fe0-8c16-3f5ca277318c tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] [instance: b5943844-32ec-464b-b08f-7a618260f817] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:28.661912 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e17e89d1-925f-4fe0-8c16-3f5ca277318c tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:28.662800 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e17e89d1-925f-4fe0-8c16-3f5ca277318c tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:28.663835 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e17e89d1-925f-4fe0-8c16-3f5ca277318c tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:28.664497 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e17e89d1-925f-4fe0-8c16-3f5ca277318c tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:28.774094 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a1cf0417-dc79-48da-a17d-72264e14543d tempest-QuotaClassesAdminTestJSON-1087832390 tempest-QuotaClassesAdminTestJSON-1087832390-project-admin] Calling method '.version_select at 0x7f30cebcddc0>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:28.779042 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:54:28.779042 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:54:28.813215 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a1cf0417-dc79-48da-a17d-72264e14543d tempest-QuotaClassesAdminTestJSON-1087832390 tempest-QuotaClassesAdminTestJSON-1087832390-project-admin] 10.222.0.46 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.190708 Jan 15 20:54:28.820883 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 840/1751] 10.222.0.46 () {58 vars in 1184 bytes} [Sat Jan 15 20:54:28 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:54:28.827109 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b30627e0-b89c-4e88-b623-64f2c60f19e7 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:28.828329 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b30627e0-b89c-4e88-b623-64f2c60f19e7 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] [instance: f6a6025e-5439-4ba5-a8b8-20019413661b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:28.837628 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b30627e0-b89c-4e88-b623-64f2c60f19e7 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:28.839165 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b30627e0-b89c-4e88-b623-64f2c60f19e7 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:28.839948 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b30627e0-b89c-4e88-b623-64f2c60f19e7 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:28.840518 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b30627e0-b89c-4e88-b623-64f2c60f19e7 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:29.017614 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-e17e89d1-925f-4fe0-8c16-3f5ca277318c tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b8081a7f0446389dd03a3182585b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e7b99384e224302b8ad9303f560cc4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:29.031891 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e17e89d1-925f-4fe0-8c16-3f5ca277318c tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] 10.222.0.46 "GET /compute/v2.1/servers/b5943844-32ec-464b-b08f-7a618260f817" status: 200 len: 1321 microversion: 2.1 time: 0.397971 Jan 15 20:54:29.033176 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 912/1752] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:54:28 2022] GET /compute/v2.1/servers/b5943844-32ec-464b-b08f-7a618260f817 => generated 1321 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:54:29.050980 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-6e3ddff6-91f0-4d42-98b5-8cc92d77a3e1 tempest-QuotaClassesAdminTestJSON-1087832390 tempest-QuotaClassesAdminTestJSON-1087832390-project-admin] Action: 'update', calling method: .version_select at 0x7f30c8efbc10>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:54:29.053616 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:54:29.053616 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:54:29.208022 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-b30627e0-b89c-4e88-b623-64f2c60f19e7 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17e2708b6fc41b1ae6f70bcf99a0170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515bef049574d4ea4c70f90ab8c4444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:29.219785 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b30627e0-b89c-4e88-b623-64f2c60f19e7 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] 10.222.0.46 "GET /compute/v2.1/servers/f6a6025e-5439-4ba5-a8b8-20019413661b" status: 200 len: 1574 microversion: 2.1 time: 0.394764 Jan 15 20:54:29.220502 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 841/1753] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:54:28 2022] GET /compute/v2.1/servers/f6a6025e-5439-4ba5-a8b8-20019413661b => generated 1574 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:54:29.232632 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9496c034-69e0-49e8-83f4-1999395fb156 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:29.233325 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-9496c034-69e0-49e8-83f4-1999395fb156 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] [instance: eec0d897-b487-4021-8cc1-b94824339dc4] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:29.250262 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9496c034-69e0-49e8-83f4-1999395fb156 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:29.250720 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9496c034-69e0-49e8-83f4-1999395fb156 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:29.251521 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9496c034-69e0-49e8-83f4-1999395fb156 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:29.251965 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9496c034-69e0-49e8-83f4-1999395fb156 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:29.629686 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-9496c034-69e0-49e8-83f4-1999395fb156 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b55be87ae7f14b499ab2cd6fc5538988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd217e7fd648b4a78c0c32ff1c95f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:29.643792 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-9496c034-69e0-49e8-83f4-1999395fb156 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "GET /compute/v2.1/servers/eec0d897-b487-4021-8cc1-b94824339dc4" status: 200 len: 1494 microversion: 2.1 time: 0.420681 Jan 15 20:54:29.644376 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 842/1754] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:54:29 2022] GET /compute/v2.1/servers/eec0d897-b487-4021-8cc1-b94824339dc4 => generated 1494 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:54:29.657982 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f696defc-c549-44d7-8feb-5766d474ea10 tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:29.658765 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f696defc-c549-44d7-8feb-5766d474ea10 tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] [instance: 41de38d6-3f2c-4912-adae-bef0ad0ffbb1] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:29.666541 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-6e3ddff6-91f0-4d42-98b5-8cc92d77a3e1 tempest-QuotaClassesAdminTestJSON-1087832390 tempest-QuotaClassesAdminTestJSON-1087832390-project-admin] 10.222.0.46 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.632266 Jan 15 20:54:29.666697 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f696defc-c549-44d7-8feb-5766d474ea10 tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:29.666980 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f696defc-c549-44d7-8feb-5766d474ea10 tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:29.668073 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f696defc-c549-44d7-8feb-5766d474ea10 tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:29.668448 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f696defc-c549-44d7-8feb-5766d474ea10 tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:29.672871 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 913/1755] 10.222.0.46 () {60 vars in 1205 bytes} [Sat Jan 15 20:54:29 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:54:29.678664 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-82e7e086-b1a7-4f8d-84e3-da583c72d3a5 req-649eccc2-c797-47bc-926b-84410f8bdece service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5943844-32ec-464b-b08f-7a618260f817", "name": "network-vif-plugged", "status": "completed", "tag": "7372087d-b55f-45da-b646-85a04a10f042"}, {"server_uuid": "eec0d897-b487-4021-8cc1-b94824339dc4", "name": "network-vif-unplugged", "status": "completed", "tag": "f35ca04a-094e-42bc-a7ee-c8ee9d748f3f"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:54:29.682543 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:54:29.682543 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:54:29.692458 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-82e7e086-b1a7-4f8d-84e3-da583c72d3a5 req-649eccc2-c797-47bc-926b-84410f8bdece service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:29.692998 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-82e7e086-b1a7-4f8d-84e3-da583c72d3a5 req-649eccc2-c797-47bc-926b-84410f8bdece service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:29.717267 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-82e7e086-b1a7-4f8d-84e3-da583c72d3a5 req-649eccc2-c797-47bc-926b-84410f8bdece service nova] Creating event network-vif-plugged:7372087d-b55f-45da-b646-85a04a10f042 for instance b5943844-32ec-464b-b08f-7a618260f817 on nch1-master-1 Jan 15 20:54:29.718024 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-82e7e086-b1a7-4f8d-84e3-da583c72d3a5 req-649eccc2-c797-47bc-926b-84410f8bdece service nova] Creating event network-vif-unplugged:f35ca04a-094e-42bc-a7ee-c8ee9d748f3f for instance eec0d897-b487-4021-8cc1-b94824339dc4 on nch1-master-1 Jan 15 20:54:29.731258 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-82e7e086-b1a7-4f8d-84e3-da583c72d3a5 req-649eccc2-c797-47bc-926b-84410f8bdece service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.056584 Jan 15 20:54:29.731775 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 914/1756] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:54:29 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:54:29.743877 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-3a0446e2-daed-42d7-80e0-9bf10efcf938 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:29.745724 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-3a0446e2-daed-42d7-80e0-9bf10efcf938 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] [instance: 21c7200b-cace-49b4-ab7f-bf43771825ed] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:29.754905 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3a0446e2-daed-42d7-80e0-9bf10efcf938 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:29.756752 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3a0446e2-daed-42d7-80e0-9bf10efcf938 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:29.758910 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3a0446e2-daed-42d7-80e0-9bf10efcf938 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:29.759558 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3a0446e2-daed-42d7-80e0-9bf10efcf938 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:29.965799 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-f696defc-c549-44d7-8feb-5766d474ea10 tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f600415e36a4c909b49948cbae3f34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c18cfa337f4413afcb5b0741441512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:29.975500 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f696defc-c549-44d7-8feb-5766d474ea10 tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] 10.222.0.46 "GET /compute/v2.1/servers/41de38d6-3f2c-4912-adae-bef0ad0ffbb1" status: 200 len: 1323 microversion: 2.1 time: 0.329874 Jan 15 20:54:29.976580 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 843/1757] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:54:29 2022] GET /compute/v2.1/servers/41de38d6-3f2c-4912-adae-bef0ad0ffbb1 => generated 1323 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:54:29.993967 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-fbedd5db-e080-4193-a064-4dab58aece53 tempest-QuotaClassesAdminTestJSON-1087832390 tempest-QuotaClassesAdminTestJSON-1087832390-project-admin] Calling method '.version_select at 0x7f30c95a0940>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:29.995211 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:54:29.995211 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:54:30.008011 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-fbedd5db-e080-4193-a064-4dab58aece53 tempest-QuotaClassesAdminTestJSON-1087832390 tempest-QuotaClassesAdminTestJSON-1087832390-project-admin] 10.222.0.46 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.030354 Jan 15 20:54:30.009264 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 844/1758] 10.222.0.46 () {58 vars in 1184 bytes} [Sat Jan 15 20:54:29 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:54:30.014748 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-91a05f08-c7af-4b64-bb3b-ab219b775e9d req-7f4227b6-1fa3-47e0-9833-29ca015c156e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eec0d897-b487-4021-8cc1-b94824339dc4", "name": "network-vif-deleted", "tag": "f35ca04a-094e-42bc-a7ee-c8ee9d748f3f"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:54:30.016497 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:54:30.016497 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:54:30.023837 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-91a05f08-c7af-4b64-bb3b-ab219b775e9d req-7f4227b6-1fa3-47e0-9833-29ca015c156e service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:30.024516 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-91a05f08-c7af-4b64-bb3b-ab219b775e9d req-7f4227b6-1fa3-47e0-9833-29ca015c156e service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:30.037457 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-91a05f08-c7af-4b64-bb3b-ab219b775e9d req-7f4227b6-1fa3-47e0-9833-29ca015c156e service nova] Creating event network-vif-deleted:f35ca04a-094e-42bc-a7ee-c8ee9d748f3f for instance eec0d897-b487-4021-8cc1-b94824339dc4 on nch1-master-1 Jan 15 20:54:30.039907 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-3a0446e2-daed-42d7-80e0-9bf10efcf938 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e1b423e1a9146c8bb202ba012e2ee2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d5d92c87544c4d8080e19c1f6429bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:30.043530 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-91a05f08-c7af-4b64-bb3b-ab219b775e9d req-7f4227b6-1fa3-47e0-9833-29ca015c156e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032613 Jan 15 20:54:30.044408 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 845/1759] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:54:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:54:30.052968 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-3a0446e2-daed-42d7-80e0-9bf10efcf938 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] 10.222.0.46 "GET /compute/v2.1/servers/21c7200b-cace-49b4-ab7f-bf43771825ed" status: 200 len: 1324 microversion: 2.1 time: 0.313782 Jan 15 20:54:30.053862 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 915/1760] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:54:29 2022] GET /compute/v2.1/servers/21c7200b-cace-49b4-ab7f-bf43771825ed => generated 1324 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:54:30.060053 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7d8bc029-1ad0-4e2f-bbd4-ac4452cb4530 tempest-QuotaClassesAdminTestJSON-1087832390 tempest-QuotaClassesAdminTestJSON-1087832390-project-admin] Action: 'update', calling method: .version_select at 0x7f30c8de2c10>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:54:30.062228 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:54:30.062228 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:54:30.185267 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7d8bc029-1ad0-4e2f-bbd4-ac4452cb4530 tempest-QuotaClassesAdminTestJSON-1087832390 tempest-QuotaClassesAdminTestJSON-1087832390-project-admin] 10.222.0.46 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.128129 Jan 15 20:54:30.187276 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 916/1761] 10.222.0.46 () {60 vars in 1205 bytes} [Sat Jan 15 20:54:30 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:54:30.193806 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a3dfe352-c20b-4385-b4c7-1586e889c3e2 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:30.194699 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a3dfe352-c20b-4385-b4c7-1586e889c3e2 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] [instance: b5943844-32ec-464b-b08f-7a618260f817] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:30.204094 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a3dfe352-c20b-4385-b4c7-1586e889c3e2 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:30.204694 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a3dfe352-c20b-4385-b4c7-1586e889c3e2 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:30.205114 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-945be1ce-3693-42ec-a91f-12dffc13be24 tempest-AbsoluteLimitsTestJSON-176500777 tempest-AbsoluteLimitsTestJSON-176500777-project] Calling method '.version_select at 0x7f30cebd2700>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:30.205514 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a3dfe352-c20b-4385-b4c7-1586e889c3e2 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:30.205945 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a3dfe352-c20b-4385-b4c7-1586e889c3e2 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:30.228465 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-945be1ce-3693-42ec-a91f-12dffc13be24 tempest-AbsoluteLimitsTestJSON-176500777 tempest-AbsoluteLimitsTestJSON-176500777-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:30.230999 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-945be1ce-3693-42ec-a91f-12dffc13be24 tempest-AbsoluteLimitsTestJSON-176500777 tempest-AbsoluteLimitsTestJSON-176500777-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:30.233358 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-945be1ce-3693-42ec-a91f-12dffc13be24 tempest-AbsoluteLimitsTestJSON-176500777 tempest-AbsoluteLimitsTestJSON-176500777-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:30.237459 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-945be1ce-3693-42ec-a91f-12dffc13be24 tempest-AbsoluteLimitsTestJSON-176500777 tempest-AbsoluteLimitsTestJSON-176500777-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:30.267784 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-945be1ce-3693-42ec-a91f-12dffc13be24 tempest-AbsoluteLimitsTestJSON-176500777 tempest-AbsoluteLimitsTestJSON-176500777-project] 10.222.0.46 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.220486 Jan 15 20:54:30.268509 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 846/1762] 10.222.0.46 () {58 vars in 1121 bytes} [Sat Jan 15 20:54:30 2022] GET /compute/v2.1/limits => generated 511 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:54:30.285401 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-689cac6e-2691-47c4-bebd-f43371b44db2 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:30.286817 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-689cac6e-2691-47c4-bebd-f43371b44db2 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] [instance: f6a6025e-5439-4ba5-a8b8-20019413661b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:30.297866 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-689cac6e-2691-47c4-bebd-f43371b44db2 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:30.298478 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-689cac6e-2691-47c4-bebd-f43371b44db2 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:30.300612 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-689cac6e-2691-47c4-bebd-f43371b44db2 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:30.301528 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-689cac6e-2691-47c4-bebd-f43371b44db2 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:30.489497 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-a3dfe352-c20b-4385-b4c7-1586e889c3e2 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b8081a7f0446389dd03a3182585b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e7b99384e224302b8ad9303f560cc4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:30.506401 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a3dfe352-c20b-4385-b4c7-1586e889c3e2 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] 10.222.0.46 "GET /compute/v2.1/servers/b5943844-32ec-464b-b08f-7a618260f817" status: 200 len: 1321 microversion: 2.1 time: 0.317039 Jan 15 20:54:30.510811 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 917/1763] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:54:30 2022] GET /compute/v2.1/servers/b5943844-32ec-464b-b08f-7a618260f817 => generated 1321 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:54:30.593846 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-689cac6e-2691-47c4-bebd-f43371b44db2 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17e2708b6fc41b1ae6f70bcf99a0170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515bef049574d4ea4c70f90ab8c4444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:30.602660 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-689cac6e-2691-47c4-bebd-f43371b44db2 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] 10.222.0.46 "GET /compute/v2.1/servers/f6a6025e-5439-4ba5-a8b8-20019413661b" status: 200 len: 1574 microversion: 2.1 time: 0.332739 Jan 15 20:54:30.603541 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 847/1764] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:54:30 2022] GET /compute/v2.1/servers/f6a6025e-5439-4ba5-a8b8-20019413661b => generated 1574 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:54:30.628368 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-f31e5d46-fc6b-4d87-b21b-5f298a3a818a req-bd93f7fb-8452-451b-8a94-fbcea18960ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21c7200b-cace-49b4-ab7f-bf43771825ed", "tag": "3e2ec07d-d7a1-46c5-aab4-583109786f3e"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:54:30.630425 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:54:30.630425 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:54:30.645257 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-f31e5d46-fc6b-4d87-b21b-5f298a3a818a req-bd93f7fb-8452-451b-8a94-fbcea18960ce service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:30.645706 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-f31e5d46-fc6b-4d87-b21b-5f298a3a818a req-bd93f7fb-8452-451b-8a94-fbcea18960ce service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:30.662647 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-304ffd62-fcc7-42e7-bd98-5402a78f186a tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:30.663322 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-304ffd62-fcc7-42e7-bd98-5402a78f186a tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] [instance: eec0d897-b487-4021-8cc1-b94824339dc4] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:30.675641 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-f31e5d46-fc6b-4d87-b21b-5f298a3a818a req-bd93f7fb-8452-451b-8a94-fbcea18960ce service nova] Creating event network-changed:3e2ec07d-d7a1-46c5-aab4-583109786f3e for instance 21c7200b-cace-49b4-ab7f-bf43771825ed on nch2-master-1 Jan 15 20:54:30.681903 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-304ffd62-fcc7-42e7-bd98-5402a78f186a tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:30.682236 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-304ffd62-fcc7-42e7-bd98-5402a78f186a tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:30.683046 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-304ffd62-fcc7-42e7-bd98-5402a78f186a tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:30.683488 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-304ffd62-fcc7-42e7-bd98-5402a78f186a tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:30.691347 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-f31e5d46-fc6b-4d87-b21b-5f298a3a818a req-bd93f7fb-8452-451b-8a94-fbcea18960ce service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068460 Jan 15 20:54:30.692074 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 918/1765] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:54:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:54:30.715322 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-304ffd62-fcc7-42e7-bd98-5402a78f186a tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] HTTP exception thrown: Instance eec0d897-b487-4021-8cc1-b94824339dc4 could not be found. Jan 15 20:54:30.715932 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-304ffd62-fcc7-42e7-bd98-5402a78f186a tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Returning 404 to user: Instance eec0d897-b487-4021-8cc1-b94824339dc4 could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:54:30.716911 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-304ffd62-fcc7-42e7-bd98-5402a78f186a tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "GET /compute/v2.1/servers/eec0d897-b487-4021-8cc1-b94824339dc4" status: 404 len: 111 microversion: 2.1 time: 0.059331 Jan 15 20:54:30.726064 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 848/1766] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:54:30 2022] GET /compute/v2.1/servers/eec0d897-b487-4021-8cc1-b94824339dc4 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 15 20:54:30.734321 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-84dd8c18-38d7-474c-8d46-e4e1e0e105aa tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '.version_select at 0x7f30c8dea4c0>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:30.769196 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-84dd8c18-38d7-474c-8d46-e4e1e0e105aa tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] HTTP exception thrown: Image not found. Jan 15 20:54:30.770280 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-84dd8c18-38d7-474c-8d46-e4e1e0e105aa tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Returning 404 to user: Image not found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:54:30.772051 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-84dd8c18-38d7-474c-8d46-e4e1e0e105aa tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "DELETE /compute/v2.1/images/07eb66c4-9522-4f02-aad6-44189090dfa5" status: 404 len: 62 microversion: 2.1 time: 0.049292 Jan 15 20:54:30.773141 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 919/1767] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:54:30 2022] DELETE /compute/v2.1/images/07eb66c4-9522-4f02-aad6-44189090dfa5 => generated 62 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jan 15 20:54:30.782760 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ab150d49-03d5-4bb7-90c7-0a5637abac3b tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:30.783268 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ab150d49-03d5-4bb7-90c7-0a5637abac3b tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] [instance: b1d27142-a9e4-440b-a719-d2059db11e79] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:30.793031 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ab150d49-03d5-4bb7-90c7-0a5637abac3b tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:30.797103 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ab150d49-03d5-4bb7-90c7-0a5637abac3b tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:30.798162 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ab150d49-03d5-4bb7-90c7-0a5637abac3b tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:30.798769 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ab150d49-03d5-4bb7-90c7-0a5637abac3b tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:30.815356 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-ab150d49-03d5-4bb7-90c7-0a5637abac3b tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] HTTP exception thrown: Instance b1d27142-a9e4-440b-a719-d2059db11e79 could not be found. Jan 15 20:54:30.816247 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ab150d49-03d5-4bb7-90c7-0a5637abac3b tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Returning 404 to user: Instance b1d27142-a9e4-440b-a719-d2059db11e79 could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:54:30.817767 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ab150d49-03d5-4bb7-90c7-0a5637abac3b tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "DELETE /compute/v2.1/servers/b1d27142-a9e4-440b-a719-d2059db11e79" status: 404 len: 111 microversion: 2.1 time: 0.040801 Jan 15 20:54:30.822313 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 849/1768] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 20:54:30 2022] DELETE /compute/v2.1/servers/b1d27142-a9e4-440b-a719-d2059db11e79 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:54:30.828242 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7d1f0d13-a9d8-4369-a91d-4899a7c9e0e7 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:30.829073 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-7d1f0d13-a9d8-4369-a91d-4899a7c9e0e7 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] [instance: b1d27142-a9e4-440b-a719-d2059db11e79] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:30.846823 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7d1f0d13-a9d8-4369-a91d-4899a7c9e0e7 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:30.847289 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7d1f0d13-a9d8-4369-a91d-4899a7c9e0e7 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:30.848100 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7d1f0d13-a9d8-4369-a91d-4899a7c9e0e7 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:30.848542 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7d1f0d13-a9d8-4369-a91d-4899a7c9e0e7 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:30.886569 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-7d1f0d13-a9d8-4369-a91d-4899a7c9e0e7 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] HTTP exception thrown: Instance b1d27142-a9e4-440b-a719-d2059db11e79 could not be found. Jan 15 20:54:30.890539 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7d1f0d13-a9d8-4369-a91d-4899a7c9e0e7 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Returning 404 to user: Instance b1d27142-a9e4-440b-a719-d2059db11e79 could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:54:30.891403 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7d1f0d13-a9d8-4369-a91d-4899a7c9e0e7 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "GET /compute/v2.1/servers/b1d27142-a9e4-440b-a719-d2059db11e79" status: 404 len: 111 microversion: 2.1 time: 0.067878 Jan 15 20:54:30.892932 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 920/1769] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:54:30 2022] GET /compute/v2.1/servers/b1d27142-a9e4-440b-a719-d2059db11e79 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 15 20:54:30.902340 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a56657b3-c7d5-4a18-9453-9cd9ddf646ba tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '.version_select at 0x7f30ceb32700>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:30.988919 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-a56657b3-c7d5-4a18-9453-9cd9ddf646ba tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] HTTP exception thrown: Image not found. Jan 15 20:54:30.989714 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a56657b3-c7d5-4a18-9453-9cd9ddf646ba tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Returning 404 to user: Image not found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:54:30.991627 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a56657b3-c7d5-4a18-9453-9cd9ddf646ba tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "DELETE /compute/v2.1/images/02c98032-11ad-4694-be3b-e856797c5802" status: 404 len: 62 microversion: 2.1 time: 0.093766 Jan 15 20:54:30.993652 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 850/1770] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:54:30 2022] DELETE /compute/v2.1/images/02c98032-11ad-4694-be3b-e856797c5802 => generated 62 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jan 15 20:54:30.996917 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-341ec577-cecc-49c4-9f7b-72b4101b7870 tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:30.997530 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-341ec577-cecc-49c4-9f7b-72b4101b7870 tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] [instance: 41de38d6-3f2c-4912-adae-bef0ad0ffbb1] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:31.004561 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2e7eaa78-0bcc-4ff4-820f-2ea91c3ed3ee tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:31.005985 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-2e7eaa78-0bcc-4ff4-820f-2ea91c3ed3ee tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] [instance: 067b97a2-ee1a-4d43-926c-11a8bfa2e332] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:31.011237 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-341ec577-cecc-49c4-9f7b-72b4101b7870 tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:31.011735 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-341ec577-cecc-49c4-9f7b-72b4101b7870 tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:31.012589 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-341ec577-cecc-49c4-9f7b-72b4101b7870 tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:31.013869 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-341ec577-cecc-49c4-9f7b-72b4101b7870 tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:31.021681 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2e7eaa78-0bcc-4ff4-820f-2ea91c3ed3ee tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:31.022534 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2e7eaa78-0bcc-4ff4-820f-2ea91c3ed3ee tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:31.023710 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2e7eaa78-0bcc-4ff4-820f-2ea91c3ed3ee tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:31.024770 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2e7eaa78-0bcc-4ff4-820f-2ea91c3ed3ee tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:31.048324 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-2e7eaa78-0bcc-4ff4-820f-2ea91c3ed3ee tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] HTTP exception thrown: Instance 067b97a2-ee1a-4d43-926c-11a8bfa2e332 could not be found. Jan 15 20:54:31.049506 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2e7eaa78-0bcc-4ff4-820f-2ea91c3ed3ee tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Returning 404 to user: Instance 067b97a2-ee1a-4d43-926c-11a8bfa2e332 could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:54:31.051620 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2e7eaa78-0bcc-4ff4-820f-2ea91c3ed3ee tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "DELETE /compute/v2.1/servers/067b97a2-ee1a-4d43-926c-11a8bfa2e332" status: 404 len: 111 microversion: 2.1 time: 0.052542 Jan 15 20:54:31.052937 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 851/1771] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 20:54:30 2022] DELETE /compute/v2.1/servers/067b97a2-ee1a-4d43-926c-11a8bfa2e332 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:54:31.063165 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-96f20aae-002b-425e-9cd9-70d9a21f45af tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:31.065593 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-96f20aae-002b-425e-9cd9-70d9a21f45af tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] [instance: 067b97a2-ee1a-4d43-926c-11a8bfa2e332] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:31.090383 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-96f20aae-002b-425e-9cd9-70d9a21f45af tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:31.091651 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-96f20aae-002b-425e-9cd9-70d9a21f45af tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:31.096369 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-96f20aae-002b-425e-9cd9-70d9a21f45af tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:31.099617 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-96f20aae-002b-425e-9cd9-70d9a21f45af tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:31.143158 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-96f20aae-002b-425e-9cd9-70d9a21f45af tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] HTTP exception thrown: Instance 067b97a2-ee1a-4d43-926c-11a8bfa2e332 could not be found. Jan 15 20:54:31.147589 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-96f20aae-002b-425e-9cd9-70d9a21f45af tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Returning 404 to user: Instance 067b97a2-ee1a-4d43-926c-11a8bfa2e332 could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:54:31.149228 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-96f20aae-002b-425e-9cd9-70d9a21f45af tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "GET /compute/v2.1/servers/067b97a2-ee1a-4d43-926c-11a8bfa2e332" status: 404 len: 111 microversion: 2.1 time: 0.092225 Jan 15 20:54:31.150783 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 852/1772] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:54:31 2022] GET /compute/v2.1/servers/067b97a2-ee1a-4d43-926c-11a8bfa2e332 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:54:31.161508 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-33cc4c48-1155-44e6-b274-58e7d48d8a66 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:31.163595 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-33cc4c48-1155-44e6-b274-58e7d48d8a66 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] [instance: 21c7200b-cace-49b4-ab7f-bf43771825ed] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:31.173214 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-33cc4c48-1155-44e6-b274-58e7d48d8a66 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:31.174107 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-33cc4c48-1155-44e6-b274-58e7d48d8a66 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:31.176019 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-33cc4c48-1155-44e6-b274-58e7d48d8a66 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:31.177373 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-33cc4c48-1155-44e6-b274-58e7d48d8a66 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:31.414758 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-341ec577-cecc-49c4-9f7b-72b4101b7870 tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f600415e36a4c909b49948cbae3f34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c18cfa337f4413afcb5b0741441512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:31.423481 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-341ec577-cecc-49c4-9f7b-72b4101b7870 tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] 10.222.0.46 "GET /compute/v2.1/servers/41de38d6-3f2c-4912-adae-bef0ad0ffbb1" status: 200 len: 1323 microversion: 2.1 time: 0.430515 Jan 15 20:54:31.433598 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 921/1773] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:54:30 2022] GET /compute/v2.1/servers/41de38d6-3f2c-4912-adae-bef0ad0ffbb1 => generated 1323 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:54:31.439310 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-86d6d1f2-723b-422c-92ee-b388e586092f tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '.version_select at 0x7f30c8f0c430>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:31.463357 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-86d6d1f2-723b-422c-92ee-b388e586092f tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] HTTP exception thrown: Image not found. Jan 15 20:54:31.463631 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-86d6d1f2-723b-422c-92ee-b388e586092f tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Returning 404 to user: Image not found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:54:31.464455 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-86d6d1f2-723b-422c-92ee-b388e586092f tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "DELETE /compute/v2.1/images/106585ed-7081-4635-b265-1e7bf3b59ff9" status: 404 len: 62 microversion: 2.1 time: 0.029634 Jan 15 20:54:31.469281 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 922/1774] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:54:31 2022] DELETE /compute/v2.1/images/106585ed-7081-4635-b265-1e7bf3b59ff9 => generated 62 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jan 15 20:54:31.474136 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b2c021b2-bc06-48b2-aad6-41551989de8d tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:31.474570 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b2c021b2-bc06-48b2-aad6-41551989de8d tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] [instance: ecba885c-f344-480e-9efc-707d1c542d42] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:31.481788 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b2c021b2-bc06-48b2-aad6-41551989de8d tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:31.482235 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b2c021b2-bc06-48b2-aad6-41551989de8d tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:31.483359 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b2c021b2-bc06-48b2-aad6-41551989de8d tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:31.483788 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b2c021b2-bc06-48b2-aad6-41551989de8d tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:31.500165 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-b2c021b2-bc06-48b2-aad6-41551989de8d tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] HTTP exception thrown: Instance ecba885c-f344-480e-9efc-707d1c542d42 could not be found. Jan 15 20:54:31.501225 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b2c021b2-bc06-48b2-aad6-41551989de8d tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Returning 404 to user: Instance ecba885c-f344-480e-9efc-707d1c542d42 could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:54:31.502376 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b2c021b2-bc06-48b2-aad6-41551989de8d tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "DELETE /compute/v2.1/servers/ecba885c-f344-480e-9efc-707d1c542d42" status: 404 len: 111 microversion: 2.1 time: 0.032155 Jan 15 20:54:31.503574 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 923/1775] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 20:54:31 2022] DELETE /compute/v2.1/servers/ecba885c-f344-480e-9efc-707d1c542d42 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:54:31.511013 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-fae03fbb-c39b-444b-a6bc-df4638ba4813 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:31.511980 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-fae03fbb-c39b-444b-a6bc-df4638ba4813 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] [instance: ecba885c-f344-480e-9efc-707d1c542d42] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:31.521427 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fae03fbb-c39b-444b-a6bc-df4638ba4813 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:31.522265 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fae03fbb-c39b-444b-a6bc-df4638ba4813 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:31.523265 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fae03fbb-c39b-444b-a6bc-df4638ba4813 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:31.523992 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fae03fbb-c39b-444b-a6bc-df4638ba4813 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:31.539719 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-fae03fbb-c39b-444b-a6bc-df4638ba4813 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] HTTP exception thrown: Instance ecba885c-f344-480e-9efc-707d1c542d42 could not be found. Jan 15 20:54:31.540334 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-fae03fbb-c39b-444b-a6bc-df4638ba4813 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] Returning 404 to user: Instance ecba885c-f344-480e-9efc-707d1c542d42 could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:54:31.541636 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-fae03fbb-c39b-444b-a6bc-df4638ba4813 tempest-ImagesTestJSON-1305970011 tempest-ImagesTestJSON-1305970011-project] 10.222.0.46 "GET /compute/v2.1/servers/ecba885c-f344-480e-9efc-707d1c542d42" status: 404 len: 111 microversion: 2.1 time: 0.034263 Jan 15 20:54:31.545427 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 924/1776] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:54:31 2022] GET /compute/v2.1/servers/ecba885c-f344-480e-9efc-707d1c542d42 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:54:31.547672 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-76288123-1ce4-43e3-80b9-f78c5d6afd67 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:31.548147 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-76288123-1ce4-43e3-80b9-f78c5d6afd67 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] [instance: b5943844-32ec-464b-b08f-7a618260f817] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:31.554836 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-76288123-1ce4-43e3-80b9-f78c5d6afd67 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:31.555429 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-76288123-1ce4-43e3-80b9-f78c5d6afd67 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:31.556209 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-76288123-1ce4-43e3-80b9-f78c5d6afd67 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:31.557032 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-76288123-1ce4-43e3-80b9-f78c5d6afd67 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:31.675709 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-33cc4c48-1155-44e6-b274-58e7d48d8a66 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e1b423e1a9146c8bb202ba012e2ee2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d5d92c87544c4d8080e19c1f6429bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:31.683446 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-33cc4c48-1155-44e6-b274-58e7d48d8a66 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] 10.222.0.46 "GET /compute/v2.1/servers/21c7200b-cace-49b4-ab7f-bf43771825ed" status: 200 len: 1324 microversion: 2.1 time: 0.531191 Jan 15 20:54:31.694104 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 853/1777] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:54:31 2022] GET /compute/v2.1/servers/21c7200b-cace-49b4-ab7f-bf43771825ed => generated 1324 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:54:31.699218 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-efbdbe7d-b99e-4f5c-9515-bd9c58680b90 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:31.700123 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-efbdbe7d-b99e-4f5c-9515-bd9c58680b90 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] [instance: f6a6025e-5439-4ba5-a8b8-20019413661b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:31.706925 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-efbdbe7d-b99e-4f5c-9515-bd9c58680b90 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:31.707582 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-efbdbe7d-b99e-4f5c-9515-bd9c58680b90 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:31.708568 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-efbdbe7d-b99e-4f5c-9515-bd9c58680b90 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:31.709711 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-efbdbe7d-b99e-4f5c-9515-bd9c58680b90 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:32.011780 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-76288123-1ce4-43e3-80b9-f78c5d6afd67 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b8081a7f0446389dd03a3182585b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e7b99384e224302b8ad9303f560cc4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:32.020057 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-76288123-1ce4-43e3-80b9-f78c5d6afd67 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] 10.222.0.46 "GET /compute/v2.1/servers/b5943844-32ec-464b-b08f-7a618260f817" status: 200 len: 1508 microversion: 2.1 time: 0.476071 Jan 15 20:54:32.023011 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 925/1778] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:54:31 2022] GET /compute/v2.1/servers/b5943844-32ec-464b-b08f-7a618260f817 => generated 1508 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:54:32.237661 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-efbdbe7d-b99e-4f5c-9515-bd9c58680b90 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17e2708b6fc41b1ae6f70bcf99a0170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515bef049574d4ea4c70f90ab8c4444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:32.249391 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-efbdbe7d-b99e-4f5c-9515-bd9c58680b90 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] 10.222.0.46 "GET /compute/v2.1/servers/f6a6025e-5439-4ba5-a8b8-20019413661b" status: 200 len: 1572 microversion: 2.1 time: 0.553863 Jan 15 20:54:32.252039 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 854/1779] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:54:31 2022] GET /compute/v2.1/servers/f6a6025e-5439-4ba5-a8b8-20019413661b => generated 1572 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:54:32.269196 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-40862486-9fd4-4bb8-b8ae-4ee769664152 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1281489077"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:54:32.270088 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-40862486-9fd4-4bb8-b8ae-4ee769664152 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] [instance: f6a6025e-5439-4ba5-a8b8-20019413661b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:32.276904 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-40862486-9fd4-4bb8-b8ae-4ee769664152 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:32.277662 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-40862486-9fd4-4bb8-b8ae-4ee769664152 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:32.278708 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-40862486-9fd4-4bb8-b8ae-4ee769664152 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:32.280498 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-40862486-9fd4-4bb8-b8ae-4ee769664152 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:32.443112 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-93f976be-7181-4b57-b9d4-57dacfbd7bcc tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:32.444059 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-93f976be-7181-4b57-b9d4-57dacfbd7bcc tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] [instance: 41de38d6-3f2c-4912-adae-bef0ad0ffbb1] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:32.453050 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-93f976be-7181-4b57-b9d4-57dacfbd7bcc tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:32.453851 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-93f976be-7181-4b57-b9d4-57dacfbd7bcc tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:32.454954 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-93f976be-7181-4b57-b9d4-57dacfbd7bcc tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:32.455620 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-93f976be-7181-4b57-b9d4-57dacfbd7bcc tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:32.553759 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.network.security_group_api [None req-40862486-9fd4-4bb8-b8ae-4ee769664152 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Adding security group 6f2925c8-4e8b-4ae9-8a62-c89aae730cbe to port cf311698-e345-42ab-8508-0fa2a6da33ab Jan 15 20:54:33.323222 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-93f976be-7181-4b57-b9d4-57dacfbd7bcc tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f600415e36a4c909b49948cbae3f34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c18cfa337f4413afcb5b0741441512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:33.336552 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-93f976be-7181-4b57-b9d4-57dacfbd7bcc tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] 10.222.0.46 "GET /compute/v2.1/servers/41de38d6-3f2c-4912-adae-bef0ad0ffbb1" status: 200 len: 1323 microversion: 2.1 time: 0.898407 Jan 15 20:54:33.338620 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 855/1780] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:54:32 2022] GET /compute/v2.1/servers/41de38d6-3f2c-4912-adae-bef0ad0ffbb1 => generated 1323 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:54:33.348563 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-20922465-bfc1-436b-afa0-571dec8b13fb tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:33.349761 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-20922465-bfc1-436b-afa0-571dec8b13fb tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] [instance: 21c7200b-cace-49b4-ab7f-bf43771825ed] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:33.356243 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-20922465-bfc1-436b-afa0-571dec8b13fb tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:33.356673 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-20922465-bfc1-436b-afa0-571dec8b13fb tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:33.358020 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-20922465-bfc1-436b-afa0-571dec8b13fb tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:33.358794 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-20922465-bfc1-436b-afa0-571dec8b13fb tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:33.600216 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-20922465-bfc1-436b-afa0-571dec8b13fb tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e1b423e1a9146c8bb202ba012e2ee2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d5d92c87544c4d8080e19c1f6429bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:33.609802 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-20922465-bfc1-436b-afa0-571dec8b13fb tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] 10.222.0.46 "GET /compute/v2.1/servers/21c7200b-cace-49b4-ab7f-bf43771825ed" status: 200 len: 1324 microversion: 2.1 time: 0.268519 Jan 15 20:54:33.620063 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 856/1781] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:54:33 2022] GET /compute/v2.1/servers/21c7200b-cace-49b4-ab7f-bf43771825ed => generated 1324 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:54:33.631438 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-30cf7c4d-4621-40d9-9bc8-e51d1289d9f1 req-3c33b6c6-fd6b-4a53-b20c-0a61bde35459 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41de38d6-3f2c-4912-adae-bef0ad0ffbb1", "name": "network-vif-plugged", "status": "completed", "tag": "e9008cdf-b62f-4f84-8aec-da321150af1c"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:54:33.633460 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:54:33.633460 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:54:33.647095 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-30cf7c4d-4621-40d9-9bc8-e51d1289d9f1 req-3c33b6c6-fd6b-4a53-b20c-0a61bde35459 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:33.647683 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-30cf7c4d-4621-40d9-9bc8-e51d1289d9f1 req-3c33b6c6-fd6b-4a53-b20c-0a61bde35459 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:33.661690 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-30cf7c4d-4621-40d9-9bc8-e51d1289d9f1 req-3c33b6c6-fd6b-4a53-b20c-0a61bde35459 service nova] Creating event network-vif-plugged:e9008cdf-b62f-4f84-8aec-da321150af1c for instance 41de38d6-3f2c-4912-adae-bef0ad0ffbb1 on nch2-master-1 Jan 15 20:54:33.686588 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-30cf7c4d-4621-40d9-9bc8-e51d1289d9f1 req-3c33b6c6-fd6b-4a53-b20c-0a61bde35459 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064400 Jan 15 20:54:33.695646 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 857/1782] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:54:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:54:33.697990 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-40862486-9fd4-4bb8-b8ae-4ee769664152 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] 10.222.0.46 "POST /compute/v2.1/servers/f6a6025e-5439-4ba5-a8b8-20019413661b/action" status: 202 len: 0 microversion: 2.1 time: 1.433191 Jan 15 20:54:33.702592 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 926/1783] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:54:32 2022] POST /compute/v2.1/servers/f6a6025e-5439-4ba5-a8b8-20019413661b/action => generated 0 bytes in 1435 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 20:54:33.713525 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-6ff60cec-8880-4196-8b2c-7afdc76480a9 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Calling method '.version_select at 0x7f30c8f8b4c0>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:33.714295 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d3c35dca-9912-4d19-9bdd-f98f85b43429 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "684a098f-564a-4f37-94f8-f08328ebc632"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:54:33.717587 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d3c35dca-9912-4d19-9bdd-f98f85b43429 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] [instance: b5943844-32ec-464b-b08f-7a618260f817] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:33.734695 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d3c35dca-9912-4d19-9bdd-f98f85b43429 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:33.737234 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d3c35dca-9912-4d19-9bdd-f98f85b43429 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:33.738364 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d3c35dca-9912-4d19-9bdd-f98f85b43429 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:33.741456 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d3c35dca-9912-4d19-9bdd-f98f85b43429 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:33.909449 ncdv-master-1 devstack@n-api.service[129366]: DEBUG neutronclient.v2_0.client [None req-6ff60cec-8880-4196-8b2c-7afdc76480a9 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 6f2925c8-4e8b-4ae9-8a62-c89aae730cbe in use.", "detail": ""}} {{(pid=129366) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jan 15 20:54:33.910848 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-6ff60cec-8880-4196-8b2c-7afdc76480a9 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] HTTP exception thrown: Security Group 6f2925c8-4e8b-4ae9-8a62-c89aae730cbe in use. Jan 15 20:54:33.910848 ncdv-master-1 devstack@n-api.service[129366]: Neutron server returns request_ids: ['req-3a10ee0f-4168-4a55-a325-6692312dd6f9'] Jan 15 20:54:33.911444 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-6ff60cec-8880-4196-8b2c-7afdc76480a9 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Returning 400 to user: Security Group 6f2925c8-4e8b-4ae9-8a62-c89aae730cbe in use. Jan 15 20:54:33.911444 ncdv-master-1 devstack@n-api.service[129366]: Neutron server returns request_ids: ['req-3a10ee0f-4168-4a55-a325-6692312dd6f9'] {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:54:33.912596 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-6ff60cec-8880-4196-8b2c-7afdc76480a9 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/6f2925c8-4e8b-4ae9-8a62-c89aae730cbe" status: 400 len: 185 microversion: 2.1 time: 0.209258 Jan 15 20:54:33.913893 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 927/1784] 10.222.0.46 () {58 vars in 1271 bytes} [Sat Jan 15 20:54:33 2022] DELETE /compute/v2.1/os-security-groups/6f2925c8-4e8b-4ae9-8a62-c89aae730cbe => generated 185 bytes in 211 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jan 15 20:54:33.919651 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-4bf55e82-24ba-47fd-8911-5647f2cddbf7 req-a710ff53-2895-4828-a5e8-0a85ebdf0fbc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6a6025e-5439-4ba5-a8b8-20019413661b", "tag": "cf311698-e345-42ab-8508-0fa2a6da33ab"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:54:33.922321 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:54:33.922321 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:54:33.955817 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-4bf55e82-24ba-47fd-8911-5647f2cddbf7 req-a710ff53-2895-4828-a5e8-0a85ebdf0fbc service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:33.956798 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-4bf55e82-24ba-47fd-8911-5647f2cddbf7 req-a710ff53-2895-4828-a5e8-0a85ebdf0fbc service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:33.990002 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-4bf55e82-24ba-47fd-8911-5647f2cddbf7 req-a710ff53-2895-4828-a5e8-0a85ebdf0fbc service nova] Creating event network-changed:cf311698-e345-42ab-8508-0fa2a6da33ab for instance f6a6025e-5439-4ba5-a8b8-20019413661b on nch2-master-1 Jan 15 20:54:34.003772 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-4bf55e82-24ba-47fd-8911-5647f2cddbf7 req-a710ff53-2895-4828-a5e8-0a85ebdf0fbc service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088139 Jan 15 20:54:34.004530 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 928/1785] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:54:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:54:34.013463 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-43ac5e20-e526-484a-ae8f-53e3d3a5beed tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:34.014495 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-43ac5e20-e526-484a-ae8f-53e3d3a5beed tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] [instance: f6a6025e-5439-4ba5-a8b8-20019413661b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:34.035652 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-43ac5e20-e526-484a-ae8f-53e3d3a5beed tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:34.036874 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-43ac5e20-e526-484a-ae8f-53e3d3a5beed tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:34.038024 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-43ac5e20-e526-484a-ae8f-53e3d3a5beed tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:34.038922 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-43ac5e20-e526-484a-ae8f-53e3d3a5beed tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:34.103548 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-43ac5e20-e526-484a-ae8f-53e3d3a5beed tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] [instance: f6a6025e-5439-4ba5-a8b8-20019413661b] Going to try to terminate instance {{(pid=129366) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 20:54:34.247371 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-43ac5e20-e526-484a-ae8f-53e3d3a5beed tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] 10.222.0.46 "DELETE /compute/v2.1/servers/f6a6025e-5439-4ba5-a8b8-20019413661b" status: 204 len: 0 microversion: 2.1 time: 0.238952 Jan 15 20:54:34.248570 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 929/1786] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 20:54:34 2022] DELETE /compute/v2.1/servers/f6a6025e-5439-4ba5-a8b8-20019413661b => generated 0 bytes in 243 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 20:54:34.252483 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d3c35dca-9912-4d19-9bdd-f98f85b43429 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] 10.222.0.46 "POST /compute/v2.1/servers/b5943844-32ec-464b-b08f-7a618260f817/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.520006 Jan 15 20:54:34.254129 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 858/1787] 10.222.0.46 () {60 vars in 1322 bytes} [Sat Jan 15 20:54:33 2022] POST /compute/v2.1/servers/b5943844-32ec-464b-b08f-7a618260f817/os-volume_attachments => generated 194 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:54:34.259691 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4400fdac-e2c1-4e25-aee0-60eb461ea864 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:34.261071 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-4400fdac-e2c1-4e25-aee0-60eb461ea864 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] [instance: f6a6025e-5439-4ba5-a8b8-20019413661b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:34.272870 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4400fdac-e2c1-4e25-aee0-60eb461ea864 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:34.273433 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4400fdac-e2c1-4e25-aee0-60eb461ea864 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:34.274306 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4400fdac-e2c1-4e25-aee0-60eb461ea864 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:34.274786 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4400fdac-e2c1-4e25-aee0-60eb461ea864 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:34.356512 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f1f5f94a-4f6e-4788-bcc1-d91e3f450358 tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:34.357930 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f1f5f94a-4f6e-4788-bcc1-d91e3f450358 tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] [instance: 41de38d6-3f2c-4912-adae-bef0ad0ffbb1] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:34.378351 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f1f5f94a-4f6e-4788-bcc1-d91e3f450358 tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:34.382357 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f1f5f94a-4f6e-4788-bcc1-d91e3f450358 tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:34.384217 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f1f5f94a-4f6e-4788-bcc1-d91e3f450358 tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:34.384776 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f1f5f94a-4f6e-4788-bcc1-d91e3f450358 tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:34.667329 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-4400fdac-e2c1-4e25-aee0-60eb461ea864 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17e2708b6fc41b1ae6f70bcf99a0170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515bef049574d4ea4c70f90ab8c4444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:34.676739 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-4400fdac-e2c1-4e25-aee0-60eb461ea864 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] 10.222.0.46 "GET /compute/v2.1/servers/f6a6025e-5439-4ba5-a8b8-20019413661b" status: 200 len: 1647 microversion: 2.1 time: 0.423260 Jan 15 20:54:34.680803 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 930/1788] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:54:34 2022] GET /compute/v2.1/servers/f6a6025e-5439-4ba5-a8b8-20019413661b => generated 1647 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:54:34.686582 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1a8ecb8e-ff4d-44ea-8d79-1e15d13cb3c7 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:34.703620 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-1a8ecb8e-ff4d-44ea-8d79-1e15d13cb3c7 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] [instance: 21c7200b-cace-49b4-ab7f-bf43771825ed] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:34.717762 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1a8ecb8e-ff4d-44ea-8d79-1e15d13cb3c7 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:34.726513 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1a8ecb8e-ff4d-44ea-8d79-1e15d13cb3c7 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:34.728099 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1a8ecb8e-ff4d-44ea-8d79-1e15d13cb3c7 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:34.733252 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1a8ecb8e-ff4d-44ea-8d79-1e15d13cb3c7 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:35.055787 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-f1f5f94a-4f6e-4788-bcc1-d91e3f450358 tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f600415e36a4c909b49948cbae3f34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c18cfa337f4413afcb5b0741441512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:35.066833 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f1f5f94a-4f6e-4788-bcc1-d91e3f450358 tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] 10.222.0.46 "GET /compute/v2.1/servers/41de38d6-3f2c-4912-adae-bef0ad0ffbb1" status: 200 len: 1323 microversion: 2.1 time: 0.714672 Jan 15 20:54:35.081220 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 859/1789] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:54:34 2022] GET /compute/v2.1/servers/41de38d6-3f2c-4912-adae-bef0ad0ffbb1 => generated 1323 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:54:35.159894 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-1a8ecb8e-ff4d-44ea-8d79-1e15d13cb3c7 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e1b423e1a9146c8bb202ba012e2ee2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d5d92c87544c4d8080e19c1f6429bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:35.178154 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-1a8ecb8e-ff4d-44ea-8d79-1e15d13cb3c7 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] 10.222.0.46 "GET /compute/v2.1/servers/21c7200b-cace-49b4-ab7f-bf43771825ed" status: 200 len: 1324 microversion: 2.1 time: 0.494307 Jan 15 20:54:35.179536 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 931/1790] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:54:34 2022] GET /compute/v2.1/servers/21c7200b-cace-49b4-ab7f-bf43771825ed => generated 1324 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:54:35.696295 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-4908a66a-7241-4b5e-b2b4-9b4f727c536f tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:35.697824 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-4908a66a-7241-4b5e-b2b4-9b4f727c536f tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] [instance: f6a6025e-5439-4ba5-a8b8-20019413661b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:35.713090 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4908a66a-7241-4b5e-b2b4-9b4f727c536f tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:35.715975 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4908a66a-7241-4b5e-b2b4-9b4f727c536f tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:35.717138 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4908a66a-7241-4b5e-b2b4-9b4f727c536f tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:35.718055 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4908a66a-7241-4b5e-b2b4-9b4f727c536f tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:36.045504 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-4908a66a-7241-4b5e-b2b4-9b4f727c536f tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17e2708b6fc41b1ae6f70bcf99a0170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515bef049574d4ea4c70f90ab8c4444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:36.059996 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-4908a66a-7241-4b5e-b2b4-9b4f727c536f tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] 10.222.0.46 "GET /compute/v2.1/servers/f6a6025e-5439-4ba5-a8b8-20019413661b" status: 200 len: 1647 microversion: 2.1 time: 0.368054 Jan 15 20:54:36.062903 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 860/1791] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:54:35 2022] GET /compute/v2.1/servers/f6a6025e-5439-4ba5-a8b8-20019413661b => generated 1647 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:54:36.084639 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9ebe5999-ee24-460f-aea7-af5b2087ab09 tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:36.085275 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-9ebe5999-ee24-460f-aea7-af5b2087ab09 tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] [instance: 41de38d6-3f2c-4912-adae-bef0ad0ffbb1] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:36.095001 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9ebe5999-ee24-460f-aea7-af5b2087ab09 tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:36.095433 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9ebe5999-ee24-460f-aea7-af5b2087ab09 tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:36.096433 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9ebe5999-ee24-460f-aea7-af5b2087ab09 tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:36.097104 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9ebe5999-ee24-460f-aea7-af5b2087ab09 tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:36.204133 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3368881f-340a-4586-aace-5f008763a8fa tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:36.204766 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-3368881f-340a-4586-aace-5f008763a8fa tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] [instance: 21c7200b-cace-49b4-ab7f-bf43771825ed] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:36.221020 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3368881f-340a-4586-aace-5f008763a8fa tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:36.221480 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3368881f-340a-4586-aace-5f008763a8fa tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:36.222864 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3368881f-340a-4586-aace-5f008763a8fa tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:36.223268 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3368881f-340a-4586-aace-5f008763a8fa tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:36.298235 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-9ebe5999-ee24-460f-aea7-af5b2087ab09 tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f600415e36a4c909b49948cbae3f34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c18cfa337f4413afcb5b0741441512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:36.313093 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-9ebe5999-ee24-460f-aea7-af5b2087ab09 tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] 10.222.0.46 "GET /compute/v2.1/servers/41de38d6-3f2c-4912-adae-bef0ad0ffbb1" status: 200 len: 1473 microversion: 2.1 time: 0.227055 Jan 15 20:54:36.315622 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 932/1792] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:54:36 2022] GET /compute/v2.1/servers/41de38d6-3f2c-4912-adae-bef0ad0ffbb1 => generated 1473 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:54:36.461820 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-3368881f-340a-4586-aace-5f008763a8fa tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e1b423e1a9146c8bb202ba012e2ee2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d5d92c87544c4d8080e19c1f6429bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:36.473591 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3368881f-340a-4586-aace-5f008763a8fa tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] 10.222.0.46 "GET /compute/v2.1/servers/21c7200b-cace-49b4-ab7f-bf43771825ed" status: 200 len: 1324 microversion: 2.1 time: 0.280353 Jan 15 20:54:36.475518 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 861/1793] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:54:36 2022] GET /compute/v2.1/servers/21c7200b-cace-49b4-ab7f-bf43771825ed => generated 1324 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:54:36.497453 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-25fe6415-d454-4178-acdb-f2eb97eadabe tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:36.498859 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-25fe6415-d454-4178-acdb-f2eb97eadabe tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] [instance: 41de38d6-3f2c-4912-adae-bef0ad0ffbb1] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:36.513233 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-25fe6415-d454-4178-acdb-f2eb97eadabe tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:36.514562 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-25fe6415-d454-4178-acdb-f2eb97eadabe tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:36.516792 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-25fe6415-d454-4178-acdb-f2eb97eadabe tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:36.517548 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-25fe6415-d454-4178-acdb-f2eb97eadabe tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:36.549105 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-25fe6415-d454-4178-acdb-f2eb97eadabe tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '9f600415e36a4c909b49948cbae3f34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c18cfa337f4413afcb5b0741441512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:36.549726 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-25fe6415-d454-4178-acdb-f2eb97eadabe tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:54:36.550834 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-25fe6415-d454-4178-acdb-f2eb97eadabe tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] 10.222.0.46 "GET /compute/v2.1/servers/41de38d6-3f2c-4912-adae-bef0ad0ffbb1/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.073492 Jan 15 20:54:36.552880 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 862/1794] 10.222.0.46 () {58 vars in 1271 bytes} [Sat Jan 15 20:54:36 2022] GET /compute/v2.1/servers/41de38d6-3f2c-4912-adae-bef0ad0ffbb1/diagnostics => generated 117 bytes in 75 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:54:36.564507 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8fc1e91c-7006-473e-8d09-95eb74d00a90 tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:36.568234 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-8fc1e91c-7006-473e-8d09-95eb74d00a90 tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] [instance: 41de38d6-3f2c-4912-adae-bef0ad0ffbb1] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:36.583274 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8fc1e91c-7006-473e-8d09-95eb74d00a90 tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:36.583949 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8fc1e91c-7006-473e-8d09-95eb74d00a90 tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:36.584720 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8fc1e91c-7006-473e-8d09-95eb74d00a90 tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:36.585609 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8fc1e91c-7006-473e-8d09-95eb74d00a90 tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:36.620242 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-8fc1e91c-7006-473e-8d09-95eb74d00a90 tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] [instance: 41de38d6-3f2c-4912-adae-bef0ad0ffbb1] Going to try to terminate instance {{(pid=129365) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 20:54:36.769072 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-8fc1e91c-7006-473e-8d09-95eb74d00a90 tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] 10.222.0.46 "DELETE /compute/v2.1/servers/41de38d6-3f2c-4912-adae-bef0ad0ffbb1" status: 204 len: 0 microversion: 2.1 time: 0.209546 Jan 15 20:54:36.770521 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 863/1795] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 20:54:36 2022] DELETE /compute/v2.1/servers/41de38d6-3f2c-4912-adae-bef0ad0ffbb1 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 20:54:36.797965 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-706e6151-dd77-4004-8a13-eb56bc331539 tempest-ListImagesTestJSON-1476425712 tempest-ListImagesTestJSON-1476425712-project] Calling method '.version_select at 0x7f30c8e955e0>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:36.859207 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-706e6151-dd77-4004-8a13-eb56bc331539 tempest-ListImagesTestJSON-1476425712 tempest-ListImagesTestJSON-1476425712-project] 10.222.0.46 "GET /compute/v2.1/images/1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815" status: 200 len: 784 microversion: 2.1 time: 0.542163 Jan 15 20:54:36.860287 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 933/1796] 10.222.0.46 () {58 vars in 1232 bytes} [Sat Jan 15 20:54:36 2022] GET /compute/v2.1/images/1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815 => generated 784 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:54:36.874168 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-37dd5e07-4f80-48c9-a353-0b0af12f1065 tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:36.875216 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-37dd5e07-4f80-48c9-a353-0b0af12f1065 tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] [instance: 41de38d6-3f2c-4912-adae-bef0ad0ffbb1] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:36.882037 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-37dd5e07-4f80-48c9-a353-0b0af12f1065 tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:36.882809 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-37dd5e07-4f80-48c9-a353-0b0af12f1065 tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:36.883818 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-37dd5e07-4f80-48c9-a353-0b0af12f1065 tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:36.884533 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-37dd5e07-4f80-48c9-a353-0b0af12f1065 tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:37.067049 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-37dd5e07-4f80-48c9-a353-0b0af12f1065 tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f600415e36a4c909b49948cbae3f34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c18cfa337f4413afcb5b0741441512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:37.078711 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-37dd5e07-4f80-48c9-a353-0b0af12f1065 tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] 10.222.0.46 "GET /compute/v2.1/servers/41de38d6-3f2c-4912-adae-bef0ad0ffbb1" status: 200 len: 1479 microversion: 2.1 time: 0.216910 Jan 15 20:54:37.079747 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 934/1797] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:54:36 2022] GET /compute/v2.1/servers/41de38d6-3f2c-4912-adae-bef0ad0ffbb1 => generated 1479 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:54:37.095587 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-c0d6cb23-8808-440a-bb97-57991532c120 req-352ec96f-6b43-422c-9de5-0f8d55006c09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6a6025e-5439-4ba5-a8b8-20019413661b", "name": "network-vif-deleted", "tag": "cf311698-e345-42ab-8508-0fa2a6da33ab"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:54:37.099513 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:54:37.099513 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:54:37.109539 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-c0d6cb23-8808-440a-bb97-57991532c120 req-352ec96f-6b43-422c-9de5-0f8d55006c09 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:37.111669 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-c0d6cb23-8808-440a-bb97-57991532c120 req-352ec96f-6b43-422c-9de5-0f8d55006c09 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:37.124206 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-c0d6cb23-8808-440a-bb97-57991532c120 req-352ec96f-6b43-422c-9de5-0f8d55006c09 service nova] Creating event network-vif-deleted:cf311698-e345-42ab-8508-0fa2a6da33ab for instance f6a6025e-5439-4ba5-a8b8-20019413661b on nch2-master-1 Jan 15 20:54:37.130004 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-c0d6cb23-8808-440a-bb97-57991532c120 req-352ec96f-6b43-422c-9de5-0f8d55006c09 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039178 Jan 15 20:54:37.137867 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 935/1798] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:54:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:54:37.144068 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-70256d61-33cb-40d2-95a7-b979f06b4032 tempest-ListImagesTestJSON-1476425712 tempest-ListImagesTestJSON-1476425712-project] Calling method '.version_select at 0x7f30c8f8b4c0>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:37.232959 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ac822f17-b28d-4944-bb1d-bd5a422a5da2 tempest-SecurityGroupsNegativeTestJSON-191577102 tempest-SecurityGroupsNegativeTestJSON-191577102-project] Calling method '.version_select at 0x7f30c8e909d0>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:37.239384 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-70256d61-33cb-40d2-95a7-b979f06b4032 tempest-ListImagesTestJSON-1476425712 tempest-ListImagesTestJSON-1476425712-project] 10.222.0.46 "GET /compute/v2.1/images" status: 200 len: 871 microversion: 2.1 time: 0.099373 Jan 15 20:54:37.240392 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 936/1799] 10.222.0.46 () {58 vars in 1121 bytes} [Sat Jan 15 20:54:37 2022] GET /compute/v2.1/images => generated 871 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:54:37.251400 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-5d951cb2-f87c-4d0a-afdf-76c39fb7ffdc tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:37.265162 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-5d951cb2-f87c-4d0a-afdf-76c39fb7ffdc tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] [instance: f6a6025e-5439-4ba5-a8b8-20019413661b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:37.279908 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5d951cb2-f87c-4d0a-afdf-76c39fb7ffdc tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:37.283445 ncdv-master-1 devstack@n-api.service[129365]: DEBUG neutronclient.v2_0.client [None req-ac822f17-b28d-4944-bb1d-bd5a422a5da2 tempest-SecurityGroupsNegativeTestJSON-191577102 tempest-SecurityGroupsNegativeTestJSON-191577102-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d216b3ae-58fd-4a72-8ca2-77508515bfee does not exist", "detail": ""}} {{(pid=129365) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jan 15 20:54:37.284896 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.network.security_group_api [None req-ac822f17-b28d-4944-bb1d-bd5a422a5da2 tempest-SecurityGroupsNegativeTestJSON-191577102 tempest-SecurityGroupsNegativeTestJSON-191577102-project] Neutron security group d216b3ae-58fd-4a72-8ca2-77508515bfee not found {{(pid=129365) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jan 15 20:54:37.285843 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-ac822f17-b28d-4944-bb1d-bd5a422a5da2 tempest-SecurityGroupsNegativeTestJSON-191577102 tempest-SecurityGroupsNegativeTestJSON-191577102-project] HTTP exception thrown: Security group d216b3ae-58fd-4a72-8ca2-77508515bfee does not exist Jan 15 20:54:37.285843 ncdv-master-1 devstack@n-api.service[129365]: Neutron server returns request_ids: ['req-d68e5ca3-74e8-4af2-9844-302747736189'] Jan 15 20:54:37.286841 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ac822f17-b28d-4944-bb1d-bd5a422a5da2 tempest-SecurityGroupsNegativeTestJSON-191577102 tempest-SecurityGroupsNegativeTestJSON-191577102-project] Returning 404 to user: Security group d216b3ae-58fd-4a72-8ca2-77508515bfee does not exist Jan 15 20:54:37.286841 ncdv-master-1 devstack@n-api.service[129365]: Neutron server returns request_ids: ['req-d68e5ca3-74e8-4af2-9844-302747736189'] {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:54:37.287906 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ac822f17-b28d-4944-bb1d-bd5a422a5da2 tempest-SecurityGroupsNegativeTestJSON-191577102 tempest-SecurityGroupsNegativeTestJSON-191577102-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/d216b3ae-58fd-4a72-8ca2-77508515bfee" status: 404 len: 194 microversion: 2.1 time: 0.515303 Jan 15 20:54:37.288977 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 864/1800] 10.222.0.46 () {58 vars in 1271 bytes} [Sat Jan 15 20:54:36 2022] DELETE /compute/v2.1/os-security-groups/d216b3ae-58fd-4a72-8ca2-77508515bfee => generated 194 bytes in 517 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:54:37.290862 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5d951cb2-f87c-4d0a-afdf-76c39fb7ffdc tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:37.292024 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5d951cb2-f87c-4d0a-afdf-76c39fb7ffdc tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:37.298844 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-298f3073-8546-4d7c-a486-5cfca1046eaa req-d07568a9-b8cf-400f-831a-125839a0066c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21c7200b-cace-49b4-ab7f-bf43771825ed", "name": "network-vif-plugged", "status": "completed", "tag": "3e2ec07d-d7a1-46c5-aab4-583109786f3e"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:54:37.302034 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5d951cb2-f87c-4d0a-afdf-76c39fb7ffdc tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:37.304136 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:54:37.304136 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:54:37.328265 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-298f3073-8546-4d7c-a486-5cfca1046eaa req-d07568a9-b8cf-400f-831a-125839a0066c service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:37.329164 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-298f3073-8546-4d7c-a486-5cfca1046eaa req-d07568a9-b8cf-400f-831a-125839a0066c service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:37.343022 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-298f3073-8546-4d7c-a486-5cfca1046eaa req-d07568a9-b8cf-400f-831a-125839a0066c service nova] Creating event network-vif-plugged:3e2ec07d-d7a1-46c5-aab4-583109786f3e for instance 21c7200b-cace-49b4-ab7f-bf43771825ed on nch2-master-1 Jan 15 20:54:37.359421 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-298f3073-8546-4d7c-a486-5cfca1046eaa req-d07568a9-b8cf-400f-831a-125839a0066c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057885 Jan 15 20:54:37.360742 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 865/1801] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:54:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:54:37.366279 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5016d528-3f98-4ff0-bd1f-767479c546e3 tempest-ListImagesTestJSON-1476425712 tempest-ListImagesTestJSON-1476425712-project] Calling method '.version_select at 0x7f30ceba7c10>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:37.394731 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5d951cb2-f87c-4d0a-afdf-76c39fb7ffdc tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:37.397354 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5d951cb2-f87c-4d0a-afdf-76c39fb7ffdc tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:37.397857 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.objects.instance [None req-5d951cb2-f87c-4d0a-afdf-76c39fb7ffdc tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lazy-loading 'fault' on Instance uuid f6a6025e-5439-4ba5-a8b8-20019413661b {{(pid=129366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 20:54:37.450143 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5016d528-3f98-4ff0-bd1f-767479c546e3 tempest-ListImagesTestJSON-1476425712 tempest-ListImagesTestJSON-1476425712-project] 10.222.0.46 "GET /compute/v2.1/images/detail" status: 200 len: 1475 microversion: 2.1 time: 0.087857 Jan 15 20:54:37.451716 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 866/1802] 10.222.0.46 () {58 vars in 1142 bytes} [Sat Jan 15 20:54:37 2022] GET /compute/v2.1/images/detail => generated 1475 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:54:37.470791 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a7a6f6e1-e735-4ebd-9ba6-e2988c79e8da tempest-SecurityGroupsNegativeTestJSON-191577102 tempest-SecurityGroupsNegativeTestJSON-191577102-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.013903 Jan 15 20:54:37.472630 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 867/1803] 10.222.0.46 () {58 vars in 1163 bytes} [Sat Jan 15 20:54:37 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 20 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jan 15 20:54:37.480217 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-5d951cb2-f87c-4d0a-afdf-76c39fb7ffdc tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17e2708b6fc41b1ae6f70bcf99a0170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515bef049574d4ea4c70f90ab8c4444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:37.490161 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-5d951cb2-f87c-4d0a-afdf-76c39fb7ffdc tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] 10.222.0.46 "GET /compute/v2.1/servers/f6a6025e-5439-4ba5-a8b8-20019413661b" status: 200 len: 1306 microversion: 2.1 time: 0.248485 Jan 15 20:54:37.491100 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 937/1804] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:54:37 2022] GET /compute/v2.1/servers/f6a6025e-5439-4ba5-a8b8-20019413661b => generated 1306 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:54:37.620861 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e106d78f-819a-43b2-a87e-8a1187d2e751 tempest-ServicesAdminNegativeTestJSON-868281886 tempest-ServicesAdminNegativeTestJSON-868281886-project-admin] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:37.622959 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:54:37.622959 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:54:37.625053 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e106d78f-819a-43b2-a87e-8a1187d2e751 tempest-ServicesAdminNegativeTestJSON-868281886 tempest-ServicesAdminNegativeTestJSON-868281886-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:37.625575 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e106d78f-819a-43b2-a87e-8a1187d2e751 tempest-ServicesAdminNegativeTestJSON-868281886 tempest-ServicesAdminNegativeTestJSON-868281886-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:37.626489 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e106d78f-819a-43b2-a87e-8a1187d2e751 tempest-ServicesAdminNegativeTestJSON-868281886 tempest-ServicesAdminNegativeTestJSON-868281886-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:37.627223 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e106d78f-819a-43b2-a87e-8a1187d2e751 tempest-ServicesAdminNegativeTestJSON-868281886 tempest-ServicesAdminNegativeTestJSON-868281886-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:37.663892 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e106d78f-819a-43b2-a87e-8a1187d2e751 tempest-ServicesAdminNegativeTestJSON-868281886 tempest-ServicesAdminNegativeTestJSON-868281886-project-admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.186663 Jan 15 20:54:37.664828 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 868/1805] 10.222.0.46 () {58 vars in 1136 bytes} [Sat Jan 15 20:54:37 2022] GET /compute/v2.1/os-services => generated 947 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:54:37.669409 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5edbada1-5955-4541-a9ea-299d84fec3d9 tempest-SecurityGroupsNegativeTestJSON-191577102 tempest-SecurityGroupsNegativeTestJSON-191577102-project] Calling method '.version_select at 0x7f30ceb79550>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:37.741540 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-5da98d38-588c-40e6-b307-9ec410681c36 tempest-FlavorsAccessNegativeTestJSON-1753152423 tempest-FlavorsAccessNegativeTestJSON-1753152423-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-181119230", "id": 1358483083, "os-flavor-access:is_public": "False"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:54:37.743182 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:54:37.743182 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:54:37.765434 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-5da98d38-588c-40e6-b307-9ec410681c36 tempest-FlavorsAccessNegativeTestJSON-1753152423 tempest-FlavorsAccessNegativeTestJSON-1753152423-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.272742 Jan 15 20:54:37.766358 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 938/1806] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 20:54:37 2022] POST /compute/v2.1/flavors => generated 438 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:54:37.770840 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8de36c74-382f-4035-ba93-7e5fc915fe03 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:37.771649 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-8de36c74-382f-4035-ba93-7e5fc915fe03 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] [instance: 21c7200b-cace-49b4-ab7f-bf43771825ed] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:37.777720 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8de36c74-382f-4035-ba93-7e5fc915fe03 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:37.778347 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8de36c74-382f-4035-ba93-7e5fc915fe03 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:37.780182 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8de36c74-382f-4035-ba93-7e5fc915fe03 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:37.780784 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8de36c74-382f-4035-ba93-7e5fc915fe03 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:37.882536 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5edbada1-5955-4541-a9ea-299d84fec3d9 tempest-SecurityGroupsNegativeTestJSON-191577102 tempest-SecurityGroupsNegativeTestJSON-191577102-project] 10.222.0.46 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.216583 Jan 15 20:54:37.883279 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 869/1807] 10.222.0.46 () {58 vars in 1157 bytes} [Sat Jan 15 20:54:37 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:54:37.887828 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2b0ea7e8-bf3a-4c97-b2ec-94bb8231bb49 tempest-ServicesAdminNegativeTestJSON-868281886 tempest-ServicesAdminNegativeTestJSON-868281886-project-admin] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:37.889917 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:54:37.889917 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:54:37.891619 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2b0ea7e8-bf3a-4c97-b2ec-94bb8231bb49 tempest-ServicesAdminNegativeTestJSON-868281886 tempest-ServicesAdminNegativeTestJSON-868281886-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:37.892072 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2b0ea7e8-bf3a-4c97-b2ec-94bb8231bb49 tempest-ServicesAdminNegativeTestJSON-868281886 tempest-ServicesAdminNegativeTestJSON-868281886-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:37.892907 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2b0ea7e8-bf3a-4c97-b2ec-94bb8231bb49 tempest-ServicesAdminNegativeTestJSON-868281886 tempest-ServicesAdminNegativeTestJSON-868281886-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:37.893671 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2b0ea7e8-bf3a-4c97-b2ec-94bb8231bb49 tempest-ServicesAdminNegativeTestJSON-868281886 tempest-ServicesAdminNegativeTestJSON-868281886-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:37.918858 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2b0ea7e8-bf3a-4c97-b2ec-94bb8231bb49 tempest-ServicesAdminNegativeTestJSON-868281886 tempest-ServicesAdminNegativeTestJSON-868281886-project-admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.034209 Jan 15 20:54:37.919503 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 870/1808] 10.222.0.46 () {58 vars in 1169 bytes} [Sat Jan 15 20:54:37 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 947 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:54:37.925940 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-726a7f9c-ace9-4dba-a3ea-9dd8a97a53e0 tempest-FlavorsAccessNegativeTestJSON-1753152423 tempest-FlavorsAccessNegativeTestJSON-1753152423-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "9383bceaf4c649d8880aeb8a070179b5"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:54:37.927157 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:54:37.927157 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:54:37.962253 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-8de36c74-382f-4035-ba93-7e5fc915fe03 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e1b423e1a9146c8bb202ba012e2ee2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d5d92c87544c4d8080e19c1f6429bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:37.971324 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-8de36c74-382f-4035-ba93-7e5fc915fe03 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] 10.222.0.46 "GET /compute/v2.1/servers/21c7200b-cace-49b4-ab7f-bf43771825ed" status: 200 len: 1324 microversion: 2.1 time: 0.203762 Jan 15 20:54:37.972218 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 939/1809] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:54:37 2022] GET /compute/v2.1/servers/21c7200b-cace-49b4-ab7f-bf43771825ed => generated 1324 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:54:37.977607 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9f2b9dc2-7ab5-441c-8501-aa4980109877 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:37.978971 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-9f2b9dc2-7ab5-441c-8501-aa4980109877 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] [instance: b5943844-32ec-464b-b08f-7a618260f817] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:37.986246 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9f2b9dc2-7ab5-441c-8501-aa4980109877 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:37.986894 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9f2b9dc2-7ab5-441c-8501-aa4980109877 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:37.987879 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9f2b9dc2-7ab5-441c-8501-aa4980109877 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:37.988448 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9f2b9dc2-7ab5-441c-8501-aa4980109877 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:38.022024 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-9f2b9dc2-7ab5-441c-8501-aa4980109877 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] 10.222.0.46 "GET /compute/v2.1/servers/b5943844-32ec-464b-b08f-7a618260f817/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048489 Jan 15 20:54:38.024917 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 940/1810] 10.222.0.46 () {58 vars in 1301 bytes} [Sat Jan 15 20:54:37 2022] GET /compute/v2.1/servers/b5943844-32ec-464b-b08f-7a618260f817/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:54:38.027168 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d9c30a62-6ba3-4246-bcd6-684d5dfc318d tempest-SecurityGroupsNegativeTestJSON-191577102 tempest-SecurityGroupsNegativeTestJSON-191577102-project] Calling method '.version_select at 0x7f30c8edb700>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:38.147862 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-726a7f9c-ace9-4dba-a3ea-9dd8a97a53e0 tempest-FlavorsAccessNegativeTestJSON-1753152423 tempest-FlavorsAccessNegativeTestJSON-1753152423-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors/1358483083/action" status: 200 len: 97 microversion: 2.1 time: 0.225618 Jan 15 20:54:38.148912 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 871/1811] 10.222.0.46 () {60 vars in 1199 bytes} [Sat Jan 15 20:54:37 2022] POST /compute/v2.1/flavors/1358483083/action => generated 97 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 20:54:38.157375 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-85ecfec9-1426-4378-ab5e-245ce1a52166 tempest-ServicesAdminNegativeTestJSON-868281886 tempest-ServicesAdminNegativeTestJSON-868281886-project-admin] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:38.158560 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:54:38.158560 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:54:38.160488 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-85ecfec9-1426-4378-ab5e-245ce1a52166 tempest-ServicesAdminNegativeTestJSON-868281886 tempest-ServicesAdminNegativeTestJSON-868281886-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:38.160590 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-85ecfec9-1426-4378-ab5e-245ce1a52166 tempest-ServicesAdminNegativeTestJSON-868281886 tempest-ServicesAdminNegativeTestJSON-868281886-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:38.161414 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-85ecfec9-1426-4378-ab5e-245ce1a52166 tempest-ServicesAdminNegativeTestJSON-868281886 tempest-ServicesAdminNegativeTestJSON-868281886-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:38.161839 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-85ecfec9-1426-4378-ab5e-245ce1a52166 tempest-ServicesAdminNegativeTestJSON-868281886 tempest-ServicesAdminNegativeTestJSON-868281886-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:38.172227 ncdv-master-1 devstack@n-api.service[129366]: DEBUG neutronclient.v2_0.client [None req-d9c30a62-6ba3-4246-bcd6-684d5dfc318d tempest-SecurityGroupsNegativeTestJSON-191577102 tempest-SecurityGroupsNegativeTestJSON-191577102-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=129366) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jan 15 20:54:38.173540 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-d9c30a62-6ba3-4246-bcd6-684d5dfc318d tempest-SecurityGroupsNegativeTestJSON-191577102 tempest-SecurityGroupsNegativeTestJSON-191577102-project] HTTP exception thrown: Insufficient rights for removing default security group. Jan 15 20:54:38.173540 ncdv-master-1 devstack@n-api.service[129366]: Neutron server returns request_ids: ['req-c46ed4b6-5c88-44b0-b224-d83da36a4f7f'] Jan 15 20:54:38.174217 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d9c30a62-6ba3-4246-bcd6-684d5dfc318d tempest-SecurityGroupsNegativeTestJSON-191577102 tempest-SecurityGroupsNegativeTestJSON-191577102-project] Returning 400 to user: Insufficient rights for removing default security group. Jan 15 20:54:38.174217 ncdv-master-1 devstack@n-api.service[129366]: Neutron server returns request_ids: ['req-c46ed4b6-5c88-44b0-b224-d83da36a4f7f'] {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:54:38.175619 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d9c30a62-6ba3-4246-bcd6-684d5dfc318d tempest-SecurityGroupsNegativeTestJSON-191577102 tempest-SecurityGroupsNegativeTestJSON-191577102-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/0f88248d-0015-4811-961c-8211ae94734e" status: 400 len: 182 microversion: 2.1 time: 0.151638 Jan 15 20:54:38.181030 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 941/1812] 10.222.0.46 () {58 vars in 1271 bytes} [Sat Jan 15 20:54:38 2022] DELETE /compute/v2.1/os-security-groups/0f88248d-0015-4811-961c-8211ae94734e => generated 182 bytes in 153 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 15 20:54:38.189930 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-2a01fb66-a20c-45b4-a0b3-43a1ca510354 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:38.192909 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-85ecfec9-1426-4378-ab5e-245ce1a52166 tempest-ServicesAdminNegativeTestJSON-868281886 tempest-ServicesAdminNegativeTestJSON-868281886-project-admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.042936 Jan 15 20:54:38.193168 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-2a01fb66-a20c-45b4-a0b3-43a1ca510354 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] [instance: b5943844-32ec-464b-b08f-7a618260f817] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:38.194239 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 872/1813] 10.222.0.46 () {58 vars in 1136 bytes} [Sat Jan 15 20:54:38 2022] GET /compute/v2.1/os-services => generated 947 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:54:38.199253 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-eabed3db-1a39-4abb-8c9e-aef8e6acc814 tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:38.199780 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2a01fb66-a20c-45b4-a0b3-43a1ca510354 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:38.200272 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2a01fb66-a20c-45b4-a0b3-43a1ca510354 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:38.200712 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-eabed3db-1a39-4abb-8c9e-aef8e6acc814 tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] [instance: 41de38d6-3f2c-4912-adae-bef0ad0ffbb1] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:38.201238 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2a01fb66-a20c-45b4-a0b3-43a1ca510354 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:38.201718 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2a01fb66-a20c-45b4-a0b3-43a1ca510354 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:38.207480 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-eabed3db-1a39-4abb-8c9e-aef8e6acc814 tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:38.208144 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-eabed3db-1a39-4abb-8c9e-aef8e6acc814 tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:38.209111 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-eabed3db-1a39-4abb-8c9e-aef8e6acc814 tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:38.209788 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-eabed3db-1a39-4abb-8c9e-aef8e6acc814 tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:38.347086 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.objects.instance [None req-2a01fb66-a20c-45b4-a0b3-43a1ca510354 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Lazy-loading 'services' on Instance uuid b5943844-32ec-464b-b08f-7a618260f817 {{(pid=129366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 20:54:38.391289 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-eabed3db-1a39-4abb-8c9e-aef8e6acc814 tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f600415e36a4c909b49948cbae3f34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c18cfa337f4413afcb5b0741441512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:38.401156 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-eabed3db-1a39-4abb-8c9e-aef8e6acc814 tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] 10.222.0.46 "GET /compute/v2.1/servers/41de38d6-3f2c-4912-adae-bef0ad0ffbb1" status: 200 len: 1479 microversion: 2.1 time: 0.204694 Jan 15 20:54:38.409850 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 873/1814] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:54:38 2022] GET /compute/v2.1/servers/41de38d6-3f2c-4912-adae-bef0ad0ffbb1 => generated 1479 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:54:38.415930 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-7d6ab639-c72f-4d28-9683-e253507c9665 tempest-FlavorsAccessNegativeTestJSON-1753152423 tempest-FlavorsAccessNegativeTestJSON-1753152423-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "9383bceaf4c649d8880aeb8a070179b5"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:54:38.417234 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:54:38.417234 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:54:38.484656 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-2a01fb66-a20c-45b4-a0b3-43a1ca510354 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] 10.222.0.46 "DELETE /compute/v2.1/servers/b5943844-32ec-464b-b08f-7a618260f817/os-volume_attachments/684a098f-564a-4f37-94f8-f08328ebc632" status: 202 len: 0 microversion: 2.1 time: 0.306190 Jan 15 20:54:38.485294 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 942/1815] 10.222.0.46 () {58 vars in 1415 bytes} [Sat Jan 15 20:54:38 2022] DELETE /compute/v2.1/servers/b5943844-32ec-464b-b08f-7a618260f817/os-volume_attachments/684a098f-564a-4f37-94f8-f08328ebc632 => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 20:54:38.491839 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9b653fc2-662f-4f14-9175-180db9267ea9 tempest-SecurityGroupsNegativeTestJSON-191577102 tempest-SecurityGroupsNegativeTestJSON-191577102-project] Calling method '.version_select at 0x7f30c8deaa60>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:38.538084 ncdv-master-1 devstack@n-api.service[129366]: DEBUG neutronclient.v2_0.client [None req-9b653fc2-662f-4f14-9175-180db9267ea9 tempest-SecurityGroupsNegativeTestJSON-191577102 tempest-SecurityGroupsNegativeTestJSON-191577102-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 7c504e2d-9d5a-4e00-aa47-1c3c5cad4237 does not exist", "detail": ""}} {{(pid=129366) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jan 15 20:54:38.538750 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.network.security_group_api [None req-9b653fc2-662f-4f14-9175-180db9267ea9 tempest-SecurityGroupsNegativeTestJSON-191577102 tempest-SecurityGroupsNegativeTestJSON-191577102-project] Neutron security group 7c504e2d-9d5a-4e00-aa47-1c3c5cad4237 not found {{(pid=129366) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jan 15 20:54:38.539369 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-9b653fc2-662f-4f14-9175-180db9267ea9 tempest-SecurityGroupsNegativeTestJSON-191577102 tempest-SecurityGroupsNegativeTestJSON-191577102-project] HTTP exception thrown: Security group 7c504e2d-9d5a-4e00-aa47-1c3c5cad4237 does not exist Jan 15 20:54:38.539369 ncdv-master-1 devstack@n-api.service[129366]: Neutron server returns request_ids: ['req-bb054f4d-03fd-4a41-af48-bfee2c453c0b'] Jan 15 20:54:38.540120 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9b653fc2-662f-4f14-9175-180db9267ea9 tempest-SecurityGroupsNegativeTestJSON-191577102 tempest-SecurityGroupsNegativeTestJSON-191577102-project] Returning 404 to user: Security group 7c504e2d-9d5a-4e00-aa47-1c3c5cad4237 does not exist Jan 15 20:54:38.540120 ncdv-master-1 devstack@n-api.service[129366]: Neutron server returns request_ids: ['req-bb054f4d-03fd-4a41-af48-bfee2c453c0b'] {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:54:38.541057 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-9b653fc2-662f-4f14-9175-180db9267ea9 tempest-SecurityGroupsNegativeTestJSON-191577102 tempest-SecurityGroupsNegativeTestJSON-191577102-project] 10.222.0.46 "GET /compute/v2.1/os-security-groups/7c504e2d-9d5a-4e00-aa47-1c3c5cad4237" status: 404 len: 194 microversion: 2.1 time: 0.054480 Jan 15 20:54:38.542012 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 943/1816] 10.222.0.46 () {58 vars in 1268 bytes} [Sat Jan 15 20:54:38 2022] GET /compute/v2.1/os-security-groups/7c504e2d-9d5a-4e00-aa47-1c3c5cad4237 => generated 194 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:54:38.547625 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-672e5ea8-1e3d-4494-acc8-f1673bff5a91 tempest-ServicesAdminNegativeTestJSON-868281886 tempest-ServicesAdminNegativeTestJSON-868281886-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:38.550440 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:54:38.550440 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:54:38.555272 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-672e5ea8-1e3d-4494-acc8-f1673bff5a91 tempest-ServicesAdminNegativeTestJSON-868281886 tempest-ServicesAdminNegativeTestJSON-868281886-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:38.555971 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-672e5ea8-1e3d-4494-acc8-f1673bff5a91 tempest-ServicesAdminNegativeTestJSON-868281886 tempest-ServicesAdminNegativeTestJSON-868281886-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:38.556790 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-672e5ea8-1e3d-4494-acc8-f1673bff5a91 tempest-ServicesAdminNegativeTestJSON-868281886 tempest-ServicesAdminNegativeTestJSON-868281886-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:38.557247 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-672e5ea8-1e3d-4494-acc8-f1673bff5a91 tempest-ServicesAdminNegativeTestJSON-868281886 tempest-ServicesAdminNegativeTestJSON-868281886-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:38.606461 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-672e5ea8-1e3d-4494-acc8-f1673bff5a91 tempest-ServicesAdminNegativeTestJSON-868281886 tempest-ServicesAdminNegativeTestJSON-868281886-project-admin] 10.222.0.46 "GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.063099 Jan 15 20:54:38.606976 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 944/1817] 10.222.0.46 () {58 vars in 1195 bytes} [Sat Jan 15 20:54:38 2022] GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx => generated 16 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 20:54:38.613697 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0a99a133-4a51-4127-8bb3-4a7c8b3ebc9f tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:38.614394 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-0a99a133-4a51-4127-8bb3-4a7c8b3ebc9f tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] [instance: f6a6025e-5439-4ba5-a8b8-20019413661b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:38.621914 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0a99a133-4a51-4127-8bb3-4a7c8b3ebc9f tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:38.622247 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0a99a133-4a51-4127-8bb3-4a7c8b3ebc9f tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:38.623110 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0a99a133-4a51-4127-8bb3-4a7c8b3ebc9f tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:38.624499 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0a99a133-4a51-4127-8bb3-4a7c8b3ebc9f tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:38.637775 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-0a99a133-4a51-4127-8bb3-4a7c8b3ebc9f tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] HTTP exception thrown: Instance f6a6025e-5439-4ba5-a8b8-20019413661b could not be found. Jan 15 20:54:38.639906 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0a99a133-4a51-4127-8bb3-4a7c8b3ebc9f tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Returning 404 to user: Instance f6a6025e-5439-4ba5-a8b8-20019413661b could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:54:38.641165 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0a99a133-4a51-4127-8bb3-4a7c8b3ebc9f tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] 10.222.0.46 "GET /compute/v2.1/servers/f6a6025e-5439-4ba5-a8b8-20019413661b" status: 404 len: 111 microversion: 2.1 time: 0.030506 Jan 15 20:54:38.641936 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 945/1818] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:54:38 2022] GET /compute/v2.1/servers/f6a6025e-5439-4ba5-a8b8-20019413661b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:54:38.648466 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-5f30bcf6-5540-4d27-bec8-2fd33e6ef5b7 tempest-SecurityGroupsNegativeTestJSON-191577102 tempest-SecurityGroupsNegativeTestJSON-191577102-project] Action: 'update', calling method: .version_select at 0x7f30c8deaa60>, body: {"security_group": {"name": "tempest-sg-1387395965", "description": "tempest-description-1841362536"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:54:38.674344 ncdv-master-1 devstack@n-api.service[129366]: DEBUG neutronclient.v2_0.client [None req-5f30bcf6-5540-4d27-bec8-2fd33e6ef5b7 tempest-SecurityGroupsNegativeTestJSON-191577102 tempest-SecurityGroupsNegativeTestJSON-191577102-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 280a3fe7-0cc1-45a5-be81-2baff9aa249c does not exist", "detail": ""}} {{(pid=129366) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jan 15 20:54:38.674963 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.network.security_group_api [None req-5f30bcf6-5540-4d27-bec8-2fd33e6ef5b7 tempest-SecurityGroupsNegativeTestJSON-191577102 tempest-SecurityGroupsNegativeTestJSON-191577102-project] Neutron security group 280a3fe7-0cc1-45a5-be81-2baff9aa249c not found {{(pid=129366) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jan 15 20:54:38.675441 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-5f30bcf6-5540-4d27-bec8-2fd33e6ef5b7 tempest-SecurityGroupsNegativeTestJSON-191577102 tempest-SecurityGroupsNegativeTestJSON-191577102-project] HTTP exception thrown: Security group 280a3fe7-0cc1-45a5-be81-2baff9aa249c does not exist Jan 15 20:54:38.675441 ncdv-master-1 devstack@n-api.service[129366]: Neutron server returns request_ids: ['req-d4ffcf87-b375-4135-bc5a-72c06aa7855d'] Jan 15 20:54:38.676031 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-5f30bcf6-5540-4d27-bec8-2fd33e6ef5b7 tempest-SecurityGroupsNegativeTestJSON-191577102 tempest-SecurityGroupsNegativeTestJSON-191577102-project] Returning 404 to user: Security group 280a3fe7-0cc1-45a5-be81-2baff9aa249c does not exist Jan 15 20:54:38.676031 ncdv-master-1 devstack@n-api.service[129366]: Neutron server returns request_ids: ['req-d4ffcf87-b375-4135-bc5a-72c06aa7855d'] {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:54:38.676811 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-5f30bcf6-5540-4d27-bec8-2fd33e6ef5b7 tempest-SecurityGroupsNegativeTestJSON-191577102 tempest-SecurityGroupsNegativeTestJSON-191577102-project] 10.222.0.46 "PUT /compute/v2.1/os-security-groups/280a3fe7-0cc1-45a5-be81-2baff9aa249c" status: 404 len: 194 microversion: 2.1 time: 0.034216 Jan 15 20:54:38.677719 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 946/1819] 10.222.0.46 () {60 vars in 1289 bytes} [Sat Jan 15 20:54:38 2022] PUT /compute/v2.1/os-security-groups/280a3fe7-0cc1-45a5-be81-2baff9aa249c => generated 194 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:54:38.682824 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ac191da8-2123-4d22-995d-206e9a03e18b tempest-ServicesAdminNegativeTestJSON-868281886 tempest-ServicesAdminNegativeTestJSON-868281886-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:38.683971 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:54:38.683971 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:54:38.693332 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ac191da8-2123-4d22-995d-206e9a03e18b tempest-ServicesAdminNegativeTestJSON-868281886 tempest-ServicesAdminNegativeTestJSON-868281886-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:38.693866 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ac191da8-2123-4d22-995d-206e9a03e18b tempest-ServicesAdminNegativeTestJSON-868281886 tempest-ServicesAdminNegativeTestJSON-868281886-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:38.695506 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ac191da8-2123-4d22-995d-206e9a03e18b tempest-ServicesAdminNegativeTestJSON-868281886 tempest-ServicesAdminNegativeTestJSON-868281886-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:38.695944 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ac191da8-2123-4d22-995d-206e9a03e18b tempest-ServicesAdminNegativeTestJSON-868281886 tempest-ServicesAdminNegativeTestJSON-868281886-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:38.714646 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-7d6ab639-c72f-4d28-9683-e253507c9665 tempest-FlavorsAccessNegativeTestJSON-1753152423 tempest-FlavorsAccessNegativeTestJSON-1753152423-project-admin] HTTP exception thrown: Flavor access already exists for flavor 35 and project 9383bceaf4c649d8880aeb8a070179b5 combination. Jan 15 20:54:38.715441 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-7d6ab639-c72f-4d28-9683-e253507c9665 tempest-FlavorsAccessNegativeTestJSON-1753152423 tempest-FlavorsAccessNegativeTestJSON-1753152423-project-admin] Returning 409 to user: Flavor access already exists for flavor 35 and project 9383bceaf4c649d8880aeb8a070179b5 combination. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:54:38.718852 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-7d6ab639-c72f-4d28-9683-e253507c9665 tempest-FlavorsAccessNegativeTestJSON-1753152423 tempest-FlavorsAccessNegativeTestJSON-1753152423-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors/1358483083/action" status: 409 len: 152 microversion: 2.1 time: 0.307127 Jan 15 20:54:38.719481 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 874/1820] 10.222.0.46 () {60 vars in 1199 bytes} [Sat Jan 15 20:54:38 2022] POST /compute/v2.1/flavors/1358483083/action => generated 152 bytes in 309 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jan 15 20:54:38.736345 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-02cfcd54-2d50-4331-9732-d8651c727b09 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Calling method '.version_select at 0x7f30c913b3a0>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:38.753537 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ac191da8-2123-4d22-995d-206e9a03e18b tempest-ServicesAdminNegativeTestJSON-868281886 tempest-ServicesAdminNegativeTestJSON-868281886-project-admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.074602 Jan 15 20:54:38.755052 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 947/1821] 10.222.0.46 () {58 vars in 1136 bytes} [Sat Jan 15 20:54:38 2022] GET /compute/v2.1/os-services => generated 947 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:54:38.761102 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9d4eb643-1859-4ded-b603-bd2b82594704 tempest-FlavorsAccessNegativeTestJSON-1753152423 tempest-FlavorsAccessNegativeTestJSON-1753152423-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "9383bceaf4c649d8880aeb8a070179b5"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:54:38.765090 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:54:38.765090 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:54:38.958707 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-9d4eb643-1859-4ded-b603-bd2b82594704 tempest-FlavorsAccessNegativeTestJSON-1753152423 tempest-FlavorsAccessNegativeTestJSON-1753152423-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors/1358483083/action" status: 200 len: 21 microversion: 2.1 time: 0.202147 Jan 15 20:54:38.964775 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 948/1822] 10.222.0.46 () {60 vars in 1199 bytes} [Sat Jan 15 20:54:38 2022] POST /compute/v2.1/flavors/1358483083/action => generated 21 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 20:54:38.971220 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f6af8dde-ee60-4467-9be4-8824f5f2ef6e tempest-ServicesAdminNegativeTestJSON-868281886 tempest-ServicesAdminNegativeTestJSON-868281886-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:38.972430 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:54:38.972430 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:54:38.974737 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f6af8dde-ee60-4467-9be4-8824f5f2ef6e tempest-ServicesAdminNegativeTestJSON-868281886 tempest-ServicesAdminNegativeTestJSON-868281886-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:38.975192 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f6af8dde-ee60-4467-9be4-8824f5f2ef6e tempest-ServicesAdminNegativeTestJSON-868281886 tempest-ServicesAdminNegativeTestJSON-868281886-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:38.976131 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f6af8dde-ee60-4467-9be4-8824f5f2ef6e tempest-ServicesAdminNegativeTestJSON-868281886 tempest-ServicesAdminNegativeTestJSON-868281886-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:38.976703 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f6af8dde-ee60-4467-9be4-8824f5f2ef6e tempest-ServicesAdminNegativeTestJSON-868281886 tempest-ServicesAdminNegativeTestJSON-868281886-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:39.008718 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f6af8dde-ee60-4467-9be4-8824f5f2ef6e tempest-ServicesAdminNegativeTestJSON-868281886 tempest-ServicesAdminNegativeTestJSON-868281886-project-admin] 10.222.0.46 "GET /compute/v2.1/os-services?host=xxx&binary=nova-conductor" status: 200 len: 16 microversion: 2.1 time: 0.042801 Jan 15 20:54:39.016057 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 949/1823] 10.222.0.46 () {58 vars in 1197 bytes} [Sat Jan 15 20:54:38 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-conductor => generated 16 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 20:54:39.020105 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7b3bf567-7ee3-489a-b1d0-b4dbeffd64cb tempest-FlavorsAccessNegativeTestJSON-1753152423 tempest-FlavorsAccessNegativeTestJSON-1753152423-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:39.020976 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:54:39.020976 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:54:39.046370 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7b3bf567-7ee3-489a-b1d0-b4dbeffd64cb tempest-FlavorsAccessNegativeTestJSON-1753152423 tempest-FlavorsAccessNegativeTestJSON-1753152423-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/1358483083" status: 202 len: 0 microversion: 2.1 time: 0.033818 Jan 15 20:54:39.051560 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 950/1824] 10.222.0.46 () {58 vars in 1160 bytes} [Sat Jan 15 20:54:39 2022] DELETE /compute/v2.1/flavors/1358483083 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 20:54:39.058902 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-3f765119-960f-4fd4-949b-506c43996f1d tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:39.060044 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-3f765119-960f-4fd4-949b-506c43996f1d tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] [instance: 21c7200b-cace-49b4-ab7f-bf43771825ed] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:39.079527 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3f765119-960f-4fd4-949b-506c43996f1d tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:39.081308 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3f765119-960f-4fd4-949b-506c43996f1d tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:39.082104 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3f765119-960f-4fd4-949b-506c43996f1d tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:39.082657 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3f765119-960f-4fd4-949b-506c43996f1d tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:39.363193 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-3f765119-960f-4fd4-949b-506c43996f1d tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e1b423e1a9146c8bb202ba012e2ee2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d5d92c87544c4d8080e19c1f6429bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:39.379116 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-3f765119-960f-4fd4-949b-506c43996f1d tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] 10.222.0.46 "GET /compute/v2.1/servers/21c7200b-cace-49b4-ab7f-bf43771825ed" status: 200 len: 1521 microversion: 2.1 time: 0.318865 Jan 15 20:54:39.384895 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 951/1825] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:54:39 2022] GET /compute/v2.1/servers/21c7200b-cace-49b4-ab7f-bf43771825ed => generated 1521 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:54:39.390994 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-02cfcd54-2d50-4331-9732-d8651c727b09 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/e251adca-5ba6-4b03-828d-e26b6bdb42fb" status: 202 len: 0 microversion: 2.1 time: 0.665367 Jan 15 20:54:39.395870 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 875/1826] 10.222.0.46 () {58 vars in 1271 bytes} [Sat Jan 15 20:54:38 2022] DELETE /compute/v2.1/os-security-groups/e251adca-5ba6-4b03-828d-e26b6bdb42fb => generated 0 bytes in 676 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 20:54:39.401011 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e8a1a380-7b91-4dce-8376-14cd9f68a4c0 tempest-FlavorsAccessNegativeTestJSON-1753152423 tempest-FlavorsAccessNegativeTestJSON-1753152423-project-admin] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:39.444792 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e8a1a380-7b91-4dce-8376-14cd9f68a4c0 tempest-FlavorsAccessNegativeTestJSON-1753152423 tempest-FlavorsAccessNegativeTestJSON-1753152423-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.047489 Jan 15 20:54:39.445677 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 876/1827] 10.222.0.46 () {58 vars in 1145 bytes} [Sat Jan 15 20:54:39 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:54:39.462479 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-c01aca49-8dd7-4bdb-b90a-c0f5a6a73a9d req-c025ac3b-a378-460b-926f-0b531055248c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41de38d6-3f2c-4912-adae-bef0ad0ffbb1", "name": "network-vif-deleted", "tag": "e9008cdf-b62f-4f84-8aec-da321150af1c"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:54:39.464073 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:54:39.464073 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:54:39.473094 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-c01aca49-8dd7-4bdb-b90a-c0f5a6a73a9d req-c025ac3b-a378-460b-926f-0b531055248c service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:39.473806 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-c01aca49-8dd7-4bdb-b90a-c0f5a6a73a9d req-c025ac3b-a378-460b-926f-0b531055248c service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:39.485729 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-c01aca49-8dd7-4bdb-b90a-c0f5a6a73a9d req-c025ac3b-a378-460b-926f-0b531055248c service nova] Creating event network-vif-deleted:e9008cdf-b62f-4f84-8aec-da321150af1c for instance 41de38d6-3f2c-4912-adae-bef0ad0ffbb1 on nch2-master-1 Jan 15 20:54:39.491009 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-c01aca49-8dd7-4bdb-b90a-c0f5a6a73a9d req-c025ac3b-a378-460b-926f-0b531055248c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032967 Jan 15 20:54:39.491754 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 877/1828] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:54:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:54:39.498184 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d6728ce4-2e2a-4fe5-ac3e-cadf0b236711 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:39.499196 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d6728ce4-2e2a-4fe5-ac3e-cadf0b236711 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] [instance: 21c7200b-cace-49b4-ab7f-bf43771825ed] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:39.505981 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d6728ce4-2e2a-4fe5-ac3e-cadf0b236711 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:39.507406 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d6728ce4-2e2a-4fe5-ac3e-cadf0b236711 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:39.508516 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d6728ce4-2e2a-4fe5-ac3e-cadf0b236711 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:39.509410 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d6728ce4-2e2a-4fe5-ac3e-cadf0b236711 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:39.651544 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c3a54c70-e5c6-4431-9d3d-1628708667a9 tempest-ServicesAdminNegativeTestJSON-490181095 tempest-ServicesAdminNegativeTestJSON-490181095-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:39.652814 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:54:39.652814 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:54:39.654643 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-c3a54c70-e5c6-4431-9d3d-1628708667a9 tempest-ServicesAdminNegativeTestJSON-490181095 tempest-ServicesAdminNegativeTestJSON-490181095-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '126f83b8f34c4ee8a7ae0d4ba85814a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c088576f320545f1acbf3bb92d5ebb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:39.655506 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c3a54c70-e5c6-4431-9d3d-1628708667a9 tempest-ServicesAdminNegativeTestJSON-490181095 tempest-ServicesAdminNegativeTestJSON-490181095-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:54:39.661478 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c3a54c70-e5c6-4431-9d3d-1628708667a9 tempest-ServicesAdminNegativeTestJSON-490181095 tempest-ServicesAdminNegativeTestJSON-490181095-project] 10.222.0.46 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.252001 Jan 15 20:54:39.679199 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 952/1829] 10.222.0.46 () {58 vars in 1136 bytes} [Sat Jan 15 20:54:39 2022] GET /compute/v2.1/os-services => generated 112 bytes in 291 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:54:39.694454 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-99c6ec5f-c581-4a27-b0ac-5ec164844cb7 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Calling method '.version_select at 0x7f30c8e35e50>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:39.763198 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-d6728ce4-2e2a-4fe5-ac3e-cadf0b236711 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e1b423e1a9146c8bb202ba012e2ee2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d5d92c87544c4d8080e19c1f6429bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:39.774912 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d6728ce4-2e2a-4fe5-ac3e-cadf0b236711 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] 10.222.0.46 "GET /compute/v2.1/servers/21c7200b-cace-49b4-ab7f-bf43771825ed" status: 200 len: 1521 microversion: 2.1 time: 0.279868 Jan 15 20:54:39.776322 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 878/1830] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:54:39 2022] GET /compute/v2.1/servers/21c7200b-cace-49b4-ab7f-bf43771825ed => generated 1521 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:54:39.788083 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f7f44eb3-88f7-4878-bf2e-5329c41b7c1d tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:39.791538 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f7f44eb3-88f7-4878-bf2e-5329c41b7c1d tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] [instance: 41de38d6-3f2c-4912-adae-bef0ad0ffbb1] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:39.802214 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f7f44eb3-88f7-4878-bf2e-5329c41b7c1d tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:39.803265 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f7f44eb3-88f7-4878-bf2e-5329c41b7c1d tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:39.804665 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f7f44eb3-88f7-4878-bf2e-5329c41b7c1d tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:39.806039 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f7f44eb3-88f7-4878-bf2e-5329c41b7c1d tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:39.886973 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f7f44eb3-88f7-4878-bf2e-5329c41b7c1d tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:39.887716 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f7f44eb3-88f7-4878-bf2e-5329c41b7c1d tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:39.889407 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.objects.instance [None req-f7f44eb3-88f7-4878-bf2e-5329c41b7c1d tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] Lazy-loading 'fault' on Instance uuid 41de38d6-3f2c-4912-adae-bef0ad0ffbb1 {{(pid=129365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 20:54:39.982092 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-f7f44eb3-88f7-4878-bf2e-5329c41b7c1d tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f600415e36a4c909b49948cbae3f34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c18cfa337f4413afcb5b0741441512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:39.992382 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f7f44eb3-88f7-4878-bf2e-5329c41b7c1d tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] 10.222.0.46 "GET /compute/v2.1/servers/41de38d6-3f2c-4912-adae-bef0ad0ffbb1" status: 200 len: 1313 microversion: 2.1 time: 0.213511 Jan 15 20:54:39.993614 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 879/1831] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:54:39 2022] GET /compute/v2.1/servers/41de38d6-3f2c-4912-adae-bef0ad0ffbb1 => generated 1313 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:54:40.000245 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8e0df266-37e9-4cb8-ae10-df6e4cc06eb0 tempest-FlavorsAccessNegativeTestJSON-1753152423 tempest-FlavorsAccessNegativeTestJSON-1753152423-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1994533371", "id": 572740925, "os-flavor-access:is_public": "True"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:54:40.002183 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:54:40.002183 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:54:40.023667 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-8e0df266-37e9-4cb8-ae10-df6e4cc06eb0 tempest-FlavorsAccessNegativeTestJSON-1753152423 tempest-FlavorsAccessNegativeTestJSON-1753152423-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.027386 Jan 15 20:54:40.025148 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 880/1832] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 20:54:39 2022] POST /compute/v2.1/flavors => generated 435 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:54:40.035018 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-06a49c74-e3e0-4793-a868-3e34c560c716 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:40.038093 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-06a49c74-e3e0-4793-a868-3e34c560c716 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] [instance: b5943844-32ec-464b-b08f-7a618260f817] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:40.055924 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-06a49c74-e3e0-4793-a868-3e34c560c716 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:40.057478 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-06a49c74-e3e0-4793-a868-3e34c560c716 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:40.060507 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-06a49c74-e3e0-4793-a868-3e34c560c716 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:40.061379 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-06a49c74-e3e0-4793-a868-3e34c560c716 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:40.106211 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-99c6ec5f-c581-4a27-b0ac-5ec164844cb7 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/6f2925c8-4e8b-4ae9-8a62-c89aae730cbe" status: 202 len: 0 microversion: 2.1 time: 0.423463 Jan 15 20:54:40.107010 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 953/1833] 10.222.0.46 () {58 vars in 1271 bytes} [Sat Jan 15 20:54:39 2022] DELETE /compute/v2.1/os-security-groups/6f2925c8-4e8b-4ae9-8a62-c89aae730cbe => generated 0 bytes in 427 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 20:54:40.116881 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a466a0ee-6f91-4a27-b7bd-e6dfbab8796e tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1693434342", "metadata": {"": ""}}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:54:40.118038 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-06a49c74-e3e0-4793-a868-3e34c560c716 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] 10.222.0.46 "GET /compute/v2.1/servers/b5943844-32ec-464b-b08f-7a618260f817/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.091070 Jan 15 20:54:40.118412 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a466a0ee-6f91-4a27-b7bd-e6dfbab8796e tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:54:40.119354 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 881/1834] 10.222.0.46 () {58 vars in 1301 bytes} [Sat Jan 15 20:54:40 2022] GET /compute/v2.1/servers/b5943844-32ec-464b-b08f-7a618260f817/os-volume_attachments => generated 25 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 20:54:40.125812 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-50c195c3-1f93-49c6-b5d1-2825a3fc15c7 tempest-FlavorsAccessNegativeTestJSON-1753152423 tempest-FlavorsAccessNegativeTestJSON-1753152423-project-admin] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:40.126801 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:54:40.126801 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:54:40.130814 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a466a0ee-6f91-4a27-b7bd-e6dfbab8796e tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] 10.222.0.46 "POST /compute/v2.1/servers/21c7200b-cace-49b4-ab7f-bf43771825ed/action" status: 400 len: 170 microversion: 2.1 time: 0.011032 Jan 15 20:54:40.132263 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 954/1835] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Jan 15 20:54:40 2022] POST /compute/v2.1/servers/21c7200b-cace-49b4-ab7f-bf43771825ed/action => generated 170 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 15 20:54:40.148427 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1fc23171-b592-4d10-ab4b-e02fa03027b2 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Action: 'create', calling method: .version_select at 0x7f30c8df2a60>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-19148596", "description": "tempest-description-1654808046"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:54:40.153637 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-50c195c3-1f93-49c6-b5d1-2825a3fc15c7 tempest-FlavorsAccessNegativeTestJSON-1753152423 tempest-FlavorsAccessNegativeTestJSON-1753152423-project-admin] HTTP exception thrown: Access list not available for public flavors. Jan 15 20:54:40.155051 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-50c195c3-1f93-49c6-b5d1-2825a3fc15c7 tempest-FlavorsAccessNegativeTestJSON-1753152423 tempest-FlavorsAccessNegativeTestJSON-1753152423-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:54:40.156221 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-50c195c3-1f93-49c6-b5d1-2825a3fc15c7 tempest-FlavorsAccessNegativeTestJSON-1753152423 tempest-FlavorsAccessNegativeTestJSON-1753152423-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/572740925/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.035190 Jan 15 20:54:40.160554 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 882/1836] 10.222.0.46 () {58 vars in 1205 bytes} [Sat Jan 15 20:54:40 2022] GET /compute/v2.1/flavors/572740925/os-flavor-access => generated 91 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jan 15 20:54:40.165825 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-57ea529b-1d9d-4153-ad8e-74bbd4e8f798 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:40.166623 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-57ea529b-1d9d-4153-ad8e-74bbd4e8f798 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] [instance: 21c7200b-cace-49b4-ab7f-bf43771825ed] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:40.175268 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-57ea529b-1d9d-4153-ad8e-74bbd4e8f798 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:40.175933 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-57ea529b-1d9d-4153-ad8e-74bbd4e8f798 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:40.177105 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-57ea529b-1d9d-4153-ad8e-74bbd4e8f798 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:40.177995 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-57ea529b-1d9d-4153-ad8e-74bbd4e8f798 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:40.552150 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-57ea529b-1d9d-4153-ad8e-74bbd4e8f798 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e1b423e1a9146c8bb202ba012e2ee2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d5d92c87544c4d8080e19c1f6429bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:40.564990 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-57ea529b-1d9d-4153-ad8e-74bbd4e8f798 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] 10.222.0.46 "GET /compute/v2.1/servers/21c7200b-cace-49b4-ab7f-bf43771825ed" status: 200 len: 1521 microversion: 2.1 time: 0.403051 Jan 15 20:54:40.567453 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 883/1837] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:54:40 2022] GET /compute/v2.1/servers/21c7200b-cace-49b4-ab7f-bf43771825ed => generated 1521 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:54:40.577076 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a1016456-3447-427a-a565-182a4dadf892 tempest-FlavorsAccessNegativeTestJSON-1753152423 tempest-FlavorsAccessNegativeTestJSON-1753152423-project-admin] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:40.578127 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:54:40.578127 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:54:40.626930 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a1016456-3447-427a-a565-182a4dadf892 tempest-FlavorsAccessNegativeTestJSON-1753152423 tempest-FlavorsAccessNegativeTestJSON-1753152423-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/572740925" status: 202 len: 0 microversion: 2.1 time: 0.056933 Jan 15 20:54:40.627663 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 884/1838] 10.222.0.46 () {58 vars in 1157 bytes} [Sat Jan 15 20:54:40 2022] DELETE /compute/v2.1/flavors/572740925 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 20:54:40.634378 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-1fc23171-b592-4d10-ab4b-e02fa03027b2 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] 10.222.0.46 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.498673 Jan 15 20:54:40.639171 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2a1e458f-4f0d-4833-9eb5-1a07508e0e88 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:40.640302 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-2a1e458f-4f0d-4833-9eb5-1a07508e0e88 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] [instance: b5943844-32ec-464b-b08f-7a618260f817] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:40.642588 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 955/1839] 10.222.0.46 () {60 vars in 1179 bytes} [Sat Jan 15 20:54:40 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:54:40.648473 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-95046bdf-49f1-4d03-809b-79d087a28c96 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:40.649097 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-95046bdf-49f1-4d03-809b-79d087a28c96 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] [instance: 21c7200b-cace-49b4-ab7f-bf43771825ed] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:40.664001 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2a1e458f-4f0d-4833-9eb5-1a07508e0e88 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:40.664477 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2a1e458f-4f0d-4833-9eb5-1a07508e0e88 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:40.667220 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-95046bdf-49f1-4d03-809b-79d087a28c96 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:40.668673 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2a1e458f-4f0d-4833-9eb5-1a07508e0e88 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:40.668998 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-95046bdf-49f1-4d03-809b-79d087a28c96 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:40.669199 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2a1e458f-4f0d-4833-9eb5-1a07508e0e88 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:40.671707 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-95046bdf-49f1-4d03-809b-79d087a28c96 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:40.673229 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-95046bdf-49f1-4d03-809b-79d087a28c96 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:40.736196 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2a1e458f-4f0d-4833-9eb5-1a07508e0e88 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] 10.222.0.46 "GET /compute/v2.1/servers/b5943844-32ec-464b-b08f-7a618260f817/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.091819 Jan 15 20:54:40.743287 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 885/1840] 10.222.0.46 () {58 vars in 1301 bytes} [Sat Jan 15 20:54:40 2022] GET /compute/v2.1/servers/b5943844-32ec-464b-b08f-7a618260f817/os-volume_attachments => generated 25 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 20:54:40.751160 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f786457e-f8aa-43f1-88fe-d8589f2804d8 tempest-FlavorsAccessNegativeTestJSON-1753152423 tempest-FlavorsAccessNegativeTestJSON-1753152423-project-admin] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:40.800598 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f786457e-f8aa-43f1-88fe-d8589f2804d8 tempest-FlavorsAccessNegativeTestJSON-1753152423 tempest-FlavorsAccessNegativeTestJSON-1753152423-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.056040 Jan 15 20:54:40.801440 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 886/1841] 10.222.0.46 () {58 vars in 1145 bytes} [Sat Jan 15 20:54:40 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:54:40.818301 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-59b5288d-f839-4cca-93e2-49286782a404 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Action: 'update', calling method: .version_select at 0x7f30c97738b0>, body: {"security_group": {"name": "tempest-sg-hth-376035966", "description": "tempest-description-hth-2104850954"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:54:41.061613 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-95046bdf-49f1-4d03-809b-79d087a28c96 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e1b423e1a9146c8bb202ba012e2ee2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d5d92c87544c4d8080e19c1f6429bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:41.068927 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-95046bdf-49f1-4d03-809b-79d087a28c96 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] 10.222.0.46 "GET /compute/v2.1/servers/21c7200b-cace-49b4-ab7f-bf43771825ed" status: 200 len: 1521 microversion: 2.1 time: 0.425087 Jan 15 20:54:41.069704 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 956/1842] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:54:40 2022] GET /compute/v2.1/servers/21c7200b-cace-49b4-ab7f-bf43771825ed => generated 1521 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:54:41.074197 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-97ae36ce-89fc-47ed-82d0-a5fc241473ec tempest-FlavorsAccessNegativeTestJSON-1753152423 tempest-FlavorsAccessNegativeTestJSON-1753152423-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-443099828", "id": 215080117, "os-flavor-access:is_public": "False"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:54:41.076625 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:54:41.076625 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:54:41.093971 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-97ae36ce-89fc-47ed-82d0-a5fc241473ec tempest-FlavorsAccessNegativeTestJSON-1753152423 tempest-FlavorsAccessNegativeTestJSON-1753152423-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.023061 Jan 15 20:54:41.094631 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 957/1843] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 20:54:41 2022] POST /compute/v2.1/flavors => generated 435 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:54:41.110487 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-326eb76a-04b9-4525-8a5a-66ae80e76670 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:41.111534 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-326eb76a-04b9-4525-8a5a-66ae80e76670 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] [instance: b5943844-32ec-464b-b08f-7a618260f817] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:41.125884 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-326eb76a-04b9-4525-8a5a-66ae80e76670 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:41.126603 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-326eb76a-04b9-4525-8a5a-66ae80e76670 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:41.129733 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-326eb76a-04b9-4525-8a5a-66ae80e76670 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:41.131118 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-326eb76a-04b9-4525-8a5a-66ae80e76670 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:41.177321 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-59b5288d-f839-4cca-93e2-49286782a404 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] 10.222.0.46 "PUT /compute/v2.1/os-security-groups/b53f2478-3326-4b87-a151-215039fc0f80" status: 200 len: 217 microversion: 2.1 time: 0.369680 Jan 15 20:54:41.178293 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 887/1844] 10.222.0.46 () {60 vars in 1289 bytes} [Sat Jan 15 20:54:40 2022] PUT /compute/v2.1/os-security-groups/b53f2478-3326-4b87-a151-215039fc0f80 => generated 217 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:54:41.194488 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-326eb76a-04b9-4525-8a5a-66ae80e76670 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] [instance: b5943844-32ec-464b-b08f-7a618260f817] Going to try to terminate instance {{(pid=129366) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 20:54:41.309876 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-326eb76a-04b9-4525-8a5a-66ae80e76670 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] 10.222.0.46 "DELETE /compute/v2.1/servers/b5943844-32ec-464b-b08f-7a618260f817" status: 204 len: 0 microversion: 2.1 time: 0.213500 Jan 15 20:54:41.311526 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 958/1845] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 20:54:41 2022] DELETE /compute/v2.1/servers/b5943844-32ec-464b-b08f-7a618260f817 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 20:54:41.319691 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f09b94e5-7967-46bd-8db3-c3d54633c637 tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:41.320920 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f09b94e5-7967-46bd-8db3-c3d54633c637 tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] [instance: 41de38d6-3f2c-4912-adae-bef0ad0ffbb1] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:41.329819 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f09b94e5-7967-46bd-8db3-c3d54633c637 tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:41.330572 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f09b94e5-7967-46bd-8db3-c3d54633c637 tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:41.331623 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f09b94e5-7967-46bd-8db3-c3d54633c637 tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:41.332366 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f09b94e5-7967-46bd-8db3-c3d54633c637 tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:41.354353 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-f09b94e5-7967-46bd-8db3-c3d54633c637 tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] HTTP exception thrown: Instance 41de38d6-3f2c-4912-adae-bef0ad0ffbb1 could not be found. Jan 15 20:54:41.355667 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f09b94e5-7967-46bd-8db3-c3d54633c637 tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] Returning 404 to user: Instance 41de38d6-3f2c-4912-adae-bef0ad0ffbb1 could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:54:41.357435 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f09b94e5-7967-46bd-8db3-c3d54633c637 tempest-ServerDiagnosticsNegativeTest-1660075211 tempest-ServerDiagnosticsNegativeTest-1660075211-project] 10.222.0.46 "GET /compute/v2.1/servers/41de38d6-3f2c-4912-adae-bef0ad0ffbb1" status: 404 len: 111 microversion: 2.1 time: 0.044061 Jan 15 20:54:41.359882 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 959/1846] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:54:41 2022] GET /compute/v2.1/servers/41de38d6-3f2c-4912-adae-bef0ad0ffbb1 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:54:41.368529 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-5b0fe936-fe87-4b32-865f-1088aed693d8 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-941597890", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:54:41.371105 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-5b0fe936-fe87-4b32-865f-1088aed693d8 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:54:41.372578 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-5b0fe936-fe87-4b32-865f-1088aed693d8 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] 10.222.0.46 "POST /compute/v2.1/servers/21c7200b-cace-49b4-ab7f-bf43771825ed/action" status: 400 len: 938 microversion: 2.1 time: 0.010798 Jan 15 20:54:41.379854 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 960/1847] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Jan 15 20:54:41 2022] POST /compute/v2.1/servers/21c7200b-cace-49b4-ab7f-bf43771825ed/action => generated 938 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 15 20:54:41.573079 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-6c42cab8-0cb0-4bad-b023-49bb7644f7c9 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1838919738", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "networks": [{"uuid": "531bba45-51d6-4df1-9e47-d4b8172e5210"}]}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:54:41.632208 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.network.neutron [None req-6c42cab8-0cb0-4bad-b023-49bb7644f7c9 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] validate_networks() for [('531bba45-51d6-4df1-9e47-d4b8172e5210', None, None, None, None, None)] {{(pid=129365) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 20:54:41.790096 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-11eef33d-d989-4a16-9ae3-0797a8a2111a tempest-FlavorsAccessNegativeTestJSON-1980838252 tempest-FlavorsAccessNegativeTestJSON-1980838252-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "9383bceaf4c649d8880aeb8a070179b5"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:54:41.791960 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:54:41.791960 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:54:41.793546 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-11eef33d-d989-4a16-9ae3-0797a8a2111a tempest-FlavorsAccessNegativeTestJSON-1980838252 tempest-FlavorsAccessNegativeTestJSON-1980838252-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': 'f95e74a38da54e9ca16000ab6c81e8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9383bceaf4c649d8880aeb8a070179b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:41.794359 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-11eef33d-d989-4a16-9ae3-0797a8a2111a tempest-FlavorsAccessNegativeTestJSON-1980838252 tempest-FlavorsAccessNegativeTestJSON-1980838252-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:54:41.795988 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-11eef33d-d989-4a16-9ae3-0797a8a2111a tempest-FlavorsAccessNegativeTestJSON-1980838252 tempest-FlavorsAccessNegativeTestJSON-1980838252-project] 10.222.0.46 "POST /compute/v2.1/flavors/215080117/action" status: 403 len: 130 microversion: 2.1 time: 0.414350 Jan 15 20:54:41.800621 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 961/1848] 10.222.0.46 () {60 vars in 1196 bytes} [Sat Jan 15 20:54:41 2022] POST /compute/v2.1/flavors/215080117/action => generated 130 bytes in 420 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:54:41.806361 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d724418c-0d96-4a69-8e6f-c3fcc76d9c94 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Calling method '.version_select at 0x7f30c8de2670>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:41.919273 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d724418c-0d96-4a69-8e6f-c3fcc76d9c94 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] 10.222.0.46 "GET /compute/v2.1/os-security-groups/b53f2478-3326-4b87-a151-215039fc0f80" status: 200 len: 217 microversion: 2.1 time: 0.116477 Jan 15 20:54:41.920524 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 962/1849] 10.222.0.46 () {58 vars in 1268 bytes} [Sat Jan 15 20:54:41 2022] GET /compute/v2.1/os-security-groups/b53f2478-3326-4b87-a151-215039fc0f80 => generated 217 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:54:41.925044 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-44059afc-b6aa-46f4-bc15-ab8156b02b78 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:41.926216 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-44059afc-b6aa-46f4-bc15-ab8156b02b78 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] [instance: b5943844-32ec-464b-b08f-7a618260f817] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:41.933019 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-44059afc-b6aa-46f4-bc15-ab8156b02b78 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:41.933475 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-44059afc-b6aa-46f4-bc15-ab8156b02b78 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:41.934276 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-44059afc-b6aa-46f4-bc15-ab8156b02b78 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:41.934717 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-44059afc-b6aa-46f4-bc15-ab8156b02b78 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:42.123642 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-6c42cab8-0cb0-4bad-b023-49bb7644f7c9 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Flavor limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 20:54:42.125518 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-6c42cab8-0cb0-4bad-b023-49bb7644f7c9 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Image limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 20:54:42.126019 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-6c42cab8-0cb0-4bad-b023-49bb7644f7c9 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Flavor pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 20:54:42.126767 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-6c42cab8-0cb0-4bad-b023-49bb7644f7c9 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Image pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 20:54:42.127394 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-6c42cab8-0cb0-4bad-b023-49bb7644f7c9 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 20:54:42.146388 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6c42cab8-0cb0-4bad-b023-49bb7644f7c9 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:42.147267 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6c42cab8-0cb0-4bad-b023-49bb7644f7c9 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:42.148829 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6c42cab8-0cb0-4bad-b023-49bb7644f7c9 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:42.153216 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-44059afc-b6aa-46f4-bc15-ab8156b02b78 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b8081a7f0446389dd03a3182585b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e7b99384e224302b8ad9303f560cc4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:42.158052 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6c42cab8-0cb0-4bad-b023-49bb7644f7c9 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:42.162316 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-44059afc-b6aa-46f4-bc15-ab8156b02b78 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] 10.222.0.46 "GET /compute/v2.1/servers/b5943844-32ec-464b-b08f-7a618260f817" status: 200 len: 1514 microversion: 2.1 time: 0.240661 Jan 15 20:54:42.162883 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 963/1850] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:54:41 2022] GET /compute/v2.1/servers/b5943844-32ec-464b-b08f-7a618260f817 => generated 1514 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:54:42.167365 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f2b28b1c-c824-4337-aa0d-860678e6f8c7 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:42.168531 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f2b28b1c-c824-4337-aa0d-860678e6f8c7 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] [instance: 21c7200b-cace-49b4-ab7f-bf43771825ed] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:42.178412 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f2b28b1c-c824-4337-aa0d-860678e6f8c7 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:42.179428 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f2b28b1c-c824-4337-aa0d-860678e6f8c7 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:42.180231 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f2b28b1c-c824-4337-aa0d-860678e6f8c7 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:42.181071 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f2b28b1c-c824-4337-aa0d-860678e6f8c7 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:42.191815 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-6c42cab8-0cb0-4bad-b023-49bb7644f7c9 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Getting quotas for project 51cad90ef72141c2983640133453f788. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:54:42.199292 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-6c42cab8-0cb0-4bad-b023-49bb7644f7c9 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Getting quotas for user 765cbcb4d9c8476494f08b123d1db59b and project 51cad90ef72141c2983640133453f788. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:54:42.215390 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-6c42cab8-0cb0-4bad-b023-49bb7644f7c9 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Going to run 1 instances... {{(pid=129365) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 20:54:42.218482 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-6c42cab8-0cb0-4bad-b023-49bb7644f7c9 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: 427db3d9-56d4-49ff-a4f1-28302d78f56a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129365) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 20:54:42.303232 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-6c42cab8-0cb0-4bad-b023-49bb7644f7c9 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.123265 Jan 15 20:54:42.304183 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 888/1851] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 20:54:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1125 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 20:54:42.308887 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3ae97f13-cfd3-4cb6-8567-652d1d687e05 tempest-FlavorsAccessNegativeTestJSON-1753152423 tempest-FlavorsAccessNegativeTestJSON-1753152423-project-admin] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:42.310110 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:54:42.310110 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:54:42.351034 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3ae97f13-cfd3-4cb6-8567-652d1d687e05 tempest-FlavorsAccessNegativeTestJSON-1753152423 tempest-FlavorsAccessNegativeTestJSON-1753152423-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/215080117" status: 202 len: 0 microversion: 2.1 time: 0.045525 Jan 15 20:54:42.352021 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 889/1852] 10.222.0.46 () {58 vars in 1157 bytes} [Sat Jan 15 20:54:42 2022] DELETE /compute/v2.1/flavors/215080117 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 20:54:42.356977 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-0858a34b-34c4-4675-83c8-715cd4ce1885 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Calling method '.version_select at 0x7f30cebe3e50>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:42.496268 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-f2b28b1c-c824-4337-aa0d-860678e6f8c7 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e1b423e1a9146c8bb202ba012e2ee2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d5d92c87544c4d8080e19c1f6429bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:42.507404 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f2b28b1c-c824-4337-aa0d-860678e6f8c7 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] 10.222.0.46 "GET /compute/v2.1/servers/21c7200b-cace-49b4-ab7f-bf43771825ed" status: 200 len: 1521 microversion: 2.1 time: 0.343206 Jan 15 20:54:42.518802 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 964/1853] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:54:42 2022] GET /compute/v2.1/servers/21c7200b-cace-49b4-ab7f-bf43771825ed => generated 1521 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:54:42.523771 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a7b5a24c-b5d9-44b9-a902-80c7e3666347 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:42.534388 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a7b5a24c-b5d9-44b9-a902-80c7e3666347 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: 427db3d9-56d4-49ff-a4f1-28302d78f56a] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:42.643918 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-a7b5a24c-b5d9-44b9-a902-80c7e3666347 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:42.656606 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a7b5a24c-b5d9-44b9-a902-80c7e3666347 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/427db3d9-56d4-49ff-a4f1-28302d78f56a" status: 200 len: 1215 microversion: 2.1 time: 0.133915 Jan 15 20:54:42.658251 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 965/1854] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:54:42 2022] GET /compute/v2.1/servers/427db3d9-56d4-49ff-a4f1-28302d78f56a => generated 1215 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:54:42.675609 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-5f9b63e7-a744-49e6-a5bd-1eee2cbff4e4 tempest-FlavorsAccessNegativeTestJSON-1753152423 tempest-FlavorsAccessNegativeTestJSON-1753152423-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:42.722980 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-5f9b63e7-a744-49e6-a5bd-1eee2cbff4e4 tempest-FlavorsAccessNegativeTestJSON-1753152423 tempest-FlavorsAccessNegativeTestJSON-1753152423-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.061751 Jan 15 20:54:42.745918 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 966/1855] 10.222.0.46 () {58 vars in 1145 bytes} [Sat Jan 15 20:54:42 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:54:42.770520 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-25558849-c7c4-408b-b209-0ce95f5e3a55 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:42.771710 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-25558849-c7c4-408b-b209-0ce95f5e3a55 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] [instance: 21c7200b-cace-49b4-ab7f-bf43771825ed] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:42.798049 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-25558849-c7c4-408b-b209-0ce95f5e3a55 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:42.800745 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-25558849-c7c4-408b-b209-0ce95f5e3a55 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:42.801837 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-25558849-c7c4-408b-b209-0ce95f5e3a55 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:42.802410 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-25558849-c7c4-408b-b209-0ce95f5e3a55 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:42.929722 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-0858a34b-34c4-4675-83c8-715cd4ce1885 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/b53f2478-3326-4b87-a151-215039fc0f80" status: 202 len: 0 microversion: 2.1 time: 0.576462 Jan 15 20:54:42.930722 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 890/1856] 10.222.0.46 () {58 vars in 1271 bytes} [Sat Jan 15 20:54:42 2022] DELETE /compute/v2.1/os-security-groups/b53f2478-3326-4b87-a151-215039fc0f80 => generated 0 bytes in 578 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 20:54:42.939004 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-4b56603f-7944-45d5-8b58-b38a2a3e67f6 tempest-FlavorsAccessNegativeTestJSON-1753152423 tempest-FlavorsAccessNegativeTestJSON-1753152423-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-960558125", "id": 778755678, "os-flavor-access:is_public": "False"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:54:42.942035 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:54:42.942035 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:54:42.969306 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-4b56603f-7944-45d5-8b58-b38a2a3e67f6 tempest-FlavorsAccessNegativeTestJSON-1753152423 tempest-FlavorsAccessNegativeTestJSON-1753152423-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.036069 Jan 15 20:54:42.977451 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 891/1857] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 20:54:42 2022] POST /compute/v2.1/flavors => generated 435 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:54:42.988098 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-60be6b97-d60a-4111-a631-d10e1791d044 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:42.988721 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-60be6b97-d60a-4111-a631-d10e1791d044 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] [instance: f6a6025e-5439-4ba5-a8b8-20019413661b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:42.998427 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-60be6b97-d60a-4111-a631-d10e1791d044 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:42.999272 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-60be6b97-d60a-4111-a631-d10e1791d044 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:43.000452 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-60be6b97-d60a-4111-a631-d10e1791d044 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:43.001415 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-60be6b97-d60a-4111-a631-d10e1791d044 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:43.021932 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-60be6b97-d60a-4111-a631-d10e1791d044 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] HTTP exception thrown: Instance f6a6025e-5439-4ba5-a8b8-20019413661b could not be found. Jan 15 20:54:43.023440 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-60be6b97-d60a-4111-a631-d10e1791d044 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Returning 404 to user: Instance f6a6025e-5439-4ba5-a8b8-20019413661b could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:54:43.024456 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-60be6b97-d60a-4111-a631-d10e1791d044 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] 10.222.0.46 "DELETE /compute/v2.1/servers/f6a6025e-5439-4ba5-a8b8-20019413661b" status: 404 len: 111 microversion: 2.1 time: 0.045436 Jan 15 20:54:43.025991 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 892/1858] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 20:54:42 2022] DELETE /compute/v2.1/servers/f6a6025e-5439-4ba5-a8b8-20019413661b => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:54:43.032824 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f5b359b4-55c8-451c-8f7b-0dd0ae5cac64 tempest-FlavorsAccessNegativeTestJSON-1753152423 tempest-FlavorsAccessNegativeTestJSON-1753152423-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "9383bceaf4c649d8880aeb8a070179b5"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:54:43.034748 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:54:43.034748 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:54:43.165988 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-25558849-c7c4-408b-b209-0ce95f5e3a55 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e1b423e1a9146c8bb202ba012e2ee2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d5d92c87544c4d8080e19c1f6429bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:43.181872 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-25558849-c7c4-408b-b209-0ce95f5e3a55 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] 10.222.0.46 "GET /compute/v2.1/servers/21c7200b-cace-49b4-ab7f-bf43771825ed" status: 200 len: 1521 microversion: 2.1 time: 0.427367 Jan 15 20:54:43.184825 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 967/1859] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:54:42 2022] GET /compute/v2.1/servers/21c7200b-cace-49b4-ab7f-bf43771825ed => generated 1521 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:54:43.199753 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-3dc3cf71-88ce-47fe-b6ad-005a1d5bc4e8 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:43.202550 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-3dc3cf71-88ce-47fe-b6ad-005a1d5bc4e8 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] [instance: f6a6025e-5439-4ba5-a8b8-20019413661b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:43.215363 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3dc3cf71-88ce-47fe-b6ad-005a1d5bc4e8 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:43.216123 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3dc3cf71-88ce-47fe-b6ad-005a1d5bc4e8 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:43.219010 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3dc3cf71-88ce-47fe-b6ad-005a1d5bc4e8 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:43.219612 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3dc3cf71-88ce-47fe-b6ad-005a1d5bc4e8 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:43.252013 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-3dc3cf71-88ce-47fe-b6ad-005a1d5bc4e8 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] HTTP exception thrown: Instance f6a6025e-5439-4ba5-a8b8-20019413661b could not be found. Jan 15 20:54:43.254534 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-3dc3cf71-88ce-47fe-b6ad-005a1d5bc4e8 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Returning 404 to user: Instance f6a6025e-5439-4ba5-a8b8-20019413661b could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:54:43.255567 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-3dc3cf71-88ce-47fe-b6ad-005a1d5bc4e8 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] 10.222.0.46 "GET /compute/v2.1/servers/f6a6025e-5439-4ba5-a8b8-20019413661b" status: 404 len: 111 microversion: 2.1 time: 0.068666 Jan 15 20:54:43.262068 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 968/1860] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:54:43 2022] GET /compute/v2.1/servers/f6a6025e-5439-4ba5-a8b8-20019413661b => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:54:43.269225 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-443bbf38-5b3d-4225-a14a-164e0aae19d5 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:43.270257 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-443bbf38-5b3d-4225-a14a-164e0aae19d5 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] [instance: b5943844-32ec-464b-b08f-7a618260f817] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:43.278158 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-443bbf38-5b3d-4225-a14a-164e0aae19d5 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:43.279338 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-443bbf38-5b3d-4225-a14a-164e0aae19d5 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:43.281026 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-443bbf38-5b3d-4225-a14a-164e0aae19d5 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:43.282428 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-443bbf38-5b3d-4225-a14a-164e0aae19d5 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:43.391210 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f5b359b4-55c8-451c-8f7b-0dd0ae5cac64 tempest-FlavorsAccessNegativeTestJSON-1753152423 tempest-FlavorsAccessNegativeTestJSON-1753152423-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors/778755678/action" status: 200 len: 96 microversion: 2.1 time: 0.363316 Jan 15 20:54:43.396943 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 893/1861] 10.222.0.46 () {60 vars in 1196 bytes} [Sat Jan 15 20:54:43 2022] POST /compute/v2.1/flavors/778755678/action => generated 96 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 20:54:43.402125 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2459a448-c1c1-41d8-948e-dce3871b1a41 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:54:43.403322 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2459a448-c1c1-41d8-948e-dce3871b1a41 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:54:43.404276 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2459a448-c1c1-41d8-948e-dce3871b1a41 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] 10.222.0.46 "POST /compute/v2.1/servers/21c7200b-cace-49b4-ab7f-bf43771825ed/action" status: 400 len: 619 microversion: 2.1 time: 0.006130 Jan 15 20:54:43.405083 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 894/1862] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Jan 15 20:54:43 2022] POST /compute/v2.1/servers/21c7200b-cace-49b4-ab7f-bf43771825ed/action => generated 619 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 15 20:54:43.411500 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ed12063e-6001-4d3e-a630-fc2a6daf6342 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Calling method '.version_select at 0x7f30ceb79dc0>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:43.506749 ncdv-master-1 devstack@n-api.service[129365]: DEBUG neutronclient.v2_0.client [None req-ed12063e-6001-4d3e-a630-fc2a6daf6342 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 6f2925c8-4e8b-4ae9-8a62-c89aae730cbe does not exist", "detail": ""}} {{(pid=129365) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jan 15 20:54:43.507697 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.network.security_group_api [None req-ed12063e-6001-4d3e-a630-fc2a6daf6342 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Neutron security group 6f2925c8-4e8b-4ae9-8a62-c89aae730cbe not found {{(pid=129365) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jan 15 20:54:43.508704 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-ed12063e-6001-4d3e-a630-fc2a6daf6342 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] HTTP exception thrown: Security group 6f2925c8-4e8b-4ae9-8a62-c89aae730cbe does not exist Jan 15 20:54:43.508704 ncdv-master-1 devstack@n-api.service[129365]: Neutron server returns request_ids: ['req-e8c42cf4-4aa4-4160-ac56-3fed9e8b6699'] Jan 15 20:54:43.509703 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ed12063e-6001-4d3e-a630-fc2a6daf6342 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Returning 404 to user: Security group 6f2925c8-4e8b-4ae9-8a62-c89aae730cbe does not exist Jan 15 20:54:43.509703 ncdv-master-1 devstack@n-api.service[129365]: Neutron server returns request_ids: ['req-e8c42cf4-4aa4-4160-ac56-3fed9e8b6699'] {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:54:43.511519 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ed12063e-6001-4d3e-a630-fc2a6daf6342 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/6f2925c8-4e8b-4ae9-8a62-c89aae730cbe" status: 404 len: 194 microversion: 2.1 time: 0.105155 Jan 15 20:54:43.513124 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 895/1863] 10.222.0.46 () {58 vars in 1271 bytes} [Sat Jan 15 20:54:43 2022] DELETE /compute/v2.1/os-security-groups/6f2925c8-4e8b-4ae9-8a62-c89aae730cbe => generated 194 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:54:43.520952 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-49142b5c-79fc-435a-b149-c4873b1b0546 tempest-FlavorsAccessNegativeTestJSON-1980838252 tempest-FlavorsAccessNegativeTestJSON-1980838252-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "9383bceaf4c649d8880aeb8a070179b5"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:54:43.522894 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:54:43.522894 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:54:43.524365 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-49142b5c-79fc-435a-b149-c4873b1b0546 tempest-FlavorsAccessNegativeTestJSON-1980838252 tempest-FlavorsAccessNegativeTestJSON-1980838252-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': 'f95e74a38da54e9ca16000ab6c81e8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9383bceaf4c649d8880aeb8a070179b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:43.525393 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-49142b5c-79fc-435a-b149-c4873b1b0546 tempest-FlavorsAccessNegativeTestJSON-1980838252 tempest-FlavorsAccessNegativeTestJSON-1980838252-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:54:43.526654 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-49142b5c-79fc-435a-b149-c4873b1b0546 tempest-FlavorsAccessNegativeTestJSON-1980838252 tempest-FlavorsAccessNegativeTestJSON-1980838252-project] 10.222.0.46 "POST /compute/v2.1/flavors/778755678/action" status: 403 len: 133 microversion: 2.1 time: 0.011856 Jan 15 20:54:43.531977 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 896/1864] 10.222.0.46 () {60 vars in 1196 bytes} [Sat Jan 15 20:54:43 2022] POST /compute/v2.1/flavors/778755678/action => generated 133 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:54:43.538772 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-93f7a70b-18cf-4a4f-8ecb-e84254714b08 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:43.539543 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-93f7a70b-18cf-4a4f-8ecb-e84254714b08 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] [instance: 21c7200b-cace-49b4-ab7f-bf43771825ed] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:43.565624 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-93f7a70b-18cf-4a4f-8ecb-e84254714b08 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:43.566436 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-93f7a70b-18cf-4a4f-8ecb-e84254714b08 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:43.578497 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-93f7a70b-18cf-4a4f-8ecb-e84254714b08 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:43.580573 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-93f7a70b-18cf-4a4f-8ecb-e84254714b08 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:43.770699 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-443bbf38-5b3d-4225-a14a-164e0aae19d5 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b8081a7f0446389dd03a3182585b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e7b99384e224302b8ad9303f560cc4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:43.787182 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-443bbf38-5b3d-4225-a14a-164e0aae19d5 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] 10.222.0.46 "GET /compute/v2.1/servers/b5943844-32ec-464b-b08f-7a618260f817" status: 200 len: 1514 microversion: 2.1 time: 0.523685 Jan 15 20:54:43.790228 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 969/1865] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:54:43 2022] GET /compute/v2.1/servers/b5943844-32ec-464b-b08f-7a618260f817 => generated 1514 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:54:43.807522 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-63077d2a-5bc5-4620-a960-4583f36c3370 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Calling method '.version_select at 0x7f30c8da6670>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:43.900113 ncdv-master-1 devstack@n-api.service[129366]: DEBUG neutronclient.v2_0.client [None req-63077d2a-5bc5-4620-a960-4583f36c3370 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group e251adca-5ba6-4b03-828d-e26b6bdb42fb does not exist", "detail": ""}} {{(pid=129366) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jan 15 20:54:43.900983 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.network.security_group_api [None req-63077d2a-5bc5-4620-a960-4583f36c3370 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Neutron security group e251adca-5ba6-4b03-828d-e26b6bdb42fb not found {{(pid=129366) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jan 15 20:54:43.901699 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-63077d2a-5bc5-4620-a960-4583f36c3370 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] HTTP exception thrown: Security group e251adca-5ba6-4b03-828d-e26b6bdb42fb does not exist Jan 15 20:54:43.901699 ncdv-master-1 devstack@n-api.service[129366]: Neutron server returns request_ids: ['req-2629b138-8f82-4655-8a4d-2e465613efa2'] Jan 15 20:54:43.902291 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-63077d2a-5bc5-4620-a960-4583f36c3370 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Returning 404 to user: Security group e251adca-5ba6-4b03-828d-e26b6bdb42fb does not exist Jan 15 20:54:43.902291 ncdv-master-1 devstack@n-api.service[129366]: Neutron server returns request_ids: ['req-2629b138-8f82-4655-8a4d-2e465613efa2'] {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:54:43.903403 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-63077d2a-5bc5-4620-a960-4583f36c3370 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/e251adca-5ba6-4b03-828d-e26b6bdb42fb" status: 404 len: 194 microversion: 2.1 time: 0.101203 Jan 15 20:54:43.904665 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 970/1866] 10.222.0.46 () {58 vars in 1271 bytes} [Sat Jan 15 20:54:43 2022] DELETE /compute/v2.1/os-security-groups/e251adca-5ba6-4b03-828d-e26b6bdb42fb => generated 194 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:54:43.912125 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-08a49dd6-f752-4ec2-bf4d-f8bc9708ac48 tempest-FlavorsAccessNegativeTestJSON-1753152423 tempest-FlavorsAccessNegativeTestJSON-1753152423-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "9383bceaf4c649d8880aeb8a070179b5"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:54:43.914713 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:54:43.914713 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:54:43.966693 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-93f7a70b-18cf-4a4f-8ecb-e84254714b08 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e1b423e1a9146c8bb202ba012e2ee2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d5d92c87544c4d8080e19c1f6429bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:43.974615 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-93f7a70b-18cf-4a4f-8ecb-e84254714b08 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] 10.222.0.46 "GET /compute/v2.1/servers/21c7200b-cace-49b4-ab7f-bf43771825ed" status: 200 len: 1521 microversion: 2.1 time: 0.440985 Jan 15 20:54:43.975417 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 897/1867] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:54:43 2022] GET /compute/v2.1/servers/21c7200b-cace-49b4-ab7f-bf43771825ed => generated 1521 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:54:43.980881 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-1339a3a7-360d-46a5-b3c6-058823ea1b17 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:43.981806 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-1339a3a7-360d-46a5-b3c6-058823ea1b17 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: 427db3d9-56d4-49ff-a4f1-28302d78f56a] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:43.991867 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1339a3a7-360d-46a5-b3c6-058823ea1b17 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:43.992917 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1339a3a7-360d-46a5-b3c6-058823ea1b17 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:43.994205 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1339a3a7-360d-46a5-b3c6-058823ea1b17 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:43.994958 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1339a3a7-360d-46a5-b3c6-058823ea1b17 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:44.090943 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-08a49dd6-f752-4ec2-bf4d-f8bc9708ac48 tempest-FlavorsAccessNegativeTestJSON-1753152423 tempest-FlavorsAccessNegativeTestJSON-1753152423-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors/778755678/action" status: 200 len: 21 microversion: 2.1 time: 0.184760 Jan 15 20:54:44.096271 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 971/1868] 10.222.0.46 () {60 vars in 1196 bytes} [Sat Jan 15 20:54:43 2022] POST /compute/v2.1/flavors/778755678/action => generated 21 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 20:54:44.101248 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7333b2d3-d00a-4d7f-83c1-bf85f86bd7cd tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Calling method '.version_select at 0x7f30cecf7e50>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:44.103399 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-1339a3a7-360d-46a5-b3c6-058823ea1b17 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:44.112024 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-1339a3a7-360d-46a5-b3c6-058823ea1b17 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/427db3d9-56d4-49ff-a4f1-28302d78f56a" status: 200 len: 1273 microversion: 2.1 time: 0.135250 Jan 15 20:54:44.122302 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 898/1869] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:54:43 2022] GET /compute/v2.1/servers/427db3d9-56d4-49ff-a4f1-28302d78f56a => generated 1273 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:54:44.127531 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-cb89e633-ba0c-4133-9fdf-92c6656f9161 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:44.128414 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-cb89e633-ba0c-4133-9fdf-92c6656f9161 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] [instance: 21c7200b-cace-49b4-ab7f-bf43771825ed] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:44.136445 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cb89e633-ba0c-4133-9fdf-92c6656f9161 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:44.137622 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cb89e633-ba0c-4133-9fdf-92c6656f9161 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:44.139168 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cb89e633-ba0c-4133-9fdf-92c6656f9161 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:44.139797 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cb89e633-ba0c-4133-9fdf-92c6656f9161 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:44.209754 ncdv-master-1 devstack@n-api.service[129366]: DEBUG neutronclient.v2_0.client [None req-7333b2d3-d00a-4d7f-83c1-bf85f86bd7cd tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 4df05402-0f5f-41b0-bd2d-d7f0ffb5fad9 does not exist", "detail": ""}} {{(pid=129366) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jan 15 20:54:44.214861 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.network.security_group_api [None req-7333b2d3-d00a-4d7f-83c1-bf85f86bd7cd tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Neutron security group 4df05402-0f5f-41b0-bd2d-d7f0ffb5fad9 not found {{(pid=129366) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jan 15 20:54:44.217327 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-7333b2d3-d00a-4d7f-83c1-bf85f86bd7cd tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] HTTP exception thrown: Security group 4df05402-0f5f-41b0-bd2d-d7f0ffb5fad9 does not exist Jan 15 20:54:44.217327 ncdv-master-1 devstack@n-api.service[129366]: Neutron server returns request_ids: ['req-abfc7dd7-47bb-4b7c-a088-c760153bd193'] Jan 15 20:54:44.219359 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7333b2d3-d00a-4d7f-83c1-bf85f86bd7cd tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Returning 404 to user: Security group 4df05402-0f5f-41b0-bd2d-d7f0ffb5fad9 does not exist Jan 15 20:54:44.219359 ncdv-master-1 devstack@n-api.service[129366]: Neutron server returns request_ids: ['req-abfc7dd7-47bb-4b7c-a088-c760153bd193'] {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:54:44.220732 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7333b2d3-d00a-4d7f-83c1-bf85f86bd7cd tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/4df05402-0f5f-41b0-bd2d-d7f0ffb5fad9" status: 404 len: 194 microversion: 2.1 time: 0.123010 Jan 15 20:54:44.222535 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 972/1870] 10.222.0.46 () {58 vars in 1271 bytes} [Sat Jan 15 20:54:44 2022] DELETE /compute/v2.1/os-security-groups/4df05402-0f5f-41b0-bd2d-d7f0ffb5fad9 => generated 194 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:54:44.229596 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9a6743d5-0749-4103-a2d4-5c6d8eedf287 tempest-FlavorsAccessNegativeTestJSON-1753152423 tempest-FlavorsAccessNegativeTestJSON-1753152423-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:44.230657 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:54:44.230657 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:54:44.254997 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-9a6743d5-0749-4103-a2d4-5c6d8eedf287 tempest-FlavorsAccessNegativeTestJSON-1753152423 tempest-FlavorsAccessNegativeTestJSON-1753152423-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/778755678" status: 202 len: 0 microversion: 2.1 time: 0.031053 Jan 15 20:54:44.256286 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 973/1871] 10.222.0.46 () {58 vars in 1157 bytes} [Sat Jan 15 20:54:44 2022] DELETE /compute/v2.1/flavors/778755678 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 20:54:44.266063 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-2693d67f-7b82-4d7a-8afc-32e67dea0db8 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Calling method '.version_select at 0x7f30c8e3cca0>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:44.366446 ncdv-master-1 devstack@n-api.service[129366]: DEBUG neutronclient.v2_0.client [None req-2693d67f-7b82-4d7a-8afc-32e67dea0db8 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 017593ab-28f4-40d5-bb6a-7223ece3d24e does not exist", "detail": ""}} {{(pid=129366) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jan 15 20:54:44.367932 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.network.security_group_api [None req-2693d67f-7b82-4d7a-8afc-32e67dea0db8 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Neutron security group 017593ab-28f4-40d5-bb6a-7223ece3d24e not found {{(pid=129366) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jan 15 20:54:44.368629 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-2693d67f-7b82-4d7a-8afc-32e67dea0db8 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] HTTP exception thrown: Security group 017593ab-28f4-40d5-bb6a-7223ece3d24e does not exist Jan 15 20:54:44.368629 ncdv-master-1 devstack@n-api.service[129366]: Neutron server returns request_ids: ['req-f2ea43cb-db15-4b74-9019-83f0996ddcc7'] Jan 15 20:54:44.369247 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-2693d67f-7b82-4d7a-8afc-32e67dea0db8 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Returning 404 to user: Security group 017593ab-28f4-40d5-bb6a-7223ece3d24e does not exist Jan 15 20:54:44.369247 ncdv-master-1 devstack@n-api.service[129366]: Neutron server returns request_ids: ['req-f2ea43cb-db15-4b74-9019-83f0996ddcc7'] {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:54:44.370159 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-2693d67f-7b82-4d7a-8afc-32e67dea0db8 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/017593ab-28f4-40d5-bb6a-7223ece3d24e" status: 404 len: 194 microversion: 2.1 time: 0.111316 Jan 15 20:54:44.370775 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 974/1872] 10.222.0.46 () {58 vars in 1271 bytes} [Sat Jan 15 20:54:44 2022] DELETE /compute/v2.1/os-security-groups/017593ab-28f4-40d5-bb6a-7223ece3d24e => generated 194 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:54:44.379892 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d0ea1ced-d176-4a05-b7d2-c0f4b0a40a12 tempest-FlavorsAccessNegativeTestJSON-1753152423 tempest-FlavorsAccessNegativeTestJSON-1753152423-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:44.432585 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d0ea1ced-d176-4a05-b7d2-c0f4b0a40a12 tempest-FlavorsAccessNegativeTestJSON-1753152423 tempest-FlavorsAccessNegativeTestJSON-1753152423-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.060482 Jan 15 20:54:44.439824 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 975/1873] 10.222.0.46 () {58 vars in 1145 bytes} [Sat Jan 15 20:54:44 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:54:44.447424 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-9ce3578d-b5f3-4874-9e0c-ba05c1e399a3 req-2d90bf60-719f-4cde-a8ec-8bba31405ea5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5943844-32ec-464b-b08f-7a618260f817", "name": "network-vif-deleted", "tag": "7372087d-b55f-45da-b646-85a04a10f042"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:54:44.451374 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:54:44.451374 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:54:44.469080 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-9ce3578d-b5f3-4874-9e0c-ba05c1e399a3 req-2d90bf60-719f-4cde-a8ec-8bba31405ea5 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:44.472170 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-9ce3578d-b5f3-4874-9e0c-ba05c1e399a3 req-2d90bf60-719f-4cde-a8ec-8bba31405ea5 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:44.494812 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-9ce3578d-b5f3-4874-9e0c-ba05c1e399a3 req-2d90bf60-719f-4cde-a8ec-8bba31405ea5 service nova] Creating event network-vif-deleted:7372087d-b55f-45da-b646-85a04a10f042 for instance b5943844-32ec-464b-b08f-7a618260f817 on nch1-master-1 Jan 15 20:54:44.502578 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-9ce3578d-b5f3-4874-9e0c-ba05c1e399a3 req-2d90bf60-719f-4cde-a8ec-8bba31405ea5 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061227 Jan 15 20:54:44.503711 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 976/1874] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:54:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:54:44.510028 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-75a65a67-686c-4962-bfdd-251f82e30e87 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Calling method '.version_select at 0x7f30c9215a60>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:44.596730 ncdv-master-1 devstack@n-api.service[129366]: DEBUG neutronclient.v2_0.client [None req-75a65a67-686c-4962-bfdd-251f82e30e87 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 48e93c44-f35b-4e83-9ae2-5afca960383f does not exist", "detail": ""}} {{(pid=129366) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jan 15 20:54:44.597961 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.network.security_group_api [None req-75a65a67-686c-4962-bfdd-251f82e30e87 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Neutron security group 48e93c44-f35b-4e83-9ae2-5afca960383f not found {{(pid=129366) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jan 15 20:54:44.598490 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-75a65a67-686c-4962-bfdd-251f82e30e87 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] HTTP exception thrown: Security group 48e93c44-f35b-4e83-9ae2-5afca960383f does not exist Jan 15 20:54:44.598490 ncdv-master-1 devstack@n-api.service[129366]: Neutron server returns request_ids: ['req-8fdbfa37-5d97-4c70-b437-a24d4461d1bc'] Jan 15 20:54:44.599074 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-75a65a67-686c-4962-bfdd-251f82e30e87 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Returning 404 to user: Security group 48e93c44-f35b-4e83-9ae2-5afca960383f does not exist Jan 15 20:54:44.599074 ncdv-master-1 devstack@n-api.service[129366]: Neutron server returns request_ids: ['req-8fdbfa37-5d97-4c70-b437-a24d4461d1bc'] {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:54:44.599903 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-75a65a67-686c-4962-bfdd-251f82e30e87 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/48e93c44-f35b-4e83-9ae2-5afca960383f" status: 404 len: 194 microversion: 2.1 time: 0.094993 Jan 15 20:54:44.600474 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 977/1875] 10.222.0.46 () {58 vars in 1271 bytes} [Sat Jan 15 20:54:44 2022] DELETE /compute/v2.1/os-security-groups/48e93c44-f35b-4e83-9ae2-5afca960383f => generated 194 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:54:44.605245 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1e837603-72b9-4a83-9fad-2ea67144ea8d tempest-FlavorsAccessNegativeTestJSON-1753152423 tempest-FlavorsAccessNegativeTestJSON-1753152423-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1197801202", "id": 779832349, "os-flavor-access:is_public": "False"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:54:44.607631 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:54:44.607631 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:54:44.628274 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-1e837603-72b9-4a83-9fad-2ea67144ea8d tempest-FlavorsAccessNegativeTestJSON-1753152423 tempest-FlavorsAccessNegativeTestJSON-1753152423-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.026531 Jan 15 20:54:44.629564 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 978/1876] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 20:54:44 2022] POST /compute/v2.1/flavors => generated 436 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:54:44.641932 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b8847fe9-a4b8-4145-b569-4e59907f9a07 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Calling method '.version_select at 0x7f30c8edbaf0>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:44.676192 ncdv-master-1 devstack@n-api.service[129366]: DEBUG neutronclient.v2_0.client [None req-b8847fe9-a4b8-4145-b569-4e59907f9a07 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group e0f75dca-2a13-47e2-b483-39719ff6eae9 does not exist", "detail": ""}} {{(pid=129366) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jan 15 20:54:44.676787 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.network.security_group_api [None req-b8847fe9-a4b8-4145-b569-4e59907f9a07 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Neutron security group e0f75dca-2a13-47e2-b483-39719ff6eae9 not found {{(pid=129366) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jan 15 20:54:44.677364 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-b8847fe9-a4b8-4145-b569-4e59907f9a07 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] HTTP exception thrown: Security group e0f75dca-2a13-47e2-b483-39719ff6eae9 does not exist Jan 15 20:54:44.677364 ncdv-master-1 devstack@n-api.service[129366]: Neutron server returns request_ids: ['req-9e2254a4-f35e-49da-aa4b-0691a276cb25'] Jan 15 20:54:44.677943 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b8847fe9-a4b8-4145-b569-4e59907f9a07 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Returning 404 to user: Security group e0f75dca-2a13-47e2-b483-39719ff6eae9 does not exist Jan 15 20:54:44.677943 ncdv-master-1 devstack@n-api.service[129366]: Neutron server returns request_ids: ['req-9e2254a4-f35e-49da-aa4b-0691a276cb25'] {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:54:44.678767 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b8847fe9-a4b8-4145-b569-4e59907f9a07 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/e0f75dca-2a13-47e2-b483-39719ff6eae9" status: 404 len: 194 microversion: 2.1 time: 0.048100 Jan 15 20:54:44.679336 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 979/1877] 10.222.0.46 () {58 vars in 1271 bytes} [Sat Jan 15 20:54:44 2022] DELETE /compute/v2.1/os-security-groups/e0f75dca-2a13-47e2-b483-39719ff6eae9 => generated 194 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:54:44.683453 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-cb89e633-ba0c-4133-9fdf-92c6656f9161 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e1b423e1a9146c8bb202ba012e2ee2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d5d92c87544c4d8080e19c1f6429bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:44.684189 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c8ae57b9-4166-4934-94c5-b018e15ce580 tempest-FlavorsAccessNegativeTestJSON-1753152423 tempest-FlavorsAccessNegativeTestJSON-1753152423-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "48f15ee191c541c7a5f2a656dc52ec97"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:54:44.686167 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:54:44.686167 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:54:44.692437 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-cb89e633-ba0c-4133-9fdf-92c6656f9161 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] 10.222.0.46 "GET /compute/v2.1/servers/21c7200b-cace-49b4-ab7f-bf43771825ed" status: 200 len: 1521 microversion: 2.1 time: 0.568552 Jan 15 20:54:44.699485 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 899/1878] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:54:44 2022] GET /compute/v2.1/servers/21c7200b-cace-49b4-ab7f-bf43771825ed => generated 1521 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:54:44.723030 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d3215730-1f5c-4f3e-9e3e-b7d91c6193a2 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:44.723866 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d3215730-1f5c-4f3e-9e3e-b7d91c6193a2 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] [instance: 3fd1fac4-6c41-4230-9eb5-4fd5a4d82c15] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:44.732055 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d3215730-1f5c-4f3e-9e3e-b7d91c6193a2 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:44.733375 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d3215730-1f5c-4f3e-9e3e-b7d91c6193a2 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:44.750661 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d3215730-1f5c-4f3e-9e3e-b7d91c6193a2 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:44.751317 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d3215730-1f5c-4f3e-9e3e-b7d91c6193a2 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:44.796479 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d3215730-1f5c-4f3e-9e3e-b7d91c6193a2 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] [instance: 3fd1fac4-6c41-4230-9eb5-4fd5a4d82c15] Going to try to terminate instance {{(pid=129365) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 20:54:44.858434 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-c8ae57b9-4166-4934-94c5-b018e15ce580 tempest-FlavorsAccessNegativeTestJSON-1753152423 tempest-FlavorsAccessNegativeTestJSON-1753152423-project-admin] HTTP exception thrown: Flavor access not found for 39 / 48f15ee191c541c7a5f2a656dc52ec97 combination. Jan 15 20:54:44.860312 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c8ae57b9-4166-4934-94c5-b018e15ce580 tempest-FlavorsAccessNegativeTestJSON-1753152423 tempest-FlavorsAccessNegativeTestJSON-1753152423-project-admin] Returning 404 to user: Flavor access not found for 39 / 48f15ee191c541c7a5f2a656dc52ec97 combination. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:54:44.861390 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c8ae57b9-4166-4934-94c5-b018e15ce580 tempest-FlavorsAccessNegativeTestJSON-1753152423 tempest-FlavorsAccessNegativeTestJSON-1753152423-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors/779832349/action" status: 404 len: 124 microversion: 2.1 time: 0.181146 Jan 15 20:54:44.862948 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 980/1879] 10.222.0.46 () {60 vars in 1196 bytes} [Sat Jan 15 20:54:44 2022] POST /compute/v2.1/flavors/779832349/action => generated 124 bytes in 183 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:54:44.870188 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a6ae77e8-f164-4ad0-986a-012196179058 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-619020407"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:54:44.878437 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a6ae77e8-f164-4ad0-986a-012196179058 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] [instance: 21c7200b-cace-49b4-ab7f-bf43771825ed] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:44.893484 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a6ae77e8-f164-4ad0-986a-012196179058 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:44.894916 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a6ae77e8-f164-4ad0-986a-012196179058 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:44.896118 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a6ae77e8-f164-4ad0-986a-012196179058 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:44.897572 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a6ae77e8-f164-4ad0-986a-012196179058 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:45.028748 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d3215730-1f5c-4f3e-9e3e-b7d91c6193a2 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] 10.222.0.46 "DELETE /compute/v2.1/servers/3fd1fac4-6c41-4230-9eb5-4fd5a4d82c15" status: 204 len: 0 microversion: 2.1 time: 0.312752 Jan 15 20:54:45.032438 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 900/1880] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 20:54:44 2022] DELETE /compute/v2.1/servers/3fd1fac4-6c41-4230-9eb5-4fd5a4d82c15 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 20:54:45.046703 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b21e3e0a-c28c-45d3-b3ca-f0a8b17c30bc tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:45.050110 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b21e3e0a-c28c-45d3-b3ca-f0a8b17c30bc tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] [instance: b5943844-32ec-464b-b08f-7a618260f817] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:45.062960 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b21e3e0a-c28c-45d3-b3ca-f0a8b17c30bc tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:45.066943 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b21e3e0a-c28c-45d3-b3ca-f0a8b17c30bc tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:45.067971 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b21e3e0a-c28c-45d3-b3ca-f0a8b17c30bc tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:45.068724 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b21e3e0a-c28c-45d3-b3ca-f0a8b17c30bc tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:45.104366 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-b21e3e0a-c28c-45d3-b3ca-f0a8b17c30bc tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] HTTP exception thrown: Instance b5943844-32ec-464b-b08f-7a618260f817 could not be found. Jan 15 20:54:45.105001 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b21e3e0a-c28c-45d3-b3ca-f0a8b17c30bc tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Returning 404 to user: Instance b5943844-32ec-464b-b08f-7a618260f817 could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:54:45.106019 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b21e3e0a-c28c-45d3-b3ca-f0a8b17c30bc tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] 10.222.0.46 "GET /compute/v2.1/servers/b5943844-32ec-464b-b08f-7a618260f817" status: 404 len: 111 microversion: 2.1 time: 0.072035 Jan 15 20:54:45.109135 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 901/1881] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:54:45 2022] GET /compute/v2.1/servers/b5943844-32ec-464b-b08f-7a618260f817 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:54:45.119871 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-bf745cdb-ccca-4917-8c23-c1ab35acfd49 tempest-FlavorsAccessNegativeTestJSON-1753152423 tempest-FlavorsAccessNegativeTestJSON-1753152423-project-admin] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:45.120967 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:54:45.120967 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:54:45.163444 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-bf745cdb-ccca-4917-8c23-c1ab35acfd49 tempest-FlavorsAccessNegativeTestJSON-1753152423 tempest-FlavorsAccessNegativeTestJSON-1753152423-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/779832349" status: 202 len: 0 microversion: 2.1 time: 0.051903 Jan 15 20:54:45.167792 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 902/1882] 10.222.0.46 () {58 vars in 1157 bytes} [Sat Jan 15 20:54:45 2022] DELETE /compute/v2.1/flavors/779832349 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 20:54:45.172909 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c03a50c8-6ca2-4b13-bf6f-51f4b95f4ca8 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:45.177932 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c03a50c8-6ca2-4b13-bf6f-51f4b95f4ca8 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] [instance: 3fd1fac4-6c41-4230-9eb5-4fd5a4d82c15] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:45.194555 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c03a50c8-6ca2-4b13-bf6f-51f4b95f4ca8 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:45.195021 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c03a50c8-6ca2-4b13-bf6f-51f4b95f4ca8 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:45.195830 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c03a50c8-6ca2-4b13-bf6f-51f4b95f4ca8 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:45.198296 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c03a50c8-6ca2-4b13-bf6f-51f4b95f4ca8 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:45.368482 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a6ae77e8-f164-4ad0-986a-012196179058 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] 10.222.0.46 "POST /compute/v2.1/servers/21c7200b-cace-49b4-ab7f-bf43771825ed/action" status: 202 len: 0 microversion: 2.1 time: 0.503707 Jan 15 20:54:45.387572 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 981/1883] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:54:44 2022] POST /compute/v2.1/servers/21c7200b-cace-49b4-ab7f-bf43771825ed/action => generated 0 bytes in 524 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jan 15 20:54:45.396238 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f2f297c4-7435-4c7c-bf1d-d5177dd74ec6 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:45.401250 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f2f297c4-7435-4c7c-bf1d-d5177dd74ec6 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: 427db3d9-56d4-49ff-a4f1-28302d78f56a] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:45.414850 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f2f297c4-7435-4c7c-bf1d-d5177dd74ec6 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:45.415738 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f2f297c4-7435-4c7c-bf1d-d5177dd74ec6 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:45.416808 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f2f297c4-7435-4c7c-bf1d-d5177dd74ec6 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:45.418889 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f2f297c4-7435-4c7c-bf1d-d5177dd74ec6 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:45.897260 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-f2f297c4-7435-4c7c-bf1d-d5177dd74ec6 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:45.941373 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f2f297c4-7435-4c7c-bf1d-d5177dd74ec6 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/427db3d9-56d4-49ff-a4f1-28302d78f56a" status: 200 len: 1273 microversion: 2.1 time: 0.544394 Jan 15 20:54:45.942717 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 982/1884] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:54:45 2022] GET /compute/v2.1/servers/427db3d9-56d4-49ff-a4f1-28302d78f56a => generated 1273 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:54:45.993501 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-964b892f-aea7-41cf-9399-425dc743f407 tempest-FlavorsAccessNegativeTestJSON-1753152423 tempest-FlavorsAccessNegativeTestJSON-1753152423-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:46.069460 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-964b892f-aea7-41cf-9399-425dc743f407 tempest-FlavorsAccessNegativeTestJSON-1753152423 tempest-FlavorsAccessNegativeTestJSON-1753152423-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.095023 Jan 15 20:54:46.070593 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 983/1885] 10.222.0.46 () {58 vars in 1145 bytes} [Sat Jan 15 20:54:45 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:54:46.109541 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-137dd82d-cc42-4033-ab89-3a20f933414e tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-476916682"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:54:46.115368 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-137dd82d-cc42-4033-ab89-3a20f933414e tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] [instance: 21c7200b-cace-49b4-ab7f-bf43771825ed] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:46.128592 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-137dd82d-cc42-4033-ab89-3a20f933414e tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:46.129197 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-137dd82d-cc42-4033-ab89-3a20f933414e tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:46.130440 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-137dd82d-cc42-4033-ab89-3a20f933414e tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:46.131404 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-137dd82d-cc42-4033-ab89-3a20f933414e tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:46.288153 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-137dd82d-cc42-4033-ab89-3a20f933414e tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] HTTP exception thrown: Cannot 'createImage' instance 21c7200b-cace-49b4-ab7f-bf43771825ed while it is in task_state image_snapshot Jan 15 20:54:46.296579 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-137dd82d-cc42-4033-ab89-3a20f933414e tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Returning 409 to user: Cannot 'createImage' instance 21c7200b-cace-49b4-ab7f-bf43771825ed while it is in task_state image_snapshot {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:54:46.297550 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-137dd82d-cc42-4033-ab89-3a20f933414e tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] 10.222.0.46 "POST /compute/v2.1/servers/21c7200b-cace-49b4-ab7f-bf43771825ed/action" status: 409 len: 159 microversion: 2.1 time: 0.199255 Jan 15 20:54:46.298233 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 984/1886] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:54:46 2022] POST /compute/v2.1/servers/21c7200b-cace-49b4-ab7f-bf43771825ed/action => generated 159 bytes in 207 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jan 15 20:54:46.313143 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-c03a50c8-6ca2-4b13-bf6f-51f4b95f4ca8 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17e2708b6fc41b1ae6f70bcf99a0170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515bef049574d4ea4c70f90ab8c4444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:46.320497 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b340f2f1-9e71-48e4-ae30-ba5f46e48fbb tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Calling method '.version_select at 0x7f30c8e35ca0>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:46.327145 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c03a50c8-6ca2-4b13-bf6f-51f4b95f4ca8 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] 10.222.0.46 "GET /compute/v2.1/servers/3fd1fac4-6c41-4230-9eb5-4fd5a4d82c15" status: 200 len: 1649 microversion: 2.1 time: 1.157149 Jan 15 20:54:46.329511 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 903/1887] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:54:45 2022] GET /compute/v2.1/servers/3fd1fac4-6c41-4230-9eb5-4fd5a4d82c15 => generated 1649 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:54:46.601735 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b340f2f1-9e71-48e4-ae30-ba5f46e48fbb tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] 10.222.0.46 "DELETE /compute/v2.1/images/8a2359e9-3440-4830-8682-0edb8897140a" status: 204 len: 0 microversion: 2.1 time: 0.298799 Jan 15 20:54:46.602286 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 985/1888] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:54:46 2022] DELETE /compute/v2.1/images/8a2359e9-3440-4830-8682-0edb8897140a => generated 0 bytes in 300 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 20:54:46.617934 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-403b2722-477f-456f-b3d5-5909230e8a38 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:46.619125 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-403b2722-477f-456f-b3d5-5909230e8a38 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] [instance: 21c7200b-cace-49b4-ab7f-bf43771825ed] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:46.633115 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-403b2722-477f-456f-b3d5-5909230e8a38 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:46.634146 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-403b2722-477f-456f-b3d5-5909230e8a38 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:46.635886 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-403b2722-477f-456f-b3d5-5909230e8a38 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:46.636751 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-403b2722-477f-456f-b3d5-5909230e8a38 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:46.959219 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b8e9f5bf-2158-40ae-a286-fa0728eb6360 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:46.960515 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b8e9f5bf-2158-40ae-a286-fa0728eb6360 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: 427db3d9-56d4-49ff-a4f1-28302d78f56a] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:46.990863 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b8e9f5bf-2158-40ae-a286-fa0728eb6360 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:46.992206 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b8e9f5bf-2158-40ae-a286-fa0728eb6360 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:46.995456 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b8e9f5bf-2158-40ae-a286-fa0728eb6360 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:46.996184 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b8e9f5bf-2158-40ae-a286-fa0728eb6360 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:47.585152 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-403b2722-477f-456f-b3d5-5909230e8a38 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e1b423e1a9146c8bb202ba012e2ee2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d5d92c87544c4d8080e19c1f6429bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:47.595585 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-403b2722-477f-456f-b3d5-5909230e8a38 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] 10.222.0.46 "GET /compute/v2.1/servers/21c7200b-cace-49b4-ab7f-bf43771825ed" status: 200 len: 1533 microversion: 2.1 time: 0.987796 Jan 15 20:54:47.595585 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 904/1889] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:54:46 2022] GET /compute/v2.1/servers/21c7200b-cace-49b4-ab7f-bf43771825ed => generated 1533 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:54:47.603683 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-6062b207-352f-4f52-82ed-d19150b1b06a tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:47.604303 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-6062b207-352f-4f52-82ed-d19150b1b06a tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] [instance: 3fd1fac4-6c41-4230-9eb5-4fd5a4d82c15] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:47.623359 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6062b207-352f-4f52-82ed-d19150b1b06a tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:47.624648 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6062b207-352f-4f52-82ed-d19150b1b06a tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:47.630013 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6062b207-352f-4f52-82ed-d19150b1b06a tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:47.632731 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6062b207-352f-4f52-82ed-d19150b1b06a tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:48.136992 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-b8e9f5bf-2158-40ae-a286-fa0728eb6360 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:48.146281 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b8e9f5bf-2158-40ae-a286-fa0728eb6360 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/427db3d9-56d4-49ff-a4f1-28302d78f56a" status: 200 len: 1315 microversion: 2.1 time: 1.190917 Jan 15 20:54:48.148215 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 986/1890] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:54:46 2022] GET /compute/v2.1/servers/427db3d9-56d4-49ff-a4f1-28302d78f56a => generated 1315 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:54:48.410675 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d0765fc8-433f-4421-a5e1-a2ebce79aa39 tempest-ServicesAdminNegativeV253TestJSON-1406685001 tempest-ServicesAdminNegativeV253TestJSON-1406685001-project-admin] Action: 'update', calling method: .version_select at 0x7f30c8df2dc0>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:54:48.412476 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:54:48.412476 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:54:48.414281 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d0765fc8-433f-4421-a5e1-a2ebce79aa39 tempest-ServicesAdminNegativeV253TestJSON-1406685001 tempest-ServicesAdminNegativeV253TestJSON-1406685001-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:48.414958 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d0765fc8-433f-4421-a5e1-a2ebce79aa39 tempest-ServicesAdminNegativeV253TestJSON-1406685001 tempest-ServicesAdminNegativeV253TestJSON-1406685001-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:48.442019 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d0765fc8-433f-4421-a5e1-a2ebce79aa39 tempest-ServicesAdminNegativeV253TestJSON-1406685001 tempest-ServicesAdminNegativeV253TestJSON-1406685001-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:48.445628 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d0765fc8-433f-4421-a5e1-a2ebce79aa39 tempest-ServicesAdminNegativeV253TestJSON-1406685001 tempest-ServicesAdminNegativeV253TestJSON-1406685001-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:48.461945 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-d0765fc8-433f-4421-a5e1-a2ebce79aa39 tempest-ServicesAdminNegativeV253TestJSON-1406685001 tempest-ServicesAdminNegativeV253TestJSON-1406685001-project-admin] HTTP exception thrown: Service ef0ce000-5668-47a4-b3cf-9ce252d88b25 could not be found. Jan 15 20:54:48.462895 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d0765fc8-433f-4421-a5e1-a2ebce79aa39 tempest-ServicesAdminNegativeV253TestJSON-1406685001 tempest-ServicesAdminNegativeV253TestJSON-1406685001-project-admin] Returning 404 to user: Service ef0ce000-5668-47a4-b3cf-9ce252d88b25 could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:54:48.463975 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d0765fc8-433f-4421-a5e1-a2ebce79aa39 tempest-ServicesAdminNegativeV253TestJSON-1406685001 tempest-ServicesAdminNegativeV253TestJSON-1406685001-project-admin] 10.222.0.46 "PUT /compute/v2.1/os-services/ef0ce000-5668-47a4-b3cf-9ce252d88b25" status: 404 len: 110 microversion: 2.53 time: 0.314549 Jan 15 20:54:48.469550 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 987/1891] 10.222.0.46 () {62 vars in 1308 bytes} [Sat Jan 15 20:54:48 2022] PUT /compute/v2.1/os-services/ef0ce000-5668-47a4-b3cf-9ce252d88b25 => generated 110 bytes in 320 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 15 20:54:48.477353 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-fcf096b7-1728-4e49-afd9-c789a37a9881 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:48.478936 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-fcf096b7-1728-4e49-afd9-c789a37a9881 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] [instance: b5943844-32ec-464b-b08f-7a618260f817] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:48.487258 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fcf096b7-1728-4e49-afd9-c789a37a9881 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:48.487995 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fcf096b7-1728-4e49-afd9-c789a37a9881 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:48.489567 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fcf096b7-1728-4e49-afd9-c789a37a9881 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:48.490279 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fcf096b7-1728-4e49-afd9-c789a37a9881 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:48.510817 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-fcf096b7-1728-4e49-afd9-c789a37a9881 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] HTTP exception thrown: Instance b5943844-32ec-464b-b08f-7a618260f817 could not be found. Jan 15 20:54:48.511971 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-fcf096b7-1728-4e49-afd9-c789a37a9881 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Returning 404 to user: Instance b5943844-32ec-464b-b08f-7a618260f817 could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:54:48.513221 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-fcf096b7-1728-4e49-afd9-c789a37a9881 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] 10.222.0.46 "DELETE /compute/v2.1/servers/b5943844-32ec-464b-b08f-7a618260f817" status: 404 len: 111 microversion: 2.1 time: 0.042262 Jan 15 20:54:48.515461 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 988/1892] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 20:54:48 2022] DELETE /compute/v2.1/servers/b5943844-32ec-464b-b08f-7a618260f817 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:54:48.534997 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0fede51e-99da-4053-8705-426cc80b6b08 tempest-ServicesAdminNegativeV253TestJSON-1406685001 tempest-ServicesAdminNegativeV253TestJSON-1406685001-project-admin] Action: 'update', calling method: .version_select at 0x7f30c8e11940>, body: {"status": "disabled"} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:54:48.536883 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-6062b207-352f-4f52-82ed-d19150b1b06a tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17e2708b6fc41b1ae6f70bcf99a0170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515bef049574d4ea4c70f90ab8c4444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:48.537854 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:54:48.537854 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:54:48.540859 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0fede51e-99da-4053-8705-426cc80b6b08 tempest-ServicesAdminNegativeV253TestJSON-1406685001 tempest-ServicesAdminNegativeV253TestJSON-1406685001-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:48.542119 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0fede51e-99da-4053-8705-426cc80b6b08 tempest-ServicesAdminNegativeV253TestJSON-1406685001 tempest-ServicesAdminNegativeV253TestJSON-1406685001-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:48.550624 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0fede51e-99da-4053-8705-426cc80b6b08 tempest-ServicesAdminNegativeV253TestJSON-1406685001 tempest-ServicesAdminNegativeV253TestJSON-1406685001-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:48.550876 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-6062b207-352f-4f52-82ed-d19150b1b06a tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] 10.222.0.46 "GET /compute/v2.1/servers/3fd1fac4-6c41-4230-9eb5-4fd5a4d82c15" status: 200 len: 1649 microversion: 2.1 time: 0.953641 Jan 15 20:54:48.551545 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 905/1893] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:54:47 2022] GET /compute/v2.1/servers/3fd1fac4-6c41-4230-9eb5-4fd5a4d82c15 => generated 1649 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:54:48.552612 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0fede51e-99da-4053-8705-426cc80b6b08 tempest-ServicesAdminNegativeV253TestJSON-1406685001 tempest-ServicesAdminNegativeV253TestJSON-1406685001-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:48.558753 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-0fede51e-99da-4053-8705-426cc80b6b08 tempest-ServicesAdminNegativeV253TestJSON-1406685001 tempest-ServicesAdminNegativeV253TestJSON-1406685001-project-admin] HTTP exception thrown: Service ef0ce000-5668-47a4-b3cf-9ce252d88b25 could not be found. Jan 15 20:54:48.569256 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-636e7f9a-a556-4861-a149-c81e56cee1f2 req-c044dac6-4d89-4745-a1a9-3d3e4ba28791 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "427db3d9-56d4-49ff-a4f1-28302d78f56a", "tag": "07cc6e79-5c17-40cf-b596-8367f1d2319e"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:54:48.571122 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0fede51e-99da-4053-8705-426cc80b6b08 tempest-ServicesAdminNegativeV253TestJSON-1406685001 tempest-ServicesAdminNegativeV253TestJSON-1406685001-project-admin] Returning 404 to user: Service ef0ce000-5668-47a4-b3cf-9ce252d88b25 could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:54:48.572986 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:54:48.572986 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:54:48.582324 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0fede51e-99da-4053-8705-426cc80b6b08 tempest-ServicesAdminNegativeV253TestJSON-1406685001 tempest-ServicesAdminNegativeV253TestJSON-1406685001-project-admin] 10.222.0.46 "PUT /compute/v2.1/os-services/ef0ce000-5668-47a4-b3cf-9ce252d88b25" status: 404 len: 110 microversion: 2.53 time: 0.054671 Jan 15 20:54:48.585072 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 989/1894] 10.222.0.46 () {62 vars in 1308 bytes} [Sat Jan 15 20:54:48 2022] PUT /compute/v2.1/os-services/ef0ce000-5668-47a4-b3cf-9ce252d88b25 => generated 110 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 15 20:54:48.603894 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-bdb817f5-9e35-4dca-9770-fa7e4ff3dbb1 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:48.604518 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-bdb817f5-9e35-4dca-9770-fa7e4ff3dbb1 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] [instance: b5943844-32ec-464b-b08f-7a618260f817] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:48.610171 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-636e7f9a-a556-4861-a149-c81e56cee1f2 req-c044dac6-4d89-4745-a1a9-3d3e4ba28791 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:48.613011 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-636e7f9a-a556-4861-a149-c81e56cee1f2 req-c044dac6-4d89-4745-a1a9-3d3e4ba28791 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:48.631512 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bdb817f5-9e35-4dca-9770-fa7e4ff3dbb1 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:48.649454 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bdb817f5-9e35-4dca-9770-fa7e4ff3dbb1 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:48.650587 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bdb817f5-9e35-4dca-9770-fa7e4ff3dbb1 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:48.653695 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bdb817f5-9e35-4dca-9770-fa7e4ff3dbb1 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:48.668044 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-636e7f9a-a556-4861-a149-c81e56cee1f2 req-c044dac6-4d89-4745-a1a9-3d3e4ba28791 service nova] Creating event network-changed:07cc6e79-5c17-40cf-b596-8367f1d2319e for instance 427db3d9-56d4-49ff-a4f1-28302d78f56a on nch2-master-1 Jan 15 20:54:48.693413 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-636e7f9a-a556-4861-a149-c81e56cee1f2 req-c044dac6-4d89-4745-a1a9-3d3e4ba28791 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139986 Jan 15 20:54:48.695011 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 906/1895] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:54:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:54:48.696982 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-bdb817f5-9e35-4dca-9770-fa7e4ff3dbb1 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] HTTP exception thrown: Instance b5943844-32ec-464b-b08f-7a618260f817 could not be found. Jan 15 20:54:48.705874 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-bdb817f5-9e35-4dca-9770-fa7e4ff3dbb1 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] Returning 404 to user: Instance b5943844-32ec-464b-b08f-7a618260f817 could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:54:48.707083 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-bdb817f5-9e35-4dca-9770-fa7e4ff3dbb1 tempest-AttachSCSIVolumeTestJSON-1803548154 tempest-AttachSCSIVolumeTestJSON-1803548154-project] 10.222.0.46 "GET /compute/v2.1/servers/b5943844-32ec-464b-b08f-7a618260f817" status: 404 len: 111 microversion: 2.1 time: 0.120688 Jan 15 20:54:48.708543 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 990/1896] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:54:48 2022] GET /compute/v2.1/servers/b5943844-32ec-464b-b08f-7a618260f817 => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:54:48.722374 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b2df00db-d790-4117-aef0-065d32ecad3d tempest-ServicesAdminNegativeV253TestJSON-1406685001 tempest-ServicesAdminNegativeV253TestJSON-1406685001-project-admin] Action: 'update', calling method: .version_select at 0x7f30c8f3edc0>, body: {"status": "enabled"} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:54:48.725132 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-1baac71a-c52f-4865-9aaf-2d44097f4766 req-b970e752-fe45-45c9-87f9-c0143aba71e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fd1fac4-6c41-4230-9eb5-4fd5a4d82c15", "name": "network-vif-deleted", "tag": "f6190630-2b92-456a-a85f-b69eb4ffcb81"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:54:48.728596 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:54:48.728596 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:54:48.738078 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:54:48.738078 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:54:48.741732 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b2df00db-d790-4117-aef0-065d32ecad3d tempest-ServicesAdminNegativeV253TestJSON-1406685001 tempest-ServicesAdminNegativeV253TestJSON-1406685001-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:48.743806 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b2df00db-d790-4117-aef0-065d32ecad3d tempest-ServicesAdminNegativeV253TestJSON-1406685001 tempest-ServicesAdminNegativeV253TestJSON-1406685001-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:48.762902 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-1baac71a-c52f-4865-9aaf-2d44097f4766 req-b970e752-fe45-45c9-87f9-c0143aba71e1 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:48.765602 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-1baac71a-c52f-4865-9aaf-2d44097f4766 req-b970e752-fe45-45c9-87f9-c0143aba71e1 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:48.775517 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b2df00db-d790-4117-aef0-065d32ecad3d tempest-ServicesAdminNegativeV253TestJSON-1406685001 tempest-ServicesAdminNegativeV253TestJSON-1406685001-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:48.777293 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b2df00db-d790-4117-aef0-065d32ecad3d tempest-ServicesAdminNegativeV253TestJSON-1406685001 tempest-ServicesAdminNegativeV253TestJSON-1406685001-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:48.798699 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-b2df00db-d790-4117-aef0-065d32ecad3d tempest-ServicesAdminNegativeV253TestJSON-1406685001 tempest-ServicesAdminNegativeV253TestJSON-1406685001-project-admin] HTTP exception thrown: Service ef0ce000-5668-47a4-b3cf-9ce252d88b25 could not be found. Jan 15 20:54:48.799643 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b2df00db-d790-4117-aef0-065d32ecad3d tempest-ServicesAdminNegativeV253TestJSON-1406685001 tempest-ServicesAdminNegativeV253TestJSON-1406685001-project-admin] Returning 404 to user: Service ef0ce000-5668-47a4-b3cf-9ce252d88b25 could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:54:48.805458 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b2df00db-d790-4117-aef0-065d32ecad3d tempest-ServicesAdminNegativeV253TestJSON-1406685001 tempest-ServicesAdminNegativeV253TestJSON-1406685001-project-admin] 10.222.0.46 "PUT /compute/v2.1/os-services/ef0ce000-5668-47a4-b3cf-9ce252d88b25" status: 404 len: 110 microversion: 2.53 time: 0.090097 Jan 15 20:54:48.813267 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 991/1897] 10.222.0.46 () {62 vars in 1308 bytes} [Sat Jan 15 20:54:48 2022] PUT /compute/v2.1/os-services/ef0ce000-5668-47a4-b3cf-9ce252d88b25 => generated 110 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 15 20:54:48.820672 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-1baac71a-c52f-4865-9aaf-2d44097f4766 req-b970e752-fe45-45c9-87f9-c0143aba71e1 service nova] Creating event network-vif-deleted:f6190630-2b92-456a-a85f-b69eb4ffcb81 for instance 3fd1fac4-6c41-4230-9eb5-4fd5a4d82c15 on nch1-master-1 Jan 15 20:54:48.825494 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-42f9ce52-90d8-44a3-9bcc-b263c7bac0e1 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:48.826389 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-42f9ce52-90d8-44a3-9bcc-b263c7bac0e1 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] [instance: 21c7200b-cace-49b4-ab7f-bf43771825ed] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:48.831108 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-1baac71a-c52f-4865-9aaf-2d44097f4766 req-b970e752-fe45-45c9-87f9-c0143aba71e1 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132534 Jan 15 20:54:48.838173 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 907/1898] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:54:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:54:48.849477 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-42f9ce52-90d8-44a3-9bcc-b263c7bac0e1 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:48.850618 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-08fee9ea-a5ca-436b-93d4-4432112c8724 tempest-ServicesAdminNegativeV253TestJSON-1406685001 tempest-ServicesAdminNegativeV253TestJSON-1406685001-project-admin] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:48.851246 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-42f9ce52-90d8-44a3-9bcc-b263c7bac0e1 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:48.852243 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-42f9ce52-90d8-44a3-9bcc-b263c7bac0e1 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:48.853726 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-42f9ce52-90d8-44a3-9bcc-b263c7bac0e1 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:48.856789 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:54:48.856789 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:54:48.860696 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-08fee9ea-a5ca-436b-93d4-4432112c8724 tempest-ServicesAdminNegativeV253TestJSON-1406685001 tempest-ServicesAdminNegativeV253TestJSON-1406685001-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:48.861756 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-08fee9ea-a5ca-436b-93d4-4432112c8724 tempest-ServicesAdminNegativeV253TestJSON-1406685001 tempest-ServicesAdminNegativeV253TestJSON-1406685001-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:48.865385 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-08fee9ea-a5ca-436b-93d4-4432112c8724 tempest-ServicesAdminNegativeV253TestJSON-1406685001 tempest-ServicesAdminNegativeV253TestJSON-1406685001-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:48.871835 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-08fee9ea-a5ca-436b-93d4-4432112c8724 tempest-ServicesAdminNegativeV253TestJSON-1406685001 tempest-ServicesAdminNegativeV253TestJSON-1406685001-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:48.938187 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-08fee9ea-a5ca-436b-93d4-4432112c8724 tempest-ServicesAdminNegativeV253TestJSON-1406685001 tempest-ServicesAdminNegativeV253TestJSON-1406685001-project-admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.097075 Jan 15 20:54:48.939066 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 908/1899] 10.222.0.46 () {60 vars in 1177 bytes} [Sat Jan 15 20:54:48 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:54:48.951410 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-da189702-b294-44ec-9e6d-d8eef997a03b tempest-ServicesAdminNegativeV253TestJSON-1406685001 tempest-ServicesAdminNegativeV253TestJSON-1406685001-project-admin] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:48.955023 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:54:48.955023 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:54:48.960693 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-da189702-b294-44ec-9e6d-d8eef997a03b tempest-ServicesAdminNegativeV253TestJSON-1406685001 tempest-ServicesAdminNegativeV253TestJSON-1406685001-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:48.961176 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-da189702-b294-44ec-9e6d-d8eef997a03b tempest-ServicesAdminNegativeV253TestJSON-1406685001 tempest-ServicesAdminNegativeV253TestJSON-1406685001-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:48.962912 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-da189702-b294-44ec-9e6d-d8eef997a03b tempest-ServicesAdminNegativeV253TestJSON-1406685001 tempest-ServicesAdminNegativeV253TestJSON-1406685001-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:48.963697 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-da189702-b294-44ec-9e6d-d8eef997a03b tempest-ServicesAdminNegativeV253TestJSON-1406685001 tempest-ServicesAdminNegativeV253TestJSON-1406685001-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:48.995389 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-da189702-b294-44ec-9e6d-d8eef997a03b tempest-ServicesAdminNegativeV253TestJSON-1406685001 tempest-ServicesAdminNegativeV253TestJSON-1406685001-project-admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.047925 Jan 15 20:54:49.003957 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 909/1900] 10.222.0.46 () {60 vars in 1210 bytes} [Sat Jan 15 20:54:48 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1242 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 15 20:54:49.015953 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-54714f96-32e9-438e-a893-c64124e2341d tempest-ServicesAdminNegativeV253TestJSON-1406685001 tempest-ServicesAdminNegativeV253TestJSON-1406685001-project-admin] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:49.017437 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:54:49.017437 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:54:49.019387 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-54714f96-32e9-438e-a893-c64124e2341d tempest-ServicesAdminNegativeV253TestJSON-1406685001 tempest-ServicesAdminNegativeV253TestJSON-1406685001-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:49.020067 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-54714f96-32e9-438e-a893-c64124e2341d tempest-ServicesAdminNegativeV253TestJSON-1406685001 tempest-ServicesAdminNegativeV253TestJSON-1406685001-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:49.021862 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-54714f96-32e9-438e-a893-c64124e2341d tempest-ServicesAdminNegativeV253TestJSON-1406685001 tempest-ServicesAdminNegativeV253TestJSON-1406685001-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:49.022604 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-54714f96-32e9-438e-a893-c64124e2341d tempest-ServicesAdminNegativeV253TestJSON-1406685001 tempest-ServicesAdminNegativeV253TestJSON-1406685001-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:49.050463 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-54714f96-32e9-438e-a893-c64124e2341d tempest-ServicesAdminNegativeV253TestJSON-1406685001 tempest-ServicesAdminNegativeV253TestJSON-1406685001-project-admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.039488 Jan 15 20:54:49.057936 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 910/1901] 10.222.0.46 () {60 vars in 1177 bytes} [Sat Jan 15 20:54:49 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:54:49.065438 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-41bef5a7-4e43-4474-8263-445fb90a2074 tempest-ServicesAdminNegativeV253TestJSON-1406685001 tempest-ServicesAdminNegativeV253TestJSON-1406685001-project-admin] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:49.066799 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:54:49.066799 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:54:49.068467 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-41bef5a7-4e43-4474-8263-445fb90a2074 tempest-ServicesAdminNegativeV253TestJSON-1406685001 tempest-ServicesAdminNegativeV253TestJSON-1406685001-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:49.068885 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-41bef5a7-4e43-4474-8263-445fb90a2074 tempest-ServicesAdminNegativeV253TestJSON-1406685001 tempest-ServicesAdminNegativeV253TestJSON-1406685001-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:49.069933 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-41bef5a7-4e43-4474-8263-445fb90a2074 tempest-ServicesAdminNegativeV253TestJSON-1406685001 tempest-ServicesAdminNegativeV253TestJSON-1406685001-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:49.070399 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-41bef5a7-4e43-4474-8263-445fb90a2074 tempest-ServicesAdminNegativeV253TestJSON-1406685001 tempest-ServicesAdminNegativeV253TestJSON-1406685001-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:49.108016 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-41bef5a7-4e43-4474-8263-445fb90a2074 tempest-ServicesAdminNegativeV253TestJSON-1406685001 tempest-ServicesAdminNegativeV253TestJSON-1406685001-project-admin] 10.222.0.46 "GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.047431 Jan 15 20:54:49.112868 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 911/1902] 10.222.0.46 () {60 vars in 1236 bytes} [Sat Jan 15 20:54:49 2022] GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx => generated 16 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:54:49.118930 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2bb2932f-679f-4719-bec6-7b32d5d73d52 tempest-ServicesAdminNegativeV253TestJSON-1406685001 tempest-ServicesAdminNegativeV253TestJSON-1406685001-project-admin] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:49.125288 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:54:49.125288 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:54:49.128225 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2bb2932f-679f-4719-bec6-7b32d5d73d52 tempest-ServicesAdminNegativeV253TestJSON-1406685001 tempest-ServicesAdminNegativeV253TestJSON-1406685001-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:49.129350 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2bb2932f-679f-4719-bec6-7b32d5d73d52 tempest-ServicesAdminNegativeV253TestJSON-1406685001 tempest-ServicesAdminNegativeV253TestJSON-1406685001-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:49.130583 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2bb2932f-679f-4719-bec6-7b32d5d73d52 tempest-ServicesAdminNegativeV253TestJSON-1406685001 tempest-ServicesAdminNegativeV253TestJSON-1406685001-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:49.131344 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2bb2932f-679f-4719-bec6-7b32d5d73d52 tempest-ServicesAdminNegativeV253TestJSON-1406685001 tempest-ServicesAdminNegativeV253TestJSON-1406685001-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:49.163375 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2bb2932f-679f-4719-bec6-7b32d5d73d52 tempest-ServicesAdminNegativeV253TestJSON-1406685001 tempest-ServicesAdminNegativeV253TestJSON-1406685001-project-admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.047234 Jan 15 20:54:49.164868 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 912/1903] 10.222.0.46 () {60 vars in 1177 bytes} [Sat Jan 15 20:54:49 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:54:49.175601 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b25d09e7-1a4f-45ec-8686-d6f79c771552 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:49.176633 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b25d09e7-1a4f-45ec-8686-d6f79c771552 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: 427db3d9-56d4-49ff-a4f1-28302d78f56a] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:49.193861 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b25d09e7-1a4f-45ec-8686-d6f79c771552 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:49.194640 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b25d09e7-1a4f-45ec-8686-d6f79c771552 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:49.195680 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b25d09e7-1a4f-45ec-8686-d6f79c771552 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:49.196273 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b25d09e7-1a4f-45ec-8686-d6f79c771552 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:49.261855 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-42f9ce52-90d8-44a3-9bcc-b263c7bac0e1 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e1b423e1a9146c8bb202ba012e2ee2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d5d92c87544c4d8080e19c1f6429bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:49.278430 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-42f9ce52-90d8-44a3-9bcc-b263c7bac0e1 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] 10.222.0.46 "GET /compute/v2.1/servers/21c7200b-cace-49b4-ab7f-bf43771825ed" status: 200 len: 1534 microversion: 2.1 time: 0.460956 Jan 15 20:54:49.280378 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 992/1904] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:54:48 2022] GET /compute/v2.1/servers/21c7200b-cace-49b4-ab7f-bf43771825ed => generated 1534 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:54:49.290439 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c9149306-0552-48e8-b374-e7550c57428f tempest-ServicesAdminNegativeV253TestJSON-1406685001 tempest-ServicesAdminNegativeV253TestJSON-1406685001-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:49.294615 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:54:49.294615 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:54:49.299478 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c9149306-0552-48e8-b374-e7550c57428f tempest-ServicesAdminNegativeV253TestJSON-1406685001 tempest-ServicesAdminNegativeV253TestJSON-1406685001-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:49.301380 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c9149306-0552-48e8-b374-e7550c57428f tempest-ServicesAdminNegativeV253TestJSON-1406685001 tempest-ServicesAdminNegativeV253TestJSON-1406685001-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:49.302609 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c9149306-0552-48e8-b374-e7550c57428f tempest-ServicesAdminNegativeV253TestJSON-1406685001 tempest-ServicesAdminNegativeV253TestJSON-1406685001-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:49.304996 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c9149306-0552-48e8-b374-e7550c57428f tempest-ServicesAdminNegativeV253TestJSON-1406685001 tempest-ServicesAdminNegativeV253TestJSON-1406685001-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:49.368701 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c9149306-0552-48e8-b374-e7550c57428f tempest-ServicesAdminNegativeV253TestJSON-1406685001 tempest-ServicesAdminNegativeV253TestJSON-1406685001-project-admin] 10.222.0.46 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.086381 Jan 15 20:54:49.370033 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 993/1905] 10.222.0.46 () {60 vars in 1238 bytes} [Sat Jan 15 20:54:49 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:54:49.567694 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-5c8bda1c-e15d-4d9f-aaf3-3b920b5a31bc tempest-ServicesAdminNegativeV253TestJSON-1666927633 tempest-ServicesAdminNegativeV253TestJSON-1666927633-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:49.569300 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:54:49.569300 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:54:49.570877 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-5c8bda1c-e15d-4d9f-aaf3-3b920b5a31bc tempest-ServicesAdminNegativeV253TestJSON-1666927633 tempest-ServicesAdminNegativeV253TestJSON-1666927633-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '8f1146052e054c789bd8d7455f1919db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b5140c56b649fa98bf89100b3c1c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:49.571686 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-5c8bda1c-e15d-4d9f-aaf3-3b920b5a31bc tempest-ServicesAdminNegativeV253TestJSON-1666927633 tempest-ServicesAdminNegativeV253TestJSON-1666927633-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:54:49.573636 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-5c8bda1c-e15d-4d9f-aaf3-3b920b5a31bc tempest-ServicesAdminNegativeV253TestJSON-1666927633 tempest-ServicesAdminNegativeV253TestJSON-1666927633-project] 10.222.0.46 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.194064 Jan 15 20:54:49.574432 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 994/1906] 10.222.0.46 () {60 vars in 1177 bytes} [Sat Jan 15 20:54:49 2022] GET /compute/v2.1/os-services => generated 112 bytes in 197 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Jan 15 20:54:49.589470 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-96d33256-f839-4132-b148-eef3f564c7bb tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:49.590336 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-96d33256-f839-4132-b148-eef3f564c7bb tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] [instance: 3fd1fac4-6c41-4230-9eb5-4fd5a4d82c15] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:49.604206 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-96d33256-f839-4132-b148-eef3f564c7bb tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:49.605573 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-96d33256-f839-4132-b148-eef3f564c7bb tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:49.607839 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-96d33256-f839-4132-b148-eef3f564c7bb tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:49.608455 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-96d33256-f839-4132-b148-eef3f564c7bb tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:49.623403 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-b25d09e7-1a4f-45ec-8686-d6f79c771552 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:49.635981 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b25d09e7-1a4f-45ec-8686-d6f79c771552 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/427db3d9-56d4-49ff-a4f1-28302d78f56a" status: 200 len: 1315 microversion: 2.1 time: 0.469456 Jan 15 20:54:49.641275 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 913/1907] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:54:49 2022] GET /compute/v2.1/servers/427db3d9-56d4-49ff-a4f1-28302d78f56a => generated 1315 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:54:49.644782 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-96d33256-f839-4132-b148-eef3f564c7bb tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] HTTP exception thrown: Instance 3fd1fac4-6c41-4230-9eb5-4fd5a4d82c15 could not be found. Jan 15 20:54:49.645901 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-96d33256-f839-4132-b148-eef3f564c7bb tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Returning 404 to user: Instance 3fd1fac4-6c41-4230-9eb5-4fd5a4d82c15 could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:54:49.647001 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-96d33256-f839-4132-b148-eef3f564c7bb tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] 10.222.0.46 "GET /compute/v2.1/servers/3fd1fac4-6c41-4230-9eb5-4fd5a4d82c15" status: 404 len: 111 microversion: 2.1 time: 0.064593 Jan 15 20:54:49.647806 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 995/1908] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:54:49 2022] GET /compute/v2.1/servers/3fd1fac4-6c41-4230-9eb5-4fd5a4d82c15 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:54:49.659870 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-be83d9b1-6b2c-4200-825f-ef46613f8c8d tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Calling method '.version_select at 0x7f30ceba7af0>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:50.129620 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-be83d9b1-6b2c-4200-825f-ef46613f8c8d tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/6fcd6844-3261-41cc-9071-34a253ce8007" status: 202 len: 0 microversion: 2.1 time: 0.474927 Jan 15 20:54:50.130211 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 914/1909] 10.222.0.46 () {58 vars in 1271 bytes} [Sat Jan 15 20:54:49 2022] DELETE /compute/v2.1/os-security-groups/6fcd6844-3261-41cc-9071-34a253ce8007 => generated 0 bytes in 477 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 15 20:54:50.139219 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e343074a-f282-4ba3-941d-6deb1234ab21 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] Calling method '.version_select at 0x7f30c8e0b8b0>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:50.301306 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-76a99368-729a-42fe-97a2-039493fc3270 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:50.302448 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-76a99368-729a-42fe-97a2-039493fc3270 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] [instance: 21c7200b-cace-49b4-ab7f-bf43771825ed] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:50.315928 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-76a99368-729a-42fe-97a2-039493fc3270 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:50.316620 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-76a99368-729a-42fe-97a2-039493fc3270 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:50.322690 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-76a99368-729a-42fe-97a2-039493fc3270 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:50.323736 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-76a99368-729a-42fe-97a2-039493fc3270 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:50.952697 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-76a99368-729a-42fe-97a2-039493fc3270 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e1b423e1a9146c8bb202ba012e2ee2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d5d92c87544c4d8080e19c1f6429bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:50.970569 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-76a99368-729a-42fe-97a2-039493fc3270 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] 10.222.0.46 "GET /compute/v2.1/servers/21c7200b-cace-49b4-ab7f-bf43771825ed" status: 200 len: 1521 microversion: 2.1 time: 0.674904 Jan 15 20:54:50.982540 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 915/1910] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:54:50 2022] GET /compute/v2.1/servers/21c7200b-cace-49b4-ab7f-bf43771825ed => generated 1521 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:54:50.982540 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-93dfaa2b-b05b-477d-83e7-1054f5da59c3 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:50.982840 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-93dfaa2b-b05b-477d-83e7-1054f5da59c3 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: 427db3d9-56d4-49ff-a4f1-28302d78f56a] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:50.995334 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-93dfaa2b-b05b-477d-83e7-1054f5da59c3 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:50.996334 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-93dfaa2b-b05b-477d-83e7-1054f5da59c3 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:50.997204 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-93dfaa2b-b05b-477d-83e7-1054f5da59c3 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:50.997907 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-93dfaa2b-b05b-477d-83e7-1054f5da59c3 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:51.013150 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e343074a-f282-4ba3-941d-6deb1234ab21 tempest-SecurityGroupsTestJSON-648215362 tempest-SecurityGroupsTestJSON-648215362-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/0a330bbb-88d9-44eb-a060-ef87d8ba5601" status: 202 len: 0 microversion: 2.1 time: 0.878543 Jan 15 20:54:51.017951 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 996/1911] 10.222.0.46 () {58 vars in 1271 bytes} [Sat Jan 15 20:54:50 2022] DELETE /compute/v2.1/os-security-groups/0a330bbb-88d9-44eb-a060-ef87d8ba5601 => generated 0 bytes in 884 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 15 20:54:51.022955 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-02f60e7d-799d-437d-8104-e7e4d1c016ef tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:51.023698 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-02f60e7d-799d-437d-8104-e7e4d1c016ef tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] [instance: 21c7200b-cace-49b4-ab7f-bf43771825ed] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:51.039566 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-02f60e7d-799d-437d-8104-e7e4d1c016ef tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:51.040348 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-02f60e7d-799d-437d-8104-e7e4d1c016ef tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:51.041463 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-02f60e7d-799d-437d-8104-e7e4d1c016ef tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:51.043895 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-02f60e7d-799d-437d-8104-e7e4d1c016ef tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:51.101868 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-02f60e7d-799d-437d-8104-e7e4d1c016ef tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] [instance: 21c7200b-cace-49b4-ab7f-bf43771825ed] Going to try to terminate instance {{(pid=129366) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 20:54:51.293295 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-02f60e7d-799d-437d-8104-e7e4d1c016ef tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] 10.222.0.46 "DELETE /compute/v2.1/servers/21c7200b-cace-49b4-ab7f-bf43771825ed" status: 204 len: 0 microversion: 2.1 time: 0.271570 Jan 15 20:54:51.293929 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 997/1912] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 20:54:51 2022] DELETE /compute/v2.1/servers/21c7200b-cace-49b4-ab7f-bf43771825ed => generated 0 bytes in 275 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 20:54:51.314921 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b767a35a-715a-466b-be7a-5928fe7c68f1 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:51.316009 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b767a35a-715a-466b-be7a-5928fe7c68f1 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] [instance: 21c7200b-cace-49b4-ab7f-bf43771825ed] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:51.326987 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b767a35a-715a-466b-be7a-5928fe7c68f1 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:51.327605 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b767a35a-715a-466b-be7a-5928fe7c68f1 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:51.329325 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b767a35a-715a-466b-be7a-5928fe7c68f1 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:51.329776 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b767a35a-715a-466b-be7a-5928fe7c68f1 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:52.358724 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-b767a35a-715a-466b-be7a-5928fe7c68f1 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e1b423e1a9146c8bb202ba012e2ee2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d5d92c87544c4d8080e19c1f6429bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:52.368014 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b767a35a-715a-466b-be7a-5928fe7c68f1 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] 10.222.0.46 "GET /compute/v2.1/servers/21c7200b-cace-49b4-ab7f-bf43771825ed" status: 200 len: 1527 microversion: 2.1 time: 1.068898 Jan 15 20:54:52.371801 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 998/1913] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:54:51 2022] GET /compute/v2.1/servers/21c7200b-cace-49b4-ab7f-bf43771825ed => generated 1527 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:54:52.431400 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-93dfaa2b-b05b-477d-83e7-1054f5da59c3 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:52.447117 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-93dfaa2b-b05b-477d-83e7-1054f5da59c3 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/427db3d9-56d4-49ff-a4f1-28302d78f56a" status: 200 len: 1315 microversion: 2.1 time: 1.471724 Jan 15 20:54:52.448903 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 916/1914] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:54:50 2022] GET /compute/v2.1/servers/427db3d9-56d4-49ff-a4f1-28302d78f56a => generated 1315 bytes in 1476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:54:53.389862 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-319007fa-2bb0-425b-b850-3cb45689aa42 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:53.391100 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-319007fa-2bb0-425b-b850-3cb45689aa42 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] [instance: 21c7200b-cace-49b4-ab7f-bf43771825ed] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:53.411461 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-319007fa-2bb0-425b-b850-3cb45689aa42 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:53.417906 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-319007fa-2bb0-425b-b850-3cb45689aa42 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:53.419070 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-319007fa-2bb0-425b-b850-3cb45689aa42 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:53.421461 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-319007fa-2bb0-425b-b850-3cb45689aa42 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:53.469150 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a8e51f40-ea6e-45fe-8287-a9763596f409 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:53.469783 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a8e51f40-ea6e-45fe-8287-a9763596f409 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: 427db3d9-56d4-49ff-a4f1-28302d78f56a] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:53.491952 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a8e51f40-ea6e-45fe-8287-a9763596f409 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:53.493919 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a8e51f40-ea6e-45fe-8287-a9763596f409 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:53.494990 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a8e51f40-ea6e-45fe-8287-a9763596f409 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:53.497281 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a8e51f40-ea6e-45fe-8287-a9763596f409 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:54.054804 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-319007fa-2bb0-425b-b850-3cb45689aa42 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e1b423e1a9146c8bb202ba012e2ee2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d5d92c87544c4d8080e19c1f6429bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:54.067636 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-319007fa-2bb0-425b-b850-3cb45689aa42 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] 10.222.0.46 "GET /compute/v2.1/servers/21c7200b-cace-49b4-ab7f-bf43771825ed" status: 200 len: 1527 microversion: 2.1 time: 0.682648 Jan 15 20:54:54.077782 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 999/1915] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:54:53 2022] GET /compute/v2.1/servers/21c7200b-cace-49b4-ab7f-bf43771825ed => generated 1527 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:54:54.119089 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-a8e51f40-ea6e-45fe-8287-a9763596f409 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:54.128796 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a8e51f40-ea6e-45fe-8287-a9763596f409 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/427db3d9-56d4-49ff-a4f1-28302d78f56a" status: 200 len: 1315 microversion: 2.1 time: 0.664419 Jan 15 20:54:54.129982 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 917/1916] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:54:53 2022] GET /compute/v2.1/servers/427db3d9-56d4-49ff-a4f1-28302d78f56a => generated 1315 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:54:55.084568 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f58bc832-a5cb-4b8d-a1bd-d2b3884e3c54 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:55.086845 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f58bc832-a5cb-4b8d-a1bd-d2b3884e3c54 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] [instance: 21c7200b-cace-49b4-ab7f-bf43771825ed] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:55.100326 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f58bc832-a5cb-4b8d-a1bd-d2b3884e3c54 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:55.101109 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f58bc832-a5cb-4b8d-a1bd-d2b3884e3c54 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:55.102536 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f58bc832-a5cb-4b8d-a1bd-d2b3884e3c54 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:55.104538 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f58bc832-a5cb-4b8d-a1bd-d2b3884e3c54 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:55.147154 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-914340df-36ae-4900-8728-e6ed59f81973 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:55.149590 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-914340df-36ae-4900-8728-e6ed59f81973 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: 427db3d9-56d4-49ff-a4f1-28302d78f56a] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:55.162410 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-914340df-36ae-4900-8728-e6ed59f81973 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:55.166547 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-914340df-36ae-4900-8728-e6ed59f81973 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:55.167925 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-914340df-36ae-4900-8728-e6ed59f81973 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:55.168541 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-914340df-36ae-4900-8728-e6ed59f81973 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:55.493828 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-f58bc832-a5cb-4b8d-a1bd-d2b3884e3c54 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e1b423e1a9146c8bb202ba012e2ee2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d5d92c87544c4d8080e19c1f6429bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:55.507488 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f58bc832-a5cb-4b8d-a1bd-d2b3884e3c54 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] 10.222.0.46 "GET /compute/v2.1/servers/21c7200b-cace-49b4-ab7f-bf43771825ed" status: 200 len: 1527 microversion: 2.1 time: 0.424186 Jan 15 20:54:55.524687 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1000/1917] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:54:55 2022] GET /compute/v2.1/servers/21c7200b-cace-49b4-ab7f-bf43771825ed => generated 1527 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:54:55.579641 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-914340df-36ae-4900-8728-e6ed59f81973 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:55.588876 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-914340df-36ae-4900-8728-e6ed59f81973 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/427db3d9-56d4-49ff-a4f1-28302d78f56a" status: 200 len: 1315 microversion: 2.1 time: 0.446991 Jan 15 20:54:55.589940 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 918/1918] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:54:55 2022] GET /compute/v2.1/servers/427db3d9-56d4-49ff-a4f1-28302d78f56a => generated 1315 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:54:55.935469 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a8b5260f-6c5e-46aa-9280-7bb1074940d8 tempest-ImagesDeleteNegativeTestJSON-1769113944 tempest-ImagesDeleteNegativeTestJSON-1769113944-project] 10.222.0.46 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.104399 Jan 15 20:54:55.940523 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 919/1919] 10.222.0.46 () {58 vars in 1127 bytes} [Sat Jan 15 20:54:55 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 110 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jan 15 20:54:55.945844 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-966e4eae-b721-406a-86b8-198b63627cc3 tempest-ImagesDeleteNegativeTestJSON-1769113944 tempest-ImagesDeleteNegativeTestJSON-1769113944-project] Calling method '.version_select at 0x7f30ceb63550>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:55.982508 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-966e4eae-b721-406a-86b8-198b63627cc3 tempest-ImagesDeleteNegativeTestJSON-1769113944 tempest-ImagesDeleteNegativeTestJSON-1769113944-project] HTTP exception thrown: Image not found. Jan 15 20:54:55.983106 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-966e4eae-b721-406a-86b8-198b63627cc3 tempest-ImagesDeleteNegativeTestJSON-1769113944 tempest-ImagesDeleteNegativeTestJSON-1769113944-project] Returning 404 to user: Image not found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:54:55.983940 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-966e4eae-b721-406a-86b8-198b63627cc3 tempest-ImagesDeleteNegativeTestJSON-1769113944 tempest-ImagesDeleteNegativeTestJSON-1769113944-project] 10.222.0.46 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.042205 Jan 15 20:54:55.989298 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 920/1920] 10.222.0.46 () {58 vars in 1133 bytes} [Sat Jan 15 20:54:55 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jan 15 20:54:55.997335 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-4f0ac0ee-06fd-4733-998c-d524ce36ca4b tempest-ImagesDeleteNegativeTestJSON-1769113944 tempest-ImagesDeleteNegativeTestJSON-1769113944-project] Calling method '.version_select at 0x7f30ceb32940>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:56.036112 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e8cefd97-9866-4217-8688-ee2a8a391216 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Action: 'create', calling method: .version_select at 0x7f30cecdbaf0>, body: {"keypair": {"name": "tempest-keypair-1897593836"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:54:56.062467 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-4f0ac0ee-06fd-4733-998c-d524ce36ca4b tempest-ImagesDeleteNegativeTestJSON-1769113944 tempest-ImagesDeleteNegativeTestJSON-1769113944-project] HTTP exception thrown: Image not found. Jan 15 20:54:56.063253 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-4f0ac0ee-06fd-4733-998c-d524ce36ca4b tempest-ImagesDeleteNegativeTestJSON-1769113944 tempest-ImagesDeleteNegativeTestJSON-1769113944-project] Returning 404 to user: Image not found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:54:56.064091 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-4f0ac0ee-06fd-4733-998c-d524ce36ca4b tempest-ImagesDeleteNegativeTestJSON-1769113944 tempest-ImagesDeleteNegativeTestJSON-1769113944-project] 10.222.0.46 "DELETE /compute/v2.1/images/b88b47a8-1add-4180-a6a7-fdc83826db8j" status: 404 len: 62 microversion: 2.1 time: 0.071565 Jan 15 20:54:56.066544 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 921/1921] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:54:55 2022] DELETE /compute/v2.1/images/b88b47a8-1add-4180-a6a7-fdc83826db8j => generated 62 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jan 15 20:54:56.084580 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c868fbcb-3e7e-404c-8ae2-bcad0d63c2dd tempest-ImagesDeleteNegativeTestJSON-1769113944 tempest-ImagesDeleteNegativeTestJSON-1769113944-project] Calling method '.version_select at 0x7f30ceb63ee0>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:56.097292 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-e8cefd97-9866-4217-8688-ee2a8a391216 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Getting quotas for project 964edbaeb4c944cfb68578886695266c. Resources: {'key_pairs'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:54:56.107959 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-e8cefd97-9866-4217-8688-ee2a8a391216 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Getting quotas for user 4c0085c7fa1d44e58b20181319ea00f4 and project 964edbaeb4c944cfb68578886695266c. Resources: {'key_pairs'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:54:56.110498 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-c868fbcb-3e7e-404c-8ae2-bcad0d63c2dd tempest-ImagesDeleteNegativeTestJSON-1769113944 tempest-ImagesDeleteNegativeTestJSON-1769113944-project] HTTP exception thrown: Image not found. Jan 15 20:54:56.111104 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c868fbcb-3e7e-404c-8ae2-bcad0d63c2dd tempest-ImagesDeleteNegativeTestJSON-1769113944 tempest-ImagesDeleteNegativeTestJSON-1769113944-project] Returning 404 to user: Image not found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:54:56.112120 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c868fbcb-3e7e-404c-8ae2-bcad0d63c2dd tempest-ImagesDeleteNegativeTestJSON-1769113944 tempest-ImagesDeleteNegativeTestJSON-1769113944-project] 10.222.0.46 "DELETE /compute/v2.1/images/dbf2257f-e4a1-4592-9e14-3e7a8638c26c1" status: 404 len: 62 microversion: 2.1 time: 0.040247 Jan 15 20:54:56.117585 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 922/1922] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 20:54:56 2022] DELETE /compute/v2.1/images/dbf2257f-e4a1-4592-9e14-3e7a8638c26c1 => generated 62 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jan 15 20:54:56.131375 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-69209f61-eea9-4302-83bc-3e4d6748a1a6 tempest-ImagesDeleteNegativeTestJSON-1769113944 tempest-ImagesDeleteNegativeTestJSON-1769113944-project] Calling method '.version_select at 0x7f30ceb63700>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:56.161724 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-69209f61-eea9-4302-83bc-3e4d6748a1a6 tempest-ImagesDeleteNegativeTestJSON-1769113944 tempest-ImagesDeleteNegativeTestJSON-1769113944-project] HTTP exception thrown: Image not found. Jan 15 20:54:56.167428 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-69209f61-eea9-4302-83bc-3e4d6748a1a6 tempest-ImagesDeleteNegativeTestJSON-1769113944 tempest-ImagesDeleteNegativeTestJSON-1769113944-project] Returning 404 to user: Image not found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:54:56.168568 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-69209f61-eea9-4302-83bc-3e4d6748a1a6 tempest-ImagesDeleteNegativeTestJSON-1769113944 tempest-ImagesDeleteNegativeTestJSON-1769113944-project] 10.222.0.46 "DELETE /compute/v2.1/images/tempest-invalid-627777793" status: 404 len: 62 microversion: 2.1 time: 0.049757 Jan 15 20:54:56.174966 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 923/1923] 10.222.0.46 () {58 vars in 1202 bytes} [Sat Jan 15 20:54:56 2022] DELETE /compute/v2.1/images/tempest-invalid-627777793 => generated 62 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jan 15 20:54:56.184319 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-db68ed59-21fd-42a9-bec5-8f220089c2a7 tempest-ImagesDeleteNegativeTestJSON-1769113944 tempest-ImagesDeleteNegativeTestJSON-1769113944-project] Calling method '.version_select at 0x7f30ceb63f70>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:56.228143 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-db68ed59-21fd-42a9-bec5-8f220089c2a7 tempest-ImagesDeleteNegativeTestJSON-1769113944 tempest-ImagesDeleteNegativeTestJSON-1769113944-project] HTTP exception thrown: Image not found. Jan 15 20:54:56.228725 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-db68ed59-21fd-42a9-bec5-8f220089c2a7 tempest-ImagesDeleteNegativeTestJSON-1769113944 tempest-ImagesDeleteNegativeTestJSON-1769113944-project] Returning 404 to user: Image not found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:54:56.229963 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-db68ed59-21fd-42a9-bec5-8f220089c2a7 tempest-ImagesDeleteNegativeTestJSON-1769113944 tempest-ImagesDeleteNegativeTestJSON-1769113944-project] 10.222.0.46 "DELETE /compute/v2.1/images/c1441895-e88a-4cc2-a545-b12211837a0b" status: 404 len: 62 microversion: 2.1 time: 0.053782 Jan 15 20:54:56.238283 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 924/1924] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:54:56 2022] DELETE /compute/v2.1/images/c1441895-e88a-4cc2-a545-b12211837a0b => generated 62 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jan 15 20:54:56.247616 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-18ea4294-4280-45b6-b0e7-ee367e045300 req-b30b14da-025f-496e-9c99-5c719c9769be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21c7200b-cace-49b4-ab7f-bf43771825ed", "name": "network-vif-deleted", "tag": "3e2ec07d-d7a1-46c5-aab4-583109786f3e"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:54:56.257108 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:54:56.257108 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:54:56.281790 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-18ea4294-4280-45b6-b0e7-ee367e045300 req-b30b14da-025f-496e-9c99-5c719c9769be service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:56.282234 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-18ea4294-4280-45b6-b0e7-ee367e045300 req-b30b14da-025f-496e-9c99-5c719c9769be service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:56.333595 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-18ea4294-4280-45b6-b0e7-ee367e045300 req-b30b14da-025f-496e-9c99-5c719c9769be service nova] Creating event network-vif-deleted:3e2ec07d-d7a1-46c5-aab4-583109786f3e for instance 21c7200b-cace-49b4-ab7f-bf43771825ed on nch2-master-1 Jan 15 20:54:56.348698 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-18ea4294-4280-45b6-b0e7-ee367e045300 req-b30b14da-025f-496e-9c99-5c719c9769be service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109091 Jan 15 20:54:56.359596 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 925/1925] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:54:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:54:56.535678 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-bff2baec-9843-4610-a7c9-4c047515113e tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:56.536822 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-bff2baec-9843-4610-a7c9-4c047515113e tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] [instance: 21c7200b-cace-49b4-ab7f-bf43771825ed] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:56.560944 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bff2baec-9843-4610-a7c9-4c047515113e tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:56.564379 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bff2baec-9843-4610-a7c9-4c047515113e tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:56.568678 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bff2baec-9843-4610-a7c9-4c047515113e tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:56.569938 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bff2baec-9843-4610-a7c9-4c047515113e tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:56.619300 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-e8cefd97-9866-4217-8688-ee2a8a391216 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Getting quotas for project 964edbaeb4c944cfb68578886695266c. Resources: {'key_pairs'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:54:56.634135 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bff2baec-9843-4610-a7c9-4c047515113e tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:56.634374 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-e8cefd97-9866-4217-8688-ee2a8a391216 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Getting quotas for user 4c0085c7fa1d44e58b20181319ea00f4 and project 964edbaeb4c944cfb68578886695266c. Resources: {'key_pairs'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:54:56.635266 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bff2baec-9843-4610-a7c9-4c047515113e tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:56.636011 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.objects.instance [None req-bff2baec-9843-4610-a7c9-4c047515113e tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lazy-loading 'fault' on Instance uuid 21c7200b-cace-49b4-ab7f-bf43771825ed {{(pid=129365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 20:54:56.716883 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e8cefd97-9866-4217-8688-ee2a8a391216 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 1.094833 Jan 15 20:54:56.717436 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1001/1926] 10.222.0.46 () {60 vars in 1157 bytes} [Sat Jan 15 20:54:55 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:54:56.736448 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-04381d60-e089-466f-a0fd-1629223717a4 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:56.737109 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-04381d60-e089-466f-a0fd-1629223717a4 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: 427db3d9-56d4-49ff-a4f1-28302d78f56a] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:56.754688 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-04381d60-e089-466f-a0fd-1629223717a4 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:56.756376 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-04381d60-e089-466f-a0fd-1629223717a4 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:56.760219 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-04381d60-e089-466f-a0fd-1629223717a4 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:56.762053 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-04381d60-e089-466f-a0fd-1629223717a4 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:56.834173 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-bff2baec-9843-4610-a7c9-4c047515113e tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e1b423e1a9146c8bb202ba012e2ee2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d5d92c87544c4d8080e19c1f6429bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:56.845440 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-bff2baec-9843-4610-a7c9-4c047515113e tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] 10.222.0.46 "GET /compute/v2.1/servers/21c7200b-cace-49b4-ab7f-bf43771825ed" status: 200 len: 1314 microversion: 2.1 time: 0.318508 Jan 15 20:54:56.849338 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 926/1927] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:54:56 2022] GET /compute/v2.1/servers/21c7200b-cace-49b4-ab7f-bf43771825ed => generated 1314 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:54:57.422253 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-04381d60-e089-466f-a0fd-1629223717a4 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:54:57.433574 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-04381d60-e089-466f-a0fd-1629223717a4 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/427db3d9-56d4-49ff-a4f1-28302d78f56a" status: 200 len: 1315 microversion: 2.1 time: 0.704382 Jan 15 20:54:57.437019 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1002/1928] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:54:56 2022] GET /compute/v2.1/servers/427db3d9-56d4-49ff-a4f1-28302d78f56a => generated 1315 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:54:57.866654 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3e81b0d0-a030-4139-bd29-83f97adc0f47 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:57.867872 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-3e81b0d0-a030-4139-bd29-83f97adc0f47 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] [instance: 21c7200b-cace-49b4-ab7f-bf43771825ed] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:57.883873 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3e81b0d0-a030-4139-bd29-83f97adc0f47 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:57.886094 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3e81b0d0-a030-4139-bd29-83f97adc0f47 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:57.890930 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3e81b0d0-a030-4139-bd29-83f97adc0f47 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:57.892501 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3e81b0d0-a030-4139-bd29-83f97adc0f47 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:57.928754 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-3e81b0d0-a030-4139-bd29-83f97adc0f47 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] HTTP exception thrown: Instance 21c7200b-cace-49b4-ab7f-bf43771825ed could not be found. Jan 15 20:54:57.929547 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3e81b0d0-a030-4139-bd29-83f97adc0f47 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Returning 404 to user: Instance 21c7200b-cace-49b4-ab7f-bf43771825ed could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:54:57.930498 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3e81b0d0-a030-4139-bd29-83f97adc0f47 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] 10.222.0.46 "GET /compute/v2.1/servers/21c7200b-cace-49b4-ab7f-bf43771825ed" status: 404 len: 111 microversion: 2.1 time: 0.067717 Jan 15 20:54:57.931151 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 927/1929] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:54:57 2022] GET /compute/v2.1/servers/21c7200b-cace-49b4-ab7f-bf43771825ed => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:54:57.940580 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-90bae619-6f99-4d98-965e-4ab2aaf1808d tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Action: 'create', calling method: .version_select at 0x7f30c8f44280>, body: {"keypair": {"name": "tempest-keypair-1095949725"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:54:57.957116 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-90bae619-6f99-4d98-965e-4ab2aaf1808d tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Getting quotas for project f6d5d92c87544c4d8080e19c1f6429bf. Resources: {'key_pairs'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:54:57.963360 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-90bae619-6f99-4d98-965e-4ab2aaf1808d tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Getting quotas for user 2e1b423e1a9146c8bb202ba012e2ee2a and project f6d5d92c87544c4d8080e19c1f6429bf. Resources: {'key_pairs'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:54:58.321703 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-90bae619-6f99-4d98-965e-4ab2aaf1808d tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Getting quotas for project f6d5d92c87544c4d8080e19c1f6429bf. Resources: {'key_pairs'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:54:58.338919 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-90bae619-6f99-4d98-965e-4ab2aaf1808d tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Getting quotas for user 2e1b423e1a9146c8bb202ba012e2ee2a and project f6d5d92c87544c4d8080e19c1f6429bf. Resources: {'key_pairs'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:54:58.403820 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-90bae619-6f99-4d98-965e-4ab2aaf1808d tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.463133 Jan 15 20:54:58.405012 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1003/1930] 10.222.0.46 () {60 vars in 1157 bytes} [Sat Jan 15 20:54:57 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:54:58.454264 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-72e205d1-baf6-4ab9-96b6-8510feb7bdd5 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:54:58.454879 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-72e205d1-baf6-4ab9-96b6-8510feb7bdd5 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: 427db3d9-56d4-49ff-a4f1-28302d78f56a] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:54:58.469794 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-72e205d1-baf6-4ab9-96b6-8510feb7bdd5 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:58.470246 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-72e205d1-baf6-4ab9-96b6-8510feb7bdd5 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:58.476433 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-72e205d1-baf6-4ab9-96b6-8510feb7bdd5 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:54:58.477018 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-72e205d1-baf6-4ab9-96b6-8510feb7bdd5 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:54:59.718070 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ed30b411-29a4-4f5f-8ab5-d5c96613f1d6 tempest-FloatingIPDetailsTestJSON-205108975 tempest-FloatingIPDetailsTestJSON-205108975-project] Action: 'create', calling method: .version_select at 0x7f30ced31c10>, body: {"pool": null} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:55:00.019212 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-72e205d1-baf6-4ab9-96b6-8510feb7bdd5 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:55:00.058857 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-72e205d1-baf6-4ab9-96b6-8510feb7bdd5 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/427db3d9-56d4-49ff-a4f1-28302d78f56a" status: 200 len: 1315 microversion: 2.1 time: 1.605699 Jan 15 20:55:00.063110 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 928/1931] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:54:58 2022] GET /compute/v2.1/servers/427db3d9-56d4-49ff-a4f1-28302d78f56a => generated 1315 bytes in 1614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:55:00.422999 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-90fcd8f5-6d10-4c6a-b282-03f165cd9651 tempest-FlavorsV261TestJSON-602304126 tempest-FlavorsV261TestJSON-602304126-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-1625723380", "id": 1539555813, "os-flavor-access:is_public": "True"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:55:00.430804 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:55:00.430804 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:55:00.473490 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-90fcd8f5-6d10-4c6a-b282-03f165cd9651 tempest-FlavorsV261TestJSON-602304126 tempest-FlavorsV261TestJSON-602304126-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 468 microversion: 2.61 time: 0.408127 Jan 15 20:55:00.476139 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 929/1932] 10.222.0.46 () {62 vars in 1187 bytes} [Sat Jan 15 20:55:00 2022] POST /compute/v2.1/flavors => generated 468 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:55:00.797365 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ec92b8e9-4e5f-4677-ad8a-e8850a13d1c2 tempest-FlavorsV261TestJSON-614860814 tempest-FlavorsV261TestJSON-614860814-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:00.809247 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ec92b8e9-4e5f-4677-ad8a-e8850a13d1c2 tempest-FlavorsV261TestJSON-614860814 tempest-FlavorsV261TestJSON-614860814-project] 10.222.0.46 "GET /compute/v2.1/flavors/1539555813" status: 200 len: 468 microversion: 2.61 time: 0.324974 Jan 15 20:55:00.811581 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 930/1933] 10.222.0.46 () {60 vars in 1198 bytes} [Sat Jan 15 20:55:00 2022] GET /compute/v2.1/flavors/1539555813 => generated 468 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 20:55:00.816230 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-aab6ce7a-e0c2-4e6a-a76b-c0be4c639d45 req-5dda188c-1de2-4f45-81d6-16669e78e26e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "427db3d9-56d4-49ff-a4f1-28302d78f56a", "name": "network-vif-plugged", "status": "completed", "tag": "07cc6e79-5c17-40cf-b596-8367f1d2319e"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:55:00.818312 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:55:00.818312 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:55:00.826338 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-aab6ce7a-e0c2-4e6a-a76b-c0be4c639d45 req-5dda188c-1de2-4f45-81d6-16669e78e26e service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:00.827047 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-aab6ce7a-e0c2-4e6a-a76b-c0be4c639d45 req-5dda188c-1de2-4f45-81d6-16669e78e26e service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:00.838745 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-aab6ce7a-e0c2-4e6a-a76b-c0be4c639d45 req-5dda188c-1de2-4f45-81d6-16669e78e26e service nova] Creating event network-vif-plugged:07cc6e79-5c17-40cf-b596-8367f1d2319e for instance 427db3d9-56d4-49ff-a4f1-28302d78f56a on nch2-master-1 Jan 15 20:55:00.845915 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-aab6ce7a-e0c2-4e6a-a76b-c0be4c639d45 req-5dda188c-1de2-4f45-81d6-16669e78e26e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033012 Jan 15 20:55:00.847051 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 931/1934] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:55:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:55:01.021454 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2e8830e4-3eaf-4a04-832a-6fd5696738b8 tempest-KeyPairsV22TestJSON-375510187 tempest-KeyPairsV22TestJSON-375510187-project] Action: 'create', calling method: .version_select at 0x7f30c8d94670>, body: {"keypair": {"name": "tempest-keypair-967851013"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:55:01.097174 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-2e8830e4-3eaf-4a04-832a-6fd5696738b8 tempest-KeyPairsV22TestJSON-375510187 tempest-KeyPairsV22TestJSON-375510187-project] Getting quotas for project c849974ff33d4bbb82ed2c33fe57029a. Resources: {'key_pairs'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:55:01.106640 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-2e8830e4-3eaf-4a04-832a-6fd5696738b8 tempest-KeyPairsV22TestJSON-375510187 tempest-KeyPairsV22TestJSON-375510187-project] Getting quotas for user a38b8e16857b4c57ac8e500e4bd53294 and project c849974ff33d4bbb82ed2c33fe57029a. Resources: {'key_pairs'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:55:01.317241 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-2e8830e4-3eaf-4a04-832a-6fd5696738b8 tempest-KeyPairsV22TestJSON-375510187 tempest-KeyPairsV22TestJSON-375510187-project] Getting quotas for project c849974ff33d4bbb82ed2c33fe57029a. Resources: {'key_pairs'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:55:01.326218 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-2e8830e4-3eaf-4a04-832a-6fd5696738b8 tempest-KeyPairsV22TestJSON-375510187 tempest-KeyPairsV22TestJSON-375510187-project] Getting quotas for user a38b8e16857b4c57ac8e500e4bd53294 and project c849974ff33d4bbb82ed2c33fe57029a. Resources: {'key_pairs'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:55:01.363106 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2e8830e4-3eaf-4a04-832a-6fd5696738b8 tempest-KeyPairsV22TestJSON-375510187 tempest-KeyPairsV22TestJSON-375510187-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.2 time: 0.514452 Jan 15 20:55:01.370590 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 932/1935] 10.222.0.46 () {62 vars in 1197 bytes} [Sat Jan 15 20:55:00 2022] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 523 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Jan 15 20:55:01.394742 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-64763e3b-e259-46d3-b37b-c0effcd4c8db tempest-FlavorsV261TestJSON-602304126 tempest-FlavorsV261TestJSON-602304126-project-admin] Action: 'update', calling method: .version_select at 0x7f30cbbe8670>, body: {"flavor": {"description": "new"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:55:01.411666 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:55:01.411666 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:55:01.462930 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-64763e3b-e259-46d3-b37b-c0effcd4c8db tempest-FlavorsV261TestJSON-602304126 tempest-FlavorsV261TestJSON-602304126-project-admin] 10.222.0.46 "PUT /compute/v2.1/flavors/1539555813" status: 200 len: 469 microversion: 2.61 time: 0.090737 Jan 15 20:55:01.468648 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 933/1936] 10.222.0.46 () {62 vars in 1218 bytes} [Sat Jan 15 20:55:01 2022] PUT /compute/v2.1/flavors/1539555813 => generated 469 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:55:01.479398 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ff08b5fc-6b55-4baf-8efd-54974ef07d6f tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:01.480481 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ff08b5fc-6b55-4baf-8efd-54974ef07d6f tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: 427db3d9-56d4-49ff-a4f1-28302d78f56a] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:55:01.491244 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ff08b5fc-6b55-4baf-8efd-54974ef07d6f tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:01.492235 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ff08b5fc-6b55-4baf-8efd-54974ef07d6f tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:01.493374 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ff08b5fc-6b55-4baf-8efd-54974ef07d6f tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:01.494138 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ff08b5fc-6b55-4baf-8efd-54974ef07d6f tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:02.110234 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-ff08b5fc-6b55-4baf-8efd-54974ef07d6f tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:55:02.122720 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ff08b5fc-6b55-4baf-8efd-54974ef07d6f tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/427db3d9-56d4-49ff-a4f1-28302d78f56a" status: 200 len: 1315 microversion: 2.1 time: 0.651931 Jan 15 20:55:02.127069 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 934/1937] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:55:01 2022] GET /compute/v2.1/servers/427db3d9-56d4-49ff-a4f1-28302d78f56a => generated 1315 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:55:02.131800 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ed38bed8-1eb4-4e4f-94ee-668bfcd47bff tempest-KeyPairsV22TestJSON-375510187 tempest-KeyPairsV22TestJSON-375510187-project] Calling method '.version_select at 0x7f30ceb5f820>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:02.156893 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ed38bed8-1eb4-4e4f-94ee-668bfcd47bff tempest-KeyPairsV22TestJSON-375510187 tempest-KeyPairsV22TestJSON-375510187-project] 10.222.0.46 "GET /compute/v2.1/os-keypairs/tempest-keypair-967851013" status: 200 len: 705 microversion: 2.2 time: 0.028642 Jan 15 20:55:02.157505 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 935/1938] 10.222.0.46 () {60 vars in 1254 bytes} [Sat Jan 15 20:55:02 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-967851013 => generated 705 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:55:02.166491 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e88589fd-b770-4408-b944-2b6ee2493490 tempest-FlavorsV261TestJSON-614860814 tempest-FlavorsV261TestJSON-614860814-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:02.192714 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e88589fd-b770-4408-b944-2b6ee2493490 tempest-FlavorsV261TestJSON-614860814 tempest-FlavorsV261TestJSON-614860814-project] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 6250 microversion: 2.61 time: 0.034031 Jan 15 20:55:02.205767 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 936/1939] 10.222.0.46 () {60 vars in 1186 bytes} [Sat Jan 15 20:55:02 2022] GET /compute/v2.1/flavors/detail => generated 6250 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:55:02.210704 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-fa55212f-e144-4bb8-8f05-e52c0eb6f746 tempest-KeyPairsV22TestJSON-375510187 tempest-KeyPairsV22TestJSON-375510187-project] Calling method '.version_select at 0x7f30c8d940d0>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:02.241966 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-fa55212f-e144-4bb8-8f05-e52c0eb6f746 tempest-KeyPairsV22TestJSON-375510187 tempest-KeyPairsV22TestJSON-375510187-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-967851013" status: 204 len: 0 microversion: 2.2 time: 0.032758 Jan 15 20:55:02.243174 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 937/1940] 10.222.0.46 () {60 vars in 1257 bytes} [Sat Jan 15 20:55:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-967851013 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 20:55:02.252503 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f7f7deca-a852-47ea-af3c-01177c589a1a tempest-FlavorsV261TestJSON-614860814 tempest-FlavorsV261TestJSON-614860814-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:02.303709 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f7f7deca-a852-47ea-af3c-01177c589a1a tempest-FlavorsV261TestJSON-614860814 tempest-FlavorsV261TestJSON-614860814-project] 10.222.0.46 "GET /compute/v2.1/flavors" status: 200 len: 3157 microversion: 2.61 time: 0.059067 Jan 15 20:55:02.308019 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 938/1941] 10.222.0.46 () {60 vars in 1165 bytes} [Sat Jan 15 20:55:02 2022] GET /compute/v2.1/flavors => generated 3157 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:55:02.325265 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-64526ad2-35e6-4b98-9edc-91ace69ce561 tempest-KeyPairsV22TestJSON-375510187 tempest-KeyPairsV22TestJSON-375510187-project] Action: 'create', calling method: .version_select at 0x7f30ceb58700>, body: {"keypair": {"name": "tempest-keypair-1918890771"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:55:02.368229 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-64526ad2-35e6-4b98-9edc-91ace69ce561 tempest-KeyPairsV22TestJSON-375510187 tempest-KeyPairsV22TestJSON-375510187-project] Getting quotas for project c849974ff33d4bbb82ed2c33fe57029a. Resources: {'key_pairs'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:55:02.378445 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-64526ad2-35e6-4b98-9edc-91ace69ce561 tempest-KeyPairsV22TestJSON-375510187 tempest-KeyPairsV22TestJSON-375510187-project] Getting quotas for user a38b8e16857b4c57ac8e500e4bd53294 and project c849974ff33d4bbb82ed2c33fe57029a. Resources: {'key_pairs'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:55:02.745986 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-64526ad2-35e6-4b98-9edc-91ace69ce561 tempest-KeyPairsV22TestJSON-375510187 tempest-KeyPairsV22TestJSON-375510187-project] Getting quotas for project c849974ff33d4bbb82ed2c33fe57029a. Resources: {'key_pairs'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:55:02.753504 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-64526ad2-35e6-4b98-9edc-91ace69ce561 tempest-KeyPairsV22TestJSON-375510187 tempest-KeyPairsV22TestJSON-375510187-project] Getting quotas for user a38b8e16857b4c57ac8e500e4bd53294 and project c849974ff33d4bbb82ed2c33fe57029a. Resources: {'key_pairs'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:55:02.773242 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-64526ad2-35e6-4b98-9edc-91ace69ce561 tempest-KeyPairsV22TestJSON-375510187 tempest-KeyPairsV22TestJSON-375510187-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.2 time: 0.461414 Jan 15 20:55:02.775004 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 939/1942] 10.222.0.46 () {62 vars in 1197 bytes} [Sat Jan 15 20:55:02 2022] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 465 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Jan 15 20:55:02.782417 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-988b875d-3bd5-45a4-9e18-37fe72aa9de2 tempest-FlavorsV261TestJSON-602304126 tempest-FlavorsV261TestJSON-602304126-project-admin] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:02.783449 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:55:02.783449 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:55:02.808787 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-988b875d-3bd5-45a4-9e18-37fe72aa9de2 tempest-FlavorsV261TestJSON-602304126 tempest-FlavorsV261TestJSON-602304126-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/1539555813" status: 202 len: 0 microversion: 2.61 time: 0.032675 Jan 15 20:55:02.810017 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 940/1943] 10.222.0.46 () {60 vars in 1201 bytes} [Sat Jan 15 20:55:02 2022] DELETE /compute/v2.1/flavors/1539555813 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 15 20:55:02.816299 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-429cb027-8dee-456b-9cc6-2ccc38ef176f tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-1514659738", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "77920bd4-7261-421c-ba8f-4e4aa10b2090"}], "security_groups": [{"name": "tempest-securitygroup--1381211952"}], "key_name": "tempest-keypair-1897593836", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:55:03.172747 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.network.neutron [None req-429cb027-8dee-456b-9cc6-2ccc38ef176f tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] validate_networks() for [('77920bd4-7261-421c-ba8f-4e4aa10b2090', None, None, None, None, None)] {{(pid=129365) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 20:55:05.338548 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ed30b411-29a4-4f5f-8ab5-d5c96613f1d6 tempest-FloatingIPDetailsTestJSON-205108975 tempest-FloatingIPDetailsTestJSON-205108975-project] 10.222.0.46 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 6.079628 Jan 15 20:55:05.345079 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1004/1944] 10.222.0.46 () {60 vars in 1169 bytes} [Sat Jan 15 20:54:59 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 6081 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 20:55:05.345749 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1e8e398e-77a0-4081-9343-9e7d99232faa tempest-KeyPairsV22TestJSON-375510187 tempest-KeyPairsV22TestJSON-375510187-project] Calling method '.version_select at 0x7f30cecdb670>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:05.383818 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-1e8e398e-77a0-4081-9343-9e7d99232faa tempest-KeyPairsV22TestJSON-375510187 tempest-KeyPairsV22TestJSON-375510187-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1918890771" status: 204 len: 0 microversion: 2.2 time: 0.043168 Jan 15 20:55:05.389110 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1005/1945] 10.222.0.46 () {60 vars in 1260 bytes} [Sat Jan 15 20:55:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1918890771 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 20:55:05.395642 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-97932482-5d35-46b9-9fba-0b02a93c9276 tempest-FlavorsV261TestJSON-602304126 tempest-FlavorsV261TestJSON-602304126-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:05.440110 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-429cb027-8dee-456b-9cc6-2ccc38ef176f tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Getting quotas for project 964edbaeb4c944cfb68578886695266c. Resources: dict_keys(['metadata_items']) {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:55:05.446925 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-97932482-5d35-46b9-9fba-0b02a93c9276 tempest-FlavorsV261TestJSON-602304126 tempest-FlavorsV261TestJSON-602304126-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 5791 microversion: 2.61 time: 0.060887 Jan 15 20:55:05.457513 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1006/1946] 10.222.0.46 () {60 vars in 1186 bytes} [Sat Jan 15 20:55:05 2022] GET /compute/v2.1/flavors/detail => generated 5791 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:55:05.460810 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-429cb027-8dee-456b-9cc6-2ccc38ef176f tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Getting quotas for user 4c0085c7fa1d44e58b20181319ea00f4 and project 964edbaeb4c944cfb68578886695266c. Resources: dict_keys(['metadata_items']) {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:55:05.480028 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e08f7bce-6242-46e2-9c98-4f972b0898f3 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:05.480647 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e08f7bce-6242-46e2-9c98-4f972b0898f3 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: 427db3d9-56d4-49ff-a4f1-28302d78f56a] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:55:05.487884 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e08f7bce-6242-46e2-9c98-4f972b0898f3 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:05.496117 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e08f7bce-6242-46e2-9c98-4f972b0898f3 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:05.497891 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e08f7bce-6242-46e2-9c98-4f972b0898f3 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:05.499276 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e08f7bce-6242-46e2-9c98-4f972b0898f3 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:05.519288 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-429cb027-8dee-456b-9cc6-2ccc38ef176f tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Flavor limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 20:55:05.519743 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-429cb027-8dee-456b-9cc6-2ccc38ef176f tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Image limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 20:55:05.520231 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-429cb027-8dee-456b-9cc6-2ccc38ef176f tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Flavor pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 20:55:05.527463 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-429cb027-8dee-456b-9cc6-2ccc38ef176f tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Image pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 20:55:05.527961 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-429cb027-8dee-456b-9cc6-2ccc38ef176f tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 20:55:05.570518 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-429cb027-8dee-456b-9cc6-2ccc38ef176f tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:05.570981 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-429cb027-8dee-456b-9cc6-2ccc38ef176f tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:05.571863 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-429cb027-8dee-456b-9cc6-2ccc38ef176f tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:05.572296 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-429cb027-8dee-456b-9cc6-2ccc38ef176f tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:05.630453 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-429cb027-8dee-456b-9cc6-2ccc38ef176f tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Getting quotas for project 964edbaeb4c944cfb68578886695266c. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:55:05.655114 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-429cb027-8dee-456b-9cc6-2ccc38ef176f tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Getting quotas for user 4c0085c7fa1d44e58b20181319ea00f4 and project 964edbaeb4c944cfb68578886695266c. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:55:05.695672 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-429cb027-8dee-456b-9cc6-2ccc38ef176f tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Going to run 1 instances... {{(pid=129365) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 20:55:05.705065 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-429cb027-8dee-456b-9cc6-2ccc38ef176f tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] [instance: b1eb0bef-5aaf-46d6-8739-b12303df9842] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129365) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 20:55:05.781199 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-e08f7bce-6242-46e2-9c98-4f972b0898f3 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:55:05.802614 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-429cb027-8dee-456b-9cc6-2ccc38ef176f tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.991245 Jan 15 20:55:05.803991 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 941/1947] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 20:55:02 2022] POST /compute/v2.1/servers => generated 409 bytes in 2993 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 20:55:05.822070 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e08f7bce-6242-46e2-9c98-4f972b0898f3 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/427db3d9-56d4-49ff-a4f1-28302d78f56a" status: 200 len: 1501 microversion: 2.1 time: 0.362253 Jan 15 20:55:05.824658 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1007/1948] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:55:05 2022] GET /compute/v2.1/servers/427db3d9-56d4-49ff-a4f1-28302d78f56a => generated 1501 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:55:05.831741 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9645eaf7-87af-429f-9c34-656d9723cec3 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-914692441", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b7ee6eaf-eda1-43c9-9d45-4bb747012a97"}]}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:55:05.851221 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-dcef30df-0031-4a4f-bf0d-1c59ddf9f570 tempest-FloatingIPDetailsTestJSON-205108975 tempest-FloatingIPDetailsTestJSON-205108975-project] Action: 'create', calling method: .version_select at 0x7f30c8e35f70>, body: {"pool": null} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:55:05.943221 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.network.neutron [None req-9645eaf7-87af-429f-9c34-656d9723cec3 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] validate_networks() for [('b7ee6eaf-eda1-43c9-9d45-4bb747012a97', None, None, None, None, None)] {{(pid=129365) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 20:55:07.048778 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-9645eaf7-87af-429f-9c34-656d9723cec3 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Flavor limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 20:55:07.049483 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-9645eaf7-87af-429f-9c34-656d9723cec3 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Image limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 20:55:07.049962 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-9645eaf7-87af-429f-9c34-656d9723cec3 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Flavor pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 20:55:07.050554 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-9645eaf7-87af-429f-9c34-656d9723cec3 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Image pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 20:55:07.051042 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-9645eaf7-87af-429f-9c34-656d9723cec3 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 20:55:07.067485 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9645eaf7-87af-429f-9c34-656d9723cec3 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:07.068099 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9645eaf7-87af-429f-9c34-656d9723cec3 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:07.069144 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9645eaf7-87af-429f-9c34-656d9723cec3 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:07.072886 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9645eaf7-87af-429f-9c34-656d9723cec3 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:07.134447 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-9645eaf7-87af-429f-9c34-656d9723cec3 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Getting quotas for project f6d5d92c87544c4d8080e19c1f6429bf. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:55:07.150792 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-9645eaf7-87af-429f-9c34-656d9723cec3 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Getting quotas for user 2e1b423e1a9146c8bb202ba012e2ee2a and project f6d5d92c87544c4d8080e19c1f6429bf. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:55:07.179521 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-9645eaf7-87af-429f-9c34-656d9723cec3 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Going to run 1 instances... {{(pid=129365) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 20:55:07.183319 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-9645eaf7-87af-429f-9c34-656d9723cec3 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] [instance: 39b25eb1-ffab-417c-b47d-893dabb85d7c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129365) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 20:55:07.259745 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-9645eaf7-87af-429f-9c34-656d9723cec3 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.453804 Jan 15 20:55:07.261420 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 942/1949] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 20:55:05 2022] POST /compute/v2.1/servers => generated 383 bytes in 1456 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 20:55:07.272855 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2f776b7a-98e0-4921-a165-5093a33c0935 tempest-KeyPairsV22TestJSON-375510187 tempest-KeyPairsV22TestJSON-375510187-project] Action: 'create', calling method: .version_select at 0x7f30c913bf70>, body: {"keypair": {"name": "tempest-keypair-1815419956", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:55:07.298768 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-2f776b7a-98e0-4921-a165-5093a33c0935 tempest-KeyPairsV22TestJSON-375510187 tempest-KeyPairsV22TestJSON-375510187-project] Getting quotas for project c849974ff33d4bbb82ed2c33fe57029a. Resources: {'key_pairs'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:55:07.325033 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-2f776b7a-98e0-4921-a165-5093a33c0935 tempest-KeyPairsV22TestJSON-375510187 tempest-KeyPairsV22TestJSON-375510187-project] Getting quotas for user a38b8e16857b4c57ac8e500e4bd53294 and project c849974ff33d4bbb82ed2c33fe57029a. Resources: {'key_pairs'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:55:07.397755 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2f776b7a-98e0-4921-a165-5093a33c0935 tempest-KeyPairsV22TestJSON-375510187 tempest-KeyPairsV22TestJSON-375510187-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 201 len: 589 microversion: 2.2 time: 0.134961 Jan 15 20:55:07.401321 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 943/1950] 10.222.0.46 () {62 vars in 1198 bytes} [Sat Jan 15 20:55:07 2022] POST /compute/v2.1/os-keypairs => generated 589 bytes in 139 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jan 15 20:55:07.409859 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-85bf2d9c-442c-4c2a-99fd-c0f16c97bf3b tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:07.410684 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-85bf2d9c-442c-4c2a-99fd-c0f16c97bf3b tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] [instance: b1eb0bef-5aaf-46d6-8739-b12303df9842] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:55:07.422277 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-85bf2d9c-442c-4c2a-99fd-c0f16c97bf3b tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:07.423634 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-85bf2d9c-442c-4c2a-99fd-c0f16c97bf3b tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:07.424985 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-85bf2d9c-442c-4c2a-99fd-c0f16c97bf3b tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:07.425589 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-85bf2d9c-442c-4c2a-99fd-c0f16c97bf3b tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:07.509689 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-85bf2d9c-442c-4c2a-99fd-c0f16c97bf3b tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c0085c7fa1d44e58b20181319ea00f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '964edbaeb4c944cfb68578886695266c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:55:07.519774 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-85bf2d9c-442c-4c2a-99fd-c0f16c97bf3b tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] 10.222.0.46 "GET /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842" status: 200 len: 1330 microversion: 2.1 time: 0.116992 Jan 15 20:55:07.520378 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 944/1951] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:55:07 2022] GET /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842 => generated 1330 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:55:07.555739 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-037ea923-9e55-4f7f-a287-fae323a9edf6 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:07.556290 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-037ea923-9e55-4f7f-a287-fae323a9edf6 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: 427db3d9-56d4-49ff-a4f1-28302d78f56a] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:55:07.564570 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-037ea923-9e55-4f7f-a287-fae323a9edf6 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:07.565234 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-037ea923-9e55-4f7f-a287-fae323a9edf6 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:07.566062 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-037ea923-9e55-4f7f-a287-fae323a9edf6 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:07.566430 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-037ea923-9e55-4f7f-a287-fae323a9edf6 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:07.599720 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-037ea923-9e55-4f7f-a287-fae323a9edf6 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: 427db3d9-56d4-49ff-a4f1-28302d78f56a] Going to try to terminate instance {{(pid=129365) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 20:55:07.789104 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-037ea923-9e55-4f7f-a287-fae323a9edf6 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "DELETE /compute/v2.1/servers/427db3d9-56d4-49ff-a4f1-28302d78f56a" status: 204 len: 0 microversion: 2.1 time: 0.241328 Jan 15 20:55:07.795189 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 945/1952] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 20:55:07 2022] DELETE /compute/v2.1/servers/427db3d9-56d4-49ff-a4f1-28302d78f56a => generated 0 bytes in 273 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 20:55:07.803734 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-4607c98b-a20e-4d50-a944-3509ef67d207 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:07.805474 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-4607c98b-a20e-4d50-a944-3509ef67d207 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] [instance: 39b25eb1-ffab-417c-b47d-893dabb85d7c] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:55:07.957102 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-4607c98b-a20e-4d50-a944-3509ef67d207 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e1b423e1a9146c8bb202ba012e2ee2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d5d92c87544c4d8080e19c1f6429bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:55:07.965397 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-4607c98b-a20e-4d50-a944-3509ef67d207 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] 10.222.0.46 "GET /compute/v2.1/servers/39b25eb1-ffab-417c-b47d-893dabb85d7c" status: 200 len: 1224 microversion: 2.1 time: 0.168291 Jan 15 20:55:07.979668 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 946/1953] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:55:07 2022] GET /compute/v2.1/servers/39b25eb1-ffab-417c-b47d-893dabb85d7c => generated 1224 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:55:07.993250 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-0ca24901-9554-4b4a-bb8c-7d4ee813dcc4 tempest-KeyPairsV22TestJSON-375510187 tempest-KeyPairsV22TestJSON-375510187-project] Calling method '.version_select at 0x7f30ceb9f160>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:08.029045 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-0ca24901-9554-4b4a-bb8c-7d4ee813dcc4 tempest-KeyPairsV22TestJSON-375510187 tempest-KeyPairsV22TestJSON-375510187-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1815419956" status: 204 len: 0 microversion: 2.2 time: 0.047574 Jan 15 20:55:08.035545 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 947/1954] 10.222.0.46 () {60 vars in 1260 bytes} [Sat Jan 15 20:55:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1815419956 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 20:55:08.042175 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a1894219-c841-4049-afe2-cab5bf5212ae tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:08.043466 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a1894219-c841-4049-afe2-cab5bf5212ae tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: 427db3d9-56d4-49ff-a4f1-28302d78f56a] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:55:08.056331 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a1894219-c841-4049-afe2-cab5bf5212ae tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:08.057033 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a1894219-c841-4049-afe2-cab5bf5212ae tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:08.058646 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a1894219-c841-4049-afe2-cab5bf5212ae tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:08.059326 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a1894219-c841-4049-afe2-cab5bf5212ae tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:08.763697 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-a1894219-c841-4049-afe2-cab5bf5212ae tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:55:08.776683 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a1894219-c841-4049-afe2-cab5bf5212ae tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/427db3d9-56d4-49ff-a4f1-28302d78f56a" status: 200 len: 1507 microversion: 2.1 time: 0.738579 Jan 15 20:55:08.794090 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 948/1955] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:55:08 2022] GET /compute/v2.1/servers/427db3d9-56d4-49ff-a4f1-28302d78f56a => generated 1507 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:55:08.800860 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c4476fa3-1e3d-4f01-8ebe-f59f025e044a tempest-KeyPairsV22TestJSON-375510187 tempest-KeyPairsV22TestJSON-375510187-project] Action: 'create', calling method: .version_select at 0x7f30ceb32ee0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-224676190"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:55:08.818416 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-c4476fa3-1e3d-4f01-8ebe-f59f025e044a tempest-KeyPairsV22TestJSON-375510187 tempest-KeyPairsV22TestJSON-375510187-project] Getting quotas for project c849974ff33d4bbb82ed2c33fe57029a. Resources: {'key_pairs'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:55:08.826712 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-c4476fa3-1e3d-4f01-8ebe-f59f025e044a tempest-KeyPairsV22TestJSON-375510187 tempest-KeyPairsV22TestJSON-375510187-project] Getting quotas for user a38b8e16857b4c57ac8e500e4bd53294 and project c849974ff33d4bbb82ed2c33fe57029a. Resources: {'key_pairs'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:55:08.989576 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-c4476fa3-1e3d-4f01-8ebe-f59f025e044a tempest-KeyPairsV22TestJSON-375510187 tempest-KeyPairsV22TestJSON-375510187-project] Getting quotas for project c849974ff33d4bbb82ed2c33fe57029a. Resources: {'key_pairs'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:55:09.027122 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-c4476fa3-1e3d-4f01-8ebe-f59f025e044a tempest-KeyPairsV22TestJSON-375510187 tempest-KeyPairsV22TestJSON-375510187-project] Getting quotas for user a38b8e16857b4c57ac8e500e4bd53294 and project c849974ff33d4bbb82ed2c33fe57029a. Resources: {'key_pairs'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:55:09.085759 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c4476fa3-1e3d-4f01-8ebe-f59f025e044a tempest-KeyPairsV22TestJSON-375510187 tempest-KeyPairsV22TestJSON-375510187-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 201 len: 2339 microversion: 2.2 time: 0.289974 Jan 15 20:55:09.086420 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 949/1956] 10.222.0.46 () {62 vars in 1197 bytes} [Sat Jan 15 20:55:08 2022] POST /compute/v2.1/os-keypairs => generated 2339 bytes in 291 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Jan 15 20:55:09.105685 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-903ee074-57e2-416f-8c2c-4757a5218c8e tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:09.106312 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-903ee074-57e2-416f-8c2c-4757a5218c8e tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] [instance: b1eb0bef-5aaf-46d6-8739-b12303df9842] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:55:09.124943 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-903ee074-57e2-416f-8c2c-4757a5218c8e tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:09.125557 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-903ee074-57e2-416f-8c2c-4757a5218c8e tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:09.126441 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-903ee074-57e2-416f-8c2c-4757a5218c8e tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:09.127088 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-903ee074-57e2-416f-8c2c-4757a5218c8e tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:09.159687 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-dcef30df-0031-4a4f-bf0d-1c59ddf9f570 tempest-FloatingIPDetailsTestJSON-205108975 tempest-FloatingIPDetailsTestJSON-205108975-project] 10.222.0.46 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.331536 Jan 15 20:55:09.160292 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1008/1957] 10.222.0.46 () {60 vars in 1169 bytes} [Sat Jan 15 20:55:05 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:55:09.166232 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e3daff8b-b9f7-4a68-927d-6c7dc21373bc tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:09.167258 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e3daff8b-b9f7-4a68-927d-6c7dc21373bc tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] [instance: 39b25eb1-ffab-417c-b47d-893dabb85d7c] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:55:09.183833 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e3daff8b-b9f7-4a68-927d-6c7dc21373bc tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:09.184647 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e3daff8b-b9f7-4a68-927d-6c7dc21373bc tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:09.186455 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e3daff8b-b9f7-4a68-927d-6c7dc21373bc tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:09.188280 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e3daff8b-b9f7-4a68-927d-6c7dc21373bc tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:09.296196 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-903ee074-57e2-416f-8c2c-4757a5218c8e tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c0085c7fa1d44e58b20181319ea00f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '964edbaeb4c944cfb68578886695266c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:55:09.311491 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-903ee074-57e2-416f-8c2c-4757a5218c8e tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] 10.222.0.46 "GET /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842" status: 200 len: 1336 microversion: 2.1 time: 0.220303 Jan 15 20:55:09.312389 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 950/1958] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:55:09 2022] GET /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842 => generated 1336 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:55:09.322966 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-520de026-9f92-4432-a71d-20fffb110870 tempest-KeyPairsV22TestJSON-375510187 tempest-KeyPairsV22TestJSON-375510187-project] Action: 'create', calling method: .version_select at 0x7f30ceb32790>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1491871784"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:55:09.338607 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-e3daff8b-b9f7-4a68-927d-6c7dc21373bc tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e1b423e1a9146c8bb202ba012e2ee2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d5d92c87544c4d8080e19c1f6429bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:55:09.348160 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-520de026-9f92-4432-a71d-20fffb110870 tempest-KeyPairsV22TestJSON-375510187 tempest-KeyPairsV22TestJSON-375510187-project] Getting quotas for project c849974ff33d4bbb82ed2c33fe57029a. Resources: {'key_pairs'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:55:09.352265 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e3daff8b-b9f7-4a68-927d-6c7dc21373bc tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] 10.222.0.46 "GET /compute/v2.1/servers/39b25eb1-ffab-417c-b47d-893dabb85d7c" status: 200 len: 1294 microversion: 2.1 time: 0.188314 Jan 15 20:55:09.353973 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1009/1959] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:55:09 2022] GET /compute/v2.1/servers/39b25eb1-ffab-417c-b47d-893dabb85d7c => generated 1294 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:55:09.359810 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7edcfe06-cc59-42d3-ad89-a2eb06fd15c1 tempest-FloatingIPDetailsTestJSON-205108975 tempest-FloatingIPDetailsTestJSON-205108975-project] Action: 'create', calling method: .version_select at 0x7f30cece1160>, body: {"pool": null} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:55:09.360526 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-520de026-9f92-4432-a71d-20fffb110870 tempest-KeyPairsV22TestJSON-375510187 tempest-KeyPairsV22TestJSON-375510187-project] Getting quotas for user a38b8e16857b4c57ac8e500e4bd53294 and project c849974ff33d4bbb82ed2c33fe57029a. Resources: {'key_pairs'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:55:09.678624 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-520de026-9f92-4432-a71d-20fffb110870 tempest-KeyPairsV22TestJSON-375510187 tempest-KeyPairsV22TestJSON-375510187-project] Getting quotas for project c849974ff33d4bbb82ed2c33fe57029a. Resources: {'key_pairs'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:55:09.687083 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-520de026-9f92-4432-a71d-20fffb110870 tempest-KeyPairsV22TestJSON-375510187 tempest-KeyPairsV22TestJSON-375510187-project] Getting quotas for user a38b8e16857b4c57ac8e500e4bd53294 and project c849974ff33d4bbb82ed2c33fe57029a. Resources: {'key_pairs'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:55:09.709785 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-520de026-9f92-4432-a71d-20fffb110870 tempest-KeyPairsV22TestJSON-375510187 tempest-KeyPairsV22TestJSON-375510187-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 201 len: 2340 microversion: 2.2 time: 0.391245 Jan 15 20:55:09.710594 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 951/1960] 10.222.0.46 () {62 vars in 1197 bytes} [Sat Jan 15 20:55:09 2022] POST /compute/v2.1/os-keypairs => generated 2340 bytes in 398 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Jan 15 20:55:09.719911 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-0f594807-93a0-4a46-b9d1-63a5bc136478 tempest-KeyPairsV22TestJSON-375510187 tempest-KeyPairsV22TestJSON-375510187-project] Action: 'create', calling method: .version_select at 0x7f30ceb5e5e0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-708626431"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:55:09.744476 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-0f594807-93a0-4a46-b9d1-63a5bc136478 tempest-KeyPairsV22TestJSON-375510187 tempest-KeyPairsV22TestJSON-375510187-project] Getting quotas for project c849974ff33d4bbb82ed2c33fe57029a. Resources: {'key_pairs'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:55:09.751685 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-0f594807-93a0-4a46-b9d1-63a5bc136478 tempest-KeyPairsV22TestJSON-375510187 tempest-KeyPairsV22TestJSON-375510187-project] Getting quotas for user a38b8e16857b4c57ac8e500e4bd53294 and project c849974ff33d4bbb82ed2c33fe57029a. Resources: {'key_pairs'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:55:10.346071 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-0f594807-93a0-4a46-b9d1-63a5bc136478 tempest-KeyPairsV22TestJSON-375510187 tempest-KeyPairsV22TestJSON-375510187-project] Getting quotas for project c849974ff33d4bbb82ed2c33fe57029a. Resources: {'key_pairs'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:55:10.364321 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-0f594807-93a0-4a46-b9d1-63a5bc136478 tempest-KeyPairsV22TestJSON-375510187 tempest-KeyPairsV22TestJSON-375510187-project] Getting quotas for user a38b8e16857b4c57ac8e500e4bd53294 and project c849974ff33d4bbb82ed2c33fe57029a. Resources: {'key_pairs'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:55:10.413498 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-0f594807-93a0-4a46-b9d1-63a5bc136478 tempest-KeyPairsV22TestJSON-375510187 tempest-KeyPairsV22TestJSON-375510187-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 201 len: 2339 microversion: 2.2 time: 0.697174 Jan 15 20:55:10.419825 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 952/1961] 10.222.0.46 () {62 vars in 1197 bytes} [Sat Jan 15 20:55:09 2022] POST /compute/v2.1/os-keypairs => generated 2339 bytes in 699 msecs (HTTP/1.1 201) 9 headers in 363 bytes (2 switches on core 0) Jan 15 20:55:10.438589 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e7d9e821-2eee-4a31-a90e-94bfe884434d tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:10.443601 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e7d9e821-2eee-4a31-a90e-94bfe884434d tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: 427db3d9-56d4-49ff-a4f1-28302d78f56a] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:55:10.458766 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e7d9e821-2eee-4a31-a90e-94bfe884434d tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:10.459397 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e7d9e821-2eee-4a31-a90e-94bfe884434d tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:10.460263 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e7d9e821-2eee-4a31-a90e-94bfe884434d tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:10.460941 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e7d9e821-2eee-4a31-a90e-94bfe884434d tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:11.153844 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-e7d9e821-2eee-4a31-a90e-94bfe884434d tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:55:11.168154 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e7d9e821-2eee-4a31-a90e-94bfe884434d tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/427db3d9-56d4-49ff-a4f1-28302d78f56a" status: 200 len: 1507 microversion: 2.1 time: 0.748112 Jan 15 20:55:11.171308 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 953/1962] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:55:10 2022] GET /compute/v2.1/servers/427db3d9-56d4-49ff-a4f1-28302d78f56a => generated 1507 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:55:11.176431 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-be4b8195-65b7-4904-afba-9417c4593118 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:11.177737 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-be4b8195-65b7-4904-afba-9417c4593118 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] [instance: b1eb0bef-5aaf-46d6-8739-b12303df9842] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:55:11.190714 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-be4b8195-65b7-4904-afba-9417c4593118 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:11.191451 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-be4b8195-65b7-4904-afba-9417c4593118 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:11.192915 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-be4b8195-65b7-4904-afba-9417c4593118 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:11.194035 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-be4b8195-65b7-4904-afba-9417c4593118 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:11.557123 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-be4b8195-65b7-4904-afba-9417c4593118 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c0085c7fa1d44e58b20181319ea00f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '964edbaeb4c944cfb68578886695266c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:55:11.565775 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-be4b8195-65b7-4904-afba-9417c4593118 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] 10.222.0.46 "GET /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842" status: 200 len: 1404 microversion: 2.1 time: 0.393248 Jan 15 20:55:11.586337 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 954/1963] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:55:11 2022] GET /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842 => generated 1404 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:55:11.596236 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5022064b-917a-4b73-bde2-8f6d7557e0c8 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:11.598612 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-5022064b-917a-4b73-bde2-8f6d7557e0c8 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] [instance: 39b25eb1-ffab-417c-b47d-893dabb85d7c] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:55:11.620977 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5022064b-917a-4b73-bde2-8f6d7557e0c8 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:11.622934 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5022064b-917a-4b73-bde2-8f6d7557e0c8 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:11.624463 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5022064b-917a-4b73-bde2-8f6d7557e0c8 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:11.626378 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5022064b-917a-4b73-bde2-8f6d7557e0c8 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:11.832674 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-5022064b-917a-4b73-bde2-8f6d7557e0c8 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e1b423e1a9146c8bb202ba012e2ee2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d5d92c87544c4d8080e19c1f6429bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:55:11.841486 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5022064b-917a-4b73-bde2-8f6d7557e0c8 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] 10.222.0.46 "GET /compute/v2.1/servers/39b25eb1-ffab-417c-b47d-893dabb85d7c" status: 200 len: 1282 microversion: 2.1 time: 0.253672 Jan 15 20:55:11.844412 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 955/1964] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:55:11 2022] GET /compute/v2.1/servers/39b25eb1-ffab-417c-b47d-893dabb85d7c => generated 1282 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:55:11.855673 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-fba66ce4-056d-4caf-96d9-ddaa30e1deec tempest-KeyPairsV22TestJSON-375510187 tempest-KeyPairsV22TestJSON-375510187-project] Calling method '.version_select at 0x7f30ceba7af0>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:11.864796 ncdv-master-1 devstack@n-api.service[129365]: WARNING oslo_db.sqlalchemy.utils [None req-fba66ce4-056d-4caf-96d9-ddaa30e1deec tempest-KeyPairsV22TestJSON-375510187 tempest-KeyPairsV22TestJSON-375510187-project] Unique keys not in sort_keys. The sorting order may be unstable. Jan 15 20:55:11.876424 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-fba66ce4-056d-4caf-96d9-ddaa30e1deec tempest-KeyPairsV22TestJSON-375510187 tempest-KeyPairsV22TestJSON-375510187-project] 10.222.0.46 "GET /compute/v2.1/os-keypairs" status: 200 len: 1722 microversion: 2.2 time: 0.029115 Jan 15 20:55:11.877747 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 956/1965] 10.222.0.46 () {60 vars in 1176 bytes} [Sat Jan 15 20:55:11 2022] GET /compute/v2.1/os-keypairs => generated 1722 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:55:11.884561 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-a48a4838-3d49-48e8-b51b-530d867e3680 req-27424d44-7785-4b0b-8fb2-2072097751d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "427db3d9-56d4-49ff-a4f1-28302d78f56a", "name": "network-vif-deleted", "tag": "07cc6e79-5c17-40cf-b596-8367f1d2319e"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:55:11.886721 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:55:11.886721 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:55:11.899102 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-a48a4838-3d49-48e8-b51b-530d867e3680 req-27424d44-7785-4b0b-8fb2-2072097751d7 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:11.899980 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-a48a4838-3d49-48e8-b51b-530d867e3680 req-27424d44-7785-4b0b-8fb2-2072097751d7 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:11.915276 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-a48a4838-3d49-48e8-b51b-530d867e3680 req-27424d44-7785-4b0b-8fb2-2072097751d7 service nova] Creating event network-vif-deleted:07cc6e79-5c17-40cf-b596-8367f1d2319e for instance 427db3d9-56d4-49ff-a4f1-28302d78f56a on nch2-master-1 Jan 15 20:55:11.925636 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-a48a4838-3d49-48e8-b51b-530d867e3680 req-27424d44-7785-4b0b-8fb2-2072097751d7 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045774 Jan 15 20:55:11.926704 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 957/1966] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:55:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:55:11.932406 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-881c31d2-5c42-42f9-b72e-641fbabaceeb tempest-KeyPairsV22TestJSON-375510187 tempest-KeyPairsV22TestJSON-375510187-project] Calling method '.version_select at 0x7f30ceafad30>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:11.963364 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-881c31d2-5c42-42f9-b72e-641fbabaceeb tempest-KeyPairsV22TestJSON-375510187 tempest-KeyPairsV22TestJSON-375510187-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-708626431" status: 204 len: 0 microversion: 2.2 time: 0.035336 Jan 15 20:55:11.963954 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 958/1967] 10.222.0.46 () {60 vars in 1317 bytes} [Sat Jan 15 20:55:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-708626431 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 20:55:11.977521 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9a967065-f227-4111-9ac7-7a8bf747bf48 tempest-KeyPairsV22TestJSON-375510187 tempest-KeyPairsV22TestJSON-375510187-project] Calling method '.version_select at 0x7f30ceb63790>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:12.005581 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-9a967065-f227-4111-9ac7-7a8bf747bf48 tempest-KeyPairsV22TestJSON-375510187 tempest-KeyPairsV22TestJSON-375510187-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1491871784" status: 204 len: 0 microversion: 2.2 time: 0.035514 Jan 15 20:55:12.006906 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 959/1968] 10.222.0.46 () {60 vars in 1320 bytes} [Sat Jan 15 20:55:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1491871784 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 15 20:55:12.026678 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-84d699b1-c492-4535-87f9-77d99bc2b88f tempest-KeyPairsV22TestJSON-375510187 tempest-KeyPairsV22TestJSON-375510187-project] Calling method '.version_select at 0x7f30ceb9f8b0>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:12.067863 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-84d699b1-c492-4535-87f9-77d99bc2b88f tempest-KeyPairsV22TestJSON-375510187 tempest-KeyPairsV22TestJSON-375510187-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-224676190" status: 204 len: 0 microversion: 2.2 time: 0.049333 Jan 15 20:55:12.068728 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 960/1969] 10.222.0.46 () {60 vars in 1317 bytes} [Sat Jan 15 20:55:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-224676190 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 20:55:12.079687 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-bb9bd61f-c438-4646-8367-8fa533153a04 tempest-KeyPairsV22TestJSON-375510187 tempest-KeyPairsV22TestJSON-375510187-project] Action: 'create', calling method: .version_select at 0x7f30ceb029d0>, body: {"keypair": {"name": "tempest-keypair-271332605"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:55:12.095833 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-bb9bd61f-c438-4646-8367-8fa533153a04 tempest-KeyPairsV22TestJSON-375510187 tempest-KeyPairsV22TestJSON-375510187-project] Getting quotas for project c849974ff33d4bbb82ed2c33fe57029a. Resources: {'key_pairs'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:55:12.104107 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-bb9bd61f-c438-4646-8367-8fa533153a04 tempest-KeyPairsV22TestJSON-375510187 tempest-KeyPairsV22TestJSON-375510187-project] Getting quotas for user a38b8e16857b4c57ac8e500e4bd53294 and project c849974ff33d4bbb82ed2c33fe57029a. Resources: {'key_pairs'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:55:12.666959 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-bb9bd61f-c438-4646-8367-8fa533153a04 tempest-KeyPairsV22TestJSON-375510187 tempest-KeyPairsV22TestJSON-375510187-project] Getting quotas for project c849974ff33d4bbb82ed2c33fe57029a. Resources: {'key_pairs'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:55:12.681314 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-bb9bd61f-c438-4646-8367-8fa533153a04 tempest-KeyPairsV22TestJSON-375510187 tempest-KeyPairsV22TestJSON-375510187-project] Getting quotas for user a38b8e16857b4c57ac8e500e4bd53294 and project c849974ff33d4bbb82ed2c33fe57029a. Resources: {'key_pairs'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:55:12.714396 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-bb9bd61f-c438-4646-8367-8fa533153a04 tempest-KeyPairsV22TestJSON-375510187 tempest-KeyPairsV22TestJSON-375510187-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.2 time: 0.639693 Jan 15 20:55:12.715015 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 961/1970] 10.222.0.46 () {62 vars in 1197 bytes} [Sat Jan 15 20:55:12 2022] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 641 msecs (HTTP/1.1 201) 9 headers in 363 bytes (2 switches on core 0) Jan 15 20:55:12.728485 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a5256ebe-3a06-4da8-8dd1-8521a4ef4ece tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:12.729678 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a5256ebe-3a06-4da8-8dd1-8521a4ef4ece tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: 427db3d9-56d4-49ff-a4f1-28302d78f56a] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:55:12.739012 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a5256ebe-3a06-4da8-8dd1-8521a4ef4ece tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:12.739960 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a5256ebe-3a06-4da8-8dd1-8521a4ef4ece tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:12.740954 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a5256ebe-3a06-4da8-8dd1-8521a4ef4ece tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:12.741561 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a5256ebe-3a06-4da8-8dd1-8521a4ef4ece tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:12.760479 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-a5256ebe-3a06-4da8-8dd1-8521a4ef4ece tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] HTTP exception thrown: Instance 427db3d9-56d4-49ff-a4f1-28302d78f56a could not be found. Jan 15 20:55:12.761392 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a5256ebe-3a06-4da8-8dd1-8521a4ef4ece tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Returning 404 to user: Instance 427db3d9-56d4-49ff-a4f1-28302d78f56a could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:55:12.766299 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a5256ebe-3a06-4da8-8dd1-8521a4ef4ece tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/427db3d9-56d4-49ff-a4f1-28302d78f56a" status: 404 len: 111 microversion: 2.1 time: 0.050248 Jan 15 20:55:12.767126 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 962/1971] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:55:12 2022] GET /compute/v2.1/servers/427db3d9-56d4-49ff-a4f1-28302d78f56a => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:55:12.773010 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-cf1433fb-f5da-4e59-af22-07d27ec71fd5 req-37bdf6fe-9c30-4fb4-b50e-b8cf47d94f21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1eb0bef-5aaf-46d6-8739-b12303df9842", "tag": "d4128316-d1ff-46a8-817e-082539cee097"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:55:12.783315 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:55:12.783315 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:55:12.791516 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-cf1433fb-f5da-4e59-af22-07d27ec71fd5 req-37bdf6fe-9c30-4fb4-b50e-b8cf47d94f21 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:12.799146 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-cf1433fb-f5da-4e59-af22-07d27ec71fd5 req-37bdf6fe-9c30-4fb4-b50e-b8cf47d94f21 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:12.840215 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-cf1433fb-f5da-4e59-af22-07d27ec71fd5 req-37bdf6fe-9c30-4fb4-b50e-b8cf47d94f21 service nova] Creating event network-changed:d4128316-d1ff-46a8-817e-082539cee097 for instance b1eb0bef-5aaf-46d6-8739-b12303df9842 on nch1-master-1 Jan 15 20:55:12.855121 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-cf1433fb-f5da-4e59-af22-07d27ec71fd5 req-37bdf6fe-9c30-4fb4-b50e-b8cf47d94f21 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085423 Jan 15 20:55:12.856068 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 963/1972] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:55:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:55:12.868094 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-41c1ecd9-d4a9-48b2-afad-21930a9c83b8 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:12.869936 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-41c1ecd9-d4a9-48b2-afad-21930a9c83b8 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] [instance: b1eb0bef-5aaf-46d6-8739-b12303df9842] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:55:12.882114 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-41c1ecd9-d4a9-48b2-afad-21930a9c83b8 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:12.882893 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-41c1ecd9-d4a9-48b2-afad-21930a9c83b8 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:12.884454 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-41c1ecd9-d4a9-48b2-afad-21930a9c83b8 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:12.885975 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-41c1ecd9-d4a9-48b2-afad-21930a9c83b8 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:13.326291 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7edcfe06-cc59-42d3-ad89-a2eb06fd15c1 tempest-FloatingIPDetailsTestJSON-205108975 tempest-FloatingIPDetailsTestJSON-205108975-project] 10.222.0.46 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.970417 Jan 15 20:55:13.326887 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1010/1973] 10.222.0.46 () {60 vars in 1169 bytes} [Sat Jan 15 20:55:09 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3972 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:55:13.337876 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d1b1ccc8-1f71-41c7-a0b5-5cd831e2a32a tempest-KeyPairsV22TestJSON-375510187 tempest-KeyPairsV22TestJSON-375510187-project] Calling method '.version_select at 0x7f30cecdbdc0>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:13.347334 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d1b1ccc8-1f71-41c7-a0b5-5cd831e2a32a tempest-KeyPairsV22TestJSON-375510187 tempest-KeyPairsV22TestJSON-375510187-project] 10.222.0.46 "GET /compute/v2.1/os-keypairs/tempest-keypair-271332605" status: 200 len: 706 microversion: 2.2 time: 0.019125 Jan 15 20:55:13.349036 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1011/1974] 10.222.0.46 () {60 vars in 1254 bytes} [Sat Jan 15 20:55:13 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-271332605 => generated 706 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:55:13.353765 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-015ad183-662d-4c67-aecd-3f888fa97779 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:13.354731 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-015ad183-662d-4c67-aecd-3f888fa97779 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] [instance: 39b25eb1-ffab-417c-b47d-893dabb85d7c] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:55:13.363911 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-015ad183-662d-4c67-aecd-3f888fa97779 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:13.364606 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-015ad183-662d-4c67-aecd-3f888fa97779 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:13.366250 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-015ad183-662d-4c67-aecd-3f888fa97779 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:13.366856 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-015ad183-662d-4c67-aecd-3f888fa97779 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:13.465304 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-41c1ecd9-d4a9-48b2-afad-21930a9c83b8 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c0085c7fa1d44e58b20181319ea00f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '964edbaeb4c944cfb68578886695266c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:55:13.474231 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-41c1ecd9-d4a9-48b2-afad-21930a9c83b8 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] 10.222.0.46 "GET /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842" status: 200 len: 1404 microversion: 2.1 time: 0.616819 Jan 15 20:55:13.484610 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 964/1975] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:55:12 2022] GET /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842 => generated 1404 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:55:13.491285 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f21bb8e2-29d0-41bb-a9cc-b5ee02963ecc tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1903102046", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "networks": [{"uuid": "531bba45-51d6-4df1-9e47-d4b8172e5210"}]}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:55:13.552662 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.network.neutron [None req-f21bb8e2-29d0-41bb-a9cc-b5ee02963ecc tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] validate_networks() for [('531bba45-51d6-4df1-9e47-d4b8172e5210', None, None, None, None, None)] {{(pid=129365) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 20:55:14.038677 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-015ad183-662d-4c67-aecd-3f888fa97779 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e1b423e1a9146c8bb202ba012e2ee2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d5d92c87544c4d8080e19c1f6429bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:55:14.055060 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-015ad183-662d-4c67-aecd-3f888fa97779 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] 10.222.0.46 "GET /compute/v2.1/servers/39b25eb1-ffab-417c-b47d-893dabb85d7c" status: 200 len: 1324 microversion: 2.1 time: 0.703574 Jan 15 20:55:14.068785 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1012/1976] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:55:13 2022] GET /compute/v2.1/servers/39b25eb1-ffab-417c-b47d-893dabb85d7c => generated 1324 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:55:14.074876 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-646bbf0a-f77d-4891-bf1f-e75c37e2023d tempest-FloatingIPDetailsTestJSON-205108975 tempest-FloatingIPDetailsTestJSON-205108975-project] Action: 'create', calling method: .version_select at 0x7f30ced03670>, body: {"pool": null} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:55:15.211907 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-f21bb8e2-29d0-41bb-a9cc-b5ee02963ecc tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Flavor limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 20:55:15.212449 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-f21bb8e2-29d0-41bb-a9cc-b5ee02963ecc tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Image limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 20:55:15.212784 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-f21bb8e2-29d0-41bb-a9cc-b5ee02963ecc tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Flavor pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 20:55:15.213291 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-f21bb8e2-29d0-41bb-a9cc-b5ee02963ecc tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Image pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 20:55:15.214013 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-f21bb8e2-29d0-41bb-a9cc-b5ee02963ecc tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 20:55:15.237274 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f21bb8e2-29d0-41bb-a9cc-b5ee02963ecc tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:15.237732 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f21bb8e2-29d0-41bb-a9cc-b5ee02963ecc tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:15.238645 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f21bb8e2-29d0-41bb-a9cc-b5ee02963ecc tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:15.239096 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f21bb8e2-29d0-41bb-a9cc-b5ee02963ecc tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:15.281587 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-f21bb8e2-29d0-41bb-a9cc-b5ee02963ecc tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Getting quotas for project 51cad90ef72141c2983640133453f788. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:55:15.295445 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-f21bb8e2-29d0-41bb-a9cc-b5ee02963ecc tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Getting quotas for user 765cbcb4d9c8476494f08b123d1db59b and project 51cad90ef72141c2983640133453f788. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:55:15.327163 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f21bb8e2-29d0-41bb-a9cc-b5ee02963ecc tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Going to run 1 instances... {{(pid=129365) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 20:55:15.329674 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f21bb8e2-29d0-41bb-a9cc-b5ee02963ecc tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: bdd7983d-e38b-4ca2-8b65-295d134baf35] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129365) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 20:55:15.460263 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f21bb8e2-29d0-41bb-a9cc-b5ee02963ecc tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.973867 Jan 15 20:55:15.465413 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 965/1977] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 20:55:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1980 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 20:55:15.479198 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-eaa31c9e-9fe6-41d2-ad06-42790a4ff04e tempest-KeyPairsV22TestJSON-375510187 tempest-KeyPairsV22TestJSON-375510187-project] Calling method '.version_select at 0x7f30ceb761f0>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:15.483021 ncdv-master-1 devstack@n-api.service[129365]: WARNING oslo_db.sqlalchemy.utils [None req-eaa31c9e-9fe6-41d2-ad06-42790a4ff04e tempest-KeyPairsV22TestJSON-375510187 tempest-KeyPairsV22TestJSON-375510187-project] Unique keys not in sort_keys. The sorting order may be unstable. Jan 15 20:55:15.508349 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-eaa31c9e-9fe6-41d2-ad06-42790a4ff04e tempest-KeyPairsV22TestJSON-375510187 tempest-KeyPairsV22TestJSON-375510187-project] 10.222.0.46 "GET /compute/v2.1/os-keypairs" status: 200 len: 563 microversion: 2.2 time: 0.040675 Jan 15 20:55:15.509036 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 966/1978] 10.222.0.46 () {60 vars in 1176 bytes} [Sat Jan 15 20:55:15 2022] GET /compute/v2.1/os-keypairs => generated 563 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:55:15.518773 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-bd895c72-847c-4d6d-a024-4c74394d0a68 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:15.523069 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-bd895c72-847c-4d6d-a024-4c74394d0a68 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] [instance: b1eb0bef-5aaf-46d6-8739-b12303df9842] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:55:15.538573 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bd895c72-847c-4d6d-a024-4c74394d0a68 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:15.541398 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bd895c72-847c-4d6d-a024-4c74394d0a68 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:15.542381 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bd895c72-847c-4d6d-a024-4c74394d0a68 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:15.543723 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bd895c72-847c-4d6d-a024-4c74394d0a68 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:16.354286 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-bd895c72-847c-4d6d-a024-4c74394d0a68 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c0085c7fa1d44e58b20181319ea00f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '964edbaeb4c944cfb68578886695266c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:55:16.397580 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-bd895c72-847c-4d6d-a024-4c74394d0a68 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] 10.222.0.46 "GET /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842" status: 200 len: 1404 microversion: 2.1 time: 0.887390 Jan 15 20:55:16.398583 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 967/1979] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:55:15 2022] GET /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842 => generated 1404 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:55:16.405756 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b71c1de3-d1f0-42f2-ad6f-a3bc1d875d34 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:16.409079 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b71c1de3-d1f0-42f2-ad6f-a3bc1d875d34 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] [instance: 39b25eb1-ffab-417c-b47d-893dabb85d7c] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:55:16.436630 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b71c1de3-d1f0-42f2-ad6f-a3bc1d875d34 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:16.437156 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b71c1de3-d1f0-42f2-ad6f-a3bc1d875d34 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:16.441229 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b71c1de3-d1f0-42f2-ad6f-a3bc1d875d34 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:16.441959 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b71c1de3-d1f0-42f2-ad6f-a3bc1d875d34 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:17.129396 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-b71c1de3-d1f0-42f2-ad6f-a3bc1d875d34 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e1b423e1a9146c8bb202ba012e2ee2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d5d92c87544c4d8080e19c1f6429bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:55:17.143994 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b71c1de3-d1f0-42f2-ad6f-a3bc1d875d34 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] 10.222.0.46 "GET /compute/v2.1/servers/39b25eb1-ffab-417c-b47d-893dabb85d7c" status: 200 len: 1324 microversion: 2.1 time: 0.741295 Jan 15 20:55:17.146639 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 968/1980] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:55:16 2022] GET /compute/v2.1/servers/39b25eb1-ffab-417c-b47d-893dabb85d7c => generated 1324 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:55:17.152495 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-cee011d0-bf3b-45cf-9a1c-38bd874b636a req-84207579-8a15-4919-a1f9-f5c6b239db65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39b25eb1-ffab-417c-b47d-893dabb85d7c", "tag": "9fdb652e-4fff-4829-a594-2e6365d0ca3f"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:55:17.155917 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:55:17.155917 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:55:17.179086 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-cee011d0-bf3b-45cf-9a1c-38bd874b636a req-84207579-8a15-4919-a1f9-f5c6b239db65 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:17.179578 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-cee011d0-bf3b-45cf-9a1c-38bd874b636a req-84207579-8a15-4919-a1f9-f5c6b239db65 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:17.202744 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-cee011d0-bf3b-45cf-9a1c-38bd874b636a req-84207579-8a15-4919-a1f9-f5c6b239db65 service nova] Creating event network-changed:9fdb652e-4fff-4829-a594-2e6365d0ca3f for instance 39b25eb1-ffab-417c-b47d-893dabb85d7c on nch2-master-1 Jan 15 20:55:17.219792 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-cee011d0-bf3b-45cf-9a1c-38bd874b636a req-84207579-8a15-4919-a1f9-f5c6b239db65 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071513 Jan 15 20:55:17.220414 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 969/1981] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:55:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:55:17.234958 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a88446cd-42cf-49e9-97f9-834a2cc38e69 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:17.235691 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a88446cd-42cf-49e9-97f9-834a2cc38e69 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: bdd7983d-e38b-4ca2-8b65-295d134baf35] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:55:17.251792 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a88446cd-42cf-49e9-97f9-834a2cc38e69 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:17.252795 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a88446cd-42cf-49e9-97f9-834a2cc38e69 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:17.254746 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a88446cd-42cf-49e9-97f9-834a2cc38e69 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:17.255982 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a88446cd-42cf-49e9-97f9-834a2cc38e69 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:17.372035 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-a88446cd-42cf-49e9-97f9-834a2cc38e69 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:55:17.396862 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a88446cd-42cf-49e9-97f9-834a2cc38e69 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/bdd7983d-e38b-4ca2-8b65-295d134baf35" status: 200 len: 1273 microversion: 2.1 time: 0.174836 Jan 15 20:55:17.400555 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 970/1982] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:55:17 2022] GET /compute/v2.1/servers/bdd7983d-e38b-4ca2-8b65-295d134baf35 => generated 1273 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:55:17.414935 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e5915821-d530-4284-80f9-159f186d0dd6 tempest-KeyPairsV22TestJSON-375510187 tempest-KeyPairsV22TestJSON-375510187-project] Calling method '.version_select at 0x7f30ceb028b0>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:17.472286 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e5915821-d530-4284-80f9-159f186d0dd6 tempest-KeyPairsV22TestJSON-375510187 tempest-KeyPairsV22TestJSON-375510187-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-271332605" status: 204 len: 0 microversion: 2.2 time: 0.069151 Jan 15 20:55:17.473010 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 971/1983] 10.222.0.46 () {60 vars in 1257 bytes} [Sat Jan 15 20:55:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-271332605 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 20:55:17.478076 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a0997839-235a-43a5-a85a-feb10f7b8638 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:17.479156 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a0997839-235a-43a5-a85a-feb10f7b8638 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] [instance: b1eb0bef-5aaf-46d6-8739-b12303df9842] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:55:17.489986 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a0997839-235a-43a5-a85a-feb10f7b8638 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:17.490435 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a0997839-235a-43a5-a85a-feb10f7b8638 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:17.492286 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a0997839-235a-43a5-a85a-feb10f7b8638 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:17.493242 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a0997839-235a-43a5-a85a-feb10f7b8638 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:17.876021 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-a0997839-235a-43a5-a85a-feb10f7b8638 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c0085c7fa1d44e58b20181319ea00f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '964edbaeb4c944cfb68578886695266c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:55:17.968454 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a0997839-235a-43a5-a85a-feb10f7b8638 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] 10.222.0.46 "GET /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842" status: 200 len: 1404 microversion: 2.1 time: 0.487183 Jan 15 20:55:17.971489 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 972/1984] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:55:17 2022] GET /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842 => generated 1404 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:55:17.984087 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9b0330f7-6e98-44aa-a768-fcb106e86958 tempest-KeyPairsV22TestJSON-375510187 tempest-KeyPairsV22TestJSON-375510187-project] Action: 'create', calling method: .version_select at 0x7f30ceb02160>, body: {"keypair": {"name": "tempest-keypair-1391616146", "type": "x509"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:55:18.016040 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-9b0330f7-6e98-44aa-a768-fcb106e86958 tempest-KeyPairsV22TestJSON-375510187 tempest-KeyPairsV22TestJSON-375510187-project] Getting quotas for project c849974ff33d4bbb82ed2c33fe57029a. Resources: {'key_pairs'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:55:18.035533 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-9b0330f7-6e98-44aa-a768-fcb106e86958 tempest-KeyPairsV22TestJSON-375510187 tempest-KeyPairsV22TestJSON-375510187-project] Getting quotas for user a38b8e16857b4c57ac8e500e4bd53294 and project c849974ff33d4bbb82ed2c33fe57029a. Resources: {'key_pairs'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:55:18.073983 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.processutils [None req-9b0330f7-6e98-44aa-a768-fcb106e86958 tempest-KeyPairsV22TestJSON-375510187 tempest-KeyPairsV22TestJSON-375510187-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmpk5vk11w1/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpk5vk11w1/temp.key -subj /CN=a38b8e16857b4c57ac8e500e4bd53294 -extensions v3_req_client {{(pid=129365) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 15 20:55:18.661536 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.processutils [None req-9b0330f7-6e98-44aa-a768-fcb106e86958 tempest-KeyPairsV22TestJSON-375510187 tempest-KeyPairsV22TestJSON-375510187-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmpk5vk11w1/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpk5vk11w1/temp.key -subj /CN=a38b8e16857b4c57ac8e500e4bd53294 -extensions v3_req_client" returned: 0 in 0.587s {{(pid=129365) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 15 20:55:18.664709 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.processutils [None req-9b0330f7-6e98-44aa-a768-fcb106e86958 tempest-KeyPairsV22TestJSON-375510187 tempest-KeyPairsV22TestJSON-375510187-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmpk5vk11w1/temp.key -password pass: {{(pid=129365) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 15 20:55:18.768242 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.processutils [None req-9b0330f7-6e98-44aa-a768-fcb106e86958 tempest-KeyPairsV22TestJSON-375510187 tempest-KeyPairsV22TestJSON-375510187-project] CMD "openssl pkcs12 -export -inkey /tmp/tmpk5vk11w1/temp.key -password pass:" returned: 0 in 0.102s {{(pid=129365) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 15 20:55:18.820681 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-646bbf0a-f77d-4891-bf1f-e75c37e2023d tempest-FloatingIPDetailsTestJSON-205108975 tempest-FloatingIPDetailsTestJSON-205108975-project] 10.222.0.46 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.749681 Jan 15 20:55:18.827002 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1013/1985] 10.222.0.46 () {60 vars in 1169 bytes} [Sat Jan 15 20:55:14 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4757 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:55:18.832096 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4124bb4e-9806-4d14-a474-2ebbb136cf6c tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:18.833148 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-4124bb4e-9806-4d14-a474-2ebbb136cf6c tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] [instance: 39b25eb1-ffab-417c-b47d-893dabb85d7c] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:55:18.841647 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4124bb4e-9806-4d14-a474-2ebbb136cf6c tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:18.842315 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4124bb4e-9806-4d14-a474-2ebbb136cf6c tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:18.843371 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4124bb4e-9806-4d14-a474-2ebbb136cf6c tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:18.844165 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4124bb4e-9806-4d14-a474-2ebbb136cf6c tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:18.869223 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-9b0330f7-6e98-44aa-a768-fcb106e86958 tempest-KeyPairsV22TestJSON-375510187 tempest-KeyPairsV22TestJSON-375510187-project] Getting quotas for project c849974ff33d4bbb82ed2c33fe57029a. Resources: {'key_pairs'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:55:18.888583 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-9b0330f7-6e98-44aa-a768-fcb106e86958 tempest-KeyPairsV22TestJSON-375510187 tempest-KeyPairsV22TestJSON-375510187-project] Getting quotas for user a38b8e16857b4c57ac8e500e4bd53294 and project c849974ff33d4bbb82ed2c33fe57029a. Resources: {'key_pairs'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:55:18.952561 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-9b0330f7-6e98-44aa-a768-fcb106e86958 tempest-KeyPairsV22TestJSON-375510187 tempest-KeyPairsV22TestJSON-375510187-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 201 len: 4693 microversion: 2.2 time: 0.979288 Jan 15 20:55:18.963052 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 973/1986] 10.222.0.46 () {62 vars in 1197 bytes} [Sat Jan 15 20:55:17 2022] POST /compute/v2.1/os-keypairs => generated 4693 bytes in 991 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Jan 15 20:55:18.969775 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b1f9312c-2905-463f-9fd0-f3f35c320f2c tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:18.970843 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b1f9312c-2905-463f-9fd0-f3f35c320f2c tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: bdd7983d-e38b-4ca2-8b65-295d134baf35] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:55:18.978719 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b1f9312c-2905-463f-9fd0-f3f35c320f2c tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:18.979694 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b1f9312c-2905-463f-9fd0-f3f35c320f2c tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:18.980768 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b1f9312c-2905-463f-9fd0-f3f35c320f2c tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:18.981577 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b1f9312c-2905-463f-9fd0-f3f35c320f2c tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:19.096976 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-b1f9312c-2905-463f-9fd0-f3f35c320f2c tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:55:19.108595 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b1f9312c-2905-463f-9fd0-f3f35c320f2c tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/bdd7983d-e38b-4ca2-8b65-295d134baf35" status: 200 len: 1273 microversion: 2.1 time: 0.143830 Jan 15 20:55:19.109233 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 974/1987] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:55:18 2022] GET /compute/v2.1/servers/bdd7983d-e38b-4ca2-8b65-295d134baf35 => generated 1273 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:55:19.180337 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-4124bb4e-9806-4d14-a474-2ebbb136cf6c tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e1b423e1a9146c8bb202ba012e2ee2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d5d92c87544c4d8080e19c1f6429bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:55:19.188118 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-4124bb4e-9806-4d14-a474-2ebbb136cf6c tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] 10.222.0.46 "GET /compute/v2.1/servers/39b25eb1-ffab-417c-b47d-893dabb85d7c" status: 200 len: 1324 microversion: 2.1 time: 0.359835 Jan 15 20:55:19.188701 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1014/1988] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:55:18 2022] GET /compute/v2.1/servers/39b25eb1-ffab-417c-b47d-893dabb85d7c => generated 1324 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:55:19.196373 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b04838ca-ce52-4baf-bf4b-3787252f4e58 tempest-FloatingIPDetailsTestJSON-205108975 tempest-FloatingIPDetailsTestJSON-205108975-project] Calling method '.version_select at 0x7f30c8de2670>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:19.467363 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ba3e6dd6-3aa1-4789-9150-a9e25896ca35 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-806752403", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "networks": [{"uuid": "dd4402cd-4bc8-45f2-ad1b-283bdc21d905"}]}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:55:19.509298 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b04838ca-ce52-4baf-bf4b-3787252f4e58 tempest-FloatingIPDetailsTestJSON-205108975 tempest-FloatingIPDetailsTestJSON-205108975-project] 10.222.0.46 "GET /compute/v2.1/os-floating-ips/b6322e3a-4d37-4acf-b09d-acdfffbfe81a" status: 200 len: 141 microversion: 2.1 time: 0.316335 Jan 15 20:55:19.510097 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1015/1989] 10.222.0.46 () {58 vars in 1259 bytes} [Sat Jan 15 20:55:19 2022] GET /compute/v2.1/os-floating-ips/b6322e3a-4d37-4acf-b09d-acdfffbfe81a => generated 141 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:55:19.517055 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8fcf3296-6624-4a5f-83b1-b773396f71f3 tempest-KeyPairsV22TestJSON-375510187 tempest-KeyPairsV22TestJSON-375510187-project] Calling method '.version_select at 0x7f30ced03280>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:19.533845 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-8fcf3296-6624-4a5f-83b1-b773396f71f3 tempest-KeyPairsV22TestJSON-375510187 tempest-KeyPairsV22TestJSON-375510187-project] 10.222.0.46 "GET /compute/v2.1/os-keypairs/tempest-keypair-1391616146" status: 200 len: 1534 microversion: 2.2 time: 0.022363 Jan 15 20:55:19.537531 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1016/1990] 10.222.0.46 () {60 vars in 1257 bytes} [Sat Jan 15 20:55:19 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1391616146 => generated 1534 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:55:19.542521 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.network.neutron [None req-ba3e6dd6-3aa1-4789-9150-a9e25896ca35 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] validate_networks() for [('dd4402cd-4bc8-45f2-ad1b-283bdc21d905', None, None, None, None, None)] {{(pid=129365) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 20:55:19.550629 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e2aecc39-fb61-4498-aaa8-2e6cd6c41e51 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:19.551334 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e2aecc39-fb61-4498-aaa8-2e6cd6c41e51 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] [instance: b1eb0bef-5aaf-46d6-8739-b12303df9842] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:55:19.566603 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e2aecc39-fb61-4498-aaa8-2e6cd6c41e51 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:19.569452 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e2aecc39-fb61-4498-aaa8-2e6cd6c41e51 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:19.570665 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e2aecc39-fb61-4498-aaa8-2e6cd6c41e51 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:19.571331 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e2aecc39-fb61-4498-aaa8-2e6cd6c41e51 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:19.865907 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-e2aecc39-fb61-4498-aaa8-2e6cd6c41e51 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c0085c7fa1d44e58b20181319ea00f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '964edbaeb4c944cfb68578886695266c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:55:19.882060 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e2aecc39-fb61-4498-aaa8-2e6cd6c41e51 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] 10.222.0.46 "GET /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842" status: 200 len: 1404 microversion: 2.1 time: 0.343138 Jan 15 20:55:19.895782 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1017/1991] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:55:19 2022] GET /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842 => generated 1404 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:55:19.902816 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-79714158-e287-4824-a3e5-58dfb7713be8 req-378bcecc-623f-461c-97ef-cef9044b4178 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1eb0bef-5aaf-46d6-8739-b12303df9842", "name": "network-vif-plugged", "status": "completed", "tag": "d4128316-d1ff-46a8-817e-082539cee097"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:55:19.908764 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:55:19.908764 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:55:19.920567 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-79714158-e287-4824-a3e5-58dfb7713be8 req-378bcecc-623f-461c-97ef-cef9044b4178 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:19.921243 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-79714158-e287-4824-a3e5-58dfb7713be8 req-378bcecc-623f-461c-97ef-cef9044b4178 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:19.964207 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-79714158-e287-4824-a3e5-58dfb7713be8 req-378bcecc-623f-461c-97ef-cef9044b4178 service nova] Creating event network-vif-plugged:d4128316-d1ff-46a8-817e-082539cee097 for instance b1eb0bef-5aaf-46d6-8739-b12303df9842 on nch1-master-1 Jan 15 20:55:19.982799 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-79714158-e287-4824-a3e5-58dfb7713be8 req-378bcecc-623f-461c-97ef-cef9044b4178 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085351 Jan 15 20:55:19.986033 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1018/1992] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:55:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:55:20.002618 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0a54d708-a263-4d6d-a39b-5d63c7bf873e tempest-FloatingIPDetailsTestJSON-205108975 tempest-FloatingIPDetailsTestJSON-205108975-project] Calling method '.version_select at 0x7f30cece1790>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:20.330240 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-ba3e6dd6-3aa1-4789-9150-a9e25896ca35 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Flavor limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 20:55:20.331893 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-ba3e6dd6-3aa1-4789-9150-a9e25896ca35 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Image limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 20:55:20.333643 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-ba3e6dd6-3aa1-4789-9150-a9e25896ca35 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Flavor pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 20:55:20.334249 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-ba3e6dd6-3aa1-4789-9150-a9e25896ca35 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Image pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 20:55:20.334969 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-ba3e6dd6-3aa1-4789-9150-a9e25896ca35 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 20:55:20.389896 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ba3e6dd6-3aa1-4789-9150-a9e25896ca35 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:20.390366 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ba3e6dd6-3aa1-4789-9150-a9e25896ca35 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:20.391486 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ba3e6dd6-3aa1-4789-9150-a9e25896ca35 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:20.391936 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ba3e6dd6-3aa1-4789-9150-a9e25896ca35 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:20.424590 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-ba3e6dd6-3aa1-4789-9150-a9e25896ca35 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Getting quotas for project 385a05b1a0a7479db84b762eca23b55b. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:55:20.441419 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-ba3e6dd6-3aa1-4789-9150-a9e25896ca35 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Getting quotas for user e2ec114f8ece434aa496cd401494e2e4 and project 385a05b1a0a7479db84b762eca23b55b. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:55:20.493871 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ba3e6dd6-3aa1-4789-9150-a9e25896ca35 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Going to run 1 instances... {{(pid=129365) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 20:55:20.503215 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ba3e6dd6-3aa1-4789-9150-a9e25896ca35 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] [instance: 0207c6e5-54cf-4b26-b1e7-ed649dac8bb9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129365) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 20:55:20.570746 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ba3e6dd6-3aa1-4789-9150-a9e25896ca35 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.460376 Jan 15 20:55:20.572965 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 975/1993] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 20:55:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1463 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 20:55:20.579129 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-861abc63-a9f2-446f-8490-cc8f0a2a3dbc tempest-KeyPairsV22TestJSON-375510187 tempest-KeyPairsV22TestJSON-375510187-project] Calling method '.version_select at 0x7f30c8d94af0>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:20.583605 ncdv-master-1 devstack@n-api.service[129365]: WARNING oslo_db.sqlalchemy.utils [None req-861abc63-a9f2-446f-8490-cc8f0a2a3dbc tempest-KeyPairsV22TestJSON-375510187 tempest-KeyPairsV22TestJSON-375510187-project] Unique keys not in sort_keys. The sorting order may be unstable. Jan 15 20:55:20.595331 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-861abc63-a9f2-446f-8490-cc8f0a2a3dbc tempest-KeyPairsV22TestJSON-375510187 tempest-KeyPairsV22TestJSON-375510187-project] 10.222.0.46 "GET /compute/v2.1/os-keypairs" status: 200 len: 1391 microversion: 2.2 time: 0.020555 Jan 15 20:55:20.596460 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 976/1994] 10.222.0.46 () {60 vars in 1176 bytes} [Sat Jan 15 20:55:20 2022] GET /compute/v2.1/os-keypairs => generated 1391 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:55:20.603353 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-70f52e3c-24ec-4ac8-9772-56d34a3b2891 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-2010716483", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "networks": [{"uuid": "197895cf-682e-4efc-bfb1-824ab1de40fa"}, {"uuid": "97e9fbbf-6f05-4fa2-882d-e8fa2d23f0fe"}, {"uuid": "197895cf-682e-4efc-bfb1-824ab1de40fa"}]}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:55:20.673888 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.network.neutron [None req-70f52e3c-24ec-4ac8-9772-56d34a3b2891 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] validate_networks() for [('197895cf-682e-4efc-bfb1-824ab1de40fa', None, None, None, None, None), ('97e9fbbf-6f05-4fa2-882d-e8fa2d23f0fe', None, None, None, None, None), ('197895cf-682e-4efc-bfb1-824ab1de40fa', None, None, None, None, None)] {{(pid=129365) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 20:55:23.107328 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0a54d708-a263-4d6d-a39b-5d63c7bf873e tempest-FloatingIPDetailsTestJSON-205108975 tempest-FloatingIPDetailsTestJSON-205108975-project] 10.222.0.46 "DELETE /compute/v2.1/os-floating-ips/b6322e3a-4d37-4acf-b09d-acdfffbfe81a" status: 202 len: 0 microversion: 2.1 time: 3.119131 Jan 15 20:55:23.110459 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1019/1995] 10.222.0.46 () {58 vars in 1262 bytes} [Sat Jan 15 20:55:19 2022] DELETE /compute/v2.1/os-floating-ips/b6322e3a-4d37-4acf-b09d-acdfffbfe81a => generated 0 bytes in 3124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 20:55:23.117740 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b2658861-f24e-48d5-ab27-d3b53c3ba57a tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:23.120054 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b2658861-f24e-48d5-ab27-d3b53c3ba57a tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: bdd7983d-e38b-4ca2-8b65-295d134baf35] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:55:23.139738 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b2658861-f24e-48d5-ab27-d3b53c3ba57a tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:23.140856 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b2658861-f24e-48d5-ab27-d3b53c3ba57a tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:23.142751 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b2658861-f24e-48d5-ab27-d3b53c3ba57a tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:23.143479 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b2658861-f24e-48d5-ab27-d3b53c3ba57a tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:23.374581 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-70f52e3c-24ec-4ac8-9772-56d34a3b2891 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Flavor limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 20:55:23.375550 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-70f52e3c-24ec-4ac8-9772-56d34a3b2891 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Image limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 20:55:23.376029 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-70f52e3c-24ec-4ac8-9772-56d34a3b2891 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Flavor pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 20:55:23.379082 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-70f52e3c-24ec-4ac8-9772-56d34a3b2891 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Image pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 20:55:23.379722 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-70f52e3c-24ec-4ac8-9772-56d34a3b2891 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 20:55:23.391962 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-70f52e3c-24ec-4ac8-9772-56d34a3b2891 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:23.392966 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-70f52e3c-24ec-4ac8-9772-56d34a3b2891 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:23.394890 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-70f52e3c-24ec-4ac8-9772-56d34a3b2891 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:23.395632 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-70f52e3c-24ec-4ac8-9772-56d34a3b2891 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:23.437491 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-70f52e3c-24ec-4ac8-9772-56d34a3b2891 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Getting quotas for project dc238c23f15041c583fd50a124461b2c. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:55:23.467304 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-70f52e3c-24ec-4ac8-9772-56d34a3b2891 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Getting quotas for user 72f5490d676542fcb18b0dd5f5074516 and project dc238c23f15041c583fd50a124461b2c. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:55:23.521286 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-70f52e3c-24ec-4ac8-9772-56d34a3b2891 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Going to run 1 instances... {{(pid=129365) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 20:55:23.523504 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-70f52e3c-24ec-4ac8-9772-56d34a3b2891 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] [instance: 64e6adc9-543a-4611-89fa-38967f9c5ea4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129365) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 20:55:23.638162 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-70f52e3c-24ec-4ac8-9772-56d34a3b2891 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.039467 Jan 15 20:55:23.639517 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 977/1996] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 20:55:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 3042 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 20:55:23.661111 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-02d35e33-66df-4382-aec1-1a2e79e2ae47 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:23.671409 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-02d35e33-66df-4382-aec1-1a2e79e2ae47 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] [instance: 39b25eb1-ffab-417c-b47d-893dabb85d7c] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:55:23.701418 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-b2658861-f24e-48d5-ab27-d3b53c3ba57a tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:55:23.702733 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-02d35e33-66df-4382-aec1-1a2e79e2ae47 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:23.703183 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-02d35e33-66df-4382-aec1-1a2e79e2ae47 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:23.710820 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-02d35e33-66df-4382-aec1-1a2e79e2ae47 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:23.719353 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-02d35e33-66df-4382-aec1-1a2e79e2ae47 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:23.730955 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b2658861-f24e-48d5-ab27-d3b53c3ba57a tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/bdd7983d-e38b-4ca2-8b65-295d134baf35" status: 200 len: 1315 microversion: 2.1 time: 0.616884 Jan 15 20:55:23.733868 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1020/1997] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:55:23 2022] GET /compute/v2.1/servers/bdd7983d-e38b-4ca2-8b65-295d134baf35 => generated 1315 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:55:23.740535 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b6506054-6278-4ab9-8f81-a6ae0c2c4bf1 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:23.742341 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b6506054-6278-4ab9-8f81-a6ae0c2c4bf1 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] [instance: 0207c6e5-54cf-4b26-b1e7-ed649dac8bb9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:55:23.751980 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b6506054-6278-4ab9-8f81-a6ae0c2c4bf1 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:23.752771 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b6506054-6278-4ab9-8f81-a6ae0c2c4bf1 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:23.753804 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b6506054-6278-4ab9-8f81-a6ae0c2c4bf1 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:23.754417 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b6506054-6278-4ab9-8f81-a6ae0c2c4bf1 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:24.302221 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-b6506054-6278-4ab9-8f81-a6ae0c2c4bf1 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ec114f8ece434aa496cd401494e2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a05b1a0a7479db84b762eca23b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:55:24.311504 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b6506054-6278-4ab9-8f81-a6ae0c2c4bf1 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] 10.222.0.46 "GET /compute/v2.1/servers/0207c6e5-54cf-4b26-b1e7-ed649dac8bb9" status: 200 len: 1310 microversion: 2.1 time: 0.576163 Jan 15 20:55:24.323256 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1021/1998] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:55:23 2022] GET /compute/v2.1/servers/0207c6e5-54cf-4b26-b1e7-ed649dac8bb9 => generated 1310 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:55:24.329983 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-771e7c6a-efef-48ff-8903-be8c7e525501 tempest-KeyPairsV22TestJSON-375510187 tempest-KeyPairsV22TestJSON-375510187-project] Calling method '.version_select at 0x7f30ceccf0d0>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:24.362694 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-02d35e33-66df-4382-aec1-1a2e79e2ae47 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e1b423e1a9146c8bb202ba012e2ee2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d5d92c87544c4d8080e19c1f6429bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:55:24.366109 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-771e7c6a-efef-48ff-8903-be8c7e525501 tempest-KeyPairsV22TestJSON-375510187 tempest-KeyPairsV22TestJSON-375510187-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1391616146" status: 204 len: 0 microversion: 2.2 time: 0.041389 Jan 15 20:55:24.369616 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1022/1999] 10.222.0.46 () {60 vars in 1260 bytes} [Sat Jan 15 20:55:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1391616146 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 20:55:24.381973 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-26928901-3169-49da-a4dd-baa44a9d9a09 req-6531bd94-5608-42a3-a767-39ed0af13e25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdd7983d-e38b-4ca2-8b65-295d134baf35", "tag": "cb54b931-8990-43b4-9c30-39ab45e72beb"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:55:24.387248 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:55:24.387248 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:55:24.390884 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-02d35e33-66df-4382-aec1-1a2e79e2ae47 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] 10.222.0.46 "GET /compute/v2.1/servers/39b25eb1-ffab-417c-b47d-893dabb85d7c" status: 200 len: 1324 microversion: 2.1 time: 0.750027 Jan 15 20:55:24.402757 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 978/2000] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:55:23 2022] GET /compute/v2.1/servers/39b25eb1-ffab-417c-b47d-893dabb85d7c => generated 1324 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:55:24.420311 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-26928901-3169-49da-a4dd-baa44a9d9a09 req-6531bd94-5608-42a3-a767-39ed0af13e25 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:24.420894 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-26928901-3169-49da-a4dd-baa44a9d9a09 req-6531bd94-5608-42a3-a767-39ed0af13e25 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:24.422551 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c4e58bc5-e836-447a-87d4-1fb27ebe1509 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:24.423621 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c4e58bc5-e836-447a-87d4-1fb27ebe1509 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] [instance: b1eb0bef-5aaf-46d6-8739-b12303df9842] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:55:24.441708 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c4e58bc5-e836-447a-87d4-1fb27ebe1509 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:24.442095 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c4e58bc5-e836-447a-87d4-1fb27ebe1509 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:24.466648 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c4e58bc5-e836-447a-87d4-1fb27ebe1509 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:24.467251 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c4e58bc5-e836-447a-87d4-1fb27ebe1509 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:24.484593 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-26928901-3169-49da-a4dd-baa44a9d9a09 req-6531bd94-5608-42a3-a767-39ed0af13e25 service nova] Creating event network-changed:cb54b931-8990-43b4-9c30-39ab45e72beb for instance bdd7983d-e38b-4ca2-8b65-295d134baf35 on nch2-master-1 Jan 15 20:55:24.508909 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-26928901-3169-49da-a4dd-baa44a9d9a09 req-6531bd94-5608-42a3-a767-39ed0af13e25 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135243 Jan 15 20:55:24.509545 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1023/2001] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:55:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:55:24.570970 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f4db95df-fce0-4202-b5d3-3f8749c9c3a9 tempest-FloatingIPDetailsTestJSON-205108975 tempest-FloatingIPDetailsTestJSON-205108975-project] Calling method '.version_select at 0x7f30ced03550>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:25.240995 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f4db95df-fce0-4202-b5d3-3f8749c9c3a9 tempest-FloatingIPDetailsTestJSON-205108975 tempest-FloatingIPDetailsTestJSON-205108975-project] 10.222.0.46 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.722526 Jan 15 20:55:25.242315 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1024/2002] 10.222.0.46 () {58 vars in 1163 bytes} [Sat Jan 15 20:55:24 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 20:55:25.251523 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-fe2ced8a-82af-4c3b-a4aa-d757b533fed7 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:25.256821 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-fe2ced8a-82af-4c3b-a4aa-d757b533fed7 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] [instance: 64e6adc9-543a-4611-89fa-38967f9c5ea4] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:55:25.281138 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fe2ced8a-82af-4c3b-a4aa-d757b533fed7 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:25.283166 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fe2ced8a-82af-4c3b-a4aa-d757b533fed7 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:25.285294 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fe2ced8a-82af-4c3b-a4aa-d757b533fed7 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:25.287570 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fe2ced8a-82af-4c3b-a4aa-d757b533fed7 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:25.686704 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-c4e58bc5-e836-447a-87d4-1fb27ebe1509 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c0085c7fa1d44e58b20181319ea00f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '964edbaeb4c944cfb68578886695266c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:55:25.712867 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-fe2ced8a-82af-4c3b-a4aa-d757b533fed7 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f5490d676542fcb18b0dd5f5074516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc238c23f15041c583fd50a124461b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:55:25.716884 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c4e58bc5-e836-447a-87d4-1fb27ebe1509 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] 10.222.0.46 "GET /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842" status: 200 len: 1592 microversion: 2.1 time: 1.318748 Jan 15 20:55:25.717822 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 979/2003] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:55:24 2022] GET /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842 => generated 1592 bytes in 1322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:55:25.731483 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-fe2ced8a-82af-4c3b-a4aa-d757b533fed7 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] 10.222.0.46 "GET /compute/v2.1/servers/64e6adc9-543a-4611-89fa-38967f9c5ea4" status: 200 len: 1265 microversion: 2.1 time: 0.486838 Jan 15 20:55:25.732375 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1025/2004] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:55:25 2022] GET /compute/v2.1/servers/64e6adc9-543a-4611-89fa-38967f9c5ea4 => generated 1265 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:55:25.745250 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a2d19485-d953-4128-b255-9a4823bc18d9 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:25.749722 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a2d19485-d953-4128-b255-9a4823bc18d9 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: bdd7983d-e38b-4ca2-8b65-295d134baf35] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:55:25.752161 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-ef5809b3-90ff-499c-b03d-59f9c9fce429 req-02f92c09-6725-4824-8841-5357699b53c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39b25eb1-ffab-417c-b47d-893dabb85d7c", "name": "network-vif-plugged", "status": "completed", "tag": "9fdb652e-4fff-4829-a594-2e6365d0ca3f"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:55:25.762491 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:55:25.762491 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:55:25.762887 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a2d19485-d953-4128-b255-9a4823bc18d9 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:25.762887 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a2d19485-d953-4128-b255-9a4823bc18d9 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:25.765547 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a2d19485-d953-4128-b255-9a4823bc18d9 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:25.767609 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a2d19485-d953-4128-b255-9a4823bc18d9 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:25.784169 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-ef5809b3-90ff-499c-b03d-59f9c9fce429 req-02f92c09-6725-4824-8841-5357699b53c9 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:25.785572 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-ef5809b3-90ff-499c-b03d-59f9c9fce429 req-02f92c09-6725-4824-8841-5357699b53c9 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:25.816825 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-ef5809b3-90ff-499c-b03d-59f9c9fce429 req-02f92c09-6725-4824-8841-5357699b53c9 service nova] Creating event network-vif-plugged:9fdb652e-4fff-4829-a594-2e6365d0ca3f for instance 39b25eb1-ffab-417c-b47d-893dabb85d7c on nch2-master-1 Jan 15 20:55:25.828083 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-ef5809b3-90ff-499c-b03d-59f9c9fce429 req-02f92c09-6725-4824-8841-5357699b53c9 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107079 Jan 15 20:55:25.829116 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 980/2005] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:55:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:55:25.839751 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-493cb391-5a8e-4b61-8781-08fe7975d2c0 tempest-FloatingIPDetailsTestJSON-205108975 tempest-FloatingIPDetailsTestJSON-205108975-project] Calling method '.version_select at 0x7f30ceba7af0>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:26.457369 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-a2d19485-d953-4128-b255-9a4823bc18d9 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:55:26.473835 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a2d19485-d953-4128-b255-9a4823bc18d9 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/bdd7983d-e38b-4ca2-8b65-295d134baf35" status: 200 len: 1315 microversion: 2.1 time: 0.732239 Jan 15 20:55:26.474798 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1026/2006] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:55:25 2022] GET /compute/v2.1/servers/bdd7983d-e38b-4ca2-8b65-295d134baf35 => generated 1315 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:55:26.479507 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b84da3be-6c71-441b-9f90-3dded058c778 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:26.482559 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b84da3be-6c71-441b-9f90-3dded058c778 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] [instance: 0207c6e5-54cf-4b26-b1e7-ed649dac8bb9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:55:26.495150 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b84da3be-6c71-441b-9f90-3dded058c778 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:26.498573 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b84da3be-6c71-441b-9f90-3dded058c778 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:26.499736 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b84da3be-6c71-441b-9f90-3dded058c778 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:26.500345 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b84da3be-6c71-441b-9f90-3dded058c778 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:26.565092 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-493cb391-5a8e-4b61-8781-08fe7975d2c0 tempest-FloatingIPDetailsTestJSON-205108975 tempest-FloatingIPDetailsTestJSON-205108975-project] 10.222.0.46 "GET /compute/v2.1/os-floating-ips" status: 200 len: 398 microversion: 2.1 time: 0.734601 Jan 15 20:55:26.566279 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 981/2007] 10.222.0.46 () {58 vars in 1148 bytes} [Sat Jan 15 20:55:25 2022] GET /compute/v2.1/os-floating-ips => generated 398 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:55:26.573452 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-78b34708-0739-4903-969a-9d1cb94ac01e tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:26.575345 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-78b34708-0739-4903-969a-9d1cb94ac01e tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] [instance: 39b25eb1-ffab-417c-b47d-893dabb85d7c] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:55:26.608786 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-78b34708-0739-4903-969a-9d1cb94ac01e tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:26.609977 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-78b34708-0739-4903-969a-9d1cb94ac01e tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:26.611823 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-78b34708-0739-4903-969a-9d1cb94ac01e tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:26.613866 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-78b34708-0739-4903-969a-9d1cb94ac01e tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:27.138757 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-b84da3be-6c71-441b-9f90-3dded058c778 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ec114f8ece434aa496cd401494e2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a05b1a0a7479db84b762eca23b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:55:27.150970 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b84da3be-6c71-441b-9f90-3dded058c778 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] 10.222.0.46 "GET /compute/v2.1/servers/0207c6e5-54cf-4b26-b1e7-ed649dac8bb9" status: 200 len: 1310 microversion: 2.1 time: 0.674665 Jan 15 20:55:27.152627 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1027/2008] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:55:26 2022] GET /compute/v2.1/servers/0207c6e5-54cf-4b26-b1e7-ed649dac8bb9 => generated 1310 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:55:27.161284 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8cb4901c-ceb6-475e-b73b-33b53c3719bc tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:27.162293 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-8cb4901c-ceb6-475e-b73b-33b53c3719bc tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] [instance: b1eb0bef-5aaf-46d6-8739-b12303df9842] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:55:27.172431 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8cb4901c-ceb6-475e-b73b-33b53c3719bc tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:27.173330 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8cb4901c-ceb6-475e-b73b-33b53c3719bc tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:27.174577 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8cb4901c-ceb6-475e-b73b-33b53c3719bc tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:27.175311 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8cb4901c-ceb6-475e-b73b-33b53c3719bc tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:27.231619 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-78b34708-0739-4903-969a-9d1cb94ac01e tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e1b423e1a9146c8bb202ba012e2ee2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d5d92c87544c4d8080e19c1f6429bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:55:27.245441 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-78b34708-0739-4903-969a-9d1cb94ac01e tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] 10.222.0.46 "GET /compute/v2.1/servers/39b25eb1-ffab-417c-b47d-893dabb85d7c" status: 200 len: 1324 microversion: 2.1 time: 0.677781 Jan 15 20:55:27.246367 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 982/2009] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:55:26 2022] GET /compute/v2.1/servers/39b25eb1-ffab-417c-b47d-893dabb85d7c => generated 1324 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:55:27.259148 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ef829e7b-6da6-483f-9049-5c752a0c2d2b tempest-FloatingIPDetailsTestJSON-205108975 tempest-FloatingIPDetailsTestJSON-205108975-project] Calling method '.version_select at 0x7f30ceb5eee0>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:27.579360 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-8cb4901c-ceb6-475e-b73b-33b53c3719bc tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] 10.222.0.46 "GET /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.421548 Jan 15 20:55:27.590335 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1028/2010] 10.222.0.46 () {58 vars in 1274 bytes} [Sat Jan 15 20:55:27 2022] GET /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842/os-interface => generated 285 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:55:27.600734 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-3ee8d6c7-c60c-4b39-9e15-3b267f624cab tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:27.603154 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-3ee8d6c7-c60c-4b39-9e15-3b267f624cab tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] [instance: 64e6adc9-543a-4611-89fa-38967f9c5ea4] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:55:27.619109 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3ee8d6c7-c60c-4b39-9e15-3b267f624cab tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:27.621609 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3ee8d6c7-c60c-4b39-9e15-3b267f624cab tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:27.622758 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3ee8d6c7-c60c-4b39-9e15-3b267f624cab tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:27.623431 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3ee8d6c7-c60c-4b39-9e15-3b267f624cab tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:28.990660 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-3ee8d6c7-c60c-4b39-9e15-3b267f624cab tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f5490d676542fcb18b0dd5f5074516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc238c23f15041c583fd50a124461b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:55:29.003779 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-3ee8d6c7-c60c-4b39-9e15-3b267f624cab tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] 10.222.0.46 "GET /compute/v2.1/servers/64e6adc9-543a-4611-89fa-38967f9c5ea4" status: 200 len: 1334 microversion: 2.1 time: 1.410357 Jan 15 20:55:29.006078 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1029/2011] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:55:27 2022] GET /compute/v2.1/servers/64e6adc9-543a-4611-89fa-38967f9c5ea4 => generated 1334 bytes in 1415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:55:29.218121 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9b730db2-b63b-4dcf-b031-bee63fe4ab24 tempest-AZV2TestJSON-1741986454 tempest-AZV2TestJSON-1741986454-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:29.220365 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9b730db2-b63b-4dcf-b031-bee63fe4ab24 tempest-AZV2TestJSON-1741986454 tempest-AZV2TestJSON-1741986454-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:29.221139 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9b730db2-b63b-4dcf-b031-bee63fe4ab24 tempest-AZV2TestJSON-1741986454 tempest-AZV2TestJSON-1741986454-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:29.222224 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9b730db2-b63b-4dcf-b031-bee63fe4ab24 tempest-AZV2TestJSON-1741986454 tempest-AZV2TestJSON-1741986454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:29.222872 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9b730db2-b63b-4dcf-b031-bee63fe4ab24 tempest-AZV2TestJSON-1741986454 tempest-AZV2TestJSON-1741986454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:29.257111 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-9b730db2-b63b-4dcf-b031-bee63fe4ab24 tempest-AZV2TestJSON-1741986454 tempest-AZV2TestJSON-1741986454-project] 10.222.0.46 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.249651 Jan 15 20:55:29.258355 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1030/2012] 10.222.0.46 () {58 vars in 1163 bytes} [Sat Jan 15 20:55:29 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 20:55:29.264135 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-49ba2949-998a-48af-8141-5cfe349e7e49 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:29.266610 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-49ba2949-998a-48af-8141-5cfe349e7e49 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: bdd7983d-e38b-4ca2-8b65-295d134baf35] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:55:29.273437 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-49ba2949-998a-48af-8141-5cfe349e7e49 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:29.274418 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-49ba2949-998a-48af-8141-5cfe349e7e49 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:29.275456 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-49ba2949-998a-48af-8141-5cfe349e7e49 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:29.276374 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-49ba2949-998a-48af-8141-5cfe349e7e49 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:30.199217 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-49ba2949-998a-48af-8141-5cfe349e7e49 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:55:30.212712 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-49ba2949-998a-48af-8141-5cfe349e7e49 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/bdd7983d-e38b-4ca2-8b65-295d134baf35" status: 200 len: 1315 microversion: 2.1 time: 0.952605 Jan 15 20:55:30.230491 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1031/2013] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:55:29 2022] GET /compute/v2.1/servers/bdd7983d-e38b-4ca2-8b65-295d134baf35 => generated 1315 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:55:30.241923 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-7a796ec0-6353-44fe-9fc6-ab11804019e3 req-201b2ab1-227e-4b34-be96-52bf4ee5454c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0207c6e5-54cf-4b26-b1e7-ed649dac8bb9", "tag": "32c4b362-d25a-4492-abc2-6267bd6efe0b"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:55:30.244956 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:55:30.244956 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:55:30.255231 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-7a796ec0-6353-44fe-9fc6-ab11804019e3 req-201b2ab1-227e-4b34-be96-52bf4ee5454c service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:30.255942 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-7a796ec0-6353-44fe-9fc6-ab11804019e3 req-201b2ab1-227e-4b34-be96-52bf4ee5454c service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:30.269498 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-7a796ec0-6353-44fe-9fc6-ab11804019e3 req-201b2ab1-227e-4b34-be96-52bf4ee5454c service nova] Creating event network-changed:32c4b362-d25a-4492-abc2-6267bd6efe0b for instance 0207c6e5-54cf-4b26-b1e7-ed649dac8bb9 on nch1-master-1 Jan 15 20:55:30.288874 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-7a796ec0-6353-44fe-9fc6-ab11804019e3 req-201b2ab1-227e-4b34-be96-52bf4ee5454c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055203 Jan 15 20:55:30.289927 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1032/2014] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:55:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:55:30.298190 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-071bf856-1ffd-45df-b7aa-a02d999a2c38 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:30.299334 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-071bf856-1ffd-45df-b7aa-a02d999a2c38 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] [instance: 0207c6e5-54cf-4b26-b1e7-ed649dac8bb9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:55:30.320876 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-071bf856-1ffd-45df-b7aa-a02d999a2c38 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:30.321468 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-071bf856-1ffd-45df-b7aa-a02d999a2c38 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:30.322678 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-071bf856-1ffd-45df-b7aa-a02d999a2c38 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:30.323251 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-071bf856-1ffd-45df-b7aa-a02d999a2c38 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:31.322643 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-071bf856-1ffd-45df-b7aa-a02d999a2c38 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ec114f8ece434aa496cd401494e2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a05b1a0a7479db84b762eca23b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:55:31.331308 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-071bf856-1ffd-45df-b7aa-a02d999a2c38 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] 10.222.0.46 "GET /compute/v2.1/servers/0207c6e5-54cf-4b26-b1e7-ed649dac8bb9" status: 200 len: 1310 microversion: 2.1 time: 1.038833 Jan 15 20:55:31.341580 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1033/2015] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:55:30 2022] GET /compute/v2.1/servers/0207c6e5-54cf-4b26-b1e7-ed649dac8bb9 => generated 1310 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:55:31.346411 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0318419b-2e87-4b8f-af57-2ea1575e0457 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:31.347022 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-0318419b-2e87-4b8f-af57-2ea1575e0457 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] [instance: 39b25eb1-ffab-417c-b47d-893dabb85d7c] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:55:31.359815 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0318419b-2e87-4b8f-af57-2ea1575e0457 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:31.360272 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0318419b-2e87-4b8f-af57-2ea1575e0457 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:31.361111 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0318419b-2e87-4b8f-af57-2ea1575e0457 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:31.361559 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0318419b-2e87-4b8f-af57-2ea1575e0457 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:31.427586 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ef829e7b-6da6-483f-9049-5c752a0c2d2b tempest-FloatingIPDetailsTestJSON-205108975 tempest-FloatingIPDetailsTestJSON-205108975-project] 10.222.0.46 "DELETE /compute/v2.1/os-floating-ips/815016a3-e112-466b-bf9d-c184af1deddf" status: 202 len: 0 microversion: 2.1 time: 4.178792 Jan 15 20:55:31.430460 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 983/2016] 10.222.0.46 () {58 vars in 1262 bytes} [Sat Jan 15 20:55:27 2022] DELETE /compute/v2.1/os-floating-ips/815016a3-e112-466b-bf9d-c184af1deddf => generated 0 bytes in 4183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 20:55:31.441790 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-7178c087-ded4-486c-a90f-14552ff1db03 req-718e25da-511b-4c43-a530-d09dbe0c8aeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdd7983d-e38b-4ca2-8b65-295d134baf35", "name": "network-vif-plugged", "status": "completed", "tag": "cb54b931-8990-43b4-9c30-39ab45e72beb"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:55:31.447842 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:55:31.447842 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:55:31.456673 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-7178c087-ded4-486c-a90f-14552ff1db03 req-718e25da-511b-4c43-a530-d09dbe0c8aeb service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:31.457139 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-7178c087-ded4-486c-a90f-14552ff1db03 req-718e25da-511b-4c43-a530-d09dbe0c8aeb service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:31.477822 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-7178c087-ded4-486c-a90f-14552ff1db03 req-718e25da-511b-4c43-a530-d09dbe0c8aeb service nova] Creating event network-vif-plugged:cb54b931-8990-43b4-9c30-39ab45e72beb for instance bdd7983d-e38b-4ca2-8b65-295d134baf35 on nch2-master-1 Jan 15 20:55:31.483476 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-7178c087-ded4-486c-a90f-14552ff1db03 req-718e25da-511b-4c43-a530-d09dbe0c8aeb service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050238 Jan 15 20:55:31.484386 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 984/2017] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:55:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:55:31.496204 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-7f28cc75-03e4-41f0-b411-573f3d87d0fd req-f245460a-72a1-442d-8e7a-b0b0aea213e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64e6adc9-543a-4611-89fa-38967f9c5ea4", "tag": "bac9459d-6b17-4ac9-ab8a-15ea5ae1f6cd"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:55:31.499531 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:55:31.499531 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:55:31.509450 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-7f28cc75-03e4-41f0-b411-573f3d87d0fd req-f245460a-72a1-442d-8e7a-b0b0aea213e7 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:31.510286 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-7f28cc75-03e4-41f0-b411-573f3d87d0fd req-f245460a-72a1-442d-8e7a-b0b0aea213e7 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:31.527021 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-7f28cc75-03e4-41f0-b411-573f3d87d0fd req-f245460a-72a1-442d-8e7a-b0b0aea213e7 service nova] Creating event network-changed:bac9459d-6b17-4ac9-ab8a-15ea5ae1f6cd for instance 64e6adc9-543a-4611-89fa-38967f9c5ea4 on nch2-master-1 Jan 15 20:55:31.535758 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-7f28cc75-03e4-41f0-b411-573f3d87d0fd req-f245460a-72a1-442d-8e7a-b0b0aea213e7 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041413 Jan 15 20:55:31.537453 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 985/2018] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:55:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:55:31.543653 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-504feb97-624d-4510-a6d8-6a60c3aac642 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:31.545637 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-504feb97-624d-4510-a6d8-6a60c3aac642 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] [instance: 64e6adc9-543a-4611-89fa-38967f9c5ea4] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:55:31.554483 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-504feb97-624d-4510-a6d8-6a60c3aac642 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:31.555237 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-504feb97-624d-4510-a6d8-6a60c3aac642 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:31.556452 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-504feb97-624d-4510-a6d8-6a60c3aac642 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:31.557307 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-504feb97-624d-4510-a6d8-6a60c3aac642 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:31.970207 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-0318419b-2e87-4b8f-af57-2ea1575e0457 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e1b423e1a9146c8bb202ba012e2ee2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d5d92c87544c4d8080e19c1f6429bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:55:31.982036 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0318419b-2e87-4b8f-af57-2ea1575e0457 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] 10.222.0.46 "GET /compute/v2.1/servers/39b25eb1-ffab-417c-b47d-893dabb85d7c" status: 200 len: 1522 microversion: 2.1 time: 0.639223 Jan 15 20:55:31.982756 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1034/2019] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:55:31 2022] GET /compute/v2.1/servers/39b25eb1-ffab-417c-b47d-893dabb85d7c => generated 1522 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:55:31.987188 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-327e8c73-57b1-475b-a56d-dfba44c59c11 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:31.987785 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-327e8c73-57b1-475b-a56d-dfba44c59c11 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: bdd7983d-e38b-4ca2-8b65-295d134baf35] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:55:32.002249 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-327e8c73-57b1-475b-a56d-dfba44c59c11 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:32.002696 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-327e8c73-57b1-475b-a56d-dfba44c59c11 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:32.003492 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-327e8c73-57b1-475b-a56d-dfba44c59c11 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:32.003921 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-327e8c73-57b1-475b-a56d-dfba44c59c11 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:32.251150 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-504feb97-624d-4510-a6d8-6a60c3aac642 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f5490d676542fcb18b0dd5f5074516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc238c23f15041c583fd50a124461b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:55:32.271898 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-504feb97-624d-4510-a6d8-6a60c3aac642 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] 10.222.0.46 "GET /compute/v2.1/servers/64e6adc9-543a-4611-89fa-38967f9c5ea4" status: 200 len: 1355 microversion: 2.1 time: 0.732684 Jan 15 20:55:32.273581 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 986/2020] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:55:31 2022] GET /compute/v2.1/servers/64e6adc9-543a-4611-89fa-38967f9c5ea4 => generated 1355 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:55:32.285250 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-7599849d-649a-4930-9cbc-56ee2633d674 tempest-FloatingIPDetailsTestJSON-205108975 tempest-FloatingIPDetailsTestJSON-205108975-project] Calling method '.version_select at 0x7f30ceb5eaf0>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:32.715435 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-327e8c73-57b1-475b-a56d-dfba44c59c11 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:55:32.724238 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-327e8c73-57b1-475b-a56d-dfba44c59c11 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/bdd7983d-e38b-4ca2-8b65-295d134baf35" status: 200 len: 1315 microversion: 2.1 time: 0.740217 Jan 15 20:55:32.724773 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1035/2021] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:55:31 2022] GET /compute/v2.1/servers/bdd7983d-e38b-4ca2-8b65-295d134baf35 => generated 1315 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:55:32.742027 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-750a138e-ab36-4704-84d0-a77f7cf9c7a9 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:32.742634 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-750a138e-ab36-4704-84d0-a77f7cf9c7a9 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] [instance: 39b25eb1-ffab-417c-b47d-893dabb85d7c] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:55:32.756625 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-750a138e-ab36-4704-84d0-a77f7cf9c7a9 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:32.757381 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-750a138e-ab36-4704-84d0-a77f7cf9c7a9 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:32.758373 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-750a138e-ab36-4704-84d0-a77f7cf9c7a9 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:32.758970 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-750a138e-ab36-4704-84d0-a77f7cf9c7a9 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:33.378432 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-750a138e-ab36-4704-84d0-a77f7cf9c7a9 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e1b423e1a9146c8bb202ba012e2ee2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d5d92c87544c4d8080e19c1f6429bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:55:33.392228 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-750a138e-ab36-4704-84d0-a77f7cf9c7a9 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] 10.222.0.46 "GET /compute/v2.1/servers/39b25eb1-ffab-417c-b47d-893dabb85d7c" status: 200 len: 1522 microversion: 2.1 time: 0.653890 Jan 15 20:55:33.395376 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1036/2022] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:55:32 2022] GET /compute/v2.1/servers/39b25eb1-ffab-417c-b47d-893dabb85d7c => generated 1522 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:55:33.402833 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-465ae136-e896-42db-878c-67835adcdd12 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:33.405421 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-465ae136-e896-42db-878c-67835adcdd12 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] [instance: 0207c6e5-54cf-4b26-b1e7-ed649dac8bb9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:55:33.414396 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-465ae136-e896-42db-878c-67835adcdd12 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:33.416974 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-465ae136-e896-42db-878c-67835adcdd12 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:33.418728 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-465ae136-e896-42db-878c-67835adcdd12 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:33.419391 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-465ae136-e896-42db-878c-67835adcdd12 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:33.807613 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-465ae136-e896-42db-878c-67835adcdd12 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ec114f8ece434aa496cd401494e2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a05b1a0a7479db84b762eca23b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:55:33.821447 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-465ae136-e896-42db-878c-67835adcdd12 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] 10.222.0.46 "GET /compute/v2.1/servers/0207c6e5-54cf-4b26-b1e7-ed649dac8bb9" status: 200 len: 1310 microversion: 2.1 time: 0.424481 Jan 15 20:55:33.824170 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1037/2023] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:55:33 2022] GET /compute/v2.1/servers/0207c6e5-54cf-4b26-b1e7-ed649dac8bb9 => generated 1310 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:55:33.830385 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4183e515-f4fd-4b71-a082-cc9e085a6097 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:55:33.832558 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-4183e515-f4fd-4b71-a082-cc9e085a6097 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] [instance: b1eb0bef-5aaf-46d6-8739-b12303df9842] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:55:33.843738 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4183e515-f4fd-4b71-a082-cc9e085a6097 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:33.844376 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4183e515-f4fd-4b71-a082-cc9e085a6097 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:33.845977 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4183e515-f4fd-4b71-a082-cc9e085a6097 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:33.846593 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4183e515-f4fd-4b71-a082-cc9e085a6097 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:33.909732 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-4183e515-f4fd-4b71-a082-cc9e085a6097 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] 10.222.0.46 "POST /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842/action" status: 200 len: 14 microversion: 2.1 time: 0.083441 Jan 15 20:55:33.915058 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1038/2024] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:55:33 2022] POST /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842/action => generated 14 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 20:55:33.926049 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-b61e2cc5-a0a3-454c-a488-eff2faaf07b3 req-09af87d5-3269-4660-93dc-0d92d8ad3c26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1eb0bef-5aaf-46d6-8739-b12303df9842", "tag": "d4128316-d1ff-46a8-817e-082539cee097"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:55:33.931766 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:55:33.931766 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:55:33.950779 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-b61e2cc5-a0a3-454c-a488-eff2faaf07b3 req-09af87d5-3269-4660-93dc-0d92d8ad3c26 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:33.951956 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-b61e2cc5-a0a3-454c-a488-eff2faaf07b3 req-09af87d5-3269-4660-93dc-0d92d8ad3c26 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:33.968611 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-b61e2cc5-a0a3-454c-a488-eff2faaf07b3 req-09af87d5-3269-4660-93dc-0d92d8ad3c26 service nova] Creating event network-changed:d4128316-d1ff-46a8-817e-082539cee097 for instance b1eb0bef-5aaf-46d6-8739-b12303df9842 on nch1-master-1 Jan 15 20:55:33.974054 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-b61e2cc5-a0a3-454c-a488-eff2faaf07b3 req-09af87d5-3269-4660-93dc-0d92d8ad3c26 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057967 Jan 15 20:55:33.975176 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1039/2025] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:55:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:55:34.166588 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-3981a247-576a-40e8-ad47-0761becddf8f tempest-FloatingIPsNegativeTestJSON-841409211 tempest-FloatingIPsNegativeTestJSON-841409211-project] Calling method '.version_select at 0x7f30ceccc310>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:34.627712 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-3981a247-576a-40e8-ad47-0761becddf8f tempest-FloatingIPsNegativeTestJSON-841409211 tempest-FloatingIPsNegativeTestJSON-841409211-project] 10.222.0.46 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.651051 Jan 15 20:55:34.628566 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1040/2026] 10.222.0.46 () {58 vars in 1148 bytes} [Sat Jan 15 20:55:33 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 20:55:34.636565 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0b8c5ba5-7709-4c29-8080-364a957b6ba1 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:34.638366 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-0b8c5ba5-7709-4c29-8080-364a957b6ba1 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] [instance: 64e6adc9-543a-4611-89fa-38967f9c5ea4] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:55:34.647685 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0b8c5ba5-7709-4c29-8080-364a957b6ba1 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:34.648389 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0b8c5ba5-7709-4c29-8080-364a957b6ba1 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:34.649221 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0b8c5ba5-7709-4c29-8080-364a957b6ba1 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:34.649670 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0b8c5ba5-7709-4c29-8080-364a957b6ba1 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:34.663372 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-7599849d-649a-4930-9cbc-56ee2633d674 tempest-FloatingIPDetailsTestJSON-205108975 tempest-FloatingIPDetailsTestJSON-205108975-project] 10.222.0.46 "DELETE /compute/v2.1/os-floating-ips/98708624-8e23-467b-8dd6-283fd90d922f" status: 202 len: 0 microversion: 2.1 time: 2.381580 Jan 15 20:55:34.669579 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 987/2027] 10.222.0.46 () {58 vars in 1262 bytes} [Sat Jan 15 20:55:32 2022] DELETE /compute/v2.1/os-floating-ips/98708624-8e23-467b-8dd6-283fd90d922f => generated 0 bytes in 2392 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 20:55:34.676349 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-55508182-5036-465b-87fb-d86659023607 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-314398833"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:55:34.678286 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-55508182-5036-465b-87fb-d86659023607 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] [instance: 39b25eb1-ffab-417c-b47d-893dabb85d7c] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:55:34.686456 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-55508182-5036-465b-87fb-d86659023607 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:34.686923 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-55508182-5036-465b-87fb-d86659023607 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:34.687835 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-55508182-5036-465b-87fb-d86659023607 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:34.688289 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-55508182-5036-465b-87fb-d86659023607 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:35.020089 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-55508182-5036-465b-87fb-d86659023607 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] 10.222.0.46 "POST /compute/v2.1/servers/39b25eb1-ffab-417c-b47d-893dabb85d7c/action" status: 202 len: 0 microversion: 2.1 time: 0.348880 Jan 15 20:55:35.021722 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 988/2028] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:55:34 2022] POST /compute/v2.1/servers/39b25eb1-ffab-417c-b47d-893dabb85d7c/action => generated 0 bytes in 351 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jan 15 20:55:35.040571 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-2b667e78-d979-431d-9ad5-1bc187006ed4 req-4cbc2438-8b6c-421e-aa9e-3f1accfb18e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64e6adc9-543a-4611-89fa-38967f9c5ea4", "tag": "4eaf05ca-1d8c-4f0d-b68a-e770667b374f"}, {"name": "network-changed", "server_uuid": "64e6adc9-543a-4611-89fa-38967f9c5ea4", "tag": "6bd959ef-20f3-40bb-aa81-6fa73d256727"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:55:35.047726 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:55:35.047726 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:55:35.061803 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-2b667e78-d979-431d-9ad5-1bc187006ed4 req-4cbc2438-8b6c-421e-aa9e-3f1accfb18e0 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:35.062819 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-2b667e78-d979-431d-9ad5-1bc187006ed4 req-4cbc2438-8b6c-421e-aa9e-3f1accfb18e0 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:35.066223 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-0b8c5ba5-7709-4c29-8080-364a957b6ba1 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f5490d676542fcb18b0dd5f5074516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc238c23f15041c583fd50a124461b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:55:35.073948 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0b8c5ba5-7709-4c29-8080-364a957b6ba1 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] 10.222.0.46 "GET /compute/v2.1/servers/64e6adc9-543a-4611-89fa-38967f9c5ea4" status: 200 len: 1355 microversion: 2.1 time: 0.444016 Jan 15 20:55:35.074540 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1041/2029] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:55:34 2022] GET /compute/v2.1/servers/64e6adc9-543a-4611-89fa-38967f9c5ea4 => generated 1355 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:55:35.089506 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-738a2b6e-d95a-4d7a-9ea3-98e029939025 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:35.093648 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-738a2b6e-d95a-4d7a-9ea3-98e029939025 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: bdd7983d-e38b-4ca2-8b65-295d134baf35] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:55:35.096790 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-2b667e78-d979-431d-9ad5-1bc187006ed4 req-4cbc2438-8b6c-421e-aa9e-3f1accfb18e0 service nova] Creating event network-changed:4eaf05ca-1d8c-4f0d-b68a-e770667b374f for instance 64e6adc9-543a-4611-89fa-38967f9c5ea4 on nch2-master-1 Jan 15 20:55:35.097535 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-2b667e78-d979-431d-9ad5-1bc187006ed4 req-4cbc2438-8b6c-421e-aa9e-3f1accfb18e0 service nova] Creating event network-changed:6bd959ef-20f3-40bb-aa81-6fa73d256727 for instance 64e6adc9-543a-4611-89fa-38967f9c5ea4 on nch2-master-1 Jan 15 20:55:35.105894 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-2b667e78-d979-431d-9ad5-1bc187006ed4 req-4cbc2438-8b6c-421e-aa9e-3f1accfb18e0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.081995 Jan 15 20:55:35.106938 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-738a2b6e-d95a-4d7a-9ea3-98e029939025 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:35.107880 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 989/2030] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:55:35 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:55:35.109402 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-738a2b6e-d95a-4d7a-9ea3-98e029939025 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:35.110231 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-738a2b6e-d95a-4d7a-9ea3-98e029939025 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:35.110668 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-738a2b6e-d95a-4d7a-9ea3-98e029939025 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:35.134679 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-6a2839e5-f897-4b30-8273-63c84da9283a tempest-FloatingIPsNegativeTestJSON-841409211 tempest-FloatingIPsNegativeTestJSON-841409211-project] Action: 'create', calling method: .version_select at 0x7f30ceb5f700>, body: {"pool": "non_exist_pool"} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:55:35.190272 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-6a2839e5-f897-4b30-8273-63c84da9283a tempest-FloatingIPsNegativeTestJSON-841409211 tempest-FloatingIPsNegativeTestJSON-841409211-project] HTTP exception thrown: Floating IP pool not found. Jan 15 20:55:35.192370 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-6a2839e5-f897-4b30-8273-63c84da9283a tempest-FloatingIPsNegativeTestJSON-841409211 tempest-FloatingIPsNegativeTestJSON-841409211-project] Returning 404 to user: Floating IP pool not found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:55:35.199037 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-6a2839e5-f897-4b30-8273-63c84da9283a tempest-FloatingIPsNegativeTestJSON-841409211 tempest-FloatingIPsNegativeTestJSON-841409211-project] 10.222.0.46 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.088897 Jan 15 20:55:35.201668 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 990/2031] 10.222.0.46 () {60 vars in 1169 bytes} [Sat Jan 15 20:55:35 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jan 15 20:55:35.212151 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-728ae274-11f2-43bd-904b-c8e4d578d085 tempest-FloatingIPDetailsTestJSON-205108975 tempest-FloatingIPDetailsTestJSON-205108975-project] Calling method '.version_select at 0x7f30ceb02ca0>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:35.652834 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-738a2b6e-d95a-4d7a-9ea3-98e029939025 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:55:35.662154 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-738a2b6e-d95a-4d7a-9ea3-98e029939025 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/bdd7983d-e38b-4ca2-8b65-295d134baf35" status: 200 len: 1502 microversion: 2.1 time: 0.576127 Jan 15 20:55:35.663391 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1042/2032] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:55:35 2022] GET /compute/v2.1/servers/bdd7983d-e38b-4ca2-8b65-295d134baf35 => generated 1502 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:55:35.670220 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4992a295-c78f-439f-a053-141e71e904f9 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:35.671430 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-4992a295-c78f-439f-a053-141e71e904f9 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] [instance: 0207c6e5-54cf-4b26-b1e7-ed649dac8bb9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:55:35.683986 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4992a295-c78f-439f-a053-141e71e904f9 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:35.685143 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4992a295-c78f-439f-a053-141e71e904f9 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:35.686268 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4992a295-c78f-439f-a053-141e71e904f9 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:35.686902 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4992a295-c78f-439f-a053-141e71e904f9 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:36.539780 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-4992a295-c78f-439f-a053-141e71e904f9 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ec114f8ece434aa496cd401494e2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a05b1a0a7479db84b762eca23b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:55:36.550747 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-4992a295-c78f-439f-a053-141e71e904f9 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] 10.222.0.46 "GET /compute/v2.1/servers/0207c6e5-54cf-4b26-b1e7-ed649dac8bb9" status: 200 len: 1310 microversion: 2.1 time: 0.885691 Jan 15 20:55:36.555720 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1043/2033] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:55:35 2022] GET /compute/v2.1/servers/0207c6e5-54cf-4b26-b1e7-ed649dac8bb9 => generated 1310 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:55:36.575343 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b7f33ff9-5967-410f-8cfb-1d18483e5234 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:55:36.580437 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b7f33ff9-5967-410f-8cfb-1d18483e5234 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] [instance: b1eb0bef-5aaf-46d6-8739-b12303df9842] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:55:36.587685 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b7f33ff9-5967-410f-8cfb-1d18483e5234 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:36.588507 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b7f33ff9-5967-410f-8cfb-1d18483e5234 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:36.589572 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b7f33ff9-5967-410f-8cfb-1d18483e5234 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:36.590164 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b7f33ff9-5967-410f-8cfb-1d18483e5234 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:36.663115 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b7f33ff9-5967-410f-8cfb-1d18483e5234 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] 10.222.0.46 "POST /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842/action" status: 200 len: 16390 microversion: 2.1 time: 0.096087 Jan 15 20:55:36.664212 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1044/2034] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:55:36 2022] POST /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842/action => generated 16390 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:55:36.670986 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9c1407a9-a828-4a4e-840b-746acbab7036 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Calling method '.version_select at 0x7f30cec8a820>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:36.849260 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-9c1407a9-a828-4a4e-840b-746acbab7036 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] 10.222.0.46 "DELETE /compute/v2.1/images/d1c9da41-1c3c-4367-ad6f-677f623acafb" status: 204 len: 0 microversion: 2.1 time: 0.183164 Jan 15 20:55:36.853480 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1045/2035] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:55:36 2022] DELETE /compute/v2.1/images/d1c9da41-1c3c-4367-ad6f-677f623acafb => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 20:55:36.859234 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-989899b1-1059-4da2-b610-7c53389369e0 tempest-FloatingIPsNegativeTestJSON-841409211 tempest-FloatingIPsNegativeTestJSON-841409211-project] Calling method '.version_select at 0x7f30ceccc670>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:36.971286 ncdv-master-1 devstack@n-api.service[129366]: DEBUG neutronclient.v2_0.client [None req-989899b1-1059-4da2-b610-7c53389369e0 tempest-FloatingIPsNegativeTestJSON-841409211 tempest-FloatingIPsNegativeTestJSON-841409211-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 03edd991-ae68-4c3c-bd66-5033e689d208 could not be found", "detail": ""}} {{(pid=129366) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jan 15 20:55:36.972493 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-989899b1-1059-4da2-b610-7c53389369e0 tempest-FloatingIPsNegativeTestJSON-841409211 tempest-FloatingIPsNegativeTestJSON-841409211-project] HTTP exception thrown: Floating IP not found for ID 03edd991-ae68-4c3c-bd66-5033e689d208 Jan 15 20:55:36.973385 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-989899b1-1059-4da2-b610-7c53389369e0 tempest-FloatingIPsNegativeTestJSON-841409211 tempest-FloatingIPsNegativeTestJSON-841409211-project] Returning 404 to user: Floating IP not found for ID 03edd991-ae68-4c3c-bd66-5033e689d208 {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:55:36.973970 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-989899b1-1059-4da2-b610-7c53389369e0 tempest-FloatingIPsNegativeTestJSON-841409211 tempest-FloatingIPsNegativeTestJSON-841409211-project] 10.222.0.46 "DELETE /compute/v2.1/os-floating-ips/03edd991-ae68-4c3c-bd66-5033e689d208" status: 404 len: 111 microversion: 2.1 time: 0.119281 Jan 15 20:55:36.974758 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1046/2036] 10.222.0.46 () {58 vars in 1262 bytes} [Sat Jan 15 20:55:36 2022] DELETE /compute/v2.1/os-floating-ips/03edd991-ae68-4c3c-bd66-5033e689d208 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:55:36.979901 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-46762e1d-6b0a-42a3-88b8-c0dffc5e0d74 req-55790e3a-5dd5-40d8-ad49-5476d4c6fb0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0207c6e5-54cf-4b26-b1e7-ed649dac8bb9", "name": "network-vif-plugged", "status": "completed", "tag": "32c4b362-d25a-4492-abc2-6267bd6efe0b"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:55:36.984034 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:55:36.984034 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:55:36.998032 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-46762e1d-6b0a-42a3-88b8-c0dffc5e0d74 req-55790e3a-5dd5-40d8-ad49-5476d4c6fb0b service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:36.998716 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-46762e1d-6b0a-42a3-88b8-c0dffc5e0d74 req-55790e3a-5dd5-40d8-ad49-5476d4c6fb0b service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:37.010295 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-46762e1d-6b0a-42a3-88b8-c0dffc5e0d74 req-55790e3a-5dd5-40d8-ad49-5476d4c6fb0b service nova] Creating event network-vif-plugged:32c4b362-d25a-4492-abc2-6267bd6efe0b for instance 0207c6e5-54cf-4b26-b1e7-ed649dac8bb9 on nch1-master-1 Jan 15 20:55:37.016334 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-46762e1d-6b0a-42a3-88b8-c0dffc5e0d74 req-55790e3a-5dd5-40d8-ad49-5476d4c6fb0b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040146 Jan 15 20:55:37.017684 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1047/2037] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:55:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:55:37.024159 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a7102df0-7b93-4df5-b5b9-d63144926e70 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:37.025121 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a7102df0-7b93-4df5-b5b9-d63144926e70 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] [instance: 64e6adc9-543a-4611-89fa-38967f9c5ea4] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:55:37.033503 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a7102df0-7b93-4df5-b5b9-d63144926e70 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:37.034251 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a7102df0-7b93-4df5-b5b9-d63144926e70 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:37.035237 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a7102df0-7b93-4df5-b5b9-d63144926e70 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:37.035846 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a7102df0-7b93-4df5-b5b9-d63144926e70 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:38.288939 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-a7102df0-7b93-4df5-b5b9-d63144926e70 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f5490d676542fcb18b0dd5f5074516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc238c23f15041c583fd50a124461b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:55:38.301951 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a7102df0-7b93-4df5-b5b9-d63144926e70 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] 10.222.0.46 "GET /compute/v2.1/servers/64e6adc9-543a-4611-89fa-38967f9c5ea4" status: 200 len: 1355 microversion: 2.1 time: 1.282775 Jan 15 20:55:38.303147 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1048/2038] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:55:37 2022] GET /compute/v2.1/servers/64e6adc9-543a-4611-89fa-38967f9c5ea4 => generated 1355 bytes in 1285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:55:38.309376 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b7d8cc18-dc35-4877-99d6-e0a5b8acf2e9 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Calling method '.version_select at 0x7f30ceccc280>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:38.335450 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-b7d8cc18-dc35-4877-99d6-e0a5b8acf2e9 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] HTTP exception thrown: Image not found. Jan 15 20:55:38.336279 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b7d8cc18-dc35-4877-99d6-e0a5b8acf2e9 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Returning 404 to user: Image not found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:55:38.337757 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b7d8cc18-dc35-4877-99d6-e0a5b8acf2e9 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] 10.222.0.46 "GET /compute/v2.1/images/d1c9da41-1c3c-4367-ad6f-677f623acafb" status: 404 len: 62 microversion: 2.1 time: 0.032960 Jan 15 20:55:38.338791 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1049/2039] 10.222.0.46 () {58 vars in 1232 bytes} [Sat Jan 15 20:55:38 2022] GET /compute/v2.1/images/d1c9da41-1c3c-4367-ad6f-677f623acafb => generated 62 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jan 15 20:55:38.344885 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-3ea1ffe3-972d-4675-8d70-0eed3d2fed61 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f729234b-9e2a-49f0-a5ab-900a73084f63"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:55:38.346313 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-3ea1ffe3-972d-4675-8d70-0eed3d2fed61 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: bdd7983d-e38b-4ca2-8b65-295d134baf35] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:55:38.355350 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3ea1ffe3-972d-4675-8d70-0eed3d2fed61 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:38.356812 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3ea1ffe3-972d-4675-8d70-0eed3d2fed61 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:38.357941 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3ea1ffe3-972d-4675-8d70-0eed3d2fed61 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:38.358660 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3ea1ffe3-972d-4675-8d70-0eed3d2fed61 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:38.385403 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-728ae274-11f2-43bd-904b-c8e4d578d085 tempest-FloatingIPDetailsTestJSON-205108975 tempest-FloatingIPDetailsTestJSON-205108975-project] 10.222.0.46 "DELETE /compute/v2.1/os-floating-ips/305cae71-c2ed-4dcb-8bcf-28bba11cee80" status: 202 len: 0 microversion: 2.1 time: 3.182198 Jan 15 20:55:38.387398 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 991/2040] 10.222.0.46 () {58 vars in 1262 bytes} [Sat Jan 15 20:55:35 2022] DELETE /compute/v2.1/os-floating-ips/305cae71-c2ed-4dcb-8bcf-28bba11cee80 => generated 0 bytes in 3185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 20:55:38.394504 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-20e5caac-44bc-4cb1-b287-0cdb2c5cb6a5 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:38.396454 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-20e5caac-44bc-4cb1-b287-0cdb2c5cb6a5 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] [instance: 0207c6e5-54cf-4b26-b1e7-ed649dac8bb9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:55:38.411726 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-20e5caac-44bc-4cb1-b287-0cdb2c5cb6a5 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:38.414110 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-20e5caac-44bc-4cb1-b287-0cdb2c5cb6a5 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:38.416990 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-20e5caac-44bc-4cb1-b287-0cdb2c5cb6a5 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:38.418399 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-20e5caac-44bc-4cb1-b287-0cdb2c5cb6a5 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:38.740489 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-3ea1ffe3-972d-4675-8d70-0eed3d2fed61 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "POST /compute/v2.1/servers/bdd7983d-e38b-4ca2-8b65-295d134baf35/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.400119 Jan 15 20:55:38.741307 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1050/2041] 10.222.0.46 () {60 vars in 1322 bytes} [Sat Jan 15 20:55:38 2022] POST /compute/v2.1/servers/bdd7983d-e38b-4ca2-8b65-295d134baf35/os-volume_attachments => generated 194 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:55:38.748207 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-447dc078-a5af-46a5-9884-28a07a36c970 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:55:38.749882 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-447dc078-a5af-46a5-9884-28a07a36c970 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] [instance: b1eb0bef-5aaf-46d6-8739-b12303df9842] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:55:38.759561 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-447dc078-a5af-46a5-9884-28a07a36c970 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:38.760454 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-447dc078-a5af-46a5-9884-28a07a36c970 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:38.761912 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-447dc078-a5af-46a5-9884-28a07a36c970 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:38.762894 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-447dc078-a5af-46a5-9884-28a07a36c970 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:38.821766 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-447dc078-a5af-46a5-9884-28a07a36c970 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] 10.222.0.46 "POST /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842/action" status: 200 len: 16390 microversion: 2.1 time: 0.078715 Jan 15 20:55:38.824251 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1051/2042] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:55:38 2022] POST /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842/action => generated 16390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:55:38.834726 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-76e28a38-de76-489b-b4dd-dcb79023c394 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:38.835422 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-76e28a38-de76-489b-b4dd-dcb79023c394 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] [instance: 39b25eb1-ffab-417c-b47d-893dabb85d7c] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:55:38.850406 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-76e28a38-de76-489b-b4dd-dcb79023c394 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:38.850920 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-76e28a38-de76-489b-b4dd-dcb79023c394 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:38.851723 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-76e28a38-de76-489b-b4dd-dcb79023c394 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:38.852152 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-76e28a38-de76-489b-b4dd-dcb79023c394 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:38.867508 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-20e5caac-44bc-4cb1-b287-0cdb2c5cb6a5 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ec114f8ece434aa496cd401494e2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a05b1a0a7479db84b762eca23b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:55:38.878856 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-20e5caac-44bc-4cb1-b287-0cdb2c5cb6a5 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] 10.222.0.46 "GET /compute/v2.1/servers/0207c6e5-54cf-4b26-b1e7-ed649dac8bb9" status: 200 len: 1310 microversion: 2.1 time: 0.490105 Jan 15 20:55:38.880172 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 992/2043] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:55:38 2022] GET /compute/v2.1/servers/0207c6e5-54cf-4b26-b1e7-ed649dac8bb9 => generated 1310 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:55:39.198977 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-76e28a38-de76-489b-b4dd-dcb79023c394 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e1b423e1a9146c8bb202ba012e2ee2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d5d92c87544c4d8080e19c1f6429bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:55:39.209663 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-76e28a38-de76-489b-b4dd-dcb79023c394 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] 10.222.0.46 "GET /compute/v2.1/servers/39b25eb1-ffab-417c-b47d-893dabb85d7c" status: 200 len: 1522 microversion: 2.1 time: 0.381778 Jan 15 20:55:39.210322 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1052/2044] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:55:38 2022] GET /compute/v2.1/servers/39b25eb1-ffab-417c-b47d-893dabb85d7c => generated 1522 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:55:39.229957 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2fa55ead-3cfe-4eab-aa1a-269475584a31 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:39.231475 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-2fa55ead-3cfe-4eab-aa1a-269475584a31 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] [instance: 39b25eb1-ffab-417c-b47d-893dabb85d7c] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:55:39.262160 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2fa55ead-3cfe-4eab-aa1a-269475584a31 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:39.263223 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2fa55ead-3cfe-4eab-aa1a-269475584a31 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:39.270151 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2fa55ead-3cfe-4eab-aa1a-269475584a31 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:39.270634 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2fa55ead-3cfe-4eab-aa1a-269475584a31 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:39.320204 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-835cc26c-8e50-45ae-8b64-163f3e85d0cd tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:39.320941 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-835cc26c-8e50-45ae-8b64-163f3e85d0cd tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] [instance: 64e6adc9-543a-4611-89fa-38967f9c5ea4] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:55:39.328867 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-835cc26c-8e50-45ae-8b64-163f3e85d0cd tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:39.329361 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-835cc26c-8e50-45ae-8b64-163f3e85d0cd tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:39.330169 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-835cc26c-8e50-45ae-8b64-163f3e85d0cd tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:39.330633 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-835cc26c-8e50-45ae-8b64-163f3e85d0cd tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:39.345624 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-2fa55ead-3cfe-4eab-aa1a-269475584a31 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] [instance: 39b25eb1-ffab-417c-b47d-893dabb85d7c] Going to try to terminate instance {{(pid=129365) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 20:55:39.532697 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2fa55ead-3cfe-4eab-aa1a-269475584a31 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] 10.222.0.46 "DELETE /compute/v2.1/servers/39b25eb1-ffab-417c-b47d-893dabb85d7c" status: 204 len: 0 microversion: 2.1 time: 0.309428 Jan 15 20:55:39.536336 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 993/2045] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 20:55:39 2022] DELETE /compute/v2.1/servers/39b25eb1-ffab-417c-b47d-893dabb85d7c => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 20:55:39.551265 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-daf51f97-2ff9-4975-be39-023ef9ea34bd tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:39.552787 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-daf51f97-2ff9-4975-be39-023ef9ea34bd tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] [instance: 39b25eb1-ffab-417c-b47d-893dabb85d7c] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:55:39.584732 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-daf51f97-2ff9-4975-be39-023ef9ea34bd tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:39.585684 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-daf51f97-2ff9-4975-be39-023ef9ea34bd tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:39.586978 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-daf51f97-2ff9-4975-be39-023ef9ea34bd tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:39.587691 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-daf51f97-2ff9-4975-be39-023ef9ea34bd tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:39.733114 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-835cc26c-8e50-45ae-8b64-163f3e85d0cd tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f5490d676542fcb18b0dd5f5074516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc238c23f15041c583fd50a124461b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:55:39.749278 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-835cc26c-8e50-45ae-8b64-163f3e85d0cd tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] 10.222.0.46 "GET /compute/v2.1/servers/64e6adc9-543a-4611-89fa-38967f9c5ea4" status: 200 len: 1355 microversion: 2.1 time: 0.432808 Jan 15 20:55:39.759324 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1053/2046] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:55:39 2022] GET /compute/v2.1/servers/64e6adc9-543a-4611-89fa-38967f9c5ea4 => generated 1355 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:55:39.835600 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-3a43d61d-dd44-4c1a-8934-20bb153cac9d tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:55:39.836570 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-3a43d61d-dd44-4c1a-8934-20bb153cac9d tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] [instance: b1eb0bef-5aaf-46d6-8739-b12303df9842] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:55:39.850084 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3a43d61d-dd44-4c1a-8934-20bb153cac9d tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:39.857561 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3a43d61d-dd44-4c1a-8934-20bb153cac9d tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:39.858788 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3a43d61d-dd44-4c1a-8934-20bb153cac9d tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:39.859396 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3a43d61d-dd44-4c1a-8934-20bb153cac9d tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:39.947134 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-3a43d61d-dd44-4c1a-8934-20bb153cac9d tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] 10.222.0.46 "POST /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842/action" status: 200 len: 24560 microversion: 2.1 time: 0.113726 Jan 15 20:55:39.951107 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1054/2047] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:55:39 2022] POST /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842/action => generated 24560 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:55:39.961450 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-32f3b237-9000-4fb8-8161-91bd5f8bbe60 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:39.962169 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-32f3b237-9000-4fb8-8161-91bd5f8bbe60 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] [instance: 0207c6e5-54cf-4b26-b1e7-ed649dac8bb9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:55:39.976645 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-32f3b237-9000-4fb8-8161-91bd5f8bbe60 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:39.977139 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-32f3b237-9000-4fb8-8161-91bd5f8bbe60 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:39.983469 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-32f3b237-9000-4fb8-8161-91bd5f8bbe60 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:39.984121 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-32f3b237-9000-4fb8-8161-91bd5f8bbe60 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:40.043464 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-daf51f97-2ff9-4975-be39-023ef9ea34bd tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e1b423e1a9146c8bb202ba012e2ee2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d5d92c87544c4d8080e19c1f6429bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:55:40.057277 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-daf51f97-2ff9-4975-be39-023ef9ea34bd tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] 10.222.0.46 "GET /compute/v2.1/servers/39b25eb1-ffab-417c-b47d-893dabb85d7c" status: 200 len: 1528 microversion: 2.1 time: 0.517583 Jan 15 20:55:40.059885 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 994/2048] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:55:39 2022] GET /compute/v2.1/servers/39b25eb1-ffab-417c-b47d-893dabb85d7c => generated 1528 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:55:40.264649 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-32f3b237-9000-4fb8-8161-91bd5f8bbe60 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ec114f8ece434aa496cd401494e2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a05b1a0a7479db84b762eca23b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:55:40.274632 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-32f3b237-9000-4fb8-8161-91bd5f8bbe60 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] 10.222.0.46 "GET /compute/v2.1/servers/0207c6e5-54cf-4b26-b1e7-ed649dac8bb9" status: 200 len: 1493 microversion: 2.1 time: 0.320082 Jan 15 20:55:40.276915 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1055/2049] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:55:39 2022] GET /compute/v2.1/servers/0207c6e5-54cf-4b26-b1e7-ed649dac8bb9 => generated 1493 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:55:40.426447 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-44e4ed80-d5e2-4ca2-98be-ab39f24e0928 tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:40.427349 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-44e4ed80-d5e2-4ca2-98be-ab39f24e0928 tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] [instance: 0207c6e5-54cf-4b26-b1e7-ed649dac8bb9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:55:40.434922 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-44e4ed80-d5e2-4ca2-98be-ab39f24e0928 tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:40.435769 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-44e4ed80-d5e2-4ca2-98be-ab39f24e0928 tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:40.436918 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-44e4ed80-d5e2-4ca2-98be-ab39f24e0928 tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:40.437515 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-44e4ed80-d5e2-4ca2-98be-ab39f24e0928 tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:40.772052 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7cfe6b0d-9d1b-4c72-b31d-c1e7c4b47b22 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:40.772656 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-7cfe6b0d-9d1b-4c72-b31d-c1e7c4b47b22 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] [instance: 64e6adc9-543a-4611-89fa-38967f9c5ea4] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:55:40.783712 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7cfe6b0d-9d1b-4c72-b31d-c1e7c4b47b22 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:40.784164 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7cfe6b0d-9d1b-4c72-b31d-c1e7c4b47b22 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:40.788430 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7cfe6b0d-9d1b-4c72-b31d-c1e7c4b47b22 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:40.798388 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7cfe6b0d-9d1b-4c72-b31d-c1e7c4b47b22 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:41.071784 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-44e4ed80-d5e2-4ca2-98be-ab39f24e0928 tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/0207c6e5-54cf-4b26-b1e7-ed649dac8bb9" status: 200 len: 1644 microversion: 2.1 time: 0.782922 Jan 15 20:55:41.073732 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 995/2050] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:55:40 2022] GET /compute/v2.1/servers/0207c6e5-54cf-4b26-b1e7-ed649dac8bb9 => generated 1644 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:55:41.085889 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-988e7fdc-0d92-44e6-9ef3-7e0f4dc7c066 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:55:41.087748 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-988e7fdc-0d92-44e6-9ef3-7e0f4dc7c066 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] [instance: b1eb0bef-5aaf-46d6-8739-b12303df9842] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:55:41.110322 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-988e7fdc-0d92-44e6-9ef3-7e0f4dc7c066 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:41.111089 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-988e7fdc-0d92-44e6-9ef3-7e0f4dc7c066 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:41.114862 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-988e7fdc-0d92-44e6-9ef3-7e0f4dc7c066 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:41.115551 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-988e7fdc-0d92-44e6-9ef3-7e0f4dc7c066 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:41.201728 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-988e7fdc-0d92-44e6-9ef3-7e0f4dc7c066 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] 10.222.0.46 "POST /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842/action" status: 200 len: 24560 microversion: 2.1 time: 0.122175 Jan 15 20:55:41.203175 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 996/2051] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:55:41 2022] POST /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842/action => generated 24560 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:55:41.213086 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e670dea1-8937-43a7-bddb-85da4d995074 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:41.214092 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e670dea1-8937-43a7-bddb-85da4d995074 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] [instance: 39b25eb1-ffab-417c-b47d-893dabb85d7c] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:55:41.224049 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e670dea1-8937-43a7-bddb-85da4d995074 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:41.224700 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e670dea1-8937-43a7-bddb-85da4d995074 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:41.225725 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e670dea1-8937-43a7-bddb-85da4d995074 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:41.226331 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e670dea1-8937-43a7-bddb-85da4d995074 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:41.476772 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-7cfe6b0d-9d1b-4c72-b31d-c1e7c4b47b22 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f5490d676542fcb18b0dd5f5074516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc238c23f15041c583fd50a124461b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:55:41.487972 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7cfe6b0d-9d1b-4c72-b31d-c1e7c4b47b22 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] 10.222.0.46 "GET /compute/v2.1/servers/64e6adc9-543a-4611-89fa-38967f9c5ea4" status: 200 len: 1355 microversion: 2.1 time: 0.722623 Jan 15 20:55:41.488713 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1056/2052] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:55:40 2022] GET /compute/v2.1/servers/64e6adc9-543a-4611-89fa-38967f9c5ea4 => generated 1355 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:55:41.513016 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-74b8e7d1-4e1f-4b5f-978a-8b5704784eab tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:41.521770 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-74b8e7d1-4e1f-4b5f-978a-8b5704784eab tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] [instance: 0207c6e5-54cf-4b26-b1e7-ed649dac8bb9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:55:41.533983 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-74b8e7d1-4e1f-4b5f-978a-8b5704784eab tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:41.551133 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-74b8e7d1-4e1f-4b5f-978a-8b5704784eab tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:41.558300 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-74b8e7d1-4e1f-4b5f-978a-8b5704784eab tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:41.559015 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-74b8e7d1-4e1f-4b5f-978a-8b5704784eab tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:41.680390 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-e670dea1-8937-43a7-bddb-85da4d995074 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e1b423e1a9146c8bb202ba012e2ee2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d5d92c87544c4d8080e19c1f6429bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:55:41.692527 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e670dea1-8937-43a7-bddb-85da4d995074 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] 10.222.0.46 "GET /compute/v2.1/servers/39b25eb1-ffab-417c-b47d-893dabb85d7c" status: 200 len: 1528 microversion: 2.1 time: 0.487874 Jan 15 20:55:41.712933 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 997/2053] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:55:41 2022] GET /compute/v2.1/servers/39b25eb1-ffab-417c-b47d-893dabb85d7c => generated 1528 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:55:41.972644 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-74b8e7d1-4e1f-4b5f-978a-8b5704784eab tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/0207c6e5-54cf-4b26-b1e7-ed649dac8bb9" status: 200 len: 1644 microversion: 2.1 time: 0.472028 Jan 15 20:55:41.987031 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1057/2054] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:55:41 2022] GET /compute/v2.1/servers/0207c6e5-54cf-4b26-b1e7-ed649dac8bb9 => generated 1644 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:55:41.990503 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e404a3af-54ed-41bd-a2b4-dd06299e401e tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:41.992569 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:55:41.992569 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:55:41.995139 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e404a3af-54ed-41bd-a2b4-dd06299e401e tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:41.996054 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e404a3af-54ed-41bd-a2b4-dd06299e401e tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:42.010375 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e404a3af-54ed-41bd-a2b4-dd06299e401e tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:42.011070 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e404a3af-54ed-41bd-a2b4-dd06299e401e tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:42.040273 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e404a3af-54ed-41bd-a2b4-dd06299e401e tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] 10.222.0.46 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.053798 Jan 15 20:55:42.046388 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 998/2055] 10.222.0.46 () {58 vars in 1175 bytes} [Sat Jan 15 20:55:41 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:55:42.062422 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-93f572a9-cb69-4ec0-bb83-62555b4439ba tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:55:42.065048 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-93f572a9-cb69-4ec0-bb83-62555b4439ba tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] [instance: 0207c6e5-54cf-4b26-b1e7-ed649dac8bb9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:55:42.071309 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-93f572a9-cb69-4ec0-bb83-62555b4439ba tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:42.071996 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-93f572a9-cb69-4ec0-bb83-62555b4439ba tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:42.072803 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-93f572a9-cb69-4ec0-bb83-62555b4439ba tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:42.073811 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-93f572a9-cb69-4ec0-bb83-62555b4439ba tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:42.120431 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.objects.instance [None req-93f572a9-cb69-4ec0-bb83-62555b4439ba tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Lazy-loading 'flavor' on Instance uuid 0207c6e5-54cf-4b26-b1e7-ed649dac8bb9 {{(pid=129366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 20:55:42.148360 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-93f572a9-cb69-4ec0-bb83-62555b4439ba tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] [instance: 0207c6e5-54cf-4b26-b1e7-ed649dac8bb9] Going to try to live migrate instance to nch2-master-1 {{(pid=129366) live_migrate /opt/stack/nova/nova/compute/api.py:5255}} Jan 15 20:55:42.214625 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2f5fe116-49e1-4665-80cb-011e3e53b9a4 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:55:42.216812 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-2f5fe116-49e1-4665-80cb-011e3e53b9a4 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] [instance: b1eb0bef-5aaf-46d6-8739-b12303df9842] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:55:42.235311 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2f5fe116-49e1-4665-80cb-011e3e53b9a4 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:42.239016 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2f5fe116-49e1-4665-80cb-011e3e53b9a4 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:42.240781 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2f5fe116-49e1-4665-80cb-011e3e53b9a4 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:42.244862 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2f5fe116-49e1-4665-80cb-011e3e53b9a4 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:42.359302 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2f5fe116-49e1-4665-80cb-011e3e53b9a4 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] 10.222.0.46 "POST /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842/action" status: 200 len: 24560 microversion: 2.1 time: 0.144072 Jan 15 20:55:42.364139 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 999/2056] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:55:42 2022] POST /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842/action => generated 24560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 20:55:42.381089 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-94694812-fe12-4933-b42b-f4879df431c9 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:42.381700 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-94694812-fe12-4933-b42b-f4879df431c9 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: bdd7983d-e38b-4ca2-8b65-295d134baf35] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:55:42.403978 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-94694812-fe12-4933-b42b-f4879df431c9 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:42.406461 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-94694812-fe12-4933-b42b-f4879df431c9 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:42.408445 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-94694812-fe12-4933-b42b-f4879df431c9 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:42.410208 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-94694812-fe12-4933-b42b-f4879df431c9 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:42.495803 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-94694812-fe12-4933-b42b-f4879df431c9 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: bdd7983d-e38b-4ca2-8b65-295d134baf35] Going to try to terminate instance {{(pid=129365) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 20:55:42.658184 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-94694812-fe12-4933-b42b-f4879df431c9 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "DELETE /compute/v2.1/servers/bdd7983d-e38b-4ca2-8b65-295d134baf35" status: 204 len: 0 microversion: 2.1 time: 0.292390 Jan 15 20:55:42.658888 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1000/2057] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 20:55:42 2022] DELETE /compute/v2.1/servers/bdd7983d-e38b-4ca2-8b65-295d134baf35 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 20:55:42.666164 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-362665d3-4ad1-452c-bb45-0ad971048345 req-9353d05c-3f36-4aa3-817e-efd2c2e2ffec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64e6adc9-543a-4611-89fa-38967f9c5ea4", "name": "network-vif-plugged", "status": "completed", "tag": "6bd959ef-20f3-40bb-aa81-6fa73d256727"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:55:42.674783 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:55:42.674783 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:55:42.690282 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-362665d3-4ad1-452c-bb45-0ad971048345 req-9353d05c-3f36-4aa3-817e-efd2c2e2ffec service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:42.690769 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-362665d3-4ad1-452c-bb45-0ad971048345 req-9353d05c-3f36-4aa3-817e-efd2c2e2ffec service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:42.725095 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-362665d3-4ad1-452c-bb45-0ad971048345 req-9353d05c-3f36-4aa3-817e-efd2c2e2ffec service nova] Creating event network-vif-plugged:6bd959ef-20f3-40bb-aa81-6fa73d256727 for instance 64e6adc9-543a-4611-89fa-38967f9c5ea4 on nch2-master-1 Jan 15 20:55:42.730537 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-362665d3-4ad1-452c-bb45-0ad971048345 req-9353d05c-3f36-4aa3-817e-efd2c2e2ffec service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069797 Jan 15 20:55:42.734406 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1001/2058] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:55:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:55:42.744339 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-57bb3702-4eb1-41c9-a16a-eee9424c231c tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:42.745097 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-57bb3702-4eb1-41c9-a16a-eee9424c231c tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] [instance: 64e6adc9-543a-4611-89fa-38967f9c5ea4] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:55:42.757760 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-57bb3702-4eb1-41c9-a16a-eee9424c231c tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:42.758218 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-57bb3702-4eb1-41c9-a16a-eee9424c231c tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:42.759057 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-57bb3702-4eb1-41c9-a16a-eee9424c231c tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:42.759457 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-57bb3702-4eb1-41c9-a16a-eee9424c231c tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:43.315955 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-57bb3702-4eb1-41c9-a16a-eee9424c231c tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f5490d676542fcb18b0dd5f5074516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc238c23f15041c583fd50a124461b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:55:43.326099 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-57bb3702-4eb1-41c9-a16a-eee9424c231c tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] 10.222.0.46 "GET /compute/v2.1/servers/64e6adc9-543a-4611-89fa-38967f9c5ea4" status: 200 len: 1355 microversion: 2.1 time: 0.590212 Jan 15 20:55:43.331599 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1002/2059] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:55:42 2022] GET /compute/v2.1/servers/64e6adc9-543a-4611-89fa-38967f9c5ea4 => generated 1355 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:55:43.339258 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-22753710-c389-481c-bd53-7fd475ca0273 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:43.342657 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-22753710-c389-481c-bd53-7fd475ca0273 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: bdd7983d-e38b-4ca2-8b65-295d134baf35] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:55:43.376366 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-22753710-c389-481c-bd53-7fd475ca0273 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:43.377082 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-22753710-c389-481c-bd53-7fd475ca0273 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:43.377917 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-22753710-c389-481c-bd53-7fd475ca0273 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:43.378529 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-22753710-c389-481c-bd53-7fd475ca0273 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:43.688118 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-22753710-c389-481c-bd53-7fd475ca0273 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:55:43.709012 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-22753710-c389-481c-bd53-7fd475ca0273 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/bdd7983d-e38b-4ca2-8b65-295d134baf35" status: 200 len: 1554 microversion: 2.1 time: 0.375079 Jan 15 20:55:43.710731 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1003/2060] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:55:43 2022] GET /compute/v2.1/servers/bdd7983d-e38b-4ca2-8b65-295d134baf35 => generated 1554 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:55:43.718950 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-85cc1c65-a091-4601-93a3-ae2a997db031 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:43.719568 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-85cc1c65-a091-4601-93a3-ae2a997db031 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] [instance: 39b25eb1-ffab-417c-b47d-893dabb85d7c] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:55:43.748326 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-85cc1c65-a091-4601-93a3-ae2a997db031 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:43.748774 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-85cc1c65-a091-4601-93a3-ae2a997db031 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:43.749605 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-85cc1c65-a091-4601-93a3-ae2a997db031 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:43.750043 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-85cc1c65-a091-4601-93a3-ae2a997db031 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:43.878975 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-85cc1c65-a091-4601-93a3-ae2a997db031 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e1b423e1a9146c8bb202ba012e2ee2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d5d92c87544c4d8080e19c1f6429bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:55:43.887985 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-85cc1c65-a091-4601-93a3-ae2a997db031 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] 10.222.0.46 "GET /compute/v2.1/servers/39b25eb1-ffab-417c-b47d-893dabb85d7c" status: 200 len: 1486 microversion: 2.1 time: 0.175396 Jan 15 20:55:43.893055 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1004/2061] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:55:43 2022] GET /compute/v2.1/servers/39b25eb1-ffab-417c-b47d-893dabb85d7c => generated 1486 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:55:43.904453 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9b72e705-190b-4a97-93b4-26a3f9062e53 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:55:43.906061 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-9b72e705-190b-4a97-93b4-26a3f9062e53 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] [instance: b1eb0bef-5aaf-46d6-8739-b12303df9842] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:55:43.917585 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9b72e705-190b-4a97-93b4-26a3f9062e53 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:43.919504 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9b72e705-190b-4a97-93b4-26a3f9062e53 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:43.922474 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9b72e705-190b-4a97-93b4-26a3f9062e53 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:43.924761 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9b72e705-190b-4a97-93b4-26a3f9062e53 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:43.995994 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-9b72e705-190b-4a97-93b4-26a3f9062e53 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] 10.222.0.46 "POST /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842/action" status: 200 len: 24560 microversion: 2.1 time: 0.100732 Jan 15 20:55:43.996930 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1005/2062] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:55:43 2022] POST /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842/action => generated 24560 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:55:44.219899 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-2c7a291f-953f-47c9-a916-dcf4ae760e26 req-3a9aa3cb-a960-4b10-9bad-c5879bba68fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39b25eb1-ffab-417c-b47d-893dabb85d7c", "name": "network-vif-deleted", "tag": "9fdb652e-4fff-4829-a594-2e6365d0ca3f"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:55:44.222249 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:55:44.222249 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:55:44.241589 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-2c7a291f-953f-47c9-a916-dcf4ae760e26 req-3a9aa3cb-a960-4b10-9bad-c5879bba68fd service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:44.242429 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-2c7a291f-953f-47c9-a916-dcf4ae760e26 req-3a9aa3cb-a960-4b10-9bad-c5879bba68fd service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:44.275325 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-2c7a291f-953f-47c9-a916-dcf4ae760e26 req-3a9aa3cb-a960-4b10-9bad-c5879bba68fd service nova] Creating event network-vif-deleted:9fdb652e-4fff-4829-a594-2e6365d0ca3f for instance 39b25eb1-ffab-417c-b47d-893dabb85d7c on nch2-master-1 Jan 15 20:55:44.292215 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-2c7a291f-953f-47c9-a916-dcf4ae760e26 req-3a9aa3cb-a960-4b10-9bad-c5879bba68fd service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095769 Jan 15 20:55:44.294861 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1006/2063] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:55:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 20:55:44.349004 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-13ded724-75e4-45c6-9cab-db3904107bb9 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:44.349731 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-13ded724-75e4-45c6-9cab-db3904107bb9 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] [instance: 64e6adc9-543a-4611-89fa-38967f9c5ea4] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:55:44.364614 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-13ded724-75e4-45c6-9cab-db3904107bb9 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:44.366834 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-13ded724-75e4-45c6-9cab-db3904107bb9 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:44.370669 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-13ded724-75e4-45c6-9cab-db3904107bb9 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:44.371304 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-13ded724-75e4-45c6-9cab-db3904107bb9 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:44.867120 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-13ded724-75e4-45c6-9cab-db3904107bb9 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f5490d676542fcb18b0dd5f5074516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc238c23f15041c583fd50a124461b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:55:44.877863 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-13ded724-75e4-45c6-9cab-db3904107bb9 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] 10.222.0.46 "GET /compute/v2.1/servers/64e6adc9-543a-4611-89fa-38967f9c5ea4" status: 200 len: 1355 microversion: 2.1 time: 0.532845 Jan 15 20:55:44.889961 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1007/2064] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:55:44 2022] GET /compute/v2.1/servers/64e6adc9-543a-4611-89fa-38967f9c5ea4 => generated 1355 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:55:44.889961 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-6baa0290-7748-4f9a-aa10-ad713df8f739 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:44.889961 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-6baa0290-7748-4f9a-aa10-ad713df8f739 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: bdd7983d-e38b-4ca2-8b65-295d134baf35] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:55:44.899513 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6baa0290-7748-4f9a-aa10-ad713df8f739 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:44.900023 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6baa0290-7748-4f9a-aa10-ad713df8f739 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:44.901584 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6baa0290-7748-4f9a-aa10-ad713df8f739 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:44.902065 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6baa0290-7748-4f9a-aa10-ad713df8f739 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:45.249258 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-6baa0290-7748-4f9a-aa10-ad713df8f739 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:55:45.267314 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-6baa0290-7748-4f9a-aa10-ad713df8f739 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/bdd7983d-e38b-4ca2-8b65-295d134baf35" status: 200 len: 1554 microversion: 2.1 time: 0.383056 Jan 15 20:55:45.268792 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1008/2065] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:55:44 2022] GET /compute/v2.1/servers/bdd7983d-e38b-4ca2-8b65-295d134baf35 => generated 1554 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:55:45.286675 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-7ec43acd-bb46-4f59-9020-1fa37b25b1b4 req-8ab8cedf-6aa8-4ec8-902d-c6ccada83733 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64e6adc9-543a-4611-89fa-38967f9c5ea4", "name": "network-vif-plugged", "status": "completed", "tag": "4eaf05ca-1d8c-4f0d-b68a-e770667b374f"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:55:45.290920 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:55:45.290920 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:55:45.301682 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-7ec43acd-bb46-4f59-9020-1fa37b25b1b4 req-8ab8cedf-6aa8-4ec8-902d-c6ccada83733 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:45.302375 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-7ec43acd-bb46-4f59-9020-1fa37b25b1b4 req-8ab8cedf-6aa8-4ec8-902d-c6ccada83733 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:45.326988 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-7ec43acd-bb46-4f59-9020-1fa37b25b1b4 req-8ab8cedf-6aa8-4ec8-902d-c6ccada83733 service nova] Creating event network-vif-plugged:4eaf05ca-1d8c-4f0d-b68a-e770667b374f for instance 64e6adc9-543a-4611-89fa-38967f9c5ea4 on nch2-master-1 Jan 15 20:55:45.333726 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-7ec43acd-bb46-4f59-9020-1fa37b25b1b4 req-8ab8cedf-6aa8-4ec8-902d-c6ccada83733 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063410 Jan 15 20:55:45.335188 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1009/2066] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:55:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:55:45.345010 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a16f9ec8-5af8-4b5f-bf34-460f92b3d41d tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:45.345931 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a16f9ec8-5af8-4b5f-bf34-460f92b3d41d tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] [instance: 39b25eb1-ffab-417c-b47d-893dabb85d7c] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:55:45.386329 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a16f9ec8-5af8-4b5f-bf34-460f92b3d41d tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:45.386934 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a16f9ec8-5af8-4b5f-bf34-460f92b3d41d tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:45.389980 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a16f9ec8-5af8-4b5f-bf34-460f92b3d41d tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:45.390420 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a16f9ec8-5af8-4b5f-bf34-460f92b3d41d tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:45.409128 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-a16f9ec8-5af8-4b5f-bf34-460f92b3d41d tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] HTTP exception thrown: Instance 39b25eb1-ffab-417c-b47d-893dabb85d7c could not be found. Jan 15 20:55:45.410136 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a16f9ec8-5af8-4b5f-bf34-460f92b3d41d tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Returning 404 to user: Instance 39b25eb1-ffab-417c-b47d-893dabb85d7c could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:55:45.410967 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a16f9ec8-5af8-4b5f-bf34-460f92b3d41d tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] 10.222.0.46 "GET /compute/v2.1/servers/39b25eb1-ffab-417c-b47d-893dabb85d7c" status: 404 len: 111 microversion: 2.1 time: 0.074233 Jan 15 20:55:45.411539 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1010/2067] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:55:45 2022] GET /compute/v2.1/servers/39b25eb1-ffab-417c-b47d-893dabb85d7c => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:55:45.416417 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-4ea8c496-b07d-4d16-b55c-b47013c066ff tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:55:45.417311 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-4ea8c496-b07d-4d16-b55c-b47013c066ff tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] [instance: b1eb0bef-5aaf-46d6-8739-b12303df9842] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:55:45.429717 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4ea8c496-b07d-4d16-b55c-b47013c066ff tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:45.431257 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4ea8c496-b07d-4d16-b55c-b47013c066ff tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:45.432292 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4ea8c496-b07d-4d16-b55c-b47013c066ff tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:45.433570 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4ea8c496-b07d-4d16-b55c-b47013c066ff tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:45.495177 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-4ea8c496-b07d-4d16-b55c-b47013c066ff tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] 10.222.0.46 "POST /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842/action" status: 200 len: 24560 microversion: 2.1 time: 0.076297 Jan 15 20:55:45.497401 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1011/2068] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:55:45 2022] POST /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842/action => generated 24560 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:55:45.580245 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-93f572a9-cb69-4ec0-bb83-62555b4439ba tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] 10.222.0.46 "POST /compute/v2.1/servers/0207c6e5-54cf-4b26-b1e7-ed649dac8bb9/action" status: 202 len: 0 microversion: 2.1 time: 3.524184 Jan 15 20:55:45.585867 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1058/2069] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:55:42 2022] POST /compute/v2.1/servers/0207c6e5-54cf-4b26-b1e7-ed649dac8bb9/action => generated 0 bytes in 3531 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 20:55:45.598380 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-1504bfea-cc1a-4764-afbe-7c8c4e95e978 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:45.599163 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-1504bfea-cc1a-4764-afbe-7c8c4e95e978 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] [instance: 0207c6e5-54cf-4b26-b1e7-ed649dac8bb9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:55:45.656765 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b86f78e4-6469-44c4-85b3-a8cfce9e0aaa tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-361373390", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b7ee6eaf-eda1-43c9-9d45-4bb747012a97"}]}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:55:45.672102 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1504bfea-cc1a-4764-afbe-7c8c4e95e978 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:45.677757 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1504bfea-cc1a-4764-afbe-7c8c4e95e978 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:45.682405 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1504bfea-cc1a-4764-afbe-7c8c4e95e978 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:45.685049 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1504bfea-cc1a-4764-afbe-7c8c4e95e978 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:45.770927 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.network.neutron [None req-b86f78e4-6469-44c4-85b3-a8cfce9e0aaa tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] validate_networks() for [('b7ee6eaf-eda1-43c9-9d45-4bb747012a97', None, None, None, None, None)] {{(pid=129366) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 20:55:46.445285 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-1504bfea-cc1a-4764-afbe-7c8c4e95e978 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ec114f8ece434aa496cd401494e2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a05b1a0a7479db84b762eca23b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:55:46.453614 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-1504bfea-cc1a-4764-afbe-7c8c4e95e978 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] 10.222.0.46 "GET /compute/v2.1/servers/0207c6e5-54cf-4b26-b1e7-ed649dac8bb9" status: 200 len: 1503 microversion: 2.1 time: 0.866102 Jan 15 20:55:46.454200 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1012/2070] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:55:45 2022] GET /compute/v2.1/servers/0207c6e5-54cf-4b26-b1e7-ed649dac8bb9 => generated 1503 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:55:46.609150 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d460fe96-e988-47ed-acc6-ff0e2e553d49 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Action: 'create', calling method: .version_select at 0x7f30ceb02670>, body: {"keypair": {"name": "tempest-keypair-2076036038"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:55:46.631965 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-d460fe96-e988-47ed-acc6-ff0e2e553d49 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Getting quotas for project dca2cdba56c74d46a478aff355b23447. Resources: {'key_pairs'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:55:46.649475 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-d460fe96-e988-47ed-acc6-ff0e2e553d49 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Getting quotas for user ca4c2db123e34ed9bdba89f7150ebcf6 and project dca2cdba56c74d46a478aff355b23447. Resources: {'key_pairs'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:55:46.847367 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-d460fe96-e988-47ed-acc6-ff0e2e553d49 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Getting quotas for project dca2cdba56c74d46a478aff355b23447. Resources: {'key_pairs'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:55:46.863821 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-d460fe96-e988-47ed-acc6-ff0e2e553d49 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Getting quotas for user ca4c2db123e34ed9bdba89f7150ebcf6 and project dca2cdba56c74d46a478aff355b23447. Resources: {'key_pairs'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:55:46.890256 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d460fe96-e988-47ed-acc6-ff0e2e553d49 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.435027 Jan 15 20:55:46.897358 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1013/2071] 10.222.0.46 () {60 vars in 1157 bytes} [Sat Jan 15 20:55:46 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:55:46.906191 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-dabbb1f4-4b07-40e2-b09b-26bb7498ea6f tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:46.907071 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-dabbb1f4-4b07-40e2-b09b-26bb7498ea6f tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] [instance: 64e6adc9-543a-4611-89fa-38967f9c5ea4] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:55:46.919604 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dabbb1f4-4b07-40e2-b09b-26bb7498ea6f tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:46.920201 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dabbb1f4-4b07-40e2-b09b-26bb7498ea6f tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:46.921298 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dabbb1f4-4b07-40e2-b09b-26bb7498ea6f tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:46.922196 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dabbb1f4-4b07-40e2-b09b-26bb7498ea6f tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:46.944698 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-b86f78e4-6469-44c4-85b3-a8cfce9e0aaa tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Flavor limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 20:55:46.945248 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-b86f78e4-6469-44c4-85b3-a8cfce9e0aaa tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Image limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 20:55:46.945770 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-b86f78e4-6469-44c4-85b3-a8cfce9e0aaa tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Flavor pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 20:55:46.947324 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-b86f78e4-6469-44c4-85b3-a8cfce9e0aaa tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Image pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 20:55:46.947868 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-b86f78e4-6469-44c4-85b3-a8cfce9e0aaa tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 20:55:47.009853 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b86f78e4-6469-44c4-85b3-a8cfce9e0aaa tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:47.011977 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b86f78e4-6469-44c4-85b3-a8cfce9e0aaa tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:47.016519 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b86f78e4-6469-44c4-85b3-a8cfce9e0aaa tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:47.021558 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b86f78e4-6469-44c4-85b3-a8cfce9e0aaa tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:47.107369 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-b86f78e4-6469-44c4-85b3-a8cfce9e0aaa tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Getting quotas for project f6d5d92c87544c4d8080e19c1f6429bf. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:55:47.123960 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-b86f78e4-6469-44c4-85b3-a8cfce9e0aaa tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Getting quotas for user 2e1b423e1a9146c8bb202ba012e2ee2a and project f6d5d92c87544c4d8080e19c1f6429bf. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:55:47.174768 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b86f78e4-6469-44c4-85b3-a8cfce9e0aaa tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Going to run 1 instances... {{(pid=129366) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 20:55:47.182831 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b86f78e4-6469-44c4-85b3-a8cfce9e0aaa tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] [instance: a0856a94-f8a0-4fac-904b-8809dd0123c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 20:55:47.201843 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-dabbb1f4-4b07-40e2-b09b-26bb7498ea6f tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f5490d676542fcb18b0dd5f5074516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc238c23f15041c583fd50a124461b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:55:47.215543 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-dabbb1f4-4b07-40e2-b09b-26bb7498ea6f tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] 10.222.0.46 "GET /compute/v2.1/servers/64e6adc9-543a-4611-89fa-38967f9c5ea4" status: 200 len: 1355 microversion: 2.1 time: 0.316481 Jan 15 20:55:47.216147 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1014/2072] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:55:46 2022] GET /compute/v2.1/servers/64e6adc9-543a-4611-89fa-38967f9c5ea4 => generated 1355 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:55:47.223122 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d59d3ea5-c1e9-46af-a4a5-b3f4a5948e3e tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:47.223881 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d59d3ea5-c1e9-46af-a4a5-b3f4a5948e3e tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: bdd7983d-e38b-4ca2-8b65-295d134baf35] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:55:47.241566 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d59d3ea5-c1e9-46af-a4a5-b3f4a5948e3e tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:47.242832 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d59d3ea5-c1e9-46af-a4a5-b3f4a5948e3e tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:47.243747 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d59d3ea5-c1e9-46af-a4a5-b3f4a5948e3e tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:47.247396 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d59d3ea5-c1e9-46af-a4a5-b3f4a5948e3e tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:47.261588 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b86f78e4-6469-44c4-85b3-a8cfce9e0aaa tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.611443 Jan 15 20:55:47.265330 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1059/2073] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 20:55:45 2022] POST /compute/v2.1/servers => generated 383 bytes in 1616 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 20:55:47.274426 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f05a1bcf-59aa-4bc3-855c-dc111831375a tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:55:47.275427 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f05a1bcf-59aa-4bc3-855c-dc111831375a tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] [instance: b1eb0bef-5aaf-46d6-8739-b12303df9842] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:55:47.297172 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f05a1bcf-59aa-4bc3-855c-dc111831375a tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:47.298095 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f05a1bcf-59aa-4bc3-855c-dc111831375a tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:47.311603 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f05a1bcf-59aa-4bc3-855c-dc111831375a tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:47.317220 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f05a1bcf-59aa-4bc3-855c-dc111831375a tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:47.318460 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d59d3ea5-c1e9-46af-a4a5-b3f4a5948e3e tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:47.318910 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d59d3ea5-c1e9-46af-a4a5-b3f4a5948e3e tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:47.319384 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.objects.instance [None req-d59d3ea5-c1e9-46af-a4a5-b3f4a5948e3e tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lazy-loading 'fault' on Instance uuid bdd7983d-e38b-4ca2-8b65-295d134baf35 {{(pid=129365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 20:55:47.431373 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-d59d3ea5-c1e9-46af-a4a5-b3f4a5948e3e tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:55:47.448345 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d59d3ea5-c1e9-46af-a4a5-b3f4a5948e3e tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/bdd7983d-e38b-4ca2-8b65-295d134baf35" status: 200 len: 1351 microversion: 2.1 time: 0.228352 Jan 15 20:55:47.450689 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1015/2074] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:55:47 2022] GET /compute/v2.1/servers/bdd7983d-e38b-4ca2-8b65-295d134baf35 => generated 1351 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:55:47.454694 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f05a1bcf-59aa-4bc3-855c-dc111831375a tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] 10.222.0.46 "POST /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842/action" status: 200 len: 24560 microversion: 2.1 time: 0.187889 Jan 15 20:55:47.464272 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-d5d588ba-19a7-471e-b1d7-08c5660d98d1 req-5c53a6bc-92f6-4b24-88bd-01b5af40b40c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdd7983d-e38b-4ca2-8b65-295d134baf35", "name": "network-vif-deleted", "tag": "cb54b931-8990-43b4-9c30-39ab45e72beb"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:55:47.470579 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:55:47.470579 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:55:47.474440 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1060/2075] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:55:47 2022] POST /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842/action => generated 24560 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:55:47.504023 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-d5d588ba-19a7-471e-b1d7-08c5660d98d1 req-5c53a6bc-92f6-4b24-88bd-01b5af40b40c service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:47.504332 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-d5d588ba-19a7-471e-b1d7-08c5660d98d1 req-5c53a6bc-92f6-4b24-88bd-01b5af40b40c service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:47.507624 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-fe434ad1-991f-4f44-8a64-643066478ef9 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:47.508471 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-fe434ad1-991f-4f44-8a64-643066478ef9 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] [instance: a0856a94-f8a0-4fac-904b-8809dd0123c9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:55:47.549132 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-d5d588ba-19a7-471e-b1d7-08c5660d98d1 req-5c53a6bc-92f6-4b24-88bd-01b5af40b40c service nova] Creating event network-vif-deleted:cb54b931-8990-43b4-9c30-39ab45e72beb for instance bdd7983d-e38b-4ca2-8b65-295d134baf35 on nch2-master-1 Jan 15 20:55:47.562184 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-d5d588ba-19a7-471e-b1d7-08c5660d98d1 req-5c53a6bc-92f6-4b24-88bd-01b5af40b40c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107704 Jan 15 20:55:47.563628 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1016/2076] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:55:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:55:47.569271 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-0c4865b3-20fd-46cf-976d-df38a019085c req-0a29eff2-8d73-4705-9be1-f797501a56b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64e6adc9-543a-4611-89fa-38967f9c5ea4", "name": "network-vif-plugged", "status": "completed", "tag": "bac9459d-6b17-4ac9-ab8a-15ea5ae1f6cd"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:55:47.571255 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:55:47.571255 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:55:47.605686 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-0c4865b3-20fd-46cf-976d-df38a019085c req-0a29eff2-8d73-4705-9be1-f797501a56b3 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:47.606906 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-0c4865b3-20fd-46cf-976d-df38a019085c req-0a29eff2-8d73-4705-9be1-f797501a56b3 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:47.619847 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-fe434ad1-991f-4f44-8a64-643066478ef9 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e1b423e1a9146c8bb202ba012e2ee2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d5d92c87544c4d8080e19c1f6429bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:55:47.628776 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-fe434ad1-991f-4f44-8a64-643066478ef9 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] 10.222.0.46 "GET /compute/v2.1/servers/a0856a94-f8a0-4fac-904b-8809dd0123c9" status: 200 len: 1224 microversion: 2.1 time: 0.152974 Jan 15 20:55:47.632327 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1061/2077] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:55:47 2022] GET /compute/v2.1/servers/a0856a94-f8a0-4fac-904b-8809dd0123c9 => generated 1224 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:55:47.638807 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-0c4865b3-20fd-46cf-976d-df38a019085c req-0a29eff2-8d73-4705-9be1-f797501a56b3 service nova] Creating event network-vif-plugged:bac9459d-6b17-4ac9-ab8a-15ea5ae1f6cd for instance 64e6adc9-543a-4611-89fa-38967f9c5ea4 on nch2-master-1 Jan 15 20:55:47.641726 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f5f6cb79-2b58-4792-83bc-8b93c97fa53d tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:47.642181 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f5f6cb79-2b58-4792-83bc-8b93c97fa53d tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] [instance: 0207c6e5-54cf-4b26-b1e7-ed649dac8bb9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:55:47.652933 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-0c4865b3-20fd-46cf-976d-df38a019085c req-0a29eff2-8d73-4705-9be1-f797501a56b3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087379 Jan 15 20:55:47.655114 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f5f6cb79-2b58-4792-83bc-8b93c97fa53d tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:47.655819 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f5f6cb79-2b58-4792-83bc-8b93c97fa53d tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:47.656348 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1017/2078] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:55:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:55:47.657228 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f5f6cb79-2b58-4792-83bc-8b93c97fa53d tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:47.657765 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f5f6cb79-2b58-4792-83bc-8b93c97fa53d tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:48.071591 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-f5f6cb79-2b58-4792-83bc-8b93c97fa53d tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ec114f8ece434aa496cd401494e2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a05b1a0a7479db84b762eca23b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:55:48.081907 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f5f6cb79-2b58-4792-83bc-8b93c97fa53d tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] 10.222.0.46 "GET /compute/v2.1/servers/0207c6e5-54cf-4b26-b1e7-ed649dac8bb9" status: 200 len: 1503 microversion: 2.1 time: 0.448377 Jan 15 20:55:48.085122 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1062/2079] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:55:47 2022] GET /compute/v2.1/servers/0207c6e5-54cf-4b26-b1e7-ed649dac8bb9 => generated 1503 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:55:48.233445 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-199d7525-4f2b-4d85-8774-9ef73396bbd1 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:48.234411 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-199d7525-4f2b-4d85-8774-9ef73396bbd1 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] [instance: 64e6adc9-543a-4611-89fa-38967f9c5ea4] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:55:48.247804 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-199d7525-4f2b-4d85-8774-9ef73396bbd1 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:48.250766 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-199d7525-4f2b-4d85-8774-9ef73396bbd1 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:48.265347 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-199d7525-4f2b-4d85-8774-9ef73396bbd1 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:48.265916 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-199d7525-4f2b-4d85-8774-9ef73396bbd1 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:48.467569 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e990ea0b-22fa-456a-9cf9-5c663ca0a0e4 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:48.468328 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e990ea0b-22fa-456a-9cf9-5c663ca0a0e4 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: bdd7983d-e38b-4ca2-8b65-295d134baf35] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:55:48.478449 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e990ea0b-22fa-456a-9cf9-5c663ca0a0e4 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:48.478944 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e990ea0b-22fa-456a-9cf9-5c663ca0a0e4 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:48.479787 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e990ea0b-22fa-456a-9cf9-5c663ca0a0e4 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:48.481634 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e990ea0b-22fa-456a-9cf9-5c663ca0a0e4 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:48.524058 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-e990ea0b-22fa-456a-9cf9-5c663ca0a0e4 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] HTTP exception thrown: Instance bdd7983d-e38b-4ca2-8b65-295d134baf35 could not be found. Jan 15 20:55:48.524660 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e990ea0b-22fa-456a-9cf9-5c663ca0a0e4 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Returning 404 to user: Instance bdd7983d-e38b-4ca2-8b65-295d134baf35 could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:55:48.529788 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e990ea0b-22fa-456a-9cf9-5c663ca0a0e4 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/bdd7983d-e38b-4ca2-8b65-295d134baf35" status: 404 len: 111 microversion: 2.1 time: 0.066419 Jan 15 20:55:48.538342 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1063/2080] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:55:48 2022] GET /compute/v2.1/servers/bdd7983d-e38b-4ca2-8b65-295d134baf35 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:55:48.544434 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a857b0b0-c11d-4223-ab17-9555e261401d tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:55:48.557345 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a857b0b0-c11d-4223-ab17-9555e261401d tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] [instance: b1eb0bef-5aaf-46d6-8739-b12303df9842] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:55:48.565651 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a857b0b0-c11d-4223-ab17-9555e261401d tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:48.568607 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a857b0b0-c11d-4223-ab17-9555e261401d tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:48.569781 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a857b0b0-c11d-4223-ab17-9555e261401d tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:48.570821 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a857b0b0-c11d-4223-ab17-9555e261401d tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:48.640907 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a857b0b0-c11d-4223-ab17-9555e261401d tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] 10.222.0.46 "POST /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842/action" status: 200 len: 24560 microversion: 2.1 time: 0.100771 Jan 15 20:55:48.642122 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1064/2081] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:55:48 2022] POST /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842/action => generated 24560 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:55:48.649233 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-832ea2fc-ca95-46e9-8d94-a39a98b30b38 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:48.650423 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-832ea2fc-ca95-46e9-8d94-a39a98b30b38 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] [instance: a0856a94-f8a0-4fac-904b-8809dd0123c9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:55:48.667651 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-832ea2fc-ca95-46e9-8d94-a39a98b30b38 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:48.669384 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-832ea2fc-ca95-46e9-8d94-a39a98b30b38 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:48.671751 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-832ea2fc-ca95-46e9-8d94-a39a98b30b38 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:48.672745 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-832ea2fc-ca95-46e9-8d94-a39a98b30b38 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:48.708343 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-199d7525-4f2b-4d85-8774-9ef73396bbd1 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f5490d676542fcb18b0dd5f5074516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc238c23f15041c583fd50a124461b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:55:48.746235 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-199d7525-4f2b-4d85-8774-9ef73396bbd1 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] 10.222.0.46 "GET /compute/v2.1/servers/64e6adc9-543a-4611-89fa-38967f9c5ea4" status: 200 len: 1355 microversion: 2.1 time: 0.510370 Jan 15 20:55:48.752021 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1018/2082] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:55:48 2022] GET /compute/v2.1/servers/64e6adc9-543a-4611-89fa-38967f9c5ea4 => generated 1355 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:55:48.826673 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a94ddd35-408e-4a14-b572-0e61cf77d20a tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:48.827950 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a94ddd35-408e-4a14-b572-0e61cf77d20a tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: bdd7983d-e38b-4ca2-8b65-295d134baf35] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:55:48.835673 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a94ddd35-408e-4a14-b572-0e61cf77d20a tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:48.836461 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a94ddd35-408e-4a14-b572-0e61cf77d20a tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:48.837535 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a94ddd35-408e-4a14-b572-0e61cf77d20a tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:48.839277 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a94ddd35-408e-4a14-b572-0e61cf77d20a tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:48.862118 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-a94ddd35-408e-4a14-b572-0e61cf77d20a tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] HTTP exception thrown: Instance bdd7983d-e38b-4ca2-8b65-295d134baf35 could not be found. Jan 15 20:55:48.864127 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a94ddd35-408e-4a14-b572-0e61cf77d20a tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Returning 404 to user: Instance bdd7983d-e38b-4ca2-8b65-295d134baf35 could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:55:48.865599 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a94ddd35-408e-4a14-b572-0e61cf77d20a tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/bdd7983d-e38b-4ca2-8b65-295d134baf35/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.050941 Jan 15 20:55:48.867083 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1019/2083] 10.222.0.46 () {58 vars in 1301 bytes} [Sat Jan 15 20:55:48 2022] GET /compute/v2.1/servers/bdd7983d-e38b-4ca2-8b65-295d134baf35/os-volume_attachments => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 15 20:55:48.950393 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-832ea2fc-ca95-46e9-8d94-a39a98b30b38 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e1b423e1a9146c8bb202ba012e2ee2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d5d92c87544c4d8080e19c1f6429bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:55:48.959539 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-832ea2fc-ca95-46e9-8d94-a39a98b30b38 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] 10.222.0.46 "GET /compute/v2.1/servers/a0856a94-f8a0-4fac-904b-8809dd0123c9" status: 200 len: 1276 microversion: 2.1 time: 0.315291 Jan 15 20:55:48.963817 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1065/2084] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:55:48 2022] GET /compute/v2.1/servers/a0856a94-f8a0-4fac-904b-8809dd0123c9 => generated 1276 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:55:49.107355 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-da340ed2-7775-4192-91fb-c2dfade36f31 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:49.108049 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-da340ed2-7775-4192-91fb-c2dfade36f31 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] [instance: 0207c6e5-54cf-4b26-b1e7-ed649dac8bb9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:55:49.139049 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-da340ed2-7775-4192-91fb-c2dfade36f31 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:49.144625 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-da340ed2-7775-4192-91fb-c2dfade36f31 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:49.148398 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-da340ed2-7775-4192-91fb-c2dfade36f31 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:49.150164 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-da340ed2-7775-4192-91fb-c2dfade36f31 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:49.341620 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7fd37858-3374-4b03-8115-e62645f8f5b9 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-121244520", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "networks": [{"uuid": "531bba45-51d6-4df1-9e47-d4b8172e5210"}]}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:55:49.474742 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.network.neutron [None req-7fd37858-3374-4b03-8115-e62645f8f5b9 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] validate_networks() for [('531bba45-51d6-4df1-9e47-d4b8172e5210', None, None, None, None, None)] {{(pid=129366) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 20:55:49.577576 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-da340ed2-7775-4192-91fb-c2dfade36f31 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ec114f8ece434aa496cd401494e2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a05b1a0a7479db84b762eca23b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:55:49.589055 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-da340ed2-7775-4192-91fb-c2dfade36f31 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] 10.222.0.46 "GET /compute/v2.1/servers/0207c6e5-54cf-4b26-b1e7-ed649dac8bb9" status: 200 len: 1503 microversion: 2.1 time: 0.489700 Jan 15 20:55:49.593040 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1020/2085] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:55:49 2022] GET /compute/v2.1/servers/0207c6e5-54cf-4b26-b1e7-ed649dac8bb9 => generated 1503 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:55:49.654961 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-431f0a36-9452-41cb-b09d-5bb247fd02df tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:55:49.656875 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-431f0a36-9452-41cb-b09d-5bb247fd02df tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] [instance: b1eb0bef-5aaf-46d6-8739-b12303df9842] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:55:49.674254 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-431f0a36-9452-41cb-b09d-5bb247fd02df tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:49.674713 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-431f0a36-9452-41cb-b09d-5bb247fd02df tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:49.675709 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-431f0a36-9452-41cb-b09d-5bb247fd02df tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:49.676436 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-431f0a36-9452-41cb-b09d-5bb247fd02df tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:49.749961 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-431f0a36-9452-41cb-b09d-5bb247fd02df tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] 10.222.0.46 "POST /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842/action" status: 200 len: 24560 microversion: 2.1 time: 0.099630 Jan 15 20:55:49.752123 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1021/2086] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:55:49 2022] POST /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842/action => generated 24560 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:55:49.775647 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f7f61cb3-df57-4126-8234-7ae3fa0d8246 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:49.776369 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f7f61cb3-df57-4126-8234-7ae3fa0d8246 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] [instance: 64e6adc9-543a-4611-89fa-38967f9c5ea4] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:55:49.790610 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f7f61cb3-df57-4126-8234-7ae3fa0d8246 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:49.791068 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f7f61cb3-df57-4126-8234-7ae3fa0d8246 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:49.795228 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f7f61cb3-df57-4126-8234-7ae3fa0d8246 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:49.795717 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f7f61cb3-df57-4126-8234-7ae3fa0d8246 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:50.378889 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-f7f61cb3-df57-4126-8234-7ae3fa0d8246 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f5490d676542fcb18b0dd5f5074516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc238c23f15041c583fd50a124461b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:55:50.389786 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f7f61cb3-df57-4126-8234-7ae3fa0d8246 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] 10.222.0.46 "GET /compute/v2.1/servers/64e6adc9-543a-4611-89fa-38967f9c5ea4" status: 200 len: 1355 microversion: 2.1 time: 0.628778 Jan 15 20:55:50.397018 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1022/2087] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:55:49 2022] GET /compute/v2.1/servers/64e6adc9-543a-4611-89fa-38967f9c5ea4 => generated 1355 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:55:50.414756 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-7adc0a06-673f-4092-863d-700df9d63d26 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:50.415375 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-7adc0a06-673f-4092-863d-700df9d63d26 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] [instance: a0856a94-f8a0-4fac-904b-8809dd0123c9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:55:50.423774 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7adc0a06-673f-4092-863d-700df9d63d26 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:50.424468 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7adc0a06-673f-4092-863d-700df9d63d26 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:50.425888 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7adc0a06-673f-4092-863d-700df9d63d26 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:50.426492 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7adc0a06-673f-4092-863d-700df9d63d26 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:50.586974 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-7adc0a06-673f-4092-863d-700df9d63d26 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e1b423e1a9146c8bb202ba012e2ee2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d5d92c87544c4d8080e19c1f6429bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:55:50.598778 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-7adc0a06-673f-4092-863d-700df9d63d26 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] 10.222.0.46 "GET /compute/v2.1/servers/a0856a94-f8a0-4fac-904b-8809dd0123c9" status: 200 len: 1282 microversion: 2.1 time: 0.197898 Jan 15 20:55:50.599359 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1023/2088] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:55:50 2022] GET /compute/v2.1/servers/a0856a94-f8a0-4fac-904b-8809dd0123c9 => generated 1282 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:55:50.615156 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-860511ef-acc6-4af9-a7a4-7e97dcec1a8f req-13a5fe14-7502-4e1f-892d-e4a4cdb45ea3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0207c6e5-54cf-4b26-b1e7-ed649dac8bb9", "name": "network-vif-unplugged", "status": "completed", "tag": "32c4b362-d25a-4492-abc2-6267bd6efe0b"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:55:50.616932 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:55:50.616932 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:55:50.644656 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-860511ef-acc6-4af9-a7a4-7e97dcec1a8f req-13a5fe14-7502-4e1f-892d-e4a4cdb45ea3 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:50.648713 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-860511ef-acc6-4af9-a7a4-7e97dcec1a8f req-13a5fe14-7502-4e1f-892d-e4a4cdb45ea3 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:50.672362 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-860511ef-acc6-4af9-a7a4-7e97dcec1a8f req-13a5fe14-7502-4e1f-892d-e4a4cdb45ea3 service nova] Creating event network-vif-unplugged:32c4b362-d25a-4492-abc2-6267bd6efe0b for instance 0207c6e5-54cf-4b26-b1e7-ed649dac8bb9 on nch1-master-1 Jan 15 20:55:50.680000 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-860511ef-acc6-4af9-a7a4-7e97dcec1a8f req-13a5fe14-7502-4e1f-892d-e4a4cdb45ea3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.074733 Jan 15 20:55:50.684389 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1024/2089] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:55:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:55:50.692898 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ed26388f-4761-4135-866d-3dab9c8ca7e3 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:50.693727 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ed26388f-4761-4135-866d-3dab9c8ca7e3 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] [instance: 0207c6e5-54cf-4b26-b1e7-ed649dac8bb9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:55:50.705236 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ed26388f-4761-4135-866d-3dab9c8ca7e3 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:50.705690 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ed26388f-4761-4135-866d-3dab9c8ca7e3 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:50.707283 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ed26388f-4761-4135-866d-3dab9c8ca7e3 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:50.707741 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ed26388f-4761-4135-866d-3dab9c8ca7e3 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:50.709008 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-7fd37858-3374-4b03-8115-e62645f8f5b9 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Flavor limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 20:55:50.709458 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-7fd37858-3374-4b03-8115-e62645f8f5b9 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Image limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 20:55:50.709877 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-7fd37858-3374-4b03-8115-e62645f8f5b9 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Flavor pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 20:55:50.710292 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-7fd37858-3374-4b03-8115-e62645f8f5b9 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Image pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 20:55:50.710849 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-7fd37858-3374-4b03-8115-e62645f8f5b9 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 20:55:50.740875 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7fd37858-3374-4b03-8115-e62645f8f5b9 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:50.741257 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7fd37858-3374-4b03-8115-e62645f8f5b9 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:50.742399 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7fd37858-3374-4b03-8115-e62645f8f5b9 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:50.743012 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7fd37858-3374-4b03-8115-e62645f8f5b9 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:50.792086 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-7fd37858-3374-4b03-8115-e62645f8f5b9 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Getting quotas for project 51cad90ef72141c2983640133453f788. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:55:50.815339 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-7fd37858-3374-4b03-8115-e62645f8f5b9 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Getting quotas for user 765cbcb4d9c8476494f08b123d1db59b and project 51cad90ef72141c2983640133453f788. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:55:50.864062 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-7fd37858-3374-4b03-8115-e62645f8f5b9 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Going to run 1 instances... {{(pid=129366) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 20:55:50.871093 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-7fd37858-3374-4b03-8115-e62645f8f5b9 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: 79c7721a-61b2-4405-955b-a7ab2f7c9300] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 20:55:50.914873 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-ed26388f-4761-4135-866d-3dab9c8ca7e3 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ec114f8ece434aa496cd401494e2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a05b1a0a7479db84b762eca23b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:55:50.923398 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ed26388f-4761-4135-866d-3dab9c8ca7e3 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] 10.222.0.46 "GET /compute/v2.1/servers/0207c6e5-54cf-4b26-b1e7-ed649dac8bb9" status: 200 len: 1503 microversion: 2.1 time: 0.237256 Jan 15 20:55:50.923982 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1025/2090] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:55:50 2022] GET /compute/v2.1/servers/0207c6e5-54cf-4b26-b1e7-ed649dac8bb9 => generated 1503 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:55:50.937687 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3bf3b878-38ca-4fba-b6b8-1863ea37e030 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:55:50.940509 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-3bf3b878-38ca-4fba-b6b8-1863ea37e030 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] [instance: b1eb0bef-5aaf-46d6-8739-b12303df9842] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:55:50.953730 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3bf3b878-38ca-4fba-b6b8-1863ea37e030 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:50.954206 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3bf3b878-38ca-4fba-b6b8-1863ea37e030 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:50.955008 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3bf3b878-38ca-4fba-b6b8-1863ea37e030 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:50.955465 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3bf3b878-38ca-4fba-b6b8-1863ea37e030 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:50.990435 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7fd37858-3374-4b03-8115-e62645f8f5b9 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.654610 Jan 15 20:55:50.993158 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1066/2091] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 20:55:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1658 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 20:55:51.001684 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-92227d61-5a56-4d35-b150-7531f3d562a6 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:51.002749 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-92227d61-5a56-4d35-b150-7531f3d562a6 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: 79c7721a-61b2-4405-955b-a7ab2f7c9300] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:55:51.065639 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3bf3b878-38ca-4fba-b6b8-1863ea37e030 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] 10.222.0.46 "POST /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842/action" status: 200 len: 24560 microversion: 2.1 time: 0.136410 Jan 15 20:55:51.066750 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1026/2092] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:55:50 2022] POST /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842/action => generated 24560 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:55:51.159093 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-92227d61-5a56-4d35-b150-7531f3d562a6 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:55:51.180018 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-92227d61-5a56-4d35-b150-7531f3d562a6 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/79c7721a-61b2-4405-955b-a7ab2f7c9300" status: 200 len: 1214 microversion: 2.1 time: 0.169222 Jan 15 20:55:51.180018 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1067/2093] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:55:50 2022] GET /compute/v2.1/servers/79c7721a-61b2-4405-955b-a7ab2f7c9300 => generated 1214 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:55:51.187722 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-7875e703-a077-44a2-9d64-1a53831df3ff tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:51.188622 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-7875e703-a077-44a2-9d64-1a53831df3ff tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: 79c7721a-61b2-4405-955b-a7ab2f7c9300] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:55:51.259686 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-7875e703-a077-44a2-9d64-1a53831df3ff tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: 79c7721a-61b2-4405-955b-a7ab2f7c9300] Going to try to terminate instance {{(pid=129365) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 20:55:51.409765 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-77f32eed-bdf2-4346-9a07-7241fc04de71 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:51.410617 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-77f32eed-bdf2-4346-9a07-7241fc04de71 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] [instance: 64e6adc9-543a-4611-89fa-38967f9c5ea4] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:55:51.420609 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-77f32eed-bdf2-4346-9a07-7241fc04de71 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:51.421465 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-77f32eed-bdf2-4346-9a07-7241fc04de71 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:51.422630 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-77f32eed-bdf2-4346-9a07-7241fc04de71 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:51.423765 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-77f32eed-bdf2-4346-9a07-7241fc04de71 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:51.894721 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-77f32eed-bdf2-4346-9a07-7241fc04de71 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f5490d676542fcb18b0dd5f5074516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc238c23f15041c583fd50a124461b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:55:51.905545 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-77f32eed-bdf2-4346-9a07-7241fc04de71 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] 10.222.0.46 "GET /compute/v2.1/servers/64e6adc9-543a-4611-89fa-38967f9c5ea4" status: 200 len: 1806 microversion: 2.1 time: 0.502431 Jan 15 20:55:51.918000 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1068/2094] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:55:51 2022] GET /compute/v2.1/servers/64e6adc9-543a-4611-89fa-38967f9c5ea4 => generated 1806 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:55:51.923439 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.compute.api [None req-7875e703-a077-44a2-9d64-1a53831df3ff tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: 79c7721a-61b2-4405-955b-a7ab2f7c9300] Instance Mapping does not exist while attempting local delete cleanup. Jan 15 20:55:51.924369 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-7875e703-a077-44a2-9d64-1a53831df3ff tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "DELETE /compute/v2.1/servers/79c7721a-61b2-4405-955b-a7ab2f7c9300" status: 204 len: 0 microversion: 2.1 time: 0.742365 Jan 15 20:55:51.925636 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-2481577e-e17a-4458-8083-2bbf1430c027 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:51.926061 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1027/2095] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 20:55:51 2022] DELETE /compute/v2.1/servers/79c7721a-61b2-4405-955b-a7ab2f7c9300 => generated 0 bytes in 744 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 20:55:51.926607 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-2481577e-e17a-4458-8083-2bbf1430c027 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] [instance: a0856a94-f8a0-4fac-904b-8809dd0123c9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:55:51.933480 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2481577e-e17a-4458-8083-2bbf1430c027 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:51.934532 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2481577e-e17a-4458-8083-2bbf1430c027 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:51.935366 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2481577e-e17a-4458-8083-2bbf1430c027 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:51.935852 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2481577e-e17a-4458-8083-2bbf1430c027 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:51.936718 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-0bc74811-0a1d-404c-9890-6c82f5691e7b tempest-ImagesMetadataTestJSON-1960834290 tempest-ImagesMetadataTestJSON-1960834290-project] Calling method '.version_select at 0x7f30ceb5ea60>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:51.992881 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-0bc74811-0a1d-404c-9890-6c82f5691e7b tempest-ImagesMetadataTestJSON-1960834290 tempest-ImagesMetadataTestJSON-1960834290-project] 10.222.0.46 "GET /compute/v2.1/images/cd034461-502b-4b3c-8155-79defb48d2b6" status: 200 len: 636 microversion: 2.1 time: 0.065392 Jan 15 20:55:51.993873 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1028/2096] 10.222.0.46 () {58 vars in 1232 bytes} [Sat Jan 15 20:55:51 2022] GET /compute/v2.1/images/cd034461-502b-4b3c-8155-79defb48d2b6 => generated 636 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:55:51.999748 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a4ee17fc-9cce-4cb8-bd5d-78f985aec2a9 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:52.002067 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a4ee17fc-9cce-4cb8-bd5d-78f985aec2a9 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] [instance: 64e6adc9-543a-4611-89fa-38967f9c5ea4] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:55:52.010092 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a4ee17fc-9cce-4cb8-bd5d-78f985aec2a9 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:52.010819 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a4ee17fc-9cce-4cb8-bd5d-78f985aec2a9 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:52.012671 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a4ee17fc-9cce-4cb8-bd5d-78f985aec2a9 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:52.013365 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a4ee17fc-9cce-4cb8-bd5d-78f985aec2a9 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:52.053752 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a4ee17fc-9cce-4cb8-bd5d-78f985aec2a9 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] 10.222.0.46 "GET /compute/v2.1/servers/64e6adc9-543a-4611-89fa-38967f9c5ea4/ips" status: 200 len: 219 microversion: 2.1 time: 0.056761 Jan 15 20:55:52.056781 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1029/2097] 10.222.0.46 () {58 vars in 1247 bytes} [Sat Jan 15 20:55:51 2022] GET /compute/v2.1/servers/64e6adc9-543a-4611-89fa-38967f9c5ea4/ips => generated 219 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:55:52.067356 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f39140a5-743a-4ad6-b457-4c1fba10c80f tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:52.068345 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f39140a5-743a-4ad6-b457-4c1fba10c80f tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: 79c7721a-61b2-4405-955b-a7ab2f7c9300] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:55:52.075628 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-f39140a5-743a-4ad6-b457-4c1fba10c80f tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] HTTP exception thrown: Instance 79c7721a-61b2-4405-955b-a7ab2f7c9300 could not be found. Jan 15 20:55:52.076590 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f39140a5-743a-4ad6-b457-4c1fba10c80f tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Returning 404 to user: Instance 79c7721a-61b2-4405-955b-a7ab2f7c9300 could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:55:52.077687 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f39140a5-743a-4ad6-b457-4c1fba10c80f tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/79c7721a-61b2-4405-955b-a7ab2f7c9300" status: 404 len: 111 microversion: 2.1 time: 0.019772 Jan 15 20:55:52.080408 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1030/2098] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:55:52 2022] GET /compute/v2.1/servers/79c7721a-61b2-4405-955b-a7ab2f7c9300 => generated 111 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:55:52.086067 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-608b5bc9-5616-4b7e-8c10-17567d746139 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:52.086839 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-608b5bc9-5616-4b7e-8c10-17567d746139 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] [instance: 0207c6e5-54cf-4b26-b1e7-ed649dac8bb9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:55:52.100473 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-608b5bc9-5616-4b7e-8c10-17567d746139 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:52.101473 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-608b5bc9-5616-4b7e-8c10-17567d746139 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:52.104273 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-608b5bc9-5616-4b7e-8c10-17567d746139 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:52.105282 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-608b5bc9-5616-4b7e-8c10-17567d746139 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:52.275710 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-2481577e-e17a-4458-8083-2bbf1430c027 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e1b423e1a9146c8bb202ba012e2ee2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d5d92c87544c4d8080e19c1f6429bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:55:52.284646 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-2481577e-e17a-4458-8083-2bbf1430c027 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] 10.222.0.46 "GET /compute/v2.1/servers/a0856a94-f8a0-4fac-904b-8809dd0123c9" status: 200 len: 1324 microversion: 2.1 time: 0.364145 Jan 15 20:55:52.285766 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1069/2099] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:55:51 2022] GET /compute/v2.1/servers/a0856a94-f8a0-4fac-904b-8809dd0123c9 => generated 1324 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:55:52.290860 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c1b40fd9-ac8f-4c10-a482-cfbc157447b2 tempest-ImagesMetadataTestJSON-1960834290 tempest-ImagesMetadataTestJSON-1960834290-project] Action: 'update_all', calling method: .version_select at 0x7f30cecab820>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:55:52.367939 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-c1b40fd9-ac8f-4c10-a482-cfbc157447b2 tempest-ImagesMetadataTestJSON-1960834290 tempest-ImagesMetadataTestJSON-1960834290-project] Getting quotas for project c1fe3bbd8d0342db9e59b60322c36e55. Resources: dict_keys(['metadata_items']) {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:55:52.376035 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-c1b40fd9-ac8f-4c10-a482-cfbc157447b2 tempest-ImagesMetadataTestJSON-1960834290 tempest-ImagesMetadataTestJSON-1960834290-project] Getting quotas for user 3e47d7ca6fc0439c9f828fff2a9c1a7a and project c1fe3bbd8d0342db9e59b60322c36e55. Resources: dict_keys(['metadata_items']) {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:55:52.764112 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c1b40fd9-ac8f-4c10-a482-cfbc157447b2 tempest-ImagesMetadataTestJSON-1960834290 tempest-ImagesMetadataTestJSON-1960834290-project] 10.222.0.46 "PUT /compute/v2.1/images/cd034461-502b-4b3c-8155-79defb48d2b6/metadata" status: 200 len: 61 microversion: 2.1 time: 0.476863 Jan 15 20:55:52.764639 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1070/2100] 10.222.0.46 () {60 vars in 1279 bytes} [Sat Jan 15 20:55:52 2022] PUT /compute/v2.1/images/cd034461-502b-4b3c-8155-79defb48d2b6/metadata => generated 61 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 20:55:52.769587 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b2e49867-a0d2-4fb0-89df-fc7dd2898b9b tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:52.770080 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b2e49867-a0d2-4fb0-89df-fc7dd2898b9b tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] [instance: 64e6adc9-543a-4611-89fa-38967f9c5ea4] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:55:52.777396 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b2e49867-a0d2-4fb0-89df-fc7dd2898b9b tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:52.777903 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b2e49867-a0d2-4fb0-89df-fc7dd2898b9b tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:52.778705 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b2e49867-a0d2-4fb0-89df-fc7dd2898b9b tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:52.779315 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b2e49867-a0d2-4fb0-89df-fc7dd2898b9b tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:52.806291 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b2e49867-a0d2-4fb0-89df-fc7dd2898b9b tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] [instance: 64e6adc9-543a-4611-89fa-38967f9c5ea4] Going to try to terminate instance {{(pid=129366) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 20:55:52.916435 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b2e49867-a0d2-4fb0-89df-fc7dd2898b9b tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] 10.222.0.46 "DELETE /compute/v2.1/servers/64e6adc9-543a-4611-89fa-38967f9c5ea4" status: 204 len: 0 microversion: 2.1 time: 0.150284 Jan 15 20:55:52.921186 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1071/2101] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 20:55:52 2022] DELETE /compute/v2.1/servers/64e6adc9-543a-4611-89fa-38967f9c5ea4 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 20:55:52.927056 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-21f9a481-868d-497d-bc07-2fd63ea6349e tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:55:52.928058 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-21f9a481-868d-497d-bc07-2fd63ea6349e tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] [instance: b1eb0bef-5aaf-46d6-8739-b12303df9842] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:55:52.935382 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-21f9a481-868d-497d-bc07-2fd63ea6349e tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:52.936195 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-21f9a481-868d-497d-bc07-2fd63ea6349e tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:52.937251 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-21f9a481-868d-497d-bc07-2fd63ea6349e tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:52.937905 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-21f9a481-868d-497d-bc07-2fd63ea6349e tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:52.959784 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-608b5bc9-5616-4b7e-8c10-17567d746139 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ec114f8ece434aa496cd401494e2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a05b1a0a7479db84b762eca23b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:55:52.971193 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-608b5bc9-5616-4b7e-8c10-17567d746139 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] 10.222.0.46 "GET /compute/v2.1/servers/0207c6e5-54cf-4b26-b1e7-ed649dac8bb9" status: 200 len: 1503 microversion: 2.1 time: 0.888681 Jan 15 20:55:52.972112 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1031/2102] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:55:52 2022] GET /compute/v2.1/servers/0207c6e5-54cf-4b26-b1e7-ed649dac8bb9 => generated 1503 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:55:52.976811 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-42b6282e-6da0-4828-973f-24662f37b1e7 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1394571343", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "networks": [{"uuid": "531bba45-51d6-4df1-9e47-d4b8172e5210"}]}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:55:52.988044 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-21f9a481-868d-497d-bc07-2fd63ea6349e tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] 10.222.0.46 "POST /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842/action" status: 200 len: 24560 microversion: 2.1 time: 0.065294 Jan 15 20:55:52.989933 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1072/2103] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:55:52 2022] POST /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842/action => generated 24560 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:55:52.999306 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-bf257332-d852-4896-b49d-392f3e78e5bc req-dbd4efa9-5e06-48a4-a7d2-6af26f076cc3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0207c6e5-54cf-4b26-b1e7-ed649dac8bb9", "tag": "32c4b362-d25a-4492-abc2-6267bd6efe0b"}, {"name": "network-changed", "server_uuid": "a0856a94-f8a0-4fac-904b-8809dd0123c9", "tag": "4baa855f-535d-4714-bbe8-b38141fc46fc"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:55:53.001608 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:55:53.001608 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:55:53.011650 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-bf257332-d852-4896-b49d-392f3e78e5bc req-dbd4efa9-5e06-48a4-a7d2-6af26f076cc3 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:53.013127 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-bf257332-d852-4896-b49d-392f3e78e5bc req-dbd4efa9-5e06-48a4-a7d2-6af26f076cc3 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:53.032335 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-bf257332-d852-4896-b49d-392f3e78e5bc req-dbd4efa9-5e06-48a4-a7d2-6af26f076cc3 service nova] Creating event network-changed:32c4b362-d25a-4492-abc2-6267bd6efe0b for instance 0207c6e5-54cf-4b26-b1e7-ed649dac8bb9 on nch1-master-1 Jan 15 20:55:53.032648 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-bf257332-d852-4896-b49d-392f3e78e5bc req-dbd4efa9-5e06-48a4-a7d2-6af26f076cc3 service nova] Creating event network-changed:4baa855f-535d-4714-bbe8-b38141fc46fc for instance a0856a94-f8a0-4fac-904b-8809dd0123c9 on nch2-master-1 Jan 15 20:55:53.042039 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-bf257332-d852-4896-b49d-392f3e78e5bc req-dbd4efa9-5e06-48a4-a7d2-6af26f076cc3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.050438 Jan 15 20:55:53.042649 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1073/2104] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:55:52 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:55:53.058889 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b8fe1425-9cf7-4290-b1e5-e24946bdb7ab tempest-ImagesMetadataTestJSON-1960834290 tempest-ImagesMetadataTestJSON-1960834290-project] Calling method '.version_select at 0x7f30ced03280>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:53.078678 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.network.neutron [None req-42b6282e-6da0-4828-973f-24662f37b1e7 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] validate_networks() for [('531bba45-51d6-4df1-9e47-d4b8172e5210', None, None, None, None, None)] {{(pid=129365) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 20:55:53.500390 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b8fe1425-9cf7-4290-b1e5-e24946bdb7ab tempest-ImagesMetadataTestJSON-1960834290 tempest-ImagesMetadataTestJSON-1960834290-project] 10.222.0.46 "DELETE /compute/v2.1/images/cd034461-502b-4b3c-8155-79defb48d2b6/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.455009 Jan 15 20:55:53.503856 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1074/2105] 10.222.0.46 () {58 vars in 1295 bytes} [Sat Jan 15 20:55:53 2022] DELETE /compute/v2.1/images/cd034461-502b-4b3c-8155-79defb48d2b6/metadata/os_version => generated 0 bytes in 458 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 20:55:53.505591 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-67da0989-1dff-4b90-824b-b35fa6eb8bb1 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:53.506411 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-67da0989-1dff-4b90-824b-b35fa6eb8bb1 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] [instance: 64e6adc9-543a-4611-89fa-38967f9c5ea4] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:55:53.515319 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-67da0989-1dff-4b90-824b-b35fa6eb8bb1 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:53.515771 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-67da0989-1dff-4b90-824b-b35fa6eb8bb1 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:53.516671 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-67da0989-1dff-4b90-824b-b35fa6eb8bb1 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:53.517185 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-67da0989-1dff-4b90-824b-b35fa6eb8bb1 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:54.009308 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-67da0989-1dff-4b90-824b-b35fa6eb8bb1 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f5490d676542fcb18b0dd5f5074516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc238c23f15041c583fd50a124461b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:55:54.020785 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-67da0989-1dff-4b90-824b-b35fa6eb8bb1 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] 10.222.0.46 "GET /compute/v2.1/servers/64e6adc9-543a-4611-89fa-38967f9c5ea4" status: 200 len: 1812 microversion: 2.1 time: 0.518472 Jan 15 20:55:54.021437 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1075/2106] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:55:53 2022] GET /compute/v2.1/servers/64e6adc9-543a-4611-89fa-38967f9c5ea4 => generated 1812 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:55:54.027770 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f0ead38d-aa7b-43b2-ac4c-afcd3d17f858 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:54.028984 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f0ead38d-aa7b-43b2-ac4c-afcd3d17f858 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] [instance: a0856a94-f8a0-4fac-904b-8809dd0123c9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:55:54.036338 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f0ead38d-aa7b-43b2-ac4c-afcd3d17f858 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:54.037214 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f0ead38d-aa7b-43b2-ac4c-afcd3d17f858 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:54.038018 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f0ead38d-aa7b-43b2-ac4c-afcd3d17f858 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:54.038457 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f0ead38d-aa7b-43b2-ac4c-afcd3d17f858 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:54.065959 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-42b6282e-6da0-4828-973f-24662f37b1e7 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Flavor limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 20:55:54.067159 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-42b6282e-6da0-4828-973f-24662f37b1e7 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Image limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 20:55:54.068121 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-42b6282e-6da0-4828-973f-24662f37b1e7 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Flavor pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 20:55:54.068880 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-42b6282e-6da0-4828-973f-24662f37b1e7 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Image pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 20:55:54.069566 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-42b6282e-6da0-4828-973f-24662f37b1e7 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 20:55:54.081553 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-42b6282e-6da0-4828-973f-24662f37b1e7 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:54.082185 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-42b6282e-6da0-4828-973f-24662f37b1e7 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:54.083173 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-42b6282e-6da0-4828-973f-24662f37b1e7 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:54.083886 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-42b6282e-6da0-4828-973f-24662f37b1e7 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:54.108632 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-42b6282e-6da0-4828-973f-24662f37b1e7 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Getting quotas for project 51cad90ef72141c2983640133453f788. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:55:54.114760 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-42b6282e-6da0-4828-973f-24662f37b1e7 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Getting quotas for user 765cbcb4d9c8476494f08b123d1db59b and project 51cad90ef72141c2983640133453f788. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:55:54.130384 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-42b6282e-6da0-4828-973f-24662f37b1e7 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Going to run 1 instances... {{(pid=129365) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 20:55:54.133394 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-42b6282e-6da0-4828-973f-24662f37b1e7 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: ae964f06-d93f-4029-9565-6f3d8d280d23] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129365) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 20:55:54.190153 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-42b6282e-6da0-4828-973f-24662f37b1e7 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.216829 Jan 15 20:55:54.191753 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1032/2107] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 20:55:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1219 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 20:55:54.206333 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ebc60727-a458-4d4c-b679-cbe25b42ba3a tempest-ImagesMetadataTestJSON-1960834290 tempest-ImagesMetadataTestJSON-1960834290-project] Calling method '.version_select at 0x7f30ceb02040>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:54.268422 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ebc60727-a458-4d4c-b679-cbe25b42ba3a tempest-ImagesMetadataTestJSON-1960834290 tempest-ImagesMetadataTestJSON-1960834290-project] 10.222.0.46 "GET /compute/v2.1/images/cd034461-502b-4b3c-8155-79defb48d2b6/metadata" status: 200 len: 37 microversion: 2.1 time: 0.075305 Jan 15 20:55:54.269304 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1033/2108] 10.222.0.46 () {58 vars in 1259 bytes} [Sat Jan 15 20:55:54 2022] GET /compute/v2.1/images/cd034461-502b-4b3c-8155-79defb48d2b6/metadata => generated 37 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 20:55:54.274581 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c088ce1d-5a0c-4720-90c6-ea484d19bb21 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:54.274986 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c088ce1d-5a0c-4720-90c6-ea484d19bb21 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] [instance: 0207c6e5-54cf-4b26-b1e7-ed649dac8bb9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:55:54.286963 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-f0ead38d-aa7b-43b2-ac4c-afcd3d17f858 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e1b423e1a9146c8bb202ba012e2ee2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d5d92c87544c4d8080e19c1f6429bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:55:54.291925 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c088ce1d-5a0c-4720-90c6-ea484d19bb21 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:54.292530 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c088ce1d-5a0c-4720-90c6-ea484d19bb21 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:54.293826 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c088ce1d-5a0c-4720-90c6-ea484d19bb21 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:54.294263 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c088ce1d-5a0c-4720-90c6-ea484d19bb21 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:54.295642 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f0ead38d-aa7b-43b2-ac4c-afcd3d17f858 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] 10.222.0.46 "GET /compute/v2.1/servers/a0856a94-f8a0-4fac-904b-8809dd0123c9" status: 200 len: 1324 microversion: 2.1 time: 0.272838 Jan 15 20:55:54.298830 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1076/2109] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:55:54 2022] GET /compute/v2.1/servers/a0856a94-f8a0-4fac-904b-8809dd0123c9 => generated 1324 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:55:54.305795 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-11e3a76d-cbe6-48be-95bd-92939fe1505c tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:55:54.310202 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-11e3a76d-cbe6-48be-95bd-92939fe1505c tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] [instance: b1eb0bef-5aaf-46d6-8739-b12303df9842] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:55:54.322104 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-11e3a76d-cbe6-48be-95bd-92939fe1505c tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:54.323141 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-11e3a76d-cbe6-48be-95bd-92939fe1505c tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:54.324882 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-11e3a76d-cbe6-48be-95bd-92939fe1505c tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:54.325590 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-11e3a76d-cbe6-48be-95bd-92939fe1505c tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:54.403779 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-11e3a76d-cbe6-48be-95bd-92939fe1505c tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] 10.222.0.46 "POST /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842/action" status: 200 len: 32632 microversion: 2.1 time: 0.103023 Jan 15 20:55:54.407910 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1077/2110] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:55:54 2022] POST /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842/action => generated 32632 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:55:54.419960 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c33a6a0b-da0d-4de9-bf6a-ec6b771c4692 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:54.420717 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c33a6a0b-da0d-4de9-bf6a-ec6b771c4692 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: ae964f06-d93f-4029-9565-6f3d8d280d23] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:55:54.499978 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-c33a6a0b-da0d-4de9-bf6a-ec6b771c4692 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:55:54.507148 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c33a6a0b-da0d-4de9-bf6a-ec6b771c4692 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/ae964f06-d93f-4029-9565-6f3d8d280d23" status: 200 len: 1215 microversion: 2.1 time: 0.097732 Jan 15 20:55:54.525893 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1078/2111] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:55:54 2022] GET /compute/v2.1/servers/ae964f06-d93f-4029-9565-6f3d8d280d23 => generated 1215 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:55:54.531672 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-af3653cf-b33f-4a77-a753-86a6a069b088 tempest-ImagesMetadataTestJSON-1960834290 tempest-ImagesMetadataTestJSON-1960834290-project] Action: 'update_all', calling method: .version_select at 0x7f30cec90160>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:55:54.593934 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-c088ce1d-5a0c-4720-90c6-ea484d19bb21 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ec114f8ece434aa496cd401494e2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a05b1a0a7479db84b762eca23b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:55:54.601757 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c088ce1d-5a0c-4720-90c6-ea484d19bb21 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] 10.222.0.46 "GET /compute/v2.1/servers/0207c6e5-54cf-4b26-b1e7-ed649dac8bb9" status: 200 len: 1503 microversion: 2.1 time: 0.331391 Jan 15 20:55:54.602333 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1034/2112] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:55:54 2022] GET /compute/v2.1/servers/0207c6e5-54cf-4b26-b1e7-ed649dac8bb9 => generated 1503 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:55:54.613221 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-af3653cf-b33f-4a77-a753-86a6a069b088 tempest-ImagesMetadataTestJSON-1960834290 tempest-ImagesMetadataTestJSON-1960834290-project] Getting quotas for project c1fe3bbd8d0342db9e59b60322c36e55. Resources: dict_keys(['metadata_items']) {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:55:54.616043 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ee9d2ebd-5d68-4e99-acfa-06b43cb59f25 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-137557408", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "b2ee2cfc-030b-4aaf-9340-8d68210312df"}], "security_groups": [{"name": "tempest-securitygroup--162495987"}], "key_name": "tempest-keypair-2076036038", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "83c3508c-ec47-4aa6-b593-6b635f7ab173", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "AUTO"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:55:54.624260 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-af3653cf-b33f-4a77-a753-86a6a069b088 tempest-ImagesMetadataTestJSON-1960834290 tempest-ImagesMetadataTestJSON-1960834290-project] Getting quotas for user 3e47d7ca6fc0439c9f828fff2a9c1a7a and project c1fe3bbd8d0342db9e59b60322c36e55. Resources: dict_keys(['metadata_items']) {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:55:54.844628 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.network.neutron [None req-ee9d2ebd-5d68-4e99-acfa-06b43cb59f25 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] validate_networks() for [('b2ee2cfc-030b-4aaf-9340-8d68210312df', None, None, None, None, None)] {{(pid=129365) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 20:55:55.173798 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-af3653cf-b33f-4a77-a753-86a6a069b088 tempest-ImagesMetadataTestJSON-1960834290 tempest-ImagesMetadataTestJSON-1960834290-project] 10.222.0.46 "PUT /compute/v2.1/images/cd034461-502b-4b3c-8155-79defb48d2b6/metadata" status: 200 len: 61 microversion: 2.1 time: 0.646688 Jan 15 20:55:55.175602 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1079/2113] 10.222.0.46 () {60 vars in 1279 bytes} [Sat Jan 15 20:55:54 2022] PUT /compute/v2.1/images/cd034461-502b-4b3c-8155-79defb48d2b6/metadata => generated 61 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 20:55:55.181248 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7b159117-e173-4200-8e72-b48bbf8b0416 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:55.182157 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-7b159117-e173-4200-8e72-b48bbf8b0416 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] [instance: 64e6adc9-543a-4611-89fa-38967f9c5ea4] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:55:55.191360 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7b159117-e173-4200-8e72-b48bbf8b0416 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:55.191834 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7b159117-e173-4200-8e72-b48bbf8b0416 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:55.192765 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7b159117-e173-4200-8e72-b48bbf8b0416 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:55.193680 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7b159117-e173-4200-8e72-b48bbf8b0416 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:55.550249 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-7b159117-e173-4200-8e72-b48bbf8b0416 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f5490d676542fcb18b0dd5f5074516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc238c23f15041c583fd50a124461b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:55:55.558612 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7b159117-e173-4200-8e72-b48bbf8b0416 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] 10.222.0.46 "GET /compute/v2.1/servers/64e6adc9-543a-4611-89fa-38967f9c5ea4" status: 200 len: 1812 microversion: 2.1 time: 0.381459 Jan 15 20:55:55.570222 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-ee9d2ebd-5d68-4e99-acfa-06b43cb59f25 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Getting quotas for project dca2cdba56c74d46a478aff355b23447. Resources: dict_keys(['metadata_items']) {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:55:55.576026 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1080/2114] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:55:55 2022] GET /compute/v2.1/servers/64e6adc9-543a-4611-89fa-38967f9c5ea4 => generated 1812 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:55:55.576220 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-ee9d2ebd-5d68-4e99-acfa-06b43cb59f25 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Getting quotas for user ca4c2db123e34ed9bdba89f7150ebcf6 and project dca2cdba56c74d46a478aff355b23447. Resources: dict_keys(['metadata_items']) {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:55:55.586005 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-343f502a-4619-4906-91ce-af2afd1b64ca tempest-ImagesMetadataTestJSON-1960834290 tempest-ImagesMetadataTestJSON-1960834290-project] Calling method '.version_select at 0x7f30c8e0b9d0>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:55.591407 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-ee9d2ebd-5d68-4e99-acfa-06b43cb59f25 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Flavor limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 20:55:55.592271 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-ee9d2ebd-5d68-4e99-acfa-06b43cb59f25 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Image limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 20:55:55.593022 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-ee9d2ebd-5d68-4e99-acfa-06b43cb59f25 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Flavor pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 20:55:55.593706 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-ee9d2ebd-5d68-4e99-acfa-06b43cb59f25 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Image pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 20:55:55.594304 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-ee9d2ebd-5d68-4e99-acfa-06b43cb59f25 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 20:55:55.622001 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ee9d2ebd-5d68-4e99-acfa-06b43cb59f25 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:55.622959 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ee9d2ebd-5d68-4e99-acfa-06b43cb59f25 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:55.624163 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ee9d2ebd-5d68-4e99-acfa-06b43cb59f25 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:55.624675 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ee9d2ebd-5d68-4e99-acfa-06b43cb59f25 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:55.644705 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-343f502a-4619-4906-91ce-af2afd1b64ca tempest-ImagesMetadataTestJSON-1960834290 tempest-ImagesMetadataTestJSON-1960834290-project] 10.222.0.46 "GET /compute/v2.1/images/cd034461-502b-4b3c-8155-79defb48d2b6/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.067327 Jan 15 20:55:55.645534 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1081/2115] 10.222.0.46 () {58 vars in 1289 bytes} [Sat Jan 15 20:55:55 2022] GET /compute/v2.1/images/cd034461-502b-4b3c-8155-79defb48d2b6/metadata/os_distro => generated 33 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 20:55:55.658028 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-5db1b166-d92a-4b65-b6d3-3d4389cbe444 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:55.658270 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-ee9d2ebd-5d68-4e99-acfa-06b43cb59f25 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Getting quotas for project dca2cdba56c74d46a478aff355b23447. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:55:55.658741 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-5db1b166-d92a-4b65-b6d3-3d4389cbe444 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] [instance: a0856a94-f8a0-4fac-904b-8809dd0123c9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:55:55.664623 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-ee9d2ebd-5d68-4e99-acfa-06b43cb59f25 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Getting quotas for user ca4c2db123e34ed9bdba89f7150ebcf6 and project dca2cdba56c74d46a478aff355b23447. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:55:55.674379 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5db1b166-d92a-4b65-b6d3-3d4389cbe444 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:55.675457 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5db1b166-d92a-4b65-b6d3-3d4389cbe444 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:55.677388 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5db1b166-d92a-4b65-b6d3-3d4389cbe444 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:55.677864 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5db1b166-d92a-4b65-b6d3-3d4389cbe444 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:55.788049 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ee9d2ebd-5d68-4e99-acfa-06b43cb59f25 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Going to run 1 instances... {{(pid=129365) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 20:55:55.790932 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ee9d2ebd-5d68-4e99-acfa-06b43cb59f25 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] [instance: 62ae2a15-8c2c-4dad-971f-0611238103a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='83c3508c-ec47-4aa6-b593-6b635f7ab173',volume_size=None,volume_type=None)] {{(pid=129365) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 20:55:55.944110 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ee9d2ebd-5d68-4e99-acfa-06b43cb59f25 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.333989 Jan 15 20:55:55.945548 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1035/2116] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 20:55:54 2022] POST /compute/v2.1/servers => generated 406 bytes in 1336 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 20:55:55.951837 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-050c69e2-cc16-4998-b28c-65fae72939b9 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:55:55.953267 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-050c69e2-cc16-4998-b28c-65fae72939b9 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] [instance: b1eb0bef-5aaf-46d6-8739-b12303df9842] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:55:55.960520 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-050c69e2-cc16-4998-b28c-65fae72939b9 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:55.961401 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-050c69e2-cc16-4998-b28c-65fae72939b9 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:55.962482 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-050c69e2-cc16-4998-b28c-65fae72939b9 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:55.963181 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-050c69e2-cc16-4998-b28c-65fae72939b9 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:56.013330 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-5db1b166-d92a-4b65-b6d3-3d4389cbe444 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e1b423e1a9146c8bb202ba012e2ee2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d5d92c87544c4d8080e19c1f6429bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:55:56.021387 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-050c69e2-cc16-4998-b28c-65fae72939b9 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] 10.222.0.46 "POST /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842/action" status: 200 len: 32632 microversion: 2.1 time: 0.073195 Jan 15 20:55:56.024358 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1036/2117] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:55:55 2022] POST /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842/action => generated 32632 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:55:56.027769 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-5db1b166-d92a-4b65-b6d3-3d4389cbe444 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] 10.222.0.46 "GET /compute/v2.1/servers/a0856a94-f8a0-4fac-904b-8809dd0123c9" status: 200 len: 1324 microversion: 2.1 time: 0.374728 Jan 15 20:55:56.028373 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1082/2118] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:55:55 2022] GET /compute/v2.1/servers/a0856a94-f8a0-4fac-904b-8809dd0123c9 => generated 1324 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:55:56.035125 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e722b6e3-5b61-4a16-be22-02e0f1db9ff1 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:56.035836 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e722b6e3-5b61-4a16-be22-02e0f1db9ff1 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: ae964f06-d93f-4029-9565-6f3d8d280d23] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:55:56.044638 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-24064aff-6eeb-4954-afd4-7d46acf01b93 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:56.045657 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-24064aff-6eeb-4954-afd4-7d46acf01b93 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] [instance: 0207c6e5-54cf-4b26-b1e7-ed649dac8bb9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:55:56.058537 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e722b6e3-5b61-4a16-be22-02e0f1db9ff1 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:56.059371 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e722b6e3-5b61-4a16-be22-02e0f1db9ff1 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:56.063276 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e722b6e3-5b61-4a16-be22-02e0f1db9ff1 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:56.063623 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e722b6e3-5b61-4a16-be22-02e0f1db9ff1 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:56.065846 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-24064aff-6eeb-4954-afd4-7d46acf01b93 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:56.066308 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-24064aff-6eeb-4954-afd4-7d46acf01b93 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:56.068443 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-24064aff-6eeb-4954-afd4-7d46acf01b93 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:56.069353 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-24064aff-6eeb-4954-afd4-7d46acf01b93 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:56.222145 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-e722b6e3-5b61-4a16-be22-02e0f1db9ff1 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:55:56.244527 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e722b6e3-5b61-4a16-be22-02e0f1db9ff1 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/ae964f06-d93f-4029-9565-6f3d8d280d23" status: 200 len: 1273 microversion: 2.1 time: 0.218168 Jan 15 20:55:56.245913 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1037/2119] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:55:56 2022] GET /compute/v2.1/servers/ae964f06-d93f-4029-9565-6f3d8d280d23 => generated 1273 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:55:56.271771 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a3731826-6ffb-4896-9574-dd92d518b1f5 tempest-ImagesMetadataTestJSON-1960834290 tempest-ImagesMetadataTestJSON-1960834290-project] Action: 'update_all', calling method: .version_select at 0x7f30c87e90d0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:55:56.343386 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-a3731826-6ffb-4896-9574-dd92d518b1f5 tempest-ImagesMetadataTestJSON-1960834290 tempest-ImagesMetadataTestJSON-1960834290-project] Getting quotas for project c1fe3bbd8d0342db9e59b60322c36e55. Resources: dict_keys(['metadata_items']) {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:55:56.356709 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-a3731826-6ffb-4896-9574-dd92d518b1f5 tempest-ImagesMetadataTestJSON-1960834290 tempest-ImagesMetadataTestJSON-1960834290-project] Getting quotas for user 3e47d7ca6fc0439c9f828fff2a9c1a7a and project c1fe3bbd8d0342db9e59b60322c36e55. Resources: dict_keys(['metadata_items']) {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:55:56.495583 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-24064aff-6eeb-4954-afd4-7d46acf01b93 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ec114f8ece434aa496cd401494e2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a05b1a0a7479db84b762eca23b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:55:56.526966 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-24064aff-6eeb-4954-afd4-7d46acf01b93 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] 10.222.0.46 "GET /compute/v2.1/servers/0207c6e5-54cf-4b26-b1e7-ed649dac8bb9" status: 200 len: 1503 microversion: 2.1 time: 0.485568 Jan 15 20:55:56.529183 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1083/2120] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:55:56 2022] GET /compute/v2.1/servers/0207c6e5-54cf-4b26-b1e7-ed649dac8bb9 => generated 1503 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:55:56.540563 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-59c94456-f786-44f6-b7d6-4a5c6eab00b8 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:56.541206 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-59c94456-f786-44f6-b7d6-4a5c6eab00b8 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] [instance: 62ae2a15-8c2c-4dad-971f-0611238103a3] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:55:56.680425 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-59c94456-f786-44f6-b7d6-4a5c6eab00b8 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4c2db123e34ed9bdba89f7150ebcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca2cdba56c74d46a478aff355b23447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:55:56.688441 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-59c94456-f786-44f6-b7d6-4a5c6eab00b8 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] 10.222.0.46 "GET /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3" status: 200 len: 1121 microversion: 2.1 time: 0.155565 Jan 15 20:55:56.697728 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1084/2121] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:55:56 2022] GET /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3 => generated 1121 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:55:56.705217 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-06abfd9e-1b5a-464f-af9f-10333db5a82c tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:56.705966 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-06abfd9e-1b5a-464f-af9f-10333db5a82c tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] [instance: 64e6adc9-543a-4611-89fa-38967f9c5ea4] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:55:56.724062 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-06abfd9e-1b5a-464f-af9f-10333db5a82c tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:56.724508 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-06abfd9e-1b5a-464f-af9f-10333db5a82c tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:56.725534 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-06abfd9e-1b5a-464f-af9f-10333db5a82c tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:56.726095 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-06abfd9e-1b5a-464f-af9f-10333db5a82c tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:56.829672 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a3731826-6ffb-4896-9574-dd92d518b1f5 tempest-ImagesMetadataTestJSON-1960834290 tempest-ImagesMetadataTestJSON-1960834290-project] 10.222.0.46 "PUT /compute/v2.1/images/cd034461-502b-4b3c-8155-79defb48d2b6/metadata" status: 200 len: 61 microversion: 2.1 time: 0.579269 Jan 15 20:55:56.834020 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1038/2122] 10.222.0.46 () {60 vars in 1279 bytes} [Sat Jan 15 20:55:56 2022] PUT /compute/v2.1/images/cd034461-502b-4b3c-8155-79defb48d2b6/metadata => generated 61 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 20:55:56.835170 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-9b3ceb8c-706c-43b3-bd4c-685f781263e0 req-47e90014-22ee-4001-a18f-6fa5f2056d69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64e6adc9-543a-4611-89fa-38967f9c5ea4", "name": "network-vif-deleted", "tag": "6bd959ef-20f3-40bb-aa81-6fa73d256727"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:55:56.836798 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:55:56.836798 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:55:56.852897 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-9b3ceb8c-706c-43b3-bd4c-685f781263e0 req-47e90014-22ee-4001-a18f-6fa5f2056d69 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:56.853630 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-9b3ceb8c-706c-43b3-bd4c-685f781263e0 req-47e90014-22ee-4001-a18f-6fa5f2056d69 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:56.866585 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-9b3ceb8c-706c-43b3-bd4c-685f781263e0 req-47e90014-22ee-4001-a18f-6fa5f2056d69 service nova] Creating event network-vif-deleted:6bd959ef-20f3-40bb-aa81-6fa73d256727 for instance 64e6adc9-543a-4611-89fa-38967f9c5ea4 on nch2-master-1 Jan 15 20:55:56.872410 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-9b3ceb8c-706c-43b3-bd4c-685f781263e0 req-47e90014-22ee-4001-a18f-6fa5f2056d69 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040598 Jan 15 20:55:56.873292 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1039/2123] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:55:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:55:56.878686 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-4439c325-638d-4a3c-abe6-a6d608583a68 tempest-ImagesMetadataTestJSON-1960834290 tempest-ImagesMetadataTestJSON-1960834290-project] Calling method '.version_select at 0x7f30ceae6550>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:56.932645 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-4439c325-638d-4a3c-abe6-a6d608583a68 tempest-ImagesMetadataTestJSON-1960834290 tempest-ImagesMetadataTestJSON-1960834290-project] 10.222.0.46 "GET /compute/v2.1/images/cd034461-502b-4b3c-8155-79defb48d2b6/metadata" status: 200 len: 61 microversion: 2.1 time: 0.057954 Jan 15 20:55:56.939100 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1040/2124] 10.222.0.46 () {58 vars in 1259 bytes} [Sat Jan 15 20:55:56 2022] GET /compute/v2.1/images/cd034461-502b-4b3c-8155-79defb48d2b6/metadata => generated 61 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 20:55:56.959770 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3e8e6996-4475-4f48-a732-45d4ff91f491 tempest-ImagesMetadataTestJSON-1960834290 tempest-ImagesMetadataTestJSON-1960834290-project] Action: 'update_all', calling method: .version_select at 0x7f30ceae61f0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:55:57.086271 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-3e8e6996-4475-4f48-a732-45d4ff91f491 tempest-ImagesMetadataTestJSON-1960834290 tempest-ImagesMetadataTestJSON-1960834290-project] Getting quotas for project c1fe3bbd8d0342db9e59b60322c36e55. Resources: dict_keys(['metadata_items']) {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:55:57.117040 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-06abfd9e-1b5a-464f-af9f-10333db5a82c tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f5490d676542fcb18b0dd5f5074516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc238c23f15041c583fd50a124461b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:55:57.117498 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-3e8e6996-4475-4f48-a732-45d4ff91f491 tempest-ImagesMetadataTestJSON-1960834290 tempest-ImagesMetadataTestJSON-1960834290-project] Getting quotas for user 3e47d7ca6fc0439c9f828fff2a9c1a7a and project c1fe3bbd8d0342db9e59b60322c36e55. Resources: dict_keys(['metadata_items']) {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:55:57.134587 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-06abfd9e-1b5a-464f-af9f-10333db5a82c tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] 10.222.0.46 "GET /compute/v2.1/servers/64e6adc9-543a-4611-89fa-38967f9c5ea4" status: 200 len: 1791 microversion: 2.1 time: 0.440906 Jan 15 20:55:57.137848 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1085/2125] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:55:56 2022] GET /compute/v2.1/servers/64e6adc9-543a-4611-89fa-38967f9c5ea4 => generated 1791 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:55:57.157416 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9713b0f3-fd80-43e9-878a-dc00dfcfe27b tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:55:57.160786 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-9713b0f3-fd80-43e9-878a-dc00dfcfe27b tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] [instance: b1eb0bef-5aaf-46d6-8739-b12303df9842] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:55:57.178252 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9713b0f3-fd80-43e9-878a-dc00dfcfe27b tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:57.180957 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9713b0f3-fd80-43e9-878a-dc00dfcfe27b tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:57.181829 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9713b0f3-fd80-43e9-878a-dc00dfcfe27b tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:57.182373 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9713b0f3-fd80-43e9-878a-dc00dfcfe27b tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:57.252181 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-9713b0f3-fd80-43e9-878a-dc00dfcfe27b tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] 10.222.0.46 "POST /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842/action" status: 200 len: 32632 microversion: 2.1 time: 0.112793 Jan 15 20:55:57.258655 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1086/2126] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:55:57 2022] POST /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842/action => generated 32632 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:55:57.265525 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c401e2fa-02e7-4591-92c6-612b63576f27 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:57.266294 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c401e2fa-02e7-4591-92c6-612b63576f27 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] [instance: a0856a94-f8a0-4fac-904b-8809dd0123c9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:55:57.275836 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c401e2fa-02e7-4591-92c6-612b63576f27 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:57.276338 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c401e2fa-02e7-4591-92c6-612b63576f27 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:57.277158 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c401e2fa-02e7-4591-92c6-612b63576f27 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:57.278484 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c401e2fa-02e7-4591-92c6-612b63576f27 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:57.562782 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-c401e2fa-02e7-4591-92c6-612b63576f27 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e1b423e1a9146c8bb202ba012e2ee2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d5d92c87544c4d8080e19c1f6429bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:55:57.574999 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c401e2fa-02e7-4591-92c6-612b63576f27 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] 10.222.0.46 "GET /compute/v2.1/servers/a0856a94-f8a0-4fac-904b-8809dd0123c9" status: 200 len: 1324 microversion: 2.1 time: 0.311895 Jan 15 20:55:57.575944 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1087/2127] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:55:57 2022] GET /compute/v2.1/servers/a0856a94-f8a0-4fac-904b-8809dd0123c9 => generated 1324 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:55:57.585831 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3e8e6996-4475-4f48-a732-45d4ff91f491 tempest-ImagesMetadataTestJSON-1960834290 tempest-ImagesMetadataTestJSON-1960834290-project] 10.222.0.46 "PUT /compute/v2.1/images/cd034461-502b-4b3c-8155-79defb48d2b6/metadata" status: 200 len: 61 microversion: 2.1 time: 0.645295 Jan 15 20:55:57.588542 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1041/2128] 10.222.0.46 () {60 vars in 1279 bytes} [Sat Jan 15 20:55:56 2022] PUT /compute/v2.1/images/cd034461-502b-4b3c-8155-79defb48d2b6/metadata => generated 61 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 20:55:57.594643 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e2221603-ae9f-4617-a488-fbe4f80e15ce tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:57.597751 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d1cc7aad-78d1-4d1e-a7ad-24fc04bfb24a tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:57.598874 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-d1cc7aad-78d1-4d1e-a7ad-24fc04bfb24a tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: ae964f06-d93f-4029-9565-6f3d8d280d23] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:55:57.599406 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e2221603-ae9f-4617-a488-fbe4f80e15ce tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] [instance: 0207c6e5-54cf-4b26-b1e7-ed649dac8bb9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:55:57.618731 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d1cc7aad-78d1-4d1e-a7ad-24fc04bfb24a tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:57.622477 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d1cc7aad-78d1-4d1e-a7ad-24fc04bfb24a tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:57.622897 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d1cc7aad-78d1-4d1e-a7ad-24fc04bfb24a tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:57.623453 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d1cc7aad-78d1-4d1e-a7ad-24fc04bfb24a tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:57.627823 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e2221603-ae9f-4617-a488-fbe4f80e15ce tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:57.628959 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e2221603-ae9f-4617-a488-fbe4f80e15ce tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:57.630450 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e2221603-ae9f-4617-a488-fbe4f80e15ce tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:57.632606 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e2221603-ae9f-4617-a488-fbe4f80e15ce tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:58.046539 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-d1cc7aad-78d1-4d1e-a7ad-24fc04bfb24a tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:55:58.061402 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d1cc7aad-78d1-4d1e-a7ad-24fc04bfb24a tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/ae964f06-d93f-4029-9565-6f3d8d280d23" status: 200 len: 1315 microversion: 2.1 time: 0.473716 Jan 15 20:55:58.071840 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1088/2129] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:55:57 2022] GET /compute/v2.1/servers/ae964f06-d93f-4029-9565-6f3d8d280d23 => generated 1315 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:55:58.076915 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-054bddb9-fc61-4b70-8808-399d7ca4b7bd tempest-ImagesMetadataTestJSON-1960834290 tempest-ImagesMetadataTestJSON-1960834290-project] Action: 'update_all', calling method: .version_select at 0x7f30c8d7d670>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:55:58.153853 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-e2221603-ae9f-4617-a488-fbe4f80e15ce tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ec114f8ece434aa496cd401494e2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a05b1a0a7479db84b762eca23b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:55:58.162801 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e2221603-ae9f-4617-a488-fbe4f80e15ce tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] 10.222.0.46 "GET /compute/v2.1/servers/0207c6e5-54cf-4b26-b1e7-ed649dac8bb9" status: 200 len: 1503 microversion: 2.1 time: 0.572902 Jan 15 20:55:58.164824 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1042/2130] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:55:57 2022] GET /compute/v2.1/servers/0207c6e5-54cf-4b26-b1e7-ed649dac8bb9 => generated 1503 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:55:58.170341 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-69870586-c12e-402c-81cf-5c132a8cca99 req-8ebd1f9d-4414-43ae-8d0c-a91141c613ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64e6adc9-543a-4611-89fa-38967f9c5ea4", "name": "network-vif-unplugged", "status": "completed", "tag": "4eaf05ca-1d8c-4f0d-b68a-e770667b374f"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:55:58.175353 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:55:58.175353 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:55:58.181394 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-054bddb9-fc61-4b70-8808-399d7ca4b7bd tempest-ImagesMetadataTestJSON-1960834290 tempest-ImagesMetadataTestJSON-1960834290-project] Getting quotas for project c1fe3bbd8d0342db9e59b60322c36e55. Resources: dict_keys(['metadata_items']) {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:55:58.191118 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-69870586-c12e-402c-81cf-5c132a8cca99 req-8ebd1f9d-4414-43ae-8d0c-a91141c613ea service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:58.191858 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-69870586-c12e-402c-81cf-5c132a8cca99 req-8ebd1f9d-4414-43ae-8d0c-a91141c613ea service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:58.193980 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-054bddb9-fc61-4b70-8808-399d7ca4b7bd tempest-ImagesMetadataTestJSON-1960834290 tempest-ImagesMetadataTestJSON-1960834290-project] Getting quotas for user 3e47d7ca6fc0439c9f828fff2a9c1a7a and project c1fe3bbd8d0342db9e59b60322c36e55. Resources: dict_keys(['metadata_items']) {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:55:58.213673 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-69870586-c12e-402c-81cf-5c132a8cca99 req-8ebd1f9d-4414-43ae-8d0c-a91141c613ea service nova] Creating event network-vif-unplugged:4eaf05ca-1d8c-4f0d-b68a-e770667b374f for instance 64e6adc9-543a-4611-89fa-38967f9c5ea4 on nch2-master-1 Jan 15 20:55:58.227266 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-69870586-c12e-402c-81cf-5c132a8cca99 req-8ebd1f9d-4414-43ae-8d0c-a91141c613ea service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060054 Jan 15 20:55:58.232910 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1043/2131] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:55:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:55:58.238176 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-6b6dd2cf-0b21-4e24-a315-64a02c61c9c7 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:58.253248 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-6b6dd2cf-0b21-4e24-a315-64a02c61c9c7 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] [instance: 62ae2a15-8c2c-4dad-971f-0611238103a3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:55:58.266846 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6b6dd2cf-0b21-4e24-a315-64a02c61c9c7 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:58.267597 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6b6dd2cf-0b21-4e24-a315-64a02c61c9c7 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:58.276953 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6b6dd2cf-0b21-4e24-a315-64a02c61c9c7 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:58.277846 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6b6dd2cf-0b21-4e24-a315-64a02c61c9c7 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:58.589503 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-6b6dd2cf-0b21-4e24-a315-64a02c61c9c7 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4c2db123e34ed9bdba89f7150ebcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca2cdba56c74d46a478aff355b23447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:55:58.599853 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-6b6dd2cf-0b21-4e24-a315-64a02c61c9c7 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] 10.222.0.46 "GET /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3" status: 200 len: 1237 microversion: 2.1 time: 0.365441 Jan 15 20:55:58.609839 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1044/2132] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:55:58 2022] GET /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3 => generated 1237 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:55:58.626445 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-cb6c9da6-0bbb-40ad-b538-092b88b0518b tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:58.627133 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-cb6c9da6-0bbb-40ad-b538-092b88b0518b tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] [instance: 64e6adc9-543a-4611-89fa-38967f9c5ea4] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:55:58.653375 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cb6c9da6-0bbb-40ad-b538-092b88b0518b tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:58.654093 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cb6c9da6-0bbb-40ad-b538-092b88b0518b tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:58.654949 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cb6c9da6-0bbb-40ad-b538-092b88b0518b tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:58.655387 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cb6c9da6-0bbb-40ad-b538-092b88b0518b tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:58.875249 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-054bddb9-fc61-4b70-8808-399d7ca4b7bd tempest-ImagesMetadataTestJSON-1960834290 tempest-ImagesMetadataTestJSON-1960834290-project] 10.222.0.46 "PUT /compute/v2.1/images/cd034461-502b-4b3c-8155-79defb48d2b6/metadata" status: 200 len: 64 microversion: 2.1 time: 0.802082 Jan 15 20:55:58.875863 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1089/2133] 10.222.0.46 () {60 vars in 1279 bytes} [Sat Jan 15 20:55:58 2022] PUT /compute/v2.1/images/cd034461-502b-4b3c-8155-79defb48d2b6/metadata => generated 64 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 20:55:58.887588 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0c076bb5-f062-48f6-b654-04113d95eaf2 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:55:58.888664 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-0c076bb5-f062-48f6-b654-04113d95eaf2 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] [instance: b1eb0bef-5aaf-46d6-8739-b12303df9842] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:55:58.909174 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0c076bb5-f062-48f6-b654-04113d95eaf2 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:58.909679 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0c076bb5-f062-48f6-b654-04113d95eaf2 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:58.910495 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0c076bb5-f062-48f6-b654-04113d95eaf2 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:58.914190 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0c076bb5-f062-48f6-b654-04113d95eaf2 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:58.992808 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0c076bb5-f062-48f6-b654-04113d95eaf2 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] 10.222.0.46 "POST /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842/action" status: 200 len: 32632 microversion: 2.1 time: 0.115327 Jan 15 20:55:58.997685 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1090/2134] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:55:58 2022] POST /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842/action => generated 32632 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:55:58.999993 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-649e904e-08d1-4f59-bd44-4460cf3f811f tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:59.000745 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-649e904e-08d1-4f59-bd44-4460cf3f811f tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] [instance: a0856a94-f8a0-4fac-904b-8809dd0123c9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:55:59.009418 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-649e904e-08d1-4f59-bd44-4460cf3f811f tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:59.009860 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-649e904e-08d1-4f59-bd44-4460cf3f811f tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:59.011255 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-649e904e-08d1-4f59-bd44-4460cf3f811f tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:59.012060 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-649e904e-08d1-4f59-bd44-4460cf3f811f tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:59.171346 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-cb6c9da6-0bbb-40ad-b538-092b88b0518b tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f5490d676542fcb18b0dd5f5074516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc238c23f15041c583fd50a124461b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:55:59.193226 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-cb6c9da6-0bbb-40ad-b538-092b88b0518b tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] 10.222.0.46 "GET /compute/v2.1/servers/64e6adc9-543a-4611-89fa-38967f9c5ea4" status: 200 len: 1655 microversion: 2.1 time: 0.573892 Jan 15 20:55:59.204176 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1045/2135] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:55:58 2022] GET /compute/v2.1/servers/64e6adc9-543a-4611-89fa-38967f9c5ea4 => generated 1655 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:55:59.209214 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-aaabfe00-0d21-4f88-9f0d-ef8df02451a4 tempest-ImagesMetadataTestJSON-1960834290 tempest-ImagesMetadataTestJSON-1960834290-project] Calling method '.version_select at 0x7f30ceb795e0>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:59.271220 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-aaabfe00-0d21-4f88-9f0d-ef8df02451a4 tempest-ImagesMetadataTestJSON-1960834290 tempest-ImagesMetadataTestJSON-1960834290-project] 10.222.0.46 "GET /compute/v2.1/images/cd034461-502b-4b3c-8155-79defb48d2b6/metadata" status: 200 len: 64 microversion: 2.1 time: 0.065569 Jan 15 20:55:59.275813 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1046/2136] 10.222.0.46 () {58 vars in 1259 bytes} [Sat Jan 15 20:55:59 2022] GET /compute/v2.1/images/cd034461-502b-4b3c-8155-79defb48d2b6/metadata => generated 64 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 20:55:59.292099 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-bc1a4750-d44a-4dcb-af40-38d45198fcb4 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:59.301536 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-bc1a4750-d44a-4dcb-af40-38d45198fcb4 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: ae964f06-d93f-4029-9565-6f3d8d280d23] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:55:59.308236 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bc1a4750-d44a-4dcb-af40-38d45198fcb4 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:59.309421 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bc1a4750-d44a-4dcb-af40-38d45198fcb4 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:59.310736 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bc1a4750-d44a-4dcb-af40-38d45198fcb4 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:59.313162 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bc1a4750-d44a-4dcb-af40-38d45198fcb4 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:59.422005 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-649e904e-08d1-4f59-bd44-4460cf3f811f tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e1b423e1a9146c8bb202ba012e2ee2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d5d92c87544c4d8080e19c1f6429bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:55:59.430227 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-649e904e-08d1-4f59-bd44-4460cf3f811f tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] 10.222.0.46 "GET /compute/v2.1/servers/a0856a94-f8a0-4fac-904b-8809dd0123c9" status: 200 len: 1324 microversion: 2.1 time: 0.435014 Jan 15 20:55:59.432512 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1091/2137] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:55:58 2022] GET /compute/v2.1/servers/a0856a94-f8a0-4fac-904b-8809dd0123c9 => generated 1324 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:55:59.445088 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-d73fe7d5-c9c6-428b-b21a-559732eadefc req-a00d8e83-aabe-42e6-804b-984ce8bb08f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64e6adc9-543a-4611-89fa-38967f9c5ea4", "name": "network-vif-deleted", "tag": "bac9459d-6b17-4ac9-ab8a-15ea5ae1f6cd"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:55:59.446961 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:55:59.446961 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:55:59.469692 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-d73fe7d5-c9c6-428b-b21a-559732eadefc req-a00d8e83-aabe-42e6-804b-984ce8bb08f0 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:59.470425 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-d73fe7d5-c9c6-428b-b21a-559732eadefc req-a00d8e83-aabe-42e6-804b-984ce8bb08f0 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:59.485208 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-d73fe7d5-c9c6-428b-b21a-559732eadefc req-a00d8e83-aabe-42e6-804b-984ce8bb08f0 service nova] Creating event network-vif-deleted:bac9459d-6b17-4ac9-ab8a-15ea5ae1f6cd for instance 64e6adc9-543a-4611-89fa-38967f9c5ea4 on nch2-master-1 Jan 15 20:55:59.490610 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-d73fe7d5-c9c6-428b-b21a-559732eadefc req-a00d8e83-aabe-42e6-804b-984ce8bb08f0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055347 Jan 15 20:55:59.491832 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1092/2138] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:55:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:55:59.497980 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-5e689ba3-6729-48cb-8be3-06bd77523906 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:59.498675 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-5e689ba3-6729-48cb-8be3-06bd77523906 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] [instance: 0207c6e5-54cf-4b26-b1e7-ed649dac8bb9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:55:59.506324 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5e689ba3-6729-48cb-8be3-06bd77523906 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:59.506775 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5e689ba3-6729-48cb-8be3-06bd77523906 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:59.507621 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5e689ba3-6729-48cb-8be3-06bd77523906 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:59.508229 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5e689ba3-6729-48cb-8be3-06bd77523906 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:59.724614 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-bc1a4750-d44a-4dcb-af40-38d45198fcb4 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:55:59.734712 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-bc1a4750-d44a-4dcb-af40-38d45198fcb4 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/ae964f06-d93f-4029-9565-6f3d8d280d23" status: 200 len: 1315 microversion: 2.1 time: 0.457660 Jan 15 20:55:59.735748 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1047/2139] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:55:59 2022] GET /compute/v2.1/servers/ae964f06-d93f-4029-9565-6f3d8d280d23 => generated 1315 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:55:59.745009 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d5324f2f-a634-44ff-9296-3ae7d979bbc6 tempest-ImagesMetadataTestJSON-1960834290 tempest-ImagesMetadataTestJSON-1960834290-project] Action: 'update_all', calling method: .version_select at 0x7f30ceb9f430>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:55:59.825136 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-d5324f2f-a634-44ff-9296-3ae7d979bbc6 tempest-ImagesMetadataTestJSON-1960834290 tempest-ImagesMetadataTestJSON-1960834290-project] Getting quotas for project c1fe3bbd8d0342db9e59b60322c36e55. Resources: dict_keys(['metadata_items']) {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:55:59.827349 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-5e689ba3-6729-48cb-8be3-06bd77523906 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ec114f8ece434aa496cd401494e2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a05b1a0a7479db84b762eca23b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:55:59.833121 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-d5324f2f-a634-44ff-9296-3ae7d979bbc6 tempest-ImagesMetadataTestJSON-1960834290 tempest-ImagesMetadataTestJSON-1960834290-project] Getting quotas for user 3e47d7ca6fc0439c9f828fff2a9c1a7a and project c1fe3bbd8d0342db9e59b60322c36e55. Resources: dict_keys(['metadata_items']) {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:55:59.836828 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-5e689ba3-6729-48cb-8be3-06bd77523906 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] 10.222.0.46 "GET /compute/v2.1/servers/0207c6e5-54cf-4b26-b1e7-ed649dac8bb9" status: 200 len: 1503 microversion: 2.1 time: 0.343535 Jan 15 20:55:59.837452 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1093/2140] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:55:59 2022] GET /compute/v2.1/servers/0207c6e5-54cf-4b26-b1e7-ed649dac8bb9 => generated 1503 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:55:59.847000 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a9328c56-a2de-4d6c-8f8d-563675d59f26 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:55:59.848766 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a9328c56-a2de-4d6c-8f8d-563675d59f26 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] [instance: 62ae2a15-8c2c-4dad-971f-0611238103a3] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:55:59.858949 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a9328c56-a2de-4d6c-8f8d-563675d59f26 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:59.860009 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a9328c56-a2de-4d6c-8f8d-563675d59f26 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:59.861263 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a9328c56-a2de-4d6c-8f8d-563675d59f26 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:55:59.861927 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a9328c56-a2de-4d6c-8f8d-563675d59f26 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:55:59.959995 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-a9328c56-a2de-4d6c-8f8d-563675d59f26 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4c2db123e34ed9bdba89f7150ebcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca2cdba56c74d46a478aff355b23447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:55:59.989751 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a9328c56-a2de-4d6c-8f8d-563675d59f26 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] 10.222.0.46 "GET /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3" status: 200 len: 1225 microversion: 2.1 time: 0.148924 Jan 15 20:56:00.003086 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1094/2141] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:55:59 2022] GET /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3 => generated 1225 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:00.008272 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-718d4ac0-568a-460e-8265-b7c770dd4420 req-38276a14-b0a3-460b-bfa4-2b36aed29d66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae964f06-d93f-4029-9565-6f3d8d280d23", "tag": "e8cb3b3e-9ba7-4dc0-86e0-83c3f385db9f"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:00.010393 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:56:00.010393 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:56:00.024549 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-718d4ac0-568a-460e-8265-b7c770dd4420 req-38276a14-b0a3-460b-bfa4-2b36aed29d66 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:00.025047 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-718d4ac0-568a-460e-8265-b7c770dd4420 req-38276a14-b0a3-460b-bfa4-2b36aed29d66 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:00.056477 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-718d4ac0-568a-460e-8265-b7c770dd4420 req-38276a14-b0a3-460b-bfa4-2b36aed29d66 service nova] Creating event network-changed:e8cb3b3e-9ba7-4dc0-86e0-83c3f385db9f for instance ae964f06-d93f-4029-9565-6f3d8d280d23 on nch1-master-1 Jan 15 20:56:00.064380 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-718d4ac0-568a-460e-8265-b7c770dd4420 req-38276a14-b0a3-460b-bfa4-2b36aed29d66 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060022 Jan 15 20:56:00.065916 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1095/2142] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:56:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:56:00.072699 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-aa2bcd0e-4a82-42ac-9055-75ace26e9c62 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:00.075664 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-aa2bcd0e-4a82-42ac-9055-75ace26e9c62 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] [instance: b1eb0bef-5aaf-46d6-8739-b12303df9842] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:00.082779 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-aa2bcd0e-4a82-42ac-9055-75ace26e9c62 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:00.083586 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-aa2bcd0e-4a82-42ac-9055-75ace26e9c62 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:00.084604 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-aa2bcd0e-4a82-42ac-9055-75ace26e9c62 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:00.085840 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-aa2bcd0e-4a82-42ac-9055-75ace26e9c62 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:00.133623 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-aa2bcd0e-4a82-42ac-9055-75ace26e9c62 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] 10.222.0.46 "POST /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842/action" status: 200 len: 32632 microversion: 2.1 time: 0.065892 Jan 15 20:56:00.139475 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1096/2143] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:56:00 2022] POST /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842/action => generated 32632 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:56:00.212350 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e1dc71a9-2786-4bce-b5dd-f90c666f0ffc tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:00.214853 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e1dc71a9-2786-4bce-b5dd-f90c666f0ffc tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] [instance: 64e6adc9-543a-4611-89fa-38967f9c5ea4] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:00.230042 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e1dc71a9-2786-4bce-b5dd-f90c666f0ffc tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:00.230518 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e1dc71a9-2786-4bce-b5dd-f90c666f0ffc tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:00.237021 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e1dc71a9-2786-4bce-b5dd-f90c666f0ffc tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:00.237479 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e1dc71a9-2786-4bce-b5dd-f90c666f0ffc tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:00.263922 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d5324f2f-a634-44ff-9296-3ae7d979bbc6 tempest-ImagesMetadataTestJSON-1960834290 tempest-ImagesMetadataTestJSON-1960834290-project] 10.222.0.46 "PUT /compute/v2.1/images/cd034461-502b-4b3c-8155-79defb48d2b6/metadata" status: 200 len: 61 microversion: 2.1 time: 0.526198 Jan 15 20:56:00.264632 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1048/2144] 10.222.0.46 () {60 vars in 1279 bytes} [Sat Jan 15 20:55:59 2022] PUT /compute/v2.1/images/cd034461-502b-4b3c-8155-79defb48d2b6/metadata => generated 61 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 20:56:00.275584 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ce661faa-5ded-4793-95bf-f862af7da32b tempest-ImagesMetadataTestJSON-1960834290 tempest-ImagesMetadataTestJSON-1960834290-project] Action: 'update', calling method: .version_select at 0x7f30c87db040>, body: {"meta": {"os_version": "alt"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:00.336620 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-ce661faa-5ded-4793-95bf-f862af7da32b tempest-ImagesMetadataTestJSON-1960834290 tempest-ImagesMetadataTestJSON-1960834290-project] Getting quotas for project c1fe3bbd8d0342db9e59b60322c36e55. Resources: dict_keys(['metadata_items']) {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:56:00.342595 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-ce661faa-5ded-4793-95bf-f862af7da32b tempest-ImagesMetadataTestJSON-1960834290 tempest-ImagesMetadataTestJSON-1960834290-project] Getting quotas for user 3e47d7ca6fc0439c9f828fff2a9c1a7a and project c1fe3bbd8d0342db9e59b60322c36e55. Resources: dict_keys(['metadata_items']) {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:56:00.541368 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-e1dc71a9-2786-4bce-b5dd-f90c666f0ffc tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f5490d676542fcb18b0dd5f5074516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc238c23f15041c583fd50a124461b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:00.551409 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e1dc71a9-2786-4bce-b5dd-f90c666f0ffc tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] 10.222.0.46 "GET /compute/v2.1/servers/64e6adc9-543a-4611-89fa-38967f9c5ea4" status: 200 len: 1497 microversion: 2.1 time: 0.343906 Jan 15 20:56:00.562838 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1097/2145] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:00 2022] GET /compute/v2.1/servers/64e6adc9-543a-4611-89fa-38967f9c5ea4 => generated 1497 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:56:00.567781 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e4e2a639-fdf4-40be-9398-1f330935682b tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:00.568728 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e4e2a639-fdf4-40be-9398-1f330935682b tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] [instance: a0856a94-f8a0-4fac-904b-8809dd0123c9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:00.576019 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e4e2a639-fdf4-40be-9398-1f330935682b tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:00.576716 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e4e2a639-fdf4-40be-9398-1f330935682b tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:00.577765 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e4e2a639-fdf4-40be-9398-1f330935682b tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:00.578447 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e4e2a639-fdf4-40be-9398-1f330935682b tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:00.787243 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ce661faa-5ded-4793-95bf-f862af7da32b tempest-ImagesMetadataTestJSON-1960834290 tempest-ImagesMetadataTestJSON-1960834290-project] 10.222.0.46 "PUT /compute/v2.1/images/cd034461-502b-4b3c-8155-79defb48d2b6/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.515232 Jan 15 20:56:00.792304 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1049/2146] 10.222.0.46 () {60 vars in 1312 bytes} [Sat Jan 15 20:56:00 2022] PUT /compute/v2.1/images/cd034461-502b-4b3c-8155-79defb48d2b6/metadata/os_version => generated 31 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 20:56:00.798867 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-321059c9-3e5c-4f77-845a-fc3170a0f83d tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:00.800173 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-321059c9-3e5c-4f77-845a-fc3170a0f83d tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: ae964f06-d93f-4029-9565-6f3d8d280d23] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:00.811298 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-321059c9-3e5c-4f77-845a-fc3170a0f83d tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:00.811930 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-321059c9-3e5c-4f77-845a-fc3170a0f83d tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:00.812830 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-321059c9-3e5c-4f77-845a-fc3170a0f83d tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:00.813394 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-321059c9-3e5c-4f77-845a-fc3170a0f83d tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:00.859904 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-e4e2a639-fdf4-40be-9398-1f330935682b tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e1b423e1a9146c8bb202ba012e2ee2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d5d92c87544c4d8080e19c1f6429bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:00.868546 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e4e2a639-fdf4-40be-9398-1f330935682b tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] 10.222.0.46 "GET /compute/v2.1/servers/a0856a94-f8a0-4fac-904b-8809dd0123c9" status: 200 len: 1324 microversion: 2.1 time: 0.304139 Jan 15 20:56:00.869528 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1098/2147] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:00 2022] GET /compute/v2.1/servers/a0856a94-f8a0-4fac-904b-8809dd0123c9 => generated 1324 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:00.877198 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d6e2c020-9215-4952-a985-5c5b6c0c74c4 tempest-ImagesMetadataTestJSON-1960834290 tempest-ImagesMetadataTestJSON-1960834290-project] Calling method '.version_select at 0x7f30cec594c0>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:00.951183 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d6e2c020-9215-4952-a985-5c5b6c0c74c4 tempest-ImagesMetadataTestJSON-1960834290 tempest-ImagesMetadataTestJSON-1960834290-project] 10.222.0.46 "GET /compute/v2.1/images/cd034461-502b-4b3c-8155-79defb48d2b6/metadata" status: 200 len: 58 microversion: 2.1 time: 0.080708 Jan 15 20:56:00.952151 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1099/2148] 10.222.0.46 () {58 vars in 1259 bytes} [Sat Jan 15 20:56:00 2022] GET /compute/v2.1/images/cd034461-502b-4b3c-8155-79defb48d2b6/metadata => generated 58 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 20:56:00.968584 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-85b35af7-a0d2-47d8-a24e-41cea8fd09a5 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:00.971915 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-85b35af7-a0d2-47d8-a24e-41cea8fd09a5 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] [instance: 0207c6e5-54cf-4b26-b1e7-ed649dac8bb9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:00.988855 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-85b35af7-a0d2-47d8-a24e-41cea8fd09a5 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:00.989573 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-85b35af7-a0d2-47d8-a24e-41cea8fd09a5 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:00.990654 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-85b35af7-a0d2-47d8-a24e-41cea8fd09a5 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:00.992477 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-85b35af7-a0d2-47d8-a24e-41cea8fd09a5 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:01.781303 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-321059c9-3e5c-4f77-845a-fc3170a0f83d tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:01.807298 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-321059c9-3e5c-4f77-845a-fc3170a0f83d tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/ae964f06-d93f-4029-9565-6f3d8d280d23" status: 200 len: 1315 microversion: 2.1 time: 1.016082 Jan 15 20:56:01.817842 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1050/2149] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:00 2022] GET /compute/v2.1/servers/ae964f06-d93f-4029-9565-6f3d8d280d23 => generated 1315 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:01.827074 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f4b27367-ebdd-4679-90bc-88e6cb31cf2a tempest-ImagesMetadataTestJSON-1960834290 tempest-ImagesMetadataTestJSON-1960834290-project] Action: 'update_all', calling method: .version_select at 0x7f30ceb029d0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:01.973882 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-f4b27367-ebdd-4679-90bc-88e6cb31cf2a tempest-ImagesMetadataTestJSON-1960834290 tempest-ImagesMetadataTestJSON-1960834290-project] Getting quotas for project c1fe3bbd8d0342db9e59b60322c36e55. Resources: dict_keys(['metadata_items']) {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:56:01.985960 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-f4b27367-ebdd-4679-90bc-88e6cb31cf2a tempest-ImagesMetadataTestJSON-1960834290 tempest-ImagesMetadataTestJSON-1960834290-project] Getting quotas for user 3e47d7ca6fc0439c9f828fff2a9c1a7a and project c1fe3bbd8d0342db9e59b60322c36e55. Resources: dict_keys(['metadata_items']) {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:56:02.082713 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-85b35af7-a0d2-47d8-a24e-41cea8fd09a5 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ec114f8ece434aa496cd401494e2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a05b1a0a7479db84b762eca23b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:02.092987 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-85b35af7-a0d2-47d8-a24e-41cea8fd09a5 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] 10.222.0.46 "GET /compute/v2.1/servers/0207c6e5-54cf-4b26-b1e7-ed649dac8bb9" status: 200 len: 1503 microversion: 2.1 time: 1.138660 Jan 15 20:56:02.094300 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1100/2150] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:00 2022] GET /compute/v2.1/servers/0207c6e5-54cf-4b26-b1e7-ed649dac8bb9 => generated 1503 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:02.098990 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-65cc13d8-557c-445c-8c8c-418f9e817c0c tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:02.099844 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-65cc13d8-557c-445c-8c8c-418f9e817c0c tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] [instance: 62ae2a15-8c2c-4dad-971f-0611238103a3] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:02.112860 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-65cc13d8-557c-445c-8c8c-418f9e817c0c tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:02.113515 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-65cc13d8-557c-445c-8c8c-418f9e817c0c tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:02.114333 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-65cc13d8-557c-445c-8c8c-418f9e817c0c tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:02.114774 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-65cc13d8-557c-445c-8c8c-418f9e817c0c tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:02.323168 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-65cc13d8-557c-445c-8c8c-418f9e817c0c tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4c2db123e34ed9bdba89f7150ebcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca2cdba56c74d46a478aff355b23447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:02.336100 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-65cc13d8-557c-445c-8c8c-418f9e817c0c tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] 10.222.0.46 "GET /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3" status: 200 len: 1292 microversion: 2.1 time: 0.240213 Jan 15 20:56:02.337219 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1101/2151] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:02 2022] GET /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3 => generated 1292 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:02.341694 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a4b38474-8f50-4347-8c1e-491085459673 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:02.342703 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a4b38474-8f50-4347-8c1e-491085459673 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] [instance: b1eb0bef-5aaf-46d6-8739-b12303df9842] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:02.348974 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a4b38474-8f50-4347-8c1e-491085459673 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:02.349700 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a4b38474-8f50-4347-8c1e-491085459673 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:02.350908 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a4b38474-8f50-4347-8c1e-491085459673 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:02.351540 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a4b38474-8f50-4347-8c1e-491085459673 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:02.397873 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a4b38474-8f50-4347-8c1e-491085459673 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] 10.222.0.46 "POST /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842/action" status: 200 len: 32632 microversion: 2.1 time: 0.059390 Jan 15 20:56:02.399248 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1102/2152] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:56:02 2022] POST /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842/action => generated 32632 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:56:02.405806 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-bcc264a7-3cd8-476e-83c2-c79a2bf4f118 req-635040e6-9684-456c-b65b-10eaea851c6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0856a94-f8a0-4fac-904b-8809dd0123c9", "name": "network-vif-plugged", "status": "completed", "tag": "4baa855f-535d-4714-bbe8-b38141fc46fc"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:02.406913 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f4b27367-ebdd-4679-90bc-88e6cb31cf2a tempest-ImagesMetadataTestJSON-1960834290 tempest-ImagesMetadataTestJSON-1960834290-project] 10.222.0.46 "PUT /compute/v2.1/images/cd034461-502b-4b3c-8155-79defb48d2b6/metadata" status: 200 len: 61 microversion: 2.1 time: 0.587295 Jan 15 20:56:02.407511 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1051/2153] 10.222.0.46 () {60 vars in 1279 bytes} [Sat Jan 15 20:56:01 2022] PUT /compute/v2.1/images/cd034461-502b-4b3c-8155-79defb48d2b6/metadata => generated 61 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 20:56:02.407916 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:56:02.407916 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:56:02.412724 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-fbc6621e-9a91-415e-9ca9-17b1d3b78856 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:02.413356 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-fbc6621e-9a91-415e-9ca9-17b1d3b78856 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] [instance: 64e6adc9-543a-4611-89fa-38967f9c5ea4] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:02.417378 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-bcc264a7-3cd8-476e-83c2-c79a2bf4f118 req-635040e6-9684-456c-b65b-10eaea851c6f service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:02.418151 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-bcc264a7-3cd8-476e-83c2-c79a2bf4f118 req-635040e6-9684-456c-b65b-10eaea851c6f service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:02.419852 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fbc6621e-9a91-415e-9ca9-17b1d3b78856 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:02.420301 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fbc6621e-9a91-415e-9ca9-17b1d3b78856 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:02.421254 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fbc6621e-9a91-415e-9ca9-17b1d3b78856 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:02.421686 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fbc6621e-9a91-415e-9ca9-17b1d3b78856 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:02.432193 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-bcc264a7-3cd8-476e-83c2-c79a2bf4f118 req-635040e6-9684-456c-b65b-10eaea851c6f service nova] Creating event network-vif-plugged:4baa855f-535d-4714-bbe8-b38141fc46fc for instance a0856a94-f8a0-4fac-904b-8809dd0123c9 on nch2-master-1 Jan 15 20:56:02.436237 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-fbc6621e-9a91-415e-9ca9-17b1d3b78856 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] HTTP exception thrown: Instance 64e6adc9-543a-4611-89fa-38967f9c5ea4 could not be found. Jan 15 20:56:02.436866 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-fbc6621e-9a91-415e-9ca9-17b1d3b78856 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Returning 404 to user: Instance 64e6adc9-543a-4611-89fa-38967f9c5ea4 could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:56:02.437741 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-fbc6621e-9a91-415e-9ca9-17b1d3b78856 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] 10.222.0.46 "GET /compute/v2.1/servers/64e6adc9-543a-4611-89fa-38967f9c5ea4" status: 404 len: 111 microversion: 2.1 time: 0.029333 Jan 15 20:56:02.439394 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-bcc264a7-3cd8-476e-83c2-c79a2bf4f118 req-635040e6-9684-456c-b65b-10eaea851c6f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038524 Jan 15 20:56:02.443294 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1052/2154] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:02 2022] GET /compute/v2.1/servers/64e6adc9-543a-4611-89fa-38967f9c5ea4 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:56:02.445491 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1103/2155] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:56:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:56:02.448334 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-c4a26e97-da14-4fa6-806a-4774c2bba3e9 req-67be3c31-9dff-46b5-a614-81546ebd1049 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64e6adc9-543a-4611-89fa-38967f9c5ea4", "name": "network-vif-deleted", "tag": "4eaf05ca-1d8c-4f0d-b68a-e770667b374f"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:02.452786 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e7a69126-f6e3-41d2-a123-0901511cc701 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:02.453784 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e7a69126-f6e3-41d2-a123-0901511cc701 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] [instance: a0856a94-f8a0-4fac-904b-8809dd0123c9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:02.460353 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:56:02.460353 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:56:02.463131 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e7a69126-f6e3-41d2-a123-0901511cc701 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:02.463794 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e7a69126-f6e3-41d2-a123-0901511cc701 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:02.464802 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e7a69126-f6e3-41d2-a123-0901511cc701 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:02.467763 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e7a69126-f6e3-41d2-a123-0901511cc701 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:02.470589 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-c4a26e97-da14-4fa6-806a-4774c2bba3e9 req-67be3c31-9dff-46b5-a614-81546ebd1049 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:02.471127 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-c4a26e97-da14-4fa6-806a-4774c2bba3e9 req-67be3c31-9dff-46b5-a614-81546ebd1049 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:02.483826 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-c4a26e97-da14-4fa6-806a-4774c2bba3e9 req-67be3c31-9dff-46b5-a614-81546ebd1049 service nova] Creating event network-vif-deleted:4eaf05ca-1d8c-4f0d-b68a-e770667b374f for instance 64e6adc9-543a-4611-89fa-38967f9c5ea4 on nch2-master-1 Jan 15 20:56:02.490013 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-c4a26e97-da14-4fa6-806a-4774c2bba3e9 req-67be3c31-9dff-46b5-a614-81546ebd1049 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044920 Jan 15 20:56:02.491305 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1053/2156] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:56:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:56:02.498324 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-1149c9ab-76e8-40b3-a92d-6927f1403228 tempest-ImagesMetadataTestJSON-1960834290 tempest-ImagesMetadataTestJSON-1960834290-project] Action: 'create', calling method: .version_select at 0x7f30ceafa550>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:02.577745 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-1149c9ab-76e8-40b3-a92d-6927f1403228 tempest-ImagesMetadataTestJSON-1960834290 tempest-ImagesMetadataTestJSON-1960834290-project] Getting quotas for project c1fe3bbd8d0342db9e59b60322c36e55. Resources: dict_keys(['metadata_items']) {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:56:02.583285 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-1149c9ab-76e8-40b3-a92d-6927f1403228 tempest-ImagesMetadataTestJSON-1960834290 tempest-ImagesMetadataTestJSON-1960834290-project] Getting quotas for user 3e47d7ca6fc0439c9f828fff2a9c1a7a and project c1fe3bbd8d0342db9e59b60322c36e55. Resources: dict_keys(['metadata_items']) {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:56:03.191527 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-1149c9ab-76e8-40b3-a92d-6927f1403228 tempest-ImagesMetadataTestJSON-1960834290 tempest-ImagesMetadataTestJSON-1960834290-project] 10.222.0.46 "POST /compute/v2.1/images/cd034461-502b-4b3c-8155-79defb48d2b6/metadata" status: 200 len: 85 microversion: 2.1 time: 0.698072 Jan 15 20:56:03.192128 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1054/2157] 10.222.0.46 () {60 vars in 1280 bytes} [Sat Jan 15 20:56:02 2022] POST /compute/v2.1/images/cd034461-502b-4b3c-8155-79defb48d2b6/metadata => generated 85 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 20:56:03.196516 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f2fcfc8c-6af6-4a0c-944c-d8dd163ac89b tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:03.197285 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f2fcfc8c-6af6-4a0c-944c-d8dd163ac89b tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: ae964f06-d93f-4029-9565-6f3d8d280d23] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:03.214700 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f2fcfc8c-6af6-4a0c-944c-d8dd163ac89b tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:03.215875 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f2fcfc8c-6af6-4a0c-944c-d8dd163ac89b tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:03.217111 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f2fcfc8c-6af6-4a0c-944c-d8dd163ac89b tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:03.217743 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f2fcfc8c-6af6-4a0c-944c-d8dd163ac89b tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:03.271418 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-e7a69126-f6e3-41d2-a123-0901511cc701 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e1b423e1a9146c8bb202ba012e2ee2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d5d92c87544c4d8080e19c1f6429bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:03.291171 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e7a69126-f6e3-41d2-a123-0901511cc701 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] 10.222.0.46 "GET /compute/v2.1/servers/a0856a94-f8a0-4fac-904b-8809dd0123c9" status: 200 len: 1324 microversion: 2.1 time: 0.843576 Jan 15 20:56:03.292469 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1104/2158] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:02 2022] GET /compute/v2.1/servers/a0856a94-f8a0-4fac-904b-8809dd0123c9 => generated 1324 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:03.301972 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0ab3a8ce-a5fa-4351-a661-15f6eb18b021 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:03.302686 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-0ab3a8ce-a5fa-4351-a661-15f6eb18b021 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] [instance: 0207c6e5-54cf-4b26-b1e7-ed649dac8bb9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:03.311018 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0ab3a8ce-a5fa-4351-a661-15f6eb18b021 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:03.311798 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0ab3a8ce-a5fa-4351-a661-15f6eb18b021 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:03.313049 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0ab3a8ce-a5fa-4351-a661-15f6eb18b021 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:03.313696 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0ab3a8ce-a5fa-4351-a661-15f6eb18b021 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:03.672231 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-f2fcfc8c-6af6-4a0c-944c-d8dd163ac89b tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:03.698318 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-0ab3a8ce-a5fa-4351-a661-15f6eb18b021 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ec114f8ece434aa496cd401494e2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a05b1a0a7479db84b762eca23b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:03.712289 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f2fcfc8c-6af6-4a0c-944c-d8dd163ac89b tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/ae964f06-d93f-4029-9565-6f3d8d280d23" status: 200 len: 1315 microversion: 2.1 time: 0.519260 Jan 15 20:56:03.717530 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1055/2159] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:03 2022] GET /compute/v2.1/servers/ae964f06-d93f-4029-9565-6f3d8d280d23 => generated 1315 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:03.727292 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0ab3a8ce-a5fa-4351-a661-15f6eb18b021 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] 10.222.0.46 "GET /compute/v2.1/servers/0207c6e5-54cf-4b26-b1e7-ed649dac8bb9" status: 200 len: 1493 microversion: 2.1 time: 0.421645 Jan 15 20:56:03.738921 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1105/2160] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:03 2022] GET /compute/v2.1/servers/0207c6e5-54cf-4b26-b1e7-ed649dac8bb9 => generated 1493 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:03.759214 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f9a033a5-82ac-4980-a84a-dbab9a5452dc tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:03.760464 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f8466d88-b447-4119-a524-4a71d43366c3 tempest-ImagesMetadataTestJSON-1960834290 tempest-ImagesMetadataTestJSON-1960834290-project] Calling method '.version_select at 0x7f30c8801f70>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:03.763655 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f9a033a5-82ac-4980-a84a-dbab9a5452dc tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] [instance: 62ae2a15-8c2c-4dad-971f-0611238103a3] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:03.789885 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f9a033a5-82ac-4980-a84a-dbab9a5452dc tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:03.790094 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f9a033a5-82ac-4980-a84a-dbab9a5452dc tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:03.790859 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f9a033a5-82ac-4980-a84a-dbab9a5452dc tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:03.794281 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f9a033a5-82ac-4980-a84a-dbab9a5452dc tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:03.858590 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f8466d88-b447-4119-a524-4a71d43366c3 tempest-ImagesMetadataTestJSON-1960834290 tempest-ImagesMetadataTestJSON-1960834290-project] 10.222.0.46 "GET /compute/v2.1/images/cd034461-502b-4b3c-8155-79defb48d2b6/metadata" status: 200 len: 85 microversion: 2.1 time: 0.139900 Jan 15 20:56:03.860428 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1056/2161] 10.222.0.46 () {58 vars in 1259 bytes} [Sat Jan 15 20:56:03 2022] GET /compute/v2.1/images/cd034461-502b-4b3c-8155-79defb48d2b6/metadata => generated 85 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 20:56:03.874347 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2df8d9d7-ccfb-47c5-8d9b-459b83b93749 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:03.876655 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-2df8d9d7-ccfb-47c5-8d9b-459b83b93749 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] [instance: b1eb0bef-5aaf-46d6-8739-b12303df9842] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:03.892442 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2df8d9d7-ccfb-47c5-8d9b-459b83b93749 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:03.898975 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2df8d9d7-ccfb-47c5-8d9b-459b83b93749 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:03.911183 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2df8d9d7-ccfb-47c5-8d9b-459b83b93749 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:03.911812 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2df8d9d7-ccfb-47c5-8d9b-459b83b93749 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:04.005963 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2df8d9d7-ccfb-47c5-8d9b-459b83b93749 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] 10.222.0.46 "POST /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842/action" status: 200 len: 32632 microversion: 2.1 time: 0.144099 Jan 15 20:56:04.008615 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1057/2162] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:56:03 2022] POST /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842/action => generated 32632 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:56:04.019821 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2996866d-f476-4806-84b5-3e1705f1a025 tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Calling method '.version_select at 0x7f30ceae6e50>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:04.021198 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-migrations:index": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:56:04.021198 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:56:04.022615 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2996866d-f476-4806-84b5-3e1705f1a025 tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:04.035616 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2996866d-f476-4806-84b5-3e1705f1a025 tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:04.064029 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2996866d-f476-4806-84b5-3e1705f1a025 tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] 10.222.0.46 "GET /compute/v2.1/os-migrations" status: 200 len: 400 microversion: 2.1 time: 0.050544 Jan 15 20:56:04.066275 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1058/2163] 10.222.0.46 () {58 vars in 1142 bytes} [Sat Jan 15 20:56:04 2022] GET /compute/v2.1/os-migrations => generated 400 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:56:04.085756 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5f5e316b-0cdd-4a8c-9da4-3d74eddb4feb tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:04.088387 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-5f5e316b-0cdd-4a8c-9da4-3d74eddb4feb tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] [instance: 0207c6e5-54cf-4b26-b1e7-ed649dac8bb9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:04.102378 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5f5e316b-0cdd-4a8c-9da4-3d74eddb4feb tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:04.104831 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5f5e316b-0cdd-4a8c-9da4-3d74eddb4feb tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:04.106306 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5f5e316b-0cdd-4a8c-9da4-3d74eddb4feb tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:04.106896 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5f5e316b-0cdd-4a8c-9da4-3d74eddb4feb tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:04.432813 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-f9a033a5-82ac-4980-a84a-dbab9a5452dc tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4c2db123e34ed9bdba89f7150ebcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca2cdba56c74d46a478aff355b23447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:04.445815 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f9a033a5-82ac-4980-a84a-dbab9a5452dc tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] 10.222.0.46 "GET /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3" status: 200 len: 1292 microversion: 2.1 time: 0.701301 Jan 15 20:56:04.446730 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1106/2164] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:03 2022] GET /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3 => generated 1292 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:04.462036 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ddf699fd-c33e-4cd5-b076-d9f50e973c8d tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:04.462822 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ddf699fd-c33e-4cd5-b076-d9f50e973c8d tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] [instance: a0856a94-f8a0-4fac-904b-8809dd0123c9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:04.478905 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ddf699fd-c33e-4cd5-b076-d9f50e973c8d tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:04.479338 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ddf699fd-c33e-4cd5-b076-d9f50e973c8d tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:04.480334 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ddf699fd-c33e-4cd5-b076-d9f50e973c8d tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:04.481353 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ddf699fd-c33e-4cd5-b076-d9f50e973c8d tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:04.587440 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5f5e316b-0cdd-4a8c-9da4-3d74eddb4feb tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/0207c6e5-54cf-4b26-b1e7-ed649dac8bb9" status: 200 len: 1644 microversion: 2.1 time: 0.513728 Jan 15 20:56:04.592399 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1059/2165] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:04 2022] GET /compute/v2.1/servers/0207c6e5-54cf-4b26-b1e7-ed649dac8bb9 => generated 1644 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:04.735332 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2855c123-f9be-4c90-8ae7-658fd4178795 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:04.736509 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-2855c123-f9be-4c90-8ae7-658fd4178795 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: ae964f06-d93f-4029-9565-6f3d8d280d23] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:04.754846 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2855c123-f9be-4c90-8ae7-658fd4178795 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:04.755760 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2855c123-f9be-4c90-8ae7-658fd4178795 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:04.757122 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2855c123-f9be-4c90-8ae7-658fd4178795 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:04.757833 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2855c123-f9be-4c90-8ae7-658fd4178795 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:05.064009 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-ddf699fd-c33e-4cd5-b076-d9f50e973c8d tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e1b423e1a9146c8bb202ba012e2ee2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d5d92c87544c4d8080e19c1f6429bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:05.075164 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ddf699fd-c33e-4cd5-b076-d9f50e973c8d tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] 10.222.0.46 "GET /compute/v2.1/servers/a0856a94-f8a0-4fac-904b-8809dd0123c9" status: 200 len: 1324 microversion: 2.1 time: 0.626983 Jan 15 20:56:05.076111 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1107/2166] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:04 2022] GET /compute/v2.1/servers/a0856a94-f8a0-4fac-904b-8809dd0123c9 => generated 1324 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:05.082997 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a2293d3e-7606-4c5c-8c1c-0b15c336b79d tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1441227234", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "networks": [{"uuid": "dd4402cd-4bc8-45f2-ad1b-283bdc21d905"}]}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:05.161465 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.network.neutron [None req-a2293d3e-7606-4c5c-8c1c-0b15c336b79d tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] validate_networks() for [('dd4402cd-4bc8-45f2-ad1b-283bdc21d905', None, None, None, None, None)] {{(pid=129366) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 20:56:05.372877 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-2855c123-f9be-4c90-8ae7-658fd4178795 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:05.386349 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2855c123-f9be-4c90-8ae7-658fd4178795 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/ae964f06-d93f-4029-9565-6f3d8d280d23" status: 200 len: 1315 microversion: 2.1 time: 0.655840 Jan 15 20:56:05.387286 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1060/2167] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:04 2022] GET /compute/v2.1/servers/ae964f06-d93f-4029-9565-6f3d8d280d23 => generated 1315 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:56:05.400998 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-7cadd2c0-3c36-4da2-87d6-47280b118fea req-d4f0ab0c-3959-4274-a10f-8a3b5e51c5b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae964f06-d93f-4029-9565-6f3d8d280d23", "name": "network-vif-plugged", "status": "completed", "tag": "e8cb3b3e-9ba7-4dc0-86e0-83c3f385db9f"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:05.406118 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:56:05.406118 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:56:05.414253 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-7cadd2c0-3c36-4da2-87d6-47280b118fea req-d4f0ab0c-3959-4274-a10f-8a3b5e51c5b6 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:05.415625 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-7cadd2c0-3c36-4da2-87d6-47280b118fea req-d4f0ab0c-3959-4274-a10f-8a3b5e51c5b6 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:05.430044 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-7cadd2c0-3c36-4da2-87d6-47280b118fea req-d4f0ab0c-3959-4274-a10f-8a3b5e51c5b6 service nova] Creating event network-vif-plugged:e8cb3b3e-9ba7-4dc0-86e0-83c3f385db9f for instance ae964f06-d93f-4029-9565-6f3d8d280d23 on nch1-master-1 Jan 15 20:56:05.436407 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-7cadd2c0-3c36-4da2-87d6-47280b118fea req-d4f0ab0c-3959-4274-a10f-8a3b5e51c5b6 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047051 Jan 15 20:56:05.440485 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1061/2168] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:56:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:56:05.457865 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-71f14616-389a-436a-aec1-d8dd7674e474 req-04e99ea5-86d9-4e90-9099-c06e7cbcd30d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62ae2a15-8c2c-4dad-971f-0611238103a3", "tag": "77153925-7185-4583-89dc-fdd59e40d230"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:05.459580 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:56:05.459580 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:56:05.473644 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-71f14616-389a-436a-aec1-d8dd7674e474 req-04e99ea5-86d9-4e90-9099-c06e7cbcd30d service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:05.474483 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-71f14616-389a-436a-aec1-d8dd7674e474 req-04e99ea5-86d9-4e90-9099-c06e7cbcd30d service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:05.492104 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-71f14616-389a-436a-aec1-d8dd7674e474 req-04e99ea5-86d9-4e90-9099-c06e7cbcd30d service nova] Creating event network-changed:77153925-7185-4583-89dc-fdd59e40d230 for instance 62ae2a15-8c2c-4dad-971f-0611238103a3 on nch2-master-1 Jan 15 20:56:05.500157 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-71f14616-389a-436a-aec1-d8dd7674e474 req-04e99ea5-86d9-4e90-9099-c06e7cbcd30d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058176 Jan 15 20:56:05.501622 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1062/2169] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:56:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:56:05.508822 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-55113f76-e021-4079-a1c6-cafb48d06c05 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:05.510384 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-55113f76-e021-4079-a1c6-cafb48d06c05 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] [instance: b1eb0bef-5aaf-46d6-8739-b12303df9842] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:05.520618 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-55113f76-e021-4079-a1c6-cafb48d06c05 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:05.521137 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-55113f76-e021-4079-a1c6-cafb48d06c05 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:05.522201 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-55113f76-e021-4079-a1c6-cafb48d06c05 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:05.522867 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-55113f76-e021-4079-a1c6-cafb48d06c05 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:05.589190 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-55113f76-e021-4079-a1c6-cafb48d06c05 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] 10.222.0.46 "POST /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842/action" status: 200 len: 32632 microversion: 2.1 time: 0.085599 Jan 15 20:56:05.591483 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1063/2170] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:56:05 2022] POST /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842/action => generated 32632 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:56:05.599668 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-bfaa8491-fb8c-436c-8e86-453bba1a8dbb tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:05.601158 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-bfaa8491-fb8c-436c-8e86-453bba1a8dbb tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] [instance: 62ae2a15-8c2c-4dad-971f-0611238103a3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:05.610318 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bfaa8491-fb8c-436c-8e86-453bba1a8dbb tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:05.611626 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bfaa8491-fb8c-436c-8e86-453bba1a8dbb tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:05.612643 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bfaa8491-fb8c-436c-8e86-453bba1a8dbb tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:05.613116 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bfaa8491-fb8c-436c-8e86-453bba1a8dbb tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:06.120320 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-bfaa8491-fb8c-436c-8e86-453bba1a8dbb tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4c2db123e34ed9bdba89f7150ebcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca2cdba56c74d46a478aff355b23447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:06.129639 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-bfaa8491-fb8c-436c-8e86-453bba1a8dbb tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] 10.222.0.46 "GET /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3" status: 200 len: 1292 microversion: 2.1 time: 0.535458 Jan 15 20:56:06.133204 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1064/2171] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:05 2022] GET /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3 => generated 1292 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:06.188787 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-a2293d3e-7606-4c5c-8c1c-0b15c336b79d tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Flavor limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 20:56:06.189492 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-a2293d3e-7606-4c5c-8c1c-0b15c336b79d tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Image limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 20:56:06.189811 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-a2293d3e-7606-4c5c-8c1c-0b15c336b79d tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Flavor pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 20:56:06.190208 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-a2293d3e-7606-4c5c-8c1c-0b15c336b79d tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Image pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 20:56:06.190618 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-a2293d3e-7606-4c5c-8c1c-0b15c336b79d tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 20:56:06.209100 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a2293d3e-7606-4c5c-8c1c-0b15c336b79d tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:06.209818 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a2293d3e-7606-4c5c-8c1c-0b15c336b79d tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:06.215848 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a2293d3e-7606-4c5c-8c1c-0b15c336b79d tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:06.217037 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a2293d3e-7606-4c5c-8c1c-0b15c336b79d tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:06.261355 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-a2293d3e-7606-4c5c-8c1c-0b15c336b79d tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Getting quotas for project 385a05b1a0a7479db84b762eca23b55b. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:56:06.281282 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-a2293d3e-7606-4c5c-8c1c-0b15c336b79d tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Getting quotas for user e2ec114f8ece434aa496cd401494e2e4 and project 385a05b1a0a7479db84b762eca23b55b. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:56:06.306071 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a2293d3e-7606-4c5c-8c1c-0b15c336b79d tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Going to run 1 instances... {{(pid=129366) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 20:56:06.312299 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a2293d3e-7606-4c5c-8c1c-0b15c336b79d tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] [instance: 137421ba-6834-4e42-8221-9b5de84419cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 20:56:06.352046 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-cf68efd4-2f7a-4e36-b8da-b69c869983f8 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Action: 'create', calling method: .version_select at 0x7f30ceb32310>, body: {"keypair": {"name": "tempest-keypair-1906508477"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:06.394142 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-cf68efd4-2f7a-4e36-b8da-b69c869983f8 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Getting quotas for project e88ac3aebabe465c8903ac9b9d8f54ea. Resources: {'key_pairs'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:56:06.410215 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-cf68efd4-2f7a-4e36-b8da-b69c869983f8 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Getting quotas for user 3c877fc1c5964326af5d86b3aa7bf64b and project e88ac3aebabe465c8903ac9b9d8f54ea. Resources: {'key_pairs'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:56:06.432143 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a2293d3e-7606-4c5c-8c1c-0b15c336b79d tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.353767 Jan 15 20:56:06.435470 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1108/2172] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 20:56:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1358 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 20:56:06.445122 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9e980136-b076-456a-b840-1069e10e1789 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:06.448337 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-9e980136-b076-456a-b840-1069e10e1789 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] [instance: a0856a94-f8a0-4fac-904b-8809dd0123c9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:06.463990 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9e980136-b076-456a-b840-1069e10e1789 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:06.464798 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9e980136-b076-456a-b840-1069e10e1789 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:06.466206 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9e980136-b076-456a-b840-1069e10e1789 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:06.468707 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9e980136-b076-456a-b840-1069e10e1789 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:06.750819 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-cf68efd4-2f7a-4e36-b8da-b69c869983f8 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Getting quotas for project e88ac3aebabe465c8903ac9b9d8f54ea. Resources: {'key_pairs'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:56:06.764322 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-cf68efd4-2f7a-4e36-b8da-b69c869983f8 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Getting quotas for user 3c877fc1c5964326af5d86b3aa7bf64b and project e88ac3aebabe465c8903ac9b9d8f54ea. Resources: {'key_pairs'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:56:06.859065 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-cf68efd4-2f7a-4e36-b8da-b69c869983f8 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.724385 Jan 15 20:56:06.865248 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1065/2173] 10.222.0.46 () {60 vars in 1157 bytes} [Sat Jan 15 20:56:06 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:06.882733 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d34b3433-f1e5-44b3-a780-ec63d1674bca tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:06.885982 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d34b3433-f1e5-44b3-a780-ec63d1674bca tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: ae964f06-d93f-4029-9565-6f3d8d280d23] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:06.907931 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d34b3433-f1e5-44b3-a780-ec63d1674bca tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:06.909065 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d34b3433-f1e5-44b3-a780-ec63d1674bca tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:06.910049 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d34b3433-f1e5-44b3-a780-ec63d1674bca tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:06.910650 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d34b3433-f1e5-44b3-a780-ec63d1674bca tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:06.962345 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-9e980136-b076-456a-b840-1069e10e1789 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e1b423e1a9146c8bb202ba012e2ee2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d5d92c87544c4d8080e19c1f6429bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:06.999053 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-9e980136-b076-456a-b840-1069e10e1789 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] 10.222.0.46 "GET /compute/v2.1/servers/a0856a94-f8a0-4fac-904b-8809dd0123c9" status: 200 len: 1522 microversion: 2.1 time: 0.562319 Jan 15 20:56:07.003130 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1109/2174] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:06 2022] GET /compute/v2.1/servers/a0856a94-f8a0-4fac-904b-8809dd0123c9 => generated 1522 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:07.045813 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-cee351c7-cf77-444f-9fb3-88c8766e1a06 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:07.052730 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-cee351c7-cf77-444f-9fb3-88c8766e1a06 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] [instance: 137421ba-6834-4e42-8221-9b5de84419cc] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:07.302982 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-cee351c7-cf77-444f-9fb3-88c8766e1a06 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ec114f8ece434aa496cd401494e2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a05b1a0a7479db84b762eca23b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:07.311468 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-cee351c7-cf77-444f-9fb3-88c8766e1a06 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] 10.222.0.46 "GET /compute/v2.1/servers/137421ba-6834-4e42-8221-9b5de84419cc" status: 200 len: 1211 microversion: 2.1 time: 0.301311 Jan 15 20:56:07.312216 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1110/2175] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:07 2022] GET /compute/v2.1/servers/137421ba-6834-4e42-8221-9b5de84419cc => generated 1211 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:07.321059 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9b65ec3e-f914-4e84-a95e-eed78022f4d6 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:07.327254 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-9b65ec3e-f914-4e84-a95e-eed78022f4d6 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] [instance: b1eb0bef-5aaf-46d6-8739-b12303df9842] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:07.357880 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9b65ec3e-f914-4e84-a95e-eed78022f4d6 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:07.358733 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9b65ec3e-f914-4e84-a95e-eed78022f4d6 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:07.361247 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9b65ec3e-f914-4e84-a95e-eed78022f4d6 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:07.363199 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9b65ec3e-f914-4e84-a95e-eed78022f4d6 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:07.435395 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-9b65ec3e-f914-4e84-a95e-eed78022f4d6 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] 10.222.0.46 "POST /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842/action" status: 200 len: 32632 microversion: 2.1 time: 0.112983 Jan 15 20:56:07.440144 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1111/2176] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:56:07 2022] POST /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842/action => generated 32632 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:56:07.449395 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-69cb340b-03a9-4134-a49f-d274b157b7f4 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:07.453186 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-69cb340b-03a9-4134-a49f-d274b157b7f4 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] [instance: a0856a94-f8a0-4fac-904b-8809dd0123c9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:07.471910 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-69cb340b-03a9-4134-a49f-d274b157b7f4 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:07.472374 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-69cb340b-03a9-4134-a49f-d274b157b7f4 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:07.473216 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-69cb340b-03a9-4134-a49f-d274b157b7f4 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:07.483393 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-69cb340b-03a9-4134-a49f-d274b157b7f4 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:07.529424 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-69cb340b-03a9-4134-a49f-d274b157b7f4 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] [instance: a0856a94-f8a0-4fac-904b-8809dd0123c9] Going to try to terminate instance {{(pid=129366) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 20:56:07.542285 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-d34b3433-f1e5-44b3-a780-ec63d1674bca tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:07.556694 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d34b3433-f1e5-44b3-a780-ec63d1674bca tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/ae964f06-d93f-4029-9565-6f3d8d280d23" status: 200 len: 1315 microversion: 2.1 time: 0.688475 Jan 15 20:56:07.572074 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1066/2177] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:06 2022] GET /compute/v2.1/servers/ae964f06-d93f-4029-9565-6f3d8d280d23 => generated 1315 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:07.587909 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c324321e-90ee-468d-acbc-314178c700d6 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:07.594564 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c324321e-90ee-468d-acbc-314178c700d6 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] [instance: 62ae2a15-8c2c-4dad-971f-0611238103a3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:07.605096 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c324321e-90ee-468d-acbc-314178c700d6 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:07.617082 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c324321e-90ee-468d-acbc-314178c700d6 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:07.621594 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c324321e-90ee-468d-acbc-314178c700d6 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:07.622318 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c324321e-90ee-468d-acbc-314178c700d6 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:07.675869 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-69cb340b-03a9-4134-a49f-d274b157b7f4 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] 10.222.0.46 "DELETE /compute/v2.1/servers/a0856a94-f8a0-4fac-904b-8809dd0123c9" status: 204 len: 0 microversion: 2.1 time: 0.234118 Jan 15 20:56:07.680173 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1112/2178] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 20:56:07 2022] DELETE /compute/v2.1/servers/a0856a94-f8a0-4fac-904b-8809dd0123c9 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 20:56:07.706562 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-936ccc65-edf1-4520-a47c-1090d8ca4dc4 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:07.707543 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-936ccc65-edf1-4520-a47c-1090d8ca4dc4 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] [instance: a0856a94-f8a0-4fac-904b-8809dd0123c9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:07.750553 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-936ccc65-edf1-4520-a47c-1090d8ca4dc4 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:07.751031 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-936ccc65-edf1-4520-a47c-1090d8ca4dc4 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:07.753816 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-936ccc65-edf1-4520-a47c-1090d8ca4dc4 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:07.754256 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-936ccc65-edf1-4520-a47c-1090d8ca4dc4 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:08.150822 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-c324321e-90ee-468d-acbc-314178c700d6 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4c2db123e34ed9bdba89f7150ebcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca2cdba56c74d46a478aff355b23447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:08.163928 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c324321e-90ee-468d-acbc-314178c700d6 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] 10.222.0.46 "GET /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3" status: 200 len: 1292 microversion: 2.1 time: 0.589114 Jan 15 20:56:08.165138 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1067/2179] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:07 2022] GET /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3 => generated 1292 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:08.175968 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-936ccc65-edf1-4520-a47c-1090d8ca4dc4 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e1b423e1a9146c8bb202ba012e2ee2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d5d92c87544c4d8080e19c1f6429bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:08.197133 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-936ccc65-edf1-4520-a47c-1090d8ca4dc4 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] 10.222.0.46 "GET /compute/v2.1/servers/a0856a94-f8a0-4fac-904b-8809dd0123c9" status: 200 len: 1528 microversion: 2.1 time: 0.502832 Jan 15 20:56:08.197986 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1113/2180] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:07 2022] GET /compute/v2.1/servers/a0856a94-f8a0-4fac-904b-8809dd0123c9 => generated 1528 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:08.332227 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3d16a254-a9e3-41c7-a555-a596f5dd8787 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:08.333190 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-3d16a254-a9e3-41c7-a555-a596f5dd8787 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] [instance: 137421ba-6834-4e42-8221-9b5de84419cc] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:08.358759 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3d16a254-a9e3-41c7-a555-a596f5dd8787 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:08.360796 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3d16a254-a9e3-41c7-a555-a596f5dd8787 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:08.361796 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3d16a254-a9e3-41c7-a555-a596f5dd8787 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:08.363308 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3d16a254-a9e3-41c7-a555-a596f5dd8787 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:08.456826 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-603b5417-6c41-4361-87a9-4e52f4bb8660 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:08.458447 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-603b5417-6c41-4361-87a9-4e52f4bb8660 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] [instance: b1eb0bef-5aaf-46d6-8739-b12303df9842] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:08.468956 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-603b5417-6c41-4361-87a9-4e52f4bb8660 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:08.469793 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-603b5417-6c41-4361-87a9-4e52f4bb8660 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:08.470619 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-603b5417-6c41-4361-87a9-4e52f4bb8660 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:08.473760 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-603b5417-6c41-4361-87a9-4e52f4bb8660 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:08.533805 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-603b5417-6c41-4361-87a9-4e52f4bb8660 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] 10.222.0.46 "POST /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842/action" status: 200 len: 32632 microversion: 2.1 time: 0.086664 Jan 15 20:56:08.535935 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1114/2181] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:56:08 2022] POST /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842/action => generated 32632 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 20:56:08.572248 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-3d16a254-a9e3-41c7-a555-a596f5dd8787 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ec114f8ece434aa496cd401494e2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a05b1a0a7479db84b762eca23b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:08.581333 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-11963609-7fc8-46a7-ac4f-1e87e017baa6 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:08.582066 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-11963609-7fc8-46a7-ac4f-1e87e017baa6 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: ae964f06-d93f-4029-9565-6f3d8d280d23] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:08.585988 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3d16a254-a9e3-41c7-a555-a596f5dd8787 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] 10.222.0.46 "GET /compute/v2.1/servers/137421ba-6834-4e42-8221-9b5de84419cc" status: 200 len: 1281 microversion: 2.1 time: 0.257913 Jan 15 20:56:08.593801 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-11963609-7fc8-46a7-ac4f-1e87e017baa6 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:08.594556 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-11963609-7fc8-46a7-ac4f-1e87e017baa6 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:08.597194 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1068/2182] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:08 2022] GET /compute/v2.1/servers/137421ba-6834-4e42-8221-9b5de84419cc => generated 1281 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:08.610154 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-11963609-7fc8-46a7-ac4f-1e87e017baa6 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:08.611691 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-11963609-7fc8-46a7-ac4f-1e87e017baa6 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:08.967068 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-11963609-7fc8-46a7-ac4f-1e87e017baa6 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:08.976621 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-11963609-7fc8-46a7-ac4f-1e87e017baa6 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/ae964f06-d93f-4029-9565-6f3d8d280d23" status: 200 len: 1502 microversion: 2.1 time: 0.400792 Jan 15 20:56:08.977251 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1115/2183] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:08 2022] GET /compute/v2.1/servers/ae964f06-d93f-4029-9565-6f3d8d280d23 => generated 1502 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:56:08.994327 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-15f04be4-15d0-4575-a646-c113846df34d tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:08.994873 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-15f04be4-15d0-4575-a646-c113846df34d tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: ae964f06-d93f-4029-9565-6f3d8d280d23] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:09.002378 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-15f04be4-15d0-4575-a646-c113846df34d tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:09.003108 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-15f04be4-15d0-4575-a646-c113846df34d tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:09.004188 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-15f04be4-15d0-4575-a646-c113846df34d tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:09.004793 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-15f04be4-15d0-4575-a646-c113846df34d tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:09.100791 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-15f04be4-15d0-4575-a646-c113846df34d tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "POST /compute/v2.1/servers/ae964f06-d93f-4029-9565-6f3d8d280d23/action" status: 202 len: 0 microversion: 2.1 time: 0.110100 Jan 15 20:56:09.101414 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1069/2184] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:56:08 2022] POST /compute/v2.1/servers/ae964f06-d93f-4029-9565-6f3d8d280d23/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 20:56:09.117967 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-afc53851-61ed-4610-8dde-13533c35fd60 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:09.121598 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-afc53851-61ed-4610-8dde-13533c35fd60 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: ae964f06-d93f-4029-9565-6f3d8d280d23] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:09.135858 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-afc53851-61ed-4610-8dde-13533c35fd60 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:09.141664 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-afc53851-61ed-4610-8dde-13533c35fd60 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:09.142966 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-afc53851-61ed-4610-8dde-13533c35fd60 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:09.143568 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-afc53851-61ed-4610-8dde-13533c35fd60 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:09.184244 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d72ba117-27c3-4383-a1b3-084cbd6d21d1 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:09.185973 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d72ba117-27c3-4383-a1b3-084cbd6d21d1 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] [instance: 62ae2a15-8c2c-4dad-971f-0611238103a3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:09.204582 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d72ba117-27c3-4383-a1b3-084cbd6d21d1 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:09.205358 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d72ba117-27c3-4383-a1b3-084cbd6d21d1 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:09.206519 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d72ba117-27c3-4383-a1b3-084cbd6d21d1 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:09.208580 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d72ba117-27c3-4383-a1b3-084cbd6d21d1 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:10.066105 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-afc53851-61ed-4610-8dde-13533c35fd60 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:10.078077 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-afc53851-61ed-4610-8dde-13533c35fd60 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/ae964f06-d93f-4029-9565-6f3d8d280d23" status: 200 len: 1507 microversion: 2.1 time: 0.970481 Jan 15 20:56:10.088536 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1116/2185] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:09 2022] GET /compute/v2.1/servers/ae964f06-d93f-4029-9565-6f3d8d280d23 => generated 1507 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:10.090526 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-56541cd3-85f5-4f30-afa5-2a5e50b43081 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:10.093970 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-56541cd3-85f5-4f30-afa5-2a5e50b43081 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] [instance: a0856a94-f8a0-4fac-904b-8809dd0123c9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:10.114666 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-56541cd3-85f5-4f30-afa5-2a5e50b43081 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:10.115664 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-56541cd3-85f5-4f30-afa5-2a5e50b43081 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:10.117280 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-56541cd3-85f5-4f30-afa5-2a5e50b43081 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:10.118389 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-56541cd3-85f5-4f30-afa5-2a5e50b43081 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:10.140653 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-d72ba117-27c3-4383-a1b3-084cbd6d21d1 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4c2db123e34ed9bdba89f7150ebcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca2cdba56c74d46a478aff355b23447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:10.155563 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d72ba117-27c3-4383-a1b3-084cbd6d21d1 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] 10.222.0.46 "GET /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3" status: 200 len: 1292 microversion: 2.1 time: 0.974072 Jan 15 20:56:10.160573 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1070/2186] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:09 2022] GET /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3 => generated 1292 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:56:10.170103 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-792e7226-6a5b-4204-940c-2fff39f04ded tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:10.181674 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-792e7226-6a5b-4204-940c-2fff39f04ded tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] [instance: b1eb0bef-5aaf-46d6-8739-b12303df9842] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:10.188565 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-792e7226-6a5b-4204-940c-2fff39f04ded tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:10.189790 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-792e7226-6a5b-4204-940c-2fff39f04ded tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:10.190585 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-792e7226-6a5b-4204-940c-2fff39f04ded tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:10.191158 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-792e7226-6a5b-4204-940c-2fff39f04ded tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:10.235974 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-56541cd3-85f5-4f30-afa5-2a5e50b43081 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e1b423e1a9146c8bb202ba012e2ee2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d5d92c87544c4d8080e19c1f6429bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:10.254038 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-56541cd3-85f5-4f30-afa5-2a5e50b43081 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] 10.222.0.46 "GET /compute/v2.1/servers/a0856a94-f8a0-4fac-904b-8809dd0123c9" status: 200 len: 1486 microversion: 2.1 time: 0.174337 Jan 15 20:56:10.254654 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1117/2187] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:10 2022] GET /compute/v2.1/servers/a0856a94-f8a0-4fac-904b-8809dd0123c9 => generated 1486 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:10.259685 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-792e7226-6a5b-4204-940c-2fff39f04ded tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] 10.222.0.46 "POST /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842/action" status: 200 len: 32632 microversion: 2.1 time: 0.096315 Jan 15 20:56:10.260321 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1071/2188] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:56:10 2022] POST /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842/action => generated 32632 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:56:10.267429 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-760b3232-0109-46d1-bce6-5354c81852e5 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Calling method '.version_select at 0x7f30c8787ca0>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:10.268533 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-5de6618c-fe95-400c-9cd6-e3769ad8b644 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:10.269182 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-5de6618c-fe95-400c-9cd6-e3769ad8b644 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] [instance: 137421ba-6834-4e42-8221-9b5de84419cc] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:10.281537 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5de6618c-fe95-400c-9cd6-e3769ad8b644 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:10.282402 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5de6618c-fe95-400c-9cd6-e3769ad8b644 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:10.283538 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5de6618c-fe95-400c-9cd6-e3769ad8b644 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:10.284331 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5de6618c-fe95-400c-9cd6-e3769ad8b644 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:10.345013 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-760b3232-0109-46d1-bce6-5354c81852e5 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] 10.222.0.46 "GET /compute/v2.1/images/f45e0f29-85bf-409f-a655-73db452996e9" status: 200 len: 661 microversion: 2.1 time: 0.081166 Jan 15 20:56:10.345690 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1072/2189] 10.222.0.46 () {58 vars in 1232 bytes} [Sat Jan 15 20:56:10 2022] GET /compute/v2.1/images/f45e0f29-85bf-409f-a655-73db452996e9 => generated 661 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:56:10.359860 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-53a61794-7d42-444c-bed4-9672a58a2ede tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Calling method '.version_select at 0x7f30c87efee0>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:10.442405 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-53a61794-7d42-444c-bed4-9672a58a2ede tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] 10.222.0.46 "GET /compute/v2.1/images/f45e0f29-85bf-409f-a655-73db452996e9" status: 200 len: 661 microversion: 2.1 time: 0.088317 Jan 15 20:56:10.444169 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1073/2190] 10.222.0.46 () {58 vars in 1232 bytes} [Sat Jan 15 20:56:10 2022] GET /compute/v2.1/images/f45e0f29-85bf-409f-a655-73db452996e9 => generated 661 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:56:10.471370 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-6455beed-147c-44eb-ae8b-d3a4074ca503 req-5d90b24a-f318-4988-b3d4-e27e2be367f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0856a94-f8a0-4fac-904b-8809dd0123c9", "name": "network-vif-deleted", "tag": "4baa855f-535d-4714-bbe8-b38141fc46fc"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:10.478538 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:56:10.478538 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:56:10.501696 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-6455beed-147c-44eb-ae8b-d3a4074ca503 req-5d90b24a-f318-4988-b3d4-e27e2be367f8 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:10.504624 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-6455beed-147c-44eb-ae8b-d3a4074ca503 req-5d90b24a-f318-4988-b3d4-e27e2be367f8 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:10.531592 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-6455beed-147c-44eb-ae8b-d3a4074ca503 req-5d90b24a-f318-4988-b3d4-e27e2be367f8 service nova] Creating event network-vif-deleted:4baa855f-535d-4714-bbe8-b38141fc46fc for instance a0856a94-f8a0-4fac-904b-8809dd0123c9 on nch2-master-1 Jan 15 20:56:10.541369 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-6455beed-147c-44eb-ae8b-d3a4074ca503 req-5d90b24a-f318-4988-b3d4-e27e2be367f8 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094218 Jan 15 20:56:10.543965 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1074/2191] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:56:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:56:10.760802 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-5de6618c-fe95-400c-9cd6-e3769ad8b644 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ec114f8ece434aa496cd401494e2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a05b1a0a7479db84b762eca23b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:10.770202 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-5de6618c-fe95-400c-9cd6-e3769ad8b644 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] 10.222.0.46 "GET /compute/v2.1/servers/137421ba-6834-4e42-8221-9b5de84419cc" status: 200 len: 1311 microversion: 2.1 time: 0.505140 Jan 15 20:56:10.771400 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1118/2192] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:10 2022] GET /compute/v2.1/servers/137421ba-6834-4e42-8221-9b5de84419cc => generated 1311 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:11.049618 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-4f142e83-3848-41f1-9053-3176b27cf73d tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-484951928", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "networks": [{"uuid": "328be4aa-670f-40cd-8c6d-20a2a1c6cab2"}, {"uuid": "4442449e-d2ed-4555-9ad6-2517eb6453e5"}]}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:11.095484 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-098c736b-ecc1-46db-b1d4-4c78a5a27389 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:11.096205 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-098c736b-ecc1-46db-b1d4-4c78a5a27389 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: ae964f06-d93f-4029-9565-6f3d8d280d23] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:11.104989 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-098c736b-ecc1-46db-b1d4-4c78a5a27389 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:11.106472 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-098c736b-ecc1-46db-b1d4-4c78a5a27389 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:11.112174 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-098c736b-ecc1-46db-b1d4-4c78a5a27389 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:11.112869 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-098c736b-ecc1-46db-b1d4-4c78a5a27389 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:11.146937 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.network.neutron [None req-4f142e83-3848-41f1-9053-3176b27cf73d tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] validate_networks() for [('328be4aa-670f-40cd-8c6d-20a2a1c6cab2', None, None, None, None, None), ('4442449e-d2ed-4555-9ad6-2517eb6453e5', None, None, None, None, None)] {{(pid=129365) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 20:56:11.650803 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-098c736b-ecc1-46db-b1d4-4c78a5a27389 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:11.659986 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-098c736b-ecc1-46db-b1d4-4c78a5a27389 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/ae964f06-d93f-4029-9565-6f3d8d280d23" status: 200 len: 1487 microversion: 2.1 time: 0.567996 Jan 15 20:56:11.660571 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1119/2193] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:11 2022] GET /compute/v2.1/servers/ae964f06-d93f-4029-9565-6f3d8d280d23 => generated 1487 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:56:11.671299 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7128e9d4-b5f8-4740-a1f6-f2ff51664283 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:11.675276 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-7128e9d4-b5f8-4740-a1f6-f2ff51664283 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] [instance: 62ae2a15-8c2c-4dad-971f-0611238103a3] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:11.691961 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7128e9d4-b5f8-4740-a1f6-f2ff51664283 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:11.692620 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7128e9d4-b5f8-4740-a1f6-f2ff51664283 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:11.693640 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7128e9d4-b5f8-4740-a1f6-f2ff51664283 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:11.694077 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7128e9d4-b5f8-4740-a1f6-f2ff51664283 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:12.180314 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-7128e9d4-b5f8-4740-a1f6-f2ff51664283 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4c2db123e34ed9bdba89f7150ebcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca2cdba56c74d46a478aff355b23447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:12.198603 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7128e9d4-b5f8-4740-a1f6-f2ff51664283 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] 10.222.0.46 "GET /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3" status: 200 len: 1292 microversion: 2.1 time: 0.531907 Jan 15 20:56:12.212065 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1120/2194] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:11 2022] GET /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3 => generated 1292 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:12.221325 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-2c16136c-b7be-4e56-bd05-59841069e807 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:12.221946 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-2c16136c-b7be-4e56-bd05-59841069e807 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] [instance: a0856a94-f8a0-4fac-904b-8809dd0123c9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:12.228157 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2c16136c-b7be-4e56-bd05-59841069e807 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:12.228597 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2c16136c-b7be-4e56-bd05-59841069e807 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:12.229727 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2c16136c-b7be-4e56-bd05-59841069e807 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:12.230164 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2c16136c-b7be-4e56-bd05-59841069e807 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:12.255786 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-2c16136c-b7be-4e56-bd05-59841069e807 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] HTTP exception thrown: Instance a0856a94-f8a0-4fac-904b-8809dd0123c9 could not be found. Jan 15 20:56:12.256675 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-2c16136c-b7be-4e56-bd05-59841069e807 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Returning 404 to user: Instance a0856a94-f8a0-4fac-904b-8809dd0123c9 could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:56:12.258110 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-2c16136c-b7be-4e56-bd05-59841069e807 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] 10.222.0.46 "GET /compute/v2.1/servers/a0856a94-f8a0-4fac-904b-8809dd0123c9" status: 404 len: 111 microversion: 2.1 time: 0.044951 Jan 15 20:56:12.258764 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1121/2195] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:12 2022] GET /compute/v2.1/servers/a0856a94-f8a0-4fac-904b-8809dd0123c9 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:56:12.268328 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ff87b517-a2cd-4f7c-87f7-4970870049cb tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:12.269641 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ff87b517-a2cd-4f7c-87f7-4970870049cb tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] [instance: b1eb0bef-5aaf-46d6-8739-b12303df9842] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:12.282352 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ff87b517-a2cd-4f7c-87f7-4970870049cb tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:12.282981 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ff87b517-a2cd-4f7c-87f7-4970870049cb tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:12.283883 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ff87b517-a2cd-4f7c-87f7-4970870049cb tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:12.284396 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ff87b517-a2cd-4f7c-87f7-4970870049cb tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:12.341734 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ff87b517-a2cd-4f7c-87f7-4970870049cb tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] 10.222.0.46 "POST /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842/action" status: 200 len: 32632 microversion: 2.1 time: 0.076167 Jan 15 20:56:12.343657 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1122/2196] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:56:12 2022] POST /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842/action => generated 32632 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:56:12.351102 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4a628b34-f984-447f-8c6c-0f915da6ff22 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:12.352336 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-4a628b34-f984-447f-8c6c-0f915da6ff22 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: ae964f06-d93f-4029-9565-6f3d8d280d23] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:12.366290 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4a628b34-f984-447f-8c6c-0f915da6ff22 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:12.367043 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4a628b34-f984-447f-8c6c-0f915da6ff22 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:12.368064 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4a628b34-f984-447f-8c6c-0f915da6ff22 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:12.368680 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4a628b34-f984-447f-8c6c-0f915da6ff22 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:12.405499 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-4a628b34-f984-447f-8c6c-0f915da6ff22 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: ae964f06-d93f-4029-9565-6f3d8d280d23] Going to try to terminate instance {{(pid=129366) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 20:56:12.495472 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-4a628b34-f984-447f-8c6c-0f915da6ff22 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "DELETE /compute/v2.1/servers/ae964f06-d93f-4029-9565-6f3d8d280d23" status: 204 len: 0 microversion: 2.1 time: 0.149524 Jan 15 20:56:12.499834 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1123/2197] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 20:56:12 2022] DELETE /compute/v2.1/servers/ae964f06-d93f-4029-9565-6f3d8d280d23 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 20:56:12.505227 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c7663197-d87d-4f66-a21c-8ecf04f1691c tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:12.506641 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c7663197-d87d-4f66-a21c-8ecf04f1691c tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] [instance: 137421ba-6834-4e42-8221-9b5de84419cc] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:12.516506 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c7663197-d87d-4f66-a21c-8ecf04f1691c tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:12.517203 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c7663197-d87d-4f66-a21c-8ecf04f1691c tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:12.518393 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c7663197-d87d-4f66-a21c-8ecf04f1691c tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:12.519011 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c7663197-d87d-4f66-a21c-8ecf04f1691c tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:12.824360 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-4f142e83-3848-41f1-9053-3176b27cf73d tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Flavor limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 20:56:12.825782 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-4f142e83-3848-41f1-9053-3176b27cf73d tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Image limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 20:56:12.827176 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-4f142e83-3848-41f1-9053-3176b27cf73d tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Flavor pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 20:56:12.827802 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-4f142e83-3848-41f1-9053-3176b27cf73d tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Image pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 20:56:12.828406 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-4f142e83-3848-41f1-9053-3176b27cf73d tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 20:56:12.841956 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4f142e83-3848-41f1-9053-3176b27cf73d tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:12.843338 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4f142e83-3848-41f1-9053-3176b27cf73d tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:12.844356 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4f142e83-3848-41f1-9053-3176b27cf73d tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:12.846550 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4f142e83-3848-41f1-9053-3176b27cf73d tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:12.877810 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-c7663197-d87d-4f66-a21c-8ecf04f1691c tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ec114f8ece434aa496cd401494e2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a05b1a0a7479db84b762eca23b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:12.885932 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c7663197-d87d-4f66-a21c-8ecf04f1691c tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] 10.222.0.46 "GET /compute/v2.1/servers/137421ba-6834-4e42-8221-9b5de84419cc" status: 200 len: 1311 microversion: 2.1 time: 0.388072 Jan 15 20:56:12.888630 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1124/2198] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:12 2022] GET /compute/v2.1/servers/137421ba-6834-4e42-8221-9b5de84419cc => generated 1311 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:12.890294 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-4f142e83-3848-41f1-9053-3176b27cf73d tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Getting quotas for project dc238c23f15041c583fd50a124461b2c. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:56:12.905105 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e1a6fe21-822d-4291-a5e5-7aca087d3e5d tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Calling method '.version_select at 0x7f30ceca2e50>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:12.909547 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-4f142e83-3848-41f1-9053-3176b27cf73d tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Getting quotas for user 72f5490d676542fcb18b0dd5f5074516 and project dc238c23f15041c583fd50a124461b2c. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:56:12.930116 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-4f142e83-3848-41f1-9053-3176b27cf73d tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Going to run 1 instances... {{(pid=129365) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 20:56:12.932591 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-4f142e83-3848-41f1-9053-3176b27cf73d tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] [instance: ffb8267e-acd5-4c23-807a-07e0b02204a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129365) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 20:56:12.977846 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e1a6fe21-822d-4291-a5e5-7aca087d3e5d tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] 10.222.0.46 "GET /compute/v2.1/images/8a66e59e-576c-4fee-b472-4ff3a1894c39" status: 200 len: 661 microversion: 2.1 time: 0.087805 Jan 15 20:56:12.978540 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1125/2199] 10.222.0.46 () {58 vars in 1232 bytes} [Sat Jan 15 20:56:12 2022] GET /compute/v2.1/images/8a66e59e-576c-4fee-b472-4ff3a1894c39 => generated 661 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:56:12.987134 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8e7f3a8e-1cd2-4bda-a74c-a121e7aaf296 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Calling method '.version_select at 0x7f30cec63940>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:13.038355 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-4f142e83-3848-41f1-9053-3176b27cf73d tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.993137 Jan 15 20:56:13.039572 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1075/2200] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 20:56:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1996 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 20:56:13.040102 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-8e7f3a8e-1cd2-4bda-a74c-a121e7aaf296 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] HTTP exception thrown: Image not found. Jan 15 20:56:13.040794 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8e7f3a8e-1cd2-4bda-a74c-a121e7aaf296 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Returning 404 to user: Image not found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:56:13.041756 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-8e7f3a8e-1cd2-4bda-a74c-a121e7aaf296 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] 10.222.0.46 "DELETE /compute/v2.1/images/d1c9da41-1c3c-4367-ad6f-677f623acafb" status: 404 len: 62 microversion: 2.1 time: 0.061931 Jan 15 20:56:13.042384 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1126/2201] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:12 2022] DELETE /compute/v2.1/images/d1c9da41-1c3c-4367-ad6f-677f623acafb => generated 62 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jan 15 20:56:13.048755 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9e705455-1323-4dfe-98d0-622a69a8b4a1 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:13.049644 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-9e705455-1323-4dfe-98d0-622a69a8b4a1 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: ae964f06-d93f-4029-9565-6f3d8d280d23] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:13.051445 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-e060a0b2-8edc-4c17-9153-03c43391a31b req-0684f8b7-141a-469d-80cf-bea25de10ee1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "137421ba-6834-4e42-8221-9b5de84419cc", "tag": "eb8f87ed-8d87-47ae-bacf-831dd563cfce"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:13.061793 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:56:13.061793 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:56:13.077565 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-e060a0b2-8edc-4c17-9153-03c43391a31b req-0684f8b7-141a-469d-80cf-bea25de10ee1 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:13.078816 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9e705455-1323-4dfe-98d0-622a69a8b4a1 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:13.084737 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-e060a0b2-8edc-4c17-9153-03c43391a31b req-0684f8b7-141a-469d-80cf-bea25de10ee1 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:13.091545 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9e705455-1323-4dfe-98d0-622a69a8b4a1 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:13.094297 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9e705455-1323-4dfe-98d0-622a69a8b4a1 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:13.095198 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9e705455-1323-4dfe-98d0-622a69a8b4a1 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:13.142576 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-e060a0b2-8edc-4c17-9153-03c43391a31b req-0684f8b7-141a-469d-80cf-bea25de10ee1 service nova] Creating event network-changed:eb8f87ed-8d87-47ae-bacf-831dd563cfce for instance 137421ba-6834-4e42-8221-9b5de84419cc on nch1-master-1 Jan 15 20:56:13.156454 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-e060a0b2-8edc-4c17-9153-03c43391a31b req-0684f8b7-141a-469d-80cf-bea25de10ee1 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107631 Jan 15 20:56:13.157603 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1127/2202] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:56:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:56:13.170749 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-670504d4-d7d4-4acc-a661-76b152638d9e tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "54a11130-ddab-4bf0-b19e-8eb96b2bf7ab"}], "security_groups": [{"name": "tempest-securitygroup--2105320778"}], "key_name": "tempest-keypair-1906508477", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:13.497420 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.network.neutron [None req-670504d4-d7d4-4acc-a661-76b152638d9e tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] validate_networks() for [('54a11130-ddab-4bf0-b19e-8eb96b2bf7ab', None, None, None, None, None)] {{(pid=129366) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 20:56:13.519300 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-9e705455-1323-4dfe-98d0-622a69a8b4a1 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:13.529472 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-9e705455-1323-4dfe-98d0-622a69a8b4a1 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/ae964f06-d93f-4029-9565-6f3d8d280d23" status: 200 len: 1493 microversion: 2.1 time: 0.488173 Jan 15 20:56:13.530650 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1076/2203] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:13 2022] GET /compute/v2.1/servers/ae964f06-d93f-4029-9565-6f3d8d280d23 => generated 1493 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:13.535112 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-0dc758c2-4fec-4b94-8e33-4244cffc1215 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Calling method '.version_select at 0x7f30c87d6790>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:13.612819 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-0dc758c2-4fec-4b94-8e33-4244cffc1215 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] 10.222.0.46 "GET /compute/v2.1/images/8a66e59e-576c-4fee-b472-4ff3a1894c39" status: 200 len: 661 microversion: 2.1 time: 0.080724 Jan 15 20:56:13.614928 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1077/2204] 10.222.0.46 () {58 vars in 1232 bytes} [Sat Jan 15 20:56:13 2022] GET /compute/v2.1/images/8a66e59e-576c-4fee-b472-4ff3a1894c39 => generated 661 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:56:13.637308 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2972d3fa-3fd3-494e-8149-5045c1fedd9e tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:13.638373 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-2972d3fa-3fd3-494e-8149-5045c1fedd9e tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] [instance: ffb8267e-acd5-4c23-807a-07e0b02204a0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:13.658450 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2972d3fa-3fd3-494e-8149-5045c1fedd9e tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:13.658898 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2972d3fa-3fd3-494e-8149-5045c1fedd9e tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:13.664205 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2972d3fa-3fd3-494e-8149-5045c1fedd9e tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:13.664751 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2972d3fa-3fd3-494e-8149-5045c1fedd9e tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:14.141275 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-2972d3fa-3fd3-494e-8149-5045c1fedd9e tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f5490d676542fcb18b0dd5f5074516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc238c23f15041c583fd50a124461b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:14.156467 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2972d3fa-3fd3-494e-8149-5045c1fedd9e tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] 10.222.0.46 "GET /compute/v2.1/servers/ffb8267e-acd5-4c23-807a-07e0b02204a0" status: 200 len: 1216 microversion: 2.1 time: 0.537306 Jan 15 20:56:14.158030 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1078/2205] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:13 2022] GET /compute/v2.1/servers/ffb8267e-acd5-4c23-807a-07e0b02204a0 => generated 1216 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:14.173636 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-98d555c2-6c74-41fb-a4b7-11b337ce5b49 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:14.174752 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-98d555c2-6c74-41fb-a4b7-11b337ce5b49 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] [instance: 39b25eb1-ffab-417c-b47d-893dabb85d7c] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:14.182807 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-98d555c2-6c74-41fb-a4b7-11b337ce5b49 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:14.183911 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-98d555c2-6c74-41fb-a4b7-11b337ce5b49 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:14.185443 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-98d555c2-6c74-41fb-a4b7-11b337ce5b49 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:14.186122 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-98d555c2-6c74-41fb-a4b7-11b337ce5b49 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:14.202559 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-98d555c2-6c74-41fb-a4b7-11b337ce5b49 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] HTTP exception thrown: Instance 39b25eb1-ffab-417c-b47d-893dabb85d7c could not be found. Jan 15 20:56:14.203592 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-98d555c2-6c74-41fb-a4b7-11b337ce5b49 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Returning 404 to user: Instance 39b25eb1-ffab-417c-b47d-893dabb85d7c could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:56:14.205061 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-98d555c2-6c74-41fb-a4b7-11b337ce5b49 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] 10.222.0.46 "DELETE /compute/v2.1/servers/39b25eb1-ffab-417c-b47d-893dabb85d7c" status: 404 len: 111 microversion: 2.1 time: 0.045420 Jan 15 20:56:14.210296 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1079/2206] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 20:56:14 2022] DELETE /compute/v2.1/servers/39b25eb1-ffab-417c-b47d-893dabb85d7c => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:56:14.216328 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-af292d2a-dc23-463a-ac13-815abf1dd00f tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:14.218039 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-af292d2a-dc23-463a-ac13-815abf1dd00f tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] [instance: 62ae2a15-8c2c-4dad-971f-0611238103a3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:14.237499 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-af292d2a-dc23-463a-ac13-815abf1dd00f tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:14.237986 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-af292d2a-dc23-463a-ac13-815abf1dd00f tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:14.238828 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-af292d2a-dc23-463a-ac13-815abf1dd00f tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:14.239268 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-af292d2a-dc23-463a-ac13-815abf1dd00f tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:14.625545 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-af292d2a-dc23-463a-ac13-815abf1dd00f tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4c2db123e34ed9bdba89f7150ebcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca2cdba56c74d46a478aff355b23447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:14.634128 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-af292d2a-dc23-463a-ac13-815abf1dd00f tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] 10.222.0.46 "GET /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3" status: 200 len: 1292 microversion: 2.1 time: 0.422370 Jan 15 20:56:14.635511 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1080/2207] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:14 2022] GET /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3 => generated 1292 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:14.641200 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-7c47efac-de71-4808-899e-790b37a6c374 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:14.642605 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-7c47efac-de71-4808-899e-790b37a6c374 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] [instance: b1eb0bef-5aaf-46d6-8739-b12303df9842] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:14.649400 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7c47efac-de71-4808-899e-790b37a6c374 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:14.650345 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7c47efac-de71-4808-899e-790b37a6c374 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:14.651259 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7c47efac-de71-4808-899e-790b37a6c374 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:14.652327 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7c47efac-de71-4808-899e-790b37a6c374 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:14.696237 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-7c47efac-de71-4808-899e-790b37a6c374 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] 10.222.0.46 "POST /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842/action" status: 200 len: 32632 microversion: 2.1 time: 0.059157 Jan 15 20:56:14.697437 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1081/2208] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:56:14 2022] POST /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842/action => generated 32632 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:56:14.705129 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-6fa9115d-4e17-40c9-a107-c8b9a2eb78d7 req-7ef4c515-6a13-47b4-b627-b3232c28cbd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62ae2a15-8c2c-4dad-971f-0611238103a3", "name": "network-vif-plugged", "status": "completed", "tag": "77153925-7185-4583-89dc-fdd59e40d230"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:14.706962 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:56:14.706962 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:56:14.717181 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-6fa9115d-4e17-40c9-a107-c8b9a2eb78d7 req-7ef4c515-6a13-47b4-b627-b3232c28cbd8 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:14.718000 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-6fa9115d-4e17-40c9-a107-c8b9a2eb78d7 req-7ef4c515-6a13-47b4-b627-b3232c28cbd8 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:14.745162 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-6fa9115d-4e17-40c9-a107-c8b9a2eb78d7 req-7ef4c515-6a13-47b4-b627-b3232c28cbd8 service nova] Creating event network-vif-plugged:77153925-7185-4583-89dc-fdd59e40d230 for instance 62ae2a15-8c2c-4dad-971f-0611238103a3 on nch2-master-1 Jan 15 20:56:14.751975 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-6fa9115d-4e17-40c9-a107-c8b9a2eb78d7 req-7ef4c515-6a13-47b4-b627-b3232c28cbd8 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051903 Jan 15 20:56:14.753256 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1082/2209] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:56:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:56:14.758483 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-063f9e95-7b10-42a8-9f44-a8d20ab203bd tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:14.762264 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-063f9e95-7b10-42a8-9f44-a8d20ab203bd tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] [instance: 137421ba-6834-4e42-8221-9b5de84419cc] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:14.770774 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-063f9e95-7b10-42a8-9f44-a8d20ab203bd tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:14.771764 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-063f9e95-7b10-42a8-9f44-a8d20ab203bd tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:14.773491 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-063f9e95-7b10-42a8-9f44-a8d20ab203bd tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:14.774326 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-063f9e95-7b10-42a8-9f44-a8d20ab203bd tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:14.842270 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-670504d4-d7d4-4acc-a661-76b152638d9e tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Flavor limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 20:56:14.843348 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-670504d4-d7d4-4acc-a661-76b152638d9e tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Image limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 20:56:14.843994 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-670504d4-d7d4-4acc-a661-76b152638d9e tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Flavor pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 20:56:14.844558 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-670504d4-d7d4-4acc-a661-76b152638d9e tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Image pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 20:56:14.846059 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-670504d4-d7d4-4acc-a661-76b152638d9e tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 20:56:14.865326 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-670504d4-d7d4-4acc-a661-76b152638d9e tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:14.865904 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-670504d4-d7d4-4acc-a661-76b152638d9e tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:14.867046 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-670504d4-d7d4-4acc-a661-76b152638d9e tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:14.867608 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-670504d4-d7d4-4acc-a661-76b152638d9e tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:14.916418 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-670504d4-d7d4-4acc-a661-76b152638d9e tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Getting quotas for project e88ac3aebabe465c8903ac9b9d8f54ea. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:56:14.926545 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-670504d4-d7d4-4acc-a661-76b152638d9e tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Getting quotas for user 3c877fc1c5964326af5d86b3aa7bf64b and project e88ac3aebabe465c8903ac9b9d8f54ea. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:56:14.958419 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-670504d4-d7d4-4acc-a661-76b152638d9e tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Going to run 1 instances... {{(pid=129366) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 20:56:14.966563 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-670504d4-d7d4-4acc-a661-76b152638d9e tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] [instance: 70bf65cf-55e2-459a-aaf1-c3eb851a6ccf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 20:56:15.043851 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-670504d4-d7d4-4acc-a661-76b152638d9e tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.883799 Jan 15 20:56:15.045257 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1128/2210] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 20:56:13 2022] POST /compute/v2.1/servers => generated 409 bytes in 1887 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 20:56:15.050337 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4e7df839-31ec-43c2-b6b8-126651da75a6 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:15.051971 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-4e7df839-31ec-43c2-b6b8-126651da75a6 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] [instance: 39b25eb1-ffab-417c-b47d-893dabb85d7c] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:15.067315 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4e7df839-31ec-43c2-b6b8-126651da75a6 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:15.067967 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4e7df839-31ec-43c2-b6b8-126651da75a6 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:15.070026 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4e7df839-31ec-43c2-b6b8-126651da75a6 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:15.070484 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4e7df839-31ec-43c2-b6b8-126651da75a6 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:15.103369 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-4e7df839-31ec-43c2-b6b8-126651da75a6 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] HTTP exception thrown: Instance 39b25eb1-ffab-417c-b47d-893dabb85d7c could not be found. Jan 15 20:56:15.103796 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4e7df839-31ec-43c2-b6b8-126651da75a6 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Returning 404 to user: Instance 39b25eb1-ffab-417c-b47d-893dabb85d7c could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:56:15.105157 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-4e7df839-31ec-43c2-b6b8-126651da75a6 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] 10.222.0.46 "GET /compute/v2.1/servers/39b25eb1-ffab-417c-b47d-893dabb85d7c" status: 404 len: 111 microversion: 2.1 time: 0.058119 Jan 15 20:56:15.109860 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1129/2211] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:15 2022] GET /compute/v2.1/servers/39b25eb1-ffab-417c-b47d-893dabb85d7c => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:56:15.114609 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4800cc59-ab1b-4339-a841-f835ec8a2e91 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:15.126066 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-4800cc59-ab1b-4339-a841-f835ec8a2e91 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: ae964f06-d93f-4029-9565-6f3d8d280d23] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:15.140207 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4800cc59-ab1b-4339-a841-f835ec8a2e91 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:15.141401 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4800cc59-ab1b-4339-a841-f835ec8a2e91 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:15.142203 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4800cc59-ab1b-4339-a841-f835ec8a2e91 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:15.146940 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4800cc59-ab1b-4339-a841-f835ec8a2e91 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:15.223420 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4800cc59-ab1b-4339-a841-f835ec8a2e91 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:15.223872 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4800cc59-ab1b-4339-a841-f835ec8a2e91 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:15.224334 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.objects.instance [None req-4800cc59-ab1b-4339-a841-f835ec8a2e91 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lazy-loading 'fault' on Instance uuid ae964f06-d93f-4029-9565-6f3d8d280d23 {{(pid=129366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 20:56:15.325675 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-4800cc59-ab1b-4339-a841-f835ec8a2e91 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:15.328506 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-063f9e95-7b10-42a8-9f44-a8d20ab203bd tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ec114f8ece434aa496cd401494e2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a05b1a0a7479db84b762eca23b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:15.336258 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-4800cc59-ab1b-4339-a841-f835ec8a2e91 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/ae964f06-d93f-4029-9565-6f3d8d280d23" status: 200 len: 1305 microversion: 2.1 time: 0.225234 Jan 15 20:56:15.336902 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1130/2212] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:15 2022] GET /compute/v2.1/servers/ae964f06-d93f-4029-9565-6f3d8d280d23 => generated 1305 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:15.355161 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-0dc18301-6ef2-4473-a5be-49604b4ee210 req-0ae38352-fc85-403e-9039-8638260c5450 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae964f06-d93f-4029-9565-6f3d8d280d23", "name": "network-vif-deleted", "tag": "e8cb3b3e-9ba7-4dc0-86e0-83c3f385db9f"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:15.358135 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:56:15.358135 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:56:15.359463 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-063f9e95-7b10-42a8-9f44-a8d20ab203bd tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] 10.222.0.46 "GET /compute/v2.1/servers/137421ba-6834-4e42-8221-9b5de84419cc" status: 200 len: 1311 microversion: 2.1 time: 0.594679 Jan 15 20:56:15.360305 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1083/2213] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:14 2022] GET /compute/v2.1/servers/137421ba-6834-4e42-8221-9b5de84419cc => generated 1311 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:15.367230 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-0dc18301-6ef2-4473-a5be-49604b4ee210 req-0ae38352-fc85-403e-9039-8638260c5450 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:15.367992 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-0dc18301-6ef2-4473-a5be-49604b4ee210 req-0ae38352-fc85-403e-9039-8638260c5450 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:15.383639 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-0dc18301-6ef2-4473-a5be-49604b4ee210 req-0ae38352-fc85-403e-9039-8638260c5450 service nova] Creating event network-vif-deleted:e8cb3b3e-9ba7-4dc0-86e0-83c3f385db9f for instance ae964f06-d93f-4029-9565-6f3d8d280d23 on nch1-master-1 Jan 15 20:56:15.389121 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c5505481-17cf-4752-8684-5274e11ad4f9 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:15.390466 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c5505481-17cf-4752-8684-5274e11ad4f9 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] [instance: 70bf65cf-55e2-459a-aaf1-c3eb851a6ccf] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:15.393301 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-0dc18301-6ef2-4473-a5be-49604b4ee210 req-0ae38352-fc85-403e-9039-8638260c5450 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054072 Jan 15 20:56:15.394267 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1131/2214] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:56:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:56:15.407548 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-44699307-0e74-4fa3-b3eb-5b34a5d174a3 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Calling method '.version_select at 0x7f30ceca2ca0>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:15.447230 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-44699307-0e74-4fa3-b3eb-5b34a5d174a3 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1095949725" status: 202 len: 0 microversion: 2.1 time: 0.051757 Jan 15 20:56:15.453146 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1132/2215] 10.222.0.46 () {58 vars in 1220 bytes} [Sat Jan 15 20:56:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1095949725 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 20:56:15.459734 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-00902b6d-f2a2-4d22-a69c-1d3d3399687a tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:15.460912 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-00902b6d-f2a2-4d22-a69c-1d3d3399687a tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] [instance: ffb8267e-acd5-4c23-807a-07e0b02204a0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:15.469089 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-00902b6d-f2a2-4d22-a69c-1d3d3399687a tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:15.469963 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-00902b6d-f2a2-4d22-a69c-1d3d3399687a tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:15.471078 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-00902b6d-f2a2-4d22-a69c-1d3d3399687a tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:15.471778 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-00902b6d-f2a2-4d22-a69c-1d3d3399687a tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:15.518673 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-c5505481-17cf-4752-8684-5274e11ad4f9 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c877fc1c5964326af5d86b3aa7bf64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ac3aebabe465c8903ac9b9d8f54ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:15.530665 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c5505481-17cf-4752-8684-5274e11ad4f9 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] 10.222.0.46 "GET /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf" status: 200 len: 1226 microversion: 2.1 time: 0.146831 Jan 15 20:56:15.531848 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1084/2216] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:15 2022] GET /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf => generated 1226 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:15.555375 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e7473398-6c87-4dc9-9b75-2c9ad1bc4839 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Calling method '.version_select at 0x7f30c877f3a0>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:15.628312 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e7473398-6c87-4dc9-9b75-2c9ad1bc4839 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] 10.222.0.46 "GET /compute/v2.1/images/b30c308a-aac8-4ea4-8059-c644a0860c32" status: 200 len: 661 microversion: 2.1 time: 0.094970 Jan 15 20:56:15.629506 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1085/2217] 10.222.0.46 () {58 vars in 1232 bytes} [Sat Jan 15 20:56:15 2022] GET /compute/v2.1/images/b30c308a-aac8-4ea4-8059-c644a0860c32 => generated 661 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:56:15.646885 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8653ac4a-686a-4fc4-b222-f7219b504c4b tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Calling method '.version_select at 0x7f30c877f9d0>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:15.716285 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-8653ac4a-686a-4fc4-b222-f7219b504c4b tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] 10.222.0.46 "GET /compute/v2.1/images/b30c308a-aac8-4ea4-8059-c644a0860c32" status: 200 len: 661 microversion: 2.1 time: 0.074868 Jan 15 20:56:15.716937 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1086/2218] 10.222.0.46 () {58 vars in 1232 bytes} [Sat Jan 15 20:56:15 2022] GET /compute/v2.1/images/b30c308a-aac8-4ea4-8059-c644a0860c32 => generated 661 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:56:15.723926 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c067cfcb-fa79-4b80-bdf3-0791e685de9b tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:15.724793 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c067cfcb-fa79-4b80-bdf3-0791e685de9b tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] [instance: 62ae2a15-8c2c-4dad-971f-0611238103a3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:15.741529 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-00902b6d-f2a2-4d22-a69c-1d3d3399687a tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f5490d676542fcb18b0dd5f5074516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc238c23f15041c583fd50a124461b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:15.750225 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-00902b6d-f2a2-4d22-a69c-1d3d3399687a tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] 10.222.0.46 "GET /compute/v2.1/servers/ffb8267e-acd5-4c23-807a-07e0b02204a0" status: 200 len: 1312 microversion: 2.1 time: 0.295596 Jan 15 20:56:15.751330 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1133/2219] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:15 2022] GET /compute/v2.1/servers/ffb8267e-acd5-4c23-807a-07e0b02204a0 => generated 1312 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:15.759398 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c067cfcb-fa79-4b80-bdf3-0791e685de9b tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:15.759860 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c067cfcb-fa79-4b80-bdf3-0791e685de9b tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:15.761389 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a72cbcce-06e4-4baf-9050-344d9b112552 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:15.762426 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a72cbcce-06e4-4baf-9050-344d9b112552 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] [instance: b1eb0bef-5aaf-46d6-8739-b12303df9842] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:15.766888 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c067cfcb-fa79-4b80-bdf3-0791e685de9b tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:15.767358 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c067cfcb-fa79-4b80-bdf3-0791e685de9b tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:15.770876 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a72cbcce-06e4-4baf-9050-344d9b112552 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:15.771643 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a72cbcce-06e4-4baf-9050-344d9b112552 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:15.772730 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a72cbcce-06e4-4baf-9050-344d9b112552 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:15.773999 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a72cbcce-06e4-4baf-9050-344d9b112552 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:15.834398 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a72cbcce-06e4-4baf-9050-344d9b112552 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] 10.222.0.46 "POST /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842/action" status: 200 len: 32632 microversion: 2.1 time: 0.080091 Jan 15 20:56:15.835786 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1134/2220] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:56:15 2022] POST /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842/action => generated 32632 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:56:15.842147 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-df4ceb99-a81c-44f3-bdea-490e94374dda tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1549312815", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:15.940814 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.network.neutron [None req-df4ceb99-a81c-44f3-bdea-490e94374dda tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] validate_networks() for None {{(pid=129366) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 20:56:15.986312 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-c067cfcb-fa79-4b80-bdf3-0791e685de9b tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4c2db123e34ed9bdba89f7150ebcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca2cdba56c74d46a478aff355b23447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:15.998064 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c067cfcb-fa79-4b80-bdf3-0791e685de9b tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] 10.222.0.46 "GET /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3" status: 200 len: 1292 microversion: 2.1 time: 0.278928 Jan 15 20:56:15.999240 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1087/2221] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:15 2022] GET /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3 => generated 1292 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:16.207175 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-df4ceb99-a81c-44f3-bdea-490e94374dda tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Flavor limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 20:56:16.207673 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-df4ceb99-a81c-44f3-bdea-490e94374dda tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Image limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 20:56:16.208222 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-df4ceb99-a81c-44f3-bdea-490e94374dda tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Flavor pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 20:56:16.208706 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-df4ceb99-a81c-44f3-bdea-490e94374dda tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Image pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 20:56:16.209218 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-df4ceb99-a81c-44f3-bdea-490e94374dda tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 20:56:16.218975 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-df4ceb99-a81c-44f3-bdea-490e94374dda tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:16.219539 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-df4ceb99-a81c-44f3-bdea-490e94374dda tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:16.220438 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-df4ceb99-a81c-44f3-bdea-490e94374dda tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:16.220979 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-df4ceb99-a81c-44f3-bdea-490e94374dda tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:16.238643 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-df4ceb99-a81c-44f3-bdea-490e94374dda tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Getting quotas for project fbb6e08a94bc415fada171a2eca3e7ad. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:56:16.243741 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-df4ceb99-a81c-44f3-bdea-490e94374dda tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Getting quotas for user 52bd234a49b24c1a8bb60ad42c0db262 and project fbb6e08a94bc415fada171a2eca3e7ad. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:56:16.256146 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-df4ceb99-a81c-44f3-bdea-490e94374dda tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Going to run 1 instances... {{(pid=129366) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 20:56:16.258640 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-df4ceb99-a81c-44f3-bdea-490e94374dda tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] [instance: bffd829f-bc6e-40a7-a9d8-59af77e5b10d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 20:56:16.305211 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-df4ceb99-a81c-44f3-bdea-490e94374dda tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.467347 Jan 15 20:56:16.305618 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1135/2222] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 20:56:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 469 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 20:56:16.354224 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2a49cf90-ff8b-486b-8e03-f37010af1098 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:16.354815 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-2a49cf90-ff8b-486b-8e03-f37010af1098 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: ae964f06-d93f-4029-9565-6f3d8d280d23] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:16.365444 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2a49cf90-ff8b-486b-8e03-f37010af1098 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:16.366410 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2a49cf90-ff8b-486b-8e03-f37010af1098 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:16.367710 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2a49cf90-ff8b-486b-8e03-f37010af1098 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:16.368219 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2a49cf90-ff8b-486b-8e03-f37010af1098 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:16.381006 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e307ea29-d14f-4281-8157-e9192e2bb224 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:16.381627 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e307ea29-d14f-4281-8157-e9192e2bb224 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] [instance: 137421ba-6834-4e42-8221-9b5de84419cc] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:16.389763 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e307ea29-d14f-4281-8157-e9192e2bb224 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:16.390294 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e307ea29-d14f-4281-8157-e9192e2bb224 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:16.391075 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e307ea29-d14f-4281-8157-e9192e2bb224 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:16.391532 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e307ea29-d14f-4281-8157-e9192e2bb224 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:16.411394 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-2a49cf90-ff8b-486b-8e03-f37010af1098 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] HTTP exception thrown: Instance ae964f06-d93f-4029-9565-6f3d8d280d23 could not be found. Jan 15 20:56:16.413980 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2a49cf90-ff8b-486b-8e03-f37010af1098 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Returning 404 to user: Instance ae964f06-d93f-4029-9565-6f3d8d280d23 could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:56:16.414966 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2a49cf90-ff8b-486b-8e03-f37010af1098 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/ae964f06-d93f-4029-9565-6f3d8d280d23" status: 404 len: 111 microversion: 2.1 time: 0.064736 Jan 15 20:56:16.420439 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1088/2223] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:16 2022] GET /compute/v2.1/servers/ae964f06-d93f-4029-9565-6f3d8d280d23 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:56:16.428041 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5a945899-58c2-4ac4-b804-e6458a7b5551 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-836008395", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:16.504341 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.network.neutron [None req-5a945899-58c2-4ac4-b804-e6458a7b5551 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] validate_networks() for None {{(pid=129365) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 20:56:16.844262 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-e307ea29-d14f-4281-8157-e9192e2bb224 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ec114f8ece434aa496cd401494e2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a05b1a0a7479db84b762eca23b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:16.858885 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e307ea29-d14f-4281-8157-e9192e2bb224 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] 10.222.0.46 "GET /compute/v2.1/servers/137421ba-6834-4e42-8221-9b5de84419cc" status: 200 len: 1311 microversion: 2.1 time: 0.485615 Jan 15 20:56:16.859670 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1136/2224] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:16 2022] GET /compute/v2.1/servers/137421ba-6834-4e42-8221-9b5de84419cc => generated 1311 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:56:16.874242 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-453fee58-6c58-4abc-ad7b-1a8a8315d88e tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:16.874863 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-453fee58-6c58-4abc-ad7b-1a8a8315d88e tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] [instance: 70bf65cf-55e2-459a-aaf1-c3eb851a6ccf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:16.887069 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-453fee58-6c58-4abc-ad7b-1a8a8315d88e tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:16.889902 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-453fee58-6c58-4abc-ad7b-1a8a8315d88e tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:16.891058 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-453fee58-6c58-4abc-ad7b-1a8a8315d88e tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:16.891703 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-453fee58-6c58-4abc-ad7b-1a8a8315d88e tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:17.023608 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-453fee58-6c58-4abc-ad7b-1a8a8315d88e tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c877fc1c5964326af5d86b3aa7bf64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ac3aebabe465c8903ac9b9d8f54ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:17.041192 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-453fee58-6c58-4abc-ad7b-1a8a8315d88e tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] 10.222.0.46 "GET /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf" status: 200 len: 1284 microversion: 2.1 time: 0.180268 Jan 15 20:56:17.045236 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1137/2225] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:16 2022] GET /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf => generated 1284 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:17.052858 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-2aef7ceb-203c-417a-b312-51465a0e51d9 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-298694990", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "networks": [{"uuid": "531bba45-51d6-4df1-9e47-d4b8172e5210"}]}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:17.112497 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-5a945899-58c2-4ac4-b804-e6458a7b5551 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Flavor limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 20:56:17.113267 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-5a945899-58c2-4ac4-b804-e6458a7b5551 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Image limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 20:56:17.114043 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-5a945899-58c2-4ac4-b804-e6458a7b5551 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Flavor pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 20:56:17.115432 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-5a945899-58c2-4ac4-b804-e6458a7b5551 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Image pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 20:56:17.116538 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-5a945899-58c2-4ac4-b804-e6458a7b5551 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 20:56:17.127899 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.network.neutron [None req-2aef7ceb-203c-417a-b312-51465a0e51d9 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] validate_networks() for [('531bba45-51d6-4df1-9e47-d4b8172e5210', None, None, None, None, None)] {{(pid=129366) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 20:56:17.134221 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5a945899-58c2-4ac4-b804-e6458a7b5551 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:17.134985 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5a945899-58c2-4ac4-b804-e6458a7b5551 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:17.138772 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5a945899-58c2-4ac4-b804-e6458a7b5551 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:17.139460 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5a945899-58c2-4ac4-b804-e6458a7b5551 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:17.177226 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-5a945899-58c2-4ac4-b804-e6458a7b5551 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Getting quotas for project fbb6e08a94bc415fada171a2eca3e7ad. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:56:17.191089 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-5a945899-58c2-4ac4-b804-e6458a7b5551 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Getting quotas for user 52bd234a49b24c1a8bb60ad42c0db262 and project fbb6e08a94bc415fada171a2eca3e7ad. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:56:17.219031 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-5a945899-58c2-4ac4-b804-e6458a7b5551 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Going to run 1 instances... {{(pid=129365) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 20:56:17.224370 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-5a945899-58c2-4ac4-b804-e6458a7b5551 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] [instance: beffc13d-acd3-455e-96d6-be4bcbb81b88] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129365) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 20:56:17.305600 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5a945899-58c2-4ac4-b804-e6458a7b5551 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.880265 Jan 15 20:56:17.306659 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1089/2226] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 20:56:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 884 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 20:56:17.315560 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-75dde7ff-1f6f-421d-8881-de294e0242b8 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:17.321203 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-75dde7ff-1f6f-421d-8881-de294e0242b8 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] [instance: ffb8267e-acd5-4c23-807a-07e0b02204a0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:17.330641 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-75dde7ff-1f6f-421d-8881-de294e0242b8 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:17.333814 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-75dde7ff-1f6f-421d-8881-de294e0242b8 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:17.334885 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-75dde7ff-1f6f-421d-8881-de294e0242b8 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:17.336612 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-75dde7ff-1f6f-421d-8881-de294e0242b8 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:17.976115 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-75dde7ff-1f6f-421d-8881-de294e0242b8 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f5490d676542fcb18b0dd5f5074516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc238c23f15041c583fd50a124461b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:17.984302 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-75dde7ff-1f6f-421d-8881-de294e0242b8 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] 10.222.0.46 "GET /compute/v2.1/servers/ffb8267e-acd5-4c23-807a-07e0b02204a0" status: 200 len: 1333 microversion: 2.1 time: 0.674578 Jan 15 20:56:17.984896 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1090/2227] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:17 2022] GET /compute/v2.1/servers/ffb8267e-acd5-4c23-807a-07e0b02204a0 => generated 1333 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:17.998997 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c0f2c2b3-971f-42ca-b42d-204dc983fbf0 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:18.000026 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c0f2c2b3-971f-42ca-b42d-204dc983fbf0 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] [instance: b1eb0bef-5aaf-46d6-8739-b12303df9842] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:18.015711 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c0f2c2b3-971f-42ca-b42d-204dc983fbf0 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:18.016156 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c0f2c2b3-971f-42ca-b42d-204dc983fbf0 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:18.016972 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c0f2c2b3-971f-42ca-b42d-204dc983fbf0 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:18.017595 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c0f2c2b3-971f-42ca-b42d-204dc983fbf0 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:18.076015 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c0f2c2b3-971f-42ca-b42d-204dc983fbf0 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] 10.222.0.46 "POST /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842/action" status: 200 len: 32632 microversion: 2.1 time: 0.081316 Jan 15 20:56:18.076906 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1091/2228] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:56:17 2022] POST /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842/action => generated 32632 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:56:18.082773 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-bd7e1da8-54b9-4f22-93f0-0143b506fdd2 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:18.083819 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-bd7e1da8-54b9-4f22-93f0-0143b506fdd2 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] [instance: 62ae2a15-8c2c-4dad-971f-0611238103a3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:18.091999 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bd7e1da8-54b9-4f22-93f0-0143b506fdd2 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:18.092705 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bd7e1da8-54b9-4f22-93f0-0143b506fdd2 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:18.093736 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bd7e1da8-54b9-4f22-93f0-0143b506fdd2 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:18.094363 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bd7e1da8-54b9-4f22-93f0-0143b506fdd2 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:18.182404 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-2aef7ceb-203c-417a-b312-51465a0e51d9 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Flavor limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 20:56:18.182970 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-2aef7ceb-203c-417a-b312-51465a0e51d9 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Image limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 20:56:18.183902 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-2aef7ceb-203c-417a-b312-51465a0e51d9 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Flavor pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 20:56:18.184529 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-2aef7ceb-203c-417a-b312-51465a0e51d9 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Image pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 20:56:18.185416 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-2aef7ceb-203c-417a-b312-51465a0e51d9 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 20:56:18.202264 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2aef7ceb-203c-417a-b312-51465a0e51d9 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:18.203150 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2aef7ceb-203c-417a-b312-51465a0e51d9 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:18.209581 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2aef7ceb-203c-417a-b312-51465a0e51d9 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:18.210502 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2aef7ceb-203c-417a-b312-51465a0e51d9 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:18.239403 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-2aef7ceb-203c-417a-b312-51465a0e51d9 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Getting quotas for project 51cad90ef72141c2983640133453f788. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:56:18.255527 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-2aef7ceb-203c-417a-b312-51465a0e51d9 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Getting quotas for user 765cbcb4d9c8476494f08b123d1db59b and project 51cad90ef72141c2983640133453f788. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:56:18.271164 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-2aef7ceb-203c-417a-b312-51465a0e51d9 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Going to run 1 instances... {{(pid=129366) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 20:56:18.273711 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-2aef7ceb-203c-417a-b312-51465a0e51d9 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: 0874eafa-ffa2-4257-b6c5-66e4bef983db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 20:56:18.328101 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-bd7e1da8-54b9-4f22-93f0-0143b506fdd2 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4c2db123e34ed9bdba89f7150ebcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca2cdba56c74d46a478aff355b23447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:18.338175 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-bd7e1da8-54b9-4f22-93f0-0143b506fdd2 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] 10.222.0.46 "GET /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3" status: 200 len: 1484 microversion: 2.1 time: 0.259719 Jan 15 20:56:18.350876 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1092/2229] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:18 2022] GET /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3 => generated 1484 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:18.356479 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-2aef7ceb-203c-417a-b312-51465a0e51d9 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.308804 Jan 15 20:56:18.359531 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-cbda8b84-5e2f-445f-aeeb-f130bb930c10 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:18.360417 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-cbda8b84-5e2f-445f-aeeb-f130bb930c10 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] [instance: beffc13d-acd3-455e-96d6-be4bcbb81b88] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:18.362872 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1138/2230] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 20:56:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1317 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 20:56:18.368415 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ac5d6dc6-e9b3-48d0-8d91-bd384cbb9761 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Calling method '.version_select at 0x7f30c8d7d5e0>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:18.368871 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cbda8b84-5e2f-445f-aeeb-f130bb930c10 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:18.369567 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cbda8b84-5e2f-445f-aeeb-f130bb930c10 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:18.370439 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cbda8b84-5e2f-445f-aeeb-f130bb930c10 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:18.379337 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cbda8b84-5e2f-445f-aeeb-f130bb930c10 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:18.400220 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-ac5d6dc6-e9b3-48d0-8d91-bd384cbb9761 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] HTTP exception thrown: Image not found. Jan 15 20:56:18.400816 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ac5d6dc6-e9b3-48d0-8d91-bd384cbb9761 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Returning 404 to user: Image not found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:56:18.401673 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ac5d6dc6-e9b3-48d0-8d91-bd384cbb9761 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] 10.222.0.46 "DELETE /compute/v2.1/images/8a2359e9-3440-4830-8682-0edb8897140a" status: 404 len: 62 microversion: 2.1 time: 0.037515 Jan 15 20:56:18.403997 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1139/2231] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:18 2022] DELETE /compute/v2.1/images/8a2359e9-3440-4830-8682-0edb8897140a => generated 62 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jan 15 20:56:18.411835 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e516a83a-e3fe-4eea-ac5c-fcc1173d49d4 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:18.412441 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e516a83a-e3fe-4eea-ac5c-fcc1173d49d4 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] [instance: 137421ba-6834-4e42-8221-9b5de84419cc] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:18.426051 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e516a83a-e3fe-4eea-ac5c-fcc1173d49d4 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:18.426706 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e516a83a-e3fe-4eea-ac5c-fcc1173d49d4 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:18.427692 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e516a83a-e3fe-4eea-ac5c-fcc1173d49d4 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:18.428363 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e516a83a-e3fe-4eea-ac5c-fcc1173d49d4 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:18.656521 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-cbda8b84-5e2f-445f-aeeb-f130bb930c10 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52bd234a49b24c1a8bb60ad42c0db262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb6e08a94bc415fada171a2eca3e7ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:18.673871 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-cbda8b84-5e2f-445f-aeeb-f130bb930c10 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] 10.222.0.46 "GET /compute/v2.1/servers/beffc13d-acd3-455e-96d6-be4bcbb81b88" status: 200 len: 1269 microversion: 2.1 time: 0.321363 Jan 15 20:56:18.675785 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1093/2232] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:18 2022] GET /compute/v2.1/servers/beffc13d-acd3-455e-96d6-be4bcbb81b88 => generated 1269 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:18.686311 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-38ac7626-3fd4-4856-85a1-030f1af85f29 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:18.707438 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-38ac7626-3fd4-4856-85a1-030f1af85f29 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] [instance: 70bf65cf-55e2-459a-aaf1-c3eb851a6ccf] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:18.716394 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-38ac7626-3fd4-4856-85a1-030f1af85f29 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:18.717612 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-38ac7626-3fd4-4856-85a1-030f1af85f29 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:18.718883 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-38ac7626-3fd4-4856-85a1-030f1af85f29 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:18.719515 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-38ac7626-3fd4-4856-85a1-030f1af85f29 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:18.930863 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-e516a83a-e3fe-4eea-ac5c-fcc1173d49d4 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ec114f8ece434aa496cd401494e2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a05b1a0a7479db84b762eca23b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:18.946243 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e516a83a-e3fe-4eea-ac5c-fcc1173d49d4 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] 10.222.0.46 "GET /compute/v2.1/servers/137421ba-6834-4e42-8221-9b5de84419cc" status: 200 len: 1311 microversion: 2.1 time: 0.542115 Jan 15 20:56:18.957196 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1140/2233] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:18 2022] GET /compute/v2.1/servers/137421ba-6834-4e42-8221-9b5de84419cc => generated 1311 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:18.960912 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c63e4d49-9a77-4762-bf43-31d82af05659 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:18.962733 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c63e4d49-9a77-4762-bf43-31d82af05659 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] [instance: 62ae2a15-8c2c-4dad-971f-0611238103a3] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:18.977334 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c63e4d49-9a77-4762-bf43-31d82af05659 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:18.978953 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c63e4d49-9a77-4762-bf43-31d82af05659 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:18.983651 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c63e4d49-9a77-4762-bf43-31d82af05659 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:18.984196 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c63e4d49-9a77-4762-bf43-31d82af05659 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:19.166616 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-38ac7626-3fd4-4856-85a1-030f1af85f29 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c877fc1c5964326af5d86b3aa7bf64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ac3aebabe465c8903ac9b9d8f54ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:19.191296 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-38ac7626-3fd4-4856-85a1-030f1af85f29 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] 10.222.0.46 "GET /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf" status: 200 len: 1352 microversion: 2.1 time: 0.510782 Jan 15 20:56:19.192875 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1094/2234] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:18 2022] GET /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf => generated 1352 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:19.196306 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c63e4d49-9a77-4762-bf43-31d82af05659 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] 10.222.0.46 "GET /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.244869 Jan 15 20:56:19.197683 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1141/2235] 10.222.0.46 () {58 vars in 1274 bytes} [Sat Jan 15 20:56:18 2022] GET /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/os-interface => generated 285 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:56:19.199415 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-dfe1e531-cb95-47dc-a0bc-78f72976c733 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:19.200621 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-dfe1e531-cb95-47dc-a0bc-78f72976c733 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: 0874eafa-ffa2-4257-b6c5-66e4bef983db] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:19.203392 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4c350751-b8db-4859-b6ee-572be3fc649f tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:19.203895 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-4c350751-b8db-4859-b6ee-572be3fc649f tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] [instance: 21c7200b-cace-49b4-ab7f-bf43771825ed] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:19.222068 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dfe1e531-cb95-47dc-a0bc-78f72976c733 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:19.223301 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4c350751-b8db-4859-b6ee-572be3fc649f tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:19.223584 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dfe1e531-cb95-47dc-a0bc-78f72976c733 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:19.223753 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4c350751-b8db-4859-b6ee-572be3fc649f tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:19.225485 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dfe1e531-cb95-47dc-a0bc-78f72976c733 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:19.226252 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dfe1e531-cb95-47dc-a0bc-78f72976c733 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:19.229104 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4c350751-b8db-4859-b6ee-572be3fc649f tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:19.233371 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4c350751-b8db-4859-b6ee-572be3fc649f tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:19.263781 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-4c350751-b8db-4859-b6ee-572be3fc649f tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] HTTP exception thrown: Instance 21c7200b-cace-49b4-ab7f-bf43771825ed could not be found. Jan 15 20:56:19.264644 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4c350751-b8db-4859-b6ee-572be3fc649f tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Returning 404 to user: Instance 21c7200b-cace-49b4-ab7f-bf43771825ed could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:56:19.265679 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-4c350751-b8db-4859-b6ee-572be3fc649f tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] 10.222.0.46 "DELETE /compute/v2.1/servers/21c7200b-cace-49b4-ab7f-bf43771825ed" status: 404 len: 111 microversion: 2.1 time: 0.066862 Jan 15 20:56:19.266749 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1142/2236] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 20:56:19 2022] DELETE /compute/v2.1/servers/21c7200b-cace-49b4-ab7f-bf43771825ed => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:56:19.275323 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-13c760d5-fc22-48a8-9b46-0fc79f26e2f6 req-aa6f0783-6a01-4486-a2c4-c5f17e8b037d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "137421ba-6834-4e42-8221-9b5de84419cc", "name": "network-vif-plugged", "status": "completed", "tag": "eb8f87ed-8d87-47ae-bacf-831dd563cfce"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:19.278235 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:56:19.278235 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:56:19.291947 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-13c760d5-fc22-48a8-9b46-0fc79f26e2f6 req-aa6f0783-6a01-4486-a2c4-c5f17e8b037d service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:19.293968 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-13c760d5-fc22-48a8-9b46-0fc79f26e2f6 req-aa6f0783-6a01-4486-a2c4-c5f17e8b037d service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:19.320455 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-13c760d5-fc22-48a8-9b46-0fc79f26e2f6 req-aa6f0783-6a01-4486-a2c4-c5f17e8b037d service nova] Creating event network-vif-plugged:eb8f87ed-8d87-47ae-bacf-831dd563cfce for instance 137421ba-6834-4e42-8221-9b5de84419cc on nch1-master-1 Jan 15 20:56:19.329396 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-13c760d5-fc22-48a8-9b46-0fc79f26e2f6 req-aa6f0783-6a01-4486-a2c4-c5f17e8b037d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059424 Jan 15 20:56:19.330513 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1143/2237] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:56:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:56:19.338808 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-49d0ff22-f224-4310-9253-4d24c688b547 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:19.339752 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-49d0ff22-f224-4310-9253-4d24c688b547 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] [instance: ffb8267e-acd5-4c23-807a-07e0b02204a0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:19.351671 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-49d0ff22-f224-4310-9253-4d24c688b547 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:19.352316 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-49d0ff22-f224-4310-9253-4d24c688b547 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:19.353292 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-49d0ff22-f224-4310-9253-4d24c688b547 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:19.354279 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-49d0ff22-f224-4310-9253-4d24c688b547 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:19.381535 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-dfe1e531-cb95-47dc-a0bc-78f72976c733 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:19.391460 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-dfe1e531-cb95-47dc-a0bc-78f72976c733 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/0874eafa-ffa2-4257-b6c5-66e4bef983db" status: 200 len: 1210 microversion: 2.1 time: 0.197152 Jan 15 20:56:19.393880 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1095/2238] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:19 2022] GET /compute/v2.1/servers/0874eafa-ffa2-4257-b6c5-66e4bef983db => generated 1210 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:19.403425 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-0b2cb55c-df84-4282-b8bb-bb171ca4203e tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:19.404422 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-0b2cb55c-df84-4282-b8bb-bb171ca4203e tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] [instance: b1eb0bef-5aaf-46d6-8739-b12303df9842] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:19.411444 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0b2cb55c-df84-4282-b8bb-bb171ca4203e tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:19.412162 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0b2cb55c-df84-4282-b8bb-bb171ca4203e tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:19.413260 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0b2cb55c-df84-4282-b8bb-bb171ca4203e tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:19.413882 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0b2cb55c-df84-4282-b8bb-bb171ca4203e tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:19.482469 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-0b2cb55c-df84-4282-b8bb-bb171ca4203e tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] 10.222.0.46 "POST /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842/action" status: 200 len: 32632 microversion: 2.1 time: 0.084101 Jan 15 20:56:19.495716 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1096/2239] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:56:19 2022] POST /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842/action => generated 32632 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:56:19.510840 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-b9f4d4a0-5a7a-47f2-9b4a-657d2c141d64 req-fda2cf44-50ea-4f13-a3fa-5e365a5504c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffb8267e-acd5-4c23-807a-07e0b02204a0", "tag": "d491075b-3ac1-4e95-a3ad-e9a004d6530d"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:19.512527 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:56:19.512527 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:56:19.521074 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-b9f4d4a0-5a7a-47f2-9b4a-657d2c141d64 req-fda2cf44-50ea-4f13-a3fa-5e365a5504c5 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:19.521751 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-b9f4d4a0-5a7a-47f2-9b4a-657d2c141d64 req-fda2cf44-50ea-4f13-a3fa-5e365a5504c5 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:19.533736 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-b9f4d4a0-5a7a-47f2-9b4a-657d2c141d64 req-fda2cf44-50ea-4f13-a3fa-5e365a5504c5 service nova] Creating event network-changed:d491075b-3ac1-4e95-a3ad-e9a004d6530d for instance ffb8267e-acd5-4c23-807a-07e0b02204a0 on nch2-master-1 Jan 15 20:56:19.539252 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-b9f4d4a0-5a7a-47f2-9b4a-657d2c141d64 req-fda2cf44-50ea-4f13-a3fa-5e365a5504c5 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040954 Jan 15 20:56:19.539994 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1097/2240] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:56:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:56:19.546002 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-42abad7f-6069-40d1-90d5-d8af6430c618 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:19.546745 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-42abad7f-6069-40d1-90d5-d8af6430c618 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] [instance: 21c7200b-cace-49b4-ab7f-bf43771825ed] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:19.554181 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-42abad7f-6069-40d1-90d5-d8af6430c618 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:19.555140 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-42abad7f-6069-40d1-90d5-d8af6430c618 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:19.556225 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-42abad7f-6069-40d1-90d5-d8af6430c618 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:19.556862 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-42abad7f-6069-40d1-90d5-d8af6430c618 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:19.574584 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-42abad7f-6069-40d1-90d5-d8af6430c618 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] HTTP exception thrown: Instance 21c7200b-cace-49b4-ab7f-bf43771825ed could not be found. Jan 15 20:56:19.575579 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-42abad7f-6069-40d1-90d5-d8af6430c618 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] Returning 404 to user: Instance 21c7200b-cace-49b4-ab7f-bf43771825ed could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:56:19.576591 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-42abad7f-6069-40d1-90d5-d8af6430c618 tempest-ImagesOneServerNegativeTestJSON-1333539543 tempest-ImagesOneServerNegativeTestJSON-1333539543-project] 10.222.0.46 "GET /compute/v2.1/servers/21c7200b-cace-49b4-ab7f-bf43771825ed" status: 404 len: 111 microversion: 2.1 time: 0.035257 Jan 15 20:56:19.577752 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1098/2241] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:19 2022] GET /compute/v2.1/servers/21c7200b-cace-49b4-ab7f-bf43771825ed => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:56:19.681885 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-49d0ff22-f224-4310-9253-4d24c688b547 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f5490d676542fcb18b0dd5f5074516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc238c23f15041c583fd50a124461b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:19.693245 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-20b73771-486e-41d8-912b-5d84f42f4a1f tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:19.694738 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-20b73771-486e-41d8-912b-5d84f42f4a1f tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] [instance: beffc13d-acd3-455e-96d6-be4bcbb81b88] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:19.695698 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-49d0ff22-f224-4310-9253-4d24c688b547 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] 10.222.0.46 "GET /compute/v2.1/servers/ffb8267e-acd5-4c23-807a-07e0b02204a0" status: 200 len: 1333 microversion: 2.1 time: 0.363753 Jan 15 20:56:19.698351 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1144/2242] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:19 2022] GET /compute/v2.1/servers/ffb8267e-acd5-4c23-807a-07e0b02204a0 => generated 1333 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:19.705412 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-20b73771-486e-41d8-912b-5d84f42f4a1f tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:19.705865 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-20b73771-486e-41d8-912b-5d84f42f4a1f tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:19.707012 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-20b73771-486e-41d8-912b-5d84f42f4a1f tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:19.707482 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-20b73771-486e-41d8-912b-5d84f42f4a1f tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:19.842542 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-20b73771-486e-41d8-912b-5d84f42f4a1f tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52bd234a49b24c1a8bb60ad42c0db262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb6e08a94bc415fada171a2eca3e7ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:19.857861 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-20b73771-486e-41d8-912b-5d84f42f4a1f tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] 10.222.0.46 "GET /compute/v2.1/servers/beffc13d-acd3-455e-96d6-be4bcbb81b88" status: 200 len: 1275 microversion: 2.1 time: 0.168478 Jan 15 20:56:19.870280 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1099/2243] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:19 2022] GET /compute/v2.1/servers/beffc13d-acd3-455e-96d6-be4bcbb81b88 => generated 1275 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:19.967578 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-eaad3e8d-8a46-4fb4-8748-8ffe8b589dbc tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:19.968485 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-eaad3e8d-8a46-4fb4-8748-8ffe8b589dbc tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] [instance: 137421ba-6834-4e42-8221-9b5de84419cc] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:19.979860 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-eaad3e8d-8a46-4fb4-8748-8ffe8b589dbc tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:19.981726 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-eaad3e8d-8a46-4fb4-8748-8ffe8b589dbc tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:19.982706 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-eaad3e8d-8a46-4fb4-8748-8ffe8b589dbc tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:19.983350 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-eaad3e8d-8a46-4fb4-8748-8ffe8b589dbc tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:20.211908 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-7c7f5095-9437-4ec9-9716-094959f3131c tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:20.213829 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-7c7f5095-9437-4ec9-9716-094959f3131c tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] [instance: 70bf65cf-55e2-459a-aaf1-c3eb851a6ccf] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:20.221374 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7c7f5095-9437-4ec9-9716-094959f3131c tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:20.221909 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7c7f5095-9437-4ec9-9716-094959f3131c tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:20.222772 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7c7f5095-9437-4ec9-9716-094959f3131c tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:20.223292 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7c7f5095-9437-4ec9-9716-094959f3131c tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:20.941853 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-eaad3e8d-8a46-4fb4-8748-8ffe8b589dbc tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ec114f8ece434aa496cd401494e2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a05b1a0a7479db84b762eca23b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:20.947979 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-7c7f5095-9437-4ec9-9716-094959f3131c tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c877fc1c5964326af5d86b3aa7bf64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ac3aebabe465c8903ac9b9d8f54ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:20.952353 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-eaad3e8d-8a46-4fb4-8748-8ffe8b589dbc tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] 10.222.0.46 "GET /compute/v2.1/servers/137421ba-6834-4e42-8221-9b5de84419cc" status: 200 len: 1311 microversion: 2.1 time: 0.990012 Jan 15 20:56:20.955847 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-7c7f5095-9437-4ec9-9716-094959f3131c tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] 10.222.0.46 "GET /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf" status: 200 len: 1352 microversion: 2.1 time: 0.749660 Jan 15 20:56:20.964652 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1145/2244] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:19 2022] GET /compute/v2.1/servers/137421ba-6834-4e42-8221-9b5de84419cc => generated 1311 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:20.965627 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1100/2245] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:20 2022] GET /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf => generated 1352 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:56:20.970617 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-38beb964-81c7-48e0-93d6-03f0686b16d6 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:20.971767 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-38beb964-81c7-48e0-93d6-03f0686b16d6 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] [instance: b1eb0bef-5aaf-46d6-8739-b12303df9842] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:20.982605 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1ea13088-03cf-4654-b0b2-e52726c06e2b tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:20.983611 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-1ea13088-03cf-4654-b0b2-e52726c06e2b tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: 0874eafa-ffa2-4257-b6c5-66e4bef983db] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:20.985529 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-38beb964-81c7-48e0-93d6-03f0686b16d6 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:20.986001 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-38beb964-81c7-48e0-93d6-03f0686b16d6 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:20.986863 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-38beb964-81c7-48e0-93d6-03f0686b16d6 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:20.987406 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-38beb964-81c7-48e0-93d6-03f0686b16d6 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:20.992191 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1ea13088-03cf-4654-b0b2-e52726c06e2b tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:20.993008 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1ea13088-03cf-4654-b0b2-e52726c06e2b tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:20.994067 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1ea13088-03cf-4654-b0b2-e52726c06e2b tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:20.994737 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1ea13088-03cf-4654-b0b2-e52726c06e2b tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:21.049728 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-38beb964-81c7-48e0-93d6-03f0686b16d6 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] 10.222.0.46 "POST /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842/action" status: 200 len: 32632 microversion: 2.1 time: 0.082247 Jan 15 20:56:21.054843 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1101/2246] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:56:20 2022] POST /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842/action => generated 32632 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:56:21.059892 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f1b332ac-22df-42d1-82c6-e08d51f2cbef tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:21.060619 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f1b332ac-22df-42d1-82c6-e08d51f2cbef tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] [instance: ffb8267e-acd5-4c23-807a-07e0b02204a0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:21.073178 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f1b332ac-22df-42d1-82c6-e08d51f2cbef tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:21.074081 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f1b332ac-22df-42d1-82c6-e08d51f2cbef tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:21.075427 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f1b332ac-22df-42d1-82c6-e08d51f2cbef tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:21.075802 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f1b332ac-22df-42d1-82c6-e08d51f2cbef tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:21.126642 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-1ea13088-03cf-4654-b0b2-e52726c06e2b tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:21.135701 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-1ea13088-03cf-4654-b0b2-e52726c06e2b tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/0874eafa-ffa2-4257-b6c5-66e4bef983db" status: 200 len: 1272 microversion: 2.1 time: 0.157433 Jan 15 20:56:21.146535 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1146/2247] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:20 2022] GET /compute/v2.1/servers/0874eafa-ffa2-4257-b6c5-66e4bef983db => generated 1272 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:21.151869 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-bb6d5410-0f8a-4744-8507-05da7727aacb tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:21.153185 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-bb6d5410-0f8a-4744-8507-05da7727aacb tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] [instance: beffc13d-acd3-455e-96d6-be4bcbb81b88] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:21.160021 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bb6d5410-0f8a-4744-8507-05da7727aacb tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:21.160684 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bb6d5410-0f8a-4744-8507-05da7727aacb tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:21.161878 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bb6d5410-0f8a-4744-8507-05da7727aacb tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:21.162592 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bb6d5410-0f8a-4744-8507-05da7727aacb tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:21.267650 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-bb6d5410-0f8a-4744-8507-05da7727aacb tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52bd234a49b24c1a8bb60ad42c0db262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb6e08a94bc415fada171a2eca3e7ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:21.278878 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-bb6d5410-0f8a-4744-8507-05da7727aacb tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] 10.222.0.46 "GET /compute/v2.1/servers/beffc13d-acd3-455e-96d6-be4bcbb81b88" status: 200 len: 1275 microversion: 2.1 time: 0.130567 Jan 15 20:56:21.279866 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1147/2248] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:21 2022] GET /compute/v2.1/servers/beffc13d-acd3-455e-96d6-be4bcbb81b88 => generated 1275 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:21.397081 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-e8811fcc-300d-4e5a-be4a-e17e75806515 req-05d7bc09-05e1-4a6b-94ac-c18aca1e957e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70bf65cf-55e2-459a-aaf1-c3eb851a6ccf", "tag": "a6cb493c-7db8-4ea6-9c25-c683e688717c"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:21.404017 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:56:21.404017 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:56:21.432169 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-e8811fcc-300d-4e5a-be4a-e17e75806515 req-05d7bc09-05e1-4a6b-94ac-c18aca1e957e service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:21.432925 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-e8811fcc-300d-4e5a-be4a-e17e75806515 req-05d7bc09-05e1-4a6b-94ac-c18aca1e957e service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:21.477582 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-e8811fcc-300d-4e5a-be4a-e17e75806515 req-05d7bc09-05e1-4a6b-94ac-c18aca1e957e service nova] Creating event network-changed:a6cb493c-7db8-4ea6-9c25-c683e688717c for instance 70bf65cf-55e2-459a-aaf1-c3eb851a6ccf on nch1-master-1 Jan 15 20:56:21.486512 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-e8811fcc-300d-4e5a-be4a-e17e75806515 req-05d7bc09-05e1-4a6b-94ac-c18aca1e957e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103763 Jan 15 20:56:21.487660 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1148/2249] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:56:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 20:56:21.506473 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-f1b332ac-22df-42d1-82c6-e08d51f2cbef tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f5490d676542fcb18b0dd5f5074516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc238c23f15041c583fd50a124461b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:21.539451 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f1b332ac-22df-42d1-82c6-e08d51f2cbef tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] 10.222.0.46 "GET /compute/v2.1/servers/ffb8267e-acd5-4c23-807a-07e0b02204a0" status: 200 len: 1333 microversion: 2.1 time: 0.486653 Jan 15 20:56:21.540958 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1102/2250] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:21 2022] GET /compute/v2.1/servers/ffb8267e-acd5-4c23-807a-07e0b02204a0 => generated 1333 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:21.973637 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-07e12676-4c52-49ad-b247-3010f0f44d3d tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:21.974377 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-07e12676-4c52-49ad-b247-3010f0f44d3d tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] [instance: 137421ba-6834-4e42-8221-9b5de84419cc] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:21.985182 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3e51260b-6a91-458e-b3e4-49a17298c28b tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:21.985828 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-3e51260b-6a91-458e-b3e4-49a17298c28b tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] [instance: 70bf65cf-55e2-459a-aaf1-c3eb851a6ccf] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:21.986574 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-07e12676-4c52-49ad-b247-3010f0f44d3d tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:21.987628 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-07e12676-4c52-49ad-b247-3010f0f44d3d tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:21.988652 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-07e12676-4c52-49ad-b247-3010f0f44d3d tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:21.989418 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-07e12676-4c52-49ad-b247-3010f0f44d3d tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:21.997324 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3e51260b-6a91-458e-b3e4-49a17298c28b tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:21.997665 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3e51260b-6a91-458e-b3e4-49a17298c28b tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:22.002827 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3e51260b-6a91-458e-b3e4-49a17298c28b tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:22.003292 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3e51260b-6a91-458e-b3e4-49a17298c28b tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:22.463626 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-07e12676-4c52-49ad-b247-3010f0f44d3d tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ec114f8ece434aa496cd401494e2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a05b1a0a7479db84b762eca23b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:22.471283 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-07e12676-4c52-49ad-b247-3010f0f44d3d tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] 10.222.0.46 "GET /compute/v2.1/servers/137421ba-6834-4e42-8221-9b5de84419cc" status: 200 len: 1494 microversion: 2.1 time: 0.503123 Jan 15 20:56:22.471868 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1149/2251] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:21 2022] GET /compute/v2.1/servers/137421ba-6834-4e42-8221-9b5de84419cc => generated 1494 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:22.476461 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-535d03f2-57fc-4b2f-bc2c-d9200fbeb308 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:22.477584 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-535d03f2-57fc-4b2f-bc2c-d9200fbeb308 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] [instance: b1eb0bef-5aaf-46d6-8739-b12303df9842] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:22.490816 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-535d03f2-57fc-4b2f-bc2c-d9200fbeb308 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:22.491949 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-535d03f2-57fc-4b2f-bc2c-d9200fbeb308 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:22.493018 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-535d03f2-57fc-4b2f-bc2c-d9200fbeb308 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:22.493777 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-535d03f2-57fc-4b2f-bc2c-d9200fbeb308 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:22.499496 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-3e51260b-6a91-458e-b3e4-49a17298c28b tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c877fc1c5964326af5d86b3aa7bf64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ac3aebabe465c8903ac9b9d8f54ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:22.512259 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3e51260b-6a91-458e-b3e4-49a17298c28b tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] 10.222.0.46 "GET /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf" status: 200 len: 1352 microversion: 2.1 time: 0.530324 Jan 15 20:56:22.515862 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1103/2252] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:21 2022] GET /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf => generated 1352 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:56:22.522537 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c66c334e-b1d8-42d1-b895-d0258084b435 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:22.525688 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c66c334e-b1d8-42d1-b895-d0258084b435 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: 0874eafa-ffa2-4257-b6c5-66e4bef983db] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:22.540737 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c66c334e-b1d8-42d1-b895-d0258084b435 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:22.546147 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c66c334e-b1d8-42d1-b895-d0258084b435 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:22.550493 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c66c334e-b1d8-42d1-b895-d0258084b435 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:22.551080 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c66c334e-b1d8-42d1-b895-d0258084b435 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:22.576556 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-535d03f2-57fc-4b2f-bc2c-d9200fbeb308 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] 10.222.0.46 "POST /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842/action" status: 200 len: 32632 microversion: 2.1 time: 0.103233 Jan 15 20:56:22.577407 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1150/2253] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:56:22 2022] POST /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842/action => generated 32632 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:56:22.583320 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-13a10867-3f4d-4053-956a-091484e6a412 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:22.590500 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-13a10867-3f4d-4053-956a-091484e6a412 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] [instance: beffc13d-acd3-455e-96d6-be4bcbb81b88] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:22.602790 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-13a10867-3f4d-4053-956a-091484e6a412 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:22.603387 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-13a10867-3f4d-4053-956a-091484e6a412 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:22.608590 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-13a10867-3f4d-4053-956a-091484e6a412 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:22.609316 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-13a10867-3f4d-4053-956a-091484e6a412 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:22.728130 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-13a10867-3f4d-4053-956a-091484e6a412 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52bd234a49b24c1a8bb60ad42c0db262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb6e08a94bc415fada171a2eca3e7ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:22.747605 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-13a10867-3f4d-4053-956a-091484e6a412 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] 10.222.0.46 "GET /compute/v2.1/servers/beffc13d-acd3-455e-96d6-be4bcbb81b88" status: 200 len: 1275 microversion: 2.1 time: 0.168708 Jan 15 20:56:22.748388 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1151/2254] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:22 2022] GET /compute/v2.1/servers/beffc13d-acd3-455e-96d6-be4bcbb81b88 => generated 1275 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:22.758093 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e0715f7a-3adf-4a1c-b7fe-03d4004d7421 tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:22.759194 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e0715f7a-3adf-4a1c-b7fe-03d4004d7421 tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] [instance: 137421ba-6834-4e42-8221-9b5de84419cc] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:22.775127 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e0715f7a-3adf-4a1c-b7fe-03d4004d7421 tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:22.775903 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e0715f7a-3adf-4a1c-b7fe-03d4004d7421 tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:22.777548 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e0715f7a-3adf-4a1c-b7fe-03d4004d7421 tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:22.779297 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e0715f7a-3adf-4a1c-b7fe-03d4004d7421 tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:23.058784 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-c66c334e-b1d8-42d1-b895-d0258084b435 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:23.073538 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c66c334e-b1d8-42d1-b895-d0258084b435 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/0874eafa-ffa2-4257-b6c5-66e4bef983db" status: 200 len: 1314 microversion: 2.1 time: 0.559019 Jan 15 20:56:23.075020 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1104/2255] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:22 2022] GET /compute/v2.1/servers/0874eafa-ffa2-4257-b6c5-66e4bef983db => generated 1314 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:23.079468 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f2af59ce-0ca5-4cc9-85d6-5515b30baf8a tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:23.080259 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f2af59ce-0ca5-4cc9-85d6-5515b30baf8a tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] [instance: ffb8267e-acd5-4c23-807a-07e0b02204a0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:23.092254 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f2af59ce-0ca5-4cc9-85d6-5515b30baf8a tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:23.092892 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f2af59ce-0ca5-4cc9-85d6-5515b30baf8a tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:23.093803 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f2af59ce-0ca5-4cc9-85d6-5515b30baf8a tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:23.094498 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f2af59ce-0ca5-4cc9-85d6-5515b30baf8a tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:23.202001 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e0715f7a-3adf-4a1c-b7fe-03d4004d7421 tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/137421ba-6834-4e42-8221-9b5de84419cc" status: 200 len: 1645 microversion: 2.1 time: 0.452014 Jan 15 20:56:23.203239 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1152/2256] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:22 2022] GET /compute/v2.1/servers/137421ba-6834-4e42-8221-9b5de84419cc => generated 1645 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:23.221063 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f2d66f43-40f6-4fdd-a0a2-fd29c9830738 tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:23.226060 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f2d66f43-40f6-4fdd-a0a2-fd29c9830738 tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] [instance: 137421ba-6834-4e42-8221-9b5de84419cc] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:23.234448 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f2d66f43-40f6-4fdd-a0a2-fd29c9830738 tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:23.236380 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f2d66f43-40f6-4fdd-a0a2-fd29c9830738 tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:23.237673 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f2d66f43-40f6-4fdd-a0a2-fd29c9830738 tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:23.238404 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f2d66f43-40f6-4fdd-a0a2-fd29c9830738 tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:23.922177 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-f2af59ce-0ca5-4cc9-85d6-5515b30baf8a tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f5490d676542fcb18b0dd5f5074516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc238c23f15041c583fd50a124461b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:23.929517 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f2af59ce-0ca5-4cc9-85d6-5515b30baf8a tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] 10.222.0.46 "GET /compute/v2.1/servers/ffb8267e-acd5-4c23-807a-07e0b02204a0" status: 200 len: 1333 microversion: 2.1 time: 0.853291 Jan 15 20:56:23.939857 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1105/2257] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:23 2022] GET /compute/v2.1/servers/ffb8267e-acd5-4c23-807a-07e0b02204a0 => generated 1333 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:23.944950 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-930637d3-cd8b-45c4-a256-d1086b059821 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:23.945562 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-930637d3-cd8b-45c4-a256-d1086b059821 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] [instance: 70bf65cf-55e2-459a-aaf1-c3eb851a6ccf] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:23.958921 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-930637d3-cd8b-45c4-a256-d1086b059821 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:23.959772 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-930637d3-cd8b-45c4-a256-d1086b059821 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:23.961053 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-930637d3-cd8b-45c4-a256-d1086b059821 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:23.961738 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-930637d3-cd8b-45c4-a256-d1086b059821 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:24.187876 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f2d66f43-40f6-4fdd-a0a2-fd29c9830738 tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/137421ba-6834-4e42-8221-9b5de84419cc" status: 200 len: 1645 microversion: 2.1 time: 0.970749 Jan 15 20:56:24.200447 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1153/2258] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:23 2022] GET /compute/v2.1/servers/137421ba-6834-4e42-8221-9b5de84419cc => generated 1645 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:56:24.206023 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-609bd090-6725-4405-b5c0-c188271591b8 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:24.207723 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-609bd090-6725-4405-b5c0-c188271591b8 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] [instance: b1eb0bef-5aaf-46d6-8739-b12303df9842] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:24.215358 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-609bd090-6725-4405-b5c0-c188271591b8 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:24.216190 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-609bd090-6725-4405-b5c0-c188271591b8 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:24.217246 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-609bd090-6725-4405-b5c0-c188271591b8 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:24.217992 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-609bd090-6725-4405-b5c0-c188271591b8 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:24.275806 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-609bd090-6725-4405-b5c0-c188271591b8 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] 10.222.0.46 "POST /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842/action" status: 200 len: 32632 microversion: 2.1 time: 0.073142 Jan 15 20:56:24.277775 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1154/2259] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:56:24 2022] POST /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842/action => generated 32632 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:56:24.290079 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1a7a813c-6105-403e-8165-d41c03493305 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:24.291656 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-1a7a813c-6105-403e-8165-d41c03493305 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] [instance: beffc13d-acd3-455e-96d6-be4bcbb81b88] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:24.307208 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1a7a813c-6105-403e-8165-d41c03493305 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:24.307822 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1a7a813c-6105-403e-8165-d41c03493305 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:24.309851 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1a7a813c-6105-403e-8165-d41c03493305 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:24.310683 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1a7a813c-6105-403e-8165-d41c03493305 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:24.486640 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-930637d3-cd8b-45c4-a256-d1086b059821 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c877fc1c5964326af5d86b3aa7bf64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ac3aebabe465c8903ac9b9d8f54ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:24.498304 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-930637d3-cd8b-45c4-a256-d1086b059821 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] 10.222.0.46 "GET /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf" status: 200 len: 1352 microversion: 2.1 time: 0.556258 Jan 15 20:56:24.501885 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1106/2260] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:23 2022] GET /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf => generated 1352 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:24.516570 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-d791de93-2f6c-4944-a877-2607955c3115 req-2b887da5-2f78-4d11-b633-0b65eac7dc28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffb8267e-acd5-4c23-807a-07e0b02204a0", "tag": "ea9ece42-4caf-4596-9d6a-f5ebd3e979e9"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:24.527768 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:56:24.527768 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:56:24.537365 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-d791de93-2f6c-4944-a877-2607955c3115 req-2b887da5-2f78-4d11-b633-0b65eac7dc28 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:24.539663 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-d791de93-2f6c-4944-a877-2607955c3115 req-2b887da5-2f78-4d11-b633-0b65eac7dc28 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:24.562651 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-d791de93-2f6c-4944-a877-2607955c3115 req-2b887da5-2f78-4d11-b633-0b65eac7dc28 service nova] Creating event network-changed:ea9ece42-4caf-4596-9d6a-f5ebd3e979e9 for instance ffb8267e-acd5-4c23-807a-07e0b02204a0 on nch2-master-1 Jan 15 20:56:24.576125 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-d791de93-2f6c-4944-a877-2607955c3115 req-2b887da5-2f78-4d11-b633-0b65eac7dc28 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069362 Jan 15 20:56:24.578003 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1107/2261] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:56:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:56:24.589712 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-950a1d8e-225a-414d-a9cf-401519b6c251 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:24.590690 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-950a1d8e-225a-414d-a9cf-401519b6c251 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: 0874eafa-ffa2-4257-b6c5-66e4bef983db] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:24.598876 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-950a1d8e-225a-414d-a9cf-401519b6c251 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:24.599855 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-950a1d8e-225a-414d-a9cf-401519b6c251 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:24.601364 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-950a1d8e-225a-414d-a9cf-401519b6c251 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:24.601974 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-950a1d8e-225a-414d-a9cf-401519b6c251 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:24.890685 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-1a7a813c-6105-403e-8165-d41c03493305 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52bd234a49b24c1a8bb60ad42c0db262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb6e08a94bc415fada171a2eca3e7ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:24.903752 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-1a7a813c-6105-403e-8165-d41c03493305 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] 10.222.0.46 "GET /compute/v2.1/servers/beffc13d-acd3-455e-96d6-be4bcbb81b88" status: 200 len: 1317 microversion: 2.1 time: 0.621795 Jan 15 20:56:24.905073 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1155/2262] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:24 2022] GET /compute/v2.1/servers/beffc13d-acd3-455e-96d6-be4bcbb81b88 => generated 1317 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:24.916013 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0d6b13f0-4f38-4f82-a1a1-b49024cb0218 tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:24.920410 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:56:24.920410 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:56:24.922327 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0d6b13f0-4f38-4f82-a1a1-b49024cb0218 tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:24.927752 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0d6b13f0-4f38-4f82-a1a1-b49024cb0218 tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:24.929672 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0d6b13f0-4f38-4f82-a1a1-b49024cb0218 tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:24.930837 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0d6b13f0-4f38-4f82-a1a1-b49024cb0218 tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:24.947044 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-950a1d8e-225a-414d-a9cf-401519b6c251 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:24.966760 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-950a1d8e-225a-414d-a9cf-401519b6c251 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/0874eafa-ffa2-4257-b6c5-66e4bef983db" status: 200 len: 1314 microversion: 2.1 time: 0.377068 Jan 15 20:56:24.979817 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1108/2263] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:24 2022] GET /compute/v2.1/servers/0874eafa-ffa2-4257-b6c5-66e4bef983db => generated 1314 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:25.000213 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-326b8371-5268-4a18-a265-a29ed70f2fc7 req-4e5fa7f6-ed1b-46b6-9323-194b29a44e35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0874eafa-ffa2-4257-b6c5-66e4bef983db", "tag": "6b0f9bd5-35ce-4655-ab53-3207b68d566f"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:25.005744 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:56:25.005744 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:56:25.030814 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-326b8371-5268-4a18-a265-a29ed70f2fc7 req-4e5fa7f6-ed1b-46b6-9323-194b29a44e35 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:25.031702 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-326b8371-5268-4a18-a265-a29ed70f2fc7 req-4e5fa7f6-ed1b-46b6-9323-194b29a44e35 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:25.033128 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0d6b13f0-4f38-4f82-a1a1-b49024cb0218 tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] 10.222.0.46 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.124181 Jan 15 20:56:25.033873 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1156/2264] 10.222.0.46 () {58 vars in 1175 bytes} [Sat Jan 15 20:56:24 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:56:25.047694 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e59f0a33-9dd8-49d3-9695-f654ff80c2c8 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:25.048812 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e59f0a33-9dd8-49d3-9695-f654ff80c2c8 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] [instance: 62ae2a15-8c2c-4dad-971f-0611238103a3] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:25.067417 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e59f0a33-9dd8-49d3-9695-f654ff80c2c8 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:25.067985 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e59f0a33-9dd8-49d3-9695-f654ff80c2c8 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:25.071125 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e59f0a33-9dd8-49d3-9695-f654ff80c2c8 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:25.072683 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e59f0a33-9dd8-49d3-9695-f654ff80c2c8 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:25.082653 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-326b8371-5268-4a18-a265-a29ed70f2fc7 req-4e5fa7f6-ed1b-46b6-9323-194b29a44e35 service nova] Creating event network-changed:6b0f9bd5-35ce-4655-ab53-3207b68d566f for instance 0874eafa-ffa2-4257-b6c5-66e4bef983db on nch2-master-1 Jan 15 20:56:25.100121 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-326b8371-5268-4a18-a265-a29ed70f2fc7 req-4e5fa7f6-ed1b-46b6-9323-194b29a44e35 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118544 Jan 15 20:56:25.102831 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1109/2265] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:56:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:56:25.114619 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-41534bd0-351c-4f79-8ddc-96d2c59264b5 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:25.117666 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-41534bd0-351c-4f79-8ddc-96d2c59264b5 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] [instance: ffb8267e-acd5-4c23-807a-07e0b02204a0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:25.134094 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-41534bd0-351c-4f79-8ddc-96d2c59264b5 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:25.136089 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-41534bd0-351c-4f79-8ddc-96d2c59264b5 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:25.138067 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-41534bd0-351c-4f79-8ddc-96d2c59264b5 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:25.138702 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-41534bd0-351c-4f79-8ddc-96d2c59264b5 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:25.168428 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e59f0a33-9dd8-49d3-9695-f654ff80c2c8 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] 10.222.0.46 "POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action" status: 200 len: 14 microversion: 2.1 time: 0.128964 Jan 15 20:56:25.170052 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1157/2266] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:56:25 2022] POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action => generated 14 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 20:56:25.189591 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a056c49f-9f2a-4027-846c-88f92ea29d9b tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:25.191064 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a056c49f-9f2a-4027-846c-88f92ea29d9b tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] [instance: 137421ba-6834-4e42-8221-9b5de84419cc] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:25.216924 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a056c49f-9f2a-4027-846c-88f92ea29d9b tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:25.219856 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a056c49f-9f2a-4027-846c-88f92ea29d9b tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:25.221918 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a056c49f-9f2a-4027-846c-88f92ea29d9b tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:25.224655 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a056c49f-9f2a-4027-846c-88f92ea29d9b tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:25.458606 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a056c49f-9f2a-4027-846c-88f92ea29d9b tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] 10.222.0.46 "POST /compute/v2.1/servers/137421ba-6834-4e42-8221-9b5de84419cc/action" status: 202 len: 0 microversion: 2.1 time: 0.285175 Jan 15 20:56:25.462429 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1158/2267] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:56:25 2022] POST /compute/v2.1/servers/137421ba-6834-4e42-8221-9b5de84419cc/action => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 20:56:25.478315 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-2a34121a-4fa2-4983-a170-45664aa4206e tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:25.480182 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-2a34121a-4fa2-4983-a170-45664aa4206e tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] [instance: b1eb0bef-5aaf-46d6-8739-b12303df9842] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:25.497704 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2a34121a-4fa2-4983-a170-45664aa4206e tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:25.499326 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2a34121a-4fa2-4983-a170-45664aa4206e tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:25.501720 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2a34121a-4fa2-4983-a170-45664aa4206e tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:25.504159 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2a34121a-4fa2-4983-a170-45664aa4206e tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:25.590920 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-2a34121a-4fa2-4983-a170-45664aa4206e tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] 10.222.0.46 "POST /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842/action" status: 200 len: 32632 microversion: 2.1 time: 0.126625 Jan 15 20:56:25.593202 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1159/2268] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:56:25 2022] POST /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842/action => generated 32632 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:56:25.603853 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-10ba6665-3edb-48f1-b23a-cc45e4153d8c tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:25.608179 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-10ba6665-3edb-48f1-b23a-cc45e4153d8c tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] [instance: 137421ba-6834-4e42-8221-9b5de84419cc] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:25.626843 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-10ba6665-3edb-48f1-b23a-cc45e4153d8c tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:25.629346 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-10ba6665-3edb-48f1-b23a-cc45e4153d8c tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:25.630372 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-10ba6665-3edb-48f1-b23a-cc45e4153d8c tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:25.632987 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-10ba6665-3edb-48f1-b23a-cc45e4153d8c tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:25.796983 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-41534bd0-351c-4f79-8ddc-96d2c59264b5 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f5490d676542fcb18b0dd5f5074516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc238c23f15041c583fd50a124461b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:25.809128 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-41534bd0-351c-4f79-8ddc-96d2c59264b5 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] 10.222.0.46 "GET /compute/v2.1/servers/ffb8267e-acd5-4c23-807a-07e0b02204a0" status: 200 len: 1333 microversion: 2.1 time: 0.703394 Jan 15 20:56:25.814685 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1110/2269] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:25 2022] GET /compute/v2.1/servers/ffb8267e-acd5-4c23-807a-07e0b02204a0 => generated 1333 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:25.826716 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8d116ed8-0175-4b90-9199-274d15e26614 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:25.827582 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-8d116ed8-0175-4b90-9199-274d15e26614 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] [instance: 70bf65cf-55e2-459a-aaf1-c3eb851a6ccf] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:25.848017 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8d116ed8-0175-4b90-9199-274d15e26614 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:25.850798 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8d116ed8-0175-4b90-9199-274d15e26614 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:25.855396 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8d116ed8-0175-4b90-9199-274d15e26614 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:25.857661 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8d116ed8-0175-4b90-9199-274d15e26614 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:26.215794 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-10ba6665-3edb-48f1-b23a-cc45e4153d8c tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/137421ba-6834-4e42-8221-9b5de84419cc" status: 200 len: 1650 microversion: 2.1 time: 0.621110 Jan 15 20:56:26.221689 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1160/2270] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:25 2022] GET /compute/v2.1/servers/137421ba-6834-4e42-8221-9b5de84419cc => generated 1650 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:26.227327 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-37bdf64b-4c9d-45bc-93e6-bfdbba1d2c13 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:26.234894 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-37bdf64b-4c9d-45bc-93e6-bfdbba1d2c13 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] [instance: beffc13d-acd3-455e-96d6-be4bcbb81b88] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:26.251864 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-37bdf64b-4c9d-45bc-93e6-bfdbba1d2c13 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:26.252763 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-37bdf64b-4c9d-45bc-93e6-bfdbba1d2c13 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:26.253748 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-37bdf64b-4c9d-45bc-93e6-bfdbba1d2c13 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:26.254923 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-37bdf64b-4c9d-45bc-93e6-bfdbba1d2c13 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:26.594661 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-8d116ed8-0175-4b90-9199-274d15e26614 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c877fc1c5964326af5d86b3aa7bf64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ac3aebabe465c8903ac9b9d8f54ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:26.605900 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-8d116ed8-0175-4b90-9199-274d15e26614 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] 10.222.0.46 "GET /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf" status: 200 len: 1352 microversion: 2.1 time: 0.789894 Jan 15 20:56:26.617939 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1111/2271] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:25 2022] GET /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf => generated 1352 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:26.630351 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-6a43ac30-06db-466d-94a0-0799d90a13de tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:26.631658 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-6a43ac30-06db-466d-94a0-0799d90a13de tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: 0874eafa-ffa2-4257-b6c5-66e4bef983db] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:26.639850 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6a43ac30-06db-466d-94a0-0799d90a13de tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:26.640702 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6a43ac30-06db-466d-94a0-0799d90a13de tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:26.643999 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6a43ac30-06db-466d-94a0-0799d90a13de tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:26.644874 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6a43ac30-06db-466d-94a0-0799d90a13de tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:26.958815 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-37bdf64b-4c9d-45bc-93e6-bfdbba1d2c13 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52bd234a49b24c1a8bb60ad42c0db262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb6e08a94bc415fada171a2eca3e7ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:26.967779 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-37bdf64b-4c9d-45bc-93e6-bfdbba1d2c13 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] 10.222.0.46 "GET /compute/v2.1/servers/beffc13d-acd3-455e-96d6-be4bcbb81b88" status: 200 len: 1317 microversion: 2.1 time: 0.743924 Jan 15 20:56:26.968384 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1161/2272] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:26 2022] GET /compute/v2.1/servers/beffc13d-acd3-455e-96d6-be4bcbb81b88 => generated 1317 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:26.972819 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c3323aa0-98b3-477a-891c-b5b469a0ac76 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:26.973744 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c3323aa0-98b3-477a-891c-b5b469a0ac76 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] [instance: 62ae2a15-8c2c-4dad-971f-0611238103a3] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:26.997507 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c3323aa0-98b3-477a-891c-b5b469a0ac76 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:26.998255 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c3323aa0-98b3-477a-891c-b5b469a0ac76 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:26.999311 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c3323aa0-98b3-477a-891c-b5b469a0ac76 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:27.006877 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c3323aa0-98b3-477a-891c-b5b469a0ac76 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:27.076911 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c3323aa0-98b3-477a-891c-b5b469a0ac76 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] 10.222.0.46 "POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action" status: 200 len: 14 microversion: 2.1 time: 0.107164 Jan 15 20:56:27.078157 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1162/2273] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:56:26 2022] POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action => generated 14 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 20:56:27.087270 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-3f55f345-1cc8-4cd0-a510-7ca4a86d5b02 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:27.087270 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-3f55f345-1cc8-4cd0-a510-7ca4a86d5b02 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] [instance: b1eb0bef-5aaf-46d6-8739-b12303df9842] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:27.095143 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3f55f345-1cc8-4cd0-a510-7ca4a86d5b02 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:27.095715 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3f55f345-1cc8-4cd0-a510-7ca4a86d5b02 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:27.096646 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3f55f345-1cc8-4cd0-a510-7ca4a86d5b02 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:27.101611 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3f55f345-1cc8-4cd0-a510-7ca4a86d5b02 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:27.176520 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-3f55f345-1cc8-4cd0-a510-7ca4a86d5b02 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] 10.222.0.46 "POST /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842/action" status: 200 len: 32632 microversion: 2.1 time: 0.096020 Jan 15 20:56:27.182695 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1163/2274] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:56:27 2022] POST /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842/action => generated 32632 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:56:27.191533 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-29ad72d0-40c7-4f7a-bc33-f72277d51161 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:27.193289 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-29ad72d0-40c7-4f7a-bc33-f72277d51161 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] [instance: ffb8267e-acd5-4c23-807a-07e0b02204a0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:27.202631 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-29ad72d0-40c7-4f7a-bc33-f72277d51161 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:27.203492 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-29ad72d0-40c7-4f7a-bc33-f72277d51161 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:27.204877 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-29ad72d0-40c7-4f7a-bc33-f72277d51161 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:27.205618 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-29ad72d0-40c7-4f7a-bc33-f72277d51161 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:27.357121 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-6a43ac30-06db-466d-94a0-0799d90a13de tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:27.368636 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-6a43ac30-06db-466d-94a0-0799d90a13de tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/0874eafa-ffa2-4257-b6c5-66e4bef983db" status: 200 len: 1314 microversion: 2.1 time: 0.749465 Jan 15 20:56:27.379808 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1112/2275] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:26 2022] GET /compute/v2.1/servers/0874eafa-ffa2-4257-b6c5-66e4bef983db => generated 1314 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:27.384678 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-1652703f-bcce-49fd-9162-fb93af73b0e7 req-5362ec9a-da73-4d39-8e9c-b890aecaec06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62ae2a15-8c2c-4dad-971f-0611238103a3", "tag": "77153925-7185-4583-89dc-fdd59e40d230"}, {"name": "network-changed", "server_uuid": "bffd829f-bc6e-40a7-a9d8-59af77e5b10d", "tag": "8b8cea34-6f8d-4a83-aaae-cfea3dbff75c"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:27.388279 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:56:27.388279 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:56:27.409316 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-1652703f-bcce-49fd-9162-fb93af73b0e7 req-5362ec9a-da73-4d39-8e9c-b890aecaec06 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:27.413592 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-1652703f-bcce-49fd-9162-fb93af73b0e7 req-5362ec9a-da73-4d39-8e9c-b890aecaec06 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:27.431507 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-1652703f-bcce-49fd-9162-fb93af73b0e7 req-5362ec9a-da73-4d39-8e9c-b890aecaec06 service nova] Creating event network-changed:77153925-7185-4583-89dc-fdd59e40d230 for instance 62ae2a15-8c2c-4dad-971f-0611238103a3 on nch2-master-1 Jan 15 20:56:27.432321 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-1652703f-bcce-49fd-9162-fb93af73b0e7 req-5362ec9a-da73-4d39-8e9c-b890aecaec06 service nova] Creating event network-changed:8b8cea34-6f8d-4a83-aaae-cfea3dbff75c for instance bffd829f-bc6e-40a7-a9d8-59af77e5b10d on nch2-master-1 Jan 15 20:56:27.442969 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-1652703f-bcce-49fd-9162-fb93af73b0e7 req-5362ec9a-da73-4d39-8e9c-b890aecaec06 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.061696 Jan 15 20:56:27.443941 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1113/2276] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:56:27 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:56:27.452549 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-667b4c5f-7cea-4dfe-b9f9-adc7e0121e4e tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:27.453655 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-667b4c5f-7cea-4dfe-b9f9-adc7e0121e4e tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] [instance: 137421ba-6834-4e42-8221-9b5de84419cc] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:27.460444 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-667b4c5f-7cea-4dfe-b9f9-adc7e0121e4e tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:27.461269 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-667b4c5f-7cea-4dfe-b9f9-adc7e0121e4e tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:27.462302 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-667b4c5f-7cea-4dfe-b9f9-adc7e0121e4e tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:27.463025 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-667b4c5f-7cea-4dfe-b9f9-adc7e0121e4e tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:27.710307 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-29ad72d0-40c7-4f7a-bc33-f72277d51161 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f5490d676542fcb18b0dd5f5074516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc238c23f15041c583fd50a124461b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:27.721332 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-29ad72d0-40c7-4f7a-bc33-f72277d51161 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] 10.222.0.46 "GET /compute/v2.1/servers/ffb8267e-acd5-4c23-807a-07e0b02204a0" status: 200 len: 1333 microversion: 2.1 time: 0.536243 Jan 15 20:56:27.722444 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1164/2277] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:27 2022] GET /compute/v2.1/servers/ffb8267e-acd5-4c23-807a-07e0b02204a0 => generated 1333 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:27.728530 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c034dfd1-2257-44cf-84be-67264caae461 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:27.729417 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c034dfd1-2257-44cf-84be-67264caae461 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] [instance: 70bf65cf-55e2-459a-aaf1-c3eb851a6ccf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:27.740974 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c034dfd1-2257-44cf-84be-67264caae461 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:27.741842 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c034dfd1-2257-44cf-84be-67264caae461 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:27.742982 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c034dfd1-2257-44cf-84be-67264caae461 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:27.744037 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c034dfd1-2257-44cf-84be-67264caae461 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:27.908201 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-667b4c5f-7cea-4dfe-b9f9-adc7e0121e4e tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/137421ba-6834-4e42-8221-9b5de84419cc" status: 200 len: 1630 microversion: 2.1 time: 0.462464 Jan 15 20:56:27.924110 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1114/2278] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:27 2022] GET /compute/v2.1/servers/137421ba-6834-4e42-8221-9b5de84419cc => generated 1630 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:27.929480 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-650dc931-0740-4842-ab2c-652d74d5af84 tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:27.930873 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-650dc931-0740-4842-ab2c-652d74d5af84 tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] [instance: 137421ba-6834-4e42-8221-9b5de84419cc] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:27.939457 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-650dc931-0740-4842-ab2c-652d74d5af84 tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:27.940395 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-650dc931-0740-4842-ab2c-652d74d5af84 tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:27.941600 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-650dc931-0740-4842-ab2c-652d74d5af84 tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:27.942211 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-650dc931-0740-4842-ab2c-652d74d5af84 tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:27.988636 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.objects.instance [None req-650dc931-0740-4842-ab2c-652d74d5af84 tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Lazy-loading 'flavor' on Instance uuid 137421ba-6834-4e42-8221-9b5de84419cc {{(pid=129365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 20:56:27.997025 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-c034dfd1-2257-44cf-84be-67264caae461 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c877fc1c5964326af5d86b3aa7bf64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ac3aebabe465c8903ac9b9d8f54ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:28.003460 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-650dc931-0740-4842-ab2c-652d74d5af84 tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] [instance: 137421ba-6834-4e42-8221-9b5de84419cc] Going to try to live migrate instance to nch2-master-1 {{(pid=129365) live_migrate /opt/stack/nova/nova/compute/api.py:5255}} Jan 15 20:56:28.007357 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c034dfd1-2257-44cf-84be-67264caae461 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] 10.222.0.46 "GET /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf" status: 200 len: 1352 microversion: 2.1 time: 0.282982 Jan 15 20:56:28.008806 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1165/2279] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:27 2022] GET /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf => generated 1352 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:28.018145 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-378fe7e4-a8e5-41d4-8de5-b49a120e4cee tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:28.018976 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-378fe7e4-a8e5-41d4-8de5-b49a120e4cee tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] [instance: beffc13d-acd3-455e-96d6-be4bcbb81b88] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:28.029264 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-378fe7e4-a8e5-41d4-8de5-b49a120e4cee tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:28.029903 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-378fe7e4-a8e5-41d4-8de5-b49a120e4cee tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:28.031060 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-378fe7e4-a8e5-41d4-8de5-b49a120e4cee tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:28.031674 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-378fe7e4-a8e5-41d4-8de5-b49a120e4cee tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:28.230827 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-378fe7e4-a8e5-41d4-8de5-b49a120e4cee tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52bd234a49b24c1a8bb60ad42c0db262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb6e08a94bc415fada171a2eca3e7ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:28.240299 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-378fe7e4-a8e5-41d4-8de5-b49a120e4cee tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] 10.222.0.46 "GET /compute/v2.1/servers/beffc13d-acd3-455e-96d6-be4bcbb81b88" status: 200 len: 1317 microversion: 2.1 time: 0.230213 Jan 15 20:56:28.241552 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1166/2280] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:28 2022] GET /compute/v2.1/servers/beffc13d-acd3-455e-96d6-be4bcbb81b88 => generated 1317 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:28.254748 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-94e7c29d-648e-4fdd-b738-e69ff8753691 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:28.256072 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-94e7c29d-648e-4fdd-b738-e69ff8753691 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] [instance: 62ae2a15-8c2c-4dad-971f-0611238103a3] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:28.264538 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-94e7c29d-648e-4fdd-b738-e69ff8753691 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:28.265332 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-94e7c29d-648e-4fdd-b738-e69ff8753691 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:28.266319 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-94e7c29d-648e-4fdd-b738-e69ff8753691 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:28.267069 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-94e7c29d-648e-4fdd-b738-e69ff8753691 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:28.320373 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-94e7c29d-648e-4fdd-b738-e69ff8753691 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] 10.222.0.46 "POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action" status: 200 len: 14 microversion: 2.1 time: 0.075328 Jan 15 20:56:28.329437 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1167/2281] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:56:28 2022] POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action => generated 14 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 20:56:28.335865 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-841dbd34-cf13-435c-b46c-6929a077e899 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:28.337620 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-841dbd34-cf13-435c-b46c-6929a077e899 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] [instance: b1eb0bef-5aaf-46d6-8739-b12303df9842] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:28.352017 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-841dbd34-cf13-435c-b46c-6929a077e899 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:28.357091 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-841dbd34-cf13-435c-b46c-6929a077e899 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:28.358355 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-841dbd34-cf13-435c-b46c-6929a077e899 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:28.359362 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-841dbd34-cf13-435c-b46c-6929a077e899 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:28.430816 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-841dbd34-cf13-435c-b46c-6929a077e899 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] 10.222.0.46 "POST /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842/action" status: 200 len: 32632 microversion: 2.1 time: 0.099057 Jan 15 20:56:28.435626 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1168/2282] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:56:28 2022] POST /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842/action => generated 32632 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:56:28.445131 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7a912253-5d22-41ff-a62a-963be52cd659 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:28.448349 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-7a912253-5d22-41ff-a62a-963be52cd659 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: 0874eafa-ffa2-4257-b6c5-66e4bef983db] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:28.457865 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7a912253-5d22-41ff-a62a-963be52cd659 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:28.458655 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7a912253-5d22-41ff-a62a-963be52cd659 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:28.473419 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7a912253-5d22-41ff-a62a-963be52cd659 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:28.473869 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7a912253-5d22-41ff-a62a-963be52cd659 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:28.829306 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-7a912253-5d22-41ff-a62a-963be52cd659 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:28.842803 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7a912253-5d22-41ff-a62a-963be52cd659 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/0874eafa-ffa2-4257-b6c5-66e4bef983db" status: 200 len: 1314 microversion: 2.1 time: 0.405393 Jan 15 20:56:28.843413 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1169/2283] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:28 2022] GET /compute/v2.1/servers/0874eafa-ffa2-4257-b6c5-66e4bef983db => generated 1314 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:28.851668 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-053a7d52-86a1-43b3-90c8-7132aee0ad7d tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:28.852668 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-053a7d52-86a1-43b3-90c8-7132aee0ad7d tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] [instance: ffb8267e-acd5-4c23-807a-07e0b02204a0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:28.869494 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-053a7d52-86a1-43b3-90c8-7132aee0ad7d tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:28.870339 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-053a7d52-86a1-43b3-90c8-7132aee0ad7d tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:28.872748 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-053a7d52-86a1-43b3-90c8-7132aee0ad7d tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:28.874260 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-053a7d52-86a1-43b3-90c8-7132aee0ad7d tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:29.166606 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-053a7d52-86a1-43b3-90c8-7132aee0ad7d tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f5490d676542fcb18b0dd5f5074516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc238c23f15041c583fd50a124461b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:29.175231 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-053a7d52-86a1-43b3-90c8-7132aee0ad7d tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] 10.222.0.46 "GET /compute/v2.1/servers/ffb8267e-acd5-4c23-807a-07e0b02204a0" status: 200 len: 1333 microversion: 2.1 time: 0.330623 Jan 15 20:56:29.177307 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1170/2284] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:28 2022] GET /compute/v2.1/servers/ffb8267e-acd5-4c23-807a-07e0b02204a0 => generated 1333 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:29.189072 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9c14fc7c-f2b1-4742-b300-d70efc37a566 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:29.189788 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-9c14fc7c-f2b1-4742-b300-d70efc37a566 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] [instance: 70bf65cf-55e2-459a-aaf1-c3eb851a6ccf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:29.197064 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9c14fc7c-f2b1-4742-b300-d70efc37a566 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:29.198461 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9c14fc7c-f2b1-4742-b300-d70efc37a566 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:29.200271 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9c14fc7c-f2b1-4742-b300-d70efc37a566 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:29.200404 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9c14fc7c-f2b1-4742-b300-d70efc37a566 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:29.457637 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-9c14fc7c-f2b1-4742-b300-d70efc37a566 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c877fc1c5964326af5d86b3aa7bf64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ac3aebabe465c8903ac9b9d8f54ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:29.468446 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-9c14fc7c-f2b1-4742-b300-d70efc37a566 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] 10.222.0.46 "GET /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf" status: 200 len: 1352 microversion: 2.1 time: 0.288370 Jan 15 20:56:29.469074 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1171/2285] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:29 2022] GET /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf => generated 1352 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:29.474235 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-3650e623-540f-4157-8eaa-e9d9b3f208a2 req-f8596531-6934-46ee-b818-8ba24377f2ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70bf65cf-55e2-459a-aaf1-c3eb851a6ccf", "name": "network-vif-plugged", "status": "completed", "tag": "a6cb493c-7db8-4ea6-9c25-c683e688717c"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:29.475843 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:56:29.475843 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:56:29.483255 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-3650e623-540f-4157-8eaa-e9d9b3f208a2 req-f8596531-6934-46ee-b818-8ba24377f2ea service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:29.483732 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-3650e623-540f-4157-8eaa-e9d9b3f208a2 req-f8596531-6934-46ee-b818-8ba24377f2ea service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:29.496591 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-3650e623-540f-4157-8eaa-e9d9b3f208a2 req-f8596531-6934-46ee-b818-8ba24377f2ea service nova] Creating event network-vif-plugged:a6cb493c-7db8-4ea6-9c25-c683e688717c for instance 70bf65cf-55e2-459a-aaf1-c3eb851a6ccf on nch1-master-1 Jan 15 20:56:29.502554 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-3650e623-540f-4157-8eaa-e9d9b3f208a2 req-f8596531-6934-46ee-b818-8ba24377f2ea service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032293 Jan 15 20:56:29.503403 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1172/2286] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:56:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:56:29.508791 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d6ac10ee-c269-4c02-b66a-31aeda4131a3 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:29.510078 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-d6ac10ee-c269-4c02-b66a-31aeda4131a3 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] [instance: beffc13d-acd3-455e-96d6-be4bcbb81b88] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:29.518327 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d6ac10ee-c269-4c02-b66a-31aeda4131a3 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:29.519116 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d6ac10ee-c269-4c02-b66a-31aeda4131a3 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:29.520115 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d6ac10ee-c269-4c02-b66a-31aeda4131a3 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:29.520746 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d6ac10ee-c269-4c02-b66a-31aeda4131a3 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:29.722700 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-d6ac10ee-c269-4c02-b66a-31aeda4131a3 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52bd234a49b24c1a8bb60ad42c0db262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb6e08a94bc415fada171a2eca3e7ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:29.730994 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d6ac10ee-c269-4c02-b66a-31aeda4131a3 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] 10.222.0.46 "GET /compute/v2.1/servers/beffc13d-acd3-455e-96d6-be4bcbb81b88" status: 200 len: 1317 microversion: 2.1 time: 0.225524 Jan 15 20:56:29.731732 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1173/2287] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:29 2022] GET /compute/v2.1/servers/beffc13d-acd3-455e-96d6-be4bcbb81b88 => generated 1317 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:29.736382 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-27886609-9b33-4445-b961-ccd5a9d92da7 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:29.737647 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-27886609-9b33-4445-b961-ccd5a9d92da7 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] [instance: 62ae2a15-8c2c-4dad-971f-0611238103a3] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:29.745284 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-27886609-9b33-4445-b961-ccd5a9d92da7 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:29.746827 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-27886609-9b33-4445-b961-ccd5a9d92da7 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:29.747711 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-27886609-9b33-4445-b961-ccd5a9d92da7 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:29.748240 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-27886609-9b33-4445-b961-ccd5a9d92da7 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:29.787117 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-27886609-9b33-4445-b961-ccd5a9d92da7 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] 10.222.0.46 "POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action" status: 200 len: 14 microversion: 2.1 time: 0.053879 Jan 15 20:56:29.787771 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1174/2288] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:56:29 2022] POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action => generated 14 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 20:56:29.794197 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-842117f4-bcbd-4d80-ba91-2084d420d218 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:29.795195 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-842117f4-bcbd-4d80-ba91-2084d420d218 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] [instance: b1eb0bef-5aaf-46d6-8739-b12303df9842] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:29.802234 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-842117f4-bcbd-4d80-ba91-2084d420d218 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:29.802820 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-842117f4-bcbd-4d80-ba91-2084d420d218 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:29.803649 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-842117f4-bcbd-4d80-ba91-2084d420d218 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:29.804087 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-842117f4-bcbd-4d80-ba91-2084d420d218 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:29.845652 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-842117f4-bcbd-4d80-ba91-2084d420d218 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] 10.222.0.46 "POST /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842/action" status: 200 len: 32632 microversion: 2.1 time: 0.056242 Jan 15 20:56:29.846317 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1175/2289] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:56:29 2022] POST /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842/action => generated 32632 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:56:29.902915 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7646ed1c-d9ef-4a77-8e96-db5957084099 tempest-SecurityGroupRulesTestJSON-83524440 tempest-SecurityGroupRulesTestJSON-83524440-project] Action: 'create', calling method: .version_select at 0x7f30cec2e670>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1793798824", "description": "tempest-description-1428153061"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:30.064537 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7646ed1c-d9ef-4a77-8e96-db5957084099 tempest-SecurityGroupRulesTestJSON-83524440 tempest-SecurityGroupRulesTestJSON-83524440-project] 10.222.0.46 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.217000 Jan 15 20:56:30.065486 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1176/2290] 10.222.0.46 () {60 vars in 1179 bytes} [Sat Jan 15 20:56:29 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:56:30.072215 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-2e6c60cf-beb5-4130-b80f-f7eb9e33ac44 req-b956db53-c759-44e6-beb6-d3a5b5a921fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "beffc13d-acd3-455e-96d6-be4bcbb81b88", "tag": "3de9d3d2-9291-4173-8d0b-3d31a05f6fe6"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:30.073487 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:56:30.073487 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:56:30.083987 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-2e6c60cf-beb5-4130-b80f-f7eb9e33ac44 req-b956db53-c759-44e6-beb6-d3a5b5a921fa service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:30.090330 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-2e6c60cf-beb5-4130-b80f-f7eb9e33ac44 req-b956db53-c759-44e6-beb6-d3a5b5a921fa service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:30.102517 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-2e6c60cf-beb5-4130-b80f-f7eb9e33ac44 req-b956db53-c759-44e6-beb6-d3a5b5a921fa service nova] Creating event network-changed:3de9d3d2-9291-4173-8d0b-3d31a05f6fe6 for instance beffc13d-acd3-455e-96d6-be4bcbb81b88 on nch1-master-1 Jan 15 20:56:30.108514 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-2e6c60cf-beb5-4130-b80f-f7eb9e33ac44 req-b956db53-c759-44e6-beb6-d3a5b5a921fa service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040255 Jan 15 20:56:30.109982 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1177/2291] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:56:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:56:30.114246 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9ea4e2c5-99f4-43e9-a899-b8879bd5382c tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:30.114950 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-9ea4e2c5-99f4-43e9-a899-b8879bd5382c tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: 0874eafa-ffa2-4257-b6c5-66e4bef983db] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:30.130405 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9ea4e2c5-99f4-43e9-a899-b8879bd5382c tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:30.130970 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9ea4e2c5-99f4-43e9-a899-b8879bd5382c tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:30.131785 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9ea4e2c5-99f4-43e9-a899-b8879bd5382c tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:30.132220 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9ea4e2c5-99f4-43e9-a899-b8879bd5382c tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:30.272730 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-9ea4e2c5-99f4-43e9-a899-b8879bd5382c tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:30.281181 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-9ea4e2c5-99f4-43e9-a899-b8879bd5382c tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/0874eafa-ffa2-4257-b6c5-66e4bef983db" status: 200 len: 1314 microversion: 2.1 time: 0.170767 Jan 15 20:56:30.281761 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1178/2292] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:30 2022] GET /compute/v2.1/servers/0874eafa-ffa2-4257-b6c5-66e4bef983db => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:30.286141 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-323c29db-9b0f-4ebb-88ec-bd1767e50400 tempest-SecurityGroupRulesTestJSON-83524440 tempest-SecurityGroupRulesTestJSON-83524440-project] Action: 'create', calling method: .version_select at 0x7f30cebd13a0>, body: {"security_group_rule": {"parent_group_id": "03685487-9294-4081-b017-d58b04305ea5", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:30.467478 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-323c29db-9b0f-4ebb-88ec-bd1767e50400 tempest-SecurityGroupRulesTestJSON-83524440 tempest-SecurityGroupRulesTestJSON-83524440-project] 10.222.0.46 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.184604 Jan 15 20:56:30.468119 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1179/2293] 10.222.0.46 () {60 vars in 1194 bytes} [Sat Jan 15 20:56:30 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:56:30.472410 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-29012835-bbd5-4aae-9a32-416ef4d7d5af tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:30.476876 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-29012835-bbd5-4aae-9a32-416ef4d7d5af tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] [instance: ffb8267e-acd5-4c23-807a-07e0b02204a0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:30.483930 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-29012835-bbd5-4aae-9a32-416ef4d7d5af tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:30.484384 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-29012835-bbd5-4aae-9a32-416ef4d7d5af tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:30.485234 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-29012835-bbd5-4aae-9a32-416ef4d7d5af tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:30.485848 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-29012835-bbd5-4aae-9a32-416ef4d7d5af tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:30.637320 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-29012835-bbd5-4aae-9a32-416ef4d7d5af tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f5490d676542fcb18b0dd5f5074516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc238c23f15041c583fd50a124461b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:30.644832 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-29012835-bbd5-4aae-9a32-416ef4d7d5af tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] 10.222.0.46 "GET /compute/v2.1/servers/ffb8267e-acd5-4c23-807a-07e0b02204a0" status: 200 len: 1333 microversion: 2.1 time: 0.175721 Jan 15 20:56:30.645435 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1180/2294] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:30 2022] GET /compute/v2.1/servers/ffb8267e-acd5-4c23-807a-07e0b02204a0 => generated 1333 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:30.649807 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-783ff5cd-ee22-47b7-abda-17a6b502d62b tempest-SecurityGroupRulesTestJSON-83524440 tempest-SecurityGroupRulesTestJSON-83524440-project] Action: 'create', calling method: .version_select at 0x7f30cebd1e50>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1530400554", "description": "tempest-description-1659722808"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:30.755544 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-650dc931-0740-4842-ab2c-652d74d5af84 tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] 10.222.0.46 "POST /compute/v2.1/servers/137421ba-6834-4e42-8221-9b5de84419cc/action" status: 202 len: 0 microversion: 2.1 time: 2.829990 Jan 15 20:56:30.757561 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1115/2295] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:56:27 2022] POST /compute/v2.1/servers/137421ba-6834-4e42-8221-9b5de84419cc/action => generated 0 bytes in 2833 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 15 20:56:30.770563 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d9b2d20e-f0f0-48e7-9293-53a64a3fe6d5 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:30.771856 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d9b2d20e-f0f0-48e7-9293-53a64a3fe6d5 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] [instance: 70bf65cf-55e2-459a-aaf1-c3eb851a6ccf] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:30.781511 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d9b2d20e-f0f0-48e7-9293-53a64a3fe6d5 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:30.782300 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d9b2d20e-f0f0-48e7-9293-53a64a3fe6d5 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:30.783379 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d9b2d20e-f0f0-48e7-9293-53a64a3fe6d5 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:30.784021 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d9b2d20e-f0f0-48e7-9293-53a64a3fe6d5 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:30.807215 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-783ff5cd-ee22-47b7-abda-17a6b502d62b tempest-SecurityGroupRulesTestJSON-83524440 tempest-SecurityGroupRulesTestJSON-83524440-project] 10.222.0.46 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.160739 Jan 15 20:56:30.808945 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1181/2296] 10.222.0.46 () {60 vars in 1179 bytes} [Sat Jan 15 20:56:30 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:56:30.813510 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f008c1e9-9598-4c9c-9f76-f7c2a30d20b5 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:30.814344 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f008c1e9-9598-4c9c-9f76-f7c2a30d20b5 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] [instance: beffc13d-acd3-455e-96d6-be4bcbb81b88] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:30.825279 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f008c1e9-9598-4c9c-9f76-f7c2a30d20b5 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:30.825790 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f008c1e9-9598-4c9c-9f76-f7c2a30d20b5 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:30.826591 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f008c1e9-9598-4c9c-9f76-f7c2a30d20b5 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:30.827075 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f008c1e9-9598-4c9c-9f76-f7c2a30d20b5 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:31.013984 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-d9b2d20e-f0f0-48e7-9293-53a64a3fe6d5 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c877fc1c5964326af5d86b3aa7bf64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ac3aebabe465c8903ac9b9d8f54ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:31.027933 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d9b2d20e-f0f0-48e7-9293-53a64a3fe6d5 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] 10.222.0.46 "GET /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf" status: 200 len: 1352 microversion: 2.1 time: 0.268005 Jan 15 20:56:31.039979 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1116/2297] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:30 2022] GET /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf => generated 1352 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:31.045810 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-0ed9130b-2bc3-4468-bbea-031612e65aea tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:31.046655 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-0ed9130b-2bc3-4468-bbea-031612e65aea tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] [instance: 137421ba-6834-4e42-8221-9b5de84419cc] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:31.047993 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-f008c1e9-9598-4c9c-9f76-f7c2a30d20b5 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52bd234a49b24c1a8bb60ad42c0db262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb6e08a94bc415fada171a2eca3e7ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:31.055395 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0ed9130b-2bc3-4468-bbea-031612e65aea tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:31.055925 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f008c1e9-9598-4c9c-9f76-f7c2a30d20b5 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] 10.222.0.46 "GET /compute/v2.1/servers/beffc13d-acd3-455e-96d6-be4bcbb81b88" status: 200 len: 1317 microversion: 2.1 time: 0.245409 Jan 15 20:56:31.056200 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1182/2298] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:30 2022] GET /compute/v2.1/servers/beffc13d-acd3-455e-96d6-be4bcbb81b88 => generated 1317 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:31.067137 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0ed9130b-2bc3-4468-bbea-031612e65aea tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:31.068806 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0ed9130b-2bc3-4468-bbea-031612e65aea tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:31.069511 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0ed9130b-2bc3-4468-bbea-031612e65aea tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:31.071224 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-25fd7749-c884-4edb-a06d-29cbddb0b025 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:31.072381 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-25fd7749-c884-4edb-a06d-29cbddb0b025 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] [instance: 62ae2a15-8c2c-4dad-971f-0611238103a3] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:31.082544 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-25fd7749-c884-4edb-a06d-29cbddb0b025 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:31.083016 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-25fd7749-c884-4edb-a06d-29cbddb0b025 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:31.084108 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-25fd7749-c884-4edb-a06d-29cbddb0b025 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:31.084603 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-25fd7749-c884-4edb-a06d-29cbddb0b025 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:31.148024 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-25fd7749-c884-4edb-a06d-29cbddb0b025 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] 10.222.0.46 "POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action" status: 200 len: 8208 microversion: 2.1 time: 0.090563 Jan 15 20:56:31.151963 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1183/2299] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:56:31 2022] POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action => generated 8208 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:31.154433 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8b396c3d-87e7-476c-8885-884122a6301f tempest-SecurityGroupRulesTestJSON-83524440 tempest-SecurityGroupRulesTestJSON-83524440-project] Action: 'create', calling method: .version_select at 0x7f30c8da6b80>, body: {"security_group_rule": {"parent_group_id": "be83d225-eb87-4c97-b6a7-e4da68b51426", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:31.254872 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-0ed9130b-2bc3-4468-bbea-031612e65aea tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ec114f8ece434aa496cd401494e2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a05b1a0a7479db84b762eca23b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:31.263706 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-0ed9130b-2bc3-4468-bbea-031612e65aea tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] 10.222.0.46 "GET /compute/v2.1/servers/137421ba-6834-4e42-8221-9b5de84419cc" status: 200 len: 1504 microversion: 2.1 time: 0.222181 Jan 15 20:56:31.271614 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1117/2300] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:31 2022] GET /compute/v2.1/servers/137421ba-6834-4e42-8221-9b5de84419cc => generated 1504 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:31.271614 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-cf6c1109-e370-44f1-aa82-107b57d6a1fd tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:31.271614 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-cf6c1109-e370-44f1-aa82-107b57d6a1fd tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] [instance: b1eb0bef-5aaf-46d6-8739-b12303df9842] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:31.278065 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cf6c1109-e370-44f1-aa82-107b57d6a1fd tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:31.278456 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cf6c1109-e370-44f1-aa82-107b57d6a1fd tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:31.279259 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cf6c1109-e370-44f1-aa82-107b57d6a1fd tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:31.279904 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cf6c1109-e370-44f1-aa82-107b57d6a1fd tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:31.322933 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-cf6c1109-e370-44f1-aa82-107b57d6a1fd tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] 10.222.0.46 "POST /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842/action" status: 200 len: 32632 microversion: 2.1 time: 0.057092 Jan 15 20:56:31.327118 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1118/2301] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:56:31 2022] POST /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842/action => generated 32632 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:56:31.329559 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c818b5cf-ff0d-4f2e-b7b3-5f631f6ab781 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:31.330686 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c818b5cf-ff0d-4f2e-b7b3-5f631f6ab781 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: 0874eafa-ffa2-4257-b6c5-66e4bef983db] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:31.337572 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c818b5cf-ff0d-4f2e-b7b3-5f631f6ab781 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:31.338098 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c818b5cf-ff0d-4f2e-b7b3-5f631f6ab781 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:31.338909 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c818b5cf-ff0d-4f2e-b7b3-5f631f6ab781 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:31.339382 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c818b5cf-ff0d-4f2e-b7b3-5f631f6ab781 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:31.391285 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-8b396c3d-87e7-476c-8885-884122a6301f tempest-SecurityGroupRulesTestJSON-83524440 tempest-SecurityGroupRulesTestJSON-83524440-project] 10.222.0.46 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.240288 Jan 15 20:56:31.392274 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1184/2302] 10.222.0.46 () {60 vars in 1194 bytes} [Sat Jan 15 20:56:31 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:56:31.405616 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e2b56793-1607-44d3-8ccf-3596078a6aed tempest-SecurityGroupRulesTestJSON-83524440 tempest-SecurityGroupRulesTestJSON-83524440-project] Action: 'create', calling method: .version_select at 0x7f30c8d7d940>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1528228245", "description": "tempest-description-1676877329"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:31.577523 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-c818b5cf-ff0d-4f2e-b7b3-5f631f6ab781 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:31.586846 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c818b5cf-ff0d-4f2e-b7b3-5f631f6ab781 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/0874eafa-ffa2-4257-b6c5-66e4bef983db" status: 200 len: 1314 microversion: 2.1 time: 0.260876 Jan 15 20:56:31.587558 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1119/2303] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:31 2022] GET /compute/v2.1/servers/0874eafa-ffa2-4257-b6c5-66e4bef983db => generated 1314 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:31.658652 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e2b56793-1607-44d3-8ccf-3596078a6aed tempest-SecurityGroupRulesTestJSON-83524440 tempest-SecurityGroupRulesTestJSON-83524440-project] 10.222.0.46 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.258991 Jan 15 20:56:31.661961 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1185/2304] 10.222.0.46 () {60 vars in 1179 bytes} [Sat Jan 15 20:56:31 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 20:56:31.662691 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f521b177-a620-435a-9b74-128a2352ac70 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:31.663542 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f521b177-a620-435a-9b74-128a2352ac70 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] [instance: ffb8267e-acd5-4c23-807a-07e0b02204a0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:31.672422 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1cabc9c1-ffb7-4cab-a5f8-a28f4498bf4a tempest-SecurityGroupRulesTestJSON-83524440 tempest-SecurityGroupRulesTestJSON-83524440-project] Action: 'create', calling method: .version_select at 0x7f30cec4d280>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-301462856", "description": "tempest-description-403904544"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:31.677728 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f521b177-a620-435a-9b74-128a2352ac70 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:31.678226 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f521b177-a620-435a-9b74-128a2352ac70 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:31.679076 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f521b177-a620-435a-9b74-128a2352ac70 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:31.679519 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f521b177-a620-435a-9b74-128a2352ac70 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:31.939776 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-1cabc9c1-ffb7-4cab-a5f8-a28f4498bf4a tempest-SecurityGroupRulesTestJSON-83524440 tempest-SecurityGroupRulesTestJSON-83524440-project] 10.222.0.46 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.272099 Jan 15 20:56:31.940790 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1186/2305] 10.222.0.46 () {60 vars in 1179 bytes} [Sat Jan 15 20:56:31 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:56:31.952439 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-80f65631-b945-4a25-aaaf-72795751aba0 req-602b7210-e6fd-4ef4-9ade-b1589e2cbcda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0874eafa-ffa2-4257-b6c5-66e4bef983db", "name": "network-vif-plugged", "status": "completed", "tag": "6b0f9bd5-35ce-4655-ab53-3207b68d566f"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:31.953145 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-f521b177-a620-435a-9b74-128a2352ac70 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f5490d676542fcb18b0dd5f5074516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc238c23f15041c583fd50a124461b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:31.955776 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:56:31.955776 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:56:31.962156 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f521b177-a620-435a-9b74-128a2352ac70 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] 10.222.0.46 "GET /compute/v2.1/servers/ffb8267e-acd5-4c23-807a-07e0b02204a0" status: 200 len: 1333 microversion: 2.1 time: 0.303973 Jan 15 20:56:31.965511 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1120/2306] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:31 2022] GET /compute/v2.1/servers/ffb8267e-acd5-4c23-807a-07e0b02204a0 => generated 1333 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:31.969257 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f8a12720-1582-49cb-9afb-77ebf4943522 tempest-SecurityGroupRulesTestJSON-83524440 tempest-SecurityGroupRulesTestJSON-83524440-project] Action: 'create', calling method: .version_select at 0x7f30c87ef790>, body: {"security_group_rule": {"parent_group_id": "06820719-fc20-4968-bfe7-58b4d04efa2b", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "59112bc2-6784-4048-9d83-79fb7b503b23"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:31.975266 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-80f65631-b945-4a25-aaaf-72795751aba0 req-602b7210-e6fd-4ef4-9ade-b1589e2cbcda service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:31.975958 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-80f65631-b945-4a25-aaaf-72795751aba0 req-602b7210-e6fd-4ef4-9ade-b1589e2cbcda service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:31.992631 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-80f65631-b945-4a25-aaaf-72795751aba0 req-602b7210-e6fd-4ef4-9ade-b1589e2cbcda service nova] Creating event network-vif-plugged:6b0f9bd5-35ce-4655-ab53-3207b68d566f for instance 0874eafa-ffa2-4257-b6c5-66e4bef983db on nch2-master-1 Jan 15 20:56:31.998337 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-80f65631-b945-4a25-aaaf-72795751aba0 req-602b7210-e6fd-4ef4-9ade-b1589e2cbcda service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056289 Jan 15 20:56:31.998950 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1187/2307] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:56:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:56:32.048073 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-2c13dadc-84ad-41e6-bee5-817ec496a3ea tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:32.049005 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-2c13dadc-84ad-41e6-bee5-817ec496a3ea tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] [instance: 70bf65cf-55e2-459a-aaf1-c3eb851a6ccf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:32.063890 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2c13dadc-84ad-41e6-bee5-817ec496a3ea tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:32.064246 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2c13dadc-84ad-41e6-bee5-817ec496a3ea tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:32.067224 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2c13dadc-84ad-41e6-bee5-817ec496a3ea tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:32.067722 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2c13dadc-84ad-41e6-bee5-817ec496a3ea tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:32.281745 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-2c13dadc-84ad-41e6-bee5-817ec496a3ea tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c877fc1c5964326af5d86b3aa7bf64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ac3aebabe465c8903ac9b9d8f54ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:32.290916 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-2c13dadc-84ad-41e6-bee5-817ec496a3ea tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] 10.222.0.46 "GET /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf" status: 200 len: 1543 microversion: 2.1 time: 0.248471 Jan 15 20:56:32.303837 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1188/2308] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:32 2022] GET /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf => generated 1543 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:32.310071 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c031cdfe-3008-45c9-b89c-ad239390c51e tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:32.310993 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c031cdfe-3008-45c9-b89c-ad239390c51e tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] [instance: beffc13d-acd3-455e-96d6-be4bcbb81b88] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:32.317486 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c031cdfe-3008-45c9-b89c-ad239390c51e tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:32.318159 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c031cdfe-3008-45c9-b89c-ad239390c51e tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:32.319195 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c031cdfe-3008-45c9-b89c-ad239390c51e tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:32.319827 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c031cdfe-3008-45c9-b89c-ad239390c51e tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:32.379462 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f8a12720-1582-49cb-9afb-77ebf4943522 tempest-SecurityGroupRulesTestJSON-83524440 tempest-SecurityGroupRulesTestJSON-83524440-project] 10.222.0.46 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 0.414988 Jan 15 20:56:32.380071 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1121/2309] 10.222.0.46 () {60 vars in 1194 bytes} [Sat Jan 15 20:56:31 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:56:32.385096 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-836ec621-0d20-48e3-a3a8-96f306402b4f tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:32.386523 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-836ec621-0d20-48e3-a3a8-96f306402b4f tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] [instance: 62ae2a15-8c2c-4dad-971f-0611238103a3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:32.399466 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-836ec621-0d20-48e3-a3a8-96f306402b4f tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:32.400359 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-836ec621-0d20-48e3-a3a8-96f306402b4f tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:32.401544 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-836ec621-0d20-48e3-a3a8-96f306402b4f tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:32.403135 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-836ec621-0d20-48e3-a3a8-96f306402b4f tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:32.503555 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-c031cdfe-3008-45c9-b89c-ad239390c51e tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52bd234a49b24c1a8bb60ad42c0db262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb6e08a94bc415fada171a2eca3e7ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:32.512777 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c031cdfe-3008-45c9-b89c-ad239390c51e tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] 10.222.0.46 "GET /compute/v2.1/servers/beffc13d-acd3-455e-96d6-be4bcbb81b88" status: 200 len: 1317 microversion: 2.1 time: 0.207278 Jan 15 20:56:32.513464 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1189/2310] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:32 2022] GET /compute/v2.1/servers/beffc13d-acd3-455e-96d6-be4bcbb81b88 => generated 1317 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:32.527217 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-8ab5b0cc-e0fe-4306-9d4e-744b59ef396d req-1ef84419-9700-4258-ac1b-59b7d51698e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "137421ba-6834-4e42-8221-9b5de84419cc", "name": "network-vif-unplugged", "status": "completed", "tag": "eb8f87ed-8d87-47ae-bacf-831dd563cfce"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:32.529150 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:56:32.529150 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:56:32.536674 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-8ab5b0cc-e0fe-4306-9d4e-744b59ef396d req-1ef84419-9700-4258-ac1b-59b7d51698e7 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:32.537463 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-8ab5b0cc-e0fe-4306-9d4e-744b59ef396d req-1ef84419-9700-4258-ac1b-59b7d51698e7 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:32.544446 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-836ec621-0d20-48e3-a3a8-96f306402b4f tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] 10.222.0.46 "POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action" status: 200 len: 16400 microversion: 2.1 time: 0.162562 Jan 15 20:56:32.545600 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1122/2311] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:56:32 2022] POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action => generated 16400 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:56:32.551024 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-30cc5dda-91e0-43fc-8ee4-5f1b5b2b8c5e tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:32.551586 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-8ab5b0cc-e0fe-4306-9d4e-744b59ef396d req-1ef84419-9700-4258-ac1b-59b7d51698e7 service nova] Creating event network-vif-unplugged:eb8f87ed-8d87-47ae-bacf-831dd563cfce for instance 137421ba-6834-4e42-8221-9b5de84419cc on nch1-master-1 Jan 15 20:56:32.551739 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-30cc5dda-91e0-43fc-8ee4-5f1b5b2b8c5e tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] [instance: 137421ba-6834-4e42-8221-9b5de84419cc] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:32.557021 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-8ab5b0cc-e0fe-4306-9d4e-744b59ef396d req-1ef84419-9700-4258-ac1b-59b7d51698e7 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033579 Jan 15 20:56:32.557836 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1190/2312] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:56:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:56:32.564378 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-2e09528a-57a7-42e6-a046-b0af57856b31 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:32.565181 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-2e09528a-57a7-42e6-a046-b0af57856b31 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] [instance: 70bf65cf-55e2-459a-aaf1-c3eb851a6ccf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:32.566188 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-30cc5dda-91e0-43fc-8ee4-5f1b5b2b8c5e tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:32.566638 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-30cc5dda-91e0-43fc-8ee4-5f1b5b2b8c5e tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:32.567521 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-30cc5dda-91e0-43fc-8ee4-5f1b5b2b8c5e tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:32.568539 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-30cc5dda-91e0-43fc-8ee4-5f1b5b2b8c5e tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:32.572466 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2e09528a-57a7-42e6-a046-b0af57856b31 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:32.573154 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2e09528a-57a7-42e6-a046-b0af57856b31 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:32.574352 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2e09528a-57a7-42e6-a046-b0af57856b31 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:32.574969 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2e09528a-57a7-42e6-a046-b0af57856b31 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:32.708430 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-2e09528a-57a7-42e6-a046-b0af57856b31 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] 10.222.0.46 "GET /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.149083 Jan 15 20:56:32.709447 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1191/2313] 10.222.0.46 () {58 vars in 1274 bytes} [Sat Jan 15 20:56:32 2022] GET /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/os-interface => generated 285 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:56:32.715694 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-fb525b73-2554-4ec3-a963-f3c3678bbd8c tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:32.716655 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-fb525b73-2554-4ec3-a963-f3c3678bbd8c tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] [instance: b1eb0bef-5aaf-46d6-8739-b12303df9842] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:32.723404 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fb525b73-2554-4ec3-a963-f3c3678bbd8c tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:32.724031 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fb525b73-2554-4ec3-a963-f3c3678bbd8c tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:32.725260 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fb525b73-2554-4ec3-a963-f3c3678bbd8c tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:32.726689 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fb525b73-2554-4ec3-a963-f3c3678bbd8c tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:32.763008 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-30cc5dda-91e0-43fc-8ee4-5f1b5b2b8c5e tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ec114f8ece434aa496cd401494e2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a05b1a0a7479db84b762eca23b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:32.773545 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-fb525b73-2554-4ec3-a963-f3c3678bbd8c tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] 10.222.0.46 "POST /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842/action" status: 200 len: 32632 microversion: 2.1 time: 0.062371 Jan 15 20:56:32.775510 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-30cc5dda-91e0-43fc-8ee4-5f1b5b2b8c5e tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] 10.222.0.46 "GET /compute/v2.1/servers/137421ba-6834-4e42-8221-9b5de84419cc" status: 200 len: 1504 microversion: 2.1 time: 0.228517 Jan 15 20:56:32.775659 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1192/2314] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:56:32 2022] POST /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842/action => generated 32632 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:56:32.776438 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1123/2315] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:32 2022] GET /compute/v2.1/servers/137421ba-6834-4e42-8221-9b5de84419cc => generated 1504 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:32.783061 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-6295b63a-67f8-4fd3-bc2c-31291b0de9ae tempest-SecurityGroupRulesTestJSON-83524440 tempest-SecurityGroupRulesTestJSON-83524440-project] Action: 'create', calling method: .version_select at 0x7f30cec0a280>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1165869208", "description": "tempest-description-1287236424"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:32.792711 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5e93c6e3-be30-4f44-bc0d-f1663f7d6367 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:32.794131 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-5e93c6e3-be30-4f44-bc0d-f1663f7d6367 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: 0874eafa-ffa2-4257-b6c5-66e4bef983db] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:32.800701 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5e93c6e3-be30-4f44-bc0d-f1663f7d6367 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:32.801559 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5e93c6e3-be30-4f44-bc0d-f1663f7d6367 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:32.802597 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5e93c6e3-be30-4f44-bc0d-f1663f7d6367 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:32.803258 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5e93c6e3-be30-4f44-bc0d-f1663f7d6367 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:33.021417 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-6295b63a-67f8-4fd3-bc2c-31291b0de9ae tempest-SecurityGroupRulesTestJSON-83524440 tempest-SecurityGroupRulesTestJSON-83524440-project] 10.222.0.46 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.244625 Jan 15 20:56:33.022854 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1193/2316] 10.222.0.46 () {60 vars in 1179 bytes} [Sat Jan 15 20:56:32 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:56:33.029298 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e655bf7f-aba6-4831-bb25-6c3485e2676b tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:33.030099 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e655bf7f-aba6-4831-bb25-6c3485e2676b tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] [instance: ffb8267e-acd5-4c23-807a-07e0b02204a0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:33.039925 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e655bf7f-aba6-4831-bb25-6c3485e2676b tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:33.040369 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e655bf7f-aba6-4831-bb25-6c3485e2676b tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:33.041199 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e655bf7f-aba6-4831-bb25-6c3485e2676b tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:33.041773 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e655bf7f-aba6-4831-bb25-6c3485e2676b tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:33.051777 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-5e93c6e3-be30-4f44-bc0d-f1663f7d6367 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:33.060376 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5e93c6e3-be30-4f44-bc0d-f1663f7d6367 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/0874eafa-ffa2-4257-b6c5-66e4bef983db" status: 200 len: 1314 microversion: 2.1 time: 0.281630 Jan 15 20:56:33.061100 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1124/2317] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:32 2022] GET /compute/v2.1/servers/0874eafa-ffa2-4257-b6c5-66e4bef983db => generated 1314 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:33.081444 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-4719af6e-428f-4c85-93d1-f6f1c4a7ee2c tempest-SecurityGroupRulesTestJSON-83524440 tempest-SecurityGroupRulesTestJSON-83524440-project] Action: 'create', calling method: .version_select at 0x7f30c8796f70>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1791505198", "description": "tempest-description-1249643567"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:33.266240 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-e655bf7f-aba6-4831-bb25-6c3485e2676b tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f5490d676542fcb18b0dd5f5074516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc238c23f15041c583fd50a124461b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:33.285205 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e655bf7f-aba6-4831-bb25-6c3485e2676b tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] 10.222.0.46 "GET /compute/v2.1/servers/ffb8267e-acd5-4c23-807a-07e0b02204a0" status: 200 len: 1333 microversion: 2.1 time: 0.260628 Jan 15 20:56:33.287974 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1194/2318] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:33 2022] GET /compute/v2.1/servers/ffb8267e-acd5-4c23-807a-07e0b02204a0 => generated 1333 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:33.349212 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-4719af6e-428f-4c85-93d1-f6f1c4a7ee2c tempest-SecurityGroupRulesTestJSON-83524440 tempest-SecurityGroupRulesTestJSON-83524440-project] 10.222.0.46 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.271685 Jan 15 20:56:33.356863 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1125/2319] 10.222.0.46 () {60 vars in 1179 bytes} [Sat Jan 15 20:56:33 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:56:33.368066 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-14de805f-27a1-4ac4-8936-78535b68dad9 tempest-SecurityGroupRulesTestJSON-83524440 tempest-SecurityGroupRulesTestJSON-83524440-project] Action: 'create', calling method: .version_select at 0x7f30cec63280>, body: {"security_group_rule": {"parent_group_id": "5506200d-1401-4f0f-8080-c9f983e34010", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "fe5fc437-14c8-454d-bee7-3fb5fd68009a"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:33.529813 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e25e8755-2750-402e-a7c0-9f7bede23faf tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:33.530746 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e25e8755-2750-402e-a7c0-9f7bede23faf tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] [instance: beffc13d-acd3-455e-96d6-be4bcbb81b88] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:33.540307 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e25e8755-2750-402e-a7c0-9f7bede23faf tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:33.541062 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e25e8755-2750-402e-a7c0-9f7bede23faf tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:33.542892 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e25e8755-2750-402e-a7c0-9f7bede23faf tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:33.543872 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e25e8755-2750-402e-a7c0-9f7bede23faf tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:34.021745 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-14de805f-27a1-4ac4-8936-78535b68dad9 tempest-SecurityGroupRulesTestJSON-83524440 tempest-SecurityGroupRulesTestJSON-83524440-project] 10.222.0.46 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.657795 Jan 15 20:56:34.023011 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1195/2320] 10.222.0.46 () {60 vars in 1194 bytes} [Sat Jan 15 20:56:33 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:56:34.029351 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-aa8fe6b1-5112-4dce-bf52-bb36c8bbd08c tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:34.030444 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-aa8fe6b1-5112-4dce-bf52-bb36c8bbd08c tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] [instance: 62ae2a15-8c2c-4dad-971f-0611238103a3] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:34.037757 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-aa8fe6b1-5112-4dce-bf52-bb36c8bbd08c tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:34.038264 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-aa8fe6b1-5112-4dce-bf52-bb36c8bbd08c tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:34.039179 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-aa8fe6b1-5112-4dce-bf52-bb36c8bbd08c tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:34.039725 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-aa8fe6b1-5112-4dce-bf52-bb36c8bbd08c tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:34.044661 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-e25e8755-2750-402e-a7c0-9f7bede23faf tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52bd234a49b24c1a8bb60ad42c0db262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb6e08a94bc415fada171a2eca3e7ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:34.052531 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e25e8755-2750-402e-a7c0-9f7bede23faf tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] 10.222.0.46 "GET /compute/v2.1/servers/beffc13d-acd3-455e-96d6-be4bcbb81b88" status: 200 len: 1317 microversion: 2.1 time: 0.526937 Jan 15 20:56:34.054794 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1126/2321] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:33 2022] GET /compute/v2.1/servers/beffc13d-acd3-455e-96d6-be4bcbb81b88 => generated 1317 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:56:34.061509 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-276f3e9b-e31b-497c-8b5f-a6410c5134ab tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:34.063121 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-276f3e9b-e31b-497c-8b5f-a6410c5134ab tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] [instance: b1eb0bef-5aaf-46d6-8739-b12303df9842] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:34.070043 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-276f3e9b-e31b-497c-8b5f-a6410c5134ab tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:34.070658 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-276f3e9b-e31b-497c-8b5f-a6410c5134ab tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:34.071612 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-276f3e9b-e31b-497c-8b5f-a6410c5134ab tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:34.072150 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-276f3e9b-e31b-497c-8b5f-a6410c5134ab tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:34.083724 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-aa8fe6b1-5112-4dce-bf52-bb36c8bbd08c tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] 10.222.0.46 "POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action" status: 200 len: 16400 microversion: 2.1 time: 0.058965 Jan 15 20:56:34.084325 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1196/2322] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:56:34 2022] POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action => generated 16400 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:56:34.091242 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f8a29104-5ee6-42bc-aa63-7ff910c0c0b2 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:34.091989 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f8a29104-5ee6-42bc-aa63-7ff910c0c0b2 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] [instance: 137421ba-6834-4e42-8221-9b5de84419cc] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:34.098748 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f8a29104-5ee6-42bc-aa63-7ff910c0c0b2 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:34.099219 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f8a29104-5ee6-42bc-aa63-7ff910c0c0b2 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:34.100036 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f8a29104-5ee6-42bc-aa63-7ff910c0c0b2 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:34.100472 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f8a29104-5ee6-42bc-aa63-7ff910c0c0b2 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:34.114873 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-276f3e9b-e31b-497c-8b5f-a6410c5134ab tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] 10.222.0.46 "POST /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842/action" status: 200 len: 32632 microversion: 2.1 time: 0.058581 Jan 15 20:56:34.115580 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1127/2323] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:56:34 2022] POST /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842/action => generated 32632 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:56:34.124218 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3608e6a9-e671-4dc3-a4f6-2e92ca586299 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:34.125249 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-3608e6a9-e671-4dc3-a4f6-2e92ca586299 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] [instance: 70bf65cf-55e2-459a-aaf1-c3eb851a6ccf] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:34.131870 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3608e6a9-e671-4dc3-a4f6-2e92ca586299 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:34.132324 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3608e6a9-e671-4dc3-a4f6-2e92ca586299 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:34.133135 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3608e6a9-e671-4dc3-a4f6-2e92ca586299 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:34.133575 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3608e6a9-e671-4dc3-a4f6-2e92ca586299 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:34.181702 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3608e6a9-e671-4dc3-a4f6-2e92ca586299 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] 10.222.0.46 "POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action" status: 200 len: 14 microversion: 2.1 time: 0.063632 Jan 15 20:56:34.185258 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1128/2324] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:56:34 2022] POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action => generated 14 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 20:56:34.187832 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-08cf0952-4872-456a-bf75-0790c3a918d5 tempest-SecurityGroupRulesTestJSON-83524440 tempest-SecurityGroupRulesTestJSON-83524440-project] Calling method '.version_select at 0x7f30ceb63160>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:34.283328 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-f8a29104-5ee6-42bc-aa63-7ff910c0c0b2 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ec114f8ece434aa496cd401494e2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a05b1a0a7479db84b762eca23b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:34.291615 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f8a29104-5ee6-42bc-aa63-7ff910c0c0b2 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] 10.222.0.46 "GET /compute/v2.1/servers/137421ba-6834-4e42-8221-9b5de84419cc" status: 200 len: 1504 microversion: 2.1 time: 0.205985 Jan 15 20:56:34.302184 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1197/2325] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:34 2022] GET /compute/v2.1/servers/137421ba-6834-4e42-8221-9b5de84419cc => generated 1504 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:34.306771 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-3bf8209c-bccd-40d6-8759-2a243de1eebf tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:34.307715 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-3bf8209c-bccd-40d6-8759-2a243de1eebf tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: 0874eafa-ffa2-4257-b6c5-66e4bef983db] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:34.315141 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3bf8209c-bccd-40d6-8759-2a243de1eebf tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:34.315609 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3bf8209c-bccd-40d6-8759-2a243de1eebf tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:34.316483 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3bf8209c-bccd-40d6-8759-2a243de1eebf tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:34.317018 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3bf8209c-bccd-40d6-8759-2a243de1eebf tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:34.471654 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-08cf0952-4872-456a-bf75-0790c3a918d5 tempest-SecurityGroupRulesTestJSON-83524440 tempest-SecurityGroupRulesTestJSON-83524440-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/fe5fc437-14c8-454d-bee7-3fb5fd68009a" status: 202 len: 0 microversion: 2.1 time: 0.287686 Jan 15 20:56:34.472248 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1129/2326] 10.222.0.46 () {58 vars in 1271 bytes} [Sat Jan 15 20:56:34 2022] DELETE /compute/v2.1/os-security-groups/fe5fc437-14c8-454d-bee7-3fb5fd68009a => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 20:56:34.477260 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-28827a57-a795-46e0-bbbe-f52ef575733c tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:34.478005 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-28827a57-a795-46e0-bbbe-f52ef575733c tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] [instance: ffb8267e-acd5-4c23-807a-07e0b02204a0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:34.485208 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-28827a57-a795-46e0-bbbe-f52ef575733c tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:34.486086 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-28827a57-a795-46e0-bbbe-f52ef575733c tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:34.486775 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-28827a57-a795-46e0-bbbe-f52ef575733c tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:34.487222 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-28827a57-a795-46e0-bbbe-f52ef575733c tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:34.516307 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-3bf8209c-bccd-40d6-8759-2a243de1eebf tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:34.531464 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-3bf8209c-bccd-40d6-8759-2a243de1eebf tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/0874eafa-ffa2-4257-b6c5-66e4bef983db" status: 200 len: 1501 microversion: 2.1 time: 0.237296 Jan 15 20:56:34.532617 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1198/2327] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:34 2022] GET /compute/v2.1/servers/0874eafa-ffa2-4257-b6c5-66e4bef983db => generated 1501 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:34.545563 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0dd6bbe9-901b-47c9-8a19-07767e655f75 tempest-SecurityGroupRulesTestJSON-83524440 tempest-SecurityGroupRulesTestJSON-83524440-project] Calling method '.version_select at 0x7f30cecf7b80>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:34.623612 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0dd6bbe9-901b-47c9-8a19-07767e655f75 tempest-SecurityGroupRulesTestJSON-83524440 tempest-SecurityGroupRulesTestJSON-83524440-project] 10.222.0.46 "GET /compute/v2.1/os-security-groups/5506200d-1401-4f0f-8080-c9f983e34010" status: 200 len: 248 microversion: 2.1 time: 0.089699 Jan 15 20:56:34.624950 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1199/2328] 10.222.0.46 () {58 vars in 1268 bytes} [Sat Jan 15 20:56:34 2022] GET /compute/v2.1/os-security-groups/5506200d-1401-4f0f-8080-c9f983e34010 => generated 248 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:56:34.631817 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f7ebf5f5-6c42-40e2-b935-8d670d920f47 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:34.632699 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f7ebf5f5-6c42-40e2-b935-8d670d920f47 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: 0874eafa-ffa2-4257-b6c5-66e4bef983db] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:34.641020 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f7ebf5f5-6c42-40e2-b935-8d670d920f47 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:34.641648 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f7ebf5f5-6c42-40e2-b935-8d670d920f47 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:34.642635 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f7ebf5f5-6c42-40e2-b935-8d670d920f47 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:34.643213 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f7ebf5f5-6c42-40e2-b935-8d670d920f47 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:34.669480 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.objects.instance [None req-f7ebf5f5-6c42-40e2-b935-8d670d920f47 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lazy-loading 'flavor' on Instance uuid 0874eafa-ffa2-4257-b6c5-66e4bef983db {{(pid=129366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 20:56:34.671919 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-28827a57-a795-46e0-bbbe-f52ef575733c tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f5490d676542fcb18b0dd5f5074516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc238c23f15041c583fd50a124461b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:34.679845 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-28827a57-a795-46e0-bbbe-f52ef575733c tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] 10.222.0.46 "GET /compute/v2.1/servers/ffb8267e-acd5-4c23-807a-07e0b02204a0" status: 200 len: 1333 microversion: 2.1 time: 0.206489 Jan 15 20:56:34.680461 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1130/2329] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:34 2022] GET /compute/v2.1/servers/ffb8267e-acd5-4c23-807a-07e0b02204a0 => generated 1333 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:34.687346 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-f9b259e3-42c8-4329-8b19-4a6cbdb95e2e req-4dab8993-6d72-4eb3-aa57-486a3cd5c78a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "137421ba-6834-4e42-8221-9b5de84419cc", "tag": "eb8f87ed-8d87-47ae-bacf-831dd563cfce"}, {"name": "network-changed", "server_uuid": "70bf65cf-55e2-459a-aaf1-c3eb851a6ccf", "tag": "a6cb493c-7db8-4ea6-9c25-c683e688717c"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:34.690229 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:56:34.690229 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:56:34.708283 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-f9b259e3-42c8-4329-8b19-4a6cbdb95e2e req-4dab8993-6d72-4eb3-aa57-486a3cd5c78a service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:34.709059 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-f9b259e3-42c8-4329-8b19-4a6cbdb95e2e req-4dab8993-6d72-4eb3-aa57-486a3cd5c78a service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:34.727298 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-f9b259e3-42c8-4329-8b19-4a6cbdb95e2e req-4dab8993-6d72-4eb3-aa57-486a3cd5c78a service nova] Creating event network-changed:eb8f87ed-8d87-47ae-bacf-831dd563cfce for instance 137421ba-6834-4e42-8221-9b5de84419cc on nch1-master-1 Jan 15 20:56:34.728125 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-f9b259e3-42c8-4329-8b19-4a6cbdb95e2e req-4dab8993-6d72-4eb3-aa57-486a3cd5c78a service nova] Creating event network-changed:a6cb493c-7db8-4ea6-9c25-c683e688717c for instance 70bf65cf-55e2-459a-aaf1-c3eb851a6ccf on nch1-master-1 Jan 15 20:56:34.737177 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-f9b259e3-42c8-4329-8b19-4a6cbdb95e2e req-4dab8993-6d72-4eb3-aa57-486a3cd5c78a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.055067 Jan 15 20:56:34.738010 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1131/2330] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:56:34 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:56:34.744400 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d2719f88-d751-45df-bc1e-850343a2f9f9 tempest-SecurityGroupRulesTestJSON-83524440 tempest-SecurityGroupRulesTestJSON-83524440-project] Action: 'create', calling method: .version_select at 0x7f30c872cee0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1997886294", "description": "tempest-description-1261056900"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:35.014827 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d2719f88-d751-45df-bc1e-850343a2f9f9 tempest-SecurityGroupRulesTestJSON-83524440 tempest-SecurityGroupRulesTestJSON-83524440-project] 10.222.0.46 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.275395 Jan 15 20:56:35.016074 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1132/2331] 10.222.0.46 () {60 vars in 1179 bytes} [Sat Jan 15 20:56:34 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:56:35.022746 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-d7191275-e666-4445-87e8-c1127d31e3c8 req-b1a72250-5a95-4838-81a6-0d46a363fd98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "beffc13d-acd3-455e-96d6-be4bcbb81b88", "name": "network-vif-plugged", "status": "completed", "tag": "3de9d3d2-9291-4173-8d0b-3d31a05f6fe6"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:35.025022 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:56:35.025022 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:56:35.049375 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f7ebf5f5-6c42-40e2-b935-8d670d920f47 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "POST /compute/v2.1/servers/0874eafa-ffa2-4257-b6c5-66e4bef983db/action" status: 202 len: 0 microversion: 2.1 time: 0.422853 Jan 15 20:56:35.050022 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1200/2332] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:56:34 2022] POST /compute/v2.1/servers/0874eafa-ffa2-4257-b6c5-66e4bef983db/action => generated 0 bytes in 424 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 20:56:35.052699 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-d7191275-e666-4445-87e8-c1127d31e3c8 req-b1a72250-5a95-4838-81a6-0d46a363fd98 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:35.055385 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-25305e6c-d7db-4b79-95c7-143574d0a9f5 tempest-SecurityGroupRulesTestJSON-83524440 tempest-SecurityGroupRulesTestJSON-83524440-project] Action: 'create', calling method: .version_select at 0x7f30c8deaa60>, body: {"security_group_rule": {"parent_group_id": "2dea5ac0-3da1-4379-b827-282859af02bf", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:35.058548 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-d7191275-e666-4445-87e8-c1127d31e3c8 req-b1a72250-5a95-4838-81a6-0d46a363fd98 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:35.102979 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-d7191275-e666-4445-87e8-c1127d31e3c8 req-b1a72250-5a95-4838-81a6-0d46a363fd98 service nova] Creating event network-vif-plugged:3de9d3d2-9291-4173-8d0b-3d31a05f6fe6 for instance beffc13d-acd3-455e-96d6-be4bcbb81b88 on nch1-master-1 Jan 15 20:56:35.109222 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-d7191275-e666-4445-87e8-c1127d31e3c8 req-b1a72250-5a95-4838-81a6-0d46a363fd98 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091689 Jan 15 20:56:35.113606 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1133/2333] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:56:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:56:35.123959 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-7105cd6b-4131-4fa5-9525-01a059480540 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:35.125061 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-7105cd6b-4131-4fa5-9525-01a059480540 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: 0874eafa-ffa2-4257-b6c5-66e4bef983db] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:35.139407 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7105cd6b-4131-4fa5-9525-01a059480540 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:35.139899 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7105cd6b-4131-4fa5-9525-01a059480540 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:35.140725 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7105cd6b-4131-4fa5-9525-01a059480540 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:35.141221 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7105cd6b-4131-4fa5-9525-01a059480540 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:35.399259 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-25305e6c-d7db-4b79-95c7-143574d0a9f5 tempest-SecurityGroupRulesTestJSON-83524440 tempest-SecurityGroupRulesTestJSON-83524440-project] 10.222.0.46 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.347883 Jan 15 20:56:35.405802 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1201/2334] 10.222.0.46 () {60 vars in 1194 bytes} [Sat Jan 15 20:56:35 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:56:35.410951 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c25c89d5-c577-4e23-9e6e-9c0d3be84c7c tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:35.411884 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c25c89d5-c577-4e23-9e6e-9c0d3be84c7c tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] [instance: beffc13d-acd3-455e-96d6-be4bcbb81b88] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:35.419581 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c25c89d5-c577-4e23-9e6e-9c0d3be84c7c tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:35.420319 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c25c89d5-c577-4e23-9e6e-9c0d3be84c7c tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:35.421419 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c25c89d5-c577-4e23-9e6e-9c0d3be84c7c tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:35.422021 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c25c89d5-c577-4e23-9e6e-9c0d3be84c7c tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:35.447315 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-7105cd6b-4131-4fa5-9525-01a059480540 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:35.456282 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-7105cd6b-4131-4fa5-9525-01a059480540 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/0874eafa-ffa2-4257-b6c5-66e4bef983db" status: 200 len: 1507 microversion: 2.1 time: 0.341136 Jan 15 20:56:35.457384 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1134/2335] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:35 2022] GET /compute/v2.1/servers/0874eafa-ffa2-4257-b6c5-66e4bef983db => generated 1507 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:35.464753 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f1a9e5b1-60d5-48ad-808f-31655ba1afc4 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:35.467035 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f1a9e5b1-60d5-48ad-808f-31655ba1afc4 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] [instance: 62ae2a15-8c2c-4dad-971f-0611238103a3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:35.475052 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f1a9e5b1-60d5-48ad-808f-31655ba1afc4 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:35.475852 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f1a9e5b1-60d5-48ad-808f-31655ba1afc4 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:35.476926 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f1a9e5b1-60d5-48ad-808f-31655ba1afc4 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:35.477589 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f1a9e5b1-60d5-48ad-808f-31655ba1afc4 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:35.527973 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f1a9e5b1-60d5-48ad-808f-31655ba1afc4 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] 10.222.0.46 "POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action" status: 200 len: 16400 microversion: 2.1 time: 0.069010 Jan 15 20:56:35.528980 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1135/2336] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:56:35 2022] POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action => generated 16400 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:56:35.536708 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-313399d6-d79a-4364-84b4-bf2ccc661a5a tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:35.538227 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-313399d6-d79a-4364-84b4-bf2ccc661a5a tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] [instance: b1eb0bef-5aaf-46d6-8739-b12303df9842] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:35.545648 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-313399d6-d79a-4364-84b4-bf2ccc661a5a tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:35.546237 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-313399d6-d79a-4364-84b4-bf2ccc661a5a tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:35.547026 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-313399d6-d79a-4364-84b4-bf2ccc661a5a tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:35.547462 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-313399d6-d79a-4364-84b4-bf2ccc661a5a tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:35.570919 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-c25c89d5-c577-4e23-9e6e-9c0d3be84c7c tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52bd234a49b24c1a8bb60ad42c0db262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb6e08a94bc415fada171a2eca3e7ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:35.580029 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c25c89d5-c577-4e23-9e6e-9c0d3be84c7c tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] 10.222.0.46 "GET /compute/v2.1/servers/beffc13d-acd3-455e-96d6-be4bcbb81b88" status: 200 len: 1317 microversion: 2.1 time: 0.172869 Jan 15 20:56:35.580954 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1202/2337] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:35 2022] GET /compute/v2.1/servers/beffc13d-acd3-455e-96d6-be4bcbb81b88 => generated 1317 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:35.586433 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-69babd2e-ac9b-4316-9aeb-10f723da1037 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:35.587597 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-69babd2e-ac9b-4316-9aeb-10f723da1037 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] [instance: 70bf65cf-55e2-459a-aaf1-c3eb851a6ccf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:35.594962 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-69babd2e-ac9b-4316-9aeb-10f723da1037 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:35.595652 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-69babd2e-ac9b-4316-9aeb-10f723da1037 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:35.596542 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-69babd2e-ac9b-4316-9aeb-10f723da1037 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:35.597101 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-69babd2e-ac9b-4316-9aeb-10f723da1037 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:35.666239 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-69babd2e-ac9b-4316-9aeb-10f723da1037 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] 10.222.0.46 "POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action" status: 200 len: 14 microversion: 2.1 time: 0.083247 Jan 15 20:56:35.669876 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1203/2338] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:56:35 2022] POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action => generated 14 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 20:56:35.673800 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9352763a-4535-4945-ade9-a7dca0ca8a3b tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:35.674753 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-9352763a-4535-4945-ade9-a7dca0ca8a3b tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] [instance: 137421ba-6834-4e42-8221-9b5de84419cc] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:35.682137 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9352763a-4535-4945-ade9-a7dca0ca8a3b tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:35.682621 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9352763a-4535-4945-ade9-a7dca0ca8a3b tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:35.683803 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9352763a-4535-4945-ade9-a7dca0ca8a3b tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:35.684281 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9352763a-4535-4945-ade9-a7dca0ca8a3b tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:35.726451 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-313399d6-d79a-4364-84b4-bf2ccc661a5a tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] 10.222.0.46 "POST /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842/action" status: 200 len: 32632 microversion: 2.1 time: 0.195553 Jan 15 20:56:35.727263 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1136/2339] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:56:35 2022] POST /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842/action => generated 32632 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:56:35.734097 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-dac43be8-13ca-4bed-8edd-55e355b826c3 tempest-SecurityGroupRulesTestJSON-83524440 tempest-SecurityGroupRulesTestJSON-83524440-project] Action: 'create', calling method: .version_select at 0x7f30c87395e0>, body: {"security_group_rule": {"parent_group_id": "2dea5ac0-3da1-4379-b827-282859af02bf", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:35.920335 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-9352763a-4535-4945-ade9-a7dca0ca8a3b tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ec114f8ece434aa496cd401494e2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a05b1a0a7479db84b762eca23b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:35.933836 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-9352763a-4535-4945-ade9-a7dca0ca8a3b tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] 10.222.0.46 "GET /compute/v2.1/servers/137421ba-6834-4e42-8221-9b5de84419cc" status: 200 len: 1504 microversion: 2.1 time: 0.264951 Jan 15 20:56:35.934983 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1204/2340] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:35 2022] GET /compute/v2.1/servers/137421ba-6834-4e42-8221-9b5de84419cc => generated 1504 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:35.939549 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-005c1990-31fa-408b-b56a-39e75318178a tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:35.940670 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-005c1990-31fa-408b-b56a-39e75318178a tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] [instance: ffb8267e-acd5-4c23-807a-07e0b02204a0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:35.952277 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-005c1990-31fa-408b-b56a-39e75318178a tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:35.952853 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-005c1990-31fa-408b-b56a-39e75318178a tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:35.954536 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-005c1990-31fa-408b-b56a-39e75318178a tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:35.955203 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-005c1990-31fa-408b-b56a-39e75318178a tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:36.066718 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-dac43be8-13ca-4bed-8edd-55e355b826c3 tempest-SecurityGroupRulesTestJSON-83524440 tempest-SecurityGroupRulesTestJSON-83524440-project] 10.222.0.46 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.337820 Jan 15 20:56:36.067678 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1137/2341] 10.222.0.46 () {60 vars in 1194 bytes} [Sat Jan 15 20:56:35 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:56:36.083304 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-82f8f4fb-0063-422f-82fc-ac19ac6ba3a4 tempest-SecurityGroupRulesTestJSON-83524440 tempest-SecurityGroupRulesTestJSON-83524440-project] Calling method '.version_select at 0x7f30c8801ee0>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:36.191816 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-82f8f4fb-0063-422f-82fc-ac19ac6ba3a4 tempest-SecurityGroupRulesTestJSON-83524440 tempest-SecurityGroupRulesTestJSON-83524440-project] 10.222.0.46 "GET /compute/v2.1/os-security-groups/2dea5ac0-3da1-4379-b827-282859af02bf" status: 200 len: 665 microversion: 2.1 time: 0.115955 Jan 15 20:56:36.193732 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1138/2342] 10.222.0.46 () {58 vars in 1268 bytes} [Sat Jan 15 20:56:36 2022] GET /compute/v2.1/os-security-groups/2dea5ac0-3da1-4379-b827-282859af02bf => generated 665 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:56:36.204737 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-005c1990-31fa-408b-b56a-39e75318178a tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f5490d676542fcb18b0dd5f5074516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc238c23f15041c583fd50a124461b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:36.211781 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-6d1aa3bb-c45a-433d-8c43-d949a50214fb tempest-SecurityGroupRulesTestJSON-83524440 tempest-SecurityGroupRulesTestJSON-83524440-project] Calling method '.version_select at 0x7f30c8736c10>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:36.212703 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-005c1990-31fa-408b-b56a-39e75318178a tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] 10.222.0.46 "GET /compute/v2.1/servers/ffb8267e-acd5-4c23-807a-07e0b02204a0" status: 200 len: 1333 microversion: 2.1 time: 0.276556 Jan 15 20:56:36.217088 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1205/2343] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:35 2022] GET /compute/v2.1/servers/ffb8267e-acd5-4c23-807a-07e0b02204a0 => generated 1333 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:36.456379 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-6d1aa3bb-c45a-433d-8c43-d949a50214fb tempest-SecurityGroupRulesTestJSON-83524440 tempest-SecurityGroupRulesTestJSON-83524440-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-group-rules/047817b3-a041-4ff6-9149-30e1fcb879c8" status: 202 len: 0 microversion: 2.1 time: 0.253006 Jan 15 20:56:36.457031 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1139/2344] 10.222.0.46 () {58 vars in 1286 bytes} [Sat Jan 15 20:56:36 2022] DELETE /compute/v2.1/os-security-group-rules/047817b3-a041-4ff6-9149-30e1fcb879c8 => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 15 20:56:36.466505 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-fac8a25e-7cc8-459e-a5ef-e5fd0da6d4e7 tempest-SecurityGroupRulesTestJSON-83524440 tempest-SecurityGroupRulesTestJSON-83524440-project] Calling method '.version_select at 0x7f30ceb7adc0>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:36.475732 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b01edc68-3450-4b60-b0e4-13070b10e87e tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:36.476618 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b01edc68-3450-4b60-b0e4-13070b10e87e tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: 0874eafa-ffa2-4257-b6c5-66e4bef983db] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:36.484297 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b01edc68-3450-4b60-b0e4-13070b10e87e tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:36.484826 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b01edc68-3450-4b60-b0e4-13070b10e87e tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:36.486270 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b01edc68-3450-4b60-b0e4-13070b10e87e tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:36.486746 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b01edc68-3450-4b60-b0e4-13070b10e87e tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:36.799905 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-b01edc68-3450-4b60-b0e4-13070b10e87e tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:36.810408 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b01edc68-3450-4b60-b0e4-13070b10e87e tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/0874eafa-ffa2-4257-b6c5-66e4bef983db" status: 200 len: 1507 microversion: 2.1 time: 0.337855 Jan 15 20:56:36.819452 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1140/2345] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:36 2022] GET /compute/v2.1/servers/0874eafa-ffa2-4257-b6c5-66e4bef983db => generated 1507 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:56:36.825878 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e85f591d-1cbc-48d3-a8b1-27f872a1bfe7 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:36.826845 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e85f591d-1cbc-48d3-a8b1-27f872a1bfe7 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] [instance: 62ae2a15-8c2c-4dad-971f-0611238103a3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:36.833382 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e85f591d-1cbc-48d3-a8b1-27f872a1bfe7 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:36.833865 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e85f591d-1cbc-48d3-a8b1-27f872a1bfe7 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:36.834696 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e85f591d-1cbc-48d3-a8b1-27f872a1bfe7 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:36.835129 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e85f591d-1cbc-48d3-a8b1-27f872a1bfe7 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:36.875311 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e85f591d-1cbc-48d3-a8b1-27f872a1bfe7 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] 10.222.0.46 "POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action" status: 200 len: 16400 microversion: 2.1 time: 0.054265 Jan 15 20:56:36.876016 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1141/2346] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:56:36 2022] POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action => generated 16400 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:56:36.881176 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-93fe7687-7df3-41d6-afa9-982742f6010c tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:36.881938 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-93fe7687-7df3-41d6-afa9-982742f6010c tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] [instance: beffc13d-acd3-455e-96d6-be4bcbb81b88] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:36.890257 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-93fe7687-7df3-41d6-afa9-982742f6010c tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:36.890696 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-93fe7687-7df3-41d6-afa9-982742f6010c tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:36.892008 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-93fe7687-7df3-41d6-afa9-982742f6010c tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:36.892605 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-93fe7687-7df3-41d6-afa9-982742f6010c tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:36.911806 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-fac8a25e-7cc8-459e-a5ef-e5fd0da6d4e7 tempest-SecurityGroupRulesTestJSON-83524440 tempest-SecurityGroupRulesTestJSON-83524440-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/2dea5ac0-3da1-4379-b827-282859af02bf" status: 202 len: 0 microversion: 2.1 time: 0.449489 Jan 15 20:56:36.912470 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1206/2347] 10.222.0.46 () {58 vars in 1271 bytes} [Sat Jan 15 20:56:36 2022] DELETE /compute/v2.1/os-security-groups/2dea5ac0-3da1-4379-b827-282859af02bf => generated 0 bytes in 451 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 20:56:36.921002 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c7394732-6a78-4209-a9a1-0d00d89b6bf8 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:36.923335 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c7394732-6a78-4209-a9a1-0d00d89b6bf8 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] [instance: 70bf65cf-55e2-459a-aaf1-c3eb851a6ccf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:36.932370 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c7394732-6a78-4209-a9a1-0d00d89b6bf8 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:36.933105 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c7394732-6a78-4209-a9a1-0d00d89b6bf8 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:36.934140 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c7394732-6a78-4209-a9a1-0d00d89b6bf8 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:36.934570 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c7394732-6a78-4209-a9a1-0d00d89b6bf8 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:37.226575 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c7394732-6a78-4209-a9a1-0d00d89b6bf8 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] 10.222.0.46 "POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action" status: 200 len: 14 microversion: 2.1 time: 0.312419 Jan 15 20:56:37.227213 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1207/2348] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:56:36 2022] POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action => generated 14 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 20:56:37.233157 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c4606453-cca0-4d7d-ac0c-8aa9154ae0ed tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:37.234214 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c4606453-cca0-4d7d-ac0c-8aa9154ae0ed tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] [instance: b1eb0bef-5aaf-46d6-8739-b12303df9842] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:37.241988 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c4606453-cca0-4d7d-ac0c-8aa9154ae0ed tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:37.242437 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c4606453-cca0-4d7d-ac0c-8aa9154ae0ed tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:37.243280 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c4606453-cca0-4d7d-ac0c-8aa9154ae0ed tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:37.243717 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c4606453-cca0-4d7d-ac0c-8aa9154ae0ed tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:37.289081 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c4606453-cca0-4d7d-ac0c-8aa9154ae0ed tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] 10.222.0.46 "POST /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842/action" status: 200 len: 32632 microversion: 2.1 time: 0.060333 Jan 15 20:56:37.294321 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1208/2349] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:56:37 2022] POST /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842/action => generated 32632 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:56:37.297900 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7bbc095f-40b4-4e3d-b636-b3e17c7a13d5 tempest-SecurityGroupRulesTestJSON-83524440 tempest-SecurityGroupRulesTestJSON-83524440-project] Calling method '.version_select at 0x7f30ceb7adc0>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:37.323064 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-93fe7687-7df3-41d6-afa9-982742f6010c tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52bd234a49b24c1a8bb60ad42c0db262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb6e08a94bc415fada171a2eca3e7ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:37.329426 ncdv-master-1 devstack@n-api.service[129366]: DEBUG neutronclient.v2_0.client [None req-7bbc095f-40b4-4e3d-b636-b3e17c7a13d5 tempest-SecurityGroupRulesTestJSON-83524440 tempest-SecurityGroupRulesTestJSON-83524440-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group fe5fc437-14c8-454d-bee7-3fb5fd68009a does not exist", "detail": ""}} {{(pid=129366) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jan 15 20:56:37.330201 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.network.security_group_api [None req-7bbc095f-40b4-4e3d-b636-b3e17c7a13d5 tempest-SecurityGroupRulesTestJSON-83524440 tempest-SecurityGroupRulesTestJSON-83524440-project] Neutron security group fe5fc437-14c8-454d-bee7-3fb5fd68009a not found {{(pid=129366) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jan 15 20:56:37.330754 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-7bbc095f-40b4-4e3d-b636-b3e17c7a13d5 tempest-SecurityGroupRulesTestJSON-83524440 tempest-SecurityGroupRulesTestJSON-83524440-project] HTTP exception thrown: Security group fe5fc437-14c8-454d-bee7-3fb5fd68009a does not exist Jan 15 20:56:37.330754 ncdv-master-1 devstack@n-api.service[129366]: Neutron server returns request_ids: ['req-b05cec69-0f22-4b22-82c5-470c2f9bf663'] Jan 15 20:56:37.331339 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7bbc095f-40b4-4e3d-b636-b3e17c7a13d5 tempest-SecurityGroupRulesTestJSON-83524440 tempest-SecurityGroupRulesTestJSON-83524440-project] Returning 404 to user: Security group fe5fc437-14c8-454d-bee7-3fb5fd68009a does not exist Jan 15 20:56:37.331339 ncdv-master-1 devstack@n-api.service[129366]: Neutron server returns request_ids: ['req-b05cec69-0f22-4b22-82c5-470c2f9bf663'] {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:56:37.331805 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-93fe7687-7df3-41d6-afa9-982742f6010c tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] 10.222.0.46 "GET /compute/v2.1/servers/beffc13d-acd3-455e-96d6-be4bcbb81b88" status: 200 len: 1467 microversion: 2.1 time: 0.454612 Jan 15 20:56:37.332151 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7bbc095f-40b4-4e3d-b636-b3e17c7a13d5 tempest-SecurityGroupRulesTestJSON-83524440 tempest-SecurityGroupRulesTestJSON-83524440-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/fe5fc437-14c8-454d-bee7-3fb5fd68009a" status: 404 len: 194 microversion: 2.1 time: 0.041387 Jan 15 20:56:37.332762 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1142/2350] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:36 2022] GET /compute/v2.1/servers/beffc13d-acd3-455e-96d6-be4bcbb81b88 => generated 1467 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:37.337567 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-dfada738-b0a0-427a-8010-8c742920dcfc tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:37.337793 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1209/2351] 10.222.0.46 () {58 vars in 1271 bytes} [Sat Jan 15 20:56:37 2022] DELETE /compute/v2.1/os-security-groups/fe5fc437-14c8-454d-bee7-3fb5fd68009a => generated 194 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:56:37.338614 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-dfada738-b0a0-427a-8010-8c742920dcfc tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] [instance: 137421ba-6834-4e42-8221-9b5de84419cc] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:37.346730 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dfada738-b0a0-427a-8010-8c742920dcfc tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:37.347091 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-747bb63c-03a4-461d-a651-4dcfa566aa9b req-1d319858-208a-4aec-a2dd-e22d6577b8f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffb8267e-acd5-4c23-807a-07e0b02204a0", "name": "network-vif-plugged", "status": "completed", "tag": "d491075b-3ac1-4e95-a3ad-e9a004d6530d"}, {"server_uuid": "ffb8267e-acd5-4c23-807a-07e0b02204a0", "name": "network-vif-plugged", "status": "completed", "tag": "ea9ece42-4caf-4596-9d6a-f5ebd3e979e9"}, {"server_uuid": "bffd829f-bc6e-40a7-a9d8-59af77e5b10d", "name": "network-vif-plugged", "status": "completed", "tag": "8b8cea34-6f8d-4a83-aaae-cfea3dbff75c"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:37.347411 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dfada738-b0a0-427a-8010-8c742920dcfc tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:37.348209 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dfada738-b0a0-427a-8010-8c742920dcfc tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:37.348774 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dfada738-b0a0-427a-8010-8c742920dcfc tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:37.348973 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:56:37.348973 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:56:37.360095 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-747bb63c-03a4-461d-a651-4dcfa566aa9b req-1d319858-208a-4aec-a2dd-e22d6577b8f9 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:37.360537 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-747bb63c-03a4-461d-a651-4dcfa566aa9b req-1d319858-208a-4aec-a2dd-e22d6577b8f9 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:37.378436 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-747bb63c-03a4-461d-a651-4dcfa566aa9b req-1d319858-208a-4aec-a2dd-e22d6577b8f9 service nova] Creating event network-vif-plugged:d491075b-3ac1-4e95-a3ad-e9a004d6530d for instance ffb8267e-acd5-4c23-807a-07e0b02204a0 on nch2-master-1 Jan 15 20:56:37.379270 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-747bb63c-03a4-461d-a651-4dcfa566aa9b req-1d319858-208a-4aec-a2dd-e22d6577b8f9 service nova] Creating event network-vif-plugged:ea9ece42-4caf-4596-9d6a-f5ebd3e979e9 for instance ffb8267e-acd5-4c23-807a-07e0b02204a0 on nch2-master-1 Jan 15 20:56:37.380602 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-747bb63c-03a4-461d-a651-4dcfa566aa9b req-1d319858-208a-4aec-a2dd-e22d6577b8f9 service nova] Creating event network-vif-plugged:8b8cea34-6f8d-4a83-aaae-cfea3dbff75c for instance bffd829f-bc6e-40a7-a9d8-59af77e5b10d on nch2-master-1 Jan 15 20:56:37.389044 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-747bb63c-03a4-461d-a651-4dcfa566aa9b req-1d319858-208a-4aec-a2dd-e22d6577b8f9 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.048014 Jan 15 20:56:37.389911 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1210/2352] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:56:37 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:56:37.398641 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c7b5db83-9c7b-4c43-b834-0660325409de tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:37.399556 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c7b5db83-9c7b-4c43-b834-0660325409de tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] [instance: ffb8267e-acd5-4c23-807a-07e0b02204a0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:37.425848 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c7b5db83-9c7b-4c43-b834-0660325409de tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:37.426667 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c7b5db83-9c7b-4c43-b834-0660325409de tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:37.427730 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c7b5db83-9c7b-4c43-b834-0660325409de tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:37.428336 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c7b5db83-9c7b-4c43-b834-0660325409de tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:37.569923 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-dfada738-b0a0-427a-8010-8c742920dcfc tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ec114f8ece434aa496cd401494e2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a05b1a0a7479db84b762eca23b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:37.578573 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-dfada738-b0a0-427a-8010-8c742920dcfc tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] 10.222.0.46 "GET /compute/v2.1/servers/137421ba-6834-4e42-8221-9b5de84419cc" status: 200 len: 1504 microversion: 2.1 time: 0.244545 Jan 15 20:56:37.579233 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1143/2353] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:37 2022] GET /compute/v2.1/servers/137421ba-6834-4e42-8221-9b5de84419cc => generated 1504 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:37.593965 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e9d067d6-bb1a-4292-8589-5e396289eb7f tempest-SecurityGroupRulesTestJSON-83524440 tempest-SecurityGroupRulesTestJSON-83524440-project] Calling method '.version_select at 0x7f30c86e20d0>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:37.629666 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-c7b5db83-9c7b-4c43-b834-0660325409de tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f5490d676542fcb18b0dd5f5074516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc238c23f15041c583fd50a124461b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:37.638438 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c7b5db83-9c7b-4c43-b834-0660325409de tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] 10.222.0.46 "GET /compute/v2.1/servers/ffb8267e-acd5-4c23-807a-07e0b02204a0" status: 200 len: 1333 microversion: 2.1 time: 0.246952 Jan 15 20:56:37.645320 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1211/2354] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:37 2022] GET /compute/v2.1/servers/ffb8267e-acd5-4c23-807a-07e0b02204a0 => generated 1333 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:37.651900 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8dad81cd-c413-463a-88fb-35de74485aa7 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:37.652348 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-8dad81cd-c413-463a-88fb-35de74485aa7 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] [instance: bffd829f-bc6e-40a7-a9d8-59af77e5b10d] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:37.658835 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8dad81cd-c413-463a-88fb-35de74485aa7 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:37.659293 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8dad81cd-c413-463a-88fb-35de74485aa7 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:37.660098 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8dad81cd-c413-463a-88fb-35de74485aa7 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:37.660659 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8dad81cd-c413-463a-88fb-35de74485aa7 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:37.861592 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-8dad81cd-c413-463a-88fb-35de74485aa7 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52bd234a49b24c1a8bb60ad42c0db262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb6e08a94bc415fada171a2eca3e7ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:37.869941 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-8dad81cd-c413-463a-88fb-35de74485aa7 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] 10.222.0.46 "GET /compute/v2.1/servers/bffd829f-bc6e-40a7-a9d8-59af77e5b10d" status: 200 len: 1318 microversion: 2.1 time: 0.223000 Jan 15 20:56:37.878994 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e9d067d6-bb1a-4292-8589-5e396289eb7f tempest-SecurityGroupRulesTestJSON-83524440 tempest-SecurityGroupRulesTestJSON-83524440-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/5506200d-1401-4f0f-8080-c9f983e34010" status: 202 len: 0 microversion: 2.1 time: 0.289076 Jan 15 20:56:37.880724 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1144/2355] 10.222.0.46 () {58 vars in 1271 bytes} [Sat Jan 15 20:56:37 2022] DELETE /compute/v2.1/os-security-groups/5506200d-1401-4f0f-8080-c9f983e34010 => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 20:56:37.885543 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1212/2356] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:37 2022] GET /compute/v2.1/servers/bffd829f-bc6e-40a7-a9d8-59af77e5b10d => generated 1318 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:37.893190 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e6acf618-2d37-48e1-857e-d6fdcdd0e691 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:37.894889 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-bf7d6f51-c7f5-438e-a7f5-9c5b854cc5a0 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:37.895552 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-bf7d6f51-c7f5-438e-a7f5-9c5b854cc5a0 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: 0874eafa-ffa2-4257-b6c5-66e4bef983db] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:37.904236 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bf7d6f51-c7f5-438e-a7f5-9c5b854cc5a0 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:37.905161 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bf7d6f51-c7f5-438e-a7f5-9c5b854cc5a0 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:37.906169 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bf7d6f51-c7f5-438e-a7f5-9c5b854cc5a0 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:37.906601 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bf7d6f51-c7f5-438e-a7f5-9c5b854cc5a0 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:37.908390 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e6acf618-2d37-48e1-857e-d6fdcdd0e691 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] [instance: 62ae2a15-8c2c-4dad-971f-0611238103a3] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:37.916777 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e6acf618-2d37-48e1-857e-d6fdcdd0e691 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:37.917967 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e6acf618-2d37-48e1-857e-d6fdcdd0e691 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:37.919508 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e6acf618-2d37-48e1-857e-d6fdcdd0e691 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:37.920234 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e6acf618-2d37-48e1-857e-d6fdcdd0e691 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:38.059226 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-bf7d6f51-c7f5-438e-a7f5-9c5b854cc5a0 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:38.067525 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-bf7d6f51-c7f5-438e-a7f5-9c5b854cc5a0 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/0874eafa-ffa2-4257-b6c5-66e4bef983db" status: 200 len: 1507 microversion: 2.1 time: 0.185271 Jan 15 20:56:38.068091 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1145/2357] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:37 2022] GET /compute/v2.1/servers/0874eafa-ffa2-4257-b6c5-66e4bef983db => generated 1507 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:38.072273 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-095a21e2-f34e-4666-8de4-a22f245be809 tempest-SecurityGroupRulesTestJSON-83524440 tempest-SecurityGroupRulesTestJSON-83524440-project] Calling method '.version_select at 0x7f30c86e2160>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:38.256563 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-095a21e2-f34e-4666-8de4-a22f245be809 tempest-SecurityGroupRulesTestJSON-83524440 tempest-SecurityGroupRulesTestJSON-83524440-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/59112bc2-6784-4048-9d83-79fb7b503b23" status: 202 len: 0 microversion: 2.1 time: 0.187424 Jan 15 20:56:38.257198 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1146/2358] 10.222.0.46 () {58 vars in 1271 bytes} [Sat Jan 15 20:56:38 2022] DELETE /compute/v2.1/os-security-groups/59112bc2-6784-4048-9d83-79fb7b503b23 => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 20:56:38.262777 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-4b562c29-c562-4210-85d3-12ea375f8166 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:38.263743 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-4b562c29-c562-4210-85d3-12ea375f8166 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] [instance: 70bf65cf-55e2-459a-aaf1-c3eb851a6ccf] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:38.270013 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4b562c29-c562-4210-85d3-12ea375f8166 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:38.270463 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4b562c29-c562-4210-85d3-12ea375f8166 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:38.271249 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4b562c29-c562-4210-85d3-12ea375f8166 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:38.271687 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4b562c29-c562-4210-85d3-12ea375f8166 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:38.311075 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-4b562c29-c562-4210-85d3-12ea375f8166 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] 10.222.0.46 "POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action" status: 200 len: 14 microversion: 2.1 time: 0.052389 Jan 15 20:56:38.314393 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1147/2359] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:56:38 2022] POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action => generated 14 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 20:56:38.316369 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d168e3ad-8bb8-447a-af69-2c0d1a9e5137 tempest-SecurityGroupRulesTestJSON-83524440 tempest-SecurityGroupRulesTestJSON-83524440-project] Calling method '.version_select at 0x7f30c87efaf0>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:38.325862 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e6acf618-2d37-48e1-857e-d6fdcdd0e691 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] 10.222.0.46 "POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action" status: 200 len: 24567 microversion: 2.1 time: 0.437602 Jan 15 20:56:38.329773 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1213/2360] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:56:37 2022] POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action => generated 24567 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:56:38.333907 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0db07f61-55a4-458a-9054-325da925526e tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:38.334988 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-0db07f61-55a4-458a-9054-325da925526e tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] [instance: b1eb0bef-5aaf-46d6-8739-b12303df9842] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:38.343412 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0db07f61-55a4-458a-9054-325da925526e tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:38.343953 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0db07f61-55a4-458a-9054-325da925526e tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:38.345431 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0db07f61-55a4-458a-9054-325da925526e tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:38.345874 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0db07f61-55a4-458a-9054-325da925526e tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:38.392631 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0db07f61-55a4-458a-9054-325da925526e tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] 10.222.0.46 "POST /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842/action" status: 200 len: 32632 microversion: 2.1 time: 0.063859 Jan 15 20:56:38.394222 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1214/2361] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:56:38 2022] POST /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842/action => generated 32632 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:56:38.513107 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d168e3ad-8bb8-447a-af69-2c0d1a9e5137 tempest-SecurityGroupRulesTestJSON-83524440 tempest-SecurityGroupRulesTestJSON-83524440-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/06820719-fc20-4968-bfe7-58b4d04efa2b" status: 202 len: 0 microversion: 2.1 time: 0.200139 Jan 15 20:56:38.516585 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1148/2362] 10.222.0.46 () {58 vars in 1271 bytes} [Sat Jan 15 20:56:38 2022] DELETE /compute/v2.1/os-security-groups/06820719-fc20-4968-bfe7-58b4d04efa2b => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 20:56:38.522018 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e344ed59-99be-4949-8a53-66efb2aff5c4 tempest-SecurityGroupRulesTestJSON-83524440 tempest-SecurityGroupRulesTestJSON-83524440-project] Calling method '.version_select at 0x7f30cec90f70>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:38.596902 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-fc11fd8a-7e66-4b73-8791-8359b94eb92c tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:38.597994 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-fc11fd8a-7e66-4b73-8791-8359b94eb92c tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] [instance: 137421ba-6834-4e42-8221-9b5de84419cc] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:38.605621 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fc11fd8a-7e66-4b73-8791-8359b94eb92c tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:38.606461 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fc11fd8a-7e66-4b73-8791-8359b94eb92c tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:38.607269 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fc11fd8a-7e66-4b73-8791-8359b94eb92c tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:38.607764 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fc11fd8a-7e66-4b73-8791-8359b94eb92c tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:38.783873 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e344ed59-99be-4949-8a53-66efb2aff5c4 tempest-SecurityGroupRulesTestJSON-83524440 tempest-SecurityGroupRulesTestJSON-83524440-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/be83d225-eb87-4c97-b6a7-e4da68b51426" status: 202 len: 0 microversion: 2.1 time: 0.265696 Jan 15 20:56:38.784770 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1215/2363] 10.222.0.46 () {58 vars in 1271 bytes} [Sat Jan 15 20:56:38 2022] DELETE /compute/v2.1/os-security-groups/be83d225-eb87-4c97-b6a7-e4da68b51426 => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 20:56:38.789417 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1ded62d9-0a7f-4e59-ad04-bdd5e4572b09 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:38.790135 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-1ded62d9-0a7f-4e59-ad04-bdd5e4572b09 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] [instance: ffb8267e-acd5-4c23-807a-07e0b02204a0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:38.799186 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1ded62d9-0a7f-4e59-ad04-bdd5e4572b09 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:38.799928 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1ded62d9-0a7f-4e59-ad04-bdd5e4572b09 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:38.800721 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1ded62d9-0a7f-4e59-ad04-bdd5e4572b09 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:38.801190 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1ded62d9-0a7f-4e59-ad04-bdd5e4572b09 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:38.801315 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-fc11fd8a-7e66-4b73-8791-8359b94eb92c tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ec114f8ece434aa496cd401494e2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a05b1a0a7479db84b762eca23b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:38.813707 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-fc11fd8a-7e66-4b73-8791-8359b94eb92c tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] 10.222.0.46 "GET /compute/v2.1/servers/137421ba-6834-4e42-8221-9b5de84419cc" status: 200 len: 1504 microversion: 2.1 time: 0.221401 Jan 15 20:56:38.815130 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1149/2364] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:38 2022] GET /compute/v2.1/servers/137421ba-6834-4e42-8221-9b5de84419cc => generated 1504 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:56:38.820551 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a45f774e-a9be-4bca-b699-96efed3bece1 tempest-SecurityGroupRulesTestJSON-83524440 tempest-SecurityGroupRulesTestJSON-83524440-project] Calling method '.version_select at 0x7f30c87ef670>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:39.034404 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-1ded62d9-0a7f-4e59-ad04-bdd5e4572b09 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f5490d676542fcb18b0dd5f5074516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc238c23f15041c583fd50a124461b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:39.041882 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-1ded62d9-0a7f-4e59-ad04-bdd5e4572b09 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] 10.222.0.46 "GET /compute/v2.1/servers/ffb8267e-acd5-4c23-807a-07e0b02204a0" status: 200 len: 1333 microversion: 2.1 time: 0.256059 Jan 15 20:56:39.051632 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1216/2365] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:38 2022] GET /compute/v2.1/servers/ffb8267e-acd5-4c23-807a-07e0b02204a0 => generated 1333 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:39.057210 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1eebae22-0671-45a1-8e1d-64be3063c2bd tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:39.058578 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-1eebae22-0671-45a1-8e1d-64be3063c2bd tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] [instance: bffd829f-bc6e-40a7-a9d8-59af77e5b10d] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:39.065648 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1eebae22-0671-45a1-8e1d-64be3063c2bd tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:39.066390 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1eebae22-0671-45a1-8e1d-64be3063c2bd tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:39.067414 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1eebae22-0671-45a1-8e1d-64be3063c2bd tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:39.068099 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1eebae22-0671-45a1-8e1d-64be3063c2bd tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:39.138383 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a45f774e-a9be-4bca-b699-96efed3bece1 tempest-SecurityGroupRulesTestJSON-83524440 tempest-SecurityGroupRulesTestJSON-83524440-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/03685487-9294-4081-b017-d58b04305ea5" status: 202 len: 0 microversion: 2.1 time: 0.321965 Jan 15 20:56:39.138968 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1150/2366] 10.222.0.46 () {58 vars in 1271 bytes} [Sat Jan 15 20:56:38 2022] DELETE /compute/v2.1/os-security-groups/03685487-9294-4081-b017-d58b04305ea5 => generated 0 bytes in 323 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 20:56:39.146483 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-47312202-b1ef-4d9f-8a42-feb93ab7f08b tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:39.147244 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-47312202-b1ef-4d9f-8a42-feb93ab7f08b tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: 0874eafa-ffa2-4257-b6c5-66e4bef983db] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:39.157355 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-47312202-b1ef-4d9f-8a42-feb93ab7f08b tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:39.158143 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-47312202-b1ef-4d9f-8a42-feb93ab7f08b tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:39.159697 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-47312202-b1ef-4d9f-8a42-feb93ab7f08b tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:39.160509 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-47312202-b1ef-4d9f-8a42-feb93ab7f08b tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:39.369718 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-1eebae22-0671-45a1-8e1d-64be3063c2bd tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52bd234a49b24c1a8bb60ad42c0db262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb6e08a94bc415fada171a2eca3e7ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:39.387500 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-1eebae22-0671-45a1-8e1d-64be3063c2bd tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] 10.222.0.46 "GET /compute/v2.1/servers/bffd829f-bc6e-40a7-a9d8-59af77e5b10d" status: 200 len: 1318 microversion: 2.1 time: 0.334039 Jan 15 20:56:39.388588 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1217/2367] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:39 2022] GET /compute/v2.1/servers/bffd829f-bc6e-40a7-a9d8-59af77e5b10d => generated 1318 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:39.393651 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-dd8f8ebe-ba90-48e3-93e6-bfb976f95795 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:39.395012 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-dd8f8ebe-ba90-48e3-93e6-bfb976f95795 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] [instance: 70bf65cf-55e2-459a-aaf1-c3eb851a6ccf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:39.402866 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dd8f8ebe-ba90-48e3-93e6-bfb976f95795 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:39.403625 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dd8f8ebe-ba90-48e3-93e6-bfb976f95795 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:39.405033 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dd8f8ebe-ba90-48e3-93e6-bfb976f95795 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:39.405730 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dd8f8ebe-ba90-48e3-93e6-bfb976f95795 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:39.478409 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-47312202-b1ef-4d9f-8a42-feb93ab7f08b tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:39.483067 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-dd8f8ebe-ba90-48e3-93e6-bfb976f95795 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] 10.222.0.46 "POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action" status: 200 len: 14 microversion: 2.1 time: 0.092773 Jan 15 20:56:39.487950 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1218/2368] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:56:39 2022] POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action => generated 14 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 20:56:39.495191 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-47312202-b1ef-4d9f-8a42-feb93ab7f08b tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/0874eafa-ffa2-4257-b6c5-66e4bef983db" status: 200 len: 1507 microversion: 2.1 time: 0.355152 Jan 15 20:56:39.496230 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1151/2369] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:39 2022] GET /compute/v2.1/servers/0874eafa-ffa2-4257-b6c5-66e4bef983db => generated 1507 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:39.503725 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-289d571d-27f5-4951-b15f-068721bf154e tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:39.505220 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-289d571d-27f5-4951-b15f-068721bf154e tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] [instance: b1eb0bef-5aaf-46d6-8739-b12303df9842] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:39.505373 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-384a22a9-7085-44f8-abfb-3d708f6afe92 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:39.507391 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-384a22a9-7085-44f8-abfb-3d708f6afe92 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] [instance: 62ae2a15-8c2c-4dad-971f-0611238103a3] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:39.514638 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-289d571d-27f5-4951-b15f-068721bf154e tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:39.515715 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-289d571d-27f5-4951-b15f-068721bf154e tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:39.516811 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-289d571d-27f5-4951-b15f-068721bf154e tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:39.518307 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-289d571d-27f5-4951-b15f-068721bf154e tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:39.527550 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-384a22a9-7085-44f8-abfb-3d708f6afe92 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:39.531664 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-384a22a9-7085-44f8-abfb-3d708f6afe92 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:39.533294 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-384a22a9-7085-44f8-abfb-3d708f6afe92 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:39.536743 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-384a22a9-7085-44f8-abfb-3d708f6afe92 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:39.603730 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-289d571d-27f5-4951-b15f-068721bf154e tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] 10.222.0.46 "POST /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842/action" status: 200 len: 32632 microversion: 2.1 time: 0.105089 Jan 15 20:56:39.604441 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1152/2370] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:56:39 2022] POST /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842/action => generated 32632 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:56:39.607734 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-384a22a9-7085-44f8-abfb-3d708f6afe92 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] 10.222.0.46 "POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action" status: 200 len: 24567 microversion: 2.1 time: 0.113509 Jan 15 20:56:39.609568 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1219/2371] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:56:39 2022] POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action => generated 24567 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:56:39.836116 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-6ecc1a97-d3f9-4e69-9402-e5ca21a7efa3 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:39.837098 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-6ecc1a97-d3f9-4e69-9402-e5ca21a7efa3 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] [instance: 137421ba-6834-4e42-8221-9b5de84419cc] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:39.849225 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6ecc1a97-d3f9-4e69-9402-e5ca21a7efa3 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:39.849680 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6ecc1a97-d3f9-4e69-9402-e5ca21a7efa3 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:39.850669 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6ecc1a97-d3f9-4e69-9402-e5ca21a7efa3 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:39.851111 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6ecc1a97-d3f9-4e69-9402-e5ca21a7efa3 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:40.002329 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-6ecc1a97-d3f9-4e69-9402-e5ca21a7efa3 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ec114f8ece434aa496cd401494e2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a05b1a0a7479db84b762eca23b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:40.011534 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-6ecc1a97-d3f9-4e69-9402-e5ca21a7efa3 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] 10.222.0.46 "GET /compute/v2.1/servers/137421ba-6834-4e42-8221-9b5de84419cc" status: 200 len: 1479 microversion: 2.1 time: 0.180132 Jan 15 20:56:40.012461 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1153/2372] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:39 2022] GET /compute/v2.1/servers/137421ba-6834-4e42-8221-9b5de84419cc => generated 1479 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:40.030888 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ec3735d3-39fa-45da-beb2-25ec2f656cef tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Calling method '.version_select at 0x7f30ceb7a5e0>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:40.032243 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-migrations:index": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:56:40.032243 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:56:40.033998 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ec3735d3-39fa-45da-beb2-25ec2f656cef tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:40.034453 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ec3735d3-39fa-45da-beb2-25ec2f656cef tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:40.043339 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ec3735d3-39fa-45da-beb2-25ec2f656cef tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] 10.222.0.46 "GET /compute/v2.1/os-migrations" status: 200 len: 785 microversion: 2.1 time: 0.017485 Jan 15 20:56:40.044191 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1220/2373] 10.222.0.46 () {58 vars in 1142 bytes} [Sat Jan 15 20:56:40 2022] GET /compute/v2.1/os-migrations => generated 785 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:56:40.057025 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-20856a6e-c115-409c-86d8-68c18151be71 tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:40.058648 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-20856a6e-c115-409c-86d8-68c18151be71 tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] [instance: 137421ba-6834-4e42-8221-9b5de84419cc] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:40.060210 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c41ad4c1-a3c7-45e4-a89f-ce36d07b69e4 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:40.061069 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c41ad4c1-a3c7-45e4-a89f-ce36d07b69e4 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] [instance: ffb8267e-acd5-4c23-807a-07e0b02204a0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:40.065288 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-20856a6e-c115-409c-86d8-68c18151be71 tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:40.066522 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-20856a6e-c115-409c-86d8-68c18151be71 tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:40.067490 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-20856a6e-c115-409c-86d8-68c18151be71 tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:40.068161 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-20856a6e-c115-409c-86d8-68c18151be71 tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:40.068603 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c41ad4c1-a3c7-45e4-a89f-ce36d07b69e4 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:40.069085 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c41ad4c1-a3c7-45e4-a89f-ce36d07b69e4 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:40.070096 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c41ad4c1-a3c7-45e4-a89f-ce36d07b69e4 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:40.070543 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c41ad4c1-a3c7-45e4-a89f-ce36d07b69e4 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:40.287846 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-c41ad4c1-a3c7-45e4-a89f-ce36d07b69e4 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f5490d676542fcb18b0dd5f5074516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc238c23f15041c583fd50a124461b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:40.300420 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c41ad4c1-a3c7-45e4-a89f-ce36d07b69e4 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] 10.222.0.46 "GET /compute/v2.1/servers/ffb8267e-acd5-4c23-807a-07e0b02204a0" status: 200 len: 1667 microversion: 2.1 time: 0.245231 Jan 15 20:56:40.301318 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-20856a6e-c115-409c-86d8-68c18151be71 tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/137421ba-6834-4e42-8221-9b5de84419cc" status: 200 len: 1630 microversion: 2.1 time: 0.248619 Jan 15 20:56:40.302568 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1154/2374] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:40 2022] GET /compute/v2.1/servers/137421ba-6834-4e42-8221-9b5de84419cc => generated 1630 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:40.309523 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1221/2375] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:40 2022] GET /compute/v2.1/servers/ffb8267e-acd5-4c23-807a-07e0b02204a0 => generated 1667 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:56:40.322939 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f41ee409-8b0b-466e-b5a9-534a823f931f tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:40.324670 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f41ee409-8b0b-466e-b5a9-534a823f931f tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] [instance: ffb8267e-acd5-4c23-807a-07e0b02204a0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:40.331249 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f41ee409-8b0b-466e-b5a9-534a823f931f tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:40.332148 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f41ee409-8b0b-466e-b5a9-534a823f931f tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:40.333131 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f41ee409-8b0b-466e-b5a9-534a823f931f tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:40.333638 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f41ee409-8b0b-466e-b5a9-534a823f931f tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:40.367232 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f41ee409-8b0b-466e-b5a9-534a823f931f tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] 10.222.0.46 "GET /compute/v2.1/servers/ffb8267e-acd5-4c23-807a-07e0b02204a0/ips" status: 200 len: 178 microversion: 2.1 time: 0.049914 Jan 15 20:56:40.368379 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1155/2376] 10.222.0.46 () {58 vars in 1247 bytes} [Sat Jan 15 20:56:40 2022] GET /compute/v2.1/servers/ffb8267e-acd5-4c23-807a-07e0b02204a0/ips => generated 178 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:56:40.382797 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-5a15ca96-1ecd-43b5-b4d9-79f113a5aff1 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:40.383525 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-5a15ca96-1ecd-43b5-b4d9-79f113a5aff1 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] [instance: ffb8267e-acd5-4c23-807a-07e0b02204a0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:40.393383 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5a15ca96-1ecd-43b5-b4d9-79f113a5aff1 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:40.393896 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5a15ca96-1ecd-43b5-b4d9-79f113a5aff1 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:40.394698 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5a15ca96-1ecd-43b5-b4d9-79f113a5aff1 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:40.395178 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5a15ca96-1ecd-43b5-b4d9-79f113a5aff1 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:40.404669 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-60236ad5-91a0-4622-99b7-d83c414e55f1 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:40.405590 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-60236ad5-91a0-4622-99b7-d83c414e55f1 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] [instance: bffd829f-bc6e-40a7-a9d8-59af77e5b10d] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:40.413948 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-60236ad5-91a0-4622-99b7-d83c414e55f1 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:40.415316 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-60236ad5-91a0-4622-99b7-d83c414e55f1 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:40.416374 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-60236ad5-91a0-4622-99b7-d83c414e55f1 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:40.417045 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-60236ad5-91a0-4622-99b7-d83c414e55f1 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:40.432210 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-5a15ca96-1ecd-43b5-b4d9-79f113a5aff1 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] [instance: ffb8267e-acd5-4c23-807a-07e0b02204a0] Going to try to terminate instance {{(pid=129366) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 20:56:40.527636 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-5a15ca96-1ecd-43b5-b4d9-79f113a5aff1 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] 10.222.0.46 "DELETE /compute/v2.1/servers/ffb8267e-acd5-4c23-807a-07e0b02204a0" status: 204 len: 0 microversion: 2.1 time: 0.147808 Jan 15 20:56:40.533114 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1222/2377] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 20:56:40 2022] DELETE /compute/v2.1/servers/ffb8267e-acd5-4c23-807a-07e0b02204a0 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 20:56:40.541443 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-90c5a1cb-2fc2-4c3a-a2c7-6a44582ea85b tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1405643326", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "networks": [{"uuid": "dd4402cd-4bc8-45f2-ad1b-283bdc21d905"}]}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:40.588486 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-60236ad5-91a0-4622-99b7-d83c414e55f1 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52bd234a49b24c1a8bb60ad42c0db262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb6e08a94bc415fada171a2eca3e7ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:40.602156 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-60236ad5-91a0-4622-99b7-d83c414e55f1 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] 10.222.0.46 "GET /compute/v2.1/servers/bffd829f-bc6e-40a7-a9d8-59af77e5b10d" status: 200 len: 1467 microversion: 2.1 time: 0.200005 Jan 15 20:56:40.603627 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1156/2378] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:40 2022] GET /compute/v2.1/servers/bffd829f-bc6e-40a7-a9d8-59af77e5b10d => generated 1467 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:56:40.609399 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-71f689e1-8558-435c-a387-739bd1ce0fa2 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:40.611110 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-71f689e1-8558-435c-a387-739bd1ce0fa2 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] [instance: 70bf65cf-55e2-459a-aaf1-c3eb851a6ccf] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:40.619372 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-71f689e1-8558-435c-a387-739bd1ce0fa2 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:40.620101 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-71f689e1-8558-435c-a387-739bd1ce0fa2 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:40.621685 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-71f689e1-8558-435c-a387-739bd1ce0fa2 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:40.622561 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-71f689e1-8558-435c-a387-739bd1ce0fa2 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:40.641031 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.network.neutron [None req-90c5a1cb-2fc2-4c3a-a2c7-6a44582ea85b tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] validate_networks() for [('dd4402cd-4bc8-45f2-ad1b-283bdc21d905', None, None, None, None, None)] {{(pid=129366) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 20:56:40.687024 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-71f689e1-8558-435c-a387-739bd1ce0fa2 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] 10.222.0.46 "POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action" status: 200 len: 14 microversion: 2.1 time: 0.081547 Jan 15 20:56:40.688064 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1157/2379] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:56:40 2022] POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action => generated 14 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 20:56:40.693684 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-850a8c23-e5df-4217-96ba-5f37b8806f53 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:40.694751 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-850a8c23-e5df-4217-96ba-5f37b8806f53 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: 0874eafa-ffa2-4257-b6c5-66e4bef983db] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:40.703932 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-850a8c23-e5df-4217-96ba-5f37b8806f53 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:40.704958 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-850a8c23-e5df-4217-96ba-5f37b8806f53 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:40.706214 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-850a8c23-e5df-4217-96ba-5f37b8806f53 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:40.707312 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-850a8c23-e5df-4217-96ba-5f37b8806f53 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:40.992672 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-850a8c23-e5df-4217-96ba-5f37b8806f53 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:41.002725 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-850a8c23-e5df-4217-96ba-5f37b8806f53 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/0874eafa-ffa2-4257-b6c5-66e4bef983db" status: 200 len: 1507 microversion: 2.1 time: 0.313386 Jan 15 20:56:41.013802 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1158/2380] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:40 2022] GET /compute/v2.1/servers/0874eafa-ffa2-4257-b6c5-66e4bef983db => generated 1507 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:41.018825 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-459d47a2-80f5-4b28-9bd8-1b14dba269ef tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:41.019432 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-459d47a2-80f5-4b28-9bd8-1b14dba269ef tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] [instance: ffb8267e-acd5-4c23-807a-07e0b02204a0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:41.026014 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-459d47a2-80f5-4b28-9bd8-1b14dba269ef tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:41.027690 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-459d47a2-80f5-4b28-9bd8-1b14dba269ef tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:41.028753 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-459d47a2-80f5-4b28-9bd8-1b14dba269ef tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:41.029301 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-459d47a2-80f5-4b28-9bd8-1b14dba269ef tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:41.215089 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-90c5a1cb-2fc2-4c3a-a2c7-6a44582ea85b tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Flavor limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 20:56:41.216162 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-90c5a1cb-2fc2-4c3a-a2c7-6a44582ea85b tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Image limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 20:56:41.216920 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-90c5a1cb-2fc2-4c3a-a2c7-6a44582ea85b tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Flavor pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 20:56:41.217339 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-90c5a1cb-2fc2-4c3a-a2c7-6a44582ea85b tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Image pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 20:56:41.219015 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-90c5a1cb-2fc2-4c3a-a2c7-6a44582ea85b tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 20:56:41.231524 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-90c5a1cb-2fc2-4c3a-a2c7-6a44582ea85b tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:41.231959 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-90c5a1cb-2fc2-4c3a-a2c7-6a44582ea85b tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:41.233125 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-90c5a1cb-2fc2-4c3a-a2c7-6a44582ea85b tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:41.233632 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-90c5a1cb-2fc2-4c3a-a2c7-6a44582ea85b tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:41.254620 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-90c5a1cb-2fc2-4c3a-a2c7-6a44582ea85b tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Getting quotas for project 385a05b1a0a7479db84b762eca23b55b. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:56:41.259007 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-459d47a2-80f5-4b28-9bd8-1b14dba269ef tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f5490d676542fcb18b0dd5f5074516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc238c23f15041c583fd50a124461b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:41.263229 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-90c5a1cb-2fc2-4c3a-a2c7-6a44582ea85b tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Getting quotas for user e2ec114f8ece434aa496cd401494e2e4 and project 385a05b1a0a7479db84b762eca23b55b. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:56:41.268498 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-459d47a2-80f5-4b28-9bd8-1b14dba269ef tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] 10.222.0.46 "GET /compute/v2.1/servers/ffb8267e-acd5-4c23-807a-07e0b02204a0" status: 200 len: 1673 microversion: 2.1 time: 0.253281 Jan 15 20:56:41.269742 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1159/2381] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:41 2022] GET /compute/v2.1/servers/ffb8267e-acd5-4c23-807a-07e0b02204a0 => generated 1673 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:41.274613 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-14789b7e-c2a0-4c01-bc20-23d90dfd416a tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:41.275855 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-14789b7e-c2a0-4c01-bc20-23d90dfd416a tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] [instance: b1eb0bef-5aaf-46d6-8739-b12303df9842] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:41.283449 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-14789b7e-c2a0-4c01-bc20-23d90dfd416a tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:41.284214 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-14789b7e-c2a0-4c01-bc20-23d90dfd416a tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:41.285298 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-14789b7e-c2a0-4c01-bc20-23d90dfd416a tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:41.285837 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-14789b7e-c2a0-4c01-bc20-23d90dfd416a tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:41.287971 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-90c5a1cb-2fc2-4c3a-a2c7-6a44582ea85b tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Going to run 1 instances... {{(pid=129366) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 20:56:41.297471 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-90c5a1cb-2fc2-4c3a-a2c7-6a44582ea85b tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] [instance: 84fe1922-dca1-4713-9ea1-bdd26b309ce6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 20:56:41.347318 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-14789b7e-c2a0-4c01-bc20-23d90dfd416a tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] 10.222.0.46 "POST /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842/action" status: 200 len: 32632 microversion: 2.1 time: 0.075981 Jan 15 20:56:41.348368 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1160/2382] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:56:41 2022] POST /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842/action => generated 32632 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:56:41.354445 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-90c5a1cb-2fc2-4c3a-a2c7-6a44582ea85b tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.819917 Jan 15 20:56:41.355686 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1223/2383] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 20:56:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 822 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 20:56:41.363568 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ca6b8ab3-bf19-4419-9817-d17aa22fb758 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-512376874"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:41.365044 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ca6b8ab3-bf19-4419-9817-d17aa22fb758 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] [instance: bffd829f-bc6e-40a7-a9d8-59af77e5b10d] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:41.372896 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ca6b8ab3-bf19-4419-9817-d17aa22fb758 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:41.373705 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ca6b8ab3-bf19-4419-9817-d17aa22fb758 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:41.374927 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ca6b8ab3-bf19-4419-9817-d17aa22fb758 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:41.375739 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ca6b8ab3-bf19-4419-9817-d17aa22fb758 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:41.383396 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-681de088-b9fb-4bd4-b19b-2092a59ca540 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:41.384495 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-681de088-b9fb-4bd4-b19b-2092a59ca540 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] [instance: 62ae2a15-8c2c-4dad-971f-0611238103a3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:41.400254 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-681de088-b9fb-4bd4-b19b-2092a59ca540 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:41.401204 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-681de088-b9fb-4bd4-b19b-2092a59ca540 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:41.404586 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-681de088-b9fb-4bd4-b19b-2092a59ca540 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:41.405327 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-681de088-b9fb-4bd4-b19b-2092a59ca540 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:41.469633 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-681de088-b9fb-4bd4-b19b-2092a59ca540 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] 10.222.0.46 "POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action" status: 200 len: 24567 microversion: 2.1 time: 0.119379 Jan 15 20:56:41.474529 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1161/2384] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:56:41 2022] POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action => generated 24567 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:56:41.484728 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-1c2a595f-59fb-4423-bd8f-6cb4f50247ca tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:41.485685 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-1c2a595f-59fb-4423-bd8f-6cb4f50247ca tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] [instance: 84fe1922-dca1-4713-9ea1-bdd26b309ce6] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:41.560790 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-1c2a595f-59fb-4423-bd8f-6cb4f50247ca tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ec114f8ece434aa496cd401494e2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a05b1a0a7479db84b762eca23b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:41.574315 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-1c2a595f-59fb-4423-bd8f-6cb4f50247ca tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] 10.222.0.46 "GET /compute/v2.1/servers/84fe1922-dca1-4713-9ea1-bdd26b309ce6" status: 200 len: 1211 microversion: 2.1 time: 0.096453 Jan 15 20:56:41.575714 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1162/2385] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:41 2022] GET /compute/v2.1/servers/84fe1922-dca1-4713-9ea1-bdd26b309ce6 => generated 1211 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:41.700730 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-318eded6-39f1-482a-a590-73176da04ab8 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:41.702038 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-318eded6-39f1-482a-a590-73176da04ab8 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] [instance: 70bf65cf-55e2-459a-aaf1-c3eb851a6ccf] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:41.717899 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-318eded6-39f1-482a-a590-73176da04ab8 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:41.718699 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-318eded6-39f1-482a-a590-73176da04ab8 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:41.720004 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-318eded6-39f1-482a-a590-73176da04ab8 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:41.720500 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-318eded6-39f1-482a-a590-73176da04ab8 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:41.759684 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ca6b8ab3-bf19-4419-9817-d17aa22fb758 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] 10.222.0.46 "POST /compute/v2.1/servers/bffd829f-bc6e-40a7-a9d8-59af77e5b10d/action" status: 202 len: 0 microversion: 2.1 time: 0.400704 Jan 15 20:56:41.762885 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1224/2386] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:56:41 2022] POST /compute/v2.1/servers/bffd829f-bc6e-40a7-a9d8-59af77e5b10d/action => generated 0 bytes in 406 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jan 15 20:56:41.774050 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-5ea907dd-9ff2-454e-bb9e-4afdccd0c5bb tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Calling method '.version_select at 0x7f30ceccf5e0>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:41.798584 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-318eded6-39f1-482a-a590-73176da04ab8 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] 10.222.0.46 "POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action" status: 200 len: 14 microversion: 2.1 time: 0.104487 Jan 15 20:56:41.805018 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1163/2387] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:56:41 2022] POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action => generated 14 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 15 20:56:41.833214 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-5ea907dd-9ff2-454e-bb9e-4afdccd0c5bb tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] 10.222.0.46 "GET /compute/v2.1/images/198bbbad-af58-4eb7-8548-fd851471e431" status: 200 len: 1452 microversion: 2.1 time: 0.063862 Jan 15 20:56:41.833820 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1225/2388] 10.222.0.46 () {58 vars in 1232 bytes} [Sat Jan 15 20:56:41 2022] GET /compute/v2.1/images/198bbbad-af58-4eb7-8548-fd851471e431 => generated 1452 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:42.023821 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-1b77c8d7-cb58-4a9f-a102-9b8b65bb5142 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:42.023821 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-1b77c8d7-cb58-4a9f-a102-9b8b65bb5142 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: 0874eafa-ffa2-4257-b6c5-66e4bef983db] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:42.032015 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1b77c8d7-cb58-4a9f-a102-9b8b65bb5142 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:42.032510 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1b77c8d7-cb58-4a9f-a102-9b8b65bb5142 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:42.033553 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1b77c8d7-cb58-4a9f-a102-9b8b65bb5142 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:42.034187 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1b77c8d7-cb58-4a9f-a102-9b8b65bb5142 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:42.218550 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-1b77c8d7-cb58-4a9f-a102-9b8b65bb5142 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:42.228373 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-1b77c8d7-cb58-4a9f-a102-9b8b65bb5142 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/0874eafa-ffa2-4257-b6c5-66e4bef983db" status: 200 len: 1507 microversion: 2.1 time: 0.210503 Jan 15 20:56:42.229503 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1164/2389] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:42 2022] GET /compute/v2.1/servers/0874eafa-ffa2-4257-b6c5-66e4bef983db => generated 1507 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:42.287096 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-49549403-60d7-4e77-ba28-af25f30905f4 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:42.287994 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-49549403-60d7-4e77-ba28-af25f30905f4 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] [instance: ffb8267e-acd5-4c23-807a-07e0b02204a0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:42.295602 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-49549403-60d7-4e77-ba28-af25f30905f4 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:42.296389 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-49549403-60d7-4e77-ba28-af25f30905f4 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:42.297746 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-49549403-60d7-4e77-ba28-af25f30905f4 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:42.298464 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-49549403-60d7-4e77-ba28-af25f30905f4 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:42.302757 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-efcde8f6-1245-4e4d-8a68-f15ac5b3b744 tempest-SecurityGroupRulesNegativeTestJSON-1725336859 tempest-SecurityGroupRulesNegativeTestJSON-1725336859-project] Action: 'create', calling method: .version_select at 0x7f30cec63ca0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1839541778", "description": "tempest-description-74080479"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:42.501995 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-49549403-60d7-4e77-ba28-af25f30905f4 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f5490d676542fcb18b0dd5f5074516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc238c23f15041c583fd50a124461b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:42.514106 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-49549403-60d7-4e77-ba28-af25f30905f4 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] 10.222.0.46 "GET /compute/v2.1/servers/ffb8267e-acd5-4c23-807a-07e0b02204a0" status: 200 len: 1673 microversion: 2.1 time: 0.230633 Jan 15 20:56:42.528815 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1165/2390] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:42 2022] GET /compute/v2.1/servers/ffb8267e-acd5-4c23-807a-07e0b02204a0 => generated 1673 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:56:42.537791 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e52d8a8b-e47f-4737-89cd-2a38889c1ae5 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:42.539031 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e52d8a8b-e47f-4737-89cd-2a38889c1ae5 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] [instance: b1eb0bef-5aaf-46d6-8739-b12303df9842] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:42.546890 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e52d8a8b-e47f-4737-89cd-2a38889c1ae5 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:42.547700 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e52d8a8b-e47f-4737-89cd-2a38889c1ae5 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:42.549147 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e52d8a8b-e47f-4737-89cd-2a38889c1ae5 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:42.549817 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e52d8a8b-e47f-4737-89cd-2a38889c1ae5 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:42.590216 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-efcde8f6-1245-4e4d-8a68-f15ac5b3b744 tempest-SecurityGroupRulesNegativeTestJSON-1725336859 tempest-SecurityGroupRulesNegativeTestJSON-1725336859-project] 10.222.0.46 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.424919 Jan 15 20:56:42.597941 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1226/2391] 10.222.0.46 () {60 vars in 1179 bytes} [Sat Jan 15 20:56:42 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 20:56:42.604459 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-2fafd3de-84af-49e1-810d-750518c36953 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:42.606524 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e52d8a8b-e47f-4737-89cd-2a38889c1ae5 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] 10.222.0.46 "POST /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842/action" status: 200 len: 32632 microversion: 2.1 time: 0.073538 Jan 15 20:56:42.607967 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1166/2392] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:56:42 2022] POST /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842/action => generated 32632 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:56:42.612711 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-2fafd3de-84af-49e1-810d-750518c36953 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] [instance: 62ae2a15-8c2c-4dad-971f-0611238103a3] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:42.618268 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-38a6265e-b2f3-4ada-ace0-cdf8933540dd tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:42.620173 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-38a6265e-b2f3-4ada-ace0-cdf8933540dd tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] [instance: 84fe1922-dca1-4713-9ea1-bdd26b309ce6] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:42.643600 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-38a6265e-b2f3-4ada-ace0-cdf8933540dd tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:42.644282 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-38a6265e-b2f3-4ada-ace0-cdf8933540dd tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:42.645513 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-38a6265e-b2f3-4ada-ace0-cdf8933540dd tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:42.646906 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-38a6265e-b2f3-4ada-ace0-cdf8933540dd tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:42.654780 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2fafd3de-84af-49e1-810d-750518c36953 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:42.656235 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2fafd3de-84af-49e1-810d-750518c36953 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:42.657280 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2fafd3de-84af-49e1-810d-750518c36953 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:42.657912 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2fafd3de-84af-49e1-810d-750518c36953 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:42.705572 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-2fafd3de-84af-49e1-810d-750518c36953 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] 10.222.0.46 "POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action" status: 200 len: 24567 microversion: 2.1 time: 0.105750 Jan 15 20:56:42.714972 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1227/2393] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:56:42 2022] POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action => generated 24567 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:56:42.721314 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f597a9fb-e2ea-4753-9224-5f28250fe060 tempest-SecurityGroupRulesNegativeTestJSON-1725336859 tempest-SecurityGroupRulesNegativeTestJSON-1725336859-project] Action: 'create', calling method: .version_select at 0x7f30cec63b80>, body: {"security_group_rule": {"parent_group_id": "d0876cf9-adf7-4b01-b424-49a031c66604", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:42.797644 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-38a6265e-b2f3-4ada-ace0-cdf8933540dd tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ec114f8ece434aa496cd401494e2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a05b1a0a7479db84b762eca23b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:42.830634 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-38a6265e-b2f3-4ada-ace0-cdf8933540dd tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] 10.222.0.46 "GET /compute/v2.1/servers/84fe1922-dca1-4713-9ea1-bdd26b309ce6" status: 200 len: 1281 microversion: 2.1 time: 0.218286 Jan 15 20:56:42.842875 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1167/2394] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:42 2022] GET /compute/v2.1/servers/84fe1922-dca1-4713-9ea1-bdd26b309ce6 => generated 1281 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:42.847676 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3cbd5f26-572e-4d11-956f-34788672bbdd tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:42.848870 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-3cbd5f26-572e-4d11-956f-34788672bbdd tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] [instance: 70bf65cf-55e2-459a-aaf1-c3eb851a6ccf] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:42.859208 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3cbd5f26-572e-4d11-956f-34788672bbdd tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:42.859987 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3cbd5f26-572e-4d11-956f-34788672bbdd tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:42.861298 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3cbd5f26-572e-4d11-956f-34788672bbdd tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:42.861939 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3cbd5f26-572e-4d11-956f-34788672bbdd tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:42.912564 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3cbd5f26-572e-4d11-956f-34788672bbdd tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] 10.222.0.46 "POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action" status: 200 len: 14 microversion: 2.1 time: 0.067796 Jan 15 20:56:42.914318 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1168/2395] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:56:42 2022] POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action => generated 14 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 20:56:42.929955 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-b1bef47c-5e0a-4aa8-9185-a19ff7f79bf2 req-f017c11c-af22-4542-9fa8-988038ef947c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffb8267e-acd5-4c23-807a-07e0b02204a0", "name": "network-vif-deleted", "tag": "d491075b-3ac1-4e95-a3ad-e9a004d6530d"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:42.935014 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:56:42.935014 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:56:42.952522 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-b1bef47c-5e0a-4aa8-9185-a19ff7f79bf2 req-f017c11c-af22-4542-9fa8-988038ef947c service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:42.953437 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-b1bef47c-5e0a-4aa8-9185-a19ff7f79bf2 req-f017c11c-af22-4542-9fa8-988038ef947c service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:42.968507 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-b1bef47c-5e0a-4aa8-9185-a19ff7f79bf2 req-f017c11c-af22-4542-9fa8-988038ef947c service nova] Creating event network-vif-deleted:d491075b-3ac1-4e95-a3ad-e9a004d6530d for instance ffb8267e-acd5-4c23-807a-07e0b02204a0 on nch2-master-1 Jan 15 20:56:42.975735 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-b1bef47c-5e0a-4aa8-9185-a19ff7f79bf2 req-f017c11c-af22-4542-9fa8-988038ef947c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058065 Jan 15 20:56:42.977110 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1169/2396] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:56:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:56:42.985710 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5ef74c8c-0cf7-447e-926e-92d61b6a48b2 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Calling method '.version_select at 0x7f30ceb9fee0>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:43.053828 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5ef74c8c-0cf7-447e-926e-92d61b6a48b2 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] 10.222.0.46 "GET /compute/v2.1/images/198bbbad-af58-4eb7-8548-fd851471e431" status: 200 len: 1452 microversion: 2.1 time: 0.074784 Jan 15 20:56:43.055074 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1170/2397] 10.222.0.46 () {58 vars in 1232 bytes} [Sat Jan 15 20:56:42 2022] GET /compute/v2.1/images/198bbbad-af58-4eb7-8548-fd851471e431 => generated 1452 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:43.221493 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f597a9fb-e2ea-4753-9224-5f28250fe060 tempest-SecurityGroupRulesNegativeTestJSON-1725336859 tempest-SecurityGroupRulesNegativeTestJSON-1725336859-project] 10.222.0.46 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.504567 Jan 15 20:56:43.229082 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1228/2398] 10.222.0.46 () {60 vars in 1194 bytes} [Sat Jan 15 20:56:42 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:56:43.237607 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3d636aba-9637-4aa9-bbe1-b43128165caf tempest-SecurityGroupRulesNegativeTestJSON-1725336859 tempest-SecurityGroupRulesNegativeTestJSON-1725336859-project] Action: 'create', calling method: .version_select at 0x7f30c8801af0>, body: {"security_group_rule": {"parent_group_id": "d0876cf9-adf7-4b01-b424-49a031c66604", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:43.246380 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-80ecbf53-fd27-45c2-8036-486972c5f5fb tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:43.247431 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-80ecbf53-fd27-45c2-8036-486972c5f5fb tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: 0874eafa-ffa2-4257-b6c5-66e4bef983db] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:43.255834 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-80ecbf53-fd27-45c2-8036-486972c5f5fb tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:43.256271 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-80ecbf53-fd27-45c2-8036-486972c5f5fb tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:43.257964 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-80ecbf53-fd27-45c2-8036-486972c5f5fb tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:43.258399 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-80ecbf53-fd27-45c2-8036-486972c5f5fb tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:43.325493 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-3d636aba-9637-4aa9-bbe1-b43128165caf tempest-SecurityGroupRulesNegativeTestJSON-1725336859 tempest-SecurityGroupRulesNegativeTestJSON-1725336859-project] HTTP exception thrown: This rule already exists in group d0876cf9-adf7-4b01-b424-49a031c66604 Jan 15 20:56:43.326126 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3d636aba-9637-4aa9-bbe1-b43128165caf tempest-SecurityGroupRulesNegativeTestJSON-1725336859 tempest-SecurityGroupRulesNegativeTestJSON-1725336859-project] Returning 400 to user: This rule already exists in group d0876cf9-adf7-4b01-b424-49a031c66604 {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:56:43.326997 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3d636aba-9637-4aa9-bbe1-b43128165caf tempest-SecurityGroupRulesNegativeTestJSON-1725336859 tempest-SecurityGroupRulesNegativeTestJSON-1725336859-project] 10.222.0.46 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.096160 Jan 15 20:56:43.327607 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1171/2399] 10.222.0.46 () {60 vars in 1194 bytes} [Sat Jan 15 20:56:43 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 99 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jan 15 20:56:43.336658 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-bd0f2a5f-ea9b-4543-befa-53ad63bf7c93 tempest-SecurityGroupRulesNegativeTestJSON-1725336859 tempest-SecurityGroupRulesNegativeTestJSON-1725336859-project] Calling method '.version_select at 0x7f30ceb6a9d0>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:43.648231 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-80ecbf53-fd27-45c2-8036-486972c5f5fb tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:43.657418 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-80ecbf53-fd27-45c2-8036-486972c5f5fb tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/0874eafa-ffa2-4257-b6c5-66e4bef983db" status: 200 len: 1507 microversion: 2.1 time: 0.415608 Jan 15 20:56:43.658868 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1229/2400] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:43 2022] GET /compute/v2.1/servers/0874eafa-ffa2-4257-b6c5-66e4bef983db => generated 1507 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:43.664139 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1cf9f31b-1a21-4921-b3d4-cb8977ae8f52 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:43.665073 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-1cf9f31b-1a21-4921-b3d4-cb8977ae8f52 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] [instance: ffb8267e-acd5-4c23-807a-07e0b02204a0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:43.677238 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1cf9f31b-1a21-4921-b3d4-cb8977ae8f52 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:43.677819 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1cf9f31b-1a21-4921-b3d4-cb8977ae8f52 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:43.679641 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1cf9f31b-1a21-4921-b3d4-cb8977ae8f52 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:43.680202 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1cf9f31b-1a21-4921-b3d4-cb8977ae8f52 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:43.719734 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1cf9f31b-1a21-4921-b3d4-cb8977ae8f52 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:43.720176 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1cf9f31b-1a21-4921-b3d4-cb8977ae8f52 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:43.720922 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.objects.instance [None req-1cf9f31b-1a21-4921-b3d4-cb8977ae8f52 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lazy-loading 'fault' on Instance uuid ffb8267e-acd5-4c23-807a-07e0b02204a0 {{(pid=129366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 20:56:43.776990 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-1cf9f31b-1a21-4921-b3d4-cb8977ae8f52 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f5490d676542fcb18b0dd5f5074516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc238c23f15041c583fd50a124461b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:43.781393 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-bd0f2a5f-ea9b-4543-befa-53ad63bf7c93 tempest-SecurityGroupRulesNegativeTestJSON-1725336859 tempest-SecurityGroupRulesNegativeTestJSON-1725336859-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-group-rules/6841f5b2-09f6-4daa-82d0-8c9ede000ee6" status: 202 len: 0 microversion: 2.1 time: 0.448396 Jan 15 20:56:43.782201 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1172/2401] 10.222.0.46 () {58 vars in 1286 bytes} [Sat Jan 15 20:56:43 2022] DELETE /compute/v2.1/os-security-group-rules/6841f5b2-09f6-4daa-82d0-8c9ede000ee6 => generated 0 bytes in 450 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 15 20:56:43.785516 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-1cf9f31b-1a21-4921-b3d4-cb8977ae8f52 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] 10.222.0.46 "GET /compute/v2.1/servers/ffb8267e-acd5-4c23-807a-07e0b02204a0" status: 200 len: 1302 microversion: 2.1 time: 0.124943 Jan 15 20:56:43.786691 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1230/2402] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:43 2022] GET /compute/v2.1/servers/ffb8267e-acd5-4c23-807a-07e0b02204a0 => generated 1302 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:43.791562 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-92608e34-bb6b-4802-afb7-a712589ea134 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:43.793814 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-92608e34-bb6b-4802-afb7-a712589ea134 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] [instance: b1eb0bef-5aaf-46d6-8739-b12303df9842] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:43.802209 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-92608e34-bb6b-4802-afb7-a712589ea134 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:43.802895 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e0b3c224-001e-447b-82b6-87ea54faf2a4 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:43.803890 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-92608e34-bb6b-4802-afb7-a712589ea134 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:43.805036 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e0b3c224-001e-447b-82b6-87ea54faf2a4 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] [instance: 62ae2a15-8c2c-4dad-971f-0611238103a3] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:43.806151 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-92608e34-bb6b-4802-afb7-a712589ea134 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:43.808764 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-92608e34-bb6b-4802-afb7-a712589ea134 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:43.812186 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e0b3c224-001e-447b-82b6-87ea54faf2a4 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:43.812571 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e0b3c224-001e-447b-82b6-87ea54faf2a4 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:43.813404 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e0b3c224-001e-447b-82b6-87ea54faf2a4 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:43.814022 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e0b3c224-001e-447b-82b6-87ea54faf2a4 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:43.856533 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-92608e34-bb6b-4802-afb7-a712589ea134 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] 10.222.0.46 "POST /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842/action" status: 200 len: 32632 microversion: 2.1 time: 0.072490 Jan 15 20:56:43.857289 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1173/2403] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:56:43 2022] POST /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842/action => generated 32632 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:56:43.865419 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e0b3c224-001e-447b-82b6-87ea54faf2a4 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] 10.222.0.46 "POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action" status: 200 len: 24567 microversion: 2.1 time: 0.076615 Jan 15 20:56:43.866081 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1231/2404] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:56:43 2022] POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action => generated 24567 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:56:43.866738 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c1b37042-2d6f-494f-8c1d-755ce18845d9 tempest-SecurityGroupRulesNegativeTestJSON-1725336859 tempest-SecurityGroupRulesNegativeTestJSON-1725336859-project] Action: 'create', calling method: .version_select at 0x7f30c87ef310>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1246435200", "description": "tempest-description-652102111"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:43.871549 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9306fba1-9b48-4e11-9262-373e3a63497b tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:43.872463 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-9306fba1-9b48-4e11-9262-373e3a63497b tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] [instance: 84fe1922-dca1-4713-9ea1-bdd26b309ce6] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:43.881286 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9306fba1-9b48-4e11-9262-373e3a63497b tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:43.881999 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9306fba1-9b48-4e11-9262-373e3a63497b tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:43.882792 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9306fba1-9b48-4e11-9262-373e3a63497b tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:43.883325 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9306fba1-9b48-4e11-9262-373e3a63497b tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:44.177498 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-9306fba1-9b48-4e11-9262-373e3a63497b tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ec114f8ece434aa496cd401494e2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a05b1a0a7479db84b762eca23b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:44.186711 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-9306fba1-9b48-4e11-9262-373e3a63497b tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] 10.222.0.46 "GET /compute/v2.1/servers/84fe1922-dca1-4713-9ea1-bdd26b309ce6" status: 200 len: 1311 microversion: 2.1 time: 0.318941 Jan 15 20:56:44.187416 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1232/2405] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:43 2022] GET /compute/v2.1/servers/84fe1922-dca1-4713-9ea1-bdd26b309ce6 => generated 1311 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:44.192198 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c326ca97-ad2b-445c-ab70-b60d234f6742 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:44.193134 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c326ca97-ad2b-445c-ab70-b60d234f6742 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] [instance: 70bf65cf-55e2-459a-aaf1-c3eb851a6ccf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:44.199546 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c326ca97-ad2b-445c-ab70-b60d234f6742 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:44.200244 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c326ca97-ad2b-445c-ab70-b60d234f6742 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:44.201153 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c326ca97-ad2b-445c-ab70-b60d234f6742 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:44.201601 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c326ca97-ad2b-445c-ab70-b60d234f6742 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:44.247189 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c326ca97-ad2b-445c-ab70-b60d234f6742 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] 10.222.0.46 "POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action" status: 200 len: 14 microversion: 2.1 time: 0.057893 Jan 15 20:56:44.250775 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1233/2406] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:56:44 2022] POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action => generated 14 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 20:56:44.254086 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-31a49c00-6243-4600-8cbe-05986b39f8de tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Calling method '.version_select at 0x7f30cece5f70>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:44.263382 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c1b37042-2d6f-494f-8c1d-755ce18845d9 tempest-SecurityGroupRulesNegativeTestJSON-1725336859 tempest-SecurityGroupRulesNegativeTestJSON-1725336859-project] 10.222.0.46 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.404154 Jan 15 20:56:44.263944 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1174/2407] 10.222.0.46 () {60 vars in 1179 bytes} [Sat Jan 15 20:56:43 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:56:44.274342 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-4a1ce9f4-e391-40fd-a68f-0ad7c0b549ec tempest-SecurityGroupRulesNegativeTestJSON-1725336859 tempest-SecurityGroupRulesNegativeTestJSON-1725336859-project] Action: 'create', calling method: .version_select at 0x7f30c87efca0>, body: {"security_group_rule": {"parent_group_id": "c94a5950-fa2c-4b4b-8e37-1edf8945cf7c", "ip_protocol": "tcp", "from_port": 990912114, "to_port": 22}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:44.301896 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-31a49c00-6243-4600-8cbe-05986b39f8de tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] 10.222.0.46 "GET /compute/v2.1/images/198bbbad-af58-4eb7-8548-fd851471e431" status: 200 len: 1452 microversion: 2.1 time: 0.052378 Jan 15 20:56:44.302460 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1234/2408] 10.222.0.46 () {58 vars in 1232 bytes} [Sat Jan 15 20:56:44 2022] GET /compute/v2.1/images/198bbbad-af58-4eb7-8548-fd851471e431 => generated 1452 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:44.414934 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-4a1ce9f4-e391-40fd-a68f-0ad7c0b549ec tempest-SecurityGroupRulesNegativeTestJSON-1725336859 tempest-SecurityGroupRulesNegativeTestJSON-1725336859-project] HTTP exception thrown: Invalid port range 990912114:22. Former value cannot be greater than the later Jan 15 20:56:44.415562 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-4a1ce9f4-e391-40fd-a68f-0ad7c0b549ec tempest-SecurityGroupRulesNegativeTestJSON-1725336859 tempest-SecurityGroupRulesNegativeTestJSON-1725336859-project] Returning 400 to user: Invalid port range 990912114:22. Former value cannot be greater than the later {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:56:44.418006 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-4a1ce9f4-e391-40fd-a68f-0ad7c0b549ec tempest-SecurityGroupRulesNegativeTestJSON-1725336859 tempest-SecurityGroupRulesNegativeTestJSON-1725336859-project] 10.222.0.46 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 122 microversion: 2.1 time: 0.146337 Jan 15 20:56:44.419232 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1175/2409] 10.222.0.46 () {60 vars in 1194 bytes} [Sat Jan 15 20:56:44 2022] POST /compute/v2.1/os-security-group-rules => generated 122 bytes in 150 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jan 15 20:56:44.429850 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-60887c88-1167-4b68-aa31-496183801876 tempest-SecurityGroupRulesNegativeTestJSON-1725336859 tempest-SecurityGroupRulesNegativeTestJSON-1725336859-project] Action: 'create', calling method: .version_select at 0x7f30ceca2790>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-460907150", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:44.433604 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-60887c88-1167-4b68-aa31-496183801876 tempest-SecurityGroupRulesNegativeTestJSON-1725336859 tempest-SecurityGroupRulesNegativeTestJSON-1725336859-project] HTTP exception thrown: Security group id should be uuid Jan 15 20:56:44.434385 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-60887c88-1167-4b68-aa31-496183801876 tempest-SecurityGroupRulesNegativeTestJSON-1725336859 tempest-SecurityGroupRulesNegativeTestJSON-1725336859-project] Returning 400 to user: Security group id should be uuid {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:56:44.435721 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-60887c88-1167-4b68-aa31-496183801876 tempest-SecurityGroupRulesNegativeTestJSON-1725336859 tempest-SecurityGroupRulesNegativeTestJSON-1725336859-project] 10.222.0.46 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.010814 Jan 15 20:56:44.436709 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1235/2410] 10.222.0.46 () {60 vars in 1194 bytes} [Sat Jan 15 20:56:44 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jan 15 20:56:44.446217 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-270f98f3-c828-49dc-a648-c62f4098dda4 tempest-SecurityGroupRulesNegativeTestJSON-1725336859 tempest-SecurityGroupRulesNegativeTestJSON-1725336859-project] Action: 'create', calling method: .version_select at 0x7f30ceb9fee0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-38830133", "description": "tempest-description-338983548"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:44.678135 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e231dec3-5ef6-46c2-b5fe-c0fdcc73c91e tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:44.679030 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e231dec3-5ef6-46c2-b5fe-c0fdcc73c91e tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: 0874eafa-ffa2-4257-b6c5-66e4bef983db] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:44.687205 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e231dec3-5ef6-46c2-b5fe-c0fdcc73c91e tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:44.687699 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e231dec3-5ef6-46c2-b5fe-c0fdcc73c91e tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:44.688661 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e231dec3-5ef6-46c2-b5fe-c0fdcc73c91e tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:44.689274 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e231dec3-5ef6-46c2-b5fe-c0fdcc73c91e tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:44.781512 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-270f98f3-c828-49dc-a648-c62f4098dda4 tempest-SecurityGroupRulesNegativeTestJSON-1725336859 tempest-SecurityGroupRulesNegativeTestJSON-1725336859-project] 10.222.0.46 "POST /compute/v2.1/os-security-groups" status: 200 len: 253 microversion: 2.1 time: 0.339165 Jan 15 20:56:44.782682 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1176/2411] 10.222.0.46 () {60 vars in 1179 bytes} [Sat Jan 15 20:56:44 2022] POST /compute/v2.1/os-security-groups => generated 253 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 20:56:44.794516 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-63cc38d7-6f7f-4a6a-8054-05bac8eb5db3 tempest-SecurityGroupRulesNegativeTestJSON-1725336859 tempest-SecurityGroupRulesNegativeTestJSON-1725336859-project] Action: 'create', calling method: .version_select at 0x7f30c87e9d30>, body: {"security_group_rule": {"parent_group_id": "0a12c847-58f2-4d3f-8ad2-22ca2e97cff1", "ip_protocol": "tempest-999-105375825", "from_port": 22, "to_port": 22}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:44.908913 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-63cc38d7-6f7f-4a6a-8054-05bac8eb5db3 tempest-SecurityGroupRulesNegativeTestJSON-1725336859 tempest-SecurityGroupRulesNegativeTestJSON-1725336859-project] HTTP exception thrown: Invalid IP protocol tempest-999-105375825. Jan 15 20:56:44.910202 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-63cc38d7-6f7f-4a6a-8054-05bac8eb5db3 tempest-SecurityGroupRulesNegativeTestJSON-1725336859 tempest-SecurityGroupRulesNegativeTestJSON-1725336859-project] Returning 400 to user: Invalid IP protocol tempest-999-105375825. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:56:44.911319 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-63cc38d7-6f7f-4a6a-8054-05bac8eb5db3 tempest-SecurityGroupRulesNegativeTestJSON-1725336859 tempest-SecurityGroupRulesNegativeTestJSON-1725336859-project] 10.222.0.46 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 86 microversion: 2.1 time: 0.121339 Jan 15 20:56:44.912247 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1177/2412] 10.222.0.46 () {60 vars in 1194 bytes} [Sat Jan 15 20:56:44 2022] POST /compute/v2.1/os-security-group-rules => generated 86 bytes in 123 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jan 15 20:56:44.916934 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3c5ac6ed-1c17-4096-87a9-92c3f4b4ccb5 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:44.918124 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-3c5ac6ed-1c17-4096-87a9-92c3f4b4ccb5 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] [instance: ffb8267e-acd5-4c23-807a-07e0b02204a0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:44.926109 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3c5ac6ed-1c17-4096-87a9-92c3f4b4ccb5 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:44.926823 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3c5ac6ed-1c17-4096-87a9-92c3f4b4ccb5 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:44.927780 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3c5ac6ed-1c17-4096-87a9-92c3f4b4ccb5 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:44.928266 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3c5ac6ed-1c17-4096-87a9-92c3f4b4ccb5 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:44.943830 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-3c5ac6ed-1c17-4096-87a9-92c3f4b4ccb5 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] HTTP exception thrown: Instance ffb8267e-acd5-4c23-807a-07e0b02204a0 could not be found. Jan 15 20:56:44.944580 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3c5ac6ed-1c17-4096-87a9-92c3f4b4ccb5 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Returning 404 to user: Instance ffb8267e-acd5-4c23-807a-07e0b02204a0 could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:56:44.945703 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3c5ac6ed-1c17-4096-87a9-92c3f4b4ccb5 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] 10.222.0.46 "GET /compute/v2.1/servers/ffb8267e-acd5-4c23-807a-07e0b02204a0" status: 404 len: 111 microversion: 2.1 time: 0.032199 Jan 15 20:56:44.946437 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1178/2413] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:44 2022] GET /compute/v2.1/servers/ffb8267e-acd5-4c23-807a-07e0b02204a0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:56:44.953850 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-dca3eb72-0688-414c-b6d6-c4f3cd060a87 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:44.955352 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-dca3eb72-0688-414c-b6d6-c4f3cd060a87 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] [instance: b1eb0bef-5aaf-46d6-8739-b12303df9842] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:44.963142 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dca3eb72-0688-414c-b6d6-c4f3cd060a87 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:44.963866 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dca3eb72-0688-414c-b6d6-c4f3cd060a87 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:44.965669 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dca3eb72-0688-414c-b6d6-c4f3cd060a87 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:44.966225 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dca3eb72-0688-414c-b6d6-c4f3cd060a87 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:45.027674 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-dca3eb72-0688-414c-b6d6-c4f3cd060a87 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] 10.222.0.46 "POST /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842/action" status: 200 len: 32632 microversion: 2.1 time: 0.079907 Jan 15 20:56:45.028347 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1179/2414] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:56:44 2022] POST /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842/action => generated 32632 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:56:45.033679 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-e231dec3-5ef6-46c2-b5fe-c0fdcc73c91e tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:45.037670 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-62ea4b56-78a0-4eaa-b1e9-59ff2551ab9d tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:45.038818 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-62ea4b56-78a0-4eaa-b1e9-59ff2551ab9d tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] [instance: 62ae2a15-8c2c-4dad-971f-0611238103a3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:45.049371 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-62ea4b56-78a0-4eaa-b1e9-59ff2551ab9d tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:45.049788 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-62ea4b56-78a0-4eaa-b1e9-59ff2551ab9d tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:45.050589 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-62ea4b56-78a0-4eaa-b1e9-59ff2551ab9d tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:45.051057 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-62ea4b56-78a0-4eaa-b1e9-59ff2551ab9d tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:45.051923 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e231dec3-5ef6-46c2-b5fe-c0fdcc73c91e tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/0874eafa-ffa2-4257-b6c5-66e4bef983db" status: 200 len: 1507 microversion: 2.1 time: 0.378754 Jan 15 20:56:45.063933 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1236/2415] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:44 2022] GET /compute/v2.1/servers/0874eafa-ffa2-4257-b6c5-66e4bef983db => generated 1507 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:45.063933 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-cbdceaa0-7cfb-4405-8f00-8a3995991a14 tempest-SecurityGroupRulesNegativeTestJSON-1725336859 tempest-SecurityGroupRulesNegativeTestJSON-1725336859-project] Action: 'create', calling method: .version_select at 0x7f30cece5a60>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1872015904", "description": "tempest-description-1945134078"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:45.146316 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-62ea4b56-78a0-4eaa-b1e9-59ff2551ab9d tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] 10.222.0.46 "POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action" status: 200 len: 24567 microversion: 2.1 time: 0.116378 Jan 15 20:56:45.147642 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1180/2416] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:56:45 2022] POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action => generated 24567 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:56:45.154751 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-438faf67-a402-4e0e-a970-26d6d59265b9 req-4afeeac3-d201-41ef-b317-88b2d6b0d838 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffb8267e-acd5-4c23-807a-07e0b02204a0", "name": "network-vif-deleted", "tag": "ea9ece42-4caf-4596-9d6a-f5ebd3e979e9"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:45.157448 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:56:45.157448 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:56:45.168137 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-438faf67-a402-4e0e-a970-26d6d59265b9 req-4afeeac3-d201-41ef-b317-88b2d6b0d838 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:45.168508 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-438faf67-a402-4e0e-a970-26d6d59265b9 req-4afeeac3-d201-41ef-b317-88b2d6b0d838 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:45.185194 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-438faf67-a402-4e0e-a970-26d6d59265b9 req-4afeeac3-d201-41ef-b317-88b2d6b0d838 service nova] Creating event network-vif-deleted:ea9ece42-4caf-4596-9d6a-f5ebd3e979e9 for instance ffb8267e-acd5-4c23-807a-07e0b02204a0 on nch2-master-1 Jan 15 20:56:45.191159 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-438faf67-a402-4e0e-a970-26d6d59265b9 req-4afeeac3-d201-41ef-b317-88b2d6b0d838 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042112 Jan 15 20:56:45.192067 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1181/2417] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:56:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:56:45.197700 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-94be77f2-b524-4ae6-99f6-0e4e76e39ba0 req-38c8ff5f-4ee4-4975-9353-ff9cd9105b22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84fe1922-dca1-4713-9ea1-bdd26b309ce6", "tag": "4dd9a494-ab1e-4bde-892a-a7dc884ad0a1"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:45.200639 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:56:45.200639 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:56:45.220270 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-94be77f2-b524-4ae6-99f6-0e4e76e39ba0 req-38c8ff5f-4ee4-4975-9353-ff9cd9105b22 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:45.220749 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-94be77f2-b524-4ae6-99f6-0e4e76e39ba0 req-38c8ff5f-4ee4-4975-9353-ff9cd9105b22 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:45.235053 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-94be77f2-b524-4ae6-99f6-0e4e76e39ba0 req-38c8ff5f-4ee4-4975-9353-ff9cd9105b22 service nova] Creating event network-changed:4dd9a494-ab1e-4bde-892a-a7dc884ad0a1 for instance 84fe1922-dca1-4713-9ea1-bdd26b309ce6 on nch1-master-1 Jan 15 20:56:45.249790 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-94be77f2-b524-4ae6-99f6-0e4e76e39ba0 req-38c8ff5f-4ee4-4975-9353-ff9cd9105b22 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056276 Jan 15 20:56:45.250414 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1182/2418] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:56:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:56:45.259614 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-4e89152e-ef49-46e1-885c-77e718d3674f tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:45.260384 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-4e89152e-ef49-46e1-885c-77e718d3674f tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] [instance: 84fe1922-dca1-4713-9ea1-bdd26b309ce6] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:45.274264 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4e89152e-ef49-46e1-885c-77e718d3674f tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:45.274928 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4e89152e-ef49-46e1-885c-77e718d3674f tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:45.276056 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4e89152e-ef49-46e1-885c-77e718d3674f tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:45.276712 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4e89152e-ef49-46e1-885c-77e718d3674f tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:45.671685 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-cbdceaa0-7cfb-4405-8f00-8a3995991a14 tempest-SecurityGroupRulesNegativeTestJSON-1725336859 tempest-SecurityGroupRulesNegativeTestJSON-1725336859-project] 10.222.0.46 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.616675 Jan 15 20:56:45.678162 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1237/2419] 10.222.0.46 () {60 vars in 1179 bytes} [Sat Jan 15 20:56:45 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:56:45.678162 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-799f3d5c-5cd5-49b6-92ea-cf301c1b6e12 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:45.678162 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-799f3d5c-5cd5-49b6-92ea-cf301c1b6e12 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] [instance: 70bf65cf-55e2-459a-aaf1-c3eb851a6ccf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:45.693847 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-799f3d5c-5cd5-49b6-92ea-cf301c1b6e12 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:45.694581 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-799f3d5c-5cd5-49b6-92ea-cf301c1b6e12 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:45.695147 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-799f3d5c-5cd5-49b6-92ea-cf301c1b6e12 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:45.695614 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-799f3d5c-5cd5-49b6-92ea-cf301c1b6e12 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:45.789873 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-799f3d5c-5cd5-49b6-92ea-cf301c1b6e12 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] 10.222.0.46 "POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action" status: 200 len: 16399 microversion: 2.1 time: 0.114417 Jan 15 20:56:45.790683 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1238/2420] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:56:45 2022] POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action => generated 16399 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:56:45.812078 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-51b1ac1b-723c-4465-8f8a-d5d39789977a tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Calling method '.version_select at 0x7f30cece5a60>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:45.824449 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-4e89152e-ef49-46e1-885c-77e718d3674f tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ec114f8ece434aa496cd401494e2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a05b1a0a7479db84b762eca23b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:45.835441 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-4e89152e-ef49-46e1-885c-77e718d3674f tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] 10.222.0.46 "GET /compute/v2.1/servers/84fe1922-dca1-4713-9ea1-bdd26b309ce6" status: 200 len: 1311 microversion: 2.1 time: 0.583817 Jan 15 20:56:45.837138 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1183/2421] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:45 2022] GET /compute/v2.1/servers/84fe1922-dca1-4713-9ea1-bdd26b309ce6 => generated 1311 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:45.853159 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-721e59e8-ffa3-4412-82cd-20736334a5ff tempest-SecurityGroupRulesNegativeTestJSON-1725336859 tempest-SecurityGroupRulesNegativeTestJSON-1725336859-project] Action: 'create', calling method: .version_select at 0x7f30ceb320d0>, body: {"security_group_rule": {"parent_group_id": "5a3c338a-b9bd-436a-b13d-7e1a17780016", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:45.923002 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-51b1ac1b-723c-4465-8f8a-d5d39789977a tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] 10.222.0.46 "GET /compute/v2.1/images/198bbbad-af58-4eb7-8548-fd851471e431" status: 200 len: 1452 microversion: 2.1 time: 0.130031 Jan 15 20:56:45.924121 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1239/2422] 10.222.0.46 () {58 vars in 1232 bytes} [Sat Jan 15 20:56:45 2022] GET /compute/v2.1/images/198bbbad-af58-4eb7-8548-fd851471e431 => generated 1452 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:46.040038 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-346c06f4-e160-478c-a758-afbda013e525 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:46.041193 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-346c06f4-e160-478c-a758-afbda013e525 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] [instance: b1eb0bef-5aaf-46d6-8739-b12303df9842] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:46.059028 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-346c06f4-e160-478c-a758-afbda013e525 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:46.059619 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-346c06f4-e160-478c-a758-afbda013e525 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:46.060458 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-346c06f4-e160-478c-a758-afbda013e525 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:46.060919 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-346c06f4-e160-478c-a758-afbda013e525 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:46.156147 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-346c06f4-e160-478c-a758-afbda013e525 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] 10.222.0.46 "POST /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842/action" status: 200 len: 32632 microversion: 2.1 time: 0.119991 Jan 15 20:56:46.170040 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1240/2423] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:56:46 2022] POST /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842/action => generated 32632 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 20:56:46.175612 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ca8f6d1e-ce1f-4dc8-8a95-98cd19f430f9 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:46.176354 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ca8f6d1e-ce1f-4dc8-8a95-98cd19f430f9 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: 0874eafa-ffa2-4257-b6c5-66e4bef983db] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:46.189199 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ca8f6d1e-ce1f-4dc8-8a95-98cd19f430f9 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:46.189650 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ca8f6d1e-ce1f-4dc8-8a95-98cd19f430f9 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:46.191820 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ca8f6d1e-ce1f-4dc8-8a95-98cd19f430f9 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:46.199119 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ca8f6d1e-ce1f-4dc8-8a95-98cd19f430f9 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:46.575250 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-721e59e8-ffa3-4412-82cd-20736334a5ff tempest-SecurityGroupRulesNegativeTestJSON-1725336859 tempest-SecurityGroupRulesNegativeTestJSON-1725336859-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Jan 15 20:56:46.577253 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-721e59e8-ffa3-4412-82cd-20736334a5ff tempest-SecurityGroupRulesNegativeTestJSON-1725336859 tempest-SecurityGroupRulesNegativeTestJSON-1725336859-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:56:46.578380 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-721e59e8-ffa3-4412-82cd-20736334a5ff tempest-SecurityGroupRulesNegativeTestJSON-1725336859 tempest-SecurityGroupRulesNegativeTestJSON-1725336859-project] 10.222.0.46 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.740089 Jan 15 20:56:46.579730 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1184/2424] 10.222.0.46 () {60 vars in 1194 bytes} [Sat Jan 15 20:56:45 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 742 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 15 20:56:46.585886 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e70b42a7-8629-4914-87fd-906a4375cf5d tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:46.590112 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e70b42a7-8629-4914-87fd-906a4375cf5d tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] [instance: 62ae2a15-8c2c-4dad-971f-0611238103a3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:46.599157 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e70b42a7-8629-4914-87fd-906a4375cf5d tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:46.604792 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e70b42a7-8629-4914-87fd-906a4375cf5d tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:46.607358 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e70b42a7-8629-4914-87fd-906a4375cf5d tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:46.608929 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e70b42a7-8629-4914-87fd-906a4375cf5d tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:46.681362 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e70b42a7-8629-4914-87fd-906a4375cf5d tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] 10.222.0.46 "POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action" status: 200 len: 24567 microversion: 2.1 time: 0.094254 Jan 15 20:56:46.685068 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1185/2425] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:56:46 2022] POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action => generated 24567 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:56:46.699058 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-05be7227-e30d-4f7b-a0e8-91aaff2a857c tempest-SecurityGroupRulesNegativeTestJSON-1725336859 tempest-SecurityGroupRulesNegativeTestJSON-1725336859-project] Action: 'create', calling method: .version_select at 0x7f30ceb76160>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-2004381646", "description": "tempest-description-1872713923"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:46.704712 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-ca8f6d1e-ce1f-4dc8-8a95-98cd19f430f9 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:46.716005 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ca8f6d1e-ce1f-4dc8-8a95-98cd19f430f9 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/0874eafa-ffa2-4257-b6c5-66e4bef983db" status: 200 len: 1507 microversion: 2.1 time: 0.544475 Jan 15 20:56:46.716599 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1241/2426] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:46 2022] GET /compute/v2.1/servers/0874eafa-ffa2-4257-b6c5-66e4bef983db => generated 1507 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:46.802977 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e358b727-3056-4397-9c54-61c295249a01 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:46.804222 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e358b727-3056-4397-9c54-61c295249a01 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] [instance: 70bf65cf-55e2-459a-aaf1-c3eb851a6ccf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:46.821667 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e358b727-3056-4397-9c54-61c295249a01 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:46.822298 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e358b727-3056-4397-9c54-61c295249a01 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:46.823240 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e358b727-3056-4397-9c54-61c295249a01 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:46.826151 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e358b727-3056-4397-9c54-61c295249a01 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:46.893262 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e358b727-3056-4397-9c54-61c295249a01 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] 10.222.0.46 "POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action" status: 200 len: 16399 microversion: 2.1 time: 0.094465 Jan 15 20:56:46.897944 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1242/2427] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:56:46 2022] POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action => generated 16399 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:56:46.913530 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b268e09f-95f7-4e14-82ac-98ddcbc59657 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:46.915694 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b268e09f-95f7-4e14-82ac-98ddcbc59657 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] [instance: 84fe1922-dca1-4713-9ea1-bdd26b309ce6] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:46.927068 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b268e09f-95f7-4e14-82ac-98ddcbc59657 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:46.927907 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b268e09f-95f7-4e14-82ac-98ddcbc59657 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:46.929141 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b268e09f-95f7-4e14-82ac-98ddcbc59657 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:46.930298 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b268e09f-95f7-4e14-82ac-98ddcbc59657 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:47.506197 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-05be7227-e30d-4f7b-a0e8-91aaff2a857c tempest-SecurityGroupRulesNegativeTestJSON-1725336859 tempest-SecurityGroupRulesNegativeTestJSON-1725336859-project] 10.222.0.46 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.819075 Jan 15 20:56:47.515764 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1186/2428] 10.222.0.46 () {60 vars in 1179 bytes} [Sat Jan 15 20:56:46 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:56:47.525431 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-b268e09f-95f7-4e14-82ac-98ddcbc59657 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ec114f8ece434aa496cd401494e2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a05b1a0a7479db84b762eca23b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:47.525626 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e9873809-1029-4b98-b583-e5eaeb2a962b tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Calling method '.version_select at 0x7f30c86e28b0>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:47.549096 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b268e09f-95f7-4e14-82ac-98ddcbc59657 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] 10.222.0.46 "GET /compute/v2.1/servers/84fe1922-dca1-4713-9ea1-bdd26b309ce6" status: 200 len: 1311 microversion: 2.1 time: 0.649522 Jan 15 20:56:47.560168 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1243/2429] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:46 2022] GET /compute/v2.1/servers/84fe1922-dca1-4713-9ea1-bdd26b309ce6 => generated 1311 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:47.575464 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-cb70c4d5-5f52-48c9-87e1-9f5ab3208e74 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:47.579012 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-cb70c4d5-5f52-48c9-87e1-9f5ab3208e74 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] [instance: b1eb0bef-5aaf-46d6-8739-b12303df9842] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:47.606710 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cb70c4d5-5f52-48c9-87e1-9f5ab3208e74 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:47.611502 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cb70c4d5-5f52-48c9-87e1-9f5ab3208e74 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:47.614336 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cb70c4d5-5f52-48c9-87e1-9f5ab3208e74 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:47.620449 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cb70c4d5-5f52-48c9-87e1-9f5ab3208e74 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:47.629988 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e9873809-1029-4b98-b583-e5eaeb2a962b tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] 10.222.0.46 "GET /compute/v2.1/images/198bbbad-af58-4eb7-8548-fd851471e431" status: 200 len: 1452 microversion: 2.1 time: 0.111459 Jan 15 20:56:47.631343 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1187/2430] 10.222.0.46 () {58 vars in 1232 bytes} [Sat Jan 15 20:56:47 2022] GET /compute/v2.1/images/198bbbad-af58-4eb7-8548-fd851471e431 => generated 1452 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:47.650659 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-04f64d5d-15ad-413c-9fd7-0eb6e86e4f5a tempest-SecurityGroupRulesNegativeTestJSON-1725336859 tempest-SecurityGroupRulesNegativeTestJSON-1725336859-project] Action: 'create', calling method: .version_select at 0x7f30c86e2310>, body: {"security_group_rule": {"parent_group_id": "6df400d3-3c21-401e-bff2-e7a8a3b019c8", "ip_protocol": "tcp", "from_port": 22, "to_port": 559167322}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:47.714345 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-cb70c4d5-5f52-48c9-87e1-9f5ab3208e74 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] 10.222.0.46 "POST /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842/action" status: 200 len: 32632 microversion: 2.1 time: 0.152039 Jan 15 20:56:47.715843 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1244/2431] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:56:47 2022] POST /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842/action => generated 32632 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:56:47.725964 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-5bdaee8f-29a0-43d1-a803-00a48b3bf8db tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:47.734108 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-5bdaee8f-29a0-43d1-a803-00a48b3bf8db tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] [instance: 62ae2a15-8c2c-4dad-971f-0611238103a3] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:47.750924 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5bdaee8f-29a0-43d1-a803-00a48b3bf8db tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:47.755881 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5bdaee8f-29a0-43d1-a803-00a48b3bf8db tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:47.758708 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5bdaee8f-29a0-43d1-a803-00a48b3bf8db tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:47.761755 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5bdaee8f-29a0-43d1-a803-00a48b3bf8db tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:47.847819 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-04f64d5d-15ad-413c-9fd7-0eb6e86e4f5a tempest-SecurityGroupRulesNegativeTestJSON-1725336859 tempest-SecurityGroupRulesNegativeTestJSON-1725336859-project] HTTP exception thrown: Invalid port range 22:559167322. Valid TCP ports should be between 1-65535 Jan 15 20:56:47.848870 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-04f64d5d-15ad-413c-9fd7-0eb6e86e4f5a tempest-SecurityGroupRulesNegativeTestJSON-1725336859 tempest-SecurityGroupRulesNegativeTestJSON-1725336859-project] Returning 400 to user: Invalid port range 22:559167322. Valid TCP ports should be between 1-65535 {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:56:47.850812 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-04f64d5d-15ad-413c-9fd7-0eb6e86e4f5a tempest-SecurityGroupRulesNegativeTestJSON-1725336859 tempest-SecurityGroupRulesNegativeTestJSON-1725336859-project] 10.222.0.46 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 118 microversion: 2.1 time: 0.217748 Jan 15 20:56:47.857457 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-5bdaee8f-29a0-43d1-a803-00a48b3bf8db tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] 10.222.0.46 "POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action" status: 200 len: 24567 microversion: 2.1 time: 0.135973 Jan 15 20:56:47.857999 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1188/2432] 10.222.0.46 () {60 vars in 1194 bytes} [Sat Jan 15 20:56:47 2022] POST /compute/v2.1/os-security-group-rules => generated 118 bytes in 224 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 15 20:56:47.861657 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1245/2433] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:56:47 2022] POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action => generated 24567 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:56:47.874326 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d0f8aa10-27e3-4fa8-ac19-68208d03d269 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:47.876733 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-2474db9b-7568-4cb1-919a-4ca410a30712 tempest-SecurityGroupRulesNegativeTestJSON-1725336859 tempest-SecurityGroupRulesNegativeTestJSON-1725336859-project] Action: 'create', calling method: .version_select at 0x7f30cebd1820>, body: {"security_group_rule": {"parent_group_id": "227f83f2-5a05-456f-a424-3c4b1e62cd2b", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:47.877720 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d0f8aa10-27e3-4fa8-ac19-68208d03d269 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: 0874eafa-ffa2-4257-b6c5-66e4bef983db] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:47.898709 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d0f8aa10-27e3-4fa8-ac19-68208d03d269 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:47.899958 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d0f8aa10-27e3-4fa8-ac19-68208d03d269 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:47.901017 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d0f8aa10-27e3-4fa8-ac19-68208d03d269 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:47.902316 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d0f8aa10-27e3-4fa8-ac19-68208d03d269 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:48.011611 ncdv-master-1 devstack@n-api.service[129366]: DEBUG neutronclient.v2_0.client [None req-2474db9b-7568-4cb1-919a-4ca410a30712 tempest-SecurityGroupRulesNegativeTestJSON-1725336859 tempest-SecurityGroupRulesNegativeTestJSON-1725336859-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 227f83f2-5a05-456f-a424-3c4b1e62cd2b does not exist", "detail": ""}} {{(pid=129366) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jan 15 20:56:48.013361 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.network.security_group_api [None req-2474db9b-7568-4cb1-919a-4ca410a30712 tempest-SecurityGroupRulesNegativeTestJSON-1725336859 tempest-SecurityGroupRulesNegativeTestJSON-1725336859-project] Neutron security group 227f83f2-5a05-456f-a424-3c4b1e62cd2b not found {{(pid=129366) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jan 15 20:56:48.015878 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-2474db9b-7568-4cb1-919a-4ca410a30712 tempest-SecurityGroupRulesNegativeTestJSON-1725336859 tempest-SecurityGroupRulesNegativeTestJSON-1725336859-project] HTTP exception thrown: Security group 227f83f2-5a05-456f-a424-3c4b1e62cd2b does not exist Jan 15 20:56:48.015878 ncdv-master-1 devstack@n-api.service[129366]: Neutron server returns request_ids: ['req-aed8432f-50c1-4bc9-8a6b-2338170b06e9'] Jan 15 20:56:48.022922 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-2474db9b-7568-4cb1-919a-4ca410a30712 tempest-SecurityGroupRulesNegativeTestJSON-1725336859 tempest-SecurityGroupRulesNegativeTestJSON-1725336859-project] Returning 404 to user: Security group 227f83f2-5a05-456f-a424-3c4b1e62cd2b does not exist Jan 15 20:56:48.022922 ncdv-master-1 devstack@n-api.service[129366]: Neutron server returns request_ids: ['req-aed8432f-50c1-4bc9-8a6b-2338170b06e9'] {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:56:48.025499 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-2474db9b-7568-4cb1-919a-4ca410a30712 tempest-SecurityGroupRulesNegativeTestJSON-1725336859 tempest-SecurityGroupRulesNegativeTestJSON-1725336859-project] 10.222.0.46 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.160628 Jan 15 20:56:48.032060 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1246/2434] 10.222.0.46 () {60 vars in 1194 bytes} [Sat Jan 15 20:56:47 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 165 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:56:48.046223 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f8612bb3-9aea-41a4-b088-3e6d6e426470 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:48.052349 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f8612bb3-9aea-41a4-b088-3e6d6e426470 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] [instance: 70bf65cf-55e2-459a-aaf1-c3eb851a6ccf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:48.078678 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f8612bb3-9aea-41a4-b088-3e6d6e426470 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:48.079404 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f8612bb3-9aea-41a4-b088-3e6d6e426470 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:48.081357 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f8612bb3-9aea-41a4-b088-3e6d6e426470 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:48.083553 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f8612bb3-9aea-41a4-b088-3e6d6e426470 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:48.159572 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f8612bb3-9aea-41a4-b088-3e6d6e426470 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] 10.222.0.46 "POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action" status: 200 len: 16399 microversion: 2.1 time: 0.130200 Jan 15 20:56:48.163956 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1247/2435] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:56:48 2022] POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action => generated 16399 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:56:48.172557 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-5ac0daa3-c5fc-49ab-a08a-1dd42d466b7f req-129a658e-5068-4318-a47b-7aff48c1e6c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bffd829f-bc6e-40a7-a9d8-59af77e5b10d", "name": "network-vif-plugged", "status": "completed", "tag": "8b8cea34-6f8d-4a83-aaae-cfea3dbff75c"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:48.174487 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:56:48.174487 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:56:48.185887 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-5ac0daa3-c5fc-49ab-a08a-1dd42d466b7f req-129a658e-5068-4318-a47b-7aff48c1e6c1 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:48.186627 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-5ac0daa3-c5fc-49ab-a08a-1dd42d466b7f req-129a658e-5068-4318-a47b-7aff48c1e6c1 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:48.216812 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-5ac0daa3-c5fc-49ab-a08a-1dd42d466b7f req-129a658e-5068-4318-a47b-7aff48c1e6c1 service nova] Creating event network-vif-plugged:8b8cea34-6f8d-4a83-aaae-cfea3dbff75c for instance bffd829f-bc6e-40a7-a9d8-59af77e5b10d on nch2-master-1 Jan 15 20:56:48.231070 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-5ac0daa3-c5fc-49ab-a08a-1dd42d466b7f req-129a658e-5068-4318-a47b-7aff48c1e6c1 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063684 Jan 15 20:56:48.235189 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1248/2436] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:56:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:56:48.253185 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b1884048-0f7e-4dc5-9bef-3903c05c3428 tempest-SecurityGroupRulesNegativeTestJSON-1725336859 tempest-SecurityGroupRulesNegativeTestJSON-1725336859-project] Calling method '.version_select at 0x7f30c8e0b1f0>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:48.298829 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-d0f8aa10-27e3-4fa8-ac19-68208d03d269 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:48.306594 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d0f8aa10-27e3-4fa8-ac19-68208d03d269 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/0874eafa-ffa2-4257-b6c5-66e4bef983db" status: 200 len: 1507 microversion: 2.1 time: 0.447356 Jan 15 20:56:48.307165 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1189/2437] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:47 2022] GET /compute/v2.1/servers/0874eafa-ffa2-4257-b6c5-66e4bef983db => generated 1507 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:48.317849 ncdv-master-1 devstack@n-api.service[129366]: DEBUG neutronclient.v2_0.client [None req-b1884048-0f7e-4dc5-9bef-3903c05c3428 tempest-SecurityGroupRulesNegativeTestJSON-1725336859 tempest-SecurityGroupRulesNegativeTestJSON-1725336859-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 2fe7f101-276d-4cbb-88b5-d91bf9099423 does not exist", "detail": ""}} {{(pid=129366) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jan 15 20:56:48.318675 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.network.security_group_api [None req-b1884048-0f7e-4dc5-9bef-3903c05c3428 tempest-SecurityGroupRulesNegativeTestJSON-1725336859 tempest-SecurityGroupRulesNegativeTestJSON-1725336859-project] Neutron security group rule 2fe7f101-276d-4cbb-88b5-d91bf9099423 not found {{(pid=129366) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Jan 15 20:56:48.319383 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-b1884048-0f7e-4dc5-9bef-3903c05c3428 tempest-SecurityGroupRulesNegativeTestJSON-1725336859 tempest-SecurityGroupRulesNegativeTestJSON-1725336859-project] HTTP exception thrown: Security group rule 2fe7f101-276d-4cbb-88b5-d91bf9099423 does not exist Jan 15 20:56:48.319383 ncdv-master-1 devstack@n-api.service[129366]: Neutron server returns request_ids: ['req-6c1b3d35-aa4a-4646-8b84-93feb77dd2e2'] Jan 15 20:56:48.320227 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b1884048-0f7e-4dc5-9bef-3903c05c3428 tempest-SecurityGroupRulesNegativeTestJSON-1725336859 tempest-SecurityGroupRulesNegativeTestJSON-1725336859-project] Returning 404 to user: Security group rule 2fe7f101-276d-4cbb-88b5-d91bf9099423 does not exist Jan 15 20:56:48.320227 ncdv-master-1 devstack@n-api.service[129366]: Neutron server returns request_ids: ['req-6c1b3d35-aa4a-4646-8b84-93feb77dd2e2'] {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:56:48.321523 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b1884048-0f7e-4dc5-9bef-3903c05c3428 tempest-SecurityGroupRulesNegativeTestJSON-1725336859 tempest-SecurityGroupRulesNegativeTestJSON-1725336859-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-group-rules/2fe7f101-276d-4cbb-88b5-d91bf9099423" status: 404 len: 199 microversion: 2.1 time: 0.084900 Jan 15 20:56:48.322246 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1249/2438] 10.222.0.46 () {58 vars in 1286 bytes} [Sat Jan 15 20:56:48 2022] DELETE /compute/v2.1/os-security-group-rules/2fe7f101-276d-4cbb-88b5-d91bf9099423 => generated 199 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:56:48.331949 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-30e0e28d-a0cf-4966-9369-ef9d93ee7c7e tempest-SecurityGroupRulesNegativeTestJSON-1725336859 tempest-SecurityGroupRulesNegativeTestJSON-1725336859-project] Calling method '.version_select at 0x7f30ceb76d30>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:48.575713 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-79dae211-c4f0-47f0-a387-207419ecb10b tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:48.576611 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-79dae211-c4f0-47f0-a387-207419ecb10b tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] [instance: 84fe1922-dca1-4713-9ea1-bdd26b309ce6] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:48.587630 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-79dae211-c4f0-47f0-a387-207419ecb10b tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:48.590831 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-79dae211-c4f0-47f0-a387-207419ecb10b tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:48.594146 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-79dae211-c4f0-47f0-a387-207419ecb10b tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:48.594827 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-79dae211-c4f0-47f0-a387-207419ecb10b tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:48.660829 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-30e0e28d-a0cf-4966-9369-ef9d93ee7c7e tempest-SecurityGroupRulesNegativeTestJSON-1725336859 tempest-SecurityGroupRulesNegativeTestJSON-1725336859-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/6df400d3-3c21-401e-bff2-e7a8a3b019c8" status: 202 len: 0 microversion: 2.1 time: 0.332367 Jan 15 20:56:48.662240 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1190/2439] 10.222.0.46 () {58 vars in 1271 bytes} [Sat Jan 15 20:56:48 2022] DELETE /compute/v2.1/os-security-groups/6df400d3-3c21-401e-bff2-e7a8a3b019c8 => generated 0 bytes in 334 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 20:56:48.668452 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f70cbcdb-7fdd-4732-ae87-c003246641a1 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Calling method '.version_select at 0x7f30cebd2790>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:48.761693 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f70cbcdb-7fdd-4732-ae87-c003246641a1 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] 10.222.0.46 "GET /compute/v2.1/images/198bbbad-af58-4eb7-8548-fd851471e431" status: 200 len: 1452 microversion: 2.1 time: 0.097828 Jan 15 20:56:48.762333 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1191/2440] 10.222.0.46 () {58 vars in 1232 bytes} [Sat Jan 15 20:56:48 2022] GET /compute/v2.1/images/198bbbad-af58-4eb7-8548-fd851471e431 => generated 1452 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:48.775639 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a4ed6dd1-9ef0-4f0e-adf6-273a93f653d8 tempest-SecurityGroupRulesNegativeTestJSON-1725336859 tempest-SecurityGroupRulesNegativeTestJSON-1725336859-project] Calling method '.version_select at 0x7f30ceb32af0>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:49.047239 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-79dae211-c4f0-47f0-a387-207419ecb10b tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ec114f8ece434aa496cd401494e2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a05b1a0a7479db84b762eca23b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:49.057195 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-79dae211-c4f0-47f0-a387-207419ecb10b tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] 10.222.0.46 "GET /compute/v2.1/servers/84fe1922-dca1-4713-9ea1-bdd26b309ce6" status: 200 len: 1311 microversion: 2.1 time: 0.489648 Jan 15 20:56:49.071332 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1250/2441] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:48 2022] GET /compute/v2.1/servers/84fe1922-dca1-4713-9ea1-bdd26b309ce6 => generated 1311 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:49.087323 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-42867401-59ed-480b-910d-5f45294536b0 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:49.088361 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-42867401-59ed-480b-910d-5f45294536b0 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] [instance: b1eb0bef-5aaf-46d6-8739-b12303df9842] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:49.105188 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-42867401-59ed-480b-910d-5f45294536b0 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:49.105648 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-42867401-59ed-480b-910d-5f45294536b0 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:49.106469 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-42867401-59ed-480b-910d-5f45294536b0 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:49.106929 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-42867401-59ed-480b-910d-5f45294536b0 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:49.206191 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-42867401-59ed-480b-910d-5f45294536b0 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] 10.222.0.46 "POST /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842/action" status: 200 len: 32632 microversion: 2.1 time: 0.133359 Jan 15 20:56:49.210985 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1251/2442] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:56:49 2022] POST /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842/action => generated 32632 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:56:49.225414 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-cd8d782a-88ec-4fd6-ab50-e8526581fbe2 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:49.227665 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-cd8d782a-88ec-4fd6-ab50-e8526581fbe2 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] [instance: 62ae2a15-8c2c-4dad-971f-0611238103a3] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:49.248372 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a4ed6dd1-9ef0-4f0e-adf6-273a93f653d8 tempest-SecurityGroupRulesNegativeTestJSON-1725336859 tempest-SecurityGroupRulesNegativeTestJSON-1725336859-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/5a3c338a-b9bd-436a-b13d-7e1a17780016" status: 202 len: 0 microversion: 2.1 time: 0.484580 Jan 15 20:56:49.249659 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1192/2443] 10.222.0.46 () {58 vars in 1271 bytes} [Sat Jan 15 20:56:48 2022] DELETE /compute/v2.1/os-security-groups/5a3c338a-b9bd-436a-b13d-7e1a17780016 => generated 0 bytes in 486 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 20:56:49.255160 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f713440b-095c-42f0-81e5-2e5c2b9aaeb1 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:49.257466 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f713440b-095c-42f0-81e5-2e5c2b9aaeb1 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] [instance: 70bf65cf-55e2-459a-aaf1-c3eb851a6ccf] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:49.271468 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cd8d782a-88ec-4fd6-ab50-e8526581fbe2 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:49.272278 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cd8d782a-88ec-4fd6-ab50-e8526581fbe2 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:49.273732 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cd8d782a-88ec-4fd6-ab50-e8526581fbe2 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:49.278110 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cd8d782a-88ec-4fd6-ab50-e8526581fbe2 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:49.285348 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f713440b-095c-42f0-81e5-2e5c2b9aaeb1 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:49.286301 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f713440b-095c-42f0-81e5-2e5c2b9aaeb1 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:49.288304 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f713440b-095c-42f0-81e5-2e5c2b9aaeb1 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:49.291586 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f713440b-095c-42f0-81e5-2e5c2b9aaeb1 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:49.388788 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f713440b-095c-42f0-81e5-2e5c2b9aaeb1 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] 10.222.0.46 "POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action" status: 200 len: 16399 microversion: 2.1 time: 0.137320 Jan 15 20:56:49.389282 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-cd8d782a-88ec-4fd6-ab50-e8526581fbe2 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] 10.222.0.46 "POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action" status: 200 len: 24567 microversion: 2.1 time: 0.171008 Jan 15 20:56:49.390315 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1252/2444] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:56:49 2022] POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action => generated 24567 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:56:49.393333 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1193/2445] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:56:49 2022] POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action => generated 16399 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:56:49.405979 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b3320323-ce9e-4ed8-a5c6-a1eb8a9ffc42 tempest-SecurityGroupRulesNegativeTestJSON-1725336859 tempest-SecurityGroupRulesNegativeTestJSON-1725336859-project] Calling method '.version_select at 0x7f30cec31700>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:49.407657 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9133c481-ab26-4890-a9ee-29ec9fdcc931 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:49.409663 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-9133c481-ab26-4890-a9ee-29ec9fdcc931 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: 0874eafa-ffa2-4257-b6c5-66e4bef983db] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:49.426591 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9133c481-ab26-4890-a9ee-29ec9fdcc931 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:49.428655 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9133c481-ab26-4890-a9ee-29ec9fdcc931 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:49.429508 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9133c481-ab26-4890-a9ee-29ec9fdcc931 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:49.430205 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9133c481-ab26-4890-a9ee-29ec9fdcc931 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:49.694306 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-9133c481-ab26-4890-a9ee-29ec9fdcc931 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:49.705576 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-9133c481-ab26-4890-a9ee-29ec9fdcc931 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/0874eafa-ffa2-4257-b6c5-66e4bef983db" status: 200 len: 1507 microversion: 2.1 time: 0.310442 Jan 15 20:56:49.706508 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1194/2446] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:49 2022] GET /compute/v2.1/servers/0874eafa-ffa2-4257-b6c5-66e4bef983db => generated 1507 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:49.711303 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-1fde1ec8-7681-49b4-b2a7-1dd073bd6953 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:49.711789 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-1fde1ec8-7681-49b4-b2a7-1dd073bd6953 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] [instance: ffb8267e-acd5-4c23-807a-07e0b02204a0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:49.720739 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1fde1ec8-7681-49b4-b2a7-1dd073bd6953 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:49.722314 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1fde1ec8-7681-49b4-b2a7-1dd073bd6953 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:49.725590 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1fde1ec8-7681-49b4-b2a7-1dd073bd6953 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:49.726073 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1fde1ec8-7681-49b4-b2a7-1dd073bd6953 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:49.742486 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-1fde1ec8-7681-49b4-b2a7-1dd073bd6953 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] HTTP exception thrown: Instance ffb8267e-acd5-4c23-807a-07e0b02204a0 could not be found. Jan 15 20:56:49.743376 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-1fde1ec8-7681-49b4-b2a7-1dd073bd6953 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Returning 404 to user: Instance ffb8267e-acd5-4c23-807a-07e0b02204a0 could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:56:49.745930 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-1fde1ec8-7681-49b4-b2a7-1dd073bd6953 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] 10.222.0.46 "DELETE /compute/v2.1/servers/ffb8267e-acd5-4c23-807a-07e0b02204a0" status: 404 len: 111 microversion: 2.1 time: 0.037353 Jan 15 20:56:49.750284 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1195/2447] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 20:56:49 2022] DELETE /compute/v2.1/servers/ffb8267e-acd5-4c23-807a-07e0b02204a0 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:56:49.757444 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b684c25e-02d2-43f7-980b-cdddde4417ad tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:49.758118 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b684c25e-02d2-43f7-980b-cdddde4417ad tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] [instance: ffb8267e-acd5-4c23-807a-07e0b02204a0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:49.764672 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b684c25e-02d2-43f7-980b-cdddde4417ad tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:49.765158 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b684c25e-02d2-43f7-980b-cdddde4417ad tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:49.766045 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b684c25e-02d2-43f7-980b-cdddde4417ad tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:49.766549 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b684c25e-02d2-43f7-980b-cdddde4417ad tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:49.785960 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-b684c25e-02d2-43f7-980b-cdddde4417ad tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] HTTP exception thrown: Instance ffb8267e-acd5-4c23-807a-07e0b02204a0 could not be found. Jan 15 20:56:49.786674 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b684c25e-02d2-43f7-980b-cdddde4417ad tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Returning 404 to user: Instance ffb8267e-acd5-4c23-807a-07e0b02204a0 could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:56:49.787507 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b684c25e-02d2-43f7-980b-cdddde4417ad tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] 10.222.0.46 "GET /compute/v2.1/servers/ffb8267e-acd5-4c23-807a-07e0b02204a0" status: 404 len: 111 microversion: 2.1 time: 0.035830 Jan 15 20:56:49.787877 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b3320323-ce9e-4ed8-a5c6-a1eb8a9ffc42 tempest-SecurityGroupRulesNegativeTestJSON-1725336859 tempest-SecurityGroupRulesNegativeTestJSON-1725336859-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/0a12c847-58f2-4d3f-8ad2-22ca2e97cff1" status: 202 len: 0 microversion: 2.1 time: 0.394958 Jan 15 20:56:49.791461 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1196/2448] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:49 2022] GET /compute/v2.1/servers/ffb8267e-acd5-4c23-807a-07e0b02204a0 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:56:49.796405 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1253/2449] 10.222.0.46 () {58 vars in 1271 bytes} [Sat Jan 15 20:56:49 2022] DELETE /compute/v2.1/os-security-groups/0a12c847-58f2-4d3f-8ad2-22ca2e97cff1 => generated 0 bytes in 404 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 20:56:49.799008 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-4bab450c-b395-494c-8a04-8395c5409cd2 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Calling method '.version_select at 0x7f30c86e2670>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:49.802421 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-63f2de1c-50a0-4836-ae6f-9fb35c8934e1 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:49.803043 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-63f2de1c-50a0-4836-ae6f-9fb35c8934e1 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] [instance: 64e6adc9-543a-4611-89fa-38967f9c5ea4] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:49.819223 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-63f2de1c-50a0-4836-ae6f-9fb35c8934e1 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:49.819719 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-63f2de1c-50a0-4836-ae6f-9fb35c8934e1 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:49.820516 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-63f2de1c-50a0-4836-ae6f-9fb35c8934e1 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:49.821014 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-63f2de1c-50a0-4836-ae6f-9fb35c8934e1 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:49.858716 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-4bab450c-b395-494c-8a04-8395c5409cd2 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] 10.222.0.46 "GET /compute/v2.1/images/198bbbad-af58-4eb7-8548-fd851471e431" status: 200 len: 1452 microversion: 2.1 time: 0.065768 Jan 15 20:56:49.859377 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1197/2450] 10.222.0.46 () {58 vars in 1232 bytes} [Sat Jan 15 20:56:49 2022] GET /compute/v2.1/images/198bbbad-af58-4eb7-8548-fd851471e431 => generated 1452 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:49.866103 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f84cb442-1cb4-427b-9c97-0760a6d2ca7d tempest-SecurityGroupRulesNegativeTestJSON-1725336859 tempest-SecurityGroupRulesNegativeTestJSON-1725336859-project] Calling method '.version_select at 0x7f30ceb6a820>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:49.883234 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-63f2de1c-50a0-4836-ae6f-9fb35c8934e1 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] HTTP exception thrown: Instance 64e6adc9-543a-4611-89fa-38967f9c5ea4 could not be found. Jan 15 20:56:49.883867 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-63f2de1c-50a0-4836-ae6f-9fb35c8934e1 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Returning 404 to user: Instance 64e6adc9-543a-4611-89fa-38967f9c5ea4 could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:56:49.885097 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-63f2de1c-50a0-4836-ae6f-9fb35c8934e1 tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] 10.222.0.46 "DELETE /compute/v2.1/servers/64e6adc9-543a-4611-89fa-38967f9c5ea4" status: 404 len: 111 microversion: 2.1 time: 0.087523 Jan 15 20:56:49.889610 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1254/2451] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 20:56:49 2022] DELETE /compute/v2.1/servers/64e6adc9-543a-4611-89fa-38967f9c5ea4 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:56:49.896972 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f67c8ed2-9ef0-4e77-b7ff-854aa31710ad tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:49.897980 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f67c8ed2-9ef0-4e77-b7ff-854aa31710ad tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] [instance: 64e6adc9-543a-4611-89fa-38967f9c5ea4] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:49.911545 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f67c8ed2-9ef0-4e77-b7ff-854aa31710ad tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:49.912002 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f67c8ed2-9ef0-4e77-b7ff-854aa31710ad tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:49.912829 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f67c8ed2-9ef0-4e77-b7ff-854aa31710ad tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:49.913302 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f67c8ed2-9ef0-4e77-b7ff-854aa31710ad tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:49.929130 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-f67c8ed2-9ef0-4e77-b7ff-854aa31710ad tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] HTTP exception thrown: Instance 64e6adc9-543a-4611-89fa-38967f9c5ea4 could not be found. Jan 15 20:56:49.930210 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f67c8ed2-9ef0-4e77-b7ff-854aa31710ad tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] Returning 404 to user: Instance 64e6adc9-543a-4611-89fa-38967f9c5ea4 could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:56:49.931036 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f67c8ed2-9ef0-4e77-b7ff-854aa31710ad tempest-ServersTestMultiNic-1422470225 tempest-ServersTestMultiNic-1422470225-project] 10.222.0.46 "GET /compute/v2.1/servers/64e6adc9-543a-4611-89fa-38967f9c5ea4" status: 404 len: 111 microversion: 2.1 time: 0.039714 Jan 15 20:56:49.935296 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1255/2452] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:49 2022] GET /compute/v2.1/servers/64e6adc9-543a-4611-89fa-38967f9c5ea4 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:56:50.080414 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c964e973-91a2-468e-b7e7-0acac36ab929 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:50.081136 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c964e973-91a2-468e-b7e7-0acac36ab929 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] [instance: 84fe1922-dca1-4713-9ea1-bdd26b309ce6] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:50.091284 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c964e973-91a2-468e-b7e7-0acac36ab929 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:50.091738 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c964e973-91a2-468e-b7e7-0acac36ab929 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:50.092677 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c964e973-91a2-468e-b7e7-0acac36ab929 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:50.093577 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c964e973-91a2-468e-b7e7-0acac36ab929 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:50.133727 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f84cb442-1cb4-427b-9c97-0760a6d2ca7d tempest-SecurityGroupRulesNegativeTestJSON-1725336859 tempest-SecurityGroupRulesNegativeTestJSON-1725336859-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/c94a5950-fa2c-4b4b-8e37-1edf8945cf7c" status: 202 len: 0 microversion: 2.1 time: 0.271956 Jan 15 20:56:50.134643 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1198/2453] 10.222.0.46 () {58 vars in 1271 bytes} [Sat Jan 15 20:56:49 2022] DELETE /compute/v2.1/os-security-groups/c94a5950-fa2c-4b4b-8e37-1edf8945cf7c => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 20:56:50.144194 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-59ffbb09-bb4b-4a79-bd5e-0a2b9c2cc84b tempest-SecurityGroupRulesNegativeTestJSON-1725336859 tempest-SecurityGroupRulesNegativeTestJSON-1725336859-project] Calling method '.version_select at 0x7f30ceb6a940>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:50.379490 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-c964e973-91a2-468e-b7e7-0acac36ab929 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ec114f8ece434aa496cd401494e2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a05b1a0a7479db84b762eca23b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:50.388031 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c964e973-91a2-468e-b7e7-0acac36ab929 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] 10.222.0.46 "GET /compute/v2.1/servers/84fe1922-dca1-4713-9ea1-bdd26b309ce6" status: 200 len: 1311 microversion: 2.1 time: 0.312940 Jan 15 20:56:50.388625 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1256/2454] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:50 2022] GET /compute/v2.1/servers/84fe1922-dca1-4713-9ea1-bdd26b309ce6 => generated 1311 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:50.403466 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-11633c69-7732-4993-a8a2-9f5ab93f0d18 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:50.404643 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-11633c69-7732-4993-a8a2-9f5ab93f0d18 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] [instance: b1eb0bef-5aaf-46d6-8739-b12303df9842] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:50.411684 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-11633c69-7732-4993-a8a2-9f5ab93f0d18 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:50.413026 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-11633c69-7732-4993-a8a2-9f5ab93f0d18 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:50.413312 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-11633c69-7732-4993-a8a2-9f5ab93f0d18 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:50.413583 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-11633c69-7732-4993-a8a2-9f5ab93f0d18 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:50.459827 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-11633c69-7732-4993-a8a2-9f5ab93f0d18 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] 10.222.0.46 "POST /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842/action" status: 200 len: 32632 microversion: 2.1 time: 0.068005 Jan 15 20:56:50.466321 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1257/2455] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:56:50 2022] POST /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842/action => generated 32632 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:56:50.474160 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8d4a8036-bdfb-4c0d-87cc-9b0d906d3331 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:50.476042 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-8d4a8036-bdfb-4c0d-87cc-9b0d906d3331 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] [instance: 62ae2a15-8c2c-4dad-971f-0611238103a3] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:50.483941 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8d4a8036-bdfb-4c0d-87cc-9b0d906d3331 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:50.484778 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8d4a8036-bdfb-4c0d-87cc-9b0d906d3331 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:50.485685 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8d4a8036-bdfb-4c0d-87cc-9b0d906d3331 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:50.486248 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8d4a8036-bdfb-4c0d-87cc-9b0d906d3331 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:50.535712 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-59ffbb09-bb4b-4a79-bd5e-0a2b9c2cc84b tempest-SecurityGroupRulesNegativeTestJSON-1725336859 tempest-SecurityGroupRulesNegativeTestJSON-1725336859-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/d0876cf9-adf7-4b01-b424-49a031c66604" status: 202 len: 0 microversion: 2.1 time: 0.393580 Jan 15 20:56:50.537056 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1199/2456] 10.222.0.46 () {58 vars in 1271 bytes} [Sat Jan 15 20:56:50 2022] DELETE /compute/v2.1/os-security-groups/d0876cf9-adf7-4b01-b424-49a031c66604 => generated 0 bytes in 397 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 20:56:50.543303 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-8d4a8036-bdfb-4c0d-87cc-9b0d906d3331 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] 10.222.0.46 "POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action" status: 200 len: 24567 microversion: 2.1 time: 0.075122 Jan 15 20:56:50.545789 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-1c8d2b4b-0aa2-477c-b861-672f92969ce8 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:50.547129 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-1c8d2b4b-0aa2-477c-b861-672f92969ce8 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] [instance: 70bf65cf-55e2-459a-aaf1-c3eb851a6ccf] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:50.553820 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1258/2457] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:56:50 2022] POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action => generated 24567 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:56:50.568209 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1c8d2b4b-0aa2-477c-b861-672f92969ce8 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:50.569775 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1c8d2b4b-0aa2-477c-b861-672f92969ce8 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:50.573110 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1c8d2b4b-0aa2-477c-b861-672f92969ce8 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:50.575835 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1c8d2b4b-0aa2-477c-b861-672f92969ce8 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:50.643024 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-1c8d2b4b-0aa2-477c-b861-672f92969ce8 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] 10.222.0.46 "POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action" status: 200 len: 16399 microversion: 2.1 time: 0.104438 Jan 15 20:56:50.644693 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1200/2458] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:56:50 2022] POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action => generated 16399 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:56:50.725486 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-be412b18-61a5-41a8-958a-22f275c76a4c tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:50.726682 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-be412b18-61a5-41a8-958a-22f275c76a4c tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: 0874eafa-ffa2-4257-b6c5-66e4bef983db] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:50.742713 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-be412b18-61a5-41a8-958a-22f275c76a4c tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:50.743320 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-be412b18-61a5-41a8-958a-22f275c76a4c tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:50.744251 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-be412b18-61a5-41a8-958a-22f275c76a4c tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:50.747774 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-be412b18-61a5-41a8-958a-22f275c76a4c tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:50.874546 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-34135ed8-dbbc-4c3d-abf7-83e9ea97c4a4 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Calling method '.version_select at 0x7f30c86e2e50>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:50.981340 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-34135ed8-dbbc-4c3d-abf7-83e9ea97c4a4 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] 10.222.0.46 "GET /compute/v2.1/images/198bbbad-af58-4eb7-8548-fd851471e431" status: 200 len: 1452 microversion: 2.1 time: 0.111941 Jan 15 20:56:50.991757 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1201/2459] 10.222.0.46 () {58 vars in 1232 bytes} [Sat Jan 15 20:56:50 2022] GET /compute/v2.1/images/198bbbad-af58-4eb7-8548-fd851471e431 => generated 1452 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:56:51.021618 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-be412b18-61a5-41a8-958a-22f275c76a4c tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:51.035062 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-be412b18-61a5-41a8-958a-22f275c76a4c tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/0874eafa-ffa2-4257-b6c5-66e4bef983db" status: 200 len: 1507 microversion: 2.1 time: 0.310914 Jan 15 20:56:51.038449 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1259/2460] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:50 2022] GET /compute/v2.1/servers/0874eafa-ffa2-4257-b6c5-66e4bef983db => generated 1507 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:51.408368 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d4de09a4-551d-4769-82dd-30c3030609c9 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:51.409284 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d4de09a4-551d-4769-82dd-30c3030609c9 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] [instance: 84fe1922-dca1-4713-9ea1-bdd26b309ce6] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:51.434284 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d4de09a4-551d-4769-82dd-30c3030609c9 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:51.434756 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d4de09a4-551d-4769-82dd-30c3030609c9 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:51.440090 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d4de09a4-551d-4769-82dd-30c3030609c9 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:51.440555 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d4de09a4-551d-4769-82dd-30c3030609c9 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:51.473613 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9d8c1a88-ed9d-44ea-8907-d6c806bf2029 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:51.474612 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-9d8c1a88-ed9d-44ea-8907-d6c806bf2029 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] [instance: b1eb0bef-5aaf-46d6-8739-b12303df9842] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:51.489791 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9d8c1a88-ed9d-44ea-8907-d6c806bf2029 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:51.490268 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9d8c1a88-ed9d-44ea-8907-d6c806bf2029 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:51.501630 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9d8c1a88-ed9d-44ea-8907-d6c806bf2029 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:51.502227 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9d8c1a88-ed9d-44ea-8907-d6c806bf2029 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:51.646110 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-9d8c1a88-ed9d-44ea-8907-d6c806bf2029 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] 10.222.0.46 "POST /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842/action" status: 200 len: 32632 microversion: 2.1 time: 0.176220 Jan 15 20:56:51.646728 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1260/2461] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:56:51 2022] POST /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842/action => generated 32632 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:56:51.652947 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-3ade4b82-645c-4e1e-84c0-7ea9f8b2f390 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:51.670070 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-3ade4b82-645c-4e1e-84c0-7ea9f8b2f390 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] [instance: 62ae2a15-8c2c-4dad-971f-0611238103a3] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:51.677806 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3ade4b82-645c-4e1e-84c0-7ea9f8b2f390 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:51.678279 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3ade4b82-645c-4e1e-84c0-7ea9f8b2f390 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:51.679095 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3ade4b82-645c-4e1e-84c0-7ea9f8b2f390 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:51.679536 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3ade4b82-645c-4e1e-84c0-7ea9f8b2f390 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:51.759998 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-3ade4b82-645c-4e1e-84c0-7ea9f8b2f390 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] 10.222.0.46 "POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action" status: 200 len: 24567 microversion: 2.1 time: 0.111129 Jan 15 20:56:51.764758 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1261/2462] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:56:51 2022] POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action => generated 24567 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:56:51.767093 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0118d7d1-15bb-43ab-b266-395013e167be tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:51.768105 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-0118d7d1-15bb-43ab-b266-395013e167be tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] [instance: 70bf65cf-55e2-459a-aaf1-c3eb851a6ccf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:51.791550 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0118d7d1-15bb-43ab-b266-395013e167be tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:51.801267 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0118d7d1-15bb-43ab-b266-395013e167be tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:51.802351 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0118d7d1-15bb-43ab-b266-395013e167be tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:51.809567 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0118d7d1-15bb-43ab-b266-395013e167be tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:51.898564 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0118d7d1-15bb-43ab-b266-395013e167be tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] 10.222.0.46 "POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action" status: 200 len: 24571 microversion: 2.1 time: 0.134778 Jan 15 20:56:51.902838 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1262/2463] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:56:51 2022] POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action => generated 24571 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:56:51.940287 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-d4de09a4-551d-4769-82dd-30c3030609c9 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ec114f8ece434aa496cd401494e2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a05b1a0a7479db84b762eca23b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:51.949750 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d4de09a4-551d-4769-82dd-30c3030609c9 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] 10.222.0.46 "GET /compute/v2.1/servers/84fe1922-dca1-4713-9ea1-bdd26b309ce6" status: 200 len: 1311 microversion: 2.1 time: 0.546303 Jan 15 20:56:51.950942 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1202/2464] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:51 2022] GET /compute/v2.1/servers/84fe1922-dca1-4713-9ea1-bdd26b309ce6 => generated 1311 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:52.008978 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-808b57d8-91d5-464f-9fff-4bf658841831 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Calling method '.version_select at 0x7f30cec0af70>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:52.063594 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-6c33a012-68d5-4b2c-b69f-9b1d5b791516 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:52.064204 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-6c33a012-68d5-4b2c-b69f-9b1d5b791516 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: 0874eafa-ffa2-4257-b6c5-66e4bef983db] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:52.078770 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6c33a012-68d5-4b2c-b69f-9b1d5b791516 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:52.079237 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6c33a012-68d5-4b2c-b69f-9b1d5b791516 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:52.091266 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6c33a012-68d5-4b2c-b69f-9b1d5b791516 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:52.091735 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6c33a012-68d5-4b2c-b69f-9b1d5b791516 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:52.096063 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-808b57d8-91d5-464f-9fff-4bf658841831 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] 10.222.0.46 "GET /compute/v2.1/images/198bbbad-af58-4eb7-8548-fd851471e431" status: 200 len: 1452 microversion: 2.1 time: 0.096057 Jan 15 20:56:52.097339 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1263/2465] 10.222.0.46 () {58 vars in 1232 bytes} [Sat Jan 15 20:56:51 2022] GET /compute/v2.1/images/198bbbad-af58-4eb7-8548-fd851471e431 => generated 1452 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:52.286425 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-6c33a012-68d5-4b2c-b69f-9b1d5b791516 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:52.297097 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-6c33a012-68d5-4b2c-b69f-9b1d5b791516 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/0874eafa-ffa2-4257-b6c5-66e4bef983db" status: 200 len: 1507 microversion: 2.1 time: 0.246342 Jan 15 20:56:52.309085 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1203/2466] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:52 2022] GET /compute/v2.1/servers/0874eafa-ffa2-4257-b6c5-66e4bef983db => generated 1507 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:56:52.659487 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-dba4dd5b-0cf8-4607-b10c-035fa5d69fc9 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:52.661243 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-dba4dd5b-0cf8-4607-b10c-035fa5d69fc9 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] [instance: b1eb0bef-5aaf-46d6-8739-b12303df9842] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:52.685962 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dba4dd5b-0cf8-4607-b10c-035fa5d69fc9 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:52.686718 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dba4dd5b-0cf8-4607-b10c-035fa5d69fc9 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:52.688502 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dba4dd5b-0cf8-4607-b10c-035fa5d69fc9 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:52.689207 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dba4dd5b-0cf8-4607-b10c-035fa5d69fc9 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:52.774467 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-0e21b659-8fa9-432a-88f2-8ec0ebbcebb7 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:52.775504 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-0e21b659-8fa9-432a-88f2-8ec0ebbcebb7 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] [instance: 62ae2a15-8c2c-4dad-971f-0611238103a3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:52.799943 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0e21b659-8fa9-432a-88f2-8ec0ebbcebb7 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:52.800408 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0e21b659-8fa9-432a-88f2-8ec0ebbcebb7 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:52.803986 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0e21b659-8fa9-432a-88f2-8ec0ebbcebb7 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:52.804434 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0e21b659-8fa9-432a-88f2-8ec0ebbcebb7 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:52.816975 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-dba4dd5b-0cf8-4607-b10c-035fa5d69fc9 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] 10.222.0.46 "POST /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842/action" status: 200 len: 32632 microversion: 2.1 time: 0.161707 Jan 15 20:56:52.828833 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1264/2467] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:56:52 2022] POST /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842/action => generated 32632 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:56:52.890665 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-0e21b659-8fa9-432a-88f2-8ec0ebbcebb7 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] 10.222.0.46 "POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action" status: 200 len: 24567 microversion: 2.1 time: 0.114380 Jan 15 20:56:52.897330 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1204/2468] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:56:52 2022] POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action => generated 24567 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:56:52.913565 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-fa779d3e-fd30-43d4-a1f0-d92dc42e4f28 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:52.914631 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-fa779d3e-fd30-43d4-a1f0-d92dc42e4f28 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] [instance: 70bf65cf-55e2-459a-aaf1-c3eb851a6ccf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:52.938071 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fa779d3e-fd30-43d4-a1f0-d92dc42e4f28 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:52.938531 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fa779d3e-fd30-43d4-a1f0-d92dc42e4f28 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:52.939332 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fa779d3e-fd30-43d4-a1f0-d92dc42e4f28 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:52.939787 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fa779d3e-fd30-43d4-a1f0-d92dc42e4f28 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:52.977283 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d833c46c-833e-4584-a8ad-bcafd5726590 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:52.978014 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d833c46c-833e-4584-a8ad-bcafd5726590 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] [instance: 84fe1922-dca1-4713-9ea1-bdd26b309ce6] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:53.009189 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d833c46c-833e-4584-a8ad-bcafd5726590 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:53.012110 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d833c46c-833e-4584-a8ad-bcafd5726590 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:53.013946 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d833c46c-833e-4584-a8ad-bcafd5726590 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:53.016894 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d833c46c-833e-4584-a8ad-bcafd5726590 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:53.082613 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-fa779d3e-fd30-43d4-a1f0-d92dc42e4f28 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] 10.222.0.46 "POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action" status: 200 len: 24571 microversion: 2.1 time: 0.172047 Jan 15 20:56:53.085556 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1265/2469] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:56:52 2022] POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action => generated 24571 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:56:53.112634 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-31cd3cfa-6c99-40d6-9223-efb84eca2357 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Calling method '.version_select at 0x7f30ceca2820>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:53.221232 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-31cd3cfa-6c99-40d6-9223-efb84eca2357 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] 10.222.0.46 "GET /compute/v2.1/images/198bbbad-af58-4eb7-8548-fd851471e431" status: 200 len: 1452 microversion: 2.1 time: 0.113814 Jan 15 20:56:53.223312 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1266/2470] 10.222.0.46 () {58 vars in 1232 bytes} [Sat Jan 15 20:56:53 2022] GET /compute/v2.1/images/198bbbad-af58-4eb7-8548-fd851471e431 => generated 1452 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:53.280024 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-d0f24f8e-8d41-48ec-ab63-bf8ff61cdb53 req-8f2413c6-cd20-41f0-8a12-bf500b52c3a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84fe1922-dca1-4713-9ea1-bdd26b309ce6", "name": "network-vif-plugged", "status": "completed", "tag": "4dd9a494-ab1e-4bde-892a-a7dc884ad0a1"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:53.285602 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:56:53.285602 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:56:53.322591 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-d0f24f8e-8d41-48ec-ab63-bf8ff61cdb53 req-8f2413c6-cd20-41f0-8a12-bf500b52c3a5 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:53.325054 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-d0f24f8e-8d41-48ec-ab63-bf8ff61cdb53 req-8f2413c6-cd20-41f0-8a12-bf500b52c3a5 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:53.364321 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-d0f24f8e-8d41-48ec-ab63-bf8ff61cdb53 req-8f2413c6-cd20-41f0-8a12-bf500b52c3a5 service nova] Creating event network-vif-plugged:4dd9a494-ab1e-4bde-892a-a7dc884ad0a1 for instance 84fe1922-dca1-4713-9ea1-bdd26b309ce6 on nch1-master-1 Jan 15 20:56:53.394067 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-d0f24f8e-8d41-48ec-ab63-bf8ff61cdb53 req-8f2413c6-cd20-41f0-8a12-bf500b52c3a5 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110265 Jan 15 20:56:53.397914 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1267/2471] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:56:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:56:53.426720 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7bb28024-a9e7-4bb2-bb91-0fc496c72f0a tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:53.429536 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-7bb28024-a9e7-4bb2-bb91-0fc496c72f0a tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: 0874eafa-ffa2-4257-b6c5-66e4bef983db] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:53.447360 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7bb28024-a9e7-4bb2-bb91-0fc496c72f0a tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:53.453368 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7bb28024-a9e7-4bb2-bb91-0fc496c72f0a tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:53.454750 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7bb28024-a9e7-4bb2-bb91-0fc496c72f0a tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:53.455359 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7bb28024-a9e7-4bb2-bb91-0fc496c72f0a tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:54.199774 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-7bb28024-a9e7-4bb2-bb91-0fc496c72f0a tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:54.209354 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7bb28024-a9e7-4bb2-bb91-0fc496c72f0a tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/0874eafa-ffa2-4257-b6c5-66e4bef983db" status: 200 len: 1507 microversion: 2.1 time: 0.809811 Jan 15 20:56:54.212066 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1268/2472] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:53 2022] GET /compute/v2.1/servers/0874eafa-ffa2-4257-b6c5-66e4bef983db => generated 1507 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:54.221280 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-709cd5ab-be9e-40c9-afb5-f8c240ff2401 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:54.232384 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-d833c46c-833e-4584-a8ad-bcafd5726590 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ec114f8ece434aa496cd401494e2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a05b1a0a7479db84b762eca23b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:54.240237 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-709cd5ab-be9e-40c9-afb5-f8c240ff2401 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] [instance: b1eb0bef-5aaf-46d6-8739-b12303df9842] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:54.251644 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d833c46c-833e-4584-a8ad-bcafd5726590 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] 10.222.0.46 "GET /compute/v2.1/servers/84fe1922-dca1-4713-9ea1-bdd26b309ce6" status: 200 len: 1311 microversion: 2.1 time: 1.288580 Jan 15 20:56:54.256057 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1205/2473] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:52 2022] GET /compute/v2.1/servers/84fe1922-dca1-4713-9ea1-bdd26b309ce6 => generated 1311 bytes in 1294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:56:54.265264 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9b82347b-3852-4af4-88c2-048fb313d917 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:54.266957 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-9b82347b-3852-4af4-88c2-048fb313d917 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] [instance: 62ae2a15-8c2c-4dad-971f-0611238103a3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:54.279959 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-709cd5ab-be9e-40c9-afb5-f8c240ff2401 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:54.280833 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-709cd5ab-be9e-40c9-afb5-f8c240ff2401 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:54.283613 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9b82347b-3852-4af4-88c2-048fb313d917 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:54.284792 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-709cd5ab-be9e-40c9-afb5-f8c240ff2401 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:54.285762 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-709cd5ab-be9e-40c9-afb5-f8c240ff2401 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:54.286909 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9b82347b-3852-4af4-88c2-048fb313d917 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:54.289614 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9b82347b-3852-4af4-88c2-048fb313d917 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:54.291123 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9b82347b-3852-4af4-88c2-048fb313d917 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:54.391663 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-9b82347b-3852-4af4-88c2-048fb313d917 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] 10.222.0.46 "POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action" status: 200 len: 24567 microversion: 2.1 time: 0.133999 Jan 15 20:56:54.392811 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1206/2474] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:56:54 2022] POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action => generated 24567 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:56:54.406283 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b172c042-738d-45f0-880d-d03d798f626e tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:54.407774 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b172c042-738d-45f0-880d-d03d798f626e tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] [instance: 70bf65cf-55e2-459a-aaf1-c3eb851a6ccf] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:54.427895 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b172c042-738d-45f0-880d-d03d798f626e tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:54.437627 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b172c042-738d-45f0-880d-d03d798f626e tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:54.438899 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b172c042-738d-45f0-880d-d03d798f626e tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:54.439608 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b172c042-738d-45f0-880d-d03d798f626e tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:54.469810 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-709cd5ab-be9e-40c9-afb5-f8c240ff2401 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] 10.222.0.46 "POST /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842/action" status: 200 len: 32632 microversion: 2.1 time: 0.252233 Jan 15 20:56:54.470495 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1269/2475] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:56:54 2022] POST /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842/action => generated 32632 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:56:54.486202 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-be922cdf-cfcd-4888-b84a-ec4a553c4dd9 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Calling method '.version_select at 0x7f30c8e11e50>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:54.522023 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b172c042-738d-45f0-880d-d03d798f626e tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] 10.222.0.46 "POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action" status: 200 len: 24571 microversion: 2.1 time: 0.127462 Jan 15 20:56:54.528148 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1207/2476] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:56:54 2022] POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action => generated 24571 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:56:54.602221 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-be922cdf-cfcd-4888-b84a-ec4a553c4dd9 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] 10.222.0.46 "GET /compute/v2.1/images/198bbbad-af58-4eb7-8548-fd851471e431" status: 200 len: 1452 microversion: 2.1 time: 0.129186 Jan 15 20:56:54.604485 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1270/2477] 10.222.0.46 () {58 vars in 1232 bytes} [Sat Jan 15 20:56:54 2022] GET /compute/v2.1/images/198bbbad-af58-4eb7-8548-fd851471e431 => generated 1452 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:55.231444 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-fca31fb8-49b5-4b3e-b907-98c82a61efd2 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:55.232278 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-fca31fb8-49b5-4b3e-b907-98c82a61efd2 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: 0874eafa-ffa2-4257-b6c5-66e4bef983db] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:55.248156 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fca31fb8-49b5-4b3e-b907-98c82a61efd2 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:55.248933 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fca31fb8-49b5-4b3e-b907-98c82a61efd2 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:55.249552 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fca31fb8-49b5-4b3e-b907-98c82a61efd2 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:55.252192 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fca31fb8-49b5-4b3e-b907-98c82a61efd2 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:55.273620 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0a169895-eed2-482d-a190-bf507308a6ab tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:55.275203 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-0a169895-eed2-482d-a190-bf507308a6ab tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] [instance: 84fe1922-dca1-4713-9ea1-bdd26b309ce6] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:55.301431 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0a169895-eed2-482d-a190-bf507308a6ab tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:55.302262 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0a169895-eed2-482d-a190-bf507308a6ab tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:55.303387 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0a169895-eed2-482d-a190-bf507308a6ab tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:55.310017 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0a169895-eed2-482d-a190-bf507308a6ab tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:55.791992 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-fca31fb8-49b5-4b3e-b907-98c82a61efd2 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:55.825513 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-fca31fb8-49b5-4b3e-b907-98c82a61efd2 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/0874eafa-ffa2-4257-b6c5-66e4bef983db" status: 200 len: 1507 microversion: 2.1 time: 0.600097 Jan 15 20:56:55.836389 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1208/2478] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:55 2022] GET /compute/v2.1/servers/0874eafa-ffa2-4257-b6c5-66e4bef983db => generated 1507 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:55.842936 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-15e1d0ff-9783-4410-a472-feb5a17abf1b tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:55.853275 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-15e1d0ff-9783-4410-a472-feb5a17abf1b tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] [instance: 62ae2a15-8c2c-4dad-971f-0611238103a3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:55.870934 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-15e1d0ff-9783-4410-a472-feb5a17abf1b tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:55.871844 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-15e1d0ff-9783-4410-a472-feb5a17abf1b tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:55.873302 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-15e1d0ff-9783-4410-a472-feb5a17abf1b tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:55.874034 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-15e1d0ff-9783-4410-a472-feb5a17abf1b tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:55.879522 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-0a169895-eed2-482d-a190-bf507308a6ab tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ec114f8ece434aa496cd401494e2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a05b1a0a7479db84b762eca23b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:55.891370 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0a169895-eed2-482d-a190-bf507308a6ab tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] 10.222.0.46 "GET /compute/v2.1/servers/84fe1922-dca1-4713-9ea1-bdd26b309ce6" status: 200 len: 1311 microversion: 2.1 time: 0.622660 Jan 15 20:56:55.893730 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1271/2479] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:55 2022] GET /compute/v2.1/servers/84fe1922-dca1-4713-9ea1-bdd26b309ce6 => generated 1311 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:55.908126 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-476a726e-255f-4a24-a900-95c9920f2912 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:55.909656 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-476a726e-255f-4a24-a900-95c9920f2912 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] [instance: b1eb0bef-5aaf-46d6-8739-b12303df9842] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:55.919342 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-476a726e-255f-4a24-a900-95c9920f2912 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:55.919892 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-476a726e-255f-4a24-a900-95c9920f2912 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:55.920770 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-476a726e-255f-4a24-a900-95c9920f2912 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:55.921511 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-476a726e-255f-4a24-a900-95c9920f2912 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:55.939683 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-15e1d0ff-9783-4410-a472-feb5a17abf1b tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] 10.222.0.46 "POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action" status: 200 len: 24567 microversion: 2.1 time: 0.101748 Jan 15 20:56:55.944400 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1209/2480] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:56:55 2022] POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action => generated 24567 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:56:55.954284 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8d086241-d3a5-4169-aea9-c8968f38844c tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:55.957246 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-8d086241-d3a5-4169-aea9-c8968f38844c tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] [instance: 70bf65cf-55e2-459a-aaf1-c3eb851a6ccf] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:55.971622 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8d086241-d3a5-4169-aea9-c8968f38844c tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:55.972440 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8d086241-d3a5-4169-aea9-c8968f38844c tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:55.973904 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8d086241-d3a5-4169-aea9-c8968f38844c tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:55.975162 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8d086241-d3a5-4169-aea9-c8968f38844c tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:56.014181 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-476a726e-255f-4a24-a900-95c9920f2912 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] 10.222.0.46 "POST /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842/action" status: 200 len: 32632 microversion: 2.1 time: 0.118209 Jan 15 20:56:56.016088 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1272/2481] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:56:55 2022] POST /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842/action => generated 32632 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:56:56.022195 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b2e3b7e0-0891-41e2-b72b-10d8a69cee4b tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Calling method '.version_select at 0x7f30cec31f70>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:56.039579 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-8d086241-d3a5-4169-aea9-c8968f38844c tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] 10.222.0.46 "POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action" status: 200 len: 24571 microversion: 2.1 time: 0.090298 Jan 15 20:56:56.041128 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1210/2482] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:56:55 2022] POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action => generated 24571 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:56:56.078748 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b2e3b7e0-0891-41e2-b72b-10d8a69cee4b tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] 10.222.0.46 "GET /compute/v2.1/images/198bbbad-af58-4eb7-8548-fd851471e431" status: 200 len: 1452 microversion: 2.1 time: 0.060834 Jan 15 20:56:56.080161 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1273/2483] 10.222.0.46 () {58 vars in 1232 bytes} [Sat Jan 15 20:56:56 2022] GET /compute/v2.1/images/198bbbad-af58-4eb7-8548-fd851471e431 => generated 1452 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:56.849972 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-05e4340a-d028-48d0-8d40-86cac780b367 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:56.857486 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-05e4340a-d028-48d0-8d40-86cac780b367 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: 0874eafa-ffa2-4257-b6c5-66e4bef983db] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:56.867866 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-05e4340a-d028-48d0-8d40-86cac780b367 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:56.868558 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-05e4340a-d028-48d0-8d40-86cac780b367 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:56.869622 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-05e4340a-d028-48d0-8d40-86cac780b367 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:56.870263 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-05e4340a-d028-48d0-8d40-86cac780b367 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:56.913929 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-81513300-0d65-49df-bfe5-b592ecf71936 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:56.914679 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-81513300-0d65-49df-bfe5-b592ecf71936 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] [instance: 84fe1922-dca1-4713-9ea1-bdd26b309ce6] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:56.936938 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-81513300-0d65-49df-bfe5-b592ecf71936 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:56.938761 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-81513300-0d65-49df-bfe5-b592ecf71936 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:56.939606 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-81513300-0d65-49df-bfe5-b592ecf71936 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:56.940046 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-81513300-0d65-49df-bfe5-b592ecf71936 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:57.313234 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-05e4340a-d028-48d0-8d40-86cac780b367 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:57.322410 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-81513300-0d65-49df-bfe5-b592ecf71936 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ec114f8ece434aa496cd401494e2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a05b1a0a7479db84b762eca23b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:57.326924 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-05e4340a-d028-48d0-8d40-86cac780b367 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/0874eafa-ffa2-4257-b6c5-66e4bef983db" status: 200 len: 1507 microversion: 2.1 time: 0.482190 Jan 15 20:56:57.328602 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1211/2484] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:56 2022] GET /compute/v2.1/servers/0874eafa-ffa2-4257-b6c5-66e4bef983db => generated 1507 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:57.341851 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-81513300-0d65-49df-bfe5-b592ecf71936 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] 10.222.0.46 "GET /compute/v2.1/servers/84fe1922-dca1-4713-9ea1-bdd26b309ce6" status: 200 len: 1494 microversion: 2.1 time: 0.434905 Jan 15 20:56:57.343018 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1274/2485] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:56 2022] GET /compute/v2.1/servers/84fe1922-dca1-4713-9ea1-bdd26b309ce6 => generated 1494 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:57.343552 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2ed01fab-ebb2-4812-a386-53759cddec55 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:57.347298 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-2ed01fab-ebb2-4812-a386-53759cddec55 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] [instance: 62ae2a15-8c2c-4dad-971f-0611238103a3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:57.348339 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0e49cdd5-8392-470f-b4e8-0d9f79efe12c tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:57.349561 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-0e49cdd5-8392-470f-b4e8-0d9f79efe12c tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] [instance: b1eb0bef-5aaf-46d6-8739-b12303df9842] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:57.357384 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0e49cdd5-8392-470f-b4e8-0d9f79efe12c tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:57.358261 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0e49cdd5-8392-470f-b4e8-0d9f79efe12c tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:57.359361 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0e49cdd5-8392-470f-b4e8-0d9f79efe12c tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:57.359971 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0e49cdd5-8392-470f-b4e8-0d9f79efe12c tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:57.360462 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2ed01fab-ebb2-4812-a386-53759cddec55 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:57.361062 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2ed01fab-ebb2-4812-a386-53759cddec55 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:57.372790 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2ed01fab-ebb2-4812-a386-53759cddec55 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:57.374380 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2ed01fab-ebb2-4812-a386-53759cddec55 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:57.437187 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0e49cdd5-8392-470f-b4e8-0d9f79efe12c tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] 10.222.0.46 "POST /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842/action" status: 200 len: 32632 microversion: 2.1 time: 0.090818 Jan 15 20:56:57.438041 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1275/2486] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:56:57 2022] POST /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842/action => generated 32632 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:56:57.444231 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7daae41c-fb21-4f1d-ad97-8a052e226f88 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:57.446942 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-7daae41c-fb21-4f1d-ad97-8a052e226f88 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] [instance: 70bf65cf-55e2-459a-aaf1-c3eb851a6ccf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:57.457392 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7daae41c-fb21-4f1d-ad97-8a052e226f88 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:57.458071 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7daae41c-fb21-4f1d-ad97-8a052e226f88 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:57.459201 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7daae41c-fb21-4f1d-ad97-8a052e226f88 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:57.459906 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7daae41c-fb21-4f1d-ad97-8a052e226f88 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:57.472141 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2ed01fab-ebb2-4812-a386-53759cddec55 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] 10.222.0.46 "POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action" status: 200 len: 24567 microversion: 2.1 time: 0.141054 Jan 15 20:56:57.477144 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1212/2487] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:56:57 2022] POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action => generated 24567 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:56:57.491897 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-0601c3fa-f14e-4e6c-b9f6-ecd5db307d0d tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Calling method '.version_select at 0x7f30c872e160>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:57.527297 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7daae41c-fb21-4f1d-ad97-8a052e226f88 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] 10.222.0.46 "POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action" status: 200 len: 24571 microversion: 2.1 time: 0.087632 Jan 15 20:56:57.527967 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1276/2488] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:56:57 2022] POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action => generated 24571 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:56:57.546315 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7be7f8e4-47be-44f6-b330-3580bec04ff4 tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:57.553238 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-7be7f8e4-47be-44f6-b330-3580bec04ff4 tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] [instance: 84fe1922-dca1-4713-9ea1-bdd26b309ce6] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:57.561831 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7be7f8e4-47be-44f6-b330-3580bec04ff4 tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:57.562466 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7be7f8e4-47be-44f6-b330-3580bec04ff4 tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:57.563509 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7be7f8e4-47be-44f6-b330-3580bec04ff4 tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:57.564122 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7be7f8e4-47be-44f6-b330-3580bec04ff4 tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:57.575638 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-0601c3fa-f14e-4e6c-b9f6-ecd5db307d0d tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] 10.222.0.46 "GET /compute/v2.1/images/198bbbad-af58-4eb7-8548-fd851471e431" status: 200 len: 1452 microversion: 2.1 time: 0.097030 Jan 15 20:56:57.577863 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1213/2489] 10.222.0.46 () {58 vars in 1232 bytes} [Sat Jan 15 20:56:57 2022] GET /compute/v2.1/images/198bbbad-af58-4eb7-8548-fd851471e431 => generated 1452 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:57.791847 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7be7f8e4-47be-44f6-b330-3580bec04ff4 tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/84fe1922-dca1-4713-9ea1-bdd26b309ce6" status: 200 len: 1645 microversion: 2.1 time: 0.262231 Jan 15 20:56:57.810946 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1277/2490] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:57 2022] GET /compute/v2.1/servers/84fe1922-dca1-4713-9ea1-bdd26b309ce6 => generated 1645 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:57.814751 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-53d4bb7c-3398-4e48-843c-5c32d4d5b494 tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:57.818529 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:56:57.818529 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:56:57.821757 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-53d4bb7c-3398-4e48-843c-5c32d4d5b494 tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:57.822390 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-53d4bb7c-3398-4e48-843c-5c32d4d5b494 tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:57.824192 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-53d4bb7c-3398-4e48-843c-5c32d4d5b494 tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:57.824820 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-53d4bb7c-3398-4e48-843c-5c32d4d5b494 tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:57.857236 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-53d4bb7c-3398-4e48-843c-5c32d4d5b494 tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] 10.222.0.46 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.048353 Jan 15 20:56:57.858938 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1214/2491] 10.222.0.46 () {58 vars in 1175 bytes} [Sat Jan 15 20:56:57 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 20:56:58.346329 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-14dd7a31-5050-46d5-86c3-2149f6019ca9 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:58.347397 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-14dd7a31-5050-46d5-86c3-2149f6019ca9 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: 0874eafa-ffa2-4257-b6c5-66e4bef983db] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:58.383377 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-14dd7a31-5050-46d5-86c3-2149f6019ca9 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:58.386503 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-14dd7a31-5050-46d5-86c3-2149f6019ca9 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:58.387417 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-14dd7a31-5050-46d5-86c3-2149f6019ca9 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:58.390060 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-14dd7a31-5050-46d5-86c3-2149f6019ca9 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:58.450569 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b8ca13d4-2569-4792-a48d-9047880d6422 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:58.451635 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b8ca13d4-2569-4792-a48d-9047880d6422 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] [instance: b1eb0bef-5aaf-46d6-8739-b12303df9842] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:58.468416 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b8ca13d4-2569-4792-a48d-9047880d6422 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:58.469020 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b8ca13d4-2569-4792-a48d-9047880d6422 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:58.469966 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b8ca13d4-2569-4792-a48d-9047880d6422 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:58.470423 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b8ca13d4-2569-4792-a48d-9047880d6422 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:58.566918 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b8ca13d4-2569-4792-a48d-9047880d6422 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] 10.222.0.46 "POST /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842/action" status: 200 len: 32632 microversion: 2.1 time: 0.120957 Jan 15 20:56:58.567573 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1215/2492] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:56:58 2022] POST /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842/action => generated 32632 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 20:56:58.591320 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-073066ba-2e18-4891-b0dc-3c0486dcb48f tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:58.593580 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-073066ba-2e18-4891-b0dc-3c0486dcb48f tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] [instance: 62ae2a15-8c2c-4dad-971f-0611238103a3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:58.616613 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-073066ba-2e18-4891-b0dc-3c0486dcb48f tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:58.617099 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-073066ba-2e18-4891-b0dc-3c0486dcb48f tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:58.617905 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-073066ba-2e18-4891-b0dc-3c0486dcb48f tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:58.618349 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-073066ba-2e18-4891-b0dc-3c0486dcb48f tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:58.696933 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-14dd7a31-5050-46d5-86c3-2149f6019ca9 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:56:58.714820 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-14dd7a31-5050-46d5-86c3-2149f6019ca9 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/0874eafa-ffa2-4257-b6c5-66e4bef983db" status: 200 len: 1507 microversion: 2.1 time: 0.372119 Jan 15 20:56:58.719185 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1278/2493] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:58 2022] GET /compute/v2.1/servers/0874eafa-ffa2-4257-b6c5-66e4bef983db => generated 1507 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:58.726291 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-85e8fcf7-a042-4c49-9a06-ba1202cf68ba tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:58.727667 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-85e8fcf7-a042-4c49-9a06-ba1202cf68ba tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] [instance: 70bf65cf-55e2-459a-aaf1-c3eb851a6ccf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:58.738552 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-85e8fcf7-a042-4c49-9a06-ba1202cf68ba tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:58.739287 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-85e8fcf7-a042-4c49-9a06-ba1202cf68ba tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:58.740405 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-85e8fcf7-a042-4c49-9a06-ba1202cf68ba tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:58.748046 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-85e8fcf7-a042-4c49-9a06-ba1202cf68ba tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:58.758104 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-073066ba-2e18-4891-b0dc-3c0486dcb48f tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] 10.222.0.46 "POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action" status: 200 len: 24567 microversion: 2.1 time: 0.189008 Jan 15 20:56:58.759216 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1216/2494] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:56:58 2022] POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action => generated 24567 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:56:58.768142 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9069fd5a-282c-47d0-bb13-e472eef0ab35 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Calling method '.version_select at 0x7f30c87efca0>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:58.806478 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-85e8fcf7-a042-4c49-9a06-ba1202cf68ba tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] 10.222.0.46 "POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action" status: 200 len: 24571 microversion: 2.1 time: 0.085112 Jan 15 20:56:58.810259 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1279/2495] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:56:58 2022] POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action => generated 24571 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:56:58.872375 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-9069fd5a-282c-47d0-bb13-e472eef0ab35 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] 10.222.0.46 "GET /compute/v2.1/images/198bbbad-af58-4eb7-8548-fd851471e431" status: 200 len: 1452 microversion: 2.1 time: 0.111759 Jan 15 20:56:58.880658 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1217/2496] 10.222.0.46 () {58 vars in 1232 bytes} [Sat Jan 15 20:56:58 2022] GET /compute/v2.1/images/198bbbad-af58-4eb7-8548-fd851471e431 => generated 1452 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:56:59.501986 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-62ef2268-7cc1-43b5-84ca-32fa9441ae99 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "86102022-ce53-4922-9f6d-e99e017681d7", "device": "/dev/xvdb"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:59.505453 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-62ef2268-7cc1-43b5-84ca-32fa9441ae99 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] [instance: 84fe1922-dca1-4713-9ea1-bdd26b309ce6] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:59.519704 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-62ef2268-7cc1-43b5-84ca-32fa9441ae99 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:59.520542 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-62ef2268-7cc1-43b5-84ca-32fa9441ae99 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:59.522385 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-62ef2268-7cc1-43b5-84ca-32fa9441ae99 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:59.523349 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-62ef2268-7cc1-43b5-84ca-32fa9441ae99 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:59.592243 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ea0c9f43-85d0-4194-96cd-c12171f63c02 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:56:59.596882 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ea0c9f43-85d0-4194-96cd-c12171f63c02 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] [instance: b1eb0bef-5aaf-46d6-8739-b12303df9842] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:59.620554 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ea0c9f43-85d0-4194-96cd-c12171f63c02 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:59.621361 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ea0c9f43-85d0-4194-96cd-c12171f63c02 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:59.623969 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ea0c9f43-85d0-4194-96cd-c12171f63c02 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:59.625813 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ea0c9f43-85d0-4194-96cd-c12171f63c02 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:59.719002 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ea0c9f43-85d0-4194-96cd-c12171f63c02 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] 10.222.0.46 "POST /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842/action" status: 200 len: 32632 microversion: 2.1 time: 0.140135 Jan 15 20:56:59.739544 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1218/2497] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:56:59 2022] POST /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842/action => generated 32632 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:56:59.761190 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-fe2f4473-f01f-4417-bf65-5acb05de4a9f tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:56:59.763126 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-fe2f4473-f01f-4417-bf65-5acb05de4a9f tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: 0874eafa-ffa2-4257-b6c5-66e4bef983db] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:56:59.795027 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fe2f4473-f01f-4417-bf65-5acb05de4a9f tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:59.803963 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fe2f4473-f01f-4417-bf65-5acb05de4a9f tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:56:59.805119 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fe2f4473-f01f-4417-bf65-5acb05de4a9f tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:56:59.807450 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fe2f4473-f01f-4417-bf65-5acb05de4a9f tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:00.067051 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-62ef2268-7cc1-43b5-84ca-32fa9441ae99 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] 10.222.0.46 "POST /compute/v2.1/servers/84fe1922-dca1-4713-9ea1-bdd26b309ce6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.572655 Jan 15 20:57:00.068138 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1280/2498] 10.222.0.46 () {60 vars in 1322 bytes} [Sat Jan 15 20:56:59 2022] POST /compute/v2.1/servers/84fe1922-dca1-4713-9ea1-bdd26b309ce6/os-volume_attachments => generated 194 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:57:00.087728 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a2de54ae-7679-48a6-9eb2-5b88f399cdfd tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:57:00.093424 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a2de54ae-7679-48a6-9eb2-5b88f399cdfd tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] [instance: 62ae2a15-8c2c-4dad-971f-0611238103a3] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:00.109615 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a2de54ae-7679-48a6-9eb2-5b88f399cdfd tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:00.109802 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a2de54ae-7679-48a6-9eb2-5b88f399cdfd tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:00.110686 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a2de54ae-7679-48a6-9eb2-5b88f399cdfd tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:00.111117 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a2de54ae-7679-48a6-9eb2-5b88f399cdfd tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:00.230937 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-fe2f4473-f01f-4417-bf65-5acb05de4a9f tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:57:00.245228 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-fe2f4473-f01f-4417-bf65-5acb05de4a9f tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/0874eafa-ffa2-4257-b6c5-66e4bef983db" status: 200 len: 1507 microversion: 2.1 time: 0.497921 Jan 15 20:57:00.245228 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1219/2499] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:56:59 2022] GET /compute/v2.1/servers/0874eafa-ffa2-4257-b6c5-66e4bef983db => generated 1507 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:00.254431 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-6123a645-e3ae-4c9d-8671-2ca6c3e592c3 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:57:00.255420 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-6123a645-e3ae-4c9d-8671-2ca6c3e592c3 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] [instance: 70bf65cf-55e2-459a-aaf1-c3eb851a6ccf] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:00.256435 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a2de54ae-7679-48a6-9eb2-5b88f399cdfd tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] 10.222.0.46 "POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action" status: 200 len: 24567 microversion: 2.1 time: 0.180732 Jan 15 20:57:00.260896 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1281/2500] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:57:00 2022] POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action => generated 24567 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:57:00.278109 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6123a645-e3ae-4c9d-8671-2ca6c3e592c3 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:00.278564 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6123a645-e3ae-4c9d-8671-2ca6c3e592c3 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:00.279367 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6123a645-e3ae-4c9d-8671-2ca6c3e592c3 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:00.279816 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6123a645-e3ae-4c9d-8671-2ca6c3e592c3 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:00.294617 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-fa997f3f-99c7-4c80-ab03-c4b384818e44 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Calling method '.version_select at 0x7f30cec90b80>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:00.334753 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-6123a645-e3ae-4c9d-8671-2ca6c3e592c3 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] 10.222.0.46 "POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action" status: 200 len: 24571 microversion: 2.1 time: 0.089492 Jan 15 20:57:00.335835 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1220/2501] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:57:00 2022] POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action => generated 24571 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:57:00.393617 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-fa997f3f-99c7-4c80-ab03-c4b384818e44 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] 10.222.0.46 "GET /compute/v2.1/images/198bbbad-af58-4eb7-8548-fd851471e431" status: 200 len: 1452 microversion: 2.1 time: 0.128296 Jan 15 20:57:00.397178 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1282/2502] 10.222.0.46 () {58 vars in 1232 bytes} [Sat Jan 15 20:57:00 2022] GET /compute/v2.1/images/198bbbad-af58-4eb7-8548-fd851471e431 => generated 1452 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:00.603586 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f2c75aee-76a7-4803-86b0-3481df363489 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-630101956", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "3e3aa82c-c20c-421b-9162-2caf64b5b86e"}]}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:57:00.712564 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.network.neutron [None req-f2c75aee-76a7-4803-86b0-3481df363489 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] validate_networks() for [('3e3aa82c-c20c-421b-9162-2caf64b5b86e', None, None, None, None, None)] {{(pid=129365) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 20:57:00.732297 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-6f95856b-1952-49c8-9bf5-88e57093c9cb tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:57:00.734451 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-6f95856b-1952-49c8-9bf5-88e57093c9cb tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] [instance: b1eb0bef-5aaf-46d6-8739-b12303df9842] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:00.750862 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6f95856b-1952-49c8-9bf5-88e57093c9cb tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:00.751724 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6f95856b-1952-49c8-9bf5-88e57093c9cb tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:00.756653 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6f95856b-1952-49c8-9bf5-88e57093c9cb tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:00.757478 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6f95856b-1952-49c8-9bf5-88e57093c9cb tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:00.865995 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-6f95856b-1952-49c8-9bf5-88e57093c9cb tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] 10.222.0.46 "POST /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842/action" status: 200 len: 32632 microversion: 2.1 time: 0.138875 Jan 15 20:57:00.873171 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1283/2503] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:57:00 2022] POST /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842/action => generated 32632 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 20:57:01.260140 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0020f89d-72db-47fb-ac78-aec9c10b1dee tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:01.263738 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-0020f89d-72db-47fb-ac78-aec9c10b1dee tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: 0874eafa-ffa2-4257-b6c5-66e4bef983db] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:01.273802 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0020f89d-72db-47fb-ac78-aec9c10b1dee tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:01.303085 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0020f89d-72db-47fb-ac78-aec9c10b1dee tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:01.304177 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0020f89d-72db-47fb-ac78-aec9c10b1dee tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:01.304628 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0020f89d-72db-47fb-ac78-aec9c10b1dee tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:01.691217 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-f2c75aee-76a7-4803-86b0-3481df363489 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Flavor limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 20:57:01.693383 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-f2c75aee-76a7-4803-86b0-3481df363489 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Image limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 20:57:01.695318 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-f2c75aee-76a7-4803-86b0-3481df363489 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Flavor pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 20:57:01.696921 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-f2c75aee-76a7-4803-86b0-3481df363489 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Image pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 20:57:01.702049 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-f2c75aee-76a7-4803-86b0-3481df363489 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 20:57:01.732955 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f2c75aee-76a7-4803-86b0-3481df363489 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:01.734158 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f2c75aee-76a7-4803-86b0-3481df363489 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:01.735401 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f2c75aee-76a7-4803-86b0-3481df363489 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:01.736490 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f2c75aee-76a7-4803-86b0-3481df363489 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:01.746425 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-0020f89d-72db-47fb-ac78-aec9c10b1dee tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:57:01.754504 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0020f89d-72db-47fb-ac78-aec9c10b1dee tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/0874eafa-ffa2-4257-b6c5-66e4bef983db" status: 200 len: 1507 microversion: 2.1 time: 0.498630 Jan 15 20:57:01.759266 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1284/2504] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:57:01 2022] GET /compute/v2.1/servers/0874eafa-ffa2-4257-b6c5-66e4bef983db => generated 1507 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:57:01.765557 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-f2c75aee-76a7-4803-86b0-3481df363489 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Getting quotas for project 4e4a067d84534cbd879732a1b7c057ae. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:57:01.780429 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-f2c75aee-76a7-4803-86b0-3481df363489 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Getting quotas for user 7754a1e8134b4da4803400ca6bb4c540 and project 4e4a067d84534cbd879732a1b7c057ae. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:57:01.789389 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7900ebd3-63f8-4914-97ce-aee6034778d8 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:57:01.790877 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-7900ebd3-63f8-4914-97ce-aee6034778d8 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] [instance: 62ae2a15-8c2c-4dad-971f-0611238103a3] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:01.801691 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f2c75aee-76a7-4803-86b0-3481df363489 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Going to run 3 instances... {{(pid=129365) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 20:57:01.806174 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f2c75aee-76a7-4803-86b0-3481df363489 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] [instance: 672fd3e7-4b14-4aa7-97da-6245dfabb878] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129365) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 20:57:01.816255 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7900ebd3-63f8-4914-97ce-aee6034778d8 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:01.816706 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7900ebd3-63f8-4914-97ce-aee6034778d8 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:01.817545 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7900ebd3-63f8-4914-97ce-aee6034778d8 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:01.819067 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7900ebd3-63f8-4914-97ce-aee6034778d8 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:01.862414 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f2c75aee-76a7-4803-86b0-3481df363489 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] [instance: 733106f5-de5a-4e36-9181-b277ccd1f423] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=672fd3e7-4b14-4aa7-97da-6245dfabb878,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129365) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 20:57:01.926874 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7900ebd3-63f8-4914-97ce-aee6034778d8 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] 10.222.0.46 "POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action" status: 200 len: 24567 microversion: 2.1 time: 0.166115 Jan 15 20:57:01.927672 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f2c75aee-76a7-4803-86b0-3481df363489 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] [instance: 3809db38-b5f5-471e-b6ba-de39c46d53a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=733106f5-de5a-4e36-9181-b277ccd1f423,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129365) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 20:57:01.928334 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1285/2505] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:57:01 2022] POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action => generated 24567 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:57:01.940427 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c6dae4a5-cb5c-459f-8796-76cc8d4c4b21 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:57:01.942394 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c6dae4a5-cb5c-459f-8796-76cc8d4c4b21 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] [instance: 70bf65cf-55e2-459a-aaf1-c3eb851a6ccf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:01.952038 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c6dae4a5-cb5c-459f-8796-76cc8d4c4b21 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:01.952733 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c6dae4a5-cb5c-459f-8796-76cc8d4c4b21 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:01.953766 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c6dae4a5-cb5c-459f-8796-76cc8d4c4b21 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:01.955261 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c6dae4a5-cb5c-459f-8796-76cc8d4c4b21 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:02.014203 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c6dae4a5-cb5c-459f-8796-76cc8d4c4b21 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] 10.222.0.46 "POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action" status: 200 len: 24571 microversion: 2.1 time: 0.084141 Jan 15 20:57:02.019645 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1286/2506] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:57:01 2022] POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action => generated 24571 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:57:02.026131 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-89e271ec-3159-4a86-818d-d15bef0f5d0a tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Calling method '.version_select at 0x7f30ced03040>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:02.061663 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f2c75aee-76a7-4803-86b0-3481df363489 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.709043 Jan 15 20:57:02.076935 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1221/2507] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 20:57:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1725 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 20:57:02.093518 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-644d9a70-2e8f-426b-87f6-ab83d78e8fc4 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:57:02.099418 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-644d9a70-2e8f-426b-87f6-ab83d78e8fc4 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] [instance: b1eb0bef-5aaf-46d6-8739-b12303df9842] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:02.124743 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-644d9a70-2e8f-426b-87f6-ab83d78e8fc4 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:02.125469 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-644d9a70-2e8f-426b-87f6-ab83d78e8fc4 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:02.127883 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-644d9a70-2e8f-426b-87f6-ab83d78e8fc4 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:02.141224 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-644d9a70-2e8f-426b-87f6-ab83d78e8fc4 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:02.171017 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-89e271ec-3159-4a86-818d-d15bef0f5d0a tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] 10.222.0.46 "GET /compute/v2.1/images/198bbbad-af58-4eb7-8548-fd851471e431" status: 200 len: 1452 microversion: 2.1 time: 0.149765 Jan 15 20:57:02.171619 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1287/2508] 10.222.0.46 () {58 vars in 1232 bytes} [Sat Jan 15 20:57:02 2022] GET /compute/v2.1/images/198bbbad-af58-4eb7-8548-fd851471e431 => generated 1452 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:02.190471 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-58c8ebe5-c4b8-428d-b336-537af680c0b6 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:02.196751 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:57:02.196751 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:57:02.198991 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-58c8ebe5-c4b8-428d-b336-537af680c0b6 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7754a1e8134b4da4803400ca6bb4c540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4a067d84534cbd879732a1b7c057ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:57:02.200718 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-58c8ebe5-c4b8-428d-b336-537af680c0b6 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Searching by: {'deleted': False, 'project_id': '4e4a067d84534cbd879732a1b7c057ae'} {{(pid=129366) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 15 20:57:02.236493 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-58c8ebe5-c4b8-428d-b336-537af680c0b6 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:02.236966 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-58c8ebe5-c4b8-428d-b336-537af680c0b6 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:02.238466 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-58c8ebe5-c4b8-428d-b336-537af680c0b6 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:02.239102 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-58c8ebe5-c4b8-428d-b336-537af680c0b6 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:02.267418 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-644d9a70-2e8f-426b-87f6-ab83d78e8fc4 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] 10.222.0.46 "POST /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842/action" status: 200 len: 32632 microversion: 2.1 time: 0.188627 Jan 15 20:57:02.269214 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1222/2509] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:57:02 2022] POST /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842/action => generated 32632 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:57:02.286470 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-58c8ebe5-c4b8-428d-b336-537af680c0b6 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] 10.222.0.46 "GET /compute/v2.1/servers" status: 200 len: 1015 microversion: 2.1 time: 0.109893 Jan 15 20:57:02.292912 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1288/2510] 10.222.0.46 () {58 vars in 1124 bytes} [Sat Jan 15 20:57:02 2022] GET /compute/v2.1/servers => generated 1015 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:02.305111 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-142c64b7-f0d7-4430-a1e9-d711f03fabe2 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:02.305874 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-142c64b7-f0d7-4430-a1e9-d711f03fabe2 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] [instance: 3809db38-b5f5-471e-b6ba-de39c46d53a3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:02.450211 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-142c64b7-f0d7-4430-a1e9-d711f03fabe2 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7754a1e8134b4da4803400ca6bb4c540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4a067d84534cbd879732a1b7c057ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:57:02.461824 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-142c64b7-f0d7-4430-a1e9-d711f03fabe2 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] 10.222.0.46 "GET /compute/v2.1/servers/3809db38-b5f5-471e-b6ba-de39c46d53a3" status: 200 len: 1222 microversion: 2.1 time: 0.165564 Jan 15 20:57:02.464286 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1223/2511] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:57:02 2022] GET /compute/v2.1/servers/3809db38-b5f5-471e-b6ba-de39c46d53a3 => generated 1222 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:02.777252 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-74867173-ecb8-4776-a1ea-63372e5a19f6 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:02.778638 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-74867173-ecb8-4776-a1ea-63372e5a19f6 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: 0874eafa-ffa2-4257-b6c5-66e4bef983db] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:02.788533 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-74867173-ecb8-4776-a1ea-63372e5a19f6 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:02.789692 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-74867173-ecb8-4776-a1ea-63372e5a19f6 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:02.791183 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-74867173-ecb8-4776-a1ea-63372e5a19f6 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:02.792543 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-74867173-ecb8-4776-a1ea-63372e5a19f6 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:02.940990 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-440fb9d6-cb52-4a70-a5be-8d9903271aa8 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:57:02.942776 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-440fb9d6-cb52-4a70-a5be-8d9903271aa8 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] [instance: 62ae2a15-8c2c-4dad-971f-0611238103a3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:02.972561 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-440fb9d6-cb52-4a70-a5be-8d9903271aa8 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:02.977906 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-440fb9d6-cb52-4a70-a5be-8d9903271aa8 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:02.979523 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-440fb9d6-cb52-4a70-a5be-8d9903271aa8 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:02.980186 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-440fb9d6-cb52-4a70-a5be-8d9903271aa8 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:03.038608 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-440fb9d6-cb52-4a70-a5be-8d9903271aa8 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] 10.222.0.46 "POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action" status: 200 len: 24567 microversion: 2.1 time: 0.098629 Jan 15 20:57:03.041124 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1224/2512] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:57:02 2022] POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action => generated 24567 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 20:57:03.063963 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-74867173-ecb8-4776-a1ea-63372e5a19f6 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:57:03.081641 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-74867173-ecb8-4776-a1ea-63372e5a19f6 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/0874eafa-ffa2-4257-b6c5-66e4bef983db" status: 200 len: 1507 microversion: 2.1 time: 0.308970 Jan 15 20:57:03.083615 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1289/2513] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:57:02 2022] GET /compute/v2.1/servers/0874eafa-ffa2-4257-b6c5-66e4bef983db => generated 1507 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:03.106220 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a792b425-428f-4f36-965d-8fa21705e68e tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:57:03.110714 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a792b425-428f-4f36-965d-8fa21705e68e tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] [instance: 70bf65cf-55e2-459a-aaf1-c3eb851a6ccf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:03.127468 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a792b425-428f-4f36-965d-8fa21705e68e tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:03.128030 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a792b425-428f-4f36-965d-8fa21705e68e tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:03.128814 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a792b425-428f-4f36-965d-8fa21705e68e tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:03.129314 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a792b425-428f-4f36-965d-8fa21705e68e tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:03.161231 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-aab28846-8ae3-4738-a8cf-289c83945130 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-26268426", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f1750852-5b84-449c-ab41-df71a9139482"}]}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:57:03.189362 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a792b425-428f-4f36-965d-8fa21705e68e tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] 10.222.0.46 "POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action" status: 200 len: 24571 microversion: 2.1 time: 0.092855 Jan 15 20:57:03.191523 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1290/2514] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:57:03 2022] POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action => generated 24571 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:57:03.198841 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e06b5176-a2a4-4c4b-b831-392ee7858299 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Calling method '.version_select at 0x7f30cebd1ca0>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:03.248484 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.network.neutron [None req-aab28846-8ae3-4738-a8cf-289c83945130 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] validate_networks() for [('f1750852-5b84-449c-ab41-df71a9139482', None, None, None, None, None)] {{(pid=129365) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 20:57:03.301181 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e06b5176-a2a4-4c4b-b831-392ee7858299 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] 10.222.0.46 "GET /compute/v2.1/images/198bbbad-af58-4eb7-8548-fd851471e431" status: 200 len: 1461 microversion: 2.1 time: 0.107884 Jan 15 20:57:03.302755 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1291/2515] 10.222.0.46 () {58 vars in 1232 bytes} [Sat Jan 15 20:57:03 2022] GET /compute/v2.1/images/198bbbad-af58-4eb7-8548-fd851471e431 => generated 1461 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:03.313996 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-fce2cee4-e68c-4a89-acea-455737968719 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:57:03.316452 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-fce2cee4-e68c-4a89-acea-455737968719 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] [instance: b1eb0bef-5aaf-46d6-8739-b12303df9842] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:03.331273 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fce2cee4-e68c-4a89-acea-455737968719 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:03.332532 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fce2cee4-e68c-4a89-acea-455737968719 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:03.334990 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fce2cee4-e68c-4a89-acea-455737968719 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:03.336359 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fce2cee4-e68c-4a89-acea-455737968719 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:03.435235 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-fce2cee4-e68c-4a89-acea-455737968719 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] 10.222.0.46 "POST /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842/action" status: 200 len: 40774 microversion: 2.1 time: 0.129811 Jan 15 20:57:03.436570 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1292/2516] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:57:03 2022] POST /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842/action => generated 40774 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:57:03.453882 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a37d5fe5-9ac2-4b38-ab07-cdd976d4b05b tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Calling method '.version_select at 0x7f30c8e3c700>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:03.536341 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a37d5fe5-9ac2-4b38-ab07-cdd976d4b05b tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] 10.222.0.46 "GET /compute/v2.1/images/198bbbad-af58-4eb7-8548-fd851471e431" status: 200 len: 1461 microversion: 2.1 time: 0.097741 Jan 15 20:57:03.538203 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1293/2517] 10.222.0.46 () {58 vars in 1232 bytes} [Sat Jan 15 20:57:03 2022] GET /compute/v2.1/images/198bbbad-af58-4eb7-8548-fd851471e431 => generated 1461 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:03.546868 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0a62a393-9a17-4b98-ac05-0e791a4ca450 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:03.548672 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-0a62a393-9a17-4b98-ac05-0e791a4ca450 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] [instance: b1eb0bef-5aaf-46d6-8739-b12303df9842] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:03.564347 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0a62a393-9a17-4b98-ac05-0e791a4ca450 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:03.565220 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0a62a393-9a17-4b98-ac05-0e791a4ca450 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:03.566501 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0a62a393-9a17-4b98-ac05-0e791a4ca450 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:03.567645 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0a62a393-9a17-4b98-ac05-0e791a4ca450 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:04.012881 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-0a62a393-9a17-4b98-ac05-0e791a4ca450 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c0085c7fa1d44e58b20181319ea00f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '964edbaeb4c944cfb68578886695266c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:57:04.023395 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0a62a393-9a17-4b98-ac05-0e791a4ca450 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] 10.222.0.46 "GET /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842" status: 200 len: 1710 microversion: 2.1 time: 0.482388 Jan 15 20:57:04.024818 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1294/2518] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:57:03 2022] GET /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842 => generated 1710 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:04.031619 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-faf152a5-e158-42c2-bed3-0708071192da tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:04.032592 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-faf152a5-e158-42c2-bed3-0708071192da tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] [instance: 3809db38-b5f5-471e-b6ba-de39c46d53a3] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:04.039646 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-faf152a5-e158-42c2-bed3-0708071192da tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:04.040941 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-faf152a5-e158-42c2-bed3-0708071192da tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:04.042962 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-faf152a5-e158-42c2-bed3-0708071192da tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:04.043626 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-faf152a5-e158-42c2-bed3-0708071192da tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:04.060189 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-aab28846-8ae3-4738-a8cf-289c83945130 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Flavor limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 20:57:04.060709 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-aab28846-8ae3-4738-a8cf-289c83945130 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Image limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 20:57:04.061256 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-aab28846-8ae3-4738-a8cf-289c83945130 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Flavor pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 20:57:04.061742 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-aab28846-8ae3-4738-a8cf-289c83945130 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Image pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 20:57:04.062460 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-aab28846-8ae3-4738-a8cf-289c83945130 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 20:57:04.077153 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-aab28846-8ae3-4738-a8cf-289c83945130 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:04.078146 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-aab28846-8ae3-4738-a8cf-289c83945130 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:04.079482 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-aab28846-8ae3-4738-a8cf-289c83945130 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:04.079981 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-aab28846-8ae3-4738-a8cf-289c83945130 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:04.117349 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-aab28846-8ae3-4738-a8cf-289c83945130 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Getting quotas for project f3a6720be5fb4de7bcd77cc7ef9d8000. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:57:04.125332 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-aab28846-8ae3-4738-a8cf-289c83945130 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Getting quotas for user 05483ff6eec84f78a091b29cfbcf61f8 and project f3a6720be5fb4de7bcd77cc7ef9d8000. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:57:04.144025 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-aab28846-8ae3-4738-a8cf-289c83945130 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Going to run 1 instances... {{(pid=129365) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 20:57:04.147471 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-aab28846-8ae3-4738-a8cf-289c83945130 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] [instance: e04f7a96-62cb-4aae-9612-aa8df88aef61] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129365) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 20:57:04.162845 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-faf152a5-e158-42c2-bed3-0708071192da tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7754a1e8134b4da4803400ca6bb4c540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4a067d84534cbd879732a1b7c057ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:57:04.176307 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-faf152a5-e158-42c2-bed3-0708071192da tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] 10.222.0.46 "GET /compute/v2.1/servers/3809db38-b5f5-471e-b6ba-de39c46d53a3" status: 200 len: 1274 microversion: 2.1 time: 0.149444 Jan 15 20:57:04.177446 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1295/2519] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:57:04 2022] GET /compute/v2.1/servers/3809db38-b5f5-471e-b6ba-de39c46d53a3 => generated 1274 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:04.184192 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-3d7068f0-ddf4-46aa-87a0-581ec7f7cc03 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:04.185558 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-3d7068f0-ddf4-46aa-87a0-581ec7f7cc03 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] [instance: bffd829f-bc6e-40a7-a9d8-59af77e5b10d] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:04.196120 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3d7068f0-ddf4-46aa-87a0-581ec7f7cc03 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:04.196602 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3d7068f0-ddf4-46aa-87a0-581ec7f7cc03 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:04.197522 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3d7068f0-ddf4-46aa-87a0-581ec7f7cc03 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:04.197989 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3d7068f0-ddf4-46aa-87a0-581ec7f7cc03 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:04.209844 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-aab28846-8ae3-4738-a8cf-289c83945130 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.166224 Jan 15 20:57:04.211473 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1225/2520] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 20:57:03 2022] POST /compute/v2.1/servers => generated 383 bytes in 1170 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 20:57:04.216531 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-784fa228-d45a-453d-aaa4-9870e07764d0 tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:04.217559 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-784fa228-d45a-453d-aaa4-9870e07764d0 tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] [instance: 84fe1922-dca1-4713-9ea1-bdd26b309ce6] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:04.226752 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-784fa228-d45a-453d-aaa4-9870e07764d0 tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:04.227069 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-784fa228-d45a-453d-aaa4-9870e07764d0 tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:04.227854 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-784fa228-d45a-453d-aaa4-9870e07764d0 tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:04.228343 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-784fa228-d45a-453d-aaa4-9870e07764d0 tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:04.729912 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-3d7068f0-ddf4-46aa-87a0-581ec7f7cc03 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52bd234a49b24c1a8bb60ad42c0db262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb6e08a94bc415fada171a2eca3e7ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:57:04.769245 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-3d7068f0-ddf4-46aa-87a0-581ec7f7cc03 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] 10.222.0.46 "GET /compute/v2.1/servers/bffd829f-bc6e-40a7-a9d8-59af77e5b10d" status: 200 len: 1467 microversion: 2.1 time: 0.581284 Jan 15 20:57:04.784801 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1296/2521] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:57:04 2022] GET /compute/v2.1/servers/bffd829f-bc6e-40a7-a9d8-59af77e5b10d => generated 1467 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:04.818501 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d472a96f-1b40-43ce-907b-382e74541b8f tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:57:04.826891 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-d472a96f-1b40-43ce-907b-382e74541b8f tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] [instance: 62ae2a15-8c2c-4dad-971f-0611238103a3] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:04.851570 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d472a96f-1b40-43ce-907b-382e74541b8f tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:04.852225 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d472a96f-1b40-43ce-907b-382e74541b8f tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:04.853475 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d472a96f-1b40-43ce-907b-382e74541b8f tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:04.857882 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d472a96f-1b40-43ce-907b-382e74541b8f tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:04.964675 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d472a96f-1b40-43ce-907b-382e74541b8f tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] 10.222.0.46 "POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action" status: 200 len: 24567 microversion: 2.1 time: 0.178223 Jan 15 20:57:04.966141 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1297/2522] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:57:04 2022] POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action => generated 24567 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:57:04.972289 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-fa4de9a4-b737-4934-b30c-9eed3dec7133 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:04.973628 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-fa4de9a4-b737-4934-b30c-9eed3dec7133 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: 0874eafa-ffa2-4257-b6c5-66e4bef983db] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:04.984203 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fa4de9a4-b737-4934-b30c-9eed3dec7133 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:04.984682 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fa4de9a4-b737-4934-b30c-9eed3dec7133 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:04.985535 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fa4de9a4-b737-4934-b30c-9eed3dec7133 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:04.985915 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fa4de9a4-b737-4934-b30c-9eed3dec7133 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:05.114136 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-784fa228-d45a-453d-aaa4-9870e07764d0 tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/84fe1922-dca1-4713-9ea1-bdd26b309ce6" status: 200 len: 1691 microversion: 2.1 time: 0.901155 Jan 15 20:57:05.120399 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1226/2523] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:57:04 2022] GET /compute/v2.1/servers/84fe1922-dca1-4713-9ea1-bdd26b309ce6 => generated 1691 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:05.138237 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-0f742553-a6d5-4d63-8aa0-8102491d6417 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:57:05.141907 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-0f742553-a6d5-4d63-8aa0-8102491d6417 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] [instance: 70bf65cf-55e2-459a-aaf1-c3eb851a6ccf] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:05.163202 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0f742553-a6d5-4d63-8aa0-8102491d6417 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:05.163664 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0f742553-a6d5-4d63-8aa0-8102491d6417 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:05.165608 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0f742553-a6d5-4d63-8aa0-8102491d6417 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:05.167381 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0f742553-a6d5-4d63-8aa0-8102491d6417 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:05.246596 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-0f742553-a6d5-4d63-8aa0-8102491d6417 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] 10.222.0.46 "POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action" status: 200 len: 24571 microversion: 2.1 time: 0.123077 Jan 15 20:57:05.248849 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1227/2524] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:57:05 2022] POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action => generated 24571 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:57:05.255730 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-eb197b7c-1442-4732-b6e9-6cc66a383766 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:05.256661 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-eb197b7c-1442-4732-b6e9-6cc66a383766 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] [instance: e04f7a96-62cb-4aae-9612-aa8df88aef61] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:05.267006 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-eb197b7c-1442-4732-b6e9-6cc66a383766 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:05.267910 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-eb197b7c-1442-4732-b6e9-6cc66a383766 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:05.269295 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-eb197b7c-1442-4732-b6e9-6cc66a383766 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:05.272162 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-eb197b7c-1442-4732-b6e9-6cc66a383766 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:05.499314 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-eb197b7c-1442-4732-b6e9-6cc66a383766 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05483ff6eec84f78a091b29cfbcf61f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a6720be5fb4de7bcd77cc7ef9d8000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:57:05.509488 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-fa4de9a4-b737-4934-b30c-9eed3dec7133 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:57:05.519885 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-eb197b7c-1442-4732-b6e9-6cc66a383766 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] 10.222.0.46 "GET /compute/v2.1/servers/e04f7a96-62cb-4aae-9612-aa8df88aef61" status: 200 len: 1224 microversion: 2.1 time: 0.268768 Jan 15 20:57:05.522609 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-fa4de9a4-b737-4934-b30c-9eed3dec7133 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/0874eafa-ffa2-4257-b6c5-66e4bef983db" status: 200 len: 1507 microversion: 2.1 time: 0.555018 Jan 15 20:57:05.523728 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1298/2525] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:57:04 2022] GET /compute/v2.1/servers/0874eafa-ffa2-4257-b6c5-66e4bef983db => generated 1507 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:05.537766 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1228/2526] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:57:05 2022] GET /compute/v2.1/servers/e04f7a96-62cb-4aae-9612-aa8df88aef61 => generated 1224 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:05.547297 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-09ffff33-9606-458b-a5ca-90eb6933efe8 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:05.550674 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f11f9dc0-e6fc-4232-875a-482fcc3503e8 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1610804467"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:57:05.552159 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f11f9dc0-e6fc-4232-875a-482fcc3503e8 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] [instance: beffc13d-acd3-455e-96d6-be4bcbb81b88] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:05.555189 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:57:05.555189 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:57:05.561201 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-09ffff33-9606-458b-a5ca-90eb6933efe8 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4c0085c7fa1d44e58b20181319ea00f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '964edbaeb4c944cfb68578886695266c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:57:05.562460 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-09ffff33-9606-458b-a5ca-90eb6933efe8 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Searching by: {'deleted': False, 'project_id': '964edbaeb4c944cfb68578886695266c'} {{(pid=129366) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 15 20:57:05.569709 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f11f9dc0-e6fc-4232-875a-482fcc3503e8 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:05.571367 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-09ffff33-9606-458b-a5ca-90eb6933efe8 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:05.572044 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-09ffff33-9606-458b-a5ca-90eb6933efe8 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:05.572365 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f11f9dc0-e6fc-4232-875a-482fcc3503e8 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:05.573534 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-09ffff33-9606-458b-a5ca-90eb6933efe8 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:05.573745 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f11f9dc0-e6fc-4232-875a-482fcc3503e8 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:05.574254 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f11f9dc0-e6fc-4232-875a-482fcc3503e8 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:05.574615 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-09ffff33-9606-458b-a5ca-90eb6933efe8 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:05.617551 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.multi_cell_list [None req-09ffff33-9606-458b-a5ca-90eb6933efe8 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=129366) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jan 15 20:57:05.672831 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-09ffff33-9606-458b-a5ca-90eb6933efe8 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] 10.222.0.46 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.147466 Jan 15 20:57:05.679751 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1299/2527] 10.222.0.46 () {58 vars in 1124 bytes} [Sat Jan 15 20:57:05 2022] GET /compute/v2.1/servers => generated 340 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:57:05.685722 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-37ab256c-5c61-4a04-8bfb-0d7bd17a50b7 tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:57:05.686167 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-37ab256c-5c61-4a04-8bfb-0d7bd17a50b7 tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] [instance: 84fe1922-dca1-4713-9ea1-bdd26b309ce6] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:05.692473 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-37ab256c-5c61-4a04-8bfb-0d7bd17a50b7 tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:05.693086 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-37ab256c-5c61-4a04-8bfb-0d7bd17a50b7 tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:05.694018 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-37ab256c-5c61-4a04-8bfb-0d7bd17a50b7 tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:05.694551 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-37ab256c-5c61-4a04-8bfb-0d7bd17a50b7 tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:05.720890 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.objects.instance [None req-37ab256c-5c61-4a04-8bfb-0d7bd17a50b7 tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Lazy-loading 'flavor' on Instance uuid 84fe1922-dca1-4713-9ea1-bdd26b309ce6 {{(pid=129366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 20:57:05.735129 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-37ab256c-5c61-4a04-8bfb-0d7bd17a50b7 tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] [instance: 84fe1922-dca1-4713-9ea1-bdd26b309ce6] Going to try to live migrate instance to nch2-master-1 {{(pid=129366) live_migrate /opt/stack/nova/nova/compute/api.py:5255}} Jan 15 20:57:06.027620 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f11f9dc0-e6fc-4232-875a-482fcc3503e8 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] 10.222.0.46 "POST /compute/v2.1/servers/beffc13d-acd3-455e-96d6-be4bcbb81b88/action" status: 202 len: 0 microversion: 2.1 time: 0.487437 Jan 15 20:57:06.028540 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1229/2528] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:57:05 2022] POST /compute/v2.1/servers/beffc13d-acd3-455e-96d6-be4bcbb81b88/action => generated 0 bytes in 490 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jan 15 20:57:06.043495 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d83df058-ac60-4893-8e8c-a7014202cc91 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:06.045545 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d83df058-ac60-4893-8e8c-a7014202cc91 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] [instance: 3809db38-b5f5-471e-b6ba-de39c46d53a3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:06.056045 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d83df058-ac60-4893-8e8c-a7014202cc91 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:06.056714 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d83df058-ac60-4893-8e8c-a7014202cc91 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:06.059121 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d83df058-ac60-4893-8e8c-a7014202cc91 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:06.059932 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d83df058-ac60-4893-8e8c-a7014202cc91 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:06.206634 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-d83df058-ac60-4893-8e8c-a7014202cc91 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7754a1e8134b4da4803400ca6bb4c540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4a067d84534cbd879732a1b7c057ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:57:06.236723 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d83df058-ac60-4893-8e8c-a7014202cc91 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] 10.222.0.46 "GET /compute/v2.1/servers/3809db38-b5f5-471e-b6ba-de39c46d53a3" status: 200 len: 1280 microversion: 2.1 time: 0.190450 Jan 15 20:57:06.242428 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1230/2529] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:57:06 2022] GET /compute/v2.1/servers/3809db38-b5f5-471e-b6ba-de39c46d53a3 => generated 1280 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:06.269837 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-6a4958d5-3129-4a5d-9e9f-8af7d33b5c3c tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-213971325", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f1750852-5b84-449c-ab41-df71a9139482"}]}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:57:06.387892 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.network.neutron [None req-6a4958d5-3129-4a5d-9e9f-8af7d33b5c3c tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] validate_networks() for [('f1750852-5b84-449c-ab41-df71a9139482', None, None, None, None, None)] {{(pid=129365) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 20:57:07.714503 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-6a4958d5-3129-4a5d-9e9f-8af7d33b5c3c tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Flavor limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 20:57:07.716037 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-6a4958d5-3129-4a5d-9e9f-8af7d33b5c3c tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Image limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 20:57:07.716873 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-6a4958d5-3129-4a5d-9e9f-8af7d33b5c3c tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Flavor pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 20:57:07.717887 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-6a4958d5-3129-4a5d-9e9f-8af7d33b5c3c tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Image pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 20:57:07.718568 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-6a4958d5-3129-4a5d-9e9f-8af7d33b5c3c tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 20:57:07.734488 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6a4958d5-3129-4a5d-9e9f-8af7d33b5c3c tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:07.735314 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6a4958d5-3129-4a5d-9e9f-8af7d33b5c3c tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:07.736478 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6a4958d5-3129-4a5d-9e9f-8af7d33b5c3c tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:07.737019 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6a4958d5-3129-4a5d-9e9f-8af7d33b5c3c tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:07.764645 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-6a4958d5-3129-4a5d-9e9f-8af7d33b5c3c tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Getting quotas for project f3a6720be5fb4de7bcd77cc7ef9d8000. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:57:07.771942 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-6a4958d5-3129-4a5d-9e9f-8af7d33b5c3c tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Getting quotas for user 05483ff6eec84f78a091b29cfbcf61f8 and project f3a6720be5fb4de7bcd77cc7ef9d8000. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:57:07.797194 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-6a4958d5-3129-4a5d-9e9f-8af7d33b5c3c tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Going to run 1 instances... {{(pid=129365) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 20:57:07.799722 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-6a4958d5-3129-4a5d-9e9f-8af7d33b5c3c tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] [instance: 689dd504-e36e-41d0-a461-acce91952e7e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129365) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 20:57:07.868491 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-6a4958d5-3129-4a5d-9e9f-8af7d33b5c3c tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.623467 Jan 15 20:57:07.875428 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1231/2530] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 20:57:06 2022] POST /compute/v2.1/servers => generated 383 bytes in 1626 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 20:57:07.875428 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-48e51cbf-eb6c-46bc-9ef3-54c546c541ae tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:07.878735 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:57:07.878735 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:57:07.879999 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-48e51cbf-eb6c-46bc-9ef3-54c546c541ae tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4c0085c7fa1d44e58b20181319ea00f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '964edbaeb4c944cfb68578886695266c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:57:07.881069 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-48e51cbf-eb6c-46bc-9ef3-54c546c541ae tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Searching by: {'deleted': False, 'project_id': '964edbaeb4c944cfb68578886695266c'} {{(pid=129365) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 15 20:57:07.894015 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-48e51cbf-eb6c-46bc-9ef3-54c546c541ae tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:07.894378 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-48e51cbf-eb6c-46bc-9ef3-54c546c541ae tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:07.901293 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-48e51cbf-eb6c-46bc-9ef3-54c546c541ae tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:07.914319 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-48e51cbf-eb6c-46bc-9ef3-54c546c541ae tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:07.954501 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.multi_cell_list [None req-48e51cbf-eb6c-46bc-9ef3-54c546c541ae tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=129365) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jan 15 20:57:08.012943 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-48e51cbf-eb6c-46bc-9ef3-54c546c541ae tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c0085c7fa1d44e58b20181319ea00f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '964edbaeb4c944cfb68578886695266c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:57:08.021348 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-48e51cbf-eb6c-46bc-9ef3-54c546c541ae tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:08.022999 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-48e51cbf-eb6c-46bc-9ef3-54c546c541ae tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:08.256733 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-48e51cbf-eb6c-46bc-9ef3-54c546c541ae tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] 10.222.0.46 "GET /compute/v2.1/servers/detail" status: 200 len: 1713 microversion: 2.1 time: 0.385472 Jan 15 20:57:08.257598 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1232/2531] 10.222.0.46 () {58 vars in 1145 bytes} [Sat Jan 15 20:57:07 2022] GET /compute/v2.1/servers/detail => generated 1713 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:08.268060 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ddbbc3d3-29b7-4cf9-8dcd-12ba106174da tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:57:08.271292 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ddbbc3d3-29b7-4cf9-8dcd-12ba106174da tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] [instance: 62ae2a15-8c2c-4dad-971f-0611238103a3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:08.280215 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ddbbc3d3-29b7-4cf9-8dcd-12ba106174da tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:08.282733 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ddbbc3d3-29b7-4cf9-8dcd-12ba106174da tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:08.283608 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ddbbc3d3-29b7-4cf9-8dcd-12ba106174da tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:08.284060 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ddbbc3d3-29b7-4cf9-8dcd-12ba106174da tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:08.383860 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ddbbc3d3-29b7-4cf9-8dcd-12ba106174da tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] 10.222.0.46 "POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action" status: 200 len: 24567 microversion: 2.1 time: 0.124603 Jan 15 20:57:08.387274 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1233/2532] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:57:08 2022] POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action => generated 24567 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:57:08.400524 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-21ad4fa0-3a39-435a-b6d4-1a0d1ec1a895 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Calling method '.version_select at 0x7f30c90a7ee0>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:08.477600 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-21ad4fa0-3a39-435a-b6d4-1a0d1ec1a895 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] 10.222.0.46 "GET /compute/v2.1/images/9edcd3cd-5d8f-4a6a-9e1e-eff94d6299d6" status: 200 len: 1453 microversion: 2.1 time: 0.088245 Jan 15 20:57:08.483502 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1234/2533] 10.222.0.46 () {58 vars in 1232 bytes} [Sat Jan 15 20:57:08 2022] GET /compute/v2.1/images/9edcd3cd-5d8f-4a6a-9e1e-eff94d6299d6 => generated 1453 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:08.490061 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5256b0ee-a60b-4420-afa2-75222dc062b4 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:57:08.491197 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-5256b0ee-a60b-4420-afa2-75222dc062b4 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] [instance: 70bf65cf-55e2-459a-aaf1-c3eb851a6ccf] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:08.512425 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5256b0ee-a60b-4420-afa2-75222dc062b4 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:08.514091 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5256b0ee-a60b-4420-afa2-75222dc062b4 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:08.518061 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5256b0ee-a60b-4420-afa2-75222dc062b4 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:08.518531 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5256b0ee-a60b-4420-afa2-75222dc062b4 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:08.612173 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5256b0ee-a60b-4420-afa2-75222dc062b4 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] 10.222.0.46 "POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action" status: 200 len: 32642 microversion: 2.1 time: 0.129948 Jan 15 20:57:08.612901 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1235/2534] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:57:08 2022] POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action => generated 32642 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:57:08.618015 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-6ffb73e9-a20d-4031-9485-43653df92eeb tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:08.619038 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-6ffb73e9-a20d-4031-9485-43653df92eeb tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: 0874eafa-ffa2-4257-b6c5-66e4bef983db] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:08.626690 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6ffb73e9-a20d-4031-9485-43653df92eeb tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:08.627144 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6ffb73e9-a20d-4031-9485-43653df92eeb tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:08.628152 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6ffb73e9-a20d-4031-9485-43653df92eeb tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:08.628587 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6ffb73e9-a20d-4031-9485-43653df92eeb tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:08.828159 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-37ab256c-5c61-4a04-8bfb-0d7bd17a50b7 tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] 10.222.0.46 "POST /compute/v2.1/servers/84fe1922-dca1-4713-9ea1-bdd26b309ce6/action" status: 202 len: 0 microversion: 2.1 time: 3.146837 Jan 15 20:57:08.829517 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1300/2535] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:57:05 2022] POST /compute/v2.1/servers/84fe1922-dca1-4713-9ea1-bdd26b309ce6/action => generated 0 bytes in 3149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 20:57:08.836699 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-3d4f84d6-1f7c-4480-b8b7-f300f19103e6 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:08.844128 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-3d4f84d6-1f7c-4480-b8b7-f300f19103e6 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] [instance: 3809db38-b5f5-471e-b6ba-de39c46d53a3] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:08.870882 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3d4f84d6-1f7c-4480-b8b7-f300f19103e6 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:08.875063 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3d4f84d6-1f7c-4480-b8b7-f300f19103e6 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:08.876235 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3d4f84d6-1f7c-4480-b8b7-f300f19103e6 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:08.877300 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3d4f84d6-1f7c-4480-b8b7-f300f19103e6 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:09.123909 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-6ffb73e9-a20d-4031-9485-43653df92eeb tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:57:09.162346 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-6ffb73e9-a20d-4031-9485-43653df92eeb tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/0874eafa-ffa2-4257-b6c5-66e4bef983db" status: 200 len: 1523 microversion: 2.1 time: 0.547053 Jan 15 20:57:09.166966 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1236/2536] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:57:08 2022] GET /compute/v2.1/servers/0874eafa-ffa2-4257-b6c5-66e4bef983db => generated 1523 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:09.200860 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-812cfcae-fdb6-4616-bc0d-a1dac8449f7a tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:09.204780 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-812cfcae-fdb6-4616-bc0d-a1dac8449f7a tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] [instance: 689dd504-e36e-41d0-a461-acce91952e7e] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:09.226125 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-812cfcae-fdb6-4616-bc0d-a1dac8449f7a tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:09.228682 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-812cfcae-fdb6-4616-bc0d-a1dac8449f7a tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:09.231494 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-812cfcae-fdb6-4616-bc0d-a1dac8449f7a tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:09.235811 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-812cfcae-fdb6-4616-bc0d-a1dac8449f7a tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:09.548305 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-812cfcae-fdb6-4616-bc0d-a1dac8449f7a tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05483ff6eec84f78a091b29cfbcf61f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a6720be5fb4de7bcd77cc7ef9d8000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:57:09.563427 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-812cfcae-fdb6-4616-bc0d-a1dac8449f7a tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] 10.222.0.46 "GET /compute/v2.1/servers/689dd504-e36e-41d0-a461-acce91952e7e" status: 200 len: 1273 microversion: 2.1 time: 0.392987 Jan 15 20:57:09.564307 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1237/2537] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:57:09 2022] GET /compute/v2.1/servers/689dd504-e36e-41d0-a461-acce91952e7e => generated 1273 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:09.573961 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-3bcd0d37-8bf0-4fb8-b84a-12c3b41684ad req-d42eed7a-8e59-406f-9cd8-b405cafbe115 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bffd829f-bc6e-40a7-a9d8-59af77e5b10d", "name": "network-vif-unplugged", "status": "completed", "tag": "8b8cea34-6f8d-4a83-aaae-cfea3dbff75c"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:57:09.580593 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:57:09.580593 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:57:09.600479 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-3bcd0d37-8bf0-4fb8-b84a-12c3b41684ad req-d42eed7a-8e59-406f-9cd8-b405cafbe115 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:09.601346 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-3bcd0d37-8bf0-4fb8-b84a-12c3b41684ad req-d42eed7a-8e59-406f-9cd8-b405cafbe115 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:09.633047 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-3bcd0d37-8bf0-4fb8-b84a-12c3b41684ad req-d42eed7a-8e59-406f-9cd8-b405cafbe115 service nova] Creating event network-vif-unplugged:8b8cea34-6f8d-4a83-aaae-cfea3dbff75c for instance bffd829f-bc6e-40a7-a9d8-59af77e5b10d on nch2-master-1 Jan 15 20:57:09.670915 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-3bcd0d37-8bf0-4fb8-b84a-12c3b41684ad req-d42eed7a-8e59-406f-9cd8-b405cafbe115 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.103202 Jan 15 20:57:09.671888 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1238/2538] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:57:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:57:09.681147 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-130afba5-e9e6-4858-849a-a529a2ba07f5 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:09.695121 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-3d4f84d6-1f7c-4480-b8b7-f300f19103e6 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7754a1e8134b4da4803400ca6bb4c540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4a067d84534cbd879732a1b7c057ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:57:09.710038 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-130afba5-e9e6-4858-849a-a529a2ba07f5 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] 10.222.0.46 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.036714 Jan 15 20:57:09.722902 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-3d4f84d6-1f7c-4480-b8b7-f300f19103e6 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] 10.222.0.46 "GET /compute/v2.1/servers/3809db38-b5f5-471e-b6ba-de39c46d53a3" status: 200 len: 1322 microversion: 2.1 time: 0.887691 Jan 15 20:57:09.723563 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1301/2539] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:57:08 2022] GET /compute/v2.1/servers/3809db38-b5f5-471e-b6ba-de39c46d53a3 => generated 1322 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:09.724402 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1239/2540] 10.222.0.46 () {58 vars in 1136 bytes} [Sat Jan 15 20:57:09 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:57:09.729516 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-6d0c3147-76f4-4d87-95a8-046fc5d9ebca tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:57:09.738900 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-6d0c3147-76f4-4d87-95a8-046fc5d9ebca tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] [instance: 62ae2a15-8c2c-4dad-971f-0611238103a3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:09.740066 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-3889ccfb-26d9-403f-899d-eb93c634f588 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:09.748802 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-3889ccfb-26d9-403f-899d-eb93c634f588 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] [instance: 84fe1922-dca1-4713-9ea1-bdd26b309ce6] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:09.756398 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6d0c3147-76f4-4d87-95a8-046fc5d9ebca tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:09.763714 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6d0c3147-76f4-4d87-95a8-046fc5d9ebca tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:09.769763 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6d0c3147-76f4-4d87-95a8-046fc5d9ebca tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:09.772077 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3889ccfb-26d9-403f-899d-eb93c634f588 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:09.772538 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3889ccfb-26d9-403f-899d-eb93c634f588 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:09.772797 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6d0c3147-76f4-4d87-95a8-046fc5d9ebca tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:09.779008 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3889ccfb-26d9-403f-899d-eb93c634f588 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:09.779487 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3889ccfb-26d9-403f-899d-eb93c634f588 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:09.883938 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-6d0c3147-76f4-4d87-95a8-046fc5d9ebca tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] 10.222.0.46 "POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action" status: 200 len: 24567 microversion: 2.1 time: 0.154782 Jan 15 20:57:09.892962 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1240/2541] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:57:09 2022] POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action => generated 24567 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:57:09.905858 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9e2868b2-eff5-4f49-b904-5ad2b85099b2 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Calling method '.version_select at 0x7f30ceb6ac10>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:10.059617 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-9e2868b2-eff5-4f49-b904-5ad2b85099b2 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] 10.222.0.46 "GET /compute/v2.1/images/9edcd3cd-5d8f-4a6a-9e1e-eff94d6299d6" status: 200 len: 1453 microversion: 2.1 time: 0.163070 Jan 15 20:57:10.068289 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1241/2542] 10.222.0.46 () {58 vars in 1232 bytes} [Sat Jan 15 20:57:09 2022] GET /compute/v2.1/images/9edcd3cd-5d8f-4a6a-9e1e-eff94d6299d6 => generated 1453 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:10.115779 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a4155488-9a16-4048-8556-03d83f48060c tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:57:10.130061 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a4155488-9a16-4048-8556-03d83f48060c tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] [instance: 70bf65cf-55e2-459a-aaf1-c3eb851a6ccf] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:10.181238 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-3889ccfb-26d9-403f-899d-eb93c634f588 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ec114f8ece434aa496cd401494e2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a05b1a0a7479db84b762eca23b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:57:10.197128 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-3889ccfb-26d9-403f-899d-eb93c634f588 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] 10.222.0.46 "GET /compute/v2.1/servers/84fe1922-dca1-4713-9ea1-bdd26b309ce6" status: 200 len: 1550 microversion: 2.1 time: 0.470920 Jan 15 20:57:10.208295 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a4155488-9a16-4048-8556-03d83f48060c tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:10.212080 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a4155488-9a16-4048-8556-03d83f48060c tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:10.213617 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a4155488-9a16-4048-8556-03d83f48060c tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:10.215048 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1302/2543] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:57:09 2022] GET /compute/v2.1/servers/84fe1922-dca1-4713-9ea1-bdd26b309ce6 => generated 1550 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:10.215476 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a4155488-9a16-4048-8556-03d83f48060c tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:10.221927 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f29e7774-5325-48bb-a102-d24e97a619b9 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:10.222533 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f29e7774-5325-48bb-a102-d24e97a619b9 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: 0874eafa-ffa2-4257-b6c5-66e4bef983db] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:10.237917 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f29e7774-5325-48bb-a102-d24e97a619b9 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:10.239934 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f29e7774-5325-48bb-a102-d24e97a619b9 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:10.243904 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f29e7774-5325-48bb-a102-d24e97a619b9 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:10.244670 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f29e7774-5325-48bb-a102-d24e97a619b9 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:10.430271 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a4155488-9a16-4048-8556-03d83f48060c tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] 10.222.0.46 "POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action" status: 200 len: 32642 microversion: 2.1 time: 0.353457 Jan 15 20:57:10.437883 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1242/2544] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:57:10 2022] POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action => generated 32642 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:57:10.463248 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-0d4abd32-074d-4403-87f9-743439ceee5b tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:10.464782 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-0d4abd32-074d-4403-87f9-743439ceee5b tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] [instance: b1eb0bef-5aaf-46d6-8739-b12303df9842] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:10.483689 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0d4abd32-074d-4403-87f9-743439ceee5b tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:10.484165 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0d4abd32-074d-4403-87f9-743439ceee5b tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:10.485002 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0d4abd32-074d-4403-87f9-743439ceee5b tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:10.485440 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0d4abd32-074d-4403-87f9-743439ceee5b tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:10.553774 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-0d4abd32-074d-4403-87f9-743439ceee5b tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] [instance: b1eb0bef-5aaf-46d6-8739-b12303df9842] Going to try to terminate instance {{(pid=129365) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 20:57:10.608013 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-f29e7774-5325-48bb-a102-d24e97a619b9 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:57:10.615881 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f29e7774-5325-48bb-a102-d24e97a619b9 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/0874eafa-ffa2-4257-b6c5-66e4bef983db" status: 200 len: 1523 microversion: 2.1 time: 0.399661 Jan 15 20:57:10.616436 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1303/2545] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:57:10 2022] GET /compute/v2.1/servers/0874eafa-ffa2-4257-b6c5-66e4bef983db => generated 1523 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:10.639667 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-074b2bf0-b7f4-4314-beb7-e406ebb386a5 req-36753f69-c5ff-42fe-bff1-46829a22e655 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "672fd3e7-4b14-4aa7-97da-6245dfabb878", "tag": "c668866d-59e2-40a4-830d-eaaaf5f479ca"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:57:10.644089 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:57:10.644089 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:57:10.669401 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-074b2bf0-b7f4-4314-beb7-e406ebb386a5 req-36753f69-c5ff-42fe-bff1-46829a22e655 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:10.670093 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-074b2bf0-b7f4-4314-beb7-e406ebb386a5 req-36753f69-c5ff-42fe-bff1-46829a22e655 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:10.696938 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-074b2bf0-b7f4-4314-beb7-e406ebb386a5 req-36753f69-c5ff-42fe-bff1-46829a22e655 service nova] Creating event network-changed:c668866d-59e2-40a4-830d-eaaaf5f479ca for instance 672fd3e7-4b14-4aa7-97da-6245dfabb878 on nch1-master-1 Jan 15 20:57:10.705932 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-074b2bf0-b7f4-4314-beb7-e406ebb386a5 req-36753f69-c5ff-42fe-bff1-46829a22e655 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079703 Jan 15 20:57:10.706709 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1304/2546] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:57:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:57:10.712813 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1b1e6461-64ca-419b-807d-176773cabb67 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:10.714819 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-1b1e6461-64ca-419b-807d-176773cabb67 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] [instance: 689dd504-e36e-41d0-a461-acce91952e7e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:10.722426 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1b1e6461-64ca-419b-807d-176773cabb67 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:10.723958 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1b1e6461-64ca-419b-807d-176773cabb67 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:10.725149 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1b1e6461-64ca-419b-807d-176773cabb67 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:10.725957 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1b1e6461-64ca-419b-807d-176773cabb67 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:10.780890 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-0d4abd32-074d-4403-87f9-743439ceee5b tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] 10.222.0.46 "DELETE /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842" status: 204 len: 0 microversion: 2.1 time: 0.342302 Jan 15 20:57:10.781498 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1243/2547] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 20:57:10 2022] DELETE /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 20:57:10.799374 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-7d7098a3-bb17-4f79-8196-b47f450d2609 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:10.800077 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-7d7098a3-bb17-4f79-8196-b47f450d2609 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] [instance: 3809db38-b5f5-471e-b6ba-de39c46d53a3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:10.810754 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7d7098a3-bb17-4f79-8196-b47f450d2609 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:10.811204 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7d7098a3-bb17-4f79-8196-b47f450d2609 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:10.813928 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7d7098a3-bb17-4f79-8196-b47f450d2609 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:10.815690 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7d7098a3-bb17-4f79-8196-b47f450d2609 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:10.930878 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-1b1e6461-64ca-419b-807d-176773cabb67 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05483ff6eec84f78a091b29cfbcf61f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a6720be5fb4de7bcd77cc7ef9d8000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:57:10.950698 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-1b1e6461-64ca-419b-807d-176773cabb67 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] 10.222.0.46 "GET /compute/v2.1/servers/689dd504-e36e-41d0-a461-acce91952e7e" status: 200 len: 1279 microversion: 2.1 time: 0.233216 Jan 15 20:57:10.953034 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1305/2548] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:57:10 2022] GET /compute/v2.1/servers/689dd504-e36e-41d0-a461-acce91952e7e => generated 1279 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:10.971262 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-937f8415-69b4-4f3e-8cc8-f7b5c2e00003 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:10.972053 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-937f8415-69b4-4f3e-8cc8-f7b5c2e00003 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] [instance: b1eb0bef-5aaf-46d6-8739-b12303df9842] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:10.998238 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-937f8415-69b4-4f3e-8cc8-f7b5c2e00003 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:10.998780 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-937f8415-69b4-4f3e-8cc8-f7b5c2e00003 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:10.999709 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-937f8415-69b4-4f3e-8cc8-f7b5c2e00003 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:10.999940 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-937f8415-69b4-4f3e-8cc8-f7b5c2e00003 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:11.530988 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-7d7098a3-bb17-4f79-8196-b47f450d2609 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7754a1e8134b4da4803400ca6bb4c540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4a067d84534cbd879732a1b7c057ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:57:11.552373 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-7d7098a3-bb17-4f79-8196-b47f450d2609 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] 10.222.0.46 "GET /compute/v2.1/servers/3809db38-b5f5-471e-b6ba-de39c46d53a3" status: 200 len: 1322 microversion: 2.1 time: 0.765518 Jan 15 20:57:11.553259 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1244/2549] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:57:10 2022] GET /compute/v2.1/servers/3809db38-b5f5-471e-b6ba-de39c46d53a3 => generated 1322 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:11.566519 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-cfb79262-b340-4736-9213-115899e1562d tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:57:11.569074 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-cfb79262-b340-4736-9213-115899e1562d tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] [instance: 62ae2a15-8c2c-4dad-971f-0611238103a3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:11.585134 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cfb79262-b340-4736-9213-115899e1562d tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:11.596477 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cfb79262-b340-4736-9213-115899e1562d tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:11.597833 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cfb79262-b340-4736-9213-115899e1562d tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:11.598516 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cfb79262-b340-4736-9213-115899e1562d tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:11.683791 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-cfb79262-b340-4736-9213-115899e1562d tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] 10.222.0.46 "POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action" status: 200 len: 24567 microversion: 2.1 time: 0.128979 Jan 15 20:57:11.685739 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1245/2550] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:57:11 2022] POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action => generated 24567 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:57:11.700468 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-dc730bd3-0ff2-4a24-88a1-90d14bade26d req-44bc47e9-362e-4ac8-8921-e26cc008b696 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "733106f5-de5a-4e36-9181-b277ccd1f423", "tag": "b4e79b4f-5297-4f59-b4cf-fba91468535c"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:57:11.702521 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:57:11.702521 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:57:11.716322 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-937f8415-69b4-4f3e-8cc8-f7b5c2e00003 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c0085c7fa1d44e58b20181319ea00f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '964edbaeb4c944cfb68578886695266c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:57:11.746728 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-937f8415-69b4-4f3e-8cc8-f7b5c2e00003 tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] 10.222.0.46 "GET /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842" status: 200 len: 1716 microversion: 2.1 time: 0.792576 Jan 15 20:57:11.748267 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-dc730bd3-0ff2-4a24-88a1-90d14bade26d req-44bc47e9-362e-4ac8-8921-e26cc008b696 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:11.751992 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1306/2551] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:57:10 2022] GET /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842 => generated 1716 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:11.753861 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-dc730bd3-0ff2-4a24-88a1-90d14bade26d req-44bc47e9-362e-4ac8-8921-e26cc008b696 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:11.768132 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8a937b4c-8686-4666-b7a8-2230249fdb64 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Calling method '.version_select at 0x7f30c8df2700>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:11.784515 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-dc730bd3-0ff2-4a24-88a1-90d14bade26d req-44bc47e9-362e-4ac8-8921-e26cc008b696 service nova] Creating event network-changed:b4e79b4f-5297-4f59-b4cf-fba91468535c for instance 733106f5-de5a-4e36-9181-b277ccd1f423 on nch2-master-1 Jan 15 20:57:11.798416 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-dc730bd3-0ff2-4a24-88a1-90d14bade26d req-44bc47e9-362e-4ac8-8921-e26cc008b696 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111051 Jan 15 20:57:11.799408 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1246/2552] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:57:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:57:11.804530 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-aea8ef2b-10dc-4522-a026-a78c161accba tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:11.805589 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-aea8ef2b-10dc-4522-a026-a78c161accba tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] [instance: 84fe1922-dca1-4713-9ea1-bdd26b309ce6] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:11.813010 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-aea8ef2b-10dc-4522-a026-a78c161accba tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:11.813838 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-aea8ef2b-10dc-4522-a026-a78c161accba tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:11.814860 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-aea8ef2b-10dc-4522-a026-a78c161accba tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:11.815519 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-aea8ef2b-10dc-4522-a026-a78c161accba tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:12.154656 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-aea8ef2b-10dc-4522-a026-a78c161accba tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ec114f8ece434aa496cd401494e2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a05b1a0a7479db84b762eca23b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:57:12.193844 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-aea8ef2b-10dc-4522-a026-a78c161accba tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] 10.222.0.46 "GET /compute/v2.1/servers/84fe1922-dca1-4713-9ea1-bdd26b309ce6" status: 200 len: 1550 microversion: 2.1 time: 0.392921 Jan 15 20:57:12.201221 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1247/2553] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:57:11 2022] GET /compute/v2.1/servers/84fe1922-dca1-4713-9ea1-bdd26b309ce6 => generated 1550 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:12.219857 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-12a6fe37-e3e4-4f8f-9ad2-6fa815053940 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:57:12.223663 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-12a6fe37-e3e4-4f8f-9ad2-6fa815053940 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] [instance: 70bf65cf-55e2-459a-aaf1-c3eb851a6ccf] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:12.252461 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-12a6fe37-e3e4-4f8f-9ad2-6fa815053940 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:12.253212 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-12a6fe37-e3e4-4f8f-9ad2-6fa815053940 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:12.254167 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-12a6fe37-e3e4-4f8f-9ad2-6fa815053940 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:12.254773 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-12a6fe37-e3e4-4f8f-9ad2-6fa815053940 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:12.349647 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-12a6fe37-e3e4-4f8f-9ad2-6fa815053940 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] 10.222.0.46 "POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action" status: 200 len: 32642 microversion: 2.1 time: 0.146115 Jan 15 20:57:12.354827 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1248/2554] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:57:12 2022] POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action => generated 32642 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:57:12.360237 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e5064ed5-2c3c-47f3-b63d-e79fb5ff2721 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:12.361519 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e5064ed5-2c3c-47f3-b63d-e79fb5ff2721 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: 0874eafa-ffa2-4257-b6c5-66e4bef983db] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:12.369258 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e5064ed5-2c3c-47f3-b63d-e79fb5ff2721 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:12.370019 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e5064ed5-2c3c-47f3-b63d-e79fb5ff2721 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:12.371985 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e5064ed5-2c3c-47f3-b63d-e79fb5ff2721 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:12.372695 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e5064ed5-2c3c-47f3-b63d-e79fb5ff2721 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:13.023734 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-e5064ed5-2c3c-47f3-b63d-e79fb5ff2721 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:57:13.050476 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e5064ed5-2c3c-47f3-b63d-e79fb5ff2721 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/0874eafa-ffa2-4257-b6c5-66e4bef983db" status: 200 len: 1523 microversion: 2.1 time: 0.688739 Jan 15 20:57:13.064909 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1249/2555] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:57:12 2022] GET /compute/v2.1/servers/0874eafa-ffa2-4257-b6c5-66e4bef983db => generated 1523 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:13.090043 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-efee5d05-6e48-4007-b513-c986260bca31 req-41e0ebbf-29a6-455c-8c0a-57f614d90d1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "beffc13d-acd3-455e-96d6-be4bcbb81b88", "name": "network-vif-plugged", "status": "completed", "tag": "3de9d3d2-9291-4173-8d0b-3d31a05f6fe6"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:57:13.095928 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:57:13.095928 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:57:13.125000 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-efee5d05-6e48-4007-b513-c986260bca31 req-41e0ebbf-29a6-455c-8c0a-57f614d90d1d service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:13.127440 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-efee5d05-6e48-4007-b513-c986260bca31 req-41e0ebbf-29a6-455c-8c0a-57f614d90d1d service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:13.158024 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-efee5d05-6e48-4007-b513-c986260bca31 req-41e0ebbf-29a6-455c-8c0a-57f614d90d1d service nova] Creating event network-vif-plugged:3de9d3d2-9291-4173-8d0b-3d31a05f6fe6 for instance beffc13d-acd3-455e-96d6-be4bcbb81b88 on nch1-master-1 Jan 15 20:57:13.173748 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-efee5d05-6e48-4007-b513-c986260bca31 req-41e0ebbf-29a6-455c-8c0a-57f614d90d1d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104637 Jan 15 20:57:13.175390 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1250/2556] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:57:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:57:13.189033 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e291c11b-cd22-430c-a1cd-2c7adb13964a tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:13.189728 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e291c11b-cd22-430c-a1cd-2c7adb13964a tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] [instance: 689dd504-e36e-41d0-a461-acce91952e7e] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:13.211267 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e291c11b-cd22-430c-a1cd-2c7adb13964a tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:13.212081 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e291c11b-cd22-430c-a1cd-2c7adb13964a tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:13.215576 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e291c11b-cd22-430c-a1cd-2c7adb13964a tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:13.219459 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e291c11b-cd22-430c-a1cd-2c7adb13964a tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:13.379707 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-e291c11b-cd22-430c-a1cd-2c7adb13964a tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05483ff6eec84f78a091b29cfbcf61f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a6720be5fb4de7bcd77cc7ef9d8000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:57:13.395589 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e291c11b-cd22-430c-a1cd-2c7adb13964a tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] 10.222.0.46 "GET /compute/v2.1/servers/689dd504-e36e-41d0-a461-acce91952e7e" status: 200 len: 1279 microversion: 2.1 time: 0.218639 Jan 15 20:57:13.396538 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1251/2557] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:57:13 2022] GET /compute/v2.1/servers/689dd504-e36e-41d0-a461-acce91952e7e => generated 1279 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:13.404598 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-54e72fd5-f90c-4b26-b3b5-1b3cd5a51456 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:13.411053 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-54e72fd5-f90c-4b26-b3b5-1b3cd5a51456 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] [instance: 3809db38-b5f5-471e-b6ba-de39c46d53a3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:13.422511 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-54e72fd5-f90c-4b26-b3b5-1b3cd5a51456 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:13.422995 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-54e72fd5-f90c-4b26-b3b5-1b3cd5a51456 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:13.423785 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-54e72fd5-f90c-4b26-b3b5-1b3cd5a51456 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:13.424330 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-54e72fd5-f90c-4b26-b3b5-1b3cd5a51456 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:13.952172 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-54e72fd5-f90c-4b26-b3b5-1b3cd5a51456 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7754a1e8134b4da4803400ca6bb4c540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4a067d84534cbd879732a1b7c057ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:57:13.960826 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-54e72fd5-f90c-4b26-b3b5-1b3cd5a51456 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] 10.222.0.46 "GET /compute/v2.1/servers/3809db38-b5f5-471e-b6ba-de39c46d53a3" status: 200 len: 1322 microversion: 2.1 time: 0.560051 Jan 15 20:57:13.977400 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1252/2558] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:57:13 2022] GET /compute/v2.1/servers/3809db38-b5f5-471e-b6ba-de39c46d53a3 => generated 1322 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:13.988425 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ccc68f7a-a858-4c08-82ac-f718f9da1f5c tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:57:13.990133 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ccc68f7a-a858-4c08-82ac-f718f9da1f5c tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] [instance: 62ae2a15-8c2c-4dad-971f-0611238103a3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:14.006210 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ccc68f7a-a858-4c08-82ac-f718f9da1f5c tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:14.007040 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ccc68f7a-a858-4c08-82ac-f718f9da1f5c tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:14.012728 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ccc68f7a-a858-4c08-82ac-f718f9da1f5c tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:14.013512 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ccc68f7a-a858-4c08-82ac-f718f9da1f5c tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:14.099261 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ccc68f7a-a858-4c08-82ac-f718f9da1f5c tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] 10.222.0.46 "POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action" status: 200 len: 24567 microversion: 2.1 time: 0.120006 Jan 15 20:57:14.104653 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1253/2559] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:57:13 2022] POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action => generated 24567 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:57:14.119248 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-0e197338-8674-4148-9301-f44237de029d tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:14.124094 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-0e197338-8674-4148-9301-f44237de029d tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] [instance: b1eb0bef-5aaf-46d6-8739-b12303df9842] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:14.154001 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0e197338-8674-4148-9301-f44237de029d tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:14.157476 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0e197338-8674-4148-9301-f44237de029d tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:14.158820 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0e197338-8674-4148-9301-f44237de029d tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:14.159538 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0e197338-8674-4148-9301-f44237de029d tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:14.601689 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-0e197338-8674-4148-9301-f44237de029d tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c0085c7fa1d44e58b20181319ea00f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '964edbaeb4c944cfb68578886695266c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:57:14.610133 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-0e197338-8674-4148-9301-f44237de029d tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] 10.222.0.46 "GET /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842" status: 200 len: 1716 microversion: 2.1 time: 0.503620 Jan 15 20:57:14.614804 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1254/2560] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:57:14 2022] GET /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842 => generated 1716 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:14.641816 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ac0f3b6b-3498-4b1d-860a-bc1aa0ba522a tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:14.642818 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ac0f3b6b-3498-4b1d-860a-bc1aa0ba522a tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] [instance: 84fe1922-dca1-4713-9ea1-bdd26b309ce6] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:14.653873 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ac0f3b6b-3498-4b1d-860a-bc1aa0ba522a tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:14.655865 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ac0f3b6b-3498-4b1d-860a-bc1aa0ba522a tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:14.656812 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ac0f3b6b-3498-4b1d-860a-bc1aa0ba522a tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:14.658125 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ac0f3b6b-3498-4b1d-860a-bc1aa0ba522a tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:15.226475 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-ac0f3b6b-3498-4b1d-860a-bc1aa0ba522a tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ec114f8ece434aa496cd401494e2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a05b1a0a7479db84b762eca23b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:57:15.243143 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ac0f3b6b-3498-4b1d-860a-bc1aa0ba522a tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] 10.222.0.46 "GET /compute/v2.1/servers/84fe1922-dca1-4713-9ea1-bdd26b309ce6" status: 200 len: 1550 microversion: 2.1 time: 0.616433 Jan 15 20:57:15.245417 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1255/2561] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:57:14 2022] GET /compute/v2.1/servers/84fe1922-dca1-4713-9ea1-bdd26b309ce6 => generated 1550 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:15.250767 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-59d372b4-8bac-4765-900b-b64078ba7702 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:57:15.265553 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-59d372b4-8bac-4765-900b-b64078ba7702 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] [instance: 70bf65cf-55e2-459a-aaf1-c3eb851a6ccf] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:15.301770 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-59d372b4-8bac-4765-900b-b64078ba7702 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:15.305011 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-59d372b4-8bac-4765-900b-b64078ba7702 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:15.305867 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-59d372b4-8bac-4765-900b-b64078ba7702 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:15.306523 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-59d372b4-8bac-4765-900b-b64078ba7702 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:15.415168 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-59d372b4-8bac-4765-900b-b64078ba7702 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] 10.222.0.46 "POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action" status: 200 len: 32642 microversion: 2.1 time: 0.167903 Jan 15 20:57:15.417267 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1256/2562] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:57:15 2022] POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action => generated 32642 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:57:15.428352 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-613e3b89-dfe3-4034-bf8a-5ef20aaef184 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:15.430328 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-613e3b89-dfe3-4034-bf8a-5ef20aaef184 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: 0874eafa-ffa2-4257-b6c5-66e4bef983db] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:15.448344 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-613e3b89-dfe3-4034-bf8a-5ef20aaef184 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:15.452187 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-613e3b89-dfe3-4034-bf8a-5ef20aaef184 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:15.453551 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-613e3b89-dfe3-4034-bf8a-5ef20aaef184 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:15.454166 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-613e3b89-dfe3-4034-bf8a-5ef20aaef184 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:16.085248 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-613e3b89-dfe3-4034-bf8a-5ef20aaef184 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:57:16.096030 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-613e3b89-dfe3-4034-bf8a-5ef20aaef184 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/0874eafa-ffa2-4257-b6c5-66e4bef983db" status: 200 len: 1523 microversion: 2.1 time: 0.677300 Jan 15 20:57:16.096633 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1257/2563] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:57:15 2022] GET /compute/v2.1/servers/0874eafa-ffa2-4257-b6c5-66e4bef983db => generated 1523 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:16.114021 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-0e446bbe-7e34-4790-ae91-aa8e3ebf0c91 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:16.116792 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-0e446bbe-7e34-4790-ae91-aa8e3ebf0c91 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] [instance: 689dd504-e36e-41d0-a461-acce91952e7e] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:16.124082 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0e446bbe-7e34-4790-ae91-aa8e3ebf0c91 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:16.125077 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0e446bbe-7e34-4790-ae91-aa8e3ebf0c91 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:16.125874 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0e446bbe-7e34-4790-ae91-aa8e3ebf0c91 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:16.133087 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0e446bbe-7e34-4790-ae91-aa8e3ebf0c91 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:17.357874 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-0e446bbe-7e34-4790-ae91-aa8e3ebf0c91 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05483ff6eec84f78a091b29cfbcf61f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a6720be5fb4de7bcd77cc7ef9d8000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:57:17.377004 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-0e446bbe-7e34-4790-ae91-aa8e3ebf0c91 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] 10.222.0.46 "GET /compute/v2.1/servers/689dd504-e36e-41d0-a461-acce91952e7e" status: 200 len: 1321 microversion: 2.1 time: 1.279214 Jan 15 20:57:17.377599 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1258/2564] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:57:16 2022] GET /compute/v2.1/servers/689dd504-e36e-41d0-a461-acce91952e7e => generated 1321 bytes in 1280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:17.384945 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f2b98439-8306-4f08-961a-d8de1e85b762 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:17.392376 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f2b98439-8306-4f08-961a-d8de1e85b762 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] [instance: 3809db38-b5f5-471e-b6ba-de39c46d53a3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:17.402894 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f2b98439-8306-4f08-961a-d8de1e85b762 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:17.407519 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f2b98439-8306-4f08-961a-d8de1e85b762 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:17.408574 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f2b98439-8306-4f08-961a-d8de1e85b762 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:17.409202 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f2b98439-8306-4f08-961a-d8de1e85b762 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:17.696093 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-f2b98439-8306-4f08-961a-d8de1e85b762 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7754a1e8134b4da4803400ca6bb4c540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4a067d84534cbd879732a1b7c057ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:57:17.710176 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f2b98439-8306-4f08-961a-d8de1e85b762 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] 10.222.0.46 "GET /compute/v2.1/servers/3809db38-b5f5-471e-b6ba-de39c46d53a3" status: 200 len: 1322 microversion: 2.1 time: 0.324046 Jan 15 20:57:17.712199 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1259/2565] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:57:17 2022] GET /compute/v2.1/servers/3809db38-b5f5-471e-b6ba-de39c46d53a3 => generated 1322 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:17.729921 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d31ccc27-9133-4aa2-959d-d5d721d7a5e0 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:57:17.730971 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d31ccc27-9133-4aa2-959d-d5d721d7a5e0 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] [instance: 62ae2a15-8c2c-4dad-971f-0611238103a3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:17.747110 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d31ccc27-9133-4aa2-959d-d5d721d7a5e0 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:17.748572 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d31ccc27-9133-4aa2-959d-d5d721d7a5e0 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:17.749690 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d31ccc27-9133-4aa2-959d-d5d721d7a5e0 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:17.751287 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d31ccc27-9133-4aa2-959d-d5d721d7a5e0 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:17.877755 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d31ccc27-9133-4aa2-959d-d5d721d7a5e0 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] 10.222.0.46 "POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action" status: 200 len: 32634 microversion: 2.1 time: 0.159475 Jan 15 20:57:17.886423 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1260/2566] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:57:17 2022] POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action => generated 32634 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:57:17.900052 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-9ada8b43-1e54-43d6-a212-d786a141a66c req-45503734-98d3-4365-9572-40ba3984d736 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0874eafa-ffa2-4257-b6c5-66e4bef983db", "name": "network-vif-plugged", "status": "completed", "tag": "6b0f9bd5-35ce-4655-ab53-3207b68d566f"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:57:17.902707 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:57:17.902707 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:57:17.927029 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-9ada8b43-1e54-43d6-a212-d786a141a66c req-45503734-98d3-4365-9572-40ba3984d736 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:17.927691 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-9ada8b43-1e54-43d6-a212-d786a141a66c req-45503734-98d3-4365-9572-40ba3984d736 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:17.956497 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-9ada8b43-1e54-43d6-a212-d786a141a66c req-45503734-98d3-4365-9572-40ba3984d736 service nova] Creating event network-vif-plugged:6b0f9bd5-35ce-4655-ab53-3207b68d566f for instance 0874eafa-ffa2-4257-b6c5-66e4bef983db on nch2-master-1 Jan 15 20:57:17.970223 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-9ada8b43-1e54-43d6-a212-d786a141a66c req-45503734-98d3-4365-9572-40ba3984d736 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081858 Jan 15 20:57:17.974073 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1261/2567] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:57:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:57:18.032372 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-408a69ef-eb4a-49ed-bea9-151425a107bc tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:18.044276 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-408a69ef-eb4a-49ed-bea9-151425a107bc tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] [instance: b1eb0bef-5aaf-46d6-8739-b12303df9842] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:18.095589 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-408a69ef-eb4a-49ed-bea9-151425a107bc tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:18.108594 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-408a69ef-eb4a-49ed-bea9-151425a107bc tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:18.120321 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-408a69ef-eb4a-49ed-bea9-151425a107bc tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:18.121291 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-408a69ef-eb4a-49ed-bea9-151425a107bc tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:18.197938 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-408a69ef-eb4a-49ed-bea9-151425a107bc tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] HTTP exception thrown: Instance b1eb0bef-5aaf-46d6-8739-b12303df9842 could not be found. Jan 15 20:57:18.200316 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-408a69ef-eb4a-49ed-bea9-151425a107bc tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Returning 404 to user: Instance b1eb0bef-5aaf-46d6-8739-b12303df9842 could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:57:18.201313 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-408a69ef-eb4a-49ed-bea9-151425a107bc tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] 10.222.0.46 "GET /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842" status: 404 len: 111 microversion: 2.1 time: 0.224914 Jan 15 20:57:18.203380 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1262/2568] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:57:17 2022] GET /compute/v2.1/servers/b1eb0bef-5aaf-46d6-8739-b12303df9842 => generated 111 bytes in 228 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:57:18.231107 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-0e3adbd3-a90e-4cee-be23-016c70be8221 req-ff9ad197-0617-4532-8941-514237112aa0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1eb0bef-5aaf-46d6-8739-b12303df9842", "name": "network-vif-deleted", "tag": "d4128316-d1ff-46a8-817e-082539cee097"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:57:18.237427 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:57:18.237427 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:57:18.262021 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-0e3adbd3-a90e-4cee-be23-016c70be8221 req-ff9ad197-0617-4532-8941-514237112aa0 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:18.263143 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-0e3adbd3-a90e-4cee-be23-016c70be8221 req-ff9ad197-0617-4532-8941-514237112aa0 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:18.285254 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-0e3adbd3-a90e-4cee-be23-016c70be8221 req-ff9ad197-0617-4532-8941-514237112aa0 service nova] Creating event network-vif-deleted:d4128316-d1ff-46a8-817e-082539cee097 for instance b1eb0bef-5aaf-46d6-8739-b12303df9842 on nch1-master-1 Jan 15 20:57:18.304658 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-0e3adbd3-a90e-4cee-be23-016c70be8221 req-ff9ad197-0617-4532-8941-514237112aa0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097044 Jan 15 20:57:18.309746 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1263/2569] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:57:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:57:18.315004 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-0d2a9461-df8a-47b4-b569-949d56f01de3 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:18.320406 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-0d2a9461-df8a-47b4-b569-949d56f01de3 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] [instance: 84fe1922-dca1-4713-9ea1-bdd26b309ce6] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:18.330883 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0d2a9461-df8a-47b4-b569-949d56f01de3 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:18.331709 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0d2a9461-df8a-47b4-b569-949d56f01de3 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:18.332775 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0d2a9461-df8a-47b4-b569-949d56f01de3 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:18.333660 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0d2a9461-df8a-47b4-b569-949d56f01de3 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:18.727961 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-0d2a9461-df8a-47b4-b569-949d56f01de3 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ec114f8ece434aa496cd401494e2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a05b1a0a7479db84b762eca23b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:57:18.750874 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-0d2a9461-df8a-47b4-b569-949d56f01de3 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] 10.222.0.46 "GET /compute/v2.1/servers/84fe1922-dca1-4713-9ea1-bdd26b309ce6" status: 200 len: 1550 microversion: 2.1 time: 0.439681 Jan 15 20:57:18.753624 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1264/2570] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:57:18 2022] GET /compute/v2.1/servers/84fe1922-dca1-4713-9ea1-bdd26b309ce6 => generated 1550 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:18.759438 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9a643658-e27b-4cb4-b5ff-e7c353f9a05d tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:57:18.761342 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-9a643658-e27b-4cb4-b5ff-e7c353f9a05d tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] [instance: 70bf65cf-55e2-459a-aaf1-c3eb851a6ccf] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:18.770504 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9a643658-e27b-4cb4-b5ff-e7c353f9a05d tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:18.771303 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9a643658-e27b-4cb4-b5ff-e7c353f9a05d tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:18.775426 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9a643658-e27b-4cb4-b5ff-e7c353f9a05d tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:18.776971 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9a643658-e27b-4cb4-b5ff-e7c353f9a05d tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:18.842628 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-9a643658-e27b-4cb4-b5ff-e7c353f9a05d tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] 10.222.0.46 "POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action" status: 200 len: 32642 microversion: 2.1 time: 0.087203 Jan 15 20:57:18.843787 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1265/2571] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:57:18 2022] POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action => generated 32642 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:57:18.849506 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b4ab5ca3-a3b3-4017-a6f6-698325b2492f tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:18.850595 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b4ab5ca3-a3b3-4017-a6f6-698325b2492f tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: 0874eafa-ffa2-4257-b6c5-66e4bef983db] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:18.861211 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b4ab5ca3-a3b3-4017-a6f6-698325b2492f tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:18.863070 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b4ab5ca3-a3b3-4017-a6f6-698325b2492f tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:18.867199 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b4ab5ca3-a3b3-4017-a6f6-698325b2492f tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:18.868143 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b4ab5ca3-a3b3-4017-a6f6-698325b2492f tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:19.228055 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-b4ab5ca3-a3b3-4017-a6f6-698325b2492f tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:57:19.253374 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b4ab5ca3-a3b3-4017-a6f6-698325b2492f tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/0874eafa-ffa2-4257-b6c5-66e4bef983db" status: 200 len: 1523 microversion: 2.1 time: 0.408015 Jan 15 20:57:19.267877 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1266/2572] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:57:18 2022] GET /compute/v2.1/servers/0874eafa-ffa2-4257-b6c5-66e4bef983db => generated 1523 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:19.287759 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-a59e9d7d-b41b-43db-85e1-a3e009b4844f req-03ef3ac6-6cdc-4975-afb9-2624b1105eda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3809db38-b5f5-471e-b6ba-de39c46d53a3", "tag": "9409ec6f-f317-4b00-ad1b-b8d9a6b10896"}, {"name": "network-changed", "server_uuid": "e04f7a96-62cb-4aae-9612-aa8df88aef61", "tag": "dd2cbd6f-3487-4fa2-b57c-a5a8ae164d93"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:57:19.295370 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:57:19.295370 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:57:19.317638 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-a59e9d7d-b41b-43db-85e1-a3e009b4844f req-03ef3ac6-6cdc-4975-afb9-2624b1105eda service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:19.324264 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-a59e9d7d-b41b-43db-85e1-a3e009b4844f req-03ef3ac6-6cdc-4975-afb9-2624b1105eda service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:19.358009 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-a59e9d7d-b41b-43db-85e1-a3e009b4844f req-03ef3ac6-6cdc-4975-afb9-2624b1105eda service nova] Creating event network-changed:9409ec6f-f317-4b00-ad1b-b8d9a6b10896 for instance 3809db38-b5f5-471e-b6ba-de39c46d53a3 on nch1-master-1 Jan 15 20:57:19.358818 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-a59e9d7d-b41b-43db-85e1-a3e009b4844f req-03ef3ac6-6cdc-4975-afb9-2624b1105eda service nova] Creating event network-changed:dd2cbd6f-3487-4fa2-b57c-a5a8ae164d93 for instance e04f7a96-62cb-4aae-9612-aa8df88aef61 on nch2-master-1 Jan 15 20:57:19.373500 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-a59e9d7d-b41b-43db-85e1-a3e009b4844f req-03ef3ac6-6cdc-4975-afb9-2624b1105eda service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.102419 Jan 15 20:57:19.376766 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1267/2573] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:57:19 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:57:19.388936 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-739ff908-8e3b-4709-b27f-f3ca330fb82d tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] Calling method '.version_select at 0x7f30c95a04c0>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:19.439845 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-739ff908-8e3b-4709-b27f-f3ca330fb82d tempest-ServersTestManualDisk-1686593371 tempest-ServersTestManualDisk-1686593371-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1897593836" status: 202 len: 0 microversion: 2.1 time: 0.060665 Jan 15 20:57:19.441246 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1268/2574] 10.222.0.46 () {58 vars in 1220 bytes} [Sat Jan 15 20:57:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1897593836 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 20:57:19.482667 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a8a57fcc-8ee5-461b-bcb0-a5d252b65c2b tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:19.483757 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a8a57fcc-8ee5-461b-bcb0-a5d252b65c2b tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] [instance: 689dd504-e36e-41d0-a461-acce91952e7e] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:19.505929 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a8a57fcc-8ee5-461b-bcb0-a5d252b65c2b tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:19.515967 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a8a57fcc-8ee5-461b-bcb0-a5d252b65c2b tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:19.517169 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a8a57fcc-8ee5-461b-bcb0-a5d252b65c2b tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:19.517774 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a8a57fcc-8ee5-461b-bcb0-a5d252b65c2b tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:19.793228 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-a8a57fcc-8ee5-461b-bcb0-a5d252b65c2b tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05483ff6eec84f78a091b29cfbcf61f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a6720be5fb4de7bcd77cc7ef9d8000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:57:19.828759 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a8a57fcc-8ee5-461b-bcb0-a5d252b65c2b tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] 10.222.0.46 "GET /compute/v2.1/servers/689dd504-e36e-41d0-a461-acce91952e7e" status: 200 len: 1321 microversion: 2.1 time: 0.384735 Jan 15 20:57:19.832023 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1269/2575] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:57:19 2022] GET /compute/v2.1/servers/689dd504-e36e-41d0-a461-acce91952e7e => generated 1321 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:19.847210 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-1b4d0ea9-c91a-4dc9-aab0-4a79bb390c98 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:19.850892 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-1b4d0ea9-c91a-4dc9-aab0-4a79bb390c98 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] [instance: 3809db38-b5f5-471e-b6ba-de39c46d53a3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:19.865700 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1b4d0ea9-c91a-4dc9-aab0-4a79bb390c98 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:19.866550 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1b4d0ea9-c91a-4dc9-aab0-4a79bb390c98 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:19.868201 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1b4d0ea9-c91a-4dc9-aab0-4a79bb390c98 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:19.868818 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1b4d0ea9-c91a-4dc9-aab0-4a79bb390c98 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:20.359853 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-1b4d0ea9-c91a-4dc9-aab0-4a79bb390c98 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7754a1e8134b4da4803400ca6bb4c540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4a067d84534cbd879732a1b7c057ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:57:20.368036 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-1b4d0ea9-c91a-4dc9-aab0-4a79bb390c98 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] 10.222.0.46 "GET /compute/v2.1/servers/3809db38-b5f5-471e-b6ba-de39c46d53a3" status: 200 len: 1322 microversion: 2.1 time: 0.534860 Jan 15 20:57:20.368626 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1270/2576] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:57:19 2022] GET /compute/v2.1/servers/3809db38-b5f5-471e-b6ba-de39c46d53a3 => generated 1322 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:20.378654 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-7a16418f-6795-46e5-ae6e-10596ce52464 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:57:20.383473 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-7a16418f-6795-46e5-ae6e-10596ce52464 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] [instance: 62ae2a15-8c2c-4dad-971f-0611238103a3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:20.401892 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7a16418f-6795-46e5-ae6e-10596ce52464 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:20.403221 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7a16418f-6795-46e5-ae6e-10596ce52464 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:20.405853 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7a16418f-6795-46e5-ae6e-10596ce52464 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:20.407281 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7a16418f-6795-46e5-ae6e-10596ce52464 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:20.488828 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-7a16418f-6795-46e5-ae6e-10596ce52464 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] 10.222.0.46 "POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action" status: 200 len: 32634 microversion: 2.1 time: 0.111396 Jan 15 20:57:20.498502 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1271/2577] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:57:20 2022] POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action => generated 32634 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:57:20.508426 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-240836df-6250-409f-a5bf-6c823579bade tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:20.511267 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-240836df-6250-409f-a5bf-6c823579bade tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] [instance: 84fe1922-dca1-4713-9ea1-bdd26b309ce6] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:20.529972 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-240836df-6250-409f-a5bf-6c823579bade tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:20.533049 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-240836df-6250-409f-a5bf-6c823579bade tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:20.536538 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-240836df-6250-409f-a5bf-6c823579bade tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:20.537361 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-240836df-6250-409f-a5bf-6c823579bade tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:20.833003 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-240836df-6250-409f-a5bf-6c823579bade tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ec114f8ece434aa496cd401494e2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a05b1a0a7479db84b762eca23b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:57:20.842452 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-240836df-6250-409f-a5bf-6c823579bade tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] 10.222.0.46 "GET /compute/v2.1/servers/84fe1922-dca1-4713-9ea1-bdd26b309ce6" status: 200 len: 1550 microversion: 2.1 time: 0.342227 Jan 15 20:57:20.863540 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1272/2578] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:57:20 2022] GET /compute/v2.1/servers/84fe1922-dca1-4713-9ea1-bdd26b309ce6 => generated 1550 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:20.875884 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ec7fbfaf-06e8-4abe-a531-9defe97a43cf tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:57:20.879520 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ec7fbfaf-06e8-4abe-a531-9defe97a43cf tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] [instance: 70bf65cf-55e2-459a-aaf1-c3eb851a6ccf] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:20.895528 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ec7fbfaf-06e8-4abe-a531-9defe97a43cf tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:20.897229 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ec7fbfaf-06e8-4abe-a531-9defe97a43cf tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:20.900438 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ec7fbfaf-06e8-4abe-a531-9defe97a43cf tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:20.901722 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ec7fbfaf-06e8-4abe-a531-9defe97a43cf tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:21.008055 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ec7fbfaf-06e8-4abe-a531-9defe97a43cf tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] 10.222.0.46 "POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action" status: 200 len: 32642 microversion: 2.1 time: 0.142751 Jan 15 20:57:21.011353 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1273/2579] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:57:20 2022] POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action => generated 32642 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:57:21.040820 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-0ba3f226-4dec-4c1e-bcc6-0234084b38c4 req-48c1c631-3fed-4ff8-bfa5-2c2a66782590 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "672fd3e7-4b14-4aa7-97da-6245dfabb878", "name": "network-vif-plugged", "status": "completed", "tag": "c668866d-59e2-40a4-830d-eaaaf5f479ca"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:57:21.043696 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:57:21.043696 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:57:21.058606 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-0ba3f226-4dec-4c1e-bcc6-0234084b38c4 req-48c1c631-3fed-4ff8-bfa5-2c2a66782590 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:21.059295 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-0ba3f226-4dec-4c1e-bcc6-0234084b38c4 req-48c1c631-3fed-4ff8-bfa5-2c2a66782590 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:21.084782 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-0ba3f226-4dec-4c1e-bcc6-0234084b38c4 req-48c1c631-3fed-4ff8-bfa5-2c2a66782590 service nova] Creating event network-vif-plugged:c668866d-59e2-40a4-830d-eaaaf5f479ca for instance 672fd3e7-4b14-4aa7-97da-6245dfabb878 on nch1-master-1 Jan 15 20:57:21.094004 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-0ba3f226-4dec-4c1e-bcc6-0234084b38c4 req-48c1c631-3fed-4ff8-bfa5-2c2a66782590 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080631 Jan 15 20:57:21.096250 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1274/2580] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:57:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:57:21.107570 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e1d83133-edce-4366-b6b7-3626976863e7 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:21.108752 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e1d83133-edce-4366-b6b7-3626976863e7 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: 0874eafa-ffa2-4257-b6c5-66e4bef983db] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:21.118738 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e1d83133-edce-4366-b6b7-3626976863e7 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:21.118991 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e1d83133-edce-4366-b6b7-3626976863e7 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:21.121452 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e1d83133-edce-4366-b6b7-3626976863e7 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:21.121452 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e1d83133-edce-4366-b6b7-3626976863e7 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:21.587369 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-e1d83133-edce-4366-b6b7-3626976863e7 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:57:21.600294 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e1d83133-edce-4366-b6b7-3626976863e7 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/0874eafa-ffa2-4257-b6c5-66e4bef983db" status: 200 len: 1523 microversion: 2.1 time: 0.498771 Jan 15 20:57:21.601778 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1275/2581] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:57:21 2022] GET /compute/v2.1/servers/0874eafa-ffa2-4257-b6c5-66e4bef983db => generated 1523 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:21.607571 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ecc2981e-4115-464f-8aa4-34fc70861333 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:21.609494 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ecc2981e-4115-464f-8aa4-34fc70861333 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] [instance: 689dd504-e36e-41d0-a461-acce91952e7e] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:21.625935 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ecc2981e-4115-464f-8aa4-34fc70861333 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:21.628814 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ecc2981e-4115-464f-8aa4-34fc70861333 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:21.630214 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ecc2981e-4115-464f-8aa4-34fc70861333 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:21.634539 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ecc2981e-4115-464f-8aa4-34fc70861333 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:22.008188 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-ecc2981e-4115-464f-8aa4-34fc70861333 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05483ff6eec84f78a091b29cfbcf61f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a6720be5fb4de7bcd77cc7ef9d8000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:57:22.027264 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ecc2981e-4115-464f-8aa4-34fc70861333 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] 10.222.0.46 "GET /compute/v2.1/servers/689dd504-e36e-41d0-a461-acce91952e7e" status: 200 len: 1321 microversion: 2.1 time: 0.423879 Jan 15 20:57:22.028627 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1276/2582] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:57:21 2022] GET /compute/v2.1/servers/689dd504-e36e-41d0-a461-acce91952e7e => generated 1321 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:22.033639 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-7b145648-aa6a-43e8-9fe6-5ae16af08be5 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:22.034616 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-7b145648-aa6a-43e8-9fe6-5ae16af08be5 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] [instance: 3809db38-b5f5-471e-b6ba-de39c46d53a3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:22.046439 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7b145648-aa6a-43e8-9fe6-5ae16af08be5 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:22.047164 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7b145648-aa6a-43e8-9fe6-5ae16af08be5 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:22.048587 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7b145648-aa6a-43e8-9fe6-5ae16af08be5 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:22.049364 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7b145648-aa6a-43e8-9fe6-5ae16af08be5 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:22.253677 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-7b145648-aa6a-43e8-9fe6-5ae16af08be5 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7754a1e8134b4da4803400ca6bb4c540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4a067d84534cbd879732a1b7c057ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:57:22.265114 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-7b145648-aa6a-43e8-9fe6-5ae16af08be5 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] 10.222.0.46 "GET /compute/v2.1/servers/3809db38-b5f5-471e-b6ba-de39c46d53a3" status: 200 len: 1322 microversion: 2.1 time: 0.234735 Jan 15 20:57:22.266597 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1277/2583] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:57:22 2022] GET /compute/v2.1/servers/3809db38-b5f5-471e-b6ba-de39c46d53a3 => generated 1322 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:22.273071 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5378a2e6-d616-4268-869b-5065a8f76576 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:57:22.274111 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-5378a2e6-d616-4268-869b-5065a8f76576 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] [instance: 62ae2a15-8c2c-4dad-971f-0611238103a3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:22.283143 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5378a2e6-d616-4268-869b-5065a8f76576 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:22.283564 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5378a2e6-d616-4268-869b-5065a8f76576 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:22.284363 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5378a2e6-d616-4268-869b-5065a8f76576 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:22.284868 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5378a2e6-d616-4268-869b-5065a8f76576 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:22.361620 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5378a2e6-d616-4268-869b-5065a8f76576 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] 10.222.0.46 "POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action" status: 200 len: 32634 microversion: 2.1 time: 0.092607 Jan 15 20:57:22.370862 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1278/2584] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:57:22 2022] POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action => generated 32634 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:57:22.387359 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-fbe61fbd-46a5-4997-9a92-f261674e4e25 req-5d0a15c7-a5b1-43f3-b159-11237ecd8c39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84fe1922-dca1-4713-9ea1-bdd26b309ce6", "name": "network-vif-unplugged", "status": "completed", "tag": "4dd9a494-ab1e-4bde-892a-a7dc884ad0a1"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:57:22.392508 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:57:22.392508 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:57:22.421056 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-fbe61fbd-46a5-4997-9a92-f261674e4e25 req-5d0a15c7-a5b1-43f3-b159-11237ecd8c39 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:22.421604 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-fbe61fbd-46a5-4997-9a92-f261674e4e25 req-5d0a15c7-a5b1-43f3-b159-11237ecd8c39 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:22.454421 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-fbe61fbd-46a5-4997-9a92-f261674e4e25 req-5d0a15c7-a5b1-43f3-b159-11237ecd8c39 service nova] Creating event network-vif-unplugged:4dd9a494-ab1e-4bde-892a-a7dc884ad0a1 for instance 84fe1922-dca1-4713-9ea1-bdd26b309ce6 on nch1-master-1 Jan 15 20:57:22.468747 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-fbe61fbd-46a5-4997-9a92-f261674e4e25 req-5d0a15c7-a5b1-43f3-b159-11237ecd8c39 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.096147 Jan 15 20:57:22.470794 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1279/2585] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:57:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:57:22.502186 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a6a6a19f-3468-45bd-ab34-5a845117031a tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:22.505042 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a6a6a19f-3468-45bd-ab34-5a845117031a tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] [instance: 84fe1922-dca1-4713-9ea1-bdd26b309ce6] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:22.525092 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a6a6a19f-3468-45bd-ab34-5a845117031a tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:22.526635 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a6a6a19f-3468-45bd-ab34-5a845117031a tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:22.528233 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a6a6a19f-3468-45bd-ab34-5a845117031a tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:22.530014 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a6a6a19f-3468-45bd-ab34-5a845117031a tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:22.870367 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-a6a6a19f-3468-45bd-ab34-5a845117031a tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ec114f8ece434aa496cd401494e2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a05b1a0a7479db84b762eca23b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:57:22.890297 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a6a6a19f-3468-45bd-ab34-5a845117031a tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] 10.222.0.46 "GET /compute/v2.1/servers/84fe1922-dca1-4713-9ea1-bdd26b309ce6" status: 200 len: 1550 microversion: 2.1 time: 0.417274 Jan 15 20:57:22.891230 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1280/2586] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:57:22 2022] GET /compute/v2.1/servers/84fe1922-dca1-4713-9ea1-bdd26b309ce6 => generated 1550 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:22.901317 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-497c747d-5fb1-4083-834c-41aa3f2cd63f tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:57:22.915610 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-497c747d-5fb1-4083-834c-41aa3f2cd63f tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] [instance: 70bf65cf-55e2-459a-aaf1-c3eb851a6ccf] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:22.943986 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-497c747d-5fb1-4083-834c-41aa3f2cd63f tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:22.944447 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-497c747d-5fb1-4083-834c-41aa3f2cd63f tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:22.945301 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-497c747d-5fb1-4083-834c-41aa3f2cd63f tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:22.945750 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-497c747d-5fb1-4083-834c-41aa3f2cd63f tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:23.116082 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-497c747d-5fb1-4083-834c-41aa3f2cd63f tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] 10.222.0.46 "POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action" status: 200 len: 32642 microversion: 2.1 time: 0.223461 Jan 15 20:57:23.118317 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1281/2587] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:57:22 2022] POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action => generated 32642 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:57:23.128393 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-250f304f-9c54-44f7-90bb-0084d16ce749 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:23.129629 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-250f304f-9c54-44f7-90bb-0084d16ce749 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: 0874eafa-ffa2-4257-b6c5-66e4bef983db] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:23.150150 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-250f304f-9c54-44f7-90bb-0084d16ce749 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:23.153893 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-250f304f-9c54-44f7-90bb-0084d16ce749 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:23.157203 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-250f304f-9c54-44f7-90bb-0084d16ce749 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:23.158443 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-250f304f-9c54-44f7-90bb-0084d16ce749 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:23.502884 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-250f304f-9c54-44f7-90bb-0084d16ce749 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:57:23.518803 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-250f304f-9c54-44f7-90bb-0084d16ce749 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/0874eafa-ffa2-4257-b6c5-66e4bef983db" status: 200 len: 1523 microversion: 2.1 time: 0.397552 Jan 15 20:57:23.520041 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1282/2588] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:57:23 2022] GET /compute/v2.1/servers/0874eafa-ffa2-4257-b6c5-66e4bef983db => generated 1523 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:23.525236 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b95f9c40-dc97-4061-987c-2c9cdedd95d5 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:23.526128 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b95f9c40-dc97-4061-987c-2c9cdedd95d5 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] [instance: 689dd504-e36e-41d0-a461-acce91952e7e] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:23.533460 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b95f9c40-dc97-4061-987c-2c9cdedd95d5 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:23.534634 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b95f9c40-dc97-4061-987c-2c9cdedd95d5 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:23.535791 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b95f9c40-dc97-4061-987c-2c9cdedd95d5 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:23.536581 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b95f9c40-dc97-4061-987c-2c9cdedd95d5 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:23.863271 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-b95f9c40-dc97-4061-987c-2c9cdedd95d5 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05483ff6eec84f78a091b29cfbcf61f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a6720be5fb4de7bcd77cc7ef9d8000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:57:23.879140 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b95f9c40-dc97-4061-987c-2c9cdedd95d5 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] 10.222.0.46 "GET /compute/v2.1/servers/689dd504-e36e-41d0-a461-acce91952e7e" status: 200 len: 1321 microversion: 2.1 time: 0.356228 Jan 15 20:57:23.881239 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1283/2589] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:57:23 2022] GET /compute/v2.1/servers/689dd504-e36e-41d0-a461-acce91952e7e => generated 1321 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:23.888901 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-869ae73a-8dfa-4cb4-a091-0c0aebabaa10 req-fbba1f94-e359-4ac3-ba2d-7ba8eb1ec9aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "733106f5-de5a-4e36-9181-b277ccd1f423", "name": "network-vif-plugged", "status": "completed", "tag": "b4e79b4f-5297-4f59-b4cf-fba91468535c"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:57:23.896556 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:57:23.896556 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:57:23.905995 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-869ae73a-8dfa-4cb4-a091-0c0aebabaa10 req-fbba1f94-e359-4ac3-ba2d-7ba8eb1ec9aa service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:23.907097 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-869ae73a-8dfa-4cb4-a091-0c0aebabaa10 req-fbba1f94-e359-4ac3-ba2d-7ba8eb1ec9aa service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:23.939242 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-869ae73a-8dfa-4cb4-a091-0c0aebabaa10 req-fbba1f94-e359-4ac3-ba2d-7ba8eb1ec9aa service nova] Creating event network-vif-plugged:b4e79b4f-5297-4f59-b4cf-fba91468535c for instance 733106f5-de5a-4e36-9181-b277ccd1f423 on nch2-master-1 Jan 15 20:57:23.948914 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-869ae73a-8dfa-4cb4-a091-0c0aebabaa10 req-fbba1f94-e359-4ac3-ba2d-7ba8eb1ec9aa service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064808 Jan 15 20:57:23.950189 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1284/2590] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:57:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:57:23.958275 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-1161e9fe-51b4-4edb-87de-12f7c4c3848e tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:23.959328 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-1161e9fe-51b4-4edb-87de-12f7c4c3848e tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] [instance: 3809db38-b5f5-471e-b6ba-de39c46d53a3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:23.968655 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1161e9fe-51b4-4edb-87de-12f7c4c3848e tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:23.969669 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1161e9fe-51b4-4edb-87de-12f7c4c3848e tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:23.971895 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1161e9fe-51b4-4edb-87de-12f7c4c3848e tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:23.975262 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1161e9fe-51b4-4edb-87de-12f7c4c3848e tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:24.415909 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-1161e9fe-51b4-4edb-87de-12f7c4c3848e tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7754a1e8134b4da4803400ca6bb4c540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4a067d84534cbd879732a1b7c057ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:57:24.429744 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-1161e9fe-51b4-4edb-87de-12f7c4c3848e tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] 10.222.0.46 "GET /compute/v2.1/servers/3809db38-b5f5-471e-b6ba-de39c46d53a3" status: 200 len: 1322 microversion: 2.1 time: 0.478017 Jan 15 20:57:24.442861 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1285/2591] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:57:23 2022] GET /compute/v2.1/servers/3809db38-b5f5-471e-b6ba-de39c46d53a3 => generated 1322 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:24.448393 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9fc804ae-3330-4c5c-815a-7f4c9f2217e7 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:57:24.475277 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-9fc804ae-3330-4c5c-815a-7f4c9f2217e7 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] [instance: 62ae2a15-8c2c-4dad-971f-0611238103a3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:24.486719 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9fc804ae-3330-4c5c-815a-7f4c9f2217e7 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:24.487612 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9fc804ae-3330-4c5c-815a-7f4c9f2217e7 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:24.488973 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9fc804ae-3330-4c5c-815a-7f4c9f2217e7 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:24.489712 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9fc804ae-3330-4c5c-815a-7f4c9f2217e7 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:24.739828 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-9fc804ae-3330-4c5c-815a-7f4c9f2217e7 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] 10.222.0.46 "POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action" status: 200 len: 32634 microversion: 2.1 time: 0.294883 Jan 15 20:57:24.748914 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1286/2592] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:57:24 2022] POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action => generated 32634 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:57:24.766404 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-adad73a1-ddbe-4091-a648-075573584f46 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:24.770173 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-adad73a1-ddbe-4091-a648-075573584f46 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] [instance: 84fe1922-dca1-4713-9ea1-bdd26b309ce6] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:24.799295 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-adad73a1-ddbe-4091-a648-075573584f46 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:24.800627 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-adad73a1-ddbe-4091-a648-075573584f46 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:24.804264 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-adad73a1-ddbe-4091-a648-075573584f46 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:24.805913 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-adad73a1-ddbe-4091-a648-075573584f46 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:25.097405 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-adad73a1-ddbe-4091-a648-075573584f46 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ec114f8ece434aa496cd401494e2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a05b1a0a7479db84b762eca23b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:57:25.118718 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-adad73a1-ddbe-4091-a648-075573584f46 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] 10.222.0.46 "GET /compute/v2.1/servers/84fe1922-dca1-4713-9ea1-bdd26b309ce6" status: 200 len: 1550 microversion: 2.1 time: 0.366057 Jan 15 20:57:25.120346 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1287/2593] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:57:24 2022] GET /compute/v2.1/servers/84fe1922-dca1-4713-9ea1-bdd26b309ce6 => generated 1550 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:25.129674 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-84893ff9-0474-4e72-9d62-7a691cd164fd tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:57:25.131852 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-84893ff9-0474-4e72-9d62-7a691cd164fd tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] [instance: 70bf65cf-55e2-459a-aaf1-c3eb851a6ccf] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:25.144198 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-84893ff9-0474-4e72-9d62-7a691cd164fd tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:25.145661 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-84893ff9-0474-4e72-9d62-7a691cd164fd tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:25.148571 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-84893ff9-0474-4e72-9d62-7a691cd164fd tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:25.150277 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-84893ff9-0474-4e72-9d62-7a691cd164fd tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:25.236258 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-84893ff9-0474-4e72-9d62-7a691cd164fd tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] 10.222.0.46 "POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action" status: 200 len: 32642 microversion: 2.1 time: 0.113343 Jan 15 20:57:25.241186 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1288/2594] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:57:25 2022] POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action => generated 32642 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:57:25.252736 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-4b841ec2-200d-4077-9bd6-5bc42ccc75bc tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:25.253539 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-4b841ec2-200d-4077-9bd6-5bc42ccc75bc tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: 0874eafa-ffa2-4257-b6c5-66e4bef983db] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:25.261593 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4b841ec2-200d-4077-9bd6-5bc42ccc75bc tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:25.261955 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4b841ec2-200d-4077-9bd6-5bc42ccc75bc tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:25.262952 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4b841ec2-200d-4077-9bd6-5bc42ccc75bc tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:25.263445 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4b841ec2-200d-4077-9bd6-5bc42ccc75bc tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:25.580115 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-4b841ec2-200d-4077-9bd6-5bc42ccc75bc tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:57:25.617447 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-4b841ec2-200d-4077-9bd6-5bc42ccc75bc tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/0874eafa-ffa2-4257-b6c5-66e4bef983db" status: 200 len: 1523 microversion: 2.1 time: 0.372174 Jan 15 20:57:25.631239 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1289/2595] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:57:25 2022] GET /compute/v2.1/servers/0874eafa-ffa2-4257-b6c5-66e4bef983db => generated 1523 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:25.645544 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-e46f7dde-5a5f-4889-8eaa-d2852a2daa7f req-5c4d3cb6-0fbf-4155-af10-17e59926ca4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "689dd504-e36e-41d0-a461-acce91952e7e", "tag": "a9e5de5f-a2aa-4d5e-9883-5e3f4e4bb682"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:57:25.647559 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:57:25.647559 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:57:25.673850 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-e46f7dde-5a5f-4889-8eaa-d2852a2daa7f req-5c4d3cb6-0fbf-4155-af10-17e59926ca4b service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:25.675814 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-e46f7dde-5a5f-4889-8eaa-d2852a2daa7f req-5c4d3cb6-0fbf-4155-af10-17e59926ca4b service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:25.722378 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-e46f7dde-5a5f-4889-8eaa-d2852a2daa7f req-5c4d3cb6-0fbf-4155-af10-17e59926ca4b service nova] Creating event network-changed:a9e5de5f-a2aa-4d5e-9883-5e3f4e4bb682 for instance 689dd504-e36e-41d0-a461-acce91952e7e on nch1-master-1 Jan 15 20:57:25.736925 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-e46f7dde-5a5f-4889-8eaa-d2852a2daa7f req-5c4d3cb6-0fbf-4155-af10-17e59926ca4b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098035 Jan 15 20:57:25.739299 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1290/2596] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:57:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:57:25.759418 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-53f817b5-5483-48d8-a3b4-95eaa2b0dd6a tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:25.766164 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-53f817b5-5483-48d8-a3b4-95eaa2b0dd6a tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] [instance: 689dd504-e36e-41d0-a461-acce91952e7e] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:25.787114 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-53f817b5-5483-48d8-a3b4-95eaa2b0dd6a tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:25.787370 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-53f817b5-5483-48d8-a3b4-95eaa2b0dd6a tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:25.789295 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-53f817b5-5483-48d8-a3b4-95eaa2b0dd6a tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:25.790079 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-53f817b5-5483-48d8-a3b4-95eaa2b0dd6a tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:26.102113 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-53f817b5-5483-48d8-a3b4-95eaa2b0dd6a tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05483ff6eec84f78a091b29cfbcf61f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a6720be5fb4de7bcd77cc7ef9d8000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:57:26.127422 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-53f817b5-5483-48d8-a3b4-95eaa2b0dd6a tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] 10.222.0.46 "GET /compute/v2.1/servers/689dd504-e36e-41d0-a461-acce91952e7e" status: 200 len: 1321 microversion: 2.1 time: 0.382518 Jan 15 20:57:26.128709 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1291/2597] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:57:25 2022] GET /compute/v2.1/servers/689dd504-e36e-41d0-a461-acce91952e7e => generated 1321 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:26.139793 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a7f16092-2c19-4816-a7c3-96aab5e63126 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:26.143668 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a7f16092-2c19-4816-a7c3-96aab5e63126 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] [instance: 3809db38-b5f5-471e-b6ba-de39c46d53a3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:26.171185 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a7f16092-2c19-4816-a7c3-96aab5e63126 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:26.172668 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a7f16092-2c19-4816-a7c3-96aab5e63126 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:26.177080 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a7f16092-2c19-4816-a7c3-96aab5e63126 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:26.177795 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a7f16092-2c19-4816-a7c3-96aab5e63126 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:26.709477 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-a7f16092-2c19-4816-a7c3-96aab5e63126 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7754a1e8134b4da4803400ca6bb4c540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4a067d84534cbd879732a1b7c057ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:57:26.742476 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a7f16092-2c19-4816-a7c3-96aab5e63126 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] 10.222.0.46 "GET /compute/v2.1/servers/3809db38-b5f5-471e-b6ba-de39c46d53a3" status: 200 len: 1322 microversion: 2.1 time: 0.603015 Jan 15 20:57:26.742476 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1292/2598] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:57:26 2022] GET /compute/v2.1/servers/3809db38-b5f5-471e-b6ba-de39c46d53a3 => generated 1322 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:26.742476 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b4c08283-1000-4071-ba28-cbdeefcaee9f tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:57:26.742952 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b4c08283-1000-4071-ba28-cbdeefcaee9f tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] [instance: 62ae2a15-8c2c-4dad-971f-0611238103a3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:26.762297 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b4c08283-1000-4071-ba28-cbdeefcaee9f tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:26.763084 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b4c08283-1000-4071-ba28-cbdeefcaee9f tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:26.764078 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b4c08283-1000-4071-ba28-cbdeefcaee9f tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:26.765119 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b4c08283-1000-4071-ba28-cbdeefcaee9f tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:26.907501 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b4c08283-1000-4071-ba28-cbdeefcaee9f tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] 10.222.0.46 "POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action" status: 200 len: 32634 microversion: 2.1 time: 0.169423 Jan 15 20:57:26.908193 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1293/2599] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:57:26 2022] POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action => generated 32634 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:57:26.924454 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2caea99d-b52f-4f84-bc8f-7be98a46bcf1 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:26.930975 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-2caea99d-b52f-4f84-bc8f-7be98a46bcf1 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] [instance: 84fe1922-dca1-4713-9ea1-bdd26b309ce6] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:26.952517 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2caea99d-b52f-4f84-bc8f-7be98a46bcf1 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:26.958031 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2caea99d-b52f-4f84-bc8f-7be98a46bcf1 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:26.958031 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2caea99d-b52f-4f84-bc8f-7be98a46bcf1 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:26.958031 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2caea99d-b52f-4f84-bc8f-7be98a46bcf1 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:27.318422 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-2caea99d-b52f-4f84-bc8f-7be98a46bcf1 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ec114f8ece434aa496cd401494e2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a05b1a0a7479db84b762eca23b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:57:27.339585 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2caea99d-b52f-4f84-bc8f-7be98a46bcf1 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] 10.222.0.46 "GET /compute/v2.1/servers/84fe1922-dca1-4713-9ea1-bdd26b309ce6" status: 200 len: 1550 microversion: 2.1 time: 0.430045 Jan 15 20:57:27.341167 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1294/2600] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:57:26 2022] GET /compute/v2.1/servers/84fe1922-dca1-4713-9ea1-bdd26b309ce6 => generated 1550 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:27.351175 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d5ba0356-18d6-40c3-bccd-076e57f0fcf1 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:57:27.351442 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d5ba0356-18d6-40c3-bccd-076e57f0fcf1 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] [instance: 70bf65cf-55e2-459a-aaf1-c3eb851a6ccf] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:27.368590 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d5ba0356-18d6-40c3-bccd-076e57f0fcf1 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:27.369228 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d5ba0356-18d6-40c3-bccd-076e57f0fcf1 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:27.370159 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d5ba0356-18d6-40c3-bccd-076e57f0fcf1 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:27.370595 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d5ba0356-18d6-40c3-bccd-076e57f0fcf1 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:27.484510 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d5ba0356-18d6-40c3-bccd-076e57f0fcf1 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] 10.222.0.46 "POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action" status: 200 len: 32642 microversion: 2.1 time: 0.142041 Jan 15 20:57:27.494387 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1295/2601] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:57:27 2022] POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action => generated 32642 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:57:27.504529 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-bafe09bb-dff3-41ff-b5a3-f2c6237dcf12 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:27.506023 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-bafe09bb-dff3-41ff-b5a3-f2c6237dcf12 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: 0874eafa-ffa2-4257-b6c5-66e4bef983db] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:27.519152 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bafe09bb-dff3-41ff-b5a3-f2c6237dcf12 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:27.519784 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bafe09bb-dff3-41ff-b5a3-f2c6237dcf12 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:27.520810 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bafe09bb-dff3-41ff-b5a3-f2c6237dcf12 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:27.521600 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bafe09bb-dff3-41ff-b5a3-f2c6237dcf12 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:27.898452 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-bafe09bb-dff3-41ff-b5a3-f2c6237dcf12 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:57:27.898452 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-bafe09bb-dff3-41ff-b5a3-f2c6237dcf12 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/0874eafa-ffa2-4257-b6c5-66e4bef983db" status: 200 len: 1523 microversion: 2.1 time: 0.368800 Jan 15 20:57:27.898452 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1296/2602] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:57:27 2022] GET /compute/v2.1/servers/0874eafa-ffa2-4257-b6c5-66e4bef983db => generated 1523 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:27.898452 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-19390dad-1a83-4c9b-9a06-975e1ae6ac55 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:27.898452 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-19390dad-1a83-4c9b-9a06-975e1ae6ac55 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] [instance: 689dd504-e36e-41d0-a461-acce91952e7e] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:27.912034 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-19390dad-1a83-4c9b-9a06-975e1ae6ac55 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:27.916242 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-19390dad-1a83-4c9b-9a06-975e1ae6ac55 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:27.917145 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-19390dad-1a83-4c9b-9a06-975e1ae6ac55 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:27.917819 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-19390dad-1a83-4c9b-9a06-975e1ae6ac55 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:28.283088 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-19390dad-1a83-4c9b-9a06-975e1ae6ac55 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05483ff6eec84f78a091b29cfbcf61f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a6720be5fb4de7bcd77cc7ef9d8000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:57:28.295696 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-19390dad-1a83-4c9b-9a06-975e1ae6ac55 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] 10.222.0.46 "GET /compute/v2.1/servers/689dd504-e36e-41d0-a461-acce91952e7e" status: 200 len: 1321 microversion: 2.1 time: 0.412451 Jan 15 20:57:28.297011 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1297/2603] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:57:27 2022] GET /compute/v2.1/servers/689dd504-e36e-41d0-a461-acce91952e7e => generated 1321 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:28.307967 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-4217db61-58e5-44f3-9b73-409f29ca58a0 req-86fa2159-1d8b-4e28-984b-037f60f9fcf6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3809db38-b5f5-471e-b6ba-de39c46d53a3", "name": "network-vif-plugged", "status": "completed", "tag": "9409ec6f-f317-4b00-ad1b-b8d9a6b10896"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:57:28.310572 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:57:28.310572 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:57:28.320325 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-4217db61-58e5-44f3-9b73-409f29ca58a0 req-86fa2159-1d8b-4e28-984b-037f60f9fcf6 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:28.321183 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-4217db61-58e5-44f3-9b73-409f29ca58a0 req-86fa2159-1d8b-4e28-984b-037f60f9fcf6 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:28.339989 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-4217db61-58e5-44f3-9b73-409f29ca58a0 req-86fa2159-1d8b-4e28-984b-037f60f9fcf6 service nova] Creating event network-vif-plugged:9409ec6f-f317-4b00-ad1b-b8d9a6b10896 for instance 3809db38-b5f5-471e-b6ba-de39c46d53a3 on nch1-master-1 Jan 15 20:57:28.347396 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-4217db61-58e5-44f3-9b73-409f29ca58a0 req-86fa2159-1d8b-4e28-984b-037f60f9fcf6 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044793 Jan 15 20:57:28.348690 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1298/2604] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:57:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:57:28.357129 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2e722252-8077-48b3-a82f-f5d35fd57117 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:28.358226 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-2e722252-8077-48b3-a82f-f5d35fd57117 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] [instance: 3809db38-b5f5-471e-b6ba-de39c46d53a3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:28.365498 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2e722252-8077-48b3-a82f-f5d35fd57117 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:28.366267 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2e722252-8077-48b3-a82f-f5d35fd57117 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:28.367378 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2e722252-8077-48b3-a82f-f5d35fd57117 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:28.368599 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2e722252-8077-48b3-a82f-f5d35fd57117 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:28.642424 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-2e722252-8077-48b3-a82f-f5d35fd57117 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7754a1e8134b4da4803400ca6bb4c540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4a067d84534cbd879732a1b7c057ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:57:28.655948 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2e722252-8077-48b3-a82f-f5d35fd57117 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] 10.222.0.46 "GET /compute/v2.1/servers/3809db38-b5f5-471e-b6ba-de39c46d53a3" status: 200 len: 1322 microversion: 2.1 time: 0.305586 Jan 15 20:57:28.656697 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1299/2605] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:57:28 2022] GET /compute/v2.1/servers/3809db38-b5f5-471e-b6ba-de39c46d53a3 => generated 1322 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:28.670054 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-10a0671d-2702-424a-a371-3e33c3addfa1 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:57:28.685909 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-10a0671d-2702-424a-a371-3e33c3addfa1 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] [instance: 62ae2a15-8c2c-4dad-971f-0611238103a3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:28.712199 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-10a0671d-2702-424a-a371-3e33c3addfa1 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:28.714258 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-10a0671d-2702-424a-a371-3e33c3addfa1 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:28.715281 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-10a0671d-2702-424a-a371-3e33c3addfa1 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:28.715846 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-10a0671d-2702-424a-a371-3e33c3addfa1 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:28.825425 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-10a0671d-2702-424a-a371-3e33c3addfa1 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] 10.222.0.46 "POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action" status: 200 len: 32634 microversion: 2.1 time: 0.167104 Jan 15 20:57:28.827685 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1300/2606] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:57:28 2022] POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action => generated 32634 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:57:28.837203 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5cf679fb-eafe-45ad-b013-9da672fc7ce7 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:28.838970 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-5cf679fb-eafe-45ad-b013-9da672fc7ce7 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] [instance: 84fe1922-dca1-4713-9ea1-bdd26b309ce6] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:28.847866 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5cf679fb-eafe-45ad-b013-9da672fc7ce7 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:28.848689 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5cf679fb-eafe-45ad-b013-9da672fc7ce7 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:28.850344 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5cf679fb-eafe-45ad-b013-9da672fc7ce7 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:28.851273 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5cf679fb-eafe-45ad-b013-9da672fc7ce7 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:29.101965 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-5cf679fb-eafe-45ad-b013-9da672fc7ce7 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ec114f8ece434aa496cd401494e2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a05b1a0a7479db84b762eca23b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:57:29.114409 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5cf679fb-eafe-45ad-b013-9da672fc7ce7 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] 10.222.0.46 "GET /compute/v2.1/servers/84fe1922-dca1-4713-9ea1-bdd26b309ce6" status: 200 len: 1550 microversion: 2.1 time: 0.283771 Jan 15 20:57:29.124896 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1301/2607] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:57:28 2022] GET /compute/v2.1/servers/84fe1922-dca1-4713-9ea1-bdd26b309ce6 => generated 1550 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:29.124896 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-131bd1c0-8897-408a-bb8d-c10a988b2a27 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:57:29.124896 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-131bd1c0-8897-408a-bb8d-c10a988b2a27 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] [instance: 70bf65cf-55e2-459a-aaf1-c3eb851a6ccf] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:29.137444 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-131bd1c0-8897-408a-bb8d-c10a988b2a27 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:29.137444 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-131bd1c0-8897-408a-bb8d-c10a988b2a27 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:29.138550 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-131bd1c0-8897-408a-bb8d-c10a988b2a27 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:29.139068 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-131bd1c0-8897-408a-bb8d-c10a988b2a27 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:29.204393 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-131bd1c0-8897-408a-bb8d-c10a988b2a27 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] 10.222.0.46 "POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action" status: 200 len: 32642 microversion: 2.1 time: 0.087150 Jan 15 20:57:29.206129 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1302/2608] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:57:29 2022] POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action => generated 32642 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:57:29.212560 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-b09620f2-6855-40ba-909c-f9b44e589e02 req-53ff47c8-e4e9-4e41-a744-0cefbf412161 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84fe1922-dca1-4713-9ea1-bdd26b309ce6", "tag": "4dd9a494-ab1e-4bde-892a-a7dc884ad0a1"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:57:29.219311 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:57:29.219311 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:57:29.238526 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-b09620f2-6855-40ba-909c-f9b44e589e02 req-53ff47c8-e4e9-4e41-a744-0cefbf412161 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:29.239172 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-b09620f2-6855-40ba-909c-f9b44e589e02 req-53ff47c8-e4e9-4e41-a744-0cefbf412161 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:29.256795 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-b09620f2-6855-40ba-909c-f9b44e589e02 req-53ff47c8-e4e9-4e41-a744-0cefbf412161 service nova] Creating event network-changed:4dd9a494-ab1e-4bde-892a-a7dc884ad0a1 for instance 84fe1922-dca1-4713-9ea1-bdd26b309ce6 on nch1-master-1 Jan 15 20:57:29.264144 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-b09620f2-6855-40ba-909c-f9b44e589e02 req-53ff47c8-e4e9-4e41-a744-0cefbf412161 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055834 Jan 15 20:57:29.265804 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1303/2609] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:57:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:57:29.275032 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f4bb0a00-75e7-4e70-844f-8bf72d219cba tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:29.276692 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f4bb0a00-75e7-4e70-844f-8bf72d219cba tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: 0874eafa-ffa2-4257-b6c5-66e4bef983db] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:29.284981 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-8a937b4c-8686-4666-b7a8-2230249fdb64 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] 10.222.0.46 "GET /compute/v2.1/images/9edcd3cd-5d8f-4a6a-9e1e-eff94d6299d6" status: 200 len: 1453 microversion: 2.1 time: 17.530833 Jan 15 20:57:29.286117 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f4bb0a00-75e7-4e70-844f-8bf72d219cba tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:29.287353 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f4bb0a00-75e7-4e70-844f-8bf72d219cba tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:29.287823 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1307/2610] 10.222.0.46 () {58 vars in 1232 bytes} [Sat Jan 15 20:57:11 2022] GET /compute/v2.1/images/9edcd3cd-5d8f-4a6a-9e1e-eff94d6299d6 => generated 1453 bytes in 17533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:29.289277 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f4bb0a00-75e7-4e70-844f-8bf72d219cba tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:29.289939 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f4bb0a00-75e7-4e70-844f-8bf72d219cba tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:29.323048 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8513295c-f4e6-45cd-9cbb-aa733ef30aa1 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:29.329910 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-8513295c-f4e6-45cd-9cbb-aa733ef30aa1 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] [instance: 689dd504-e36e-41d0-a461-acce91952e7e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:29.365945 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8513295c-f4e6-45cd-9cbb-aa733ef30aa1 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:29.366612 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8513295c-f4e6-45cd-9cbb-aa733ef30aa1 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:29.367446 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8513295c-f4e6-45cd-9cbb-aa733ef30aa1 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:29.367876 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8513295c-f4e6-45cd-9cbb-aa733ef30aa1 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:29.630547 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-f4bb0a00-75e7-4e70-844f-8bf72d219cba tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:57:29.653575 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f4bb0a00-75e7-4e70-844f-8bf72d219cba tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/0874eafa-ffa2-4257-b6c5-66e4bef983db" status: 200 len: 1523 microversion: 2.1 time: 0.385265 Jan 15 20:57:29.657824 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1304/2611] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:57:29 2022] GET /compute/v2.1/servers/0874eafa-ffa2-4257-b6c5-66e4bef983db => generated 1523 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:29.675048 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-8513295c-f4e6-45cd-9cbb-aa733ef30aa1 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05483ff6eec84f78a091b29cfbcf61f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a6720be5fb4de7bcd77cc7ef9d8000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:57:29.686107 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-8513295c-f4e6-45cd-9cbb-aa733ef30aa1 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] 10.222.0.46 "GET /compute/v2.1/servers/689dd504-e36e-41d0-a461-acce91952e7e" status: 200 len: 1321 microversion: 2.1 time: 0.376196 Jan 15 20:57:29.686561 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5263964b-ddd1-4f38-9a09-3de48b848c0b tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:29.687249 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-5263964b-ddd1-4f38-9a09-3de48b848c0b tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] [instance: 3809db38-b5f5-471e-b6ba-de39c46d53a3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:29.688327 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1308/2612] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:57:29 2022] GET /compute/v2.1/servers/689dd504-e36e-41d0-a461-acce91952e7e => generated 1321 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:29.694164 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5263964b-ddd1-4f38-9a09-3de48b848c0b tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:29.694624 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5263964b-ddd1-4f38-9a09-3de48b848c0b tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:29.695428 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5263964b-ddd1-4f38-9a09-3de48b848c0b tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:29.696444 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5263964b-ddd1-4f38-9a09-3de48b848c0b tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:29.839309 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-96304255-e253-4f97-9c90-904864e0dad3 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:57:29.840455 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-96304255-e253-4f97-9c90-904864e0dad3 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] [instance: 62ae2a15-8c2c-4dad-971f-0611238103a3] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:29.856563 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-96304255-e253-4f97-9c90-904864e0dad3 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:29.857161 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-96304255-e253-4f97-9c90-904864e0dad3 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:29.858575 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-96304255-e253-4f97-9c90-904864e0dad3 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:29.859115 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-96304255-e253-4f97-9c90-904864e0dad3 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:29.874759 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-5263964b-ddd1-4f38-9a09-3de48b848c0b tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7754a1e8134b4da4803400ca6bb4c540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4a067d84534cbd879732a1b7c057ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:57:29.887882 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5263964b-ddd1-4f38-9a09-3de48b848c0b tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] 10.222.0.46 "GET /compute/v2.1/servers/3809db38-b5f5-471e-b6ba-de39c46d53a3" status: 200 len: 1322 microversion: 2.1 time: 0.215809 Jan 15 20:57:29.889037 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1305/2613] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:57:29 2022] GET /compute/v2.1/servers/3809db38-b5f5-471e-b6ba-de39c46d53a3 => generated 1322 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:29.918035 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-96304255-e253-4f97-9c90-904864e0dad3 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] 10.222.0.46 "POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action" status: 200 len: 32634 microversion: 2.1 time: 0.083070 Jan 15 20:57:29.920881 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1309/2614] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:57:29 2022] POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action => generated 32634 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:57:30.133636 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-39347f6d-b78d-4211-a97f-1e3e936643c8 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:30.143598 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-39347f6d-b78d-4211-a97f-1e3e936643c8 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] [instance: 84fe1922-dca1-4713-9ea1-bdd26b309ce6] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:30.154202 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-39347f6d-b78d-4211-a97f-1e3e936643c8 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:30.154652 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-39347f6d-b78d-4211-a97f-1e3e936643c8 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:30.155443 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-39347f6d-b78d-4211-a97f-1e3e936643c8 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:30.157159 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-39347f6d-b78d-4211-a97f-1e3e936643c8 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:30.221222 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-5f4384a6-7133-495c-b7e4-5f211eab397e tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:57:30.222152 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-5f4384a6-7133-495c-b7e4-5f211eab397e tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] [instance: 70bf65cf-55e2-459a-aaf1-c3eb851a6ccf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:30.234344 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5f4384a6-7133-495c-b7e4-5f211eab397e tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:30.234976 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5f4384a6-7133-495c-b7e4-5f211eab397e tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:30.236429 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5f4384a6-7133-495c-b7e4-5f211eab397e tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:30.237017 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5f4384a6-7133-495c-b7e4-5f211eab397e tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:30.296376 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-5f4384a6-7133-495c-b7e4-5f211eab397e tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] 10.222.0.46 "POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action" status: 200 len: 32642 microversion: 2.1 time: 0.081212 Jan 15 20:57:30.298750 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1310/2615] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:57:30 2022] POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action => generated 32642 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:57:30.304348 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-63ec94c8-5e77-4b31-9ac2-4cb4926bb4f3 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Calling method '.version_select at 0x7f30c8f04160>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:30.332211 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-39347f6d-b78d-4211-a97f-1e3e936643c8 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ec114f8ece434aa496cd401494e2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a05b1a0a7479db84b762eca23b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:57:30.341604 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-39347f6d-b78d-4211-a97f-1e3e936643c8 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] 10.222.0.46 "GET /compute/v2.1/servers/84fe1922-dca1-4713-9ea1-bdd26b309ce6" status: 200 len: 1550 microversion: 2.1 time: 0.212598 Jan 15 20:57:30.342427 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1306/2616] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:57:30 2022] GET /compute/v2.1/servers/84fe1922-dca1-4713-9ea1-bdd26b309ce6 => generated 1550 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:57:30.375995 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-63ec94c8-5e77-4b31-9ac2-4cb4926bb4f3 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] 10.222.0.46 "GET /compute/v2.1/images/9edcd3cd-5d8f-4a6a-9e1e-eff94d6299d6" status: 200 len: 1462 microversion: 2.1 time: 0.075604 Jan 15 20:57:30.376242 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-4c94a8b8-0954-4b32-88e6-bb397814780c req-a6895d33-25e8-4669-8322-3971ece0da8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e04f7a96-62cb-4aae-9612-aa8df88aef61", "name": "network-vif-plugged", "status": "completed", "tag": "dd2cbd6f-3487-4fa2-b57c-a5a8ae164d93"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:57:30.383168 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:57:30.383168 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:57:30.384319 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1311/2617] 10.222.0.46 () {58 vars in 1232 bytes} [Sat Jan 15 20:57:30 2022] GET /compute/v2.1/images/9edcd3cd-5d8f-4a6a-9e1e-eff94d6299d6 => generated 1462 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:30.392737 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-4c94a8b8-0954-4b32-88e6-bb397814780c req-a6895d33-25e8-4669-8322-3971ece0da8d service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:30.393186 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-35009d6c-7199-4c8b-b41b-e7d23dac3c10 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Calling method '.version_select at 0x7f30c8df21f0>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:30.393905 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-4c94a8b8-0954-4b32-88e6-bb397814780c req-a6895d33-25e8-4669-8322-3971ece0da8d service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:30.417172 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-4c94a8b8-0954-4b32-88e6-bb397814780c req-a6895d33-25e8-4669-8322-3971ece0da8d service nova] Creating event network-vif-plugged:dd2cbd6f-3487-4fa2-b57c-a5a8ae164d93 for instance e04f7a96-62cb-4aae-9612-aa8df88aef61 on nch2-master-1 Jan 15 20:57:30.423850 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-4c94a8b8-0954-4b32-88e6-bb397814780c req-a6895d33-25e8-4669-8322-3971ece0da8d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057399 Jan 15 20:57:30.425750 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1307/2618] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:57:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:57:30.455244 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-35009d6c-7199-4c8b-b41b-e7d23dac3c10 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] 10.222.0.46 "GET /compute/v2.1/images/9edcd3cd-5d8f-4a6a-9e1e-eff94d6299d6" status: 200 len: 1462 microversion: 2.1 time: 0.067980 Jan 15 20:57:30.458454 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1312/2619] 10.222.0.46 () {58 vars in 1232 bytes} [Sat Jan 15 20:57:30 2022] GET /compute/v2.1/images/9edcd3cd-5d8f-4a6a-9e1e-eff94d6299d6 => generated 1462 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:30.473914 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f1352fb0-20ae-4608-b1e4-c14ca826695f tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:30.474857 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f1352fb0-20ae-4608-b1e4-c14ca826695f tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] [instance: beffc13d-acd3-455e-96d6-be4bcbb81b88] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:30.483566 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f1352fb0-20ae-4608-b1e4-c14ca826695f tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:30.484975 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f1352fb0-20ae-4608-b1e4-c14ca826695f tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:30.485939 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f1352fb0-20ae-4608-b1e4-c14ca826695f tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:30.486534 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f1352fb0-20ae-4608-b1e4-c14ca826695f tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:30.675008 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-6bece37c-d641-48b0-8ce0-d49c64f04b11 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:30.676041 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-6bece37c-d641-48b0-8ce0-d49c64f04b11 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: 0874eafa-ffa2-4257-b6c5-66e4bef983db] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:30.684335 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6bece37c-d641-48b0-8ce0-d49c64f04b11 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:30.685119 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6bece37c-d641-48b0-8ce0-d49c64f04b11 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:30.686180 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6bece37c-d641-48b0-8ce0-d49c64f04b11 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:30.686801 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6bece37c-d641-48b0-8ce0-d49c64f04b11 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:30.863331 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-f1352fb0-20ae-4608-b1e4-c14ca826695f tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52bd234a49b24c1a8bb60ad42c0db262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb6e08a94bc415fada171a2eca3e7ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:57:30.877179 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f1352fb0-20ae-4608-b1e4-c14ca826695f tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] 10.222.0.46 "GET /compute/v2.1/servers/beffc13d-acd3-455e-96d6-be4bcbb81b88" status: 200 len: 1467 microversion: 2.1 time: 0.408717 Jan 15 20:57:30.899369 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1308/2620] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:57:30 2022] GET /compute/v2.1/servers/beffc13d-acd3-455e-96d6-be4bcbb81b88 => generated 1467 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:57:30.906103 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-0cc03151-6cba-4a6c-8b69-e9ae24f632be tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:30.908296 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-0cc03151-6cba-4a6c-8b69-e9ae24f632be tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] [instance: 689dd504-e36e-41d0-a461-acce91952e7e] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:30.916834 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0cc03151-6cba-4a6c-8b69-e9ae24f632be tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:30.919413 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0cc03151-6cba-4a6c-8b69-e9ae24f632be tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:30.921849 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0cc03151-6cba-4a6c-8b69-e9ae24f632be tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:30.925321 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0cc03151-6cba-4a6c-8b69-e9ae24f632be tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:31.066777 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-6bece37c-d641-48b0-8ce0-d49c64f04b11 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:57:31.076477 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-6bece37c-d641-48b0-8ce0-d49c64f04b11 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/0874eafa-ffa2-4257-b6c5-66e4bef983db" status: 200 len: 1505 microversion: 2.1 time: 0.405513 Jan 15 20:57:31.081681 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1313/2621] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:57:30 2022] GET /compute/v2.1/servers/0874eafa-ffa2-4257-b6c5-66e4bef983db => generated 1505 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:57:31.096768 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f8af9cfa-aae6-4ba0-99cb-3b29e545128e tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-498796944"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:57:31.098451 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f8af9cfa-aae6-4ba0-99cb-3b29e545128e tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] [instance: bffd829f-bc6e-40a7-a9d8-59af77e5b10d] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:31.118280 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f8af9cfa-aae6-4ba0-99cb-3b29e545128e tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:31.119286 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f8af9cfa-aae6-4ba0-99cb-3b29e545128e tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:31.120486 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f8af9cfa-aae6-4ba0-99cb-3b29e545128e tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:31.121348 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f8af9cfa-aae6-4ba0-99cb-3b29e545128e tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:31.336931 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-0cc03151-6cba-4a6c-8b69-e9ae24f632be tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05483ff6eec84f78a091b29cfbcf61f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a6720be5fb4de7bcd77cc7ef9d8000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:57:31.349361 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-0cc03151-6cba-4a6c-8b69-e9ae24f632be tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] 10.222.0.46 "GET /compute/v2.1/servers/689dd504-e36e-41d0-a461-acce91952e7e" status: 200 len: 1321 microversion: 2.1 time: 0.447573 Jan 15 20:57:31.350148 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1309/2622] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:57:30 2022] GET /compute/v2.1/servers/689dd504-e36e-41d0-a461-acce91952e7e => generated 1321 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:31.364440 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8a8d5f1e-cfb2-429f-9275-ad741357ef0b tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:31.364686 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-8a8d5f1e-cfb2-429f-9275-ad741357ef0b tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] [instance: 3809db38-b5f5-471e-b6ba-de39c46d53a3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:31.381611 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8a8d5f1e-cfb2-429f-9275-ad741357ef0b tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:31.382076 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8a8d5f1e-cfb2-429f-9275-ad741357ef0b tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:31.382892 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8a8d5f1e-cfb2-429f-9275-ad741357ef0b tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:31.383330 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8a8d5f1e-cfb2-429f-9275-ad741357ef0b tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:31.553151 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f8af9cfa-aae6-4ba0-99cb-3b29e545128e tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] 10.222.0.46 "POST /compute/v2.1/servers/bffd829f-bc6e-40a7-a9d8-59af77e5b10d/action" status: 202 len: 0 microversion: 2.1 time: 0.469445 Jan 15 20:57:31.554441 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1314/2623] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:57:31 2022] POST /compute/v2.1/servers/bffd829f-bc6e-40a7-a9d8-59af77e5b10d/action => generated 0 bytes in 472 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jan 15 20:57:31.560447 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-937ff2fe-7f7c-49f2-9872-dbb911df0535 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:57:31.561511 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-937ff2fe-7f7c-49f2-9872-dbb911df0535 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] [instance: 62ae2a15-8c2c-4dad-971f-0611238103a3] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:31.569099 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-937ff2fe-7f7c-49f2-9872-dbb911df0535 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:31.569848 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-937ff2fe-7f7c-49f2-9872-dbb911df0535 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:31.570723 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-937ff2fe-7f7c-49f2-9872-dbb911df0535 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:31.571335 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-937ff2fe-7f7c-49f2-9872-dbb911df0535 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:31.625553 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-937ff2fe-7f7c-49f2-9872-dbb911df0535 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] 10.222.0.46 "POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action" status: 200 len: 32634 microversion: 2.1 time: 0.068095 Jan 15 20:57:31.627040 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1315/2624] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:57:31 2022] POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action => generated 32634 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:57:31.633520 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-831bece2-588a-46ba-979c-772dbb6865a0 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:57:31.635224 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-831bece2-588a-46ba-979c-772dbb6865a0 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] [instance: 70bf65cf-55e2-459a-aaf1-c3eb851a6ccf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:31.642905 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-831bece2-588a-46ba-979c-772dbb6865a0 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:31.643455 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-831bece2-588a-46ba-979c-772dbb6865a0 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:31.644739 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-831bece2-588a-46ba-979c-772dbb6865a0 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:31.644739 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-831bece2-588a-46ba-979c-772dbb6865a0 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:31.658905 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-8a8d5f1e-cfb2-429f-9275-ad741357ef0b tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7754a1e8134b4da4803400ca6bb4c540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4a067d84534cbd879732a1b7c057ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:57:31.674252 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-8a8d5f1e-cfb2-429f-9275-ad741357ef0b tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] 10.222.0.46 "GET /compute/v2.1/servers/3809db38-b5f5-471e-b6ba-de39c46d53a3" status: 200 len: 1516 microversion: 2.1 time: 0.313660 Jan 15 20:57:31.676545 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1310/2625] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:57:31 2022] GET /compute/v2.1/servers/3809db38-b5f5-471e-b6ba-de39c46d53a3 => generated 1516 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:31.681931 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-1785f215-4587-4a3d-ae2c-2609cebf9258 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:31.682606 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-1785f215-4587-4a3d-ae2c-2609cebf9258 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] [instance: 84fe1922-dca1-4713-9ea1-bdd26b309ce6] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:31.703167 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1785f215-4587-4a3d-ae2c-2609cebf9258 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:31.703634 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1785f215-4587-4a3d-ae2c-2609cebf9258 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:31.704444 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1785f215-4587-4a3d-ae2c-2609cebf9258 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:31.704908 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1785f215-4587-4a3d-ae2c-2609cebf9258 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:31.726879 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-831bece2-588a-46ba-979c-772dbb6865a0 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] 10.222.0.46 "POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action" status: 200 len: 32642 microversion: 2.1 time: 0.097663 Jan 15 20:57:31.727708 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1316/2626] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:57:31 2022] POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action => generated 32642 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:57:31.742821 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-83ce1397-8db6-4a1f-9351-6b3af9152620 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Calling method '.version_select at 0x7f30ced03a60>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:31.831632 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-83ce1397-8db6-4a1f-9351-6b3af9152620 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] 10.222.0.46 "GET /compute/v2.1/images/1f99b18e-87c4-42c4-834c-464b28e8793e" status: 200 len: 1452 microversion: 2.1 time: 0.096155 Jan 15 20:57:31.840113 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1317/2627] 10.222.0.46 () {58 vars in 1232 bytes} [Sat Jan 15 20:57:31 2022] GET /compute/v2.1/images/1f99b18e-87c4-42c4-834c-464b28e8793e => generated 1452 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:31.862820 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f74eeea1-9e34-4c6a-a04f-ceb147a4440c tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:31.864016 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f74eeea1-9e34-4c6a-a04f-ceb147a4440c tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] [instance: 733106f5-de5a-4e36-9181-b277ccd1f423] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:31.875428 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f74eeea1-9e34-4c6a-a04f-ceb147a4440c tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:31.876343 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f74eeea1-9e34-4c6a-a04f-ceb147a4440c tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:31.876686 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f74eeea1-9e34-4c6a-a04f-ceb147a4440c tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:31.878699 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f74eeea1-9e34-4c6a-a04f-ceb147a4440c tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:32.216256 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-1785f215-4587-4a3d-ae2c-2609cebf9258 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ec114f8ece434aa496cd401494e2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a05b1a0a7479db84b762eca23b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:57:32.226146 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-1785f215-4587-4a3d-ae2c-2609cebf9258 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] 10.222.0.46 "GET /compute/v2.1/servers/84fe1922-dca1-4713-9ea1-bdd26b309ce6" status: 200 len: 1550 microversion: 2.1 time: 0.548198 Jan 15 20:57:32.230143 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1311/2628] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:57:31 2022] GET /compute/v2.1/servers/84fe1922-dca1-4713-9ea1-bdd26b309ce6 => generated 1550 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:32.236048 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-98a4dd05-8769-4926-a1a7-e41724fb36f8 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:32.236796 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-98a4dd05-8769-4926-a1a7-e41724fb36f8 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: 0874eafa-ffa2-4257-b6c5-66e4bef983db] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:32.245330 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-98a4dd05-8769-4926-a1a7-e41724fb36f8 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:32.247018 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-98a4dd05-8769-4926-a1a7-e41724fb36f8 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:32.248094 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-98a4dd05-8769-4926-a1a7-e41724fb36f8 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:32.248783 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-98a4dd05-8769-4926-a1a7-e41724fb36f8 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:32.314720 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-f74eeea1-9e34-4c6a-a04f-ceb147a4440c tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7754a1e8134b4da4803400ca6bb4c540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4a067d84534cbd879732a1b7c057ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:57:32.323816 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f74eeea1-9e34-4c6a-a04f-ceb147a4440c tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] 10.222.0.46 "GET /compute/v2.1/servers/733106f5-de5a-4e36-9181-b277ccd1f423" status: 200 len: 1515 microversion: 2.1 time: 0.481062 Jan 15 20:57:32.324398 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1318/2629] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:57:31 2022] GET /compute/v2.1/servers/733106f5-de5a-4e36-9181-b277ccd1f423 => generated 1515 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:32.340246 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e2cfaedb-2ca0-4ce1-839c-6a1010bcc10f tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:32.341105 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e2cfaedb-2ca0-4ce1-839c-6a1010bcc10f tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] [instance: 672fd3e7-4b14-4aa7-97da-6245dfabb878] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:32.347221 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e2cfaedb-2ca0-4ce1-839c-6a1010bcc10f tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:32.347916 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e2cfaedb-2ca0-4ce1-839c-6a1010bcc10f tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:32.348913 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e2cfaedb-2ca0-4ce1-839c-6a1010bcc10f tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:32.355261 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e2cfaedb-2ca0-4ce1-839c-6a1010bcc10f tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:32.571908 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-98a4dd05-8769-4926-a1a7-e41724fb36f8 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:57:32.583862 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-98a4dd05-8769-4926-a1a7-e41724fb36f8 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/0874eafa-ffa2-4257-b6c5-66e4bef983db" status: 200 len: 1505 microversion: 2.1 time: 0.352091 Jan 15 20:57:32.584463 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1312/2630] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:57:32 2022] GET /compute/v2.1/servers/0874eafa-ffa2-4257-b6c5-66e4bef983db => generated 1505 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:32.594652 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-7e3eeadd-76db-49d5-b596-9439c39d75cc tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:32.596064 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-7e3eeadd-76db-49d5-b596-9439c39d75cc tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] [instance: 689dd504-e36e-41d0-a461-acce91952e7e] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:32.607563 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7e3eeadd-76db-49d5-b596-9439c39d75cc tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:32.608191 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7e3eeadd-76db-49d5-b596-9439c39d75cc tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:32.609142 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7e3eeadd-76db-49d5-b596-9439c39d75cc tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:32.609680 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7e3eeadd-76db-49d5-b596-9439c39d75cc tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:32.678808 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-e2cfaedb-2ca0-4ce1-839c-6a1010bcc10f tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7754a1e8134b4da4803400ca6bb4c540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4a067d84534cbd879732a1b7c057ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:57:32.686850 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e2cfaedb-2ca0-4ce1-839c-6a1010bcc10f tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] 10.222.0.46 "GET /compute/v2.1/servers/672fd3e7-4b14-4aa7-97da-6245dfabb878" status: 200 len: 1515 microversion: 2.1 time: 0.351072 Jan 15 20:57:32.687667 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1319/2631] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:57:32 2022] GET /compute/v2.1/servers/672fd3e7-4b14-4aa7-97da-6245dfabb878 => generated 1515 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:32.692234 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-09c9d515-5010-46ea-9d38-24d637936f70 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:57:32.693575 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-09c9d515-5010-46ea-9d38-24d637936f70 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] [instance: 62ae2a15-8c2c-4dad-971f-0611238103a3] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:32.700200 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-09c9d515-5010-46ea-9d38-24d637936f70 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:32.700951 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-09c9d515-5010-46ea-9d38-24d637936f70 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:32.701954 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-09c9d515-5010-46ea-9d38-24d637936f70 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:32.702401 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-09c9d515-5010-46ea-9d38-24d637936f70 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:32.750523 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-09c9d515-5010-46ea-9d38-24d637936f70 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] 10.222.0.46 "POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action" status: 200 len: 32634 microversion: 2.1 time: 0.060717 Jan 15 20:57:32.751053 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1320/2632] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:57:32 2022] POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action => generated 32634 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:57:32.757941 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f256a281-64ca-45ac-ba3e-f09eb3f851ce tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:32.758917 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f256a281-64ca-45ac-ba3e-f09eb3f851ce tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] [instance: 672fd3e7-4b14-4aa7-97da-6245dfabb878] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:32.769711 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f256a281-64ca-45ac-ba3e-f09eb3f851ce tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:32.770456 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f256a281-64ca-45ac-ba3e-f09eb3f851ce tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:32.771471 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f256a281-64ca-45ac-ba3e-f09eb3f851ce tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:32.772240 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f256a281-64ca-45ac-ba3e-f09eb3f851ce tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:32.810374 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f256a281-64ca-45ac-ba3e-f09eb3f851ce tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] [instance: 672fd3e7-4b14-4aa7-97da-6245dfabb878] Going to try to terminate instance {{(pid=129366) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 20:57:32.844405 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-7e3eeadd-76db-49d5-b596-9439c39d75cc tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05483ff6eec84f78a091b29cfbcf61f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a6720be5fb4de7bcd77cc7ef9d8000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:57:32.852643 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-7e3eeadd-76db-49d5-b596-9439c39d75cc tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] 10.222.0.46 "GET /compute/v2.1/servers/689dd504-e36e-41d0-a461-acce91952e7e" status: 200 len: 1321 microversion: 2.1 time: 0.267093 Jan 15 20:57:32.853760 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1313/2633] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:57:32 2022] GET /compute/v2.1/servers/689dd504-e36e-41d0-a461-acce91952e7e => generated 1321 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:32.859579 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-1c1ed685-b6d4-4e24-a7ba-c7283ad4bd56 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:57:32.860951 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-1c1ed685-b6d4-4e24-a7ba-c7283ad4bd56 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] [instance: 70bf65cf-55e2-459a-aaf1-c3eb851a6ccf] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:32.868544 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1c1ed685-b6d4-4e24-a7ba-c7283ad4bd56 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:32.869399 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1c1ed685-b6d4-4e24-a7ba-c7283ad4bd56 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:32.870214 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1c1ed685-b6d4-4e24-a7ba-c7283ad4bd56 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:32.870874 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1c1ed685-b6d4-4e24-a7ba-c7283ad4bd56 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:32.926818 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f256a281-64ca-45ac-ba3e-f09eb3f851ce tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] 10.222.0.46 "DELETE /compute/v2.1/servers/672fd3e7-4b14-4aa7-97da-6245dfabb878" status: 204 len: 0 microversion: 2.1 time: 0.172822 Jan 15 20:57:32.928674 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1321/2634] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 20:57:32 2022] DELETE /compute/v2.1/servers/672fd3e7-4b14-4aa7-97da-6245dfabb878 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 20:57:32.936409 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-43b95a04-cf5d-448a-848d-a06d86a1d7a4 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Calling method '.version_select at 0x7f30cec63b80>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:32.940285 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-1c1ed685-b6d4-4e24-a7ba-c7283ad4bd56 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] 10.222.0.46 "POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action" status: 200 len: 32642 microversion: 2.1 time: 0.084755 Jan 15 20:57:32.941610 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1314/2635] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:57:32 2022] POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action => generated 32642 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:57:32.949808 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-bba9611a-1b40-4838-9050-dd74e13443b0 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:32.950763 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-bba9611a-1b40-4838-9050-dd74e13443b0 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] [instance: 672fd3e7-4b14-4aa7-97da-6245dfabb878] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:32.966347 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bba9611a-1b40-4838-9050-dd74e13443b0 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:32.972970 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bba9611a-1b40-4838-9050-dd74e13443b0 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:32.974885 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bba9611a-1b40-4838-9050-dd74e13443b0 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:32.976074 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bba9611a-1b40-4838-9050-dd74e13443b0 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:33.008573 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-43b95a04-cf5d-448a-848d-a06d86a1d7a4 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] 10.222.0.46 "GET /compute/v2.1/images/1f99b18e-87c4-42c4-834c-464b28e8793e" status: 200 len: 1452 microversion: 2.1 time: 0.077917 Jan 15 20:57:33.009634 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1322/2636] 10.222.0.46 () {58 vars in 1232 bytes} [Sat Jan 15 20:57:32 2022] GET /compute/v2.1/images/1f99b18e-87c4-42c4-834c-464b28e8793e => generated 1452 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:33.175573 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-bba9611a-1b40-4838-9050-dd74e13443b0 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7754a1e8134b4da4803400ca6bb4c540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4a067d84534cbd879732a1b7c057ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:57:33.183744 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-bba9611a-1b40-4838-9050-dd74e13443b0 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] 10.222.0.46 "GET /compute/v2.1/servers/672fd3e7-4b14-4aa7-97da-6245dfabb878" status: 200 len: 1521 microversion: 2.1 time: 0.240448 Jan 15 20:57:33.184344 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1315/2637] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:57:32 2022] GET /compute/v2.1/servers/672fd3e7-4b14-4aa7-97da-6245dfabb878 => generated 1521 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:33.248130 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-69003e38-0a0c-4fca-9775-eda35f710d2a tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:33.249280 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-69003e38-0a0c-4fca-9775-eda35f710d2a tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] [instance: 84fe1922-dca1-4713-9ea1-bdd26b309ce6] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:33.257010 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-69003e38-0a0c-4fca-9775-eda35f710d2a tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:33.257782 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-69003e38-0a0c-4fca-9775-eda35f710d2a tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:33.258600 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-69003e38-0a0c-4fca-9775-eda35f710d2a tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:33.259043 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-69003e38-0a0c-4fca-9775-eda35f710d2a tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:33.444774 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-69003e38-0a0c-4fca-9775-eda35f710d2a tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ec114f8ece434aa496cd401494e2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a05b1a0a7479db84b762eca23b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:57:33.458029 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-69003e38-0a0c-4fca-9775-eda35f710d2a tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] 10.222.0.46 "GET /compute/v2.1/servers/84fe1922-dca1-4713-9ea1-bdd26b309ce6" status: 200 len: 1550 microversion: 2.1 time: 0.213796 Jan 15 20:57:33.469599 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1323/2638] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:57:33 2022] GET /compute/v2.1/servers/84fe1922-dca1-4713-9ea1-bdd26b309ce6 => generated 1550 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:33.602364 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-35cb4a6d-9e8f-467c-ad0b-94ec1684daba req-690dccd3-cf80-441e-94bb-7a0388bb0f80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "689dd504-e36e-41d0-a461-acce91952e7e", "name": "network-vif-plugged", "status": "completed", "tag": "a9e5de5f-a2aa-4d5e-9883-5e3f4e4bb682"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:57:33.606946 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:57:33.606946 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:57:33.609387 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-2fd3becc-ae05-4122-84d1-6bfb859098bf tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:33.610211 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-2fd3becc-ae05-4122-84d1-6bfb859098bf tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: 0874eafa-ffa2-4257-b6c5-66e4bef983db] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:33.618599 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2fd3becc-ae05-4122-84d1-6bfb859098bf tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:33.619377 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2fd3becc-ae05-4122-84d1-6bfb859098bf tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:33.620366 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2fd3becc-ae05-4122-84d1-6bfb859098bf tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:33.621029 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2fd3becc-ae05-4122-84d1-6bfb859098bf tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:33.622745 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-35cb4a6d-9e8f-467c-ad0b-94ec1684daba req-690dccd3-cf80-441e-94bb-7a0388bb0f80 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:33.623207 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-35cb4a6d-9e8f-467c-ad0b-94ec1684daba req-690dccd3-cf80-441e-94bb-7a0388bb0f80 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:33.636559 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-35cb4a6d-9e8f-467c-ad0b-94ec1684daba req-690dccd3-cf80-441e-94bb-7a0388bb0f80 service nova] Creating event network-vif-plugged:a9e5de5f-a2aa-4d5e-9883-5e3f4e4bb682 for instance 689dd504-e36e-41d0-a461-acce91952e7e on nch1-master-1 Jan 15 20:57:33.643636 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-35cb4a6d-9e8f-467c-ad0b-94ec1684daba req-690dccd3-cf80-441e-94bb-7a0388bb0f80 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049420 Jan 15 20:57:33.644740 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1316/2639] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:57:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:57:33.764864 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a1c6ef4e-e080-4f8e-92d1-b7ca0091cfb5 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:57:33.766000 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a1c6ef4e-e080-4f8e-92d1-b7ca0091cfb5 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] [instance: 62ae2a15-8c2c-4dad-971f-0611238103a3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:33.774615 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a1c6ef4e-e080-4f8e-92d1-b7ca0091cfb5 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:33.775935 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a1c6ef4e-e080-4f8e-92d1-b7ca0091cfb5 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:33.777022 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a1c6ef4e-e080-4f8e-92d1-b7ca0091cfb5 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:33.777634 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a1c6ef4e-e080-4f8e-92d1-b7ca0091cfb5 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:33.832239 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-2fd3becc-ae05-4122-84d1-6bfb859098bf tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:57:33.841993 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-2fd3becc-ae05-4122-84d1-6bfb859098bf tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/0874eafa-ffa2-4257-b6c5-66e4bef983db" status: 200 len: 1508 microversion: 2.1 time: 0.240785 Jan 15 20:57:33.842960 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1324/2640] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:57:33 2022] GET /compute/v2.1/servers/0874eafa-ffa2-4257-b6c5-66e4bef983db => generated 1508 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:57:33.860157 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a1c6ef4e-e080-4f8e-92d1-b7ca0091cfb5 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] 10.222.0.46 "POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action" status: 200 len: 32634 microversion: 2.1 time: 0.100777 Jan 15 20:57:33.862030 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1317/2641] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:57:33 2022] POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action => generated 32634 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 20:57:33.873126 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-7ccc1092-3135-4168-b358-a72f4effbb93 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:33.873879 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-7ccc1092-3135-4168-b358-a72f4effbb93 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] [instance: 689dd504-e36e-41d0-a461-acce91952e7e] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:33.878377 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0189c870-d5e5-40b1-a74b-bc2ef66a61aa tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:33.878895 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-0189c870-d5e5-40b1-a74b-bc2ef66a61aa tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: 0874eafa-ffa2-4257-b6c5-66e4bef983db] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:33.886608 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0189c870-d5e5-40b1-a74b-bc2ef66a61aa tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:33.887078 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0189c870-d5e5-40b1-a74b-bc2ef66a61aa tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:33.888024 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0189c870-d5e5-40b1-a74b-bc2ef66a61aa tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:33.888473 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0189c870-d5e5-40b1-a74b-bc2ef66a61aa tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:33.915691 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7ccc1092-3135-4168-b358-a72f4effbb93 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:33.916264 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7ccc1092-3135-4168-b358-a72f4effbb93 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:33.917328 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7ccc1092-3135-4168-b358-a72f4effbb93 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:33.921825 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7ccc1092-3135-4168-b358-a72f4effbb93 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:33.926973 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-0189c870-d5e5-40b1-a74b-bc2ef66a61aa tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: 0874eafa-ffa2-4257-b6c5-66e4bef983db] Going to try to terminate instance {{(pid=129366) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 20:57:33.936333 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.compute.api [None req-0189c870-d5e5-40b1-a74b-bc2ef66a61aa tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: 0874eafa-ffa2-4257-b6c5-66e4bef983db] Working on deleting snapshot 915f9a40-207b-4103-8c44-332c5bc2afc9 from shelved instance... Jan 15 20:57:34.161967 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-7ccc1092-3135-4168-b358-a72f4effbb93 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05483ff6eec84f78a091b29cfbcf61f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a6720be5fb4de7bcd77cc7ef9d8000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:57:34.179583 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-7ccc1092-3135-4168-b358-a72f4effbb93 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] 10.222.0.46 "GET /compute/v2.1/servers/689dd504-e36e-41d0-a461-acce91952e7e" status: 200 len: 1321 microversion: 2.1 time: 0.311442 Jan 15 20:57:34.180488 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1318/2642] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:57:33 2022] GET /compute/v2.1/servers/689dd504-e36e-41d0-a461-acce91952e7e => generated 1321 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:34.188661 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d58e8aab-3002-4be8-9fc2-8fec8ec023d6 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:57:34.189718 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d58e8aab-3002-4be8-9fc2-8fec8ec023d6 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] [instance: 70bf65cf-55e2-459a-aaf1-c3eb851a6ccf] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:34.196748 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d58e8aab-3002-4be8-9fc2-8fec8ec023d6 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:34.197184 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d58e8aab-3002-4be8-9fc2-8fec8ec023d6 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:34.198249 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d58e8aab-3002-4be8-9fc2-8fec8ec023d6 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:34.198689 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d58e8aab-3002-4be8-9fc2-8fec8ec023d6 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:34.240129 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d58e8aab-3002-4be8-9fc2-8fec8ec023d6 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] 10.222.0.46 "POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action" status: 200 len: 32642 microversion: 2.1 time: 0.058179 Jan 15 20:57:34.240783 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1319/2643] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:57:34 2022] POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action => generated 32642 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:57:34.246962 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-bc8cf112-e7e1-47f6-984e-a4602cf43fdd tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Calling method '.version_select at 0x7f30c9a47820>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:34.307761 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-bc8cf112-e7e1-47f6-984e-a4602cf43fdd tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] 10.222.0.46 "GET /compute/v2.1/images/1f99b18e-87c4-42c4-834c-464b28e8793e" status: 200 len: 1452 microversion: 2.1 time: 0.065298 Jan 15 20:57:34.313353 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1320/2644] 10.222.0.46 () {58 vars in 1232 bytes} [Sat Jan 15 20:57:34 2022] GET /compute/v2.1/images/1f99b18e-87c4-42c4-834c-464b28e8793e => generated 1452 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:34.318594 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-cedf9aea-87ff-4e48-b427-9e97d49e18b4 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:34.319399 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-cedf9aea-87ff-4e48-b427-9e97d49e18b4 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] [instance: 672fd3e7-4b14-4aa7-97da-6245dfabb878] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:34.339759 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cedf9aea-87ff-4e48-b427-9e97d49e18b4 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:34.340519 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cedf9aea-87ff-4e48-b427-9e97d49e18b4 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:34.343200 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cedf9aea-87ff-4e48-b427-9e97d49e18b4 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:34.344029 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cedf9aea-87ff-4e48-b427-9e97d49e18b4 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:34.502174 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-cedf9aea-87ff-4e48-b427-9e97d49e18b4 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7754a1e8134b4da4803400ca6bb4c540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4a067d84534cbd879732a1b7c057ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:57:34.511591 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-cedf9aea-87ff-4e48-b427-9e97d49e18b4 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] 10.222.0.46 "GET /compute/v2.1/servers/672fd3e7-4b14-4aa7-97da-6245dfabb878" status: 200 len: 1521 microversion: 2.1 time: 0.197186 Jan 15 20:57:34.512167 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1321/2645] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:57:34 2022] GET /compute/v2.1/servers/672fd3e7-4b14-4aa7-97da-6245dfabb878 => generated 1521 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:34.517607 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-81dd75bd-086c-4955-ab89-8164cc463259 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:34.519318 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-81dd75bd-086c-4955-ab89-8164cc463259 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] [instance: 84fe1922-dca1-4713-9ea1-bdd26b309ce6] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:34.527694 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-81dd75bd-086c-4955-ab89-8164cc463259 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:34.528237 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-81dd75bd-086c-4955-ab89-8164cc463259 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:34.529112 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-81dd75bd-086c-4955-ab89-8164cc463259 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:34.529549 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-81dd75bd-086c-4955-ab89-8164cc463259 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:34.699241 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-81dd75bd-086c-4955-ab89-8164cc463259 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ec114f8ece434aa496cd401494e2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a05b1a0a7479db84b762eca23b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:57:34.712324 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-81dd75bd-086c-4955-ab89-8164cc463259 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] 10.222.0.46 "GET /compute/v2.1/servers/84fe1922-dca1-4713-9ea1-bdd26b309ce6" status: 200 len: 1540 microversion: 2.1 time: 0.197410 Jan 15 20:57:34.713916 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1322/2646] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:57:34 2022] GET /compute/v2.1/servers/84fe1922-dca1-4713-9ea1-bdd26b309ce6 => generated 1540 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:34.736643 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-36a2e721-8389-41d9-a398-6374b06890f9 tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Calling method '.version_select at 0x7f30ceb78c10>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:34.738067 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-migrations:index": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:57:34.738067 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:57:34.739508 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-36a2e721-8389-41d9-a398-6374b06890f9 tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:34.739968 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-36a2e721-8389-41d9-a398-6374b06890f9 tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:34.752599 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-36a2e721-8389-41d9-a398-6374b06890f9 tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] 10.222.0.46 "GET /compute/v2.1/os-migrations" status: 200 len: 1168 microversion: 2.1 time: 0.025536 Jan 15 20:57:34.754058 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1323/2647] 10.222.0.46 () {58 vars in 1142 bytes} [Sat Jan 15 20:57:34 2022] GET /compute/v2.1/os-migrations => generated 1168 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:57:34.767069 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a9d5fb6e-fe6f-430b-9979-2cba348c0c15 tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:34.768127 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a9d5fb6e-fe6f-430b-9979-2cba348c0c15 tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] [instance: 84fe1922-dca1-4713-9ea1-bdd26b309ce6] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:34.777374 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a9d5fb6e-fe6f-430b-9979-2cba348c0c15 tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:34.778134 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a9d5fb6e-fe6f-430b-9979-2cba348c0c15 tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:34.779030 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a9d5fb6e-fe6f-430b-9979-2cba348c0c15 tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:34.779470 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a9d5fb6e-fe6f-430b-9979-2cba348c0c15 tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:34.804734 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-0189c870-d5e5-40b1-a74b-bc2ef66a61aa tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: 0874eafa-ffa2-4257-b6c5-66e4bef983db] Doing local delete in cell 2935be83-7c51-430d-8ff2-0a8179973c9a(cell1) {{(pid=129366) _delete /opt/stack/nova/nova/compute/api.py:2439}} Jan 15 20:57:34.805654 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0189c870-d5e5-40b1-a74b-bc2ef66a61aa tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:34.806114 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0189c870-d5e5-40b1-a74b-bc2ef66a61aa tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:34.807372 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.compute.api [None req-0189c870-d5e5-40b1-a74b-bc2ef66a61aa tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: 0874eafa-ffa2-4257-b6c5-66e4bef983db] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Jan 15 20:57:34.823137 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.network.neutron [None req-0189c870-d5e5-40b1-a74b-bc2ef66a61aa tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: 0874eafa-ffa2-4257-b6c5-66e4bef983db] deallocate_for_instance() {{(pid=129366) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1676}} Jan 15 20:57:35.030808 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a9d5fb6e-fe6f-430b-9979-2cba348c0c15 tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/84fe1922-dca1-4713-9ea1-bdd26b309ce6" status: 200 len: 1691 microversion: 2.1 time: 0.268223 Jan 15 20:57:35.046010 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1324/2648] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:57:34 2022] GET /compute/v2.1/servers/84fe1922-dca1-4713-9ea1-bdd26b309ce6 => generated 1691 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:35.060296 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-90174cb3-ded2-4eb6-aff1-7c3bc2821a03 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:57:35.061496 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-90174cb3-ded2-4eb6-aff1-7c3bc2821a03 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] [instance: 62ae2a15-8c2c-4dad-971f-0611238103a3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:35.067785 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-90174cb3-ded2-4eb6-aff1-7c3bc2821a03 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:35.068520 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-90174cb3-ded2-4eb6-aff1-7c3bc2821a03 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:35.069560 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-90174cb3-ded2-4eb6-aff1-7c3bc2821a03 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:35.070203 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-90174cb3-ded2-4eb6-aff1-7c3bc2821a03 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:35.129884 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-90174cb3-ded2-4eb6-aff1-7c3bc2821a03 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] 10.222.0.46 "POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action" status: 200 len: 32634 microversion: 2.1 time: 0.080727 Jan 15 20:57:35.132206 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1325/2649] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:57:35 2022] POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action => generated 32634 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:57:35.139681 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ff90728a-01f7-4c7d-853c-b597c82ba0fc tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:35.140976 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ff90728a-01f7-4c7d-853c-b597c82ba0fc tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] [instance: 84fe1922-dca1-4713-9ea1-bdd26b309ce6] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:35.168685 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ff90728a-01f7-4c7d-853c-b597c82ba0fc tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:35.169897 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ff90728a-01f7-4c7d-853c-b597c82ba0fc tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:35.175797 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ff90728a-01f7-4c7d-853c-b597c82ba0fc tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:35.176549 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ff90728a-01f7-4c7d-853c-b597c82ba0fc tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:35.812182 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ff90728a-01f7-4c7d-853c-b597c82ba0fc tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/84fe1922-dca1-4713-9ea1-bdd26b309ce6" status: 200 len: 1691 microversion: 2.1 time: 0.678317 Jan 15 20:57:35.817447 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1326/2650] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:57:35 2022] GET /compute/v2.1/servers/84fe1922-dca1-4713-9ea1-bdd26b309ce6 => generated 1691 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:35.822863 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-1731b8cb-e921-4916-95f8-8a7cb665fbc7 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:35.823545 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-1731b8cb-e921-4916-95f8-8a7cb665fbc7 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] [instance: 689dd504-e36e-41d0-a461-acce91952e7e] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:35.855406 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1731b8cb-e921-4916-95f8-8a7cb665fbc7 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:35.857026 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1731b8cb-e921-4916-95f8-8a7cb665fbc7 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:35.858783 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1731b8cb-e921-4916-95f8-8a7cb665fbc7 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:35.860309 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1731b8cb-e921-4916-95f8-8a7cb665fbc7 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:36.211259 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.network.neutron [None req-0189c870-d5e5-40b1-a74b-bc2ef66a61aa tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: 0874eafa-ffa2-4257-b6c5-66e4bef983db] Updating instance_info_cache with network_info: [] {{(pid=129366) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jan 15 20:57:36.231137 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-1731b8cb-e921-4916-95f8-8a7cb665fbc7 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05483ff6eec84f78a091b29cfbcf61f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a6720be5fb4de7bcd77cc7ef9d8000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:57:36.257755 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-1731b8cb-e921-4916-95f8-8a7cb665fbc7 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] 10.222.0.46 "GET /compute/v2.1/servers/689dd504-e36e-41d0-a461-acce91952e7e" status: 200 len: 1516 microversion: 2.1 time: 0.439055 Jan 15 20:57:36.267717 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1327/2651] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:57:35 2022] GET /compute/v2.1/servers/689dd504-e36e-41d0-a461-acce91952e7e => generated 1516 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:36.279988 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-fed00297-77ff-456d-bded-edfd2d9c5b93 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:57:36.289605 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-fed00297-77ff-456d-bded-edfd2d9c5b93 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] [instance: 70bf65cf-55e2-459a-aaf1-c3eb851a6ccf] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:36.305542 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fed00297-77ff-456d-bded-edfd2d9c5b93 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:36.309228 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fed00297-77ff-456d-bded-edfd2d9c5b93 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:36.310373 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fed00297-77ff-456d-bded-edfd2d9c5b93 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:36.312202 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fed00297-77ff-456d-bded-edfd2d9c5b93 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:36.383372 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-fed00297-77ff-456d-bded-edfd2d9c5b93 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] 10.222.0.46 "POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action" status: 200 len: 32642 microversion: 2.1 time: 0.114013 Jan 15 20:57:36.387969 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1328/2652] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:57:36 2022] POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action => generated 32642 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:57:36.392427 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-f1172d4b-5959-4509-baed-768282c71f5c req-a6beff77-56aa-493f-b309-13e94b0e1e7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "672fd3e7-4b14-4aa7-97da-6245dfabb878", "name": "network-vif-deleted", "tag": "c668866d-59e2-40a4-830d-eaaaf5f479ca"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:57:36.394482 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:57:36.394482 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:57:36.405671 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-f1172d4b-5959-4509-baed-768282c71f5c req-a6beff77-56aa-493f-b309-13e94b0e1e7c service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:36.406493 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-f1172d4b-5959-4509-baed-768282c71f5c req-a6beff77-56aa-493f-b309-13e94b0e1e7c service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:36.420237 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-f1172d4b-5959-4509-baed-768282c71f5c req-a6beff77-56aa-493f-b309-13e94b0e1e7c service nova] Creating event network-vif-deleted:c668866d-59e2-40a4-830d-eaaaf5f479ca for instance 672fd3e7-4b14-4aa7-97da-6245dfabb878 on nch1-master-1 Jan 15 20:57:36.427009 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-f1172d4b-5959-4509-baed-768282c71f5c req-a6beff77-56aa-493f-b309-13e94b0e1e7c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040294 Jan 15 20:57:36.428027 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1329/2653] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:57:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:57:36.433946 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a751b11d-837f-4d84-87ef-5fc906c2e31f tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Calling method '.version_select at 0x7f30c96c6f70>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:36.483962 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a751b11d-837f-4d84-87ef-5fc906c2e31f tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] 10.222.0.46 "GET /compute/v2.1/images/1f99b18e-87c4-42c4-834c-464b28e8793e" status: 200 len: 1452 microversion: 2.1 time: 0.054285 Jan 15 20:57:36.484691 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1330/2654] 10.222.0.46 () {58 vars in 1232 bytes} [Sat Jan 15 20:57:36 2022] GET /compute/v2.1/images/1f99b18e-87c4-42c4-834c-464b28e8793e => generated 1452 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:36.493384 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8d50900f-5d94-413b-89d8-c9f509b6efbe tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:36.494211 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-8d50900f-5d94-413b-89d8-c9f509b6efbe tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] [instance: 672fd3e7-4b14-4aa7-97da-6245dfabb878] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:36.504289 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8d50900f-5d94-413b-89d8-c9f509b6efbe tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:36.504746 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8d50900f-5d94-413b-89d8-c9f509b6efbe tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:36.505629 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8d50900f-5d94-413b-89d8-c9f509b6efbe tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:36.506074 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8d50900f-5d94-413b-89d8-c9f509b6efbe tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:36.526037 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-8d50900f-5d94-413b-89d8-c9f509b6efbe tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] HTTP exception thrown: Instance 672fd3e7-4b14-4aa7-97da-6245dfabb878 could not be found. Jan 15 20:57:36.526807 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8d50900f-5d94-413b-89d8-c9f509b6efbe tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Returning 404 to user: Instance 672fd3e7-4b14-4aa7-97da-6245dfabb878 could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:57:36.527823 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-8d50900f-5d94-413b-89d8-c9f509b6efbe tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] 10.222.0.46 "GET /compute/v2.1/servers/672fd3e7-4b14-4aa7-97da-6245dfabb878" status: 404 len: 111 microversion: 2.1 time: 0.042060 Jan 15 20:57:36.530675 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1331/2655] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:57:36 2022] GET /compute/v2.1/servers/672fd3e7-4b14-4aa7-97da-6245dfabb878 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:57:36.539130 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-9ccc2bb2-0e9b-48c8-8017-5016df058162 req-f0f5077b-2c69-4384-b36c-9afe824f3074 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0874eafa-ffa2-4257-b6c5-66e4bef983db", "name": "network-vif-unplugged", "status": "completed", "tag": "6b0f9bd5-35ce-4655-ab53-3207b68d566f"}, {"server_uuid": "beffc13d-acd3-455e-96d6-be4bcbb81b88", "name": "network-vif-unplugged", "status": "completed", "tag": "3de9d3d2-9291-4173-8d0b-3d31a05f6fe6"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:57:36.543132 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:57:36.543132 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:57:36.554715 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-9ccc2bb2-0e9b-48c8-8017-5016df058162 req-f0f5077b-2c69-4384-b36c-9afe824f3074 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:36.555822 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-9ccc2bb2-0e9b-48c8-8017-5016df058162 req-f0f5077b-2c69-4384-b36c-9afe824f3074 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:36.572577 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.compute.server_external_events [req-9ccc2bb2-0e9b-48c8-8017-5016df058162 req-f0f5077b-2c69-4384-b36c-9afe824f3074 service nova] Unable to find a host for instance 0874eafa-ffa2-4257-b6c5-66e4bef983db. Dropping event network-vif-unplugged {{(pid=129365) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Jan 15 20:57:36.573867 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-9ccc2bb2-0e9b-48c8-8017-5016df058162 req-f0f5077b-2c69-4384-b36c-9afe824f3074 service nova] Creating event network-vif-unplugged:3de9d3d2-9291-4173-8d0b-3d31a05f6fe6 for instance beffc13d-acd3-455e-96d6-be4bcbb81b88 on nch1-master-1 Jan 15 20:57:36.580296 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-9ccc2bb2-0e9b-48c8-8017-5016df058162 req-f0f5077b-2c69-4384-b36c-9afe824f3074 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 207 len: 355 microversion: 2.1 time: 0.046198 Jan 15 20:57:36.581451 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1332/2656] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:57:36 2022] POST /compute/v2.1/os-server-external-events => generated 355 bytes in 50 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jan 15 20:57:36.590461 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-0ec7ce4a-681c-4063-9802-077b236f768b tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:36.592944 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-0ec7ce4a-681c-4063-9802-077b236f768b tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] [instance: 84fe1922-dca1-4713-9ea1-bdd26b309ce6] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:36.604441 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0ec7ce4a-681c-4063-9802-077b236f768b tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:36.605205 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0ec7ce4a-681c-4063-9802-077b236f768b tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:36.613989 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0ec7ce4a-681c-4063-9802-077b236f768b tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:36.615370 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0ec7ce4a-681c-4063-9802-077b236f768b tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:36.782896 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.objects.instance [None req-0ec7ce4a-681c-4063-9802-077b236f768b tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lazy-loading 'services' on Instance uuid 84fe1922-dca1-4713-9ea1-bdd26b309ce6 {{(pid=129365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 20:57:36.817259 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0189c870-d5e5-40b1-a74b-bc2ef66a61aa tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "DELETE /compute/v2.1/servers/0874eafa-ffa2-4257-b6c5-66e4bef983db" status: 204 len: 0 microversion: 2.1 time: 2.958666 Jan 15 20:57:36.823038 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1325/2657] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 20:57:33 2022] DELETE /compute/v2.1/servers/0874eafa-ffa2-4257-b6c5-66e4bef983db => generated 0 bytes in 2962 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 15 20:57:36.829652 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-527322fa-d896-41c6-953c-5c8674d83d40 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:57:36.831186 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-527322fa-d896-41c6-953c-5c8674d83d40 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] [instance: 62ae2a15-8c2c-4dad-971f-0611238103a3] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:36.840438 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-527322fa-d896-41c6-953c-5c8674d83d40 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:36.841185 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-527322fa-d896-41c6-953c-5c8674d83d40 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:36.845923 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-527322fa-d896-41c6-953c-5c8674d83d40 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:36.852696 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-527322fa-d896-41c6-953c-5c8674d83d40 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:36.893315 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-0ec7ce4a-681c-4063-9802-077b236f768b tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] 10.222.0.46 "DELETE /compute/v2.1/servers/84fe1922-dca1-4713-9ea1-bdd26b309ce6/os-volume_attachments/86102022-ce53-4922-9f6d-e99e017681d7" status: 202 len: 0 microversion: 2.1 time: 0.308825 Jan 15 20:57:36.895399 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1333/2658] 10.222.0.46 () {58 vars in 1415 bytes} [Sat Jan 15 20:57:36 2022] DELETE /compute/v2.1/servers/84fe1922-dca1-4713-9ea1-bdd26b309ce6/os-volume_attachments/86102022-ce53-4922-9f6d-e99e017681d7 => generated 0 bytes in 313 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 20:57:36.901673 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-2f60751c-5795-406b-a7ae-a153670c61de req-161fcf01-e2c2-4b3d-8508-3c16c6454a70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0874eafa-ffa2-4257-b6c5-66e4bef983db", "name": "network-vif-deleted", "tag": "6b0f9bd5-35ce-4655-ab53-3207b68d566f"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:57:36.903652 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:57:36.903652 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:57:36.912221 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-2f60751c-5795-406b-a7ae-a153670c61de req-161fcf01-e2c2-4b3d-8508-3c16c6454a70 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:36.912987 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-2f60751c-5795-406b-a7ae-a153670c61de req-161fcf01-e2c2-4b3d-8508-3c16c6454a70 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:36.913995 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-527322fa-d896-41c6-953c-5c8674d83d40 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] 10.222.0.46 "POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action" status: 200 len: 32634 microversion: 2.1 time: 0.089162 Jan 15 20:57:36.916193 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1326/2659] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:57:36 2022] POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action => generated 32634 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:57:36.930536 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-845e4fa1-05d5-4230-93ab-40b5dab20897 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:57:36.932360 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.compute.server_external_events [req-2f60751c-5795-406b-a7ae-a153670c61de req-161fcf01-e2c2-4b3d-8508-3c16c6454a70 service nova] Unable to find a host for instance 0874eafa-ffa2-4257-b6c5-66e4bef983db. Dropping event network-vif-deleted {{(pid=129365) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Jan 15 20:57:36.933405 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-2f60751c-5795-406b-a7ae-a153670c61de req-161fcf01-e2c2-4b3d-8508-3c16c6454a70 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.036668 Jan 15 20:57:36.933541 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-845e4fa1-05d5-4230-93ab-40b5dab20897 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] [instance: 689dd504-e36e-41d0-a461-acce91952e7e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:36.935057 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1334/2660] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:57:36 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 39 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jan 15 20:57:36.940193 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-637f2623-3da3-45e8-ae5b-86ccb714a62d tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:36.944442 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:57:36.944442 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:57:36.945738 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-637f2623-3da3-45e8-ae5b-86ccb714a62d tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7754a1e8134b4da4803400ca6bb4c540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4a067d84534cbd879732a1b7c057ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:57:36.946780 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-637f2623-3da3-45e8-ae5b-86ccb714a62d tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': '4e4a067d84534cbd879732a1b7c057ae'} {{(pid=129365) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 15 20:57:36.960810 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-845e4fa1-05d5-4230-93ab-40b5dab20897 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:36.961604 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-845e4fa1-05d5-4230-93ab-40b5dab20897 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:36.964573 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-845e4fa1-05d5-4230-93ab-40b5dab20897 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:36.965170 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-845e4fa1-05d5-4230-93ab-40b5dab20897 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:36.968273 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-637f2623-3da3-45e8-ae5b-86ccb714a62d tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:36.969068 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-637f2623-3da3-45e8-ae5b-86ccb714a62d tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:36.970072 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-637f2623-3da3-45e8-ae5b-86ccb714a62d tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:36.970567 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-637f2623-3da3-45e8-ae5b-86ccb714a62d tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:37.016732 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.objects.instance [None req-845e4fa1-05d5-4230-93ab-40b5dab20897 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lazy-loading 'flavor' on Instance uuid 689dd504-e36e-41d0-a461-acce91952e7e {{(pid=129366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 20:57:37.190288 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-637f2623-3da3-45e8-ae5b-86ccb714a62d tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] 10.222.0.46 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.254106 Jan 15 20:57:37.191222 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1335/2661] 10.222.0.46 () {58 vars in 1229 bytes} [Sat Jan 15 20:57:36 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 20:57:37.198721 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2a194bf7-e854-43e8-ad11-eb3246da02ea tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:37.199458 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-2a194bf7-e854-43e8-ad11-eb3246da02ea tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: 0874eafa-ffa2-4257-b6c5-66e4bef983db] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:37.213739 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2a194bf7-e854-43e8-ad11-eb3246da02ea tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:37.215247 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2a194bf7-e854-43e8-ad11-eb3246da02ea tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:37.216727 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2a194bf7-e854-43e8-ad11-eb3246da02ea tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:37.217807 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2a194bf7-e854-43e8-ad11-eb3246da02ea tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:37.223394 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-845e4fa1-05d5-4230-93ab-40b5dab20897 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] 10.222.0.46 "POST /compute/v2.1/servers/689dd504-e36e-41d0-a461-acce91952e7e/action" status: 200 len: 32 microversion: 2.1 time: 0.304002 Jan 15 20:57:37.232924 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1327/2662] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:57:36 2022] POST /compute/v2.1/servers/689dd504-e36e-41d0-a461-acce91952e7e/action => generated 32 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 20:57:37.249001 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-5296f5bd-cdf9-41d2-a6e6-06e52a590c5b tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:37.250424 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-5296f5bd-cdf9-41d2-a6e6-06e52a590c5b tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] [instance: 84fe1922-dca1-4713-9ea1-bdd26b309ce6] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:37.252297 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-2a194bf7-e854-43e8-ad11-eb3246da02ea tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] HTTP exception thrown: Instance 0874eafa-ffa2-4257-b6c5-66e4bef983db could not be found. Jan 15 20:57:37.257638 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2a194bf7-e854-43e8-ad11-eb3246da02ea tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Returning 404 to user: Instance 0874eafa-ffa2-4257-b6c5-66e4bef983db could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:57:37.262307 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2a194bf7-e854-43e8-ad11-eb3246da02ea tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/0874eafa-ffa2-4257-b6c5-66e4bef983db" status: 404 len: 111 microversion: 2.1 time: 0.069255 Jan 15 20:57:37.269144 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1336/2663] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:57:37 2022] GET /compute/v2.1/servers/0874eafa-ffa2-4257-b6c5-66e4bef983db => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:57:37.269680 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5296f5bd-cdf9-41d2-a6e6-06e52a590c5b tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:37.270130 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5296f5bd-cdf9-41d2-a6e6-06e52a590c5b tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:37.270922 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5296f5bd-cdf9-41d2-a6e6-06e52a590c5b tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:37.271356 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5296f5bd-cdf9-41d2-a6e6-06e52a590c5b tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:37.282108 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-0c3d7cc3-fad2-4bdd-897e-884f12f2cdef tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:37.287424 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-0c3d7cc3-fad2-4bdd-897e-884f12f2cdef tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:57:37.290139 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-0c3d7cc3-fad2-4bdd-897e-884f12f2cdef tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] 10.222.0.46 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.018923 Jan 15 20:57:37.291895 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1337/2664] 10.222.0.46 () {58 vars in 1181 bytes} [Sat Jan 15 20:57:37 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 15 20:57:37.302153 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-26781616-1443-4729-be16-82d1bf6e82c1 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:37.303126 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-26781616-1443-4729-be16-82d1bf6e82c1 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] [instance: 689dd504-e36e-41d0-a461-acce91952e7e] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:37.317603 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-26781616-1443-4729-be16-82d1bf6e82c1 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:37.318534 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-26781616-1443-4729-be16-82d1bf6e82c1 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:37.320397 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-26781616-1443-4729-be16-82d1bf6e82c1 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:37.321135 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-26781616-1443-4729-be16-82d1bf6e82c1 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:37.407066 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-5296f5bd-cdf9-41d2-a6e6-06e52a590c5b tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] 10.222.0.46 "GET /compute/v2.1/servers/84fe1922-dca1-4713-9ea1-bdd26b309ce6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.171533 Jan 15 20:57:37.408536 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1328/2665] 10.222.0.46 () {58 vars in 1301 bytes} [Sat Jan 15 20:57:37 2022] GET /compute/v2.1/servers/84fe1922-dca1-4713-9ea1-bdd26b309ce6/os-volume_attachments => generated 197 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:57:37.419710 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-2c619598-776d-4a38-823a-1f7013c571f1 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:37.424338 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:57:37.424338 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:57:37.425838 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-2c619598-776d-4a38-823a-1f7013c571f1 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7754a1e8134b4da4803400ca6bb4c540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4a067d84534cbd879732a1b7c057ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:57:37.426975 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-2c619598-776d-4a38-823a-1f7013c571f1 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Searching by: {'deleted': False, 'project_id': '4e4a067d84534cbd879732a1b7c057ae'} {{(pid=129366) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 15 20:57:37.436016 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2c619598-776d-4a38-823a-1f7013c571f1 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:37.438958 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2c619598-776d-4a38-823a-1f7013c571f1 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:37.441505 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2c619598-776d-4a38-823a-1f7013c571f1 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:37.445527 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2c619598-776d-4a38-823a-1f7013c571f1 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:37.518959 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.multi_cell_list [None req-2c619598-776d-4a38-823a-1f7013c571f1 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=129366) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jan 15 20:57:37.592180 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-2c619598-776d-4a38-823a-1f7013c571f1 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] 10.222.0.46 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.180392 Jan 15 20:57:37.597754 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1329/2666] 10.222.0.46 () {58 vars in 1124 bytes} [Sat Jan 15 20:57:37 2022] GET /compute/v2.1/servers => generated 681 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:57:37.608743 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-033400af-1770-49cd-834c-95a2c0d24947 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:57:37.610216 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-033400af-1770-49cd-834c-95a2c0d24947 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] [instance: 70bf65cf-55e2-459a-aaf1-c3eb851a6ccf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:37.623960 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-033400af-1770-49cd-834c-95a2c0d24947 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:37.624415 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-033400af-1770-49cd-834c-95a2c0d24947 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:37.625244 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-033400af-1770-49cd-834c-95a2c0d24947 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:37.625682 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-033400af-1770-49cd-834c-95a2c0d24947 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:37.697060 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-033400af-1770-49cd-834c-95a2c0d24947 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] 10.222.0.46 "POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action" status: 200 len: 32642 microversion: 2.1 time: 0.099999 Jan 15 20:57:37.701580 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1330/2667] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:57:37 2022] POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action => generated 32642 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:57:37.729456 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7815c91b-f568-4d0b-b818-3ee7e7b2cfc8 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Calling method '.version_select at 0x7f30cec638b0>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:37.770751 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-26781616-1443-4729-be16-82d1bf6e82c1 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05483ff6eec84f78a091b29cfbcf61f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a6720be5fb4de7bcd77cc7ef9d8000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:57:37.782926 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-26781616-1443-4729-be16-82d1bf6e82c1 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] 10.222.0.46 "GET /compute/v2.1/servers/689dd504-e36e-41d0-a461-acce91952e7e" status: 200 len: 1522 microversion: 2.1 time: 0.489172 Jan 15 20:57:37.792995 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1338/2668] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:57:37 2022] GET /compute/v2.1/servers/689dd504-e36e-41d0-a461-acce91952e7e => generated 1522 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:37.809014 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a4006c55-8f3d-4705-ace4-7f3d6a4fd590 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1518274281", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "networks": [{"uuid": "531bba45-51d6-4df1-9e47-d4b8172e5210"}]}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:57:37.815431 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7815c91b-f568-4d0b-b818-3ee7e7b2cfc8 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] 10.222.0.46 "GET /compute/v2.1/images/1f99b18e-87c4-42c4-834c-464b28e8793e" status: 200 len: 1452 microversion: 2.1 time: 0.108078 Jan 15 20:57:37.818551 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1331/2669] 10.222.0.46 () {58 vars in 1232 bytes} [Sat Jan 15 20:57:37 2022] GET /compute/v2.1/images/1f99b18e-87c4-42c4-834c-464b28e8793e => generated 1452 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:37.867835 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-5b1642f0-8bea-478e-a761-ade0b32452c8 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:37.888965 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:57:37.888965 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:57:37.890489 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-5b1642f0-8bea-478e-a761-ade0b32452c8 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7754a1e8134b4da4803400ca6bb4c540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4a067d84534cbd879732a1b7c057ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:57:37.891138 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.compute.servers [None req-5b1642f0-8bea-478e-a761-ade0b32452c8 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Removing options 'limit' from query {{(pid=129366) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1474}} Jan 15 20:57:37.892113 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-5b1642f0-8bea-478e-a761-ade0b32452c8 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Searching by: {'deleted': False, 'project_id': '4e4a067d84534cbd879732a1b7c057ae'} {{(pid=129366) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 15 20:57:37.927708 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5b1642f0-8bea-478e-a761-ade0b32452c8 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:37.932811 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5b1642f0-8bea-478e-a761-ade0b32452c8 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:37.933100 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.network.neutron [None req-a4006c55-8f3d-4705-ace4-7f3d6a4fd590 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] validate_networks() for [('531bba45-51d6-4df1-9e47-d4b8172e5210', None, None, None, None, None)] {{(pid=129365) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 20:57:37.936430 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5b1642f0-8bea-478e-a761-ade0b32452c8 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:37.938786 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5b1642f0-8bea-478e-a761-ade0b32452c8 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:38.025212 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.multi_cell_list [None req-5b1642f0-8bea-478e-a761-ade0b32452c8 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=129366) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jan 15 20:57:38.136995 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-5b1642f0-8bea-478e-a761-ade0b32452c8 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] 10.222.0.46 "GET /compute/v2.1/servers?limit=102" status: 200 len: 681 microversion: 2.1 time: 0.315072 Jan 15 20:57:38.150786 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1332/2670] 10.222.0.46 () {58 vars in 1143 bytes} [Sat Jan 15 20:57:37 2022] GET /compute/v2.1/servers?limit=102 => generated 681 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:57:38.157517 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e00ca965-c615-45df-9d91-d6e31e70d38f tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:57:38.159485 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e00ca965-c615-45df-9d91-d6e31e70d38f tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] [instance: 62ae2a15-8c2c-4dad-971f-0611238103a3] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:38.167157 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e00ca965-c615-45df-9d91-d6e31e70d38f tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:38.167942 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e00ca965-c615-45df-9d91-d6e31e70d38f tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:38.169706 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e00ca965-c615-45df-9d91-d6e31e70d38f tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:38.170316 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e00ca965-c615-45df-9d91-d6e31e70d38f tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:38.272632 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e00ca965-c615-45df-9d91-d6e31e70d38f tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] 10.222.0.46 "POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action" status: 200 len: 32634 microversion: 2.1 time: 0.120006 Jan 15 20:57:38.273565 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1333/2671] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:57:38 2022] POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action => generated 32634 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:57:38.292636 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-84ee961c-9ac2-45df-86b6-3b99e3541821 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:38.302009 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-84ee961c-9ac2-45df-86b6-3b99e3541821 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:57:38.302894 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-84ee961c-9ac2-45df-86b6-3b99e3541821 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] 10.222.0.46 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.021924 Jan 15 20:57:38.308339 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1334/2672] 10.222.0.46 () {58 vars in 1141 bytes} [Sat Jan 15 20:57:38 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 15 20:57:38.330431 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0cb1fb04-5ecc-4d8e-959a-cfa638f50092 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:38.331749 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0cb1fb04-5ecc-4d8e-959a-cfa638f50092 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:57:38.332552 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0cb1fb04-5ecc-4d8e-959a-cfa638f50092 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] 10.222.0.46 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.017703 Jan 15 20:57:38.334651 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1335/2673] 10.222.0.46 () {58 vars in 1151 bytes} [Sat Jan 15 20:57:38 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 15 20:57:38.347348 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9460e6bd-ac97-4e34-b7e5-f97b39cc3259 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:38.351656 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:57:38.351656 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:57:38.356221 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-9460e6bd-ac97-4e34-b7e5-f97b39cc3259 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7754a1e8134b4da4803400ca6bb4c540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4a067d84534cbd879732a1b7c057ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:57:38.357345 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-9460e6bd-ac97-4e34-b7e5-f97b39cc3259 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': '4e4a067d84534cbd879732a1b7c057ae'} {{(pid=129366) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 15 20:57:38.367572 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.compute.servers [None req-9460e6bd-ac97-4e34-b7e5-f97b39cc3259 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Flavor 'non_existing_flavor' could not be found {{(pid=129366) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:337}} Jan 15 20:57:38.369896 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-9460e6bd-ac97-4e34-b7e5-f97b39cc3259 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] 10.222.0.46 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.025907 Jan 15 20:57:38.377464 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1336/2674] 10.222.0.46 () {58 vars in 1177 bytes} [Sat Jan 15 20:57:38 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 20:57:38.402594 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-499d99d4-7714-4158-9b57-198749eb7094 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:38.411875 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-499d99d4-7714-4158-9b57-198749eb7094 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7754a1e8134b4da4803400ca6bb4c540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4a067d84534cbd879732a1b7c057ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:57:38.412686 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-499d99d4-7714-4158-9b57-198749eb7094 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': '4e4a067d84534cbd879732a1b7c057ae'} {{(pid=129366) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 15 20:57:38.420289 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-499d99d4-7714-4158-9b57-198749eb7094 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:38.420747 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-499d99d4-7714-4158-9b57-198749eb7094 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:38.421602 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-499d99d4-7714-4158-9b57-198749eb7094 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:38.422039 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-499d99d4-7714-4158-9b57-198749eb7094 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:38.550331 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-499d99d4-7714-4158-9b57-198749eb7094 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] 10.222.0.46 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.171573 Jan 15 20:57:38.559439 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1337/2675] 10.222.0.46 () {58 vars in 1173 bytes} [Sat Jan 15 20:57:38 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 20:57:38.564199 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-044de292-52b2-44ee-87db-199ca0c09418 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:38.565282 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-044de292-52b2-44ee-87db-199ca0c09418 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] [instance: 84fe1922-dca1-4713-9ea1-bdd26b309ce6] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:38.572288 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-044de292-52b2-44ee-87db-199ca0c09418 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:38.575434 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-044de292-52b2-44ee-87db-199ca0c09418 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:38.575434 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-044de292-52b2-44ee-87db-199ca0c09418 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:38.575434 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-044de292-52b2-44ee-87db-199ca0c09418 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:38.610521 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-044de292-52b2-44ee-87db-199ca0c09418 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] 10.222.0.46 "GET /compute/v2.1/servers/84fe1922-dca1-4713-9ea1-bdd26b309ce6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049979 Jan 15 20:57:38.611119 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1338/2676] 10.222.0.46 () {58 vars in 1301 bytes} [Sat Jan 15 20:57:38 2022] GET /compute/v2.1/servers/84fe1922-dca1-4713-9ea1-bdd26b309ce6/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 20:57:38.615895 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-aa1b0d9f-54f3-4a89-babc-bd112036a4ff tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:38.627794 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:57:38.627794 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:57:38.629333 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-aa1b0d9f-54f3-4a89-babc-bd112036a4ff tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7754a1e8134b4da4803400ca6bb4c540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4a067d84534cbd879732a1b7c057ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:57:38.630271 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-aa1b0d9f-54f3-4a89-babc-bd112036a4ff tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': '4e4a067d84534cbd879732a1b7c057ae'} {{(pid=129366) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 15 20:57:38.640823 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-aa1b0d9f-54f3-4a89-babc-bd112036a4ff tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:38.641338 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-aa1b0d9f-54f3-4a89-babc-bd112036a4ff tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:38.642186 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-aa1b0d9f-54f3-4a89-babc-bd112036a4ff tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:38.642625 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-aa1b0d9f-54f3-4a89-babc-bd112036a4ff tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:38.774038 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-aa1b0d9f-54f3-4a89-babc-bd112036a4ff tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] 10.222.0.46 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.161837 Jan 15 20:57:38.780793 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1339/2677] 10.222.0.46 () {58 vars in 1183 bytes} [Sat Jan 15 20:57:38 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 20:57:38.780793 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-1ab3af47-54e5-4b5d-8c5a-b2f270f5f23a req-14922162-8d97-404a-b92c-4ffff33986a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bffd829f-bc6e-40a7-a9d8-59af77e5b10d", "name": "network-vif-plugged", "status": "completed", "tag": "8b8cea34-6f8d-4a83-aaae-cfea3dbff75c"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:57:38.784626 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:57:38.784626 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:57:38.792908 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-1ab3af47-54e5-4b5d-8c5a-b2f270f5f23a req-14922162-8d97-404a-b92c-4ffff33986a7 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:38.793418 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-1ab3af47-54e5-4b5d-8c5a-b2f270f5f23a req-14922162-8d97-404a-b92c-4ffff33986a7 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:38.810201 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-1ab3af47-54e5-4b5d-8c5a-b2f270f5f23a req-14922162-8d97-404a-b92c-4ffff33986a7 service nova] Creating event network-vif-plugged:8b8cea34-6f8d-4a83-aaae-cfea3dbff75c for instance bffd829f-bc6e-40a7-a9d8-59af77e5b10d on nch2-master-1 Jan 15 20:57:38.818763 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-1ab3af47-54e5-4b5d-8c5a-b2f270f5f23a req-14922162-8d97-404a-b92c-4ffff33986a7 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039606 Jan 15 20:57:38.828666 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1340/2678] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:57:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:57:38.836550 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-2186da00-eaef-4130-b82d-bd6f5fccaae5 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:57:38.840210 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-2186da00-eaef-4130-b82d-bd6f5fccaae5 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] [instance: 70bf65cf-55e2-459a-aaf1-c3eb851a6ccf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:38.850858 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2186da00-eaef-4130-b82d-bd6f5fccaae5 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:38.851307 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2186da00-eaef-4130-b82d-bd6f5fccaae5 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:38.852131 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2186da00-eaef-4130-b82d-bd6f5fccaae5 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:38.852569 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2186da00-eaef-4130-b82d-bd6f5fccaae5 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:38.914750 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-2186da00-eaef-4130-b82d-bd6f5fccaae5 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] 10.222.0.46 "POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action" status: 200 len: 32642 microversion: 2.1 time: 0.083766 Jan 15 20:57:38.918220 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1341/2679] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:57:38 2022] POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action => generated 32642 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:57:38.927378 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d01c7c78-b998-460f-8b9d-060257a2bfb1 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:38.938533 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:57:38.938533 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:57:38.943226 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-d01c7c78-b998-460f-8b9d-060257a2bfb1 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7754a1e8134b4da4803400ca6bb4c540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4a067d84534cbd879732a1b7c057ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:57:38.944133 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-d01c7c78-b998-460f-8b9d-060257a2bfb1 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Searching by: {'deleted': False, 'project_id': '4e4a067d84534cbd879732a1b7c057ae'} {{(pid=129366) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 15 20:57:38.954835 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d01c7c78-b998-460f-8b9d-060257a2bfb1 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:38.955277 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d01c7c78-b998-460f-8b9d-060257a2bfb1 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:38.956486 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d01c7c78-b998-460f-8b9d-060257a2bfb1 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:38.957133 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d01c7c78-b998-460f-8b9d-060257a2bfb1 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:39.013113 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.multi_cell_list [None req-d01c7c78-b998-460f-8b9d-060257a2bfb1 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=129366) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jan 15 20:57:39.185313 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-d01c7c78-b998-460f-8b9d-060257a2bfb1 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7754a1e8134b4da4803400ca6bb4c540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4a067d84534cbd879732a1b7c057ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:57:39.201615 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d01c7c78-b998-460f-8b9d-060257a2bfb1 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:39.202335 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d01c7c78-b998-460f-8b9d-060257a2bfb1 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:39.832714 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-a4006c55-8f3d-4705-ace4-7f3d6a4fd590 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Flavor limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 20:57:39.833317 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-a4006c55-8f3d-4705-ace4-7f3d6a4fd590 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Image limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 20:57:39.833640 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-a4006c55-8f3d-4705-ace4-7f3d6a4fd590 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Flavor pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 20:57:39.834045 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-a4006c55-8f3d-4705-ace4-7f3d6a4fd590 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Image pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 20:57:39.834455 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-a4006c55-8f3d-4705-ace4-7f3d6a4fd590 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 20:57:39.850456 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a4006c55-8f3d-4705-ace4-7f3d6a4fd590 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:39.850911 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a4006c55-8f3d-4705-ace4-7f3d6a4fd590 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:39.851736 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a4006c55-8f3d-4705-ace4-7f3d6a4fd590 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:39.854991 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a4006c55-8f3d-4705-ace4-7f3d6a4fd590 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:39.897222 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-a4006c55-8f3d-4705-ace4-7f3d6a4fd590 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Getting quotas for project 51cad90ef72141c2983640133453f788. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:57:39.913029 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-a4006c55-8f3d-4705-ace4-7f3d6a4fd590 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Getting quotas for user 765cbcb4d9c8476494f08b123d1db59b and project 51cad90ef72141c2983640133453f788. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:57:39.952427 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a4006c55-8f3d-4705-ace4-7f3d6a4fd590 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Going to run 1 instances... {{(pid=129365) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 20:57:39.956520 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a4006c55-8f3d-4705-ace4-7f3d6a4fd590 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: deef57f9-d933-48ad-a051-e782593799bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129365) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 20:57:39.977380 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d01c7c78-b998-460f-8b9d-060257a2bfb1 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] 10.222.0.46 "GET /compute/v2.1/servers/detail" status: 200 len: 3024 microversion: 2.1 time: 1.057608 Jan 15 20:57:39.977977 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1342/2680] 10.222.0.46 () {58 vars in 1145 bytes} [Sat Jan 15 20:57:38 2022] GET /compute/v2.1/servers/detail => generated 3024 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:39.982571 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8e71c58f-6177-4bf3-bb9c-0e2625111581 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:39.983290 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-8e71c58f-6177-4bf3-bb9c-0e2625111581 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] [instance: 689dd504-e36e-41d0-a461-acce91952e7e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:40.009751 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8e71c58f-6177-4bf3-bb9c-0e2625111581 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:40.010720 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8e71c58f-6177-4bf3-bb9c-0e2625111581 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:40.011842 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8e71c58f-6177-4bf3-bb9c-0e2625111581 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:40.012503 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8e71c58f-6177-4bf3-bb9c-0e2625111581 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:40.072873 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a4006c55-8f3d-4705-ace4-7f3d6a4fd590 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.275809 Jan 15 20:57:40.073869 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1339/2681] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 20:57:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 2277 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 20:57:40.085613 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-68d63cfd-eb17-4e92-8ec6-cb02d6f35830 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Calling method '.version_select at 0x7f30c99580d0>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:40.186755 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-68d63cfd-eb17-4e92-8ec6-cb02d6f35830 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] 10.222.0.46 "GET /compute/v2.1/images/1f99b18e-87c4-42c4-834c-464b28e8793e" status: 200 len: 1452 microversion: 2.1 time: 0.111366 Jan 15 20:57:40.204093 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1340/2682] 10.222.0.46 () {58 vars in 1232 bytes} [Sat Jan 15 20:57:40 2022] GET /compute/v2.1/images/1f99b18e-87c4-42c4-834c-464b28e8793e => generated 1452 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:40.218902 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-27dc346a-0dc6-4898-8b83-1a4539761134 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:57:40.219612 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-27dc346a-0dc6-4898-8b83-1a4539761134 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] [instance: 62ae2a15-8c2c-4dad-971f-0611238103a3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:40.247362 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-27dc346a-0dc6-4898-8b83-1a4539761134 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:40.247822 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-27dc346a-0dc6-4898-8b83-1a4539761134 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:40.272246 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-27dc346a-0dc6-4898-8b83-1a4539761134 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:40.273184 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-27dc346a-0dc6-4898-8b83-1a4539761134 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:40.395652 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-27dc346a-0dc6-4898-8b83-1a4539761134 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] 10.222.0.46 "POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action" status: 200 len: 32634 microversion: 2.1 time: 0.186517 Jan 15 20:57:40.396789 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1341/2683] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:57:40 2022] POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action => generated 32634 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:57:40.410301 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ec96ac63-56fb-43e9-b22f-49aaf90aa0d8 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:57:40.411663 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ec96ac63-56fb-43e9-b22f-49aaf90aa0d8 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] [instance: 70bf65cf-55e2-459a-aaf1-c3eb851a6ccf] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:40.436738 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-8e71c58f-6177-4bf3-bb9c-0e2625111581 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05483ff6eec84f78a091b29cfbcf61f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a6720be5fb4de7bcd77cc7ef9d8000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:57:40.436974 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ec96ac63-56fb-43e9-b22f-49aaf90aa0d8 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:40.437298 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ec96ac63-56fb-43e9-b22f-49aaf90aa0d8 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:40.440042 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ec96ac63-56fb-43e9-b22f-49aaf90aa0d8 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:40.445439 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-8e71c58f-6177-4bf3-bb9c-0e2625111581 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] 10.222.0.46 "GET /compute/v2.1/servers/689dd504-e36e-41d0-a461-acce91952e7e" status: 200 len: 1522 microversion: 2.1 time: 0.466320 Jan 15 20:57:40.445675 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ec96ac63-56fb-43e9-b22f-49aaf90aa0d8 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:40.448459 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1343/2684] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:57:39 2022] GET /compute/v2.1/servers/689dd504-e36e-41d0-a461-acce91952e7e => generated 1522 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:40.467531 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-47cd2596-7f7a-4a87-9ca2-9fa50b6587ff tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:40.472409 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:57:40.472409 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:57:40.474482 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-47cd2596-7f7a-4a87-9ca2-9fa50b6587ff tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7754a1e8134b4da4803400ca6bb4c540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4a067d84534cbd879732a1b7c057ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:57:40.476001 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-47cd2596-7f7a-4a87-9ca2-9fa50b6587ff tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] 10.222.0.46 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.025170 Jan 15 20:57:40.477145 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1344/2685] 10.222.0.46 () {58 vars in 1177 bytes} [Sat Jan 15 20:57:40 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 20:57:40.488483 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8eae4018-32f6-4bef-9ba6-f91c14c5181d tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:40.489476 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-8eae4018-32f6-4bef-9ba6-f91c14c5181d tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: deef57f9-d933-48ad-a051-e782593799bf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:40.519111 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ec96ac63-56fb-43e9-b22f-49aaf90aa0d8 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] 10.222.0.46 "POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action" status: 200 len: 32642 microversion: 2.1 time: 0.120922 Jan 15 20:57:40.519906 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1342/2686] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:57:40 2022] POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action => generated 32642 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:57:40.529539 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-08a53347-6ca2-45c0-af2b-33a036aa7ed4 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:40.533358 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:57:40.533358 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:57:40.534994 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-08a53347-6ca2-45c0-af2b-33a036aa7ed4 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7754a1e8134b4da4803400ca6bb4c540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4a067d84534cbd879732a1b7c057ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:57:40.536654 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-08a53347-6ca2-45c0-af2b-33a036aa7ed4 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Searching by: {'deleted': False, 'project_id': '4e4a067d84534cbd879732a1b7c057ae'} {{(pid=129365) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 15 20:57:40.545033 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-08a53347-6ca2-45c0-af2b-33a036aa7ed4 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:40.546357 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-08a53347-6ca2-45c0-af2b-33a036aa7ed4 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:40.547471 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-08a53347-6ca2-45c0-af2b-33a036aa7ed4 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:40.548013 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-08a53347-6ca2-45c0-af2b-33a036aa7ed4 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:40.605538 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-8eae4018-32f6-4bef-9ba6-f91c14c5181d tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:57:40.619787 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-8eae4018-32f6-4bef-9ba6-f91c14c5181d tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/deef57f9-d933-48ad-a051-e782593799bf" status: 200 len: 1215 microversion: 2.1 time: 0.139812 Jan 15 20:57:40.621142 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1345/2687] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:57:40 2022] GET /compute/v2.1/servers/deef57f9-d933-48ad-a051-e782593799bf => generated 1215 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:40.700228 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.multi_cell_list [None req-08a53347-6ca2-45c0-af2b-33a036aa7ed4 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=129365) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jan 15 20:57:40.789343 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-08a53347-6ca2-45c0-af2b-33a036aa7ed4 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] 10.222.0.46 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.265455 Jan 15 20:57:40.796164 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1343/2688] 10.222.0.46 () {58 vars in 1124 bytes} [Sat Jan 15 20:57:40 2022] GET /compute/v2.1/servers => generated 681 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:57:40.801401 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4325a1fa-1b26-469e-8db1-5202323f8d23 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:40.801889 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-4325a1fa-1b26-469e-8db1-5202323f8d23 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] [instance: 672fd3e7-4b14-4aa7-97da-6245dfabb878] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:40.809053 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4325a1fa-1b26-469e-8db1-5202323f8d23 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:40.809483 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4325a1fa-1b26-469e-8db1-5202323f8d23 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:40.810477 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4325a1fa-1b26-469e-8db1-5202323f8d23 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:40.811078 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4325a1fa-1b26-469e-8db1-5202323f8d23 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:40.838237 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-4325a1fa-1b26-469e-8db1-5202323f8d23 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] HTTP exception thrown: Instance 672fd3e7-4b14-4aa7-97da-6245dfabb878 could not be found. Jan 15 20:57:40.839399 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4325a1fa-1b26-469e-8db1-5202323f8d23 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Returning 404 to user: Instance 672fd3e7-4b14-4aa7-97da-6245dfabb878 could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:57:40.840272 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-4325a1fa-1b26-469e-8db1-5202323f8d23 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] 10.222.0.46 "DELETE /compute/v2.1/servers/672fd3e7-4b14-4aa7-97da-6245dfabb878" status: 404 len: 111 microversion: 2.1 time: 0.042869 Jan 15 20:57:40.840852 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1346/2689] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 20:57:40 2022] DELETE /compute/v2.1/servers/672fd3e7-4b14-4aa7-97da-6245dfabb878 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:57:40.849872 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-70f1d363-71ac-4861-978b-bf52dc0857a1 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:40.851076 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-70f1d363-71ac-4861-978b-bf52dc0857a1 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] [instance: 733106f5-de5a-4e36-9181-b277ccd1f423] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:40.857570 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-70f1d363-71ac-4861-978b-bf52dc0857a1 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:40.858284 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-70f1d363-71ac-4861-978b-bf52dc0857a1 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:40.859423 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-70f1d363-71ac-4861-978b-bf52dc0857a1 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:40.860029 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-70f1d363-71ac-4861-978b-bf52dc0857a1 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:40.894673 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-70f1d363-71ac-4861-978b-bf52dc0857a1 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] [instance: 733106f5-de5a-4e36-9181-b277ccd1f423] Going to try to terminate instance {{(pid=129365) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 20:57:41.019609 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-70f1d363-71ac-4861-978b-bf52dc0857a1 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] 10.222.0.46 "DELETE /compute/v2.1/servers/733106f5-de5a-4e36-9181-b277ccd1f423" status: 204 len: 0 microversion: 2.1 time: 0.173922 Jan 15 20:57:41.020823 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1344/2690] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 20:57:40 2022] DELETE /compute/v2.1/servers/733106f5-de5a-4e36-9181-b277ccd1f423 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 20:57:41.029996 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e1f4c430-f8a6-4206-b22d-f79213521925 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:41.031127 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e1f4c430-f8a6-4206-b22d-f79213521925 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] [instance: 3809db38-b5f5-471e-b6ba-de39c46d53a3] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:41.039996 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e1f4c430-f8a6-4206-b22d-f79213521925 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:41.041336 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e1f4c430-f8a6-4206-b22d-f79213521925 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:41.042329 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e1f4c430-f8a6-4206-b22d-f79213521925 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:41.043378 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e1f4c430-f8a6-4206-b22d-f79213521925 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:41.107997 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e1f4c430-f8a6-4206-b22d-f79213521925 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] [instance: 3809db38-b5f5-471e-b6ba-de39c46d53a3] Going to try to terminate instance {{(pid=129366) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 20:57:41.218491 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-48e4ebbe-16fb-4f1c-b09c-0eef3068fca3 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Calling method '.version_select at 0x7f30ceb79f70>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:41.323541 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-48e4ebbe-16fb-4f1c-b09c-0eef3068fca3 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] 10.222.0.46 "GET /compute/v2.1/images/1f99b18e-87c4-42c4-834c-464b28e8793e" status: 200 len: 1452 microversion: 2.1 time: 0.109878 Jan 15 20:57:41.324145 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1345/2691] 10.222.0.46 () {58 vars in 1232 bytes} [Sat Jan 15 20:57:41 2022] GET /compute/v2.1/images/1f99b18e-87c4-42c4-834c-464b28e8793e => generated 1452 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:57:41.357964 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e1f4c430-f8a6-4206-b22d-f79213521925 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] 10.222.0.46 "DELETE /compute/v2.1/servers/3809db38-b5f5-471e-b6ba-de39c46d53a3" status: 204 len: 0 microversion: 2.1 time: 0.332762 Jan 15 20:57:41.358914 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1347/2692] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 20:57:41 2022] DELETE /compute/v2.1/servers/3809db38-b5f5-471e-b6ba-de39c46d53a3 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 20:57:41.370761 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-40619b93-e9a0-49d6-8f1f-a7974de3e7f4 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:41.371505 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-40619b93-e9a0-49d6-8f1f-a7974de3e7f4 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] [instance: 672fd3e7-4b14-4aa7-97da-6245dfabb878] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:41.380594 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-40619b93-e9a0-49d6-8f1f-a7974de3e7f4 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:41.381410 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-40619b93-e9a0-49d6-8f1f-a7974de3e7f4 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:41.382217 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-40619b93-e9a0-49d6-8f1f-a7974de3e7f4 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:41.382745 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-40619b93-e9a0-49d6-8f1f-a7974de3e7f4 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:41.417194 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d4f37935-1788-44d3-9bcb-4fd2adade79f tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:57:41.420018 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-d4f37935-1788-44d3-9bcb-4fd2adade79f tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] [instance: 62ae2a15-8c2c-4dad-971f-0611238103a3] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:41.450473 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d4f37935-1788-44d3-9bcb-4fd2adade79f tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:41.451283 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d4f37935-1788-44d3-9bcb-4fd2adade79f tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:41.452121 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d4f37935-1788-44d3-9bcb-4fd2adade79f tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:41.452525 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d4f37935-1788-44d3-9bcb-4fd2adade79f tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:41.469235 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-40619b93-e9a0-49d6-8f1f-a7974de3e7f4 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] HTTP exception thrown: Instance 672fd3e7-4b14-4aa7-97da-6245dfabb878 could not be found. Jan 15 20:57:41.471565 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-40619b93-e9a0-49d6-8f1f-a7974de3e7f4 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Returning 404 to user: Instance 672fd3e7-4b14-4aa7-97da-6245dfabb878 could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:57:41.475303 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-40619b93-e9a0-49d6-8f1f-a7974de3e7f4 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] 10.222.0.46 "GET /compute/v2.1/servers/672fd3e7-4b14-4aa7-97da-6245dfabb878" status: 404 len: 111 microversion: 2.1 time: 0.108949 Jan 15 20:57:41.477686 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1346/2693] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:57:41 2022] GET /compute/v2.1/servers/672fd3e7-4b14-4aa7-97da-6245dfabb878 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:57:41.491212 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2d1ee7b2-fbc2-47cf-b188-4266a95ec5da tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:41.497686 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-2d1ee7b2-fbc2-47cf-b188-4266a95ec5da tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] [instance: 689dd504-e36e-41d0-a461-acce91952e7e] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:41.516979 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2d1ee7b2-fbc2-47cf-b188-4266a95ec5da tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:41.518239 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2d1ee7b2-fbc2-47cf-b188-4266a95ec5da tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:41.520399 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2d1ee7b2-fbc2-47cf-b188-4266a95ec5da tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:41.522136 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2d1ee7b2-fbc2-47cf-b188-4266a95ec5da tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:41.605733 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d4f37935-1788-44d3-9bcb-4fd2adade79f tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] 10.222.0.46 "POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action" status: 200 len: 32634 microversion: 2.1 time: 0.199488 Jan 15 20:57:41.608760 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1348/2694] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:57:41 2022] POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action => generated 32634 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:57:41.632970 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-fa79ea17-ccad-4952-8c66-5a469eb38577 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:41.634157 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-fa79ea17-ccad-4952-8c66-5a469eb38577 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] [instance: 733106f5-de5a-4e36-9181-b277ccd1f423] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:41.654998 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fa79ea17-ccad-4952-8c66-5a469eb38577 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:41.656925 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fa79ea17-ccad-4952-8c66-5a469eb38577 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:41.658048 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fa79ea17-ccad-4952-8c66-5a469eb38577 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:41.658666 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fa79ea17-ccad-4952-8c66-5a469eb38577 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:42.688907 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-2d1ee7b2-fbc2-47cf-b188-4266a95ec5da tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05483ff6eec84f78a091b29cfbcf61f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a6720be5fb4de7bcd77cc7ef9d8000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:57:42.704962 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2d1ee7b2-fbc2-47cf-b188-4266a95ec5da tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] 10.222.0.46 "GET /compute/v2.1/servers/689dd504-e36e-41d0-a461-acce91952e7e" status: 200 len: 1522 microversion: 2.1 time: 1.224463 Jan 15 20:57:42.707643 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1347/2695] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:57:41 2022] GET /compute/v2.1/servers/689dd504-e36e-41d0-a461-acce91952e7e => generated 1522 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:42.721098 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b985d971-be50-455f-b165-eb1597a298e0 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:57:42.722425 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b985d971-be50-455f-b165-eb1597a298e0 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] [instance: 70bf65cf-55e2-459a-aaf1-c3eb851a6ccf] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:42.739224 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b985d971-be50-455f-b165-eb1597a298e0 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:42.741863 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b985d971-be50-455f-b165-eb1597a298e0 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:42.744277 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b985d971-be50-455f-b165-eb1597a298e0 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:42.744994 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b985d971-be50-455f-b165-eb1597a298e0 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:42.805062 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-fa79ea17-ccad-4952-8c66-5a469eb38577 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7754a1e8134b4da4803400ca6bb4c540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4a067d84534cbd879732a1b7c057ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:57:42.815205 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-fa79ea17-ccad-4952-8c66-5a469eb38577 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] 10.222.0.46 "GET /compute/v2.1/servers/733106f5-de5a-4e36-9181-b277ccd1f423" status: 200 len: 1521 microversion: 2.1 time: 1.204167 Jan 15 20:57:42.816512 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1349/2696] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:57:41 2022] GET /compute/v2.1/servers/733106f5-de5a-4e36-9181-b277ccd1f423 => generated 1521 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:42.823358 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-2cc8e766-0d11-49f9-9e67-fe08ee061e8e tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:42.824626 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-2cc8e766-0d11-49f9-9e67-fe08ee061e8e tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: deef57f9-d933-48ad-a051-e782593799bf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:42.835882 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2cc8e766-0d11-49f9-9e67-fe08ee061e8e tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:42.837122 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2cc8e766-0d11-49f9-9e67-fe08ee061e8e tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:42.839309 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2cc8e766-0d11-49f9-9e67-fe08ee061e8e tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:42.840131 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2cc8e766-0d11-49f9-9e67-fe08ee061e8e tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:42.851958 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b985d971-be50-455f-b165-eb1597a298e0 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] 10.222.0.46 "POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action" status: 200 len: 32642 microversion: 2.1 time: 0.142795 Jan 15 20:57:42.856577 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1348/2697] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:57:42 2022] POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action => generated 32642 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:57:42.879781 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c40fab6f-a37e-42d8-a13b-b14d6347b25e tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Calling method '.version_select at 0x7f30c96c6430>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:42.943240 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c40fab6f-a37e-42d8-a13b-b14d6347b25e tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] 10.222.0.46 "GET /compute/v2.1/images/1f99b18e-87c4-42c4-834c-464b28e8793e" status: 200 len: 1452 microversion: 2.1 time: 0.088637 Jan 15 20:57:42.945335 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1349/2698] 10.222.0.46 () {58 vars in 1232 bytes} [Sat Jan 15 20:57:42 2022] GET /compute/v2.1/images/1f99b18e-87c4-42c4-834c-464b28e8793e => generated 1452 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:42.951561 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-2cc8e766-0d11-49f9-9e67-fe08ee061e8e tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:57:42.956386 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-850c84d9-20a3-4673-8af7-aa95cdff0e38 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:57:42.961486 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-850c84d9-20a3-4673-8af7-aa95cdff0e38 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] [instance: 62ae2a15-8c2c-4dad-971f-0611238103a3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:42.968360 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-2cc8e766-0d11-49f9-9e67-fe08ee061e8e tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/deef57f9-d933-48ad-a051-e782593799bf" status: 200 len: 1273 microversion: 2.1 time: 0.146871 Jan 15 20:57:42.969492 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1350/2699] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:57:42 2022] GET /compute/v2.1/servers/deef57f9-d933-48ad-a051-e782593799bf => generated 1273 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:42.976352 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-61e33894-37d5-45c7-9578-04b35c51bd35 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1960720664", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "dd4402cd-4bc8-45f2-ad1b-283bdc21d905"}], "block_device_mapping_v2": [{"uuid": "f24d67a0-cde3-4074-b10c-8904f7d12e2e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:57:42.982900 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-850c84d9-20a3-4673-8af7-aa95cdff0e38 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:42.985662 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-850c84d9-20a3-4673-8af7-aa95cdff0e38 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:42.986700 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-850c84d9-20a3-4673-8af7-aa95cdff0e38 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:42.989576 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-850c84d9-20a3-4673-8af7-aa95cdff0e38 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:43.077498 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-850c84d9-20a3-4673-8af7-aa95cdff0e38 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] 10.222.0.46 "POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action" status: 200 len: 32634 microversion: 2.1 time: 0.126007 Jan 15 20:57:43.078860 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1350/2700] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:57:42 2022] POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action => generated 32634 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:57:43.111958 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.network.neutron [None req-61e33894-37d5-45c7-9578-04b35c51bd35 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] validate_networks() for [('dd4402cd-4bc8-45f2-ad1b-283bdc21d905', None, None, None, None, None)] {{(pid=129366) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 20:57:43.725949 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-abc9b575-a840-4358-86c4-6c9ea4daff72 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:43.730957 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-abc9b575-a840-4358-86c4-6c9ea4daff72 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] [instance: 689dd504-e36e-41d0-a461-acce91952e7e] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:43.742272 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-abc9b575-a840-4358-86c4-6c9ea4daff72 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:43.743122 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-abc9b575-a840-4358-86c4-6c9ea4daff72 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:43.746984 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-abc9b575-a840-4358-86c4-6c9ea4daff72 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:43.755140 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-abc9b575-a840-4358-86c4-6c9ea4daff72 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:44.225272 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-abc9b575-a840-4358-86c4-6c9ea4daff72 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05483ff6eec84f78a091b29cfbcf61f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a6720be5fb4de7bcd77cc7ef9d8000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:57:44.226045 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-61e33894-37d5-45c7-9578-04b35c51bd35 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Flavor limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 20:57:44.228493 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-61e33894-37d5-45c7-9578-04b35c51bd35 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Image limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 20:57:44.230587 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-61e33894-37d5-45c7-9578-04b35c51bd35 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Flavor pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 20:57:44.231312 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-61e33894-37d5-45c7-9578-04b35c51bd35 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Image pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 20:57:44.231991 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-61e33894-37d5-45c7-9578-04b35c51bd35 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 20:57:44.239362 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-abc9b575-a840-4358-86c4-6c9ea4daff72 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] 10.222.0.46 "GET /compute/v2.1/servers/689dd504-e36e-41d0-a461-acce91952e7e" status: 200 len: 1522 microversion: 2.1 time: 0.518610 Jan 15 20:57:44.243102 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1351/2701] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:57:43 2022] GET /compute/v2.1/servers/689dd504-e36e-41d0-a461-acce91952e7e => generated 1522 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:44.251290 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-61e33894-37d5-45c7-9578-04b35c51bd35 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:44.254722 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f8e5a3fb-2a2c-4249-8fdd-a500c30f3887 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:44.255338 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f8e5a3fb-2a2c-4249-8fdd-a500c30f3887 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] [instance: 733106f5-de5a-4e36-9181-b277ccd1f423] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:44.255500 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-61e33894-37d5-45c7-9578-04b35c51bd35 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:44.256444 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-61e33894-37d5-45c7-9578-04b35c51bd35 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:44.257425 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-61e33894-37d5-45c7-9578-04b35c51bd35 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:44.277648 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-61e33894-37d5-45c7-9578-04b35c51bd35 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Getting quotas for project 385a05b1a0a7479db84b762eca23b55b. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:57:44.284033 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-61e33894-37d5-45c7-9578-04b35c51bd35 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Getting quotas for user e2ec114f8ece434aa496cd401494e2e4 and project 385a05b1a0a7479db84b762eca23b55b. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:57:44.291455 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f8e5a3fb-2a2c-4249-8fdd-a500c30f3887 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:44.295332 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f8e5a3fb-2a2c-4249-8fdd-a500c30f3887 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:44.297301 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f8e5a3fb-2a2c-4249-8fdd-a500c30f3887 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:44.300135 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f8e5a3fb-2a2c-4249-8fdd-a500c30f3887 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:44.393101 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-61e33894-37d5-45c7-9578-04b35c51bd35 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Going to run 1 instances... {{(pid=129366) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 20:57:44.395474 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-61e33894-37d5-45c7-9578-04b35c51bd35 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] [instance: 2427a640-1c1b-49f4-a98d-bff4af6e596b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f24d67a0-cde3-4074-b10c-8904f7d12e2e',volume_size=None,volume_type=None)] {{(pid=129366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 20:57:44.614279 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-61e33894-37d5-45c7-9578-04b35c51bd35 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.640715 Jan 15 20:57:44.615120 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1351/2702] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 20:57:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1645 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 20:57:44.630129 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-de402b9a-dafb-4ad9-abe1-34194990c9e7 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:57:44.646590 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-de402b9a-dafb-4ad9-abe1-34194990c9e7 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] [instance: 70bf65cf-55e2-459a-aaf1-c3eb851a6ccf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:44.654786 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-f8e5a3fb-2a2c-4249-8fdd-a500c30f3887 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7754a1e8134b4da4803400ca6bb4c540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4a067d84534cbd879732a1b7c057ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:57:44.663847 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-de402b9a-dafb-4ad9-abe1-34194990c9e7 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:44.665338 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-de402b9a-dafb-4ad9-abe1-34194990c9e7 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:44.669554 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-de402b9a-dafb-4ad9-abe1-34194990c9e7 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:44.670756 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-de402b9a-dafb-4ad9-abe1-34194990c9e7 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:44.684095 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f8e5a3fb-2a2c-4249-8fdd-a500c30f3887 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] 10.222.0.46 "GET /compute/v2.1/servers/733106f5-de5a-4e36-9181-b277ccd1f423" status: 200 len: 1521 microversion: 2.1 time: 0.422129 Jan 15 20:57:44.693406 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1352/2703] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:57:44 2022] GET /compute/v2.1/servers/733106f5-de5a-4e36-9181-b277ccd1f423 => generated 1521 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:44.699160 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-0983bb28-eb9e-4d08-89ea-5ee62e6b8bf9 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Calling method '.version_select at 0x7f30c87ef0d0>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:44.775224 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-de402b9a-dafb-4ad9-abe1-34194990c9e7 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] 10.222.0.46 "POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action" status: 200 len: 32642 microversion: 2.1 time: 0.151779 Jan 15 20:57:44.776513 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1352/2704] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:57:44 2022] POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action => generated 32642 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:57:44.786419 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-cce73956-2f23-4e15-b0b4-f3d8cdd193da tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:44.792195 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-0983bb28-eb9e-4d08-89ea-5ee62e6b8bf9 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] 10.222.0.46 "GET /compute/v2.1/images/1f99b18e-87c4-42c4-834c-464b28e8793e" status: 200 len: 1452 microversion: 2.1 time: 0.105915 Jan 15 20:57:44.793772 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1353/2705] 10.222.0.46 () {58 vars in 1232 bytes} [Sat Jan 15 20:57:44 2022] GET /compute/v2.1/images/1f99b18e-87c4-42c4-834c-464b28e8793e => generated 1452 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:44.798880 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-cce73956-2f23-4e15-b0b4-f3d8cdd193da tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: deef57f9-d933-48ad-a051-e782593799bf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:44.813010 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-66726800-4005-4470-962b-dfd8102e41bc tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:57:44.814028 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-66726800-4005-4470-962b-dfd8102e41bc tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] [instance: 62ae2a15-8c2c-4dad-971f-0611238103a3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:44.820749 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cce73956-2f23-4e15-b0b4-f3d8cdd193da tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:44.821342 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cce73956-2f23-4e15-b0b4-f3d8cdd193da tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:44.823022 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cce73956-2f23-4e15-b0b4-f3d8cdd193da tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:44.823624 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cce73956-2f23-4e15-b0b4-f3d8cdd193da tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:44.843870 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-66726800-4005-4470-962b-dfd8102e41bc tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:44.844332 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-66726800-4005-4470-962b-dfd8102e41bc tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:44.853856 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-66726800-4005-4470-962b-dfd8102e41bc tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:44.858454 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-66726800-4005-4470-962b-dfd8102e41bc tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:44.977859 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-66726800-4005-4470-962b-dfd8102e41bc tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] 10.222.0.46 "POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action" status: 200 len: 32634 microversion: 2.1 time: 0.182554 Jan 15 20:57:44.979007 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1354/2706] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:57:44 2022] POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action => generated 32634 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:57:44.987401 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ebed8721-a0ee-469b-b97d-ae24b41bb06d tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:44.988417 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ebed8721-a0ee-469b-b97d-ae24b41bb06d tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] [instance: 2427a640-1c1b-49f4-a98d-bff4af6e596b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:45.102844 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-ebed8721-a0ee-469b-b97d-ae24b41bb06d tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ec114f8ece434aa496cd401494e2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a05b1a0a7479db84b762eca23b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:57:45.144697 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ebed8721-a0ee-469b-b97d-ae24b41bb06d tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] 10.222.0.46 "GET /compute/v2.1/servers/2427a640-1c1b-49f4-a98d-bff4af6e596b" status: 200 len: 1053 microversion: 2.1 time: 0.164239 Jan 15 20:57:45.156366 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1355/2707] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:57:44 2022] GET /compute/v2.1/servers/2427a640-1c1b-49f4-a98d-bff4af6e596b => generated 1053 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:45.256105 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-05ade915-0c57-47e7-af2a-87eef0f11d1a tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:45.257262 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-05ade915-0c57-47e7-af2a-87eef0f11d1a tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] [instance: 689dd504-e36e-41d0-a461-acce91952e7e] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:45.257557 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-cce73956-2f23-4e15-b0b4-f3d8cdd193da tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:57:45.272749 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-05ade915-0c57-47e7-af2a-87eef0f11d1a tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:45.281446 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-cce73956-2f23-4e15-b0b4-f3d8cdd193da tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/deef57f9-d933-48ad-a051-e782593799bf" status: 200 len: 1315 microversion: 2.1 time: 0.501380 Jan 15 20:57:45.282004 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-05ade915-0c57-47e7-af2a-87eef0f11d1a tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:45.282298 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1353/2708] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:57:44 2022] GET /compute/v2.1/servers/deef57f9-d933-48ad-a051-e782593799bf => generated 1315 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:45.285949 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-05ade915-0c57-47e7-af2a-87eef0f11d1a tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:45.289199 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-05ade915-0c57-47e7-af2a-87eef0f11d1a tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:45.702583 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-40b5ed1c-eaa7-43a3-8fc1-d8ab41f4f96c tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:45.703255 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-40b5ed1c-eaa7-43a3-8fc1-d8ab41f4f96c tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] [instance: 733106f5-de5a-4e36-9181-b277ccd1f423] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:45.733262 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-40b5ed1c-eaa7-43a3-8fc1-d8ab41f4f96c tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:45.733708 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-40b5ed1c-eaa7-43a3-8fc1-d8ab41f4f96c tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:45.742591 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-40b5ed1c-eaa7-43a3-8fc1-d8ab41f4f96c tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:45.748970 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-40b5ed1c-eaa7-43a3-8fc1-d8ab41f4f96c tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:45.795262 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-05ade915-0c57-47e7-af2a-87eef0f11d1a tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05483ff6eec84f78a091b29cfbcf61f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a6720be5fb4de7bcd77cc7ef9d8000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:57:45.810699 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-05ade915-0c57-47e7-af2a-87eef0f11d1a tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] 10.222.0.46 "GET /compute/v2.1/servers/689dd504-e36e-41d0-a461-acce91952e7e" status: 200 len: 1522 microversion: 2.1 time: 0.558496 Jan 15 20:57:45.818804 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1356/2709] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:57:45 2022] GET /compute/v2.1/servers/689dd504-e36e-41d0-a461-acce91952e7e => generated 1522 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:45.832652 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-a112ff09-b8f1-4b29-9eff-560249da48e3 req-ab860e95-f7bc-43ed-b2e6-60a796f55d39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "733106f5-de5a-4e36-9181-b277ccd1f423", "name": "network-vif-deleted", "tag": "b4e79b4f-5297-4f59-b4cf-fba91468535c"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:57:45.836900 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:57:45.836900 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:57:45.854037 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-a112ff09-b8f1-4b29-9eff-560249da48e3 req-ab860e95-f7bc-43ed-b2e6-60a796f55d39 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:45.861563 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-a112ff09-b8f1-4b29-9eff-560249da48e3 req-ab860e95-f7bc-43ed-b2e6-60a796f55d39 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:45.912935 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-a112ff09-b8f1-4b29-9eff-560249da48e3 req-ab860e95-f7bc-43ed-b2e6-60a796f55d39 service nova] Creating event network-vif-deleted:b4e79b4f-5297-4f59-b4cf-fba91468535c for instance 733106f5-de5a-4e36-9181-b277ccd1f423 on nch2-master-1 Jan 15 20:57:45.930247 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-a112ff09-b8f1-4b29-9eff-560249da48e3 req-ab860e95-f7bc-43ed-b2e6-60a796f55d39 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107773 Jan 15 20:57:45.933788 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1357/2710] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:57:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:57:45.957218 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-52695dc8-278f-4c2e-b327-ed3628ab0811 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:57:45.959327 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-40b5ed1c-eaa7-43a3-8fc1-d8ab41f4f96c tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7754a1e8134b4da4803400ca6bb4c540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4a067d84534cbd879732a1b7c057ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:57:45.960244 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-52695dc8-278f-4c2e-b327-ed3628ab0811 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] [instance: 70bf65cf-55e2-459a-aaf1-c3eb851a6ccf] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:45.981004 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-40b5ed1c-eaa7-43a3-8fc1-d8ab41f4f96c tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] 10.222.0.46 "GET /compute/v2.1/servers/733106f5-de5a-4e36-9181-b277ccd1f423" status: 200 len: 1307 microversion: 2.1 time: 0.284060 Jan 15 20:57:45.987210 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-52695dc8-278f-4c2e-b327-ed3628ab0811 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:45.987671 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-52695dc8-278f-4c2e-b327-ed3628ab0811 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:45.988026 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1354/2711] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:57:45 2022] GET /compute/v2.1/servers/733106f5-de5a-4e36-9181-b277ccd1f423 => generated 1307 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:45.988495 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-52695dc8-278f-4c2e-b327-ed3628ab0811 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:45.988958 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-52695dc8-278f-4c2e-b327-ed3628ab0811 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:46.009721 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-da2e3924-cca4-4213-9282-9c151eb10910 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Calling method '.version_select at 0x7f30c8f8b160>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:46.108111 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-52695dc8-278f-4c2e-b327-ed3628ab0811 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] 10.222.0.46 "POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action" status: 200 len: 32642 microversion: 2.1 time: 0.170753 Jan 15 20:57:46.109642 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-da2e3924-cca4-4213-9282-9c151eb10910 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] 10.222.0.46 "GET /compute/v2.1/images/1f99b18e-87c4-42c4-834c-464b28e8793e" status: 200 len: 1452 microversion: 2.1 time: 0.117937 Jan 15 20:57:46.123651 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1358/2712] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:57:45 2022] POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action => generated 32642 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:57:46.135828 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1355/2713] 10.222.0.46 () {58 vars in 1232 bytes} [Sat Jan 15 20:57:45 2022] GET /compute/v2.1/images/1f99b18e-87c4-42c4-834c-464b28e8793e => generated 1452 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:46.149456 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-6975bce8-9c81-4315-a179-8d3640a838c7 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:57:46.153264 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-6975bce8-9c81-4315-a179-8d3640a838c7 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] [instance: 62ae2a15-8c2c-4dad-971f-0611238103a3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:46.174652 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-3b746175-cbe9-482f-812b-b4beb5f089fb tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:46.177286 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-3b746175-cbe9-482f-812b-b4beb5f089fb tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] [instance: 2427a640-1c1b-49f4-a98d-bff4af6e596b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:46.179108 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6975bce8-9c81-4315-a179-8d3640a838c7 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:46.181975 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6975bce8-9c81-4315-a179-8d3640a838c7 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:46.194209 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6975bce8-9c81-4315-a179-8d3640a838c7 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:46.195266 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6975bce8-9c81-4315-a179-8d3640a838c7 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:46.201452 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3b746175-cbe9-482f-812b-b4beb5f089fb tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:46.202236 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3b746175-cbe9-482f-812b-b4beb5f089fb tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:46.206223 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3b746175-cbe9-482f-812b-b4beb5f089fb tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:46.207487 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3b746175-cbe9-482f-812b-b4beb5f089fb tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:46.300938 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-6975bce8-9c81-4315-a179-8d3640a838c7 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] 10.222.0.46 "POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action" status: 200 len: 32634 microversion: 2.1 time: 0.173925 Jan 15 20:57:46.305494 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1359/2714] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:57:46 2022] POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action => generated 32634 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:57:46.317410 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-05e2ab17-1728-48a0-ab6b-96dbb0574525 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:46.318610 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-05e2ab17-1728-48a0-ab6b-96dbb0574525 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: deef57f9-d933-48ad-a051-e782593799bf] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:46.340222 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-05e2ab17-1728-48a0-ab6b-96dbb0574525 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:46.343954 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-05e2ab17-1728-48a0-ab6b-96dbb0574525 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:46.345269 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-05e2ab17-1728-48a0-ab6b-96dbb0574525 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:46.346770 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-05e2ab17-1728-48a0-ab6b-96dbb0574525 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:46.416615 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-3b746175-cbe9-482f-812b-b4beb5f089fb tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ec114f8ece434aa496cd401494e2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a05b1a0a7479db84b762eca23b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:57:46.437561 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-3b746175-cbe9-482f-812b-b4beb5f089fb tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] 10.222.0.46 "GET /compute/v2.1/servers/2427a640-1c1b-49f4-a98d-bff4af6e596b" status: 200 len: 1151 microversion: 2.1 time: 0.267595 Jan 15 20:57:46.438181 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1356/2715] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:57:46 2022] GET /compute/v2.1/servers/2427a640-1c1b-49f4-a98d-bff4af6e596b => generated 1151 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:46.673568 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-05e2ab17-1728-48a0-ab6b-96dbb0574525 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:57:46.684003 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-05e2ab17-1728-48a0-ab6b-96dbb0574525 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/deef57f9-d933-48ad-a051-e782593799bf" status: 200 len: 1315 microversion: 2.1 time: 0.377006 Jan 15 20:57:46.684870 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1360/2716] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:57:46 2022] GET /compute/v2.1/servers/deef57f9-d933-48ad-a051-e782593799bf => generated 1315 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:46.834102 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-133da899-8424-4c0c-b6d2-82761a003abd tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:46.835339 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-133da899-8424-4c0c-b6d2-82761a003abd tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] [instance: 689dd504-e36e-41d0-a461-acce91952e7e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:46.852172 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-133da899-8424-4c0c-b6d2-82761a003abd tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:46.877057 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-133da899-8424-4c0c-b6d2-82761a003abd tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:46.879443 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-133da899-8424-4c0c-b6d2-82761a003abd tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:46.882669 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-133da899-8424-4c0c-b6d2-82761a003abd tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:47.007461 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f8012d1d-7b97-4e61-801d-c153a42a423b tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:47.008682 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f8012d1d-7b97-4e61-801d-c153a42a423b tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] [instance: 733106f5-de5a-4e36-9181-b277ccd1f423] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:47.019020 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f8012d1d-7b97-4e61-801d-c153a42a423b tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:47.025520 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f8012d1d-7b97-4e61-801d-c153a42a423b tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:47.026700 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f8012d1d-7b97-4e61-801d-c153a42a423b tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:47.027326 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f8012d1d-7b97-4e61-801d-c153a42a423b tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:47.098856 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-f8012d1d-7b97-4e61-801d-c153a42a423b tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] HTTP exception thrown: Instance 733106f5-de5a-4e36-9181-b277ccd1f423 could not be found. Jan 15 20:57:47.099517 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f8012d1d-7b97-4e61-801d-c153a42a423b tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Returning 404 to user: Instance 733106f5-de5a-4e36-9181-b277ccd1f423 could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:57:47.109984 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f8012d1d-7b97-4e61-801d-c153a42a423b tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] 10.222.0.46 "GET /compute/v2.1/servers/733106f5-de5a-4e36-9181-b277ccd1f423" status: 404 len: 111 microversion: 2.1 time: 0.096889 Jan 15 20:57:47.110681 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1361/2717] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:57:47 2022] GET /compute/v2.1/servers/733106f5-de5a-4e36-9181-b277ccd1f423 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:57:47.121426 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3fa01568-c92f-46b8-9760-adbbdd9d2740 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:47.122140 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-3fa01568-c92f-46b8-9760-adbbdd9d2740 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] [instance: 3809db38-b5f5-471e-b6ba-de39c46d53a3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:47.164009 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-133da899-8424-4c0c-b6d2-82761a003abd tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05483ff6eec84f78a091b29cfbcf61f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a6720be5fb4de7bcd77cc7ef9d8000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:57:47.178610 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-133da899-8424-4c0c-b6d2-82761a003abd tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] 10.222.0.46 "GET /compute/v2.1/servers/689dd504-e36e-41d0-a461-acce91952e7e" status: 200 len: 1522 microversion: 2.1 time: 0.348074 Jan 15 20:57:47.179234 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1357/2718] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:57:46 2022] GET /compute/v2.1/servers/689dd504-e36e-41d0-a461-acce91952e7e => generated 1522 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:57:47.194864 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3fa01568-c92f-46b8-9760-adbbdd9d2740 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:47.195323 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3fa01568-c92f-46b8-9760-adbbdd9d2740 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:47.196148 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3fa01568-c92f-46b8-9760-adbbdd9d2740 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:47.196635 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3fa01568-c92f-46b8-9760-adbbdd9d2740 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:47.212819 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-349ac3ed-9b2b-4ca5-bc13-071c2366b208 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:57:47.214494 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-349ac3ed-9b2b-4ca5-bc13-071c2366b208 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] [instance: 70bf65cf-55e2-459a-aaf1-c3eb851a6ccf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:47.254792 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-349ac3ed-9b2b-4ca5-bc13-071c2366b208 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:47.255184 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-349ac3ed-9b2b-4ca5-bc13-071c2366b208 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:47.256008 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-349ac3ed-9b2b-4ca5-bc13-071c2366b208 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:47.256452 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-349ac3ed-9b2b-4ca5-bc13-071c2366b208 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:47.274251 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-3fa01568-c92f-46b8-9760-adbbdd9d2740 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] HTTP exception thrown: Instance 3809db38-b5f5-471e-b6ba-de39c46d53a3 could not be found. Jan 15 20:57:47.276906 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3fa01568-c92f-46b8-9760-adbbdd9d2740 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] Returning 404 to user: Instance 3809db38-b5f5-471e-b6ba-de39c46d53a3 could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:57:47.278908 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3fa01568-c92f-46b8-9760-adbbdd9d2740 tempest-ListServersNegativeTestJSON-1076198852 tempest-ListServersNegativeTestJSON-1076198852-project] 10.222.0.46 "GET /compute/v2.1/servers/3809db38-b5f5-471e-b6ba-de39c46d53a3" status: 404 len: 111 microversion: 2.1 time: 0.161539 Jan 15 20:57:47.280014 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1362/2719] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:57:47 2022] GET /compute/v2.1/servers/3809db38-b5f5-471e-b6ba-de39c46d53a3 => generated 111 bytes in 165 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:57:47.285168 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e25dadcd-f93b-4514-9c47-ffe4f8da36eb tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Calling method '.version_select at 0x7f30c90315e0>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:47.354195 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-349ac3ed-9b2b-4ca5-bc13-071c2366b208 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] 10.222.0.46 "POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action" status: 200 len: 32642 microversion: 2.1 time: 0.153703 Jan 15 20:57:47.358309 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1358/2720] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:57:47 2022] POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action => generated 32642 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:57:47.363680 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-6c68cb01-ccdc-49b7-b3f1-8f8694d6b35f tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:57:47.363928 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e25dadcd-f93b-4514-9c47-ffe4f8da36eb tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] 10.222.0.46 "GET /compute/v2.1/images/1f99b18e-87c4-42c4-834c-464b28e8793e" status: 200 len: 1452 microversion: 2.1 time: 0.081982 Jan 15 20:57:47.364747 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-6c68cb01-ccdc-49b7-b3f1-8f8694d6b35f tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] [instance: 62ae2a15-8c2c-4dad-971f-0611238103a3] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:47.366184 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1363/2721] 10.222.0.46 () {58 vars in 1232 bytes} [Sat Jan 15 20:57:47 2022] GET /compute/v2.1/images/1f99b18e-87c4-42c4-834c-464b28e8793e => generated 1452 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:47.397385 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6c68cb01-ccdc-49b7-b3f1-8f8694d6b35f tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:47.398197 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6c68cb01-ccdc-49b7-b3f1-8f8694d6b35f tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:47.399272 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6c68cb01-ccdc-49b7-b3f1-8f8694d6b35f tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:47.402215 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6c68cb01-ccdc-49b7-b3f1-8f8694d6b35f tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:47.458514 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-53265d0c-3863-452c-b362-f49632df872b tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:47.459350 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-53265d0c-3863-452c-b362-f49632df872b tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] [instance: 2427a640-1c1b-49f4-a98d-bff4af6e596b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:47.461673 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-6c68cb01-ccdc-49b7-b3f1-8f8694d6b35f tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] 10.222.0.46 "POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action" status: 200 len: 32634 microversion: 2.1 time: 0.101434 Jan 15 20:57:47.465141 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1359/2722] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:57:47 2022] POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action => generated 32634 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:57:47.483863 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-53265d0c-3863-452c-b362-f49632df872b tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:47.487461 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-53265d0c-3863-452c-b362-f49632df872b tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:47.492565 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-53265d0c-3863-452c-b362-f49632df872b tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:47.497851 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-53265d0c-3863-452c-b362-f49632df872b tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:47.704912 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-05e38861-4ce7-4046-9f5c-d13555606d09 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:47.705643 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-05e38861-4ce7-4046-9f5c-d13555606d09 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: deef57f9-d933-48ad-a051-e782593799bf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:47.731074 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-05e38861-4ce7-4046-9f5c-d13555606d09 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:47.738075 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-05e38861-4ce7-4046-9f5c-d13555606d09 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:47.740657 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-05e38861-4ce7-4046-9f5c-d13555606d09 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:47.741391 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-05e38861-4ce7-4046-9f5c-d13555606d09 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:47.950054 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-53265d0c-3863-452c-b362-f49632df872b tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ec114f8ece434aa496cd401494e2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a05b1a0a7479db84b762eca23b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:57:47.963684 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-53265d0c-3863-452c-b362-f49632df872b tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] 10.222.0.46 "GET /compute/v2.1/servers/2427a640-1c1b-49f4-a98d-bff4af6e596b" status: 200 len: 1169 microversion: 2.1 time: 0.510931 Jan 15 20:57:47.984320 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1364/2723] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:57:47 2022] GET /compute/v2.1/servers/2427a640-1c1b-49f4-a98d-bff4af6e596b => generated 1169 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:57:48.198311 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-aab37bf8-0bc9-43dd-b5d1-fd8f97e448c6 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:48.199809 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-aab37bf8-0bc9-43dd-b5d1-fd8f97e448c6 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] [instance: 689dd504-e36e-41d0-a461-acce91952e7e] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:48.228208 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-aab37bf8-0bc9-43dd-b5d1-fd8f97e448c6 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:48.229128 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-aab37bf8-0bc9-43dd-b5d1-fd8f97e448c6 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:48.236808 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-aab37bf8-0bc9-43dd-b5d1-fd8f97e448c6 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:48.240271 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-aab37bf8-0bc9-43dd-b5d1-fd8f97e448c6 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:48.870993 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-05e38861-4ce7-4046-9f5c-d13555606d09 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:57:48.880509 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-05e38861-4ce7-4046-9f5c-d13555606d09 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/deef57f9-d933-48ad-a051-e782593799bf" status: 200 len: 1315 microversion: 2.1 time: 1.180294 Jan 15 20:57:48.888988 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1360/2724] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:57:47 2022] GET /compute/v2.1/servers/deef57f9-d933-48ad-a051-e782593799bf => generated 1315 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:48.904220 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-9debe8bd-0956-4f23-9a79-fc37c008562b req-6ca2f3dc-6a38-4aab-813b-b553b0444f42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3809db38-b5f5-471e-b6ba-de39c46d53a3", "name": "network-vif-deleted", "tag": "9409ec6f-f317-4b00-ad1b-b8d9a6b10896"}, {"name": "network-changed", "server_uuid": "deef57f9-d933-48ad-a051-e782593799bf", "tag": "00278b05-3736-45fa-b8cc-cc991355aa9a"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:57:48.908757 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:57:48.908757 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:57:48.934380 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-9debe8bd-0956-4f23-9a79-fc37c008562b req-6ca2f3dc-6a38-4aab-813b-b553b0444f42 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:48.936901 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-9debe8bd-0956-4f23-9a79-fc37c008562b req-6ca2f3dc-6a38-4aab-813b-b553b0444f42 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:48.977656 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-9debe8bd-0956-4f23-9a79-fc37c008562b req-6ca2f3dc-6a38-4aab-813b-b553b0444f42 service nova] Creating event network-vif-deleted:9409ec6f-f317-4b00-ad1b-b8d9a6b10896 for instance 3809db38-b5f5-471e-b6ba-de39c46d53a3 on nch1-master-1 Jan 15 20:57:48.978744 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-9debe8bd-0956-4f23-9a79-fc37c008562b req-6ca2f3dc-6a38-4aab-813b-b553b0444f42 service nova] Creating event network-changed:00278b05-3736-45fa-b8cc-cc991355aa9a for instance deef57f9-d933-48ad-a051-e782593799bf on nch1-master-1 Jan 15 20:57:48.995858 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-9debe8bd-0956-4f23-9a79-fc37c008562b req-6ca2f3dc-6a38-4aab-813b-b553b0444f42 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.105317 Jan 15 20:57:49.000256 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1361/2725] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:57:48 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:57:49.013776 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-acb8ef1d-b975-40e8-9063-0ad10fddde9e tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:57:49.015896 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-acb8ef1d-b975-40e8-9063-0ad10fddde9e tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] [instance: 70bf65cf-55e2-459a-aaf1-c3eb851a6ccf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:49.033811 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-acb8ef1d-b975-40e8-9063-0ad10fddde9e tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:49.035896 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-acb8ef1d-b975-40e8-9063-0ad10fddde9e tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:49.038860 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-acb8ef1d-b975-40e8-9063-0ad10fddde9e tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:49.039433 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-acb8ef1d-b975-40e8-9063-0ad10fddde9e tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:49.122806 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-acb8ef1d-b975-40e8-9063-0ad10fddde9e tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] 10.222.0.46 "POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action" status: 200 len: 32642 microversion: 2.1 time: 0.120694 Jan 15 20:57:49.129053 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1362/2726] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:57:49 2022] POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action => generated 32642 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:57:49.141361 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9e4cab9a-3002-425d-9c45-4f1da2f68f6b tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Calling method '.version_select at 0x7f30c8f44b80>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:49.190771 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-aab37bf8-0bc9-43dd-b5d1-fd8f97e448c6 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05483ff6eec84f78a091b29cfbcf61f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a6720be5fb4de7bcd77cc7ef9d8000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:57:49.206679 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-aab37bf8-0bc9-43dd-b5d1-fd8f97e448c6 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] 10.222.0.46 "GET /compute/v2.1/servers/689dd504-e36e-41d0-a461-acce91952e7e" status: 200 len: 1522 microversion: 2.1 time: 1.008679 Jan 15 20:57:49.221849 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1365/2727] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:57:48 2022] GET /compute/v2.1/servers/689dd504-e36e-41d0-a461-acce91952e7e => generated 1522 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:57:49.234510 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e47035ba-cd3e-44a1-b33c-309a537894e5 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:57:49.236114 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e47035ba-cd3e-44a1-b33c-309a537894e5 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] [instance: 62ae2a15-8c2c-4dad-971f-0611238103a3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:49.256190 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e47035ba-cd3e-44a1-b33c-309a537894e5 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:49.256944 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e47035ba-cd3e-44a1-b33c-309a537894e5 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:49.258731 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e47035ba-cd3e-44a1-b33c-309a537894e5 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:49.260535 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e47035ba-cd3e-44a1-b33c-309a537894e5 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:49.275608 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-9e4cab9a-3002-425d-9c45-4f1da2f68f6b tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] 10.222.0.46 "GET /compute/v2.1/images/1f99b18e-87c4-42c4-834c-464b28e8793e" status: 200 len: 1452 microversion: 2.1 time: 0.144312 Jan 15 20:57:49.276414 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1363/2728] 10.222.0.46 () {58 vars in 1232 bytes} [Sat Jan 15 20:57:49 2022] GET /compute/v2.1/images/1f99b18e-87c4-42c4-834c-464b28e8793e => generated 1452 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:49.295080 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0cd5608f-270b-4c5e-b5e0-47916e9f427a tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:49.296480 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-0cd5608f-270b-4c5e-b5e0-47916e9f427a tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] [instance: 2427a640-1c1b-49f4-a98d-bff4af6e596b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:49.318399 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0cd5608f-270b-4c5e-b5e0-47916e9f427a tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:49.325748 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e47035ba-cd3e-44a1-b33c-309a537894e5 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] 10.222.0.46 "POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action" status: 200 len: 32634 microversion: 2.1 time: 0.102258 Jan 15 20:57:49.329488 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0cd5608f-270b-4c5e-b5e0-47916e9f427a tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:49.331201 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0cd5608f-270b-4c5e-b5e0-47916e9f427a tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:49.331726 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1366/2729] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:57:49 2022] POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action => generated 32634 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:57:49.332395 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0cd5608f-270b-4c5e-b5e0-47916e9f427a tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:49.695501 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-0cd5608f-270b-4c5e-b5e0-47916e9f427a tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ec114f8ece434aa496cd401494e2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a05b1a0a7479db84b762eca23b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:57:49.706008 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0cd5608f-270b-4c5e-b5e0-47916e9f427a tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] 10.222.0.46 "GET /compute/v2.1/servers/2427a640-1c1b-49f4-a98d-bff4af6e596b" status: 200 len: 1199 microversion: 2.1 time: 0.428421 Jan 15 20:57:49.711007 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1364/2730] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:57:49 2022] GET /compute/v2.1/servers/2427a640-1c1b-49f4-a98d-bff4af6e596b => generated 1199 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:49.903942 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a45d003a-60f0-4c18-93e4-b90a7f36cf54 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:49.905069 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a45d003a-60f0-4c18-93e4-b90a7f36cf54 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: deef57f9-d933-48ad-a051-e782593799bf] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:49.937401 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a45d003a-60f0-4c18-93e4-b90a7f36cf54 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:49.938218 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a45d003a-60f0-4c18-93e4-b90a7f36cf54 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:49.939257 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a45d003a-60f0-4c18-93e4-b90a7f36cf54 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:49.939861 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a45d003a-60f0-4c18-93e4-b90a7f36cf54 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:50.141305 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-2817ad30-d335-4b9b-8426-2f2d0616270d tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:57:50.142494 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-2817ad30-d335-4b9b-8426-2f2d0616270d tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] [instance: 70bf65cf-55e2-459a-aaf1-c3eb851a6ccf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:50.153196 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2817ad30-d335-4b9b-8426-2f2d0616270d tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:50.157732 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2817ad30-d335-4b9b-8426-2f2d0616270d tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:50.160660 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2817ad30-d335-4b9b-8426-2f2d0616270d tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:50.161396 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2817ad30-d335-4b9b-8426-2f2d0616270d tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:50.206235 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-a45d003a-60f0-4c18-93e4-b90a7f36cf54 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:57:50.219750 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a45d003a-60f0-4c18-93e4-b90a7f36cf54 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/deef57f9-d933-48ad-a051-e782593799bf" status: 200 len: 1315 microversion: 2.1 time: 0.321334 Jan 15 20:57:50.221085 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1367/2731] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:57:49 2022] GET /compute/v2.1/servers/deef57f9-d933-48ad-a051-e782593799bf => generated 1315 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:50.228744 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-56ce6e7f-eea8-4c03-9639-632ebc4caece tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:50.232343 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-56ce6e7f-eea8-4c03-9639-632ebc4caece tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] [instance: 689dd504-e36e-41d0-a461-acce91952e7e] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:50.243344 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-56ce6e7f-eea8-4c03-9639-632ebc4caece tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:50.244203 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-56ce6e7f-eea8-4c03-9639-632ebc4caece tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:50.245065 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-56ce6e7f-eea8-4c03-9639-632ebc4caece tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:50.245513 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-56ce6e7f-eea8-4c03-9639-632ebc4caece tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:50.251118 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-2817ad30-d335-4b9b-8426-2f2d0616270d tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] 10.222.0.46 "POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action" status: 200 len: 32642 microversion: 2.1 time: 0.118850 Jan 15 20:57:50.252348 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1365/2732] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:57:50 2022] POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action => generated 32642 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:57:50.298904 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f3282815-b22a-4b12-9fbe-de37299e6aec tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Calling method '.version_select at 0x7f30c98981f0>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:50.380201 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f3282815-b22a-4b12-9fbe-de37299e6aec tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] 10.222.0.46 "GET /compute/v2.1/images/1f99b18e-87c4-42c4-834c-464b28e8793e" status: 200 len: 1452 microversion: 2.1 time: 0.090958 Jan 15 20:57:50.381721 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1366/2733] 10.222.0.46 () {58 vars in 1232 bytes} [Sat Jan 15 20:57:50 2022] GET /compute/v2.1/images/1f99b18e-87c4-42c4-834c-464b28e8793e => generated 1452 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:50.396626 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-41d7fdfb-3216-4720-9641-45e8b85ee09e tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:57:50.397870 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-41d7fdfb-3216-4720-9641-45e8b85ee09e tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] [instance: 62ae2a15-8c2c-4dad-971f-0611238103a3] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:50.426232 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-41d7fdfb-3216-4720-9641-45e8b85ee09e tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:50.426714 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-41d7fdfb-3216-4720-9641-45e8b85ee09e tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:50.434266 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-41d7fdfb-3216-4720-9641-45e8b85ee09e tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:50.434845 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-41d7fdfb-3216-4720-9641-45e8b85ee09e tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:50.490914 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-56ce6e7f-eea8-4c03-9639-632ebc4caece tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05483ff6eec84f78a091b29cfbcf61f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a6720be5fb4de7bcd77cc7ef9d8000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:57:50.504871 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-56ce6e7f-eea8-4c03-9639-632ebc4caece tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] 10.222.0.46 "GET /compute/v2.1/servers/689dd504-e36e-41d0-a461-acce91952e7e" status: 200 len: 1522 microversion: 2.1 time: 0.282329 Jan 15 20:57:50.511982 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1368/2734] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:57:50 2022] GET /compute/v2.1/servers/689dd504-e36e-41d0-a461-acce91952e7e => generated 1522 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:50.515629 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-41d7fdfb-3216-4720-9641-45e8b85ee09e tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] 10.222.0.46 "POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action" status: 200 len: 32634 microversion: 2.1 time: 0.132613 Jan 15 20:57:50.516362 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1367/2735] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:57:50 2022] POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action => generated 32634 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:57:50.723531 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5dbf2402-c18d-408d-bcfc-babd81f61cda tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:50.724150 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-5dbf2402-c18d-408d-bcfc-babd81f61cda tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] [instance: 2427a640-1c1b-49f4-a98d-bff4af6e596b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:50.733844 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5dbf2402-c18d-408d-bcfc-babd81f61cda tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:50.734552 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5dbf2402-c18d-408d-bcfc-babd81f61cda tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:50.736751 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5dbf2402-c18d-408d-bcfc-babd81f61cda tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:50.739576 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5dbf2402-c18d-408d-bcfc-babd81f61cda tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:51.245776 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ad801616-861c-47d0-923e-57c665e4ff00 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:51.245776 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ad801616-861c-47d0-923e-57c665e4ff00 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: deef57f9-d933-48ad-a051-e782593799bf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:51.246308 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-5dbf2402-c18d-408d-bcfc-babd81f61cda tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ec114f8ece434aa496cd401494e2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a05b1a0a7479db84b762eca23b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:57:51.253500 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ad801616-861c-47d0-923e-57c665e4ff00 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:51.254083 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ad801616-861c-47d0-923e-57c665e4ff00 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:51.254974 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ad801616-861c-47d0-923e-57c665e4ff00 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:51.255417 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ad801616-861c-47d0-923e-57c665e4ff00 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:51.272084 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5dbf2402-c18d-408d-bcfc-babd81f61cda tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] 10.222.0.46 "GET /compute/v2.1/servers/2427a640-1c1b-49f4-a98d-bff4af6e596b" status: 200 len: 1199 microversion: 2.1 time: 0.548206 Jan 15 20:57:51.283232 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1369/2736] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:57:50 2022] GET /compute/v2.1/servers/2427a640-1c1b-49f4-a98d-bff4af6e596b => generated 1199 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:51.309018 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5f7ed659-a70a-47c3-8b64-01ef811ded45 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:57:51.315153 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-5f7ed659-a70a-47c3-8b64-01ef811ded45 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] [instance: 70bf65cf-55e2-459a-aaf1-c3eb851a6ccf] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:51.336783 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5f7ed659-a70a-47c3-8b64-01ef811ded45 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:51.339709 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5f7ed659-a70a-47c3-8b64-01ef811ded45 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:51.340972 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5f7ed659-a70a-47c3-8b64-01ef811ded45 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:51.342553 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5f7ed659-a70a-47c3-8b64-01ef811ded45 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:51.438005 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5f7ed659-a70a-47c3-8b64-01ef811ded45 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] 10.222.0.46 "POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action" status: 200 len: 32642 microversion: 2.1 time: 0.152837 Jan 15 20:57:51.441183 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1370/2737] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:57:51 2022] POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action => generated 32642 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:57:51.458367 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-6ea93776-a96c-4c4f-adf3-9ce19403be83 req-1bce107d-5a15-47c7-bf6c-deb606eba0fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2427a640-1c1b-49f4-a98d-bff4af6e596b", "tag": "b0dcfdb5-db07-45b0-99bf-de55b9ceff10"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:57:51.462406 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:57:51.462406 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:57:51.485217 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-6ea93776-a96c-4c4f-adf3-9ce19403be83 req-1bce107d-5a15-47c7-bf6c-deb606eba0fa service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:51.487586 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-6ea93776-a96c-4c4f-adf3-9ce19403be83 req-1bce107d-5a15-47c7-bf6c-deb606eba0fa service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:51.523155 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-6ea93776-a96c-4c4f-adf3-9ce19403be83 req-1bce107d-5a15-47c7-bf6c-deb606eba0fa service nova] Creating event network-changed:b0dcfdb5-db07-45b0-99bf-de55b9ceff10 for instance 2427a640-1c1b-49f4-a98d-bff4af6e596b on nch2-master-1 Jan 15 20:57:51.554215 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-6ea93776-a96c-4c4f-adf3-9ce19403be83 req-1bce107d-5a15-47c7-bf6c-deb606eba0fa service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104950 Jan 15 20:57:51.555128 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1371/2738] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:57:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:57:51.572668 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-723afdaa-dcd9-49c8-acb0-423610d61cdf tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Calling method '.version_select at 0x7f30c8e90e50>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:51.678014 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-723afdaa-dcd9-49c8-acb0-423610d61cdf tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] 10.222.0.46 "GET /compute/v2.1/images/1f99b18e-87c4-42c4-834c-464b28e8793e" status: 200 len: 1452 microversion: 2.1 time: 0.121671 Jan 15 20:57:51.683124 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1372/2739] 10.222.0.46 () {58 vars in 1232 bytes} [Sat Jan 15 20:57:51 2022] GET /compute/v2.1/images/1f99b18e-87c4-42c4-834c-464b28e8793e => generated 1452 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:51.695543 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-1e17caff-5570-4896-b93f-30eb288473cc tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:51.711331 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-1e17caff-5570-4896-b93f-30eb288473cc tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] [instance: 689dd504-e36e-41d0-a461-acce91952e7e] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:51.746287 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1e17caff-5570-4896-b93f-30eb288473cc tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:51.746771 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1e17caff-5570-4896-b93f-30eb288473cc tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:51.757980 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1e17caff-5570-4896-b93f-30eb288473cc tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:51.781344 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1e17caff-5570-4896-b93f-30eb288473cc tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:52.505450 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-ad801616-861c-47d0-923e-57c665e4ff00 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:57:52.516558 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ad801616-861c-47d0-923e-57c665e4ff00 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/deef57f9-d933-48ad-a051-e782593799bf" status: 200 len: 1315 microversion: 2.1 time: 1.281520 Jan 15 20:57:52.528642 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1368/2740] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:57:51 2022] GET /compute/v2.1/servers/deef57f9-d933-48ad-a051-e782593799bf => generated 1315 bytes in 1295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:52.534347 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-da99bc54-8ed3-46f2-9e64-9236a4ed0102 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:57:52.535729 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-da99bc54-8ed3-46f2-9e64-9236a4ed0102 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] [instance: 62ae2a15-8c2c-4dad-971f-0611238103a3] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:52.546999 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-da99bc54-8ed3-46f2-9e64-9236a4ed0102 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:52.547957 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-da99bc54-8ed3-46f2-9e64-9236a4ed0102 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:52.549841 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-da99bc54-8ed3-46f2-9e64-9236a4ed0102 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:52.550634 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-da99bc54-8ed3-46f2-9e64-9236a4ed0102 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:52.654402 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-da99bc54-8ed3-46f2-9e64-9236a4ed0102 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] 10.222.0.46 "POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action" status: 200 len: 32634 microversion: 2.1 time: 0.122774 Jan 15 20:57:52.660354 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1369/2741] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:57:52 2022] POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action => generated 32634 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:57:52.669692 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-11a62c2b-02eb-4895-81fb-ea42c012e8bf tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:52.670706 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-11a62c2b-02eb-4895-81fb-ea42c012e8bf tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] [instance: 2427a640-1c1b-49f4-a98d-bff4af6e596b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:52.680669 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-1e17caff-5570-4896-b93f-30eb288473cc tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05483ff6eec84f78a091b29cfbcf61f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a6720be5fb4de7bcd77cc7ef9d8000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:57:52.707229 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-1e17caff-5570-4896-b93f-30eb288473cc tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] 10.222.0.46 "GET /compute/v2.1/servers/689dd504-e36e-41d0-a461-acce91952e7e" status: 200 len: 1522 microversion: 2.1 time: 1.023129 Jan 15 20:57:52.707818 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1373/2742] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:57:51 2022] GET /compute/v2.1/servers/689dd504-e36e-41d0-a461-acce91952e7e => generated 1522 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:52.719096 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-11a62c2b-02eb-4895-81fb-ea42c012e8bf tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:52.719451 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-11a62c2b-02eb-4895-81fb-ea42c012e8bf tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.040s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:52.720506 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-11a62c2b-02eb-4895-81fb-ea42c012e8bf tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:52.722067 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-11a62c2b-02eb-4895-81fb-ea42c012e8bf tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:52.740737 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-054b940e-f1cb-49d1-997b-531dfce6009a tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:57:52.756019 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-054b940e-f1cb-49d1-997b-531dfce6009a tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] [instance: 70bf65cf-55e2-459a-aaf1-c3eb851a6ccf] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:52.769155 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-054b940e-f1cb-49d1-997b-531dfce6009a tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:52.769981 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-054b940e-f1cb-49d1-997b-531dfce6009a tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:52.770931 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-054b940e-f1cb-49d1-997b-531dfce6009a tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:52.777618 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-054b940e-f1cb-49d1-997b-531dfce6009a tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:52.868450 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-054b940e-f1cb-49d1-997b-531dfce6009a tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] 10.222.0.46 "POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action" status: 200 len: 32642 microversion: 2.1 time: 0.135740 Jan 15 20:57:52.869452 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1374/2743] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:57:52 2022] POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action => generated 32642 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:57:52.879130 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-62a141aa-d417-427c-93a4-72fe7ded5cc1 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Calling method '.version_select at 0x7f30c8e02820>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:53.011534 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-62a141aa-d417-427c-93a4-72fe7ded5cc1 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] 10.222.0.46 "GET /compute/v2.1/images/1f99b18e-87c4-42c4-834c-464b28e8793e" status: 200 len: 1452 microversion: 2.1 time: 0.140323 Jan 15 20:57:53.012124 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1375/2744] 10.222.0.46 () {58 vars in 1232 bytes} [Sat Jan 15 20:57:52 2022] GET /compute/v2.1/images/1f99b18e-87c4-42c4-834c-464b28e8793e => generated 1452 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:53.297943 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-11a62c2b-02eb-4895-81fb-ea42c012e8bf tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ec114f8ece434aa496cd401494e2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a05b1a0a7479db84b762eca23b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:57:53.310368 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-11a62c2b-02eb-4895-81fb-ea42c012e8bf tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] 10.222.0.46 "GET /compute/v2.1/servers/2427a640-1c1b-49f4-a98d-bff4af6e596b" status: 200 len: 1199 microversion: 2.1 time: 0.646905 Jan 15 20:57:53.313486 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1370/2745] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:57:52 2022] GET /compute/v2.1/servers/2427a640-1c1b-49f4-a98d-bff4af6e596b => generated 1199 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:53.543731 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-6d34f412-6e17-4108-916f-72870393a144 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:53.545299 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-6d34f412-6e17-4108-916f-72870393a144 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: deef57f9-d933-48ad-a051-e782593799bf] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:53.564028 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6d34f412-6e17-4108-916f-72870393a144 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:53.566695 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6d34f412-6e17-4108-916f-72870393a144 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:53.568305 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6d34f412-6e17-4108-916f-72870393a144 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:53.569929 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6d34f412-6e17-4108-916f-72870393a144 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:53.667378 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a08fe229-1b2c-49d5-96b4-aa9661075a53 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:57:53.668474 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a08fe229-1b2c-49d5-96b4-aa9661075a53 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] [instance: 62ae2a15-8c2c-4dad-971f-0611238103a3] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:53.679001 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a08fe229-1b2c-49d5-96b4-aa9661075a53 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:53.687275 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a08fe229-1b2c-49d5-96b4-aa9661075a53 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:53.688287 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a08fe229-1b2c-49d5-96b4-aa9661075a53 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:53.688987 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a08fe229-1b2c-49d5-96b4-aa9661075a53 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:53.750011 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a08fe229-1b2c-49d5-96b4-aa9661075a53 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] 10.222.0.46 "POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action" status: 200 len: 32634 microversion: 2.1 time: 0.086689 Jan 15 20:57:53.751807 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1371/2746] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:57:53 2022] POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action => generated 32634 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:57:53.767789 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c9528dd3-8afc-47d1-91e3-9480d063acce tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:53.769676 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c9528dd3-8afc-47d1-91e3-9480d063acce tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] [instance: 689dd504-e36e-41d0-a461-acce91952e7e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:53.782480 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c9528dd3-8afc-47d1-91e3-9480d063acce tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:53.783782 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c9528dd3-8afc-47d1-91e3-9480d063acce tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:53.785796 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c9528dd3-8afc-47d1-91e3-9480d063acce tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:53.786500 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c9528dd3-8afc-47d1-91e3-9480d063acce tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:54.113453 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-6d34f412-6e17-4108-916f-72870393a144 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:57:54.122288 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-6d34f412-6e17-4108-916f-72870393a144 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/deef57f9-d933-48ad-a051-e782593799bf" status: 200 len: 1315 microversion: 2.1 time: 0.589609 Jan 15 20:57:54.142634 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1376/2747] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:57:53 2022] GET /compute/v2.1/servers/deef57f9-d933-48ad-a051-e782593799bf => generated 1315 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:54.147626 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-bb67960e-c7da-4e10-b83b-5c0598640a82 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:57:54.148670 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-bb67960e-c7da-4e10-b83b-5c0598640a82 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] [instance: 70bf65cf-55e2-459a-aaf1-c3eb851a6ccf] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:54.160381 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bb67960e-c7da-4e10-b83b-5c0598640a82 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:54.161187 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bb67960e-c7da-4e10-b83b-5c0598640a82 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:54.169966 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bb67960e-c7da-4e10-b83b-5c0598640a82 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:54.171056 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bb67960e-c7da-4e10-b83b-5c0598640a82 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:54.238729 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-bb67960e-c7da-4e10-b83b-5c0598640a82 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] 10.222.0.46 "POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action" status: 200 len: 32642 microversion: 2.1 time: 0.094629 Jan 15 20:57:54.239600 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1377/2748] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:57:54 2022] POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action => generated 32642 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:57:54.245518 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-754bfd3a-70c5-47cf-83e9-533b74f3c494 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Calling method '.version_select at 0x7f30c8fff160>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:54.314691 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-754bfd3a-70c5-47cf-83e9-533b74f3c494 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] 10.222.0.46 "GET /compute/v2.1/images/1f99b18e-87c4-42c4-834c-464b28e8793e" status: 200 len: 1452 microversion: 2.1 time: 0.072657 Jan 15 20:57:54.317729 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1378/2749] 10.222.0.46 () {58 vars in 1232 bytes} [Sat Jan 15 20:57:54 2022] GET /compute/v2.1/images/1f99b18e-87c4-42c4-834c-464b28e8793e => generated 1452 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:54.335097 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-131f6c4a-20f4-4325-888d-70b3b900258e tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:54.336205 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-131f6c4a-20f4-4325-888d-70b3b900258e tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] [instance: 2427a640-1c1b-49f4-a98d-bff4af6e596b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:54.344478 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-131f6c4a-20f4-4325-888d-70b3b900258e tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:54.347078 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-131f6c4a-20f4-4325-888d-70b3b900258e tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:54.348137 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-131f6c4a-20f4-4325-888d-70b3b900258e tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:54.348813 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-131f6c4a-20f4-4325-888d-70b3b900258e tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:54.500289 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-c9528dd3-8afc-47d1-91e3-9480d063acce tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05483ff6eec84f78a091b29cfbcf61f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a6720be5fb4de7bcd77cc7ef9d8000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:57:54.527551 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c9528dd3-8afc-47d1-91e3-9480d063acce tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] 10.222.0.46 "GET /compute/v2.1/servers/689dd504-e36e-41d0-a461-acce91952e7e" status: 200 len: 1522 microversion: 2.1 time: 0.768320 Jan 15 20:57:54.529489 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1372/2750] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:57:53 2022] GET /compute/v2.1/servers/689dd504-e36e-41d0-a461-acce91952e7e => generated 1522 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:54.765329 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-639f262e-f152-460f-93e5-4fc535ae94d8 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:57:54.767040 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-639f262e-f152-460f-93e5-4fc535ae94d8 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] [instance: 62ae2a15-8c2c-4dad-971f-0611238103a3] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:54.784190 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-639f262e-f152-460f-93e5-4fc535ae94d8 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:54.784865 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-639f262e-f152-460f-93e5-4fc535ae94d8 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:54.785941 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-639f262e-f152-460f-93e5-4fc535ae94d8 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:54.787222 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-639f262e-f152-460f-93e5-4fc535ae94d8 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:54.867022 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-639f262e-f152-460f-93e5-4fc535ae94d8 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] 10.222.0.46 "POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action" status: 200 len: 32634 microversion: 2.1 time: 0.106745 Jan 15 20:57:54.876957 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1373/2751] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:57:54 2022] POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action => generated 32634 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:57:54.926312 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-131f6c4a-20f4-4325-888d-70b3b900258e tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ec114f8ece434aa496cd401494e2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a05b1a0a7479db84b762eca23b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:57:54.938164 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-131f6c4a-20f4-4325-888d-70b3b900258e tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] 10.222.0.46 "GET /compute/v2.1/servers/2427a640-1c1b-49f4-a98d-bff4af6e596b" status: 200 len: 1199 microversion: 2.1 time: 0.611631 Jan 15 20:57:54.940176 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1379/2752] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:57:54 2022] GET /compute/v2.1/servers/2427a640-1c1b-49f4-a98d-bff4af6e596b => generated 1199 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:55.150458 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ac7a0f28-aca2-4196-96f5-ac8fe1775711 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:55.151840 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ac7a0f28-aca2-4196-96f5-ac8fe1775711 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: deef57f9-d933-48ad-a051-e782593799bf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:55.164760 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ac7a0f28-aca2-4196-96f5-ac8fe1775711 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:55.166806 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ac7a0f28-aca2-4196-96f5-ac8fe1775711 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:55.171168 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ac7a0f28-aca2-4196-96f5-ac8fe1775711 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:55.171746 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ac7a0f28-aca2-4196-96f5-ac8fe1775711 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:55.253545 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-fed1a614-7bee-4e0e-828d-fc22f2050862 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:57:55.254719 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-fed1a614-7bee-4e0e-828d-fc22f2050862 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] [instance: 70bf65cf-55e2-459a-aaf1-c3eb851a6ccf] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:55.270764 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fed1a614-7bee-4e0e-828d-fc22f2050862 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:55.271212 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fed1a614-7bee-4e0e-828d-fc22f2050862 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:55.272230 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fed1a614-7bee-4e0e-828d-fc22f2050862 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:55.272893 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fed1a614-7bee-4e0e-828d-fc22f2050862 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:55.371356 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-fed1a614-7bee-4e0e-828d-fc22f2050862 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] 10.222.0.46 "POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action" status: 200 len: 32642 microversion: 2.1 time: 0.119630 Jan 15 20:57:55.373001 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1380/2753] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:57:55 2022] POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action => generated 32642 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:57:55.380280 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ab521b3e-746e-495d-b117-02d03d5e2dff tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Calling method '.version_select at 0x7f30c8e020d0>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:55.437531 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ab521b3e-746e-495d-b117-02d03d5e2dff tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] 10.222.0.46 "GET /compute/v2.1/images/1f99b18e-87c4-42c4-834c-464b28e8793e" status: 200 len: 1452 microversion: 2.1 time: 0.062037 Jan 15 20:57:55.438400 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1381/2754] 10.222.0.46 () {58 vars in 1232 bytes} [Sat Jan 15 20:57:55 2022] GET /compute/v2.1/images/1f99b18e-87c4-42c4-834c-464b28e8793e => generated 1452 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:55.547602 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-db051fc1-ac75-46ec-89e2-2a4f134ccc9a tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:55.549664 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-db051fc1-ac75-46ec-89e2-2a4f134ccc9a tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] [instance: 689dd504-e36e-41d0-a461-acce91952e7e] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:55.563342 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-db051fc1-ac75-46ec-89e2-2a4f134ccc9a tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:55.566918 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-db051fc1-ac75-46ec-89e2-2a4f134ccc9a tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:55.570793 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-db051fc1-ac75-46ec-89e2-2a4f134ccc9a tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:55.573462 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-db051fc1-ac75-46ec-89e2-2a4f134ccc9a tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:55.765142 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-ac7a0f28-aca2-4196-96f5-ac8fe1775711 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:57:55.788702 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ac7a0f28-aca2-4196-96f5-ac8fe1775711 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/deef57f9-d933-48ad-a051-e782593799bf" status: 200 len: 1315 microversion: 2.1 time: 0.642531 Jan 15 20:57:55.794388 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1374/2755] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:57:55 2022] GET /compute/v2.1/servers/deef57f9-d933-48ad-a051-e782593799bf => generated 1315 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:55.883759 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-fe8bd55f-309b-4859-b7ba-1cd73a4a78ea tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:57:55.886339 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-fe8bd55f-309b-4859-b7ba-1cd73a4a78ea tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] [instance: 62ae2a15-8c2c-4dad-971f-0611238103a3] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:55.905437 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fe8bd55f-309b-4859-b7ba-1cd73a4a78ea tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:55.907290 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fe8bd55f-309b-4859-b7ba-1cd73a4a78ea tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:55.908601 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fe8bd55f-309b-4859-b7ba-1cd73a4a78ea tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:55.909090 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fe8bd55f-309b-4859-b7ba-1cd73a4a78ea tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:56.000329 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-fe8bd55f-309b-4859-b7ba-1cd73a4a78ea tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] 10.222.0.46 "POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action" status: 200 len: 32634 microversion: 2.1 time: 0.121528 Jan 15 20:57:56.001724 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1375/2756] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:57:55 2022] POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action => generated 32634 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:57:56.012078 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-90e15fb4-38f1-41fa-86b2-116e59a66005 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:56.012944 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-90e15fb4-38f1-41fa-86b2-116e59a66005 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] [instance: 2427a640-1c1b-49f4-a98d-bff4af6e596b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:56.031584 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-90e15fb4-38f1-41fa-86b2-116e59a66005 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:56.032037 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-90e15fb4-38f1-41fa-86b2-116e59a66005 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:56.033670 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-90e15fb4-38f1-41fa-86b2-116e59a66005 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:56.034407 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-90e15fb4-38f1-41fa-86b2-116e59a66005 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:56.083287 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-db051fc1-ac75-46ec-89e2-2a4f134ccc9a tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05483ff6eec84f78a091b29cfbcf61f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a6720be5fb4de7bcd77cc7ef9d8000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:57:56.096149 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-db051fc1-ac75-46ec-89e2-2a4f134ccc9a tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] 10.222.0.46 "GET /compute/v2.1/servers/689dd504-e36e-41d0-a461-acce91952e7e" status: 200 len: 1522 microversion: 2.1 time: 0.553874 Jan 15 20:57:56.096748 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1382/2757] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:57:55 2022] GET /compute/v2.1/servers/689dd504-e36e-41d0-a461-acce91952e7e => generated 1522 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:56.109934 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-a71bc32f-f8d9-48b4-afc8-d5008ead1d4e req-b2d7adf8-1c5c-4d0c-990e-457837bfb61c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "deef57f9-d933-48ad-a051-e782593799bf", "name": "network-vif-plugged", "status": "completed", "tag": "00278b05-3736-45fa-b8cc-cc991355aa9a"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:57:56.111540 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:57:56.111540 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:57:56.147864 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-a71bc32f-f8d9-48b4-afc8-d5008ead1d4e req-b2d7adf8-1c5c-4d0c-990e-457837bfb61c service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:56.148684 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-a71bc32f-f8d9-48b4-afc8-d5008ead1d4e req-b2d7adf8-1c5c-4d0c-990e-457837bfb61c service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:56.169270 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-a71bc32f-f8d9-48b4-afc8-d5008ead1d4e req-b2d7adf8-1c5c-4d0c-990e-457837bfb61c service nova] Creating event network-vif-plugged:00278b05-3736-45fa-b8cc-cc991355aa9a for instance deef57f9-d933-48ad-a051-e782593799bf on nch1-master-1 Jan 15 20:57:56.176067 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-a71bc32f-f8d9-48b4-afc8-d5008ead1d4e req-b2d7adf8-1c5c-4d0c-990e-457837bfb61c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077801 Jan 15 20:57:56.177070 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1383/2758] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:57:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:57:56.396170 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-366d0245-b097-43c9-af5d-6bea7804af14 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:57:56.399269 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-366d0245-b097-43c9-af5d-6bea7804af14 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] [instance: 70bf65cf-55e2-459a-aaf1-c3eb851a6ccf] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:56.409603 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-366d0245-b097-43c9-af5d-6bea7804af14 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:56.410590 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-366d0245-b097-43c9-af5d-6bea7804af14 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:56.411599 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-366d0245-b097-43c9-af5d-6bea7804af14 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:56.412258 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-366d0245-b097-43c9-af5d-6bea7804af14 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:56.419211 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-90e15fb4-38f1-41fa-86b2-116e59a66005 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ec114f8ece434aa496cd401494e2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a05b1a0a7479db84b762eca23b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:57:56.433532 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-90e15fb4-38f1-41fa-86b2-116e59a66005 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] 10.222.0.46 "GET /compute/v2.1/servers/2427a640-1c1b-49f4-a98d-bff4af6e596b" status: 200 len: 1199 microversion: 2.1 time: 0.430440 Jan 15 20:57:56.437122 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1376/2759] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:57:56 2022] GET /compute/v2.1/servers/2427a640-1c1b-49f4-a98d-bff4af6e596b => generated 1199 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:56.454937 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d1525933-1194-418e-a98f-c021b0ee26ed tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Calling method '.version_select at 0x7f30c91a6820>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:56.470245 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-366d0245-b097-43c9-af5d-6bea7804af14 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] 10.222.0.46 "POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action" status: 200 len: 32642 microversion: 2.1 time: 0.088082 Jan 15 20:57:56.480504 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1384/2760] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:57:56 2022] POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action => generated 32642 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 20:57:56.533885 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d1525933-1194-418e-a98f-c021b0ee26ed tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] 10.222.0.46 "GET /compute/v2.1/images/1f99b18e-87c4-42c4-834c-464b28e8793e" status: 200 len: 1452 microversion: 2.1 time: 0.085690 Jan 15 20:57:56.541164 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1377/2761] 10.222.0.46 () {58 vars in 1232 bytes} [Sat Jan 15 20:57:56 2022] GET /compute/v2.1/images/1f99b18e-87c4-42c4-834c-464b28e8793e => generated 1452 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:56.812126 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-7062ee6d-18c1-4b9d-8d92-cd4bdba38d6c tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:56.813183 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-7062ee6d-18c1-4b9d-8d92-cd4bdba38d6c tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: deef57f9-d933-48ad-a051-e782593799bf] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:56.832663 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7062ee6d-18c1-4b9d-8d92-cd4bdba38d6c tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:56.833150 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7062ee6d-18c1-4b9d-8d92-cd4bdba38d6c tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:56.839338 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7062ee6d-18c1-4b9d-8d92-cd4bdba38d6c tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:56.839956 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7062ee6d-18c1-4b9d-8d92-cd4bdba38d6c tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:57.012338 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f69f47ad-07fd-49c2-94d6-8ed6e62d7b83 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:57:57.014529 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f69f47ad-07fd-49c2-94d6-8ed6e62d7b83 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] [instance: 62ae2a15-8c2c-4dad-971f-0611238103a3] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:57.029064 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f69f47ad-07fd-49c2-94d6-8ed6e62d7b83 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:57.036543 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f69f47ad-07fd-49c2-94d6-8ed6e62d7b83 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:57.039923 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f69f47ad-07fd-49c2-94d6-8ed6e62d7b83 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:57.042415 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f69f47ad-07fd-49c2-94d6-8ed6e62d7b83 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:57.131439 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-7062ee6d-18c1-4b9d-8d92-cd4bdba38d6c tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:57:57.144436 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-7062ee6d-18c1-4b9d-8d92-cd4bdba38d6c tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/deef57f9-d933-48ad-a051-e782593799bf" status: 200 len: 1315 microversion: 2.1 time: 0.336576 Jan 15 20:57:57.145342 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1385/2762] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:57:56 2022] GET /compute/v2.1/servers/deef57f9-d933-48ad-a051-e782593799bf => generated 1315 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:57.151057 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f69f47ad-07fd-49c2-94d6-8ed6e62d7b83 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] 10.222.0.46 "POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action" status: 200 len: 32634 microversion: 2.1 time: 0.141784 Jan 15 20:57:57.151740 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1378/2763] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:57:57 2022] POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action => generated 32634 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 20:57:57.162011 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3d41d40f-c1bd-4e49-aff8-84792a0a6735 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:57.169954 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-3d41d40f-c1bd-4e49-aff8-84792a0a6735 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] [instance: 689dd504-e36e-41d0-a461-acce91952e7e] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:57.176423 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3d41d40f-c1bd-4e49-aff8-84792a0a6735 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:57.184315 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3d41d40f-c1bd-4e49-aff8-84792a0a6735 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:57.186377 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3d41d40f-c1bd-4e49-aff8-84792a0a6735 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:57.187270 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3d41d40f-c1bd-4e49-aff8-84792a0a6735 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:57.457698 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b4638687-7a2a-4c4d-a742-7e6e8d06959e tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:57.458372 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b4638687-7a2a-4c4d-a742-7e6e8d06959e tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] [instance: 2427a640-1c1b-49f4-a98d-bff4af6e596b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:57.472595 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b4638687-7a2a-4c4d-a742-7e6e8d06959e tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:57.474844 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b4638687-7a2a-4c4d-a742-7e6e8d06959e tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:57.475730 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b4638687-7a2a-4c4d-a742-7e6e8d06959e tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:57.476173 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b4638687-7a2a-4c4d-a742-7e6e8d06959e tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:58.130496 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-3d41d40f-c1bd-4e49-aff8-84792a0a6735 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05483ff6eec84f78a091b29cfbcf61f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a6720be5fb4de7bcd77cc7ef9d8000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:57:58.139643 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3d41d40f-c1bd-4e49-aff8-84792a0a6735 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] 10.222.0.46 "GET /compute/v2.1/servers/689dd504-e36e-41d0-a461-acce91952e7e" status: 200 len: 1522 microversion: 2.1 time: 0.988591 Jan 15 20:57:58.149272 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1386/2764] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:57:57 2022] GET /compute/v2.1/servers/689dd504-e36e-41d0-a461-acce91952e7e => generated 1522 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:58.152703 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e48ab47e-c322-4a17-ad5e-18e4283288b3 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:57:58.155348 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e48ab47e-c322-4a17-ad5e-18e4283288b3 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] [instance: 70bf65cf-55e2-459a-aaf1-c3eb851a6ccf] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:58.176596 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e48ab47e-c322-4a17-ad5e-18e4283288b3 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:58.177224 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e48ab47e-c322-4a17-ad5e-18e4283288b3 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:58.177908 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e48ab47e-c322-4a17-ad5e-18e4283288b3 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:58.178347 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e48ab47e-c322-4a17-ad5e-18e4283288b3 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:58.258052 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e48ab47e-c322-4a17-ad5e-18e4283288b3 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] 10.222.0.46 "POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action" status: 200 len: 32642 microversion: 2.1 time: 0.109475 Jan 15 20:57:58.259569 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1387/2765] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:57:58 2022] POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action => generated 32642 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:57:58.265068 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e27c2374-0741-461a-ae18-53ad4952e0a9 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Calling method '.version_select at 0x7f30c8eb1af0>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:58.360144 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e27c2374-0741-461a-ae18-53ad4952e0a9 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] 10.222.0.46 "GET /compute/v2.1/images/1f99b18e-87c4-42c4-834c-464b28e8793e" status: 200 len: 1452 microversion: 2.1 time: 0.099125 Jan 15 20:57:58.362321 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1388/2766] 10.222.0.46 () {58 vars in 1232 bytes} [Sat Jan 15 20:57:58 2022] GET /compute/v2.1/images/1f99b18e-87c4-42c4-834c-464b28e8793e => generated 1452 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:58.369987 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-eb59adec-04d9-4cc6-861b-25f9022868c6 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:58.372729 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-eb59adec-04d9-4cc6-861b-25f9022868c6 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: deef57f9-d933-48ad-a051-e782593799bf] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:58.391435 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-eb59adec-04d9-4cc6-861b-25f9022868c6 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:58.392165 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-eb59adec-04d9-4cc6-861b-25f9022868c6 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:58.393267 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-eb59adec-04d9-4cc6-861b-25f9022868c6 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:58.393889 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-eb59adec-04d9-4cc6-861b-25f9022868c6 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:58.404410 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-b4638687-7a2a-4c4d-a742-7e6e8d06959e tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ec114f8ece434aa496cd401494e2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a05b1a0a7479db84b762eca23b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:57:58.433483 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b4638687-7a2a-4c4d-a742-7e6e8d06959e tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] 10.222.0.46 "GET /compute/v2.1/servers/2427a640-1c1b-49f4-a98d-bff4af6e596b" status: 200 len: 1199 microversion: 2.1 time: 0.969222 Jan 15 20:57:58.444952 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1379/2767] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:57:57 2022] GET /compute/v2.1/servers/2427a640-1c1b-49f4-a98d-bff4af6e596b => generated 1199 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:58.468062 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-5e67e177-dbbc-4589-8f80-245cebff1237 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:57:58.469238 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-5e67e177-dbbc-4589-8f80-245cebff1237 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] [instance: 62ae2a15-8c2c-4dad-971f-0611238103a3] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:58.487515 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5e67e177-dbbc-4589-8f80-245cebff1237 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:58.487981 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5e67e177-dbbc-4589-8f80-245cebff1237 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:58.488771 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5e67e177-dbbc-4589-8f80-245cebff1237 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:58.504132 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5e67e177-dbbc-4589-8f80-245cebff1237 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:58.594893 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-5e67e177-dbbc-4589-8f80-245cebff1237 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] 10.222.0.46 "POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action" status: 200 len: 32634 microversion: 2.1 time: 0.148510 Jan 15 20:57:58.603392 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1380/2768] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:57:58 2022] POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action => generated 32634 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:57:58.981981 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-eb59adec-04d9-4cc6-861b-25f9022868c6 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:57:58.990096 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-eb59adec-04d9-4cc6-861b-25f9022868c6 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/deef57f9-d933-48ad-a051-e782593799bf" status: 200 len: 1501 microversion: 2.1 time: 0.626002 Jan 15 20:57:58.990682 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1389/2769] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:57:58 2022] GET /compute/v2.1/servers/deef57f9-d933-48ad-a051-e782593799bf => generated 1501 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:57:59.014467 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a46e31d6-d5c5-4ec8-ac77-2778801c7708 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:57:59.021908 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a46e31d6-d5c5-4ec8-ac77-2778801c7708 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:59.026806 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a46e31d6-d5c5-4ec8-ac77-2778801c7708 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:59.099439 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a46e31d6-d5c5-4ec8-ac77-2778801c7708 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: deef57f9-d933-48ad-a051-e782593799bf] Going to try to stop instance {{(pid=129366) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Jan 15 20:57:59.157166 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-93dff378-0085-46fd-902b-1f952d0c6e9e tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:59.158602 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-93dff378-0085-46fd-902b-1f952d0c6e9e tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] [instance: 689dd504-e36e-41d0-a461-acce91952e7e] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:59.179164 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-93dff378-0085-46fd-902b-1f952d0c6e9e tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:59.180384 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-93dff378-0085-46fd-902b-1f952d0c6e9e tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:59.181648 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-93dff378-0085-46fd-902b-1f952d0c6e9e tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:59.188172 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-93dff378-0085-46fd-902b-1f952d0c6e9e tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:59.261605 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a46e31d6-d5c5-4ec8-ac77-2778801c7708 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "POST /compute/v2.1/servers/deef57f9-d933-48ad-a051-e782593799bf/action" status: 202 len: 0 microversion: 2.1 time: 0.251408 Jan 15 20:57:59.270122 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1381/2770] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:57:59 2022] POST /compute/v2.1/servers/deef57f9-d933-48ad-a051-e782593799bf/action => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 20:57:59.277563 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ec6ab7e2-0854-402b-891a-6c21fc2f522f tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:57:59.278887 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ec6ab7e2-0854-402b-891a-6c21fc2f522f tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] [instance: 70bf65cf-55e2-459a-aaf1-c3eb851a6ccf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:59.289053 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ec6ab7e2-0854-402b-891a-6c21fc2f522f tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:59.290277 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ec6ab7e2-0854-402b-891a-6c21fc2f522f tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:59.291682 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ec6ab7e2-0854-402b-891a-6c21fc2f522f tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:59.292339 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ec6ab7e2-0854-402b-891a-6c21fc2f522f tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:59.349311 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ec6ab7e2-0854-402b-891a-6c21fc2f522f tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] 10.222.0.46 "POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action" status: 200 len: 32642 microversion: 2.1 time: 0.077073 Jan 15 20:57:59.357378 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1382/2771] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:57:59 2022] POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action => generated 32642 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:57:59.387268 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-91a1f211-b1b8-4e4f-83bc-52af5e42db38 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:57:59.388620 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-91a1f211-b1b8-4e4f-83bc-52af5e42db38 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: deef57f9-d933-48ad-a051-e782593799bf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:57:59.420871 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-91a1f211-b1b8-4e4f-83bc-52af5e42db38 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:59.428795 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-91a1f211-b1b8-4e4f-83bc-52af5e42db38 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:57:59.437832 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-91a1f211-b1b8-4e4f-83bc-52af5e42db38 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:57:59.438398 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-91a1f211-b1b8-4e4f-83bc-52af5e42db38 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:00.004164 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-93dff378-0085-46fd-902b-1f952d0c6e9e tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05483ff6eec84f78a091b29cfbcf61f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a6720be5fb4de7bcd77cc7ef9d8000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:00.011966 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-93dff378-0085-46fd-902b-1f952d0c6e9e tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] 10.222.0.46 "GET /compute/v2.1/servers/689dd504-e36e-41d0-a461-acce91952e7e" status: 200 len: 1522 microversion: 2.1 time: 0.858720 Jan 15 20:58:00.033278 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1390/2772] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:57:59 2022] GET /compute/v2.1/servers/689dd504-e36e-41d0-a461-acce91952e7e => generated 1522 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:00.038479 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-89709aed-9b5f-4214-b89c-742a906f5c8e tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Calling method '.version_select at 0x7f30c8ed2040>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:00.105768 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-89709aed-9b5f-4214-b89c-742a906f5c8e tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] 10.222.0.46 "GET /compute/v2.1/images/1f99b18e-87c4-42c4-834c-464b28e8793e" status: 200 len: 1452 microversion: 2.1 time: 0.070887 Jan 15 20:58:00.109574 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1391/2773] 10.222.0.46 () {58 vars in 1232 bytes} [Sat Jan 15 20:58:00 2022] GET /compute/v2.1/images/1f99b18e-87c4-42c4-834c-464b28e8793e => generated 1452 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:00.114362 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-1981627c-9700-436b-8e7c-3f027e2138a4 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:00.119638 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-1981627c-9700-436b-8e7c-3f027e2138a4 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] [instance: 2427a640-1c1b-49f4-a98d-bff4af6e596b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:00.139130 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1981627c-9700-436b-8e7c-3f027e2138a4 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:00.147362 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1981627c-9700-436b-8e7c-3f027e2138a4 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:00.148661 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1981627c-9700-436b-8e7c-3f027e2138a4 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:00.149300 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1981627c-9700-436b-8e7c-3f027e2138a4 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:00.401604 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-91a1f211-b1b8-4e4f-83bc-52af5e42db38 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:00.410547 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-91a1f211-b1b8-4e4f-83bc-52af5e42db38 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/deef57f9-d933-48ad-a051-e782593799bf" status: 200 len: 1511 microversion: 2.1 time: 1.051500 Jan 15 20:58:00.413532 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1383/2774] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:57:59 2022] GET /compute/v2.1/servers/deef57f9-d933-48ad-a051-e782593799bf => generated 1511 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:00.424347 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-067239b1-f255-4ade-8af1-93a3e75cd03f tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:58:00.433346 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-067239b1-f255-4ade-8af1-93a3e75cd03f tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] [instance: 62ae2a15-8c2c-4dad-971f-0611238103a3] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:00.453248 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-067239b1-f255-4ade-8af1-93a3e75cd03f tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:00.454279 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-067239b1-f255-4ade-8af1-93a3e75cd03f tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:00.455328 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-067239b1-f255-4ade-8af1-93a3e75cd03f tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:00.455991 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-067239b1-f255-4ade-8af1-93a3e75cd03f tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:00.546496 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-067239b1-f255-4ade-8af1-93a3e75cd03f tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] 10.222.0.46 "POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action" status: 200 len: 32634 microversion: 2.1 time: 0.130945 Jan 15 20:58:00.550802 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1384/2775] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:58:00 2022] POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action => generated 32634 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:58:00.564800 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ae92232f-95f1-45d3-986a-9bd754c9d41a tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:58:00.577769 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ae92232f-95f1-45d3-986a-9bd754c9d41a tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] [instance: 70bf65cf-55e2-459a-aaf1-c3eb851a6ccf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:00.596518 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ae92232f-95f1-45d3-986a-9bd754c9d41a tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:00.597416 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ae92232f-95f1-45d3-986a-9bd754c9d41a tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:00.598391 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ae92232f-95f1-45d3-986a-9bd754c9d41a tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:00.598997 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ae92232f-95f1-45d3-986a-9bd754c9d41a tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:00.692484 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ae92232f-95f1-45d3-986a-9bd754c9d41a tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] 10.222.0.46 "POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action" status: 200 len: 32642 microversion: 2.1 time: 0.140023 Jan 15 20:58:00.693481 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1385/2776] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:58:00 2022] POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action => generated 32642 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:58:00.854103 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-1981627c-9700-436b-8e7c-3f027e2138a4 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ec114f8ece434aa496cd401494e2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a05b1a0a7479db84b762eca23b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:00.871226 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-1981627c-9700-436b-8e7c-3f027e2138a4 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] 10.222.0.46 "GET /compute/v2.1/servers/2427a640-1c1b-49f4-a98d-bff4af6e596b" status: 200 len: 1199 microversion: 2.1 time: 0.760076 Jan 15 20:58:00.875735 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1392/2777] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:00 2022] GET /compute/v2.1/servers/2427a640-1c1b-49f4-a98d-bff4af6e596b => generated 1199 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:01.030513 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-3bfd0605-8464-4f6e-b45b-7619e391a7e3 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:01.031222 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-3bfd0605-8464-4f6e-b45b-7619e391a7e3 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] [instance: 689dd504-e36e-41d0-a461-acce91952e7e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:01.039753 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3bfd0605-8464-4f6e-b45b-7619e391a7e3 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:01.040636 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3bfd0605-8464-4f6e-b45b-7619e391a7e3 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:01.053155 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3bfd0605-8464-4f6e-b45b-7619e391a7e3 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:01.054459 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3bfd0605-8464-4f6e-b45b-7619e391a7e3 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:01.123185 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-dbe66e60-42b1-46ff-ae8b-117bb4b57915 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Calling method '.version_select at 0x7f30c8e02310>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:01.203464 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-dbe66e60-42b1-46ff-ae8b-117bb4b57915 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] 10.222.0.46 "GET /compute/v2.1/images/1f99b18e-87c4-42c4-834c-464b28e8793e" status: 200 len: 1461 microversion: 2.1 time: 0.084184 Jan 15 20:58:01.210075 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1393/2778] 10.222.0.46 () {58 vars in 1232 bytes} [Sat Jan 15 20:58:01 2022] GET /compute/v2.1/images/1f99b18e-87c4-42c4-834c-464b28e8793e => generated 1461 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:01.215067 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-996c6ade-6182-4e62-bbc7-f6838cb9a48f tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Calling method '.version_select at 0x7f30c8ffff70>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:01.287068 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-996c6ade-6182-4e62-bbc7-f6838cb9a48f tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] 10.222.0.46 "GET /compute/v2.1/images/1f99b18e-87c4-42c4-834c-464b28e8793e" status: 200 len: 1461 microversion: 2.1 time: 0.075022 Jan 15 20:58:01.287822 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1394/2779] 10.222.0.46 () {58 vars in 1232 bytes} [Sat Jan 15 20:58:01 2022] GET /compute/v2.1/images/1f99b18e-87c4-42c4-834c-464b28e8793e => generated 1461 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:58:01.304428 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-7a7d301a-569d-4a3a-8ebc-d20dce7def21 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:01.305088 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-7a7d301a-569d-4a3a-8ebc-d20dce7def21 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] [instance: bffd829f-bc6e-40a7-a9d8-59af77e5b10d] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:01.320660 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7a7d301a-569d-4a3a-8ebc-d20dce7def21 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:01.321991 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7a7d301a-569d-4a3a-8ebc-d20dce7def21 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:01.323299 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7a7d301a-569d-4a3a-8ebc-d20dce7def21 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:01.325124 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7a7d301a-569d-4a3a-8ebc-d20dce7def21 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:01.472935 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-3bfd0605-8464-4f6e-b45b-7619e391a7e3 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05483ff6eec84f78a091b29cfbcf61f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a6720be5fb4de7bcd77cc7ef9d8000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:01.494152 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-3bfd0605-8464-4f6e-b45b-7619e391a7e3 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] 10.222.0.46 "GET /compute/v2.1/servers/689dd504-e36e-41d0-a461-acce91952e7e" status: 200 len: 1522 microversion: 2.1 time: 0.466897 Jan 15 20:58:01.507680 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1386/2780] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:01 2022] GET /compute/v2.1/servers/689dd504-e36e-41d0-a461-acce91952e7e => generated 1522 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:01.522319 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b73525e3-0c99-4725-bacd-8af173298993 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:01.522950 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b73525e3-0c99-4725-bacd-8af173298993 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: deef57f9-d933-48ad-a051-e782593799bf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:01.541593 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b73525e3-0c99-4725-bacd-8af173298993 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:01.544632 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b73525e3-0c99-4725-bacd-8af173298993 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:01.546858 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b73525e3-0c99-4725-bacd-8af173298993 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:01.548790 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b73525e3-0c99-4725-bacd-8af173298993 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:01.804019 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-7a7d301a-569d-4a3a-8ebc-d20dce7def21 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52bd234a49b24c1a8bb60ad42c0db262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb6e08a94bc415fada171a2eca3e7ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:01.828681 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-7a7d301a-569d-4a3a-8ebc-d20dce7def21 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] 10.222.0.46 "GET /compute/v2.1/servers/bffd829f-bc6e-40a7-a9d8-59af77e5b10d" status: 200 len: 1480 microversion: 2.1 time: 0.522312 Jan 15 20:58:01.842711 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1395/2781] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:01 2022] GET /compute/v2.1/servers/bffd829f-bc6e-40a7-a9d8-59af77e5b10d => generated 1480 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:01.848383 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-a67ea775-e147-4344-9323-73381645e180 req-9c24119e-6f5f-410e-af01-0ebd312826b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2427a640-1c1b-49f4-a98d-bff4af6e596b", "name": "network-vif-plugged", "status": "completed", "tag": "b0dcfdb5-db07-45b0-99bf-de55b9ceff10"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:58:01.869435 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:58:01.869435 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:58:01.913708 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-a67ea775-e147-4344-9323-73381645e180 req-9c24119e-6f5f-410e-af01-0ebd312826b5 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:01.915688 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-a67ea775-e147-4344-9323-73381645e180 req-9c24119e-6f5f-410e-af01-0ebd312826b5 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:01.949211 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-a67ea775-e147-4344-9323-73381645e180 req-9c24119e-6f5f-410e-af01-0ebd312826b5 service nova] Creating event network-vif-plugged:b0dcfdb5-db07-45b0-99bf-de55b9ceff10 for instance 2427a640-1c1b-49f4-a98d-bff4af6e596b on nch2-master-1 Jan 15 20:58:01.954353 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-a67ea775-e147-4344-9323-73381645e180 req-9c24119e-6f5f-410e-af01-0ebd312826b5 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109446 Jan 15 20:58:01.961154 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1396/2782] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:58:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:58:01.974431 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3cde538b-5c6d-4992-8655-98f87fec89f3 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:58:01.978705 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-3cde538b-5c6d-4992-8655-98f87fec89f3 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] [instance: 62ae2a15-8c2c-4dad-971f-0611238103a3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:01.996608 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3cde538b-5c6d-4992-8655-98f87fec89f3 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:01.999773 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3cde538b-5c6d-4992-8655-98f87fec89f3 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:02.001662 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3cde538b-5c6d-4992-8655-98f87fec89f3 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:02.002332 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3cde538b-5c6d-4992-8655-98f87fec89f3 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:02.059140 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-b73525e3-0c99-4725-bacd-8af173298993 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:02.067186 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b73525e3-0c99-4725-bacd-8af173298993 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/deef57f9-d933-48ad-a051-e782593799bf" status: 200 len: 1511 microversion: 2.1 time: 0.556172 Jan 15 20:58:02.073955 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1387/2783] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:01 2022] GET /compute/v2.1/servers/deef57f9-d933-48ad-a051-e782593799bf => generated 1511 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:02.085690 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-241f1344-be08-4b41-b826-36e7af3b8186 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:58:02.089108 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-241f1344-be08-4b41-b826-36e7af3b8186 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] [instance: 70bf65cf-55e2-459a-aaf1-c3eb851a6ccf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:02.098978 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-241f1344-be08-4b41-b826-36e7af3b8186 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:02.099928 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-241f1344-be08-4b41-b826-36e7af3b8186 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:02.101105 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-241f1344-be08-4b41-b826-36e7af3b8186 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:02.102088 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-241f1344-be08-4b41-b826-36e7af3b8186 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:02.105751 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3cde538b-5c6d-4992-8655-98f87fec89f3 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] 10.222.0.46 "POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action" status: 200 len: 32634 microversion: 2.1 time: 0.141272 Jan 15 20:58:02.109935 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1397/2784] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:58:01 2022] POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action => generated 32634 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:58:02.121689 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c5d74b37-b829-4d96-ba8a-6c450b5dd168 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:02.122695 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c5d74b37-b829-4d96-ba8a-6c450b5dd168 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] [instance: 2427a640-1c1b-49f4-a98d-bff4af6e596b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:02.141311 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c5d74b37-b829-4d96-ba8a-6c450b5dd168 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:02.141896 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c5d74b37-b829-4d96-ba8a-6c450b5dd168 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:02.145609 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c5d74b37-b829-4d96-ba8a-6c450b5dd168 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:02.146316 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c5d74b37-b829-4d96-ba8a-6c450b5dd168 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:02.161415 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-241f1344-be08-4b41-b826-36e7af3b8186 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] 10.222.0.46 "POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action" status: 200 len: 32642 microversion: 2.1 time: 0.085372 Jan 15 20:58:02.162905 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1388/2785] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:58:02 2022] POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action => generated 32642 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:58:02.463665 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-c5d74b37-b829-4d96-ba8a-6c450b5dd168 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ec114f8ece434aa496cd401494e2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a05b1a0a7479db84b762eca23b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:02.473754 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c5d74b37-b829-4d96-ba8a-6c450b5dd168 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] 10.222.0.46 "GET /compute/v2.1/servers/2427a640-1c1b-49f4-a98d-bff4af6e596b" status: 200 len: 1199 microversion: 2.1 time: 0.362243 Jan 15 20:58:02.475090 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1398/2786] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:02 2022] GET /compute/v2.1/servers/2427a640-1c1b-49f4-a98d-bff4af6e596b => generated 1199 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:02.515123 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-80be6dd8-1754-4629-ba90-ac1238d8dff2 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:02.516056 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-80be6dd8-1754-4629-ba90-ac1238d8dff2 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] [instance: 689dd504-e36e-41d0-a461-acce91952e7e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:02.533694 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-80be6dd8-1754-4629-ba90-ac1238d8dff2 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:02.536500 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-80be6dd8-1754-4629-ba90-ac1238d8dff2 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:02.538580 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-80be6dd8-1754-4629-ba90-ac1238d8dff2 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:02.539408 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-80be6dd8-1754-4629-ba90-ac1238d8dff2 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:02.763021 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-1b770cb2-546e-439d-97e8-05f74d9860ae tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Action: 'create', calling method: .version_select at 0x7f30c91b1940>, body: {"keypair": {"name": "tempest-keypair-617238005"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:58:02.764558 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-80be6dd8-1754-4629-ba90-ac1238d8dff2 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05483ff6eec84f78a091b29cfbcf61f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a6720be5fb4de7bcd77cc7ef9d8000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:02.780366 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-1b770cb2-546e-439d-97e8-05f74d9860ae tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Getting quotas for project e3a611cade394cb288f103fcf516e4ab. Resources: {'key_pairs'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:58:02.782186 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-80be6dd8-1754-4629-ba90-ac1238d8dff2 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] 10.222.0.46 "GET /compute/v2.1/servers/689dd504-e36e-41d0-a461-acce91952e7e" status: 200 len: 1522 microversion: 2.1 time: 0.273571 Jan 15 20:58:02.785421 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1389/2787] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:02 2022] GET /compute/v2.1/servers/689dd504-e36e-41d0-a461-acce91952e7e => generated 1522 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:02.793778 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-1b770cb2-546e-439d-97e8-05f74d9860ae tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Getting quotas for user 7f1ee75d18ae4db8825653f6e8180b72 and project e3a611cade394cb288f103fcf516e4ab. Resources: {'key_pairs'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:58:02.849080 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-61a7cf7a-a95a-4aa6-9bf8-d24a26e7e592 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:02.849764 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-61a7cf7a-a95a-4aa6-9bf8-d24a26e7e592 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] [instance: bffd829f-bc6e-40a7-a9d8-59af77e5b10d] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:02.856647 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-61a7cf7a-a95a-4aa6-9bf8-d24a26e7e592 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:02.857154 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-61a7cf7a-a95a-4aa6-9bf8-d24a26e7e592 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:02.857969 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-61a7cf7a-a95a-4aa6-9bf8-d24a26e7e592 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:02.858597 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-61a7cf7a-a95a-4aa6-9bf8-d24a26e7e592 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:03.120491 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-61a7cf7a-a95a-4aa6-9bf8-d24a26e7e592 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52bd234a49b24c1a8bb60ad42c0db262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb6e08a94bc415fada171a2eca3e7ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:03.129077 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-61a7cf7a-a95a-4aa6-9bf8-d24a26e7e592 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] 10.222.0.46 "GET /compute/v2.1/servers/bffd829f-bc6e-40a7-a9d8-59af77e5b10d" status: 200 len: 1467 microversion: 2.1 time: 0.284203 Jan 15 20:58:03.129360 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-1b770cb2-546e-439d-97e8-05f74d9860ae tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Getting quotas for project e3a611cade394cb288f103fcf516e4ab. Resources: {'key_pairs'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:58:03.135863 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-1b770cb2-546e-439d-97e8-05f74d9860ae tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Getting quotas for user 7f1ee75d18ae4db8825653f6e8180b72 and project e3a611cade394cb288f103fcf516e4ab. Resources: {'key_pairs'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:58:03.141373 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1390/2788] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:02 2022] GET /compute/v2.1/servers/bffd829f-bc6e-40a7-a9d8-59af77e5b10d => generated 1467 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:03.154793 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9199cf3d-7acf-43c5-a507-3673d4a02731 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:03.159233 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-9199cf3d-7acf-43c5-a507-3673d4a02731 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: deef57f9-d933-48ad-a051-e782593799bf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:03.167379 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9199cf3d-7acf-43c5-a507-3673d4a02731 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:03.167844 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9199cf3d-7acf-43c5-a507-3673d4a02731 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:03.168934 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-1b770cb2-546e-439d-97e8-05f74d9860ae tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.615033 Jan 15 20:58:03.170332 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1399/2789] 10.222.0.46 () {60 vars in 1157 bytes} [Sat Jan 15 20:58:02 2022] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:03.170761 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9199cf3d-7acf-43c5-a507-3673d4a02731 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:03.171292 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9199cf3d-7acf-43c5-a507-3673d4a02731 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:03.176394 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-333b5cd7-fc28-4d35-a678-016b4cb2686b tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:58:03.177951 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-333b5cd7-fc28-4d35-a678-016b4cb2686b tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] [instance: 62ae2a15-8c2c-4dad-971f-0611238103a3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:03.185840 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-333b5cd7-fc28-4d35-a678-016b4cb2686b tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:03.186496 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-333b5cd7-fc28-4d35-a678-016b4cb2686b tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:03.187495 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-333b5cd7-fc28-4d35-a678-016b4cb2686b tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:03.188342 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-333b5cd7-fc28-4d35-a678-016b4cb2686b tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:03.244196 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-333b5cd7-fc28-4d35-a678-016b4cb2686b tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] 10.222.0.46 "POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action" status: 200 len: 32634 microversion: 2.1 time: 0.071594 Jan 15 20:58:03.245153 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1400/2790] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:58:03 2022] POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action => generated 32634 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:58:03.250361 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b63c1d96-6a50-413c-8c8b-f4dfd673c5b3 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Calling method '.version_select at 0x7f30c9685700>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:03.388445 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-9199cf3d-7acf-43c5-a507-3673d4a02731 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:03.403483 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-9199cf3d-7acf-43c5-a507-3673d4a02731 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/deef57f9-d933-48ad-a051-e782593799bf" status: 200 len: 1511 microversion: 2.1 time: 0.256446 Jan 15 20:58:03.405459 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1391/2791] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:03 2022] GET /compute/v2.1/servers/deef57f9-d933-48ad-a051-e782593799bf => generated 1511 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:03.410853 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0e0bffa8-261a-44fa-8da7-d20403dcb689 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:58:03.411926 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-0e0bffa8-261a-44fa-8da7-d20403dcb689 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] [instance: 70bf65cf-55e2-459a-aaf1-c3eb851a6ccf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:03.424396 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0e0bffa8-261a-44fa-8da7-d20403dcb689 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:03.425112 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0e0bffa8-261a-44fa-8da7-d20403dcb689 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:03.426174 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0e0bffa8-261a-44fa-8da7-d20403dcb689 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:03.427141 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0e0bffa8-261a-44fa-8da7-d20403dcb689 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:03.463697 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b63c1d96-6a50-413c-8c8b-f4dfd673c5b3 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] 10.222.0.46 "GET /compute/v2.1/images?changes-since=2022-01-15T20%3A56%3A14Z" status: 200 len: 1901 microversion: 2.1 time: 0.215700 Jan 15 20:58:03.464644 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1401/2792] 10.222.0.46 () {58 vars in 1198 bytes} [Sat Jan 15 20:58:03 2022] GET /compute/v2.1/images?changes-since=2022-01-15T20%3A56%3A14Z => generated 1901 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:03.481701 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-46c04d3c-d401-4e34-be17-a9a708101484 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Calling method '.version_select at 0x7f30c8fff9d0>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:03.512778 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0e0bffa8-261a-44fa-8da7-d20403dcb689 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] 10.222.0.46 "POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action" status: 200 len: 32642 microversion: 2.1 time: 0.105714 Jan 15 20:58:03.513905 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1392/2793] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:58:03 2022] POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action => generated 32642 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:58:03.535855 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-54f29994-ce5c-4e06-99b2-c6530c5dbb20 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:03.538850 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-54f29994-ce5c-4e06-99b2-c6530c5dbb20 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] [instance: 2427a640-1c1b-49f4-a98d-bff4af6e596b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:03.547927 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-54f29994-ce5c-4e06-99b2-c6530c5dbb20 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:03.548577 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-54f29994-ce5c-4e06-99b2-c6530c5dbb20 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:03.549798 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-54f29994-ce5c-4e06-99b2-c6530c5dbb20 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:03.550572 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-54f29994-ce5c-4e06-99b2-c6530c5dbb20 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:03.611696 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-46c04d3c-d401-4e34-be17-a9a708101484 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] 10.222.0.46 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-552307174" status: 200 len: 484 microversion: 2.1 time: 0.138420 Jan 15 20:58:03.612343 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1402/2794] 10.222.0.46 () {58 vars in 1228 bytes} [Sat Jan 15 20:58:03 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-552307174 => generated 484 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:58:03.625844 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-284fb649-2fa0-4a3c-b4d8-76cec95a41b9 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Calling method '.version_select at 0x7f30c97ac820>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:03.739539 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-284fb649-2fa0-4a3c-b4d8-76cec95a41b9 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] 10.222.0.46 "GET /compute/v2.1/images?server=bffd829f-bc6e-40a7-a9d8-59af77e5b10d" status: 200 len: 956 microversion: 2.1 time: 0.117410 Jan 15 20:58:03.740437 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1403/2795] 10.222.0.46 () {58 vars in 1208 bytes} [Sat Jan 15 20:58:03 2022] GET /compute/v2.1/images?server=bffd829f-bc6e-40a7-a9d8-59af77e5b10d => generated 956 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 20:58:03.750863 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-54f29994-ce5c-4e06-99b2-c6530c5dbb20 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ec114f8ece434aa496cd401494e2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a05b1a0a7479db84b762eca23b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:03.754198 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b35e6e1e-0fdf-4278-b6c8-d7ced685f77c tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Calling method '.version_select at 0x7f30c95a05e0>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:03.764426 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-54f29994-ce5c-4e06-99b2-c6530c5dbb20 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] 10.222.0.46 "GET /compute/v2.1/servers/2427a640-1c1b-49f4-a98d-bff4af6e596b" status: 200 len: 1382 microversion: 2.1 time: 0.245894 Jan 15 20:58:03.782216 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1393/2796] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:03 2022] GET /compute/v2.1/servers/2427a640-1c1b-49f4-a98d-bff4af6e596b => generated 1382 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:03.790969 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-77738109-6a91-4e39-98fd-f15a6105579b tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:03.792285 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-77738109-6a91-4e39-98fd-f15a6105579b tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] [instance: 2427a640-1c1b-49f4-a98d-bff4af6e596b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:03.803033 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-77738109-6a91-4e39-98fd-f15a6105579b tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:03.804100 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-77738109-6a91-4e39-98fd-f15a6105579b tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:03.805661 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-77738109-6a91-4e39-98fd-f15a6105579b tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:03.806596 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-77738109-6a91-4e39-98fd-f15a6105579b tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:03.830069 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b35e6e1e-0fdf-4278-b6c8-d7ced685f77c tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] 10.222.0.46 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.46%2Fcompute%2Fv2.1%2Fservers%2Fbeffc13d-acd3-455e-96d6-be4bcbb81b88" status: 200 len: 485 microversion: 2.1 time: 0.080121 Jan 15 20:58:03.831319 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1404/2797] 10.222.0.46 () {58 vars in 1316 bytes} [Sat Jan 15 20:58:03 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.46%2Fcompute%2Fv2.1%2Fservers%2Fbeffc13d-acd3-455e-96d6-be4bcbb81b88 => generated 485 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:58:03.836649 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-6fa03d00-a2b1-437e-a8a2-260197c32481 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:03.838219 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-6fa03d00-a2b1-437e-a8a2-260197c32481 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] [instance: 689dd504-e36e-41d0-a461-acce91952e7e] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:03.847740 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6fa03d00-a2b1-437e-a8a2-260197c32481 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:03.848519 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6fa03d00-a2b1-437e-a8a2-260197c32481 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:03.849526 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6fa03d00-a2b1-437e-a8a2-260197c32481 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:03.850262 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6fa03d00-a2b1-437e-a8a2-260197c32481 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:04.038639 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-77738109-6a91-4e39-98fd-f15a6105579b tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/2427a640-1c1b-49f4-a98d-bff4af6e596b" status: 200 len: 1533 microversion: 2.1 time: 0.253122 Jan 15 20:58:04.050215 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1394/2798] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:03 2022] GET /compute/v2.1/servers/2427a640-1c1b-49f4-a98d-bff4af6e596b => generated 1533 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:04.064302 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f31439aa-e3e9-4e57-b1d8-13ec479fad95 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Calling method '.version_select at 0x7f30c8ef5dc0>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:04.083264 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-6fa03d00-a2b1-437e-a8a2-260197c32481 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05483ff6eec84f78a091b29cfbcf61f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a6720be5fb4de7bcd77cc7ef9d8000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:04.093969 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-6fa03d00-a2b1-437e-a8a2-260197c32481 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] 10.222.0.46 "GET /compute/v2.1/servers/689dd504-e36e-41d0-a461-acce91952e7e" status: 200 len: 1522 microversion: 2.1 time: 0.261003 Jan 15 20:58:04.094912 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1405/2799] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:03 2022] GET /compute/v2.1/servers/689dd504-e36e-41d0-a461-acce91952e7e => generated 1522 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:04.100055 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3e620c8a-d39f-42f8-a188-984fb9cca64d tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:04.105955 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-3e620c8a-d39f-42f8-a188-984fb9cca64d tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] [instance: 2427a640-1c1b-49f4-a98d-bff4af6e596b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:04.121043 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3e620c8a-d39f-42f8-a188-984fb9cca64d tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:04.122743 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3e620c8a-d39f-42f8-a188-984fb9cca64d tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:04.124483 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3e620c8a-d39f-42f8-a188-984fb9cca64d tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:04.125008 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3e620c8a-d39f-42f8-a188-984fb9cca64d tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:04.163167 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f31439aa-e3e9-4e57-b1d8-13ec479fad95 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] 10.222.0.46 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.46%2Fcompute%2Fservers%2Fbeffc13d-acd3-455e-96d6-be4bcbb81b88" status: 200 len: 485 microversion: 2.1 time: 0.111734 Jan 15 20:58:04.163737 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1395/2800] 10.222.0.46 () {58 vars in 1302 bytes} [Sat Jan 15 20:58:04 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.46%2Fcompute%2Fservers%2Fbeffc13d-acd3-455e-96d6-be4bcbb81b88 => generated 485 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:58:04.177072 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d762e265-3704-418b-aa29-30b19465d780 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Calling method '.version_select at 0x7f30c9215dc0>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:04.334764 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d762e265-3704-418b-aa29-30b19465d780 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] 10.222.0.46 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3278 microversion: 2.1 time: 0.161537 Jan 15 20:58:04.338623 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1396/2801] 10.222.0.46 () {58 vars in 1148 bytes} [Sat Jan 15 20:58:04 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3278 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:04.358339 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ce13c56d-8cd0-448c-be1f-c25ecd9ab0f6 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:58:04.359892 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ce13c56d-8cd0-448c-be1f-c25ecd9ab0f6 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] [instance: 62ae2a15-8c2c-4dad-971f-0611238103a3] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:04.369719 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ce13c56d-8cd0-448c-be1f-c25ecd9ab0f6 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:04.370272 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ce13c56d-8cd0-448c-be1f-c25ecd9ab0f6 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:04.371280 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ce13c56d-8cd0-448c-be1f-c25ecd9ab0f6 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:04.373809 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ce13c56d-8cd0-448c-be1f-c25ecd9ab0f6 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:04.404438 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3e620c8a-d39f-42f8-a188-984fb9cca64d tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/2427a640-1c1b-49f4-a98d-bff4af6e596b" status: 200 len: 1533 microversion: 2.1 time: 0.306951 Jan 15 20:58:04.406780 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1406/2802] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:04 2022] GET /compute/v2.1/servers/2427a640-1c1b-49f4-a98d-bff4af6e596b => generated 1533 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:04.428327 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-1a66f964-b26c-433a-8b0a-5861539584f3 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Calling method '.version_select at 0x7f30c91b10d0>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:04.436428 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ce13c56d-8cd0-448c-be1f-c25ecd9ab0f6 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] 10.222.0.46 "POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action" status: 200 len: 32634 microversion: 2.1 time: 0.096322 Jan 15 20:58:04.439546 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1397/2803] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:58:04 2022] POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action => generated 32634 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:58:04.466681 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b5ce08c3-c952-4d4e-950c-cb5225c1f983 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:04.469852 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b5ce08c3-c952-4d4e-950c-cb5225c1f983 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: deef57f9-d933-48ad-a051-e782593799bf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:04.485387 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b5ce08c3-c952-4d4e-950c-cb5225c1f983 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:04.485833 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b5ce08c3-c952-4d4e-950c-cb5225c1f983 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:04.502394 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b5ce08c3-c952-4d4e-950c-cb5225c1f983 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:04.502861 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b5ce08c3-c952-4d4e-950c-cb5225c1f983 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:04.566720 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-1a66f964-b26c-433a-8b0a-5861539584f3 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] 10.222.0.46 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1429 microversion: 2.1 time: 0.150941 Jan 15 20:58:04.571630 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1407/2804] 10.222.0.46 () {58 vars in 1148 bytes} [Sat Jan 15 20:58:04 2022] GET /compute/v2.1/images?type=snapshot => generated 1429 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:04.577066 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3aa5c8a6-601c-443f-b89b-cdeb86a7dc5c tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:04.582718 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:58:04.582718 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:58:04.586088 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3aa5c8a6-601c-443f-b89b-cdeb86a7dc5c tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:04.586549 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3aa5c8a6-601c-443f-b89b-cdeb86a7dc5c tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:04.587958 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3aa5c8a6-601c-443f-b89b-cdeb86a7dc5c tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:04.588401 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3aa5c8a6-601c-443f-b89b-cdeb86a7dc5c tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:04.625547 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3aa5c8a6-601c-443f-b89b-cdeb86a7dc5c tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] 10.222.0.46 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.052608 Jan 15 20:58:04.633019 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1408/2805] 10.222.0.46 () {58 vars in 1175 bytes} [Sat Jan 15 20:58:04 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:58:04.638466 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ad8a6c96-d12b-4f8f-b545-80d478560a83 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:58:04.639888 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ad8a6c96-d12b-4f8f-b545-80d478560a83 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] [instance: 70bf65cf-55e2-459a-aaf1-c3eb851a6ccf] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:04.647846 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ad8a6c96-d12b-4f8f-b545-80d478560a83 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:04.648728 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ad8a6c96-d12b-4f8f-b545-80d478560a83 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:04.650359 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ad8a6c96-d12b-4f8f-b545-80d478560a83 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:04.651293 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ad8a6c96-d12b-4f8f-b545-80d478560a83 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:04.693624 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ad8a6c96-d12b-4f8f-b545-80d478560a83 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] 10.222.0.46 "POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action" status: 200 len: 32642 microversion: 2.1 time: 0.058793 Jan 15 20:58:04.695204 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1409/2806] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:58:04 2022] POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action => generated 32642 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:58:04.709163 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e6b72d07-37e9-4653-874b-cfca1589694c tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Calling method '.version_select at 0x7f30c8e84c10>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:04.811056 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-b5ce08c3-c952-4d4e-950c-cb5225c1f983 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:04.825578 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b5ce08c3-c952-4d4e-950c-cb5225c1f983 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/deef57f9-d933-48ad-a051-e782593799bf" status: 200 len: 1511 microversion: 2.1 time: 0.384004 Jan 15 20:58:04.829233 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e6b72d07-37e9-4653-874b-cfca1589694c tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] 10.222.0.46 "GET /compute/v2.1/images?limit=1" status: 200 len: 621 microversion: 2.1 time: 0.131620 Jan 15 20:58:04.830343 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1398/2807] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:04 2022] GET /compute/v2.1/servers/deef57f9-d933-48ad-a051-e782593799bf => generated 1511 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:04.835193 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-3bfb73da-ae5d-48f7-b78c-ac7fdd7b9430 tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": false, "disk_over_commit": false}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:58:04.837330 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-3bfb73da-ae5d-48f7-b78c-ac7fdd7b9430 tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] [instance: 2427a640-1c1b-49f4-a98d-bff4af6e596b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:04.838556 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1410/2808] 10.222.0.46 () {58 vars in 1136 bytes} [Sat Jan 15 20:58:04 2022] GET /compute/v2.1/images?limit=1 => generated 621 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:58:04.843551 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-cf735478-3d44-4177-a5be-b3437924b2e9 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Calling method '.version_select at 0x7f30c8e909d0>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:04.866004 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3bfb73da-ae5d-48f7-b78c-ac7fdd7b9430 tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:04.868965 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3bfb73da-ae5d-48f7-b78c-ac7fdd7b9430 tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:04.870359 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3bfb73da-ae5d-48f7-b78c-ac7fdd7b9430 tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:04.873175 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3bfb73da-ae5d-48f7-b78c-ac7fdd7b9430 tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:04.901626 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.objects.instance [None req-3bfb73da-ae5d-48f7-b78c-ac7fdd7b9430 tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Lazy-loading 'flavor' on Instance uuid 2427a640-1c1b-49f4-a98d-bff4af6e596b {{(pid=129366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 20:58:04.935126 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-3bfb73da-ae5d-48f7-b78c-ac7fdd7b9430 tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] [instance: 2427a640-1c1b-49f4-a98d-bff4af6e596b] Going to try to live migrate instance to nch1-master-1 {{(pid=129366) live_migrate /opt/stack/nova/nova/compute/api.py:5255}} Jan 15 20:58:04.997867 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-cf735478-3d44-4177-a5be-b3437924b2e9 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] 10.222.0.46 "GET /compute/v2.1/images/detail?changes-since=2022-01-15T20%3A56%3A09Z" status: 200 len: 6325 microversion: 2.1 time: 0.156807 Jan 15 20:58:04.999662 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1411/2809] 10.222.0.46 () {58 vars in 1219 bytes} [Sat Jan 15 20:58:04 2022] GET /compute/v2.1/images/detail?changes-since=2022-01-15T20%3A56%3A09Z => generated 6325 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:05.018523 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9f132571-e4fc-4b30-8672-9a9e4f64629f tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Calling method '.version_select at 0x7f30c952fee0>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:05.212527 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-9f132571-e4fc-4b30-8672-9a9e4f64629f tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] 10.222.0.46 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-552307174" status: 200 len: 664 microversion: 2.1 time: 0.198221 Jan 15 20:58:05.213325 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1412/2810] 10.222.0.46 () {58 vars in 1249 bytes} [Sat Jan 15 20:58:05 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-552307174 => generated 664 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 20:58:05.232585 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-109bfe6d-7ca3-416a-a160-df05e0ebb3d6 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:05.233388 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-109bfe6d-7ca3-416a-a160-df05e0ebb3d6 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] [instance: 689dd504-e36e-41d0-a461-acce91952e7e] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:05.265127 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-109bfe6d-7ca3-416a-a160-df05e0ebb3d6 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:05.266329 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-109bfe6d-7ca3-416a-a160-df05e0ebb3d6 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:05.268576 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-109bfe6d-7ca3-416a-a160-df05e0ebb3d6 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:05.270262 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-109bfe6d-7ca3-416a-a160-df05e0ebb3d6 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:05.589012 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-109bfe6d-7ca3-416a-a160-df05e0ebb3d6 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05483ff6eec84f78a091b29cfbcf61f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a6720be5fb4de7bcd77cc7ef9d8000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:05.600679 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-109bfe6d-7ca3-416a-a160-df05e0ebb3d6 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] 10.222.0.46 "GET /compute/v2.1/servers/689dd504-e36e-41d0-a461-acce91952e7e" status: 200 len: 1522 microversion: 2.1 time: 0.382284 Jan 15 20:58:05.601326 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1413/2811] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:05 2022] GET /compute/v2.1/servers/689dd504-e36e-41d0-a461-acce91952e7e => generated 1522 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:05.608135 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5061f2e0-e7d7-4bad-8132-8d4d8ea577a1 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Calling method '.version_select at 0x7f30c91c4a60>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:05.719205 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5061f2e0-e7d7-4bad-8132-8d4d8ea577a1 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] 10.222.0.46 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.46%2Fcompute%2Fv2.1%2Fservers%2Fbeffc13d-acd3-455e-96d6-be4bcbb81b88" status: 200 len: 1465 microversion: 2.1 time: 0.114394 Jan 15 20:58:05.720033 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1414/2812] 10.222.0.46 () {58 vars in 1337 bytes} [Sat Jan 15 20:58:05 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.46%2Fcompute%2Fv2.1%2Fservers%2Fbeffc13d-acd3-455e-96d6-be4bcbb81b88 => generated 1465 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:05.727006 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-123bd920-8203-42c6-b833-a412365b6238 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:58:05.730144 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-123bd920-8203-42c6-b833-a412365b6238 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] [instance: 62ae2a15-8c2c-4dad-971f-0611238103a3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:05.756394 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-123bd920-8203-42c6-b833-a412365b6238 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:05.758580 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-123bd920-8203-42c6-b833-a412365b6238 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:05.764994 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-123bd920-8203-42c6-b833-a412365b6238 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:05.766374 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-123bd920-8203-42c6-b833-a412365b6238 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:05.858276 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-123bd920-8203-42c6-b833-a412365b6238 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] 10.222.0.46 "POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action" status: 200 len: 32634 microversion: 2.1 time: 0.136255 Jan 15 20:58:05.859138 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1415/2813] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:58:05 2022] POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action => generated 32634 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:58:05.873889 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9cde8b05-656d-45d7-a9d3-b0981fc61f3c tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:58:05.875314 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-9cde8b05-656d-45d7-a9d3-b0981fc61f3c tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] [instance: 70bf65cf-55e2-459a-aaf1-c3eb851a6ccf] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:05.892121 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9cde8b05-656d-45d7-a9d3-b0981fc61f3c tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:05.892890 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9cde8b05-656d-45d7-a9d3-b0981fc61f3c tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:05.894798 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9cde8b05-656d-45d7-a9d3-b0981fc61f3c tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:05.896980 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9cde8b05-656d-45d7-a9d3-b0981fc61f3c tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:05.960474 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-9cde8b05-656d-45d7-a9d3-b0981fc61f3c tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] 10.222.0.46 "POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action" status: 200 len: 32642 microversion: 2.1 time: 0.099648 Jan 15 20:58:05.964819 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1416/2814] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:58:05 2022] POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action => generated 32642 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:58:05.982428 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e32f714a-641f-415f-b4f3-04d46f5b2b13 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Calling method '.version_select at 0x7f30c90204c0>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:06.074876 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e32f714a-641f-415f-b4f3-04d46f5b2b13 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] 10.222.0.46 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.46%2Fcompute%2Fservers%2Fbeffc13d-acd3-455e-96d6-be4bcbb81b88" status: 200 len: 1465 microversion: 2.1 time: 0.106423 Jan 15 20:58:06.087990 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1417/2815] 10.222.0.46 () {58 vars in 1323 bytes} [Sat Jan 15 20:58:05 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.46%2Fcompute%2Fservers%2Fbeffc13d-acd3-455e-96d6-be4bcbb81b88 => generated 1465 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:06.105641 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-bc00f989-5553-44cd-8108-ad3244b6b89a tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:06.109012 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-bc00f989-5553-44cd-8108-ad3244b6b89a tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: deef57f9-d933-48ad-a051-e782593799bf] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:06.126801 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bc00f989-5553-44cd-8108-ad3244b6b89a tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:06.128547 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bc00f989-5553-44cd-8108-ad3244b6b89a tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:06.132654 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bc00f989-5553-44cd-8108-ad3244b6b89a tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:06.137075 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bc00f989-5553-44cd-8108-ad3244b6b89a tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:06.518725 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-bc00f989-5553-44cd-8108-ad3244b6b89a tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:06.538079 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-bc00f989-5553-44cd-8108-ad3244b6b89a tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/deef57f9-d933-48ad-a051-e782593799bf" status: 200 len: 1511 microversion: 2.1 time: 0.442429 Jan 15 20:58:06.553398 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1418/2816] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:06 2022] GET /compute/v2.1/servers/deef57f9-d933-48ad-a051-e782593799bf => generated 1511 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:06.559480 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-4ed05db5-9a30-4b32-ab7e-7c18a1b2fe02 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Calling method '.version_select at 0x7f30c9958820>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:06.780753 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-4ed05db5-9a30-4b32-ab7e-7c18a1b2fe02 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] 10.222.0.46 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7100 microversion: 2.1 time: 0.225940 Jan 15 20:58:06.793778 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1419/2817] 10.222.0.46 () {58 vars in 1169 bytes} [Sat Jan 15 20:58:06 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7100 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:06.793778 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-8d43b4a7-c900-4d60-9f43-56c2c9bcc7fe req-543f4fc6-6d52-48b4-b5b1-d756cb6de9cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bffd829f-bc6e-40a7-a9d8-59af77e5b10d", "name": "network-vif-unplugged", "status": "completed", "tag": "8b8cea34-6f8d-4a83-aaae-cfea3dbff75c"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:58:06.793778 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:58:06.793778 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:58:06.807905 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-8d43b4a7-c900-4d60-9f43-56c2c9bcc7fe req-543f4fc6-6d52-48b4-b5b1-d756cb6de9cc service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:06.813685 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-8d43b4a7-c900-4d60-9f43-56c2c9bcc7fe req-543f4fc6-6d52-48b4-b5b1-d756cb6de9cc service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:06.837237 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-8d43b4a7-c900-4d60-9f43-56c2c9bcc7fe req-543f4fc6-6d52-48b4-b5b1-d756cb6de9cc service nova] Creating event network-vif-unplugged:8b8cea34-6f8d-4a83-aaae-cfea3dbff75c for instance bffd829f-bc6e-40a7-a9d8-59af77e5b10d on nch2-master-1 Jan 15 20:58:06.851966 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-8d43b4a7-c900-4d60-9f43-56c2c9bcc7fe req-543f4fc6-6d52-48b4-b5b1-d756cb6de9cc service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.069438 Jan 15 20:58:06.854955 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1420/2818] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:58:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:58:06.862570 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-46b5cf5b-2981-4b74-8f28-98b930610ccd tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2000626582", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "694fb227-829a-493b-b1b7-2dc4e238e05e"}], "security_groups": [{"name": "tempest-securitygroup--1946290030"}], "key_name": "tempest-keypair-617238005", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:58:07.077446 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.network.neutron [None req-46b5cf5b-2981-4b74-8f28-98b930610ccd tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] validate_networks() for [('694fb227-829a-493b-b1b7-2dc4e238e05e', None, None, None, None, None)] {{(pid=129365) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 20:58:07.286428 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-3bfb73da-ae5d-48f7-b78c-ac7fdd7b9430 tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] 10.222.0.46 "POST /compute/v2.1/servers/2427a640-1c1b-49f4-a98d-bff4af6e596b/action" status: 202 len: 0 microversion: 2.1 time: 2.454741 Jan 15 20:58:07.289192 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1399/2819] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:58:04 2022] POST /compute/v2.1/servers/2427a640-1c1b-49f4-a98d-bff4af6e596b/action => generated 0 bytes in 2458 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 20:58:07.311368 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d3236841-0432-4e0b-a976-8edb677ebf43 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:07.316616 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-d3236841-0432-4e0b-a976-8edb677ebf43 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] [instance: 689dd504-e36e-41d0-a461-acce91952e7e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:07.358244 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d3236841-0432-4e0b-a976-8edb677ebf43 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:07.362692 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d3236841-0432-4e0b-a976-8edb677ebf43 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:07.385773 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d3236841-0432-4e0b-a976-8edb677ebf43 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:07.389593 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d3236841-0432-4e0b-a976-8edb677ebf43 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:07.927712 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-d3236841-0432-4e0b-a976-8edb677ebf43 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05483ff6eec84f78a091b29cfbcf61f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a6720be5fb4de7bcd77cc7ef9d8000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:07.936389 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d3236841-0432-4e0b-a976-8edb677ebf43 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] 10.222.0.46 "GET /compute/v2.1/servers/689dd504-e36e-41d0-a461-acce91952e7e" status: 200 len: 1502 microversion: 2.1 time: 0.644428 Jan 15 20:58:07.937316 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1400/2820] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:07 2022] GET /compute/v2.1/servers/689dd504-e36e-41d0-a461-acce91952e7e => generated 1502 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:07.953787 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4d89ab86-6316-40fb-a8d4-2acbd0e3716b tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Calling method '.version_select at 0x7f30c8efb280>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:08.047632 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-4d89ab86-6316-40fb-a8d4-2acbd0e3716b tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] 10.222.0.46 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4369 microversion: 2.1 time: 0.097683 Jan 15 20:58:08.049797 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1401/2821] 10.222.0.46 () {58 vars in 1169 bytes} [Sat Jan 15 20:58:07 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4369 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:08.059511 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a3b25b49-0597-4eea-8b83-feb0a61be802 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:58:08.060906 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a3b25b49-0597-4eea-8b83-feb0a61be802 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] [instance: 62ae2a15-8c2c-4dad-971f-0611238103a3] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:08.069070 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a3b25b49-0597-4eea-8b83-feb0a61be802 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:08.069884 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a3b25b49-0597-4eea-8b83-feb0a61be802 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:08.072428 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a3b25b49-0597-4eea-8b83-feb0a61be802 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:08.073491 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a3b25b49-0597-4eea-8b83-feb0a61be802 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:08.127078 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a3b25b49-0597-4eea-8b83-feb0a61be802 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] 10.222.0.46 "POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action" status: 200 len: 32634 microversion: 2.1 time: 0.074116 Jan 15 20:58:08.128063 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1402/2822] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:58:08 2022] POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action => generated 32634 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:58:08.136774 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-5efa7f02-0a96-4cfe-b64a-544aaf1938e8 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:58:08.139280 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-5efa7f02-0a96-4cfe-b64a-544aaf1938e8 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] [instance: 70bf65cf-55e2-459a-aaf1-c3eb851a6ccf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:08.140773 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-46b5cf5b-2981-4b74-8f28-98b930610ccd tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Flavor limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 20:58:08.143185 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-46b5cf5b-2981-4b74-8f28-98b930610ccd tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Image limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 20:58:08.144330 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-46b5cf5b-2981-4b74-8f28-98b930610ccd tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Flavor pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 20:58:08.145055 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-46b5cf5b-2981-4b74-8f28-98b930610ccd tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Image pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 20:58:08.145705 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-46b5cf5b-2981-4b74-8f28-98b930610ccd tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 20:58:08.149965 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5efa7f02-0a96-4cfe-b64a-544aaf1938e8 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:08.150755 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5efa7f02-0a96-4cfe-b64a-544aaf1938e8 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:08.151928 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5efa7f02-0a96-4cfe-b64a-544aaf1938e8 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:08.152709 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5efa7f02-0a96-4cfe-b64a-544aaf1938e8 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:08.162437 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-46b5cf5b-2981-4b74-8f28-98b930610ccd tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:08.163618 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-46b5cf5b-2981-4b74-8f28-98b930610ccd tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:08.171427 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-46b5cf5b-2981-4b74-8f28-98b930610ccd tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:08.172194 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-46b5cf5b-2981-4b74-8f28-98b930610ccd tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:08.215934 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-46b5cf5b-2981-4b74-8f28-98b930610ccd tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Getting quotas for project e3a611cade394cb288f103fcf516e4ab. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:58:08.220258 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-5efa7f02-0a96-4cfe-b64a-544aaf1938e8 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] 10.222.0.46 "POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action" status: 200 len: 32642 microversion: 2.1 time: 0.090470 Jan 15 20:58:08.221500 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1403/2823] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:58:08 2022] POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action => generated 32642 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:58:08.231676 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-46b5cf5b-2981-4b74-8f28-98b930610ccd tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Getting quotas for user 7f1ee75d18ae4db8825653f6e8180b72 and project e3a611cade394cb288f103fcf516e4ab. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:58:08.235291 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0d9b05c3-9251-4879-a27a-b3f9b1f893e6 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:08.236625 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-0d9b05c3-9251-4879-a27a-b3f9b1f893e6 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] [instance: 2427a640-1c1b-49f4-a98d-bff4af6e596b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:08.250936 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0d9b05c3-9251-4879-a27a-b3f9b1f893e6 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:08.251394 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0d9b05c3-9251-4879-a27a-b3f9b1f893e6 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:08.252183 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0d9b05c3-9251-4879-a27a-b3f9b1f893e6 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:08.258047 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0d9b05c3-9251-4879-a27a-b3f9b1f893e6 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:08.266107 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-46b5cf5b-2981-4b74-8f28-98b930610ccd tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Going to run 1 instances... {{(pid=129365) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 20:58:08.269757 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-46b5cf5b-2981-4b74-8f28-98b930610ccd tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129365) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 20:58:08.349385 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-46b5cf5b-2981-4b74-8f28-98b930610ccd tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.492878 Jan 15 20:58:08.350548 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1421/2824] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 20:58:06 2022] POST /compute/v2.1/servers => generated 409 bytes in 1495 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 20:58:08.355473 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9aed0984-a28d-4051-8799-045027ead2fb tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:08.356523 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-9aed0984-a28d-4051-8799-045027ead2fb tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: deef57f9-d933-48ad-a051-e782593799bf] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:08.369201 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9aed0984-a28d-4051-8799-045027ead2fb tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:08.370094 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9aed0984-a28d-4051-8799-045027ead2fb tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:08.372337 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9aed0984-a28d-4051-8799-045027ead2fb tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:08.373320 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9aed0984-a28d-4051-8799-045027ead2fb tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:08.657217 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-9aed0984-a28d-4051-8799-045027ead2fb tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:08.665422 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-9aed0984-a28d-4051-8799-045027ead2fb tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/deef57f9-d933-48ad-a051-e782593799bf" status: 200 len: 1511 microversion: 2.1 time: 0.313017 Jan 15 20:58:08.676917 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1422/2825] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:08 2022] GET /compute/v2.1/servers/deef57f9-d933-48ad-a051-e782593799bf => generated 1511 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:08.686453 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8f0719df-0d8c-4c81-8ff8-946927ba1e4c tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:08.687285 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-8f0719df-0d8c-4c81-8ff8-946927ba1e4c tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] [instance: e04f7a96-62cb-4aae-9612-aa8df88aef61] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:08.703326 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8f0719df-0d8c-4c81-8ff8-946927ba1e4c tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:08.704042 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8f0719df-0d8c-4c81-8ff8-946927ba1e4c tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:08.709119 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-0d9b05c3-9251-4879-a27a-b3f9b1f893e6 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ec114f8ece434aa496cd401494e2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a05b1a0a7479db84b762eca23b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:08.719422 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0d9b05c3-9251-4879-a27a-b3f9b1f893e6 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] 10.222.0.46 "GET /compute/v2.1/servers/2427a640-1c1b-49f4-a98d-bff4af6e596b" status: 200 len: 1392 microversion: 2.1 time: 0.497285 Jan 15 20:58:08.720070 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8f0719df-0d8c-4c81-8ff8-946927ba1e4c tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:08.720738 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8f0719df-0d8c-4c81-8ff8-946927ba1e4c tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:08.736213 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1404/2826] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:08 2022] GET /compute/v2.1/servers/2427a640-1c1b-49f4-a98d-bff4af6e596b => generated 1392 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:08.741151 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0efd5528-a6aa-4a19-947b-d749bc37ae26 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Calling method '.version_select at 0x7f30c923eb80>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:08.815000 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0efd5528-a6aa-4a19-947b-d749bc37ae26 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] 10.222.0.46 "GET /compute/v2.1/images/1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815" status: 200 len: 784 microversion: 2.1 time: 0.077507 Jan 15 20:58:08.816126 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1405/2827] 10.222.0.46 () {58 vars in 1232 bytes} [Sat Jan 15 20:58:08 2022] GET /compute/v2.1/images/1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815 => generated 784 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:58:08.832103 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1a252058-09d8-4573-98c0-38704cfc9eca tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:08.841801 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-1a252058-09d8-4573-98c0-38704cfc9eca tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:08.920118 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-1a252058-09d8-4573-98c0-38704cfc9eca tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:08.926992 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-1a252058-09d8-4573-98c0-38704cfc9eca tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9" status: 200 len: 1238 microversion: 2.1 time: 0.109510 Jan 15 20:58:08.938755 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1406/2828] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:08 2022] GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9 => generated 1238 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:08.942850 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1426af42-5772-4757-9646-a9720e25a244 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Calling method '.version_select at 0x7f30c8ec9f70>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:09.215521 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-1426af42-5772-4757-9646-a9720e25a244 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] 10.222.0.46 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1608 microversion: 2.1 time: 0.283652 Jan 15 20:58:09.216422 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1407/2829] 10.222.0.46 () {58 vars in 1157 bytes} [Sat Jan 15 20:58:08 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1608 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:09.227664 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0f8bc757-6a85-4e09-b666-375d226586e5 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:58:09.228873 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-0f8bc757-6a85-4e09-b666-375d226586e5 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] [instance: 62ae2a15-8c2c-4dad-971f-0611238103a3] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:09.248747 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0f8bc757-6a85-4e09-b666-375d226586e5 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:09.249232 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0f8bc757-6a85-4e09-b666-375d226586e5 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:09.250043 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0f8bc757-6a85-4e09-b666-375d226586e5 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:09.250480 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0f8bc757-6a85-4e09-b666-375d226586e5 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:09.290656 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-8f0719df-0d8c-4c81-8ff8-946927ba1e4c tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05483ff6eec84f78a091b29cfbcf61f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a6720be5fb4de7bcd77cc7ef9d8000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:09.310972 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-8f0719df-0d8c-4c81-8ff8-946927ba1e4c tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] 10.222.0.46 "GET /compute/v2.1/servers/e04f7a96-62cb-4aae-9612-aa8df88aef61" status: 200 len: 1514 microversion: 2.1 time: 0.632660 Jan 15 20:58:09.326881 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1423/2830] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:08 2022] GET /compute/v2.1/servers/e04f7a96-62cb-4aae-9612-aa8df88aef61 => generated 1514 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:09.331854 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c87ed1f1-6a5c-4f02-98ed-cceca40f255e tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Calling method '.version_select at 0x7f30ceb78c10>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:09.358705 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0f8bc757-6a85-4e09-b666-375d226586e5 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] 10.222.0.46 "POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action" status: 200 len: 32634 microversion: 2.1 time: 0.140621 Jan 15 20:58:09.368573 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1408/2831] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:58:09 2022] POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action => generated 32634 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:58:09.389519 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7aea6787-208f-49a3-a8bd-1a0561ccc60f tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:58:09.393661 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-7aea6787-208f-49a3-a8bd-1a0561ccc60f tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] [instance: 70bf65cf-55e2-459a-aaf1-c3eb851a6ccf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:09.405804 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7aea6787-208f-49a3-a8bd-1a0561ccc60f tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:09.406311 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7aea6787-208f-49a3-a8bd-1a0561ccc60f tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:09.407180 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7aea6787-208f-49a3-a8bd-1a0561ccc60f tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:09.407549 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7aea6787-208f-49a3-a8bd-1a0561ccc60f tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:09.504525 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7aea6787-208f-49a3-a8bd-1a0561ccc60f tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] 10.222.0.46 "POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action" status: 200 len: 32642 microversion: 2.1 time: 0.134137 Jan 15 20:58:09.505489 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1409/2832] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:58:09 2022] POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action => generated 32642 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:58:09.521720 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8bee129c-ab92-4189-ab5c-8996dcce716a tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:58:09.533653 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-8bee129c-ab92-4189-ab5c-8996dcce716a tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] [instance: 12eec705-fe03-4d10-a061-274fbc146048] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:09.541870 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-8bee129c-ab92-4189-ab5c-8996dcce716a tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] HTTP exception thrown: Instance 12eec705-fe03-4d10-a061-274fbc146048 could not be found. Jan 15 20:58:09.544996 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8bee129c-ab92-4189-ab5c-8996dcce716a tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Returning 404 to user: Instance 12eec705-fe03-4d10-a061-274fbc146048 could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:58:09.547768 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-8bee129c-ab92-4189-ab5c-8996dcce716a tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] 10.222.0.46 "POST /compute/v2.1/servers/12eec705-fe03-4d10-a061-274fbc146048/action" status: 404 len: 111 microversion: 2.1 time: 0.039441 Jan 15 20:58:09.548457 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1410/2833] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:58:09 2022] POST /compute/v2.1/servers/12eec705-fe03-4d10-a061-274fbc146048/action => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:58:09.566544 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-868e0a61-6dc7-4e2e-ab90-9240974d1c0d tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:58:09.567853 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-868e0a61-6dc7-4e2e-ab90-9240974d1c0d tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] [instance: e04f7a96-62cb-4aae-9612-aa8df88aef61] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:09.599003 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-868e0a61-6dc7-4e2e-ab90-9240974d1c0d tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:09.601883 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-868e0a61-6dc7-4e2e-ab90-9240974d1c0d tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:09.603439 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-868e0a61-6dc7-4e2e-ab90-9240974d1c0d tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:09.610843 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-868e0a61-6dc7-4e2e-ab90-9240974d1c0d tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:09.767296 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-868e0a61-6dc7-4e2e-ab90-9240974d1c0d tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] 10.222.0.46 "POST /compute/v2.1/servers/e04f7a96-62cb-4aae-9612-aa8df88aef61/action" status: 202 len: 0 microversion: 2.1 time: 0.212679 Jan 15 20:58:09.767989 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1411/2834] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:58:09 2022] POST /compute/v2.1/servers/e04f7a96-62cb-4aae-9612-aa8df88aef61/action => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 20:58:09.797380 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7e9caaf7-be94-45fc-8c1d-cf2e73930fe5 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:09.798128 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-7e9caaf7-be94-45fc-8c1d-cf2e73930fe5 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: deef57f9-d933-48ad-a051-e782593799bf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:09.819514 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7e9caaf7-be94-45fc-8c1d-cf2e73930fe5 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:09.819979 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7e9caaf7-be94-45fc-8c1d-cf2e73930fe5 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:09.820788 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7e9caaf7-be94-45fc-8c1d-cf2e73930fe5 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:09.828967 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7e9caaf7-be94-45fc-8c1d-cf2e73930fe5 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:10.283142 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-7e9caaf7-be94-45fc-8c1d-cf2e73930fe5 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:10.306967 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7e9caaf7-be94-45fc-8c1d-cf2e73930fe5 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/deef57f9-d933-48ad-a051-e782593799bf" status: 200 len: 1511 microversion: 2.1 time: 0.513130 Jan 15 20:58:10.307661 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1412/2835] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:09 2022] GET /compute/v2.1/servers/deef57f9-d933-48ad-a051-e782593799bf => generated 1511 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:10.321913 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-198aae0a-1537-4392-ab41-c137a4ea7343 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:10.326987 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-198aae0a-1537-4392-ab41-c137a4ea7343 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] [instance: 2427a640-1c1b-49f4-a98d-bff4af6e596b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:10.345899 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-198aae0a-1537-4392-ab41-c137a4ea7343 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:10.348569 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-198aae0a-1537-4392-ab41-c137a4ea7343 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:10.349892 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-198aae0a-1537-4392-ab41-c137a4ea7343 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:10.350336 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-198aae0a-1537-4392-ab41-c137a4ea7343 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:10.535094 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c87ed1f1-6a5c-4f02-98ed-cceca40f255e tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] 10.222.0.46 "DELETE /compute/v2.1/images/1f99b18e-87c4-42c4-834c-464b28e8793e" status: 204 len: 0 microversion: 2.1 time: 1.211609 Jan 15 20:58:10.538803 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1424/2836] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:09 2022] DELETE /compute/v2.1/images/1f99b18e-87c4-42c4-834c-464b28e8793e => generated 0 bytes in 1213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 20:58:10.545041 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-467ef172-a6b3-43ff-8a74-05e189ceede7 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:10.545649 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-467ef172-a6b3-43ff-8a74-05e189ceede7 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] [instance: e04f7a96-62cb-4aae-9612-aa8df88aef61] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:10.568482 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-467ef172-a6b3-43ff-8a74-05e189ceede7 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:10.571818 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-467ef172-a6b3-43ff-8a74-05e189ceede7 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:10.575860 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-467ef172-a6b3-43ff-8a74-05e189ceede7 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:10.576572 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-467ef172-a6b3-43ff-8a74-05e189ceede7 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:10.629474 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-198aae0a-1537-4392-ab41-c137a4ea7343 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ec114f8ece434aa496cd401494e2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a05b1a0a7479db84b762eca23b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:10.643134 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-198aae0a-1537-4392-ab41-c137a4ea7343 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] 10.222.0.46 "GET /compute/v2.1/servers/2427a640-1c1b-49f4-a98d-bff4af6e596b" status: 200 len: 1392 microversion: 2.1 time: 0.331499 Jan 15 20:58:10.646494 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1413/2837] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:10 2022] GET /compute/v2.1/servers/2427a640-1c1b-49f4-a98d-bff4af6e596b => generated 1392 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:10.654216 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b0c238ea-70a9-4f24-9372-9f71e5b2516b tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:10.657590 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b0c238ea-70a9-4f24-9372-9f71e5b2516b tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:10.675049 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b0c238ea-70a9-4f24-9372-9f71e5b2516b tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:10.675676 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b0c238ea-70a9-4f24-9372-9f71e5b2516b tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:10.677545 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b0c238ea-70a9-4f24-9372-9f71e5b2516b tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:10.678408 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b0c238ea-70a9-4f24-9372-9f71e5b2516b tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:10.799781 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-b0c238ea-70a9-4f24-9372-9f71e5b2516b tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:10.810132 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b0c238ea-70a9-4f24-9372-9f71e5b2516b tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9" status: 200 len: 1296 microversion: 2.1 time: 0.162208 Jan 15 20:58:10.811539 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-467ef172-a6b3-43ff-8a74-05e189ceede7 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05483ff6eec84f78a091b29cfbcf61f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a6720be5fb4de7bcd77cc7ef9d8000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:10.812389 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1414/2838] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:10 2022] GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9 => generated 1296 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:10.823992 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-467ef172-a6b3-43ff-8a74-05e189ceede7 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] 10.222.0.46 "GET /compute/v2.1/servers/e04f7a96-62cb-4aae-9612-aa8df88aef61" status: 200 len: 1499 microversion: 2.1 time: 0.283819 Jan 15 20:58:10.825293 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-81fd4486-2d9e-4567-a63e-59e71e2361fa tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:58:10.826000 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1425/2839] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:10 2022] GET /compute/v2.1/servers/e04f7a96-62cb-4aae-9612-aa8df88aef61 => generated 1499 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:10.826214 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-81fd4486-2d9e-4567-a63e-59e71e2361fa tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] [instance: 62ae2a15-8c2c-4dad-971f-0611238103a3] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:10.831304 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b2de99bb-4f4a-4507-8fe1-54bd6594d747 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:58:10.838457 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b2de99bb-4f4a-4507-8fe1-54bd6594d747 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] [instance: 70bf65cf-55e2-459a-aaf1-c3eb851a6ccf] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:10.843488 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-81fd4486-2d9e-4567-a63e-59e71e2361fa tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:10.844180 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-81fd4486-2d9e-4567-a63e-59e71e2361fa tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:10.845392 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-81fd4486-2d9e-4567-a63e-59e71e2361fa tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:10.847935 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-81fd4486-2d9e-4567-a63e-59e71e2361fa tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:10.849382 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b2de99bb-4f4a-4507-8fe1-54bd6594d747 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:10.850729 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b2de99bb-4f4a-4507-8fe1-54bd6594d747 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:10.852274 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b2de99bb-4f4a-4507-8fe1-54bd6594d747 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:10.853760 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b2de99bb-4f4a-4507-8fe1-54bd6594d747 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:10.926863 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b2de99bb-4f4a-4507-8fe1-54bd6594d747 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] 10.222.0.46 "POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action" status: 200 len: 32642 microversion: 2.1 time: 0.095972 Jan 15 20:58:10.931094 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1426/2840] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:58:10 2022] POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action => generated 32642 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:58:10.943307 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-844cadf0-12ca-4212-ab76-67d05bb0d196 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Calling method '.version_select at 0x7f30c8e84af0>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:10.970183 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-81fd4486-2d9e-4567-a63e-59e71e2361fa tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] 10.222.0.46 "POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action" status: 200 len: 32634 microversion: 2.1 time: 0.149566 Jan 15 20:58:10.972941 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1415/2841] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:58:10 2022] POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action => generated 32634 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:58:10.992131 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a798e71f-9e55-48d7-a9be-59e20919ba2c tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:58:10.999078 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a798e71f-9e55-48d7-a9be-59e20919ba2c tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] [instance: e04f7a96-62cb-4aae-9612-aa8df88aef61] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:11.015913 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a798e71f-9e55-48d7-a9be-59e20919ba2c tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:11.017763 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a798e71f-9e55-48d7-a9be-59e20919ba2c tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:11.019622 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a798e71f-9e55-48d7-a9be-59e20919ba2c tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:11.023326 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a798e71f-9e55-48d7-a9be-59e20919ba2c tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:11.096679 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.objects.instance [None req-a798e71f-9e55-48d7-a9be-59e20919ba2c tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lazy-loading 'flavor' on Instance uuid e04f7a96-62cb-4aae-9612-aa8df88aef61 {{(pid=129366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 20:58:11.115592 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-a798e71f-9e55-48d7-a9be-59e20919ba2c tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] HTTP exception thrown: Cannot 'rescue' instance e04f7a96-62cb-4aae-9612-aa8df88aef61 while it is in vm_state paused Jan 15 20:58:11.116214 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a798e71f-9e55-48d7-a9be-59e20919ba2c tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Returning 409 to user: Cannot 'rescue' instance e04f7a96-62cb-4aae-9612-aa8df88aef61 while it is in vm_state paused {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:58:11.117162 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a798e71f-9e55-48d7-a9be-59e20919ba2c tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] 10.222.0.46 "POST /compute/v2.1/servers/e04f7a96-62cb-4aae-9612-aa8df88aef61/action" status: 409 len: 144 microversion: 2.1 time: 0.141815 Jan 15 20:58:11.117760 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1416/2842] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:58:10 2022] POST /compute/v2.1/servers/e04f7a96-62cb-4aae-9612-aa8df88aef61/action => generated 144 bytes in 144 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jan 15 20:58:11.128926 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1efd0b73-033b-4956-b8ef-2262a4092074 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:58:11.130480 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-1efd0b73-033b-4956-b8ef-2262a4092074 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] [instance: e04f7a96-62cb-4aae-9612-aa8df88aef61] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:11.154122 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1efd0b73-033b-4956-b8ef-2262a4092074 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:11.154651 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1efd0b73-033b-4956-b8ef-2262a4092074 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:11.155836 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1efd0b73-033b-4956-b8ef-2262a4092074 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:11.156410 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1efd0b73-033b-4956-b8ef-2262a4092074 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:11.284720 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-1efd0b73-033b-4956-b8ef-2262a4092074 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] 10.222.0.46 "POST /compute/v2.1/servers/e04f7a96-62cb-4aae-9612-aa8df88aef61/action" status: 202 len: 0 microversion: 2.1 time: 0.159741 Jan 15 20:58:11.286242 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1417/2843] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:58:11 2022] POST /compute/v2.1/servers/e04f7a96-62cb-4aae-9612-aa8df88aef61/action => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 20:58:11.302191 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b255c089-ce5c-48ff-be98-dcce410f0bf6 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:11.302892 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b255c089-ce5c-48ff-be98-dcce410f0bf6 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] [instance: e04f7a96-62cb-4aae-9612-aa8df88aef61] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:11.320535 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b255c089-ce5c-48ff-be98-dcce410f0bf6 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:11.321207 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b255c089-ce5c-48ff-be98-dcce410f0bf6 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:11.325058 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b255c089-ce5c-48ff-be98-dcce410f0bf6 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:11.325507 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b255c089-ce5c-48ff-be98-dcce410f0bf6 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:11.848188 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-844cadf0-12ca-4212-ab76-67d05bb0d196 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] 10.222.0.46 "DELETE /compute/v2.1/images/9edcd3cd-5d8f-4a6a-9e1e-eff94d6299d6" status: 204 len: 0 microversion: 2.1 time: 0.916876 Jan 15 20:58:11.848816 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1427/2844] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:10 2022] DELETE /compute/v2.1/images/9edcd3cd-5d8f-4a6a-9e1e-eff94d6299d6 => generated 0 bytes in 918 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 20:58:11.854505 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ac92fffc-a635-47f2-984b-39841faac3b2 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:11.856500 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ac92fffc-a635-47f2-984b-39841faac3b2 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: deef57f9-d933-48ad-a051-e782593799bf] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:11.864641 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ac92fffc-a635-47f2-984b-39841faac3b2 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:11.865479 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ac92fffc-a635-47f2-984b-39841faac3b2 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:11.866537 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ac92fffc-a635-47f2-984b-39841faac3b2 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:11.867187 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ac92fffc-a635-47f2-984b-39841faac3b2 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:12.010834 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-b255c089-ce5c-48ff-be98-dcce410f0bf6 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05483ff6eec84f78a091b29cfbcf61f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a6720be5fb4de7bcd77cc7ef9d8000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:12.029146 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b255c089-ce5c-48ff-be98-dcce410f0bf6 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] 10.222.0.46 "GET /compute/v2.1/servers/e04f7a96-62cb-4aae-9612-aa8df88aef61" status: 200 len: 1506 microversion: 2.1 time: 0.737259 Jan 15 20:58:12.030799 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1418/2845] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:11 2022] GET /compute/v2.1/servers/e04f7a96-62cb-4aae-9612-aa8df88aef61 => generated 1506 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:12.043011 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4e9d16b5-a715-4e52-973e-5caa60659da5 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:12.046724 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-4e9d16b5-a715-4e52-973e-5caa60659da5 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] [instance: 2427a640-1c1b-49f4-a98d-bff4af6e596b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:12.061566 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4e9d16b5-a715-4e52-973e-5caa60659da5 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:12.063222 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4e9d16b5-a715-4e52-973e-5caa60659da5 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:12.074080 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4e9d16b5-a715-4e52-973e-5caa60659da5 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:12.074990 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4e9d16b5-a715-4e52-973e-5caa60659da5 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:12.314400 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-ac92fffc-a635-47f2-984b-39841faac3b2 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:12.326093 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ac92fffc-a635-47f2-984b-39841faac3b2 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/deef57f9-d933-48ad-a051-e782593799bf" status: 200 len: 1511 microversion: 2.1 time: 0.475762 Jan 15 20:58:12.330060 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1428/2846] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:11 2022] GET /compute/v2.1/servers/deef57f9-d933-48ad-a051-e782593799bf => generated 1511 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:12.335352 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a8a1af7f-8af7-4c2f-a02d-6857c524865b tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:12.338048 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a8a1af7f-8af7-4c2f-a02d-6857c524865b tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:12.365741 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a8a1af7f-8af7-4c2f-a02d-6857c524865b tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:12.366330 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a8a1af7f-8af7-4c2f-a02d-6857c524865b tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:12.367191 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a8a1af7f-8af7-4c2f-a02d-6857c524865b tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:12.369482 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a8a1af7f-8af7-4c2f-a02d-6857c524865b tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:12.588230 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-4e9d16b5-a715-4e52-973e-5caa60659da5 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ec114f8ece434aa496cd401494e2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a05b1a0a7479db84b762eca23b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:12.603998 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-4e9d16b5-a715-4e52-973e-5caa60659da5 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] 10.222.0.46 "GET /compute/v2.1/servers/2427a640-1c1b-49f4-a98d-bff4af6e596b" status: 200 len: 1392 microversion: 2.1 time: 0.565641 Jan 15 20:58:12.605932 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1419/2847] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:12 2022] GET /compute/v2.1/servers/2427a640-1c1b-49f4-a98d-bff4af6e596b => generated 1392 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:12.612602 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d951948d-4677-4c31-ac93-79e29f6a874b tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Calling method '.version_select at 0x7f30c9ce4550>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:12.731147 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-a8a1af7f-8af7-4c2f-a02d-6857c524865b tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:12.741876 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a8a1af7f-8af7-4c2f-a02d-6857c524865b tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9" status: 200 len: 1364 microversion: 2.1 time: 0.408487 Jan 15 20:58:12.745310 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1429/2848] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:12 2022] GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9 => generated 1364 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:12.758244 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f3d04baa-dd7a-49f7-95fc-c1777fd23a5e tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:58:12.763315 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f3d04baa-dd7a-49f7-95fc-c1777fd23a5e tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] [instance: 70bf65cf-55e2-459a-aaf1-c3eb851a6ccf] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:12.779262 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f3d04baa-dd7a-49f7-95fc-c1777fd23a5e tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:12.779720 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f3d04baa-dd7a-49f7-95fc-c1777fd23a5e tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:12.781744 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f3d04baa-dd7a-49f7-95fc-c1777fd23a5e tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:12.782194 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f3d04baa-dd7a-49f7-95fc-c1777fd23a5e tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:12.912477 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f3d04baa-dd7a-49f7-95fc-c1777fd23a5e tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] 10.222.0.46 "POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action" status: 200 len: 32642 microversion: 2.1 time: 0.164594 Jan 15 20:58:12.921894 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1430/2849] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:58:12 2022] POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action => generated 32642 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:58:12.954291 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5b784a46-679d-4d77-bb68-87be0ecb5c70 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:58:12.955791 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-5b784a46-679d-4d77-bb68-87be0ecb5c70 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] [instance: 62ae2a15-8c2c-4dad-971f-0611238103a3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:12.980367 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5b784a46-679d-4d77-bb68-87be0ecb5c70 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:12.986033 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5b784a46-679d-4d77-bb68-87be0ecb5c70 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:12.987494 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5b784a46-679d-4d77-bb68-87be0ecb5c70 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:12.991929 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5b784a46-679d-4d77-bb68-87be0ecb5c70 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:13.074080 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5b784a46-679d-4d77-bb68-87be0ecb5c70 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] 10.222.0.46 "POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action" status: 200 len: 32634 microversion: 2.1 time: 0.148684 Jan 15 20:58:13.078158 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1431/2850] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:58:12 2022] POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action => generated 32634 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:58:13.082300 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2182d961-aa81-40c6-aae1-997d8b465936 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:13.083424 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-2182d961-aa81-40c6-aae1-997d8b465936 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] [instance: e04f7a96-62cb-4aae-9612-aa8df88aef61] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:13.092131 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2182d961-aa81-40c6-aae1-997d8b465936 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:13.092762 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2182d961-aa81-40c6-aae1-997d8b465936 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:13.093841 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2182d961-aa81-40c6-aae1-997d8b465936 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:13.094484 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2182d961-aa81-40c6-aae1-997d8b465936 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:13.393047 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d951948d-4677-4c31-ac93-79e29f6a874b tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] 10.222.0.46 "DELETE /compute/v2.1/images/198bbbad-af58-4eb7-8548-fd851471e431" status: 204 len: 0 microversion: 2.1 time: 0.785042 Jan 15 20:58:13.393607 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1420/2851] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:12 2022] DELETE /compute/v2.1/images/198bbbad-af58-4eb7-8548-fd851471e431 => generated 0 bytes in 787 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 20:58:13.412148 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8b92c34e-ee20-4133-93c6-b1c80c1b7aff tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:13.413086 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-8b92c34e-ee20-4133-93c6-b1c80c1b7aff tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: deef57f9-d933-48ad-a051-e782593799bf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:13.421861 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-2182d961-aa81-40c6-aae1-997d8b465936 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05483ff6eec84f78a091b29cfbcf61f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a6720be5fb4de7bcd77cc7ef9d8000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:13.437883 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8b92c34e-ee20-4133-93c6-b1c80c1b7aff tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:13.438603 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8b92c34e-ee20-4133-93c6-b1c80c1b7aff tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:13.439584 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8b92c34e-ee20-4133-93c6-b1c80c1b7aff tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:13.440183 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8b92c34e-ee20-4133-93c6-b1c80c1b7aff tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:13.446497 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2182d961-aa81-40c6-aae1-997d8b465936 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] 10.222.0.46 "GET /compute/v2.1/servers/e04f7a96-62cb-4aae-9612-aa8df88aef61" status: 200 len: 1514 microversion: 2.1 time: 0.370098 Jan 15 20:58:13.449549 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1432/2852] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:13 2022] GET /compute/v2.1/servers/e04f7a96-62cb-4aae-9612-aa8df88aef61 => generated 1514 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:13.458535 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-94de4184-fa18-4049-8a40-5fbce6baa4fb tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:13.461020 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-94de4184-fa18-4049-8a40-5fbce6baa4fb tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] [instance: beffc13d-acd3-455e-96d6-be4bcbb81b88] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:13.468619 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-94de4184-fa18-4049-8a40-5fbce6baa4fb tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:13.468746 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-94de4184-fa18-4049-8a40-5fbce6baa4fb tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:13.469684 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-94de4184-fa18-4049-8a40-5fbce6baa4fb tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:13.471461 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-94de4184-fa18-4049-8a40-5fbce6baa4fb tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:13.509647 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-94de4184-fa18-4049-8a40-5fbce6baa4fb tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] [instance: beffc13d-acd3-455e-96d6-be4bcbb81b88] Going to try to terminate instance {{(pid=129365) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 20:58:13.627456 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-94de4184-fa18-4049-8a40-5fbce6baa4fb tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] 10.222.0.46 "DELETE /compute/v2.1/servers/beffc13d-acd3-455e-96d6-be4bcbb81b88" status: 204 len: 0 microversion: 2.1 time: 0.175625 Jan 15 20:58:13.630588 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1433/2853] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 20:58:13 2022] DELETE /compute/v2.1/servers/beffc13d-acd3-455e-96d6-be4bcbb81b88 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 20:58:13.650255 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-3756e763-60e3-4f3d-9e80-6d91ae6379a9 req-8d9a4ebf-6ca6-450b-9455-54b5a4528044 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4504a13b-d10e-436a-a5ef-991829938dd9", "tag": "f7503e3b-a43e-4550-8109-a1fb1aa2d5f1"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:58:13.661179 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:58:13.661179 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:58:13.670824 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-3756e763-60e3-4f3d-9e80-6d91ae6379a9 req-8d9a4ebf-6ca6-450b-9455-54b5a4528044 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:13.671517 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-3756e763-60e3-4f3d-9e80-6d91ae6379a9 req-8d9a4ebf-6ca6-450b-9455-54b5a4528044 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:13.692703 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-3756e763-60e3-4f3d-9e80-6d91ae6379a9 req-8d9a4ebf-6ca6-450b-9455-54b5a4528044 service nova] Creating event network-changed:f7503e3b-a43e-4550-8109-a1fb1aa2d5f1 for instance 4504a13b-d10e-436a-a5ef-991829938dd9 on nch1-master-1 Jan 15 20:58:13.699409 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-3756e763-60e3-4f3d-9e80-6d91ae6379a9 req-8d9a4ebf-6ca6-450b-9455-54b5a4528044 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065124 Jan 15 20:58:13.713341 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1434/2854] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:58:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:58:13.719374 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ab419266-0769-4385-a963-030e39beccb6 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:13.720596 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ab419266-0769-4385-a963-030e39beccb6 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] [instance: 2427a640-1c1b-49f4-a98d-bff4af6e596b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:13.728497 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ab419266-0769-4385-a963-030e39beccb6 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:13.729381 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ab419266-0769-4385-a963-030e39beccb6 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:13.730558 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ab419266-0769-4385-a963-030e39beccb6 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:13.731245 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ab419266-0769-4385-a963-030e39beccb6 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:13.783579 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-8b92c34e-ee20-4133-93c6-b1c80c1b7aff tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:13.800242 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-8b92c34e-ee20-4133-93c6-b1c80c1b7aff tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/deef57f9-d933-48ad-a051-e782593799bf" status: 200 len: 1511 microversion: 2.1 time: 0.405353 Jan 15 20:58:13.800987 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1421/2855] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:13 2022] GET /compute/v2.1/servers/deef57f9-d933-48ad-a051-e782593799bf => generated 1511 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:13.814466 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-70dca69f-c930-4773-a8ef-ec19d768489e tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:13.815621 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-70dca69f-c930-4773-a8ef-ec19d768489e tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] [instance: beffc13d-acd3-455e-96d6-be4bcbb81b88] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:13.834097 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-70dca69f-c930-4773-a8ef-ec19d768489e tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:13.836463 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-70dca69f-c930-4773-a8ef-ec19d768489e tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:13.841737 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-70dca69f-c930-4773-a8ef-ec19d768489e tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:13.842362 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-70dca69f-c930-4773-a8ef-ec19d768489e tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:14.004280 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-ab419266-0769-4385-a963-030e39beccb6 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ec114f8ece434aa496cd401494e2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a05b1a0a7479db84b762eca23b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:14.017196 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ab419266-0769-4385-a963-030e39beccb6 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] 10.222.0.46 "GET /compute/v2.1/servers/2427a640-1c1b-49f4-a98d-bff4af6e596b" status: 200 len: 1392 microversion: 2.1 time: 0.302024 Jan 15 20:58:14.019608 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1435/2856] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:13 2022] GET /compute/v2.1/servers/2427a640-1c1b-49f4-a98d-bff4af6e596b => generated 1392 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:14.036760 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c3ecb9e3-dda8-4d90-a4ca-0b9d2600ead1 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:14.037944 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c3ecb9e3-dda8-4d90-a4ca-0b9d2600ead1 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:14.051965 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c3ecb9e3-dda8-4d90-a4ca-0b9d2600ead1 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:14.052774 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c3ecb9e3-dda8-4d90-a4ca-0b9d2600ead1 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:14.054045 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c3ecb9e3-dda8-4d90-a4ca-0b9d2600ead1 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:14.054522 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c3ecb9e3-dda8-4d90-a4ca-0b9d2600ead1 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:14.145464 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-70dca69f-c930-4773-a8ef-ec19d768489e tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52bd234a49b24c1a8bb60ad42c0db262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb6e08a94bc415fada171a2eca3e7ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:14.169827 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-70dca69f-c930-4773-a8ef-ec19d768489e tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] 10.222.0.46 "GET /compute/v2.1/servers/beffc13d-acd3-455e-96d6-be4bcbb81b88" status: 200 len: 1473 microversion: 2.1 time: 0.363255 Jan 15 20:58:14.180973 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1422/2857] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:13 2022] GET /compute/v2.1/servers/beffc13d-acd3-455e-96d6-be4bcbb81b88 => generated 1473 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:14.192983 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f13813d8-0cb9-4f4a-90fb-3855774fa20b tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:58:14.197882 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f13813d8-0cb9-4f4a-90fb-3855774fa20b tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] [instance: 70bf65cf-55e2-459a-aaf1-c3eb851a6ccf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:14.213772 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f13813d8-0cb9-4f4a-90fb-3855774fa20b tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:14.214512 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f13813d8-0cb9-4f4a-90fb-3855774fa20b tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:14.215631 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f13813d8-0cb9-4f4a-90fb-3855774fa20b tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:14.217027 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f13813d8-0cb9-4f4a-90fb-3855774fa20b tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:14.269164 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f13813d8-0cb9-4f4a-90fb-3855774fa20b tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] 10.222.0.46 "POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action" status: 200 len: 32642 microversion: 2.1 time: 0.086349 Jan 15 20:58:14.271096 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1423/2858] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:58:14 2022] POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action => generated 32642 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:58:14.286364 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c39931b0-89b0-4a8c-9fe5-67b6c51222b2 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:58:14.288651 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c39931b0-89b0-4a8c-9fe5-67b6c51222b2 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] [instance: 62ae2a15-8c2c-4dad-971f-0611238103a3] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:14.306728 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c39931b0-89b0-4a8c-9fe5-67b6c51222b2 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:14.309629 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c39931b0-89b0-4a8c-9fe5-67b6c51222b2 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:14.310617 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c39931b0-89b0-4a8c-9fe5-67b6c51222b2 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:14.311448 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c39931b0-89b0-4a8c-9fe5-67b6c51222b2 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:14.377006 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-c3ecb9e3-dda8-4d90-a4ca-0b9d2600ead1 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:14.386049 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c3ecb9e3-dda8-4d90-a4ca-0b9d2600ead1 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9" status: 200 len: 1364 microversion: 2.1 time: 0.362900 Jan 15 20:58:14.398672 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1436/2859] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:14 2022] GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9 => generated 1364 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:14.414112 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c39931b0-89b0-4a8c-9fe5-67b6c51222b2 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] 10.222.0.46 "POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action" status: 200 len: 32634 microversion: 2.1 time: 0.141330 Jan 15 20:58:14.415516 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1424/2860] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:58:14 2022] POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action => generated 32634 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:58:14.818539 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f6a307c9-acb3-449e-8a1c-a6f31808c540 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:14.819550 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f6a307c9-acb3-449e-8a1c-a6f31808c540 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: deef57f9-d933-48ad-a051-e782593799bf] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:14.837522 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f6a307c9-acb3-449e-8a1c-a6f31808c540 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:14.837906 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f6a307c9-acb3-449e-8a1c-a6f31808c540 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:14.838713 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f6a307c9-acb3-449e-8a1c-a6f31808c540 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:14.839140 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f6a307c9-acb3-449e-8a1c-a6f31808c540 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:15.036964 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-16b1c049-70d0-4e70-977b-fb0fc121a01b tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:15.037961 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-16b1c049-70d0-4e70-977b-fb0fc121a01b tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] [instance: 2427a640-1c1b-49f4-a98d-bff4af6e596b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:15.048107 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-16b1c049-70d0-4e70-977b-fb0fc121a01b tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:15.048772 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-16b1c049-70d0-4e70-977b-fb0fc121a01b tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:15.049834 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-16b1c049-70d0-4e70-977b-fb0fc121a01b tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:15.050554 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-16b1c049-70d0-4e70-977b-fb0fc121a01b tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:15.057788 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-f6a307c9-acb3-449e-8a1c-a6f31808c540 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:15.080895 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f6a307c9-acb3-449e-8a1c-a6f31808c540 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/deef57f9-d933-48ad-a051-e782593799bf" status: 200 len: 1511 microversion: 2.1 time: 0.266851 Jan 15 20:58:15.082851 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1437/2861] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:14 2022] GET /compute/v2.1/servers/deef57f9-d933-48ad-a051-e782593799bf => generated 1511 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:15.169833 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5ec34b67-3713-4208-b91c-8642f370d38e tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:58:15.171277 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-5ec34b67-3713-4208-b91c-8642f370d38e tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] [instance: e04f7a96-62cb-4aae-9612-aa8df88aef61] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:15.180455 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5ec34b67-3713-4208-b91c-8642f370d38e tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:15.181267 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5ec34b67-3713-4208-b91c-8642f370d38e tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:15.182374 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5ec34b67-3713-4208-b91c-8642f370d38e tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:15.183062 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5ec34b67-3713-4208-b91c-8642f370d38e tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:15.225804 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.objects.instance [None req-5ec34b67-3713-4208-b91c-8642f370d38e tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lazy-loading 'flavor' on Instance uuid e04f7a96-62cb-4aae-9612-aa8df88aef61 {{(pid=129365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 20:58:15.279239 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-16b1c049-70d0-4e70-977b-fb0fc121a01b tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ec114f8ece434aa496cd401494e2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a05b1a0a7479db84b762eca23b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:15.291462 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-16b1c049-70d0-4e70-977b-fb0fc121a01b tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] 10.222.0.46 "GET /compute/v2.1/servers/2427a640-1c1b-49f4-a98d-bff4af6e596b" status: 200 len: 1392 microversion: 2.1 time: 0.259307 Jan 15 20:58:15.295121 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1425/2862] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:15 2022] GET /compute/v2.1/servers/2427a640-1c1b-49f4-a98d-bff4af6e596b => generated 1392 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:58:15.310210 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c1c1d07e-624f-42c7-9115-9509bc2b1571 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:15.312352 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c1c1d07e-624f-42c7-9115-9509bc2b1571 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] [instance: beffc13d-acd3-455e-96d6-be4bcbb81b88] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:15.336341 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c1c1d07e-624f-42c7-9115-9509bc2b1571 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:15.336892 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c1c1d07e-624f-42c7-9115-9509bc2b1571 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:15.338047 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5ec34b67-3713-4208-b91c-8642f370d38e tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] 10.222.0.46 "POST /compute/v2.1/servers/e04f7a96-62cb-4aae-9612-aa8df88aef61/action" status: 200 len: 32 microversion: 2.1 time: 0.174308 Jan 15 20:58:15.338303 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c1c1d07e-624f-42c7-9115-9509bc2b1571 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:15.338750 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c1c1d07e-624f-42c7-9115-9509bc2b1571 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:15.339227 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1438/2863] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:58:15 2022] POST /compute/v2.1/servers/e04f7a96-62cb-4aae-9612-aa8df88aef61/action => generated 32 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 20:58:15.346563 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ae1c827f-7824-4338-ac0f-c2ad550c9566 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:58:15.347858 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ae1c827f-7824-4338-ac0f-c2ad550c9566 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] [instance: 70bf65cf-55e2-459a-aaf1-c3eb851a6ccf] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:15.358118 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ae1c827f-7824-4338-ac0f-c2ad550c9566 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:15.360680 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ae1c827f-7824-4338-ac0f-c2ad550c9566 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:15.361924 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ae1c827f-7824-4338-ac0f-c2ad550c9566 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:15.362308 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ae1c827f-7824-4338-ac0f-c2ad550c9566 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:15.426926 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ae1c827f-7824-4338-ac0f-c2ad550c9566 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] 10.222.0.46 "POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action" status: 200 len: 32642 microversion: 2.1 time: 0.085743 Jan 15 20:58:15.428665 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1439/2864] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:58:15 2022] POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action => generated 32642 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:58:15.434903 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-57f60587-d8ef-4fde-bcd6-c0e550024eac tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:15.437993 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-57f60587-d8ef-4fde-bcd6-c0e550024eac tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] [instance: e04f7a96-62cb-4aae-9612-aa8df88aef61] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:15.447345 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-57f60587-d8ef-4fde-bcd6-c0e550024eac tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:15.447345 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-57f60587-d8ef-4fde-bcd6-c0e550024eac tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:15.448330 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-57f60587-d8ef-4fde-bcd6-c0e550024eac tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:15.448870 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-57f60587-d8ef-4fde-bcd6-c0e550024eac tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:15.769991 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-c1c1d07e-624f-42c7-9115-9509bc2b1571 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52bd234a49b24c1a8bb60ad42c0db262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb6e08a94bc415fada171a2eca3e7ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:15.784172 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c1c1d07e-624f-42c7-9115-9509bc2b1571 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] 10.222.0.46 "GET /compute/v2.1/servers/beffc13d-acd3-455e-96d6-be4bcbb81b88" status: 200 len: 1473 microversion: 2.1 time: 0.487087 Jan 15 20:58:15.785268 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1426/2865] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:15 2022] GET /compute/v2.1/servers/beffc13d-acd3-455e-96d6-be4bcbb81b88 => generated 1473 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:15.797145 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-582a12e3-0384-487b-9fcc-836fbc935631 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:15.801749 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-582a12e3-0384-487b-9fcc-836fbc935631 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:15.817552 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-582a12e3-0384-487b-9fcc-836fbc935631 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:15.818390 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-582a12e3-0384-487b-9fcc-836fbc935631 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:15.819464 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-582a12e3-0384-487b-9fcc-836fbc935631 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:15.820143 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-582a12e3-0384-487b-9fcc-836fbc935631 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:15.877439 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-57f60587-d8ef-4fde-bcd6-c0e550024eac tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05483ff6eec84f78a091b29cfbcf61f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a6720be5fb4de7bcd77cc7ef9d8000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:15.888580 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-57f60587-d8ef-4fde-bcd6-c0e550024eac tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] 10.222.0.46 "GET /compute/v2.1/servers/e04f7a96-62cb-4aae-9612-aa8df88aef61" status: 200 len: 1520 microversion: 2.1 time: 0.458294 Jan 15 20:58:15.904037 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1440/2866] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:15 2022] GET /compute/v2.1/servers/e04f7a96-62cb-4aae-9612-aa8df88aef61 => generated 1520 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:15.909806 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a5b64428-f0ef-4dfc-965c-584e978e13b4 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:58:15.910850 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a5b64428-f0ef-4dfc-965c-584e978e13b4 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] [instance: 62ae2a15-8c2c-4dad-971f-0611238103a3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:15.918214 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a5b64428-f0ef-4dfc-965c-584e978e13b4 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:15.918733 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a5b64428-f0ef-4dfc-965c-584e978e13b4 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:15.919876 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a5b64428-f0ef-4dfc-965c-584e978e13b4 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:15.920306 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a5b64428-f0ef-4dfc-965c-584e978e13b4 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:16.007602 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a5b64428-f0ef-4dfc-965c-584e978e13b4 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] 10.222.0.46 "POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action" status: 200 len: 32634 microversion: 2.1 time: 0.101460 Jan 15 20:58:16.009191 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1441/2867] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:58:15 2022] POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action => generated 32634 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:58:16.025450 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-ce752465-10ba-4c4e-a036-1534b3ea5db2 req-2827c504-904b-4648-9e64-b5cd7a1b9e7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2427a640-1c1b-49f4-a98d-bff4af6e596b", "name": "network-vif-unplugged", "status": "completed", "tag": "b0dcfdb5-db07-45b0-99bf-de55b9ceff10"}, {"name": "network-changed", "server_uuid": "2427a640-1c1b-49f4-a98d-bff4af6e596b", "tag": "b0dcfdb5-db07-45b0-99bf-de55b9ceff10"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:58:16.028702 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:58:16.028702 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:58:16.048098 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-ce752465-10ba-4c4e-a036-1534b3ea5db2 req-2827c504-904b-4648-9e64-b5cd7a1b9e7c service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:16.048821 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-ce752465-10ba-4c4e-a036-1534b3ea5db2 req-2827c504-904b-4648-9e64-b5cd7a1b9e7c service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:16.068509 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-ce752465-10ba-4c4e-a036-1534b3ea5db2 req-2827c504-904b-4648-9e64-b5cd7a1b9e7c service nova] Creating event network-vif-unplugged:b0dcfdb5-db07-45b0-99bf-de55b9ceff10 for instance 2427a640-1c1b-49f4-a98d-bff4af6e596b on nch2-master-1 Jan 15 20:58:16.069407 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-ce752465-10ba-4c4e-a036-1534b3ea5db2 req-2827c504-904b-4648-9e64-b5cd7a1b9e7c service nova] Creating event network-changed:b0dcfdb5-db07-45b0-99bf-de55b9ceff10 for instance 2427a640-1c1b-49f4-a98d-bff4af6e596b on nch2-master-1 Jan 15 20:58:16.076629 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-ce752465-10ba-4c4e-a036-1534b3ea5db2 req-2827c504-904b-4648-9e64-b5cd7a1b9e7c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.060060 Jan 15 20:58:16.079068 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1442/2868] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:58:16 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:58:16.104271 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-0a900cde-3058-40ca-9297-738617960bd2 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:16.105825 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-0a900cde-3058-40ca-9297-738617960bd2 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: deef57f9-d933-48ad-a051-e782593799bf] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:16.114556 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0a900cde-3058-40ca-9297-738617960bd2 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:16.115472 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0a900cde-3058-40ca-9297-738617960bd2 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:16.116474 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0a900cde-3058-40ca-9297-738617960bd2 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:16.117247 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0a900cde-3058-40ca-9297-738617960bd2 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:16.244855 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-582a12e3-0384-487b-9fcc-836fbc935631 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:16.271088 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-582a12e3-0384-487b-9fcc-836fbc935631 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9" status: 200 len: 1364 microversion: 2.1 time: 0.481663 Jan 15 20:58:16.273907 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1427/2869] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:15 2022] GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9 => generated 1364 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:16.319866 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-86e176c9-9678-4f81-aeb3-add7d98ab9d6 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:16.324493 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-86e176c9-9678-4f81-aeb3-add7d98ab9d6 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] [instance: 2427a640-1c1b-49f4-a98d-bff4af6e596b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:16.341400 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-86e176c9-9678-4f81-aeb3-add7d98ab9d6 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:16.342928 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-86e176c9-9678-4f81-aeb3-add7d98ab9d6 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:16.345643 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-86e176c9-9678-4f81-aeb3-add7d98ab9d6 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:16.346845 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-86e176c9-9678-4f81-aeb3-add7d98ab9d6 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:16.375480 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-0a900cde-3058-40ca-9297-738617960bd2 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:16.383153 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-0a900cde-3058-40ca-9297-738617960bd2 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/deef57f9-d933-48ad-a051-e782593799bf" status: 200 len: 1511 microversion: 2.1 time: 0.286770 Jan 15 20:58:16.387978 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1443/2870] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:16 2022] GET /compute/v2.1/servers/deef57f9-d933-48ad-a051-e782593799bf => generated 1511 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:58:16.439914 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-89c6e4c1-d166-4373-8e6f-2574aec7efea tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:58:16.440913 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-89c6e4c1-d166-4373-8e6f-2574aec7efea tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] [instance: 70bf65cf-55e2-459a-aaf1-c3eb851a6ccf] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:16.458863 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-89c6e4c1-d166-4373-8e6f-2574aec7efea tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:16.459621 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-89c6e4c1-d166-4373-8e6f-2574aec7efea tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:16.465973 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-89c6e4c1-d166-4373-8e6f-2574aec7efea tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:16.466664 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-89c6e4c1-d166-4373-8e6f-2574aec7efea tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:16.569540 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-89c6e4c1-d166-4373-8e6f-2574aec7efea tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] 10.222.0.46 "POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action" status: 200 len: 32642 microversion: 2.1 time: 0.132068 Jan 15 20:58:16.576004 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1444/2871] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:58:16 2022] POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action => generated 32642 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 20:58:16.641211 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-712f7dd5-cf2d-4465-98fe-8648641bffd3 req-0c8c887f-1646-4271-a0d5-4a8588d39558 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "beffc13d-acd3-455e-96d6-be4bcbb81b88", "name": "network-vif-deleted", "tag": "3de9d3d2-9291-4173-8d0b-3d31a05f6fe6"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:58:16.643610 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:58:16.643610 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:58:16.654447 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-712f7dd5-cf2d-4465-98fe-8648641bffd3 req-0c8c887f-1646-4271-a0d5-4a8588d39558 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:16.655000 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-712f7dd5-cf2d-4465-98fe-8648641bffd3 req-0c8c887f-1646-4271-a0d5-4a8588d39558 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:16.675309 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-712f7dd5-cf2d-4465-98fe-8648641bffd3 req-0c8c887f-1646-4271-a0d5-4a8588d39558 service nova] Creating event network-vif-deleted:3de9d3d2-9291-4173-8d0b-3d31a05f6fe6 for instance beffc13d-acd3-455e-96d6-be4bcbb81b88 on nch1-master-1 Jan 15 20:58:16.677485 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-86e176c9-9678-4f81-aeb3-add7d98ab9d6 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ec114f8ece434aa496cd401494e2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a05b1a0a7479db84b762eca23b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:16.681900 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-712f7dd5-cf2d-4465-98fe-8648641bffd3 req-0c8c887f-1646-4271-a0d5-4a8588d39558 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050224 Jan 15 20:58:16.683317 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1445/2872] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:58:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 20:58:16.689786 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-86e176c9-9678-4f81-aeb3-add7d98ab9d6 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] 10.222.0.46 "GET /compute/v2.1/servers/2427a640-1c1b-49f4-a98d-bff4af6e596b" status: 200 len: 1392 microversion: 2.1 time: 0.381725 Jan 15 20:58:16.690386 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1428/2873] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:16 2022] GET /compute/v2.1/servers/2427a640-1c1b-49f4-a98d-bff4af6e596b => generated 1392 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:16.804576 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a088ebcc-a52c-4361-9e8c-0a900e71eff4 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:16.806037 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a088ebcc-a52c-4361-9e8c-0a900e71eff4 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] [instance: beffc13d-acd3-455e-96d6-be4bcbb81b88] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:16.813694 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a088ebcc-a52c-4361-9e8c-0a900e71eff4 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:16.814533 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a088ebcc-a52c-4361-9e8c-0a900e71eff4 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:16.815406 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a088ebcc-a52c-4361-9e8c-0a900e71eff4 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:16.816099 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a088ebcc-a52c-4361-9e8c-0a900e71eff4 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:16.851050 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a088ebcc-a52c-4361-9e8c-0a900e71eff4 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:16.851712 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a088ebcc-a52c-4361-9e8c-0a900e71eff4 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:16.852707 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.objects.instance [None req-a088ebcc-a52c-4361-9e8c-0a900e71eff4 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lazy-loading 'fault' on Instance uuid beffc13d-acd3-455e-96d6-be4bcbb81b88 {{(pid=129365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 20:58:16.914506 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-2de4ec24-46e3-4978-9198-0fa97a10501c tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:16.925295 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-2de4ec24-46e3-4978-9198-0fa97a10501c tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] [instance: e04f7a96-62cb-4aae-9612-aa8df88aef61] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:16.928763 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-a088ebcc-a52c-4361-9e8c-0a900e71eff4 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52bd234a49b24c1a8bb60ad42c0db262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb6e08a94bc415fada171a2eca3e7ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:16.940685 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2de4ec24-46e3-4978-9198-0fa97a10501c tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:16.943140 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2de4ec24-46e3-4978-9198-0fa97a10501c tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:16.943994 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2de4ec24-46e3-4978-9198-0fa97a10501c tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:16.944439 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2de4ec24-46e3-4978-9198-0fa97a10501c tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:16.951008 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a088ebcc-a52c-4361-9e8c-0a900e71eff4 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] 10.222.0.46 "GET /compute/v2.1/servers/beffc13d-acd3-455e-96d6-be4bcbb81b88" status: 200 len: 1307 microversion: 2.1 time: 0.151559 Jan 15 20:58:16.962367 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1446/2874] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:16 2022] GET /compute/v2.1/servers/beffc13d-acd3-455e-96d6-be4bcbb81b88 => generated 1307 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:58:17.025896 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ffb4febc-3464-41ac-ab80-7e72ed64d895 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:58:17.027214 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ffb4febc-3464-41ac-ab80-7e72ed64d895 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] [instance: 62ae2a15-8c2c-4dad-971f-0611238103a3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:17.051750 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ffb4febc-3464-41ac-ab80-7e72ed64d895 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:17.052210 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ffb4febc-3464-41ac-ab80-7e72ed64d895 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:17.053063 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ffb4febc-3464-41ac-ab80-7e72ed64d895 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:17.059650 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ffb4febc-3464-41ac-ab80-7e72ed64d895 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:17.173192 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ffb4febc-3464-41ac-ab80-7e72ed64d895 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] 10.222.0.46 "POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action" status: 200 len: 32634 microversion: 2.1 time: 0.155784 Jan 15 20:58:17.179946 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1447/2875] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:58:17 2022] POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action => generated 32634 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:58:17.255357 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-2de4ec24-46e3-4978-9198-0fa97a10501c tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05483ff6eec84f78a091b29cfbcf61f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a6720be5fb4de7bcd77cc7ef9d8000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:17.266472 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-2de4ec24-46e3-4978-9198-0fa97a10501c tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] 10.222.0.46 "GET /compute/v2.1/servers/e04f7a96-62cb-4aae-9612-aa8df88aef61" status: 200 len: 1520 microversion: 2.1 time: 0.359532 Jan 15 20:58:17.267270 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1429/2876] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:16 2022] GET /compute/v2.1/servers/e04f7a96-62cb-4aae-9612-aa8df88aef61 => generated 1520 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:17.292378 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8818658a-de8e-46a9-8a4c-9a39a059c3e6 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:17.293731 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-8818658a-de8e-46a9-8a4c-9a39a059c3e6 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:17.308729 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8818658a-de8e-46a9-8a4c-9a39a059c3e6 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:17.310945 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8818658a-de8e-46a9-8a4c-9a39a059c3e6 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:17.311936 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8818658a-de8e-46a9-8a4c-9a39a059c3e6 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:17.313776 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8818658a-de8e-46a9-8a4c-9a39a059c3e6 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:17.360968 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9c3df9e7-7ec8-404c-be20-09bbbe2be454 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'create', calling method: .version_select at 0x7f30c9006b80>, body: {"keypair": {"name": "tempest-keypair-842385728"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:58:17.403678 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-9c3df9e7-7ec8-404c-be20-09bbbe2be454 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Getting quotas for project aa080ba5c4e041ae8960caa9e14da5b5. Resources: {'key_pairs'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:58:17.413680 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-9c3df9e7-7ec8-404c-be20-09bbbe2be454 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Getting quotas for user 36d0deec10a44cf7b451501768112c40 and project aa080ba5c4e041ae8960caa9e14da5b5. Resources: {'key_pairs'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:58:17.500578 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-8818658a-de8e-46a9-8a4c-9a39a059c3e6 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:17.509326 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-8818658a-de8e-46a9-8a4c-9a39a059c3e6 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9" status: 200 len: 1364 microversion: 2.1 time: 0.222066 Jan 15 20:58:17.516170 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1448/2877] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:17 2022] GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9 => generated 1364 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:17.521554 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-6e5f5a96-5dfa-4179-a0a5-eccf13eb9b0d tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:17.530006 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-6e5f5a96-5dfa-4179-a0a5-eccf13eb9b0d tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: deef57f9-d933-48ad-a051-e782593799bf] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:17.538257 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6e5f5a96-5dfa-4179-a0a5-eccf13eb9b0d tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:17.538945 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6e5f5a96-5dfa-4179-a0a5-eccf13eb9b0d tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:17.540076 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6e5f5a96-5dfa-4179-a0a5-eccf13eb9b0d tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:17.540743 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6e5f5a96-5dfa-4179-a0a5-eccf13eb9b0d tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:17.704878 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-6e5f5a96-5dfa-4179-a0a5-eccf13eb9b0d tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:17.714593 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-6e5f5a96-5dfa-4179-a0a5-eccf13eb9b0d tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/deef57f9-d933-48ad-a051-e782593799bf" status: 200 len: 1511 microversion: 2.1 time: 0.196077 Jan 15 20:58:17.721371 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1449/2878] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:17 2022] GET /compute/v2.1/servers/deef57f9-d933-48ad-a051-e782593799bf => generated 1511 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:17.727764 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-4d29a272-73e2-48f6-b91e-047f37e3d2ac tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:58:17.729836 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-4d29a272-73e2-48f6-b91e-047f37e3d2ac tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] [instance: 70bf65cf-55e2-459a-aaf1-c3eb851a6ccf] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:17.741013 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4d29a272-73e2-48f6-b91e-047f37e3d2ac tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:17.741699 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4d29a272-73e2-48f6-b91e-047f37e3d2ac tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:17.742492 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4d29a272-73e2-48f6-b91e-047f37e3d2ac tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:17.743220 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4d29a272-73e2-48f6-b91e-047f37e3d2ac tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:17.786342 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-4d29a272-73e2-48f6-b91e-047f37e3d2ac tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] 10.222.0.46 "POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action" status: 200 len: 32642 microversion: 2.1 time: 0.063104 Jan 15 20:58:17.786987 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1450/2879] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:58:17 2022] POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action => generated 32642 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:58:17.793188 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-553c7d23-4983-47ad-8e93-fb8984ec7a3a tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:17.793882 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-553c7d23-4983-47ad-8e93-fb8984ec7a3a tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] [instance: 2427a640-1c1b-49f4-a98d-bff4af6e596b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:17.802017 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-553c7d23-4983-47ad-8e93-fb8984ec7a3a tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:17.802461 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-553c7d23-4983-47ad-8e93-fb8984ec7a3a tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:17.803241 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-553c7d23-4983-47ad-8e93-fb8984ec7a3a tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:17.803669 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-553c7d23-4983-47ad-8e93-fb8984ec7a3a tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:17.831334 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-9c3df9e7-7ec8-404c-be20-09bbbe2be454 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Getting quotas for project aa080ba5c4e041ae8960caa9e14da5b5. Resources: {'key_pairs'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:58:17.836234 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-9c3df9e7-7ec8-404c-be20-09bbbe2be454 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Getting quotas for user 36d0deec10a44cf7b451501768112c40 and project aa080ba5c4e041ae8960caa9e14da5b5. Resources: {'key_pairs'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:58:17.850650 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-9c3df9e7-7ec8-404c-be20-09bbbe2be454 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.42 time: 0.493526 Jan 15 20:58:17.851265 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1430/2880] 10.222.0.46 () {62 vars in 1198 bytes} [Sat Jan 15 20:58:17 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 495 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Jan 15 20:58:17.947767 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-553c7d23-4983-47ad-8e93-fb8984ec7a3a tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ec114f8ece434aa496cd401494e2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a05b1a0a7479db84b762eca23b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:17.956108 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-553c7d23-4983-47ad-8e93-fb8984ec7a3a tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] 10.222.0.46 "GET /compute/v2.1/servers/2427a640-1c1b-49f4-a98d-bff4af6e596b" status: 200 len: 1392 microversion: 2.1 time: 0.167467 Jan 15 20:58:17.965852 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1451/2881] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:17 2022] GET /compute/v2.1/servers/2427a640-1c1b-49f4-a98d-bff4af6e596b => generated 1392 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:17.968065 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-89bc7fa4-6a9d-4967-8f1f-197eb948c8bf tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:17.968821 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-89bc7fa4-6a9d-4967-8f1f-197eb948c8bf tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] [instance: beffc13d-acd3-455e-96d6-be4bcbb81b88] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:17.974994 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-89bc7fa4-6a9d-4967-8f1f-197eb948c8bf tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:17.975420 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-89bc7fa4-6a9d-4967-8f1f-197eb948c8bf tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:17.976287 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-89bc7fa4-6a9d-4967-8f1f-197eb948c8bf tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:17.976683 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-89bc7fa4-6a9d-4967-8f1f-197eb948c8bf tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:17.992182 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-89bc7fa4-6a9d-4967-8f1f-197eb948c8bf tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] HTTP exception thrown: Instance beffc13d-acd3-455e-96d6-be4bcbb81b88 could not be found. Jan 15 20:58:17.993512 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-89bc7fa4-6a9d-4967-8f1f-197eb948c8bf tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Returning 404 to user: Instance beffc13d-acd3-455e-96d6-be4bcbb81b88 could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:58:17.994541 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-89bc7fa4-6a9d-4967-8f1f-197eb948c8bf tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] 10.222.0.46 "GET /compute/v2.1/servers/beffc13d-acd3-455e-96d6-be4bcbb81b88" status: 404 len: 111 microversion: 2.1 time: 0.030941 Jan 15 20:58:17.995302 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1431/2882] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:17 2022] GET /compute/v2.1/servers/beffc13d-acd3-455e-96d6-be4bcbb81b88 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:58:18.004429 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-eeb83970-9ea0-4488-90b2-ee303de5c5a3 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:18.008750 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-eeb83970-9ea0-4488-90b2-ee303de5c5a3 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] [instance: bffd829f-bc6e-40a7-a9d8-59af77e5b10d] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:18.012239 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-eeb83970-9ea0-4488-90b2-ee303de5c5a3 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:18.012753 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-eeb83970-9ea0-4488-90b2-ee303de5c5a3 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:18.013665 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-eeb83970-9ea0-4488-90b2-ee303de5c5a3 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:18.014438 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-eeb83970-9ea0-4488-90b2-ee303de5c5a3 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:18.047261 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-eeb83970-9ea0-4488-90b2-ee303de5c5a3 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] [instance: bffd829f-bc6e-40a7-a9d8-59af77e5b10d] Going to try to terminate instance {{(pid=129365) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 20:58:18.125402 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-eeb83970-9ea0-4488-90b2-ee303de5c5a3 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] 10.222.0.46 "DELETE /compute/v2.1/servers/bffd829f-bc6e-40a7-a9d8-59af77e5b10d" status: 204 len: 0 microversion: 2.1 time: 0.125357 Jan 15 20:58:18.126377 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1452/2883] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 20:58:17 2022] DELETE /compute/v2.1/servers/bffd829f-bc6e-40a7-a9d8-59af77e5b10d => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 20:58:18.135110 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-171f6e3b-d0d3-49c3-a07b-37b51e842198 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:18.135650 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-171f6e3b-d0d3-49c3-a07b-37b51e842198 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] [instance: bffd829f-bc6e-40a7-a9d8-59af77e5b10d] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:18.143146 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-171f6e3b-d0d3-49c3-a07b-37b51e842198 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:18.143609 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-171f6e3b-d0d3-49c3-a07b-37b51e842198 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:18.144417 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-171f6e3b-d0d3-49c3-a07b-37b51e842198 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:18.144892 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-171f6e3b-d0d3-49c3-a07b-37b51e842198 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:18.189846 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8914cc17-898d-4412-afd3-3527223e6832 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:58:18.191494 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-8914cc17-898d-4412-afd3-3527223e6832 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] [instance: 62ae2a15-8c2c-4dad-971f-0611238103a3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:18.198092 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8914cc17-898d-4412-afd3-3527223e6832 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:18.198628 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8914cc17-898d-4412-afd3-3527223e6832 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:18.199615 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8914cc17-898d-4412-afd3-3527223e6832 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:18.200118 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8914cc17-898d-4412-afd3-3527223e6832 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:18.245614 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-8914cc17-898d-4412-afd3-3527223e6832 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] 10.222.0.46 "POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action" status: 200 len: 32634 microversion: 2.1 time: 0.061415 Jan 15 20:58:18.246673 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1453/2884] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:58:18 2022] POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action => generated 32634 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 20:58:18.285441 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-4264dfa1-3ba9-4519-97f2-32fe61187820 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:18.286214 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-4264dfa1-3ba9-4519-97f2-32fe61187820 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] [instance: e04f7a96-62cb-4aae-9612-aa8df88aef61] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:18.292684 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-171f6e3b-d0d3-49c3-a07b-37b51e842198 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52bd234a49b24c1a8bb60ad42c0db262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb6e08a94bc415fada171a2eca3e7ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:18.294769 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4264dfa1-3ba9-4519-97f2-32fe61187820 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:18.295121 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4264dfa1-3ba9-4519-97f2-32fe61187820 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:18.296442 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4264dfa1-3ba9-4519-97f2-32fe61187820 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:18.296988 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4264dfa1-3ba9-4519-97f2-32fe61187820 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:18.301100 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-171f6e3b-d0d3-49c3-a07b-37b51e842198 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] 10.222.0.46 "GET /compute/v2.1/servers/bffd829f-bc6e-40a7-a9d8-59af77e5b10d" status: 200 len: 1473 microversion: 2.1 time: 0.170227 Jan 15 20:58:18.301998 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1432/2885] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:18 2022] GET /compute/v2.1/servers/bffd829f-bc6e-40a7-a9d8-59af77e5b10d => generated 1473 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:58:18.443769 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-4264dfa1-3ba9-4519-97f2-32fe61187820 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05483ff6eec84f78a091b29cfbcf61f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a6720be5fb4de7bcd77cc7ef9d8000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:18.451954 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-4264dfa1-3ba9-4519-97f2-32fe61187820 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] 10.222.0.46 "GET /compute/v2.1/servers/e04f7a96-62cb-4aae-9612-aa8df88aef61" status: 200 len: 1520 microversion: 2.1 time: 0.170855 Jan 15 20:58:18.453237 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1454/2886] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:18 2022] GET /compute/v2.1/servers/e04f7a96-62cb-4aae-9612-aa8df88aef61 => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:58:18.533365 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-cbfb0c11-ef82-4908-9b42-141614568dbc tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:18.534113 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-cbfb0c11-ef82-4908-9b42-141614568dbc tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:18.543033 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cbfb0c11-ef82-4908-9b42-141614568dbc tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:18.543488 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cbfb0c11-ef82-4908-9b42-141614568dbc tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:18.544571 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cbfb0c11-ef82-4908-9b42-141614568dbc tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:18.545063 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cbfb0c11-ef82-4908-9b42-141614568dbc tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:18.688748 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-cbfb0c11-ef82-4908-9b42-141614568dbc tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:18.698102 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-cbfb0c11-ef82-4908-9b42-141614568dbc tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9" status: 200 len: 1364 microversion: 2.1 time: 0.169010 Jan 15 20:58:18.698682 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1433/2887] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:18 2022] GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9 => generated 1364 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:18.731784 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-1af8ac47-618a-4f08-a779-9e2068b93ec3 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:18.732403 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-1af8ac47-618a-4f08-a779-9e2068b93ec3 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: deef57f9-d933-48ad-a051-e782593799bf] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:18.738853 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1af8ac47-618a-4f08-a779-9e2068b93ec3 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:18.739454 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1af8ac47-618a-4f08-a779-9e2068b93ec3 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:18.740324 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1af8ac47-618a-4f08-a779-9e2068b93ec3 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:18.740871 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1af8ac47-618a-4f08-a779-9e2068b93ec3 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:18.798868 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-53d885be-f674-475a-b773-708f5380b3c5 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:58:18.799972 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-53d885be-f674-475a-b773-708f5380b3c5 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] [instance: 70bf65cf-55e2-459a-aaf1-c3eb851a6ccf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:18.808502 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-53d885be-f674-475a-b773-708f5380b3c5 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:18.808998 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-53d885be-f674-475a-b773-708f5380b3c5 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:18.809824 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-53d885be-f674-475a-b773-708f5380b3c5 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:18.810461 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-53d885be-f674-475a-b773-708f5380b3c5 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:18.856056 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-53d885be-f674-475a-b773-708f5380b3c5 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] 10.222.0.46 "POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action" status: 200 len: 32642 microversion: 2.1 time: 0.060273 Jan 15 20:58:18.857270 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1434/2888] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:58:18 2022] POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action => generated 32642 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 20:58:18.886436 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-1af8ac47-618a-4f08-a779-9e2068b93ec3 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:18.894066 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-1af8ac47-618a-4f08-a779-9e2068b93ec3 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/deef57f9-d933-48ad-a051-e782593799bf" status: 200 len: 1511 microversion: 2.1 time: 0.166252 Jan 15 20:58:18.894739 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1455/2889] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:18 2022] GET /compute/v2.1/servers/deef57f9-d933-48ad-a051-e782593799bf => generated 1511 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:18.973785 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d3b88d4e-7da9-4769-9049-24668326cea3 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:18.974478 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-d3b88d4e-7da9-4769-9049-24668326cea3 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] [instance: 2427a640-1c1b-49f4-a98d-bff4af6e596b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:18.982387 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d3b88d4e-7da9-4769-9049-24668326cea3 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:18.982836 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d3b88d4e-7da9-4769-9049-24668326cea3 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:18.983617 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d3b88d4e-7da9-4769-9049-24668326cea3 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:18.984049 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d3b88d4e-7da9-4769-9049-24668326cea3 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:19.141139 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-d3b88d4e-7da9-4769-9049-24668326cea3 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ec114f8ece434aa496cd401494e2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a05b1a0a7479db84b762eca23b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:19.148723 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d3b88d4e-7da9-4769-9049-24668326cea3 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] 10.222.0.46 "GET /compute/v2.1/servers/2427a640-1c1b-49f4-a98d-bff4af6e596b" status: 200 len: 1392 microversion: 2.1 time: 0.178818 Jan 15 20:58:19.150836 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1435/2890] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:18 2022] GET /compute/v2.1/servers/2427a640-1c1b-49f4-a98d-bff4af6e596b => generated 1392 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:19.224177 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8e5e2704-fa40-4e20-9c42-f54d20bd5884 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1946480249", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "f1abede3-ecab-4e83-a1da-6cc70da90e11"}, {"port": "5a70acfe-3b12-4c47-a821-8552633f0121", "tag": "port-1"}, {"port": "90ef8468-1684-4743-ae03-c3725fd41a73", "tag": "port-2"}, {"uuid": "0ef2cc14-9e80-4859-a806-4f8642660717", "tag": "net-1"}, {"uuid": "0ef2cc14-9e80-4859-a806-4f8642660717"}, {"uuid": "878a0e81-034a-4a83-abcb-c15907086183", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "878a0e81-034a-4a83-abcb-c15907086183", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "a68031b5-01be-4dd2-bc8c-bd643fdc53d4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "c24f9c1b-c425-47b2-b6ea-c6857a68ebe8", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "efb00e0a-c1d0-490c-b037-a9ff38a1ecac", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1480249324"}], "key_name": "tempest-keypair-842385728", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:58:19.256929 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-6ef5850a-92b3-41f3-8848-cbaadf4a6a9e tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:58:19.257902 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-6ef5850a-92b3-41f3-8848-cbaadf4a6a9e tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] [instance: 62ae2a15-8c2c-4dad-971f-0611238103a3] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:19.267526 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6ef5850a-92b3-41f3-8848-cbaadf4a6a9e tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:19.268203 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6ef5850a-92b3-41f3-8848-cbaadf4a6a9e tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:19.269206 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6ef5850a-92b3-41f3-8848-cbaadf4a6a9e tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:19.269800 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6ef5850a-92b3-41f3-8848-cbaadf4a6a9e tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:19.327672 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-6ef5850a-92b3-41f3-8848-cbaadf4a6a9e tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] 10.222.0.46 "POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action" status: 200 len: 32634 microversion: 2.1 time: 0.074148 Jan 15 20:58:19.328332 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1436/2891] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:58:19 2022] POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action => generated 32634 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 20:58:19.334882 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9bcb343f-e90e-4c5d-96e3-f3cb8e219b75 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:19.335789 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-9bcb343f-e90e-4c5d-96e3-f3cb8e219b75 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] [instance: bffd829f-bc6e-40a7-a9d8-59af77e5b10d] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:19.344095 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9bcb343f-e90e-4c5d-96e3-f3cb8e219b75 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:19.344798 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9bcb343f-e90e-4c5d-96e3-f3cb8e219b75 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:19.345601 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9bcb343f-e90e-4c5d-96e3-f3cb8e219b75 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:19.346248 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9bcb343f-e90e-4c5d-96e3-f3cb8e219b75 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:19.377769 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.network.neutron [None req-8e5e2704-fa40-4e20-9c42-f54d20bd5884 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] validate_networks() for [('f1abede3-ecab-4e83-a1da-6cc70da90e11', None, None, None, None, None), (None, None, '5a70acfe-3b12-4c47-a821-8552633f0121', None, None, None), (None, None, '90ef8468-1684-4743-ae03-c3725fd41a73', None, None, None), ('0ef2cc14-9e80-4859-a806-4f8642660717', None, None, None, None, None), ('0ef2cc14-9e80-4859-a806-4f8642660717', None, None, None, None, None), ('878a0e81-034a-4a83-abcb-c15907086183', '10.2.2.100', None, None, None, None), ('878a0e81-034a-4a83-abcb-c15907086183', '10.2.2.200', None, None, None, None)] {{(pid=129365) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 20:58:19.962345 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-9bcb343f-e90e-4c5d-96e3-f3cb8e219b75 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52bd234a49b24c1a8bb60ad42c0db262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb6e08a94bc415fada171a2eca3e7ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:19.970288 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-9bcb343f-e90e-4c5d-96e3-f3cb8e219b75 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] 10.222.0.46 "GET /compute/v2.1/servers/bffd829f-bc6e-40a7-a9d8-59af77e5b10d" status: 200 len: 1473 microversion: 2.1 time: 0.640553 Jan 15 20:58:19.971102 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1437/2892] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:19 2022] GET /compute/v2.1/servers/bffd829f-bc6e-40a7-a9d8-59af77e5b10d => generated 1473 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:19.975945 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-9c4f44da-0d58-4339-9920-39d2bd60229e req-6b4bd4cc-ae11-4548-a6c3-2d8afc0a2993 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4504a13b-d10e-436a-a5ef-991829938dd9", "name": "network-vif-plugged", "status": "completed", "tag": "f7503e3b-a43e-4550-8109-a1fb1aa2d5f1"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:58:19.981181 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:58:19.981181 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:58:19.989154 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-9c4f44da-0d58-4339-9920-39d2bd60229e req-6b4bd4cc-ae11-4548-a6c3-2d8afc0a2993 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:19.989807 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-9c4f44da-0d58-4339-9920-39d2bd60229e req-6b4bd4cc-ae11-4548-a6c3-2d8afc0a2993 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:20.002612 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-9c4f44da-0d58-4339-9920-39d2bd60229e req-6b4bd4cc-ae11-4548-a6c3-2d8afc0a2993 service nova] Creating event network-vif-plugged:f7503e3b-a43e-4550-8109-a1fb1aa2d5f1 for instance 4504a13b-d10e-436a-a5ef-991829938dd9 on nch1-master-1 Jan 15 20:58:20.008708 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-9c4f44da-0d58-4339-9920-39d2bd60229e req-6b4bd4cc-ae11-4548-a6c3-2d8afc0a2993 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035610 Jan 15 20:58:20.009913 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1438/2893] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:58:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:58:20.016809 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e575621f-2c0a-4590-a6ad-57ff87362734 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:20.017566 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e575621f-2c0a-4590-a6ad-57ff87362734 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] [instance: e04f7a96-62cb-4aae-9612-aa8df88aef61] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:20.024541 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e575621f-2c0a-4590-a6ad-57ff87362734 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:20.025026 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e575621f-2c0a-4590-a6ad-57ff87362734 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:20.025826 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e575621f-2c0a-4590-a6ad-57ff87362734 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:20.026264 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e575621f-2c0a-4590-a6ad-57ff87362734 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:20.345556 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-e575621f-2c0a-4590-a6ad-57ff87362734 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05483ff6eec84f78a091b29cfbcf61f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a6720be5fb4de7bcd77cc7ef9d8000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:20.354841 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e575621f-2c0a-4590-a6ad-57ff87362734 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] 10.222.0.46 "GET /compute/v2.1/servers/e04f7a96-62cb-4aae-9612-aa8df88aef61" status: 200 len: 1520 microversion: 2.1 time: 0.343089 Jan 15 20:58:20.363805 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1439/2894] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:20 2022] GET /compute/v2.1/servers/e04f7a96-62cb-4aae-9612-aa8df88aef61 => generated 1520 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:20.369146 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-6ec9215d-eb87-4094-8e6f-52601ada3644 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:20.369882 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-6ec9215d-eb87-4094-8e6f-52601ada3644 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:20.376867 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6ec9215d-eb87-4094-8e6f-52601ada3644 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:20.377431 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6ec9215d-eb87-4094-8e6f-52601ada3644 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:20.378404 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6ec9215d-eb87-4094-8e6f-52601ada3644 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:20.378917 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6ec9215d-eb87-4094-8e6f-52601ada3644 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:20.623780 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-6ec9215d-eb87-4094-8e6f-52601ada3644 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:20.631588 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-6ec9215d-eb87-4094-8e6f-52601ada3644 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9" status: 200 len: 1364 microversion: 2.1 time: 0.266544 Jan 15 20:58:20.641433 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1440/2895] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:20 2022] GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9 => generated 1364 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:20.641433 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0b45086f-8553-42d9-b50b-32d42498615a tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:58:20.641433 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-0b45086f-8553-42d9-b50b-32d42498615a tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] [instance: 70bf65cf-55e2-459a-aaf1-c3eb851a6ccf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:20.645394 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0b45086f-8553-42d9-b50b-32d42498615a tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:20.645848 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0b45086f-8553-42d9-b50b-32d42498615a tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:20.646634 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0b45086f-8553-42d9-b50b-32d42498615a tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:20.647259 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0b45086f-8553-42d9-b50b-32d42498615a tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:21.278749 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0b45086f-8553-42d9-b50b-32d42498615a tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] 10.222.0.46 "POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action" status: 200 len: 40793 microversion: 2.1 time: 0.644930 Jan 15 20:58:21.280091 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1441/2896] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:58:20 2022] POST /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf/action => generated 40793 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:58:21.293279 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c0a0c8a6-e4b8-42ec-98db-827e24ef6a20 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:21.294741 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c0a0c8a6-e4b8-42ec-98db-827e24ef6a20 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: deef57f9-d933-48ad-a051-e782593799bf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:21.306640 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c0a0c8a6-e4b8-42ec-98db-827e24ef6a20 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:21.307394 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c0a0c8a6-e4b8-42ec-98db-827e24ef6a20 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:21.308188 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c0a0c8a6-e4b8-42ec-98db-827e24ef6a20 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:21.308618 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c0a0c8a6-e4b8-42ec-98db-827e24ef6a20 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:21.577716 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-c0a0c8a6-e4b8-42ec-98db-827e24ef6a20 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:21.586242 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c0a0c8a6-e4b8-42ec-98db-827e24ef6a20 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/deef57f9-d933-48ad-a051-e782593799bf" status: 200 len: 1511 microversion: 2.1 time: 0.304796 Jan 15 20:58:21.587062 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1442/2897] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:21 2022] GET /compute/v2.1/servers/deef57f9-d933-48ad-a051-e782593799bf => generated 1511 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:21.593162 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-efedfac2-f4a5-4dd7-a94a-5ac594b55b1b tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:21.594618 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-efedfac2-f4a5-4dd7-a94a-5ac594b55b1b tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] [instance: 2427a640-1c1b-49f4-a98d-bff4af6e596b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:21.601281 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-efedfac2-f4a5-4dd7-a94a-5ac594b55b1b tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:21.602575 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-efedfac2-f4a5-4dd7-a94a-5ac594b55b1b tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:21.603829 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-efedfac2-f4a5-4dd7-a94a-5ac594b55b1b tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:21.604270 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-efedfac2-f4a5-4dd7-a94a-5ac594b55b1b tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:21.850086 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-efedfac2-f4a5-4dd7-a94a-5ac594b55b1b tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ec114f8ece434aa496cd401494e2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a05b1a0a7479db84b762eca23b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:21.857952 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-efedfac2-f4a5-4dd7-a94a-5ac594b55b1b tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] 10.222.0.46 "GET /compute/v2.1/servers/2427a640-1c1b-49f4-a98d-bff4af6e596b" status: 200 len: 1382 microversion: 2.1 time: 0.269710 Jan 15 20:58:21.858533 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1443/2898] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:21 2022] GET /compute/v2.1/servers/2427a640-1c1b-49f4-a98d-bff4af6e596b => generated 1382 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:21.864227 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9600e02b-a5ef-421b-a9ed-687f73947a7b tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:58:21.865220 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-9600e02b-a5ef-421b-a9ed-687f73947a7b tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] [instance: 62ae2a15-8c2c-4dad-971f-0611238103a3] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:21.872120 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9600e02b-a5ef-421b-a9ed-687f73947a7b tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:21.872574 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9600e02b-a5ef-421b-a9ed-687f73947a7b tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:21.873405 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9600e02b-a5ef-421b-a9ed-687f73947a7b tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:21.873847 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9600e02b-a5ef-421b-a9ed-687f73947a7b tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:21.919511 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-9600e02b-a5ef-421b-a9ed-687f73947a7b tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] 10.222.0.46 "POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action" status: 200 len: 32634 microversion: 2.1 time: 0.059394 Jan 15 20:58:21.920813 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1444/2899] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:58:21 2022] POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action => generated 32634 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:58:21.925353 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-2dba6273-31aa-46b3-9260-aef8ccfac2c6 req-cb93e817-628d-4aee-ace3-42f2dab83ff6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bffd829f-bc6e-40a7-a9d8-59af77e5b10d", "name": "network-vif-deleted", "tag": "8b8cea34-6f8d-4a83-aaae-cfea3dbff75c"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:58:21.926831 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:58:21.926831 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:58:21.935409 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-2dba6273-31aa-46b3-9260-aef8ccfac2c6 req-cb93e817-628d-4aee-ace3-42f2dab83ff6 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:21.935846 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-2dba6273-31aa-46b3-9260-aef8ccfac2c6 req-cb93e817-628d-4aee-ace3-42f2dab83ff6 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:21.950351 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-2dba6273-31aa-46b3-9260-aef8ccfac2c6 req-cb93e817-628d-4aee-ace3-42f2dab83ff6 service nova] Creating event network-vif-deleted:8b8cea34-6f8d-4a83-aaae-cfea3dbff75c for instance bffd829f-bc6e-40a7-a9d8-59af77e5b10d on nch2-master-1 Jan 15 20:58:21.955020 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-2dba6273-31aa-46b3-9260-aef8ccfac2c6 req-cb93e817-628d-4aee-ace3-42f2dab83ff6 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033611 Jan 15 20:58:21.955626 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1445/2900] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:58:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:58:21.963383 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-6aaa2f05-2b34-4a43-838f-299e3d6cfb83 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:21.964063 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-6aaa2f05-2b34-4a43-838f-299e3d6cfb83 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] [instance: bffd829f-bc6e-40a7-a9d8-59af77e5b10d] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:21.970509 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6aaa2f05-2b34-4a43-838f-299e3d6cfb83 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:21.970955 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6aaa2f05-2b34-4a43-838f-299e3d6cfb83 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:21.971724 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6aaa2f05-2b34-4a43-838f-299e3d6cfb83 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:21.972151 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6aaa2f05-2b34-4a43-838f-299e3d6cfb83 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:21.985354 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-6aaa2f05-2b34-4a43-838f-299e3d6cfb83 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] HTTP exception thrown: Instance bffd829f-bc6e-40a7-a9d8-59af77e5b10d could not be found. Jan 15 20:58:21.985939 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-6aaa2f05-2b34-4a43-838f-299e3d6cfb83 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Returning 404 to user: Instance bffd829f-bc6e-40a7-a9d8-59af77e5b10d could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:58:21.986754 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-6aaa2f05-2b34-4a43-838f-299e3d6cfb83 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] 10.222.0.46 "GET /compute/v2.1/servers/bffd829f-bc6e-40a7-a9d8-59af77e5b10d" status: 404 len: 111 microversion: 2.1 time: 0.027157 Jan 15 20:58:21.987305 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1446/2901] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:21 2022] GET /compute/v2.1/servers/bffd829f-bc6e-40a7-a9d8-59af77e5b10d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:58:21.991763 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ca77e6cd-1a21-4b8e-90fc-4e9098e7a74a tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:21.992347 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ca77e6cd-1a21-4b8e-90fc-4e9098e7a74a tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] [instance: e04f7a96-62cb-4aae-9612-aa8df88aef61] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:21.998697 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ca77e6cd-1a21-4b8e-90fc-4e9098e7a74a tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:21.999142 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ca77e6cd-1a21-4b8e-90fc-4e9098e7a74a tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:21.999914 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ca77e6cd-1a21-4b8e-90fc-4e9098e7a74a tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:22.000348 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ca77e6cd-1a21-4b8e-90fc-4e9098e7a74a tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:22.160254 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-8e5e2704-fa40-4e20-9c42-f54d20bd5884 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Flavor limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 20:58:22.160254 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-8e5e2704-fa40-4e20-9c42-f54d20bd5884 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Image limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 20:58:22.160918 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-8e5e2704-fa40-4e20-9c42-f54d20bd5884 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Flavor pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 20:58:22.161176 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-8e5e2704-fa40-4e20-9c42-f54d20bd5884 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Image pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 20:58:22.161782 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-8e5e2704-fa40-4e20-9c42-f54d20bd5884 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 20:58:22.174064 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8e5e2704-fa40-4e20-9c42-f54d20bd5884 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:22.174520 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8e5e2704-fa40-4e20-9c42-f54d20bd5884 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:22.175547 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8e5e2704-fa40-4e20-9c42-f54d20bd5884 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:22.175990 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8e5e2704-fa40-4e20-9c42-f54d20bd5884 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:22.194197 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-8e5e2704-fa40-4e20-9c42-f54d20bd5884 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Getting quotas for project aa080ba5c4e041ae8960caa9e14da5b5. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:58:22.200104 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-ca77e6cd-1a21-4b8e-90fc-4e9098e7a74a tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05483ff6eec84f78a091b29cfbcf61f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a6720be5fb4de7bcd77cc7ef9d8000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:22.200386 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-8e5e2704-fa40-4e20-9c42-f54d20bd5884 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Getting quotas for user 36d0deec10a44cf7b451501768112c40 and project aa080ba5c4e041ae8960caa9e14da5b5. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:58:22.207984 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ca77e6cd-1a21-4b8e-90fc-4e9098e7a74a tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] 10.222.0.46 "GET /compute/v2.1/servers/e04f7a96-62cb-4aae-9612-aa8df88aef61" status: 200 len: 1520 microversion: 2.1 time: 0.219741 Jan 15 20:58:22.218310 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1447/2902] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:21 2022] GET /compute/v2.1/servers/e04f7a96-62cb-4aae-9612-aa8df88aef61 => generated 1520 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:22.218310 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8011ab36-4d0d-406e-a717-80f9eea835c6 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:22.218310 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-8011ab36-4d0d-406e-a717-80f9eea835c6 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:22.221110 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8011ab36-4d0d-406e-a717-80f9eea835c6 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:22.221563 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8011ab36-4d0d-406e-a717-80f9eea835c6 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:22.222352 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8011ab36-4d0d-406e-a717-80f9eea835c6 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:22.223216 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8011ab36-4d0d-406e-a717-80f9eea835c6 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:22.359698 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-8011ab36-4d0d-406e-a717-80f9eea835c6 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:22.364785 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-8e5e2704-fa40-4e20-9c42-f54d20bd5884 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Going to run 1 instances... {{(pid=129365) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 20:58:22.367613 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-8e5e2704-fa40-4e20-9c42-f54d20bd5884 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='a68031b5-01be-4dd2-bc8c-bd643fdc53d4',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='c24f9c1b-c425-47b2-b6ea-c6857a68ebe8',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='efb00e0a-c1d0-490c-b037-a9ff38a1ecac',volume_size=None,volume_type=None)] {{(pid=129365) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 20:58:22.372331 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-8011ab36-4d0d-406e-a717-80f9eea835c6 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9" status: 200 len: 1364 microversion: 2.1 time: 0.162427 Jan 15 20:58:22.373344 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1448/2903] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:22 2022] GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9 => generated 1364 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:22.377910 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-2b7d7696-1d12-4a13-a371-0636a56c2ebb tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Calling method '.version_select at 0x7f30c8ec9f70>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:22.379416 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-migrations:index": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:58:22.379416 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:58:22.380931 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2b7d7696-1d12-4a13-a371-0636a56c2ebb tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:22.381374 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2b7d7696-1d12-4a13-a371-0636a56c2ebb tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:22.391000 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-2b7d7696-1d12-4a13-a371-0636a56c2ebb tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] 10.222.0.46 "GET /compute/v2.1/os-migrations" status: 200 len: 1553 microversion: 2.1 time: 0.016590 Jan 15 20:58:22.391600 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1449/2904] 10.222.0.46 () {58 vars in 1142 bytes} [Sat Jan 15 20:58:22 2022] GET /compute/v2.1/os-migrations => generated 1553 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:22.395708 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f4012c25-a69f-4fdc-96c2-6191cba1e5f1 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Calling method '.version_select at 0x7f30c8e35040>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:22.627358 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f4012c25-a69f-4fdc-96c2-6191cba1e5f1 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] 10.222.0.46 "DELETE /compute/v2.1/images/b30c308a-aac8-4ea4-8059-c644a0860c32" status: 204 len: 0 microversion: 2.1 time: 0.234739 Jan 15 20:58:22.627923 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1450/2905] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:22 2022] DELETE /compute/v2.1/images/b30c308a-aac8-4ea4-8059-c644a0860c32 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 20:58:22.632712 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d238df58-f6f0-4f95-8b11-4837183d2ba8 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:22.633671 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-d238df58-f6f0-4f95-8b11-4837183d2ba8 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] [instance: 70bf65cf-55e2-459a-aaf1-c3eb851a6ccf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:22.640084 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d238df58-f6f0-4f95-8b11-4837183d2ba8 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:22.640648 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d238df58-f6f0-4f95-8b11-4837183d2ba8 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:22.641489 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d238df58-f6f0-4f95-8b11-4837183d2ba8 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:22.641922 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d238df58-f6f0-4f95-8b11-4837183d2ba8 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:22.672262 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-d238df58-f6f0-4f95-8b11-4837183d2ba8 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] [instance: 70bf65cf-55e2-459a-aaf1-c3eb851a6ccf] Going to try to terminate instance {{(pid=129366) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 20:58:22.682056 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-8e5e2704-fa40-4e20-9c42-f54d20bd5884 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.42 time: 3.461346 Jan 15 20:58:22.683056 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1456/2906] 10.222.0.46 () {62 vars in 1188 bytes} [Sat Jan 15 20:58:19 2022] POST /compute/v2.1/servers => generated 406 bytes in 3463 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jan 15 20:58:22.687436 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d9ece9aa-87d1-4cd2-a39f-fcc5eca20109 tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:22.688041 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d9ece9aa-87d1-4cd2-a39f-fcc5eca20109 tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] [instance: 2427a640-1c1b-49f4-a98d-bff4af6e596b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:22.694224 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d9ece9aa-87d1-4cd2-a39f-fcc5eca20109 tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:22.694874 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d9ece9aa-87d1-4cd2-a39f-fcc5eca20109 tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:22.696137 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d9ece9aa-87d1-4cd2-a39f-fcc5eca20109 tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:22.698303 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d9ece9aa-87d1-4cd2-a39f-fcc5eca20109 tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:22.806206 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d238df58-f6f0-4f95-8b11-4837183d2ba8 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] 10.222.0.46 "DELETE /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf" status: 204 len: 0 microversion: 2.1 time: 0.176388 Jan 15 20:58:22.807668 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1451/2907] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 20:58:22 2022] DELETE /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 20:58:22.816550 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-cacb9833-2ede-4cea-8d89-163dc5b62d80 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:22.817354 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-cacb9833-2ede-4cea-8d89-163dc5b62d80 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: deef57f9-d933-48ad-a051-e782593799bf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:22.824347 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cacb9833-2ede-4cea-8d89-163dc5b62d80 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:22.824540 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cacb9833-2ede-4cea-8d89-163dc5b62d80 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:22.825372 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cacb9833-2ede-4cea-8d89-163dc5b62d80 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:22.826059 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cacb9833-2ede-4cea-8d89-163dc5b62d80 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:22.870342 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d9ece9aa-87d1-4cd2-a39f-fcc5eca20109 tempest-LiveMigrationTest-46717820 tempest-LiveMigrationTest-46717820-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/2427a640-1c1b-49f4-a98d-bff4af6e596b" status: 200 len: 1533 microversion: 2.1 time: 0.185806 Jan 15 20:58:22.871243 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1457/2908] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:22 2022] GET /compute/v2.1/servers/2427a640-1c1b-49f4-a98d-bff4af6e596b => generated 1533 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:22.875700 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-808b0b5a-b848-4fcf-bd25-2e9976edcf53 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Calling method '.version_select at 0x7f30c9111af0>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:23.010939 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-cacb9833-2ede-4cea-8d89-163dc5b62d80 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:23.024402 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-cacb9833-2ede-4cea-8d89-163dc5b62d80 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/deef57f9-d933-48ad-a051-e782593799bf" status: 200 len: 1511 microversion: 2.1 time: 0.214314 Jan 15 20:58:23.025618 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1452/2909] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:22 2022] GET /compute/v2.1/servers/deef57f9-d933-48ad-a051-e782593799bf => generated 1511 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:23.030847 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b2fdf2ec-5167-441b-8aa2-207876e5527e tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:23.031451 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b2fdf2ec-5167-441b-8aa2-207876e5527e tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:23.105252 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-b2fdf2ec-5167-441b-8aa2-207876e5527e tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:23.114444 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-b2fdf2ec-5167-441b-8aa2-207876e5527e tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:23.116375 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-b2fdf2ec-5167-441b-8aa2-207876e5527e tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:23.118869 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b2fdf2ec-5167-441b-8aa2-207876e5527e tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "GET /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee" status: 200 len: 1285 microversion: 2.42 time: 0.091858 Jan 15 20:58:23.129805 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1453/2910] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:58:23 2022] GET /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee => generated 1285 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:58:23.137101 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e7869d22-dc8e-455f-9bd7-144aafb12de4 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:23.138564 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e7869d22-dc8e-455f-9bd7-144aafb12de4 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] [instance: 70bf65cf-55e2-459a-aaf1-c3eb851a6ccf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:23.150365 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e7869d22-dc8e-455f-9bd7-144aafb12de4 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:23.151068 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e7869d22-dc8e-455f-9bd7-144aafb12de4 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:23.152076 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e7869d22-dc8e-455f-9bd7-144aafb12de4 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:23.152780 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e7869d22-dc8e-455f-9bd7-144aafb12de4 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:23.169805 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-808b0b5a-b848-4fcf-bd25-2e9976edcf53 tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] 10.222.0.46 "DELETE /compute/v2.1/images/8a66e59e-576c-4fee-b472-4ff3a1894c39" status: 204 len: 0 microversion: 2.1 time: 0.297067 Jan 15 20:58:23.170920 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1458/2911] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:22 2022] DELETE /compute/v2.1/images/8a66e59e-576c-4fee-b472-4ff3a1894c39 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 20:58:23.178241 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e1dfb8f9-b007-4ab0-8018-c5d41ab81026 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:23.178949 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e1dfb8f9-b007-4ab0-8018-c5d41ab81026 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] [instance: 2427a640-1c1b-49f4-a98d-bff4af6e596b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:23.185917 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e1dfb8f9-b007-4ab0-8018-c5d41ab81026 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:23.186795 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e1dfb8f9-b007-4ab0-8018-c5d41ab81026 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:23.187641 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e1dfb8f9-b007-4ab0-8018-c5d41ab81026 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:23.188077 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e1dfb8f9-b007-4ab0-8018-c5d41ab81026 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:23.217262 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e1dfb8f9-b007-4ab0-8018-c5d41ab81026 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] [instance: 2427a640-1c1b-49f4-a98d-bff4af6e596b] Going to try to terminate instance {{(pid=129365) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 20:58:23.317533 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e1dfb8f9-b007-4ab0-8018-c5d41ab81026 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] 10.222.0.46 "DELETE /compute/v2.1/servers/2427a640-1c1b-49f4-a98d-bff4af6e596b" status: 204 len: 0 microversion: 2.1 time: 0.142373 Jan 15 20:58:23.318507 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1459/2912] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 20:58:23 2022] DELETE /compute/v2.1/servers/2427a640-1c1b-49f4-a98d-bff4af6e596b => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 20:58:23.322620 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-e7869d22-dc8e-455f-9bd7-144aafb12de4 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c877fc1c5964326af5d86b3aa7bf64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ac3aebabe465c8903ac9b9d8f54ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:23.325267 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b76799c5-c349-49e8-96c7-81071f4d871b tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:58:23.326777 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b76799c5-c349-49e8-96c7-81071f4d871b tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] [instance: 62ae2a15-8c2c-4dad-971f-0611238103a3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:23.331876 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e7869d22-dc8e-455f-9bd7-144aafb12de4 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] 10.222.0.46 "GET /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf" status: 200 len: 1668 microversion: 2.1 time: 0.201034 Jan 15 20:58:23.332495 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1454/2913] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:23 2022] GET /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf => generated 1668 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:23.337882 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-65c217f0-6f45-4d3f-afe9-bff3695d7afb tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] Calling method '.version_select at 0x7f30c91a60d0>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:23.345523 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b76799c5-c349-49e8-96c7-81071f4d871b tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:23.345927 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b76799c5-c349-49e8-96c7-81071f4d871b tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:23.347068 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b76799c5-c349-49e8-96c7-81071f4d871b tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:23.348080 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b76799c5-c349-49e8-96c7-81071f4d871b tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:23.397716 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b76799c5-c349-49e8-96c7-81071f4d871b tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] 10.222.0.46 "POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action" status: 200 len: 32634 microversion: 2.1 time: 0.077054 Jan 15 20:58:23.399562 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1460/2914] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:58:23 2022] POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action => generated 32634 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:58:23.407630 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e513ef5f-80a3-493a-88d1-0d61dbc0c6cb tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:23.408778 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e513ef5f-80a3-493a-88d1-0d61dbc0c6cb tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] [instance: e04f7a96-62cb-4aae-9612-aa8df88aef61] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:23.418290 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e513ef5f-80a3-493a-88d1-0d61dbc0c6cb tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:23.418817 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e513ef5f-80a3-493a-88d1-0d61dbc0c6cb tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:23.419944 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e513ef5f-80a3-493a-88d1-0d61dbc0c6cb tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:23.420360 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e513ef5f-80a3-493a-88d1-0d61dbc0c6cb tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:23.571692 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-e513ef5f-80a3-493a-88d1-0d61dbc0c6cb tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05483ff6eec84f78a091b29cfbcf61f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a6720be5fb4de7bcd77cc7ef9d8000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:23.579217 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e513ef5f-80a3-493a-88d1-0d61dbc0c6cb tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] 10.222.0.46 "GET /compute/v2.1/servers/e04f7a96-62cb-4aae-9612-aa8df88aef61" status: 200 len: 1520 microversion: 2.1 time: 0.178080 Jan 15 20:58:23.580055 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1461/2915] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:23 2022] GET /compute/v2.1/servers/e04f7a96-62cb-4aae-9612-aa8df88aef61 => generated 1520 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:23.584416 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-39db9a55-1b55-4cb0-9d7b-993c4027ab34 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:23.585269 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-39db9a55-1b55-4cb0-9d7b-993c4027ab34 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] [instance: 2427a640-1c1b-49f4-a98d-bff4af6e596b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:23.593856 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-39db9a55-1b55-4cb0-9d7b-993c4027ab34 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:23.594318 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-39db9a55-1b55-4cb0-9d7b-993c4027ab34 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:23.595109 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-39db9a55-1b55-4cb0-9d7b-993c4027ab34 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:23.595551 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-39db9a55-1b55-4cb0-9d7b-993c4027ab34 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:23.599170 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-65c217f0-6f45-4d3f-afe9-bff3695d7afb tempest-ListImageFiltersTestJSON-586784373 tempest-ListImageFiltersTestJSON-586784373-project] 10.222.0.46 "DELETE /compute/v2.1/images/f45e0f29-85bf-409f-a655-73db452996e9" status: 204 len: 0 microversion: 2.1 time: 0.265348 Jan 15 20:58:23.599804 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1455/2916] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:23 2022] DELETE /compute/v2.1/images/f45e0f29-85bf-409f-a655-73db452996e9 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 20:58:23.605665 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8080fbcf-517a-4b18-9b0a-cc102056b408 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:23.606690 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-8080fbcf-517a-4b18-9b0a-cc102056b408 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:23.614315 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8080fbcf-517a-4b18-9b0a-cc102056b408 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:23.615023 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8080fbcf-517a-4b18-9b0a-cc102056b408 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:23.615992 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8080fbcf-517a-4b18-9b0a-cc102056b408 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:23.616606 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8080fbcf-517a-4b18-9b0a-cc102056b408 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:23.840546 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-39db9a55-1b55-4cb0-9d7b-993c4027ab34 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ec114f8ece434aa496cd401494e2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a05b1a0a7479db84b762eca23b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:23.851809 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-39db9a55-1b55-4cb0-9d7b-993c4027ab34 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] 10.222.0.46 "GET /compute/v2.1/servers/2427a640-1c1b-49f4-a98d-bff4af6e596b" status: 200 len: 1388 microversion: 2.1 time: 0.267956 Jan 15 20:58:23.852992 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-8080fbcf-517a-4b18-9b0a-cc102056b408 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:23.859392 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1462/2917] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:23 2022] GET /compute/v2.1/servers/2427a640-1c1b-49f4-a98d-bff4af6e596b => generated 1388 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:23.864567 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-8080fbcf-517a-4b18-9b0a-cc102056b408 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9" status: 200 len: 1364 microversion: 2.1 time: 0.262882 Jan 15 20:58:23.865179 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1456/2918] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:23 2022] GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9 => generated 1364 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:24.043972 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9b3ecaa4-f620-46cf-a961-b637ba904f43 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:24.045040 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-9b3ecaa4-f620-46cf-a961-b637ba904f43 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: deef57f9-d933-48ad-a051-e782593799bf] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:24.052501 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9b3ecaa4-f620-46cf-a961-b637ba904f43 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:24.053001 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9b3ecaa4-f620-46cf-a961-b637ba904f43 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:24.053812 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9b3ecaa4-f620-46cf-a961-b637ba904f43 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:24.054261 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9b3ecaa4-f620-46cf-a961-b637ba904f43 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:24.140123 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-2e12d1e3-8fa3-498e-ae3c-7b6bdb5bc03c tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:24.140747 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-2e12d1e3-8fa3-498e-ae3c-7b6bdb5bc03c tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:24.147647 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2e12d1e3-8fa3-498e-ae3c-7b6bdb5bc03c tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:24.148101 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2e12d1e3-8fa3-498e-ae3c-7b6bdb5bc03c tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:24.149623 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2e12d1e3-8fa3-498e-ae3c-7b6bdb5bc03c tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:24.150081 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2e12d1e3-8fa3-498e-ae3c-7b6bdb5bc03c tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:24.222045 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-9b3ecaa4-f620-46cf-a961-b637ba904f43 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:24.230531 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-9b3ecaa4-f620-46cf-a961-b637ba904f43 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/deef57f9-d933-48ad-a051-e782593799bf" status: 200 len: 1511 microversion: 2.1 time: 0.192399 Jan 15 20:58:24.231673 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1463/2919] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:24 2022] GET /compute/v2.1/servers/deef57f9-d933-48ad-a051-e782593799bf => generated 1511 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:24.282095 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-2e12d1e3-8fa3-498e-ae3c-7b6bdb5bc03c tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:24.291802 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-2e12d1e3-8fa3-498e-ae3c-7b6bdb5bc03c tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:24.293324 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-2e12d1e3-8fa3-498e-ae3c-7b6bdb5bc03c tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:24.294733 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-2e12d1e3-8fa3-498e-ae3c-7b6bdb5bc03c tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "GET /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee" status: 200 len: 1593 microversion: 2.42 time: 0.158691 Jan 15 20:58:24.295304 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1457/2920] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:58:24 2022] GET /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee => generated 1593 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 15 20:58:24.352014 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-992a7006-88fd-46f8-ae0a-ca932205bbe1 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:24.352804 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-992a7006-88fd-46f8-ae0a-ca932205bbe1 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] [instance: 70bf65cf-55e2-459a-aaf1-c3eb851a6ccf] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:24.360646 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-992a7006-88fd-46f8-ae0a-ca932205bbe1 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:24.361310 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-992a7006-88fd-46f8-ae0a-ca932205bbe1 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:24.362265 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-992a7006-88fd-46f8-ae0a-ca932205bbe1 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:24.362874 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-992a7006-88fd-46f8-ae0a-ca932205bbe1 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:24.410606 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ad0cc300-cdd5-47bb-8da1-21babaa80e0f tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:58:24.411893 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ad0cc300-cdd5-47bb-8da1-21babaa80e0f tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] [instance: 62ae2a15-8c2c-4dad-971f-0611238103a3] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:24.419824 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ad0cc300-cdd5-47bb-8da1-21babaa80e0f tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:24.421229 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ad0cc300-cdd5-47bb-8da1-21babaa80e0f tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:24.422191 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ad0cc300-cdd5-47bb-8da1-21babaa80e0f tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:24.422806 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ad0cc300-cdd5-47bb-8da1-21babaa80e0f tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:24.475390 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ad0cc300-cdd5-47bb-8da1-21babaa80e0f tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] 10.222.0.46 "POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action" status: 200 len: 32634 microversion: 2.1 time: 0.068865 Jan 15 20:58:24.479898 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1458/2921] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:58:24 2022] POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action => generated 32634 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:58:24.525928 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-992a7006-88fd-46f8-ae0a-ca932205bbe1 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c877fc1c5964326af5d86b3aa7bf64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ac3aebabe465c8903ac9b9d8f54ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:24.533353 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-992a7006-88fd-46f8-ae0a-ca932205bbe1 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] 10.222.0.46 "GET /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf" status: 200 len: 1668 microversion: 2.1 time: 0.187121 Jan 15 20:58:24.534094 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1464/2922] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:24 2022] GET /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf => generated 1668 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:24.599611 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-158ba09f-842c-416d-b7d1-95d4f271610a tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:24.600443 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-158ba09f-842c-416d-b7d1-95d4f271610a tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] [instance: e04f7a96-62cb-4aae-9612-aa8df88aef61] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:24.609832 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-158ba09f-842c-416d-b7d1-95d4f271610a tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:24.610732 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-158ba09f-842c-416d-b7d1-95d4f271610a tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:24.611681 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-158ba09f-842c-416d-b7d1-95d4f271610a tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:24.612184 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-158ba09f-842c-416d-b7d1-95d4f271610a tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:24.793736 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-158ba09f-842c-416d-b7d1-95d4f271610a tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05483ff6eec84f78a091b29cfbcf61f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a6720be5fb4de7bcd77cc7ef9d8000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:24.803922 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-158ba09f-842c-416d-b7d1-95d4f271610a tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] 10.222.0.46 "GET /compute/v2.1/servers/e04f7a96-62cb-4aae-9612-aa8df88aef61" status: 200 len: 1520 microversion: 2.1 time: 0.209723 Jan 15 20:58:24.805825 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1459/2923] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:24 2022] GET /compute/v2.1/servers/e04f7a96-62cb-4aae-9612-aa8df88aef61 => generated 1520 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:24.866156 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-1acc992d-0b16-4a86-97be-3fa1001c75d5 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:24.866985 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-1acc992d-0b16-4a86-97be-3fa1001c75d5 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] [instance: 2427a640-1c1b-49f4-a98d-bff4af6e596b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:24.874293 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1acc992d-0b16-4a86-97be-3fa1001c75d5 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:24.877249 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1acc992d-0b16-4a86-97be-3fa1001c75d5 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:24.878302 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1acc992d-0b16-4a86-97be-3fa1001c75d5 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:24.879049 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1acc992d-0b16-4a86-97be-3fa1001c75d5 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:24.881051 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4add4450-30f8-4718-b19d-64e979b13a3e tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:24.881658 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-4add4450-30f8-4718-b19d-64e979b13a3e tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:24.896943 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4add4450-30f8-4718-b19d-64e979b13a3e tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:24.897250 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4add4450-30f8-4718-b19d-64e979b13a3e tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:24.897976 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4add4450-30f8-4718-b19d-64e979b13a3e tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:24.898405 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4add4450-30f8-4718-b19d-64e979b13a3e tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:25.120961 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-4add4450-30f8-4718-b19d-64e979b13a3e tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:25.136459 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-4add4450-30f8-4718-b19d-64e979b13a3e tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9" status: 200 len: 1364 microversion: 2.1 time: 0.258792 Jan 15 20:58:25.137708 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1460/2924] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:24 2022] GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9 => generated 1364 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:58:25.207871 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-1acc992d-0b16-4a86-97be-3fa1001c75d5 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ec114f8ece434aa496cd401494e2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a05b1a0a7479db84b762eca23b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:25.216792 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-1acc992d-0b16-4a86-97be-3fa1001c75d5 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] 10.222.0.46 "GET /compute/v2.1/servers/2427a640-1c1b-49f4-a98d-bff4af6e596b" status: 200 len: 1388 microversion: 2.1 time: 0.354181 Jan 15 20:58:25.225952 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1465/2925] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:24 2022] GET /compute/v2.1/servers/2427a640-1c1b-49f4-a98d-bff4af6e596b => generated 1388 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:25.252266 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-bd3761fe-cac8-4e74-a70d-fa5af6da462c tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:25.253023 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-bd3761fe-cac8-4e74-a70d-fa5af6da462c tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: deef57f9-d933-48ad-a051-e782593799bf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:25.260328 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bd3761fe-cac8-4e74-a70d-fa5af6da462c tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:25.261181 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bd3761fe-cac8-4e74-a70d-fa5af6da462c tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:25.261842 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bd3761fe-cac8-4e74-a70d-fa5af6da462c tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:25.262669 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bd3761fe-cac8-4e74-a70d-fa5af6da462c tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:25.314589 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-63bad3cb-996e-4a51-aef4-fa89c6f49ebc tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:25.315204 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-63bad3cb-996e-4a51-aef4-fa89c6f49ebc tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:25.323020 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-63bad3cb-996e-4a51-aef4-fa89c6f49ebc tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:25.323486 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-63bad3cb-996e-4a51-aef4-fa89c6f49ebc tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:25.324292 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-63bad3cb-996e-4a51-aef4-fa89c6f49ebc tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:25.324734 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-63bad3cb-996e-4a51-aef4-fa89c6f49ebc tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:25.658592 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-bd3761fe-cac8-4e74-a70d-fa5af6da462c tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:25.670915 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-bd3761fe-cac8-4e74-a70d-fa5af6da462c tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/deef57f9-d933-48ad-a051-e782593799bf" status: 200 len: 1511 microversion: 2.1 time: 0.422984 Jan 15 20:58:25.685365 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1461/2926] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:25 2022] GET /compute/v2.1/servers/deef57f9-d933-48ad-a051-e782593799bf => generated 1511 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:25.700454 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-45851682-c322-411a-ac42-d829727a02e6 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:58:25.726729 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-45851682-c322-411a-ac42-d829727a02e6 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] [instance: 62ae2a15-8c2c-4dad-971f-0611238103a3] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:25.734009 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-45851682-c322-411a-ac42-d829727a02e6 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:25.734709 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-45851682-c322-411a-ac42-d829727a02e6 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:25.738295 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-45851682-c322-411a-ac42-d829727a02e6 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:25.740782 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-45851682-c322-411a-ac42-d829727a02e6 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:25.834664 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-63bad3cb-996e-4a51-aef4-fa89c6f49ebc tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:25.848399 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-63bad3cb-996e-4a51-aef4-fa89c6f49ebc tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:25.850254 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-63bad3cb-996e-4a51-aef4-fa89c6f49ebc tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:25.852198 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-63bad3cb-996e-4a51-aef4-fa89c6f49ebc tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "GET /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee" status: 200 len: 1661 microversion: 2.42 time: 0.541688 Jan 15 20:58:25.853275 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-45851682-c322-411a-ac42-d829727a02e6 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] 10.222.0.46 "POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action" status: 200 len: 32634 microversion: 2.1 time: 0.166293 Jan 15 20:58:25.857192 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1462/2927] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:58:25 2022] POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action => generated 32634 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:58:25.864729 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1466/2928] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:58:25 2022] GET /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee => generated 1661 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:58:25.874068 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8ac5f5a0-824f-46ad-a6c1-37bb80635155 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:25.874896 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-8ac5f5a0-824f-46ad-a6c1-37bb80635155 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] [instance: 70bf65cf-55e2-459a-aaf1-c3eb851a6ccf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:25.894289 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8ac5f5a0-824f-46ad-a6c1-37bb80635155 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:25.894747 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8ac5f5a0-824f-46ad-a6c1-37bb80635155 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:25.898827 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8ac5f5a0-824f-46ad-a6c1-37bb80635155 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:25.899319 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8ac5f5a0-824f-46ad-a6c1-37bb80635155 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:26.117661 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-11db6c80-b6d6-4bcc-96f5-020d1a7abaad tempest-KeyPairsNegativeTestJSON-1257137424 tempest-KeyPairsNegativeTestJSON-1257137424-project] Action: 'create', calling method: .version_select at 0x7f30c8ed2040>, body: {"keypair": {"name": "key_/.\\@:"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:58:26.130331 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-11db6c80-b6d6-4bcc-96f5-020d1a7abaad tempest-KeyPairsNegativeTestJSON-1257137424 tempest-KeyPairsNegativeTestJSON-1257137424-project] HTTP exception thrown: Keypair data is invalid: Keypair name contains unsafe characters Jan 15 20:58:26.131377 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-11db6c80-b6d6-4bcc-96f5-020d1a7abaad tempest-KeyPairsNegativeTestJSON-1257137424 tempest-KeyPairsNegativeTestJSON-1257137424-project] Returning 400 to user: Keypair data is invalid: Keypair name contains unsafe characters {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:58:26.132920 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-11db6c80-b6d6-4bcc-96f5-020d1a7abaad tempest-KeyPairsNegativeTestJSON-1257137424 tempest-KeyPairsNegativeTestJSON-1257137424-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.266688 Jan 15 20:58:26.140401 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1467/2929] 10.222.0.46 () {60 vars in 1157 bytes} [Sat Jan 15 20:58:25 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 275 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 15 20:58:26.149564 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2f0e0d50-49e8-4135-928c-0b7b46726fde tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:26.150805 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-2f0e0d50-49e8-4135-928c-0b7b46726fde tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] [instance: e04f7a96-62cb-4aae-9612-aa8df88aef61] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:26.159252 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2f0e0d50-49e8-4135-928c-0b7b46726fde tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:26.159892 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2f0e0d50-49e8-4135-928c-0b7b46726fde tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:26.161878 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2f0e0d50-49e8-4135-928c-0b7b46726fde tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:26.162535 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2f0e0d50-49e8-4135-928c-0b7b46726fde tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:26.360688 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-8ac5f5a0-824f-46ad-a6c1-37bb80635155 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c877fc1c5964326af5d86b3aa7bf64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ac3aebabe465c8903ac9b9d8f54ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:26.378262 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-8ac5f5a0-824f-46ad-a6c1-37bb80635155 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] 10.222.0.46 "GET /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf" status: 200 len: 1668 microversion: 2.1 time: 0.512635 Jan 15 20:58:26.378262 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1463/2930] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:25 2022] GET /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf => generated 1668 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:26.388319 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-22c00177-295c-496b-8665-1aeca5375a6d req-c397fbb8-2be8-4abd-9ac1-9e10a9c213b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2427a640-1c1b-49f4-a98d-bff4af6e596b", "name": "network-vif-deleted", "tag": "b0dcfdb5-db07-45b0-99bf-de55b9ceff10"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:58:26.391042 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:58:26.391042 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:58:26.408906 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-22c00177-295c-496b-8665-1aeca5375a6d req-c397fbb8-2be8-4abd-9ac1-9e10a9c213b5 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:26.409340 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-22c00177-295c-496b-8665-1aeca5375a6d req-c397fbb8-2be8-4abd-9ac1-9e10a9c213b5 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:26.428721 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-22c00177-295c-496b-8665-1aeca5375a6d req-c397fbb8-2be8-4abd-9ac1-9e10a9c213b5 service nova] Creating event network-vif-deleted:b0dcfdb5-db07-45b0-99bf-de55b9ceff10 for instance 2427a640-1c1b-49f4-a98d-bff4af6e596b on nch1-master-1 Jan 15 20:58:26.435682 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-22c00177-295c-496b-8665-1aeca5375a6d req-c397fbb8-2be8-4abd-9ac1-9e10a9c213b5 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057981 Jan 15 20:58:26.447518 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1464/2931] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:58:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:58:26.453151 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-15f2c87f-9fdd-4b01-88c3-97fe1027c31b tempest-KeyPairsNegativeTestJSON-1257137424 tempest-KeyPairsNegativeTestJSON-1257137424-project] Action: 'create', calling method: .version_select at 0x7f30c90005e0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-818371972", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:58:26.472790 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-15f2c87f-9fdd-4b01-88c3-97fe1027c31b tempest-KeyPairsNegativeTestJSON-1257137424 tempest-KeyPairsNegativeTestJSON-1257137424-project] Getting quotas for project 89608f43d7ed4ea5af9813c5c50377e9. Resources: {'key_pairs'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:58:26.479199 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-15f2c87f-9fdd-4b01-88c3-97fe1027c31b tempest-KeyPairsNegativeTestJSON-1257137424 tempest-KeyPairsNegativeTestJSON-1257137424-project] Getting quotas for user 77d27b9d72e14f3b8b68d4c467323c06 and project 89608f43d7ed4ea5af9813c5c50377e9. Resources: {'key_pairs'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:58:26.500722 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-15f2c87f-9fdd-4b01-88c3-97fe1027c31b tempest-KeyPairsNegativeTestJSON-1257137424 tempest-KeyPairsNegativeTestJSON-1257137424-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Jan 15 20:58:26.501593 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-15f2c87f-9fdd-4b01-88c3-97fe1027c31b tempest-KeyPairsNegativeTestJSON-1257137424 tempest-KeyPairsNegativeTestJSON-1257137424-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:58:26.502382 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-15f2c87f-9fdd-4b01-88c3-97fe1027c31b tempest-KeyPairsNegativeTestJSON-1257137424 tempest-KeyPairsNegativeTestJSON-1257137424-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.054309 Jan 15 20:58:26.506952 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1465/2932] 10.222.0.46 () {60 vars in 1159 bytes} [Sat Jan 15 20:58:26 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 56 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jan 15 20:58:26.509097 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-3a953246-f398-4816-be85-13fb96e49d7c tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:26.510278 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-3a953246-f398-4816-be85-13fb96e49d7c tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:26.527144 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3a953246-f398-4816-be85-13fb96e49d7c tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:26.527599 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3a953246-f398-4816-be85-13fb96e49d7c tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:26.528893 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3a953246-f398-4816-be85-13fb96e49d7c tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:26.531049 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-2f0e0d50-49e8-4135-928c-0b7b46726fde tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05483ff6eec84f78a091b29cfbcf61f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a6720be5fb4de7bcd77cc7ef9d8000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:26.535419 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3a953246-f398-4816-be85-13fb96e49d7c tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:26.539082 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2f0e0d50-49e8-4135-928c-0b7b46726fde tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] 10.222.0.46 "GET /compute/v2.1/servers/e04f7a96-62cb-4aae-9612-aa8df88aef61" status: 200 len: 1520 microversion: 2.1 time: 0.395992 Jan 15 20:58:26.543237 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1468/2933] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:26 2022] GET /compute/v2.1/servers/e04f7a96-62cb-4aae-9612-aa8df88aef61 => generated 1520 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:26.571718 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-fe11ae88-5b15-40d2-b27c-7a4a06b2cbf2 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:26.572888 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-fe11ae88-5b15-40d2-b27c-7a4a06b2cbf2 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] [instance: 2427a640-1c1b-49f4-a98d-bff4af6e596b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:26.584239 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fe11ae88-5b15-40d2-b27c-7a4a06b2cbf2 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:26.590188 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fe11ae88-5b15-40d2-b27c-7a4a06b2cbf2 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:26.591889 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fe11ae88-5b15-40d2-b27c-7a4a06b2cbf2 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:26.592508 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fe11ae88-5b15-40d2-b27c-7a4a06b2cbf2 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:26.650507 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fe11ae88-5b15-40d2-b27c-7a4a06b2cbf2 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:26.651835 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fe11ae88-5b15-40d2-b27c-7a4a06b2cbf2 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:26.652453 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.objects.instance [None req-fe11ae88-5b15-40d2-b27c-7a4a06b2cbf2 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lazy-loading 'fault' on Instance uuid 2427a640-1c1b-49f4-a98d-bff4af6e596b {{(pid=129365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 20:58:27.010733 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-fe11ae88-5b15-40d2-b27c-7a4a06b2cbf2 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ec114f8ece434aa496cd401494e2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a05b1a0a7479db84b762eca23b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:27.020366 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-fe11ae88-5b15-40d2-b27c-7a4a06b2cbf2 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] 10.222.0.46 "GET /compute/v2.1/servers/2427a640-1c1b-49f4-a98d-bff4af6e596b" status: 200 len: 1143 microversion: 2.1 time: 0.461401 Jan 15 20:58:27.022369 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1469/2934] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:26 2022] GET /compute/v2.1/servers/2427a640-1c1b-49f4-a98d-bff4af6e596b => generated 1143 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:27.038913 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-52b40dcf-e8f0-408b-97cc-122ea7842618 tempest-KeyPairsNegativeTestJSON-1257137424 tempest-KeyPairsNegativeTestJSON-1257137424-project] Action: 'create', calling method: .version_select at 0x7f30ceb58f70>, body: {"keypair": {"name": "tempest-keypair-932828616"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:58:27.082309 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-52b40dcf-e8f0-408b-97cc-122ea7842618 tempest-KeyPairsNegativeTestJSON-1257137424 tempest-KeyPairsNegativeTestJSON-1257137424-project] Getting quotas for project 89608f43d7ed4ea5af9813c5c50377e9. Resources: {'key_pairs'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:58:27.099212 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-52b40dcf-e8f0-408b-97cc-122ea7842618 tempest-KeyPairsNegativeTestJSON-1257137424 tempest-KeyPairsNegativeTestJSON-1257137424-project] Getting quotas for user 77d27b9d72e14f3b8b68d4c467323c06 and project 89608f43d7ed4ea5af9813c5c50377e9. Resources: {'key_pairs'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:58:27.166713 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-3a953246-f398-4816-be85-13fb96e49d7c tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:27.183394 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-3a953246-f398-4816-be85-13fb96e49d7c tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9" status: 200 len: 1364 microversion: 2.1 time: 0.678551 Jan 15 20:58:27.187065 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1466/2935] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:26 2022] GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9 => generated 1364 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:27.207387 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-2334e518-c8e4-4fd6-924d-94fb993912e5 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:27.208566 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-2334e518-c8e4-4fd6-924d-94fb993912e5 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: deef57f9-d933-48ad-a051-e782593799bf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:27.232118 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2334e518-c8e4-4fd6-924d-94fb993912e5 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:27.232936 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2334e518-c8e4-4fd6-924d-94fb993912e5 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:27.233948 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2334e518-c8e4-4fd6-924d-94fb993912e5 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:27.234537 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2334e518-c8e4-4fd6-924d-94fb993912e5 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:27.406461 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-52b40dcf-e8f0-408b-97cc-122ea7842618 tempest-KeyPairsNegativeTestJSON-1257137424 tempest-KeyPairsNegativeTestJSON-1257137424-project] Getting quotas for project 89608f43d7ed4ea5af9813c5c50377e9. Resources: {'key_pairs'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:58:27.412697 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-52b40dcf-e8f0-408b-97cc-122ea7842618 tempest-KeyPairsNegativeTestJSON-1257137424 tempest-KeyPairsNegativeTestJSON-1257137424-project] Getting quotas for user 77d27b9d72e14f3b8b68d4c467323c06 and project 89608f43d7ed4ea5af9813c5c50377e9. Resources: {'key_pairs'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:58:27.432025 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-52b40dcf-e8f0-408b-97cc-122ea7842618 tempest-KeyPairsNegativeTestJSON-1257137424 tempest-KeyPairsNegativeTestJSON-1257137424-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.400673 Jan 15 20:58:27.433219 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1470/2936] 10.222.0.46 () {60 vars in 1157 bytes} [Sat Jan 15 20:58:27 2022] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:27.442094 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-931cf17d-ac47-458a-a537-cfd523c362fa tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:58:27.444356 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-931cf17d-ac47-458a-a537-cfd523c362fa tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] [instance: 62ae2a15-8c2c-4dad-971f-0611238103a3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:27.460430 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-931cf17d-ac47-458a-a537-cfd523c362fa tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:27.461308 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-931cf17d-ac47-458a-a537-cfd523c362fa tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:27.462302 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-931cf17d-ac47-458a-a537-cfd523c362fa tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:27.462756 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-931cf17d-ac47-458a-a537-cfd523c362fa tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:27.515242 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-931cf17d-ac47-458a-a537-cfd523c362fa tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] 10.222.0.46 "POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action" status: 200 len: 32634 microversion: 2.1 time: 0.078959 Jan 15 20:58:27.516375 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1471/2937] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:58:27 2022] POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action => generated 32634 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:58:27.523564 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-1385f747-a97e-49ba-97dc-f8062542fb71 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:27.529202 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-1385f747-a97e-49ba-97dc-f8062542fb71 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:27.536474 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1385f747-a97e-49ba-97dc-f8062542fb71 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:27.537066 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1385f747-a97e-49ba-97dc-f8062542fb71 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:27.541953 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1385f747-a97e-49ba-97dc-f8062542fb71 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:27.542551 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1385f747-a97e-49ba-97dc-f8062542fb71 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:27.567837 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-2334e518-c8e4-4fd6-924d-94fb993912e5 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:27.579548 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-2334e518-c8e4-4fd6-924d-94fb993912e5 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/deef57f9-d933-48ad-a051-e782593799bf" status: 200 len: 1511 microversion: 2.1 time: 0.391060 Jan 15 20:58:27.580164 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1467/2938] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:27 2022] GET /compute/v2.1/servers/deef57f9-d933-48ad-a051-e782593799bf => generated 1511 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:27.593442 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-fbec3d9f-cc46-4a51-b95b-5d0c11913ac2 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:27.594048 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-fbec3d9f-cc46-4a51-b95b-5d0c11913ac2 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] [instance: 70bf65cf-55e2-459a-aaf1-c3eb851a6ccf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:27.608516 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fbec3d9f-cc46-4a51-b95b-5d0c11913ac2 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:27.613504 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fbec3d9f-cc46-4a51-b95b-5d0c11913ac2 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:27.614655 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fbec3d9f-cc46-4a51-b95b-5d0c11913ac2 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:27.615121 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fbec3d9f-cc46-4a51-b95b-5d0c11913ac2 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:27.780717 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-fbec3d9f-cc46-4a51-b95b-5d0c11913ac2 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c877fc1c5964326af5d86b3aa7bf64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ac3aebabe465c8903ac9b9d8f54ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:27.795507 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-fbec3d9f-cc46-4a51-b95b-5d0c11913ac2 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] 10.222.0.46 "GET /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf" status: 200 len: 1600 microversion: 2.1 time: 0.208464 Jan 15 20:58:27.796517 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1468/2939] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:27 2022] GET /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf => generated 1600 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:27.801612 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e5608690-79c1-4833-888a-18f2f098b404 tempest-KeyPairsNegativeTestJSON-1257137424 tempest-KeyPairsNegativeTestJSON-1257137424-project] Action: 'create', calling method: .version_select at 0x7f30c8f408b0>, body: {"keypair": {"name": "tempest-keypair-932828616"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:58:27.843219 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-e5608690-79c1-4833-888a-18f2f098b404 tempest-KeyPairsNegativeTestJSON-1257137424 tempest-KeyPairsNegativeTestJSON-1257137424-project] Getting quotas for project 89608f43d7ed4ea5af9813c5c50377e9. Resources: {'key_pairs'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:58:27.854142 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-e5608690-79c1-4833-888a-18f2f098b404 tempest-KeyPairsNegativeTestJSON-1257137424 tempest-KeyPairsNegativeTestJSON-1257137424-project] Getting quotas for user 77d27b9d72e14f3b8b68d4c467323c06 and project 89608f43d7ed4ea5af9813c5c50377e9. Resources: {'key_pairs'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:58:28.034412 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-e5608690-79c1-4833-888a-18f2f098b404 tempest-KeyPairsNegativeTestJSON-1257137424 tempest-KeyPairsNegativeTestJSON-1257137424-project] HTTP exception thrown: Key pair 'tempest-keypair-932828616' already exists. Jan 15 20:58:28.035211 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e5608690-79c1-4833-888a-18f2f098b404 tempest-KeyPairsNegativeTestJSON-1257137424 tempest-KeyPairsNegativeTestJSON-1257137424-project] Returning 409 to user: Key pair 'tempest-keypair-932828616' already exists. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:58:28.036232 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e5608690-79c1-4833-888a-18f2f098b404 tempest-KeyPairsNegativeTestJSON-1257137424 tempest-KeyPairsNegativeTestJSON-1257137424-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 409 len: 104 microversion: 2.1 time: 0.238567 Jan 15 20:58:28.038190 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1469/2940] 10.222.0.46 () {60 vars in 1157 bytes} [Sat Jan 15 20:58:27 2022] POST /compute/v2.1/os-keypairs => generated 104 bytes in 241 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jan 15 20:58:28.046046 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-05c51730-ffeb-4a2d-a04c-30dfd7d3b953 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:28.053904 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-05c51730-ffeb-4a2d-a04c-30dfd7d3b953 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] [instance: e04f7a96-62cb-4aae-9612-aa8df88aef61] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:28.065770 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-05c51730-ffeb-4a2d-a04c-30dfd7d3b953 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:28.073644 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-05c51730-ffeb-4a2d-a04c-30dfd7d3b953 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:28.075123 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-05c51730-ffeb-4a2d-a04c-30dfd7d3b953 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:28.075870 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-05c51730-ffeb-4a2d-a04c-30dfd7d3b953 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:28.178308 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-1385f747-a97e-49ba-97dc-f8062542fb71 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:28.193861 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-1385f747-a97e-49ba-97dc-f8062542fb71 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:28.195443 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-1385f747-a97e-49ba-97dc-f8062542fb71 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:28.203175 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-1385f747-a97e-49ba-97dc-f8062542fb71 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "GET /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee" status: 200 len: 1708 microversion: 2.42 time: 0.684332 Jan 15 20:58:28.204027 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1472/2941] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:58:27 2022] GET /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee => generated 1708 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:58:28.215374 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-45ce222c-39cf-428c-8d90-c1f13f89d06f tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:28.216392 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-45ce222c-39cf-428c-8d90-c1f13f89d06f tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] [instance: 2427a640-1c1b-49f4-a98d-bff4af6e596b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:28.273463 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-45ce222c-39cf-428c-8d90-c1f13f89d06f tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:28.274073 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-45ce222c-39cf-428c-8d90-c1f13f89d06f tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:28.284676 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-45ce222c-39cf-428c-8d90-c1f13f89d06f tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:28.288749 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-45ce222c-39cf-428c-8d90-c1f13f89d06f tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:28.344515 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-45ce222c-39cf-428c-8d90-c1f13f89d06f tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] HTTP exception thrown: Instance 2427a640-1c1b-49f4-a98d-bff4af6e596b could not be found. Jan 15 20:58:28.347497 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-45ce222c-39cf-428c-8d90-c1f13f89d06f tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Returning 404 to user: Instance 2427a640-1c1b-49f4-a98d-bff4af6e596b could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:58:28.348759 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-45ce222c-39cf-428c-8d90-c1f13f89d06f tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] 10.222.0.46 "GET /compute/v2.1/servers/2427a640-1c1b-49f4-a98d-bff4af6e596b" status: 404 len: 111 microversion: 2.1 time: 0.142908 Jan 15 20:58:28.363276 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1473/2942] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:28 2022] GET /compute/v2.1/servers/2427a640-1c1b-49f4-a98d-bff4af6e596b => generated 111 bytes in 158 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:58:28.403419 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3586dcd7-37be-4525-83b7-4e3e55cb5fbf tempest-KeyPairsNegativeTestJSON-1257137424 tempest-KeyPairsNegativeTestJSON-1257137424-project] Calling method '.version_select at 0x7f30c913e820>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:28.436187 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3586dcd7-37be-4525-83b7-4e3e55cb5fbf tempest-KeyPairsNegativeTestJSON-1257137424 tempest-KeyPairsNegativeTestJSON-1257137424-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-932828616" status: 202 len: 0 microversion: 2.1 time: 0.071506 Jan 15 20:58:28.437015 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1474/2943] 10.222.0.46 () {58 vars in 1217 bytes} [Sat Jan 15 20:58:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-932828616 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 20:58:28.441587 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-a4cf5443-b228-42a9-ba2a-7f8bb959a3e8 req-b48bf78a-6b73-420e-845c-7b3a9f6e2958 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70bf65cf-55e2-459a-aaf1-c3eb851a6ccf", "name": "network-vif-deleted", "tag": "a6cb493c-7db8-4ea6-9c25-c683e688717c"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:58:28.443338 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:58:28.443338 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:58:28.452567 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-a4cf5443-b228-42a9-ba2a-7f8bb959a3e8 req-b48bf78a-6b73-420e-845c-7b3a9f6e2958 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:28.454637 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-a4cf5443-b228-42a9-ba2a-7f8bb959a3e8 req-b48bf78a-6b73-420e-845c-7b3a9f6e2958 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:28.473419 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-a4cf5443-b228-42a9-ba2a-7f8bb959a3e8 req-b48bf78a-6b73-420e-845c-7b3a9f6e2958 service nova] Creating event network-vif-deleted:a6cb493c-7db8-4ea6-9c25-c683e688717c for instance 70bf65cf-55e2-459a-aaf1-c3eb851a6ccf on nch1-master-1 Jan 15 20:58:28.484225 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-a4cf5443-b228-42a9-ba2a-7f8bb959a3e8 req-b48bf78a-6b73-420e-845c-7b3a9f6e2958 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045667 Jan 15 20:58:28.485388 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1475/2944] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:58:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:58:28.509450 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-1ea1826a-e40f-45ba-a9b3-d998ea5ec2a3 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:28.510425 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-1ea1826a-e40f-45ba-a9b3-d998ea5ec2a3 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:28.532717 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1ea1826a-e40f-45ba-a9b3-d998ea5ec2a3 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:28.533486 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1ea1826a-e40f-45ba-a9b3-d998ea5ec2a3 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:28.534515 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1ea1826a-e40f-45ba-a9b3-d998ea5ec2a3 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:28.535829 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1ea1826a-e40f-45ba-a9b3-d998ea5ec2a3 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:28.542240 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-05c51730-ffeb-4a2d-a04c-30dfd7d3b953 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05483ff6eec84f78a091b29cfbcf61f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a6720be5fb4de7bcd77cc7ef9d8000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:28.553699 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-05c51730-ffeb-4a2d-a04c-30dfd7d3b953 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] 10.222.0.46 "GET /compute/v2.1/servers/e04f7a96-62cb-4aae-9612-aa8df88aef61" status: 200 len: 1520 microversion: 2.1 time: 0.514281 Jan 15 20:58:28.558257 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1470/2945] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:28 2022] GET /compute/v2.1/servers/e04f7a96-62cb-4aae-9612-aa8df88aef61 => generated 1520 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:28.565113 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-80f347d0-e272-43f9-9bb9-b0b5ad17967f tempest-KeyPairsNegativeTestJSON-1257137424 tempest-KeyPairsNegativeTestJSON-1257137424-project] Action: 'create', calling method: .version_select at 0x7f30c8f403a0>, body: {"keypair": {"name": ""}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:58:28.566457 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-80f347d0-e272-43f9-9bb9-b0b5ad17967f tempest-KeyPairsNegativeTestJSON-1257137424 tempest-KeyPairsNegativeTestJSON-1257137424-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:58:28.576169 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-80f347d0-e272-43f9-9bb9-b0b5ad17967f tempest-KeyPairsNegativeTestJSON-1257137424 tempest-KeyPairsNegativeTestJSON-1257137424-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.007915 Jan 15 20:58:28.576819 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1471/2946] 10.222.0.46 () {60 vars in 1157 bytes} [Sat Jan 15 20:58:28 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 15 20:58:28.595248 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ba96eab2-a235-477f-85f2-3d5564fdf438 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:58:28.597689 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ba96eab2-a235-477f-85f2-3d5564fdf438 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] [instance: 62ae2a15-8c2c-4dad-971f-0611238103a3] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:28.605423 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ba96eab2-a235-477f-85f2-3d5564fdf438 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:28.606076 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ba96eab2-a235-477f-85f2-3d5564fdf438 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:28.608372 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ba96eab2-a235-477f-85f2-3d5564fdf438 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:28.609015 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ba96eab2-a235-477f-85f2-3d5564fdf438 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:28.663761 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ba96eab2-a235-477f-85f2-3d5564fdf438 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] 10.222.0.46 "POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action" status: 200 len: 32634 microversion: 2.1 time: 0.075950 Jan 15 20:58:28.665142 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1472/2947] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:58:28 2022] POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action => generated 32634 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:58:28.694364 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-656bd259-c6ee-4ec1-bb4b-c4329ded2cd2 tempest-KeyPairsNegativeTestJSON-1257137424 tempest-KeyPairsNegativeTestJSON-1257137424-project] Action: 'create', calling method: .version_select at 0x7f30c8fa43a0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-491102802", "public_key": " "}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:58:28.736163 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-656bd259-c6ee-4ec1-bb4b-c4329ded2cd2 tempest-KeyPairsNegativeTestJSON-1257137424 tempest-KeyPairsNegativeTestJSON-1257137424-project] Getting quotas for project 89608f43d7ed4ea5af9813c5c50377e9. Resources: {'key_pairs'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:58:28.746833 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-656bd259-c6ee-4ec1-bb4b-c4329ded2cd2 tempest-KeyPairsNegativeTestJSON-1257137424 tempest-KeyPairsNegativeTestJSON-1257137424-project] Getting quotas for user 77d27b9d72e14f3b8b68d4c467323c06 and project 89608f43d7ed4ea5af9813c5c50377e9. Resources: {'key_pairs'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:58:28.786767 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-656bd259-c6ee-4ec1-bb4b-c4329ded2cd2 tempest-KeyPairsNegativeTestJSON-1257137424 tempest-KeyPairsNegativeTestJSON-1257137424-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Jan 15 20:58:28.787568 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-656bd259-c6ee-4ec1-bb4b-c4329ded2cd2 tempest-KeyPairsNegativeTestJSON-1257137424 tempest-KeyPairsNegativeTestJSON-1257137424-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:58:28.788528 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-656bd259-c6ee-4ec1-bb4b-c4329ded2cd2 tempest-KeyPairsNegativeTestJSON-1257137424 tempest-KeyPairsNegativeTestJSON-1257137424-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.110634 Jan 15 20:58:28.792149 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1473/2948] 10.222.0.46 () {60 vars in 1157 bytes} [Sat Jan 15 20:58:28 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 121 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jan 15 20:58:28.804740 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-664e5125-3824-4442-8021-ef0224e05a4b tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:28.807129 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-664e5125-3824-4442-8021-ef0224e05a4b tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: deef57f9-d933-48ad-a051-e782593799bf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:28.833440 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-664e5125-3824-4442-8021-ef0224e05a4b tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:28.833930 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-664e5125-3824-4442-8021-ef0224e05a4b tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:28.834757 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-664e5125-3824-4442-8021-ef0224e05a4b tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:28.837286 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-664e5125-3824-4442-8021-ef0224e05a4b tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:28.861972 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-1ea1826a-e40f-45ba-a9b3-d998ea5ec2a3 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:28.878005 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-1ea1826a-e40f-45ba-a9b3-d998ea5ec2a3 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9" status: 200 len: 1552 microversion: 2.1 time: 0.390925 Jan 15 20:58:28.878970 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1476/2949] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:28 2022] GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9 => generated 1552 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:28.885228 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c074fa00-f320-402a-ab8e-7345cff288eb tempest-KeyPairsNegativeTestJSON-1257137424 tempest-KeyPairsNegativeTestJSON-1257137424-project] Action: 'create', calling method: .version_select at 0x7f30c9958430>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:58:28.886523 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c074fa00-f320-402a-ab8e-7345cff288eb tempest-KeyPairsNegativeTestJSON-1257137424 tempest-KeyPairsNegativeTestJSON-1257137424-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:58:28.887512 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c074fa00-f320-402a-ab8e-7345cff288eb tempest-KeyPairsNegativeTestJSON-1257137424 tempest-KeyPairsNegativeTestJSON-1257137424-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.007310 Jan 15 20:58:28.888345 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1477/2950] 10.222.0.46 () {60 vars in 1158 bytes} [Sat Jan 15 20:58:28 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 15 20:58:28.894012 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ded4a907-6917-4480-a474-18af44abfadc tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:28.894707 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ded4a907-6917-4480-a474-18af44abfadc tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] [instance: 70bf65cf-55e2-459a-aaf1-c3eb851a6ccf] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:28.906425 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ded4a907-6917-4480-a474-18af44abfadc tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:28.907046 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ded4a907-6917-4480-a474-18af44abfadc tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:28.908450 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ded4a907-6917-4480-a474-18af44abfadc tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:28.909792 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ded4a907-6917-4480-a474-18af44abfadc tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:28.964124 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-ded4a907-6917-4480-a474-18af44abfadc tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] HTTP exception thrown: Instance 70bf65cf-55e2-459a-aaf1-c3eb851a6ccf could not be found. Jan 15 20:58:28.965121 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ded4a907-6917-4480-a474-18af44abfadc tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Returning 404 to user: Instance 70bf65cf-55e2-459a-aaf1-c3eb851a6ccf could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:58:28.966558 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ded4a907-6917-4480-a474-18af44abfadc tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] 10.222.0.46 "GET /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf" status: 404 len: 111 microversion: 2.1 time: 0.076931 Jan 15 20:58:28.969193 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1478/2951] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:28 2022] GET /compute/v2.1/servers/70bf65cf-55e2-459a-aaf1-c3eb851a6ccf => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:58:28.975491 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b96d47d2-855f-4157-a4c7-bf4aa55068c8 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:28.984825 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b96d47d2-855f-4157-a4c7-bf4aa55068c8 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:28.999155 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b96d47d2-855f-4157-a4c7-bf4aa55068c8 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:29.001480 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b96d47d2-855f-4157-a4c7-bf4aa55068c8 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:29.004174 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b96d47d2-855f-4157-a4c7-bf4aa55068c8 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:29.006523 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b96d47d2-855f-4157-a4c7-bf4aa55068c8 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:29.137003 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-664e5125-3824-4442-8021-ef0224e05a4b tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:29.145045 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-664e5125-3824-4442-8021-ef0224e05a4b tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/deef57f9-d933-48ad-a051-e782593799bf" status: 200 len: 1511 microversion: 2.1 time: 0.351613 Jan 15 20:58:29.149066 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1474/2952] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:28 2022] GET /compute/v2.1/servers/deef57f9-d933-48ad-a051-e782593799bf => generated 1511 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:29.152394 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b96d47d2-855f-4157-a4c7-bf4aa55068c8 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.181358 Jan 15 20:58:29.153467 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1479/2953] 10.222.0.46 () {58 vars in 1274 bytes} [Sat Jan 15 20:58:28 2022] GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/os-interface => generated 285 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:58:29.156040 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1a7c9308-47ae-4276-9948-d1633493bd89 tempest-KeyPairsNegativeTestJSON-1257137424 tempest-KeyPairsNegativeTestJSON-1257137424-project] Action: 'create', calling method: .version_select at 0x7f30c935dee0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-802557433", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:58:29.158245 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5ad29b0b-ea4a-452f-b522-51e4f1a822e0 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] Calling method '.version_select at 0x7f30c913eca0>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:29.192828 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-1a7c9308-47ae-4276-9948-d1633493bd89 tempest-KeyPairsNegativeTestJSON-1257137424 tempest-KeyPairsNegativeTestJSON-1257137424-project] Getting quotas for project 89608f43d7ed4ea5af9813c5c50377e9. Resources: {'key_pairs'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:58:29.199514 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-1a7c9308-47ae-4276-9948-d1633493bd89 tempest-KeyPairsNegativeTestJSON-1257137424 tempest-KeyPairsNegativeTestJSON-1257137424-project] Getting quotas for user 77d27b9d72e14f3b8b68d4c467323c06 and project 89608f43d7ed4ea5af9813c5c50377e9. Resources: {'key_pairs'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:58:29.206934 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5ad29b0b-ea4a-452f-b522-51e4f1a822e0 tempest-ServersTestFqdnHostnames-315190417 tempest-ServersTestFqdnHostnames-315190417-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1906508477" status: 202 len: 0 microversion: 2.1 time: 0.051959 Jan 15 20:58:29.207691 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1480/2954] 10.222.0.46 () {58 vars in 1220 bytes} [Sat Jan 15 20:58:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1906508477 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 20:58:29.229578 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-97e76c1c-7e2d-4d2c-bf22-f14bf611c973 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:29.231083 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-97e76c1c-7e2d-4d2c-bf22-f14bf611c973 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:29.251087 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-1a7c9308-47ae-4276-9948-d1633493bd89 tempest-KeyPairsNegativeTestJSON-1257137424 tempest-KeyPairsNegativeTestJSON-1257137424-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Jan 15 20:58:29.251832 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1a7c9308-47ae-4276-9948-d1633493bd89 tempest-KeyPairsNegativeTestJSON-1257137424 tempest-KeyPairsNegativeTestJSON-1257137424-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:58:29.252781 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-97e76c1c-7e2d-4d2c-bf22-f14bf611c973 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:29.253563 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-97e76c1c-7e2d-4d2c-bf22-f14bf611c973 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:29.254554 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-97e76c1c-7e2d-4d2c-bf22-f14bf611c973 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:29.257643 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-97e76c1c-7e2d-4d2c-bf22-f14bf611c973 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:29.261860 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-1a7c9308-47ae-4276-9948-d1633493bd89 tempest-KeyPairsNegativeTestJSON-1257137424 tempest-KeyPairsNegativeTestJSON-1257137424-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.111672 Jan 15 20:58:29.267714 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1475/2955] 10.222.0.46 () {60 vars in 1158 bytes} [Sat Jan 15 20:58:29 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 118 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jan 15 20:58:29.282859 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ad2a8839-06da-4ab4-ae4e-e4ff79c85ee0 tempest-KeyPairsNegativeTestJSON-1257137424 tempest-KeyPairsNegativeTestJSON-1257137424-project] Calling method '.version_select at 0x7f30c9032c10>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:29.316104 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-ad2a8839-06da-4ab4-ae4e-e4ff79c85ee0 tempest-KeyPairsNegativeTestJSON-1257137424 tempest-KeyPairsNegativeTestJSON-1257137424-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-1798624 not found for user 77d27b9d72e14f3b8b68d4c467323c06 Jan 15 20:58:29.317224 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ad2a8839-06da-4ab4-ae4e-e4ff79c85ee0 tempest-KeyPairsNegativeTestJSON-1257137424 tempest-KeyPairsNegativeTestJSON-1257137424-project] Returning 404 to user: Keypair tempest-keypair-non-existent-1798624 not found for user 77d27b9d72e14f3b8b68d4c467323c06 {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:58:29.318247 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ad2a8839-06da-4ab4-ae4e-e4ff79c85ee0 tempest-KeyPairsNegativeTestJSON-1257137424 tempest-KeyPairsNegativeTestJSON-1257137424-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1798624" status: 404 len: 142 microversion: 2.1 time: 0.043112 Jan 15 20:58:29.323654 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1476/2956] 10.222.0.46 () {58 vars in 1250 bytes} [Sat Jan 15 20:58:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1798624 => generated 142 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 15 20:58:29.584707 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9c9efce9-82e8-4ce1-b0fc-d9901df33127 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:29.587189 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-9c9efce9-82e8-4ce1-b0fc-d9901df33127 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] [instance: e04f7a96-62cb-4aae-9612-aa8df88aef61] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:29.597604 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9c9efce9-82e8-4ce1-b0fc-d9901df33127 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:29.598332 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9c9efce9-82e8-4ce1-b0fc-d9901df33127 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:29.599387 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9c9efce9-82e8-4ce1-b0fc-d9901df33127 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:29.599971 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9c9efce9-82e8-4ce1-b0fc-d9901df33127 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:29.746562 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-97e76c1c-7e2d-4d2c-bf22-f14bf611c973 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:29.763086 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-97e76c1c-7e2d-4d2c-bf22-f14bf611c973 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:29.764598 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-97e76c1c-7e2d-4d2c-bf22-f14bf611c973 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:29.783948 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-97e76c1c-7e2d-4d2c-bf22-f14bf611c973 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "GET /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee" status: 200 len: 1755 microversion: 2.42 time: 0.563997 Jan 15 20:58:29.793144 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1481/2957] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:58:29 2022] GET /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee => generated 1755 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:58:29.802863 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ec7f9644-ab7e-4386-98dd-4754015519d2 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:58:29.809438 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ec7f9644-ab7e-4386-98dd-4754015519d2 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] [instance: 62ae2a15-8c2c-4dad-971f-0611238103a3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:29.825574 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ec7f9644-ab7e-4386-98dd-4754015519d2 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:29.826034 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ec7f9644-ab7e-4386-98dd-4754015519d2 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:29.827608 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ec7f9644-ab7e-4386-98dd-4754015519d2 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:29.828058 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ec7f9644-ab7e-4386-98dd-4754015519d2 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:29.901069 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ec7f9644-ab7e-4386-98dd-4754015519d2 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] 10.222.0.46 "POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action" status: 200 len: 32634 microversion: 2.1 time: 0.104002 Jan 15 20:58:29.906259 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1482/2958] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:58:29 2022] POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action => generated 32634 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:58:29.918453 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2960ef36-2641-4b4d-a744-1414e273a1fa tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:29.919526 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-2960ef36-2641-4b4d-a744-1414e273a1fa tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] [instance: 84fe1922-dca1-4713-9ea1-bdd26b309ce6] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:29.929515 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2960ef36-2641-4b4d-a744-1414e273a1fa tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:29.930747 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2960ef36-2641-4b4d-a744-1414e273a1fa tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:29.931722 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2960ef36-2641-4b4d-a744-1414e273a1fa tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:29.932315 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2960ef36-2641-4b4d-a744-1414e273a1fa tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:29.962742 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-2960ef36-2641-4b4d-a744-1414e273a1fa tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] [instance: 84fe1922-dca1-4713-9ea1-bdd26b309ce6] Going to try to terminate instance {{(pid=129365) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 20:58:30.099563 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2960ef36-2641-4b4d-a744-1414e273a1fa tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] 10.222.0.46 "DELETE /compute/v2.1/servers/84fe1922-dca1-4713-9ea1-bdd26b309ce6" status: 204 len: 0 microversion: 2.1 time: 0.190371 Jan 15 20:58:30.104092 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1483/2959] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 20:58:29 2022] DELETE /compute/v2.1/servers/84fe1922-dca1-4713-9ea1-bdd26b309ce6 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 20:58:30.113609 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-561208f9-652d-4f16-b32f-737fdbc751ca tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:30.114545 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-561208f9-652d-4f16-b32f-737fdbc751ca tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] [instance: 84fe1922-dca1-4713-9ea1-bdd26b309ce6] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:30.126212 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-561208f9-652d-4f16-b32f-737fdbc751ca tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:30.126919 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-561208f9-652d-4f16-b32f-737fdbc751ca tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:30.128045 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-561208f9-652d-4f16-b32f-737fdbc751ca tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:30.129112 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-561208f9-652d-4f16-b32f-737fdbc751ca tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:30.537968 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-9c9efce9-82e8-4ce1-b0fc-d9901df33127 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05483ff6eec84f78a091b29cfbcf61f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a6720be5fb4de7bcd77cc7ef9d8000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:30.548987 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-9c9efce9-82e8-4ce1-b0fc-d9901df33127 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] 10.222.0.46 "GET /compute/v2.1/servers/e04f7a96-62cb-4aae-9612-aa8df88aef61" status: 200 len: 1520 microversion: 2.1 time: 0.978353 Jan 15 20:58:30.552195 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1477/2960] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:29 2022] GET /compute/v2.1/servers/e04f7a96-62cb-4aae-9612-aa8df88aef61 => generated 1520 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:30.567178 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1beb0e43-21b9-4789-9062-64cd74ea99f3 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:30.568827 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-1beb0e43-21b9-4789-9062-64cd74ea99f3 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: deef57f9-d933-48ad-a051-e782593799bf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:30.586265 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1beb0e43-21b9-4789-9062-64cd74ea99f3 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:30.587501 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1beb0e43-21b9-4789-9062-64cd74ea99f3 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:30.588404 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1beb0e43-21b9-4789-9062-64cd74ea99f3 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:30.588975 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1beb0e43-21b9-4789-9062-64cd74ea99f3 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:30.981970 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-561208f9-652d-4f16-b32f-737fdbc751ca tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ec114f8ece434aa496cd401494e2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a05b1a0a7479db84b762eca23b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:30.990640 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-561208f9-652d-4f16-b32f-737fdbc751ca tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] 10.222.0.46 "GET /compute/v2.1/servers/84fe1922-dca1-4713-9ea1-bdd26b309ce6" status: 200 len: 1500 microversion: 2.1 time: 0.885029 Jan 15 20:58:30.991631 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1484/2961] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:30 2022] GET /compute/v2.1/servers/84fe1922-dca1-4713-9ea1-bdd26b309ce6 => generated 1500 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:30.997508 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-83ed76f0-2524-4338-b7ad-9047c3db17b9 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:30.998290 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-83ed76f0-2524-4338-b7ad-9047c3db17b9 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:31.006171 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-83ed76f0-2524-4338-b7ad-9047c3db17b9 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:31.007273 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-83ed76f0-2524-4338-b7ad-9047c3db17b9 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:31.008917 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-83ed76f0-2524-4338-b7ad-9047c3db17b9 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:31.009504 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-83ed76f0-2524-4338-b7ad-9047c3db17b9 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:31.360239 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-1beb0e43-21b9-4789-9062-64cd74ea99f3 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:31.371521 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-1beb0e43-21b9-4789-9062-64cd74ea99f3 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/deef57f9-d933-48ad-a051-e782593799bf" status: 200 len: 1488 microversion: 2.1 time: 0.809426 Jan 15 20:58:31.372769 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1478/2962] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:30 2022] GET /compute/v2.1/servers/deef57f9-d933-48ad-a051-e782593799bf => generated 1488 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:31.381869 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1523910f-c370-4dd9-9151-f55e0852871c tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:58:31.383022 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-1523910f-c370-4dd9-9151-f55e0852871c tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] [instance: 62ae2a15-8c2c-4dad-971f-0611238103a3] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:31.390981 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1523910f-c370-4dd9-9151-f55e0852871c tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:31.391609 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1523910f-c370-4dd9-9151-f55e0852871c tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:31.393879 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1523910f-c370-4dd9-9151-f55e0852871c tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:31.394359 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1523910f-c370-4dd9-9151-f55e0852871c tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:31.442179 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-1523910f-c370-4dd9-9151-f55e0852871c tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] 10.222.0.46 "POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action" status: 200 len: 32634 microversion: 2.1 time: 0.067199 Jan 15 20:58:31.446914 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1479/2963] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:58:31 2022] POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action => generated 32634 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:58:31.449617 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-19d837db-2d13-453e-b082-196076810356 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:31.450202 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-19d837db-2d13-453e-b082-196076810356 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: deef57f9-d933-48ad-a051-e782593799bf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:31.457947 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-19d837db-2d13-453e-b082-196076810356 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:31.458399 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-19d837db-2d13-453e-b082-196076810356 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:31.459186 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-19d837db-2d13-453e-b082-196076810356 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:31.459637 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-19d837db-2d13-453e-b082-196076810356 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:31.486112 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-19d837db-2d13-453e-b082-196076810356 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: deef57f9-d933-48ad-a051-e782593799bf] Going to try to terminate instance {{(pid=129366) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 20:58:31.497662 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-83ed76f0-2524-4338-b7ad-9047c3db17b9 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:31.521989 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-83ed76f0-2524-4338-b7ad-9047c3db17b9 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:31.527204 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-83ed76f0-2524-4338-b7ad-9047c3db17b9 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:31.530737 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-83ed76f0-2524-4338-b7ad-9047c3db17b9 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "GET /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee" status: 200 len: 1790 microversion: 2.42 time: 0.536910 Jan 15 20:58:31.531453 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1485/2964] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:58:30 2022] GET /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee => generated 1790 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:58:31.574532 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e78e810b-f0df-4a7c-820e-ef55bdb168d2 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:31.575367 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e78e810b-f0df-4a7c-820e-ef55bdb168d2 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] [instance: e04f7a96-62cb-4aae-9612-aa8df88aef61] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:31.584804 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e78e810b-f0df-4a7c-820e-ef55bdb168d2 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:31.585597 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e78e810b-f0df-4a7c-820e-ef55bdb168d2 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:31.587784 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e78e810b-f0df-4a7c-820e-ef55bdb168d2 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:31.588504 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e78e810b-f0df-4a7c-820e-ef55bdb168d2 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:31.600996 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-19d837db-2d13-453e-b082-196076810356 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "DELETE /compute/v2.1/servers/deef57f9-d933-48ad-a051-e782593799bf" status: 204 len: 0 microversion: 2.1 time: 0.156120 Jan 15 20:58:31.605520 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1480/2965] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 20:58:31 2022] DELETE /compute/v2.1/servers/deef57f9-d933-48ad-a051-e782593799bf => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 20:58:31.610713 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-3d5e21ae-a492-4084-8c89-9a27f648691d tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:31.611622 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-3d5e21ae-a492-4084-8c89-9a27f648691d tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: deef57f9-d933-48ad-a051-e782593799bf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:31.619158 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3d5e21ae-a492-4084-8c89-9a27f648691d tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:31.619805 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3d5e21ae-a492-4084-8c89-9a27f648691d tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:31.620783 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3d5e21ae-a492-4084-8c89-9a27f648691d tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:31.621393 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3d5e21ae-a492-4084-8c89-9a27f648691d tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:32.189443 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-e78e810b-f0df-4a7c-820e-ef55bdb168d2 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05483ff6eec84f78a091b29cfbcf61f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a6720be5fb4de7bcd77cc7ef9d8000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:32.197844 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e78e810b-f0df-4a7c-820e-ef55bdb168d2 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] 10.222.0.46 "GET /compute/v2.1/servers/e04f7a96-62cb-4aae-9612-aa8df88aef61" status: 200 len: 1500 microversion: 2.1 time: 0.629601 Jan 15 20:58:32.209368 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1486/2966] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:31 2022] GET /compute/v2.1/servers/e04f7a96-62cb-4aae-9612-aa8df88aef61 => generated 1500 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:32.228279 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f77dda72-1cb8-4ac2-afe7-d8d77796f804 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:32.230889 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f77dda72-1cb8-4ac2-afe7-d8d77796f804 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] [instance: 84fe1922-dca1-4713-9ea1-bdd26b309ce6] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:32.246014 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f77dda72-1cb8-4ac2-afe7-d8d77796f804 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:32.249043 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-3d5e21ae-a492-4084-8c89-9a27f648691d tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:32.249749 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f77dda72-1cb8-4ac2-afe7-d8d77796f804 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:32.252298 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f77dda72-1cb8-4ac2-afe7-d8d77796f804 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:32.252991 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f77dda72-1cb8-4ac2-afe7-d8d77796f804 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:32.265193 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-3d5e21ae-a492-4084-8c89-9a27f648691d tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/deef57f9-d933-48ad-a051-e782593799bf" status: 200 len: 1494 microversion: 2.1 time: 0.656884 Jan 15 20:58:32.276967 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1481/2967] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:31 2022] GET /compute/v2.1/servers/deef57f9-d933-48ad-a051-e782593799bf => generated 1494 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:32.281950 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-2d2efc00-758a-473e-a2ae-5cfa414f557a req-1ebe90d3-8ddf-4ee0-acef-5e7313a5bd7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84fe1922-dca1-4713-9ea1-bdd26b309ce6", "name": "network-vif-deleted", "tag": "4dd9a494-ab1e-4bde-892a-a7dc884ad0a1"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:58:32.288619 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:58:32.288619 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:58:32.316444 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-2d2efc00-758a-473e-a2ae-5cfa414f557a req-1ebe90d3-8ddf-4ee0-acef-5e7313a5bd7f service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:32.316919 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-2d2efc00-758a-473e-a2ae-5cfa414f557a req-1ebe90d3-8ddf-4ee0-acef-5e7313a5bd7f service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:32.340629 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-2d2efc00-758a-473e-a2ae-5cfa414f557a req-1ebe90d3-8ddf-4ee0-acef-5e7313a5bd7f service nova] Creating event network-vif-deleted:4dd9a494-ab1e-4bde-892a-a7dc884ad0a1 for instance 84fe1922-dca1-4713-9ea1-bdd26b309ce6 on nch2-master-1 Jan 15 20:58:32.356102 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-2d2efc00-758a-473e-a2ae-5cfa414f557a req-1ebe90d3-8ddf-4ee0-acef-5e7313a5bd7f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087056 Jan 15 20:58:32.357168 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1482/2968] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:58:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:58:32.366372 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4252469f-6783-41b3-8a06-fd90445eda17 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "71f38de6-b902-4c86-aee3-dcc1ab1eaf75"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:58:32.373493 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-4252469f-6783-41b3-8a06-fd90445eda17 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] [instance: e04f7a96-62cb-4aae-9612-aa8df88aef61] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:32.386171 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4252469f-6783-41b3-8a06-fd90445eda17 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:32.388343 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4252469f-6783-41b3-8a06-fd90445eda17 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:32.389222 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4252469f-6783-41b3-8a06-fd90445eda17 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:32.389668 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4252469f-6783-41b3-8a06-fd90445eda17 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:32.397167 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-f77dda72-1cb8-4ac2-afe7-d8d77796f804 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ec114f8ece434aa496cd401494e2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a05b1a0a7479db84b762eca23b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:32.413056 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f77dda72-1cb8-4ac2-afe7-d8d77796f804 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] 10.222.0.46 "GET /compute/v2.1/servers/84fe1922-dca1-4713-9ea1-bdd26b309ce6" status: 200 len: 1296 microversion: 2.1 time: 0.197616 Jan 15 20:58:32.416876 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1487/2969] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:32 2022] GET /compute/v2.1/servers/84fe1922-dca1-4713-9ea1-bdd26b309ce6 => generated 1296 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:32.454856 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8e7054c4-e686-4d2a-9c05-f0b51d22169e tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:58:32.456231 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-8e7054c4-e686-4d2a-9c05-f0b51d22169e tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] [instance: 62ae2a15-8c2c-4dad-971f-0611238103a3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:32.461780 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-4252469f-6783-41b3-8a06-fd90445eda17 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] HTTP exception thrown: Cannot 'attach_volume' instance e04f7a96-62cb-4aae-9612-aa8df88aef61 while it is in vm_state rescued Jan 15 20:58:32.463185 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4252469f-6783-41b3-8a06-fd90445eda17 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Returning 409 to user: Cannot 'attach_volume' instance e04f7a96-62cb-4aae-9612-aa8df88aef61 while it is in vm_state rescued {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:58:32.464215 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-4252469f-6783-41b3-8a06-fd90445eda17 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] 10.222.0.46 "POST /compute/v2.1/servers/e04f7a96-62cb-4aae-9612-aa8df88aef61/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.105738 Jan 15 20:58:32.467176 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8e7054c4-e686-4d2a-9c05-f0b51d22169e tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:32.467625 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1483/2970] 10.222.0.46 () {60 vars in 1322 bytes} [Sat Jan 15 20:58:32 2022] POST /compute/v2.1/servers/e04f7a96-62cb-4aae-9612-aa8df88aef61/os-volume_attachments => generated 152 bytes in 108 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jan 15 20:58:32.467724 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8e7054c4-e686-4d2a-9c05-f0b51d22169e tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:32.469011 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8e7054c4-e686-4d2a-9c05-f0b51d22169e tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:32.470198 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8e7054c4-e686-4d2a-9c05-f0b51d22169e tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:32.480585 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-3de076b5-90ae-439f-b409-c65abb81d801 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:58:32.481697 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-3de076b5-90ae-439f-b409-c65abb81d801 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] [instance: e04f7a96-62cb-4aae-9612-aa8df88aef61] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:32.505076 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3de076b5-90ae-439f-b409-c65abb81d801 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:32.506813 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3de076b5-90ae-439f-b409-c65abb81d801 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:32.508660 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3de076b5-90ae-439f-b409-c65abb81d801 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:32.509549 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3de076b5-90ae-439f-b409-c65abb81d801 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:32.542167 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-8e7054c4-e686-4d2a-9c05-f0b51d22169e tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] 10.222.0.46 "POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action" status: 200 len: 32634 microversion: 2.1 time: 0.089053 Jan 15 20:58:32.542876 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1488/2971] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:58:32 2022] POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action => generated 32634 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 20:58:32.563932 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-0e51fb6b-a2c9-40ba-a660-48425c459ba1 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:32.569540 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-0e51fb6b-a2c9-40ba-a660-48425c459ba1 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:32.583785 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0e51fb6b-a2c9-40ba-a660-48425c459ba1 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:32.585237 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0e51fb6b-a2c9-40ba-a660-48425c459ba1 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:32.588218 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0e51fb6b-a2c9-40ba-a660-48425c459ba1 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:32.590156 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0e51fb6b-a2c9-40ba-a660-48425c459ba1 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:32.654155 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-3de076b5-90ae-439f-b409-c65abb81d801 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] 10.222.0.46 "POST /compute/v2.1/servers/e04f7a96-62cb-4aae-9612-aa8df88aef61/action" status: 202 len: 0 microversion: 2.1 time: 0.182439 Jan 15 20:58:32.655294 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1484/2972] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:58:32 2022] POST /compute/v2.1/servers/e04f7a96-62cb-4aae-9612-aa8df88aef61/action => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 20:58:32.665787 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-def758db-7d36-4bac-a33a-2d49e894319c tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:32.667509 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-def758db-7d36-4bac-a33a-2d49e894319c tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] [instance: e04f7a96-62cb-4aae-9612-aa8df88aef61] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:32.676782 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-def758db-7d36-4bac-a33a-2d49e894319c tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:32.677831 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-def758db-7d36-4bac-a33a-2d49e894319c tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:32.682625 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-def758db-7d36-4bac-a33a-2d49e894319c tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:32.683352 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-def758db-7d36-4bac-a33a-2d49e894319c tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:33.399600 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-0e51fb6b-a2c9-40ba-a660-48425c459ba1 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:33.413267 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-0e51fb6b-a2c9-40ba-a660-48425c459ba1 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:33.415324 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-0e51fb6b-a2c9-40ba-a660-48425c459ba1 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:33.416750 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-0e51fb6b-a2c9-40ba-a660-48425c459ba1 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "GET /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee" status: 200 len: 1837 microversion: 2.42 time: 0.867639 Jan 15 20:58:33.435965 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1489/2973] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:58:32 2022] GET /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee => generated 1837 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:58:33.440582 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-1af9b8f7-9e78-41a8-9bbb-f32539768f2e tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:58:33.441727 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-1af9b8f7-9e78-41a8-9bbb-f32539768f2e tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:33.462859 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1af9b8f7-9e78-41a8-9bbb-f32539768f2e tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:33.463324 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1af9b8f7-9e78-41a8-9bbb-f32539768f2e tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:33.464128 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1af9b8f7-9e78-41a8-9bbb-f32539768f2e tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:33.464609 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1af9b8f7-9e78-41a8-9bbb-f32539768f2e tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:33.507738 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-1af9b8f7-9e78-41a8-9bbb-f32539768f2e tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action" status: 200 len: 14 microversion: 2.1 time: 0.080953 Jan 15 20:58:33.509643 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1490/2974] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:58:33 2022] POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action => generated 14 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 20:58:33.524334 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-78e5f762-d866-49d6-ad36-7753690c69bf req-87416bc6-f22f-435f-a8a4-d3354251e94b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4504a13b-d10e-436a-a5ef-991829938dd9", "tag": "f7503e3b-a43e-4550-8109-a1fb1aa2d5f1"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:58:33.526219 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:58:33.526219 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:58:33.527634 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-def758db-7d36-4bac-a33a-2d49e894319c tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05483ff6eec84f78a091b29cfbcf61f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a6720be5fb4de7bcd77cc7ef9d8000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:33.538946 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-def758db-7d36-4bac-a33a-2d49e894319c tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] 10.222.0.46 "GET /compute/v2.1/servers/e04f7a96-62cb-4aae-9612-aa8df88aef61" status: 200 len: 1508 microversion: 2.1 time: 0.876432 Jan 15 20:58:33.541613 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1485/2975] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:32 2022] GET /compute/v2.1/servers/e04f7a96-62cb-4aae-9612-aa8df88aef61 => generated 1508 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:58:33.553889 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-78e5f762-d866-49d6-ad36-7753690c69bf req-87416bc6-f22f-435f-a8a4-d3354251e94b service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:33.556766 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1a525ba4-f0e3-48a3-89d1-0984000ca9f1 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:33.557120 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-78e5f762-d866-49d6-ad36-7753690c69bf req-87416bc6-f22f-435f-a8a4-d3354251e94b service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:33.557484 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-1a525ba4-f0e3-48a3-89d1-0984000ca9f1 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: deef57f9-d933-48ad-a051-e782593799bf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:33.576625 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-78e5f762-d866-49d6-ad36-7753690c69bf req-87416bc6-f22f-435f-a8a4-d3354251e94b service nova] Creating event network-changed:f7503e3b-a43e-4550-8109-a1fb1aa2d5f1 for instance 4504a13b-d10e-436a-a5ef-991829938dd9 on nch1-master-1 Jan 15 20:58:33.584693 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-78e5f762-d866-49d6-ad36-7753690c69bf req-87416bc6-f22f-435f-a8a4-d3354251e94b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072499 Jan 15 20:58:33.586560 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1491/2976] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:58:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:58:33.589249 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1a525ba4-f0e3-48a3-89d1-0984000ca9f1 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:33.589896 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1a525ba4-f0e3-48a3-89d1-0984000ca9f1 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:33.592931 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1a525ba4-f0e3-48a3-89d1-0984000ca9f1 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:33.593439 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1a525ba4-f0e3-48a3-89d1-0984000ca9f1 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:33.594386 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-08b0505d-a22b-41c7-bb3e-f7162b6bfda3 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:33.595511 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-08b0505d-a22b-41c7-bb3e-f7162b6bfda3 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] [instance: 84fe1922-dca1-4713-9ea1-bdd26b309ce6] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:33.611112 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-08b0505d-a22b-41c7-bb3e-f7162b6bfda3 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:33.611727 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-08b0505d-a22b-41c7-bb3e-f7162b6bfda3 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:33.612897 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-08b0505d-a22b-41c7-bb3e-f7162b6bfda3 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:33.613782 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-08b0505d-a22b-41c7-bb3e-f7162b6bfda3 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:33.632296 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-08b0505d-a22b-41c7-bb3e-f7162b6bfda3 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] HTTP exception thrown: Instance 84fe1922-dca1-4713-9ea1-bdd26b309ce6 could not be found. Jan 15 20:58:33.633512 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-08b0505d-a22b-41c7-bb3e-f7162b6bfda3 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Returning 404 to user: Instance 84fe1922-dca1-4713-9ea1-bdd26b309ce6 could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:58:33.634645 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-08b0505d-a22b-41c7-bb3e-f7162b6bfda3 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] 10.222.0.46 "GET /compute/v2.1/servers/84fe1922-dca1-4713-9ea1-bdd26b309ce6" status: 404 len: 111 microversion: 2.1 time: 0.046314 Jan 15 20:58:33.635627 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1492/2977] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:33 2022] GET /compute/v2.1/servers/84fe1922-dca1-4713-9ea1-bdd26b309ce6 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:58:33.644225 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3ba4cc2a-f187-4175-a6f7-cba85f7e1fef tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:58:33.647031 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-3ba4cc2a-f187-4175-a6f7-cba85f7e1fef tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] [instance: 62ae2a15-8c2c-4dad-971f-0611238103a3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:33.657794 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3ba4cc2a-f187-4175-a6f7-cba85f7e1fef tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:33.658466 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3ba4cc2a-f187-4175-a6f7-cba85f7e1fef tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:33.659743 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3ba4cc2a-f187-4175-a6f7-cba85f7e1fef tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:33.660382 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3ba4cc2a-f187-4175-a6f7-cba85f7e1fef tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:33.719257 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3ba4cc2a-f187-4175-a6f7-cba85f7e1fef tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] 10.222.0.46 "POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action" status: 200 len: 32634 microversion: 2.1 time: 0.081255 Jan 15 20:58:33.721062 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1493/2978] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:58:33 2022] POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action => generated 32634 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:58:33.728897 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9c13bbc3-b0cc-4c2a-a0f3-2282d32f192d tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:33.729802 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-9c13bbc3-b0cc-4c2a-a0f3-2282d32f192d tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] [instance: 137421ba-6834-4e42-8221-9b5de84419cc] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:33.738929 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9c13bbc3-b0cc-4c2a-a0f3-2282d32f192d tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:33.740289 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9c13bbc3-b0cc-4c2a-a0f3-2282d32f192d tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:33.742240 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9c13bbc3-b0cc-4c2a-a0f3-2282d32f192d tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:33.744694 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9c13bbc3-b0cc-4c2a-a0f3-2282d32f192d tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:33.784233 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-9c13bbc3-b0cc-4c2a-a0f3-2282d32f192d tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] [instance: 137421ba-6834-4e42-8221-9b5de84419cc] Going to try to terminate instance {{(pid=129365) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 20:58:33.955854 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-9c13bbc3-b0cc-4c2a-a0f3-2282d32f192d tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] 10.222.0.46 "DELETE /compute/v2.1/servers/137421ba-6834-4e42-8221-9b5de84419cc" status: 204 len: 0 microversion: 2.1 time: 0.231176 Jan 15 20:58:33.960979 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1494/2979] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 20:58:33 2022] DELETE /compute/v2.1/servers/137421ba-6834-4e42-8221-9b5de84419cc => generated 0 bytes in 236 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 20:58:33.984355 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-be59fc66-ac5f-4fd1-b3ed-e5a753b16933 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:33.989257 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-be59fc66-ac5f-4fd1-b3ed-e5a753b16933 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] [instance: 137421ba-6834-4e42-8221-9b5de84419cc] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:33.997870 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-be59fc66-ac5f-4fd1-b3ed-e5a753b16933 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:33.998563 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-be59fc66-ac5f-4fd1-b3ed-e5a753b16933 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:33.999457 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-be59fc66-ac5f-4fd1-b3ed-e5a753b16933 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:34.000691 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-be59fc66-ac5f-4fd1-b3ed-e5a753b16933 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:34.444023 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-1a525ba4-f0e3-48a3-89d1-0984000ca9f1 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:34.458977 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-1a525ba4-f0e3-48a3-89d1-0984000ca9f1 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/deef57f9-d933-48ad-a051-e782593799bf" status: 200 len: 1494 microversion: 2.1 time: 0.913406 Jan 15 20:58:34.464029 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1486/2980] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:33 2022] GET /compute/v2.1/servers/deef57f9-d933-48ad-a051-e782593799bf => generated 1494 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:34.470582 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-2a716345-0e15-4a17-a217-18111ebb0463 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:34.471438 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-2a716345-0e15-4a17-a217-18111ebb0463 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:34.481377 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2a716345-0e15-4a17-a217-18111ebb0463 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:34.482144 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2a716345-0e15-4a17-a217-18111ebb0463 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:34.483175 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2a716345-0e15-4a17-a217-18111ebb0463 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:34.483811 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2a716345-0e15-4a17-a217-18111ebb0463 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:35.124643 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-2a716345-0e15-4a17-a217-18111ebb0463 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:35.132915 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-be59fc66-ac5f-4fd1-b3ed-e5a753b16933 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ec114f8ece434aa496cd401494e2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a05b1a0a7479db84b762eca23b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:35.137073 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-2a716345-0e15-4a17-a217-18111ebb0463 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:35.140101 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-2a716345-0e15-4a17-a217-18111ebb0463 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:35.144397 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-2a716345-0e15-4a17-a217-18111ebb0463 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "GET /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee" status: 200 len: 1837 microversion: 2.42 time: 0.678378 Jan 15 20:58:35.151067 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-be59fc66-ac5f-4fd1-b3ed-e5a753b16933 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] 10.222.0.46 "GET /compute/v2.1/servers/137421ba-6834-4e42-8221-9b5de84419cc" status: 200 len: 1485 microversion: 2.1 time: 1.176286 Jan 15 20:58:35.151945 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1495/2981] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:33 2022] GET /compute/v2.1/servers/137421ba-6834-4e42-8221-9b5de84419cc => generated 1485 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:35.157786 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1487/2982] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:58:34 2022] GET /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee => generated 1837 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:58:35.158576 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-262f59e2-5f55-4f86-a067-b6488dda6380 req-871eb0d3-6a4f-4901-a97e-da8f222529e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1884dd3f-949c-4df3-a977-3f6f5a204fee", "tag": "e3bdb69c-2e57-497e-80bb-2b7d539e87f7"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:58:35.160293 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:58:35.160293 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:58:35.166777 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a952a7b1-0b56-4e57-9355-08249cac9978 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:58:35.169396 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a952a7b1-0b56-4e57-9355-08249cac9978 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:35.175425 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-262f59e2-5f55-4f86-a067-b6488dda6380 req-871eb0d3-6a4f-4901-a97e-da8f222529e9 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:35.175886 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-262f59e2-5f55-4f86-a067-b6488dda6380 req-871eb0d3-6a4f-4901-a97e-da8f222529e9 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:35.177054 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a952a7b1-0b56-4e57-9355-08249cac9978 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:35.177729 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a952a7b1-0b56-4e57-9355-08249cac9978 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:35.178928 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a952a7b1-0b56-4e57-9355-08249cac9978 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:35.179369 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a952a7b1-0b56-4e57-9355-08249cac9978 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:35.188112 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-262f59e2-5f55-4f86-a067-b6488dda6380 req-871eb0d3-6a4f-4901-a97e-da8f222529e9 service nova] Creating event network-changed:e3bdb69c-2e57-497e-80bb-2b7d539e87f7 for instance 1884dd3f-949c-4df3-a977-3f6f5a204fee on nch2-master-1 Jan 15 20:58:35.201500 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-262f59e2-5f55-4f86-a067-b6488dda6380 req-871eb0d3-6a4f-4901-a97e-da8f222529e9 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048123 Jan 15 20:58:35.203328 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1496/2983] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:58:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:58:35.208673 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-33e273fe-6eb5-4fd3-b939-2a7976a3a76a tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:35.209455 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-33e273fe-6eb5-4fd3-b939-2a7976a3a76a tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] [instance: e04f7a96-62cb-4aae-9612-aa8df88aef61] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:35.222293 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-33e273fe-6eb5-4fd3-b939-2a7976a3a76a tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:35.223465 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-33e273fe-6eb5-4fd3-b939-2a7976a3a76a tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:35.224419 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-33e273fe-6eb5-4fd3-b939-2a7976a3a76a tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:35.225036 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-33e273fe-6eb5-4fd3-b939-2a7976a3a76a tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:35.230252 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a952a7b1-0b56-4e57-9355-08249cac9978 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action" status: 200 len: 14 microversion: 2.1 time: 0.070743 Jan 15 20:58:35.233365 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1488/2984] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:58:35 2022] POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action => generated 14 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 20:58:35.242405 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-5b8bc9e9-2342-4bc2-944e-3bb0f063575c tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:58:35.243594 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-5b8bc9e9-2342-4bc2-944e-3bb0f063575c tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] [instance: 62ae2a15-8c2c-4dad-971f-0611238103a3] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:35.256624 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5b8bc9e9-2342-4bc2-944e-3bb0f063575c tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:35.257338 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5b8bc9e9-2342-4bc2-944e-3bb0f063575c tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:35.259119 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5b8bc9e9-2342-4bc2-944e-3bb0f063575c tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:35.260267 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5b8bc9e9-2342-4bc2-944e-3bb0f063575c tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:35.330006 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-5b8bc9e9-2342-4bc2-944e-3bb0f063575c tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] 10.222.0.46 "POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action" status: 200 len: 32634 microversion: 2.1 time: 0.097057 Jan 15 20:58:35.332462 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1489/2985] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:58:35 2022] POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action => generated 32634 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:58:35.491544 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-83494ae1-37c4-4f3b-8db1-97fac331037a tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:35.494211 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-83494ae1-37c4-4f3b-8db1-97fac331037a tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: deef57f9-d933-48ad-a051-e782593799bf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:35.504432 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-83494ae1-37c4-4f3b-8db1-97fac331037a tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:35.506926 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-83494ae1-37c4-4f3b-8db1-97fac331037a tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:35.509409 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-83494ae1-37c4-4f3b-8db1-97fac331037a tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:35.510988 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-83494ae1-37c4-4f3b-8db1-97fac331037a tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:35.566691 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-83494ae1-37c4-4f3b-8db1-97fac331037a tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:35.567311 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-83494ae1-37c4-4f3b-8db1-97fac331037a tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:35.567877 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.objects.instance [None req-83494ae1-37c4-4f3b-8db1-97fac331037a tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lazy-loading 'fault' on Instance uuid deef57f9-d933-48ad-a051-e782593799bf {{(pid=129366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 20:58:35.689331 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-83494ae1-37c4-4f3b-8db1-97fac331037a tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:35.698852 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-83494ae1-37c4-4f3b-8db1-97fac331037a tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/deef57f9-d933-48ad-a051-e782593799bf" status: 200 len: 1305 microversion: 2.1 time: 0.216807 Jan 15 20:58:35.703179 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-33e273fe-6eb5-4fd3-b939-2a7976a3a76a tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05483ff6eec84f78a091b29cfbcf61f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a6720be5fb4de7bcd77cc7ef9d8000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:35.707196 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1490/2986] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:35 2022] GET /compute/v2.1/servers/deef57f9-d933-48ad-a051-e782593799bf => generated 1305 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:58:35.720669 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-33e273fe-6eb5-4fd3-b939-2a7976a3a76a tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] 10.222.0.46 "GET /compute/v2.1/servers/e04f7a96-62cb-4aae-9612-aa8df88aef61" status: 200 len: 1508 microversion: 2.1 time: 0.515891 Jan 15 20:58:35.722054 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1497/2987] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:35 2022] GET /compute/v2.1/servers/e04f7a96-62cb-4aae-9612-aa8df88aef61 => generated 1508 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:36.179398 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-95a50f08-601a-432e-9634-09f78b90442d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:36.181726 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-13b15a65-71b0-4334-a21b-23776b0a60c0 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:36.185586 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-13b15a65-71b0-4334-a21b-23776b0a60c0 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] [instance: 137421ba-6834-4e42-8221-9b5de84419cc] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:36.186101 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-95a50f08-601a-432e-9634-09f78b90442d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:36.209465 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-95a50f08-601a-432e-9634-09f78b90442d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:36.211869 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-95a50f08-601a-432e-9634-09f78b90442d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:36.214245 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-95a50f08-601a-432e-9634-09f78b90442d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:36.214577 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-13b15a65-71b0-4334-a21b-23776b0a60c0 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:36.215719 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-13b15a65-71b0-4334-a21b-23776b0a60c0 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:36.216340 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-95a50f08-601a-432e-9634-09f78b90442d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:36.219741 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-13b15a65-71b0-4334-a21b-23776b0a60c0 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:36.223129 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-13b15a65-71b0-4334-a21b-23776b0a60c0 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:36.716398 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-13b15a65-71b0-4334-a21b-23776b0a60c0 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ec114f8ece434aa496cd401494e2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a05b1a0a7479db84b762eca23b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:36.724569 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-13b15a65-71b0-4334-a21b-23776b0a60c0 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] 10.222.0.46 "GET /compute/v2.1/servers/137421ba-6834-4e42-8221-9b5de84419cc" status: 200 len: 1443 microversion: 2.1 time: 0.557011 Jan 15 20:58:36.740424 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1498/2988] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:36 2022] GET /compute/v2.1/servers/137421ba-6834-4e42-8221-9b5de84419cc => generated 1443 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:36.746121 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-49c8952d-f0d1-4ee7-808e-c608cffe63d0 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:58:36.747100 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-49c8952d-f0d1-4ee7-808e-c608cffe63d0 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:36.763357 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-49c8952d-f0d1-4ee7-808e-c608cffe63d0 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:36.775448 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-49c8952d-f0d1-4ee7-808e-c608cffe63d0 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:36.781600 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-49c8952d-f0d1-4ee7-808e-c608cffe63d0 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:36.782255 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-49c8952d-f0d1-4ee7-808e-c608cffe63d0 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:36.887245 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-49c8952d-f0d1-4ee7-808e-c608cffe63d0 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action" status: 200 len: 14 microversion: 2.1 time: 0.145144 Jan 15 20:58:36.890441 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1499/2989] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:58:36 2022] POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action => generated 14 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 20:58:36.896232 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-6de65257-35ba-4432-869f-e6e9eeb58b3a tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:58:36.900215 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-6de65257-35ba-4432-869f-e6e9eeb58b3a tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] [instance: 62ae2a15-8c2c-4dad-971f-0611238103a3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:36.935686 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6de65257-35ba-4432-869f-e6e9eeb58b3a tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:36.936731 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6de65257-35ba-4432-869f-e6e9eeb58b3a tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:36.940996 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6de65257-35ba-4432-869f-e6e9eeb58b3a tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:36.942574 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6de65257-35ba-4432-869f-e6e9eeb58b3a tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:37.027125 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-95a50f08-601a-432e-9634-09f78b90442d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:37.049452 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-95a50f08-601a-432e-9634-09f78b90442d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:37.052254 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-6de65257-35ba-4432-869f-e6e9eeb58b3a tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] 10.222.0.46 "POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action" status: 200 len: 32634 microversion: 2.1 time: 0.162130 Jan 15 20:58:37.054116 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1500/2990] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:58:36 2022] POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action => generated 32634 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:58:37.056217 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-95a50f08-601a-432e-9634-09f78b90442d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:37.062117 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-95a50f08-601a-432e-9634-09f78b90442d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "GET /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee" status: 200 len: 1858 microversion: 2.42 time: 0.895965 Jan 15 20:58:37.062715 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1491/2991] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:58:36 2022] GET /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee => generated 1858 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:58:37.063919 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-565a6573-574d-4a9f-8d22-653112967c2e tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:37.065521 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-565a6573-574d-4a9f-8d22-653112967c2e tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: deef57f9-d933-48ad-a051-e782593799bf] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:37.074038 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-565a6573-574d-4a9f-8d22-653112967c2e tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:37.074701 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-565a6573-574d-4a9f-8d22-653112967c2e tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:37.075834 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-565a6573-574d-4a9f-8d22-653112967c2e tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:37.077182 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-565a6573-574d-4a9f-8d22-653112967c2e tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:37.077788 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b2731366-ebb4-468b-9b3a-6fe38f264df2 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:37.078507 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b2731366-ebb4-468b-9b3a-6fe38f264df2 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] [instance: e04f7a96-62cb-4aae-9612-aa8df88aef61] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:37.089578 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b2731366-ebb4-468b-9b3a-6fe38f264df2 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:37.090275 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b2731366-ebb4-468b-9b3a-6fe38f264df2 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:37.091312 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b2731366-ebb4-468b-9b3a-6fe38f264df2 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:37.094871 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b2731366-ebb4-468b-9b3a-6fe38f264df2 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:37.112920 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-565a6573-574d-4a9f-8d22-653112967c2e tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] HTTP exception thrown: Instance deef57f9-d933-48ad-a051-e782593799bf could not be found. Jan 15 20:58:37.114078 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-565a6573-574d-4a9f-8d22-653112967c2e tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Returning 404 to user: Instance deef57f9-d933-48ad-a051-e782593799bf could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:58:37.115562 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-565a6573-574d-4a9f-8d22-653112967c2e tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/deef57f9-d933-48ad-a051-e782593799bf" status: 404 len: 111 microversion: 2.1 time: 0.059093 Jan 15 20:58:37.117386 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1501/2992] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:37 2022] GET /compute/v2.1/servers/deef57f9-d933-48ad-a051-e782593799bf => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:58:37.254501 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-32b82f39-73fd-459b-b6ea-e33d0da9fe10 tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-1991082652", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "networks": [{"uuid": "a0bd7267-78f7-47d3-a245-2891ae658b43"}]}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:58:37.406696 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.network.neutron [None req-32b82f39-73fd-459b-b6ea-e33d0da9fe10 tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] validate_networks() for [('a0bd7267-78f7-47d3-a245-2891ae658b43', None, None, None, None, None)] {{(pid=129365) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 20:58:37.428776 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-b2731366-ebb4-468b-9b3a-6fe38f264df2 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05483ff6eec84f78a091b29cfbcf61f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a6720be5fb4de7bcd77cc7ef9d8000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:37.437662 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b2731366-ebb4-468b-9b3a-6fe38f264df2 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] 10.222.0.46 "GET /compute/v2.1/servers/e04f7a96-62cb-4aae-9612-aa8df88aef61" status: 200 len: 1514 microversion: 2.1 time: 0.373722 Jan 15 20:58:37.443177 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1492/2993] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:37 2022] GET /compute/v2.1/servers/e04f7a96-62cb-4aae-9612-aa8df88aef61 => generated 1514 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:37.462303 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-5861b1da-2a0b-4cd6-a3d9-ba480d518df8 req-20067075-aca1-444c-b266-4aa057ce2fc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "deef57f9-d933-48ad-a051-e782593799bf", "name": "network-vif-deleted", "tag": "00278b05-3736-45fa-b8cc-cc991355aa9a"}, {"name": "network-changed", "server_uuid": "1884dd3f-949c-4df3-a977-3f6f5a204fee", "tag": "5a70acfe-3b12-4c47-a821-8552633f0121"}, {"server_uuid": "137421ba-6834-4e42-8221-9b5de84419cc", "name": "network-vif-deleted", "tag": "eb8f87ed-8d87-47ae-bacf-831dd563cfce"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:58:37.464494 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:58:37.464494 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:58:37.481530 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-5861b1da-2a0b-4cd6-a3d9-ba480d518df8 req-20067075-aca1-444c-b266-4aa057ce2fc3 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:37.482166 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-5861b1da-2a0b-4cd6-a3d9-ba480d518df8 req-20067075-aca1-444c-b266-4aa057ce2fc3 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:37.515806 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-5861b1da-2a0b-4cd6-a3d9-ba480d518df8 req-20067075-aca1-444c-b266-4aa057ce2fc3 service nova] Creating event network-vif-deleted:00278b05-3736-45fa-b8cc-cc991355aa9a for instance deef57f9-d933-48ad-a051-e782593799bf on nch1-master-1 Jan 15 20:58:37.516317 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-5861b1da-2a0b-4cd6-a3d9-ba480d518df8 req-20067075-aca1-444c-b266-4aa057ce2fc3 service nova] Creating event network-changed:5a70acfe-3b12-4c47-a821-8552633f0121 for instance 1884dd3f-949c-4df3-a977-3f6f5a204fee on nch2-master-1 Jan 15 20:58:37.516831 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-5861b1da-2a0b-4cd6-a3d9-ba480d518df8 req-20067075-aca1-444c-b266-4aa057ce2fc3 service nova] Creating event network-vif-deleted:eb8f87ed-8d87-47ae-bacf-831dd563cfce for instance 137421ba-6834-4e42-8221-9b5de84419cc on nch2-master-1 Jan 15 20:58:37.541349 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-5861b1da-2a0b-4cd6-a3d9-ba480d518df8 req-20067075-aca1-444c-b266-4aa057ce2fc3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 521 microversion: 2.1 time: 0.095764 Jan 15 20:58:37.545389 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1493/2994] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:58:37 2022] POST /compute/v2.1/os-server-external-events => generated 521 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:58:37.565771 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-01c2cd3b-794a-40d6-ab5c-dca92ceadc1d tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-153409330", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "networks": [{"uuid": "531bba45-51d6-4df1-9e47-d4b8172e5210"}]}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:58:37.677173 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.network.neutron [None req-01c2cd3b-794a-40d6-ab5c-dca92ceadc1d tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] validate_networks() for [('531bba45-51d6-4df1-9e47-d4b8172e5210', None, None, None, None, None)] {{(pid=129366) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 20:58:38.729311 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-32b82f39-73fd-459b-b6ea-e33d0da9fe10 tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Flavor limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 20:58:38.730475 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-32b82f39-73fd-459b-b6ea-e33d0da9fe10 tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Image limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 20:58:38.731051 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-32b82f39-73fd-459b-b6ea-e33d0da9fe10 tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Flavor pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 20:58:38.731527 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-32b82f39-73fd-459b-b6ea-e33d0da9fe10 tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Image pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 20:58:38.732184 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-32b82f39-73fd-459b-b6ea-e33d0da9fe10 tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 20:58:38.743157 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-32b82f39-73fd-459b-b6ea-e33d0da9fe10 tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:38.744398 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-32b82f39-73fd-459b-b6ea-e33d0da9fe10 tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:38.745837 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-32b82f39-73fd-459b-b6ea-e33d0da9fe10 tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:38.747017 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-32b82f39-73fd-459b-b6ea-e33d0da9fe10 tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:38.769891 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-32b82f39-73fd-459b-b6ea-e33d0da9fe10 tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Getting quotas for project fdef9bfc39b84aba936ad3c1dfda8e9d. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:58:38.776721 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-32b82f39-73fd-459b-b6ea-e33d0da9fe10 tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Getting quotas for user ff71c36a6ee04b67a6db8940296dc9ef and project fdef9bfc39b84aba936ad3c1dfda8e9d. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:58:38.795067 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-32b82f39-73fd-459b-b6ea-e33d0da9fe10 tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Going to run 1 instances... {{(pid=129365) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 20:58:38.798377 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-32b82f39-73fd-459b-b6ea-e33d0da9fe10 tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] [instance: bcf7aaa6-1938-4efc-bb5d-efb290dc345e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129365) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 20:58:38.863674 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-32b82f39-73fd-459b-b6ea-e33d0da9fe10 tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 1.744702 Jan 15 20:58:38.865683 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1502/2995] 10.222.0.46 () {62 vars in 1187 bytes} [Sat Jan 15 20:58:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1747 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jan 15 20:58:38.871113 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-24f73d86-3356-4480-81ea-203ceaecc6a4 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:38.872462 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-24f73d86-3356-4480-81ea-203ceaecc6a4 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] [instance: 137421ba-6834-4e42-8221-9b5de84419cc] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:38.887907 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-24f73d86-3356-4480-81ea-203ceaecc6a4 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:38.888416 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-24f73d86-3356-4480-81ea-203ceaecc6a4 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:38.891911 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-24f73d86-3356-4480-81ea-203ceaecc6a4 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:38.892547 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-24f73d86-3356-4480-81ea-203ceaecc6a4 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:38.914732 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-01c2cd3b-794a-40d6-ab5c-dca92ceadc1d tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Flavor limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 20:58:38.915617 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-01c2cd3b-794a-40d6-ab5c-dca92ceadc1d tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Image limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 20:58:38.916111 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-01c2cd3b-794a-40d6-ab5c-dca92ceadc1d tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Flavor pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 20:58:38.916521 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-01c2cd3b-794a-40d6-ab5c-dca92ceadc1d tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Image pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 20:58:38.918154 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-01c2cd3b-794a-40d6-ab5c-dca92ceadc1d tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 20:58:38.955184 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-01c2cd3b-794a-40d6-ab5c-dca92ceadc1d tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:38.957354 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-01c2cd3b-794a-40d6-ab5c-dca92ceadc1d tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:38.957669 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-24f73d86-3356-4480-81ea-203ceaecc6a4 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] HTTP exception thrown: Instance 137421ba-6834-4e42-8221-9b5de84419cc could not be found. Jan 15 20:58:38.958773 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-24f73d86-3356-4480-81ea-203ceaecc6a4 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Returning 404 to user: Instance 137421ba-6834-4e42-8221-9b5de84419cc could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:58:38.959997 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-24f73d86-3356-4480-81ea-203ceaecc6a4 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] 10.222.0.46 "GET /compute/v2.1/servers/137421ba-6834-4e42-8221-9b5de84419cc" status: 404 len: 111 microversion: 2.1 time: 0.093166 Jan 15 20:58:38.960640 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-01c2cd3b-794a-40d6-ab5c-dca92ceadc1d tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:38.961904 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1503/2996] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:38 2022] GET /compute/v2.1/servers/137421ba-6834-4e42-8221-9b5de84419cc => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:58:38.962471 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-01c2cd3b-794a-40d6-ab5c-dca92ceadc1d tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:38.967991 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9d3c7b4b-768c-45e3-bd92-15034db08e67 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:58:38.970049 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-9d3c7b4b-768c-45e3-bd92-15034db08e67 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:38.979732 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9d3c7b4b-768c-45e3-bd92-15034db08e67 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:38.980539 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9d3c7b4b-768c-45e3-bd92-15034db08e67 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:38.981714 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9d3c7b4b-768c-45e3-bd92-15034db08e67 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:38.982616 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9d3c7b4b-768c-45e3-bd92-15034db08e67 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:39.027895 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-01c2cd3b-794a-40d6-ab5c-dca92ceadc1d tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Getting quotas for project 51cad90ef72141c2983640133453f788. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:58:39.041921 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-01c2cd3b-794a-40d6-ab5c-dca92ceadc1d tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Getting quotas for user 765cbcb4d9c8476494f08b123d1db59b and project 51cad90ef72141c2983640133453f788. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:58:39.059133 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-9d3c7b4b-768c-45e3-bd92-15034db08e67 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action" status: 200 len: 14 microversion: 2.1 time: 0.095395 Jan 15 20:58:39.062807 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1504/2997] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:58:38 2022] POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action => generated 14 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 20:58:39.072670 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-78516709-4c6a-41b2-b5ed-e8b7bba3dc11 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:58:39.076911 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-78516709-4c6a-41b2-b5ed-e8b7bba3dc11 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] [instance: 62ae2a15-8c2c-4dad-971f-0611238103a3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:39.082630 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-01c2cd3b-794a-40d6-ab5c-dca92ceadc1d tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Going to run 1 instances... {{(pid=129366) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 20:58:39.088078 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-01c2cd3b-794a-40d6-ab5c-dca92ceadc1d tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: 67049bcd-1b55-4546-9f51-ab337a3be6be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 20:58:39.096474 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-78516709-4c6a-41b2-b5ed-e8b7bba3dc11 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:39.099910 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-78516709-4c6a-41b2-b5ed-e8b7bba3dc11 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:39.102721 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-78516709-4c6a-41b2-b5ed-e8b7bba3dc11 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:39.104954 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-78516709-4c6a-41b2-b5ed-e8b7bba3dc11 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:39.217836 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-78516709-4c6a-41b2-b5ed-e8b7bba3dc11 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] 10.222.0.46 "POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action" status: 200 len: 32634 microversion: 2.1 time: 0.152841 Jan 15 20:58:39.223644 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-01c2cd3b-794a-40d6-ab5c-dca92ceadc1d tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.673801 Jan 15 20:58:39.224632 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1494/2998] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 20:58:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1678 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 20:58:39.233685 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-6833930a-22a9-4041-9910-dccc8424df06 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:39.234843 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-6833930a-22a9-4041-9910-dccc8424df06 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:39.240092 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1505/2999] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:58:39 2022] POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action => generated 32634 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:58:39.253388 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6833930a-22a9-4041-9910-dccc8424df06 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:39.256294 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6833930a-22a9-4041-9910-dccc8424df06 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:39.259299 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-710db015-0ea9-43c1-aa66-14b8fb0492e5 tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:39.259567 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6833930a-22a9-4041-9910-dccc8424df06 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:39.260192 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6833930a-22a9-4041-9910-dccc8424df06 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:39.281619 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-710db015-0ea9-43c1-aa66-14b8fb0492e5 tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] [instance: bcf7aaa6-1938-4efc-bb5d-efb290dc345e] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:39.591855 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-710db015-0ea9-43c1-aa66-14b8fb0492e5 tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff71c36a6ee04b67a6db8940296dc9ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdef9bfc39b84aba936ad3c1dfda8e9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:39.600409 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-710db015-0ea9-43c1-aa66-14b8fb0492e5 tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff71c36a6ee04b67a6db8940296dc9ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdef9bfc39b84aba936ad3c1dfda8e9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:39.611075 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-710db015-0ea9-43c1-aa66-14b8fb0492e5 tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff71c36a6ee04b67a6db8940296dc9ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdef9bfc39b84aba936ad3c1dfda8e9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:39.612752 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-710db015-0ea9-43c1-aa66-14b8fb0492e5 tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] 10.222.0.46 "GET /compute/v2.1/servers/bcf7aaa6-1938-4efc-bb5d-efb290dc345e" status: 200 len: 1259 microversion: 2.21 time: 0.368357 Jan 15 20:58:39.613575 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1506/3000] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:58:39 2022] GET /compute/v2.1/servers/bcf7aaa6-1938-4efc-bb5d-efb290dc345e => generated 1259 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:58:39.629851 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-829142d4-9378-466d-8b3b-31c8ade1526c tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:39.637664 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-829142d4-9378-466d-8b3b-31c8ade1526c tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] [instance: 0207c6e5-54cf-4b26-b1e7-ed649dac8bb9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:39.665899 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-829142d4-9378-466d-8b3b-31c8ade1526c tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:39.667261 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-829142d4-9378-466d-8b3b-31c8ade1526c tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:39.669880 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-829142d4-9378-466d-8b3b-31c8ade1526c tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:39.670402 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-829142d4-9378-466d-8b3b-31c8ade1526c tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:39.773178 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-829142d4-9378-466d-8b3b-31c8ade1526c tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] [instance: 0207c6e5-54cf-4b26-b1e7-ed649dac8bb9] Going to try to terminate instance {{(pid=129365) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 20:58:40.017786 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-829142d4-9378-466d-8b3b-31c8ade1526c tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] 10.222.0.46 "DELETE /compute/v2.1/servers/0207c6e5-54cf-4b26-b1e7-ed649dac8bb9" status: 204 len: 0 microversion: 2.1 time: 0.391649 Jan 15 20:58:40.024981 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1507/3001] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 20:58:39 2022] DELETE /compute/v2.1/servers/0207c6e5-54cf-4b26-b1e7-ed649dac8bb9 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 20:58:40.032975 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2dc877a2-f861-4f6a-92a0-7d7479640a45 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:40.036738 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-2dc877a2-f861-4f6a-92a0-7d7479640a45 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] [instance: e04f7a96-62cb-4aae-9612-aa8df88aef61] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:40.051387 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2dc877a2-f861-4f6a-92a0-7d7479640a45 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:40.051816 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2dc877a2-f861-4f6a-92a0-7d7479640a45 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:40.053683 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2dc877a2-f861-4f6a-92a0-7d7479640a45 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:40.054125 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2dc877a2-f861-4f6a-92a0-7d7479640a45 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:40.066051 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-6833930a-22a9-4041-9910-dccc8424df06 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:40.088556 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-6833930a-22a9-4041-9910-dccc8424df06 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:40.092394 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-6833930a-22a9-4041-9910-dccc8424df06 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:40.105184 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-6833930a-22a9-4041-9910-dccc8424df06 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "GET /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee" status: 200 len: 1879 microversion: 2.42 time: 0.876142 Jan 15 20:58:40.117602 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1495/3002] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:58:39 2022] GET /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee => generated 1879 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:58:40.141771 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0c7437a3-6748-4b94-962d-28817d880c4c tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:40.142941 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-0c7437a3-6748-4b94-962d-28817d880c4c tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: 67049bcd-1b55-4546-9f51-ab337a3be6be] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:40.156285 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0c7437a3-6748-4b94-962d-28817d880c4c tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:40.157295 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0c7437a3-6748-4b94-962d-28817d880c4c tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:40.158742 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0c7437a3-6748-4b94-962d-28817d880c4c tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:40.159817 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0c7437a3-6748-4b94-962d-28817d880c4c tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:40.292200 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-0c7437a3-6748-4b94-962d-28817d880c4c tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:40.305154 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0c7437a3-6748-4b94-962d-28817d880c4c tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/67049bcd-1b55-4546-9f51-ab337a3be6be" status: 200 len: 1218 microversion: 2.1 time: 0.184502 Jan 15 20:58:40.310017 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1496/3003] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:40 2022] GET /compute/v2.1/servers/67049bcd-1b55-4546-9f51-ab337a3be6be => generated 1218 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:40.327841 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-b6bd658e-33cb-4150-9df5-4f62c2ca9a55 req-ed8442ea-1a68-473f-b7bd-3bd5103c18b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1884dd3f-949c-4df3-a977-3f6f5a204fee", "tag": "90ef8468-1684-4743-ae03-c3725fd41a73"}, {"name": "network-changed", "server_uuid": "1884dd3f-949c-4df3-a977-3f6f5a204fee", "tag": "cddf88bd-8f9f-40f9-9dfd-4dad717d9fbf"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:58:40.335652 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:58:40.335652 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:58:40.361533 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-b6bd658e-33cb-4150-9df5-4f62c2ca9a55 req-ed8442ea-1a68-473f-b7bd-3bd5103c18b3 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:40.362971 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-b6bd658e-33cb-4150-9df5-4f62c2ca9a55 req-ed8442ea-1a68-473f-b7bd-3bd5103c18b3 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:40.388136 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-b6bd658e-33cb-4150-9df5-4f62c2ca9a55 req-ed8442ea-1a68-473f-b7bd-3bd5103c18b3 service nova] Creating event network-changed:90ef8468-1684-4743-ae03-c3725fd41a73 for instance 1884dd3f-949c-4df3-a977-3f6f5a204fee on nch2-master-1 Jan 15 20:58:40.389208 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-b6bd658e-33cb-4150-9df5-4f62c2ca9a55 req-ed8442ea-1a68-473f-b7bd-3bd5103c18b3 service nova] Creating event network-changed:cddf88bd-8f9f-40f9-9dfd-4dad717d9fbf for instance 1884dd3f-949c-4df3-a977-3f6f5a204fee on nch2-master-1 Jan 15 20:58:40.397462 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-b6bd658e-33cb-4150-9df5-4f62c2ca9a55 req-ed8442ea-1a68-473f-b7bd-3bd5103c18b3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.084400 Jan 15 20:58:40.399907 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1497/3004] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:58:40 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:58:40.409943 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e44dc287-63ce-4c1e-a489-3ad0fee120f8 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:40.411144 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e44dc287-63ce-4c1e-a489-3ad0fee120f8 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] [instance: 0207c6e5-54cf-4b26-b1e7-ed649dac8bb9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:40.417330 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-2dc877a2-f861-4f6a-92a0-7d7479640a45 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05483ff6eec84f78a091b29cfbcf61f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a6720be5fb4de7bcd77cc7ef9d8000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:40.423983 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e44dc287-63ce-4c1e-a489-3ad0fee120f8 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:40.424543 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e44dc287-63ce-4c1e-a489-3ad0fee120f8 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:40.425835 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e44dc287-63ce-4c1e-a489-3ad0fee120f8 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:40.426290 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e44dc287-63ce-4c1e-a489-3ad0fee120f8 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:40.430171 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2dc877a2-f861-4f6a-92a0-7d7479640a45 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] 10.222.0.46 "GET /compute/v2.1/servers/e04f7a96-62cb-4aae-9612-aa8df88aef61" status: 200 len: 1514 microversion: 2.1 time: 0.402861 Jan 15 20:58:40.431820 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1508/3005] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:40 2022] GET /compute/v2.1/servers/e04f7a96-62cb-4aae-9612-aa8df88aef61 => generated 1514 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:40.466001 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a0d9673f-6fef-44dd-b4fa-4f9f7d953769 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:58:40.468746 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a0d9673f-6fef-44dd-b4fa-4f9f7d953769 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:40.504997 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a0d9673f-6fef-44dd-b4fa-4f9f7d953769 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:40.507286 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a0d9673f-6fef-44dd-b4fa-4f9f7d953769 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:40.512892 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a0d9673f-6fef-44dd-b4fa-4f9f7d953769 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:40.517099 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a0d9673f-6fef-44dd-b4fa-4f9f7d953769 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:40.623047 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a0d9673f-6fef-44dd-b4fa-4f9f7d953769 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action" status: 200 len: 8206 microversion: 2.1 time: 0.189373 Jan 15 20:58:40.627963 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1509/3006] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:58:40 2022] POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action => generated 8206 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:40.646336 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-06a383fd-0ffe-44d0-9e44-5d0692247655 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:58:40.655845 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-06a383fd-0ffe-44d0-9e44-5d0692247655 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] [instance: 62ae2a15-8c2c-4dad-971f-0611238103a3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:40.669836 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-06a383fd-0ffe-44d0-9e44-5d0692247655 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:40.673553 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-06a383fd-0ffe-44d0-9e44-5d0692247655 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:40.674793 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-06a383fd-0ffe-44d0-9e44-5d0692247655 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:40.675455 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-06a383fd-0ffe-44d0-9e44-5d0692247655 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:40.774725 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-06a383fd-0ffe-44d0-9e44-5d0692247655 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] 10.222.0.46 "POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action" status: 200 len: 32634 microversion: 2.1 time: 0.144620 Jan 15 20:58:40.776538 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1510/3007] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:58:40 2022] POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action => generated 32634 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:58:40.782473 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ba3c901a-8f18-4b3c-a639-fa952d2d7308 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ba3df6f7-3423-44f7-84bf-6545c2261c44"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:58:40.784083 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ba3c901a-8f18-4b3c-a639-fa952d2d7308 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] [instance: e04f7a96-62cb-4aae-9612-aa8df88aef61] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:40.793450 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ba3c901a-8f18-4b3c-a639-fa952d2d7308 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:40.794379 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ba3c901a-8f18-4b3c-a639-fa952d2d7308 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:40.795830 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ba3c901a-8f18-4b3c-a639-fa952d2d7308 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:40.796645 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ba3c901a-8f18-4b3c-a639-fa952d2d7308 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:40.877552 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-e44dc287-63ce-4c1e-a489-3ad0fee120f8 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ec114f8ece434aa496cd401494e2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a05b1a0a7479db84b762eca23b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:40.907716 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e44dc287-63ce-4c1e-a489-3ad0fee120f8 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] 10.222.0.46 "GET /compute/v2.1/servers/0207c6e5-54cf-4b26-b1e7-ed649dac8bb9" status: 200 len: 1499 microversion: 2.1 time: 0.501838 Jan 15 20:58:40.910202 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1498/3008] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:40 2022] GET /compute/v2.1/servers/0207c6e5-54cf-4b26-b1e7-ed649dac8bb9 => generated 1499 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:40.929328 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-39c56992-58a2-4012-97d6-18b795f81734 tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:40.931033 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-39c56992-58a2-4012-97d6-18b795f81734 tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] [instance: bcf7aaa6-1938-4efc-bb5d-efb290dc345e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:40.948409 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-39c56992-58a2-4012-97d6-18b795f81734 tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:40.949713 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-39c56992-58a2-4012-97d6-18b795f81734 tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:40.955013 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-39c56992-58a2-4012-97d6-18b795f81734 tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:40.955636 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-39c56992-58a2-4012-97d6-18b795f81734 tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:41.100586 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-39c56992-58a2-4012-97d6-18b795f81734 tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff71c36a6ee04b67a6db8940296dc9ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdef9bfc39b84aba936ad3c1dfda8e9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:41.121267 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-39c56992-58a2-4012-97d6-18b795f81734 tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff71c36a6ee04b67a6db8940296dc9ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdef9bfc39b84aba936ad3c1dfda8e9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:41.127923 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-39c56992-58a2-4012-97d6-18b795f81734 tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff71c36a6ee04b67a6db8940296dc9ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdef9bfc39b84aba936ad3c1dfda8e9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:41.133292 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-39c56992-58a2-4012-97d6-18b795f81734 tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] 10.222.0.46 "GET /compute/v2.1/servers/bcf7aaa6-1938-4efc-bb5d-efb290dc345e" status: 200 len: 1317 microversion: 2.21 time: 0.218172 Jan 15 20:58:41.137526 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1499/3009] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:58:40 2022] GET /compute/v2.1/servers/bcf7aaa6-1938-4efc-bb5d-efb290dc345e => generated 1317 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:58:41.150334 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-541f5bc1-8b5d-431c-ba50-1666c5e4063d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:41.150953 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-541f5bc1-8b5d-431c-ba50-1666c5e4063d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:41.182469 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-541f5bc1-8b5d-431c-ba50-1666c5e4063d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:41.183384 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-541f5bc1-8b5d-431c-ba50-1666c5e4063d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:41.184509 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-541f5bc1-8b5d-431c-ba50-1666c5e4063d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:41.187114 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-541f5bc1-8b5d-431c-ba50-1666c5e4063d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:41.295498 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ba3c901a-8f18-4b3c-a639-fa952d2d7308 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] 10.222.0.46 "POST /compute/v2.1/servers/e04f7a96-62cb-4aae-9612-aa8df88aef61/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.516995 Jan 15 20:58:41.296825 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1511/3010] 10.222.0.46 () {60 vars in 1322 bytes} [Sat Jan 15 20:58:40 2022] POST /compute/v2.1/servers/e04f7a96-62cb-4aae-9612-aa8df88aef61/os-volume_attachments => generated 194 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:58:41.343792 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-71b63db1-d90f-41d5-9354-db0e182041b9 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:41.344806 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-71b63db1-d90f-41d5-9354-db0e182041b9 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: 67049bcd-1b55-4546-9f51-ab337a3be6be] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:41.369655 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-71b63db1-d90f-41d5-9354-db0e182041b9 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:41.373078 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-71b63db1-d90f-41d5-9354-db0e182041b9 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:41.374006 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-71b63db1-d90f-41d5-9354-db0e182041b9 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:41.377129 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-71b63db1-d90f-41d5-9354-db0e182041b9 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:41.912864 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-71b63db1-d90f-41d5-9354-db0e182041b9 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:41.937180 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-71b63db1-d90f-41d5-9354-db0e182041b9 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/67049bcd-1b55-4546-9f51-ab337a3be6be" status: 200 len: 1284 microversion: 2.1 time: 0.611602 Jan 15 20:58:41.939574 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1512/3011] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:41 2022] GET /compute/v2.1/servers/67049bcd-1b55-4546-9f51-ab337a3be6be => generated 1284 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:41.951890 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8882cb43-4b1f-4460-b97d-deac05bf1f23 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:58:41.958103 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-8882cb43-4b1f-4460-b97d-deac05bf1f23 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:41.971664 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8882cb43-4b1f-4460-b97d-deac05bf1f23 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:41.974854 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8882cb43-4b1f-4460-b97d-deac05bf1f23 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:41.977016 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8882cb43-4b1f-4460-b97d-deac05bf1f23 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:41.977467 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8882cb43-4b1f-4460-b97d-deac05bf1f23 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:42.066636 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-8882cb43-4b1f-4460-b97d-deac05bf1f23 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action" status: 200 len: 16400 microversion: 2.1 time: 0.124799 Jan 15 20:58:42.067188 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1513/3012] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:58:41 2022] POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action => generated 16400 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:58:42.074614 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-962abedf-e3d1-465b-8ded-09fa8c123b23 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:58:42.075610 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-962abedf-e3d1-465b-8ded-09fa8c123b23 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] [instance: 62ae2a15-8c2c-4dad-971f-0611238103a3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:42.101170 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-962abedf-e3d1-465b-8ded-09fa8c123b23 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:42.101647 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-962abedf-e3d1-465b-8ded-09fa8c123b23 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:42.108239 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-962abedf-e3d1-465b-8ded-09fa8c123b23 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:42.108684 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-962abedf-e3d1-465b-8ded-09fa8c123b23 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:42.157668 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-541f5bc1-8b5d-431c-ba50-1666c5e4063d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:42.181325 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-962abedf-e3d1-465b-8ded-09fa8c123b23 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] 10.222.0.46 "POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action" status: 200 len: 40781 microversion: 2.1 time: 0.112111 Jan 15 20:58:42.182804 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1514/3013] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:58:42 2022] POST /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3/action => generated 40781 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:58:42.185020 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-541f5bc1-8b5d-431c-ba50-1666c5e4063d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:42.189068 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-541f5bc1-8b5d-431c-ba50-1666c5e4063d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:42.193024 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-541f5bc1-8b5d-431c-ba50-1666c5e4063d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "GET /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee" status: 200 len: 1879 microversion: 2.42 time: 1.053890 Jan 15 20:58:42.196165 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1500/3014] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:58:41 2022] GET /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee => generated 1879 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:58:42.208872 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-00b2241e-2682-4714-9afc-129a343974b0 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:42.209632 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-00b2241e-2682-4714-9afc-129a343974b0 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] [instance: 0207c6e5-54cf-4b26-b1e7-ed649dac8bb9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:42.213362 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ec31684b-1c11-4dbb-816d-b481cafaa228 tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:42.214165 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ec31684b-1c11-4dbb-816d-b481cafaa228 tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] [instance: bcf7aaa6-1938-4efc-bb5d-efb290dc345e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:42.221078 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-00b2241e-2682-4714-9afc-129a343974b0 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:42.223269 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-00b2241e-2682-4714-9afc-129a343974b0 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:42.224720 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-00b2241e-2682-4714-9afc-129a343974b0 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:42.225386 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-00b2241e-2682-4714-9afc-129a343974b0 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:42.231422 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ec31684b-1c11-4dbb-816d-b481cafaa228 tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:42.232203 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ec31684b-1c11-4dbb-816d-b481cafaa228 tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:42.234822 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ec31684b-1c11-4dbb-816d-b481cafaa228 tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:42.235799 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ec31684b-1c11-4dbb-816d-b481cafaa228 tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:42.452264 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-ec31684b-1c11-4dbb-816d-b481cafaa228 tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff71c36a6ee04b67a6db8940296dc9ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdef9bfc39b84aba936ad3c1dfda8e9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:42.469237 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-ec31684b-1c11-4dbb-816d-b481cafaa228 tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff71c36a6ee04b67a6db8940296dc9ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdef9bfc39b84aba936ad3c1dfda8e9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:42.471035 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-ec31684b-1c11-4dbb-816d-b481cafaa228 tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff71c36a6ee04b67a6db8940296dc9ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdef9bfc39b84aba936ad3c1dfda8e9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:42.472267 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ec31684b-1c11-4dbb-816d-b481cafaa228 tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] 10.222.0.46 "GET /compute/v2.1/servers/bcf7aaa6-1938-4efc-bb5d-efb290dc345e" status: 200 len: 1317 microversion: 2.21 time: 0.274587 Jan 15 20:58:42.472768 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1501/3015] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:58:42 2022] GET /compute/v2.1/servers/bcf7aaa6-1938-4efc-bb5d-efb290dc345e => generated 1317 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:58:42.480264 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d5f299a8-be86-4a40-bc45-e7cdf84cec38 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:42.480916 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-d5f299a8-be86-4a40-bc45-e7cdf84cec38 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] [instance: 62ae2a15-8c2c-4dad-971f-0611238103a3] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:42.502162 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d5f299a8-be86-4a40-bc45-e7cdf84cec38 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:42.504102 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d5f299a8-be86-4a40-bc45-e7cdf84cec38 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:42.505282 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d5f299a8-be86-4a40-bc45-e7cdf84cec38 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:42.506327 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d5f299a8-be86-4a40-bc45-e7cdf84cec38 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:42.822201 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-00b2241e-2682-4714-9afc-129a343974b0 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ec114f8ece434aa496cd401494e2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a05b1a0a7479db84b762eca23b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:42.831409 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-00b2241e-2682-4714-9afc-129a343974b0 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] 10.222.0.46 "GET /compute/v2.1/servers/0207c6e5-54cf-4b26-b1e7-ed649dac8bb9" status: 200 len: 1499 microversion: 2.1 time: 0.636718 Jan 15 20:58:42.843334 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1515/3016] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:42 2022] GET /compute/v2.1/servers/0207c6e5-54cf-4b26-b1e7-ed649dac8bb9 => generated 1499 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:42.902781 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-da5d5b13-4746-4ec5-b612-35838b42e738 req-04780664-bbe0-4268-bc5d-b5fb462d9e91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1884dd3f-949c-4df3-a977-3f6f5a204fee", "tag": "897218f9-2c52-48ce-af2d-b6ceececef93"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:58:42.905237 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:58:42.905237 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:58:42.915337 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-da5d5b13-4746-4ec5-b612-35838b42e738 req-04780664-bbe0-4268-bc5d-b5fb462d9e91 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:42.916017 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-da5d5b13-4746-4ec5-b612-35838b42e738 req-04780664-bbe0-4268-bc5d-b5fb462d9e91 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:42.947047 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-da5d5b13-4746-4ec5-b612-35838b42e738 req-04780664-bbe0-4268-bc5d-b5fb462d9e91 service nova] Creating event network-changed:897218f9-2c52-48ce-af2d-b6ceececef93 for instance 1884dd3f-949c-4df3-a977-3f6f5a204fee on nch2-master-1 Jan 15 20:58:42.957966 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-da5d5b13-4746-4ec5-b612-35838b42e738 req-04780664-bbe0-4268-bc5d-b5fb462d9e91 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060517 Jan 15 20:58:42.959563 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1516/3017] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:58:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:58:42.965441 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-6095ec50-0d90-469a-bf47-3ae7cb235ba0 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:42.966470 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-6095ec50-0d90-469a-bf47-3ae7cb235ba0 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: 67049bcd-1b55-4546-9f51-ab337a3be6be] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:42.981936 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6095ec50-0d90-469a-bf47-3ae7cb235ba0 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:42.983036 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6095ec50-0d90-469a-bf47-3ae7cb235ba0 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:42.983248 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-d5f299a8-be86-4a40-bc45-e7cdf84cec38 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4c2db123e34ed9bdba89f7150ebcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca2cdba56c74d46a478aff355b23447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:42.987809 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6095ec50-0d90-469a-bf47-3ae7cb235ba0 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:42.987809 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6095ec50-0d90-469a-bf47-3ae7cb235ba0 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:43.001914 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d5f299a8-be86-4a40-bc45-e7cdf84cec38 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] 10.222.0.46 "GET /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3" status: 200 len: 1603 microversion: 2.1 time: 0.528002 Jan 15 20:58:43.004681 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1502/3018] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:42 2022] GET /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3 => generated 1603 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:43.080956 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a28f5d44-fb12-40eb-b854-d121c986ccb4 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:58:43.085496 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a28f5d44-fb12-40eb-b854-d121c986ccb4 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:43.102465 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a28f5d44-fb12-40eb-b854-d121c986ccb4 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:43.103793 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a28f5d44-fb12-40eb-b854-d121c986ccb4 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:43.105050 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a28f5d44-fb12-40eb-b854-d121c986ccb4 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:43.106184 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a28f5d44-fb12-40eb-b854-d121c986ccb4 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:43.139480 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-6095ec50-0d90-469a-bf47-3ae7cb235ba0 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:43.155288 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-6095ec50-0d90-469a-bf47-3ae7cb235ba0 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/67049bcd-1b55-4546-9f51-ab337a3be6be" status: 200 len: 1272 microversion: 2.1 time: 0.192225 Jan 15 20:58:43.161963 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1517/3019] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:42 2022] GET /compute/v2.1/servers/67049bcd-1b55-4546-9f51-ab337a3be6be => generated 1272 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:43.170623 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a28f5d44-fb12-40eb-b854-d121c986ccb4 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action" status: 200 len: 16400 microversion: 2.1 time: 0.093254 Jan 15 20:58:43.173397 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1503/3020] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:58:43 2022] POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action => generated 16400 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:58:43.214861 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-37a4bd1b-6d5e-4f50-bf68-05efddb1947d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:43.215578 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-37a4bd1b-6d5e-4f50-bf68-05efddb1947d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:43.229486 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-37a4bd1b-6d5e-4f50-bf68-05efddb1947d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:43.229943 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-37a4bd1b-6d5e-4f50-bf68-05efddb1947d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:43.230900 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-37a4bd1b-6d5e-4f50-bf68-05efddb1947d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:43.231321 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-37a4bd1b-6d5e-4f50-bf68-05efddb1947d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:43.496524 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-78d2bae7-5e01-46c7-9937-674b9a12513c tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:43.497517 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-78d2bae7-5e01-46c7-9937-674b9a12513c tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] [instance: bcf7aaa6-1938-4efc-bb5d-efb290dc345e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:43.512252 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-78d2bae7-5e01-46c7-9937-674b9a12513c tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:43.513689 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-78d2bae7-5e01-46c7-9937-674b9a12513c tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:43.515298 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-78d2bae7-5e01-46c7-9937-674b9a12513c tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:43.515949 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-78d2bae7-5e01-46c7-9937-674b9a12513c tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:43.592812 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-37a4bd1b-6d5e-4f50-bf68-05efddb1947d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:43.607614 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-37a4bd1b-6d5e-4f50-bf68-05efddb1947d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:43.609503 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-37a4bd1b-6d5e-4f50-bf68-05efddb1947d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:43.611237 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-37a4bd1b-6d5e-4f50-bf68-05efddb1947d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "GET /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee" status: 200 len: 1879 microversion: 2.42 time: 0.401697 Jan 15 20:58:43.617436 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1518/3021] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:58:43 2022] GET /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee => generated 1879 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:58:43.849632 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2adc3834-0c6d-40b0-acfc-faf83d567cc5 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:43.850242 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-2adc3834-0c6d-40b0-acfc-faf83d567cc5 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] [instance: 0207c6e5-54cf-4b26-b1e7-ed649dac8bb9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:43.858832 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2adc3834-0c6d-40b0-acfc-faf83d567cc5 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:43.869885 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2adc3834-0c6d-40b0-acfc-faf83d567cc5 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:43.870784 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2adc3834-0c6d-40b0-acfc-faf83d567cc5 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:43.871227 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2adc3834-0c6d-40b0-acfc-faf83d567cc5 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:43.928048 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-78d2bae7-5e01-46c7-9937-674b9a12513c tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff71c36a6ee04b67a6db8940296dc9ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdef9bfc39b84aba936ad3c1dfda8e9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:43.947377 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2adc3834-0c6d-40b0-acfc-faf83d567cc5 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:43.949514 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2adc3834-0c6d-40b0-acfc-faf83d567cc5 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:43.949918 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-78d2bae7-5e01-46c7-9937-674b9a12513c tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff71c36a6ee04b67a6db8940296dc9ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdef9bfc39b84aba936ad3c1dfda8e9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:43.950484 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.objects.instance [None req-2adc3834-0c6d-40b0-acfc-faf83d567cc5 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lazy-loading 'fault' on Instance uuid 0207c6e5-54cf-4b26-b1e7-ed649dac8bb9 {{(pid=129365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 20:58:43.961289 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-78d2bae7-5e01-46c7-9937-674b9a12513c tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff71c36a6ee04b67a6db8940296dc9ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdef9bfc39b84aba936ad3c1dfda8e9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:43.969569 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-78d2bae7-5e01-46c7-9937-674b9a12513c tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] 10.222.0.46 "GET /compute/v2.1/servers/bcf7aaa6-1938-4efc-bb5d-efb290dc345e" status: 200 len: 1359 microversion: 2.21 time: 0.477487 Jan 15 20:58:43.970993 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1504/3022] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:58:43 2022] GET /compute/v2.1/servers/bcf7aaa6-1938-4efc-bb5d-efb290dc345e => generated 1359 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:58:44.066831 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-2adc3834-0c6d-40b0-acfc-faf83d567cc5 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ec114f8ece434aa496cd401494e2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '385a05b1a0a7479db84b762eca23b55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:44.078251 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2adc3834-0c6d-40b0-acfc-faf83d567cc5 tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] 10.222.0.46 "GET /compute/v2.1/servers/0207c6e5-54cf-4b26-b1e7-ed649dac8bb9" status: 200 len: 1300 microversion: 2.1 time: 0.232149 Jan 15 20:58:44.091944 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1519/3023] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:43 2022] GET /compute/v2.1/servers/0207c6e5-54cf-4b26-b1e7-ed649dac8bb9 => generated 1300 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:44.182412 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-336dae89-907a-4e66-8a24-5b4de0bdfd1e tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:44.184490 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f623c7e1-2644-4fbd-93b8-aab6ba0a181e tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:58:44.185027 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-336dae89-907a-4e66-8a24-5b4de0bdfd1e tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: 67049bcd-1b55-4546-9f51-ab337a3be6be] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:44.187045 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f623c7e1-2644-4fbd-93b8-aab6ba0a181e tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:44.198813 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-336dae89-907a-4e66-8a24-5b4de0bdfd1e tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:44.199327 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-336dae89-907a-4e66-8a24-5b4de0bdfd1e tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:44.201322 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-336dae89-907a-4e66-8a24-5b4de0bdfd1e tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:44.201878 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-336dae89-907a-4e66-8a24-5b4de0bdfd1e tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:44.202026 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f623c7e1-2644-4fbd-93b8-aab6ba0a181e tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:44.202430 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f623c7e1-2644-4fbd-93b8-aab6ba0a181e tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:44.204701 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f623c7e1-2644-4fbd-93b8-aab6ba0a181e tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:44.205176 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f623c7e1-2644-4fbd-93b8-aab6ba0a181e tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:44.284510 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f623c7e1-2644-4fbd-93b8-aab6ba0a181e tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action" status: 200 len: 16400 microversion: 2.1 time: 0.104439 Jan 15 20:58:44.285950 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1520/3024] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:58:44 2022] POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action => generated 16400 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 20:58:44.293128 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-cacfedfa-bafd-4533-967b-297249c91914 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:44.298518 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:58:44.298518 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:58:44.300194 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-cacfedfa-bafd-4533-967b-297249c91914 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ca4c2db123e34ed9bdba89f7150ebcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca2cdba56c74d46a478aff355b23447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:44.301349 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-cacfedfa-bafd-4533-967b-297249c91914 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Searching by: {'deleted': False, 'project_id': 'dca2cdba56c74d46a478aff355b23447'} {{(pid=129365) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 15 20:58:44.315101 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cacfedfa-bafd-4533-967b-297249c91914 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:44.315659 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cacfedfa-bafd-4533-967b-297249c91914 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:44.316584 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cacfedfa-bafd-4533-967b-297249c91914 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:44.318303 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cacfedfa-bafd-4533-967b-297249c91914 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:44.371967 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.multi_cell_list [None req-cacfedfa-bafd-4533-967b-297249c91914 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=129365) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jan 15 20:58:44.416064 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-cacfedfa-bafd-4533-967b-297249c91914 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] 10.222.0.46 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.126981 Jan 15 20:58:44.416669 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1521/3025] 10.222.0.46 () {58 vars in 1124 bytes} [Sat Jan 15 20:58:44 2022] GET /compute/v2.1/servers => generated 343 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:58:44.430822 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-934d19ff-a384-4bc9-92c8-926f62bd49a6 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:44.435510 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:58:44.435510 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:58:44.437057 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-934d19ff-a384-4bc9-92c8-926f62bd49a6 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ca4c2db123e34ed9bdba89f7150ebcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca2cdba56c74d46a478aff355b23447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:44.438863 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-934d19ff-a384-4bc9-92c8-926f62bd49a6 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Searching by: {'deleted': False, 'project_id': 'dca2cdba56c74d46a478aff355b23447'} {{(pid=129365) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 15 20:58:44.450695 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-934d19ff-a384-4bc9-92c8-926f62bd49a6 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:44.451645 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-934d19ff-a384-4bc9-92c8-926f62bd49a6 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:44.453152 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-934d19ff-a384-4bc9-92c8-926f62bd49a6 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:44.453857 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-934d19ff-a384-4bc9-92c8-926f62bd49a6 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:44.520161 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.multi_cell_list [None req-934d19ff-a384-4bc9-92c8-926f62bd49a6 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=129365) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jan 15 20:58:44.611739 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-934d19ff-a384-4bc9-92c8-926f62bd49a6 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4c2db123e34ed9bdba89f7150ebcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca2cdba56c74d46a478aff355b23447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:44.627132 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-934d19ff-a384-4bc9-92c8-926f62bd49a6 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:44.627964 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-934d19ff-a384-4bc9-92c8-926f62bd49a6 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:44.658201 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-336dae89-907a-4e66-8a24-5b4de0bdfd1e tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:44.668752 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-336dae89-907a-4e66-8a24-5b4de0bdfd1e tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/67049bcd-1b55-4546-9f51-ab337a3be6be" status: 200 len: 1314 microversion: 2.1 time: 0.491993 Jan 15 20:58:44.687838 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1505/3026] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:44 2022] GET /compute/v2.1/servers/67049bcd-1b55-4546-9f51-ab337a3be6be => generated 1314 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:44.703901 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9f0bfae1-59a1-4e24-bfdd-94f1b33a1029 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:44.704535 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-9f0bfae1-59a1-4e24-bfdd-94f1b33a1029 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:44.741792 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9f0bfae1-59a1-4e24-bfdd-94f1b33a1029 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:44.749853 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9f0bfae1-59a1-4e24-bfdd-94f1b33a1029 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:44.750999 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9f0bfae1-59a1-4e24-bfdd-94f1b33a1029 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:44.751757 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9f0bfae1-59a1-4e24-bfdd-94f1b33a1029 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:45.192272 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-934d19ff-a384-4bc9-92c8-926f62bd49a6 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] 10.222.0.46 "GET /compute/v2.1/servers/detail" status: 200 len: 1606 microversion: 2.1 time: 0.765972 Jan 15 20:58:45.194822 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1522/3027] 10.222.0.46 () {58 vars in 1145 bytes} [Sat Jan 15 20:58:44 2022] GET /compute/v2.1/servers/detail => generated 1606 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:45.210226 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-253eaad3-6be6-47e9-9970-e8893adbfe29 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:58:45.211804 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-253eaad3-6be6-47e9-9970-e8893adbfe29 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] [instance: e04f7a96-62cb-4aae-9612-aa8df88aef61] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:45.218189 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-253eaad3-6be6-47e9-9970-e8893adbfe29 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:45.218644 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-253eaad3-6be6-47e9-9970-e8893adbfe29 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:45.219672 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-253eaad3-6be6-47e9-9970-e8893adbfe29 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:45.220315 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-253eaad3-6be6-47e9-9970-e8893adbfe29 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:45.275805 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-9f0bfae1-59a1-4e24-bfdd-94f1b33a1029 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:45.277318 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.objects.instance [None req-253eaad3-6be6-47e9-9970-e8893adbfe29 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lazy-loading 'flavor' on Instance uuid e04f7a96-62cb-4aae-9612-aa8df88aef61 {{(pid=129365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 20:58:45.288364 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-9f0bfae1-59a1-4e24-bfdd-94f1b33a1029 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:45.295278 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-9f0bfae1-59a1-4e24-bfdd-94f1b33a1029 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:45.296565 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-9f0bfae1-59a1-4e24-bfdd-94f1b33a1029 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "GET /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee" status: 200 len: 1879 microversion: 2.42 time: 0.607521 Jan 15 20:58:45.299426 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1506/3028] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:58:44 2022] GET /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee => generated 1879 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:58:45.305366 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-8a99b926-ebfa-40a0-ae63-6b49e41ba031 req-5cc4e707-3cfb-4d83-b487-9ec3eccb4477 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0207c6e5-54cf-4b26-b1e7-ed649dac8bb9", "name": "network-vif-deleted", "tag": "32c4b362-d25a-4492-abc2-6267bd6efe0b"}, {"name": "network-changed", "server_uuid": "1884dd3f-949c-4df3-a977-3f6f5a204fee", "tag": "27dce314-8869-41b8-89c3-42aefdb46190"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:58:45.307425 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:58:45.307425 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:58:45.322943 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-8a99b926-ebfa-40a0-ae63-6b49e41ba031 req-5cc4e707-3cfb-4d83-b487-9ec3eccb4477 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:45.323467 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-8a99b926-ebfa-40a0-ae63-6b49e41ba031 req-5cc4e707-3cfb-4d83-b487-9ec3eccb4477 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:45.342840 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-8a99b926-ebfa-40a0-ae63-6b49e41ba031 req-5cc4e707-3cfb-4d83-b487-9ec3eccb4477 service nova] Creating event network-vif-deleted:32c4b362-d25a-4492-abc2-6267bd6efe0b for instance 0207c6e5-54cf-4b26-b1e7-ed649dac8bb9 on nch2-master-1 Jan 15 20:58:45.346603 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-8a99b926-ebfa-40a0-ae63-6b49e41ba031 req-5cc4e707-3cfb-4d83-b487-9ec3eccb4477 service nova] Creating event network-changed:27dce314-8869-41b8-89c3-42aefdb46190 for instance 1884dd3f-949c-4df3-a977-3f6f5a204fee on nch2-master-1 Jan 15 20:58:45.362956 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-8a99b926-ebfa-40a0-ae63-6b49e41ba031 req-5cc4e707-3cfb-4d83-b487-9ec3eccb4477 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.061816 Jan 15 20:58:45.363757 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1507/3029] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:58:45 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:58:45.373016 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e901a9eb-8396-4a52-854b-9ee3168c7fbd tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:45.377796 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e901a9eb-8396-4a52-854b-9ee3168c7fbd tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] [instance: bcf7aaa6-1938-4efc-bb5d-efb290dc345e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:45.391290 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e901a9eb-8396-4a52-854b-9ee3168c7fbd tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:45.391819 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e901a9eb-8396-4a52-854b-9ee3168c7fbd tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:45.392700 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e901a9eb-8396-4a52-854b-9ee3168c7fbd tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:45.393199 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e901a9eb-8396-4a52-854b-9ee3168c7fbd tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:45.562857 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-253eaad3-6be6-47e9-9970-e8893adbfe29 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] 10.222.0.46 "POST /compute/v2.1/servers/e04f7a96-62cb-4aae-9612-aa8df88aef61/action" status: 200 len: 32 microversion: 2.1 time: 0.361662 Jan 15 20:58:45.567938 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1523/3030] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:58:45 2022] POST /compute/v2.1/servers/e04f7a96-62cb-4aae-9612-aa8df88aef61/action => generated 32 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 20:58:45.576904 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-971aa66f-699b-49ff-884b-fb348dee4bcf tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:45.578381 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-971aa66f-699b-49ff-884b-fb348dee4bcf tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] [instance: 0207c6e5-54cf-4b26-b1e7-ed649dac8bb9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:45.592268 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-971aa66f-699b-49ff-884b-fb348dee4bcf tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:45.593492 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-971aa66f-699b-49ff-884b-fb348dee4bcf tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:45.595169 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-971aa66f-699b-49ff-884b-fb348dee4bcf tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:45.597163 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-971aa66f-699b-49ff-884b-fb348dee4bcf tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:45.639602 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-971aa66f-699b-49ff-884b-fb348dee4bcf tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] HTTP exception thrown: Instance 0207c6e5-54cf-4b26-b1e7-ed649dac8bb9 could not be found. Jan 15 20:58:45.640833 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-971aa66f-699b-49ff-884b-fb348dee4bcf tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] Returning 404 to user: Instance 0207c6e5-54cf-4b26-b1e7-ed649dac8bb9 could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:58:45.645249 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-971aa66f-699b-49ff-884b-fb348dee4bcf tempest-LiveMigrationTest-1442391401 tempest-LiveMigrationTest-1442391401-project] 10.222.0.46 "GET /compute/v2.1/servers/0207c6e5-54cf-4b26-b1e7-ed649dac8bb9" status: 404 len: 111 microversion: 2.1 time: 0.078541 Jan 15 20:58:45.652254 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1524/3031] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:45 2022] GET /compute/v2.1/servers/0207c6e5-54cf-4b26-b1e7-ed649dac8bb9 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:58:45.671512 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-6cf122cd-6fab-4ab6-830e-b5f32d2ee1db tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:45.689210 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-6cf122cd-6fab-4ab6-830e-b5f32d2ee1db tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] 10.222.0.46 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.034449 Jan 15 20:58:45.709298 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1525/3032] 10.222.0.46 () {58 vars in 1136 bytes} [Sat Jan 15 20:58:45 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:58:45.719992 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5a321baf-6a42-499e-a1f2-e73f37b8c6ee tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:58:45.721867 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-5a321baf-6a42-499e-a1f2-e73f37b8c6ee tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:45.733976 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5a321baf-6a42-499e-a1f2-e73f37b8c6ee tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:45.734894 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5a321baf-6a42-499e-a1f2-e73f37b8c6ee tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:45.736306 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5a321baf-6a42-499e-a1f2-e73f37b8c6ee tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:45.737263 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5a321baf-6a42-499e-a1f2-e73f37b8c6ee tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:45.837444 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-e901a9eb-8396-4a52-854b-9ee3168c7fbd tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff71c36a6ee04b67a6db8940296dc9ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdef9bfc39b84aba936ad3c1dfda8e9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:45.838730 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5a321baf-6a42-499e-a1f2-e73f37b8c6ee tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action" status: 200 len: 16400 microversion: 2.1 time: 0.126788 Jan 15 20:58:45.840234 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1526/3033] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:58:45 2022] POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action => generated 16400 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:58:45.853987 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-e901a9eb-8396-4a52-854b-9ee3168c7fbd tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff71c36a6ee04b67a6db8940296dc9ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdef9bfc39b84aba936ad3c1dfda8e9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:45.854384 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-4e0579e6-f57f-4f78-978f-6723d8e49939 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:45.856189 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-e901a9eb-8396-4a52-854b-9ee3168c7fbd tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff71c36a6ee04b67a6db8940296dc9ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdef9bfc39b84aba936ad3c1dfda8e9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:45.858230 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e901a9eb-8396-4a52-854b-9ee3168c7fbd tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] 10.222.0.46 "GET /compute/v2.1/servers/bcf7aaa6-1938-4efc-bb5d-efb290dc345e" status: 200 len: 1359 microversion: 2.21 time: 0.493026 Jan 15 20:58:45.860413 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1508/3034] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:58:45 2022] GET /compute/v2.1/servers/bcf7aaa6-1938-4efc-bb5d-efb290dc345e => generated 1359 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:58:45.865576 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d2203899-7ffb-41f7-b932-bab07cbc811d tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:45.866689 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-d2203899-7ffb-41f7-b932-bab07cbc811d tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: 67049bcd-1b55-4546-9f51-ab337a3be6be] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:45.870677 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-4e0579e6-f57f-4f78-978f-6723d8e49939 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] [instance: e04f7a96-62cb-4aae-9612-aa8df88aef61] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:45.876047 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d2203899-7ffb-41f7-b932-bab07cbc811d tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:45.876946 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d2203899-7ffb-41f7-b932-bab07cbc811d tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:45.879034 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d2203899-7ffb-41f7-b932-bab07cbc811d tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:45.879482 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d2203899-7ffb-41f7-b932-bab07cbc811d tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:45.880642 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4e0579e6-f57f-4f78-978f-6723d8e49939 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:45.881120 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4e0579e6-f57f-4f78-978f-6723d8e49939 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:45.881914 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4e0579e6-f57f-4f78-978f-6723d8e49939 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:45.882385 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4e0579e6-f57f-4f78-978f-6723d8e49939 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:46.384463 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-d2203899-7ffb-41f7-b932-bab07cbc811d tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:46.391171 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-4e0579e6-f57f-4f78-978f-6723d8e49939 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05483ff6eec84f78a091b29cfbcf61f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a6720be5fb4de7bcd77cc7ef9d8000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:46.393219 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d2203899-7ffb-41f7-b932-bab07cbc811d tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/67049bcd-1b55-4546-9f51-ab337a3be6be" status: 200 len: 1314 microversion: 2.1 time: 0.531479 Jan 15 20:58:46.394040 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1509/3035] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:45 2022] GET /compute/v2.1/servers/67049bcd-1b55-4546-9f51-ab337a3be6be => generated 1314 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:46.403730 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-4e0579e6-f57f-4f78-978f-6723d8e49939 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] 10.222.0.46 "GET /compute/v2.1/servers/e04f7a96-62cb-4aae-9612-aa8df88aef61" status: 200 len: 1566 microversion: 2.1 time: 0.556886 Jan 15 20:58:46.408800 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1527/3036] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:45 2022] GET /compute/v2.1/servers/e04f7a96-62cb-4aae-9612-aa8df88aef61 => generated 1566 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:46.417914 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-82cf5f13-ffbe-40e9-9787-c113878b0dcd tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:46.418415 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-82cf5f13-ffbe-40e9-9787-c113878b0dcd tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] [instance: 62ae2a15-8c2c-4dad-971f-0611238103a3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:46.424663 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-82cf5f13-ffbe-40e9-9787-c113878b0dcd tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:46.425143 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-82cf5f13-ffbe-40e9-9787-c113878b0dcd tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:46.425929 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-82cf5f13-ffbe-40e9-9787-c113878b0dcd tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:46.426361 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-82cf5f13-ffbe-40e9-9787-c113878b0dcd tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:46.457006 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-82cf5f13-ffbe-40e9-9787-c113878b0dcd tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] [instance: 62ae2a15-8c2c-4dad-971f-0611238103a3] Going to try to terminate instance {{(pid=129365) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 20:58:46.569412 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-82cf5f13-ffbe-40e9-9787-c113878b0dcd tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] 10.222.0.46 "DELETE /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3" status: 204 len: 0 microversion: 2.1 time: 0.158704 Jan 15 20:58:46.571981 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1528/3037] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 20:58:46 2022] DELETE /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 20:58:46.579027 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-6278dac2-8cc7-4242-8836-88ab9d9733d2 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:46.579728 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-6278dac2-8cc7-4242-8836-88ab9d9733d2 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:46.581918 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-c6e2ed3d-516e-4a65-8075-26ae16baae39 req-2a7e7d41-9cc1-4d95-980e-52340a34cf8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bcf7aaa6-1938-4efc-bb5d-efb290dc345e", "tag": "46409b3b-6c55-4c78-a954-43f18fe42119"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:58:46.586898 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6278dac2-8cc7-4242-8836-88ab9d9733d2 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:46.587532 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6278dac2-8cc7-4242-8836-88ab9d9733d2 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:46.588338 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6278dac2-8cc7-4242-8836-88ab9d9733d2 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:46.588780 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6278dac2-8cc7-4242-8836-88ab9d9733d2 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:46.588925 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:58:46.588925 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:58:46.601410 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-c6e2ed3d-516e-4a65-8075-26ae16baae39 req-2a7e7d41-9cc1-4d95-980e-52340a34cf8b service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:46.602210 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-c6e2ed3d-516e-4a65-8075-26ae16baae39 req-2a7e7d41-9cc1-4d95-980e-52340a34cf8b service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:46.615039 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-c6e2ed3d-516e-4a65-8075-26ae16baae39 req-2a7e7d41-9cc1-4d95-980e-52340a34cf8b service nova] Creating event network-changed:46409b3b-6c55-4c78-a954-43f18fe42119 for instance bcf7aaa6-1938-4efc-bb5d-efb290dc345e on nch1-master-1 Jan 15 20:58:46.620682 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-c6e2ed3d-516e-4a65-8075-26ae16baae39 req-2a7e7d41-9cc1-4d95-980e-52340a34cf8b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.215307 Jan 15 20:58:46.621626 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1510/3038] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:58:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:58:46.626867 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-69126770-27a1-4258-9b50-2b9338cb59c0 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:46.627565 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-69126770-27a1-4258-9b50-2b9338cb59c0 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] [instance: 62ae2a15-8c2c-4dad-971f-0611238103a3] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:46.634418 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-69126770-27a1-4258-9b50-2b9338cb59c0 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:46.635028 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-69126770-27a1-4258-9b50-2b9338cb59c0 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:46.635819 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-69126770-27a1-4258-9b50-2b9338cb59c0 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:46.636253 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-69126770-27a1-4258-9b50-2b9338cb59c0 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:47.140539 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-69126770-27a1-4258-9b50-2b9338cb59c0 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4c2db123e34ed9bdba89f7150ebcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca2cdba56c74d46a478aff355b23447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:47.154277 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-69126770-27a1-4258-9b50-2b9338cb59c0 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] 10.222.0.46 "GET /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3" status: 200 len: 1609 microversion: 2.1 time: 0.531096 Jan 15 20:58:47.156318 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1511/3039] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:46 2022] GET /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3 => generated 1609 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:47.157810 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-6278dac2-8cc7-4242-8836-88ab9d9733d2 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:47.167039 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-6278dac2-8cc7-4242-8836-88ab9d9733d2 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:47.168934 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-6278dac2-8cc7-4242-8836-88ab9d9733d2 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:47.170934 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-6278dac2-8cc7-4242-8836-88ab9d9733d2 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "GET /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee" status: 200 len: 1879 microversion: 2.42 time: 0.596452 Jan 15 20:58:47.182462 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-006e23c3-ef74-49dd-91a9-375af96a3cf3 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:58:47.182462 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-006e23c3-ef74-49dd-91a9-375af96a3cf3 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:47.183163 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1529/3040] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:58:46 2022] GET /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee => generated 1879 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:58:47.188374 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-0615d4eb-ec26-4671-9d12-1bcd615b91e9 tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:47.189238 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-0615d4eb-ec26-4671-9d12-1bcd615b91e9 tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] [instance: bcf7aaa6-1938-4efc-bb5d-efb290dc345e] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:47.196615 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0615d4eb-ec26-4671-9d12-1bcd615b91e9 tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:47.197171 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0615d4eb-ec26-4671-9d12-1bcd615b91e9 tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:47.197887 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-006e23c3-ef74-49dd-91a9-375af96a3cf3 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:47.198037 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0615d4eb-ec26-4671-9d12-1bcd615b91e9 tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:47.198669 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0615d4eb-ec26-4671-9d12-1bcd615b91e9 tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:47.199201 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-006e23c3-ef74-49dd-91a9-375af96a3cf3 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:47.202489 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-006e23c3-ef74-49dd-91a9-375af96a3cf3 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:47.203335 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-006e23c3-ef74-49dd-91a9-375af96a3cf3 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:47.266675 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-006e23c3-ef74-49dd-91a9-375af96a3cf3 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action" status: 200 len: 24574 microversion: 2.1 time: 0.108640 Jan 15 20:58:47.271439 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1512/3041] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:58:47 2022] POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action => generated 24574 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:58:47.418767 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-29f49ab0-8433-43c9-a8b3-5c6d946a2fee tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:47.420391 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-29f49ab0-8433-43c9-a8b3-5c6d946a2fee tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: 67049bcd-1b55-4546-9f51-ab337a3be6be] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:47.431206 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-29f49ab0-8433-43c9-a8b3-5c6d946a2fee tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:47.432066 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-29f49ab0-8433-43c9-a8b3-5c6d946a2fee tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:47.433809 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-29f49ab0-8433-43c9-a8b3-5c6d946a2fee tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:47.434527 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-29f49ab0-8433-43c9-a8b3-5c6d946a2fee tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:47.577890 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-0615d4eb-ec26-4671-9d12-1bcd615b91e9 tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff71c36a6ee04b67a6db8940296dc9ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdef9bfc39b84aba936ad3c1dfda8e9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:47.593780 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-0615d4eb-ec26-4671-9d12-1bcd615b91e9 tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff71c36a6ee04b67a6db8940296dc9ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdef9bfc39b84aba936ad3c1dfda8e9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:47.595511 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-0615d4eb-ec26-4671-9d12-1bcd615b91e9 tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff71c36a6ee04b67a6db8940296dc9ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdef9bfc39b84aba936ad3c1dfda8e9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:47.597519 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-0615d4eb-ec26-4671-9d12-1bcd615b91e9 tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] 10.222.0.46 "GET /compute/v2.1/servers/bcf7aaa6-1938-4efc-bb5d-efb290dc345e" status: 200 len: 1359 microversion: 2.21 time: 0.413027 Jan 15 20:58:47.598581 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1530/3042] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:58:47 2022] GET /compute/v2.1/servers/bcf7aaa6-1938-4efc-bb5d-efb290dc345e => generated 1359 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:58:47.615697 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-4e38c686-4f67-41a6-b1fc-2e3aa46a60ae tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:47.618304 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-4e38c686-4f67-41a6-b1fc-2e3aa46a60ae tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] [instance: e04f7a96-62cb-4aae-9612-aa8df88aef61] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:47.626041 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4e38c686-4f67-41a6-b1fc-2e3aa46a60ae tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:47.626497 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4e38c686-4f67-41a6-b1fc-2e3aa46a60ae tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:47.628008 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4e38c686-4f67-41a6-b1fc-2e3aa46a60ae tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:47.628451 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4e38c686-4f67-41a6-b1fc-2e3aa46a60ae tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:48.127620 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-29f49ab0-8433-43c9-a8b3-5c6d946a2fee tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:48.137425 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-29f49ab0-8433-43c9-a8b3-5c6d946a2fee tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/67049bcd-1b55-4546-9f51-ab337a3be6be" status: 200 len: 1314 microversion: 2.1 time: 0.729763 Jan 15 20:58:48.139397 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1513/3043] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:47 2022] GET /compute/v2.1/servers/67049bcd-1b55-4546-9f51-ab337a3be6be => generated 1314 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:48.146184 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-c4f98559-344a-4b68-a6f8-c6e5821a43f3 req-629f38a8-3e4b-46ba-975b-e80cbd08a636 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1884dd3f-949c-4df3-a977-3f6f5a204fee", "tag": "71565d73-8ba2-4ed6-8fb6-b6d496626525"}, {"name": "network-changed", "server_uuid": "67049bcd-1b55-4546-9f51-ab337a3be6be", "tag": "1760c48a-43cb-484d-bf8d-1928a9b77428"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:58:48.148743 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:58:48.148743 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:58:48.158489 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-c4f98559-344a-4b68-a6f8-c6e5821a43f3 req-629f38a8-3e4b-46ba-975b-e80cbd08a636 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:48.159070 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-c4f98559-344a-4b68-a6f8-c6e5821a43f3 req-629f38a8-3e4b-46ba-975b-e80cbd08a636 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:48.173281 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-c4f98559-344a-4b68-a6f8-c6e5821a43f3 req-629f38a8-3e4b-46ba-975b-e80cbd08a636 service nova] Creating event network-changed:71565d73-8ba2-4ed6-8fb6-b6d496626525 for instance 1884dd3f-949c-4df3-a977-3f6f5a204fee on nch2-master-1 Jan 15 20:58:48.174075 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-c4f98559-344a-4b68-a6f8-c6e5821a43f3 req-629f38a8-3e4b-46ba-975b-e80cbd08a636 service nova] Creating event network-changed:1760c48a-43cb-484d-bf8d-1928a9b77428 for instance 67049bcd-1b55-4546-9f51-ab337a3be6be on nch1-master-1 Jan 15 20:58:48.182926 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-c4f98559-344a-4b68-a6f8-c6e5821a43f3 req-629f38a8-3e4b-46ba-975b-e80cbd08a636 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.041974 Jan 15 20:58:48.184353 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1514/3044] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:58:48 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:58:48.190012 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8a27737d-4513-43da-872d-044b50fe5fba tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:48.191050 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-8a27737d-4513-43da-872d-044b50fe5fba tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] [instance: 62ae2a15-8c2c-4dad-971f-0611238103a3] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:48.201793 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8a27737d-4513-43da-872d-044b50fe5fba tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:48.202410 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8a27737d-4513-43da-872d-044b50fe5fba tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:48.203426 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8a27737d-4513-43da-872d-044b50fe5fba tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:48.204014 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8a27737d-4513-43da-872d-044b50fe5fba tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:48.256152 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-4e38c686-4f67-41a6-b1fc-2e3aa46a60ae tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05483ff6eec84f78a091b29cfbcf61f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a6720be5fb4de7bcd77cc7ef9d8000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:48.276329 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-4e38c686-4f67-41a6-b1fc-2e3aa46a60ae tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] 10.222.0.46 "GET /compute/v2.1/servers/e04f7a96-62cb-4aae-9612-aa8df88aef61" status: 200 len: 1566 microversion: 2.1 time: 0.676327 Jan 15 20:58:48.276906 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1531/3045] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:47 2022] GET /compute/v2.1/servers/e04f7a96-62cb-4aae-9612-aa8df88aef61 => generated 1566 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:48.281476 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-1def81dd-01da-4ee9-9c1d-3ac0eb32bd59 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:48.282231 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-1def81dd-01da-4ee9-9c1d-3ac0eb32bd59 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:48.299667 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1def81dd-01da-4ee9-9c1d-3ac0eb32bd59 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:48.300125 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1def81dd-01da-4ee9-9c1d-3ac0eb32bd59 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:48.301021 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1def81dd-01da-4ee9-9c1d-3ac0eb32bd59 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:48.301527 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1def81dd-01da-4ee9-9c1d-3ac0eb32bd59 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:48.696447 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-8a27737d-4513-43da-872d-044b50fe5fba tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4c2db123e34ed9bdba89f7150ebcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca2cdba56c74d46a478aff355b23447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:48.704774 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-8a27737d-4513-43da-872d-044b50fe5fba tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] 10.222.0.46 "GET /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3" status: 200 len: 1609 microversion: 2.1 time: 0.519051 Jan 15 20:58:48.725027 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1515/3046] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:48 2022] GET /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3 => generated 1609 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:48.735342 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-abec3ad0-9fff-49ec-836f-3cc0ae16f256 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:58:48.736628 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-abec3ad0-9fff-49ec-836f-3cc0ae16f256 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:48.745427 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-abec3ad0-9fff-49ec-836f-3cc0ae16f256 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:48.746277 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-abec3ad0-9fff-49ec-836f-3cc0ae16f256 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:48.747338 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-abec3ad0-9fff-49ec-836f-3cc0ae16f256 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:48.747989 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-abec3ad0-9fff-49ec-836f-3cc0ae16f256 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:48.795121 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-abec3ad0-9fff-49ec-836f-3cc0ae16f256 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action" status: 200 len: 24574 microversion: 2.1 time: 0.068017 Jan 15 20:58:48.800703 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1516/3047] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:58:48 2022] POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action => generated 24574 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:58:48.808658 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f8525b83-542a-47d0-a69f-5d6fe934794b tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:48.809713 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f8525b83-542a-47d0-a69f-5d6fe934794b tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] [instance: bcf7aaa6-1938-4efc-bb5d-efb290dc345e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:48.818568 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f8525b83-542a-47d0-a69f-5d6fe934794b tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:48.819310 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f8525b83-542a-47d0-a69f-5d6fe934794b tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:48.820916 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f8525b83-542a-47d0-a69f-5d6fe934794b tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:48.821576 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f8525b83-542a-47d0-a69f-5d6fe934794b tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:48.896532 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-1def81dd-01da-4ee9-9c1d-3ac0eb32bd59 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:48.914279 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-1def81dd-01da-4ee9-9c1d-3ac0eb32bd59 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:48.915851 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-1def81dd-01da-4ee9-9c1d-3ac0eb32bd59 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:48.918808 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-1def81dd-01da-4ee9-9c1d-3ac0eb32bd59 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "GET /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee" status: 200 len: 1879 microversion: 2.42 time: 0.639065 Jan 15 20:58:48.920026 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1532/3048] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:58:48 2022] GET /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee => generated 1879 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:58:49.097105 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-f8525b83-542a-47d0-a69f-5d6fe934794b tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff71c36a6ee04b67a6db8940296dc9ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdef9bfc39b84aba936ad3c1dfda8e9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:49.110897 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-f8525b83-542a-47d0-a69f-5d6fe934794b tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff71c36a6ee04b67a6db8940296dc9ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdef9bfc39b84aba936ad3c1dfda8e9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:49.112596 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-f8525b83-542a-47d0-a69f-5d6fe934794b tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff71c36a6ee04b67a6db8940296dc9ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdef9bfc39b84aba936ad3c1dfda8e9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:49.113900 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f8525b83-542a-47d0-a69f-5d6fe934794b tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] 10.222.0.46 "GET /compute/v2.1/servers/bcf7aaa6-1938-4efc-bb5d-efb290dc345e" status: 200 len: 1359 microversion: 2.21 time: 0.311555 Jan 15 20:58:49.114461 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1517/3049] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:58:48 2022] GET /compute/v2.1/servers/bcf7aaa6-1938-4efc-bb5d-efb290dc345e => generated 1359 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:58:49.157298 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-63f19d1b-404c-4f61-8008-282dc081ac25 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:49.160762 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-63f19d1b-404c-4f61-8008-282dc081ac25 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: 67049bcd-1b55-4546-9f51-ab337a3be6be] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:49.168049 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-63f19d1b-404c-4f61-8008-282dc081ac25 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:49.168503 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-63f19d1b-404c-4f61-8008-282dc081ac25 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:49.171425 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-63f19d1b-404c-4f61-8008-282dc081ac25 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:49.171890 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-63f19d1b-404c-4f61-8008-282dc081ac25 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:49.293326 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-cac1599c-979b-4f1b-b101-38a91a8914bc tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:49.294724 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-cac1599c-979b-4f1b-b101-38a91a8914bc tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] [instance: e04f7a96-62cb-4aae-9612-aa8df88aef61] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:49.301926 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cac1599c-979b-4f1b-b101-38a91a8914bc tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:49.302656 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cac1599c-979b-4f1b-b101-38a91a8914bc tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:49.303749 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cac1599c-979b-4f1b-b101-38a91a8914bc tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:49.304425 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cac1599c-979b-4f1b-b101-38a91a8914bc tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:49.493456 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-63f19d1b-404c-4f61-8008-282dc081ac25 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:49.501904 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-63f19d1b-404c-4f61-8008-282dc081ac25 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/67049bcd-1b55-4546-9f51-ab337a3be6be" status: 200 len: 1314 microversion: 2.1 time: 0.350259 Jan 15 20:58:49.506423 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1533/3050] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:49 2022] GET /compute/v2.1/servers/67049bcd-1b55-4546-9f51-ab337a3be6be => generated 1314 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:49.662805 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-cac1599c-979b-4f1b-b101-38a91a8914bc tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05483ff6eec84f78a091b29cfbcf61f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a6720be5fb4de7bcd77cc7ef9d8000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:49.677657 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-cac1599c-979b-4f1b-b101-38a91a8914bc tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] 10.222.0.46 "GET /compute/v2.1/servers/e04f7a96-62cb-4aae-9612-aa8df88aef61" status: 200 len: 1566 microversion: 2.1 time: 0.388633 Jan 15 20:58:49.678390 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1518/3051] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:49 2022] GET /compute/v2.1/servers/e04f7a96-62cb-4aae-9612-aa8df88aef61 => generated 1566 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:58:49.722340 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-7d71bd50-ad49-400b-a49a-75dd1f83001a tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:49.723160 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-7d71bd50-ad49-400b-a49a-75dd1f83001a tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] [instance: 62ae2a15-8c2c-4dad-971f-0611238103a3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:49.730688 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7d71bd50-ad49-400b-a49a-75dd1f83001a tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:49.731293 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7d71bd50-ad49-400b-a49a-75dd1f83001a tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:49.732237 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7d71bd50-ad49-400b-a49a-75dd1f83001a tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:49.732781 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7d71bd50-ad49-400b-a49a-75dd1f83001a tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:49.811753 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b2040852-e232-4f27-b9d7-ffbc48be0d01 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:58:49.814842 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b2040852-e232-4f27-b9d7-ffbc48be0d01 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:49.826502 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b2040852-e232-4f27-b9d7-ffbc48be0d01 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:49.827301 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b2040852-e232-4f27-b9d7-ffbc48be0d01 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:49.828989 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b2040852-e232-4f27-b9d7-ffbc48be0d01 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:49.830311 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b2040852-e232-4f27-b9d7-ffbc48be0d01 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:49.920921 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b2040852-e232-4f27-b9d7-ffbc48be0d01 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action" status: 200 len: 24574 microversion: 2.1 time: 0.116189 Jan 15 20:58:49.921826 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1519/3052] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:58:49 2022] POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action => generated 24574 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:58:49.939278 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8e442441-146c-4f6d-98d9-865b25ced35f tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:49.941213 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-8e442441-146c-4f6d-98d9-865b25ced35f tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:49.972158 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8e442441-146c-4f6d-98d9-865b25ced35f tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:49.973802 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8e442441-146c-4f6d-98d9-865b25ced35f tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:49.974697 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8e442441-146c-4f6d-98d9-865b25ced35f tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:49.975143 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8e442441-146c-4f6d-98d9-865b25ced35f tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:50.102154 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-7d71bd50-ad49-400b-a49a-75dd1f83001a tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4c2db123e34ed9bdba89f7150ebcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca2cdba56c74d46a478aff355b23447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:50.115890 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-7d71bd50-ad49-400b-a49a-75dd1f83001a tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] 10.222.0.46 "GET /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3" status: 200 len: 1609 microversion: 2.1 time: 0.397190 Jan 15 20:58:50.120476 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1534/3053] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:49 2022] GET /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3 => generated 1609 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:50.133891 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-90df278e-0563-4390-8dc0-a40dcc541def tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:50.134839 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-90df278e-0563-4390-8dc0-a40dcc541def tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] [instance: bcf7aaa6-1938-4efc-bb5d-efb290dc345e] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:50.142625 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-90df278e-0563-4390-8dc0-a40dcc541def tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:50.143562 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-90df278e-0563-4390-8dc0-a40dcc541def tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:50.144770 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-90df278e-0563-4390-8dc0-a40dcc541def tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:50.145680 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-90df278e-0563-4390-8dc0-a40dcc541def tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:50.486251 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-8e442441-146c-4f6d-98d9-865b25ced35f tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:50.503218 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-8e442441-146c-4f6d-98d9-865b25ced35f tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:50.504815 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-8e442441-146c-4f6d-98d9-865b25ced35f tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:50.506251 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-8e442441-146c-4f6d-98d9-865b25ced35f tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "GET /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee" status: 200 len: 1879 microversion: 2.42 time: 0.571459 Jan 15 20:58:50.510745 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1520/3054] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:58:49 2022] GET /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee => generated 1879 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 15 20:58:50.523861 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-47ca88ef-762a-4526-beee-b76795f843a6 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:50.524538 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-47ca88ef-762a-4526-beee-b76795f843a6 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: 67049bcd-1b55-4546-9f51-ab337a3be6be] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:50.541902 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-47ca88ef-762a-4526-beee-b76795f843a6 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:50.542393 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-47ca88ef-762a-4526-beee-b76795f843a6 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:50.543159 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-47ca88ef-762a-4526-beee-b76795f843a6 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:50.543658 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-47ca88ef-762a-4526-beee-b76795f843a6 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:50.617993 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-90df278e-0563-4390-8dc0-a40dcc541def tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff71c36a6ee04b67a6db8940296dc9ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdef9bfc39b84aba936ad3c1dfda8e9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:50.631474 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-90df278e-0563-4390-8dc0-a40dcc541def tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff71c36a6ee04b67a6db8940296dc9ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdef9bfc39b84aba936ad3c1dfda8e9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:50.634280 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-90df278e-0563-4390-8dc0-a40dcc541def tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff71c36a6ee04b67a6db8940296dc9ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdef9bfc39b84aba936ad3c1dfda8e9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:50.638414 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-90df278e-0563-4390-8dc0-a40dcc541def tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] 10.222.0.46 "GET /compute/v2.1/servers/bcf7aaa6-1938-4efc-bb5d-efb290dc345e" status: 200 len: 1359 microversion: 2.21 time: 0.510719 Jan 15 20:58:50.639734 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1535/3055] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:58:50 2022] GET /compute/v2.1/servers/bcf7aaa6-1938-4efc-bb5d-efb290dc345e => generated 1359 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 15 20:58:50.698024 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-075e8928-9f94-4869-96c9-2746f86f2830 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:50.698962 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-075e8928-9f94-4869-96c9-2746f86f2830 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] [instance: e04f7a96-62cb-4aae-9612-aa8df88aef61] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:50.708552 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-075e8928-9f94-4869-96c9-2746f86f2830 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:50.709998 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-075e8928-9f94-4869-96c9-2746f86f2830 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:50.711408 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-075e8928-9f94-4869-96c9-2746f86f2830 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:50.712391 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-075e8928-9f94-4869-96c9-2746f86f2830 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:51.004405 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-47ca88ef-762a-4526-beee-b76795f843a6 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:51.031106 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-47ca88ef-762a-4526-beee-b76795f843a6 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/67049bcd-1b55-4546-9f51-ab337a3be6be" status: 200 len: 1314 microversion: 2.1 time: 0.507332 Jan 15 20:58:51.031905 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1521/3056] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:50 2022] GET /compute/v2.1/servers/67049bcd-1b55-4546-9f51-ab337a3be6be => generated 1314 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:51.038518 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4a544cc5-037a-44e0-8f8e-a42c57304b3f tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:58:51.041184 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-4a544cc5-037a-44e0-8f8e-a42c57304b3f tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:51.052696 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4a544cc5-037a-44e0-8f8e-a42c57304b3f tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:51.053343 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4a544cc5-037a-44e0-8f8e-a42c57304b3f tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:51.054332 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4a544cc5-037a-44e0-8f8e-a42c57304b3f tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:51.054758 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4a544cc5-037a-44e0-8f8e-a42c57304b3f tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:51.101201 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-4a544cc5-037a-44e0-8f8e-a42c57304b3f tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action" status: 200 len: 24574 microversion: 2.1 time: 0.067401 Jan 15 20:58:51.103482 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1522/3057] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:58:51 2022] POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action => generated 24574 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:58:51.139347 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e4b98ebe-9d29-4848-969c-8173572f540b tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:51.140402 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e4b98ebe-9d29-4848-969c-8173572f540b tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] [instance: 62ae2a15-8c2c-4dad-971f-0611238103a3] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:51.149982 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e4b98ebe-9d29-4848-969c-8173572f540b tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:51.151437 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e4b98ebe-9d29-4848-969c-8173572f540b tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:51.154294 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e4b98ebe-9d29-4848-969c-8173572f540b tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:51.155337 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e4b98ebe-9d29-4848-969c-8173572f540b tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:51.495576 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-075e8928-9f94-4869-96c9-2746f86f2830 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05483ff6eec84f78a091b29cfbcf61f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a6720be5fb4de7bcd77cc7ef9d8000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:51.511915 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-075e8928-9f94-4869-96c9-2746f86f2830 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] 10.222.0.46 "GET /compute/v2.1/servers/e04f7a96-62cb-4aae-9612-aa8df88aef61" status: 200 len: 1566 microversion: 2.1 time: 0.817775 Jan 15 20:58:51.513925 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1536/3058] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:50 2022] GET /compute/v2.1/servers/e04f7a96-62cb-4aae-9612-aa8df88aef61 => generated 1566 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:51.529419 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-13ef34af-b953-4b28-9216-f9f135e9b30d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:51.530139 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-13ef34af-b953-4b28-9216-f9f135e9b30d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:51.541777 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-13ef34af-b953-4b28-9216-f9f135e9b30d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:51.543185 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-13ef34af-b953-4b28-9216-f9f135e9b30d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:51.545216 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-13ef34af-b953-4b28-9216-f9f135e9b30d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:51.548679 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-13ef34af-b953-4b28-9216-f9f135e9b30d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:51.568272 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-e4b98ebe-9d29-4848-969c-8173572f540b tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4c2db123e34ed9bdba89f7150ebcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca2cdba56c74d46a478aff355b23447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:51.595638 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e4b98ebe-9d29-4848-969c-8173572f540b tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] 10.222.0.46 "GET /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3" status: 200 len: 1542 microversion: 2.1 time: 0.460558 Jan 15 20:58:51.598713 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1523/3059] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:51 2022] GET /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3 => generated 1542 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:58:51.636603 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-e265086f-1e4c-4a67-a393-3f9b072dfadf req-bf97e3e5-c60e-4802-9f05-c283daafd2b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62ae2a15-8c2c-4dad-971f-0611238103a3", "name": "network-vif-deleted", "tag": "77153925-7185-4583-89dc-fdd59e40d230"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:58:51.639661 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:58:51.639661 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:58:51.654808 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-e265086f-1e4c-4a67-a393-3f9b072dfadf req-bf97e3e5-c60e-4802-9f05-c283daafd2b8 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:51.655636 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-e265086f-1e4c-4a67-a393-3f9b072dfadf req-bf97e3e5-c60e-4802-9f05-c283daafd2b8 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:51.683657 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-e265086f-1e4c-4a67-a393-3f9b072dfadf req-bf97e3e5-c60e-4802-9f05-c283daafd2b8 service nova] Creating event network-vif-deleted:77153925-7185-4583-89dc-fdd59e40d230 for instance 62ae2a15-8c2c-4dad-971f-0611238103a3 on nch2-master-1 Jan 15 20:58:51.710158 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-e265086f-1e4c-4a67-a393-3f9b072dfadf req-bf97e3e5-c60e-4802-9f05-c283daafd2b8 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080290 Jan 15 20:58:51.718287 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1524/3060] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:58:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 20:58:51.731535 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-6e7813b9-6129-4aae-bad6-13c703e6444e tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:51.743345 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-6e7813b9-6129-4aae-bad6-13c703e6444e tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] [instance: bcf7aaa6-1938-4efc-bb5d-efb290dc345e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:51.760336 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6e7813b9-6129-4aae-bad6-13c703e6444e tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:51.764074 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6e7813b9-6129-4aae-bad6-13c703e6444e tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:51.768188 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6e7813b9-6129-4aae-bad6-13c703e6444e tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:51.768929 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6e7813b9-6129-4aae-bad6-13c703e6444e tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:52.423732 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-6e7813b9-6129-4aae-bad6-13c703e6444e tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff71c36a6ee04b67a6db8940296dc9ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdef9bfc39b84aba936ad3c1dfda8e9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:52.437911 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-6e7813b9-6129-4aae-bad6-13c703e6444e tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff71c36a6ee04b67a6db8940296dc9ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdef9bfc39b84aba936ad3c1dfda8e9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:52.440831 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-6e7813b9-6129-4aae-bad6-13c703e6444e tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff71c36a6ee04b67a6db8940296dc9ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdef9bfc39b84aba936ad3c1dfda8e9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:52.441999 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-6e7813b9-6129-4aae-bad6-13c703e6444e tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] 10.222.0.46 "GET /compute/v2.1/servers/bcf7aaa6-1938-4efc-bb5d-efb290dc345e" status: 200 len: 1359 microversion: 2.21 time: 0.722167 Jan 15 20:58:52.450905 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1525/3061] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:58:51 2022] GET /compute/v2.1/servers/bcf7aaa6-1938-4efc-bb5d-efb290dc345e => generated 1359 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:58:52.455618 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-002b2f70-085a-4974-89b3-bdcf2bb44cd7 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:52.456372 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-002b2f70-085a-4974-89b3-bdcf2bb44cd7 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: 67049bcd-1b55-4546-9f51-ab337a3be6be] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:52.470344 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-002b2f70-085a-4974-89b3-bdcf2bb44cd7 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:52.473263 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-002b2f70-085a-4974-89b3-bdcf2bb44cd7 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:52.474594 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-002b2f70-085a-4974-89b3-bdcf2bb44cd7 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:52.475599 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-002b2f70-085a-4974-89b3-bdcf2bb44cd7 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:52.495144 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-13ef34af-b953-4b28-9216-f9f135e9b30d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:52.508366 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-13ef34af-b953-4b28-9216-f9f135e9b30d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:52.512253 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-13ef34af-b953-4b28-9216-f9f135e9b30d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:52.518288 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-13ef34af-b953-4b28-9216-f9f135e9b30d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "GET /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee" status: 200 len: 1879 microversion: 2.42 time: 0.993745 Jan 15 20:58:52.521352 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1537/3062] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:58:51 2022] GET /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee => generated 1879 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:58:52.528982 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e5e099e4-deb1-4341-aac1-baef03041b65 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:58:52.532080 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e5e099e4-deb1-4341-aac1-baef03041b65 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:52.547764 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e5e099e4-deb1-4341-aac1-baef03041b65 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:52.548258 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e5e099e4-deb1-4341-aac1-baef03041b65 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:52.549094 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e5e099e4-deb1-4341-aac1-baef03041b65 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:52.549695 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e5e099e4-deb1-4341-aac1-baef03041b65 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:52.630371 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e5e099e4-deb1-4341-aac1-baef03041b65 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action" status: 200 len: 24574 microversion: 2.1 time: 0.107236 Jan 15 20:58:52.632462 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1538/3063] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:58:52 2022] POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action => generated 24574 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:58:52.639182 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-6393e5a3-8542-4d50-95ae-f3faf98e1e0b req-9e8d2e94-06c2-4dc8-aac0-fcc2a7cefcf7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcf7aaa6-1938-4efc-bb5d-efb290dc345e", "name": "network-vif-plugged", "status": "completed", "tag": "46409b3b-6c55-4c78-a954-43f18fe42119"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:58:52.651369 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:58:52.651369 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:58:52.665527 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-6393e5a3-8542-4d50-95ae-f3faf98e1e0b req-9e8d2e94-06c2-4dc8-aac0-fcc2a7cefcf7 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:52.668959 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-6393e5a3-8542-4d50-95ae-f3faf98e1e0b req-9e8d2e94-06c2-4dc8-aac0-fcc2a7cefcf7 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:52.701482 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-6393e5a3-8542-4d50-95ae-f3faf98e1e0b req-9e8d2e94-06c2-4dc8-aac0-fcc2a7cefcf7 service nova] Creating event network-vif-plugged:46409b3b-6c55-4c78-a954-43f18fe42119 for instance bcf7aaa6-1938-4efc-bb5d-efb290dc345e on nch1-master-1 Jan 15 20:58:52.717273 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-6393e5a3-8542-4d50-95ae-f3faf98e1e0b req-9e8d2e94-06c2-4dc8-aac0-fcc2a7cefcf7 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082481 Jan 15 20:58:52.722821 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1539/3064] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:58:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:58:52.728751 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f9c61a27-6b92-43ef-b748-0d61b307974f tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:52.736017 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f9c61a27-6b92-43ef-b748-0d61b307974f tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] [instance: e04f7a96-62cb-4aae-9612-aa8df88aef61] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:52.753400 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f9c61a27-6b92-43ef-b748-0d61b307974f tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:52.760811 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f9c61a27-6b92-43ef-b748-0d61b307974f tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:52.762207 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f9c61a27-6b92-43ef-b748-0d61b307974f tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:52.763161 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f9c61a27-6b92-43ef-b748-0d61b307974f tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:52.936763 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-002b2f70-085a-4974-89b3-bdcf2bb44cd7 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:52.955649 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-002b2f70-085a-4974-89b3-bdcf2bb44cd7 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/67049bcd-1b55-4546-9f51-ab337a3be6be" status: 200 len: 1314 microversion: 2.1 time: 0.503407 Jan 15 20:58:52.956699 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1526/3065] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:52 2022] GET /compute/v2.1/servers/67049bcd-1b55-4546-9f51-ab337a3be6be => generated 1314 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:52.962179 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9b5532f0-76f9-4a67-a7aa-218a5fe79ea6 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:52.963243 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-9b5532f0-76f9-4a67-a7aa-218a5fe79ea6 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] [instance: 62ae2a15-8c2c-4dad-971f-0611238103a3] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:52.970431 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9b5532f0-76f9-4a67-a7aa-218a5fe79ea6 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:52.971137 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9b5532f0-76f9-4a67-a7aa-218a5fe79ea6 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:52.972179 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9b5532f0-76f9-4a67-a7aa-218a5fe79ea6 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:52.972827 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9b5532f0-76f9-4a67-a7aa-218a5fe79ea6 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:52.988901 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-9b5532f0-76f9-4a67-a7aa-218a5fe79ea6 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] HTTP exception thrown: Instance 62ae2a15-8c2c-4dad-971f-0611238103a3 could not be found. Jan 15 20:58:52.991003 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9b5532f0-76f9-4a67-a7aa-218a5fe79ea6 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Returning 404 to user: Instance 62ae2a15-8c2c-4dad-971f-0611238103a3 could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:58:52.992207 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-9b5532f0-76f9-4a67-a7aa-218a5fe79ea6 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] 10.222.0.46 "GET /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3" status: 404 len: 111 microversion: 2.1 time: 0.034188 Jan 15 20:58:52.996666 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1527/3066] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:52 2022] GET /compute/v2.1/servers/62ae2a15-8c2c-4dad-971f-0611238103a3 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:58:53.004119 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8ef77a40-487b-48ac-992a-31b59b510176 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] Calling method '.version_select at 0x7f30c87a4280>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:53.040380 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-8ef77a40-487b-48ac-992a-31b59b510176 tempest-ServersTestBootFromVolume-1678952565 tempest-ServersTestBootFromVolume-1678952565-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2076036038" status: 202 len: 0 microversion: 2.1 time: 0.042144 Jan 15 20:58:53.042502 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1528/3067] 10.222.0.46 () {58 vars in 1220 bytes} [Sat Jan 15 20:58:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2076036038 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 20:58:53.081911 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-f9c61a27-6b92-43ef-b748-0d61b307974f tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05483ff6eec84f78a091b29cfbcf61f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a6720be5fb4de7bcd77cc7ef9d8000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:53.090717 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f9c61a27-6b92-43ef-b748-0d61b307974f tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] 10.222.0.46 "GET /compute/v2.1/servers/e04f7a96-62cb-4aae-9612-aa8df88aef61" status: 200 len: 1566 microversion: 2.1 time: 0.366028 Jan 15 20:58:53.091813 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1540/3068] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:52 2022] GET /compute/v2.1/servers/e04f7a96-62cb-4aae-9612-aa8df88aef61 => generated 1566 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:53.467715 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1282b8ac-c89d-4435-a1d9-fb9f132c389b tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:53.468723 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-1282b8ac-c89d-4435-a1d9-fb9f132c389b tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] [instance: bcf7aaa6-1938-4efc-bb5d-efb290dc345e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:53.478291 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1282b8ac-c89d-4435-a1d9-fb9f132c389b tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:53.484937 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1282b8ac-c89d-4435-a1d9-fb9f132c389b tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:53.485981 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1282b8ac-c89d-4435-a1d9-fb9f132c389b tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:53.492697 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1282b8ac-c89d-4435-a1d9-fb9f132c389b tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:53.549066 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-32afafd2-0fb8-465d-8609-6cd4a2717bdb tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:53.556175 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-32afafd2-0fb8-465d-8609-6cd4a2717bdb tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:53.567906 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-32afafd2-0fb8-465d-8609-6cd4a2717bdb tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:53.569245 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-32afafd2-0fb8-465d-8609-6cd4a2717bdb tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:53.571704 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-32afafd2-0fb8-465d-8609-6cd4a2717bdb tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:53.579973 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-32afafd2-0fb8-465d-8609-6cd4a2717bdb tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:53.929145 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-1282b8ac-c89d-4435-a1d9-fb9f132c389b tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff71c36a6ee04b67a6db8940296dc9ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdef9bfc39b84aba936ad3c1dfda8e9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:53.944288 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-1282b8ac-c89d-4435-a1d9-fb9f132c389b tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff71c36a6ee04b67a6db8940296dc9ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdef9bfc39b84aba936ad3c1dfda8e9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:53.946707 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-1282b8ac-c89d-4435-a1d9-fb9f132c389b tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff71c36a6ee04b67a6db8940296dc9ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdef9bfc39b84aba936ad3c1dfda8e9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:53.947979 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-1282b8ac-c89d-4435-a1d9-fb9f132c389b tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] 10.222.0.46 "GET /compute/v2.1/servers/bcf7aaa6-1938-4efc-bb5d-efb290dc345e" status: 200 len: 1359 microversion: 2.21 time: 0.484105 Jan 15 20:58:53.948977 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1529/3069] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:58:53 2022] GET /compute/v2.1/servers/bcf7aaa6-1938-4efc-bb5d-efb290dc345e => generated 1359 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:58:53.960633 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b76aafe2-cebc-441f-b2bf-e136b02881d3 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:58:53.961772 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b76aafe2-cebc-441f-b2bf-e136b02881d3 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:53.980635 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b76aafe2-cebc-441f-b2bf-e136b02881d3 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:53.988576 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b76aafe2-cebc-441f-b2bf-e136b02881d3 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:53.988576 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b76aafe2-cebc-441f-b2bf-e136b02881d3 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:53.989612 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b76aafe2-cebc-441f-b2bf-e136b02881d3 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:54.030282 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-32afafd2-0fb8-465d-8609-6cd4a2717bdb tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:54.048829 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-32afafd2-0fb8-465d-8609-6cd4a2717bdb tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:54.058177 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-32afafd2-0fb8-465d-8609-6cd4a2717bdb tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:54.059651 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-32afafd2-0fb8-465d-8609-6cd4a2717bdb tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "GET /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee" status: 200 len: 1879 microversion: 2.42 time: 0.518847 Jan 15 20:58:54.062505 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1541/3070] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:58:53 2022] GET /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee => generated 1879 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:58:54.068601 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-84307315-8281-4dc7-bda1-b979cbe6d689 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:54.069423 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-84307315-8281-4dc7-bda1-b979cbe6d689 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: 67049bcd-1b55-4546-9f51-ab337a3be6be] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:54.076496 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-84307315-8281-4dc7-bda1-b979cbe6d689 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:54.077199 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-84307315-8281-4dc7-bda1-b979cbe6d689 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:54.078254 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-84307315-8281-4dc7-bda1-b979cbe6d689 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:54.078881 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-84307315-8281-4dc7-bda1-b979cbe6d689 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:54.091726 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b76aafe2-cebc-441f-b2bf-e136b02881d3 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action" status: 200 len: 24574 microversion: 2.1 time: 0.141248 Jan 15 20:58:54.095908 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1530/3071] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:58:53 2022] POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action => generated 24574 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:58:54.108721 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-32eb1d4e-be0a-45e2-8ee5-9cd1325cfcc7 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:54.110564 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-32eb1d4e-be0a-45e2-8ee5-9cd1325cfcc7 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] [instance: e04f7a96-62cb-4aae-9612-aa8df88aef61] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:54.128441 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-32eb1d4e-be0a-45e2-8ee5-9cd1325cfcc7 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:54.129132 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-32eb1d4e-be0a-45e2-8ee5-9cd1325cfcc7 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:54.134502 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-32eb1d4e-be0a-45e2-8ee5-9cd1325cfcc7 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:54.135122 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-32eb1d4e-be0a-45e2-8ee5-9cd1325cfcc7 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:54.645074 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-84307315-8281-4dc7-bda1-b979cbe6d689 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:54.656447 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-84307315-8281-4dc7-bda1-b979cbe6d689 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/67049bcd-1b55-4546-9f51-ab337a3be6be" status: 200 len: 1314 microversion: 2.1 time: 0.589230 Jan 15 20:58:54.657804 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1542/3072] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:54 2022] GET /compute/v2.1/servers/67049bcd-1b55-4546-9f51-ab337a3be6be => generated 1314 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:54.702691 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-32eb1d4e-be0a-45e2-8ee5-9cd1325cfcc7 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05483ff6eec84f78a091b29cfbcf61f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a6720be5fb4de7bcd77cc7ef9d8000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:54.717531 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-32eb1d4e-be0a-45e2-8ee5-9cd1325cfcc7 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] 10.222.0.46 "GET /compute/v2.1/servers/e04f7a96-62cb-4aae-9612-aa8df88aef61" status: 200 len: 1566 microversion: 2.1 time: 0.612954 Jan 15 20:58:54.718774 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1531/3073] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:54 2022] GET /compute/v2.1/servers/e04f7a96-62cb-4aae-9612-aa8df88aef61 => generated 1566 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:54.881872 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-30662c8f-4d0f-43d1-a160-0a5307b56529 tempest-ImagesMetadataNegativeTestJSON-250842470 tempest-ImagesMetadataNegativeTestJSON-250842470-project] Calling method '.version_select at 0x7f30c85d7f70>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:54.910128 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-30662c8f-4d0f-43d1-a160-0a5307b56529 tempest-ImagesMetadataNegativeTestJSON-250842470 tempest-ImagesMetadataNegativeTestJSON-250842470-project] HTTP exception thrown: Image not found. Jan 15 20:58:54.910725 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-30662c8f-4d0f-43d1-a160-0a5307b56529 tempest-ImagesMetadataNegativeTestJSON-250842470 tempest-ImagesMetadataNegativeTestJSON-250842470-project] Returning 404 to user: Image not found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:58:54.911678 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-30662c8f-4d0f-43d1-a160-0a5307b56529 tempest-ImagesMetadataNegativeTestJSON-250842470 tempest-ImagesMetadataNegativeTestJSON-250842470-project] 10.222.0.46 "DELETE /compute/v2.1/images/f8ce4fa0-df9f-4e01-a340-57d603153499/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.218934 Jan 15 20:58:54.912541 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1543/3074] 10.222.0.46 () {58 vars in 1292 bytes} [Sat Jan 15 20:58:54 2022] DELETE /compute/v2.1/images/f8ce4fa0-df9f-4e01-a340-57d603153499/metadata/os_distro => generated 62 bytes in 220 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jan 15 20:58:54.924004 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d8c59700-17d4-4b9b-8c05-f6ae1edc5a52 tempest-ImagesMetadataNegativeTestJSON-250842470 tempest-ImagesMetadataNegativeTestJSON-250842470-project] Calling method '.version_select at 0x7f30c8fa4940>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:54.949247 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-d8c59700-17d4-4b9b-8c05-f6ae1edc5a52 tempest-ImagesMetadataNegativeTestJSON-250842470 tempest-ImagesMetadataNegativeTestJSON-250842470-project] HTTP exception thrown: Image not found. Jan 15 20:58:54.950065 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d8c59700-17d4-4b9b-8c05-f6ae1edc5a52 tempest-ImagesMetadataNegativeTestJSON-250842470 tempest-ImagesMetadataNegativeTestJSON-250842470-project] Returning 404 to user: Image not found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:58:54.951290 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d8c59700-17d4-4b9b-8c05-f6ae1edc5a52 tempest-ImagesMetadataNegativeTestJSON-250842470 tempest-ImagesMetadataNegativeTestJSON-250842470-project] 10.222.0.46 "GET /compute/v2.1/images/739434fa-787f-435d-8eb8-b2897be8324e/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.031049 Jan 15 20:58:54.952464 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1532/3075] 10.222.0.46 () {58 vars in 1292 bytes} [Sat Jan 15 20:58:54 2022] GET /compute/v2.1/images/739434fa-787f-435d-8eb8-b2897be8324e/metadata/os_version => generated 62 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jan 15 20:58:54.965358 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f3b7a2e2-8231-488a-8f65-719e9a3976e4 tempest-ImagesMetadataNegativeTestJSON-250842470 tempest-ImagesMetadataNegativeTestJSON-250842470-project] Calling method '.version_select at 0x7f30ceaebe50>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:54.973996 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-40b03e7b-66ea-406d-b65d-b98c5b91432b tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:54.978435 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-40b03e7b-66ea-406d-b65d-b98c5b91432b tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] [instance: bcf7aaa6-1938-4efc-bb5d-efb290dc345e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:54.990458 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-40b03e7b-66ea-406d-b65d-b98c5b91432b tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:54.993844 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-40b03e7b-66ea-406d-b65d-b98c5b91432b tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:54.994713 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-40b03e7b-66ea-406d-b65d-b98c5b91432b tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:54.995165 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-40b03e7b-66ea-406d-b65d-b98c5b91432b tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:55.002167 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-f3b7a2e2-8231-488a-8f65-719e9a3976e4 tempest-ImagesMetadataNegativeTestJSON-250842470 tempest-ImagesMetadataNegativeTestJSON-250842470-project] HTTP exception thrown: Image not found. Jan 15 20:58:55.004306 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f3b7a2e2-8231-488a-8f65-719e9a3976e4 tempest-ImagesMetadataNegativeTestJSON-250842470 tempest-ImagesMetadataNegativeTestJSON-250842470-project] Returning 404 to user: Image not found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:58:55.005556 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f3b7a2e2-8231-488a-8f65-719e9a3976e4 tempest-ImagesMetadataNegativeTestJSON-250842470 tempest-ImagesMetadataNegativeTestJSON-250842470-project] 10.222.0.46 "GET /compute/v2.1/images/7108fed9-8be6-4e3b-b61b-91f773de595a/metadata" status: 404 len: 62 microversion: 2.1 time: 0.045347 Jan 15 20:58:55.012666 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1544/3076] 10.222.0.46 () {58 vars in 1259 bytes} [Sat Jan 15 20:58:54 2022] GET /compute/v2.1/images/7108fed9-8be6-4e3b-b61b-91f773de595a/metadata => generated 62 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jan 15 20:58:55.019020 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-7cf4f0fa-7813-4c6a-a66a-d70fa192d10a tempest-ImagesMetadataNegativeTestJSON-250842470 tempest-ImagesMetadataNegativeTestJSON-250842470-project] Action: 'update_all', calling method: .version_select at 0x7f30c85be160>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:58:55.045003 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-7cf4f0fa-7813-4c6a-a66a-d70fa192d10a tempest-ImagesMetadataNegativeTestJSON-250842470 tempest-ImagesMetadataNegativeTestJSON-250842470-project] HTTP exception thrown: Image not found. Jan 15 20:58:55.045779 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-7cf4f0fa-7813-4c6a-a66a-d70fa192d10a tempest-ImagesMetadataNegativeTestJSON-250842470 tempest-ImagesMetadataNegativeTestJSON-250842470-project] Returning 404 to user: Image not found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:58:55.048183 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-7cf4f0fa-7813-4c6a-a66a-d70fa192d10a tempest-ImagesMetadataNegativeTestJSON-250842470 tempest-ImagesMetadataNegativeTestJSON-250842470-project] 10.222.0.46 "PUT /compute/v2.1/images/4166f339-3f61-411c-9e58-d9abcc3f99f6/metadata" status: 404 len: 62 microversion: 2.1 time: 0.032807 Jan 15 20:58:55.049217 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1545/3077] 10.222.0.46 () {60 vars in 1279 bytes} [Sat Jan 15 20:58:55 2022] PUT /compute/v2.1/images/4166f339-3f61-411c-9e58-d9abcc3f99f6/metadata => generated 62 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jan 15 20:58:55.059845 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e29e307f-14e7-4f63-82de-e529381c2db5 tempest-ImagesMetadataNegativeTestJSON-250842470 tempest-ImagesMetadataNegativeTestJSON-250842470-project] Action: 'update', calling method: .version_select at 0x7f30c9656dc0>, body: {"meta": {"os_distro": "alt"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:58:55.088183 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-e29e307f-14e7-4f63-82de-e529381c2db5 tempest-ImagesMetadataNegativeTestJSON-250842470 tempest-ImagesMetadataNegativeTestJSON-250842470-project] HTTP exception thrown: Image not found. Jan 15 20:58:55.089036 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e29e307f-14e7-4f63-82de-e529381c2db5 tempest-ImagesMetadataNegativeTestJSON-250842470 tempest-ImagesMetadataNegativeTestJSON-250842470-project] Returning 404 to user: Image not found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:58:55.091244 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e29e307f-14e7-4f63-82de-e529381c2db5 tempest-ImagesMetadataNegativeTestJSON-250842470 tempest-ImagesMetadataNegativeTestJSON-250842470-project] 10.222.0.46 "PUT /compute/v2.1/images/053f7e96-db4e-4e8d-b6d4-a616cae24149/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.036842 Jan 15 20:58:55.092269 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1546/3078] 10.222.0.46 () {60 vars in 1309 bytes} [Sat Jan 15 20:58:55 2022] PUT /compute/v2.1/images/053f7e96-db4e-4e8d-b6d4-a616cae24149/metadata/os_distro => generated 62 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jan 15 20:58:55.100206 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-aefeda93-0df8-4dc1-ba1c-cd3c3d82afab tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:55.101482 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-aefeda93-0df8-4dc1-ba1c-cd3c3d82afab tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:55.112475 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-aefeda93-0df8-4dc1-ba1c-cd3c3d82afab tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:55.113346 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-aefeda93-0df8-4dc1-ba1c-cd3c3d82afab tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:55.114593 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-aefeda93-0df8-4dc1-ba1c-cd3c3d82afab tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:55.115399 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-aefeda93-0df8-4dc1-ba1c-cd3c3d82afab tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:55.324565 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-40b03e7b-66ea-406d-b65d-b98c5b91432b tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff71c36a6ee04b67a6db8940296dc9ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdef9bfc39b84aba936ad3c1dfda8e9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:55.334892 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-40b03e7b-66ea-406d-b65d-b98c5b91432b tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff71c36a6ee04b67a6db8940296dc9ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdef9bfc39b84aba936ad3c1dfda8e9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:55.337073 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-40b03e7b-66ea-406d-b65d-b98c5b91432b tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff71c36a6ee04b67a6db8940296dc9ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdef9bfc39b84aba936ad3c1dfda8e9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:55.338614 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-40b03e7b-66ea-406d-b65d-b98c5b91432b tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] 10.222.0.46 "GET /compute/v2.1/servers/bcf7aaa6-1938-4efc-bb5d-efb290dc345e" status: 200 len: 1553 microversion: 2.21 time: 0.371711 Jan 15 20:58:55.339185 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1533/3079] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:58:54 2022] GET /compute/v2.1/servers/bcf7aaa6-1938-4efc-bb5d-efb290dc345e => generated 1553 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:58:55.358342 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8bfafe0a-d90a-41bb-b5fd-1194ecaef478 tempest-ImagesMetadataNegativeTestJSON-250842470 tempest-ImagesMetadataNegativeTestJSON-250842470-project] Action: 'create', calling method: .version_select at 0x7f30c90053a0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:58:55.384188 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-8bfafe0a-d90a-41bb-b5fd-1194ecaef478 tempest-ImagesMetadataNegativeTestJSON-250842470 tempest-ImagesMetadataNegativeTestJSON-250842470-project] HTTP exception thrown: Image not found. Jan 15 20:58:55.385079 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8bfafe0a-d90a-41bb-b5fd-1194ecaef478 tempest-ImagesMetadataNegativeTestJSON-250842470 tempest-ImagesMetadataNegativeTestJSON-250842470-project] Returning 404 to user: Image not found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:58:55.386328 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-8bfafe0a-d90a-41bb-b5fd-1194ecaef478 tempest-ImagesMetadataNegativeTestJSON-250842470 tempest-ImagesMetadataNegativeTestJSON-250842470-project] 10.222.0.46 "POST /compute/v2.1/images/db8c9fed-2e14-40f0-90f3-2e316f31bcb4/metadata" status: 404 len: 62 microversion: 2.1 time: 0.031868 Jan 15 20:58:55.387872 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1534/3080] 10.222.0.46 () {60 vars in 1280 bytes} [Sat Jan 15 20:58:55 2022] POST /compute/v2.1/images/db8c9fed-2e14-40f0-90f3-2e316f31bcb4/metadata => generated 62 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jan 15 20:58:55.398582 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-da055c73-bceb-4302-97b6-9b1fc526f064 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:58:55.400070 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-da055c73-bceb-4302-97b6-9b1fc526f064 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:55.407987 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-da055c73-bceb-4302-97b6-9b1fc526f064 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:55.408617 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-da055c73-bceb-4302-97b6-9b1fc526f064 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:55.410013 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-da055c73-bceb-4302-97b6-9b1fc526f064 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:55.410602 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-da055c73-bceb-4302-97b6-9b1fc526f064 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:55.473419 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-da055c73-bceb-4302-97b6-9b1fc526f064 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action" status: 200 len: 24574 microversion: 2.1 time: 0.081935 Jan 15 20:58:55.475629 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1535/3081] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:58:55 2022] POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action => generated 24574 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:58:55.490854 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-fa216da3-c782-4d87-97ce-137887bcb125 tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:55.492255 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-fa216da3-c782-4d87-97ce-137887bcb125 tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] [instance: bcf7aaa6-1938-4efc-bb5d-efb290dc345e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:55.505943 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fa216da3-c782-4d87-97ce-137887bcb125 tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:55.506641 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fa216da3-c782-4d87-97ce-137887bcb125 tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:55.508393 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fa216da3-c782-4d87-97ce-137887bcb125 tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:55.509023 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fa216da3-c782-4d87-97ce-137887bcb125 tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:55.614302 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-fa216da3-c782-4d87-97ce-137887bcb125 tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] [instance: bcf7aaa6-1938-4efc-bb5d-efb290dc345e] Going to try to terminate instance {{(pid=129366) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 20:58:55.633700 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-aefeda93-0df8-4dc1-ba1c-cd3c3d82afab tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:55.642888 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-aefeda93-0df8-4dc1-ba1c-cd3c3d82afab tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:55.644417 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-aefeda93-0df8-4dc1-ba1c-cd3c3d82afab tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:55.656319 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-aefeda93-0df8-4dc1-ba1c-cd3c3d82afab tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "GET /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee" status: 200 len: 1879 microversion: 2.42 time: 0.561327 Jan 15 20:58:55.656974 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1547/3082] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:58:55 2022] GET /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee => generated 1879 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:58:55.675366 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-39f7c6ae-fb58-4665-ad98-d547b642a181 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:55.675979 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-39f7c6ae-fb58-4665-ad98-d547b642a181 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: 67049bcd-1b55-4546-9f51-ab337a3be6be] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:55.704011 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-39f7c6ae-fb58-4665-ad98-d547b642a181 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:55.704472 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-39f7c6ae-fb58-4665-ad98-d547b642a181 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:55.705318 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-39f7c6ae-fb58-4665-ad98-d547b642a181 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:55.705758 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-39f7c6ae-fb58-4665-ad98-d547b642a181 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:55.818116 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-fa216da3-c782-4d87-97ce-137887bcb125 tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] 10.222.0.46 "DELETE /compute/v2.1/servers/bcf7aaa6-1938-4efc-bb5d-efb290dc345e" status: 204 len: 0 microversion: 2.21 time: 0.338496 Jan 15 20:58:55.821277 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1536/3083] 10.222.0.46 () {60 vars in 1279 bytes} [Sat Jan 15 20:58:55 2022] DELETE /compute/v2.1/servers/bcf7aaa6-1938-4efc-bb5d-efb290dc345e => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 15 20:58:55.829677 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-feb6d7da-f562-40f7-86cc-ce87640eebf7 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:55.831518 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-feb6d7da-f562-40f7-86cc-ce87640eebf7 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] [instance: e04f7a96-62cb-4aae-9612-aa8df88aef61] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:55.840263 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-feb6d7da-f562-40f7-86cc-ce87640eebf7 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:55.840979 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-feb6d7da-f562-40f7-86cc-ce87640eebf7 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:55.841952 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-feb6d7da-f562-40f7-86cc-ce87640eebf7 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:55.842531 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-feb6d7da-f562-40f7-86cc-ce87640eebf7 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:56.262457 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-feb6d7da-f562-40f7-86cc-ce87640eebf7 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05483ff6eec84f78a091b29cfbcf61f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a6720be5fb4de7bcd77cc7ef9d8000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:56.280653 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-feb6d7da-f562-40f7-86cc-ce87640eebf7 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] 10.222.0.46 "GET /compute/v2.1/servers/e04f7a96-62cb-4aae-9612-aa8df88aef61" status: 200 len: 1566 microversion: 2.1 time: 0.456970 Jan 15 20:58:56.281286 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1537/3084] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:55 2022] GET /compute/v2.1/servers/e04f7a96-62cb-4aae-9612-aa8df88aef61 => generated 1566 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:56.292703 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-655f9edb-77d0-455a-899d-1e22a2307904 tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:56.293301 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-655f9edb-77d0-455a-899d-1e22a2307904 tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] [instance: bcf7aaa6-1938-4efc-bb5d-efb290dc345e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:56.309141 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-655f9edb-77d0-455a-899d-1e22a2307904 tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:56.309871 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-655f9edb-77d0-455a-899d-1e22a2307904 tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:56.315787 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-655f9edb-77d0-455a-899d-1e22a2307904 tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:56.316270 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-655f9edb-77d0-455a-899d-1e22a2307904 tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:56.362983 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-39f7c6ae-fb58-4665-ad98-d547b642a181 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:56.373416 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-39f7c6ae-fb58-4665-ad98-d547b642a181 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/67049bcd-1b55-4546-9f51-ab337a3be6be" status: 200 len: 1314 microversion: 2.1 time: 0.700601 Jan 15 20:58:56.387343 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1548/3085] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:55 2022] GET /compute/v2.1/servers/67049bcd-1b55-4546-9f51-ab337a3be6be => generated 1314 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:58:56.394545 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-a173f2b2-dc4c-42f2-8290-a74456a8eee2 req-591e98f0-3526-42b9-8aab-84782a5945c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67049bcd-1b55-4546-9f51-ab337a3be6be", "name": "network-vif-plugged", "status": "completed", "tag": "1760c48a-43cb-484d-bf8d-1928a9b77428"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:58:56.399310 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:58:56.399310 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:58:56.409531 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-a173f2b2-dc4c-42f2-8290-a74456a8eee2 req-591e98f0-3526-42b9-8aab-84782a5945c6 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:56.410222 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-a173f2b2-dc4c-42f2-8290-a74456a8eee2 req-591e98f0-3526-42b9-8aab-84782a5945c6 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:56.426578 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-a173f2b2-dc4c-42f2-8290-a74456a8eee2 req-591e98f0-3526-42b9-8aab-84782a5945c6 service nova] Creating event network-vif-plugged:1760c48a-43cb-484d-bf8d-1928a9b77428 for instance 67049bcd-1b55-4546-9f51-ab337a3be6be on nch1-master-1 Jan 15 20:58:56.433543 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-a173f2b2-dc4c-42f2-8290-a74456a8eee2 req-591e98f0-3526-42b9-8aab-84782a5945c6 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043135 Jan 15 20:58:56.435146 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1549/3086] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:58:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:58:56.488811 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-19446d92-d90c-4d05-b20c-5aa0f19c6661 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:58:56.490935 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-19446d92-d90c-4d05-b20c-5aa0f19c6661 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:56.505725 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-19446d92-d90c-4d05-b20c-5aa0f19c6661 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:56.507139 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-19446d92-d90c-4d05-b20c-5aa0f19c6661 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:56.511368 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-19446d92-d90c-4d05-b20c-5aa0f19c6661 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:56.512124 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-19446d92-d90c-4d05-b20c-5aa0f19c6661 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:56.616430 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-19446d92-d90c-4d05-b20c-5aa0f19c6661 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action" status: 200 len: 24574 microversion: 2.1 time: 0.132236 Jan 15 20:58:56.617985 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1550/3087] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:58:56 2022] POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action => generated 24574 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:58:56.677689 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-95b74f05-d295-4c7e-9117-085f77d4eb20 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:56.680055 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-95b74f05-d295-4c7e-9117-085f77d4eb20 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:56.694141 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-95b74f05-d295-4c7e-9117-085f77d4eb20 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:56.696225 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-95b74f05-d295-4c7e-9117-085f77d4eb20 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:56.698004 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-95b74f05-d295-4c7e-9117-085f77d4eb20 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:56.700331 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-95b74f05-d295-4c7e-9117-085f77d4eb20 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:57.166665 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-655f9edb-77d0-455a-899d-1e22a2307904 tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff71c36a6ee04b67a6db8940296dc9ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdef9bfc39b84aba936ad3c1dfda8e9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:57.179572 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-655f9edb-77d0-455a-899d-1e22a2307904 tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff71c36a6ee04b67a6db8940296dc9ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdef9bfc39b84aba936ad3c1dfda8e9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:57.184962 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-655f9edb-77d0-455a-899d-1e22a2307904 tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff71c36a6ee04b67a6db8940296dc9ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdef9bfc39b84aba936ad3c1dfda8e9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:57.186887 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-655f9edb-77d0-455a-899d-1e22a2307904 tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] 10.222.0.46 "GET /compute/v2.1/servers/bcf7aaa6-1938-4efc-bb5d-efb290dc345e" status: 200 len: 1559 microversion: 2.21 time: 0.904633 Jan 15 20:58:57.188038 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1538/3088] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:58:56 2022] GET /compute/v2.1/servers/bcf7aaa6-1938-4efc-bb5d-efb290dc345e => generated 1559 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:58:57.298894 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0e724d3c-83d1-4464-a28d-caeb7b0ae965 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:57.300120 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-0e724d3c-83d1-4464-a28d-caeb7b0ae965 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] [instance: e04f7a96-62cb-4aae-9612-aa8df88aef61] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:57.304032 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-95b74f05-d295-4c7e-9117-085f77d4eb20 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:57.315746 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0e724d3c-83d1-4464-a28d-caeb7b0ae965 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:57.316565 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0e724d3c-83d1-4464-a28d-caeb7b0ae965 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:57.317641 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0e724d3c-83d1-4464-a28d-caeb7b0ae965 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:57.318396 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0e724d3c-83d1-4464-a28d-caeb7b0ae965 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:57.320555 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-95b74f05-d295-4c7e-9117-085f77d4eb20 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:57.323033 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-95b74f05-d295-4c7e-9117-085f77d4eb20 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:57.324223 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-95b74f05-d295-4c7e-9117-085f77d4eb20 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "GET /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee" status: 200 len: 1879 microversion: 2.42 time: 0.652795 Jan 15 20:58:57.324785 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1551/3089] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:58:56 2022] GET /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee => generated 1879 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 15 20:58:57.396277 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b553963e-3393-4803-985c-f8932fc12ef8 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:57.397031 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b553963e-3393-4803-985c-f8932fc12ef8 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: 67049bcd-1b55-4546-9f51-ab337a3be6be] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:57.410179 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b553963e-3393-4803-985c-f8932fc12ef8 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:57.410639 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b553963e-3393-4803-985c-f8932fc12ef8 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:57.411439 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b553963e-3393-4803-985c-f8932fc12ef8 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:57.411932 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b553963e-3393-4803-985c-f8932fc12ef8 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:57.764044 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-0e724d3c-83d1-4464-a28d-caeb7b0ae965 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05483ff6eec84f78a091b29cfbcf61f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a6720be5fb4de7bcd77cc7ef9d8000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:57.781583 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0e724d3c-83d1-4464-a28d-caeb7b0ae965 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] 10.222.0.46 "GET /compute/v2.1/servers/e04f7a96-62cb-4aae-9612-aa8df88aef61" status: 200 len: 1566 microversion: 2.1 time: 0.483362 Jan 15 20:58:57.783891 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1539/3090] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:57 2022] GET /compute/v2.1/servers/e04f7a96-62cb-4aae-9612-aa8df88aef61 => generated 1566 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:58:57.799771 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-b553963e-3393-4803-985c-f8932fc12ef8 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:57.812413 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b553963e-3393-4803-985c-f8932fc12ef8 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/67049bcd-1b55-4546-9f51-ab337a3be6be" status: 200 len: 1314 microversion: 2.1 time: 0.424001 Jan 15 20:58:57.814420 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1552/3091] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:57 2022] GET /compute/v2.1/servers/67049bcd-1b55-4546-9f51-ab337a3be6be => generated 1314 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:58:57.823206 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9ebfbec5-b61f-41d0-85ae-13883509c363 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:58:57.829487 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-9ebfbec5-b61f-41d0-85ae-13883509c363 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:57.844332 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9ebfbec5-b61f-41d0-85ae-13883509c363 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:57.845247 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9ebfbec5-b61f-41d0-85ae-13883509c363 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:57.846281 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9ebfbec5-b61f-41d0-85ae-13883509c363 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:57.846949 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9ebfbec5-b61f-41d0-85ae-13883509c363 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:57.955868 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-9ebfbec5-b61f-41d0-85ae-13883509c363 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action" status: 200 len: 24574 microversion: 2.1 time: 0.139072 Jan 15 20:58:57.956541 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1553/3092] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:58:57 2022] POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action => generated 24574 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:58:58.033136 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-3a133b5f-9560-4df2-8960-111d2b63c298 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Action: 'create', calling method: .version_select at 0x7f30c87a48b0>, body: {"keypair": {"name": "tempest-keypair-1374284916"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:58:58.051870 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-3a133b5f-9560-4df2-8960-111d2b63c298 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Getting quotas for project f16b035e629e4eb89850c2871a128781. Resources: {'key_pairs'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:58:58.059048 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-3a133b5f-9560-4df2-8960-111d2b63c298 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Getting quotas for user 27f38865f66e433090132a8a09d44774 and project f16b035e629e4eb89850c2871a128781. Resources: {'key_pairs'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:58:58.206684 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a6df0dad-cfab-4256-9162-8a11716cea44 tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:58.207777 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a6df0dad-cfab-4256-9162-8a11716cea44 tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] [instance: bcf7aaa6-1938-4efc-bb5d-efb290dc345e] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:58.223961 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a6df0dad-cfab-4256-9162-8a11716cea44 tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:58.225435 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a6df0dad-cfab-4256-9162-8a11716cea44 tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:58.235752 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a6df0dad-cfab-4256-9162-8a11716cea44 tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:58.237268 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a6df0dad-cfab-4256-9162-8a11716cea44 tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:58.574931 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-3a133b5f-9560-4df2-8960-111d2b63c298 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Getting quotas for project f16b035e629e4eb89850c2871a128781. Resources: {'key_pairs'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:58:58.595481 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-3a133b5f-9560-4df2-8960-111d2b63c298 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Getting quotas for user 27f38865f66e433090132a8a09d44774 and project f16b035e629e4eb89850c2871a128781. Resources: {'key_pairs'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:58:58.635144 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-3a133b5f-9560-4df2-8960-111d2b63c298 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.850140 Jan 15 20:58:58.639558 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1540/3093] 10.222.0.46 () {60 vars in 1157 bytes} [Sat Jan 15 20:58:57 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:58.644405 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-60671a62-6338-4c98-b393-73f2eda10976 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:58.647163 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-60671a62-6338-4c98-b393-73f2eda10976 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:58.674655 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-60671a62-6338-4c98-b393-73f2eda10976 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:58.676953 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-60671a62-6338-4c98-b393-73f2eda10976 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:58.679606 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-60671a62-6338-4c98-b393-73f2eda10976 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:58.682568 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-60671a62-6338-4c98-b393-73f2eda10976 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:58.826644 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-a6df0dad-cfab-4256-9162-8a11716cea44 tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff71c36a6ee04b67a6db8940296dc9ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdef9bfc39b84aba936ad3c1dfda8e9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:58.845376 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-a6df0dad-cfab-4256-9162-8a11716cea44 tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff71c36a6ee04b67a6db8940296dc9ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdef9bfc39b84aba936ad3c1dfda8e9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:58.848990 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-a6df0dad-cfab-4256-9162-8a11716cea44 tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff71c36a6ee04b67a6db8940296dc9ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdef9bfc39b84aba936ad3c1dfda8e9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:58.853543 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a6df0dad-cfab-4256-9162-8a11716cea44 tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] 10.222.0.46 "GET /compute/v2.1/servers/bcf7aaa6-1938-4efc-bb5d-efb290dc345e" status: 200 len: 1559 microversion: 2.21 time: 0.651112 Jan 15 20:58:58.856248 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1554/3094] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:58:58 2022] GET /compute/v2.1/servers/bcf7aaa6-1938-4efc-bb5d-efb290dc345e => generated 1559 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:58:58.881064 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-2c32ffc1-e40e-4a08-8df6-96a7c2911afd req-b16e01cf-d71a-408c-8fe3-b805cbf252ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcf7aaa6-1938-4efc-bb5d-efb290dc345e", "name": "network-vif-deleted", "tag": "46409b3b-6c55-4c78-a954-43f18fe42119"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:58:58.886315 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:58:58.886315 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:58:58.900759 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-2c32ffc1-e40e-4a08-8df6-96a7c2911afd req-b16e01cf-d71a-408c-8fe3-b805cbf252ef service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:58.901646 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-2c32ffc1-e40e-4a08-8df6-96a7c2911afd req-b16e01cf-d71a-408c-8fe3-b805cbf252ef service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:58.920302 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-2c32ffc1-e40e-4a08-8df6-96a7c2911afd req-b16e01cf-d71a-408c-8fe3-b805cbf252ef service nova] Creating event network-vif-deleted:46409b3b-6c55-4c78-a954-43f18fe42119 for instance bcf7aaa6-1938-4efc-bb5d-efb290dc345e on nch1-master-1 Jan 15 20:58:58.931659 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-2c32ffc1-e40e-4a08-8df6-96a7c2911afd req-b16e01cf-d71a-408c-8fe3-b805cbf252ef service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069821 Jan 15 20:58:58.932780 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1555/3095] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:58:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:58:58.950805 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ff023132-f98f-48e7-944b-e329791ff504 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:58.952135 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ff023132-f98f-48e7-944b-e329791ff504 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] [instance: e04f7a96-62cb-4aae-9612-aa8df88aef61] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:58.965343 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ff023132-f98f-48e7-944b-e329791ff504 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:58.966336 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ff023132-f98f-48e7-944b-e329791ff504 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:58.967653 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ff023132-f98f-48e7-944b-e329791ff504 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:58.968478 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ff023132-f98f-48e7-944b-e329791ff504 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:59.215290 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-60671a62-6338-4c98-b393-73f2eda10976 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:59.224747 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-60671a62-6338-4c98-b393-73f2eda10976 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:59.237028 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-60671a62-6338-4c98-b393-73f2eda10976 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:59.238574 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-60671a62-6338-4c98-b393-73f2eda10976 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "GET /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee" status: 200 len: 1879 microversion: 2.42 time: 0.597687 Jan 15 20:58:59.239277 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1541/3096] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:58:58 2022] GET /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee => generated 1879 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:58:59.246476 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e351b5bc-0a4d-494f-b959-94ed670ff674 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:59.249472 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e351b5bc-0a4d-494f-b959-94ed670ff674 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: 67049bcd-1b55-4546-9f51-ab337a3be6be] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:59.261512 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e351b5bc-0a4d-494f-b959-94ed670ff674 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:59.264121 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e351b5bc-0a4d-494f-b959-94ed670ff674 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:59.265100 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e351b5bc-0a4d-494f-b959-94ed670ff674 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:59.266318 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e351b5bc-0a4d-494f-b959-94ed670ff674 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:59.423913 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-ff023132-f98f-48e7-944b-e329791ff504 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05483ff6eec84f78a091b29cfbcf61f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a6720be5fb4de7bcd77cc7ef9d8000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:59.434035 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ff023132-f98f-48e7-944b-e329791ff504 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] 10.222.0.46 "GET /compute/v2.1/servers/e04f7a96-62cb-4aae-9612-aa8df88aef61" status: 200 len: 1566 microversion: 2.1 time: 0.495993 Jan 15 20:58:59.434576 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1556/3097] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:58 2022] GET /compute/v2.1/servers/e04f7a96-62cb-4aae-9612-aa8df88aef61 => generated 1566 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:59.466387 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f7c2cc05-18bc-4cfc-90aa-13d589a87d6c tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:58:59.467331 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f7c2cc05-18bc-4cfc-90aa-13d589a87d6c tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:59.490265 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f7c2cc05-18bc-4cfc-90aa-13d589a87d6c tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:59.490975 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f7c2cc05-18bc-4cfc-90aa-13d589a87d6c tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:59.493116 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f7c2cc05-18bc-4cfc-90aa-13d589a87d6c tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:59.493714 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f7c2cc05-18bc-4cfc-90aa-13d589a87d6c tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:59.570747 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f7c2cc05-18bc-4cfc-90aa-13d589a87d6c tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action" status: 200 len: 24574 microversion: 2.1 time: 0.114880 Jan 15 20:58:59.571511 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1557/3098] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:58:59 2022] POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action => generated 24574 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:58:59.873641 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-e351b5bc-0a4d-494f-b959-94ed670ff674 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:58:59.886467 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e351b5bc-0a4d-494f-b959-94ed670ff674 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/67049bcd-1b55-4546-9f51-ab337a3be6be" status: 200 len: 1501 microversion: 2.1 time: 0.646056 Jan 15 20:58:59.887510 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1542/3099] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:58:59 2022] GET /compute/v2.1/servers/67049bcd-1b55-4546-9f51-ab337a3be6be => generated 1501 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:58:59.891932 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c0db2b32-ef97-46d0-ac6d-b2ec91caeab2 tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:58:59.892526 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c0db2b32-ef97-46d0-ac6d-b2ec91caeab2 tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] [instance: bcf7aaa6-1938-4efc-bb5d-efb290dc345e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:58:59.903037 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-10220a5c-93e6-4bf2-b872-573c7c63a827 tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-986846761", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:58:59.922571 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c0db2b32-ef97-46d0-ac6d-b2ec91caeab2 tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:59.923283 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c0db2b32-ef97-46d0-ac6d-b2ec91caeab2 tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:59.924239 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c0db2b32-ef97-46d0-ac6d-b2ec91caeab2 tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:58:59.924832 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c0db2b32-ef97-46d0-ac6d-b2ec91caeab2 tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:58:59.985223 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-c0db2b32-ef97-46d0-ac6d-b2ec91caeab2 tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] HTTP exception thrown: Instance bcf7aaa6-1938-4efc-bb5d-efb290dc345e could not be found. Jan 15 20:58:59.985733 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c0db2b32-ef97-46d0-ac6d-b2ec91caeab2 tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Returning 404 to user: Instance bcf7aaa6-1938-4efc-bb5d-efb290dc345e could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:58:59.993221 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c0db2b32-ef97-46d0-ac6d-b2ec91caeab2 tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] 10.222.0.46 "GET /compute/v2.1/servers/bcf7aaa6-1938-4efc-bb5d-efb290dc345e" status: 404 len: 111 microversion: 2.21 time: 0.104537 Jan 15 20:58:59.997189 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1543/3100] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:58:59 2022] GET /compute/v2.1/servers/bcf7aaa6-1938-4efc-bb5d-efb290dc345e => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 15 20:59:00.008692 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1fa9e9c6-71f7-4a07-9116-bf25a35dee00 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:00.011906 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-1fa9e9c6-71f7-4a07-9116-bf25a35dee00 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: 67049bcd-1b55-4546-9f51-ab337a3be6be] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:00.030079 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.network.neutron [None req-10220a5c-93e6-4bf2-b872-573c7c63a827 tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] validate_networks() for None {{(pid=129365) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 20:59:00.039283 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1fa9e9c6-71f7-4a07-9116-bf25a35dee00 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:00.039899 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1fa9e9c6-71f7-4a07-9116-bf25a35dee00 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:00.040885 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1fa9e9c6-71f7-4a07-9116-bf25a35dee00 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:00.041438 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1fa9e9c6-71f7-4a07-9116-bf25a35dee00 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:00.112348 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.objects.instance [None req-1fa9e9c6-71f7-4a07-9116-bf25a35dee00 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lazy-loading 'flavor' on Instance uuid 67049bcd-1b55-4546-9f51-ab337a3be6be {{(pid=129366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 20:59:00.233540 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-1fa9e9c6-71f7-4a07-9116-bf25a35dee00 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "POST /compute/v2.1/servers/67049bcd-1b55-4546-9f51-ab337a3be6be/action" status: 202 len: 0 microversion: 2.1 time: 0.234083 Jan 15 20:59:00.235722 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1544/3101] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:58:59 2022] POST /compute/v2.1/servers/67049bcd-1b55-4546-9f51-ab337a3be6be/action => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 20:59:00.253604 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1db2d8ce-21b3-467f-b7ce-a389b3023763 tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Calling method '.version_select at 0x7f30c87c6550>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:00.254619 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-1db2d8ce-21b3-467f-b7ce-a389b3023763 tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] [instance: bcf7aaa6-1938-4efc-bb5d-efb290dc345e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:00.270764 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1db2d8ce-21b3-467f-b7ce-a389b3023763 tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:00.273819 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1db2d8ce-21b3-467f-b7ce-a389b3023763 tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:00.274842 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1db2d8ce-21b3-467f-b7ce-a389b3023763 tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:00.278165 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1db2d8ce-21b3-467f-b7ce-a389b3023763 tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:00.398420 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-1db2d8ce-21b3-467f-b7ce-a389b3023763 tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] 10.222.0.46 "GET /compute/v2.1/servers/bcf7aaa6-1938-4efc-bb5d-efb290dc345e/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.159030 Jan 15 20:59:00.407236 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1545/3102] 10.222.0.46 () {60 vars in 1336 bytes} [Sat Jan 15 20:59:00 2022] GET /compute/v2.1/servers/bcf7aaa6-1938-4efc-bb5d-efb290dc345e/os-instance-actions => generated 611 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:59:00.414521 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ef2c5ac5-ae99-4ca0-9112-3a64981d1aa5 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:00.415434 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ef2c5ac5-ae99-4ca0-9112-3a64981d1aa5 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: 67049bcd-1b55-4546-9f51-ab337a3be6be] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:00.424805 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ef2c5ac5-ae99-4ca0-9112-3a64981d1aa5 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:00.425484 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ef2c5ac5-ae99-4ca0-9112-3a64981d1aa5 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:00.427140 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ef2c5ac5-ae99-4ca0-9112-3a64981d1aa5 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:00.427760 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ef2c5ac5-ae99-4ca0-9112-3a64981d1aa5 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:01.040234 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-ef2c5ac5-ae99-4ca0-9112-3a64981d1aa5 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:01.048775 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ef2c5ac5-ae99-4ca0-9112-3a64981d1aa5 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/67049bcd-1b55-4546-9f51-ab337a3be6be" status: 200 len: 1509 microversion: 2.1 time: 0.640129 Jan 15 20:59:01.059807 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1546/3103] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:00 2022] GET /compute/v2.1/servers/67049bcd-1b55-4546-9f51-ab337a3be6be => generated 1509 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:59:01.059807 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-868d232d-f66b-4ca7-b012-45d4dd55870d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:01.059807 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-868d232d-f66b-4ca7-b012-45d4dd55870d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:01.077172 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-868d232d-f66b-4ca7-b012-45d4dd55870d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:01.077795 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-868d232d-f66b-4ca7-b012-45d4dd55870d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:01.078693 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-868d232d-f66b-4ca7-b012-45d4dd55870d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:01.079205 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-868d232d-f66b-4ca7-b012-45d4dd55870d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:01.092472 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-10220a5c-93e6-4bf2-b872-573c7c63a827 tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] Flavor limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 20:59:01.093431 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-10220a5c-93e6-4bf2-b872-573c7c63a827 tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] Image limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 20:59:01.093766 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-10220a5c-93e6-4bf2-b872-573c7c63a827 tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] Flavor pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 20:59:01.094499 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-10220a5c-93e6-4bf2-b872-573c7c63a827 tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] Image pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 20:59:01.094919 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-10220a5c-93e6-4bf2-b872-573c7c63a827 tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 20:59:01.105624 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-10220a5c-93e6-4bf2-b872-573c7c63a827 tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:01.106086 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-10220a5c-93e6-4bf2-b872-573c7c63a827 tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:01.106896 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-10220a5c-93e6-4bf2-b872-573c7c63a827 tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:01.107329 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-10220a5c-93e6-4bf2-b872-573c7c63a827 tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:01.129026 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-10220a5c-93e6-4bf2-b872-573c7c63a827 tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] Getting quotas for project 7902e3c4b947454ea2411fc422568e4e. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:59:01.135088 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-10220a5c-93e6-4bf2-b872-573c7c63a827 tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] Getting quotas for user a4986ff02ec54476842aa7c9eaac62ba and project 7902e3c4b947454ea2411fc422568e4e. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:59:01.153218 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-10220a5c-93e6-4bf2-b872-573c7c63a827 tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] Going to run 1 instances... {{(pid=129365) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 20:59:01.156445 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-10220a5c-93e6-4bf2-b872-573c7c63a827 tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] [instance: 9a181c6f-84ca-409d-93f3-3a86ba0f1b6d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129365) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 20:59:01.219133 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-10220a5c-93e6-4bf2-b872-573c7c63a827 tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.646485 Jan 15 20:59:01.225406 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1558/3104] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 20:58:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1653 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 20:59:01.232232 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-573a6c94-c4d4-434a-aaeb-1deb9ebac9a3 tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:01.232729 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-573a6c94-c4d4-434a-aaeb-1deb9ebac9a3 tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] [instance: bcf7aaa6-1938-4efc-bb5d-efb290dc345e] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:01.240584 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-573a6c94-c4d4-434a-aaeb-1deb9ebac9a3 tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:01.241187 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-573a6c94-c4d4-434a-aaeb-1deb9ebac9a3 tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:01.242668 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-573a6c94-c4d4-434a-aaeb-1deb9ebac9a3 tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:01.243239 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-573a6c94-c4d4-434a-aaeb-1deb9ebac9a3 tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:01.266874 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-573a6c94-c4d4-434a-aaeb-1deb9ebac9a3 tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] HTTP exception thrown: Instance bcf7aaa6-1938-4efc-bb5d-efb290dc345e could not be found. Jan 15 20:59:01.267480 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-573a6c94-c4d4-434a-aaeb-1deb9ebac9a3 tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Returning 404 to user: Instance bcf7aaa6-1938-4efc-bb5d-efb290dc345e could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:59:01.268633 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-573a6c94-c4d4-434a-aaeb-1deb9ebac9a3 tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] 10.222.0.46 "DELETE /compute/v2.1/servers/bcf7aaa6-1938-4efc-bb5d-efb290dc345e" status: 404 len: 111 microversion: 2.21 time: 0.040835 Jan 15 20:59:01.269569 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1559/3105] 10.222.0.46 () {60 vars in 1279 bytes} [Sat Jan 15 20:59:01 2022] DELETE /compute/v2.1/servers/bcf7aaa6-1938-4efc-bb5d-efb290dc345e => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 15 20:59:01.274644 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-01526a64-54d1-4127-abd8-f9ae0b148816 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:01.275252 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-01526a64-54d1-4127-abd8-f9ae0b148816 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] [instance: e04f7a96-62cb-4aae-9612-aa8df88aef61] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:01.281847 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-01526a64-54d1-4127-abd8-f9ae0b148816 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:01.282295 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-01526a64-54d1-4127-abd8-f9ae0b148816 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:01.283077 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-01526a64-54d1-4127-abd8-f9ae0b148816 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:01.283678 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-01526a64-54d1-4127-abd8-f9ae0b148816 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:01.406072 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-868d232d-f66b-4ca7-b012-45d4dd55870d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:01.420780 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-868d232d-f66b-4ca7-b012-45d4dd55870d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:01.423790 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-868d232d-f66b-4ca7-b012-45d4dd55870d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:01.425434 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-868d232d-f66b-4ca7-b012-45d4dd55870d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "GET /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee" status: 200 len: 1879 microversion: 2.42 time: 0.374719 Jan 15 20:59:01.452314 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1547/3106] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:59:01 2022] GET /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee => generated 1879 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:59:01.465957 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-93addf02-232d-4890-9ce0-d7459cb0e5f9 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:01.467026 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-93addf02-232d-4890-9ce0-d7459cb0e5f9 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:01.477990 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-93addf02-232d-4890-9ce0-d7459cb0e5f9 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:01.478442 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-93addf02-232d-4890-9ce0-d7459cb0e5f9 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:01.483125 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-93addf02-232d-4890-9ce0-d7459cb0e5f9 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:01.483615 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-93addf02-232d-4890-9ce0-d7459cb0e5f9 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:01.551565 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-01526a64-54d1-4127-abd8-f9ae0b148816 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05483ff6eec84f78a091b29cfbcf61f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a6720be5fb4de7bcd77cc7ef9d8000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:01.552055 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-93addf02-232d-4890-9ce0-d7459cb0e5f9 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action" status: 200 len: 32641 microversion: 2.1 time: 0.089800 Jan 15 20:59:01.553391 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1548/3107] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:59:01 2022] POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action => generated 32641 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:59:01.560451 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e4387a9c-6727-433f-84c1-c8979dc47ea2 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1400829770", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "4bfa39ea-0964-46f2-af6c-3e9216614c72"}], "security_groups": [{"name": "tempest-securitygroup--1530253147"}], "key_name": "tempest-keypair-1374284916", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "AUTO"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:01.567428 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-01526a64-54d1-4127-abd8-f9ae0b148816 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] 10.222.0.46 "GET /compute/v2.1/servers/e04f7a96-62cb-4aae-9612-aa8df88aef61" status: 200 len: 1566 microversion: 2.1 time: 0.296592 Jan 15 20:59:01.568020 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1560/3108] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:01 2022] GET /compute/v2.1/servers/e04f7a96-62cb-4aae-9612-aa8df88aef61 => generated 1566 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:59:01.583355 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-6a3bc0cc-0d1c-4d2c-a31a-c7718d11dd10 tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:01.583962 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-6a3bc0cc-0d1c-4d2c-a31a-c7718d11dd10 tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] [instance: 9a181c6f-84ca-409d-93f3-3a86ba0f1b6d] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:01.713786 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-6a3bc0cc-0d1c-4d2c-a31a-c7718d11dd10 tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4986ff02ec54476842aa7c9eaac62ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7902e3c4b947454ea2411fc422568e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:01.721625 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-6a3bc0cc-0d1c-4d2c-a31a-c7718d11dd10 tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] 10.222.0.46 "GET /compute/v2.1/servers/9a181c6f-84ca-409d-93f3-3a86ba0f1b6d" status: 200 len: 1215 microversion: 2.1 time: 0.141813 Jan 15 20:59:01.722314 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1561/3109] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:01 2022] GET /compute/v2.1/servers/9a181c6f-84ca-409d-93f3-3a86ba0f1b6d => generated 1215 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:59:01.728005 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-76e1b511-5307-4add-b6d0-ec61d5e6a48d tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:01.729074 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-76e1b511-5307-4add-b6d0-ec61d5e6a48d tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] [instance: bcf7aaa6-1938-4efc-bb5d-efb290dc345e] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:01.735916 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-76e1b511-5307-4add-b6d0-ec61d5e6a48d tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:01.736498 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-76e1b511-5307-4add-b6d0-ec61d5e6a48d tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:01.737295 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-76e1b511-5307-4add-b6d0-ec61d5e6a48d tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:01.737908 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-76e1b511-5307-4add-b6d0-ec61d5e6a48d tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:01.753455 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-76e1b511-5307-4add-b6d0-ec61d5e6a48d tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] HTTP exception thrown: Instance bcf7aaa6-1938-4efc-bb5d-efb290dc345e could not be found. Jan 15 20:59:01.754428 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-76e1b511-5307-4add-b6d0-ec61d5e6a48d tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] Returning 404 to user: Instance bcf7aaa6-1938-4efc-bb5d-efb290dc345e could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:59:01.755702 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-76e1b511-5307-4add-b6d0-ec61d5e6a48d tempest-InstanceActionsV221TestJSON-400205188 tempest-InstanceActionsV221TestJSON-400205188-project] 10.222.0.46 "GET /compute/v2.1/servers/bcf7aaa6-1938-4efc-bb5d-efb290dc345e" status: 404 len: 111 microversion: 2.21 time: 0.031901 Jan 15 20:59:01.760921 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1562/3110] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:59:01 2022] GET /compute/v2.1/servers/bcf7aaa6-1938-4efc-bb5d-efb290dc345e => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 15 20:59:01.839694 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.network.neutron [None req-e4387a9c-6727-433f-84c1-c8979dc47ea2 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] validate_networks() for [('4bfa39ea-0964-46f2-af6c-3e9216614c72', None, None, None, None, None)] {{(pid=129366) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 20:59:02.068779 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b6d2dfe1-13db-48c5-ac0c-4c2268ecf3dc tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:02.070211 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b6d2dfe1-13db-48c5-ac0c-4c2268ecf3dc tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: 67049bcd-1b55-4546-9f51-ab337a3be6be] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:02.083204 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b6d2dfe1-13db-48c5-ac0c-4c2268ecf3dc tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:02.083707 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b6d2dfe1-13db-48c5-ac0c-4c2268ecf3dc tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:02.084512 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b6d2dfe1-13db-48c5-ac0c-4c2268ecf3dc tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:02.084982 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b6d2dfe1-13db-48c5-ac0c-4c2268ecf3dc tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:02.589341 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-b6d2dfe1-13db-48c5-ac0c-4c2268ecf3dc tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:02.600003 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b6d2dfe1-13db-48c5-ac0c-4c2268ecf3dc tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/67049bcd-1b55-4546-9f51-ab337a3be6be" status: 200 len: 1492 microversion: 2.1 time: 0.536807 Jan 15 20:59:02.614696 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1563/3111] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:02 2022] GET /compute/v2.1/servers/67049bcd-1b55-4546-9f51-ab337a3be6be => generated 1492 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:59:02.621996 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-226f6641-a61e-493d-b42f-d62b7a7351ff tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:02.622895 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-226f6641-a61e-493d-b42f-d62b7a7351ff tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:02.630297 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-226f6641-a61e-493d-b42f-d62b7a7351ff tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:02.631142 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-226f6641-a61e-493d-b42f-d62b7a7351ff tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:02.633165 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-226f6641-a61e-493d-b42f-d62b7a7351ff tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:02.633940 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-226f6641-a61e-493d-b42f-d62b7a7351ff tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:03.081719 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-226f6641-a61e-493d-b42f-d62b7a7351ff tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:03.118133 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-226f6641-a61e-493d-b42f-d62b7a7351ff tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:03.133390 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-226f6641-a61e-493d-b42f-d62b7a7351ff tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:03.137739 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-226f6641-a61e-493d-b42f-d62b7a7351ff tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "GET /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee" status: 200 len: 1879 microversion: 2.42 time: 0.521775 Jan 15 20:59:03.138380 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-e4387a9c-6727-433f-84c1-c8979dc47ea2 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Getting quotas for project f16b035e629e4eb89850c2871a128781. Resources: dict_keys(['metadata_items']) {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:59:03.140988 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1564/3112] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:59:02 2022] GET /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee => generated 1879 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:59:03.145732 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-e4387a9c-6727-433f-84c1-c8979dc47ea2 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Getting quotas for user 27f38865f66e433090132a8a09d44774 and project f16b035e629e4eb89850c2871a128781. Resources: dict_keys(['metadata_items']) {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:59:03.146747 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-fb4e54eb-489a-44a4-b146-28eea7464565 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:03.148641 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-fb4e54eb-489a-44a4-b146-28eea7464565 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:03.157878 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fb4e54eb-489a-44a4-b146-28eea7464565 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:03.158551 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fb4e54eb-489a-44a4-b146-28eea7464565 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:03.159616 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fb4e54eb-489a-44a4-b146-28eea7464565 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:03.160235 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fb4e54eb-489a-44a4-b146-28eea7464565 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:03.176247 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-e4387a9c-6727-433f-84c1-c8979dc47ea2 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Flavor limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 20:59:03.189402 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-e4387a9c-6727-433f-84c1-c8979dc47ea2 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Image limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 20:59:03.189953 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-e4387a9c-6727-433f-84c1-c8979dc47ea2 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Flavor pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 20:59:03.190422 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-e4387a9c-6727-433f-84c1-c8979dc47ea2 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Image pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 20:59:03.190760 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-e4387a9c-6727-433f-84c1-c8979dc47ea2 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 20:59:03.199925 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e4387a9c-6727-433f-84c1-c8979dc47ea2 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:03.200362 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e4387a9c-6727-433f-84c1-c8979dc47ea2 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:03.201368 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e4387a9c-6727-433f-84c1-c8979dc47ea2 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:03.202114 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e4387a9c-6727-433f-84c1-c8979dc47ea2 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:03.227444 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-fb4e54eb-489a-44a4-b146-28eea7464565 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action" status: 200 len: 32641 microversion: 2.1 time: 0.083881 Jan 15 20:59:03.234025 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1565/3113] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:59:03 2022] POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action => generated 32641 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:59:03.240671 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-698628fe-69a5-49ff-a23f-093747e2f138 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:03.242514 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-698628fe-69a5-49ff-a23f-093747e2f138 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] [instance: e04f7a96-62cb-4aae-9612-aa8df88aef61] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:03.250207 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-e4387a9c-6727-433f-84c1-c8979dc47ea2 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Getting quotas for project f16b035e629e4eb89850c2871a128781. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:59:03.251483 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-698628fe-69a5-49ff-a23f-093747e2f138 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:03.252134 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-698628fe-69a5-49ff-a23f-093747e2f138 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:03.253579 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-698628fe-69a5-49ff-a23f-093747e2f138 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:03.254029 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-698628fe-69a5-49ff-a23f-093747e2f138 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:03.255841 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-e4387a9c-6727-433f-84c1-c8979dc47ea2 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Getting quotas for user 27f38865f66e433090132a8a09d44774 and project f16b035e629e4eb89850c2871a128781. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:59:03.281189 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e4387a9c-6727-433f-84c1-c8979dc47ea2 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Going to run 1 instances... {{(pid=129366) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 20:59:03.284966 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e4387a9c-6727-433f-84c1-c8979dc47ea2 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] [instance: 5e93486c-7c77-4855-85f4-2bc8bcf4832f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 20:59:03.397150 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e4387a9c-6727-433f-84c1-c8979dc47ea2 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.841642 Jan 15 20:59:03.402979 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1549/3114] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 20:59:01 2022] POST /compute/v2.1/servers => generated 407 bytes in 1849 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 20:59:03.414689 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f0fe6625-ea18-4317-97f6-a9d4613b30ac tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:03.417560 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f0fe6625-ea18-4317-97f6-a9d4613b30ac tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: 67049bcd-1b55-4546-9f51-ab337a3be6be] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:03.437080 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f0fe6625-ea18-4317-97f6-a9d4613b30ac tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:03.440258 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f0fe6625-ea18-4317-97f6-a9d4613b30ac tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:03.441425 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f0fe6625-ea18-4317-97f6-a9d4613b30ac tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:03.442407 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f0fe6625-ea18-4317-97f6-a9d4613b30ac tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:03.515340 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f0fe6625-ea18-4317-97f6-a9d4613b30ac tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: 67049bcd-1b55-4546-9f51-ab337a3be6be] Going to try to terminate instance {{(pid=129366) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 20:59:03.554462 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-698628fe-69a5-49ff-a23f-093747e2f138 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05483ff6eec84f78a091b29cfbcf61f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a6720be5fb4de7bcd77cc7ef9d8000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:03.571167 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-698628fe-69a5-49ff-a23f-093747e2f138 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] 10.222.0.46 "GET /compute/v2.1/servers/e04f7a96-62cb-4aae-9612-aa8df88aef61" status: 200 len: 1566 microversion: 2.1 time: 0.335322 Jan 15 20:59:03.580536 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1566/3115] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:03 2022] GET /compute/v2.1/servers/e04f7a96-62cb-4aae-9612-aa8df88aef61 => generated 1566 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:59:03.580536 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-82a95105-06e1-4992-bcc3-035fcdd386fd tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:03.583821 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-82a95105-06e1-4992-bcc3-035fcdd386fd tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] [instance: 9a181c6f-84ca-409d-93f3-3a86ba0f1b6d] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:03.601925 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-82a95105-06e1-4992-bcc3-035fcdd386fd tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:03.602491 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-82a95105-06e1-4992-bcc3-035fcdd386fd tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:03.603224 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-82a95105-06e1-4992-bcc3-035fcdd386fd tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:03.603635 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-82a95105-06e1-4992-bcc3-035fcdd386fd tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:03.727223 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f0fe6625-ea18-4317-97f6-a9d4613b30ac tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "DELETE /compute/v2.1/servers/67049bcd-1b55-4546-9f51-ab337a3be6be" status: 204 len: 0 microversion: 2.1 time: 0.321940 Jan 15 20:59:03.728033 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1550/3116] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 20:59:03 2022] DELETE /compute/v2.1/servers/67049bcd-1b55-4546-9f51-ab337a3be6be => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 20:59:03.736692 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-fd65dce5-6131-40b5-a924-d2eb4d844672 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:03.738441 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-fd65dce5-6131-40b5-a924-d2eb4d844672 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] [instance: 5e93486c-7c77-4855-85f4-2bc8bcf4832f] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:03.756486 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-82a95105-06e1-4992-bcc3-035fcdd386fd tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4986ff02ec54476842aa7c9eaac62ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7902e3c4b947454ea2411fc422568e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:03.767461 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-82a95105-06e1-4992-bcc3-035fcdd386fd tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] 10.222.0.46 "GET /compute/v2.1/servers/9a181c6f-84ca-409d-93f3-3a86ba0f1b6d" status: 200 len: 1273 microversion: 2.1 time: 0.191801 Jan 15 20:59:03.770806 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1567/3117] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:03 2022] GET /compute/v2.1/servers/9a181c6f-84ca-409d-93f3-3a86ba0f1b6d => generated 1273 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:59:03.779105 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-13888832-ea76-42dd-adc7-462943378e1e tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:03.779719 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-13888832-ea76-42dd-adc7-462943378e1e tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: 67049bcd-1b55-4546-9f51-ab337a3be6be] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:03.794886 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-13888832-ea76-42dd-adc7-462943378e1e tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:03.795335 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-13888832-ea76-42dd-adc7-462943378e1e tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:03.823407 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-13888832-ea76-42dd-adc7-462943378e1e tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:03.823877 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-13888832-ea76-42dd-adc7-462943378e1e tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:03.893835 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-fd65dce5-6131-40b5-a924-d2eb4d844672 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f38865f66e433090132a8a09d44774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16b035e629e4eb89850c2871a128781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:03.921130 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-fd65dce5-6131-40b5-a924-d2eb4d844672 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] 10.222.0.46 "GET /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f" status: 200 len: 1270 microversion: 2.1 time: 0.190076 Jan 15 20:59:03.932819 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1551/3118] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:03 2022] GET /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f => generated 1270 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:59:04.161314 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f5318037-e0dc-472f-baaa-ae2e8eaab9e6 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:04.161977 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f5318037-e0dc-472f-baaa-ae2e8eaab9e6 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:04.170788 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-13888832-ea76-42dd-adc7-462943378e1e tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:04.178456 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f5318037-e0dc-472f-baaa-ae2e8eaab9e6 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:04.179038 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f5318037-e0dc-472f-baaa-ae2e8eaab9e6 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:04.181853 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f5318037-e0dc-472f-baaa-ae2e8eaab9e6 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:04.182323 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f5318037-e0dc-472f-baaa-ae2e8eaab9e6 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:04.182815 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-13888832-ea76-42dd-adc7-462943378e1e tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/67049bcd-1b55-4546-9f51-ab337a3be6be" status: 200 len: 1498 microversion: 2.1 time: 0.410754 Jan 15 20:59:04.195275 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1568/3119] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:03 2022] GET /compute/v2.1/servers/67049bcd-1b55-4546-9f51-ab337a3be6be => generated 1498 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:59:04.243764 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ad828ea9-4e34-4a7e-988e-ecc54b16c3cc tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:04.245806 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ad828ea9-4e34-4a7e-988e-ecc54b16c3cc tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:04.259588 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ad828ea9-4e34-4a7e-988e-ecc54b16c3cc tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:04.260294 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ad828ea9-4e34-4a7e-988e-ecc54b16c3cc tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:04.261329 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ad828ea9-4e34-4a7e-988e-ecc54b16c3cc tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:04.262035 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ad828ea9-4e34-4a7e-988e-ecc54b16c3cc tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:04.320032 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ad828ea9-4e34-4a7e-988e-ecc54b16c3cc tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action" status: 200 len: 32641 microversion: 2.1 time: 0.081255 Jan 15 20:59:04.324255 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1569/3120] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:59:04 2022] POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action => generated 32641 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:59:04.590494 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-1a59f6b1-b720-4b96-a511-7d60753eeb48 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:04.591311 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-1a59f6b1-b720-4b96-a511-7d60753eeb48 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] [instance: e04f7a96-62cb-4aae-9612-aa8df88aef61] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:04.605596 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1a59f6b1-b720-4b96-a511-7d60753eeb48 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:04.607477 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1a59f6b1-b720-4b96-a511-7d60753eeb48 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:04.610442 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1a59f6b1-b720-4b96-a511-7d60753eeb48 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:04.611099 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1a59f6b1-b720-4b96-a511-7d60753eeb48 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:04.781745 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-f5318037-e0dc-472f-baaa-ae2e8eaab9e6 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:04.794774 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-f5318037-e0dc-472f-baaa-ae2e8eaab9e6 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:04.796719 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-f5318037-e0dc-472f-baaa-ae2e8eaab9e6 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:04.798290 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f5318037-e0dc-472f-baaa-ae2e8eaab9e6 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "GET /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee" status: 200 len: 1879 microversion: 2.42 time: 0.642102 Jan 15 20:59:04.799042 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1552/3121] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:59:04 2022] GET /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee => generated 1879 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 15 20:59:04.818474 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9654f232-c7ec-4e4f-ad3b-fb233f481bef tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:04.819659 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-9654f232-c7ec-4e4f-ad3b-fb233f481bef tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] [instance: 9a181c6f-84ca-409d-93f3-3a86ba0f1b6d] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:04.826837 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9654f232-c7ec-4e4f-ad3b-fb233f481bef tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:04.827627 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9654f232-c7ec-4e4f-ad3b-fb233f481bef tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:04.828626 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9654f232-c7ec-4e4f-ad3b-fb233f481bef tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:04.829305 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9654f232-c7ec-4e4f-ad3b-fb233f481bef tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:04.964387 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-1a59f6b1-b720-4b96-a511-7d60753eeb48 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05483ff6eec84f78a091b29cfbcf61f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a6720be5fb4de7bcd77cc7ef9d8000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:05.003227 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-1a59f6b1-b720-4b96-a511-7d60753eeb48 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] 10.222.0.46 "GET /compute/v2.1/servers/e04f7a96-62cb-4aae-9612-aa8df88aef61" status: 200 len: 1566 microversion: 2.1 time: 0.418910 Jan 15 20:59:05.004683 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1570/3122] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:04 2022] GET /compute/v2.1/servers/e04f7a96-62cb-4aae-9612-aa8df88aef61 => generated 1566 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:59:05.015859 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-100cf7a5-0a18-4909-92c5-b62c781c3f91 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:05.025012 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-100cf7a5-0a18-4909-92c5-b62c781c3f91 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] [instance: 5e93486c-7c77-4855-85f4-2bc8bcf4832f] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:05.051872 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-100cf7a5-0a18-4909-92c5-b62c781c3f91 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:05.056815 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-100cf7a5-0a18-4909-92c5-b62c781c3f91 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:05.061345 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-100cf7a5-0a18-4909-92c5-b62c781c3f91 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:05.064984 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-100cf7a5-0a18-4909-92c5-b62c781c3f91 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:05.153837 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-9654f232-c7ec-4e4f-ad3b-fb233f481bef tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4986ff02ec54476842aa7c9eaac62ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7902e3c4b947454ea2411fc422568e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:05.163920 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-9654f232-c7ec-4e4f-ad3b-fb233f481bef tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] 10.222.0.46 "GET /compute/v2.1/servers/9a181c6f-84ca-409d-93f3-3a86ba0f1b6d" status: 200 len: 1315 microversion: 2.1 time: 0.350771 Jan 15 20:59:05.172401 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1553/3123] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:04 2022] GET /compute/v2.1/servers/9a181c6f-84ca-409d-93f3-3a86ba0f1b6d => generated 1315 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:59:05.201743 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-215f7c4a-99bb-4fda-b2df-2e9a51d16b5f tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:05.202288 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-215f7c4a-99bb-4fda-b2df-2e9a51d16b5f tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: 67049bcd-1b55-4546-9f51-ab337a3be6be] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:05.220366 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-215f7c4a-99bb-4fda-b2df-2e9a51d16b5f tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:05.220826 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-215f7c4a-99bb-4fda-b2df-2e9a51d16b5f tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:05.221803 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-215f7c4a-99bb-4fda-b2df-2e9a51d16b5f tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:05.222244 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-215f7c4a-99bb-4fda-b2df-2e9a51d16b5f tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:05.269703 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-100cf7a5-0a18-4909-92c5-b62c781c3f91 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f38865f66e433090132a8a09d44774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16b035e629e4eb89850c2871a128781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:05.291410 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-100cf7a5-0a18-4909-92c5-b62c781c3f91 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] 10.222.0.46 "GET /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f" status: 200 len: 1330 microversion: 2.1 time: 0.285027 Jan 15 20:59:05.292027 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1571/3124] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:05 2022] GET /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f => generated 1330 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:59:05.335357 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9583705a-f72f-4dc5-b677-320c9a3e5d5d tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:05.337056 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-9583705a-f72f-4dc5-b677-320c9a3e5d5d tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:05.347804 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9583705a-f72f-4dc5-b677-320c9a3e5d5d tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:05.348263 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9583705a-f72f-4dc5-b677-320c9a3e5d5d tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:05.349101 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9583705a-f72f-4dc5-b677-320c9a3e5d5d tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:05.361912 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9583705a-f72f-4dc5-b677-320c9a3e5d5d tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:05.432391 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-9583705a-f72f-4dc5-b677-320c9a3e5d5d tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action" status: 200 len: 32641 microversion: 2.1 time: 0.099288 Jan 15 20:59:05.434275 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1572/3125] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:59:05 2022] POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action => generated 32641 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 20:59:05.643947 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-215f7c4a-99bb-4fda-b2df-2e9a51d16b5f tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:05.652290 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-215f7c4a-99bb-4fda-b2df-2e9a51d16b5f tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/67049bcd-1b55-4546-9f51-ab337a3be6be" status: 200 len: 1498 microversion: 2.1 time: 0.454216 Jan 15 20:59:05.655253 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1554/3126] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:05 2022] GET /compute/v2.1/servers/67049bcd-1b55-4546-9f51-ab337a3be6be => generated 1498 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:59:05.818655 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-fdd7949a-7d33-43c7-9380-7da2e5d96b22 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:05.821064 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-fdd7949a-7d33-43c7-9380-7da2e5d96b22 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:05.833994 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fdd7949a-7d33-43c7-9380-7da2e5d96b22 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:05.837124 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fdd7949a-7d33-43c7-9380-7da2e5d96b22 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:05.839167 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fdd7949a-7d33-43c7-9380-7da2e5d96b22 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:05.841526 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fdd7949a-7d33-43c7-9380-7da2e5d96b22 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:06.025007 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-25ef5356-2a30-489d-ab11-9871812f0bac tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:06.026082 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-25ef5356-2a30-489d-ab11-9871812f0bac tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] [instance: e04f7a96-62cb-4aae-9612-aa8df88aef61] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:06.032883 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-25ef5356-2a30-489d-ab11-9871812f0bac tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:06.033558 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-25ef5356-2a30-489d-ab11-9871812f0bac tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:06.034637 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-25ef5356-2a30-489d-ab11-9871812f0bac tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:06.035078 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-25ef5356-2a30-489d-ab11-9871812f0bac tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:06.342309 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-fdd7949a-7d33-43c7-9380-7da2e5d96b22 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:06.384067 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-fdd7949a-7d33-43c7-9380-7da2e5d96b22 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:06.384764 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-fdd7949a-7d33-43c7-9380-7da2e5d96b22 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:06.389374 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-fdd7949a-7d33-43c7-9380-7da2e5d96b22 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "GET /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee" status: 200 len: 1879 microversion: 2.42 time: 0.574748 Jan 15 20:59:06.390747 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1573/3127] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:59:05 2022] GET /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee => generated 1879 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:59:06.413527 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d5ebd9ed-e4df-4775-a02b-fba74e800a3e tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:06.415244 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d5ebd9ed-e4df-4775-a02b-fba74e800a3e tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] [instance: 9a181c6f-84ca-409d-93f3-3a86ba0f1b6d] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:06.451198 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d5ebd9ed-e4df-4775-a02b-fba74e800a3e tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:06.452034 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d5ebd9ed-e4df-4775-a02b-fba74e800a3e tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:06.453310 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d5ebd9ed-e4df-4775-a02b-fba74e800a3e tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:06.454602 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d5ebd9ed-e4df-4775-a02b-fba74e800a3e tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:06.981032 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-25ef5356-2a30-489d-ab11-9871812f0bac tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05483ff6eec84f78a091b29cfbcf61f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a6720be5fb4de7bcd77cc7ef9d8000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:06.992737 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-25ef5356-2a30-489d-ab11-9871812f0bac tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] 10.222.0.46 "GET /compute/v2.1/servers/e04f7a96-62cb-4aae-9612-aa8df88aef61" status: 200 len: 1566 microversion: 2.1 time: 0.971651 Jan 15 20:59:06.996929 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1555/3128] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:06 2022] GET /compute/v2.1/servers/e04f7a96-62cb-4aae-9612-aa8df88aef61 => generated 1566 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:59:07.006992 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-91348121-54a6-44da-8c9d-1413cc796971 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:07.013461 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-91348121-54a6-44da-8c9d-1413cc796971 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] [instance: 5e93486c-7c77-4855-85f4-2bc8bcf4832f] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:07.026205 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-91348121-54a6-44da-8c9d-1413cc796971 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:07.029451 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-91348121-54a6-44da-8c9d-1413cc796971 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:07.030563 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-91348121-54a6-44da-8c9d-1413cc796971 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:07.032205 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-91348121-54a6-44da-8c9d-1413cc796971 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:07.156824 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-91348121-54a6-44da-8c9d-1413cc796971 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f38865f66e433090132a8a09d44774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16b035e629e4eb89850c2871a128781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:07.173584 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-91348121-54a6-44da-8c9d-1413cc796971 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] 10.222.0.46 "GET /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f" status: 200 len: 1328 microversion: 2.1 time: 0.175323 Jan 15 20:59:07.184077 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1556/3129] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:06 2022] GET /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f => generated 1328 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:59:07.195293 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4967e98a-d5ef-4915-ab11-585a9dde43a4 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:07.197907 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-4967e98a-d5ef-4915-ab11-585a9dde43a4 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:07.212158 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-d5ebd9ed-e4df-4775-a02b-fba74e800a3e tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4986ff02ec54476842aa7c9eaac62ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7902e3c4b947454ea2411fc422568e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:07.214913 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4967e98a-d5ef-4915-ab11-585a9dde43a4 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:07.217635 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4967e98a-d5ef-4915-ab11-585a9dde43a4 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:07.218543 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4967e98a-d5ef-4915-ab11-585a9dde43a4 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:07.219062 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4967e98a-d5ef-4915-ab11-585a9dde43a4 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:07.228760 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d5ebd9ed-e4df-4775-a02b-fba74e800a3e tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] 10.222.0.46 "GET /compute/v2.1/servers/9a181c6f-84ca-409d-93f3-3a86ba0f1b6d" status: 200 len: 1315 microversion: 2.1 time: 0.830936 Jan 15 20:59:07.239641 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1574/3130] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:06 2022] GET /compute/v2.1/servers/9a181c6f-84ca-409d-93f3-3a86ba0f1b6d => generated 1315 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:59:07.244304 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a0f6274b-a020-4e39-9a86-896b66603b60 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:07.244966 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a0f6274b-a020-4e39-9a86-896b66603b60 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: 67049bcd-1b55-4546-9f51-ab337a3be6be] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:07.274330 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a0f6274b-a020-4e39-9a86-896b66603b60 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:07.275320 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a0f6274b-a020-4e39-9a86-896b66603b60 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:07.278701 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a0f6274b-a020-4e39-9a86-896b66603b60 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:07.279479 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a0f6274b-a020-4e39-9a86-896b66603b60 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:07.300689 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-4967e98a-d5ef-4915-ab11-585a9dde43a4 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action" status: 200 len: 32641 microversion: 2.1 time: 0.114853 Jan 15 20:59:07.301502 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1557/3131] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:59:07 2022] POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action => generated 32641 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:59:07.313253 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-45680356-eedf-4941-aad4-12f884b97c26 req-26b427ba-2a1e-40cb-8917-e0b65aa2b39d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67049bcd-1b55-4546-9f51-ab337a3be6be", "name": "network-vif-deleted", "tag": "1760c48a-43cb-484d-bf8d-1928a9b77428"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:07.317019 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:59:07.317019 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:59:07.334746 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-45680356-eedf-4941-aad4-12f884b97c26 req-26b427ba-2a1e-40cb-8917-e0b65aa2b39d service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:07.341525 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-45680356-eedf-4941-aad4-12f884b97c26 req-26b427ba-2a1e-40cb-8917-e0b65aa2b39d service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:07.343933 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a0f6274b-a020-4e39-9a86-896b66603b60 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:07.345265 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a0f6274b-a020-4e39-9a86-896b66603b60 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:07.346160 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.objects.instance [None req-a0f6274b-a020-4e39-9a86-896b66603b60 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lazy-loading 'fault' on Instance uuid 67049bcd-1b55-4546-9f51-ab337a3be6be {{(pid=129365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 20:59:07.393671 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-45680356-eedf-4941-aad4-12f884b97c26 req-26b427ba-2a1e-40cb-8917-e0b65aa2b39d service nova] Creating event network-vif-deleted:1760c48a-43cb-484d-bf8d-1928a9b77428 for instance 67049bcd-1b55-4546-9f51-ab337a3be6be on nch1-master-1 Jan 15 20:59:07.404637 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-45680356-eedf-4941-aad4-12f884b97c26 req-26b427ba-2a1e-40cb-8917-e0b65aa2b39d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101313 Jan 15 20:59:07.410326 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1558/3132] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:59:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:59:07.422918 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-a0f6274b-a020-4e39-9a86-896b66603b60 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765cbcb4d9c8476494f08b123d1db59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cad90ef72141c2983640133453f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:07.424272 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-eb26e508-2d2c-42ae-be78-10e4596e6125 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:07.425611 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-eb26e508-2d2c-42ae-be78-10e4596e6125 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:07.432464 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-eb26e508-2d2c-42ae-be78-10e4596e6125 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:07.433369 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-eb26e508-2d2c-42ae-be78-10e4596e6125 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:07.434345 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-eb26e508-2d2c-42ae-be78-10e4596e6125 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:07.434930 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-eb26e508-2d2c-42ae-be78-10e4596e6125 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:07.436374 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a0f6274b-a020-4e39-9a86-896b66603b60 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/67049bcd-1b55-4546-9f51-ab337a3be6be" status: 200 len: 1304 microversion: 2.1 time: 0.204223 Jan 15 20:59:07.436995 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1575/3133] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:07 2022] GET /compute/v2.1/servers/67049bcd-1b55-4546-9f51-ab337a3be6be => generated 1304 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:59:07.560713 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-1b616cc7-b5ef-4037-83e9-ed7877942711 req-e6fdd2b0-f6f9-4891-a0ef-d2f61553d74a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a181c6f-84ca-409d-93f3-3a86ba0f1b6d", "tag": "3764e35a-48e0-4620-a874-3fa02f5b2fb2"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:07.563422 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:59:07.563422 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:59:07.572654 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-1b616cc7-b5ef-4037-83e9-ed7877942711 req-e6fdd2b0-f6f9-4891-a0ef-d2f61553d74a service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:07.573707 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-1b616cc7-b5ef-4037-83e9-ed7877942711 req-e6fdd2b0-f6f9-4891-a0ef-d2f61553d74a service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:07.588708 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-1b616cc7-b5ef-4037-83e9-ed7877942711 req-e6fdd2b0-f6f9-4891-a0ef-d2f61553d74a service nova] Creating event network-changed:3764e35a-48e0-4620-a874-3fa02f5b2fb2 for instance 9a181c6f-84ca-409d-93f3-3a86ba0f1b6d on nch1-master-1 Jan 15 20:59:07.596914 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-1b616cc7-b5ef-4037-83e9-ed7877942711 req-e6fdd2b0-f6f9-4891-a0ef-d2f61553d74a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082129 Jan 15 20:59:07.599475 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1576/3134] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:59:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:59:07.693218 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-eb26e508-2d2c-42ae-be78-10e4596e6125 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:07.704816 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-eb26e508-2d2c-42ae-be78-10e4596e6125 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:07.706875 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-eb26e508-2d2c-42ae-be78-10e4596e6125 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:07.708548 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-eb26e508-2d2c-42ae-be78-10e4596e6125 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "GET /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee" status: 200 len: 1879 microversion: 2.42 time: 0.295678 Jan 15 20:59:07.709845 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1559/3135] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:59:07 2022] GET /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee => generated 1879 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:59:08.014738 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-958f3faa-615f-4ef3-aaf7-45e85bb4a5b7 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:08.015637 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-958f3faa-615f-4ef3-aaf7-45e85bb4a5b7 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] [instance: e04f7a96-62cb-4aae-9612-aa8df88aef61] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:08.031201 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-958f3faa-615f-4ef3-aaf7-45e85bb4a5b7 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:08.031677 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-958f3faa-615f-4ef3-aaf7-45e85bb4a5b7 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:08.032741 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-958f3faa-615f-4ef3-aaf7-45e85bb4a5b7 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:08.033911 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-958f3faa-615f-4ef3-aaf7-45e85bb4a5b7 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:08.200584 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e26b8e5b-21ec-48af-99a0-cfdb357beae8 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:08.202142 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e26b8e5b-21ec-48af-99a0-cfdb357beae8 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] [instance: 5e93486c-7c77-4855-85f4-2bc8bcf4832f] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:08.217530 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e26b8e5b-21ec-48af-99a0-cfdb357beae8 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:08.218009 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e26b8e5b-21ec-48af-99a0-cfdb357beae8 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:08.222775 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e26b8e5b-21ec-48af-99a0-cfdb357beae8 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:08.223467 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e26b8e5b-21ec-48af-99a0-cfdb357beae8 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:08.264326 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-958f3faa-615f-4ef3-aaf7-45e85bb4a5b7 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05483ff6eec84f78a091b29cfbcf61f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a6720be5fb4de7bcd77cc7ef9d8000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:08.275504 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-958f3faa-615f-4ef3-aaf7-45e85bb4a5b7 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] 10.222.0.46 "GET /compute/v2.1/servers/e04f7a96-62cb-4aae-9612-aa8df88aef61" status: 200 len: 1566 microversion: 2.1 time: 0.265836 Jan 15 20:59:08.276857 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1577/3136] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:08 2022] GET /compute/v2.1/servers/e04f7a96-62cb-4aae-9612-aa8df88aef61 => generated 1566 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:59:08.457445 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-37312ac2-a391-4074-8e38-e6f4733cf715 tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-7042931", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "networks": [{"uuid": "5567dad2-7b3c-4256-9525-ef4026166298"}]}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:08.481442 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-e26b8e5b-21ec-48af-99a0-cfdb357beae8 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f38865f66e433090132a8a09d44774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16b035e629e4eb89850c2871a128781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:08.489084 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e26b8e5b-21ec-48af-99a0-cfdb357beae8 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] 10.222.0.46 "GET /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f" status: 200 len: 1396 microversion: 2.1 time: 0.292280 Jan 15 20:59:08.502316 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1560/3137] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:08 2022] GET /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f => generated 1396 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:59:08.508308 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-3663e308-cb15-4489-a437-9a28b0b1ec14 tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:08.509159 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-3663e308-cb15-4489-a437-9a28b0b1ec14 tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] [instance: 9a181c6f-84ca-409d-93f3-3a86ba0f1b6d] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:08.525571 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3663e308-cb15-4489-a437-9a28b0b1ec14 tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:08.526026 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3663e308-cb15-4489-a437-9a28b0b1ec14 tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:08.530100 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3663e308-cb15-4489-a437-9a28b0b1ec14 tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:08.530557 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3663e308-cb15-4489-a437-9a28b0b1ec14 tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:08.548712 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.network.neutron [None req-37312ac2-a391-4074-8e38-e6f4733cf715 tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] validate_networks() for [('5567dad2-7b3c-4256-9525-ef4026166298', None, None, None, None, None)] {{(pid=129365) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 20:59:09.166816 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-3663e308-cb15-4489-a437-9a28b0b1ec14 tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4986ff02ec54476842aa7c9eaac62ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7902e3c4b947454ea2411fc422568e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:09.188326 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-3663e308-cb15-4489-a437-9a28b0b1ec14 tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] 10.222.0.46 "GET /compute/v2.1/servers/9a181c6f-84ca-409d-93f3-3a86ba0f1b6d" status: 200 len: 1315 microversion: 2.1 time: 0.681565 Jan 15 20:59:09.197005 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1561/3138] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:08 2022] GET /compute/v2.1/servers/9a181c6f-84ca-409d-93f3-3a86ba0f1b6d => generated 1315 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:59:09.203863 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c25c4850-7d21-485c-bb96-1495c659e377 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:09.206398 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c25c4850-7d21-485c-bb96-1495c659e377 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:09.216702 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c25c4850-7d21-485c-bb96-1495c659e377 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:09.218240 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c25c4850-7d21-485c-bb96-1495c659e377 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:09.219624 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c25c4850-7d21-485c-bb96-1495c659e377 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:09.220549 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c25c4850-7d21-485c-bb96-1495c659e377 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:09.320795 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c25c4850-7d21-485c-bb96-1495c659e377 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action" status: 200 len: 32641 microversion: 2.1 time: 0.116127 Jan 15 20:59:09.321494 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1562/3139] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:59:09 2022] POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action => generated 32641 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:59:09.339901 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-5e128eb0-2aac-45ef-986d-d17fefa6d01b tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:09.340507 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-5e128eb0-2aac-45ef-986d-d17fefa6d01b tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: 67049bcd-1b55-4546-9f51-ab337a3be6be] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:09.348297 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5e128eb0-2aac-45ef-986d-d17fefa6d01b tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:09.348998 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5e128eb0-2aac-45ef-986d-d17fefa6d01b tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:09.350120 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5e128eb0-2aac-45ef-986d-d17fefa6d01b tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:09.350899 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5e128eb0-2aac-45ef-986d-d17fefa6d01b tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:09.373785 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-5e128eb0-2aac-45ef-986d-d17fefa6d01b tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] HTTP exception thrown: Instance 67049bcd-1b55-4546-9f51-ab337a3be6be could not be found. Jan 15 20:59:09.374653 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-5e128eb0-2aac-45ef-986d-d17fefa6d01b tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Returning 404 to user: Instance 67049bcd-1b55-4546-9f51-ab337a3be6be could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:59:09.375655 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-5e128eb0-2aac-45ef-986d-d17fefa6d01b tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/67049bcd-1b55-4546-9f51-ab337a3be6be" status: 404 len: 111 microversion: 2.1 time: 0.053010 Jan 15 20:59:09.376385 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1563/3140] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:09 2022] GET /compute/v2.1/servers/67049bcd-1b55-4546-9f51-ab337a3be6be => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:59:09.387542 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4506d201-b1ba-4110-b21d-172bf25298b1 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:09.388352 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-4506d201-b1ba-4110-b21d-172bf25298b1 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:09.395371 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4506d201-b1ba-4110-b21d-172bf25298b1 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:09.396203 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4506d201-b1ba-4110-b21d-172bf25298b1 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:09.397185 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4506d201-b1ba-4110-b21d-172bf25298b1 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:09.397905 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4506d201-b1ba-4110-b21d-172bf25298b1 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:09.613151 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-37312ac2-a391-4074-8e38-e6f4733cf715 tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] Flavor limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 20:59:09.613744 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-37312ac2-a391-4074-8e38-e6f4733cf715 tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] Image limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 20:59:09.614050 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-37312ac2-a391-4074-8e38-e6f4733cf715 tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] Flavor pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 20:59:09.614769 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-37312ac2-a391-4074-8e38-e6f4733cf715 tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] Image pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 20:59:09.615189 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-37312ac2-a391-4074-8e38-e6f4733cf715 tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 20:59:09.632413 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-37312ac2-a391-4074-8e38-e6f4733cf715 tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:09.633458 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-37312ac2-a391-4074-8e38-e6f4733cf715 tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:09.634685 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-37312ac2-a391-4074-8e38-e6f4733cf715 tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:09.635358 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-37312ac2-a391-4074-8e38-e6f4733cf715 tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:09.659211 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-37312ac2-a391-4074-8e38-e6f4733cf715 tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] Getting quotas for project d976820970ac45138c6bf2da811786c3. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:59:09.668096 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-37312ac2-a391-4074-8e38-e6f4733cf715 tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] Getting quotas for user 2b92cf3d63e14307ac083b6560bdcc49 and project d976820970ac45138c6bf2da811786c3. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:59:09.684949 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-37312ac2-a391-4074-8e38-e6f4733cf715 tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] Going to run 1 instances... {{(pid=129365) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 20:59:09.688565 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-37312ac2-a391-4074-8e38-e6f4733cf715 tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] [instance: 7c93f609-7034-418c-95ac-eb1589a1cb4b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129365) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 20:59:09.720075 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-4506d201-b1ba-4110-b21d-172bf25298b1 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:09.736126 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-4506d201-b1ba-4110-b21d-172bf25298b1 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:09.738274 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-4506d201-b1ba-4110-b21d-172bf25298b1 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:09.739593 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-4506d201-b1ba-4110-b21d-172bf25298b1 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "GET /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee" status: 200 len: 1879 microversion: 2.42 time: 0.362006 Jan 15 20:59:09.740832 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1564/3141] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:59:09 2022] GET /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee => generated 1879 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:59:09.746245 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f5048f85-4938-4678-8d96-c38dfd39eaff tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:09.747164 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f5048f85-4938-4678-8d96-c38dfd39eaff tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] [instance: e04f7a96-62cb-4aae-9612-aa8df88aef61] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:09.761143 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f5048f85-4938-4678-8d96-c38dfd39eaff tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:09.761627 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f5048f85-4938-4678-8d96-c38dfd39eaff tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:09.762894 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f5048f85-4938-4678-8d96-c38dfd39eaff tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:09.763515 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f5048f85-4938-4678-8d96-c38dfd39eaff tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:09.779003 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-37312ac2-a391-4074-8e38-e6f4733cf715 tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.500816 Jan 15 20:59:09.780315 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1578/3142] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 20:59:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1503 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 20:59:09.786506 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3982ced3-8cd8-4d64-84b1-67fa96c32f05 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:09.787230 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-3982ced3-8cd8-4d64-84b1-67fa96c32f05 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: 67049bcd-1b55-4546-9f51-ab337a3be6be] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:09.797496 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3982ced3-8cd8-4d64-84b1-67fa96c32f05 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:09.798153 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3982ced3-8cd8-4d64-84b1-67fa96c32f05 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:09.799109 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3982ced3-8cd8-4d64-84b1-67fa96c32f05 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:09.799684 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3982ced3-8cd8-4d64-84b1-67fa96c32f05 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:09.855463 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-3982ced3-8cd8-4d64-84b1-67fa96c32f05 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] HTTP exception thrown: Instance 67049bcd-1b55-4546-9f51-ab337a3be6be could not be found. Jan 15 20:59:09.856651 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3982ced3-8cd8-4d64-84b1-67fa96c32f05 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Returning 404 to user: Instance 67049bcd-1b55-4546-9f51-ab337a3be6be could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:59:09.857731 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3982ced3-8cd8-4d64-84b1-67fa96c32f05 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "DELETE /compute/v2.1/servers/67049bcd-1b55-4546-9f51-ab337a3be6be" status: 404 len: 111 microversion: 2.1 time: 0.076171 Jan 15 20:59:09.861883 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1579/3143] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 20:59:09 2022] DELETE /compute/v2.1/servers/67049bcd-1b55-4546-9f51-ab337a3be6be => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:59:09.868035 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9f9fd7cb-ab9e-44ad-bc06-9a9f94777fd9 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:09.869620 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-9f9fd7cb-ab9e-44ad-bc06-9a9f94777fd9 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] [instance: 5e93486c-7c77-4855-85f4-2bc8bcf4832f] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:09.876400 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9f9fd7cb-ab9e-44ad-bc06-9a9f94777fd9 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:09.877271 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9f9fd7cb-ab9e-44ad-bc06-9a9f94777fd9 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:09.878978 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9f9fd7cb-ab9e-44ad-bc06-9a9f94777fd9 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:09.879584 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9f9fd7cb-ab9e-44ad-bc06-9a9f94777fd9 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:10.008594 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-f5048f85-4938-4678-8d96-c38dfd39eaff tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05483ff6eec84f78a091b29cfbcf61f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a6720be5fb4de7bcd77cc7ef9d8000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:10.016901 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f5048f85-4938-4678-8d96-c38dfd39eaff tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] 10.222.0.46 "GET /compute/v2.1/servers/e04f7a96-62cb-4aae-9612-aa8df88aef61" status: 200 len: 1566 microversion: 2.1 time: 0.274733 Jan 15 20:59:10.017474 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1565/3144] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:09 2022] GET /compute/v2.1/servers/e04f7a96-62cb-4aae-9612-aa8df88aef61 => generated 1566 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:59:10.037220 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-43009747-71ed-4a09-89e2-72689514d958 tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:10.045361 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-43009747-71ed-4a09-89e2-72689514d958 tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] [instance: 7c93f609-7034-418c-95ac-eb1589a1cb4b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:10.128404 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-43009747-71ed-4a09-89e2-72689514d958 tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b92cf3d63e14307ac083b6560bdcc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd976820970ac45138c6bf2da811786c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:10.138266 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-43009747-71ed-4a09-89e2-72689514d958 tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] 10.222.0.46 "GET /compute/v2.1/servers/7c93f609-7034-418c-95ac-eb1589a1cb4b" status: 200 len: 1222 microversion: 2.1 time: 0.105444 Jan 15 20:59:10.140812 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1566/3145] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:10 2022] GET /compute/v2.1/servers/7c93f609-7034-418c-95ac-eb1589a1cb4b => generated 1222 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:59:10.192131 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-9f9fd7cb-ab9e-44ad-bc06-9a9f94777fd9 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f38865f66e433090132a8a09d44774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16b035e629e4eb89850c2871a128781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:10.203529 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-9f9fd7cb-ab9e-44ad-bc06-9a9f94777fd9 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] 10.222.0.46 "GET /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f" status: 200 len: 1396 microversion: 2.1 time: 0.340267 Jan 15 20:59:10.204788 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1580/3146] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:09 2022] GET /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f => generated 1396 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:59:10.210589 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-eb7c1d0f-5211-48d0-8fbc-235f1304c40e tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:10.212826 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-eb7c1d0f-5211-48d0-8fbc-235f1304c40e tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: 67049bcd-1b55-4546-9f51-ab337a3be6be] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:10.219271 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-eb7c1d0f-5211-48d0-8fbc-235f1304c40e tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:10.220551 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-eb7c1d0f-5211-48d0-8fbc-235f1304c40e tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:10.223158 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-eb7c1d0f-5211-48d0-8fbc-235f1304c40e tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:10.223607 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-eb7c1d0f-5211-48d0-8fbc-235f1304c40e tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:10.251896 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-6bd4cbd1-8870-4a06-87b9-310705d76d38 req-0c4de52e-3c13-4df5-88c1-8957ab6699bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e93486c-7c77-4855-85f4-2bc8bcf4832f", "tag": "93c9ee82-e08e-44b9-a8c0-f6e275b08b7b"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:10.255512 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:59:10.255512 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:59:10.264403 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-eb7c1d0f-5211-48d0-8fbc-235f1304c40e tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] HTTP exception thrown: Instance 67049bcd-1b55-4546-9f51-ab337a3be6be could not be found. Jan 15 20:59:10.265531 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-eb7c1d0f-5211-48d0-8fbc-235f1304c40e tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Returning 404 to user: Instance 67049bcd-1b55-4546-9f51-ab337a3be6be could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:59:10.271067 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-6bd4cbd1-8870-4a06-87b9-310705d76d38 req-0c4de52e-3c13-4df5-88c1-8957ab6699bb service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:10.272136 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-6bd4cbd1-8870-4a06-87b9-310705d76d38 req-0c4de52e-3c13-4df5-88c1-8957ab6699bb service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:10.278514 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-eb7c1d0f-5211-48d0-8fbc-235f1304c40e tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/67049bcd-1b55-4546-9f51-ab337a3be6be" status: 404 len: 111 microversion: 2.1 time: 0.061152 Jan 15 20:59:10.282778 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1581/3147] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:10 2022] GET /compute/v2.1/servers/67049bcd-1b55-4546-9f51-ab337a3be6be => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:59:10.297208 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-74d123be-12bd-47c7-a98d-d6d642e38d43 req-502cef4d-704c-4442-a33d-0cfb401305b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1884dd3f-949c-4df3-a977-3f6f5a204fee", "name": "network-vif-plugged", "status": "completed", "tag": "90ef8468-1684-4743-ae03-c3725fd41a73"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:10.300394 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:59:10.300394 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:59:10.307324 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-6bd4cbd1-8870-4a06-87b9-310705d76d38 req-0c4de52e-3c13-4df5-88c1-8957ab6699bb service nova] Creating event network-changed:93c9ee82-e08e-44b9-a8c0-f6e275b08b7b for instance 5e93486c-7c77-4855-85f4-2bc8bcf4832f on nch2-master-1 Jan 15 20:59:10.310874 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-74d123be-12bd-47c7-a98d-d6d642e38d43 req-502cef4d-704c-4442-a33d-0cfb401305b2 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:10.311581 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-74d123be-12bd-47c7-a98d-d6d642e38d43 req-502cef4d-704c-4442-a33d-0cfb401305b2 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:10.315687 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-6bd4cbd1-8870-4a06-87b9-310705d76d38 req-0c4de52e-3c13-4df5-88c1-8957ab6699bb service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.171864 Jan 15 20:59:10.316628 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1567/3148] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:59:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:59:10.329227 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-74d123be-12bd-47c7-a98d-d6d642e38d43 req-502cef4d-704c-4442-a33d-0cfb401305b2 service nova] Creating event network-vif-plugged:90ef8468-1684-4743-ae03-c3725fd41a73 for instance 1884dd3f-949c-4df3-a977-3f6f5a204fee on nch2-master-1 Jan 15 20:59:10.332510 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-dbd8e240-fb82-4eef-9d5a-a73400074cf8 tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:10.333242 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-dbd8e240-fb82-4eef-9d5a-a73400074cf8 tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] [instance: 9a181c6f-84ca-409d-93f3-3a86ba0f1b6d] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:10.335632 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-74d123be-12bd-47c7-a98d-d6d642e38d43 req-502cef4d-704c-4442-a33d-0cfb401305b2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048398 Jan 15 20:59:10.336663 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1582/3149] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:59:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:59:10.342445 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a48e20ab-72c5-40fe-9740-60523df1cdee tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:10.343353 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a48e20ab-72c5-40fe-9740-60523df1cdee tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: deef57f9-d933-48ad-a051-e782593799bf] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:10.353582 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a48e20ab-72c5-40fe-9740-60523df1cdee tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:10.354361 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a48e20ab-72c5-40fe-9740-60523df1cdee tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:10.359812 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a48e20ab-72c5-40fe-9740-60523df1cdee tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:10.360471 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a48e20ab-72c5-40fe-9740-60523df1cdee tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:10.362426 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dbd8e240-fb82-4eef-9d5a-a73400074cf8 tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:10.363506 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dbd8e240-fb82-4eef-9d5a-a73400074cf8 tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:10.364490 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dbd8e240-fb82-4eef-9d5a-a73400074cf8 tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:10.366969 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dbd8e240-fb82-4eef-9d5a-a73400074cf8 tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:10.379632 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-a48e20ab-72c5-40fe-9740-60523df1cdee tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] HTTP exception thrown: Instance deef57f9-d933-48ad-a051-e782593799bf could not be found. Jan 15 20:59:10.380408 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a48e20ab-72c5-40fe-9740-60523df1cdee tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Returning 404 to user: Instance deef57f9-d933-48ad-a051-e782593799bf could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:59:10.381462 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a48e20ab-72c5-40fe-9740-60523df1cdee tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "DELETE /compute/v2.1/servers/deef57f9-d933-48ad-a051-e782593799bf" status: 404 len: 111 microversion: 2.1 time: 0.043408 Jan 15 20:59:10.386476 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1583/3150] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 20:59:10 2022] DELETE /compute/v2.1/servers/deef57f9-d933-48ad-a051-e782593799bf => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:59:10.391327 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a5d08e82-da4e-4e33-9b9a-f82771077fb2 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:10.392385 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a5d08e82-da4e-4e33-9b9a-f82771077fb2 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:10.400691 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a5d08e82-da4e-4e33-9b9a-f82771077fb2 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:10.401190 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a5d08e82-da4e-4e33-9b9a-f82771077fb2 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:10.401991 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a5d08e82-da4e-4e33-9b9a-f82771077fb2 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:10.402424 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a5d08e82-da4e-4e33-9b9a-f82771077fb2 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:10.450750 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a5d08e82-da4e-4e33-9b9a-f82771077fb2 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action" status: 200 len: 32641 microversion: 2.1 time: 0.062770 Jan 15 20:59:10.452001 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1584/3151] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:59:10 2022] POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action => generated 32641 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:59:10.470977 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-cb3ebc29-36e4-4d04-8f89-67604fc189db tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:10.473244 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-cb3ebc29-36e4-4d04-8f89-67604fc189db tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: deef57f9-d933-48ad-a051-e782593799bf] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:10.486781 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cb3ebc29-36e4-4d04-8f89-67604fc189db tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:10.487872 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cb3ebc29-36e4-4d04-8f89-67604fc189db tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:10.488852 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cb3ebc29-36e4-4d04-8f89-67604fc189db tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:10.489441 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cb3ebc29-36e4-4d04-8f89-67604fc189db tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:10.509420 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-cb3ebc29-36e4-4d04-8f89-67604fc189db tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] HTTP exception thrown: Instance deef57f9-d933-48ad-a051-e782593799bf could not be found. Jan 15 20:59:10.510534 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-cb3ebc29-36e4-4d04-8f89-67604fc189db tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Returning 404 to user: Instance deef57f9-d933-48ad-a051-e782593799bf could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:59:10.511811 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-cb3ebc29-36e4-4d04-8f89-67604fc189db tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/deef57f9-d933-48ad-a051-e782593799bf" status: 404 len: 111 microversion: 2.1 time: 0.059280 Jan 15 20:59:10.513026 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1585/3152] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:10 2022] GET /compute/v2.1/servers/deef57f9-d933-48ad-a051-e782593799bf => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:59:10.521743 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8d418c8c-a942-4af3-8f7d-b51b662f97c1 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:10.523176 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-8d418c8c-a942-4af3-8f7d-b51b662f97c1 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: 0874eafa-ffa2-4257-b6c5-66e4bef983db] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:10.531038 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8d418c8c-a942-4af3-8f7d-b51b662f97c1 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:10.532055 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8d418c8c-a942-4af3-8f7d-b51b662f97c1 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:10.533126 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8d418c8c-a942-4af3-8f7d-b51b662f97c1 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:10.533786 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8d418c8c-a942-4af3-8f7d-b51b662f97c1 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:10.551632 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-8d418c8c-a942-4af3-8f7d-b51b662f97c1 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] HTTP exception thrown: Instance 0874eafa-ffa2-4257-b6c5-66e4bef983db could not be found. Jan 15 20:59:10.552343 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8d418c8c-a942-4af3-8f7d-b51b662f97c1 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Returning 404 to user: Instance 0874eafa-ffa2-4257-b6c5-66e4bef983db could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:59:10.553309 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-8d418c8c-a942-4af3-8f7d-b51b662f97c1 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "DELETE /compute/v2.1/servers/0874eafa-ffa2-4257-b6c5-66e4bef983db" status: 404 len: 111 microversion: 2.1 time: 0.036489 Jan 15 20:59:10.557549 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1586/3153] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 20:59:10 2022] DELETE /compute/v2.1/servers/0874eafa-ffa2-4257-b6c5-66e4bef983db => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 15 20:59:10.576867 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-7b1a2a14-11c6-478f-93db-6193e499a110 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:10.577575 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-7b1a2a14-11c6-478f-93db-6193e499a110 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: 0874eafa-ffa2-4257-b6c5-66e4bef983db] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:10.594813 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7b1a2a14-11c6-478f-93db-6193e499a110 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:10.595311 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7b1a2a14-11c6-478f-93db-6193e499a110 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:10.596148 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7b1a2a14-11c6-478f-93db-6193e499a110 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:10.596661 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7b1a2a14-11c6-478f-93db-6193e499a110 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:10.634175 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-7b1a2a14-11c6-478f-93db-6193e499a110 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] HTTP exception thrown: Instance 0874eafa-ffa2-4257-b6c5-66e4bef983db could not be found. Jan 15 20:59:10.634798 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-7b1a2a14-11c6-478f-93db-6193e499a110 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Returning 404 to user: Instance 0874eafa-ffa2-4257-b6c5-66e4bef983db could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:59:10.640854 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-7b1a2a14-11c6-478f-93db-6193e499a110 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/0874eafa-ffa2-4257-b6c5-66e4bef983db" status: 404 len: 111 microversion: 2.1 time: 0.079408 Jan 15 20:59:10.642091 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1587/3154] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:10 2022] GET /compute/v2.1/servers/0874eafa-ffa2-4257-b6c5-66e4bef983db => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:59:10.650462 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-04653c19-3791-49db-a690-489ee6c2f70f tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:10.652644 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-04653c19-3791-49db-a690-489ee6c2f70f tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: ae964f06-d93f-4029-9565-6f3d8d280d23] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:10.661348 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-04653c19-3791-49db-a690-489ee6c2f70f tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:10.662051 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-04653c19-3791-49db-a690-489ee6c2f70f tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:10.663699 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-04653c19-3791-49db-a690-489ee6c2f70f tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:10.664304 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-04653c19-3791-49db-a690-489ee6c2f70f tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:10.687686 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-dbd8e240-fb82-4eef-9d5a-a73400074cf8 tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4986ff02ec54476842aa7c9eaac62ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7902e3c4b947454ea2411fc422568e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:10.691880 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-04653c19-3791-49db-a690-489ee6c2f70f tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] HTTP exception thrown: Instance ae964f06-d93f-4029-9565-6f3d8d280d23 could not be found. Jan 15 20:59:10.692509 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-04653c19-3791-49db-a690-489ee6c2f70f tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Returning 404 to user: Instance ae964f06-d93f-4029-9565-6f3d8d280d23 could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:59:10.695248 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-04653c19-3791-49db-a690-489ee6c2f70f tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "DELETE /compute/v2.1/servers/ae964f06-d93f-4029-9565-6f3d8d280d23" status: 404 len: 111 microversion: 2.1 time: 0.048844 Jan 15 20:59:10.701378 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1588/3155] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 20:59:10 2022] DELETE /compute/v2.1/servers/ae964f06-d93f-4029-9565-6f3d8d280d23 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:59:10.703535 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-dbd8e240-fb82-4eef-9d5a-a73400074cf8 tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] 10.222.0.46 "GET /compute/v2.1/servers/9a181c6f-84ca-409d-93f3-3a86ba0f1b6d" status: 200 len: 1315 microversion: 2.1 time: 0.374831 Jan 15 20:59:10.708024 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1568/3156] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:10 2022] GET /compute/v2.1/servers/9a181c6f-84ca-409d-93f3-3a86ba0f1b6d => generated 1315 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:59:10.708946 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a05ee7c1-70ad-4fbe-b465-a2f285d8fb54 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:10.709800 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a05ee7c1-70ad-4fbe-b465-a2f285d8fb54 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: ae964f06-d93f-4029-9565-6f3d8d280d23] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:10.723256 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a05ee7c1-70ad-4fbe-b465-a2f285d8fb54 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:10.723810 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a05ee7c1-70ad-4fbe-b465-a2f285d8fb54 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:10.724727 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a05ee7c1-70ad-4fbe-b465-a2f285d8fb54 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:10.726056 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a05ee7c1-70ad-4fbe-b465-a2f285d8fb54 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:10.759306 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-665715af-b77b-4c22-b7b6-44a1e51bf27f tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:10.760084 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-665715af-b77b-4c22-b7b6-44a1e51bf27f tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:10.774891 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-a05ee7c1-70ad-4fbe-b465-a2f285d8fb54 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] HTTP exception thrown: Instance ae964f06-d93f-4029-9565-6f3d8d280d23 could not be found. Jan 15 20:59:10.775500 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a05ee7c1-70ad-4fbe-b465-a2f285d8fb54 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Returning 404 to user: Instance ae964f06-d93f-4029-9565-6f3d8d280d23 could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:59:10.776361 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a05ee7c1-70ad-4fbe-b465-a2f285d8fb54 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/ae964f06-d93f-4029-9565-6f3d8d280d23" status: 404 len: 111 microversion: 2.1 time: 0.073533 Jan 15 20:59:10.776983 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1589/3157] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:10 2022] GET /compute/v2.1/servers/ae964f06-d93f-4029-9565-6f3d8d280d23 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:59:10.777290 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-665715af-b77b-4c22-b7b6-44a1e51bf27f tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:10.778176 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-665715af-b77b-4c22-b7b6-44a1e51bf27f tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:10.780283 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-665715af-b77b-4c22-b7b6-44a1e51bf27f tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:10.783948 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-665715af-b77b-4c22-b7b6-44a1e51bf27f tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:10.787297 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-33b1e7d2-6881-4e55-acc5-904b6b910326 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:10.795685 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-33b1e7d2-6881-4e55-acc5-904b6b910326 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: 79c7721a-61b2-4405-955b-a7ab2f7c9300] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:10.815067 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-33b1e7d2-6881-4e55-acc5-904b6b910326 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] HTTP exception thrown: Instance 79c7721a-61b2-4405-955b-a7ab2f7c9300 could not be found. Jan 15 20:59:10.815908 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-33b1e7d2-6881-4e55-acc5-904b6b910326 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Returning 404 to user: Instance 79c7721a-61b2-4405-955b-a7ab2f7c9300 could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:59:10.817078 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-33b1e7d2-6881-4e55-acc5-904b6b910326 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "DELETE /compute/v2.1/servers/79c7721a-61b2-4405-955b-a7ab2f7c9300" status: 404 len: 111 microversion: 2.1 time: 0.035489 Jan 15 20:59:10.818776 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1590/3158] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 20:59:10 2022] DELETE /compute/v2.1/servers/79c7721a-61b2-4405-955b-a7ab2f7c9300 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:59:10.827227 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2a4cc584-0a31-4a89-b3c8-500de90bd87c tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:10.829807 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-2a4cc584-0a31-4a89-b3c8-500de90bd87c tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: 79c7721a-61b2-4405-955b-a7ab2f7c9300] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:10.846401 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-2a4cc584-0a31-4a89-b3c8-500de90bd87c tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] HTTP exception thrown: Instance 79c7721a-61b2-4405-955b-a7ab2f7c9300 could not be found. Jan 15 20:59:10.847396 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2a4cc584-0a31-4a89-b3c8-500de90bd87c tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Returning 404 to user: Instance 79c7721a-61b2-4405-955b-a7ab2f7c9300 could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:59:10.848430 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2a4cc584-0a31-4a89-b3c8-500de90bd87c tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/79c7721a-61b2-4405-955b-a7ab2f7c9300" status: 404 len: 111 microversion: 2.1 time: 0.025194 Jan 15 20:59:10.852200 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1591/3159] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:10 2022] GET /compute/v2.1/servers/79c7721a-61b2-4405-955b-a7ab2f7c9300 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:59:11.039408 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-cf81776a-2d4a-4653-8a93-b589a9ce0b35 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:11.040467 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-cf81776a-2d4a-4653-8a93-b589a9ce0b35 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] [instance: e04f7a96-62cb-4aae-9612-aa8df88aef61] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:11.051040 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cf81776a-2d4a-4653-8a93-b589a9ce0b35 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:11.051826 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cf81776a-2d4a-4653-8a93-b589a9ce0b35 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:11.053530 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cf81776a-2d4a-4653-8a93-b589a9ce0b35 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:11.055392 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cf81776a-2d4a-4653-8a93-b589a9ce0b35 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:11.317205 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-665715af-b77b-4c22-b7b6-44a1e51bf27f tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:11.337797 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-665715af-b77b-4c22-b7b6-44a1e51bf27f tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:11.341251 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-665715af-b77b-4c22-b7b6-44a1e51bf27f tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:11.360159 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-665715af-b77b-4c22-b7b6-44a1e51bf27f tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "GET /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee" status: 200 len: 1879 microversion: 2.42 time: 0.591914 Jan 15 20:59:11.362197 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1569/3160] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:59:10 2022] GET /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee => generated 1879 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 15 20:59:11.375051 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-40365174-22f9-411c-84b3-12f775de2584 tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:11.376272 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-40365174-22f9-411c-84b3-12f775de2584 tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] [instance: 7c93f609-7034-418c-95ac-eb1589a1cb4b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:11.384646 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-40365174-22f9-411c-84b3-12f775de2584 tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:11.385370 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-40365174-22f9-411c-84b3-12f775de2584 tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:11.386341 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-40365174-22f9-411c-84b3-12f775de2584 tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:11.387672 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-40365174-22f9-411c-84b3-12f775de2584 tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:11.512264 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-40365174-22f9-411c-84b3-12f775de2584 tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b92cf3d63e14307ac083b6560bdcc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd976820970ac45138c6bf2da811786c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:11.513657 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-cf81776a-2d4a-4653-8a93-b589a9ce0b35 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05483ff6eec84f78a091b29cfbcf61f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a6720be5fb4de7bcd77cc7ef9d8000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:11.522389 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-cf81776a-2d4a-4653-8a93-b589a9ce0b35 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] 10.222.0.46 "GET /compute/v2.1/servers/e04f7a96-62cb-4aae-9612-aa8df88aef61" status: 200 len: 1566 microversion: 2.1 time: 0.491492 Jan 15 20:59:11.523749 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1592/3161] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:11 2022] GET /compute/v2.1/servers/e04f7a96-62cb-4aae-9612-aa8df88aef61 => generated 1566 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:59:11.528080 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e686ad90-a47f-4d98-8a5b-f29439d4e0a8 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:11.528813 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e686ad90-a47f-4d98-8a5b-f29439d4e0a8 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] [instance: 5e93486c-7c77-4855-85f4-2bc8bcf4832f] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:11.535455 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e686ad90-a47f-4d98-8a5b-f29439d4e0a8 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:11.535904 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e686ad90-a47f-4d98-8a5b-f29439d4e0a8 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:11.537055 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e686ad90-a47f-4d98-8a5b-f29439d4e0a8 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:11.537495 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e686ad90-a47f-4d98-8a5b-f29439d4e0a8 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:11.547421 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-40365174-22f9-411c-84b3-12f775de2584 tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] 10.222.0.46 "GET /compute/v2.1/servers/7c93f609-7034-418c-95ac-eb1589a1cb4b" status: 200 len: 1282 microversion: 2.1 time: 0.181249 Jan 15 20:59:11.560569 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1570/3162] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:11 2022] GET /compute/v2.1/servers/7c93f609-7034-418c-95ac-eb1589a1cb4b => generated 1282 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:59:11.573211 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e12446af-3598-4258-b60f-8a7590f3f06e tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:11.574211 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e12446af-3598-4258-b60f-8a7590f3f06e tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:11.588393 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e12446af-3598-4258-b60f-8a7590f3f06e tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:11.591519 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e12446af-3598-4258-b60f-8a7590f3f06e tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:11.596953 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e12446af-3598-4258-b60f-8a7590f3f06e tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:11.597679 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e12446af-3598-4258-b60f-8a7590f3f06e tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:11.665014 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e12446af-3598-4258-b60f-8a7590f3f06e tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action" status: 200 len: 32641 microversion: 2.1 time: 0.096625 Jan 15 20:59:11.666934 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1571/3163] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:59:11 2022] POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action => generated 32641 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:59:11.724787 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-061bec8c-a15c-4ff0-9ce2-2ccd29dd8a5e tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:11.726697 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-061bec8c-a15c-4ff0-9ce2-2ccd29dd8a5e tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] [instance: 9a181c6f-84ca-409d-93f3-3a86ba0f1b6d] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:11.736660 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-061bec8c-a15c-4ff0-9ce2-2ccd29dd8a5e tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:11.737406 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-061bec8c-a15c-4ff0-9ce2-2ccd29dd8a5e tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:11.738496 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-061bec8c-a15c-4ff0-9ce2-2ccd29dd8a5e tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:11.739686 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-061bec8c-a15c-4ff0-9ce2-2ccd29dd8a5e tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:11.746006 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-e686ad90-a47f-4d98-8a5b-f29439d4e0a8 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f38865f66e433090132a8a09d44774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16b035e629e4eb89850c2871a128781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:11.757925 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e686ad90-a47f-4d98-8a5b-f29439d4e0a8 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] 10.222.0.46 "GET /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f" status: 200 len: 1396 microversion: 2.1 time: 0.232497 Jan 15 20:59:11.758983 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1593/3164] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:11 2022] GET /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f => generated 1396 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:59:12.010783 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-061bec8c-a15c-4ff0-9ce2-2ccd29dd8a5e tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4986ff02ec54476842aa7c9eaac62ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7902e3c4b947454ea2411fc422568e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:12.022961 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-061bec8c-a15c-4ff0-9ce2-2ccd29dd8a5e tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] 10.222.0.46 "GET /compute/v2.1/servers/9a181c6f-84ca-409d-93f3-3a86ba0f1b6d" status: 200 len: 1315 microversion: 2.1 time: 0.302009 Jan 15 20:59:12.024004 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1572/3165] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:11 2022] GET /compute/v2.1/servers/9a181c6f-84ca-409d-93f3-3a86ba0f1b6d => generated 1315 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:59:12.140444 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-53556f96-df95-4af8-b28e-759df2a1f6d6 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:12.140917 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-53556f96-df95-4af8-b28e-759df2a1f6d6 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: bdd7983d-e38b-4ca2-8b65-295d134baf35] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:12.147889 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-53556f96-df95-4af8-b28e-759df2a1f6d6 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:12.148341 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-53556f96-df95-4af8-b28e-759df2a1f6d6 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:12.149194 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-53556f96-df95-4af8-b28e-759df2a1f6d6 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:12.149625 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-53556f96-df95-4af8-b28e-759df2a1f6d6 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:12.163946 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-53556f96-df95-4af8-b28e-759df2a1f6d6 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] HTTP exception thrown: Instance bdd7983d-e38b-4ca2-8b65-295d134baf35 could not be found. Jan 15 20:59:12.164637 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-53556f96-df95-4af8-b28e-759df2a1f6d6 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Returning 404 to user: Instance bdd7983d-e38b-4ca2-8b65-295d134baf35 could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:59:12.171902 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-53556f96-df95-4af8-b28e-759df2a1f6d6 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "DELETE /compute/v2.1/servers/bdd7983d-e38b-4ca2-8b65-295d134baf35" status: 404 len: 111 microversion: 2.1 time: 0.036093 Jan 15 20:59:12.172768 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1594/3166] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 20:59:12 2022] DELETE /compute/v2.1/servers/bdd7983d-e38b-4ca2-8b65-295d134baf35 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:59:12.184315 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-75a19403-4985-4ea2-8adb-17efffbfd783 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:12.185212 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-75a19403-4985-4ea2-8adb-17efffbfd783 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: bdd7983d-e38b-4ca2-8b65-295d134baf35] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:12.193141 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-75a19403-4985-4ea2-8adb-17efffbfd783 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:12.193810 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-75a19403-4985-4ea2-8adb-17efffbfd783 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:12.195404 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-75a19403-4985-4ea2-8adb-17efffbfd783 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:12.195988 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-75a19403-4985-4ea2-8adb-17efffbfd783 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:12.212536 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-75a19403-4985-4ea2-8adb-17efffbfd783 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] HTTP exception thrown: Instance bdd7983d-e38b-4ca2-8b65-295d134baf35 could not be found. Jan 15 20:59:12.213169 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-75a19403-4985-4ea2-8adb-17efffbfd783 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Returning 404 to user: Instance bdd7983d-e38b-4ca2-8b65-295d134baf35 could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:59:12.214157 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-75a19403-4985-4ea2-8adb-17efffbfd783 tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/bdd7983d-e38b-4ca2-8b65-295d134baf35" status: 404 len: 111 microversion: 2.1 time: 0.036291 Jan 15 20:59:12.215172 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1573/3167] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:12 2022] GET /compute/v2.1/servers/bdd7983d-e38b-4ca2-8b65-295d134baf35 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:59:12.223739 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3dc529a1-cf1c-466e-8242-80d852b949ac tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:12.224290 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-3dc529a1-cf1c-466e-8242-80d852b949ac tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: 427db3d9-56d4-49ff-a4f1-28302d78f56a] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:12.232922 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3dc529a1-cf1c-466e-8242-80d852b949ac tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:12.233396 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3dc529a1-cf1c-466e-8242-80d852b949ac tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:12.234392 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3dc529a1-cf1c-466e-8242-80d852b949ac tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:12.234847 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3dc529a1-cf1c-466e-8242-80d852b949ac tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:12.268922 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-3dc529a1-cf1c-466e-8242-80d852b949ac tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] HTTP exception thrown: Instance 427db3d9-56d4-49ff-a4f1-28302d78f56a could not be found. Jan 15 20:59:12.269829 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3dc529a1-cf1c-466e-8242-80d852b949ac tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Returning 404 to user: Instance 427db3d9-56d4-49ff-a4f1-28302d78f56a could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:59:12.271741 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3dc529a1-cf1c-466e-8242-80d852b949ac tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "DELETE /compute/v2.1/servers/427db3d9-56d4-49ff-a4f1-28302d78f56a" status: 404 len: 111 microversion: 2.1 time: 0.052199 Jan 15 20:59:12.277908 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1595/3168] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 20:59:12 2022] DELETE /compute/v2.1/servers/427db3d9-56d4-49ff-a4f1-28302d78f56a => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:59:12.286754 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1fb485d9-64ea-46e1-8e9d-efdf9708816c tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:12.288487 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-1fb485d9-64ea-46e1-8e9d-efdf9708816c tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] [instance: 427db3d9-56d4-49ff-a4f1-28302d78f56a] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:12.303396 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1fb485d9-64ea-46e1-8e9d-efdf9708816c tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:12.304714 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1fb485d9-64ea-46e1-8e9d-efdf9708816c tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:12.305930 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1fb485d9-64ea-46e1-8e9d-efdf9708816c tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:12.306552 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1fb485d9-64ea-46e1-8e9d-efdf9708816c tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:12.327557 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-1fb485d9-64ea-46e1-8e9d-efdf9708816c tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] HTTP exception thrown: Instance 427db3d9-56d4-49ff-a4f1-28302d78f56a could not be found. Jan 15 20:59:12.329074 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1fb485d9-64ea-46e1-8e9d-efdf9708816c tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] Returning 404 to user: Instance 427db3d9-56d4-49ff-a4f1-28302d78f56a could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:59:12.330066 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-1fb485d9-64ea-46e1-8e9d-efdf9708816c tempest-DeleteServersTestJSON-2005428209 tempest-DeleteServersTestJSON-2005428209-project] 10.222.0.46 "GET /compute/v2.1/servers/427db3d9-56d4-49ff-a4f1-28302d78f56a" status: 404 len: 111 microversion: 2.1 time: 0.049298 Jan 15 20:59:12.336906 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1574/3169] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:12 2022] GET /compute/v2.1/servers/427db3d9-56d4-49ff-a4f1-28302d78f56a => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:59:12.382307 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a91d7e0c-4ac1-4443-8639-f7b67a399839 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:12.383102 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a91d7e0c-4ac1-4443-8639-f7b67a399839 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:12.389976 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a91d7e0c-4ac1-4443-8639-f7b67a399839 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:12.396261 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a91d7e0c-4ac1-4443-8639-f7b67a399839 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:12.397559 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a91d7e0c-4ac1-4443-8639-f7b67a399839 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:12.400381 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a91d7e0c-4ac1-4443-8639-f7b67a399839 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:12.406929 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-f27e3c31-7eb8-48fc-827d-ddd9fe43ba3d req-10534cab-2a77-43d7-ac89-9fecd9d53774 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1884dd3f-949c-4df3-a977-3f6f5a204fee", "name": "network-vif-plugged", "status": "completed", "tag": "e3bdb69c-2e57-497e-80bb-2b7d539e87f7"}, {"server_uuid": "1884dd3f-949c-4df3-a977-3f6f5a204fee", "name": "network-vif-plugged", "status": "completed", "tag": "897218f9-2c52-48ce-af2d-b6ceececef93"}, {"server_uuid": "1884dd3f-949c-4df3-a977-3f6f5a204fee", "name": "network-vif-plugged", "status": "completed", "tag": "5a70acfe-3b12-4c47-a821-8552633f0121"}, {"server_uuid": "1884dd3f-949c-4df3-a977-3f6f5a204fee", "name": "network-vif-plugged", "status": "completed", "tag": "cddf88bd-8f9f-40f9-9dfd-4dad717d9fbf"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:12.409118 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:59:12.409118 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:59:12.433041 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-f27e3c31-7eb8-48fc-827d-ddd9fe43ba3d req-10534cab-2a77-43d7-ac89-9fecd9d53774 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:12.433659 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-f27e3c31-7eb8-48fc-827d-ddd9fe43ba3d req-10534cab-2a77-43d7-ac89-9fecd9d53774 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:12.454000 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-f27e3c31-7eb8-48fc-827d-ddd9fe43ba3d req-10534cab-2a77-43d7-ac89-9fecd9d53774 service nova] Creating event network-vif-plugged:e3bdb69c-2e57-497e-80bb-2b7d539e87f7 for instance 1884dd3f-949c-4df3-a977-3f6f5a204fee on nch2-master-1 Jan 15 20:59:12.454679 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-f27e3c31-7eb8-48fc-827d-ddd9fe43ba3d req-10534cab-2a77-43d7-ac89-9fecd9d53774 service nova] Creating event network-vif-plugged:897218f9-2c52-48ce-af2d-b6ceececef93 for instance 1884dd3f-949c-4df3-a977-3f6f5a204fee on nch2-master-1 Jan 15 20:59:12.455350 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-f27e3c31-7eb8-48fc-827d-ddd9fe43ba3d req-10534cab-2a77-43d7-ac89-9fecd9d53774 service nova] Creating event network-vif-plugged:5a70acfe-3b12-4c47-a821-8552633f0121 for instance 1884dd3f-949c-4df3-a977-3f6f5a204fee on nch2-master-1 Jan 15 20:59:12.456014 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-f27e3c31-7eb8-48fc-827d-ddd9fe43ba3d req-10534cab-2a77-43d7-ac89-9fecd9d53774 service nova] Creating event network-vif-plugged:cddf88bd-8f9f-40f9-9dfd-4dad717d9fbf for instance 1884dd3f-949c-4df3-a977-3f6f5a204fee on nch2-master-1 Jan 15 20:59:12.463000 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-f27e3c31-7eb8-48fc-827d-ddd9fe43ba3d req-10534cab-2a77-43d7-ac89-9fecd9d53774 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.059801 Jan 15 20:59:12.464118 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1575/3170] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:59:12 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 20:59:12.552218 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e7469531-f931-4e93-b6c2-113d2b086494 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:12.555209 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e7469531-f931-4e93-b6c2-113d2b086494 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] [instance: e04f7a96-62cb-4aae-9612-aa8df88aef61] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:12.566720 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e7469531-f931-4e93-b6c2-113d2b086494 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:12.567521 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e7469531-f931-4e93-b6c2-113d2b086494 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:12.568823 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e7469531-f931-4e93-b6c2-113d2b086494 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:12.572071 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e7469531-f931-4e93-b6c2-113d2b086494 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:12.823735 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-a91d7e0c-4ac1-4443-8639-f7b67a399839 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:12.864052 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-a91d7e0c-4ac1-4443-8639-f7b67a399839 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:12.868043 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-a91d7e0c-4ac1-4443-8639-f7b67a399839 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:12.871798 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a91d7e0c-4ac1-4443-8639-f7b67a399839 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "GET /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee" status: 200 len: 1879 microversion: 2.42 time: 0.494250 Jan 15 20:59:12.874031 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1596/3171] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:59:12 2022] GET /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee => generated 1879 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:59:12.892074 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-e7469531-f931-4e93-b6c2-113d2b086494 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05483ff6eec84f78a091b29cfbcf61f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a6720be5fb4de7bcd77cc7ef9d8000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:12.902126 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e7469531-f931-4e93-b6c2-113d2b086494 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] 10.222.0.46 "GET /compute/v2.1/servers/e04f7a96-62cb-4aae-9612-aa8df88aef61" status: 200 len: 1546 microversion: 2.1 time: 0.360912 Jan 15 20:59:12.905583 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3618216c-7813-4e0d-9b32-c49edb2fec29 tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:12.905907 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1576/3172] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:12 2022] GET /compute/v2.1/servers/e04f7a96-62cb-4aae-9612-aa8df88aef61 => generated 1546 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:59:12.906807 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-3618216c-7813-4e0d-9b32-c49edb2fec29 tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] [instance: 7c93f609-7034-418c-95ac-eb1589a1cb4b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:12.914557 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-db150c9c-d596-4db6-9460-3e9ec7fa8f10 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:12.915398 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-db150c9c-d596-4db6-9460-3e9ec7fa8f10 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:12.931585 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-db150c9c-d596-4db6-9460-3e9ec7fa8f10 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:12.936532 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-db150c9c-d596-4db6-9460-3e9ec7fa8f10 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:12.936727 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3618216c-7813-4e0d-9b32-c49edb2fec29 tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:12.937520 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3618216c-7813-4e0d-9b32-c49edb2fec29 tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:12.937645 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-db150c9c-d596-4db6-9460-3e9ec7fa8f10 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:12.938049 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-db150c9c-d596-4db6-9460-3e9ec7fa8f10 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:12.938730 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3618216c-7813-4e0d-9b32-c49edb2fec29 tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:12.939325 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3618216c-7813-4e0d-9b32-c49edb2fec29 tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:13.014751 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-db150c9c-d596-4db6-9460-3e9ec7fa8f10 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action" status: 200 len: 32641 microversion: 2.1 time: 0.106543 Jan 15 20:59:13.015426 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1577/3173] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:59:12 2022] POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action => generated 32641 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:59:13.026157 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b4057ad4-80f5-435d-aabc-e3752afa1d6d tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:13.034041 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b4057ad4-80f5-435d-aabc-e3752afa1d6d tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] [instance: 5e93486c-7c77-4855-85f4-2bc8bcf4832f] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:13.051048 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b4057ad4-80f5-435d-aabc-e3752afa1d6d tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:13.051813 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b4057ad4-80f5-435d-aabc-e3752afa1d6d tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:13.052660 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b4057ad4-80f5-435d-aabc-e3752afa1d6d tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:13.053282 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b4057ad4-80f5-435d-aabc-e3752afa1d6d tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:13.107342 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-3618216c-7813-4e0d-9b32-c49edb2fec29 tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b92cf3d63e14307ac083b6560bdcc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd976820970ac45138c6bf2da811786c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:13.117573 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3618216c-7813-4e0d-9b32-c49edb2fec29 tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] 10.222.0.46 "GET /compute/v2.1/servers/7c93f609-7034-418c-95ac-eb1589a1cb4b" status: 200 len: 1280 microversion: 2.1 time: 0.240708 Jan 15 20:59:13.139252 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1597/3174] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:12 2022] GET /compute/v2.1/servers/7c93f609-7034-418c-95ac-eb1589a1cb4b => generated 1280 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:59:13.149135 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e5f385b8-e6f3-40d1-9e62-ae518e2836e3 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:13.150357 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e5f385b8-e6f3-40d1-9e62-ae518e2836e3 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] [instance: e04f7a96-62cb-4aae-9612-aa8df88aef61] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:13.160875 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e5f385b8-e6f3-40d1-9e62-ae518e2836e3 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:13.161701 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e5f385b8-e6f3-40d1-9e62-ae518e2836e3 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:13.162725 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e5f385b8-e6f3-40d1-9e62-ae518e2836e3 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:13.163662 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e5f385b8-e6f3-40d1-9e62-ae518e2836e3 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:13.277912 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-e5f385b8-e6f3-40d1-9e62-ae518e2836e3 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] HTTP exception thrown: Cannot 'detach_volume' instance e04f7a96-62cb-4aae-9612-aa8df88aef61 while it is in vm_state rescued Jan 15 20:59:13.279257 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e5f385b8-e6f3-40d1-9e62-ae518e2836e3 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Returning 409 to user: Cannot 'detach_volume' instance e04f7a96-62cb-4aae-9612-aa8df88aef61 while it is in vm_state rescued {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:59:13.280608 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e5f385b8-e6f3-40d1-9e62-ae518e2836e3 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] 10.222.0.46 "DELETE /compute/v2.1/servers/e04f7a96-62cb-4aae-9612-aa8df88aef61/os-volume_attachments/ba3df6f7-3423-44f7-84bf-6545c2261c44" status: 409 len: 152 microversion: 2.1 time: 0.140008 Jan 15 20:59:13.282096 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1598/3175] 10.222.0.46 () {58 vars in 1415 bytes} [Sat Jan 15 20:59:13 2022] DELETE /compute/v2.1/servers/e04f7a96-62cb-4aae-9612-aa8df88aef61/os-volume_attachments/ba3df6f7-3423-44f7-84bf-6545c2261c44 => generated 152 bytes in 142 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jan 15 20:59:13.292679 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-beb0ce6f-8167-4283-b3d6-c59c33c45b78 tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:13.293817 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-beb0ce6f-8167-4283-b3d6-c59c33c45b78 tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] [instance: 9a181c6f-84ca-409d-93f3-3a86ba0f1b6d] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:13.301582 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-beb0ce6f-8167-4283-b3d6-c59c33c45b78 tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:13.303223 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-beb0ce6f-8167-4283-b3d6-c59c33c45b78 tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:13.304275 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-beb0ce6f-8167-4283-b3d6-c59c33c45b78 tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:13.305012 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-beb0ce6f-8167-4283-b3d6-c59c33c45b78 tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:13.317346 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-b4057ad4-80f5-435d-aabc-e3752afa1d6d tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f38865f66e433090132a8a09d44774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16b035e629e4eb89850c2871a128781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:13.336312 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b4057ad4-80f5-435d-aabc-e3752afa1d6d tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] 10.222.0.46 "GET /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f" status: 200 len: 1396 microversion: 2.1 time: 0.318463 Jan 15 20:59:13.338603 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1578/3176] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:13 2022] GET /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f => generated 1396 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:59:13.352927 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-5334374b-2d06-49a8-a19c-9da664798fde tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:13.355533 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-5334374b-2d06-49a8-a19c-9da664798fde tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] [instance: e04f7a96-62cb-4aae-9612-aa8df88aef61] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:13.371002 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5334374b-2d06-49a8-a19c-9da664798fde tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:13.371916 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5334374b-2d06-49a8-a19c-9da664798fde tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:13.373088 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5334374b-2d06-49a8-a19c-9da664798fde tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:13.373679 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5334374b-2d06-49a8-a19c-9da664798fde tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:13.493921 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-5334374b-2d06-49a8-a19c-9da664798fde tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] 10.222.0.46 "POST /compute/v2.1/servers/e04f7a96-62cb-4aae-9612-aa8df88aef61/action" status: 202 len: 0 microversion: 2.1 time: 0.151856 Jan 15 20:59:13.495477 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1579/3177] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:59:13 2022] POST /compute/v2.1/servers/e04f7a96-62cb-4aae-9612-aa8df88aef61/action => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 20:59:13.508986 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-fc14bc09-c89c-44a9-a532-36ba533b8618 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:13.510006 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-fc14bc09-c89c-44a9-a532-36ba533b8618 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] [instance: e04f7a96-62cb-4aae-9612-aa8df88aef61] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:13.537217 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fc14bc09-c89c-44a9-a532-36ba533b8618 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:13.537217 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fc14bc09-c89c-44a9-a532-36ba533b8618 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:13.537773 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fc14bc09-c89c-44a9-a532-36ba533b8618 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:13.538276 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fc14bc09-c89c-44a9-a532-36ba533b8618 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:13.868335 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-fc14bc09-c89c-44a9-a532-36ba533b8618 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05483ff6eec84f78a091b29cfbcf61f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a6720be5fb4de7bcd77cc7ef9d8000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:13.879853 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-fc14bc09-c89c-44a9-a532-36ba533b8618 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] 10.222.0.46 "GET /compute/v2.1/servers/e04f7a96-62cb-4aae-9612-aa8df88aef61" status: 200 len: 1554 microversion: 2.1 time: 0.379586 Jan 15 20:59:13.880890 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1580/3178] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:13 2022] GET /compute/v2.1/servers/e04f7a96-62cb-4aae-9612-aa8df88aef61 => generated 1554 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:59:13.893445 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-beb0ce6f-8167-4283-b3d6-c59c33c45b78 tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4986ff02ec54476842aa7c9eaac62ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7902e3c4b947454ea2411fc422568e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:13.901329 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-beb0ce6f-8167-4283-b3d6-c59c33c45b78 tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] 10.222.0.46 "GET /compute/v2.1/servers/9a181c6f-84ca-409d-93f3-3a86ba0f1b6d" status: 200 len: 1315 microversion: 2.1 time: 0.617787 Jan 15 20:59:13.911772 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9833ffc1-74fb-4f89-b160-7daf30c01bb5 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:13.911772 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-9833ffc1-74fb-4f89-b160-7daf30c01bb5 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:13.916732 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1599/3179] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:13 2022] GET /compute/v2.1/servers/9a181c6f-84ca-409d-93f3-3a86ba0f1b6d => generated 1315 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:59:13.922078 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9833ffc1-74fb-4f89-b160-7daf30c01bb5 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:13.922864 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9833ffc1-74fb-4f89-b160-7daf30c01bb5 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:13.925382 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9833ffc1-74fb-4f89-b160-7daf30c01bb5 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:13.926384 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9833ffc1-74fb-4f89-b160-7daf30c01bb5 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:14.026429 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b1611b87-7740-4deb-ad4d-5654b3132a64 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:14.027859 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b1611b87-7740-4deb-ad4d-5654b3132a64 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:14.034237 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b1611b87-7740-4deb-ad4d-5654b3132a64 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:14.034893 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b1611b87-7740-4deb-ad4d-5654b3132a64 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:14.035863 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b1611b87-7740-4deb-ad4d-5654b3132a64 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:14.036453 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b1611b87-7740-4deb-ad4d-5654b3132a64 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:14.078260 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b1611b87-7740-4deb-ad4d-5654b3132a64 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action" status: 200 len: 32641 microversion: 2.1 time: 0.055331 Jan 15 20:59:14.079608 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1600/3180] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:59:14 2022] POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action => generated 32641 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 20:59:14.142843 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-457b8aae-3630-4caa-a2c0-6dc465462792 tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:14.143884 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-457b8aae-3630-4caa-a2c0-6dc465462792 tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] [instance: 7c93f609-7034-418c-95ac-eb1589a1cb4b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:14.151753 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-457b8aae-3630-4caa-a2c0-6dc465462792 tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:14.152435 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-457b8aae-3630-4caa-a2c0-6dc465462792 tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:14.153409 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-457b8aae-3630-4caa-a2c0-6dc465462792 tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:14.153992 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-457b8aae-3630-4caa-a2c0-6dc465462792 tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:14.208653 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-9833ffc1-74fb-4f89-b160-7daf30c01bb5 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:14.223035 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-9833ffc1-74fb-4f89-b160-7daf30c01bb5 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:14.224431 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-9833ffc1-74fb-4f89-b160-7daf30c01bb5 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:14.226162 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-9833ffc1-74fb-4f89-b160-7daf30c01bb5 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "GET /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee" status: 200 len: 1879 microversion: 2.42 time: 0.327600 Jan 15 20:59:14.236224 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1581/3181] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:59:13 2022] GET /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee => generated 1879 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:59:14.355177 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8e8d7f6d-4ade-4e6e-8b42-93bd11b9429d tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:14.355782 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-8e8d7f6d-4ade-4e6e-8b42-93bd11b9429d tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] [instance: 5e93486c-7c77-4855-85f4-2bc8bcf4832f] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:14.369140 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8e8d7f6d-4ade-4e6e-8b42-93bd11b9429d tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:14.369596 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8e8d7f6d-4ade-4e6e-8b42-93bd11b9429d tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:14.370395 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8e8d7f6d-4ade-4e6e-8b42-93bd11b9429d tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:14.370830 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8e8d7f6d-4ade-4e6e-8b42-93bd11b9429d tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:14.423476 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-457b8aae-3630-4caa-a2c0-6dc465462792 tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b92cf3d63e14307ac083b6560bdcc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd976820970ac45138c6bf2da811786c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:14.432669 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-457b8aae-3630-4caa-a2c0-6dc465462792 tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] 10.222.0.46 "GET /compute/v2.1/servers/7c93f609-7034-418c-95ac-eb1589a1cb4b" status: 200 len: 1322 microversion: 2.1 time: 0.294048 Jan 15 20:59:14.442939 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1601/3182] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:14 2022] GET /compute/v2.1/servers/7c93f609-7034-418c-95ac-eb1589a1cb4b => generated 1322 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:59:14.542639 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-7a8fdb8f-a559-4c85-9c4f-8ed0659c0633 req-158170c4-89af-4fe6-8196-cac6b115bdf1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1884dd3f-949c-4df3-a977-3f6f5a204fee", "name": "network-vif-plugged", "status": "completed", "tag": "71565d73-8ba2-4ed6-8fb6-b6d496626525"}, {"server_uuid": "1884dd3f-949c-4df3-a977-3f6f5a204fee", "name": "network-vif-plugged", "status": "completed", "tag": "27dce314-8869-41b8-89c3-42aefdb46190"}, {"server_uuid": "9a181c6f-84ca-409d-93f3-3a86ba0f1b6d", "name": "network-vif-plugged", "status": "completed", "tag": "3764e35a-48e0-4620-a874-3fa02f5b2fb2"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:14.544877 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:59:14.544877 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:59:14.562310 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-7a8fdb8f-a559-4c85-9c4f-8ed0659c0633 req-158170c4-89af-4fe6-8196-cac6b115bdf1 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:14.564617 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-7a8fdb8f-a559-4c85-9c4f-8ed0659c0633 req-158170c4-89af-4fe6-8196-cac6b115bdf1 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:14.593777 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-7a8fdb8f-a559-4c85-9c4f-8ed0659c0633 req-158170c4-89af-4fe6-8196-cac6b115bdf1 service nova] Creating event network-vif-plugged:71565d73-8ba2-4ed6-8fb6-b6d496626525 for instance 1884dd3f-949c-4df3-a977-3f6f5a204fee on nch2-master-1 Jan 15 20:59:14.595157 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-7a8fdb8f-a559-4c85-9c4f-8ed0659c0633 req-158170c4-89af-4fe6-8196-cac6b115bdf1 service nova] Creating event network-vif-plugged:27dce314-8869-41b8-89c3-42aefdb46190 for instance 1884dd3f-949c-4df3-a977-3f6f5a204fee on nch2-master-1 Jan 15 20:59:14.601081 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-7a8fdb8f-a559-4c85-9c4f-8ed0659c0633 req-158170c4-89af-4fe6-8196-cac6b115bdf1 service nova] Creating event network-vif-plugged:3764e35a-48e0-4620-a874-3fa02f5b2fb2 for instance 9a181c6f-84ca-409d-93f3-3a86ba0f1b6d on nch1-master-1 Jan 15 20:59:14.605844 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-8e8d7f6d-4ade-4e6e-8b42-93bd11b9429d tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f38865f66e433090132a8a09d44774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16b035e629e4eb89850c2871a128781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:14.614049 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-8e8d7f6d-4ade-4e6e-8b42-93bd11b9429d tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] 10.222.0.46 "GET /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f" status: 200 len: 1396 microversion: 2.1 time: 0.262359 Jan 15 20:59:14.623941 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1582/3183] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:14 2022] GET /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f => generated 1396 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:59:14.624069 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-7a8fdb8f-a559-4c85-9c4f-8ed0659c0633 req-158170c4-89af-4fe6-8196-cac6b115bdf1 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.079986 Jan 15 20:59:14.624069 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1602/3184] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:59:14 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:59:14.898504 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-42f15018-7789-4ae7-acc1-29527e6344e9 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:14.899918 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-42f15018-7789-4ae7-acc1-29527e6344e9 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] [instance: e04f7a96-62cb-4aae-9612-aa8df88aef61] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:14.907219 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-42f15018-7789-4ae7-acc1-29527e6344e9 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:14.907798 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-42f15018-7789-4ae7-acc1-29527e6344e9 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:14.908713 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-42f15018-7789-4ae7-acc1-29527e6344e9 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:14.909427 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-42f15018-7789-4ae7-acc1-29527e6344e9 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:14.922153 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-af6710a3-6ff4-47da-8900-f0caa59f4bdc tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:14.923584 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-af6710a3-6ff4-47da-8900-f0caa59f4bdc tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] [instance: 9a181c6f-84ca-409d-93f3-3a86ba0f1b6d] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:14.932916 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-af6710a3-6ff4-47da-8900-f0caa59f4bdc tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:14.934187 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-af6710a3-6ff4-47da-8900-f0caa59f4bdc tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:14.935078 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-af6710a3-6ff4-47da-8900-f0caa59f4bdc tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:14.935562 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-af6710a3-6ff4-47da-8900-f0caa59f4bdc tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:15.206990 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-42f15018-7789-4ae7-acc1-29527e6344e9 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05483ff6eec84f78a091b29cfbcf61f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a6720be5fb4de7bcd77cc7ef9d8000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:15.224688 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-42f15018-7789-4ae7-acc1-29527e6344e9 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] 10.222.0.46 "GET /compute/v2.1/servers/e04f7a96-62cb-4aae-9612-aa8df88aef61" status: 200 len: 1554 microversion: 2.1 time: 0.330365 Jan 15 20:59:15.225409 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1583/3185] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:14 2022] GET /compute/v2.1/servers/e04f7a96-62cb-4aae-9612-aa8df88aef61 => generated 1554 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:59:15.245753 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1f857db6-f473-499d-a5f6-4f7d46cfe138 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:15.247135 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-1f857db6-f473-499d-a5f6-4f7d46cfe138 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:15.257953 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1f857db6-f473-499d-a5f6-4f7d46cfe138 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:15.258657 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1f857db6-f473-499d-a5f6-4f7d46cfe138 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:15.259709 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1f857db6-f473-499d-a5f6-4f7d46cfe138 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:15.260343 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1f857db6-f473-499d-a5f6-4f7d46cfe138 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:15.264268 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-af6710a3-6ff4-47da-8900-f0caa59f4bdc tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4986ff02ec54476842aa7c9eaac62ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7902e3c4b947454ea2411fc422568e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:15.272797 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-af6710a3-6ff4-47da-8900-f0caa59f4bdc tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] 10.222.0.46 "GET /compute/v2.1/servers/9a181c6f-84ca-409d-93f3-3a86ba0f1b6d" status: 200 len: 1315 microversion: 2.1 time: 0.356709 Jan 15 20:59:15.277386 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1603/3186] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:14 2022] GET /compute/v2.1/servers/9a181c6f-84ca-409d-93f3-3a86ba0f1b6d => generated 1315 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:59:15.282386 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-55639897-8aba-4931-aa96-8b39b1db5451 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:15.288451 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-55639897-8aba-4931-aa96-8b39b1db5451 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:15.300970 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-55639897-8aba-4931-aa96-8b39b1db5451 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:15.302273 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-55639897-8aba-4931-aa96-8b39b1db5451 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:15.303238 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-55639897-8aba-4931-aa96-8b39b1db5451 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:15.304601 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-55639897-8aba-4931-aa96-8b39b1db5451 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:15.343953 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-1f857db6-f473-499d-a5f6-4f7d46cfe138 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action" status: 200 len: 32641 microversion: 2.1 time: 0.115077 Jan 15 20:59:15.349224 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1584/3187] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:59:15 2022] POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action => generated 32641 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:59:15.456521 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7ede1bf8-b391-4c2d-aa58-2709043a16d5 tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:15.457339 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-7ede1bf8-b391-4c2d-aa58-2709043a16d5 tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] [instance: 7c93f609-7034-418c-95ac-eb1589a1cb4b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:15.471301 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7ede1bf8-b391-4c2d-aa58-2709043a16d5 tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:15.471859 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7ede1bf8-b391-4c2d-aa58-2709043a16d5 tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:15.474162 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7ede1bf8-b391-4c2d-aa58-2709043a16d5 tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:15.474707 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7ede1bf8-b391-4c2d-aa58-2709043a16d5 tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:15.604170 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-55639897-8aba-4931-aa96-8b39b1db5451 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:15.615672 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-55639897-8aba-4931-aa96-8b39b1db5451 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:15.621016 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-55639897-8aba-4931-aa96-8b39b1db5451 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:15.622401 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-55639897-8aba-4931-aa96-8b39b1db5451 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "GET /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee" status: 200 len: 1879 microversion: 2.42 time: 0.343924 Jan 15 20:59:15.623487 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1604/3188] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:59:15 2022] GET /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee => generated 1879 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:59:15.631121 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ec04a384-fcb6-4d15-829a-13367df25fe0 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:15.632678 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ec04a384-fcb6-4d15-829a-13367df25fe0 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] [instance: 5e93486c-7c77-4855-85f4-2bc8bcf4832f] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:15.639101 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ec04a384-fcb6-4d15-829a-13367df25fe0 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:15.640223 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ec04a384-fcb6-4d15-829a-13367df25fe0 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:15.641220 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ec04a384-fcb6-4d15-829a-13367df25fe0 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:15.641805 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ec04a384-fcb6-4d15-829a-13367df25fe0 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:15.695737 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-7ede1bf8-b391-4c2d-aa58-2709043a16d5 tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b92cf3d63e14307ac083b6560bdcc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd976820970ac45138c6bf2da811786c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:15.706581 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7ede1bf8-b391-4c2d-aa58-2709043a16d5 tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] 10.222.0.46 "GET /compute/v2.1/servers/7c93f609-7034-418c-95ac-eb1589a1cb4b" status: 200 len: 1322 microversion: 2.1 time: 0.259645 Jan 15 20:59:15.716949 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1585/3189] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:15 2022] GET /compute/v2.1/servers/7c93f609-7034-418c-95ac-eb1589a1cb4b => generated 1322 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:59:15.880685 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-ec04a384-fcb6-4d15-829a-13367df25fe0 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f38865f66e433090132a8a09d44774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16b035e629e4eb89850c2871a128781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:15.888601 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ec04a384-fcb6-4d15-829a-13367df25fe0 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] 10.222.0.46 "GET /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f" status: 200 len: 1396 microversion: 2.1 time: 0.260883 Jan 15 20:59:15.889362 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1605/3190] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:15 2022] GET /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f => generated 1396 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:59:16.242779 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-20c65bd8-006f-4fbb-9853-2c85175113c9 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:16.243402 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-20c65bd8-006f-4fbb-9853-2c85175113c9 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] [instance: e04f7a96-62cb-4aae-9612-aa8df88aef61] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:16.250947 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-20c65bd8-006f-4fbb-9853-2c85175113c9 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:16.251400 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-20c65bd8-006f-4fbb-9853-2c85175113c9 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:16.252451 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-20c65bd8-006f-4fbb-9853-2c85175113c9 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:16.253113 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-20c65bd8-006f-4fbb-9853-2c85175113c9 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:16.293066 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-710b0def-847e-4963-a2a3-699d5563f498 tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:16.295003 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-710b0def-847e-4963-a2a3-699d5563f498 tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] [instance: 9a181c6f-84ca-409d-93f3-3a86ba0f1b6d] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:16.302890 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-710b0def-847e-4963-a2a3-699d5563f498 tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:16.303611 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-710b0def-847e-4963-a2a3-699d5563f498 tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:16.307464 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-710b0def-847e-4963-a2a3-699d5563f498 tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:16.308941 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-710b0def-847e-4963-a2a3-699d5563f498 tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:16.466993 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-20c65bd8-006f-4fbb-9853-2c85175113c9 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05483ff6eec84f78a091b29cfbcf61f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a6720be5fb4de7bcd77cc7ef9d8000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:16.479581 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-20c65bd8-006f-4fbb-9853-2c85175113c9 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] 10.222.0.46 "GET /compute/v2.1/servers/e04f7a96-62cb-4aae-9612-aa8df88aef61" status: 200 len: 1554 microversion: 2.1 time: 0.240891 Jan 15 20:59:16.481541 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1586/3191] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:16 2022] GET /compute/v2.1/servers/e04f7a96-62cb-4aae-9612-aa8df88aef61 => generated 1554 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:59:16.487318 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-eef86ecf-c4a7-45c9-bed7-bdc8014f733c tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:16.490263 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-eef86ecf-c4a7-45c9-bed7-bdc8014f733c tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:16.500945 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-eef86ecf-c4a7-45c9-bed7-bdc8014f733c tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:16.501943 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-eef86ecf-c4a7-45c9-bed7-bdc8014f733c tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:16.502900 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-eef86ecf-c4a7-45c9-bed7-bdc8014f733c tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:16.503484 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-eef86ecf-c4a7-45c9-bed7-bdc8014f733c tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:16.535836 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-710b0def-847e-4963-a2a3-699d5563f498 tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4986ff02ec54476842aa7c9eaac62ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7902e3c4b947454ea2411fc422568e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:16.560105 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-710b0def-847e-4963-a2a3-699d5563f498 tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] 10.222.0.46 "GET /compute/v2.1/servers/9a181c6f-84ca-409d-93f3-3a86ba0f1b6d" status: 200 len: 1464 microversion: 2.1 time: 0.267619 Jan 15 20:59:16.565291 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1606/3192] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:16 2022] GET /compute/v2.1/servers/9a181c6f-84ca-409d-93f3-3a86ba0f1b6d => generated 1464 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:59:16.582935 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-48610f5c-1add-403f-b117-199324ba425b tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:16.583437 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-48610f5c-1add-403f-b117-199324ba425b tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] [instance: 9a181c6f-84ca-409d-93f3-3a86ba0f1b6d] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:16.592744 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-48610f5c-1add-403f-b117-199324ba425b tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:16.593735 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-eef86ecf-c4a7-45c9-bed7-bdc8014f733c tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action" status: 200 len: 32641 microversion: 2.1 time: 0.110489 Jan 15 20:59:16.594415 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-48610f5c-1add-403f-b117-199324ba425b tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:16.595254 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-48610f5c-1add-403f-b117-199324ba425b tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:16.595696 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-48610f5c-1add-403f-b117-199324ba425b tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:16.595821 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1587/3193] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:59:16 2022] POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action => generated 32641 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:59:16.632166 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-48610f5c-1add-403f-b117-199324ba425b tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] [instance: 9a181c6f-84ca-409d-93f3-3a86ba0f1b6d] Going to try to terminate instance {{(pid=129365) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 20:59:16.645174 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ceb4094b-9485-44ea-bcbc-ae69f0aec350 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:16.646061 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ceb4094b-9485-44ea-bcbc-ae69f0aec350 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:16.654209 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ceb4094b-9485-44ea-bcbc-ae69f0aec350 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:16.654660 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ceb4094b-9485-44ea-bcbc-ae69f0aec350 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:16.655476 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ceb4094b-9485-44ea-bcbc-ae69f0aec350 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:16.656252 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ceb4094b-9485-44ea-bcbc-ae69f0aec350 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:16.774145 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-48610f5c-1add-403f-b117-199324ba425b tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] 10.222.0.46 "DELETE /compute/v2.1/servers/9a181c6f-84ca-409d-93f3-3a86ba0f1b6d" status: 204 len: 0 microversion: 2.1 time: 0.195907 Jan 15 20:59:16.774740 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1607/3194] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 20:59:16 2022] DELETE /compute/v2.1/servers/9a181c6f-84ca-409d-93f3-3a86ba0f1b6d => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 20:59:16.779806 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d84c228a-0d8d-4ed2-bb39-271edcf41715 tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:16.780495 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d84c228a-0d8d-4ed2-bb39-271edcf41715 tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] [instance: 7c93f609-7034-418c-95ac-eb1589a1cb4b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:16.795634 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d84c228a-0d8d-4ed2-bb39-271edcf41715 tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:16.796367 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d84c228a-0d8d-4ed2-bb39-271edcf41715 tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:16.797189 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d84c228a-0d8d-4ed2-bb39-271edcf41715 tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:16.797626 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d84c228a-0d8d-4ed2-bb39-271edcf41715 tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:17.106276 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-ceb4094b-9485-44ea-bcbc-ae69f0aec350 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:17.125351 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-ceb4094b-9485-44ea-bcbc-ae69f0aec350 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:17.127450 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-ceb4094b-9485-44ea-bcbc-ae69f0aec350 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:17.129096 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ceb4094b-9485-44ea-bcbc-ae69f0aec350 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "GET /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee" status: 200 len: 1879 microversion: 2.42 time: 0.488570 Jan 15 20:59:17.129891 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1588/3195] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:59:16 2022] GET /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee => generated 1879 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:59:17.141805 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a43e7989-fe45-483c-b0e9-716e71dbca93 tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:17.142718 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a43e7989-fe45-483c-b0e9-716e71dbca93 tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] [instance: 9a181c6f-84ca-409d-93f3-3a86ba0f1b6d] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:17.154511 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a43e7989-fe45-483c-b0e9-716e71dbca93 tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:17.154964 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a43e7989-fe45-483c-b0e9-716e71dbca93 tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:17.156407 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a43e7989-fe45-483c-b0e9-716e71dbca93 tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:17.157044 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a43e7989-fe45-483c-b0e9-716e71dbca93 tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:17.261802 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-d84c228a-0d8d-4ed2-bb39-271edcf41715 tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b92cf3d63e14307ac083b6560bdcc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd976820970ac45138c6bf2da811786c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:17.269293 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d84c228a-0d8d-4ed2-bb39-271edcf41715 tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] 10.222.0.46 "GET /compute/v2.1/servers/7c93f609-7034-418c-95ac-eb1589a1cb4b" status: 200 len: 1322 microversion: 2.1 time: 0.493137 Jan 15 20:59:17.269879 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1608/3196] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:16 2022] GET /compute/v2.1/servers/7c93f609-7034-418c-95ac-eb1589a1cb4b => generated 1322 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:59:17.282198 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-faf61212-1d0c-46ca-a9b6-a969a3d18085 req-dbd9f7fc-9c61-48ad-b8ae-31d94789aae3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c93f609-7034-418c-95ac-eb1589a1cb4b", "tag": "91ff1980-18eb-4ad0-9fb9-080ce1912c6f"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:17.283789 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:59:17.283789 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:59:17.302214 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-faf61212-1d0c-46ca-a9b6-a969a3d18085 req-dbd9f7fc-9c61-48ad-b8ae-31d94789aae3 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:17.305143 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-faf61212-1d0c-46ca-a9b6-a969a3d18085 req-dbd9f7fc-9c61-48ad-b8ae-31d94789aae3 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:17.324682 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-faf61212-1d0c-46ca-a9b6-a969a3d18085 req-dbd9f7fc-9c61-48ad-b8ae-31d94789aae3 service nova] Creating event network-changed:91ff1980-18eb-4ad0-9fb9-080ce1912c6f for instance 7c93f609-7034-418c-95ac-eb1589a1cb4b on nch1-master-1 Jan 15 20:59:17.333985 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-faf61212-1d0c-46ca-a9b6-a969a3d18085 req-dbd9f7fc-9c61-48ad-b8ae-31d94789aae3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055730 Jan 15 20:59:17.336182 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1609/3197] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:59:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:59:17.343302 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2f207053-cd81-445d-82c8-aeaf14aaaff3 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:17.344410 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-2f207053-cd81-445d-82c8-aeaf14aaaff3 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] [instance: 5e93486c-7c77-4855-85f4-2bc8bcf4832f] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:17.363677 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2f207053-cd81-445d-82c8-aeaf14aaaff3 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:17.364488 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2f207053-cd81-445d-82c8-aeaf14aaaff3 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:17.365882 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2f207053-cd81-445d-82c8-aeaf14aaaff3 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:17.367449 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2f207053-cd81-445d-82c8-aeaf14aaaff3 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:17.506454 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-a43e7989-fe45-483c-b0e9-716e71dbca93 tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4986ff02ec54476842aa7c9eaac62ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7902e3c4b947454ea2411fc422568e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:17.526313 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a43e7989-fe45-483c-b0e9-716e71dbca93 tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] 10.222.0.46 "GET /compute/v2.1/servers/9a181c6f-84ca-409d-93f3-3a86ba0f1b6d" status: 200 len: 1470 microversion: 2.1 time: 0.388132 Jan 15 20:59:17.537024 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1589/3198] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:17 2022] GET /compute/v2.1/servers/9a181c6f-84ca-409d-93f3-3a86ba0f1b6d => generated 1470 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:59:17.546382 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-548694e5-267f-46a2-9ca0-77cd7698b6a5 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:17.549633 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-548694e5-267f-46a2-9ca0-77cd7698b6a5 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] [instance: e04f7a96-62cb-4aae-9612-aa8df88aef61] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:17.564881 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-548694e5-267f-46a2-9ca0-77cd7698b6a5 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:17.573430 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-548694e5-267f-46a2-9ca0-77cd7698b6a5 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:17.575017 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-548694e5-267f-46a2-9ca0-77cd7698b6a5 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:17.575648 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-548694e5-267f-46a2-9ca0-77cd7698b6a5 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:17.758771 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-2f207053-cd81-445d-82c8-aeaf14aaaff3 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f38865f66e433090132a8a09d44774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16b035e629e4eb89850c2871a128781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:17.771386 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2f207053-cd81-445d-82c8-aeaf14aaaff3 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] 10.222.0.46 "GET /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f" status: 200 len: 1396 microversion: 2.1 time: 0.431126 Jan 15 20:59:17.772010 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1610/3199] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:17 2022] GET /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f => generated 1396 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:59:17.786826 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3488a52c-fb4b-4c00-96b2-0a97d114d91f tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:17.787877 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-3488a52c-fb4b-4c00-96b2-0a97d114d91f tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:17.803605 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3488a52c-fb4b-4c00-96b2-0a97d114d91f tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:17.804501 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3488a52c-fb4b-4c00-96b2-0a97d114d91f tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:17.805341 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3488a52c-fb4b-4c00-96b2-0a97d114d91f tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:17.805781 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3488a52c-fb4b-4c00-96b2-0a97d114d91f tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:17.895223 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3488a52c-fb4b-4c00-96b2-0a97d114d91f tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action" status: 200 len: 32641 microversion: 2.1 time: 0.115839 Jan 15 20:59:17.895620 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1611/3200] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:59:17 2022] POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action => generated 32641 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:59:17.945850 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-548694e5-267f-46a2-9ca0-77cd7698b6a5 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05483ff6eec84f78a091b29cfbcf61f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a6720be5fb4de7bcd77cc7ef9d8000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:17.962415 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-548694e5-267f-46a2-9ca0-77cd7698b6a5 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] 10.222.0.46 "GET /compute/v2.1/servers/e04f7a96-62cb-4aae-9612-aa8df88aef61" status: 200 len: 1560 microversion: 2.1 time: 0.422944 Jan 15 20:59:17.981579 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1590/3201] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:17 2022] GET /compute/v2.1/servers/e04f7a96-62cb-4aae-9612-aa8df88aef61 => generated 1560 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:59:18.073836 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-662d20d5-0990-48d3-8f4c-ed37c5cdcdd3 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:18.074595 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-662d20d5-0990-48d3-8f4c-ed37c5cdcdd3 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] [instance: e04f7a96-62cb-4aae-9612-aa8df88aef61] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:18.080770 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-662d20d5-0990-48d3-8f4c-ed37c5cdcdd3 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:18.081270 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-662d20d5-0990-48d3-8f4c-ed37c5cdcdd3 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:18.082134 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-662d20d5-0990-48d3-8f4c-ed37c5cdcdd3 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:18.082583 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-662d20d5-0990-48d3-8f4c-ed37c5cdcdd3 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:18.180778 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-45673617-d868-46a0-a845-7ecf0ac42a0a req-fd43716d-1fa4-47b1-910a-04ab7904be8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e93486c-7c77-4855-85f4-2bc8bcf4832f", "name": "network-vif-plugged", "status": "completed", "tag": "93c9ee82-e08e-44b9-a8c0-f6e275b08b7b"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:18.186036 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:59:18.186036 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:59:18.196923 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-45673617-d868-46a0-a845-7ecf0ac42a0a req-fd43716d-1fa4-47b1-910a-04ab7904be8c service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:18.198071 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-45673617-d868-46a0-a845-7ecf0ac42a0a req-fd43716d-1fa4-47b1-910a-04ab7904be8c service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:18.199741 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.objects.instance [None req-662d20d5-0990-48d3-8f4c-ed37c5cdcdd3 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lazy-loading 'services' on Instance uuid e04f7a96-62cb-4aae-9612-aa8df88aef61 {{(pid=129366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 20:59:18.212727 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-45673617-d868-46a0-a845-7ecf0ac42a0a req-fd43716d-1fa4-47b1-910a-04ab7904be8c service nova] Creating event network-vif-plugged:93c9ee82-e08e-44b9-a8c0-f6e275b08b7b for instance 5e93486c-7c77-4855-85f4-2bc8bcf4832f on nch2-master-1 Jan 15 20:59:18.217831 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-45673617-d868-46a0-a845-7ecf0ac42a0a req-fd43716d-1fa4-47b1-910a-04ab7904be8c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.316678 Jan 15 20:59:18.219338 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1612/3202] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:59:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:59:18.310919 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a0f36089-92af-4be0-91d2-e858c491ac9d tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-2139015484", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "networks": [{"uuid": "e20dc768-2ef4-41d4-9bd1-8c6a11def8cb"}]}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:18.363090 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-662d20d5-0990-48d3-8f4c-ed37c5cdcdd3 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] 10.222.0.46 "DELETE /compute/v2.1/servers/e04f7a96-62cb-4aae-9612-aa8df88aef61/os-volume_attachments/ba3df6f7-3423-44f7-84bf-6545c2261c44" status: 202 len: 0 microversion: 2.1 time: 0.294921 Jan 15 20:59:18.366691 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1591/3203] 10.222.0.46 () {58 vars in 1415 bytes} [Sat Jan 15 20:59:18 2022] DELETE /compute/v2.1/servers/e04f7a96-62cb-4aae-9612-aa8df88aef61/os-volume_attachments/ba3df6f7-3423-44f7-84bf-6545c2261c44 => generated 0 bytes in 299 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 20:59:18.410244 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d247d651-8fd7-4334-8e18-e980133fa9ca tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:18.411311 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-d247d651-8fd7-4334-8e18-e980133fa9ca tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:18.411818 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.network.neutron [None req-a0f36089-92af-4be0-91d2-e858c491ac9d tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] validate_networks() for [('e20dc768-2ef4-41d4-9bd1-8c6a11def8cb', None, None, None, None, None)] {{(pid=129365) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 20:59:18.420589 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d247d651-8fd7-4334-8e18-e980133fa9ca tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:18.421329 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d247d651-8fd7-4334-8e18-e980133fa9ca tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:18.422532 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d247d651-8fd7-4334-8e18-e980133fa9ca tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:18.423225 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d247d651-8fd7-4334-8e18-e980133fa9ca tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:18.877338 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-d247d651-8fd7-4334-8e18-e980133fa9ca tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:18.891859 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-d247d651-8fd7-4334-8e18-e980133fa9ca tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:18.894147 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-d247d651-8fd7-4334-8e18-e980133fa9ca tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:18.895553 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d247d651-8fd7-4334-8e18-e980133fa9ca tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "GET /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee" status: 200 len: 2837 microversion: 2.42 time: 0.527091 Jan 15 20:59:18.896216 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1592/3204] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:59:18 2022] GET /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee => generated 2837 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:59:18.906594 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d9f79224-f5a1-4799-ac6f-500a24991280 tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:18.907556 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-d9f79224-f5a1-4799-ac6f-500a24991280 tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] [instance: 7c93f609-7034-418c-95ac-eb1589a1cb4b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:18.916239 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d9f79224-f5a1-4799-ac6f-500a24991280 tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:18.916999 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d9f79224-f5a1-4799-ac6f-500a24991280 tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:18.918287 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d9f79224-f5a1-4799-ac6f-500a24991280 tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:18.918947 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d9f79224-f5a1-4799-ac6f-500a24991280 tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:19.266836 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-a0f36089-92af-4be0-91d2-e858c491ac9d tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Flavor limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 20:59:19.267349 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-a0f36089-92af-4be0-91d2-e858c491ac9d tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Image limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 20:59:19.267907 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-a0f36089-92af-4be0-91d2-e858c491ac9d tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Flavor pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 20:59:19.268685 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-a0f36089-92af-4be0-91d2-e858c491ac9d tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Image pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 20:59:19.269325 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-a0f36089-92af-4be0-91d2-e858c491ac9d tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 20:59:19.288493 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a0f36089-92af-4be0-91d2-e858c491ac9d tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:19.288986 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a0f36089-92af-4be0-91d2-e858c491ac9d tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:19.289814 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a0f36089-92af-4be0-91d2-e858c491ac9d tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:19.292621 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a0f36089-92af-4be0-91d2-e858c491ac9d tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:19.356771 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-a0f36089-92af-4be0-91d2-e858c491ac9d tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Getting quotas for project 6a75218d537c4d63874297261bec70ad. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:59:19.369265 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-d9f79224-f5a1-4799-ac6f-500a24991280 tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b92cf3d63e14307ac083b6560bdcc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd976820970ac45138c6bf2da811786c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:19.374480 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-a0f36089-92af-4be0-91d2-e858c491ac9d tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Getting quotas for user 8a8f9c6ea7f6496792258d683640c838 and project 6a75218d537c4d63874297261bec70ad. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:59:19.398844 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d9f79224-f5a1-4799-ac6f-500a24991280 tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] 10.222.0.46 "GET /compute/v2.1/servers/7c93f609-7034-418c-95ac-eb1589a1cb4b" status: 200 len: 1322 microversion: 2.1 time: 0.498220 Jan 15 20:59:19.410461 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1593/3205] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:18 2022] GET /compute/v2.1/servers/7c93f609-7034-418c-95ac-eb1589a1cb4b => generated 1322 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:59:19.413187 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a0f36089-92af-4be0-91d2-e858c491ac9d tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Going to run 1 instances... {{(pid=129365) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 20:59:19.418907 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a0f36089-92af-4be0-91d2-e858c491ac9d tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: c8986b09-8342-4290-87be-22cece488c73] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129365) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 20:59:19.421876 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4d104454-bc8f-4830-9e04-6cfb78a9a500 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:19.422865 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-4d104454-bc8f-4830-9e04-6cfb78a9a500 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] [instance: e04f7a96-62cb-4aae-9612-aa8df88aef61] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:19.440878 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4d104454-bc8f-4830-9e04-6cfb78a9a500 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:19.441324 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4d104454-bc8f-4830-9e04-6cfb78a9a500 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:19.443357 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4d104454-bc8f-4830-9e04-6cfb78a9a500 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:19.443806 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4d104454-bc8f-4830-9e04-6cfb78a9a500 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:19.503359 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-4d104454-bc8f-4830-9e04-6cfb78a9a500 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] 10.222.0.46 "GET /compute/v2.1/servers/e04f7a96-62cb-4aae-9612-aa8df88aef61/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089937 Jan 15 20:59:19.504361 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1594/3206] 10.222.0.46 () {58 vars in 1301 bytes} [Sat Jan 15 20:59:19 2022] GET /compute/v2.1/servers/e04f7a96-62cb-4aae-9612-aa8df88aef61/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:59:19.514345 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-85afbae1-98c9-447a-8ef3-ce3cd0b15298 tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:19.515443 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-85afbae1-98c9-447a-8ef3-ce3cd0b15298 tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] [instance: 9a181c6f-84ca-409d-93f3-3a86ba0f1b6d] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:19.522791 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-85afbae1-98c9-447a-8ef3-ce3cd0b15298 tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:19.523751 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-85afbae1-98c9-447a-8ef3-ce3cd0b15298 tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:19.525231 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-85afbae1-98c9-447a-8ef3-ce3cd0b15298 tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:19.526218 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-85afbae1-98c9-447a-8ef3-ce3cd0b15298 tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:19.560431 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a0f36089-92af-4be0-91d2-e858c491ac9d tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.339770 Jan 15 20:59:19.570583 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1613/3207] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 20:59:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1351 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 20:59:19.580967 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d1301c0c-f911-426b-a4b3-1125728c71eb tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:19.581784 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d1301c0c-f911-426b-a4b3-1125728c71eb tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] [instance: 5e93486c-7c77-4855-85f4-2bc8bcf4832f] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:19.590833 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-85afbae1-98c9-447a-8ef3-ce3cd0b15298 tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:19.591443 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d1301c0c-f911-426b-a4b3-1125728c71eb tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:19.592275 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d1301c0c-f911-426b-a4b3-1125728c71eb tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:19.593101 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-85afbae1-98c9-447a-8ef3-ce3cd0b15298 tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:19.593884 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.objects.instance [None req-85afbae1-98c9-447a-8ef3-ce3cd0b15298 tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] Lazy-loading 'fault' on Instance uuid 9a181c6f-84ca-409d-93f3-3a86ba0f1b6d {{(pid=129366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 20:59:19.594854 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d1301c0c-f911-426b-a4b3-1125728c71eb tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:19.595543 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d1301c0c-f911-426b-a4b3-1125728c71eb tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:19.687687 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-85afbae1-98c9-447a-8ef3-ce3cd0b15298 tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4986ff02ec54476842aa7c9eaac62ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7902e3c4b947454ea2411fc422568e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:19.696050 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-85afbae1-98c9-447a-8ef3-ce3cd0b15298 tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] 10.222.0.46 "GET /compute/v2.1/servers/9a181c6f-84ca-409d-93f3-3a86ba0f1b6d" status: 200 len: 1305 microversion: 2.1 time: 0.186282 Jan 15 20:59:19.708101 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1595/3208] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:19 2022] GET /compute/v2.1/servers/9a181c6f-84ca-409d-93f3-3a86ba0f1b6d => generated 1305 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:59:19.715463 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ba7db57c-9a49-407c-b1ee-cfbb00043b30 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:19.716461 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ba7db57c-9a49-407c-b1ee-cfbb00043b30 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:19.730551 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ba7db57c-9a49-407c-b1ee-cfbb00043b30 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:19.731007 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ba7db57c-9a49-407c-b1ee-cfbb00043b30 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:19.732271 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ba7db57c-9a49-407c-b1ee-cfbb00043b30 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:19.733070 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ba7db57c-9a49-407c-b1ee-cfbb00043b30 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:19.787190 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ba7db57c-9a49-407c-b1ee-cfbb00043b30 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action" status: 200 len: 32641 microversion: 2.1 time: 0.085823 Jan 15 20:59:19.788447 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1596/3209] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:59:19 2022] POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action => generated 32641 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:59:19.795990 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-498e41eb-75ed-4b1a-a7d0-20c5e525edb7 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:19.797056 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-498e41eb-75ed-4b1a-a7d0-20c5e525edb7 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:19.810037 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-498e41eb-75ed-4b1a-a7d0-20c5e525edb7 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:19.811330 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-498e41eb-75ed-4b1a-a7d0-20c5e525edb7 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:19.812333 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-498e41eb-75ed-4b1a-a7d0-20c5e525edb7 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:19.813002 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-498e41eb-75ed-4b1a-a7d0-20c5e525edb7 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:19.950277 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-d1301c0c-f911-426b-a4b3-1125728c71eb tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f38865f66e433090132a8a09d44774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16b035e629e4eb89850c2871a128781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:19.966880 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d1301c0c-f911-426b-a4b3-1125728c71eb tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] 10.222.0.46 "GET /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f" status: 200 len: 1396 microversion: 2.1 time: 0.389464 Jan 15 20:59:19.967423 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1614/3210] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:19 2022] GET /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f => generated 1396 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:59:19.988511 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-fd01444e-5f6c-4350-a1e5-12a91132caa0 req-901266e7-7be1-4fd6-b7ff-aa9952eb40d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a181c6f-84ca-409d-93f3-3a86ba0f1b6d", "name": "network-vif-deleted", "tag": "3764e35a-48e0-4620-a874-3fa02f5b2fb2"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:19.997180 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:59:19.997180 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:59:20.016358 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-fd01444e-5f6c-4350-a1e5-12a91132caa0 req-901266e7-7be1-4fd6-b7ff-aa9952eb40d7 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:20.020312 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-fd01444e-5f6c-4350-a1e5-12a91132caa0 req-901266e7-7be1-4fd6-b7ff-aa9952eb40d7 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:20.067307 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-fd01444e-5f6c-4350-a1e5-12a91132caa0 req-901266e7-7be1-4fd6-b7ff-aa9952eb40d7 service nova] Creating event network-vif-deleted:3764e35a-48e0-4620-a874-3fa02f5b2fb2 for instance 9a181c6f-84ca-409d-93f3-3a86ba0f1b6d on nch1-master-1 Jan 15 20:59:20.083593 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-fd01444e-5f6c-4350-a1e5-12a91132caa0 req-901266e7-7be1-4fd6-b7ff-aa9952eb40d7 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112491 Jan 15 20:59:20.086562 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1615/3211] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:59:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:59:20.105222 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f62f5f1d-c0f7-4030-abf5-5b570470aedf tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:20.107680 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f62f5f1d-c0f7-4030-abf5-5b570470aedf tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: c8986b09-8342-4290-87be-22cece488c73] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:20.237839 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-498e41eb-75ed-4b1a-a7d0-20c5e525edb7 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "GET /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.448693 Jan 15 20:59:20.238727 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1597/3212] 10.222.0.46 () {60 vars in 1315 bytes} [Sat Jan 15 20:59:19 2022] GET /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/os-interface => generated 1831 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:59:20.272797 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-f62f5f1d-c0f7-4030-abf5-5b570470aedf tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8f9c6ea7f6496792258d683640c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a75218d537c4d63874297261bec70ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:20.282130 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f62f5f1d-c0f7-4030-abf5-5b570470aedf tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] 10.222.0.46 "GET /compute/v2.1/servers/c8986b09-8342-4290-87be-22cece488c73" status: 200 len: 1218 microversion: 2.1 time: 0.191736 Jan 15 20:59:20.294568 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1616/3213] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:20 2022] GET /compute/v2.1/servers/c8986b09-8342-4290-87be-22cece488c73 => generated 1218 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:59:20.419068 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-14d3ec17-1b34-42be-887b-b51032929e64 tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:20.420259 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-14d3ec17-1b34-42be-887b-b51032929e64 tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] [instance: 7c93f609-7034-418c-95ac-eb1589a1cb4b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:20.434454 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-14d3ec17-1b34-42be-887b-b51032929e64 tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:20.436833 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-14d3ec17-1b34-42be-887b-b51032929e64 tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:20.437916 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-14d3ec17-1b34-42be-887b-b51032929e64 tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:20.440857 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-14d3ec17-1b34-42be-887b-b51032929e64 tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:20.515649 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d0d4dff8-5cc3-4562-9f64-f1dc0e95d84e tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:20.516686 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d0d4dff8-5cc3-4562-9f64-f1dc0e95d84e tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] [instance: e04f7a96-62cb-4aae-9612-aa8df88aef61] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:20.525670 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d0d4dff8-5cc3-4562-9f64-f1dc0e95d84e tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:20.537470 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d0d4dff8-5cc3-4562-9f64-f1dc0e95d84e tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:20.538599 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d0d4dff8-5cc3-4562-9f64-f1dc0e95d84e tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:20.539159 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d0d4dff8-5cc3-4562-9f64-f1dc0e95d84e tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:20.596537 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d0d4dff8-5cc3-4562-9f64-f1dc0e95d84e tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] 10.222.0.46 "GET /compute/v2.1/servers/e04f7a96-62cb-4aae-9612-aa8df88aef61/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.084789 Jan 15 20:59:20.597509 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1617/3214] 10.222.0.46 () {58 vars in 1301 bytes} [Sat Jan 15 20:59:20 2022] GET /compute/v2.1/servers/e04f7a96-62cb-4aae-9612-aa8df88aef61/os-volume_attachments => generated 25 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 15 20:59:20.711095 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3e524b17-9ccb-46c2-a6e6-e5bb8b061409 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:20.712433 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-3e524b17-9ccb-46c2-a6e6-e5bb8b061409 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] [instance: 689dd504-e36e-41d0-a461-acce91952e7e] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:20.722111 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3e524b17-9ccb-46c2-a6e6-e5bb8b061409 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:20.727670 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3e524b17-9ccb-46c2-a6e6-e5bb8b061409 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:20.728734 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3e524b17-9ccb-46c2-a6e6-e5bb8b061409 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:20.730095 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3e524b17-9ccb-46c2-a6e6-e5bb8b061409 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:20.741486 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-14d3ec17-1b34-42be-887b-b51032929e64 tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b92cf3d63e14307ac083b6560bdcc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd976820970ac45138c6bf2da811786c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:20.749825 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-14d3ec17-1b34-42be-887b-b51032929e64 tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] 10.222.0.46 "GET /compute/v2.1/servers/7c93f609-7034-418c-95ac-eb1589a1cb4b" status: 200 len: 1322 microversion: 2.1 time: 0.336619 Jan 15 20:59:20.753568 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1598/3215] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:20 2022] GET /compute/v2.1/servers/7c93f609-7034-418c-95ac-eb1589a1cb4b => generated 1322 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:59:20.764319 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a914c7a4-053c-41a5-a4c1-c46857cdad00 tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:20.764967 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a914c7a4-053c-41a5-a4c1-c46857cdad00 tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] [instance: 9a181c6f-84ca-409d-93f3-3a86ba0f1b6d] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:20.778997 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a914c7a4-053c-41a5-a4c1-c46857cdad00 tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:20.779838 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a914c7a4-053c-41a5-a4c1-c46857cdad00 tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:20.781360 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a914c7a4-053c-41a5-a4c1-c46857cdad00 tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:20.781987 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a914c7a4-053c-41a5-a4c1-c46857cdad00 tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:20.804372 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-3e524b17-9ccb-46c2-a6e6-e5bb8b061409 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] HTTP exception thrown: Cannot 'reboot' instance 689dd504-e36e-41d0-a461-acce91952e7e while it is in vm_state rescued Jan 15 20:59:20.805516 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3e524b17-9ccb-46c2-a6e6-e5bb8b061409 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Returning 409 to user: Cannot 'reboot' instance 689dd504-e36e-41d0-a461-acce91952e7e while it is in vm_state rescued {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:59:20.806630 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3e524b17-9ccb-46c2-a6e6-e5bb8b061409 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] 10.222.0.46 "POST /compute/v2.1/servers/689dd504-e36e-41d0-a461-acce91952e7e/action" status: 409 len: 145 microversion: 2.1 time: 0.101079 Jan 15 20:59:20.808351 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1618/3216] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:59:20 2022] POST /compute/v2.1/servers/689dd504-e36e-41d0-a461-acce91952e7e/action => generated 145 bytes in 103 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jan 15 20:59:20.813799 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d841999d-a62f-4614-a2b9-9d748da6530b tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:20.815532 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d841999d-a62f-4614-a2b9-9d748da6530b tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:20.820677 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-a914c7a4-053c-41a5-a4c1-c46857cdad00 tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] HTTP exception thrown: Instance 9a181c6f-84ca-409d-93f3-3a86ba0f1b6d could not be found. Jan 15 20:59:20.823819 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d841999d-a62f-4614-a2b9-9d748da6530b tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:20.825015 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d841999d-a62f-4614-a2b9-9d748da6530b tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:20.826012 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d841999d-a62f-4614-a2b9-9d748da6530b tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:20.826709 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d841999d-a62f-4614-a2b9-9d748da6530b tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:20.830468 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a914c7a4-053c-41a5-a4c1-c46857cdad00 tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] Returning 404 to user: Instance 9a181c6f-84ca-409d-93f3-3a86ba0f1b6d could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:59:20.831370 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a914c7a4-053c-41a5-a4c1-c46857cdad00 tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] 10.222.0.46 "GET /compute/v2.1/servers/9a181c6f-84ca-409d-93f3-3a86ba0f1b6d" status: 404 len: 111 microversion: 2.1 time: 0.076498 Jan 15 20:59:20.831955 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1599/3217] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:20 2022] GET /compute/v2.1/servers/9a181c6f-84ca-409d-93f3-3a86ba0f1b6d => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:59:20.851767 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d8b9fe29-b868-4241-ac40-a6c37072ba36 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:20.856796 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-d8b9fe29-b868-4241-ac40-a6c37072ba36 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] [instance: 689dd504-e36e-41d0-a461-acce91952e7e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:20.871961 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d8b9fe29-b868-4241-ac40-a6c37072ba36 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:20.874055 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d8b9fe29-b868-4241-ac40-a6c37072ba36 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:20.875267 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d8b9fe29-b868-4241-ac40-a6c37072ba36 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:20.879254 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d8b9fe29-b868-4241-ac40-a6c37072ba36 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:20.893746 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d841999d-a62f-4614-a2b9-9d748da6530b tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action" status: 200 len: 32641 microversion: 2.1 time: 0.083344 Jan 15 20:59:20.895984 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1619/3218] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:59:20 2022] POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action => generated 32641 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:59:20.916011 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-0e6cc9ef-21f6-4dba-8b08-5260e4815a38 tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-336745989", "metadata": {"image_type": "test"}}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:20.919628 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-0e6cc9ef-21f6-4dba-8b08-5260e4815a38 tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] [instance: 9a181c6f-84ca-409d-93f3-3a86ba0f1b6d] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:20.931507 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0e6cc9ef-21f6-4dba-8b08-5260e4815a38 tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:20.932478 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0e6cc9ef-21f6-4dba-8b08-5260e4815a38 tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:20.933856 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0e6cc9ef-21f6-4dba-8b08-5260e4815a38 tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:20.934499 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0e6cc9ef-21f6-4dba-8b08-5260e4815a38 tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:20.937627 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-d8b9fe29-b868-4241-ac40-a6c37072ba36 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] HTTP exception thrown: Cannot 'rebuild' instance 689dd504-e36e-41d0-a461-acce91952e7e while it is in vm_state rescued Jan 15 20:59:20.938308 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d8b9fe29-b868-4241-ac40-a6c37072ba36 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Returning 409 to user: Cannot 'rebuild' instance 689dd504-e36e-41d0-a461-acce91952e7e while it is in vm_state rescued {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:59:20.939019 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d8b9fe29-b868-4241-ac40-a6c37072ba36 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] 10.222.0.46 "POST /compute/v2.1/servers/689dd504-e36e-41d0-a461-acce91952e7e/action" status: 409 len: 146 microversion: 2.1 time: 0.096594 Jan 15 20:59:20.940168 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1600/3219] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:59:20 2022] POST /compute/v2.1/servers/689dd504-e36e-41d0-a461-acce91952e7e/action => generated 146 bytes in 107 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jan 15 20:59:20.957983 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-0e6cc9ef-21f6-4dba-8b08-5260e4815a38 tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] HTTP exception thrown: Instance 9a181c6f-84ca-409d-93f3-3a86ba0f1b6d could not be found. Jan 15 20:59:20.958827 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-0e6cc9ef-21f6-4dba-8b08-5260e4815a38 tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] Returning 404 to user: Instance 9a181c6f-84ca-409d-93f3-3a86ba0f1b6d could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:59:20.960043 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-0e6cc9ef-21f6-4dba-8b08-5260e4815a38 tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] 10.222.0.46 "POST /compute/v2.1/servers/9a181c6f-84ca-409d-93f3-3a86ba0f1b6d/action" status: 404 len: 111 microversion: 2.1 time: 0.061013 Jan 15 20:59:20.981457 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9e33e8a4-c0af-4d92-8a5f-606dc0926a4e tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-33392467", "metadata": {"image_type": "test"}}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:20.982564 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-9e33e8a4-c0af-4d92-8a5f-606dc0926a4e tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] Failed to fetch instance by id tempest-invalid-964090732 {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2871}} Jan 15 20:59:20.983073 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-9e33e8a4-c0af-4d92-8a5f-606dc0926a4e tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] HTTP exception thrown: Instance tempest-invalid-964090732 could not be found. Jan 15 20:59:20.983896 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9e33e8a4-c0af-4d92-8a5f-606dc0926a4e tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] Returning 404 to user: Instance tempest-invalid-964090732 could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:59:20.984490 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-9e33e8a4-c0af-4d92-8a5f-606dc0926a4e tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] 10.222.0.46 "POST /compute/v2.1/servers/tempest-invalid-964090732/action" status: 404 len: 100 microversion: 2.1 time: 0.006870 Jan 15 20:59:20.990073 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1601/3221] 10.222.0.46 () {60 vars in 1245 bytes} [Sat Jan 15 20:59:20 2022] POST /compute/v2.1/servers/tempest-invalid-964090732/action => generated 100 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:59:20.990771 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1620/3221] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Jan 15 20:59:20 2022] POST /compute/v2.1/servers/9a181c6f-84ca-409d-93f3-3a86ba0f1b6d/action => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:59:21.001215 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-797a02fa-d05e-4ab7-a4e7-ed72449a2306 tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1961289899"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:21.002045 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c386cccb-6e23-45d6-8e0e-88d607d03593 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:21.002852 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c386cccb-6e23-45d6-8e0e-88d607d03593 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] [instance: 5e93486c-7c77-4855-85f4-2bc8bcf4832f] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:21.004090 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-797a02fa-d05e-4ab7-a4e7-ed72449a2306 tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2871}} Jan 15 20:59:21.007671 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-797a02fa-d05e-4ab7-a4e7-ed72449a2306 tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jan 15 20:59:21.008507 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-797a02fa-d05e-4ab7-a4e7-ed72449a2306 tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:59:21.009593 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-797a02fa-d05e-4ab7-a4e7-ed72449a2306 tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] 10.222.0.46 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.015805 Jan 15 20:59:21.018546 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1621/3222] 10.222.0.46 () {60 vars in 1274 bytes} [Sat Jan 15 20:59:20 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:59:21.024737 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d24cd7ec-64f3-4919-abed-22e5190195b5 tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1150829482"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:21.027539 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d24cd7ec-64f3-4919-abed-22e5190195b5 tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2871}} Jan 15 20:59:21.028258 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-d24cd7ec-64f3-4919-abed-22e5190195b5 tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jan 15 20:59:21.029228 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d24cd7ec-64f3-4919-abed-22e5190195b5 tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:59:21.030331 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d24cd7ec-64f3-4919-abed-22e5190195b5 tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] 10.222.0.46 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.010533 Jan 15 20:59:21.036493 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c386cccb-6e23-45d6-8e0e-88d607d03593 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:21.037338 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1622/3223] 10.222.0.46 () {60 vars in 1280 bytes} [Sat Jan 15 20:59:21 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:59:21.042152 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-625fb6c3-9fca-4cc5-a204-42b58ed7955a tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:21.042925 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-625fb6c3-9fca-4cc5-a204-42b58ed7955a tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] [instance: 9a181c6f-84ca-409d-93f3-3a86ba0f1b6d] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:21.043575 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c386cccb-6e23-45d6-8e0e-88d607d03593 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:21.044884 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c386cccb-6e23-45d6-8e0e-88d607d03593 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:21.045339 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c386cccb-6e23-45d6-8e0e-88d607d03593 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:21.050328 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-625fb6c3-9fca-4cc5-a204-42b58ed7955a tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:21.054920 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-625fb6c3-9fca-4cc5-a204-42b58ed7955a tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:21.055978 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-625fb6c3-9fca-4cc5-a204-42b58ed7955a tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:21.056644 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-625fb6c3-9fca-4cc5-a204-42b58ed7955a tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:21.078600 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-625fb6c3-9fca-4cc5-a204-42b58ed7955a tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] HTTP exception thrown: Instance 9a181c6f-84ca-409d-93f3-3a86ba0f1b6d could not be found. Jan 15 20:59:21.079759 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-625fb6c3-9fca-4cc5-a204-42b58ed7955a tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] Returning 404 to user: Instance 9a181c6f-84ca-409d-93f3-3a86ba0f1b6d could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:59:21.080814 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-625fb6c3-9fca-4cc5-a204-42b58ed7955a tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] 10.222.0.46 "DELETE /compute/v2.1/servers/9a181c6f-84ca-409d-93f3-3a86ba0f1b6d" status: 404 len: 111 microversion: 2.1 time: 0.042639 Jan 15 20:59:21.085246 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1623/3224] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 20:59:21 2022] DELETE /compute/v2.1/servers/9a181c6f-84ca-409d-93f3-3a86ba0f1b6d => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:59:21.090509 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-831b92e5-c468-4f42-a213-92a68b825ba6 tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:21.092059 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-831b92e5-c468-4f42-a213-92a68b825ba6 tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] [instance: 9a181c6f-84ca-409d-93f3-3a86ba0f1b6d] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:21.099994 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-831b92e5-c468-4f42-a213-92a68b825ba6 tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:21.100756 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-831b92e5-c468-4f42-a213-92a68b825ba6 tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:21.103527 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-831b92e5-c468-4f42-a213-92a68b825ba6 tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:21.104331 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-831b92e5-c468-4f42-a213-92a68b825ba6 tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:21.141869 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-831b92e5-c468-4f42-a213-92a68b825ba6 tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] HTTP exception thrown: Instance 9a181c6f-84ca-409d-93f3-3a86ba0f1b6d could not be found. Jan 15 20:59:21.143362 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-831b92e5-c468-4f42-a213-92a68b825ba6 tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] Returning 404 to user: Instance 9a181c6f-84ca-409d-93f3-3a86ba0f1b6d could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:59:21.146182 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-831b92e5-c468-4f42-a213-92a68b825ba6 tempest-ImagesNegativeTestJSON-329973163 tempest-ImagesNegativeTestJSON-329973163-project] 10.222.0.46 "GET /compute/v2.1/servers/9a181c6f-84ca-409d-93f3-3a86ba0f1b6d" status: 404 len: 111 microversion: 2.1 time: 0.058498 Jan 15 20:59:21.154797 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1624/3225] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:21 2022] GET /compute/v2.1/servers/9a181c6f-84ca-409d-93f3-3a86ba0f1b6d => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:59:21.300486 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5513c5fe-2ea9-4aaf-8451-2e6de0a6e348 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:21.301140 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-5513c5fe-2ea9-4aaf-8451-2e6de0a6e348 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: c8986b09-8342-4290-87be-22cece488c73] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:21.319099 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5513c5fe-2ea9-4aaf-8451-2e6de0a6e348 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:21.321573 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5513c5fe-2ea9-4aaf-8451-2e6de0a6e348 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:21.322535 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5513c5fe-2ea9-4aaf-8451-2e6de0a6e348 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:21.324410 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5513c5fe-2ea9-4aaf-8451-2e6de0a6e348 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:22.076364 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-5513c5fe-2ea9-4aaf-8451-2e6de0a6e348 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8f9c6ea7f6496792258d683640c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a75218d537c4d63874297261bec70ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:22.090685 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5513c5fe-2ea9-4aaf-8451-2e6de0a6e348 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] 10.222.0.46 "GET /compute/v2.1/servers/c8986b09-8342-4290-87be-22cece488c73" status: 200 len: 1278 microversion: 2.1 time: 0.795248 Jan 15 20:59:22.093079 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1625/3226] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:21 2022] GET /compute/v2.1/servers/c8986b09-8342-4290-87be-22cece488c73 => generated 1278 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:59:22.125974 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-71508a6e-c2cb-4933-85a8-a9073f316189 tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:22.126667 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-71508a6e-c2cb-4933-85a8-a9073f316189 tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] [instance: 7c93f609-7034-418c-95ac-eb1589a1cb4b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:22.145238 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-71508a6e-c2cb-4933-85a8-a9073f316189 tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:22.145697 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-71508a6e-c2cb-4933-85a8-a9073f316189 tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:22.146517 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-71508a6e-c2cb-4933-85a8-a9073f316189 tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:22.146961 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-71508a6e-c2cb-4933-85a8-a9073f316189 tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:22.357934 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-c386cccb-6e23-45d6-8e0e-88d607d03593 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f38865f66e433090132a8a09d44774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16b035e629e4eb89850c2871a128781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:22.370635 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c386cccb-6e23-45d6-8e0e-88d607d03593 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] 10.222.0.46 "GET /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f" status: 200 len: 1578 microversion: 2.1 time: 1.377167 Jan 15 20:59:22.387456 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1602/3227] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:20 2022] GET /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f => generated 1578 bytes in 1396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:59:22.395777 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-6f26d135-2674-495d-921a-14369fc9a496 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:22.404599 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-6f26d135-2674-495d-921a-14369fc9a496 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:22.411441 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6f26d135-2674-495d-921a-14369fc9a496 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:22.411897 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6f26d135-2674-495d-921a-14369fc9a496 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:22.414652 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6f26d135-2674-495d-921a-14369fc9a496 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:22.416540 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6f26d135-2674-495d-921a-14369fc9a496 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:22.496640 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-6f26d135-2674-495d-921a-14369fc9a496 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action" status: 200 len: 32641 microversion: 2.1 time: 0.107803 Jan 15 20:59:22.497780 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1603/3228] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:59:22 2022] POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action => generated 32641 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:59:22.502809 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-0d07ef01-8636-4ffd-a8e2-f6660479f839 req-1b4357c7-76cd-4201-aafd-0fe5ca6b41b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c93f609-7034-418c-95ac-eb1589a1cb4b", "name": "network-vif-plugged", "status": "completed", "tag": "91ff1980-18eb-4ad0-9fb9-080ce1912c6f"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:22.504337 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:59:22.504337 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:59:22.530313 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-0d07ef01-8636-4ffd-a8e2-f6660479f839 req-1b4357c7-76cd-4201-aafd-0fe5ca6b41b3 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:22.530987 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-0d07ef01-8636-4ffd-a8e2-f6660479f839 req-1b4357c7-76cd-4201-aafd-0fe5ca6b41b3 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:22.594049 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-0d07ef01-8636-4ffd-a8e2-f6660479f839 req-1b4357c7-76cd-4201-aafd-0fe5ca6b41b3 service nova] Creating event network-vif-plugged:91ff1980-18eb-4ad0-9fb9-080ce1912c6f for instance 7c93f609-7034-418c-95ac-eb1589a1cb4b on nch1-master-1 Jan 15 20:59:22.607728 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-0d07ef01-8636-4ffd-a8e2-f6660479f839 req-1b4357c7-76cd-4201-aafd-0fe5ca6b41b3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108573 Jan 15 20:59:22.608584 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1604/3229] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:59:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:59:22.647600 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-192a5507-97e7-4fce-b8ec-5b97af776184 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:22.649167 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-192a5507-97e7-4fce-b8ec-5b97af776184 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] [instance: 5e93486c-7c77-4855-85f4-2bc8bcf4832f] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:22.681768 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-192a5507-97e7-4fce-b8ec-5b97af776184 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:22.684328 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-192a5507-97e7-4fce-b8ec-5b97af776184 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:22.685320 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-192a5507-97e7-4fce-b8ec-5b97af776184 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:22.685873 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-192a5507-97e7-4fce-b8ec-5b97af776184 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:22.824344 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-71508a6e-c2cb-4933-85a8-a9073f316189 tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b92cf3d63e14307ac083b6560bdcc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd976820970ac45138c6bf2da811786c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:22.835050 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-71508a6e-c2cb-4933-85a8-a9073f316189 tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] 10.222.0.46 "GET /compute/v2.1/servers/7c93f609-7034-418c-95ac-eb1589a1cb4b" status: 200 len: 1322 microversion: 2.1 time: 0.739508 Jan 15 20:59:22.847821 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1626/3230] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:22 2022] GET /compute/v2.1/servers/7c93f609-7034-418c-95ac-eb1589a1cb4b => generated 1322 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:59:22.950316 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-192a5507-97e7-4fce-b8ec-5b97af776184 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] 10.222.0.46 "GET /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.334516 Jan 15 20:59:22.951131 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1605/3231] 10.222.0.46 () {58 vars in 1274 bytes} [Sat Jan 15 20:59:22 2022] GET /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/os-interface => generated 285 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:59:23.109606 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ad1a9651-7e75-4097-948e-21640c5b14e8 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:23.110413 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ad1a9651-7e75-4097-948e-21640c5b14e8 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: c8986b09-8342-4290-87be-22cece488c73] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:23.124143 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ad1a9651-7e75-4097-948e-21640c5b14e8 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:23.124804 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ad1a9651-7e75-4097-948e-21640c5b14e8 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:23.127742 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ad1a9651-7e75-4097-948e-21640c5b14e8 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:23.128481 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ad1a9651-7e75-4097-948e-21640c5b14e8 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:23.509560 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-6a5e671d-c003-4720-aaf9-62c395998006 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:23.511808 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-6a5e671d-c003-4720-aaf9-62c395998006 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:23.530123 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6a5e671d-c003-4720-aaf9-62c395998006 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:23.530856 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6a5e671d-c003-4720-aaf9-62c395998006 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:23.534179 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6a5e671d-c003-4720-aaf9-62c395998006 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:23.536673 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6a5e671d-c003-4720-aaf9-62c395998006 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:23.626982 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-6a5e671d-c003-4720-aaf9-62c395998006 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action" status: 200 len: 32641 microversion: 2.1 time: 0.122871 Jan 15 20:59:23.630142 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1606/3232] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:59:23 2022] POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action => generated 32641 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:59:23.644001 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0be81b91-1c1a-49c9-844b-1d33288bd95b tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:23.645558 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-0be81b91-1c1a-49c9-844b-1d33288bd95b tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:23.668039 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0be81b91-1c1a-49c9-844b-1d33288bd95b tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:23.668497 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0be81b91-1c1a-49c9-844b-1d33288bd95b tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:23.669594 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0be81b91-1c1a-49c9-844b-1d33288bd95b tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:23.670042 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0be81b91-1c1a-49c9-844b-1d33288bd95b tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:23.737429 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0be81b91-1c1a-49c9-844b-1d33288bd95b tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 14 microversion: 2.42 time: 0.104727 Jan 15 20:59:23.737429 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1607/3233] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 20:59:23 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 14 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:59:23.742711 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-a3d4cee0-ccb6-4aa2-b3cd-a472286e6e26 req-f801ff31-725e-4587-9086-05863563a01c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1884dd3f-949c-4df3-a977-3f6f5a204fee", "tag": "e3bdb69c-2e57-497e-80bb-2b7d539e87f7"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:23.744203 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:59:23.744203 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:59:23.764248 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-a3d4cee0-ccb6-4aa2-b3cd-a472286e6e26 req-f801ff31-725e-4587-9086-05863563a01c service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:23.764689 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-a3d4cee0-ccb6-4aa2-b3cd-a472286e6e26 req-f801ff31-725e-4587-9086-05863563a01c service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:23.791683 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-a3d4cee0-ccb6-4aa2-b3cd-a472286e6e26 req-f801ff31-725e-4587-9086-05863563a01c service nova] Creating event network-changed:e3bdb69c-2e57-497e-80bb-2b7d539e87f7 for instance 1884dd3f-949c-4df3-a977-3f6f5a204fee on nch2-master-1 Jan 15 20:59:23.797410 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-a3d4cee0-ccb6-4aa2-b3cd-a472286e6e26 req-f801ff31-725e-4587-9086-05863563a01c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058818 Jan 15 20:59:23.798022 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1608/3234] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:59:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:59:23.805189 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-03574fd4-0e9d-4bb5-ad4b-fbe9588db23b tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:23.805189 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-03574fd4-0e9d-4bb5-ad4b-fbe9588db23b tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] [instance: 689dd504-e36e-41d0-a461-acce91952e7e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:23.810992 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-03574fd4-0e9d-4bb5-ad4b-fbe9588db23b tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:23.811454 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-03574fd4-0e9d-4bb5-ad4b-fbe9588db23b tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:23.812310 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-03574fd4-0e9d-4bb5-ad4b-fbe9588db23b tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:23.812750 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-03574fd4-0e9d-4bb5-ad4b-fbe9588db23b tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:23.873120 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-03574fd4-0e9d-4bb5-ad4b-fbe9588db23b tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] [instance: 689dd504-e36e-41d0-a461-acce91952e7e] Going to try to terminate instance {{(pid=129366) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 20:59:23.903792 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-ad1a9651-7e75-4097-948e-21640c5b14e8 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8f9c6ea7f6496792258d683640c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a75218d537c4d63874297261bec70ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:23.917138 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ad1a9651-7e75-4097-948e-21640c5b14e8 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] 10.222.0.46 "GET /compute/v2.1/servers/c8986b09-8342-4290-87be-22cece488c73" status: 200 len: 1276 microversion: 2.1 time: 0.811017 Jan 15 20:59:23.918079 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1627/3235] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:23 2022] GET /compute/v2.1/servers/c8986b09-8342-4290-87be-22cece488c73 => generated 1276 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:59:23.939906 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e8edbaf5-f104-474b-a89b-5c0d8d819111 tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:23.940831 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e8edbaf5-f104-474b-a89b-5c0d8d819111 tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] [instance: 7c93f609-7034-418c-95ac-eb1589a1cb4b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:23.961212 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e8edbaf5-f104-474b-a89b-5c0d8d819111 tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:23.966522 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e8edbaf5-f104-474b-a89b-5c0d8d819111 tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:23.968771 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e8edbaf5-f104-474b-a89b-5c0d8d819111 tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:23.969906 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e8edbaf5-f104-474b-a89b-5c0d8d819111 tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:24.044150 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-03574fd4-0e9d-4bb5-ad4b-fbe9588db23b tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] 10.222.0.46 "DELETE /compute/v2.1/servers/689dd504-e36e-41d0-a461-acce91952e7e" status: 204 len: 0 microversion: 2.1 time: 0.244081 Jan 15 20:59:24.046365 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1609/3236] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 20:59:23 2022] DELETE /compute/v2.1/servers/689dd504-e36e-41d0-a461-acce91952e7e => generated 0 bytes in 248 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 20:59:24.061771 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b9cdc270-8c47-47d5-80cb-cd697f5dd316 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:24.062698 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b9cdc270-8c47-47d5-80cb-cd697f5dd316 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] [instance: 689dd504-e36e-41d0-a461-acce91952e7e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:24.077168 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b9cdc270-8c47-47d5-80cb-cd697f5dd316 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:24.077622 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b9cdc270-8c47-47d5-80cb-cd697f5dd316 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:24.078437 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b9cdc270-8c47-47d5-80cb-cd697f5dd316 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:24.083577 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b9cdc270-8c47-47d5-80cb-cd697f5dd316 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:24.597540 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-e8edbaf5-f104-474b-a89b-5c0d8d819111 tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b92cf3d63e14307ac083b6560bdcc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd976820970ac45138c6bf2da811786c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:24.613467 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e8edbaf5-f104-474b-a89b-5c0d8d819111 tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] 10.222.0.46 "GET /compute/v2.1/servers/7c93f609-7034-418c-95ac-eb1589a1cb4b" status: 200 len: 1322 microversion: 2.1 time: 0.691447 Jan 15 20:59:24.614160 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1628/3237] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:23 2022] GET /compute/v2.1/servers/7c93f609-7034-418c-95ac-eb1589a1cb4b => generated 1322 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:59:24.639471 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ed1ad867-abde-4aae-8a1a-9573d67e1452 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:24.640239 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-b9cdc270-8c47-47d5-80cb-cd697f5dd316 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05483ff6eec84f78a091b29cfbcf61f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a6720be5fb4de7bcd77cc7ef9d8000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:24.640887 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ed1ad867-abde-4aae-8a1a-9573d67e1452 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:24.649573 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b9cdc270-8c47-47d5-80cb-cd697f5dd316 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] 10.222.0.46 "GET /compute/v2.1/servers/689dd504-e36e-41d0-a461-acce91952e7e" status: 200 len: 1508 microversion: 2.1 time: 0.598766 Jan 15 20:59:24.651172 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ed1ad867-abde-4aae-8a1a-9573d67e1452 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:24.651845 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ed1ad867-abde-4aae-8a1a-9573d67e1452 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:24.652741 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ed1ad867-abde-4aae-8a1a-9573d67e1452 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:24.655248 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1610/3238] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:24 2022] GET /compute/v2.1/servers/689dd504-e36e-41d0-a461-acce91952e7e => generated 1508 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:59:24.655771 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ed1ad867-abde-4aae-8a1a-9573d67e1452 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:24.746097 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ed1ad867-abde-4aae-8a1a-9573d67e1452 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action" status: 200 len: 32641 microversion: 2.1 time: 0.110139 Jan 15 20:59:24.747391 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1629/3239] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:59:24 2022] POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action => generated 32641 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 20:59:24.763660 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c35b8dfb-c966-4e01-ae80-6556c8609f6c tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:24.767551 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c35b8dfb-c966-4e01-ae80-6556c8609f6c tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:24.791372 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c35b8dfb-c966-4e01-ae80-6556c8609f6c tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:24.791782 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c35b8dfb-c966-4e01-ae80-6556c8609f6c tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:24.792597 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c35b8dfb-c966-4e01-ae80-6556c8609f6c tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:24.793077 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c35b8dfb-c966-4e01-ae80-6556c8609f6c tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:24.888515 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c35b8dfb-c966-4e01-ae80-6556c8609f6c tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 14 microversion: 2.42 time: 0.139393 Jan 15 20:59:24.890937 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1630/3240] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 20:59:24 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 14 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:59:24.942149 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-7d771fe9-9338-434f-bcba-09353f28a4bf tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:24.943350 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-7d771fe9-9338-434f-bcba-09353f28a4bf tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: c8986b09-8342-4290-87be-22cece488c73] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:24.965176 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7d771fe9-9338-434f-bcba-09353f28a4bf tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:24.967710 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7d771fe9-9338-434f-bcba-09353f28a4bf tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:24.968727 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7d771fe9-9338-434f-bcba-09353f28a4bf tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:24.970123 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7d771fe9-9338-434f-bcba-09353f28a4bf tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:24.991835 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9c4c7661-abfc-4a67-bbfa-20bf46a17f9d tempest-ListImageFiltersNegativeTestJSON-890779479 tempest-ListImageFiltersNegativeTestJSON-890779479-project] Calling method '.version_select at 0x7f30c8817a60>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:25.017369 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-9c4c7661-abfc-4a67-bbfa-20bf46a17f9d tempest-ListImageFiltersNegativeTestJSON-890779479 tempest-ListImageFiltersNegativeTestJSON-890779479-project] HTTP exception thrown: Image not found. Jan 15 20:59:25.018597 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9c4c7661-abfc-4a67-bbfa-20bf46a17f9d tempest-ListImageFiltersNegativeTestJSON-890779479 tempest-ListImageFiltersNegativeTestJSON-890779479-project] Returning 404 to user: Image not found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:59:25.019443 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-9c4c7661-abfc-4a67-bbfa-20bf46a17f9d tempest-ListImageFiltersNegativeTestJSON-890779479 tempest-ListImageFiltersNegativeTestJSON-890779479-project] 10.222.0.46 "GET /compute/v2.1/images/3d51c48e-415b-4792-a0d0-2bd9d792ef34" status: 404 len: 62 microversion: 2.1 time: 0.305387 Jan 15 20:59:25.021126 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1611/3241] 10.222.0.46 () {58 vars in 1232 bytes} [Sat Jan 15 20:59:24 2022] GET /compute/v2.1/images/3d51c48e-415b-4792-a0d0-2bd9d792ef34 => generated 62 bytes in 308 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jan 15 20:59:25.202112 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-7d771fe9-9338-434f-bcba-09353f28a4bf tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8f9c6ea7f6496792258d683640c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a75218d537c4d63874297261bec70ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:25.214213 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-7d771fe9-9338-434f-bcba-09353f28a4bf tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] 10.222.0.46 "GET /compute/v2.1/servers/c8986b09-8342-4290-87be-22cece488c73" status: 200 len: 1276 microversion: 2.1 time: 0.280298 Jan 15 20:59:25.215190 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1631/3242] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:24 2022] GET /compute/v2.1/servers/c8986b09-8342-4290-87be-22cece488c73 => generated 1276 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:59:25.636808 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8fdb9427-0dee-4640-8fdb-55f9e068bf3f tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:25.641659 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-8fdb9427-0dee-4640-8fdb-55f9e068bf3f tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] [instance: 7c93f609-7034-418c-95ac-eb1589a1cb4b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:25.651980 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8fdb9427-0dee-4640-8fdb-55f9e068bf3f tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:25.652744 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8fdb9427-0dee-4640-8fdb-55f9e068bf3f tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:25.656671 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8fdb9427-0dee-4640-8fdb-55f9e068bf3f tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:25.657475 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8fdb9427-0dee-4640-8fdb-55f9e068bf3f tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:25.678168 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-7d26fbd0-db22-469a-b373-e503828426b9 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:25.680110 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-7d26fbd0-db22-469a-b373-e503828426b9 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] [instance: 689dd504-e36e-41d0-a461-acce91952e7e] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:25.693730 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7d26fbd0-db22-469a-b373-e503828426b9 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:25.696144 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7d26fbd0-db22-469a-b373-e503828426b9 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:25.697116 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7d26fbd0-db22-469a-b373-e503828426b9 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:25.701521 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7d26fbd0-db22-469a-b373-e503828426b9 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:26.621011 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-8fdb9427-0dee-4640-8fdb-55f9e068bf3f tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b92cf3d63e14307ac083b6560bdcc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd976820970ac45138c6bf2da811786c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:26.636071 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-8fdb9427-0dee-4640-8fdb-55f9e068bf3f tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] 10.222.0.46 "GET /compute/v2.1/servers/7c93f609-7034-418c-95ac-eb1589a1cb4b" status: 200 len: 1519 microversion: 2.1 time: 1.008179 Jan 15 20:59:26.638945 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1612/3243] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:25 2022] GET /compute/v2.1/servers/7c93f609-7034-418c-95ac-eb1589a1cb4b => generated 1519 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:59:26.646445 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-7d26fbd0-db22-469a-b373-e503828426b9 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05483ff6eec84f78a091b29cfbcf61f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a6720be5fb4de7bcd77cc7ef9d8000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:26.665701 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-7d26fbd0-db22-469a-b373-e503828426b9 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] 10.222.0.46 "GET /compute/v2.1/servers/689dd504-e36e-41d0-a461-acce91952e7e" status: 200 len: 1508 microversion: 2.1 time: 0.989578 Jan 15 20:59:26.670523 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1632/3244] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:25 2022] GET /compute/v2.1/servers/689dd504-e36e-41d0-a461-acce91952e7e => generated 1508 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:59:26.674795 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-92eb09e4-7a4a-4cdd-a7c5-1bc2a7111cbc tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:26.683802 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-92eb09e4-7a4a-4cdd-a7c5-1bc2a7111cbc tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:26.686637 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-bee25016-9ab2-4d56-b9f4-432d58fa94c4 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:26.687605 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-bee25016-9ab2-4d56-b9f4-432d58fa94c4 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:26.699313 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-92eb09e4-7a4a-4cdd-a7c5-1bc2a7111cbc tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:26.702383 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-92eb09e4-7a4a-4cdd-a7c5-1bc2a7111cbc tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:26.704614 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-92eb09e4-7a4a-4cdd-a7c5-1bc2a7111cbc tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:26.706198 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bee25016-9ab2-4d56-b9f4-432d58fa94c4 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:26.706803 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-92eb09e4-7a4a-4cdd-a7c5-1bc2a7111cbc tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:26.710985 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bee25016-9ab2-4d56-b9f4-432d58fa94c4 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:26.712356 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bee25016-9ab2-4d56-b9f4-432d58fa94c4 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:26.713343 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bee25016-9ab2-4d56-b9f4-432d58fa94c4 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:26.800343 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-92eb09e4-7a4a-4cdd-a7c5-1bc2a7111cbc tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action" status: 200 len: 32641 microversion: 2.1 time: 0.156025 Jan 15 20:59:26.806269 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1613/3245] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:59:26 2022] POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action => generated 32641 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:59:26.810903 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-bee25016-9ab2-4d56-b9f4-432d58fa94c4 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 14 microversion: 2.42 time: 0.138030 Jan 15 20:59:26.811899 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1633/3246] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 20:59:26 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 14 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:59:26.816652 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a52be4ec-f9de-4711-87e1-9d2122700411 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:26.817633 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a52be4ec-f9de-4711-87e1-9d2122700411 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: c8986b09-8342-4290-87be-22cece488c73] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:26.818552 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-afe6ca0f-94ed-4a75-9c0d-16df7a81ebde tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:26.822158 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-afe6ca0f-94ed-4a75-9c0d-16df7a81ebde tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] [instance: 5e93486c-7c77-4855-85f4-2bc8bcf4832f] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:26.827763 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a52be4ec-f9de-4711-87e1-9d2122700411 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:26.829175 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a52be4ec-f9de-4711-87e1-9d2122700411 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:26.830167 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a52be4ec-f9de-4711-87e1-9d2122700411 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:26.830925 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a52be4ec-f9de-4711-87e1-9d2122700411 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:26.847201 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-afe6ca0f-94ed-4a75-9c0d-16df7a81ebde tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:26.847676 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-afe6ca0f-94ed-4a75-9c0d-16df7a81ebde tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:26.848495 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-afe6ca0f-94ed-4a75-9c0d-16df7a81ebde tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:26.848965 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-afe6ca0f-94ed-4a75-9c0d-16df7a81ebde tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:26.922294 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-afe6ca0f-94ed-4a75-9c0d-16df7a81ebde tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] 10.222.0.46 "POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action" status: 200 len: 14 microversion: 2.1 time: 0.108664 Jan 15 20:59:26.923019 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1634/3247] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:59:26 2022] POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action => generated 14 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 20:59:26.935701 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-7924ef57-8b07-4784-8a45-1e16f9d9ce40 req-2300d13f-1ccf-41fc-9a52-1507b8978a3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e93486c-7c77-4855-85f4-2bc8bcf4832f", "tag": "93c9ee82-e08e-44b9-a8c0-f6e275b08b7b"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:26.937269 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:59:26.937269 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:59:26.956138 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-7924ef57-8b07-4784-8a45-1e16f9d9ce40 req-2300d13f-1ccf-41fc-9a52-1507b8978a3f service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:26.972820 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-7924ef57-8b07-4784-8a45-1e16f9d9ce40 req-2300d13f-1ccf-41fc-9a52-1507b8978a3f service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:27.004107 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-7924ef57-8b07-4784-8a45-1e16f9d9ce40 req-2300d13f-1ccf-41fc-9a52-1507b8978a3f service nova] Creating event network-changed:93c9ee82-e08e-44b9-a8c0-f6e275b08b7b for instance 5e93486c-7c77-4855-85f4-2bc8bcf4832f on nch2-master-1 Jan 15 20:59:27.015547 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-7924ef57-8b07-4784-8a45-1e16f9d9ce40 req-2300d13f-1ccf-41fc-9a52-1507b8978a3f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087973 Jan 15 20:59:27.016611 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1635/3248] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:59:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:59:27.033465 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9b3006c3-a15b-4c1a-866c-b02c653f91ee tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:27.034135 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-9b3006c3-a15b-4c1a-866c-b02c653f91ee tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] [instance: 7c93f609-7034-418c-95ac-eb1589a1cb4b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:27.048420 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9b3006c3-a15b-4c1a-866c-b02c653f91ee tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:27.048926 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9b3006c3-a15b-4c1a-866c-b02c653f91ee tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:27.049719 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9b3006c3-a15b-4c1a-866c-b02c653f91ee tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:27.055289 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9b3006c3-a15b-4c1a-866c-b02c653f91ee tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:27.154367 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-9b3006c3-a15b-4c1a-866c-b02c653f91ee tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] HTTP exception thrown: Action 999 not found Jan 15 20:59:27.161474 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9b3006c3-a15b-4c1a-866c-b02c653f91ee tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] Returning 404 to user: Action 999 not found {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:59:27.163696 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-9b3006c3-a15b-4c1a-866c-b02c653f91ee tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] 10.222.0.46 "GET /compute/v2.1/servers/7c93f609-7034-418c-95ac-eb1589a1cb4b/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.141475 Jan 15 20:59:27.164535 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1636/3249] 10.222.0.46 () {58 vars in 1307 bytes} [Sat Jan 15 20:59:27 2022] GET /compute/v2.1/servers/7c93f609-7034-418c-95ac-eb1589a1cb4b/os-instance-actions/999 => generated 66 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jan 15 20:59:27.175987 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ec7c343c-f94d-49a2-abe9-f354cdc159b9 tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] Calling method '.version_select at 0x7f30c8535670>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:27.183631 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ec7c343c-f94d-49a2-abe9-f354cdc159b9 tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] [instance: a7c112ca-2d42-4b45-82b6-f6822599d05a] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:27.210626 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-ec7c343c-f94d-49a2-abe9-f354cdc159b9 tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] HTTP exception thrown: Instance a7c112ca-2d42-4b45-82b6-f6822599d05a could not be found. Jan 15 20:59:27.213271 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ec7c343c-f94d-49a2-abe9-f354cdc159b9 tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] Returning 404 to user: Instance a7c112ca-2d42-4b45-82b6-f6822599d05a could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:59:27.223844 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ec7c343c-f94d-49a2-abe9-f354cdc159b9 tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] 10.222.0.46 "GET /compute/v2.1/servers/a7c112ca-2d42-4b45-82b6-f6822599d05a/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.052399 Jan 15 20:59:27.231065 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1637/3250] 10.222.0.46 () {58 vars in 1295 bytes} [Sat Jan 15 20:59:27 2022] GET /compute/v2.1/servers/a7c112ca-2d42-4b45-82b6-f6822599d05a/os-instance-actions => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:59:27.240383 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b1d04b63-6d92-4591-839a-cbb992a1de43 tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:27.241994 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b1d04b63-6d92-4591-839a-cbb992a1de43 tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] [instance: 7c93f609-7034-418c-95ac-eb1589a1cb4b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:27.252437 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b1d04b63-6d92-4591-839a-cbb992a1de43 tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:27.253850 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b1d04b63-6d92-4591-839a-cbb992a1de43 tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:27.256921 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b1d04b63-6d92-4591-839a-cbb992a1de43 tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:27.257989 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b1d04b63-6d92-4591-839a-cbb992a1de43 tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:27.311671 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b1d04b63-6d92-4591-839a-cbb992a1de43 tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] [instance: 7c93f609-7034-418c-95ac-eb1589a1cb4b] Going to try to terminate instance {{(pid=129365) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 20:59:27.494948 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b1d04b63-6d92-4591-839a-cbb992a1de43 tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] 10.222.0.46 "DELETE /compute/v2.1/servers/7c93f609-7034-418c-95ac-eb1589a1cb4b" status: 204 len: 0 microversion: 2.1 time: 0.258152 Jan 15 20:59:27.501672 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1638/3251] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 20:59:27 2022] DELETE /compute/v2.1/servers/7c93f609-7034-418c-95ac-eb1589a1cb4b => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 20:59:27.508760 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-833e26ca-eb1c-4c59-a95d-55c515cc8263 tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:27.509539 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-833e26ca-eb1c-4c59-a95d-55c515cc8263 tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] [instance: 7c93f609-7034-418c-95ac-eb1589a1cb4b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:27.523433 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-833e26ca-eb1c-4c59-a95d-55c515cc8263 tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:27.524062 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-833e26ca-eb1c-4c59-a95d-55c515cc8263 tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:27.524944 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-833e26ca-eb1c-4c59-a95d-55c515cc8263 tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:27.525921 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-833e26ca-eb1c-4c59-a95d-55c515cc8263 tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:27.556547 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-a52be4ec-f9de-4711-87e1-9d2122700411 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8f9c6ea7f6496792258d683640c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a75218d537c4d63874297261bec70ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:27.568170 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a52be4ec-f9de-4711-87e1-9d2122700411 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] 10.222.0.46 "GET /compute/v2.1/servers/c8986b09-8342-4290-87be-22cece488c73" status: 200 len: 1318 microversion: 2.1 time: 0.757884 Jan 15 20:59:27.581968 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1614/3252] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:26 2022] GET /compute/v2.1/servers/c8986b09-8342-4290-87be-22cece488c73 => generated 1318 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:59:27.690711 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-47b3bfb7-a90f-49be-b733-bb59be0d97d6 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:27.691578 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-47b3bfb7-a90f-49be-b733-bb59be0d97d6 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] [instance: 689dd504-e36e-41d0-a461-acce91952e7e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:27.704731 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-47b3bfb7-a90f-49be-b733-bb59be0d97d6 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:27.710956 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-47b3bfb7-a90f-49be-b733-bb59be0d97d6 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:27.712112 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-47b3bfb7-a90f-49be-b733-bb59be0d97d6 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:27.713101 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-47b3bfb7-a90f-49be-b733-bb59be0d97d6 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:28.000260 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-833e26ca-eb1c-4c59-a95d-55c515cc8263 tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b92cf3d63e14307ac083b6560bdcc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd976820970ac45138c6bf2da811786c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:28.008735 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-833e26ca-eb1c-4c59-a95d-55c515cc8263 tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] 10.222.0.46 "GET /compute/v2.1/servers/7c93f609-7034-418c-95ac-eb1589a1cb4b" status: 200 len: 1525 microversion: 2.1 time: 0.505097 Jan 15 20:59:28.019637 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1639/3253] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:27 2022] GET /compute/v2.1/servers/7c93f609-7034-418c-95ac-eb1589a1cb4b => generated 1525 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:59:28.024551 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-421a7950-c5db-4c6f-a93a-d1840b9e7aaf tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:28.025518 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-421a7950-c5db-4c6f-a93a-d1840b9e7aaf tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:28.039859 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-421a7950-c5db-4c6f-a93a-d1840b9e7aaf tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:28.040370 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-421a7950-c5db-4c6f-a93a-d1840b9e7aaf tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:28.041328 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-421a7950-c5db-4c6f-a93a-d1840b9e7aaf tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:28.041777 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-421a7950-c5db-4c6f-a93a-d1840b9e7aaf tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:28.065332 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-47b3bfb7-a90f-49be-b733-bb59be0d97d6 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05483ff6eec84f78a091b29cfbcf61f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a6720be5fb4de7bcd77cc7ef9d8000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:28.074522 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-47b3bfb7-a90f-49be-b733-bb59be0d97d6 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] 10.222.0.46 "GET /compute/v2.1/servers/689dd504-e36e-41d0-a461-acce91952e7e" status: 200 len: 1508 microversion: 2.1 time: 0.388470 Jan 15 20:59:28.077206 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1615/3254] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:27 2022] GET /compute/v2.1/servers/689dd504-e36e-41d0-a461-acce91952e7e => generated 1508 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:59:28.087162 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9fc118fa-cefe-4faa-b9f0-22e14c6a07eb tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:28.094575 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-9fc118fa-cefe-4faa-b9f0-22e14c6a07eb tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:28.111412 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9fc118fa-cefe-4faa-b9f0-22e14c6a07eb tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:28.112505 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9fc118fa-cefe-4faa-b9f0-22e14c6a07eb tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:28.117962 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9fc118fa-cefe-4faa-b9f0-22e14c6a07eb tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:28.118709 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9fc118fa-cefe-4faa-b9f0-22e14c6a07eb tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:28.149844 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-421a7950-c5db-4c6f-a93a-d1840b9e7aaf tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action" status: 200 len: 32641 microversion: 2.1 time: 0.135040 Jan 15 20:59:28.154037 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1640/3255] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:59:28 2022] POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action => generated 32641 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:59:28.161233 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3a9626b4-4482-4b99-88b5-047740d9b5ed tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:28.164098 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-3a9626b4-4482-4b99-88b5-047740d9b5ed tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] [instance: 5e93486c-7c77-4855-85f4-2bc8bcf4832f] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:28.187064 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3a9626b4-4482-4b99-88b5-047740d9b5ed tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:28.187524 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3a9626b4-4482-4b99-88b5-047740d9b5ed tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:28.188324 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3a9626b4-4482-4b99-88b5-047740d9b5ed tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:28.188766 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3a9626b4-4482-4b99-88b5-047740d9b5ed tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:28.223249 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-9fc118fa-cefe-4faa-b9f0-22e14c6a07eb tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 14 microversion: 2.42 time: 0.142373 Jan 15 20:59:28.234417 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1616/3256] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 20:59:28 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 14 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:59:28.284767 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3a9626b4-4482-4b99-88b5-047740d9b5ed tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] 10.222.0.46 "POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action" status: 200 len: 14 microversion: 2.1 time: 0.129213 Jan 15 20:59:28.285858 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1641/3257] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:59:28 2022] POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action => generated 14 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 20:59:28.593841 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e3345f0a-323e-4b5c-87f5-41beb9e3ce9b tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:28.595187 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e3345f0a-323e-4b5c-87f5-41beb9e3ce9b tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: c8986b09-8342-4290-87be-22cece488c73] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:28.612485 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e3345f0a-323e-4b5c-87f5-41beb9e3ce9b tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:28.628809 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e3345f0a-323e-4b5c-87f5-41beb9e3ce9b tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:28.630721 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e3345f0a-323e-4b5c-87f5-41beb9e3ce9b tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:28.635035 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e3345f0a-323e-4b5c-87f5-41beb9e3ce9b tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:29.026963 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-4e2ca11b-b0f3-4e4b-9e63-3abbb84a1ad7 tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:29.027604 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-4e2ca11b-b0f3-4e4b-9e63-3abbb84a1ad7 tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] [instance: 7c93f609-7034-418c-95ac-eb1589a1cb4b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:29.042207 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4e2ca11b-b0f3-4e4b-9e63-3abbb84a1ad7 tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:29.042676 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4e2ca11b-b0f3-4e4b-9e63-3abbb84a1ad7 tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:29.043489 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4e2ca11b-b0f3-4e4b-9e63-3abbb84a1ad7 tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:29.048301 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4e2ca11b-b0f3-4e4b-9e63-3abbb84a1ad7 tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:29.617231 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-e3345f0a-323e-4b5c-87f5-41beb9e3ce9b tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8f9c6ea7f6496792258d683640c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a75218d537c4d63874297261bec70ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:29.639334 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e3345f0a-323e-4b5c-87f5-41beb9e3ce9b tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] 10.222.0.46 "GET /compute/v2.1/servers/c8986b09-8342-4290-87be-22cece488c73" status: 200 len: 1318 microversion: 2.1 time: 1.048996 Jan 15 20:59:29.640654 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-4e2ca11b-b0f3-4e4b-9e63-3abbb84a1ad7 tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b92cf3d63e14307ac083b6560bdcc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd976820970ac45138c6bf2da811786c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:29.643864 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1617/3258] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:28 2022] GET /compute/v2.1/servers/c8986b09-8342-4290-87be-22cece488c73 => generated 1318 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:59:29.658780 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-4e2ca11b-b0f3-4e4b-9e63-3abbb84a1ad7 tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] 10.222.0.46 "GET /compute/v2.1/servers/7c93f609-7034-418c-95ac-eb1589a1cb4b" status: 200 len: 1525 microversion: 2.1 time: 0.636160 Jan 15 20:59:29.659972 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1642/3259] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:29 2022] GET /compute/v2.1/servers/7c93f609-7034-418c-95ac-eb1589a1cb4b => generated 1525 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:59:29.672282 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a8275bb9-a612-4208-b5b8-a8622db88c7d tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:29.673291 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a8275bb9-a612-4208-b5b8-a8622db88c7d tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] [instance: 689dd504-e36e-41d0-a461-acce91952e7e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:29.677185 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-668e6f96-5ebe-49b7-b23b-5712b9275c75 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:29.678264 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-668e6f96-5ebe-49b7-b23b-5712b9275c75 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:29.684988 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a8275bb9-a612-4208-b5b8-a8622db88c7d tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:29.686750 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a8275bb9-a612-4208-b5b8-a8622db88c7d tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:29.689141 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a8275bb9-a612-4208-b5b8-a8622db88c7d tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:29.690741 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a8275bb9-a612-4208-b5b8-a8622db88c7d tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:29.705127 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-668e6f96-5ebe-49b7-b23b-5712b9275c75 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:29.705859 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-668e6f96-5ebe-49b7-b23b-5712b9275c75 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:29.706837 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-668e6f96-5ebe-49b7-b23b-5712b9275c75 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:29.707616 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-668e6f96-5ebe-49b7-b23b-5712b9275c75 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:29.768187 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a8275bb9-a612-4208-b5b8-a8622db88c7d tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:29.768912 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a8275bb9-a612-4208-b5b8-a8622db88c7d tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:29.769819 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.objects.instance [None req-a8275bb9-a612-4208-b5b8-a8622db88c7d tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lazy-loading 'fault' on Instance uuid 689dd504-e36e-41d0-a461-acce91952e7e {{(pid=129366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 20:59:29.780653 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-668e6f96-5ebe-49b7-b23b-5712b9275c75 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action" status: 200 len: 32641 microversion: 2.1 time: 0.119225 Jan 15 20:59:29.784513 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1643/3260] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:59:29 2022] POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action => generated 32641 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:59:29.804596 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-a3d7f715-0563-4350-9e41-7bb530724134 req-08d70d96-800f-4b3e-a06e-ab0d4369bb18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8986b09-8342-4290-87be-22cece488c73", "tag": "7cf5ea2d-375f-4590-af25-836bb895b886"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:29.806368 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:59:29.806368 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:59:29.816895 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-a3d7f715-0563-4350-9e41-7bb530724134 req-08d70d96-800f-4b3e-a06e-ab0d4369bb18 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:29.817815 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-a3d7f715-0563-4350-9e41-7bb530724134 req-08d70d96-800f-4b3e-a06e-ab0d4369bb18 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:29.826209 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-a8275bb9-a612-4208-b5b8-a8622db88c7d tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05483ff6eec84f78a091b29cfbcf61f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a6720be5fb4de7bcd77cc7ef9d8000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:29.836504 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a8275bb9-a612-4208-b5b8-a8622db88c7d tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] 10.222.0.46 "GET /compute/v2.1/servers/689dd504-e36e-41d0-a461-acce91952e7e" status: 200 len: 1311 microversion: 2.1 time: 0.190531 Jan 15 20:59:29.837085 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-a3d7f715-0563-4350-9e41-7bb530724134 req-08d70d96-800f-4b3e-a06e-ab0d4369bb18 service nova] Creating event network-changed:7cf5ea2d-375f-4590-af25-836bb895b886 for instance c8986b09-8342-4290-87be-22cece488c73 on nch1-master-1 Jan 15 20:59:29.837326 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1618/3261] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:29 2022] GET /compute/v2.1/servers/689dd504-e36e-41d0-a461-acce91952e7e => generated 1311 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:59:29.842861 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ef4fdf46-ab85-4a20-8612-d37233f98c06 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:29.844091 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ef4fdf46-ab85-4a20-8612-d37233f98c06 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:29.844446 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-a3d7f715-0563-4350-9e41-7bb530724134 req-08d70d96-800f-4b3e-a06e-ab0d4369bb18 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049015 Jan 15 20:59:29.845621 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1644/3262] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:59:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:59:29.853014 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ef4fdf46-ab85-4a20-8612-d37233f98c06 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:29.853820 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ef4fdf46-ab85-4a20-8612-d37233f98c06 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:29.854912 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ef4fdf46-ab85-4a20-8612-d37233f98c06 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:29.855555 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ef4fdf46-ab85-4a20-8612-d37233f98c06 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:29.932009 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ef4fdf46-ab85-4a20-8612-d37233f98c06 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 14 microversion: 2.42 time: 0.092692 Jan 15 20:59:29.932676 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1619/3263] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 20:59:29 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 14 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:59:29.937760 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-060f1454-f876-44e1-a191-3239c9b624ba tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:29.938931 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-060f1454-f876-44e1-a191-3239c9b624ba tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] [instance: 5e93486c-7c77-4855-85f4-2bc8bcf4832f] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:29.947057 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-060f1454-f876-44e1-a191-3239c9b624ba tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:29.947511 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-060f1454-f876-44e1-a191-3239c9b624ba tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:29.948528 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-060f1454-f876-44e1-a191-3239c9b624ba tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:29.948943 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-060f1454-f876-44e1-a191-3239c9b624ba tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:29.994734 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-060f1454-f876-44e1-a191-3239c9b624ba tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] 10.222.0.46 "POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action" status: 200 len: 14 microversion: 2.1 time: 0.060563 Jan 15 20:59:29.997960 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1620/3264] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:59:29 2022] POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action => generated 14 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 20:59:30.001496 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-ddfb0eb1-a947-4077-8784-7be4675e99df req-547d1f1a-48a4-49b0-af49-b250e734dbc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "689dd504-e36e-41d0-a461-acce91952e7e", "name": "network-vif-deleted", "tag": "a9e5de5f-a2aa-4d5e-9883-5e3f4e4bb682"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:30.005088 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:59:30.005088 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:59:30.023066 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-ddfb0eb1-a947-4077-8784-7be4675e99df req-547d1f1a-48a4-49b0-af49-b250e734dbc9 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:30.025492 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-ddfb0eb1-a947-4077-8784-7be4675e99df req-547d1f1a-48a4-49b0-af49-b250e734dbc9 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:30.054068 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-ddfb0eb1-a947-4077-8784-7be4675e99df req-547d1f1a-48a4-49b0-af49-b250e734dbc9 service nova] Creating event network-vif-deleted:a9e5de5f-a2aa-4d5e-9883-5e3f4e4bb682 for instance 689dd504-e36e-41d0-a461-acce91952e7e on nch1-master-1 Jan 15 20:59:30.079867 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-ddfb0eb1-a947-4077-8784-7be4675e99df req-547d1f1a-48a4-49b0-af49-b250e734dbc9 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082857 Jan 15 20:59:30.080872 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1621/3265] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:59:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:59:30.118898 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-701bcdda-2fc5-43b7-a7d4-53051952e58f tempest-KeyPairsV2TestJSON-1039671826 tempest-KeyPairsV2TestJSON-1039671826-project] Action: 'create', calling method: .version_select at 0x7f30c84e7940>, body: {"keypair": {"name": "tempest-keypair-497219337"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:30.139019 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-701bcdda-2fc5-43b7-a7d4-53051952e58f tempest-KeyPairsV2TestJSON-1039671826 tempest-KeyPairsV2TestJSON-1039671826-project] Getting quotas for project 704703e47c3a475fb7e158bd9830e3b8. Resources: {'key_pairs'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:59:30.144974 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-701bcdda-2fc5-43b7-a7d4-53051952e58f tempest-KeyPairsV2TestJSON-1039671826 tempest-KeyPairsV2TestJSON-1039671826-project] Getting quotas for user 997cea78b0f241fcae9bcfaef9353b45 and project 704703e47c3a475fb7e158bd9830e3b8. Resources: {'key_pairs'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:59:30.604816 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-701bcdda-2fc5-43b7-a7d4-53051952e58f tempest-KeyPairsV2TestJSON-1039671826 tempest-KeyPairsV2TestJSON-1039671826-project] Getting quotas for project 704703e47c3a475fb7e158bd9830e3b8. Resources: {'key_pairs'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:59:30.612602 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-701bcdda-2fc5-43b7-a7d4-53051952e58f tempest-KeyPairsV2TestJSON-1039671826 tempest-KeyPairsV2TestJSON-1039671826-project] Getting quotas for user 997cea78b0f241fcae9bcfaef9353b45 and project 704703e47c3a475fb7e158bd9830e3b8. Resources: {'key_pairs'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:59:30.643244 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-701bcdda-2fc5-43b7-a7d4-53051952e58f tempest-KeyPairsV2TestJSON-1039671826 tempest-KeyPairsV2TestJSON-1039671826-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.796234 Jan 15 20:59:30.643891 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1645/3266] 10.222.0.46 () {60 vars in 1157 bytes} [Sat Jan 15 20:59:29 2022] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:59:30.665440 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-387d3911-3f78-4fc1-9b6d-190c69a7c451 tempest-KeyPairsV2TestJSON-1039671826 tempest-KeyPairsV2TestJSON-1039671826-project] Calling method '.version_select at 0x7f30c8717670>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:30.666223 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3d142cfe-44b3-4a8d-9e16-55436fb4499d tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:30.667302 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-3d142cfe-44b3-4a8d-9e16-55436fb4499d tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: c8986b09-8342-4290-87be-22cece488c73] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:30.675547 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3d142cfe-44b3-4a8d-9e16-55436fb4499d tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:30.675917 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3d142cfe-44b3-4a8d-9e16-55436fb4499d tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:30.676708 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3d142cfe-44b3-4a8d-9e16-55436fb4499d tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:30.677186 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3d142cfe-44b3-4a8d-9e16-55436fb4499d tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:30.680282 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-387d3911-3f78-4fc1-9b6d-190c69a7c451 tempest-KeyPairsV2TestJSON-1039671826 tempest-KeyPairsV2TestJSON-1039671826-project] 10.222.0.46 "GET /compute/v2.1/os-keypairs/tempest-keypair-497219337" status: 200 len: 691 microversion: 2.1 time: 0.029233 Jan 15 20:59:30.681498 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1622/3267] 10.222.0.46 () {58 vars in 1214 bytes} [Sat Jan 15 20:59:30 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-497219337 => generated 691 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 20:59:30.695218 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-846651e8-e1d9-4266-9627-b37f8f3f227c tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:30.696219 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-846651e8-e1d9-4266-9627-b37f8f3f227c tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] [instance: 7c93f609-7034-418c-95ac-eb1589a1cb4b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:30.723885 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-846651e8-e1d9-4266-9627-b37f8f3f227c tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:30.728138 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-846651e8-e1d9-4266-9627-b37f8f3f227c tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:30.729365 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-846651e8-e1d9-4266-9627-b37f8f3f227c tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:30.734358 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-846651e8-e1d9-4266-9627-b37f8f3f227c tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:30.792992 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-846651e8-e1d9-4266-9627-b37f8f3f227c tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:30.793933 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-846651e8-e1d9-4266-9627-b37f8f3f227c tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:30.797451 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.objects.instance [None req-846651e8-e1d9-4266-9627-b37f8f3f227c tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] Lazy-loading 'fault' on Instance uuid 7c93f609-7034-418c-95ac-eb1589a1cb4b {{(pid=129366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 20:59:30.868405 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-846651e8-e1d9-4266-9627-b37f8f3f227c tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b92cf3d63e14307ac083b6560bdcc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd976820970ac45138c6bf2da811786c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:30.883952 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-846651e8-e1d9-4266-9627-b37f8f3f227c tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] 10.222.0.46 "GET /compute/v2.1/servers/7c93f609-7034-418c-95ac-eb1589a1cb4b" status: 200 len: 1312 microversion: 2.1 time: 0.188475 Jan 15 20:59:30.894266 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1623/3268] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:30 2022] GET /compute/v2.1/servers/7c93f609-7034-418c-95ac-eb1589a1cb4b => generated 1312 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:59:30.895918 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9d5b58e2-c2b0-43e6-ba08-2923263d0689 tempest-KeyPairsV2TestJSON-1039671826 tempest-KeyPairsV2TestJSON-1039671826-project] Calling method '.version_select at 0x7f30c870a550>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:30.956335 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-9d5b58e2-c2b0-43e6-ba08-2923263d0689 tempest-KeyPairsV2TestJSON-1039671826 tempest-KeyPairsV2TestJSON-1039671826-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-497219337" status: 202 len: 0 microversion: 2.1 time: 0.066857 Jan 15 20:59:30.957076 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1624/3269] 10.222.0.46 () {58 vars in 1217 bytes} [Sat Jan 15 20:59:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-497219337 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 20:59:30.963147 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-bd8d5f7f-272b-42bf-919d-b7a8cc658016 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:30.970621 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-bd8d5f7f-272b-42bf-919d-b7a8cc658016 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:31.011718 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bd8d5f7f-272b-42bf-919d-b7a8cc658016 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:31.012929 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bd8d5f7f-272b-42bf-919d-b7a8cc658016 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:31.014896 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bd8d5f7f-272b-42bf-919d-b7a8cc658016 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:31.016023 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bd8d5f7f-272b-42bf-919d-b7a8cc658016 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:31.071233 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-3d142cfe-44b3-4a8d-9e16-55436fb4499d tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8f9c6ea7f6496792258d683640c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a75218d537c4d63874297261bec70ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:31.079268 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3d142cfe-44b3-4a8d-9e16-55436fb4499d tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] 10.222.0.46 "GET /compute/v2.1/servers/c8986b09-8342-4290-87be-22cece488c73" status: 200 len: 1318 microversion: 2.1 time: 0.420482 Jan 15 20:59:31.083532 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-bd8d5f7f-272b-42bf-919d-b7a8cc658016 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action" status: 200 len: 32641 microversion: 2.1 time: 0.124906 Jan 15 20:59:31.085199 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1625/3270] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:59:30 2022] POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action => generated 32641 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:59:31.091709 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-00cc1d73-7a0b-42ec-b5ff-9acd7b6c4938 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:31.091936 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1646/3271] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:30 2022] GET /compute/v2.1/servers/c8986b09-8342-4290-87be-22cece488c73 => generated 1318 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:59:31.096759 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b3d9eb34-903d-421e-8c32-097ccdf57e33 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:31.098042 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b3d9eb34-903d-421e-8c32-097ccdf57e33 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:31.105914 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b3d9eb34-903d-421e-8c32-097ccdf57e33 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:31.106221 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-00cc1d73-7a0b-42ec-b5ff-9acd7b6c4938 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] [instance: 689dd504-e36e-41d0-a461-acce91952e7e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:31.106777 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b3d9eb34-903d-421e-8c32-097ccdf57e33 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:31.107776 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b3d9eb34-903d-421e-8c32-097ccdf57e33 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:31.108423 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b3d9eb34-903d-421e-8c32-097ccdf57e33 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:31.116344 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-00cc1d73-7a0b-42ec-b5ff-9acd7b6c4938 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:31.116898 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-00cc1d73-7a0b-42ec-b5ff-9acd7b6c4938 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:31.119699 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-00cc1d73-7a0b-42ec-b5ff-9acd7b6c4938 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:31.120337 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-00cc1d73-7a0b-42ec-b5ff-9acd7b6c4938 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:31.144469 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-00cc1d73-7a0b-42ec-b5ff-9acd7b6c4938 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] HTTP exception thrown: Instance 689dd504-e36e-41d0-a461-acce91952e7e could not be found. Jan 15 20:59:31.151202 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-00cc1d73-7a0b-42ec-b5ff-9acd7b6c4938 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Returning 404 to user: Instance 689dd504-e36e-41d0-a461-acce91952e7e could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:59:31.152105 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-00cc1d73-7a0b-42ec-b5ff-9acd7b6c4938 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] 10.222.0.46 "GET /compute/v2.1/servers/689dd504-e36e-41d0-a461-acce91952e7e" status: 404 len: 111 microversion: 2.1 time: 0.065553 Jan 15 20:59:31.152704 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1626/3272] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:31 2022] GET /compute/v2.1/servers/689dd504-e36e-41d0-a461-acce91952e7e => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:59:31.160705 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0d57005b-17a0-44c2-92b4-21ba7c1a2f7c tempest-KeyPairsV2TestJSON-1039671826 tempest-KeyPairsV2TestJSON-1039671826-project] Action: 'create', calling method: .version_select at 0x7f30c8717820>, body: {"keypair": {"name": "tempest-keypair-1517712404"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:31.191138 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b3d9eb34-903d-421e-8c32-097ccdf57e33 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 8206 microversion: 2.42 time: 0.097886 Jan 15 20:59:31.192964 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1647/3273] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 20:59:31 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 8206 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:59:31.200028 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-0112bddf-0b72-4677-ac0c-54b1edf3731a tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:31.201348 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-0112bddf-0b72-4677-ac0c-54b1edf3731a tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] [instance: 5e93486c-7c77-4855-85f4-2bc8bcf4832f] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:31.210733 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0112bddf-0b72-4677-ac0c-54b1edf3731a tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:31.211659 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0112bddf-0b72-4677-ac0c-54b1edf3731a tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:31.212655 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0112bddf-0b72-4677-ac0c-54b1edf3731a tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:31.213274 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0112bddf-0b72-4677-ac0c-54b1edf3731a tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:31.215895 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-0d57005b-17a0-44c2-92b4-21ba7c1a2f7c tempest-KeyPairsV2TestJSON-1039671826 tempest-KeyPairsV2TestJSON-1039671826-project] Getting quotas for project 704703e47c3a475fb7e158bd9830e3b8. Resources: {'key_pairs'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:59:31.223767 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-0d57005b-17a0-44c2-92b4-21ba7c1a2f7c tempest-KeyPairsV2TestJSON-1039671826 tempest-KeyPairsV2TestJSON-1039671826-project] Getting quotas for user 997cea78b0f241fcae9bcfaef9353b45 and project 704703e47c3a475fb7e158bd9830e3b8. Resources: {'key_pairs'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:59:31.300385 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-0112bddf-0b72-4677-ac0c-54b1edf3731a tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] 10.222.0.46 "POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action" status: 200 len: 14 microversion: 2.1 time: 0.106011 Jan 15 20:59:31.303701 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1648/3274] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:59:31 2022] POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action => generated 14 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 20:59:31.310447 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-80d2d2e4-ec61-4bbc-80b3-2a66917ce41b tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:31.312642 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-80d2d2e4-ec61-4bbc-80b3-2a66917ce41b tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] [instance: e04f7a96-62cb-4aae-9612-aa8df88aef61] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:31.327479 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-80d2d2e4-ec61-4bbc-80b3-2a66917ce41b tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:31.328130 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-80d2d2e4-ec61-4bbc-80b3-2a66917ce41b tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:31.330165 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-80d2d2e4-ec61-4bbc-80b3-2a66917ce41b tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:31.330785 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-80d2d2e4-ec61-4bbc-80b3-2a66917ce41b tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:31.363983 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-80d2d2e4-ec61-4bbc-80b3-2a66917ce41b tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] [instance: e04f7a96-62cb-4aae-9612-aa8df88aef61] Going to try to terminate instance {{(pid=129365) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 20:59:31.462038 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-80d2d2e4-ec61-4bbc-80b3-2a66917ce41b tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] 10.222.0.46 "DELETE /compute/v2.1/servers/e04f7a96-62cb-4aae-9612-aa8df88aef61" status: 204 len: 0 microversion: 2.1 time: 0.155792 Jan 15 20:59:31.463109 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1649/3275] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 20:59:31 2022] DELETE /compute/v2.1/servers/e04f7a96-62cb-4aae-9612-aa8df88aef61 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 20:59:31.477975 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a6eea218-0731-4045-9211-10b9f951699f tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:31.479013 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a6eea218-0731-4045-9211-10b9f951699f tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] [instance: e04f7a96-62cb-4aae-9612-aa8df88aef61] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:31.487625 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a6eea218-0731-4045-9211-10b9f951699f tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:31.488325 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a6eea218-0731-4045-9211-10b9f951699f tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:31.489467 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a6eea218-0731-4045-9211-10b9f951699f tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:31.490208 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a6eea218-0731-4045-9211-10b9f951699f tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:31.503932 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-0d57005b-17a0-44c2-92b4-21ba7c1a2f7c tempest-KeyPairsV2TestJSON-1039671826 tempest-KeyPairsV2TestJSON-1039671826-project] Getting quotas for project 704703e47c3a475fb7e158bd9830e3b8. Resources: {'key_pairs'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:59:31.509463 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-0d57005b-17a0-44c2-92b4-21ba7c1a2f7c tempest-KeyPairsV2TestJSON-1039671826 tempest-KeyPairsV2TestJSON-1039671826-project] Getting quotas for user 997cea78b0f241fcae9bcfaef9353b45 and project 704703e47c3a475fb7e158bd9830e3b8. Resources: {'key_pairs'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:59:31.525247 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0d57005b-17a0-44c2-92b4-21ba7c1a2f7c tempest-KeyPairsV2TestJSON-1039671826 tempest-KeyPairsV2TestJSON-1039671826-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.368433 Jan 15 20:59:31.527071 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1627/3276] 10.222.0.46 () {60 vars in 1157 bytes} [Sat Jan 15 20:59:31 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:59:31.536023 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7062f6db-1914-4ec2-b9e1-9a2644d48661 tempest-KeyPairsV2TestJSON-1039671826 tempest-KeyPairsV2TestJSON-1039671826-project] Calling method '.version_select at 0x7f30c8717ee0>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:31.556557 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7062f6db-1914-4ec2-b9e1-9a2644d48661 tempest-KeyPairsV2TestJSON-1039671826 tempest-KeyPairsV2TestJSON-1039671826-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1517712404" status: 202 len: 0 microversion: 2.1 time: 0.024177 Jan 15 20:59:31.557588 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1628/3277] 10.222.0.46 () {58 vars in 1220 bytes} [Sat Jan 15 20:59:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1517712404 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 15 20:59:31.568454 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-3b4edae0-045a-4755-bb04-9dfaa088d08a tempest-KeyPairsV2TestJSON-1039671826 tempest-KeyPairsV2TestJSON-1039671826-project] Action: 'create', calling method: .version_select at 0x7f30c876ee50>, body: {"keypair": {"name": "tempest-keypair-1834003700", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:31.585784 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-3b4edae0-045a-4755-bb04-9dfaa088d08a tempest-KeyPairsV2TestJSON-1039671826 tempest-KeyPairsV2TestJSON-1039671826-project] Getting quotas for project 704703e47c3a475fb7e158bd9830e3b8. Resources: {'key_pairs'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:59:31.591073 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-3b4edae0-045a-4755-bb04-9dfaa088d08a tempest-KeyPairsV2TestJSON-1039671826 tempest-KeyPairsV2TestJSON-1039671826-project] Getting quotas for user 997cea78b0f241fcae9bcfaef9353b45 and project 704703e47c3a475fb7e158bd9830e3b8. Resources: {'key_pairs'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:59:31.619568 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-3b4edae0-045a-4755-bb04-9dfaa088d08a tempest-KeyPairsV2TestJSON-1039671826 tempest-KeyPairsV2TestJSON-1039671826-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 574 microversion: 2.1 time: 0.055259 Jan 15 20:59:31.620374 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1629/3278] 10.222.0.46 () {60 vars in 1158 bytes} [Sat Jan 15 20:59:31 2022] POST /compute/v2.1/os-keypairs => generated 574 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 20:59:31.630519 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4f3b9090-d003-4f49-aa81-240434fe3de5 tempest-KeyPairsV2TestJSON-1039671826 tempest-KeyPairsV2TestJSON-1039671826-project] Calling method '.version_select at 0x7f30c87405e0>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:31.658639 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-4f3b9090-d003-4f49-aa81-240434fe3de5 tempest-KeyPairsV2TestJSON-1039671826 tempest-KeyPairsV2TestJSON-1039671826-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1834003700" status: 202 len: 0 microversion: 2.1 time: 0.032271 Jan 15 20:59:31.660123 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1630/3279] 10.222.0.46 () {58 vars in 1220 bytes} [Sat Jan 15 20:59:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1834003700 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 20:59:31.671180 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4d6448b4-ac8a-42cd-ba4e-374108fcdda0 tempest-KeyPairsV2TestJSON-1039671826 tempest-KeyPairsV2TestJSON-1039671826-project] Action: 'create', calling method: .version_select at 0x7f30c873a4c0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-756639022"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:31.696764 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-a6eea218-0731-4045-9211-10b9f951699f tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05483ff6eec84f78a091b29cfbcf61f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a6720be5fb4de7bcd77cc7ef9d8000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:31.701274 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-4d6448b4-ac8a-42cd-ba4e-374108fcdda0 tempest-KeyPairsV2TestJSON-1039671826 tempest-KeyPairsV2TestJSON-1039671826-project] Getting quotas for project 704703e47c3a475fb7e158bd9830e3b8. Resources: {'key_pairs'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:59:31.706747 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-4d6448b4-ac8a-42cd-ba4e-374108fcdda0 tempest-KeyPairsV2TestJSON-1039671826 tempest-KeyPairsV2TestJSON-1039671826-project] Getting quotas for user 997cea78b0f241fcae9bcfaef9353b45 and project 704703e47c3a475fb7e158bd9830e3b8. Resources: {'key_pairs'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:59:31.708386 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a6eea218-0731-4045-9211-10b9f951699f tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] 10.222.0.46 "GET /compute/v2.1/servers/e04f7a96-62cb-4aae-9612-aa8df88aef61" status: 200 len: 1520 microversion: 2.1 time: 0.237122 Jan 15 20:59:31.710973 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1650/3280] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:31 2022] GET /compute/v2.1/servers/e04f7a96-62cb-4aae-9612-aa8df88aef61 => generated 1520 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:59:31.900940 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-1e7f69c3-6f28-483a-8a34-8760ab979d6d req-56c325ef-65d4-4ba1-b0a9-2f4eb3b70c68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c93f609-7034-418c-95ac-eb1589a1cb4b", "name": "network-vif-deleted", "tag": "91ff1980-18eb-4ad0-9fb9-080ce1912c6f"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:31.903494 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:59:31.903494 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:59:31.917570 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-1e7f69c3-6f28-483a-8a34-8760ab979d6d req-56c325ef-65d4-4ba1-b0a9-2f4eb3b70c68 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:31.918843 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-1e7f69c3-6f28-483a-8a34-8760ab979d6d req-56c325ef-65d4-4ba1-b0a9-2f4eb3b70c68 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:31.939073 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-1e7f69c3-6f28-483a-8a34-8760ab979d6d req-56c325ef-65d4-4ba1-b0a9-2f4eb3b70c68 service nova] Creating event network-vif-deleted:91ff1980-18eb-4ad0-9fb9-080ce1912c6f for instance 7c93f609-7034-418c-95ac-eb1589a1cb4b on nch1-master-1 Jan 15 20:59:31.949142 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-1e7f69c3-6f28-483a-8a34-8760ab979d6d req-56c325ef-65d4-4ba1-b0a9-2f4eb3b70c68 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052601 Jan 15 20:59:31.949997 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1651/3281] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:59:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 20:59:31.959283 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e9b395c5-bb2a-45c5-9415-d9124dcc5d6f tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:31.960781 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e9b395c5-bb2a-45c5-9415-d9124dcc5d6f tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] [instance: 7c93f609-7034-418c-95ac-eb1589a1cb4b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:31.983287 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e9b395c5-bb2a-45c5-9415-d9124dcc5d6f tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:31.983976 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e9b395c5-bb2a-45c5-9415-d9124dcc5d6f tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:31.985226 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e9b395c5-bb2a-45c5-9415-d9124dcc5d6f tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:31.986491 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e9b395c5-bb2a-45c5-9415-d9124dcc5d6f tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:32.003881 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-e9b395c5-bb2a-45c5-9415-d9124dcc5d6f tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] HTTP exception thrown: Instance 7c93f609-7034-418c-95ac-eb1589a1cb4b could not be found. Jan 15 20:59:32.004531 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e9b395c5-bb2a-45c5-9415-d9124dcc5d6f tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] Returning 404 to user: Instance 7c93f609-7034-418c-95ac-eb1589a1cb4b could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:59:32.005560 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e9b395c5-bb2a-45c5-9415-d9124dcc5d6f tempest-InstanceActionsNegativeTestJSON-1231237904 tempest-InstanceActionsNegativeTestJSON-1231237904-project] 10.222.0.46 "GET /compute/v2.1/servers/7c93f609-7034-418c-95ac-eb1589a1cb4b" status: 404 len: 111 microversion: 2.1 time: 0.051189 Jan 15 20:59:32.013130 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1652/3282] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:31 2022] GET /compute/v2.1/servers/7c93f609-7034-418c-95ac-eb1589a1cb4b => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:59:32.039978 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-4d6448b4-ac8a-42cd-ba4e-374108fcdda0 tempest-KeyPairsV2TestJSON-1039671826 tempest-KeyPairsV2TestJSON-1039671826-project] Getting quotas for project 704703e47c3a475fb7e158bd9830e3b8. Resources: {'key_pairs'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:59:32.049142 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-4d6448b4-ac8a-42cd-ba4e-374108fcdda0 tempest-KeyPairsV2TestJSON-1039671826 tempest-KeyPairsV2TestJSON-1039671826-project] Getting quotas for user 997cea78b0f241fcae9bcfaef9353b45 and project 704703e47c3a475fb7e158bd9830e3b8. Resources: {'key_pairs'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:59:32.068059 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-4d6448b4-ac8a-42cd-ba4e-374108fcdda0 tempest-KeyPairsV2TestJSON-1039671826 tempest-KeyPairsV2TestJSON-1039671826-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 2323 microversion: 2.1 time: 0.401398 Jan 15 20:59:32.069511 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1631/3283] 10.222.0.46 () {60 vars in 1157 bytes} [Sat Jan 15 20:59:31 2022] POST /compute/v2.1/os-keypairs => generated 2323 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:59:32.082077 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a005e2a7-64c4-4e1b-8775-e9966925a96a tempest-KeyPairsV2TestJSON-1039671826 tempest-KeyPairsV2TestJSON-1039671826-project] Action: 'create', calling method: .version_select at 0x7f30c854c700>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1131431795"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:32.095665 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-17ceb410-e6b3-4f6d-8984-fa08112284d3 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:32.096798 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-17ceb410-e6b3-4f6d-8984-fa08112284d3 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:32.102947 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-a005e2a7-64c4-4e1b-8775-e9966925a96a tempest-KeyPairsV2TestJSON-1039671826 tempest-KeyPairsV2TestJSON-1039671826-project] Getting quotas for project 704703e47c3a475fb7e158bd9830e3b8. Resources: {'key_pairs'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:59:32.107133 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-17ceb410-e6b3-4f6d-8984-fa08112284d3 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:32.109940 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-17ceb410-e6b3-4f6d-8984-fa08112284d3 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:32.111026 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-17ceb410-e6b3-4f6d-8984-fa08112284d3 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:32.111783 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-17ceb410-e6b3-4f6d-8984-fa08112284d3 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:32.113721 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-a005e2a7-64c4-4e1b-8775-e9966925a96a tempest-KeyPairsV2TestJSON-1039671826 tempest-KeyPairsV2TestJSON-1039671826-project] Getting quotas for user 997cea78b0f241fcae9bcfaef9353b45 and project 704703e47c3a475fb7e158bd9830e3b8. Resources: {'key_pairs'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:59:32.169522 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-17ceb410-e6b3-4f6d-8984-fa08112284d3 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action" status: 200 len: 32641 microversion: 2.1 time: 0.076113 Jan 15 20:59:32.173465 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1632/3284] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:59:32 2022] POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action => generated 32641 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:59:32.179735 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e5069d71-ffcb-4790-884c-d5fac8e7e25c tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:32.180641 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e5069d71-ffcb-4790-884c-d5fac8e7e25c tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: c8986b09-8342-4290-87be-22cece488c73] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:32.195041 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e5069d71-ffcb-4790-884c-d5fac8e7e25c tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:32.196070 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e5069d71-ffcb-4790-884c-d5fac8e7e25c tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:32.197080 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e5069d71-ffcb-4790-884c-d5fac8e7e25c tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:32.209146 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e5069d71-ffcb-4790-884c-d5fac8e7e25c tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:32.373075 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-a005e2a7-64c4-4e1b-8775-e9966925a96a tempest-KeyPairsV2TestJSON-1039671826 tempest-KeyPairsV2TestJSON-1039671826-project] Getting quotas for project 704703e47c3a475fb7e158bd9830e3b8. Resources: {'key_pairs'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:59:32.384557 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-a005e2a7-64c4-4e1b-8775-e9966925a96a tempest-KeyPairsV2TestJSON-1039671826 tempest-KeyPairsV2TestJSON-1039671826-project] Getting quotas for user 997cea78b0f241fcae9bcfaef9353b45 and project 704703e47c3a475fb7e158bd9830e3b8. Resources: {'key_pairs'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:59:32.407308 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a005e2a7-64c4-4e1b-8775-e9966925a96a tempest-KeyPairsV2TestJSON-1039671826 tempest-KeyPairsV2TestJSON-1039671826-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 2324 microversion: 2.1 time: 0.330539 Jan 15 20:59:32.409206 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1653/3285] 10.222.0.46 () {60 vars in 1157 bytes} [Sat Jan 15 20:59:32 2022] POST /compute/v2.1/os-keypairs => generated 2324 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:59:32.417058 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-de9c1d57-6a43-4d81-8531-1935f1956e0a tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:32.424249 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-de9c1d57-6a43-4d81-8531-1935f1956e0a tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:32.441831 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-de9c1d57-6a43-4d81-8531-1935f1956e0a tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:32.442552 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-de9c1d57-6a43-4d81-8531-1935f1956e0a tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:32.443513 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-de9c1d57-6a43-4d81-8531-1935f1956e0a tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:32.444168 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-de9c1d57-6a43-4d81-8531-1935f1956e0a tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:32.531870 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-de9c1d57-6a43-4d81-8531-1935f1956e0a tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 16397 microversion: 2.42 time: 0.120857 Jan 15 20:59:32.538749 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1654/3286] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 20:59:32 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 16397 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 20:59:32.545515 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-49325e16-b51d-4f28-a045-de3f25d3c3e3 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:32.546695 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-49325e16-b51d-4f28-a045-de3f25d3c3e3 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] [instance: 5e93486c-7c77-4855-85f4-2bc8bcf4832f] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:32.563515 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-49325e16-b51d-4f28-a045-de3f25d3c3e3 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:32.564199 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-49325e16-b51d-4f28-a045-de3f25d3c3e3 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:32.565218 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-49325e16-b51d-4f28-a045-de3f25d3c3e3 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:32.565655 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-49325e16-b51d-4f28-a045-de3f25d3c3e3 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:32.602246 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-e5069d71-ffcb-4790-884c-d5fac8e7e25c tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8f9c6ea7f6496792258d683640c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a75218d537c4d63874297261bec70ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:32.613503 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e5069d71-ffcb-4790-884c-d5fac8e7e25c tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] 10.222.0.46 "GET /compute/v2.1/servers/c8986b09-8342-4290-87be-22cece488c73" status: 200 len: 1318 microversion: 2.1 time: 0.438498 Jan 15 20:59:32.614396 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1633/3287] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:32 2022] GET /compute/v2.1/servers/c8986b09-8342-4290-87be-22cece488c73 => generated 1318 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:59:32.619133 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7571d05d-ef44-4bd2-a614-28fe02b35388 tempest-KeyPairsV2TestJSON-1039671826 tempest-KeyPairsV2TestJSON-1039671826-project] Action: 'create', calling method: .version_select at 0x7f30c8717c10>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-775678169"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:32.651353 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-7571d05d-ef44-4bd2-a614-28fe02b35388 tempest-KeyPairsV2TestJSON-1039671826 tempest-KeyPairsV2TestJSON-1039671826-project] Getting quotas for project 704703e47c3a475fb7e158bd9830e3b8. Resources: {'key_pairs'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:59:32.655771 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-49325e16-b51d-4f28-a045-de3f25d3c3e3 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] 10.222.0.46 "POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action" status: 200 len: 14 microversion: 2.1 time: 0.114840 Jan 15 20:59:32.657043 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1655/3288] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:59:32 2022] POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action => generated 14 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 20:59:32.660720 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-7571d05d-ef44-4bd2-a614-28fe02b35388 tempest-KeyPairsV2TestJSON-1039671826 tempest-KeyPairsV2TestJSON-1039671826-project] Getting quotas for user 997cea78b0f241fcae9bcfaef9353b45 and project 704703e47c3a475fb7e158bd9830e3b8. Resources: {'key_pairs'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:59:32.729021 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-20144a3b-975e-42bb-a249-80e5d9dc073c tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:32.729718 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-20144a3b-975e-42bb-a249-80e5d9dc073c tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] [instance: e04f7a96-62cb-4aae-9612-aa8df88aef61] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:32.738853 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-20144a3b-975e-42bb-a249-80e5d9dc073c tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:32.739304 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-20144a3b-975e-42bb-a249-80e5d9dc073c tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:32.740294 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-20144a3b-975e-42bb-a249-80e5d9dc073c tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:32.740641 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-20144a3b-975e-42bb-a249-80e5d9dc073c tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:32.869606 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-7571d05d-ef44-4bd2-a614-28fe02b35388 tempest-KeyPairsV2TestJSON-1039671826 tempest-KeyPairsV2TestJSON-1039671826-project] Getting quotas for project 704703e47c3a475fb7e158bd9830e3b8. Resources: {'key_pairs'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:59:32.876240 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-7571d05d-ef44-4bd2-a614-28fe02b35388 tempest-KeyPairsV2TestJSON-1039671826 tempest-KeyPairsV2TestJSON-1039671826-project] Getting quotas for user 997cea78b0f241fcae9bcfaef9353b45 and project 704703e47c3a475fb7e158bd9830e3b8. Resources: {'key_pairs'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:59:32.901579 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7571d05d-ef44-4bd2-a614-28fe02b35388 tempest-KeyPairsV2TestJSON-1039671826 tempest-KeyPairsV2TestJSON-1039671826-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 2319 microversion: 2.1 time: 0.285694 Jan 15 20:59:32.902717 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1634/3289] 10.222.0.46 () {60 vars in 1157 bytes} [Sat Jan 15 20:59:32 2022] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:59:32.915554 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f9d8f739-a914-4ce0-ac5a-a4d6305b0168 tempest-KeyPairsV2TestJSON-1039671826 tempest-KeyPairsV2TestJSON-1039671826-project] Calling method '.version_select at 0x7f30c875a310>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:32.918546 ncdv-master-1 devstack@n-api.service[129366]: WARNING oslo_db.sqlalchemy.utils [None req-f9d8f739-a914-4ce0-ac5a-a4d6305b0168 tempest-KeyPairsV2TestJSON-1039671826 tempest-KeyPairsV2TestJSON-1039671826-project] Unique keys not in sort_keys. The sorting order may be unstable. Jan 15 20:59:32.927018 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f9d8f739-a914-4ce0-ac5a-a4d6305b0168 tempest-KeyPairsV2TestJSON-1039671826 tempest-KeyPairsV2TestJSON-1039671826-project] 10.222.0.46 "GET /compute/v2.1/os-keypairs" status: 200 len: 1674 microversion: 2.1 time: 0.016853 Jan 15 20:59:32.927018 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1635/3290] 10.222.0.46 () {58 vars in 1136 bytes} [Sat Jan 15 20:59:32 2022] GET /compute/v2.1/os-keypairs => generated 1674 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:59:32.938247 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-87f798f5-5ec9-43a9-88bb-7337c10e1811 tempest-KeyPairsV2TestJSON-1039671826 tempest-KeyPairsV2TestJSON-1039671826-project] Calling method '.version_select at 0x7f30c873a5e0>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:32.964984 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-87f798f5-5ec9-43a9-88bb-7337c10e1811 tempest-KeyPairsV2TestJSON-1039671826 tempest-KeyPairsV2TestJSON-1039671826-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-775678169" status: 202 len: 0 microversion: 2.1 time: 0.031366 Jan 15 20:59:32.965889 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1636/3291] 10.222.0.46 () {58 vars in 1274 bytes} [Sat Jan 15 20:59:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-775678169 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 20:59:32.974278 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-cb650346-f2b9-4c65-b6d7-27e0a4fe08af tempest-KeyPairsV2TestJSON-1039671826 tempest-KeyPairsV2TestJSON-1039671826-project] Calling method '.version_select at 0x7f30c8817af0>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:33.023920 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-cb650346-f2b9-4c65-b6d7-27e0a4fe08af tempest-KeyPairsV2TestJSON-1039671826 tempest-KeyPairsV2TestJSON-1039671826-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1131431795" status: 202 len: 0 microversion: 2.1 time: 0.053693 Jan 15 20:59:33.025186 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1637/3292] 10.222.0.46 () {58 vars in 1277 bytes} [Sat Jan 15 20:59:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1131431795 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 15 20:59:33.033336 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-335d338a-d2ec-42e3-909b-4895d48f9026 tempest-KeyPairsV2TestJSON-1039671826 tempest-KeyPairsV2TestJSON-1039671826-project] Calling method '.version_select at 0x7f30c86f5160>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:33.040683 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-20144a3b-975e-42bb-a249-80e5d9dc073c tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05483ff6eec84f78a091b29cfbcf61f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a6720be5fb4de7bcd77cc7ef9d8000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:33.049081 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-20144a3b-975e-42bb-a249-80e5d9dc073c tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] 10.222.0.46 "GET /compute/v2.1/servers/e04f7a96-62cb-4aae-9612-aa8df88aef61" status: 200 len: 1520 microversion: 2.1 time: 0.325317 Jan 15 20:59:33.063426 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-335d338a-d2ec-42e3-909b-4895d48f9026 tempest-KeyPairsV2TestJSON-1039671826 tempest-KeyPairsV2TestJSON-1039671826-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-756639022" status: 202 len: 0 microversion: 2.1 time: 0.033708 Jan 15 20:59:33.064700 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1638/3293] 10.222.0.46 () {58 vars in 1274 bytes} [Sat Jan 15 20:59:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-756639022 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 20:59:33.068295 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1656/3294] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:32 2022] GET /compute/v2.1/servers/e04f7a96-62cb-4aae-9612-aa8df88aef61 => generated 1520 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:59:33.185165 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9e71c983-02c7-4e1d-8b10-da751cb7b95b tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:33.186315 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-9e71c983-02c7-4e1d-8b10-da751cb7b95b tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:33.195966 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9e71c983-02c7-4e1d-8b10-da751cb7b95b tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:33.199321 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9e71c983-02c7-4e1d-8b10-da751cb7b95b tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:33.202090 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9e71c983-02c7-4e1d-8b10-da751cb7b95b tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:33.202679 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9e71c983-02c7-4e1d-8b10-da751cb7b95b tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:33.261259 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-9e71c983-02c7-4e1d-8b10-da751cb7b95b tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action" status: 200 len: 32641 microversion: 2.1 time: 0.080256 Jan 15 20:59:33.262243 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1657/3295] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:59:33 2022] POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action => generated 32641 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:59:33.551906 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8cfa6217-9872-407e-8fe5-d66390cdbcdf tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:33.555114 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-8cfa6217-9872-407e-8fe5-d66390cdbcdf tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:33.578103 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8cfa6217-9872-407e-8fe5-d66390cdbcdf tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:33.581220 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8cfa6217-9872-407e-8fe5-d66390cdbcdf tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:33.582581 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8cfa6217-9872-407e-8fe5-d66390cdbcdf tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:33.582992 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8cfa6217-9872-407e-8fe5-d66390cdbcdf tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:33.639891 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2d1445b9-bf7b-4f82-a435-70ff42df2e63 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:33.640703 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-2d1445b9-bf7b-4f82-a435-70ff42df2e63 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: c8986b09-8342-4290-87be-22cece488c73] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:33.656312 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2d1445b9-bf7b-4f82-a435-70ff42df2e63 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:33.656770 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2d1445b9-bf7b-4f82-a435-70ff42df2e63 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:33.661245 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2d1445b9-bf7b-4f82-a435-70ff42df2e63 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:33.665306 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2d1445b9-bf7b-4f82-a435-70ff42df2e63 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:33.685078 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-8cfa6217-9872-407e-8fe5-d66390cdbcdf tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 16397 microversion: 2.42 time: 0.138732 Jan 15 20:59:33.691078 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1639/3296] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 20:59:33 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 16397 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 20:59:33.703240 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c15dd0db-d562-44fc-9a3c-88e4dcc0dae2 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:33.704674 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c15dd0db-d562-44fc-9a3c-88e4dcc0dae2 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] [instance: 5e93486c-7c77-4855-85f4-2bc8bcf4832f] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:33.725910 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c15dd0db-d562-44fc-9a3c-88e4dcc0dae2 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:33.727924 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c15dd0db-d562-44fc-9a3c-88e4dcc0dae2 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:33.729007 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c15dd0db-d562-44fc-9a3c-88e4dcc0dae2 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:33.730492 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c15dd0db-d562-44fc-9a3c-88e4dcc0dae2 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:33.819621 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c15dd0db-d562-44fc-9a3c-88e4dcc0dae2 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] 10.222.0.46 "POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action" status: 200 len: 8207 microversion: 2.1 time: 0.122405 Jan 15 20:59:33.820894 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1640/3297] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:59:33 2022] POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action => generated 8207 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:59:33.945255 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-d1236763-5d9b-49ac-9b47-db21e39ba390 req-94e9964c-a284-4655-919e-ab9309a55290 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8986b09-8342-4290-87be-22cece488c73", "name": "network-vif-plugged", "status": "completed", "tag": "7cf5ea2d-375f-4590-af25-836bb895b886"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:33.947736 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:59:33.947736 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:59:33.975442 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-d1236763-5d9b-49ac-9b47-db21e39ba390 req-94e9964c-a284-4655-919e-ab9309a55290 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:33.977984 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-d1236763-5d9b-49ac-9b47-db21e39ba390 req-94e9964c-a284-4655-919e-ab9309a55290 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:33.983587 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-2d1445b9-bf7b-4f82-a435-70ff42df2e63 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8f9c6ea7f6496792258d683640c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a75218d537c4d63874297261bec70ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:33.996476 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2d1445b9-bf7b-4f82-a435-70ff42df2e63 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] 10.222.0.46 "GET /compute/v2.1/servers/c8986b09-8342-4290-87be-22cece488c73" status: 200 len: 1318 microversion: 2.1 time: 0.368351 Jan 15 20:59:34.007377 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1658/3298] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:33 2022] GET /compute/v2.1/servers/c8986b09-8342-4290-87be-22cece488c73 => generated 1318 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:59:34.024164 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-d1236763-5d9b-49ac-9b47-db21e39ba390 req-94e9964c-a284-4655-919e-ab9309a55290 service nova] Creating event network-vif-plugged:7cf5ea2d-375f-4590-af25-836bb895b886 for instance c8986b09-8342-4290-87be-22cece488c73 on nch1-master-1 Jan 15 20:59:34.037734 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-d1236763-5d9b-49ac-9b47-db21e39ba390 req-94e9964c-a284-4655-919e-ab9309a55290 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097301 Jan 15 20:59:34.041371 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1641/3299] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:59:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:59:34.069954 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-eea52001-b641-4310-b221-3d5d106c3f3a tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:34.070741 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-eea52001-b641-4310-b221-3d5d106c3f3a tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] [instance: e04f7a96-62cb-4aae-9612-aa8df88aef61] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:34.088453 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-eea52001-b641-4310-b221-3d5d106c3f3a tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:34.091676 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-eea52001-b641-4310-b221-3d5d106c3f3a tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:34.097165 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-eea52001-b641-4310-b221-3d5d106c3f3a tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:34.097785 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-eea52001-b641-4310-b221-3d5d106c3f3a tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:34.274414 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d12f09af-41c8-4802-a5cb-05d106f75650 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:34.275438 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-d12f09af-41c8-4802-a5cb-05d106f75650 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:34.292075 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d12f09af-41c8-4802-a5cb-05d106f75650 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:34.293462 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d12f09af-41c8-4802-a5cb-05d106f75650 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:34.294919 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d12f09af-41c8-4802-a5cb-05d106f75650 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:34.295819 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d12f09af-41c8-4802-a5cb-05d106f75650 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:34.374552 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d12f09af-41c8-4802-a5cb-05d106f75650 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action" status: 200 len: 32641 microversion: 2.1 time: 0.104417 Jan 15 20:59:34.381937 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1642/3300] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:59:34 2022] POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action => generated 32641 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 20:59:34.561084 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-eea52001-b641-4310-b221-3d5d106c3f3a tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05483ff6eec84f78a091b29cfbcf61f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a6720be5fb4de7bcd77cc7ef9d8000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:34.573483 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-eea52001-b641-4310-b221-3d5d106c3f3a tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] 10.222.0.46 "GET /compute/v2.1/servers/e04f7a96-62cb-4aae-9612-aa8df88aef61" status: 200 len: 1520 microversion: 2.1 time: 0.509267 Jan 15 20:59:34.574988 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1659/3301] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:34 2022] GET /compute/v2.1/servers/e04f7a96-62cb-4aae-9612-aa8df88aef61 => generated 1520 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:59:34.699261 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ed2d4f2f-d081-4bd5-9ef7-adc7b0a111e6 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:34.700301 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ed2d4f2f-d081-4bd5-9ef7-adc7b0a111e6 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:34.717384 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ed2d4f2f-d081-4bd5-9ef7-adc7b0a111e6 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:34.717838 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ed2d4f2f-d081-4bd5-9ef7-adc7b0a111e6 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:34.727100 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ed2d4f2f-d081-4bd5-9ef7-adc7b0a111e6 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:34.727567 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ed2d4f2f-d081-4bd5-9ef7-adc7b0a111e6 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:34.787161 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ed2d4f2f-d081-4bd5-9ef7-adc7b0a111e6 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 16397 microversion: 2.42 time: 0.093950 Jan 15 20:59:34.791837 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1643/3302] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 20:59:34 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 16397 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 20:59:34.830574 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b870f6d6-e8a7-4077-965b-a1066c10ed62 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:34.831499 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b870f6d6-e8a7-4077-965b-a1066c10ed62 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] [instance: 5e93486c-7c77-4855-85f4-2bc8bcf4832f] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:34.839531 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b870f6d6-e8a7-4077-965b-a1066c10ed62 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:34.842647 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b870f6d6-e8a7-4077-965b-a1066c10ed62 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:34.843516 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b870f6d6-e8a7-4077-965b-a1066c10ed62 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:34.844107 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b870f6d6-e8a7-4077-965b-a1066c10ed62 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:34.903621 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b870f6d6-e8a7-4077-965b-a1066c10ed62 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] 10.222.0.46 "POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action" status: 200 len: 8207 microversion: 2.1 time: 0.076376 Jan 15 20:59:34.904456 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1660/3303] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:59:34 2022] POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action => generated 8207 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:59:35.021558 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4528131c-f238-4503-847d-fe7884344a9f tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:35.030571 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-4528131c-f238-4503-847d-fe7884344a9f tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: c8986b09-8342-4290-87be-22cece488c73] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:35.056029 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4528131c-f238-4503-847d-fe7884344a9f tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:35.056696 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4528131c-f238-4503-847d-fe7884344a9f tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:35.057786 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4528131c-f238-4503-847d-fe7884344a9f tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:35.059483 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4528131c-f238-4503-847d-fe7884344a9f tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:35.256892 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-4528131c-f238-4503-847d-fe7884344a9f tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8f9c6ea7f6496792258d683640c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a75218d537c4d63874297261bec70ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:35.270208 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-4528131c-f238-4503-847d-fe7884344a9f tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] 10.222.0.46 "GET /compute/v2.1/servers/c8986b09-8342-4290-87be-22cece488c73" status: 200 len: 1318 microversion: 2.1 time: 0.257995 Jan 15 20:59:35.271585 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1644/3304] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:35 2022] GET /compute/v2.1/servers/c8986b09-8342-4290-87be-22cece488c73 => generated 1318 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:59:35.393803 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f5a97f92-d7eb-41b0-9a13-75cefccb24e6 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:35.394991 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f5a97f92-d7eb-41b0-9a13-75cefccb24e6 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:35.407710 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f5a97f92-d7eb-41b0-9a13-75cefccb24e6 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:35.408521 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f5a97f92-d7eb-41b0-9a13-75cefccb24e6 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:35.409477 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f5a97f92-d7eb-41b0-9a13-75cefccb24e6 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:35.410125 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f5a97f92-d7eb-41b0-9a13-75cefccb24e6 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:35.496462 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f5a97f92-d7eb-41b0-9a13-75cefccb24e6 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action" status: 200 len: 32641 microversion: 2.1 time: 0.106870 Jan 15 20:59:35.498151 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1661/3305] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:59:35 2022] POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action => generated 32641 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:59:35.592276 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7a65eb53-ccae-49e2-9a4d-6262707a9178 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:35.593592 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-7a65eb53-ccae-49e2-9a4d-6262707a9178 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] [instance: e04f7a96-62cb-4aae-9612-aa8df88aef61] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:35.606857 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7a65eb53-ccae-49e2-9a4d-6262707a9178 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:35.610189 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7a65eb53-ccae-49e2-9a4d-6262707a9178 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:35.611481 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7a65eb53-ccae-49e2-9a4d-6262707a9178 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:35.612121 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7a65eb53-ccae-49e2-9a4d-6262707a9178 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:35.800014 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e91438b1-e4bd-47ce-8552-dc22121152f1 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:35.801654 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e91438b1-e4bd-47ce-8552-dc22121152f1 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:35.812832 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e91438b1-e4bd-47ce-8552-dc22121152f1 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:35.813797 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e91438b1-e4bd-47ce-8552-dc22121152f1 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:35.814765 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e91438b1-e4bd-47ce-8552-dc22121152f1 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:35.815416 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e91438b1-e4bd-47ce-8552-dc22121152f1 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:35.829755 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-7a65eb53-ccae-49e2-9a4d-6262707a9178 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05483ff6eec84f78a091b29cfbcf61f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a6720be5fb4de7bcd77cc7ef9d8000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:35.841558 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7a65eb53-ccae-49e2-9a4d-6262707a9178 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] 10.222.0.46 "GET /compute/v2.1/servers/e04f7a96-62cb-4aae-9612-aa8df88aef61" status: 200 len: 1520 microversion: 2.1 time: 0.253344 Jan 15 20:59:35.842490 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1645/3306] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:35 2022] GET /compute/v2.1/servers/e04f7a96-62cb-4aae-9612-aa8df88aef61 => generated 1520 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:59:35.862339 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e91438b1-e4bd-47ce-8552-dc22121152f1 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 16397 microversion: 2.42 time: 0.066380 Jan 15 20:59:35.863230 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1662/3307] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 20:59:35 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 16397 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 20:59:35.915784 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-991e38ad-c0c0-4b4f-861b-13a2aeb8203d tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:35.916789 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-991e38ad-c0c0-4b4f-861b-13a2aeb8203d tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] [instance: 5e93486c-7c77-4855-85f4-2bc8bcf4832f] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:35.928389 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-991e38ad-c0c0-4b4f-861b-13a2aeb8203d tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:35.930336 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-991e38ad-c0c0-4b4f-861b-13a2aeb8203d tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:35.933572 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-991e38ad-c0c0-4b4f-861b-13a2aeb8203d tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:35.934033 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-991e38ad-c0c0-4b4f-861b-13a2aeb8203d tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:36.027734 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-991e38ad-c0c0-4b4f-861b-13a2aeb8203d tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] 10.222.0.46 "POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action" status: 200 len: 16401 microversion: 2.1 time: 0.116636 Jan 15 20:59:36.028832 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1646/3308] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:59:35 2022] POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action => generated 16401 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 20:59:36.292949 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8cb01e0c-68be-4d0e-876f-e24be7262941 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:36.294081 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-8cb01e0c-68be-4d0e-876f-e24be7262941 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: c8986b09-8342-4290-87be-22cece488c73] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:36.329767 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8cb01e0c-68be-4d0e-876f-e24be7262941 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:36.341051 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8cb01e0c-68be-4d0e-876f-e24be7262941 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:36.343634 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8cb01e0c-68be-4d0e-876f-e24be7262941 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:36.346059 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8cb01e0c-68be-4d0e-876f-e24be7262941 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:36.595391 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-019d7004-f820-4b2c-a33f-8b417d6cef11 tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-402554449", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "06debdb1-4712-4eed-bcd6-395d1a8ea49c"}]}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:36.669480 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.network.neutron [None req-019d7004-f820-4b2c-a33f-8b417d6cef11 tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] validate_networks() for [('06debdb1-4712-4eed-bcd6-395d1a8ea49c', None, None, None, None, None)] {{(pid=129366) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 20:59:36.828116 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-8cb01e0c-68be-4d0e-876f-e24be7262941 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8f9c6ea7f6496792258d683640c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a75218d537c4d63874297261bec70ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:36.836324 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-8cb01e0c-68be-4d0e-876f-e24be7262941 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] 10.222.0.46 "GET /compute/v2.1/servers/c8986b09-8342-4290-87be-22cece488c73" status: 200 len: 1508 microversion: 2.1 time: 0.549114 Jan 15 20:59:36.840902 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1663/3309] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:36 2022] GET /compute/v2.1/servers/c8986b09-8342-4290-87be-22cece488c73 => generated 1508 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:59:36.846839 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ad0d03a7-0ad0-407c-8d7f-67d143a58fdf tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:36.850156 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ad0d03a7-0ad0-407c-8d7f-67d143a58fdf tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:36.860453 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ad0d03a7-0ad0-407c-8d7f-67d143a58fdf tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:36.860952 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ad0d03a7-0ad0-407c-8d7f-67d143a58fdf tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:36.861870 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ad0d03a7-0ad0-407c-8d7f-67d143a58fdf tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:36.862333 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ad0d03a7-0ad0-407c-8d7f-67d143a58fdf tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:36.915499 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ad0d03a7-0ad0-407c-8d7f-67d143a58fdf tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action" status: 200 len: 32641 microversion: 2.1 time: 0.076683 Jan 15 20:59:36.916764 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1664/3310] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:59:36 2022] POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action => generated 32641 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:59:36.923079 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d4676efb-8324-4496-9ea3-0cbc339a78ca tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:36.923792 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d4676efb-8324-4496-9ea3-0cbc339a78ca tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: c8986b09-8342-4290-87be-22cece488c73] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:36.948053 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d4676efb-8324-4496-9ea3-0cbc339a78ca tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:36.948538 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d4676efb-8324-4496-9ea3-0cbc339a78ca tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:36.950548 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d4676efb-8324-4496-9ea3-0cbc339a78ca tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:36.950991 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d4676efb-8324-4496-9ea3-0cbc339a78ca tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:37.546604 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-d4676efb-8324-4496-9ea3-0cbc339a78ca tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8f9c6ea7f6496792258d683640c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a75218d537c4d63874297261bec70ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:37.567035 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-019d7004-f820-4b2c-a33f-8b417d6cef11 tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] Flavor limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 20:59:37.567697 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-019d7004-f820-4b2c-a33f-8b417d6cef11 tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] Image limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 20:59:37.568479 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-019d7004-f820-4b2c-a33f-8b417d6cef11 tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] Flavor pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 20:59:37.569470 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-019d7004-f820-4b2c-a33f-8b417d6cef11 tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] Image pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 20:59:37.570136 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-019d7004-f820-4b2c-a33f-8b417d6cef11 tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 20:59:37.580451 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d4676efb-8324-4496-9ea3-0cbc339a78ca tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] 10.222.0.46 "GET /compute/v2.1/servers/c8986b09-8342-4290-87be-22cece488c73" status: 200 len: 1508 microversion: 2.1 time: 0.662468 Jan 15 20:59:37.588224 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-019d7004-f820-4b2c-a33f-8b417d6cef11 tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:37.588692 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1665/3311] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:36 2022] GET /compute/v2.1/servers/c8986b09-8342-4290-87be-22cece488c73 => generated 1508 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:59:37.588827 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-019d7004-f820-4b2c-a33f-8b417d6cef11 tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:37.589959 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-019d7004-f820-4b2c-a33f-8b417d6cef11 tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:37.590458 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-019d7004-f820-4b2c-a33f-8b417d6cef11 tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:37.603661 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-7a5bf75f-56c9-4986-8fb3-e3324ffe1597 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:37.606094 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-7a5bf75f-56c9-4986-8fb3-e3324ffe1597 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] [instance: e04f7a96-62cb-4aae-9612-aa8df88aef61] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:37.622189 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7a5bf75f-56c9-4986-8fb3-e3324ffe1597 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:37.622933 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7a5bf75f-56c9-4986-8fb3-e3324ffe1597 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:37.626147 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7a5bf75f-56c9-4986-8fb3-e3324ffe1597 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:37.626943 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7a5bf75f-56c9-4986-8fb3-e3324ffe1597 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:37.628707 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-019d7004-f820-4b2c-a33f-8b417d6cef11 tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] Getting quotas for project 56b3ba8ddd164cbbbc04a57bd2819003. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:59:37.639879 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-019d7004-f820-4b2c-a33f-8b417d6cef11 tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] Getting quotas for user 6b671d4d84454404a6f8ceba212fb2d9 and project 56b3ba8ddd164cbbbc04a57bd2819003. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:59:37.656766 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-019d7004-f820-4b2c-a33f-8b417d6cef11 tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] Going to run 1 instances... {{(pid=129366) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 20:59:37.660301 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-019d7004-f820-4b2c-a33f-8b417d6cef11 tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] [instance: 6d9fd532-17fd-4ec1-b3e2-d05605c20756] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 20:59:37.737866 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-019d7004-f820-4b2c-a33f-8b417d6cef11 tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.360119 Jan 15 20:59:37.739318 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1647/3312] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 20:59:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1362 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 20:59:37.746739 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-494fd965-1253-40d5-8091-afe21ac9672c tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:37.747775 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-494fd965-1253-40d5-8091-afe21ac9672c tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:37.758417 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-494fd965-1253-40d5-8091-afe21ac9672c tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:37.758942 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-494fd965-1253-40d5-8091-afe21ac9672c tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:37.759825 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-494fd965-1253-40d5-8091-afe21ac9672c tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:37.766346 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-494fd965-1253-40d5-8091-afe21ac9672c tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:37.849001 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-494fd965-1253-40d5-8091-afe21ac9672c tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 24586 microversion: 2.42 time: 0.108191 Jan 15 20:59:37.853411 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1648/3313] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 20:59:37 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 24586 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 20:59:37.859346 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-cbbf70d7-2ad8-4f55-9c64-6758b687bfb1 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:37.862424 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-cbbf70d7-2ad8-4f55-9c64-6758b687bfb1 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] [instance: 5e93486c-7c77-4855-85f4-2bc8bcf4832f] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:37.864768 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-7a5bf75f-56c9-4986-8fb3-e3324ffe1597 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05483ff6eec84f78a091b29cfbcf61f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a6720be5fb4de7bcd77cc7ef9d8000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:37.872749 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cbbf70d7-2ad8-4f55-9c64-6758b687bfb1 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:37.873230 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cbbf70d7-2ad8-4f55-9c64-6758b687bfb1 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:37.874015 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cbbf70d7-2ad8-4f55-9c64-6758b687bfb1 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:37.874646 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cbbf70d7-2ad8-4f55-9c64-6758b687bfb1 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:37.875115 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-7a5bf75f-56c9-4986-8fb3-e3324ffe1597 tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] 10.222.0.46 "GET /compute/v2.1/servers/e04f7a96-62cb-4aae-9612-aa8df88aef61" status: 200 len: 1520 microversion: 2.1 time: 0.283233 Jan 15 20:59:37.885729 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1666/3314] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:37 2022] GET /compute/v2.1/servers/e04f7a96-62cb-4aae-9612-aa8df88aef61 => generated 1520 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:59:37.937126 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-cbbf70d7-2ad8-4f55-9c64-6758b687bfb1 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] 10.222.0.46 "POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action" status: 200 len: 16401 microversion: 2.1 time: 0.084315 Jan 15 20:59:37.941769 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1649/3315] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:59:37 2022] POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action => generated 16401 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:59:37.948688 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-5e0950e4-6e83-42db-acc6-e16080b04294 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "OS-DCF:diskConfig": "AUTO"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:37.950650 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-5e0950e4-6e83-42db-acc6-e16080b04294 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: c8986b09-8342-4290-87be-22cece488c73] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:37.962592 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5e0950e4-6e83-42db-acc6-e16080b04294 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:37.963475 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5e0950e4-6e83-42db-acc6-e16080b04294 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:37.964375 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5e0950e4-6e83-42db-acc6-e16080b04294 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:37.964933 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5e0950e4-6e83-42db-acc6-e16080b04294 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:37.983209 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-288ced98-d2df-4842-a47a-d6a5dec60aa6 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-1440153291", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "2853abb2-f8b6-4eeb-86ee-8eff3f932a44"}]}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:38.089719 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.network.neutron [None req-288ced98-d2df-4842-a47a-d6a5dec60aa6 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] validate_networks() for [('2853abb2-f8b6-4eeb-86ee-8eff3f932a44', None, None, None, None, None)] {{(pid=129365) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 20:59:38.103599 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-5e0950e4-6e83-42db-acc6-e16080b04294 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Flavor limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 20:59:38.104263 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-5e0950e4-6e83-42db-acc6-e16080b04294 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Image limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 20:59:38.105705 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-5e0950e4-6e83-42db-acc6-e16080b04294 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Flavor pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 20:59:38.106362 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-5e0950e4-6e83-42db-acc6-e16080b04294 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Image pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 20:59:38.106969 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-5e0950e4-6e83-42db-acc6-e16080b04294 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 20:59:38.190998 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-5e0950e4-6e83-42db-acc6-e16080b04294 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: c8986b09-8342-4290-87be-22cece488c73] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:38.197622 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5e0950e4-6e83-42db-acc6-e16080b04294 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:38.198358 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5e0950e4-6e83-42db-acc6-e16080b04294 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:38.199030 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5e0950e4-6e83-42db-acc6-e16080b04294 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:38.199887 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5e0950e4-6e83-42db-acc6-e16080b04294 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:38.234708 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-5e0950e4-6e83-42db-acc6-e16080b04294 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] 10.222.0.46 "POST /compute/v2.1/servers/c8986b09-8342-4290-87be-22cece488c73/action" status: 202 len: 1110 microversion: 2.1 time: 0.291578 Jan 15 20:59:38.235611 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1650/3316] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:59:37 2022] POST /compute/v2.1/servers/c8986b09-8342-4290-87be-22cece488c73/action => generated 1110 bytes in 293 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 15 20:59:38.241957 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-108f8067-60a1-4fcf-84e0-1fa0b23ff126 tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:38.243082 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-108f8067-60a1-4fcf-84e0-1fa0b23ff126 tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] [instance: 6d9fd532-17fd-4ec1-b3e2-d05605c20756] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:38.346965 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-108f8067-60a1-4fcf-84e0-1fa0b23ff126 tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b671d4d84454404a6f8ceba212fb2d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b3ba8ddd164cbbbc04a57bd2819003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:38.357366 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-108f8067-60a1-4fcf-84e0-1fa0b23ff126 tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] 10.222.0.46 "GET /compute/v2.1/servers/6d9fd532-17fd-4ec1-b3e2-d05605c20756" status: 200 len: 1223 microversion: 2.1 time: 0.120357 Jan 15 20:59:38.359089 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1651/3317] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:38 2022] GET /compute/v2.1/servers/6d9fd532-17fd-4ec1-b3e2-d05605c20756 => generated 1223 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:59:38.365209 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-2cdf295f-01a2-4eb3-9da1-ca82bb7ab798 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:38.366542 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-2cdf295f-01a2-4eb3-9da1-ca82bb7ab798 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:38.373528 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2cdf295f-01a2-4eb3-9da1-ca82bb7ab798 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:38.373978 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2cdf295f-01a2-4eb3-9da1-ca82bb7ab798 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:38.374769 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2cdf295f-01a2-4eb3-9da1-ca82bb7ab798 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:38.375204 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2cdf295f-01a2-4eb3-9da1-ca82bb7ab798 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:38.426955 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-2cdf295f-01a2-4eb3-9da1-ca82bb7ab798 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action" status: 200 len: 32641 microversion: 2.1 time: 0.065755 Jan 15 20:59:38.428956 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1652/3318] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:59:38 2022] POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action => generated 32641 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:59:38.434835 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-065b424f-aaff-484d-8f3b-e3701375442f req-837df5c3-be92-478d-a955-14d072765075 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e04f7a96-62cb-4aae-9612-aa8df88aef61", "name": "network-vif-deleted", "tag": "dd2cbd6f-3487-4fa2-b57c-a5a8ae164d93"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:38.436319 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:59:38.436319 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:59:38.446615 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-065b424f-aaff-484d-8f3b-e3701375442f req-837df5c3-be92-478d-a955-14d072765075 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:38.447061 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-065b424f-aaff-484d-8f3b-e3701375442f req-837df5c3-be92-478d-a955-14d072765075 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:38.462543 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-065b424f-aaff-484d-8f3b-e3701375442f req-837df5c3-be92-478d-a955-14d072765075 service nova] Creating event network-vif-deleted:dd2cbd6f-3487-4fa2-b57c-a5a8ae164d93 for instance e04f7a96-62cb-4aae-9612-aa8df88aef61 on nch2-master-1 Jan 15 20:59:38.467379 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-065b424f-aaff-484d-8f3b-e3701375442f req-837df5c3-be92-478d-a955-14d072765075 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036891 Jan 15 20:59:38.467981 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1653/3319] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:59:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:59:38.474324 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-44a31896-c6f4-412b-8fee-1eeade8d9a5a tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:38.475877 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-44a31896-c6f4-412b-8fee-1eeade8d9a5a tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: c8986b09-8342-4290-87be-22cece488c73] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:38.482176 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-44a31896-c6f4-412b-8fee-1eeade8d9a5a tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:38.482826 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-44a31896-c6f4-412b-8fee-1eeade8d9a5a tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:38.483739 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-44a31896-c6f4-412b-8fee-1eeade8d9a5a tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:38.484189 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-44a31896-c6f4-412b-8fee-1eeade8d9a5a tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:38.675577 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-288ced98-d2df-4842-a47a-d6a5dec60aa6 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Flavor limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 20:59:38.676145 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-288ced98-d2df-4842-a47a-d6a5dec60aa6 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Image limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 20:59:38.676890 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-288ced98-d2df-4842-a47a-d6a5dec60aa6 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Flavor pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 20:59:38.677492 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-288ced98-d2df-4842-a47a-d6a5dec60aa6 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Image pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 20:59:38.678945 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-288ced98-d2df-4842-a47a-d6a5dec60aa6 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 20:59:38.691655 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-288ced98-d2df-4842-a47a-d6a5dec60aa6 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:38.692256 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-288ced98-d2df-4842-a47a-d6a5dec60aa6 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:38.693091 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-288ced98-d2df-4842-a47a-d6a5dec60aa6 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:38.693772 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-288ced98-d2df-4842-a47a-d6a5dec60aa6 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:38.713934 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-288ced98-d2df-4842-a47a-d6a5dec60aa6 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Getting quotas for project 0ca0988cda6548f89ee936bee64f56ac. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:59:38.720447 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-288ced98-d2df-4842-a47a-d6a5dec60aa6 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Getting quotas for user f1c07d13117a49b6b2042e182faaf9c7 and project 0ca0988cda6548f89ee936bee64f56ac. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:59:38.738459 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-288ced98-d2df-4842-a47a-d6a5dec60aa6 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Going to run 2 instances... {{(pid=129365) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 20:59:38.742075 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-288ced98-d2df-4842-a47a-d6a5dec60aa6 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] [instance: 58ee3eff-55c4-48eb-a5f6-2731d35270a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129365) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 20:59:38.748644 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-44a31896-c6f4-412b-8fee-1eeade8d9a5a tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8f9c6ea7f6496792258d683640c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a75218d537c4d63874297261bec70ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:38.758645 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-44a31896-c6f4-412b-8fee-1eeade8d9a5a tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] 10.222.0.46 "GET /compute/v2.1/servers/c8986b09-8342-4290-87be-22cece488c73" status: 200 len: 1515 microversion: 2.1 time: 0.289257 Jan 15 20:59:38.759446 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1654/3320] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:38 2022] GET /compute/v2.1/servers/c8986b09-8342-4290-87be-22cece488c73 => generated 1515 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:59:38.782565 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-288ced98-d2df-4842-a47a-d6a5dec60aa6 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] [instance: 0d04bb3a-eacf-48ca-b7bf-e830a2c30b80] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=58ee3eff-55c4-48eb-a5f6-2731d35270a0,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129365) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 20:59:38.853779 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-288ced98-d2df-4842-a47a-d6a5dec60aa6 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.964174 Jan 15 20:59:38.854449 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1667/3321] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 20:59:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 968 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 20:59:38.862275 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-23737e49-af94-4b8a-bc0a-2401d5e3f507 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:38.863209 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-23737e49-af94-4b8a-bc0a-2401d5e3f507 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:38.867057 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-0c527211-5bad-4aa2-b5eb-22450490ca62 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:38.870800 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:59:38.870800 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:59:38.872370 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-0c527211-5bad-4aa2-b5eb-22450490ca62 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f1c07d13117a49b6b2042e182faaf9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca0988cda6548f89ee936bee64f56ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:38.873529 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-0c527211-5bad-4aa2-b5eb-22450490ca62 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Searching by: {'deleted': False, 'project_id': '0ca0988cda6548f89ee936bee64f56ac'} {{(pid=129365) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 15 20:59:38.876817 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-23737e49-af94-4b8a-bc0a-2401d5e3f507 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:38.877302 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-23737e49-af94-4b8a-bc0a-2401d5e3f507 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:38.878504 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-23737e49-af94-4b8a-bc0a-2401d5e3f507 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:38.879084 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-23737e49-af94-4b8a-bc0a-2401d5e3f507 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:38.891888 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0c527211-5bad-4aa2-b5eb-22450490ca62 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:38.892428 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0c527211-5bad-4aa2-b5eb-22450490ca62 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:38.893288 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0c527211-5bad-4aa2-b5eb-22450490ca62 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:38.893731 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0c527211-5bad-4aa2-b5eb-22450490ca62 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:38.920150 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-0c527211-5bad-4aa2-b5eb-22450490ca62 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] 10.222.0.46 "GET /compute/v2.1/servers" status: 200 len: 677 microversion: 2.1 time: 0.057683 Jan 15 20:59:38.920959 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1668/3322] 10.222.0.46 () {58 vars in 1124 bytes} [Sat Jan 15 20:59:38 2022] GET /compute/v2.1/servers => generated 677 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:59:38.931033 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-7981a0cf-f584-43c8-bc48-ec112c3be34e tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:38.931651 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-7981a0cf-f584-43c8-bc48-ec112c3be34e tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] [instance: e04f7a96-62cb-4aae-9612-aa8df88aef61] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:38.938049 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7981a0cf-f584-43c8-bc48-ec112c3be34e tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:38.938501 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7981a0cf-f584-43c8-bc48-ec112c3be34e tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:38.939286 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7981a0cf-f584-43c8-bc48-ec112c3be34e tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:38.939722 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7981a0cf-f584-43c8-bc48-ec112c3be34e tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:38.948535 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-23737e49-af94-4b8a-bc0a-2401d5e3f507 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 24586 microversion: 2.42 time: 0.091089 Jan 15 20:59:38.949277 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1655/3323] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 20:59:38 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 24586 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 20:59:38.955990 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f90cb2b2-55f7-4d0c-8258-c0ab814dbd8e tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:38.956779 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f90cb2b2-55f7-4d0c-8258-c0ab814dbd8e tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] [instance: 0d04bb3a-eacf-48ca-b7bf-e830a2c30b80] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:38.959995 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-7981a0cf-f584-43c8-bc48-ec112c3be34e tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] HTTP exception thrown: Instance e04f7a96-62cb-4aae-9612-aa8df88aef61 could not be found. Jan 15 20:59:38.960741 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-7981a0cf-f584-43c8-bc48-ec112c3be34e tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] Returning 404 to user: Instance e04f7a96-62cb-4aae-9612-aa8df88aef61 could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:59:38.961682 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-7981a0cf-f584-43c8-bc48-ec112c3be34e tempest-ServerRescueNegativeTestJSON-1529536467 tempest-ServerRescueNegativeTestJSON-1529536467-project] 10.222.0.46 "GET /compute/v2.1/servers/e04f7a96-62cb-4aae-9612-aa8df88aef61" status: 404 len: 111 microversion: 2.1 time: 0.039734 Jan 15 20:59:38.965973 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1669/3324] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:38 2022] GET /compute/v2.1/servers/e04f7a96-62cb-4aae-9612-aa8df88aef61 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:59:38.971165 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9af44951-d4fd-4553-9a94-1a156de14ff4 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:38.972320 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-9af44951-d4fd-4553-9a94-1a156de14ff4 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] [instance: 5e93486c-7c77-4855-85f4-2bc8bcf4832f] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:38.980172 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9af44951-d4fd-4553-9a94-1a156de14ff4 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:38.980891 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9af44951-d4fd-4553-9a94-1a156de14ff4 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:38.981831 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9af44951-d4fd-4553-9a94-1a156de14ff4 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:38.983438 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9af44951-d4fd-4553-9a94-1a156de14ff4 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:39.031799 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-9af44951-d4fd-4553-9a94-1a156de14ff4 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] 10.222.0.46 "POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action" status: 200 len: 16401 microversion: 2.1 time: 0.063951 Jan 15 20:59:39.033174 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1670/3325] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:59:38 2022] POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action => generated 16401 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:59:39.114617 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-f90cb2b2-55f7-4d0c-8258-c0ab814dbd8e tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c07d13117a49b6b2042e182faaf9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca0988cda6548f89ee936bee64f56ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:39.124954 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f90cb2b2-55f7-4d0c-8258-c0ab814dbd8e tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] 10.222.0.46 "GET /compute/v2.1/servers/0d04bb3a-eacf-48ca-b7bf-e830a2c30b80" status: 200 len: 1220 microversion: 2.1 time: 0.174113 Jan 15 20:59:39.127165 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1656/3326] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:38 2022] GET /compute/v2.1/servers/0d04bb3a-eacf-48ca-b7bf-e830a2c30b80 => generated 1220 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:59:39.391043 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c77e029f-7836-4c3f-94b8-e73aaf168a6e tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:39.392532 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c77e029f-7836-4c3f-94b8-e73aaf168a6e tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] [instance: 6d9fd532-17fd-4ec1-b3e2-d05605c20756] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:39.404377 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c77e029f-7836-4c3f-94b8-e73aaf168a6e tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:39.405523 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c77e029f-7836-4c3f-94b8-e73aaf168a6e tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:39.406893 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c77e029f-7836-4c3f-94b8-e73aaf168a6e tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:39.407637 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c77e029f-7836-4c3f-94b8-e73aaf168a6e tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:39.446497 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-18747b45-47fa-4a12-be6b-8ce108b2be91 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:39.448936 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-18747b45-47fa-4a12-be6b-8ce108b2be91 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:39.458577 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-18747b45-47fa-4a12-be6b-8ce108b2be91 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:39.460409 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-18747b45-47fa-4a12-be6b-8ce108b2be91 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:39.461621 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-18747b45-47fa-4a12-be6b-8ce108b2be91 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:39.462336 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-18747b45-47fa-4a12-be6b-8ce108b2be91 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:39.510502 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-c77e029f-7836-4c3f-94b8-e73aaf168a6e tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b671d4d84454404a6f8ceba212fb2d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b3ba8ddd164cbbbc04a57bd2819003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:39.527143 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-18747b45-47fa-4a12-be6b-8ce108b2be91 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action" status: 200 len: 32641 microversion: 2.1 time: 0.090748 Jan 15 20:59:39.528186 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c77e029f-7836-4c3f-94b8-e73aaf168a6e tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] 10.222.0.46 "GET /compute/v2.1/servers/6d9fd532-17fd-4ec1-b3e2-d05605c20756" status: 200 len: 1281 microversion: 2.1 time: 0.155774 Jan 15 20:59:39.529320 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1671/3327] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:39 2022] GET /compute/v2.1/servers/6d9fd532-17fd-4ec1-b3e2-d05605c20756 => generated 1281 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:59:39.530202 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1657/3328] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:59:39 2022] POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action => generated 32641 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:59:39.778783 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3f293943-98da-41fb-8b52-150e30c7ef42 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:39.779830 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-3f293943-98da-41fb-8b52-150e30c7ef42 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: c8986b09-8342-4290-87be-22cece488c73] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:39.788182 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3f293943-98da-41fb-8b52-150e30c7ef42 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:39.790106 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3f293943-98da-41fb-8b52-150e30c7ef42 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:39.791773 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3f293943-98da-41fb-8b52-150e30c7ef42 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:39.792535 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3f293943-98da-41fb-8b52-150e30c7ef42 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:39.965481 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-14686fb6-a66c-483e-b59c-753a5fb726d2 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:39.976477 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-14686fb6-a66c-483e-b59c-753a5fb726d2 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:39.998767 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-14686fb6-a66c-483e-b59c-753a5fb726d2 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:39.999522 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-14686fb6-a66c-483e-b59c-753a5fb726d2 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:40.000491 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-14686fb6-a66c-483e-b59c-753a5fb726d2 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:40.001114 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-14686fb6-a66c-483e-b59c-753a5fb726d2 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:40.090646 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-14686fb6-a66c-483e-b59c-753a5fb726d2 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 24586 microversion: 2.42 time: 0.133226 Jan 15 20:59:40.091316 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1658/3329] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 20:59:39 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 24586 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 20:59:40.099319 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ac5add6e-b2f1-462a-91aa-f1bc497c4931 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:40.101921 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ac5add6e-b2f1-462a-91aa-f1bc497c4931 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] [instance: 5e93486c-7c77-4855-85f4-2bc8bcf4832f] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:40.112081 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ac5add6e-b2f1-462a-91aa-f1bc497c4931 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:40.113521 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ac5add6e-b2f1-462a-91aa-f1bc497c4931 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:40.114773 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ac5add6e-b2f1-462a-91aa-f1bc497c4931 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:40.115411 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ac5add6e-b2f1-462a-91aa-f1bc497c4931 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:40.172440 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ac5add6e-b2f1-462a-91aa-f1bc497c4931 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] 10.222.0.46 "POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action" status: 200 len: 16401 microversion: 2.1 time: 0.079402 Jan 15 20:59:40.173247 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1659/3330] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:59:40 2022] POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action => generated 16401 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:59:40.178695 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-75fef922-0bee-42e5-b3f1-8ce0c1468ddb tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:40.179408 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-75fef922-0bee-42e5-b3f1-8ce0c1468ddb tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] [instance: 0d04bb3a-eacf-48ca-b7bf-e830a2c30b80] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:40.186688 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-75fef922-0bee-42e5-b3f1-8ce0c1468ddb tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:40.187072 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-75fef922-0bee-42e5-b3f1-8ce0c1468ddb tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:40.187867 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-75fef922-0bee-42e5-b3f1-8ce0c1468ddb tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:40.188613 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-75fef922-0bee-42e5-b3f1-8ce0c1468ddb tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:40.215448 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-3f293943-98da-41fb-8b52-150e30c7ef42 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8f9c6ea7f6496792258d683640c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a75218d537c4d63874297261bec70ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:40.231224 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3f293943-98da-41fb-8b52-150e30c7ef42 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] 10.222.0.46 "GET /compute/v2.1/servers/c8986b09-8342-4290-87be-22cece488c73" status: 200 len: 1515 microversion: 2.1 time: 0.459035 Jan 15 20:59:40.232064 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1672/3331] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:39 2022] GET /compute/v2.1/servers/c8986b09-8342-4290-87be-22cece488c73 => generated 1515 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:59:40.292313 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-75fef922-0bee-42e5-b3f1-8ce0c1468ddb tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c07d13117a49b6b2042e182faaf9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca0988cda6548f89ee936bee64f56ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:40.303423 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-75fef922-0bee-42e5-b3f1-8ce0c1468ddb tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] 10.222.0.46 "GET /compute/v2.1/servers/0d04bb3a-eacf-48ca-b7bf-e830a2c30b80" status: 200 len: 1272 microversion: 2.1 time: 0.129065 Jan 15 20:59:40.304383 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1660/3332] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:40 2022] GET /compute/v2.1/servers/0d04bb3a-eacf-48ca-b7bf-e830a2c30b80 => generated 1272 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:59:40.548531 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-7ceaa4aa-ad25-43ce-99e6-a4960c7986a3 tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:40.549464 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-7ceaa4aa-ad25-43ce-99e6-a4960c7986a3 tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] [instance: 6d9fd532-17fd-4ec1-b3e2-d05605c20756] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:40.562086 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7ceaa4aa-ad25-43ce-99e6-a4960c7986a3 tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:40.562927 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7ceaa4aa-ad25-43ce-99e6-a4960c7986a3 tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:40.564076 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7ceaa4aa-ad25-43ce-99e6-a4960c7986a3 tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:40.564832 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7ceaa4aa-ad25-43ce-99e6-a4960c7986a3 tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:40.580228 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-745ebe94-f591-4080-8a15-08d989644e02 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:40.594761 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-745ebe94-f591-4080-8a15-08d989644e02 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:40.618509 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-745ebe94-f591-4080-8a15-08d989644e02 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:40.621385 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-745ebe94-f591-4080-8a15-08d989644e02 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:40.625735 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-745ebe94-f591-4080-8a15-08d989644e02 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:40.628583 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-745ebe94-f591-4080-8a15-08d989644e02 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:40.714792 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-745ebe94-f591-4080-8a15-08d989644e02 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action" status: 200 len: 32641 microversion: 2.1 time: 0.168246 Jan 15 20:59:40.720425 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1661/3333] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:59:40 2022] POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action => generated 32641 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 20:59:41.087269 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-7ceaa4aa-ad25-43ce-99e6-a4960c7986a3 tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b671d4d84454404a6f8ceba212fb2d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b3ba8ddd164cbbbc04a57bd2819003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:41.094855 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-7ceaa4aa-ad25-43ce-99e6-a4960c7986a3 tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] 10.222.0.46 "GET /compute/v2.1/servers/6d9fd532-17fd-4ec1-b3e2-d05605c20756" status: 200 len: 1323 microversion: 2.1 time: 0.553950 Jan 15 20:59:41.104814 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-98236b69-2000-4e64-9623-919649fb0730 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:41.105661 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1673/3334] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:40 2022] GET /compute/v2.1/servers/6d9fd532-17fd-4ec1-b3e2-d05605c20756 => generated 1323 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:59:41.106960 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-98236b69-2000-4e64-9623-919649fb0730 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:41.121750 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-98236b69-2000-4e64-9623-919649fb0730 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:41.125557 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-98236b69-2000-4e64-9623-919649fb0730 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:41.126673 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-98236b69-2000-4e64-9623-919649fb0730 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:41.127185 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-98236b69-2000-4e64-9623-919649fb0730 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:41.185633 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2172fd65-5e8a-4220-9ed3-b9af1e1d0230 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:41.187141 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-2172fd65-5e8a-4220-9ed3-b9af1e1d0230 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] [instance: 5e93486c-7c77-4855-85f4-2bc8bcf4832f] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:41.198587 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-98236b69-2000-4e64-9623-919649fb0730 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 24586 microversion: 2.42 time: 0.099025 Jan 15 20:59:41.200184 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1662/3335] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 20:59:41 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 24586 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 20:59:41.202018 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2172fd65-5e8a-4220-9ed3-b9af1e1d0230 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:41.202481 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2172fd65-5e8a-4220-9ed3-b9af1e1d0230 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:41.203472 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2172fd65-5e8a-4220-9ed3-b9af1e1d0230 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:41.204086 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2172fd65-5e8a-4220-9ed3-b9af1e1d0230 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:41.252004 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e5f5b134-ca46-4df3-9e5b-e671d1bf4ff7 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:41.252647 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e5f5b134-ca46-4df3-9e5b-e671d1bf4ff7 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: c8986b09-8342-4290-87be-22cece488c73] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:41.272627 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e5f5b134-ca46-4df3-9e5b-e671d1bf4ff7 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:41.274473 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e5f5b134-ca46-4df3-9e5b-e671d1bf4ff7 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:41.275874 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2172fd65-5e8a-4220-9ed3-b9af1e1d0230 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] 10.222.0.46 "POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action" status: 200 len: 24573 microversion: 2.1 time: 0.094017 Jan 15 20:59:41.280802 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1674/3336] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:59:41 2022] POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action => generated 24573 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:59:41.282224 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e5f5b134-ca46-4df3-9e5b-e671d1bf4ff7 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:41.283038 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e5f5b134-ca46-4df3-9e5b-e671d1bf4ff7 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:41.328828 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c7c24cf9-1a07-469d-883d-8879c190402f tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:41.330028 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c7c24cf9-1a07-469d-883d-8879c190402f tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] [instance: 0d04bb3a-eacf-48ca-b7bf-e830a2c30b80] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:41.355903 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c7c24cf9-1a07-469d-883d-8879c190402f tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:41.356601 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c7c24cf9-1a07-469d-883d-8879c190402f tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:41.357725 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c7c24cf9-1a07-469d-883d-8879c190402f tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:41.358553 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c7c24cf9-1a07-469d-883d-8879c190402f tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:41.567413 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-c7c24cf9-1a07-469d-883d-8879c190402f tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c07d13117a49b6b2042e182faaf9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca0988cda6548f89ee936bee64f56ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:41.580963 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c7c24cf9-1a07-469d-883d-8879c190402f tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] 10.222.0.46 "GET /compute/v2.1/servers/0d04bb3a-eacf-48ca-b7bf-e830a2c30b80" status: 200 len: 1278 microversion: 2.1 time: 0.263336 Jan 15 20:59:41.582881 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1675/3337] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:41 2022] GET /compute/v2.1/servers/0d04bb3a-eacf-48ca-b7bf-e830a2c30b80 => generated 1278 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:59:41.729129 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-519ffe63-f50b-46d9-8c59-a571b397131c tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:41.731929 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-519ffe63-f50b-46d9-8c59-a571b397131c tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:41.742009 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-519ffe63-f50b-46d9-8c59-a571b397131c tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:41.742568 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-519ffe63-f50b-46d9-8c59-a571b397131c tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:41.743461 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-519ffe63-f50b-46d9-8c59-a571b397131c tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:41.743955 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-519ffe63-f50b-46d9-8c59-a571b397131c tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:41.809989 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-519ffe63-f50b-46d9-8c59-a571b397131c tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action" status: 200 len: 32641 microversion: 2.1 time: 0.085804 Jan 15 20:59:41.814638 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-e5f5b134-ca46-4df3-9e5b-e671d1bf4ff7 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8f9c6ea7f6496792258d683640c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a75218d537c4d63874297261bec70ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:41.829210 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e5f5b134-ca46-4df3-9e5b-e671d1bf4ff7 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] 10.222.0.46 "GET /compute/v2.1/servers/c8986b09-8342-4290-87be-22cece488c73" status: 200 len: 1515 microversion: 2.1 time: 0.584322 Jan 15 20:59:41.830513 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1676/3338] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:59:41 2022] POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action => generated 32641 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 20:59:41.844872 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1663/3339] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:41 2022] GET /compute/v2.1/servers/c8986b09-8342-4290-87be-22cece488c73 => generated 1515 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:59:42.128013 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-179574a6-791d-4e1f-a8e4-21c3c4cbf5a1 tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:42.130162 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-179574a6-791d-4e1f-a8e4-21c3c4cbf5a1 tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] [instance: 6d9fd532-17fd-4ec1-b3e2-d05605c20756] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:42.145904 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-179574a6-791d-4e1f-a8e4-21c3c4cbf5a1 tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:42.147488 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-179574a6-791d-4e1f-a8e4-21c3c4cbf5a1 tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:42.150116 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-179574a6-791d-4e1f-a8e4-21c3c4cbf5a1 tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:42.150854 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-179574a6-791d-4e1f-a8e4-21c3c4cbf5a1 tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:42.215965 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7ba3b61d-69fd-4516-8f9e-e4b69ae04bb1 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:42.218370 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-7ba3b61d-69fd-4516-8f9e-e4b69ae04bb1 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:42.247071 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7ba3b61d-69fd-4516-8f9e-e4b69ae04bb1 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:42.247547 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7ba3b61d-69fd-4516-8f9e-e4b69ae04bb1 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:42.248377 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7ba3b61d-69fd-4516-8f9e-e4b69ae04bb1 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:42.248999 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7ba3b61d-69fd-4516-8f9e-e4b69ae04bb1 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:42.305579 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7ba3b61d-69fd-4516-8f9e-e4b69ae04bb1 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 24586 microversion: 2.42 time: 0.097424 Jan 15 20:59:42.306841 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1664/3340] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 20:59:42 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 24586 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 20:59:42.316551 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a74c69dc-fde7-4dd8-8059-3198afd58b0d tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:42.318337 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a74c69dc-fde7-4dd8-8059-3198afd58b0d tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] [instance: 5e93486c-7c77-4855-85f4-2bc8bcf4832f] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:42.332659 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a74c69dc-fde7-4dd8-8059-3198afd58b0d tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:42.333325 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a74c69dc-fde7-4dd8-8059-3198afd58b0d tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:42.336073 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a74c69dc-fde7-4dd8-8059-3198afd58b0d tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:42.336969 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a74c69dc-fde7-4dd8-8059-3198afd58b0d tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:42.399811 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a74c69dc-fde7-4dd8-8059-3198afd58b0d tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] 10.222.0.46 "POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action" status: 200 len: 24573 microversion: 2.1 time: 0.091516 Jan 15 20:59:42.400913 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1665/3341] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:59:42 2022] POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action => generated 24573 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:59:42.406508 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-7660c113-d72e-47c2-afa1-d55d65feae16 req-6cee389d-a9ab-4edf-a2a8-9ea9b05324ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d9fd532-17fd-4ec1-b3e2-d05605c20756", "tag": "6c32aa4e-6a73-415e-9647-886333a1d237"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:42.408055 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:59:42.408055 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:59:42.434952 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-7660c113-d72e-47c2-afa1-d55d65feae16 req-6cee389d-a9ab-4edf-a2a8-9ea9b05324ae service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:42.435689 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-7660c113-d72e-47c2-afa1-d55d65feae16 req-6cee389d-a9ab-4edf-a2a8-9ea9b05324ae service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:42.484748 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-7660c113-d72e-47c2-afa1-d55d65feae16 req-6cee389d-a9ab-4edf-a2a8-9ea9b05324ae service nova] Creating event network-changed:6c32aa4e-6a73-415e-9647-886333a1d237 for instance 6d9fd532-17fd-4ec1-b3e2-d05605c20756 on nch2-master-1 Jan 15 20:59:42.502697 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-7660c113-d72e-47c2-afa1-d55d65feae16 req-6cee389d-a9ab-4edf-a2a8-9ea9b05324ae service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099866 Jan 15 20:59:42.503842 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1666/3342] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:59:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:59:42.614826 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-fadf24b2-c28a-4bac-9672-75947e1267a7 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:42.616032 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-fadf24b2-c28a-4bac-9672-75947e1267a7 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] [instance: 0d04bb3a-eacf-48ca-b7bf-e830a2c30b80] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:42.628052 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fadf24b2-c28a-4bac-9672-75947e1267a7 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:42.629669 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fadf24b2-c28a-4bac-9672-75947e1267a7 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:42.632794 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fadf24b2-c28a-4bac-9672-75947e1267a7 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:42.634266 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fadf24b2-c28a-4bac-9672-75947e1267a7 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:43.071975 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-179574a6-791d-4e1f-a8e4-21c3c4cbf5a1 tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b671d4d84454404a6f8ceba212fb2d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b3ba8ddd164cbbbc04a57bd2819003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:43.081880 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-179574a6-791d-4e1f-a8e4-21c3c4cbf5a1 tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] 10.222.0.46 "GET /compute/v2.1/servers/6d9fd532-17fd-4ec1-b3e2-d05605c20756" status: 200 len: 1323 microversion: 2.1 time: 0.971956 Jan 15 20:59:43.090660 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1677/3343] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:42 2022] GET /compute/v2.1/servers/6d9fd532-17fd-4ec1-b3e2-d05605c20756 => generated 1323 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:59:43.103826 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-fadf24b2-c28a-4bac-9672-75947e1267a7 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c07d13117a49b6b2042e182faaf9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca0988cda6548f89ee936bee64f56ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:43.106795 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-44af9255-16b9-4c6e-a243-6c44d5b7c666 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:43.107739 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-44af9255-16b9-4c6e-a243-6c44d5b7c666 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:43.123682 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-fadf24b2-c28a-4bac-9672-75947e1267a7 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] 10.222.0.46 "GET /compute/v2.1/servers/0d04bb3a-eacf-48ca-b7bf-e830a2c30b80" status: 200 len: 1278 microversion: 2.1 time: 0.509796 Jan 15 20:59:43.127590 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1667/3344] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:42 2022] GET /compute/v2.1/servers/0d04bb3a-eacf-48ca-b7bf-e830a2c30b80 => generated 1278 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:59:43.136810 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f40c94ff-48d5-46ef-aa27-d47346159d9a tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:43.138470 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-44af9255-16b9-4c6e-a243-6c44d5b7c666 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:43.139076 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-44af9255-16b9-4c6e-a243-6c44d5b7c666 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:43.139982 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-44af9255-16b9-4c6e-a243-6c44d5b7c666 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:43.140561 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f40c94ff-48d5-46ef-aa27-d47346159d9a tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: c8986b09-8342-4290-87be-22cece488c73] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:43.143837 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-44af9255-16b9-4c6e-a243-6c44d5b7c666 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:43.160442 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f40c94ff-48d5-46ef-aa27-d47346159d9a tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:43.160922 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f40c94ff-48d5-46ef-aa27-d47346159d9a tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:43.161724 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f40c94ff-48d5-46ef-aa27-d47346159d9a tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:43.162197 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f40c94ff-48d5-46ef-aa27-d47346159d9a tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:43.203407 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-44af9255-16b9-4c6e-a243-6c44d5b7c666 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action" status: 200 len: 32641 microversion: 2.1 time: 0.111108 Jan 15 20:59:43.204979 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1678/3345] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:59:43 2022] POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action => generated 32641 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:59:43.322327 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-4aa12ccf-f411-4268-babb-ac1583606a61 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:43.324217 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-4aa12ccf-f411-4268-babb-ac1583606a61 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:43.360655 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4aa12ccf-f411-4268-babb-ac1583606a61 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:43.361582 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4aa12ccf-f411-4268-babb-ac1583606a61 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:43.363097 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4aa12ccf-f411-4268-babb-ac1583606a61 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:43.363833 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4aa12ccf-f411-4268-babb-ac1583606a61 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:43.447724 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-4aa12ccf-f411-4268-babb-ac1583606a61 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 24586 microversion: 2.42 time: 0.133172 Jan 15 20:59:43.462330 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1679/3346] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 20:59:43 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 24586 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 20:59:43.471152 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-652eb350-8f87-4157-a145-3fdf16d8a08b tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:43.473229 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-652eb350-8f87-4157-a145-3fdf16d8a08b tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] [instance: 5e93486c-7c77-4855-85f4-2bc8bcf4832f] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:43.482260 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-652eb350-8f87-4157-a145-3fdf16d8a08b tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:43.483110 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-652eb350-8f87-4157-a145-3fdf16d8a08b tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:43.484703 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-652eb350-8f87-4157-a145-3fdf16d8a08b tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:43.485334 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-652eb350-8f87-4157-a145-3fdf16d8a08b tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:43.543450 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-652eb350-8f87-4157-a145-3fdf16d8a08b tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] 10.222.0.46 "POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action" status: 200 len: 24573 microversion: 2.1 time: 0.078655 Jan 15 20:59:43.545776 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1680/3347] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:59:43 2022] POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action => generated 24573 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:59:43.774706 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-f40c94ff-48d5-46ef-aa27-d47346159d9a tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8f9c6ea7f6496792258d683640c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a75218d537c4d63874297261bec70ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:43.782822 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f40c94ff-48d5-46ef-aa27-d47346159d9a tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] 10.222.0.46 "GET /compute/v2.1/servers/c8986b09-8342-4290-87be-22cece488c73" status: 200 len: 1515 microversion: 2.1 time: 0.654040 Jan 15 20:59:43.796335 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1668/3348] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:43 2022] GET /compute/v2.1/servers/c8986b09-8342-4290-87be-22cece488c73 => generated 1515 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:59:44.112926 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a235e49e-28ca-490a-a2e6-d08cbeb2b90d tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:44.114380 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a235e49e-28ca-490a-a2e6-d08cbeb2b90d tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] [instance: 6d9fd532-17fd-4ec1-b3e2-d05605c20756] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:44.135762 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8ffbdd3c-f53b-442e-af40-693ce2268f61 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:44.137821 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-8ffbdd3c-f53b-442e-af40-693ce2268f61 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] [instance: 0d04bb3a-eacf-48ca-b7bf-e830a2c30b80] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:44.155620 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a235e49e-28ca-490a-a2e6-d08cbeb2b90d tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:44.156803 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8ffbdd3c-f53b-442e-af40-693ce2268f61 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:44.157368 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8ffbdd3c-f53b-442e-af40-693ce2268f61 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:44.158557 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8ffbdd3c-f53b-442e-af40-693ce2268f61 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:44.160077 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8ffbdd3c-f53b-442e-af40-693ce2268f61 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:44.161005 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a235e49e-28ca-490a-a2e6-d08cbeb2b90d tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:44.169666 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a235e49e-28ca-490a-a2e6-d08cbeb2b90d tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:44.171626 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a235e49e-28ca-490a-a2e6-d08cbeb2b90d tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:44.825390 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-a235e49e-28ca-490a-a2e6-d08cbeb2b90d tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b671d4d84454404a6f8ceba212fb2d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b3ba8ddd164cbbbc04a57bd2819003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:44.839977 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a235e49e-28ca-490a-a2e6-d08cbeb2b90d tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] 10.222.0.46 "GET /compute/v2.1/servers/6d9fd532-17fd-4ec1-b3e2-d05605c20756" status: 200 len: 1323 microversion: 2.1 time: 0.734016 Jan 15 20:59:44.840780 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1681/3349] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:44 2022] GET /compute/v2.1/servers/6d9fd532-17fd-4ec1-b3e2-d05605c20756 => generated 1323 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:59:44.850416 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d8320e65-cf4b-4db0-826f-a5c78f097379 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:44.867416 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d8320e65-cf4b-4db0-826f-a5c78f097379 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:44.874297 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d8320e65-cf4b-4db0-826f-a5c78f097379 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:44.874870 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d8320e65-cf4b-4db0-826f-a5c78f097379 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:44.875651 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d8320e65-cf4b-4db0-826f-a5c78f097379 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:44.876176 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d8320e65-cf4b-4db0-826f-a5c78f097379 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:44.965578 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d8320e65-cf4b-4db0-826f-a5c78f097379 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action" status: 200 len: 32641 microversion: 2.1 time: 0.119725 Jan 15 20:59:44.966485 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1682/3350] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:59:44 2022] POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action => generated 32641 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:59:44.978884 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-83ba3f2f-e27a-48cb-8567-d48f57ffcfac tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:44.979911 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-83ba3f2f-e27a-48cb-8567-d48f57ffcfac tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:44.992379 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-83ba3f2f-e27a-48cb-8567-d48f57ffcfac tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:44.992894 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-83ba3f2f-e27a-48cb-8567-d48f57ffcfac tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:45.011830 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-83ba3f2f-e27a-48cb-8567-d48f57ffcfac tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:45.012295 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-83ba3f2f-e27a-48cb-8567-d48f57ffcfac tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:45.075193 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-8ffbdd3c-f53b-442e-af40-693ce2268f61 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c07d13117a49b6b2042e182faaf9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca0988cda6548f89ee936bee64f56ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:45.088692 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-8ffbdd3c-f53b-442e-af40-693ce2268f61 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] 10.222.0.46 "GET /compute/v2.1/servers/0d04bb3a-eacf-48ca-b7bf-e830a2c30b80" status: 200 len: 1320 microversion: 2.1 time: 0.958249 Jan 15 20:59:45.090853 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1669/3351] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:44 2022] GET /compute/v2.1/servers/0d04bb3a-eacf-48ca-b7bf-e830a2c30b80 => generated 1320 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:59:45.103299 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-62fd5dd9-28f3-4ff3-8082-02592092858d tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:45.108238 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-62fd5dd9-28f3-4ff3-8082-02592092858d tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] [instance: 5e93486c-7c77-4855-85f4-2bc8bcf4832f] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:45.202044 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-62fd5dd9-28f3-4ff3-8082-02592092858d tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:45.210581 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-62fd5dd9-28f3-4ff3-8082-02592092858d tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:45.212508 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-62fd5dd9-28f3-4ff3-8082-02592092858d tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:45.216166 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-62fd5dd9-28f3-4ff3-8082-02592092858d tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:45.341168 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-62fd5dd9-28f3-4ff3-8082-02592092858d tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] 10.222.0.46 "POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action" status: 200 len: 24573 microversion: 2.1 time: 0.242484 Jan 15 20:59:45.343910 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1670/3352] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:59:45 2022] POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action => generated 24573 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:59:45.374167 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8177f46e-2f77-48e4-83fe-c115e5775500 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:45.375997 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-8177f46e-2f77-48e4-83fe-c115e5775500 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: c8986b09-8342-4290-87be-22cece488c73] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:45.397831 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8177f46e-2f77-48e4-83fe-c115e5775500 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:45.398786 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8177f46e-2f77-48e4-83fe-c115e5775500 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:45.420259 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8177f46e-2f77-48e4-83fe-c115e5775500 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:45.422838 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8177f46e-2f77-48e4-83fe-c115e5775500 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:45.700677 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-83ba3f2f-e27a-48cb-8567-d48f57ffcfac tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 24586 microversion: 2.42 time: 0.732980 Jan 15 20:59:45.706574 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1683/3353] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 20:59:44 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 24586 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 20:59:45.713132 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-b60d037d-e8a5-4f6e-b836-de027aaade5a req-35528a6b-17e8-47ba-aa9f-d118329e866b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58ee3eff-55c4-48eb-a5f6-2731d35270a0", "tag": "cac6dd7d-cf94-4715-be2c-1beb35c8ff69"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:45.714971 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:59:45.714971 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:59:45.722984 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-b60d037d-e8a5-4f6e-b836-de027aaade5a req-35528a6b-17e8-47ba-aa9f-d118329e866b service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:45.723641 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-b60d037d-e8a5-4f6e-b836-de027aaade5a req-35528a6b-17e8-47ba-aa9f-d118329e866b service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:45.755380 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-b60d037d-e8a5-4f6e-b836-de027aaade5a req-35528a6b-17e8-47ba-aa9f-d118329e866b service nova] Creating event network-changed:cac6dd7d-cf94-4715-be2c-1beb35c8ff69 for instance 58ee3eff-55c4-48eb-a5f6-2731d35270a0 on nch1-master-1 Jan 15 20:59:45.763563 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-b60d037d-e8a5-4f6e-b836-de027aaade5a req-35528a6b-17e8-47ba-aa9f-d118329e866b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054775 Jan 15 20:59:45.765045 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1684/3354] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:59:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:59:45.861608 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-217d0fe6-feb4-4ff4-9e27-a28f3b1355b6 tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:45.862913 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-217d0fe6-feb4-4ff4-9e27-a28f3b1355b6 tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] [instance: 6d9fd532-17fd-4ec1-b3e2-d05605c20756] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:45.872915 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-217d0fe6-feb4-4ff4-9e27-a28f3b1355b6 tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:45.873709 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-217d0fe6-feb4-4ff4-9e27-a28f3b1355b6 tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:45.874769 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-217d0fe6-feb4-4ff4-9e27-a28f3b1355b6 tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:45.875619 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-217d0fe6-feb4-4ff4-9e27-a28f3b1355b6 tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:45.977255 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-8177f46e-2f77-48e4-83fe-c115e5775500 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8f9c6ea7f6496792258d683640c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a75218d537c4d63874297261bec70ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:46.015296 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-8177f46e-2f77-48e4-83fe-c115e5775500 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] 10.222.0.46 "GET /compute/v2.1/servers/c8986b09-8342-4290-87be-22cece488c73" status: 200 len: 1515 microversion: 2.1 time: 0.667806 Jan 15 20:59:46.018319 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1671/3355] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:45 2022] GET /compute/v2.1/servers/c8986b09-8342-4290-87be-22cece488c73 => generated 1515 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:59:46.041500 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8fdc0f43-f12e-4496-9786-b1f8aed03147 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:46.046461 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-8fdc0f43-f12e-4496-9786-b1f8aed03147 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:46.087179 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8fdc0f43-f12e-4496-9786-b1f8aed03147 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:46.088370 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8fdc0f43-f12e-4496-9786-b1f8aed03147 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:46.089756 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8fdc0f43-f12e-4496-9786-b1f8aed03147 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:46.090424 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8fdc0f43-f12e-4496-9786-b1f8aed03147 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:46.193408 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-8fdc0f43-f12e-4496-9786-b1f8aed03147 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action" status: 200 len: 32641 microversion: 2.1 time: 0.167062 Jan 15 20:59:46.195605 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1672/3356] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:59:46 2022] POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action => generated 32641 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:59:46.204462 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-97f1b9ba-1953-4bd3-a5cd-1e8b6d47f93f tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:46.205849 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-97f1b9ba-1953-4bd3-a5cd-1e8b6d47f93f tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] [instance: 0d04bb3a-eacf-48ca-b7bf-e830a2c30b80] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:46.270498 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-97f1b9ba-1953-4bd3-a5cd-1e8b6d47f93f tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:46.271378 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-97f1b9ba-1953-4bd3-a5cd-1e8b6d47f93f tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:46.273334 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-97f1b9ba-1953-4bd3-a5cd-1e8b6d47f93f tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:46.278102 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-97f1b9ba-1953-4bd3-a5cd-1e8b6d47f93f tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:46.331803 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-217d0fe6-feb4-4ff4-9e27-a28f3b1355b6 tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b671d4d84454404a6f8ceba212fb2d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b3ba8ddd164cbbbc04a57bd2819003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:46.345955 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-217d0fe6-feb4-4ff4-9e27-a28f3b1355b6 tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] 10.222.0.46 "GET /compute/v2.1/servers/6d9fd532-17fd-4ec1-b3e2-d05605c20756" status: 200 len: 1323 microversion: 2.1 time: 0.486693 Jan 15 20:59:46.351407 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1685/3357] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:45 2022] GET /compute/v2.1/servers/6d9fd532-17fd-4ec1-b3e2-d05605c20756 => generated 1323 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:59:46.366885 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2ec2173e-d30f-4285-ac50-e73f620f254c tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:46.376238 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-2ec2173e-d30f-4285-ac50-e73f620f254c tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] [instance: 5e93486c-7c77-4855-85f4-2bc8bcf4832f] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:46.398933 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2ec2173e-d30f-4285-ac50-e73f620f254c tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:46.403206 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2ec2173e-d30f-4285-ac50-e73f620f254c tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:46.404689 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2ec2173e-d30f-4285-ac50-e73f620f254c tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:46.407482 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2ec2173e-d30f-4285-ac50-e73f620f254c tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:46.495464 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2ec2173e-d30f-4285-ac50-e73f620f254c tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] 10.222.0.46 "POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action" status: 200 len: 24573 microversion: 2.1 time: 0.141710 Jan 15 20:59:46.496609 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1686/3358] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:59:46 2022] POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action => generated 24573 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:59:46.722052 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-00d3d599-18ea-415f-acb0-5f11ba05900d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:46.724481 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-00d3d599-18ea-415f-acb0-5f11ba05900d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:46.748602 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-00d3d599-18ea-415f-acb0-5f11ba05900d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:46.749399 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-00d3d599-18ea-415f-acb0-5f11ba05900d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:46.751873 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-00d3d599-18ea-415f-acb0-5f11ba05900d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:46.754151 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-00d3d599-18ea-415f-acb0-5f11ba05900d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:46.788341 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-97f1b9ba-1953-4bd3-a5cd-1e8b6d47f93f tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c07d13117a49b6b2042e182faaf9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca0988cda6548f89ee936bee64f56ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:46.807576 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-97f1b9ba-1953-4bd3-a5cd-1e8b6d47f93f tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] 10.222.0.46 "GET /compute/v2.1/servers/0d04bb3a-eacf-48ca-b7bf-e830a2c30b80" status: 200 len: 1320 microversion: 2.1 time: 0.609537 Jan 15 20:59:46.808478 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1673/3359] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:46 2022] GET /compute/v2.1/servers/0d04bb3a-eacf-48ca-b7bf-e830a2c30b80 => generated 1320 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:59:46.834505 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-00d3d599-18ea-415f-acb0-5f11ba05900d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 24586 microversion: 2.42 time: 0.121942 Jan 15 20:59:46.838948 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1687/3360] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 20:59:46 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 24586 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 20:59:47.036631 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f70c1326-244f-4131-b74f-c16147b4efff tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:47.037828 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f70c1326-244f-4131-b74f-c16147b4efff tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: c8986b09-8342-4290-87be-22cece488c73] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:47.050850 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f70c1326-244f-4131-b74f-c16147b4efff tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:47.051400 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f70c1326-244f-4131-b74f-c16147b4efff tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:47.052290 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f70c1326-244f-4131-b74f-c16147b4efff tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:47.057250 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f70c1326-244f-4131-b74f-c16147b4efff tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:47.206311 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3c8d66c4-a164-407b-8e17-acc1f81d7237 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:47.207746 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-3c8d66c4-a164-407b-8e17-acc1f81d7237 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:47.216055 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3c8d66c4-a164-407b-8e17-acc1f81d7237 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:47.216894 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3c8d66c4-a164-407b-8e17-acc1f81d7237 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:47.217959 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3c8d66c4-a164-407b-8e17-acc1f81d7237 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:47.218618 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3c8d66c4-a164-407b-8e17-acc1f81d7237 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:47.285893 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3c8d66c4-a164-407b-8e17-acc1f81d7237 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action" status: 200 len: 32641 microversion: 2.1 time: 0.083506 Jan 15 20:59:47.287566 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1688/3361] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:59:47 2022] POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action => generated 32641 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 20:59:47.368638 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-68ebf128-6127-42c5-8360-44fa0864a2ec tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:47.369830 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-68ebf128-6127-42c5-8360-44fa0864a2ec tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] [instance: 6d9fd532-17fd-4ec1-b3e2-d05605c20756] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:47.390583 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-68ebf128-6127-42c5-8360-44fa0864a2ec tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:47.391565 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-68ebf128-6127-42c5-8360-44fa0864a2ec tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:47.393382 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-68ebf128-6127-42c5-8360-44fa0864a2ec tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:47.394026 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-68ebf128-6127-42c5-8360-44fa0864a2ec tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:47.545048 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-f70c1326-244f-4131-b74f-c16147b4efff tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8f9c6ea7f6496792258d683640c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a75218d537c4d63874297261bec70ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:47.560291 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f70c1326-244f-4131-b74f-c16147b4efff tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] 10.222.0.46 "GET /compute/v2.1/servers/c8986b09-8342-4290-87be-22cece488c73" status: 200 len: 1515 microversion: 2.1 time: 0.528375 Jan 15 20:59:47.574085 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1674/3362] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:47 2022] GET /compute/v2.1/servers/c8986b09-8342-4290-87be-22cece488c73 => generated 1515 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:59:47.580593 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-eacc37de-96ab-4bf4-a3ae-43d01a83e31f tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:47.581803 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-eacc37de-96ab-4bf4-a3ae-43d01a83e31f tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] [instance: 5e93486c-7c77-4855-85f4-2bc8bcf4832f] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:47.596702 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-eacc37de-96ab-4bf4-a3ae-43d01a83e31f tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:47.597409 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-eacc37de-96ab-4bf4-a3ae-43d01a83e31f tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:47.598559 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-eacc37de-96ab-4bf4-a3ae-43d01a83e31f tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:47.599183 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-eacc37de-96ab-4bf4-a3ae-43d01a83e31f tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:47.656404 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-68ebf128-6127-42c5-8360-44fa0864a2ec tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b671d4d84454404a6f8ceba212fb2d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b3ba8ddd164cbbbc04a57bd2819003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:47.665501 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-68ebf128-6127-42c5-8360-44fa0864a2ec tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] 10.222.0.46 "GET /compute/v2.1/servers/6d9fd532-17fd-4ec1-b3e2-d05605c20756" status: 200 len: 1323 microversion: 2.1 time: 0.305081 Jan 15 20:59:47.684538 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1689/3363] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:47 2022] GET /compute/v2.1/servers/6d9fd532-17fd-4ec1-b3e2-d05605c20756 => generated 1323 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:59:47.690368 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-eacc37de-96ab-4bf4-a3ae-43d01a83e31f tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] 10.222.0.46 "POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action" status: 200 len: 24573 microversion: 2.1 time: 0.114332 Jan 15 20:59:47.696858 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1675/3364] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:59:47 2022] POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action => generated 24573 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:59:47.826916 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5e2086c4-91df-48b9-922b-5a00626bcfab tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:47.828380 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-5e2086c4-91df-48b9-922b-5a00626bcfab tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] [instance: 0d04bb3a-eacf-48ca-b7bf-e830a2c30b80] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:47.836209 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5e2086c4-91df-48b9-922b-5a00626bcfab tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:47.837092 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5e2086c4-91df-48b9-922b-5a00626bcfab tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:47.838062 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5e2086c4-91df-48b9-922b-5a00626bcfab tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:47.838603 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5e2086c4-91df-48b9-922b-5a00626bcfab tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:47.854152 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-da84c5a2-ab9e-4204-850d-cd3df18f70d3 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:47.855782 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-da84c5a2-ab9e-4204-850d-cd3df18f70d3 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:47.866988 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-da84c5a2-ab9e-4204-850d-cd3df18f70d3 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:47.867813 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-da84c5a2-ab9e-4204-850d-cd3df18f70d3 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:47.868868 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-da84c5a2-ab9e-4204-850d-cd3df18f70d3 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:47.869665 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-da84c5a2-ab9e-4204-850d-cd3df18f70d3 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:47.942614 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-da84c5a2-ab9e-4204-850d-cd3df18f70d3 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 24586 microversion: 2.42 time: 0.099268 Jan 15 20:59:47.943456 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1676/3365] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 20:59:47 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 24586 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 20:59:47.950939 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-6ba8d7f6-b0a0-4480-a59d-a1888de752ac req-3a6ea58f-dc8b-4719-9fa1-eaeea4d51b1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d04bb3a-eacf-48ca-b7bf-e830a2c30b80", "tag": "e1f58043-97ce-4c2d-86fb-63acb89366e7"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:47.952506 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:59:47.952506 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:59:47.960547 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-6ba8d7f6-b0a0-4480-a59d-a1888de752ac req-3a6ea58f-dc8b-4719-9fa1-eaeea4d51b1e service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:47.961129 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-6ba8d7f6-b0a0-4480-a59d-a1888de752ac req-3a6ea58f-dc8b-4719-9fa1-eaeea4d51b1e service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:47.973115 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-6ba8d7f6-b0a0-4480-a59d-a1888de752ac req-3a6ea58f-dc8b-4719-9fa1-eaeea4d51b1e service nova] Creating event network-changed:e1f58043-97ce-4c2d-86fb-63acb89366e7 for instance 0d04bb3a-eacf-48ca-b7bf-e830a2c30b80 on nch2-master-1 Jan 15 20:59:47.979159 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-6ba8d7f6-b0a0-4480-a59d-a1888de752ac req-3a6ea58f-dc8b-4719-9fa1-eaeea4d51b1e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034014 Jan 15 20:59:47.979916 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1677/3366] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:59:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:59:48.056468 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-5e2086c4-91df-48b9-922b-5a00626bcfab tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c07d13117a49b6b2042e182faaf9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca0988cda6548f89ee936bee64f56ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:48.064353 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5e2086c4-91df-48b9-922b-5a00626bcfab tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] 10.222.0.46 "GET /compute/v2.1/servers/0d04bb3a-eacf-48ca-b7bf-e830a2c30b80" status: 200 len: 1320 microversion: 2.1 time: 0.241991 Jan 15 20:59:48.065253 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1690/3367] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:47 2022] GET /compute/v2.1/servers/0d04bb3a-eacf-48ca-b7bf-e830a2c30b80 => generated 1320 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:59:48.299618 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-bc5f8ea0-8692-4432-8e01-88414dc3f92b tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:48.301292 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-bc5f8ea0-8692-4432-8e01-88414dc3f92b tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:48.309107 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bc5f8ea0-8692-4432-8e01-88414dc3f92b tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:48.309562 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bc5f8ea0-8692-4432-8e01-88414dc3f92b tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:48.310830 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bc5f8ea0-8692-4432-8e01-88414dc3f92b tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:48.311548 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bc5f8ea0-8692-4432-8e01-88414dc3f92b tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:48.359020 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-bc5f8ea0-8692-4432-8e01-88414dc3f92b tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action" status: 200 len: 32641 microversion: 2.1 time: 0.064075 Jan 15 20:59:48.359999 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1678/3368] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:59:48 2022] POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action => generated 32641 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:59:48.579702 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-7865f421-5461-4885-9ddc-a963891cf303 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:48.580822 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-7865f421-5461-4885-9ddc-a963891cf303 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: c8986b09-8342-4290-87be-22cece488c73] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:48.590669 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7865f421-5461-4885-9ddc-a963891cf303 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:48.591122 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7865f421-5461-4885-9ddc-a963891cf303 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:48.592340 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7865f421-5461-4885-9ddc-a963891cf303 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:48.592983 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7865f421-5461-4885-9ddc-a963891cf303 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:48.683739 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-178e4770-73fc-4e38-b98e-f2e93367fce0 tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:48.685385 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-178e4770-73fc-4e38-b98e-f2e93367fce0 tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] [instance: 6d9fd532-17fd-4ec1-b3e2-d05605c20756] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:48.700770 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-178e4770-73fc-4e38-b98e-f2e93367fce0 tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:48.701246 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-178e4770-73fc-4e38-b98e-f2e93367fce0 tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:48.702055 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-178e4770-73fc-4e38-b98e-f2e93367fce0 tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:48.707932 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-178e4770-73fc-4e38-b98e-f2e93367fce0 tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:48.850778 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-7865f421-5461-4885-9ddc-a963891cf303 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8f9c6ea7f6496792258d683640c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a75218d537c4d63874297261bec70ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:48.862993 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-7865f421-5461-4885-9ddc-a963891cf303 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] 10.222.0.46 "GET /compute/v2.1/servers/c8986b09-8342-4290-87be-22cece488c73" status: 200 len: 1515 microversion: 2.1 time: 0.288386 Jan 15 20:59:48.868148 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1691/3369] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:48 2022] GET /compute/v2.1/servers/c8986b09-8342-4290-87be-22cece488c73 => generated 1515 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:59:48.875045 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5cdbfabb-3997-4430-9e6f-a7abb0b4772b tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:48.876463 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-5cdbfabb-3997-4430-9e6f-a7abb0b4772b tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] [instance: 5e93486c-7c77-4855-85f4-2bc8bcf4832f] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:48.884764 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5cdbfabb-3997-4430-9e6f-a7abb0b4772b tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:48.885606 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5cdbfabb-3997-4430-9e6f-a7abb0b4772b tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:48.886898 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5cdbfabb-3997-4430-9e6f-a7abb0b4772b tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:48.887418 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5cdbfabb-3997-4430-9e6f-a7abb0b4772b tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:48.976289 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5cdbfabb-3997-4430-9e6f-a7abb0b4772b tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] 10.222.0.46 "POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action" status: 200 len: 24573 microversion: 2.1 time: 0.105873 Jan 15 20:59:48.977421 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1692/3370] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:59:48 2022] POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action => generated 24573 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:59:48.983906 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-178e4770-73fc-4e38-b98e-f2e93367fce0 tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b671d4d84454404a6f8ceba212fb2d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b3ba8ddd164cbbbc04a57bd2819003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:48.993134 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-49048362-3d16-4268-9e1c-694842882e95 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'create', calling method: .version_select at 0x7f30c858a160>, body: {"keypair": {"name": "tempest-keypair-16403008"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:48.995407 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-178e4770-73fc-4e38-b98e-f2e93367fce0 tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] 10.222.0.46 "GET /compute/v2.1/servers/6d9fd532-17fd-4ec1-b3e2-d05605c20756" status: 200 len: 1323 microversion: 2.1 time: 0.316309 Jan 15 20:59:48.996602 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1679/3371] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:48 2022] GET /compute/v2.1/servers/6d9fd532-17fd-4ec1-b3e2-d05605c20756 => generated 1323 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:59:49.001362 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-fe62597a-1942-4053-aa85-2c7321e3a31b tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:49.002586 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-fe62597a-1942-4053-aa85-2c7321e3a31b tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:49.012114 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fe62597a-1942-4053-aa85-2c7321e3a31b tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:49.013037 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fe62597a-1942-4053-aa85-2c7321e3a31b tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:49.014438 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fe62597a-1942-4053-aa85-2c7321e3a31b tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:49.015100 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fe62597a-1942-4053-aa85-2c7321e3a31b tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:49.022329 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-49048362-3d16-4268-9e1c-694842882e95 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Getting quotas for project 2b36b007e8a9409783a549b87017c8ee. Resources: {'key_pairs'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:59:49.030105 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-49048362-3d16-4268-9e1c-694842882e95 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Getting quotas for user f11dc7a8a21449b1b7de146145d51ec9 and project 2b36b007e8a9409783a549b87017c8ee. Resources: {'key_pairs'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:59:49.097713 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-fe62597a-1942-4053-aa85-2c7321e3a31b tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 24586 microversion: 2.42 time: 0.099632 Jan 15 20:59:49.098681 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1680/3372] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 20:59:48 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 24586 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 20:59:49.108915 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-2978d7d1-1e41-4768-8b8c-2d02b1336c0b tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:49.110206 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-2978d7d1-1e41-4768-8b8c-2d02b1336c0b tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] [instance: 0d04bb3a-eacf-48ca-b7bf-e830a2c30b80] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:49.118565 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2978d7d1-1e41-4768-8b8c-2d02b1336c0b tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:49.119589 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2978d7d1-1e41-4768-8b8c-2d02b1336c0b tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:49.120610 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2978d7d1-1e41-4768-8b8c-2d02b1336c0b tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:49.121392 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2978d7d1-1e41-4768-8b8c-2d02b1336c0b tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:49.203083 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-49048362-3d16-4268-9e1c-694842882e95 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Getting quotas for project 2b36b007e8a9409783a549b87017c8ee. Resources: {'key_pairs'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:59:49.213295 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-49048362-3d16-4268-9e1c-694842882e95 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Getting quotas for user f11dc7a8a21449b1b7de146145d51ec9 and project 2b36b007e8a9409783a549b87017c8ee. Resources: {'key_pairs'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:59:49.231944 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-49048362-3d16-4268-9e1c-694842882e95 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 201 len: 2318 microversion: 2.32 time: 0.252908 Jan 15 20:59:49.233129 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1693/3373] 10.222.0.46 () {62 vars in 1198 bytes} [Sat Jan 15 20:59:48 2022] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 255 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Jan 15 20:59:49.304816 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-2978d7d1-1e41-4768-8b8c-2d02b1336c0b tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c07d13117a49b6b2042e182faaf9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca0988cda6548f89ee936bee64f56ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:49.314047 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-2978d7d1-1e41-4768-8b8c-2d02b1336c0b tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] 10.222.0.46 "GET /compute/v2.1/servers/0d04bb3a-eacf-48ca-b7bf-e830a2c30b80" status: 200 len: 1320 microversion: 2.1 time: 0.213414 Jan 15 20:59:49.315038 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1681/3374] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:49 2022] GET /compute/v2.1/servers/0d04bb3a-eacf-48ca-b7bf-e830a2c30b80 => generated 1320 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:59:49.375824 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c193ec0d-dcc9-4e45-85fd-d7be5bdf5e5f tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:49.376897 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c193ec0d-dcc9-4e45-85fd-d7be5bdf5e5f tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:49.388224 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c193ec0d-dcc9-4e45-85fd-d7be5bdf5e5f tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:49.389319 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c193ec0d-dcc9-4e45-85fd-d7be5bdf5e5f tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:49.390284 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c193ec0d-dcc9-4e45-85fd-d7be5bdf5e5f tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:49.390284 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c193ec0d-dcc9-4e45-85fd-d7be5bdf5e5f tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:49.442721 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c193ec0d-dcc9-4e45-85fd-d7be5bdf5e5f tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action" status: 200 len: 32641 microversion: 2.1 time: 0.073848 Jan 15 20:59:49.445323 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1694/3375] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:59:49 2022] POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action => generated 32641 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:59:49.652348 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-2978d7d1-1e41-4768-8b8c-2d02b1336c0b tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:49.653428 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-2978d7d1-1e41-4768-8b8c-2d02b1336c0b tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] 10.222.0.46 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001467 Jan 15 20:59:49.653865 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1682/3376] 10.222.0.46 () {56 vars in 885 bytes} [Sat Jan 15 20:59:49 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jan 15 20:59:49.892773 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9478c2b4-a35c-40bd-ba85-5d0c198d0ff5 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:49.893566 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-9478c2b4-a35c-40bd-ba85-5d0c198d0ff5 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: c8986b09-8342-4290-87be-22cece488c73] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:49.904904 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9478c2b4-a35c-40bd-ba85-5d0c198d0ff5 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:49.905921 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9478c2b4-a35c-40bd-ba85-5d0c198d0ff5 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:49.909869 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9478c2b4-a35c-40bd-ba85-5d0c198d0ff5 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:49.913446 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9478c2b4-a35c-40bd-ba85-5d0c198d0ff5 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:49.987694 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-758bce30-7499-4313-8ad8-06464397b465 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:49.989230 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-758bce30-7499-4313-8ad8-06464397b465 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] [instance: 5e93486c-7c77-4855-85f4-2bc8bcf4832f] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:50.008988 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-758bce30-7499-4313-8ad8-06464397b465 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:50.009669 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-758bce30-7499-4313-8ad8-06464397b465 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:50.010664 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-758bce30-7499-4313-8ad8-06464397b465 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:50.011244 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-758bce30-7499-4313-8ad8-06464397b465 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:50.071022 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-758bce30-7499-4313-8ad8-06464397b465 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] 10.222.0.46 "POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action" status: 200 len: 24573 microversion: 2.1 time: 0.086761 Jan 15 20:59:50.071904 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1683/3377] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:59:49 2022] POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action => generated 24573 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 20:59:50.083598 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-29450322-6472-4366-8808-b9added0b573 tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:50.085387 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-29450322-6472-4366-8808-b9added0b573 tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] [instance: 6d9fd532-17fd-4ec1-b3e2-d05605c20756] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:50.107562 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-29450322-6472-4366-8808-b9added0b573 tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:50.108182 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-29450322-6472-4366-8808-b9added0b573 tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:50.109156 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-29450322-6472-4366-8808-b9added0b573 tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:50.109776 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-29450322-6472-4366-8808-b9added0b573 tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:50.179459 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-9478c2b4-a35c-40bd-ba85-5d0c198d0ff5 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8f9c6ea7f6496792258d683640c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a75218d537c4d63874297261bec70ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:50.196241 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-9478c2b4-a35c-40bd-ba85-5d0c198d0ff5 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] 10.222.0.46 "GET /compute/v2.1/servers/c8986b09-8342-4290-87be-22cece488c73" status: 200 len: 1515 microversion: 2.1 time: 0.310557 Jan 15 20:59:50.198574 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1695/3378] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:49 2022] GET /compute/v2.1/servers/c8986b09-8342-4290-87be-22cece488c73 => generated 1515 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:59:50.206913 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-617897bf-8b9a-4f8d-84da-602a7be5501e tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:50.216729 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-617897bf-8b9a-4f8d-84da-602a7be5501e tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:50.232952 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-617897bf-8b9a-4f8d-84da-602a7be5501e tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:50.236590 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-617897bf-8b9a-4f8d-84da-602a7be5501e tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:50.239453 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-617897bf-8b9a-4f8d-84da-602a7be5501e tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:50.241847 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-617897bf-8b9a-4f8d-84da-602a7be5501e tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:50.313918 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-617897bf-8b9a-4f8d-84da-602a7be5501e tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 24586 microversion: 2.42 time: 0.112775 Jan 15 20:59:50.317522 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1696/3379] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 20:59:50 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 24586 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 20:59:50.322061 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-29450322-6472-4366-8808-b9added0b573 tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b671d4d84454404a6f8ceba212fb2d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b3ba8ddd164cbbbc04a57bd2819003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:50.331604 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-29450322-6472-4366-8808-b9added0b573 tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] 10.222.0.46 "GET /compute/v2.1/servers/6d9fd532-17fd-4ec1-b3e2-d05605c20756" status: 200 len: 1323 microversion: 2.1 time: 0.258098 Jan 15 20:59:50.332441 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1684/3380] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:50 2022] GET /compute/v2.1/servers/6d9fd532-17fd-4ec1-b3e2-d05605c20756 => generated 1323 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:59:50.342827 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-b0e46c3a-30c8-44e6-b188-d1b55d393460 req-22821b2c-d059-4bb3-a04b-9c8da440ffde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d9fd532-17fd-4ec1-b3e2-d05605c20756", "name": "network-vif-plugged", "status": "completed", "tag": "6c32aa4e-6a73-415e-9647-886333a1d237"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:50.342827 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:59:50.342827 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:59:50.351686 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-5841720c-ce99-4e5f-b7cb-418a148178cf tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:50.352658 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-5841720c-ce99-4e5f-b7cb-418a148178cf tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] [instance: 0d04bb3a-eacf-48ca-b7bf-e830a2c30b80] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:50.371554 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-b0e46c3a-30c8-44e6-b188-d1b55d393460 req-22821b2c-d059-4bb3-a04b-9c8da440ffde service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:50.373769 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5841720c-ce99-4e5f-b7cb-418a148178cf tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:50.374600 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5841720c-ce99-4e5f-b7cb-418a148178cf tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:50.375658 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5841720c-ce99-4e5f-b7cb-418a148178cf tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:50.376554 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-b0e46c3a-30c8-44e6-b188-d1b55d393460 req-22821b2c-d059-4bb3-a04b-9c8da440ffde service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:50.377196 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5841720c-ce99-4e5f-b7cb-418a148178cf tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:50.412663 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-b0e46c3a-30c8-44e6-b188-d1b55d393460 req-22821b2c-d059-4bb3-a04b-9c8da440ffde service nova] Creating event network-vif-plugged:6c32aa4e-6a73-415e-9647-886333a1d237 for instance 6d9fd532-17fd-4ec1-b3e2-d05605c20756 on nch2-master-1 Jan 15 20:59:50.426681 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-b0e46c3a-30c8-44e6-b188-d1b55d393460 req-22821b2c-d059-4bb3-a04b-9c8da440ffde service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105097 Jan 15 20:59:50.432643 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1697/3381] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:59:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:59:50.461672 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b1527bb6-e72d-4215-80ef-bacde3df86fe tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:50.473050 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b1527bb6-e72d-4215-80ef-bacde3df86fe tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:50.497221 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b1527bb6-e72d-4215-80ef-bacde3df86fe tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:50.499671 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b1527bb6-e72d-4215-80ef-bacde3df86fe tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:50.501790 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b1527bb6-e72d-4215-80ef-bacde3df86fe tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:50.502357 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b1527bb6-e72d-4215-80ef-bacde3df86fe tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:50.581929 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b1527bb6-e72d-4215-80ef-bacde3df86fe tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action" status: 200 len: 32641 microversion: 2.1 time: 0.127645 Jan 15 20:59:50.584895 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1698/3382] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:59:50 2022] POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action => generated 32641 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 20:59:50.631287 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-5841720c-ce99-4e5f-b7cb-418a148178cf tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c07d13117a49b6b2042e182faaf9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca0988cda6548f89ee936bee64f56ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:50.643566 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-5841720c-ce99-4e5f-b7cb-418a148178cf tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] 10.222.0.46 "GET /compute/v2.1/servers/0d04bb3a-eacf-48ca-b7bf-e830a2c30b80" status: 200 len: 1320 microversion: 2.1 time: 0.297619 Jan 15 20:59:50.645072 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1685/3383] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:50 2022] GET /compute/v2.1/servers/0d04bb3a-eacf-48ca-b7bf-e830a2c30b80 => generated 1320 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:59:51.086224 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5824646d-fc3f-4215-b467-cef4f733acd1 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:51.088185 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-5824646d-fc3f-4215-b467-cef4f733acd1 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] [instance: 5e93486c-7c77-4855-85f4-2bc8bcf4832f] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:51.101418 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5824646d-fc3f-4215-b467-cef4f733acd1 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:51.101418 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5824646d-fc3f-4215-b467-cef4f733acd1 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:51.101418 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5824646d-fc3f-4215-b467-cef4f733acd1 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:51.101418 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5824646d-fc3f-4215-b467-cef4f733acd1 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:51.155270 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5824646d-fc3f-4215-b467-cef4f733acd1 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] 10.222.0.46 "POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action" status: 200 len: 24573 microversion: 2.1 time: 0.074820 Jan 15 20:59:51.156901 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1699/3384] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:59:51 2022] POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action => generated 24573 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:59:51.216976 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e0d2b1fe-2931-4396-a660-df1564c1bb85 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:51.216976 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e0d2b1fe-2931-4396-a660-df1564c1bb85 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: c8986b09-8342-4290-87be-22cece488c73] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:51.225002 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e0d2b1fe-2931-4396-a660-df1564c1bb85 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:51.226291 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e0d2b1fe-2931-4396-a660-df1564c1bb85 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:51.226426 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e0d2b1fe-2931-4396-a660-df1564c1bb85 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:51.226854 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e0d2b1fe-2931-4396-a660-df1564c1bb85 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:51.264493 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5c2af6da-8197-4146-bbe4-f104c1162da7 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1781838886", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "b740d751-068e-4a93-9225-aa5d63661275"}, {"port": "d36cd432-9054-48c0-a218-c6094ff964e7", "tag": "port-1"}, {"port": "d8af72f0-b932-47f5-b578-70fdd429d39b", "tag": "port-2"}, {"uuid": "f6dce376-1a08-428a-8bf0-aa7cf17a7a69", "tag": "net-1"}, {"uuid": "f6dce376-1a08-428a-8bf0-aa7cf17a7a69"}, {"uuid": "f213ffd6-16a4-404b-80d4-e008020201ac", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "f213ffd6-16a4-404b-80d4-e008020201ac", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "0914c9c7-c7ec-4509-8149-015f4d73dd20", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "aa8e576c-d6ef-43bc-bde0-1914820f85a1", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "9df52e98-8cdf-4ad5-b0c1-c486b68fb042", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1674955099"}], "key_name": "tempest-keypair-16403008", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:51.414591 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-e0d2b1fe-2931-4396-a660-df1564c1bb85 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8f9c6ea7f6496792258d683640c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a75218d537c4d63874297261bec70ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:51.423779 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e0d2b1fe-2931-4396-a660-df1564c1bb85 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] 10.222.0.46 "GET /compute/v2.1/servers/c8986b09-8342-4290-87be-22cece488c73" status: 200 len: 1515 microversion: 2.1 time: 0.211066 Jan 15 20:59:51.424629 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1686/3385] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:51 2022] GET /compute/v2.1/servers/c8986b09-8342-4290-87be-22cece488c73 => generated 1515 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:59:51.430527 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d007dda5-2ccd-4e01-9c74-32a3c43d8585 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:51.431684 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-d007dda5-2ccd-4e01-9c74-32a3c43d8585 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:51.438748 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d007dda5-2ccd-4e01-9c74-32a3c43d8585 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:51.440008 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d007dda5-2ccd-4e01-9c74-32a3c43d8585 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:51.440903 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.network.neutron [None req-5c2af6da-8197-4146-bbe4-f104c1162da7 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] validate_networks() for [('b740d751-068e-4a93-9225-aa5d63661275', None, None, None, None, None), (None, None, 'd36cd432-9054-48c0-a218-c6094ff964e7', None, None, None), (None, None, 'd8af72f0-b932-47f5-b578-70fdd429d39b', None, None, None), ('f6dce376-1a08-428a-8bf0-aa7cf17a7a69', None, None, None, None, None), ('f6dce376-1a08-428a-8bf0-aa7cf17a7a69', None, None, None, None, None), ('f213ffd6-16a4-404b-80d4-e008020201ac', '10.2.2.100', None, None, None, None), ('f213ffd6-16a4-404b-80d4-e008020201ac', '10.2.2.200', None, None, None, None)] {{(pid=129365) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 20:59:51.441167 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d007dda5-2ccd-4e01-9c74-32a3c43d8585 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:51.441728 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d007dda5-2ccd-4e01-9c74-32a3c43d8585 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:51.486705 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d007dda5-2ccd-4e01-9c74-32a3c43d8585 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 24586 microversion: 2.42 time: 0.060482 Jan 15 20:59:51.487765 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1687/3386] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 20:59:51 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 24586 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 20:59:51.496006 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f1da5252-6b5d-41bf-a082-d15ea88a3f92 tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:51.497393 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f1da5252-6b5d-41bf-a082-d15ea88a3f92 tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] [instance: 6d9fd532-17fd-4ec1-b3e2-d05605c20756] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:51.506936 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f1da5252-6b5d-41bf-a082-d15ea88a3f92 tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:51.507472 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f1da5252-6b5d-41bf-a082-d15ea88a3f92 tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:51.508449 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f1da5252-6b5d-41bf-a082-d15ea88a3f92 tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:51.508961 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f1da5252-6b5d-41bf-a082-d15ea88a3f92 tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:52.076317 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-f1da5252-6b5d-41bf-a082-d15ea88a3f92 tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b671d4d84454404a6f8ceba212fb2d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b3ba8ddd164cbbbc04a57bd2819003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:52.088055 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f1da5252-6b5d-41bf-a082-d15ea88a3f92 tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] 10.222.0.46 "GET /compute/v2.1/servers/6d9fd532-17fd-4ec1-b3e2-d05605c20756" status: 200 len: 1323 microversion: 2.1 time: 0.598655 Jan 15 20:59:52.089422 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1688/3387] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:51 2022] GET /compute/v2.1/servers/6d9fd532-17fd-4ec1-b3e2-d05605c20756 => generated 1323 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:59:52.095786 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4033a11d-b01c-41ef-9d79-90a128bfe9c1 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:52.097089 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-4033a11d-b01c-41ef-9d79-90a128bfe9c1 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:52.108007 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4033a11d-b01c-41ef-9d79-90a128bfe9c1 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:52.108916 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4033a11d-b01c-41ef-9d79-90a128bfe9c1 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:52.110434 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4033a11d-b01c-41ef-9d79-90a128bfe9c1 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:52.111145 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4033a11d-b01c-41ef-9d79-90a128bfe9c1 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:52.157954 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-4033a11d-b01c-41ef-9d79-90a128bfe9c1 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action" status: 200 len: 32641 microversion: 2.1 time: 0.066827 Jan 15 20:59:52.158633 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1689/3388] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:59:52 2022] POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action => generated 32641 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:59:52.165805 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-5a7668ee-402e-462e-9a7d-4f0ffbfce556 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:52.166489 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-5a7668ee-402e-462e-9a7d-4f0ffbfce556 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] [instance: 0d04bb3a-eacf-48ca-b7bf-e830a2c30b80] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:52.175090 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5a7668ee-402e-462e-9a7d-4f0ffbfce556 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:52.175761 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5a7668ee-402e-462e-9a7d-4f0ffbfce556 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:52.176568 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5a7668ee-402e-462e-9a7d-4f0ffbfce556 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:52.177027 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5a7668ee-402e-462e-9a7d-4f0ffbfce556 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:52.467789 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-5a7668ee-402e-462e-9a7d-4f0ffbfce556 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c07d13117a49b6b2042e182faaf9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca0988cda6548f89ee936bee64f56ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:52.482697 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-5a7668ee-402e-462e-9a7d-4f0ffbfce556 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] 10.222.0.46 "GET /compute/v2.1/servers/0d04bb3a-eacf-48ca-b7bf-e830a2c30b80" status: 200 len: 1320 microversion: 2.1 time: 0.322874 Jan 15 20:59:52.484153 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1690/3389] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:52 2022] GET /compute/v2.1/servers/0d04bb3a-eacf-48ca-b7bf-e830a2c30b80 => generated 1320 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:59:52.492818 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4e89e8bf-eaed-4ab2-a5c6-137a313c0819 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:52.496867 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-4e89e8bf-eaed-4ab2-a5c6-137a313c0819 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] [instance: 5e93486c-7c77-4855-85f4-2bc8bcf4832f] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:52.508617 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4e89e8bf-eaed-4ab2-a5c6-137a313c0819 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:52.509111 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4e89e8bf-eaed-4ab2-a5c6-137a313c0819 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:52.510134 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4e89e8bf-eaed-4ab2-a5c6-137a313c0819 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:52.510727 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4e89e8bf-eaed-4ab2-a5c6-137a313c0819 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:52.558918 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-4e89e8bf-eaed-4ab2-a5c6-137a313c0819 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] 10.222.0.46 "POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action" status: 200 len: 24573 microversion: 2.1 time: 0.072639 Jan 15 20:59:52.560629 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1691/3390] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:59:52 2022] POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action => generated 24573 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:59:52.566703 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c946a80b-8c9d-455a-b77e-c8a22006abd6 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:52.567539 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c946a80b-8c9d-455a-b77e-c8a22006abd6 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: c8986b09-8342-4290-87be-22cece488c73] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:52.576912 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c946a80b-8c9d-455a-b77e-c8a22006abd6 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:52.577398 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c946a80b-8c9d-455a-b77e-c8a22006abd6 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:52.578278 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c946a80b-8c9d-455a-b77e-c8a22006abd6 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:52.578629 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c946a80b-8c9d-455a-b77e-c8a22006abd6 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:52.829733 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-c946a80b-8c9d-455a-b77e-c8a22006abd6 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8f9c6ea7f6496792258d683640c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a75218d537c4d63874297261bec70ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:52.863855 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c946a80b-8c9d-455a-b77e-c8a22006abd6 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] 10.222.0.46 "GET /compute/v2.1/servers/c8986b09-8342-4290-87be-22cece488c73" status: 200 len: 1515 microversion: 2.1 time: 0.279365 Jan 15 20:59:52.872995 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1692/3391] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:52 2022] GET /compute/v2.1/servers/c8986b09-8342-4290-87be-22cece488c73 => generated 1515 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:59:52.887311 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-21424fcd-d97d-4c60-a984-a4f112141215 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:52.888397 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-21424fcd-d97d-4c60-a984-a4f112141215 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:52.901881 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-21424fcd-d97d-4c60-a984-a4f112141215 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:52.902314 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-21424fcd-d97d-4c60-a984-a4f112141215 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:52.903112 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-21424fcd-d97d-4c60-a984-a4f112141215 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:52.903546 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-21424fcd-d97d-4c60-a984-a4f112141215 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:52.965725 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-21424fcd-d97d-4c60-a984-a4f112141215 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 24586 microversion: 2.42 time: 0.084480 Jan 15 20:59:52.970153 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1693/3392] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 20:59:52 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 24586 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 20:59:52.972120 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-65a63d38-3d02-40cf-8dbe-f3c372c413a2 req-dedfe44a-fd3f-4a28-8cdd-1aef2143e773 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58ee3eff-55c4-48eb-a5f6-2731d35270a0", "name": "network-vif-plugged", "status": "completed", "tag": "cac6dd7d-cf94-4715-be2c-1beb35c8ff69"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:52.973676 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:59:52.973676 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 20:59:52.983274 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-65a63d38-3d02-40cf-8dbe-f3c372c413a2 req-dedfe44a-fd3f-4a28-8cdd-1aef2143e773 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:52.983727 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-65a63d38-3d02-40cf-8dbe-f3c372c413a2 req-dedfe44a-fd3f-4a28-8cdd-1aef2143e773 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:52.998393 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-65a63d38-3d02-40cf-8dbe-f3c372c413a2 req-dedfe44a-fd3f-4a28-8cdd-1aef2143e773 service nova] Creating event network-vif-plugged:cac6dd7d-cf94-4715-be2c-1beb35c8ff69 for instance 58ee3eff-55c4-48eb-a5f6-2731d35270a0 on nch1-master-1 Jan 15 20:59:53.003798 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-65a63d38-3d02-40cf-8dbe-f3c372c413a2 req-dedfe44a-fd3f-4a28-8cdd-1aef2143e773 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035591 Jan 15 20:59:53.005112 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1694/3393] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:59:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:59:53.106751 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-abcb840b-f2b2-4329-b0f0-a81aef00dfab tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:53.107442 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-abcb840b-f2b2-4329-b0f0-a81aef00dfab tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] [instance: 6d9fd532-17fd-4ec1-b3e2-d05605c20756] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:53.121204 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-abcb840b-f2b2-4329-b0f0-a81aef00dfab tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:53.122846 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-abcb840b-f2b2-4329-b0f0-a81aef00dfab tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:53.124194 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-abcb840b-f2b2-4329-b0f0-a81aef00dfab tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:53.126001 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-abcb840b-f2b2-4329-b0f0-a81aef00dfab tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:53.451477 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-abcb840b-f2b2-4329-b0f0-a81aef00dfab tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b671d4d84454404a6f8ceba212fb2d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b3ba8ddd164cbbbc04a57bd2819003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:53.462090 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-abcb840b-f2b2-4329-b0f0-a81aef00dfab tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] 10.222.0.46 "GET /compute/v2.1/servers/6d9fd532-17fd-4ec1-b3e2-d05605c20756" status: 200 len: 1518 microversion: 2.1 time: 0.359739 Jan 15 20:59:53.473709 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1695/3394] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:53 2022] GET /compute/v2.1/servers/6d9fd532-17fd-4ec1-b3e2-d05605c20756 => generated 1518 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:59:53.505629 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-46944310-efef-442e-a36d-a7e12a5d7ba0 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:53.514456 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-46944310-efef-442e-a36d-a7e12a5d7ba0 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:53.524168 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-46944310-efef-442e-a36d-a7e12a5d7ba0 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:53.525539 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-46944310-efef-442e-a36d-a7e12a5d7ba0 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:53.526961 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-46944310-efef-442e-a36d-a7e12a5d7ba0 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:53.528718 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-46944310-efef-442e-a36d-a7e12a5d7ba0 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:53.573852 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-46944310-efef-442e-a36d-a7e12a5d7ba0 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action" status: 200 len: 32641 microversion: 2.1 time: 0.088814 Jan 15 20:59:53.574901 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1696/3395] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:59:53 2022] POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action => generated 32641 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:59:53.582057 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-da30b9ff-6530-44aa-84d9-57e95064dfd2 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:53.583993 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-da30b9ff-6530-44aa-84d9-57e95064dfd2 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] [instance: 0d04bb3a-eacf-48ca-b7bf-e830a2c30b80] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:53.597495 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-da30b9ff-6530-44aa-84d9-57e95064dfd2 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:53.599006 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-da30b9ff-6530-44aa-84d9-57e95064dfd2 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:53.602671 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-da30b9ff-6530-44aa-84d9-57e95064dfd2 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:53.603833 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-da30b9ff-6530-44aa-84d9-57e95064dfd2 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:53.893584 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-da30b9ff-6530-44aa-84d9-57e95064dfd2 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c07d13117a49b6b2042e182faaf9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca0988cda6548f89ee936bee64f56ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:53.907612 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-da30b9ff-6530-44aa-84d9-57e95064dfd2 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] 10.222.0.46 "GET /compute/v2.1/servers/0d04bb3a-eacf-48ca-b7bf-e830a2c30b80" status: 200 len: 1320 microversion: 2.1 time: 0.331249 Jan 15 20:59:53.918268 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1697/3396] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:53 2022] GET /compute/v2.1/servers/0d04bb3a-eacf-48ca-b7bf-e830a2c30b80 => generated 1320 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:59:53.923263 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d18107c7-3298-41c1-a7f5-f44b2238fbd4 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:53.924726 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-d18107c7-3298-41c1-a7f5-f44b2238fbd4 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] [instance: 5e93486c-7c77-4855-85f4-2bc8bcf4832f] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:53.933184 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d18107c7-3298-41c1-a7f5-f44b2238fbd4 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:53.933780 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d18107c7-3298-41c1-a7f5-f44b2238fbd4 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:53.935078 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d18107c7-3298-41c1-a7f5-f44b2238fbd4 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:53.935942 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d18107c7-3298-41c1-a7f5-f44b2238fbd4 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:53.997978 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d18107c7-3298-41c1-a7f5-f44b2238fbd4 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] 10.222.0.46 "POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action" status: 200 len: 24573 microversion: 2.1 time: 0.087763 Jan 15 20:59:54.001227 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1698/3397] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:59:53 2022] POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action => generated 24573 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:59:54.010215 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a53df717-f4bf-41b9-9061-14bd99f4542e tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1425141769", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "06debdb1-4712-4eed-bcd6-395d1a8ea49c"}]}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:54.011975 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a53df717-f4bf-41b9-9061-14bd99f4542e tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:59:54.013151 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a53df717-f4bf-41b9-9061-14bd99f4542e tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.010560 Jan 15 20:59:54.020732 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1699/3398] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 20:59:54 2022] POST /compute/v2.1/servers => generated 175 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 15 20:59:54.027664 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-96fedfce-7777-4d90-9321-cbf02423d2a8 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:54.029928 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-96fedfce-7777-4d90-9321-cbf02423d2a8 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: c8986b09-8342-4290-87be-22cece488c73] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:54.042092 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-96fedfce-7777-4d90-9321-cbf02423d2a8 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:54.042947 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-96fedfce-7777-4d90-9321-cbf02423d2a8 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:54.043937 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-96fedfce-7777-4d90-9321-cbf02423d2a8 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:54.044722 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-96fedfce-7777-4d90-9321-cbf02423d2a8 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:54.365491 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-96fedfce-7777-4d90-9321-cbf02423d2a8 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8f9c6ea7f6496792258d683640c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a75218d537c4d63874297261bec70ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:54.381239 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-96fedfce-7777-4d90-9321-cbf02423d2a8 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] 10.222.0.46 "GET /compute/v2.1/servers/c8986b09-8342-4290-87be-22cece488c73" status: 200 len: 1515 microversion: 2.1 time: 0.359880 Jan 15 20:59:54.382290 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1700/3399] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:54 2022] GET /compute/v2.1/servers/c8986b09-8342-4290-87be-22cece488c73 => generated 1515 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:59:54.389659 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ff6e3508-6b1e-483c-b0ee-d7316ec990b9 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:54.404126 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ff6e3508-6b1e-483c-b0ee-d7316ec990b9 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:54.421933 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ff6e3508-6b1e-483c-b0ee-d7316ec990b9 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:54.422429 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ff6e3508-6b1e-483c-b0ee-d7316ec990b9 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:54.423480 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ff6e3508-6b1e-483c-b0ee-d7316ec990b9 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:54.423937 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ff6e3508-6b1e-483c-b0ee-d7316ec990b9 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:54.493342 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ff6e3508-6b1e-483c-b0ee-d7316ec990b9 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 24586 microversion: 2.42 time: 0.108754 Jan 15 20:59:54.495249 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1701/3400] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 20:59:54 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 24586 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 20:59:54.501064 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-2efd981d-0bc7-4d04-ad59-21955e56e427 tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:54.502009 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-2efd981d-0bc7-4d04-ad59-21955e56e427 tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] [instance: 4d908130-9602-4a2c-b4c1-6be332af3cc1] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:54.510165 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-2efd981d-0bc7-4d04-ad59-21955e56e427 tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] HTTP exception thrown: Instance 4d908130-9602-4a2c-b4c1-6be332af3cc1 could not be found. Jan 15 20:59:54.511205 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-2efd981d-0bc7-4d04-ad59-21955e56e427 tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] Returning 404 to user: Instance 4d908130-9602-4a2c-b4c1-6be332af3cc1 could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:59:54.512274 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-2efd981d-0bc7-4d04-ad59-21955e56e427 tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] 10.222.0.46 "GET /compute/v2.1/servers/4d908130-9602-4a2c-b4c1-6be332af3cc1/metadata" status: 404 len: 111 microversion: 2.1 time: 0.015477 Jan 15 20:59:54.513480 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1702/3401] 10.222.0.46 () {58 vars in 1262 bytes} [Sat Jan 15 20:59:54 2022] GET /compute/v2.1/servers/4d908130-9602-4a2c-b4c1-6be332af3cc1/metadata => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:59:54.589169 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-36080cd2-e815-492f-8fca-2072d19200b6 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:54.589169 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-36080cd2-e815-492f-8fca-2072d19200b6 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:54.603960 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-36080cd2-e815-492f-8fca-2072d19200b6 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:54.604407 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-36080cd2-e815-492f-8fca-2072d19200b6 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:54.605252 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-36080cd2-e815-492f-8fca-2072d19200b6 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:54.605687 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-36080cd2-e815-492f-8fca-2072d19200b6 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:54.656668 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-36080cd2-e815-492f-8fca-2072d19200b6 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action" status: 200 len: 32641 microversion: 2.1 time: 0.073353 Jan 15 20:59:54.658212 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1703/3402] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:59:54 2022] POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action => generated 32641 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 20:59:54.668553 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-46530135-a831-484c-a651-ef2736fac8db tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1083248670", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "06debdb1-4712-4eed-bcd6-395d1a8ea49c"}]}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:54.671216 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-46530135-a831-484c-a651-ef2736fac8db tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:59:54.672285 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-46530135-a831-484c-a651-ef2736fac8db tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.012510 Jan 15 20:59:54.673335 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1704/3403] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 20:59:54 2022] POST /compute/v2.1/servers => generated 687 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 15 20:59:54.718960 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-5c2af6da-8197-4146-bbe4-f104c1162da7 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Flavor limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 20:59:54.719549 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-5c2af6da-8197-4146-bbe4-f104c1162da7 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Image limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 20:59:54.719982 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-5c2af6da-8197-4146-bbe4-f104c1162da7 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Flavor pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 20:59:54.720530 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-5c2af6da-8197-4146-bbe4-f104c1162da7 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Image pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 20:59:54.721163 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-5c2af6da-8197-4146-bbe4-f104c1162da7 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 20:59:54.737305 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7b25b419-4e0a-44b5-8970-c999d51c2859 tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1770708494", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "06debdb1-4712-4eed-bcd6-395d1a8ea49c"}]}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:54.738971 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7b25b419-4e0a-44b5-8970-c999d51c2859 tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:59:54.740472 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7b25b419-4e0a-44b5-8970-c999d51c2859 tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.007035 Jan 15 20:59:54.741234 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5c2af6da-8197-4146-bbe4-f104c1162da7 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:54.741830 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5c2af6da-8197-4146-bbe4-f104c1162da7 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:54.741950 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1705/3404] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 20:59:54 2022] POST /compute/v2.1/servers => generated 689 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 15 20:59:54.742975 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5c2af6da-8197-4146-bbe4-f104c1162da7 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:54.743512 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5c2af6da-8197-4146-bbe4-f104c1162da7 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:54.765763 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-5c2af6da-8197-4146-bbe4-f104c1162da7 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Getting quotas for project 2b36b007e8a9409783a549b87017c8ee. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:59:54.774153 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-5c2af6da-8197-4146-bbe4-f104c1162da7 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Getting quotas for user f11dc7a8a21449b1b7de146145d51ec9 and project 2b36b007e8a9409783a549b87017c8ee. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 20:59:54.805206 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ef561596-de4d-4700-8eb2-f1a6e420b1a3 tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1733584322", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "06debdb1-4712-4eed-bcd6-395d1a8ea49c"}]}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:54.807018 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ef561596-de4d-4700-8eb2-f1a6e420b1a3 tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:59:54.808187 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ef561596-de4d-4700-8eb2-f1a6e420b1a3 tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.009162 Jan 15 20:59:54.808983 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1706/3405] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 20:59:54 2022] POST /compute/v2.1/servers => generated 1197 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 382 bytes (2 switches on core 0) Jan 15 20:59:54.868510 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0836f455-d382-4f3d-9eeb-f41ba954b4ec tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1260549916", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "06debdb1-4712-4eed-bcd6-395d1a8ea49c"}]}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:54.870488 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0836f455-d382-4f3d-9eeb-f41ba954b4ec tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:59:54.871330 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0836f455-d382-4f3d-9eeb-f41ba954b4ec tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.009064 Jan 15 20:59:54.877315 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1707/3406] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Jan 15 20:59:54 2022] POST /compute/v2.1/servers => generated 2221 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Jan 15 20:59:54.890551 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7c978098-97fe-453b-98a5-d2955a8965c7 tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:54.892097 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-7c978098-97fe-453b-98a5-d2955a8965c7 tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] [instance: faa15c20-c261-429c-926d-822e5ab05c20] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:54.902803 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-7c978098-97fe-453b-98a5-d2955a8965c7 tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] HTTP exception thrown: Instance faa15c20-c261-429c-926d-822e5ab05c20 could not be found. Jan 15 20:59:54.903661 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7c978098-97fe-453b-98a5-d2955a8965c7 tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] Returning 404 to user: Instance faa15c20-c261-429c-926d-822e5ab05c20 could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 20:59:54.904564 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7c978098-97fe-453b-98a5-d2955a8965c7 tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] 10.222.0.46 "GET /compute/v2.1/servers/faa15c20-c261-429c-926d-822e5ab05c20/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.024760 Jan 15 20:59:54.905707 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1708/3407] 10.222.0.46 () {58 vars in 1280 bytes} [Sat Jan 15 20:59:54 2022] GET /compute/v2.1/servers/faa15c20-c261-429c-926d-822e5ab05c20/metadata/test2 => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 20:59:54.950413 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-973cc775-33dd-44aa-a6e4-bc20ba655fac tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:54.950944 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-973cc775-33dd-44aa-a6e4-bc20ba655fac tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] [instance: 6d9fd532-17fd-4ec1-b3e2-d05605c20756] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:54.959456 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-973cc775-33dd-44aa-a6e4-bc20ba655fac tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:54.959937 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-973cc775-33dd-44aa-a6e4-bc20ba655fac tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:54.965290 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-973cc775-33dd-44aa-a6e4-bc20ba655fac tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:54.966198 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-973cc775-33dd-44aa-a6e4-bc20ba655fac tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:54.996669 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-973cc775-33dd-44aa-a6e4-bc20ba655fac tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] [instance: 6d9fd532-17fd-4ec1-b3e2-d05605c20756] Going to try to terminate instance {{(pid=129366) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 20:59:55.008911 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-5c2af6da-8197-4146-bbe4-f104c1162da7 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Going to run 1 instances... {{(pid=129365) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 20:59:55.012948 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-5c2af6da-8197-4146-bbe4-f104c1162da7 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='0914c9c7-c7ec-4509-8149-015f4d73dd20',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='aa8e576c-d6ef-43bc-bde0-1914820f85a1',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9df52e98-8cdf-4ad5-b0c1-c486b68fb042',volume_size=None,volume_type=None)] {{(pid=129365) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 20:59:55.142430 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-973cc775-33dd-44aa-a6e4-bc20ba655fac tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] 10.222.0.46 "DELETE /compute/v2.1/servers/6d9fd532-17fd-4ec1-b3e2-d05605c20756" status: 204 len: 0 microversion: 2.1 time: 0.221137 Jan 15 20:59:55.143255 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1709/3408] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 20:59:54 2022] DELETE /compute/v2.1/servers/6d9fd532-17fd-4ec1-b3e2-d05605c20756 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 20:59:55.150320 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ebc61010-c9d1-4bfb-b4c0-5708692d47ca tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:55.151501 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ebc61010-c9d1-4bfb-b4c0-5708692d47ca tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] [instance: 0d04bb3a-eacf-48ca-b7bf-e830a2c30b80] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:55.161063 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ebc61010-c9d1-4bfb-b4c0-5708692d47ca tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:55.161607 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ebc61010-c9d1-4bfb-b4c0-5708692d47ca tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:55.162899 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ebc61010-c9d1-4bfb-b4c0-5708692d47ca tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:55.163550 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ebc61010-c9d1-4bfb-b4c0-5708692d47ca tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:55.546869 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5c2af6da-8197-4146-bbe4-f104c1162da7 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.32 time: 4.285880 Jan 15 20:59:55.554850 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1700/3409] 10.222.0.46 () {62 vars in 1188 bytes} [Sat Jan 15 20:59:51 2022] POST /compute/v2.1/servers => generated 406 bytes in 4295 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jan 15 20:59:55.561981 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-99c957dc-76e6-405b-b254-6c7d4eb1b790 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:55.563396 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-99c957dc-76e6-405b-b254-6c7d4eb1b790 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] [instance: 5e93486c-7c77-4855-85f4-2bc8bcf4832f] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:55.577922 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-99c957dc-76e6-405b-b254-6c7d4eb1b790 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:55.578778 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-99c957dc-76e6-405b-b254-6c7d4eb1b790 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:55.579604 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-99c957dc-76e6-405b-b254-6c7d4eb1b790 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:55.580042 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-99c957dc-76e6-405b-b254-6c7d4eb1b790 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:55.638894 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-99c957dc-76e6-405b-b254-6c7d4eb1b790 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] 10.222.0.46 "POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action" status: 200 len: 24573 microversion: 2.1 time: 0.081681 Jan 15 20:59:55.643198 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1701/3410] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:59:55 2022] POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action => generated 24573 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:59:55.649737 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-631eb494-259e-4df4-a665-6a76e65b24ac req-3ffe30cb-bd64-42fd-94a7-c0ea921dd8a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d04bb3a-eacf-48ca-b7bf-e830a2c30b80", "name": "network-vif-plugged", "status": "completed", "tag": "e1f58043-97ce-4c2d-86fb-63acb89366e7"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:55.651568 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:59:55.651568 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:59:55.669048 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-631eb494-259e-4df4-a665-6a76e65b24ac req-3ffe30cb-bd64-42fd-94a7-c0ea921dd8a5 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:55.669843 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-631eb494-259e-4df4-a665-6a76e65b24ac req-3ffe30cb-bd64-42fd-94a7-c0ea921dd8a5 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:55.700896 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-631eb494-259e-4df4-a665-6a76e65b24ac req-3ffe30cb-bd64-42fd-94a7-c0ea921dd8a5 service nova] Creating event network-vif-plugged:e1f58043-97ce-4c2d-86fb-63acb89366e7 for instance 0d04bb3a-eacf-48ca-b7bf-e830a2c30b80 on nch2-master-1 Jan 15 20:59:55.707136 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-631eb494-259e-4df4-a665-6a76e65b24ac req-3ffe30cb-bd64-42fd-94a7-c0ea921dd8a5 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062463 Jan 15 20:59:55.707807 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1702/3411] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:59:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:59:55.724494 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2322b7ab-da35-4c36-b384-359a2a514be6 tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:55.725537 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-2322b7ab-da35-4c36-b384-359a2a514be6 tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] [instance: 6d9fd532-17fd-4ec1-b3e2-d05605c20756] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:55.734712 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2322b7ab-da35-4c36-b384-359a2a514be6 tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:55.735456 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2322b7ab-da35-4c36-b384-359a2a514be6 tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:55.736588 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2322b7ab-da35-4c36-b384-359a2a514be6 tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:55.737191 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2322b7ab-da35-4c36-b384-359a2a514be6 tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:55.757823 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-ebc61010-c9d1-4bfb-b4c0-5708692d47ca tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c07d13117a49b6b2042e182faaf9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca0988cda6548f89ee936bee64f56ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:55.770624 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ebc61010-c9d1-4bfb-b4c0-5708692d47ca tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] 10.222.0.46 "GET /compute/v2.1/servers/0d04bb3a-eacf-48ca-b7bf-e830a2c30b80" status: 200 len: 1320 microversion: 2.1 time: 0.624933 Jan 15 20:59:55.772487 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1710/3412] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:55 2022] GET /compute/v2.1/servers/0d04bb3a-eacf-48ca-b7bf-e830a2c30b80 => generated 1320 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:59:55.777964 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8da74cfe-1b8e-4dd8-8fa4-9be2bc05c555 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:55.778825 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-8da74cfe-1b8e-4dd8-8fa4-9be2bc05c555 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: c8986b09-8342-4290-87be-22cece488c73] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:55.786481 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8da74cfe-1b8e-4dd8-8fa4-9be2bc05c555 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:55.787262 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8da74cfe-1b8e-4dd8-8fa4-9be2bc05c555 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:55.788852 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8da74cfe-1b8e-4dd8-8fa4-9be2bc05c555 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:55.789481 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8da74cfe-1b8e-4dd8-8fa4-9be2bc05c555 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:56.175819 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-8da74cfe-1b8e-4dd8-8fa4-9be2bc05c555 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8f9c6ea7f6496792258d683640c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a75218d537c4d63874297261bec70ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:56.191431 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-8da74cfe-1b8e-4dd8-8fa4-9be2bc05c555 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] 10.222.0.46 "GET /compute/v2.1/servers/c8986b09-8342-4290-87be-22cece488c73" status: 200 len: 1515 microversion: 2.1 time: 0.415984 Jan 15 20:59:56.192292 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1711/3413] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:55 2022] GET /compute/v2.1/servers/c8986b09-8342-4290-87be-22cece488c73 => generated 1515 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:59:56.203560 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-fe752bb8-4f06-4d4b-80e6-d72f5ff24835 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:56.208023 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-fe752bb8-4f06-4d4b-80e6-d72f5ff24835 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:56.220832 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fe752bb8-4f06-4d4b-80e6-d72f5ff24835 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:56.234042 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fe752bb8-4f06-4d4b-80e6-d72f5ff24835 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:56.235361 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fe752bb8-4f06-4d4b-80e6-d72f5ff24835 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:56.235832 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fe752bb8-4f06-4d4b-80e6-d72f5ff24835 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:56.273298 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-2322b7ab-da35-4c36-b384-359a2a514be6 tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b671d4d84454404a6f8ceba212fb2d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b3ba8ddd164cbbbc04a57bd2819003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:56.289543 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2322b7ab-da35-4c36-b384-359a2a514be6 tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] 10.222.0.46 "GET /compute/v2.1/servers/6d9fd532-17fd-4ec1-b3e2-d05605c20756" status: 200 len: 1524 microversion: 2.1 time: 0.579375 Jan 15 20:59:56.290744 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1703/3414] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:55 2022] GET /compute/v2.1/servers/6d9fd532-17fd-4ec1-b3e2-d05605c20756 => generated 1524 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:59:56.305348 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-34dd7090-380e-4855-8706-090fd33ae425 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:56.306471 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-34dd7090-380e-4855-8706-090fd33ae425 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:56.392369 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-fe752bb8-4f06-4d4b-80e6-d72f5ff24835 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 24586 microversion: 2.42 time: 0.193563 Jan 15 20:59:56.393676 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1712/3415] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 20:59:56 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 24586 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 20:59:56.401405 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1eee7eb6-af75-4767-8cbe-70a3cf003a44 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:56.403034 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-1eee7eb6-af75-4767-8cbe-70a3cf003a44 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:56.412917 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1eee7eb6-af75-4767-8cbe-70a3cf003a44 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:56.418017 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-34dd7090-380e-4855-8706-090fd33ae425 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:56.429800 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-34dd7090-380e-4855-8706-090fd33ae425 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:56.430024 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1eee7eb6-af75-4767-8cbe-70a3cf003a44 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:56.432614 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1eee7eb6-af75-4767-8cbe-70a3cf003a44 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:56.433523 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1eee7eb6-af75-4767-8cbe-70a3cf003a44 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:56.433864 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-34dd7090-380e-4855-8706-090fd33ae425 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:56.435054 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-34dd7090-380e-4855-8706-090fd33ae425 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "GET /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220" status: 200 len: 1284 microversion: 2.32 time: 0.143116 Jan 15 20:59:56.435632 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1704/3416] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:59:56 2022] GET /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220 => generated 1284 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:59:56.539492 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-1eee7eb6-af75-4767-8cbe-70a3cf003a44 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action" status: 200 len: 32641 microversion: 2.1 time: 0.140178 Jan 15 20:59:56.542591 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1713/3417] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:59:56 2022] POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action => generated 32641 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:59:56.654004 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-72ac5863-8e71-47b5-b1c3-1398d83832ce tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:56.656163 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-72ac5863-8e71-47b5-b1c3-1398d83832ce tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] [instance: 5e93486c-7c77-4855-85f4-2bc8bcf4832f] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:56.664672 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-72ac5863-8e71-47b5-b1c3-1398d83832ce tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:56.665435 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-72ac5863-8e71-47b5-b1c3-1398d83832ce tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:56.666368 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-72ac5863-8e71-47b5-b1c3-1398d83832ce tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:56.666810 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-72ac5863-8e71-47b5-b1c3-1398d83832ce tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:56.726569 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-72ac5863-8e71-47b5-b1c3-1398d83832ce tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] 10.222.0.46 "POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action" status: 200 len: 32650 microversion: 2.1 time: 0.078763 Jan 15 20:59:56.728367 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1705/3418] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:59:56 2022] POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action => generated 32650 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:59:56.790070 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-dadf1f61-8018-4420-9311-2649f1041482 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:56.790884 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-dadf1f61-8018-4420-9311-2649f1041482 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] [instance: 0d04bb3a-eacf-48ca-b7bf-e830a2c30b80] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:56.799264 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dadf1f61-8018-4420-9311-2649f1041482 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:56.800141 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dadf1f61-8018-4420-9311-2649f1041482 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:56.800970 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dadf1f61-8018-4420-9311-2649f1041482 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:56.801575 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dadf1f61-8018-4420-9311-2649f1041482 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:57.033210 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-dadf1f61-8018-4420-9311-2649f1041482 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c07d13117a49b6b2042e182faaf9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca0988cda6548f89ee936bee64f56ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:57.045361 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-dadf1f61-8018-4420-9311-2649f1041482 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] 10.222.0.46 "GET /compute/v2.1/servers/0d04bb3a-eacf-48ca-b7bf-e830a2c30b80" status: 200 len: 1320 microversion: 2.1 time: 0.259599 Jan 15 20:59:57.055390 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1714/3419] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:56 2022] GET /compute/v2.1/servers/0d04bb3a-eacf-48ca-b7bf-e830a2c30b80 => generated 1320 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:59:57.210555 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-08719b39-b907-4fdf-915e-11cca0ea5c53 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:57.211263 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-08719b39-b907-4fdf-915e-11cca0ea5c53 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: c8986b09-8342-4290-87be-22cece488c73] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:57.227998 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-08719b39-b907-4fdf-915e-11cca0ea5c53 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:57.228446 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-08719b39-b907-4fdf-915e-11cca0ea5c53 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:57.229341 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-08719b39-b907-4fdf-915e-11cca0ea5c53 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:57.229777 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-08719b39-b907-4fdf-915e-11cca0ea5c53 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:57.309414 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7924154e-ded8-4a19-a714-bd41a0ead5b4 tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:57.310106 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-7924154e-ded8-4a19-a714-bd41a0ead5b4 tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] [instance: 6d9fd532-17fd-4ec1-b3e2-d05605c20756] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:57.319648 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7924154e-ded8-4a19-a714-bd41a0ead5b4 tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:57.319870 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7924154e-ded8-4a19-a714-bd41a0ead5b4 tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:57.320653 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7924154e-ded8-4a19-a714-bd41a0ead5b4 tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:57.322343 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7924154e-ded8-4a19-a714-bd41a0ead5b4 tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:57.704442 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-08719b39-b907-4fdf-915e-11cca0ea5c53 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8f9c6ea7f6496792258d683640c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a75218d537c4d63874297261bec70ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:57.710375 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-7924154e-ded8-4a19-a714-bd41a0ead5b4 tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b671d4d84454404a6f8ceba212fb2d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b3ba8ddd164cbbbc04a57bd2819003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:57.713350 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-08719b39-b907-4fdf-915e-11cca0ea5c53 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] 10.222.0.46 "GET /compute/v2.1/servers/c8986b09-8342-4290-87be-22cece488c73" status: 200 len: 1515 microversion: 2.1 time: 0.508039 Jan 15 20:59:57.713937 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1706/3420] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:57 2022] GET /compute/v2.1/servers/c8986b09-8342-4290-87be-22cece488c73 => generated 1515 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:59:57.723079 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7924154e-ded8-4a19-a714-bd41a0ead5b4 tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] 10.222.0.46 "GET /compute/v2.1/servers/6d9fd532-17fd-4ec1-b3e2-d05605c20756" status: 200 len: 1524 microversion: 2.1 time: 0.417575 Jan 15 20:59:57.724484 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1715/3421] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:57 2022] GET /compute/v2.1/servers/6d9fd532-17fd-4ec1-b3e2-d05605c20756 => generated 1524 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:59:57.727868 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5babc9f4-6c24-44ca-aca4-39f9faf16561 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:57.730958 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-5babc9f4-6c24-44ca-aca4-39f9faf16561 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:57.738244 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-77e6694f-ce64-4d6d-8af8-c397c5f1a3f4 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:57.739361 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-77e6694f-ce64-4d6d-8af8-c397c5f1a3f4 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:57.743591 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5babc9f4-6c24-44ca-aca4-39f9faf16561 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:57.744121 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5babc9f4-6c24-44ca-aca4-39f9faf16561 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:57.745072 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5babc9f4-6c24-44ca-aca4-39f9faf16561 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:57.745580 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5babc9f4-6c24-44ca-aca4-39f9faf16561 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:57.748067 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-77e6694f-ce64-4d6d-8af8-c397c5f1a3f4 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:57.748765 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-77e6694f-ce64-4d6d-8af8-c397c5f1a3f4 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:57.750217 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-77e6694f-ce64-4d6d-8af8-c397c5f1a3f4 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:57.754721 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-77e6694f-ce64-4d6d-8af8-c397c5f1a3f4 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:57.799443 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5babc9f4-6c24-44ca-aca4-39f9faf16561 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 24586 microversion: 2.42 time: 0.076694 Jan 15 20:59:57.807146 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1707/3422] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 20:59:57 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 24586 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 20:59:57.814831 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-16a843fe-0a83-49a6-9e14-1e2fe059feaa tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:57.816455 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-16a843fe-0a83-49a6-9e14-1e2fe059feaa tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:57.825786 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-16a843fe-0a83-49a6-9e14-1e2fe059feaa tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:57.826523 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-16a843fe-0a83-49a6-9e14-1e2fe059feaa tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:57.827529 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-16a843fe-0a83-49a6-9e14-1e2fe059feaa tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:57.828149 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-16a843fe-0a83-49a6-9e14-1e2fe059feaa tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:57.839445 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-77e6694f-ce64-4d6d-8af8-c397c5f1a3f4 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:57.851071 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-77e6694f-ce64-4d6d-8af8-c397c5f1a3f4 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:57.852999 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-77e6694f-ce64-4d6d-8af8-c397c5f1a3f4 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:57.854349 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-77e6694f-ce64-4d6d-8af8-c397c5f1a3f4 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "GET /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220" status: 200 len: 1592 microversion: 2.32 time: 0.128624 Jan 15 20:59:57.855402 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1716/3423] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:59:57 2022] GET /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220 => generated 1592 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:59:57.860785 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-06b9ec77-038a-4423-a1d6-e30cc491388e tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:57.861979 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-06b9ec77-038a-4423-a1d6-e30cc491388e tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] [instance: 5e93486c-7c77-4855-85f4-2bc8bcf4832f] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:57.870173 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-06b9ec77-038a-4423-a1d6-e30cc491388e tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:57.871143 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-06b9ec77-038a-4423-a1d6-e30cc491388e tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:57.872104 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-06b9ec77-038a-4423-a1d6-e30cc491388e tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:57.872751 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-06b9ec77-038a-4423-a1d6-e30cc491388e tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:57.894434 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-16a843fe-0a83-49a6-9e14-1e2fe059feaa tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action" status: 200 len: 32641 microversion: 2.1 time: 0.087583 Jan 15 20:59:57.895100 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1708/3424] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:59:57 2022] POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action => generated 32641 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:59:57.934637 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-06b9ec77-038a-4423-a1d6-e30cc491388e tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] 10.222.0.46 "POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action" status: 200 len: 32650 microversion: 2.1 time: 0.077633 Jan 15 20:59:57.935597 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1717/3425] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:59:57 2022] POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action => generated 32650 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:59:58.063397 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-beecdbc5-2c74-4583-a184-dd21492852f9 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:58.064430 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-beecdbc5-2c74-4583-a184-dd21492852f9 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] [instance: 0d04bb3a-eacf-48ca-b7bf-e830a2c30b80] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:58.073127 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-beecdbc5-2c74-4583-a184-dd21492852f9 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:58.073903 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-beecdbc5-2c74-4583-a184-dd21492852f9 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:58.074968 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-beecdbc5-2c74-4583-a184-dd21492852f9 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:58.075610 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-beecdbc5-2c74-4583-a184-dd21492852f9 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:58.255142 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-beecdbc5-2c74-4583-a184-dd21492852f9 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c07d13117a49b6b2042e182faaf9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca0988cda6548f89ee936bee64f56ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:58.267567 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-beecdbc5-2c74-4583-a184-dd21492852f9 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] 10.222.0.46 "GET /compute/v2.1/servers/0d04bb3a-eacf-48ca-b7bf-e830a2c30b80" status: 200 len: 1508 microversion: 2.1 time: 0.206787 Jan 15 20:59:58.268882 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1709/3426] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:58 2022] GET /compute/v2.1/servers/0d04bb3a-eacf-48ca-b7bf-e830a2c30b80 => generated 1508 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:59:58.290058 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-90da2ade-b466-4066-b073-b757b6b6926b tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:58.293515 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-90da2ade-b466-4066-b073-b757b6b6926b tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] [instance: 58ee3eff-55c4-48eb-a5f6-2731d35270a0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:58.303435 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-90da2ade-b466-4066-b073-b757b6b6926b tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:58.303953 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-90da2ade-b466-4066-b073-b757b6b6926b tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:58.304778 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-90da2ade-b466-4066-b073-b757b6b6926b tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:58.305257 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-90da2ade-b466-4066-b073-b757b6b6926b tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:58.415487 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-dfe12238-7752-4cff-90fc-8b0bd10da5bf req-33a86d95-a319-4934-967a-e676b1b9a59f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d9fd532-17fd-4ec1-b3e2-d05605c20756", "name": "network-vif-deleted", "tag": "6c32aa4e-6a73-415e-9647-886333a1d237"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:58.417807 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 20:59:58.417807 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 20:59:58.435503 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-dfe12238-7752-4cff-90fc-8b0bd10da5bf req-33a86d95-a319-4934-967a-e676b1b9a59f service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:58.436159 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-dfe12238-7752-4cff-90fc-8b0bd10da5bf req-33a86d95-a319-4934-967a-e676b1b9a59f service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:58.463642 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-dfe12238-7752-4cff-90fc-8b0bd10da5bf req-33a86d95-a319-4934-967a-e676b1b9a59f service nova] Creating event network-vif-deleted:6c32aa4e-6a73-415e-9647-886333a1d237 for instance 6d9fd532-17fd-4ec1-b3e2-d05605c20756 on nch2-master-1 Jan 15 20:59:58.469974 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-dfe12238-7752-4cff-90fc-8b0bd10da5bf req-33a86d95-a319-4934-967a-e676b1b9a59f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059920 Jan 15 20:59:58.471369 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1710/3427] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 20:59:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 20:59:58.572096 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-90da2ade-b466-4066-b073-b757b6b6926b tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c07d13117a49b6b2042e182faaf9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca0988cda6548f89ee936bee64f56ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:58.582791 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-90da2ade-b466-4066-b073-b757b6b6926b tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] 10.222.0.46 "GET /compute/v2.1/servers/58ee3eff-55c4-48eb-a5f6-2731d35270a0" status: 200 len: 1508 microversion: 2.1 time: 0.300736 Jan 15 20:59:58.584546 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1718/3428] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:58 2022] GET /compute/v2.1/servers/58ee3eff-55c4-48eb-a5f6-2731d35270a0 => generated 1508 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:59:58.605908 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-abe8039e-ec81-4fa6-b815-e5716115693d tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:58.607617 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-abe8039e-ec81-4fa6-b815-e5716115693d tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] [instance: 58ee3eff-55c4-48eb-a5f6-2731d35270a0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:58.625094 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-abe8039e-ec81-4fa6-b815-e5716115693d tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:58.625996 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-abe8039e-ec81-4fa6-b815-e5716115693d tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:58.627188 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-abe8039e-ec81-4fa6-b815-e5716115693d tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:58.627746 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-abe8039e-ec81-4fa6-b815-e5716115693d tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:58.668687 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-abe8039e-ec81-4fa6-b815-e5716115693d tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] [instance: 58ee3eff-55c4-48eb-a5f6-2731d35270a0] Going to try to terminate instance {{(pid=129365) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 20:59:58.740353 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f1a8970e-79bb-4b23-922b-28a2fb7d5c30 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:58.741941 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f1a8970e-79bb-4b23-922b-28a2fb7d5c30 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: c8986b09-8342-4290-87be-22cece488c73] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:58.749490 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f1a8970e-79bb-4b23-922b-28a2fb7d5c30 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:58.750226 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f1a8970e-79bb-4b23-922b-28a2fb7d5c30 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:58.751255 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f1a8970e-79bb-4b23-922b-28a2fb7d5c30 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:58.752002 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f1a8970e-79bb-4b23-922b-28a2fb7d5c30 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:58.805533 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-abe8039e-ec81-4fa6-b815-e5716115693d tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] 10.222.0.46 "DELETE /compute/v2.1/servers/58ee3eff-55c4-48eb-a5f6-2731d35270a0" status: 204 len: 0 microversion: 2.1 time: 0.206723 Jan 15 20:59:58.806917 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1711/3429] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 20:59:58 2022] DELETE /compute/v2.1/servers/58ee3eff-55c4-48eb-a5f6-2731d35270a0 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 20:59:58.812927 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-44ca77bd-45c5-4e89-8c7a-aa7613fb3ee0 tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:58.814315 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-44ca77bd-45c5-4e89-8c7a-aa7613fb3ee0 tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] [instance: 6d9fd532-17fd-4ec1-b3e2-d05605c20756] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:58.825436 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-44ca77bd-45c5-4e89-8c7a-aa7613fb3ee0 tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:58.826225 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-44ca77bd-45c5-4e89-8c7a-aa7613fb3ee0 tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:58.828443 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-44ca77bd-45c5-4e89-8c7a-aa7613fb3ee0 tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:58.830264 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-44ca77bd-45c5-4e89-8c7a-aa7613fb3ee0 tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:58.957790 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-44ca77bd-45c5-4e89-8c7a-aa7613fb3ee0 tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:58.959524 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-44ca77bd-45c5-4e89-8c7a-aa7613fb3ee0 tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:58.961960 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.objects.instance [None req-44ca77bd-45c5-4e89-8c7a-aa7613fb3ee0 tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] Lazy-loading 'fault' on Instance uuid 6d9fd532-17fd-4ec1-b3e2-d05605c20756 {{(pid=129365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 20:59:59.045536 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-44ca77bd-45c5-4e89-8c7a-aa7613fb3ee0 tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b671d4d84454404a6f8ceba212fb2d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b3ba8ddd164cbbbc04a57bd2819003', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:59.061039 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-44ca77bd-45c5-4e89-8c7a-aa7613fb3ee0 tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] 10.222.0.46 "GET /compute/v2.1/servers/6d9fd532-17fd-4ec1-b3e2-d05605c20756" status: 200 len: 1313 microversion: 2.1 time: 0.252638 Jan 15 20:59:59.074251 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1712/3430] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:58 2022] GET /compute/v2.1/servers/6d9fd532-17fd-4ec1-b3e2-d05605c20756 => generated 1313 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 20:59:59.087018 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8220364d-2de5-43b5-825a-0f70c03a3267 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:59.088008 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-8220364d-2de5-43b5-825a-0f70c03a3267 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:59.109014 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8220364d-2de5-43b5-825a-0f70c03a3267 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:59.109353 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8220364d-2de5-43b5-825a-0f70c03a3267 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:59.110319 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8220364d-2de5-43b5-825a-0f70c03a3267 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:59.111376 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8220364d-2de5-43b5-825a-0f70c03a3267 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:59.119885 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-f1a8970e-79bb-4b23-922b-28a2fb7d5c30 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8f9c6ea7f6496792258d683640c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a75218d537c4d63874297261bec70ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:59.154028 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f1a8970e-79bb-4b23-922b-28a2fb7d5c30 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] 10.222.0.46 "GET /compute/v2.1/servers/c8986b09-8342-4290-87be-22cece488c73" status: 200 len: 1515 microversion: 2.1 time: 0.419542 Jan 15 20:59:59.180021 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1719/3431] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 20:59:58 2022] GET /compute/v2.1/servers/c8986b09-8342-4290-87be-22cece488c73 => generated 1515 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 20:59:59.186722 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-8220364d-2de5-43b5-825a-0f70c03a3267 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 24586 microversion: 2.42 time: 0.110997 Jan 15 20:59:59.190272 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1713/3432] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 20:59:59 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 24586 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 20:59:59.193639 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d81d02df-0094-46fe-87fc-b4685840f898 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:59.193785 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-df7aaacd-0104-48e1-9dea-1d0765daed9b tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 20:59:59.194347 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d81d02df-0094-46fe-87fc-b4685840f898 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:59.195214 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-df7aaacd-0104-48e1-9dea-1d0765daed9b tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] [instance: 0d04bb3a-eacf-48ca-b7bf-e830a2c30b80] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:59.224648 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d81d02df-0094-46fe-87fc-b4685840f898 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:59.225169 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d81d02df-0094-46fe-87fc-b4685840f898 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:59.226107 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d81d02df-0094-46fe-87fc-b4685840f898 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:59.226554 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d81d02df-0094-46fe-87fc-b4685840f898 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:59.237381 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-df7aaacd-0104-48e1-9dea-1d0765daed9b tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:59.238414 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-df7aaacd-0104-48e1-9dea-1d0765daed9b tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:59.241542 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-df7aaacd-0104-48e1-9dea-1d0765daed9b tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:59.242172 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-df7aaacd-0104-48e1-9dea-1d0765daed9b tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:59.274175 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-df7aaacd-0104-48e1-9dea-1d0765daed9b tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] [instance: 0d04bb3a-eacf-48ca-b7bf-e830a2c30b80] Going to try to terminate instance {{(pid=129366) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 20:59:59.363892 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-d81d02df-0094-46fe-87fc-b4685840f898 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:59.381603 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-d81d02df-0094-46fe-87fc-b4685840f898 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:59.383360 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-d81d02df-0094-46fe-87fc-b4685840f898 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 20:59:59.384712 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d81d02df-0094-46fe-87fc-b4685840f898 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "GET /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220" status: 200 len: 1592 microversion: 2.32 time: 0.195488 Jan 15 20:59:59.395783 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1714/3433] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 20:59:59 2022] GET /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220 => generated 1592 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 20:59:59.395783 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-dc77b342-4a1f-4b00-af57-60c1c83409b9 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:59.395783 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-dc77b342-4a1f-4b00-af57-60c1c83409b9 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:59.409354 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dc77b342-4a1f-4b00-af57-60c1c83409b9 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:59.410310 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dc77b342-4a1f-4b00-af57-60c1c83409b9 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:59.412313 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dc77b342-4a1f-4b00-af57-60c1c83409b9 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:59.413654 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dc77b342-4a1f-4b00-af57-60c1c83409b9 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:59.483516 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-dc77b342-4a1f-4b00-af57-60c1c83409b9 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action" status: 200 len: 32641 microversion: 2.1 time: 0.096460 Jan 15 20:59:59.486845 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1715/3434] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:59:59 2022] POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action => generated 32641 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:59:59.503434 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-df7aaacd-0104-48e1-9dea-1d0765daed9b tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] 10.222.0.46 "DELETE /compute/v2.1/servers/0d04bb3a-eacf-48ca-b7bf-e830a2c30b80" status: 204 len: 0 microversion: 2.1 time: 0.320364 Jan 15 20:59:59.504939 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ebca83c2-06f4-4656-b599-e37d9b362cbb tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:59.505517 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1720/3435] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 20:59:59 2022] DELETE /compute/v2.1/servers/0d04bb3a-eacf-48ca-b7bf-e830a2c30b80 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 20:59:59.514280 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ebca83c2-06f4-4656-b599-e37d9b362cbb tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] [instance: 5e93486c-7c77-4855-85f4-2bc8bcf4832f] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 20:59:59.529410 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ebca83c2-06f4-4656-b599-e37d9b362cbb tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:59.535187 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ebca83c2-06f4-4656-b599-e37d9b362cbb tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:59.536336 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ebca83c2-06f4-4656-b599-e37d9b362cbb tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 20:59:59.538408 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ebca83c2-06f4-4656-b599-e37d9b362cbb tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 20:59:59.648589 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ebca83c2-06f4-4656-b599-e37d9b362cbb tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] 10.222.0.46 "POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action" status: 200 len: 32650 microversion: 2.1 time: 0.151263 Jan 15 20:59:59.649360 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1716/3436] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 20:59:59 2022] POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action => generated 32650 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 20:59:59.690481 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a2622d50-56d7-43d9-b47c-69d0639084c0 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-1128500034", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "2853abb2-f8b6-4eeb-86ee-8eff3f932a44"}]}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:59.785525 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.network.neutron [None req-a2622d50-56d7-43d9-b47c-69d0639084c0 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] validate_networks() for [('2853abb2-f8b6-4eeb-86ee-8eff3f932a44', None, None, None, None, None)] {{(pid=129366) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 20:59:59.887446 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a7270683-5065-4096-9ff8-d9c3a7899146 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'create', calling method: .version_select at 0x7f30c854c4c0>, body: {"keypair": {"name": "tempest-keypair-957610633"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 20:59:59.909670 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-a7270683-5065-4096-9ff8-d9c3a7899146 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Getting quotas for project 818a237ecf6b46e389a244c2f33641d5. Resources: {'key_pairs'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 20:59:59.915796 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-a7270683-5065-4096-9ff8-d9c3a7899146 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Getting quotas for user ffbeca0a8c6247bb9cf07d84b7c53a9d and project 818a237ecf6b46e389a244c2f33641d5. Resources: {'key_pairs'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:00:00.059475 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-a7270683-5065-4096-9ff8-d9c3a7899146 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Getting quotas for project 818a237ecf6b46e389a244c2f33641d5. Resources: {'key_pairs'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:00:00.065208 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-a7270683-5065-4096-9ff8-d9c3a7899146 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Getting quotas for user ffbeca0a8c6247bb9cf07d84b7c53a9d and project 818a237ecf6b46e389a244c2f33641d5. Resources: {'key_pairs'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:00:00.085010 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a7270683-5065-4096-9ff8-d9c3a7899146 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.20 time: 0.384871 Jan 15 21:00:00.091290 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1717/3437] 10.222.0.46 () {62 vars in 1198 bytes} [Sat Jan 15 20:59:59 2022] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 392 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Jan 15 21:00:00.096585 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8b0e7dab-d8d3-49e1-a3ba-857ac3698cf1 tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:00.097355 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-8b0e7dab-d8d3-49e1-a3ba-857ac3698cf1 tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] [instance: 6d9fd532-17fd-4ec1-b3e2-d05605c20756] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:00.106133 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8b0e7dab-d8d3-49e1-a3ba-857ac3698cf1 tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:00.106967 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8b0e7dab-d8d3-49e1-a3ba-857ac3698cf1 tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:00.108128 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8b0e7dab-d8d3-49e1-a3ba-857ac3698cf1 tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:00.109215 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8b0e7dab-d8d3-49e1-a3ba-857ac3698cf1 tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:00.133520 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-8b0e7dab-d8d3-49e1-a3ba-857ac3698cf1 tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] HTTP exception thrown: Instance 6d9fd532-17fd-4ec1-b3e2-d05605c20756 could not be found. Jan 15 21:00:00.134359 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8b0e7dab-d8d3-49e1-a3ba-857ac3698cf1 tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] Returning 404 to user: Instance 6d9fd532-17fd-4ec1-b3e2-d05605c20756 could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:00:00.135334 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-8b0e7dab-d8d3-49e1-a3ba-857ac3698cf1 tempest-ServerMetadataNegativeTestJSON-1749172078 tempest-ServerMetadataNegativeTestJSON-1749172078-project] 10.222.0.46 "GET /compute/v2.1/servers/6d9fd532-17fd-4ec1-b3e2-d05605c20756" status: 404 len: 111 microversion: 2.1 time: 0.042819 Jan 15 21:00:00.136111 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1718/3438] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:00:00 2022] GET /compute/v2.1/servers/6d9fd532-17fd-4ec1-b3e2-d05605c20756 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:00:00.196497 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-075ec83a-4836-4b62-a5d8-f2590bca6bff tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:00.200956 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-075ec83a-4836-4b62-a5d8-f2590bca6bff tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: c8986b09-8342-4290-87be-22cece488c73] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:00.214793 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-075ec83a-4836-4b62-a5d8-f2590bca6bff tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:00.215269 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-075ec83a-4836-4b62-a5d8-f2590bca6bff tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:00.224798 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-075ec83a-4836-4b62-a5d8-f2590bca6bff tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:00.225912 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-075ec83a-4836-4b62-a5d8-f2590bca6bff tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:00.586947 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-a2622d50-56d7-43d9-b47c-69d0639084c0 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Flavor limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 21:00:00.587479 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-a2622d50-56d7-43d9-b47c-69d0639084c0 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Image limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 21:00:00.587847 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-a2622d50-56d7-43d9-b47c-69d0639084c0 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Flavor pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 21:00:00.588264 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-a2622d50-56d7-43d9-b47c-69d0639084c0 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Image pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 21:00:00.588671 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-a2622d50-56d7-43d9-b47c-69d0639084c0 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 21:00:00.607099 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a2622d50-56d7-43d9-b47c-69d0639084c0 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:00.607554 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a2622d50-56d7-43d9-b47c-69d0639084c0 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:00.608377 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a2622d50-56d7-43d9-b47c-69d0639084c0 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:00.608814 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a2622d50-56d7-43d9-b47c-69d0639084c0 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:00.645730 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-a2622d50-56d7-43d9-b47c-69d0639084c0 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Getting quotas for project 0ca0988cda6548f89ee936bee64f56ac. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:00:00.665320 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-a2622d50-56d7-43d9-b47c-69d0639084c0 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Getting quotas for user f1c07d13117a49b6b2042e182faaf9c7 and project 0ca0988cda6548f89ee936bee64f56ac. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:00:00.696218 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a2622d50-56d7-43d9-b47c-69d0639084c0 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Going to run 2 instances... {{(pid=129366) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 21:00:00.698849 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a2622d50-56d7-43d9-b47c-69d0639084c0 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] [instance: 8aaf65b5-c92d-4c08-bba3-a5bef4ac3aa3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 21:00:00.719264 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-075ec83a-4836-4b62-a5d8-f2590bca6bff tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8f9c6ea7f6496792258d683640c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a75218d537c4d63874297261bec70ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:00.766060 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-075ec83a-4836-4b62-a5d8-f2590bca6bff tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] 10.222.0.46 "GET /compute/v2.1/servers/c8986b09-8342-4290-87be-22cece488c73" status: 200 len: 1515 microversion: 2.1 time: 0.576641 Jan 15 21:00:00.769200 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1719/3439] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:00:00 2022] GET /compute/v2.1/servers/c8986b09-8342-4290-87be-22cece488c73 => generated 1515 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:00:00.783315 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a2622d50-56d7-43d9-b47c-69d0639084c0 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] [instance: 52a604e6-ab40-42a3-bb6b-6a65307d2bef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=8aaf65b5-c92d-4c08-bba3-a5bef4ac3aa3,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 21:00:00.789378 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8805d8aa-31ad-4d7f-a1b3-2c7d6e188d31 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:00.793764 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-8805d8aa-31ad-4d7f-a1b3-2c7d6e188d31 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:00.836906 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8805d8aa-31ad-4d7f-a1b3-2c7d6e188d31 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:00.838327 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8805d8aa-31ad-4d7f-a1b3-2c7d6e188d31 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:00.872120 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8805d8aa-31ad-4d7f-a1b3-2c7d6e188d31 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:00.875020 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8805d8aa-31ad-4d7f-a1b3-2c7d6e188d31 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:00.914932 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a2622d50-56d7-43d9-b47c-69d0639084c0 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.230243 Jan 15 21:00:00.917862 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1721/3440] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 20:59:59 2022] POST /compute/v2.1/servers => generated 32 bytes in 1236 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Jan 15 21:00:00.926545 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-48e90a7d-2e8d-4e86-a13d-d327db41a1ef tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:00.929627 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-48e90a7d-2e8d-4e86-a13d-d327db41a1ef tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:00.943649 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-48e90a7d-2e8d-4e86-a13d-d327db41a1ef tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:00.948126 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-48e90a7d-2e8d-4e86-a13d-d327db41a1ef tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:00.950334 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-48e90a7d-2e8d-4e86-a13d-d327db41a1ef tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:00.950942 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-48e90a7d-2e8d-4e86-a13d-d327db41a1ef tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:01.103788 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-8805d8aa-31ad-4d7f-a1b3-2c7d6e188d31 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 24586 microversion: 2.42 time: 0.327289 Jan 15 21:00:01.110607 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1720/3441] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:00:00 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 24586 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:00:01.128679 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-78eeb140-610b-402f-9acf-4b8170e58866 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:01.130145 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-78eeb140-610b-402f-9acf-4b8170e58866 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:01.163561 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-78eeb140-610b-402f-9acf-4b8170e58866 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:01.164949 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-78eeb140-610b-402f-9acf-4b8170e58866 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:01.169926 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-78eeb140-610b-402f-9acf-4b8170e58866 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:01.171009 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-78eeb140-610b-402f-9acf-4b8170e58866 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:01.310881 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-78eeb140-610b-402f-9acf-4b8170e58866 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action" status: 200 len: 32641 microversion: 2.1 time: 0.200037 Jan 15 21:00:01.316579 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1721/3442] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:00:01 2022] POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action => generated 32641 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:00:01.337410 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5cca969d-80cb-43f9-91bf-a37b002a31ce tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:01.338826 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-5cca969d-80cb-43f9-91bf-a37b002a31ce tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] [instance: 5e93486c-7c77-4855-85f4-2bc8bcf4832f] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:01.352215 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5cca969d-80cb-43f9-91bf-a37b002a31ce tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:01.354001 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5cca969d-80cb-43f9-91bf-a37b002a31ce tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:01.355055 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5cca969d-80cb-43f9-91bf-a37b002a31ce tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:01.355639 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5cca969d-80cb-43f9-91bf-a37b002a31ce tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:01.395232 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-48e90a7d-2e8d-4e86-a13d-d327db41a1ef tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:01.419951 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5cca969d-80cb-43f9-91bf-a37b002a31ce tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] 10.222.0.46 "POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action" status: 200 len: 32650 microversion: 2.1 time: 0.088212 Jan 15 21:00:01.425504 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-48e90a7d-2e8d-4e86-a13d-d327db41a1ef tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:01.427602 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-48e90a7d-2e8d-4e86-a13d-d327db41a1ef tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:01.429456 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1722/3443] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:00:01 2022] POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action => generated 32650 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:00:01.431456 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-48e90a7d-2e8d-4e86-a13d-d327db41a1ef tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "GET /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220" status: 200 len: 1660 microversion: 2.32 time: 0.509961 Jan 15 21:00:01.433208 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1722/3444] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:00:00 2022] GET /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220 => generated 1660 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:00:01.447697 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-fbc84fc9-f49e-4c6f-899b-56ecee8c6ea1 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:01.456010 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:00:01.456010 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:00:01.461386 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-fbc84fc9-f49e-4c6f-899b-56ecee8c6ea1 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f1c07d13117a49b6b2042e182faaf9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca0988cda6548f89ee936bee64f56ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:01.462260 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-fbc84fc9-f49e-4c6f-899b-56ecee8c6ea1 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Searching by: {'deleted': False, 'project_id': '0ca0988cda6548f89ee936bee64f56ac'} {{(pid=129365) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 15 21:00:01.512475 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fbc84fc9-f49e-4c6f-899b-56ecee8c6ea1 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:01.513489 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fbc84fc9-f49e-4c6f-899b-56ecee8c6ea1 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:01.513998 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fbc84fc9-f49e-4c6f-899b-56ecee8c6ea1 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:01.517713 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fbc84fc9-f49e-4c6f-899b-56ecee8c6ea1 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:01.600331 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.multi_cell_list [None req-fbc84fc9-f49e-4c6f-899b-56ecee8c6ea1 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=129365) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jan 15 21:00:01.679968 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-fbc84fc9-f49e-4c6f-899b-56ecee8c6ea1 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] 10.222.0.46 "GET /compute/v2.1/servers" status: 200 len: 1337 microversion: 2.1 time: 0.248271 Jan 15 21:00:01.683397 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1723/3445] 10.222.0.46 () {58 vars in 1124 bytes} [Sat Jan 15 21:00:01 2022] GET /compute/v2.1/servers => generated 1337 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:00:01.693798 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c22266be-1fcf-4015-88e0-22118f445c0a tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:01.694407 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c22266be-1fcf-4015-88e0-22118f445c0a tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] [instance: 52a604e6-ab40-42a3-bb6b-6a65307d2bef] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:01.789757 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8598be85-11d5-4e6e-b3aa-793c27461a6e tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:01.790771 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-8598be85-11d5-4e6e-b3aa-793c27461a6e tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: c8986b09-8342-4290-87be-22cece488c73] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:01.811023 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8598be85-11d5-4e6e-b3aa-793c27461a6e tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:01.812603 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8598be85-11d5-4e6e-b3aa-793c27461a6e tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:01.815605 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8598be85-11d5-4e6e-b3aa-793c27461a6e tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:01.817761 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8598be85-11d5-4e6e-b3aa-793c27461a6e tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:01.828917 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-c22266be-1fcf-4015-88e0-22118f445c0a tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c07d13117a49b6b2042e182faaf9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca0988cda6548f89ee936bee64f56ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:01.846757 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c22266be-1fcf-4015-88e0-22118f445c0a tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] 10.222.0.46 "GET /compute/v2.1/servers/52a604e6-ab40-42a3-bb6b-6a65307d2bef" status: 200 len: 1218 microversion: 2.1 time: 0.156806 Jan 15 21:00:01.851394 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1723/3446] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:00:01 2022] GET /compute/v2.1/servers/52a604e6-ab40-42a3-bb6b-6a65307d2bef => generated 1218 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:00:02.118171 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-382032b1-2631-4266-a069-cacc1b3f9230 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:02.119727 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-382032b1-2631-4266-a069-cacc1b3f9230 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:02.142735 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-382032b1-2631-4266-a069-cacc1b3f9230 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:02.143462 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-382032b1-2631-4266-a069-cacc1b3f9230 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:02.145176 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-382032b1-2631-4266-a069-cacc1b3f9230 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:02.145780 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-382032b1-2631-4266-a069-cacc1b3f9230 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:02.250091 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-382032b1-2631-4266-a069-cacc1b3f9230 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 24586 microversion: 2.42 time: 0.137090 Jan 15 21:00:02.250994 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1724/3447] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:00:02 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 24586 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:00:02.325596 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9ea31254-1a1b-4b23-9be7-334918a00a5e tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:02.326581 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-9ea31254-1a1b-4b23-9be7-334918a00a5e tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:02.362708 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9ea31254-1a1b-4b23-9be7-334918a00a5e tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:02.363328 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9ea31254-1a1b-4b23-9be7-334918a00a5e tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:02.395168 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9ea31254-1a1b-4b23-9be7-334918a00a5e tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:02.396647 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9ea31254-1a1b-4b23-9be7-334918a00a5e tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.031s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:02.542918 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-9ea31254-1a1b-4b23-9be7-334918a00a5e tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action" status: 200 len: 32641 microversion: 2.1 time: 0.222278 Jan 15 21:00:02.553121 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1725/3448] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:00:02 2022] POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action => generated 32641 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:00:02.562665 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a704d899-3c3b-484f-98a7-8ea78e2e31ee tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:02.574209 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a704d899-3c3b-484f-98a7-8ea78e2e31ee tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] [instance: 5e93486c-7c77-4855-85f4-2bc8bcf4832f] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:02.595894 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a704d899-3c3b-484f-98a7-8ea78e2e31ee tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:02.605228 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a704d899-3c3b-484f-98a7-8ea78e2e31ee tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:02.606512 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a704d899-3c3b-484f-98a7-8ea78e2e31ee tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:02.606512 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a704d899-3c3b-484f-98a7-8ea78e2e31ee tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:02.701530 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a704d899-3c3b-484f-98a7-8ea78e2e31ee tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] 10.222.0.46 "POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action" status: 200 len: 32650 microversion: 2.1 time: 0.143348 Jan 15 21:00:02.706203 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1726/3449] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:00:02 2022] POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action => generated 32650 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:00:02.707978 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-12ba932e-05a4-4610-b37b-88432f3ef3fc tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:02.708774 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-12ba932e-05a4-4610-b37b-88432f3ef3fc tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:02.729217 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-12ba932e-05a4-4610-b37b-88432f3ef3fc tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:02.729667 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-12ba932e-05a4-4610-b37b-88432f3ef3fc tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:02.730465 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-12ba932e-05a4-4610-b37b-88432f3ef3fc tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:02.730902 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-12ba932e-05a4-4610-b37b-88432f3ef3fc tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:03.200436 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-8598be85-11d5-4e6e-b3aa-793c27461a6e tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8f9c6ea7f6496792258d683640c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a75218d537c4d63874297261bec70ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:03.213504 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-8598be85-11d5-4e6e-b3aa-793c27461a6e tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] 10.222.0.46 "GET /compute/v2.1/servers/c8986b09-8342-4290-87be-22cece488c73" status: 200 len: 1515 microversion: 2.1 time: 1.429228 Jan 15 21:00:03.214959 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1724/3450] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:00:01 2022] GET /compute/v2.1/servers/c8986b09-8342-4290-87be-22cece488c73 => generated 1515 bytes in 1433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:00:03.226870 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-cec1087b-41f0-4ec8-8625-935f34c9a512 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:03.229265 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-cec1087b-41f0-4ec8-8625-935f34c9a512 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] [instance: 52a604e6-ab40-42a3-bb6b-6a65307d2bef] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:03.246370 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cec1087b-41f0-4ec8-8625-935f34c9a512 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:03.248975 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cec1087b-41f0-4ec8-8625-935f34c9a512 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:03.249834 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cec1087b-41f0-4ec8-8625-935f34c9a512 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:03.250278 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cec1087b-41f0-4ec8-8625-935f34c9a512 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:03.499179 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-cec1087b-41f0-4ec8-8625-935f34c9a512 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c07d13117a49b6b2042e182faaf9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca0988cda6548f89ee936bee64f56ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:03.517879 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-cec1087b-41f0-4ec8-8625-935f34c9a512 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] 10.222.0.46 "GET /compute/v2.1/servers/52a604e6-ab40-42a3-bb6b-6a65307d2bef" status: 200 len: 1270 microversion: 2.1 time: 0.299493 Jan 15 21:00:03.519363 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1725/3451] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:00:03 2022] GET /compute/v2.1/servers/52a604e6-ab40-42a3-bb6b-6a65307d2bef => generated 1270 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:00:03.530230 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ae9c43bd-60ca-4b58-9842-6e7ac7d4f14d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:03.531747 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ae9c43bd-60ca-4b58-9842-6e7ac7d4f14d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:03.555214 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ae9c43bd-60ca-4b58-9842-6e7ac7d4f14d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:03.556596 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ae9c43bd-60ca-4b58-9842-6e7ac7d4f14d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:03.559892 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ae9c43bd-60ca-4b58-9842-6e7ac7d4f14d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:03.560822 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ae9c43bd-60ca-4b58-9842-6e7ac7d4f14d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:03.663329 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ae9c43bd-60ca-4b58-9842-6e7ac7d4f14d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 24586 microversion: 2.42 time: 0.138432 Jan 15 21:00:03.665342 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1726/3452] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:00:03 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 24586 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:00:03.675056 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-0e7ff933-6fec-4097-9c09-9b988e52bffb req-a091b85b-622c-4aac-8145-79d18202b913 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58ee3eff-55c4-48eb-a5f6-2731d35270a0", "name": "network-vif-deleted", "tag": "cac6dd7d-cf94-4715-be2c-1beb35c8ff69"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:03.677203 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:00:03.677203 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:00:03.706404 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-0e7ff933-6fec-4097-9c09-9b988e52bffb req-a091b85b-622c-4aac-8145-79d18202b913 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:03.711348 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-0e7ff933-6fec-4097-9c09-9b988e52bffb req-a091b85b-622c-4aac-8145-79d18202b913 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:03.750823 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-0e7ff933-6fec-4097-9c09-9b988e52bffb req-a091b85b-622c-4aac-8145-79d18202b913 service nova] Creating event network-vif-deleted:cac6dd7d-cf94-4715-be2c-1beb35c8ff69 for instance 58ee3eff-55c4-48eb-a5f6-2731d35270a0 on nch1-master-1 Jan 15 21:00:03.769697 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-0e7ff933-6fec-4097-9c09-9b988e52bffb req-a091b85b-622c-4aac-8145-79d18202b913 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100628 Jan 15 21:00:03.773092 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1727/3453] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:00:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:00:03.787343 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-64e865c5-f1af-4e1a-a6a6-b47c9189e0dd tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:03.790557 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-64e865c5-f1af-4e1a-a6a6-b47c9189e0dd tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:03.810690 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-64e865c5-f1af-4e1a-a6a6-b47c9189e0dd tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:03.811825 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-64e865c5-f1af-4e1a-a6a6-b47c9189e0dd tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:03.814276 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-64e865c5-f1af-4e1a-a6a6-b47c9189e0dd tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:03.815287 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-64e865c5-f1af-4e1a-a6a6-b47c9189e0dd tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:03.827668 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-12ba932e-05a4-4610-b37b-88432f3ef3fc tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:03.846167 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-12ba932e-05a4-4610-b37b-88432f3ef3fc tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:03.847851 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-12ba932e-05a4-4610-b37b-88432f3ef3fc tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:03.855905 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-12ba932e-05a4-4610-b37b-88432f3ef3fc tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "GET /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220" status: 200 len: 1707 microversion: 2.32 time: 1.152315 Jan 15 21:00:03.856502 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1727/3454] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:00:02 2022] GET /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220 => generated 1707 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:00:03.872237 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-6bef007d-8a74-42ae-b342-4816a4ca518f tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:03.878883 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-64e865c5-f1af-4e1a-a6a6-b47c9189e0dd tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action" status: 200 len: 32641 microversion: 2.1 time: 0.104038 Jan 15 21:00:03.881288 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-6bef007d-8a74-42ae-b342-4816a4ca518f tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] [instance: 5e93486c-7c77-4855-85f4-2bc8bcf4832f] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:03.883182 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1728/3455] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:00:03 2022] POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action => generated 32641 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:00:03.916118 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6bef007d-8a74-42ae-b342-4816a4ca518f tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:03.916260 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6bef007d-8a74-42ae-b342-4816a4ca518f tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:03.920113 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6bef007d-8a74-42ae-b342-4816a4ca518f tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:03.920562 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6bef007d-8a74-42ae-b342-4816a4ca518f tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:04.030838 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-6bef007d-8a74-42ae-b342-4816a4ca518f tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] 10.222.0.46 "POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action" status: 200 len: 32650 microversion: 2.1 time: 0.167048 Jan 15 21:00:04.034502 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1728/3456] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:00:03 2022] POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action => generated 32650 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:00:04.232171 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ff17368b-4130-4bb8-a9fa-7cd5964c18b1 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:04.236974 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ff17368b-4130-4bb8-a9fa-7cd5964c18b1 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: c8986b09-8342-4290-87be-22cece488c73] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:04.247196 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ff17368b-4130-4bb8-a9fa-7cd5964c18b1 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:04.247748 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ff17368b-4130-4bb8-a9fa-7cd5964c18b1 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:04.248679 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ff17368b-4130-4bb8-a9fa-7cd5964c18b1 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:04.249318 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ff17368b-4130-4bb8-a9fa-7cd5964c18b1 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:04.357597 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c08a7608-53af-4924-8660-29c196f38b0e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-92839244", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "535f6b6c-b9f5-47ea-8d07-fcc8966ad86d"}], "security_groups": [{"name": "tempest-securitygroup--1138119416"}], "key_name": "tempest-keypair-957610633", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:04.631488 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.network.neutron [None req-c08a7608-53af-4924-8660-29c196f38b0e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] validate_networks() for [('535f6b6c-b9f5-47ea-8d07-fcc8966ad86d', None, None, None, None, None)] {{(pid=129366) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 21:00:04.718822 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-ff17368b-4130-4bb8-a9fa-7cd5964c18b1 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8f9c6ea7f6496792258d683640c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a75218d537c4d63874297261bec70ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:04.736344 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ff17368b-4130-4bb8-a9fa-7cd5964c18b1 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] 10.222.0.46 "GET /compute/v2.1/servers/c8986b09-8342-4290-87be-22cece488c73" status: 200 len: 1515 microversion: 2.1 time: 0.508095 Jan 15 21:00:04.737934 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1729/3457] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:00:04 2022] GET /compute/v2.1/servers/c8986b09-8342-4290-87be-22cece488c73 => generated 1515 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:00:04.746414 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-25a29d06-d14c-4906-ae74-93d4407deef6 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:04.747037 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-25a29d06-d14c-4906-ae74-93d4407deef6 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] [instance: 52a604e6-ab40-42a3-bb6b-6a65307d2bef] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:04.755232 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-25a29d06-d14c-4906-ae74-93d4407deef6 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:04.756079 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-25a29d06-d14c-4906-ae74-93d4407deef6 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:04.757210 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-25a29d06-d14c-4906-ae74-93d4407deef6 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:04.757812 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-25a29d06-d14c-4906-ae74-93d4407deef6 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:04.885673 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-25a29d06-d14c-4906-ae74-93d4407deef6 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c07d13117a49b6b2042e182faaf9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca0988cda6548f89ee936bee64f56ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:04.907547 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-25a29d06-d14c-4906-ae74-93d4407deef6 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] 10.222.0.46 "GET /compute/v2.1/servers/52a604e6-ab40-42a3-bb6b-6a65307d2bef" status: 200 len: 1276 microversion: 2.1 time: 0.166441 Jan 15 21:00:04.920229 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1730/3458] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:00:04 2022] GET /compute/v2.1/servers/52a604e6-ab40-42a3-bb6b-6a65307d2bef => generated 1276 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:00:04.921101 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-cf69eda7-d2cd-489a-9536-42d3c3ffed18 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:04.922136 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-cf69eda7-d2cd-489a-9536-42d3c3ffed18 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:04.929907 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cf69eda7-d2cd-489a-9536-42d3c3ffed18 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:04.930568 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cf69eda7-d2cd-489a-9536-42d3c3ffed18 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:04.933802 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cf69eda7-d2cd-489a-9536-42d3c3ffed18 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:04.934551 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cf69eda7-d2cd-489a-9536-42d3c3ffed18 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:05.027269 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-cf69eda7-d2cd-489a-9536-42d3c3ffed18 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 24586 microversion: 2.42 time: 0.111789 Jan 15 21:00:05.028020 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1731/3459] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:00:04 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 24586 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:00:05.046570 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d9e78f7c-5366-48df-9b3b-c3d56d18cb44 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:05.055322 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d9e78f7c-5366-48df-9b3b-c3d56d18cb44 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:05.086106 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d9e78f7c-5366-48df-9b3b-c3d56d18cb44 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:05.086861 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d9e78f7c-5366-48df-9b3b-c3d56d18cb44 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:05.087894 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d9e78f7c-5366-48df-9b3b-c3d56d18cb44 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:05.090009 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d9e78f7c-5366-48df-9b3b-c3d56d18cb44 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:05.506992 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-c08a7608-53af-4924-8660-29c196f38b0e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Flavor limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 21:00:05.509310 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-c08a7608-53af-4924-8660-29c196f38b0e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Image limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 21:00:05.510155 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-c08a7608-53af-4924-8660-29c196f38b0e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Flavor pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 21:00:05.510731 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-c08a7608-53af-4924-8660-29c196f38b0e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Image pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 21:00:05.511523 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-c08a7608-53af-4924-8660-29c196f38b0e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 21:00:05.526781 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c08a7608-53af-4924-8660-29c196f38b0e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:05.527612 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c08a7608-53af-4924-8660-29c196f38b0e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:05.529062 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c08a7608-53af-4924-8660-29c196f38b0e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:05.529695 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c08a7608-53af-4924-8660-29c196f38b0e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:05.560607 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-c08a7608-53af-4924-8660-29c196f38b0e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Getting quotas for project 818a237ecf6b46e389a244c2f33641d5. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:00:05.568561 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-c08a7608-53af-4924-8660-29c196f38b0e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Getting quotas for user ffbeca0a8c6247bb9cf07d84b7c53a9d and project 818a237ecf6b46e389a244c2f33641d5. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:00:05.572709 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-d9e78f7c-5366-48df-9b3b-c3d56d18cb44 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:05.584759 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c08a7608-53af-4924-8660-29c196f38b0e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Going to run 1 instances... {{(pid=129366) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 21:00:05.587137 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-d9e78f7c-5366-48df-9b3b-c3d56d18cb44 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:05.587519 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c08a7608-53af-4924-8660-29c196f38b0e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 21:00:05.589832 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-d9e78f7c-5366-48df-9b3b-c3d56d18cb44 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:05.591114 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d9e78f7c-5366-48df-9b3b-c3d56d18cb44 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "GET /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220" status: 200 len: 1742 microversion: 2.32 time: 0.555767 Jan 15 21:00:05.600983 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1732/3460] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:00:05 2022] GET /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220 => generated 1742 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:00:05.609683 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-6fbb527f-3f3e-44ad-bb42-751945a8d317 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:05.611585 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-6fbb527f-3f3e-44ad-bb42-751945a8d317 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:05.620658 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6fbb527f-3f3e-44ad-bb42-751945a8d317 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:05.621287 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6fbb527f-3f3e-44ad-bb42-751945a8d317 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:05.622347 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6fbb527f-3f3e-44ad-bb42-751945a8d317 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:05.623042 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6fbb527f-3f3e-44ad-bb42-751945a8d317 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:05.656760 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c08a7608-53af-4924-8660-29c196f38b0e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.303624 Jan 15 21:00:05.663712 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1729/3461] 10.222.0.46 () {62 vars in 1187 bytes} [Sat Jan 15 21:00:04 2022] POST /compute/v2.1/servers => generated 402 bytes in 1311 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jan 15 21:00:05.669980 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-46f37b51-467a-419b-a403-aad79f444149 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:05.671214 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-46f37b51-467a-419b-a403-aad79f444149 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] [instance: 5e93486c-7c77-4855-85f4-2bc8bcf4832f] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:05.681429 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-46f37b51-467a-419b-a403-aad79f444149 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:05.682148 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-46f37b51-467a-419b-a403-aad79f444149 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:05.683107 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-46f37b51-467a-419b-a403-aad79f444149 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:05.683848 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-46f37b51-467a-419b-a403-aad79f444149 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:05.686903 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-6fbb527f-3f3e-44ad-bb42-751945a8d317 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action" status: 200 len: 32641 microversion: 2.1 time: 0.080134 Jan 15 21:00:05.696426 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1733/3462] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:00:05 2022] POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action => generated 32641 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:00:05.708905 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e046d077-7329-4613-8abd-9f01a1a2e5f2 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:05.726811 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e046d077-7329-4613-8abd-9f01a1a2e5f2 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:05.777987 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-46f37b51-467a-419b-a403-aad79f444149 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] 10.222.0.46 "POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action" status: 200 len: 32650 microversion: 2.1 time: 0.112550 Jan 15 21:00:05.783152 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1730/3463] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:00:05 2022] POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action => generated 32650 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:00:05.797984 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7a0bdf94-ffc8-46bc-95c6-6ba1d6c3d6e2 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:05.798960 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-7a0bdf94-ffc8-46bc-95c6-6ba1d6c3d6e2 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: c8986b09-8342-4290-87be-22cece488c73] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:05.811088 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7a0bdf94-ffc8-46bc-95c6-6ba1d6c3d6e2 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:05.811979 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7a0bdf94-ffc8-46bc-95c6-6ba1d6c3d6e2 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:05.813307 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7a0bdf94-ffc8-46bc-95c6-6ba1d6c3d6e2 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:05.814305 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7a0bdf94-ffc8-46bc-95c6-6ba1d6c3d6e2 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:05.903086 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-e046d077-7329-4613-8abd-9f01a1a2e5f2 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:05.923728 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-e046d077-7329-4613-8abd-9f01a1a2e5f2 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:05.925637 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-e046d077-7329-4613-8abd-9f01a1a2e5f2 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:05.934166 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e046d077-7329-4613-8abd-9f01a1a2e5f2 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0" status: 200 len: 1279 microversion: 2.20 time: 0.231255 Jan 15 21:00:05.936052 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1734/3464] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:00:05 2022] GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0 => generated 1279 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:00:05.960173 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-a1d1c276-467a-426b-b2b9-abccd9bea33f req-8046208a-8035-4bb4-9199-69c0fd872bbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d04bb3a-eacf-48ca-b7bf-e830a2c30b80", "name": "network-vif-deleted", "tag": "e1f58043-97ce-4c2d-86fb-63acb89366e7"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:05.962479 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:00:05.962479 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:00:05.972917 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-a1d1c276-467a-426b-b2b9-abccd9bea33f req-8046208a-8035-4bb4-9199-69c0fd872bbf service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:05.973746 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-a1d1c276-467a-426b-b2b9-abccd9bea33f req-8046208a-8035-4bb4-9199-69c0fd872bbf service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:05.988647 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-a1d1c276-467a-426b-b2b9-abccd9bea33f req-8046208a-8035-4bb4-9199-69c0fd872bbf service nova] Creating event network-vif-deleted:e1f58043-97ce-4c2d-86fb-63acb89366e7 for instance 0d04bb3a-eacf-48ca-b7bf-e830a2c30b80 on nch2-master-1 Jan 15 21:00:06.004174 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-a1d1c276-467a-426b-b2b9-abccd9bea33f req-8046208a-8035-4bb4-9199-69c0fd872bbf service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048829 Jan 15 21:00:06.005582 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1735/3465] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:00:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:00:06.037012 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b62e7581-ed29-4243-a4af-f9105d101f55 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:06.096469 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b62e7581-ed29-4243-a4af-f9105d101f55 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] [instance: 52a604e6-ab40-42a3-bb6b-6a65307d2bef] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:06.143645 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b62e7581-ed29-4243-a4af-f9105d101f55 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:06.144389 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b62e7581-ed29-4243-a4af-f9105d101f55 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:06.146181 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b62e7581-ed29-4243-a4af-f9105d101f55 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:06.150704 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b62e7581-ed29-4243-a4af-f9105d101f55 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:06.241160 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-7a0bdf94-ffc8-46bc-95c6-6ba1d6c3d6e2 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8f9c6ea7f6496792258d683640c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a75218d537c4d63874297261bec70ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:06.254080 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7a0bdf94-ffc8-46bc-95c6-6ba1d6c3d6e2 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] 10.222.0.46 "GET /compute/v2.1/servers/c8986b09-8342-4290-87be-22cece488c73" status: 200 len: 1521 microversion: 2.1 time: 0.468935 Jan 15 21:00:06.258172 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1731/3466] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:00:05 2022] GET /compute/v2.1/servers/c8986b09-8342-4290-87be-22cece488c73 => generated 1521 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:00:06.275366 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e88fd75e-af5a-4acc-be92-90a8632aa906 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:06.278257 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e88fd75e-af5a-4acc-be92-90a8632aa906 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:06.306122 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e88fd75e-af5a-4acc-be92-90a8632aa906 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:06.306843 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e88fd75e-af5a-4acc-be92-90a8632aa906 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:06.309137 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e88fd75e-af5a-4acc-be92-90a8632aa906 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:06.309981 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e88fd75e-af5a-4acc-be92-90a8632aa906 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:06.319477 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-b62e7581-ed29-4243-a4af-f9105d101f55 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c07d13117a49b6b2042e182faaf9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca0988cda6548f89ee936bee64f56ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:06.334476 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b62e7581-ed29-4243-a4af-f9105d101f55 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] 10.222.0.46 "GET /compute/v2.1/servers/52a604e6-ab40-42a3-bb6b-6a65307d2bef" status: 200 len: 1276 microversion: 2.1 time: 0.319026 Jan 15 21:00:06.335435 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1736/3467] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:00:06 2022] GET /compute/v2.1/servers/52a604e6-ab40-42a3-bb6b-6a65307d2bef => generated 1276 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:00:06.414092 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e88fd75e-af5a-4acc-be92-90a8632aa906 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 24586 microversion: 2.42 time: 0.153596 Jan 15 21:00:06.418067 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1732/3468] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:00:06 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 24586 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:00:06.617697 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9da3f59f-5989-470c-82f2-abfbb46bd8c3 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:06.619016 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-9da3f59f-5989-470c-82f2-abfbb46bd8c3 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:06.659014 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9da3f59f-5989-470c-82f2-abfbb46bd8c3 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:06.660394 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9da3f59f-5989-470c-82f2-abfbb46bd8c3 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:06.665206 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9da3f59f-5989-470c-82f2-abfbb46bd8c3 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:06.668149 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9da3f59f-5989-470c-82f2-abfbb46bd8c3 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:06.706210 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-87b3653d-10e1-46eb-886c-b9daef7e8255 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:06.708921 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-87b3653d-10e1-46eb-886c-b9daef7e8255 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:06.727610 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-87b3653d-10e1-46eb-886c-b9daef7e8255 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:06.732272 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-87b3653d-10e1-46eb-886c-b9daef7e8255 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:06.734351 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-87b3653d-10e1-46eb-886c-b9daef7e8255 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:06.735004 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-87b3653d-10e1-46eb-886c-b9daef7e8255 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:06.809532 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-87b3653d-10e1-46eb-886c-b9daef7e8255 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action" status: 200 len: 32641 microversion: 2.1 time: 0.110015 Jan 15 21:00:06.810870 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1733/3469] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:00:06 2022] POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action => generated 32641 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:00:06.817883 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ee459360-3b27-4a02-9281-955d725f0996 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:06.819226 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ee459360-3b27-4a02-9281-955d725f0996 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] [instance: 5e93486c-7c77-4855-85f4-2bc8bcf4832f] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:06.830887 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ee459360-3b27-4a02-9281-955d725f0996 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:06.831563 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ee459360-3b27-4a02-9281-955d725f0996 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:06.832573 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ee459360-3b27-4a02-9281-955d725f0996 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:06.837546 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ee459360-3b27-4a02-9281-955d725f0996 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:06.894580 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ee459360-3b27-4a02-9281-955d725f0996 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] 10.222.0.46 "POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action" status: 200 len: 32650 microversion: 2.1 time: 0.081850 Jan 15 21:00:06.896253 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1734/3470] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:00:06 2022] POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action => generated 32650 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:00:06.956807 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0344d9d5-49db-4565-aeda-494c2b19b9ff tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:06.958654 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-0344d9d5-49db-4565-aeda-494c2b19b9ff tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:06.969136 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0344d9d5-49db-4565-aeda-494c2b19b9ff tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:06.970576 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0344d9d5-49db-4565-aeda-494c2b19b9ff tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:06.971908 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0344d9d5-49db-4565-aeda-494c2b19b9ff tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:06.972792 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0344d9d5-49db-4565-aeda-494c2b19b9ff tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:07.035165 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-9da3f59f-5989-470c-82f2-abfbb46bd8c3 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:07.059220 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-9da3f59f-5989-470c-82f2-abfbb46bd8c3 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:07.062055 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-9da3f59f-5989-470c-82f2-abfbb46bd8c3 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:07.063617 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-9da3f59f-5989-470c-82f2-abfbb46bd8c3 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "GET /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220" status: 200 len: 1742 microversion: 2.32 time: 0.452528 Jan 15 21:00:07.065855 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1737/3471] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:00:06 2022] GET /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220 => generated 1742 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:00:07.111007 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-0344d9d5-49db-4565-aeda-494c2b19b9ff tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:07.134005 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-0344d9d5-49db-4565-aeda-494c2b19b9ff tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:07.135592 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-0344d9d5-49db-4565-aeda-494c2b19b9ff tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:07.136744 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0344d9d5-49db-4565-aeda-494c2b19b9ff tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0" status: 200 len: 1331 microversion: 2.20 time: 0.185928 Jan 15 21:00:07.149501 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1735/3472] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:00:06 2022] GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0 => generated 1331 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 15 21:00:07.277291 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5ba470ce-f31f-4e96-bb1c-d0e591ba6860 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:07.278837 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-5ba470ce-f31f-4e96-bb1c-d0e591ba6860 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: c8986b09-8342-4290-87be-22cece488c73] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:07.301877 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5ba470ce-f31f-4e96-bb1c-d0e591ba6860 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:07.309945 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5ba470ce-f31f-4e96-bb1c-d0e591ba6860 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:07.312280 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5ba470ce-f31f-4e96-bb1c-d0e591ba6860 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:07.313721 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5ba470ce-f31f-4e96-bb1c-d0e591ba6860 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:07.359187 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0b4c0dc7-dc86-4f45-b0bc-61651daedacb tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:07.360093 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-0b4c0dc7-dc86-4f45-b0bc-61651daedacb tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] [instance: 52a604e6-ab40-42a3-bb6b-6a65307d2bef] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:07.371470 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0b4c0dc7-dc86-4f45-b0bc-61651daedacb tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:07.373515 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0b4c0dc7-dc86-4f45-b0bc-61651daedacb tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:07.379284 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0b4c0dc7-dc86-4f45-b0bc-61651daedacb tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:07.379798 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0b4c0dc7-dc86-4f45-b0bc-61651daedacb tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:07.642129 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-5ba470ce-f31f-4e96-bb1c-d0e591ba6860 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8f9c6ea7f6496792258d683640c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a75218d537c4d63874297261bec70ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:07.656328 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5ba470ce-f31f-4e96-bb1c-d0e591ba6860 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] 10.222.0.46 "GET /compute/v2.1/servers/c8986b09-8342-4290-87be-22cece488c73" status: 200 len: 1521 microversion: 2.1 time: 0.383157 Jan 15 21:00:07.657500 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1738/3473] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:00:07 2022] GET /compute/v2.1/servers/c8986b09-8342-4290-87be-22cece488c73 => generated 1521 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:00:07.664459 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-57c79267-e213-45cb-96e7-1e51db766848 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:07.665673 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-57c79267-e213-45cb-96e7-1e51db766848 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:07.675684 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-57c79267-e213-45cb-96e7-1e51db766848 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:07.676783 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-57c79267-e213-45cb-96e7-1e51db766848 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:07.679416 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-57c79267-e213-45cb-96e7-1e51db766848 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:07.681280 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-57c79267-e213-45cb-96e7-1e51db766848 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:07.702120 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-0b4c0dc7-dc86-4f45-b0bc-61651daedacb tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c07d13117a49b6b2042e182faaf9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca0988cda6548f89ee936bee64f56ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:07.723651 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0b4c0dc7-dc86-4f45-b0bc-61651daedacb tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] 10.222.0.46 "GET /compute/v2.1/servers/52a604e6-ab40-42a3-bb6b-6a65307d2bef" status: 200 len: 1318 microversion: 2.1 time: 0.368221 Jan 15 21:00:07.726625 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1736/3474] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:00:07 2022] GET /compute/v2.1/servers/52a604e6-ab40-42a3-bb6b-6a65307d2bef => generated 1318 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:00:07.756718 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-57c79267-e213-45cb-96e7-1e51db766848 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 24586 microversion: 2.42 time: 0.097525 Jan 15 21:00:07.757705 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1739/3475] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:00:07 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 24586 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:00:07.825087 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-eb927d72-0ead-40ad-b086-71f638e9b770 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:07.826454 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-eb927d72-0ead-40ad-b086-71f638e9b770 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:07.839172 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-eb927d72-0ead-40ad-b086-71f638e9b770 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:07.839908 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-eb927d72-0ead-40ad-b086-71f638e9b770 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:07.840931 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-eb927d72-0ead-40ad-b086-71f638e9b770 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:07.841527 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-eb927d72-0ead-40ad-b086-71f638e9b770 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:07.899665 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-eb927d72-0ead-40ad-b086-71f638e9b770 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action" status: 200 len: 32641 microversion: 2.1 time: 0.079820 Jan 15 21:00:07.902477 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1740/3476] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:00:07 2022] POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action => generated 32641 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:00:07.908353 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-db68613a-125e-419a-94f4-1c17952fc564 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:07.909909 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-db68613a-125e-419a-94f4-1c17952fc564 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] [instance: 5e93486c-7c77-4855-85f4-2bc8bcf4832f] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:07.920350 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-db68613a-125e-419a-94f4-1c17952fc564 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:07.921159 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-db68613a-125e-419a-94f4-1c17952fc564 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:07.922170 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-db68613a-125e-419a-94f4-1c17952fc564 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:07.922773 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-db68613a-125e-419a-94f4-1c17952fc564 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:07.982544 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-db68613a-125e-419a-94f4-1c17952fc564 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] 10.222.0.46 "POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action" status: 200 len: 32650 microversion: 2.1 time: 0.078290 Jan 15 21:00:07.984061 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1741/3477] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:00:07 2022] POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action => generated 32650 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:00:07.992183 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-8a3f1cd0-a47a-4175-855c-3457c44f7d03 req-112d1b0a-1991-480c-a361-6c254c14b303 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8986b09-8342-4290-87be-22cece488c73", "name": "network-vif-unplugged", "status": "completed", "tag": "7cf5ea2d-375f-4590-af25-836bb895b886"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:07.995250 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:00:07.995250 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:00:08.010105 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-8a3f1cd0-a47a-4175-855c-3457c44f7d03 req-112d1b0a-1991-480c-a361-6c254c14b303 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:08.010495 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-8a3f1cd0-a47a-4175-855c-3457c44f7d03 req-112d1b0a-1991-480c-a361-6c254c14b303 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:08.012325 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9a9c194c-46b7-428d-b288-eab561b87d3c tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-1050474467", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "networks": [{"uuid": "006f34d4-b973-47be-9dd6-ce9e0538fd1b"}]}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:08.026755 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-8a3f1cd0-a47a-4175-855c-3457c44f7d03 req-112d1b0a-1991-480c-a361-6c254c14b303 service nova] Creating event network-vif-unplugged:7cf5ea2d-375f-4590-af25-836bb895b886 for instance c8986b09-8342-4290-87be-22cece488c73 on nch1-master-1 Jan 15 21:00:08.038957 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-8a3f1cd0-a47a-4175-855c-3457c44f7d03 req-112d1b0a-1991-480c-a361-6c254c14b303 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052224 Jan 15 21:00:08.040566 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1742/3478] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:00:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:00:08.088091 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3305d3ca-c520-414a-bb1d-e47639bc25b3 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:08.089490 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-3305d3ca-c520-414a-bb1d-e47639bc25b3 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:08.098418 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3305d3ca-c520-414a-bb1d-e47639bc25b3 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:08.099490 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3305d3ca-c520-414a-bb1d-e47639bc25b3 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:08.102074 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3305d3ca-c520-414a-bb1d-e47639bc25b3 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:08.102547 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3305d3ca-c520-414a-bb1d-e47639bc25b3 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:08.105982 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.network.neutron [None req-9a9c194c-46b7-428d-b288-eab561b87d3c tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] validate_networks() for [('006f34d4-b973-47be-9dd6-ce9e0538fd1b', None, None, None, None, None)] {{(pid=129366) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 21:00:08.394257 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-3305d3ca-c520-414a-bb1d-e47639bc25b3 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:08.406182 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-3305d3ca-c520-414a-bb1d-e47639bc25b3 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:08.408530 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-3305d3ca-c520-414a-bb1d-e47639bc25b3 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:08.410585 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3305d3ca-c520-414a-bb1d-e47639bc25b3 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "GET /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220" status: 200 len: 1742 microversion: 2.32 time: 0.327842 Jan 15 21:00:08.411794 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1743/3479] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:00:08 2022] GET /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220 => generated 1742 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:00:08.419697 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b9cd6f69-238e-46c2-a055-5e593ef1d451 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:08.420954 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b9cd6f69-238e-46c2-a055-5e593ef1d451 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:08.432933 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b9cd6f69-238e-46c2-a055-5e593ef1d451 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:08.433566 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b9cd6f69-238e-46c2-a055-5e593ef1d451 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:08.434725 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b9cd6f69-238e-46c2-a055-5e593ef1d451 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:08.435429 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b9cd6f69-238e-46c2-a055-5e593ef1d451 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:08.581625 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-b9cd6f69-238e-46c2-a055-5e593ef1d451 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:08.601588 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-b9cd6f69-238e-46c2-a055-5e593ef1d451 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:08.603386 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-b9cd6f69-238e-46c2-a055-5e593ef1d451 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:08.604732 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b9cd6f69-238e-46c2-a055-5e593ef1d451 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0" status: 200 len: 1337 microversion: 2.20 time: 0.191131 Jan 15 21:00:08.610171 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1744/3480] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:00:08 2022] GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0 => generated 1337 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:00:08.684561 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-51bfad85-59f1-41e0-bc8e-6d0d5b2c3fb3 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:08.686980 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-51bfad85-59f1-41e0-bc8e-6d0d5b2c3fb3 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: c8986b09-8342-4290-87be-22cece488c73] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:08.707752 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-51bfad85-59f1-41e0-bc8e-6d0d5b2c3fb3 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:08.710985 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-51bfad85-59f1-41e0-bc8e-6d0d5b2c3fb3 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:08.711769 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-51bfad85-59f1-41e0-bc8e-6d0d5b2c3fb3 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:08.713359 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-51bfad85-59f1-41e0-bc8e-6d0d5b2c3fb3 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:08.837173 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-9a9c194c-46b7-428d-b288-eab561b87d3c tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Flavor limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 21:00:08.838922 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-9a9c194c-46b7-428d-b288-eab561b87d3c tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Image limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 21:00:08.840866 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-9a9c194c-46b7-428d-b288-eab561b87d3c tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Flavor pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 21:00:08.842315 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-9a9c194c-46b7-428d-b288-eab561b87d3c tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Image pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 21:00:08.843398 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-9a9c194c-46b7-428d-b288-eab561b87d3c tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 21:00:08.871180 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9a9c194c-46b7-428d-b288-eab561b87d3c tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:08.871978 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9a9c194c-46b7-428d-b288-eab561b87d3c tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:08.878325 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9a9c194c-46b7-428d-b288-eab561b87d3c tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:08.879701 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9a9c194c-46b7-428d-b288-eab561b87d3c tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:08.905041 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-9a9c194c-46b7-428d-b288-eab561b87d3c tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Getting quotas for project 0cf19dbd41564d638af8f2e69883d2fa. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:00:08.913897 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-9a9c194c-46b7-428d-b288-eab561b87d3c tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Getting quotas for user eb21ef67d1f64f73af586e35f1b772de and project 0cf19dbd41564d638af8f2e69883d2fa. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:00:08.935032 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-51bfad85-59f1-41e0-bc8e-6d0d5b2c3fb3 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8f9c6ea7f6496792258d683640c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a75218d537c4d63874297261bec70ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:08.940597 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-9a9c194c-46b7-428d-b288-eab561b87d3c tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Going to run 1 instances... {{(pid=129366) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 21:00:08.944502 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-9a9c194c-46b7-428d-b288-eab561b87d3c tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] [instance: eab97efd-0a8e-4f55-981e-818ed5583d2c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 21:00:08.946499 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-51bfad85-59f1-41e0-bc8e-6d0d5b2c3fb3 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] 10.222.0.46 "GET /compute/v2.1/servers/c8986b09-8342-4290-87be-22cece488c73" status: 200 len: 1521 microversion: 2.1 time: 0.273447 Jan 15 21:00:08.947694 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1745/3481] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:00:08 2022] GET /compute/v2.1/servers/c8986b09-8342-4290-87be-22cece488c73 => generated 1521 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:00:08.953057 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9d199116-1f16-4706-80ba-6cf7754144e4 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:08.953786 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-9d199116-1f16-4706-80ba-6cf7754144e4 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] [instance: 52a604e6-ab40-42a3-bb6b-6a65307d2bef] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:08.964114 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9d199116-1f16-4706-80ba-6cf7754144e4 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:08.964942 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9d199116-1f16-4706-80ba-6cf7754144e4 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:08.966029 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9d199116-1f16-4706-80ba-6cf7754144e4 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:08.966835 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9d199116-1f16-4706-80ba-6cf7754144e4 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:09.011659 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-9a9c194c-46b7-428d-b288-eab561b87d3c tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.283582 Jan 15 21:00:09.013073 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1737/3482] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 21:00:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1286 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 21:00:09.021309 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-03e4f575-e255-4cac-9717-7c07a4eb1e9e tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:09.022557 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-03e4f575-e255-4cac-9717-7c07a4eb1e9e tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:09.031610 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-03e4f575-e255-4cac-9717-7c07a4eb1e9e tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:09.032030 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-03e4f575-e255-4cac-9717-7c07a4eb1e9e tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:09.033089 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-03e4f575-e255-4cac-9717-7c07a4eb1e9e tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:09.033695 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-03e4f575-e255-4cac-9717-7c07a4eb1e9e tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:09.090789 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-03e4f575-e255-4cac-9717-7c07a4eb1e9e tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 24586 microversion: 2.42 time: 0.076167 Jan 15 21:00:09.091809 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1738/3483] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:00:09 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 24586 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:00:09.105533 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e652cca2-c3b1-4c91-bd14-757c5c47cb4f tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:09.107567 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e652cca2-c3b1-4c91-bd14-757c5c47cb4f tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:09.127390 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e652cca2-c3b1-4c91-bd14-757c5c47cb4f tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:09.134280 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e652cca2-c3b1-4c91-bd14-757c5c47cb4f tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:09.135805 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e652cca2-c3b1-4c91-bd14-757c5c47cb4f tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:09.136460 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e652cca2-c3b1-4c91-bd14-757c5c47cb4f tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:09.173407 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-9d199116-1f16-4706-80ba-6cf7754144e4 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c07d13117a49b6b2042e182faaf9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca0988cda6548f89ee936bee64f56ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:09.183203 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-9d199116-1f16-4706-80ba-6cf7754144e4 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] 10.222.0.46 "GET /compute/v2.1/servers/52a604e6-ab40-42a3-bb6b-6a65307d2bef" status: 200 len: 1318 microversion: 2.1 time: 0.233736 Jan 15 21:00:09.184180 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1746/3484] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:00:08 2022] GET /compute/v2.1/servers/52a604e6-ab40-42a3-bb6b-6a65307d2bef => generated 1318 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:00:09.189423 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9033d3e0-5a46-47a6-908c-b3f4bc864882 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:09.190416 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-9033d3e0-5a46-47a6-908c-b3f4bc864882 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] [instance: 5e93486c-7c77-4855-85f4-2bc8bcf4832f] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:09.197885 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9033d3e0-5a46-47a6-908c-b3f4bc864882 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:09.198788 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9033d3e0-5a46-47a6-908c-b3f4bc864882 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:09.200041 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9033d3e0-5a46-47a6-908c-b3f4bc864882 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:09.200502 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9033d3e0-5a46-47a6-908c-b3f4bc864882 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:09.240775 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e652cca2-c3b1-4c91-bd14-757c5c47cb4f tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action" status: 200 len: 40794 microversion: 2.1 time: 0.146376 Jan 15 21:00:09.249048 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1739/3485] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:00:09 2022] POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action => generated 40794 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:00:09.261602 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-549b4f55-2d9e-4f72-9ebe-f99f1d831df0 tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:09.263695 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-549b4f55-2d9e-4f72-9ebe-f99f1d831df0 tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] [instance: eab97efd-0a8e-4f55-981e-818ed5583d2c] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:09.266847 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-9033d3e0-5a46-47a6-908c-b3f4bc864882 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] 10.222.0.46 "POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action" status: 200 len: 32650 microversion: 2.1 time: 0.080746 Jan 15 21:00:09.273026 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1747/3486] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:00:09 2022] POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action => generated 32650 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:00:09.280087 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5099ed31-cea5-47ef-9be9-1e944b72dc74 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:09.281041 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-5099ed31-cea5-47ef-9be9-1e944b72dc74 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:09.291505 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5099ed31-cea5-47ef-9be9-1e944b72dc74 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:09.292505 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5099ed31-cea5-47ef-9be9-1e944b72dc74 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:09.293601 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5099ed31-cea5-47ef-9be9-1e944b72dc74 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:09.295280 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5099ed31-cea5-47ef-9be9-1e944b72dc74 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:09.344894 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-549b4f55-2d9e-4f72-9ebe-f99f1d831df0 tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb21ef67d1f64f73af586e35f1b772de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf19dbd41564d638af8f2e69883d2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:09.354884 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-549b4f55-2d9e-4f72-9ebe-f99f1d831df0 tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] 10.222.0.46 "GET /compute/v2.1/servers/eab97efd-0a8e-4f55-981e-818ed5583d2c" status: 200 len: 1216 microversion: 2.1 time: 0.104187 Jan 15 21:00:09.367090 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1740/3487] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:00:09 2022] GET /compute/v2.1/servers/eab97efd-0a8e-4f55-981e-818ed5583d2c => generated 1216 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:00:09.447929 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-75a18cbc-110e-4261-94ee-a7cebf6ecbe4 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:09.451043 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-75a18cbc-110e-4261-94ee-a7cebf6ecbe4 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:09.462849 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-75a18cbc-110e-4261-94ee-a7cebf6ecbe4 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:09.463944 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-75a18cbc-110e-4261-94ee-a7cebf6ecbe4 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:09.465271 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-75a18cbc-110e-4261-94ee-a7cebf6ecbe4 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:09.466011 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-75a18cbc-110e-4261-94ee-a7cebf6ecbe4 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:09.515615 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-5099ed31-cea5-47ef-9be9-1e944b72dc74 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:09.531123 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5099ed31-cea5-47ef-9be9-1e944b72dc74 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9" status: 200 len: 1670 microversion: 2.1 time: 0.257058 Jan 15 21:00:09.533490 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1748/3488] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:00:09 2022] GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9 => generated 1670 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:00:09.555413 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8d4f09db-512d-4051-b375-24a0ac72bbb6 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-765325633"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:09.558274 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-8d4f09db-512d-4051-b375-24a0ac72bbb6 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:09.569839 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8d4f09db-512d-4051-b375-24a0ac72bbb6 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:09.570413 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8d4f09db-512d-4051-b375-24a0ac72bbb6 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:09.571641 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8d4f09db-512d-4051-b375-24a0ac72bbb6 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:09.572204 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8d4f09db-512d-4051-b375-24a0ac72bbb6 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:09.750206 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-75a18cbc-110e-4261-94ee-a7cebf6ecbe4 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:09.762188 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-75a18cbc-110e-4261-94ee-a7cebf6ecbe4 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:09.764067 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-75a18cbc-110e-4261-94ee-a7cebf6ecbe4 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:09.765710 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-75a18cbc-110e-4261-94ee-a7cebf6ecbe4 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "GET /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220" status: 200 len: 1789 microversion: 2.32 time: 0.328689 Jan 15 21:00:09.766536 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1741/3489] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:00:09 2022] GET /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220 => generated 1789 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:00:09.772696 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ce16e50a-7d1c-4186-a280-01d993cb0035 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:09.773596 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ce16e50a-7d1c-4186-a280-01d993cb0035 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:09.789941 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ce16e50a-7d1c-4186-a280-01d993cb0035 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:09.790768 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ce16e50a-7d1c-4186-a280-01d993cb0035 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:09.792048 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ce16e50a-7d1c-4186-a280-01d993cb0035 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:09.792874 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ce16e50a-7d1c-4186-a280-01d993cb0035 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:09.908063 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-ce16e50a-7d1c-4186-a280-01d993cb0035 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:09.936927 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-ce16e50a-7d1c-4186-a280-01d993cb0035 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:09.938889 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-ce16e50a-7d1c-4186-a280-01d993cb0035 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:09.940297 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ce16e50a-7d1c-4186-a280-01d993cb0035 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0" status: 200 len: 1337 microversion: 2.20 time: 0.172490 Jan 15 21:00:09.945654 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1742/3490] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:00:09 2022] GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0 => generated 1337 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:00:09.950574 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-5998db72-f021-434a-870c-8bca98c8db03 req-9e396701-4c6a-4566-bcee-e273c8e303c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52a604e6-ab40-42a3-bb6b-6a65307d2bef", "tag": "4ed568ab-4582-4d97-8362-7eee18a7cd9f"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:09.959830 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:00:09.959830 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:00:09.976820 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-5998db72-f021-434a-870c-8bca98c8db03 req-9e396701-4c6a-4566-bcee-e273c8e303c6 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:09.980249 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-5998db72-f021-434a-870c-8bca98c8db03 req-9e396701-4c6a-4566-bcee-e273c8e303c6 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:10.016796 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-5998db72-f021-434a-870c-8bca98c8db03 req-9e396701-4c6a-4566-bcee-e273c8e303c6 service nova] Creating event network-changed:4ed568ab-4582-4d97-8362-7eee18a7cd9f for instance 52a604e6-ab40-42a3-bb6b-6a65307d2bef on nch2-master-1 Jan 15 21:00:10.028624 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-5998db72-f021-434a-870c-8bca98c8db03 req-9e396701-4c6a-4566-bcee-e273c8e303c6 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081408 Jan 15 21:00:10.029667 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1743/3491] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:00:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:00:10.049131 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-2fc3583e-9f9a-4598-a7c6-c3e3afbbdd5f tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:10.050472 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-2fc3583e-9f9a-4598-a7c6-c3e3afbbdd5f tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: c8986b09-8342-4290-87be-22cece488c73] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:10.069979 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-8d4f09db-512d-4051-b375-24a0ac72bbb6 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action" status: 202 len: 0 microversion: 2.1 time: 0.518937 Jan 15 21:00:10.078203 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1749/3492] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:00:09 2022] POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action => generated 0 bytes in 530 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Jan 15 21:00:10.085351 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2fc3583e-9f9a-4598-a7c6-c3e3afbbdd5f tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:10.087292 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-31fa339f-a5da-4b75-a1ce-602ba8038535 req-a863a8fc-938e-4a8e-bf0b-e76f1905c4a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8986b09-8342-4290-87be-22cece488c73", "name": "network-vif-plugged", "status": "completed", "tag": "7cf5ea2d-375f-4590-af25-836bb895b886"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:10.089317 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2fc3583e-9f9a-4598-a7c6-c3e3afbbdd5f tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:10.090273 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2fc3583e-9f9a-4598-a7c6-c3e3afbbdd5f tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:10.090690 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:00:10.090690 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:00:10.090913 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2fc3583e-9f9a-4598-a7c6-c3e3afbbdd5f tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:10.126152 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-31fa339f-a5da-4b75-a1ce-602ba8038535 req-a863a8fc-938e-4a8e-bf0b-e76f1905c4a6 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:10.127480 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-31fa339f-a5da-4b75-a1ce-602ba8038535 req-a863a8fc-938e-4a8e-bf0b-e76f1905c4a6 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:10.149785 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-31fa339f-a5da-4b75-a1ce-602ba8038535 req-a863a8fc-938e-4a8e-bf0b-e76f1905c4a6 service nova] Creating event network-vif-plugged:7cf5ea2d-375f-4590-af25-836bb895b886 for instance c8986b09-8342-4290-87be-22cece488c73 on nch1-master-1 Jan 15 21:00:10.155921 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-31fa339f-a5da-4b75-a1ce-602ba8038535 req-a863a8fc-938e-4a8e-bf0b-e76f1905c4a6 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075031 Jan 15 21:00:10.162499 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1750/3493] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:00:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:00:10.169818 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f03b7ce4-c7fc-4590-a491-6b8c9c410091 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:10.171306 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f03b7ce4-c7fc-4590-a491-6b8c9c410091 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:10.181040 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f03b7ce4-c7fc-4590-a491-6b8c9c410091 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:10.186575 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f03b7ce4-c7fc-4590-a491-6b8c9c410091 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:10.188627 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f03b7ce4-c7fc-4590-a491-6b8c9c410091 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:10.190212 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f03b7ce4-c7fc-4590-a491-6b8c9c410091 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:10.269924 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f03b7ce4-c7fc-4590-a491-6b8c9c410091 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 24586 microversion: 2.42 time: 0.105645 Jan 15 21:00:10.271624 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1751/3494] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:00:10 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 24586 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:00:10.277281 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e87d59a4-3aea-4562-b1dd-46e148ade840 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:10.278073 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e87d59a4-3aea-4562-b1dd-46e148ade840 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] [instance: 52a604e6-ab40-42a3-bb6b-6a65307d2bef] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:10.291849 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e87d59a4-3aea-4562-b1dd-46e148ade840 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:10.293205 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e87d59a4-3aea-4562-b1dd-46e148ade840 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:10.294613 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e87d59a4-3aea-4562-b1dd-46e148ade840 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:10.295218 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e87d59a4-3aea-4562-b1dd-46e148ade840 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:10.352299 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-2fc3583e-9f9a-4598-a7c6-c3e3afbbdd5f tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8f9c6ea7f6496792258d683640c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a75218d537c4d63874297261bec70ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:10.363755 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-2fc3583e-9f9a-4598-a7c6-c3e3afbbdd5f tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] 10.222.0.46 "GET /compute/v2.1/servers/c8986b09-8342-4290-87be-22cece488c73" status: 200 len: 1521 microversion: 2.1 time: 0.328456 Jan 15 21:00:10.375407 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1744/3495] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:00:10 2022] GET /compute/v2.1/servers/c8986b09-8342-4290-87be-22cece488c73 => generated 1521 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:00:10.375407 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-5a9d1398-9d72-4522-8ee6-12d9a982055c tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:10.375407 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-5a9d1398-9d72-4522-8ee6-12d9a982055c tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] [instance: 5e93486c-7c77-4855-85f4-2bc8bcf4832f] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:10.395592 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5a9d1398-9d72-4522-8ee6-12d9a982055c tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:10.396421 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5a9d1398-9d72-4522-8ee6-12d9a982055c tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:10.399409 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5a9d1398-9d72-4522-8ee6-12d9a982055c tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:10.400066 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5a9d1398-9d72-4522-8ee6-12d9a982055c tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:10.456806 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-5a9d1398-9d72-4522-8ee6-12d9a982055c tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] 10.222.0.46 "POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action" status: 200 len: 32650 microversion: 2.1 time: 0.089952 Jan 15 21:00:10.459471 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1745/3496] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:00:10 2022] POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action => generated 32650 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:00:10.466815 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f4a33ce1-d0e5-4f75-b18a-811c042fbcb2 tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:10.469233 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f4a33ce1-d0e5-4f75-b18a-811c042fbcb2 tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] [instance: eab97efd-0a8e-4f55-981e-818ed5583d2c] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:10.490905 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f4a33ce1-d0e5-4f75-b18a-811c042fbcb2 tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:10.491890 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f4a33ce1-d0e5-4f75-b18a-811c042fbcb2 tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:10.493960 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f4a33ce1-d0e5-4f75-b18a-811c042fbcb2 tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:10.494692 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f4a33ce1-d0e5-4f75-b18a-811c042fbcb2 tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:10.555478 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-e87d59a4-3aea-4562-b1dd-46e148ade840 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c07d13117a49b6b2042e182faaf9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca0988cda6548f89ee936bee64f56ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:10.567050 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e87d59a4-3aea-4562-b1dd-46e148ade840 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] 10.222.0.46 "GET /compute/v2.1/servers/52a604e6-ab40-42a3-bb6b-6a65307d2bef" status: 200 len: 1318 microversion: 2.1 time: 0.294283 Jan 15 21:00:10.567959 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1752/3497] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:00:10 2022] GET /compute/v2.1/servers/52a604e6-ab40-42a3-bb6b-6a65307d2bef => generated 1318 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:00:10.609946 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-f4a33ce1-d0e5-4f75-b18a-811c042fbcb2 tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb21ef67d1f64f73af586e35f1b772de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf19dbd41564d638af8f2e69883d2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:10.621169 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f4a33ce1-d0e5-4f75-b18a-811c042fbcb2 tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] 10.222.0.46 "GET /compute/v2.1/servers/eab97efd-0a8e-4f55-981e-818ed5583d2c" status: 200 len: 1276 microversion: 2.1 time: 0.159817 Jan 15 21:00:10.622002 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1746/3498] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:00:10 2022] GET /compute/v2.1/servers/eab97efd-0a8e-4f55-981e-818ed5583d2c => generated 1276 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:00:10.788484 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-dba90c71-89df-4592-bf25-79f2944f286c tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:10.789465 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-dba90c71-89df-4592-bf25-79f2944f286c tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:10.796578 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dba90c71-89df-4592-bf25-79f2944f286c tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:10.797336 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dba90c71-89df-4592-bf25-79f2944f286c tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:10.798672 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dba90c71-89df-4592-bf25-79f2944f286c tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:10.799482 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dba90c71-89df-4592-bf25-79f2944f286c tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:10.964377 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4b319d65-b2e9-46e1-91be-3f95476cd773 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:10.966449 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-4b319d65-b2e9-46e1-91be-3f95476cd773 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:10.977487 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4b319d65-b2e9-46e1-91be-3f95476cd773 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:10.978739 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4b319d65-b2e9-46e1-91be-3f95476cd773 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:10.979934 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4b319d65-b2e9-46e1-91be-3f95476cd773 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:10.980753 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4b319d65-b2e9-46e1-91be-3f95476cd773 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:10.983611 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-dba90c71-89df-4592-bf25-79f2944f286c tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:10.998446 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-dba90c71-89df-4592-bf25-79f2944f286c tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:11.000601 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-dba90c71-89df-4592-bf25-79f2944f286c tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:11.002334 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-dba90c71-89df-4592-bf25-79f2944f286c tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "GET /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220" status: 200 len: 1789 microversion: 2.32 time: 0.217719 Jan 15 21:00:11.004004 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1753/3499] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:00:10 2022] GET /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220 => generated 1789 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:00:11.066048 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-4b319d65-b2e9-46e1-91be-3f95476cd773 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:11.076371 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-4b319d65-b2e9-46e1-91be-3f95476cd773 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:11.078426 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-4b319d65-b2e9-46e1-91be-3f95476cd773 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:11.079666 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-4b319d65-b2e9-46e1-91be-3f95476cd773 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0" status: 200 len: 1337 microversion: 2.20 time: 0.122798 Jan 15 21:00:11.092214 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1747/3500] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:00:10 2022] GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0 => generated 1337 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:00:11.283674 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b5f06a4e-19eb-4057-8320-011332385f2e tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:11.284809 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b5f06a4e-19eb-4057-8320-011332385f2e tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:11.294086 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b5f06a4e-19eb-4057-8320-011332385f2e tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:11.294946 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b5f06a4e-19eb-4057-8320-011332385f2e tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:11.296213 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b5f06a4e-19eb-4057-8320-011332385f2e tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:11.296652 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b5f06a4e-19eb-4057-8320-011332385f2e tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:11.349672 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b5f06a4e-19eb-4057-8320-011332385f2e tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 24586 microversion: 2.42 time: 0.069845 Jan 15 21:00:11.351041 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1754/3501] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:00:11 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 24586 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:00:11.384974 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-81b617c9-0647-45db-bc04-e0618244e003 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:11.386018 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-81b617c9-0647-45db-bc04-e0618244e003 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: c8986b09-8342-4290-87be-22cece488c73] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:11.393034 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-81b617c9-0647-45db-bc04-e0618244e003 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:11.393603 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-81b617c9-0647-45db-bc04-e0618244e003 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:11.394677 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-81b617c9-0647-45db-bc04-e0618244e003 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:11.395417 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-81b617c9-0647-45db-bc04-e0618244e003 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:11.472636 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c79bea5f-ab00-4dff-8ba2-67fc7a3096ff tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:11.474910 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c79bea5f-ab00-4dff-8ba2-67fc7a3096ff tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] [instance: 5e93486c-7c77-4855-85f4-2bc8bcf4832f] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:11.486170 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c79bea5f-ab00-4dff-8ba2-67fc7a3096ff tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:11.488565 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c79bea5f-ab00-4dff-8ba2-67fc7a3096ff tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:11.490070 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c79bea5f-ab00-4dff-8ba2-67fc7a3096ff tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:11.492334 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c79bea5f-ab00-4dff-8ba2-67fc7a3096ff tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:11.550120 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c79bea5f-ab00-4dff-8ba2-67fc7a3096ff tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] 10.222.0.46 "POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action" status: 200 len: 32650 microversion: 2.1 time: 0.082099 Jan 15 21:00:11.551518 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1755/3502] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:00:11 2022] POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action => generated 32650 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 21:00:11.588669 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-fa09cc94-b53a-4e86-9d80-8af60fdd77d8 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:11.590867 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-fa09cc94-b53a-4e86-9d80-8af60fdd77d8 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] [instance: 52a604e6-ab40-42a3-bb6b-6a65307d2bef] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:11.615568 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fa09cc94-b53a-4e86-9d80-8af60fdd77d8 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:11.616178 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fa09cc94-b53a-4e86-9d80-8af60fdd77d8 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:11.616995 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fa09cc94-b53a-4e86-9d80-8af60fdd77d8 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:11.617540 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fa09cc94-b53a-4e86-9d80-8af60fdd77d8 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:11.646823 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-81b617c9-0647-45db-bc04-e0618244e003 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8f9c6ea7f6496792258d683640c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a75218d537c4d63874297261bec70ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:11.659559 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-81b617c9-0647-45db-bc04-e0618244e003 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] 10.222.0.46 "GET /compute/v2.1/servers/c8986b09-8342-4290-87be-22cece488c73" status: 200 len: 1521 microversion: 2.1 time: 0.279742 Jan 15 21:00:11.661014 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1748/3503] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:00:11 2022] GET /compute/v2.1/servers/c8986b09-8342-4290-87be-22cece488c73 => generated 1521 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:00:11.685325 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4666e909-ed2d-4e65-9d1d-dc7ce182e5d9 tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:11.687446 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-4666e909-ed2d-4e65-9d1d-dc7ce182e5d9 tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] [instance: eab97efd-0a8e-4f55-981e-818ed5583d2c] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:11.706567 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4666e909-ed2d-4e65-9d1d-dc7ce182e5d9 tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:11.707846 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4666e909-ed2d-4e65-9d1d-dc7ce182e5d9 tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:11.709278 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4666e909-ed2d-4e65-9d1d-dc7ce182e5d9 tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:11.710106 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4666e909-ed2d-4e65-9d1d-dc7ce182e5d9 tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:11.837946 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-4666e909-ed2d-4e65-9d1d-dc7ce182e5d9 tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb21ef67d1f64f73af586e35f1b772de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf19dbd41564d638af8f2e69883d2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:11.848224 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-4666e909-ed2d-4e65-9d1d-dc7ce182e5d9 tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] 10.222.0.46 "GET /compute/v2.1/servers/eab97efd-0a8e-4f55-981e-818ed5583d2c" status: 200 len: 1274 microversion: 2.1 time: 0.185338 Jan 15 21:00:11.851277 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1749/3504] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:00:11 2022] GET /compute/v2.1/servers/eab97efd-0a8e-4f55-981e-818ed5583d2c => generated 1274 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:00:11.893094 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-fa09cc94-b53a-4e86-9d80-8af60fdd77d8 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c07d13117a49b6b2042e182faaf9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca0988cda6548f89ee936bee64f56ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:11.902711 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-fa09cc94-b53a-4e86-9d80-8af60fdd77d8 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] 10.222.0.46 "GET /compute/v2.1/servers/52a604e6-ab40-42a3-bb6b-6a65307d2bef" status: 200 len: 1318 microversion: 2.1 time: 0.320527 Jan 15 21:00:11.904131 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1756/3505] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:00:11 2022] GET /compute/v2.1/servers/52a604e6-ab40-42a3-bb6b-6a65307d2bef => generated 1318 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:00:12.023531 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1e686ce8-1f44-4ae6-b128-c66dced6a7d2 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:12.024734 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-1e686ce8-1f44-4ae6-b128-c66dced6a7d2 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:12.033506 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1e686ce8-1f44-4ae6-b128-c66dced6a7d2 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:12.034001 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1e686ce8-1f44-4ae6-b128-c66dced6a7d2 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:12.035026 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1e686ce8-1f44-4ae6-b128-c66dced6a7d2 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:12.035793 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1e686ce8-1f44-4ae6-b128-c66dced6a7d2 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:12.100788 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-83982398-de49-4b0f-aca9-5893496f6346 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:12.101384 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-83982398-de49-4b0f-aca9-5893496f6346 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:12.108572 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-83982398-de49-4b0f-aca9-5893496f6346 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:12.109102 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-83982398-de49-4b0f-aca9-5893496f6346 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:12.109910 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-83982398-de49-4b0f-aca9-5893496f6346 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:12.110354 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-83982398-de49-4b0f-aca9-5893496f6346 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:12.317831 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-1e686ce8-1f44-4ae6-b128-c66dced6a7d2 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:12.335150 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-1e686ce8-1f44-4ae6-b128-c66dced6a7d2 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:12.337359 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-1e686ce8-1f44-4ae6-b128-c66dced6a7d2 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:12.338798 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-1e686ce8-1f44-4ae6-b128-c66dced6a7d2 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "GET /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220" status: 200 len: 1836 microversion: 2.32 time: 0.320499 Jan 15 21:00:12.339520 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1750/3506] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:00:12 2022] GET /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220 => generated 1836 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:00:12.343439 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-83982398-de49-4b0f-aca9-5893496f6346 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:12.354961 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-83982398-de49-4b0f-aca9-5893496f6346 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:12.357432 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-83982398-de49-4b0f-aca9-5893496f6346 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:12.358595 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-83982398-de49-4b0f-aca9-5893496f6346 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0" status: 200 len: 1405 microversion: 2.20 time: 0.262801 Jan 15 21:00:12.360901 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1757/3507] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:00:12 2022] GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0 => generated 1405 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 15 21:00:12.364487 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-25526865-2548-4928-a9fd-d5746eddd485 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:12.365592 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-25526865-2548-4928-a9fd-d5746eddd485 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:12.377714 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-25526865-2548-4928-a9fd-d5746eddd485 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:12.378176 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-25526865-2548-4928-a9fd-d5746eddd485 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:12.378994 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-25526865-2548-4928-a9fd-d5746eddd485 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:12.379439 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-25526865-2548-4928-a9fd-d5746eddd485 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:12.430789 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-25526865-2548-4928-a9fd-d5746eddd485 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 24586 microversion: 2.42 time: 0.071897 Jan 15 21:00:12.432137 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1751/3508] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:00:12 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 24586 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:00:12.445398 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-22ad7a37-a9a8-485b-b85c-0e1e284adc19 req-08535630-5d3b-4b4f-9d85-7739916ba483 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8aaf65b5-c92d-4c08-bba3-a5bef4ac3aa3", "tag": "36f3b8af-fe91-4ff7-8ba4-6576445d3e86"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:12.447382 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:00:12.447382 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:00:12.455522 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-22ad7a37-a9a8-485b-b85c-0e1e284adc19 req-08535630-5d3b-4b4f-9d85-7739916ba483 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:12.456565 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-22ad7a37-a9a8-485b-b85c-0e1e284adc19 req-08535630-5d3b-4b4f-9d85-7739916ba483 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:12.475306 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-22ad7a37-a9a8-485b-b85c-0e1e284adc19 req-08535630-5d3b-4b4f-9d85-7739916ba483 service nova] Creating event network-changed:36f3b8af-fe91-4ff7-8ba4-6576445d3e86 for instance 8aaf65b5-c92d-4c08-bba3-a5bef4ac3aa3 on nch2-master-1 Jan 15 21:00:12.480534 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-22ad7a37-a9a8-485b-b85c-0e1e284adc19 req-08535630-5d3b-4b4f-9d85-7739916ba483 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038904 Jan 15 21:00:12.481994 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1758/3509] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:00:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:00:12.563666 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-88054f11-4715-4cfa-888c-0345487bfa13 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:12.564982 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-88054f11-4715-4cfa-888c-0345487bfa13 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] [instance: 5e93486c-7c77-4855-85f4-2bc8bcf4832f] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:12.574885 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-88054f11-4715-4cfa-888c-0345487bfa13 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:12.575288 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-88054f11-4715-4cfa-888c-0345487bfa13 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:12.577336 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-88054f11-4715-4cfa-888c-0345487bfa13 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:12.578492 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-88054f11-4715-4cfa-888c-0345487bfa13 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:12.627620 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-88054f11-4715-4cfa-888c-0345487bfa13 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] 10.222.0.46 "POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action" status: 200 len: 32650 microversion: 2.1 time: 0.067928 Jan 15 21:00:12.629199 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1752/3510] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:00:12 2022] POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action => generated 32650 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:00:12.682521 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9eec71ae-e483-49f2-b8a3-00aecc76df76 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:12.683379 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-9eec71ae-e483-49f2-b8a3-00aecc76df76 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: c8986b09-8342-4290-87be-22cece488c73] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:12.690719 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9eec71ae-e483-49f2-b8a3-00aecc76df76 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:12.691191 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9eec71ae-e483-49f2-b8a3-00aecc76df76 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:12.692224 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9eec71ae-e483-49f2-b8a3-00aecc76df76 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:12.693266 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9eec71ae-e483-49f2-b8a3-00aecc76df76 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:12.861082 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-9eec71ae-e483-49f2-b8a3-00aecc76df76 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8f9c6ea7f6496792258d683640c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a75218d537c4d63874297261bec70ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:12.871105 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-6dcee617-d3a2-499a-a6ce-c86f97058e51 tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:12.872061 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-6dcee617-d3a2-499a-a6ce-c86f97058e51 tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] [instance: eab97efd-0a8e-4f55-981e-818ed5583d2c] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:12.873331 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-9eec71ae-e483-49f2-b8a3-00aecc76df76 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] 10.222.0.46 "GET /compute/v2.1/servers/c8986b09-8342-4290-87be-22cece488c73" status: 200 len: 1506 microversion: 2.1 time: 0.196337 Jan 15 21:00:12.874319 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1759/3511] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:00:12 2022] GET /compute/v2.1/servers/c8986b09-8342-4290-87be-22cece488c73 => generated 1506 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:00:12.892335 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6dcee617-d3a2-499a-a6ce-c86f97058e51 tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:12.892925 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6dcee617-d3a2-499a-a6ce-c86f97058e51 tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:12.893862 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6dcee617-d3a2-499a-a6ce-c86f97058e51 tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:12.894536 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6dcee617-d3a2-499a-a6ce-c86f97058e51 tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:12.910740 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-bfc37633-2fab-4ea5-a560-5511cff5ebc4 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:12.911776 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-bfc37633-2fab-4ea5-a560-5511cff5ebc4 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: c8986b09-8342-4290-87be-22cece488c73] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:12.923664 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bfc37633-2fab-4ea5-a560-5511cff5ebc4 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:12.924553 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bfc37633-2fab-4ea5-a560-5511cff5ebc4 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:12.925577 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bfc37633-2fab-4ea5-a560-5511cff5ebc4 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:12.926474 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bfc37633-2fab-4ea5-a560-5511cff5ebc4 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:12.966038 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-6dcee617-d3a2-499a-a6ce-c86f97058e51 tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb21ef67d1f64f73af586e35f1b772de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf19dbd41564d638af8f2e69883d2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:12.975758 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-6dcee617-d3a2-499a-a6ce-c86f97058e51 tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] 10.222.0.46 "GET /compute/v2.1/servers/eab97efd-0a8e-4f55-981e-818ed5583d2c" status: 200 len: 1274 microversion: 2.1 time: 0.111394 Jan 15 21:00:12.985304 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1753/3512] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:00:12 2022] GET /compute/v2.1/servers/eab97efd-0a8e-4f55-981e-818ed5583d2c => generated 1274 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:00:12.985304 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e3999d08-102a-4b19-8270-66a7b4a786af tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:12.985304 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e3999d08-102a-4b19-8270-66a7b4a786af tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] [instance: 52a604e6-ab40-42a3-bb6b-6a65307d2bef] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:12.991501 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e3999d08-102a-4b19-8270-66a7b4a786af tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:12.992024 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e3999d08-102a-4b19-8270-66a7b4a786af tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:12.992996 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e3999d08-102a-4b19-8270-66a7b4a786af tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:12.993658 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e3999d08-102a-4b19-8270-66a7b4a786af tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:13.159804 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-bfc37633-2fab-4ea5-a560-5511cff5ebc4 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8f9c6ea7f6496792258d683640c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a75218d537c4d63874297261bec70ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:13.171747 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-bfc37633-2fab-4ea5-a560-5511cff5ebc4 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] 10.222.0.46 "GET /compute/v2.1/servers/c8986b09-8342-4290-87be-22cece488c73" status: 200 len: 1506 microversion: 2.1 time: 0.271473 Jan 15 21:00:13.173265 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1760/3513] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:00:12 2022] GET /compute/v2.1/servers/c8986b09-8342-4290-87be-22cece488c73 => generated 1506 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:00:13.193655 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-39065897-1272-4219-86dc-d84535657252 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:13.194056 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-39065897-1272-4219-86dc-d84535657252 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: c8986b09-8342-4290-87be-22cece488c73] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:13.204177 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-39065897-1272-4219-86dc-d84535657252 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:13.210547 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-39065897-1272-4219-86dc-d84535657252 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:13.211977 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-39065897-1272-4219-86dc-d84535657252 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:13.212662 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-39065897-1272-4219-86dc-d84535657252 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:13.228995 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-e3999d08-102a-4b19-8270-66a7b4a786af tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c07d13117a49b6b2042e182faaf9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca0988cda6548f89ee936bee64f56ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:13.240633 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e3999d08-102a-4b19-8270-66a7b4a786af tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] 10.222.0.46 "GET /compute/v2.1/servers/52a604e6-ab40-42a3-bb6b-6a65307d2bef" status: 200 len: 1318 microversion: 2.1 time: 0.261497 Jan 15 21:00:13.240933 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1754/3514] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:00:12 2022] GET /compute/v2.1/servers/52a604e6-ab40-42a3-bb6b-6a65307d2bef => generated 1318 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:00:13.245297 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-39065897-1272-4219-86dc-d84535657252 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: c8986b09-8342-4290-87be-22cece488c73] Going to try to terminate instance {{(pid=129365) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 21:00:13.347476 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-39065897-1272-4219-86dc-d84535657252 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] 10.222.0.46 "DELETE /compute/v2.1/servers/c8986b09-8342-4290-87be-22cece488c73" status: 204 len: 0 microversion: 2.1 time: 0.160052 Jan 15 21:00:13.349270 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1761/3515] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 21:00:13 2022] DELETE /compute/v2.1/servers/c8986b09-8342-4290-87be-22cece488c73 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 21:00:13.369798 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-af776455-f9c4-42d6-9b96-418d9aadd269 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:13.373085 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-af776455-f9c4-42d6-9b96-418d9aadd269 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:13.379069 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-693ec5b6-c08a-4d8f-bf00-1a4b6f7ca689 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:13.380208 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-693ec5b6-c08a-4d8f-bf00-1a4b6f7ca689 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:13.382946 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-af776455-f9c4-42d6-9b96-418d9aadd269 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:13.383949 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-af776455-f9c4-42d6-9b96-418d9aadd269 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:13.384817 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-af776455-f9c4-42d6-9b96-418d9aadd269 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:13.385281 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-af776455-f9c4-42d6-9b96-418d9aadd269 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:13.388978 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-693ec5b6-c08a-4d8f-bf00-1a4b6f7ca689 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:13.389409 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-693ec5b6-c08a-4d8f-bf00-1a4b6f7ca689 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:13.390398 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-693ec5b6-c08a-4d8f-bf00-1a4b6f7ca689 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:13.390855 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-693ec5b6-c08a-4d8f-bf00-1a4b6f7ca689 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:13.717205 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-af776455-f9c4-42d6-9b96-418d9aadd269 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:13.717445 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-693ec5b6-c08a-4d8f-bf00-1a4b6f7ca689 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:13.731624 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-af776455-f9c4-42d6-9b96-418d9aadd269 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:13.732168 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-693ec5b6-c08a-4d8f-bf00-1a4b6f7ca689 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:13.733416 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-af776455-f9c4-42d6-9b96-418d9aadd269 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:13.734193 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-693ec5b6-c08a-4d8f-bf00-1a4b6f7ca689 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:13.735029 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-af776455-f9c4-42d6-9b96-418d9aadd269 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "GET /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220" status: 200 len: 1836 microversion: 2.32 time: 0.369650 Jan 15 21:00:13.735409 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-693ec5b6-c08a-4d8f-bf00-1a4b6f7ca689 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0" status: 200 len: 1405 microversion: 2.20 time: 0.361829 Jan 15 21:00:13.736191 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1755/3516] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:00:13 2022] GET /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220 => generated 1836 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:00:13.740741 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-cc25706a-d615-4e29-8721-add6e1592a88 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:13.741855 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-cc25706a-d615-4e29-8721-add6e1592a88 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:13.748811 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cc25706a-d615-4e29-8721-add6e1592a88 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:13.749768 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cc25706a-d615-4e29-8721-add6e1592a88 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:13.750843 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cc25706a-d615-4e29-8721-add6e1592a88 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:13.751430 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cc25706a-d615-4e29-8721-add6e1592a88 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:13.751975 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1762/3517] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:00:13 2022] GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0 => generated 1405 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 15 21:00:13.758996 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-914a418a-28a8-4ace-bb0d-fb3c4f563866 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-937453992", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "networks": [{"uuid": "e20dc768-2ef4-41d4-9bd1-8c6a11def8cb"}]}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:13.802957 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-cc25706a-d615-4e29-8721-add6e1592a88 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 24586 microversion: 2.42 time: 0.064814 Jan 15 21:00:13.807512 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1756/3518] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:00:13 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 24586 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:00:13.814769 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7660a4ae-1202-48f8-ad9e-9d701560583e tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:13.819821 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-7660a4ae-1202-48f8-ad9e-9d701560583e tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] [instance: 5e93486c-7c77-4855-85f4-2bc8bcf4832f] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:13.839363 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7660a4ae-1202-48f8-ad9e-9d701560583e tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:13.839819 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7660a4ae-1202-48f8-ad9e-9d701560583e tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:13.843310 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7660a4ae-1202-48f8-ad9e-9d701560583e tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:13.843757 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7660a4ae-1202-48f8-ad9e-9d701560583e tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:13.858499 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.network.neutron [None req-914a418a-28a8-4ace-bb0d-fb3c4f563866 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] validate_networks() for [('e20dc768-2ef4-41d4-9bd1-8c6a11def8cb', None, None, None, None, None)] {{(pid=129365) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 21:00:13.908582 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7660a4ae-1202-48f8-ad9e-9d701560583e tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] 10.222.0.46 "POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action" status: 200 len: 32650 microversion: 2.1 time: 0.098745 Jan 15 21:00:13.912750 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1757/3519] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:00:13 2022] POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action => generated 32650 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:00:13.998183 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7eba6ae7-b538-420e-9ef8-724abb3d89d5 tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:14.002472 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-7eba6ae7-b538-420e-9ef8-724abb3d89d5 tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] [instance: eab97efd-0a8e-4f55-981e-818ed5583d2c] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:14.031785 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7eba6ae7-b538-420e-9ef8-724abb3d89d5 tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:14.033733 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7eba6ae7-b538-420e-9ef8-724abb3d89d5 tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:14.036954 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7eba6ae7-b538-420e-9ef8-724abb3d89d5 tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:14.037810 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7eba6ae7-b538-420e-9ef8-724abb3d89d5 tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:14.244512 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-7eba6ae7-b538-420e-9ef8-724abb3d89d5 tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb21ef67d1f64f73af586e35f1b772de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf19dbd41564d638af8f2e69883d2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:14.287536 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7eba6ae7-b538-420e-9ef8-724abb3d89d5 tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] 10.222.0.46 "GET /compute/v2.1/servers/eab97efd-0a8e-4f55-981e-818ed5583d2c" status: 200 len: 1274 microversion: 2.1 time: 0.296619 Jan 15 21:00:14.303941 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1758/3520] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:00:13 2022] GET /compute/v2.1/servers/eab97efd-0a8e-4f55-981e-818ed5583d2c => generated 1274 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:00:14.319876 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1ee85000-0b76-48ee-bc74-67f45db15c2e tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:14.323291 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-1ee85000-0b76-48ee-bc74-67f45db15c2e tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] [instance: 52a604e6-ab40-42a3-bb6b-6a65307d2bef] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:14.351460 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1ee85000-0b76-48ee-bc74-67f45db15c2e tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:14.352014 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1ee85000-0b76-48ee-bc74-67f45db15c2e tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:14.354436 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1ee85000-0b76-48ee-bc74-67f45db15c2e tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:14.354873 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1ee85000-0b76-48ee-bc74-67f45db15c2e tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:14.783763 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-914a418a-28a8-4ace-bb0d-fb3c4f563866 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Flavor limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 21:00:14.784642 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-914a418a-28a8-4ace-bb0d-fb3c4f563866 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Image limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 21:00:14.785469 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-914a418a-28a8-4ace-bb0d-fb3c4f563866 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Flavor pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 21:00:14.788578 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-914a418a-28a8-4ace-bb0d-fb3c4f563866 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Image pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 21:00:14.789558 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-914a418a-28a8-4ace-bb0d-fb3c4f563866 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 21:00:14.815799 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-914a418a-28a8-4ace-bb0d-fb3c4f563866 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:14.823146 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-914a418a-28a8-4ace-bb0d-fb3c4f563866 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:14.827427 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-914a418a-28a8-4ace-bb0d-fb3c4f563866 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:14.829317 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-914a418a-28a8-4ace-bb0d-fb3c4f563866 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:14.884104 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-1ee85000-0b76-48ee-bc74-67f45db15c2e tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c07d13117a49b6b2042e182faaf9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca0988cda6548f89ee936bee64f56ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:14.899718 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-1ee85000-0b76-48ee-bc74-67f45db15c2e tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] 10.222.0.46 "GET /compute/v2.1/servers/52a604e6-ab40-42a3-bb6b-6a65307d2bef" status: 200 len: 1318 microversion: 2.1 time: 0.593731 Jan 15 21:00:14.901018 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1759/3521] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:00:14 2022] GET /compute/v2.1/servers/52a604e6-ab40-42a3-bb6b-6a65307d2bef => generated 1318 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:00:14.905889 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-bc4578d0-d347-458e-8c08-a08226b2491e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:14.909885 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-bc4578d0-d347-458e-8c08-a08226b2491e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:14.935820 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bc4578d0-d347-458e-8c08-a08226b2491e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:14.936812 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bc4578d0-d347-458e-8c08-a08226b2491e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:14.938976 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bc4578d0-d347-458e-8c08-a08226b2491e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:14.940670 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bc4578d0-d347-458e-8c08-a08226b2491e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:14.943795 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-914a418a-28a8-4ace-bb0d-fb3c4f563866 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Getting quotas for project 6a75218d537c4d63874297261bec70ad. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:00:14.965134 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-914a418a-28a8-4ace-bb0d-fb3c4f563866 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Getting quotas for user 8a8f9c6ea7f6496792258d683640c838 and project 6a75218d537c4d63874297261bec70ad. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:00:15.022758 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-914a418a-28a8-4ace-bb0d-fb3c4f563866 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Going to run 1 instances... {{(pid=129365) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 21:00:15.038606 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-914a418a-28a8-4ace-bb0d-fb3c4f563866 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: 4d836f07-866f-4e13-94ff-c4fe850e58d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129365) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 21:00:15.227795 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-914a418a-28a8-4ace-bb0d-fb3c4f563866 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.474537 Jan 15 21:00:15.236198 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1763/3522] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 21:00:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1479 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 21:00:15.246532 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-62c01628-5973-41ce-8ea3-e7e335b6b945 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:15.254615 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-62c01628-5973-41ce-8ea3-e7e335b6b945 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:15.284021 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-62c01628-5973-41ce-8ea3-e7e335b6b945 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:15.285337 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-62c01628-5973-41ce-8ea3-e7e335b6b945 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:15.291843 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-62c01628-5973-41ce-8ea3-e7e335b6b945 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:15.293175 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-62c01628-5973-41ce-8ea3-e7e335b6b945 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:15.588395 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-bc4578d0-d347-458e-8c08-a08226b2491e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:15.615882 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-bc4578d0-d347-458e-8c08-a08226b2491e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:15.621640 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-bc4578d0-d347-458e-8c08-a08226b2491e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:15.633767 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-bc4578d0-d347-458e-8c08-a08226b2491e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "GET /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220" status: 200 len: 1836 microversion: 2.32 time: 0.731273 Jan 15 21:00:15.645621 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1760/3523] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:00:14 2022] GET /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220 => generated 1836 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:00:15.664642 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-2964801c-61a3-4222-b797-ceeb493c80b5 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:15.665610 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-2964801c-61a3-4222-b797-ceeb493c80b5 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:15.704100 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2964801c-61a3-4222-b797-ceeb493c80b5 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:15.704515 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2964801c-61a3-4222-b797-ceeb493c80b5 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:15.705731 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2964801c-61a3-4222-b797-ceeb493c80b5 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:15.711086 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2964801c-61a3-4222-b797-ceeb493c80b5 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:15.825961 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-2964801c-61a3-4222-b797-ceeb493c80b5 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 24586 microversion: 2.42 time: 0.172839 Jan 15 21:00:15.827075 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1761/3524] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:00:15 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 24586 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:00:15.838156 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ebb28697-1491-42d2-a8ec-70eb86199af9 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:15.839655 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ebb28697-1491-42d2-a8ec-70eb86199af9 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] [instance: 5e93486c-7c77-4855-85f4-2bc8bcf4832f] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:15.852935 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ebb28697-1491-42d2-a8ec-70eb86199af9 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:15.853911 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ebb28697-1491-42d2-a8ec-70eb86199af9 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:15.862358 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ebb28697-1491-42d2-a8ec-70eb86199af9 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:15.863161 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ebb28697-1491-42d2-a8ec-70eb86199af9 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:15.946781 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ebb28697-1491-42d2-a8ec-70eb86199af9 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] 10.222.0.46 "POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action" status: 200 len: 32650 microversion: 2.1 time: 0.117684 Jan 15 21:00:15.951119 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1762/3525] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:00:15 2022] POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action => generated 32650 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:00:15.966630 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7bf005f1-ad09-4c23-8396-1fc8012d58d7 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:15.969823 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-7bf005f1-ad09-4c23-8396-1fc8012d58d7 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: 4d836f07-866f-4e13-94ff-c4fe850e58d3] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:15.988924 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-62c01628-5973-41ce-8ea3-e7e335b6b945 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:16.017346 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-62c01628-5973-41ce-8ea3-e7e335b6b945 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:16.026996 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-62c01628-5973-41ce-8ea3-e7e335b6b945 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:16.030862 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-62c01628-5973-41ce-8ea3-e7e335b6b945 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0" status: 200 len: 1405 microversion: 2.20 time: 0.796369 Jan 15 21:00:16.031482 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1764/3526] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:00:15 2022] GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0 => generated 1405 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:00:16.061603 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-aa63a5f3-4ca3-43ab-83f5-847ebd902d44 tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:16.062183 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-aa63a5f3-4ca3-43ab-83f5-847ebd902d44 tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] [instance: eab97efd-0a8e-4f55-981e-818ed5583d2c] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:16.088457 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-aa63a5f3-4ca3-43ab-83f5-847ebd902d44 tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:16.092365 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-aa63a5f3-4ca3-43ab-83f5-847ebd902d44 tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:16.093151 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-aa63a5f3-4ca3-43ab-83f5-847ebd902d44 tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:16.096589 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-aa63a5f3-4ca3-43ab-83f5-847ebd902d44 tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:16.135452 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-7bf005f1-ad09-4c23-8396-1fc8012d58d7 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8f9c6ea7f6496792258d683640c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a75218d537c4d63874297261bec70ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:16.142645 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7bf005f1-ad09-4c23-8396-1fc8012d58d7 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] 10.222.0.46 "GET /compute/v2.1/servers/4d836f07-866f-4e13-94ff-c4fe850e58d3" status: 200 len: 1217 microversion: 2.1 time: 0.188445 Jan 15 21:00:16.155472 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1763/3527] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:00:15 2022] GET /compute/v2.1/servers/4d836f07-866f-4e13-94ff-c4fe850e58d3 => generated 1217 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:00:16.166113 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-76ccd4e5-e111-4859-9e9c-836ed6a29aa1 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:16.167189 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-76ccd4e5-e111-4859-9e9c-836ed6a29aa1 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] [instance: 52a604e6-ab40-42a3-bb6b-6a65307d2bef] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:16.188956 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-76ccd4e5-e111-4859-9e9c-836ed6a29aa1 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:16.189579 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-76ccd4e5-e111-4859-9e9c-836ed6a29aa1 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:16.190371 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-76ccd4e5-e111-4859-9e9c-836ed6a29aa1 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:16.190841 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-76ccd4e5-e111-4859-9e9c-836ed6a29aa1 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:16.876101 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-76ccd4e5-e111-4859-9e9c-836ed6a29aa1 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c07d13117a49b6b2042e182faaf9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca0988cda6548f89ee936bee64f56ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:16.922596 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-76ccd4e5-e111-4859-9e9c-836ed6a29aa1 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] 10.222.0.46 "GET /compute/v2.1/servers/52a604e6-ab40-42a3-bb6b-6a65307d2bef" status: 200 len: 1318 microversion: 2.1 time: 0.765841 Jan 15 21:00:16.936788 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1764/3528] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:00:16 2022] GET /compute/v2.1/servers/52a604e6-ab40-42a3-bb6b-6a65307d2bef => generated 1318 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:00:16.945972 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-af7cf99e-2187-4cac-a567-97bdc2f2feca tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:16.946794 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-af7cf99e-2187-4cac-a567-97bdc2f2feca tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:16.946994 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-aa63a5f3-4ca3-43ab-83f5-847ebd902d44 tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb21ef67d1f64f73af586e35f1b772de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf19dbd41564d638af8f2e69883d2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:16.962892 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-af7cf99e-2187-4cac-a567-97bdc2f2feca tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:16.964129 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-af7cf99e-2187-4cac-a567-97bdc2f2feca tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:16.965646 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-aa63a5f3-4ca3-43ab-83f5-847ebd902d44 tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] 10.222.0.46 "GET /compute/v2.1/servers/eab97efd-0a8e-4f55-981e-818ed5583d2c" status: 200 len: 1316 microversion: 2.1 time: 0.924475 Jan 15 21:00:16.969012 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-af7cf99e-2187-4cac-a567-97bdc2f2feca tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:16.969765 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-af7cf99e-2187-4cac-a567-97bdc2f2feca tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:16.980876 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1765/3529] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:00:16 2022] GET /compute/v2.1/servers/eab97efd-0a8e-4f55-981e-818ed5583d2c => generated 1316 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:00:17.000101 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-099c58fb-9644-4179-9341-bd5bce7dac92 req-61dd893d-c0c4-4bdb-b155-658395df7d89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ac722a3-aadf-4791-b5b1-e5e5efebddc0", "tag": "6d958b2a-aaab-40bf-8bb7-ce4cd3fc57b5"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:17.011666 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:00:17.011666 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:00:17.062847 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-099c58fb-9644-4179-9341-bd5bce7dac92 req-61dd893d-c0c4-4bdb-b155-658395df7d89 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:17.063503 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-099c58fb-9644-4179-9341-bd5bce7dac92 req-61dd893d-c0c4-4bdb-b155-658395df7d89 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:17.104488 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-099c58fb-9644-4179-9341-bd5bce7dac92 req-61dd893d-c0c4-4bdb-b155-658395df7d89 service nova] Creating event network-changed:6d958b2a-aaab-40bf-8bb7-ce4cd3fc57b5 for instance 0ac722a3-aadf-4791-b5b1-e5e5efebddc0 on nch1-master-1 Jan 15 21:00:17.138844 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-099c58fb-9644-4179-9341-bd5bce7dac92 req-61dd893d-c0c4-4bdb-b155-658395df7d89 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.151772 Jan 15 21:00:17.141011 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1766/3530] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:00:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:00:17.169574 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e00421a1-fe2b-4b56-96db-2930211c1a8a tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:17.171397 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e00421a1-fe2b-4b56-96db-2930211c1a8a tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:17.191840 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e00421a1-fe2b-4b56-96db-2930211c1a8a tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:17.193191 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e00421a1-fe2b-4b56-96db-2930211c1a8a tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:17.213303 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e00421a1-fe2b-4b56-96db-2930211c1a8a tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:17.214182 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e00421a1-fe2b-4b56-96db-2930211c1a8a tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:17.403726 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e00421a1-fe2b-4b56-96db-2930211c1a8a tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 24586 microversion: 2.42 time: 0.260982 Jan 15 21:00:17.406198 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1767/3531] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:00:17 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 24586 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:00:17.414988 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-b107733b-33c2-4663-8aa1-6cf1308d76af req-b52bb1b5-30a9-4acb-a339-c6a4cc932c8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4504a13b-d10e-436a-a5ef-991829938dd9", "name": "network-vif-plugged", "status": "completed", "tag": "f7503e3b-a43e-4550-8109-a1fb1aa2d5f1"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:17.421014 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:00:17.421014 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:00:17.449204 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-b107733b-33c2-4663-8aa1-6cf1308d76af req-b52bb1b5-30a9-4acb-a339-c6a4cc932c8b service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:17.449944 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-b107733b-33c2-4663-8aa1-6cf1308d76af req-b52bb1b5-30a9-4acb-a339-c6a4cc932c8b service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:17.469672 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-b107733b-33c2-4663-8aa1-6cf1308d76af req-b52bb1b5-30a9-4acb-a339-c6a4cc932c8b service nova] Creating event network-vif-plugged:f7503e3b-a43e-4550-8109-a1fb1aa2d5f1 for instance 4504a13b-d10e-436a-a5ef-991829938dd9 on nch1-master-1 Jan 15 21:00:17.478843 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-b107733b-33c2-4663-8aa1-6cf1308d76af req-b52bb1b5-30a9-4acb-a339-c6a4cc932c8b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069829 Jan 15 21:00:17.479928 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1768/3532] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:00:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:00:17.488637 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-dc89daad-8e1b-4b9c-b3a2-f213e9f9eb9c tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:17.490513 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-dc89daad-8e1b-4b9c-b3a2-f213e9f9eb9c tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] [instance: 5e93486c-7c77-4855-85f4-2bc8bcf4832f] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:17.502410 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dc89daad-8e1b-4b9c-b3a2-f213e9f9eb9c tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:17.503127 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dc89daad-8e1b-4b9c-b3a2-f213e9f9eb9c tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:17.505984 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dc89daad-8e1b-4b9c-b3a2-f213e9f9eb9c tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:17.507260 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dc89daad-8e1b-4b9c-b3a2-f213e9f9eb9c tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:17.574494 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-dc89daad-8e1b-4b9c-b3a2-f213e9f9eb9c tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] 10.222.0.46 "POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action" status: 200 len: 32650 microversion: 2.1 time: 0.091756 Jan 15 21:00:17.576434 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1769/3533] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:00:17 2022] POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action => generated 32650 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:00:17.585901 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-695bf947-62e2-4f62-8631-985956d84b20 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:17.587581 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-695bf947-62e2-4f62-8631-985956d84b20 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:17.599451 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-695bf947-62e2-4f62-8631-985956d84b20 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:17.600278 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-695bf947-62e2-4f62-8631-985956d84b20 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:17.602572 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-695bf947-62e2-4f62-8631-985956d84b20 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:17.603319 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-695bf947-62e2-4f62-8631-985956d84b20 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:18.309943 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-695bf947-62e2-4f62-8631-985956d84b20 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:18.322832 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-695bf947-62e2-4f62-8631-985956d84b20 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:18.324685 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-695bf947-62e2-4f62-8631-985956d84b20 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:18.331969 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-695bf947-62e2-4f62-8631-985956d84b20 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0" status: 200 len: 1405 microversion: 2.20 time: 0.753934 Jan 15 21:00:18.332949 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1770/3534] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:00:17 2022] GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0 => generated 1405 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:00:18.344627 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-527ced0e-b070-4243-a796-f1726579e456 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:18.345532 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-527ced0e-b070-4243-a796-f1726579e456 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: 4d836f07-866f-4e13-94ff-c4fe850e58d3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:18.361083 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-527ced0e-b070-4243-a796-f1726579e456 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:18.361817 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-527ced0e-b070-4243-a796-f1726579e456 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:18.362808 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-527ced0e-b070-4243-a796-f1726579e456 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:18.363404 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-527ced0e-b070-4243-a796-f1726579e456 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:18.375292 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-af7cf99e-2187-4cac-a567-97bdc2f2feca tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:18.399774 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-af7cf99e-2187-4cac-a567-97bdc2f2feca tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:18.401492 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-af7cf99e-2187-4cac-a567-97bdc2f2feca tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:18.407141 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-af7cf99e-2187-4cac-a567-97bdc2f2feca tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "GET /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220" status: 200 len: 1836 microversion: 2.32 time: 1.474584 Jan 15 21:00:18.407804 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1765/3535] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:00:16 2022] GET /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220 => generated 1836 bytes in 1477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:00:18.433853 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-ca140e5f-b3e0-466b-b2af-51da492b8012 req-6eab6691-d892-42e3-a872-ae0a3b9d86f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8986b09-8342-4290-87be-22cece488c73", "name": "network-vif-deleted", "tag": "7cf5ea2d-375f-4590-af25-836bb895b886"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:18.468229 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:00:18.468229 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:00:18.487566 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-ca140e5f-b3e0-466b-b2af-51da492b8012 req-6eab6691-d892-42e3-a872-ae0a3b9d86f6 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:18.488464 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-ca140e5f-b3e0-466b-b2af-51da492b8012 req-6eab6691-d892-42e3-a872-ae0a3b9d86f6 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:18.510845 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-ca140e5f-b3e0-466b-b2af-51da492b8012 req-6eab6691-d892-42e3-a872-ae0a3b9d86f6 service nova] Creating event network-vif-deleted:7cf5ea2d-375f-4590-af25-836bb895b886 for instance c8986b09-8342-4290-87be-22cece488c73 on nch1-master-1 Jan 15 21:00:18.549132 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-ca140e5f-b3e0-466b-b2af-51da492b8012 req-6eab6691-d892-42e3-a872-ae0a3b9d86f6 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133472 Jan 15 21:00:18.556685 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-527ced0e-b070-4243-a796-f1726579e456 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8f9c6ea7f6496792258d683640c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a75218d537c4d63874297261bec70ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:18.560740 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1766/3536] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:00:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:00:18.567473 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-527ced0e-b070-4243-a796-f1726579e456 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] 10.222.0.46 "GET /compute/v2.1/servers/4d836f07-866f-4e13-94ff-c4fe850e58d3" status: 200 len: 1275 microversion: 2.1 time: 0.232547 Jan 15 21:00:18.575371 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e5942139-28a8-46ed-b917-8198b5bd618c tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:18.578029 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1771/3537] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:00:18 2022] GET /compute/v2.1/servers/4d836f07-866f-4e13-94ff-c4fe850e58d3 => generated 1275 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:00:18.579372 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e5942139-28a8-46ed-b917-8198b5bd618c tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] [instance: 52a604e6-ab40-42a3-bb6b-6a65307d2bef] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:18.587575 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a127fb1f-e508-4d07-a130-14a9dc2f71ea tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:18.588324 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a127fb1f-e508-4d07-a130-14a9dc2f71ea tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] [instance: eab97efd-0a8e-4f55-981e-818ed5583d2c] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:18.600817 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e5942139-28a8-46ed-b917-8198b5bd618c tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:18.601773 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e5942139-28a8-46ed-b917-8198b5bd618c tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:18.603090 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e5942139-28a8-46ed-b917-8198b5bd618c tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:18.604037 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e5942139-28a8-46ed-b917-8198b5bd618c tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:18.612387 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a127fb1f-e508-4d07-a130-14a9dc2f71ea tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:18.612830 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a127fb1f-e508-4d07-a130-14a9dc2f71ea tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:18.613668 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a127fb1f-e508-4d07-a130-14a9dc2f71ea tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:18.620086 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a127fb1f-e508-4d07-a130-14a9dc2f71ea tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:19.030246 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-a127fb1f-e508-4d07-a130-14a9dc2f71ea tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb21ef67d1f64f73af586e35f1b772de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf19dbd41564d638af8f2e69883d2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:19.041434 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a127fb1f-e508-4d07-a130-14a9dc2f71ea tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] 10.222.0.46 "GET /compute/v2.1/servers/eab97efd-0a8e-4f55-981e-818ed5583d2c" status: 200 len: 1316 microversion: 2.1 time: 0.461567 Jan 15 21:00:19.045179 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1772/3538] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:00:18 2022] GET /compute/v2.1/servers/eab97efd-0a8e-4f55-981e-818ed5583d2c => generated 1316 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:00:19.050362 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ea8c263e-f9ab-42b3-931f-91c7d5cc5257 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:19.064939 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ea8c263e-f9ab-42b3-931f-91c7d5cc5257 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:19.073114 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ea8c263e-f9ab-42b3-931f-91c7d5cc5257 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:19.073574 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ea8c263e-f9ab-42b3-931f-91c7d5cc5257 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:19.074491 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ea8c263e-f9ab-42b3-931f-91c7d5cc5257 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:19.075004 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ea8c263e-f9ab-42b3-931f-91c7d5cc5257 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:19.128761 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-e5942139-28a8-46ed-b917-8198b5bd618c tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c07d13117a49b6b2042e182faaf9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca0988cda6548f89ee936bee64f56ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:19.171283 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e5942139-28a8-46ed-b917-8198b5bd618c tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] 10.222.0.46 "GET /compute/v2.1/servers/52a604e6-ab40-42a3-bb6b-6a65307d2bef" status: 200 len: 1318 microversion: 2.1 time: 0.607802 Jan 15 21:00:19.177269 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1767/3539] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:00:18 2022] GET /compute/v2.1/servers/52a604e6-ab40-42a3-bb6b-6a65307d2bef => generated 1318 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:00:19.190028 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ea8c263e-f9ab-42b3-931f-91c7d5cc5257 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 24586 microversion: 2.42 time: 0.143317 Jan 15 21:00:19.190738 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1773/3540] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:00:19 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 24586 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:00:19.192863 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e71c84cc-53e7-45ed-8484-79046b3cd635 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:19.230740 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e71c84cc-53e7-45ed-8484-79046b3cd635 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] [instance: 5e93486c-7c77-4855-85f4-2bc8bcf4832f] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:19.262744 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e71c84cc-53e7-45ed-8484-79046b3cd635 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:19.264797 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e71c84cc-53e7-45ed-8484-79046b3cd635 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:19.266954 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e71c84cc-53e7-45ed-8484-79046b3cd635 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:19.268833 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e71c84cc-53e7-45ed-8484-79046b3cd635 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:19.311612 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-637fca12-2826-4a42-963c-b80dd733fc32 req-6db40d48-61ed-46ad-aadf-3182d2e63236 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "686aa731-082f-4584-8607-5a40f0d63220", "tag": "1c682467-fd92-4011-a1b3-79b4e61291df"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:19.313613 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:00:19.313613 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:00:19.337560 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-637fca12-2826-4a42-963c-b80dd733fc32 req-6db40d48-61ed-46ad-aadf-3182d2e63236 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:19.338391 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-637fca12-2826-4a42-963c-b80dd733fc32 req-6db40d48-61ed-46ad-aadf-3182d2e63236 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:19.351988 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e71c84cc-53e7-45ed-8484-79046b3cd635 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] 10.222.0.46 "POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action" status: 200 len: 32650 microversion: 2.1 time: 0.171454 Jan 15 21:00:19.353189 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1768/3541] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:00:19 2022] POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action => generated 32650 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:00:19.365770 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-de0a8910-5bfe-4a78-9d2f-027efdfc0c51 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:19.368788 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-de0a8910-5bfe-4a78-9d2f-027efdfc0c51 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:19.380714 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-de0a8910-5bfe-4a78-9d2f-027efdfc0c51 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:19.383755 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-637fca12-2826-4a42-963c-b80dd733fc32 req-6db40d48-61ed-46ad-aadf-3182d2e63236 service nova] Creating event network-changed:1c682467-fd92-4011-a1b3-79b4e61291df for instance 686aa731-082f-4584-8607-5a40f0d63220 on nch1-master-1 Jan 15 21:00:19.385802 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-de0a8910-5bfe-4a78-9d2f-027efdfc0c51 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:19.387445 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-de0a8910-5bfe-4a78-9d2f-027efdfc0c51 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:19.388861 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-de0a8910-5bfe-4a78-9d2f-027efdfc0c51 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:19.401467 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-637fca12-2826-4a42-963c-b80dd733fc32 req-6db40d48-61ed-46ad-aadf-3182d2e63236 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094442 Jan 15 21:00:19.403977 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1774/3542] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:00:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 21:00:19.440559 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-033080f3-a580-46a9-901d-aec3e3a04e47 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:19.442696 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-033080f3-a580-46a9-901d-aec3e3a04e47 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:19.459193 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-033080f3-a580-46a9-901d-aec3e3a04e47 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:19.459904 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-033080f3-a580-46a9-901d-aec3e3a04e47 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:19.461481 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-033080f3-a580-46a9-901d-aec3e3a04e47 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:19.463341 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-033080f3-a580-46a9-901d-aec3e3a04e47 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:20.425776 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-de0a8910-5bfe-4a78-9d2f-027efdfc0c51 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:20.441002 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-de0a8910-5bfe-4a78-9d2f-027efdfc0c51 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:20.443187 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-de0a8910-5bfe-4a78-9d2f-027efdfc0c51 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:20.445590 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-de0a8910-5bfe-4a78-9d2f-027efdfc0c51 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0" status: 200 len: 1405 microversion: 2.20 time: 1.085228 Jan 15 21:00:20.446499 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1769/3543] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:00:19 2022] GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0 => generated 1405 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:00:20.452457 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-8c12ecbb-c52b-4b67-b778-cbf32d6f2c1d req-0e247242-db78-4fe9-a7a5-f67a285c91b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52a604e6-ab40-42a3-bb6b-6a65307d2bef", "name": "network-vif-plugged", "status": "completed", "tag": "4ed568ab-4582-4d97-8362-7eee18a7cd9f"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:20.465274 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:00:20.465274 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:00:20.491130 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-033080f3-a580-46a9-901d-aec3e3a04e47 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:20.501260 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-8c12ecbb-c52b-4b67-b778-cbf32d6f2c1d req-0e247242-db78-4fe9-a7a5-f67a285c91b5 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:20.503549 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-8c12ecbb-c52b-4b67-b778-cbf32d6f2c1d req-0e247242-db78-4fe9-a7a5-f67a285c91b5 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:20.514759 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-033080f3-a580-46a9-901d-aec3e3a04e47 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:20.522612 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-033080f3-a580-46a9-901d-aec3e3a04e47 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:20.526596 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-033080f3-a580-46a9-901d-aec3e3a04e47 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "GET /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220" status: 200 len: 1857 microversion: 2.32 time: 1.092700 Jan 15 21:00:20.528999 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1775/3544] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:00:19 2022] GET /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220 => generated 1857 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:00:20.540776 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-8c12ecbb-c52b-4b67-b778-cbf32d6f2c1d req-0e247242-db78-4fe9-a7a5-f67a285c91b5 service nova] Creating event network-vif-plugged:4ed568ab-4582-4d97-8362-7eee18a7cd9f for instance 52a604e6-ab40-42a3-bb6b-6a65307d2bef on nch2-master-1 Jan 15 21:00:20.553742 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-062de415-f423-4fbb-8a08-2e5051042555 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:20.554467 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-062de415-f423-4fbb-8a08-2e5051042555 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: 4d836f07-866f-4e13-94ff-c4fe850e58d3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:20.556350 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-8c12ecbb-c52b-4b67-b778-cbf32d6f2c1d req-0e247242-db78-4fe9-a7a5-f67a285c91b5 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108268 Jan 15 21:00:20.568887 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1770/3545] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:00:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:00:20.578015 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0b5f7784-7c40-4511-a3d6-b6120c6c4bc9 tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:20.585519 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-062de415-f423-4fbb-8a08-2e5051042555 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:20.585981 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-062de415-f423-4fbb-8a08-2e5051042555 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:20.586796 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-062de415-f423-4fbb-8a08-2e5051042555 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:20.587236 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-062de415-f423-4fbb-8a08-2e5051042555 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:20.591882 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-0b5f7784-7c40-4511-a3d6-b6120c6c4bc9 tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] [instance: eab97efd-0a8e-4f55-981e-818ed5583d2c] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:20.608636 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0b5f7784-7c40-4511-a3d6-b6120c6c4bc9 tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:20.609836 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0b5f7784-7c40-4511-a3d6-b6120c6c4bc9 tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:20.610992 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0b5f7784-7c40-4511-a3d6-b6120c6c4bc9 tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:20.612035 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0b5f7784-7c40-4511-a3d6-b6120c6c4bc9 tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:21.015509 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-0b5f7784-7c40-4511-a3d6-b6120c6c4bc9 tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb21ef67d1f64f73af586e35f1b772de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf19dbd41564d638af8f2e69883d2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:21.024032 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0b5f7784-7c40-4511-a3d6-b6120c6c4bc9 tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] 10.222.0.46 "GET /compute/v2.1/servers/eab97efd-0a8e-4f55-981e-818ed5583d2c" status: 200 len: 1316 microversion: 2.1 time: 0.453386 Jan 15 21:00:21.038164 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-062de415-f423-4fbb-8a08-2e5051042555 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8f9c6ea7f6496792258d683640c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a75218d537c4d63874297261bec70ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:21.056459 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-062de415-f423-4fbb-8a08-2e5051042555 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] 10.222.0.46 "GET /compute/v2.1/servers/4d836f07-866f-4e13-94ff-c4fe850e58d3" status: 200 len: 1317 microversion: 2.1 time: 0.525482 Jan 15 21:00:21.057162 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1771/3546] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:00:20 2022] GET /compute/v2.1/servers/eab97efd-0a8e-4f55-981e-818ed5583d2c => generated 1316 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:00:21.061051 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1776/3547] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:00:20 2022] GET /compute/v2.1/servers/4d836f07-866f-4e13-94ff-c4fe850e58d3 => generated 1317 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:00:21.066352 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0f12938b-af38-4210-9d52-f977bbf3d634 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:21.067826 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-0f12938b-af38-4210-9d52-f977bbf3d634 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] [instance: 52a604e6-ab40-42a3-bb6b-6a65307d2bef] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:21.074344 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-07de8258-9401-4b8e-a958-3b5ec7679072 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:21.076733 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-07de8258-9401-4b8e-a958-3b5ec7679072 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:21.083504 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0f12938b-af38-4210-9d52-f977bbf3d634 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:21.083965 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0f12938b-af38-4210-9d52-f977bbf3d634 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:21.084825 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0f12938b-af38-4210-9d52-f977bbf3d634 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:21.085285 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0f12938b-af38-4210-9d52-f977bbf3d634 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:21.098205 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-07de8258-9401-4b8e-a958-3b5ec7679072 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:21.098644 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-07de8258-9401-4b8e-a958-3b5ec7679072 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:21.105283 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-07de8258-9401-4b8e-a958-3b5ec7679072 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:21.105752 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-07de8258-9401-4b8e-a958-3b5ec7679072 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:21.202202 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-07de8258-9401-4b8e-a958-3b5ec7679072 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 24586 microversion: 2.42 time: 0.139139 Jan 15 21:00:21.206601 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1777/3548] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:00:21 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 24586 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:00:21.208533 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-aaa63fc0-aff6-4d09-8447-23cbd72ba6d0 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:21.215960 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-aaa63fc0-aff6-4d09-8447-23cbd72ba6d0 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] [instance: 5e93486c-7c77-4855-85f4-2bc8bcf4832f] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:21.229210 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-aaa63fc0-aff6-4d09-8447-23cbd72ba6d0 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:21.229695 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-aaa63fc0-aff6-4d09-8447-23cbd72ba6d0 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:21.230522 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-aaa63fc0-aff6-4d09-8447-23cbd72ba6d0 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:21.230963 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-aaa63fc0-aff6-4d09-8447-23cbd72ba6d0 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:21.510057 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-aaa63fc0-aff6-4d09-8447-23cbd72ba6d0 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] 10.222.0.46 "POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action" status: 200 len: 32650 microversion: 2.1 time: 0.303731 Jan 15 21:00:21.510776 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1778/3549] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:00:21 2022] POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action => generated 32650 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:00:21.516360 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-0f12938b-af38-4210-9d52-f977bbf3d634 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c07d13117a49b6b2042e182faaf9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca0988cda6548f89ee936bee64f56ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:21.522267 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-d02ee3b7-031f-4e77-b0c9-d88cfdaf6507 req-05b3221b-d861-46cd-8411-50853c873cb5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eab97efd-0a8e-4f55-981e-818ed5583d2c", "tag": "32879371-6c0b-43fe-b550-fd4eca872af0"}, {"name": "network-changed", "server_uuid": "686aa731-082f-4584-8607-5a40f0d63220", "tag": "d36cd432-9054-48c0-a218-c6094ff964e7"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:21.523957 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:00:21.523957 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:00:21.524775 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0f12938b-af38-4210-9d52-f977bbf3d634 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] 10.222.0.46 "GET /compute/v2.1/servers/52a604e6-ab40-42a3-bb6b-6a65307d2bef" status: 200 len: 1318 microversion: 2.1 time: 0.466292 Jan 15 21:00:21.539561 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1772/3550] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:00:21 2022] GET /compute/v2.1/servers/52a604e6-ab40-42a3-bb6b-6a65307d2bef => generated 1318 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:00:21.545485 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e8164fb9-bd6b-4148-a787-34d0464e79d4 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:21.546441 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e8164fb9-bd6b-4148-a787-34d0464e79d4 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:21.550484 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-d02ee3b7-031f-4e77-b0c9-d88cfdaf6507 req-05b3221b-d861-46cd-8411-50853c873cb5 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:21.553302 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-d02ee3b7-031f-4e77-b0c9-d88cfdaf6507 req-05b3221b-d861-46cd-8411-50853c873cb5 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:21.554704 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e8164fb9-bd6b-4148-a787-34d0464e79d4 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:21.555376 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e8164fb9-bd6b-4148-a787-34d0464e79d4 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:21.556549 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e8164fb9-bd6b-4148-a787-34d0464e79d4 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:21.557244 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e8164fb9-bd6b-4148-a787-34d0464e79d4 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:21.579894 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-d02ee3b7-031f-4e77-b0c9-d88cfdaf6507 req-05b3221b-d861-46cd-8411-50853c873cb5 service nova] Creating event network-changed:32879371-6c0b-43fe-b550-fd4eca872af0 for instance eab97efd-0a8e-4f55-981e-818ed5583d2c on nch2-master-1 Jan 15 21:00:21.586444 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-d02ee3b7-031f-4e77-b0c9-d88cfdaf6507 req-05b3221b-d861-46cd-8411-50853c873cb5 service nova] Creating event network-changed:d36cd432-9054-48c0-a218-c6094ff964e7 for instance 686aa731-082f-4584-8607-5a40f0d63220 on nch1-master-1 Jan 15 21:00:21.603642 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-d02ee3b7-031f-4e77-b0c9-d88cfdaf6507 req-05b3221b-d861-46cd-8411-50853c873cb5 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.091353 Jan 15 21:00:21.604266 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1779/3551] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:00:21 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:00:21.610815 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-89dc8357-4db4-497f-89c3-b3e64c341c5e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:21.611870 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-89dc8357-4db4-497f-89c3-b3e64c341c5e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:21.640775 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-89dc8357-4db4-497f-89c3-b3e64c341c5e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:21.641674 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-89dc8357-4db4-497f-89c3-b3e64c341c5e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:21.643864 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-89dc8357-4db4-497f-89c3-b3e64c341c5e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:21.647304 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-89dc8357-4db4-497f-89c3-b3e64c341c5e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:22.352086 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-89dc8357-4db4-497f-89c3-b3e64c341c5e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:22.388140 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-89dc8357-4db4-497f-89c3-b3e64c341c5e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:22.398193 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-89dc8357-4db4-497f-89c3-b3e64c341c5e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:22.409735 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-89dc8357-4db4-497f-89c3-b3e64c341c5e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "GET /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220" status: 200 len: 1857 microversion: 2.32 time: 0.800365 Jan 15 21:00:22.410718 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1780/3552] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:00:21 2022] GET /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220 => generated 1857 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:00:22.421618 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2b521b74-3134-4b65-9f0f-f05d39361d6f tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:22.426906 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-2b521b74-3134-4b65-9f0f-f05d39361d6f tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] [instance: eab97efd-0a8e-4f55-981e-818ed5583d2c] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:22.453437 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2b521b74-3134-4b65-9f0f-f05d39361d6f tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:22.463082 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-e8164fb9-bd6b-4148-a787-34d0464e79d4 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:22.482153 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2b521b74-3134-4b65-9f0f-f05d39361d6f tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:22.487039 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2b521b74-3134-4b65-9f0f-f05d39361d6f tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:22.494851 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2b521b74-3134-4b65-9f0f-f05d39361d6f tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:22.500822 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-e8164fb9-bd6b-4148-a787-34d0464e79d4 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:22.525211 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-e8164fb9-bd6b-4148-a787-34d0464e79d4 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:22.536390 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e8164fb9-bd6b-4148-a787-34d0464e79d4 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0" status: 200 len: 1405 microversion: 2.20 time: 0.994955 Jan 15 21:00:22.539871 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1773/3553] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:00:21 2022] GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0 => generated 1405 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:00:22.556619 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0be12b61-64e2-4888-8820-72792097eb29 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:22.568107 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-0be12b61-64e2-4888-8820-72792097eb29 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: 4d836f07-866f-4e13-94ff-c4fe850e58d3] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:22.602143 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0be12b61-64e2-4888-8820-72792097eb29 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:22.603163 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0be12b61-64e2-4888-8820-72792097eb29 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:22.612991 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0be12b61-64e2-4888-8820-72792097eb29 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:22.616949 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0be12b61-64e2-4888-8820-72792097eb29 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:23.058927 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-2b521b74-3134-4b65-9f0f-f05d39361d6f tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb21ef67d1f64f73af586e35f1b772de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf19dbd41564d638af8f2e69883d2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:23.136519 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2b521b74-3134-4b65-9f0f-f05d39361d6f tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] 10.222.0.46 "GET /compute/v2.1/servers/eab97efd-0a8e-4f55-981e-818ed5583d2c" status: 200 len: 1316 microversion: 2.1 time: 0.718121 Jan 15 21:00:23.138430 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1781/3554] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:00:22 2022] GET /compute/v2.1/servers/eab97efd-0a8e-4f55-981e-818ed5583d2c => generated 1316 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:00:23.163917 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-005a9c06-7165-4578-8266-42b5bbebbe8e tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:23.168454 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-005a9c06-7165-4578-8266-42b5bbebbe8e tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:23.222936 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-005a9c06-7165-4578-8266-42b5bbebbe8e tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:23.229077 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-005a9c06-7165-4578-8266-42b5bbebbe8e tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:23.231906 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-005a9c06-7165-4578-8266-42b5bbebbe8e tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:23.234630 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-005a9c06-7165-4578-8266-42b5bbebbe8e tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:23.374196 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-005a9c06-7165-4578-8266-42b5bbebbe8e tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 24586 microversion: 2.42 time: 0.229124 Jan 15 21:00:23.380464 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1782/3555] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:00:23 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 24586 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:00:23.395464 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-18612f27-6ea9-4627-9b3f-bcd255b3fffb tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:23.396889 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-18612f27-6ea9-4627-9b3f-bcd255b3fffb tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] [instance: 5e93486c-7c77-4855-85f4-2bc8bcf4832f] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:23.438978 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-18612f27-6ea9-4627-9b3f-bcd255b3fffb tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:23.439478 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-18612f27-6ea9-4627-9b3f-bcd255b3fffb tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:23.454801 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-18612f27-6ea9-4627-9b3f-bcd255b3fffb tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:23.455591 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-18612f27-6ea9-4627-9b3f-bcd255b3fffb tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:23.506293 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-0be12b61-64e2-4888-8820-72792097eb29 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8f9c6ea7f6496792258d683640c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a75218d537c4d63874297261bec70ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:23.521712 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0be12b61-64e2-4888-8820-72792097eb29 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] 10.222.0.46 "GET /compute/v2.1/servers/4d836f07-866f-4e13-94ff-c4fe850e58d3" status: 200 len: 1317 microversion: 2.1 time: 0.975978 Jan 15 21:00:23.538086 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1774/3556] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:00:22 2022] GET /compute/v2.1/servers/4d836f07-866f-4e13-94ff-c4fe850e58d3 => generated 1317 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:00:23.545466 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4ea428e8-aab0-45f2-92bb-a2ad76e6b802 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:23.546368 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-4ea428e8-aab0-45f2-92bb-a2ad76e6b802 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] [instance: 52a604e6-ab40-42a3-bb6b-6a65307d2bef] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:23.555987 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4ea428e8-aab0-45f2-92bb-a2ad76e6b802 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:23.556718 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4ea428e8-aab0-45f2-92bb-a2ad76e6b802 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:23.557148 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-18612f27-6ea9-4627-9b3f-bcd255b3fffb tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] 10.222.0.46 "POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action" status: 200 len: 32650 microversion: 2.1 time: 0.174705 Jan 15 21:00:23.558376 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4ea428e8-aab0-45f2-92bb-a2ad76e6b802 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:23.559205 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4ea428e8-aab0-45f2-92bb-a2ad76e6b802 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:23.574870 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1783/3557] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:00:23 2022] POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action => generated 32650 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:00:23.602796 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-5c4eb9e4-0d0d-4188-b1b0-805dd193b0d3 req-c5bca0c6-6d99-45a9-9ec4-4814ef3a4f7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8aaf65b5-c92d-4c08-bba3-a5bef4ac3aa3", "name": "network-vif-plugged", "status": "completed", "tag": "36f3b8af-fe91-4ff7-8ba4-6576445d3e86"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:23.607692 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:00:23.607692 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:00:23.633686 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-5c4eb9e4-0d0d-4188-b1b0-805dd193b0d3 req-c5bca0c6-6d99-45a9-9ec4-4814ef3a4f7f service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:23.633902 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-5c4eb9e4-0d0d-4188-b1b0-805dd193b0d3 req-c5bca0c6-6d99-45a9-9ec4-4814ef3a4f7f service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:23.663291 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-5c4eb9e4-0d0d-4188-b1b0-805dd193b0d3 req-c5bca0c6-6d99-45a9-9ec4-4814ef3a4f7f service nova] Creating event network-vif-plugged:36f3b8af-fe91-4ff7-8ba4-6576445d3e86 for instance 8aaf65b5-c92d-4c08-bba3-a5bef4ac3aa3 on nch2-master-1 Jan 15 21:00:23.670415 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-5c4eb9e4-0d0d-4188-b1b0-805dd193b0d3 req-c5bca0c6-6d99-45a9-9ec4-4814ef3a4f7f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093055 Jan 15 21:00:23.671733 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1784/3558] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:00:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:00:23.677613 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d0195f92-c2de-46f4-ba28-ed51ea990a94 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:23.679014 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d0195f92-c2de-46f4-ba28-ed51ea990a94 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:23.693461 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d0195f92-c2de-46f4-ba28-ed51ea990a94 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:23.697683 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d0195f92-c2de-46f4-ba28-ed51ea990a94 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:23.698909 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d0195f92-c2de-46f4-ba28-ed51ea990a94 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:23.700711 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d0195f92-c2de-46f4-ba28-ed51ea990a94 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:24.501832 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-d0195f92-c2de-46f4-ba28-ed51ea990a94 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:24.515626 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-d0195f92-c2de-46f4-ba28-ed51ea990a94 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:24.523787 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-d0195f92-c2de-46f4-ba28-ed51ea990a94 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:24.527643 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d0195f92-c2de-46f4-ba28-ed51ea990a94 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "GET /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220" status: 200 len: 1878 microversion: 2.32 time: 0.855090 Jan 15 21:00:24.528555 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1785/3559] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:00:23 2022] GET /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220 => generated 1878 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:00:24.541464 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-11778e9b-8b7d-4fdb-8e3d-24c0bd996947 req-43cb913f-ce3f-43e7-a38d-2aeb0e47cea5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d836f07-866f-4e13-94ff-c4fe850e58d3", "tag": "4949ae19-44ff-4865-9776-96c470821b54"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:24.543284 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:00:24.543284 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:00:24.573729 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-11778e9b-8b7d-4fdb-8e3d-24c0bd996947 req-43cb913f-ce3f-43e7-a38d-2aeb0e47cea5 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:24.574212 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-11778e9b-8b7d-4fdb-8e3d-24c0bd996947 req-43cb913f-ce3f-43e7-a38d-2aeb0e47cea5 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:24.587701 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-11778e9b-8b7d-4fdb-8e3d-24c0bd996947 req-43cb913f-ce3f-43e7-a38d-2aeb0e47cea5 service nova] Creating event network-changed:4949ae19-44ff-4865-9776-96c470821b54 for instance 4d836f07-866f-4e13-94ff-c4fe850e58d3 on nch1-master-1 Jan 15 21:00:24.597154 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-11778e9b-8b7d-4fdb-8e3d-24c0bd996947 req-43cb913f-ce3f-43e7-a38d-2aeb0e47cea5 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066240 Jan 15 21:00:24.599431 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1786/3560] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:00:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:00:24.606767 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8dc22551-170e-40f0-bb88-4e3d543912e2 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:24.608529 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-8dc22551-170e-40f0-bb88-4e3d543912e2 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:24.620743 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8dc22551-170e-40f0-bb88-4e3d543912e2 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:24.621049 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-4ea428e8-aab0-45f2-92bb-a2ad76e6b802 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c07d13117a49b6b2042e182faaf9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca0988cda6548f89ee936bee64f56ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:24.622040 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8dc22551-170e-40f0-bb88-4e3d543912e2 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:24.623191 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8dc22551-170e-40f0-bb88-4e3d543912e2 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:24.623848 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8dc22551-170e-40f0-bb88-4e3d543912e2 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:24.635034 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-4ea428e8-aab0-45f2-92bb-a2ad76e6b802 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] 10.222.0.46 "GET /compute/v2.1/servers/52a604e6-ab40-42a3-bb6b-6a65307d2bef" status: 200 len: 1506 microversion: 2.1 time: 1.094937 Jan 15 21:00:24.638037 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1775/3561] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:00:23 2022] GET /compute/v2.1/servers/52a604e6-ab40-42a3-bb6b-6a65307d2bef => generated 1506 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:00:24.657738 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-c20edfa7-d221-4d23-89af-5a88a880ee98 req-443ef549-8f28-4fed-bc2b-327eb0bfb975 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "686aa731-082f-4584-8607-5a40f0d63220", "tag": "d8af72f0-b932-47f5-b578-70fdd429d39b"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:24.675615 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:00:24.675615 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:00:24.690588 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-c20edfa7-d221-4d23-89af-5a88a880ee98 req-443ef549-8f28-4fed-bc2b-327eb0bfb975 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:24.691713 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-c20edfa7-d221-4d23-89af-5a88a880ee98 req-443ef549-8f28-4fed-bc2b-327eb0bfb975 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:24.712880 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-c20edfa7-d221-4d23-89af-5a88a880ee98 req-443ef549-8f28-4fed-bc2b-327eb0bfb975 service nova] Creating event network-changed:d8af72f0-b932-47f5-b578-70fdd429d39b for instance 686aa731-082f-4584-8607-5a40f0d63220 on nch1-master-1 Jan 15 21:00:24.721910 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-c20edfa7-d221-4d23-89af-5a88a880ee98 req-443ef549-8f28-4fed-bc2b-327eb0bfb975 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080205 Jan 15 21:00:24.724648 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1776/3562] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:00:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:00:24.736055 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-04db12d1-271f-4419-a61d-0cc2f5bf6dea tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:24.737427 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-04db12d1-271f-4419-a61d-0cc2f5bf6dea tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] [instance: eab97efd-0a8e-4f55-981e-818ed5583d2c] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:24.750517 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-04db12d1-271f-4419-a61d-0cc2f5bf6dea tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:24.751342 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-04db12d1-271f-4419-a61d-0cc2f5bf6dea tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:24.752913 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-04db12d1-271f-4419-a61d-0cc2f5bf6dea tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:24.753855 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-04db12d1-271f-4419-a61d-0cc2f5bf6dea tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:25.092261 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-8dc22551-170e-40f0-bb88-4e3d543912e2 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:25.106867 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-8dc22551-170e-40f0-bb88-4e3d543912e2 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:25.112187 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-8dc22551-170e-40f0-bb88-4e3d543912e2 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:25.113454 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-8dc22551-170e-40f0-bb88-4e3d543912e2 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0" status: 200 len: 1405 microversion: 2.20 time: 0.512806 Jan 15 21:00:25.134378 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1787/3563] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:00:24 2022] GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0 => generated 1405 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:00:25.144444 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a742e843-1634-4e56-af55-a98e2b925bb1 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:25.149481 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a742e843-1634-4e56-af55-a98e2b925bb1 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:25.163953 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a742e843-1634-4e56-af55-a98e2b925bb1 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:25.166885 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a742e843-1634-4e56-af55-a98e2b925bb1 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:25.168607 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a742e843-1634-4e56-af55-a98e2b925bb1 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:25.169562 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a742e843-1634-4e56-af55-a98e2b925bb1 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:25.241443 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a742e843-1634-4e56-af55-a98e2b925bb1 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 24586 microversion: 2.42 time: 0.104675 Jan 15 21:00:25.242451 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1788/3564] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:00:25 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 24586 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:00:25.251521 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ecdf7faa-3dac-4f65-ad0a-5ee71a252959 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:25.252809 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ecdf7faa-3dac-4f65-ad0a-5ee71a252959 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: 4d836f07-866f-4e13-94ff-c4fe850e58d3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:25.264100 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ecdf7faa-3dac-4f65-ad0a-5ee71a252959 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:25.265060 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ecdf7faa-3dac-4f65-ad0a-5ee71a252959 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:25.266174 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ecdf7faa-3dac-4f65-ad0a-5ee71a252959 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:25.266934 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ecdf7faa-3dac-4f65-ad0a-5ee71a252959 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:25.500215 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-04db12d1-271f-4419-a61d-0cc2f5bf6dea tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb21ef67d1f64f73af586e35f1b772de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf19dbd41564d638af8f2e69883d2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:25.509640 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-04db12d1-271f-4419-a61d-0cc2f5bf6dea tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] 10.222.0.46 "GET /compute/v2.1/servers/eab97efd-0a8e-4f55-981e-818ed5583d2c" status: 200 len: 1316 microversion: 2.1 time: 0.782264 Jan 15 21:00:25.511411 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1777/3565] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:00:24 2022] GET /compute/v2.1/servers/eab97efd-0a8e-4f55-981e-818ed5583d2c => generated 1316 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:00:25.517614 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-701a9fba-5671-4c41-bb53-66c2e22f8b41 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:25.518821 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-701a9fba-5671-4c41-bb53-66c2e22f8b41 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] [instance: 5e93486c-7c77-4855-85f4-2bc8bcf4832f] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:25.528049 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-701a9fba-5671-4c41-bb53-66c2e22f8b41 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:25.529364 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-701a9fba-5671-4c41-bb53-66c2e22f8b41 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:25.530600 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-701a9fba-5671-4c41-bb53-66c2e22f8b41 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:25.531257 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-701a9fba-5671-4c41-bb53-66c2e22f8b41 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:25.612506 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-701a9fba-5671-4c41-bb53-66c2e22f8b41 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] 10.222.0.46 "POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action" status: 200 len: 32650 microversion: 2.1 time: 0.095481 Jan 15 21:00:25.617535 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1778/3566] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:00:25 2022] POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action => generated 32650 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:00:25.638718 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7b2979b3-dda2-43e6-abf4-cc96679663fe tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:25.644284 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-7b2979b3-dda2-43e6-abf4-cc96679663fe tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] [instance: 8aaf65b5-c92d-4c08-bba3-a5bef4ac3aa3] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:25.660911 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7b2979b3-dda2-43e6-abf4-cc96679663fe tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:25.663809 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7b2979b3-dda2-43e6-abf4-cc96679663fe tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:25.668165 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7b2979b3-dda2-43e6-abf4-cc96679663fe tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:25.668884 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7b2979b3-dda2-43e6-abf4-cc96679663fe tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:25.725957 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-ecdf7faa-3dac-4f65-ad0a-5ee71a252959 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8f9c6ea7f6496792258d683640c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a75218d537c4d63874297261bec70ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:25.741292 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ecdf7faa-3dac-4f65-ad0a-5ee71a252959 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] 10.222.0.46 "GET /compute/v2.1/servers/4d836f07-866f-4e13-94ff-c4fe850e58d3" status: 200 len: 1317 microversion: 2.1 time: 0.496872 Jan 15 21:00:25.744246 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1789/3567] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:00:25 2022] GET /compute/v2.1/servers/4d836f07-866f-4e13-94ff-c4fe850e58d3 => generated 1317 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:00:25.757426 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-72639c79-6878-4c2a-8ac6-0b42849dc3c7 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:25.758275 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-72639c79-6878-4c2a-8ac6-0b42849dc3c7 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:25.772971 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-72639c79-6878-4c2a-8ac6-0b42849dc3c7 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:25.773733 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-72639c79-6878-4c2a-8ac6-0b42849dc3c7 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:25.774762 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-72639c79-6878-4c2a-8ac6-0b42849dc3c7 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:25.775472 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-72639c79-6878-4c2a-8ac6-0b42849dc3c7 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:26.148562 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-7b2979b3-dda2-43e6-abf4-cc96679663fe tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c07d13117a49b6b2042e182faaf9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca0988cda6548f89ee936bee64f56ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:26.171142 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7b2979b3-dda2-43e6-abf4-cc96679663fe tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] 10.222.0.46 "GET /compute/v2.1/servers/8aaf65b5-c92d-4c08-bba3-a5bef4ac3aa3" status: 200 len: 1318 microversion: 2.1 time: 0.546420 Jan 15 21:00:26.174806 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1779/3568] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:00:25 2022] GET /compute/v2.1/servers/8aaf65b5-c92d-4c08-bba3-a5bef4ac3aa3 => generated 1318 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:00:26.202196 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-caf23ab3-8724-413f-990b-6ff5e9cede92 req-b8c0b545-f66d-4abc-a233-67fb2dc447d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ac722a3-aadf-4791-b5b1-e5e5efebddc0", "name": "network-vif-plugged", "status": "completed", "tag": "6d958b2a-aaab-40bf-8bb7-ce4cd3fc57b5"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:26.210083 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:00:26.210083 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:00:26.236115 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-caf23ab3-8724-413f-990b-6ff5e9cede92 req-b8c0b545-f66d-4abc-a233-67fb2dc447d8 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:26.251722 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-caf23ab3-8724-413f-990b-6ff5e9cede92 req-b8c0b545-f66d-4abc-a233-67fb2dc447d8 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:26.297876 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-caf23ab3-8724-413f-990b-6ff5e9cede92 req-b8c0b545-f66d-4abc-a233-67fb2dc447d8 service nova] Creating event network-vif-plugged:6d958b2a-aaab-40bf-8bb7-ce4cd3fc57b5 for instance 0ac722a3-aadf-4791-b5b1-e5e5efebddc0 on nch1-master-1 Jan 15 21:00:26.310996 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-72639c79-6878-4c2a-8ac6-0b42849dc3c7 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:26.317529 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-caf23ab3-8724-413f-990b-6ff5e9cede92 req-b8c0b545-f66d-4abc-a233-67fb2dc447d8 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138512 Jan 15 21:00:26.319820 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1780/3569] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:00:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:00:26.328742 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-72639c79-6878-4c2a-8ac6-0b42849dc3c7 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:26.343562 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-53d7200c-01ad-4aa1-b2b1-e57f5416fe37 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:26.344340 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-53d7200c-01ad-4aa1-b2b1-e57f5416fe37 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:26.354331 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-72639c79-6878-4c2a-8ac6-0b42849dc3c7 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:26.361478 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-72639c79-6878-4c2a-8ac6-0b42849dc3c7 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "GET /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220" status: 200 len: 1878 microversion: 2.32 time: 0.603089 Jan 15 21:00:26.362888 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1790/3570] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:00:25 2022] GET /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220 => generated 1878 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:00:26.370068 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-31be03dc-c154-41a5-9703-b3faa0bbcc62 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:26.375599 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-31be03dc-c154-41a5-9703-b3faa0bbcc62 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:26.392139 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-53d7200c-01ad-4aa1-b2b1-e57f5416fe37 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:26.395613 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-53d7200c-01ad-4aa1-b2b1-e57f5416fe37 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.032s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:26.397538 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-31be03dc-c154-41a5-9703-b3faa0bbcc62 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:26.400002 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-53d7200c-01ad-4aa1-b2b1-e57f5416fe37 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:26.400357 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-31be03dc-c154-41a5-9703-b3faa0bbcc62 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:26.400714 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-53d7200c-01ad-4aa1-b2b1-e57f5416fe37 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:26.409793 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-31be03dc-c154-41a5-9703-b3faa0bbcc62 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:26.410664 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-31be03dc-c154-41a5-9703-b3faa0bbcc62 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:26.495678 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-31be03dc-c154-41a5-9703-b3faa0bbcc62 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 24586 microversion: 2.42 time: 0.129212 Jan 15 21:00:26.498402 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1791/3571] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:00:26 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 24586 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:00:26.530411 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c9001414-cec5-419e-a30b-592d4bf278da tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:26.531896 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c9001414-cec5-419e-a30b-592d4bf278da tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] [instance: eab97efd-0a8e-4f55-981e-818ed5583d2c] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:26.567470 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c9001414-cec5-419e-a30b-592d4bf278da tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:26.568230 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c9001414-cec5-419e-a30b-592d4bf278da tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:26.572353 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c9001414-cec5-419e-a30b-592d4bf278da tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:26.577571 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c9001414-cec5-419e-a30b-592d4bf278da tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:26.845496 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-53d7200c-01ad-4aa1-b2b1-e57f5416fe37 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:26.870003 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-53d7200c-01ad-4aa1-b2b1-e57f5416fe37 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:26.871815 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-53d7200c-01ad-4aa1-b2b1-e57f5416fe37 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:26.874877 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-53d7200c-01ad-4aa1-b2b1-e57f5416fe37 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0" status: 200 len: 1405 microversion: 2.20 time: 0.551247 Jan 15 21:00:26.877478 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1781/3572] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:00:26 2022] GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0 => generated 1405 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:00:26.887217 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c923f20d-bc19-4cf6-add7-6f80d64563ba tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:26.888492 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c923f20d-bc19-4cf6-add7-6f80d64563ba tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] [instance: 5e93486c-7c77-4855-85f4-2bc8bcf4832f] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:26.921262 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c923f20d-bc19-4cf6-add7-6f80d64563ba tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:26.926077 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c923f20d-bc19-4cf6-add7-6f80d64563ba tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:26.929356 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c923f20d-bc19-4cf6-add7-6f80d64563ba tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:26.931634 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c923f20d-bc19-4cf6-add7-6f80d64563ba tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:26.952187 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-c9001414-cec5-419e-a30b-592d4bf278da tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb21ef67d1f64f73af586e35f1b772de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf19dbd41564d638af8f2e69883d2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:26.971246 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c9001414-cec5-419e-a30b-592d4bf278da tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] 10.222.0.46 "GET /compute/v2.1/servers/eab97efd-0a8e-4f55-981e-818ed5583d2c" status: 200 len: 1316 microversion: 2.1 time: 0.442523 Jan 15 21:00:26.978287 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1792/3573] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:00:26 2022] GET /compute/v2.1/servers/eab97efd-0a8e-4f55-981e-818ed5583d2c => generated 1316 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:00:26.995912 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-31d44031-d3ec-46c5-8c78-93138230e0ad req-3cf4d94c-f980-41d9-b33f-3f1088e2d203 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "686aa731-082f-4584-8607-5a40f0d63220", "tag": "64cf49a0-1762-46ea-8738-821b466cb2c9"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:26.999690 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:00:26.999690 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:00:27.017650 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-31d44031-d3ec-46c5-8c78-93138230e0ad req-3cf4d94c-f980-41d9-b33f-3f1088e2d203 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:27.019798 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-31d44031-d3ec-46c5-8c78-93138230e0ad req-3cf4d94c-f980-41d9-b33f-3f1088e2d203 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:27.027541 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c923f20d-bc19-4cf6-add7-6f80d64563ba tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] 10.222.0.46 "POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action" status: 200 len: 32650 microversion: 2.1 time: 0.148000 Jan 15 21:00:27.029225 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1782/3574] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:00:26 2022] POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action => generated 32650 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:00:27.039433 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1ef724da-bebd-400b-b543-0964a17736d8 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:27.040146 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-1ef724da-bebd-400b-b543-0964a17736d8 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: 4d836f07-866f-4e13-94ff-c4fe850e58d3] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:27.048250 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1ef724da-bebd-400b-b543-0964a17736d8 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:27.049468 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1ef724da-bebd-400b-b543-0964a17736d8 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:27.050593 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1ef724da-bebd-400b-b543-0964a17736d8 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:27.051784 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1ef724da-bebd-400b-b543-0964a17736d8 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:27.127086 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-31d44031-d3ec-46c5-8c78-93138230e0ad req-3cf4d94c-f980-41d9-b33f-3f1088e2d203 service nova] Creating event network-changed:64cf49a0-1762-46ea-8738-821b466cb2c9 for instance 686aa731-082f-4584-8607-5a40f0d63220 on nch1-master-1 Jan 15 21:00:27.187218 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-31d44031-d3ec-46c5-8c78-93138230e0ad req-3cf4d94c-f980-41d9-b33f-3f1088e2d203 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.195728 Jan 15 21:00:27.193103 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1793/3575] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:00:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:00:27.209222 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-4adff5b3-f160-4d75-b3bd-385d3db2c54a tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:27.213298 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-4adff5b3-f160-4d75-b3bd-385d3db2c54a tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] [instance: 8aaf65b5-c92d-4c08-bba3-a5bef4ac3aa3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:27.231487 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4adff5b3-f160-4d75-b3bd-385d3db2c54a tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:27.232038 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4adff5b3-f160-4d75-b3bd-385d3db2c54a tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:27.232972 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4adff5b3-f160-4d75-b3bd-385d3db2c54a tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:27.237567 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4adff5b3-f160-4d75-b3bd-385d3db2c54a tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:27.417375 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-1ef724da-bebd-400b-b543-0964a17736d8 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8f9c6ea7f6496792258d683640c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a75218d537c4d63874297261bec70ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:27.427571 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-1ef724da-bebd-400b-b543-0964a17736d8 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] 10.222.0.46 "GET /compute/v2.1/servers/4d836f07-866f-4e13-94ff-c4fe850e58d3" status: 200 len: 1317 microversion: 2.1 time: 0.396796 Jan 15 21:00:27.428172 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1783/3576] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:00:27 2022] GET /compute/v2.1/servers/4d836f07-866f-4e13-94ff-c4fe850e58d3 => generated 1317 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:00:27.458423 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-611b1bda-8dd9-48a3-9403-efb7c8bbdf24 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:27.465058 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-611b1bda-8dd9-48a3-9403-efb7c8bbdf24 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:27.481252 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-611b1bda-8dd9-48a3-9403-efb7c8bbdf24 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:27.481708 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-611b1bda-8dd9-48a3-9403-efb7c8bbdf24 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:27.482520 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-611b1bda-8dd9-48a3-9403-efb7c8bbdf24 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:27.482958 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-611b1bda-8dd9-48a3-9403-efb7c8bbdf24 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:27.743931 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-4adff5b3-f160-4d75-b3bd-385d3db2c54a tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c07d13117a49b6b2042e182faaf9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca0988cda6548f89ee936bee64f56ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:27.758194 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-4adff5b3-f160-4d75-b3bd-385d3db2c54a tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] 10.222.0.46 "GET /compute/v2.1/servers/8aaf65b5-c92d-4c08-bba3-a5bef4ac3aa3" status: 200 len: 1506 microversion: 2.1 time: 0.562603 Jan 15 21:00:27.759140 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1794/3577] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:00:27 2022] GET /compute/v2.1/servers/8aaf65b5-c92d-4c08-bba3-a5bef4ac3aa3 => generated 1506 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:00:27.764176 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d9c3c972-861f-4b39-a041-18275288c907 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:27.765132 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d9c3c972-861f-4b39-a041-18275288c907 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:27.789313 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d9c3c972-861f-4b39-a041-18275288c907 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:27.789815 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d9c3c972-861f-4b39-a041-18275288c907 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:27.790624 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d9c3c972-861f-4b39-a041-18275288c907 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:27.791059 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d9c3c972-861f-4b39-a041-18275288c907 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:27.901981 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d9c3c972-861f-4b39-a041-18275288c907 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 24586 microversion: 2.42 time: 0.141003 Jan 15 21:00:27.903162 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1795/3578] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:00:27 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 24586 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:00:27.908541 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-dea42b9f-97df-436d-a320-b10c8df25856 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:27.909120 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-dea42b9f-97df-436d-a320-b10c8df25856 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] [instance: 8aaf65b5-c92d-4c08-bba3-a5bef4ac3aa3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:27.946778 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dea42b9f-97df-436d-a320-b10c8df25856 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:27.947303 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dea42b9f-97df-436d-a320-b10c8df25856 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:27.948115 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dea42b9f-97df-436d-a320-b10c8df25856 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:27.961403 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dea42b9f-97df-436d-a320-b10c8df25856 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:28.048263 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-dea42b9f-97df-436d-a320-b10c8df25856 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] [instance: 8aaf65b5-c92d-4c08-bba3-a5bef4ac3aa3] Going to try to terminate instance {{(pid=129365) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 21:00:28.221340 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-dea42b9f-97df-436d-a320-b10c8df25856 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] 10.222.0.46 "DELETE /compute/v2.1/servers/8aaf65b5-c92d-4c08-bba3-a5bef4ac3aa3" status: 204 len: 0 microversion: 2.1 time: 0.316553 Jan 15 21:00:28.222273 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1796/3579] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 21:00:27 2022] DELETE /compute/v2.1/servers/8aaf65b5-c92d-4c08-bba3-a5bef4ac3aa3 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 21:00:28.240711 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e0ff866f-691c-4d69-87a6-de6aaecefa21 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:28.240711 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e0ff866f-691c-4d69-87a6-de6aaecefa21 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:28.255622 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e0ff866f-691c-4d69-87a6-de6aaecefa21 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:28.265735 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e0ff866f-691c-4d69-87a6-de6aaecefa21 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:28.266648 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e0ff866f-691c-4d69-87a6-de6aaecefa21 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:28.267100 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e0ff866f-691c-4d69-87a6-de6aaecefa21 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:28.346960 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-611b1bda-8dd9-48a3-9403-efb7c8bbdf24 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:28.362892 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-611b1bda-8dd9-48a3-9403-efb7c8bbdf24 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:28.364809 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-611b1bda-8dd9-48a3-9403-efb7c8bbdf24 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:28.372467 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-611b1bda-8dd9-48a3-9403-efb7c8bbdf24 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "GET /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220" status: 200 len: 1878 microversion: 2.32 time: 0.918668 Jan 15 21:00:28.384089 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1784/3580] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:00:27 2022] GET /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220 => generated 1878 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:00:28.388553 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8dadca4e-b5c3-4100-af5f-1d6e501bf2f8 tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:28.389195 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-8dadca4e-b5c3-4100-af5f-1d6e501bf2f8 tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] [instance: eab97efd-0a8e-4f55-981e-818ed5583d2c] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:28.399492 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8dadca4e-b5c3-4100-af5f-1d6e501bf2f8 tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:28.399951 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8dadca4e-b5c3-4100-af5f-1d6e501bf2f8 tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:28.400742 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8dadca4e-b5c3-4100-af5f-1d6e501bf2f8 tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:28.401212 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8dadca4e-b5c3-4100-af5f-1d6e501bf2f8 tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:28.630230 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-e0ff866f-691c-4d69-87a6-de6aaecefa21 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:28.641247 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-e0ff866f-691c-4d69-87a6-de6aaecefa21 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:28.642769 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-e0ff866f-691c-4d69-87a6-de6aaecefa21 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:28.644024 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e0ff866f-691c-4d69-87a6-de6aaecefa21 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0" status: 200 len: 1596 microversion: 2.20 time: 0.420119 Jan 15 21:00:28.646822 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1797/3581] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:00:28 2022] GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0 => generated 1596 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:00:28.656208 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-41497d29-8ac0-4dce-94ce-8c5d0e0e0b04 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:28.660061 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-41497d29-8ac0-4dce-94ce-8c5d0e0e0b04 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] [instance: 5e93486c-7c77-4855-85f4-2bc8bcf4832f] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:28.669967 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-8dadca4e-b5c3-4100-af5f-1d6e501bf2f8 tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb21ef67d1f64f73af586e35f1b772de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf19dbd41564d638af8f2e69883d2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:28.684060 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-8dadca4e-b5c3-4100-af5f-1d6e501bf2f8 tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] 10.222.0.46 "GET /compute/v2.1/servers/eab97efd-0a8e-4f55-981e-818ed5583d2c" status: 200 len: 1316 microversion: 2.1 time: 0.306154 Jan 15 21:00:28.696670 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-41497d29-8ac0-4dce-94ce-8c5d0e0e0b04 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:28.697146 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-41497d29-8ac0-4dce-94ce-8c5d0e0e0b04 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:28.697988 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-41497d29-8ac0-4dce-94ce-8c5d0e0e0b04 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:28.698441 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-41497d29-8ac0-4dce-94ce-8c5d0e0e0b04 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:28.702753 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1785/3582] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:00:28 2022] GET /compute/v2.1/servers/eab97efd-0a8e-4f55-981e-818ed5583d2c => generated 1316 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:00:28.708604 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-2e5f539b-acfd-417f-9a66-1543c907f655 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:28.709421 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-2e5f539b-acfd-417f-9a66-1543c907f655 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] [instance: 52a604e6-ab40-42a3-bb6b-6a65307d2bef] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:28.723473 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2e5f539b-acfd-417f-9a66-1543c907f655 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:28.724000 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2e5f539b-acfd-417f-9a66-1543c907f655 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:28.725390 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2e5f539b-acfd-417f-9a66-1543c907f655 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:28.726037 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2e5f539b-acfd-417f-9a66-1543c907f655 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:28.780094 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-41497d29-8ac0-4dce-94ce-8c5d0e0e0b04 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] 10.222.0.46 "POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action" status: 200 len: 32650 microversion: 2.1 time: 0.129638 Jan 15 21:00:28.781355 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1798/3583] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:00:28 2022] POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action => generated 32650 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:00:28.794927 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-4a2905c6-a922-4e3c-822c-1833cf7eacec tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:28.796700 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-4a2905c6-a922-4e3c-822c-1833cf7eacec tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: 4d836f07-866f-4e13-94ff-c4fe850e58d3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:28.809016 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-2e5f539b-acfd-417f-9a66-1543c907f655 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] [instance: 52a604e6-ab40-42a3-bb6b-6a65307d2bef] Going to try to terminate instance {{(pid=129366) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 21:00:28.817861 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4a2905c6-a922-4e3c-822c-1833cf7eacec tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:28.818353 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4a2905c6-a922-4e3c-822c-1833cf7eacec tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:28.819203 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4a2905c6-a922-4e3c-822c-1833cf7eacec tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:28.822805 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4a2905c6-a922-4e3c-822c-1833cf7eacec tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:29.096955 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-2e5f539b-acfd-417f-9a66-1543c907f655 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] 10.222.0.46 "DELETE /compute/v2.1/servers/52a604e6-ab40-42a3-bb6b-6a65307d2bef" status: 204 len: 0 microversion: 2.1 time: 0.392464 Jan 15 21:00:29.097769 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1786/3584] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 21:00:28 2022] DELETE /compute/v2.1/servers/52a604e6-ab40-42a3-bb6b-6a65307d2bef => generated 0 bytes in 394 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 21:00:29.113131 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-acb70013-5e07-49ae-9727-71e6c918a34d tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:29.114405 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-acb70013-5e07-49ae-9727-71e6c918a34d tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:29.133227 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-acb70013-5e07-49ae-9727-71e6c918a34d tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:29.134928 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-acb70013-5e07-49ae-9727-71e6c918a34d tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:29.136797 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-acb70013-5e07-49ae-9727-71e6c918a34d tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:29.139082 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-acb70013-5e07-49ae-9727-71e6c918a34d tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:29.190118 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-4a2905c6-a922-4e3c-822c-1833cf7eacec tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8f9c6ea7f6496792258d683640c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a75218d537c4d63874297261bec70ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:29.205974 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-4a2905c6-a922-4e3c-822c-1833cf7eacec tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] 10.222.0.46 "GET /compute/v2.1/servers/4d836f07-866f-4e13-94ff-c4fe850e58d3" status: 200 len: 1317 microversion: 2.1 time: 0.422552 Jan 15 21:00:29.217824 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1799/3585] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:00:28 2022] GET /compute/v2.1/servers/4d836f07-866f-4e13-94ff-c4fe850e58d3 => generated 1317 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:00:29.223780 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-68ed0e5e-8192-483d-92c4-649d795e26e1 req-5bb97e54-5c52-4527-8469-daf8fef2d78c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eab97efd-0a8e-4f55-981e-818ed5583d2c", "name": "network-vif-plugged", "status": "completed", "tag": "32879371-6c0b-43fe-b550-fd4eca872af0"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:29.228224 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:00:29.228224 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:00:29.251728 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-68ed0e5e-8192-483d-92c4-649d795e26e1 req-5bb97e54-5c52-4527-8469-daf8fef2d78c service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:29.255804 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-68ed0e5e-8192-483d-92c4-649d795e26e1 req-5bb97e54-5c52-4527-8469-daf8fef2d78c service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:29.290490 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-acb70013-5e07-49ae-9727-71e6c918a34d tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.186976 Jan 15 21:00:29.291328 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-68ed0e5e-8192-483d-92c4-649d795e26e1 req-5bb97e54-5c52-4527-8469-daf8fef2d78c service nova] Creating event network-vif-plugged:32879371-6c0b-43fe-b550-fd4eca872af0 for instance eab97efd-0a8e-4f55-981e-818ed5583d2c on nch2-master-1 Jan 15 21:00:29.298730 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1787/3586] 10.222.0.46 () {60 vars in 1315 bytes} [Sat Jan 15 21:00:29 2022] GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/os-interface => generated 284 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:00:29.304619 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c511f773-a61e-46ec-81e9-03b85fad247c tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:29.305198 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-68ed0e5e-8192-483d-92c4-649d795e26e1 req-5bb97e54-5c52-4527-8469-daf8fef2d78c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085212 Jan 15 21:00:29.305625 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c511f773-a61e-46ec-81e9-03b85fad247c tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:29.306299 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1800/3587] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:00:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:00:29.313726 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-57c17aa6-955f-4595-9b2f-d247ef1fb3e6 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:29.322370 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c511f773-a61e-46ec-81e9-03b85fad247c tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:29.322824 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c511f773-a61e-46ec-81e9-03b85fad247c tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:29.323615 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c511f773-a61e-46ec-81e9-03b85fad247c tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:29.323850 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-57c17aa6-955f-4595-9b2f-d247ef1fb3e6 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] [instance: 8aaf65b5-c92d-4c08-bba3-a5bef4ac3aa3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:29.324047 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c511f773-a61e-46ec-81e9-03b85fad247c tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:29.333166 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-57c17aa6-955f-4595-9b2f-d247ef1fb3e6 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:29.335695 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-57c17aa6-955f-4595-9b2f-d247ef1fb3e6 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:29.336914 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-57c17aa6-955f-4595-9b2f-d247ef1fb3e6 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:29.338107 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-57c17aa6-955f-4595-9b2f-d247ef1fb3e6 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:29.404645 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c511f773-a61e-46ec-81e9-03b85fad247c tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 24586 microversion: 2.42 time: 0.104540 Jan 15 21:00:29.405349 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1788/3588] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:00:29 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 24586 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:00:29.421529 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-1e219163-143a-4a57-a95b-09ea18ff2908 req-8753c3f3-9ca1-4541-82e9-de814ce21c73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "686aa731-082f-4584-8607-5a40f0d63220", "tag": "e70cfdd0-1455-44d5-8de1-57e6af6d6aac"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:29.438078 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:00:29.438078 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:00:29.460834 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-1e219163-143a-4a57-a95b-09ea18ff2908 req-8753c3f3-9ca1-4541-82e9-de814ce21c73 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:29.461439 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-1e219163-143a-4a57-a95b-09ea18ff2908 req-8753c3f3-9ca1-4541-82e9-de814ce21c73 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:29.491486 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-1e219163-143a-4a57-a95b-09ea18ff2908 req-8753c3f3-9ca1-4541-82e9-de814ce21c73 service nova] Creating event network-changed:e70cfdd0-1455-44d5-8de1-57e6af6d6aac for instance 686aa731-082f-4584-8607-5a40f0d63220 on nch1-master-1 Jan 15 21:00:29.511297 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-1e219163-143a-4a57-a95b-09ea18ff2908 req-8753c3f3-9ca1-4541-82e9-de814ce21c73 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104427 Jan 15 21:00:29.513468 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1789/3589] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:00:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:00:29.526663 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a057d85d-a0d5-4f07-a3d0-3023b335e131 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:29.527411 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a057d85d-a0d5-4f07-a3d0-3023b335e131 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:29.573922 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a057d85d-a0d5-4f07-a3d0-3023b335e131 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:29.581483 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a057d85d-a0d5-4f07-a3d0-3023b335e131 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:29.588270 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a057d85d-a0d5-4f07-a3d0-3023b335e131 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:29.589140 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a057d85d-a0d5-4f07-a3d0-3023b335e131 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:29.636228 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-57c17aa6-955f-4595-9b2f-d247ef1fb3e6 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c07d13117a49b6b2042e182faaf9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca0988cda6548f89ee936bee64f56ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:29.652954 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-57c17aa6-955f-4595-9b2f-d247ef1fb3e6 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] 10.222.0.46 "GET /compute/v2.1/servers/8aaf65b5-c92d-4c08-bba3-a5bef4ac3aa3" status: 200 len: 1512 microversion: 2.1 time: 0.345127 Jan 15 21:00:29.654326 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1801/3590] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:00:29 2022] GET /compute/v2.1/servers/8aaf65b5-c92d-4c08-bba3-a5bef4ac3aa3 => generated 1512 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:00:29.703863 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-547efb46-6a36-42ad-b1dc-becf55d5b71f tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:29.704942 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-547efb46-6a36-42ad-b1dc-becf55d5b71f tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] [instance: eab97efd-0a8e-4f55-981e-818ed5583d2c] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:29.713841 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-547efb46-6a36-42ad-b1dc-becf55d5b71f tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:29.714632 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-547efb46-6a36-42ad-b1dc-becf55d5b71f tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:29.715652 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-547efb46-6a36-42ad-b1dc-becf55d5b71f tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:29.716311 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-547efb46-6a36-42ad-b1dc-becf55d5b71f tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:30.169164 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-a057d85d-a0d5-4f07-a3d0-3023b335e131 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:30.189083 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-a057d85d-a0d5-4f07-a3d0-3023b335e131 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:30.190906 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-a057d85d-a0d5-4f07-a3d0-3023b335e131 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:30.192544 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a057d85d-a0d5-4f07-a3d0-3023b335e131 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "GET /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220" status: 200 len: 1878 microversion: 2.32 time: 0.677479 Jan 15 21:00:30.193993 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1790/3591] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:00:29 2022] GET /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220 => generated 1878 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:00:30.204361 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4c3382f7-22b1-4deb-8676-396a3cf819fa tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:30.205296 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-4c3382f7-22b1-4deb-8676-396a3cf819fa tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] [instance: 5e93486c-7c77-4855-85f4-2bc8bcf4832f] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:30.222937 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4c3382f7-22b1-4deb-8676-396a3cf819fa tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:30.223944 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4c3382f7-22b1-4deb-8676-396a3cf819fa tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:30.225078 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4c3382f7-22b1-4deb-8676-396a3cf819fa tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:30.225836 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4c3382f7-22b1-4deb-8676-396a3cf819fa tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:30.309753 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-4c3382f7-22b1-4deb-8676-396a3cf819fa tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] 10.222.0.46 "POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action" status: 200 len: 32650 microversion: 2.1 time: 0.114339 Jan 15 21:00:30.310341 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-547efb46-6a36-42ad-b1dc-becf55d5b71f tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb21ef67d1f64f73af586e35f1b772de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf19dbd41564d638af8f2e69883d2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:30.313496 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1791/3592] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:00:30 2022] POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action => generated 32650 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:00:30.326198 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-247b107a-bce2-4bcd-85b2-767554a9c9e2 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:30.326941 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-247b107a-bce2-4bcd-85b2-767554a9c9e2 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: 4d836f07-866f-4e13-94ff-c4fe850e58d3] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:30.328149 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-547efb46-6a36-42ad-b1dc-becf55d5b71f tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] 10.222.0.46 "GET /compute/v2.1/servers/eab97efd-0a8e-4f55-981e-818ed5583d2c" status: 200 len: 1316 microversion: 2.1 time: 0.629091 Jan 15 21:00:30.339129 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-247b107a-bce2-4bcd-85b2-767554a9c9e2 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:30.339129 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-247b107a-bce2-4bcd-85b2-767554a9c9e2 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:30.339554 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-247b107a-bce2-4bcd-85b2-767554a9c9e2 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:30.340143 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-247b107a-bce2-4bcd-85b2-767554a9c9e2 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:30.341161 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1802/3593] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:00:29 2022] GET /compute/v2.1/servers/eab97efd-0a8e-4f55-981e-818ed5583d2c => generated 1316 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:00:30.417397 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b6f5ef46-589a-46bb-9e44-b7c4435dfe7d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:30.418517 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b6f5ef46-589a-46bb-9e44-b7c4435dfe7d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:30.448674 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b6f5ef46-589a-46bb-9e44-b7c4435dfe7d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:30.449653 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b6f5ef46-589a-46bb-9e44-b7c4435dfe7d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:30.450758 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b6f5ef46-589a-46bb-9e44-b7c4435dfe7d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:30.451474 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b6f5ef46-589a-46bb-9e44-b7c4435dfe7d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:30.587681 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b6f5ef46-589a-46bb-9e44-b7c4435dfe7d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 24586 microversion: 2.42 time: 0.174098 Jan 15 21:00:30.596005 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1803/3594] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:00:30 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 24586 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:00:30.678750 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e18af2d7-31f0-4a27-8b5f-7f128ab98fb5 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:30.680111 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e18af2d7-31f0-4a27-8b5f-7f128ab98fb5 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] [instance: 8aaf65b5-c92d-4c08-bba3-a5bef4ac3aa3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:30.699171 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e18af2d7-31f0-4a27-8b5f-7f128ab98fb5 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:30.699762 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e18af2d7-31f0-4a27-8b5f-7f128ab98fb5 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:30.700644 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e18af2d7-31f0-4a27-8b5f-7f128ab98fb5 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:30.701448 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e18af2d7-31f0-4a27-8b5f-7f128ab98fb5 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:30.756287 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-247b107a-bce2-4bcd-85b2-767554a9c9e2 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8f9c6ea7f6496792258d683640c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a75218d537c4d63874297261bec70ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:30.766236 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-247b107a-bce2-4bcd-85b2-767554a9c9e2 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] 10.222.0.46 "GET /compute/v2.1/servers/4d836f07-866f-4e13-94ff-c4fe850e58d3" status: 200 len: 1317 microversion: 2.1 time: 0.451157 Jan 15 21:00:30.788100 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1792/3595] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:00:30 2022] GET /compute/v2.1/servers/4d836f07-866f-4e13-94ff-c4fe850e58d3 => generated 1317 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:00:31.139431 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-e18af2d7-31f0-4a27-8b5f-7f128ab98fb5 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c07d13117a49b6b2042e182faaf9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca0988cda6548f89ee936bee64f56ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:31.147998 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e18af2d7-31f0-4a27-8b5f-7f128ab98fb5 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] 10.222.0.46 "GET /compute/v2.1/servers/8aaf65b5-c92d-4c08-bba3-a5bef4ac3aa3" status: 200 len: 1512 microversion: 2.1 time: 0.479056 Jan 15 21:00:31.149243 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1804/3596] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:00:30 2022] GET /compute/v2.1/servers/8aaf65b5-c92d-4c08-bba3-a5bef4ac3aa3 => generated 1512 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:00:31.212321 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4d2f4524-b12b-4620-bc2d-f007760519fa tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:31.212858 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-4d2f4524-b12b-4620-bc2d-f007760519fa tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:31.232152 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4d2f4524-b12b-4620-bc2d-f007760519fa tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:31.232637 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4d2f4524-b12b-4620-bc2d-f007760519fa tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:31.233642 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4d2f4524-b12b-4620-bc2d-f007760519fa tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:31.233859 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4d2f4524-b12b-4620-bc2d-f007760519fa tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:31.327593 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-fbe1df65-a6b4-4607-9bfd-862fbd040969 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:31.328708 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-fbe1df65-a6b4-4607-9bfd-862fbd040969 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] [instance: 5e93486c-7c77-4855-85f4-2bc8bcf4832f] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:31.335733 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fbe1df65-a6b4-4607-9bfd-862fbd040969 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:31.336181 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fbe1df65-a6b4-4607-9bfd-862fbd040969 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:31.342656 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fbe1df65-a6b4-4607-9bfd-862fbd040969 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:31.343179 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fbe1df65-a6b4-4607-9bfd-862fbd040969 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:31.404549 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-fbe1df65-a6b4-4607-9bfd-862fbd040969 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] 10.222.0.46 "POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action" status: 200 len: 32650 microversion: 2.1 time: 0.080291 Jan 15 21:00:31.409542 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1805/3597] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:00:31 2022] POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action => generated 32650 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:00:31.416224 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-eff6ddf3-8398-45e3-9113-d180f168655b tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:31.417383 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-eff6ddf3-8398-45e3-9113-d180f168655b tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] [instance: eab97efd-0a8e-4f55-981e-818ed5583d2c] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:31.425583 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-eff6ddf3-8398-45e3-9113-d180f168655b tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:31.426393 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-eff6ddf3-8398-45e3-9113-d180f168655b tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:31.427836 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-eff6ddf3-8398-45e3-9113-d180f168655b tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:31.428547 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-eff6ddf3-8398-45e3-9113-d180f168655b tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:31.633466 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-4d2f4524-b12b-4620-bc2d-f007760519fa tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:31.655874 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-4d2f4524-b12b-4620-bc2d-f007760519fa tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:31.657692 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-4d2f4524-b12b-4620-bc2d-f007760519fa tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:31.659341 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-4d2f4524-b12b-4620-bc2d-f007760519fa tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "GET /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220" status: 200 len: 1878 microversion: 2.32 time: 0.450970 Jan 15 21:00:31.660410 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1793/3598] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:00:31 2022] GET /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220 => generated 1878 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:00:31.669092 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-cdc1cc9c-37c3-4f1e-b3b5-b24c8793d07c tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:31.669092 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-cdc1cc9c-37c3-4f1e-b3b5-b24c8793d07c tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:31.679672 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cdc1cc9c-37c3-4f1e-b3b5-b24c8793d07c tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:31.680124 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cdc1cc9c-37c3-4f1e-b3b5-b24c8793d07c tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:31.680977 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cdc1cc9c-37c3-4f1e-b3b5-b24c8793d07c tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:31.681415 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cdc1cc9c-37c3-4f1e-b3b5-b24c8793d07c tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:31.736642 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-cdc1cc9c-37c3-4f1e-b3b5-b24c8793d07c tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 24586 microversion: 2.42 time: 0.074083 Jan 15 21:00:31.738063 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1794/3599] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:00:31 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 24586 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:00:31.744391 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-8ac1b1c9-93e9-4bff-b9b3-bb9e69c16226 req-53ea9778-859c-40ba-a412-7a8574db6bdb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "686aa731-082f-4584-8607-5a40f0d63220", "tag": "9f31cf46-d654-4aef-ada4-dab1fc37d328"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:31.747437 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:00:31.747437 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:00:31.758351 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-8ac1b1c9-93e9-4bff-b9b3-bb9e69c16226 req-53ea9778-859c-40ba-a412-7a8574db6bdb service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:31.759916 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-8ac1b1c9-93e9-4bff-b9b3-bb9e69c16226 req-53ea9778-859c-40ba-a412-7a8574db6bdb service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:31.766377 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-eff6ddf3-8398-45e3-9113-d180f168655b tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb21ef67d1f64f73af586e35f1b772de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf19dbd41564d638af8f2e69883d2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:31.775984 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-eff6ddf3-8398-45e3-9113-d180f168655b tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] 10.222.0.46 "GET /compute/v2.1/servers/eab97efd-0a8e-4f55-981e-818ed5583d2c" status: 200 len: 1316 microversion: 2.1 time: 0.364793 Jan 15 21:00:31.779285 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-8ac1b1c9-93e9-4bff-b9b3-bb9e69c16226 req-53ea9778-859c-40ba-a412-7a8574db6bdb service nova] Creating event network-changed:9f31cf46-d654-4aef-ada4-dab1fc37d328 for instance 686aa731-082f-4584-8607-5a40f0d63220 on nch1-master-1 Jan 15 21:00:31.781801 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1806/3600] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:00:31 2022] GET /compute/v2.1/servers/eab97efd-0a8e-4f55-981e-818ed5583d2c => generated 1316 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:00:31.785131 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-8ac1b1c9-93e9-4bff-b9b3-bb9e69c16226 req-53ea9778-859c-40ba-a412-7a8574db6bdb service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045209 Jan 15 21:00:31.787082 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1795/3601] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:00:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:00:31.793697 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-8bae42b3-bd02-4310-b5c9-4048475447ef req-b9cf0aa7-7c76-4a67-82ff-2937931c773f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52a604e6-ab40-42a3-bb6b-6a65307d2bef", "name": "network-vif-deleted", "tag": "4ed568ab-4582-4d97-8362-7eee18a7cd9f"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:31.795741 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:00:31.795741 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:00:31.803044 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-81ff09f9-73b3-4f54-b2aa-f84c5b5074cd tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:31.804214 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-81ff09f9-73b3-4f54-b2aa-f84c5b5074cd tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: 4d836f07-866f-4e13-94ff-c4fe850e58d3] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:31.805260 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-8bae42b3-bd02-4310-b5c9-4048475447ef req-b9cf0aa7-7c76-4a67-82ff-2937931c773f service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:31.805862 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-8bae42b3-bd02-4310-b5c9-4048475447ef req-b9cf0aa7-7c76-4a67-82ff-2937931c773f service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:31.822129 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-81ff09f9-73b3-4f54-b2aa-f84c5b5074cd tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:31.823176 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-81ff09f9-73b3-4f54-b2aa-f84c5b5074cd tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:31.827914 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-81ff09f9-73b3-4f54-b2aa-f84c5b5074cd tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:31.828510 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-81ff09f9-73b3-4f54-b2aa-f84c5b5074cd tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:31.838437 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-8bae42b3-bd02-4310-b5c9-4048475447ef req-b9cf0aa7-7c76-4a67-82ff-2937931c773f service nova] Creating event network-vif-deleted:4ed568ab-4582-4d97-8362-7eee18a7cd9f for instance 52a604e6-ab40-42a3-bb6b-6a65307d2bef on nch2-master-1 Jan 15 21:00:31.847273 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-8bae42b3-bd02-4310-b5c9-4048475447ef req-b9cf0aa7-7c76-4a67-82ff-2937931c773f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057011 Jan 15 21:00:31.851553 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1807/3602] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:00:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:00:32.167091 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-473e7c5b-4ad0-4508-95f8-937573951607 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:32.168213 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-473e7c5b-4ad0-4508-95f8-937573951607 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] [instance: 8aaf65b5-c92d-4c08-bba3-a5bef4ac3aa3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:32.193265 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-473e7c5b-4ad0-4508-95f8-937573951607 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:32.196587 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-473e7c5b-4ad0-4508-95f8-937573951607 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:32.200278 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-473e7c5b-4ad0-4508-95f8-937573951607 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:32.213781 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-473e7c5b-4ad0-4508-95f8-937573951607 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:32.284112 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-81ff09f9-73b3-4f54-b2aa-f84c5b5074cd tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8f9c6ea7f6496792258d683640c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a75218d537c4d63874297261bec70ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:32.293659 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-81ff09f9-73b3-4f54-b2aa-f84c5b5074cd tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] 10.222.0.46 "GET /compute/v2.1/servers/4d836f07-866f-4e13-94ff-c4fe850e58d3" status: 200 len: 1317 microversion: 2.1 time: 0.502464 Jan 15 21:00:32.302916 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1796/3603] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:00:31 2022] GET /compute/v2.1/servers/4d836f07-866f-4e13-94ff-c4fe850e58d3 => generated 1317 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:00:32.417319 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-cd4a2f0c-209c-4f25-aa0c-1733a19d4c15 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:32.418486 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-cd4a2f0c-209c-4f25-aa0c-1733a19d4c15 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] [instance: 5e93486c-7c77-4855-85f4-2bc8bcf4832f] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:32.430068 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cd4a2f0c-209c-4f25-aa0c-1733a19d4c15 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:32.430474 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cd4a2f0c-209c-4f25-aa0c-1733a19d4c15 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:32.431320 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cd4a2f0c-209c-4f25-aa0c-1733a19d4c15 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:32.431706 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cd4a2f0c-209c-4f25-aa0c-1733a19d4c15 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:32.511820 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-cd4a2f0c-209c-4f25-aa0c-1733a19d4c15 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] 10.222.0.46 "POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action" status: 200 len: 32650 microversion: 2.1 time: 0.097605 Jan 15 21:00:32.513619 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1797/3604] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:00:32 2022] POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action => generated 32650 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:00:32.522889 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-cedcc4d0-c41c-4ccd-b7d4-0bdc908220b7 req-bef0f332-10fe-47b9-8817-4af06882ac1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8aaf65b5-c92d-4c08-bba3-a5bef4ac3aa3", "name": "network-vif-unplugged", "status": "completed", "tag": "36f3b8af-fe91-4ff7-8ba4-6576445d3e86"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:32.526868 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:00:32.526868 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:00:32.542850 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-cedcc4d0-c41c-4ccd-b7d4-0bdc908220b7 req-bef0f332-10fe-47b9-8817-4af06882ac1e service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:32.543351 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-cedcc4d0-c41c-4ccd-b7d4-0bdc908220b7 req-bef0f332-10fe-47b9-8817-4af06882ac1e service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:32.560623 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-cedcc4d0-c41c-4ccd-b7d4-0bdc908220b7 req-bef0f332-10fe-47b9-8817-4af06882ac1e service nova] Creating event network-vif-unplugged:36f3b8af-fe91-4ff7-8ba4-6576445d3e86 for instance 8aaf65b5-c92d-4c08-bba3-a5bef4ac3aa3 on nch2-master-1 Jan 15 21:00:32.568619 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-473e7c5b-4ad0-4508-95f8-937573951607 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c07d13117a49b6b2042e182faaf9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca0988cda6548f89ee936bee64f56ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:32.569259 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-cedcc4d0-c41c-4ccd-b7d4-0bdc908220b7 req-bef0f332-10fe-47b9-8817-4af06882ac1e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052930 Jan 15 21:00:32.569821 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1798/3605] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:00:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:00:32.577350 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-473e7c5b-4ad0-4508-95f8-937573951607 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] 10.222.0.46 "GET /compute/v2.1/servers/8aaf65b5-c92d-4c08-bba3-a5bef4ac3aa3" status: 200 len: 1512 microversion: 2.1 time: 0.415578 Jan 15 21:00:32.589520 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1808/3606] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:00:32 2022] GET /compute/v2.1/servers/8aaf65b5-c92d-4c08-bba3-a5bef4ac3aa3 => generated 1512 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:00:32.684123 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-68ded10e-1a19-4d2a-8ee4-4784ced66598 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:32.684814 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-68ded10e-1a19-4d2a-8ee4-4784ced66598 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:32.695260 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-68ded10e-1a19-4d2a-8ee4-4784ced66598 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:32.695714 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-68ded10e-1a19-4d2a-8ee4-4784ced66598 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:32.696512 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-68ded10e-1a19-4d2a-8ee4-4784ced66598 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:32.696985 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-68ded10e-1a19-4d2a-8ee4-4784ced66598 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:32.752436 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-494ddac1-605a-4fc4-ab2a-296805f94d3c tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:32.753305 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-494ddac1-605a-4fc4-ab2a-296805f94d3c tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:32.769015 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-494ddac1-605a-4fc4-ab2a-296805f94d3c tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:32.769775 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-494ddac1-605a-4fc4-ab2a-296805f94d3c tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:32.771453 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-494ddac1-605a-4fc4-ab2a-296805f94d3c tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:32.772171 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-494ddac1-605a-4fc4-ab2a-296805f94d3c tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:32.843923 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-494ddac1-605a-4fc4-ab2a-296805f94d3c tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 32601 microversion: 2.42 time: 0.096411 Jan 15 21:00:32.850166 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1809/3607] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:00:32 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 32601 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:00:32.862943 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c4ad5dff-1fc9-48b7-ac67-41a5380e8fc0 tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:32.864153 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c4ad5dff-1fc9-48b7-ac67-41a5380e8fc0 tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] [instance: eab97efd-0a8e-4f55-981e-818ed5583d2c] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:32.883024 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c4ad5dff-1fc9-48b7-ac67-41a5380e8fc0 tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:32.892562 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c4ad5dff-1fc9-48b7-ac67-41a5380e8fc0 tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:32.893655 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c4ad5dff-1fc9-48b7-ac67-41a5380e8fc0 tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:32.894325 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c4ad5dff-1fc9-48b7-ac67-41a5380e8fc0 tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:33.127945 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-68ded10e-1a19-4d2a-8ee4-4784ced66598 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:33.145502 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-68ded10e-1a19-4d2a-8ee4-4784ced66598 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:33.150833 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-68ded10e-1a19-4d2a-8ee4-4784ced66598 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:33.159281 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-68ded10e-1a19-4d2a-8ee4-4784ced66598 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "GET /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220" status: 200 len: 1878 microversion: 2.32 time: 0.480370 Jan 15 21:00:33.161405 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1799/3608] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:00:32 2022] GET /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220 => generated 1878 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:00:33.214459 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-c4ad5dff-1fc9-48b7-ac67-41a5380e8fc0 tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb21ef67d1f64f73af586e35f1b772de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf19dbd41564d638af8f2e69883d2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:33.226679 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c4ad5dff-1fc9-48b7-ac67-41a5380e8fc0 tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] 10.222.0.46 "GET /compute/v2.1/servers/eab97efd-0a8e-4f55-981e-818ed5583d2c" status: 200 len: 1505 microversion: 2.1 time: 0.380294 Jan 15 21:00:33.243067 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1810/3609] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:00:32 2022] GET /compute/v2.1/servers/eab97efd-0a8e-4f55-981e-818ed5583d2c => generated 1505 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:00:33.245580 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ec60a9e2-08e4-4609-822b-db3d84492c9f tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:33.246335 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ec60a9e2-08e4-4609-822b-db3d84492c9f tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] [instance: eab97efd-0a8e-4f55-981e-818ed5583d2c] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:33.255006 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ec60a9e2-08e4-4609-822b-db3d84492c9f tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:33.255794 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ec60a9e2-08e4-4609-822b-db3d84492c9f tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:33.256916 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ec60a9e2-08e4-4609-822b-db3d84492c9f tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:33.257543 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ec60a9e2-08e4-4609-822b-db3d84492c9f tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:33.315363 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-89460ce1-0bb7-4a0b-80b4-78e4de557d00 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:33.315979 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-89460ce1-0bb7-4a0b-80b4-78e4de557d00 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: 4d836f07-866f-4e13-94ff-c4fe850e58d3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:33.325051 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-89460ce1-0bb7-4a0b-80b4-78e4de557d00 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:33.325574 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-89460ce1-0bb7-4a0b-80b4-78e4de557d00 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:33.326446 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-89460ce1-0bb7-4a0b-80b4-78e4de557d00 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:33.328152 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-89460ce1-0bb7-4a0b-80b4-78e4de557d00 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:33.361542 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ec60a9e2-08e4-4609-822b-db3d84492c9f tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] 10.222.0.46 "DELETE /compute/v2.1/servers/eab97efd-0a8e-4f55-981e-818ed5583d2c/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.119793 Jan 15 21:00:33.368929 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1800/3610] 10.222.0.46 () {58 vars in 1295 bytes} [Sat Jan 15 21:00:33 2022] DELETE /compute/v2.1/servers/eab97efd-0a8e-4f55-981e-818ed5583d2c/os-server-password => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 15 21:00:33.374248 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-3582903e-d439-4e12-8565-a5b46867b813 tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:33.375557 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-3582903e-d439-4e12-8565-a5b46867b813 tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] [instance: eab97efd-0a8e-4f55-981e-818ed5583d2c] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:33.387816 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3582903e-d439-4e12-8565-a5b46867b813 tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:33.390647 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3582903e-d439-4e12-8565-a5b46867b813 tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:33.391756 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3582903e-d439-4e12-8565-a5b46867b813 tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:33.392380 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3582903e-d439-4e12-8565-a5b46867b813 tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:33.424580 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-3582903e-d439-4e12-8565-a5b46867b813 tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] 10.222.0.46 "GET /compute/v2.1/servers/eab97efd-0a8e-4f55-981e-818ed5583d2c/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.053651 Jan 15 21:00:33.425572 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1801/3611] 10.222.0.46 () {58 vars in 1292 bytes} [Sat Jan 15 21:00:33 2022] GET /compute/v2.1/servers/eab97efd-0a8e-4f55-981e-818ed5583d2c/os-server-password => generated 16 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 21:00:33.448478 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b412bb42-3c61-4c52-94b9-9c28c65af709 tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:33.449046 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b412bb42-3c61-4c52-94b9-9c28c65af709 tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] [instance: eab97efd-0a8e-4f55-981e-818ed5583d2c] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:33.462506 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b412bb42-3c61-4c52-94b9-9c28c65af709 tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:33.464417 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b412bb42-3c61-4c52-94b9-9c28c65af709 tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:33.465585 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b412bb42-3c61-4c52-94b9-9c28c65af709 tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:33.467049 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b412bb42-3c61-4c52-94b9-9c28c65af709 tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:33.501364 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b412bb42-3c61-4c52-94b9-9c28c65af709 tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] [instance: eab97efd-0a8e-4f55-981e-818ed5583d2c] Going to try to terminate instance {{(pid=129366) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 21:00:33.509296 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-89460ce1-0bb7-4a0b-80b4-78e4de557d00 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8f9c6ea7f6496792258d683640c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a75218d537c4d63874297261bec70ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:33.517389 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-89460ce1-0bb7-4a0b-80b4-78e4de557d00 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] 10.222.0.46 "GET /compute/v2.1/servers/4d836f07-866f-4e13-94ff-c4fe850e58d3" status: 200 len: 1317 microversion: 2.1 time: 0.205680 Jan 15 21:00:33.519068 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1811/3612] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:00:33 2022] GET /compute/v2.1/servers/4d836f07-866f-4e13-94ff-c4fe850e58d3 => generated 1317 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:00:33.533199 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c6d0a3b5-ade7-43c7-a2fb-098f17997070 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:33.534324 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c6d0a3b5-ade7-43c7-a2fb-098f17997070 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] [instance: 5e93486c-7c77-4855-85f4-2bc8bcf4832f] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:33.547674 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c6d0a3b5-ade7-43c7-a2fb-098f17997070 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:33.548145 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c6d0a3b5-ade7-43c7-a2fb-098f17997070 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:33.550421 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c6d0a3b5-ade7-43c7-a2fb-098f17997070 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:33.551387 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c6d0a3b5-ade7-43c7-a2fb-098f17997070 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:33.602135 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c6d0a3b5-ade7-43c7-a2fb-098f17997070 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] 10.222.0.46 "POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action" status: 200 len: 32650 microversion: 2.1 time: 0.081625 Jan 15 21:00:33.603405 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1812/3613] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:00:33 2022] POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action => generated 32650 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:00:33.612563 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e70f8b35-1f68-4bc4-ab8f-b8395a9aa0b2 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:33.617700 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e70f8b35-1f68-4bc4-ab8f-b8395a9aa0b2 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] [instance: 8aaf65b5-c92d-4c08-bba3-a5bef4ac3aa3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:33.627309 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e70f8b35-1f68-4bc4-ab8f-b8395a9aa0b2 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:33.627778 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e70f8b35-1f68-4bc4-ab8f-b8395a9aa0b2 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:33.628666 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e70f8b35-1f68-4bc4-ab8f-b8395a9aa0b2 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:33.629263 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e70f8b35-1f68-4bc4-ab8f-b8395a9aa0b2 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:33.647644 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b412bb42-3c61-4c52-94b9-9c28c65af709 tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] 10.222.0.46 "DELETE /compute/v2.1/servers/eab97efd-0a8e-4f55-981e-818ed5583d2c" status: 204 len: 0 microversion: 2.1 time: 0.214528 Jan 15 21:00:33.653332 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1802/3614] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 21:00:33 2022] DELETE /compute/v2.1/servers/eab97efd-0a8e-4f55-981e-818ed5583d2c => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 21:00:33.658823 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-2498787e-75a8-4c83-9a2c-36a9d9614889 tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:33.660992 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-2498787e-75a8-4c83-9a2c-36a9d9614889 tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] [instance: eab97efd-0a8e-4f55-981e-818ed5583d2c] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:33.667917 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2498787e-75a8-4c83-9a2c-36a9d9614889 tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:33.668661 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2498787e-75a8-4c83-9a2c-36a9d9614889 tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:33.670702 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2498787e-75a8-4c83-9a2c-36a9d9614889 tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:33.671380 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2498787e-75a8-4c83-9a2c-36a9d9614889 tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:33.713570 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-e70f8b35-1f68-4bc4-ab8f-b8395a9aa0b2 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c07d13117a49b6b2042e182faaf9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca0988cda6548f89ee936bee64f56ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:33.724406 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e70f8b35-1f68-4bc4-ab8f-b8395a9aa0b2 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] 10.222.0.46 "GET /compute/v2.1/servers/8aaf65b5-c92d-4c08-bba3-a5bef4ac3aa3" status: 200 len: 1470 microversion: 2.1 time: 0.118988 Jan 15 21:00:33.725286 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1813/3615] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:00:33 2022] GET /compute/v2.1/servers/8aaf65b5-c92d-4c08-bba3-a5bef4ac3aa3 => generated 1470 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:00:33.849558 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-2498787e-75a8-4c83-9a2c-36a9d9614889 tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb21ef67d1f64f73af586e35f1b772de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf19dbd41564d638af8f2e69883d2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:33.857084 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-72c669d8-9419-495b-a654-4ff9c1ac4722 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:33.858229 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-2498787e-75a8-4c83-9a2c-36a9d9614889 tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] 10.222.0.46 "GET /compute/v2.1/servers/eab97efd-0a8e-4f55-981e-818ed5583d2c" status: 200 len: 1511 microversion: 2.1 time: 0.203387 Jan 15 21:00:33.858667 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-72c669d8-9419-495b-a654-4ff9c1ac4722 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:33.864107 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1803/3616] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:00:33 2022] GET /compute/v2.1/servers/eab97efd-0a8e-4f55-981e-818ed5583d2c => generated 1511 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:00:33.866793 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-72c669d8-9419-495b-a654-4ff9c1ac4722 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:33.867490 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-72c669d8-9419-495b-a654-4ff9c1ac4722 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:33.868620 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-72c669d8-9419-495b-a654-4ff9c1ac4722 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:33.869370 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-72c669d8-9419-495b-a654-4ff9c1ac4722 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:33.916886 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-72c669d8-9419-495b-a654-4ff9c1ac4722 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 32601 microversion: 2.42 time: 0.064162 Jan 15 21:00:33.922004 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1814/3617] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:00:33 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 32601 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:00:34.022764 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-61e95739-0d63-4f0e-b3dc-f620216c860e req-ab43691b-5744-4569-b60a-bb01d7f5f6eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8aaf65b5-c92d-4c08-bba3-a5bef4ac3aa3", "name": "network-vif-deleted", "tag": "36f3b8af-fe91-4ff7-8ba4-6576445d3e86"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:34.024421 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:00:34.024421 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:00:34.042286 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-61e95739-0d63-4f0e-b3dc-f620216c860e req-ab43691b-5744-4569-b60a-bb01d7f5f6eb service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:34.042824 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-61e95739-0d63-4f0e-b3dc-f620216c860e req-ab43691b-5744-4569-b60a-bb01d7f5f6eb service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:34.064608 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-61e95739-0d63-4f0e-b3dc-f620216c860e req-ab43691b-5744-4569-b60a-bb01d7f5f6eb service nova] Creating event network-vif-deleted:36f3b8af-fe91-4ff7-8ba4-6576445d3e86 for instance 8aaf65b5-c92d-4c08-bba3-a5bef4ac3aa3 on nch2-master-1 Jan 15 21:00:34.071186 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-61e95739-0d63-4f0e-b3dc-f620216c860e req-ab43691b-5744-4569-b60a-bb01d7f5f6eb service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052145 Jan 15 21:00:34.072310 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1804/3618] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:00:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:00:34.178420 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-506cd94d-24af-4a83-b663-9b95be184c07 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:34.179267 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-506cd94d-24af-4a83-b663-9b95be184c07 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:34.195391 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-506cd94d-24af-4a83-b663-9b95be184c07 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:34.196001 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-506cd94d-24af-4a83-b663-9b95be184c07 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:34.196977 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-506cd94d-24af-4a83-b663-9b95be184c07 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:34.200359 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-506cd94d-24af-4a83-b663-9b95be184c07 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:34.500680 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-506cd94d-24af-4a83-b663-9b95be184c07 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:34.512409 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-506cd94d-24af-4a83-b663-9b95be184c07 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:34.514150 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-506cd94d-24af-4a83-b663-9b95be184c07 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:34.516109 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-506cd94d-24af-4a83-b663-9b95be184c07 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "GET /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220" status: 200 len: 1878 microversion: 2.32 time: 0.341629 Jan 15 21:00:34.516739 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1815/3619] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:00:34 2022] GET /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220 => generated 1878 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:00:34.541413 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e82eca63-5100-4e1b-914b-18ee0b975be6 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:34.542129 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e82eca63-5100-4e1b-914b-18ee0b975be6 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: 4d836f07-866f-4e13-94ff-c4fe850e58d3] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:34.565749 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e82eca63-5100-4e1b-914b-18ee0b975be6 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:34.566214 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e82eca63-5100-4e1b-914b-18ee0b975be6 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:34.567079 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e82eca63-5100-4e1b-914b-18ee0b975be6 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:34.567632 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e82eca63-5100-4e1b-914b-18ee0b975be6 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:34.591900 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-8e5fe559-b7fe-4c1a-8db7-96cb792b67b6 req-7cd97d47-ddf3-4fd3-ab29-78a27f5955b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d836f07-866f-4e13-94ff-c4fe850e58d3", "name": "network-vif-plugged", "status": "completed", "tag": "4949ae19-44ff-4865-9776-96c470821b54"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:34.610874 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:00:34.610874 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:00:34.647744 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-8e5fe559-b7fe-4c1a-8db7-96cb792b67b6 req-7cd97d47-ddf3-4fd3-ab29-78a27f5955b3 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:34.648269 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-8e5fe559-b7fe-4c1a-8db7-96cb792b67b6 req-7cd97d47-ddf3-4fd3-ab29-78a27f5955b3 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:34.716085 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-8e5fe559-b7fe-4c1a-8db7-96cb792b67b6 req-7cd97d47-ddf3-4fd3-ab29-78a27f5955b3 service nova] Creating event network-vif-plugged:4949ae19-44ff-4865-9776-96c470821b54 for instance 4d836f07-866f-4e13-94ff-c4fe850e58d3 on nch1-master-1 Jan 15 21:00:34.742842 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-8e5fe559-b7fe-4c1a-8db7-96cb792b67b6 req-7cd97d47-ddf3-4fd3-ab29-78a27f5955b3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152856 Jan 15 21:00:34.743500 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1816/3620] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:00:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:00:34.760310 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-759947d9-1b1a-49e7-a427-df3d24abca1f tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:34.767998 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-759947d9-1b1a-49e7-a427-df3d24abca1f tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] [instance: 5e93486c-7c77-4855-85f4-2bc8bcf4832f] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:34.791083 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-759947d9-1b1a-49e7-a427-df3d24abca1f tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:34.791548 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-759947d9-1b1a-49e7-a427-df3d24abca1f tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:34.803313 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-759947d9-1b1a-49e7-a427-df3d24abca1f tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:34.803927 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-759947d9-1b1a-49e7-a427-df3d24abca1f tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:34.937641 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-759947d9-1b1a-49e7-a427-df3d24abca1f tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] 10.222.0.46 "POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action" status: 200 len: 32650 microversion: 2.1 time: 0.192507 Jan 15 21:00:34.938565 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1817/3621] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:00:34 2022] POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action => generated 32650 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:00:34.954741 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-41555057-8be8-4d2f-accf-3a51a2a0acea tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:34.965940 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-41555057-8be8-4d2f-accf-3a51a2a0acea tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:34.968739 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-e82eca63-5100-4e1b-914b-18ee0b975be6 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8f9c6ea7f6496792258d683640c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a75218d537c4d63874297261bec70ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:34.978232 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e82eca63-5100-4e1b-914b-18ee0b975be6 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] 10.222.0.46 "GET /compute/v2.1/servers/4d836f07-866f-4e13-94ff-c4fe850e58d3" status: 200 len: 1317 microversion: 2.1 time: 0.441163 Jan 15 21:00:34.979677 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-41555057-8be8-4d2f-accf-3a51a2a0acea tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:34.982379 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1805/3622] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:00:34 2022] GET /compute/v2.1/servers/4d836f07-866f-4e13-94ff-c4fe850e58d3 => generated 1317 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:00:34.990570 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-41555057-8be8-4d2f-accf-3a51a2a0acea tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:34.991631 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-41555057-8be8-4d2f-accf-3a51a2a0acea tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:34.992091 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-41555057-8be8-4d2f-accf-3a51a2a0acea tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:34.997175 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e0265fa1-483f-424b-b9c3-c657c414023d tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:34.998856 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e0265fa1-483f-424b-b9c3-c657c414023d tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] [instance: 8aaf65b5-c92d-4c08-bba3-a5bef4ac3aa3] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:35.017162 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e0265fa1-483f-424b-b9c3-c657c414023d tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:35.017643 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e0265fa1-483f-424b-b9c3-c657c414023d tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:35.018480 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e0265fa1-483f-424b-b9c3-c657c414023d tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:35.018924 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e0265fa1-483f-424b-b9c3-c657c414023d tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:35.047546 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-e0265fa1-483f-424b-b9c3-c657c414023d tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] HTTP exception thrown: Instance 8aaf65b5-c92d-4c08-bba3-a5bef4ac3aa3 could not be found. Jan 15 21:00:35.048517 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e0265fa1-483f-424b-b9c3-c657c414023d tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Returning 404 to user: Instance 8aaf65b5-c92d-4c08-bba3-a5bef4ac3aa3 could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:00:35.049615 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e0265fa1-483f-424b-b9c3-c657c414023d tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] 10.222.0.46 "GET /compute/v2.1/servers/8aaf65b5-c92d-4c08-bba3-a5bef4ac3aa3" status: 404 len: 111 microversion: 2.1 time: 0.064836 Jan 15 21:00:35.050403 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1806/3623] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:00:34 2022] GET /compute/v2.1/servers/8aaf65b5-c92d-4c08-bba3-a5bef4ac3aa3 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:00:35.056179 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d5fa9ad4-bb30-4a09-ac52-5a2510ee8774 tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:35.057430 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-d5fa9ad4-bb30-4a09-ac52-5a2510ee8774 tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] [instance: eab97efd-0a8e-4f55-981e-818ed5583d2c] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:35.069795 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d5fa9ad4-bb30-4a09-ac52-5a2510ee8774 tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:35.070618 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d5fa9ad4-bb30-4a09-ac52-5a2510ee8774 tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:35.071660 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d5fa9ad4-bb30-4a09-ac52-5a2510ee8774 tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:35.072938 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d5fa9ad4-bb30-4a09-ac52-5a2510ee8774 tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:35.092952 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-41555057-8be8-4d2f-accf-3a51a2a0acea tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action" status: 200 len: 14 microversion: 2.20 time: 0.151439 Jan 15 21:00:35.094996 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1818/3624] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:00:34 2022] POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action => generated 14 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:00:35.106881 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-65a9d6de-7e80-43ff-a865-ab144f4efc8f tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:35.108183 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-65a9d6de-7e80-43ff-a865-ab144f4efc8f tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:35.121701 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-65a9d6de-7e80-43ff-a865-ab144f4efc8f tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:35.122446 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-65a9d6de-7e80-43ff-a865-ab144f4efc8f tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:35.123401 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-65a9d6de-7e80-43ff-a865-ab144f4efc8f tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:35.123994 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-65a9d6de-7e80-43ff-a865-ab144f4efc8f tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:35.203051 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-65a9d6de-7e80-43ff-a865-ab144f4efc8f tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 32601 microversion: 2.42 time: 0.102068 Jan 15 21:00:35.212535 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1819/3625] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:00:35 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 32601 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:00:35.225166 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-faed0c98-16b8-4fe9-9206-341fc4b74bf0 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:35.230245 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-faed0c98-16b8-4fe9-9206-341fc4b74bf0 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] [instance: 52a604e6-ab40-42a3-bb6b-6a65307d2bef] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:35.252518 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-faed0c98-16b8-4fe9-9206-341fc4b74bf0 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:35.253023 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-faed0c98-16b8-4fe9-9206-341fc4b74bf0 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:35.256741 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-faed0c98-16b8-4fe9-9206-341fc4b74bf0 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:35.258976 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-faed0c98-16b8-4fe9-9206-341fc4b74bf0 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:35.334285 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-faed0c98-16b8-4fe9-9206-341fc4b74bf0 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] HTTP exception thrown: Instance 52a604e6-ab40-42a3-bb6b-6a65307d2bef could not be found. Jan 15 21:00:35.334986 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-faed0c98-16b8-4fe9-9206-341fc4b74bf0 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] Returning 404 to user: Instance 52a604e6-ab40-42a3-bb6b-6a65307d2bef could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:00:35.338434 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-faed0c98-16b8-4fe9-9206-341fc4b74bf0 tempest-MultipleCreateTestJSON-140746638 tempest-MultipleCreateTestJSON-140746638-project] 10.222.0.46 "GET /compute/v2.1/servers/52a604e6-ab40-42a3-bb6b-6a65307d2bef" status: 404 len: 111 microversion: 2.1 time: 0.124757 Jan 15 21:00:35.339225 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1820/3626] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:00:35 2022] GET /compute/v2.1/servers/52a604e6-ab40-42a3-bb6b-6a65307d2bef => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:00:35.536828 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-486ab87d-797a-439f-9b48-59ce3cca2d54 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:35.539900 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-486ab87d-797a-439f-9b48-59ce3cca2d54 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:35.558522 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-486ab87d-797a-439f-9b48-59ce3cca2d54 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:35.559544 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-486ab87d-797a-439f-9b48-59ce3cca2d54 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:35.560862 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-486ab87d-797a-439f-9b48-59ce3cca2d54 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:35.563558 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-d5fa9ad4-bb30-4a09-ac52-5a2510ee8774 tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb21ef67d1f64f73af586e35f1b772de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf19dbd41564d638af8f2e69883d2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:35.564011 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-486ab87d-797a-439f-9b48-59ce3cca2d54 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:35.583423 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d5fa9ad4-bb30-4a09-ac52-5a2510ee8774 tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] 10.222.0.46 "GET /compute/v2.1/servers/eab97efd-0a8e-4f55-981e-818ed5583d2c" status: 200 len: 1511 microversion: 2.1 time: 0.526841 Jan 15 21:00:35.584728 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1807/3627] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:00:35 2022] GET /compute/v2.1/servers/eab97efd-0a8e-4f55-981e-818ed5583d2c => generated 1511 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:00:35.953860 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-12e996df-b36b-4902-9c64-9af787dcfe97 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:35.955965 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-12e996df-b36b-4902-9c64-9af787dcfe97 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] [instance: 5e93486c-7c77-4855-85f4-2bc8bcf4832f] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:35.976618 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-12e996df-b36b-4902-9c64-9af787dcfe97 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:35.977806 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-12e996df-b36b-4902-9c64-9af787dcfe97 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:35.980337 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-12e996df-b36b-4902-9c64-9af787dcfe97 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:35.982791 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-12e996df-b36b-4902-9c64-9af787dcfe97 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:36.007743 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-486ab87d-797a-439f-9b48-59ce3cca2d54 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:36.032491 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-486ab87d-797a-439f-9b48-59ce3cca2d54 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:36.034859 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-486ab87d-797a-439f-9b48-59ce3cca2d54 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:36.037863 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-486ab87d-797a-439f-9b48-59ce3cca2d54 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "GET /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220" status: 200 len: 1878 microversion: 2.32 time: 0.504884 Jan 15 21:00:36.039907 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1821/3628] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:00:35 2022] GET /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220 => generated 1878 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 15 21:00:36.044735 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9e80c1fe-1f3d-4e0e-9579-e09959094a4a tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:36.045920 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-9e80c1fe-1f3d-4e0e-9579-e09959094a4a tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: 4d836f07-866f-4e13-94ff-c4fe850e58d3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:36.073949 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9e80c1fe-1f3d-4e0e-9579-e09959094a4a tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:36.074898 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9e80c1fe-1f3d-4e0e-9579-e09959094a4a tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:36.076134 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9e80c1fe-1f3d-4e0e-9579-e09959094a4a tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:36.080522 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9e80c1fe-1f3d-4e0e-9579-e09959094a4a tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:36.111097 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-12e996df-b36b-4902-9c64-9af787dcfe97 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] 10.222.0.46 "POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action" status: 200 len: 32650 microversion: 2.1 time: 0.163636 Jan 15 21:00:36.112130 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1808/3629] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:00:35 2022] POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action => generated 32650 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:00:36.127992 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-2dc6f691-6e71-4cc2-b67a-10e675506697 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:36.130340 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-2dc6f691-6e71-4cc2-b67a-10e675506697 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:36.138660 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2dc6f691-6e71-4cc2-b67a-10e675506697 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:36.139647 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2dc6f691-6e71-4cc2-b67a-10e675506697 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:36.140686 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2dc6f691-6e71-4cc2-b67a-10e675506697 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:36.141351 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2dc6f691-6e71-4cc2-b67a-10e675506697 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:36.204675 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-2dc6f691-6e71-4cc2-b67a-10e675506697 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action" status: 200 len: 14 microversion: 2.20 time: 0.084643 Jan 15 21:00:36.210253 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1809/3630] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:00:36 2022] POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action => generated 14 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:00:36.216377 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-1d7da6f6-2611-4ccd-a5fe-705524f85daf req-21bc544a-c80d-472e-a217-bc6f876c96d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ac722a3-aadf-4791-b5b1-e5e5efebddc0", "tag": "6d958b2a-aaab-40bf-8bb7-ce4cd3fc57b5"}, {"name": "network-changed", "server_uuid": "686aa731-082f-4584-8607-5a40f0d63220", "tag": "a63ec384-e15d-441f-b027-6fb09676099b"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:36.218218 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:00:36.218218 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:00:36.234398 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-1d7da6f6-2611-4ccd-a5fe-705524f85daf req-21bc544a-c80d-472e-a217-bc6f876c96d1 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:36.235170 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-1d7da6f6-2611-4ccd-a5fe-705524f85daf req-21bc544a-c80d-472e-a217-bc6f876c96d1 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:36.267611 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-1d7da6f6-2611-4ccd-a5fe-705524f85daf req-21bc544a-c80d-472e-a217-bc6f876c96d1 service nova] Creating event network-changed:6d958b2a-aaab-40bf-8bb7-ce4cd3fc57b5 for instance 0ac722a3-aadf-4791-b5b1-e5e5efebddc0 on nch1-master-1 Jan 15 21:00:36.268635 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-1d7da6f6-2611-4ccd-a5fe-705524f85daf req-21bc544a-c80d-472e-a217-bc6f876c96d1 service nova] Creating event network-changed:a63ec384-e15d-441f-b027-6fb09676099b for instance 686aa731-082f-4584-8607-5a40f0d63220 on nch1-master-1 Jan 15 21:00:36.282378 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-1d7da6f6-2611-4ccd-a5fe-705524f85daf req-21bc544a-c80d-472e-a217-bc6f876c96d1 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.070344 Jan 15 21:00:36.283218 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1810/3631] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:00:36 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:00:36.291995 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-31e9841a-0ce4-4c10-9075-d361e62f5568 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:36.293437 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-31e9841a-0ce4-4c10-9075-d361e62f5568 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:36.317559 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-31e9841a-0ce4-4c10-9075-d361e62f5568 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:36.317992 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-31e9841a-0ce4-4c10-9075-d361e62f5568 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:36.319147 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-31e9841a-0ce4-4c10-9075-d361e62f5568 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:36.319664 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-31e9841a-0ce4-4c10-9075-d361e62f5568 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:36.413537 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-31e9841a-0ce4-4c10-9075-d361e62f5568 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 32601 microversion: 2.42 time: 0.126522 Jan 15 21:00:36.415322 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1811/3632] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:00:36 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 32601 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:00:36.603770 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4e52ea6e-8958-4a07-b73d-466bf04eaa17 tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:36.604484 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-4e52ea6e-8958-4a07-b73d-466bf04eaa17 tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] [instance: eab97efd-0a8e-4f55-981e-818ed5583d2c] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:36.631533 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4e52ea6e-8958-4a07-b73d-466bf04eaa17 tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:36.633166 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4e52ea6e-8958-4a07-b73d-466bf04eaa17 tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:36.634119 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4e52ea6e-8958-4a07-b73d-466bf04eaa17 tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:36.634891 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4e52ea6e-8958-4a07-b73d-466bf04eaa17 tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:36.873795 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-4e52ea6e-8958-4a07-b73d-466bf04eaa17 tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb21ef67d1f64f73af586e35f1b772de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf19dbd41564d638af8f2e69883d2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:36.888798 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-4e52ea6e-8958-4a07-b73d-466bf04eaa17 tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] 10.222.0.46 "GET /compute/v2.1/servers/eab97efd-0a8e-4f55-981e-818ed5583d2c" status: 200 len: 1469 microversion: 2.1 time: 0.290521 Jan 15 21:00:36.890748 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1812/3633] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:00:36 2022] GET /compute/v2.1/servers/eab97efd-0a8e-4f55-981e-818ed5583d2c => generated 1469 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:00:36.907159 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-9e80c1fe-1f3d-4e0e-9579-e09959094a4a tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8f9c6ea7f6496792258d683640c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a75218d537c4d63874297261bec70ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:36.919689 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-9e80c1fe-1f3d-4e0e-9579-e09959094a4a tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] 10.222.0.46 "GET /compute/v2.1/servers/4d836f07-866f-4e13-94ff-c4fe850e58d3" status: 200 len: 1317 microversion: 2.1 time: 0.878096 Jan 15 21:00:36.920283 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1822/3634] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:00:36 2022] GET /compute/v2.1/servers/4d836f07-866f-4e13-94ff-c4fe850e58d3 => generated 1317 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:00:37.059734 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ee5f0ab8-cb37-4bc6-9609-8011504b0e45 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:37.060390 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ee5f0ab8-cb37-4bc6-9609-8011504b0e45 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:37.072221 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ee5f0ab8-cb37-4bc6-9609-8011504b0e45 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:37.073089 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ee5f0ab8-cb37-4bc6-9609-8011504b0e45 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:37.074221 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ee5f0ab8-cb37-4bc6-9609-8011504b0e45 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:37.074988 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ee5f0ab8-cb37-4bc6-9609-8011504b0e45 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:37.138112 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-0973d43b-1b3d-4335-a793-0fc610173a91 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:37.149538 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-0973d43b-1b3d-4335-a793-0fc610173a91 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] [instance: 5e93486c-7c77-4855-85f4-2bc8bcf4832f] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:37.165463 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0973d43b-1b3d-4335-a793-0fc610173a91 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:37.166843 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0973d43b-1b3d-4335-a793-0fc610173a91 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:37.173459 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0973d43b-1b3d-4335-a793-0fc610173a91 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:37.174209 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0973d43b-1b3d-4335-a793-0fc610173a91 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:37.289898 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-0973d43b-1b3d-4335-a793-0fc610173a91 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] 10.222.0.46 "POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action" status: 200 len: 32650 microversion: 2.1 time: 0.168902 Jan 15 21:00:37.321578 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1823/3635] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:00:37 2022] POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action => generated 32650 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:00:37.331141 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-1069cf63-d952-47ed-9a50-7872ca2a1a6d tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:37.333615 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-1069cf63-d952-47ed-9a50-7872ca2a1a6d tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:37.377888 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1069cf63-d952-47ed-9a50-7872ca2a1a6d tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:37.380169 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1069cf63-d952-47ed-9a50-7872ca2a1a6d tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:37.380169 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1069cf63-d952-47ed-9a50-7872ca2a1a6d tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:37.380169 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1069cf63-d952-47ed-9a50-7872ca2a1a6d tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:37.439336 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-ee5f0ab8-cb37-4bc6-9609-8011504b0e45 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:37.457876 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-ee5f0ab8-cb37-4bc6-9609-8011504b0e45 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:37.458181 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-1069cf63-d952-47ed-9a50-7872ca2a1a6d tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action" status: 200 len: 14 microversion: 2.20 time: 0.133542 Jan 15 21:00:37.458924 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1824/3636] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:00:37 2022] POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action => generated 14 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:00:37.459843 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-ee5f0ab8-cb37-4bc6-9609-8011504b0e45 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:37.461386 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ee5f0ab8-cb37-4bc6-9609-8011504b0e45 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "GET /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220" status: 200 len: 1878 microversion: 2.32 time: 0.406391 Jan 15 21:00:37.462364 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1813/3637] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:00:37 2022] GET /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220 => generated 1878 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:00:37.466102 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-7fc6fb32-34bf-4af8-a8ff-b0e0a7a3f9cb tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:37.467074 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-7fc6fb32-34bf-4af8-a8ff-b0e0a7a3f9cb tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:37.469405 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-3573067c-82c9-4363-96ba-c4f97cc653eb tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:37.470755 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-3573067c-82c9-4363-96ba-c4f97cc653eb tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:37.480225 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7fc6fb32-34bf-4af8-a8ff-b0e0a7a3f9cb tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:37.480994 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7fc6fb32-34bf-4af8-a8ff-b0e0a7a3f9cb tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:37.481631 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3573067c-82c9-4363-96ba-c4f97cc653eb tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:37.482112 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3573067c-82c9-4363-96ba-c4f97cc653eb tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:37.482491 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7fc6fb32-34bf-4af8-a8ff-b0e0a7a3f9cb tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:37.482918 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3573067c-82c9-4363-96ba-c4f97cc653eb tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:37.483362 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3573067c-82c9-4363-96ba-c4f97cc653eb tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:37.483675 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7fc6fb32-34bf-4af8-a8ff-b0e0a7a3f9cb tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:37.549255 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-3573067c-82c9-4363-96ba-c4f97cc653eb tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 32601 microversion: 2.42 time: 0.085311 Jan 15 21:00:37.550422 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1814/3638] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:00:37 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 32601 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:00:37.715138 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-7fc6fb32-34bf-4af8-a8ff-b0e0a7a3f9cb tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:37.722642 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-7fc6fb32-34bf-4af8-a8ff-b0e0a7a3f9cb tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9" status: 200 len: 1670 microversion: 2.1 time: 0.261194 Jan 15 21:00:37.734586 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1825/3639] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:00:37 2022] GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9 => generated 1670 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:00:37.741012 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-458536c5-273f-4a42-b55f-8d6f10aa2536 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-898190419"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:37.743523 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-458536c5-273f-4a42-b55f-8d6f10aa2536 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:37.750968 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-458536c5-273f-4a42-b55f-8d6f10aa2536 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:37.751684 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-458536c5-273f-4a42-b55f-8d6f10aa2536 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:37.752527 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-458536c5-273f-4a42-b55f-8d6f10aa2536 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:37.753427 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-458536c5-273f-4a42-b55f-8d6f10aa2536 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:37.905837 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ae00f18f-f2a5-4664-891f-7133edded4dc tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:37.906901 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ae00f18f-f2a5-4664-891f-7133edded4dc tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] [instance: eab97efd-0a8e-4f55-981e-818ed5583d2c] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:37.921023 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ae00f18f-f2a5-4664-891f-7133edded4dc tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:37.924353 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ae00f18f-f2a5-4664-891f-7133edded4dc tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:37.925762 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ae00f18f-f2a5-4664-891f-7133edded4dc tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:37.927074 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ae00f18f-f2a5-4664-891f-7133edded4dc tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:37.951786 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-ae00f18f-f2a5-4664-891f-7133edded4dc tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] HTTP exception thrown: Instance eab97efd-0a8e-4f55-981e-818ed5583d2c could not be found. Jan 15 21:00:37.952711 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ae00f18f-f2a5-4664-891f-7133edded4dc tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] Returning 404 to user: Instance eab97efd-0a8e-4f55-981e-818ed5583d2c could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:00:37.954293 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ae00f18f-f2a5-4664-891f-7133edded4dc tempest-ServerPasswordTestJSON-268173168 tempest-ServerPasswordTestJSON-268173168-project] 10.222.0.46 "GET /compute/v2.1/servers/eab97efd-0a8e-4f55-981e-818ed5583d2c" status: 404 len: 111 microversion: 2.1 time: 0.052615 Jan 15 21:00:37.955320 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1826/3640] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:00:37 2022] GET /compute/v2.1/servers/eab97efd-0a8e-4f55-981e-818ed5583d2c => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 15 21:00:37.962780 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c00b5fef-3512-4f3e-99ee-c82e43d67125 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:37.963704 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c00b5fef-3512-4f3e-99ee-c82e43d67125 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: 4d836f07-866f-4e13-94ff-c4fe850e58d3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:37.971376 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c00b5fef-3512-4f3e-99ee-c82e43d67125 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:37.972193 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c00b5fef-3512-4f3e-99ee-c82e43d67125 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:37.975982 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c00b5fef-3512-4f3e-99ee-c82e43d67125 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:37.976761 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c00b5fef-3512-4f3e-99ee-c82e43d67125 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:38.199347 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-458536c5-273f-4a42-b55f-8d6f10aa2536 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action" status: 202 len: 0 microversion: 2.1 time: 0.443644 Jan 15 21:00:38.201560 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1815/3641] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:00:37 2022] POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action => generated 0 bytes in 466 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Jan 15 21:00:38.319695 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-e5420ab6-3c92-461b-ad85-51e9ea0a286d req-b870ed9c-ae85-4ac6-9f0b-0658d88c5195 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eab97efd-0a8e-4f55-981e-818ed5583d2c", "name": "network-vif-deleted", "tag": "32879371-6c0b-43fe-b550-fd4eca872af0"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:38.321842 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:00:38.321842 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:00:38.345296 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-e5420ab6-3c92-461b-ad85-51e9ea0a286d req-b870ed9c-ae85-4ac6-9f0b-0658d88c5195 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:38.346484 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-e5420ab6-3c92-461b-ad85-51e9ea0a286d req-b870ed9c-ae85-4ac6-9f0b-0658d88c5195 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:38.381643 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-c00b5fef-3512-4f3e-99ee-c82e43d67125 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8f9c6ea7f6496792258d683640c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a75218d537c4d63874297261bec70ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:38.393726 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-e5420ab6-3c92-461b-ad85-51e9ea0a286d req-b870ed9c-ae85-4ac6-9f0b-0658d88c5195 service nova] Creating event network-vif-deleted:32879371-6c0b-43fe-b550-fd4eca872af0 for instance eab97efd-0a8e-4f55-981e-818ed5583d2c on nch2-master-1 Jan 15 21:00:38.399185 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c00b5fef-3512-4f3e-99ee-c82e43d67125 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] 10.222.0.46 "GET /compute/v2.1/servers/4d836f07-866f-4e13-94ff-c4fe850e58d3" status: 200 len: 1507 microversion: 2.1 time: 0.441866 Jan 15 21:00:38.400468 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1827/3642] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:00:37 2022] GET /compute/v2.1/servers/4d836f07-866f-4e13-94ff-c4fe850e58d3 => generated 1507 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:00:38.413449 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-e5420ab6-3c92-461b-ad85-51e9ea0a286d req-b870ed9c-ae85-4ac6-9f0b-0658d88c5195 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091817 Jan 15 21:00:38.413449 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1816/3643] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:00:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 21:00:38.420040 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-fe516ecc-d568-4afe-8a16-6a035556b2fa tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:38.421901 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-fe516ecc-d568-4afe-8a16-6a035556b2fa tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] [instance: 5e93486c-7c77-4855-85f4-2bc8bcf4832f] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:38.422168 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-efc156a7-c8df-4881-a3a6-6181794015c0 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:38.422728 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-efc156a7-c8df-4881-a3a6-6181794015c0 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: 4d836f07-866f-4e13-94ff-c4fe850e58d3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:38.431078 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-efc156a7-c8df-4881-a3a6-6181794015c0 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:38.431543 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-efc156a7-c8df-4881-a3a6-6181794015c0 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:38.431688 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fe516ecc-d568-4afe-8a16-6a035556b2fa tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:38.432678 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fe516ecc-d568-4afe-8a16-6a035556b2fa tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:38.432855 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-efc156a7-c8df-4881-a3a6-6181794015c0 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:38.432855 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-efc156a7-c8df-4881-a3a6-6181794015c0 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:38.435352 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fe516ecc-d568-4afe-8a16-6a035556b2fa tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:38.435974 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fe516ecc-d568-4afe-8a16-6a035556b2fa tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:38.502403 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-fe516ecc-d568-4afe-8a16-6a035556b2fa tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] 10.222.0.46 "POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action" status: 200 len: 32650 microversion: 2.1 time: 0.090730 Jan 15 21:00:38.503291 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1817/3644] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:00:38 2022] POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action => generated 32650 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:00:38.515312 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-cc067dcf-b0a9-411c-85a0-c32cf2afaf4f tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:38.521310 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-cc067dcf-b0a9-411c-85a0-c32cf2afaf4f tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:38.533351 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cc067dcf-b0a9-411c-85a0-c32cf2afaf4f tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:38.533928 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cc067dcf-b0a9-411c-85a0-c32cf2afaf4f tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:38.535436 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cc067dcf-b0a9-411c-85a0-c32cf2afaf4f tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:38.536469 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cc067dcf-b0a9-411c-85a0-c32cf2afaf4f tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:38.582927 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-cc067dcf-b0a9-411c-85a0-c32cf2afaf4f tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action" status: 200 len: 14 microversion: 2.20 time: 0.074313 Jan 15 21:00:38.584818 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1818/3645] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:00:38 2022] POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action => generated 14 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:00:38.592013 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d273efae-0191-4666-b725-8ab06c9b950b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:38.593037 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-d273efae-0191-4666-b725-8ab06c9b950b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:38.603150 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d273efae-0191-4666-b725-8ab06c9b950b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:38.603981 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d273efae-0191-4666-b725-8ab06c9b950b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:38.605084 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d273efae-0191-4666-b725-8ab06c9b950b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:38.605613 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d273efae-0191-4666-b725-8ab06c9b950b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:38.633198 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-efc156a7-c8df-4881-a3a6-6181794015c0 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8f9c6ea7f6496792258d683640c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a75218d537c4d63874297261bec70ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:38.646136 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-efc156a7-c8df-4881-a3a6-6181794015c0 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] 10.222.0.46 "GET /compute/v2.1/servers/4d836f07-866f-4e13-94ff-c4fe850e58d3" status: 200 len: 1507 microversion: 2.1 time: 0.228965 Jan 15 21:00:38.651070 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1828/3646] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:00:38 2022] GET /compute/v2.1/servers/4d836f07-866f-4e13-94ff-c4fe850e58d3 => generated 1507 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:00:38.659051 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-81539499-4dde-4f6d-b7b2-097f4869a9e9 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:38.660475 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-81539499-4dde-4f6d-b7b2-097f4869a9e9 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:38.668001 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-81539499-4dde-4f6d-b7b2-097f4869a9e9 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:38.668596 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-81539499-4dde-4f6d-b7b2-097f4869a9e9 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:38.670237 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-81539499-4dde-4f6d-b7b2-097f4869a9e9 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:38.670727 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-81539499-4dde-4f6d-b7b2-097f4869a9e9 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:38.758287 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-81539499-4dde-4f6d-b7b2-097f4869a9e9 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.105713 Jan 15 21:00:38.759296 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1829/3647] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:00:38 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:00:38.764773 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ae27570c-85d4-41fa-acec-334e478069a5 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:38.766304 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ae27570c-85d4-41fa-acec-334e478069a5 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: 4d836f07-866f-4e13-94ff-c4fe850e58d3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:38.775270 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ae27570c-85d4-41fa-acec-334e478069a5 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:38.775927 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ae27570c-85d4-41fa-acec-334e478069a5 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:38.777146 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ae27570c-85d4-41fa-acec-334e478069a5 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:38.777791 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ae27570c-85d4-41fa-acec-334e478069a5 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:38.852132 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ae27570c-85d4-41fa-acec-334e478069a5 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] 10.222.0.46 "PUT /compute/v2.1/servers/4d836f07-866f-4e13-94ff-c4fe850e58d3" status: 200 len: 1079 microversion: 2.1 time: 0.091406 Jan 15 21:00:38.852799 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1830/3648] 10.222.0.46 () {60 vars in 1255 bytes} [Sat Jan 15 21:00:38 2022] PUT /compute/v2.1/servers/4d836f07-866f-4e13-94ff-c4fe850e58d3 => generated 1079 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:00:38.868029 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-1e72a4a7-7fcd-4313-8e4c-f469dcfeb94f tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:38.868711 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-1e72a4a7-7fcd-4313-8e4c-f469dcfeb94f tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: 4d836f07-866f-4e13-94ff-c4fe850e58d3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:38.875797 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1e72a4a7-7fcd-4313-8e4c-f469dcfeb94f tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:38.876300 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1e72a4a7-7fcd-4313-8e4c-f469dcfeb94f tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:38.877351 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1e72a4a7-7fcd-4313-8e4c-f469dcfeb94f tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:38.877948 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1e72a4a7-7fcd-4313-8e4c-f469dcfeb94f tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:38.921831 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-d273efae-0191-4666-b725-8ab06c9b950b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:38.935758 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-d273efae-0191-4666-b725-8ab06c9b950b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:38.937294 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-d273efae-0191-4666-b725-8ab06c9b950b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:38.939592 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d273efae-0191-4666-b725-8ab06c9b950b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "GET /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220" status: 200 len: 1878 microversion: 2.32 time: 0.352099 Jan 15 21:00:38.950544 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1819/3649] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:00:38 2022] GET /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220 => generated 1878 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:00:39.074181 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-1e72a4a7-7fcd-4313-8e4c-f469dcfeb94f tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8f9c6ea7f6496792258d683640c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a75218d537c4d63874297261bec70ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:39.082776 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-1e72a4a7-7fcd-4313-8e4c-f469dcfeb94f tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] 10.222.0.46 "GET /compute/v2.1/servers/4d836f07-866f-4e13-94ff-c4fe850e58d3" status: 200 len: 1505 microversion: 2.1 time: 0.218762 Jan 15 21:00:39.094219 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1831/3650] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:00:38 2022] GET /compute/v2.1/servers/4d836f07-866f-4e13-94ff-c4fe850e58d3 => generated 1505 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:00:39.101672 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-57455f1e-a62c-428e-8ec9-ba8502e5f734 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:39.102814 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-57455f1e-a62c-428e-8ec9-ba8502e5f734 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: 4d836f07-866f-4e13-94ff-c4fe850e58d3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:39.111383 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-57455f1e-a62c-428e-8ec9-ba8502e5f734 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:39.112096 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-57455f1e-a62c-428e-8ec9-ba8502e5f734 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:39.114304 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-57455f1e-a62c-428e-8ec9-ba8502e5f734 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:39.115166 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-57455f1e-a62c-428e-8ec9-ba8502e5f734 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:39.199311 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a71ab62e-0647-46fb-b838-b07ba279bb3a tempest-ExtensionsTest-1822332019 tempest-ExtensionsTest-1822332019-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:39.201409 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a71ab62e-0647-46fb-b838-b07ba279bb3a tempest-ExtensionsTest-1822332019 tempest-ExtensionsTest-1822332019-project] 10.222.0.46 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.189433 Jan 15 21:00:39.202171 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1820/3651] 10.222.0.46 () {58 vars in 1169 bytes} [Sat Jan 15 21:00:39 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:00:39.211586 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-35d6f08a-1ee8-41e7-b50a-e060c6712eb9 tempest-ExtensionsTest-1822332019 tempest-ExtensionsTest-1822332019-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:39.213671 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-35d6f08a-1ee8-41e7-b50a-e060c6712eb9 tempest-ExtensionsTest-1822332019 tempest-ExtensionsTest-1822332019-project] 10.222.0.46 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.006496 Jan 15 21:00:39.216863 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1821/3652] 10.222.0.46 () {58 vars in 1133 bytes} [Sat Jan 15 21:00:39 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 10 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:00:39.295443 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-57455f1e-a62c-428e-8ec9-ba8502e5f734 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8f9c6ea7f6496792258d683640c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a75218d537c4d63874297261bec70ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:39.304412 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-57455f1e-a62c-428e-8ec9-ba8502e5f734 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] 10.222.0.46 "GET /compute/v2.1/servers/4d836f07-866f-4e13-94ff-c4fe850e58d3" status: 200 len: 1505 microversion: 2.1 time: 0.208811 Jan 15 21:00:39.305556 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1832/3653] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:00:39 2022] GET /compute/v2.1/servers/4d836f07-866f-4e13-94ff-c4fe850e58d3 => generated 1505 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:00:39.322247 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8b6a9ddd-f1fe-483d-929e-9e7a39183910 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:39.324711 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-8b6a9ddd-f1fe-483d-929e-9e7a39183910 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: 4d836f07-866f-4e13-94ff-c4fe850e58d3] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:39.336174 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8b6a9ddd-f1fe-483d-929e-9e7a39183910 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:39.336792 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8b6a9ddd-f1fe-483d-929e-9e7a39183910 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:39.337631 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8b6a9ddd-f1fe-483d-929e-9e7a39183910 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:39.338043 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8b6a9ddd-f1fe-483d-929e-9e7a39183910 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:39.428041 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-8b6a9ddd-f1fe-483d-929e-9e7a39183910 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Flavor limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 21:00:39.428619 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-8b6a9ddd-f1fe-483d-929e-9e7a39183910 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Image limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 21:00:39.429361 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-8b6a9ddd-f1fe-483d-929e-9e7a39183910 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Flavor pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 21:00:39.429880 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-8b6a9ddd-f1fe-483d-929e-9e7a39183910 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Image pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 21:00:39.430418 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-8b6a9ddd-f1fe-483d-929e-9e7a39183910 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 21:00:39.506370 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-8b6a9ddd-f1fe-483d-929e-9e7a39183910 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: 4d836f07-866f-4e13-94ff-c4fe850e58d3] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:39.513573 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8b6a9ddd-f1fe-483d-929e-9e7a39183910 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:39.516572 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8b6a9ddd-f1fe-483d-929e-9e7a39183910 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:39.516696 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f5c3a65a-ba34-4b7d-8c64-da0dd285133f tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:39.517200 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8b6a9ddd-f1fe-483d-929e-9e7a39183910 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:39.517385 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f5c3a65a-ba34-4b7d-8c64-da0dd285133f tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] [instance: 5e93486c-7c77-4855-85f4-2bc8bcf4832f] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:39.517543 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8b6a9ddd-f1fe-483d-929e-9e7a39183910 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:39.532578 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f5c3a65a-ba34-4b7d-8c64-da0dd285133f tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:39.535881 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f5c3a65a-ba34-4b7d-8c64-da0dd285133f tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:39.538580 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f5c3a65a-ba34-4b7d-8c64-da0dd285133f tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:39.540732 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f5c3a65a-ba34-4b7d-8c64-da0dd285133f tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:39.556205 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-8b6a9ddd-f1fe-483d-929e-9e7a39183910 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] 10.222.0.46 "POST /compute/v2.1/servers/4d836f07-866f-4e13-94ff-c4fe850e58d3/action" status: 202 len: 1111 microversion: 2.1 time: 0.237664 Jan 15 21:00:39.560905 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1822/3654] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:00:39 2022] POST /compute/v2.1/servers/4d836f07-866f-4e13-94ff-c4fe850e58d3/action => generated 1111 bytes in 240 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 15 21:00:39.584070 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0d8399c3-2aa7-4035-87bd-ac4e9e81c6cd tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:39.584872 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-0d8399c3-2aa7-4035-87bd-ac4e9e81c6cd tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: 4d836f07-866f-4e13-94ff-c4fe850e58d3] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:39.600866 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0d8399c3-2aa7-4035-87bd-ac4e9e81c6cd tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:39.601104 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0d8399c3-2aa7-4035-87bd-ac4e9e81c6cd tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:39.601762 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0d8399c3-2aa7-4035-87bd-ac4e9e81c6cd tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:39.606285 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0d8399c3-2aa7-4035-87bd-ac4e9e81c6cd tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:39.631768 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f5c3a65a-ba34-4b7d-8c64-da0dd285133f tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] 10.222.0.46 "POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action" status: 200 len: 32650 microversion: 2.1 time: 0.120640 Jan 15 21:00:39.637063 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1833/3655] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:00:39 2022] POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action => generated 32650 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:00:39.657039 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-df5c5fef-1f20-46e9-9f64-fede2758f072 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:39.664501 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-df5c5fef-1f20-46e9-9f64-fede2758f072 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:39.674801 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-df5c5fef-1f20-46e9-9f64-fede2758f072 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:39.675876 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-df5c5fef-1f20-46e9-9f64-fede2758f072 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:39.677263 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-df5c5fef-1f20-46e9-9f64-fede2758f072 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:39.678022 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-df5c5fef-1f20-46e9-9f64-fede2758f072 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:39.748102 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-df5c5fef-1f20-46e9-9f64-fede2758f072 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action" status: 200 len: 14 microversion: 2.20 time: 0.106814 Jan 15 21:00:39.758413 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1834/3656] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:00:39 2022] POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action => generated 14 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:00:39.773117 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b63fda58-14a4-4b48-8171-b5dc0b834d64 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:39.775448 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b63fda58-14a4-4b48-8171-b5dc0b834d64 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:39.783815 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b63fda58-14a4-4b48-8171-b5dc0b834d64 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:39.784283 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b63fda58-14a4-4b48-8171-b5dc0b834d64 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:39.785089 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b63fda58-14a4-4b48-8171-b5dc0b834d64 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:39.786403 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b63fda58-14a4-4b48-8171-b5dc0b834d64 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:39.842350 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-0d8399c3-2aa7-4035-87bd-ac4e9e81c6cd tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8f9c6ea7f6496792258d683640c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a75218d537c4d63874297261bec70ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:39.845375 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b63fda58-14a4-4b48-8171-b5dc0b834d64 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.078478 Jan 15 21:00:39.847069 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1835/3657] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:00:39 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:00:39.856804 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0d8399c3-2aa7-4035-87bd-ac4e9e81c6cd tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] 10.222.0.46 "GET /compute/v2.1/servers/4d836f07-866f-4e13-94ff-c4fe850e58d3" status: 200 len: 1516 microversion: 2.1 time: 0.287898 Jan 15 21:00:39.858519 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1823/3658] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:00:39 2022] GET /compute/v2.1/servers/4d836f07-866f-4e13-94ff-c4fe850e58d3 => generated 1516 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:00:39.960793 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-adec4cdf-7627-42e0-97f5-d73f83c0b61b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:39.961633 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-adec4cdf-7627-42e0-97f5-d73f83c0b61b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:39.976522 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-adec4cdf-7627-42e0-97f5-d73f83c0b61b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:39.976996 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-adec4cdf-7627-42e0-97f5-d73f83c0b61b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:39.977798 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-adec4cdf-7627-42e0-97f5-d73f83c0b61b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:39.978385 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-adec4cdf-7627-42e0-97f5-d73f83c0b61b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:40.099887 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-08791f5f-df6b-4d38-b4a7-497828767e37 req-26bd5e40-f1cc-4f65-82ac-668a80ef26f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4504a13b-d10e-436a-a5ef-991829938dd9", "name": "network-vif-unplugged", "status": "completed", "tag": "f7503e3b-a43e-4550-8109-a1fb1aa2d5f1"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:40.101691 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:00:40.101691 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:00:40.120014 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-08791f5f-df6b-4d38-b4a7-497828767e37 req-26bd5e40-f1cc-4f65-82ac-668a80ef26f0 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:40.120552 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-08791f5f-df6b-4d38-b4a7-497828767e37 req-26bd5e40-f1cc-4f65-82ac-668a80ef26f0 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:40.163862 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-08791f5f-df6b-4d38-b4a7-497828767e37 req-26bd5e40-f1cc-4f65-82ac-668a80ef26f0 service nova] Creating event network-vif-unplugged:f7503e3b-a43e-4550-8109-a1fb1aa2d5f1 for instance 4504a13b-d10e-436a-a5ef-991829938dd9 on nch1-master-1 Jan 15 21:00:40.180448 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-08791f5f-df6b-4d38-b4a7-497828767e37 req-26bd5e40-f1cc-4f65-82ac-668a80ef26f0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.086205 Jan 15 21:00:40.181467 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1824/3659] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:00:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 21:00:40.328444 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-adec4cdf-7627-42e0-97f5-d73f83c0b61b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:40.341627 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-adec4cdf-7627-42e0-97f5-d73f83c0b61b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:40.343469 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-adec4cdf-7627-42e0-97f5-d73f83c0b61b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:40.345126 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-adec4cdf-7627-42e0-97f5-d73f83c0b61b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "GET /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220" status: 200 len: 1878 microversion: 2.32 time: 0.391333 Jan 15 21:00:40.345807 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1836/3660] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:00:39 2022] GET /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220 => generated 1878 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:00:40.652177 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-17e7b013-6bee-4e6a-8efe-b9ae707ef101 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:40.653640 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-17e7b013-6bee-4e6a-8efe-b9ae707ef101 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] [instance: 5e93486c-7c77-4855-85f4-2bc8bcf4832f] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:40.671857 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-17e7b013-6bee-4e6a-8efe-b9ae707ef101 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:40.672628 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-17e7b013-6bee-4e6a-8efe-b9ae707ef101 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:40.673961 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-17e7b013-6bee-4e6a-8efe-b9ae707ef101 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:40.674751 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-17e7b013-6bee-4e6a-8efe-b9ae707ef101 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:40.752397 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-17e7b013-6bee-4e6a-8efe-b9ae707ef101 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] 10.222.0.46 "POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action" status: 200 len: 32650 microversion: 2.1 time: 0.109584 Jan 15 21:00:40.757698 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1825/3661] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:00:40 2022] POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action => generated 32650 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:00:40.772554 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-95c047f9-18a1-4a6a-8208-e03a0c1a9179 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:40.774549 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-95c047f9-18a1-4a6a-8208-e03a0c1a9179 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:40.785418 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-95c047f9-18a1-4a6a-8208-e03a0c1a9179 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:40.785862 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-95c047f9-18a1-4a6a-8208-e03a0c1a9179 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:40.786870 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-95c047f9-18a1-4a6a-8208-e03a0c1a9179 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:40.787898 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-95c047f9-18a1-4a6a-8208-e03a0c1a9179 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:40.844776 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-95c047f9-18a1-4a6a-8208-e03a0c1a9179 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action" status: 200 len: 14 microversion: 2.20 time: 0.077874 Jan 15 21:00:40.846183 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1837/3662] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:00:40 2022] POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action => generated 14 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:00:40.862008 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d569a71c-f7c6-4121-bff2-645dfba7aade tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:40.864365 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d569a71c-f7c6-4121-bff2-645dfba7aade tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:40.873998 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d569a71c-f7c6-4121-bff2-645dfba7aade tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:40.874729 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d569a71c-f7c6-4121-bff2-645dfba7aade tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:40.875984 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d569a71c-f7c6-4121-bff2-645dfba7aade tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:40.876666 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d569a71c-f7c6-4121-bff2-645dfba7aade tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:40.950373 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d569a71c-f7c6-4121-bff2-645dfba7aade tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.094404 Jan 15 21:00:40.951472 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1838/3663] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:00:40 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:00:40.962258 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-1fcc97f4-e3c1-4aef-91ff-5d07ad93ca64 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:40.964279 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-1fcc97f4-e3c1-4aef-91ff-5d07ad93ca64 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: 4d836f07-866f-4e13-94ff-c4fe850e58d3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:40.977657 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1fcc97f4-e3c1-4aef-91ff-5d07ad93ca64 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:40.978399 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1fcc97f4-e3c1-4aef-91ff-5d07ad93ca64 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:40.979379 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1fcc97f4-e3c1-4aef-91ff-5d07ad93ca64 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:40.979974 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1fcc97f4-e3c1-4aef-91ff-5d07ad93ca64 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:41.082871 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-55aa2349-faa6-49b9-ae73-8e434bf1cb0a tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-890372764", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "networks": "none"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:41.165294 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-55aa2349-faa6-49b9-ae73-8e434bf1cb0a tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Flavor limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 21:00:41.166696 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-55aa2349-faa6-49b9-ae73-8e434bf1cb0a tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Image limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 21:00:41.167283 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-55aa2349-faa6-49b9-ae73-8e434bf1cb0a tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Flavor pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 21:00:41.168497 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-55aa2349-faa6-49b9-ae73-8e434bf1cb0a tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Image pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 21:00:41.169424 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-55aa2349-faa6-49b9-ae73-8e434bf1cb0a tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 21:00:41.181315 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-55aa2349-faa6-49b9-ae73-8e434bf1cb0a tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:41.181655 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-55aa2349-faa6-49b9-ae73-8e434bf1cb0a tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:41.182638 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-55aa2349-faa6-49b9-ae73-8e434bf1cb0a tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:41.183104 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-55aa2349-faa6-49b9-ae73-8e434bf1cb0a tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:41.212664 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-1fcc97f4-e3c1-4aef-91ff-5d07ad93ca64 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8f9c6ea7f6496792258d683640c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a75218d537c4d63874297261bec70ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:41.222038 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-55aa2349-faa6-49b9-ae73-8e434bf1cb0a tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Getting quotas for project 8fdff116c9f44e98b33c9f9346be1af3. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:00:41.226559 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-1fcc97f4-e3c1-4aef-91ff-5d07ad93ca64 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] 10.222.0.46 "GET /compute/v2.1/servers/4d836f07-866f-4e13-94ff-c4fe850e58d3" status: 200 len: 1516 microversion: 2.1 time: 0.273339 Jan 15 21:00:41.227495 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1839/3664] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:00:40 2022] GET /compute/v2.1/servers/4d836f07-866f-4e13-94ff-c4fe850e58d3 => generated 1516 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:00:41.234548 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-55aa2349-faa6-49b9-ae73-8e434bf1cb0a tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Getting quotas for user ea59ebcaec344a22a53807319a88af69 and project 8fdff116c9f44e98b33c9f9346be1af3. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:00:41.255128 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-55aa2349-faa6-49b9-ae73-8e434bf1cb0a tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Going to run 1 instances... {{(pid=129366) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 21:00:41.259189 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-55aa2349-faa6-49b9-ae73-8e434bf1cb0a tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] [instance: fe691c6c-ffa5-464a-803d-75eb61fd8268] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 21:00:41.323752 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-55aa2349-faa6-49b9-ae73-8e434bf1cb0a tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.521353 Jan 15 21:00:41.329794 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1826/3665] 10.222.0.46 () {62 vars in 1187 bytes} [Sat Jan 15 21:00:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 529 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jan 15 21:00:41.338666 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-1ca7c508-b8f5-4d09-8cc0-48c2f7116a14 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:41.339559 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-1ca7c508-b8f5-4d09-8cc0-48c2f7116a14 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] [instance: fe691c6c-ffa5-464a-803d-75eb61fd8268] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:41.364423 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b563d6c5-6da2-44b1-85e4-8cf1fdc0e9fb tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:41.365060 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b563d6c5-6da2-44b1-85e4-8cf1fdc0e9fb tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:41.391529 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b563d6c5-6da2-44b1-85e4-8cf1fdc0e9fb tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:41.396153 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b563d6c5-6da2-44b1-85e4-8cf1fdc0e9fb tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:41.397746 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b563d6c5-6da2-44b1-85e4-8cf1fdc0e9fb tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:41.398202 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b563d6c5-6da2-44b1-85e4-8cf1fdc0e9fb tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:41.434770 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-1ca7c508-b8f5-4d09-8cc0-48c2f7116a14 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea59ebcaec344a22a53807319a88af69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdff116c9f44e98b33c9f9346be1af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:41.446080 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-1ca7c508-b8f5-4d09-8cc0-48c2f7116a14 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea59ebcaec344a22a53807319a88af69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdff116c9f44e98b33c9f9346be1af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:41.448624 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-1ca7c508-b8f5-4d09-8cc0-48c2f7116a14 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea59ebcaec344a22a53807319a88af69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdff116c9f44e98b33c9f9346be1af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:41.449833 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-1ca7c508-b8f5-4d09-8cc0-48c2f7116a14 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] 10.222.0.46 "GET /compute/v2.1/servers/fe691c6c-ffa5-464a-803d-75eb61fd8268" status: 200 len: 1277 microversion: 2.54 time: 0.118523 Jan 15 21:00:41.450701 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1840/3666] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:00:41 2022] GET /compute/v2.1/servers/fe691c6c-ffa5-464a-803d-75eb61fd8268 => generated 1277 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:00:41.706571 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-b563d6c5-6da2-44b1-85e4-8cf1fdc0e9fb tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:41.723767 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-b563d6c5-6da2-44b1-85e4-8cf1fdc0e9fb tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:41.726253 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-b563d6c5-6da2-44b1-85e4-8cf1fdc0e9fb tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:41.727750 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b563d6c5-6da2-44b1-85e4-8cf1fdc0e9fb tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "GET /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220" status: 200 len: 1878 microversion: 2.32 time: 0.367934 Jan 15 21:00:41.739881 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1827/3667] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:00:41 2022] GET /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220 => generated 1878 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 15 21:00:41.766971 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3237e7b6-5e90-4fd5-a1fb-a05112a85226 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:41.768948 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-3237e7b6-5e90-4fd5-a1fb-a05112a85226 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] [instance: 5e93486c-7c77-4855-85f4-2bc8bcf4832f] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:41.780594 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3237e7b6-5e90-4fd5-a1fb-a05112a85226 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:41.782312 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3237e7b6-5e90-4fd5-a1fb-a05112a85226 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:41.784306 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3237e7b6-5e90-4fd5-a1fb-a05112a85226 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:41.785668 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3237e7b6-5e90-4fd5-a1fb-a05112a85226 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:41.839845 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3237e7b6-5e90-4fd5-a1fb-a05112a85226 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] 10.222.0.46 "POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action" status: 200 len: 32650 microversion: 2.1 time: 0.078580 Jan 15 21:00:41.841091 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1841/3668] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:00:41 2022] POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action => generated 32650 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:00:41.859585 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-543cace3-b10c-42ac-9c3a-0bfb3afb84fe tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:41.860804 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-543cace3-b10c-42ac-9c3a-0bfb3afb84fe tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:41.869845 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-543cace3-b10c-42ac-9c3a-0bfb3afb84fe tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:41.870478 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-543cace3-b10c-42ac-9c3a-0bfb3afb84fe tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:41.871532 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-543cace3-b10c-42ac-9c3a-0bfb3afb84fe tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:41.872058 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-543cace3-b10c-42ac-9c3a-0bfb3afb84fe tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:41.928458 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-543cace3-b10c-42ac-9c3a-0bfb3afb84fe tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action" status: 200 len: 14 microversion: 2.20 time: 0.072741 Jan 15 21:00:41.935135 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1828/3669] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:00:41 2022] POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action => generated 14 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:00:41.965174 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9c771c0a-83db-4385-a2c8-73090fe2443e tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:41.967062 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-9c771c0a-83db-4385-a2c8-73090fe2443e tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:41.982081 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9c771c0a-83db-4385-a2c8-73090fe2443e tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:41.997331 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9c771c0a-83db-4385-a2c8-73090fe2443e tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:42.000684 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9c771c0a-83db-4385-a2c8-73090fe2443e tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:42.001458 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9c771c0a-83db-4385-a2c8-73090fe2443e tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:42.080257 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-9c771c0a-83db-4385-a2c8-73090fe2443e tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.119309 Jan 15 21:00:42.085315 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1842/3670] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:00:41 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:00:42.246529 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8409e153-3506-4ed3-9591-b5c3b86ed96a tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:42.247762 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-8409e153-3506-4ed3-9591-b5c3b86ed96a tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: 4d836f07-866f-4e13-94ff-c4fe850e58d3] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:42.260285 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8409e153-3506-4ed3-9591-b5c3b86ed96a tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:42.261061 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8409e153-3506-4ed3-9591-b5c3b86ed96a tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:42.262059 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8409e153-3506-4ed3-9591-b5c3b86ed96a tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:42.262810 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8409e153-3506-4ed3-9591-b5c3b86ed96a tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:42.470956 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-6ecc3a7d-4825-4bbb-b304-e09ac7eb9f4e tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:42.472012 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-6ecc3a7d-4825-4bbb-b304-e09ac7eb9f4e tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] [instance: fe691c6c-ffa5-464a-803d-75eb61fd8268] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:42.488616 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6ecc3a7d-4825-4bbb-b304-e09ac7eb9f4e tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:42.493243 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6ecc3a7d-4825-4bbb-b304-e09ac7eb9f4e tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:42.494210 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6ecc3a7d-4825-4bbb-b304-e09ac7eb9f4e tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:42.496831 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6ecc3a7d-4825-4bbb-b304-e09ac7eb9f4e tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:42.569966 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-8409e153-3506-4ed3-9591-b5c3b86ed96a tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8f9c6ea7f6496792258d683640c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a75218d537c4d63874297261bec70ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:42.583616 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-8409e153-3506-4ed3-9591-b5c3b86ed96a tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] 10.222.0.46 "GET /compute/v2.1/servers/4d836f07-866f-4e13-94ff-c4fe850e58d3" status: 200 len: 1516 microversion: 2.1 time: 0.341463 Jan 15 21:00:42.598259 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1829/3671] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:00:42 2022] GET /compute/v2.1/servers/4d836f07-866f-4e13-94ff-c4fe850e58d3 => generated 1516 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:00:42.647446 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-6ecc3a7d-4825-4bbb-b304-e09ac7eb9f4e tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea59ebcaec344a22a53807319a88af69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdff116c9f44e98b33c9f9346be1af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:42.657908 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-6ecc3a7d-4825-4bbb-b304-e09ac7eb9f4e tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea59ebcaec344a22a53807319a88af69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdff116c9f44e98b33c9f9346be1af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:42.659872 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-6ecc3a7d-4825-4bbb-b304-e09ac7eb9f4e tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea59ebcaec344a22a53807319a88af69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdff116c9f44e98b33c9f9346be1af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:42.662526 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-6ecc3a7d-4825-4bbb-b304-e09ac7eb9f4e tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] 10.222.0.46 "GET /compute/v2.1/servers/fe691c6c-ffa5-464a-803d-75eb61fd8268" status: 200 len: 1329 microversion: 2.54 time: 0.195622 Jan 15 21:00:42.663745 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1843/3672] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:00:42 2022] GET /compute/v2.1/servers/fe691c6c-ffa5-464a-803d-75eb61fd8268 => generated 1329 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:00:42.747562 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-32666f3a-0e65-4a74-9e8e-ae6a264e43a0 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:42.748192 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-32666f3a-0e65-4a74-9e8e-ae6a264e43a0 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:42.754536 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-32666f3a-0e65-4a74-9e8e-ae6a264e43a0 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:42.755245 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-32666f3a-0e65-4a74-9e8e-ae6a264e43a0 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:42.756291 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-32666f3a-0e65-4a74-9e8e-ae6a264e43a0 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:42.757087 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-32666f3a-0e65-4a74-9e8e-ae6a264e43a0 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:42.856570 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-777303ef-b72b-4fc2-9b79-397b6500e69e tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:42.859868 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-777303ef-b72b-4fc2-9b79-397b6500e69e tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] [instance: 5e93486c-7c77-4855-85f4-2bc8bcf4832f] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:42.884768 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-777303ef-b72b-4fc2-9b79-397b6500e69e tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:42.885289 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-777303ef-b72b-4fc2-9b79-397b6500e69e tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:42.886120 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-777303ef-b72b-4fc2-9b79-397b6500e69e tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:42.886568 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-777303ef-b72b-4fc2-9b79-397b6500e69e tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:42.974869 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-777303ef-b72b-4fc2-9b79-397b6500e69e tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] 10.222.0.46 "POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action" status: 200 len: 32650 microversion: 2.1 time: 0.123780 Jan 15 21:00:42.978650 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1844/3673] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:00:42 2022] POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action => generated 32650 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 21:00:42.987501 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c9e6d47b-4670-4585-afa9-877f43d9edf9 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:42.989186 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c9e6d47b-4670-4585-afa9-877f43d9edf9 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:42.997383 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c9e6d47b-4670-4585-afa9-877f43d9edf9 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:42.997839 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c9e6d47b-4670-4585-afa9-877f43d9edf9 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:42.998821 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c9e6d47b-4670-4585-afa9-877f43d9edf9 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:42.999429 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c9e6d47b-4670-4585-afa9-877f43d9edf9 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:43.080811 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c9e6d47b-4670-4585-afa9-877f43d9edf9 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action" status: 200 len: 8197 microversion: 2.20 time: 0.102957 Jan 15 21:00:43.085740 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1845/3674] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:00:42 2022] POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action => generated 8197 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:00:43.094632 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-292465f4-c8a9-42e6-ac4b-b03e49abec4b tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:43.095715 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-292465f4-c8a9-42e6-ac4b-b03e49abec4b tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:43.113728 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-292465f4-c8a9-42e6-ac4b-b03e49abec4b tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:43.114251 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-292465f4-c8a9-42e6-ac4b-b03e49abec4b tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:43.115027 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-292465f4-c8a9-42e6-ac4b-b03e49abec4b tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:43.115474 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-292465f4-c8a9-42e6-ac4b-b03e49abec4b tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:43.169019 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-32666f3a-0e65-4a74-9e8e-ae6a264e43a0 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:43.180828 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-32666f3a-0e65-4a74-9e8e-ae6a264e43a0 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:43.183336 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-32666f3a-0e65-4a74-9e8e-ae6a264e43a0 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:43.184531 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-32666f3a-0e65-4a74-9e8e-ae6a264e43a0 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "GET /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220" status: 200 len: 1878 microversion: 2.32 time: 0.440715 Jan 15 21:00:43.185547 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1830/3675] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:00:42 2022] GET /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220 => generated 1878 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:00:43.221058 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-292465f4-c8a9-42e6-ac4b-b03e49abec4b tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.127225 Jan 15 21:00:43.222480 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1846/3676] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:00:43 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:00:43.603278 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d45df0d9-ceda-4b9b-a1f4-6bfcd0a3e95b tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:43.603962 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-d45df0d9-ceda-4b9b-a1f4-6bfcd0a3e95b tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: 4d836f07-866f-4e13-94ff-c4fe850e58d3] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:43.611752 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d45df0d9-ceda-4b9b-a1f4-6bfcd0a3e95b tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:43.612485 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d45df0d9-ceda-4b9b-a1f4-6bfcd0a3e95b tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:43.613603 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d45df0d9-ceda-4b9b-a1f4-6bfcd0a3e95b tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:43.614547 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d45df0d9-ceda-4b9b-a1f4-6bfcd0a3e95b tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:43.687735 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d6a109c3-6129-4d1b-881d-f425188d1beb tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:43.688978 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d6a109c3-6129-4d1b-881d-f425188d1beb tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] [instance: fe691c6c-ffa5-464a-803d-75eb61fd8268] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:43.716920 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d6a109c3-6129-4d1b-881d-f425188d1beb tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:43.717568 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d6a109c3-6129-4d1b-881d-f425188d1beb tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:43.721342 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d6a109c3-6129-4d1b-881d-f425188d1beb tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:43.722137 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d6a109c3-6129-4d1b-881d-f425188d1beb tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:43.839622 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-d6a109c3-6129-4d1b-881d-f425188d1beb tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea59ebcaec344a22a53807319a88af69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdff116c9f44e98b33c9f9346be1af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:43.851000 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-d6a109c3-6129-4d1b-881d-f425188d1beb tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea59ebcaec344a22a53807319a88af69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdff116c9f44e98b33c9f9346be1af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:43.858255 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-d6a109c3-6129-4d1b-881d-f425188d1beb tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea59ebcaec344a22a53807319a88af69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdff116c9f44e98b33c9f9346be1af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:43.861697 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d6a109c3-6129-4d1b-881d-f425188d1beb tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] 10.222.0.46 "GET /compute/v2.1/servers/fe691c6c-ffa5-464a-803d-75eb61fd8268" status: 200 len: 1335 microversion: 2.54 time: 0.181689 Jan 15 21:00:43.879603 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1847/3677] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:00:43 2022] GET /compute/v2.1/servers/fe691c6c-ffa5-464a-803d-75eb61fd8268 => generated 1335 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 15 21:00:43.988026 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a27525da-7046-4220-8e4a-9c83db1bb522 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:43.989131 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a27525da-7046-4220-8e4a-9c83db1bb522 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] [instance: 5e93486c-7c77-4855-85f4-2bc8bcf4832f] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:44.002108 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a27525da-7046-4220-8e4a-9c83db1bb522 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:44.002819 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a27525da-7046-4220-8e4a-9c83db1bb522 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:44.009329 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-d45df0d9-ceda-4b9b-a1f4-6bfcd0a3e95b tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8f9c6ea7f6496792258d683640c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a75218d537c4d63874297261bec70ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:44.015715 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a27525da-7046-4220-8e4a-9c83db1bb522 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:44.016882 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a27525da-7046-4220-8e4a-9c83db1bb522 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:44.020672 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d45df0d9-ceda-4b9b-a1f4-6bfcd0a3e95b tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] 10.222.0.46 "GET /compute/v2.1/servers/4d836f07-866f-4e13-94ff-c4fe850e58d3" status: 200 len: 1516 microversion: 2.1 time: 0.421948 Jan 15 21:00:44.032886 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1831/3678] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:00:43 2022] GET /compute/v2.1/servers/4d836f07-866f-4e13-94ff-c4fe850e58d3 => generated 1516 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:00:44.087630 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a27525da-7046-4220-8e4a-9c83db1bb522 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] 10.222.0.46 "POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action" status: 200 len: 32650 microversion: 2.1 time: 0.102939 Jan 15 21:00:44.093325 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1848/3679] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:00:43 2022] POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action => generated 32650 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:00:44.095913 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9fc9be38-e52a-4ec0-9400-b71dfad58194 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:44.097426 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-9fc9be38-e52a-4ec0-9400-b71dfad58194 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:44.112300 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9fc9be38-e52a-4ec0-9400-b71dfad58194 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:44.113601 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9fc9be38-e52a-4ec0-9400-b71dfad58194 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:44.115365 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9fc9be38-e52a-4ec0-9400-b71dfad58194 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:44.115966 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9fc9be38-e52a-4ec0-9400-b71dfad58194 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:44.208243 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-266a5903-0e1f-4764-a420-96c1c869e5b7 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:44.209318 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-266a5903-0e1f-4764-a420-96c1c869e5b7 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:44.218790 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-9fc9be38-e52a-4ec0-9400-b71dfad58194 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action" status: 200 len: 16388 microversion: 2.20 time: 0.128620 Jan 15 21:00:44.226311 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1832/3680] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:00:44 2022] POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action => generated 16388 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:00:44.245450 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-266a5903-0e1f-4764-a420-96c1c869e5b7 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:44.245939 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-266a5903-0e1f-4764-a420-96c1c869e5b7 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:44.246808 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-266a5903-0e1f-4764-a420-96c1c869e5b7 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:44.249288 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0b046fd0-6d2a-41b3-9fdb-d350e144d7fb tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:44.250048 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-266a5903-0e1f-4764-a420-96c1c869e5b7 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:44.252797 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-0b046fd0-6d2a-41b3-9fdb-d350e144d7fb tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:44.281682 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0b046fd0-6d2a-41b3-9fdb-d350e144d7fb tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:44.282423 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0b046fd0-6d2a-41b3-9fdb-d350e144d7fb tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:44.284856 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0b046fd0-6d2a-41b3-9fdb-d350e144d7fb tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:44.286415 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0b046fd0-6d2a-41b3-9fdb-d350e144d7fb tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:44.362452 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0b046fd0-6d2a-41b3-9fdb-d350e144d7fb tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.130521 Jan 15 21:00:44.366696 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1833/3681] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:00:44 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:00:44.413060 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-f8c74eac-8b8e-4018-ad60-c31bd969846f req-24679a7c-e17b-4aaf-b6be-6609ddab3558 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4504a13b-d10e-436a-a5ef-991829938dd9", "name": "network-vif-plugged", "status": "completed", "tag": "f7503e3b-a43e-4550-8109-a1fb1aa2d5f1"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:44.419022 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:00:44.419022 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:00:44.448014 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-f8c74eac-8b8e-4018-ad60-c31bd969846f req-24679a7c-e17b-4aaf-b6be-6609ddab3558 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:44.449458 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-f8c74eac-8b8e-4018-ad60-c31bd969846f req-24679a7c-e17b-4aaf-b6be-6609ddab3558 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:44.495288 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-f8c74eac-8b8e-4018-ad60-c31bd969846f req-24679a7c-e17b-4aaf-b6be-6609ddab3558 service nova] Creating event network-vif-plugged:f7503e3b-a43e-4550-8109-a1fb1aa2d5f1 for instance 4504a13b-d10e-436a-a5ef-991829938dd9 on nch1-master-1 Jan 15 21:00:44.510174 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-f8c74eac-8b8e-4018-ad60-c31bd969846f req-24679a7c-e17b-4aaf-b6be-6609ddab3558 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101916 Jan 15 21:00:44.510914 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1834/3682] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:00:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:00:44.681446 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-266a5903-0e1f-4764-a420-96c1c869e5b7 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:44.695404 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-266a5903-0e1f-4764-a420-96c1c869e5b7 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:44.697312 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-266a5903-0e1f-4764-a420-96c1c869e5b7 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:44.698712 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-266a5903-0e1f-4764-a420-96c1c869e5b7 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "GET /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220" status: 200 len: 1878 microversion: 2.32 time: 0.497998 Jan 15 21:00:44.699772 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1849/3683] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:00:44 2022] GET /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220 => generated 1878 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 15 21:00:44.888764 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b9f34a73-5ede-456f-998b-a049e3d3a311 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:44.890809 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b9f34a73-5ede-456f-998b-a049e3d3a311 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] [instance: fe691c6c-ffa5-464a-803d-75eb61fd8268] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:44.903507 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b9f34a73-5ede-456f-998b-a049e3d3a311 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:44.904144 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b9f34a73-5ede-456f-998b-a049e3d3a311 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:44.905213 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b9f34a73-5ede-456f-998b-a049e3d3a311 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:44.905890 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b9f34a73-5ede-456f-998b-a049e3d3a311 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:45.042170 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-b9f34a73-5ede-456f-998b-a049e3d3a311 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea59ebcaec344a22a53807319a88af69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdff116c9f44e98b33c9f9346be1af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:45.043502 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-414d0e2c-35b0-430b-94f6-631d88b3b751 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:45.044739 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-414d0e2c-35b0-430b-94f6-631d88b3b751 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: 4d836f07-866f-4e13-94ff-c4fe850e58d3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:45.056623 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-b9f34a73-5ede-456f-998b-a049e3d3a311 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea59ebcaec344a22a53807319a88af69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdff116c9f44e98b33c9f9346be1af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:45.058962 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-b9f34a73-5ede-456f-998b-a049e3d3a311 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea59ebcaec344a22a53807319a88af69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdff116c9f44e98b33c9f9346be1af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:45.060390 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b9f34a73-5ede-456f-998b-a049e3d3a311 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] 10.222.0.46 "GET /compute/v2.1/servers/fe691c6c-ffa5-464a-803d-75eb61fd8268" status: 200 len: 1335 microversion: 2.54 time: 0.179517 Jan 15 21:00:45.061144 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1835/3684] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:00:44 2022] GET /compute/v2.1/servers/fe691c6c-ffa5-464a-803d-75eb61fd8268 => generated 1335 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:00:45.073071 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-414d0e2c-35b0-430b-94f6-631d88b3b751 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:45.073071 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-414d0e2c-35b0-430b-94f6-631d88b3b751 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:45.073701 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-414d0e2c-35b0-430b-94f6-631d88b3b751 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:45.074352 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-414d0e2c-35b0-430b-94f6-631d88b3b751 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:45.103157 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-2d922471-273d-471f-9d9e-de626ea10cce tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:45.105135 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-2d922471-273d-471f-9d9e-de626ea10cce tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] [instance: 5e93486c-7c77-4855-85f4-2bc8bcf4832f] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:45.125761 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2d922471-273d-471f-9d9e-de626ea10cce tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:45.126554 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2d922471-273d-471f-9d9e-de626ea10cce tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:45.127604 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2d922471-273d-471f-9d9e-de626ea10cce tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:45.129891 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2d922471-273d-471f-9d9e-de626ea10cce tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:45.208345 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-2d922471-273d-471f-9d9e-de626ea10cce tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] 10.222.0.46 "POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action" status: 200 len: 32650 microversion: 2.1 time: 0.111098 Jan 15 21:00:45.210089 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1836/3685] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:00:45 2022] POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action => generated 32650 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:00:45.247303 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-565399bc-95fc-484d-900c-1bd0bf8e3f40 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:45.248435 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-565399bc-95fc-484d-900c-1bd0bf8e3f40 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:45.262410 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-565399bc-95fc-484d-900c-1bd0bf8e3f40 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:45.263462 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-565399bc-95fc-484d-900c-1bd0bf8e3f40 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:45.264669 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-565399bc-95fc-484d-900c-1bd0bf8e3f40 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:45.265293 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-565399bc-95fc-484d-900c-1bd0bf8e3f40 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:45.359837 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-565399bc-95fc-484d-900c-1bd0bf8e3f40 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action" status: 200 len: 16388 microversion: 2.20 time: 0.123675 Jan 15 21:00:45.364769 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1837/3686] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:00:45 2022] POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action => generated 16388 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:00:45.397066 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-34867eb3-800d-4e21-9070-059ff2111cdb tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:45.399482 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-34867eb3-800d-4e21-9070-059ff2111cdb tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:45.430209 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-34867eb3-800d-4e21-9070-059ff2111cdb tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:45.444291 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-34867eb3-800d-4e21-9070-059ff2111cdb tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:45.445693 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-34867eb3-800d-4e21-9070-059ff2111cdb tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:45.446289 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-34867eb3-800d-4e21-9070-059ff2111cdb tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:45.574437 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-34867eb3-800d-4e21-9070-059ff2111cdb tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.199949 Jan 15 21:00:45.580609 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1838/3687] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:00:45 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:00:45.590059 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-414d0e2c-35b0-430b-94f6-631d88b3b751 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8f9c6ea7f6496792258d683640c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a75218d537c4d63874297261bec70ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:45.608751 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-414d0e2c-35b0-430b-94f6-631d88b3b751 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] 10.222.0.46 "GET /compute/v2.1/servers/4d836f07-866f-4e13-94ff-c4fe850e58d3" status: 200 len: 1516 microversion: 2.1 time: 0.563691 Jan 15 21:00:45.610155 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1850/3688] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:00:45 2022] GET /compute/v2.1/servers/4d836f07-866f-4e13-94ff-c4fe850e58d3 => generated 1516 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:00:45.725419 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f5e6fc5a-10a9-4ea9-8627-55f1055098a8 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:45.726514 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f5e6fc5a-10a9-4ea9-8627-55f1055098a8 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:45.742457 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f5e6fc5a-10a9-4ea9-8627-55f1055098a8 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:45.743935 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f5e6fc5a-10a9-4ea9-8627-55f1055098a8 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:45.744872 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f5e6fc5a-10a9-4ea9-8627-55f1055098a8 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:45.753999 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f5e6fc5a-10a9-4ea9-8627-55f1055098a8 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:46.082583 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-badc142e-d5ea-45b9-af65-3207722fd9b2 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:46.084166 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-badc142e-d5ea-45b9-af65-3207722fd9b2 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] [instance: fe691c6c-ffa5-464a-803d-75eb61fd8268] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:46.098303 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-badc142e-d5ea-45b9-af65-3207722fd9b2 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:46.104083 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-badc142e-d5ea-45b9-af65-3207722fd9b2 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:46.107201 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-badc142e-d5ea-45b9-af65-3207722fd9b2 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:46.107893 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-f5e6fc5a-10a9-4ea9-8627-55f1055098a8 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:46.110511 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-badc142e-d5ea-45b9-af65-3207722fd9b2 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:46.123417 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-f5e6fc5a-10a9-4ea9-8627-55f1055098a8 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:46.127887 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-f5e6fc5a-10a9-4ea9-8627-55f1055098a8 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:46.131058 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f5e6fc5a-10a9-4ea9-8627-55f1055098a8 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "GET /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220" status: 200 len: 1878 microversion: 2.32 time: 0.413436 Jan 15 21:00:46.131908 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1839/3689] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:00:45 2022] GET /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220 => generated 1878 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:00:46.221315 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-5b96ea94-4cb0-403d-8890-021e4f0f731b tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:46.223288 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-5b96ea94-4cb0-403d-8890-021e4f0f731b tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] [instance: 5e93486c-7c77-4855-85f4-2bc8bcf4832f] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:46.233381 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5b96ea94-4cb0-403d-8890-021e4f0f731b tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:46.234366 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5b96ea94-4cb0-403d-8890-021e4f0f731b tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:46.236396 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5b96ea94-4cb0-403d-8890-021e4f0f731b tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:46.237241 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5b96ea94-4cb0-403d-8890-021e4f0f731b tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:46.259318 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-badc142e-d5ea-45b9-af65-3207722fd9b2 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea59ebcaec344a22a53807319a88af69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdff116c9f44e98b33c9f9346be1af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:46.270229 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-badc142e-d5ea-45b9-af65-3207722fd9b2 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea59ebcaec344a22a53807319a88af69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdff116c9f44e98b33c9f9346be1af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:46.272002 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-badc142e-d5ea-45b9-af65-3207722fd9b2 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea59ebcaec344a22a53807319a88af69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdff116c9f44e98b33c9f9346be1af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:46.273349 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-badc142e-d5ea-45b9-af65-3207722fd9b2 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] 10.222.0.46 "GET /compute/v2.1/servers/fe691c6c-ffa5-464a-803d-75eb61fd8268" status: 200 len: 1356 microversion: 2.54 time: 0.195427 Jan 15 21:00:46.274251 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1851/3690] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:00:46 2022] GET /compute/v2.1/servers/fe691c6c-ffa5-464a-803d-75eb61fd8268 => generated 1356 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:00:46.294504 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e7b24e00-5cce-433f-beb8-75a518649cef tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Action: 'create', calling method: .version_select at 0x7f30c961e940>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-1287966864"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:46.295536 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-5b96ea94-4cb0-403d-8890-021e4f0f731b tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] 10.222.0.46 "POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action" status: 200 len: 32650 microversion: 2.1 time: 0.078296 Jan 15 21:00:46.297265 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1840/3691] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:00:46 2022] POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action => generated 32650 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 21:00:46.317963 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-e7b24e00-5cce-433f-beb8-75a518649cef tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Getting quotas for project 8fdff116c9f44e98b33c9f9346be1af3. Resources: {'key_pairs'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:00:46.335501 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-e7b24e00-5cce-433f-beb8-75a518649cef tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Getting quotas for user ea59ebcaec344a22a53807319a88af69 and project 8fdff116c9f44e98b33c9f9346be1af3. Resources: {'key_pairs'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:00:46.382957 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-edb78856-3671-4abf-9e8c-a64e48f95253 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:46.384264 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-edb78856-3671-4abf-9e8c-a64e48f95253 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:46.409264 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-edb78856-3671-4abf-9e8c-a64e48f95253 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:46.411079 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-edb78856-3671-4abf-9e8c-a64e48f95253 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:46.414411 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-edb78856-3671-4abf-9e8c-a64e48f95253 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:46.415729 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-edb78856-3671-4abf-9e8c-a64e48f95253 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:46.469849 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-edb78856-3671-4abf-9e8c-a64e48f95253 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action" status: 200 len: 16388 microversion: 2.20 time: 0.100131 Jan 15 21:00:46.470579 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1841/3692] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:00:46 2022] POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action => generated 16388 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:00:46.589337 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d8d8ad4b-2a3c-46ab-9540-c8bfea5ccd35 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:46.590425 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-d8d8ad4b-2a3c-46ab-9540-c8bfea5ccd35 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:46.612069 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d8d8ad4b-2a3c-46ab-9540-c8bfea5ccd35 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:46.612533 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d8d8ad4b-2a3c-46ab-9540-c8bfea5ccd35 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:46.614210 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d8d8ad4b-2a3c-46ab-9540-c8bfea5ccd35 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:46.614677 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d8d8ad4b-2a3c-46ab-9540-c8bfea5ccd35 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:46.723625 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d8d8ad4b-2a3c-46ab-9540-c8bfea5ccd35 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.138510 Jan 15 21:00:46.724622 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1842/3693] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:00:46 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:00:46.741158 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b3b96c69-ffd3-4495-818f-df3e7ff8e287 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:46.741942 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b3b96c69-ffd3-4495-818f-df3e7ff8e287 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: 4d836f07-866f-4e13-94ff-c4fe850e58d3] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:46.795492 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b3b96c69-ffd3-4495-818f-df3e7ff8e287 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:46.796531 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b3b96c69-ffd3-4495-818f-df3e7ff8e287 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:46.797119 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b3b96c69-ffd3-4495-818f-df3e7ff8e287 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:46.797590 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b3b96c69-ffd3-4495-818f-df3e7ff8e287 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:46.924985 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-e7b24e00-5cce-433f-beb8-75a518649cef tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Getting quotas for project 8fdff116c9f44e98b33c9f9346be1af3. Resources: {'key_pairs'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:00:46.937912 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-e7b24e00-5cce-433f-beb8-75a518649cef tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Getting quotas for user ea59ebcaec344a22a53807319a88af69 and project 8fdff116c9f44e98b33c9f9346be1af3. Resources: {'key_pairs'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:00:46.977704 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e7b24e00-5cce-433f-beb8-75a518649cef tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 201 len: 2335 microversion: 2.54 time: 0.687675 Jan 15 21:00:46.978177 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1852/3694] 10.222.0.46 () {62 vars in 1198 bytes} [Sat Jan 15 21:00:46 2022] POST /compute/v2.1/os-keypairs => generated 2335 bytes in 689 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Jan 15 21:00:46.988029 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3281b4f8-5446-4007-9b3f-ed54ffcc3ec9 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-1287966864", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:46.990147 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-3281b4f8-5446-4007-9b3f-ed54ffcc3ec9 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] [instance: fe691c6c-ffa5-464a-803d-75eb61fd8268] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:47.006594 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3281b4f8-5446-4007-9b3f-ed54ffcc3ec9 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:47.007056 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3281b4f8-5446-4007-9b3f-ed54ffcc3ec9 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:47.007869 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3281b4f8-5446-4007-9b3f-ed54ffcc3ec9 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:47.008303 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3281b4f8-5446-4007-9b3f-ed54ffcc3ec9 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:47.185631 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-3281b4f8-5446-4007-9b3f-ed54ffcc3ec9 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Flavor limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 21:00:47.186785 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-3281b4f8-5446-4007-9b3f-ed54ffcc3ec9 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Image limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 21:00:47.188686 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-3281b4f8-5446-4007-9b3f-ed54ffcc3ec9 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Flavor pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 21:00:47.189313 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-3281b4f8-5446-4007-9b3f-ed54ffcc3ec9 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Image pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 21:00:47.189914 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-3281b4f8-5446-4007-9b3f-ed54ffcc3ec9 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 21:00:47.333252 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-3281b4f8-5446-4007-9b3f-ed54ffcc3ec9 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] [instance: fe691c6c-ffa5-464a-803d-75eb61fd8268] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:47.343743 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3281b4f8-5446-4007-9b3f-ed54ffcc3ec9 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:47.344498 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3281b4f8-5446-4007-9b3f-ed54ffcc3ec9 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:47.345751 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3281b4f8-5446-4007-9b3f-ed54ffcc3ec9 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:47.346404 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3281b4f8-5446-4007-9b3f-ed54ffcc3ec9 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:47.449741 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3281b4f8-5446-4007-9b3f-ed54ffcc3ec9 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] 10.222.0.46 "POST /compute/v2.1/servers/fe691c6c-ffa5-464a-803d-75eb61fd8268/action" status: 202 len: 1139 microversion: 2.54 time: 0.465336 Jan 15 21:00:47.458923 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1853/3695] 10.222.0.46 () {62 vars in 1319 bytes} [Sat Jan 15 21:00:46 2022] POST /compute/v2.1/servers/fe691c6c-ffa5-464a-803d-75eb61fd8268/action => generated 1139 bytes in 475 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jan 15 21:00:47.469172 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-02ca91c0-fd92-40e0-8cc7-99b15611cad0 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:47.470135 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-02ca91c0-fd92-40e0-8cc7-99b15611cad0 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:47.485479 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-02ca91c0-fd92-40e0-8cc7-99b15611cad0 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:47.487114 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-02ca91c0-fd92-40e0-8cc7-99b15611cad0 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:47.498738 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-02ca91c0-fd92-40e0-8cc7-99b15611cad0 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:47.499484 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-02ca91c0-fd92-40e0-8cc7-99b15611cad0 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:47.516722 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-b3b96c69-ffd3-4495-818f-df3e7ff8e287 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8f9c6ea7f6496792258d683640c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a75218d537c4d63874297261bec70ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:47.526830 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b3b96c69-ffd3-4495-818f-df3e7ff8e287 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] 10.222.0.46 "GET /compute/v2.1/servers/4d836f07-866f-4e13-94ff-c4fe850e58d3" status: 200 len: 1516 microversion: 2.1 time: 0.790253 Jan 15 21:00:47.527299 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1843/3696] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:00:46 2022] GET /compute/v2.1/servers/4d836f07-866f-4e13-94ff-c4fe850e58d3 => generated 1516 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:00:47.555056 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9fc94f78-7ab4-444c-aa25-59fdb8e9b095 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:47.562509 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-9fc94f78-7ab4-444c-aa25-59fdb8e9b095 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] [instance: 5e93486c-7c77-4855-85f4-2bc8bcf4832f] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:47.575031 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9fc94f78-7ab4-444c-aa25-59fdb8e9b095 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:47.575576 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9fc94f78-7ab4-444c-aa25-59fdb8e9b095 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:47.575869 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9fc94f78-7ab4-444c-aa25-59fdb8e9b095 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:47.576399 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9fc94f78-7ab4-444c-aa25-59fdb8e9b095 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:47.632691 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-9fc94f78-7ab4-444c-aa25-59fdb8e9b095 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] 10.222.0.46 "POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action" status: 200 len: 32650 microversion: 2.1 time: 0.103869 Jan 15 21:00:47.639539 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1844/3697] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:00:47 2022] POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action => generated 32650 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:00:47.645528 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7c91ab01-ff65-40be-ad87-e25bb93c2d0b tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:47.646024 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-7c91ab01-ff65-40be-ad87-e25bb93c2d0b tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] [instance: fe691c6c-ffa5-464a-803d-75eb61fd8268] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:47.655060 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7c91ab01-ff65-40be-ad87-e25bb93c2d0b tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:47.655499 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7c91ab01-ff65-40be-ad87-e25bb93c2d0b tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:47.656623 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7c91ab01-ff65-40be-ad87-e25bb93c2d0b tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:47.657442 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7c91ab01-ff65-40be-ad87-e25bb93c2d0b tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:47.809264 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-7c91ab01-ff65-40be-ad87-e25bb93c2d0b tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea59ebcaec344a22a53807319a88af69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdff116c9f44e98b33c9f9346be1af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:47.819201 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-7c91ab01-ff65-40be-ad87-e25bb93c2d0b tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea59ebcaec344a22a53807319a88af69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdff116c9f44e98b33c9f9346be1af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:47.821817 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-7c91ab01-ff65-40be-ad87-e25bb93c2d0b tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea59ebcaec344a22a53807319a88af69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdff116c9f44e98b33c9f9346be1af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:47.824032 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7c91ab01-ff65-40be-ad87-e25bb93c2d0b tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] 10.222.0.46 "GET /compute/v2.1/servers/fe691c6c-ffa5-464a-803d-75eb61fd8268" status: 200 len: 1408 microversion: 2.54 time: 0.182778 Jan 15 21:00:47.824964 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1845/3698] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:00:47 2022] GET /compute/v2.1/servers/fe691c6c-ffa5-464a-803d-75eb61fd8268 => generated 1408 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:00:47.842384 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0b709733-06e5-4cfa-a424-17c8f26c8732 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:47.843600 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-0b709733-06e5-4cfa-a424-17c8f26c8732 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:47.851017 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0b709733-06e5-4cfa-a424-17c8f26c8732 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:47.851784 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0b709733-06e5-4cfa-a424-17c8f26c8732 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:47.853003 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0b709733-06e5-4cfa-a424-17c8f26c8732 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:47.853618 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0b709733-06e5-4cfa-a424-17c8f26c8732 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:47.911930 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0b709733-06e5-4cfa-a424-17c8f26c8732 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action" status: 200 len: 16388 microversion: 2.20 time: 0.074022 Jan 15 21:00:47.912991 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1846/3699] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:00:47 2022] POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action => generated 16388 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:00:47.919966 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ae94c987-b6f3-440e-aa87-24c78b899a8e tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:47.921907 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ae94c987-b6f3-440e-aa87-24c78b899a8e tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:47.931704 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ae94c987-b6f3-440e-aa87-24c78b899a8e tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:47.932155 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ae94c987-b6f3-440e-aa87-24c78b899a8e tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:47.933034 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ae94c987-b6f3-440e-aa87-24c78b899a8e tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:47.933472 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ae94c987-b6f3-440e-aa87-24c78b899a8e tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:47.935867 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-02ca91c0-fd92-40e0-8cc7-99b15611cad0 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:47.952483 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-02ca91c0-fd92-40e0-8cc7-99b15611cad0 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:47.954015 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-02ca91c0-fd92-40e0-8cc7-99b15611cad0 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:47.955193 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-02ca91c0-fd92-40e0-8cc7-99b15611cad0 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "GET /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220" status: 200 len: 1878 microversion: 2.32 time: 0.494979 Jan 15 21:00:47.955764 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1854/3700] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:00:47 2022] GET /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220 => generated 1878 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:00:48.017667 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ae94c987-b6f3-440e-aa87-24c78b899a8e tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.102118 Jan 15 21:00:48.018997 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1847/3701] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:00:47 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:00:48.545473 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-902e1535-d67c-4399-ad1d-01d7f5066172 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:48.546080 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-902e1535-d67c-4399-ad1d-01d7f5066172 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: 4d836f07-866f-4e13-94ff-c4fe850e58d3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:48.561344 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-902e1535-d67c-4399-ad1d-01d7f5066172 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:48.565714 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-902e1535-d67c-4399-ad1d-01d7f5066172 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:48.568602 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-902e1535-d67c-4399-ad1d-01d7f5066172 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:48.571066 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-902e1535-d67c-4399-ad1d-01d7f5066172 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:48.648220 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-dcf3232e-0463-4578-a7db-a63ef99e91aa tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:48.650136 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-dcf3232e-0463-4578-a7db-a63ef99e91aa tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] [instance: 5e93486c-7c77-4855-85f4-2bc8bcf4832f] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:48.662560 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dcf3232e-0463-4578-a7db-a63ef99e91aa tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:48.671185 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dcf3232e-0463-4578-a7db-a63ef99e91aa tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:48.672081 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dcf3232e-0463-4578-a7db-a63ef99e91aa tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:48.672524 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dcf3232e-0463-4578-a7db-a63ef99e91aa tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:48.776265 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-dcf3232e-0463-4578-a7db-a63ef99e91aa tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] 10.222.0.46 "POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action" status: 200 len: 32650 microversion: 2.1 time: 0.132439 Jan 15 21:00:48.778901 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1848/3702] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:00:48 2022] POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action => generated 32650 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:00:48.852883 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-5741e11c-5cc9-4e8d-8969-cac686856314 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:48.856987 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-5741e11c-5cc9-4e8d-8969-cac686856314 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] [instance: fe691c6c-ffa5-464a-803d-75eb61fd8268] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:48.869727 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5741e11c-5cc9-4e8d-8969-cac686856314 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:48.870601 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5741e11c-5cc9-4e8d-8969-cac686856314 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:48.871840 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5741e11c-5cc9-4e8d-8969-cac686856314 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:48.872496 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5741e11c-5cc9-4e8d-8969-cac686856314 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:48.943344 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-902e1535-d67c-4399-ad1d-01d7f5066172 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8f9c6ea7f6496792258d683640c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a75218d537c4d63874297261bec70ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:48.952743 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-902e1535-d67c-4399-ad1d-01d7f5066172 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] 10.222.0.46 "GET /compute/v2.1/servers/4d836f07-866f-4e13-94ff-c4fe850e58d3" status: 200 len: 1516 microversion: 2.1 time: 0.411211 Jan 15 21:00:48.958260 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1855/3703] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:00:48 2022] GET /compute/v2.1/servers/4d836f07-866f-4e13-94ff-c4fe850e58d3 => generated 1516 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:00:48.989562 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-65e5cd68-0b08-4e85-9460-b902fcff74bb tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:48.990590 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-65e5cd68-0b08-4e85-9460-b902fcff74bb tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:49.043235 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-5741e11c-5cc9-4e8d-8969-cac686856314 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea59ebcaec344a22a53807319a88af69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdff116c9f44e98b33c9f9346be1af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:49.044040 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-65e5cd68-0b08-4e85-9460-b902fcff74bb tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:49.044040 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-65e5cd68-0b08-4e85-9460-b902fcff74bb tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:49.044040 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-65e5cd68-0b08-4e85-9460-b902fcff74bb tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:49.044678 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-5741e11c-5cc9-4e8d-8969-cac686856314 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea59ebcaec344a22a53807319a88af69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdff116c9f44e98b33c9f9346be1af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:49.044678 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-5741e11c-5cc9-4e8d-8969-cac686856314 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea59ebcaec344a22a53807319a88af69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdff116c9f44e98b33c9f9346be1af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:49.044996 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-65e5cd68-0b08-4e85-9460-b902fcff74bb tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:49.045149 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-5741e11c-5cc9-4e8d-8969-cac686856314 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] 10.222.0.46 "GET /compute/v2.1/servers/fe691c6c-ffa5-464a-803d-75eb61fd8268" status: 200 len: 1408 microversion: 2.54 time: 0.191983 Jan 15 21:00:49.045149 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1849/3704] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:00:48 2022] GET /compute/v2.1/servers/fe691c6c-ffa5-464a-803d-75eb61fd8268 => generated 1408 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 15 21:00:49.064011 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b1c9d711-9871-48dd-8303-1ed93930291f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:49.065852 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b1c9d711-9871-48dd-8303-1ed93930291f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:49.084540 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b1c9d711-9871-48dd-8303-1ed93930291f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:49.085037 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b1c9d711-9871-48dd-8303-1ed93930291f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:49.086294 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b1c9d711-9871-48dd-8303-1ed93930291f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:49.086294 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b1c9d711-9871-48dd-8303-1ed93930291f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:49.130777 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-65e5cd68-0b08-4e85-9460-b902fcff74bb tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action" status: 200 len: 24554 microversion: 2.20 time: 0.170973 Jan 15 21:00:49.131540 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1856/3705] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:00:48 2022] POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action => generated 24554 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:00:49.146964 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-4b5f5a6d-fd3b-4519-9077-59be39ce0315 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:49.148018 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-4b5f5a6d-fd3b-4519-9077-59be39ce0315 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:49.170073 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4b5f5a6d-fd3b-4519-9077-59be39ce0315 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:49.171534 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4b5f5a6d-fd3b-4519-9077-59be39ce0315 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:49.172682 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4b5f5a6d-fd3b-4519-9077-59be39ce0315 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:49.173843 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4b5f5a6d-fd3b-4519-9077-59be39ce0315 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:49.262379 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-4b5f5a6d-fd3b-4519-9077-59be39ce0315 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.121976 Jan 15 21:00:49.265651 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1857/3706] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:00:49 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:00:49.530875 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-b1c9d711-9871-48dd-8303-1ed93930291f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:49.540736 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-b1c9d711-9871-48dd-8303-1ed93930291f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:49.542325 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-b1c9d711-9871-48dd-8303-1ed93930291f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:49.543592 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b1c9d711-9871-48dd-8303-1ed93930291f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "GET /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220" status: 200 len: 1878 microversion: 2.32 time: 0.502219 Jan 15 21:00:49.544647 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1850/3707] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:00:49 2022] GET /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220 => generated 1878 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:00:49.796459 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-0538a5f7-d69a-4720-b3b7-7fd2fa20824d tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:49.798470 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-0538a5f7-d69a-4720-b3b7-7fd2fa20824d tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] [instance: 5e93486c-7c77-4855-85f4-2bc8bcf4832f] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:49.813697 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0538a5f7-d69a-4720-b3b7-7fd2fa20824d tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:49.814395 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0538a5f7-d69a-4720-b3b7-7fd2fa20824d tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:49.815386 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0538a5f7-d69a-4720-b3b7-7fd2fa20824d tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:49.815990 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0538a5f7-d69a-4720-b3b7-7fd2fa20824d tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:49.876834 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-0538a5f7-d69a-4720-b3b7-7fd2fa20824d tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] 10.222.0.46 "POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action" status: 200 len: 32650 microversion: 2.1 time: 0.088622 Jan 15 21:00:49.878253 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1858/3708] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:00:49 2022] POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action => generated 32650 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:00:49.994947 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-dde91663-2d47-43d6-8d75-d6852c044102 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:49.995631 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-dde91663-2d47-43d6-8d75-d6852c044102 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: 4d836f07-866f-4e13-94ff-c4fe850e58d3] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:50.007196 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dde91663-2d47-43d6-8d75-d6852c044102 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:50.007698 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dde91663-2d47-43d6-8d75-d6852c044102 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:50.009751 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dde91663-2d47-43d6-8d75-d6852c044102 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:50.012057 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dde91663-2d47-43d6-8d75-d6852c044102 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:50.064329 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a41501ed-dc16-4e8d-b751-7a3390859dc8 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:50.065168 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a41501ed-dc16-4e8d-b751-7a3390859dc8 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] [instance: fe691c6c-ffa5-464a-803d-75eb61fd8268] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:50.078309 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a41501ed-dc16-4e8d-b751-7a3390859dc8 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:50.085197 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a41501ed-dc16-4e8d-b751-7a3390859dc8 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:50.086385 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a41501ed-dc16-4e8d-b751-7a3390859dc8 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:50.097507 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a41501ed-dc16-4e8d-b751-7a3390859dc8 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:50.552924 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-a41501ed-dc16-4e8d-b751-7a3390859dc8 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea59ebcaec344a22a53807319a88af69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdff116c9f44e98b33c9f9346be1af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:50.562686 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-a41501ed-dc16-4e8d-b751-7a3390859dc8 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea59ebcaec344a22a53807319a88af69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdff116c9f44e98b33c9f9346be1af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:50.565086 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-a41501ed-dc16-4e8d-b751-7a3390859dc8 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea59ebcaec344a22a53807319a88af69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdff116c9f44e98b33c9f9346be1af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:50.568566 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a41501ed-dc16-4e8d-b751-7a3390859dc8 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] 10.222.0.46 "GET /compute/v2.1/servers/fe691c6c-ffa5-464a-803d-75eb61fd8268" status: 200 len: 1408 microversion: 2.54 time: 0.508725 Jan 15 21:00:50.583161 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1859/3709] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:00:50 2022] GET /compute/v2.1/servers/fe691c6c-ffa5-464a-803d-75eb61fd8268 => generated 1408 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:00:50.588686 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-caa6b92d-2211-41b4-b156-0a31f60babd9 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:50.589847 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-caa6b92d-2211-41b4-b156-0a31f60babd9 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:50.596540 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-caa6b92d-2211-41b4-b156-0a31f60babd9 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:50.597261 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-caa6b92d-2211-41b4-b156-0a31f60babd9 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:50.599010 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-caa6b92d-2211-41b4-b156-0a31f60babd9 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:50.599713 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-caa6b92d-2211-41b4-b156-0a31f60babd9 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:50.655064 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-caa6b92d-2211-41b4-b156-0a31f60babd9 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action" status: 200 len: 24554 microversion: 2.20 time: 0.070164 Jan 15 21:00:50.656959 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-dde91663-2d47-43d6-8d75-d6852c044102 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8f9c6ea7f6496792258d683640c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a75218d537c4d63874297261bec70ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:50.665985 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1860/3710] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:00:50 2022] POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action => generated 24554 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:00:50.667961 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-dde91663-2d47-43d6-8d75-d6852c044102 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] 10.222.0.46 "GET /compute/v2.1/servers/4d836f07-866f-4e13-94ff-c4fe850e58d3" status: 200 len: 1516 microversion: 2.1 time: 0.677283 Jan 15 21:00:50.668808 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1851/3711] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:00:49 2022] GET /compute/v2.1/servers/4d836f07-866f-4e13-94ff-c4fe850e58d3 => generated 1516 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:00:50.688260 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4378547a-71d2-49aa-b124-b4e7ceb3bffd tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:50.689595 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-4378547a-71d2-49aa-b124-b4e7ceb3bffd tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:50.698283 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4378547a-71d2-49aa-b124-b4e7ceb3bffd tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:50.698761 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4378547a-71d2-49aa-b124-b4e7ceb3bffd tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:50.699817 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4378547a-71d2-49aa-b124-b4e7ceb3bffd tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:50.700264 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4378547a-71d2-49aa-b124-b4e7ceb3bffd tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:50.769879 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-4378547a-71d2-49aa-b124-b4e7ceb3bffd tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.096110 Jan 15 21:00:50.773235 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1852/3712] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:00:50 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:00:50.782919 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-876faf25-3508-40a2-b9e9-5be5732f7b81 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:50.783639 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-876faf25-3508-40a2-b9e9-5be5732f7b81 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:50.796222 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-876faf25-3508-40a2-b9e9-5be5732f7b81 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:50.796679 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-876faf25-3508-40a2-b9e9-5be5732f7b81 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:50.798395 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-876faf25-3508-40a2-b9e9-5be5732f7b81 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:50.798836 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-876faf25-3508-40a2-b9e9-5be5732f7b81 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:50.842048 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ed4acac8-4ecc-4e9f-90f0-c866debc0906 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'create', calling method: .version_select at 0x7f30c9031940>, body: {"keypair": {"name": "tempest-keypair-92621215"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:50.873148 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-ed4acac8-4ecc-4e9f-90f0-c866debc0906 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Getting quotas for project f4dad65fccfe481a973f5fcbb9287dee. Resources: {'key_pairs'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:00:50.879671 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-ed4acac8-4ecc-4e9f-90f0-c866debc0906 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Getting quotas for user 6a6097506a2d4e36818310d9d70bf01b and project f4dad65fccfe481a973f5fcbb9287dee. Resources: {'key_pairs'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:00:51.135700 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-876faf25-3508-40a2-b9e9-5be5732f7b81 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:51.152573 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-876faf25-3508-40a2-b9e9-5be5732f7b81 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:51.160872 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-876faf25-3508-40a2-b9e9-5be5732f7b81 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:51.170534 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-876faf25-3508-40a2-b9e9-5be5732f7b81 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "GET /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220" status: 200 len: 1878 microversion: 2.32 time: 0.395586 Jan 15 21:00:51.176980 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1853/3713] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:00:50 2022] GET /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220 => generated 1878 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:00:51.188355 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e913a012-4d82-4d7a-a108-ef240f286ed7 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:51.189703 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e913a012-4d82-4d7a-a108-ef240f286ed7 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] [instance: 5e93486c-7c77-4855-85f4-2bc8bcf4832f] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:51.197769 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e913a012-4d82-4d7a-a108-ef240f286ed7 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:51.198433 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e913a012-4d82-4d7a-a108-ef240f286ed7 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:51.199667 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e913a012-4d82-4d7a-a108-ef240f286ed7 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:51.200257 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e913a012-4d82-4d7a-a108-ef240f286ed7 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:51.267036 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e913a012-4d82-4d7a-a108-ef240f286ed7 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] 10.222.0.46 "POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action" status: 200 len: 32650 microversion: 2.1 time: 0.088070 Jan 15 21:00:51.267986 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1854/3714] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:00:51 2022] POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action => generated 32650 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:00:51.373586 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-ed4acac8-4ecc-4e9f-90f0-c866debc0906 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Getting quotas for project f4dad65fccfe481a973f5fcbb9287dee. Resources: {'key_pairs'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:00:51.380387 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-ed4acac8-4ecc-4e9f-90f0-c866debc0906 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Getting quotas for user 6a6097506a2d4e36818310d9d70bf01b and project f4dad65fccfe481a973f5fcbb9287dee. Resources: {'key_pairs'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:00:51.398575 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ed4acac8-4ecc-4e9f-90f0-c866debc0906 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 2303 microversion: 2.1 time: 0.731240 Jan 15 21:00:51.399520 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1861/3715] 10.222.0.46 () {60 vars in 1157 bytes} [Sat Jan 15 21:00:50 2022] POST /compute/v2.1/os-keypairs => generated 2303 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:00:51.590457 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-57c86169-3f51-42d1-b3d8-546a8892bc7f tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:51.591286 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-57c86169-3f51-42d1-b3d8-546a8892bc7f tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] [instance: fe691c6c-ffa5-464a-803d-75eb61fd8268] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:51.617019 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-57c86169-3f51-42d1-b3d8-546a8892bc7f tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:51.622353 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-57c86169-3f51-42d1-b3d8-546a8892bc7f tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:51.624478 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-57c86169-3f51-42d1-b3d8-546a8892bc7f tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:51.626271 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-57c86169-3f51-42d1-b3d8-546a8892bc7f tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:51.673242 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c9945512-63ac-4521-85a3-b15bc59e1b30 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:51.674959 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c9945512-63ac-4521-85a3-b15bc59e1b30 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:51.704822 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c9945512-63ac-4521-85a3-b15bc59e1b30 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:51.709821 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c9945512-63ac-4521-85a3-b15bc59e1b30 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:51.711173 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c9945512-63ac-4521-85a3-b15bc59e1b30 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:51.714031 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c9945512-63ac-4521-85a3-b15bc59e1b30 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:51.777181 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-57c86169-3f51-42d1-b3d8-546a8892bc7f tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea59ebcaec344a22a53807319a88af69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdff116c9f44e98b33c9f9346be1af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:51.792043 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-57c86169-3f51-42d1-b3d8-546a8892bc7f tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea59ebcaec344a22a53807319a88af69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdff116c9f44e98b33c9f9346be1af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:51.794582 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-57c86169-3f51-42d1-b3d8-546a8892bc7f tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea59ebcaec344a22a53807319a88af69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdff116c9f44e98b33c9f9346be1af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:51.796871 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-57c86169-3f51-42d1-b3d8-546a8892bc7f tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] 10.222.0.46 "GET /compute/v2.1/servers/fe691c6c-ffa5-464a-803d-75eb61fd8268" status: 200 len: 1408 microversion: 2.54 time: 0.211970 Jan 15 21:00:51.815434 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c9945512-63ac-4521-85a3-b15bc59e1b30 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action" status: 200 len: 24554 microversion: 2.20 time: 0.146978 Jan 15 21:00:51.822443 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1862/3716] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:00:51 2022] POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action => generated 24554 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:00:51.825579 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1855/3717] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:00:51 2022] GET /compute/v2.1/servers/fe691c6c-ffa5-464a-803d-75eb61fd8268 => generated 1408 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:00:51.837505 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-6d49ad7b-e69f-40f7-89dc-8cf4afe85397 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:51.838541 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ae65a2df-792b-43ca-b287-819f4a646947 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:51.839565 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-6d49ad7b-e69f-40f7-89dc-8cf4afe85397 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: 4d836f07-866f-4e13-94ff-c4fe850e58d3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:51.840567 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ae65a2df-792b-43ca-b287-819f4a646947 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:51.864950 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ae65a2df-792b-43ca-b287-819f4a646947 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:51.865469 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ae65a2df-792b-43ca-b287-819f4a646947 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:51.869005 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ae65a2df-792b-43ca-b287-819f4a646947 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:51.869465 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ae65a2df-792b-43ca-b287-819f4a646947 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:51.870410 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6d49ad7b-e69f-40f7-89dc-8cf4afe85397 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:51.871954 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6d49ad7b-e69f-40f7-89dc-8cf4afe85397 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:51.875724 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6d49ad7b-e69f-40f7-89dc-8cf4afe85397 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:51.876560 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6d49ad7b-e69f-40f7-89dc-8cf4afe85397 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:51.949275 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ae65a2df-792b-43ca-b287-819f4a646947 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.121978 Jan 15 21:00:51.950911 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1856/3718] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:00:51 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:00:52.176404 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-6d49ad7b-e69f-40f7-89dc-8cf4afe85397 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8f9c6ea7f6496792258d683640c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a75218d537c4d63874297261bec70ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:52.187665 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-6d49ad7b-e69f-40f7-89dc-8cf4afe85397 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] 10.222.0.46 "GET /compute/v2.1/servers/4d836f07-866f-4e13-94ff-c4fe850e58d3" status: 200 len: 1516 microversion: 2.1 time: 0.363845 Jan 15 21:00:52.188694 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1863/3719] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:00:51 2022] GET /compute/v2.1/servers/4d836f07-866f-4e13-94ff-c4fe850e58d3 => generated 1516 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:00:52.197171 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-06dae08a-eb0c-4338-95c4-512934968679 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:52.198505 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-06dae08a-eb0c-4338-95c4-512934968679 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:52.209646 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-06dae08a-eb0c-4338-95c4-512934968679 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:52.210397 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-06dae08a-eb0c-4338-95c4-512934968679 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:52.211528 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-06dae08a-eb0c-4338-95c4-512934968679 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:52.212269 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-06dae08a-eb0c-4338-95c4-512934968679 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:52.282484 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-58804d58-c71f-4aab-8cd2-a2f03278a045 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:52.283886 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-58804d58-c71f-4aab-8cd2-a2f03278a045 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] [instance: 5e93486c-7c77-4855-85f4-2bc8bcf4832f] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:52.293080 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-58804d58-c71f-4aab-8cd2-a2f03278a045 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:52.294856 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-58804d58-c71f-4aab-8cd2-a2f03278a045 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:52.295887 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-58804d58-c71f-4aab-8cd2-a2f03278a045 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:52.296540 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-58804d58-c71f-4aab-8cd2-a2f03278a045 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:52.362025 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-58804d58-c71f-4aab-8cd2-a2f03278a045 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] 10.222.0.46 "POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action" status: 200 len: 32650 microversion: 2.1 time: 0.086063 Jan 15 21:00:52.363641 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1864/3720] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:00:52 2022] POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action => generated 32650 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 21:00:52.550002 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-06dae08a-eb0c-4338-95c4-512934968679 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:52.562793 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-06dae08a-eb0c-4338-95c4-512934968679 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:52.569879 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-06dae08a-eb0c-4338-95c4-512934968679 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:52.571373 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-06dae08a-eb0c-4338-95c4-512934968679 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "GET /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220" status: 200 len: 1878 microversion: 2.32 time: 0.385207 Jan 15 21:00:52.574871 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1857/3721] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:00:52 2022] GET /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220 => generated 1878 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 15 21:00:52.816623 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-56fc453e-a228-44d3-8b86-f51dc0e124ca tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:52.817581 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-56fc453e-a228-44d3-8b86-f51dc0e124ca tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] [instance: fe691c6c-ffa5-464a-803d-75eb61fd8268] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:52.827773 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d03e5c75-8ed7-482c-9c73-64365d9ff935 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:52.828909 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-d03e5c75-8ed7-482c-9c73-64365d9ff935 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:52.843456 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d03e5c75-8ed7-482c-9c73-64365d9ff935 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:52.844595 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d03e5c75-8ed7-482c-9c73-64365d9ff935 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:52.849803 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-56fc453e-a228-44d3-8b86-f51dc0e124ca tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:52.850294 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d03e5c75-8ed7-482c-9c73-64365d9ff935 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:52.853301 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d03e5c75-8ed7-482c-9c73-64365d9ff935 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:52.853638 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-56fc453e-a228-44d3-8b86-f51dc0e124ca tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:52.854789 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-56fc453e-a228-44d3-8b86-f51dc0e124ca tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:52.857174 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-56fc453e-a228-44d3-8b86-f51dc0e124ca tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:52.941800 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d03e5c75-8ed7-482c-9c73-64365d9ff935 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action" status: 200 len: 24554 microversion: 2.20 time: 0.117728 Jan 15 21:00:52.946218 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1858/3722] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:00:52 2022] POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action => generated 24554 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:00:52.973626 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-920a0fe9-debd-4ced-b7a8-7267e3611d3e tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:52.975445 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-920a0fe9-debd-4ced-b7a8-7267e3611d3e tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:52.985410 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-56fc453e-a228-44d3-8b86-f51dc0e124ca tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea59ebcaec344a22a53807319a88af69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdff116c9f44e98b33c9f9346be1af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:52.987522 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-920a0fe9-debd-4ced-b7a8-7267e3611d3e tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:52.990440 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-920a0fe9-debd-4ced-b7a8-7267e3611d3e tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:52.990618 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-920a0fe9-debd-4ced-b7a8-7267e3611d3e tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:52.991172 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-920a0fe9-debd-4ced-b7a8-7267e3611d3e tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:52.994453 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-56fc453e-a228-44d3-8b86-f51dc0e124ca tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea59ebcaec344a22a53807319a88af69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdff116c9f44e98b33c9f9346be1af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:52.995971 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-56fc453e-a228-44d3-8b86-f51dc0e124ca tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea59ebcaec344a22a53807319a88af69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdff116c9f44e98b33c9f9346be1af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:53.002854 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-56fc453e-a228-44d3-8b86-f51dc0e124ca tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] 10.222.0.46 "GET /compute/v2.1/servers/fe691c6c-ffa5-464a-803d-75eb61fd8268" status: 200 len: 1408 microversion: 2.54 time: 0.190974 Jan 15 21:00:53.006297 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1865/3723] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:00:52 2022] GET /compute/v2.1/servers/fe691c6c-ffa5-464a-803d-75eb61fd8268 => generated 1408 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:00:53.062354 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-920a0fe9-debd-4ced-b7a8-7267e3611d3e tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.100848 Jan 15 21:00:53.065094 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1859/3724] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:00:52 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:00:53.206302 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-592e7560-28ca-43b4-a6b6-77d2287a845e tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:53.207563 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-592e7560-28ca-43b4-a6b6-77d2287a845e tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: 4d836f07-866f-4e13-94ff-c4fe850e58d3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:53.218913 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-592e7560-28ca-43b4-a6b6-77d2287a845e tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:53.219621 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-592e7560-28ca-43b4-a6b6-77d2287a845e tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:53.220690 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-592e7560-28ca-43b4-a6b6-77d2287a845e tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:53.221110 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-592e7560-28ca-43b4-a6b6-77d2287a845e tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:53.383203 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-2b13acec-14bc-474e-a3da-6e1111e628ae tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:53.386275 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-2b13acec-14bc-474e-a3da-6e1111e628ae tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] [instance: 5e93486c-7c77-4855-85f4-2bc8bcf4832f] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:53.402729 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2b13acec-14bc-474e-a3da-6e1111e628ae tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:53.406061 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2b13acec-14bc-474e-a3da-6e1111e628ae tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:53.410310 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2b13acec-14bc-474e-a3da-6e1111e628ae tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:53.411015 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2b13acec-14bc-474e-a3da-6e1111e628ae tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:53.507465 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-2b13acec-14bc-474e-a3da-6e1111e628ae tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] 10.222.0.46 "POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action" status: 200 len: 32650 microversion: 2.1 time: 0.134322 Jan 15 21:00:53.509076 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1860/3725] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:00:53 2022] POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action => generated 32650 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:00:53.536960 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-592e7560-28ca-43b4-a6b6-77d2287a845e tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8f9c6ea7f6496792258d683640c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a75218d537c4d63874297261bec70ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:53.548546 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-592e7560-28ca-43b4-a6b6-77d2287a845e tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] 10.222.0.46 "GET /compute/v2.1/servers/4d836f07-866f-4e13-94ff-c4fe850e58d3" status: 200 len: 1516 microversion: 2.1 time: 0.346256 Jan 15 21:00:53.549593 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1866/3726] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:00:53 2022] GET /compute/v2.1/servers/4d836f07-866f-4e13-94ff-c4fe850e58d3 => generated 1516 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:00:53.593347 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-31312f67-4a36-474e-88b6-46346380e53a tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:53.595321 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-31312f67-4a36-474e-88b6-46346380e53a tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:53.617635 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-31312f67-4a36-474e-88b6-46346380e53a tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:53.618720 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-31312f67-4a36-474e-88b6-46346380e53a tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:53.620334 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-31312f67-4a36-474e-88b6-46346380e53a tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:53.621117 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-31312f67-4a36-474e-88b6-46346380e53a tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:53.955457 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c418173b-bddb-47e5-8bab-2e8faa402599 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:53.956777 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c418173b-bddb-47e5-8bab-2e8faa402599 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:53.964430 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c418173b-bddb-47e5-8bab-2e8faa402599 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:53.965179 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c418173b-bddb-47e5-8bab-2e8faa402599 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:53.966292 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c418173b-bddb-47e5-8bab-2e8faa402599 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:53.966882 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c418173b-bddb-47e5-8bab-2e8faa402599 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:53.994622 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-31312f67-4a36-474e-88b6-46346380e53a tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:54.014140 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-31312f67-4a36-474e-88b6-46346380e53a tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:54.017934 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-31312f67-4a36-474e-88b6-46346380e53a tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:54.022705 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-31312f67-4a36-474e-88b6-46346380e53a tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "GET /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220" status: 200 len: 1878 microversion: 2.32 time: 0.435143 Jan 15 21:00:54.023838 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1861/3727] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:00:53 2022] GET /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220 => generated 1878 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:00:54.041410 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c418173b-bddb-47e5-8bab-2e8faa402599 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action" status: 200 len: 24554 microversion: 2.20 time: 0.090731 Jan 15 21:00:54.046687 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1867/3728] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:00:53 2022] POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action => generated 24554 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:00:54.056468 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-5f05e422-637e-4969-ac90-db33e2533ded tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:54.059220 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-5f05e422-637e-4969-ac90-db33e2533ded tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] [instance: fe691c6c-ffa5-464a-803d-75eb61fd8268] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:54.077252 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3cd647b4-1e42-4de9-9a1c-eb5785b34e53 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:54.078734 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5f05e422-637e-4969-ac90-db33e2533ded tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:54.079187 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-3cd647b4-1e42-4de9-9a1c-eb5785b34e53 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:54.079691 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5f05e422-637e-4969-ac90-db33e2533ded tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:54.080598 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5f05e422-637e-4969-ac90-db33e2533ded tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:54.081225 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5f05e422-637e-4969-ac90-db33e2533ded tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:54.093195 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3cd647b4-1e42-4de9-9a1c-eb5785b34e53 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:54.093874 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3cd647b4-1e42-4de9-9a1c-eb5785b34e53 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:54.094844 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3cd647b4-1e42-4de9-9a1c-eb5785b34e53 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:54.099302 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3cd647b4-1e42-4de9-9a1c-eb5785b34e53 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:54.179986 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-5f05e422-637e-4969-ac90-db33e2533ded tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea59ebcaec344a22a53807319a88af69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdff116c9f44e98b33c9f9346be1af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:54.188705 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3cd647b4-1e42-4de9-9a1c-eb5785b34e53 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.115996 Jan 15 21:00:54.190020 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1868/3729] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:00:54 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:00:54.191763 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-5f05e422-637e-4969-ac90-db33e2533ded tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea59ebcaec344a22a53807319a88af69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdff116c9f44e98b33c9f9346be1af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:54.193786 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-5f05e422-637e-4969-ac90-db33e2533ded tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea59ebcaec344a22a53807319a88af69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdff116c9f44e98b33c9f9346be1af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:54.197801 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-5f05e422-637e-4969-ac90-db33e2533ded tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] 10.222.0.46 "GET /compute/v2.1/servers/fe691c6c-ffa5-464a-803d-75eb61fd8268" status: 200 len: 1408 microversion: 2.54 time: 0.172695 Jan 15 21:00:54.201364 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9560875f-7b97-43b9-a9e6-77f9c70baa09 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-660941091", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dd26bf3f-ac0f-4779-8f8e-a3094245a610"}], "security_groups": [{"name": "tempest-securitygroup--1812858443"}], "key_name": "tempest-keypair-92621215", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:54.211752 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1862/3730] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:00:54 2022] GET /compute/v2.1/servers/fe691c6c-ffa5-464a-803d-75eb61fd8268 => generated 1408 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:00:54.353767 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.network.neutron [None req-9560875f-7b97-43b9-a9e6-77f9c70baa09 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] validate_networks() for [('dd26bf3f-ac0f-4779-8f8e-a3094245a610', None, None, None, None, None)] {{(pid=129365) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 21:00:54.527524 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-5a800f06-d996-4f56-b573-1806f3440a92 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:54.528508 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-5a800f06-d996-4f56-b573-1806f3440a92 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] [instance: 5e93486c-7c77-4855-85f4-2bc8bcf4832f] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:54.540430 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5a800f06-d996-4f56-b573-1806f3440a92 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:54.541764 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5a800f06-d996-4f56-b573-1806f3440a92 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:54.542753 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5a800f06-d996-4f56-b573-1806f3440a92 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:54.543435 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5a800f06-d996-4f56-b573-1806f3440a92 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:54.610098 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-5a800f06-d996-4f56-b573-1806f3440a92 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] 10.222.0.46 "POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action" status: 200 len: 32650 microversion: 2.1 time: 0.093273 Jan 15 21:00:54.611481 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1863/3731] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:00:54 2022] POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action => generated 32650 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:00:54.619212 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-74d94e04-69f4-46df-94cd-d6871b77fd2c tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:54.625423 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-74d94e04-69f4-46df-94cd-d6871b77fd2c tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: 4d836f07-866f-4e13-94ff-c4fe850e58d3] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:54.641288 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-74d94e04-69f4-46df-94cd-d6871b77fd2c tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:54.641826 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-74d94e04-69f4-46df-94cd-d6871b77fd2c tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:54.643028 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-74d94e04-69f4-46df-94cd-d6871b77fd2c tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:54.660970 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-74d94e04-69f4-46df-94cd-d6871b77fd2c tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:54.924586 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-74d94e04-69f4-46df-94cd-d6871b77fd2c tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8f9c6ea7f6496792258d683640c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a75218d537c4d63874297261bec70ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:54.939216 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-74d94e04-69f4-46df-94cd-d6871b77fd2c tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] 10.222.0.46 "GET /compute/v2.1/servers/4d836f07-866f-4e13-94ff-c4fe850e58d3" status: 200 len: 1516 microversion: 2.1 time: 0.326275 Jan 15 21:00:54.940043 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1864/3732] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:00:54 2022] GET /compute/v2.1/servers/4d836f07-866f-4e13-94ff-c4fe850e58d3 => generated 1516 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:00:55.045144 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d7a61746-ffb1-494e-a0b2-86b025b4bf50 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:55.046408 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-d7a61746-ffb1-494e-a0b2-86b025b4bf50 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:55.059022 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d7a61746-ffb1-494e-a0b2-86b025b4bf50 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:55.065134 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d7a61746-ffb1-494e-a0b2-86b025b4bf50 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:55.066707 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d7a61746-ffb1-494e-a0b2-86b025b4bf50 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:55.069172 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d7a61746-ffb1-494e-a0b2-86b025b4bf50 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:55.095773 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-9560875f-7b97-43b9-a9e6-77f9c70baa09 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Flavor limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 21:00:55.096664 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-9560875f-7b97-43b9-a9e6-77f9c70baa09 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Image limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 21:00:55.099464 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-9560875f-7b97-43b9-a9e6-77f9c70baa09 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Flavor pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 21:00:55.099965 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-9560875f-7b97-43b9-a9e6-77f9c70baa09 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Image pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 21:00:55.100454 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-9560875f-7b97-43b9-a9e6-77f9c70baa09 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 21:00:55.112227 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9560875f-7b97-43b9-a9e6-77f9c70baa09 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:55.112775 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9560875f-7b97-43b9-a9e6-77f9c70baa09 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:55.113993 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9560875f-7b97-43b9-a9e6-77f9c70baa09 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:55.114497 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9560875f-7b97-43b9-a9e6-77f9c70baa09 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:55.143537 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-9560875f-7b97-43b9-a9e6-77f9c70baa09 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Getting quotas for project f4dad65fccfe481a973f5fcbb9287dee. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:00:55.151251 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-9560875f-7b97-43b9-a9e6-77f9c70baa09 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Getting quotas for user 6a6097506a2d4e36818310d9d70bf01b and project f4dad65fccfe481a973f5fcbb9287dee. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:00:55.176641 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-9560875f-7b97-43b9-a9e6-77f9c70baa09 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Going to run 1 instances... {{(pid=129365) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 21:00:55.182709 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-9560875f-7b97-43b9-a9e6-77f9c70baa09 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129365) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 21:00:55.283955 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-9560875f-7b97-43b9-a9e6-77f9c70baa09 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.090673 Jan 15 21:00:55.292905 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1869/3733] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 21:00:54 2022] POST /compute/v2.1/servers => generated 402 bytes in 1100 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 21:00:55.331307 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-80da59c1-3f69-44dd-80b7-67357ab6146f tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:55.334931 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-80da59c1-3f69-44dd-80b7-67357ab6146f tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:55.391162 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-80da59c1-3f69-44dd-80b7-67357ab6146f tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:55.391647 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-80da59c1-3f69-44dd-80b7-67357ab6146f tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:55.392486 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-80da59c1-3f69-44dd-80b7-67357ab6146f tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:55.423901 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-80da59c1-3f69-44dd-80b7-67357ab6146f tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:55.487467 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-d7a61746-ffb1-494e-a0b2-86b025b4bf50 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:55.510686 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-80da59c1-3f69-44dd-80b7-67357ab6146f tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action" status: 200 len: 24554 microversion: 2.20 time: 0.216392 Jan 15 21:00:55.511600 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1870/3734] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:00:55 2022] POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action => generated 24554 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:00:55.514884 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-d7a61746-ffb1-494e-a0b2-86b025b4bf50 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:55.518531 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-d7a61746-ffb1-494e-a0b2-86b025b4bf50 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:55.519980 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f732c995-7f76-46f7-847e-7f5689102610 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:55.521247 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f732c995-7f76-46f7-847e-7f5689102610 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:55.522784 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d7a61746-ffb1-494e-a0b2-86b025b4bf50 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "GET /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220" status: 200 len: 1878 microversion: 2.32 time: 0.484019 Jan 15 21:00:55.526785 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1865/3735] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:00:55 2022] GET /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220 => generated 1878 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 15 21:00:55.534336 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b2b33a62-d081-4d81-8f98-e16e14accd47 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:55.538425 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b2b33a62-d081-4d81-8f98-e16e14accd47 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] [instance: fe691c6c-ffa5-464a-803d-75eb61fd8268] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:55.546269 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f732c995-7f76-46f7-847e-7f5689102610 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:55.546893 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f732c995-7f76-46f7-847e-7f5689102610 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:55.547869 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f732c995-7f76-46f7-847e-7f5689102610 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:55.548472 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f732c995-7f76-46f7-847e-7f5689102610 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:55.560792 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b2b33a62-d081-4d81-8f98-e16e14accd47 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:55.567489 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b2b33a62-d081-4d81-8f98-e16e14accd47 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:55.570867 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b2b33a62-d081-4d81-8f98-e16e14accd47 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:55.571457 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b2b33a62-d081-4d81-8f98-e16e14accd47 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:55.623112 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f732c995-7f76-46f7-847e-7f5689102610 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.109783 Jan 15 21:00:55.627646 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1871/3736] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:00:55 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:00:55.631728 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-1dc74f6a-7439-4a8f-b370-daa700b6d07f tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:55.632468 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-1dc74f6a-7439-4a8f-b370-daa700b6d07f tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:55.694776 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-b2b33a62-d081-4d81-8f98-e16e14accd47 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea59ebcaec344a22a53807319a88af69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdff116c9f44e98b33c9f9346be1af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:55.707299 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-b2b33a62-d081-4d81-8f98-e16e14accd47 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea59ebcaec344a22a53807319a88af69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdff116c9f44e98b33c9f9346be1af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:55.711201 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-b2b33a62-d081-4d81-8f98-e16e14accd47 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea59ebcaec344a22a53807319a88af69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdff116c9f44e98b33c9f9346be1af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:55.717539 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b2b33a62-d081-4d81-8f98-e16e14accd47 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] 10.222.0.46 "GET /compute/v2.1/servers/fe691c6c-ffa5-464a-803d-75eb61fd8268" status: 200 len: 1408 microversion: 2.54 time: 0.184908 Jan 15 21:00:55.729687 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1866/3737] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:00:55 2022] GET /compute/v2.1/servers/fe691c6c-ffa5-464a-803d-75eb61fd8268 => generated 1408 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:00:55.729687 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-3f706f91-623d-4a9a-816e-fa7ef5ddaff8 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:55.729687 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-3f706f91-623d-4a9a-816e-fa7ef5ddaff8 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] [instance: 5e93486c-7c77-4855-85f4-2bc8bcf4832f] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:55.739921 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3f706f91-623d-4a9a-816e-fa7ef5ddaff8 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:55.740480 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3f706f91-623d-4a9a-816e-fa7ef5ddaff8 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:55.741405 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3f706f91-623d-4a9a-816e-fa7ef5ddaff8 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:55.741920 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3f706f91-623d-4a9a-816e-fa7ef5ddaff8 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:55.758538 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-1dc74f6a-7439-4a8f-b370-daa700b6d07f tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6097506a2d4e36818310d9d70bf01b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4dad65fccfe481a973f5fcbb9287dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:55.771340 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-1dc74f6a-7439-4a8f-b370-daa700b6d07f tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "GET /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a" status: 200 len: 1235 microversion: 2.1 time: 0.144914 Jan 15 21:00:55.774442 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1872/3738] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:00:55 2022] GET /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a => generated 1235 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:00:55.798433 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-3f706f91-623d-4a9a-816e-fa7ef5ddaff8 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] 10.222.0.46 "POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action" status: 200 len: 32650 microversion: 2.1 time: 0.077714 Jan 15 21:00:55.801156 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1867/3739] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:00:55 2022] POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action => generated 32650 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:00:55.960106 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f22fc978-6296-434e-ab46-f67b54188381 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:55.960823 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f22fc978-6296-434e-ab46-f67b54188381 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: 4d836f07-866f-4e13-94ff-c4fe850e58d3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:55.978285 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f22fc978-6296-434e-ab46-f67b54188381 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:55.978841 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f22fc978-6296-434e-ab46-f67b54188381 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:55.979720 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f22fc978-6296-434e-ab46-f67b54188381 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:55.981208 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f22fc978-6296-434e-ab46-f67b54188381 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:56.219603 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-f22fc978-6296-434e-ab46-f67b54188381 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8f9c6ea7f6496792258d683640c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a75218d537c4d63874297261bec70ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:56.230010 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f22fc978-6296-434e-ab46-f67b54188381 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] 10.222.0.46 "GET /compute/v2.1/servers/4d836f07-866f-4e13-94ff-c4fe850e58d3" status: 200 len: 1516 microversion: 2.1 time: 0.275057 Jan 15 21:00:56.230892 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1873/3740] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:00:55 2022] GET /compute/v2.1/servers/4d836f07-866f-4e13-94ff-c4fe850e58d3 => generated 1516 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:00:56.528394 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-93d50c56-80a1-429d-9d13-6d2049134e2f tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:56.529416 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-93d50c56-80a1-429d-9d13-6d2049134e2f tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:56.550079 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-49986665-9787-4193-9461-0e5c6fc55bf6 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:56.553385 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-49986665-9787-4193-9461-0e5c6fc55bf6 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:56.559952 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-93d50c56-80a1-429d-9d13-6d2049134e2f tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:56.561192 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-93d50c56-80a1-429d-9d13-6d2049134e2f tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:56.564834 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-93d50c56-80a1-429d-9d13-6d2049134e2f tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:56.566859 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-93d50c56-80a1-429d-9d13-6d2049134e2f tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:56.569332 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-49986665-9787-4193-9461-0e5c6fc55bf6 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:56.574401 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-49986665-9787-4193-9461-0e5c6fc55bf6 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:56.577840 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-49986665-9787-4193-9461-0e5c6fc55bf6 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:56.578558 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-49986665-9787-4193-9461-0e5c6fc55bf6 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:56.656407 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-93d50c56-80a1-429d-9d13-6d2049134e2f tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action" status: 200 len: 24554 microversion: 2.20 time: 0.136838 Jan 15 21:00:56.664076 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1868/3741] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:00:56 2022] POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action => generated 24554 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:00:56.669925 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-3773ff58-5074-46b4-b9eb-ca529bf5f1a6 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:56.671087 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-3773ff58-5074-46b4-b9eb-ca529bf5f1a6 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:56.684229 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3773ff58-5074-46b4-b9eb-ca529bf5f1a6 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:56.684768 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3773ff58-5074-46b4-b9eb-ca529bf5f1a6 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:56.685721 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3773ff58-5074-46b4-b9eb-ca529bf5f1a6 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:56.686221 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3773ff58-5074-46b4-b9eb-ca529bf5f1a6 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:56.750314 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-3773ff58-5074-46b4-b9eb-ca529bf5f1a6 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.084735 Jan 15 21:00:56.751177 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1869/3742] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:00:56 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:00:56.764397 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ab0eda61-c4b4-496a-b9b3-6852f0a5cab6 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:56.765692 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ab0eda61-c4b4-496a-b9b3-6852f0a5cab6 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] [instance: fe691c6c-ffa5-464a-803d-75eb61fd8268] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:56.779048 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ab0eda61-c4b4-496a-b9b3-6852f0a5cab6 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:56.779963 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ab0eda61-c4b4-496a-b9b3-6852f0a5cab6 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:56.780963 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ab0eda61-c4b4-496a-b9b3-6852f0a5cab6 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:56.781498 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ab0eda61-c4b4-496a-b9b3-6852f0a5cab6 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:56.946601 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-ab0eda61-c4b4-496a-b9b3-6852f0a5cab6 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea59ebcaec344a22a53807319a88af69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdff116c9f44e98b33c9f9346be1af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:56.956507 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-ab0eda61-c4b4-496a-b9b3-6852f0a5cab6 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea59ebcaec344a22a53807319a88af69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdff116c9f44e98b33c9f9346be1af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:56.958766 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-ab0eda61-c4b4-496a-b9b3-6852f0a5cab6 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea59ebcaec344a22a53807319a88af69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdff116c9f44e98b33c9f9346be1af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:56.960189 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ab0eda61-c4b4-496a-b9b3-6852f0a5cab6 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] 10.222.0.46 "GET /compute/v2.1/servers/fe691c6c-ffa5-464a-803d-75eb61fd8268" status: 200 len: 1408 microversion: 2.54 time: 0.201585 Jan 15 21:00:56.965780 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1870/3743] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:00:56 2022] GET /compute/v2.1/servers/fe691c6c-ffa5-464a-803d-75eb61fd8268 => generated 1408 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:00:56.971448 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-72ccef0d-4cd5-4569-b0b7-e7d258cdd2cf tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:56.972064 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-72ccef0d-4cd5-4569-b0b7-e7d258cdd2cf tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:56.987570 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-72ccef0d-4cd5-4569-b0b7-e7d258cdd2cf tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:56.988726 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-72ccef0d-4cd5-4569-b0b7-e7d258cdd2cf tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:56.989472 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-72ccef0d-4cd5-4569-b0b7-e7d258cdd2cf tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:56.989918 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-72ccef0d-4cd5-4569-b0b7-e7d258cdd2cf tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:57.104563 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-49986665-9787-4193-9461-0e5c6fc55bf6 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:57.116903 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-49986665-9787-4193-9461-0e5c6fc55bf6 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:57.118435 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-49986665-9787-4193-9461-0e5c6fc55bf6 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:57.119614 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-49986665-9787-4193-9461-0e5c6fc55bf6 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "GET /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220" status: 200 len: 1878 microversion: 2.32 time: 0.577011 Jan 15 21:00:57.120189 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1874/3744] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:00:56 2022] GET /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220 => generated 1878 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:00:57.152012 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-49708151-4d66-4b29-bae7-f06b16361521 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:57.153032 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-49708151-4d66-4b29-bae7-f06b16361521 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] [instance: 5e93486c-7c77-4855-85f4-2bc8bcf4832f] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:57.187436 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-49708151-4d66-4b29-bae7-f06b16361521 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:57.187898 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-49708151-4d66-4b29-bae7-f06b16361521 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:57.188705 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-49708151-4d66-4b29-bae7-f06b16361521 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:57.189264 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-49708151-4d66-4b29-bae7-f06b16361521 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:57.210907 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-72ccef0d-4cd5-4569-b0b7-e7d258cdd2cf tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6097506a2d4e36818310d9d70bf01b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4dad65fccfe481a973f5fcbb9287dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:57.219896 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-72ccef0d-4cd5-4569-b0b7-e7d258cdd2cf tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "GET /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a" status: 200 len: 1305 microversion: 2.1 time: 0.252893 Jan 15 21:00:57.220509 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1871/3745] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:00:56 2022] GET /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a => generated 1305 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:00:57.247650 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c57d342f-5f6a-4a8c-aaef-c879c2c29919 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:57.248621 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c57d342f-5f6a-4a8c-aaef-c879c2c29919 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: 4d836f07-866f-4e13-94ff-c4fe850e58d3] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:57.261657 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c57d342f-5f6a-4a8c-aaef-c879c2c29919 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:57.262111 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c57d342f-5f6a-4a8c-aaef-c879c2c29919 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:57.262911 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c57d342f-5f6a-4a8c-aaef-c879c2c29919 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:57.263383 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c57d342f-5f6a-4a8c-aaef-c879c2c29919 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:57.288262 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-49708151-4d66-4b29-bae7-f06b16361521 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] 10.222.0.46 "POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action" status: 200 len: 32650 microversion: 2.1 time: 0.165991 Jan 15 21:00:57.290503 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1875/3746] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:00:57 2022] POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action => generated 32650 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:00:57.333760 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-ec59ba56-3e46-48d5-a6c9-2269a3bdfcb1 req-886d06e9-a304-44d2-9cb5-81c7a99db97a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "686aa731-082f-4584-8607-5a40f0d63220", "name": "network-vif-plugged", "status": "completed", "tag": "d36cd432-9054-48c0-a218-c6094ff964e7"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:57.335758 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:00:57.335758 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:00:57.346422 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-ec59ba56-3e46-48d5-a6c9-2269a3bdfcb1 req-886d06e9-a304-44d2-9cb5-81c7a99db97a service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:57.347326 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-ec59ba56-3e46-48d5-a6c9-2269a3bdfcb1 req-886d06e9-a304-44d2-9cb5-81c7a99db97a service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:57.370294 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-ec59ba56-3e46-48d5-a6c9-2269a3bdfcb1 req-886d06e9-a304-44d2-9cb5-81c7a99db97a service nova] Creating event network-vif-plugged:d36cd432-9054-48c0-a218-c6094ff964e7 for instance 686aa731-082f-4584-8607-5a40f0d63220 on nch1-master-1 Jan 15 21:00:57.378027 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-ec59ba56-3e46-48d5-a6c9-2269a3bdfcb1 req-886d06e9-a304-44d2-9cb5-81c7a99db97a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054267 Jan 15 21:00:57.380211 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1876/3747] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:00:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:00:57.523625 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-c57d342f-5f6a-4a8c-aaef-c879c2c29919 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8f9c6ea7f6496792258d683640c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a75218d537c4d63874297261bec70ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:57.531742 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c57d342f-5f6a-4a8c-aaef-c879c2c29919 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] 10.222.0.46 "GET /compute/v2.1/servers/4d836f07-866f-4e13-94ff-c4fe850e58d3" status: 200 len: 1516 microversion: 2.1 time: 0.288085 Jan 15 21:00:57.543046 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1872/3748] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:00:57 2022] GET /compute/v2.1/servers/4d836f07-866f-4e13-94ff-c4fe850e58d3 => generated 1516 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:00:57.673552 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a21adbf2-9134-4b9d-a4fe-5eca736023f4 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:57.674615 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a21adbf2-9134-4b9d-a4fe-5eca736023f4 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:57.681381 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a21adbf2-9134-4b9d-a4fe-5eca736023f4 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:57.682016 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a21adbf2-9134-4b9d-a4fe-5eca736023f4 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:57.682837 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a21adbf2-9134-4b9d-a4fe-5eca736023f4 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:57.683280 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a21adbf2-9134-4b9d-a4fe-5eca736023f4 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:57.726817 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a21adbf2-9134-4b9d-a4fe-5eca736023f4 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action" status: 200 len: 24554 microversion: 2.20 time: 0.057854 Jan 15 21:00:57.730657 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1877/3749] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:00:57 2022] POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action => generated 24554 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:00:57.771501 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-437bfa9c-aa8c-4ab3-94fd-5bedcbb9a43d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:57.773300 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-437bfa9c-aa8c-4ab3-94fd-5bedcbb9a43d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:57.790616 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-437bfa9c-aa8c-4ab3-94fd-5bedcbb9a43d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:57.791174 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-437bfa9c-aa8c-4ab3-94fd-5bedcbb9a43d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:57.792090 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-437bfa9c-aa8c-4ab3-94fd-5bedcbb9a43d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:57.792534 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-437bfa9c-aa8c-4ab3-94fd-5bedcbb9a43d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:57.857424 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-437bfa9c-aa8c-4ab3-94fd-5bedcbb9a43d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.096532 Jan 15 21:00:57.861657 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1873/3750] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:00:57 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:00:57.978768 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-523b50a5-4ff4-400d-b9a7-ccee4b76afa7 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:57.979525 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-523b50a5-4ff4-400d-b9a7-ccee4b76afa7 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] [instance: fe691c6c-ffa5-464a-803d-75eb61fd8268] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:57.993782 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-523b50a5-4ff4-400d-b9a7-ccee4b76afa7 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:57.994308 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-523b50a5-4ff4-400d-b9a7-ccee4b76afa7 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:57.995318 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-523b50a5-4ff4-400d-b9a7-ccee4b76afa7 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:57.995776 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-523b50a5-4ff4-400d-b9a7-ccee4b76afa7 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:58.141359 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e56bcc45-448c-4093-975d-beeee5650817 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:58.142189 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e56bcc45-448c-4093-975d-beeee5650817 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:58.172006 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e56bcc45-448c-4093-975d-beeee5650817 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:58.172464 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e56bcc45-448c-4093-975d-beeee5650817 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:58.173300 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e56bcc45-448c-4093-975d-beeee5650817 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:58.173734 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e56bcc45-448c-4093-975d-beeee5650817 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:58.181742 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-523b50a5-4ff4-400d-b9a7-ccee4b76afa7 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea59ebcaec344a22a53807319a88af69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdff116c9f44e98b33c9f9346be1af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:58.190733 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-523b50a5-4ff4-400d-b9a7-ccee4b76afa7 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea59ebcaec344a22a53807319a88af69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdff116c9f44e98b33c9f9346be1af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:58.203755 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-523b50a5-4ff4-400d-b9a7-ccee4b76afa7 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea59ebcaec344a22a53807319a88af69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdff116c9f44e98b33c9f9346be1af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:58.207742 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-523b50a5-4ff4-400d-b9a7-ccee4b76afa7 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] 10.222.0.46 "GET /compute/v2.1/servers/fe691c6c-ffa5-464a-803d-75eb61fd8268" status: 200 len: 1408 microversion: 2.54 time: 0.233127 Jan 15 21:00:58.208542 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1878/3751] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:00:57 2022] GET /compute/v2.1/servers/fe691c6c-ffa5-464a-803d-75eb61fd8268 => generated 1408 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:00:58.238508 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-fa62ee26-7b21-4ed8-80f7-f7b9329c60e6 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:58.239132 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-fa62ee26-7b21-4ed8-80f7-f7b9329c60e6 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:58.261806 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fa62ee26-7b21-4ed8-80f7-f7b9329c60e6 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:58.262476 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fa62ee26-7b21-4ed8-80f7-f7b9329c60e6 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:58.265802 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fa62ee26-7b21-4ed8-80f7-f7b9329c60e6 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:58.267286 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fa62ee26-7b21-4ed8-80f7-f7b9329c60e6 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:58.600150 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-e56bcc45-448c-4093-975d-beeee5650817 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:58.631492 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-e56bcc45-448c-4093-975d-beeee5650817 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:58.639221 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-e56bcc45-448c-4093-975d-beeee5650817 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:58.640767 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e56bcc45-448c-4093-975d-beeee5650817 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "GET /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220" status: 200 len: 1878 microversion: 2.32 time: 0.504559 Jan 15 21:00:58.641556 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1874/3752] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:00:58 2022] GET /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220 => generated 1878 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:00:58.647274 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c2c073be-d196-4b81-9146-1146565ea741 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:58.648542 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c2c073be-d196-4b81-9146-1146565ea741 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] [instance: 5e93486c-7c77-4855-85f4-2bc8bcf4832f] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:58.680144 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c2c073be-d196-4b81-9146-1146565ea741 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:58.683014 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c2c073be-d196-4b81-9146-1146565ea741 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:58.691989 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c2c073be-d196-4b81-9146-1146565ea741 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:58.701511 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c2c073be-d196-4b81-9146-1146565ea741 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:58.711056 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-fa62ee26-7b21-4ed8-80f7-f7b9329c60e6 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6097506a2d4e36818310d9d70bf01b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4dad65fccfe481a973f5fcbb9287dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:58.718714 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-fa62ee26-7b21-4ed8-80f7-f7b9329c60e6 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "GET /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a" status: 200 len: 1361 microversion: 2.1 time: 0.484876 Jan 15 21:00:58.723452 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1879/3753] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:00:58 2022] GET /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a => generated 1361 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:00:58.732311 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-693d4119-f298-4d66-99a3-a7cac77b9611 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:58.733140 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-693d4119-f298-4d66-99a3-a7cac77b9611 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: 4d836f07-866f-4e13-94ff-c4fe850e58d3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:58.750272 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-693d4119-f298-4d66-99a3-a7cac77b9611 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:58.750923 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-693d4119-f298-4d66-99a3-a7cac77b9611 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:58.751879 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-693d4119-f298-4d66-99a3-a7cac77b9611 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:58.752476 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-693d4119-f298-4d66-99a3-a7cac77b9611 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:58.800005 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c2c073be-d196-4b81-9146-1146565ea741 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] 10.222.0.46 "POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action" status: 200 len: 32650 microversion: 2.1 time: 0.150513 Jan 15 21:00:58.803191 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1875/3754] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:00:58 2022] POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action => generated 32650 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:00:58.814054 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f9c44d85-adf4-4ff6-8f77-f29bf1e7ea11 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:58.815081 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f9c44d85-adf4-4ff6-8f77-f29bf1e7ea11 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:58.839711 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f9c44d85-adf4-4ff6-8f77-f29bf1e7ea11 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:58.840601 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f9c44d85-adf4-4ff6-8f77-f29bf1e7ea11 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:58.841687 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f9c44d85-adf4-4ff6-8f77-f29bf1e7ea11 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:58.843340 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f9c44d85-adf4-4ff6-8f77-f29bf1e7ea11 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:58.963599 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f9c44d85-adf4-4ff6-8f77-f29bf1e7ea11 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action" status: 200 len: 24554 microversion: 2.20 time: 0.159034 Jan 15 21:00:58.967883 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1876/3755] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:00:58 2022] POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action => generated 24554 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:00:58.975041 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d599fffe-75c3-4d0e-a247-9da0c7e4052f tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:58.978202 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-d599fffe-75c3-4d0e-a247-9da0c7e4052f tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:58.995552 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d599fffe-75c3-4d0e-a247-9da0c7e4052f tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:58.998795 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d599fffe-75c3-4d0e-a247-9da0c7e4052f tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:59.000328 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d599fffe-75c3-4d0e-a247-9da0c7e4052f tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:59.004601 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d599fffe-75c3-4d0e-a247-9da0c7e4052f tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:59.039854 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-693d4119-f298-4d66-99a3-a7cac77b9611 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8f9c6ea7f6496792258d683640c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a75218d537c4d63874297261bec70ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:59.050981 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-693d4119-f298-4d66-99a3-a7cac77b9611 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] 10.222.0.46 "GET /compute/v2.1/servers/4d836f07-866f-4e13-94ff-c4fe850e58d3" status: 200 len: 1516 microversion: 2.1 time: 0.326158 Jan 15 21:00:59.051955 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1880/3756] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:00:58 2022] GET /compute/v2.1/servers/4d836f07-866f-4e13-94ff-c4fe850e58d3 => generated 1516 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:00:59.104177 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d599fffe-75c3-4d0e-a247-9da0c7e4052f tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.134663 Jan 15 21:00:59.107852 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1877/3757] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:00:58 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:00:59.227847 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-1d2b3a93-6507-41be-9e0b-f18356775185 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:59.228465 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-1d2b3a93-6507-41be-9e0b-f18356775185 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] [instance: fe691c6c-ffa5-464a-803d-75eb61fd8268] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:59.232559 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-a345e249-3252-4e08-99da-c05ed065cc37 req-8834b184-4f05-4be6-9752-478c9c0a0f7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac78554d-ca29-4e31-a410-00dc4df5c77a", "tag": "97667f1d-b2d5-4c9c-b247-ad291c112fa3"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:59.235267 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:00:59.235267 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:00:59.239027 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1d2b3a93-6507-41be-9e0b-f18356775185 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:59.239546 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1d2b3a93-6507-41be-9e0b-f18356775185 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:59.240361 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1d2b3a93-6507-41be-9e0b-f18356775185 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:59.240817 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1d2b3a93-6507-41be-9e0b-f18356775185 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:59.258026 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-a345e249-3252-4e08-99da-c05ed065cc37 req-8834b184-4f05-4be6-9752-478c9c0a0f7d service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:59.260301 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-a345e249-3252-4e08-99da-c05ed065cc37 req-8834b184-4f05-4be6-9752-478c9c0a0f7d service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:59.303696 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-a345e249-3252-4e08-99da-c05ed065cc37 req-8834b184-4f05-4be6-9752-478c9c0a0f7d service nova] Creating event network-changed:97667f1d-b2d5-4c9c-b247-ad291c112fa3 for instance ac78554d-ca29-4e31-a410-00dc4df5c77a on nch2-master-1 Jan 15 21:00:59.320074 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-a345e249-3252-4e08-99da-c05ed065cc37 req-8834b184-4f05-4be6-9752-478c9c0a0f7d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082206 Jan 15 21:00:59.321449 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1878/3758] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:00:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 21:00:59.416718 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-b276cbaf-0f61-4679-93ab-5e2259950ce6 req-452edfaf-b0ab-4a2e-9c8b-32ab1c6bf091 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "686aa731-082f-4584-8607-5a40f0d63220", "name": "network-vif-plugged", "status": "completed", "tag": "9f31cf46-d654-4aef-ada4-dab1fc37d328"}, {"server_uuid": "686aa731-082f-4584-8607-5a40f0d63220", "name": "network-vif-plugged", "status": "completed", "tag": "64cf49a0-1762-46ea-8738-821b466cb2c9"}, {"server_uuid": "686aa731-082f-4584-8607-5a40f0d63220", "name": "network-vif-plugged", "status": "completed", "tag": "d8af72f0-b932-47f5-b578-70fdd429d39b"}, {"server_uuid": "686aa731-082f-4584-8607-5a40f0d63220", "name": "network-vif-plugged", "status": "completed", "tag": "a63ec384-e15d-441f-b027-6fb09676099b"}, {"server_uuid": "686aa731-082f-4584-8607-5a40f0d63220", "name": "network-vif-plugged", "status": "completed", "tag": "e70cfdd0-1455-44d5-8de1-57e6af6d6aac"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:00:59.420456 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-1d2b3a93-6507-41be-9e0b-f18356775185 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea59ebcaec344a22a53807319a88af69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdff116c9f44e98b33c9f9346be1af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:59.421474 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:00:59.421474 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:00:59.436505 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-1d2b3a93-6507-41be-9e0b-f18356775185 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea59ebcaec344a22a53807319a88af69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdff116c9f44e98b33c9f9346be1af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:59.438257 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-1d2b3a93-6507-41be-9e0b-f18356775185 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea59ebcaec344a22a53807319a88af69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdff116c9f44e98b33c9f9346be1af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:00:59.446185 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-1d2b3a93-6507-41be-9e0b-f18356775185 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] 10.222.0.46 "GET /compute/v2.1/servers/fe691c6c-ffa5-464a-803d-75eb61fd8268" status: 200 len: 1408 microversion: 2.54 time: 0.223587 Jan 15 21:00:59.446345 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-b276cbaf-0f61-4679-93ab-5e2259950ce6 req-452edfaf-b0ab-4a2e-9c8b-32ab1c6bf091 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:59.449405 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1881/3759] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:00:59 2022] GET /compute/v2.1/servers/fe691c6c-ffa5-464a-803d-75eb61fd8268 => generated 1408 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:00:59.459669 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-b276cbaf-0f61-4679-93ab-5e2259950ce6 req-452edfaf-b0ab-4a2e-9c8b-32ab1c6bf091 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:59.478788 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-b276cbaf-0f61-4679-93ab-5e2259950ce6 req-452edfaf-b0ab-4a2e-9c8b-32ab1c6bf091 service nova] Creating event network-vif-plugged:9f31cf46-d654-4aef-ada4-dab1fc37d328 for instance 686aa731-082f-4584-8607-5a40f0d63220 on nch1-master-1 Jan 15 21:00:59.479320 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-b276cbaf-0f61-4679-93ab-5e2259950ce6 req-452edfaf-b0ab-4a2e-9c8b-32ab1c6bf091 service nova] Creating event network-vif-plugged:64cf49a0-1762-46ea-8738-821b466cb2c9 for instance 686aa731-082f-4584-8607-5a40f0d63220 on nch1-master-1 Jan 15 21:00:59.479883 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-b276cbaf-0f61-4679-93ab-5e2259950ce6 req-452edfaf-b0ab-4a2e-9c8b-32ab1c6bf091 service nova] Creating event network-vif-plugged:d8af72f0-b932-47f5-b578-70fdd429d39b for instance 686aa731-082f-4584-8607-5a40f0d63220 on nch1-master-1 Jan 15 21:00:59.480393 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-b276cbaf-0f61-4679-93ab-5e2259950ce6 req-452edfaf-b0ab-4a2e-9c8b-32ab1c6bf091 service nova] Creating event network-vif-plugged:a63ec384-e15d-441f-b027-6fb09676099b for instance 686aa731-082f-4584-8607-5a40f0d63220 on nch1-master-1 Jan 15 21:00:59.480885 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-b276cbaf-0f61-4679-93ab-5e2259950ce6 req-452edfaf-b0ab-4a2e-9c8b-32ab1c6bf091 service nova] Creating event network-vif-plugged:e70cfdd0-1455-44d5-8de1-57e6af6d6aac for instance 686aa731-082f-4584-8607-5a40f0d63220 on nch1-master-1 Jan 15 21:00:59.489960 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-b276cbaf-0f61-4679-93ab-5e2259950ce6 req-452edfaf-b0ab-4a2e-9c8b-32ab1c6bf091 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 867 microversion: 2.1 time: 0.086216 Jan 15 21:00:59.490742 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1879/3760] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:00:59 2022] POST /compute/v2.1/os-server-external-events => generated 867 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:00:59.659559 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-cc6ca558-59f2-4a19-8ecc-f76f5ce7d222 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:59.660517 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-cc6ca558-59f2-4a19-8ecc-f76f5ce7d222 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:59.672772 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cc6ca558-59f2-4a19-8ecc-f76f5ce7d222 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:59.673256 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cc6ca558-59f2-4a19-8ecc-f76f5ce7d222 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:59.674440 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cc6ca558-59f2-4a19-8ecc-f76f5ce7d222 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:59.678728 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cc6ca558-59f2-4a19-8ecc-f76f5ce7d222 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:59.741615 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9534c093-4b67-4d8a-be90-20dc48eee259 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:00:59.742281 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-9534c093-4b67-4d8a-be90-20dc48eee259 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:00:59.749561 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9534c093-4b67-4d8a-be90-20dc48eee259 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:59.750109 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9534c093-4b67-4d8a-be90-20dc48eee259 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:00:59.752557 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9534c093-4b67-4d8a-be90-20dc48eee259 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:00:59.752557 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9534c093-4b67-4d8a-be90-20dc48eee259 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:00.010944 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-cc6ca558-59f2-4a19-8ecc-f76f5ce7d222 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:00.013426 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-9534c093-4b67-4d8a-be90-20dc48eee259 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6097506a2d4e36818310d9d70bf01b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4dad65fccfe481a973f5fcbb9287dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:00.021386 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-cc6ca558-59f2-4a19-8ecc-f76f5ce7d222 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:00.022927 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-9534c093-4b67-4d8a-be90-20dc48eee259 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "GET /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a" status: 200 len: 1361 microversion: 2.1 time: 0.285639 Jan 15 21:01:00.023531 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-cc6ca558-59f2-4a19-8ecc-f76f5ce7d222 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:00.032889 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1880/3761] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:00:59 2022] GET /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a => generated 1361 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:00.032889 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-54d76078-4b21-4a4b-93b3-52cc8730adf3 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:00.032889 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-54d76078-4b21-4a4b-93b3-52cc8730adf3 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] [instance: 5e93486c-7c77-4855-85f4-2bc8bcf4832f] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:00.036174 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-54d76078-4b21-4a4b-93b3-52cc8730adf3 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:00.036730 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-54d76078-4b21-4a4b-93b3-52cc8730adf3 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:00.037630 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-54d76078-4b21-4a4b-93b3-52cc8730adf3 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:00.038314 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-54d76078-4b21-4a4b-93b3-52cc8730adf3 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:00.040128 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-cc6ca558-59f2-4a19-8ecc-f76f5ce7d222 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "GET /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220" status: 200 len: 1878 microversion: 2.32 time: 0.384067 Jan 15 21:01:00.041210 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1882/3762] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:00:59 2022] GET /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220 => generated 1878 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:01:00.047819 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-56de7c56-381c-4aec-ae12-7c5c37b75b82 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:00.049690 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-56de7c56-381c-4aec-ae12-7c5c37b75b82 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:00.061512 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-56de7c56-381c-4aec-ae12-7c5c37b75b82 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:00.062128 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-56de7c56-381c-4aec-ae12-7c5c37b75b82 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:00.063313 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-56de7c56-381c-4aec-ae12-7c5c37b75b82 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:00.063826 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-56de7c56-381c-4aec-ae12-7c5c37b75b82 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:00.094315 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-54d76078-4b21-4a4b-93b3-52cc8730adf3 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] 10.222.0.46 "POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action" status: 200 len: 32650 microversion: 2.1 time: 0.068355 Jan 15 21:01:00.095466 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1881/3763] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:01:00 2022] POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action => generated 32650 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:01:00.102024 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-716ebdd1-bcec-4e0a-989b-5b7ae4ddceed tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:00.102790 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-716ebdd1-bcec-4e0a-989b-5b7ae4ddceed tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: 4d836f07-866f-4e13-94ff-c4fe850e58d3] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:00.109162 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-56de7c56-381c-4aec-ae12-7c5c37b75b82 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action" status: 200 len: 24554 microversion: 2.20 time: 0.065864 Jan 15 21:01:00.115714 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1883/3764] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:00 2022] POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action => generated 24554 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:01:00.115898 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-716ebdd1-bcec-4e0a-989b-5b7ae4ddceed tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:00.115898 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-716ebdd1-bcec-4e0a-989b-5b7ae4ddceed tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:00.115898 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-716ebdd1-bcec-4e0a-989b-5b7ae4ddceed tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:00.115898 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-716ebdd1-bcec-4e0a-989b-5b7ae4ddceed tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:00.123793 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-4e58270b-9281-4bcd-bca9-7b9272ec5720 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:00.124813 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-4e58270b-9281-4bcd-bca9-7b9272ec5720 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:00.142253 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4e58270b-9281-4bcd-bca9-7b9272ec5720 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:00.142962 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4e58270b-9281-4bcd-bca9-7b9272ec5720 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:00.145066 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4e58270b-9281-4bcd-bca9-7b9272ec5720 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:00.145950 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4e58270b-9281-4bcd-bca9-7b9272ec5720 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:00.195983 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-4e58270b-9281-4bcd-bca9-7b9272ec5720 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.077881 Jan 15 21:01:00.196681 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1884/3765] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:00 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:01:00.273722 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-716ebdd1-bcec-4e0a-989b-5b7ae4ddceed tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8f9c6ea7f6496792258d683640c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a75218d537c4d63874297261bec70ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:00.280943 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-716ebdd1-bcec-4e0a-989b-5b7ae4ddceed tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] 10.222.0.46 "GET /compute/v2.1/servers/4d836f07-866f-4e13-94ff-c4fe850e58d3" status: 200 len: 1516 microversion: 2.1 time: 0.183497 Jan 15 21:01:00.281842 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1882/3766] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:00 2022] GET /compute/v2.1/servers/4d836f07-866f-4e13-94ff-c4fe850e58d3 => generated 1516 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:00.326464 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e2aa27ba-75cd-40c6-99a4-b0150abca886 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:00.327162 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e2aa27ba-75cd-40c6-99a4-b0150abca886 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:00.334945 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e2aa27ba-75cd-40c6-99a4-b0150abca886 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:00.335392 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e2aa27ba-75cd-40c6-99a4-b0150abca886 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:00.336175 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e2aa27ba-75cd-40c6-99a4-b0150abca886 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:00.336613 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e2aa27ba-75cd-40c6-99a4-b0150abca886 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:00.465576 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4de9dc89-8d27-477f-aac1-cc827b64fc21 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:00.466392 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-4de9dc89-8d27-477f-aac1-cc827b64fc21 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] [instance: fe691c6c-ffa5-464a-803d-75eb61fd8268] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:00.473497 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4de9dc89-8d27-477f-aac1-cc827b64fc21 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:00.473955 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4de9dc89-8d27-477f-aac1-cc827b64fc21 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:00.474747 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4de9dc89-8d27-477f-aac1-cc827b64fc21 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:00.475179 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4de9dc89-8d27-477f-aac1-cc827b64fc21 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:00.476509 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-e2aa27ba-75cd-40c6-99a4-b0150abca886 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:00.486613 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e2aa27ba-75cd-40c6-99a4-b0150abca886 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9" status: 200 len: 1683 microversion: 2.1 time: 0.164102 Jan 15 21:01:00.487660 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1885/3767] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:00 2022] GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9 => generated 1683 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:00.552819 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-4de9dc89-8d27-477f-aac1-cc827b64fc21 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea59ebcaec344a22a53807319a88af69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdff116c9f44e98b33c9f9346be1af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:00.567979 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-4de9dc89-8d27-477f-aac1-cc827b64fc21 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea59ebcaec344a22a53807319a88af69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdff116c9f44e98b33c9f9346be1af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:00.569519 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-4de9dc89-8d27-477f-aac1-cc827b64fc21 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea59ebcaec344a22a53807319a88af69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdff116c9f44e98b33c9f9346be1af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:00.570684 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-4de9dc89-8d27-477f-aac1-cc827b64fc21 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] 10.222.0.46 "GET /compute/v2.1/servers/fe691c6c-ffa5-464a-803d-75eb61fd8268" status: 200 len: 1408 microversion: 2.54 time: 0.108948 Jan 15 21:01:00.571247 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1883/3768] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:01:00 2022] GET /compute/v2.1/servers/fe691c6c-ffa5-464a-803d-75eb61fd8268 => generated 1408 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 15 21:01:01.041112 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-be380558-b0ab-40a9-8c18-9ae9268202f7 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:01.041718 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-be380558-b0ab-40a9-8c18-9ae9268202f7 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:01.048437 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-be380558-b0ab-40a9-8c18-9ae9268202f7 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:01.048920 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-be380558-b0ab-40a9-8c18-9ae9268202f7 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:01.049704 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-be380558-b0ab-40a9-8c18-9ae9268202f7 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:01.050139 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-be380558-b0ab-40a9-8c18-9ae9268202f7 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:01.058761 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-319965ee-d682-4c26-8b97-ef608cfa4b20 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:01.059376 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-319965ee-d682-4c26-8b97-ef608cfa4b20 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:01.066996 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-319965ee-d682-4c26-8b97-ef608cfa4b20 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:01.067451 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-319965ee-d682-4c26-8b97-ef608cfa4b20 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:01.068250 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-319965ee-d682-4c26-8b97-ef608cfa4b20 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:01.068691 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-319965ee-d682-4c26-8b97-ef608cfa4b20 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:01.295396 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-be380558-b0ab-40a9-8c18-9ae9268202f7 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6097506a2d4e36818310d9d70bf01b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4dad65fccfe481a973f5fcbb9287dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:01.304473 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-be380558-b0ab-40a9-8c18-9ae9268202f7 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "GET /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a" status: 200 len: 1361 microversion: 2.1 time: 0.267194 Jan 15 21:01:01.305143 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1886/3769] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:01 2022] GET /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a => generated 1361 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:01.309607 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-0ec603a6-ae6d-4bbd-8c01-f5cbe812ecf8 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:01.310556 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-0ec603a6-ae6d-4bbd-8c01-f5cbe812ecf8 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] [instance: 5e93486c-7c77-4855-85f4-2bc8bcf4832f] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:01.317133 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0ec603a6-ae6d-4bbd-8c01-f5cbe812ecf8 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:01.317643 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0ec603a6-ae6d-4bbd-8c01-f5cbe812ecf8 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:01.318456 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0ec603a6-ae6d-4bbd-8c01-f5cbe812ecf8 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:01.318795 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-319965ee-d682-4c26-8b97-ef608cfa4b20 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:01.318913 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0ec603a6-ae6d-4bbd-8c01-f5cbe812ecf8 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:01.328469 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-319965ee-d682-4c26-8b97-ef608cfa4b20 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:01.330004 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-319965ee-d682-4c26-8b97-ef608cfa4b20 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:01.331164 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-319965ee-d682-4c26-8b97-ef608cfa4b20 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "GET /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220" status: 200 len: 1878 microversion: 2.32 time: 0.276191 Jan 15 21:01:01.344879 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1884/3770] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:01:01 2022] GET /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220 => generated 1878 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 15 21:01:01.344879 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c701a315-5638-40a6-9fbc-d2a18eb06b9b tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:01.344879 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c701a315-5638-40a6-9fbc-d2a18eb06b9b tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:01.344879 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c701a315-5638-40a6-9fbc-d2a18eb06b9b tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:01.344879 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c701a315-5638-40a6-9fbc-d2a18eb06b9b tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:01.345788 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c701a315-5638-40a6-9fbc-d2a18eb06b9b tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:01.345943 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c701a315-5638-40a6-9fbc-d2a18eb06b9b tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:01.363968 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-0ec603a6-ae6d-4bbd-8c01-f5cbe812ecf8 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] 10.222.0.46 "POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action" status: 200 len: 32650 microversion: 2.1 time: 0.057530 Jan 15 21:01:01.366035 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1887/3771] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:01:01 2022] POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action => generated 32650 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:01:01.370189 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-520d44c6-08ce-4911-b1e7-01d7158443c1 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:01.371196 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-520d44c6-08ce-4911-b1e7-01d7158443c1 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:01.378482 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-520d44c6-08ce-4911-b1e7-01d7158443c1 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:01.379267 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-520d44c6-08ce-4911-b1e7-01d7158443c1 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:01.380036 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-520d44c6-08ce-4911-b1e7-01d7158443c1 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:01.380979 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-520d44c6-08ce-4911-b1e7-01d7158443c1 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:01.391010 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c701a315-5638-40a6-9fbc-d2a18eb06b9b tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action" status: 200 len: 24554 microversion: 2.20 time: 0.057113 Jan 15 21:01:01.392427 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1885/3772] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:01 2022] POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action => generated 24554 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:01:01.397480 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-2288c3bd-8a8e-4512-a355-77b67a670a65 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:01.398180 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-2288c3bd-8a8e-4512-a355-77b67a670a65 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: 4d836f07-866f-4e13-94ff-c4fe850e58d3] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:01.405083 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2288c3bd-8a8e-4512-a355-77b67a670a65 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:01.405542 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2288c3bd-8a8e-4512-a355-77b67a670a65 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:01.406338 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2288c3bd-8a8e-4512-a355-77b67a670a65 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:01.406780 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2288c3bd-8a8e-4512-a355-77b67a670a65 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:01.426985 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-520d44c6-08ce-4911-b1e7-01d7158443c1 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.060387 Jan 15 21:01:01.427659 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1888/3773] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:01 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:01:01.506628 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2daf0d27-69b9-445e-93d6-0f3976b0e1ee tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:01.507500 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-2daf0d27-69b9-445e-93d6-0f3976b0e1ee tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:01.515226 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2daf0d27-69b9-445e-93d6-0f3976b0e1ee tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:01.515684 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2daf0d27-69b9-445e-93d6-0f3976b0e1ee tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:01.516489 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2daf0d27-69b9-445e-93d6-0f3976b0e1ee tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:01.516955 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2daf0d27-69b9-445e-93d6-0f3976b0e1ee tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:01.543625 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-2288c3bd-8a8e-4512-a355-77b67a670a65 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8f9c6ea7f6496792258d683640c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a75218d537c4d63874297261bec70ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:01.551769 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-2288c3bd-8a8e-4512-a355-77b67a670a65 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] 10.222.0.46 "GET /compute/v2.1/servers/4d836f07-866f-4e13-94ff-c4fe850e58d3" status: 200 len: 1516 microversion: 2.1 time: 0.158956 Jan 15 21:01:01.552385 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1886/3774] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:01 2022] GET /compute/v2.1/servers/4d836f07-866f-4e13-94ff-c4fe850e58d3 => generated 1516 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:01.556731 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-44ceeee7-f281-4111-a644-b9a5124d950d req-b4eebc33-8e7f-4bbe-b418-5a51a922a0fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "686aa731-082f-4584-8607-5a40f0d63220", "name": "network-vif-plugged", "status": "completed", "tag": "1c682467-fd92-4011-a1b3-79b4e61291df"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:01.558248 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:01:01.558248 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:01:01.565579 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-44ceeee7-f281-4111-a644-b9a5124d950d req-b4eebc33-8e7f-4bbe-b418-5a51a922a0fe service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:01.566399 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-44ceeee7-f281-4111-a644-b9a5124d950d req-b4eebc33-8e7f-4bbe-b418-5a51a922a0fe service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:01.577901 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-44ceeee7-f281-4111-a644-b9a5124d950d req-b4eebc33-8e7f-4bbe-b418-5a51a922a0fe service nova] Creating event network-vif-plugged:1c682467-fd92-4011-a1b3-79b4e61291df for instance 686aa731-082f-4584-8607-5a40f0d63220 on nch1-master-1 Jan 15 21:01:01.584803 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-44ceeee7-f281-4111-a644-b9a5124d950d req-b4eebc33-8e7f-4bbe-b418-5a51a922a0fe service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030322 Jan 15 21:01:01.584803 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1887/3775] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:01:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:01:01.590789 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-884298a2-c5ac-4c48-ae58-c1c435fe33b7 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:01.591525 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-884298a2-c5ac-4c48-ae58-c1c435fe33b7 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] [instance: fe691c6c-ffa5-464a-803d-75eb61fd8268] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:01.598843 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-884298a2-c5ac-4c48-ae58-c1c435fe33b7 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:01.599373 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-884298a2-c5ac-4c48-ae58-c1c435fe33b7 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:01.600186 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-884298a2-c5ac-4c48-ae58-c1c435fe33b7 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:01.600636 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-884298a2-c5ac-4c48-ae58-c1c435fe33b7 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:01.683463 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-884298a2-c5ac-4c48-ae58-c1c435fe33b7 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea59ebcaec344a22a53807319a88af69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdff116c9f44e98b33c9f9346be1af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:01.687120 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-2daf0d27-69b9-445e-93d6-0f3976b0e1ee tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:01.691791 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-884298a2-c5ac-4c48-ae58-c1c435fe33b7 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea59ebcaec344a22a53807319a88af69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdff116c9f44e98b33c9f9346be1af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:01.693536 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-884298a2-c5ac-4c48-ae58-c1c435fe33b7 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea59ebcaec344a22a53807319a88af69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdff116c9f44e98b33c9f9346be1af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:01.694765 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-884298a2-c5ac-4c48-ae58-c1c435fe33b7 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] 10.222.0.46 "GET /compute/v2.1/servers/fe691c6c-ffa5-464a-803d-75eb61fd8268" status: 200 len: 1408 microversion: 2.54 time: 0.107841 Jan 15 21:01:01.695214 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2daf0d27-69b9-445e-93d6-0f3976b0e1ee tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9" status: 200 len: 1670 microversion: 2.1 time: 0.193721 Jan 15 21:01:01.695906 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1888/3776] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:01:01 2022] GET /compute/v2.1/servers/fe691c6c-ffa5-464a-803d-75eb61fd8268 => generated 1408 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 15 21:01:01.696049 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1889/3777] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:01 2022] GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9 => generated 1670 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:01.712300 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-aa3d396f-4f8e-45e0-8d84-447f58406ae7 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-865129077"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:01.713602 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-aa3d396f-4f8e-45e0-8d84-447f58406ae7 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:01.719895 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-aa3d396f-4f8e-45e0-8d84-447f58406ae7 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:01.720406 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-aa3d396f-4f8e-45e0-8d84-447f58406ae7 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:01.721257 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-aa3d396f-4f8e-45e0-8d84-447f58406ae7 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:01.721690 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-aa3d396f-4f8e-45e0-8d84-447f58406ae7 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:01.999952 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-aa3d396f-4f8e-45e0-8d84-447f58406ae7 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action" status: 202 len: 0 microversion: 2.1 time: 0.291164 Jan 15 21:01:02.000690 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1889/3778] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:01:01 2022] POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action => generated 0 bytes in 293 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Jan 15 21:01:02.012163 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-599f240a-f34d-44e7-848f-60ab2e371dc5 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:02.013329 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-599f240a-f34d-44e7-848f-60ab2e371dc5 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:02.022831 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-599f240a-f34d-44e7-848f-60ab2e371dc5 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:02.023287 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-599f240a-f34d-44e7-848f-60ab2e371dc5 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:02.024111 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-599f240a-f34d-44e7-848f-60ab2e371dc5 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:02.024740 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-599f240a-f34d-44e7-848f-60ab2e371dc5 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:02.173124 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-599f240a-f34d-44e7-848f-60ab2e371dc5 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:02.180979 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-599f240a-f34d-44e7-848f-60ab2e371dc5 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9" status: 200 len: 1680 microversion: 2.1 time: 0.174982 Jan 15 21:01:02.181553 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1890/3779] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:02 2022] GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9 => generated 1680 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:02.322130 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9917fdeb-5821-467d-a3a4-7c3cd512a974 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:02.322865 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-9917fdeb-5821-467d-a3a4-7c3cd512a974 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:02.329112 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9917fdeb-5821-467d-a3a4-7c3cd512a974 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:02.329570 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9917fdeb-5821-467d-a3a4-7c3cd512a974 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:02.330351 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9917fdeb-5821-467d-a3a4-7c3cd512a974 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:02.330796 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9917fdeb-5821-467d-a3a4-7c3cd512a974 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:02.355724 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8fe5c579-5230-4041-8ddf-4b2a6641f250 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:02.356425 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-8fe5c579-5230-4041-8ddf-4b2a6641f250 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:02.363656 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8fe5c579-5230-4041-8ddf-4b2a6641f250 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:02.364106 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8fe5c579-5230-4041-8ddf-4b2a6641f250 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:02.365094 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8fe5c579-5230-4041-8ddf-4b2a6641f250 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:02.365559 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8fe5c579-5230-4041-8ddf-4b2a6641f250 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:02.564107 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-9917fdeb-5821-467d-a3a4-7c3cd512a974 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6097506a2d4e36818310d9d70bf01b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4dad65fccfe481a973f5fcbb9287dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:02.572314 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-9917fdeb-5821-467d-a3a4-7c3cd512a974 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "GET /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a" status: 200 len: 1361 microversion: 2.1 time: 0.254896 Jan 15 21:01:02.573050 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1890/3780] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:02 2022] GET /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a => generated 1361 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:02.577264 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-76e84d75-f778-403f-8db4-31ac53f99cad tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:02.578157 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-76e84d75-f778-403f-8db4-31ac53f99cad tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] [instance: 5e93486c-7c77-4855-85f4-2bc8bcf4832f] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:02.583945 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-76e84d75-f778-403f-8db4-31ac53f99cad tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:02.584398 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-76e84d75-f778-403f-8db4-31ac53f99cad tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:02.585234 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-76e84d75-f778-403f-8db4-31ac53f99cad tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:02.585674 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-76e84d75-f778-403f-8db4-31ac53f99cad tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:02.606609 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-8fe5c579-5230-4041-8ddf-4b2a6641f250 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:02.617690 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-8fe5c579-5230-4041-8ddf-4b2a6641f250 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:02.619184 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-8fe5c579-5230-4041-8ddf-4b2a6641f250 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:02.620315 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-8fe5c579-5230-4041-8ddf-4b2a6641f250 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "GET /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220" status: 200 len: 1878 microversion: 2.32 time: 0.268657 Jan 15 21:01:02.620892 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1891/3781] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:01:02 2022] GET /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220 => generated 1878 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:01:02.625243 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-7ba39410-1fa7-4dfe-9ef7-add737d89a74 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:02.626194 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-7ba39410-1fa7-4dfe-9ef7-add737d89a74 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:02.630972 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-76e84d75-f778-403f-8db4-31ac53f99cad tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] 10.222.0.46 "POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action" status: 200 len: 32650 microversion: 2.1 time: 0.056918 Jan 15 21:01:02.631623 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1891/3782] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:01:02 2022] POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action => generated 32650 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:01:02.633719 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7ba39410-1fa7-4dfe-9ef7-add737d89a74 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:02.634171 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7ba39410-1fa7-4dfe-9ef7-add737d89a74 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:02.635000 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7ba39410-1fa7-4dfe-9ef7-add737d89a74 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:02.635438 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7ba39410-1fa7-4dfe-9ef7-add737d89a74 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:02.636696 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-3b1c0dc7-02c9-44bd-8e93-23dc6e7d75ae tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:02.637709 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-3b1c0dc7-02c9-44bd-8e93-23dc6e7d75ae tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:02.644744 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3b1c0dc7-02c9-44bd-8e93-23dc6e7d75ae tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:02.645415 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3b1c0dc7-02c9-44bd-8e93-23dc6e7d75ae tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:02.646627 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3b1c0dc7-02c9-44bd-8e93-23dc6e7d75ae tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:02.647348 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3b1c0dc7-02c9-44bd-8e93-23dc6e7d75ae tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:02.677406 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-7ba39410-1fa7-4dfe-9ef7-add737d89a74 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action" status: 200 len: 24554 microversion: 2.20 time: 0.055100 Jan 15 21:01:02.678109 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1892/3783] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:02 2022] POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action => generated 24554 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:01:02.683213 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-7072528e-35d6-41a8-b4e2-a54b2c0fc3b9 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:02.683906 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-7072528e-35d6-41a8-b4e2-a54b2c0fc3b9 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: 4d836f07-866f-4e13-94ff-c4fe850e58d3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:02.690976 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7072528e-35d6-41a8-b4e2-a54b2c0fc3b9 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:02.691677 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7072528e-35d6-41a8-b4e2-a54b2c0fc3b9 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:02.692459 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7072528e-35d6-41a8-b4e2-a54b2c0fc3b9 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:02.692949 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7072528e-35d6-41a8-b4e2-a54b2c0fc3b9 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:02.695046 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-3b1c0dc7-02c9-44bd-8e93-23dc6e7d75ae tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.062020 Jan 15 21:01:02.695992 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1892/3784] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:02 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:01:02.713749 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9e5e54af-8218-4386-a6bc-4c18452b69e2 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:02.714528 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-9e5e54af-8218-4386-a6bc-4c18452b69e2 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] [instance: fe691c6c-ffa5-464a-803d-75eb61fd8268] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:02.721492 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9e5e54af-8218-4386-a6bc-4c18452b69e2 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:02.721954 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9e5e54af-8218-4386-a6bc-4c18452b69e2 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:02.723930 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9e5e54af-8218-4386-a6bc-4c18452b69e2 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:02.724370 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9e5e54af-8218-4386-a6bc-4c18452b69e2 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:02.793840 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-9e5e54af-8218-4386-a6bc-4c18452b69e2 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea59ebcaec344a22a53807319a88af69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdff116c9f44e98b33c9f9346be1af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:02.803138 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-9e5e54af-8218-4386-a6bc-4c18452b69e2 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea59ebcaec344a22a53807319a88af69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdff116c9f44e98b33c9f9346be1af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:02.804595 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-9e5e54af-8218-4386-a6bc-4c18452b69e2 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea59ebcaec344a22a53807319a88af69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdff116c9f44e98b33c9f9346be1af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:02.805776 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-9e5e54af-8218-4386-a6bc-4c18452b69e2 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] 10.222.0.46 "GET /compute/v2.1/servers/fe691c6c-ffa5-464a-803d-75eb61fd8268" status: 200 len: 1408 microversion: 2.54 time: 0.096661 Jan 15 21:01:02.806335 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1893/3785] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:01:02 2022] GET /compute/v2.1/servers/fe691c6c-ffa5-464a-803d-75eb61fd8268 => generated 1408 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 15 21:01:02.855925 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-7072528e-35d6-41a8-b4e2-a54b2c0fc3b9 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8f9c6ea7f6496792258d683640c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a75218d537c4d63874297261bec70ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:02.864016 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-7072528e-35d6-41a8-b4e2-a54b2c0fc3b9 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] 10.222.0.46 "GET /compute/v2.1/servers/4d836f07-866f-4e13-94ff-c4fe850e58d3" status: 200 len: 1516 microversion: 2.1 time: 0.184828 Jan 15 21:01:02.864661 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1893/3786] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:02 2022] GET /compute/v2.1/servers/4d836f07-866f-4e13-94ff-c4fe850e58d3 => generated 1516 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:03.197908 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-27595938-23cf-498d-82d0-f92bc87f5101 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:03.198509 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-27595938-23cf-498d-82d0-f92bc87f5101 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:03.205077 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-27595938-23cf-498d-82d0-f92bc87f5101 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:03.205526 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-27595938-23cf-498d-82d0-f92bc87f5101 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:03.206305 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-27595938-23cf-498d-82d0-f92bc87f5101 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:03.207565 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-27595938-23cf-498d-82d0-f92bc87f5101 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:03.343276 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-27595938-23cf-498d-82d0-f92bc87f5101 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:03.351951 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-27595938-23cf-498d-82d0-f92bc87f5101 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9" status: 200 len: 1680 microversion: 2.1 time: 0.157663 Jan 15 21:01:03.352532 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1894/3787] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:03 2022] GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9 => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:03.591453 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5869eb55-8e6e-42c8-af53-943a88282405 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:03.592369 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-5869eb55-8e6e-42c8-af53-943a88282405 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:03.601844 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5869eb55-8e6e-42c8-af53-943a88282405 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:03.602294 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5869eb55-8e6e-42c8-af53-943a88282405 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:03.603083 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5869eb55-8e6e-42c8-af53-943a88282405 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:03.603521 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5869eb55-8e6e-42c8-af53-943a88282405 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:03.639082 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-79b6c09c-fb84-4b21-a155-e79d3e56769d tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:03.639745 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-79b6c09c-fb84-4b21-a155-e79d3e56769d tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:03.646866 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-79b6c09c-fb84-4b21-a155-e79d3e56769d tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:03.647350 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-79b6c09c-fb84-4b21-a155-e79d3e56769d tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:03.648148 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-79b6c09c-fb84-4b21-a155-e79d3e56769d tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:03.648580 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-79b6c09c-fb84-4b21-a155-e79d3e56769d tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:03.818355 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-5869eb55-8e6e-42c8-af53-943a88282405 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6097506a2d4e36818310d9d70bf01b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4dad65fccfe481a973f5fcbb9287dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:03.826134 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5869eb55-8e6e-42c8-af53-943a88282405 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "GET /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a" status: 200 len: 1361 microversion: 2.1 time: 0.240499 Jan 15 21:01:03.826719 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1894/3788] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:03 2022] GET /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a => generated 1361 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:03.831228 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a57b84b9-c4e2-4a07-8016-a5877ccbdf2b tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:03.833123 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a57b84b9-c4e2-4a07-8016-a5877ccbdf2b tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] [instance: 5e93486c-7c77-4855-85f4-2bc8bcf4832f] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:03.838427 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a57b84b9-c4e2-4a07-8016-a5877ccbdf2b tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:03.838875 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a57b84b9-c4e2-4a07-8016-a5877ccbdf2b tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:03.839658 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a57b84b9-c4e2-4a07-8016-a5877ccbdf2b tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:03.840090 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a57b84b9-c4e2-4a07-8016-a5877ccbdf2b tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:03.875332 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-79b6c09c-fb84-4b21-a155-e79d3e56769d tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:03.882563 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a57b84b9-c4e2-4a07-8016-a5877ccbdf2b tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] 10.222.0.46 "POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action" status: 200 len: 32650 microversion: 2.1 time: 0.054616 Jan 15 21:01:03.886530 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1895/3789] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:01:03 2022] POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action => generated 32650 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:01:03.886666 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-79b6c09c-fb84-4b21-a155-e79d3e56769d tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:03.886666 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-79b6c09c-fb84-4b21-a155-e79d3e56769d tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:03.887153 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-79b6c09c-fb84-4b21-a155-e79d3e56769d tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "GET /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220" status: 200 len: 2834 microversion: 2.32 time: 0.251987 Jan 15 21:01:03.887705 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1895/3790] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:01:03 2022] GET /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220 => generated 2834 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 15 21:01:03.888397 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-6d0251e1-3d53-4ee6-aeb2-b4a12fef5fba tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:03.889420 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-6d0251e1-3d53-4ee6-aeb2-b4a12fef5fba tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:03.891946 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-083639c3-cc26-4ae5-80e0-d9f9fbf33d14 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:03.892906 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-083639c3-cc26-4ae5-80e0-d9f9fbf33d14 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:03.897022 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6d0251e1-3d53-4ee6-aeb2-b4a12fef5fba tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:03.897625 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6d0251e1-3d53-4ee6-aeb2-b4a12fef5fba tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:03.898429 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6d0251e1-3d53-4ee6-aeb2-b4a12fef5fba tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:03.898877 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6d0251e1-3d53-4ee6-aeb2-b4a12fef5fba tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:03.899116 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-083639c3-cc26-4ae5-80e0-d9f9fbf33d14 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:03.899564 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-083639c3-cc26-4ae5-80e0-d9f9fbf33d14 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:03.900332 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-083639c3-cc26-4ae5-80e0-d9f9fbf33d14 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:03.900761 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-083639c3-cc26-4ae5-80e0-d9f9fbf33d14 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:03.943122 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-083639c3-cc26-4ae5-80e0-d9f9fbf33d14 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.054233 Jan 15 21:01:03.943994 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1896/3791] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:03 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:01:03.944253 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-6d0251e1-3d53-4ee6-aeb2-b4a12fef5fba tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action" status: 200 len: 24554 microversion: 2.20 time: 0.059595 Jan 15 21:01:03.945446 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1896/3792] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:03 2022] POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action => generated 24554 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:01:03.948474 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-425859ff-bd5c-4530-b609-d9d6412dfa7d tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:03.949192 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-425859ff-bd5c-4530-b609-d9d6412dfa7d tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] [instance: fe691c6c-ffa5-464a-803d-75eb61fd8268] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:03.951913 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-4acf05f4-7e6e-4edb-9bb1-93d4cb1dd16e tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:03.952618 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-4acf05f4-7e6e-4edb-9bb1-93d4cb1dd16e tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: 4d836f07-866f-4e13-94ff-c4fe850e58d3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:03.956112 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-425859ff-bd5c-4530-b609-d9d6412dfa7d tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:03.957119 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-425859ff-bd5c-4530-b609-d9d6412dfa7d tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:03.958160 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-425859ff-bd5c-4530-b609-d9d6412dfa7d tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:03.958490 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-425859ff-bd5c-4530-b609-d9d6412dfa7d tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:03.960234 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4acf05f4-7e6e-4edb-9bb1-93d4cb1dd16e tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:03.960687 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4acf05f4-7e6e-4edb-9bb1-93d4cb1dd16e tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:03.961501 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4acf05f4-7e6e-4edb-9bb1-93d4cb1dd16e tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:03.961942 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4acf05f4-7e6e-4edb-9bb1-93d4cb1dd16e tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:04.045281 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-425859ff-bd5c-4530-b609-d9d6412dfa7d tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea59ebcaec344a22a53807319a88af69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdff116c9f44e98b33c9f9346be1af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:04.054312 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-425859ff-bd5c-4530-b609-d9d6412dfa7d tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea59ebcaec344a22a53807319a88af69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdff116c9f44e98b33c9f9346be1af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:04.055829 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-425859ff-bd5c-4530-b609-d9d6412dfa7d tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea59ebcaec344a22a53807319a88af69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdff116c9f44e98b33c9f9346be1af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:04.057029 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-425859ff-bd5c-4530-b609-d9d6412dfa7d tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] 10.222.0.46 "GET /compute/v2.1/servers/fe691c6c-ffa5-464a-803d-75eb61fd8268" status: 200 len: 1408 microversion: 2.54 time: 0.112178 Jan 15 21:01:04.057592 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1897/3793] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:01:03 2022] GET /compute/v2.1/servers/fe691c6c-ffa5-464a-803d-75eb61fd8268 => generated 1408 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:01:04.062031 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c99ce971-5cb6-4511-bc96-e29a553a2420 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:04.062511 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c99ce971-5cb6-4511-bc96-e29a553a2420 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:04.069152 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c99ce971-5cb6-4511-bc96-e29a553a2420 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:04.069600 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c99ce971-5cb6-4511-bc96-e29a553a2420 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:04.070372 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c99ce971-5cb6-4511-bc96-e29a553a2420 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:04.070804 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c99ce971-5cb6-4511-bc96-e29a553a2420 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:04.149154 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-4acf05f4-7e6e-4edb-9bb1-93d4cb1dd16e tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8f9c6ea7f6496792258d683640c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a75218d537c4d63874297261bec70ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:04.156989 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-4acf05f4-7e6e-4edb-9bb1-93d4cb1dd16e tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] 10.222.0.46 "GET /compute/v2.1/servers/4d836f07-866f-4e13-94ff-c4fe850e58d3" status: 200 len: 1516 microversion: 2.1 time: 0.210822 Jan 15 21:01:04.158280 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1897/3794] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:03 2022] GET /compute/v2.1/servers/4d836f07-866f-4e13-94ff-c4fe850e58d3 => generated 1516 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:04.213955 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c99ce971-5cb6-4511-bc96-e29a553a2420 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "GET /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/os-interface" status: 200 len: 1833 microversion: 2.32 time: 0.155293 Jan 15 21:01:04.214551 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1898/3795] 10.222.0.46 () {60 vars in 1315 bytes} [Sat Jan 15 21:01:04 2022] GET /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/os-interface => generated 1833 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:01:04.369405 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d9b5b007-a715-43a1-9e07-ac51c11180e6 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:04.370009 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d9b5b007-a715-43a1-9e07-ac51c11180e6 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:04.376437 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d9b5b007-a715-43a1-9e07-ac51c11180e6 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:04.376925 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d9b5b007-a715-43a1-9e07-ac51c11180e6 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:04.379557 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d9b5b007-a715-43a1-9e07-ac51c11180e6 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:04.379762 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d9b5b007-a715-43a1-9e07-ac51c11180e6 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:04.646756 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-d9b5b007-a715-43a1-9e07-ac51c11180e6 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:04.654367 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d9b5b007-a715-43a1-9e07-ac51c11180e6 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9" status: 200 len: 1688 microversion: 2.1 time: 0.288704 Jan 15 21:01:04.654964 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1898/3796] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:04 2022] GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9 => generated 1688 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:04.843550 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1e175ff3-58ea-497c-9fb3-ac6f113348a9 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:04.844175 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-1e175ff3-58ea-497c-9fb3-ac6f113348a9 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:04.852552 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1e175ff3-58ea-497c-9fb3-ac6f113348a9 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:04.853166 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1e175ff3-58ea-497c-9fb3-ac6f113348a9 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:04.854054 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1e175ff3-58ea-497c-9fb3-ac6f113348a9 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:04.854612 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1e175ff3-58ea-497c-9fb3-ac6f113348a9 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:04.897509 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-98d2bd33-a182-463e-9280-4a3398f5d4a4 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:04.898648 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-98d2bd33-a182-463e-9280-4a3398f5d4a4 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] [instance: 5e93486c-7c77-4855-85f4-2bc8bcf4832f] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:04.905790 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-98d2bd33-a182-463e-9280-4a3398f5d4a4 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:04.906250 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-98d2bd33-a182-463e-9280-4a3398f5d4a4 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:04.907191 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-98d2bd33-a182-463e-9280-4a3398f5d4a4 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:04.907922 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-98d2bd33-a182-463e-9280-4a3398f5d4a4 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:04.954601 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-98d2bd33-a182-463e-9280-4a3398f5d4a4 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] 10.222.0.46 "POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action" status: 200 len: 32650 microversion: 2.1 time: 0.062184 Jan 15 21:01:04.956010 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1899/3797] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:01:04 2022] POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action => generated 32650 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:01:04.961763 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-622f56c3-9b86-47a2-9387-c7b39e91dc72 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:04.962792 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-622f56c3-9b86-47a2-9387-c7b39e91dc72 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:04.971127 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-622f56c3-9b86-47a2-9387-c7b39e91dc72 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:04.971599 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-622f56c3-9b86-47a2-9387-c7b39e91dc72 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:04.973658 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-622f56c3-9b86-47a2-9387-c7b39e91dc72 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:04.974116 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-622f56c3-9b86-47a2-9387-c7b39e91dc72 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:05.026781 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-622f56c3-9b86-47a2-9387-c7b39e91dc72 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.069966 Jan 15 21:01:05.031378 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1900/3798] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:04 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:01:05.034051 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-07e1e9fc-ce0e-4033-960a-0a93cd8fa897 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:05.035796 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-07e1e9fc-ce0e-4033-960a-0a93cd8fa897 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:05.043801 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-07e1e9fc-ce0e-4033-960a-0a93cd8fa897 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:05.044960 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-07e1e9fc-ce0e-4033-960a-0a93cd8fa897 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:05.045657 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-07e1e9fc-ce0e-4033-960a-0a93cd8fa897 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:05.046182 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-07e1e9fc-ce0e-4033-960a-0a93cd8fa897 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:05.109168 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-07e1e9fc-ce0e-4033-960a-0a93cd8fa897 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action" status: 200 len: 32628 microversion: 2.20 time: 0.079449 Jan 15 21:01:05.110640 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1901/3799] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:05 2022] POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action => generated 32628 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:01:05.116189 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-554bb07b-2eb6-421f-97a6-7358aa578cd5 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:05.116927 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-554bb07b-2eb6-421f-97a6-7358aa578cd5 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] [instance: fe691c6c-ffa5-464a-803d-75eb61fd8268] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:05.124624 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-554bb07b-2eb6-421f-97a6-7358aa578cd5 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:05.124937 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-554bb07b-2eb6-421f-97a6-7358aa578cd5 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:05.125739 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-554bb07b-2eb6-421f-97a6-7358aa578cd5 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:05.126183 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-554bb07b-2eb6-421f-97a6-7358aa578cd5 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:05.231821 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-554bb07b-2eb6-421f-97a6-7358aa578cd5 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea59ebcaec344a22a53807319a88af69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdff116c9f44e98b33c9f9346be1af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:05.244678 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-554bb07b-2eb6-421f-97a6-7358aa578cd5 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea59ebcaec344a22a53807319a88af69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdff116c9f44e98b33c9f9346be1af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:05.246496 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-554bb07b-2eb6-421f-97a6-7358aa578cd5 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea59ebcaec344a22a53807319a88af69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdff116c9f44e98b33c9f9346be1af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:05.247911 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-554bb07b-2eb6-421f-97a6-7358aa578cd5 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] 10.222.0.46 "GET /compute/v2.1/servers/fe691c6c-ffa5-464a-803d-75eb61fd8268" status: 200 len: 1408 microversion: 2.54 time: 0.136576 Jan 15 21:01:05.248974 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1902/3800] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:01:05 2022] GET /compute/v2.1/servers/fe691c6c-ffa5-464a-803d-75eb61fd8268 => generated 1408 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:01:05.254979 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-852943ea-8acc-44a6-a050-d950cce9975e req-8be016b5-14b4-423c-9c6e-26f6f841378d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4504a13b-d10e-436a-a5ef-991829938dd9", "name": "network-vif-unplugged", "status": "completed", "tag": "f7503e3b-a43e-4550-8109-a1fb1aa2d5f1"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:05.256674 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:01:05.256674 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:01:05.264281 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-852943ea-8acc-44a6-a050-d950cce9975e req-8be016b5-14b4-423c-9c6e-26f6f841378d service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:05.264729 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-852943ea-8acc-44a6-a050-d950cce9975e req-8be016b5-14b4-423c-9c6e-26f6f841378d service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:05.278709 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-852943ea-8acc-44a6-a050-d950cce9975e req-8be016b5-14b4-423c-9c6e-26f6f841378d service nova] Creating event network-vif-unplugged:f7503e3b-a43e-4550-8109-a1fb1aa2d5f1 for instance 4504a13b-d10e-436a-a5ef-991829938dd9 on nch1-master-1 Jan 15 21:01:05.284023 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-852943ea-8acc-44a6-a050-d950cce9975e req-8be016b5-14b4-423c-9c6e-26f6f841378d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033566 Jan 15 21:01:05.285281 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1903/3801] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:01:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:01:05.290298 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c365e3a7-d918-4ede-bcaa-e43dea09b1ca tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:05.291002 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c365e3a7-d918-4ede-bcaa-e43dea09b1ca tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: 4d836f07-866f-4e13-94ff-c4fe850e58d3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:05.297629 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c365e3a7-d918-4ede-bcaa-e43dea09b1ca tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:05.298080 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c365e3a7-d918-4ede-bcaa-e43dea09b1ca tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:05.298874 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c365e3a7-d918-4ede-bcaa-e43dea09b1ca tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:05.299434 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c365e3a7-d918-4ede-bcaa-e43dea09b1ca tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:05.407022 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-1e175ff3-58ea-497c-9fb3-ac6f113348a9 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6097506a2d4e36818310d9d70bf01b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4dad65fccfe481a973f5fcbb9287dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:05.415574 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-1e175ff3-58ea-497c-9fb3-ac6f113348a9 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "GET /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a" status: 200 len: 1361 microversion: 2.1 time: 0.575716 Jan 15 21:01:05.416155 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1899/3802] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:04 2022] GET /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a => generated 1361 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:05.537544 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-c365e3a7-d918-4ede-bcaa-e43dea09b1ca tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8f9c6ea7f6496792258d683640c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a75218d537c4d63874297261bec70ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:05.545399 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c365e3a7-d918-4ede-bcaa-e43dea09b1ca tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] 10.222.0.46 "GET /compute/v2.1/servers/4d836f07-866f-4e13-94ff-c4fe850e58d3" status: 200 len: 1516 microversion: 2.1 time: 0.259052 Jan 15 21:01:05.545976 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1904/3803] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:05 2022] GET /compute/v2.1/servers/4d836f07-866f-4e13-94ff-c4fe850e58d3 => generated 1516 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:05.671774 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7ea23790-ec03-46e5-b21b-4ddf96fbe629 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:05.672381 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-7ea23790-ec03-46e5-b21b-4ddf96fbe629 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:05.679124 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7ea23790-ec03-46e5-b21b-4ddf96fbe629 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:05.679589 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7ea23790-ec03-46e5-b21b-4ddf96fbe629 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:05.680381 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7ea23790-ec03-46e5-b21b-4ddf96fbe629 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:05.680816 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7ea23790-ec03-46e5-b21b-4ddf96fbe629 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:05.764559 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-7f1f9b42-e7f6-4845-9335-1c56ee5346cf tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:05.765917 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-7f1f9b42-e7f6-4845-9335-1c56ee5346cf tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:05.774352 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7f1f9b42-e7f6-4845-9335-1c56ee5346cf tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:05.775354 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7f1f9b42-e7f6-4845-9335-1c56ee5346cf tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:05.778191 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7f1f9b42-e7f6-4845-9335-1c56ee5346cf tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:05.778191 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7f1f9b42-e7f6-4845-9335-1c56ee5346cf tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:05.821727 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-7f1f9b42-e7f6-4845-9335-1c56ee5346cf tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 14 microversion: 2.32 time: 0.061262 Jan 15 21:01:05.824914 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1905/3804] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:05 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 14 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:05.827475 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-8e051521-2867-41fc-9ab4-1cb3716a096b req-ddb50007-d175-4d9e-b23c-f121c02de99d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "686aa731-082f-4584-8607-5a40f0d63220", "tag": "1c682467-fd92-4011-a1b3-79b4e61291df"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:05.829039 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:01:05.829039 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:01:05.837598 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-8e051521-2867-41fc-9ab4-1cb3716a096b req-ddb50007-d175-4d9e-b23c-f121c02de99d service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:05.838056 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-8e051521-2867-41fc-9ab4-1cb3716a096b req-ddb50007-d175-4d9e-b23c-f121c02de99d service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:05.851350 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-8e051521-2867-41fc-9ab4-1cb3716a096b req-ddb50007-d175-4d9e-b23c-f121c02de99d service nova] Creating event network-changed:1c682467-fd92-4011-a1b3-79b4e61291df for instance 686aa731-082f-4584-8607-5a40f0d63220 on nch1-master-1 Jan 15 21:01:05.856429 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-8e051521-2867-41fc-9ab4-1cb3716a096b req-ddb50007-d175-4d9e-b23c-f121c02de99d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032724 Jan 15 21:01:05.857548 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1906/3805] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:01:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:01:05.862491 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-7ea23790-ec03-46e5-b21b-4ddf96fbe629 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:05.871290 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7ea23790-ec03-46e5-b21b-4ddf96fbe629 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9" status: 200 len: 1688 microversion: 2.1 time: 0.203552 Jan 15 21:01:05.882109 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1900/3806] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:05 2022] GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9 => generated 1688 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:05.967937 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-810c0409-8d3e-4ea6-a71f-3d0f4a37546b tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:05.969202 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-810c0409-8d3e-4ea6-a71f-3d0f4a37546b tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] [instance: 5e93486c-7c77-4855-85f4-2bc8bcf4832f] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:05.977215 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-810c0409-8d3e-4ea6-a71f-3d0f4a37546b tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:05.977800 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-810c0409-8d3e-4ea6-a71f-3d0f4a37546b tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:05.979311 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-810c0409-8d3e-4ea6-a71f-3d0f4a37546b tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:05.979918 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-810c0409-8d3e-4ea6-a71f-3d0f4a37546b tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:06.039667 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-17a29569-30cf-41aa-b503-376a8cc258fc tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:06.041625 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-17a29569-30cf-41aa-b503-376a8cc258fc tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:06.042267 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-810c0409-8d3e-4ea6-a71f-3d0f4a37546b tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] 10.222.0.46 "POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action" status: 200 len: 40804 microversion: 2.1 time: 0.078486 Jan 15 21:01:06.042950 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1907/3807] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:01:05 2022] POST /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f/action => generated 40804 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:01:06.054567 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-17a29569-30cf-41aa-b503-376a8cc258fc tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:06.054984 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-17a29569-30cf-41aa-b503-376a8cc258fc tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:06.055613 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b549895d-4f0d-49a8-bb73-262ba885e5ef tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:06.055998 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-17a29569-30cf-41aa-b503-376a8cc258fc tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:06.056328 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b549895d-4f0d-49a8-bb73-262ba885e5ef tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] [instance: 5e93486c-7c77-4855-85f4-2bc8bcf4832f] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:06.056668 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-17a29569-30cf-41aa-b503-376a8cc258fc tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:06.064485 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b549895d-4f0d-49a8-bb73-262ba885e5ef tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:06.064986 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b549895d-4f0d-49a8-bb73-262ba885e5ef tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:06.066420 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b549895d-4f0d-49a8-bb73-262ba885e5ef tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:06.066796 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b549895d-4f0d-49a8-bb73-262ba885e5ef tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:06.108518 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-17a29569-30cf-41aa-b503-376a8cc258fc tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.073031 Jan 15 21:01:06.109365 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1901/3808] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:06 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:01:06.122032 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e3d478eb-afe9-4251-aa2f-434abdef5435 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:06.123259 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e3d478eb-afe9-4251-aa2f-434abdef5435 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:06.135001 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e3d478eb-afe9-4251-aa2f-434abdef5435 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:06.137283 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e3d478eb-afe9-4251-aa2f-434abdef5435 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:06.138349 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e3d478eb-afe9-4251-aa2f-434abdef5435 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:06.138798 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e3d478eb-afe9-4251-aa2f-434abdef5435 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:06.226422 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e3d478eb-afe9-4251-aa2f-434abdef5435 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action" status: 200 len: 32628 microversion: 2.20 time: 0.108423 Jan 15 21:01:06.230382 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1902/3809] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:06 2022] POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action => generated 32628 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:01:06.230552 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-b549895d-4f0d-49a8-bb73-262ba885e5ef tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f38865f66e433090132a8a09d44774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16b035e629e4eb89850c2871a128781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:06.241393 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b549895d-4f0d-49a8-bb73-262ba885e5ef tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] 10.222.0.46 "GET /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f" status: 200 len: 1697 microversion: 2.1 time: 0.191339 Jan 15 21:01:06.242066 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1908/3810] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:06 2022] GET /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f => generated 1697 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:06.270763 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c4b646e7-9f86-4bc9-b431-370b5e815bae tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:06.271475 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c4b646e7-9f86-4bc9-b431-370b5e815bae tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] [instance: fe691c6c-ffa5-464a-803d-75eb61fd8268] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:06.280776 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c4b646e7-9f86-4bc9-b431-370b5e815bae tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:06.281542 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c4b646e7-9f86-4bc9-b431-370b5e815bae tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:06.282599 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c4b646e7-9f86-4bc9-b431-370b5e815bae tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:06.283224 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c4b646e7-9f86-4bc9-b431-370b5e815bae tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:06.367331 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-c4b646e7-9f86-4bc9-b431-370b5e815bae tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea59ebcaec344a22a53807319a88af69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdff116c9f44e98b33c9f9346be1af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:06.376414 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-c4b646e7-9f86-4bc9-b431-370b5e815bae tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea59ebcaec344a22a53807319a88af69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdff116c9f44e98b33c9f9346be1af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:06.380322 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-c4b646e7-9f86-4bc9-b431-370b5e815bae tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea59ebcaec344a22a53807319a88af69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdff116c9f44e98b33c9f9346be1af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:06.381677 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c4b646e7-9f86-4bc9-b431-370b5e815bae tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] 10.222.0.46 "GET /compute/v2.1/servers/fe691c6c-ffa5-464a-803d-75eb61fd8268" status: 200 len: 1408 microversion: 2.54 time: 0.118246 Jan 15 21:01:06.383172 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1903/3811] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:01:06 2022] GET /compute/v2.1/servers/fe691c6c-ffa5-464a-803d-75eb61fd8268 => generated 1408 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:01:06.431792 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-03e20bdf-65e9-4cdf-a947-2859edf1d2f9 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:06.432613 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-03e20bdf-65e9-4cdf-a947-2859edf1d2f9 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:06.445170 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-03e20bdf-65e9-4cdf-a947-2859edf1d2f9 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:06.445713 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-03e20bdf-65e9-4cdf-a947-2859edf1d2f9 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:06.446638 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-03e20bdf-65e9-4cdf-a947-2859edf1d2f9 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:06.447189 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-03e20bdf-65e9-4cdf-a947-2859edf1d2f9 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:06.562956 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-268f405f-1521-4d33-9c08-698e97622a75 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:06.563642 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-268f405f-1521-4d33-9c08-698e97622a75 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: 4d836f07-866f-4e13-94ff-c4fe850e58d3] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:06.575917 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-268f405f-1521-4d33-9c08-698e97622a75 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:06.576538 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-268f405f-1521-4d33-9c08-698e97622a75 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:06.577551 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-268f405f-1521-4d33-9c08-698e97622a75 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:06.579527 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-268f405f-1521-4d33-9c08-698e97622a75 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:06.724183 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-03e20bdf-65e9-4cdf-a947-2859edf1d2f9 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6097506a2d4e36818310d9d70bf01b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4dad65fccfe481a973f5fcbb9287dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:06.740356 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-03e20bdf-65e9-4cdf-a947-2859edf1d2f9 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "GET /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a" status: 200 len: 1361 microversion: 2.1 time: 0.312136 Jan 15 21:01:06.745597 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1909/3812] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:06 2022] GET /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a => generated 1361 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:06.834096 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-dd7e0e0a-a5ca-4e9a-82dc-bce4b39b98e7 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:06.836073 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-dd7e0e0a-a5ca-4e9a-82dc-bce4b39b98e7 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:06.848944 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dd7e0e0a-a5ca-4e9a-82dc-bce4b39b98e7 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:06.851886 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dd7e0e0a-a5ca-4e9a-82dc-bce4b39b98e7 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:06.852963 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dd7e0e0a-a5ca-4e9a-82dc-bce4b39b98e7 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:06.853660 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dd7e0e0a-a5ca-4e9a-82dc-bce4b39b98e7 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:06.872625 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-268f405f-1521-4d33-9c08-698e97622a75 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8f9c6ea7f6496792258d683640c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a75218d537c4d63874297261bec70ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:06.881199 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-268f405f-1521-4d33-9c08-698e97622a75 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] 10.222.0.46 "GET /compute/v2.1/servers/4d836f07-866f-4e13-94ff-c4fe850e58d3" status: 200 len: 1516 microversion: 2.1 time: 0.322231 Jan 15 21:01:06.881791 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1904/3813] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:06 2022] GET /compute/v2.1/servers/4d836f07-866f-4e13-94ff-c4fe850e58d3 => generated 1516 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:06.892996 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-511758e4-2834-4338-94e2-c915f1250c42 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:06.898056 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:01:06.898056 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:01:06.901174 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-511758e4-2834-4338-94e2-c915f1250c42 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '27f38865f66e433090132a8a09d44774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16b035e629e4eb89850c2871a128781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:06.902062 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-511758e4-2834-4338-94e2-c915f1250c42 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Searching by: {'deleted': False, 'project_id': 'f16b035e629e4eb89850c2871a128781'} {{(pid=129366) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 15 21:01:06.907943 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-511758e4-2834-4338-94e2-c915f1250c42 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:06.908575 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-511758e4-2834-4338-94e2-c915f1250c42 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:06.913413 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-511758e4-2834-4338-94e2-c915f1250c42 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:06.914505 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-511758e4-2834-4338-94e2-c915f1250c42 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:06.936141 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-dd7e0e0a-a5ca-4e9a-82dc-bce4b39b98e7 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 14 microversion: 2.32 time: 0.106239 Jan 15 21:01:06.942107 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1910/3814] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:06 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 14 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:01:06.950720 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-418f3112-35f9-4b36-9aa6-82943a2d8aa5 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:06.951618 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.multi_cell_list [None req-511758e4-2834-4338-94e2-c915f1250c42 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=129366) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jan 15 21:01:06.952116 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-418f3112-35f9-4b36-9aa6-82943a2d8aa5 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:06.960551 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-418f3112-35f9-4b36-9aa6-82943a2d8aa5 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:06.961474 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-418f3112-35f9-4b36-9aa6-82943a2d8aa5 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:06.962593 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-418f3112-35f9-4b36-9aa6-82943a2d8aa5 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:06.963246 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-418f3112-35f9-4b36-9aa6-82943a2d8aa5 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:07.002172 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-511758e4-2834-4338-94e2-c915f1250c42 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] 10.222.0.46 "GET /compute/v2.1/servers" status: 200 len: 334 microversion: 2.1 time: 0.119314 Jan 15 21:01:07.002760 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1905/3815] 10.222.0.46 () {58 vars in 1124 bytes} [Sat Jan 15 21:01:06 2022] GET /compute/v2.1/servers => generated 334 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:01:07.022450 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9aa4a25d-90d6-4f4a-9d4a-47c7b182af71 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:07.028277 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:01:07.028277 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:01:07.029639 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-9aa4a25d-90d6-4f4a-9d4a-47c7b182af71 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '27f38865f66e433090132a8a09d44774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16b035e629e4eb89850c2871a128781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:07.030986 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-9aa4a25d-90d6-4f4a-9d4a-47c7b182af71 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Searching by: {'deleted': False, 'project_id': 'f16b035e629e4eb89850c2871a128781'} {{(pid=129366) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 15 21:01:07.046124 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9aa4a25d-90d6-4f4a-9d4a-47c7b182af71 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:07.046723 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9aa4a25d-90d6-4f4a-9d4a-47c7b182af71 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:07.047830 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9aa4a25d-90d6-4f4a-9d4a-47c7b182af71 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:07.050573 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9aa4a25d-90d6-4f4a-9d4a-47c7b182af71 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:07.108427 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.multi_cell_list [None req-9aa4a25d-90d6-4f4a-9d4a-47c7b182af71 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=129366) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jan 15 21:01:07.187669 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-9aa4a25d-90d6-4f4a-9d4a-47c7b182af71 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f38865f66e433090132a8a09d44774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16b035e629e4eb89850c2871a128781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:07.198962 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-418f3112-35f9-4b36-9aa6-82943a2d8aa5 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:07.199859 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9aa4a25d-90d6-4f4a-9d4a-47c7b182af71 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:07.200509 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9aa4a25d-90d6-4f4a-9d4a-47c7b182af71 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:07.209158 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-418f3112-35f9-4b36-9aa6-82943a2d8aa5 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9" status: 200 len: 1683 microversion: 2.1 time: 0.265145 Jan 15 21:01:07.210806 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1911/3816] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:06 2022] GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9 => generated 1683 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:07.216557 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-1160986a-322d-4d16-bd7a-14540702d55b tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:07.218004 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-1160986a-322d-4d16-bd7a-14540702d55b tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:07.228652 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1160986a-322d-4d16-bd7a-14540702d55b tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:07.229379 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1160986a-322d-4d16-bd7a-14540702d55b tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:07.230519 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1160986a-322d-4d16-bd7a-14540702d55b tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:07.231102 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1160986a-322d-4d16-bd7a-14540702d55b tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:07.433329 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-1160986a-322d-4d16-bd7a-14540702d55b tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.190373 Jan 15 21:01:07.434329 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1912/3817] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:07 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:01:07.455142 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d8a9404e-1b24-4f3e-a663-20b042b7bf15 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:07.461475 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d8a9404e-1b24-4f3e-a663-20b042b7bf15 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:07.487267 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d8a9404e-1b24-4f3e-a663-20b042b7bf15 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:07.490663 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d8a9404e-1b24-4f3e-a663-20b042b7bf15 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:07.493427 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d8a9404e-1b24-4f3e-a663-20b042b7bf15 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:07.494721 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d8a9404e-1b24-4f3e-a663-20b042b7bf15 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:07.519295 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-9aa4a25d-90d6-4f4a-9d4a-47c7b182af71 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] 10.222.0.46 "GET /compute/v2.1/servers/detail" status: 200 len: 1700 microversion: 2.1 time: 0.499988 Jan 15 21:01:07.520205 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1906/3818] 10.222.0.46 () {58 vars in 1145 bytes} [Sat Jan 15 21:01:07 2022] GET /compute/v2.1/servers/detail => generated 1700 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:07.526987 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-a43dbf48-8fc6-4552-ad0b-5e616476a002 req-9437692b-d5fc-435a-a6d2-dbbb6b575cda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac78554d-ca29-4e31-a410-00dc4df5c77a", "name": "network-vif-plugged", "status": "completed", "tag": "97667f1d-b2d5-4c9c-b247-ad291c112fa3"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:07.532437 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:01:07.532437 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:01:07.550036 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-a43dbf48-8fc6-4552-ad0b-5e616476a002 req-9437692b-d5fc-435a-a6d2-dbbb6b575cda service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:07.550556 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-a43dbf48-8fc6-4552-ad0b-5e616476a002 req-9437692b-d5fc-435a-a6d2-dbbb6b575cda service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:07.568388 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-a43dbf48-8fc6-4552-ad0b-5e616476a002 req-9437692b-d5fc-435a-a6d2-dbbb6b575cda service nova] Creating event network-vif-plugged:97667f1d-b2d5-4c9c-b247-ad291c112fa3 for instance ac78554d-ca29-4e31-a410-00dc4df5c77a on nch2-master-1 Jan 15 21:01:07.573767 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d8a9404e-1b24-4f3e-a663-20b042b7bf15 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action" status: 200 len: 32628 microversion: 2.20 time: 0.138246 Jan 15 21:01:07.578319 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1913/3819] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:07 2022] POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action => generated 32628 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:01:07.583107 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f551e89e-0773-432d-b972-a3c48cc7a47e tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:07.583820 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f551e89e-0773-432d-b972-a3c48cc7a47e tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] [instance: fe691c6c-ffa5-464a-803d-75eb61fd8268] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:07.590686 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-a43dbf48-8fc6-4552-ad0b-5e616476a002 req-9437692b-d5fc-435a-a6d2-dbbb6b575cda service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068945 Jan 15 21:01:07.591656 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1907/3820] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:01:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:01:07.599056 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7abd03d8-1b08-4e75-b4bf-e8ecdce18363 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:07.605885 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f551e89e-0773-432d-b972-a3c48cc7a47e tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:07.606342 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f551e89e-0773-432d-b972-a3c48cc7a47e tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:07.607212 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f551e89e-0773-432d-b972-a3c48cc7a47e tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:07.607678 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f551e89e-0773-432d-b972-a3c48cc7a47e tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:07.616887 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7abd03d8-1b08-4e75-b4bf-e8ecdce18363 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] 10.222.0.46 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.024010 Jan 15 21:01:07.621060 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1908/3821] 10.222.0.46 () {58 vars in 1136 bytes} [Sat Jan 15 21:01:07 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:01:07.696732 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-f551e89e-0773-432d-b972-a3c48cc7a47e tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea59ebcaec344a22a53807319a88af69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdff116c9f44e98b33c9f9346be1af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:07.717819 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-f551e89e-0773-432d-b972-a3c48cc7a47e tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea59ebcaec344a22a53807319a88af69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdff116c9f44e98b33c9f9346be1af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:07.725776 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-f551e89e-0773-432d-b972-a3c48cc7a47e tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea59ebcaec344a22a53807319a88af69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdff116c9f44e98b33c9f9346be1af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:07.727066 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f551e89e-0773-432d-b972-a3c48cc7a47e tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] 10.222.0.46 "GET /compute/v2.1/servers/fe691c6c-ffa5-464a-803d-75eb61fd8268" status: 200 len: 1408 microversion: 2.54 time: 0.151000 Jan 15 21:01:07.727662 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1914/3822] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:01:07 2022] GET /compute/v2.1/servers/fe691c6c-ffa5-464a-803d-75eb61fd8268 => generated 1408 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:01:07.764568 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b2833ae1-49bc-4dcf-bc03-7be7ba362824 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:07.765588 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b2833ae1-49bc-4dcf-bc03-7be7ba362824 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:07.775457 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b2833ae1-49bc-4dcf-bc03-7be7ba362824 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:07.776194 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b2833ae1-49bc-4dcf-bc03-7be7ba362824 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:07.777209 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b2833ae1-49bc-4dcf-bc03-7be7ba362824 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:07.777657 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b2833ae1-49bc-4dcf-bc03-7be7ba362824 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:07.899316 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-765476b5-5a0e-4c64-bec6-57170863d71d tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:07.900537 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-765476b5-5a0e-4c64-bec6-57170863d71d tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: 4d836f07-866f-4e13-94ff-c4fe850e58d3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:07.908653 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-765476b5-5a0e-4c64-bec6-57170863d71d tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:07.909417 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-765476b5-5a0e-4c64-bec6-57170863d71d tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:07.910447 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-765476b5-5a0e-4c64-bec6-57170863d71d tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:07.911087 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-765476b5-5a0e-4c64-bec6-57170863d71d tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:07.994264 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-b2833ae1-49bc-4dcf-bc03-7be7ba362824 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6097506a2d4e36818310d9d70bf01b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4dad65fccfe481a973f5fcbb9287dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:08.007114 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b2833ae1-49bc-4dcf-bc03-7be7ba362824 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "GET /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a" status: 200 len: 1361 microversion: 2.1 time: 0.246809 Jan 15 21:01:08.007860 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1909/3823] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:07 2022] GET /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a => generated 1361 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:08.013097 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-bc86b8cc-5e4c-4ad1-9911-42213d1d3bee tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:08.014313 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-bc86b8cc-5e4c-4ad1-9911-42213d1d3bee tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:08.021824 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bc86b8cc-5e4c-4ad1-9911-42213d1d3bee tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:08.022643 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bc86b8cc-5e4c-4ad1-9911-42213d1d3bee tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:08.023652 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bc86b8cc-5e4c-4ad1-9911-42213d1d3bee tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:08.024163 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bc86b8cc-5e4c-4ad1-9911-42213d1d3bee tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:08.080162 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-bc86b8cc-5e4c-4ad1-9911-42213d1d3bee tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 14 microversion: 2.32 time: 0.070804 Jan 15 21:01:08.082322 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1910/3824] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:08 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 14 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:08.087770 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-99a5c0ef-925c-471b-a532-7c1066b14ee7 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:08.088361 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-99a5c0ef-925c-471b-a532-7c1066b14ee7 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] [instance: 5e93486c-7c77-4855-85f4-2bc8bcf4832f] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:08.096095 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-99a5c0ef-925c-471b-a532-7c1066b14ee7 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:08.096935 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-99a5c0ef-925c-471b-a532-7c1066b14ee7 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:08.097517 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-99a5c0ef-925c-471b-a532-7c1066b14ee7 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:08.097978 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-99a5c0ef-925c-471b-a532-7c1066b14ee7 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:08.111608 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-765476b5-5a0e-4c64-bec6-57170863d71d tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8f9c6ea7f6496792258d683640c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a75218d537c4d63874297261bec70ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:08.125125 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-765476b5-5a0e-4c64-bec6-57170863d71d tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] 10.222.0.46 "GET /compute/v2.1/servers/4d836f07-866f-4e13-94ff-c4fe850e58d3" status: 200 len: 1516 microversion: 2.1 time: 0.229472 Jan 15 21:01:08.126683 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1915/3825] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:07 2022] GET /compute/v2.1/servers/4d836f07-866f-4e13-94ff-c4fe850e58d3 => generated 1516 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:08.132475 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-99a5c0ef-925c-471b-a532-7c1066b14ee7 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] [instance: 5e93486c-7c77-4855-85f4-2bc8bcf4832f] Going to try to terminate instance {{(pid=129366) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 21:01:08.233269 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-54f754ad-24e9-4e55-9860-b8ab85b522d1 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:08.234301 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-54f754ad-24e9-4e55-9860-b8ab85b522d1 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:08.243331 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-99a5c0ef-925c-471b-a532-7c1066b14ee7 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] 10.222.0.46 "DELETE /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f" status: 204 len: 0 microversion: 2.1 time: 0.157811 Jan 15 21:01:08.248573 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1911/3826] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 21:01:08 2022] DELETE /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 21:01:08.248767 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-54f754ad-24e9-4e55-9860-b8ab85b522d1 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:08.248767 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-54f754ad-24e9-4e55-9860-b8ab85b522d1 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:08.249532 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-54f754ad-24e9-4e55-9860-b8ab85b522d1 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:08.249971 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-54f754ad-24e9-4e55-9860-b8ab85b522d1 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:08.257926 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-fa9244ad-763e-4d4d-825b-f6723bfa1da3 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:08.258616 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-fa9244ad-763e-4d4d-825b-f6723bfa1da3 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] [instance: 5e93486c-7c77-4855-85f4-2bc8bcf4832f] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:08.270284 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fa9244ad-763e-4d4d-825b-f6723bfa1da3 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:08.270978 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fa9244ad-763e-4d4d-825b-f6723bfa1da3 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:08.271799 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fa9244ad-763e-4d4d-825b-f6723bfa1da3 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:08.272276 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fa9244ad-763e-4d4d-825b-f6723bfa1da3 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:08.493214 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-54f754ad-24e9-4e55-9860-b8ab85b522d1 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:08.506460 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-54f754ad-24e9-4e55-9860-b8ab85b522d1 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9" status: 200 len: 1683 microversion: 2.1 time: 0.280967 Jan 15 21:01:08.506668 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1916/3827] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:08 2022] GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9 => generated 1683 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:08.521336 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-4765a8ad-bd47-480f-952f-8493beec8c67 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:08.522271 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-4765a8ad-bd47-480f-952f-8493beec8c67 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:08.528152 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-fa9244ad-763e-4d4d-825b-f6723bfa1da3 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f38865f66e433090132a8a09d44774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16b035e629e4eb89850c2871a128781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:08.538005 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4765a8ad-bd47-480f-952f-8493beec8c67 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:08.538439 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4765a8ad-bd47-480f-952f-8493beec8c67 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:08.539228 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4765a8ad-bd47-480f-952f-8493beec8c67 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:08.539657 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4765a8ad-bd47-480f-952f-8493beec8c67 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:08.542664 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-fa9244ad-763e-4d4d-825b-f6723bfa1da3 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] 10.222.0.46 "GET /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f" status: 200 len: 1703 microversion: 2.1 time: 0.288589 Jan 15 21:01:08.543463 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1912/3828] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:08 2022] GET /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f => generated 1703 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:08.586922 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-04497695-b5de-4a62-9446-977892392e64 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:08.587936 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-04497695-b5de-4a62-9446-977892392e64 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:08.598367 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-04497695-b5de-4a62-9446-977892392e64 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:08.598951 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-04497695-b5de-4a62-9446-977892392e64 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:08.599857 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-04497695-b5de-4a62-9446-977892392e64 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:08.600394 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-04497695-b5de-4a62-9446-977892392e64 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:08.602739 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-4765a8ad-bd47-480f-952f-8493beec8c67 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.085819 Jan 15 21:01:08.607320 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1917/3829] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:08 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:01:08.649829 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-04497695-b5de-4a62-9446-977892392e64 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action" status: 200 len: 32628 microversion: 2.20 time: 0.066842 Jan 15 21:01:08.653925 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1913/3830] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:08 2022] POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action => generated 32628 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:01:08.747157 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-677cf8de-8241-47ec-a52d-0f624c375553 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:08.748325 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-677cf8de-8241-47ec-a52d-0f624c375553 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] [instance: fe691c6c-ffa5-464a-803d-75eb61fd8268] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:08.756669 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-677cf8de-8241-47ec-a52d-0f624c375553 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:08.757250 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-677cf8de-8241-47ec-a52d-0f624c375553 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:08.758146 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-677cf8de-8241-47ec-a52d-0f624c375553 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:08.758643 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-677cf8de-8241-47ec-a52d-0f624c375553 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:08.833987 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-677cf8de-8241-47ec-a52d-0f624c375553 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea59ebcaec344a22a53807319a88af69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdff116c9f44e98b33c9f9346be1af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:08.843929 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-677cf8de-8241-47ec-a52d-0f624c375553 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea59ebcaec344a22a53807319a88af69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdff116c9f44e98b33c9f9346be1af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:08.846143 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-677cf8de-8241-47ec-a52d-0f624c375553 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea59ebcaec344a22a53807319a88af69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdff116c9f44e98b33c9f9346be1af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:08.848252 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-677cf8de-8241-47ec-a52d-0f624c375553 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] 10.222.0.46 "GET /compute/v2.1/servers/fe691c6c-ffa5-464a-803d-75eb61fd8268" status: 200 len: 1408 microversion: 2.54 time: 0.106675 Jan 15 21:01:08.860519 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1918/3831] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:01:08 2022] GET /compute/v2.1/servers/fe691c6c-ffa5-464a-803d-75eb61fd8268 => generated 1408 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:01:09.027408 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-97acdb90-375d-4f43-88f6-e22809dcc6ab tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:09.027408 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-97acdb90-375d-4f43-88f6-e22809dcc6ab tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:09.039642 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-97acdb90-375d-4f43-88f6-e22809dcc6ab tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:09.039992 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-97acdb90-375d-4f43-88f6-e22809dcc6ab tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:09.040884 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-97acdb90-375d-4f43-88f6-e22809dcc6ab tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:09.041345 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-97acdb90-375d-4f43-88f6-e22809dcc6ab tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:09.092143 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-31b5bcb3-afbd-496e-b621-a8db68d225b7 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:09.093243 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-31b5bcb3-afbd-496e-b621-a8db68d225b7 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:09.103727 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-31b5bcb3-afbd-496e-b621-a8db68d225b7 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:09.104178 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-31b5bcb3-afbd-496e-b621-a8db68d225b7 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:09.105025 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-31b5bcb3-afbd-496e-b621-a8db68d225b7 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:09.113383 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-31b5bcb3-afbd-496e-b621-a8db68d225b7 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:09.183740 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-31b5bcb3-afbd-496e-b621-a8db68d225b7 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 14 microversion: 2.32 time: 0.095578 Jan 15 21:01:09.186827 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1919/3832] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:09 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 14 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:01:09.190827 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b673779b-14cf-492b-9f55-4997fbacdeab tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:09.191668 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b673779b-14cf-492b-9f55-4997fbacdeab tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: 4d836f07-866f-4e13-94ff-c4fe850e58d3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:09.201336 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b673779b-14cf-492b-9f55-4997fbacdeab tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:09.202012 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b673779b-14cf-492b-9f55-4997fbacdeab tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:09.203137 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b673779b-14cf-492b-9f55-4997fbacdeab tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:09.203713 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b673779b-14cf-492b-9f55-4997fbacdeab tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:09.272245 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-97acdb90-375d-4f43-88f6-e22809dcc6ab tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6097506a2d4e36818310d9d70bf01b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4dad65fccfe481a973f5fcbb9287dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:09.287467 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-97acdb90-375d-4f43-88f6-e22809dcc6ab tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "GET /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a" status: 200 len: 1361 microversion: 2.1 time: 0.266535 Jan 15 21:01:09.299027 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1914/3833] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:09 2022] GET /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a => generated 1361 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:09.375751 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-b673779b-14cf-492b-9f55-4997fbacdeab tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8f9c6ea7f6496792258d683640c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a75218d537c4d63874297261bec70ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:09.385123 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b673779b-14cf-492b-9f55-4997fbacdeab tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] 10.222.0.46 "GET /compute/v2.1/servers/4d836f07-866f-4e13-94ff-c4fe850e58d3" status: 200 len: 1516 microversion: 2.1 time: 0.199152 Jan 15 21:01:09.385838 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1920/3834] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:09 2022] GET /compute/v2.1/servers/4d836f07-866f-4e13-94ff-c4fe850e58d3 => generated 1516 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:09.524253 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-6f771f97-3534-448e-bc6e-884fab6c40de tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:09.525214 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-6f771f97-3534-448e-bc6e-884fab6c40de tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:09.534081 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6f771f97-3534-448e-bc6e-884fab6c40de tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:09.535265 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6f771f97-3534-448e-bc6e-884fab6c40de tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:09.536122 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6f771f97-3534-448e-bc6e-884fab6c40de tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:09.536559 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6f771f97-3534-448e-bc6e-884fab6c40de tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:09.560444 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d451e828-ab59-47a3-b026-128b09e34815 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:09.561100 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d451e828-ab59-47a3-b026-128b09e34815 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] [instance: 5e93486c-7c77-4855-85f4-2bc8bcf4832f] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:09.570970 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d451e828-ab59-47a3-b026-128b09e34815 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:09.571426 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d451e828-ab59-47a3-b026-128b09e34815 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:09.572249 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d451e828-ab59-47a3-b026-128b09e34815 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:09.572691 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d451e828-ab59-47a3-b026-128b09e34815 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:09.726805 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-6f771f97-3534-448e-bc6e-884fab6c40de tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:09.737023 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-6f771f97-3534-448e-bc6e-884fab6c40de tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9" status: 200 len: 1683 microversion: 2.1 time: 0.217525 Jan 15 21:01:09.748916 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1915/3835] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:09 2022] GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9 => generated 1683 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:09.753846 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-b2198cf2-bbc0-4adb-8b64-0d7a23a6de83 req-7db99131-1cb4-401b-bc8a-dc4317a055a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4504a13b-d10e-436a-a5ef-991829938dd9", "name": "network-vif-plugged", "status": "completed", "tag": "f7503e3b-a43e-4550-8109-a1fb1aa2d5f1"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:09.755560 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:01:09.755560 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:01:09.765581 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-b2198cf2-bbc0-4adb-8b64-0d7a23a6de83 req-7db99131-1cb4-401b-bc8a-dc4317a055a8 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:09.765581 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-b2198cf2-bbc0-4adb-8b64-0d7a23a6de83 req-7db99131-1cb4-401b-bc8a-dc4317a055a8 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:09.776945 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-b2198cf2-bbc0-4adb-8b64-0d7a23a6de83 req-7db99131-1cb4-401b-bc8a-dc4317a055a8 service nova] Creating event network-vif-plugged:f7503e3b-a43e-4550-8109-a1fb1aa2d5f1 for instance 4504a13b-d10e-436a-a5ef-991829938dd9 on nch1-master-1 Jan 15 21:01:09.784099 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-b2198cf2-bbc0-4adb-8b64-0d7a23a6de83 req-7db99131-1cb4-401b-bc8a-dc4317a055a8 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033808 Jan 15 21:01:09.789008 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1916/3836] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:01:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:01:09.794856 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-84302b58-d2cc-4632-9a91-5f8f65095672 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:09.795862 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-84302b58-d2cc-4632-9a91-5f8f65095672 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:09.804004 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-84302b58-d2cc-4632-9a91-5f8f65095672 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:09.804467 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-84302b58-d2cc-4632-9a91-5f8f65095672 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:09.805388 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-84302b58-d2cc-4632-9a91-5f8f65095672 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:09.805830 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-84302b58-d2cc-4632-9a91-5f8f65095672 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:09.820496 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-d451e828-ab59-47a3-b026-128b09e34815 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f38865f66e433090132a8a09d44774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16b035e629e4eb89850c2871a128781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:09.832101 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d451e828-ab59-47a3-b026-128b09e34815 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] 10.222.0.46 "GET /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f" status: 200 len: 1703 microversion: 2.1 time: 0.274374 Jan 15 21:01:09.836005 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1921/3837] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:09 2022] GET /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f => generated 1703 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:09.841213 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d5b2c1da-a279-4a2e-898a-fb9cb01fbd0f tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:09.842527 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d5b2c1da-a279-4a2e-898a-fb9cb01fbd0f tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:09.849477 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d5b2c1da-a279-4a2e-898a-fb9cb01fbd0f tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:09.850149 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d5b2c1da-a279-4a2e-898a-fb9cb01fbd0f tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:09.851161 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d5b2c1da-a279-4a2e-898a-fb9cb01fbd0f tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:09.851856 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d5b2c1da-a279-4a2e-898a-fb9cb01fbd0f tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:09.873571 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-84302b58-d2cc-4632-9a91-5f8f65095672 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.081583 Jan 15 21:01:09.873571 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1917/3838] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:09 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:01:09.892963 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8adc1307-a3fd-4e92-973e-f9fb3b986cde tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:09.894185 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-8adc1307-a3fd-4e92-973e-f9fb3b986cde tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] [instance: fe691c6c-ffa5-464a-803d-75eb61fd8268] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:09.901290 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8adc1307-a3fd-4e92-973e-f9fb3b986cde tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:09.901702 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8adc1307-a3fd-4e92-973e-f9fb3b986cde tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:09.902760 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8adc1307-a3fd-4e92-973e-f9fb3b986cde tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:09.903038 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8adc1307-a3fd-4e92-973e-f9fb3b986cde tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:09.905513 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d5b2c1da-a279-4a2e-898a-fb9cb01fbd0f tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action" status: 200 len: 32628 microversion: 2.20 time: 0.067836 Jan 15 21:01:09.907147 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1922/3839] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:09 2022] POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action => generated 32628 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:01:09.992057 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-8adc1307-a3fd-4e92-973e-f9fb3b986cde tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea59ebcaec344a22a53807319a88af69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdff116c9f44e98b33c9f9346be1af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:10.006539 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-8adc1307-a3fd-4e92-973e-f9fb3b986cde tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea59ebcaec344a22a53807319a88af69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdff116c9f44e98b33c9f9346be1af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:10.008369 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-8adc1307-a3fd-4e92-973e-f9fb3b986cde tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea59ebcaec344a22a53807319a88af69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdff116c9f44e98b33c9f9346be1af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:10.009628 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-8adc1307-a3fd-4e92-973e-f9fb3b986cde tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] 10.222.0.46 "GET /compute/v2.1/servers/fe691c6c-ffa5-464a-803d-75eb61fd8268" status: 200 len: 1408 microversion: 2.54 time: 0.120800 Jan 15 21:01:10.011596 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1918/3840] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:01:09 2022] GET /compute/v2.1/servers/fe691c6c-ffa5-464a-803d-75eb61fd8268 => generated 1408 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:01:10.195882 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-7b6719e4-452c-46db-9ef9-3f9d4174768b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:10.225538 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-7b6719e4-452c-46db-9ef9-3f9d4174768b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:10.225538 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7b6719e4-452c-46db-9ef9-3f9d4174768b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:10.225538 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7b6719e4-452c-46db-9ef9-3f9d4174768b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:10.225538 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7b6719e4-452c-46db-9ef9-3f9d4174768b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:10.225538 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7b6719e4-452c-46db-9ef9-3f9d4174768b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:10.261657 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-7b6719e4-452c-46db-9ef9-3f9d4174768b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 14 microversion: 2.32 time: 0.070513 Jan 15 21:01:10.265218 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1923/3841] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:10 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 14 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:10.306876 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-09324f57-6cb9-4a84-893a-c46e8b1e113d tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:10.307478 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-09324f57-6cb9-4a84-893a-c46e8b1e113d tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:10.317949 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-09324f57-6cb9-4a84-893a-c46e8b1e113d tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:10.318164 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-09324f57-6cb9-4a84-893a-c46e8b1e113d tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:10.319025 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-09324f57-6cb9-4a84-893a-c46e8b1e113d tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:10.320070 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-09324f57-6cb9-4a84-893a-c46e8b1e113d tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:10.403458 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c6657993-f175-4cc7-a408-d8f31afeb892 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:10.404195 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c6657993-f175-4cc7-a408-d8f31afeb892 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: 4d836f07-866f-4e13-94ff-c4fe850e58d3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:10.426597 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c6657993-f175-4cc7-a408-d8f31afeb892 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:10.426847 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c6657993-f175-4cc7-a408-d8f31afeb892 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:10.428350 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c6657993-f175-4cc7-a408-d8f31afeb892 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:10.428749 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c6657993-f175-4cc7-a408-d8f31afeb892 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:10.600591 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-09324f57-6cb9-4a84-893a-c46e8b1e113d tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6097506a2d4e36818310d9d70bf01b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4dad65fccfe481a973f5fcbb9287dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:10.610749 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-09324f57-6cb9-4a84-893a-c46e8b1e113d tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "GET /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a" status: 200 len: 1548 microversion: 2.1 time: 0.308555 Jan 15 21:01:10.622002 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1919/3842] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:10 2022] GET /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a => generated 1548 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:10.626787 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c741acd8-20e5-4ddd-92e4-39567482113c tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:10.627283 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c741acd8-20e5-4ddd-92e4-39567482113c tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:10.639920 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c741acd8-20e5-4ddd-92e4-39567482113c tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:10.640522 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c741acd8-20e5-4ddd-92e4-39567482113c tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:10.641770 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c741acd8-20e5-4ddd-92e4-39567482113c tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:10.644351 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c741acd8-20e5-4ddd-92e4-39567482113c tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:10.719791 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-c6657993-f175-4cc7-a408-d8f31afeb892 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8f9c6ea7f6496792258d683640c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a75218d537c4d63874297261bec70ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:10.731955 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c6657993-f175-4cc7-a408-d8f31afeb892 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] 10.222.0.46 "GET /compute/v2.1/servers/4d836f07-866f-4e13-94ff-c4fe850e58d3" status: 200 len: 1516 microversion: 2.1 time: 0.332789 Jan 15 21:01:10.742003 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1924/3843] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:10 2022] GET /compute/v2.1/servers/4d836f07-866f-4e13-94ff-c4fe850e58d3 => generated 1516 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:01:10.756285 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-20092085-d15f-42c8-8b23-8d326825bdce tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:10.757435 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-20092085-d15f-42c8-8b23-8d326825bdce tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:10.767749 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-20092085-d15f-42c8-8b23-8d326825bdce tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:10.769718 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-20092085-d15f-42c8-8b23-8d326825bdce tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:10.771118 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-20092085-d15f-42c8-8b23-8d326825bdce tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:10.771760 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-20092085-d15f-42c8-8b23-8d326825bdce tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:10.772833 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c741acd8-20e5-4ddd-92e4-39567482113c tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "GET /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.149626 Jan 15 21:01:10.778754 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1920/3844] 10.222.0.46 () {58 vars in 1274 bytes} [Sat Jan 15 21:01:10 2022] GET /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/os-interface => generated 285 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:01:10.852484 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-dd6cfe2a-70ae-4add-b039-7e56b463409e tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:10.858618 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-dd6cfe2a-70ae-4add-b039-7e56b463409e tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] [instance: 5e93486c-7c77-4855-85f4-2bc8bcf4832f] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:10.871758 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dd6cfe2a-70ae-4add-b039-7e56b463409e tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:10.872391 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dd6cfe2a-70ae-4add-b039-7e56b463409e tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:10.896289 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dd6cfe2a-70ae-4add-b039-7e56b463409e tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:10.896926 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dd6cfe2a-70ae-4add-b039-7e56b463409e tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:11.204134 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-dd6cfe2a-70ae-4add-b039-7e56b463409e tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f38865f66e433090132a8a09d44774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16b035e629e4eb89850c2871a128781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:11.213304 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-dd6cfe2a-70ae-4add-b039-7e56b463409e tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] 10.222.0.46 "GET /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f" status: 200 len: 1355 microversion: 2.1 time: 0.366872 Jan 15 21:01:11.214209 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1921/3845] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:10 2022] GET /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f => generated 1355 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:11.218951 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-2a18d4d0-8150-409a-8012-dad6a34464ba req-40a521bb-f7a9-4770-b65f-b80803b48cc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e93486c-7c77-4855-85f4-2bc8bcf4832f", "name": "network-vif-deleted", "tag": "93c9ee82-e08e-44b9-a8c0-f6e275b08b7b"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:11.220451 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:01:11.220451 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:01:11.233015 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-2a18d4d0-8150-409a-8012-dad6a34464ba req-40a521bb-f7a9-4770-b65f-b80803b48cc3 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:11.233536 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-2a18d4d0-8150-409a-8012-dad6a34464ba req-40a521bb-f7a9-4770-b65f-b80803b48cc3 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:11.253808 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-2a18d4d0-8150-409a-8012-dad6a34464ba req-40a521bb-f7a9-4770-b65f-b80803b48cc3 service nova] Creating event network-vif-deleted:93c9ee82-e08e-44b9-a8c0-f6e275b08b7b for instance 5e93486c-7c77-4855-85f4-2bc8bcf4832f on nch2-master-1 Jan 15 21:01:11.262285 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-2a18d4d0-8150-409a-8012-dad6a34464ba req-40a521bb-f7a9-4770-b65f-b80803b48cc3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045375 Jan 15 21:01:11.263824 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1922/3846] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:01:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:01:11.271543 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-6fed8117-7f51-4710-919a-ee6e8b7508af tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:11.272468 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-6fed8117-7f51-4710-919a-ee6e8b7508af tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:11.282155 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6fed8117-7f51-4710-919a-ee6e8b7508af tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:11.282664 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6fed8117-7f51-4710-919a-ee6e8b7508af tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:11.283510 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6fed8117-7f51-4710-919a-ee6e8b7508af tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:11.284010 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6fed8117-7f51-4710-919a-ee6e8b7508af tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:11.285344 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-20092085-d15f-42c8-8b23-8d326825bdce tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:11.297049 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-20092085-d15f-42c8-8b23-8d326825bdce tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9" status: 200 len: 1683 microversion: 2.1 time: 0.545320 Jan 15 21:01:11.297651 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1925/3847] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:10 2022] GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9 => generated 1683 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:01:11.310211 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b055a41c-4c1d-4310-b229-40824a76c2f9 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:11.321034 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b055a41c-4c1d-4310-b229-40824a76c2f9 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:11.339718 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b055a41c-4c1d-4310-b229-40824a76c2f9 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:11.340390 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b055a41c-4c1d-4310-b229-40824a76c2f9 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:11.341443 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b055a41c-4c1d-4310-b229-40824a76c2f9 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:11.342077 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b055a41c-4c1d-4310-b229-40824a76c2f9 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:11.343801 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-6fed8117-7f51-4710-919a-ee6e8b7508af tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.078558 Jan 15 21:01:11.348967 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1923/3848] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:11 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:01:11.352759 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-3f4b9090-99e3-4914-98a8-d7767fe655d8 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:11.353732 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-3f4b9090-99e3-4914-98a8-d7767fe655d8 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] [instance: fe691c6c-ffa5-464a-803d-75eb61fd8268] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:11.361846 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3f4b9090-99e3-4914-98a8-d7767fe655d8 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:11.362419 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3f4b9090-99e3-4914-98a8-d7767fe655d8 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:11.363466 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3f4b9090-99e3-4914-98a8-d7767fe655d8 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:11.363971 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3f4b9090-99e3-4914-98a8-d7767fe655d8 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:11.465695 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b055a41c-4c1d-4310-b229-40824a76c2f9 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action" status: 200 len: 32628 microversion: 2.20 time: 0.164164 Jan 15 21:01:11.473537 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1926/3849] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:11 2022] POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action => generated 32628 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:01:11.481403 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c204b78e-f02f-4fa5-b220-727e18a9d9a4 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:11.483195 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c204b78e-f02f-4fa5-b220-727e18a9d9a4 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:11.494464 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c204b78e-f02f-4fa5-b220-727e18a9d9a4 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:11.495530 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c204b78e-f02f-4fa5-b220-727e18a9d9a4 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:11.496902 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c204b78e-f02f-4fa5-b220-727e18a9d9a4 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:11.497583 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c204b78e-f02f-4fa5-b220-727e18a9d9a4 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:11.526773 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-3f4b9090-99e3-4914-98a8-d7767fe655d8 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea59ebcaec344a22a53807319a88af69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdff116c9f44e98b33c9f9346be1af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:11.545206 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-3f4b9090-99e3-4914-98a8-d7767fe655d8 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea59ebcaec344a22a53807319a88af69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdff116c9f44e98b33c9f9346be1af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:11.550614 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-3f4b9090-99e3-4914-98a8-d7767fe655d8 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea59ebcaec344a22a53807319a88af69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdff116c9f44e98b33c9f9346be1af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:11.556679 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-3f4b9090-99e3-4914-98a8-d7767fe655d8 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] 10.222.0.46 "GET /compute/v2.1/servers/fe691c6c-ffa5-464a-803d-75eb61fd8268" status: 200 len: 1408 microversion: 2.54 time: 0.207791 Jan 15 21:01:11.572536 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1924/3850] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:01:11 2022] GET /compute/v2.1/servers/fe691c6c-ffa5-464a-803d-75eb61fd8268 => generated 1408 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:01:11.583447 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c204b78e-f02f-4fa5-b220-727e18a9d9a4 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 14 microversion: 2.32 time: 0.106581 Jan 15 21:01:11.586766 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1927/3851] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:11 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 14 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:11.752116 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e599e81a-f343-4c8b-8547-795e8f532903 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:11.753699 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e599e81a-f343-4c8b-8547-795e8f532903 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: 4d836f07-866f-4e13-94ff-c4fe850e58d3] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:11.762274 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e599e81a-f343-4c8b-8547-795e8f532903 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:11.763060 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e599e81a-f343-4c8b-8547-795e8f532903 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:11.764340 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e599e81a-f343-4c8b-8547-795e8f532903 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:11.765262 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e599e81a-f343-4c8b-8547-795e8f532903 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:12.078867 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-e599e81a-f343-4c8b-8547-795e8f532903 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8f9c6ea7f6496792258d683640c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a75218d537c4d63874297261bec70ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:12.089293 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e599e81a-f343-4c8b-8547-795e8f532903 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] 10.222.0.46 "GET /compute/v2.1/servers/4d836f07-866f-4e13-94ff-c4fe850e58d3" status: 200 len: 1516 microversion: 2.1 time: 0.343351 Jan 15 21:01:12.099299 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1925/3852] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:11 2022] GET /compute/v2.1/servers/4d836f07-866f-4e13-94ff-c4fe850e58d3 => generated 1516 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:12.231200 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b881d7c8-7a2b-4f8b-af4f-22dbab889eca tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:12.231903 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b881d7c8-7a2b-4f8b-af4f-22dbab889eca tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] [instance: 5e93486c-7c77-4855-85f4-2bc8bcf4832f] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:12.240088 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b881d7c8-7a2b-4f8b-af4f-22dbab889eca tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:12.240541 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b881d7c8-7a2b-4f8b-af4f-22dbab889eca tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:12.241386 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b881d7c8-7a2b-4f8b-af4f-22dbab889eca tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:12.241824 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b881d7c8-7a2b-4f8b-af4f-22dbab889eca tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:12.258287 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-b881d7c8-7a2b-4f8b-af4f-22dbab889eca tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] HTTP exception thrown: Instance 5e93486c-7c77-4855-85f4-2bc8bcf4832f could not be found. Jan 15 21:01:12.258971 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b881d7c8-7a2b-4f8b-af4f-22dbab889eca tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Returning 404 to user: Instance 5e93486c-7c77-4855-85f4-2bc8bcf4832f could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:01:12.259783 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b881d7c8-7a2b-4f8b-af4f-22dbab889eca tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] 10.222.0.46 "GET /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f" status: 404 len: 111 microversion: 2.1 time: 0.032881 Jan 15 21:01:12.263464 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1928/3853] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:12 2022] GET /compute/v2.1/servers/5e93486c-7c77-4855-85f4-2bc8bcf4832f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:01:12.269126 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a52e70ce-b36d-4d28-81ff-cf4d820e4e75 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] Calling method '.version_select at 0x7f30c8f139d0>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:12.313312 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a52e70ce-b36d-4d28-81ff-cf4d820e4e75 tempest-ServersTestJSON-834903186 tempest-ServersTestJSON-834903186-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1374284916" status: 202 len: 0 microversion: 2.1 time: 0.048139 Jan 15 21:01:12.313961 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1926/3854] 10.222.0.46 () {58 vars in 1220 bytes} [Sat Jan 15 21:01:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1374284916 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:01:12.315458 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b0800873-b16d-46f4-8723-c74007fa35fa tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:12.317593 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b0800873-b16d-46f4-8723-c74007fa35fa tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:12.335654 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b0800873-b16d-46f4-8723-c74007fa35fa tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:12.336355 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b0800873-b16d-46f4-8723-c74007fa35fa tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:12.337366 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b0800873-b16d-46f4-8723-c74007fa35fa tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:12.341154 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b0800873-b16d-46f4-8723-c74007fa35fa tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:12.356200 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e5eb1a0c-4b95-4e31-975b-9eaf1771b4cc tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:12.357153 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e5eb1a0c-4b95-4e31-975b-9eaf1771b4cc tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:12.369671 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e5eb1a0c-4b95-4e31-975b-9eaf1771b4cc tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:12.370140 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e5eb1a0c-4b95-4e31-975b-9eaf1771b4cc tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:12.371403 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e5eb1a0c-4b95-4e31-975b-9eaf1771b4cc tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:12.371403 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e5eb1a0c-4b95-4e31-975b-9eaf1771b4cc tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:12.466411 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e5eb1a0c-4b95-4e31-975b-9eaf1771b4cc tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.113426 Jan 15 21:01:12.467511 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1927/3855] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:12 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:01:12.482745 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-adcba1c0-4dcf-4d1e-a1ca-7b8238bb8e18 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:12.484437 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-adcba1c0-4dcf-4d1e-a1ca-7b8238bb8e18 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:12.498046 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-adcba1c0-4dcf-4d1e-a1ca-7b8238bb8e18 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:12.498046 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-adcba1c0-4dcf-4d1e-a1ca-7b8238bb8e18 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:12.498859 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-adcba1c0-4dcf-4d1e-a1ca-7b8238bb8e18 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:12.499418 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-adcba1c0-4dcf-4d1e-a1ca-7b8238bb8e18 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:12.561627 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-adcba1c0-4dcf-4d1e-a1ca-7b8238bb8e18 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action" status: 200 len: 32628 microversion: 2.20 time: 0.085820 Jan 15 21:01:12.564040 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1928/3856] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:12 2022] POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action => generated 32628 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:01:12.595304 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e3d55fd0-5946-404a-bfe7-683188a65491 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:12.596396 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e3d55fd0-5946-404a-bfe7-683188a65491 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] [instance: fe691c6c-ffa5-464a-803d-75eb61fd8268] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:12.610475 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e3d55fd0-5946-404a-bfe7-683188a65491 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:12.614830 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e3d55fd0-5946-404a-bfe7-683188a65491 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:12.616034 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e3d55fd0-5946-404a-bfe7-683188a65491 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:12.616693 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e3d55fd0-5946-404a-bfe7-683188a65491 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:12.810329 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-e3d55fd0-5946-404a-bfe7-683188a65491 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea59ebcaec344a22a53807319a88af69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdff116c9f44e98b33c9f9346be1af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:12.819758 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-e3d55fd0-5946-404a-bfe7-683188a65491 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea59ebcaec344a22a53807319a88af69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdff116c9f44e98b33c9f9346be1af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:12.822664 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-e3d55fd0-5946-404a-bfe7-683188a65491 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea59ebcaec344a22a53807319a88af69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdff116c9f44e98b33c9f9346be1af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:12.837096 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e3d55fd0-5946-404a-bfe7-683188a65491 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] 10.222.0.46 "GET /compute/v2.1/servers/fe691c6c-ffa5-464a-803d-75eb61fd8268" status: 200 len: 1408 microversion: 2.54 time: 0.234048 Jan 15 21:01:12.838115 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1929/3857] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:01:12 2022] GET /compute/v2.1/servers/fe691c6c-ffa5-464a-803d-75eb61fd8268 => generated 1408 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 15 21:01:12.842788 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-881d1223-9034-4f27-8cd2-f26267d0e1b0 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:12.843726 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-881d1223-9034-4f27-8cd2-f26267d0e1b0 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:12.872476 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-881d1223-9034-4f27-8cd2-f26267d0e1b0 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:12.872954 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-881d1223-9034-4f27-8cd2-f26267d0e1b0 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:12.876037 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-881d1223-9034-4f27-8cd2-f26267d0e1b0 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:12.876037 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-881d1223-9034-4f27-8cd2-f26267d0e1b0 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:12.939047 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-881d1223-9034-4f27-8cd2-f26267d0e1b0 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 14 microversion: 2.32 time: 0.099264 Jan 15 21:01:12.940026 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1930/3858] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:12 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 14 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:12.994579 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-b0800873-b16d-46f4-8723-c74007fa35fa tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:13.009033 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b0800873-b16d-46f4-8723-c74007fa35fa tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9" status: 200 len: 1683 microversion: 2.1 time: 0.693847 Jan 15 21:01:13.012939 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1929/3859] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:12 2022] GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9 => generated 1683 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:13.106661 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4c4b9470-aff9-46a3-919b-b0808e0daa17 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:13.109787 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-4c4b9470-aff9-46a3-919b-b0808e0daa17 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: 4d836f07-866f-4e13-94ff-c4fe850e58d3] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:13.123312 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4c4b9470-aff9-46a3-919b-b0808e0daa17 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:13.123770 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4c4b9470-aff9-46a3-919b-b0808e0daa17 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:13.124586 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4c4b9470-aff9-46a3-919b-b0808e0daa17 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:13.125059 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4c4b9470-aff9-46a3-919b-b0808e0daa17 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:13.409878 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a324d4da-1704-481b-abec-33b0b25dd657 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:13.411157 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a324d4da-1704-481b-abec-33b0b25dd657 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:13.416583 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-4c4b9470-aff9-46a3-919b-b0808e0daa17 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8f9c6ea7f6496792258d683640c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a75218d537c4d63874297261bec70ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:13.423390 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a324d4da-1704-481b-abec-33b0b25dd657 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:13.423848 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a324d4da-1704-481b-abec-33b0b25dd657 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:13.426839 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-4c4b9470-aff9-46a3-919b-b0808e0daa17 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] 10.222.0.46 "GET /compute/v2.1/servers/4d836f07-866f-4e13-94ff-c4fe850e58d3" status: 200 len: 1522 microversion: 2.1 time: 0.324124 Jan 15 21:01:13.431813 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a324d4da-1704-481b-abec-33b0b25dd657 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:13.432384 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a324d4da-1704-481b-abec-33b0b25dd657 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:13.447653 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1931/3860] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:13 2022] GET /compute/v2.1/servers/4d836f07-866f-4e13-94ff-c4fe850e58d3 => generated 1522 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:13.452753 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-28965778-7ea0-4d1e-90c3-8f47ce4ff111 req-205b480c-53ff-4470-937f-4b34c178a2e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac78554d-ca29-4e31-a410-00dc4df5c77a", "tag": "97667f1d-b2d5-4c9c-b247-ad291c112fa3"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:13.454464 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:01:13.454464 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:01:13.469649 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-28965778-7ea0-4d1e-90c3-8f47ce4ff111 req-205b480c-53ff-4470-937f-4b34c178a2e2 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:13.474932 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-28965778-7ea0-4d1e-90c3-8f47ce4ff111 req-205b480c-53ff-4470-937f-4b34c178a2e2 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:13.476363 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a324d4da-1704-481b-abec-33b0b25dd657 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action" status: 200 len: 14 microversion: 2.1 time: 0.071434 Jan 15 21:01:13.480061 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1930/3861] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:01:13 2022] POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action => generated 14 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 21:01:13.485748 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ba438650-dd5a-49ec-a517-0c335a4dc785 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:13.487176 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ba438650-dd5a-49ec-a517-0c335a4dc785 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:13.494192 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ba438650-dd5a-49ec-a517-0c335a4dc785 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:13.494864 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ba438650-dd5a-49ec-a517-0c335a4dc785 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:13.495918 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ba438650-dd5a-49ec-a517-0c335a4dc785 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:13.496603 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ba438650-dd5a-49ec-a517-0c335a4dc785 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:13.499783 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-28965778-7ea0-4d1e-90c3-8f47ce4ff111 req-205b480c-53ff-4470-937f-4b34c178a2e2 service nova] Creating event network-changed:97667f1d-b2d5-4c9c-b247-ad291c112fa3 for instance ac78554d-ca29-4e31-a410-00dc4df5c77a on nch2-master-1 Jan 15 21:01:13.507390 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-28965778-7ea0-4d1e-90c3-8f47ce4ff111 req-205b480c-53ff-4470-937f-4b34c178a2e2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058168 Jan 15 21:01:13.509364 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1932/3862] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:01:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:01:13.566403 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ba438650-dd5a-49ec-a517-0c335a4dc785 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.084331 Jan 15 21:01:13.567393 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1931/3863] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:13 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:01:13.578348 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-af907849-df99-41d8-adb6-368c861662ac tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:13.579492 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-af907849-df99-41d8-adb6-368c861662ac tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:13.592773 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-af907849-df99-41d8-adb6-368c861662ac tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:13.593357 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-af907849-df99-41d8-adb6-368c861662ac tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:13.594279 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-af907849-df99-41d8-adb6-368c861662ac tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:13.596249 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-af907849-df99-41d8-adb6-368c861662ac tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:13.669929 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-af907849-df99-41d8-adb6-368c861662ac tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action" status: 200 len: 32628 microversion: 2.20 time: 0.095108 Jan 15 21:01:13.674253 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1933/3864] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:13 2022] POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action => generated 32628 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:01:13.856326 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-4a39297e-2d98-4a1e-aca2-d0ebfd54ac67 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:13.857131 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-4a39297e-2d98-4a1e-aca2-d0ebfd54ac67 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] [instance: fe691c6c-ffa5-464a-803d-75eb61fd8268] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:13.867833 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4a39297e-2d98-4a1e-aca2-d0ebfd54ac67 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:13.868288 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4a39297e-2d98-4a1e-aca2-d0ebfd54ac67 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:13.869126 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4a39297e-2d98-4a1e-aca2-d0ebfd54ac67 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:13.869568 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4a39297e-2d98-4a1e-aca2-d0ebfd54ac67 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:13.954202 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-66190ba2-e8f8-4f12-87b7-e30948f45e47 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:13.955579 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-66190ba2-e8f8-4f12-87b7-e30948f45e47 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:13.963953 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-66190ba2-e8f8-4f12-87b7-e30948f45e47 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:13.964773 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-66190ba2-e8f8-4f12-87b7-e30948f45e47 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:13.965850 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-66190ba2-e8f8-4f12-87b7-e30948f45e47 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:13.967969 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-66190ba2-e8f8-4f12-87b7-e30948f45e47 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:13.989705 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-4a39297e-2d98-4a1e-aca2-d0ebfd54ac67 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea59ebcaec344a22a53807319a88af69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdff116c9f44e98b33c9f9346be1af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:14.010051 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-4a39297e-2d98-4a1e-aca2-d0ebfd54ac67 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea59ebcaec344a22a53807319a88af69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdff116c9f44e98b33c9f9346be1af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:14.011292 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-4a39297e-2d98-4a1e-aca2-d0ebfd54ac67 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea59ebcaec344a22a53807319a88af69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdff116c9f44e98b33c9f9346be1af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:14.012541 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-4a39297e-2d98-4a1e-aca2-d0ebfd54ac67 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] 10.222.0.46 "GET /compute/v2.1/servers/fe691c6c-ffa5-464a-803d-75eb61fd8268" status: 200 len: 1408 microversion: 2.54 time: 0.160789 Jan 15 21:01:14.032184 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1932/3865] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:01:13 2022] GET /compute/v2.1/servers/fe691c6c-ffa5-464a-803d-75eb61fd8268 => generated 1408 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:01:14.038454 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b2d8c266-c1e5-4058-9e71-992d2cbf06ee tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:14.039167 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b2d8c266-c1e5-4058-9e71-992d2cbf06ee tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:14.048408 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-66190ba2-e8f8-4f12-87b7-e30948f45e47 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 14 microversion: 2.32 time: 0.098318 Jan 15 21:01:14.051817 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b2d8c266-c1e5-4058-9e71-992d2cbf06ee tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:14.052160 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b2d8c266-c1e5-4058-9e71-992d2cbf06ee tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:14.052971 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1934/3866] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:13 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 14 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:14.053364 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b2d8c266-c1e5-4058-9e71-992d2cbf06ee tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:14.053982 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b2d8c266-c1e5-4058-9e71-992d2cbf06ee tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:14.348765 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-b2d8c266-c1e5-4058-9e71-992d2cbf06ee tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:14.368077 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b2d8c266-c1e5-4058-9e71-992d2cbf06ee tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9" status: 200 len: 1683 microversion: 2.1 time: 0.334388 Jan 15 21:01:14.368572 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1933/3867] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:14 2022] GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9 => generated 1683 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:14.447592 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-5233df8a-d54e-4359-93ae-a5d20cbb4486 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:14.449074 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-5233df8a-d54e-4359-93ae-a5d20cbb4486 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: 4d836f07-866f-4e13-94ff-c4fe850e58d3] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:14.466024 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5233df8a-d54e-4359-93ae-a5d20cbb4486 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:14.466805 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5233df8a-d54e-4359-93ae-a5d20cbb4486 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:14.469702 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5233df8a-d54e-4359-93ae-a5d20cbb4486 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:14.470402 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5233df8a-d54e-4359-93ae-a5d20cbb4486 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:14.489523 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-038d67a0-17f5-4e8d-a5df-43ff1745eb0c tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:14.492057 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-038d67a0-17f5-4e8d-a5df-43ff1745eb0c tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:14.511968 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-038d67a0-17f5-4e8d-a5df-43ff1745eb0c tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:14.519359 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-038d67a0-17f5-4e8d-a5df-43ff1745eb0c tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:14.521307 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-038d67a0-17f5-4e8d-a5df-43ff1745eb0c tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:14.523009 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-038d67a0-17f5-4e8d-a5df-43ff1745eb0c tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:14.632601 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-038d67a0-17f5-4e8d-a5df-43ff1745eb0c tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action" status: 200 len: 14 microversion: 2.1 time: 0.148445 Jan 15 21:01:14.634061 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1934/3868] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:01:14 2022] POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action => generated 14 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 15 21:01:14.644922 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ff5955fd-0fe0-46b3-b422-a1a524739039 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:14.646647 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ff5955fd-0fe0-46b3-b422-a1a524739039 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:14.655010 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ff5955fd-0fe0-46b3-b422-a1a524739039 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:14.655771 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ff5955fd-0fe0-46b3-b422-a1a524739039 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:14.657043 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ff5955fd-0fe0-46b3-b422-a1a524739039 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:14.657834 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ff5955fd-0fe0-46b3-b422-a1a524739039 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:14.724217 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ff5955fd-0fe0-46b3-b422-a1a524739039 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.084737 Jan 15 21:01:14.725702 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1935/3869] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:14 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:01:14.745045 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-47edb981-7b21-49ea-82a8-917c27d3f1ec tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:14.746063 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-47edb981-7b21-49ea-82a8-917c27d3f1ec tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:14.755834 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-47edb981-7b21-49ea-82a8-917c27d3f1ec tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:14.755834 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-47edb981-7b21-49ea-82a8-917c27d3f1ec tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:14.756681 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-47edb981-7b21-49ea-82a8-917c27d3f1ec tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:14.757389 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-47edb981-7b21-49ea-82a8-917c27d3f1ec tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:14.822322 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-47edb981-7b21-49ea-82a8-917c27d3f1ec tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action" status: 200 len: 32628 microversion: 2.20 time: 0.093625 Jan 15 21:01:14.823281 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1936/3870] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:14 2022] POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action => generated 32628 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:01:14.880889 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-5233df8a-d54e-4359-93ae-a5d20cbb4486 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8f9c6ea7f6496792258d683640c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a75218d537c4d63874297261bec70ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:14.889442 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-5233df8a-d54e-4359-93ae-a5d20cbb4486 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] 10.222.0.46 "GET /compute/v2.1/servers/4d836f07-866f-4e13-94ff-c4fe850e58d3" status: 200 len: 1522 microversion: 2.1 time: 0.447194 Jan 15 21:01:14.892981 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1935/3871] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:14 2022] GET /compute/v2.1/servers/4d836f07-866f-4e13-94ff-c4fe850e58d3 => generated 1522 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:15.060374 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-06399cba-2982-490c-a0b9-f1cbfa02656b tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:15.061456 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-cc1278ab-d130-40b7-9797-1ff066675e52 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:15.062522 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-cc1278ab-d130-40b7-9797-1ff066675e52 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:15.070160 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cc1278ab-d130-40b7-9797-1ff066675e52 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:15.070596 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-06399cba-2982-490c-a0b9-f1cbfa02656b tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] [instance: fe691c6c-ffa5-464a-803d-75eb61fd8268] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:15.070722 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cc1278ab-d130-40b7-9797-1ff066675e52 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:15.071671 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cc1278ab-d130-40b7-9797-1ff066675e52 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:15.072253 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cc1278ab-d130-40b7-9797-1ff066675e52 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:15.084520 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-06399cba-2982-490c-a0b9-f1cbfa02656b tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:15.084996 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-06399cba-2982-490c-a0b9-f1cbfa02656b tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:15.085799 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-06399cba-2982-490c-a0b9-f1cbfa02656b tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:15.086233 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-06399cba-2982-490c-a0b9-f1cbfa02656b tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:15.138757 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-cc1278ab-d130-40b7-9797-1ff066675e52 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 14 microversion: 2.32 time: 0.081289 Jan 15 21:01:15.141884 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1936/3872] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:15 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 14 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:01:15.198618 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-06399cba-2982-490c-a0b9-f1cbfa02656b tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea59ebcaec344a22a53807319a88af69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdff116c9f44e98b33c9f9346be1af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:15.208860 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-06399cba-2982-490c-a0b9-f1cbfa02656b tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea59ebcaec344a22a53807319a88af69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdff116c9f44e98b33c9f9346be1af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:15.210637 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-06399cba-2982-490c-a0b9-f1cbfa02656b tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea59ebcaec344a22a53807319a88af69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdff116c9f44e98b33c9f9346be1af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:15.212127 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-06399cba-2982-490c-a0b9-f1cbfa02656b tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] 10.222.0.46 "GET /compute/v2.1/servers/fe691c6c-ffa5-464a-803d-75eb61fd8268" status: 200 len: 1414 microversion: 2.54 time: 0.183986 Jan 15 21:01:15.213098 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1937/3873] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:01:15 2022] GET /compute/v2.1/servers/fe691c6c-ffa5-464a-803d-75eb61fd8268 => generated 1414 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:01:15.387152 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f85dcf5e-2cda-4997-8dd6-222bf46b89a4 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:15.387964 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f85dcf5e-2cda-4997-8dd6-222bf46b89a4 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:15.400769 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f85dcf5e-2cda-4997-8dd6-222bf46b89a4 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:15.401228 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f85dcf5e-2cda-4997-8dd6-222bf46b89a4 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:15.402144 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f85dcf5e-2cda-4997-8dd6-222bf46b89a4 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:15.402646 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f85dcf5e-2cda-4997-8dd6-222bf46b89a4 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:15.645212 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-52ea32c0-5363-48ba-8ff3-ea9680d9115e tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:15.646767 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-52ea32c0-5363-48ba-8ff3-ea9680d9115e tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:15.666500 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-52ea32c0-5363-48ba-8ff3-ea9680d9115e tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:15.666939 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-52ea32c0-5363-48ba-8ff3-ea9680d9115e tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:15.667774 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-52ea32c0-5363-48ba-8ff3-ea9680d9115e tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:15.668323 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-52ea32c0-5363-48ba-8ff3-ea9680d9115e tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:15.700725 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-f85dcf5e-2cda-4997-8dd6-222bf46b89a4 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:15.714880 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f85dcf5e-2cda-4997-8dd6-222bf46b89a4 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9" status: 200 len: 1683 microversion: 2.1 time: 0.331825 Jan 15 21:01:15.718754 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1937/3874] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:15 2022] GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9 => generated 1683 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:15.737128 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a16c527a-bb9c-4880-a80e-219def2efc49 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:15.739641 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a16c527a-bb9c-4880-a80e-219def2efc49 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:15.742301 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-52ea32c0-5363-48ba-8ff3-ea9680d9115e tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action" status: 200 len: 14 microversion: 2.1 time: 0.102183 Jan 15 21:01:15.745775 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1938/3875] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:01:15 2022] POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action => generated 14 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 15 21:01:15.757821 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a16c527a-bb9c-4880-a80e-219def2efc49 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:15.759604 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a16c527a-bb9c-4880-a80e-219def2efc49 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:15.761299 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a16c527a-bb9c-4880-a80e-219def2efc49 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:15.762129 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a16c527a-bb9c-4880-a80e-219def2efc49 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:15.826449 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a16c527a-bb9c-4880-a80e-219def2efc49 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.092872 Jan 15 21:01:15.830672 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1938/3876] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:15 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:01:15.838792 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-bba77024-7d55-47ca-97d5-894764953791 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:15.839875 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-bba77024-7d55-47ca-97d5-894764953791 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:15.856903 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bba77024-7d55-47ca-97d5-894764953791 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:15.857545 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bba77024-7d55-47ca-97d5-894764953791 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:15.858238 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bba77024-7d55-47ca-97d5-894764953791 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:15.858739 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bba77024-7d55-47ca-97d5-894764953791 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:15.909553 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-67e76195-4fac-4a20-8a30-b0339fa90836 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:15.910742 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-67e76195-4fac-4a20-8a30-b0339fa90836 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: 4d836f07-866f-4e13-94ff-c4fe850e58d3] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:15.919727 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-bba77024-7d55-47ca-97d5-894764953791 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action" status: 200 len: 32628 microversion: 2.20 time: 0.084189 Jan 15 21:01:15.920830 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1939/3877] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:15 2022] POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action => generated 32628 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:01:15.929844 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-67e76195-4fac-4a20-8a30-b0339fa90836 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:15.930298 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-67e76195-4fac-4a20-8a30-b0339fa90836 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:15.931136 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-67e76195-4fac-4a20-8a30-b0339fa90836 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:15.931573 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-67e76195-4fac-4a20-8a30-b0339fa90836 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:16.150391 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2187b666-66f4-455d-b835-fcf6d2fb5dcb tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:16.151385 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-2187b666-66f4-455d-b835-fcf6d2fb5dcb tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:16.163583 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2187b666-66f4-455d-b835-fcf6d2fb5dcb tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:16.164031 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2187b666-66f4-455d-b835-fcf6d2fb5dcb tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:16.164823 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2187b666-66f4-455d-b835-fcf6d2fb5dcb tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:16.165291 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2187b666-66f4-455d-b835-fcf6d2fb5dcb tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:16.196759 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-67e76195-4fac-4a20-8a30-b0339fa90836 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8f9c6ea7f6496792258d683640c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a75218d537c4d63874297261bec70ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:16.204678 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-67e76195-4fac-4a20-8a30-b0339fa90836 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] 10.222.0.46 "GET /compute/v2.1/servers/4d836f07-866f-4e13-94ff-c4fe850e58d3" status: 200 len: 1522 microversion: 2.1 time: 0.300855 Jan 15 21:01:16.210063 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2187b666-66f4-455d-b835-fcf6d2fb5dcb tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 14 microversion: 2.32 time: 0.062710 Jan 15 21:01:16.210917 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1940/3878] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:16 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 14 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:16.217000 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1939/3879] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:15 2022] GET /compute/v2.1/servers/4d836f07-866f-4e13-94ff-c4fe850e58d3 => generated 1522 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:16.232541 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ab0395ff-c5af-41ab-8ddc-8e717a1ed436 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:16.233291 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ab0395ff-c5af-41ab-8ddc-8e717a1ed436 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] [instance: fe691c6c-ffa5-464a-803d-75eb61fd8268] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:16.241957 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ab0395ff-c5af-41ab-8ddc-8e717a1ed436 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:16.242409 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ab0395ff-c5af-41ab-8ddc-8e717a1ed436 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:16.243365 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ab0395ff-c5af-41ab-8ddc-8e717a1ed436 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:16.244023 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ab0395ff-c5af-41ab-8ddc-8e717a1ed436 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:16.354483 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-ab0395ff-c5af-41ab-8ddc-8e717a1ed436 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea59ebcaec344a22a53807319a88af69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdff116c9f44e98b33c9f9346be1af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:16.375168 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-ab0395ff-c5af-41ab-8ddc-8e717a1ed436 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea59ebcaec344a22a53807319a88af69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdff116c9f44e98b33c9f9346be1af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:16.376917 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-ab0395ff-c5af-41ab-8ddc-8e717a1ed436 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea59ebcaec344a22a53807319a88af69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdff116c9f44e98b33c9f9346be1af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:16.380235 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ab0395ff-c5af-41ab-8ddc-8e717a1ed436 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] 10.222.0.46 "GET /compute/v2.1/servers/fe691c6c-ffa5-464a-803d-75eb61fd8268" status: 200 len: 1414 microversion: 2.54 time: 0.151253 Jan 15 21:01:16.380429 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1941/3880] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:01:16 2022] GET /compute/v2.1/servers/fe691c6c-ffa5-464a-803d-75eb61fd8268 => generated 1414 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:01:16.740071 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-aa4410a5-bff4-4cb4-9ece-eac921af3cf2 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:16.742160 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-aa4410a5-bff4-4cb4-9ece-eac921af3cf2 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:16.755187 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-1241e78b-6833-49e5-bc4a-f03f70fcb382 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:16.758860 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-1241e78b-6833-49e5-bc4a-f03f70fcb382 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:16.792760 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-aa4410a5-bff4-4cb4-9ece-eac921af3cf2 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:16.794022 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1241e78b-6833-49e5-bc4a-f03f70fcb382 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:16.795933 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-aa4410a5-bff4-4cb4-9ece-eac921af3cf2 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:16.796464 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1241e78b-6833-49e5-bc4a-f03f70fcb382 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:16.798343 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-aa4410a5-bff4-4cb4-9ece-eac921af3cf2 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:16.799584 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1241e78b-6833-49e5-bc4a-f03f70fcb382 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:16.801614 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-aa4410a5-bff4-4cb4-9ece-eac921af3cf2 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:16.802683 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1241e78b-6833-49e5-bc4a-f03f70fcb382 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:16.884114 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-1241e78b-6833-49e5-bc4a-f03f70fcb382 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action" status: 200 len: 14 microversion: 2.1 time: 0.133619 Jan 15 21:01:16.885389 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1942/3881] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:01:16 2022] POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action => generated 14 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 21:01:16.891917 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ecfbd69e-0a97-4b38-b41f-192e599d53de tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:16.893669 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ecfbd69e-0a97-4b38-b41f-192e599d53de tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:16.902202 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ecfbd69e-0a97-4b38-b41f-192e599d53de tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:16.904211 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ecfbd69e-0a97-4b38-b41f-192e599d53de tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:16.905374 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ecfbd69e-0a97-4b38-b41f-192e599d53de tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:16.906037 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ecfbd69e-0a97-4b38-b41f-192e599d53de tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:17.044627 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ecfbd69e-0a97-4b38-b41f-192e599d53de tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.156995 Jan 15 21:01:17.058025 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1943/3882] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:16 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:01:17.086303 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d3cb2e29-5127-4f0c-9f73-160fdbe589cf tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:17.087442 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d3cb2e29-5127-4f0c-9f73-160fdbe589cf tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:17.114629 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d3cb2e29-5127-4f0c-9f73-160fdbe589cf tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:17.117501 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d3cb2e29-5127-4f0c-9f73-160fdbe589cf tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:17.118460 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d3cb2e29-5127-4f0c-9f73-160fdbe589cf tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:17.120295 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d3cb2e29-5127-4f0c-9f73-160fdbe589cf tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:17.231157 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d3cb2e29-5127-4f0c-9f73-160fdbe589cf tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action" status: 200 len: 32628 microversion: 2.20 time: 0.171525 Jan 15 21:01:17.233074 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-aa4410a5-bff4-4cb4-9ece-eac921af3cf2 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:17.246323 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1944/3883] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:17 2022] POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action => generated 32628 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:01:17.251725 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-63568ea9-546a-4a97-9e1b-75c5390bf482 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:17.253550 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-aa4410a5-bff4-4cb4-9ece-eac921af3cf2 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9" status: 200 len: 1683 microversion: 2.1 time: 0.520713 Jan 15 21:01:17.254698 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1940/3884] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:16 2022] GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9 => generated 1683 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:17.262017 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ecfee153-b4ae-4b62-bc56-c36623dba19e tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:17.263482 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ecfee153-b4ae-4b62-bc56-c36623dba19e tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: 4d836f07-866f-4e13-94ff-c4fe850e58d3] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:17.264875 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-63568ea9-546a-4a97-9e1b-75c5390bf482 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:17.275206 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ecfee153-b4ae-4b62-bc56-c36623dba19e tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:17.276012 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ecfee153-b4ae-4b62-bc56-c36623dba19e tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:17.277093 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ecfee153-b4ae-4b62-bc56-c36623dba19e tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:17.278307 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ecfee153-b4ae-4b62-bc56-c36623dba19e tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:17.292666 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-63568ea9-546a-4a97-9e1b-75c5390bf482 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:17.296481 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-63568ea9-546a-4a97-9e1b-75c5390bf482 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:17.303777 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-63568ea9-546a-4a97-9e1b-75c5390bf482 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:17.304352 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-63568ea9-546a-4a97-9e1b-75c5390bf482 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:17.406869 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-63568ea9-546a-4a97-9e1b-75c5390bf482 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 14 microversion: 2.32 time: 0.158903 Jan 15 21:01:17.407986 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1945/3885] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:17 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 14 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:17.414066 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8ba9f4f6-5242-459e-89d6-4b02ee3c1bd8 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:17.425505 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-8ba9f4f6-5242-459e-89d6-4b02ee3c1bd8 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] [instance: fe691c6c-ffa5-464a-803d-75eb61fd8268] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:17.433538 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8ba9f4f6-5242-459e-89d6-4b02ee3c1bd8 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:17.434020 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8ba9f4f6-5242-459e-89d6-4b02ee3c1bd8 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:17.434956 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8ba9f4f6-5242-459e-89d6-4b02ee3c1bd8 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:17.435396 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8ba9f4f6-5242-459e-89d6-4b02ee3c1bd8 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:17.575985 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-8ba9f4f6-5242-459e-89d6-4b02ee3c1bd8 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea59ebcaec344a22a53807319a88af69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdff116c9f44e98b33c9f9346be1af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:17.592113 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-8ba9f4f6-5242-459e-89d6-4b02ee3c1bd8 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea59ebcaec344a22a53807319a88af69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdff116c9f44e98b33c9f9346be1af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:17.593953 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-8ba9f4f6-5242-459e-89d6-4b02ee3c1bd8 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea59ebcaec344a22a53807319a88af69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdff116c9f44e98b33c9f9346be1af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:17.601545 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-8ba9f4f6-5242-459e-89d6-4b02ee3c1bd8 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] 10.222.0.46 "GET /compute/v2.1/servers/fe691c6c-ffa5-464a-803d-75eb61fd8268" status: 200 len: 1399 microversion: 2.54 time: 0.192241 Jan 15 21:01:17.602700 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1946/3886] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:01:17 2022] GET /compute/v2.1/servers/fe691c6c-ffa5-464a-803d-75eb61fd8268 => generated 1399 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:01:17.606977 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-717ee09b-607b-43ed-b127-f923d28c15e8 req-f26a31b4-1c7a-419f-9fd9-7cb4eeafd480 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d836f07-866f-4e13-94ff-c4fe850e58d3", "name": "network-vif-unplugged", "status": "completed", "tag": "4949ae19-44ff-4865-9776-96c470821b54"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:17.615979 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:01:17.615979 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:01:17.632742 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-717ee09b-607b-43ed-b127-f923d28c15e8 req-f26a31b4-1c7a-419f-9fd9-7cb4eeafd480 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:17.634942 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-717ee09b-607b-43ed-b127-f923d28c15e8 req-f26a31b4-1c7a-419f-9fd9-7cb4eeafd480 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:17.658616 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-717ee09b-607b-43ed-b127-f923d28c15e8 req-f26a31b4-1c7a-419f-9fd9-7cb4eeafd480 service nova] Creating event network-vif-unplugged:4949ae19-44ff-4865-9776-96c470821b54 for instance 4d836f07-866f-4e13-94ff-c4fe850e58d3 on nch1-master-1 Jan 15 21:01:17.675185 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-717ee09b-607b-43ed-b127-f923d28c15e8 req-f26a31b4-1c7a-419f-9fd9-7cb4eeafd480 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.071168 Jan 15 21:01:17.678219 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1947/3887] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:01:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:01:17.688780 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-88f54a38-bb06-4c68-86a8-6db40a4e266e tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Calling method '.version_select at 0x7f30ceb584c0>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:17.700303 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-ecfee153-b4ae-4b62-bc56-c36623dba19e tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8f9c6ea7f6496792258d683640c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a75218d537c4d63874297261bec70ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:17.708926 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ecfee153-b4ae-4b62-bc56-c36623dba19e tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] 10.222.0.46 "GET /compute/v2.1/servers/4d836f07-866f-4e13-94ff-c4fe850e58d3" status: 200 len: 1522 microversion: 2.1 time: 0.452913 Jan 15 21:01:17.713660 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1941/3888] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:17 2022] GET /compute/v2.1/servers/4d836f07-866f-4e13-94ff-c4fe850e58d3 => generated 1522 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:17.728866 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-88f54a38-bb06-4c68-86a8-6db40a4e266e tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1287966864" status: 204 len: 0 microversion: 2.54 time: 0.048999 Jan 15 21:01:17.729489 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1948/3889] 10.222.0.46 () {60 vars in 1318 bytes} [Sat Jan 15 21:01:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1287966864 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 15 21:01:17.741494 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-06cd1359-a75e-404f-9538-bfff3439cc7e tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:17.742198 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-06cd1359-a75e-404f-9538-bfff3439cc7e tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] [instance: fe691c6c-ffa5-464a-803d-75eb61fd8268] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:17.750722 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-06cd1359-a75e-404f-9538-bfff3439cc7e tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:17.754129 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-06cd1359-a75e-404f-9538-bfff3439cc7e tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:17.755326 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-06cd1359-a75e-404f-9538-bfff3439cc7e tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:17.755995 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-06cd1359-a75e-404f-9538-bfff3439cc7e tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:17.794599 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-06cd1359-a75e-404f-9538-bfff3439cc7e tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] [instance: fe691c6c-ffa5-464a-803d-75eb61fd8268] Going to try to terminate instance {{(pid=129366) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 21:01:17.909533 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b43f4922-46d5-47d3-bb65-5833cb8b06df tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:17.913130 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b43f4922-46d5-47d3-bb65-5833cb8b06df tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:17.946243 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b43f4922-46d5-47d3-bb65-5833cb8b06df tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:17.953748 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b43f4922-46d5-47d3-bb65-5833cb8b06df tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:17.955947 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b43f4922-46d5-47d3-bb65-5833cb8b06df tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:17.958842 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b43f4922-46d5-47d3-bb65-5833cb8b06df tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:18.018813 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-06cd1359-a75e-404f-9538-bfff3439cc7e tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] 10.222.0.46 "DELETE /compute/v2.1/servers/fe691c6c-ffa5-464a-803d-75eb61fd8268" status: 204 len: 0 microversion: 2.54 time: 0.280969 Jan 15 21:01:18.028152 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1942/3890] 10.222.0.46 () {60 vars in 1279 bytes} [Sat Jan 15 21:01:17 2022] DELETE /compute/v2.1/servers/fe691c6c-ffa5-464a-803d-75eb61fd8268 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 15 21:01:18.041111 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b43f4922-46d5-47d3-bb65-5833cb8b06df tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action" status: 200 len: 14 microversion: 2.1 time: 0.146141 Jan 15 21:01:18.042162 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1949/3891] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:01:17 2022] POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action => generated 14 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 15 21:01:18.051368 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a54e3c30-def4-4407-9b69-ce44d38f89e2 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:18.055228 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a54e3c30-def4-4407-9b69-ce44d38f89e2 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] [instance: fe691c6c-ffa5-464a-803d-75eb61fd8268] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:18.068506 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-16965c96-aa40-48bd-b267-6c572b39c115 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:18.073103 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-16965c96-aa40-48bd-b267-6c572b39c115 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:18.103608 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a54e3c30-def4-4407-9b69-ce44d38f89e2 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:18.104085 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a54e3c30-def4-4407-9b69-ce44d38f89e2 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:18.115457 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a54e3c30-def4-4407-9b69-ce44d38f89e2 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:18.116080 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a54e3c30-def4-4407-9b69-ce44d38f89e2 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:18.128878 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-16965c96-aa40-48bd-b267-6c572b39c115 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:18.128878 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-16965c96-aa40-48bd-b267-6c572b39c115 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:18.129346 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-16965c96-aa40-48bd-b267-6c572b39c115 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:18.129813 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-16965c96-aa40-48bd-b267-6c572b39c115 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:18.318238 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-16965c96-aa40-48bd-b267-6c572b39c115 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.256201 Jan 15 21:01:18.322565 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1950/3892] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:18 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:01:18.343717 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b053ca53-2969-4225-a3fc-23c24144025b tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:18.347977 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b053ca53-2969-4225-a3fc-23c24144025b tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:18.374968 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b053ca53-2969-4225-a3fc-23c24144025b tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:18.379706 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b053ca53-2969-4225-a3fc-23c24144025b tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:18.380601 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b053ca53-2969-4225-a3fc-23c24144025b tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:18.381046 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b053ca53-2969-4225-a3fc-23c24144025b tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:18.455947 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b053ca53-2969-4225-a3fc-23c24144025b tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action" status: 200 len: 32628 microversion: 2.20 time: 0.132659 Jan 15 21:01:18.458204 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1951/3893] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:18 2022] POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action => generated 32628 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:01:18.461470 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-a54e3c30-def4-4407-9b69-ce44d38f89e2 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea59ebcaec344a22a53807319a88af69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdff116c9f44e98b33c9f9346be1af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:18.463633 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e59b53a9-10ad-4714-ad36-9fa4dabe3336 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:18.464469 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e59b53a9-10ad-4714-ad36-9fa4dabe3336 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:18.473422 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e59b53a9-10ad-4714-ad36-9fa4dabe3336 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:18.474017 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e59b53a9-10ad-4714-ad36-9fa4dabe3336 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:18.475777 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e59b53a9-10ad-4714-ad36-9fa4dabe3336 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:18.475777 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e59b53a9-10ad-4714-ad36-9fa4dabe3336 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:18.480190 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-a54e3c30-def4-4407-9b69-ce44d38f89e2 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea59ebcaec344a22a53807319a88af69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdff116c9f44e98b33c9f9346be1af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:18.483325 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-a54e3c30-def4-4407-9b69-ce44d38f89e2 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea59ebcaec344a22a53807319a88af69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdff116c9f44e98b33c9f9346be1af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:18.485420 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a54e3c30-def4-4407-9b69-ce44d38f89e2 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] 10.222.0.46 "GET /compute/v2.1/servers/fe691c6c-ffa5-464a-803d-75eb61fd8268" status: 200 len: 1405 microversion: 2.54 time: 0.452244 Jan 15 21:01:18.486558 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1943/3894] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:01:18 2022] GET /compute/v2.1/servers/fe691c6c-ffa5-464a-803d-75eb61fd8268 => generated 1405 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:01:18.492741 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-28cafd30-30da-414d-99e4-d8081fdc48fe tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:18.493996 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-28cafd30-30da-414d-99e4-d8081fdc48fe tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:18.504312 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-28cafd30-30da-414d-99e4-d8081fdc48fe tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:18.504775 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-28cafd30-30da-414d-99e4-d8081fdc48fe tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:18.513655 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-28cafd30-30da-414d-99e4-d8081fdc48fe tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:18.514132 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-28cafd30-30da-414d-99e4-d8081fdc48fe tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:18.564240 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-28cafd30-30da-414d-99e4-d8081fdc48fe tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 14 microversion: 2.32 time: 0.072301 Jan 15 21:01:18.567971 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1944/3895] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:18 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 14 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:18.705128 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-e59b53a9-10ad-4714-ad36-9fa4dabe3336 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:18.725776 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e59b53a9-10ad-4714-ad36-9fa4dabe3336 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9" status: 200 len: 1683 microversion: 2.1 time: 0.266425 Jan 15 21:01:18.726738 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1952/3896] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:18 2022] GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9 => generated 1683 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:18.733461 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-edad16a6-aea4-4d89-b839-ead34149e6cd tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:18.734164 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-edad16a6-aea4-4d89-b839-ead34149e6cd tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: 4d836f07-866f-4e13-94ff-c4fe850e58d3] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:18.742493 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-edad16a6-aea4-4d89-b839-ead34149e6cd tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:18.743115 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-edad16a6-aea4-4d89-b839-ead34149e6cd tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:18.743744 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-edad16a6-aea4-4d89-b839-ead34149e6cd tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:18.744185 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-edad16a6-aea4-4d89-b839-ead34149e6cd tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:18.939170 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-edad16a6-aea4-4d89-b839-ead34149e6cd tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8f9c6ea7f6496792258d683640c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a75218d537c4d63874297261bec70ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:18.949876 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-edad16a6-aea4-4d89-b839-ead34149e6cd tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] 10.222.0.46 "GET /compute/v2.1/servers/4d836f07-866f-4e13-94ff-c4fe850e58d3" status: 200 len: 1522 microversion: 2.1 time: 0.220237 Jan 15 21:01:18.950873 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1945/3897] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:18 2022] GET /compute/v2.1/servers/4d836f07-866f-4e13-94ff-c4fe850e58d3 => generated 1522 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:19.054168 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-71a78996-2ec0-40b2-90de-b8456ad0449c tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:19.055258 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-71a78996-2ec0-40b2-90de-b8456ad0449c tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:19.070024 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-71a78996-2ec0-40b2-90de-b8456ad0449c tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:19.073476 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-71a78996-2ec0-40b2-90de-b8456ad0449c tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:19.074472 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-71a78996-2ec0-40b2-90de-b8456ad0449c tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:19.074948 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-71a78996-2ec0-40b2-90de-b8456ad0449c tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:19.175265 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-71a78996-2ec0-40b2-90de-b8456ad0449c tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action" status: 200 len: 14 microversion: 2.1 time: 0.125559 Jan 15 21:01:19.176430 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1953/3898] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:01:19 2022] POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action => generated 14 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 21:01:19.330540 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c7a6ab04-dc84-4176-9767-074c3607a380 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:19.337809 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c7a6ab04-dc84-4176-9767-074c3607a380 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:19.351692 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c7a6ab04-dc84-4176-9767-074c3607a380 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:19.352636 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c7a6ab04-dc84-4176-9767-074c3607a380 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:19.353665 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c7a6ab04-dc84-4176-9767-074c3607a380 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:19.354381 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c7a6ab04-dc84-4176-9767-074c3607a380 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:19.442603 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c7a6ab04-dc84-4176-9767-074c3607a380 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.115406 Jan 15 21:01:19.448310 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1946/3899] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:19 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:01:19.472054 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-04fbe055-d082-4b74-9b6a-90b5e3c4418c tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:19.473116 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-04fbe055-d082-4b74-9b6a-90b5e3c4418c tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:19.487930 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-04fbe055-d082-4b74-9b6a-90b5e3c4418c tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:19.488270 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-04fbe055-d082-4b74-9b6a-90b5e3c4418c tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:19.490090 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-04fbe055-d082-4b74-9b6a-90b5e3c4418c tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:19.490702 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-04fbe055-d082-4b74-9b6a-90b5e3c4418c tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:19.510907 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-11a5e927-72c2-4ed9-9f95-fca6d634697f tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:19.514383 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-11a5e927-72c2-4ed9-9f95-fca6d634697f tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] [instance: fe691c6c-ffa5-464a-803d-75eb61fd8268] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:19.533835 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-11a5e927-72c2-4ed9-9f95-fca6d634697f tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:19.543769 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-11a5e927-72c2-4ed9-9f95-fca6d634697f tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:19.546400 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-11a5e927-72c2-4ed9-9f95-fca6d634697f tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:19.549357 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-11a5e927-72c2-4ed9-9f95-fca6d634697f tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:19.562449 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-04fbe055-d082-4b74-9b6a-90b5e3c4418c tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action" status: 200 len: 32628 microversion: 2.20 time: 0.096243 Jan 15 21:01:19.569209 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1954/3900] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:19 2022] POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action => generated 32628 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:01:19.582802 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-84f9f48a-f01a-4a5a-9637-dcd7b55359bf tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:19.584314 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-84f9f48a-f01a-4a5a-9637-dcd7b55359bf tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:19.599606 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-84f9f48a-f01a-4a5a-9637-dcd7b55359bf tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:19.605664 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-84f9f48a-f01a-4a5a-9637-dcd7b55359bf tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:19.606765 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-84f9f48a-f01a-4a5a-9637-dcd7b55359bf tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:19.607636 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-84f9f48a-f01a-4a5a-9637-dcd7b55359bf tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:19.673010 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-84f9f48a-f01a-4a5a-9637-dcd7b55359bf tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 8206 microversion: 2.32 time: 0.096215 Jan 15 21:01:19.673702 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1955/3901] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:19 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 8206 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:01:19.743035 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-11a5e927-72c2-4ed9-9f95-fca6d634697f tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea59ebcaec344a22a53807319a88af69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdff116c9f44e98b33c9f9346be1af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:19.750809 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b29fbca6-c073-4a1d-a10e-99c5e6c7e16b tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:19.751556 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b29fbca6-c073-4a1d-a10e-99c5e6c7e16b tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:19.753734 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-11a5e927-72c2-4ed9-9f95-fca6d634697f tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea59ebcaec344a22a53807319a88af69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdff116c9f44e98b33c9f9346be1af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:19.759499 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-11a5e927-72c2-4ed9-9f95-fca6d634697f tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea59ebcaec344a22a53807319a88af69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdff116c9f44e98b33c9f9346be1af3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:19.762280 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-11a5e927-72c2-4ed9-9f95-fca6d634697f tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] 10.222.0.46 "GET /compute/v2.1/servers/fe691c6c-ffa5-464a-803d-75eb61fd8268" status: 200 len: 1405 microversion: 2.54 time: 0.259540 Jan 15 21:01:19.765774 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1947/3902] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:01:19 2022] GET /compute/v2.1/servers/fe691c6c-ffa5-464a-803d-75eb61fd8268 => generated 1405 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:01:19.770775 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b29fbca6-c073-4a1d-a10e-99c5e6c7e16b tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:19.773606 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b29fbca6-c073-4a1d-a10e-99c5e6c7e16b tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:19.774607 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b29fbca6-c073-4a1d-a10e-99c5e6c7e16b tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:19.775083 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b29fbca6-c073-4a1d-a10e-99c5e6c7e16b tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:19.966405 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-003641d8-9e63-4b18-94b6-939e0d2e60f6 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:19.967186 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-003641d8-9e63-4b18-94b6-939e0d2e60f6 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: 4d836f07-866f-4e13-94ff-c4fe850e58d3] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:19.984810 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-003641d8-9e63-4b18-94b6-939e0d2e60f6 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:19.986891 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-003641d8-9e63-4b18-94b6-939e0d2e60f6 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:19.989370 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-003641d8-9e63-4b18-94b6-939e0d2e60f6 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:19.991554 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-003641d8-9e63-4b18-94b6-939e0d2e60f6 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:20.187202 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-b29fbca6-c073-4a1d-a10e-99c5e6c7e16b tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:20.206502 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b29fbca6-c073-4a1d-a10e-99c5e6c7e16b tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9" status: 200 len: 1683 microversion: 2.1 time: 0.465992 Jan 15 21:01:20.211482 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1956/3903] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:19 2022] GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9 => generated 1683 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:01:20.216981 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-6dde6c64-93ea-42d6-a029-53938ddf1d8f tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:20.219754 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-6dde6c64-93ea-42d6-a029-53938ddf1d8f tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:20.242297 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6dde6c64-93ea-42d6-a029-53938ddf1d8f tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:20.242871 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6dde6c64-93ea-42d6-a029-53938ddf1d8f tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:20.244053 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6dde6c64-93ea-42d6-a029-53938ddf1d8f tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:20.244721 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6dde6c64-93ea-42d6-a029-53938ddf1d8f tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:20.289811 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-003641d8-9e63-4b18-94b6-939e0d2e60f6 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8f9c6ea7f6496792258d683640c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a75218d537c4d63874297261bec70ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:20.301620 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-003641d8-9e63-4b18-94b6-939e0d2e60f6 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] 10.222.0.46 "GET /compute/v2.1/servers/4d836f07-866f-4e13-94ff-c4fe850e58d3" status: 200 len: 1522 microversion: 2.1 time: 0.338525 Jan 15 21:01:20.303847 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1948/3904] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:19 2022] GET /compute/v2.1/servers/4d836f07-866f-4e13-94ff-c4fe850e58d3 => generated 1522 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:20.310125 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-6dde6c64-93ea-42d6-a029-53938ddf1d8f tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action" status: 200 len: 14 microversion: 2.1 time: 0.096434 Jan 15 21:01:20.311530 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1957/3905] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:01:20 2022] POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action => generated 14 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 21:01:20.455575 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-bb26561d-bc57-420f-bdae-756ae2121337 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:20.457222 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-bb26561d-bc57-420f-bdae-756ae2121337 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:20.465007 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bb26561d-bc57-420f-bdae-756ae2121337 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:20.466012 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bb26561d-bc57-420f-bdae-756ae2121337 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:20.467961 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bb26561d-bc57-420f-bdae-756ae2121337 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:20.468639 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bb26561d-bc57-420f-bdae-756ae2121337 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:20.521145 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-bb26561d-bc57-420f-bdae-756ae2121337 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.069031 Jan 15 21:01:20.522661 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1949/3906] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:20 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:01:20.576475 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3584d5ac-b67c-4d66-8364-5ec9c934dbd3 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:20.577974 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-3584d5ac-b67c-4d66-8364-5ec9c934dbd3 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:20.586793 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3584d5ac-b67c-4d66-8364-5ec9c934dbd3 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:20.587691 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3584d5ac-b67c-4d66-8364-5ec9c934dbd3 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:20.588713 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3584d5ac-b67c-4d66-8364-5ec9c934dbd3 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:20.589363 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3584d5ac-b67c-4d66-8364-5ec9c934dbd3 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:20.635100 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3584d5ac-b67c-4d66-8364-5ec9c934dbd3 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action" status: 200 len: 32628 microversion: 2.20 time: 0.062664 Jan 15 21:01:20.636068 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1958/3907] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:20 2022] POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action => generated 32628 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:01:20.686112 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d94fcd20-76d5-47e0-adee-98d8471716b6 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:20.687117 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-d94fcd20-76d5-47e0-adee-98d8471716b6 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:20.695460 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d94fcd20-76d5-47e0-adee-98d8471716b6 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:20.695916 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d94fcd20-76d5-47e0-adee-98d8471716b6 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:20.696728 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d94fcd20-76d5-47e0-adee-98d8471716b6 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:20.697199 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d94fcd20-76d5-47e0-adee-98d8471716b6 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:20.750234 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d94fcd20-76d5-47e0-adee-98d8471716b6 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 16397 microversion: 2.32 time: 0.068166 Jan 15 21:01:20.751044 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1950/3908] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:20 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 16397 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:01:20.783303 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2eed5169-507f-4b76-8677-ffaa0b1b7379 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:20.784035 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-2eed5169-507f-4b76-8677-ffaa0b1b7379 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] [instance: fe691c6c-ffa5-464a-803d-75eb61fd8268] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:20.792061 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2eed5169-507f-4b76-8677-ffaa0b1b7379 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:20.792520 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2eed5169-507f-4b76-8677-ffaa0b1b7379 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:20.793343 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2eed5169-507f-4b76-8677-ffaa0b1b7379 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:20.793784 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2eed5169-507f-4b76-8677-ffaa0b1b7379 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:20.809323 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-2eed5169-507f-4b76-8677-ffaa0b1b7379 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] HTTP exception thrown: Instance fe691c6c-ffa5-464a-803d-75eb61fd8268 could not be found. Jan 15 21:01:20.809932 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2eed5169-507f-4b76-8677-ffaa0b1b7379 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] Returning 404 to user: Instance fe691c6c-ffa5-464a-803d-75eb61fd8268 could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:01:20.810767 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2eed5169-507f-4b76-8677-ffaa0b1b7379 tempest-ServerShowV254Test-962186330 tempest-ServerShowV254Test-962186330-project] 10.222.0.46 "GET /compute/v2.1/servers/fe691c6c-ffa5-464a-803d-75eb61fd8268" status: 404 len: 111 microversion: 2.54 time: 0.031768 Jan 15 21:01:20.811350 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1959/3909] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:01:20 2022] GET /compute/v2.1/servers/fe691c6c-ffa5-464a-803d-75eb61fd8268 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 15 21:01:21.012103 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-d356934c-2848-4bb4-839c-1db9692a73e2 req-ed8115b1-f30b-4d0f-8eeb-bcc728eb2834 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d836f07-866f-4e13-94ff-c4fe850e58d3", "name": "network-vif-plugged", "status": "completed", "tag": "4949ae19-44ff-4865-9776-96c470821b54"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:21.015512 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:01:21.015512 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:01:21.051871 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-d356934c-2848-4bb4-839c-1db9692a73e2 req-ed8115b1-f30b-4d0f-8eeb-bcc728eb2834 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:21.052558 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-d356934c-2848-4bb4-839c-1db9692a73e2 req-ed8115b1-f30b-4d0f-8eeb-bcc728eb2834 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:21.072390 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-d356934c-2848-4bb4-839c-1db9692a73e2 req-ed8115b1-f30b-4d0f-8eeb-bcc728eb2834 service nova] Creating event network-vif-plugged:4949ae19-44ff-4865-9776-96c470821b54 for instance 4d836f07-866f-4e13-94ff-c4fe850e58d3 on nch1-master-1 Jan 15 21:01:21.086292 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-d356934c-2848-4bb4-839c-1db9692a73e2 req-ed8115b1-f30b-4d0f-8eeb-bcc728eb2834 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079146 Jan 15 21:01:21.087637 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1951/3910] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:01:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:01:21.228448 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-4c260593-151f-4e82-b98a-6d13e4324c92 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:21.229437 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-4c260593-151f-4e82-b98a-6d13e4324c92 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:21.244370 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4c260593-151f-4e82-b98a-6d13e4324c92 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:21.247949 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4c260593-151f-4e82-b98a-6d13e4324c92 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:21.250360 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4c260593-151f-4e82-b98a-6d13e4324c92 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:21.250812 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4c260593-151f-4e82-b98a-6d13e4324c92 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:21.321514 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-12b42d29-8de2-4890-8c79-5a0d17b2ae26 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:21.322292 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-12b42d29-8de2-4890-8c79-5a0d17b2ae26 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: 4d836f07-866f-4e13-94ff-c4fe850e58d3] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:21.334854 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-12b42d29-8de2-4890-8c79-5a0d17b2ae26 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:21.335375 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-12b42d29-8de2-4890-8c79-5a0d17b2ae26 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:21.336264 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-12b42d29-8de2-4890-8c79-5a0d17b2ae26 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:21.338186 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-12b42d29-8de2-4890-8c79-5a0d17b2ae26 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:21.581262 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-4c260593-151f-4e82-b98a-6d13e4324c92 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:21.588814 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-4c260593-151f-4e82-b98a-6d13e4324c92 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9" status: 200 len: 1670 microversion: 2.1 time: 0.365097 Jan 15 21:01:21.600792 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1960/3911] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:21 2022] GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9 => generated 1670 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:21.607674 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-0c370111-a962-44b0-90fc-752fb92e63ac tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:21.608876 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-0c370111-a962-44b0-90fc-752fb92e63ac tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:21.615829 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0c370111-a962-44b0-90fc-752fb92e63ac tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:21.616369 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0c370111-a962-44b0-90fc-752fb92e63ac tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:21.617428 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0c370111-a962-44b0-90fc-752fb92e63ac tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:21.618103 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0c370111-a962-44b0-90fc-752fb92e63ac tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:21.662683 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-0c370111-a962-44b0-90fc-752fb92e63ac tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action" status: 200 len: 14 microversion: 2.1 time: 0.060247 Jan 15 21:01:21.663334 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1961/3912] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:01:21 2022] POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action => generated 14 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 21:01:21.674222 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a4aef7b8-1364-4632-9fcd-83996c11d786 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:21.675295 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a4aef7b8-1364-4632-9fcd-83996c11d786 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:21.683910 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a4aef7b8-1364-4632-9fcd-83996c11d786 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:21.684702 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a4aef7b8-1364-4632-9fcd-83996c11d786 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:21.686021 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a4aef7b8-1364-4632-9fcd-83996c11d786 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:21.686488 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a4aef7b8-1364-4632-9fcd-83996c11d786 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:21.693877 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-12b42d29-8de2-4890-8c79-5a0d17b2ae26 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8f9c6ea7f6496792258d683640c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a75218d537c4d63874297261bec70ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:21.704633 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-12b42d29-8de2-4890-8c79-5a0d17b2ae26 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] 10.222.0.46 "GET /compute/v2.1/servers/4d836f07-866f-4e13-94ff-c4fe850e58d3" status: 200 len: 1522 microversion: 2.1 time: 0.388636 Jan 15 21:01:21.709128 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1952/3913] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:21 2022] GET /compute/v2.1/servers/4d836f07-866f-4e13-94ff-c4fe850e58d3 => generated 1522 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:01:21.714046 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4c7784ab-14cf-4870-a908-01a173ceff9f tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:21.714958 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-4c7784ab-14cf-4870-a908-01a173ceff9f tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:21.726754 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4c7784ab-14cf-4870-a908-01a173ceff9f tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:21.727216 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4c7784ab-14cf-4870-a908-01a173ceff9f tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:21.729006 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4c7784ab-14cf-4870-a908-01a173ceff9f tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:21.729454 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4c7784ab-14cf-4870-a908-01a173ceff9f tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:21.755513 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a4aef7b8-1364-4632-9fcd-83996c11d786 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.089856 Jan 15 21:01:21.762013 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1962/3914] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:21 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:01:21.764961 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-175f3ab4-7419-4114-b9a4-3f4b313a9a22 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:21.765979 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-175f3ab4-7419-4114-b9a4-3f4b313a9a22 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:21.775767 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-175f3ab4-7419-4114-b9a4-3f4b313a9a22 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:21.776868 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-175f3ab4-7419-4114-b9a4-3f4b313a9a22 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:21.778665 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-175f3ab4-7419-4114-b9a4-3f4b313a9a22 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:21.780530 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-175f3ab4-7419-4114-b9a4-3f4b313a9a22 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:21.813312 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-4c7784ab-14cf-4870-a908-01a173ceff9f tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action" status: 200 len: 32628 microversion: 2.20 time: 0.102630 Jan 15 21:01:21.816890 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1953/3915] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:21 2022] POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action => generated 32628 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:01:21.871171 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-175f3ab4-7419-4114-b9a4-3f4b313a9a22 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 16397 microversion: 2.32 time: 0.110239 Jan 15 21:01:21.872008 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1963/3916] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:21 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 16397 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:01:22.680901 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a1d941e4-1eee-4c72-bec5-a2fb743b0515 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:22.681991 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a1d941e4-1eee-4c72-bec5-a2fb743b0515 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:22.701069 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a1d941e4-1eee-4c72-bec5-a2fb743b0515 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:22.701583 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a1d941e4-1eee-4c72-bec5-a2fb743b0515 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:22.703100 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a1d941e4-1eee-4c72-bec5-a2fb743b0515 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:22.703748 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a1d941e4-1eee-4c72-bec5-a2fb743b0515 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:22.761900 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a1d941e4-1eee-4c72-bec5-a2fb743b0515 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action" status: 200 len: 8154 microversion: 2.1 time: 0.090820 Jan 15 21:01:22.763029 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1964/3917] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:01:22 2022] POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action => generated 8154 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:22.771548 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8ff8fa08-70ed-49e2-94f1-56e41fbbb656 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:22.772229 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-8ff8fa08-70ed-49e2-94f1-56e41fbbb656 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:22.780975 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8ff8fa08-70ed-49e2-94f1-56e41fbbb656 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:22.781368 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8ff8fa08-70ed-49e2-94f1-56e41fbbb656 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:22.782156 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8ff8fa08-70ed-49e2-94f1-56e41fbbb656 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:22.782587 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8ff8fa08-70ed-49e2-94f1-56e41fbbb656 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:22.817565 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-020df35b-b45b-4a8d-8ca8-06f2cb9b4700 tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-163248467", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "networks": [{"uuid": "78376d3d-5a87-4378-89ee-63df1f0dfd23"}]}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:22.881100 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.network.neutron [None req-020df35b-b45b-4a8d-8ca8-06f2cb9b4700 tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] validate_networks() for [('78376d3d-5a87-4378-89ee-63df1f0dfd23', None, None, None, None, None)] {{(pid=129366) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 21:01:23.073667 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-8ff8fa08-70ed-49e2-94f1-56e41fbbb656 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:23.082534 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-8ff8fa08-70ed-49e2-94f1-56e41fbbb656 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9" status: 200 len: 1670 microversion: 2.1 time: 0.318267 Jan 15 21:01:23.083118 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1965/3918] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:22 2022] GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9 => generated 1670 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:23.087513 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9024c0f1-5372-4265-a67a-eb29d3d67816 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:23.088114 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-9024c0f1-5372-4265-a67a-eb29d3d67816 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: 4d836f07-866f-4e13-94ff-c4fe850e58d3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:23.095402 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9024c0f1-5372-4265-a67a-eb29d3d67816 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:23.095945 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9024c0f1-5372-4265-a67a-eb29d3d67816 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:23.096974 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9024c0f1-5372-4265-a67a-eb29d3d67816 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:23.097673 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9024c0f1-5372-4265-a67a-eb29d3d67816 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:23.446491 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-9024c0f1-5372-4265-a67a-eb29d3d67816 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8f9c6ea7f6496792258d683640c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a75218d537c4d63874297261bec70ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:23.454182 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-9024c0f1-5372-4265-a67a-eb29d3d67816 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] 10.222.0.46 "GET /compute/v2.1/servers/4d836f07-866f-4e13-94ff-c4fe850e58d3" status: 200 len: 1507 microversion: 2.1 time: 0.370062 Jan 15 21:01:23.454774 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1966/3919] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:23 2022] GET /compute/v2.1/servers/4d836f07-866f-4e13-94ff-c4fe850e58d3 => generated 1507 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:23.464863 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a3406956-ab4c-42d4-b592-de22e9e51fff tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:23.465819 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a3406956-ab4c-42d4-b592-de22e9e51fff tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:23.482408 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a3406956-ab4c-42d4-b592-de22e9e51fff tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:23.484885 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a3406956-ab4c-42d4-b592-de22e9e51fff tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:23.485701 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a3406956-ab4c-42d4-b592-de22e9e51fff tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:23.486143 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a3406956-ab4c-42d4-b592-de22e9e51fff tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:23.553719 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a3406956-ab4c-42d4-b592-de22e9e51fff tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.092955 Jan 15 21:01:23.558203 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1967/3920] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:23 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:01:23.564341 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8c682a66-1bd1-492c-8ad9-dca63cd31ae6 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:23.564341 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-8c682a66-1bd1-492c-8ad9-dca63cd31ae6 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:23.571214 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8c682a66-1bd1-492c-8ad9-dca63cd31ae6 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:23.571677 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8c682a66-1bd1-492c-8ad9-dca63cd31ae6 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:23.572709 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8c682a66-1bd1-492c-8ad9-dca63cd31ae6 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:23.573591 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8c682a66-1bd1-492c-8ad9-dca63cd31ae6 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:23.621251 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-8c682a66-1bd1-492c-8ad9-dca63cd31ae6 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action" status: 200 len: 32628 microversion: 2.20 time: 0.065041 Jan 15 21:01:23.622383 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1968/3921] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:23 2022] POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action => generated 32628 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:01:23.628523 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-0ca6d5c1-ff78-4b31-8feb-e66fffdd4813 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:23.629563 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-0ca6d5c1-ff78-4b31-8feb-e66fffdd4813 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:23.633682 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-020df35b-b45b-4a8d-8ca8-06f2cb9b4700 tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] Flavor limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 21:01:23.634106 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-020df35b-b45b-4a8d-8ca8-06f2cb9b4700 tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] Image limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 21:01:23.634608 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-020df35b-b45b-4a8d-8ca8-06f2cb9b4700 tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] Flavor pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 21:01:23.635020 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-020df35b-b45b-4a8d-8ca8-06f2cb9b4700 tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] Image pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 21:01:23.635457 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-020df35b-b45b-4a8d-8ca8-06f2cb9b4700 tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 21:01:23.637696 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0ca6d5c1-ff78-4b31-8feb-e66fffdd4813 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:23.638156 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0ca6d5c1-ff78-4b31-8feb-e66fffdd4813 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:23.639098 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0ca6d5c1-ff78-4b31-8feb-e66fffdd4813 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:23.639686 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0ca6d5c1-ff78-4b31-8feb-e66fffdd4813 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:23.648466 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-020df35b-b45b-4a8d-8ca8-06f2cb9b4700 tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:23.648961 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-020df35b-b45b-4a8d-8ca8-06f2cb9b4700 tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:23.649841 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-020df35b-b45b-4a8d-8ca8-06f2cb9b4700 tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:23.650274 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-020df35b-b45b-4a8d-8ca8-06f2cb9b4700 tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:23.669885 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-020df35b-b45b-4a8d-8ca8-06f2cb9b4700 tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] Getting quotas for project 06185565206e41dca051d568bd18a082. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:01:23.677321 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-020df35b-b45b-4a8d-8ca8-06f2cb9b4700 tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] Getting quotas for user 5688424f63d04fb5bef4b79eb08546eb and project 06185565206e41dca051d568bd18a082. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:01:23.686399 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-0ca6d5c1-ff78-4b31-8feb-e66fffdd4813 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 16397 microversion: 2.32 time: 0.062144 Jan 15 21:01:23.687333 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1969/3922] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:23 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 16397 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:01:23.692700 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-020df35b-b45b-4a8d-8ca8-06f2cb9b4700 tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] Going to run 1 instances... {{(pid=129366) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 21:01:23.693781 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-34cad780-19eb-45cf-9371-7cc7cad9bd8d tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:23.694548 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-34cad780-19eb-45cf-9371-7cc7cad9bd8d tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: 4d836f07-866f-4e13-94ff-c4fe850e58d3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:23.695192 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-020df35b-b45b-4a8d-8ca8-06f2cb9b4700 tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] [instance: 1c4fc198-0d0c-44d3-8add-e663bd22d35a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 21:01:23.703310 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-34cad780-19eb-45cf-9371-7cc7cad9bd8d tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:23.703833 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-34cad780-19eb-45cf-9371-7cc7cad9bd8d tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:23.704690 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-34cad780-19eb-45cf-9371-7cc7cad9bd8d tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:23.705215 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-34cad780-19eb-45cf-9371-7cc7cad9bd8d tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:23.748587 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-020df35b-b45b-4a8d-8ca8-06f2cb9b4700 tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.118948 Jan 15 21:01:23.755283 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1954/3923] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 21:01:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1127 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 21:01:23.829431 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a5d589d8-8408-4a3d-9c5b-6d663a6ef02f tempest-ComputeTenantNetworksTest-1081836694 tempest-ComputeTenantNetworksTest-1081836694-project] Calling method '.version_select at 0x7f30c9215550>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:24.038367 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-34cad780-19eb-45cf-9371-7cc7cad9bd8d tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8f9c6ea7f6496792258d683640c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a75218d537c4d63874297261bec70ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:24.047931 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-34cad780-19eb-45cf-9371-7cc7cad9bd8d tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] 10.222.0.46 "GET /compute/v2.1/servers/4d836f07-866f-4e13-94ff-c4fe850e58d3" status: 200 len: 1507 microversion: 2.1 time: 0.358980 Jan 15 21:01:24.050952 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1970/3924] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:23 2022] GET /compute/v2.1/servers/4d836f07-866f-4e13-94ff-c4fe850e58d3 => generated 1507 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:24.061956 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9f3b2268-1040-4f0b-9744-07e7b253cf23 tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:24.062815 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-9f3b2268-1040-4f0b-9744-07e7b253cf23 tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] [instance: 1c4fc198-0d0c-44d3-8add-e663bd22d35a] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:24.106047 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a5d589d8-8408-4a3d-9c5b-6d663a6ef02f tempest-ComputeTenantNetworksTest-1081836694 tempest-ComputeTenantNetworksTest-1081836694-project] 10.222.0.46 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 308 microversion: 2.1 time: 0.344786 Jan 15 21:01:24.107765 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1955/3925] 10.222.0.46 () {58 vars in 1157 bytes} [Sat Jan 15 21:01:23 2022] GET /compute/v2.1/os-tenant-networks => generated 308 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:01:24.117641 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-69beed5f-3a84-49ef-b485-eb67e505bb39 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:24.119124 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-69beed5f-3a84-49ef-b485-eb67e505bb39 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:24.129453 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-69beed5f-3a84-49ef-b485-eb67e505bb39 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:24.130878 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-69beed5f-3a84-49ef-b485-eb67e505bb39 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:24.131896 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-69beed5f-3a84-49ef-b485-eb67e505bb39 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:24.132999 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-69beed5f-3a84-49ef-b485-eb67e505bb39 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:24.140554 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-9f3b2268-1040-4f0b-9744-07e7b253cf23 tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5688424f63d04fb5bef4b79eb08546eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06185565206e41dca051d568bd18a082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:24.150267 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-9f3b2268-1040-4f0b-9744-07e7b253cf23 tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] 10.222.0.46 "GET /compute/v2.1/servers/1c4fc198-0d0c-44d3-8add-e663bd22d35a" status: 200 len: 1224 microversion: 2.1 time: 0.097803 Jan 15 21:01:24.151220 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1971/3926] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:24 2022] GET /compute/v2.1/servers/1c4fc198-0d0c-44d3-8add-e663bd22d35a => generated 1224 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:24.157053 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-856859be-8fa8-4f3b-b823-2ccdcd6cc17c tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:24.158081 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-856859be-8fa8-4f3b-b823-2ccdcd6cc17c tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: 4d836f07-866f-4e13-94ff-c4fe850e58d3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:24.167084 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-856859be-8fa8-4f3b-b823-2ccdcd6cc17c tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:24.167863 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-856859be-8fa8-4f3b-b823-2ccdcd6cc17c tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:24.170564 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-856859be-8fa8-4f3b-b823-2ccdcd6cc17c tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:24.170945 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-856859be-8fa8-4f3b-b823-2ccdcd6cc17c tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:24.198169 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-856859be-8fa8-4f3b-b823-2ccdcd6cc17c tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: 4d836f07-866f-4e13-94ff-c4fe850e58d3] Going to try to terminate instance {{(pid=129365) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 21:01:24.204064 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-69beed5f-3a84-49ef-b485-eb67e505bb39 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action" status: 200 len: 16331 microversion: 2.1 time: 0.094300 Jan 15 21:01:24.211019 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1956/3927] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:01:24 2022] POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action => generated 16331 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:01:24.219245 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8aa7b19b-81bc-4168-b08a-ab2ed926f545 tempest-ComputeTenantNetworksTest-1081836694 tempest-ComputeTenantNetworksTest-1081836694-project] Calling method '.version_select at 0x7f30ceca25e0>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:24.320068 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-856859be-8fa8-4f3b-b823-2ccdcd6cc17c tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] 10.222.0.46 "DELETE /compute/v2.1/servers/4d836f07-866f-4e13-94ff-c4fe850e58d3" status: 204 len: 0 microversion: 2.1 time: 0.167310 Jan 15 21:01:24.322504 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1972/3928] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 21:01:24 2022] DELETE /compute/v2.1/servers/4d836f07-866f-4e13-94ff-c4fe850e58d3 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 21:01:24.371423 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ee69f0db-7bb7-4822-ac93-2bddbaab645d tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:24.372206 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ee69f0db-7bb7-4822-ac93-2bddbaab645d tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:24.382908 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ee69f0db-7bb7-4822-ac93-2bddbaab645d tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:24.383469 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ee69f0db-7bb7-4822-ac93-2bddbaab645d tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:24.384334 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ee69f0db-7bb7-4822-ac93-2bddbaab645d tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:24.384955 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ee69f0db-7bb7-4822-ac93-2bddbaab645d tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:24.405751 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-8aa7b19b-81bc-4168-b08a-ab2ed926f545 tempest-ComputeTenantNetworksTest-1081836694 tempest-ComputeTenantNetworksTest-1081836694-project] 10.222.0.46 "GET /compute/v2.1/os-tenant-networks/336af374-222c-4eac-ae17-c9dcc2a11829" status: 200 len: 139 microversion: 2.1 time: 0.192702 Jan 15 21:01:24.406360 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1957/3929] 10.222.0.46 () {58 vars in 1268 bytes} [Sat Jan 15 21:01:24 2022] GET /compute/v2.1/os-tenant-networks/336af374-222c-4eac-ae17-c9dcc2a11829 => generated 139 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:01:24.487501 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-6b646182-126b-4e79-ba4d-981810c9474a tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1821247468", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "networks": [{"uuid": "e20dc768-2ef4-41d4-9bd1-8c6a11def8cb"}]}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:24.556997 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.network.neutron [None req-6b646182-126b-4e79-ba4d-981810c9474a tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] validate_networks() for [('e20dc768-2ef4-41d4-9bd1-8c6a11def8cb', None, None, None, None, None)] {{(pid=129366) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 21:01:24.558451 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-ee69f0db-7bb7-4822-ac93-2bddbaab645d tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:24.571011 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ee69f0db-7bb7-4822-ac93-2bddbaab645d tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9" status: 200 len: 1670 microversion: 2.1 time: 0.209272 Jan 15 21:01:24.582892 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1973/3930] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:24 2022] GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9 => generated 1670 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:01:24.588877 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ec253f47-5d14-492d-b637-33ce922ab507 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:24.590283 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ec253f47-5d14-492d-b637-33ce922ab507 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:24.597335 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ec253f47-5d14-492d-b637-33ce922ab507 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:24.598099 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ec253f47-5d14-492d-b637-33ce922ab507 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:24.599279 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ec253f47-5d14-492d-b637-33ce922ab507 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:24.600005 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ec253f47-5d14-492d-b637-33ce922ab507 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:24.647377 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ec253f47-5d14-492d-b637-33ce922ab507 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.062640 Jan 15 21:01:24.652281 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1974/3931] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:24 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:01:24.656299 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-4da84a07-bbb3-498e-87ab-e89ae23b8df3 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:24.657567 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-4da84a07-bbb3-498e-87ab-e89ae23b8df3 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:24.665547 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4da84a07-bbb3-498e-87ab-e89ae23b8df3 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:24.666277 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4da84a07-bbb3-498e-87ab-e89ae23b8df3 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:24.667107 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4da84a07-bbb3-498e-87ab-e89ae23b8df3 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:24.667537 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4da84a07-bbb3-498e-87ab-e89ae23b8df3 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:24.762602 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-4da84a07-bbb3-498e-87ab-e89ae23b8df3 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action" status: 202 len: 0 microversion: 2.1 time: 0.110965 Jan 15 21:01:24.763436 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1975/3932] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:01:24 2022] POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:01:24.771878 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-6b763a9b-645c-4ee8-9ae9-6e03c807c6dc tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:24.773799 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-6b763a9b-645c-4ee8-9ae9-6e03c807c6dc tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:24.782954 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6b763a9b-645c-4ee8-9ae9-6e03c807c6dc tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:24.784484 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6b763a9b-645c-4ee8-9ae9-6e03c807c6dc tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:24.785669 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6b763a9b-645c-4ee8-9ae9-6e03c807c6dc tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:24.786483 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6b763a9b-645c-4ee8-9ae9-6e03c807c6dc tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:24.900892 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-6b763a9b-645c-4ee8-9ae9-6e03c807c6dc tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action" status: 200 len: 32628 microversion: 2.20 time: 0.133478 Jan 15 21:01:24.901611 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1976/3933] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:24 2022] POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action => generated 32628 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:01:24.925346 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d786dfd2-f00c-4c42-9447-3c9e96058cbd tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:24.928912 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d786dfd2-f00c-4c42-9447-3c9e96058cbd tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:24.943068 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d786dfd2-f00c-4c42-9447-3c9e96058cbd tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:24.943624 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d786dfd2-f00c-4c42-9447-3c9e96058cbd tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:24.945121 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d786dfd2-f00c-4c42-9447-3c9e96058cbd tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:24.945641 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d786dfd2-f00c-4c42-9447-3c9e96058cbd tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:25.054609 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d786dfd2-f00c-4c42-9447-3c9e96058cbd tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 24546 microversion: 2.32 time: 0.137998 Jan 15 21:01:25.059334 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1977/3934] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:24 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 24546 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:01:25.072765 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-477b0211-767b-4c9c-aef1-a387ddb4070e tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:25.073476 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-477b0211-767b-4c9c-aef1-a387ddb4070e tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:25.091235 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-477b0211-767b-4c9c-aef1-a387ddb4070e tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:25.092058 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-477b0211-767b-4c9c-aef1-a387ddb4070e tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:25.092185 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-6b646182-126b-4e79-ba4d-981810c9474a tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Flavor limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 21:01:25.092616 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-6b646182-126b-4e79-ba4d-981810c9474a tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Image limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 21:01:25.093157 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-6b646182-126b-4e79-ba4d-981810c9474a tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Flavor pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 21:01:25.093303 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-477b0211-767b-4c9c-aef1-a387ddb4070e tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:25.094701 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-477b0211-767b-4c9c-aef1-a387ddb4070e tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:25.094949 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-6b646182-126b-4e79-ba4d-981810c9474a tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Image pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 21:01:25.095820 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-6b646182-126b-4e79-ba4d-981810c9474a tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 21:01:25.124301 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6b646182-126b-4e79-ba4d-981810c9474a tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:25.125176 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6b646182-126b-4e79-ba4d-981810c9474a tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:25.126256 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6b646182-126b-4e79-ba4d-981810c9474a tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:25.129383 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6b646182-126b-4e79-ba4d-981810c9474a tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:25.179643 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-6b646182-126b-4e79-ba4d-981810c9474a tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Getting quotas for project 6a75218d537c4d63874297261bec70ad. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:01:25.186814 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-6b646182-126b-4e79-ba4d-981810c9474a tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Getting quotas for user 8a8f9c6ea7f6496792258d683640c838 and project 6a75218d537c4d63874297261bec70ad. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:01:25.204759 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-6b646182-126b-4e79-ba4d-981810c9474a tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Going to run 1 instances... {{(pid=129366) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 21:01:25.207649 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-6b646182-126b-4e79-ba4d-981810c9474a tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: f437ed26-18bf-4cd8-b804-da114755f27e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 21:01:25.264428 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-6b646182-126b-4e79-ba4d-981810c9474a tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.782056 Jan 15 21:01:25.265539 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1958/3935] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 21:01:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 784 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 21:01:25.277130 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-a5c9d0fd-531e-409d-915b-126f4f23df5d req-8870bac3-39f8-4c76-ba7c-111ccc769bc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4504a13b-d10e-436a-a5ef-991829938dd9", "name": "network-vif-unplugged", "status": "completed", "tag": "f7503e3b-a43e-4550-8109-a1fb1aa2d5f1"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:25.278951 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:01:25.278951 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:01:25.287539 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-a5c9d0fd-531e-409d-915b-126f4f23df5d req-8870bac3-39f8-4c76-ba7c-111ccc769bc1 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:25.288278 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-a5c9d0fd-531e-409d-915b-126f4f23df5d req-8870bac3-39f8-4c76-ba7c-111ccc769bc1 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:25.301709 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-477b0211-767b-4c9c-aef1-a387ddb4070e tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:25.304743 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-a5c9d0fd-531e-409d-915b-126f4f23df5d req-8870bac3-39f8-4c76-ba7c-111ccc769bc1 service nova] Creating event network-vif-unplugged:f7503e3b-a43e-4550-8109-a1fb1aa2d5f1 for instance 4504a13b-d10e-436a-a5ef-991829938dd9 on nch1-master-1 Jan 15 21:01:25.311167 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-477b0211-767b-4c9c-aef1-a387ddb4070e tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9" status: 200 len: 1672 microversion: 2.1 time: 0.249364 Jan 15 21:01:25.322027 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1978/3936] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:25 2022] GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9 => generated 1672 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:25.327587 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-a5c9d0fd-531e-409d-915b-126f4f23df5d req-8870bac3-39f8-4c76-ba7c-111ccc769bc1 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050493 Jan 15 21:01:25.328380 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1959/3937] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:01:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:01:25.333363 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5a083c0a-1752-4e5d-bce0-25ee0c4b2686 tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:25.334105 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-5a083c0a-1752-4e5d-bce0-25ee0c4b2686 tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] [instance: 1c4fc198-0d0c-44d3-8add-e663bd22d35a] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:25.340660 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5a083c0a-1752-4e5d-bce0-25ee0c4b2686 tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:25.341297 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5a083c0a-1752-4e5d-bce0-25ee0c4b2686 tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:25.341527 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8e78e098-0f48-43c6-b91f-e49ee01d65b6 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:25.342496 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5a083c0a-1752-4e5d-bce0-25ee0c4b2686 tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:25.343048 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5a083c0a-1752-4e5d-bce0-25ee0c4b2686 tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:25.349187 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-8e78e098-0f48-43c6-b91f-e49ee01d65b6 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:25.370115 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8e78e098-0f48-43c6-b91f-e49ee01d65b6 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:25.373504 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8e78e098-0f48-43c6-b91f-e49ee01d65b6 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:25.374623 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8e78e098-0f48-43c6-b91f-e49ee01d65b6 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:25.376348 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8e78e098-0f48-43c6-b91f-e49ee01d65b6 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:25.435079 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-8e78e098-0f48-43c6-b91f-e49ee01d65b6 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action" status: 200 len: 16331 microversion: 2.1 time: 0.102637 Jan 15 21:01:25.439671 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1960/3938] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:01:25 2022] POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action => generated 16331 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:01:25.445069 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-dd4e8ef4-f9c5-48a0-83a7-7105c30aa613 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:25.446992 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-dd4e8ef4-f9c5-48a0-83a7-7105c30aa613 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: f437ed26-18bf-4cd8-b804-da114755f27e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:25.462530 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-5a083c0a-1752-4e5d-bce0-25ee0c4b2686 tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5688424f63d04fb5bef4b79eb08546eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06185565206e41dca051d568bd18a082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:25.475611 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5a083c0a-1752-4e5d-bce0-25ee0c4b2686 tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] 10.222.0.46 "GET /compute/v2.1/servers/1c4fc198-0d0c-44d3-8add-e663bd22d35a" status: 200 len: 1282 microversion: 2.1 time: 0.150645 Jan 15 21:01:25.478166 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1979/3939] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:25 2022] GET /compute/v2.1/servers/1c4fc198-0d0c-44d3-8add-e663bd22d35a => generated 1282 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:25.534568 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-dd4e8ef4-f9c5-48a0-83a7-7105c30aa613 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8f9c6ea7f6496792258d683640c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a75218d537c4d63874297261bec70ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:25.546432 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-dd4e8ef4-f9c5-48a0-83a7-7105c30aa613 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] 10.222.0.46 "GET /compute/v2.1/servers/f437ed26-18bf-4cd8-b804-da114755f27e" status: 200 len: 1218 microversion: 2.1 time: 0.108646 Jan 15 21:01:25.547408 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1961/3940] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:25 2022] GET /compute/v2.1/servers/f437ed26-18bf-4cd8-b804-da114755f27e => generated 1218 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:25.663595 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ac412ed7-6992-4ef9-8f43-58f0bda42838 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:25.666872 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ac412ed7-6992-4ef9-8f43-58f0bda42838 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:25.706551 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ac412ed7-6992-4ef9-8f43-58f0bda42838 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:25.707009 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ac412ed7-6992-4ef9-8f43-58f0bda42838 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:25.707999 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ac412ed7-6992-4ef9-8f43-58f0bda42838 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:25.708436 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ac412ed7-6992-4ef9-8f43-58f0bda42838 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:25.762082 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ac412ed7-6992-4ef9-8f43-58f0bda42838 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.104542 Jan 15 21:01:25.766547 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1980/3941] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:25 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:01:25.913423 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-fb049b3f-b66f-43be-9779-d5e77169599e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:25.914485 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-fb049b3f-b66f-43be-9779-d5e77169599e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:25.922661 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fb049b3f-b66f-43be-9779-d5e77169599e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:25.923374 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fb049b3f-b66f-43be-9779-d5e77169599e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:25.925343 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fb049b3f-b66f-43be-9779-d5e77169599e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:25.926170 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fb049b3f-b66f-43be-9779-d5e77169599e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:25.973364 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-fb049b3f-b66f-43be-9779-d5e77169599e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action" status: 200 len: 32628 microversion: 2.20 time: 0.064178 Jan 15 21:01:25.978045 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1962/3942] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:25 2022] POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action => generated 32628 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:01:26.070660 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-addc4386-f022-4666-8dbe-0da095793ea9 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:26.072043 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-addc4386-f022-4666-8dbe-0da095793ea9 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:26.086971 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-addc4386-f022-4666-8dbe-0da095793ea9 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:26.087421 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-addc4386-f022-4666-8dbe-0da095793ea9 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:26.091097 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-addc4386-f022-4666-8dbe-0da095793ea9 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:26.091607 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-addc4386-f022-4666-8dbe-0da095793ea9 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:26.145454 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-addc4386-f022-4666-8dbe-0da095793ea9 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 24546 microversion: 2.32 time: 0.079293 Jan 15 21:01:26.149337 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1981/3943] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:26 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 24546 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:01:26.329845 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-03fdab7b-1e3d-4844-bfe7-d129d82d5207 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:26.331486 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-03fdab7b-1e3d-4844-bfe7-d129d82d5207 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:26.342420 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-03fdab7b-1e3d-4844-bfe7-d129d82d5207 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:26.342925 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-03fdab7b-1e3d-4844-bfe7-d129d82d5207 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:26.344273 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-03fdab7b-1e3d-4844-bfe7-d129d82d5207 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:26.344720 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-03fdab7b-1e3d-4844-bfe7-d129d82d5207 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:26.449608 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-939d7121-aa73-4ed2-b741-b6d1f54d07c4 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:26.462847 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-939d7121-aa73-4ed2-b741-b6d1f54d07c4 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:26.485919 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-939d7121-aa73-4ed2-b741-b6d1f54d07c4 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:26.486383 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-939d7121-aa73-4ed2-b741-b6d1f54d07c4 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:26.487236 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-939d7121-aa73-4ed2-b741-b6d1f54d07c4 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:26.487688 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-939d7121-aa73-4ed2-b741-b6d1f54d07c4 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:26.592860 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-939d7121-aa73-4ed2-b741-b6d1f54d07c4 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action" status: 200 len: 16331 microversion: 2.1 time: 0.148054 Jan 15 21:01:26.593916 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1982/3944] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:01:26 2022] POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action => generated 16331 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:01:26.599760 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a5ff6428-3cd6-4d9b-a1d1-8071813443c6 tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:26.600468 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a5ff6428-3cd6-4d9b-a1d1-8071813443c6 tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] [instance: 1c4fc198-0d0c-44d3-8add-e663bd22d35a] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:26.607630 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a5ff6428-3cd6-4d9b-a1d1-8071813443c6 tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:26.608091 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a5ff6428-3cd6-4d9b-a1d1-8071813443c6 tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:26.608909 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a5ff6428-3cd6-4d9b-a1d1-8071813443c6 tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:26.609762 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a5ff6428-3cd6-4d9b-a1d1-8071813443c6 tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:26.635049 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-03fdab7b-1e3d-4844-bfe7-d129d82d5207 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:26.649997 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-03fdab7b-1e3d-4844-bfe7-d129d82d5207 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9" status: 200 len: 1677 microversion: 2.1 time: 0.323860 Jan 15 21:01:26.650839 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1963/3945] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:26 2022] GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9 => generated 1677 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:26.666320 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-15eeb314-4d79-45f6-8442-5e7147ca4e85 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:26.666982 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-15eeb314-4d79-45f6-8442-5e7147ca4e85 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: f437ed26-18bf-4cd8-b804-da114755f27e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:26.679232 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-15eeb314-4d79-45f6-8442-5e7147ca4e85 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:26.680709 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-15eeb314-4d79-45f6-8442-5e7147ca4e85 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:26.681715 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-15eeb314-4d79-45f6-8442-5e7147ca4e85 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:26.682387 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-15eeb314-4d79-45f6-8442-5e7147ca4e85 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:26.787155 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-15eeb314-4d79-45f6-8442-5e7147ca4e85 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8f9c6ea7f6496792258d683640c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a75218d537c4d63874297261bec70ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:26.796461 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-15eeb314-4d79-45f6-8442-5e7147ca4e85 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] 10.222.0.46 "GET /compute/v2.1/servers/f437ed26-18bf-4cd8-b804-da114755f27e" status: 200 len: 1288 microversion: 2.1 time: 0.144214 Jan 15 21:01:26.797347 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1964/3946] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:26 2022] GET /compute/v2.1/servers/f437ed26-18bf-4cd8-b804-da114755f27e => generated 1288 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:26.816038 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-a5ff6428-3cd6-4d9b-a1d1-8071813443c6 tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5688424f63d04fb5bef4b79eb08546eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06185565206e41dca051d568bd18a082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:26.824394 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a5ff6428-3cd6-4d9b-a1d1-8071813443c6 tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] 10.222.0.46 "GET /compute/v2.1/servers/1c4fc198-0d0c-44d3-8add-e663bd22d35a" status: 200 len: 1324 microversion: 2.1 time: 0.229257 Jan 15 21:01:26.825306 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1983/3947] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:26 2022] GET /compute/v2.1/servers/1c4fc198-0d0c-44d3-8add-e663bd22d35a => generated 1324 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:26.831182 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-1ea56fc7-19e1-4cdf-9b1f-f3ceb1bc2fd6 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:26.832199 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-1ea56fc7-19e1-4cdf-9b1f-f3ceb1bc2fd6 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:26.839316 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1ea56fc7-19e1-4cdf-9b1f-f3ceb1bc2fd6 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:26.840072 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1ea56fc7-19e1-4cdf-9b1f-f3ceb1bc2fd6 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:26.840985 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1ea56fc7-19e1-4cdf-9b1f-f3ceb1bc2fd6 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:26.841422 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1ea56fc7-19e1-4cdf-9b1f-f3ceb1bc2fd6 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:26.888554 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-1ea56fc7-19e1-4cdf-9b1f-f3ceb1bc2fd6 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.061218 Jan 15 21:01:26.892963 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1984/3948] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:26 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:01:26.933323 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-dcf66e63-0e6f-4d3b-945e-4437ba8a6b79 tempest-VolumesSnapshotsTestJSON-502917034 tempest-VolumesSnapshotsTestJSON-502917034-project] Action: 'create', calling method: .version_select at 0x7f30c8f3e0d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1902801600"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:26.989429 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d3df10b4-7e75-454f-80d5-0b648fd51ba5 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:26.992434 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d3df10b4-7e75-454f-80d5-0b648fd51ba5 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:27.001026 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d3df10b4-7e75-454f-80d5-0b648fd51ba5 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:27.001480 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d3df10b4-7e75-454f-80d5-0b648fd51ba5 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:27.002433 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d3df10b4-7e75-454f-80d5-0b648fd51ba5 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:27.003224 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d3df10b4-7e75-454f-80d5-0b648fd51ba5 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:27.046652 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d3df10b4-7e75-454f-80d5-0b648fd51ba5 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action" status: 200 len: 32628 microversion: 2.20 time: 0.064091 Jan 15 21:01:27.051105 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1985/3949] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:26 2022] POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action => generated 32628 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:01:27.160545 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3d8567b3-e7f5-4cab-ae83-9ecf95e36bc7 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:27.162489 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-3d8567b3-e7f5-4cab-ae83-9ecf95e36bc7 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:27.175861 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3d8567b3-e7f5-4cab-ae83-9ecf95e36bc7 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:27.177048 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3d8567b3-e7f5-4cab-ae83-9ecf95e36bc7 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:27.178155 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3d8567b3-e7f5-4cab-ae83-9ecf95e36bc7 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:27.178829 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3d8567b3-e7f5-4cab-ae83-9ecf95e36bc7 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:27.261460 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3d8567b3-e7f5-4cab-ae83-9ecf95e36bc7 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 24546 microversion: 2.32 time: 0.092376 Jan 15 21:01:27.262683 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1986/3950] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:27 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 24546 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:01:27.271939 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-c14027c9-bc05-4080-a39a-2eb6ebaabfde req-8482953d-b2f3-463c-bb37-ba0225cad129 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d836f07-866f-4e13-94ff-c4fe850e58d3", "name": "network-vif-deleted", "tag": "4949ae19-44ff-4865-9776-96c470821b54"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:27.285069 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:01:27.285069 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:01:27.302924 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-c14027c9-bc05-4080-a39a-2eb6ebaabfde req-8482953d-b2f3-463c-bb37-ba0225cad129 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:27.303534 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-c14027c9-bc05-4080-a39a-2eb6ebaabfde req-8482953d-b2f3-463c-bb37-ba0225cad129 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:27.346932 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-c14027c9-bc05-4080-a39a-2eb6ebaabfde req-8482953d-b2f3-463c-bb37-ba0225cad129 service nova] Creating event network-vif-deleted:4949ae19-44ff-4865-9776-96c470821b54 for instance 4d836f07-866f-4e13-94ff-c4fe850e58d3 on nch1-master-1 Jan 15 21:01:27.354042 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-c14027c9-bc05-4080-a39a-2eb6ebaabfde req-8482953d-b2f3-463c-bb37-ba0225cad129 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089849 Jan 15 21:01:27.354870 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1987/3951] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:01:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:01:27.400829 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-dcf66e63-0e6f-4d3b-945e-4437ba8a6b79 tempest-VolumesSnapshotsTestJSON-502917034 tempest-VolumesSnapshotsTestJSON-502917034-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 200 len: 338 microversion: 2.1 time: 0.602063 Jan 15 21:01:27.401610 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1965/3952] 10.222.0.46 () {60 vars in 1154 bytes} [Sat Jan 15 21:01:26 2022] POST /compute/v2.1/os-volumes => generated 338 bytes in 604 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jan 15 21:01:27.414950 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-1e36d67f-a2e1-47d7-b787-9a9f623da609 tempest-VolumesSnapshotsTestJSON-502917034 tempest-VolumesSnapshotsTestJSON-502917034-project] Calling method '.version_select at 0x7f30c9a47820>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:27.479886 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-1e36d67f-a2e1-47d7-b787-9a9f623da609 tempest-VolumesSnapshotsTestJSON-502917034 tempest-VolumesSnapshotsTestJSON-502917034-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/428ecd34-edb8-4c5b-a0ef-792f33a44f46" status: 200 len: 338 microversion: 2.1 time: 0.070891 Jan 15 21:01:27.480596 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1988/3953] 10.222.0.46 () {58 vars in 1244 bytes} [Sat Jan 15 21:01:27 2022] GET /compute/v2.1/os-volumes/428ecd34-edb8-4c5b-a0ef-792f33a44f46 => generated 338 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:01:27.607053 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ed6c41d0-f7ee-488e-936f-dedd2baed91c tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:27.608159 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ed6c41d0-f7ee-488e-936f-dedd2baed91c tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:27.624512 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ed6c41d0-f7ee-488e-936f-dedd2baed91c tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:27.624990 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ed6c41d0-f7ee-488e-936f-dedd2baed91c tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:27.625824 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ed6c41d0-f7ee-488e-936f-dedd2baed91c tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:27.626272 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ed6c41d0-f7ee-488e-936f-dedd2baed91c tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:27.684961 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2f7344fd-6382-4d16-9bcb-d5f3adea0727 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:27.686159 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-2f7344fd-6382-4d16-9bcb-d5f3adea0727 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:27.693229 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ed6c41d0-f7ee-488e-936f-dedd2baed91c tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action" status: 200 len: 16331 microversion: 2.1 time: 0.090458 Jan 15 21:01:27.707913 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1966/3954] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:01:27 2022] POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action => generated 16331 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 21:01:27.717563 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2f7344fd-6382-4d16-9bcb-d5f3adea0727 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:27.718194 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2f7344fd-6382-4d16-9bcb-d5f3adea0727 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:27.720361 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2f7344fd-6382-4d16-9bcb-d5f3adea0727 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:27.722463 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2f7344fd-6382-4d16-9bcb-d5f3adea0727 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:27.816694 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-2d55aafb-2b04-4e3e-8b40-c02f87f5965d tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:27.817530 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-2d55aafb-2b04-4e3e-8b40-c02f87f5965d tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: f437ed26-18bf-4cd8-b804-da114755f27e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:27.843478 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2d55aafb-2b04-4e3e-8b40-c02f87f5965d tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:27.845106 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2d55aafb-2b04-4e3e-8b40-c02f87f5965d tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:27.847638 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2d55aafb-2b04-4e3e-8b40-c02f87f5965d tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:27.849374 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2d55aafb-2b04-4e3e-8b40-c02f87f5965d tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:27.988624 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-2d55aafb-2b04-4e3e-8b40-c02f87f5965d tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8f9c6ea7f6496792258d683640c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a75218d537c4d63874297261bec70ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:28.017619 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-2f7344fd-6382-4d16-9bcb-d5f3adea0727 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:28.024608 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-2d55aafb-2b04-4e3e-8b40-c02f87f5965d tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] 10.222.0.46 "GET /compute/v2.1/servers/f437ed26-18bf-4cd8-b804-da114755f27e" status: 200 len: 1276 microversion: 2.1 time: 0.207037 Jan 15 21:01:28.036997 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1967/3955] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:27 2022] GET /compute/v2.1/servers/f437ed26-18bf-4cd8-b804-da114755f27e => generated 1276 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:28.040686 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2f7344fd-6382-4d16-9bcb-d5f3adea0727 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9" status: 200 len: 1670 microversion: 2.1 time: 0.373751 Jan 15 21:01:28.043332 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1989/3956] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:27 2022] GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9 => generated 1670 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:28.046832 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0c453d86-9cfc-4181-884c-e32e842b0669 tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:28.048731 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-0c453d86-9cfc-4181-884c-e32e842b0669 tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] [instance: 1c4fc198-0d0c-44d3-8add-e663bd22d35a] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:28.060067 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0c453d86-9cfc-4181-884c-e32e842b0669 tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:28.060492 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-88fbd91d-8137-4a51-be6c-69a0ca08a4b4 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:28.060776 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0c453d86-9cfc-4181-884c-e32e842b0669 tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:28.062242 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0c453d86-9cfc-4181-884c-e32e842b0669 tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:28.062688 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0c453d86-9cfc-4181-884c-e32e842b0669 tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:28.064360 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-88fbd91d-8137-4a51-be6c-69a0ca08a4b4 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:28.079190 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-88fbd91d-8137-4a51-be6c-69a0ca08a4b4 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:28.082425 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-88fbd91d-8137-4a51-be6c-69a0ca08a4b4 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:28.084018 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-88fbd91d-8137-4a51-be6c-69a0ca08a4b4 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:28.084748 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-88fbd91d-8137-4a51-be6c-69a0ca08a4b4 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:28.149312 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-88fbd91d-8137-4a51-be6c-69a0ca08a4b4 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.102090 Jan 15 21:01:28.154202 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1990/3957] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:28 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:01:28.168093 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f7c692b6-3625-416e-a99a-7f82e9e66323 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:28.170982 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f7c692b6-3625-416e-a99a-7f82e9e66323 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:28.182986 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f7c692b6-3625-416e-a99a-7f82e9e66323 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:28.183444 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f7c692b6-3625-416e-a99a-7f82e9e66323 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:28.184714 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f7c692b6-3625-416e-a99a-7f82e9e66323 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:28.185445 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f7c692b6-3625-416e-a99a-7f82e9e66323 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:28.264393 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f7c692b6-3625-416e-a99a-7f82e9e66323 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action" status: 200 len: 32628 microversion: 2.20 time: 0.107150 Jan 15 21:01:28.265558 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1991/3958] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:28 2022] POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action => generated 32628 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:01:28.279394 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-953a99ae-5cfb-4e5f-b5a4-d5dabc3586e3 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:28.280572 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-953a99ae-5cfb-4e5f-b5a4-d5dabc3586e3 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:28.286155 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-0c453d86-9cfc-4181-884c-e32e842b0669 tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5688424f63d04fb5bef4b79eb08546eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06185565206e41dca051d568bd18a082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:28.289315 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-953a99ae-5cfb-4e5f-b5a4-d5dabc3586e3 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:28.289833 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-953a99ae-5cfb-4e5f-b5a4-d5dabc3586e3 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:28.290713 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-953a99ae-5cfb-4e5f-b5a4-d5dabc3586e3 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:28.291264 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-953a99ae-5cfb-4e5f-b5a4-d5dabc3586e3 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:28.310379 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0c453d86-9cfc-4181-884c-e32e842b0669 tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] 10.222.0.46 "GET /compute/v2.1/servers/1c4fc198-0d0c-44d3-8add-e663bd22d35a" status: 200 len: 1324 microversion: 2.1 time: 0.271703 Jan 15 21:01:28.311322 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1968/3959] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:28 2022] GET /compute/v2.1/servers/1c4fc198-0d0c-44d3-8add-e663bd22d35a => generated 1324 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:28.333682 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1c4b2bc3-1236-487b-bd66-3053d3e0f10e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:28.335027 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-1c4b2bc3-1236-487b-bd66-3053d3e0f10e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:28.348773 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1c4b2bc3-1236-487b-bd66-3053d3e0f10e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:28.355951 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1c4b2bc3-1236-487b-bd66-3053d3e0f10e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:28.357623 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1c4b2bc3-1236-487b-bd66-3053d3e0f10e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:28.358291 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1c4b2bc3-1236-487b-bd66-3053d3e0f10e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:28.370091 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-953a99ae-5cfb-4e5f-b5a4-d5dabc3586e3 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action" status: 200 len: 322 microversion: 2.1 time: 0.101933 Jan 15 21:01:28.371168 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1992/3960] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:01:28 2022] POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action => generated 322 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:01:28.385424 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5f6671b6-0988-4a70-8459-cac22a508406 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:28.385803 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-5f6671b6-0988-4a70-8459-cac22a508406 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:28.395827 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5f6671b6-0988-4a70-8459-cac22a508406 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:28.397007 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5f6671b6-0988-4a70-8459-cac22a508406 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:28.398154 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5f6671b6-0988-4a70-8459-cac22a508406 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:28.399148 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5f6671b6-0988-4a70-8459-cac22a508406 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:28.419697 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-1c4b2bc3-1236-487b-bd66-3053d3e0f10e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 24546 microversion: 2.32 time: 0.103985 Jan 15 21:01:28.422229 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1969/3961] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:28 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 24546 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:01:28.496783 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0389f9b8-4c93-4422-9ff7-2ffb13e208d0 tempest-VolumesSnapshotsTestJSON-502917034 tempest-VolumesSnapshotsTestJSON-502917034-project] Calling method '.version_select at 0x7f30c8f3e280>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:28.585880 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0389f9b8-4c93-4422-9ff7-2ffb13e208d0 tempest-VolumesSnapshotsTestJSON-502917034 tempest-VolumesSnapshotsTestJSON-502917034-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/428ecd34-edb8-4c5b-a0ef-792f33a44f46" status: 200 len: 339 microversion: 2.1 time: 0.096743 Jan 15 21:01:28.586598 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1970/3962] 10.222.0.46 () {58 vars in 1244 bytes} [Sat Jan 15 21:01:28 2022] GET /compute/v2.1/os-volumes/428ecd34-edb8-4c5b-a0ef-792f33a44f46 => generated 339 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 21:01:28.602407 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-74021b4b-3bb3-4a02-8165-7262c10f0733 tempest-VolumesSnapshotsTestJSON-502917034 tempest-VolumesSnapshotsTestJSON-502917034-project] Action: 'create', calling method: .version_select at 0x7f30cec0aee0>, body: {"snapshot": {"volume_id": "428ecd34-edb8-4c5b-a0ef-792f33a44f46", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-26244564"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:28.602802 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-5f6671b6-0988-4a70-8459-cac22a508406 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:28.611365 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5f6671b6-0988-4a70-8459-cac22a508406 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9" status: 200 len: 1670 microversion: 2.1 time: 0.233716 Jan 15 21:01:28.612321 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1993/3963] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:28 2022] GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9 => generated 1670 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:28.632330 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a2783bad-c956-4490-acb4-929b6b0c87c4 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:28.633135 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a2783bad-c956-4490-acb4-929b6b0c87c4 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:28.640176 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a2783bad-c956-4490-acb4-929b6b0c87c4 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:28.640725 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a2783bad-c956-4490-acb4-929b6b0c87c4 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:28.641665 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a2783bad-c956-4490-acb4-929b6b0c87c4 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:28.642263 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a2783bad-c956-4490-acb4-929b6b0c87c4 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:28.809932 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-a2783bad-c956-4490-acb4-929b6b0c87c4 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:28.822466 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a2783bad-c956-4490-acb4-929b6b0c87c4 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9" status: 200 len: 1670 microversion: 2.1 time: 0.194662 Jan 15 21:01:28.823070 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1994/3964] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:28 2022] GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9 => generated 1670 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:28.840508 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a98c0404-f083-425f-bce1-b37c424494f5 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:28.842543 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a98c0404-f083-425f-bce1-b37c424494f5 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:28.859928 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a98c0404-f083-425f-bce1-b37c424494f5 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:28.860384 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a98c0404-f083-425f-bce1-b37c424494f5 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:28.866412 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a98c0404-f083-425f-bce1-b37c424494f5 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:28.867786 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a98c0404-f083-425f-bce1-b37c424494f5 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:28.874769 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-74021b4b-3bb3-4a02-8165-7262c10f0733 tempest-VolumesSnapshotsTestJSON-502917034 tempest-VolumesSnapshotsTestJSON-502917034-project] 10.222.0.46 "POST /compute/v2.1/os-snapshots" status: 200 len: 285 microversion: 2.1 time: 0.278922 Jan 15 21:01:28.875480 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1971/3965] 10.222.0.46 () {60 vars in 1161 bytes} [Sat Jan 15 21:01:28 2022] POST /compute/v2.1/os-snapshots => generated 285 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:01:28.887675 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-49ad4062-5402-4bb8-9164-d41a0d6ed5db tempest-VolumesSnapshotsTestJSON-502917034 tempest-VolumesSnapshotsTestJSON-502917034-project] Calling method '.version_select at 0x7f30cec639d0>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:28.973094 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a98c0404-f083-425f-bce1-b37c424494f5 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action" status: 200 len: 24508 microversion: 2.1 time: 0.144345 Jan 15 21:01:28.974257 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1995/3966] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:01:28 2022] POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action => generated 24508 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:01:29.013300 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-49ad4062-5402-4bb8-9164-d41a0d6ed5db tempest-VolumesSnapshotsTestJSON-502917034 tempest-VolumesSnapshotsTestJSON-502917034-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/1cda52b6-7abd-4e85-b049-45674f789a78" status: 200 len: 285 microversion: 2.1 time: 0.125343 Jan 15 21:01:29.015409 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1972/3967] 10.222.0.46 () {58 vars in 1250 bytes} [Sat Jan 15 21:01:28 2022] GET /compute/v2.1/os-snapshots/1cda52b6-7abd-4e85-b049-45674f789a78 => generated 285 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:01:29.030366 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-4241bed0-c117-498a-ac8f-80f1ad2bedf4 tempest-VolumesSnapshotsTestJSON-502917034 tempest-VolumesSnapshotsTestJSON-502917034-project] Calling method '.version_select at 0x7f30c87efe50>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:29.046366 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-cee52dce-d410-4715-826c-ee52dcfad6c0 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:29.047122 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-cee52dce-d410-4715-826c-ee52dcfad6c0 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: f437ed26-18bf-4cd8-b804-da114755f27e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:29.059046 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cee52dce-d410-4715-826c-ee52dcfad6c0 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:29.059503 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cee52dce-d410-4715-826c-ee52dcfad6c0 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:29.060316 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cee52dce-d410-4715-826c-ee52dcfad6c0 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:29.060755 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cee52dce-d410-4715-826c-ee52dcfad6c0 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:29.104235 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-4241bed0-c117-498a-ac8f-80f1ad2bedf4 tempest-VolumesSnapshotsTestJSON-502917034 tempest-VolumesSnapshotsTestJSON-502917034-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots" status: 200 len: 288 microversion: 2.1 time: 0.081025 Jan 15 21:01:29.104911 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1996/3968] 10.222.0.46 () {58 vars in 1139 bytes} [Sat Jan 15 21:01:29 2022] GET /compute/v2.1/os-snapshots => generated 288 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:01:29.115620 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-4dfc320b-e069-4353-9bb6-06bd38118e23 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1325533290", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "networks": [{"uuid": "694fb227-829a-493b-b1b7-2dc4e238e05e"}]}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:29.222765 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.network.neutron [None req-4dfc320b-e069-4353-9bb6-06bd38118e23 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] validate_networks() for [('694fb227-829a-493b-b1b7-2dc4e238e05e', None, None, None, None, None)] {{(pid=129365) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 21:01:29.393884 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-cee52dce-d410-4715-826c-ee52dcfad6c0 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8f9c6ea7f6496792258d683640c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a75218d537c4d63874297261bec70ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:29.411531 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-cee52dce-d410-4715-826c-ee52dcfad6c0 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] 10.222.0.46 "GET /compute/v2.1/servers/f437ed26-18bf-4cd8-b804-da114755f27e" status: 200 len: 1318 microversion: 2.1 time: 0.371077 Jan 15 21:01:29.413567 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1973/3969] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:29 2022] GET /compute/v2.1/servers/f437ed26-18bf-4cd8-b804-da114755f27e => generated 1318 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:01:29.419689 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7db4407e-8f4c-4eb7-91f0-3a7b1f50637b tempest-VolumesSnapshotsTestJSON-502917034 tempest-VolumesSnapshotsTestJSON-502917034-project] Calling method '.version_select at 0x7f30cec0a160>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:29.471723 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7db4407e-8f4c-4eb7-91f0-3a7b1f50637b tempest-VolumesSnapshotsTestJSON-502917034 tempest-VolumesSnapshotsTestJSON-502917034-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/1cda52b6-7abd-4e85-b049-45674f789a78" status: 200 len: 285 microversion: 2.1 time: 0.056257 Jan 15 21:01:29.472299 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1974/3970] 10.222.0.46 () {58 vars in 1250 bytes} [Sat Jan 15 21:01:29 2022] GET /compute/v2.1/os-snapshots/1cda52b6-7abd-4e85-b049-45674f789a78 => generated 285 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:01:29.480076 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b1930295-938a-46cc-a98e-828910e36a57 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:29.481090 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b1930295-938a-46cc-a98e-828910e36a57 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:29.487801 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b1930295-938a-46cc-a98e-828910e36a57 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:29.488263 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b1930295-938a-46cc-a98e-828910e36a57 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:29.489178 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b1930295-938a-46cc-a98e-828910e36a57 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:29.489783 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b1930295-938a-46cc-a98e-828910e36a57 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:29.547090 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b1930295-938a-46cc-a98e-828910e36a57 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.072699 Jan 15 21:01:29.551966 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1975/3971] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:29 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:01:29.558899 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-31081027-4b9d-4b93-849b-12a5dfc67ab5 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:29.560817 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-31081027-4b9d-4b93-849b-12a5dfc67ab5 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:29.569949 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-31081027-4b9d-4b93-849b-12a5dfc67ab5 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:29.570745 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-31081027-4b9d-4b93-849b-12a5dfc67ab5 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:29.571672 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-31081027-4b9d-4b93-849b-12a5dfc67ab5 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:29.572448 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-31081027-4b9d-4b93-849b-12a5dfc67ab5 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:29.632524 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-31081027-4b9d-4b93-849b-12a5dfc67ab5 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action" status: 200 len: 32628 microversion: 2.20 time: 0.077686 Jan 15 21:01:29.639657 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1976/3972] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:29 2022] POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action => generated 32628 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:01:29.647597 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8b5c115d-14e8-4245-915c-76f4eddc9c7e tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:29.649398 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-8b5c115d-14e8-4245-915c-76f4eddc9c7e tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] [instance: 1c4fc198-0d0c-44d3-8add-e663bd22d35a] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:29.660487 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8b5c115d-14e8-4245-915c-76f4eddc9c7e tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:29.661031 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8b5c115d-14e8-4245-915c-76f4eddc9c7e tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:29.662049 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8b5c115d-14e8-4245-915c-76f4eddc9c7e tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:29.662751 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8b5c115d-14e8-4245-915c-76f4eddc9c7e tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:30.139725 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-4dfc320b-e069-4353-9bb6-06bd38118e23 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Flavor limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 21:01:30.140284 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-4dfc320b-e069-4353-9bb6-06bd38118e23 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Image limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 21:01:30.140473 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-4dfc320b-e069-4353-9bb6-06bd38118e23 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Flavor pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 21:01:30.140911 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-4dfc320b-e069-4353-9bb6-06bd38118e23 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Image pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 21:01:30.141592 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-4dfc320b-e069-4353-9bb6-06bd38118e23 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 21:01:30.152225 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4dfc320b-e069-4353-9bb6-06bd38118e23 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:30.152684 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4dfc320b-e069-4353-9bb6-06bd38118e23 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:30.153540 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4dfc320b-e069-4353-9bb6-06bd38118e23 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:30.153984 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4dfc320b-e069-4353-9bb6-06bd38118e23 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:30.174993 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-4dfc320b-e069-4353-9bb6-06bd38118e23 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Getting quotas for project e3a611cade394cb288f103fcf516e4ab. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:01:30.181265 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-4dfc320b-e069-4353-9bb6-06bd38118e23 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Getting quotas for user 7f1ee75d18ae4db8825653f6e8180b72 and project e3a611cade394cb288f103fcf516e4ab. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:01:30.193580 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-8b5c115d-14e8-4245-915c-76f4eddc9c7e tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5688424f63d04fb5bef4b79eb08546eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06185565206e41dca051d568bd18a082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:30.195598 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-4dfc320b-e069-4353-9bb6-06bd38118e23 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Going to run 1 instances... {{(pid=129365) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 21:01:30.198093 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-4dfc320b-e069-4353-9bb6-06bd38118e23 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 11cbafd5-4836-48b9-8db6-440002deb281] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129365) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 21:01:30.201031 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-8b5c115d-14e8-4245-915c-76f4eddc9c7e tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] 10.222.0.46 "GET /compute/v2.1/servers/1c4fc198-0d0c-44d3-8add-e663bd22d35a" status: 200 len: 1324 microversion: 2.1 time: 0.559588 Jan 15 21:01:30.201596 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1977/3973] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:29 2022] GET /compute/v2.1/servers/1c4fc198-0d0c-44d3-8add-e663bd22d35a => generated 1324 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:30.216587 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-75b23ca4-590c-462d-96ec-0455965adfff req-7026b4c8-bac0-4ad4-af50-22b92fef4e02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c4fc198-0d0c-44d3-8add-e663bd22d35a", "tag": "9fa19225-1fe7-4da0-8e05-a2d51660efa1"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:30.218161 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:01:30.218161 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:01:30.227151 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-75b23ca4-590c-462d-96ec-0455965adfff req-7026b4c8-bac0-4ad4-af50-22b92fef4e02 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:30.227796 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-75b23ca4-590c-462d-96ec-0455965adfff req-7026b4c8-bac0-4ad4-af50-22b92fef4e02 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:30.239142 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-75b23ca4-590c-462d-96ec-0455965adfff req-7026b4c8-bac0-4ad4-af50-22b92fef4e02 service nova] Creating event network-changed:9fa19225-1fe7-4da0-8e05-a2d51660efa1 for instance 1c4fc198-0d0c-44d3-8add-e663bd22d35a on nch2-master-1 Jan 15 21:01:30.243885 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-4dfc320b-e069-4353-9bb6-06bd38118e23 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.137018 Jan 15 21:01:30.244833 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1997/3974] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 21:01:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1139 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 21:01:30.245158 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-75b23ca4-590c-462d-96ec-0455965adfff req-7026b4c8-bac0-4ad4-af50-22b92fef4e02 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032686 Jan 15 21:01:30.246062 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1978/3975] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:01:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:01:30.250581 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d47f0b16-9022-4f2e-91fa-57eb98b39be5 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:30.251588 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-5405e89e-9410-47e2-b07b-e4b679e430b0 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:30.251830 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d47f0b16-9022-4f2e-91fa-57eb98b39be5 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:30.253226 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-5405e89e-9410-47e2-b07b-e4b679e430b0 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:30.260611 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d47f0b16-9022-4f2e-91fa-57eb98b39be5 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:30.261113 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d47f0b16-9022-4f2e-91fa-57eb98b39be5 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:30.261912 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d47f0b16-9022-4f2e-91fa-57eb98b39be5 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:30.262354 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d47f0b16-9022-4f2e-91fa-57eb98b39be5 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:30.271697 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5405e89e-9410-47e2-b07b-e4b679e430b0 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:30.272156 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5405e89e-9410-47e2-b07b-e4b679e430b0 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:30.273775 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5405e89e-9410-47e2-b07b-e4b679e430b0 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:30.274083 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5405e89e-9410-47e2-b07b-e4b679e430b0 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:30.320748 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-5405e89e-9410-47e2-b07b-e4b679e430b0 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action" status: 200 len: 24508 microversion: 2.1 time: 0.073044 Jan 15 21:01:30.323135 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d47f0b16-9022-4f2e-91fa-57eb98b39be5 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 24546 microversion: 2.32 time: 0.076027 Jan 15 21:01:30.324067 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1998/3976] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:30 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 24546 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:01:30.326117 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1979/3977] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:01:30 2022] POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action => generated 24508 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:01:30.329762 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-63449960-e473-449d-8d4f-28c1592b5ef0 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:30.332041 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-63449960-e473-449d-8d4f-28c1592b5ef0 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 11cbafd5-4836-48b9-8db6-440002deb281] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:30.393762 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-63449960-e473-449d-8d4f-28c1592b5ef0 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:30.401493 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-63449960-e473-449d-8d4f-28c1592b5ef0 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/11cbafd5-4836-48b9-8db6-440002deb281" status: 200 len: 1215 microversion: 2.1 time: 0.075755 Jan 15 21:01:30.402224 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 1999/3978] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:30 2022] GET /compute/v2.1/servers/11cbafd5-4836-48b9-8db6-440002deb281 => generated 1215 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:30.429629 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-92a02eb0-79ae-4f3e-ba92-448e143d9b0d tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:30.430636 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-92a02eb0-79ae-4f3e-ba92-448e143d9b0d tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: f437ed26-18bf-4cd8-b804-da114755f27e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:30.438807 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-92a02eb0-79ae-4f3e-ba92-448e143d9b0d tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:30.439357 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-92a02eb0-79ae-4f3e-ba92-448e143d9b0d tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:30.441136 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-92a02eb0-79ae-4f3e-ba92-448e143d9b0d tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:30.441685 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-92a02eb0-79ae-4f3e-ba92-448e143d9b0d tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:30.485030 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c21f5a8a-05b5-46b7-a59d-c99a62f34170 tempest-VolumesSnapshotsTestJSON-502917034 tempest-VolumesSnapshotsTestJSON-502917034-project] Calling method '.version_select at 0x7f30c8528a60>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:30.532323 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c21f5a8a-05b5-46b7-a59d-c99a62f34170 tempest-VolumesSnapshotsTestJSON-502917034 tempest-VolumesSnapshotsTestJSON-502917034-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/1cda52b6-7abd-4e85-b049-45674f789a78" status: 200 len: 286 microversion: 2.1 time: 0.052400 Jan 15 21:01:30.534274 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2000/3979] 10.222.0.46 () {58 vars in 1250 bytes} [Sat Jan 15 21:01:30 2022] GET /compute/v2.1/os-snapshots/1cda52b6-7abd-4e85-b049-45674f789a78 => generated 286 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 21:01:30.546098 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2e36b270-1fd0-4302-9e73-e08c6c273fde tempest-VolumesSnapshotsTestJSON-502917034 tempest-VolumesSnapshotsTestJSON-502917034-project] Calling method '.version_select at 0x7f30c8528700>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:30.617060 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-92a02eb0-79ae-4f3e-ba92-448e143d9b0d tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8f9c6ea7f6496792258d683640c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a75218d537c4d63874297261bec70ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:30.621587 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2e36b270-1fd0-4302-9e73-e08c6c273fde tempest-VolumesSnapshotsTestJSON-502917034 tempest-VolumesSnapshotsTestJSON-502917034-project] 10.222.0.46 "DELETE /compute/v2.1/os-snapshots/1cda52b6-7abd-4e85-b049-45674f789a78" status: 202 len: 0 microversion: 2.1 time: 0.080654 Jan 15 21:01:30.622267 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2001/3980] 10.222.0.46 () {58 vars in 1253 bytes} [Sat Jan 15 21:01:30 2022] DELETE /compute/v2.1/os-snapshots/1cda52b6-7abd-4e85-b049-45674f789a78 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:01:30.636130 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f132f06d-6e15-4d46-97e7-6112ccfa241a tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:30.637175 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f132f06d-6e15-4d46-97e7-6112ccfa241a tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:30.647641 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-92a02eb0-79ae-4f3e-ba92-448e143d9b0d tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] 10.222.0.46 "GET /compute/v2.1/servers/f437ed26-18bf-4cd8-b804-da114755f27e" status: 200 len: 1318 microversion: 2.1 time: 0.221899 Jan 15 21:01:30.648988 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1980/3981] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:30 2022] GET /compute/v2.1/servers/f437ed26-18bf-4cd8-b804-da114755f27e => generated 1318 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:30.654397 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-2d9f3a42-020e-477c-84e3-2cedc59716c3 tempest-VolumesSnapshotsTestJSON-502917034 tempest-VolumesSnapshotsTestJSON-502917034-project] Calling method '.version_select at 0x7f30c9150700>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:30.662577 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f132f06d-6e15-4d46-97e7-6112ccfa241a tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:30.663202 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f132f06d-6e15-4d46-97e7-6112ccfa241a tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:30.664669 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f132f06d-6e15-4d46-97e7-6112ccfa241a tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:30.665289 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f132f06d-6e15-4d46-97e7-6112ccfa241a tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:30.703101 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-2d9f3a42-020e-477c-84e3-2cedc59716c3 tempest-VolumesSnapshotsTestJSON-502917034 tempest-VolumesSnapshotsTestJSON-502917034-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/1cda52b6-7abd-4e85-b049-45674f789a78" status: 200 len: 285 microversion: 2.1 time: 0.052206 Jan 15 21:01:30.704927 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1981/3982] 10.222.0.46 () {58 vars in 1250 bytes} [Sat Jan 15 21:01:30 2022] GET /compute/v2.1/os-snapshots/1cda52b6-7abd-4e85-b049-45674f789a78 => generated 285 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:01:30.713642 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4ce92a7c-63f2-4bd1-971a-8dd99a54b38d tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:30.724483 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f132f06d-6e15-4d46-97e7-6112ccfa241a tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.095081 Jan 15 21:01:30.725979 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2002/3983] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:30 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:01:30.727057 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-4ce92a7c-63f2-4bd1-971a-8dd99a54b38d tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:30.736497 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4ce92a7c-63f2-4bd1-971a-8dd99a54b38d tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:30.737850 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4ce92a7c-63f2-4bd1-971a-8dd99a54b38d tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:30.738712 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4ce92a7c-63f2-4bd1-971a-8dd99a54b38d tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:30.739322 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4ce92a7c-63f2-4bd1-971a-8dd99a54b38d tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:30.795070 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-4ce92a7c-63f2-4bd1-971a-8dd99a54b38d tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action" status: 200 len: 32628 microversion: 2.20 time: 0.087891 Jan 15 21:01:30.802104 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1982/3984] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:30 2022] POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action => generated 32628 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:01:31.220366 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-1b6a63ad-abff-4a7f-9dbd-497fc9115e1d tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:31.221350 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-1b6a63ad-abff-4a7f-9dbd-497fc9115e1d tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] [instance: 1c4fc198-0d0c-44d3-8add-e663bd22d35a] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:31.230898 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1b6a63ad-abff-4a7f-9dbd-497fc9115e1d tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:31.231426 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1b6a63ad-abff-4a7f-9dbd-497fc9115e1d tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:31.232411 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1b6a63ad-abff-4a7f-9dbd-497fc9115e1d tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:31.233754 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1b6a63ad-abff-4a7f-9dbd-497fc9115e1d tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:31.342688 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-958a17cb-ea29-4c26-9b8d-2734d38afb13 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:31.344098 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-958a17cb-ea29-4c26-9b8d-2734d38afb13 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:31.357121 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-958a17cb-ea29-4c26-9b8d-2734d38afb13 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:31.357121 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-958a17cb-ea29-4c26-9b8d-2734d38afb13 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:31.358653 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-958a17cb-ea29-4c26-9b8d-2734d38afb13 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:31.359124 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-958a17cb-ea29-4c26-9b8d-2734d38afb13 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:31.423847 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-958a17cb-ea29-4c26-9b8d-2734d38afb13 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action" status: 200 len: 24508 microversion: 2.1 time: 0.093865 Jan 15 21:01:31.426026 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1983/3985] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:01:31 2022] POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action => generated 24508 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 21:01:31.430580 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-1b6a63ad-abff-4a7f-9dbd-497fc9115e1d tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5688424f63d04fb5bef4b79eb08546eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06185565206e41dca051d568bd18a082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:31.431571 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ae1c4d28-5f65-4865-85e2-7c818980ece8 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:31.432834 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ae1c4d28-5f65-4865-85e2-7c818980ece8 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:31.440603 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-1b6a63ad-abff-4a7f-9dbd-497fc9115e1d tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] 10.222.0.46 "GET /compute/v2.1/servers/1c4fc198-0d0c-44d3-8add-e663bd22d35a" status: 200 len: 1324 microversion: 2.1 time: 0.224999 Jan 15 21:01:31.441642 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2003/3986] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:31 2022] GET /compute/v2.1/servers/1c4fc198-0d0c-44d3-8add-e663bd22d35a => generated 1324 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:31.441822 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ae1c4d28-5f65-4865-85e2-7c818980ece8 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:31.442366 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ae1c4d28-5f65-4865-85e2-7c818980ece8 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:31.443181 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ae1c4d28-5f65-4865-85e2-7c818980ece8 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:31.443616 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ae1c4d28-5f65-4865-85e2-7c818980ece8 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:31.446882 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-39c7b324-0e96-4acb-bce3-4dd23f6f959d tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:31.447486 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-39c7b324-0e96-4acb-bce3-4dd23f6f959d tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 11cbafd5-4836-48b9-8db6-440002deb281] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:31.454373 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-39c7b324-0e96-4acb-bce3-4dd23f6f959d tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:31.454800 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-39c7b324-0e96-4acb-bce3-4dd23f6f959d tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:31.455885 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-39c7b324-0e96-4acb-bce3-4dd23f6f959d tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:31.456572 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-39c7b324-0e96-4acb-bce3-4dd23f6f959d tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:31.504159 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ae1c4d28-5f65-4865-85e2-7c818980ece8 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 24546 microversion: 2.32 time: 0.076188 Jan 15 21:01:31.507227 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1984/3987] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:31 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 24546 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:01:31.541338 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-39c7b324-0e96-4acb-bce3-4dd23f6f959d tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:31.552463 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-39c7b324-0e96-4acb-bce3-4dd23f6f959d tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/11cbafd5-4836-48b9-8db6-440002deb281" status: 200 len: 1267 microversion: 2.1 time: 0.109053 Jan 15 21:01:31.553875 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2004/3988] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:31 2022] GET /compute/v2.1/servers/11cbafd5-4836-48b9-8db6-440002deb281 => generated 1267 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:31.668912 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e9db524a-ca35-4989-93f5-69d633b53f2d tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:31.670096 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e9db524a-ca35-4989-93f5-69d633b53f2d tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: f437ed26-18bf-4cd8-b804-da114755f27e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:31.679665 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e9db524a-ca35-4989-93f5-69d633b53f2d tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:31.680157 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e9db524a-ca35-4989-93f5-69d633b53f2d tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:31.681447 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e9db524a-ca35-4989-93f5-69d633b53f2d tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:31.681832 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e9db524a-ca35-4989-93f5-69d633b53f2d tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:31.722132 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ffe0c1b3-ce45-4408-abc2-ce761f78f03e tempest-VolumesSnapshotsTestJSON-502917034 tempest-VolumesSnapshotsTestJSON-502917034-project] Calling method '.version_select at 0x7f30c8df0040>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:31.761221 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-ffe0c1b3-ce45-4408-abc2-ce761f78f03e tempest-VolumesSnapshotsTestJSON-502917034 tempest-VolumesSnapshotsTestJSON-502917034-project] HTTP exception thrown: Snapshot 1cda52b6-7abd-4e85-b049-45674f789a78 could not be found. Jan 15 21:01:31.763429 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ffe0c1b3-ce45-4408-abc2-ce761f78f03e tempest-VolumesSnapshotsTestJSON-502917034 tempest-VolumesSnapshotsTestJSON-502917034-project] Returning 404 to user: Snapshot 1cda52b6-7abd-4e85-b049-45674f789a78 could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:01:31.765353 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ffe0c1b3-ce45-4408-abc2-ce761f78f03e tempest-VolumesSnapshotsTestJSON-502917034 tempest-VolumesSnapshotsTestJSON-502917034-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/1cda52b6-7abd-4e85-b049-45674f789a78" status: 404 len: 111 microversion: 2.1 time: 0.053309 Jan 15 21:01:31.767650 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2005/3989] 10.222.0.46 () {58 vars in 1250 bytes} [Sat Jan 15 21:01:31 2022] GET /compute/v2.1/os-snapshots/1cda52b6-7abd-4e85-b049-45674f789a78 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 15 21:01:31.776006 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e98c0071-9429-4f55-9937-705d054bdc40 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:31.777912 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e98c0071-9429-4f55-9937-705d054bdc40 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:31.787548 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e98c0071-9429-4f55-9937-705d054bdc40 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:31.797784 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e98c0071-9429-4f55-9937-705d054bdc40 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:31.809223 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e98c0071-9429-4f55-9937-705d054bdc40 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:31.810454 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e98c0071-9429-4f55-9937-705d054bdc40 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:31.862737 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-e9db524a-ca35-4989-93f5-69d633b53f2d tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8f9c6ea7f6496792258d683640c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a75218d537c4d63874297261bec70ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:31.863509 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e98c0071-9429-4f55-9937-705d054bdc40 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.092863 Jan 15 21:01:31.865028 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2006/3990] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:31 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:01:31.869958 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e29e5eff-aac7-40f0-8352-329915f68b9f tempest-VolumesSnapshotsTestJSON-502917034 tempest-VolumesSnapshotsTestJSON-502917034-project] Calling method '.version_select at 0x7f30ceb58e50>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:31.875877 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e9db524a-ca35-4989-93f5-69d633b53f2d tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] 10.222.0.46 "GET /compute/v2.1/servers/f437ed26-18bf-4cd8-b804-da114755f27e" status: 200 len: 1318 microversion: 2.1 time: 0.212420 Jan 15 21:01:31.881754 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1985/3991] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:31 2022] GET /compute/v2.1/servers/f437ed26-18bf-4cd8-b804-da114755f27e => generated 1318 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:31.893782 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ee10be46-8520-4f61-b276-f2ac6d4ba4db tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:31.895215 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ee10be46-8520-4f61-b276-f2ac6d4ba4db tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:31.903312 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ee10be46-8520-4f61-b276-f2ac6d4ba4db tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:31.904208 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ee10be46-8520-4f61-b276-f2ac6d4ba4db tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:31.904826 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ee10be46-8520-4f61-b276-f2ac6d4ba4db tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:31.906087 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ee10be46-8520-4f61-b276-f2ac6d4ba4db tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:31.972761 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e29e5eff-aac7-40f0-8352-329915f68b9f tempest-VolumesSnapshotsTestJSON-502917034 tempest-VolumesSnapshotsTestJSON-502917034-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/428ecd34-edb8-4c5b-a0ef-792f33a44f46" status: 202 len: 0 microversion: 2.1 time: 0.103231 Jan 15 21:01:31.973065 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2007/3992] 10.222.0.46 () {58 vars in 1247 bytes} [Sat Jan 15 21:01:31 2022] DELETE /compute/v2.1/os-volumes/428ecd34-edb8-4c5b-a0ef-792f33a44f46 => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:01:31.979299 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ee10be46-8520-4f61-b276-f2ac6d4ba4db tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action" status: 200 len: 32628 microversion: 2.20 time: 0.095722 Jan 15 21:01:31.980311 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1986/3993] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:31 2022] POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action => generated 32628 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:01:31.982415 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-de751b9f-edd4-47f1-989a-320d7282ad61 tempest-VolumesSnapshotsTestJSON-502917034 tempest-VolumesSnapshotsTestJSON-502917034-project] Calling method '.version_select at 0x7f30ceb79f70>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:32.053672 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-de751b9f-edd4-47f1-989a-320d7282ad61 tempest-VolumesSnapshotsTestJSON-502917034 tempest-VolumesSnapshotsTestJSON-502917034-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/428ecd34-edb8-4c5b-a0ef-792f33a44f46" status: 200 len: 338 microversion: 2.1 time: 0.075086 Jan 15 21:01:32.053872 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2008/3994] 10.222.0.46 () {58 vars in 1244 bytes} [Sat Jan 15 21:01:31 2022] GET /compute/v2.1/os-volumes/428ecd34-edb8-4c5b-a0ef-792f33a44f46 => generated 338 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 21:01:32.282865 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-3439c7cf-88b3-4131-9188-47e105672b7f req-d100d1fc-dae6-46ae-899d-7837c63c0ecb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f437ed26-18bf-4cd8-b804-da114755f27e", "tag": "f665537c-6da1-4935-8603-6f099be4c06c"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:32.286579 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:01:32.286579 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:01:32.299934 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-3439c7cf-88b3-4131-9188-47e105672b7f req-d100d1fc-dae6-46ae-899d-7837c63c0ecb service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:32.300632 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-3439c7cf-88b3-4131-9188-47e105672b7f req-d100d1fc-dae6-46ae-899d-7837c63c0ecb service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:32.319937 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-3439c7cf-88b3-4131-9188-47e105672b7f req-d100d1fc-dae6-46ae-899d-7837c63c0ecb service nova] Creating event network-changed:f665537c-6da1-4935-8603-6f099be4c06c for instance f437ed26-18bf-4cd8-b804-da114755f27e on nch2-master-1 Jan 15 21:01:32.328442 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-3439c7cf-88b3-4131-9188-47e105672b7f req-d100d1fc-dae6-46ae-899d-7837c63c0ecb service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051001 Jan 15 21:01:32.331364 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1987/3995] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:01:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:01:32.440263 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-48237728-50b9-49c6-9d35-c2af9cffc8de tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:32.441623 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-48237728-50b9-49c6-9d35-c2af9cffc8de tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:32.450967 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-48237728-50b9-49c6-9d35-c2af9cffc8de tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:32.452760 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-48237728-50b9-49c6-9d35-c2af9cffc8de tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:32.461718 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ecc39d0e-b722-4b65-9d71-0be2c88dc752 tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:32.462566 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ecc39d0e-b722-4b65-9d71-0be2c88dc752 tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] [instance: 1c4fc198-0d0c-44d3-8add-e663bd22d35a] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:32.465423 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-48237728-50b9-49c6-9d35-c2af9cffc8de tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:32.465983 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-48237728-50b9-49c6-9d35-c2af9cffc8de tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:32.476032 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ecc39d0e-b722-4b65-9d71-0be2c88dc752 tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:32.477837 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ecc39d0e-b722-4b65-9d71-0be2c88dc752 tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:32.478980 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ecc39d0e-b722-4b65-9d71-0be2c88dc752 tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:32.480473 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ecc39d0e-b722-4b65-9d71-0be2c88dc752 tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:32.523278 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-48237728-50b9-49c6-9d35-c2af9cffc8de tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action" status: 200 len: 24508 microversion: 2.1 time: 0.088640 Jan 15 21:01:32.524042 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2009/3996] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:01:32 2022] POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action => generated 24508 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 21:01:32.533971 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f0595644-cfd1-4a26-a97f-13d21b03dafa tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:32.536063 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f0595644-cfd1-4a26-a97f-13d21b03dafa tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:32.548632 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f0595644-cfd1-4a26-a97f-13d21b03dafa tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:32.550280 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f0595644-cfd1-4a26-a97f-13d21b03dafa tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:32.552021 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f0595644-cfd1-4a26-a97f-13d21b03dafa tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:32.552468 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f0595644-cfd1-4a26-a97f-13d21b03dafa tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:32.625178 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f0595644-cfd1-4a26-a97f-13d21b03dafa tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 24546 microversion: 2.32 time: 0.099260 Jan 15 21:01:32.632324 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2010/3997] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:32 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 24546 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:01:32.640330 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-0cca010c-587f-4c44-ac20-d8570ba47811 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:32.641158 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-0cca010c-587f-4c44-ac20-d8570ba47811 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 11cbafd5-4836-48b9-8db6-440002deb281] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:32.649050 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0cca010c-587f-4c44-ac20-d8570ba47811 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:32.649764 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0cca010c-587f-4c44-ac20-d8570ba47811 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:32.650711 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0cca010c-587f-4c44-ac20-d8570ba47811 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:32.651305 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0cca010c-587f-4c44-ac20-d8570ba47811 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:32.705290 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-ecc39d0e-b722-4b65-9d71-0be2c88dc752 tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5688424f63d04fb5bef4b79eb08546eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06185565206e41dca051d568bd18a082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:32.718246 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ecc39d0e-b722-4b65-9d71-0be2c88dc752 tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] 10.222.0.46 "GET /compute/v2.1/servers/1c4fc198-0d0c-44d3-8add-e663bd22d35a" status: 200 len: 1324 microversion: 2.1 time: 0.262565 Jan 15 21:01:32.718832 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1988/3998] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:32 2022] GET /compute/v2.1/servers/1c4fc198-0d0c-44d3-8add-e663bd22d35a => generated 1324 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:32.755594 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-0cca010c-587f-4c44-ac20-d8570ba47811 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:32.766832 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-0cca010c-587f-4c44-ac20-d8570ba47811 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/11cbafd5-4836-48b9-8db6-440002deb281" status: 200 len: 1273 microversion: 2.1 time: 0.132344 Jan 15 21:01:32.769733 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2011/3999] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:32 2022] GET /compute/v2.1/servers/11cbafd5-4836-48b9-8db6-440002deb281 => generated 1273 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:32.877835 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-977793b8-a350-4d85-83bb-c120c5b4bb7b tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:32.879754 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-977793b8-a350-4d85-83bb-c120c5b4bb7b tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:32.886478 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-977793b8-a350-4d85-83bb-c120c5b4bb7b tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:32.887032 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-977793b8-a350-4d85-83bb-c120c5b4bb7b tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:32.887715 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-977793b8-a350-4d85-83bb-c120c5b4bb7b tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:32.888559 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-977793b8-a350-4d85-83bb-c120c5b4bb7b tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:32.896486 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2b0221d1-47f9-4610-b9b4-33b90e27c7c8 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:32.900134 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-2b0221d1-47f9-4610-b9b4-33b90e27c7c8 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: f437ed26-18bf-4cd8-b804-da114755f27e] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:32.906702 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2b0221d1-47f9-4610-b9b4-33b90e27c7c8 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:32.907374 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2b0221d1-47f9-4610-b9b4-33b90e27c7c8 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:32.908345 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2b0221d1-47f9-4610-b9b4-33b90e27c7c8 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:32.909643 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2b0221d1-47f9-4610-b9b4-33b90e27c7c8 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:32.943161 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-977793b8-a350-4d85-83bb-c120c5b4bb7b tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.071061 Jan 15 21:01:32.944353 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1989/4000] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:32 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:01:32.992703 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-989bc15d-d9a2-4438-a621-e399342e0d78 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:32.994037 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-989bc15d-d9a2-4438-a621-e399342e0d78 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:33.001109 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-989bc15d-d9a2-4438-a621-e399342e0d78 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:33.001559 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-989bc15d-d9a2-4438-a621-e399342e0d78 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:33.002378 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-989bc15d-d9a2-4438-a621-e399342e0d78 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:33.002816 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-989bc15d-d9a2-4438-a621-e399342e0d78 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:33.047101 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-989bc15d-d9a2-4438-a621-e399342e0d78 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action" status: 200 len: 32628 microversion: 2.20 time: 0.058293 Jan 15 21:01:33.048742 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1990/4001] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:32 2022] POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action => generated 32628 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:01:33.068064 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-746738dd-6956-4b27-a6f6-7c465aee151b tempest-VolumesSnapshotsTestJSON-502917034 tempest-VolumesSnapshotsTestJSON-502917034-project] Calling method '.version_select at 0x7f30cec0a820>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:33.093808 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-2b0221d1-47f9-4610-b9b4-33b90e27c7c8 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8f9c6ea7f6496792258d683640c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a75218d537c4d63874297261bec70ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:33.104715 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2b0221d1-47f9-4610-b9b4-33b90e27c7c8 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] 10.222.0.46 "GET /compute/v2.1/servers/f437ed26-18bf-4cd8-b804-da114755f27e" status: 200 len: 1318 microversion: 2.1 time: 0.212786 Jan 15 21:01:33.115898 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2012/4002] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:32 2022] GET /compute/v2.1/servers/f437ed26-18bf-4cd8-b804-da114755f27e => generated 1318 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:01:33.125373 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-746738dd-6956-4b27-a6f6-7c465aee151b tempest-VolumesSnapshotsTestJSON-502917034 tempest-VolumesSnapshotsTestJSON-502917034-project] HTTP exception thrown: Volume 428ecd34-edb8-4c5b-a0ef-792f33a44f46 could not be found. Jan 15 21:01:33.126727 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-746738dd-6956-4b27-a6f6-7c465aee151b tempest-VolumesSnapshotsTestJSON-502917034 tempest-VolumesSnapshotsTestJSON-502917034-project] Returning 404 to user: Volume 428ecd34-edb8-4c5b-a0ef-792f33a44f46 could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:01:33.127853 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-746738dd-6956-4b27-a6f6-7c465aee151b tempest-VolumesSnapshotsTestJSON-502917034 tempest-VolumesSnapshotsTestJSON-502917034-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/428ecd34-edb8-4c5b-a0ef-792f33a44f46" status: 404 len: 109 microversion: 2.1 time: 0.064947 Jan 15 21:01:33.128460 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1991/4003] 10.222.0.46 () {58 vars in 1244 bytes} [Sat Jan 15 21:01:33 2022] GET /compute/v2.1/os-volumes/428ecd34-edb8-4c5b-a0ef-792f33a44f46 => generated 109 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:01:33.137595 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-cdb9c660-2553-4c1e-90f7-70a358d5b66e tempest-VolumesSnapshotsTestJSON-502917034 tempest-VolumesSnapshotsTestJSON-502917034-project] Calling method '.version_select at 0x7f30ceb5e1f0>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:33.170934 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-cdb9c660-2553-4c1e-90f7-70a358d5b66e tempest-VolumesSnapshotsTestJSON-502917034 tempest-VolumesSnapshotsTestJSON-502917034-project] HTTP exception thrown: Volume 428ecd34-edb8-4c5b-a0ef-792f33a44f46 could not be found. Jan 15 21:01:33.171533 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-cdb9c660-2553-4c1e-90f7-70a358d5b66e tempest-VolumesSnapshotsTestJSON-502917034 tempest-VolumesSnapshotsTestJSON-502917034-project] Returning 404 to user: Volume 428ecd34-edb8-4c5b-a0ef-792f33a44f46 could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:01:33.172366 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-cdb9c660-2553-4c1e-90f7-70a358d5b66e tempest-VolumesSnapshotsTestJSON-502917034 tempest-VolumesSnapshotsTestJSON-502917034-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/428ecd34-edb8-4c5b-a0ef-792f33a44f46" status: 404 len: 109 microversion: 2.1 time: 0.038625 Jan 15 21:01:33.173102 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2013/4004] 10.222.0.46 () {58 vars in 1247 bytes} [Sat Jan 15 21:01:33 2022] DELETE /compute/v2.1/os-volumes/428ecd34-edb8-4c5b-a0ef-792f33a44f46 => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:01:33.183205 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ba14bb1a-ca14-4b05-b4e1-6e1561f7c416 tempest-VolumesSnapshotsTestJSON-502917034 tempest-VolumesSnapshotsTestJSON-502917034-project] Calling method '.version_select at 0x7f30ced31700>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:33.211875 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-ba14bb1a-ca14-4b05-b4e1-6e1561f7c416 tempest-VolumesSnapshotsTestJSON-502917034 tempest-VolumesSnapshotsTestJSON-502917034-project] HTTP exception thrown: Volume 428ecd34-edb8-4c5b-a0ef-792f33a44f46 could not be found. Jan 15 21:01:33.212466 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ba14bb1a-ca14-4b05-b4e1-6e1561f7c416 tempest-VolumesSnapshotsTestJSON-502917034 tempest-VolumesSnapshotsTestJSON-502917034-project] Returning 404 to user: Volume 428ecd34-edb8-4c5b-a0ef-792f33a44f46 could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:01:33.214012 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ba14bb1a-ca14-4b05-b4e1-6e1561f7c416 tempest-VolumesSnapshotsTestJSON-502917034 tempest-VolumesSnapshotsTestJSON-502917034-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/428ecd34-edb8-4c5b-a0ef-792f33a44f46" status: 404 len: 109 microversion: 2.1 time: 0.035501 Jan 15 21:01:33.217507 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1992/4005] 10.222.0.46 () {58 vars in 1244 bytes} [Sat Jan 15 21:01:33 2022] GET /compute/v2.1/os-volumes/428ecd34-edb8-4c5b-a0ef-792f33a44f46 => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:01:33.537748 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b5e6560f-b0e2-4eb4-b287-068b526fd4bd tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:33.539182 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b5e6560f-b0e2-4eb4-b287-068b526fd4bd tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:33.547995 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b5e6560f-b0e2-4eb4-b287-068b526fd4bd tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:33.549781 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b5e6560f-b0e2-4eb4-b287-068b526fd4bd tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:33.551093 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b5e6560f-b0e2-4eb4-b287-068b526fd4bd tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:33.551770 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b5e6560f-b0e2-4eb4-b287-068b526fd4bd tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:33.599823 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b5e6560f-b0e2-4eb4-b287-068b526fd4bd tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action" status: 200 len: 24508 microversion: 2.1 time: 0.068103 Jan 15 21:01:33.601316 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2014/4006] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:01:33 2022] POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action => generated 24508 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:01:33.645623 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c49cb457-3bc4-4791-be1b-1d7d5c53c113 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:33.646732 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c49cb457-3bc4-4791-be1b-1d7d5c53c113 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:33.654299 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c49cb457-3bc4-4791-be1b-1d7d5c53c113 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:33.654766 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c49cb457-3bc4-4791-be1b-1d7d5c53c113 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:33.655565 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c49cb457-3bc4-4791-be1b-1d7d5c53c113 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:33.656232 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c49cb457-3bc4-4791-be1b-1d7d5c53c113 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:33.710002 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c49cb457-3bc4-4791-be1b-1d7d5c53c113 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 24546 microversion: 2.32 time: 0.068800 Jan 15 21:01:33.711544 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1993/4007] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:33 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 24546 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:01:33.743196 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-05482ffd-147d-4eaa-abd6-62ae930f5cfa tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:33.743902 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-05482ffd-147d-4eaa-abd6-62ae930f5cfa tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] [instance: 1c4fc198-0d0c-44d3-8add-e663bd22d35a] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:33.752600 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-05482ffd-147d-4eaa-abd6-62ae930f5cfa tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:33.753220 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-05482ffd-147d-4eaa-abd6-62ae930f5cfa tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:33.754555 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-05482ffd-147d-4eaa-abd6-62ae930f5cfa tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:33.755635 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-05482ffd-147d-4eaa-abd6-62ae930f5cfa tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:33.788890 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c4b036fd-a82a-4346-b0c5-e7a35d022b32 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:33.790084 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c4b036fd-a82a-4346-b0c5-e7a35d022b32 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 11cbafd5-4836-48b9-8db6-440002deb281] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:33.804245 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c4b036fd-a82a-4346-b0c5-e7a35d022b32 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:33.805714 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c4b036fd-a82a-4346-b0c5-e7a35d022b32 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:33.806908 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c4b036fd-a82a-4346-b0c5-e7a35d022b32 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:33.807610 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c4b036fd-a82a-4346-b0c5-e7a35d022b32 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:34.096979 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-05482ffd-147d-4eaa-abd6-62ae930f5cfa tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5688424f63d04fb5bef4b79eb08546eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06185565206e41dca051d568bd18a082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:34.108872 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-05482ffd-147d-4eaa-abd6-62ae930f5cfa tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] 10.222.0.46 "GET /compute/v2.1/servers/1c4fc198-0d0c-44d3-8add-e663bd22d35a" status: 200 len: 1324 microversion: 2.1 time: 0.369569 Jan 15 21:01:34.110263 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2015/4008] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:33 2022] GET /compute/v2.1/servers/1c4fc198-0d0c-44d3-8add-e663bd22d35a => generated 1324 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:34.115292 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-bfaa96e5-ea62-4f0c-9c4b-fec79002fcb3 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:34.116490 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-bfaa96e5-ea62-4f0c-9c4b-fec79002fcb3 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:34.142824 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bfaa96e5-ea62-4f0c-9c4b-fec79002fcb3 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:34.144602 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bfaa96e5-ea62-4f0c-9c4b-fec79002fcb3 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:34.146355 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bfaa96e5-ea62-4f0c-9c4b-fec79002fcb3 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:34.152374 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bfaa96e5-ea62-4f0c-9c4b-fec79002fcb3 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:34.171158 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-c4b036fd-a82a-4346-b0c5-e7a35d022b32 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:34.192470 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c4b036fd-a82a-4346-b0c5-e7a35d022b32 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/11cbafd5-4836-48b9-8db6-440002deb281" status: 200 len: 1315 microversion: 2.1 time: 0.410681 Jan 15 21:01:34.205703 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1994/4009] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:33 2022] GET /compute/v2.1/servers/11cbafd5-4836-48b9-8db6-440002deb281 => generated 1315 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:34.215242 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-561a9a6d-d7a9-4dbc-a6dd-6c49651b1dbd tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:34.217318 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-561a9a6d-d7a9-4dbc-a6dd-6c49651b1dbd tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:34.229335 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-bfaa96e5-ea62-4f0c-9c4b-fec79002fcb3 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.117468 Jan 15 21:01:34.230970 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2016/4010] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:34 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:01:34.243202 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-561a9a6d-d7a9-4dbc-a6dd-6c49651b1dbd tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:34.244395 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-561a9a6d-d7a9-4dbc-a6dd-6c49651b1dbd tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:34.245322 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-561a9a6d-d7a9-4dbc-a6dd-6c49651b1dbd tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:34.246193 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-7603030f-7878-4db8-b120-85ec41075415 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:34.247072 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-561a9a6d-d7a9-4dbc-a6dd-6c49651b1dbd tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:34.247702 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-7603030f-7878-4db8-b120-85ec41075415 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: f437ed26-18bf-4cd8-b804-da114755f27e] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:34.269263 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7603030f-7878-4db8-b120-85ec41075415 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:34.269263 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7603030f-7878-4db8-b120-85ec41075415 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:34.270466 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7603030f-7878-4db8-b120-85ec41075415 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:34.273234 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7603030f-7878-4db8-b120-85ec41075415 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:34.342862 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-561a9a6d-d7a9-4dbc-a6dd-6c49651b1dbd tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action" status: 200 len: 32628 microversion: 2.20 time: 0.134494 Jan 15 21:01:34.344822 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1995/4011] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:34 2022] POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action => generated 32628 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:01:34.537788 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-8f427956-e656-43f7-a05d-872af6933058 req-e3a33479-8507-4d0c-8bba-41fd6319f054 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11cbafd5-4836-48b9-8db6-440002deb281", "tag": "f19de7c9-cb20-4177-abf7-73605a4d6a80"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:34.547684 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:01:34.547684 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:01:34.558112 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-7603030f-7878-4db8-b120-85ec41075415 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8f9c6ea7f6496792258d683640c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a75218d537c4d63874297261bec70ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:34.571447 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-8f427956-e656-43f7-a05d-872af6933058 req-e3a33479-8507-4d0c-8bba-41fd6319f054 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:34.572646 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-8f427956-e656-43f7-a05d-872af6933058 req-e3a33479-8507-4d0c-8bba-41fd6319f054 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:34.576535 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-7603030f-7878-4db8-b120-85ec41075415 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] 10.222.0.46 "GET /compute/v2.1/servers/f437ed26-18bf-4cd8-b804-da114755f27e" status: 200 len: 1318 microversion: 2.1 time: 0.343137 Jan 15 21:01:34.577666 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2017/4012] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:34 2022] GET /compute/v2.1/servers/f437ed26-18bf-4cd8-b804-da114755f27e => generated 1318 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:34.619299 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9e5cf2d2-c688-4f4c-b22d-103f60ac231d tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:34.621377 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-9e5cf2d2-c688-4f4c-b22d-103f60ac231d tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:34.628942 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-8f427956-e656-43f7-a05d-872af6933058 req-e3a33479-8507-4d0c-8bba-41fd6319f054 service nova] Creating event network-changed:f19de7c9-cb20-4177-abf7-73605a4d6a80 for instance 11cbafd5-4836-48b9-8db6-440002deb281 on nch1-master-1 Jan 15 21:01:34.632528 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9e5cf2d2-c688-4f4c-b22d-103f60ac231d tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:34.633768 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9e5cf2d2-c688-4f4c-b22d-103f60ac231d tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:34.634866 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9e5cf2d2-c688-4f4c-b22d-103f60ac231d tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:34.635715 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9e5cf2d2-c688-4f4c-b22d-103f60ac231d tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:34.641425 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-8f427956-e656-43f7-a05d-872af6933058 req-e3a33479-8507-4d0c-8bba-41fd6319f054 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127868 Jan 15 21:01:34.642507 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1996/4013] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:01:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:01:34.724134 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-fe03525c-3ba0-4c34-b6b6-958cd94e2f11 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:34.725186 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-fe03525c-3ba0-4c34-b6b6-958cd94e2f11 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:34.732710 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-9e5cf2d2-c688-4f4c-b22d-103f60ac231d tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action" status: 200 len: 24508 microversion: 2.1 time: 0.121557 Jan 15 21:01:34.734467 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2018/4014] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:01:34 2022] POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action => generated 24508 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:01:34.746865 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fe03525c-3ba0-4c34-b6b6-958cd94e2f11 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:34.747204 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fe03525c-3ba0-4c34-b6b6-958cd94e2f11 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:34.748016 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fe03525c-3ba0-4c34-b6b6-958cd94e2f11 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:34.748458 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fe03525c-3ba0-4c34-b6b6-958cd94e2f11 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:34.772554 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-7d612b0b-df1b-4414-b1e0-8bb551d70d5c req-404b1b63-4dfb-47c8-8cfb-a9213683552f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c4fc198-0d0c-44d3-8add-e663bd22d35a", "name": "network-vif-plugged", "status": "completed", "tag": "9fa19225-1fe7-4da0-8e05-a2d51660efa1"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:34.776968 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:01:34.776968 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:01:34.797150 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-7d612b0b-df1b-4414-b1e0-8bb551d70d5c req-404b1b63-4dfb-47c8-8cfb-a9213683552f service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:34.797656 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-7d612b0b-df1b-4414-b1e0-8bb551d70d5c req-404b1b63-4dfb-47c8-8cfb-a9213683552f service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:34.817240 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-fe03525c-3ba0-4c34-b6b6-958cd94e2f11 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 24546 microversion: 2.32 time: 0.098610 Jan 15 21:01:34.823176 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1997/4015] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:34 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 24546 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:01:34.834295 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-7d612b0b-df1b-4414-b1e0-8bb551d70d5c req-404b1b63-4dfb-47c8-8cfb-a9213683552f service nova] Creating event network-vif-plugged:9fa19225-1fe7-4da0-8e05-a2d51660efa1 for instance 1c4fc198-0d0c-44d3-8add-e663bd22d35a on nch2-master-1 Jan 15 21:01:34.842687 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-7d612b0b-df1b-4414-b1e0-8bb551d70d5c req-404b1b63-4dfb-47c8-8cfb-a9213683552f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076528 Jan 15 21:01:34.843693 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2019/4016] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:01:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:01:35.129997 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-db9ac6db-da87-4574-bb96-1148dcd2800c tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:35.131144 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-db9ac6db-da87-4574-bb96-1148dcd2800c tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] [instance: 1c4fc198-0d0c-44d3-8add-e663bd22d35a] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:35.142344 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-db9ac6db-da87-4574-bb96-1148dcd2800c tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:35.145010 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-db9ac6db-da87-4574-bb96-1148dcd2800c tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:35.147069 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-db9ac6db-da87-4574-bb96-1148dcd2800c tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:35.147749 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-db9ac6db-da87-4574-bb96-1148dcd2800c tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:35.214331 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8492bcf9-46d9-4b84-a080-563eb291277b tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:35.216301 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-8492bcf9-46d9-4b84-a080-563eb291277b tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 11cbafd5-4836-48b9-8db6-440002deb281] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:35.238720 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8492bcf9-46d9-4b84-a080-563eb291277b tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:35.240019 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8492bcf9-46d9-4b84-a080-563eb291277b tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:35.243844 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8492bcf9-46d9-4b84-a080-563eb291277b tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:35.245995 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8492bcf9-46d9-4b84-a080-563eb291277b tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:35.415808 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-db9ac6db-da87-4574-bb96-1148dcd2800c tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5688424f63d04fb5bef4b79eb08546eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06185565206e41dca051d568bd18a082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:35.434841 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-db9ac6db-da87-4574-bb96-1148dcd2800c tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] 10.222.0.46 "GET /compute/v2.1/servers/1c4fc198-0d0c-44d3-8add-e663bd22d35a" status: 200 len: 1324 microversion: 2.1 time: 0.311311 Jan 15 21:01:35.446095 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1998/4017] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:35 2022] GET /compute/v2.1/servers/1c4fc198-0d0c-44d3-8add-e663bd22d35a => generated 1324 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:35.451304 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e94d5768-7c98-439d-b9e4-784bab6c8405 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:35.452276 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e94d5768-7c98-439d-b9e4-784bab6c8405 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:35.464520 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e94d5768-7c98-439d-b9e4-784bab6c8405 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:35.465041 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e94d5768-7c98-439d-b9e4-784bab6c8405 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:35.465819 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e94d5768-7c98-439d-b9e4-784bab6c8405 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:35.466268 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e94d5768-7c98-439d-b9e4-784bab6c8405 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:35.497295 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-8492bcf9-46d9-4b84-a080-563eb291277b tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:35.506662 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-8492bcf9-46d9-4b84-a080-563eb291277b tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/11cbafd5-4836-48b9-8db6-440002deb281" status: 200 len: 1315 microversion: 2.1 time: 0.298465 Jan 15 21:01:35.508164 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2020/4018] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:35 2022] GET /compute/v2.1/servers/11cbafd5-4836-48b9-8db6-440002deb281 => generated 1315 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:35.512996 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ac039615-ead5-4c81-84f4-372357cf46b5 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:35.513957 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ac039615-ead5-4c81-84f4-372357cf46b5 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:35.521747 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ac039615-ead5-4c81-84f4-372357cf46b5 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:35.522369 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ac039615-ead5-4c81-84f4-372357cf46b5 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:35.523435 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ac039615-ead5-4c81-84f4-372357cf46b5 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:35.524042 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ac039615-ead5-4c81-84f4-372357cf46b5 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:35.526130 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e94d5768-7c98-439d-b9e4-784bab6c8405 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.077177 Jan 15 21:01:35.526540 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 1999/4019] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:35 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:01:35.574528 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ac039615-ead5-4c81-84f4-372357cf46b5 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action" status: 200 len: 32628 microversion: 2.20 time: 0.064982 Jan 15 21:01:35.576322 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2021/4020] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:35 2022] POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action => generated 32628 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:01:35.597429 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f44aa2f7-996a-46f4-a46f-b5b04f29cf56 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:35.598204 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f44aa2f7-996a-46f4-a46f-b5b04f29cf56 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: f437ed26-18bf-4cd8-b804-da114755f27e] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:35.605432 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f44aa2f7-996a-46f4-a46f-b5b04f29cf56 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:35.605889 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f44aa2f7-996a-46f4-a46f-b5b04f29cf56 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:35.606693 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f44aa2f7-996a-46f4-a46f-b5b04f29cf56 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:35.607214 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f44aa2f7-996a-46f4-a46f-b5b04f29cf56 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:35.683484 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d0e8b573-2466-4254-8e9e-5b47df9a6587 tempest-VolumesGetTestJSON-1089060493 tempest-VolumesGetTestJSON-1089060493-project] Action: 'create', calling method: .version_select at 0x7f30ceb7a1f0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-861683177", "metadata": {"Type": "work"}}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:35.764488 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-f44aa2f7-996a-46f4-a46f-b5b04f29cf56 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8f9c6ea7f6496792258d683640c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a75218d537c4d63874297261bec70ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:35.773478 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f44aa2f7-996a-46f4-a46f-b5b04f29cf56 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] 10.222.0.46 "GET /compute/v2.1/servers/f437ed26-18bf-4cd8-b804-da114755f27e" status: 200 len: 1318 microversion: 2.1 time: 0.181403 Jan 15 21:01:35.782750 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2022/4021] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:35 2022] GET /compute/v2.1/servers/f437ed26-18bf-4cd8-b804-da114755f27e => generated 1318 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:01:35.787934 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ef96113b-6ff6-420b-b67e-4fcf92d2cde1 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:35.788935 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ef96113b-6ff6-420b-b67e-4fcf92d2cde1 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:35.795743 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ef96113b-6ff6-420b-b67e-4fcf92d2cde1 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:35.796190 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ef96113b-6ff6-420b-b67e-4fcf92d2cde1 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:35.797018 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ef96113b-6ff6-420b-b67e-4fcf92d2cde1 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:35.798285 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ef96113b-6ff6-420b-b67e-4fcf92d2cde1 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:35.848064 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ef96113b-6ff6-420b-b67e-4fcf92d2cde1 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action" status: 200 len: 24508 microversion: 2.1 time: 0.072360 Jan 15 21:01:35.849202 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2023/4022] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:01:35 2022] POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action => generated 24508 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:01:35.854530 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5ac4b49f-175c-4294-b193-492971430ffc tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:35.855706 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-5ac4b49f-175c-4294-b193-492971430ffc tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:35.863362 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5ac4b49f-175c-4294-b193-492971430ffc tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:35.863939 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5ac4b49f-175c-4294-b193-492971430ffc tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:35.864764 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5ac4b49f-175c-4294-b193-492971430ffc tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:35.865722 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5ac4b49f-175c-4294-b193-492971430ffc tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:35.921236 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5ac4b49f-175c-4294-b193-492971430ffc tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 24546 microversion: 2.32 time: 0.070410 Jan 15 21:01:35.923311 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2024/4023] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:35 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 24546 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:01:36.029968 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d0e8b573-2466-4254-8e9e-5b47df9a6587 tempest-VolumesGetTestJSON-1089060493 tempest-VolumesGetTestJSON-1089060493-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.498406 Jan 15 21:01:36.030562 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2000/4024] 10.222.0.46 () {60 vars in 1155 bytes} [Sat Jan 15 21:01:35 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 500 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jan 15 21:01:36.045177 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a8b3be96-adfa-4811-85a5-2edf3588107c tempest-VolumesGetTestJSON-1089060493 tempest-VolumesGetTestJSON-1089060493-project] Calling method '.version_select at 0x7f30c8535550>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:36.110994 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a8b3be96-adfa-4811-85a5-2edf3588107c tempest-VolumesGetTestJSON-1089060493 tempest-VolumesGetTestJSON-1089060493-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/1d85839d-98dd-473c-bc4b-0dabce6a2d62" status: 200 len: 345 microversion: 2.1 time: 0.070924 Jan 15 21:01:36.112314 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2025/4025] 10.222.0.46 () {58 vars in 1244 bytes} [Sat Jan 15 21:01:36 2022] GET /compute/v2.1/os-volumes/1d85839d-98dd-473c-bc4b-0dabce6a2d62 => generated 345 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:01:36.454372 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c6ab6a6b-c0d8-43dc-ab22-956e1784ac5f tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:36.455350 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c6ab6a6b-c0d8-43dc-ab22-956e1784ac5f tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] [instance: 1c4fc198-0d0c-44d3-8add-e663bd22d35a] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:36.464472 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c6ab6a6b-c0d8-43dc-ab22-956e1784ac5f tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:36.465168 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c6ab6a6b-c0d8-43dc-ab22-956e1784ac5f tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:36.466387 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c6ab6a6b-c0d8-43dc-ab22-956e1784ac5f tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:36.467039 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c6ab6a6b-c0d8-43dc-ab22-956e1784ac5f tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:36.524651 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-6a8a2c2a-c9e0-4be8-a19a-a8dc92beb5c0 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:36.525528 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-6a8a2c2a-c9e0-4be8-a19a-a8dc92beb5c0 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 11cbafd5-4836-48b9-8db6-440002deb281] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:36.537258 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6a8a2c2a-c9e0-4be8-a19a-a8dc92beb5c0 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:36.537778 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6a8a2c2a-c9e0-4be8-a19a-a8dc92beb5c0 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:36.538724 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6a8a2c2a-c9e0-4be8-a19a-a8dc92beb5c0 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:36.539213 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6a8a2c2a-c9e0-4be8-a19a-a8dc92beb5c0 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:36.647183 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-c6ab6a6b-c0d8-43dc-ab22-956e1784ac5f tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5688424f63d04fb5bef4b79eb08546eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06185565206e41dca051d568bd18a082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:36.655183 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c6ab6a6b-c0d8-43dc-ab22-956e1784ac5f tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] 10.222.0.46 "GET /compute/v2.1/servers/1c4fc198-0d0c-44d3-8add-e663bd22d35a" status: 200 len: 1521 microversion: 2.1 time: 0.207155 Jan 15 21:01:36.655805 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2001/4026] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:36 2022] GET /compute/v2.1/servers/1c4fc198-0d0c-44d3-8add-e663bd22d35a => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:36.668014 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ddcebccf-dc6f-424a-b452-782220cfe9d2 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:36.668014 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ddcebccf-dc6f-424a-b452-782220cfe9d2 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:36.668417 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ddcebccf-dc6f-424a-b452-782220cfe9d2 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:36.668981 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ddcebccf-dc6f-424a-b452-782220cfe9d2 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:36.670031 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ddcebccf-dc6f-424a-b452-782220cfe9d2 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:36.670571 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ddcebccf-dc6f-424a-b452-782220cfe9d2 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:36.717161 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-6a8a2c2a-c9e0-4be8-a19a-a8dc92beb5c0 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:36.717858 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ddcebccf-dc6f-424a-b452-782220cfe9d2 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.060771 Jan 15 21:01:36.719345 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2002/4027] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:36 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:01:36.726268 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c46ccad6-683c-48f5-b08c-ed09e0944d55 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:36.726694 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-6a8a2c2a-c9e0-4be8-a19a-a8dc92beb5c0 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/11cbafd5-4836-48b9-8db6-440002deb281" status: 200 len: 1315 microversion: 2.1 time: 0.206333 Jan 15 21:01:36.727260 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2026/4028] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:36 2022] GET /compute/v2.1/servers/11cbafd5-4836-48b9-8db6-440002deb281 => generated 1315 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:01:36.727423 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c46ccad6-683c-48f5-b08c-ed09e0944d55 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:36.731943 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8445640e-8d80-4aef-970e-bb9d5555e6fe tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:36.732602 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-8445640e-8d80-4aef-970e-bb9d5555e6fe tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] [instance: 1c4fc198-0d0c-44d3-8add-e663bd22d35a] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:36.736491 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c46ccad6-683c-48f5-b08c-ed09e0944d55 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:36.737106 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c46ccad6-683c-48f5-b08c-ed09e0944d55 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:36.737988 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c46ccad6-683c-48f5-b08c-ed09e0944d55 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:36.738440 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c46ccad6-683c-48f5-b08c-ed09e0944d55 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:36.739453 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8445640e-8d80-4aef-970e-bb9d5555e6fe tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:36.739944 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8445640e-8d80-4aef-970e-bb9d5555e6fe tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:36.740932 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8445640e-8d80-4aef-970e-bb9d5555e6fe tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:36.741622 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8445640e-8d80-4aef-970e-bb9d5555e6fe tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:36.771550 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-8445640e-8d80-4aef-970e-bb9d5555e6fe tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] HTTP exception thrown: Instance is not a member of specified network Jan 15 21:01:36.772188 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8445640e-8d80-4aef-970e-bb9d5555e6fe tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] Returning 404 to user: Instance is not a member of specified network {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:01:36.773103 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-8445640e-8d80-4aef-970e-bb9d5555e6fe tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] 10.222.0.46 "GET /compute/v2.1/servers/1c4fc198-0d0c-44d3-8add-e663bd22d35a/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.044601 Jan 15 21:01:36.773738 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2027/4029] 10.222.0.46 () {58 vars in 1271 bytes} [Sat Jan 15 21:01:36 2022] GET /compute/v2.1/servers/1c4fc198-0d0c-44d3-8add-e663bd22d35a/ips/invalid => generated 91 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jan 15 21:01:36.783991 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c46ccad6-683c-48f5-b08c-ed09e0944d55 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action" status: 200 len: 32628 microversion: 2.20 time: 0.061582 Jan 15 21:01:36.788461 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2003/4030] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:36 2022] POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action => generated 32628 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:01:36.788710 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-1bcde013-40c1-4933-bda0-0e6eedffbd65 tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:36.788710 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-1bcde013-40c1-4933-bda0-0e6eedffbd65 tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] Failed to fetch instance by id 999 {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2871}} Jan 15 21:01:36.788710 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-1bcde013-40c1-4933-bda0-0e6eedffbd65 tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] HTTP exception thrown: Instance 999 could not be found. Jan 15 21:01:36.788710 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-1bcde013-40c1-4933-bda0-0e6eedffbd65 tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] Returning 404 to user: Instance 999 could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:01:36.788710 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-1bcde013-40c1-4933-bda0-0e6eedffbd65 tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] 10.222.0.46 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.006752 Jan 15 21:01:36.788710 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2028/4031] 10.222.0.46 () {58 vars in 1148 bytes} [Sat Jan 15 21:01:36 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 8 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jan 15 21:01:36.792759 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-727db02d-d5e6-4acd-998b-79333f1bc395 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:36.793420 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-727db02d-d5e6-4acd-998b-79333f1bc395 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: f437ed26-18bf-4cd8-b804-da114755f27e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:36.796959 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-de00c537-6e8b-4faf-bc99-cd0e839e3d81 tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:36.797594 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-de00c537-6e8b-4faf-bc99-cd0e839e3d81 tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] [instance: 1c4fc198-0d0c-44d3-8add-e663bd22d35a] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:36.802828 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-727db02d-d5e6-4acd-998b-79333f1bc395 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:36.803277 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-727db02d-d5e6-4acd-998b-79333f1bc395 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:36.804068 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-727db02d-d5e6-4acd-998b-79333f1bc395 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:36.804559 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-727db02d-d5e6-4acd-998b-79333f1bc395 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:36.805215 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-de00c537-6e8b-4faf-bc99-cd0e839e3d81 tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:36.805736 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-de00c537-6e8b-4faf-bc99-cd0e839e3d81 tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:36.806559 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-de00c537-6e8b-4faf-bc99-cd0e839e3d81 tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:36.807111 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-de00c537-6e8b-4faf-bc99-cd0e839e3d81 tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:36.834477 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-de00c537-6e8b-4faf-bc99-cd0e839e3d81 tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] [instance: 1c4fc198-0d0c-44d3-8add-e663bd22d35a] Going to try to terminate instance {{(pid=129365) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 21:01:36.931784 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-de00c537-6e8b-4faf-bc99-cd0e839e3d81 tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] 10.222.0.46 "DELETE /compute/v2.1/servers/1c4fc198-0d0c-44d3-8add-e663bd22d35a" status: 204 len: 0 microversion: 2.1 time: 0.138462 Jan 15 21:01:36.932367 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2029/4032] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 21:01:36 2022] DELETE /compute/v2.1/servers/1c4fc198-0d0c-44d3-8add-e663bd22d35a => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 15 21:01:36.939082 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c6e1ef31-988e-4394-be77-27ac2bf2d2e7 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:36.940442 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c6e1ef31-988e-4394-be77-27ac2bf2d2e7 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:36.946916 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c6e1ef31-988e-4394-be77-27ac2bf2d2e7 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:36.947370 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c6e1ef31-988e-4394-be77-27ac2bf2d2e7 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:36.948358 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c6e1ef31-988e-4394-be77-27ac2bf2d2e7 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:36.948799 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c6e1ef31-988e-4394-be77-27ac2bf2d2e7 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:36.969735 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-727db02d-d5e6-4acd-998b-79333f1bc395 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8f9c6ea7f6496792258d683640c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a75218d537c4d63874297261bec70ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:36.978031 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-727db02d-d5e6-4acd-998b-79333f1bc395 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] 10.222.0.46 "GET /compute/v2.1/servers/f437ed26-18bf-4cd8-b804-da114755f27e" status: 200 len: 1318 microversion: 2.1 time: 0.189394 Jan 15 21:01:36.978923 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2004/4033] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:36 2022] GET /compute/v2.1/servers/f437ed26-18bf-4cd8-b804-da114755f27e => generated 1318 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:01:36.984163 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-3505ffd1-41a4-41f4-a139-bdc6a4425796 req-d740936f-ae2d-4244-b245-f05d15a5dc70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f437ed26-18bf-4cd8-b804-da114755f27e", "name": "network-vif-plugged", "status": "completed", "tag": "f665537c-6da1-4935-8603-6f099be4c06c"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:36.985884 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:01:36.985884 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:01:36.992647 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c6e1ef31-988e-4394-be77-27ac2bf2d2e7 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action" status: 200 len: 24508 microversion: 2.1 time: 0.058100 Jan 15 21:01:36.993329 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2030/4034] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:01:36 2022] POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action => generated 24508 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:01:36.994291 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-3505ffd1-41a4-41f4-a139-bdc6a4425796 req-d740936f-ae2d-4244-b245-f05d15a5dc70 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:36.994730 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-3505ffd1-41a4-41f4-a139-bdc6a4425796 req-d740936f-ae2d-4244-b245-f05d15a5dc70 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:36.999362 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ebca5a0a-796b-4e6d-9fc7-088b9f222d73 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:37.000564 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ebca5a0a-796b-4e6d-9fc7-088b9f222d73 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:37.008648 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-3505ffd1-41a4-41f4-a139-bdc6a4425796 req-d740936f-ae2d-4244-b245-f05d15a5dc70 service nova] Creating event network-vif-plugged:f665537c-6da1-4935-8603-6f099be4c06c for instance f437ed26-18bf-4cd8-b804-da114755f27e on nch2-master-1 Jan 15 21:01:37.009624 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ebca5a0a-796b-4e6d-9fc7-088b9f222d73 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:37.009982 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ebca5a0a-796b-4e6d-9fc7-088b9f222d73 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:37.011005 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ebca5a0a-796b-4e6d-9fc7-088b9f222d73 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:37.011437 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ebca5a0a-796b-4e6d-9fc7-088b9f222d73 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:37.013661 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-3505ffd1-41a4-41f4-a139-bdc6a4425796 req-d740936f-ae2d-4244-b245-f05d15a5dc70 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033609 Jan 15 21:01:37.014297 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2005/4035] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:01:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:01:37.020100 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-bd06b82e-82a1-417b-9b10-5988cb09b9da tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:37.021025 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-bd06b82e-82a1-417b-9b10-5988cb09b9da tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] [instance: 1c4fc198-0d0c-44d3-8add-e663bd22d35a] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:37.027436 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bd06b82e-82a1-417b-9b10-5988cb09b9da tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:37.028496 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bd06b82e-82a1-417b-9b10-5988cb09b9da tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:37.028720 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bd06b82e-82a1-417b-9b10-5988cb09b9da tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:37.029358 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bd06b82e-82a1-417b-9b10-5988cb09b9da tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:37.060624 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ebca5a0a-796b-4e6d-9fc7-088b9f222d73 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 24546 microversion: 2.32 time: 0.065077 Jan 15 21:01:37.068375 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2031/4036] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:36 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 24546 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:01:37.130753 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b1347bea-706e-458a-b4b7-1d4fae5878eb tempest-VolumesGetTestJSON-1089060493 tempest-VolumesGetTestJSON-1089060493-project] Calling method '.version_select at 0x7f30ceafa700>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:37.191339 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b1347bea-706e-458a-b4b7-1d4fae5878eb tempest-VolumesGetTestJSON-1089060493 tempest-VolumesGetTestJSON-1089060493-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/1d85839d-98dd-473c-bc4b-0dabce6a2d62" status: 200 len: 346 microversion: 2.1 time: 0.067632 Jan 15 21:01:37.193679 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2032/4037] 10.222.0.46 () {58 vars in 1244 bytes} [Sat Jan 15 21:01:37 2022] GET /compute/v2.1/os-volumes/1d85839d-98dd-473c-bc4b-0dabce6a2d62 => generated 346 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 21:01:37.205376 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b5ee0fec-7ed0-4468-b2b9-aa005e4701fd tempest-VolumesGetTestJSON-1089060493 tempest-VolumesGetTestJSON-1089060493-project] Calling method '.version_select at 0x7f30c853a670>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:37.214155 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-bd06b82e-82a1-417b-9b10-5988cb09b9da tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5688424f63d04fb5bef4b79eb08546eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06185565206e41dca051d568bd18a082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:37.223254 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-bd06b82e-82a1-417b-9b10-5988cb09b9da tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] 10.222.0.46 "GET /compute/v2.1/servers/1c4fc198-0d0c-44d3-8add-e663bd22d35a" status: 200 len: 1527 microversion: 2.1 time: 0.207725 Jan 15 21:01:37.224058 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2006/4038] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:37 2022] GET /compute/v2.1/servers/1c4fc198-0d0c-44d3-8add-e663bd22d35a => generated 1527 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:37.259007 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b5ee0fec-7ed0-4468-b2b9-aa005e4701fd tempest-VolumesGetTestJSON-1089060493 tempest-VolumesGetTestJSON-1089060493-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/1d85839d-98dd-473c-bc4b-0dabce6a2d62" status: 200 len: 346 microversion: 2.1 time: 0.058841 Jan 15 21:01:37.259545 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2033/4039] 10.222.0.46 () {58 vars in 1244 bytes} [Sat Jan 15 21:01:37 2022] GET /compute/v2.1/os-volumes/1d85839d-98dd-473c-bc4b-0dabce6a2d62 => generated 346 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 21:01:37.272615 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-67f71c4c-cff0-4443-9834-2207ac94dda2 tempest-VolumesGetTestJSON-1089060493 tempest-VolumesGetTestJSON-1089060493-project] Calling method '.version_select at 0x7f30ced31d30>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:37.345295 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-67f71c4c-cff0-4443-9834-2207ac94dda2 tempest-VolumesGetTestJSON-1089060493 tempest-VolumesGetTestJSON-1089060493-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/1d85839d-98dd-473c-bc4b-0dabce6a2d62" status: 202 len: 0 microversion: 2.1 time: 0.077433 Jan 15 21:01:37.347443 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2007/4040] 10.222.0.46 () {58 vars in 1247 bytes} [Sat Jan 15 21:01:37 2022] DELETE /compute/v2.1/os-volumes/1d85839d-98dd-473c-bc4b-0dabce6a2d62 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:01:37.367773 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-41e10f21-7593-4c1c-b987-c6b1b92c09ff tempest-VolumesGetTestJSON-1089060493 tempest-VolumesGetTestJSON-1089060493-project] Calling method '.version_select at 0x7f30c953a310>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:37.424003 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-41e10f21-7593-4c1c-b987-c6b1b92c09ff tempest-VolumesGetTestJSON-1089060493 tempest-VolumesGetTestJSON-1089060493-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/1d85839d-98dd-473c-bc4b-0dabce6a2d62" status: 200 len: 345 microversion: 2.1 time: 0.064878 Jan 15 21:01:37.426419 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2034/4041] 10.222.0.46 () {58 vars in 1244 bytes} [Sat Jan 15 21:01:37 2022] GET /compute/v2.1/os-volumes/1d85839d-98dd-473c-bc4b-0dabce6a2d62 => generated 345 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:01:37.732105 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e4db0b02-0127-421d-b7a2-4ae1cc18bf98 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:37.733416 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e4db0b02-0127-421d-b7a2-4ae1cc18bf98 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:37.741083 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e4db0b02-0127-421d-b7a2-4ae1cc18bf98 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:37.741758 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e4db0b02-0127-421d-b7a2-4ae1cc18bf98 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:37.742564 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e4db0b02-0127-421d-b7a2-4ae1cc18bf98 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:37.743211 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e4db0b02-0127-421d-b7a2-4ae1cc18bf98 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:37.753658 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8e09a95e-d2f2-4285-98d4-d4f01c74e7ff tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:37.755882 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-8e09a95e-d2f2-4285-98d4-d4f01c74e7ff tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 11cbafd5-4836-48b9-8db6-440002deb281] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:37.772363 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8e09a95e-d2f2-4285-98d4-d4f01c74e7ff tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:37.773503 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8e09a95e-d2f2-4285-98d4-d4f01c74e7ff tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:37.775555 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8e09a95e-d2f2-4285-98d4-d4f01c74e7ff tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:37.777000 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8e09a95e-d2f2-4285-98d4-d4f01c74e7ff tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:37.798432 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e4db0b02-0127-421d-b7a2-4ae1cc18bf98 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.070006 Jan 15 21:01:37.799663 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2008/4042] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:37 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:01:37.807181 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1dc3dd95-da4d-4982-8cbf-03a3fa1729ec tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:37.808302 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-1dc3dd95-da4d-4982-8cbf-03a3fa1729ec tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:37.817003 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1dc3dd95-da4d-4982-8cbf-03a3fa1729ec tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:37.817494 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1dc3dd95-da4d-4982-8cbf-03a3fa1729ec tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:37.818248 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1dc3dd95-da4d-4982-8cbf-03a3fa1729ec tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:37.818682 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1dc3dd95-da4d-4982-8cbf-03a3fa1729ec tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:37.871008 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-1dc3dd95-da4d-4982-8cbf-03a3fa1729ec tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action" status: 200 len: 32628 microversion: 2.20 time: 0.069558 Jan 15 21:01:37.871720 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2009/4043] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:37 2022] POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action => generated 32628 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:01:37.962968 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-8e09a95e-d2f2-4285-98d4-d4f01c74e7ff tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:37.970546 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-8e09a95e-d2f2-4285-98d4-d4f01c74e7ff tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/11cbafd5-4836-48b9-8db6-440002deb281" status: 200 len: 1315 microversion: 2.1 time: 0.229305 Jan 15 21:01:37.971657 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2035/4044] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:37 2022] GET /compute/v2.1/servers/11cbafd5-4836-48b9-8db6-440002deb281 => generated 1315 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:37.998314 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-70d9a14c-5fad-45ac-af82-c20bb7156f56 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:37.999202 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-70d9a14c-5fad-45ac-af82-c20bb7156f56 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: f437ed26-18bf-4cd8-b804-da114755f27e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:38.005260 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a64c74fa-9509-442c-8376-7a4c47dcc88f tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:38.006383 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a64c74fa-9509-442c-8376-7a4c47dcc88f tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:38.007909 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-70d9a14c-5fad-45ac-af82-c20bb7156f56 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:38.008719 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-70d9a14c-5fad-45ac-af82-c20bb7156f56 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:38.009788 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-70d9a14c-5fad-45ac-af82-c20bb7156f56 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:38.010292 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-70d9a14c-5fad-45ac-af82-c20bb7156f56 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:38.013436 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a64c74fa-9509-442c-8376-7a4c47dcc88f tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:38.013955 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a64c74fa-9509-442c-8376-7a4c47dcc88f tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:38.014908 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a64c74fa-9509-442c-8376-7a4c47dcc88f tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:38.015405 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a64c74fa-9509-442c-8376-7a4c47dcc88f tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:38.062300 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a64c74fa-9509-442c-8376-7a4c47dcc88f tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action" status: 200 len: 24508 microversion: 2.1 time: 0.061630 Jan 15 21:01:38.063415 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2036/4045] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:01:37 2022] POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action => generated 24508 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 21:01:38.075168 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-6f87ae60-922f-4e45-9bb8-218f9228095f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:38.076943 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-6f87ae60-922f-4e45-9bb8-218f9228095f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:38.085816 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6f87ae60-922f-4e45-9bb8-218f9228095f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:38.086382 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6f87ae60-922f-4e45-9bb8-218f9228095f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:38.087402 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6f87ae60-922f-4e45-9bb8-218f9228095f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:38.087858 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6f87ae60-922f-4e45-9bb8-218f9228095f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:38.138647 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-6f87ae60-922f-4e45-9bb8-218f9228095f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 24546 microversion: 2.32 time: 0.068335 Jan 15 21:01:38.139503 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2037/4046] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:38 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 24546 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:01:38.183390 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-70d9a14c-5fad-45ac-af82-c20bb7156f56 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8f9c6ea7f6496792258d683640c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a75218d537c4d63874297261bec70ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:38.192397 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-70d9a14c-5fad-45ac-af82-c20bb7156f56 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] 10.222.0.46 "GET /compute/v2.1/servers/f437ed26-18bf-4cd8-b804-da114755f27e" status: 200 len: 1318 microversion: 2.1 time: 0.199146 Jan 15 21:01:38.193096 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2010/4047] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:37 2022] GET /compute/v2.1/servers/f437ed26-18bf-4cd8-b804-da114755f27e => generated 1318 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:38.243868 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ade8201e-e750-4b52-b5ea-a62577db213a tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:38.244566 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ade8201e-e750-4b52-b5ea-a62577db213a tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] [instance: 1c4fc198-0d0c-44d3-8add-e663bd22d35a] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:38.254838 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ade8201e-e750-4b52-b5ea-a62577db213a tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:38.255270 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ade8201e-e750-4b52-b5ea-a62577db213a tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:38.256156 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ade8201e-e750-4b52-b5ea-a62577db213a tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:38.256596 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ade8201e-e750-4b52-b5ea-a62577db213a tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:38.416040 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-ade8201e-e750-4b52-b5ea-a62577db213a tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5688424f63d04fb5bef4b79eb08546eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06185565206e41dca051d568bd18a082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:38.424593 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ade8201e-e750-4b52-b5ea-a62577db213a tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] 10.222.0.46 "GET /compute/v2.1/servers/1c4fc198-0d0c-44d3-8add-e663bd22d35a" status: 200 len: 1527 microversion: 2.1 time: 0.184283 Jan 15 21:01:38.425557 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2038/4048] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:38 2022] GET /compute/v2.1/servers/1c4fc198-0d0c-44d3-8add-e663bd22d35a => generated 1527 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:01:38.440795 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c5534e29-4b06-4d3f-ad1d-2fd78be00af7 tempest-VolumesGetTestJSON-1089060493 tempest-VolumesGetTestJSON-1089060493-project] Calling method '.version_select at 0x7f30cece5c10>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:38.476772 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-c5534e29-4b06-4d3f-ad1d-2fd78be00af7 tempest-VolumesGetTestJSON-1089060493 tempest-VolumesGetTestJSON-1089060493-project] HTTP exception thrown: Volume 1d85839d-98dd-473c-bc4b-0dabce6a2d62 could not be found. Jan 15 21:01:38.477449 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c5534e29-4b06-4d3f-ad1d-2fd78be00af7 tempest-VolumesGetTestJSON-1089060493 tempest-VolumesGetTestJSON-1089060493-project] Returning 404 to user: Volume 1d85839d-98dd-473c-bc4b-0dabce6a2d62 could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:01:38.478511 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c5534e29-4b06-4d3f-ad1d-2fd78be00af7 tempest-VolumesGetTestJSON-1089060493 tempest-VolumesGetTestJSON-1089060493-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/1d85839d-98dd-473c-bc4b-0dabce6a2d62" status: 404 len: 109 microversion: 2.1 time: 0.042580 Jan 15 21:01:38.479169 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2011/4049] 10.222.0.46 () {58 vars in 1244 bytes} [Sat Jan 15 21:01:38 2022] GET /compute/v2.1/os-volumes/1d85839d-98dd-473c-bc4b-0dabce6a2d62 => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:01:38.813256 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ff0f029c-4b1e-4381-a195-38eb20bda878 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:38.814313 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ff0f029c-4b1e-4381-a195-38eb20bda878 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:38.822194 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ff0f029c-4b1e-4381-a195-38eb20bda878 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:38.822751 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ff0f029c-4b1e-4381-a195-38eb20bda878 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:38.823698 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ff0f029c-4b1e-4381-a195-38eb20bda878 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:38.824366 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ff0f029c-4b1e-4381-a195-38eb20bda878 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:38.879965 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ff0f029c-4b1e-4381-a195-38eb20bda878 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.070576 Jan 15 21:01:38.880624 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2039/4050] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:38 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:01:38.886007 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-2d7ddb9e-23dc-48b6-a10a-d736bf982def tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:38.887230 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-2d7ddb9e-23dc-48b6-a10a-d736bf982def tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:38.894549 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2d7ddb9e-23dc-48b6-a10a-d736bf982def tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:38.895083 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2d7ddb9e-23dc-48b6-a10a-d736bf982def tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:38.896471 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2d7ddb9e-23dc-48b6-a10a-d736bf982def tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:38.897069 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2d7ddb9e-23dc-48b6-a10a-d736bf982def tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:38.943481 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-2d7ddb9e-23dc-48b6-a10a-d736bf982def tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action" status: 200 len: 32628 microversion: 2.20 time: 0.063324 Jan 15 21:01:38.944474 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2012/4051] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:38 2022] POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action => generated 32628 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:01:38.990483 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b396c3c3-7c8f-45ad-9751-cf7e95c28743 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:38.991179 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b396c3c3-7c8f-45ad-9751-cf7e95c28743 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 11cbafd5-4836-48b9-8db6-440002deb281] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:38.997950 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b396c3c3-7c8f-45ad-9751-cf7e95c28743 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:38.998622 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b396c3c3-7c8f-45ad-9751-cf7e95c28743 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:38.999571 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b396c3c3-7c8f-45ad-9751-cf7e95c28743 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:39.000165 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b396c3c3-7c8f-45ad-9751-cf7e95c28743 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:39.076695 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-cb4afc80-4c87-4384-8ffc-fb09a3ace628 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:39.078630 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-cb4afc80-4c87-4384-8ffc-fb09a3ace628 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:39.089029 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cb4afc80-4c87-4384-8ffc-fb09a3ace628 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:39.090177 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cb4afc80-4c87-4384-8ffc-fb09a3ace628 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:39.091480 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cb4afc80-4c87-4384-8ffc-fb09a3ace628 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:39.092146 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cb4afc80-4c87-4384-8ffc-fb09a3ace628 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:39.145615 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-cb4afc80-4c87-4384-8ffc-fb09a3ace628 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action" status: 200 len: 24508 microversion: 2.1 time: 0.073004 Jan 15 21:01:39.147361 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2013/4052] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:01:39 2022] POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action => generated 24508 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:01:39.154900 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c6d84b89-d678-409a-b028-43314efc5d7b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:39.158833 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c6d84b89-d678-409a-b028-43314efc5d7b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:39.168628 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c6d84b89-d678-409a-b028-43314efc5d7b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:39.169540 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c6d84b89-d678-409a-b028-43314efc5d7b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:39.170574 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c6d84b89-d678-409a-b028-43314efc5d7b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:39.171050 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c6d84b89-d678-409a-b028-43314efc5d7b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:39.209737 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-b396c3c3-7c8f-45ad-9751-cf7e95c28743 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:39.220616 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b396c3c3-7c8f-45ad-9751-cf7e95c28743 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/11cbafd5-4836-48b9-8db6-440002deb281" status: 200 len: 1315 microversion: 2.1 time: 0.234155 Jan 15 21:01:39.222363 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2040/4053] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:38 2022] GET /compute/v2.1/servers/11cbafd5-4836-48b9-8db6-440002deb281 => generated 1315 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:39.226908 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-78a81628-95e5-4ef0-80f5-413bfb7628a5 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:39.227554 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-78a81628-95e5-4ef0-80f5-413bfb7628a5 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: f437ed26-18bf-4cd8-b804-da114755f27e] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:39.234493 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-78a81628-95e5-4ef0-80f5-413bfb7628a5 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:39.234493 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-78a81628-95e5-4ef0-80f5-413bfb7628a5 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:39.235337 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-78a81628-95e5-4ef0-80f5-413bfb7628a5 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:39.235987 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-78a81628-95e5-4ef0-80f5-413bfb7628a5 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:39.238065 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c6d84b89-d678-409a-b028-43314efc5d7b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 24546 microversion: 2.32 time: 0.088897 Jan 15 21:01:39.239163 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2014/4054] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:39 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 24546 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:01:39.401763 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-74a9caf2-58df-468e-aca2-8faa6bc7472b req-a2c1aecf-f63d-4ac9-8d07-d258485ef69e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c4fc198-0d0c-44d3-8add-e663bd22d35a", "name": "network-vif-deleted", "tag": "9fa19225-1fe7-4da0-8e05-a2d51660efa1"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:39.403867 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:01:39.403867 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:01:39.414466 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-74a9caf2-58df-468e-aca2-8faa6bc7472b req-a2c1aecf-f63d-4ac9-8d07-d258485ef69e service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:39.415276 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-74a9caf2-58df-468e-aca2-8faa6bc7472b req-a2c1aecf-f63d-4ac9-8d07-d258485ef69e service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:39.432676 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-74a9caf2-58df-468e-aca2-8faa6bc7472b req-a2c1aecf-f63d-4ac9-8d07-d258485ef69e service nova] Creating event network-vif-deleted:9fa19225-1fe7-4da0-8e05-a2d51660efa1 for instance 1c4fc198-0d0c-44d3-8add-e663bd22d35a on nch2-master-1 Jan 15 21:01:39.439505 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-74a9caf2-58df-468e-aca2-8faa6bc7472b req-a2c1aecf-f63d-4ac9-8d07-d258485ef69e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045728 Jan 15 21:01:39.441290 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2015/4055] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:01:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:01:39.447273 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-775e83f7-d15b-4628-a12d-a93abd765bdf tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:39.448093 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-775e83f7-d15b-4628-a12d-a93abd765bdf tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] [instance: 1c4fc198-0d0c-44d3-8add-e663bd22d35a] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:39.457037 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-775e83f7-d15b-4628-a12d-a93abd765bdf tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:39.457815 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-775e83f7-d15b-4628-a12d-a93abd765bdf tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:39.458744 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-775e83f7-d15b-4628-a12d-a93abd765bdf tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:39.459352 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-775e83f7-d15b-4628-a12d-a93abd765bdf tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:39.480890 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-78a81628-95e5-4ef0-80f5-413bfb7628a5 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8f9c6ea7f6496792258d683640c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a75218d537c4d63874297261bec70ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:39.495412 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-78a81628-95e5-4ef0-80f5-413bfb7628a5 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] 10.222.0.46 "GET /compute/v2.1/servers/f437ed26-18bf-4cd8-b804-da114755f27e" status: 200 len: 1508 microversion: 2.1 time: 0.271833 Jan 15 21:01:39.497067 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2041/4056] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:39 2022] GET /compute/v2.1/servers/f437ed26-18bf-4cd8-b804-da114755f27e => generated 1508 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:39.517150 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-1b7063f3-c507-44e8-b32d-9bebec34b739 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:39.519296 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-1b7063f3-c507-44e8-b32d-9bebec34b739 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: f437ed26-18bf-4cd8-b804-da114755f27e] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:39.542278 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1b7063f3-c507-44e8-b32d-9bebec34b739 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:39.547890 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1b7063f3-c507-44e8-b32d-9bebec34b739 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:39.548947 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1b7063f3-c507-44e8-b32d-9bebec34b739 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:39.549551 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1b7063f3-c507-44e8-b32d-9bebec34b739 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:39.586394 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-775e83f7-d15b-4628-a12d-a93abd765bdf tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5688424f63d04fb5bef4b79eb08546eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06185565206e41dca051d568bd18a082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:39.595091 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-775e83f7-d15b-4628-a12d-a93abd765bdf tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] 10.222.0.46 "GET /compute/v2.1/servers/1c4fc198-0d0c-44d3-8add-e663bd22d35a" status: 200 len: 1309 microversion: 2.1 time: 0.152346 Jan 15 21:01:39.596514 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2016/4057] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:39 2022] GET /compute/v2.1/servers/1c4fc198-0d0c-44d3-8add-e663bd22d35a => generated 1309 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:39.744730 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-1b7063f3-c507-44e8-b32d-9bebec34b739 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8f9c6ea7f6496792258d683640c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a75218d537c4d63874297261bec70ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:39.754163 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-1b7063f3-c507-44e8-b32d-9bebec34b739 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] 10.222.0.46 "GET /compute/v2.1/servers/f437ed26-18bf-4cd8-b804-da114755f27e" status: 200 len: 1508 microversion: 2.1 time: 0.243060 Jan 15 21:01:39.754749 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2042/4058] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:39 2022] GET /compute/v2.1/servers/f437ed26-18bf-4cd8-b804-da114755f27e => generated 1508 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:39.771050 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-66a3fe2b-1110-49ef-a0bb-a03bda779853 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:39.772242 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-66a3fe2b-1110-49ef-a0bb-a03bda779853 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: f437ed26-18bf-4cd8-b804-da114755f27e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:39.778996 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-66a3fe2b-1110-49ef-a0bb-a03bda779853 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:39.779465 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-66a3fe2b-1110-49ef-a0bb-a03bda779853 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:39.780383 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-66a3fe2b-1110-49ef-a0bb-a03bda779853 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:39.780814 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-66a3fe2b-1110-49ef-a0bb-a03bda779853 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:39.867604 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-66a3fe2b-1110-49ef-a0bb-a03bda779853 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] 10.222.0.46 "PUT /compute/v2.1/servers/f437ed26-18bf-4cd8-b804-da114755f27e" status: 200 len: 1080 microversion: 2.1 time: 0.100373 Jan 15 21:01:39.868656 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2017/4059] 10.222.0.46 () {60 vars in 1255 bytes} [Sat Jan 15 21:01:39 2022] PUT /compute/v2.1/servers/f437ed26-18bf-4cd8-b804-da114755f27e => generated 1080 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:39.888354 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e38baf14-4231-4a08-81f9-fe66c86bc445 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:39.889178 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e38baf14-4231-4a08-81f9-fe66c86bc445 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: f437ed26-18bf-4cd8-b804-da114755f27e] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:39.896700 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b291610f-5a0a-44a6-a22f-24aaf4bf83da tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:39.897671 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e38baf14-4231-4a08-81f9-fe66c86bc445 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:39.898177 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e38baf14-4231-4a08-81f9-fe66c86bc445 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:39.898489 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b291610f-5a0a-44a6-a22f-24aaf4bf83da tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:39.899067 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e38baf14-4231-4a08-81f9-fe66c86bc445 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:39.899474 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e38baf14-4231-4a08-81f9-fe66c86bc445 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:39.906582 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b291610f-5a0a-44a6-a22f-24aaf4bf83da tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:39.907024 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b291610f-5a0a-44a6-a22f-24aaf4bf83da tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:39.909353 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b291610f-5a0a-44a6-a22f-24aaf4bf83da tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:39.909969 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b291610f-5a0a-44a6-a22f-24aaf4bf83da tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:39.969710 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b291610f-5a0a-44a6-a22f-24aaf4bf83da tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.078142 Jan 15 21:01:39.974397 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2018/4060] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:39 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:01:39.981846 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4da4d131-77e7-4553-ad17-c9f67a2390ee tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:39.983137 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-4da4d131-77e7-4553-ad17-c9f67a2390ee tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:39.992690 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4da4d131-77e7-4553-ad17-c9f67a2390ee tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:39.993518 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4da4d131-77e7-4553-ad17-c9f67a2390ee tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:39.994535 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4da4d131-77e7-4553-ad17-c9f67a2390ee tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:39.995373 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4da4d131-77e7-4553-ad17-c9f67a2390ee tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:40.064193 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-4da4d131-77e7-4553-ad17-c9f67a2390ee tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action" status: 200 len: 32628 microversion: 2.20 time: 0.087543 Jan 15 21:01:40.066146 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2019/4061] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:39 2022] POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action => generated 32628 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:01:40.106675 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-e38baf14-4231-4a08-81f9-fe66c86bc445 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8f9c6ea7f6496792258d683640c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a75218d537c4d63874297261bec70ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:40.114945 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e38baf14-4231-4a08-81f9-fe66c86bc445 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] 10.222.0.46 "GET /compute/v2.1/servers/f437ed26-18bf-4cd8-b804-da114755f27e" status: 200 len: 1506 microversion: 2.1 time: 0.231214 Jan 15 21:01:40.115530 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2043/4062] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:39 2022] GET /compute/v2.1/servers/f437ed26-18bf-4cd8-b804-da114755f27e => generated 1506 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:01:40.131893 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d6105477-b9e8-41ea-a831-7cfbd120dd8a tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:40.132609 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-d6105477-b9e8-41ea-a831-7cfbd120dd8a tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: f437ed26-18bf-4cd8-b804-da114755f27e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:40.141090 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d6105477-b9e8-41ea-a831-7cfbd120dd8a tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:40.141985 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d6105477-b9e8-41ea-a831-7cfbd120dd8a tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:40.143168 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d6105477-b9e8-41ea-a831-7cfbd120dd8a tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:40.143831 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d6105477-b9e8-41ea-a831-7cfbd120dd8a tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:40.160250 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-1e213051-ba98-4771-ab82-e71fa2dace88 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:40.162197 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-1e213051-ba98-4771-ab82-e71fa2dace88 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:40.169349 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1e213051-ba98-4771-ab82-e71fa2dace88 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:40.170089 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1e213051-ba98-4771-ab82-e71fa2dace88 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:40.170864 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1e213051-ba98-4771-ab82-e71fa2dace88 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:40.171591 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1e213051-ba98-4771-ab82-e71fa2dace88 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:40.222334 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-1e213051-ba98-4771-ab82-e71fa2dace88 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action" status: 200 len: 24508 microversion: 2.1 time: 0.067020 Jan 15 21:01:40.225177 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2044/4063] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:01:40 2022] POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action => generated 24508 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:01:40.241444 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8818a3c7-89bf-470f-9280-39bb2f9cb91b tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:40.242181 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-8818a3c7-89bf-470f-9280-39bb2f9cb91b tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 11cbafd5-4836-48b9-8db6-440002deb281] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:40.250025 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8818a3c7-89bf-470f-9280-39bb2f9cb91b tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:40.250426 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8818a3c7-89bf-470f-9280-39bb2f9cb91b tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:40.251390 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8818a3c7-89bf-470f-9280-39bb2f9cb91b tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:40.251833 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8818a3c7-89bf-470f-9280-39bb2f9cb91b tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:40.351004 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-d6105477-b9e8-41ea-a831-7cfbd120dd8a tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8f9c6ea7f6496792258d683640c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a75218d537c4d63874297261bec70ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:40.360511 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d6105477-b9e8-41ea-a831-7cfbd120dd8a tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] 10.222.0.46 "GET /compute/v2.1/servers/f437ed26-18bf-4cd8-b804-da114755f27e" status: 200 len: 1506 microversion: 2.1 time: 0.232930 Jan 15 21:01:40.361248 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2020/4064] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:40 2022] GET /compute/v2.1/servers/f437ed26-18bf-4cd8-b804-da114755f27e => generated 1506 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:40.367939 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-50318e56-f683-42bd-b679-c48c17291408 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:40.369501 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-50318e56-f683-42bd-b679-c48c17291408 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:40.382385 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-50318e56-f683-42bd-b679-c48c17291408 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:40.383206 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-50318e56-f683-42bd-b679-c48c17291408 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:40.384650 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-50318e56-f683-42bd-b679-c48c17291408 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:40.385154 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-50318e56-f683-42bd-b679-c48c17291408 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:40.439212 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-8818a3c7-89bf-470f-9280-39bb2f9cb91b tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:40.439407 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-50318e56-f683-42bd-b679-c48c17291408 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 24546 microversion: 2.32 time: 0.076184 Jan 15 21:01:40.440569 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2021/4065] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:40 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 24546 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:01:40.449508 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-8818a3c7-89bf-470f-9280-39bb2f9cb91b tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/11cbafd5-4836-48b9-8db6-440002deb281" status: 200 len: 1315 microversion: 2.1 time: 0.213640 Jan 15 21:01:40.450504 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2045/4066] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:40 2022] GET /compute/v2.1/servers/11cbafd5-4836-48b9-8db6-440002deb281 => generated 1315 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:40.453466 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9e067c58-0231-4f7f-b0e2-5e299429dda7 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:40.454854 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-9e067c58-0231-4f7f-b0e2-5e299429dda7 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: f437ed26-18bf-4cd8-b804-da114755f27e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:40.463230 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9e067c58-0231-4f7f-b0e2-5e299429dda7 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:40.463687 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9e067c58-0231-4f7f-b0e2-5e299429dda7 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:40.464541 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9e067c58-0231-4f7f-b0e2-5e299429dda7 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:40.465094 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9e067c58-0231-4f7f-b0e2-5e299429dda7 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:40.543589 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-9e067c58-0231-4f7f-b0e2-5e299429dda7 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] 10.222.0.46 "PUT /compute/v2.1/servers/f437ed26-18bf-4cd8-b804-da114755f27e" status: 200 len: 1082 microversion: 2.1 time: 0.098422 Jan 15 21:01:40.544998 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2022/4067] 10.222.0.46 () {60 vars in 1255 bytes} [Sat Jan 15 21:01:40 2022] PUT /compute/v2.1/servers/f437ed26-18bf-4cd8-b804-da114755f27e => generated 1082 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:40.561643 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-abfae045-1900-460f-975b-56f7ca53bced tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:40.562254 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-abfae045-1900-460f-975b-56f7ca53bced tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: f437ed26-18bf-4cd8-b804-da114755f27e] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:40.570369 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-abfae045-1900-460f-975b-56f7ca53bced tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:40.570930 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-abfae045-1900-460f-975b-56f7ca53bced tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:40.571781 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-abfae045-1900-460f-975b-56f7ca53bced tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:40.572374 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-abfae045-1900-460f-975b-56f7ca53bced tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:40.615395 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4efe4408-bb23-49b8-8541-bb50844ffaa0 tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:40.616067 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-4efe4408-bb23-49b8-8541-bb50844ffaa0 tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] [instance: 1c4fc198-0d0c-44d3-8add-e663bd22d35a] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:40.631665 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4efe4408-bb23-49b8-8541-bb50844ffaa0 tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:40.632180 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4efe4408-bb23-49b8-8541-bb50844ffaa0 tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:40.633212 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4efe4408-bb23-49b8-8541-bb50844ffaa0 tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:40.633446 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4efe4408-bb23-49b8-8541-bb50844ffaa0 tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:40.652871 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-4efe4408-bb23-49b8-8541-bb50844ffaa0 tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] HTTP exception thrown: Instance 1c4fc198-0d0c-44d3-8add-e663bd22d35a could not be found. Jan 15 21:01:40.653555 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4efe4408-bb23-49b8-8541-bb50844ffaa0 tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] Returning 404 to user: Instance 1c4fc198-0d0c-44d3-8add-e663bd22d35a could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:01:40.654322 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-4efe4408-bb23-49b8-8541-bb50844ffaa0 tempest-ServerAddressesNegativeTestJSON-2008177388 tempest-ServerAddressesNegativeTestJSON-2008177388-project] 10.222.0.46 "GET /compute/v2.1/servers/1c4fc198-0d0c-44d3-8add-e663bd22d35a" status: 404 len: 111 microversion: 2.1 time: 0.044280 Jan 15 21:01:40.655202 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2023/4068] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:40 2022] GET /compute/v2.1/servers/1c4fc198-0d0c-44d3-8add-e663bd22d35a => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:01:40.734086 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-abfae045-1900-460f-975b-56f7ca53bced tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8f9c6ea7f6496792258d683640c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a75218d537c4d63874297261bec70ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:40.745303 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-abfae045-1900-460f-975b-56f7ca53bced tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] 10.222.0.46 "GET /compute/v2.1/servers/f437ed26-18bf-4cd8-b804-da114755f27e" status: 200 len: 1508 microversion: 2.1 time: 0.187963 Jan 15 21:01:40.746090 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2046/4069] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:40 2022] GET /compute/v2.1/servers/f437ed26-18bf-4cd8-b804-da114755f27e => generated 1508 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:40.761476 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-34d404a0-acb5-47eb-948f-337fa02fbf28 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:40.762084 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-34d404a0-acb5-47eb-948f-337fa02fbf28 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: f437ed26-18bf-4cd8-b804-da114755f27e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:40.769933 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-34d404a0-acb5-47eb-948f-337fa02fbf28 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:40.770386 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-34d404a0-acb5-47eb-948f-337fa02fbf28 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:40.771306 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-34d404a0-acb5-47eb-948f-337fa02fbf28 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:40.771752 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-34d404a0-acb5-47eb-948f-337fa02fbf28 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:40.929746 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-34d404a0-acb5-47eb-948f-337fa02fbf28 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8f9c6ea7f6496792258d683640c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a75218d537c4d63874297261bec70ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:40.937889 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-34d404a0-acb5-47eb-948f-337fa02fbf28 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] 10.222.0.46 "GET /compute/v2.1/servers/f437ed26-18bf-4cd8-b804-da114755f27e" status: 200 len: 1508 microversion: 2.1 time: 0.180251 Jan 15 21:01:40.938987 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2024/4070] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:40 2022] GET /compute/v2.1/servers/f437ed26-18bf-4cd8-b804-da114755f27e => generated 1508 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:40.957527 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c01a215b-b4c0-4add-8786-b9e0b38da8ca tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:40.958707 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c01a215b-b4c0-4add-8786-b9e0b38da8ca tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: f437ed26-18bf-4cd8-b804-da114755f27e] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:40.967236 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c01a215b-b4c0-4add-8786-b9e0b38da8ca tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:40.968004 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c01a215b-b4c0-4add-8786-b9e0b38da8ca tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:40.969032 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c01a215b-b4c0-4add-8786-b9e0b38da8ca tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:40.969660 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c01a215b-b4c0-4add-8786-b9e0b38da8ca tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:40.982673 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e82d2537-8a4f-4473-8f44-d3edce6ebfba tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:40.984828 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e82d2537-8a4f-4473-8f44-d3edce6ebfba tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:41.006903 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c01a215b-b4c0-4add-8786-b9e0b38da8ca tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: f437ed26-18bf-4cd8-b804-da114755f27e] Going to try to terminate instance {{(pid=129365) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 21:01:41.023474 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e82d2537-8a4f-4473-8f44-d3edce6ebfba tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:41.024420 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e82d2537-8a4f-4473-8f44-d3edce6ebfba tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:41.030958 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e82d2537-8a4f-4473-8f44-d3edce6ebfba tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:41.031492 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e82d2537-8a4f-4473-8f44-d3edce6ebfba tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:41.114282 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e82d2537-8a4f-4473-8f44-d3edce6ebfba tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.135651 Jan 15 21:01:41.115829 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2025/4071] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:40 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:01:41.124322 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ecf48238-6b84-4eb3-9df0-31814e835d24 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:41.137747 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ecf48238-6b84-4eb3-9df0-31814e835d24 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:41.153816 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c01a215b-b4c0-4add-8786-b9e0b38da8ca tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] 10.222.0.46 "DELETE /compute/v2.1/servers/f437ed26-18bf-4cd8-b804-da114755f27e" status: 204 len: 0 microversion: 2.1 time: 0.200436 Jan 15 21:01:41.154546 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2047/4072] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 21:01:40 2022] DELETE /compute/v2.1/servers/f437ed26-18bf-4cd8-b804-da114755f27e => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 21:01:41.158142 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ecf48238-6b84-4eb3-9df0-31814e835d24 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:41.159172 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ecf48238-6b84-4eb3-9df0-31814e835d24 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:41.162942 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ecf48238-6b84-4eb3-9df0-31814e835d24 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:41.163402 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ecf48238-6b84-4eb3-9df0-31814e835d24 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:41.172525 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-92c29ab1-9787-49a4-bea9-79900c3ae94e tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:41.173170 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-92c29ab1-9787-49a4-bea9-79900c3ae94e tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: f437ed26-18bf-4cd8-b804-da114755f27e] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:41.191961 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-92c29ab1-9787-49a4-bea9-79900c3ae94e tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:41.192864 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-92c29ab1-9787-49a4-bea9-79900c3ae94e tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:41.194917 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-92c29ab1-9787-49a4-bea9-79900c3ae94e tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:41.195495 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-92c29ab1-9787-49a4-bea9-79900c3ae94e tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:41.235100 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-92c29ab1-9787-49a4-bea9-79900c3ae94e tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: f437ed26-18bf-4cd8-b804-da114755f27e] Going to try to terminate instance {{(pid=129365) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 21:01:41.240731 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ecf48238-6b84-4eb3-9df0-31814e835d24 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action" status: 200 len: 32628 microversion: 2.20 time: 0.122259 Jan 15 21:01:41.242081 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2026/4073] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:41 2022] POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action => generated 32628 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:01:41.247945 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-68381173-c51c-4ad0-9a44-7916bd4f67eb tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:41.250237 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-68381173-c51c-4ad0-9a44-7916bd4f67eb tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:41.260472 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-68381173-c51c-4ad0-9a44-7916bd4f67eb tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:41.260820 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-68381173-c51c-4ad0-9a44-7916bd4f67eb tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:41.263975 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-68381173-c51c-4ad0-9a44-7916bd4f67eb tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:41.264481 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-68381173-c51c-4ad0-9a44-7916bd4f67eb tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:41.310827 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.compute.api [None req-92c29ab1-9787-49a4-bea9-79900c3ae94e tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: f437ed26-18bf-4cd8-b804-da114755f27e] Instance is already in deleting state, ignoring this request Jan 15 21:01:41.311827 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-92c29ab1-9787-49a4-bea9-79900c3ae94e tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] 10.222.0.46 "DELETE /compute/v2.1/servers/f437ed26-18bf-4cd8-b804-da114755f27e" status: 204 len: 0 microversion: 2.1 time: 0.147770 Jan 15 21:01:41.312322 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2048/4074] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 21:01:41 2022] DELETE /compute/v2.1/servers/f437ed26-18bf-4cd8-b804-da114755f27e => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 21:01:41.323735 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-453b8ff2-08c1-42e4-b488-79e325efb489 req-c74f806f-dcac-4336-9583-604687720990 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11cbafd5-4836-48b9-8db6-440002deb281", "name": "network-vif-plugged", "status": "completed", "tag": "f19de7c9-cb20-4177-abf7-73605a4d6a80"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:41.323735 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:01:41.323735 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:01:41.334264 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-68381173-c51c-4ad0-9a44-7916bd4f67eb tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action" status: 200 len: 24508 microversion: 2.1 time: 0.090615 Jan 15 21:01:41.335516 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2027/4075] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:01:41 2022] POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action => generated 24508 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:01:41.340573 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-453b8ff2-08c1-42e4-b488-79e325efb489 req-c74f806f-dcac-4336-9583-604687720990 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:41.341278 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-453b8ff2-08c1-42e4-b488-79e325efb489 req-c74f806f-dcac-4336-9583-604687720990 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:41.349618 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-512c1a2b-f908-42dc-a9e8-fb231d7f9838 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:41.359481 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-512c1a2b-f908-42dc-a9e8-fb231d7f9838 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: f437ed26-18bf-4cd8-b804-da114755f27e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:41.371370 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-453b8ff2-08c1-42e4-b488-79e325efb489 req-c74f806f-dcac-4336-9583-604687720990 service nova] Creating event network-vif-plugged:f19de7c9-cb20-4177-abf7-73605a4d6a80 for instance 11cbafd5-4836-48b9-8db6-440002deb281 on nch1-master-1 Jan 15 21:01:41.380507 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-512c1a2b-f908-42dc-a9e8-fb231d7f9838 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:41.381745 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-512c1a2b-f908-42dc-a9e8-fb231d7f9838 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:41.381745 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-512c1a2b-f908-42dc-a9e8-fb231d7f9838 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:41.382204 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-512c1a2b-f908-42dc-a9e8-fb231d7f9838 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:41.390533 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-453b8ff2-08c1-42e4-b488-79e325efb489 req-c74f806f-dcac-4336-9583-604687720990 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073004 Jan 15 21:01:41.391266 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2049/4076] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:01:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:01:41.453667 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-baf5fca1-54c6-4a9b-8407-68c917a029cb tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:41.456215 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-baf5fca1-54c6-4a9b-8407-68c917a029cb tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:41.476504 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-baf5fca1-54c6-4a9b-8407-68c917a029cb tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:41.477007 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-baf5fca1-54c6-4a9b-8407-68c917a029cb tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:41.478584 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-baf5fca1-54c6-4a9b-8407-68c917a029cb tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:41.480627 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-baf5fca1-54c6-4a9b-8407-68c917a029cb tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:41.557825 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-baf5fca1-54c6-4a9b-8407-68c917a029cb tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 24546 microversion: 2.32 time: 0.108346 Jan 15 21:01:41.561774 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2050/4077] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:41 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 24546 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:01:41.567615 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-04d64578-c7ba-4faf-9adc-bf49313cd062 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:41.568695 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-04d64578-c7ba-4faf-9adc-bf49313cd062 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 11cbafd5-4836-48b9-8db6-440002deb281] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:41.576441 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-04d64578-c7ba-4faf-9adc-bf49313cd062 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:41.577368 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-04d64578-c7ba-4faf-9adc-bf49313cd062 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:41.578375 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-04d64578-c7ba-4faf-9adc-bf49313cd062 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:41.578980 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-04d64578-c7ba-4faf-9adc-bf49313cd062 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:41.616806 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-512c1a2b-f908-42dc-a9e8-fb231d7f9838 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8f9c6ea7f6496792258d683640c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a75218d537c4d63874297261bec70ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:41.625529 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-512c1a2b-f908-42dc-a9e8-fb231d7f9838 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] 10.222.0.46 "GET /compute/v2.1/servers/f437ed26-18bf-4cd8-b804-da114755f27e" status: 200 len: 1514 microversion: 2.1 time: 0.289142 Jan 15 21:01:41.627810 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2028/4078] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:41 2022] GET /compute/v2.1/servers/f437ed26-18bf-4cd8-b804-da114755f27e => generated 1514 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:41.733378 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-04d64578-c7ba-4faf-9adc-bf49313cd062 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:41.740878 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-04d64578-c7ba-4faf-9adc-bf49313cd062 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/11cbafd5-4836-48b9-8db6-440002deb281" status: 200 len: 1315 microversion: 2.1 time: 0.177616 Jan 15 21:01:41.741463 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2051/4079] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:41 2022] GET /compute/v2.1/servers/11cbafd5-4836-48b9-8db6-440002deb281 => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:42.126570 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a12a4a01-0632-456e-9b11-03b14a2c15de tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:42.127888 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a12a4a01-0632-456e-9b11-03b14a2c15de tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:42.135435 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a12a4a01-0632-456e-9b11-03b14a2c15de tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:42.135948 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a12a4a01-0632-456e-9b11-03b14a2c15de tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:42.136979 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a12a4a01-0632-456e-9b11-03b14a2c15de tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:42.137516 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a12a4a01-0632-456e-9b11-03b14a2c15de tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:42.174832 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8f8fd51b-0fcb-4c60-bb6f-aca7b01dcb28 tempest-VolumesTestJSON-1724704593 tempest-VolumesTestJSON-1724704593-project] Calling method '.version_select at 0x7f30c853b160>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:42.189617 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a12a4a01-0632-456e-9b11-03b14a2c15de tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.066734 Jan 15 21:01:42.191063 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2029/4080] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:42 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:01:42.229880 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-8f8fd51b-0fcb-4c60-bb6f-aca7b01dcb28 tempest-VolumesTestJSON-1724704593 tempest-VolumesTestJSON-1724704593-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/96ad96ac-d6ea-4de8-a9b8-65d8d67e8dae" status: 200 len: 344 microversion: 2.1 time: 0.058745 Jan 15 21:01:42.230594 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2052/4081] 10.222.0.46 () {58 vars in 1244 bytes} [Sat Jan 15 21:01:42 2022] GET /compute/v2.1/os-volumes/96ad96ac-d6ea-4de8-a9b8-65d8d67e8dae => generated 344 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:01:42.252722 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-03365fa7-3e15-4957-98cd-d455b9a6391d tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:42.253780 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-03365fa7-3e15-4957-98cd-d455b9a6391d tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:42.260808 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-03365fa7-3e15-4957-98cd-d455b9a6391d tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:42.261295 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-03365fa7-3e15-4957-98cd-d455b9a6391d tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:42.262088 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-03365fa7-3e15-4957-98cd-d455b9a6391d tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:42.262528 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-03365fa7-3e15-4957-98cd-d455b9a6391d tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:42.303964 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-03365fa7-3e15-4957-98cd-d455b9a6391d tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action" status: 200 len: 32628 microversion: 2.20 time: 0.055860 Jan 15 21:01:42.306000 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2030/4082] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:42 2022] POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action => generated 32628 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:01:42.346715 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-bd67b452-e9de-4af2-8662-981ea0e453da tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:42.347633 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-bd67b452-e9de-4af2-8662-981ea0e453da tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:42.371098 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bd67b452-e9de-4af2-8662-981ea0e453da tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:42.377799 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bd67b452-e9de-4af2-8662-981ea0e453da tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:42.377799 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bd67b452-e9de-4af2-8662-981ea0e453da tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:42.378981 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bd67b452-e9de-4af2-8662-981ea0e453da tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:42.425394 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-bd67b452-e9de-4af2-8662-981ea0e453da tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action" status: 200 len: 24508 microversion: 2.1 time: 0.082775 Jan 15 21:01:42.426352 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2053/4083] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:01:42 2022] POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action => generated 24508 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:01:42.575778 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e0af150f-6389-492d-bd15-b17b84c90368 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:42.577201 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e0af150f-6389-492d-bd15-b17b84c90368 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:42.587522 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e0af150f-6389-492d-bd15-b17b84c90368 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:42.588179 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e0af150f-6389-492d-bd15-b17b84c90368 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:42.590152 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e0af150f-6389-492d-bd15-b17b84c90368 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:42.590655 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e0af150f-6389-492d-bd15-b17b84c90368 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:42.647103 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f3711db5-1d7a-4c59-8e8f-19fd9b1136cb tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:42.649822 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f3711db5-1d7a-4c59-8e8f-19fd9b1136cb tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: f437ed26-18bf-4cd8-b804-da114755f27e] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:42.654935 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e0af150f-6389-492d-bd15-b17b84c90368 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 24546 microversion: 2.32 time: 0.085730 Jan 15 21:01:42.655871 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2031/4084] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:42 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 24546 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:01:42.663692 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f3711db5-1d7a-4c59-8e8f-19fd9b1136cb tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:42.664150 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f3711db5-1d7a-4c59-8e8f-19fd9b1136cb tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:42.664978 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f3711db5-1d7a-4c59-8e8f-19fd9b1136cb tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:42.665594 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f3711db5-1d7a-4c59-8e8f-19fd9b1136cb tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:42.757890 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-2a8bdf89-d5b8-4f82-bf6c-b25cafa17e61 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:42.759097 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-2a8bdf89-d5b8-4f82-bf6c-b25cafa17e61 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 11cbafd5-4836-48b9-8db6-440002deb281] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:42.773388 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2a8bdf89-d5b8-4f82-bf6c-b25cafa17e61 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:42.774104 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2a8bdf89-d5b8-4f82-bf6c-b25cafa17e61 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:42.776119 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2a8bdf89-d5b8-4f82-bf6c-b25cafa17e61 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:42.777764 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2a8bdf89-d5b8-4f82-bf6c-b25cafa17e61 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:42.918204 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-f3711db5-1d7a-4c59-8e8f-19fd9b1136cb tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8f9c6ea7f6496792258d683640c838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a75218d537c4d63874297261bec70ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:42.930188 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f3711db5-1d7a-4c59-8e8f-19fd9b1136cb tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] 10.222.0.46 "GET /compute/v2.1/servers/f437ed26-18bf-4cd8-b804-da114755f27e" status: 200 len: 1514 microversion: 2.1 time: 0.288273 Jan 15 21:01:42.930795 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2054/4085] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:42 2022] GET /compute/v2.1/servers/f437ed26-18bf-4cd8-b804-da114755f27e => generated 1514 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:01:43.022237 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-2a8bdf89-d5b8-4f82-bf6c-b25cafa17e61 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:43.030699 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-2a8bdf89-d5b8-4f82-bf6c-b25cafa17e61 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/11cbafd5-4836-48b9-8db6-440002deb281" status: 200 len: 1315 microversion: 2.1 time: 0.277029 Jan 15 21:01:43.031741 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2032/4086] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:42 2022] GET /compute/v2.1/servers/11cbafd5-4836-48b9-8db6-440002deb281 => generated 1315 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:43.203571 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-437ae63b-0880-4168-8ff8-fc5471442d3a tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:43.206177 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-437ae63b-0880-4168-8ff8-fc5471442d3a tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:43.211533 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-a6cb8e30-016f-4087-a05b-8e07185ec726 req-c7579836-d831-46f0-b242-94a0d6a63d53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f437ed26-18bf-4cd8-b804-da114755f27e", "name": "network-vif-deleted", "tag": "f665537c-6da1-4935-8603-6f099be4c06c"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:43.213691 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:01:43.213691 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:01:43.217931 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-437ae63b-0880-4168-8ff8-fc5471442d3a tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:43.218593 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-437ae63b-0880-4168-8ff8-fc5471442d3a tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:43.219411 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-437ae63b-0880-4168-8ff8-fc5471442d3a tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:43.219853 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-437ae63b-0880-4168-8ff8-fc5471442d3a tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:43.225333 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-a6cb8e30-016f-4087-a05b-8e07185ec726 req-c7579836-d831-46f0-b242-94a0d6a63d53 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:43.226032 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-a6cb8e30-016f-4087-a05b-8e07185ec726 req-c7579836-d831-46f0-b242-94a0d6a63d53 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:43.239287 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-a6cb8e30-016f-4087-a05b-8e07185ec726 req-c7579836-d831-46f0-b242-94a0d6a63d53 service nova] Creating event network-vif-deleted:f665537c-6da1-4935-8603-6f099be4c06c for instance f437ed26-18bf-4cd8-b804-da114755f27e on nch2-master-1 Jan 15 21:01:43.245514 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-a6cb8e30-016f-4087-a05b-8e07185ec726 req-c7579836-d831-46f0-b242-94a0d6a63d53 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040107 Jan 15 21:01:43.251665 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2033/4087] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:01:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:01:43.296233 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-437ae63b-0880-4168-8ff8-fc5471442d3a tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.096962 Jan 15 21:01:43.297536 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2055/4088] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:43 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:01:43.319590 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-fde5b50a-c12a-4065-b345-86c0e082b785 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:43.320634 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-fde5b50a-c12a-4065-b345-86c0e082b785 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:43.327107 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fde5b50a-c12a-4065-b345-86c0e082b785 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:43.328292 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fde5b50a-c12a-4065-b345-86c0e082b785 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:43.329125 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fde5b50a-c12a-4065-b345-86c0e082b785 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:43.329925 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fde5b50a-c12a-4065-b345-86c0e082b785 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:43.394705 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-fde5b50a-c12a-4065-b345-86c0e082b785 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action" status: 200 len: 32628 microversion: 2.20 time: 0.081131 Jan 15 21:01:43.395405 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2034/4089] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:43 2022] POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action => generated 32628 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:01:43.438441 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-088036d0-a0ab-4dc7-b5f8-82c2b107463c tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:43.439656 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-088036d0-a0ab-4dc7-b5f8-82c2b107463c tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:43.447531 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-088036d0-a0ab-4dc7-b5f8-82c2b107463c tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:43.447978 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-088036d0-a0ab-4dc7-b5f8-82c2b107463c tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:43.449133 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-088036d0-a0ab-4dc7-b5f8-82c2b107463c tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:43.449515 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-088036d0-a0ab-4dc7-b5f8-82c2b107463c tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:43.508824 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-088036d0-a0ab-4dc7-b5f8-82c2b107463c tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action" status: 200 len: 32580 microversion: 2.1 time: 0.074611 Jan 15 21:01:43.509517 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2056/4090] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:01:43 2022] POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action => generated 32580 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:01:43.605437 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b8d5020d-3a94-4b22-914f-3e8268bf9b10 tempest-VolumesTestJSON-1724704593 tempest-VolumesTestJSON-1724704593-project] Calling method '.version_select at 0x7f30cec0a940>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:43.661702 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b8d5020d-3a94-4b22-914f-3e8268bf9b10 tempest-VolumesTestJSON-1724704593 tempest-VolumesTestJSON-1724704593-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/88151be2-e3e8-4786-9c72-cc1bf5f8c7b8" status: 200 len: 344 microversion: 2.1 time: 0.060459 Jan 15 21:01:43.662907 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2035/4091] 10.222.0.46 () {58 vars in 1244 bytes} [Sat Jan 15 21:01:43 2022] GET /compute/v2.1/os-volumes/88151be2-e3e8-4786-9c72-cc1bf5f8c7b8 => generated 344 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:01:43.672790 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-13b485e3-61d8-4a19-b679-2e5e790555b9 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:43.673942 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-13b485e3-61d8-4a19-b679-2e5e790555b9 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:43.680944 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-13b485e3-61d8-4a19-b679-2e5e790555b9 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:43.681667 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-13b485e3-61d8-4a19-b679-2e5e790555b9 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:43.682467 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-13b485e3-61d8-4a19-b679-2e5e790555b9 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:43.683104 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-13b485e3-61d8-4a19-b679-2e5e790555b9 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:43.736174 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-13b485e3-61d8-4a19-b679-2e5e790555b9 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 24546 microversion: 2.32 time: 0.073003 Jan 15 21:01:43.741082 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2057/4092] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:43 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 24546 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:01:43.944651 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8aa3ebbf-1165-40f5-aebb-f7fa3f8576ec tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Action: 'create', calling method: .version_select at 0x7f30c8e5d8b0>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-789423460", "policies": ["affinity"]}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:43.954556 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-af11ae9a-b09e-472c-b34b-d36df4f86dc9 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:43.956137 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-af11ae9a-b09e-472c-b34b-d36df4f86dc9 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: f437ed26-18bf-4cd8-b804-da114755f27e] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:43.962224 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-8aa3ebbf-1165-40f5-aebb-f7fa3f8576ec tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Getting quotas for project 769ee4a0d84d43abbed6cdcc4d536de7. Resources: {'server_groups'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:01:43.964092 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-af11ae9a-b09e-472c-b34b-d36df4f86dc9 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:43.964549 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-af11ae9a-b09e-472c-b34b-d36df4f86dc9 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:43.965442 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-af11ae9a-b09e-472c-b34b-d36df4f86dc9 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:43.965881 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-af11ae9a-b09e-472c-b34b-d36df4f86dc9 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:43.967685 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-8aa3ebbf-1165-40f5-aebb-f7fa3f8576ec tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Getting quotas for user f084ea51b9d7466cb5e99881ce59e1c3 and project 769ee4a0d84d43abbed6cdcc4d536de7. Resources: {'server_groups'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:01:43.981518 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-af11ae9a-b09e-472c-b34b-d36df4f86dc9 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] HTTP exception thrown: Instance f437ed26-18bf-4cd8-b804-da114755f27e could not be found. Jan 15 21:01:43.982502 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-af11ae9a-b09e-472c-b34b-d36df4f86dc9 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Returning 404 to user: Instance f437ed26-18bf-4cd8-b804-da114755f27e could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:01:43.982963 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-af11ae9a-b09e-472c-b34b-d36df4f86dc9 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] 10.222.0.46 "GET /compute/v2.1/servers/f437ed26-18bf-4cd8-b804-da114755f27e" status: 404 len: 111 microversion: 2.1 time: 0.032813 Jan 15 21:01:43.983524 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2058/4093] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:43 2022] GET /compute/v2.1/servers/f437ed26-18bf-4cd8-b804-da114755f27e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:01:43.992744 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d0607642-f5c1-4f23-a66b-d319b5477968 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:43.993453 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d0607642-f5c1-4f23-a66b-d319b5477968 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: 4d836f07-866f-4e13-94ff-c4fe850e58d3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:44.000447 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d0607642-f5c1-4f23-a66b-d319b5477968 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:44.001376 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d0607642-f5c1-4f23-a66b-d319b5477968 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:44.003208 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d0607642-f5c1-4f23-a66b-d319b5477968 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:44.003662 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d0607642-f5c1-4f23-a66b-d319b5477968 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:44.019708 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-d0607642-f5c1-4f23-a66b-d319b5477968 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] HTTP exception thrown: Instance 4d836f07-866f-4e13-94ff-c4fe850e58d3 could not be found. Jan 15 21:01:44.020557 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d0607642-f5c1-4f23-a66b-d319b5477968 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Returning 404 to user: Instance 4d836f07-866f-4e13-94ff-c4fe850e58d3 could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:01:44.021927 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d0607642-f5c1-4f23-a66b-d319b5477968 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] 10.222.0.46 "DELETE /compute/v2.1/servers/4d836f07-866f-4e13-94ff-c4fe850e58d3" status: 404 len: 111 microversion: 2.1 time: 0.033587 Jan 15 21:01:44.022960 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2059/4094] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 21:01:43 2022] DELETE /compute/v2.1/servers/4d836f07-866f-4e13-94ff-c4fe850e58d3 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:01:44.032304 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3298e13f-3171-404d-8d86-15ed3f651a7b tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:44.034151 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-3298e13f-3171-404d-8d86-15ed3f651a7b tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: 4d836f07-866f-4e13-94ff-c4fe850e58d3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:44.041469 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3298e13f-3171-404d-8d86-15ed3f651a7b tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:44.041937 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3298e13f-3171-404d-8d86-15ed3f651a7b tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:44.042829 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3298e13f-3171-404d-8d86-15ed3f651a7b tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:44.043535 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-8aa3ebbf-1165-40f5-aebb-f7fa3f8576ec tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Getting quotas for project 769ee4a0d84d43abbed6cdcc4d536de7. Resources: {'server_groups'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:01:44.043664 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3298e13f-3171-404d-8d86-15ed3f651a7b tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:44.050331 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-8aa3ebbf-1165-40f5-aebb-f7fa3f8576ec tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Getting quotas for user f084ea51b9d7466cb5e99881ce59e1c3 and project 769ee4a0d84d43abbed6cdcc4d536de7. Resources: {'server_groups'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:01:44.065268 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-3298e13f-3171-404d-8d86-15ed3f651a7b tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] HTTP exception thrown: Instance 4d836f07-866f-4e13-94ff-c4fe850e58d3 could not be found. Jan 15 21:01:44.066221 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3298e13f-3171-404d-8d86-15ed3f651a7b tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Returning 404 to user: Instance 4d836f07-866f-4e13-94ff-c4fe850e58d3 could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:01:44.066627 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-8aa3ebbf-1165-40f5-aebb-f7fa3f8576ec tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] 10.222.0.46 "POST /compute/v2.1/os-server-groups" status: 200 len: 183 microversion: 2.1 time: 0.272056 Jan 15 21:01:44.066954 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3298e13f-3171-404d-8d86-15ed3f651a7b tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] 10.222.0.46 "GET /compute/v2.1/servers/4d836f07-866f-4e13-94ff-c4fe850e58d3" status: 404 len: 111 microversion: 2.1 time: 0.039514 Jan 15 21:01:44.067251 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2036/4095] 10.222.0.46 () {60 vars in 1173 bytes} [Sat Jan 15 21:01:43 2022] POST /compute/v2.1/os-server-groups => generated 183 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 21:01:44.069421 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2060/4096] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:44 2022] GET /compute/v2.1/servers/4d836f07-866f-4e13-94ff-c4fe850e58d3 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:01:44.072320 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-fb1c8ce1-ad3b-4da3-b581-e764d65463f0 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:44.073080 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-fb1c8ce1-ad3b-4da3-b581-e764d65463f0 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 11cbafd5-4836-48b9-8db6-440002deb281] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:44.079491 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fb1c8ce1-ad3b-4da3-b581-e764d65463f0 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:44.080436 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fb1c8ce1-ad3b-4da3-b581-e764d65463f0 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:44.081493 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-861daa1e-68a5-47a9-8a6d-5b03b6a9d6af tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Action: 'create', calling method: .version_select at 0x7f30c8535dc0>, body: {"server_group": {"name": "tempest-server-group-190267543", "policies": ["affinity"]}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:44.081632 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fb1c8ce1-ad3b-4da3-b581-e764d65463f0 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:44.081941 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fb1c8ce1-ad3b-4da3-b581-e764d65463f0 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:44.100034 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-861daa1e-68a5-47a9-8a6d-5b03b6a9d6af tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Getting quotas for project 769ee4a0d84d43abbed6cdcc4d536de7. Resources: {'server_groups'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:01:44.107253 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-861daa1e-68a5-47a9-8a6d-5b03b6a9d6af tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Getting quotas for user f084ea51b9d7466cb5e99881ce59e1c3 and project 769ee4a0d84d43abbed6cdcc4d536de7. Resources: {'server_groups'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:01:44.155453 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-861daa1e-68a5-47a9-8a6d-5b03b6a9d6af tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Getting quotas for project 769ee4a0d84d43abbed6cdcc4d536de7. Resources: {'server_groups'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:01:44.161503 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-861daa1e-68a5-47a9-8a6d-5b03b6a9d6af tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Getting quotas for user f084ea51b9d7466cb5e99881ce59e1c3 and project 769ee4a0d84d43abbed6cdcc4d536de7. Resources: {'server_groups'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:01:44.175833 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-861daa1e-68a5-47a9-8a6d-5b03b6a9d6af tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] 10.222.0.46 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.098700 Jan 15 21:01:44.176435 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2061/4097] 10.222.0.46 () {60 vars in 1172 bytes} [Sat Jan 15 21:01:44 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:01:44.181226 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-03cec472-477a-49c5-8c18-1baadd322b2b tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:44.181797 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-03cec472-477a-49c5-8c18-1baadd322b2b tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: c8986b09-8342-4290-87be-22cece488c73] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:44.188698 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-03cec472-477a-49c5-8c18-1baadd322b2b tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:44.189196 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-03cec472-477a-49c5-8c18-1baadd322b2b tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:44.190515 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-03cec472-477a-49c5-8c18-1baadd322b2b tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:44.191234 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-03cec472-477a-49c5-8c18-1baadd322b2b tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:44.212738 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-03cec472-477a-49c5-8c18-1baadd322b2b tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] HTTP exception thrown: Instance c8986b09-8342-4290-87be-22cece488c73 could not be found. Jan 15 21:01:44.214564 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-03cec472-477a-49c5-8c18-1baadd322b2b tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Returning 404 to user: Instance c8986b09-8342-4290-87be-22cece488c73 could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:01:44.216234 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-03cec472-477a-49c5-8c18-1baadd322b2b tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] 10.222.0.46 "DELETE /compute/v2.1/servers/c8986b09-8342-4290-87be-22cece488c73" status: 404 len: 111 microversion: 2.1 time: 0.038337 Jan 15 21:01:44.217334 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2062/4098] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 21:01:44 2022] DELETE /compute/v2.1/servers/c8986b09-8342-4290-87be-22cece488c73 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:01:44.226766 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-956c1ab4-f19a-4131-896d-a8d443299fcc tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Action: 'create', calling method: .version_select at 0x7f30ceb79670>, body: {"server_group": {"name": "tempest-server-group-190267543", "policies": ["affinity"]}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:44.249884 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-fb1c8ce1-ad3b-4da3-b581-e764d65463f0 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:44.251887 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-956c1ab4-f19a-4131-896d-a8d443299fcc tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Getting quotas for project 769ee4a0d84d43abbed6cdcc4d536de7. Resources: {'server_groups'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:01:44.259172 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-956c1ab4-f19a-4131-896d-a8d443299fcc tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Getting quotas for user f084ea51b9d7466cb5e99881ce59e1c3 and project 769ee4a0d84d43abbed6cdcc4d536de7. Resources: {'server_groups'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:01:44.261059 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-fb1c8ce1-ad3b-4da3-b581-e764d65463f0 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/11cbafd5-4836-48b9-8db6-440002deb281" status: 200 len: 1502 microversion: 2.1 time: 0.192716 Jan 15 21:01:44.262619 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2037/4099] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:44 2022] GET /compute/v2.1/servers/11cbafd5-4836-48b9-8db6-440002deb281 => generated 1502 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:44.267356 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f23c7ff3-0c3f-4066-be03-a562f7d35f15 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:44.268722 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f23c7ff3-0c3f-4066-be03-a562f7d35f15 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] [instance: c8986b09-8342-4290-87be-22cece488c73] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:44.276860 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f23c7ff3-0c3f-4066-be03-a562f7d35f15 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:44.277800 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f23c7ff3-0c3f-4066-be03-a562f7d35f15 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:44.279002 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f23c7ff3-0c3f-4066-be03-a562f7d35f15 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:44.279715 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f23c7ff3-0c3f-4066-be03-a562f7d35f15 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:44.301989 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-f23c7ff3-0c3f-4066-be03-a562f7d35f15 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] HTTP exception thrown: Instance c8986b09-8342-4290-87be-22cece488c73 could not be found. Jan 15 21:01:44.302698 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f23c7ff3-0c3f-4066-be03-a562f7d35f15 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] Returning 404 to user: Instance c8986b09-8342-4290-87be-22cece488c73 could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:01:44.303606 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f23c7ff3-0c3f-4066-be03-a562f7d35f15 tempest-ServerDiskConfigTestJSON-205891383 tempest-ServerDiskConfigTestJSON-205891383-project] 10.222.0.46 "GET /compute/v2.1/servers/c8986b09-8342-4290-87be-22cece488c73" status: 404 len: 111 microversion: 2.1 time: 0.039646 Jan 15 21:01:44.304622 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2038/4100] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:44 2022] GET /compute/v2.1/servers/c8986b09-8342-4290-87be-22cece488c73 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:01:44.314271 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-72e67c49-3621-412f-8cf3-fe5f0dc1559e tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:44.320584 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-956c1ab4-f19a-4131-896d-a8d443299fcc tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Getting quotas for project 769ee4a0d84d43abbed6cdcc4d536de7. Resources: {'server_groups'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:01:44.331213 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-956c1ab4-f19a-4131-896d-a8d443299fcc tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Getting quotas for user f084ea51b9d7466cb5e99881ce59e1c3 and project 769ee4a0d84d43abbed6cdcc4d536de7. Resources: {'server_groups'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:01:44.338733 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-72e67c49-3621-412f-8cf3-fe5f0dc1559e tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:44.339224 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-72e67c49-3621-412f-8cf3-fe5f0dc1559e tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:44.346421 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-956c1ab4-f19a-4131-896d-a8d443299fcc tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] 10.222.0.46 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.127471 Jan 15 21:01:44.348208 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2063/4101] 10.222.0.46 () {60 vars in 1172 bytes} [Sat Jan 15 21:01:44 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:01:44.366366 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-6aebcb5e-8b80-43ae-9a57-3d25f0b75b47 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:44.367418 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-6aebcb5e-8b80-43ae-9a57-3d25f0b75b47 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:44.378458 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-72e67c49-3621-412f-8cf3-fe5f0dc1559e tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 11cbafd5-4836-48b9-8db6-440002deb281] Going to try to stop instance {{(pid=129366) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Jan 15 21:01:44.386845 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6aebcb5e-8b80-43ae-9a57-3d25f0b75b47 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:44.387501 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6aebcb5e-8b80-43ae-9a57-3d25f0b75b47 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:44.388376 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6aebcb5e-8b80-43ae-9a57-3d25f0b75b47 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:44.388929 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6aebcb5e-8b80-43ae-9a57-3d25f0b75b47 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:44.436516 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-72e67c49-3621-412f-8cf3-fe5f0dc1559e tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "POST /compute/v2.1/servers/11cbafd5-4836-48b9-8db6-440002deb281/action" status: 202 len: 0 microversion: 2.1 time: 0.126398 Jan 15 21:01:44.441522 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-6aebcb5e-8b80-43ae-9a57-3d25f0b75b47 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.092004 Jan 15 21:01:44.442423 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2039/4102] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:01:44 2022] POST /compute/v2.1/servers/11cbafd5-4836-48b9-8db6-440002deb281/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:01:44.447954 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-2aceb9e4-491a-414d-a5d2-fc93ac5b67d8 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:44.452570 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2064/4103] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:44 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:01:44.460552 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ccffcecd-cd74-463c-aaa4-0bb98498ebd4 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:44.461979 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ccffcecd-cd74-463c-aaa4-0bb98498ebd4 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:44.479228 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ccffcecd-cd74-463c-aaa4-0bb98498ebd4 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:44.479764 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ccffcecd-cd74-463c-aaa4-0bb98498ebd4 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:44.480690 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ccffcecd-cd74-463c-aaa4-0bb98498ebd4 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:44.481744 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ccffcecd-cd74-463c-aaa4-0bb98498ebd4 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:44.494744 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-2aceb9e4-491a-414d-a5d2-fc93ac5b67d8 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] 10.222.0.46 "DELETE /compute/v2.1/os-server-groups/bbd2f0e9-e528-459d-b2bc-566bde5f1379" status: 204 len: 0 microversion: 2.1 time: 0.050976 Jan 15 21:01:44.495664 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2040/4104] 10.222.0.46 () {58 vars in 1265 bytes} [Sat Jan 15 21:01:44 2022] DELETE /compute/v2.1/os-server-groups/bbd2f0e9-e528-459d-b2bc-566bde5f1379 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 21:01:44.506071 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4aaca1fb-4ac1-4303-ab85-9446082d4b8e tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:44.506874 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-4aaca1fb-4ac1-4303-ab85-9446082d4b8e tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 11cbafd5-4836-48b9-8db6-440002deb281] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:44.515787 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4aaca1fb-4ac1-4303-ab85-9446082d4b8e tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:44.515787 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4aaca1fb-4ac1-4303-ab85-9446082d4b8e tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:44.516118 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4aaca1fb-4ac1-4303-ab85-9446082d4b8e tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:44.516547 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4aaca1fb-4ac1-4303-ab85-9446082d4b8e tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:44.537029 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ccffcecd-cd74-463c-aaa4-0bb98498ebd4 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action" status: 200 len: 32628 microversion: 2.20 time: 0.085028 Jan 15 21:01:44.540146 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2065/4105] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:44 2022] POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action => generated 32628 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:01:44.545761 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-618eed3d-8f63-4ac5-8232-ba2538a18cf9 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:44.568671 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-618eed3d-8f63-4ac5-8232-ba2538a18cf9 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] 10.222.0.46 "GET /compute/v2.1/os-server-groups" status: 200 len: 333 microversion: 2.1 time: 0.026894 Jan 15 21:01:44.569967 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2066/4106] 10.222.0.46 () {58 vars in 1151 bytes} [Sat Jan 15 21:01:44 2022] GET /compute/v2.1/os-server-groups => generated 333 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:01:44.581403 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ae0a6add-7750-48ac-adee-7039f8b9d0db tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:44.582948 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ae0a6add-7750-48ac-adee-7039f8b9d0db tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:44.591711 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ae0a6add-7750-48ac-adee-7039f8b9d0db tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:44.592569 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ae0a6add-7750-48ac-adee-7039f8b9d0db tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:44.593743 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ae0a6add-7750-48ac-adee-7039f8b9d0db tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:44.594462 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ae0a6add-7750-48ac-adee-7039f8b9d0db tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:44.649968 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ae0a6add-7750-48ac-adee-7039f8b9d0db tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action" status: 200 len: 32580 microversion: 2.1 time: 0.073086 Jan 15 21:01:44.651604 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2067/4107] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:01:44 2022] POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action => generated 32580 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:01:44.659303 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d7003b2c-ab2c-4199-8040-a249f55709e3 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:44.693245 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d7003b2c-ab2c-4199-8040-a249f55709e3 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] 10.222.0.46 "DELETE /compute/v2.1/os-server-groups/b3e1af76-fd65-4c24-86ad-85fb5891ca60" status: 204 len: 0 microversion: 2.1 time: 0.039786 Jan 15 21:01:44.693897 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2068/4108] 10.222.0.46 () {58 vars in 1265 bytes} [Sat Jan 15 21:01:44 2022] DELETE /compute/v2.1/os-server-groups/b3e1af76-fd65-4c24-86ad-85fb5891ca60 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 21:01:44.702498 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-21055b75-67a3-466d-9fb1-aae32dbb7282 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:44.716073 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-21055b75-67a3-466d-9fb1-aae32dbb7282 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] 10.222.0.46 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.016693 Jan 15 21:01:44.716673 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2069/4109] 10.222.0.46 () {58 vars in 1151 bytes} [Sat Jan 15 21:01:44 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:01:44.728750 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a17fe0f2-026e-4d39-93ed-8ef415aef35e tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Action: 'create', calling method: .version_select at 0x7f30c8594700>, body: {"server_group": {"name": "tempest-server-group-1827828050", "policies": ["affinity"]}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:44.745411 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-a17fe0f2-026e-4d39-93ed-8ef415aef35e tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Getting quotas for project 769ee4a0d84d43abbed6cdcc4d536de7. Resources: {'server_groups'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:01:44.750595 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-a17fe0f2-026e-4d39-93ed-8ef415aef35e tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Getting quotas for user f084ea51b9d7466cb5e99881ce59e1c3 and project 769ee4a0d84d43abbed6cdcc4d536de7. Resources: {'server_groups'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:01:44.777352 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-4aaca1fb-4ac1-4303-ab85-9446082d4b8e tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:44.786759 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-4aaca1fb-4ac1-4303-ab85-9446082d4b8e tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/11cbafd5-4836-48b9-8db6-440002deb281" status: 200 len: 1512 microversion: 2.1 time: 0.288709 Jan 15 21:01:44.787433 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2041/4110] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:44 2022] GET /compute/v2.1/servers/11cbafd5-4836-48b9-8db6-440002deb281 => generated 1512 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:44.792060 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-5a32f835-41a6-42e5-ac6d-6b5408720a7d tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:44.793254 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-5a32f835-41a6-42e5-ac6d-6b5408720a7d tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:44.799508 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5a32f835-41a6-42e5-ac6d-6b5408720a7d tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:44.800028 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5a32f835-41a6-42e5-ac6d-6b5408720a7d tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:44.801019 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5a32f835-41a6-42e5-ac6d-6b5408720a7d tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:44.801613 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5a32f835-41a6-42e5-ac6d-6b5408720a7d tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:44.807467 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-a17fe0f2-026e-4d39-93ed-8ef415aef35e tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Getting quotas for project 769ee4a0d84d43abbed6cdcc4d536de7. Resources: {'server_groups'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:01:44.813381 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-a17fe0f2-026e-4d39-93ed-8ef415aef35e tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Getting quotas for user f084ea51b9d7466cb5e99881ce59e1c3 and project 769ee4a0d84d43abbed6cdcc4d536de7. Resources: {'server_groups'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:01:44.827678 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a17fe0f2-026e-4d39-93ed-8ef415aef35e tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] 10.222.0.46 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.102512 Jan 15 21:01:44.828572 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2070/4111] 10.222.0.46 () {60 vars in 1172 bytes} [Sat Jan 15 21:01:44 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:01:44.838274 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a71c50ee-be0d-4e8b-9ef0-d322d7692214 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:44.849469 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-5a32f835-41a6-42e5-ac6d-6b5408720a7d tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 24546 microversion: 2.32 time: 0.060436 Jan 15 21:01:44.851034 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2042/4112] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:44 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 24546 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:01:44.862886 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a71c50ee-be0d-4e8b-9ef0-d322d7692214 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] 10.222.0.46 "DELETE /compute/v2.1/os-server-groups/83802644-f267-48c8-a461-1b26bd6831d1" status: 204 len: 0 microversion: 2.1 time: 0.028120 Jan 15 21:01:44.863632 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2071/4113] 10.222.0.46 () {58 vars in 1265 bytes} [Sat Jan 15 21:01:44 2022] DELETE /compute/v2.1/os-server-groups/83802644-f267-48c8-a461-1b26bd6831d1 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 15 21:01:44.871592 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-fbed1ec5-be85-4843-b53f-1805a4a170ed tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:44.886921 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-fbed1ec5-be85-4843-b53f-1805a4a170ed tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] 10.222.0.46 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.019171 Jan 15 21:01:44.887485 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2043/4114] 10.222.0.46 () {58 vars in 1151 bytes} [Sat Jan 15 21:01:44 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:01:44.898708 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3b71039b-08a7-4290-9bb9-a31a0b6f2d68 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Action: 'create', calling method: .version_select at 0x7f30c85948b0>, body: {"server_group": {"name": "tempest-server-group-871198850", "policies": ["anti-affinity"]}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:44.916255 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-3b71039b-08a7-4290-9bb9-a31a0b6f2d68 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Getting quotas for project 769ee4a0d84d43abbed6cdcc4d536de7. Resources: {'server_groups'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:01:44.925745 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-3b71039b-08a7-4290-9bb9-a31a0b6f2d68 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Getting quotas for user f084ea51b9d7466cb5e99881ce59e1c3 and project 769ee4a0d84d43abbed6cdcc4d536de7. Resources: {'server_groups'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:01:44.969320 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-3b71039b-08a7-4290-9bb9-a31a0b6f2d68 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Getting quotas for project 769ee4a0d84d43abbed6cdcc4d536de7. Resources: {'server_groups'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:01:44.975572 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-3b71039b-08a7-4290-9bb9-a31a0b6f2d68 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Getting quotas for user f084ea51b9d7466cb5e99881ce59e1c3 and project 769ee4a0d84d43abbed6cdcc4d536de7. Resources: {'server_groups'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:01:44.990381 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3b71039b-08a7-4290-9bb9-a31a0b6f2d68 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] 10.222.0.46 "POST /compute/v2.1/os-server-groups" status: 200 len: 168 microversion: 2.1 time: 0.095493 Jan 15 21:01:44.991336 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2072/4115] 10.222.0.46 () {60 vars in 1172 bytes} [Sat Jan 15 21:01:44 2022] POST /compute/v2.1/os-server-groups => generated 168 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:01:45.001742 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0060a36f-5e33-4c4f-a375-a97c77471c1f tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:45.029710 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0060a36f-5e33-4c4f-a375-a97c77471c1f tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] 10.222.0.46 "DELETE /compute/v2.1/os-server-groups/ea465c3d-3299-48ad-b678-8f6358eb5366" status: 204 len: 0 microversion: 2.1 time: 0.032509 Jan 15 21:01:45.030459 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2044/4116] 10.222.0.46 () {58 vars in 1265 bytes} [Sat Jan 15 21:01:44 2022] DELETE /compute/v2.1/os-server-groups/ea465c3d-3299-48ad-b678-8f6358eb5366 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 21:01:45.038958 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5864de24-3d04-4882-9bef-37ca1f06f591 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:45.048265 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5864de24-3d04-4882-9bef-37ca1f06f591 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] 10.222.0.46 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.012858 Jan 15 21:01:45.049123 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2073/4117] 10.222.0.46 () {58 vars in 1151 bytes} [Sat Jan 15 21:01:45 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:01:45.106434 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-936370d6-8b4a-496e-936a-371d072bfaa7 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-1380002148", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "networks": [{"uuid": "66c03dbb-842c-460e-99ad-2e1cc04c8ce1"}]}, "os:scheduler_hints": {"group": "de2ddae4-b545-4b41-bc9f-1b3b96f3da91"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:45.129311 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8e69fee9-3759-45b0-82d7-57b8f6fceb91 tempest-VolumesTestJSON-1724704593 tempest-VolumesTestJSON-1724704593-project] Calling method '.version_select at 0x7f30c8801790>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:45.166270 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.network.neutron [None req-936370d6-8b4a-496e-936a-371d072bfaa7 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] validate_networks() for [('66c03dbb-842c-460e-99ad-2e1cc04c8ce1', None, None, None, None, None)] {{(pid=129366) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 21:01:45.187062 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-8e69fee9-3759-45b0-82d7-57b8f6fceb91 tempest-VolumesTestJSON-1724704593 tempest-VolumesTestJSON-1724704593-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/b3475c51-c24c-4b04-9848-18db8206659f" status: 200 len: 342 microversion: 2.1 time: 0.061924 Jan 15 21:01:45.187951 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2074/4118] 10.222.0.46 () {58 vars in 1244 bytes} [Sat Jan 15 21:01:45 2022] GET /compute/v2.1/os-volumes/b3475c51-c24c-4b04-9848-18db8206659f => generated 342 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 21:01:45.200026 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c02d3eef-35db-451f-a622-fce7c6ad9631 tempest-VolumesTestJSON-1724704593 tempest-VolumesTestJSON-1724704593-project] Calling method '.version_select at 0x7f30c8535160>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:45.297355 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c02d3eef-35db-451f-a622-fce7c6ad9631 tempest-VolumesTestJSON-1724704593 tempest-VolumesTestJSON-1724704593-project] 10.222.0.46 "GET /compute/v2.1/os-volumes" status: 200 len: 1013 microversion: 2.1 time: 0.101346 Jan 15 21:01:45.297915 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2075/4119] 10.222.0.46 () {58 vars in 1133 bytes} [Sat Jan 15 21:01:45 2022] GET /compute/v2.1/os-volumes => generated 1013 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:45.313152 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c359b3bd-c261-4a21-aaec-9756206192a3 tempest-VolumesTestJSON-1724704593 tempest-VolumesTestJSON-1724704593-project] Calling method '.version_select at 0x7f30c853c940>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:45.418758 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c359b3bd-c261-4a21-aaec-9756206192a3 tempest-VolumesTestJSON-1724704593 tempest-VolumesTestJSON-1724704593-project] 10.222.0.46 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 679 microversion: 2.1 time: 0.110083 Jan 15 21:01:45.419748 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2076/4120] 10.222.0.46 () {58 vars in 1148 bytes} [Sat Jan 15 21:01:45 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 679 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:01:45.432002 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-6bf69738-cbbe-41d1-aa65-0cfaf67dbbc2 tempest-VolumesTestJSON-1724704593 tempest-VolumesTestJSON-1724704593-project] Calling method '.version_select at 0x7f30c853b310>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:45.525721 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-6bf69738-cbbe-41d1-aa65-0cfaf67dbbc2 tempest-VolumesTestJSON-1724704593 tempest-VolumesTestJSON-1724704593-project] 10.222.0.46 "GET /compute/v2.1/os-volumes" status: 200 len: 1013 microversion: 2.1 time: 0.097205 Jan 15 21:01:45.526701 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2077/4121] 10.222.0.46 () {58 vars in 1133 bytes} [Sat Jan 15 21:01:45 2022] GET /compute/v2.1/os-volumes => generated 1013 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:45.540349 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-eb6d9408-ab54-487f-be4c-5b88f8834b5b tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:45.542681 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-eb6d9408-ab54-487f-be4c-5b88f8834b5b tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:45.554658 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-eb6d9408-ab54-487f-be4c-5b88f8834b5b tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:45.555233 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-eb6d9408-ab54-487f-be4c-5b88f8834b5b tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:45.556215 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-eb6d9408-ab54-487f-be4c-5b88f8834b5b tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:45.556714 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-eb6d9408-ab54-487f-be4c-5b88f8834b5b tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:45.578202 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-936370d6-8b4a-496e-936a-371d072bfaa7 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Flavor limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 21:01:45.578620 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-936370d6-8b4a-496e-936a-371d072bfaa7 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Image limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 21:01:45.579121 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-936370d6-8b4a-496e-936a-371d072bfaa7 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Flavor pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 21:01:45.579740 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-936370d6-8b4a-496e-936a-371d072bfaa7 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Image pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 21:01:45.580880 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-936370d6-8b4a-496e-936a-371d072bfaa7 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 21:01:45.600505 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-936370d6-8b4a-496e-936a-371d072bfaa7 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:45.601513 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-936370d6-8b4a-496e-936a-371d072bfaa7 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:45.602634 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-936370d6-8b4a-496e-936a-371d072bfaa7 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:45.603095 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-936370d6-8b4a-496e-936a-371d072bfaa7 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:45.604334 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-eb6d9408-ab54-487f-be4c-5b88f8834b5b tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.068352 Jan 15 21:01:45.606139 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2078/4122] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:45 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:01:45.615154 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3667a75c-e5d7-449e-a2a8-0b32e083e3ee tempest-VolumesTestJSON-1724704593 tempest-VolumesTestJSON-1724704593-project] Calling method '.version_select at 0x7f30c853a4c0>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:45.624927 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-936370d6-8b4a-496e-936a-371d072bfaa7 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Getting quotas for project 769ee4a0d84d43abbed6cdcc4d536de7. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:01:45.632322 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-936370d6-8b4a-496e-936a-371d072bfaa7 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Getting quotas for user f084ea51b9d7466cb5e99881ce59e1c3 and project 769ee4a0d84d43abbed6cdcc4d536de7. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:01:45.648964 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-936370d6-8b4a-496e-936a-371d072bfaa7 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Going to run 1 instances... {{(pid=129366) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 21:01:45.652079 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-936370d6-8b4a-496e-936a-371d072bfaa7 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] [instance: c76b9e9c-4a53-40ed-9424-7c77a1b946d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 21:01:45.711776 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-936370d6-8b4a-496e-936a-371d072bfaa7 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Getting quotas for project 769ee4a0d84d43abbed6cdcc4d536de7. Resources: {'server_group_members'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:01:45.715363 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3667a75c-e5d7-449e-a2a8-0b32e083e3ee tempest-VolumesTestJSON-1724704593 tempest-VolumesTestJSON-1724704593-project] 10.222.0.46 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 347 microversion: 2.1 time: 0.104728 Jan 15 21:01:45.715958 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2079/4123] 10.222.0.46 () {58 vars in 1166 bytes} [Sat Jan 15 21:01:45 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 347 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:01:45.718828 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-936370d6-8b4a-496e-936a-371d072bfaa7 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Getting quotas for user f084ea51b9d7466cb5e99881ce59e1c3 and project 769ee4a0d84d43abbed6cdcc4d536de7. Resources: {'server_group_members'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:01:45.723895 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9c5b9c9c-c18c-482f-8e89-3fec623a9fc9 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:45.725306 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-9c5b9c9c-c18c-482f-8e89-3fec623a9fc9 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:45.733261 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9c5b9c9c-c18c-482f-8e89-3fec623a9fc9 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:45.733787 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9c5b9c9c-c18c-482f-8e89-3fec623a9fc9 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:45.734792 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9c5b9c9c-c18c-482f-8e89-3fec623a9fc9 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:45.735287 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9c5b9c9c-c18c-482f-8e89-3fec623a9fc9 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:45.762532 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-936370d6-8b4a-496e-936a-371d072bfaa7 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Getting quotas for project 769ee4a0d84d43abbed6cdcc4d536de7. Resources: {'server_group_members'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:01:45.768541 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-936370d6-8b4a-496e-936a-371d072bfaa7 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Getting quotas for user f084ea51b9d7466cb5e99881ce59e1c3 and project 769ee4a0d84d43abbed6cdcc4d536de7. Resources: {'server_group_members'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:01:45.785723 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-9c5b9c9c-c18c-482f-8e89-3fec623a9fc9 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action" status: 200 len: 32628 microversion: 2.20 time: 0.060305 Jan 15 21:01:45.789013 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2080/4124] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:45 2022] POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action => generated 32628 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:01:45.792163 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-1da4da52-d039-4ed6-872c-e38d1748c843 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:45.793171 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-1da4da52-d039-4ed6-872c-e38d1748c843 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:45.800767 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1da4da52-d039-4ed6-872c-e38d1748c843 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:45.801251 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1da4da52-d039-4ed6-872c-e38d1748c843 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:45.802050 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1da4da52-d039-4ed6-872c-e38d1748c843 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:45.802489 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1da4da52-d039-4ed6-872c-e38d1748c843 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:45.803127 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-936370d6-8b4a-496e-936a-371d072bfaa7 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.700315 Jan 15 21:01:45.804081 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2045/4125] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 21:01:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 703 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 21:01:45.809971 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-093a345d-5399-4a40-863d-4327e813040e tempest-VolumesTestJSON-1724704593 tempest-VolumesTestJSON-1724704593-project] Calling method '.version_select at 0x7f30c8e0b280>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:45.856078 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-1da4da52-d039-4ed6-872c-e38d1748c843 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action" status: 200 len: 32580 microversion: 2.1 time: 0.066443 Jan 15 21:01:45.856078 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2081/4126] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:01:45 2022] POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action => generated 32580 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:01:45.867191 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-009df260-7682-4820-87b4-2811be4b1037 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:45.867977 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-009df260-7682-4820-87b4-2811be4b1037 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 11cbafd5-4836-48b9-8db6-440002deb281] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:45.875329 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-009df260-7682-4820-87b4-2811be4b1037 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:45.875868 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-009df260-7682-4820-87b4-2811be4b1037 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:45.876744 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-009df260-7682-4820-87b4-2811be4b1037 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:45.877654 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-009df260-7682-4820-87b4-2811be4b1037 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:45.906941 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-093a345d-5399-4a40-863d-4327e813040e tempest-VolumesTestJSON-1724704593 tempest-VolumesTestJSON-1724704593-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 679 microversion: 2.1 time: 0.101026 Jan 15 21:01:45.907561 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2046/4127] 10.222.0.46 () {58 vars in 1169 bytes} [Sat Jan 15 21:01:45 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 679 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:01:45.913246 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1c760785-26d7-43ad-aa2c-6960af8a3161 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:45.913612 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-1c760785-26d7-43ad-aa2c-6960af8a3161 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] [instance: c76b9e9c-4a53-40ed-9424-7c77a1b946d8] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:46.008164 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-1c760785-26d7-43ad-aa2c-6960af8a3161 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f084ea51b9d7466cb5e99881ce59e1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769ee4a0d84d43abbed6cdcc4d536de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:46.026052 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-1c760785-26d7-43ad-aa2c-6960af8a3161 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] 10.222.0.46 "GET /compute/v2.1/servers/c76b9e9c-4a53-40ed-9424-7c77a1b946d8" status: 200 len: 1213 microversion: 2.1 time: 0.116939 Jan 15 21:01:46.026955 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2047/4128] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:45 2022] GET /compute/v2.1/servers/c76b9e9c-4a53-40ed-9424-7c77a1b946d8 => generated 1213 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:46.036402 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-6e916bd7-acf5-46d1-9a4f-affe6a651738 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:46.037461 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-6e916bd7-acf5-46d1-9a4f-affe6a651738 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:46.047092 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6e916bd7-acf5-46d1-9a4f-affe6a651738 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:46.048070 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6e916bd7-acf5-46d1-9a4f-affe6a651738 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:46.049215 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6e916bd7-acf5-46d1-9a4f-affe6a651738 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:46.050096 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6e916bd7-acf5-46d1-9a4f-affe6a651738 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:46.097326 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-009df260-7682-4820-87b4-2811be4b1037 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:46.108797 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-009df260-7682-4820-87b4-2811be4b1037 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/11cbafd5-4836-48b9-8db6-440002deb281" status: 200 len: 1512 microversion: 2.1 time: 0.247709 Jan 15 21:01:46.110207 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2082/4129] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:45 2022] GET /compute/v2.1/servers/11cbafd5-4836-48b9-8db6-440002deb281 => generated 1512 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:46.117860 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-133e273e-8918-4994-b015-56c763dee25b tempest-VolumesTestJSON-1724704593 tempest-VolumesTestJSON-1724704593-project] Calling method '.version_select at 0x7f30c856b040>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:46.119425 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-6e916bd7-acf5-46d1-9a4f-affe6a651738 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 24546 microversion: 2.32 time: 0.088863 Jan 15 21:01:46.120115 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2048/4130] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:46 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 24546 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:01:46.213348 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-133e273e-8918-4994-b015-56c763dee25b tempest-VolumesTestJSON-1724704593 tempest-VolumesTestJSON-1724704593-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1013 microversion: 2.1 time: 0.102509 Jan 15 21:01:46.213927 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2083/4131] 10.222.0.46 () {58 vars in 1154 bytes} [Sat Jan 15 21:01:46 2022] GET /compute/v2.1/os-volumes/detail => generated 1013 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:46.227448 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-89ef2cee-3588-4643-8ebe-7e97161dcdaf tempest-VolumesTestJSON-1724704593 tempest-VolumesTestJSON-1724704593-project] Calling method '.version_select at 0x7f30cec59700>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:46.320387 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-89ef2cee-3588-4643-8ebe-7e97161dcdaf tempest-VolumesTestJSON-1724704593 tempest-VolumesTestJSON-1724704593-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 347 microversion: 2.1 time: 0.097573 Jan 15 21:01:46.321123 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2049/4132] 10.222.0.46 () {58 vars in 1187 bytes} [Sat Jan 15 21:01:46 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 347 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 21:01:46.335684 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-51305226-9080-4943-be37-31815f871a64 tempest-VolumesTestJSON-1724704593 tempest-VolumesTestJSON-1724704593-project] Calling method '.version_select at 0x7f30c8547700>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:46.450892 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-51305226-9080-4943-be37-31815f871a64 tempest-VolumesTestJSON-1724704593 tempest-VolumesTestJSON-1724704593-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1013 microversion: 2.1 time: 0.120774 Jan 15 21:01:46.451873 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2084/4133] 10.222.0.46 () {58 vars in 1154 bytes} [Sat Jan 15 21:01:46 2022] GET /compute/v2.1/os-volumes/detail => generated 1013 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:46.619325 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7545f292-4cfd-476b-a1ba-b5da0b91c958 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:46.621398 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-7545f292-4cfd-476b-a1ba-b5da0b91c958 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:46.637075 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7545f292-4cfd-476b-a1ba-b5da0b91c958 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:46.637526 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7545f292-4cfd-476b-a1ba-b5da0b91c958 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:46.638327 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7545f292-4cfd-476b-a1ba-b5da0b91c958 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:46.638758 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7545f292-4cfd-476b-a1ba-b5da0b91c958 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:46.690483 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7545f292-4cfd-476b-a1ba-b5da0b91c958 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.077329 Jan 15 21:01:46.695510 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2050/4134] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:46 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:01:46.799325 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e1b9fc4c-5a9e-40aa-b677-e6c488f4126b tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:46.800461 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e1b9fc4c-5a9e-40aa-b677-e6c488f4126b tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:46.808904 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e1b9fc4c-5a9e-40aa-b677-e6c488f4126b tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:46.809871 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e1b9fc4c-5a9e-40aa-b677-e6c488f4126b tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:46.813479 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e1b9fc4c-5a9e-40aa-b677-e6c488f4126b tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:46.814468 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e1b9fc4c-5a9e-40aa-b677-e6c488f4126b tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:46.866485 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e1b9fc4c-5a9e-40aa-b677-e6c488f4126b tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action" status: 200 len: 32628 microversion: 2.20 time: 0.071203 Jan 15 21:01:46.871532 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2085/4135] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:46 2022] POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action => generated 32628 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:01:46.871764 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-6d85414b-8e81-4e18-bc64-4ebbd5553bcd tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:46.872228 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-6d85414b-8e81-4e18-bc64-4ebbd5553bcd tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:46.887848 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6d85414b-8e81-4e18-bc64-4ebbd5553bcd tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:46.888317 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6d85414b-8e81-4e18-bc64-4ebbd5553bcd tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:46.889313 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6d85414b-8e81-4e18-bc64-4ebbd5553bcd tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:46.889828 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6d85414b-8e81-4e18-bc64-4ebbd5553bcd tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:46.938818 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-6d85414b-8e81-4e18-bc64-4ebbd5553bcd tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action" status: 200 len: 32580 microversion: 2.1 time: 0.074183 Jan 15 21:01:46.941592 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2051/4136] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:01:46 2022] POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action => generated 32580 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:01:47.046522 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c1849699-5719-4bcc-9af3-59a4ee095705 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:47.047545 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c1849699-5719-4bcc-9af3-59a4ee095705 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] [instance: c76b9e9c-4a53-40ed-9424-7c77a1b946d8] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:47.057422 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c1849699-5719-4bcc-9af3-59a4ee095705 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:47.058224 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c1849699-5719-4bcc-9af3-59a4ee095705 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:47.059260 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c1849699-5719-4bcc-9af3-59a4ee095705 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:47.059904 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c1849699-5719-4bcc-9af3-59a4ee095705 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:47.128948 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b0605ed5-878c-4ee4-807a-d4a76e2ccdc5 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:47.129849 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b0605ed5-878c-4ee4-807a-d4a76e2ccdc5 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 11cbafd5-4836-48b9-8db6-440002deb281] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:47.143345 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b0605ed5-878c-4ee4-807a-d4a76e2ccdc5 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:47.144340 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b0605ed5-878c-4ee4-807a-d4a76e2ccdc5 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:47.145828 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b0605ed5-878c-4ee4-807a-d4a76e2ccdc5 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:47.146586 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b0605ed5-878c-4ee4-807a-d4a76e2ccdc5 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:47.154038 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-c1849699-5719-4bcc-9af3-59a4ee095705 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f084ea51b9d7466cb5e99881ce59e1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769ee4a0d84d43abbed6cdcc4d536de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:47.166212 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c1849699-5719-4bcc-9af3-59a4ee095705 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] 10.222.0.46 "GET /compute/v2.1/servers/c76b9e9c-4a53-40ed-9424-7c77a1b946d8" status: 200 len: 1265 microversion: 2.1 time: 0.121728 Jan 15 21:01:47.166871 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2086/4137] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:47 2022] GET /compute/v2.1/servers/c76b9e9c-4a53-40ed-9424-7c77a1b946d8 => generated 1265 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:47.177364 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-20526267-9ada-4ef9-8012-a7f5cd53bcc8 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:47.177364 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-20526267-9ada-4ef9-8012-a7f5cd53bcc8 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:47.189838 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-20526267-9ada-4ef9-8012-a7f5cd53bcc8 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:47.190355 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-20526267-9ada-4ef9-8012-a7f5cd53bcc8 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:47.191263 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-20526267-9ada-4ef9-8012-a7f5cd53bcc8 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:47.191600 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-20526267-9ada-4ef9-8012-a7f5cd53bcc8 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:47.305723 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-20526267-9ada-4ef9-8012-a7f5cd53bcc8 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 24546 microversion: 2.32 time: 0.131095 Jan 15 21:01:47.309991 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2087/4138] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:47 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 24546 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:01:47.468617 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-b0605ed5-878c-4ee4-807a-d4a76e2ccdc5 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:47.479072 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b0605ed5-878c-4ee4-807a-d4a76e2ccdc5 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/11cbafd5-4836-48b9-8db6-440002deb281" status: 200 len: 1512 microversion: 2.1 time: 0.355568 Jan 15 21:01:47.480088 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2052/4139] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:47 2022] GET /compute/v2.1/servers/11cbafd5-4836-48b9-8db6-440002deb281 => generated 1512 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:47.703231 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2b68f49b-a81c-4321-a616-3bd15d196a8d tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-688251014", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "networks": [{"uuid": "0aa73f96-76d4-4e9b-85cd-073eea7cf7fe"}]}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:47.707003 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-2634ba75-f49f-4bef-8170-cab0fb1865eb tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:47.707998 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-2634ba75-f49f-4bef-8170-cab0fb1865eb tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:47.717995 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2634ba75-f49f-4bef-8170-cab0fb1865eb tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:47.718779 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2634ba75-f49f-4bef-8170-cab0fb1865eb tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:47.719769 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2634ba75-f49f-4bef-8170-cab0fb1865eb tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:47.720398 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2634ba75-f49f-4bef-8170-cab0fb1865eb tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:47.793372 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.network.neutron [None req-2b68f49b-a81c-4321-a616-3bd15d196a8d tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] validate_networks() for [('0aa73f96-76d4-4e9b-85cd-073eea7cf7fe', None, None, None, None, None)] {{(pid=129365) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 21:01:47.812730 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-2634ba75-f49f-4bef-8170-cab0fb1865eb tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.112684 Jan 15 21:01:47.817907 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2053/4140] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:47 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:01:47.885934 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-24822bc5-fa4c-4022-97c0-adfbb0197438 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:47.886922 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-24822bc5-fa4c-4022-97c0-adfbb0197438 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:47.899524 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-24822bc5-fa4c-4022-97c0-adfbb0197438 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:47.900434 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-24822bc5-fa4c-4022-97c0-adfbb0197438 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:47.902052 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-24822bc5-fa4c-4022-97c0-adfbb0197438 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:47.902711 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-24822bc5-fa4c-4022-97c0-adfbb0197438 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:47.952903 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-24822bc5-fa4c-4022-97c0-adfbb0197438 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action" status: 200 len: 32628 microversion: 2.20 time: 0.076046 Jan 15 21:01:47.953583 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2054/4141] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:47 2022] POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action => generated 32628 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:01:47.960969 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c962e8db-8761-4a92-970a-5b50aa9c47ca tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:47.962678 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c962e8db-8761-4a92-970a-5b50aa9c47ca tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:47.970085 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c962e8db-8761-4a92-970a-5b50aa9c47ca tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:47.971100 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c962e8db-8761-4a92-970a-5b50aa9c47ca tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:47.972253 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c962e8db-8761-4a92-970a-5b50aa9c47ca tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:47.972757 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c962e8db-8761-4a92-970a-5b50aa9c47ca tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:48.020317 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c962e8db-8761-4a92-970a-5b50aa9c47ca tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action" status: 200 len: 32580 microversion: 2.1 time: 0.065054 Jan 15 21:01:48.023865 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2055/4142] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:01:47 2022] POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action => generated 32580 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:01:48.184630 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-563a4859-9dfd-42ac-82a6-d35c53b3c37e tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:48.186709 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-563a4859-9dfd-42ac-82a6-d35c53b3c37e tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] [instance: c76b9e9c-4a53-40ed-9424-7c77a1b946d8] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:48.194263 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-563a4859-9dfd-42ac-82a6-d35c53b3c37e tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:48.194843 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-563a4859-9dfd-42ac-82a6-d35c53b3c37e tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:48.195877 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-563a4859-9dfd-42ac-82a6-d35c53b3c37e tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:48.196466 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-563a4859-9dfd-42ac-82a6-d35c53b3c37e tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:48.217527 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-2b68f49b-a81c-4321-a616-3bd15d196a8d tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] Flavor limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 21:01:48.218519 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-2b68f49b-a81c-4321-a616-3bd15d196a8d tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] Image limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 21:01:48.219263 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-2b68f49b-a81c-4321-a616-3bd15d196a8d tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] Flavor pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 21:01:48.219822 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-2b68f49b-a81c-4321-a616-3bd15d196a8d tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] Image pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 21:01:48.220381 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-2b68f49b-a81c-4321-a616-3bd15d196a8d tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 21:01:48.240421 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2b68f49b-a81c-4321-a616-3bd15d196a8d tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:48.240974 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2b68f49b-a81c-4321-a616-3bd15d196a8d tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:48.241835 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2b68f49b-a81c-4321-a616-3bd15d196a8d tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:48.242276 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2b68f49b-a81c-4321-a616-3bd15d196a8d tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:48.268664 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-2b68f49b-a81c-4321-a616-3bd15d196a8d tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] Getting quotas for project fb1e1f3647ce41048a7071decbdfe961. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:01:48.274678 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-2b68f49b-a81c-4321-a616-3bd15d196a8d tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] Getting quotas for user 62278eb28e2e4417bd83e1d04e9fc531 and project fb1e1f3647ce41048a7071decbdfe961. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:01:48.290413 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-2b68f49b-a81c-4321-a616-3bd15d196a8d tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] Going to run 1 instances... {{(pid=129365) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 21:01:48.293278 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-2b68f49b-a81c-4321-a616-3bd15d196a8d tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] [instance: d95ee4eb-4703-466f-b007-a90cc4ac22ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129365) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 21:01:48.375609 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2b68f49b-a81c-4321-a616-3bd15d196a8d tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.831760 Jan 15 21:01:48.376278 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2088/4143] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 21:01:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 834 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 21:01:48.389506 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-4850450e-69ac-4915-96d6-ed9c1651c488 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:48.390829 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-4850450e-69ac-4915-96d6-ed9c1651c488 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:48.396455 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-563a4859-9dfd-42ac-82a6-d35c53b3c37e tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f084ea51b9d7466cb5e99881ce59e1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769ee4a0d84d43abbed6cdcc4d536de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:48.399981 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4850450e-69ac-4915-96d6-ed9c1651c488 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:48.400463 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4850450e-69ac-4915-96d6-ed9c1651c488 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:48.401359 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4850450e-69ac-4915-96d6-ed9c1651c488 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:48.401798 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4850450e-69ac-4915-96d6-ed9c1651c488 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:48.404907 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-563a4859-9dfd-42ac-82a6-d35c53b3c37e tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] 10.222.0.46 "GET /compute/v2.1/servers/c76b9e9c-4a53-40ed-9424-7c77a1b946d8" status: 200 len: 1313 microversion: 2.1 time: 0.224685 Jan 15 21:01:48.413742 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2056/4144] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:48 2022] GET /compute/v2.1/servers/c76b9e9c-4a53-40ed-9424-7c77a1b946d8 => generated 1313 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:01:48.422364 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-620d835e-e573-48e1-ad88-bb8719e72a6b tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:48.426536 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-620d835e-e573-48e1-ad88-bb8719e72a6b tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] [instance: d95ee4eb-4703-466f-b007-a90cc4ac22ce] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:48.485383 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-4850450e-69ac-4915-96d6-ed9c1651c488 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 24546 microversion: 2.32 time: 0.106998 Jan 15 21:01:48.486310 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2089/4145] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:48 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 24546 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:01:48.500151 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-620d835e-e573-48e1-ad88-bb8719e72a6b tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62278eb28e2e4417bd83e1d04e9fc531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1e1f3647ce41048a7071decbdfe961', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:48.504334 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-10edec48-b694-4157-948d-6e35650efc8d tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:48.505259 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-10edec48-b694-4157-948d-6e35650efc8d tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 11cbafd5-4836-48b9-8db6-440002deb281] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:48.511657 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-620d835e-e573-48e1-ad88-bb8719e72a6b tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] 10.222.0.46 "GET /compute/v2.1/servers/d95ee4eb-4703-466f-b007-a90cc4ac22ce" status: 200 len: 1216 microversion: 2.1 time: 0.096149 Jan 15 21:01:48.522156 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2057/4146] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:48 2022] GET /compute/v2.1/servers/d95ee4eb-4703-466f-b007-a90cc4ac22ce => generated 1216 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:48.522987 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-10edec48-b694-4157-948d-6e35650efc8d tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:48.523588 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-10edec48-b694-4157-948d-6e35650efc8d tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:48.524401 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-10edec48-b694-4157-948d-6e35650efc8d tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:48.525055 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-10edec48-b694-4157-948d-6e35650efc8d tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:48.687262 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-10edec48-b694-4157-948d-6e35650efc8d tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:48.699145 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-10edec48-b694-4157-948d-6e35650efc8d tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/11cbafd5-4836-48b9-8db6-440002deb281" status: 200 len: 1512 microversion: 2.1 time: 0.205168 Jan 15 21:01:48.700498 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2090/4147] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:48 2022] GET /compute/v2.1/servers/11cbafd5-4836-48b9-8db6-440002deb281 => generated 1512 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:01:48.825403 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-eab6cb42-424f-4d15-9984-3fd455d7076a tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:48.826637 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-eab6cb42-424f-4d15-9984-3fd455d7076a tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:48.834202 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-eab6cb42-424f-4d15-9984-3fd455d7076a tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:48.834899 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-eab6cb42-424f-4d15-9984-3fd455d7076a tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:48.835919 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-eab6cb42-424f-4d15-9984-3fd455d7076a tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:48.836560 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-eab6cb42-424f-4d15-9984-3fd455d7076a tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:48.889634 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-eab6cb42-424f-4d15-9984-3fd455d7076a tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.067762 Jan 15 21:01:48.900753 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2058/4148] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:48 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:01:48.968587 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-21fc2575-4808-48fd-bb59-cd339c211a4a tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:48.969896 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-21fc2575-4808-48fd-bb59-cd339c211a4a tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:48.989074 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-21fc2575-4808-48fd-bb59-cd339c211a4a tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:48.989532 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-21fc2575-4808-48fd-bb59-cd339c211a4a tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:48.990659 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-21fc2575-4808-48fd-bb59-cd339c211a4a tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:48.991095 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-21fc2575-4808-48fd-bb59-cd339c211a4a tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:49.027164 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-dca13f75-3f7d-4661-9f17-ed633ad718d8 req-2d44c619-5b49-44b2-920a-6a6606b08edf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c76b9e9c-4a53-40ed-9424-7c77a1b946d8", "tag": "0c5e3426-33d2-4433-bed0-1c17171bce52"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:49.028765 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:01:49.028765 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:01:49.046105 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-dca13f75-3f7d-4661-9f17-ed633ad718d8 req-2d44c619-5b49-44b2-920a-6a6606b08edf service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:49.046540 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-dca13f75-3f7d-4661-9f17-ed633ad718d8 req-2d44c619-5b49-44b2-920a-6a6606b08edf service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:49.061018 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-dca13f75-3f7d-4661-9f17-ed633ad718d8 req-2d44c619-5b49-44b2-920a-6a6606b08edf service nova] Creating event network-changed:0c5e3426-33d2-4433-bed0-1c17171bce52 for instance c76b9e9c-4a53-40ed-9424-7c77a1b946d8 on nch2-master-1 Jan 15 21:01:49.068305 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-dca13f75-3f7d-4661-9f17-ed633ad718d8 req-2d44c619-5b49-44b2-920a-6a6606b08edf service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047776 Jan 15 21:01:49.069549 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2059/4149] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:01:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:01:49.084160 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-2d616973-a636-449a-9cde-40f99dd16e07 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:49.085398 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-2d616973-a636-449a-9cde-40f99dd16e07 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:49.093320 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2d616973-a636-449a-9cde-40f99dd16e07 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:49.094422 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2d616973-a636-449a-9cde-40f99dd16e07 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:49.096009 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2d616973-a636-449a-9cde-40f99dd16e07 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:49.096909 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2d616973-a636-449a-9cde-40f99dd16e07 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:49.098899 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-21fc2575-4808-48fd-bb59-cd339c211a4a tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action" status: 200 len: 32628 microversion: 2.20 time: 0.134497 Jan 15 21:01:49.107005 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2091/4150] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:48 2022] POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action => generated 32628 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:01:49.147872 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-2d616973-a636-449a-9cde-40f99dd16e07 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action" status: 200 len: 32580 microversion: 2.1 time: 0.076535 Jan 15 21:01:49.149721 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2060/4151] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:01:49 2022] POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action => generated 32580 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:01:49.425935 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8cd9111b-31c6-460c-8474-24af16174043 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:49.426780 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-8cd9111b-31c6-460c-8474-24af16174043 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] [instance: c76b9e9c-4a53-40ed-9424-7c77a1b946d8] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:49.435621 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8cd9111b-31c6-460c-8474-24af16174043 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:49.436416 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8cd9111b-31c6-460c-8474-24af16174043 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:49.437636 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8cd9111b-31c6-460c-8474-24af16174043 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:49.438549 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8cd9111b-31c6-460c-8474-24af16174043 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:49.506925 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-30352d7c-402f-43d6-8cfe-488f7078bf25 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:49.508702 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-30352d7c-402f-43d6-8cfe-488f7078bf25 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:49.523577 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-30352d7c-402f-43d6-8cfe-488f7078bf25 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:49.524921 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-30352d7c-402f-43d6-8cfe-488f7078bf25 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:49.525995 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-30352d7c-402f-43d6-8cfe-488f7078bf25 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:49.527423 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-30352d7c-402f-43d6-8cfe-488f7078bf25 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:49.609629 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-30352d7c-402f-43d6-8cfe-488f7078bf25 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 24546 microversion: 2.32 time: 0.114512 Jan 15 21:01:49.610582 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2061/4152] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:49 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 24546 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:01:49.618333 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-38e3e099-9dda-41b7-a536-674a08a53d72 tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:49.619309 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-38e3e099-9dda-41b7-a536-674a08a53d72 tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] [instance: d95ee4eb-4703-466f-b007-a90cc4ac22ce] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:49.628653 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-38e3e099-9dda-41b7-a536-674a08a53d72 tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:49.629296 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-38e3e099-9dda-41b7-a536-674a08a53d72 tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:49.630229 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-38e3e099-9dda-41b7-a536-674a08a53d72 tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:49.630916 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-38e3e099-9dda-41b7-a536-674a08a53d72 tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:49.694925 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-8cd9111b-31c6-460c-8474-24af16174043 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f084ea51b9d7466cb5e99881ce59e1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769ee4a0d84d43abbed6cdcc4d536de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:49.705870 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-8cd9111b-31c6-460c-8474-24af16174043 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] 10.222.0.46 "GET /compute/v2.1/servers/c76b9e9c-4a53-40ed-9424-7c77a1b946d8" status: 200 len: 1313 microversion: 2.1 time: 0.285158 Jan 15 21:01:49.707305 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2092/4153] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:49 2022] GET /compute/v2.1/servers/c76b9e9c-4a53-40ed-9424-7c77a1b946d8 => generated 1313 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:49.728111 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9c9e66a1-f81b-42b7-af64-3eb652814763 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:49.728691 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-9c9e66a1-f81b-42b7-af64-3eb652814763 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 11cbafd5-4836-48b9-8db6-440002deb281] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:49.739637 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9c9e66a1-f81b-42b7-af64-3eb652814763 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:49.740295 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9c9e66a1-f81b-42b7-af64-3eb652814763 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:49.741485 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9c9e66a1-f81b-42b7-af64-3eb652814763 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:49.742204 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9c9e66a1-f81b-42b7-af64-3eb652814763 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:49.770576 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-38e3e099-9dda-41b7-a536-674a08a53d72 tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62278eb28e2e4417bd83e1d04e9fc531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1e1f3647ce41048a7071decbdfe961', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:49.780626 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-38e3e099-9dda-41b7-a536-674a08a53d72 tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] 10.222.0.46 "GET /compute/v2.1/servers/d95ee4eb-4703-466f-b007-a90cc4ac22ce" status: 200 len: 1276 microversion: 2.1 time: 0.167885 Jan 15 21:01:49.782024 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2062/4154] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:49 2022] GET /compute/v2.1/servers/d95ee4eb-4703-466f-b007-a90cc4ac22ce => generated 1276 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:49.905753 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-6efbbfb2-eb43-45ec-857b-066d8cf4664d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:49.906726 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-6efbbfb2-eb43-45ec-857b-066d8cf4664d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:49.916584 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6efbbfb2-eb43-45ec-857b-066d8cf4664d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:49.917224 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6efbbfb2-eb43-45ec-857b-066d8cf4664d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:49.918164 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6efbbfb2-eb43-45ec-857b-066d8cf4664d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:49.918723 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6efbbfb2-eb43-45ec-857b-066d8cf4664d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:49.928657 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-9c9e66a1-f81b-42b7-af64-3eb652814763 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:49.938635 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-9c9e66a1-f81b-42b7-af64-3eb652814763 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/11cbafd5-4836-48b9-8db6-440002deb281" status: 200 len: 1512 microversion: 2.1 time: 0.216178 Jan 15 21:01:49.940202 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2093/4155] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:49 2022] GET /compute/v2.1/servers/11cbafd5-4836-48b9-8db6-440002deb281 => generated 1512 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:49.978577 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-6efbbfb2-eb43-45ec-857b-066d8cf4664d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.077435 Jan 15 21:01:49.979425 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2063/4156] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:49 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:01:50.113180 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-acb90892-a892-471e-8cc6-544f397956fe tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:50.114925 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-acb90892-a892-471e-8cc6-544f397956fe tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:50.124092 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-acb90892-a892-471e-8cc6-544f397956fe tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:50.124542 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-acb90892-a892-471e-8cc6-544f397956fe tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:50.127725 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-acb90892-a892-471e-8cc6-544f397956fe tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:50.130182 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-acb90892-a892-471e-8cc6-544f397956fe tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:50.164243 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a07f899f-351a-4d91-9cda-62ff0aec0ed1 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:50.166024 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a07f899f-351a-4d91-9cda-62ff0aec0ed1 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:50.177664 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a07f899f-351a-4d91-9cda-62ff0aec0ed1 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:50.178556 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a07f899f-351a-4d91-9cda-62ff0aec0ed1 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:50.179923 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a07f899f-351a-4d91-9cda-62ff0aec0ed1 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:50.180590 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a07f899f-351a-4d91-9cda-62ff0aec0ed1 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:50.183916 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-acb90892-a892-471e-8cc6-544f397956fe tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action" status: 200 len: 32628 microversion: 2.20 time: 0.075756 Jan 15 21:01:50.185072 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2094/4157] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:50 2022] POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action => generated 32628 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:01:50.241684 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a07f899f-351a-4d91-9cda-62ff0aec0ed1 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action" status: 200 len: 32580 microversion: 2.1 time: 0.082060 Jan 15 21:01:50.242470 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2064/4158] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:01:50 2022] POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action => generated 32580 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 21:01:50.631246 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c46851fc-2f01-49ec-809a-e2fcb0fe0081 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:50.632260 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c46851fc-2f01-49ec-809a-e2fcb0fe0081 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:50.641402 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c46851fc-2f01-49ec-809a-e2fcb0fe0081 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:50.641902 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c46851fc-2f01-49ec-809a-e2fcb0fe0081 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:50.643342 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c46851fc-2f01-49ec-809a-e2fcb0fe0081 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:50.643746 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c46851fc-2f01-49ec-809a-e2fcb0fe0081 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:50.700342 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c46851fc-2f01-49ec-809a-e2fcb0fe0081 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 24546 microversion: 2.32 time: 0.078524 Jan 15 21:01:50.701172 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2095/4159] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:50 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 24546 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:01:50.726176 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-5c061b3f-687d-40fe-b718-e680033ab76e tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:50.726853 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-5c061b3f-687d-40fe-b718-e680033ab76e tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] [instance: c76b9e9c-4a53-40ed-9424-7c77a1b946d8] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:50.733965 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5c061b3f-687d-40fe-b718-e680033ab76e tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:50.734592 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5c061b3f-687d-40fe-b718-e680033ab76e tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:50.735828 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5c061b3f-687d-40fe-b718-e680033ab76e tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:50.736287 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5c061b3f-687d-40fe-b718-e680033ab76e tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:50.802268 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8156de10-b5c2-4e76-88fe-1edc07548fa8 tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:50.803266 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-8156de10-b5c2-4e76-88fe-1edc07548fa8 tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] [instance: d95ee4eb-4703-466f-b007-a90cc4ac22ce] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:50.813051 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8156de10-b5c2-4e76-88fe-1edc07548fa8 tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:50.813818 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8156de10-b5c2-4e76-88fe-1edc07548fa8 tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:50.815987 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8156de10-b5c2-4e76-88fe-1edc07548fa8 tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:50.816600 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8156de10-b5c2-4e76-88fe-1edc07548fa8 tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:50.905764 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-8156de10-b5c2-4e76-88fe-1edc07548fa8 tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62278eb28e2e4417bd83e1d04e9fc531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1e1f3647ce41048a7071decbdfe961', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:50.918040 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-8156de10-b5c2-4e76-88fe-1edc07548fa8 tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] 10.222.0.46 "GET /compute/v2.1/servers/d95ee4eb-4703-466f-b007-a90cc4ac22ce" status: 200 len: 1274 microversion: 2.1 time: 0.122118 Jan 15 21:01:50.918637 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2096/4160] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:50 2022] GET /compute/v2.1/servers/d95ee4eb-4703-466f-b007-a90cc4ac22ce => generated 1274 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:50.957348 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-5c061b3f-687d-40fe-b718-e680033ab76e tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f084ea51b9d7466cb5e99881ce59e1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769ee4a0d84d43abbed6cdcc4d536de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:50.958617 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f5569327-6426-4bc6-a427-09beb0ac84c5 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:50.959312 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f5569327-6426-4bc6-a427-09beb0ac84c5 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 11cbafd5-4836-48b9-8db6-440002deb281] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:50.968516 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f5569327-6426-4bc6-a427-09beb0ac84c5 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:50.968967 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-5c061b3f-687d-40fe-b718-e680033ab76e tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] 10.222.0.46 "GET /compute/v2.1/servers/c76b9e9c-4a53-40ed-9424-7c77a1b946d8" status: 200 len: 1313 microversion: 2.1 time: 0.247205 Jan 15 21:01:50.969245 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f5569327-6426-4bc6-a427-09beb0ac84c5 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:50.969852 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2065/4161] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:50 2022] GET /compute/v2.1/servers/c76b9e9c-4a53-40ed-9424-7c77a1b946d8 => generated 1313 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:50.974446 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f5569327-6426-4bc6-a427-09beb0ac84c5 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:50.975687 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f5569327-6426-4bc6-a427-09beb0ac84c5 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:50.992935 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c6a6473c-e123-493b-8b69-8c4dbc68b451 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:50.995037 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c6a6473c-e123-493b-8b69-8c4dbc68b451 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:51.002460 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c6a6473c-e123-493b-8b69-8c4dbc68b451 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:51.003221 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c6a6473c-e123-493b-8b69-8c4dbc68b451 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:51.004144 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c6a6473c-e123-493b-8b69-8c4dbc68b451 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:51.004755 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c6a6473c-e123-493b-8b69-8c4dbc68b451 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:51.089775 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c6a6473c-e123-493b-8b69-8c4dbc68b451 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.100725 Jan 15 21:01:51.090419 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2066/4162] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:50 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:01:51.189818 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-f5569327-6426-4bc6-a427-09beb0ac84c5 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:51.198223 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-cefa5bba-5c35-40af-8077-01f573ae0474 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:51.199550 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-cefa5bba-5c35-40af-8077-01f573ae0474 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:51.206606 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f5569327-6426-4bc6-a427-09beb0ac84c5 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/11cbafd5-4836-48b9-8db6-440002deb281" status: 200 len: 1512 microversion: 2.1 time: 0.250974 Jan 15 21:01:51.209852 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2097/4163] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:50 2022] GET /compute/v2.1/servers/11cbafd5-4836-48b9-8db6-440002deb281 => generated 1512 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:51.216992 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cefa5bba-5c35-40af-8077-01f573ae0474 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:51.218638 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cefa5bba-5c35-40af-8077-01f573ae0474 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:51.220716 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cefa5bba-5c35-40af-8077-01f573ae0474 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:51.221463 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cefa5bba-5c35-40af-8077-01f573ae0474 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:51.254658 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-42603c57-492a-4283-849d-b5fb02a974c7 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:51.255839 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-42603c57-492a-4283-849d-b5fb02a974c7 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:51.265779 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-42603c57-492a-4283-849d-b5fb02a974c7 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:51.266253 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-42603c57-492a-4283-849d-b5fb02a974c7 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:51.268181 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-42603c57-492a-4283-849d-b5fb02a974c7 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:51.268949 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-42603c57-492a-4283-849d-b5fb02a974c7 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:51.276742 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-cefa5bba-5c35-40af-8077-01f573ae0474 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action" status: 200 len: 32628 microversion: 2.20 time: 0.083766 Jan 15 21:01:51.277525 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2067/4164] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:51 2022] POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action => generated 32628 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:01:51.325639 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-42603c57-492a-4283-849d-b5fb02a974c7 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action" status: 200 len: 32580 microversion: 2.1 time: 0.075193 Jan 15 21:01:51.327179 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2098/4165] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:01:51 2022] POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action => generated 32580 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 21:01:51.715979 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-668f8d17-cea1-48ca-91dd-b979a8ffe074 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:51.716969 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-668f8d17-cea1-48ca-91dd-b979a8ffe074 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:51.726367 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-668f8d17-cea1-48ca-91dd-b979a8ffe074 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:51.727048 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-668f8d17-cea1-48ca-91dd-b979a8ffe074 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:51.727916 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-668f8d17-cea1-48ca-91dd-b979a8ffe074 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:51.728428 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-668f8d17-cea1-48ca-91dd-b979a8ffe074 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:51.779710 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-668f8d17-cea1-48ca-91dd-b979a8ffe074 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 24546 microversion: 2.32 time: 0.070216 Jan 15 21:01:51.784203 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2068/4166] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:51 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 24546 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:01:51.941161 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ab05b2cc-23ff-4cbc-907c-0e48ba7b7f16 tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:51.944013 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ab05b2cc-23ff-4cbc-907c-0e48ba7b7f16 tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] [instance: d95ee4eb-4703-466f-b007-a90cc4ac22ce] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:51.952032 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ab05b2cc-23ff-4cbc-907c-0e48ba7b7f16 tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:51.952757 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ab05b2cc-23ff-4cbc-907c-0e48ba7b7f16 tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:51.953844 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ab05b2cc-23ff-4cbc-907c-0e48ba7b7f16 tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:51.954444 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ab05b2cc-23ff-4cbc-907c-0e48ba7b7f16 tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:51.988715 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a82345c4-f310-4595-b3f9-c7ddcff4ea02 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:51.990075 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a82345c4-f310-4595-b3f9-c7ddcff4ea02 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] [instance: c76b9e9c-4a53-40ed-9424-7c77a1b946d8] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:52.004919 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a82345c4-f310-4595-b3f9-c7ddcff4ea02 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:52.005563 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a82345c4-f310-4595-b3f9-c7ddcff4ea02 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:52.006333 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a82345c4-f310-4595-b3f9-c7ddcff4ea02 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:52.006936 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a82345c4-f310-4595-b3f9-c7ddcff4ea02 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:52.193942 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-ab05b2cc-23ff-4cbc-907c-0e48ba7b7f16 tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62278eb28e2e4417bd83e1d04e9fc531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1e1f3647ce41048a7071decbdfe961', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:52.206270 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ab05b2cc-23ff-4cbc-907c-0e48ba7b7f16 tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] 10.222.0.46 "GET /compute/v2.1/servers/d95ee4eb-4703-466f-b007-a90cc4ac22ce" status: 200 len: 1316 microversion: 2.1 time: 0.272526 Jan 15 21:01:52.207846 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2099/4167] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:51 2022] GET /compute/v2.1/servers/d95ee4eb-4703-466f-b007-a90cc4ac22ce => generated 1316 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:52.214374 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-76a9c2e6-a7e9-4a59-be60-be4d1b5cd344 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:52.215333 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-76a9c2e6-a7e9-4a59-be60-be4d1b5cd344 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:52.224751 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-76a9c2e6-a7e9-4a59-be60-be4d1b5cd344 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:52.225472 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-76a9c2e6-a7e9-4a59-be60-be4d1b5cd344 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:52.226695 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-76a9c2e6-a7e9-4a59-be60-be4d1b5cd344 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:52.227217 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-76a9c2e6-a7e9-4a59-be60-be4d1b5cd344 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:52.260502 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-a82345c4-f310-4595-b3f9-c7ddcff4ea02 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f084ea51b9d7466cb5e99881ce59e1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769ee4a0d84d43abbed6cdcc4d536de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:52.271295 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a82345c4-f310-4595-b3f9-c7ddcff4ea02 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] 10.222.0.46 "GET /compute/v2.1/servers/c76b9e9c-4a53-40ed-9424-7c77a1b946d8" status: 200 len: 1313 microversion: 2.1 time: 0.286631 Jan 15 21:01:52.281765 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2069/4168] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:51 2022] GET /compute/v2.1/servers/c76b9e9c-4a53-40ed-9424-7c77a1b946d8 => generated 1313 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:01:52.284352 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-76a9c2e6-a7e9-4a59-be60-be4d1b5cd344 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.072732 Jan 15 21:01:52.287312 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2100/4169] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:52 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:01:52.290839 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-dbe208b1-1101-4ea7-b590-d016a61b8274 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:52.291709 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-dbe208b1-1101-4ea7-b590-d016a61b8274 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 11cbafd5-4836-48b9-8db6-440002deb281] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:52.295796 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-2c3261c5-b606-4d2b-aeb3-93559ff2de38 req-7c80782f-36f3-460c-9bdb-84fe572f3f31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d95ee4eb-4703-466f-b007-a90cc4ac22ce", "tag": "c9595e70-1846-4eb0-8e71-6944c7a0d531"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:52.298343 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:01:52.298343 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:01:52.301393 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dbe208b1-1101-4ea7-b590-d016a61b8274 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:52.302579 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dbe208b1-1101-4ea7-b590-d016a61b8274 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:52.303663 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dbe208b1-1101-4ea7-b590-d016a61b8274 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:52.304940 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dbe208b1-1101-4ea7-b590-d016a61b8274 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:52.312437 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-2c3261c5-b606-4d2b-aeb3-93559ff2de38 req-7c80782f-36f3-460c-9bdb-84fe572f3f31 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:52.313031 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-2c3261c5-b606-4d2b-aeb3-93559ff2de38 req-7c80782f-36f3-460c-9bdb-84fe572f3f31 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:52.327646 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-2c3261c5-b606-4d2b-aeb3-93559ff2de38 req-7c80782f-36f3-460c-9bdb-84fe572f3f31 service nova] Creating event network-changed:c9595e70-1846-4eb0-8e71-6944c7a0d531 for instance d95ee4eb-4703-466f-b007-a90cc4ac22ce on nch2-master-1 Jan 15 21:01:52.336687 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-2c3261c5-b606-4d2b-aeb3-93559ff2de38 req-7c80782f-36f3-460c-9bdb-84fe572f3f31 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057351 Jan 15 21:01:52.337754 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2070/4170] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:01:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:01:52.342878 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-058bc363-5862-4301-a0eb-8f761dd08fec tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:52.344593 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-058bc363-5862-4301-a0eb-8f761dd08fec tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:52.354317 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-058bc363-5862-4301-a0eb-8f761dd08fec tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:52.355053 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-058bc363-5862-4301-a0eb-8f761dd08fec tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:52.355785 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-058bc363-5862-4301-a0eb-8f761dd08fec tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:52.356548 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-058bc363-5862-4301-a0eb-8f761dd08fec tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:52.430295 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-058bc363-5862-4301-a0eb-8f761dd08fec tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action" status: 200 len: 32628 microversion: 2.20 time: 0.091012 Jan 15 21:01:52.440488 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2071/4171] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:52 2022] POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action => generated 32628 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:01:52.451486 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-3c5894d5-fd64-463d-b7f9-2b74deba0999 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:52.452660 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-3c5894d5-fd64-463d-b7f9-2b74deba0999 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:52.470135 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3c5894d5-fd64-463d-b7f9-2b74deba0999 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:52.471811 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3c5894d5-fd64-463d-b7f9-2b74deba0999 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:52.478959 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3c5894d5-fd64-463d-b7f9-2b74deba0999 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:52.478959 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3c5894d5-fd64-463d-b7f9-2b74deba0999 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:52.504887 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-dbe208b1-1101-4ea7-b590-d016a61b8274 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:52.515577 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-dbe208b1-1101-4ea7-b590-d016a61b8274 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/11cbafd5-4836-48b9-8db6-440002deb281" status: 200 len: 1512 microversion: 2.1 time: 0.229101 Jan 15 21:01:52.519493 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2101/4172] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:52 2022] GET /compute/v2.1/servers/11cbafd5-4836-48b9-8db6-440002deb281 => generated 1512 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:52.545406 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-3c5894d5-fd64-463d-b7f9-2b74deba0999 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action" status: 200 len: 32580 microversion: 2.1 time: 0.104855 Jan 15 21:01:52.547118 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2072/4173] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:01:52 2022] POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action => generated 32580 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:01:52.793314 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c11a3750-8fe5-4b67-aa90-89330792105a tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:52.794585 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c11a3750-8fe5-4b67-aa90-89330792105a tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:52.803772 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c11a3750-8fe5-4b67-aa90-89330792105a tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:52.804340 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c11a3750-8fe5-4b67-aa90-89330792105a tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:52.805861 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c11a3750-8fe5-4b67-aa90-89330792105a tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:52.806608 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c11a3750-8fe5-4b67-aa90-89330792105a tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:52.854183 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c11a3750-8fe5-4b67-aa90-89330792105a tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 24546 microversion: 2.32 time: 0.064818 Jan 15 21:01:52.855176 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2102/4174] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:52 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 24546 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:01:53.224227 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-af46bab2-db98-4e63-bed1-b76d822c9057 tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:53.225045 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-af46bab2-db98-4e63-bed1-b76d822c9057 tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] [instance: d95ee4eb-4703-466f-b007-a90cc4ac22ce] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:53.234386 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-af46bab2-db98-4e63-bed1-b76d822c9057 tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:53.234925 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-af46bab2-db98-4e63-bed1-b76d822c9057 tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:53.236695 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-af46bab2-db98-4e63-bed1-b76d822c9057 tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:53.237550 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-af46bab2-db98-4e63-bed1-b76d822c9057 tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:53.290899 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-fccd33c3-2603-4426-a68d-a08080187318 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:53.292446 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-fccd33c3-2603-4426-a68d-a08080187318 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] [instance: c76b9e9c-4a53-40ed-9424-7c77a1b946d8] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:53.303177 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fccd33c3-2603-4426-a68d-a08080187318 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:53.303925 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fccd33c3-2603-4426-a68d-a08080187318 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:53.304733 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fccd33c3-2603-4426-a68d-a08080187318 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:53.305590 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fccd33c3-2603-4426-a68d-a08080187318 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:53.474741 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-af46bab2-db98-4e63-bed1-b76d822c9057 tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62278eb28e2e4417bd83e1d04e9fc531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1e1f3647ce41048a7071decbdfe961', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:53.486757 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-af46bab2-db98-4e63-bed1-b76d822c9057 tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] 10.222.0.46 "GET /compute/v2.1/servers/d95ee4eb-4703-466f-b007-a90cc4ac22ce" status: 200 len: 1316 microversion: 2.1 time: 0.266103 Jan 15 21:01:53.487890 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2073/4175] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:53 2022] GET /compute/v2.1/servers/d95ee4eb-4703-466f-b007-a90cc4ac22ce => generated 1316 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:53.493571 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-acc11fa5-1e81-4f77-9018-03bddfa4db63 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:53.495016 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-acc11fa5-1e81-4f77-9018-03bddfa4db63 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:53.503888 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-acc11fa5-1e81-4f77-9018-03bddfa4db63 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:53.505201 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-acc11fa5-1e81-4f77-9018-03bddfa4db63 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:53.505899 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-acc11fa5-1e81-4f77-9018-03bddfa4db63 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:53.506245 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-acc11fa5-1e81-4f77-9018-03bddfa4db63 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:53.553332 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-fccd33c3-2603-4426-a68d-a08080187318 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f084ea51b9d7466cb5e99881ce59e1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769ee4a0d84d43abbed6cdcc4d536de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:53.562394 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-fccd33c3-2603-4426-a68d-a08080187318 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] 10.222.0.46 "GET /compute/v2.1/servers/c76b9e9c-4a53-40ed-9424-7c77a1b946d8" status: 200 len: 1313 microversion: 2.1 time: 0.276580 Jan 15 21:01:53.563054 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2103/4176] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:53 2022] GET /compute/v2.1/servers/c76b9e9c-4a53-40ed-9424-7c77a1b946d8 => generated 1313 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:53.568404 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-16db43f4-8f18-4df7-adb3-2ecd02a8bd0c tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:53.569150 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-acc11fa5-1e81-4f77-9018-03bddfa4db63 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.079621 Jan 15 21:01:53.569733 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-16db43f4-8f18-4df7-adb3-2ecd02a8bd0c tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:53.569860 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2074/4177] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:53 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:01:53.577744 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-16db43f4-8f18-4df7-adb3-2ecd02a8bd0c tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:53.578218 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-16db43f4-8f18-4df7-adb3-2ecd02a8bd0c tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:53.579248 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-16db43f4-8f18-4df7-adb3-2ecd02a8bd0c tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:53.579384 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-dd3c43e1-5f86-48a4-907f-00e6bd594c88 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:53.580574 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-dd3c43e1-5f86-48a4-907f-00e6bd594c88 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 11cbafd5-4836-48b9-8db6-440002deb281] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:53.581116 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-16db43f4-8f18-4df7-adb3-2ecd02a8bd0c tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:53.590251 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dd3c43e1-5f86-48a4-907f-00e6bd594c88 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:53.590745 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dd3c43e1-5f86-48a4-907f-00e6bd594c88 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:53.591602 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dd3c43e1-5f86-48a4-907f-00e6bd594c88 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:53.592089 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dd3c43e1-5f86-48a4-907f-00e6bd594c88 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:53.635865 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-16db43f4-8f18-4df7-adb3-2ecd02a8bd0c tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action" status: 200 len: 32628 microversion: 2.20 time: 0.070635 Jan 15 21:01:53.637032 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2104/4178] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:53 2022] POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action => generated 32628 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:01:53.643350 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-51347bac-b14e-42a2-830a-04386407ebf0 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:53.645333 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-51347bac-b14e-42a2-830a-04386407ebf0 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:53.654319 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-51347bac-b14e-42a2-830a-04386407ebf0 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:53.655668 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-51347bac-b14e-42a2-830a-04386407ebf0 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:53.656877 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-51347bac-b14e-42a2-830a-04386407ebf0 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:53.657541 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-51347bac-b14e-42a2-830a-04386407ebf0 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:53.714054 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-51347bac-b14e-42a2-830a-04386407ebf0 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action" status: 200 len: 32580 microversion: 2.1 time: 0.074903 Jan 15 21:01:53.714990 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2105/4179] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:01:53 2022] POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action => generated 32580 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:01:53.758483 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-dd3c43e1-5f86-48a4-907f-00e6bd594c88 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:53.767669 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-dd3c43e1-5f86-48a4-907f-00e6bd594c88 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/11cbafd5-4836-48b9-8db6-440002deb281" status: 200 len: 1512 microversion: 2.1 time: 0.196387 Jan 15 21:01:53.768345 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2075/4180] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:53 2022] GET /compute/v2.1/servers/11cbafd5-4836-48b9-8db6-440002deb281 => generated 1512 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:53.869213 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-38175831-0dc0-48a7-a19d-150128f544dd tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:53.870670 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-38175831-0dc0-48a7-a19d-150128f544dd tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:53.879825 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-38175831-0dc0-48a7-a19d-150128f544dd tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:53.880543 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-38175831-0dc0-48a7-a19d-150128f544dd tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:53.881746 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-38175831-0dc0-48a7-a19d-150128f544dd tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:53.882288 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-38175831-0dc0-48a7-a19d-150128f544dd tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:53.934603 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-38175831-0dc0-48a7-a19d-150128f544dd tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 24546 microversion: 2.32 time: 0.070194 Jan 15 21:01:53.935327 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2106/4181] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:53 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 24546 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:01:54.508266 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8f0ae516-101e-42e3-92d8-41229eb32541 tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:54.508266 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-8f0ae516-101e-42e3-92d8-41229eb32541 tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] [instance: d95ee4eb-4703-466f-b007-a90cc4ac22ce] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:54.514563 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8f0ae516-101e-42e3-92d8-41229eb32541 tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:54.515371 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8f0ae516-101e-42e3-92d8-41229eb32541 tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:54.517969 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8f0ae516-101e-42e3-92d8-41229eb32541 tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:54.518539 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8f0ae516-101e-42e3-92d8-41229eb32541 tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:54.584459 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-18e11b30-8cef-4fa1-8985-7faa19b5685e tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:54.585442 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-18e11b30-8cef-4fa1-8985-7faa19b5685e tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] [instance: c76b9e9c-4a53-40ed-9424-7c77a1b946d8] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:54.604481 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-18e11b30-8cef-4fa1-8985-7faa19b5685e tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:54.605028 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-18e11b30-8cef-4fa1-8985-7faa19b5685e tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:54.605919 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-18e11b30-8cef-4fa1-8985-7faa19b5685e tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:54.610187 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-18e11b30-8cef-4fa1-8985-7faa19b5685e tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:54.771839 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-8f0ae516-101e-42e3-92d8-41229eb32541 tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62278eb28e2e4417bd83e1d04e9fc531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1e1f3647ce41048a7071decbdfe961', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:54.782526 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-8f0ae516-101e-42e3-92d8-41229eb32541 tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] 10.222.0.46 "GET /compute/v2.1/servers/d95ee4eb-4703-466f-b007-a90cc4ac22ce" status: 200 len: 1316 microversion: 2.1 time: 0.281343 Jan 15 21:01:54.784005 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2076/4182] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:54 2022] GET /compute/v2.1/servers/d95ee4eb-4703-466f-b007-a90cc4ac22ce => generated 1316 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:54.791695 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-bbe17927-d851-4f0f-8c23-6953e7b92138 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:54.793068 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-bbe17927-d851-4f0f-8c23-6953e7b92138 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:54.801844 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bbe17927-d851-4f0f-8c23-6953e7b92138 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:54.802289 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bbe17927-d851-4f0f-8c23-6953e7b92138 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:54.803367 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bbe17927-d851-4f0f-8c23-6953e7b92138 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:54.804115 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bbe17927-d851-4f0f-8c23-6953e7b92138 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:54.853344 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-18e11b30-8cef-4fa1-8985-7faa19b5685e tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f084ea51b9d7466cb5e99881ce59e1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769ee4a0d84d43abbed6cdcc4d536de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:54.859095 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-bbe17927-d851-4f0f-8c23-6953e7b92138 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.073373 Jan 15 21:01:54.860492 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2077/4183] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:54 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:01:54.866974 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-34c852de-0d5e-4b26-9094-a54337277a60 req-2ee2489f-20e3-4134-9071-bbf165536cbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c76b9e9c-4a53-40ed-9424-7c77a1b946d8", "name": "network-vif-plugged", "status": "completed", "tag": "0c5e3426-33d2-4433-bed0-1c17171bce52"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:54.867167 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-18e11b30-8cef-4fa1-8985-7faa19b5685e tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] 10.222.0.46 "GET /compute/v2.1/servers/c76b9e9c-4a53-40ed-9424-7c77a1b946d8" status: 200 len: 1313 microversion: 2.1 time: 0.287976 Jan 15 21:01:54.867965 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2107/4184] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:54 2022] GET /compute/v2.1/servers/c76b9e9c-4a53-40ed-9424-7c77a1b946d8 => generated 1313 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:54.869853 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:01:54.869853 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:01:54.876426 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e4716f3b-6c90-4172-99f2-55a4d4545129 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:54.877948 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e4716f3b-6c90-4172-99f2-55a4d4545129 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:54.880014 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-34c852de-0d5e-4b26-9094-a54337277a60 req-2ee2489f-20e3-4134-9071-bbf165536cbd service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:54.880735 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-34c852de-0d5e-4b26-9094-a54337277a60 req-2ee2489f-20e3-4134-9071-bbf165536cbd service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:54.885257 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e4716f3b-6c90-4172-99f2-55a4d4545129 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:54.886301 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e4716f3b-6c90-4172-99f2-55a4d4545129 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:54.887431 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e4716f3b-6c90-4172-99f2-55a4d4545129 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:54.888122 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e4716f3b-6c90-4172-99f2-55a4d4545129 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:54.897313 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-34c852de-0d5e-4b26-9094-a54337277a60 req-2ee2489f-20e3-4134-9071-bbf165536cbd service nova] Creating event network-vif-plugged:0c5e3426-33d2-4433-bed0-1c17171bce52 for instance c76b9e9c-4a53-40ed-9424-7c77a1b946d8 on nch2-master-1 Jan 15 21:01:54.902904 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-34c852de-0d5e-4b26-9094-a54337277a60 req-2ee2489f-20e3-4134-9071-bbf165536cbd service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039771 Jan 15 21:01:54.903530 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2078/4185] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:01:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:01:54.909357 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-dde29726-e25f-40b2-870e-a43f1a545faa tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:54.910485 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-dde29726-e25f-40b2-870e-a43f1a545faa tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:54.925110 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dde29726-e25f-40b2-870e-a43f1a545faa tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:54.925811 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dde29726-e25f-40b2-870e-a43f1a545faa tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:54.942458 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dde29726-e25f-40b2-870e-a43f1a545faa tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:54.943163 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dde29726-e25f-40b2-870e-a43f1a545faa tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:54.946804 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e4716f3b-6c90-4172-99f2-55a4d4545129 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action" status: 200 len: 32628 microversion: 2.20 time: 0.077424 Jan 15 21:01:54.947846 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2108/4186] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:54 2022] POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action => generated 32628 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:01:54.965294 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-31efa9cd-b92d-4d46-b763-bb18882bb388 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:54.966394 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-31efa9cd-b92d-4d46-b763-bb18882bb388 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 11cbafd5-4836-48b9-8db6-440002deb281] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:54.975307 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-31efa9cd-b92d-4d46-b763-bb18882bb388 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:54.975887 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-31efa9cd-b92d-4d46-b763-bb18882bb388 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:54.976942 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-31efa9cd-b92d-4d46-b763-bb18882bb388 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:54.977449 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-31efa9cd-b92d-4d46-b763-bb18882bb388 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:54.997765 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-dde29726-e25f-40b2-870e-a43f1a545faa tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action" status: 200 len: 32580 microversion: 2.1 time: 0.091923 Jan 15 21:01:55.002583 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2079/4187] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:01:54 2022] POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action => generated 32580 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:01:55.008531 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-232b5b48-55d8-4b5a-8587-8602740e299e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:55.009782 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-232b5b48-55d8-4b5a-8587-8602740e299e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:55.019150 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-232b5b48-55d8-4b5a-8587-8602740e299e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:55.019774 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-232b5b48-55d8-4b5a-8587-8602740e299e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:55.020584 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-232b5b48-55d8-4b5a-8587-8602740e299e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:55.021131 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-232b5b48-55d8-4b5a-8587-8602740e299e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:55.074141 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-232b5b48-55d8-4b5a-8587-8602740e299e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 24546 microversion: 2.32 time: 0.069859 Jan 15 21:01:55.075643 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2080/4188] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:55 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 24546 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:01:55.183886 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-31efa9cd-b92d-4d46-b763-bb18882bb388 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:55.195709 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-31efa9cd-b92d-4d46-b763-bb18882bb388 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/11cbafd5-4836-48b9-8db6-440002deb281" status: 200 len: 1512 microversion: 2.1 time: 0.246322 Jan 15 21:01:55.196397 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2109/4189] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:54 2022] GET /compute/v2.1/servers/11cbafd5-4836-48b9-8db6-440002deb281 => generated 1512 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:55.806403 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-77fd7ded-f41b-4152-80a5-cbbab0e93e61 tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:55.807361 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-77fd7ded-f41b-4152-80a5-cbbab0e93e61 tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] [instance: d95ee4eb-4703-466f-b007-a90cc4ac22ce] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:55.816487 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-77fd7ded-f41b-4152-80a5-cbbab0e93e61 tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:55.817316 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-77fd7ded-f41b-4152-80a5-cbbab0e93e61 tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:55.818085 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-77fd7ded-f41b-4152-80a5-cbbab0e93e61 tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:55.818747 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-77fd7ded-f41b-4152-80a5-cbbab0e93e61 tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:55.871969 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-bba624ff-d0de-4b6e-8571-c6fc0d6d9db3 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:55.873065 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-bba624ff-d0de-4b6e-8571-c6fc0d6d9db3 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:55.881585 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bba624ff-d0de-4b6e-8571-c6fc0d6d9db3 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:55.882033 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bba624ff-d0de-4b6e-8571-c6fc0d6d9db3 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:55.883026 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bba624ff-d0de-4b6e-8571-c6fc0d6d9db3 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:55.883965 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bba624ff-d0de-4b6e-8571-c6fc0d6d9db3 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:55.931048 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-bba624ff-d0de-4b6e-8571-c6fc0d6d9db3 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.062763 Jan 15 21:01:55.931939 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2110/4190] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:55 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:01:55.936814 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-dd91939f-e9ed-4e45-9f98-ee328b2f1a73 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:55.937520 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-dd91939f-e9ed-4e45-9f98-ee328b2f1a73 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] [instance: c76b9e9c-4a53-40ed-9424-7c77a1b946d8] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:55.944762 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dd91939f-e9ed-4e45-9f98-ee328b2f1a73 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:55.945233 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dd91939f-e9ed-4e45-9f98-ee328b2f1a73 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:55.946017 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dd91939f-e9ed-4e45-9f98-ee328b2f1a73 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:55.946451 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dd91939f-e9ed-4e45-9f98-ee328b2f1a73 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:56.061290 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-77fd7ded-f41b-4152-80a5-cbbab0e93e61 tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62278eb28e2e4417bd83e1d04e9fc531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1e1f3647ce41048a7071decbdfe961', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:56.100301 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-77fd7ded-f41b-4152-80a5-cbbab0e93e61 tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] 10.222.0.46 "GET /compute/v2.1/servers/d95ee4eb-4703-466f-b007-a90cc4ac22ce" status: 200 len: 1316 microversion: 2.1 time: 0.299183 Jan 15 21:01:56.100301 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2081/4191] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:55 2022] GET /compute/v2.1/servers/d95ee4eb-4703-466f-b007-a90cc4ac22ce => generated 1316 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:56.107238 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-fb2100e1-afad-49a0-9272-742eb7e13994 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:56.108276 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-fb2100e1-afad-49a0-9272-742eb7e13994 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:56.118282 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fb2100e1-afad-49a0-9272-742eb7e13994 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:56.118808 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fb2100e1-afad-49a0-9272-742eb7e13994 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:56.119620 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fb2100e1-afad-49a0-9272-742eb7e13994 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:56.120277 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fb2100e1-afad-49a0-9272-742eb7e13994 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:56.161314 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-dd91939f-e9ed-4e45-9f98-ee328b2f1a73 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f084ea51b9d7466cb5e99881ce59e1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769ee4a0d84d43abbed6cdcc4d536de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:56.170331 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-dd91939f-e9ed-4e45-9f98-ee328b2f1a73 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] 10.222.0.46 "GET /compute/v2.1/servers/c76b9e9c-4a53-40ed-9424-7c77a1b946d8" status: 200 len: 1313 microversion: 2.1 time: 0.237502 Jan 15 21:01:56.171281 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2111/4192] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:55 2022] GET /compute/v2.1/servers/c76b9e9c-4a53-40ed-9424-7c77a1b946d8 => generated 1313 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:56.175042 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-fb2100e1-afad-49a0-9272-742eb7e13994 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action" status: 200 len: 32628 microversion: 2.20 time: 0.074242 Jan 15 21:01:56.176232 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2082/4193] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:56 2022] POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action => generated 32628 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:01:56.180028 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a3e4cb3f-56be-49f4-bfb5-7380f58db5fe tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:56.181190 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a3e4cb3f-56be-49f4-bfb5-7380f58db5fe tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:56.182345 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1c8aa50e-cef1-42c8-a6d9-9940df22f3a3 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:56.183477 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-1c8aa50e-cef1-42c8-a6d9-9940df22f3a3 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:56.188379 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a3e4cb3f-56be-49f4-bfb5-7380f58db5fe tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:56.190494 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a3e4cb3f-56be-49f4-bfb5-7380f58db5fe tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:56.191508 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a3e4cb3f-56be-49f4-bfb5-7380f58db5fe tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:56.192144 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a3e4cb3f-56be-49f4-bfb5-7380f58db5fe tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:56.193574 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1c8aa50e-cef1-42c8-a6d9-9940df22f3a3 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:56.194157 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1c8aa50e-cef1-42c8-a6d9-9940df22f3a3 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:56.195244 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1c8aa50e-cef1-42c8-a6d9-9940df22f3a3 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:56.195760 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1c8aa50e-cef1-42c8-a6d9-9940df22f3a3 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:56.242901 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-1c8aa50e-cef1-42c8-a6d9-9940df22f3a3 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 24546 microversion: 2.32 time: 0.065114 Jan 15 21:01:56.244443 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2083/4194] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:56 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 24546 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:01:56.249852 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a3e4cb3f-56be-49f4-bfb5-7380f58db5fe tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action" status: 200 len: 32580 microversion: 2.1 time: 0.077163 Jan 15 21:01:56.254708 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2112/4195] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:01:56 2022] POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action => generated 32580 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:01:56.255342 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-86913bb0-fef7-47c7-8fb6-5c78d6cbcbb6 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:56.256305 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-86913bb0-fef7-47c7-8fb6-5c78d6cbcbb6 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 11cbafd5-4836-48b9-8db6-440002deb281] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:56.263680 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-86913bb0-fef7-47c7-8fb6-5c78d6cbcbb6 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:56.264133 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-86913bb0-fef7-47c7-8fb6-5c78d6cbcbb6 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:56.265184 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-86913bb0-fef7-47c7-8fb6-5c78d6cbcbb6 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:56.265680 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-86913bb0-fef7-47c7-8fb6-5c78d6cbcbb6 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:56.445411 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-86913bb0-fef7-47c7-8fb6-5c78d6cbcbb6 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:56.453660 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-86913bb0-fef7-47c7-8fb6-5c78d6cbcbb6 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/11cbafd5-4836-48b9-8db6-440002deb281" status: 200 len: 1512 microversion: 2.1 time: 0.208825 Jan 15 21:01:56.454238 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2084/4196] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:56 2022] GET /compute/v2.1/servers/11cbafd5-4836-48b9-8db6-440002deb281 => generated 1512 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:56.950589 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-aafb7a84-447c-4055-bc76-107683dc019d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:56.952351 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-aafb7a84-447c-4055-bc76-107683dc019d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:56.967008 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-aafb7a84-447c-4055-bc76-107683dc019d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:56.967780 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-aafb7a84-447c-4055-bc76-107683dc019d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:56.969261 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-aafb7a84-447c-4055-bc76-107683dc019d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:56.970075 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-aafb7a84-447c-4055-bc76-107683dc019d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:57.047241 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-aafb7a84-447c-4055-bc76-107683dc019d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.105322 Jan 15 21:01:57.048891 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2113/4197] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:56 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:01:57.131884 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c203f50b-3bbb-48bb-90ab-7f7b677b92c3 tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:57.133920 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c203f50b-3bbb-48bb-90ab-7f7b677b92c3 tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] [instance: d95ee4eb-4703-466f-b007-a90cc4ac22ce] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:57.164334 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c203f50b-3bbb-48bb-90ab-7f7b677b92c3 tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:57.165082 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c203f50b-3bbb-48bb-90ab-7f7b677b92c3 tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:57.166125 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c203f50b-3bbb-48bb-90ab-7f7b677b92c3 tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:57.166712 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c203f50b-3bbb-48bb-90ab-7f7b677b92c3 tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:57.193436 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-912f6000-c9dc-42d2-b26a-473d5c109a12 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:57.194969 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-912f6000-c9dc-42d2-b26a-473d5c109a12 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] [instance: c76b9e9c-4a53-40ed-9424-7c77a1b946d8] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:57.207848 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-912f6000-c9dc-42d2-b26a-473d5c109a12 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:57.208645 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-912f6000-c9dc-42d2-b26a-473d5c109a12 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:57.209835 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-912f6000-c9dc-42d2-b26a-473d5c109a12 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:57.210560 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-912f6000-c9dc-42d2-b26a-473d5c109a12 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:57.453055 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-c203f50b-3bbb-48bb-90ab-7f7b677b92c3 tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62278eb28e2e4417bd83e1d04e9fc531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1e1f3647ce41048a7071decbdfe961', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:57.458990 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-912f6000-c9dc-42d2-b26a-473d5c109a12 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f084ea51b9d7466cb5e99881ce59e1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769ee4a0d84d43abbed6cdcc4d536de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:57.463505 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c203f50b-3bbb-48bb-90ab-7f7b677b92c3 tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] 10.222.0.46 "GET /compute/v2.1/servers/d95ee4eb-4703-466f-b007-a90cc4ac22ce" status: 200 len: 1316 microversion: 2.1 time: 0.351980 Jan 15 21:01:57.464525 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2085/4198] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:57 2022] GET /compute/v2.1/servers/d95ee4eb-4703-466f-b007-a90cc4ac22ce => generated 1316 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:57.469455 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-912f6000-c9dc-42d2-b26a-473d5c109a12 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] 10.222.0.46 "GET /compute/v2.1/servers/c76b9e9c-4a53-40ed-9424-7c77a1b946d8" status: 200 len: 1498 microversion: 2.1 time: 0.282889 Jan 15 21:01:57.471473 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2114/4199] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:57 2022] GET /compute/v2.1/servers/c76b9e9c-4a53-40ed-9424-7c77a1b946d8 => generated 1498 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:01:57.476187 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f4cb68f6-8025-45eb-8317-5449380914ab tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:57.477111 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f4cb68f6-8025-45eb-8317-5449380914ab tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:57.479410 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7c685872-ee6e-4a3a-b067-ae32af0e4f5e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:57.481981 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-7c685872-ee6e-4a3a-b067-ae32af0e4f5e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:57.483391 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f4cb68f6-8025-45eb-8317-5449380914ab tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:57.483912 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f4cb68f6-8025-45eb-8317-5449380914ab tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:57.485477 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f4cb68f6-8025-45eb-8317-5449380914ab tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:57.486691 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f4cb68f6-8025-45eb-8317-5449380914ab tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:57.494521 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7c685872-ee6e-4a3a-b067-ae32af0e4f5e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:57.495094 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7c685872-ee6e-4a3a-b067-ae32af0e4f5e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:57.496017 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7c685872-ee6e-4a3a-b067-ae32af0e4f5e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:57.496492 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7c685872-ee6e-4a3a-b067-ae32af0e4f5e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:57.537687 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f4cb68f6-8025-45eb-8317-5449380914ab tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 24546 microversion: 2.32 time: 0.064852 Jan 15 21:01:57.541522 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2115/4200] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:57 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 24546 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:01:57.543795 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2a392a56-edf8-4875-831b-04d46f5b28d4 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:57.545079 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-2a392a56-edf8-4875-831b-04d46f5b28d4 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:57.548798 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7c685872-ee6e-4a3a-b067-ae32af0e4f5e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action" status: 200 len: 32628 microversion: 2.20 time: 0.081897 Jan 15 21:01:57.549691 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2086/4201] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:57 2022] POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action => generated 32628 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:01:57.553778 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2a392a56-edf8-4875-831b-04d46f5b28d4 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:57.557518 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2a392a56-edf8-4875-831b-04d46f5b28d4 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:57.557518 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2a392a56-edf8-4875-831b-04d46f5b28d4 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:57.557518 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2a392a56-edf8-4875-831b-04d46f5b28d4 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:57.557872 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ea8831d8-e481-4bd2-b063-57912a5966eb tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:57.557872 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ea8831d8-e481-4bd2-b063-57912a5966eb tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 11cbafd5-4836-48b9-8db6-440002deb281] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:57.567018 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ea8831d8-e481-4bd2-b063-57912a5966eb tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:57.567512 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ea8831d8-e481-4bd2-b063-57912a5966eb tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:57.569118 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ea8831d8-e481-4bd2-b063-57912a5966eb tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:57.569620 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ea8831d8-e481-4bd2-b063-57912a5966eb tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:57.606534 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2a392a56-edf8-4875-831b-04d46f5b28d4 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action" status: 200 len: 32580 microversion: 2.1 time: 0.065122 Jan 15 21:01:57.607735 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2116/4202] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:01:57 2022] POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action => generated 32580 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:01:57.614375 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a71fb7b7-ccab-4417-ab35-df27b6320c89 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:57.635284 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.compute.server_groups [None req-a71fb7b7-ccab-4417-ab35-df27b6320c89 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Querying cell 2935be83-7c51-430d-8ff2-0a8179973c9a(cell1) for 1 instances {{(pid=129365) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:68}} Jan 15 21:01:57.636056 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a71fb7b7-ccab-4417-ab35-df27b6320c89 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:57.636712 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a71fb7b7-ccab-4417-ab35-df27b6320c89 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:57.662221 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a71fb7b7-ccab-4417-ab35-df27b6320c89 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] 10.222.0.46 "GET /compute/v2.1/os-server-groups/de2ddae4-b545-4b41-bc9f-1b3b96f3da91" status: 200 len: 221 microversion: 2.1 time: 0.053099 Jan 15 21:01:57.663173 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2117/4203] 10.222.0.46 () {58 vars in 1262 bytes} [Sat Jan 15 21:01:57 2022] GET /compute/v2.1/os-server-groups/de2ddae4-b545-4b41-bc9f-1b3b96f3da91 => generated 221 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:01:57.675477 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f6871f90-fe09-4ef8-a586-76cf76651d15 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:57.676133 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f6871f90-fe09-4ef8-a586-76cf76651d15 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] [instance: c76b9e9c-4a53-40ed-9424-7c77a1b946d8] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:57.682531 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f6871f90-fe09-4ef8-a586-76cf76651d15 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:57.683054 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f6871f90-fe09-4ef8-a586-76cf76651d15 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:57.683849 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f6871f90-fe09-4ef8-a586-76cf76651d15 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:57.684512 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f6871f90-fe09-4ef8-a586-76cf76651d15 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:57.718489 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f6871f90-fe09-4ef8-a586-76cf76651d15 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] [instance: c76b9e9c-4a53-40ed-9424-7c77a1b946d8] Going to try to terminate instance {{(pid=129365) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 21:01:57.745176 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-ea8831d8-e481-4bd2-b063-57912a5966eb tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:57.755674 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ea8831d8-e481-4bd2-b063-57912a5966eb tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/11cbafd5-4836-48b9-8db6-440002deb281" status: 200 len: 1512 microversion: 2.1 time: 0.204714 Jan 15 21:01:57.761027 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2087/4204] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:57 2022] GET /compute/v2.1/servers/11cbafd5-4836-48b9-8db6-440002deb281 => generated 1512 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:57.816164 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f6871f90-fe09-4ef8-a586-76cf76651d15 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] 10.222.0.46 "DELETE /compute/v2.1/servers/c76b9e9c-4a53-40ed-9424-7c77a1b946d8" status: 204 len: 0 microversion: 2.1 time: 0.145291 Jan 15 21:01:57.816764 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2118/4205] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 21:01:57 2022] DELETE /compute/v2.1/servers/c76b9e9c-4a53-40ed-9424-7c77a1b946d8 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 15 21:01:57.826748 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e263d8d6-8df3-417d-a6c9-d27e99631c98 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:57.827530 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e263d8d6-8df3-417d-a6c9-d27e99631c98 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] [instance: c76b9e9c-4a53-40ed-9424-7c77a1b946d8] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:57.834607 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e263d8d6-8df3-417d-a6c9-d27e99631c98 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:57.835083 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e263d8d6-8df3-417d-a6c9-d27e99631c98 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:57.838928 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e263d8d6-8df3-417d-a6c9-d27e99631c98 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:57.838928 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e263d8d6-8df3-417d-a6c9-d27e99631c98 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:57.984594 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-e263d8d6-8df3-417d-a6c9-d27e99631c98 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f084ea51b9d7466cb5e99881ce59e1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769ee4a0d84d43abbed6cdcc4d536de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:57.992366 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e263d8d6-8df3-417d-a6c9-d27e99631c98 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] 10.222.0.46 "GET /compute/v2.1/servers/c76b9e9c-4a53-40ed-9424-7c77a1b946d8" status: 200 len: 1504 microversion: 2.1 time: 0.171401 Jan 15 21:01:57.992958 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2088/4206] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:57 2022] GET /compute/v2.1/servers/c76b9e9c-4a53-40ed-9424-7c77a1b946d8 => generated 1504 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:01:58.060054 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-158c475c-9506-4783-bb4f-909f7cbe5232 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:58.061117 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-158c475c-9506-4783-bb4f-909f7cbe5232 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:58.068118 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-158c475c-9506-4783-bb4f-909f7cbe5232 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:58.068564 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-158c475c-9506-4783-bb4f-909f7cbe5232 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:58.069379 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-158c475c-9506-4783-bb4f-909f7cbe5232 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:58.069815 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-158c475c-9506-4783-bb4f-909f7cbe5232 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:58.114509 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-158c475c-9506-4783-bb4f-909f7cbe5232 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.058509 Jan 15 21:01:58.115771 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2119/4207] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:58 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:01:58.482292 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-10d1ecee-f2b6-4936-b701-51e681274741 tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:58.483695 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-10d1ecee-f2b6-4936-b701-51e681274741 tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] [instance: d95ee4eb-4703-466f-b007-a90cc4ac22ce] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:58.492621 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-10d1ecee-f2b6-4936-b701-51e681274741 tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:58.493660 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-10d1ecee-f2b6-4936-b701-51e681274741 tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:58.494807 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-10d1ecee-f2b6-4936-b701-51e681274741 tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:58.495601 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-10d1ecee-f2b6-4936-b701-51e681274741 tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:58.550159 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-05b8e383-06bb-42b2-a72a-36ab9e4fb879 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:58.551161 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-05b8e383-06bb-42b2-a72a-36ab9e4fb879 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:58.561793 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-05b8e383-06bb-42b2-a72a-36ab9e4fb879 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:58.562238 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-05b8e383-06bb-42b2-a72a-36ab9e4fb879 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:58.563032 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-05b8e383-06bb-42b2-a72a-36ab9e4fb879 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:58.563463 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-05b8e383-06bb-42b2-a72a-36ab9e4fb879 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:58.616085 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-05b8e383-06bb-42b2-a72a-36ab9e4fb879 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 24546 microversion: 2.32 time: 0.070314 Jan 15 21:01:58.616684 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2120/4208] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:58 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 24546 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:01:58.624563 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3fc9cc8b-d2b2-4c1a-a849-6eab1aae0d96 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:58.625693 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-3fc9cc8b-d2b2-4c1a-a849-6eab1aae0d96 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:58.633554 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3fc9cc8b-d2b2-4c1a-a849-6eab1aae0d96 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:58.634052 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3fc9cc8b-d2b2-4c1a-a849-6eab1aae0d96 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:58.634937 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3fc9cc8b-d2b2-4c1a-a849-6eab1aae0d96 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:58.635428 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3fc9cc8b-d2b2-4c1a-a849-6eab1aae0d96 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:58.671428 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-10d1ecee-f2b6-4936-b701-51e681274741 tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62278eb28e2e4417bd83e1d04e9fc531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1e1f3647ce41048a7071decbdfe961', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:58.681278 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-10d1ecee-f2b6-4936-b701-51e681274741 tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] 10.222.0.46 "GET /compute/v2.1/servers/d95ee4eb-4703-466f-b007-a90cc4ac22ce" status: 200 len: 1316 microversion: 2.1 time: 0.203384 Jan 15 21:01:58.681939 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2089/4209] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:58 2022] GET /compute/v2.1/servers/d95ee4eb-4703-466f-b007-a90cc4ac22ce => generated 1316 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:01:58.687581 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-b59524ed-74ee-47c1-ae0a-198e74b2be7f req-4d3896bf-0665-465a-8cc3-9d0f3f18a045 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d95ee4eb-4703-466f-b007-a90cc4ac22ce", "name": "network-vif-plugged", "status": "completed", "tag": "c9595e70-1846-4eb0-8e71-6944c7a0d531"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:58.690914 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:01:58.690914 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:01:58.701022 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-b59524ed-74ee-47c1-ae0a-198e74b2be7f req-4d3896bf-0665-465a-8cc3-9d0f3f18a045 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:58.701753 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-b59524ed-74ee-47c1-ae0a-198e74b2be7f req-4d3896bf-0665-465a-8cc3-9d0f3f18a045 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:58.703998 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3fc9cc8b-d2b2-4c1a-a849-6eab1aae0d96 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action" status: 200 len: 32628 microversion: 2.20 time: 0.085053 Jan 15 21:01:58.705217 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2121/4210] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:58 2022] POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action => generated 32628 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:01:58.724193 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-b59524ed-74ee-47c1-ae0a-198e74b2be7f req-4d3896bf-0665-465a-8cc3-9d0f3f18a045 service nova] Creating event network-vif-plugged:c9595e70-1846-4eb0-8e71-6944c7a0d531 for instance d95ee4eb-4703-466f-b007-a90cc4ac22ce on nch2-master-1 Jan 15 21:01:58.724969 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-fd88cb2e-d920-4ca1-bcb2-63eb0bad9b47 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:58.726107 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-fd88cb2e-d920-4ca1-bcb2-63eb0bad9b47 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:58.733852 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fd88cb2e-d920-4ca1-bcb2-63eb0bad9b47 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:58.734478 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fd88cb2e-d920-4ca1-bcb2-63eb0bad9b47 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:58.735433 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fd88cb2e-d920-4ca1-bcb2-63eb0bad9b47 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:58.736631 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fd88cb2e-d920-4ca1-bcb2-63eb0bad9b47 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:58.739390 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-b59524ed-74ee-47c1-ae0a-198e74b2be7f req-4d3896bf-0665-465a-8cc3-9d0f3f18a045 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055132 Jan 15 21:01:58.740192 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2090/4211] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:01:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:01:58.780758 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e03f3a3b-d8e5-4b3d-ab93-7891f3e82b11 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:58.783927 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e03f3a3b-d8e5-4b3d-ab93-7891f3e82b11 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 11cbafd5-4836-48b9-8db6-440002deb281] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:58.792971 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e03f3a3b-d8e5-4b3d-ab93-7891f3e82b11 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:58.793423 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e03f3a3b-d8e5-4b3d-ab93-7891f3e82b11 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:58.795932 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e03f3a3b-d8e5-4b3d-ab93-7891f3e82b11 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:58.796682 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e03f3a3b-d8e5-4b3d-ab93-7891f3e82b11 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:58.802015 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-fd88cb2e-d920-4ca1-bcb2-63eb0bad9b47 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action" status: 200 len: 32580 microversion: 2.1 time: 0.091544 Jan 15 21:01:58.802819 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2122/4212] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:01:58 2022] POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action => generated 32580 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:01:58.964990 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-e03f3a3b-d8e5-4b3d-ab93-7891f3e82b11 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:58.974109 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e03f3a3b-d8e5-4b3d-ab93-7891f3e82b11 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/11cbafd5-4836-48b9-8db6-440002deb281" status: 200 len: 1512 microversion: 2.1 time: 0.202129 Jan 15 21:01:58.974766 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2091/4213] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:58 2022] GET /compute/v2.1/servers/11cbafd5-4836-48b9-8db6-440002deb281 => generated 1512 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:01:59.011719 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e099429d-936c-4e75-82fe-7f097cf0722d tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:59.012414 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e099429d-936c-4e75-82fe-7f097cf0722d tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] [instance: c76b9e9c-4a53-40ed-9424-7c77a1b946d8] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:59.020712 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e099429d-936c-4e75-82fe-7f097cf0722d tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:59.021055 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e099429d-936c-4e75-82fe-7f097cf0722d tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:59.021913 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e099429d-936c-4e75-82fe-7f097cf0722d tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:59.022360 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e099429d-936c-4e75-82fe-7f097cf0722d tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:59.126947 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c3c110c3-f4f6-431a-963b-be0a738a641e tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:59.128027 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c3c110c3-f4f6-431a-963b-be0a738a641e tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:59.134825 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c3c110c3-f4f6-431a-963b-be0a738a641e tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:59.135641 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c3c110c3-f4f6-431a-963b-be0a738a641e tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:59.136619 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c3c110c3-f4f6-431a-963b-be0a738a641e tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:59.137238 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c3c110c3-f4f6-431a-963b-be0a738a641e tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:59.186456 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c3c110c3-f4f6-431a-963b-be0a738a641e tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.063307 Jan 15 21:01:59.187298 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2092/4214] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:59 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:01:59.188482 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-e099429d-936c-4e75-82fe-7f097cf0722d tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f084ea51b9d7466cb5e99881ce59e1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769ee4a0d84d43abbed6cdcc4d536de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:59.196290 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e099429d-936c-4e75-82fe-7f097cf0722d tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] 10.222.0.46 "GET /compute/v2.1/servers/c76b9e9c-4a53-40ed-9424-7c77a1b946d8" status: 200 len: 1504 microversion: 2.1 time: 0.189167 Jan 15 21:01:59.204879 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2123/4215] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:59 2022] GET /compute/v2.1/servers/c76b9e9c-4a53-40ed-9424-7c77a1b946d8 => generated 1504 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:01:59.630056 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e77b9b71-3e56-419a-9d87-28350e6ac19e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:59.631723 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e77b9b71-3e56-419a-9d87-28350e6ac19e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:59.641070 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e77b9b71-3e56-419a-9d87-28350e6ac19e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:59.641446 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e77b9b71-3e56-419a-9d87-28350e6ac19e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:59.643044 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e77b9b71-3e56-419a-9d87-28350e6ac19e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:59.643531 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e77b9b71-3e56-419a-9d87-28350e6ac19e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:59.699987 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-4c164d0c-75e3-40fa-841f-83fc57d1954b tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:59.700242 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e77b9b71-3e56-419a-9d87-28350e6ac19e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 24546 microversion: 2.32 time: 0.074930 Jan 15 21:01:59.700997 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2093/4216] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:59 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 24546 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:01:59.701149 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-4c164d0c-75e3-40fa-841f-83fc57d1954b tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] [instance: d95ee4eb-4703-466f-b007-a90cc4ac22ce] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:59.719758 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c3551c43-3307-41f1-907b-f070487c442e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:59.722074 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c3551c43-3307-41f1-907b-f070487c442e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:59.722231 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4c164d0c-75e3-40fa-841f-83fc57d1954b tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:59.722857 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4c164d0c-75e3-40fa-841f-83fc57d1954b tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:59.724433 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4c164d0c-75e3-40fa-841f-83fc57d1954b tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:59.725484 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4c164d0c-75e3-40fa-841f-83fc57d1954b tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:59.731715 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c3551c43-3307-41f1-907b-f070487c442e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:59.732440 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c3551c43-3307-41f1-907b-f070487c442e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:59.733336 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c3551c43-3307-41f1-907b-f070487c442e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:59.733961 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c3551c43-3307-41f1-907b-f070487c442e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:59.793964 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c3551c43-3307-41f1-907b-f070487c442e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action" status: 200 len: 32628 microversion: 2.20 time: 0.078666 Jan 15 21:01:59.795412 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2094/4217] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:01:59 2022] POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action => generated 32628 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:01:59.817393 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-bdda2c13-1368-4587-a84a-f223aa74b984 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:59.818910 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-bdda2c13-1368-4587-a84a-f223aa74b984 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:01:59.832197 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bdda2c13-1368-4587-a84a-f223aa74b984 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:59.833369 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bdda2c13-1368-4587-a84a-f223aa74b984 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:59.834611 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bdda2c13-1368-4587-a84a-f223aa74b984 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:59.835106 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bdda2c13-1368-4587-a84a-f223aa74b984 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:59.885554 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-bdda2c13-1368-4587-a84a-f223aa74b984 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action" status: 200 len: 32580 microversion: 2.1 time: 0.074527 Jan 15 21:01:59.887835 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2095/4218] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:01:59 2022] POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action => generated 32580 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:01:59.969861 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-4c164d0c-75e3-40fa-841f-83fc57d1954b tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62278eb28e2e4417bd83e1d04e9fc531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1e1f3647ce41048a7071decbdfe961', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:01:59.972432 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-90da5b3b-fbb7-4d7c-8c99-7596f62fb26b req-4931b554-ca81-44d3-b78d-0ef1b084b7d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c76b9e9c-4a53-40ed-9424-7c77a1b946d8", "name": "network-vif-deleted", "tag": "0c5e3426-33d2-4433-bed0-1c17171bce52"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:01:59.974989 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:01:59.974989 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:01:59.984432 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-4c164d0c-75e3-40fa-841f-83fc57d1954b tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] 10.222.0.46 "GET /compute/v2.1/servers/d95ee4eb-4703-466f-b007-a90cc4ac22ce" status: 200 len: 1316 microversion: 2.1 time: 0.288053 Jan 15 21:01:59.984694 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-90da5b3b-fbb7-4d7c-8c99-7596f62fb26b req-4931b554-ca81-44d3-b78d-0ef1b084b7d0 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:01:59.987470 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-90da5b3b-fbb7-4d7c-8c99-7596f62fb26b req-4931b554-ca81-44d3-b78d-0ef1b084b7d0 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:01:59.989322 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2124/4219] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:59 2022] GET /compute/v2.1/servers/d95ee4eb-4703-466f-b007-a90cc4ac22ce => generated 1316 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:01:59.995328 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e13d0f8b-21b5-48ac-abc7-fb2cc94dfa40 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:01:59.996696 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e13d0f8b-21b5-48ac-abc7-fb2cc94dfa40 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 11cbafd5-4836-48b9-8db6-440002deb281] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:00.008691 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e13d0f8b-21b5-48ac-abc7-fb2cc94dfa40 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:00.010926 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e13d0f8b-21b5-48ac-abc7-fb2cc94dfa40 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:00.012148 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e13d0f8b-21b5-48ac-abc7-fb2cc94dfa40 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:00.012938 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e13d0f8b-21b5-48ac-abc7-fb2cc94dfa40 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:00.015765 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-90da5b3b-fbb7-4d7c-8c99-7596f62fb26b req-4931b554-ca81-44d3-b78d-0ef1b084b7d0 service nova] Creating event network-vif-deleted:0c5e3426-33d2-4433-bed0-1c17171bce52 for instance c76b9e9c-4a53-40ed-9424-7c77a1b946d8 on nch2-master-1 Jan 15 21:02:00.024141 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-90da5b3b-fbb7-4d7c-8c99-7596f62fb26b req-4931b554-ca81-44d3-b78d-0ef1b084b7d0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056793 Jan 15 21:02:00.025326 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2096/4220] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:01:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:02:00.200468 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-89ae8b1d-cf8e-4cd0-acf8-c8736ba6244d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:00.208403 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-89ae8b1d-cf8e-4cd0-acf8-c8736ba6244d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:00.217892 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-89ae8b1d-cf8e-4cd0-acf8-c8736ba6244d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:00.218782 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-89ae8b1d-cf8e-4cd0-acf8-c8736ba6244d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:00.220136 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-89ae8b1d-cf8e-4cd0-acf8-c8736ba6244d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:00.221222 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-89ae8b1d-cf8e-4cd0-acf8-c8736ba6244d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:00.255686 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-e13d0f8b-21b5-48ac-abc7-fb2cc94dfa40 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:00.263667 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e13d0f8b-21b5-48ac-abc7-fb2cc94dfa40 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/11cbafd5-4836-48b9-8db6-440002deb281" status: 200 len: 1512 microversion: 2.1 time: 0.272979 Jan 15 21:02:00.264310 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2125/4221] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:01:59 2022] GET /compute/v2.1/servers/11cbafd5-4836-48b9-8db6-440002deb281 => generated 1512 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:02:00.270196 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-fab20d4b-f770-47db-a8ba-33a7191c96af tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:00.271319 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-fab20d4b-f770-47db-a8ba-33a7191c96af tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] [instance: c76b9e9c-4a53-40ed-9424-7c77a1b946d8] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:00.274504 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-89ae8b1d-cf8e-4cd0-acf8-c8736ba6244d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.078740 Jan 15 21:02:00.277467 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2097/4222] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:02:00 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:02:00.278841 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fab20d4b-f770-47db-a8ba-33a7191c96af tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:00.279278 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fab20d4b-f770-47db-a8ba-33a7191c96af tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:00.280331 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fab20d4b-f770-47db-a8ba-33a7191c96af tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:00.280771 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fab20d4b-f770-47db-a8ba-33a7191c96af tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:00.316134 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fab20d4b-f770-47db-a8ba-33a7191c96af tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:00.316811 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fab20d4b-f770-47db-a8ba-33a7191c96af tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:00.317341 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.objects.instance [None req-fab20d4b-f770-47db-a8ba-33a7191c96af tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Lazy-loading 'fault' on Instance uuid c76b9e9c-4a53-40ed-9424-7c77a1b946d8 {{(pid=129365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 21:02:00.670948 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-fab20d4b-f770-47db-a8ba-33a7191c96af tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f084ea51b9d7466cb5e99881ce59e1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769ee4a0d84d43abbed6cdcc4d536de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:00.678050 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-fab20d4b-f770-47db-a8ba-33a7191c96af tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] 10.222.0.46 "GET /compute/v2.1/servers/c76b9e9c-4a53-40ed-9424-7c77a1b946d8" status: 200 len: 1303 microversion: 2.1 time: 0.412542 Jan 15 21:02:00.678630 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2126/4223] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:02:00 2022] GET /compute/v2.1/servers/c76b9e9c-4a53-40ed-9424-7c77a1b946d8 => generated 1303 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:02:00.714216 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-5eace2bf-aa5e-4414-a3cf-3aaeffb9db46 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:00.715548 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-5eace2bf-aa5e-4414-a3cf-3aaeffb9db46 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:00.724119 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5eace2bf-aa5e-4414-a3cf-3aaeffb9db46 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:00.724803 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5eace2bf-aa5e-4414-a3cf-3aaeffb9db46 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:00.726049 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5eace2bf-aa5e-4414-a3cf-3aaeffb9db46 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:00.726763 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5eace2bf-aa5e-4414-a3cf-3aaeffb9db46 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:00.777063 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-5eace2bf-aa5e-4414-a3cf-3aaeffb9db46 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 24546 microversion: 2.32 time: 0.068017 Jan 15 21:02:00.780461 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2098/4224] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:02:00 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 24546 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:02:00.808249 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d70e673d-0c84-44e9-83dc-6266e5591fed tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:00.809458 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d70e673d-0c84-44e9-83dc-6266e5591fed tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:00.816387 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d70e673d-0c84-44e9-83dc-6266e5591fed tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:00.816927 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d70e673d-0c84-44e9-83dc-6266e5591fed tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:00.817827 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d70e673d-0c84-44e9-83dc-6266e5591fed tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:00.818301 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d70e673d-0c84-44e9-83dc-6266e5591fed tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:00.861962 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d70e673d-0c84-44e9-83dc-6266e5591fed tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action" status: 200 len: 32628 microversion: 2.20 time: 0.057258 Jan 15 21:02:00.866346 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2127/4225] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:02:00 2022] POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action => generated 32628 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:02:00.900309 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-bae08d8a-c3e6-479b-b71a-8baa5fe48416 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:00.901883 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-bae08d8a-c3e6-479b-b71a-8baa5fe48416 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:00.913153 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bae08d8a-c3e6-479b-b71a-8baa5fe48416 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:00.914233 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bae08d8a-c3e6-479b-b71a-8baa5fe48416 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:00.915591 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bae08d8a-c3e6-479b-b71a-8baa5fe48416 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:00.916357 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bae08d8a-c3e6-479b-b71a-8baa5fe48416 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:00.966979 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-bae08d8a-c3e6-479b-b71a-8baa5fe48416 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action" status: 200 len: 32580 microversion: 2.1 time: 0.070845 Jan 15 21:02:00.968877 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2099/4226] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:02:00 2022] POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action => generated 32580 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:02:01.005458 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-7bd2d985-5583-444a-808b-0a09b2ac9790 tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:01.006157 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-7bd2d985-5583-444a-808b-0a09b2ac9790 tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] [instance: d95ee4eb-4703-466f-b007-a90cc4ac22ce] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:01.013755 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7bd2d985-5583-444a-808b-0a09b2ac9790 tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:01.014206 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7bd2d985-5583-444a-808b-0a09b2ac9790 tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:01.014992 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7bd2d985-5583-444a-808b-0a09b2ac9790 tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:01.015430 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7bd2d985-5583-444a-808b-0a09b2ac9790 tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:01.176290 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-7bd2d985-5583-444a-808b-0a09b2ac9790 tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62278eb28e2e4417bd83e1d04e9fc531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1e1f3647ce41048a7071decbdfe961', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:01.184929 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-7bd2d985-5583-444a-808b-0a09b2ac9790 tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] 10.222.0.46 "GET /compute/v2.1/servers/d95ee4eb-4703-466f-b007-a90cc4ac22ce" status: 200 len: 1504 microversion: 2.1 time: 0.183560 Jan 15 21:02:01.185620 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2128/4227] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:02:00 2022] GET /compute/v2.1/servers/d95ee4eb-4703-466f-b007-a90cc4ac22ce => generated 1504 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:02:01.203566 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-59fb8fef-43cb-47c6-b5a5-92696a3e36f3 tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:01.205241 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-59fb8fef-43cb-47c6-b5a5-92696a3e36f3 tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] [instance: d95ee4eb-4703-466f-b007-a90cc4ac22ce] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:01.214017 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-59fb8fef-43cb-47c6-b5a5-92696a3e36f3 tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:01.214512 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-59fb8fef-43cb-47c6-b5a5-92696a3e36f3 tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:01.215361 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-59fb8fef-43cb-47c6-b5a5-92696a3e36f3 tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:01.215901 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-59fb8fef-43cb-47c6-b5a5-92696a3e36f3 tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:01.242045 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-59fb8fef-43cb-47c6-b5a5-92696a3e36f3 tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] 10.222.0.46 "GET /compute/v2.1/servers/d95ee4eb-4703-466f-b007-a90cc4ac22ce/ips" status: 200 len: 108 microversion: 2.1 time: 0.043339 Jan 15 21:02:01.242767 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2100/4228] 10.222.0.46 () {58 vars in 1247 bytes} [Sat Jan 15 21:02:01 2022] GET /compute/v2.1/servers/d95ee4eb-4703-466f-b007-a90cc4ac22ce/ips => generated 108 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:02:01.255562 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-85e43fe9-441d-4d3f-8e87-099530b69ef5 tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:01.256094 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-85e43fe9-441d-4d3f-8e87-099530b69ef5 tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] [instance: d95ee4eb-4703-466f-b007-a90cc4ac22ce] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:01.264188 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-85e43fe9-441d-4d3f-8e87-099530b69ef5 tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:01.264721 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-85e43fe9-441d-4d3f-8e87-099530b69ef5 tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:01.265643 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-85e43fe9-441d-4d3f-8e87-099530b69ef5 tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:01.266160 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-85e43fe9-441d-4d3f-8e87-099530b69ef5 tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:01.282348 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-88d490fe-a420-40be-83c5-908c9f5454ea tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:01.282586 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-88d490fe-a420-40be-83c5-908c9f5454ea tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 11cbafd5-4836-48b9-8db6-440002deb281] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:01.291451 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-88d490fe-a420-40be-83c5-908c9f5454ea tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:01.291910 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-88d490fe-a420-40be-83c5-908c9f5454ea tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:01.292747 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-88d490fe-a420-40be-83c5-908c9f5454ea tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:01.293325 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-88d490fe-a420-40be-83c5-908c9f5454ea tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:01.296252 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-85e43fe9-441d-4d3f-8e87-099530b69ef5 tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] 10.222.0.46 "GET /compute/v2.1/servers/d95ee4eb-4703-466f-b007-a90cc4ac22ce/ips" status: 200 len: 108 microversion: 2.1 time: 0.045933 Jan 15 21:02:01.301069 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2129/4229] 10.222.0.46 () {58 vars in 1247 bytes} [Sat Jan 15 21:02:01 2022] GET /compute/v2.1/servers/d95ee4eb-4703-466f-b007-a90cc4ac22ce/ips => generated 108 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:02:01.305002 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-34b65bde-5cef-48a4-852b-b072296fe372 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:01.306411 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-34b65bde-5cef-48a4-852b-b072296fe372 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:01.315616 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-34b65bde-5cef-48a4-852b-b072296fe372 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:01.316178 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-34b65bde-5cef-48a4-852b-b072296fe372 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:01.317429 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-34b65bde-5cef-48a4-852b-b072296fe372 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:01.317594 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-34b65bde-5cef-48a4-852b-b072296fe372 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:01.375128 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-34b65bde-5cef-48a4-852b-b072296fe372 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.076798 Jan 15 21:02:01.376651 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2130/4230] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:02:01 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:02:01.382631 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-6813224c-7c6f-43dd-af78-1952087a1b0b tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:01.383251 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-6813224c-7c6f-43dd-af78-1952087a1b0b tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] [instance: d95ee4eb-4703-466f-b007-a90cc4ac22ce] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:01.393085 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6813224c-7c6f-43dd-af78-1952087a1b0b tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:01.406369 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6813224c-7c6f-43dd-af78-1952087a1b0b tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:01.406369 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6813224c-7c6f-43dd-af78-1952087a1b0b tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:01.406369 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6813224c-7c6f-43dd-af78-1952087a1b0b tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:01.431947 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-6813224c-7c6f-43dd-af78-1952087a1b0b tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] 10.222.0.46 "GET /compute/v2.1/servers/d95ee4eb-4703-466f-b007-a90cc4ac22ce/ips/tempest-ServerAddressesTestJSON-806994825-network" status: 200 len: 93 microversion: 2.1 time: 0.053741 Jan 15 21:02:01.432613 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2131/4231] 10.222.0.46 () {58 vars in 1397 bytes} [Sat Jan 15 21:02:01 2022] GET /compute/v2.1/servers/d95ee4eb-4703-466f-b007-a90cc4ac22ce/ips/tempest-ServerAddressesTestJSON-806994825-network => generated 93 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 21:02:01.444509 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c7d907bd-e851-489b-be7d-ce34d491349a tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:01.445364 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c7d907bd-e851-489b-be7d-ce34d491349a tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] [instance: d95ee4eb-4703-466f-b007-a90cc4ac22ce] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:01.453208 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c7d907bd-e851-489b-be7d-ce34d491349a tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:01.453702 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c7d907bd-e851-489b-be7d-ce34d491349a tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:01.455110 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c7d907bd-e851-489b-be7d-ce34d491349a tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:01.455562 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c7d907bd-e851-489b-be7d-ce34d491349a tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:01.488386 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c7d907bd-e851-489b-be7d-ce34d491349a tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] [instance: d95ee4eb-4703-466f-b007-a90cc4ac22ce] Going to try to terminate instance {{(pid=129365) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 21:02:01.499428 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-88d490fe-a420-40be-83c5-908c9f5454ea tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:01.509129 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-88d490fe-a420-40be-83c5-908c9f5454ea tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/11cbafd5-4836-48b9-8db6-440002deb281" status: 200 len: 1512 microversion: 2.1 time: 0.231107 Jan 15 21:02:01.511142 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2101/4232] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:02:01 2022] GET /compute/v2.1/servers/11cbafd5-4836-48b9-8db6-440002deb281 => generated 1512 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:02:01.573740 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c7d907bd-e851-489b-be7d-ce34d491349a tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] 10.222.0.46 "DELETE /compute/v2.1/servers/d95ee4eb-4703-466f-b007-a90cc4ac22ce" status: 204 len: 0 microversion: 2.1 time: 0.132987 Jan 15 21:02:01.574625 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2132/4233] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 21:02:01 2022] DELETE /compute/v2.1/servers/d95ee4eb-4703-466f-b007-a90cc4ac22ce => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 15 21:02:01.586821 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-36ca9058-5146-4168-abce-8b3448aa4f61 tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:01.587668 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-36ca9058-5146-4168-abce-8b3448aa4f61 tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] [instance: d95ee4eb-4703-466f-b007-a90cc4ac22ce] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:01.594127 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-36ca9058-5146-4168-abce-8b3448aa4f61 tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:01.595166 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-36ca9058-5146-4168-abce-8b3448aa4f61 tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:01.596818 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-36ca9058-5146-4168-abce-8b3448aa4f61 tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:01.597528 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-36ca9058-5146-4168-abce-8b3448aa4f61 tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:01.697324 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c47e257c-8d3d-407c-bd57-f8b4dfb72767 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:01.698249 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c47e257c-8d3d-407c-bd57-f8b4dfb72767 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] [instance: c76b9e9c-4a53-40ed-9424-7c77a1b946d8] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:01.705343 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c47e257c-8d3d-407c-bd57-f8b4dfb72767 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:01.706431 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c47e257c-8d3d-407c-bd57-f8b4dfb72767 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:01.707429 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c47e257c-8d3d-407c-bd57-f8b4dfb72767 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:01.708672 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c47e257c-8d3d-407c-bd57-f8b4dfb72767 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:01.726256 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-c47e257c-8d3d-407c-bd57-f8b4dfb72767 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] HTTP exception thrown: Instance c76b9e9c-4a53-40ed-9424-7c77a1b946d8 could not be found. Jan 15 21:02:01.726880 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c47e257c-8d3d-407c-bd57-f8b4dfb72767 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Returning 404 to user: Instance c76b9e9c-4a53-40ed-9424-7c77a1b946d8 could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:02:01.727861 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c47e257c-8d3d-407c-bd57-f8b4dfb72767 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] 10.222.0.46 "GET /compute/v2.1/servers/c76b9e9c-4a53-40ed-9424-7c77a1b946d8" status: 404 len: 111 microversion: 2.1 time: 0.035518 Jan 15 21:02:01.728952 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2133/4234] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:02:01 2022] GET /compute/v2.1/servers/c76b9e9c-4a53-40ed-9424-7c77a1b946d8 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:02:01.741433 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-6e6e55a5-40da-49ab-97e4-a04b7d2104c4 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:01.756620 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-36ca9058-5146-4168-abce-8b3448aa4f61 tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62278eb28e2e4417bd83e1d04e9fc531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1e1f3647ce41048a7071decbdfe961', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:01.760785 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.compute.server_groups [None req-6e6e55a5-40da-49ab-97e4-a04b7d2104c4 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Querying cell 2935be83-7c51-430d-8ff2-0a8179973c9a(cell1) for 1 instances {{(pid=129365) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:68}} Jan 15 21:02:01.762062 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6e6e55a5-40da-49ab-97e4-a04b7d2104c4 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:01.762922 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6e6e55a5-40da-49ab-97e4-a04b7d2104c4 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:01.764745 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-36ca9058-5146-4168-abce-8b3448aa4f61 tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] 10.222.0.46 "GET /compute/v2.1/servers/d95ee4eb-4703-466f-b007-a90cc4ac22ce" status: 200 len: 1510 microversion: 2.1 time: 0.183996 Jan 15 21:02:01.765431 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2102/4235] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:02:01 2022] GET /compute/v2.1/servers/d95ee4eb-4703-466f-b007-a90cc4ac22ce => generated 1510 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:02:01.777692 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-6e6e55a5-40da-49ab-97e4-a04b7d2104c4 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] 10.222.0.46 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.041742 Jan 15 21:02:01.778373 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2134/4236] 10.222.0.46 () {58 vars in 1151 bytes} [Sat Jan 15 21:02:01 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:02:01.790583 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-35a1f787-4dcb-4486-8312-5d08e9747774 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:01.791485 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-35a1f787-4dcb-4486-8312-5d08e9747774 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:01.791766 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5af27db0-c291-44b7-8327-56f4c3607492 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:01.797763 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-35a1f787-4dcb-4486-8312-5d08e9747774 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:01.798244 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-35a1f787-4dcb-4486-8312-5d08e9747774 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:01.799035 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-35a1f787-4dcb-4486-8312-5d08e9747774 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:01.799682 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-35a1f787-4dcb-4486-8312-5d08e9747774 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:01.809992 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.compute.server_groups [None req-5af27db0-c291-44b7-8327-56f4c3607492 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Querying cell 2935be83-7c51-430d-8ff2-0a8179973c9a(cell1) for 1 instances {{(pid=129365) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:68}} Jan 15 21:02:01.810915 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5af27db0-c291-44b7-8327-56f4c3607492 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:01.811421 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5af27db0-c291-44b7-8327-56f4c3607492 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:01.823479 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5af27db0-c291-44b7-8327-56f4c3607492 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] 10.222.0.46 "GET /compute/v2.1/os-server-groups/de2ddae4-b545-4b41-bc9f-1b3b96f3da91" status: 200 len: 183 microversion: 2.1 time: 0.035945 Jan 15 21:02:01.830557 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2135/4237] 10.222.0.46 () {58 vars in 1262 bytes} [Sat Jan 15 21:02:01 2022] GET /compute/v2.1/os-server-groups/de2ddae4-b545-4b41-bc9f-1b3b96f3da91 => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:02:01.836518 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c83584e3-4505-4d60-835d-8a0dd288cabf tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:01.837266 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c83584e3-4505-4d60-835d-8a0dd288cabf tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] [instance: c76b9e9c-4a53-40ed-9424-7c77a1b946d8] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:01.844390 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c83584e3-4505-4d60-835d-8a0dd288cabf tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:01.844878 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c83584e3-4505-4d60-835d-8a0dd288cabf tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:01.846302 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c83584e3-4505-4d60-835d-8a0dd288cabf tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:01.846828 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c83584e3-4505-4d60-835d-8a0dd288cabf tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:01.855458 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-35a1f787-4dcb-4486-8312-5d08e9747774 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 24546 microversion: 2.32 time: 0.068284 Jan 15 21:02:01.856523 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2103/4238] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:02:01 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 24546 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:02:01.862116 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-c83584e3-4505-4d60-835d-8a0dd288cabf tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] HTTP exception thrown: Instance c76b9e9c-4a53-40ed-9424-7c77a1b946d8 could not be found. Jan 15 21:02:01.862803 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c83584e3-4505-4d60-835d-8a0dd288cabf tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Returning 404 to user: Instance c76b9e9c-4a53-40ed-9424-7c77a1b946d8 could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:02:01.863779 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c83584e3-4505-4d60-835d-8a0dd288cabf tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] 10.222.0.46 "DELETE /compute/v2.1/servers/c76b9e9c-4a53-40ed-9424-7c77a1b946d8" status: 404 len: 111 microversion: 2.1 time: 0.031484 Jan 15 21:02:01.864568 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2136/4239] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 21:02:01 2022] DELETE /compute/v2.1/servers/c76b9e9c-4a53-40ed-9424-7c77a1b946d8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:02:01.874918 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ddff0878-76ac-4bb1-89f6-55c1d4c6b915 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:01.876044 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ddff0878-76ac-4bb1-89f6-55c1d4c6b915 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:01.876933 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7d840507-f22e-4123-ac9d-8a00ef17fd9b tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:01.878040 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-7d840507-f22e-4123-ac9d-8a00ef17fd9b tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] [instance: c76b9e9c-4a53-40ed-9424-7c77a1b946d8] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:01.884662 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ddff0878-76ac-4bb1-89f6-55c1d4c6b915 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:01.885249 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ddff0878-76ac-4bb1-89f6-55c1d4c6b915 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:01.886274 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ddff0878-76ac-4bb1-89f6-55c1d4c6b915 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:01.886755 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ddff0878-76ac-4bb1-89f6-55c1d4c6b915 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:01.887536 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7d840507-f22e-4123-ac9d-8a00ef17fd9b tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:01.888349 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7d840507-f22e-4123-ac9d-8a00ef17fd9b tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:01.889488 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7d840507-f22e-4123-ac9d-8a00ef17fd9b tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:01.890106 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7d840507-f22e-4123-ac9d-8a00ef17fd9b tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:01.910339 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-7d840507-f22e-4123-ac9d-8a00ef17fd9b tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] HTTP exception thrown: Instance c76b9e9c-4a53-40ed-9424-7c77a1b946d8 could not be found. Jan 15 21:02:01.911551 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7d840507-f22e-4123-ac9d-8a00ef17fd9b tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Returning 404 to user: Instance c76b9e9c-4a53-40ed-9424-7c77a1b946d8 could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:02:01.912706 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7d840507-f22e-4123-ac9d-8a00ef17fd9b tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] 10.222.0.46 "GET /compute/v2.1/servers/c76b9e9c-4a53-40ed-9424-7c77a1b946d8" status: 404 len: 111 microversion: 2.1 time: 0.042893 Jan 15 21:02:01.914475 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2104/4240] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:02:01 2022] GET /compute/v2.1/servers/c76b9e9c-4a53-40ed-9424-7c77a1b946d8 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:02:01.922743 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e03ee916-1a51-4bd1-9166-f62550911b3b tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:01.932040 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-e03ee916-1a51-4bd1-9166-f62550911b3b tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] HTTP exception thrown: Instance group ea465c3d-3299-48ad-b678-8f6358eb5366 could not be found. Jan 15 21:02:01.933061 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e03ee916-1a51-4bd1-9166-f62550911b3b tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Returning 404 to user: Instance group ea465c3d-3299-48ad-b678-8f6358eb5366 could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:02:01.933929 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e03ee916-1a51-4bd1-9166-f62550911b3b tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] 10.222.0.46 "DELETE /compute/v2.1/os-server-groups/ea465c3d-3299-48ad-b678-8f6358eb5366" status: 404 len: 117 microversion: 2.1 time: 0.015611 Jan 15 21:02:01.939663 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2105/4241] 10.222.0.46 () {58 vars in 1265 bytes} [Sat Jan 15 21:02:01 2022] DELETE /compute/v2.1/os-server-groups/ea465c3d-3299-48ad-b678-8f6358eb5366 => generated 117 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 15 21:02:01.942993 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ddff0878-76ac-4bb1-89f6-55c1d4c6b915 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action" status: 200 len: 32628 microversion: 2.20 time: 0.071717 Jan 15 21:02:01.946457 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-82156d56-f30c-41d5-bcc2-fc9aeb05ddef tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:01.948673 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2137/4242] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:02:01 2022] POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action => generated 32628 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:02:01.957187 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-82156d56-f30c-41d5-bcc2-fc9aeb05ddef tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] HTTP exception thrown: Instance group 83802644-f267-48c8-a461-1b26bd6831d1 could not be found. Jan 15 21:02:01.957980 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-82156d56-f30c-41d5-bcc2-fc9aeb05ddef tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Returning 404 to user: Instance group 83802644-f267-48c8-a461-1b26bd6831d1 could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:02:01.959522 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-82156d56-f30c-41d5-bcc2-fc9aeb05ddef tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] 10.222.0.46 "DELETE /compute/v2.1/os-server-groups/83802644-f267-48c8-a461-1b26bd6831d1" status: 404 len: 117 microversion: 2.1 time: 0.017893 Jan 15 21:02:01.960201 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2106/4243] 10.222.0.46 () {58 vars in 1265 bytes} [Sat Jan 15 21:02:01 2022] DELETE /compute/v2.1/os-server-groups/83802644-f267-48c8-a461-1b26bd6831d1 => generated 117 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:02:01.972201 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-0ae32a05-4361-45a2-89cd-42862c2c08a5 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:01.980545 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-0ae32a05-4361-45a2-89cd-42862c2c08a5 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] HTTP exception thrown: Instance group b3e1af76-fd65-4c24-86ad-85fb5891ca60 could not be found. Jan 15 21:02:01.981698 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-0ae32a05-4361-45a2-89cd-42862c2c08a5 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Returning 404 to user: Instance group b3e1af76-fd65-4c24-86ad-85fb5891ca60 could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:02:01.982855 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-0ae32a05-4361-45a2-89cd-42862c2c08a5 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] 10.222.0.46 "DELETE /compute/v2.1/os-server-groups/b3e1af76-fd65-4c24-86ad-85fb5891ca60" status: 404 len: 117 microversion: 2.1 time: 0.016426 Jan 15 21:02:01.983623 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2138/4244] 10.222.0.46 () {58 vars in 1265 bytes} [Sat Jan 15 21:02:01 2022] DELETE /compute/v2.1/os-server-groups/b3e1af76-fd65-4c24-86ad-85fb5891ca60 => generated 117 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:02:01.990571 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-cce8733c-c71c-49f5-887c-6f870bde86ea tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:01.991513 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-cce8733c-c71c-49f5-887c-6f870bde86ea tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:01.993650 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-7c031ba0-56e7-45b9-9f8f-e956b795eb11 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:01.997954 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cce8733c-c71c-49f5-887c-6f870bde86ea tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:01.998440 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cce8733c-c71c-49f5-887c-6f870bde86ea tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:01.999369 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cce8733c-c71c-49f5-887c-6f870bde86ea tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:01.999630 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cce8733c-c71c-49f5-887c-6f870bde86ea tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:02.004022 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-7c031ba0-56e7-45b9-9f8f-e956b795eb11 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] HTTP exception thrown: Instance group bbd2f0e9-e528-459d-b2bc-566bde5f1379 could not be found. Jan 15 21:02:02.004663 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-7c031ba0-56e7-45b9-9f8f-e956b795eb11 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Returning 404 to user: Instance group bbd2f0e9-e528-459d-b2bc-566bde5f1379 could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:02:02.005583 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-7c031ba0-56e7-45b9-9f8f-e956b795eb11 tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] 10.222.0.46 "DELETE /compute/v2.1/os-server-groups/bbd2f0e9-e528-459d-b2bc-566bde5f1379" status: 404 len: 117 microversion: 2.1 time: 0.016183 Jan 15 21:02:02.006358 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2139/4245] 10.222.0.46 () {58 vars in 1265 bytes} [Sat Jan 15 21:02:01 2022] DELETE /compute/v2.1/os-server-groups/bbd2f0e9-e528-459d-b2bc-566bde5f1379 => generated 117 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:02:02.016928 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c7b9c17b-7e32-4fea-8228-a2c52418526f tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:02.052475 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-cce8733c-c71c-49f5-887c-6f870bde86ea tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action" status: 200 len: 32580 microversion: 2.1 time: 0.070700 Jan 15 21:02:02.053093 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c7b9c17b-7e32-4fea-8228-a2c52418526f tempest-ServerGroupTestJSON-807921766 tempest-ServerGroupTestJSON-807921766-project] 10.222.0.46 "DELETE /compute/v2.1/os-server-groups/de2ddae4-b545-4b41-bc9f-1b3b96f3da91" status: 204 len: 0 microversion: 2.1 time: 0.040898 Jan 15 21:02:02.053883 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2107/4246] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:02:01 2022] POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action => generated 32580 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:02:02.054306 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2140/4247] 10.222.0.46 () {58 vars in 1265 bytes} [Sat Jan 15 21:02:02 2022] DELETE /compute/v2.1/os-server-groups/de2ddae4-b545-4b41-bc9f-1b3b96f3da91 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 15 21:02:02.391266 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-92689eae-93b2-4b9b-8ea1-9d45aa8dc4f0 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:02.393499 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-92689eae-93b2-4b9b-8ea1-9d45aa8dc4f0 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:02.401881 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-92689eae-93b2-4b9b-8ea1-9d45aa8dc4f0 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:02.402702 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-92689eae-93b2-4b9b-8ea1-9d45aa8dc4f0 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:02.403587 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-92689eae-93b2-4b9b-8ea1-9d45aa8dc4f0 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:02.404448 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-92689eae-93b2-4b9b-8ea1-9d45aa8dc4f0 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:02.466887 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-92689eae-93b2-4b9b-8ea1-9d45aa8dc4f0 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.081068 Jan 15 21:02:02.468559 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2108/4248] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:02:02 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:02:02.527384 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2736b939-4096-427f-84e7-3e9ac8dd2d44 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:02.528210 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-2736b939-4096-427f-84e7-3e9ac8dd2d44 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 11cbafd5-4836-48b9-8db6-440002deb281] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:02.536526 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2736b939-4096-427f-84e7-3e9ac8dd2d44 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:02.536995 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2736b939-4096-427f-84e7-3e9ac8dd2d44 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:02.538044 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2736b939-4096-427f-84e7-3e9ac8dd2d44 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:02.538604 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2736b939-4096-427f-84e7-3e9ac8dd2d44 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:02.711361 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-2736b939-4096-427f-84e7-3e9ac8dd2d44 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:02.722488 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2736b939-4096-427f-84e7-3e9ac8dd2d44 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/11cbafd5-4836-48b9-8db6-440002deb281" status: 200 len: 1512 microversion: 2.1 time: 0.198655 Jan 15 21:02:02.724386 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2141/4249] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:02:02 2022] GET /compute/v2.1/servers/11cbafd5-4836-48b9-8db6-440002deb281 => generated 1512 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:02:02.784428 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0ff6c4bf-c45f-4c8f-92aa-23c064a458a3 tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:02.785309 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-0ff6c4bf-c45f-4c8f-92aa-23c064a458a3 tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] [instance: d95ee4eb-4703-466f-b007-a90cc4ac22ce] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:02.807188 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0ff6c4bf-c45f-4c8f-92aa-23c064a458a3 tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:02.808015 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0ff6c4bf-c45f-4c8f-92aa-23c064a458a3 tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:02.809169 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0ff6c4bf-c45f-4c8f-92aa-23c064a458a3 tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:02.809634 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0ff6c4bf-c45f-4c8f-92aa-23c064a458a3 tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:02.868093 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b0e996bf-7131-4362-bdfe-da5461fbad61 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:02.869053 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b0e996bf-7131-4362-bdfe-da5461fbad61 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:02.877042 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b0e996bf-7131-4362-bdfe-da5461fbad61 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:02.877717 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b0e996bf-7131-4362-bdfe-da5461fbad61 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:02.881202 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b0e996bf-7131-4362-bdfe-da5461fbad61 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:02.881202 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b0e996bf-7131-4362-bdfe-da5461fbad61 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:02.937672 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b0e996bf-7131-4362-bdfe-da5461fbad61 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 24546 microversion: 2.32 time: 0.073240 Jan 15 21:02:02.945245 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2142/4250] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:02:02 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 24546 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:02:02.959722 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9c67497d-5583-487f-b275-56caa48e1ffe tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:02.960659 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-9c67497d-5583-487f-b275-56caa48e1ffe tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:02.978553 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9c67497d-5583-487f-b275-56caa48e1ffe tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:02.979290 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9c67497d-5583-487f-b275-56caa48e1ffe tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:02.980113 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9c67497d-5583-487f-b275-56caa48e1ffe tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:02.980546 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9c67497d-5583-487f-b275-56caa48e1ffe tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:03.016416 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-0ff6c4bf-c45f-4c8f-92aa-23c064a458a3 tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62278eb28e2e4417bd83e1d04e9fc531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1e1f3647ce41048a7071decbdfe961', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:03.028608 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0ff6c4bf-c45f-4c8f-92aa-23c064a458a3 tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] 10.222.0.46 "GET /compute/v2.1/servers/d95ee4eb-4703-466f-b007-a90cc4ac22ce" status: 200 len: 1510 microversion: 2.1 time: 0.248705 Jan 15 21:02:03.031238 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2109/4251] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:02:02 2022] GET /compute/v2.1/servers/d95ee4eb-4703-466f-b007-a90cc4ac22ce => generated 1510 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:02:03.046360 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-9c67497d-5583-487f-b275-56caa48e1ffe tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action" status: 200 len: 32628 microversion: 2.20 time: 0.093825 Jan 15 21:02:03.051076 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2143/4252] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:02:02 2022] POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action => generated 32628 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:02:03.067498 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d5caf223-82a3-4fa3-9945-7ef26107340d tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:03.068621 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-d5caf223-82a3-4fa3-9945-7ef26107340d tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:03.076201 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d5caf223-82a3-4fa3-9945-7ef26107340d tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:03.077336 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d5caf223-82a3-4fa3-9945-7ef26107340d tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:03.078661 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d5caf223-82a3-4fa3-9945-7ef26107340d tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:03.080321 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d5caf223-82a3-4fa3-9945-7ef26107340d tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:03.147011 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d5caf223-82a3-4fa3-9945-7ef26107340d tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action" status: 200 len: 32580 microversion: 2.1 time: 0.084358 Jan 15 21:02:03.147714 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2110/4253] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:02:03 2022] POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action => generated 32580 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:02:03.481436 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9d566791-66f8-415f-9200-949e538e46f5 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:03.483129 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-9d566791-66f8-415f-9200-949e538e46f5 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:03.493104 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9d566791-66f8-415f-9200-949e538e46f5 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:03.493627 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9d566791-66f8-415f-9200-949e538e46f5 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:03.494551 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9d566791-66f8-415f-9200-949e538e46f5 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:03.495223 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9d566791-66f8-415f-9200-949e538e46f5 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:03.553458 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-9d566791-66f8-415f-9200-949e538e46f5 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.076513 Jan 15 21:02:03.560321 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2144/4254] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:02:03 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:02:03.644664 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-46c4917b-78c4-4cee-8a6b-4dddd60ac9d8 req-466bd0f6-1487-42f3-8f3a-addae242b85a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d95ee4eb-4703-466f-b007-a90cc4ac22ce", "name": "network-vif-deleted", "tag": "c9595e70-1846-4eb0-8e71-6944c7a0d531"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:03.646430 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:02:03.646430 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:02:03.667588 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-46c4917b-78c4-4cee-8a6b-4dddd60ac9d8 req-466bd0f6-1487-42f3-8f3a-addae242b85a service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:03.668049 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-46c4917b-78c4-4cee-8a6b-4dddd60ac9d8 req-466bd0f6-1487-42f3-8f3a-addae242b85a service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:03.682205 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-46c4917b-78c4-4cee-8a6b-4dddd60ac9d8 req-466bd0f6-1487-42f3-8f3a-addae242b85a service nova] Creating event network-vif-deleted:c9595e70-1846-4eb0-8e71-6944c7a0d531 for instance d95ee4eb-4703-466f-b007-a90cc4ac22ce on nch2-master-1 Jan 15 21:02:03.687984 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-46c4917b-78c4-4cee-8a6b-4dddd60ac9d8 req-466bd0f6-1487-42f3-8f3a-addae242b85a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048476 Jan 15 21:02:03.691877 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2111/4255] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:02:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:02:03.742900 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-47aadfb9-9d5d-4d16-a5b5-8d918ba0ef3f tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:03.743681 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-47aadfb9-9d5d-4d16-a5b5-8d918ba0ef3f tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 11cbafd5-4836-48b9-8db6-440002deb281] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:03.750615 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-47aadfb9-9d5d-4d16-a5b5-8d918ba0ef3f tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:03.751070 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-47aadfb9-9d5d-4d16-a5b5-8d918ba0ef3f tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:03.754966 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-47aadfb9-9d5d-4d16-a5b5-8d918ba0ef3f tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:03.757917 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-47aadfb9-9d5d-4d16-a5b5-8d918ba0ef3f tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:03.961472 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-db304408-4873-4372-b5eb-23649d9d4db5 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:03.964046 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-db304408-4873-4372-b5eb-23649d9d4db5 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:03.973416 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-db304408-4873-4372-b5eb-23649d9d4db5 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:03.973983 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-db304408-4873-4372-b5eb-23649d9d4db5 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:03.975538 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-db304408-4873-4372-b5eb-23649d9d4db5 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:03.976417 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-db304408-4873-4372-b5eb-23649d9d4db5 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:04.005243 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-47aadfb9-9d5d-4d16-a5b5-8d918ba0ef3f tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:04.018198 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-47aadfb9-9d5d-4d16-a5b5-8d918ba0ef3f tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/11cbafd5-4836-48b9-8db6-440002deb281" status: 200 len: 1512 microversion: 2.1 time: 0.279634 Jan 15 21:02:04.019105 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2145/4256] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:02:03 2022] GET /compute/v2.1/servers/11cbafd5-4836-48b9-8db6-440002deb281 => generated 1512 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:02:04.051097 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-064f94d2-e6ba-418b-93b4-9fadbf828a86 tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:04.052058 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-064f94d2-e6ba-418b-93b4-9fadbf828a86 tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] [instance: d95ee4eb-4703-466f-b007-a90cc4ac22ce] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:04.061615 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-064f94d2-e6ba-418b-93b4-9fadbf828a86 tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:04.062279 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-064f94d2-e6ba-418b-93b4-9fadbf828a86 tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:04.062666 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-db304408-4873-4372-b5eb-23649d9d4db5 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 24546 microversion: 2.32 time: 0.107949 Jan 15 21:02:04.067585 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2112/4257] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:02:03 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 24546 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:02:04.067885 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-064f94d2-e6ba-418b-93b4-9fadbf828a86 tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:04.067885 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-064f94d2-e6ba-418b-93b4-9fadbf828a86 tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:04.071320 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4832ff8e-9c9b-40f9-9e63-d69acf1ddf5e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:04.074478 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-4832ff8e-9c9b-40f9-9e63-d69acf1ddf5e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:04.089502 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4832ff8e-9c9b-40f9-9e63-d69acf1ddf5e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:04.090578 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4832ff8e-9c9b-40f9-9e63-d69acf1ddf5e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:04.093364 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4832ff8e-9c9b-40f9-9e63-d69acf1ddf5e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:04.094501 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4832ff8e-9c9b-40f9-9e63-d69acf1ddf5e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:04.150729 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-064f94d2-e6ba-418b-93b4-9fadbf828a86 tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:04.151637 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-064f94d2-e6ba-418b-93b4-9fadbf828a86 tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:04.154813 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.objects.instance [None req-064f94d2-e6ba-418b-93b4-9fadbf828a86 tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] Lazy-loading 'fault' on Instance uuid d95ee4eb-4703-466f-b007-a90cc4ac22ce {{(pid=129365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 21:02:04.163396 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-4832ff8e-9c9b-40f9-9e63-d69acf1ddf5e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action" status: 200 len: 32628 microversion: 2.20 time: 0.096529 Jan 15 21:02:04.166518 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2113/4258] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:02:04 2022] POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action => generated 32628 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:02:04.178000 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-32dcf73a-316e-433d-8050-6328ca8f8019 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:04.179292 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-32dcf73a-316e-433d-8050-6328ca8f8019 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:04.190249 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-32dcf73a-316e-433d-8050-6328ca8f8019 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:04.190954 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-32dcf73a-316e-433d-8050-6328ca8f8019 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:04.192012 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-32dcf73a-316e-433d-8050-6328ca8f8019 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:04.192810 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-32dcf73a-316e-433d-8050-6328ca8f8019 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:04.258310 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-064f94d2-e6ba-418b-93b4-9fadbf828a86 tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62278eb28e2e4417bd83e1d04e9fc531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1e1f3647ce41048a7071decbdfe961', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:04.264687 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-32dcf73a-316e-433d-8050-6328ca8f8019 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action" status: 200 len: 32580 microversion: 2.1 time: 0.092445 Jan 15 21:02:04.266260 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2114/4259] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:02:04 2022] POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action => generated 32580 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:02:04.272147 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-064f94d2-e6ba-418b-93b4-9fadbf828a86 tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] 10.222.0.46 "GET /compute/v2.1/servers/d95ee4eb-4703-466f-b007-a90cc4ac22ce" status: 200 len: 1306 microversion: 2.1 time: 0.227063 Jan 15 21:02:04.273453 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2146/4260] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:02:04 2022] GET /compute/v2.1/servers/d95ee4eb-4703-466f-b007-a90cc4ac22ce => generated 1306 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:02:04.574469 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7a261aed-4df6-47d4-a8db-e8e7f1251266 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:04.576079 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-7a261aed-4df6-47d4-a8db-e8e7f1251266 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:04.584968 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7a261aed-4df6-47d4-a8db-e8e7f1251266 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:04.585705 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7a261aed-4df6-47d4-a8db-e8e7f1251266 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:04.586730 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7a261aed-4df6-47d4-a8db-e8e7f1251266 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:04.587470 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7a261aed-4df6-47d4-a8db-e8e7f1251266 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:04.645122 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7a261aed-4df6-47d4-a8db-e8e7f1251266 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.076525 Jan 15 21:02:04.645798 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2115/4261] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:02:04 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:02:05.037156 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-97cd4c23-edcd-40ca-bd55-5ee95445e79a tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:05.038553 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-97cd4c23-edcd-40ca-bd55-5ee95445e79a tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 11cbafd5-4836-48b9-8db6-440002deb281] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:05.050644 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-97cd4c23-edcd-40ca-bd55-5ee95445e79a tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:05.051222 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-97cd4c23-edcd-40ca-bd55-5ee95445e79a tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:05.052484 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-97cd4c23-edcd-40ca-bd55-5ee95445e79a tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:05.053043 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-97cd4c23-edcd-40ca-bd55-5ee95445e79a tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:05.077191 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f934ec8d-79b4-43e9-8229-960ee5ad3bc8 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:05.078198 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f934ec8d-79b4-43e9-8229-960ee5ad3bc8 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:05.094716 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f934ec8d-79b4-43e9-8229-960ee5ad3bc8 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:05.098366 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f934ec8d-79b4-43e9-8229-960ee5ad3bc8 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:05.100157 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f934ec8d-79b4-43e9-8229-960ee5ad3bc8 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:05.102184 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f934ec8d-79b4-43e9-8229-960ee5ad3bc8 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:05.179671 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f934ec8d-79b4-43e9-8229-960ee5ad3bc8 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 24546 microversion: 2.32 time: 0.107836 Jan 15 21:02:05.181838 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2116/4262] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:02:05 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 24546 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:02:05.197378 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f773c4fb-9c4a-4600-a620-65ab90581d0c tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:05.199333 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f773c4fb-9c4a-4600-a620-65ab90581d0c tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:05.216815 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f773c4fb-9c4a-4600-a620-65ab90581d0c tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:05.217996 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f773c4fb-9c4a-4600-a620-65ab90581d0c tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:05.223318 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f773c4fb-9c4a-4600-a620-65ab90581d0c tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:05.224528 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f773c4fb-9c4a-4600-a620-65ab90581d0c tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:05.289354 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-97cd4c23-edcd-40ca-bd55-5ee95445e79a tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:05.295076 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f773c4fb-9c4a-4600-a620-65ab90581d0c tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action" status: 200 len: 32628 microversion: 2.20 time: 0.111383 Jan 15 21:02:05.301158 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-97cd4c23-edcd-40ca-bd55-5ee95445e79a tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/11cbafd5-4836-48b9-8db6-440002deb281" status: 200 len: 1512 microversion: 2.1 time: 0.268875 Jan 15 21:02:05.301291 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2117/4263] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:02:05 2022] POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action => generated 32628 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:02:05.311300 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a06c1d16-388d-4b30-8e63-ad9c5cecf4d3 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:05.311300 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a06c1d16-388d-4b30-8e63-ad9c5cecf4d3 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:05.312099 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2147/4264] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:02:05 2022] GET /compute/v2.1/servers/11cbafd5-4836-48b9-8db6-440002deb281 => generated 1512 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:02:05.317195 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e1f603c0-bcbe-4994-b52c-a1a1510dbaa4 tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:05.317666 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a06c1d16-388d-4b30-8e63-ad9c5cecf4d3 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:05.318436 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e1f603c0-bcbe-4994-b52c-a1a1510dbaa4 tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] [instance: d95ee4eb-4703-466f-b007-a90cc4ac22ce] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:05.318561 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a06c1d16-388d-4b30-8e63-ad9c5cecf4d3 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:05.319435 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a06c1d16-388d-4b30-8e63-ad9c5cecf4d3 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:05.319881 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a06c1d16-388d-4b30-8e63-ad9c5cecf4d3 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:05.326008 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e1f603c0-bcbe-4994-b52c-a1a1510dbaa4 tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:05.326877 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e1f603c0-bcbe-4994-b52c-a1a1510dbaa4 tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:05.327761 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e1f603c0-bcbe-4994-b52c-a1a1510dbaa4 tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:05.328267 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e1f603c0-bcbe-4994-b52c-a1a1510dbaa4 tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:05.346743 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-e1f603c0-bcbe-4994-b52c-a1a1510dbaa4 tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] HTTP exception thrown: Instance d95ee4eb-4703-466f-b007-a90cc4ac22ce could not be found. Jan 15 21:02:05.347445 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e1f603c0-bcbe-4994-b52c-a1a1510dbaa4 tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] Returning 404 to user: Instance d95ee4eb-4703-466f-b007-a90cc4ac22ce could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:02:05.348709 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e1f603c0-bcbe-4994-b52c-a1a1510dbaa4 tempest-ServerAddressesTestJSON-1839787290 tempest-ServerAddressesTestJSON-1839787290-project] 10.222.0.46 "GET /compute/v2.1/servers/d95ee4eb-4703-466f-b007-a90cc4ac22ce" status: 404 len: 111 microversion: 2.1 time: 0.035244 Jan 15 21:02:05.350457 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2148/4265] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:02:05 2022] GET /compute/v2.1/servers/d95ee4eb-4703-466f-b007-a90cc4ac22ce => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:02:05.402518 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a06c1d16-388d-4b30-8e63-ad9c5cecf4d3 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action" status: 200 len: 32580 microversion: 2.1 time: 0.097771 Jan 15 21:02:05.404223 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2118/4266] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:02:05 2022] POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action => generated 32580 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:02:05.613800 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-cdd37399-7857-4d11-9e16-5a7e8b60a5d7 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-1269994723", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "networks": [{"uuid": "e6197bfe-5ee1-43c6-91d2-83857deb053a"}]}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:05.658762 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0094f8ca-481c-475f-be33-57fc21c32f97 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:05.660329 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-0094f8ca-481c-475f-be33-57fc21c32f97 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:05.669451 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0094f8ca-481c-475f-be33-57fc21c32f97 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:05.669948 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0094f8ca-481c-475f-be33-57fc21c32f97 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:05.670965 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0094f8ca-481c-475f-be33-57fc21c32f97 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:05.671251 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0094f8ca-481c-475f-be33-57fc21c32f97 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:05.691067 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.network.neutron [None req-cdd37399-7857-4d11-9e16-5a7e8b60a5d7 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] validate_networks() for [('e6197bfe-5ee1-43c6-91d2-83857deb053a', None, None, None, None, None)] {{(pid=129365) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 21:02:05.742682 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0094f8ca-481c-475f-be33-57fc21c32f97 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.088869 Jan 15 21:02:05.748073 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2119/4267] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:02:05 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:02:06.128895 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-cdd37399-7857-4d11-9e16-5a7e8b60a5d7 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Flavor limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 21:02:06.129374 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-cdd37399-7857-4d11-9e16-5a7e8b60a5d7 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Image limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 21:02:06.129791 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-cdd37399-7857-4d11-9e16-5a7e8b60a5d7 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Flavor pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 21:02:06.130212 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-cdd37399-7857-4d11-9e16-5a7e8b60a5d7 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Image pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 21:02:06.130929 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-cdd37399-7857-4d11-9e16-5a7e8b60a5d7 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 21:02:06.147658 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cdd37399-7857-4d11-9e16-5a7e8b60a5d7 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:06.148714 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cdd37399-7857-4d11-9e16-5a7e8b60a5d7 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:06.149670 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cdd37399-7857-4d11-9e16-5a7e8b60a5d7 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:06.150129 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cdd37399-7857-4d11-9e16-5a7e8b60a5d7 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:06.176671 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-cdd37399-7857-4d11-9e16-5a7e8b60a5d7 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Getting quotas for project 356d7bd6c3e84b759875cc530b7d18c4. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:02:06.184383 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-cdd37399-7857-4d11-9e16-5a7e8b60a5d7 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Getting quotas for user 527f03c53ee54c99ba36a3b918c25597 and project 356d7bd6c3e84b759875cc530b7d18c4. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:02:06.194016 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c44b6c15-5164-4f66-878c-8d8990de1ec5 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:06.196269 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c44b6c15-5164-4f66-878c-8d8990de1ec5 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:06.203214 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-cdd37399-7857-4d11-9e16-5a7e8b60a5d7 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Going to run 1 instances... {{(pid=129365) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 21:02:06.205448 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c44b6c15-5164-4f66-878c-8d8990de1ec5 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:06.206454 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c44b6c15-5164-4f66-878c-8d8990de1ec5 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:06.206820 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-cdd37399-7857-4d11-9e16-5a7e8b60a5d7 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] [instance: 3777fc27-6875-48e2-86e1-e87fe7a9e56c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129365) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 21:02:06.208038 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c44b6c15-5164-4f66-878c-8d8990de1ec5 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:06.208718 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c44b6c15-5164-4f66-878c-8d8990de1ec5 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:06.258266 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c44b6c15-5164-4f66-878c-8d8990de1ec5 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 24546 microversion: 2.32 time: 0.068820 Jan 15 21:02:06.259914 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2120/4268] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:02:06 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 24546 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:02:06.277200 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-cdd37399-7857-4d11-9e16-5a7e8b60a5d7 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 0.841444 Jan 15 21:02:06.278491 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2149/4269] 10.222.0.46 () {62 vars in 1187 bytes} [Sat Jan 15 21:02:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 844 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jan 15 21:02:06.292273 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7c363eaa-5ccb-4e94-9ade-5c766fa57f8f tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:06.293889 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-7c363eaa-5ccb-4e94-9ade-5c766fa57f8f tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] [instance: 3777fc27-6875-48e2-86e1-e87fe7a9e56c] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:06.308137 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c2eb2fcf-0272-4c44-ae60-a9b9caf82e7a tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:06.309373 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c2eb2fcf-0272-4c44-ae60-a9b9caf82e7a tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:06.318562 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c2eb2fcf-0272-4c44-ae60-a9b9caf82e7a tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:06.319371 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c2eb2fcf-0272-4c44-ae60-a9b9caf82e7a tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:06.320412 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c2eb2fcf-0272-4c44-ae60-a9b9caf82e7a tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:06.321330 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c2eb2fcf-0272-4c44-ae60-a9b9caf82e7a tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:06.389476 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c2eb2fcf-0272-4c44-ae60-a9b9caf82e7a tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action" status: 200 len: 32628 microversion: 2.20 time: 0.085025 Jan 15 21:02:06.390887 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2150/4270] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:02:06 2022] POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action => generated 32628 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:02:06.396286 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-7c363eaa-5ccb-4e94-9ade-5c766fa57f8f tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527f03c53ee54c99ba36a3b918c25597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356d7bd6c3e84b759875cc530b7d18c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:06.397689 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f4683192-2a27-42b3-8579-5e1641d43f56 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:06.398559 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f4683192-2a27-42b3-8579-5e1641d43f56 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 11cbafd5-4836-48b9-8db6-440002deb281] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:06.404883 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-7c363eaa-5ccb-4e94-9ade-5c766fa57f8f tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527f03c53ee54c99ba36a3b918c25597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356d7bd6c3e84b759875cc530b7d18c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:06.406628 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-7c363eaa-5ccb-4e94-9ade-5c766fa57f8f tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527f03c53ee54c99ba36a3b918c25597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356d7bd6c3e84b759875cc530b7d18c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:06.408410 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7c363eaa-5ccb-4e94-9ade-5c766fa57f8f tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] 10.222.0.46 "GET /compute/v2.1/servers/3777fc27-6875-48e2-86e1-e87fe7a9e56c" status: 200 len: 1262 microversion: 2.26 time: 0.122163 Jan 15 21:02:06.408559 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f4683192-2a27-42b3-8579-5e1641d43f56 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:06.409235 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2121/4271] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:02:06 2022] GET /compute/v2.1/servers/3777fc27-6875-48e2-86e1-e87fe7a9e56c => generated 1262 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:02:06.421285 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f4683192-2a27-42b3-8579-5e1641d43f56 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:06.421285 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f4683192-2a27-42b3-8579-5e1641d43f56 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:06.421285 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f4683192-2a27-42b3-8579-5e1641d43f56 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:06.427556 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-55174d81-21f8-4dd7-a5e9-6e2322bbc90c tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:06.428605 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-55174d81-21f8-4dd7-a5e9-6e2322bbc90c tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:06.435402 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-55174d81-21f8-4dd7-a5e9-6e2322bbc90c tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:06.436755 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-55174d81-21f8-4dd7-a5e9-6e2322bbc90c tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:06.437801 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-55174d81-21f8-4dd7-a5e9-6e2322bbc90c tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:06.438473 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-55174d81-21f8-4dd7-a5e9-6e2322bbc90c tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:06.503398 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-55174d81-21f8-4dd7-a5e9-6e2322bbc90c tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action" status: 200 len: 32580 microversion: 2.1 time: 0.079721 Jan 15 21:02:06.504215 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2122/4272] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:02:06 2022] POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action => generated 32580 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:02:06.759074 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-74cb2c12-f43a-44a3-8f20-2042a2f0f038 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:06.761722 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-74cb2c12-f43a-44a3-8f20-2042a2f0f038 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:06.772809 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-74cb2c12-f43a-44a3-8f20-2042a2f0f038 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:06.773359 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-74cb2c12-f43a-44a3-8f20-2042a2f0f038 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:06.774242 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-74cb2c12-f43a-44a3-8f20-2042a2f0f038 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:06.774650 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-74cb2c12-f43a-44a3-8f20-2042a2f0f038 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:06.835036 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-f4683192-2a27-42b3-8579-5e1641d43f56 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:06.845022 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f4683192-2a27-42b3-8579-5e1641d43f56 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/11cbafd5-4836-48b9-8db6-440002deb281" status: 200 len: 1512 microversion: 2.1 time: 0.451146 Jan 15 21:02:06.846540 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2151/4273] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:02:06 2022] GET /compute/v2.1/servers/11cbafd5-4836-48b9-8db6-440002deb281 => generated 1512 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:02:06.862436 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-74cb2c12-f43a-44a3-8f20-2042a2f0f038 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.109610 Jan 15 21:02:06.863745 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2123/4274] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:02:06 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:02:07.277220 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-41609e8c-6574-428a-98a0-11482b94bdfc tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:07.279101 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-41609e8c-6574-428a-98a0-11482b94bdfc tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:07.307696 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-41609e8c-6574-428a-98a0-11482b94bdfc tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:07.308388 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-41609e8c-6574-428a-98a0-11482b94bdfc tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:07.309348 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-41609e8c-6574-428a-98a0-11482b94bdfc tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:07.309983 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-41609e8c-6574-428a-98a0-11482b94bdfc tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:07.393059 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-41609e8c-6574-428a-98a0-11482b94bdfc tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 24546 microversion: 2.32 time: 0.126212 Jan 15 21:02:07.399108 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2152/4275] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:02:07 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 24546 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:02:07.403966 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-3b3f7495-3909-4f8b-9444-d858ed897dc0 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:07.405532 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-3b3f7495-3909-4f8b-9444-d858ed897dc0 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:07.430810 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-45c63fe6-c0fa-4098-af3a-531fa547cb10 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:07.431714 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-45c63fe6-c0fa-4098-af3a-531fa547cb10 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] [instance: 3777fc27-6875-48e2-86e1-e87fe7a9e56c] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:07.433410 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3b3f7495-3909-4f8b-9444-d858ed897dc0 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:07.434317 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3b3f7495-3909-4f8b-9444-d858ed897dc0 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:07.437451 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3b3f7495-3909-4f8b-9444-d858ed897dc0 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:07.438029 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3b3f7495-3909-4f8b-9444-d858ed897dc0 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:07.441317 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-45c63fe6-c0fa-4098-af3a-531fa547cb10 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:07.442078 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-45c63fe6-c0fa-4098-af3a-531fa547cb10 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:07.443194 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-45c63fe6-c0fa-4098-af3a-531fa547cb10 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:07.444697 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-45c63fe6-c0fa-4098-af3a-531fa547cb10 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:07.527324 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-45c63fe6-c0fa-4098-af3a-531fa547cb10 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527f03c53ee54c99ba36a3b918c25597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356d7bd6c3e84b759875cc530b7d18c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:07.539121 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-45c63fe6-c0fa-4098-af3a-531fa547cb10 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527f03c53ee54c99ba36a3b918c25597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356d7bd6c3e84b759875cc530b7d18c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:07.541325 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-45c63fe6-c0fa-4098-af3a-531fa547cb10 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527f03c53ee54c99ba36a3b918c25597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356d7bd6c3e84b759875cc530b7d18c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:07.542778 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-45c63fe6-c0fa-4098-af3a-531fa547cb10 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] 10.222.0.46 "GET /compute/v2.1/servers/3777fc27-6875-48e2-86e1-e87fe7a9e56c" status: 200 len: 1322 microversion: 2.26 time: 0.117890 Jan 15 21:02:07.543530 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2153/4276] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:02:07 2022] GET /compute/v2.1/servers/3777fc27-6875-48e2-86e1-e87fe7a9e56c => generated 1322 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 15 21:02:07.552662 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a264f4ab-e57b-468d-9b07-9dd624ddcdce tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:07.556730 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a264f4ab-e57b-468d-9b07-9dd624ddcdce tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:07.556943 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-3b3f7495-3909-4f8b-9444-d858ed897dc0 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action" status: 200 len: 32628 microversion: 2.20 time: 0.156347 Jan 15 21:02:07.558630 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2124/4277] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:02:07 2022] POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action => generated 32628 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:02:07.572574 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a264f4ab-e57b-468d-9b07-9dd624ddcdce tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:07.573057 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a264f4ab-e57b-468d-9b07-9dd624ddcdce tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:07.573854 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a264f4ab-e57b-468d-9b07-9dd624ddcdce tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:07.574331 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a264f4ab-e57b-468d-9b07-9dd624ddcdce tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:07.635247 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a264f4ab-e57b-468d-9b07-9dd624ddcdce tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action" status: 200 len: 32580 microversion: 2.1 time: 0.089572 Jan 15 21:02:07.636358 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2154/4278] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:02:07 2022] POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action => generated 32580 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:02:07.863140 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-fca509f4-afa7-4503-916d-4ff893730e16 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:07.863834 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-fca509f4-afa7-4503-916d-4ff893730e16 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 11cbafd5-4836-48b9-8db6-440002deb281] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:07.872770 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fca509f4-afa7-4503-916d-4ff893730e16 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:07.873671 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fca509f4-afa7-4503-916d-4ff893730e16 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:07.875922 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fca509f4-afa7-4503-916d-4ff893730e16 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:07.877194 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fca509f4-afa7-4503-916d-4ff893730e16 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:07.877848 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-26102977-96d8-4a40-9c1f-ef18c4e9974b tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:07.879549 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-26102977-96d8-4a40-9c1f-ef18c4e9974b tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:07.893296 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-26102977-96d8-4a40-9c1f-ef18c4e9974b tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:07.894102 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-26102977-96d8-4a40-9c1f-ef18c4e9974b tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:07.895208 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-26102977-96d8-4a40-9c1f-ef18c4e9974b tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:07.895791 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-26102977-96d8-4a40-9c1f-ef18c4e9974b tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:07.952375 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-26102977-96d8-4a40-9c1f-ef18c4e9974b tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.081467 Jan 15 21:02:07.954027 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2155/4279] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:02:07 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:02:08.298249 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-fca509f4-afa7-4503-916d-4ff893730e16 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:08.307416 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-fca509f4-afa7-4503-916d-4ff893730e16 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/11cbafd5-4836-48b9-8db6-440002deb281" status: 200 len: 1512 microversion: 2.1 time: 0.448311 Jan 15 21:02:08.308000 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2125/4280] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:02:07 2022] GET /compute/v2.1/servers/11cbafd5-4836-48b9-8db6-440002deb281 => generated 1512 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:02:08.406087 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f6a18fe2-d2c9-4918-ab2e-03a512cbcf12 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:08.409269 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f6a18fe2-d2c9-4918-ab2e-03a512cbcf12 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:08.417940 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f6a18fe2-d2c9-4918-ab2e-03a512cbcf12 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:08.418709 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f6a18fe2-d2c9-4918-ab2e-03a512cbcf12 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:08.420312 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f6a18fe2-d2c9-4918-ab2e-03a512cbcf12 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:08.420967 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f6a18fe2-d2c9-4918-ab2e-03a512cbcf12 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:08.487533 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f6a18fe2-d2c9-4918-ab2e-03a512cbcf12 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 32575 microversion: 2.32 time: 0.086144 Jan 15 21:02:08.488197 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2156/4281] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:02:08 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 32575 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:02:08.564441 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-012562d8-6622-4f75-b163-02034590d306 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:08.565346 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-012562d8-6622-4f75-b163-02034590d306 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] [instance: 3777fc27-6875-48e2-86e1-e87fe7a9e56c] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:08.573673 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-012562d8-6622-4f75-b163-02034590d306 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:08.574572 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-012562d8-6622-4f75-b163-02034590d306 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:08.575005 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ace4ed56-47a9-4100-9e56-46ba32f436a9 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:08.575772 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-012562d8-6622-4f75-b163-02034590d306 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:08.576356 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-012562d8-6622-4f75-b163-02034590d306 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:08.576828 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ace4ed56-47a9-4100-9e56-46ba32f436a9 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:08.585946 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ace4ed56-47a9-4100-9e56-46ba32f436a9 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:08.586855 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ace4ed56-47a9-4100-9e56-46ba32f436a9 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:08.587805 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ace4ed56-47a9-4100-9e56-46ba32f436a9 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:08.588549 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ace4ed56-47a9-4100-9e56-46ba32f436a9 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:08.640046 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ace4ed56-47a9-4100-9e56-46ba32f436a9 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action" status: 200 len: 32628 microversion: 2.20 time: 0.069475 Jan 15 21:02:08.642286 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2157/4282] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:02:08 2022] POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action => generated 32628 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:02:08.648738 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ce4e2c06-b57d-4590-ad3b-c022c6c8fb15 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:08.650824 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ce4e2c06-b57d-4590-ad3b-c022c6c8fb15 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:08.659055 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ce4e2c06-b57d-4590-ad3b-c022c6c8fb15 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:08.659578 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ce4e2c06-b57d-4590-ad3b-c022c6c8fb15 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:08.660032 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-012562d8-6622-4f75-b163-02034590d306 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527f03c53ee54c99ba36a3b918c25597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356d7bd6c3e84b759875cc530b7d18c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:08.660415 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ce4e2c06-b57d-4590-ad3b-c022c6c8fb15 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:08.660885 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ce4e2c06-b57d-4590-ad3b-c022c6c8fb15 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:08.681557 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-012562d8-6622-4f75-b163-02034590d306 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527f03c53ee54c99ba36a3b918c25597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356d7bd6c3e84b759875cc530b7d18c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:08.684063 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-012562d8-6622-4f75-b163-02034590d306 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527f03c53ee54c99ba36a3b918c25597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356d7bd6c3e84b759875cc530b7d18c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:08.685801 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-012562d8-6622-4f75-b163-02034590d306 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] 10.222.0.46 "GET /compute/v2.1/servers/3777fc27-6875-48e2-86e1-e87fe7a9e56c" status: 200 len: 1320 microversion: 2.26 time: 0.125997 Jan 15 21:02:08.687888 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2126/4283] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:02:08 2022] GET /compute/v2.1/servers/3777fc27-6875-48e2-86e1-e87fe7a9e56c => generated 1320 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:02:08.712507 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ce4e2c06-b57d-4590-ad3b-c022c6c8fb15 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action" status: 200 len: 32580 microversion: 2.1 time: 0.068167 Jan 15 21:02:08.713234 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2158/4284] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:02:08 2022] POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action => generated 32580 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 21:02:08.968174 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-dea8a9d2-dc78-4de3-aa30-fdfac523124a tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:08.969764 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-dea8a9d2-dc78-4de3-aa30-fdfac523124a tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:08.999643 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dea8a9d2-dc78-4de3-aa30-fdfac523124a tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:09.000999 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dea8a9d2-dc78-4de3-aa30-fdfac523124a tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:09.002642 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dea8a9d2-dc78-4de3-aa30-fdfac523124a tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:09.003104 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dea8a9d2-dc78-4de3-aa30-fdfac523124a tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:09.057272 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-dea8a9d2-dc78-4de3-aa30-fdfac523124a tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.095936 Jan 15 21:02:09.058955 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2127/4285] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:02:08 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:02:09.326199 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3689a4de-31f5-4291-adec-66c3a6466c8b tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:09.327055 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-3689a4de-31f5-4291-adec-66c3a6466c8b tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 11cbafd5-4836-48b9-8db6-440002deb281] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:09.335626 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3689a4de-31f5-4291-adec-66c3a6466c8b tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:09.336252 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3689a4de-31f5-4291-adec-66c3a6466c8b tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:09.337237 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3689a4de-31f5-4291-adec-66c3a6466c8b tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:09.337778 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3689a4de-31f5-4291-adec-66c3a6466c8b tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:09.500615 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-15cbfa03-b5b0-481f-bcbe-57c9047c40da tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:09.502348 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-15cbfa03-b5b0-481f-bcbe-57c9047c40da tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:09.510644 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-15cbfa03-b5b0-481f-bcbe-57c9047c40da tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:09.511612 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-15cbfa03-b5b0-481f-bcbe-57c9047c40da tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:09.512527 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-15cbfa03-b5b0-481f-bcbe-57c9047c40da tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:09.513191 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-15cbfa03-b5b0-481f-bcbe-57c9047c40da tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:09.571405 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-15cbfa03-b5b0-481f-bcbe-57c9047c40da tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 32575 microversion: 2.32 time: 0.074913 Jan 15 21:02:09.575489 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2128/4286] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:02:09 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 32575 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:02:09.599106 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-3689a4de-31f5-4291-adec-66c3a6466c8b tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:09.609165 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3689a4de-31f5-4291-adec-66c3a6466c8b tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/11cbafd5-4836-48b9-8db6-440002deb281" status: 200 len: 1512 microversion: 2.1 time: 0.287644 Jan 15 21:02:09.620094 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2159/4287] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:02:09 2022] GET /compute/v2.1/servers/11cbafd5-4836-48b9-8db6-440002deb281 => generated 1512 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:02:09.655206 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f8bd4fd9-357a-4747-8f86-74f8f7d4f19c tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:09.656847 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f8bd4fd9-357a-4747-8f86-74f8f7d4f19c tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:09.668961 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f8bd4fd9-357a-4747-8f86-74f8f7d4f19c tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:09.670044 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f8bd4fd9-357a-4747-8f86-74f8f7d4f19c tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:09.671105 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f8bd4fd9-357a-4747-8f86-74f8f7d4f19c tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:09.671894 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f8bd4fd9-357a-4747-8f86-74f8f7d4f19c tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:09.711138 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-1ee3bd8f-57f4-4333-816f-d415f60889ea tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:09.714921 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-1ee3bd8f-57f4-4333-816f-d415f60889ea tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] [instance: 3777fc27-6875-48e2-86e1-e87fe7a9e56c] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:09.717691 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f8bd4fd9-357a-4747-8f86-74f8f7d4f19c tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action" status: 200 len: 32628 microversion: 2.20 time: 0.067195 Jan 15 21:02:09.723254 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2129/4288] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:02:09 2022] POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action => generated 32628 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:02:09.732200 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1de2ce67-1557-48d2-8af9-578055bd7db7 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:09.734022 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-1de2ce67-1557-48d2-8af9-578055bd7db7 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:09.736894 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1ee3bd8f-57f4-4333-816f-d415f60889ea tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:09.737790 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1ee3bd8f-57f4-4333-816f-d415f60889ea tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:09.738661 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1ee3bd8f-57f4-4333-816f-d415f60889ea tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:09.739101 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1ee3bd8f-57f4-4333-816f-d415f60889ea tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:09.745680 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1de2ce67-1557-48d2-8af9-578055bd7db7 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:09.746356 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1de2ce67-1557-48d2-8af9-578055bd7db7 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:09.747126 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1de2ce67-1557-48d2-8af9-578055bd7db7 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:09.748012 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1de2ce67-1557-48d2-8af9-578055bd7db7 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:09.805810 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-1de2ce67-1557-48d2-8af9-578055bd7db7 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action" status: 200 len: 32580 microversion: 2.1 time: 0.078207 Jan 15 21:02:09.807381 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2130/4289] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:02:09 2022] POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action => generated 32580 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:02:09.927479 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-1ee3bd8f-57f4-4333-816f-d415f60889ea tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527f03c53ee54c99ba36a3b918c25597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356d7bd6c3e84b759875cc530b7d18c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:09.936553 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-1ee3bd8f-57f4-4333-816f-d415f60889ea tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527f03c53ee54c99ba36a3b918c25597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356d7bd6c3e84b759875cc530b7d18c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:09.938420 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-1ee3bd8f-57f4-4333-816f-d415f60889ea tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527f03c53ee54c99ba36a3b918c25597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356d7bd6c3e84b759875cc530b7d18c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:09.940390 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-1ee3bd8f-57f4-4333-816f-d415f60889ea tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] 10.222.0.46 "GET /compute/v2.1/servers/3777fc27-6875-48e2-86e1-e87fe7a9e56c" status: 200 len: 1362 microversion: 2.26 time: 0.235763 Jan 15 21:02:09.941376 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2160/4290] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:02:09 2022] GET /compute/v2.1/servers/3777fc27-6875-48e2-86e1-e87fe7a9e56c => generated 1362 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:02:10.071108 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-265ed208-7820-41cb-9772-592a84ae2faa tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:10.072313 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-265ed208-7820-41cb-9772-592a84ae2faa tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:10.080745 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-265ed208-7820-41cb-9772-592a84ae2faa tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:10.081442 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-265ed208-7820-41cb-9772-592a84ae2faa tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:10.082268 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-265ed208-7820-41cb-9772-592a84ae2faa tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:10.082785 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-265ed208-7820-41cb-9772-592a84ae2faa tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:10.152545 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-265ed208-7820-41cb-9772-592a84ae2faa tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.084661 Jan 15 21:02:10.154193 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2131/4291] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:02:10 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:02:10.164535 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-baa34f54-a5c7-42c5-be96-16f27423289f req-5802c9e3-ab14-4787-9dbb-943ed8e1f1eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3777fc27-6875-48e2-86e1-e87fe7a9e56c", "tag": "5e114ab3-9fc7-4c3f-a6e3-d84796facc4f"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:10.166102 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:02:10.166102 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:02:10.174704 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-baa34f54-a5c7-42c5-be96-16f27423289f req-5802c9e3-ab14-4787-9dbb-943ed8e1f1eb service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:10.175482 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-baa34f54-a5c7-42c5-be96-16f27423289f req-5802c9e3-ab14-4787-9dbb-943ed8e1f1eb service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:10.187922 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-baa34f54-a5c7-42c5-be96-16f27423289f req-5802c9e3-ab14-4787-9dbb-943ed8e1f1eb service nova] Creating event network-changed:5e114ab3-9fc7-4c3f-a6e3-d84796facc4f for instance 3777fc27-6875-48e2-86e1-e87fe7a9e56c on nch2-master-1 Jan 15 21:02:10.193465 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-baa34f54-a5c7-42c5-be96-16f27423289f req-5802c9e3-ab14-4787-9dbb-943ed8e1f1eb service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033789 Jan 15 21:02:10.194315 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2161/4292] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:02:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:02:10.589061 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-5766f0fb-bfd0-44f2-8418-927c5588295f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:10.590658 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-5766f0fb-bfd0-44f2-8418-927c5588295f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:10.604119 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5766f0fb-bfd0-44f2-8418-927c5588295f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:10.605166 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5766f0fb-bfd0-44f2-8418-927c5588295f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:10.606837 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5766f0fb-bfd0-44f2-8418-927c5588295f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:10.607440 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5766f0fb-bfd0-44f2-8418-927c5588295f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:10.637024 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-28f7b32e-de55-4866-8b1a-789f47190d29 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:10.638218 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-28f7b32e-de55-4866-8b1a-789f47190d29 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 11cbafd5-4836-48b9-8db6-440002deb281] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:10.647444 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-28f7b32e-de55-4866-8b1a-789f47190d29 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:10.648383 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-28f7b32e-de55-4866-8b1a-789f47190d29 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:10.649540 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-28f7b32e-de55-4866-8b1a-789f47190d29 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:10.649977 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-28f7b32e-de55-4866-8b1a-789f47190d29 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:10.656763 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-5766f0fb-bfd0-44f2-8418-927c5588295f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 32575 microversion: 2.32 time: 0.074354 Jan 15 21:02:10.658493 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2132/4293] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:02:10 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 32575 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:02:10.730927 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-31f593ef-2025-446a-891d-362d1e3e7c07 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:10.734068 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-31f593ef-2025-446a-891d-362d1e3e7c07 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:10.749563 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-31f593ef-2025-446a-891d-362d1e3e7c07 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:10.750051 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-31f593ef-2025-446a-891d-362d1e3e7c07 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:10.751003 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-31f593ef-2025-446a-891d-362d1e3e7c07 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:10.752057 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-31f593ef-2025-446a-891d-362d1e3e7c07 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:10.827051 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-31f593ef-2025-446a-891d-362d1e3e7c07 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action" status: 200 len: 32628 microversion: 2.20 time: 0.100536 Jan 15 21:02:10.828446 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2133/4294] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:02:10 2022] POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action => generated 32628 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:02:10.835497 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-28f7b32e-de55-4866-8b1a-789f47190d29 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:10.836144 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-6dac08d9-5001-4179-b1b8-021d372805c5 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:10.837340 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-6dac08d9-5001-4179-b1b8-021d372805c5 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:10.845118 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-28f7b32e-de55-4866-8b1a-789f47190d29 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/11cbafd5-4836-48b9-8db6-440002deb281" status: 200 len: 1512 microversion: 2.1 time: 0.219392 Jan 15 21:02:10.846264 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6dac08d9-5001-4179-b1b8-021d372805c5 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:10.846429 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2162/4295] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:02:10 2022] GET /compute/v2.1/servers/11cbafd5-4836-48b9-8db6-440002deb281 => generated 1512 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:02:10.847143 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6dac08d9-5001-4179-b1b8-021d372805c5 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:10.847960 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6dac08d9-5001-4179-b1b8-021d372805c5 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:10.848402 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6dac08d9-5001-4179-b1b8-021d372805c5 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:10.901612 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-6dac08d9-5001-4179-b1b8-021d372805c5 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action" status: 200 len: 32580 microversion: 2.1 time: 0.070419 Jan 15 21:02:10.902922 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2134/4296] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:02:10 2022] POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action => generated 32580 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:02:10.962061 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-077c9aed-c828-4c6a-9abf-a8017f1fbcd0 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:10.962680 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-077c9aed-c828-4c6a-9abf-a8017f1fbcd0 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] [instance: 3777fc27-6875-48e2-86e1-e87fe7a9e56c] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:10.969158 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-077c9aed-c828-4c6a-9abf-a8017f1fbcd0 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:10.969606 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-077c9aed-c828-4c6a-9abf-a8017f1fbcd0 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:10.970921 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-077c9aed-c828-4c6a-9abf-a8017f1fbcd0 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:10.971639 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-077c9aed-c828-4c6a-9abf-a8017f1fbcd0 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:11.123008 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-077c9aed-c828-4c6a-9abf-a8017f1fbcd0 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527f03c53ee54c99ba36a3b918c25597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356d7bd6c3e84b759875cc530b7d18c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:11.131752 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-077c9aed-c828-4c6a-9abf-a8017f1fbcd0 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527f03c53ee54c99ba36a3b918c25597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356d7bd6c3e84b759875cc530b7d18c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:11.133748 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-077c9aed-c828-4c6a-9abf-a8017f1fbcd0 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527f03c53ee54c99ba36a3b918c25597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356d7bd6c3e84b759875cc530b7d18c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:11.134891 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-077c9aed-c828-4c6a-9abf-a8017f1fbcd0 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] 10.222.0.46 "GET /compute/v2.1/servers/3777fc27-6875-48e2-86e1-e87fe7a9e56c" status: 200 len: 1362 microversion: 2.26 time: 0.179052 Jan 15 21:02:11.135614 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2163/4297] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:02:10 2022] GET /compute/v2.1/servers/3777fc27-6875-48e2-86e1-e87fe7a9e56c => generated 1362 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:02:11.167091 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ddf23040-ea64-4f07-af02-6a1b40921d82 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:11.168255 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ddf23040-ea64-4f07-af02-6a1b40921d82 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:11.178703 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ddf23040-ea64-4f07-af02-6a1b40921d82 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:11.179344 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ddf23040-ea64-4f07-af02-6a1b40921d82 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:11.180393 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ddf23040-ea64-4f07-af02-6a1b40921d82 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:11.181070 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ddf23040-ea64-4f07-af02-6a1b40921d82 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:11.244128 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ddf23040-ea64-4f07-af02-6a1b40921d82 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.081130 Jan 15 21:02:11.245478 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2135/4298] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:02:11 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:02:11.670631 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-24c9b5b1-9458-476e-809b-a7d1ace6f35d tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:11.672328 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-24c9b5b1-9458-476e-809b-a7d1ace6f35d tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:11.680294 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-24c9b5b1-9458-476e-809b-a7d1ace6f35d tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:11.680781 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-24c9b5b1-9458-476e-809b-a7d1ace6f35d tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:11.681889 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-24c9b5b1-9458-476e-809b-a7d1ace6f35d tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:11.682460 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-24c9b5b1-9458-476e-809b-a7d1ace6f35d tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:11.732061 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-24c9b5b1-9458-476e-809b-a7d1ace6f35d tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 32575 microversion: 2.32 time: 0.065912 Jan 15 21:02:11.733454 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2164/4299] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:02:11 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 32575 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:02:11.841912 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9524d980-90a2-45b1-968e-1ce436878985 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:11.843129 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-9524d980-90a2-45b1-968e-1ce436878985 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:11.852360 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9524d980-90a2-45b1-968e-1ce436878985 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:11.853154 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9524d980-90a2-45b1-968e-1ce436878985 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:11.854098 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9524d980-90a2-45b1-968e-1ce436878985 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:11.854547 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9524d980-90a2-45b1-968e-1ce436878985 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:11.870497 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9655e0fc-4ddd-48b0-a668-b2bb96e0bb12 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:11.872947 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-9655e0fc-4ddd-48b0-a668-b2bb96e0bb12 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 11cbafd5-4836-48b9-8db6-440002deb281] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:11.881817 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9655e0fc-4ddd-48b0-a668-b2bb96e0bb12 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:11.884223 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9655e0fc-4ddd-48b0-a668-b2bb96e0bb12 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:11.885460 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9655e0fc-4ddd-48b0-a668-b2bb96e0bb12 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:11.886119 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9655e0fc-4ddd-48b0-a668-b2bb96e0bb12 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:11.910804 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-9524d980-90a2-45b1-968e-1ce436878985 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action" status: 200 len: 32628 microversion: 2.20 time: 0.074043 Jan 15 21:02:11.913086 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2136/4300] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:02:11 2022] POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action => generated 32628 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:02:11.919909 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-007c8ca5-6a18-43d5-99fa-2d2fdf5f4767 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:11.921532 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-007c8ca5-6a18-43d5-99fa-2d2fdf5f4767 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:11.944926 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-007c8ca5-6a18-43d5-99fa-2d2fdf5f4767 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:11.946349 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-007c8ca5-6a18-43d5-99fa-2d2fdf5f4767 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:11.947662 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-007c8ca5-6a18-43d5-99fa-2d2fdf5f4767 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:11.948331 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-007c8ca5-6a18-43d5-99fa-2d2fdf5f4767 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:12.006437 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-007c8ca5-6a18-43d5-99fa-2d2fdf5f4767 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action" status: 200 len: 32580 microversion: 2.1 time: 0.090817 Jan 15 21:02:12.008531 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2137/4301] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:02:11 2022] POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action => generated 32580 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:02:12.160470 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b3314915-caad-4bfa-adfc-ec7dea7ef2c3 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:12.162436 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b3314915-caad-4bfa-adfc-ec7dea7ef2c3 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] [instance: 3777fc27-6875-48e2-86e1-e87fe7a9e56c] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:12.170801 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b3314915-caad-4bfa-adfc-ec7dea7ef2c3 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:12.171980 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b3314915-caad-4bfa-adfc-ec7dea7ef2c3 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:12.173877 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b3314915-caad-4bfa-adfc-ec7dea7ef2c3 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:12.174643 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b3314915-caad-4bfa-adfc-ec7dea7ef2c3 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:12.246987 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-9655e0fc-4ddd-48b0-a668-b2bb96e0bb12 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:12.256105 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-9655e0fc-4ddd-48b0-a668-b2bb96e0bb12 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/11cbafd5-4836-48b9-8db6-440002deb281" status: 200 len: 1512 microversion: 2.1 time: 0.398236 Jan 15 21:02:12.257161 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2165/4302] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:02:11 2022] GET /compute/v2.1/servers/11cbafd5-4836-48b9-8db6-440002deb281 => generated 1512 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:02:12.261869 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f27f50da-976e-4a33-9b9b-a3de345a8837 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:12.263689 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f27f50da-976e-4a33-9b9b-a3de345a8837 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:12.273037 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f27f50da-976e-4a33-9b9b-a3de345a8837 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:12.273673 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f27f50da-976e-4a33-9b9b-a3de345a8837 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:12.275029 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f27f50da-976e-4a33-9b9b-a3de345a8837 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:12.275567 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f27f50da-976e-4a33-9b9b-a3de345a8837 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:12.329565 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f27f50da-976e-4a33-9b9b-a3de345a8837 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.070269 Jan 15 21:02:12.334852 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2166/4303] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:02:12 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:02:12.430097 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-b3314915-caad-4bfa-adfc-ec7dea7ef2c3 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527f03c53ee54c99ba36a3b918c25597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356d7bd6c3e84b759875cc530b7d18c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:12.452209 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-b3314915-caad-4bfa-adfc-ec7dea7ef2c3 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527f03c53ee54c99ba36a3b918c25597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356d7bd6c3e84b759875cc530b7d18c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:12.456921 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-b3314915-caad-4bfa-adfc-ec7dea7ef2c3 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527f03c53ee54c99ba36a3b918c25597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356d7bd6c3e84b759875cc530b7d18c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:12.458668 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b3314915-caad-4bfa-adfc-ec7dea7ef2c3 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] 10.222.0.46 "GET /compute/v2.1/servers/3777fc27-6875-48e2-86e1-e87fe7a9e56c" status: 200 len: 1362 microversion: 2.26 time: 0.305942 Jan 15 21:02:12.460230 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2138/4304] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:02:12 2022] GET /compute/v2.1/servers/3777fc27-6875-48e2-86e1-e87fe7a9e56c => generated 1362 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:02:12.747700 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2700c057-fde9-42ec-a547-23c2fa67688b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:12.749539 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-2700c057-fde9-42ec-a547-23c2fa67688b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:12.759093 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2700c057-fde9-42ec-a547-23c2fa67688b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:12.760000 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2700c057-fde9-42ec-a547-23c2fa67688b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:12.762526 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2700c057-fde9-42ec-a547-23c2fa67688b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:12.763213 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2700c057-fde9-42ec-a547-23c2fa67688b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:12.818138 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2700c057-fde9-42ec-a547-23c2fa67688b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 32575 microversion: 2.32 time: 0.075684 Jan 15 21:02:12.823992 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2167/4305] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:02:12 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 32575 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:02:12.924754 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a5173499-66d2-41b0-8f6a-7562e44c5dcc tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:12.926544 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a5173499-66d2-41b0-8f6a-7562e44c5dcc tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:12.940521 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a5173499-66d2-41b0-8f6a-7562e44c5dcc tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:12.941650 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a5173499-66d2-41b0-8f6a-7562e44c5dcc tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:12.942750 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a5173499-66d2-41b0-8f6a-7562e44c5dcc tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:12.943839 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a5173499-66d2-41b0-8f6a-7562e44c5dcc tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:13.000280 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a5173499-66d2-41b0-8f6a-7562e44c5dcc tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action" status: 200 len: 32628 microversion: 2.20 time: 0.079934 Jan 15 21:02:13.005925 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2139/4306] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:02:12 2022] POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action => generated 32628 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:02:13.021625 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f1a7a0db-ff16-4294-9358-466ccc9f346f tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:13.022995 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f1a7a0db-ff16-4294-9358-466ccc9f346f tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:13.041135 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f1a7a0db-ff16-4294-9358-466ccc9f346f tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:13.042000 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f1a7a0db-ff16-4294-9358-466ccc9f346f tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:13.043265 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f1a7a0db-ff16-4294-9358-466ccc9f346f tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:13.044455 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f1a7a0db-ff16-4294-9358-466ccc9f346f tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:13.104382 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f1a7a0db-ff16-4294-9358-466ccc9f346f tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action" status: 200 len: 32580 microversion: 2.1 time: 0.088809 Jan 15 21:02:13.105487 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2168/4307] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:02:13 2022] POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action => generated 32580 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:02:13.286680 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8e41c38a-cdc5-48ce-b0cf-067b45c5811e tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:13.297470 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-8e41c38a-cdc5-48ce-b0cf-067b45c5811e tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 11cbafd5-4836-48b9-8db6-440002deb281] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:13.310717 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8e41c38a-cdc5-48ce-b0cf-067b45c5811e tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:13.311710 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8e41c38a-cdc5-48ce-b0cf-067b45c5811e tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:13.312872 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8e41c38a-cdc5-48ce-b0cf-067b45c5811e tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:13.317327 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8e41c38a-cdc5-48ce-b0cf-067b45c5811e tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:13.347043 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8d0d09d2-4aeb-4e62-8e9a-66330598408c tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:13.348264 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-8d0d09d2-4aeb-4e62-8e9a-66330598408c tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:13.388337 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8d0d09d2-4aeb-4e62-8e9a-66330598408c tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:13.389062 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8d0d09d2-4aeb-4e62-8e9a-66330598408c tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:13.389965 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8d0d09d2-4aeb-4e62-8e9a-66330598408c tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:13.390628 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8d0d09d2-4aeb-4e62-8e9a-66330598408c tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:13.477829 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-8d0d09d2-4aeb-4e62-8e9a-66330598408c tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.136769 Jan 15 21:02:13.480950 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2169/4308] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:02:13 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:02:13.492540 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5ae5f22b-ce78-4aec-8bd2-b7e95030fefc tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:13.493806 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-5ae5f22b-ce78-4aec-8bd2-b7e95030fefc tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] [instance: 3777fc27-6875-48e2-86e1-e87fe7a9e56c] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:13.500825 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5ae5f22b-ce78-4aec-8bd2-b7e95030fefc tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:13.501610 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5ae5f22b-ce78-4aec-8bd2-b7e95030fefc tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:13.502893 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5ae5f22b-ce78-4aec-8bd2-b7e95030fefc tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:13.504172 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5ae5f22b-ce78-4aec-8bd2-b7e95030fefc tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:13.616476 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-8e41c38a-cdc5-48ce-b0cf-067b45c5811e tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:13.651268 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-8e41c38a-cdc5-48ce-b0cf-067b45c5811e tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/11cbafd5-4836-48b9-8db6-440002deb281" status: 200 len: 1512 microversion: 2.1 time: 0.372962 Jan 15 21:02:13.653968 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2140/4309] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:02:13 2022] GET /compute/v2.1/servers/11cbafd5-4836-48b9-8db6-440002deb281 => generated 1512 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:02:13.710164 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-5ae5f22b-ce78-4aec-8bd2-b7e95030fefc tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527f03c53ee54c99ba36a3b918c25597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356d7bd6c3e84b759875cc530b7d18c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:13.720511 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-5ae5f22b-ce78-4aec-8bd2-b7e95030fefc tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527f03c53ee54c99ba36a3b918c25597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356d7bd6c3e84b759875cc530b7d18c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:13.722655 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-5ae5f22b-ce78-4aec-8bd2-b7e95030fefc tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527f03c53ee54c99ba36a3b918c25597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356d7bd6c3e84b759875cc530b7d18c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:13.724914 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5ae5f22b-ce78-4aec-8bd2-b7e95030fefc tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] 10.222.0.46 "GET /compute/v2.1/servers/3777fc27-6875-48e2-86e1-e87fe7a9e56c" status: 200 len: 1362 microversion: 2.26 time: 0.241505 Jan 15 21:02:13.725846 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2170/4310] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:02:13 2022] GET /compute/v2.1/servers/3777fc27-6875-48e2-86e1-e87fe7a9e56c => generated 1362 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:02:13.837477 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-84ed7894-82f4-48d7-a09e-09751f6ec15e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:13.837957 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-84ed7894-82f4-48d7-a09e-09751f6ec15e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:13.845323 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-84ed7894-82f4-48d7-a09e-09751f6ec15e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:13.846233 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-84ed7894-82f4-48d7-a09e-09751f6ec15e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:13.847222 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-84ed7894-82f4-48d7-a09e-09751f6ec15e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:13.847727 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-84ed7894-82f4-48d7-a09e-09751f6ec15e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:13.914311 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-84ed7894-82f4-48d7-a09e-09751f6ec15e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.082726 Jan 15 21:02:13.918584 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2141/4311] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:02:13 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:02:14.013143 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2ff4aed7-22a1-442e-8dcb-1dcfb9d57bb4 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:14.014072 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-2ff4aed7-22a1-442e-8dcb-1dcfb9d57bb4 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:14.021679 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2ff4aed7-22a1-442e-8dcb-1dcfb9d57bb4 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:14.022128 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2ff4aed7-22a1-442e-8dcb-1dcfb9d57bb4 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:14.022933 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2ff4aed7-22a1-442e-8dcb-1dcfb9d57bb4 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:14.023366 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2ff4aed7-22a1-442e-8dcb-1dcfb9d57bb4 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:14.069731 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2ff4aed7-22a1-442e-8dcb-1dcfb9d57bb4 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action" status: 200 len: 32628 microversion: 2.20 time: 0.060071 Jan 15 21:02:14.070550 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2171/4312] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:02:14 2022] POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action => generated 32628 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:02:14.125584 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-91af206f-ac9d-41f4-87d2-a110c1bb951b tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:14.128088 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-91af206f-ac9d-41f4-87d2-a110c1bb951b tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:14.136353 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-91af206f-ac9d-41f4-87d2-a110c1bb951b tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:14.137248 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-91af206f-ac9d-41f4-87d2-a110c1bb951b tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:14.138045 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-91af206f-ac9d-41f4-87d2-a110c1bb951b tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:14.138498 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-91af206f-ac9d-41f4-87d2-a110c1bb951b tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:14.188209 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-91af206f-ac9d-41f4-87d2-a110c1bb951b tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action" status: 200 len: 32580 microversion: 2.1 time: 0.067094 Jan 15 21:02:14.193283 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2142/4313] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:02:14 2022] POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action => generated 32580 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:02:14.495755 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-51e4ae5d-3561-4c5c-8db2-13f0a1587e7b tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:14.497340 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-51e4ae5d-3561-4c5c-8db2-13f0a1587e7b tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:14.525612 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-51e4ae5d-3561-4c5c-8db2-13f0a1587e7b tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:14.526200 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-51e4ae5d-3561-4c5c-8db2-13f0a1587e7b tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:14.527387 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-51e4ae5d-3561-4c5c-8db2-13f0a1587e7b tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:14.527827 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-51e4ae5d-3561-4c5c-8db2-13f0a1587e7b tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:14.588239 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-51e4ae5d-3561-4c5c-8db2-13f0a1587e7b tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.097896 Jan 15 21:02:14.589738 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2172/4314] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:02:14 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:02:14.673220 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ba556aec-3cae-4f53-a826-b0c51e5177da tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:14.674303 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ba556aec-3cae-4f53-a826-b0c51e5177da tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 11cbafd5-4836-48b9-8db6-440002deb281] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:14.697855 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ba556aec-3cae-4f53-a826-b0c51e5177da tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:14.699467 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ba556aec-3cae-4f53-a826-b0c51e5177da tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:14.700591 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ba556aec-3cae-4f53-a826-b0c51e5177da tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:14.701803 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ba556aec-3cae-4f53-a826-b0c51e5177da tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:14.753190 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b186bac5-52b2-4754-9871-65719df87a83 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:14.759125 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b186bac5-52b2-4754-9871-65719df87a83 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] [instance: 3777fc27-6875-48e2-86e1-e87fe7a9e56c] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:14.791790 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b186bac5-52b2-4754-9871-65719df87a83 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:14.796048 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b186bac5-52b2-4754-9871-65719df87a83 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:14.807640 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b186bac5-52b2-4754-9871-65719df87a83 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:14.808348 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b186bac5-52b2-4754-9871-65719df87a83 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:14.930855 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-ba556aec-3cae-4f53-a826-b0c51e5177da tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:14.980345 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ba556aec-3cae-4f53-a826-b0c51e5177da tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/11cbafd5-4836-48b9-8db6-440002deb281" status: 200 len: 1512 microversion: 2.1 time: 0.312902 Jan 15 21:02:14.982016 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2143/4315] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:02:14 2022] GET /compute/v2.1/servers/11cbafd5-4836-48b9-8db6-440002deb281 => generated 1512 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:02:14.988997 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-689facd5-201a-4ad6-9226-064daa1db80b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:14.989812 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-689facd5-201a-4ad6-9226-064daa1db80b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:14.999239 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-689facd5-201a-4ad6-9226-064daa1db80b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:14.999723 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-689facd5-201a-4ad6-9226-064daa1db80b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:15.000534 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-689facd5-201a-4ad6-9226-064daa1db80b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:15.005273 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-689facd5-201a-4ad6-9226-064daa1db80b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:15.067812 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-689facd5-201a-4ad6-9226-064daa1db80b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.084470 Jan 15 21:02:15.069134 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2144/4316] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:02:14 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:02:15.087926 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-5e7b04f6-4a76-4621-88c0-689200225cd3 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:15.090269 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-5e7b04f6-4a76-4621-88c0-689200225cd3 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:15.124237 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5e7b04f6-4a76-4621-88c0-689200225cd3 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:15.128051 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5e7b04f6-4a76-4621-88c0-689200225cd3 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:15.130711 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5e7b04f6-4a76-4621-88c0-689200225cd3 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:15.134679 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5e7b04f6-4a76-4621-88c0-689200225cd3 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:15.271516 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-5e7b04f6-4a76-4621-88c0-689200225cd3 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action" status: 200 len: 40781 microversion: 2.20 time: 0.192683 Jan 15 21:02:15.287550 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2145/4317] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:02:15 2022] POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action => generated 40781 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:02:15.310686 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-6521ad5a-68c0-40c7-b60a-ed47d34b3f6c tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:15.311703 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-6521ad5a-68c0-40c7-b60a-ed47d34b3f6c tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:15.333184 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6521ad5a-68c0-40c7-b60a-ed47d34b3f6c tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:15.334073 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6521ad5a-68c0-40c7-b60a-ed47d34b3f6c tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:15.335201 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6521ad5a-68c0-40c7-b60a-ed47d34b3f6c tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:15.336510 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6521ad5a-68c0-40c7-b60a-ed47d34b3f6c tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:15.371473 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-b186bac5-52b2-4754-9871-65719df87a83 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527f03c53ee54c99ba36a3b918c25597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356d7bd6c3e84b759875cc530b7d18c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:15.412471 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-b186bac5-52b2-4754-9871-65719df87a83 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527f03c53ee54c99ba36a3b918c25597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356d7bd6c3e84b759875cc530b7d18c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:15.427225 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-b186bac5-52b2-4754-9871-65719df87a83 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527f03c53ee54c99ba36a3b918c25597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356d7bd6c3e84b759875cc530b7d18c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:15.433120 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b186bac5-52b2-4754-9871-65719df87a83 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] 10.222.0.46 "GET /compute/v2.1/servers/3777fc27-6875-48e2-86e1-e87fe7a9e56c" status: 200 len: 1362 microversion: 2.26 time: 0.691913 Jan 15 21:02:15.434409 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2173/4318] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:02:14 2022] GET /compute/v2.1/servers/3777fc27-6875-48e2-86e1-e87fe7a9e56c => generated 1362 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:02:15.451067 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-6521ad5a-68c0-40c7-b60a-ed47d34b3f6c tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action" status: 200 len: 32580 microversion: 2.1 time: 0.160239 Jan 15 21:02:15.452177 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2146/4319] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:02:15 2022] POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action => generated 32580 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:02:15.459615 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-078d145f-525e-4388-871c-b597df797d0e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:15.464994 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-078d145f-525e-4388-871c-b597df797d0e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:15.485905 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-078d145f-525e-4388-871c-b597df797d0e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:15.489048 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-078d145f-525e-4388-871c-b597df797d0e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:15.490129 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-078d145f-525e-4388-871c-b597df797d0e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:15.492642 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-078d145f-525e-4388-871c-b597df797d0e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:15.553884 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-078d145f-525e-4388-871c-b597df797d0e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/ips" status: 200 len: 151 microversion: 2.20 time: 0.118171 Jan 15 21:02:15.556784 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2174/4320] 10.222.0.46 () {60 vars in 1288 bytes} [Sat Jan 15 21:02:15 2022] GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/ips => generated 151 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:02:15.602746 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d7982713-3045-40d2-bcab-87ab816936a4 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:15.603702 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d7982713-3045-40d2-bcab-87ab816936a4 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:15.622446 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d7982713-3045-40d2-bcab-87ab816936a4 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:15.622913 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d7982713-3045-40d2-bcab-87ab816936a4 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:15.623729 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d7982713-3045-40d2-bcab-87ab816936a4 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:15.624166 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d7982713-3045-40d2-bcab-87ab816936a4 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:15.722565 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d7982713-3045-40d2-bcab-87ab816936a4 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.123374 Jan 15 21:02:15.729776 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2175/4321] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:02:15 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:02:15.771257 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-6f1a897b-9c65-4fb2-a8ff-5d41b2021a28 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-1874938312", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bf43669e-491e-49cf-8622-cd5d76591729"}]}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:15.865139 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.network.neutron [None req-6f1a897b-9c65-4fb2-a8ff-5d41b2021a28 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] validate_networks() for [('bf43669e-491e-49cf-8622-cd5d76591729', None, None, None, None, None)] {{(pid=129366) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 21:02:16.001971 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-89ab9d82-ee4e-4086-90ee-f371e68c17b5 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:16.004109 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-89ab9d82-ee4e-4086-90ee-f371e68c17b5 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 11cbafd5-4836-48b9-8db6-440002deb281] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:16.026365 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-89ab9d82-ee4e-4086-90ee-f371e68c17b5 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:16.027349 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-89ab9d82-ee4e-4086-90ee-f371e68c17b5 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:16.028986 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-89ab9d82-ee4e-4086-90ee-f371e68c17b5 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:16.031627 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-89ab9d82-ee4e-4086-90ee-f371e68c17b5 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:16.571360 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-89ab9d82-ee4e-4086-90ee-f371e68c17b5 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:16.581968 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-89ab9d82-ee4e-4086-90ee-f371e68c17b5 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/11cbafd5-4836-48b9-8db6-440002deb281" status: 200 len: 1489 microversion: 2.1 time: 0.586444 Jan 15 21:02:16.585547 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2176/4322] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:02:15 2022] GET /compute/v2.1/servers/11cbafd5-4836-48b9-8db6-440002deb281 => generated 1489 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:02:16.596386 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f2b74846-847e-47fa-ae9f-76487b60bc4e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:16.599011 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f2b74846-847e-47fa-ae9f-76487b60bc4e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:16.614061 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f2b74846-847e-47fa-ae9f-76487b60bc4e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:16.615280 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f2b74846-847e-47fa-ae9f-76487b60bc4e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:16.624428 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f2b74846-847e-47fa-ae9f-76487b60bc4e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:16.625263 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f2b74846-847e-47fa-ae9f-76487b60bc4e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:16.696056 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f2b74846-847e-47fa-ae9f-76487b60bc4e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.108300 Jan 15 21:02:16.696643 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2177/4323] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:02:16 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:02:16.702712 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-10a0c6a6-ee6e-43e7-84c8-8cb8e39159cb tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:16.703426 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-10a0c6a6-ee6e-43e7-84c8-8cb8e39159cb tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] [instance: 3777fc27-6875-48e2-86e1-e87fe7a9e56c] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:16.712988 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-10a0c6a6-ee6e-43e7-84c8-8cb8e39159cb tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:16.713657 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-10a0c6a6-ee6e-43e7-84c8-8cb8e39159cb tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:16.714657 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-10a0c6a6-ee6e-43e7-84c8-8cb8e39159cb tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:16.714912 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-6f1a897b-9c65-4fb2-a8ff-5d41b2021a28 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Flavor limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 21:02:16.715452 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-6f1a897b-9c65-4fb2-a8ff-5d41b2021a28 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Image limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 21:02:16.716081 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-10a0c6a6-ee6e-43e7-84c8-8cb8e39159cb tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:16.716930 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-6f1a897b-9c65-4fb2-a8ff-5d41b2021a28 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Flavor pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 21:02:16.718117 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-6f1a897b-9c65-4fb2-a8ff-5d41b2021a28 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Image pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 21:02:16.718777 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-6f1a897b-9c65-4fb2-a8ff-5d41b2021a28 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 21:02:16.744781 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6f1a897b-9c65-4fb2-a8ff-5d41b2021a28 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:16.748887 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6f1a897b-9c65-4fb2-a8ff-5d41b2021a28 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:16.749801 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6f1a897b-9c65-4fb2-a8ff-5d41b2021a28 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:16.753613 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6f1a897b-9c65-4fb2-a8ff-5d41b2021a28 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:16.786901 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-6f1a897b-9c65-4fb2-a8ff-5d41b2021a28 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Getting quotas for project 74165fadf5154c319ca56b4aa961e7b6. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:02:16.798074 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-6f1a897b-9c65-4fb2-a8ff-5d41b2021a28 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Getting quotas for user 8e8f253bac41484ab8e92b74bfa54465 and project 74165fadf5154c319ca56b4aa961e7b6. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:02:16.821716 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-6f1a897b-9c65-4fb2-a8ff-5d41b2021a28 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Going to run 1 instances... {{(pid=129366) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 21:02:16.840799 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-6f1a897b-9c65-4fb2-a8ff-5d41b2021a28 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] [instance: 26f27adc-8567-4752-8a51-ee9c301b2611] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 21:02:16.929794 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-6f1a897b-9c65-4fb2-a8ff-5d41b2021a28 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.414047 Jan 15 21:02:16.941738 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2147/4324] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 21:02:15 2022] POST /compute/v2.1/servers => generated 383 bytes in 1427 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 21:02:16.955140 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ecc4d657-8332-476d-a633-3d195c548873 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:16.957388 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ecc4d657-8332-476d-a633-3d195c548873 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:16.976376 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ecc4d657-8332-476d-a633-3d195c548873 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:16.977747 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-10a0c6a6-ee6e-43e7-84c8-8cb8e39159cb tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527f03c53ee54c99ba36a3b918c25597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356d7bd6c3e84b759875cc530b7d18c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:16.978862 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ecc4d657-8332-476d-a633-3d195c548873 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:16.979547 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ecc4d657-8332-476d-a633-3d195c548873 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:16.980012 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ecc4d657-8332-476d-a633-3d195c548873 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:16.988297 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-10a0c6a6-ee6e-43e7-84c8-8cb8e39159cb tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527f03c53ee54c99ba36a3b918c25597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356d7bd6c3e84b759875cc530b7d18c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:16.990968 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-10a0c6a6-ee6e-43e7-84c8-8cb8e39159cb tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527f03c53ee54c99ba36a3b918c25597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356d7bd6c3e84b759875cc530b7d18c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:16.992505 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-10a0c6a6-ee6e-43e7-84c8-8cb8e39159cb tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] 10.222.0.46 "GET /compute/v2.1/servers/3777fc27-6875-48e2-86e1-e87fe7a9e56c" status: 200 len: 1362 microversion: 2.26 time: 0.294381 Jan 15 21:02:16.994141 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2178/4325] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:02:16 2022] GET /compute/v2.1/servers/3777fc27-6875-48e2-86e1-e87fe7a9e56c => generated 1362 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:02:16.999558 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-47bc3e8a-86df-4357-b5d4-c69069b03bd5 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:17.000923 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-47bc3e8a-86df-4357-b5d4-c69069b03bd5 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:17.009375 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-47bc3e8a-86df-4357-b5d4-c69069b03bd5 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:17.010278 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-47bc3e8a-86df-4357-b5d4-c69069b03bd5 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:17.011460 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-47bc3e8a-86df-4357-b5d4-c69069b03bd5 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:17.012581 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-47bc3e8a-86df-4357-b5d4-c69069b03bd5 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:17.072165 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-47bc3e8a-86df-4357-b5d4-c69069b03bd5 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action" status: 200 len: 121 microversion: 2.1 time: 0.076066 Jan 15 21:02:17.076911 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2179/4326] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:02:16 2022] POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action => generated 121 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:02:17.077415 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ecc4d657-8332-476d-a633-3d195c548873 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action" status: 200 len: 32580 microversion: 2.1 time: 0.133522 Jan 15 21:02:17.077504 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2148/4327] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:02:16 2022] POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action => generated 32580 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:02:17.084070 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-858e8cb5-534b-46ce-ac84-d759b677e969 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:17.087538 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ca6842bf-6448-4839-96cd-b5400a905aa3 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:17.088428 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-858e8cb5-534b-46ce-ac84-d759b677e969 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] [instance: 26f27adc-8567-4752-8a51-ee9c301b2611] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:17.093195 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ca6842bf-6448-4839-96cd-b5400a905aa3 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:17.123658 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ca6842bf-6448-4839-96cd-b5400a905aa3 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:17.126578 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ca6842bf-6448-4839-96cd-b5400a905aa3 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:17.128072 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ca6842bf-6448-4839-96cd-b5400a905aa3 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:17.128700 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ca6842bf-6448-4839-96cd-b5400a905aa3 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:17.208021 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-858e8cb5-534b-46ce-ac84-d759b677e969 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e8f253bac41484ab8e92b74bfa54465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74165fadf5154c319ca56b4aa961e7b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:17.218333 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-858e8cb5-534b-46ce-ac84-d759b677e969 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] 10.222.0.46 "GET /compute/v2.1/servers/26f27adc-8567-4752-8a51-ee9c301b2611" status: 200 len: 1223 microversion: 2.1 time: 0.139228 Jan 15 21:02:17.232244 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2180/4328] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:02:17 2022] GET /compute/v2.1/servers/26f27adc-8567-4752-8a51-ee9c301b2611 => generated 1223 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:02:17.256554 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ca6842bf-6448-4839-96cd-b5400a905aa3 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.176260 Jan 15 21:02:17.257700 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3131c268-93a6-474e-a3f9-83b5a493dd56 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:17.258328 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-3131c268-93a6-474e-a3f9-83b5a493dd56 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:17.258442 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2149/4329] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:02:17 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:02:17.276418 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3131c268-93a6-474e-a3f9-83b5a493dd56 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:17.276887 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3131c268-93a6-474e-a3f9-83b5a493dd56 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:17.277677 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3131c268-93a6-474e-a3f9-83b5a493dd56 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:17.278197 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3131c268-93a6-474e-a3f9-83b5a493dd56 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:17.335362 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-2fcb25c3-bc39-4293-ab7b-45d1d69ff553 req-e43bdb61-d064-42e0-a220-3e2dc7a2989f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3777fc27-6875-48e2-86e1-e87fe7a9e56c", "name": "network-vif-plugged", "status": "completed", "tag": "5e114ab3-9fc7-4c3f-a6e3-d84796facc4f"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:17.339975 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:02:17.339975 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:02:17.384579 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-2fcb25c3-bc39-4293-ab7b-45d1d69ff553 req-e43bdb61-d064-42e0-a220-3e2dc7a2989f service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:17.385031 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-2fcb25c3-bc39-4293-ab7b-45d1d69ff553 req-e43bdb61-d064-42e0-a220-3e2dc7a2989f service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:17.414931 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-2fcb25c3-bc39-4293-ab7b-45d1d69ff553 req-e43bdb61-d064-42e0-a220-3e2dc7a2989f service nova] Creating event network-vif-plugged:5e114ab3-9fc7-4c3f-a6e3-d84796facc4f for instance 3777fc27-6875-48e2-86e1-e87fe7a9e56c on nch2-master-1 Jan 15 21:02:17.421834 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-2fcb25c3-bc39-4293-ab7b-45d1d69ff553 req-e43bdb61-d064-42e0-a220-3e2dc7a2989f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096407 Jan 15 21:02:17.423800 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2150/4330] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:02:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:02:17.653331 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-3131c268-93a6-474e-a3f9-83b5a493dd56 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:17.664513 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3131c268-93a6-474e-a3f9-83b5a493dd56 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9" status: 200 len: 1670 microversion: 2.1 time: 0.431097 Jan 15 21:02:17.665162 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2181/4331] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:02:17 2022] GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9 => generated 1670 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:02:17.688929 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-23e53b8a-d534-4c7d-bcc4-969560839003 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:17.689712 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-23e53b8a-d534-4c7d-bcc4-969560839003 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:17.701393 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-23e53b8a-d534-4c7d-bcc4-969560839003 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:17.701904 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-23e53b8a-d534-4c7d-bcc4-969560839003 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:17.709413 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ed06769d-152e-4adb-acfb-8757c715c66b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:17.712289 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-23e53b8a-d534-4c7d-bcc4-969560839003 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:17.713319 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ed06769d-152e-4adb-acfb-8757c715c66b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:17.714024 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-23e53b8a-d534-4c7d-bcc4-969560839003 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:17.728089 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ed06769d-152e-4adb-acfb-8757c715c66b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:17.729004 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ed06769d-152e-4adb-acfb-8757c715c66b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:17.736253 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ed06769d-152e-4adb-acfb-8757c715c66b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:17.738790 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ed06769d-152e-4adb-acfb-8757c715c66b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:17.836457 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ed06769d-152e-4adb-acfb-8757c715c66b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.131219 Jan 15 21:02:17.838504 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2182/4332] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:02:17 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:02:17.952695 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-23e53b8a-d534-4c7d-bcc4-969560839003 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:17.964401 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-23e53b8a-d534-4c7d-bcc4-969560839003 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9" status: 200 len: 1670 microversion: 2.1 time: 0.280606 Jan 15 21:02:17.966471 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2151/4333] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:02:17 2022] GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9 => generated 1670 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:02:18.015485 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-55b60d14-e821-4654-831b-8117a53f0c9d tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:18.017420 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-55b60d14-e821-4654-831b-8117a53f0c9d tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] [instance: 3777fc27-6875-48e2-86e1-e87fe7a9e56c] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:18.035299 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-55b60d14-e821-4654-831b-8117a53f0c9d tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:18.035740 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-55b60d14-e821-4654-831b-8117a53f0c9d tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:18.042223 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-55b60d14-e821-4654-831b-8117a53f0c9d tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:18.049144 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-55b60d14-e821-4654-831b-8117a53f0c9d tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:18.094177 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-5816d1cb-f2da-49e0-a230-8fe10eab8b66 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:18.098228 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-5816d1cb-f2da-49e0-a230-8fe10eab8b66 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:18.128806 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5816d1cb-f2da-49e0-a230-8fe10eab8b66 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:18.131151 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5816d1cb-f2da-49e0-a230-8fe10eab8b66 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:18.137166 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5816d1cb-f2da-49e0-a230-8fe10eab8b66 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:18.138540 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5816d1cb-f2da-49e0-a230-8fe10eab8b66 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:18.242372 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-5816d1cb-f2da-49e0-a230-8fe10eab8b66 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action" status: 200 len: 32580 microversion: 2.1 time: 0.155906 Jan 15 21:02:18.243711 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2152/4334] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:02:18 2022] POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action => generated 32580 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:02:18.260376 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c5dbdebb-09aa-4334-a82f-52e758a8d356 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:18.261269 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c5dbdebb-09aa-4334-a82f-52e758a8d356 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:18.276373 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c5dbdebb-09aa-4334-a82f-52e758a8d356 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:18.277174 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c5dbdebb-09aa-4334-a82f-52e758a8d356 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:18.278874 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c5dbdebb-09aa-4334-a82f-52e758a8d356 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:18.279507 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c5dbdebb-09aa-4334-a82f-52e758a8d356 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:18.340288 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.objects.instance [None req-c5dbdebb-09aa-4334-a82f-52e758a8d356 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lazy-loading 'flavor' on Instance uuid 0ac722a3-aadf-4791-b5b1-e5e5efebddc0 {{(pid=129366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 21:02:18.539783 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-55b60d14-e821-4654-831b-8117a53f0c9d tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527f03c53ee54c99ba36a3b918c25597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356d7bd6c3e84b759875cc530b7d18c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:18.564563 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-55b60d14-e821-4654-831b-8117a53f0c9d tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527f03c53ee54c99ba36a3b918c25597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356d7bd6c3e84b759875cc530b7d18c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:18.569601 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-55b60d14-e821-4654-831b-8117a53f0c9d tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527f03c53ee54c99ba36a3b918c25597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356d7bd6c3e84b759875cc530b7d18c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:18.571957 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-55b60d14-e821-4654-831b-8117a53f0c9d tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] 10.222.0.46 "GET /compute/v2.1/servers/3777fc27-6875-48e2-86e1-e87fe7a9e56c" status: 200 len: 1362 microversion: 2.26 time: 0.561263 Jan 15 21:02:18.575076 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2183/4335] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:02:18 2022] GET /compute/v2.1/servers/3777fc27-6875-48e2-86e1-e87fe7a9e56c => generated 1362 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:02:18.580820 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-adc9c5e1-27be-4252-93f0-a7ec95eb3046 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:18.582006 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-adc9c5e1-27be-4252-93f0-a7ec95eb3046 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] [instance: 26f27adc-8567-4752-8a51-ee9c301b2611] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:18.601075 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-adc9c5e1-27be-4252-93f0-a7ec95eb3046 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:18.601969 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-adc9c5e1-27be-4252-93f0-a7ec95eb3046 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:18.603171 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-adc9c5e1-27be-4252-93f0-a7ec95eb3046 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:18.604784 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-adc9c5e1-27be-4252-93f0-a7ec95eb3046 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:18.758503 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-adc9c5e1-27be-4252-93f0-a7ec95eb3046 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e8f253bac41484ab8e92b74bfa54465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74165fadf5154c319ca56b4aa961e7b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:18.778688 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-adc9c5e1-27be-4252-93f0-a7ec95eb3046 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] 10.222.0.46 "GET /compute/v2.1/servers/26f27adc-8567-4752-8a51-ee9c301b2611" status: 200 len: 1275 microversion: 2.1 time: 0.200901 Jan 15 21:02:18.780741 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2184/4336] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:02:18 2022] GET /compute/v2.1/servers/26f27adc-8567-4752-8a51-ee9c301b2611 => generated 1275 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:02:18.780741 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-371ce1dc-6a6d-41fb-af32-c1eecfe2b3dc tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:18.780741 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-371ce1dc-6a6d-41fb-af32-c1eecfe2b3dc tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:18.804434 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-371ce1dc-6a6d-41fb-af32-c1eecfe2b3dc tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:18.805265 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-371ce1dc-6a6d-41fb-af32-c1eecfe2b3dc tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:18.806376 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-371ce1dc-6a6d-41fb-af32-c1eecfe2b3dc tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:18.807054 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-371ce1dc-6a6d-41fb-af32-c1eecfe2b3dc tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:18.910749 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c5dbdebb-09aa-4334-a82f-52e758a8d356 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action" status: 202 len: 0 microversion: 2.20 time: 0.664616 Jan 15 21:02:18.917929 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2153/4337] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:02:18 2022] POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action => generated 0 bytes in 672 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 15 21:02:18.926170 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-6dbe8a72-903e-4324-89be-b7d75f2585d4 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2089408849", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "networks": [{"uuid": "694fb227-829a-493b-b1b7-2dc4e238e05e"}]}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:19.021792 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-371ce1dc-6a6d-41fb-af32-c1eecfe2b3dc tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.236485 Jan 15 21:02:19.024361 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2185/4338] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:02:18 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:02:19.040189 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3d780ca1-92c6-4061-b728-54d38c8fe60b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:19.054567 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-3d780ca1-92c6-4061-b728-54d38c8fe60b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:19.072827 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.network.neutron [None req-6dbe8a72-903e-4324-89be-b7d75f2585d4 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] validate_networks() for [('694fb227-829a-493b-b1b7-2dc4e238e05e', None, None, None, None, None)] {{(pid=129366) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 21:02:19.084567 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3d780ca1-92c6-4061-b728-54d38c8fe60b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:19.086335 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3d780ca1-92c6-4061-b728-54d38c8fe60b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:19.088238 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3d780ca1-92c6-4061-b728-54d38c8fe60b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:19.089341 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3d780ca1-92c6-4061-b728-54d38c8fe60b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:19.159253 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3d780ca1-92c6-4061-b728-54d38c8fe60b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.130636 Jan 15 21:02:19.162963 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2186/4339] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:02:19 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:02:19.171646 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5eea509d-801a-4000-a314-5ad26b6aeb69 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:19.174802 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-5eea509d-801a-4000-a314-5ad26b6aeb69 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:19.187643 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5eea509d-801a-4000-a314-5ad26b6aeb69 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:19.188927 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5eea509d-801a-4000-a314-5ad26b6aeb69 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:19.190607 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5eea509d-801a-4000-a314-5ad26b6aeb69 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:19.191715 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5eea509d-801a-4000-a314-5ad26b6aeb69 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:19.522593 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-5eea509d-801a-4000-a314-5ad26b6aeb69 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:19.536254 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-5eea509d-801a-4000-a314-5ad26b6aeb69 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:19.538908 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-5eea509d-801a-4000-a314-5ad26b6aeb69 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:19.540508 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5eea509d-801a-4000-a314-5ad26b6aeb69 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0" status: 200 len: 1721 microversion: 2.20 time: 0.374617 Jan 15 21:02:19.552683 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2187/4340] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:02:19 2022] GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0 => generated 1721 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:02:19.552683 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b5ae73a3-3dd3-47c8-a986-116efe47382e tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:19.552683 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b5ae73a3-3dd3-47c8-a986-116efe47382e tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:19.567424 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b5ae73a3-3dd3-47c8-a986-116efe47382e tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:19.567897 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b5ae73a3-3dd3-47c8-a986-116efe47382e tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:19.569791 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b5ae73a3-3dd3-47c8-a986-116efe47382e tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:19.570519 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b5ae73a3-3dd3-47c8-a986-116efe47382e tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:19.641785 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b5ae73a3-3dd3-47c8-a986-116efe47382e tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action" status: 200 len: 32580 microversion: 2.1 time: 0.096947 Jan 15 21:02:19.642816 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2188/4341] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:02:19 2022] POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action => generated 32580 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:02:19.660408 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-36ef1b6a-61c5-437b-b468-5fc126070209 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:19.661034 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-36ef1b6a-61c5-437b-b468-5fc126070209 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] [instance: 3777fc27-6875-48e2-86e1-e87fe7a9e56c] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:19.673395 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-36ef1b6a-61c5-437b-b468-5fc126070209 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:19.685667 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-36ef1b6a-61c5-437b-b468-5fc126070209 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:19.686690 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-36ef1b6a-61c5-437b-b468-5fc126070209 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:19.687237 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-36ef1b6a-61c5-437b-b468-5fc126070209 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:20.219021 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-36ef1b6a-61c5-437b-b468-5fc126070209 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527f03c53ee54c99ba36a3b918c25597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356d7bd6c3e84b759875cc530b7d18c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:20.234132 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-36ef1b6a-61c5-437b-b468-5fc126070209 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527f03c53ee54c99ba36a3b918c25597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356d7bd6c3e84b759875cc530b7d18c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:20.251046 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-36ef1b6a-61c5-437b-b468-5fc126070209 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527f03c53ee54c99ba36a3b918c25597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356d7bd6c3e84b759875cc530b7d18c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:20.252616 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-36ef1b6a-61c5-437b-b468-5fc126070209 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] 10.222.0.46 "GET /compute/v2.1/servers/3777fc27-6875-48e2-86e1-e87fe7a9e56c" status: 200 len: 1545 microversion: 2.26 time: 0.607404 Jan 15 21:02:20.253488 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2189/4342] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:02:19 2022] GET /compute/v2.1/servers/3777fc27-6875-48e2-86e1-e87fe7a9e56c => generated 1545 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:02:20.258181 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d27920fb-d738-4bd5-b9a7-e75310651628 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:20.259015 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d27920fb-d738-4bd5-b9a7-e75310651628 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] [instance: 26f27adc-8567-4752-8a51-ee9c301b2611] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:20.274377 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d27920fb-d738-4bd5-b9a7-e75310651628 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:20.275224 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d27920fb-d738-4bd5-b9a7-e75310651628 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:20.276199 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d27920fb-d738-4bd5-b9a7-e75310651628 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:20.276811 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d27920fb-d738-4bd5-b9a7-e75310651628 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:20.373598 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-6dbe8a72-903e-4324-89be-b7d75f2585d4 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Flavor limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 21:02:20.374443 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-6dbe8a72-903e-4324-89be-b7d75f2585d4 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Image limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 21:02:20.374776 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-6dbe8a72-903e-4324-89be-b7d75f2585d4 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Flavor pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 21:02:20.375197 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-6dbe8a72-903e-4324-89be-b7d75f2585d4 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Image pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 21:02:20.375890 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-6dbe8a72-903e-4324-89be-b7d75f2585d4 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 21:02:20.406359 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6dbe8a72-903e-4324-89be-b7d75f2585d4 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:20.411370 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6dbe8a72-903e-4324-89be-b7d75f2585d4 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:20.413827 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6dbe8a72-903e-4324-89be-b7d75f2585d4 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:20.414455 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6dbe8a72-903e-4324-89be-b7d75f2585d4 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:20.467672 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-6dbe8a72-903e-4324-89be-b7d75f2585d4 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Getting quotas for project e3a611cade394cb288f103fcf516e4ab. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:02:20.486815 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-6dbe8a72-903e-4324-89be-b7d75f2585d4 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Getting quotas for user 7f1ee75d18ae4db8825653f6e8180b72 and project e3a611cade394cb288f103fcf516e4ab. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:02:20.520033 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-6dbe8a72-903e-4324-89be-b7d75f2585d4 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Going to run 1 instances... {{(pid=129366) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 21:02:20.523610 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-6dbe8a72-903e-4324-89be-b7d75f2585d4 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: d09ef93d-246f-464d-8c9c-f5a6fa14e4fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 21:02:20.602527 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-6dbe8a72-903e-4324-89be-b7d75f2585d4 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.683122 Jan 15 21:02:20.604389 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2154/4343] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 21:02:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1686 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 21:02:20.609853 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-fb597621-bbb5-44d6-a6a2-838c52d77843 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:20.611309 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-fb597621-bbb5-44d6-a6a2-838c52d77843 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:20.635935 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fb597621-bbb5-44d6-a6a2-838c52d77843 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:20.639086 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fb597621-bbb5-44d6-a6a2-838c52d77843 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:20.639806 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fb597621-bbb5-44d6-a6a2-838c52d77843 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:20.640396 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fb597621-bbb5-44d6-a6a2-838c52d77843 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:20.717615 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-fb597621-bbb5-44d6-a6a2-838c52d77843 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.111419 Jan 15 21:02:20.723728 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2155/4344] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:02:20 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:02:20.730336 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4e346d1b-b410-479a-bf55-ea67f94121fb tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:20.732190 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-4e346d1b-b410-479a-bf55-ea67f94121fb tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:20.741242 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4e346d1b-b410-479a-bf55-ea67f94121fb tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:20.742050 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4e346d1b-b410-479a-bf55-ea67f94121fb tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:20.744055 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4e346d1b-b410-479a-bf55-ea67f94121fb tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:20.744893 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4e346d1b-b410-479a-bf55-ea67f94121fb tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:20.819697 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-4e346d1b-b410-479a-bf55-ea67f94121fb tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.094101 Jan 15 21:02:20.820431 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2156/4345] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:02:20 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:02:20.833032 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-946f07e9-5a18-457c-8a08-54bcc2c44c2d tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Calling method '.version_select at 0x7f30c86370d0>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:20.838737 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-d27920fb-d738-4bd5-b9a7-e75310651628 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e8f253bac41484ab8e92b74bfa54465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74165fadf5154c319ca56b4aa961e7b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:20.845941 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-946f07e9-5a18-457c-8a08-54bcc2c44c2d tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:20.846401 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-946f07e9-5a18-457c-8a08-54bcc2c44c2d tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:20.846992 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-946f07e9-5a18-457c-8a08-54bcc2c44c2d tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] [instance: 3777fc27-6875-48e2-86e1-e87fe7a9e56c] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:20.850404 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d27920fb-d738-4bd5-b9a7-e75310651628 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] 10.222.0.46 "GET /compute/v2.1/servers/26f27adc-8567-4752-8a51-ee9c301b2611" status: 200 len: 1323 microversion: 2.1 time: 0.595747 Jan 15 21:02:20.851053 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2190/4346] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:02:20 2022] GET /compute/v2.1/servers/26f27adc-8567-4752-8a51-ee9c301b2611 => generated 1323 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:02:20.862727 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-08ac7bf3-b8da-4785-a7d4-4033369e0ee1 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:20.864022 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-08ac7bf3-b8da-4785-a7d4-4033369e0ee1 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:20.874725 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-08ac7bf3-b8da-4785-a7d4-4033369e0ee1 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:20.875187 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-08ac7bf3-b8da-4785-a7d4-4033369e0ee1 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:20.876142 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-08ac7bf3-b8da-4785-a7d4-4033369e0ee1 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:20.876721 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-08ac7bf3-b8da-4785-a7d4-4033369e0ee1 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:20.887546 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-946f07e9-5a18-457c-8a08-54bcc2c44c2d tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:20.894933 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-946f07e9-5a18-457c-8a08-54bcc2c44c2d tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:20.896532 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-946f07e9-5a18-457c-8a08-54bcc2c44c2d tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:20.897158 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-946f07e9-5a18-457c-8a08-54bcc2c44c2d tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:20.984751 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-946f07e9-5a18-457c-8a08-54bcc2c44c2d tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:20.985913 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-946f07e9-5a18-457c-8a08-54bcc2c44c2d tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:21.024753 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-946f07e9-5a18-457c-8a08-54bcc2c44c2d tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:21.025280 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-946f07e9-5a18-457c-8a08-54bcc2c44c2d tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:21.117613 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.objects.instance [None req-946f07e9-5a18-457c-8a08-54bcc2c44c2d tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lazy-loading 'flavor' on Instance uuid 3777fc27-6875-48e2-86e1-e87fe7a9e56c {{(pid=129366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 21:02:21.142012 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-946f07e9-5a18-457c-8a08-54bcc2c44c2d tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] 10.222.0.46 "PUT /compute/v2.1/servers/3777fc27-6875-48e2-86e1-e87fe7a9e56c/tags/tempest-tag-573853866" status: 201 len: 0 microversion: 2.26 time: 0.319980 Jan 15 21:02:21.152436 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2157/4347] 10.222.0.46 () {62 vars in 1376 bytes} [Sat Jan 15 21:02:20 2022] PUT /compute/v2.1/servers/3777fc27-6875-48e2-86e1-e87fe7a9e56c/tags/tempest-tag-573853866 => generated 0 bytes in 331 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Jan 15 21:02:21.162842 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-db093c33-ceba-4166-b649-6dcc45f5a350 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:21.164633 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-db093c33-ceba-4166-b649-6dcc45f5a350 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: d09ef93d-246f-464d-8c9c-f5a6fa14e4fe] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:21.324758 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-db093c33-ceba-4166-b649-6dcc45f5a350 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:21.334463 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-db093c33-ceba-4166-b649-6dcc45f5a350 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/d09ef93d-246f-464d-8c9c-f5a6fa14e4fe" status: 200 len: 1215 microversion: 2.1 time: 0.179529 Jan 15 21:02:21.335480 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2158/4348] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:02:21 2022] GET /compute/v2.1/servers/d09ef93d-246f-464d-8c9c-f5a6fa14e4fe => generated 1215 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:02:21.341611 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-2c10bf62-6b2f-44c8-8fd7-08af5b7473c9 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:21.342575 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-2c10bf62-6b2f-44c8-8fd7-08af5b7473c9 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:21.383724 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2c10bf62-6b2f-44c8-8fd7-08af5b7473c9 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:21.385545 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2c10bf62-6b2f-44c8-8fd7-08af5b7473c9 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:21.386868 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2c10bf62-6b2f-44c8-8fd7-08af5b7473c9 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:21.387589 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2c10bf62-6b2f-44c8-8fd7-08af5b7473c9 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:21.467021 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-08ac7bf3-b8da-4785-a7d4-4033369e0ee1 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:21.484106 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-2c10bf62-6b2f-44c8-8fd7-08af5b7473c9 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action" status: 200 len: 32580 microversion: 2.1 time: 0.147334 Jan 15 21:02:21.492421 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-08ac7bf3-b8da-4785-a7d4-4033369e0ee1 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:21.494941 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2159/4349] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:02:21 2022] POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action => generated 32580 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:02:21.496936 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-08ac7bf3-b8da-4785-a7d4-4033369e0ee1 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:21.498343 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-08ac7bf3-b8da-4785-a7d4-4033369e0ee1 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0" status: 200 len: 1721 microversion: 2.20 time: 0.646274 Jan 15 21:02:21.527643 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2191/4350] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:02:20 2022] GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0 => generated 1721 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:02:21.529483 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-20f0d8e2-b741-44ec-b5fc-6aeeabeafa53 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Calling method '.version_select at 0x7f30c85e2ca0>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:21.559130 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-20f0d8e2-b741-44ec-b5fc-6aeeabeafa53 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:21.559839 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-20f0d8e2-b741-44ec-b5fc-6aeeabeafa53 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:21.605585 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-20f0d8e2-b741-44ec-b5fc-6aeeabeafa53 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] 10.222.0.46 "GET /compute/v2.1/servers/3777fc27-6875-48e2-86e1-e87fe7a9e56c/tags/tempest-tag-573853866" status: 204 len: 0 microversion: 2.26 time: 0.108871 Jan 15 21:02:21.606319 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2160/4351] 10.222.0.46 () {60 vars in 1357 bytes} [Sat Jan 15 21:02:21 2022] GET /compute/v2.1/servers/3777fc27-6875-48e2-86e1-e87fe7a9e56c/tags/tempest-tag-573853866 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 15 21:02:21.617686 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5d884d00-1ac1-4821-9c6e-2bb7f64890e7 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Calling method '.version_select at 0x7f30c85f7160>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:21.633646 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5d884d00-1ac1-4821-9c6e-2bb7f64890e7 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:21.634101 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5d884d00-1ac1-4821-9c6e-2bb7f64890e7 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:21.635843 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-5d884d00-1ac1-4821-9c6e-2bb7f64890e7 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] [instance: 3777fc27-6875-48e2-86e1-e87fe7a9e56c] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:21.644252 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5d884d00-1ac1-4821-9c6e-2bb7f64890e7 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:21.645098 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5d884d00-1ac1-4821-9c6e-2bb7f64890e7 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:21.646748 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5d884d00-1ac1-4821-9c6e-2bb7f64890e7 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:21.647394 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5d884d00-1ac1-4821-9c6e-2bb7f64890e7 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:21.694277 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5d884d00-1ac1-4821-9c6e-2bb7f64890e7 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:21.694725 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5d884d00-1ac1-4821-9c6e-2bb7f64890e7 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:21.733126 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-30f36ea5-1568-4148-9dc8-bdf87bd4f490 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:21.734752 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-30f36ea5-1568-4148-9dc8-bdf87bd4f490 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:21.742074 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-30f36ea5-1568-4148-9dc8-bdf87bd4f490 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:21.742805 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-30f36ea5-1568-4148-9dc8-bdf87bd4f490 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:21.744350 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-30f36ea5-1568-4148-9dc8-bdf87bd4f490 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:21.745184 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-30f36ea5-1568-4148-9dc8-bdf87bd4f490 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:21.755296 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.objects.instance [None req-5d884d00-1ac1-4821-9c6e-2bb7f64890e7 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lazy-loading 'flavor' on Instance uuid 3777fc27-6875-48e2-86e1-e87fe7a9e56c {{(pid=129365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 21:02:21.800635 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5d884d00-1ac1-4821-9c6e-2bb7f64890e7 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] 10.222.0.46 "DELETE /compute/v2.1/servers/3777fc27-6875-48e2-86e1-e87fe7a9e56c/tags" status: 204 len: 0 microversion: 2.26 time: 0.189221 Jan 15 21:02:21.803160 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2192/4352] 10.222.0.46 () {60 vars in 1294 bytes} [Sat Jan 15 21:02:21 2022] DELETE /compute/v2.1/servers/3777fc27-6875-48e2-86e1-e87fe7a9e56c/tags => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 15 21:02:21.820609 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-368ef5d3-298c-401a-9c4b-bc2f01b695c7 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Calling method '.version_select at 0x7f30c853a040>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:21.840641 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-30f36ea5-1568-4148-9dc8-bdf87bd4f490 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.112663 Jan 15 21:02:21.842668 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2161/4353] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:02:21 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:02:21.844243 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-368ef5d3-298c-401a-9c4b-bc2f01b695c7 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:21.847059 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-368ef5d3-298c-401a-9c4b-bc2f01b695c7 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:21.849179 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0361277b-754e-4780-a1f1-1effa6835342 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:21.850214 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-0361277b-754e-4780-a1f1-1effa6835342 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:21.870393 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0361277b-754e-4780-a1f1-1effa6835342 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:21.870393 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0361277b-754e-4780-a1f1-1effa6835342 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:21.870735 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0361277b-754e-4780-a1f1-1effa6835342 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:21.870961 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0361277b-754e-4780-a1f1-1effa6835342 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:21.878394 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-368ef5d3-298c-401a-9c4b-bc2f01b695c7 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] 10.222.0.46 "GET /compute/v2.1/servers/3777fc27-6875-48e2-86e1-e87fe7a9e56c/tags" status: 200 len: 12 microversion: 2.26 time: 0.067493 Jan 15 21:02:21.879748 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2193/4354] 10.222.0.46 () {60 vars in 1291 bytes} [Sat Jan 15 21:02:21 2022] GET /compute/v2.1/servers/3777fc27-6875-48e2-86e1-e87fe7a9e56c/tags => generated 12 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:02:21.892176 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9c6d171b-2ecc-4a73-98b2-84bae94d8be6 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:21.893256 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-9c6d171b-2ecc-4a73-98b2-84bae94d8be6 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] [instance: 26f27adc-8567-4752-8a51-ee9c301b2611] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:21.905124 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9c6d171b-2ecc-4a73-98b2-84bae94d8be6 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:21.909201 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9c6d171b-2ecc-4a73-98b2-84bae94d8be6 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:21.911655 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9c6d171b-2ecc-4a73-98b2-84bae94d8be6 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:21.915165 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9c6d171b-2ecc-4a73-98b2-84bae94d8be6 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:21.944904 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0361277b-754e-4780-a1f1-1effa6835342 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.100201 Jan 15 21:02:21.945705 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2162/4355] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:02:21 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:02:21.953432 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-00d08ed3-8eb0-46e6-b766-2dad433bd27e tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Calling method '.version_select at 0x7f30c85e2af0>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:21.975073 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-00d08ed3-8eb0-46e6-b766-2dad433bd27e tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:21.976350 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-00d08ed3-8eb0-46e6-b766-2dad433bd27e tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:21.977196 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-00d08ed3-8eb0-46e6-b766-2dad433bd27e tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] [instance: 3777fc27-6875-48e2-86e1-e87fe7a9e56c] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:21.985928 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-00d08ed3-8eb0-46e6-b766-2dad433bd27e tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:21.986467 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-00d08ed3-8eb0-46e6-b766-2dad433bd27e tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:21.987473 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-00d08ed3-8eb0-46e6-b766-2dad433bd27e tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:21.988969 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-00d08ed3-8eb0-46e6-b766-2dad433bd27e tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:22.016774 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-00d08ed3-8eb0-46e6-b766-2dad433bd27e tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:22.017462 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-00d08ed3-8eb0-46e6-b766-2dad433bd27e tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:22.029041 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-00d08ed3-8eb0-46e6-b766-2dad433bd27e tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:22.029677 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-00d08ed3-8eb0-46e6-b766-2dad433bd27e tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:22.072483 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.objects.instance [None req-00d08ed3-8eb0-46e6-b766-2dad433bd27e tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lazy-loading 'flavor' on Instance uuid 3777fc27-6875-48e2-86e1-e87fe7a9e56c {{(pid=129366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 21:02:22.099150 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-00d08ed3-8eb0-46e6-b766-2dad433bd27e tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] 10.222.0.46 "PUT /compute/v2.1/servers/3777fc27-6875-48e2-86e1-e87fe7a9e56c/tags/tempest-tag-516365846" status: 201 len: 0 microversion: 2.26 time: 0.151352 Jan 15 21:02:22.105259 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2163/4356] 10.222.0.46 () {62 vars in 1376 bytes} [Sat Jan 15 21:02:21 2022] PUT /compute/v2.1/servers/3777fc27-6875-48e2-86e1-e87fe7a9e56c/tags/tempest-tag-516365846 => generated 0 bytes in 159 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Jan 15 21:02:22.111178 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9c8fac90-7355-4a07-b01c-f6b53b90ec64 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Calling method '.version_select at 0x7f30c85e24c0>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:22.122220 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9c8fac90-7355-4a07-b01c-f6b53b90ec64 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:22.123638 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9c8fac90-7355-4a07-b01c-f6b53b90ec64 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:22.140939 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-9c8fac90-7355-4a07-b01c-f6b53b90ec64 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] 10.222.0.46 "GET /compute/v2.1/servers/3777fc27-6875-48e2-86e1-e87fe7a9e56c/tags" status: 200 len: 35 microversion: 2.26 time: 0.034072 Jan 15 21:02:22.147543 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2164/4357] 10.222.0.46 () {60 vars in 1291 bytes} [Sat Jan 15 21:02:22 2022] GET /compute/v2.1/servers/3777fc27-6875-48e2-86e1-e87fe7a9e56c/tags => generated 35 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:02:22.153098 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-5c95d68a-1e1f-4eac-b062-14c4c7778e77 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Calling method '.version_select at 0x7f30c868cca0>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:22.165857 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5c95d68a-1e1f-4eac-b062-14c4c7778e77 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:22.166313 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5c95d68a-1e1f-4eac-b062-14c4c7778e77 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:22.166992 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-5c95d68a-1e1f-4eac-b062-14c4c7778e77 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] [instance: 3777fc27-6875-48e2-86e1-e87fe7a9e56c] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:22.174617 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5c95d68a-1e1f-4eac-b062-14c4c7778e77 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:22.175388 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5c95d68a-1e1f-4eac-b062-14c4c7778e77 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:22.175979 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5c95d68a-1e1f-4eac-b062-14c4c7778e77 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:22.176416 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5c95d68a-1e1f-4eac-b062-14c4c7778e77 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:22.227198 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5c95d68a-1e1f-4eac-b062-14c4c7778e77 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:22.227682 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5c95d68a-1e1f-4eac-b062-14c4c7778e77 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:22.267747 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.objects.instance [None req-5c95d68a-1e1f-4eac-b062-14c4c7778e77 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lazy-loading 'flavor' on Instance uuid 3777fc27-6875-48e2-86e1-e87fe7a9e56c {{(pid=129366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 21:02:22.287255 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-5c95d68a-1e1f-4eac-b062-14c4c7778e77 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] 10.222.0.46 "DELETE /compute/v2.1/servers/3777fc27-6875-48e2-86e1-e87fe7a9e56c/tags/tempest-tag-516365846" status: 204 len: 0 microversion: 2.26 time: 0.138517 Jan 15 21:02:22.291160 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2165/4358] 10.222.0.46 () {60 vars in 1360 bytes} [Sat Jan 15 21:02:22 2022] DELETE /compute/v2.1/servers/3777fc27-6875-48e2-86e1-e87fe7a9e56c/tags/tempest-tag-516365846 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 15 21:02:22.298573 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-234d7627-1404-49ef-a772-27f07186675a tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Calling method '.version_select at 0x7f30c873b670>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:22.314417 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-234d7627-1404-49ef-a772-27f07186675a tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:22.315017 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-234d7627-1404-49ef-a772-27f07186675a tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:22.315173 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-9c6d171b-2ecc-4a73-98b2-84bae94d8be6 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e8f253bac41484ab8e92b74bfa54465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74165fadf5154c319ca56b4aa961e7b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:22.326886 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-234d7627-1404-49ef-a772-27f07186675a tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] 10.222.0.46 "GET /compute/v2.1/servers/3777fc27-6875-48e2-86e1-e87fe7a9e56c/tags" status: 200 len: 12 microversion: 2.26 time: 0.033299 Jan 15 21:02:22.329413 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2166/4359] 10.222.0.46 () {60 vars in 1291 bytes} [Sat Jan 15 21:02:22 2022] GET /compute/v2.1/servers/3777fc27-6875-48e2-86e1-e87fe7a9e56c/tags => generated 12 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:02:22.337512 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-76938ab7-2ee1-4de5-b797-e38fd27be305 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Calling method '.version_select at 0x7f30cece5820>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:22.339115 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-9c6d171b-2ecc-4a73-98b2-84bae94d8be6 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] 10.222.0.46 "GET /compute/v2.1/servers/26f27adc-8567-4752-8a51-ee9c301b2611" status: 200 len: 1323 microversion: 2.1 time: 0.457942 Jan 15 21:02:22.339707 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2194/4360] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:02:21 2022] GET /compute/v2.1/servers/26f27adc-8567-4752-8a51-ee9c301b2611 => generated 1323 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:02:22.350411 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-76938ab7-2ee1-4de5-b797-e38fd27be305 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:22.350878 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-76938ab7-2ee1-4de5-b797-e38fd27be305 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:22.351559 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-76938ab7-2ee1-4de5-b797-e38fd27be305 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] [instance: 3777fc27-6875-48e2-86e1-e87fe7a9e56c] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:22.357795 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-76938ab7-2ee1-4de5-b797-e38fd27be305 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:22.358249 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-76938ab7-2ee1-4de5-b797-e38fd27be305 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:22.359078 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-76938ab7-2ee1-4de5-b797-e38fd27be305 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:22.360439 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-76938ab7-2ee1-4de5-b797-e38fd27be305 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:22.396489 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-76938ab7-2ee1-4de5-b797-e38fd27be305 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:22.397180 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-76938ab7-2ee1-4de5-b797-e38fd27be305 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:22.408168 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8dd0856e-e4df-46eb-b18a-3190deaba1d8 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:22.409972 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.objects.instance [None req-76938ab7-2ee1-4de5-b797-e38fd27be305 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lazy-loading 'flavor' on Instance uuid 3777fc27-6875-48e2-86e1-e87fe7a9e56c {{(pid=129366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 21:02:22.412152 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-8dd0856e-e4df-46eb-b18a-3190deaba1d8 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: d09ef93d-246f-464d-8c9c-f5a6fa14e4fe] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:22.428599 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8dd0856e-e4df-46eb-b18a-3190deaba1d8 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:22.429103 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8dd0856e-e4df-46eb-b18a-3190deaba1d8 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:22.429918 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8dd0856e-e4df-46eb-b18a-3190deaba1d8 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:22.430363 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8dd0856e-e4df-46eb-b18a-3190deaba1d8 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:22.441591 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-76938ab7-2ee1-4de5-b797-e38fd27be305 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] 10.222.0.46 "DELETE /compute/v2.1/servers/3777fc27-6875-48e2-86e1-e87fe7a9e56c/tags" status: 204 len: 0 microversion: 2.26 time: 0.108979 Jan 15 21:02:22.442589 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2167/4361] 10.222.0.46 () {60 vars in 1294 bytes} [Sat Jan 15 21:02:22 2022] DELETE /compute/v2.1/servers/3777fc27-6875-48e2-86e1-e87fe7a9e56c/tags => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 15 21:02:22.457157 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-fc472dfd-8dda-4a18-ac65-6f9bce925097 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Calling method '.version_select at 0x7f30c868c670>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:22.467847 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fc472dfd-8dda-4a18-ac65-6f9bce925097 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:22.468660 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fc472dfd-8dda-4a18-ac65-6f9bce925097 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:22.469408 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-fc472dfd-8dda-4a18-ac65-6f9bce925097 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] [instance: 3777fc27-6875-48e2-86e1-e87fe7a9e56c] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:22.481079 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fc472dfd-8dda-4a18-ac65-6f9bce925097 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:22.481787 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fc472dfd-8dda-4a18-ac65-6f9bce925097 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:22.482758 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fc472dfd-8dda-4a18-ac65-6f9bce925097 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:22.483394 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fc472dfd-8dda-4a18-ac65-6f9bce925097 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:22.522098 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fc472dfd-8dda-4a18-ac65-6f9bce925097 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:22.522571 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fc472dfd-8dda-4a18-ac65-6f9bce925097 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:22.537232 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fc472dfd-8dda-4a18-ac65-6f9bce925097 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:22.537942 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fc472dfd-8dda-4a18-ac65-6f9bce925097 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:22.561684 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-8dd0856e-e4df-46eb-b18a-3190deaba1d8 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:22.580098 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-8dd0856e-e4df-46eb-b18a-3190deaba1d8 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/d09ef93d-246f-464d-8c9c-f5a6fa14e4fe" status: 200 len: 1275 microversion: 2.1 time: 0.217050 Jan 15 21:02:22.580769 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2195/4362] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:02:22 2022] GET /compute/v2.1/servers/d09ef93d-246f-464d-8c9c-f5a6fa14e4fe => generated 1275 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:02:22.585749 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.objects.instance [None req-fc472dfd-8dda-4a18-ac65-6f9bce925097 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lazy-loading 'flavor' on Instance uuid 3777fc27-6875-48e2-86e1-e87fe7a9e56c {{(pid=129366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 21:02:22.589661 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-4eff540d-c9e7-4e8d-8c26-af811abec89a tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:22.590819 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-4eff540d-c9e7-4e8d-8c26-af811abec89a tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:22.612658 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-fc472dfd-8dda-4a18-ac65-6f9bce925097 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] 10.222.0.46 "PUT /compute/v2.1/servers/3777fc27-6875-48e2-86e1-e87fe7a9e56c/tags/tempest-tag-7425055" status: 201 len: 0 microversion: 2.26 time: 0.160552 Jan 15 21:02:22.613137 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4eff540d-c9e7-4e8d-8c26-af811abec89a tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:22.613666 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4eff540d-c9e7-4e8d-8c26-af811abec89a tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:22.618130 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4eff540d-c9e7-4e8d-8c26-af811abec89a tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:22.618395 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4eff540d-c9e7-4e8d-8c26-af811abec89a tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:22.633066 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2168/4363] 10.222.0.46 () {62 vars in 1370 bytes} [Sat Jan 15 21:02:22 2022] PUT /compute/v2.1/servers/3777fc27-6875-48e2-86e1-e87fe7a9e56c/tags/tempest-tag-7425055 => generated 0 bytes in 182 msecs (HTTP/1.1 201) 10 headers in 483 bytes (1 switches on core 0) Jan 15 21:02:22.645044 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ff24e66f-0c3a-4e83-bfc3-ae3312853b44 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:22.647399 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ff24e66f-0c3a-4e83-bfc3-ae3312853b44 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:22.663840 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ff24e66f-0c3a-4e83-bfc3-ae3312853b44 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:22.664830 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ff24e66f-0c3a-4e83-bfc3-ae3312853b44 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:22.665905 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ff24e66f-0c3a-4e83-bfc3-ae3312853b44 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:22.669715 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ff24e66f-0c3a-4e83-bfc3-ae3312853b44 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:22.736176 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-4eff540d-c9e7-4e8d-8c26-af811abec89a tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action" status: 200 len: 32580 microversion: 2.1 time: 0.153400 Jan 15 21:02:22.736822 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2196/4364] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:02:22 2022] POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action => generated 32580 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:02:22.754830 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-bd39f88b-c3b3-4771-873d-ae5c4e8bf439 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Calling method '.version_select at 0x7f30c84ede50>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:22.766772 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bd39f88b-c3b3-4771-873d-ae5c4e8bf439 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:22.767220 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bd39f88b-c3b3-4771-873d-ae5c4e8bf439 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:22.767990 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-bd39f88b-c3b3-4771-873d-ae5c4e8bf439 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] [instance: 3777fc27-6875-48e2-86e1-e87fe7a9e56c] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:22.777611 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bd39f88b-c3b3-4771-873d-ae5c4e8bf439 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:22.778297 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bd39f88b-c3b3-4771-873d-ae5c4e8bf439 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:22.779943 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bd39f88b-c3b3-4771-873d-ae5c4e8bf439 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:22.780565 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bd39f88b-c3b3-4771-873d-ae5c4e8bf439 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:22.828096 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bd39f88b-c3b3-4771-873d-ae5c4e8bf439 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:22.829088 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bd39f88b-c3b3-4771-873d-ae5c4e8bf439 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:22.844833 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bd39f88b-c3b3-4771-873d-ae5c4e8bf439 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:22.845904 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bd39f88b-c3b3-4771-873d-ae5c4e8bf439 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:22.898962 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.objects.instance [None req-bd39f88b-c3b3-4771-873d-ae5c4e8bf439 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lazy-loading 'flavor' on Instance uuid 3777fc27-6875-48e2-86e1-e87fe7a9e56c {{(pid=129365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 21:02:22.932557 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-bd39f88b-c3b3-4771-873d-ae5c4e8bf439 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] 10.222.0.46 "PUT /compute/v2.1/servers/3777fc27-6875-48e2-86e1-e87fe7a9e56c/tags/tempest-tag-407184674" status: 201 len: 0 microversion: 2.26 time: 0.184975 Jan 15 21:02:22.933288 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2197/4365] 10.222.0.46 () {62 vars in 1376 bytes} [Sat Jan 15 21:02:22 2022] PUT /compute/v2.1/servers/3777fc27-6875-48e2-86e1-e87fe7a9e56c/tags/tempest-tag-407184674 => generated 0 bytes in 196 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Jan 15 21:02:22.948601 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-cb190245-7329-431e-91ab-0a6d907a9536 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:22.952401 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-cb190245-7329-431e-91ab-0a6d907a9536 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:22.967378 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cb190245-7329-431e-91ab-0a6d907a9536 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:22.968325 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cb190245-7329-431e-91ab-0a6d907a9536 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:22.969151 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cb190245-7329-431e-91ab-0a6d907a9536 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:22.970968 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cb190245-7329-431e-91ab-0a6d907a9536 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:23.064326 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-cb190245-7329-431e-91ab-0a6d907a9536 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.123638 Jan 15 21:02:23.066772 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2198/4366] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:02:22 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:02:23.087043 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-d8da0961-54ec-47ac-ab88-a2bb813243df req-1360ec04-06b0-472a-bc0f-e48be0aab998 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26f27adc-8567-4752-8a51-ee9c301b2611", "tag": "99af8280-f44b-4d03-aa1f-f1d9da00f1e9"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:23.090807 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:02:23.090807 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:02:23.129567 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-d8da0961-54ec-47ac-ab88-a2bb813243df req-1360ec04-06b0-472a-bc0f-e48be0aab998 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:23.130741 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-d8da0961-54ec-47ac-ab88-a2bb813243df req-1360ec04-06b0-472a-bc0f-e48be0aab998 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:23.173874 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-d8da0961-54ec-47ac-ab88-a2bb813243df req-1360ec04-06b0-472a-bc0f-e48be0aab998 service nova] Creating event network-changed:99af8280-f44b-4d03-aa1f-f1d9da00f1e9 for instance 26f27adc-8567-4752-8a51-ee9c301b2611 on nch2-master-1 Jan 15 21:02:23.191168 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-d8da0961-54ec-47ac-ab88-a2bb813243df req-1360ec04-06b0-472a-bc0f-e48be0aab998 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116764 Jan 15 21:02:23.191896 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2199/4367] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:02:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:02:23.209998 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-4d2a09fc-df49-4e0c-8638-8d2839d1dffe tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Calling method '.version_select at 0x7f30c8470700>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:23.228354 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4d2a09fc-df49-4e0c-8638-8d2839d1dffe tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:23.228975 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4d2a09fc-df49-4e0c-8638-8d2839d1dffe tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:23.229922 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-4d2a09fc-df49-4e0c-8638-8d2839d1dffe tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] [instance: 3777fc27-6875-48e2-86e1-e87fe7a9e56c] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:23.238334 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4d2a09fc-df49-4e0c-8638-8d2839d1dffe tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:23.238907 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4d2a09fc-df49-4e0c-8638-8d2839d1dffe tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:23.239828 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4d2a09fc-df49-4e0c-8638-8d2839d1dffe tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:23.240690 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4d2a09fc-df49-4e0c-8638-8d2839d1dffe tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:23.273025 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4d2a09fc-df49-4e0c-8638-8d2839d1dffe tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:23.273319 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4d2a09fc-df49-4e0c-8638-8d2839d1dffe tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:23.293717 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.objects.instance [None req-4d2a09fc-df49-4e0c-8638-8d2839d1dffe tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lazy-loading 'flavor' on Instance uuid 3777fc27-6875-48e2-86e1-e87fe7a9e56c {{(pid=129365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 21:02:23.319857 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-4d2a09fc-df49-4e0c-8638-8d2839d1dffe tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] 10.222.0.46 "DELETE /compute/v2.1/servers/3777fc27-6875-48e2-86e1-e87fe7a9e56c/tags" status: 204 len: 0 microversion: 2.26 time: 0.125218 Jan 15 21:02:23.321133 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2200/4368] 10.222.0.46 () {60 vars in 1294 bytes} [Sat Jan 15 21:02:23 2022] DELETE /compute/v2.1/servers/3777fc27-6875-48e2-86e1-e87fe7a9e56c/tags => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 15 21:02:23.327419 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3d85659e-f231-4727-8b56-f24c165162ce tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:23.330224 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-3d85659e-f231-4727-8b56-f24c165162ce tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:23.344076 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3d85659e-f231-4727-8b56-f24c165162ce tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:23.344763 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3d85659e-f231-4727-8b56-f24c165162ce tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:23.346150 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3d85659e-f231-4727-8b56-f24c165162ce tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:23.346855 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3d85659e-f231-4727-8b56-f24c165162ce tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:23.408832 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3d85659e-f231-4727-8b56-f24c165162ce tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.085875 Jan 15 21:02:23.414477 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-ff24e66f-0c3a-4e83-bfc3-ae3312853b44 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:23.415757 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2201/4369] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:02:23 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:02:23.424110 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-836a61bf-c2a1-4943-bdac-9f6c8b15d0ec tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Calling method '.version_select at 0x7f30c84b8790>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:23.426123 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-ff24e66f-0c3a-4e83-bfc3-ae3312853b44 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:23.429494 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-ff24e66f-0c3a-4e83-bfc3-ae3312853b44 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:23.433832 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ff24e66f-0c3a-4e83-bfc3-ae3312853b44 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0" status: 200 len: 1721 microversion: 2.20 time: 0.797864 Jan 15 21:02:23.439687 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-836a61bf-c2a1-4943-bdac-9f6c8b15d0ec tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:23.440520 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-836a61bf-c2a1-4943-bdac-9f6c8b15d0ec tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:23.445675 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2169/4370] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:02:22 2022] GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0 => generated 1721 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:02:23.450684 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b858b28d-f615-4856-8964-a18a5bdc8c7a tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:23.451284 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b858b28d-f615-4856-8964-a18a5bdc8c7a tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] [instance: 26f27adc-8567-4752-8a51-ee9c301b2611] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:23.452597 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-836a61bf-c2a1-4943-bdac-9f6c8b15d0ec tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] 10.222.0.46 "GET /compute/v2.1/servers/3777fc27-6875-48e2-86e1-e87fe7a9e56c/tags" status: 200 len: 12 microversion: 2.26 time: 0.034899 Jan 15 21:02:23.454482 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2202/4371] 10.222.0.46 () {60 vars in 1291 bytes} [Sat Jan 15 21:02:23 2022] GET /compute/v2.1/servers/3777fc27-6875-48e2-86e1-e87fe7a9e56c/tags => generated 12 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:02:23.466062 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b858b28d-f615-4856-8964-a18a5bdc8c7a tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:23.466518 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b858b28d-f615-4856-8964-a18a5bdc8c7a tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:23.467293 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b858b28d-f615-4856-8964-a18a5bdc8c7a tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:23.467555 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-00616725-a2a4-48f7-b098-dd7cebc091ca tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Calling method '.version_select at 0x7f30c84bddc0>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:23.467745 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b858b28d-f615-4856-8964-a18a5bdc8c7a tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:23.489594 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-00616725-a2a4-48f7-b098-dd7cebc091ca tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:23.490459 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-00616725-a2a4-48f7-b098-dd7cebc091ca tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:23.491336 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-00616725-a2a4-48f7-b098-dd7cebc091ca tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] [instance: 3777fc27-6875-48e2-86e1-e87fe7a9e56c] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:23.500031 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-00616725-a2a4-48f7-b098-dd7cebc091ca tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:23.501151 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-00616725-a2a4-48f7-b098-dd7cebc091ca tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:23.502571 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-00616725-a2a4-48f7-b098-dd7cebc091ca tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:23.503243 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-00616725-a2a4-48f7-b098-dd7cebc091ca tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:23.542280 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-00616725-a2a4-48f7-b098-dd7cebc091ca tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:23.543351 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-00616725-a2a4-48f7-b098-dd7cebc091ca tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:23.562720 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.objects.instance [None req-00616725-a2a4-48f7-b098-dd7cebc091ca tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lazy-loading 'flavor' on Instance uuid 3777fc27-6875-48e2-86e1-e87fe7a9e56c {{(pid=129365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 21:02:23.583450 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-00616725-a2a4-48f7-b098-dd7cebc091ca tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] 10.222.0.46 "DELETE /compute/v2.1/servers/3777fc27-6875-48e2-86e1-e87fe7a9e56c/tags" status: 204 len: 0 microversion: 2.26 time: 0.122868 Jan 15 21:02:23.584962 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2203/4372] 10.222.0.46 () {60 vars in 1294 bytes} [Sat Jan 15 21:02:23 2022] DELETE /compute/v2.1/servers/3777fc27-6875-48e2-86e1-e87fe7a9e56c/tags => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jan 15 21:02:23.615690 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c7e92161-75ba-4d76-ad77-4ca3ee7fe32d tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Calling method '.version_select at 0x7f30c84b8820>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:23.646731 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c7e92161-75ba-4d76-ad77-4ca3ee7fe32d tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:23.652270 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c7e92161-75ba-4d76-ad77-4ca3ee7fe32d tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:23.653212 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c7e92161-75ba-4d76-ad77-4ca3ee7fe32d tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] [instance: 3777fc27-6875-48e2-86e1-e87fe7a9e56c] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:23.666912 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c7e92161-75ba-4d76-ad77-4ca3ee7fe32d tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:23.667513 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c7e92161-75ba-4d76-ad77-4ca3ee7fe32d tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:23.668525 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c7e92161-75ba-4d76-ad77-4ca3ee7fe32d tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:23.669507 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c7e92161-75ba-4d76-ad77-4ca3ee7fe32d tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:23.714368 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c7e92161-75ba-4d76-ad77-4ca3ee7fe32d tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:23.717182 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c7e92161-75ba-4d76-ad77-4ca3ee7fe32d tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:23.731308 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c7e92161-75ba-4d76-ad77-4ca3ee7fe32d tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:23.732294 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c7e92161-75ba-4d76-ad77-4ca3ee7fe32d tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:23.767430 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.objects.instance [None req-c7e92161-75ba-4d76-ad77-4ca3ee7fe32d tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lazy-loading 'flavor' on Instance uuid 3777fc27-6875-48e2-86e1-e87fe7a9e56c {{(pid=129365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 21:02:23.786796 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c7e92161-75ba-4d76-ad77-4ca3ee7fe32d tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] 10.222.0.46 "PUT /compute/v2.1/servers/3777fc27-6875-48e2-86e1-e87fe7a9e56c/tags/tempest-tag-971968640" status: 201 len: 0 microversion: 2.26 time: 0.177942 Jan 15 21:02:23.788424 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2204/4373] 10.222.0.46 () {62 vars in 1376 bytes} [Sat Jan 15 21:02:23 2022] PUT /compute/v2.1/servers/3777fc27-6875-48e2-86e1-e87fe7a9e56c/tags/tempest-tag-971968640 => generated 0 bytes in 190 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Jan 15 21:02:23.793746 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-dbb86f87-cb5e-4ff8-823b-45667f87fe53 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:23.794202 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-b858b28d-f615-4856-8964-a18a5bdc8c7a tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e8f253bac41484ab8e92b74bfa54465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74165fadf5154c319ca56b4aa961e7b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:23.795517 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-dbb86f87-cb5e-4ff8-823b-45667f87fe53 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: d09ef93d-246f-464d-8c9c-f5a6fa14e4fe] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:23.802941 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dbb86f87-cb5e-4ff8-823b-45667f87fe53 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:23.803940 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dbb86f87-cb5e-4ff8-823b-45667f87fe53 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:23.804996 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dbb86f87-cb5e-4ff8-823b-45667f87fe53 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:23.805578 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b858b28d-f615-4856-8964-a18a5bdc8c7a tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] 10.222.0.46 "GET /compute/v2.1/servers/26f27adc-8567-4752-8a51-ee9c301b2611" status: 200 len: 1323 microversion: 2.1 time: 0.358759 Jan 15 21:02:23.806083 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dbb86f87-cb5e-4ff8-823b-45667f87fe53 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:23.806559 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2170/4374] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:02:23 2022] GET /compute/v2.1/servers/26f27adc-8567-4752-8a51-ee9c301b2611 => generated 1323 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:02:23.821937 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0912d390-b42b-4c14-87d4-7226b00fa079 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:23.822917 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-0912d390-b42b-4c14-87d4-7226b00fa079 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:23.833426 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0912d390-b42b-4c14-87d4-7226b00fa079 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:23.835014 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0912d390-b42b-4c14-87d4-7226b00fa079 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:23.836365 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0912d390-b42b-4c14-87d4-7226b00fa079 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:23.837405 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0912d390-b42b-4c14-87d4-7226b00fa079 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:23.899509 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0912d390-b42b-4c14-87d4-7226b00fa079 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action" status: 200 len: 32580 microversion: 2.1 time: 0.091475 Jan 15 21:02:23.900672 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2171/4375] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:02:23 2022] POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action => generated 32580 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:02:23.908153 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1d8e61a6-9372-461f-bbaa-24cadf7bdf95 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Calling method '.version_select at 0x7f30c86023a0>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:23.921094 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1d8e61a6-9372-461f-bbaa-24cadf7bdf95 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:23.921700 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1d8e61a6-9372-461f-bbaa-24cadf7bdf95 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:23.922431 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-1d8e61a6-9372-461f-bbaa-24cadf7bdf95 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] [instance: 3777fc27-6875-48e2-86e1-e87fe7a9e56c] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:23.930096 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1d8e61a6-9372-461f-bbaa-24cadf7bdf95 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:23.930542 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1d8e61a6-9372-461f-bbaa-24cadf7bdf95 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:23.931333 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1d8e61a6-9372-461f-bbaa-24cadf7bdf95 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:23.931873 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1d8e61a6-9372-461f-bbaa-24cadf7bdf95 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:23.950826 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-dbb86f87-cb5e-4ff8-823b-45667f87fe53 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:23.966050 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-dbb86f87-cb5e-4ff8-823b-45667f87fe53 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/d09ef93d-246f-464d-8c9c-f5a6fa14e4fe" status: 200 len: 1273 microversion: 2.1 time: 0.176220 Jan 15 21:02:23.966687 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2205/4376] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:02:23 2022] GET /compute/v2.1/servers/d09ef93d-246f-464d-8c9c-f5a6fa14e4fe => generated 1273 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:02:23.982070 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1d8e61a6-9372-461f-bbaa-24cadf7bdf95 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:23.982575 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1d8e61a6-9372-461f-bbaa-24cadf7bdf95 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:24.006239 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1d8e61a6-9372-461f-bbaa-24cadf7bdf95 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:24.006822 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1d8e61a6-9372-461f-bbaa-24cadf7bdf95 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:24.039189 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.objects.instance [None req-1d8e61a6-9372-461f-bbaa-24cadf7bdf95 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lazy-loading 'flavor' on Instance uuid 3777fc27-6875-48e2-86e1-e87fe7a9e56c {{(pid=129366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 21:02:24.062425 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-1d8e61a6-9372-461f-bbaa-24cadf7bdf95 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] 10.222.0.46 "PUT /compute/v2.1/servers/3777fc27-6875-48e2-86e1-e87fe7a9e56c/tags/tempest-tag-1776929574" status: 201 len: 0 microversion: 2.26 time: 0.159446 Jan 15 21:02:24.063397 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2172/4377] 10.222.0.46 () {62 vars in 1379 bytes} [Sat Jan 15 21:02:23 2022] PUT /compute/v2.1/servers/3777fc27-6875-48e2-86e1-e87fe7a9e56c/tags/tempest-tag-1776929574 => generated 0 bytes in 161 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Jan 15 21:02:24.073233 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-23706140-1573-4098-ac8e-c1e1b54936ea tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Action: 'update_all', calling method: .version_select at 0x7f30c8470430>, body: {"tags": ["tempest-tag-1570649509", "tempest-tag-1607181886"]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:24.079204 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a6456717-b840-42ad-aa0d-bbbe1f3d95a4 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:24.083059 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a6456717-b840-42ad-aa0d-bbbe1f3d95a4 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:24.091762 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-23706140-1573-4098-ac8e-c1e1b54936ea tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:24.094014 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-23706140-1573-4098-ac8e-c1e1b54936ea tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:24.094759 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-23706140-1573-4098-ac8e-c1e1b54936ea tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] [instance: 3777fc27-6875-48e2-86e1-e87fe7a9e56c] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:24.100488 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a6456717-b840-42ad-aa0d-bbbe1f3d95a4 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:24.102871 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a6456717-b840-42ad-aa0d-bbbe1f3d95a4 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:24.104290 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a6456717-b840-42ad-aa0d-bbbe1f3d95a4 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:24.106291 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a6456717-b840-42ad-aa0d-bbbe1f3d95a4 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:24.110809 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-23706140-1573-4098-ac8e-c1e1b54936ea tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:24.111502 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-23706140-1573-4098-ac8e-c1e1b54936ea tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:24.113284 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-23706140-1573-4098-ac8e-c1e1b54936ea tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:24.113729 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-23706140-1573-4098-ac8e-c1e1b54936ea tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:24.174965 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-23706140-1573-4098-ac8e-c1e1b54936ea tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:24.175453 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-23706140-1573-4098-ac8e-c1e1b54936ea tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:24.218198 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.objects.instance [None req-23706140-1573-4098-ac8e-c1e1b54936ea tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lazy-loading 'flavor' on Instance uuid 3777fc27-6875-48e2-86e1-e87fe7a9e56c {{(pid=129365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 21:02:24.224371 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a6456717-b840-42ad-aa0d-bbbe1f3d95a4 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.149066 Jan 15 21:02:24.225869 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2173/4378] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:02:24 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:02:24.242490 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-23706140-1573-4098-ac8e-c1e1b54936ea tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] 10.222.0.46 "PUT /compute/v2.1/servers/3777fc27-6875-48e2-86e1-e87fe7a9e56c/tags" status: 200 len: 62 microversion: 2.26 time: 0.173713 Jan 15 21:02:24.243679 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2206/4379] 10.222.0.46 () {62 vars in 1311 bytes} [Sat Jan 15 21:02:24 2022] PUT /compute/v2.1/servers/3777fc27-6875-48e2-86e1-e87fe7a9e56c/tags => generated 62 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:02:24.255014 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-394dabeb-cf8b-4f21-a125-075633b82531 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Calling method '.version_select at 0x7f30c868c3a0>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:24.269274 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-394dabeb-cf8b-4f21-a125-075633b82531 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:24.270767 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-394dabeb-cf8b-4f21-a125-075633b82531 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:24.288975 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-394dabeb-cf8b-4f21-a125-075633b82531 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] 10.222.0.46 "GET /compute/v2.1/servers/3777fc27-6875-48e2-86e1-e87fe7a9e56c/tags" status: 200 len: 62 microversion: 2.26 time: 0.039057 Jan 15 21:02:24.289645 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2174/4380] 10.222.0.46 () {60 vars in 1291 bytes} [Sat Jan 15 21:02:24 2022] GET /compute/v2.1/servers/3777fc27-6875-48e2-86e1-e87fe7a9e56c/tags => generated 62 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:02:24.301954 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d2c1e866-c16e-413a-9899-80f53fef52c8 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Calling method '.version_select at 0x7f30c8470f70>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:24.317320 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d2c1e866-c16e-413a-9899-80f53fef52c8 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:24.317787 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d2c1e866-c16e-413a-9899-80f53fef52c8 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:24.318281 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d2c1e866-c16e-413a-9899-80f53fef52c8 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] [instance: 3777fc27-6875-48e2-86e1-e87fe7a9e56c] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:24.327286 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d2c1e866-c16e-413a-9899-80f53fef52c8 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:24.327748 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d2c1e866-c16e-413a-9899-80f53fef52c8 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:24.328556 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d2c1e866-c16e-413a-9899-80f53fef52c8 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:24.333494 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d2c1e866-c16e-413a-9899-80f53fef52c8 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:24.381629 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d2c1e866-c16e-413a-9899-80f53fef52c8 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:24.382089 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d2c1e866-c16e-413a-9899-80f53fef52c8 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:24.401884 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.objects.instance [None req-d2c1e866-c16e-413a-9899-80f53fef52c8 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lazy-loading 'flavor' on Instance uuid 3777fc27-6875-48e2-86e1-e87fe7a9e56c {{(pid=129365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 21:02:24.419659 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d2c1e866-c16e-413a-9899-80f53fef52c8 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] 10.222.0.46 "DELETE /compute/v2.1/servers/3777fc27-6875-48e2-86e1-e87fe7a9e56c/tags" status: 204 len: 0 microversion: 2.26 time: 0.123616 Jan 15 21:02:24.421584 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2207/4381] 10.222.0.46 () {60 vars in 1294 bytes} [Sat Jan 15 21:02:24 2022] DELETE /compute/v2.1/servers/3777fc27-6875-48e2-86e1-e87fe7a9e56c/tags => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 15 21:02:24.421701 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-274253c5-d6de-4740-ae73-54aba7f34aa7 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:24.423703 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-274253c5-d6de-4740-ae73-54aba7f34aa7 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:24.431646 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b8fac299-aa96-4b40-ad3c-b3a94103826a tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:24.432417 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b8fac299-aa96-4b40-ad3c-b3a94103826a tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] [instance: 3777fc27-6875-48e2-86e1-e87fe7a9e56c] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:24.434029 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-274253c5-d6de-4740-ae73-54aba7f34aa7 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:24.437176 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-274253c5-d6de-4740-ae73-54aba7f34aa7 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:24.438627 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-274253c5-d6de-4740-ae73-54aba7f34aa7 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:24.439095 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-274253c5-d6de-4740-ae73-54aba7f34aa7 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:24.441743 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b8fac299-aa96-4b40-ad3c-b3a94103826a tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:24.443361 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b8fac299-aa96-4b40-ad3c-b3a94103826a tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:24.444985 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b8fac299-aa96-4b40-ad3c-b3a94103826a tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:24.445696 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b8fac299-aa96-4b40-ad3c-b3a94103826a tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:24.495575 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b8fac299-aa96-4b40-ad3c-b3a94103826a tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] [instance: 3777fc27-6875-48e2-86e1-e87fe7a9e56c] Going to try to terminate instance {{(pid=129365) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 21:02:24.505790 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-274253c5-d6de-4740-ae73-54aba7f34aa7 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.088617 Jan 15 21:02:24.513015 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2175/4382] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:02:24 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:02:24.519982 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-91abaab7-ebf1-4dc1-af75-4f3ca5ffe333 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:24.520790 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-91abaab7-ebf1-4dc1-af75-4f3ca5ffe333 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:24.532784 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-91abaab7-ebf1-4dc1-af75-4f3ca5ffe333 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:24.533953 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-91abaab7-ebf1-4dc1-af75-4f3ca5ffe333 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:24.535140 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-91abaab7-ebf1-4dc1-af75-4f3ca5ffe333 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:24.536048 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-91abaab7-ebf1-4dc1-af75-4f3ca5ffe333 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:24.659233 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b8fac299-aa96-4b40-ad3c-b3a94103826a tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] 10.222.0.46 "DELETE /compute/v2.1/servers/3777fc27-6875-48e2-86e1-e87fe7a9e56c" status: 204 len: 0 microversion: 2.26 time: 0.231577 Jan 15 21:02:24.660746 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2208/4383] 10.222.0.46 () {60 vars in 1279 bytes} [Sat Jan 15 21:02:24 2022] DELETE /compute/v2.1/servers/3777fc27-6875-48e2-86e1-e87fe7a9e56c => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jan 15 21:02:24.672666 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f3de0d7a-12db-4142-b44e-7dcfba81c764 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:24.673607 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f3de0d7a-12db-4142-b44e-7dcfba81c764 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] [instance: 3777fc27-6875-48e2-86e1-e87fe7a9e56c] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:24.680956 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f3de0d7a-12db-4142-b44e-7dcfba81c764 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:24.681555 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f3de0d7a-12db-4142-b44e-7dcfba81c764 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:24.682509 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f3de0d7a-12db-4142-b44e-7dcfba81c764 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:24.683701 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f3de0d7a-12db-4142-b44e-7dcfba81c764 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:24.897329 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-91abaab7-ebf1-4dc1-af75-4f3ca5ffe333 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:24.910092 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-91abaab7-ebf1-4dc1-af75-4f3ca5ffe333 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:24.911792 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-91abaab7-ebf1-4dc1-af75-4f3ca5ffe333 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:24.913619 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-91abaab7-ebf1-4dc1-af75-4f3ca5ffe333 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0" status: 200 len: 1721 microversion: 2.20 time: 0.398985 Jan 15 21:02:24.925511 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2176/4384] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:02:24 2022] GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0 => generated 1721 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:02:24.925511 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-534a5bd4-2cdd-49ae-bd5e-7cd689d34e6f tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:24.925511 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-534a5bd4-2cdd-49ae-bd5e-7cd689d34e6f tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] [instance: 26f27adc-8567-4752-8a51-ee9c301b2611] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:24.937591 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-534a5bd4-2cdd-49ae-bd5e-7cd689d34e6f tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:24.938446 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-534a5bd4-2cdd-49ae-bd5e-7cd689d34e6f tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:24.939773 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-534a5bd4-2cdd-49ae-bd5e-7cd689d34e6f tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:24.940405 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-534a5bd4-2cdd-49ae-bd5e-7cd689d34e6f tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:24.968508 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-f3de0d7a-12db-4142-b44e-7dcfba81c764 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527f03c53ee54c99ba36a3b918c25597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356d7bd6c3e84b759875cc530b7d18c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:24.982030 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-f3de0d7a-12db-4142-b44e-7dcfba81c764 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527f03c53ee54c99ba36a3b918c25597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356d7bd6c3e84b759875cc530b7d18c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:24.984277 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-f3de0d7a-12db-4142-b44e-7dcfba81c764 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527f03c53ee54c99ba36a3b918c25597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356d7bd6c3e84b759875cc530b7d18c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:24.986063 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f3de0d7a-12db-4142-b44e-7dcfba81c764 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] 10.222.0.46 "GET /compute/v2.1/servers/3777fc27-6875-48e2-86e1-e87fe7a9e56c" status: 200 len: 1551 microversion: 2.26 time: 0.320647 Jan 15 21:02:24.997643 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2209/4385] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:02:24 2022] GET /compute/v2.1/servers/3777fc27-6875-48e2-86e1-e87fe7a9e56c => generated 1551 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 15 21:02:25.003287 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9cb2483d-36d3-42a6-a33e-5b7c5a6fa23e tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:25.004230 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-9cb2483d-36d3-42a6-a33e-5b7c5a6fa23e tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:25.012827 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9cb2483d-36d3-42a6-a33e-5b7c5a6fa23e tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:25.013393 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9cb2483d-36d3-42a6-a33e-5b7c5a6fa23e tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:25.014155 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9cb2483d-36d3-42a6-a33e-5b7c5a6fa23e tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:25.014643 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9cb2483d-36d3-42a6-a33e-5b7c5a6fa23e tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:25.083631 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-9cb2483d-36d3-42a6-a33e-5b7c5a6fa23e tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action" status: 200 len: 32580 microversion: 2.1 time: 0.084198 Jan 15 21:02:25.084491 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2210/4386] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:02:24 2022] POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action => generated 32580 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:02:25.109452 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-4b5f65d4-cc1e-4d4f-8d8f-58b27e648e35 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:25.113260 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-4b5f65d4-cc1e-4d4f-8d8f-58b27e648e35 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: d09ef93d-246f-464d-8c9c-f5a6fa14e4fe] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:25.131739 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4b5f65d4-cc1e-4d4f-8d8f-58b27e648e35 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:25.132203 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4b5f65d4-cc1e-4d4f-8d8f-58b27e648e35 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:25.133046 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4b5f65d4-cc1e-4d4f-8d8f-58b27e648e35 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:25.133488 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4b5f65d4-cc1e-4d4f-8d8f-58b27e648e35 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:25.311884 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-534a5bd4-2cdd-49ae-bd5e-7cd689d34e6f tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e8f253bac41484ab8e92b74bfa54465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74165fadf5154c319ca56b4aa961e7b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:25.325327 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-534a5bd4-2cdd-49ae-bd5e-7cd689d34e6f tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] 10.222.0.46 "GET /compute/v2.1/servers/26f27adc-8567-4752-8a51-ee9c301b2611" status: 200 len: 1323 microversion: 2.1 time: 0.408564 Jan 15 21:02:25.326053 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2177/4387] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:02:24 2022] GET /compute/v2.1/servers/26f27adc-8567-4752-8a51-ee9c301b2611 => generated 1323 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:02:25.356362 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d011a1f6-4468-4f72-b627-75455f0366e8 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:25.358128 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-d011a1f6-4468-4f72-b627-75455f0366e8 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:25.368460 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d011a1f6-4468-4f72-b627-75455f0366e8 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:25.380016 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d011a1f6-4468-4f72-b627-75455f0366e8 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:25.381348 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d011a1f6-4468-4f72-b627-75455f0366e8 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:25.381912 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d011a1f6-4468-4f72-b627-75455f0366e8 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:25.466644 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-4b5f65d4-cc1e-4d4f-8d8f-58b27e648e35 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:25.488686 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-4b5f65d4-cc1e-4d4f-8d8f-58b27e648e35 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/d09ef93d-246f-464d-8c9c-f5a6fa14e4fe" status: 200 len: 1315 microversion: 2.1 time: 0.395884 Jan 15 21:02:25.491745 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2211/4388] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:02:25 2022] GET /compute/v2.1/servers/d09ef93d-246f-464d-8c9c-f5a6fa14e4fe => generated 1315 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:02:25.493311 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d011a1f6-4468-4f72-b627-75455f0366e8 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.162290 Jan 15 21:02:25.494647 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2178/4389] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:02:25 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:02:25.519350 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-01ae9346-e9bc-4485-8302-678bfe038193 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:25.520524 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-01ae9346-e9bc-4485-8302-678bfe038193 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:25.531346 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-01ae9346-e9bc-4485-8302-678bfe038193 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:25.532669 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-01ae9346-e9bc-4485-8302-678bfe038193 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:25.533685 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-01ae9346-e9bc-4485-8302-678bfe038193 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:25.534513 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-01ae9346-e9bc-4485-8302-678bfe038193 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:25.581477 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-e4b06a60-fc1c-4360-bf19-5d23ec978217 req-ea102faf-5f3c-46ee-a209-78de7e2cd8b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d09ef93d-246f-464d-8c9c-f5a6fa14e4fe", "tag": "b02e61ea-6381-4f71-974b-68f69a1343f7"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:25.585021 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:02:25.585021 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:02:25.596755 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-01ae9346-e9bc-4485-8302-678bfe038193 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.081542 Jan 15 21:02:25.600338 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2212/4390] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:02:25 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:02:25.623323 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-e4b06a60-fc1c-4360-bf19-5d23ec978217 req-ea102faf-5f3c-46ee-a209-78de7e2cd8b2 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:25.624494 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-e4b06a60-fc1c-4360-bf19-5d23ec978217 req-ea102faf-5f3c-46ee-a209-78de7e2cd8b2 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:25.651250 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-e4b06a60-fc1c-4360-bf19-5d23ec978217 req-ea102faf-5f3c-46ee-a209-78de7e2cd8b2 service nova] Creating event network-changed:b02e61ea-6381-4f71-974b-68f69a1343f7 for instance d09ef93d-246f-464d-8c9c-f5a6fa14e4fe on nch1-master-1 Jan 15 21:02:25.657402 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-e4b06a60-fc1c-4360-bf19-5d23ec978217 req-ea102faf-5f3c-46ee-a209-78de7e2cd8b2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088146 Jan 15 21:02:25.660068 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2179/4391] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:02:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:02:25.934083 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-db505aa5-aa9c-4e8a-85e9-fead55407ed7 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:25.935401 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-db505aa5-aa9c-4e8a-85e9-fead55407ed7 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:25.948432 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-db505aa5-aa9c-4e8a-85e9-fead55407ed7 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:25.953472 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-db505aa5-aa9c-4e8a-85e9-fead55407ed7 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:25.955331 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-db505aa5-aa9c-4e8a-85e9-fead55407ed7 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:25.955905 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-db505aa5-aa9c-4e8a-85e9-fead55407ed7 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:26.006029 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7fcf3604-89bf-4bbd-93e6-9a9861c18a93 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:26.007128 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-7fcf3604-89bf-4bbd-93e6-9a9861c18a93 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] [instance: 3777fc27-6875-48e2-86e1-e87fe7a9e56c] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:26.019392 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7fcf3604-89bf-4bbd-93e6-9a9861c18a93 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:26.019994 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7fcf3604-89bf-4bbd-93e6-9a9861c18a93 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:26.020816 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7fcf3604-89bf-4bbd-93e6-9a9861c18a93 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:26.021284 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7fcf3604-89bf-4bbd-93e6-9a9861c18a93 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:26.237898 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-db505aa5-aa9c-4e8a-85e9-fead55407ed7 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:26.251667 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-db505aa5-aa9c-4e8a-85e9-fead55407ed7 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:26.253741 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-db505aa5-aa9c-4e8a-85e9-fead55407ed7 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:26.260517 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-db505aa5-aa9c-4e8a-85e9-fead55407ed7 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0" status: 200 len: 1721 microversion: 2.20 time: 0.330699 Jan 15 21:02:26.262452 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2213/4392] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:02:25 2022] GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0 => generated 1721 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:02:26.270963 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-29d6ad88-b780-417d-83c1-251c3d9c41c7 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:26.272118 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-29d6ad88-b780-417d-83c1-251c3d9c41c7 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:26.284538 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-29d6ad88-b780-417d-83c1-251c3d9c41c7 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:26.286144 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-29d6ad88-b780-417d-83c1-251c3d9c41c7 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:26.287467 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-29d6ad88-b780-417d-83c1-251c3d9c41c7 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:26.289169 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-29d6ad88-b780-417d-83c1-251c3d9c41c7 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:26.356896 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-29d6ad88-b780-417d-83c1-251c3d9c41c7 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action" status: 200 len: 32580 microversion: 2.1 time: 0.092155 Jan 15 21:02:26.360352 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2214/4393] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:02:26 2022] POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action => generated 32580 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:02:26.369339 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-7fcf3604-89bf-4bbd-93e6-9a9861c18a93 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527f03c53ee54c99ba36a3b918c25597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356d7bd6c3e84b759875cc530b7d18c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:26.371279 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2221e3e8-9c03-4b64-b710-71cd330f2117 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:26.372448 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-2221e3e8-9c03-4b64-b710-71cd330f2117 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] [instance: 26f27adc-8567-4752-8a51-ee9c301b2611] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:26.381157 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-7fcf3604-89bf-4bbd-93e6-9a9861c18a93 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527f03c53ee54c99ba36a3b918c25597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356d7bd6c3e84b759875cc530b7d18c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:26.382620 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-7fcf3604-89bf-4bbd-93e6-9a9861c18a93 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527f03c53ee54c99ba36a3b918c25597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356d7bd6c3e84b759875cc530b7d18c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:26.384269 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2221e3e8-9c03-4b64-b710-71cd330f2117 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:26.384995 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2221e3e8-9c03-4b64-b710-71cd330f2117 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:26.386464 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7fcf3604-89bf-4bbd-93e6-9a9861c18a93 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] 10.222.0.46 "GET /compute/v2.1/servers/3777fc27-6875-48e2-86e1-e87fe7a9e56c" status: 200 len: 1551 microversion: 2.26 time: 0.382240 Jan 15 21:02:26.387091 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2180/4394] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:02:25 2022] GET /compute/v2.1/servers/3777fc27-6875-48e2-86e1-e87fe7a9e56c => generated 1551 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:02:26.388092 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2221e3e8-9c03-4b64-b710-71cd330f2117 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:26.389506 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2221e3e8-9c03-4b64-b710-71cd330f2117 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:26.511285 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-417426de-1bb6-4a2d-a96f-abd28d9fef89 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:26.512299 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-417426de-1bb6-4a2d-a96f-abd28d9fef89 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:26.528394 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-417426de-1bb6-4a2d-a96f-abd28d9fef89 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:26.528880 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-417426de-1bb6-4a2d-a96f-abd28d9fef89 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:26.530523 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-417426de-1bb6-4a2d-a96f-abd28d9fef89 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:26.531057 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-417426de-1bb6-4a2d-a96f-abd28d9fef89 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:26.609586 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-417426de-1bb6-4a2d-a96f-abd28d9fef89 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.106513 Jan 15 21:02:26.617700 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2181/4395] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:02:26 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:02:26.627650 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-2221e3e8-9c03-4b64-b710-71cd330f2117 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e8f253bac41484ab8e92b74bfa54465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74165fadf5154c319ca56b4aa961e7b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:26.632055 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8e296d0d-fa2b-4c14-b61c-201aff3bec0f tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:26.634019 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-8e296d0d-fa2b-4c14-b61c-201aff3bec0f tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: d09ef93d-246f-464d-8c9c-f5a6fa14e4fe] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:26.637141 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2221e3e8-9c03-4b64-b710-71cd330f2117 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] 10.222.0.46 "GET /compute/v2.1/servers/26f27adc-8567-4752-8a51-ee9c301b2611" status: 200 len: 1323 microversion: 2.1 time: 0.275160 Jan 15 21:02:26.637930 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2215/4396] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:02:26 2022] GET /compute/v2.1/servers/26f27adc-8567-4752-8a51-ee9c301b2611 => generated 1323 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:02:26.645959 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5419eef9-b2a7-42cf-8f08-670a8cba849f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:26.654431 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8e296d0d-fa2b-4c14-b61c-201aff3bec0f tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:26.655166 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8e296d0d-fa2b-4c14-b61c-201aff3bec0f tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:26.656731 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8e296d0d-fa2b-4c14-b61c-201aff3bec0f tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:26.657361 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-5419eef9-b2a7-42cf-8f08-670a8cba849f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:26.657529 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8e296d0d-fa2b-4c14-b61c-201aff3bec0f tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:26.666229 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5419eef9-b2a7-42cf-8f08-670a8cba849f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:26.666678 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5419eef9-b2a7-42cf-8f08-670a8cba849f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:26.667465 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5419eef9-b2a7-42cf-8f08-670a8cba849f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:26.668396 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5419eef9-b2a7-42cf-8f08-670a8cba849f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:26.743533 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5419eef9-b2a7-42cf-8f08-670a8cba849f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.101561 Jan 15 21:02:26.744878 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2216/4397] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:02:26 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:02:26.912170 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-8e296d0d-fa2b-4c14-b61c-201aff3bec0f tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:26.920429 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-8e296d0d-fa2b-4c14-b61c-201aff3bec0f tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/d09ef93d-246f-464d-8c9c-f5a6fa14e4fe" status: 200 len: 1315 microversion: 2.1 time: 0.300555 Jan 15 21:02:26.921258 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2182/4398] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:02:26 2022] GET /compute/v2.1/servers/d09ef93d-246f-464d-8c9c-f5a6fa14e4fe => generated 1315 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:02:27.280388 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-04473027-2480-4f4f-b62f-2c5eea9d19a7 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:27.281157 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-04473027-2480-4f4f-b62f-2c5eea9d19a7 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:27.288438 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-04473027-2480-4f4f-b62f-2c5eea9d19a7 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:27.289037 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-04473027-2480-4f4f-b62f-2c5eea9d19a7 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:27.289731 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-04473027-2480-4f4f-b62f-2c5eea9d19a7 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:27.290161 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-04473027-2480-4f4f-b62f-2c5eea9d19a7 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:27.369891 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a8c9f9bc-df28-4e07-a46e-5c31a80c91e0 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:27.371102 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a8c9f9bc-df28-4e07-a46e-5c31a80c91e0 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:27.387841 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a8c9f9bc-df28-4e07-a46e-5c31a80c91e0 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:27.388546 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a8c9f9bc-df28-4e07-a46e-5c31a80c91e0 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:27.390027 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a8c9f9bc-df28-4e07-a46e-5c31a80c91e0 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:27.390695 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a8c9f9bc-df28-4e07-a46e-5c31a80c91e0 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:27.448716 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a8c9f9bc-df28-4e07-a46e-5c31a80c91e0 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action" status: 200 len: 32580 microversion: 2.1 time: 0.078852 Jan 15 21:02:27.450461 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2183/4399] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:02:27 2022] POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action => generated 32580 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:02:27.458251 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-59aef372-686d-4b1a-9b89-f28b63c7f277 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:27.459642 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-59aef372-686d-4b1a-9b89-f28b63c7f277 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] [instance: 3777fc27-6875-48e2-86e1-e87fe7a9e56c] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:27.476095 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-59aef372-686d-4b1a-9b89-f28b63c7f277 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:27.477101 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-59aef372-686d-4b1a-9b89-f28b63c7f277 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:27.478355 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-59aef372-686d-4b1a-9b89-f28b63c7f277 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:27.479151 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-59aef372-686d-4b1a-9b89-f28b63c7f277 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:27.660032 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-04473027-2480-4f4f-b62f-2c5eea9d19a7 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:27.675112 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-04473027-2480-4f4f-b62f-2c5eea9d19a7 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:27.676921 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-04473027-2480-4f4f-b62f-2c5eea9d19a7 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:27.678532 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-04473027-2480-4f4f-b62f-2c5eea9d19a7 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0" status: 200 len: 1721 microversion: 2.20 time: 0.402231 Jan 15 21:02:27.682340 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2217/4400] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:02:27 2022] GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0 => generated 1721 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:02:27.692737 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-26d0e2e3-6e15-4995-a280-406962c2d8e5 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:27.693713 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-26d0e2e3-6e15-4995-a280-406962c2d8e5 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:27.706454 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-26d0e2e3-6e15-4995-a280-406962c2d8e5 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:27.706914 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-26d0e2e3-6e15-4995-a280-406962c2d8e5 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:27.707723 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-26d0e2e3-6e15-4995-a280-406962c2d8e5 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:27.708161 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-26d0e2e3-6e15-4995-a280-406962c2d8e5 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:27.784645 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-59aef372-686d-4b1a-9b89-f28b63c7f277 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527f03c53ee54c99ba36a3b918c25597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356d7bd6c3e84b759875cc530b7d18c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:27.795803 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-26d0e2e3-6e15-4995-a280-406962c2d8e5 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.109988 Jan 15 21:02:27.797093 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2218/4401] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:02:27 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:02:27.807435 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-19fba589-23e9-427e-b85c-06207bf400fb tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:27.809101 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-19fba589-23e9-427e-b85c-06207bf400fb tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] [instance: 26f27adc-8567-4752-8a51-ee9c301b2611] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:27.809836 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-59aef372-686d-4b1a-9b89-f28b63c7f277 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '527f03c53ee54c99ba36a3b918c25597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356d7bd6c3e84b759875cc530b7d18c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:27.811350 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-59aef372-686d-4b1a-9b89-f28b63c7f277 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '527f03c53ee54c99ba36a3b918c25597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356d7bd6c3e84b759875cc530b7d18c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:27.812540 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-59aef372-686d-4b1a-9b89-f28b63c7f277 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] 10.222.0.46 "GET /compute/v2.1/servers/3777fc27-6875-48e2-86e1-e87fe7a9e56c" status: 200 len: 1551 microversion: 2.26 time: 0.360339 Jan 15 21:02:27.819498 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-19fba589-23e9-427e-b85c-06207bf400fb tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:27.820238 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-19fba589-23e9-427e-b85c-06207bf400fb tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:27.821230 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-19fba589-23e9-427e-b85c-06207bf400fb tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:27.825472 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2184/4402] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:02:27 2022] GET /compute/v2.1/servers/3777fc27-6875-48e2-86e1-e87fe7a9e56c => generated 1551 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:02:27.826471 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-19fba589-23e9-427e-b85c-06207bf400fb tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:27.835928 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e271ddf7-3681-45b7-bed4-d16f44550550 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:27.836872 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e271ddf7-3681-45b7-bed4-d16f44550550 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:27.858112 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e271ddf7-3681-45b7-bed4-d16f44550550 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:27.858606 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e271ddf7-3681-45b7-bed4-d16f44550550 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:27.860555 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e271ddf7-3681-45b7-bed4-d16f44550550 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:27.861126 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e271ddf7-3681-45b7-bed4-d16f44550550 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:27.961111 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e271ddf7-3681-45b7-bed4-d16f44550550 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.126109 Jan 15 21:02:27.961111 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2185/4403] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:02:27 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:02:27.978019 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-30dc6934-6ebe-4f8b-a2d7-eb7199f4d18d tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:27.979469 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-30dc6934-6ebe-4f8b-a2d7-eb7199f4d18d tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: d09ef93d-246f-464d-8c9c-f5a6fa14e4fe] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:28.001829 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-30dc6934-6ebe-4f8b-a2d7-eb7199f4d18d tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:28.002578 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-30dc6934-6ebe-4f8b-a2d7-eb7199f4d18d tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:28.003560 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-30dc6934-6ebe-4f8b-a2d7-eb7199f4d18d tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:28.004004 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-30dc6934-6ebe-4f8b-a2d7-eb7199f4d18d tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:28.049123 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-19fba589-23e9-427e-b85c-06207bf400fb tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e8f253bac41484ab8e92b74bfa54465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74165fadf5154c319ca56b4aa961e7b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:28.057974 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-19fba589-23e9-427e-b85c-06207bf400fb tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] 10.222.0.46 "GET /compute/v2.1/servers/26f27adc-8567-4752-8a51-ee9c301b2611" status: 200 len: 1323 microversion: 2.1 time: 0.257589 Jan 15 21:02:28.059012 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2219/4404] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:02:27 2022] GET /compute/v2.1/servers/26f27adc-8567-4752-8a51-ee9c301b2611 => generated 1323 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:02:28.173526 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-30dc6934-6ebe-4f8b-a2d7-eb7199f4d18d tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:28.181421 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-30dc6934-6ebe-4f8b-a2d7-eb7199f4d18d tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/d09ef93d-246f-464d-8c9c-f5a6fa14e4fe" status: 200 len: 1315 microversion: 2.1 time: 0.211097 Jan 15 21:02:28.182013 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2186/4405] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:02:27 2022] GET /compute/v2.1/servers/d09ef93d-246f-464d-8c9c-f5a6fa14e4fe => generated 1315 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:02:28.203437 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-bdcea1f4-0a90-4c8a-a940-04086f43e6ec req-d7eeb166-7c5a-4d56-8609-1f3bd255105d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3777fc27-6875-48e2-86e1-e87fe7a9e56c", "name": "network-vif-deleted", "tag": "5e114ab3-9fc7-4c3f-a6e3-d84796facc4f"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:28.205980 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:02:28.205980 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:02:28.214274 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-bdcea1f4-0a90-4c8a-a940-04086f43e6ec req-d7eeb166-7c5a-4d56-8609-1f3bd255105d service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:28.215026 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-bdcea1f4-0a90-4c8a-a940-04086f43e6ec req-d7eeb166-7c5a-4d56-8609-1f3bd255105d service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:28.226602 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-bdcea1f4-0a90-4c8a-a940-04086f43e6ec req-d7eeb166-7c5a-4d56-8609-1f3bd255105d service nova] Creating event network-vif-deleted:5e114ab3-9fc7-4c3f-a6e3-d84796facc4f for instance 3777fc27-6875-48e2-86e1-e87fe7a9e56c on nch2-master-1 Jan 15 21:02:28.233040 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-bdcea1f4-0a90-4c8a-a940-04086f43e6ec req-d7eeb166-7c5a-4d56-8609-1f3bd255105d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033096 Jan 15 21:02:28.233999 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2220/4406] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:02:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:02:28.461792 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-5f28161a-19b9-49fa-807b-2c3fb087e750 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:28.462906 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-5f28161a-19b9-49fa-807b-2c3fb087e750 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:28.470396 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5f28161a-19b9-49fa-807b-2c3fb087e750 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:28.470848 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5f28161a-19b9-49fa-807b-2c3fb087e750 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:28.471874 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5f28161a-19b9-49fa-807b-2c3fb087e750 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:28.472379 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5f28161a-19b9-49fa-807b-2c3fb087e750 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:28.517933 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-5f28161a-19b9-49fa-807b-2c3fb087e750 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action" status: 200 len: 32580 microversion: 2.1 time: 0.059873 Jan 15 21:02:28.518985 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2187/4407] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:02:28 2022] POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action => generated 32580 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:02:28.702626 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8b109f52-27fd-4efc-a1cb-ddd0e4161b81 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:28.704260 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-8b109f52-27fd-4efc-a1cb-ddd0e4161b81 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:28.714416 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8b109f52-27fd-4efc-a1cb-ddd0e4161b81 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:28.715048 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8b109f52-27fd-4efc-a1cb-ddd0e4161b81 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:28.716025 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8b109f52-27fd-4efc-a1cb-ddd0e4161b81 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:28.716616 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8b109f52-27fd-4efc-a1cb-ddd0e4161b81 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:28.809684 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-493e82cc-c9bc-4891-a8c0-e8719224f998 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:28.810891 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-493e82cc-c9bc-4891-a8c0-e8719224f998 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:28.818569 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-493e82cc-c9bc-4891-a8c0-e8719224f998 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:28.819307 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-493e82cc-c9bc-4891-a8c0-e8719224f998 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:28.820488 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-493e82cc-c9bc-4891-a8c0-e8719224f998 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:28.821137 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-493e82cc-c9bc-4891-a8c0-e8719224f998 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:28.910921 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-493e82cc-c9bc-4891-a8c0-e8719224f998 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.105485 Jan 15 21:02:28.912454 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2188/4408] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:02:28 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:02:28.915725 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-8b109f52-27fd-4efc-a1cb-ddd0e4161b81 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:28.924356 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-31b059c7-df46-4ddf-b10f-f83b3af95e78 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:28.925398 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-31b059c7-df46-4ddf-b10f-f83b3af95e78 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] [instance: 3777fc27-6875-48e2-86e1-e87fe7a9e56c] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:28.932428 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-8b109f52-27fd-4efc-a1cb-ddd0e4161b81 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:28.934282 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-8b109f52-27fd-4efc-a1cb-ddd0e4161b81 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:28.934629 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-31b059c7-df46-4ddf-b10f-f83b3af95e78 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:28.935238 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-31b059c7-df46-4ddf-b10f-f83b3af95e78 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:28.935778 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-8b109f52-27fd-4efc-a1cb-ddd0e4161b81 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0" status: 200 len: 1721 microversion: 2.20 time: 0.238430 Jan 15 21:02:28.936402 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-31b059c7-df46-4ddf-b10f-f83b3af95e78 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:28.937019 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-31b059c7-df46-4ddf-b10f-f83b3af95e78 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:28.947355 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2221/4409] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:02:28 2022] GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0 => generated 1721 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:02:28.967189 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-31b059c7-df46-4ddf-b10f-f83b3af95e78 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] HTTP exception thrown: Instance 3777fc27-6875-48e2-86e1-e87fe7a9e56c could not be found. Jan 15 21:02:28.967897 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-31b059c7-df46-4ddf-b10f-f83b3af95e78 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] Returning 404 to user: Instance 3777fc27-6875-48e2-86e1-e87fe7a9e56c could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:02:28.972725 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-31b059c7-df46-4ddf-b10f-f83b3af95e78 tempest-ServerTagsTestJSON-767994028 tempest-ServerTagsTestJSON-767994028-project] 10.222.0.46 "GET /compute/v2.1/servers/3777fc27-6875-48e2-86e1-e87fe7a9e56c" status: 404 len: 111 microversion: 2.26 time: 0.058796 Jan 15 21:02:28.977667 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2189/4410] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:02:28 2022] GET /compute/v2.1/servers/3777fc27-6875-48e2-86e1-e87fe7a9e56c => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 15 21:02:28.980707 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ba4f177f-d7e3-4139-8075-949cf3c2f4b9 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:28.982112 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ba4f177f-d7e3-4139-8075-949cf3c2f4b9 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:28.989423 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ba4f177f-d7e3-4139-8075-949cf3c2f4b9 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:28.990219 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ba4f177f-d7e3-4139-8075-949cf3c2f4b9 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:28.991406 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ba4f177f-d7e3-4139-8075-949cf3c2f4b9 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:28.993095 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ba4f177f-d7e3-4139-8075-949cf3c2f4b9 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:29.077464 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-143276a1-5fd4-4945-96a5-ea5bba89e0c4 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:29.078327 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-143276a1-5fd4-4945-96a5-ea5bba89e0c4 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] [instance: 26f27adc-8567-4752-8a51-ee9c301b2611] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:29.085003 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ba4f177f-d7e3-4139-8075-949cf3c2f4b9 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.114056 Jan 15 21:02:29.086399 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2222/4411] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:02:28 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:02:29.093300 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-143276a1-5fd4-4945-96a5-ea5bba89e0c4 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:29.095860 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-143276a1-5fd4-4945-96a5-ea5bba89e0c4 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:29.101433 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-143276a1-5fd4-4945-96a5-ea5bba89e0c4 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:29.102830 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-143276a1-5fd4-4945-96a5-ea5bba89e0c4 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:29.212476 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-1fa36978-70fe-4db7-bb6f-8c95b69d5229 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:29.213983 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-1fa36978-70fe-4db7-bb6f-8c95b69d5229 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: d09ef93d-246f-464d-8c9c-f5a6fa14e4fe] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:29.234387 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1fa36978-70fe-4db7-bb6f-8c95b69d5229 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:29.239261 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1fa36978-70fe-4db7-bb6f-8c95b69d5229 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:29.240311 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1fa36978-70fe-4db7-bb6f-8c95b69d5229 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:29.240955 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1fa36978-70fe-4db7-bb6f-8c95b69d5229 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:29.725224 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-143276a1-5fd4-4945-96a5-ea5bba89e0c4 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e8f253bac41484ab8e92b74bfa54465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74165fadf5154c319ca56b4aa961e7b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:29.731574 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-1fa36978-70fe-4db7-bb6f-8c95b69d5229 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:29.739991 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-1fa36978-70fe-4db7-bb6f-8c95b69d5229 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/d09ef93d-246f-464d-8c9c-f5a6fa14e4fe" status: 200 len: 1315 microversion: 2.1 time: 0.542709 Jan 15 21:02:29.743218 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2223/4412] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:02:29 2022] GET /compute/v2.1/servers/d09ef93d-246f-464d-8c9c-f5a6fa14e4fe => generated 1315 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:02:29.749270 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f2e3382d-d17d-438b-af3e-e9fcc51752c6 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:29.751260 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f2e3382d-d17d-438b-af3e-e9fcc51752c6 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:29.756132 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-143276a1-5fd4-4945-96a5-ea5bba89e0c4 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] 10.222.0.46 "GET /compute/v2.1/servers/26f27adc-8567-4752-8a51-ee9c301b2611" status: 200 len: 1323 microversion: 2.1 time: 0.683203 Jan 15 21:02:29.756929 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2190/4413] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:02:29 2022] GET /compute/v2.1/servers/26f27adc-8567-4752-8a51-ee9c301b2611 => generated 1323 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:02:29.766966 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f2e3382d-d17d-438b-af3e-e9fcc51752c6 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:29.767432 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f2e3382d-d17d-438b-af3e-e9fcc51752c6 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:29.768253 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f2e3382d-d17d-438b-af3e-e9fcc51752c6 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:29.768701 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f2e3382d-d17d-438b-af3e-e9fcc51752c6 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:29.829975 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f2e3382d-d17d-438b-af3e-e9fcc51752c6 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action" status: 200 len: 32580 microversion: 2.1 time: 0.083662 Jan 15 21:02:29.839567 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2224/4414] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:02:29 2022] POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action => generated 32580 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:02:29.937564 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-230557d3-8e18-4ec3-9af9-a6d2f8dac686 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:29.940486 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-230557d3-8e18-4ec3-9af9-a6d2f8dac686 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:29.963174 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a6e39010-978c-42d8-908e-d1e7b71f0133 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:29.965580 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a6e39010-978c-42d8-908e-d1e7b71f0133 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:29.966842 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-230557d3-8e18-4ec3-9af9-a6d2f8dac686 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:29.967521 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-230557d3-8e18-4ec3-9af9-a6d2f8dac686 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:29.973399 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-230557d3-8e18-4ec3-9af9-a6d2f8dac686 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:29.974074 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-230557d3-8e18-4ec3-9af9-a6d2f8dac686 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:29.986613 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a6e39010-978c-42d8-908e-d1e7b71f0133 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:29.987113 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a6e39010-978c-42d8-908e-d1e7b71f0133 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:29.987949 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a6e39010-978c-42d8-908e-d1e7b71f0133 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:29.988411 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a6e39010-978c-42d8-908e-d1e7b71f0133 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:30.055666 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-230557d3-8e18-4ec3-9af9-a6d2f8dac686 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.133065 Jan 15 21:02:30.058529 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2191/4415] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:02:29 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:02:30.099183 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-cdd4686b-d7b0-4e35-afbe-7239a4f245cc tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:30.100654 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-cdd4686b-d7b0-4e35-afbe-7239a4f245cc tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:30.111554 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cdd4686b-d7b0-4e35-afbe-7239a4f245cc tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:30.112124 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cdd4686b-d7b0-4e35-afbe-7239a4f245cc tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:30.114210 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cdd4686b-d7b0-4e35-afbe-7239a4f245cc tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:30.115733 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cdd4686b-d7b0-4e35-afbe-7239a4f245cc tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:30.180982 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-cdd4686b-d7b0-4e35-afbe-7239a4f245cc tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.087094 Jan 15 21:02:30.184808 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2192/4416] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:02:30 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:02:30.201827 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-a6e39010-978c-42d8-908e-d1e7b71f0133 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:30.212744 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-a6e39010-978c-42d8-908e-d1e7b71f0133 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:30.214985 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-a6e39010-978c-42d8-908e-d1e7b71f0133 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:30.216763 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a6e39010-978c-42d8-908e-d1e7b71f0133 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0" status: 200 len: 1742 microversion: 2.20 time: 0.264541 Jan 15 21:02:30.218944 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2225/4417] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:02:29 2022] GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0 => generated 1742 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 15 21:02:30.760640 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0553b5e1-65e2-4420-bfe5-ddb30be3d39b tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:30.761570 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-0553b5e1-65e2-4420-bfe5-ddb30be3d39b tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: d09ef93d-246f-464d-8c9c-f5a6fa14e4fe] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:30.773362 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-1d403817-ee5e-4f05-915b-13361bb4062f tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:30.774327 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-1d403817-ee5e-4f05-915b-13361bb4062f tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] [instance: 26f27adc-8567-4752-8a51-ee9c301b2611] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:30.780087 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0553b5e1-65e2-4420-bfe5-ddb30be3d39b tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:30.780753 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0553b5e1-65e2-4420-bfe5-ddb30be3d39b tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:30.782498 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0553b5e1-65e2-4420-bfe5-ddb30be3d39b tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:30.783427 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0553b5e1-65e2-4420-bfe5-ddb30be3d39b tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:30.785344 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1d403817-ee5e-4f05-915b-13361bb4062f tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:30.785817 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1d403817-ee5e-4f05-915b-13361bb4062f tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:30.786633 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1d403817-ee5e-4f05-915b-13361bb4062f tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:30.787081 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1d403817-ee5e-4f05-915b-13361bb4062f tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:31.086325 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-0553b5e1-65e2-4420-bfe5-ddb30be3d39b tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:31.100591 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-1d403817-ee5e-4f05-915b-13361bb4062f tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e8f253bac41484ab8e92b74bfa54465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74165fadf5154c319ca56b4aa961e7b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:31.110351 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-1d403817-ee5e-4f05-915b-13361bb4062f tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] 10.222.0.46 "GET /compute/v2.1/servers/26f27adc-8567-4752-8a51-ee9c301b2611" status: 200 len: 1323 microversion: 2.1 time: 0.341551 Jan 15 21:02:31.110997 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2226/4418] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:02:30 2022] GET /compute/v2.1/servers/26f27adc-8567-4752-8a51-ee9c301b2611 => generated 1323 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:02:31.113402 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0553b5e1-65e2-4420-bfe5-ddb30be3d39b tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/d09ef93d-246f-464d-8c9c-f5a6fa14e4fe" status: 200 len: 1315 microversion: 2.1 time: 0.351000 Jan 15 21:02:31.126096 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2193/4419] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:02:30 2022] GET /compute/v2.1/servers/d09ef93d-246f-464d-8c9c-f5a6fa14e4fe => generated 1315 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:02:31.137968 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ac106433-d4ec-415b-8e4f-323df0892d8b tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:31.142829 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-466309ed-6e18-4b2c-a1a5-096c95096792 req-f311a425-a4f6-4fd9-be8c-d79269a35570 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26f27adc-8567-4752-8a51-ee9c301b2611", "name": "network-vif-plugged", "status": "completed", "tag": "99af8280-f44b-4d03-aa1f-f1d9da00f1e9"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:31.144575 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:02:31.144575 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:02:31.145782 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ac106433-d4ec-415b-8e4f-323df0892d8b tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:31.158826 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ac106433-d4ec-415b-8e4f-323df0892d8b tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:31.159294 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ac106433-d4ec-415b-8e4f-323df0892d8b tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:31.160156 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ac106433-d4ec-415b-8e4f-323df0892d8b tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:31.160621 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ac106433-d4ec-415b-8e4f-323df0892d8b tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:31.165920 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-466309ed-6e18-4b2c-a1a5-096c95096792 req-f311a425-a4f6-4fd9-be8c-d79269a35570 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:31.166509 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-466309ed-6e18-4b2c-a1a5-096c95096792 req-f311a425-a4f6-4fd9-be8c-d79269a35570 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:31.194207 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-466309ed-6e18-4b2c-a1a5-096c95096792 req-f311a425-a4f6-4fd9-be8c-d79269a35570 service nova] Creating event network-vif-plugged:99af8280-f44b-4d03-aa1f-f1d9da00f1e9 for instance 26f27adc-8567-4752-8a51-ee9c301b2611 on nch2-master-1 Jan 15 21:02:31.202134 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-466309ed-6e18-4b2c-a1a5-096c95096792 req-f311a425-a4f6-4fd9-be8c-d79269a35570 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074311 Jan 15 21:02:31.203278 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2194/4420] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:02:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:02:31.209673 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-de02e49b-137e-47d9-8b5b-e1f06ddc05db tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:31.211014 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-de02e49b-137e-47d9-8b5b-e1f06ddc05db tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:31.218402 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-de02e49b-137e-47d9-8b5b-e1f06ddc05db tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:31.219110 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-de02e49b-137e-47d9-8b5b-e1f06ddc05db tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:31.220073 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-de02e49b-137e-47d9-8b5b-e1f06ddc05db tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:31.220674 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-de02e49b-137e-47d9-8b5b-e1f06ddc05db tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:31.249702 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ac106433-d4ec-415b-8e4f-323df0892d8b tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action" status: 200 len: 32580 microversion: 2.1 time: 0.135795 Jan 15 21:02:31.251582 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2227/4421] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:02:31 2022] POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action => generated 32580 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:02:31.282892 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-586de29f-1e6d-4999-8745-04605b3f73ee tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:31.285649 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-586de29f-1e6d-4999-8745-04605b3f73ee tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:31.297073 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-586de29f-1e6d-4999-8745-04605b3f73ee tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:31.298501 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-586de29f-1e6d-4999-8745-04605b3f73ee tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:31.299272 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-586de29f-1e6d-4999-8745-04605b3f73ee tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:31.299620 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-de02e49b-137e-47d9-8b5b-e1f06ddc05db tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.094233 Jan 15 21:02:31.300564 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-586de29f-1e6d-4999-8745-04605b3f73ee tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:31.300781 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2195/4422] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:02:31 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:02:31.307882 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ece8e08d-4dc0-47c8-9a58-1a4b4640ee35 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:31.308621 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ece8e08d-4dc0-47c8-9a58-1a4b4640ee35 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:31.318645 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ece8e08d-4dc0-47c8-9a58-1a4b4640ee35 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:31.319442 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ece8e08d-4dc0-47c8-9a58-1a4b4640ee35 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:31.321166 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ece8e08d-4dc0-47c8-9a58-1a4b4640ee35 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:31.324243 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ece8e08d-4dc0-47c8-9a58-1a4b4640ee35 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:31.403503 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-586de29f-1e6d-4999-8745-04605b3f73ee tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.148970 Jan 15 21:02:31.404459 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2228/4423] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:02:31 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:02:31.611864 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-ece8e08d-4dc0-47c8-9a58-1a4b4640ee35 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:31.621745 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-ece8e08d-4dc0-47c8-9a58-1a4b4640ee35 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:31.624033 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-ece8e08d-4dc0-47c8-9a58-1a4b4640ee35 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:31.625881 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ece8e08d-4dc0-47c8-9a58-1a4b4640ee35 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0" status: 200 len: 1742 microversion: 2.20 time: 0.323583 Jan 15 21:02:31.627155 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2196/4424] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:02:31 2022] GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0 => generated 1742 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:02:32.128603 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e84c6f98-e5d3-4364-88a5-690c118cf630 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:32.130029 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e84c6f98-e5d3-4364-88a5-690c118cf630 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] [instance: 26f27adc-8567-4752-8a51-ee9c301b2611] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:32.137022 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-442c4e4e-0482-49e5-a5b7-318efbc1104c tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:32.137658 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-442c4e4e-0482-49e5-a5b7-318efbc1104c tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: d09ef93d-246f-464d-8c9c-f5a6fa14e4fe] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:32.158609 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-442c4e4e-0482-49e5-a5b7-318efbc1104c tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:32.162955 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-442c4e4e-0482-49e5-a5b7-318efbc1104c tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:32.164036 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-442c4e4e-0482-49e5-a5b7-318efbc1104c tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:32.169888 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-442c4e4e-0482-49e5-a5b7-318efbc1104c tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:32.172146 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e84c6f98-e5d3-4364-88a5-690c118cf630 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:32.175970 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e84c6f98-e5d3-4364-88a5-690c118cf630 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:32.176873 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e84c6f98-e5d3-4364-88a5-690c118cf630 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:32.177312 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e84c6f98-e5d3-4364-88a5-690c118cf630 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:32.641091 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-442c4e4e-0482-49e5-a5b7-318efbc1104c tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:32.677751 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-442c4e4e-0482-49e5-a5b7-318efbc1104c tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/d09ef93d-246f-464d-8c9c-f5a6fa14e4fe" status: 200 len: 1315 microversion: 2.1 time: 0.544338 Jan 15 21:02:32.679746 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2197/4425] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:02:32 2022] GET /compute/v2.1/servers/d09ef93d-246f-464d-8c9c-f5a6fa14e4fe => generated 1315 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:02:32.700053 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-e84c6f98-e5d3-4364-88a5-690c118cf630 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e8f253bac41484ab8e92b74bfa54465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74165fadf5154c319ca56b4aa961e7b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:32.712276 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-2ba91c5e-f72b-4b12-9fc8-7536a5d0918e tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:32.714682 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-2ba91c5e-f72b-4b12-9fc8-7536a5d0918e tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:32.718075 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e84c6f98-e5d3-4364-88a5-690c118cf630 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] 10.222.0.46 "GET /compute/v2.1/servers/26f27adc-8567-4752-8a51-ee9c301b2611" status: 200 len: 1323 microversion: 2.1 time: 0.594111 Jan 15 21:02:32.718666 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2229/4426] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:02:32 2022] GET /compute/v2.1/servers/26f27adc-8567-4752-8a51-ee9c301b2611 => generated 1323 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:02:32.729537 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-7d598fae-5522-435d-8625-c2e8ee306120 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:32.731499 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2ba91c5e-f72b-4b12-9fc8-7536a5d0918e tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:32.732130 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2ba91c5e-f72b-4b12-9fc8-7536a5d0918e tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:32.733819 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2ba91c5e-f72b-4b12-9fc8-7536a5d0918e tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:32.734370 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-7d598fae-5522-435d-8625-c2e8ee306120 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:32.736915 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2ba91c5e-f72b-4b12-9fc8-7536a5d0918e tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:32.772668 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7d598fae-5522-435d-8625-c2e8ee306120 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:32.773426 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7d598fae-5522-435d-8625-c2e8ee306120 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:32.775374 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7d598fae-5522-435d-8625-c2e8ee306120 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:32.781237 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7d598fae-5522-435d-8625-c2e8ee306120 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:32.858459 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-2ba91c5e-f72b-4b12-9fc8-7536a5d0918e tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action" status: 200 len: 32580 microversion: 2.1 time: 0.177073 Jan 15 21:02:32.860272 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2198/4427] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:02:32 2022] POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action => generated 32580 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:02:32.868984 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-85721a81-2f03-4385-a9fa-f859f7ffb6a4 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:32.870418 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-85721a81-2f03-4385-a9fa-f859f7ffb6a4 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:32.878764 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-7d598fae-5522-435d-8625-c2e8ee306120 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.156355 Jan 15 21:02:32.880474 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-85721a81-2f03-4385-a9fa-f859f7ffb6a4 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:32.888295 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2230/4428] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:02:32 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:02:32.893217 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-85721a81-2f03-4385-a9fa-f859f7ffb6a4 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:32.894611 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-85721a81-2f03-4385-a9fa-f859f7ffb6a4 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:32.895286 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-85721a81-2f03-4385-a9fa-f859f7ffb6a4 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:32.901501 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-17254b2e-cb0f-454f-972c-d32e6406fe99 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:32.902238 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-17254b2e-cb0f-454f-972c-d32e6406fe99 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:32.916920 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-17254b2e-cb0f-454f-972c-d32e6406fe99 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:32.917378 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-17254b2e-cb0f-454f-972c-d32e6406fe99 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:32.925228 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-17254b2e-cb0f-454f-972c-d32e6406fe99 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:32.925706 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-17254b2e-cb0f-454f-972c-d32e6406fe99 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:32.968091 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-85721a81-2f03-4385-a9fa-f859f7ffb6a4 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.105679 Jan 15 21:02:32.969969 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2199/4429] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:02:32 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:02:33.137760 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-17254b2e-cb0f-454f-972c-d32e6406fe99 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:33.147329 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-17254b2e-cb0f-454f-972c-d32e6406fe99 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:33.148897 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-17254b2e-cb0f-454f-972c-d32e6406fe99 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:33.151052 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-17254b2e-cb0f-454f-972c-d32e6406fe99 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0" status: 200 len: 1737 microversion: 2.20 time: 0.261518 Jan 15 21:02:33.152806 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2231/4430] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:02:32 2022] GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0 => generated 1737 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:02:33.636569 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-e0ad985a-19ed-4d81-8a97-ca2e16e0c577 req-39b57250-efa7-4dd0-b89f-2db2a01893bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ac722a3-aadf-4791-b5b1-e5e5efebddc0", "name": "network-vif-plugged", "status": "completed", "tag": "6d958b2a-aaab-40bf-8bb7-ce4cd3fc57b5"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:33.638794 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:02:33.638794 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:02:33.670485 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-e0ad985a-19ed-4d81-8a97-ca2e16e0c577 req-39b57250-efa7-4dd0-b89f-2db2a01893bc service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:33.678651 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-e0ad985a-19ed-4d81-8a97-ca2e16e0c577 req-39b57250-efa7-4dd0-b89f-2db2a01893bc service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:33.697253 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-12c1d09d-4259-4b48-bdbc-77dc394f3b4a tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:33.697884 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-12c1d09d-4259-4b48-bdbc-77dc394f3b4a tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: d09ef93d-246f-464d-8c9c-f5a6fa14e4fe] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:33.721814 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-12c1d09d-4259-4b48-bdbc-77dc394f3b4a tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:33.727631 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-12c1d09d-4259-4b48-bdbc-77dc394f3b4a tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:33.728744 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-12c1d09d-4259-4b48-bdbc-77dc394f3b4a tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:33.729429 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-12c1d09d-4259-4b48-bdbc-77dc394f3b4a tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:33.739422 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-e0ad985a-19ed-4d81-8a97-ca2e16e0c577 req-39b57250-efa7-4dd0-b89f-2db2a01893bc service nova] Creating event network-vif-plugged:6d958b2a-aaab-40bf-8bb7-ce4cd3fc57b5 for instance 0ac722a3-aadf-4791-b5b1-e5e5efebddc0 on nch1-master-1 Jan 15 21:02:33.756426 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-e0ad985a-19ed-4d81-8a97-ca2e16e0c577 req-39b57250-efa7-4dd0-b89f-2db2a01893bc service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124615 Jan 15 21:02:33.759392 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2200/4431] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:02:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:02:33.770783 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-443d8876-c303-4a4a-b014-d2fc706e3567 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:33.776271 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-443d8876-c303-4a4a-b014-d2fc706e3567 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] [instance: 26f27adc-8567-4752-8a51-ee9c301b2611] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:33.789990 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-443d8876-c303-4a4a-b014-d2fc706e3567 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:33.795384 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-443d8876-c303-4a4a-b014-d2fc706e3567 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:33.796439 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-443d8876-c303-4a4a-b014-d2fc706e3567 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:33.797856 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-443d8876-c303-4a4a-b014-d2fc706e3567 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:34.123578 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-12c1d09d-4259-4b48-bdbc-77dc394f3b4a tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:34.133031 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-12c1d09d-4259-4b48-bdbc-77dc394f3b4a tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/d09ef93d-246f-464d-8c9c-f5a6fa14e4fe" status: 200 len: 1315 microversion: 2.1 time: 0.440230 Jan 15 21:02:34.142710 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2232/4432] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:02:33 2022] GET /compute/v2.1/servers/d09ef93d-246f-464d-8c9c-f5a6fa14e4fe => generated 1315 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:02:34.166315 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a6813d2f-42c1-4f4b-a681-96e779d56433 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:34.169752 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a6813d2f-42c1-4f4b-a681-96e779d56433 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:34.196403 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a6813d2f-42c1-4f4b-a681-96e779d56433 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:34.196884 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a6813d2f-42c1-4f4b-a681-96e779d56433 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:34.197673 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a6813d2f-42c1-4f4b-a681-96e779d56433 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:34.198103 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a6813d2f-42c1-4f4b-a681-96e779d56433 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:34.208410 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-443d8876-c303-4a4a-b014-d2fc706e3567 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e8f253bac41484ab8e92b74bfa54465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74165fadf5154c319ca56b4aa961e7b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:34.224869 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-443d8876-c303-4a4a-b014-d2fc706e3567 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] 10.222.0.46 "GET /compute/v2.1/servers/26f27adc-8567-4752-8a51-ee9c301b2611" status: 200 len: 1517 microversion: 2.1 time: 0.462784 Jan 15 21:02:34.226872 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2201/4433] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:02:33 2022] GET /compute/v2.1/servers/26f27adc-8567-4752-8a51-ee9c301b2611 => generated 1517 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:02:34.234479 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-28b99342-9e76-42b9-aecc-6a6357f2ee7d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:34.236053 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-28b99342-9e76-42b9-aecc-6a6357f2ee7d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:34.246227 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-28b99342-9e76-42b9-aecc-6a6357f2ee7d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:34.246227 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-28b99342-9e76-42b9-aecc-6a6357f2ee7d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:34.247253 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-28b99342-9e76-42b9-aecc-6a6357f2ee7d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:34.247815 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-28b99342-9e76-42b9-aecc-6a6357f2ee7d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:34.309723 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a6813d2f-42c1-4f4b-a681-96e779d56433 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action" status: 200 len: 32580 microversion: 2.1 time: 0.166501 Jan 15 21:02:34.311724 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2233/4434] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:02:34 2022] POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action => generated 32580 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:02:34.331776 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-eadde37b-3854-4122-b928-18aa7532701f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:34.335208 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-eadde37b-3854-4122-b928-18aa7532701f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:34.359644 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-eadde37b-3854-4122-b928-18aa7532701f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:34.360153 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-eadde37b-3854-4122-b928-18aa7532701f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:34.361364 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-eadde37b-3854-4122-b928-18aa7532701f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:34.364452 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-eadde37b-3854-4122-b928-18aa7532701f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:34.388257 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-28b99342-9e76-42b9-aecc-6a6357f2ee7d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.159812 Jan 15 21:02:34.389468 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2202/4435] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:02:34 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:02:34.401070 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f9a8d790-bc04-4c53-b913-3568649b4868 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:34.401827 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f9a8d790-bc04-4c53-b913-3568649b4868 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:34.415150 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f9a8d790-bc04-4c53-b913-3568649b4868 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:34.415916 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f9a8d790-bc04-4c53-b913-3568649b4868 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:34.416916 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f9a8d790-bc04-4c53-b913-3568649b4868 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:34.421755 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f9a8d790-bc04-4c53-b913-3568649b4868 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:34.445005 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-eadde37b-3854-4122-b928-18aa7532701f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.125703 Jan 15 21:02:34.449525 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2234/4436] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:02:34 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:02:34.717209 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-f9a8d790-bc04-4c53-b913-3568649b4868 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:34.737090 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-f9a8d790-bc04-4c53-b913-3568649b4868 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:34.741258 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-f9a8d790-bc04-4c53-b913-3568649b4868 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:34.742833 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f9a8d790-bc04-4c53-b913-3568649b4868 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0" status: 200 len: 1737 microversion: 2.20 time: 0.352274 Jan 15 21:02:34.744106 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2203/4437] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:02:34 2022] GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0 => generated 1737 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:02:34.749961 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e0571431-764b-4c30-b06a-6f04c60a9f0b tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:34.751326 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-cf59ba88-c4eb-4801-ba4c-7e52a002ac29 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-245548171", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "networks": [{"uuid": "0b7cce2c-2308-43f4-b72e-8ea5d98a7ae1"}]}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:34.752362 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e0571431-764b-4c30-b06a-6f04c60a9f0b tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] [instance: 26f27adc-8567-4752-8a51-ee9c301b2611] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:34.759682 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e0571431-764b-4c30-b06a-6f04c60a9f0b tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:34.760513 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e0571431-764b-4c30-b06a-6f04c60a9f0b tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:34.761924 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e0571431-764b-4c30-b06a-6f04c60a9f0b tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:34.762764 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e0571431-764b-4c30-b06a-6f04c60a9f0b tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:34.794975 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.objects.instance [None req-e0571431-764b-4c30-b06a-6f04c60a9f0b tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lazy-loading 'flavor' on Instance uuid 26f27adc-8567-4752-8a51-ee9c301b2611 {{(pid=129366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 21:02:34.846610 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.network.neutron [None req-cf59ba88-c4eb-4801-ba4c-7e52a002ac29 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] validate_networks() for [('0b7cce2c-2308-43f4-b72e-8ea5d98a7ae1', None, None, None, None, None)] {{(pid=129365) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 21:02:34.931731 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e0571431-764b-4c30-b06a-6f04c60a9f0b tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] 10.222.0.46 "POST /compute/v2.1/servers/26f27adc-8567-4752-8a51-ee9c301b2611/action" status: 200 len: 32 microversion: 2.1 time: 0.184501 Jan 15 21:02:34.932667 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2204/4438] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:02:34 2022] POST /compute/v2.1/servers/26f27adc-8567-4752-8a51-ee9c301b2611/action => generated 32 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 21:02:34.978812 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-669675fc-b02e-477e-9284-8fa726b59237 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:34.980348 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-669675fc-b02e-477e-9284-8fa726b59237 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] [instance: 26f27adc-8567-4752-8a51-ee9c301b2611] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:34.997925 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-669675fc-b02e-477e-9284-8fa726b59237 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:34.998376 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-669675fc-b02e-477e-9284-8fa726b59237 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:35.001979 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-669675fc-b02e-477e-9284-8fa726b59237 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:35.002499 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-669675fc-b02e-477e-9284-8fa726b59237 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:35.434982 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-669675fc-b02e-477e-9284-8fa726b59237 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e8f253bac41484ab8e92b74bfa54465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74165fadf5154c319ca56b4aa961e7b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:35.460555 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-669675fc-b02e-477e-9284-8fa726b59237 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] 10.222.0.46 "GET /compute/v2.1/servers/26f27adc-8567-4752-8a51-ee9c301b2611" status: 200 len: 1523 microversion: 2.1 time: 0.508756 Jan 15 21:02:35.462077 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2205/4439] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:02:34 2022] GET /compute/v2.1/servers/26f27adc-8567-4752-8a51-ee9c301b2611 => generated 1523 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:02:35.468933 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-bf85c75d-de14-4dde-8536-6709c87d2b7e tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:35.471167 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-bf85c75d-de14-4dde-8536-6709c87d2b7e tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: d09ef93d-246f-464d-8c9c-f5a6fa14e4fe] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:35.481246 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bf85c75d-de14-4dde-8536-6709c87d2b7e tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:35.482107 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bf85c75d-de14-4dde-8536-6709c87d2b7e tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:35.483742 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bf85c75d-de14-4dde-8536-6709c87d2b7e tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:35.485256 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bf85c75d-de14-4dde-8536-6709c87d2b7e tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:35.771061 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-cf59ba88-c4eb-4801-ba4c-7e52a002ac29 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Flavor limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 21:02:35.771585 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-cf59ba88-c4eb-4801-ba4c-7e52a002ac29 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Image limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 21:02:35.771940 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-cf59ba88-c4eb-4801-ba4c-7e52a002ac29 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Flavor pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 21:02:35.772714 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-cf59ba88-c4eb-4801-ba4c-7e52a002ac29 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Image pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 21:02:35.773860 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-cf59ba88-c4eb-4801-ba4c-7e52a002ac29 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 21:02:35.818667 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cf59ba88-c4eb-4801-ba4c-7e52a002ac29 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:35.819894 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cf59ba88-c4eb-4801-ba4c-7e52a002ac29 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:35.821061 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cf59ba88-c4eb-4801-ba4c-7e52a002ac29 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:35.821688 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cf59ba88-c4eb-4801-ba4c-7e52a002ac29 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:35.869251 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-cf59ba88-c4eb-4801-ba4c-7e52a002ac29 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Getting quotas for project d31af2a6b9424f168dd6084d8d5fd0c4. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:02:35.883876 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-cf59ba88-c4eb-4801-ba4c-7e52a002ac29 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Getting quotas for user 9eb3421bc9494914bc5f797b15a55643 and project d31af2a6b9424f168dd6084d8d5fd0c4. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:02:35.918735 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-cf59ba88-c4eb-4801-ba4c-7e52a002ac29 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Going to run 1 instances... {{(pid=129365) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 21:02:35.924392 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-cf59ba88-c4eb-4801-ba4c-7e52a002ac29 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: 9888e0ee-9a2f-4547-a6e3-c77d3493c63f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129365) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 21:02:35.940314 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-bf85c75d-de14-4dde-8536-6709c87d2b7e tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:35.948705 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-bf85c75d-de14-4dde-8536-6709c87d2b7e tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/d09ef93d-246f-464d-8c9c-f5a6fa14e4fe" status: 200 len: 1315 microversion: 2.1 time: 0.484768 Jan 15 21:02:35.954314 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2206/4440] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:02:35 2022] GET /compute/v2.1/servers/d09ef93d-246f-464d-8c9c-f5a6fa14e4fe => generated 1315 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:02:35.970628 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a6d2545a-fb43-48cb-96a2-ba8459c59622 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:35.971974 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a6d2545a-fb43-48cb-96a2-ba8459c59622 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:35.994560 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a6d2545a-fb43-48cb-96a2-ba8459c59622 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:35.998155 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a6d2545a-fb43-48cb-96a2-ba8459c59622 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:36.001304 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a6d2545a-fb43-48cb-96a2-ba8459c59622 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:36.002161 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a6d2545a-fb43-48cb-96a2-ba8459c59622 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:36.019924 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-cf59ba88-c4eb-4801-ba4c-7e52a002ac29 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.566965 Jan 15 21:02:36.030314 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2235/4441] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 21:02:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1580 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 21:02:36.065961 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-6ee8b9b0-1ab9-4915-986f-13207dd12f16 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:36.068271 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-6ee8b9b0-1ab9-4915-986f-13207dd12f16 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:36.076504 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6ee8b9b0-1ab9-4915-986f-13207dd12f16 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:36.077207 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6ee8b9b0-1ab9-4915-986f-13207dd12f16 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:36.079271 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6ee8b9b0-1ab9-4915-986f-13207dd12f16 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:36.079925 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6ee8b9b0-1ab9-4915-986f-13207dd12f16 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:36.104791 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a6d2545a-fb43-48cb-96a2-ba8459c59622 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action" status: 200 len: 32580 microversion: 2.1 time: 0.147599 Jan 15 21:02:36.110225 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2207/4442] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:02:35 2022] POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action => generated 32580 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:02:36.130754 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-3dac27af-b9ea-4355-bb89-a7d5fd91f565 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:36.134006 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-3dac27af-b9ea-4355-bb89-a7d5fd91f565 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:36.158781 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3dac27af-b9ea-4355-bb89-a7d5fd91f565 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:36.159269 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3dac27af-b9ea-4355-bb89-a7d5fd91f565 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:36.160288 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3dac27af-b9ea-4355-bb89-a7d5fd91f565 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:36.162667 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3dac27af-b9ea-4355-bb89-a7d5fd91f565 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:36.172584 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-6ee8b9b0-1ab9-4915-986f-13207dd12f16 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.140167 Jan 15 21:02:36.178560 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2236/4443] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:02:36 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:02:36.184280 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-7348d1c1-3b74-4ad3-93ab-bbded019e99e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:36.190391 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-7348d1c1-3b74-4ad3-93ab-bbded019e99e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:36.210109 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7348d1c1-3b74-4ad3-93ab-bbded019e99e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:36.212567 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7348d1c1-3b74-4ad3-93ab-bbded019e99e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:36.214160 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7348d1c1-3b74-4ad3-93ab-bbded019e99e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:36.227210 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7348d1c1-3b74-4ad3-93ab-bbded019e99e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:36.262397 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-3dac27af-b9ea-4355-bb89-a7d5fd91f565 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.148276 Jan 15 21:02:36.268635 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2208/4444] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:02:36 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:02:36.277850 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-cf0458cb-ab4d-4450-aaa4-3ef7ac9745c0 req-f8d531a5-c486-4470-ad97-a9f05988eef8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d09ef93d-246f-464d-8c9c-f5a6fa14e4fe", "name": "network-vif-plugged", "status": "completed", "tag": "b02e61ea-6381-4f71-974b-68f69a1343f7"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:36.284370 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:02:36.284370 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:02:36.296376 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-cf0458cb-ab4d-4450-aaa4-3ef7ac9745c0 req-f8d531a5-c486-4470-ad97-a9f05988eef8 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:36.299903 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-cf0458cb-ab4d-4450-aaa4-3ef7ac9745c0 req-f8d531a5-c486-4470-ad97-a9f05988eef8 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:36.351791 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-cf0458cb-ab4d-4450-aaa4-3ef7ac9745c0 req-f8d531a5-c486-4470-ad97-a9f05988eef8 service nova] Creating event network-vif-plugged:b02e61ea-6381-4f71-974b-68f69a1343f7 for instance d09ef93d-246f-464d-8c9c-f5a6fa14e4fe on nch1-master-1 Jan 15 21:02:36.377734 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-cf0458cb-ab4d-4450-aaa4-3ef7ac9745c0 req-f8d531a5-c486-4470-ad97-a9f05988eef8 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112276 Jan 15 21:02:36.378459 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2209/4445] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:02:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:02:36.410692 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-2ac74f02-84a7-4e14-a43c-84d232c41610 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:36.425463 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-2ac74f02-84a7-4e14-a43c-84d232c41610 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: 9888e0ee-9a2f-4547-a6e3-c77d3493c63f] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:36.611781 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-2ac74f02-84a7-4e14-a43c-84d232c41610 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb3421bc9494914bc5f797b15a55643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31af2a6b9424f168dd6084d8d5fd0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:36.620927 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-2ac74f02-84a7-4e14-a43c-84d232c41610 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/9888e0ee-9a2f-4547-a6e3-c77d3493c63f" status: 200 len: 1192 microversion: 2.1 time: 0.239159 Jan 15 21:02:36.631926 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2210/4446] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:02:36 2022] GET /compute/v2.1/servers/9888e0ee-9a2f-4547-a6e3-c77d3493c63f => generated 1192 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:02:36.636966 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f6082872-9c1c-4be5-83d3-58f177abee8c tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:36.645435 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f6082872-9c1c-4be5-83d3-58f177abee8c tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] [instance: 26f27adc-8567-4752-8a51-ee9c301b2611] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:36.696132 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f6082872-9c1c-4be5-83d3-58f177abee8c tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:36.696693 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f6082872-9c1c-4be5-83d3-58f177abee8c tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:36.704888 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f6082872-9c1c-4be5-83d3-58f177abee8c tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:36.705275 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f6082872-9c1c-4be5-83d3-58f177abee8c tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:36.744629 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-7348d1c1-3b74-4ad3-93ab-bbded019e99e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:36.756917 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-7348d1c1-3b74-4ad3-93ab-bbded019e99e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:36.759254 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-7348d1c1-3b74-4ad3-93ab-bbded019e99e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:36.761367 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-7348d1c1-3b74-4ad3-93ab-bbded019e99e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0" status: 200 len: 1737 microversion: 2.20 time: 0.581182 Jan 15 21:02:36.763075 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2237/4447] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:02:36 2022] GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0 => generated 1737 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:02:36.966915 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-0303ac36-53af-4220-81ca-6c45adb3b47e tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:36.973087 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-0303ac36-53af-4220-81ca-6c45adb3b47e tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: d09ef93d-246f-464d-8c9c-f5a6fa14e4fe] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:36.992214 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0303ac36-53af-4220-81ca-6c45adb3b47e tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:36.994208 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-f6082872-9c1c-4be5-83d3-58f177abee8c tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e8f253bac41484ab8e92b74bfa54465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74165fadf5154c319ca56b4aa961e7b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:37.000981 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0303ac36-53af-4220-81ca-6c45adb3b47e tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:37.002120 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0303ac36-53af-4220-81ca-6c45adb3b47e tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:37.003816 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f6082872-9c1c-4be5-83d3-58f177abee8c tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] 10.222.0.46 "GET /compute/v2.1/servers/26f27adc-8567-4752-8a51-ee9c301b2611" status: 200 len: 1523 microversion: 2.1 time: 0.379983 Jan 15 21:02:37.006542 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2211/4448] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:02:36 2022] GET /compute/v2.1/servers/26f27adc-8567-4752-8a51-ee9c301b2611 => generated 1523 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:02:37.007519 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0303ac36-53af-4220-81ca-6c45adb3b47e tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:37.117734 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-2d906924-6275-49ce-8b51-72d42143ff6f tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:37.118925 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-2d906924-6275-49ce-8b51-72d42143ff6f tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:37.132124 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2d906924-6275-49ce-8b51-72d42143ff6f tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:37.137668 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2d906924-6275-49ce-8b51-72d42143ff6f tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:37.143646 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2d906924-6275-49ce-8b51-72d42143ff6f tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:37.144954 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2d906924-6275-49ce-8b51-72d42143ff6f tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:37.289295 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-2d906924-6275-49ce-8b51-72d42143ff6f tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action" status: 200 len: 32580 microversion: 2.1 time: 0.174556 Jan 15 21:02:37.294512 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2212/4449] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:02:37 2022] POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action => generated 32580 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:02:37.307480 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-59fc6143-0156-4925-8e9a-eacb5ec4d84c tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:37.315872 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-59fc6143-0156-4925-8e9a-eacb5ec4d84c tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:37.333973 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-59fc6143-0156-4925-8e9a-eacb5ec4d84c tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:37.334829 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-59fc6143-0156-4925-8e9a-eacb5ec4d84c tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:37.335907 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-59fc6143-0156-4925-8e9a-eacb5ec4d84c tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:37.338020 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-59fc6143-0156-4925-8e9a-eacb5ec4d84c tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:37.480049 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-59fc6143-0156-4925-8e9a-eacb5ec4d84c tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.185899 Jan 15 21:02:37.480677 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2213/4450] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:02:37 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:02:37.501665 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4b6e1778-b3a4-4999-a34c-d3bfc84435b2 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:37.502841 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-4b6e1778-b3a4-4999-a34c-d3bfc84435b2 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:37.511708 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4b6e1778-b3a4-4999-a34c-d3bfc84435b2 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:37.512170 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4b6e1778-b3a4-4999-a34c-d3bfc84435b2 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:37.513869 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4b6e1778-b3a4-4999-a34c-d3bfc84435b2 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:37.514316 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4b6e1778-b3a4-4999-a34c-d3bfc84435b2 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:37.573935 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-4b6e1778-b3a4-4999-a34c-d3bfc84435b2 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.087703 Jan 15 21:02:37.575154 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2214/4451] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:02:37 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:02:37.658311 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e0144e1d-4188-4461-b777-b107f7a99604 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:37.659019 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e0144e1d-4188-4461-b777-b107f7a99604 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: 9888e0ee-9a2f-4547-a6e3-c77d3493c63f] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:37.666385 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e0144e1d-4188-4461-b777-b107f7a99604 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:37.666885 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e0144e1d-4188-4461-b777-b107f7a99604 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:37.667690 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e0144e1d-4188-4461-b777-b107f7a99604 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:37.668866 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e0144e1d-4188-4461-b777-b107f7a99604 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:37.828097 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-e0144e1d-4188-4461-b777-b107f7a99604 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb3421bc9494914bc5f797b15a55643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31af2a6b9424f168dd6084d8d5fd0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:37.836945 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e0144e1d-4188-4461-b777-b107f7a99604 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/9888e0ee-9a2f-4547-a6e3-c77d3493c63f" status: 200 len: 1244 microversion: 2.1 time: 0.200714 Jan 15 21:02:37.854669 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2215/4452] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:02:37 2022] GET /compute/v2.1/servers/9888e0ee-9a2f-4547-a6e3-c77d3493c63f => generated 1244 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:02:37.860684 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d62f909c-5716-4a36-8003-e838013cf2fc tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:37.862888 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-d62f909c-5716-4a36-8003-e838013cf2fc tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:37.880054 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d62f909c-5716-4a36-8003-e838013cf2fc tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:37.880786 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d62f909c-5716-4a36-8003-e838013cf2fc tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:37.883823 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d62f909c-5716-4a36-8003-e838013cf2fc tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:37.886563 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d62f909c-5716-4a36-8003-e838013cf2fc tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:37.923113 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-0303ac36-53af-4220-81ca-6c45adb3b47e tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:37.954405 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-0303ac36-53af-4220-81ca-6c45adb3b47e tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/d09ef93d-246f-464d-8c9c-f5a6fa14e4fe" status: 200 len: 1315 microversion: 2.1 time: 0.990691 Jan 15 21:02:37.965701 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2238/4453] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:02:36 2022] GET /compute/v2.1/servers/d09ef93d-246f-464d-8c9c-f5a6fa14e4fe => generated 1315 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:02:38.021444 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f368a481-86a0-47fd-87bf-8bea65ed39a9 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:38.022839 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f368a481-86a0-47fd-87bf-8bea65ed39a9 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] [instance: 26f27adc-8567-4752-8a51-ee9c301b2611] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:38.035238 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f368a481-86a0-47fd-87bf-8bea65ed39a9 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:38.036100 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f368a481-86a0-47fd-87bf-8bea65ed39a9 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:38.038398 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f368a481-86a0-47fd-87bf-8bea65ed39a9 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:38.039160 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f368a481-86a0-47fd-87bf-8bea65ed39a9 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:38.096654 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-d62f909c-5716-4a36-8003-e838013cf2fc tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:38.108238 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-d62f909c-5716-4a36-8003-e838013cf2fc tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:38.110400 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-d62f909c-5716-4a36-8003-e838013cf2fc tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:38.111780 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d62f909c-5716-4a36-8003-e838013cf2fc tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0" status: 200 len: 1737 microversion: 2.20 time: 0.257883 Jan 15 21:02:38.112742 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2216/4454] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:02:37 2022] GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0 => generated 1737 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:02:38.314443 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a7f88125-8631-47cf-8dd8-f1b0d510f13f tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:38.316475 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a7f88125-8631-47cf-8dd8-f1b0d510f13f tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:38.341052 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-f368a481-86a0-47fd-87bf-8bea65ed39a9 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e8f253bac41484ab8e92b74bfa54465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74165fadf5154c319ca56b4aa961e7b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:38.344237 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a7f88125-8631-47cf-8dd8-f1b0d510f13f tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:38.345612 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a7f88125-8631-47cf-8dd8-f1b0d510f13f tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:38.346862 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a7f88125-8631-47cf-8dd8-f1b0d510f13f tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:38.347473 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a7f88125-8631-47cf-8dd8-f1b0d510f13f tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:38.351253 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f368a481-86a0-47fd-87bf-8bea65ed39a9 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] 10.222.0.46 "GET /compute/v2.1/servers/26f27adc-8567-4752-8a51-ee9c301b2611" status: 200 len: 1523 microversion: 2.1 time: 0.333726 Jan 15 21:02:38.353253 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2239/4455] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:02:38 2022] GET /compute/v2.1/servers/26f27adc-8567-4752-8a51-ee9c301b2611 => generated 1523 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:02:38.421201 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a7f88125-8631-47cf-8dd8-f1b0d510f13f tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action" status: 200 len: 32580 microversion: 2.1 time: 0.116637 Jan 15 21:02:38.425880 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2217/4456] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:02:38 2022] POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action => generated 32580 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:02:38.493318 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5ba6aefc-3e8e-4987-9390-44f569b34ca1 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:38.494771 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-5ba6aefc-3e8e-4987-9390-44f569b34ca1 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:38.503468 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5ba6aefc-3e8e-4987-9390-44f569b34ca1 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:38.504126 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5ba6aefc-3e8e-4987-9390-44f569b34ca1 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:38.505608 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5ba6aefc-3e8e-4987-9390-44f569b34ca1 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:38.506181 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5ba6aefc-3e8e-4987-9390-44f569b34ca1 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:38.552291 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5ba6aefc-3e8e-4987-9390-44f569b34ca1 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.063299 Jan 15 21:02:38.554465 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2240/4457] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:02:38 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:02:38.588267 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-fcef9487-23a8-4b51-adc1-79c5fbb7d200 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:38.589289 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-fcef9487-23a8-4b51-adc1-79c5fbb7d200 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:38.599284 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fcef9487-23a8-4b51-adc1-79c5fbb7d200 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:38.607321 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fcef9487-23a8-4b51-adc1-79c5fbb7d200 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:38.608735 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fcef9487-23a8-4b51-adc1-79c5fbb7d200 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:38.609918 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fcef9487-23a8-4b51-adc1-79c5fbb7d200 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:38.672872 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-fcef9487-23a8-4b51-adc1-79c5fbb7d200 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.088594 Jan 15 21:02:38.673748 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2218/4458] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:02:38 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:02:38.858747 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-45b2d801-d978-49f1-b3ea-2316c954cd17 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:38.859687 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-45b2d801-d978-49f1-b3ea-2316c954cd17 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: 9888e0ee-9a2f-4547-a6e3-c77d3493c63f] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:38.871542 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-45b2d801-d978-49f1-b3ea-2316c954cd17 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:38.872009 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-45b2d801-d978-49f1-b3ea-2316c954cd17 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:38.872903 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-45b2d801-d978-49f1-b3ea-2316c954cd17 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:38.873387 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-45b2d801-d978-49f1-b3ea-2316c954cd17 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:38.966788 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-45b2d801-d978-49f1-b3ea-2316c954cd17 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb3421bc9494914bc5f797b15a55643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31af2a6b9424f168dd6084d8d5fd0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:38.974302 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-71f72a6d-d210-4123-ac34-e9f1959001fb tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:38.982247 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-71f72a6d-d210-4123-ac34-e9f1959001fb tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: d09ef93d-246f-464d-8c9c-f5a6fa14e4fe] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:38.990739 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-45b2d801-d978-49f1-b3ea-2316c954cd17 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/9888e0ee-9a2f-4547-a6e3-c77d3493c63f" status: 200 len: 1250 microversion: 2.1 time: 0.135148 Jan 15 21:02:39.003910 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-71f72a6d-d210-4123-ac34-e9f1959001fb tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:39.004694 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-71f72a6d-d210-4123-ac34-e9f1959001fb tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:39.005727 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-71f72a6d-d210-4123-ac34-e9f1959001fb tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:39.006327 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-71f72a6d-d210-4123-ac34-e9f1959001fb tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:39.010048 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2241/4459] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:02:38 2022] GET /compute/v2.1/servers/9888e0ee-9a2f-4547-a6e3-c77d3493c63f => generated 1250 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:02:39.131974 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-583f9a9d-844e-4d64-929c-a743a726fed5 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:39.136581 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-583f9a9d-844e-4d64-929c-a743a726fed5 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:39.151816 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-583f9a9d-844e-4d64-929c-a743a726fed5 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:39.158423 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-583f9a9d-844e-4d64-929c-a743a726fed5 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:39.161439 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-583f9a9d-844e-4d64-929c-a743a726fed5 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:39.162857 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-583f9a9d-844e-4d64-929c-a743a726fed5 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:39.214558 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-71f72a6d-d210-4123-ac34-e9f1959001fb tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:39.225086 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-71f72a6d-d210-4123-ac34-e9f1959001fb tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/d09ef93d-246f-464d-8c9c-f5a6fa14e4fe" status: 200 len: 1503 microversion: 2.1 time: 0.256187 Jan 15 21:02:39.225353 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2219/4460] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:02:38 2022] GET /compute/v2.1/servers/d09ef93d-246f-464d-8c9c-f5a6fa14e4fe => generated 1503 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:02:39.246854 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d67410da-5602-4071-9b05-a1e8235f4f26 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:39.255014 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-d67410da-5602-4071-9b05-a1e8235f4f26 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: d09ef93d-246f-464d-8c9c-f5a6fa14e4fe] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:39.285302 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d67410da-5602-4071-9b05-a1e8235f4f26 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:39.287148 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d67410da-5602-4071-9b05-a1e8235f4f26 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:39.289187 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d67410da-5602-4071-9b05-a1e8235f4f26 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:39.290138 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d67410da-5602-4071-9b05-a1e8235f4f26 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:39.361589 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d67410da-5602-4071-9b05-a1e8235f4f26 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "POST /compute/v2.1/servers/d09ef93d-246f-464d-8c9c-f5a6fa14e4fe/action" status: 200 len: 14 microversion: 2.1 time: 0.122725 Jan 15 21:02:39.368828 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2220/4461] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:02:39 2022] POST /compute/v2.1/servers/d09ef93d-246f-464d-8c9c-f5a6fa14e4fe/action => generated 14 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 21:02:39.382514 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-54f8d9ea-c363-4527-beab-6df79a7a51f5 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:39.383433 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-54f8d9ea-c363-4527-beab-6df79a7a51f5 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] [instance: 26f27adc-8567-4752-8a51-ee9c301b2611] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:39.407563 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-54f8d9ea-c363-4527-beab-6df79a7a51f5 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:39.408295 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-54f8d9ea-c363-4527-beab-6df79a7a51f5 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:39.410071 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-54f8d9ea-c363-4527-beab-6df79a7a51f5 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:39.410739 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-54f8d9ea-c363-4527-beab-6df79a7a51f5 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:39.595971 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-583f9a9d-844e-4d64-929c-a743a726fed5 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:39.619881 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-583f9a9d-844e-4d64-929c-a743a726fed5 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:39.624728 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-583f9a9d-844e-4d64-929c-a743a726fed5 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:39.632575 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-583f9a9d-844e-4d64-929c-a743a726fed5 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0" status: 200 len: 1737 microversion: 2.20 time: 0.504270 Jan 15 21:02:39.633860 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2242/4462] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:02:39 2022] GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0 => generated 1737 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:02:39.650317 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3fd1ef2f-c548-4fd6-9a52-14ffc86ec78e tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:39.651537 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-3fd1ef2f-c548-4fd6-9a52-14ffc86ec78e tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:39.659096 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3fd1ef2f-c548-4fd6-9a52-14ffc86ec78e tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:39.659848 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3fd1ef2f-c548-4fd6-9a52-14ffc86ec78e tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:39.660938 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3fd1ef2f-c548-4fd6-9a52-14ffc86ec78e tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:39.661538 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3fd1ef2f-c548-4fd6-9a52-14ffc86ec78e tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:39.674481 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-54f8d9ea-c363-4527-beab-6df79a7a51f5 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e8f253bac41484ab8e92b74bfa54465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74165fadf5154c319ca56b4aa961e7b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:39.683046 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-54f8d9ea-c363-4527-beab-6df79a7a51f5 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] 10.222.0.46 "GET /compute/v2.1/servers/26f27adc-8567-4752-8a51-ee9c301b2611" status: 200 len: 1523 microversion: 2.1 time: 0.312499 Jan 15 21:02:39.696391 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2221/4463] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:02:39 2022] GET /compute/v2.1/servers/26f27adc-8567-4752-8a51-ee9c301b2611 => generated 1523 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:02:39.701577 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b8976b49-4ef4-480d-abd7-72264574e593 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:39.702638 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b8976b49-4ef4-480d-abd7-72264574e593 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:39.711627 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b8976b49-4ef4-480d-abd7-72264574e593 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:39.712355 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b8976b49-4ef4-480d-abd7-72264574e593 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:39.713439 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b8976b49-4ef4-480d-abd7-72264574e593 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:39.714108 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b8976b49-4ef4-480d-abd7-72264574e593 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:39.720650 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3fd1ef2f-c548-4fd6-9a52-14ffc86ec78e tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action" status: 200 len: 32580 microversion: 2.1 time: 0.085280 Jan 15 21:02:39.722074 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2243/4464] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:02:39 2022] POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action => generated 32580 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:02:39.727972 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-4d991d1e-743c-45e2-b68b-79f8236e56fd tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:39.729306 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-4d991d1e-743c-45e2-b68b-79f8236e56fd tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:39.744561 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4d991d1e-743c-45e2-b68b-79f8236e56fd tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:39.745547 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4d991d1e-743c-45e2-b68b-79f8236e56fd tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:39.746685 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4d991d1e-743c-45e2-b68b-79f8236e56fd tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:39.747885 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4d991d1e-743c-45e2-b68b-79f8236e56fd tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:39.799563 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b8976b49-4ef4-480d-abd7-72264574e593 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.101613 Jan 15 21:02:39.804879 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2222/4465] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:02:39 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:02:39.856445 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-4d991d1e-743c-45e2-b68b-79f8236e56fd tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.132670 Jan 15 21:02:39.857724 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2244/4466] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:02:39 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:02:40.024249 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7d0ff05f-34d0-476f-bda7-0c74888d13de tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:40.025621 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-7d0ff05f-34d0-476f-bda7-0c74888d13de tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: 9888e0ee-9a2f-4547-a6e3-c77d3493c63f] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:40.044754 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7d0ff05f-34d0-476f-bda7-0c74888d13de tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:40.048406 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7d0ff05f-34d0-476f-bda7-0c74888d13de tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:40.051883 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7d0ff05f-34d0-476f-bda7-0c74888d13de tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:40.052562 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7d0ff05f-34d0-476f-bda7-0c74888d13de tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:40.284705 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-7d0ff05f-34d0-476f-bda7-0c74888d13de tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb3421bc9494914bc5f797b15a55643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31af2a6b9424f168dd6084d8d5fd0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:40.297042 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7d0ff05f-34d0-476f-bda7-0c74888d13de tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/9888e0ee-9a2f-4547-a6e3-c77d3493c63f" status: 200 len: 1292 microversion: 2.1 time: 0.282345 Jan 15 21:02:40.298170 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2223/4467] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:02:40 2022] GET /compute/v2.1/servers/9888e0ee-9a2f-4547-a6e3-c77d3493c63f => generated 1292 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:02:40.382833 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-84fc360d-e414-4b5c-b276-ffb00d27e24f tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:40.384465 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-84fc360d-e414-4b5c-b276-ffb00d27e24f tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: d09ef93d-246f-464d-8c9c-f5a6fa14e4fe] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:40.403563 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-84fc360d-e414-4b5c-b276-ffb00d27e24f tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:40.404304 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-84fc360d-e414-4b5c-b276-ffb00d27e24f tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:40.405414 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-84fc360d-e414-4b5c-b276-ffb00d27e24f tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:40.406027 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-84fc360d-e414-4b5c-b276-ffb00d27e24f tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:40.491106 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-84fc360d-e414-4b5c-b276-ffb00d27e24f tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "POST /compute/v2.1/servers/d09ef93d-246f-464d-8c9c-f5a6fa14e4fe/action" status: 200 len: 14 microversion: 2.1 time: 0.119877 Jan 15 21:02:40.494809 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2245/4468] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:02:40 2022] POST /compute/v2.1/servers/d09ef93d-246f-464d-8c9c-f5a6fa14e4fe/action => generated 14 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 21:02:40.652802 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7f1869aa-0f51-41c0-92a9-f48bb6c347b9 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:40.653719 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-7f1869aa-0f51-41c0-92a9-f48bb6c347b9 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:40.662657 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7f1869aa-0f51-41c0-92a9-f48bb6c347b9 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:40.663115 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7f1869aa-0f51-41c0-92a9-f48bb6c347b9 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:40.663914 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7f1869aa-0f51-41c0-92a9-f48bb6c347b9 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:40.665159 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7f1869aa-0f51-41c0-92a9-f48bb6c347b9 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:40.707510 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f8053fc6-0729-4211-acf2-bc28d53d9c87 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:40.709404 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f8053fc6-0729-4211-acf2-bc28d53d9c87 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] [instance: 26f27adc-8567-4752-8a51-ee9c301b2611] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:40.718693 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f8053fc6-0729-4211-acf2-bc28d53d9c87 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:40.720797 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f8053fc6-0729-4211-acf2-bc28d53d9c87 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:40.722136 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f8053fc6-0729-4211-acf2-bc28d53d9c87 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:40.722825 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f8053fc6-0729-4211-acf2-bc28d53d9c87 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:41.014394 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-7f1869aa-0f51-41c0-92a9-f48bb6c347b9 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:41.034667 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-7f1869aa-0f51-41c0-92a9-f48bb6c347b9 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:41.038359 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-7f1869aa-0f51-41c0-92a9-f48bb6c347b9 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:41.040192 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7f1869aa-0f51-41c0-92a9-f48bb6c347b9 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0" status: 200 len: 1737 microversion: 2.20 time: 0.392297 Jan 15 21:02:41.045455 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2224/4469] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:02:40 2022] GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0 => generated 1737 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:02:41.066172 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c5377dff-070b-4982-859b-ac9977fcaa28 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:41.067695 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c5377dff-070b-4982-859b-ac9977fcaa28 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:41.082321 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c5377dff-070b-4982-859b-ac9977fcaa28 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:41.086953 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c5377dff-070b-4982-859b-ac9977fcaa28 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:41.087994 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c5377dff-070b-4982-859b-ac9977fcaa28 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:41.088644 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c5377dff-070b-4982-859b-ac9977fcaa28 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:41.117658 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-f8053fc6-0729-4211-acf2-bc28d53d9c87 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e8f253bac41484ab8e92b74bfa54465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74165fadf5154c319ca56b4aa961e7b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:41.126495 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f8053fc6-0729-4211-acf2-bc28d53d9c87 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] 10.222.0.46 "GET /compute/v2.1/servers/26f27adc-8567-4752-8a51-ee9c301b2611" status: 200 len: 1523 microversion: 2.1 time: 0.428061 Jan 15 21:02:41.128098 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2246/4470] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:02:40 2022] GET /compute/v2.1/servers/26f27adc-8567-4752-8a51-ee9c301b2611 => generated 1523 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:02:41.135017 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-669722a6-a1fe-4d79-94a0-e9c7d894708e tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:41.135948 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-669722a6-a1fe-4d79-94a0-e9c7d894708e tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:41.154394 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-669722a6-a1fe-4d79-94a0-e9c7d894708e tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:41.154855 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-669722a6-a1fe-4d79-94a0-e9c7d894708e tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:41.156061 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-669722a6-a1fe-4d79-94a0-e9c7d894708e tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:41.164239 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-669722a6-a1fe-4d79-94a0-e9c7d894708e tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:41.178864 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c5377dff-070b-4982-859b-ac9977fcaa28 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action" status: 200 len: 32580 microversion: 2.1 time: 0.131764 Jan 15 21:02:41.179531 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2225/4471] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:02:41 2022] POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action => generated 32580 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:02:41.199903 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-5f2626d7-6fa6-469a-adea-794ccf5ae8e0 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:41.204372 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-5f2626d7-6fa6-469a-adea-794ccf5ae8e0 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:41.237900 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5f2626d7-6fa6-469a-adea-794ccf5ae8e0 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:41.238360 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5f2626d7-6fa6-469a-adea-794ccf5ae8e0 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:41.239167 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5f2626d7-6fa6-469a-adea-794ccf5ae8e0 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:41.239614 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5f2626d7-6fa6-469a-adea-794ccf5ae8e0 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:41.253515 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-669722a6-a1fe-4d79-94a0-e9c7d894708e tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.123936 Jan 15 21:02:41.266523 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2247/4472] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:02:41 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:02:41.274733 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-5f6f52f7-916e-4ff4-9538-322ce3224cb4 req-4f39d2eb-c969-491f-b44f-c6077dcbfad8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9888e0ee-9a2f-4547-a6e3-c77d3493c63f", "tag": "4596387d-a489-4634-a84b-5a3a77df49cd"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:41.283082 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:02:41.283082 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:02:41.300569 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-5f6f52f7-916e-4ff4-9538-322ce3224cb4 req-4f39d2eb-c969-491f-b44f-c6077dcbfad8 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:41.301877 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-5f6f52f7-916e-4ff4-9538-322ce3224cb4 req-4f39d2eb-c969-491f-b44f-c6077dcbfad8 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:41.311429 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-5f2626d7-6fa6-469a-adea-794ccf5ae8e0 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.130504 Jan 15 21:02:41.312936 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2226/4473] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:02:41 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:02:41.320641 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1e2d7f04-558e-4a72-a063-f97a99248561 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:41.324615 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-1e2d7f04-558e-4a72-a063-f97a99248561 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: 9888e0ee-9a2f-4547-a6e3-c77d3493c63f] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:41.338482 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-5f6f52f7-916e-4ff4-9538-322ce3224cb4 req-4f39d2eb-c969-491f-b44f-c6077dcbfad8 service nova] Creating event network-changed:4596387d-a489-4634-a84b-5a3a77df49cd for instance 9888e0ee-9a2f-4547-a6e3-c77d3493c63f on nch2-master-1 Jan 15 21:02:41.340874 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1e2d7f04-558e-4a72-a063-f97a99248561 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:41.344534 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1e2d7f04-558e-4a72-a063-f97a99248561 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:41.345761 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1e2d7f04-558e-4a72-a063-f97a99248561 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:41.348126 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1e2d7f04-558e-4a72-a063-f97a99248561 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:41.355864 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-5f6f52f7-916e-4ff4-9538-322ce3224cb4 req-4f39d2eb-c969-491f-b44f-c6077dcbfad8 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084181 Jan 15 21:02:41.358270 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2248/4474] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:02:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:02:41.503822 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5975b0d1-d965-42d1-af96-fb73836f4ebe tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:41.504886 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-5975b0d1-d965-42d1-af96-fb73836f4ebe tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: d09ef93d-246f-464d-8c9c-f5a6fa14e4fe] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:41.522571 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5975b0d1-d965-42d1-af96-fb73836f4ebe tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:41.523241 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5975b0d1-d965-42d1-af96-fb73836f4ebe tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:41.524488 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5975b0d1-d965-42d1-af96-fb73836f4ebe tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:41.525107 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5975b0d1-d965-42d1-af96-fb73836f4ebe tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:41.599987 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5975b0d1-d965-42d1-af96-fb73836f4ebe tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "POST /compute/v2.1/servers/d09ef93d-246f-464d-8c9c-f5a6fa14e4fe/action" status: 200 len: 14 microversion: 2.1 time: 0.101114 Jan 15 21:02:41.603776 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2249/4475] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:02:41 2022] POST /compute/v2.1/servers/d09ef93d-246f-464d-8c9c-f5a6fa14e4fe/action => generated 14 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 15 21:02:41.660693 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-1e2d7f04-558e-4a72-a063-f97a99248561 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb3421bc9494914bc5f797b15a55643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31af2a6b9424f168dd6084d8d5fd0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:41.674785 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-1e2d7f04-558e-4a72-a063-f97a99248561 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/9888e0ee-9a2f-4547-a6e3-c77d3493c63f" status: 200 len: 1292 microversion: 2.1 time: 0.359233 Jan 15 21:02:41.686111 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2227/4476] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:02:41 2022] GET /compute/v2.1/servers/9888e0ee-9a2f-4547-a6e3-c77d3493c63f => generated 1292 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:02:42.070058 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c662c3a7-ef4b-40d7-8d19-22aaaf65e7c1 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:42.071469 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c662c3a7-ef4b-40d7-8d19-22aaaf65e7c1 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:42.082953 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c662c3a7-ef4b-40d7-8d19-22aaaf65e7c1 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:42.085732 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c662c3a7-ef4b-40d7-8d19-22aaaf65e7c1 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:42.087085 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c662c3a7-ef4b-40d7-8d19-22aaaf65e7c1 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:42.089771 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c662c3a7-ef4b-40d7-8d19-22aaaf65e7c1 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:42.146492 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-afb355a2-77a2-4197-9212-69599bc2b43c tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:42.147819 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-afb355a2-77a2-4197-9212-69599bc2b43c tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] [instance: 26f27adc-8567-4752-8a51-ee9c301b2611] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:42.179431 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-afb355a2-77a2-4197-9212-69599bc2b43c tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:42.184676 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-afb355a2-77a2-4197-9212-69599bc2b43c tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:42.186278 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-afb355a2-77a2-4197-9212-69599bc2b43c tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:42.186743 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-afb355a2-77a2-4197-9212-69599bc2b43c tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:42.495802 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-c662c3a7-ef4b-40d7-8d19-22aaaf65e7c1 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:42.509957 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-c662c3a7-ef4b-40d7-8d19-22aaaf65e7c1 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:42.511941 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-c662c3a7-ef4b-40d7-8d19-22aaaf65e7c1 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:42.513388 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c662c3a7-ef4b-40d7-8d19-22aaaf65e7c1 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0" status: 200 len: 1737 microversion: 2.20 time: 0.452311 Jan 15 21:02:42.521494 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2250/4477] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:02:42 2022] GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0 => generated 1737 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:02:42.526511 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c1e05a53-ee22-4b39-8034-b2ed6d37e618 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:42.527618 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c1e05a53-ee22-4b39-8034-b2ed6d37e618 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:42.544571 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c1e05a53-ee22-4b39-8034-b2ed6d37e618 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:42.545457 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c1e05a53-ee22-4b39-8034-b2ed6d37e618 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:42.552268 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c1e05a53-ee22-4b39-8034-b2ed6d37e618 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:42.552834 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c1e05a53-ee22-4b39-8034-b2ed6d37e618 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:42.615634 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-afb355a2-77a2-4197-9212-69599bc2b43c tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e8f253bac41484ab8e92b74bfa54465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74165fadf5154c319ca56b4aa961e7b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:42.623996 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-afb355a2-77a2-4197-9212-69599bc2b43c tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] 10.222.0.46 "GET /compute/v2.1/servers/26f27adc-8567-4752-8a51-ee9c301b2611" status: 200 len: 1523 microversion: 2.1 time: 0.484099 Jan 15 21:02:42.624717 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c1e05a53-ee22-4b39-8034-b2ed6d37e618 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action" status: 200 len: 32580 microversion: 2.1 time: 0.101439 Jan 15 21:02:42.629911 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2251/4478] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:02:42 2022] POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action => generated 32580 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:02:42.630089 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2228/4479] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:02:42 2022] GET /compute/v2.1/servers/26f27adc-8567-4752-8a51-ee9c301b2611 => generated 1523 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:02:42.631929 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-6b7c8a74-3faa-4402-acd5-ea51b5bf4d12 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:42.638022 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-6b7c8a74-3faa-4402-acd5-ea51b5bf4d12 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:42.644007 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9c1d1f0c-707a-47d4-a883-d224497c6b53 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:42.645119 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-9c1d1f0c-707a-47d4-a883-d224497c6b53 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:42.650067 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6b7c8a74-3faa-4402-acd5-ea51b5bf4d12 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:42.653368 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6b7c8a74-3faa-4402-acd5-ea51b5bf4d12 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:42.654332 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6b7c8a74-3faa-4402-acd5-ea51b5bf4d12 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:42.657939 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6b7c8a74-3faa-4402-acd5-ea51b5bf4d12 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:42.661747 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9c1d1f0c-707a-47d4-a883-d224497c6b53 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:42.662207 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9c1d1f0c-707a-47d4-a883-d224497c6b53 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:42.663013 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9c1d1f0c-707a-47d4-a883-d224497c6b53 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:42.663436 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9c1d1f0c-707a-47d4-a883-d224497c6b53 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:42.740022 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-6b7c8a74-3faa-4402-acd5-ea51b5bf4d12 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.112411 Jan 15 21:02:42.743319 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2252/4480] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:02:42 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:02:42.759127 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-9c1d1f0c-707a-47d4-a883-d224497c6b53 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.127958 Jan 15 21:02:42.760665 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2229/4481] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:02:42 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:02:42.766317 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d07b0dfb-e55b-4d29-a30c-ddf2e37320a0 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:42.767616 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-d07b0dfb-e55b-4d29-a30c-ddf2e37320a0 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: 9888e0ee-9a2f-4547-a6e3-c77d3493c63f] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:42.772423 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-7d6132d1-b4a5-4408-b2f3-a3e45ce54b5c tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:42.774254 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-7d6132d1-b4a5-4408-b2f3-a3e45ce54b5c tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: d09ef93d-246f-464d-8c9c-f5a6fa14e4fe] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:42.786004 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7d6132d1-b4a5-4408-b2f3-a3e45ce54b5c tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:42.787119 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7d6132d1-b4a5-4408-b2f3-a3e45ce54b5c tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:42.789611 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d07b0dfb-e55b-4d29-a30c-ddf2e37320a0 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:42.790642 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7d6132d1-b4a5-4408-b2f3-a3e45ce54b5c tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:42.791595 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7d6132d1-b4a5-4408-b2f3-a3e45ce54b5c tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:42.794387 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d07b0dfb-e55b-4d29-a30c-ddf2e37320a0 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:42.795401 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d07b0dfb-e55b-4d29-a30c-ddf2e37320a0 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:42.799939 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d07b0dfb-e55b-4d29-a30c-ddf2e37320a0 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:42.893061 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-7d6132d1-b4a5-4408-b2f3-a3e45ce54b5c tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "POST /compute/v2.1/servers/d09ef93d-246f-464d-8c9c-f5a6fa14e4fe/action" status: 200 len: 14 microversion: 2.1 time: 0.147388 Jan 15 21:02:42.895752 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2253/4482] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:02:42 2022] POST /compute/v2.1/servers/d09ef93d-246f-464d-8c9c-f5a6fa14e4fe/action => generated 14 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 21:02:43.349469 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-d07b0dfb-e55b-4d29-a30c-ddf2e37320a0 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb3421bc9494914bc5f797b15a55643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31af2a6b9424f168dd6084d8d5fd0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:43.360265 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d07b0dfb-e55b-4d29-a30c-ddf2e37320a0 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/9888e0ee-9a2f-4547-a6e3-c77d3493c63f" status: 200 len: 1292 microversion: 2.1 time: 0.598535 Jan 15 21:02:43.361668 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2230/4483] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:02:42 2022] GET /compute/v2.1/servers/9888e0ee-9a2f-4547-a6e3-c77d3493c63f => generated 1292 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:02:43.549429 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-83659a18-e343-437d-9d34-5a18a47c72d5 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:43.550234 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-83659a18-e343-437d-9d34-5a18a47c72d5 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:43.567580 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-83659a18-e343-437d-9d34-5a18a47c72d5 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:43.568298 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-83659a18-e343-437d-9d34-5a18a47c72d5 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:43.572303 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-83659a18-e343-437d-9d34-5a18a47c72d5 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:43.581415 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-83659a18-e343-437d-9d34-5a18a47c72d5 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:43.637257 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-fb3d7e3c-ca86-49af-9aff-1b8854280fe3 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:43.638743 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-fb3d7e3c-ca86-49af-9aff-1b8854280fe3 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:43.647135 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fb3d7e3c-ca86-49af-9aff-1b8854280fe3 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:43.648092 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fb3d7e3c-ca86-49af-9aff-1b8854280fe3 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:43.649164 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fb3d7e3c-ca86-49af-9aff-1b8854280fe3 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:43.650081 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fb3d7e3c-ca86-49af-9aff-1b8854280fe3 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:43.712636 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-fb3d7e3c-ca86-49af-9aff-1b8854280fe3 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action" status: 200 len: 32580 microversion: 2.1 time: 0.079052 Jan 15 21:02:43.715078 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2231/4484] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:02:43 2022] POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action => generated 32580 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 21:02:43.721546 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9a434c25-9c5a-4b2d-a38c-f7a89213858d tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:43.722765 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-9a434c25-9c5a-4b2d-a38c-f7a89213858d tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] [instance: 26f27adc-8567-4752-8a51-ee9c301b2611] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:43.730935 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9a434c25-9c5a-4b2d-a38c-f7a89213858d tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:43.731746 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9a434c25-9c5a-4b2d-a38c-f7a89213858d tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:43.732796 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9a434c25-9c5a-4b2d-a38c-f7a89213858d tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:43.733507 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9a434c25-9c5a-4b2d-a38c-f7a89213858d tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:43.880205 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-83659a18-e343-437d-9d34-5a18a47c72d5 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:43.890045 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-83659a18-e343-437d-9d34-5a18a47c72d5 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:43.896415 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-83659a18-e343-437d-9d34-5a18a47c72d5 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:43.898893 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-83659a18-e343-437d-9d34-5a18a47c72d5 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0" status: 200 len: 1737 microversion: 2.20 time: 0.354866 Jan 15 21:02:43.900219 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2254/4485] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:02:43 2022] GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0 => generated 1737 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:02:43.918188 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8bc551db-1579-49c5-a6e8-8a14137836c6 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:43.929511 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-8bc551db-1579-49c5-a6e8-8a14137836c6 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:43.936555 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8bc551db-1579-49c5-a6e8-8a14137836c6 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:43.945874 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8bc551db-1579-49c5-a6e8-8a14137836c6 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:43.947805 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8bc551db-1579-49c5-a6e8-8a14137836c6 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:43.948475 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8bc551db-1579-49c5-a6e8-8a14137836c6 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:44.011044 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-8bc551db-1579-49c5-a6e8-8a14137836c6 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.096685 Jan 15 21:02:44.014096 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2255/4486] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:02:43 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:02:44.023744 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9b0ce9aa-8e84-40d1-ada8-125df2651f84 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:44.025214 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-9b0ce9aa-8e84-40d1-ada8-125df2651f84 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:44.036621 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-9a434c25-9c5a-4b2d-a38c-f7a89213858d tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e8f253bac41484ab8e92b74bfa54465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74165fadf5154c319ca56b4aa961e7b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:44.037508 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9b0ce9aa-8e84-40d1-ada8-125df2651f84 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:44.038136 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9b0ce9aa-8e84-40d1-ada8-125df2651f84 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:44.039151 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9b0ce9aa-8e84-40d1-ada8-125df2651f84 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:44.040475 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9b0ce9aa-8e84-40d1-ada8-125df2651f84 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:44.046403 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-9a434c25-9c5a-4b2d-a38c-f7a89213858d tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] 10.222.0.46 "GET /compute/v2.1/servers/26f27adc-8567-4752-8a51-ee9c301b2611" status: 200 len: 1523 microversion: 2.1 time: 0.329872 Jan 15 21:02:44.061035 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2232/4487] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:02:43 2022] GET /compute/v2.1/servers/26f27adc-8567-4752-8a51-ee9c301b2611 => generated 1523 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:02:44.073018 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d9d62cc4-b913-42e1-ac8d-4a4be1748dc5 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:44.075039 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-d9d62cc4-b913-42e1-ac8d-4a4be1748dc5 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: d09ef93d-246f-464d-8c9c-f5a6fa14e4fe] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:44.082742 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d9d62cc4-b913-42e1-ac8d-4a4be1748dc5 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:44.083289 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d9d62cc4-b913-42e1-ac8d-4a4be1748dc5 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:44.084167 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d9d62cc4-b913-42e1-ac8d-4a4be1748dc5 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:44.084672 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d9d62cc4-b913-42e1-ac8d-4a4be1748dc5 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:44.137256 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-9b0ce9aa-8e84-40d1-ada8-125df2651f84 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.116429 Jan 15 21:02:44.137256 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2256/4488] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:02:44 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:02:44.150728 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d9d62cc4-b913-42e1-ac8d-4a4be1748dc5 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "POST /compute/v2.1/servers/d09ef93d-246f-464d-8c9c-f5a6fa14e4fe/action" status: 200 len: 14 microversion: 2.1 time: 0.087721 Jan 15 21:02:44.155291 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2233/4489] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:02:44 2022] POST /compute/v2.1/servers/d09ef93d-246f-464d-8c9c-f5a6fa14e4fe/action => generated 14 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 21:02:44.383219 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a693e710-b419-45fa-85d7-cad306ada9d0 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:44.384207 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a693e710-b419-45fa-85d7-cad306ada9d0 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: 9888e0ee-9a2f-4547-a6e3-c77d3493c63f] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:44.396530 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a693e710-b419-45fa-85d7-cad306ada9d0 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:44.397414 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a693e710-b419-45fa-85d7-cad306ada9d0 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:44.398458 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a693e710-b419-45fa-85d7-cad306ada9d0 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:44.399244 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a693e710-b419-45fa-85d7-cad306ada9d0 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:44.727182 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4d0e7f85-2d6d-4a0a-852b-6701577514b4 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:44.734017 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-4d0e7f85-2d6d-4a0a-852b-6701577514b4 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:44.768790 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4d0e7f85-2d6d-4a0a-852b-6701577514b4 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:44.769849 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4d0e7f85-2d6d-4a0a-852b-6701577514b4 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:44.770942 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4d0e7f85-2d6d-4a0a-852b-6701577514b4 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:44.771613 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4d0e7f85-2d6d-4a0a-852b-6701577514b4 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:44.841977 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-4d0e7f85-2d6d-4a0a-852b-6701577514b4 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action" status: 200 len: 32580 microversion: 2.1 time: 0.119593 Jan 15 21:02:44.844375 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2234/4490] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:02:44 2022] POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action => generated 32580 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:02:44.904959 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-a693e710-b419-45fa-85d7-cad306ada9d0 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb3421bc9494914bc5f797b15a55643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31af2a6b9424f168dd6084d8d5fd0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:44.915018 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a693e710-b419-45fa-85d7-cad306ada9d0 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/9888e0ee-9a2f-4547-a6e3-c77d3493c63f" status: 200 len: 1292 microversion: 2.1 time: 0.540440 Jan 15 21:02:44.916196 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2257/4491] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:02:44 2022] GET /compute/v2.1/servers/9888e0ee-9a2f-4547-a6e3-c77d3493c63f => generated 1292 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:02:44.920035 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-58362e07-6fbd-4f94-8db1-4083935b698f tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:44.921015 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-58362e07-6fbd-4f94-8db1-4083935b698f tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:44.937960 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-58362e07-6fbd-4f94-8db1-4083935b698f tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:44.938549 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-58362e07-6fbd-4f94-8db1-4083935b698f tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:44.940143 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-58362e07-6fbd-4f94-8db1-4083935b698f tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:44.940857 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-58362e07-6fbd-4f94-8db1-4083935b698f tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:45.024907 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f966fdc3-5078-41b2-8949-b9ed6957cf52 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:45.027780 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f966fdc3-5078-41b2-8949-b9ed6957cf52 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:45.039147 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f966fdc3-5078-41b2-8949-b9ed6957cf52 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:45.039613 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f966fdc3-5078-41b2-8949-b9ed6957cf52 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:45.040433 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f966fdc3-5078-41b2-8949-b9ed6957cf52 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:45.044733 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f966fdc3-5078-41b2-8949-b9ed6957cf52 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:45.143218 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f966fdc3-5078-41b2-8949-b9ed6957cf52 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.121822 Jan 15 21:02:45.143882 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2258/4492] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:02:45 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:02:45.154847 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-03457349-4df3-467c-98c7-991a6737735d tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:45.155840 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-03457349-4df3-467c-98c7-991a6737735d tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] [instance: 26f27adc-8567-4752-8a51-ee9c301b2611] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:45.190629 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-03457349-4df3-467c-98c7-991a6737735d tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:45.196804 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-03457349-4df3-467c-98c7-991a6737735d tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:45.197801 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-03457349-4df3-467c-98c7-991a6737735d tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:45.199546 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-03457349-4df3-467c-98c7-991a6737735d tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:45.609036 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-58362e07-6fbd-4f94-8db1-4083935b698f tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:45.625935 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-58362e07-6fbd-4f94-8db1-4083935b698f tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:45.627815 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-58362e07-6fbd-4f94-8db1-4083935b698f tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:45.629065 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-58362e07-6fbd-4f94-8db1-4083935b698f tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0" status: 200 len: 1737 microversion: 2.20 time: 0.714329 Jan 15 21:02:45.629633 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2235/4493] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:02:44 2022] GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0 => generated 1737 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:02:45.637112 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-949146d3-58fb-4956-a81c-12d05621fada tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:45.638070 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-949146d3-58fb-4956-a81c-12d05621fada tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:45.665627 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-949146d3-58fb-4956-a81c-12d05621fada tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:45.666557 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-949146d3-58fb-4956-a81c-12d05621fada tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:45.668520 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-949146d3-58fb-4956-a81c-12d05621fada tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:45.669509 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-949146d3-58fb-4956-a81c-12d05621fada tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:45.691047 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-03457349-4df3-467c-98c7-991a6737735d tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e8f253bac41484ab8e92b74bfa54465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74165fadf5154c319ca56b4aa961e7b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:45.699542 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-03457349-4df3-467c-98c7-991a6737735d tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] 10.222.0.46 "GET /compute/v2.1/servers/26f27adc-8567-4752-8a51-ee9c301b2611" status: 200 len: 1523 microversion: 2.1 time: 0.554232 Jan 15 21:02:45.700129 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2259/4494] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:02:45 2022] GET /compute/v2.1/servers/26f27adc-8567-4752-8a51-ee9c301b2611 => generated 1523 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:02:45.709845 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-850f6dc6-b8d5-48b2-9083-7a85af321245 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:45.713079 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-850f6dc6-b8d5-48b2-9083-7a85af321245 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: d09ef93d-246f-464d-8c9c-f5a6fa14e4fe] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:45.727162 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-850f6dc6-b8d5-48b2-9083-7a85af321245 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:45.727864 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-850f6dc6-b8d5-48b2-9083-7a85af321245 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:45.728903 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-850f6dc6-b8d5-48b2-9083-7a85af321245 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:45.729495 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-850f6dc6-b8d5-48b2-9083-7a85af321245 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:45.748564 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-949146d3-58fb-4956-a81c-12d05621fada tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.115139 Jan 15 21:02:45.753584 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2236/4495] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:02:45 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:02:45.808776 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-850f6dc6-b8d5-48b2-9083-7a85af321245 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "POST /compute/v2.1/servers/d09ef93d-246f-464d-8c9c-f5a6fa14e4fe/action" status: 200 len: 14 microversion: 2.1 time: 0.106477 Jan 15 21:02:45.809616 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2260/4496] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:02:45 2022] POST /compute/v2.1/servers/d09ef93d-246f-464d-8c9c-f5a6fa14e4fe/action => generated 14 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 21:02:45.855410 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-42b1622f-6bdd-4770-88d0-700a0177593d tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:45.856685 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-42b1622f-6bdd-4770-88d0-700a0177593d tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:45.875516 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-42b1622f-6bdd-4770-88d0-700a0177593d tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:45.875884 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-42b1622f-6bdd-4770-88d0-700a0177593d tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:45.876683 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-42b1622f-6bdd-4770-88d0-700a0177593d tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:45.877145 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-42b1622f-6bdd-4770-88d0-700a0177593d tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:45.933298 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-843ad57b-e9ee-488f-bff6-e389786a6829 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:45.933941 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-843ad57b-e9ee-488f-bff6-e389786a6829 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: 9888e0ee-9a2f-4547-a6e3-c77d3493c63f] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:45.942488 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-42b1622f-6bdd-4770-88d0-700a0177593d tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action" status: 200 len: 32580 microversion: 2.1 time: 0.091407 Jan 15 21:02:45.942821 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-843ad57b-e9ee-488f-bff6-e389786a6829 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:45.943153 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2237/4497] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:02:45 2022] POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action => generated 32580 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:02:45.943594 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-843ad57b-e9ee-488f-bff6-e389786a6829 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:45.944582 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-843ad57b-e9ee-488f-bff6-e389786a6829 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:45.945213 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-843ad57b-e9ee-488f-bff6-e389786a6829 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:46.157830 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9cb276fd-29a6-49b4-b35e-4ac1cefc3a9d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:46.159485 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-9cb276fd-29a6-49b4-b35e-4ac1cefc3a9d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:46.176707 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9cb276fd-29a6-49b4-b35e-4ac1cefc3a9d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:46.177623 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9cb276fd-29a6-49b4-b35e-4ac1cefc3a9d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:46.179050 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9cb276fd-29a6-49b4-b35e-4ac1cefc3a9d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:46.179715 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9cb276fd-29a6-49b4-b35e-4ac1cefc3a9d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:46.190770 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-843ad57b-e9ee-488f-bff6-e389786a6829 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb3421bc9494914bc5f797b15a55643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31af2a6b9424f168dd6084d8d5fd0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:46.217095 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-843ad57b-e9ee-488f-bff6-e389786a6829 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/9888e0ee-9a2f-4547-a6e3-c77d3493c63f" status: 200 len: 1292 microversion: 2.1 time: 0.285833 Jan 15 21:02:46.227860 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2261/4498] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:02:45 2022] GET /compute/v2.1/servers/9888e0ee-9a2f-4547-a6e3-c77d3493c63f => generated 1292 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:02:46.233685 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-9cb276fd-29a6-49b4-b35e-4ac1cefc3a9d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.082372 Jan 15 21:02:46.238893 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2238/4499] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:02:46 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:02:46.648552 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-07972c44-95c8-42c0-9e6f-69f2888aad72 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:46.649604 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-07972c44-95c8-42c0-9e6f-69f2888aad72 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:46.662684 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-07972c44-95c8-42c0-9e6f-69f2888aad72 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:46.664052 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-07972c44-95c8-42c0-9e6f-69f2888aad72 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:46.669245 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-07972c44-95c8-42c0-9e6f-69f2888aad72 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:46.670038 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-07972c44-95c8-42c0-9e6f-69f2888aad72 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:46.719338 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-93408a9c-5d98-4efe-8d38-2afbe51c0fb4 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:46.720512 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-93408a9c-5d98-4efe-8d38-2afbe51c0fb4 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] [instance: 26f27adc-8567-4752-8a51-ee9c301b2611] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:46.732374 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-93408a9c-5d98-4efe-8d38-2afbe51c0fb4 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:46.735726 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-93408a9c-5d98-4efe-8d38-2afbe51c0fb4 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:46.738876 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-93408a9c-5d98-4efe-8d38-2afbe51c0fb4 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:46.741385 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-93408a9c-5d98-4efe-8d38-2afbe51c0fb4 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:46.899061 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-07972c44-95c8-42c0-9e6f-69f2888aad72 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:46.911301 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-07972c44-95c8-42c0-9e6f-69f2888aad72 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:46.914361 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-07972c44-95c8-42c0-9e6f-69f2888aad72 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:46.917768 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-07972c44-95c8-42c0-9e6f-69f2888aad72 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0" status: 200 len: 1737 microversion: 2.20 time: 0.273138 Jan 15 21:02:46.929481 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2262/4500] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:02:46 2022] GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0 => generated 1737 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:02:46.935043 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e6bfafc4-7c1e-4540-b1c6-7fc70ba0563b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:46.936867 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e6bfafc4-7c1e-4540-b1c6-7fc70ba0563b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:46.961709 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e6bfafc4-7c1e-4540-b1c6-7fc70ba0563b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:46.962548 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e6bfafc4-7c1e-4540-b1c6-7fc70ba0563b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:46.963572 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e6bfafc4-7c1e-4540-b1c6-7fc70ba0563b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:46.964275 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e6bfafc4-7c1e-4540-b1c6-7fc70ba0563b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:47.052250 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e6bfafc4-7c1e-4540-b1c6-7fc70ba0563b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.120933 Jan 15 21:02:47.053612 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2263/4501] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:02:46 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:02:47.059501 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-93408a9c-5d98-4efe-8d38-2afbe51c0fb4 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e8f253bac41484ab8e92b74bfa54465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74165fadf5154c319ca56b4aa961e7b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:47.072678 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-93408a9c-5d98-4efe-8d38-2afbe51c0fb4 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] 10.222.0.46 "GET /compute/v2.1/servers/26f27adc-8567-4752-8a51-ee9c301b2611" status: 200 len: 1523 microversion: 2.1 time: 0.357859 Jan 15 21:02:47.074160 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2239/4502] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:02:46 2022] GET /compute/v2.1/servers/26f27adc-8567-4752-8a51-ee9c301b2611 => generated 1523 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:02:47.083434 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2e23a2c6-830e-492e-bb77-42a6718393a6 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:47.083434 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-2e23a2c6-830e-492e-bb77-42a6718393a6 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: d09ef93d-246f-464d-8c9c-f5a6fa14e4fe] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:47.088673 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-308b534e-a0d7-4b97-bfa7-e7b47f0b7671 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:47.090006 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-308b534e-a0d7-4b97-bfa7-e7b47f0b7671 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:47.099063 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-308b534e-a0d7-4b97-bfa7-e7b47f0b7671 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:47.099776 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-308b534e-a0d7-4b97-bfa7-e7b47f0b7671 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:47.100807 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-308b534e-a0d7-4b97-bfa7-e7b47f0b7671 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:47.101485 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-308b534e-a0d7-4b97-bfa7-e7b47f0b7671 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:47.111447 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2e23a2c6-830e-492e-bb77-42a6718393a6 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:47.118996 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2e23a2c6-830e-492e-bb77-42a6718393a6 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:47.122953 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2e23a2c6-830e-492e-bb77-42a6718393a6 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:47.123534 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2e23a2c6-830e-492e-bb77-42a6718393a6 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:47.161974 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-308b534e-a0d7-4b97-bfa7-e7b47f0b7671 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action" status: 200 len: 32580 microversion: 2.1 time: 0.075824 Jan 15 21:02:47.168660 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2240/4503] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:02:47 2022] POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action => generated 32580 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:02:47.210893 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2e23a2c6-830e-492e-bb77-42a6718393a6 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "POST /compute/v2.1/servers/d09ef93d-246f-464d-8c9c-f5a6fa14e4fe/action" status: 200 len: 14 microversion: 2.1 time: 0.152963 Jan 15 21:02:47.212024 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2264/4504] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:02:47 2022] POST /compute/v2.1/servers/d09ef93d-246f-464d-8c9c-f5a6fa14e4fe/action => generated 14 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 21:02:47.237542 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-aee019b4-89dd-4a83-9c10-4c52e68b7094 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:47.240737 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-aee019b4-89dd-4a83-9c10-4c52e68b7094 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: 9888e0ee-9a2f-4547-a6e3-c77d3493c63f] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:47.247295 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5a4cdc00-925e-45a8-8457-f8d8a60466ce tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:47.248323 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-5a4cdc00-925e-45a8-8457-f8d8a60466ce tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:47.255381 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-aee019b4-89dd-4a83-9c10-4c52e68b7094 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:47.256011 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-aee019b4-89dd-4a83-9c10-4c52e68b7094 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:47.257568 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-aee019b4-89dd-4a83-9c10-4c52e68b7094 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:47.258154 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-aee019b4-89dd-4a83-9c10-4c52e68b7094 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:47.269004 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5a4cdc00-925e-45a8-8457-f8d8a60466ce tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:47.269590 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5a4cdc00-925e-45a8-8457-f8d8a60466ce tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:47.270292 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5a4cdc00-925e-45a8-8457-f8d8a60466ce tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:47.270731 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5a4cdc00-925e-45a8-8457-f8d8a60466ce tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:47.357430 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5a4cdc00-925e-45a8-8457-f8d8a60466ce tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.114748 Jan 15 21:02:47.358768 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2265/4505] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:02:47 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:02:47.506166 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-aee019b4-89dd-4a83-9c10-4c52e68b7094 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb3421bc9494914bc5f797b15a55643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31af2a6b9424f168dd6084d8d5fd0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:47.520760 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-aee019b4-89dd-4a83-9c10-4c52e68b7094 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/9888e0ee-9a2f-4547-a6e3-c77d3493c63f" status: 200 len: 1292 microversion: 2.1 time: 0.288750 Jan 15 21:02:47.531946 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2241/4506] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:02:47 2022] GET /compute/v2.1/servers/9888e0ee-9a2f-4547-a6e3-c77d3493c63f => generated 1292 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:02:47.952877 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-7877a9a7-fa62-4776-907d-357aae82d80e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:47.956801 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-7877a9a7-fa62-4776-907d-357aae82d80e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:47.964483 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7877a9a7-fa62-4776-907d-357aae82d80e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:47.965131 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7877a9a7-fa62-4776-907d-357aae82d80e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:47.966175 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7877a9a7-fa62-4776-907d-357aae82d80e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:47.966627 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7877a9a7-fa62-4776-907d-357aae82d80e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:48.066415 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-176ae44b-1ed8-43dd-b3a1-91f1a5bc5e6b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:48.067356 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-176ae44b-1ed8-43dd-b3a1-91f1a5bc5e6b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:48.074664 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-176ae44b-1ed8-43dd-b3a1-91f1a5bc5e6b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:48.075129 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-176ae44b-1ed8-43dd-b3a1-91f1a5bc5e6b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:48.075927 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-176ae44b-1ed8-43dd-b3a1-91f1a5bc5e6b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:48.076710 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-176ae44b-1ed8-43dd-b3a1-91f1a5bc5e6b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:48.147808 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-176ae44b-1ed8-43dd-b3a1-91f1a5bc5e6b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.085532 Jan 15 21:02:48.166922 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2242/4507] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:02:48 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:02:48.185533 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a9b03874-9999-4cef-8322-8fb2288b32d0 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:48.186619 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a9b03874-9999-4cef-8322-8fb2288b32d0 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] [instance: 26f27adc-8567-4752-8a51-ee9c301b2611] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:48.198923 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a9b03874-9999-4cef-8322-8fb2288b32d0 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:48.199294 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a9b03874-9999-4cef-8322-8fb2288b32d0 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:48.200122 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a9b03874-9999-4cef-8322-8fb2288b32d0 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:48.200555 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a9b03874-9999-4cef-8322-8fb2288b32d0 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:48.213153 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-7877a9a7-fa62-4776-907d-357aae82d80e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:48.223998 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-7877a9a7-fa62-4776-907d-357aae82d80e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:48.231091 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-7877a9a7-fa62-4776-907d-357aae82d80e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:48.232316 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-7877a9a7-fa62-4776-907d-357aae82d80e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0" status: 200 len: 1737 microversion: 2.20 time: 0.283794 Jan 15 21:02:48.236221 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2266/4508] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:02:47 2022] GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0 => generated 1737 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:02:48.241827 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-4a07767c-1920-4b49-886c-92833f33be7f tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:48.242942 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-4a07767c-1920-4b49-886c-92833f33be7f tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:48.253658 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4a07767c-1920-4b49-886c-92833f33be7f tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:48.254508 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4a07767c-1920-4b49-886c-92833f33be7f tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:48.256210 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4a07767c-1920-4b49-886c-92833f33be7f tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:48.270172 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4a07767c-1920-4b49-886c-92833f33be7f tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:48.318622 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-4a07767c-1920-4b49-886c-92833f33be7f tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action" status: 200 len: 32580 microversion: 2.1 time: 0.080812 Jan 15 21:02:48.319881 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2267/4509] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:02:48 2022] POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action => generated 32580 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:02:48.330232 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9740b122-292c-4acd-ae1d-8b490fd2e53b tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:48.332166 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-9740b122-292c-4acd-ae1d-8b490fd2e53b tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: d09ef93d-246f-464d-8c9c-f5a6fa14e4fe] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:48.340319 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9740b122-292c-4acd-ae1d-8b490fd2e53b tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:48.347879 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9740b122-292c-4acd-ae1d-8b490fd2e53b tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:48.349228 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9740b122-292c-4acd-ae1d-8b490fd2e53b tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:48.355476 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9740b122-292c-4acd-ae1d-8b490fd2e53b tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:48.427997 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-9740b122-292c-4acd-ae1d-8b490fd2e53b tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "POST /compute/v2.1/servers/d09ef93d-246f-464d-8c9c-f5a6fa14e4fe/action" status: 200 len: 14 microversion: 2.1 time: 0.105775 Jan 15 21:02:48.428688 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-a9b03874-9999-4cef-8322-8fb2288b32d0 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e8f253bac41484ab8e92b74bfa54465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74165fadf5154c319ca56b4aa961e7b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:48.441760 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2268/4510] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:02:48 2022] POST /compute/v2.1/servers/d09ef93d-246f-464d-8c9c-f5a6fa14e4fe/action => generated 14 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 21:02:48.448296 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3ce30cb1-f367-4de3-9961-6fc839361908 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:48.449640 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a9b03874-9999-4cef-8322-8fb2288b32d0 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] 10.222.0.46 "GET /compute/v2.1/servers/26f27adc-8567-4752-8a51-ee9c301b2611" status: 200 len: 1523 microversion: 2.1 time: 0.281016 Jan 15 21:02:48.450490 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-3ce30cb1-f367-4de3-9961-6fc839361908 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:48.450981 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2243/4511] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:02:48 2022] GET /compute/v2.1/servers/26f27adc-8567-4752-8a51-ee9c301b2611 => generated 1523 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:02:48.461335 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3ce30cb1-f367-4de3-9961-6fc839361908 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:48.461962 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3ce30cb1-f367-4de3-9961-6fc839361908 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:48.462885 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3ce30cb1-f367-4de3-9961-6fc839361908 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:48.463537 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3ce30cb1-f367-4de3-9961-6fc839361908 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:48.522270 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3ce30cb1-f367-4de3-9961-6fc839361908 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.078446 Jan 15 21:02:48.523826 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2269/4512] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:02:48 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:02:48.538313 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-faa9bc80-0230-4e7e-b1ca-41c57b0284e5 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:48.539163 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-faa9bc80-0230-4e7e-b1ca-41c57b0284e5 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: 9888e0ee-9a2f-4547-a6e3-c77d3493c63f] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:48.546994 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-faa9bc80-0230-4e7e-b1ca-41c57b0284e5 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:48.550066 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-faa9bc80-0230-4e7e-b1ca-41c57b0284e5 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:48.551086 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-faa9bc80-0230-4e7e-b1ca-41c57b0284e5 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:48.551686 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-faa9bc80-0230-4e7e-b1ca-41c57b0284e5 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:48.787494 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-faa9bc80-0230-4e7e-b1ca-41c57b0284e5 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb3421bc9494914bc5f797b15a55643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31af2a6b9424f168dd6084d8d5fd0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:48.804601 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-faa9bc80-0230-4e7e-b1ca-41c57b0284e5 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/9888e0ee-9a2f-4547-a6e3-c77d3493c63f" status: 200 len: 1292 microversion: 2.1 time: 0.270075 Jan 15 21:02:48.805601 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2244/4513] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:02:48 2022] GET /compute/v2.1/servers/9888e0ee-9a2f-4547-a6e3-c77d3493c63f => generated 1292 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:02:48.954815 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-7b35ec04-fa3f-444b-9c39-a0b4291cb7a4 req-f7637a1e-8700-4f56-a928-58a5aab18dd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9888e0ee-9a2f-4547-a6e3-c77d3493c63f", "name": "network-vif-plugged", "status": "completed", "tag": "4596387d-a489-4634-a84b-5a3a77df49cd"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:48.956239 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:02:48.956239 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:02:48.970863 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-7b35ec04-fa3f-444b-9c39-a0b4291cb7a4 req-f7637a1e-8700-4f56-a928-58a5aab18dd2 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:48.971584 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-7b35ec04-fa3f-444b-9c39-a0b4291cb7a4 req-f7637a1e-8700-4f56-a928-58a5aab18dd2 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:48.990370 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-7b35ec04-fa3f-444b-9c39-a0b4291cb7a4 req-f7637a1e-8700-4f56-a928-58a5aab18dd2 service nova] Creating event network-vif-plugged:4596387d-a489-4634-a84b-5a3a77df49cd for instance 9888e0ee-9a2f-4547-a6e3-c77d3493c63f on nch2-master-1 Jan 15 21:02:49.086173 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-7b35ec04-fa3f-444b-9c39-a0b4291cb7a4 req-f7637a1e-8700-4f56-a928-58a5aab18dd2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139204 Jan 15 21:02:49.087200 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2270/4514] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:02:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:02:49.181798 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-77426cef-372e-4cf0-ac28-3b4d47c1460f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:49.183195 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-77426cef-372e-4cf0-ac28-3b4d47c1460f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:49.192785 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-77426cef-372e-4cf0-ac28-3b4d47c1460f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:49.193273 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-77426cef-372e-4cf0-ac28-3b4d47c1460f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:49.194075 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-77426cef-372e-4cf0-ac28-3b4d47c1460f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:49.194512 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-77426cef-372e-4cf0-ac28-3b4d47c1460f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:49.254919 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-6731b08c-4060-4fca-a580-ef72c148ca40 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:49.257032 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-6731b08c-4060-4fca-a580-ef72c148ca40 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:49.266297 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6731b08c-4060-4fca-a580-ef72c148ca40 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:49.266999 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6731b08c-4060-4fca-a580-ef72c148ca40 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:49.268514 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6731b08c-4060-4fca-a580-ef72c148ca40 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:49.269136 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6731b08c-4060-4fca-a580-ef72c148ca40 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:49.281713 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-77426cef-372e-4cf0-ac28-3b4d47c1460f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.119009 Jan 15 21:02:49.288971 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2245/4515] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:02:49 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:02:49.335806 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e9b8076c-58b6-4572-8b85-98bfc1e37a39 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:49.347882 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e9b8076c-58b6-4572-8b85-98bfc1e37a39 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:49.364921 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e9b8076c-58b6-4572-8b85-98bfc1e37a39 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:49.365590 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e9b8076c-58b6-4572-8b85-98bfc1e37a39 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:49.367108 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e9b8076c-58b6-4572-8b85-98bfc1e37a39 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:49.367709 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e9b8076c-58b6-4572-8b85-98bfc1e37a39 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:49.461043 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e9b8076c-58b6-4572-8b85-98bfc1e37a39 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action" status: 200 len: 32580 microversion: 2.1 time: 0.133174 Jan 15 21:02:49.463636 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-6731b08c-4060-4fca-a580-ef72c148ca40 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:49.468594 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2246/4516] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:02:49 2022] POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action => generated 32580 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:02:49.474166 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-5c6f9045-5155-4591-8c98-de6075c03fcc tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:49.475807 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-5c6f9045-5155-4591-8c98-de6075c03fcc tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: d09ef93d-246f-464d-8c9c-f5a6fa14e4fe] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:49.477289 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-6731b08c-4060-4fca-a580-ef72c148ca40 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:49.479115 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-6731b08c-4060-4fca-a580-ef72c148ca40 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:49.480412 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-6731b08c-4060-4fca-a580-ef72c148ca40 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0" status: 200 len: 1737 microversion: 2.20 time: 0.232651 Jan 15 21:02:49.489940 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5c6f9045-5155-4591-8c98-de6075c03fcc tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:49.490904 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5c6f9045-5155-4591-8c98-de6075c03fcc tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:49.491432 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2271/4517] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:02:49 2022] GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0 => generated 1737 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 15 21:02:49.492193 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5c6f9045-5155-4591-8c98-de6075c03fcc tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:49.492868 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5c6f9045-5155-4591-8c98-de6075c03fcc tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:49.496104 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-fc3f5597-2bb1-4dd0-9681-cca7cfccf63b tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:49.496710 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-fc3f5597-2bb1-4dd0-9681-cca7cfccf63b tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] [instance: 26f27adc-8567-4752-8a51-ee9c301b2611] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:49.512949 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fc3f5597-2bb1-4dd0-9681-cca7cfccf63b tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:49.513408 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fc3f5597-2bb1-4dd0-9681-cca7cfccf63b tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:49.514217 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fc3f5597-2bb1-4dd0-9681-cca7cfccf63b tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:49.514649 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fc3f5597-2bb1-4dd0-9681-cca7cfccf63b tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:49.557988 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-5c6f9045-5155-4591-8c98-de6075c03fcc tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "POST /compute/v2.1/servers/d09ef93d-246f-464d-8c9c-f5a6fa14e4fe/action" status: 200 len: 14 microversion: 2.1 time: 0.087574 Jan 15 21:02:49.564636 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2247/4518] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:02:49 2022] POST /compute/v2.1/servers/d09ef93d-246f-464d-8c9c-f5a6fa14e4fe/action => generated 14 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 21:02:49.572333 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-34e3a6ac-11d3-4c3b-91b7-7c2a6125c7f5 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:49.573366 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-34e3a6ac-11d3-4c3b-91b7-7c2a6125c7f5 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:49.582029 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-34e3a6ac-11d3-4c3b-91b7-7c2a6125c7f5 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:49.582790 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-34e3a6ac-11d3-4c3b-91b7-7c2a6125c7f5 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:49.583765 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-34e3a6ac-11d3-4c3b-91b7-7c2a6125c7f5 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:49.584359 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-34e3a6ac-11d3-4c3b-91b7-7c2a6125c7f5 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:49.745807 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-34e3a6ac-11d3-4c3b-91b7-7c2a6125c7f5 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.179581 Jan 15 21:02:49.750555 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2248/4519] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:02:49 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:02:49.752873 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-fc3f5597-2bb1-4dd0-9681-cca7cfccf63b tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e8f253bac41484ab8e92b74bfa54465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74165fadf5154c319ca56b4aa961e7b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:49.766441 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-fc3f5597-2bb1-4dd0-9681-cca7cfccf63b tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] 10.222.0.46 "GET /compute/v2.1/servers/26f27adc-8567-4752-8a51-ee9c301b2611" status: 200 len: 1523 microversion: 2.1 time: 0.272995 Jan 15 21:02:49.767216 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2272/4520] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:02:49 2022] GET /compute/v2.1/servers/26f27adc-8567-4752-8a51-ee9c301b2611 => generated 1523 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:02:49.825502 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9b999414-b068-4af0-b882-6d7466bcb098 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:49.826392 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-9b999414-b068-4af0-b882-6d7466bcb098 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: 9888e0ee-9a2f-4547-a6e3-c77d3493c63f] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:49.843509 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9b999414-b068-4af0-b882-6d7466bcb098 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:49.844445 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9b999414-b068-4af0-b882-6d7466bcb098 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:49.845043 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9b999414-b068-4af0-b882-6d7466bcb098 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:49.845486 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9b999414-b068-4af0-b882-6d7466bcb098 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:50.045467 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-9b999414-b068-4af0-b882-6d7466bcb098 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb3421bc9494914bc5f797b15a55643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31af2a6b9424f168dd6084d8d5fd0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:50.053797 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-9b999414-b068-4af0-b882-6d7466bcb098 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/9888e0ee-9a2f-4547-a6e3-c77d3493c63f" status: 200 len: 1292 microversion: 2.1 time: 0.232477 Jan 15 21:02:50.054644 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2249/4521] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:02:49 2022] GET /compute/v2.1/servers/9888e0ee-9a2f-4547-a6e3-c77d3493c63f => generated 1292 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:02:50.297536 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e8a07c6b-371f-4bc6-8e25-7b8d2bd2b194 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:50.299021 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e8a07c6b-371f-4bc6-8e25-7b8d2bd2b194 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:50.308099 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e8a07c6b-371f-4bc6-8e25-7b8d2bd2b194 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:50.308860 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e8a07c6b-371f-4bc6-8e25-7b8d2bd2b194 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:50.310232 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e8a07c6b-371f-4bc6-8e25-7b8d2bd2b194 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:50.310976 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e8a07c6b-371f-4bc6-8e25-7b8d2bd2b194 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:50.393357 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e8a07c6b-371f-4bc6-8e25-7b8d2bd2b194 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.100756 Jan 15 21:02:50.394322 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2273/4522] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:02:50 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:02:50.481631 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9f242439-c66e-45ee-8dca-99068cf470b8 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:50.482581 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-9f242439-c66e-45ee-8dca-99068cf470b8 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:50.502331 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9f242439-c66e-45ee-8dca-99068cf470b8 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:50.503037 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9f242439-c66e-45ee-8dca-99068cf470b8 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:50.504614 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9f242439-c66e-45ee-8dca-99068cf470b8 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:50.505172 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e08e433a-44dd-4199-8d19-6c0ce5b92566 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:50.505443 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9f242439-c66e-45ee-8dca-99068cf470b8 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:50.506078 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e08e433a-44dd-4199-8d19-6c0ce5b92566 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:50.514909 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e08e433a-44dd-4199-8d19-6c0ce5b92566 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:50.516014 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e08e433a-44dd-4199-8d19-6c0ce5b92566 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:50.521181 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e08e433a-44dd-4199-8d19-6c0ce5b92566 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:50.521754 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e08e433a-44dd-4199-8d19-6c0ce5b92566 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:50.561077 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-9f242439-c66e-45ee-8dca-99068cf470b8 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action" status: 200 len: 32580 microversion: 2.1 time: 0.089955 Jan 15 21:02:50.567942 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2250/4523] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:02:50 2022] POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action => generated 32580 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 21:02:50.576182 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a988dd47-7deb-4f2c-8c74-97f677cd7879 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:50.577256 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a988dd47-7deb-4f2c-8c74-97f677cd7879 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: d09ef93d-246f-464d-8c9c-f5a6fa14e4fe] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:50.585991 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a988dd47-7deb-4f2c-8c74-97f677cd7879 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:50.586721 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a988dd47-7deb-4f2c-8c74-97f677cd7879 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:50.587888 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a988dd47-7deb-4f2c-8c74-97f677cd7879 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:50.588884 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a988dd47-7deb-4f2c-8c74-97f677cd7879 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:50.661553 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a988dd47-7deb-4f2c-8c74-97f677cd7879 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "POST /compute/v2.1/servers/d09ef93d-246f-464d-8c9c-f5a6fa14e4fe/action" status: 200 len: 8208 microversion: 2.1 time: 0.091358 Jan 15 21:02:50.669404 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2251/4524] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:02:50 2022] POST /compute/v2.1/servers/d09ef93d-246f-464d-8c9c-f5a6fa14e4fe/action => generated 8208 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:02:50.677116 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-5b965ad1-ae3e-4bfc-b036-8800a5d5c9f5 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:50.677831 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-5b965ad1-ae3e-4bfc-b036-8800a5d5c9f5 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:50.686861 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5b965ad1-ae3e-4bfc-b036-8800a5d5c9f5 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:50.688240 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5b965ad1-ae3e-4bfc-b036-8800a5d5c9f5 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:50.689244 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5b965ad1-ae3e-4bfc-b036-8800a5d5c9f5 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:50.689882 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5b965ad1-ae3e-4bfc-b036-8800a5d5c9f5 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:50.731017 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-e08e433a-44dd-4199-8d19-6c0ce5b92566 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:50.740282 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-e08e433a-44dd-4199-8d19-6c0ce5b92566 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:50.742802 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-e08e433a-44dd-4199-8d19-6c0ce5b92566 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:50.744415 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e08e433a-44dd-4199-8d19-6c0ce5b92566 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0" status: 200 len: 1737 microversion: 2.20 time: 0.244557 Jan 15 21:02:50.745770 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2274/4525] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:02:50 2022] GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0 => generated 1737 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 15 21:02:50.761103 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-7aa335f6-79fb-4cee-b01b-17cdf32f8130 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:50.762690 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-7aa335f6-79fb-4cee-b01b-17cdf32f8130 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:50.770302 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7aa335f6-79fb-4cee-b01b-17cdf32f8130 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:50.771354 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7aa335f6-79fb-4cee-b01b-17cdf32f8130 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:50.772356 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7aa335f6-79fb-4cee-b01b-17cdf32f8130 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:50.773034 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7aa335f6-79fb-4cee-b01b-17cdf32f8130 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:50.847707 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-7aa335f6-79fb-4cee-b01b-17cdf32f8130 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.091740 Jan 15 21:02:50.853418 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2275/4526] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:02:50 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:02:50.860140 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b01d9f2a-8da0-4835-8a99-f0e7b72de740 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:50.861054 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b01d9f2a-8da0-4835-8a99-f0e7b72de740 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] [instance: 26f27adc-8567-4752-8a51-ee9c301b2611] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:50.863902 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-5b965ad1-ae3e-4bfc-b036-8800a5d5c9f5 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:50.870829 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b01d9f2a-8da0-4835-8a99-f0e7b72de740 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:50.871712 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b01d9f2a-8da0-4835-8a99-f0e7b72de740 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:50.871997 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-5b965ad1-ae3e-4bfc-b036-8800a5d5c9f5 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9" status: 200 len: 1670 microversion: 2.1 time: 0.201321 Jan 15 21:02:50.872889 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2252/4527] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:02:50 2022] GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9 => generated 1670 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:02:50.873205 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b01d9f2a-8da0-4835-8a99-f0e7b72de740 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:50.873964 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b01d9f2a-8da0-4835-8a99-f0e7b72de740 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:50.898625 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d60bdc51-6a8b-4586-8fb3-91422ea2ce23 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:50.899649 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-d60bdc51-6a8b-4586-8fb3-91422ea2ce23 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:50.907328 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d60bdc51-6a8b-4586-8fb3-91422ea2ce23 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:50.908144 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d60bdc51-6a8b-4586-8fb3-91422ea2ce23 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:50.909179 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d60bdc51-6a8b-4586-8fb3-91422ea2ce23 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:50.909893 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d60bdc51-6a8b-4586-8fb3-91422ea2ce23 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:51.111091 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-d60bdc51-6a8b-4586-8fb3-91422ea2ce23 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:51.112929 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-b01d9f2a-8da0-4835-8a99-f0e7b72de740 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e8f253bac41484ab8e92b74bfa54465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74165fadf5154c319ca56b4aa961e7b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:51.121001 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b01d9f2a-8da0-4835-8a99-f0e7b72de740 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] 10.222.0.46 "GET /compute/v2.1/servers/26f27adc-8567-4752-8a51-ee9c301b2611" status: 200 len: 1523 microversion: 2.1 time: 0.266185 Jan 15 21:02:51.126218 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2276/4528] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:02:50 2022] GET /compute/v2.1/servers/26f27adc-8567-4752-8a51-ee9c301b2611 => generated 1523 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:02:51.128528 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d60bdc51-6a8b-4586-8fb3-91422ea2ce23 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9" status: 200 len: 1670 microversion: 2.1 time: 0.234104 Jan 15 21:02:51.140783 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2253/4529] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:02:50 2022] GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9 => generated 1670 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:02:51.146291 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-260cb283-5549-4961-8bc6-41d4b621d861 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:51.150093 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-260cb283-5549-4961-8bc6-41d4b621d861 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: 9888e0ee-9a2f-4547-a6e3-c77d3493c63f] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:51.155962 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-6c05259e-9cf5-47b6-95e3-535dbb788395 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:51.158133 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-6c05259e-9cf5-47b6-95e3-535dbb788395 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:51.163776 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-260cb283-5549-4961-8bc6-41d4b621d861 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:51.168498 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-260cb283-5549-4961-8bc6-41d4b621d861 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:51.173062 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6c05259e-9cf5-47b6-95e3-535dbb788395 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:51.173226 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-260cb283-5549-4961-8bc6-41d4b621d861 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:51.173518 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6c05259e-9cf5-47b6-95e3-535dbb788395 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:51.174324 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6c05259e-9cf5-47b6-95e3-535dbb788395 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:51.174560 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-260cb283-5549-4961-8bc6-41d4b621d861 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:51.180463 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6c05259e-9cf5-47b6-95e3-535dbb788395 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:51.264165 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-6c05259e-9cf5-47b6-95e3-535dbb788395 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Locking {{(pid=129366) lock /opt/stack/nova/nova/compute/api.py:4624}} Jan 15 21:02:51.342781 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-6c05259e-9cf5-47b6-95e3-535dbb788395 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action" status: 202 len: 0 microversion: 2.1 time: 0.196111 Jan 15 21:02:51.347869 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2254/4530] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:02:51 2022] POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:02:51.353802 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d6c0edcf-7f8f-4e9a-9452-de456e8b7440 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:51.354895 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-d6c0edcf-7f8f-4e9a-9452-de456e8b7440 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:51.361931 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d6c0edcf-7f8f-4e9a-9452-de456e8b7440 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:51.362664 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d6c0edcf-7f8f-4e9a-9452-de456e8b7440 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:51.363755 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d6c0edcf-7f8f-4e9a-9452-de456e8b7440 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:51.364415 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d6c0edcf-7f8f-4e9a-9452-de456e8b7440 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:51.473595 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-260cb283-5549-4961-8bc6-41d4b621d861 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb3421bc9494914bc5f797b15a55643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31af2a6b9424f168dd6084d8d5fd0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:51.485252 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-260cb283-5549-4961-8bc6-41d4b621d861 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/9888e0ee-9a2f-4547-a6e3-c77d3493c63f" status: 200 len: 1474 microversion: 2.1 time: 0.357427 Jan 15 21:02:51.486282 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2277/4531] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:02:51 2022] GET /compute/v2.1/servers/9888e0ee-9a2f-4547-a6e3-c77d3493c63f => generated 1474 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:02:51.507154 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-de09d991-8b1e-42d9-8986-893a88e94664 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:51.507998 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-de09d991-8b1e-42d9-8986-893a88e94664 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:51.519543 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-de09d991-8b1e-42d9-8986-893a88e94664 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:51.520014 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-de09d991-8b1e-42d9-8986-893a88e94664 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:51.520921 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-de09d991-8b1e-42d9-8986-893a88e94664 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:51.522195 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-de09d991-8b1e-42d9-8986-893a88e94664 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:51.561106 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-d6c0edcf-7f8f-4e9a-9452-de456e8b7440 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:51.571833 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d6c0edcf-7f8f-4e9a-9452-de456e8b7440 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9" status: 200 len: 1670 microversion: 2.1 time: 0.222532 Jan 15 21:02:51.573007 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2255/4532] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:02:51 2022] GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9 => generated 1670 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:02:51.577455 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f9fe10c6-10e2-4457-843d-1b2459807fb9 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:51.578984 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f9fe10c6-10e2-4457-843d-1b2459807fb9 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:51.587637 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f9fe10c6-10e2-4457-843d-1b2459807fb9 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:51.588156 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f9fe10c6-10e2-4457-843d-1b2459807fb9 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:51.588858 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f9fe10c6-10e2-4457-843d-1b2459807fb9 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:51.589516 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f9fe10c6-10e2-4457-843d-1b2459807fb9 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:51.612374 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-de09d991-8b1e-42d9-8986-893a88e94664 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.117082 Jan 15 21:02:51.616589 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2278/4533] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:02:51 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:02:51.618848 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-77f42453-6628-4d23-a9d0-a912a11b1749 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-583413066", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0b7cce2c-2308-43f4-b72e-8ea5d98a7ae1"}]}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:51.659325 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f9fe10c6-10e2-4457-843d-1b2459807fb9 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action" status: 200 len: 32580 microversion: 2.1 time: 0.085012 Jan 15 21:02:51.660018 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2256/4534] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:02:51 2022] POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action => generated 32580 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:02:51.667711 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-cecfa348-49e9-4c0b-bf20-33c0549ac770 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:51.678810 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cecfa348-49e9-4c0b-bf20-33c0549ac770 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:51.679425 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cecfa348-49e9-4c0b-bf20-33c0549ac770 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:51.683047 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.network.neutron [None req-77f42453-6628-4d23-a9d0-a912a11b1749 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] validate_networks() for [('0b7cce2c-2308-43f4-b72e-8ea5d98a7ae1', None, None, None, None, None)] {{(pid=129365) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 21:02:51.714380 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-cecfa348-49e9-4c0b-bf20-33c0549ac770 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] HTTP exception thrown: Instance 4504a13b-d10e-436a-a5ef-991829938dd9 is locked Jan 15 21:02:51.715240 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-cecfa348-49e9-4c0b-bf20-33c0549ac770 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Returning 409 to user: Instance 4504a13b-d10e-436a-a5ef-991829938dd9 is locked {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:02:51.716376 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-cecfa348-49e9-4c0b-bf20-33c0549ac770 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action" status: 409 len: 107 microversion: 2.1 time: 0.055293 Jan 15 21:02:51.717424 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2257/4535] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:02:51 2022] POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action => generated 107 bytes in 57 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jan 15 21:02:51.726610 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-efad9a96-004b-4308-925c-4b37a56ef60d tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:51.727491 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-efad9a96-004b-4308-925c-4b37a56ef60d tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:51.734925 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-efad9a96-004b-4308-925c-4b37a56ef60d tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:51.736451 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-efad9a96-004b-4308-925c-4b37a56ef60d tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:51.737514 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-efad9a96-004b-4308-925c-4b37a56ef60d tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:51.738130 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-efad9a96-004b-4308-925c-4b37a56ef60d tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:51.795352 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-efad9a96-004b-4308-925c-4b37a56ef60d tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Unlocking {{(pid=129366) unlock /opt/stack/nova/nova/compute/api.py:4653}} Jan 15 21:02:51.857802 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-efad9a96-004b-4308-925c-4b37a56ef60d tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action" status: 202 len: 0 microversion: 2.1 time: 0.135669 Jan 15 21:02:51.859204 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2258/4536] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:02:51 2022] POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:02:51.866533 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c6f03047-4647-4c41-bf4b-a29d1edc0bab tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:51.867315 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c6f03047-4647-4c41-bf4b-a29d1edc0bab tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:51.875202 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c6f03047-4647-4c41-bf4b-a29d1edc0bab tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:51.876413 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c6f03047-4647-4c41-bf4b-a29d1edc0bab tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:51.877439 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c6f03047-4647-4c41-bf4b-a29d1edc0bab tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:51.877989 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c6f03047-4647-4c41-bf4b-a29d1edc0bab tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:52.588868 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-c6f03047-4647-4c41-bf4b-a29d1edc0bab tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:52.606044 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-c6f03047-4647-4c41-bf4b-a29d1edc0bab tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:52.608198 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-c6f03047-4647-4c41-bf4b-a29d1edc0bab tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:52.611499 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c6f03047-4647-4c41-bf4b-a29d1edc0bab tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0" status: 200 len: 1719 microversion: 2.20 time: 0.750642 Jan 15 21:02:52.628163 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2259/4537] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:02:51 2022] GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0 => generated 1719 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:02:52.635373 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-debf62f7-ea05-4cdb-a63c-aa43a45264af tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:52.636694 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-debf62f7-ea05-4cdb-a63c-aa43a45264af tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:52.645729 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-debf62f7-ea05-4cdb-a63c-aa43a45264af tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:52.646620 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-debf62f7-ea05-4cdb-a63c-aa43a45264af tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:52.647563 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-debf62f7-ea05-4cdb-a63c-aa43a45264af tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:52.648336 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-debf62f7-ea05-4cdb-a63c-aa43a45264af tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:52.705637 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-debf62f7-ea05-4cdb-a63c-aa43a45264af tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.075508 Jan 15 21:02:52.706666 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2260/4538] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:02:52 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:02:52.712172 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ace30b99-37d4-4075-89cd-13509ede6335 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:52.721140 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ace30b99-37d4-4075-89cd-13509ede6335 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:52.721719 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ace30b99-37d4-4075-89cd-13509ede6335 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:52.755822 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ace30b99-37d4-4075-89cd-13509ede6335 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Going to try to stop instance {{(pid=129366) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Jan 15 21:02:52.820832 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ace30b99-37d4-4075-89cd-13509ede6335 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action" status: 202 len: 0 microversion: 2.1 time: 0.112641 Jan 15 21:02:52.821616 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2261/4539] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:02:52 2022] POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:02:52.834221 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-846df658-54f5-4d5f-b1f3-d03da41d8769 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:52.835069 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-846df658-54f5-4d5f-b1f3-d03da41d8769 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] [instance: 26f27adc-8567-4752-8a51-ee9c301b2611] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:52.846458 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-846df658-54f5-4d5f-b1f3-d03da41d8769 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:52.846981 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-846df658-54f5-4d5f-b1f3-d03da41d8769 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:52.848402 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-846df658-54f5-4d5f-b1f3-d03da41d8769 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:52.849128 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-846df658-54f5-4d5f-b1f3-d03da41d8769 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:52.974053 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-77f42453-6628-4d23-a9d0-a912a11b1749 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Flavor limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 21:02:52.974554 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-77f42453-6628-4d23-a9d0-a912a11b1749 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Image limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 21:02:52.974951 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-77f42453-6628-4d23-a9d0-a912a11b1749 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Flavor pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 21:02:52.975365 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-77f42453-6628-4d23-a9d0-a912a11b1749 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Image pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 21:02:52.975977 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-77f42453-6628-4d23-a9d0-a912a11b1749 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 21:02:52.985713 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-77f42453-6628-4d23-a9d0-a912a11b1749 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:52.986408 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-77f42453-6628-4d23-a9d0-a912a11b1749 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:52.987390 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-77f42453-6628-4d23-a9d0-a912a11b1749 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:52.988023 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-77f42453-6628-4d23-a9d0-a912a11b1749 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:53.013846 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-77f42453-6628-4d23-a9d0-a912a11b1749 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Getting quotas for project d31af2a6b9424f168dd6084d8d5fd0c4. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:02:53.020450 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-77f42453-6628-4d23-a9d0-a912a11b1749 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Getting quotas for user 9eb3421bc9494914bc5f797b15a55643 and project d31af2a6b9424f168dd6084d8d5fd0c4. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:02:53.035402 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-77f42453-6628-4d23-a9d0-a912a11b1749 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Going to run 1 instances... {{(pid=129365) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 21:02:53.038592 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-77f42453-6628-4d23-a9d0-a912a11b1749 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: 3ddece38-eaf4-4f3a-8f5e-5663727f8574] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129365) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 21:02:53.110425 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-77f42453-6628-4d23-a9d0-a912a11b1749 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.495571 Jan 15 21:02:53.115999 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2279/4540] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 21:02:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1497 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 21:02:53.116182 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-855668dc-fea6-4436-b691-11750a95b658 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:53.117056 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-855668dc-fea6-4436-b691-11750a95b658 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:53.123921 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-855668dc-fea6-4436-b691-11750a95b658 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:53.124381 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-855668dc-fea6-4436-b691-11750a95b658 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:53.125906 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-855668dc-fea6-4436-b691-11750a95b658 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:53.126353 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-855668dc-fea6-4436-b691-11750a95b658 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:53.179546 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-855668dc-fea6-4436-b691-11750a95b658 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.066759 Jan 15 21:02:53.180219 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2280/4541] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:02:53 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:02:53.188881 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-31e12930-0605-4603-96a9-39de6329bf6d tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:53.189833 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-31e12930-0605-4603-96a9-39de6329bf6d tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:53.197207 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-31e12930-0605-4603-96a9-39de6329bf6d tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:53.197673 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-31e12930-0605-4603-96a9-39de6329bf6d tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:53.198452 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-31e12930-0605-4603-96a9-39de6329bf6d tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:53.198890 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-31e12930-0605-4603-96a9-39de6329bf6d tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:53.226461 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-846df658-54f5-4d5f-b1f3-d03da41d8769 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e8f253bac41484ab8e92b74bfa54465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74165fadf5154c319ca56b4aa961e7b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:53.240341 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-846df658-54f5-4d5f-b1f3-d03da41d8769 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] 10.222.0.46 "GET /compute/v2.1/servers/26f27adc-8567-4752-8a51-ee9c301b2611" status: 200 len: 1523 microversion: 2.1 time: 0.414681 Jan 15 21:02:53.242176 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2262/4542] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:02:52 2022] GET /compute/v2.1/servers/26f27adc-8567-4752-8a51-ee9c301b2611 => generated 1523 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:02:53.250907 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b481ba67-ee35-4d40-b106-d2a49e821d75 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:53.251516 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b481ba67-ee35-4d40-b106-d2a49e821d75 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:53.261049 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-31e12930-0605-4603-96a9-39de6329bf6d tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action" status: 200 len: 40733 microversion: 2.1 time: 0.077176 Jan 15 21:02:53.263428 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2281/4543] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:02:53 2022] POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action => generated 40733 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:02:53.271268 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b481ba67-ee35-4d40-b106-d2a49e821d75 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:53.272306 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b481ba67-ee35-4d40-b106-d2a49e821d75 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:53.274717 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b481ba67-ee35-4d40-b106-d2a49e821d75 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:53.275292 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b481ba67-ee35-4d40-b106-d2a49e821d75 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:53.277995 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c25fa5e5-f44d-4273-907e-4a9c46e2ab7f tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:53.278768 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c25fa5e5-f44d-4273-907e-4a9c46e2ab7f tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: 3ddece38-eaf4-4f3a-8f5e-5663727f8574] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:53.337133 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c25fa5e5-f44d-4273-907e-4a9c46e2ab7f tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: 3ddece38-eaf4-4f3a-8f5e-5663727f8574] Going to try to terminate instance {{(pid=129365) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 21:02:53.551122 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-b481ba67-ee35-4d40-b106-d2a49e821d75 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:53.560684 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b481ba67-ee35-4d40-b106-d2a49e821d75 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9" status: 200 len: 1680 microversion: 2.1 time: 0.317723 Jan 15 21:02:53.572692 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2263/4544] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:02:53 2022] GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9 => generated 1680 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:02:53.577528 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-6cc9d038-19bd-4910-a519-a0086c364d78 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:53.580351 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-6cc9d038-19bd-4910-a519-a0086c364d78 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:53.596772 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6cc9d038-19bd-4910-a519-a0086c364d78 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:53.598057 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6cc9d038-19bd-4910-a519-a0086c364d78 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:53.599011 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6cc9d038-19bd-4910-a519-a0086c364d78 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:53.599597 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6cc9d038-19bd-4910-a519-a0086c364d78 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:53.666588 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-6cc9d038-19bd-4910-a519-a0086c364d78 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "GET /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/ips" status: 200 len: 145 microversion: 2.1 time: 0.089391 Jan 15 21:02:53.667761 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2264/4545] 10.222.0.46 () {58 vars in 1247 bytes} [Sat Jan 15 21:02:53 2022] GET /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/ips => generated 145 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:02:53.678290 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-fe10ec02-b979-4593-863f-e1e52ef78195 req-863212dd-e7a4-4fdf-8139-073be2795679 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ac722a3-aadf-4791-b5b1-e5e5efebddc0", "name": "network-vif-unplugged", "status": "completed", "tag": "6d958b2a-aaab-40bf-8bb7-ce4cd3fc57b5"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:53.680122 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:02:53.680122 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:02:53.688993 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-fe10ec02-b979-4593-863f-e1e52ef78195 req-863212dd-e7a4-4fdf-8139-073be2795679 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:53.689667 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-fe10ec02-b979-4593-863f-e1e52ef78195 req-863212dd-e7a4-4fdf-8139-073be2795679 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:53.702168 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-fe10ec02-b979-4593-863f-e1e52ef78195 req-863212dd-e7a4-4fdf-8139-073be2795679 service nova] Creating event network-vif-unplugged:6d958b2a-aaab-40bf-8bb7-ce4cd3fc57b5 for instance 0ac722a3-aadf-4791-b5b1-e5e5efebddc0 on nch1-master-1 Jan 15 21:02:53.711441 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-fe10ec02-b979-4593-863f-e1e52ef78195 req-863212dd-e7a4-4fdf-8139-073be2795679 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037944 Jan 15 21:02:53.714929 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2265/4546] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:02:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:02:53.724440 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0380eb2d-b9b0-406c-9ef4-237e43df4399 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:53.725102 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-0380eb2d-b9b0-406c-9ef4-237e43df4399 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:53.732367 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0380eb2d-b9b0-406c-9ef4-237e43df4399 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:53.732919 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0380eb2d-b9b0-406c-9ef4-237e43df4399 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:53.734018 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0380eb2d-b9b0-406c-9ef4-237e43df4399 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:53.734773 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0380eb2d-b9b0-406c-9ef4-237e43df4399 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:53.746112 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.scheduler.client.report [None req-c25fa5e5-f44d-4273-907e-4a9c46e2ab7f tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Deleted allocations for instance 3ddece38-eaf4-4f3a-8f5e-5663727f8574 Jan 15 21:02:53.755152 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.compute.api [None req-c25fa5e5-f44d-4273-907e-4a9c46e2ab7f tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: 3ddece38-eaf4-4f3a-8f5e-5663727f8574] Instance Mapping does not exist while attempting local delete cleanup. Jan 15 21:02:53.756386 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c25fa5e5-f44d-4273-907e-4a9c46e2ab7f tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "DELETE /compute/v2.1/servers/3ddece38-eaf4-4f3a-8f5e-5663727f8574" status: 204 len: 0 microversion: 2.1 time: 0.489684 Jan 15 21:02:53.759541 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2282/4547] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 21:02:53 2022] DELETE /compute/v2.1/servers/3ddece38-eaf4-4f3a-8f5e-5663727f8574 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 21:02:53.774496 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-26d3d8c9-bb4a-4d5b-b133-16b57a87646f tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:53.775499 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-26d3d8c9-bb4a-4d5b-b133-16b57a87646f tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:53.789988 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-26d3d8c9-bb4a-4d5b-b133-16b57a87646f tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:53.790437 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-26d3d8c9-bb4a-4d5b-b133-16b57a87646f tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:53.795280 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-26d3d8c9-bb4a-4d5b-b133-16b57a87646f tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:53.795578 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-26d3d8c9-bb4a-4d5b-b133-16b57a87646f tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:53.860017 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-26d3d8c9-bb4a-4d5b-b133-16b57a87646f tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.098823 Jan 15 21:02:53.863211 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2283/4548] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:02:53 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:02:53.869060 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a126ff84-07b4-494e-b31a-e5a30eb6e67b tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:53.870731 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a126ff84-07b4-494e-b31a-e5a30eb6e67b tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: 3ddece38-eaf4-4f3a-8f5e-5663727f8574] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:53.886374 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-a126ff84-07b4-494e-b31a-e5a30eb6e67b tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] HTTP exception thrown: Instance 3ddece38-eaf4-4f3a-8f5e-5663727f8574 could not be found. Jan 15 21:02:53.887403 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a126ff84-07b4-494e-b31a-e5a30eb6e67b tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Returning 404 to user: Instance 3ddece38-eaf4-4f3a-8f5e-5663727f8574 could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:02:53.889636 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a126ff84-07b4-494e-b31a-e5a30eb6e67b tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/3ddece38-eaf4-4f3a-8f5e-5663727f8574" status: 404 len: 111 microversion: 2.1 time: 0.023881 Jan 15 21:02:53.900226 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2284/4549] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:02:53 2022] GET /compute/v2.1/servers/3ddece38-eaf4-4f3a-8f5e-5663727f8574 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:02:53.949256 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2d847a7f-c6aa-458f-9a63-6bfd1856c93d tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1491595855", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "0b7cce2c-2308-43f4-b72e-8ea5d98a7ae1"}]}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:54.019005 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.network.neutron [None req-2d847a7f-c6aa-458f-9a63-6bfd1856c93d tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] validate_networks() for [('0b7cce2c-2308-43f4-b72e-8ea5d98a7ae1', None, None, None, None, None)] {{(pid=129365) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 21:02:54.127270 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-0380eb2d-b9b0-406c-9ef4-237e43df4399 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:54.137338 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-0380eb2d-b9b0-406c-9ef4-237e43df4399 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:54.139176 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-0380eb2d-b9b0-406c-9ef4-237e43df4399 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:54.141488 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0380eb2d-b9b0-406c-9ef4-237e43df4399 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0" status: 200 len: 1719 microversion: 2.20 time: 0.423378 Jan 15 21:02:54.152143 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2266/4550] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:02:53 2022] GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0 => generated 1719 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:02:54.194080 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1d2650ee-6087-4c32-b88c-1d958564ed2e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:54.194986 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-1d2650ee-6087-4c32-b88c-1d958564ed2e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:54.200764 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1d2650ee-6087-4c32-b88c-1d958564ed2e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:54.201257 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1d2650ee-6087-4c32-b88c-1d958564ed2e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:54.202055 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1d2650ee-6087-4c32-b88c-1d958564ed2e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:54.202495 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1d2650ee-6087-4c32-b88c-1d958564ed2e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:54.255639 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-1d2650ee-6087-4c32-b88c-1d958564ed2e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.065503 Jan 15 21:02:54.256570 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2267/4551] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:02:54 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:02:54.268420 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a3075f4f-b1c4-4b1a-a2ce-6d4d85659928 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:54.269174 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a3075f4f-b1c4-4b1a-a2ce-6d4d85659928 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] [instance: 26f27adc-8567-4752-8a51-ee9c301b2611] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:54.280248 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a3075f4f-b1c4-4b1a-a2ce-6d4d85659928 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:54.280760 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a3075f4f-b1c4-4b1a-a2ce-6d4d85659928 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:54.282216 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a3075f4f-b1c4-4b1a-a2ce-6d4d85659928 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:54.282216 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a3075f4f-b1c4-4b1a-a2ce-6d4d85659928 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:54.741011 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-a3075f4f-b1c4-4b1a-a2ce-6d4d85659928 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e8f253bac41484ab8e92b74bfa54465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74165fadf5154c319ca56b4aa961e7b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:54.752235 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a3075f4f-b1c4-4b1a-a2ce-6d4d85659928 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] 10.222.0.46 "GET /compute/v2.1/servers/26f27adc-8567-4752-8a51-ee9c301b2611" status: 200 len: 1523 microversion: 2.1 time: 0.492831 Jan 15 21:02:54.752880 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2268/4552] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:02:54 2022] GET /compute/v2.1/servers/26f27adc-8567-4752-8a51-ee9c301b2611 => generated 1523 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:02:54.757850 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ef2fc4ce-5fee-499a-afe4-a770c9d5ea29 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:54.758457 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ef2fc4ce-5fee-499a-afe4-a770c9d5ea29 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:54.765964 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ef2fc4ce-5fee-499a-afe4-a770c9d5ea29 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:54.766299 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ef2fc4ce-5fee-499a-afe4-a770c9d5ea29 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:54.767416 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ef2fc4ce-5fee-499a-afe4-a770c9d5ea29 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:54.767875 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ef2fc4ce-5fee-499a-afe4-a770c9d5ea29 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:54.967030 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-2d847a7f-c6aa-458f-9a63-6bfd1856c93d tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Flavor limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 21:02:54.967504 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-2d847a7f-c6aa-458f-9a63-6bfd1856c93d tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Image limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 21:02:54.968905 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-2d847a7f-c6aa-458f-9a63-6bfd1856c93d tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Flavor pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 21:02:54.969995 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-2d847a7f-c6aa-458f-9a63-6bfd1856c93d tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Image pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 21:02:54.970501 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-2d847a7f-c6aa-458f-9a63-6bfd1856c93d tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 21:02:54.989608 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2d847a7f-c6aa-458f-9a63-6bfd1856c93d tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:54.990091 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2d847a7f-c6aa-458f-9a63-6bfd1856c93d tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:54.991016 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2d847a7f-c6aa-458f-9a63-6bfd1856c93d tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:54.991455 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2d847a7f-c6aa-458f-9a63-6bfd1856c93d tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:55.023337 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-2d847a7f-c6aa-458f-9a63-6bfd1856c93d tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Getting quotas for project d31af2a6b9424f168dd6084d8d5fd0c4. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:02:55.028811 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-2d847a7f-c6aa-458f-9a63-6bfd1856c93d tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Getting quotas for user 9eb3421bc9494914bc5f797b15a55643 and project d31af2a6b9424f168dd6084d8d5fd0c4. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:02:55.042695 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-ef2fc4ce-5fee-499a-afe4-a770c9d5ea29 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:55.046995 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-2d847a7f-c6aa-458f-9a63-6bfd1856c93d tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Going to run 1 instances... {{(pid=129365) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 21:02:55.053133 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-2d847a7f-c6aa-458f-9a63-6bfd1856c93d tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: 5a31d952-72c7-4a45-bc31-46cef41d4b53] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129365) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 21:02:55.059761 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ef2fc4ce-5fee-499a-afe4-a770c9d5ea29 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9" status: 200 len: 1680 microversion: 2.1 time: 0.305655 Jan 15 21:02:55.060714 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2269/4553] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:02:54 2022] GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9 => generated 1680 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:02:55.067604 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-83c47618-9001-4285-8b4f-d9d1a564becd tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:55.069879 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-83c47618-9001-4285-8b4f-d9d1a564becd tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:55.080135 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-83c47618-9001-4285-8b4f-d9d1a564becd tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:55.080783 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-83c47618-9001-4285-8b4f-d9d1a564becd tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:55.081637 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-83c47618-9001-4285-8b4f-d9d1a564becd tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:55.082080 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-83c47618-9001-4285-8b4f-d9d1a564becd tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:55.114415 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2d847a7f-c6aa-458f-9a63-6bfd1856c93d tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.170972 Jan 15 21:02:55.115701 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2285/4554] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 21:02:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1176 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 21:02:55.129822 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-75fa40d2-d9e2-4b95-993d-7819b8a39141 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:55.130429 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-75fa40d2-d9e2-4b95-993d-7819b8a39141 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: 5a31d952-72c7-4a45-bc31-46cef41d4b53] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:55.141934 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-83c47618-9001-4285-8b4f-d9d1a564becd tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.078455 Jan 15 21:02:55.146363 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2270/4555] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:02:55 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:02:55.179929 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-15e3ffc9-bd50-4caa-9a0d-db2effa7b4ba tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:55.185918 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-15e3ffc9-bd50-4caa-9a0d-db2effa7b4ba tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:55.198813 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-15e3ffc9-bd50-4caa-9a0d-db2effa7b4ba tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:55.199179 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-15e3ffc9-bd50-4caa-9a0d-db2effa7b4ba tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:55.199981 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-15e3ffc9-bd50-4caa-9a0d-db2effa7b4ba tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:55.200418 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-15e3ffc9-bd50-4caa-9a0d-db2effa7b4ba tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:55.209751 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-75fa40d2-d9e2-4b95-993d-7819b8a39141 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb3421bc9494914bc5f797b15a55643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31af2a6b9424f168dd6084d8d5fd0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:55.218026 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-75fa40d2-d9e2-4b95-993d-7819b8a39141 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/5a31d952-72c7-4a45-bc31-46cef41d4b53" status: 200 len: 1221 microversion: 2.1 time: 0.091727 Jan 15 21:02:55.219885 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2286/4556] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:02:55 2022] GET /compute/v2.1/servers/5a31d952-72c7-4a45-bc31-46cef41d4b53 => generated 1221 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:02:55.272516 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b778a7f0-4671-42bc-a019-5b60c1e5c48e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:55.273597 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b778a7f0-4671-42bc-a019-5b60c1e5c48e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:55.283265 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b778a7f0-4671-42bc-a019-5b60c1e5c48e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:55.283735 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b778a7f0-4671-42bc-a019-5b60c1e5c48e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:55.294088 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b778a7f0-4671-42bc-a019-5b60c1e5c48e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:55.295014 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b778a7f0-4671-42bc-a019-5b60c1e5c48e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:55.351549 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b778a7f0-4671-42bc-a019-5b60c1e5c48e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.083169 Jan 15 21:02:55.352714 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2287/4557] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:02:55 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:02:55.410628 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-15e3ffc9-bd50-4caa-9a0d-db2effa7b4ba tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:55.422924 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-15e3ffc9-bd50-4caa-9a0d-db2effa7b4ba tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:55.436015 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-15e3ffc9-bd50-4caa-9a0d-db2effa7b4ba tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:55.438436 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-15e3ffc9-bd50-4caa-9a0d-db2effa7b4ba tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0" status: 200 len: 1662 microversion: 2.20 time: 0.264811 Jan 15 21:02:55.440055 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2271/4558] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:02:55 2022] GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0 => generated 1662 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:02:55.458421 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d6d65ec8-ae9b-4ceb-86fc-dc19d8b1f97a tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0cd4da7e-0abd-4d64-b27e-2f3b80099824"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:55.459942 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d6d65ec8-ae9b-4ceb-86fc-dc19d8b1f97a tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:55.476126 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d6d65ec8-ae9b-4ceb-86fc-dc19d8b1f97a tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:55.476859 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d6d65ec8-ae9b-4ceb-86fc-dc19d8b1f97a tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:55.478045 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d6d65ec8-ae9b-4ceb-86fc-dc19d8b1f97a tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:55.478821 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d6d65ec8-ae9b-4ceb-86fc-dc19d8b1f97a tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:55.771757 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-dae5578f-52fd-4e6c-80e8-f31a8ed0e0a7 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:55.774115 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-dae5578f-52fd-4e6c-80e8-f31a8ed0e0a7 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] [instance: 26f27adc-8567-4752-8a51-ee9c301b2611] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:55.784083 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dae5578f-52fd-4e6c-80e8-f31a8ed0e0a7 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:55.786493 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dae5578f-52fd-4e6c-80e8-f31a8ed0e0a7 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:55.789120 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dae5578f-52fd-4e6c-80e8-f31a8ed0e0a7 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:55.790713 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dae5578f-52fd-4e6c-80e8-f31a8ed0e0a7 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:55.907494 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d6d65ec8-ae9b-4ceb-86fc-dc19d8b1f97a tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.454487 Jan 15 21:02:55.908638 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2288/4559] 10.222.0.46 () {62 vars in 1363 bytes} [Sat Jan 15 21:02:55 2022] POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/os-volume_attachments => generated 188 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:02:55.920142 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-daecf6ec-adc3-4a33-a231-a49900564a99 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ca438ded-6045-415d-8f47-bda2befa2363"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:55.921305 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-daecf6ec-adc3-4a33-a231-a49900564a99 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:55.933471 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-daecf6ec-adc3-4a33-a231-a49900564a99 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:55.934065 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-daecf6ec-adc3-4a33-a231-a49900564a99 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:55.934878 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-daecf6ec-adc3-4a33-a231-a49900564a99 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:55.935318 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-daecf6ec-adc3-4a33-a231-a49900564a99 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:56.182462 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-dae5578f-52fd-4e6c-80e8-f31a8ed0e0a7 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e8f253bac41484ab8e92b74bfa54465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74165fadf5154c319ca56b4aa961e7b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:56.194530 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-dae5578f-52fd-4e6c-80e8-f31a8ed0e0a7 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] 10.222.0.46 "GET /compute/v2.1/servers/26f27adc-8567-4752-8a51-ee9c301b2611" status: 200 len: 1523 microversion: 2.1 time: 0.426712 Jan 15 21:02:56.195953 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2272/4560] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:02:55 2022] GET /compute/v2.1/servers/26f27adc-8567-4752-8a51-ee9c301b2611 => generated 1523 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:02:56.201291 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-6e32fbf0-9d07-4abc-8a1d-5c9c584f04f0 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:56.202105 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-6e32fbf0-9d07-4abc-8a1d-5c9c584f04f0 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:56.210612 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6e32fbf0-9d07-4abc-8a1d-5c9c584f04f0 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:56.211066 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6e32fbf0-9d07-4abc-8a1d-5c9c584f04f0 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:56.211929 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6e32fbf0-9d07-4abc-8a1d-5c9c584f04f0 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:56.212364 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6e32fbf0-9d07-4abc-8a1d-5c9c584f04f0 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:56.324498 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-daecf6ec-adc3-4a33-a231-a49900564a99 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.414435 Jan 15 21:02:56.328982 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2289/4561] 10.222.0.46 () {60 vars in 1322 bytes} [Sat Jan 15 21:02:55 2022] POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/os-volume_attachments => generated 194 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:02:56.331930 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-279c1072-7973-4ae3-a964-b6a864efb773 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:56.332983 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-279c1072-7973-4ae3-a964-b6a864efb773 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:56.340711 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-279c1072-7973-4ae3-a964-b6a864efb773 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:56.341204 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-279c1072-7973-4ae3-a964-b6a864efb773 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:56.341994 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-279c1072-7973-4ae3-a964-b6a864efb773 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:56.342430 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-279c1072-7973-4ae3-a964-b6a864efb773 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:56.385191 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-6e32fbf0-9d07-4abc-8a1d-5c9c584f04f0 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:56.394444 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-6e32fbf0-9d07-4abc-8a1d-5c9c584f04f0 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9" status: 200 len: 1680 microversion: 2.1 time: 0.196393 Jan 15 21:02:56.395278 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2273/4562] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:02:56 2022] GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9 => generated 1680 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:02:56.400434 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e268a8c5-9968-4305-bdc1-f42408b845cb tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:56.401150 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e268a8c5-9968-4305-bdc1-f42408b845cb tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:56.420904 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-279c1072-7973-4ae3-a964-b6a864efb773 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.093542 Jan 15 21:02:56.426941 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2290/4563] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:02:56 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:02:56.427121 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e268a8c5-9968-4305-bdc1-f42408b845cb tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:56.427121 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e268a8c5-9968-4305-bdc1-f42408b845cb tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:56.427121 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e268a8c5-9968-4305-bdc1-f42408b845cb tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:56.427121 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e268a8c5-9968-4305-bdc1-f42408b845cb tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:56.429908 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a0baa3a8-86ac-411a-850b-6b42aa92e28d tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:56.430687 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a0baa3a8-86ac-411a-850b-6b42aa92e28d tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: 5a31d952-72c7-4a45-bc31-46cef41d4b53] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:56.439632 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a0baa3a8-86ac-411a-850b-6b42aa92e28d tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:56.440083 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a0baa3a8-86ac-411a-850b-6b42aa92e28d tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:56.441148 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a0baa3a8-86ac-411a-850b-6b42aa92e28d tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:56.441411 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a0baa3a8-86ac-411a-850b-6b42aa92e28d tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:56.612331 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-a0baa3a8-86ac-411a-850b-6b42aa92e28d tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb3421bc9494914bc5f797b15a55643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31af2a6b9424f168dd6084d8d5fd0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:56.621384 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a0baa3a8-86ac-411a-850b-6b42aa92e28d tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/5a31d952-72c7-4a45-bc31-46cef41d4b53" status: 200 len: 1273 microversion: 2.1 time: 0.197244 Jan 15 21:02:56.632061 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2291/4564] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:02:56 2022] GET /compute/v2.1/servers/5a31d952-72c7-4a45-bc31-46cef41d4b53 => generated 1273 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:02:56.637235 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-37ae4e49-171f-474c-bb5a-adf7a693a72d tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:56.639264 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-37ae4e49-171f-474c-bb5a-adf7a693a72d tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:56.639756 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e268a8c5-9968-4305-bdc1-f42408b845cb tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action" status: 202 len: 0 microversion: 2.20 time: 0.242917 Jan 15 21:02:56.641084 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2274/4565] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:02:56 2022] POST /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/action => generated 0 bytes in 245 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 15 21:02:56.651632 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a66512d8-6a98-4940-b8bd-598cf8ea8f51 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:56.652922 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a66512d8-6a98-4940-b8bd-598cf8ea8f51 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:56.666941 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-37ae4e49-171f-474c-bb5a-adf7a693a72d tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:56.668075 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-37ae4e49-171f-474c-bb5a-adf7a693a72d tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:56.669659 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-37ae4e49-171f-474c-bb5a-adf7a693a72d tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:56.669808 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a66512d8-6a98-4940-b8bd-598cf8ea8f51 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:56.670561 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-37ae4e49-171f-474c-bb5a-adf7a693a72d tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:56.670685 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a66512d8-6a98-4940-b8bd-598cf8ea8f51 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:56.671826 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a66512d8-6a98-4940-b8bd-598cf8ea8f51 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:56.673055 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a66512d8-6a98-4940-b8bd-598cf8ea8f51 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:56.733308 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-37ae4e49-171f-474c-bb5a-adf7a693a72d tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.099445 Jan 15 21:02:56.737138 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2292/4566] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:02:56 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:02:56.968015 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-a66512d8-6a98-4940-b8bd-598cf8ea8f51 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:56.979866 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-a66512d8-6a98-4940-b8bd-598cf8ea8f51 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:56.981428 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-a66512d8-6a98-4940-b8bd-598cf8ea8f51 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:56.982613 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a66512d8-6a98-4940-b8bd-598cf8ea8f51 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0" status: 200 len: 1748 microversion: 2.20 time: 0.337315 Jan 15 21:02:56.996488 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2275/4567] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:02:56 2022] GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0 => generated 1748 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:02:57.217608 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-83794609-d2c9-47c1-9fcf-758123cca6e1 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:57.223525 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-83794609-d2c9-47c1-9fcf-758123cca6e1 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] [instance: 26f27adc-8567-4752-8a51-ee9c301b2611] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:57.237206 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-83794609-d2c9-47c1-9fcf-758123cca6e1 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:57.237663 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-83794609-d2c9-47c1-9fcf-758123cca6e1 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:57.238477 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-83794609-d2c9-47c1-9fcf-758123cca6e1 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:57.241647 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-83794609-d2c9-47c1-9fcf-758123cca6e1 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:57.417164 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-dc3f4c6c-cddb-4c62-845f-4d28a155c091 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:57.418011 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-dc3f4c6c-cddb-4c62-845f-4d28a155c091 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:57.429820 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dc3f4c6c-cddb-4c62-845f-4d28a155c091 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:57.430278 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dc3f4c6c-cddb-4c62-845f-4d28a155c091 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:57.432428 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dc3f4c6c-cddb-4c62-845f-4d28a155c091 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:57.433914 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dc3f4c6c-cddb-4c62-845f-4d28a155c091 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:57.675071 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-83794609-d2c9-47c1-9fcf-758123cca6e1 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e8f253bac41484ab8e92b74bfa54465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74165fadf5154c319ca56b4aa961e7b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:57.686361 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-83794609-d2c9-47c1-9fcf-758123cca6e1 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] 10.222.0.46 "GET /compute/v2.1/servers/26f27adc-8567-4752-8a51-ee9c301b2611" status: 200 len: 1523 microversion: 2.1 time: 0.475848 Jan 15 21:02:57.688406 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2293/4568] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:02:57 2022] GET /compute/v2.1/servers/26f27adc-8567-4752-8a51-ee9c301b2611 => generated 1523 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:02:57.694267 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-526a5285-a72b-4cc5-86ad-ce5d09a93ee5 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:57.696633 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-526a5285-a72b-4cc5-86ad-ce5d09a93ee5 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:57.705032 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-526a5285-a72b-4cc5-86ad-ce5d09a93ee5 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:57.705622 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-526a5285-a72b-4cc5-86ad-ce5d09a93ee5 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:57.706514 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-526a5285-a72b-4cc5-86ad-ce5d09a93ee5 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:57.707033 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-526a5285-a72b-4cc5-86ad-ce5d09a93ee5 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:57.764160 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-526a5285-a72b-4cc5-86ad-ce5d09a93ee5 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.074090 Jan 15 21:02:57.766222 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2294/4569] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:02:57 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:02:57.783017 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c3d76b6d-c16c-4d29-b4bd-723f2d6b067a tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:57.784001 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c3d76b6d-c16c-4d29-b4bd-723f2d6b067a tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: 5a31d952-72c7-4a45-bc31-46cef41d4b53] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:57.791852 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c3d76b6d-c16c-4d29-b4bd-723f2d6b067a tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:57.792580 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c3d76b6d-c16c-4d29-b4bd-723f2d6b067a tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:57.793787 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c3d76b6d-c16c-4d29-b4bd-723f2d6b067a tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:57.794499 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c3d76b6d-c16c-4d29-b4bd-723f2d6b067a tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:57.871072 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-c3d76b6d-c16c-4d29-b4bd-723f2d6b067a tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb3421bc9494914bc5f797b15a55643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31af2a6b9424f168dd6084d8d5fd0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:57.885478 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c3d76b6d-c16c-4d29-b4bd-723f2d6b067a tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/5a31d952-72c7-4a45-bc31-46cef41d4b53" status: 200 len: 1279 microversion: 2.1 time: 0.108339 Jan 15 21:02:57.886794 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2295/4570] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:02:57 2022] GET /compute/v2.1/servers/5a31d952-72c7-4a45-bc31-46cef41d4b53 => generated 1279 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:02:57.906306 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-4e015954-09df-44a7-8f6d-f0c0cf74a9c2 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:57.907750 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-4e015954-09df-44a7-8f6d-f0c0cf74a9c2 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:57.915814 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4e015954-09df-44a7-8f6d-f0c0cf74a9c2 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:57.916501 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4e015954-09df-44a7-8f6d-f0c0cf74a9c2 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:57.917502 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4e015954-09df-44a7-8f6d-f0c0cf74a9c2 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:57.918009 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4e015954-09df-44a7-8f6d-f0c0cf74a9c2 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:57.973871 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-4e015954-09df-44a7-8f6d-f0c0cf74a9c2 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.084893 Jan 15 21:02:57.977047 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2296/4571] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:02:57 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:02:58.015876 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b44f1383-484e-4521-91be-5aff0ff37dd4 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:58.017731 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b44f1383-484e-4521-91be-5aff0ff37dd4 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:58.028607 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b44f1383-484e-4521-91be-5aff0ff37dd4 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:58.029132 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b44f1383-484e-4521-91be-5aff0ff37dd4 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:58.029961 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b44f1383-484e-4521-91be-5aff0ff37dd4 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:58.042306 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b44f1383-484e-4521-91be-5aff0ff37dd4 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:58.186056 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-dc3f4c6c-cddb-4c62-845f-4d28a155c091 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:58.223916 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-dc3f4c6c-cddb-4c62-845f-4d28a155c091 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9" status: 200 len: 1680 microversion: 2.1 time: 0.815539 Jan 15 21:02:58.225313 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2276/4572] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:02:57 2022] GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9 => generated 1680 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:02:58.283949 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-b44f1383-484e-4521-91be-5aff0ff37dd4 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:58.308180 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-b44f1383-484e-4521-91be-5aff0ff37dd4 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:58.313584 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-b44f1383-484e-4521-91be-5aff0ff37dd4 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:58.315025 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b44f1383-484e-4521-91be-5aff0ff37dd4 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0" status: 200 len: 1750 microversion: 2.20 time: 0.313984 Jan 15 21:02:58.319223 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2297/4573] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:02:57 2022] GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0 => generated 1750 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:02:58.705912 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-60a13fc1-c1be-4815-84a8-8b82e4406580 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:58.706837 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-60a13fc1-c1be-4815-84a8-8b82e4406580 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] [instance: 26f27adc-8567-4752-8a51-ee9c301b2611] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:58.713215 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-60a13fc1-c1be-4815-84a8-8b82e4406580 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:58.714000 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-60a13fc1-c1be-4815-84a8-8b82e4406580 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:58.715221 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-60a13fc1-c1be-4815-84a8-8b82e4406580 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:58.715914 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-60a13fc1-c1be-4815-84a8-8b82e4406580 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:58.784647 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-4ba6e676-25e9-4586-b931-a02dfaac9092 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:58.788645 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-4ba6e676-25e9-4586-b931-a02dfaac9092 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:58.823865 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4ba6e676-25e9-4586-b931-a02dfaac9092 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:58.824326 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4ba6e676-25e9-4586-b931-a02dfaac9092 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:58.825601 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4ba6e676-25e9-4586-b931-a02dfaac9092 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:58.826954 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4ba6e676-25e9-4586-b931-a02dfaac9092 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:58.896124 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-4ba6e676-25e9-4586-b931-a02dfaac9092 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.122669 Jan 15 21:02:58.897789 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2298/4574] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:02:58 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:02:58.907503 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-760a70f5-c9e1-4919-bda2-d5d2620b6c6f tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:58.908446 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-760a70f5-c9e1-4919-bda2-d5d2620b6c6f tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: 5a31d952-72c7-4a45-bc31-46cef41d4b53] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:58.917232 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-760a70f5-c9e1-4919-bda2-d5d2620b6c6f tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:58.917946 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-760a70f5-c9e1-4919-bda2-d5d2620b6c6f tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:58.919321 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-760a70f5-c9e1-4919-bda2-d5d2620b6c6f tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:58.919917 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-760a70f5-c9e1-4919-bda2-d5d2620b6c6f tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:58.970247 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-60a13fc1-c1be-4815-84a8-8b82e4406580 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e8f253bac41484ab8e92b74bfa54465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74165fadf5154c319ca56b4aa961e7b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:58.978579 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-60a13fc1-c1be-4815-84a8-8b82e4406580 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] 10.222.0.46 "GET /compute/v2.1/servers/26f27adc-8567-4752-8a51-ee9c301b2611" status: 200 len: 1523 microversion: 2.1 time: 0.278841 Jan 15 21:02:58.983632 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2277/4575] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:02:58 2022] GET /compute/v2.1/servers/26f27adc-8567-4752-8a51-ee9c301b2611 => generated 1523 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:02:58.992303 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-10980b6c-e02d-4f3f-a02d-fd73c41173f3 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:58.993538 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-10980b6c-e02d-4f3f-a02d-fd73c41173f3 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:59.008809 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-10980b6c-e02d-4f3f-a02d-fd73c41173f3 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:59.009723 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-10980b6c-e02d-4f3f-a02d-fd73c41173f3 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:59.011588 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-10980b6c-e02d-4f3f-a02d-fd73c41173f3 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:59.012236 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-10980b6c-e02d-4f3f-a02d-fd73c41173f3 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:59.118420 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-10980b6c-e02d-4f3f-a02d-fd73c41173f3 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.131005 Jan 15 21:02:59.119761 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2278/4576] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:02:58 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:02:59.244254 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9dba199c-046e-442b-b79f-197a7b8adf7d tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:59.245002 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-9dba199c-046e-442b-b79f-197a7b8adf7d tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:59.258700 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9dba199c-046e-442b-b79f-197a7b8adf7d tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:59.259151 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9dba199c-046e-442b-b79f-197a7b8adf7d tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:59.259933 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9dba199c-046e-442b-b79f-197a7b8adf7d tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:59.274577 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9dba199c-046e-442b-b79f-197a7b8adf7d tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:59.329674 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-760a70f5-c9e1-4919-bda2-d5d2620b6c6f tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb3421bc9494914bc5f797b15a55643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31af2a6b9424f168dd6084d8d5fd0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:59.338919 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-760a70f5-c9e1-4919-bda2-d5d2620b6c6f tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/5a31d952-72c7-4a45-bc31-46cef41d4b53" status: 200 len: 1321 microversion: 2.1 time: 0.436515 Jan 15 21:02:59.341921 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2299/4577] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:02:58 2022] GET /compute/v2.1/servers/5a31d952-72c7-4a45-bc31-46cef41d4b53 => generated 1321 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:02:59.382994 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2503b384-754a-433d-ae3c-33d5cbd96695 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:59.384499 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-2503b384-754a-433d-ae3c-33d5cbd96695 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:59.421992 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2503b384-754a-433d-ae3c-33d5cbd96695 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:59.422452 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2503b384-754a-433d-ae3c-33d5cbd96695 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:59.435186 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2503b384-754a-433d-ae3c-33d5cbd96695 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:59.435933 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2503b384-754a-433d-ae3c-33d5cbd96695 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:59.606041 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-9dba199c-046e-442b-b79f-197a7b8adf7d tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:59.613722 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-9dba199c-046e-442b-b79f-197a7b8adf7d tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9" status: 200 len: 1680 microversion: 2.1 time: 0.373852 Jan 15 21:02:59.614296 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2279/4578] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:02:59 2022] GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9 => generated 1680 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:02:59.672040 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-2503b384-754a-433d-ae3c-33d5cbd96695 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:59.683277 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-2503b384-754a-433d-ae3c-33d5cbd96695 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:59.685261 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-2503b384-754a-433d-ae3c-33d5cbd96695 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:02:59.686608 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2503b384-754a-433d-ae3c-33d5cbd96695 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0" status: 200 len: 1750 microversion: 2.20 time: 0.344098 Jan 15 21:02:59.688793 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2300/4579] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:02:59 2022] GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0 => generated 1750 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:02:59.771741 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ac02b2b5-ca49-41a5-b997-efa58c970b58 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:59.778003 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ac02b2b5-ca49-41a5-b997-efa58c970b58 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:59.778695 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ac02b2b5-ca49-41a5-b997-efa58c970b58 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:59.805899 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ac02b2b5-ca49-41a5-b997-efa58c970b58 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Going to try to stop instance {{(pid=129366) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Jan 15 21:02:59.859378 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ac02b2b5-ca49-41a5-b997-efa58c970b58 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action" status: 202 len: 0 microversion: 2.1 time: 0.090741 Jan 15 21:02:59.861346 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2280/4580] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:02:59 2022] POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:02:59.873625 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8c751d8e-11de-48c3-83b4-04116d89de70 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:02:59.874261 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-8c751d8e-11de-48c3-83b4-04116d89de70 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:59.882707 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8c751d8e-11de-48c3-83b4-04116d89de70 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:59.883470 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8c751d8e-11de-48c3-83b4-04116d89de70 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:59.884392 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8c751d8e-11de-48c3-83b4-04116d89de70 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:59.885177 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8c751d8e-11de-48c3-83b4-04116d89de70 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:59.912490 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-39d8bf12-2417-4d46-aa32-9a4a2e0415df tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:02:59.913702 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-39d8bf12-2417-4d46-aa32-9a4a2e0415df tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:02:59.924029 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-39d8bf12-2417-4d46-aa32-9a4a2e0415df tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:59.924606 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-39d8bf12-2417-4d46-aa32-9a4a2e0415df tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:59.925542 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-39d8bf12-2417-4d46-aa32-9a4a2e0415df tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:02:59.926071 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-39d8bf12-2417-4d46-aa32-9a4a2e0415df tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:02:59.980703 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-39d8bf12-2417-4d46-aa32-9a4a2e0415df tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.073080 Jan 15 21:02:59.989378 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2281/4581] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:02:59 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:03:00.008792 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-2a03dddb-8183-41aa-b487-2e39c4f2fd4a tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:03:00.009893 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-2a03dddb-8183-41aa-b487-2e39c4f2fd4a tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] [instance: 26f27adc-8567-4752-8a51-ee9c301b2611] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:00.019633 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2a03dddb-8183-41aa-b487-2e39c4f2fd4a tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:00.020333 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2a03dddb-8183-41aa-b487-2e39c4f2fd4a tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:00.021362 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2a03dddb-8183-41aa-b487-2e39c4f2fd4a tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:00.021961 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2a03dddb-8183-41aa-b487-2e39c4f2fd4a tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:00.088253 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-8c751d8e-11de-48c3-83b4-04116d89de70 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6097506a2d4e36818310d9d70bf01b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4dad65fccfe481a973f5fcbb9287dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:03:00.097129 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-8c751d8e-11de-48c3-83b4-04116d89de70 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "GET /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a" status: 200 len: 1721 microversion: 2.1 time: 0.227133 Jan 15 21:03:00.098119 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2301/4582] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:02:59 2022] GET /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a => generated 1721 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:03:00.132061 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3198f15c-4a55-47a5-9955-0101fe2125be tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:03:00.133317 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-3198f15c-4a55-47a5-9955-0101fe2125be tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:00.144274 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3198f15c-4a55-47a5-9955-0101fe2125be tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:00.145085 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3198f15c-4a55-47a5-9955-0101fe2125be tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:00.146161 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3198f15c-4a55-47a5-9955-0101fe2125be tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:00.146881 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3198f15c-4a55-47a5-9955-0101fe2125be tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:00.199845 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3198f15c-4a55-47a5-9955-0101fe2125be tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.071761 Jan 15 21:03:00.202667 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2302/4583] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:03:00 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:03:00.207733 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-2a03dddb-8183-41aa-b487-2e39c4f2fd4a tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e8f253bac41484ab8e92b74bfa54465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74165fadf5154c319ca56b4aa961e7b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:03:00.216266 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-2a03dddb-8183-41aa-b487-2e39c4f2fd4a tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] 10.222.0.46 "GET /compute/v2.1/servers/26f27adc-8567-4752-8a51-ee9c301b2611" status: 200 len: 1523 microversion: 2.1 time: 0.219832 Jan 15 21:03:00.216879 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2282/4584] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:02:59 2022] GET /compute/v2.1/servers/26f27adc-8567-4752-8a51-ee9c301b2611 => generated 1523 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:03:00.317109 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-e705c82b-1b87-4d7d-89c6-221dd1abace4 req-718abee9-3bca-4066-bdd2-051265aa3af3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a31d952-72c7-4a45-bc31-46cef41d4b53", "tag": "558dc990-4fe6-4fd2-8ab9-c709029ab8be"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:03:00.318812 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:03:00.318812 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:03:00.334754 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-e705c82b-1b87-4d7d-89c6-221dd1abace4 req-718abee9-3bca-4066-bdd2-051265aa3af3 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:00.335428 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-e705c82b-1b87-4d7d-89c6-221dd1abace4 req-718abee9-3bca-4066-bdd2-051265aa3af3 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:00.350053 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-e705c82b-1b87-4d7d-89c6-221dd1abace4 req-718abee9-3bca-4066-bdd2-051265aa3af3 service nova] Creating event network-changed:558dc990-4fe6-4fd2-8ab9-c709029ab8be for instance 5a31d952-72c7-4a45-bc31-46cef41d4b53 on nch1-master-1 Jan 15 21:03:00.357009 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-e705c82b-1b87-4d7d-89c6-221dd1abace4 req-718abee9-3bca-4066-bdd2-051265aa3af3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046191 Jan 15 21:03:00.358448 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2303/4585] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:03:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:03:00.364534 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ed73c4f5-4d3a-4235-91d5-9aaedc98b98a tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:03:00.365222 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ed73c4f5-4d3a-4235-91d5-9aaedc98b98a tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: 5a31d952-72c7-4a45-bc31-46cef41d4b53] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:00.371764 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ed73c4f5-4d3a-4235-91d5-9aaedc98b98a tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:00.372597 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ed73c4f5-4d3a-4235-91d5-9aaedc98b98a tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:00.373645 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ed73c4f5-4d3a-4235-91d5-9aaedc98b98a tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:00.374474 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ed73c4f5-4d3a-4235-91d5-9aaedc98b98a tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:00.540770 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-ed73c4f5-4d3a-4235-91d5-9aaedc98b98a tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb3421bc9494914bc5f797b15a55643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31af2a6b9424f168dd6084d8d5fd0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:03:00.550091 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ed73c4f5-4d3a-4235-91d5-9aaedc98b98a tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/5a31d952-72c7-4a45-bc31-46cef41d4b53" status: 200 len: 1321 microversion: 2.1 time: 0.197155 Jan 15 21:03:00.551028 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2283/4586] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:03:00 2022] GET /compute/v2.1/servers/5a31d952-72c7-4a45-bc31-46cef41d4b53 => generated 1321 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:03:00.632141 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f181e829-2068-4342-b22c-626c3e5c85d2 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:03:00.632788 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f181e829-2068-4342-b22c-626c3e5c85d2 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:00.639710 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f181e829-2068-4342-b22c-626c3e5c85d2 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:00.640835 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f181e829-2068-4342-b22c-626c3e5c85d2 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:00.642157 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f181e829-2068-4342-b22c-626c3e5c85d2 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:00.642157 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f181e829-2068-4342-b22c-626c3e5c85d2 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:00.706307 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7d14da4a-9bb0-4a0b-bece-8dc382ad9de2 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:03:00.706498 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-7d14da4a-9bb0-4a0b-bece-8dc382ad9de2 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:00.712728 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7d14da4a-9bb0-4a0b-bece-8dc382ad9de2 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:00.713815 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7d14da4a-9bb0-4a0b-bece-8dc382ad9de2 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:00.714809 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7d14da4a-9bb0-4a0b-bece-8dc382ad9de2 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:00.715448 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7d14da4a-9bb0-4a0b-bece-8dc382ad9de2 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:00.817224 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-f181e829-2068-4342-b22c-626c3e5c85d2 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:03:00.830259 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f181e829-2068-4342-b22c-626c3e5c85d2 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9" status: 200 len: 1680 microversion: 2.1 time: 0.201952 Jan 15 21:03:00.830753 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2304/4587] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:03:00 2022] GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9 => generated 1680 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:03:00.885493 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-7d14da4a-9bb0-4a0b-bece-8dc382ad9de2 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:03:00.894230 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-7d14da4a-9bb0-4a0b-bece-8dc382ad9de2 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:03:00.895725 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-7d14da4a-9bb0-4a0b-bece-8dc382ad9de2 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:03:00.897165 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7d14da4a-9bb0-4a0b-bece-8dc382ad9de2 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0" status: 200 len: 1806 microversion: 2.20 time: 0.195751 Jan 15 21:03:00.897735 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2284/4588] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:03:00 2022] GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0 => generated 1806 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 15 21:03:01.117308 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-2558b43c-35db-4672-8919-bb878ae92180 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:03:01.117920 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-2558b43c-35db-4672-8919-bb878ae92180 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:01.129592 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2558b43c-35db-4672-8919-bb878ae92180 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:01.130251 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2558b43c-35db-4672-8919-bb878ae92180 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:01.131448 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2558b43c-35db-4672-8919-bb878ae92180 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:01.131886 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2558b43c-35db-4672-8919-bb878ae92180 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:01.142858 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-618351df-7258-4ea3-b153-0d94518379ad tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:03:01.143845 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-618351df-7258-4ea3-b153-0d94518379ad tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:01.151727 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-618351df-7258-4ea3-b153-0d94518379ad tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:01.152428 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-618351df-7258-4ea3-b153-0d94518379ad tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:01.153095 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-618351df-7258-4ea3-b153-0d94518379ad tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:01.153730 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-618351df-7258-4ea3-b153-0d94518379ad tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:01.224067 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-618351df-7258-4ea3-b153-0d94518379ad tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.233584 Jan 15 21:03:01.224787 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2305/4589] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:03:00 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:03:01.230102 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-116f15c9-7d76-46ad-8f76-9d1af4982226 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:03:01.231192 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-116f15c9-7d76-46ad-8f76-9d1af4982226 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:01.257102 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-116f15c9-7d76-46ad-8f76-9d1af4982226 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:01.257638 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-116f15c9-7d76-46ad-8f76-9d1af4982226 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:01.258487 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-116f15c9-7d76-46ad-8f76-9d1af4982226 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:01.258932 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-116f15c9-7d76-46ad-8f76-9d1af4982226 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:01.325380 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-116f15c9-7d76-46ad-8f76-9d1af4982226 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.098539 Jan 15 21:03:01.328065 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2306/4590] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:03:01 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:03:01.334768 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-996ab546-5b72-46dc-9fb1-5aba97456eae tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:03:01.335909 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-996ab546-5b72-46dc-9fb1-5aba97456eae tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] [instance: 26f27adc-8567-4752-8a51-ee9c301b2611] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:01.346019 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-996ab546-5b72-46dc-9fb1-5aba97456eae tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:01.346947 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-996ab546-5b72-46dc-9fb1-5aba97456eae tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:01.347979 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-996ab546-5b72-46dc-9fb1-5aba97456eae tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:01.349190 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-996ab546-5b72-46dc-9fb1-5aba97456eae tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:01.402482 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-2558b43c-35db-4672-8919-bb878ae92180 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6097506a2d4e36818310d9d70bf01b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4dad65fccfe481a973f5fcbb9287dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:03:01.415566 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-2558b43c-35db-4672-8919-bb878ae92180 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "GET /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a" status: 200 len: 1721 microversion: 2.1 time: 0.303845 Jan 15 21:03:01.424635 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2285/4591] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:03:01 2022] GET /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a => generated 1721 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:03:01.568935 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-95b89e70-b1a3-4905-9f19-7c5142a0e976 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:03:01.570405 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-95b89e70-b1a3-4905-9f19-7c5142a0e976 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: 5a31d952-72c7-4a45-bc31-46cef41d4b53] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:01.580496 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-95b89e70-b1a3-4905-9f19-7c5142a0e976 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:01.581246 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-95b89e70-b1a3-4905-9f19-7c5142a0e976 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:01.583431 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-95b89e70-b1a3-4905-9f19-7c5142a0e976 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:01.584944 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-95b89e70-b1a3-4905-9f19-7c5142a0e976 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:01.614552 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-996ab546-5b72-46dc-9fb1-5aba97456eae tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e8f253bac41484ab8e92b74bfa54465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74165fadf5154c319ca56b4aa961e7b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:03:01.623674 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-996ab546-5b72-46dc-9fb1-5aba97456eae tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] 10.222.0.46 "GET /compute/v2.1/servers/26f27adc-8567-4752-8a51-ee9c301b2611" status: 200 len: 1523 microversion: 2.1 time: 0.293472 Jan 15 21:03:01.624612 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2307/4592] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:03:01 2022] GET /compute/v2.1/servers/26f27adc-8567-4752-8a51-ee9c301b2611 => generated 1523 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:03:01.739965 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-95b89e70-b1a3-4905-9f19-7c5142a0e976 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb3421bc9494914bc5f797b15a55643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31af2a6b9424f168dd6084d8d5fd0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:03:01.749753 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-95b89e70-b1a3-4905-9f19-7c5142a0e976 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/5a31d952-72c7-4a45-bc31-46cef41d4b53" status: 200 len: 1321 microversion: 2.1 time: 0.185941 Jan 15 21:03:01.750748 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2286/4593] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:03:01 2022] GET /compute/v2.1/servers/5a31d952-72c7-4a45-bc31-46cef41d4b53 => generated 1321 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:03:01.848123 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-6455aac7-9c38-48d2-bc70-e6d25a4dda08 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:03:01.848735 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-6455aac7-9c38-48d2-bc70-e6d25a4dda08 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:01.855411 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6455aac7-9c38-48d2-bc70-e6d25a4dda08 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:01.855873 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6455aac7-9c38-48d2-bc70-e6d25a4dda08 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:01.856732 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6455aac7-9c38-48d2-bc70-e6d25a4dda08 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:01.857201 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6455aac7-9c38-48d2-bc70-e6d25a4dda08 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:01.915452 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a3712dc4-5c9e-4280-86fc-168d4f7c32d7 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:03:01.916062 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a3712dc4-5c9e-4280-86fc-168d4f7c32d7 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:01.922944 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a3712dc4-5c9e-4280-86fc-168d4f7c32d7 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:01.923738 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a3712dc4-5c9e-4280-86fc-168d4f7c32d7 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:01.924715 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a3712dc4-5c9e-4280-86fc-168d4f7c32d7 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:01.925426 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a3712dc4-5c9e-4280-86fc-168d4f7c32d7 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:02.110390 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-6455aac7-9c38-48d2-bc70-e6d25a4dda08 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:03:02.124096 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-6455aac7-9c38-48d2-bc70-e6d25a4dda08 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9" status: 200 len: 1680 microversion: 2.1 time: 0.279782 Jan 15 21:03:02.125269 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2308/4594] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:03:01 2022] GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9 => generated 1680 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:03:02.241839 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-13ab52dd-e3cb-41c9-933b-e52610a52beb tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:03:02.244513 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-13ab52dd-e3cb-41c9-933b-e52610a52beb tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:02.253596 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-13ab52dd-e3cb-41c9-933b-e52610a52beb tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:02.254056 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-13ab52dd-e3cb-41c9-933b-e52610a52beb tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:02.254864 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-13ab52dd-e3cb-41c9-933b-e52610a52beb tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:02.255313 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-13ab52dd-e3cb-41c9-933b-e52610a52beb tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:02.316406 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-13ab52dd-e3cb-41c9-933b-e52610a52beb tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.082125 Jan 15 21:03:02.318032 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2309/4595] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:03:02 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:03:02.344504 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-4ad6dfee-9712-4ffd-a02b-eac02f52ad0e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:03:02.346409 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-4ad6dfee-9712-4ffd-a02b-eac02f52ad0e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:02.369497 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4ad6dfee-9712-4ffd-a02b-eac02f52ad0e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:02.370293 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4ad6dfee-9712-4ffd-a02b-eac02f52ad0e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:02.371624 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4ad6dfee-9712-4ffd-a02b-eac02f52ad0e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:02.379205 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4ad6dfee-9712-4ffd-a02b-eac02f52ad0e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:02.392032 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-a3712dc4-5c9e-4280-86fc-168d4f7c32d7 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:03:02.402356 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-a3712dc4-5c9e-4280-86fc-168d4f7c32d7 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:03:02.405029 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-a3712dc4-5c9e-4280-86fc-168d4f7c32d7 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:03:02.407832 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a3712dc4-5c9e-4280-86fc-168d4f7c32d7 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0" status: 200 len: 1806 microversion: 2.20 time: 0.496189 Jan 15 21:03:02.419884 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2287/4596] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:03:01 2022] GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0 => generated 1806 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 15 21:03:02.441754 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-41a525fe-5472-40c5-970f-f27cfd105499 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:03:02.442648 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-41a525fe-5472-40c5-970f-f27cfd105499 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:02.449208 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-41a525fe-5472-40c5-970f-f27cfd105499 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:02.449674 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-41a525fe-5472-40c5-970f-f27cfd105499 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:02.450726 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-41a525fe-5472-40c5-970f-f27cfd105499 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:02.451176 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-41a525fe-5472-40c5-970f-f27cfd105499 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:02.458406 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-4ad6dfee-9712-4ffd-a02b-eac02f52ad0e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.123687 Jan 15 21:03:02.467512 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2310/4597] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:03:02 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:03:02.530944 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-713643c6-f6b6-4ce5-9cf5-6356a7c24fcd req-a899394d-b726-4ad2-bbc9-9168532854d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ac722a3-aadf-4791-b5b1-e5e5efebddc0", "tag": "6d958b2a-aaab-40bf-8bb7-ce4cd3fc57b5"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:03:02.534269 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:03:02.534269 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:03:02.550863 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-713643c6-f6b6-4ce5-9cf5-6356a7c24fcd req-a899394d-b726-4ad2-bbc9-9168532854d7 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:02.552773 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-713643c6-f6b6-4ce5-9cf5-6356a7c24fcd req-a899394d-b726-4ad2-bbc9-9168532854d7 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:02.575713 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-713643c6-f6b6-4ce5-9cf5-6356a7c24fcd req-a899394d-b726-4ad2-bbc9-9168532854d7 service nova] Creating event network-changed:6d958b2a-aaab-40bf-8bb7-ce4cd3fc57b5 for instance 0ac722a3-aadf-4791-b5b1-e5e5efebddc0 on nch2-master-1 Jan 15 21:03:02.581986 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-713643c6-f6b6-4ce5-9cf5-6356a7c24fcd req-a899394d-b726-4ad2-bbc9-9168532854d7 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055319 Jan 15 21:03:02.583066 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2311/4598] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:03:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 21:03:02.642271 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f9046ec3-f438-48f3-ac33-8140b28fdb9a tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:03:02.643096 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f9046ec3-f438-48f3-ac33-8140b28fdb9a tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] [instance: 26f27adc-8567-4752-8a51-ee9c301b2611] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:02.650099 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f9046ec3-f438-48f3-ac33-8140b28fdb9a tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:02.650707 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f9046ec3-f438-48f3-ac33-8140b28fdb9a tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:02.652076 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f9046ec3-f438-48f3-ac33-8140b28fdb9a tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:02.652076 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f9046ec3-f438-48f3-ac33-8140b28fdb9a tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:02.840304 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-41a525fe-5472-40c5-970f-f27cfd105499 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6097506a2d4e36818310d9d70bf01b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4dad65fccfe481a973f5fcbb9287dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:03:02.858042 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-41a525fe-5472-40c5-970f-f27cfd105499 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "GET /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a" status: 200 len: 1721 microversion: 2.1 time: 0.420340 Jan 15 21:03:02.858741 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2288/4599] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:03:02 2022] GET /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a => generated 1721 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:03:02.863495 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-6f3cfce8-4d39-447e-8fb8-d582d5f37e3d tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:03:02.864093 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-6f3cfce8-4d39-447e-8fb8-d582d5f37e3d tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: 5a31d952-72c7-4a45-bc31-46cef41d4b53] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:02.884482 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6f3cfce8-4d39-447e-8fb8-d582d5f37e3d tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:02.884954 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6f3cfce8-4d39-447e-8fb8-d582d5f37e3d tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:02.885745 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6f3cfce8-4d39-447e-8fb8-d582d5f37e3d tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:02.886179 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6f3cfce8-4d39-447e-8fb8-d582d5f37e3d tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:03.110165 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-f9046ec3-f438-48f3-ac33-8140b28fdb9a tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e8f253bac41484ab8e92b74bfa54465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74165fadf5154c319ca56b4aa961e7b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:03:03.125860 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f9046ec3-f438-48f3-ac33-8140b28fdb9a tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] 10.222.0.46 "GET /compute/v2.1/servers/26f27adc-8567-4752-8a51-ee9c301b2611" status: 200 len: 1523 microversion: 2.1 time: 0.488539 Jan 15 21:03:03.126454 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2312/4600] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:03:02 2022] GET /compute/v2.1/servers/26f27adc-8567-4752-8a51-ee9c301b2611 => generated 1523 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:03:03.176250 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-6f3cfce8-4d39-447e-8fb8-d582d5f37e3d tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb3421bc9494914bc5f797b15a55643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31af2a6b9424f168dd6084d8d5fd0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:03:03.203008 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-6f3cfce8-4d39-447e-8fb8-d582d5f37e3d tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/5a31d952-72c7-4a45-bc31-46cef41d4b53" status: 200 len: 1321 microversion: 2.1 time: 0.342260 Jan 15 21:03:03.208487 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2289/4601] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:03:02 2022] GET /compute/v2.1/servers/5a31d952-72c7-4a45-bc31-46cef41d4b53 => generated 1321 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:03:03.329225 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0eed00c6-1479-4ba3-a511-6c8977ef7e6a tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:03:03.330692 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-0eed00c6-1479-4ba3-a511-6c8977ef7e6a tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:03.345901 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0eed00c6-1479-4ba3-a511-6c8977ef7e6a tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:03.346665 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0eed00c6-1479-4ba3-a511-6c8977ef7e6a tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:03.347690 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0eed00c6-1479-4ba3-a511-6c8977ef7e6a tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:03.348287 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0eed00c6-1479-4ba3-a511-6c8977ef7e6a tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:03.364514 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d6ab82a2-a247-4651-a392-0d98c150cba2 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:03:03.365776 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d6ab82a2-a247-4651-a392-0d98c150cba2 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:03.377152 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d6ab82a2-a247-4651-a392-0d98c150cba2 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:03.377702 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d6ab82a2-a247-4651-a392-0d98c150cba2 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:03.379488 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d6ab82a2-a247-4651-a392-0d98c150cba2 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:03.383755 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d6ab82a2-a247-4651-a392-0d98c150cba2 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:03.434312 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0eed00c6-1479-4ba3-a511-6c8977ef7e6a tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.106628 Jan 15 21:03:03.439980 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2290/4602] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:03:03 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:03:03.448322 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-3c88669c-8b9e-46d2-8d6b-3b83136af71e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:03:03.449290 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-3c88669c-8b9e-46d2-8d6b-3b83136af71e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:03.458361 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3c88669c-8b9e-46d2-8d6b-3b83136af71e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:03.459081 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3c88669c-8b9e-46d2-8d6b-3b83136af71e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:03.460037 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3c88669c-8b9e-46d2-8d6b-3b83136af71e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:03.460623 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3c88669c-8b9e-46d2-8d6b-3b83136af71e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:03.835459 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-d6ab82a2-a247-4651-a392-0d98c150cba2 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:03:03.848761 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-3c88669c-8b9e-46d2-8d6b-3b83136af71e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:03:03.859310 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-3c88669c-8b9e-46d2-8d6b-3b83136af71e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:03:03.860286 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d6ab82a2-a247-4651-a392-0d98c150cba2 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9" status: 200 len: 1657 microversion: 2.1 time: 0.722257 Jan 15 21:03:03.860877 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-3c88669c-8b9e-46d2-8d6b-3b83136af71e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:03:03.862332 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-3c88669c-8b9e-46d2-8d6b-3b83136af71e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0" status: 200 len: 1806 microversion: 2.20 time: 0.420900 Jan 15 21:03:03.863208 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2291/4603] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:03:03 2022] GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0 => generated 1806 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:03:03.875374 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ccba18d0-6e06-4660-b1e6-8f5b60635574 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:03:03.876405 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ccba18d0-6e06-4660-b1e6-8f5b60635574 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:03.879668 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2313/4604] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:03:03 2022] GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9 => generated 1657 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:03:03.886464 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ccba18d0-6e06-4660-b1e6-8f5b60635574 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:03.886922 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ccba18d0-6e06-4660-b1e6-8f5b60635574 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:03.888107 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ccba18d0-6e06-4660-b1e6-8f5b60635574 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:03.888895 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ccba18d0-6e06-4660-b1e6-8f5b60635574 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:03.893488 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-656367a0-008a-490d-8c26-17072d8863df tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:03:03.894126 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-656367a0-008a-490d-8c26-17072d8863df tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:03.908726 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-656367a0-008a-490d-8c26-17072d8863df tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:03.910591 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-656367a0-008a-490d-8c26-17072d8863df tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:03.912532 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-656367a0-008a-490d-8c26-17072d8863df tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:03.915418 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-656367a0-008a-490d-8c26-17072d8863df tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:03.967901 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ccba18d0-6e06-4660-b1e6-8f5b60635574 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.103389 Jan 15 21:03:03.968617 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2292/4605] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:03:03 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:03:03.975024 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a4740a3a-9ad6-4016-bc4f-9ca96b7a4d38 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:03:03.994307 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a4740a3a-9ad6-4016-bc4f-9ca96b7a4d38 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:03.995113 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a4740a3a-9ad6-4016-bc4f-9ca96b7a4d38 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:04.059894 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a4740a3a-9ad6-4016-bc4f-9ca96b7a4d38 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Going to try to start instance {{(pid=129366) start /opt/stack/nova/nova/compute/api.py:2677}} Jan 15 21:03:04.170384 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a4740a3a-9ad6-4016-bc4f-9ca96b7a4d38 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action" status: 202 len: 0 microversion: 2.1 time: 0.199258 Jan 15 21:03:04.178638 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2293/4606] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:03:03 2022] POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:03:04.207431 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-203ebe1d-f254-4f8e-aa6d-753bc35fd63a tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:03:04.208174 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-203ebe1d-f254-4f8e-aa6d-753bc35fd63a tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] [instance: 26f27adc-8567-4752-8a51-ee9c301b2611] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:04.228115 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-203ebe1d-f254-4f8e-aa6d-753bc35fd63a tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:04.229078 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-203ebe1d-f254-4f8e-aa6d-753bc35fd63a tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:04.230460 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-203ebe1d-f254-4f8e-aa6d-753bc35fd63a tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:04.231072 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-203ebe1d-f254-4f8e-aa6d-753bc35fd63a tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:04.488473 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-656367a0-008a-490d-8c26-17072d8863df tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6097506a2d4e36818310d9d70bf01b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4dad65fccfe481a973f5fcbb9287dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:03:04.500231 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-656367a0-008a-490d-8c26-17072d8863df tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "GET /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a" status: 200 len: 1721 microversion: 2.1 time: 0.619360 Jan 15 21:03:04.525248 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2314/4607] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:03:03 2022] GET /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a => generated 1721 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:03:04.530497 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-cd127326-e9f2-453b-bf76-a91d66b31d58 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:03:04.537249 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-cd127326-e9f2-453b-bf76-a91d66b31d58 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:04.545656 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cd127326-e9f2-453b-bf76-a91d66b31d58 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:04.547379 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cd127326-e9f2-453b-bf76-a91d66b31d58 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:04.548639 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cd127326-e9f2-453b-bf76-a91d66b31d58 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:04.549390 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cd127326-e9f2-453b-bf76-a91d66b31d58 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:05.364533 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-cd127326-e9f2-453b-bf76-a91d66b31d58 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:03:05.381847 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-cd127326-e9f2-453b-bf76-a91d66b31d58 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9" status: 200 len: 1666 microversion: 2.1 time: 0.854958 Jan 15 21:03:05.382642 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2315/4608] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:03:04 2022] GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9 => generated 1666 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:03:05.389457 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ac855bd3-d416-4e9f-bff9-0c90bf60eedb tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:03:05.391053 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ac855bd3-d416-4e9f-bff9-0c90bf60eedb tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: 5a31d952-72c7-4a45-bc31-46cef41d4b53] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:05.407444 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ac855bd3-d416-4e9f-bff9-0c90bf60eedb tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:05.408247 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ac855bd3-d416-4e9f-bff9-0c90bf60eedb tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:05.409509 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ac855bd3-d416-4e9f-bff9-0c90bf60eedb tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:05.410258 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ac855bd3-d416-4e9f-bff9-0c90bf60eedb tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:05.415094 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-203ebe1d-f254-4f8e-aa6d-753bc35fd63a tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e8f253bac41484ab8e92b74bfa54465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74165fadf5154c319ca56b4aa961e7b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:03:05.427401 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-203ebe1d-f254-4f8e-aa6d-753bc35fd63a tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] 10.222.0.46 "GET /compute/v2.1/servers/26f27adc-8567-4752-8a51-ee9c301b2611" status: 200 len: 1503 microversion: 2.1 time: 1.232254 Jan 15 21:03:05.428025 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2294/4609] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:03:04 2022] GET /compute/v2.1/servers/26f27adc-8567-4752-8a51-ee9c301b2611 => generated 1503 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:03:05.442808 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-6f5480c3-aaf0-4c5c-b8f0-ee558cfcb3f1 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:03:05.443747 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-6f5480c3-aaf0-4c5c-b8f0-ee558cfcb3f1 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:05.472122 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6f5480c3-aaf0-4c5c-b8f0-ee558cfcb3f1 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:05.474703 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6f5480c3-aaf0-4c5c-b8f0-ee558cfcb3f1 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:05.477876 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6f5480c3-aaf0-4c5c-b8f0-ee558cfcb3f1 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:05.479503 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6f5480c3-aaf0-4c5c-b8f0-ee558cfcb3f1 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:05.975921 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-ac855bd3-d416-4e9f-bff9-0c90bf60eedb tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb3421bc9494914bc5f797b15a55643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31af2a6b9424f168dd6084d8d5fd0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:03:05.989393 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ac855bd3-d416-4e9f-bff9-0c90bf60eedb tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/5a31d952-72c7-4a45-bc31-46cef41d4b53" status: 200 len: 1321 microversion: 2.1 time: 0.605468 Jan 15 21:03:05.990974 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2316/4610] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:03:05 2022] GET /compute/v2.1/servers/5a31d952-72c7-4a45-bc31-46cef41d4b53 => generated 1321 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:03:05.997044 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-4668cc3e-6c36-4648-a781-52526c89ad28 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:03:05.997883 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-4668cc3e-6c36-4648-a781-52526c89ad28 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:06.005443 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4668cc3e-6c36-4648-a781-52526c89ad28 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:06.006298 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4668cc3e-6c36-4648-a781-52526c89ad28 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:06.007256 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4668cc3e-6c36-4648-a781-52526c89ad28 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:06.008014 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4668cc3e-6c36-4648-a781-52526c89ad28 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:06.272380 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-4668cc3e-6c36-4648-a781-52526c89ad28 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:03:06.283233 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-4668cc3e-6c36-4648-a781-52526c89ad28 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:03:06.285081 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-4668cc3e-6c36-4648-a781-52526c89ad28 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:03:06.286454 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-4668cc3e-6c36-4648-a781-52526c89ad28 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0" status: 200 len: 1806 microversion: 2.20 time: 0.294286 Jan 15 21:03:06.287493 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2317/4611] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:03:05 2022] GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0 => generated 1806 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:03:06.304952 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-56815c82-faca-4873-867e-2402a0b6e03f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:03:06.306280 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-56815c82-faca-4873-867e-2402a0b6e03f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:06.314721 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-56815c82-faca-4873-867e-2402a0b6e03f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:06.315477 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-56815c82-faca-4873-867e-2402a0b6e03f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:06.316517 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-56815c82-faca-4873-867e-2402a0b6e03f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:06.317236 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-56815c82-faca-4873-867e-2402a0b6e03f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:06.329757 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-6f5480c3-aaf0-4c5c-b8f0-ee558cfcb3f1 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.899697 Jan 15 21:03:06.334600 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2295/4612] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:03:05 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:03:06.346072 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1526bd40-6e22-405a-948a-6744780c40c9 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Action: 'create', calling method: .version_select at 0x7f30c855c5e0>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-2008548346", "description": "tempest-description-21918622"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:03:06.474751 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-56815c82-faca-4873-867e-2402a0b6e03f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.183799 Jan 15 21:03:06.482564 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2318/4613] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:03:06 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:03:06.506711 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f0bd2f1c-90a5-4a74-9419-e2fd0b9dd32a tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:03:06.507775 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f0bd2f1c-90a5-4a74-9419-e2fd0b9dd32a tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:06.535758 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f0bd2f1c-90a5-4a74-9419-e2fd0b9dd32a tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:06.543038 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f0bd2f1c-90a5-4a74-9419-e2fd0b9dd32a tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:06.547871 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f0bd2f1c-90a5-4a74-9419-e2fd0b9dd32a tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:06.548793 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f0bd2f1c-90a5-4a74-9419-e2fd0b9dd32a tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:07.134227 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-1526bd40-6e22-405a-948a-6744780c40c9 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] 10.222.0.46 "POST /compute/v2.1/os-security-groups" status: 200 len: 249 microversion: 2.1 time: 0.797736 Jan 15 21:03:07.145972 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2296/4614] 10.222.0.46 () {60 vars in 1179 bytes} [Sat Jan 15 21:03:06 2022] POST /compute/v2.1/os-security-groups => generated 249 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:03:07.162007 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-caf31689-cb37-4619-aac6-cc7fa521cba5 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:03:07.166712 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-caf31689-cb37-4619-aac6-cc7fa521cba5 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:07.204139 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-caf31689-cb37-4619-aac6-cc7fa521cba5 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:07.204587 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-caf31689-cb37-4619-aac6-cc7fa521cba5 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:07.211659 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-caf31689-cb37-4619-aac6-cc7fa521cba5 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:07.213504 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-caf31689-cb37-4619-aac6-cc7fa521cba5 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:07.307979 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-f0bd2f1c-90a5-4a74-9419-e2fd0b9dd32a tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6097506a2d4e36818310d9d70bf01b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4dad65fccfe481a973f5fcbb9287dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:03:07.322475 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f0bd2f1c-90a5-4a74-9419-e2fd0b9dd32a tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "GET /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a" status: 200 len: 1721 microversion: 2.1 time: 0.838459 Jan 15 21:03:07.332150 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2319/4615] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:03:06 2022] GET /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a => generated 1721 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:03:07.353527 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-aaf97d11-6fed-497f-95d3-1192cb419e6d tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:03:07.353527 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-aaf97d11-6fed-497f-95d3-1192cb419e6d tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: 5a31d952-72c7-4a45-bc31-46cef41d4b53] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:07.376288 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-aaf97d11-6fed-497f-95d3-1192cb419e6d tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:07.379060 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-aaf97d11-6fed-497f-95d3-1192cb419e6d tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:07.387203 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-aaf97d11-6fed-497f-95d3-1192cb419e6d tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:07.387883 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-aaf97d11-6fed-497f-95d3-1192cb419e6d tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:07.773376 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-caf31689-cb37-4619-aac6-cc7fa521cba5 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:03:07.784206 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-caf31689-cb37-4619-aac6-cc7fa521cba5 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9" status: 200 len: 1670 microversion: 2.1 time: 0.636782 Jan 15 21:03:07.790387 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2297/4616] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:03:07 2022] GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9 => generated 1670 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:03:07.804469 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-99f64cd9-91ec-47a3-8089-c4163116d294 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-2008548346"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:03:07.810697 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-99f64cd9-91ec-47a3-8089-c4163116d294 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] [instance: 26f27adc-8567-4752-8a51-ee9c301b2611] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:07.831247 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-99f64cd9-91ec-47a3-8089-c4163116d294 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:07.834274 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-99f64cd9-91ec-47a3-8089-c4163116d294 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:07.835357 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-99f64cd9-91ec-47a3-8089-c4163116d294 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:07.836015 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-99f64cd9-91ec-47a3-8089-c4163116d294 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:07.966208 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-aaf97d11-6fed-497f-95d3-1192cb419e6d tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb3421bc9494914bc5f797b15a55643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31af2a6b9424f168dd6084d8d5fd0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:03:07.984228 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-aaf97d11-6fed-497f-95d3-1192cb419e6d tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/5a31d952-72c7-4a45-bc31-46cef41d4b53" status: 200 len: 1321 microversion: 2.1 time: 0.652855 Jan 15 21:03:07.998051 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2320/4617] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:03:07 2022] GET /compute/v2.1/servers/5a31d952-72c7-4a45-bc31-46cef41d4b53 => generated 1321 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:03:08.012262 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-44906cae-200f-4877-8cbc-56a45ba29f9d tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:03:08.015544 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-44906cae-200f-4877-8cbc-56a45ba29f9d tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:08.032165 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-44906cae-200f-4877-8cbc-56a45ba29f9d tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:08.033086 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-44906cae-200f-4877-8cbc-56a45ba29f9d tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:08.035677 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-44906cae-200f-4877-8cbc-56a45ba29f9d tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:08.037820 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-44906cae-200f-4877-8cbc-56a45ba29f9d tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:08.119515 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.network.security_group_api [None req-99f64cd9-91ec-47a3-8089-c4163116d294 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Adding security group c27eaa4f-5ee4-41ab-964e-cbe397d1f1d3 to port 99af8280-f44b-4d03-aa1f-f1d9da00f1e9 Jan 15 21:03:08.539760 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-44906cae-200f-4877-8cbc-56a45ba29f9d tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:03:08.552085 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-44906cae-200f-4877-8cbc-56a45ba29f9d tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:03:08.556402 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-44906cae-200f-4877-8cbc-56a45ba29f9d tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:03:08.562843 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-44906cae-200f-4877-8cbc-56a45ba29f9d tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0" status: 200 len: 1806 microversion: 2.20 time: 0.562726 Jan 15 21:03:08.581032 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2321/4618] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:03:07 2022] GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0 => generated 1806 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:03:08.587051 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-18d722df-cb76-4973-a4bf-a20dd8365214 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:03:08.592310 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-18d722df-cb76-4973-a4bf-a20dd8365214 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:08.618060 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-18d722df-cb76-4973-a4bf-a20dd8365214 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:08.632706 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-18d722df-cb76-4973-a4bf-a20dd8365214 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:08.634006 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-18d722df-cb76-4973-a4bf-a20dd8365214 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:08.634464 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-18d722df-cb76-4973-a4bf-a20dd8365214 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:08.953599 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-99f64cd9-91ec-47a3-8089-c4163116d294 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] 10.222.0.46 "POST /compute/v2.1/servers/26f27adc-8567-4752-8a51-ee9c301b2611/action" status: 202 len: 0 microversion: 2.1 time: 1.160551 Jan 15 21:03:08.955180 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2298/4619] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:03:07 2022] POST /compute/v2.1/servers/26f27adc-8567-4752-8a51-ee9c301b2611/action => generated 0 bytes in 1164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:03:08.964097 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-fafee1ec-018c-4c7c-853b-3eefc182f2c2 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:03:08.969518 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-fafee1ec-018c-4c7c-853b-3eefc182f2c2 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:08.988272 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fafee1ec-018c-4c7c-853b-3eefc182f2c2 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:08.990101 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fafee1ec-018c-4c7c-853b-3eefc182f2c2 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:08.993791 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fafee1ec-018c-4c7c-853b-3eefc182f2c2 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:08.995070 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fafee1ec-018c-4c7c-853b-3eefc182f2c2 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:09.092152 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-fafee1ec-018c-4c7c-853b-3eefc182f2c2 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.135085 Jan 15 21:03:09.098954 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2299/4620] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:03:08 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:03:09.106474 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d51f2b7d-b06e-4f93-9a98-77db8ac47ca5 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:03:09.107482 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-d51f2b7d-b06e-4f93-9a98-77db8ac47ca5 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:09.118578 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d51f2b7d-b06e-4f93-9a98-77db8ac47ca5 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:09.120328 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d51f2b7d-b06e-4f93-9a98-77db8ac47ca5 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:09.121449 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d51f2b7d-b06e-4f93-9a98-77db8ac47ca5 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:09.122113 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d51f2b7d-b06e-4f93-9a98-77db8ac47ca5 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:09.391547 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-d51f2b7d-b06e-4f93-9a98-77db8ac47ca5 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:03:09.403768 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d51f2b7d-b06e-4f93-9a98-77db8ac47ca5 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9" status: 200 len: 1670 microversion: 2.1 time: 0.302279 Jan 15 21:03:09.406150 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2300/4621] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:03:09 2022] GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9 => generated 1670 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:03:09.412151 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-308feac0-111f-499a-8935-d9af7aa0bf83 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:03:09.413112 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-308feac0-111f-499a-8935-d9af7aa0bf83 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:09.433078 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-308feac0-111f-499a-8935-d9af7aa0bf83 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:09.433940 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-308feac0-111f-499a-8935-d9af7aa0bf83 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:09.434991 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-308feac0-111f-499a-8935-d9af7aa0bf83 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:09.435733 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-308feac0-111f-499a-8935-d9af7aa0bf83 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:09.800830 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-18d722df-cb76-4973-a4bf-a20dd8365214 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 1.217621 Jan 15 21:03:09.803115 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2322/4622] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:03:08 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:03:09.809280 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-7d892fbe-0680-4f90-bf50-004640aa3e5e req-16e31b10-d147-4d19-ae01-0e5e3b44963d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26f27adc-8567-4752-8a51-ee9c301b2611", "tag": "99af8280-f44b-4d03-aa1f-f1d9da00f1e9"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:03:09.811184 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:03:09.811184 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:03:09.822994 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-7d892fbe-0680-4f90-bf50-004640aa3e5e req-16e31b10-d147-4d19-ae01-0e5e3b44963d service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:09.823732 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-7d892fbe-0680-4f90-bf50-004640aa3e5e req-16e31b10-d147-4d19-ae01-0e5e3b44963d service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:09.866640 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-308feac0-111f-499a-8935-d9af7aa0bf83 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6097506a2d4e36818310d9d70bf01b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4dad65fccfe481a973f5fcbb9287dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:03:09.877085 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-7d892fbe-0680-4f90-bf50-004640aa3e5e req-16e31b10-d147-4d19-ae01-0e5e3b44963d service nova] Creating event network-changed:99af8280-f44b-4d03-aa1f-f1d9da00f1e9 for instance 26f27adc-8567-4752-8a51-ee9c301b2611 on nch2-master-1 Jan 15 21:03:09.892274 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-7d892fbe-0680-4f90-bf50-004640aa3e5e req-16e31b10-d147-4d19-ae01-0e5e3b44963d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087472 Jan 15 21:03:09.893233 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-308feac0-111f-499a-8935-d9af7aa0bf83 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "GET /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a" status: 200 len: 1721 microversion: 2.1 time: 0.485071 Jan 15 21:03:09.894165 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2301/4623] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:03:09 2022] GET /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a => generated 1721 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:03:09.894856 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2323/4624] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:03:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:03:09.904892 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d74b33d3-b296-439c-9f5a-a3ca422ba9ec tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-2008548346"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:03:09.908141 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-d74b33d3-b296-439c-9f5a-a3ca422ba9ec tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] [instance: 26f27adc-8567-4752-8a51-ee9c301b2611] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:09.911227 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-4de94698-f20e-4bf7-bd37-c3bc4ac8a793 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:03:09.912790 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-4de94698-f20e-4bf7-bd37-c3bc4ac8a793 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: 5a31d952-72c7-4a45-bc31-46cef41d4b53] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:09.927306 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4de94698-f20e-4bf7-bd37-c3bc4ac8a793 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:09.928790 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d74b33d3-b296-439c-9f5a-a3ca422ba9ec tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:09.929402 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d74b33d3-b296-439c-9f5a-a3ca422ba9ec tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:09.929974 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4de94698-f20e-4bf7-bd37-c3bc4ac8a793 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:09.930608 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d74b33d3-b296-439c-9f5a-a3ca422ba9ec tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:09.931146 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d74b33d3-b296-439c-9f5a-a3ca422ba9ec tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:09.932133 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4de94698-f20e-4bf7-bd37-c3bc4ac8a793 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:09.935107 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4de94698-f20e-4bf7-bd37-c3bc4ac8a793 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:10.265326 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.network.security_group_api [None req-d74b33d3-b296-439c-9f5a-a3ca422ba9ec tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Removing security group c27eaa4f-5ee4-41ab-964e-cbe397d1f1d3 from port 99af8280-f44b-4d03-aa1f-f1d9da00f1e9 Jan 15 21:03:10.441890 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-4de94698-f20e-4bf7-bd37-c3bc4ac8a793 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb3421bc9494914bc5f797b15a55643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31af2a6b9424f168dd6084d8d5fd0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:03:10.449385 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-4de94698-f20e-4bf7-bd37-c3bc4ac8a793 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/5a31d952-72c7-4a45-bc31-46cef41d4b53" status: 200 len: 1321 microversion: 2.1 time: 0.552096 Jan 15 21:03:10.461476 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2324/4625] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:03:09 2022] GET /compute/v2.1/servers/5a31d952-72c7-4a45-bc31-46cef41d4b53 => generated 1321 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:03:10.479508 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-83aa7e20-fd9a-42ed-a7b3-a76b6afbcca1 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:03:10.480061 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-83aa7e20-fd9a-42ed-a7b3-a76b6afbcca1 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:10.486853 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-83aa7e20-fd9a-42ed-a7b3-a76b6afbcca1 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:10.487339 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-83aa7e20-fd9a-42ed-a7b3-a76b6afbcca1 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:10.488100 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-83aa7e20-fd9a-42ed-a7b3-a76b6afbcca1 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:10.488532 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-83aa7e20-fd9a-42ed-a7b3-a76b6afbcca1 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:10.568084 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-83aa7e20-fd9a-42ed-a7b3-a76b6afbcca1 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Unlocking {{(pid=129365) unlock /opt/stack/nova/nova/compute/api.py:4653}} Jan 15 21:03:10.684404 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-83aa7e20-fd9a-42ed-a7b3-a76b6afbcca1 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action" status: 202 len: 0 microversion: 2.1 time: 0.220990 Jan 15 21:03:10.685527 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2325/4626] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:03:10 2022] POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:03:10.697227 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8aad99fc-48c9-4a95-bb7f-0c6324541185 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:03:10.697227 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-8aad99fc-48c9-4a95-bb7f-0c6324541185 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:10.704661 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8aad99fc-48c9-4a95-bb7f-0c6324541185 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:10.705334 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8aad99fc-48c9-4a95-bb7f-0c6324541185 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:10.706300 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8aad99fc-48c9-4a95-bb7f-0c6324541185 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:10.706609 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8aad99fc-48c9-4a95-bb7f-0c6324541185 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:11.319732 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-8aad99fc-48c9-4a95-bb7f-0c6324541185 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:03:11.336349 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-8aad99fc-48c9-4a95-bb7f-0c6324541185 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:03:11.337912 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-8aad99fc-48c9-4a95-bb7f-0c6324541185 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:03:11.339113 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-8aad99fc-48c9-4a95-bb7f-0c6324541185 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0" status: 200 len: 1806 microversion: 2.20 time: 0.652564 Jan 15 21:03:11.344019 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2326/4627] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:03:10 2022] GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0 => generated 1806 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:03:11.352448 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e3a0017d-ff6b-469b-b544-8730bd4c8b22 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:03:11.359442 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e3a0017d-ff6b-469b-b544-8730bd4c8b22 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:11.375461 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e3a0017d-ff6b-469b-b544-8730bd4c8b22 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:11.388146 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e3a0017d-ff6b-469b-b544-8730bd4c8b22 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:11.399768 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e3a0017d-ff6b-469b-b544-8730bd4c8b22 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:11.403464 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e3a0017d-ff6b-469b-b544-8730bd4c8b22 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:11.513762 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e3a0017d-ff6b-469b-b544-8730bd4c8b22 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.166809 Jan 15 21:03:11.524282 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2327/4628] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:03:11 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:03:11.530193 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-464f40fe-bd53-40c8-8bb4-67565c68eea4 req-1a0e6d3c-7224-49c5-9742-267f3e6951f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a31d952-72c7-4a45-bc31-46cef41d4b53", "name": "network-vif-plugged", "status": "completed", "tag": "558dc990-4fe6-4fd2-8ab9-c709029ab8be"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:03:11.536114 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:03:11.536114 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:03:11.558712 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-464f40fe-bd53-40c8-8bb4-67565c68eea4 req-1a0e6d3c-7224-49c5-9742-267f3e6951f2 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:11.559341 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-464f40fe-bd53-40c8-8bb4-67565c68eea4 req-1a0e6d3c-7224-49c5-9742-267f3e6951f2 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:11.596735 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-464f40fe-bd53-40c8-8bb4-67565c68eea4 req-1a0e6d3c-7224-49c5-9742-267f3e6951f2 service nova] Creating event network-vif-plugged:558dc990-4fe6-4fd2-8ab9-c709029ab8be for instance 5a31d952-72c7-4a45-bc31-46cef41d4b53 on nch1-master-1 Jan 15 21:03:11.606057 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-464f40fe-bd53-40c8-8bb4-67565c68eea4 req-1a0e6d3c-7224-49c5-9742-267f3e6951f2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076871 Jan 15 21:03:11.606862 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2328/4629] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:03:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:03:11.641718 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-af033a16-e499-4413-9754-1a9f3109b1e5 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:03:11.643438 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-af033a16-e499-4413-9754-1a9f3109b1e5 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:11.656892 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-af033a16-e499-4413-9754-1a9f3109b1e5 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:11.662985 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-af033a16-e499-4413-9754-1a9f3109b1e5 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:11.663874 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-af033a16-e499-4413-9754-1a9f3109b1e5 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:11.664485 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-af033a16-e499-4413-9754-1a9f3109b1e5 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:12.286319 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d74b33d3-b296-439c-9f5a-a3ca422ba9ec tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] 10.222.0.46 "POST /compute/v2.1/servers/26f27adc-8567-4752-8a51-ee9c301b2611/action" status: 202 len: 0 microversion: 2.1 time: 2.389464 Jan 15 21:03:12.287712 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2302/4630] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:03:09 2022] POST /compute/v2.1/servers/26f27adc-8567-4752-8a51-ee9c301b2611/action => generated 0 bytes in 2393 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:03:12.298014 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-6485ad14-5a99-47de-9b4c-5fb1c13a44f2 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:03:12.299571 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-6485ad14-5a99-47de-9b4c-5fb1c13a44f2 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:12.309639 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6485ad14-5a99-47de-9b4c-5fb1c13a44f2 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:12.310405 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6485ad14-5a99-47de-9b4c-5fb1c13a44f2 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:12.312062 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6485ad14-5a99-47de-9b4c-5fb1c13a44f2 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:12.312808 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6485ad14-5a99-47de-9b4c-5fb1c13a44f2 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:12.491662 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-af033a16-e499-4413-9754-1a9f3109b1e5 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:03:12.505328 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-af033a16-e499-4413-9754-1a9f3109b1e5 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9" status: 200 len: 1670 microversion: 2.1 time: 0.893190 Jan 15 21:03:12.506563 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2329/4631] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:03:11 2022] GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9 => generated 1670 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:03:12.512607 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2cc9a96a-5f50-4ff6-b7d1-8f1d44dac4ec tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:03:12.513869 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-2cc9a96a-5f50-4ff6-b7d1-8f1d44dac4ec tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:12.532754 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2cc9a96a-5f50-4ff6-b7d1-8f1d44dac4ec tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:12.537299 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2cc9a96a-5f50-4ff6-b7d1-8f1d44dac4ec tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:12.538416 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2cc9a96a-5f50-4ff6-b7d1-8f1d44dac4ec tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:12.539095 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2cc9a96a-5f50-4ff6-b7d1-8f1d44dac4ec tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:12.762638 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-2cc9a96a-5f50-4ff6-b7d1-8f1d44dac4ec tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6097506a2d4e36818310d9d70bf01b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4dad65fccfe481a973f5fcbb9287dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:03:12.773331 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2cc9a96a-5f50-4ff6-b7d1-8f1d44dac4ec tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "GET /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a" status: 200 len: 1698 microversion: 2.1 time: 0.264416 Jan 15 21:03:12.774213 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2330/4632] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:03:12 2022] GET /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a => generated 1698 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:03:12.783802 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c41a123e-7280-479e-8792-2249dd95a86d tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:03:12.784734 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c41a123e-7280-479e-8792-2249dd95a86d tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: 5a31d952-72c7-4a45-bc31-46cef41d4b53] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:12.791281 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c41a123e-7280-479e-8792-2249dd95a86d tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:12.791880 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c41a123e-7280-479e-8792-2249dd95a86d tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:12.792786 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c41a123e-7280-479e-8792-2249dd95a86d tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:12.793348 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c41a123e-7280-479e-8792-2249dd95a86d tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:13.063835 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-c41a123e-7280-479e-8792-2249dd95a86d tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb3421bc9494914bc5f797b15a55643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31af2a6b9424f168dd6084d8d5fd0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:03:13.074786 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c41a123e-7280-479e-8792-2249dd95a86d tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/5a31d952-72c7-4a45-bc31-46cef41d4b53" status: 200 len: 1321 microversion: 2.1 time: 0.293843 Jan 15 21:03:13.087016 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2331/4633] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:03:12 2022] GET /compute/v2.1/servers/5a31d952-72c7-4a45-bc31-46cef41d4b53 => generated 1321 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:03:13.109568 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5a184a01-c1c4-4ddf-8f79-735526ab37a1 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Action: 'create', calling method: .version_select at 0x7f30c953a280>, body: {"pool": null} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:03:13.259940 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-6485ad14-5a99-47de-9b4c-5fb1c13a44f2 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.969196 Jan 15 21:03:13.268709 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2303/4634] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:03:12 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:03:13.275040 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-28408ff8-8dcc-4294-9309-4a2d899f3be9 req-0f24d378-095d-41c9-a9d8-de13d7beedb5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26f27adc-8567-4752-8a51-ee9c301b2611", "tag": "99af8280-f44b-4d03-aa1f-f1d9da00f1e9"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:03:13.276503 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:03:13.276503 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:03:13.301925 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-28408ff8-8dcc-4294-9309-4a2d899f3be9 req-0f24d378-095d-41c9-a9d8-de13d7beedb5 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:13.306783 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-28408ff8-8dcc-4294-9309-4a2d899f3be9 req-0f24d378-095d-41c9-a9d8-de13d7beedb5 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:13.337485 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-28408ff8-8dcc-4294-9309-4a2d899f3be9 req-0f24d378-095d-41c9-a9d8-de13d7beedb5 service nova] Creating event network-changed:99af8280-f44b-4d03-aa1f-f1d9da00f1e9 for instance 26f27adc-8567-4752-8a51-ee9c301b2611 on nch2-master-1 Jan 15 21:03:13.361338 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-28408ff8-8dcc-4294-9309-4a2d899f3be9 req-0f24d378-095d-41c9-a9d8-de13d7beedb5 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090608 Jan 15 21:03:13.363186 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2304/4635] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:03:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:03:13.381208 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b2781900-b63e-49bb-8a7e-9bcda0bf0236 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:03:13.385796 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b2781900-b63e-49bb-8a7e-9bcda0bf0236 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:13.402927 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b2781900-b63e-49bb-8a7e-9bcda0bf0236 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:13.406205 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b2781900-b63e-49bb-8a7e-9bcda0bf0236 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:13.407207 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b2781900-b63e-49bb-8a7e-9bcda0bf0236 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:13.409753 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b2781900-b63e-49bb-8a7e-9bcda0bf0236 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:13.759846 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-b2781900-b63e-49bb-8a7e-9bcda0bf0236 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:03:13.776504 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-b2781900-b63e-49bb-8a7e-9bcda0bf0236 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:03:13.784267 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-b2781900-b63e-49bb-8a7e-9bcda0bf0236 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:03:13.788747 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b2781900-b63e-49bb-8a7e-9bcda0bf0236 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0" status: 200 len: 1806 microversion: 2.20 time: 0.422642 Jan 15 21:03:13.797462 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2305/4636] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:03:13 2022] GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0 => generated 1806 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:03:13.817388 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e254b5c6-3122-4bb9-b9db-ded00a50d945 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:03:13.820976 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e254b5c6-3122-4bb9-b9db-ded00a50d945 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:13.844433 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e254b5c6-3122-4bb9-b9db-ded00a50d945 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:13.847647 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e254b5c6-3122-4bb9-b9db-ded00a50d945 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:13.850538 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e254b5c6-3122-4bb9-b9db-ded00a50d945 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:13.851811 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e254b5c6-3122-4bb9-b9db-ded00a50d945 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:13.984653 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e254b5c6-3122-4bb9-b9db-ded00a50d945 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action" status: 202 len: 0 microversion: 2.1 time: 0.182294 Jan 15 21:03:13.985988 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2306/4637] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:03:13 2022] POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:03:13.996685 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b4f84df4-3eba-4d27-920b-835430f24cd6 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:03:13.998184 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b4f84df4-3eba-4d27-920b-835430f24cd6 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:14.008054 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b4f84df4-3eba-4d27-920b-835430f24cd6 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:14.009574 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b4f84df4-3eba-4d27-920b-835430f24cd6 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:14.011164 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b4f84df4-3eba-4d27-920b-835430f24cd6 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:14.012076 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b4f84df4-3eba-4d27-920b-835430f24cd6 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:14.078232 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b4f84df4-3eba-4d27-920b-835430f24cd6 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.088886 Jan 15 21:03:14.079304 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2307/4638] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:03:13 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:03:14.091890 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-262259ef-16d9-4a4d-b35c-1ce69888c4e0 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:03:14.107499 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-262259ef-16d9-4a4d-b35c-1ce69888c4e0 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:14.109833 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-262259ef-16d9-4a4d-b35c-1ce69888c4e0 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:14.139165 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-262259ef-16d9-4a4d-b35c-1ce69888c4e0 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Going to try to start instance {{(pid=129366) start /opt/stack/nova/nova/compute/api.py:2677}} Jan 15 21:03:14.236555 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-262259ef-16d9-4a4d-b35c-1ce69888c4e0 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action" status: 202 len: 0 microversion: 2.1 time: 0.155611 Jan 15 21:03:14.237474 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2308/4639] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:03:14 2022] POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:03:14.258728 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-3d06d381-0922-41cb-aaeb-1fa65a092217 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:03:14.261328 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-3d06d381-0922-41cb-aaeb-1fa65a092217 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:14.273201 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3d06d381-0922-41cb-aaeb-1fa65a092217 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:14.274016 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3d06d381-0922-41cb-aaeb-1fa65a092217 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:14.276202 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3d06d381-0922-41cb-aaeb-1fa65a092217 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:14.276834 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3d06d381-0922-41cb-aaeb-1fa65a092217 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:14.554887 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-3d06d381-0922-41cb-aaeb-1fa65a092217 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:03:14.573911 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-3d06d381-0922-41cb-aaeb-1fa65a092217 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9" status: 200 len: 1655 microversion: 2.1 time: 0.335011 Jan 15 21:03:14.590319 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2309/4640] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:03:14 2022] GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9 => generated 1655 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:03:14.597294 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8155553b-9ab4-48e5-b6c3-7ac495942427 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:03:14.605920 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-8155553b-9ab4-48e5-b6c3-7ac495942427 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: 5a31d952-72c7-4a45-bc31-46cef41d4b53] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:14.615046 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8155553b-9ab4-48e5-b6c3-7ac495942427 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:14.615046 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8155553b-9ab4-48e5-b6c3-7ac495942427 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:14.615605 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8155553b-9ab4-48e5-b6c3-7ac495942427 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:14.617064 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8155553b-9ab4-48e5-b6c3-7ac495942427 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:14.835932 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-8155553b-9ab4-48e5-b6c3-7ac495942427 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb3421bc9494914bc5f797b15a55643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31af2a6b9424f168dd6084d8d5fd0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:03:14.852144 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-8155553b-9ab4-48e5-b6c3-7ac495942427 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/5a31d952-72c7-4a45-bc31-46cef41d4b53" status: 200 len: 1502 microversion: 2.1 time: 0.258432 Jan 15 21:03:14.868771 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2310/4641] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:03:14 2022] GET /compute/v2.1/servers/5a31d952-72c7-4a45-bc31-46cef41d4b53 => generated 1502 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:03:14.877288 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a7f82690-7c5a-474d-b3fe-8f40a4b410ff tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:03:14.878080 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a7f82690-7c5a-474d-b3fe-8f40a4b410ff tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:14.887435 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a7f82690-7c5a-474d-b3fe-8f40a4b410ff tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:14.888051 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a7f82690-7c5a-474d-b3fe-8f40a4b410ff tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:14.891248 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a7f82690-7c5a-474d-b3fe-8f40a4b410ff tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:14.892485 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a7f82690-7c5a-474d-b3fe-8f40a4b410ff tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:15.463221 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-a7f82690-7c5a-474d-b3fe-8f40a4b410ff tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6097506a2d4e36818310d9d70bf01b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4dad65fccfe481a973f5fcbb9287dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:03:15.474016 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a7f82690-7c5a-474d-b3fe-8f40a4b410ff tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "GET /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a" status: 200 len: 1707 microversion: 2.1 time: 0.602572 Jan 15 21:03:15.474805 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2311/4642] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:03:14 2022] GET /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a => generated 1707 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:03:15.485183 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-34293e33-91a8-48fd-baf6-47296c5d8c0c tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:03:15.486218 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-34293e33-91a8-48fd-baf6-47296c5d8c0c tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:15.492643 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-34293e33-91a8-48fd-baf6-47296c5d8c0c tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:15.493405 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-34293e33-91a8-48fd-baf6-47296c5d8c0c tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:15.493968 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-34293e33-91a8-48fd-baf6-47296c5d8c0c tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:15.494409 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-34293e33-91a8-48fd-baf6-47296c5d8c0c tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:15.547150 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-34293e33-91a8-48fd-baf6-47296c5d8c0c tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.066945 Jan 15 21:03:15.552968 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2312/4643] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:03:15 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:03:15.559533 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-35e96add-bc66-43a0-b3eb-784ff1c158d8 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:03:15.560216 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-35e96add-bc66-43a0-b3eb-784ff1c158d8 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:15.568314 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-35e96add-bc66-43a0-b3eb-784ff1c158d8 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:15.568766 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-35e96add-bc66-43a0-b3eb-784ff1c158d8 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:15.569603 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-35e96add-bc66-43a0-b3eb-784ff1c158d8 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:15.570041 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-35e96add-bc66-43a0-b3eb-784ff1c158d8 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:15.653518 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-35e96add-bc66-43a0-b3eb-784ff1c158d8 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action" status: 202 len: 0 microversion: 2.1 time: 0.098601 Jan 15 21:03:15.653937 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2313/4644] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:03:15 2022] POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:03:15.664481 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-55156ca3-909e-453c-bb37-07213144647a tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:03:15.665401 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-55156ca3-909e-453c-bb37-07213144647a tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:15.678773 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-55156ca3-909e-453c-bb37-07213144647a tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:15.679701 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-55156ca3-909e-453c-bb37-07213144647a tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:15.680888 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-55156ca3-909e-453c-bb37-07213144647a tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:15.682526 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-55156ca3-909e-453c-bb37-07213144647a tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:15.928412 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5a184a01-c1c4-4ddf-8f79-735526ab37a1 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] 10.222.0.46 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.839834 Jan 15 21:03:15.929143 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2332/4645] 10.222.0.46 () {60 vars in 1169 bytes} [Sat Jan 15 21:03:13 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2841 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:03:15.933538 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c5bae5e2-f864-48bb-ae18-fb2a67d1bddc tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:03:15.934354 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c5bae5e2-f864-48bb-ae18-fb2a67d1bddc tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: 5a31d952-72c7-4a45-bc31-46cef41d4b53] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:15.942952 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c5bae5e2-f864-48bb-ae18-fb2a67d1bddc tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:15.943807 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c5bae5e2-f864-48bb-ae18-fb2a67d1bddc tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:15.944800 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c5bae5e2-f864-48bb-ae18-fb2a67d1bddc tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:15.945423 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c5bae5e2-f864-48bb-ae18-fb2a67d1bddc tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:15.960959 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-55156ca3-909e-453c-bb37-07213144647a tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:03:15.970140 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-55156ca3-909e-453c-bb37-07213144647a tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:03:15.971953 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-55156ca3-909e-453c-bb37-07213144647a tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:03:15.973269 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-55156ca3-909e-453c-bb37-07213144647a tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0" status: 200 len: 1806 microversion: 2.20 time: 0.314742 Jan 15 21:03:15.985093 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2314/4646] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:03:15 2022] GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0 => generated 1806 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:03:15.991299 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-482a72a0-2d25-4a7d-b86c-e9a9b0baeaaf tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:03:15.994074 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-482a72a0-2d25-4a7d-b86c-e9a9b0baeaaf tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:16.005769 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-482a72a0-2d25-4a7d-b86c-e9a9b0baeaaf tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:16.006326 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-482a72a0-2d25-4a7d-b86c-e9a9b0baeaaf tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:16.008948 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-482a72a0-2d25-4a7d-b86c-e9a9b0baeaaf tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:16.009750 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-482a72a0-2d25-4a7d-b86c-e9a9b0baeaaf tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:16.085453 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-482a72a0-2d25-4a7d-b86c-e9a9b0baeaaf tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.098155 Jan 15 21:03:16.087016 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2315/4647] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:03:15 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:03:16.093158 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7f15707a-192b-4e6f-b27f-0b99e61e9728 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:03:16.094123 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-7f15707a-192b-4e6f-b27f-0b99e61e9728 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:16.102921 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7f15707a-192b-4e6f-b27f-0b99e61e9728 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:16.103424 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7f15707a-192b-4e6f-b27f-0b99e61e9728 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:16.104233 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7f15707a-192b-4e6f-b27f-0b99e61e9728 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:16.105376 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7f15707a-192b-4e6f-b27f-0b99e61e9728 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:16.117542 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-c5bae5e2-f864-48bb-ae18-fb2a67d1bddc tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb3421bc9494914bc5f797b15a55643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31af2a6b9424f168dd6084d8d5fd0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:03:16.126840 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c5bae5e2-f864-48bb-ae18-fb2a67d1bddc tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/5a31d952-72c7-4a45-bc31-46cef41d4b53" status: 200 len: 1502 microversion: 2.1 time: 0.196724 Jan 15 21:03:16.128078 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2333/4648] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:03:15 2022] GET /compute/v2.1/servers/5a31d952-72c7-4a45-bc31-46cef41d4b53 => generated 1502 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:03:16.133091 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9e40f8ec-6872-43f6-afac-794011ccf739 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.1.53"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:03:16.134473 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-9e40f8ec-6872-43f6-afac-794011ccf739 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] [instance: 26f27adc-8567-4752-8a51-ee9c301b2611] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:16.147077 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9e40f8ec-6872-43f6-afac-794011ccf739 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:16.147390 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9e40f8ec-6872-43f6-afac-794011ccf739 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:16.148191 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9e40f8ec-6872-43f6-afac-794011ccf739 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:16.148630 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9e40f8ec-6872-43f6-afac-794011ccf739 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:16.177334 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9e40f8ec-6872-43f6-afac-794011ccf739 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Acquired lock "refresh_cache-26f27adc-8567-4752-8a51-ee9c301b2611" {{(pid=129365) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jan 15 21:03:16.415134 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-7f15707a-192b-4e6f-b27f-0b99e61e9728 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:03:16.424946 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7f15707a-192b-4e6f-b27f-0b99e61e9728 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9" status: 200 len: 1670 microversion: 2.1 time: 0.336587 Jan 15 21:03:16.426209 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2316/4649] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:03:16 2022] GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9 => generated 1670 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:03:16.434521 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-fc589cde-08f4-4b63-baeb-b7a1e4e80645 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:03:16.435154 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-fc589cde-08f4-4b63-baeb-b7a1e4e80645 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: 5a31d952-72c7-4a45-bc31-46cef41d4b53] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:16.443974 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fc589cde-08f4-4b63-baeb-b7a1e4e80645 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:16.444678 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fc589cde-08f4-4b63-baeb-b7a1e4e80645 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:16.446521 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fc589cde-08f4-4b63-baeb-b7a1e4e80645 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:16.447506 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fc589cde-08f4-4b63-baeb-b7a1e4e80645 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:16.486091 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-fc589cde-08f4-4b63-baeb-b7a1e4e80645 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: 5a31d952-72c7-4a45-bc31-46cef41d4b53] Going to try to terminate instance {{(pid=129366) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 21:03:16.597269 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-fc589cde-08f4-4b63-baeb-b7a1e4e80645 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "DELETE /compute/v2.1/servers/5a31d952-72c7-4a45-bc31-46cef41d4b53" status: 204 len: 0 microversion: 2.1 time: 0.169319 Jan 15 21:03:16.597964 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2317/4650] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 21:03:16 2022] DELETE /compute/v2.1/servers/5a31d952-72c7-4a45-bc31-46cef41d4b53 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 21:03:16.605742 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-be0d6e41-981f-4d7d-958d-3a10f4e43ae5 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:03:16.606654 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-be0d6e41-981f-4d7d-958d-3a10f4e43ae5 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:16.614469 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-be0d6e41-981f-4d7d-958d-3a10f4e43ae5 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:16.614929 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-be0d6e41-981f-4d7d-958d-3a10f4e43ae5 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:16.615732 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-be0d6e41-981f-4d7d-958d-3a10f4e43ae5 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:16.616173 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-be0d6e41-981f-4d7d-958d-3a10f4e43ae5 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:16.931523 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-be0d6e41-981f-4d7d-958d-3a10f4e43ae5 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:03:16.940114 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-be0d6e41-981f-4d7d-958d-3a10f4e43ae5 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9" status: 200 len: 1670 microversion: 2.1 time: 0.340155 Jan 15 21:03:16.953609 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2318/4651] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:03:16 2022] GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9 => generated 1670 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:03:16.960385 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-871fae1a-e585-4dcf-8541-571324355828 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:03:16.960730 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-871fae1a-e585-4dcf-8541-571324355828 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:16.966812 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-871fae1a-e585-4dcf-8541-571324355828 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:16.967266 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-871fae1a-e585-4dcf-8541-571324355828 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:16.969931 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-871fae1a-e585-4dcf-8541-571324355828 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:16.970378 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-871fae1a-e585-4dcf-8541-571324355828 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:17.392649 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-871fae1a-e585-4dcf-8541-571324355828 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6097506a2d4e36818310d9d70bf01b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4dad65fccfe481a973f5fcbb9287dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:03:17.408130 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-871fae1a-e585-4dcf-8541-571324355828 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "GET /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a" status: 200 len: 1707 microversion: 2.1 time: 0.453447 Jan 15 21:03:17.409972 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2319/4652] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:03:16 2022] GET /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a => generated 1707 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:03:17.414660 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-da5bc765-c668-4ffb-861b-a1fd5cbc9735 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:03:17.415569 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-da5bc765-c668-4ffb-861b-a1fd5cbc9735 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:17.422335 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-da5bc765-c668-4ffb-861b-a1fd5cbc9735 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:17.422785 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-da5bc765-c668-4ffb-861b-a1fd5cbc9735 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:17.423955 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-da5bc765-c668-4ffb-861b-a1fd5cbc9735 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:17.424079 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-da5bc765-c668-4ffb-861b-a1fd5cbc9735 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:17.478419 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-da5bc765-c668-4ffb-861b-a1fd5cbc9735 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.067350 Jan 15 21:03:17.480245 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2320/4653] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:03:17 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:03:17.488704 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-24f1927e-1727-4568-b3ad-7730d14c67bf tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:03:17.490697 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-24f1927e-1727-4568-b3ad-7730d14c67bf tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: 5a31d952-72c7-4a45-bc31-46cef41d4b53] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:17.504997 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-24f1927e-1727-4568-b3ad-7730d14c67bf tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:17.505465 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-24f1927e-1727-4568-b3ad-7730d14c67bf tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:17.506467 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-24f1927e-1727-4568-b3ad-7730d14c67bf tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:17.506905 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-24f1927e-1727-4568-b3ad-7730d14c67bf tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:17.934704 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-24f1927e-1727-4568-b3ad-7730d14c67bf tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb3421bc9494914bc5f797b15a55643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31af2a6b9424f168dd6084d8d5fd0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:03:17.943768 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-24f1927e-1727-4568-b3ad-7730d14c67bf tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/5a31d952-72c7-4a45-bc31-46cef41d4b53" status: 200 len: 1508 microversion: 2.1 time: 0.459916 Jan 15 21:03:17.944363 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2321/4654] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:03:17 2022] GET /compute/v2.1/servers/5a31d952-72c7-4a45-bc31-46cef41d4b53 => generated 1508 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:03:17.948792 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-50f7bfb9-7938-4bd8-9696-e76bed575fdb tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:03:17.954949 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-50f7bfb9-7938-4bd8-9696-e76bed575fdb tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:17.964266 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-50f7bfb9-7938-4bd8-9696-e76bed575fdb tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:17.964730 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-50f7bfb9-7938-4bd8-9696-e76bed575fdb tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:17.965593 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-50f7bfb9-7938-4bd8-9696-e76bed575fdb tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:17.966142 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-50f7bfb9-7938-4bd8-9696-e76bed575fdb tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:18.246536 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-50f7bfb9-7938-4bd8-9696-e76bed575fdb tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:03:18.254517 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-50f7bfb9-7938-4bd8-9696-e76bed575fdb tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9" status: 200 len: 1670 microversion: 2.1 time: 0.309072 Jan 15 21:03:18.264870 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2322/4655] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:03:17 2022] GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9 => generated 1670 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:03:18.264870 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-22d13f18-1946-4740-a6a3-ca16815bfe7e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:03:18.264870 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-22d13f18-1946-4740-a6a3-ca16815bfe7e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:18.272237 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.network.neutron [None req-9e40f8ec-6872-43f6-afac-794011ccf739 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] [instance: 26f27adc-8567-4752-8a51-ee9c301b2611] Building network info cache for instance {{(pid=129365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1883}} Jan 15 21:03:18.282389 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-22d13f18-1946-4740-a6a3-ca16815bfe7e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:18.282841 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-22d13f18-1946-4740-a6a3-ca16815bfe7e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:18.283641 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-22d13f18-1946-4740-a6a3-ca16815bfe7e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:18.284075 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-22d13f18-1946-4740-a6a3-ca16815bfe7e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:18.771463 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-22d13f18-1946-4740-a6a3-ca16815bfe7e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:03:18.783391 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-22d13f18-1946-4740-a6a3-ca16815bfe7e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:03:18.785088 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-22d13f18-1946-4740-a6a3-ca16815bfe7e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:03:18.786428 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-22d13f18-1946-4740-a6a3-ca16815bfe7e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0" status: 200 len: 1806 microversion: 2.20 time: 0.530401 Jan 15 21:03:18.800183 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2323/4656] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:03:18 2022] GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0 => generated 1806 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:03:18.808019 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-dfe47e02-6a3a-4b82-a74a-c9b9836785ad tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:03:18.819176 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-dfe47e02-6a3a-4b82-a74a-c9b9836785ad tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:18.829892 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dfe47e02-6a3a-4b82-a74a-c9b9836785ad tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:18.837776 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dfe47e02-6a3a-4b82-a74a-c9b9836785ad tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:18.839085 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dfe47e02-6a3a-4b82-a74a-c9b9836785ad tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:18.839785 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dfe47e02-6a3a-4b82-a74a-c9b9836785ad tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:18.898187 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-dfe47e02-6a3a-4b82-a74a-c9b9836785ad tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.096209 Jan 15 21:03:18.903684 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2324/4657] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:03:18 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:03:18.920031 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e701c2f5-8ef8-44ea-9b4e-cf3fb03624e0 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:03:18.922311 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e701c2f5-8ef8-44ea-9b4e-cf3fb03624e0 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:18.931468 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e701c2f5-8ef8-44ea-9b4e-cf3fb03624e0 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:18.932080 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e701c2f5-8ef8-44ea-9b4e-cf3fb03624e0 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:18.933731 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e701c2f5-8ef8-44ea-9b4e-cf3fb03624e0 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:18.934424 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e701c2f5-8ef8-44ea-9b4e-cf3fb03624e0 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:19.546810 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.network.neutron [None req-9e40f8ec-6872-43f6-afac-794011ccf739 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] [instance: 26f27adc-8567-4752-8a51-ee9c301b2611] Updating instance_info_cache with network_info: [{"id": "99af8280-f44b-4d03-aa1f-f1d9da00f1e9", "address": "fa:16:3e:f1:1f:62", "network": {"id": "bf43669e-491e-49cf-8622-cd5d76591729", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-878983702-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.1.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "74165fadf5154c319ca56b4aa961e7b6", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap99af8280-f4", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=129365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jan 15 21:03:19.563185 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9e40f8ec-6872-43f6-afac-794011ccf739 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Releasing lock "refresh_cache-26f27adc-8567-4752-8a51-ee9c301b2611" {{(pid=129365) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jan 15 21:03:19.566377 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-9e40f8ec-6872-43f6-afac-794011ccf739 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] 10.222.0.46 "POST /compute/v2.1/servers/26f27adc-8567-4752-8a51-ee9c301b2611/action" status: 202 len: 0 microversion: 2.1 time: 3.436491 Jan 15 21:03:19.568502 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2334/4658] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:03:16 2022] POST /compute/v2.1/servers/26f27adc-8567-4752-8a51-ee9c301b2611/action => generated 0 bytes in 3440 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jan 15 21:03:19.577989 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-2b4ba39e-d942-4c0d-8b2f-3f1c679208a5 req-c2e9be14-0737-4990-af85-fa4a98b94dd3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26f27adc-8567-4752-8a51-ee9c301b2611", "tag": "99af8280-f44b-4d03-aa1f-f1d9da00f1e9"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:03:19.580058 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:03:19.580058 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:03:19.594546 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-e701c2f5-8ef8-44ea-9b4e-cf3fb03624e0 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:03:19.596109 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-2b4ba39e-d942-4c0d-8b2f-3f1c679208a5 req-c2e9be14-0737-4990-af85-fa4a98b94dd3 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:19.597063 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-2b4ba39e-d942-4c0d-8b2f-3f1c679208a5 req-c2e9be14-0737-4990-af85-fa4a98b94dd3 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:19.603260 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e701c2f5-8ef8-44ea-9b4e-cf3fb03624e0 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9" status: 200 len: 1670 microversion: 2.1 time: 0.695887 Jan 15 21:03:19.604986 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2325/4659] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:03:18 2022] GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9 => generated 1670 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:03:19.610201 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-331d9d0e-08a0-4507-a954-9b555eca0ed9 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:03:19.611193 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-331d9d0e-08a0-4507-a954-9b555eca0ed9 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:19.614797 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-2b4ba39e-d942-4c0d-8b2f-3f1c679208a5 req-c2e9be14-0737-4990-af85-fa4a98b94dd3 service nova] Creating event network-changed:99af8280-f44b-4d03-aa1f-f1d9da00f1e9 for instance 26f27adc-8567-4752-8a51-ee9c301b2611 on nch2-master-1 Jan 15 21:03:19.619614 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-2b4ba39e-d942-4c0d-8b2f-3f1c679208a5 req-c2e9be14-0737-4990-af85-fa4a98b94dd3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049059 Jan 15 21:03:19.620660 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2335/4660] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:03:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:03:19.622427 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-331d9d0e-08a0-4507-a954-9b555eca0ed9 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:19.623120 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-331d9d0e-08a0-4507-a954-9b555eca0ed9 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:19.624140 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-331d9d0e-08a0-4507-a954-9b555eca0ed9 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:19.625681 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-331d9d0e-08a0-4507-a954-9b555eca0ed9 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:19.643348 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b50be55f-9847-452a-b27e-7e689736095e tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:03:19.646010 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b50be55f-9847-452a-b27e-7e689736095e tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:19.653930 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b50be55f-9847-452a-b27e-7e689736095e tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:19.654543 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b50be55f-9847-452a-b27e-7e689736095e tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:19.655884 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b50be55f-9847-452a-b27e-7e689736095e tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:19.656445 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b50be55f-9847-452a-b27e-7e689736095e tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:19.719967 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b50be55f-9847-452a-b27e-7e689736095e tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.097461 Jan 15 21:03:19.725143 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2336/4661] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:03:19 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:03:19.730432 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-eaa841b7-0e6d-4684-97de-bccfe4d614df req-71de7397-4e61-46c6-9834-b85435d81bd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a31d952-72c7-4a45-bc31-46cef41d4b53", "name": "network-vif-deleted", "tag": "558dc990-4fe6-4fd2-8ab9-c709029ab8be"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:03:19.731946 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:03:19.731946 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:03:19.740739 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-eaa841b7-0e6d-4684-97de-bccfe4d614df req-71de7397-4e61-46c6-9834-b85435d81bd1 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:19.741241 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-eaa841b7-0e6d-4684-97de-bccfe4d614df req-71de7397-4e61-46c6-9834-b85435d81bd1 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:19.758679 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-eaa841b7-0e6d-4684-97de-bccfe4d614df req-71de7397-4e61-46c6-9834-b85435d81bd1 service nova] Creating event network-vif-deleted:558dc990-4fe6-4fd2-8ab9-c709029ab8be for instance 5a31d952-72c7-4a45-bc31-46cef41d4b53 on nch1-master-1 Jan 15 21:03:19.764097 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-eaa841b7-0e6d-4684-97de-bccfe4d614df req-71de7397-4e61-46c6-9834-b85435d81bd1 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037503 Jan 15 21:03:19.765942 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2337/4662] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:03:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:03:19.771220 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-58cf412e-a280-4bc7-adb2-e2d33297ff4e tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:03:19.772166 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-58cf412e-a280-4bc7-adb2-e2d33297ff4e tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: 5a31d952-72c7-4a45-bc31-46cef41d4b53] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:19.779508 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-58cf412e-a280-4bc7-adb2-e2d33297ff4e tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:19.780737 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-58cf412e-a280-4bc7-adb2-e2d33297ff4e tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:19.781732 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-58cf412e-a280-4bc7-adb2-e2d33297ff4e tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:19.782338 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-58cf412e-a280-4bc7-adb2-e2d33297ff4e tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:19.799077 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-58cf412e-a280-4bc7-adb2-e2d33297ff4e tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] HTTP exception thrown: Instance 5a31d952-72c7-4a45-bc31-46cef41d4b53 could not be found. Jan 15 21:03:19.800864 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-58cf412e-a280-4bc7-adb2-e2d33297ff4e tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Returning 404 to user: Instance 5a31d952-72c7-4a45-bc31-46cef41d4b53 could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:03:19.802035 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-58cf412e-a280-4bc7-adb2-e2d33297ff4e tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/5a31d952-72c7-4a45-bc31-46cef41d4b53" status: 404 len: 111 microversion: 2.1 time: 0.034842 Jan 15 21:03:19.803439 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2338/4663] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:03:19 2022] GET /compute/v2.1/servers/5a31d952-72c7-4a45-bc31-46cef41d4b53 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:03:19.810573 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-38fadb87-f5b4-41eb-9326-83c592aa6b26 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.1.53"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:03:20.049196 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-331d9d0e-08a0-4507-a954-9b555eca0ed9 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6097506a2d4e36818310d9d70bf01b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4dad65fccfe481a973f5fcbb9287dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:03:20.059005 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-331d9d0e-08a0-4507-a954-9b555eca0ed9 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "GET /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a" status: 200 len: 1711 microversion: 2.1 time: 0.452293 Jan 15 21:03:20.060151 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2326/4664] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:03:19 2022] GET /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a => generated 1711 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:03:20.070207 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-85227f42-d1b2-4143-99ca-6f70dbf09fc8 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:03:20.071076 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-85227f42-d1b2-4143-99ca-6f70dbf09fc8 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:20.083551 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-85227f42-d1b2-4143-99ca-6f70dbf09fc8 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:20.084302 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-85227f42-d1b2-4143-99ca-6f70dbf09fc8 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:20.087340 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-85227f42-d1b2-4143-99ca-6f70dbf09fc8 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:20.088008 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-85227f42-d1b2-4143-99ca-6f70dbf09fc8 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:20.107721 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-38fadb87-f5b4-41eb-9326-83c592aa6b26 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] [instance: 26f27adc-8567-4752-8a51-ee9c301b2611] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:20.117411 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-38fadb87-f5b4-41eb-9326-83c592aa6b26 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:20.118597 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-38fadb87-f5b4-41eb-9326-83c592aa6b26 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:20.121712 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-38fadb87-f5b4-41eb-9326-83c592aa6b26 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:20.122827 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-38fadb87-f5b4-41eb-9326-83c592aa6b26 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:20.478436 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-85227f42-d1b2-4143-99ca-6f70dbf09fc8 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:03:20.488153 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-85227f42-d1b2-4143-99ca-6f70dbf09fc8 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:03:20.490127 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-85227f42-d1b2-4143-99ca-6f70dbf09fc8 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:03:20.491297 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-85227f42-d1b2-4143-99ca-6f70dbf09fc8 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0" status: 200 len: 1806 microversion: 2.20 time: 0.429981 Jan 15 21:03:20.498252 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2327/4665] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:03:20 2022] GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0 => generated 1806 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:03:20.498252 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ec384c37-d52d-43f9-8e08-023f07d94bf7 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Action: 'create', calling method: .version_select at 0x7f30c8623040>, body: {"keypair": {"name": "tempest-key-1849995260"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:03:20.512143 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-ec384c37-d52d-43f9-8e08-023f07d94bf7 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Getting quotas for project d31af2a6b9424f168dd6084d8d5fd0c4. Resources: {'key_pairs'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:03:20.517940 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-ec384c37-d52d-43f9-8e08-023f07d94bf7 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Getting quotas for user 9eb3421bc9494914bc5f797b15a55643 and project d31af2a6b9424f168dd6084d8d5fd0c4. Resources: {'key_pairs'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:03:20.520500 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-38fadb87-f5b4-41eb-9326-83c592aa6b26 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Acquired lock "refresh_cache-26f27adc-8567-4752-8a51-ee9c301b2611" {{(pid=129365) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jan 15 21:03:20.611148 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-ec384c37-d52d-43f9-8e08-023f07d94bf7 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Getting quotas for project d31af2a6b9424f168dd6084d8d5fd0c4. Resources: {'key_pairs'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:03:20.616487 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-ec384c37-d52d-43f9-8e08-023f07d94bf7 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Getting quotas for user 9eb3421bc9494914bc5f797b15a55643 and project d31af2a6b9424f168dd6084d8d5fd0c4. Resources: {'key_pairs'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:03:20.632799 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ec384c37-d52d-43f9-8e08-023f07d94bf7 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 2297 microversion: 2.1 time: 0.139768 Jan 15 21:03:20.638204 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2328/4666] 10.222.0.46 () {60 vars in 1157 bytes} [Sat Jan 15 21:03:20 2022] POST /compute/v2.1/os-keypairs => generated 2297 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:03:20.643456 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b32b5b04-c68c-464c-a938-4800cbd93441 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:03:20.645692 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b32b5b04-c68c-464c-a938-4800cbd93441 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:20.653705 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b32b5b04-c68c-464c-a938-4800cbd93441 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:20.654425 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b32b5b04-c68c-464c-a938-4800cbd93441 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:20.656294 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b32b5b04-c68c-464c-a938-4800cbd93441 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:20.656937 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b32b5b04-c68c-464c-a938-4800cbd93441 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:20.713278 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b32b5b04-c68c-464c-a938-4800cbd93441 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.073636 Jan 15 21:03:20.714666 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2329/4667] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:03:20 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:03:20.721127 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-71c93976-92b7-481b-aa7a-45873ed951ea tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '.version_select at 0x7f30c8637ca0>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:03:20.725210 ncdv-master-1 devstack@n-api.service[129366]: WARNING oslo_db.sqlalchemy.utils [None req-71c93976-92b7-481b-aa7a-45873ed951ea tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Unique keys not in sort_keys. The sorting order may be unstable. Jan 15 21:03:20.743036 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-71c93976-92b7-481b-aa7a-45873ed951ea tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/os-keypairs" status: 200 len: 545 microversion: 2.1 time: 0.022513 Jan 15 21:03:20.753742 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2330/4668] 10.222.0.46 () {58 vars in 1136 bytes} [Sat Jan 15 21:03:20 2022] GET /compute/v2.1/os-keypairs => generated 545 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:03:20.753742 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-541ea510-bf1d-45e6-909d-19f3dd72fb48 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:03:20.753742 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-541ea510-bf1d-45e6-909d-19f3dd72fb48 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:20.780477 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-541ea510-bf1d-45e6-909d-19f3dd72fb48 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:20.782236 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-541ea510-bf1d-45e6-909d-19f3dd72fb48 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:20.783215 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-541ea510-bf1d-45e6-909d-19f3dd72fb48 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:20.783662 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-541ea510-bf1d-45e6-909d-19f3dd72fb48 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:20.847200 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-541ea510-bf1d-45e6-909d-19f3dd72fb48 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.101717 Jan 15 21:03:20.853603 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2331/4669] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:03:20 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:03:20.856191 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b6bf562c-5aec-4902-acc0-4087db5c846a tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-74539406", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "key_name": "tempest-key-1849995260", "networks": [{"uuid": "0b7cce2c-2308-43f4-b72e-8ea5d98a7ae1"}]}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:03:20.933399 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.network.neutron [None req-b6bf562c-5aec-4902-acc0-4087db5c846a tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] validate_networks() for [('0b7cce2c-2308-43f4-b72e-8ea5d98a7ae1', None, None, None, None, None)] {{(pid=129366) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 21:03:21.647431 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-b6bf562c-5aec-4902-acc0-4087db5c846a tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Flavor limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 21:03:21.648127 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-b6bf562c-5aec-4902-acc0-4087db5c846a tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Image limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 21:03:21.648334 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-b6bf562c-5aec-4902-acc0-4087db5c846a tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Flavor pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 21:03:21.648748 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-b6bf562c-5aec-4902-acc0-4087db5c846a tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Image pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 21:03:21.649201 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-b6bf562c-5aec-4902-acc0-4087db5c846a tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 21:03:21.660334 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b6bf562c-5aec-4902-acc0-4087db5c846a tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:21.661149 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b6bf562c-5aec-4902-acc0-4087db5c846a tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:21.662143 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b6bf562c-5aec-4902-acc0-4087db5c846a tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:21.662885 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b6bf562c-5aec-4902-acc0-4087db5c846a tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:21.685223 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-b6bf562c-5aec-4902-acc0-4087db5c846a tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Getting quotas for project d31af2a6b9424f168dd6084d8d5fd0c4. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:03:21.690823 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-b6bf562c-5aec-4902-acc0-4087db5c846a tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Getting quotas for user 9eb3421bc9494914bc5f797b15a55643 and project d31af2a6b9424f168dd6084d8d5fd0c4. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:03:21.705989 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b6bf562c-5aec-4902-acc0-4087db5c846a tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Going to run 1 instances... {{(pid=129366) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 21:03:21.708576 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b6bf562c-5aec-4902-acc0-4087db5c846a tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: bdf3b234-dc0e-4ad2-b0a4-3aaa618bfe73] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 21:03:21.770903 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b6bf562c-5aec-4902-acc0-4087db5c846a tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.920347 Jan 15 21:03:21.771735 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2332/4670] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 21:03:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 922 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 21:03:21.781090 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-5694bf96-c283-4efd-83ef-1e828793a168 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:03:21.781699 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-5694bf96-c283-4efd-83ef-1e828793a168 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:21.788023 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5694bf96-c283-4efd-83ef-1e828793a168 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:21.788485 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5694bf96-c283-4efd-83ef-1e828793a168 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:21.789310 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5694bf96-c283-4efd-83ef-1e828793a168 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:21.789744 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5694bf96-c283-4efd-83ef-1e828793a168 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:22.182359 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-5694bf96-c283-4efd-83ef-1e828793a168 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:03:22.196507 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-5694bf96-c283-4efd-83ef-1e828793a168 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:03:22.198741 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-5694bf96-c283-4efd-83ef-1e828793a168 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:03:22.200508 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-5694bf96-c283-4efd-83ef-1e828793a168 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0" status: 200 len: 1806 microversion: 2.20 time: 0.423465 Jan 15 21:03:22.202835 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2333/4671] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:03:21 2022] GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0 => generated 1806 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:03:22.223497 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7942cdbf-7112-466a-9dc9-acb9ae563849 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:03:22.226543 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-7942cdbf-7112-466a-9dc9-acb9ae563849 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:22.238395 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7942cdbf-7112-466a-9dc9-acb9ae563849 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:22.239918 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7942cdbf-7112-466a-9dc9-acb9ae563849 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:22.241558 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7942cdbf-7112-466a-9dc9-acb9ae563849 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:22.243034 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7942cdbf-7112-466a-9dc9-acb9ae563849 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:22.310151 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7942cdbf-7112-466a-9dc9-acb9ae563849 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.095207 Jan 15 21:03:22.316774 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2334/4672] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:03:22 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:03:22.325769 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-75321c9d-d9b8-451f-bd70-565de5304364 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:03:22.327701 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-75321c9d-d9b8-451f-bd70-565de5304364 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: bdf3b234-dc0e-4ad2-b0a4-3aaa618bfe73] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:22.338979 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-75321c9d-d9b8-451f-bd70-565de5304364 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:22.339751 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-75321c9d-d9b8-451f-bd70-565de5304364 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:22.340766 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-75321c9d-d9b8-451f-bd70-565de5304364 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:22.341652 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-75321c9d-d9b8-451f-bd70-565de5304364 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:22.469940 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-75321c9d-d9b8-451f-bd70-565de5304364 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb3421bc9494914bc5f797b15a55643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31af2a6b9424f168dd6084d8d5fd0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:03:22.481314 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-75321c9d-d9b8-451f-bd70-565de5304364 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/bdf3b234-dc0e-4ad2-b0a4-3aaa618bfe73" status: 200 len: 1231 microversion: 2.1 time: 0.162607 Jan 15 21:03:22.494404 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2335/4673] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:03:22 2022] GET /compute/v2.1/servers/bdf3b234-dc0e-4ad2-b0a4-3aaa618bfe73 => generated 1231 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:03:22.503052 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-45282f42-ded7-4b46-bbc6-83ca949735f7 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:03:22.504336 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-45282f42-ded7-4b46-bbc6-83ca949735f7 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:22.515894 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-45282f42-ded7-4b46-bbc6-83ca949735f7 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:22.516714 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-45282f42-ded7-4b46-bbc6-83ca949735f7 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:22.517656 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-45282f42-ded7-4b46-bbc6-83ca949735f7 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:22.519285 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-45282f42-ded7-4b46-bbc6-83ca949735f7 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:22.581161 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-45282f42-ded7-4b46-bbc6-83ca949735f7 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.084874 Jan 15 21:03:22.582785 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2336/4674] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:03:22 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:03:22.801244 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.network.neutron [None req-38fadb87-f5b4-41eb-9326-83c592aa6b26 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] [instance: 26f27adc-8567-4752-8a51-ee9c301b2611] Building network info cache for instance {{(pid=129365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1883}} Jan 15 21:03:22.818092 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-bdd4033c-7947-4ca3-adc4-5c240f0c9265 req-c86a1c28-dc52-49ad-8789-c1195da52ef3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26f27adc-8567-4752-8a51-ee9c301b2611", "tag": "99af8280-f44b-4d03-aa1f-f1d9da00f1e9"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:03:22.823189 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:03:22.823189 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:03:22.848314 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-bdd4033c-7947-4ca3-adc4-5c240f0c9265 req-c86a1c28-dc52-49ad-8789-c1195da52ef3 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:22.848596 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-bdd4033c-7947-4ca3-adc4-5c240f0c9265 req-c86a1c28-dc52-49ad-8789-c1195da52ef3 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:22.866460 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-bdd4033c-7947-4ca3-adc4-5c240f0c9265 req-c86a1c28-dc52-49ad-8789-c1195da52ef3 service nova] Creating event network-changed:99af8280-f44b-4d03-aa1f-f1d9da00f1e9 for instance 26f27adc-8567-4752-8a51-ee9c301b2611 on nch2-master-1 Jan 15 21:03:22.872657 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-bdd4033c-7947-4ca3-adc4-5c240f0c9265 req-c86a1c28-dc52-49ad-8789-c1195da52ef3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068118 Jan 15 21:03:22.874847 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2337/4675] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:03:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:03:23.225364 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ef3e35cd-0f88-41e1-b166-1e3ac232b1a1 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:03:23.226379 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ef3e35cd-0f88-41e1-b166-1e3ac232b1a1 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:23.237576 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ef3e35cd-0f88-41e1-b166-1e3ac232b1a1 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:23.238531 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ef3e35cd-0f88-41e1-b166-1e3ac232b1a1 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:23.239572 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ef3e35cd-0f88-41e1-b166-1e3ac232b1a1 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:23.240459 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ef3e35cd-0f88-41e1-b166-1e3ac232b1a1 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:23.934161 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-ef3e35cd-0f88-41e1-b166-1e3ac232b1a1 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:03:23.949802 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-ef3e35cd-0f88-41e1-b166-1e3ac232b1a1 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:03:23.952914 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-ef3e35cd-0f88-41e1-b166-1e3ac232b1a1 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:03:23.956205 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ef3e35cd-0f88-41e1-b166-1e3ac232b1a1 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0" status: 200 len: 1806 microversion: 2.20 time: 0.739709 Jan 15 21:03:23.957390 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2338/4676] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:03:23 2022] GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0 => generated 1806 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:03:23.963958 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9f999a0b-06ac-47cf-85ab-687e0ec588db tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:03:23.965182 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-9f999a0b-06ac-47cf-85ab-687e0ec588db tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:23.974841 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9f999a0b-06ac-47cf-85ab-687e0ec588db tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:23.975298 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9f999a0b-06ac-47cf-85ab-687e0ec588db tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:23.976102 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9f999a0b-06ac-47cf-85ab-687e0ec588db tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:23.976537 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9f999a0b-06ac-47cf-85ab-687e0ec588db tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:24.025738 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-9f999a0b-06ac-47cf-85ab-687e0ec588db tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.066293 Jan 15 21:03:24.032167 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2339/4677] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:03:23 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:03:24.037876 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b2f286a4-bc43-408f-a60a-43b00d2d0a29 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:03:24.038574 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b2f286a4-bc43-408f-a60a-43b00d2d0a29 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: bdf3b234-dc0e-4ad2-b0a4-3aaa618bfe73] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:24.048244 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b2f286a4-bc43-408f-a60a-43b00d2d0a29 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:24.048698 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b2f286a4-bc43-408f-a60a-43b00d2d0a29 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:24.049544 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b2f286a4-bc43-408f-a60a-43b00d2d0a29 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:24.049971 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b2f286a4-bc43-408f-a60a-43b00d2d0a29 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:24.130021 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-b2f286a4-bc43-408f-a60a-43b00d2d0a29 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb3421bc9494914bc5f797b15a55643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31af2a6b9424f168dd6084d8d5fd0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:03:24.132474 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.network.neutron [None req-38fadb87-f5b4-41eb-9326-83c592aa6b26 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] [instance: 26f27adc-8567-4752-8a51-ee9c301b2611] Updating instance_info_cache with network_info: [{"id": "99af8280-f44b-4d03-aa1f-f1d9da00f1e9", "address": "fa:16:3e:f1:1f:62", "network": {"id": "bf43669e-491e-49cf-8622-cd5d76591729", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-878983702-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "74165fadf5154c319ca56b4aa961e7b6", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap99af8280-f4", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=129365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jan 15 21:03:24.140106 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b2f286a4-bc43-408f-a60a-43b00d2d0a29 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/bdf3b234-dc0e-4ad2-b0a4-3aaa618bfe73" status: 200 len: 1285 microversion: 2.1 time: 0.106181 Jan 15 21:03:24.140744 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2340/4678] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:03:24 2022] GET /compute/v2.1/servers/bdf3b234-dc0e-4ad2-b0a4-3aaa618bfe73 => generated 1285 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:03:24.151438 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-defe1015-b9ef-4933-bc1e-7a14c4b9cfd8 req-8687a739-7762-4282-8fcf-4c6720958e26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ac722a3-aadf-4791-b5b1-e5e5efebddc0", "name": "network-vif-plugged", "status": "completed", "tag": "6d958b2a-aaab-40bf-8bb7-ce4cd3fc57b5"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:03:24.151438 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:03:24.151438 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:03:24.157029 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-defe1015-b9ef-4933-bc1e-7a14c4b9cfd8 req-8687a739-7762-4282-8fcf-4c6720958e26 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:24.157623 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-defe1015-b9ef-4933-bc1e-7a14c4b9cfd8 req-8687a739-7762-4282-8fcf-4c6720958e26 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:24.167575 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-38fadb87-f5b4-41eb-9326-83c592aa6b26 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Releasing lock "refresh_cache-26f27adc-8567-4752-8a51-ee9c301b2611" {{(pid=129365) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jan 15 21:03:24.169364 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-38fadb87-f5b4-41eb-9326-83c592aa6b26 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] 10.222.0.46 "POST /compute/v2.1/servers/26f27adc-8567-4752-8a51-ee9c301b2611/action" status: 202 len: 0 microversion: 2.1 time: 4.364154 Jan 15 21:03:24.171307 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2339/4679] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:03:19 2022] POST /compute/v2.1/servers/26f27adc-8567-4752-8a51-ee9c301b2611/action => generated 0 bytes in 4367 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jan 15 21:03:24.177680 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-defe1015-b9ef-4933-bc1e-7a14c4b9cfd8 req-8687a739-7762-4282-8fcf-4c6720958e26 service nova] Creating event network-vif-plugged:6d958b2a-aaab-40bf-8bb7-ce4cd3fc57b5 for instance 0ac722a3-aadf-4791-b5b1-e5e5efebddc0 on nch2-master-1 Jan 15 21:03:24.178748 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-90502edc-e6c1-4fef-ac35-d4f2194245a2 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:03:24.182179 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-90502edc-e6c1-4fef-ac35-d4f2194245a2 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:24.184968 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-defe1015-b9ef-4933-bc1e-7a14c4b9cfd8 req-8687a739-7762-4282-8fcf-4c6720958e26 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042468 Jan 15 21:03:24.187720 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2341/4680] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:03:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:03:24.194977 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-5e44c471-61a6-4eff-8c5b-caba61f479a2 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Calling method '.version_select at 0x7f30c8743550>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:03:24.208177 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-90502edc-e6c1-4fef-ac35-d4f2194245a2 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:24.218206 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-90502edc-e6c1-4fef-ac35-d4f2194245a2 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:24.220482 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-90502edc-e6c1-4fef-ac35-d4f2194245a2 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:24.221131 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-90502edc-e6c1-4fef-ac35-d4f2194245a2 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:24.298604 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-90502edc-e6c1-4fef-ac35-d4f2194245a2 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.124678 Jan 15 21:03:24.300035 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2340/4681] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:03:24 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:03:24.987114 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-73c329fa-00ca-4383-bc2a-fb56424d1c1b tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:03:24.988357 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-73c329fa-00ca-4383-bc2a-fb56424d1c1b tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:25.028900 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-73c329fa-00ca-4383-bc2a-fb56424d1c1b tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:25.029476 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-73c329fa-00ca-4383-bc2a-fb56424d1c1b tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:25.033657 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-73c329fa-00ca-4383-bc2a-fb56424d1c1b tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:25.035363 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-73c329fa-00ca-4383-bc2a-fb56424d1c1b tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:25.261751 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-5e44c471-61a6-4eff-8c5b-caba61f479a2 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] 10.222.0.46 "DELETE /compute/v2.1/os-floating-ips/6ba87361-1c1c-4b05-b44a-a2a71367ece0" status: 202 len: 0 microversion: 2.1 time: 1.065393 Jan 15 21:03:25.264984 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2342/4682] 10.222.0.46 () {58 vars in 1262 bytes} [Sat Jan 15 21:03:24 2022] DELETE /compute/v2.1/os-floating-ips/6ba87361-1c1c-4b05-b44a-a2a71367ece0 => generated 0 bytes in 1076 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:03:25.283569 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-67ce739c-7269-492e-add9-2dd58a3711e7 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:03:25.292291 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-67ce739c-7269-492e-add9-2dd58a3711e7 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:25.319366 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-67ce739c-7269-492e-add9-2dd58a3711e7 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:25.320526 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-67ce739c-7269-492e-add9-2dd58a3711e7 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:25.321813 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-67ce739c-7269-492e-add9-2dd58a3711e7 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:25.322509 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-67ce739c-7269-492e-add9-2dd58a3711e7 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:25.407449 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-67ce739c-7269-492e-add9-2dd58a3711e7 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.136759 Jan 15 21:03:25.409753 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2343/4683] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:03:25 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:03:25.423765 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9017c0e6-ad3e-4d1c-b6c7-f6577230cf93 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:03:25.429072 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-9017c0e6-ad3e-4d1c-b6c7-f6577230cf93 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: bdf3b234-dc0e-4ad2-b0a4-3aaa618bfe73] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:25.445497 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9017c0e6-ad3e-4d1c-b6c7-f6577230cf93 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:25.445954 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9017c0e6-ad3e-4d1c-b6c7-f6577230cf93 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:25.448960 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9017c0e6-ad3e-4d1c-b6c7-f6577230cf93 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:25.449779 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9017c0e6-ad3e-4d1c-b6c7-f6577230cf93 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:25.461559 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-73c329fa-00ca-4383-bc2a-fb56424d1c1b tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:03:25.476774 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-73c329fa-00ca-4383-bc2a-fb56424d1c1b tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:03:25.480068 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-73c329fa-00ca-4383-bc2a-fb56424d1c1b tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:03:25.486558 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-73c329fa-00ca-4383-bc2a-fb56424d1c1b tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0" status: 200 len: 1806 microversion: 2.20 time: 0.510935 Jan 15 21:03:25.501351 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2341/4684] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:03:24 2022] GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0 => generated 1806 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:03:25.516946 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-df855180-bfac-4d15-a41b-dd0911227291 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Calling method '.version_select at 0x7f30ceb5f0d0>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:03:25.732238 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-9017c0e6-ad3e-4d1c-b6c7-f6577230cf93 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb3421bc9494914bc5f797b15a55643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31af2a6b9424f168dd6084d8d5fd0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:03:25.744035 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-9017c0e6-ad3e-4d1c-b6c7-f6577230cf93 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/bdf3b234-dc0e-4ad2-b0a4-3aaa618bfe73" status: 200 len: 1327 microversion: 2.1 time: 0.332731 Jan 15 21:03:25.745707 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2344/4685] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:03:25 2022] GET /compute/v2.1/servers/bdf3b234-dc0e-4ad2-b0a4-3aaa618bfe73 => generated 1327 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:03:25.761204 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-00b23635-221a-4e7e-943c-8957992eeab2 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:03:25.762718 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-00b23635-221a-4e7e-943c-8957992eeab2 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:25.772759 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-00b23635-221a-4e7e-943c-8957992eeab2 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:25.773602 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-00b23635-221a-4e7e-943c-8957992eeab2 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:25.774539 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-00b23635-221a-4e7e-943c-8957992eeab2 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:25.775086 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-00b23635-221a-4e7e-943c-8957992eeab2 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:25.841020 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-00b23635-221a-4e7e-943c-8957992eeab2 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.085859 Jan 15 21:03:25.846256 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2345/4686] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:03:25 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:03:25.861383 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-df855180-bfac-4d15-a41b-dd0911227291 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/c27eaa4f-5ee4-41ab-964e-cbe397d1f1d3" status: 202 len: 0 microversion: 2.1 time: 0.358537 Jan 15 21:03:25.862293 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2342/4687] 10.222.0.46 () {58 vars in 1271 bytes} [Sat Jan 15 21:03:25 2022] DELETE /compute/v2.1/os-security-groups/c27eaa4f-5ee4-41ab-964e-cbe397d1f1d3 => generated 0 bytes in 360 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:03:25.879780 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-34ce759d-cb0d-4c92-bba4-77f220c40b2d tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:03:25.880501 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-34ce759d-cb0d-4c92-bba4-77f220c40b2d tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] [instance: 26f27adc-8567-4752-8a51-ee9c301b2611] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:25.892874 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-34ce759d-cb0d-4c92-bba4-77f220c40b2d tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:25.904061 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-34ce759d-cb0d-4c92-bba4-77f220c40b2d tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:25.911352 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-34ce759d-cb0d-4c92-bba4-77f220c40b2d tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:25.912596 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-34ce759d-cb0d-4c92-bba4-77f220c40b2d tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:25.941416 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-34ce759d-cb0d-4c92-bba4-77f220c40b2d tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] [instance: 26f27adc-8567-4752-8a51-ee9c301b2611] Going to try to terminate instance {{(pid=129366) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 21:03:26.046539 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-34ce759d-cb0d-4c92-bba4-77f220c40b2d tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] 10.222.0.46 "DELETE /compute/v2.1/servers/26f27adc-8567-4752-8a51-ee9c301b2611" status: 204 len: 0 microversion: 2.1 time: 0.177285 Jan 15 21:03:26.047692 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2346/4688] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 21:03:25 2022] DELETE /compute/v2.1/servers/26f27adc-8567-4752-8a51-ee9c301b2611 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 21:03:26.059265 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-84ae1906-dab7-4ef1-9abf-3c4bb7efda3c tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:03:26.060176 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-84ae1906-dab7-4ef1-9abf-3c4bb7efda3c tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] [instance: 26f27adc-8567-4752-8a51-ee9c301b2611] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:26.072283 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-84ae1906-dab7-4ef1-9abf-3c4bb7efda3c tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:26.075822 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-84ae1906-dab7-4ef1-9abf-3c4bb7efda3c tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:26.078080 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-84ae1906-dab7-4ef1-9abf-3c4bb7efda3c tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:26.078737 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-84ae1906-dab7-4ef1-9abf-3c4bb7efda3c tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:26.307687 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-84ae1906-dab7-4ef1-9abf-3c4bb7efda3c tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e8f253bac41484ab8e92b74bfa54465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74165fadf5154c319ca56b4aa961e7b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:03:26.323484 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-84ae1906-dab7-4ef1-9abf-3c4bb7efda3c tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] 10.222.0.46 "GET /compute/v2.1/servers/26f27adc-8567-4752-8a51-ee9c301b2611" status: 200 len: 1509 microversion: 2.1 time: 0.270992 Jan 15 21:03:26.324496 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2343/4689] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:03:26 2022] GET /compute/v2.1/servers/26f27adc-8567-4752-8a51-ee9c301b2611 => generated 1509 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:03:26.420469 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c355a380-526a-4354-a591-505bdf59b309 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:03:26.421861 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c355a380-526a-4354-a591-505bdf59b309 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:26.438743 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c355a380-526a-4354-a591-505bdf59b309 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:26.439200 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c355a380-526a-4354-a591-505bdf59b309 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:26.440006 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c355a380-526a-4354-a591-505bdf59b309 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:26.440437 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c355a380-526a-4354-a591-505bdf59b309 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:26.506261 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ab0f2bb5-f66b-43c3-9aa6-a905c8832bc2 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:03:26.507411 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ab0f2bb5-f66b-43c3-9aa6-a905c8832bc2 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:26.518951 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ab0f2bb5-f66b-43c3-9aa6-a905c8832bc2 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:26.522039 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ab0f2bb5-f66b-43c3-9aa6-a905c8832bc2 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:26.523657 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ab0f2bb5-f66b-43c3-9aa6-a905c8832bc2 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:26.524266 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ab0f2bb5-f66b-43c3-9aa6-a905c8832bc2 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:26.524974 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c355a380-526a-4354-a591-505bdf59b309 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.106117 Jan 15 21:03:26.529433 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2347/4690] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:03:26 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:03:26.730279 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-ab0f2bb5-f66b-43c3-9aa6-a905c8832bc2 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:03:26.753774 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-ab0f2bb5-f66b-43c3-9aa6-a905c8832bc2 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:03:26.758633 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-ab0f2bb5-f66b-43c3-9aa6-a905c8832bc2 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:03:26.763456 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b2c31ff8-cf94-4af5-955d-6ae501089e49 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:03:26.764773 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b2c31ff8-cf94-4af5-955d-6ae501089e49 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: bdf3b234-dc0e-4ad2-b0a4-3aaa618bfe73] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:26.774613 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ab0f2bb5-f66b-43c3-9aa6-a905c8832bc2 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0" status: 200 len: 1806 microversion: 2.20 time: 0.259277 Jan 15 21:03:26.777822 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2344/4691] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:03:26 2022] GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0 => generated 1806 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:03:26.791815 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b2c31ff8-cf94-4af5-955d-6ae501089e49 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:26.792341 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b2c31ff8-cf94-4af5-955d-6ae501089e49 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:26.795026 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b2c31ff8-cf94-4af5-955d-6ae501089e49 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:26.796357 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b2c31ff8-cf94-4af5-955d-6ae501089e49 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:26.812782 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-896cb2ae-c081-452c-a107-681cd7e3f01c req-31f1163f-bb6a-42e7-af0e-b3f01adac3be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdf3b234-dc0e-4ad2-b0a4-3aaa618bfe73", "tag": "3060e529-416c-4ce6-af7f-4acb88198123"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:03:26.814804 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:03:26.814804 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:03:26.823186 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-896cb2ae-c081-452c-a107-681cd7e3f01c req-31f1163f-bb6a-42e7-af0e-b3f01adac3be service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:26.824090 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-896cb2ae-c081-452c-a107-681cd7e3f01c req-31f1163f-bb6a-42e7-af0e-b3f01adac3be service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:26.845050 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-896cb2ae-c081-452c-a107-681cd7e3f01c req-31f1163f-bb6a-42e7-af0e-b3f01adac3be service nova] Creating event network-changed:3060e529-416c-4ce6-af7f-4acb88198123 for instance bdf3b234-dc0e-4ad2-b0a4-3aaa618bfe73 on nch1-master-1 Jan 15 21:03:26.851864 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-896cb2ae-c081-452c-a107-681cd7e3f01c req-31f1163f-bb6a-42e7-af0e-b3f01adac3be service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044948 Jan 15 21:03:26.854393 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2345/4692] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:03:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:03:26.862207 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-279cf023-f9b9-4b35-8741-522b4ab67e74 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:03:26.864512 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-279cf023-f9b9-4b35-8741-522b4ab67e74 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:26.877664 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-279cf023-f9b9-4b35-8741-522b4ab67e74 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:26.878293 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-279cf023-f9b9-4b35-8741-522b4ab67e74 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:26.879498 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-279cf023-f9b9-4b35-8741-522b4ab67e74 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:26.880100 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-279cf023-f9b9-4b35-8741-522b4ab67e74 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:26.982343 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-279cf023-f9b9-4b35-8741-522b4ab67e74 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.125524 Jan 15 21:03:26.989298 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2346/4693] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:03:26 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:03:27.343780 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a48d8529-68a5-4a5d-af41-7a80d668129e tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:03:27.344604 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a48d8529-68a5-4a5d-af41-7a80d668129e tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] [instance: 26f27adc-8567-4752-8a51-ee9c301b2611] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:27.346416 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-b2c31ff8-cf94-4af5-955d-6ae501089e49 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb3421bc9494914bc5f797b15a55643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31af2a6b9424f168dd6084d8d5fd0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:03:27.360499 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a48d8529-68a5-4a5d-af41-7a80d668129e tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:27.361329 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a48d8529-68a5-4a5d-af41-7a80d668129e tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:27.362416 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a48d8529-68a5-4a5d-af41-7a80d668129e tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:27.363300 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a48d8529-68a5-4a5d-af41-7a80d668129e tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:27.364545 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b2c31ff8-cf94-4af5-955d-6ae501089e49 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/bdf3b234-dc0e-4ad2-b0a4-3aaa618bfe73" status: 200 len: 1327 microversion: 2.1 time: 0.605185 Jan 15 21:03:27.369658 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2348/4694] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:03:26 2022] GET /compute/v2.1/servers/bdf3b234-dc0e-4ad2-b0a4-3aaa618bfe73 => generated 1327 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:03:27.543069 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a7a2cb88-67bb-4e59-aced-a1e93cea20b8 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:03:27.544814 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a7a2cb88-67bb-4e59-aced-a1e93cea20b8 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:27.558277 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a7a2cb88-67bb-4e59-aced-a1e93cea20b8 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:27.559497 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a7a2cb88-67bb-4e59-aced-a1e93cea20b8 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:27.561440 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a7a2cb88-67bb-4e59-aced-a1e93cea20b8 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:27.562595 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a7a2cb88-67bb-4e59-aced-a1e93cea20b8 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:27.647939 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a7a2cb88-67bb-4e59-aced-a1e93cea20b8 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.109328 Jan 15 21:03:27.650345 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2349/4695] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:03:27 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:03:27.694137 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-a48d8529-68a5-4a5d-af41-7a80d668129e tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e8f253bac41484ab8e92b74bfa54465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74165fadf5154c319ca56b4aa961e7b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:03:27.704896 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a48d8529-68a5-4a5d-af41-7a80d668129e tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] 10.222.0.46 "GET /compute/v2.1/servers/26f27adc-8567-4752-8a51-ee9c301b2611" status: 200 len: 1509 microversion: 2.1 time: 0.366319 Jan 15 21:03:27.706346 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2347/4696] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:03:27 2022] GET /compute/v2.1/servers/26f27adc-8567-4752-8a51-ee9c301b2611 => generated 1509 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:03:27.798685 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a2988fde-89c4-45d1-958b-b6380332b6f7 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:03:27.803611 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a2988fde-89c4-45d1-958b-b6380332b6f7 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:27.816181 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a2988fde-89c4-45d1-958b-b6380332b6f7 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:27.817169 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a2988fde-89c4-45d1-958b-b6380332b6f7 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:27.818384 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a2988fde-89c4-45d1-958b-b6380332b6f7 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:27.819206 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a2988fde-89c4-45d1-958b-b6380332b6f7 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:27.996010 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d4c432af-9d74-40b6-a8f4-0313ec7cddec tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:03:27.997457 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d4c432af-9d74-40b6-a8f4-0313ec7cddec tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:28.010493 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d4c432af-9d74-40b6-a8f4-0313ec7cddec tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:28.011211 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d4c432af-9d74-40b6-a8f4-0313ec7cddec tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:28.012184 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d4c432af-9d74-40b6-a8f4-0313ec7cddec tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:28.015564 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d4c432af-9d74-40b6-a8f4-0313ec7cddec tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:28.050529 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-a2988fde-89c4-45d1-958b-b6380332b6f7 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:03:28.062673 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-a2988fde-89c4-45d1-958b-b6380332b6f7 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:03:28.065131 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-a2988fde-89c4-45d1-958b-b6380332b6f7 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:03:28.067112 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a2988fde-89c4-45d1-958b-b6380332b6f7 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0" status: 200 len: 1793 microversion: 2.20 time: 0.274839 Jan 15 21:03:28.096568 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2350/4697] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:03:27 2022] GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0 => generated 1793 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:03:28.098507 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d4c432af-9d74-40b6-a8f4-0313ec7cddec tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.106140 Jan 15 21:03:28.099752 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2348/4698] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:03:27 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:03:28.387089 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f08ae694-46ce-4a39-82a7-df9ee7adaa42 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:03:28.387895 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f08ae694-46ce-4a39-82a7-df9ee7adaa42 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: bdf3b234-dc0e-4ad2-b0a4-3aaa618bfe73] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:28.395854 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f08ae694-46ce-4a39-82a7-df9ee7adaa42 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:28.397279 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f08ae694-46ce-4a39-82a7-df9ee7adaa42 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:28.398096 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f08ae694-46ce-4a39-82a7-df9ee7adaa42 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:28.398590 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f08ae694-46ce-4a39-82a7-df9ee7adaa42 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:28.664221 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-221da72f-5426-4d1d-b49e-b50934459b59 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:03:28.665684 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-221da72f-5426-4d1d-b49e-b50934459b59 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:28.678355 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-221da72f-5426-4d1d-b49e-b50934459b59 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:28.679150 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-221da72f-5426-4d1d-b49e-b50934459b59 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:28.680478 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-221da72f-5426-4d1d-b49e-b50934459b59 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:28.681394 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-221da72f-5426-4d1d-b49e-b50934459b59 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:28.715759 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-f08ae694-46ce-4a39-82a7-df9ee7adaa42 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb3421bc9494914bc5f797b15a55643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31af2a6b9424f168dd6084d8d5fd0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:03:28.728590 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f08ae694-46ce-4a39-82a7-df9ee7adaa42 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/bdf3b234-dc0e-4ad2-b0a4-3aaa618bfe73" status: 200 len: 1327 microversion: 2.1 time: 0.345391 Jan 15 21:03:28.739010 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2351/4699] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:03:28 2022] GET /compute/v2.1/servers/bdf3b234-dc0e-4ad2-b0a4-3aaa618bfe73 => generated 1327 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:03:28.743735 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-3c70619e-d898-40d5-a3f1-7a7699463854 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:03:28.744594 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-3c70619e-d898-40d5-a3f1-7a7699463854 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] [instance: 26f27adc-8567-4752-8a51-ee9c301b2611] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:28.752350 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-221da72f-5426-4d1d-b49e-b50934459b59 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.093332 Jan 15 21:03:28.757218 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2349/4700] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:03:28 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:03:28.764883 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3c70619e-d898-40d5-a3f1-7a7699463854 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:28.765574 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3c70619e-d898-40d5-a3f1-7a7699463854 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:28.767086 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3c70619e-d898-40d5-a3f1-7a7699463854 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:28.767725 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3c70619e-d898-40d5-a3f1-7a7699463854 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:29.047815 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-3c70619e-d898-40d5-a3f1-7a7699463854 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e8f253bac41484ab8e92b74bfa54465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74165fadf5154c319ca56b4aa961e7b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:03:29.056139 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-3c70619e-d898-40d5-a3f1-7a7699463854 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] 10.222.0.46 "GET /compute/v2.1/servers/26f27adc-8567-4752-8a51-ee9c301b2611" status: 200 len: 1509 microversion: 2.1 time: 0.319292 Jan 15 21:03:29.057025 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2352/4701] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:03:28 2022] GET /compute/v2.1/servers/26f27adc-8567-4752-8a51-ee9c301b2611 => generated 1509 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:03:29.110223 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8cd5c1d8-e051-44d3-a72d-9fc56d9b612a tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:03:29.111971 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-8cd5c1d8-e051-44d3-a72d-9fc56d9b612a tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:29.119593 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8cd5c1d8-e051-44d3-a72d-9fc56d9b612a tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:29.120150 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8cd5c1d8-e051-44d3-a72d-9fc56d9b612a tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:29.121497 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8cd5c1d8-e051-44d3-a72d-9fc56d9b612a tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:29.121984 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8cd5c1d8-e051-44d3-a72d-9fc56d9b612a tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:29.189866 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-8cd5c1d8-e051-44d3-a72d-9fc56d9b612a tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.083530 Jan 15 21:03:29.200733 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2350/4702] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:03:29 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:03:29.302315 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-9146b4cc-d186-4c2a-96f1-1fe51087d18c req-5e20e754-ae1b-402a-9d41-337247907a00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26f27adc-8567-4752-8a51-ee9c301b2611", "name": "network-vif-deleted", "tag": "99af8280-f44b-4d03-aa1f-f1d9da00f1e9"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:03:29.304899 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:03:29.304899 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:03:29.316512 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-9146b4cc-d186-4c2a-96f1-1fe51087d18c req-5e20e754-ae1b-402a-9d41-337247907a00 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:29.317833 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-9146b4cc-d186-4c2a-96f1-1fe51087d18c req-5e20e754-ae1b-402a-9d41-337247907a00 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:29.348214 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-9146b4cc-d186-4c2a-96f1-1fe51087d18c req-5e20e754-ae1b-402a-9d41-337247907a00 service nova] Creating event network-vif-deleted:99af8280-f44b-4d03-aa1f-f1d9da00f1e9 for instance 26f27adc-8567-4752-8a51-ee9c301b2611 on nch2-master-1 Jan 15 21:03:29.367380 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-9146b4cc-d186-4c2a-96f1-1fe51087d18c req-5e20e754-ae1b-402a-9d41-337247907a00 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067847 Jan 15 21:03:29.369151 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2353/4703] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:03:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:03:29.747283 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3f06b312-352d-4988-8285-651a77aa31c4 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:03:29.748043 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-3f06b312-352d-4988-8285-651a77aa31c4 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: bdf3b234-dc0e-4ad2-b0a4-3aaa618bfe73] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:29.762906 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3f06b312-352d-4988-8285-651a77aa31c4 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:29.763784 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3f06b312-352d-4988-8285-651a77aa31c4 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:29.766208 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3f06b312-352d-4988-8285-651a77aa31c4 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:29.766336 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a8d6917b-86df-44e2-b21e-07183b62675f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:03:29.767125 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3f06b312-352d-4988-8285-651a77aa31c4 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:29.767981 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a8d6917b-86df-44e2-b21e-07183b62675f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:29.787647 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a8d6917b-86df-44e2-b21e-07183b62675f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:29.788226 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a8d6917b-86df-44e2-b21e-07183b62675f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:29.789186 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a8d6917b-86df-44e2-b21e-07183b62675f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:29.789635 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a8d6917b-86df-44e2-b21e-07183b62675f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:29.902936 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a8d6917b-86df-44e2-b21e-07183b62675f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.138852 Jan 15 21:03:29.904438 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2354/4704] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:03:29 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:03:30.088395 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b66fb2bc-5cac-4715-996d-a3b679883bd6 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:03:30.089304 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b66fb2bc-5cac-4715-996d-a3b679883bd6 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] [instance: 26f27adc-8567-4752-8a51-ee9c301b2611] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:30.111233 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b66fb2bc-5cac-4715-996d-a3b679883bd6 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:30.112667 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b66fb2bc-5cac-4715-996d-a3b679883bd6 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:30.113860 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b66fb2bc-5cac-4715-996d-a3b679883bd6 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:30.114880 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b66fb2bc-5cac-4715-996d-a3b679883bd6 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:30.115218 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-3f06b312-352d-4988-8285-651a77aa31c4 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb3421bc9494914bc5f797b15a55643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31af2a6b9424f168dd6084d8d5fd0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:03:30.127151 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3f06b312-352d-4988-8285-651a77aa31c4 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/bdf3b234-dc0e-4ad2-b0a4-3aaa618bfe73" status: 200 len: 1327 microversion: 2.1 time: 0.384264 Jan 15 21:03:30.128225 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2351/4705] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:03:29 2022] GET /compute/v2.1/servers/bdf3b234-dc0e-4ad2-b0a4-3aaa618bfe73 => generated 1327 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:03:30.137839 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-b66fb2bc-5cac-4715-996d-a3b679883bd6 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] HTTP exception thrown: Instance 26f27adc-8567-4752-8a51-ee9c301b2611 could not be found. Jan 15 21:03:30.138678 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b66fb2bc-5cac-4715-996d-a3b679883bd6 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] Returning 404 to user: Instance 26f27adc-8567-4752-8a51-ee9c301b2611 could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:03:30.140400 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b66fb2bc-5cac-4715-996d-a3b679883bd6 tempest-ServerRescueTestJSONUnderV235-1584236440 tempest-ServerRescueTestJSONUnderV235-1584236440-project] 10.222.0.46 "GET /compute/v2.1/servers/26f27adc-8567-4752-8a51-ee9c301b2611" status: 404 len: 111 microversion: 2.1 time: 0.068471 Jan 15 21:03:30.141532 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2355/4706] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:03:30 2022] GET /compute/v2.1/servers/26f27adc-8567-4752-8a51-ee9c301b2611 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:03:30.212220 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-20574dd7-f9dd-4465-9a6f-e1cba3b7d7cb tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:03:30.213233 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-20574dd7-f9dd-4465-9a6f-e1cba3b7d7cb tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:30.228440 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-20574dd7-f9dd-4465-9a6f-e1cba3b7d7cb tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:30.229237 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-20574dd7-f9dd-4465-9a6f-e1cba3b7d7cb tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:30.230207 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-20574dd7-f9dd-4465-9a6f-e1cba3b7d7cb tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:30.230685 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-20574dd7-f9dd-4465-9a6f-e1cba3b7d7cb tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:30.297451 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-20574dd7-f9dd-4465-9a6f-e1cba3b7d7cb tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.088804 Jan 15 21:03:30.300646 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2352/4707] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:03:30 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:03:30.915024 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-6c95af85-fdbd-4ca3-8c9b-6d180cc34e63 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:03:30.916920 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-6c95af85-fdbd-4ca3-8c9b-6d180cc34e63 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:30.940787 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6c95af85-fdbd-4ca3-8c9b-6d180cc34e63 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:30.941701 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6c95af85-fdbd-4ca3-8c9b-6d180cc34e63 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:30.944350 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6c95af85-fdbd-4ca3-8c9b-6d180cc34e63 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:30.951143 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6c95af85-fdbd-4ca3-8c9b-6d180cc34e63 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:31.011326 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-6c95af85-fdbd-4ca3-8c9b-6d180cc34e63 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.100075 Jan 15 21:03:31.015653 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2356/4708] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:03:30 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:03:31.152503 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5b44f062-7fe4-4160-a00d-4b082410ce32 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:03:31.153859 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-5b44f062-7fe4-4160-a00d-4b082410ce32 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: bdf3b234-dc0e-4ad2-b0a4-3aaa618bfe73] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:31.182077 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5b44f062-7fe4-4160-a00d-4b082410ce32 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:31.184176 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5b44f062-7fe4-4160-a00d-4b082410ce32 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:31.185231 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5b44f062-7fe4-4160-a00d-4b082410ce32 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:31.186452 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5b44f062-7fe4-4160-a00d-4b082410ce32 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:31.312395 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-2816d4c0-35e2-45e7-8cac-e977d0cbf1f5 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:03:31.313734 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-2816d4c0-35e2-45e7-8cac-e977d0cbf1f5 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:31.321529 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2816d4c0-35e2-45e7-8cac-e977d0cbf1f5 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:31.321732 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2816d4c0-35e2-45e7-8cac-e977d0cbf1f5 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:31.322457 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2816d4c0-35e2-45e7-8cac-e977d0cbf1f5 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:31.323581 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2816d4c0-35e2-45e7-8cac-e977d0cbf1f5 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:31.389539 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-2816d4c0-35e2-45e7-8cac-e977d0cbf1f5 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.082680 Jan 15 21:03:31.398291 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2357/4709] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:03:31 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:03:31.908659 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-5b44f062-7fe4-4160-a00d-4b082410ce32 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb3421bc9494914bc5f797b15a55643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31af2a6b9424f168dd6084d8d5fd0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:03:31.925320 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5b44f062-7fe4-4160-a00d-4b082410ce32 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/bdf3b234-dc0e-4ad2-b0a4-3aaa618bfe73" status: 200 len: 1327 microversion: 2.1 time: 0.778160 Jan 15 21:03:31.926655 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2353/4710] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:03:31 2022] GET /compute/v2.1/servers/bdf3b234-dc0e-4ad2-b0a4-3aaa618bfe73 => generated 1327 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:03:32.024083 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f1b5f6c4-cc34-4daf-93d6-258361379614 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:03:32.025859 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f1b5f6c4-cc34-4daf-93d6-258361379614 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:32.033265 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f1b5f6c4-cc34-4daf-93d6-258361379614 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:32.033811 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f1b5f6c4-cc34-4daf-93d6-258361379614 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:32.034694 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f1b5f6c4-cc34-4daf-93d6-258361379614 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:32.035214 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f1b5f6c4-cc34-4daf-93d6-258361379614 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:32.086483 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f1b5f6c4-cc34-4daf-93d6-258361379614 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.065768 Jan 15 21:03:32.089347 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2358/4711] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:03:32 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:03:32.408906 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-dd1b7670-ce98-4af5-9d90-967dee293a3b tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:03:32.410711 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-dd1b7670-ce98-4af5-9d90-967dee293a3b tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:32.417849 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dd1b7670-ce98-4af5-9d90-967dee293a3b tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:32.418508 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dd1b7670-ce98-4af5-9d90-967dee293a3b tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:32.419776 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dd1b7670-ce98-4af5-9d90-967dee293a3b tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:32.420764 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dd1b7670-ce98-4af5-9d90-967dee293a3b tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:32.491542 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-dd1b7670-ce98-4af5-9d90-967dee293a3b tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.087971 Jan 15 21:03:32.493140 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2354/4712] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:03:32 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:03:32.944146 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-6106b84e-2ba1-4eb3-8759-adb372b76105 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:03:32.944891 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-6106b84e-2ba1-4eb3-8759-adb372b76105 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: bdf3b234-dc0e-4ad2-b0a4-3aaa618bfe73] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:32.954119 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6106b84e-2ba1-4eb3-8759-adb372b76105 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:32.954907 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6106b84e-2ba1-4eb3-8759-adb372b76105 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:32.955911 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6106b84e-2ba1-4eb3-8759-adb372b76105 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:32.956537 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6106b84e-2ba1-4eb3-8759-adb372b76105 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:33.100515 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-7ad244b5-f3a6-4617-bc44-673d1764a4ca tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:03:33.101590 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-7ad244b5-f3a6-4617-bc44-673d1764a4ca tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:33.108489 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7ad244b5-f3a6-4617-bc44-673d1764a4ca tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:33.109441 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7ad244b5-f3a6-4617-bc44-673d1764a4ca tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:33.117181 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7ad244b5-f3a6-4617-bc44-673d1764a4ca tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:33.117706 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7ad244b5-f3a6-4617-bc44-673d1764a4ca tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:33.190193 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-7ad244b5-f3a6-4617-bc44-673d1764a4ca tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.092781 Jan 15 21:03:33.191262 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2355/4713] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:03:33 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:03:33.286642 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-6106b84e-2ba1-4eb3-8759-adb372b76105 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb3421bc9494914bc5f797b15a55643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31af2a6b9424f168dd6084d8d5fd0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:03:33.295060 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-6106b84e-2ba1-4eb3-8759-adb372b76105 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/bdf3b234-dc0e-4ad2-b0a4-3aaa618bfe73" status: 200 len: 1327 microversion: 2.1 time: 0.355361 Jan 15 21:03:33.296199 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2359/4714] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:03:32 2022] GET /compute/v2.1/servers/bdf3b234-dc0e-4ad2-b0a4-3aaa618bfe73 => generated 1327 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:03:33.504556 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-32d5f359-b191-4db8-83c8-af308d0c6867 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:03:33.506141 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-32d5f359-b191-4db8-83c8-af308d0c6867 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:33.513963 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-32d5f359-b191-4db8-83c8-af308d0c6867 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:33.514451 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-32d5f359-b191-4db8-83c8-af308d0c6867 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:33.515251 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-32d5f359-b191-4db8-83c8-af308d0c6867 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:33.515688 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-32d5f359-b191-4db8-83c8-af308d0c6867 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:33.581174 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-32d5f359-b191-4db8-83c8-af308d0c6867 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.080431 Jan 15 21:03:33.583196 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2356/4715] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:03:33 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:03:33.751350 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-bff59ca3-7164-47a7-ac6e-062986bfc215 req-303f60e8-9509-44c0-8e60-fc0016af6e86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdf3b234-dc0e-4ad2-b0a4-3aaa618bfe73", "name": "network-vif-plugged", "status": "completed", "tag": "3060e529-416c-4ce6-af7f-4acb88198123"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:03:33.755279 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:03:33.755279 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:03:33.767753 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-bff59ca3-7164-47a7-ac6e-062986bfc215 req-303f60e8-9509-44c0-8e60-fc0016af6e86 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:33.768426 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-bff59ca3-7164-47a7-ac6e-062986bfc215 req-303f60e8-9509-44c0-8e60-fc0016af6e86 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:33.782295 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-bff59ca3-7164-47a7-ac6e-062986bfc215 req-303f60e8-9509-44c0-8e60-fc0016af6e86 service nova] Creating event network-vif-plugged:3060e529-416c-4ce6-af7f-4acb88198123 for instance bdf3b234-dc0e-4ad2-b0a4-3aaa618bfe73 on nch1-master-1 Jan 15 21:03:33.787959 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-bff59ca3-7164-47a7-ac6e-062986bfc215 req-303f60e8-9509-44c0-8e60-fc0016af6e86 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042231 Jan 15 21:03:33.788817 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2360/4716] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:03:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:03:34.204548 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-1427aec6-b96e-4f2d-a5e9-64bff34ca783 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:03:34.206203 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-1427aec6-b96e-4f2d-a5e9-64bff34ca783 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:34.213999 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1427aec6-b96e-4f2d-a5e9-64bff34ca783 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:34.214620 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1427aec6-b96e-4f2d-a5e9-64bff34ca783 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:34.215958 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1427aec6-b96e-4f2d-a5e9-64bff34ca783 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:34.216553 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1427aec6-b96e-4f2d-a5e9-64bff34ca783 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:34.317688 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-718224f7-76da-408c-ad28-7c7f7076ac31 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:03:34.318391 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-718224f7-76da-408c-ad28-7c7f7076ac31 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: bdf3b234-dc0e-4ad2-b0a4-3aaa618bfe73] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:34.329737 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-718224f7-76da-408c-ad28-7c7f7076ac31 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:34.330396 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-718224f7-76da-408c-ad28-7c7f7076ac31 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:34.331355 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-718224f7-76da-408c-ad28-7c7f7076ac31 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:34.332643 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-718224f7-76da-408c-ad28-7c7f7076ac31 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:34.383690 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-1427aec6-b96e-4f2d-a5e9-64bff34ca783 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.183965 Jan 15 21:03:34.385286 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2357/4717] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:03:34 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:03:34.594974 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-03bd815c-e288-46d1-b77b-3622008cc0d4 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:03:34.595877 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-03bd815c-e288-46d1-b77b-3622008cc0d4 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:34.614360 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-03bd815c-e288-46d1-b77b-3622008cc0d4 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:34.614804 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-03bd815c-e288-46d1-b77b-3622008cc0d4 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:34.615822 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-03bd815c-e288-46d1-b77b-3622008cc0d4 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:34.616417 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-03bd815c-e288-46d1-b77b-3622008cc0d4 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:34.664164 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-718224f7-76da-408c-ad28-7c7f7076ac31 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb3421bc9494914bc5f797b15a55643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31af2a6b9424f168dd6084d8d5fd0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:03:34.685610 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-718224f7-76da-408c-ad28-7c7f7076ac31 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/bdf3b234-dc0e-4ad2-b0a4-3aaa618bfe73" status: 200 len: 1327 microversion: 2.1 time: 0.375551 Jan 15 21:03:34.687260 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2361/4718] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:03:34 2022] GET /compute/v2.1/servers/bdf3b234-dc0e-4ad2-b0a4-3aaa618bfe73 => generated 1327 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:03:34.689166 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-03bd815c-e288-46d1-b77b-3622008cc0d4 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.098734 Jan 15 21:03:34.690257 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2358/4719] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:03:34 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:03:35.395914 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-501a6cca-5a11-449f-8ba6-f91aca84ad66 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:03:35.397647 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-501a6cca-5a11-449f-8ba6-f91aca84ad66 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:35.404492 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-501a6cca-5a11-449f-8ba6-f91aca84ad66 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:35.408274 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-501a6cca-5a11-449f-8ba6-f91aca84ad66 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:35.410887 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-501a6cca-5a11-449f-8ba6-f91aca84ad66 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:35.412970 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-501a6cca-5a11-449f-8ba6-f91aca84ad66 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:35.511070 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-501a6cca-5a11-449f-8ba6-f91aca84ad66 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.118680 Jan 15 21:03:35.515967 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2362/4720] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:03:35 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:03:35.706196 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c6f095c0-03c7-490d-bf4f-973256f1ff57 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:03:35.706803 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-efbdcc5a-ded0-44de-bb67-a766b72440df tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:03:35.707292 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c6f095c0-03c7-490d-bf4f-973256f1ff57 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:35.707626 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-efbdcc5a-ded0-44de-bb67-a766b72440df tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: bdf3b234-dc0e-4ad2-b0a4-3aaa618bfe73] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:35.715398 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c6f095c0-03c7-490d-bf4f-973256f1ff57 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:35.715866 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c6f095c0-03c7-490d-bf4f-973256f1ff57 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:35.716666 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c6f095c0-03c7-490d-bf4f-973256f1ff57 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:35.719504 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c6f095c0-03c7-490d-bf4f-973256f1ff57 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:35.722761 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-efbdcc5a-ded0-44de-bb67-a766b72440df tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:35.723227 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-efbdcc5a-ded0-44de-bb67-a766b72440df tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:35.725673 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-efbdcc5a-ded0-44de-bb67-a766b72440df tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:35.726293 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-efbdcc5a-ded0-44de-bb67-a766b72440df tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:35.803488 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c6f095c0-03c7-490d-bf4f-973256f1ff57 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.105520 Jan 15 21:03:35.804701 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2359/4721] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:03:35 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:03:36.365682 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-efbdcc5a-ded0-44de-bb67-a766b72440df tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb3421bc9494914bc5f797b15a55643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31af2a6b9424f168dd6084d8d5fd0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:03:36.386191 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-efbdcc5a-ded0-44de-bb67-a766b72440df tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/bdf3b234-dc0e-4ad2-b0a4-3aaa618bfe73" status: 200 len: 1508 microversion: 2.1 time: 0.687814 Jan 15 21:03:36.386832 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2363/4722] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:03:35 2022] GET /compute/v2.1/servers/bdf3b234-dc0e-4ad2-b0a4-3aaa618bfe73 => generated 1508 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:03:36.407547 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d1903565-1987-4aa9-a4e1-04015c45f2d8 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:03:36.408245 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d1903565-1987-4aa9-a4e1-04015c45f2d8 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: bdf3b234-dc0e-4ad2-b0a4-3aaa618bfe73] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:36.418209 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d1903565-1987-4aa9-a4e1-04015c45f2d8 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:36.418903 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d1903565-1987-4aa9-a4e1-04015c45f2d8 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:36.419718 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d1903565-1987-4aa9-a4e1-04015c45f2d8 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:36.420716 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d1903565-1987-4aa9-a4e1-04015c45f2d8 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:36.524986 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-805b70c6-940b-4e72-9a2b-79d711f478c2 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:03:36.526657 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-805b70c6-940b-4e72-9a2b-79d711f478c2 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:36.535679 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-805b70c6-940b-4e72-9a2b-79d711f478c2 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:36.536642 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-805b70c6-940b-4e72-9a2b-79d711f478c2 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:36.537713 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-805b70c6-940b-4e72-9a2b-79d711f478c2 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:36.538309 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-805b70c6-940b-4e72-9a2b-79d711f478c2 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:36.603344 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-805b70c6-940b-4e72-9a2b-79d711f478c2 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.082889 Jan 15 21:03:36.608334 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2364/4723] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:03:36 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:03:36.822555 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ac456eca-fcf2-4f05-b920-3118b3e14ef9 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:03:36.825101 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ac456eca-fcf2-4f05-b920-3118b3e14ef9 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:36.836352 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ac456eca-fcf2-4f05-b920-3118b3e14ef9 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:36.837350 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ac456eca-fcf2-4f05-b920-3118b3e14ef9 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:36.838806 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ac456eca-fcf2-4f05-b920-3118b3e14ef9 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:36.839637 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ac456eca-fcf2-4f05-b920-3118b3e14ef9 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:36.896463 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ac456eca-fcf2-4f05-b920-3118b3e14ef9 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.082946 Jan 15 21:03:36.901240 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2365/4724] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:03:36 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:03:37.098979 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-d1903565-1987-4aa9-a4e1-04015c45f2d8 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb3421bc9494914bc5f797b15a55643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31af2a6b9424f168dd6084d8d5fd0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:03:37.108098 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d1903565-1987-4aa9-a4e1-04015c45f2d8 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/bdf3b234-dc0e-4ad2-b0a4-3aaa618bfe73" status: 200 len: 1508 microversion: 2.1 time: 0.704926 Jan 15 21:03:37.108690 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2360/4725] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:03:36 2022] GET /compute/v2.1/servers/bdf3b234-dc0e-4ad2-b0a4-3aaa618bfe73 => generated 1508 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:03:37.134748 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-57bd0232-e003-4cc4-9103-14b1386497e8 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:03:37.135534 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-57bd0232-e003-4cc4-9103-14b1386497e8 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: bdf3b234-dc0e-4ad2-b0a4-3aaa618bfe73] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:37.151217 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-57bd0232-e003-4cc4-9103-14b1386497e8 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:37.151665 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-57bd0232-e003-4cc4-9103-14b1386497e8 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:37.152458 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-57bd0232-e003-4cc4-9103-14b1386497e8 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:37.152918 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-57bd0232-e003-4cc4-9103-14b1386497e8 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:37.202903 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-57bd0232-e003-4cc4-9103-14b1386497e8 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: bdf3b234-dc0e-4ad2-b0a4-3aaa618bfe73] Going to try to terminate instance {{(pid=129366) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 21:03:37.321274 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-57bd0232-e003-4cc4-9103-14b1386497e8 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "DELETE /compute/v2.1/servers/bdf3b234-dc0e-4ad2-b0a4-3aaa618bfe73" status: 204 len: 0 microversion: 2.1 time: 0.196183 Jan 15 21:03:37.322147 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2366/4726] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 21:03:37 2022] DELETE /compute/v2.1/servers/bdf3b234-dc0e-4ad2-b0a4-3aaa618bfe73 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 21:03:37.331536 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-591ebdbb-e441-4876-9b50-832a5845effa tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:03:37.332333 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-591ebdbb-e441-4876-9b50-832a5845effa tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: bdf3b234-dc0e-4ad2-b0a4-3aaa618bfe73] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:37.339616 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-591ebdbb-e441-4876-9b50-832a5845effa tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:37.340301 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-591ebdbb-e441-4876-9b50-832a5845effa tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:37.341179 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-591ebdbb-e441-4876-9b50-832a5845effa tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:37.342600 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-591ebdbb-e441-4876-9b50-832a5845effa tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:37.397247 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-57bd0232-e003-4cc4-9103-14b1386497e8 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:03:37.398332 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-57bd0232-e003-4cc4-9103-14b1386497e8 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001684 Jan 15 21:03:37.403849 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2367/4727] 10.222.0.46 () {56 vars in 885 bytes} [Sat Jan 15 21:03:37 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jan 15 21:03:37.406918 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-57bd0232-e003-4cc4-9103-14b1386497e8 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:03:37.408402 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-57bd0232-e003-4cc4-9103-14b1386497e8 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.003014 Jan 15 21:03:37.409718 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2368/4728] 10.222.0.46 () {54 vars in 1034 bytes} [Sat Jan 15 21:03:37 2022] GET /compute/v2/ => generated 379 bytes in 5 msecs (HTTP/1.1 200) 5 headers in 221 bytes (2 switches on core 0) Jan 15 21:03:37.415862 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-57bd0232-e003-4cc4-9103-14b1386497e8 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:03:37.417209 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-57bd0232-e003-4cc4-9103-14b1386497e8 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001642 Jan 15 21:03:37.417584 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2369/4729] 10.222.0.46 () {54 vars in 1040 bytes} [Sat Jan 15 21:03:37 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 21:03:37.426026 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-57bd0232-e003-4cc4-9103-14b1386497e8 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:03:37.427177 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-57bd0232-e003-4cc4-9103-14b1386497e8 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001467 Jan 15 21:03:37.427515 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2370/4730] 10.222.0.46 () {56 vars in 885 bytes} [Sat Jan 15 21:03:37 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (2 switches on core 0) Jan 15 21:03:37.508008 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-591ebdbb-e441-4876-9b50-832a5845effa tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb3421bc9494914bc5f797b15a55643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31af2a6b9424f168dd6084d8d5fd0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:03:37.518551 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-591ebdbb-e441-4876-9b50-832a5845effa tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/bdf3b234-dc0e-4ad2-b0a4-3aaa618bfe73" status: 200 len: 1514 microversion: 2.1 time: 0.190987 Jan 15 21:03:37.528540 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2361/4731] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:03:37 2022] GET /compute/v2.1/servers/bdf3b234-dc0e-4ad2-b0a4-3aaa618bfe73 => generated 1514 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:03:37.616061 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-bb175c13-d32a-470d-951d-e7c290c59e7a tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:03:37.618425 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-bb175c13-d32a-470d-951d-e7c290c59e7a tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:37.627349 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bb175c13-d32a-470d-951d-e7c290c59e7a tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:37.629388 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bb175c13-d32a-470d-951d-e7c290c59e7a tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:37.631086 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bb175c13-d32a-470d-951d-e7c290c59e7a tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:37.631733 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bb175c13-d32a-470d-951d-e7c290c59e7a tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:37.697001 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-bb175c13-d32a-470d-951d-e7c290c59e7a tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.084822 Jan 15 21:03:37.698672 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2371/4732] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:03:37 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:03:37.908715 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c0ac9765-185d-47ed-ad68-8fa22e2c8baf tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:03:37.909687 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c0ac9765-185d-47ed-ad68-8fa22e2c8baf tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:37.916425 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c0ac9765-185d-47ed-ad68-8fa22e2c8baf tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:37.916924 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c0ac9765-185d-47ed-ad68-8fa22e2c8baf tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:37.917734 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c0ac9765-185d-47ed-ad68-8fa22e2c8baf tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:37.918169 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c0ac9765-185d-47ed-ad68-8fa22e2c8baf tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:37.964614 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c0ac9765-185d-47ed-ad68-8fa22e2c8baf tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.059783 Jan 15 21:03:37.965865 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2362/4733] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:03:37 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:03:38.538022 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-47e5efc1-5ab3-4ddc-960b-b86e445e53b6 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:03:38.538736 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-47e5efc1-5ab3-4ddc-960b-b86e445e53b6 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: bdf3b234-dc0e-4ad2-b0a4-3aaa618bfe73] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:38.548426 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-47e5efc1-5ab3-4ddc-960b-b86e445e53b6 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:38.548910 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-47e5efc1-5ab3-4ddc-960b-b86e445e53b6 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:38.549726 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-47e5efc1-5ab3-4ddc-960b-b86e445e53b6 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:38.550183 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-47e5efc1-5ab3-4ddc-960b-b86e445e53b6 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:38.710456 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-34a353ff-bc0a-4709-8673-a52ce0d3e0f5 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:03:38.711361 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-34a353ff-bc0a-4709-8673-a52ce0d3e0f5 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:38.725823 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-34a353ff-bc0a-4709-8673-a52ce0d3e0f5 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:38.726284 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-34a353ff-bc0a-4709-8673-a52ce0d3e0f5 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:38.727162 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-34a353ff-bc0a-4709-8673-a52ce0d3e0f5 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:38.727609 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-34a353ff-bc0a-4709-8673-a52ce0d3e0f5 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:38.811687 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-34a353ff-bc0a-4709-8673-a52ce0d3e0f5 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.104783 Jan 15 21:03:38.812293 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2363/4734] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:03:38 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:03:38.871738 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-47e5efc1-5ab3-4ddc-960b-b86e445e53b6 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb3421bc9494914bc5f797b15a55643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31af2a6b9424f168dd6084d8d5fd0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:03:38.887536 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-47e5efc1-5ab3-4ddc-960b-b86e445e53b6 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/bdf3b234-dc0e-4ad2-b0a4-3aaa618bfe73" status: 200 len: 1514 microversion: 2.1 time: 0.348073 Jan 15 21:03:38.888210 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2372/4735] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:03:38 2022] GET /compute/v2.1/servers/bdf3b234-dc0e-4ad2-b0a4-3aaa618bfe73 => generated 1514 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:03:38.978467 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8d3db28f-8c24-49bd-9213-6810e19dcbe7 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:03:38.980106 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-8d3db28f-8c24-49bd-9213-6810e19dcbe7 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:38.997696 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8d3db28f-8c24-49bd-9213-6810e19dcbe7 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:38.998685 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8d3db28f-8c24-49bd-9213-6810e19dcbe7 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:38.999782 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8d3db28f-8c24-49bd-9213-6810e19dcbe7 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:39.002070 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8d3db28f-8c24-49bd-9213-6810e19dcbe7 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:39.066509 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-8d3db28f-8c24-49bd-9213-6810e19dcbe7 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.092652 Jan 15 21:03:39.070784 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2364/4736] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:03:38 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:03:39.824613 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1e29fd8a-2c88-4a5c-be1a-240a08dd402e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:03:39.826574 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-1e29fd8a-2c88-4a5c-be1a-240a08dd402e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:39.851593 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1e29fd8a-2c88-4a5c-be1a-240a08dd402e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:39.855474 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1e29fd8a-2c88-4a5c-be1a-240a08dd402e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:39.865428 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-d92b3f14-33dd-4dd0-99c8-d2d022727255 req-223e8ab8-d6f3-4efa-bd9b-546adb997366 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdf3b234-dc0e-4ad2-b0a4-3aaa618bfe73", "name": "network-vif-deleted", "tag": "3060e529-416c-4ce6-af7f-4acb88198123"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:03:39.867128 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:03:39.867128 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:03:39.872045 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1e29fd8a-2c88-4a5c-be1a-240a08dd402e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:39.877615 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1e29fd8a-2c88-4a5c-be1a-240a08dd402e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:39.891106 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-d92b3f14-33dd-4dd0-99c8-d2d022727255 req-223e8ab8-d6f3-4efa-bd9b-546adb997366 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:39.898264 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-d92b3f14-33dd-4dd0-99c8-d2d022727255 req-223e8ab8-d6f3-4efa-bd9b-546adb997366 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:39.933501 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-d92b3f14-33dd-4dd0-99c8-d2d022727255 req-223e8ab8-d6f3-4efa-bd9b-546adb997366 service nova] Creating event network-vif-deleted:3060e529-416c-4ce6-af7f-4acb88198123 for instance bdf3b234-dc0e-4ad2-b0a4-3aaa618bfe73 on nch1-master-1 Jan 15 21:03:39.946855 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-d92b3f14-33dd-4dd0-99c8-d2d022727255 req-223e8ab8-d6f3-4efa-bd9b-546adb997366 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086276 Jan 15 21:03:39.951769 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2365/4737] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:03:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 21:03:39.960600 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b7c04857-3a30-4dea-9bce-814eb5ca44b3 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:03:39.961710 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b7c04857-3a30-4dea-9bce-814eb5ca44b3 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: bdf3b234-dc0e-4ad2-b0a4-3aaa618bfe73] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:39.983854 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-1e29fd8a-2c88-4a5c-be1a-240a08dd402e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.153282 Jan 15 21:03:39.985020 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2373/4738] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:03:39 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:03:39.990550 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b7c04857-3a30-4dea-9bce-814eb5ca44b3 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:39.991060 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b7c04857-3a30-4dea-9bce-814eb5ca44b3 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:39.991991 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b7c04857-3a30-4dea-9bce-814eb5ca44b3 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:39.992435 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b7c04857-3a30-4dea-9bce-814eb5ca44b3 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:40.056368 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b7c04857-3a30-4dea-9bce-814eb5ca44b3 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:40.057264 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b7c04857-3a30-4dea-9bce-814eb5ca44b3 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:40.058217 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.objects.instance [None req-b7c04857-3a30-4dea-9bce-814eb5ca44b3 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lazy-loading 'fault' on Instance uuid bdf3b234-dc0e-4ad2-b0a4-3aaa618bfe73 {{(pid=129365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 21:03:40.079935 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-78d76aaf-5562-4c59-b1ab-bdc3f85ec548 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:03:40.081508 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-78d76aaf-5562-4c59-b1ab-bdc3f85ec548 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:40.089483 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-78d76aaf-5562-4c59-b1ab-bdc3f85ec548 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:40.090326 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-78d76aaf-5562-4c59-b1ab-bdc3f85ec548 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:40.091491 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-78d76aaf-5562-4c59-b1ab-bdc3f85ec548 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:40.092742 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-78d76aaf-5562-4c59-b1ab-bdc3f85ec548 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:40.110039 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-b7c04857-3a30-4dea-9bce-814eb5ca44b3 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb3421bc9494914bc5f797b15a55643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31af2a6b9424f168dd6084d8d5fd0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:03:40.118675 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b7c04857-3a30-4dea-9bce-814eb5ca44b3 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/bdf3b234-dc0e-4ad2-b0a4-3aaa618bfe73" status: 200 len: 1317 microversion: 2.1 time: 0.165074 Jan 15 21:03:40.121538 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2366/4739] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:03:39 2022] GET /compute/v2.1/servers/bdf3b234-dc0e-4ad2-b0a4-3aaa618bfe73 => generated 1317 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:03:40.154436 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-78d76aaf-5562-4c59-b1ab-bdc3f85ec548 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.079109 Jan 15 21:03:40.158999 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2374/4740] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:03:40 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:03:40.995439 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5bb8b407-7c14-49d8-9560-f04e45cdc43e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:03:40.996988 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-5bb8b407-7c14-49d8-9560-f04e45cdc43e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:41.014549 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5bb8b407-7c14-49d8-9560-f04e45cdc43e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:41.015990 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5bb8b407-7c14-49d8-9560-f04e45cdc43e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:41.016481 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5bb8b407-7c14-49d8-9560-f04e45cdc43e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:41.017193 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5bb8b407-7c14-49d8-9560-f04e45cdc43e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:41.083642 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5bb8b407-7c14-49d8-9560-f04e45cdc43e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.091709 Jan 15 21:03:41.085074 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2367/4741] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:03:40 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:03:41.140425 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7c2b5a48-8758-4316-9ccb-c1ff5f58c898 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:03:41.142077 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-7c2b5a48-8758-4316-9ccb-c1ff5f58c898 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: bdf3b234-dc0e-4ad2-b0a4-3aaa618bfe73] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:41.155799 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7c2b5a48-8758-4316-9ccb-c1ff5f58c898 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:41.158409 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7c2b5a48-8758-4316-9ccb-c1ff5f58c898 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:41.161593 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7c2b5a48-8758-4316-9ccb-c1ff5f58c898 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:41.165037 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7c2b5a48-8758-4316-9ccb-c1ff5f58c898 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:41.170548 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-0c696a82-f947-484a-bcf4-b459b70a91d4 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:03:41.172025 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-0c696a82-f947-484a-bcf4-b459b70a91d4 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:41.181960 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0c696a82-f947-484a-bcf4-b459b70a91d4 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:41.182612 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0c696a82-f947-484a-bcf4-b459b70a91d4 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:41.183825 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0c696a82-f947-484a-bcf4-b459b70a91d4 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:41.184569 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0c696a82-f947-484a-bcf4-b459b70a91d4 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:41.199897 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-7c2b5a48-8758-4316-9ccb-c1ff5f58c898 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] HTTP exception thrown: Instance bdf3b234-dc0e-4ad2-b0a4-3aaa618bfe73 could not be found. Jan 15 21:03:41.200589 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7c2b5a48-8758-4316-9ccb-c1ff5f58c898 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Returning 404 to user: Instance bdf3b234-dc0e-4ad2-b0a4-3aaa618bfe73 could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:03:41.202190 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7c2b5a48-8758-4316-9ccb-c1ff5f58c898 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/bdf3b234-dc0e-4ad2-b0a4-3aaa618bfe73" status: 404 len: 111 microversion: 2.1 time: 0.066259 Jan 15 21:03:41.203370 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2375/4742] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:03:41 2022] GET /compute/v2.1/servers/bdf3b234-dc0e-4ad2-b0a4-3aaa618bfe73 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:03:41.211263 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9b876264-68a0-4a1d-ab26-386d75ad135d tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '.version_select at 0x7f30c8e3c790>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:03:41.237688 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-0c696a82-f947-484a-bcf4-b459b70a91d4 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.074384 Jan 15 21:03:41.237940 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-9b876264-68a0-4a1d-ab26-386d75ad135d tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-key-1849995260" status: 202 len: 0 microversion: 2.1 time: 0.030091 Jan 15 21:03:41.238472 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2376/4743] 10.222.0.46 () {58 vars in 1208 bytes} [Sat Jan 15 21:03:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-1849995260 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:03:41.242223 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2368/4744] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:03:41 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:03:41.397397 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ddbf73a3-86ac-4934-8adf-cca682b79652 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-371114858", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "networks": [{"uuid": "0b7cce2c-2308-43f4-b72e-8ea5d98a7ae1"}]}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:03:41.476972 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.network.neutron [None req-ddbf73a3-86ac-4934-8adf-cca682b79652 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] validate_networks() for [('0b7cce2c-2308-43f4-b72e-8ea5d98a7ae1', None, None, None, None, None)] {{(pid=129366) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 21:03:42.078877 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-ddbf73a3-86ac-4934-8adf-cca682b79652 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Flavor limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 21:03:42.079668 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-ddbf73a3-86ac-4934-8adf-cca682b79652 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Image limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 21:03:42.080284 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-ddbf73a3-86ac-4934-8adf-cca682b79652 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Flavor pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 21:03:42.080884 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-ddbf73a3-86ac-4934-8adf-cca682b79652 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Image pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 21:03:42.081481 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-ddbf73a3-86ac-4934-8adf-cca682b79652 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 21:03:42.099462 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ddbf73a3-86ac-4934-8adf-cca682b79652 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:42.101058 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ddbf73a3-86ac-4934-8adf-cca682b79652 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:42.104112 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-df4c305c-1c1f-4a24-940b-7b907e94ece3 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:03:42.106072 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-df4c305c-1c1f-4a24-940b-7b907e94ece3 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:42.116526 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ddbf73a3-86ac-4934-8adf-cca682b79652 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:42.117135 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ddbf73a3-86ac-4934-8adf-cca682b79652 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:42.128203 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-df4c305c-1c1f-4a24-940b-7b907e94ece3 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:42.129150 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-df4c305c-1c1f-4a24-940b-7b907e94ece3 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:42.130386 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-df4c305c-1c1f-4a24-940b-7b907e94ece3 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:42.132930 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-df4c305c-1c1f-4a24-940b-7b907e94ece3 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:42.142568 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-ddbf73a3-86ac-4934-8adf-cca682b79652 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Getting quotas for project d31af2a6b9424f168dd6084d8d5fd0c4. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:03:42.151832 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-ddbf73a3-86ac-4934-8adf-cca682b79652 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Getting quotas for user 9eb3421bc9494914bc5f797b15a55643 and project d31af2a6b9424f168dd6084d8d5fd0c4. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:03:42.171523 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ddbf73a3-86ac-4934-8adf-cca682b79652 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Going to run 1 instances... {{(pid=129366) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 21:03:42.174312 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ddbf73a3-86ac-4934-8adf-cca682b79652 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: ab35ab75-5c67-40f1-96d6-eb5220405c13] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 21:03:42.218952 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-df4c305c-1c1f-4a24-940b-7b907e94ece3 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.122346 Jan 15 21:03:42.222129 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2369/4745] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:03:42 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:03:42.258047 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-6b703af2-91d5-4cde-823c-d1d1bf73583c tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:03:42.263404 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-6b703af2-91d5-4cde-823c-d1d1bf73583c tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:42.272277 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6b703af2-91d5-4cde-823c-d1d1bf73583c tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:42.272999 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6b703af2-91d5-4cde-823c-d1d1bf73583c tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:42.273822 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6b703af2-91d5-4cde-823c-d1d1bf73583c tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:42.274274 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6b703af2-91d5-4cde-823c-d1d1bf73583c tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:42.296222 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ddbf73a3-86ac-4934-8adf-cca682b79652 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.912571 Jan 15 21:03:42.297590 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2377/4746] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 21:03:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 915 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 21:03:42.309484 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7ad331e0-0539-49ca-88fd-75e6a231bf7b tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:03:42.311332 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-7ad331e0-0539-49ca-88fd-75e6a231bf7b tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: ab35ab75-5c67-40f1-96d6-eb5220405c13] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:42.324351 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-6b703af2-91d5-4cde-823c-d1d1bf73583c tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.072680 Jan 15 21:03:42.325330 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2370/4747] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:03:42 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:03:42.397823 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-7ad331e0-0539-49ca-88fd-75e6a231bf7b tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb3421bc9494914bc5f797b15a55643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31af2a6b9424f168dd6084d8d5fd0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:03:42.411168 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7ad331e0-0539-49ca-88fd-75e6a231bf7b tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/ab35ab75-5c67-40f1-96d6-eb5220405c13" status: 200 len: 1208 microversion: 2.1 time: 0.107338 Jan 15 21:03:42.412299 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2378/4748] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:03:42 2022] GET /compute/v2.1/servers/ab35ab75-5c67-40f1-96d6-eb5220405c13 => generated 1208 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:03:43.236954 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3b525789-c947-4b6a-93c8-70308211b7a1 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:03:43.238490 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-3b525789-c947-4b6a-93c8-70308211b7a1 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:43.258776 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3b525789-c947-4b6a-93c8-70308211b7a1 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:43.259235 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3b525789-c947-4b6a-93c8-70308211b7a1 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:43.260495 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3b525789-c947-4b6a-93c8-70308211b7a1 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:43.261129 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3b525789-c947-4b6a-93c8-70308211b7a1 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:43.328415 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3b525789-c947-4b6a-93c8-70308211b7a1 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.099388 Jan 15 21:03:43.333297 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2371/4749] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:03:43 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:03:43.337296 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-66c0a81e-f668-41de-b735-3c79322ddc6c tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:03:43.338933 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-66c0a81e-f668-41de-b735-3c79322ddc6c tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:43.349697 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-66c0a81e-f668-41de-b735-3c79322ddc6c tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:43.350153 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-66c0a81e-f668-41de-b735-3c79322ddc6c tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:43.350949 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-66c0a81e-f668-41de-b735-3c79322ddc6c tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:43.351384 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-66c0a81e-f668-41de-b735-3c79322ddc6c tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:43.429897 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-4074f499-b029-4e7e-a02a-ae5bfb15fee0 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:03:43.430882 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-4074f499-b029-4e7e-a02a-ae5bfb15fee0 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: ab35ab75-5c67-40f1-96d6-eb5220405c13] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:43.443844 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4074f499-b029-4e7e-a02a-ae5bfb15fee0 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:43.446302 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4074f499-b029-4e7e-a02a-ae5bfb15fee0 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:43.447173 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4074f499-b029-4e7e-a02a-ae5bfb15fee0 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:43.447598 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4074f499-b029-4e7e-a02a-ae5bfb15fee0 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:43.461957 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-66c0a81e-f668-41de-b735-3c79322ddc6c tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.127742 Jan 15 21:03:43.463513 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2379/4750] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:03:43 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:03:43.603460 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-4074f499-b029-4e7e-a02a-ae5bfb15fee0 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb3421bc9494914bc5f797b15a55643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31af2a6b9424f168dd6084d8d5fd0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:03:43.611799 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-4074f499-b029-4e7e-a02a-ae5bfb15fee0 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/ab35ab75-5c67-40f1-96d6-eb5220405c13" status: 200 len: 1260 microversion: 2.1 time: 0.186658 Jan 15 21:03:43.617238 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2372/4751] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:03:43 2022] GET /compute/v2.1/servers/ab35ab75-5c67-40f1-96d6-eb5220405c13 => generated 1260 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:03:44.344126 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-57a97e34-9d25-4d23-922c-10ab33e36b5e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:03:44.345982 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-57a97e34-9d25-4d23-922c-10ab33e36b5e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:44.358977 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-57a97e34-9d25-4d23-922c-10ab33e36b5e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:44.365695 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-57a97e34-9d25-4d23-922c-10ab33e36b5e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:44.366862 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-57a97e34-9d25-4d23-922c-10ab33e36b5e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:44.368099 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-57a97e34-9d25-4d23-922c-10ab33e36b5e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:44.451507 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-57a97e34-9d25-4d23-922c-10ab33e36b5e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.113794 Jan 15 21:03:44.457932 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2380/4752] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:03:44 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:03:44.475576 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9506f247-865e-4a42-936c-3d6329f921cc tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:03:44.477628 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-9506f247-865e-4a42-936c-3d6329f921cc tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:44.486732 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9506f247-865e-4a42-936c-3d6329f921cc tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:44.487289 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9506f247-865e-4a42-936c-3d6329f921cc tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:44.488226 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9506f247-865e-4a42-936c-3d6329f921cc tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:44.488872 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9506f247-865e-4a42-936c-3d6329f921cc tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:44.553296 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-9506f247-865e-4a42-936c-3d6329f921cc tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.082385 Jan 15 21:03:44.554394 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2373/4753] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:03:44 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:03:44.635256 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-07628892-d269-46f8-bdc9-5ef7d9efa079 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:03:44.638097 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-07628892-d269-46f8-bdc9-5ef7d9efa079 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: ab35ab75-5c67-40f1-96d6-eb5220405c13] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:44.654837 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-07628892-d269-46f8-bdc9-5ef7d9efa079 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:44.655814 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-07628892-d269-46f8-bdc9-5ef7d9efa079 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:44.657897 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-07628892-d269-46f8-bdc9-5ef7d9efa079 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:44.659117 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-07628892-d269-46f8-bdc9-5ef7d9efa079 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:45.037586 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-07628892-d269-46f8-bdc9-5ef7d9efa079 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb3421bc9494914bc5f797b15a55643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31af2a6b9424f168dd6084d8d5fd0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:03:45.050559 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-07628892-d269-46f8-bdc9-5ef7d9efa079 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/ab35ab75-5c67-40f1-96d6-eb5220405c13" status: 200 len: 1308 microversion: 2.1 time: 0.423006 Jan 15 21:03:45.051155 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2381/4754] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:03:44 2022] GET /compute/v2.1/servers/ab35ab75-5c67-40f1-96d6-eb5220405c13 => generated 1308 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:03:45.464799 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f5e876ba-411a-4e47-9753-569afcdacdd7 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:03:45.465936 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f5e876ba-411a-4e47-9753-569afcdacdd7 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:45.484428 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f5e876ba-411a-4e47-9753-569afcdacdd7 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:45.485167 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f5e876ba-411a-4e47-9753-569afcdacdd7 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:45.488578 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f5e876ba-411a-4e47-9753-569afcdacdd7 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:45.490396 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f5e876ba-411a-4e47-9753-569afcdacdd7 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:45.567131 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-3948cb67-d1de-4120-b8cd-6c7e1ac05f7e tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:03:45.567622 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-3948cb67-d1de-4120-b8cd-6c7e1ac05f7e tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:45.581731 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3948cb67-d1de-4120-b8cd-6c7e1ac05f7e tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:45.582274 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3948cb67-d1de-4120-b8cd-6c7e1ac05f7e tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:45.583076 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3948cb67-d1de-4120-b8cd-6c7e1ac05f7e tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:45.583510 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3948cb67-d1de-4120-b8cd-6c7e1ac05f7e tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:45.594430 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f5e876ba-411a-4e47-9753-569afcdacdd7 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.133649 Jan 15 21:03:45.598613 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2374/4755] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:03:45 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:03:45.673181 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-3948cb67-d1de-4120-b8cd-6c7e1ac05f7e tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.110086 Jan 15 21:03:45.674377 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2382/4756] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:03:45 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:03:45.790640 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-752ab83f-59a7-4a24-8b0e-8c1767069f2d req-0d74af82-20c0-4452-986e-3f6e440e34bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab35ab75-5c67-40f1-96d6-eb5220405c13", "tag": "d3b0d270-adad-4376-905e-5a5f98d7020b"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:03:45.796525 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:03:45.796525 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:03:45.808940 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-752ab83f-59a7-4a24-8b0e-8c1767069f2d req-0d74af82-20c0-4452-986e-3f6e440e34bd service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:45.809835 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-752ab83f-59a7-4a24-8b0e-8c1767069f2d req-0d74af82-20c0-4452-986e-3f6e440e34bd service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:45.823436 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-752ab83f-59a7-4a24-8b0e-8c1767069f2d req-0d74af82-20c0-4452-986e-3f6e440e34bd service nova] Creating event network-changed:d3b0d270-adad-4376-905e-5a5f98d7020b for instance ab35ab75-5c67-40f1-96d6-eb5220405c13 on nch1-master-1 Jan 15 21:03:45.831217 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-752ab83f-59a7-4a24-8b0e-8c1767069f2d req-0d74af82-20c0-4452-986e-3f6e440e34bd service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046954 Jan 15 21:03:45.832536 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2375/4757] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:03:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:03:46.067858 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c53d975a-9d84-4f01-b57b-6c1c2103b646 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:03:46.069067 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c53d975a-9d84-4f01-b57b-6c1c2103b646 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: ab35ab75-5c67-40f1-96d6-eb5220405c13] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:46.081998 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c53d975a-9d84-4f01-b57b-6c1c2103b646 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:46.085109 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c53d975a-9d84-4f01-b57b-6c1c2103b646 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:46.086216 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c53d975a-9d84-4f01-b57b-6c1c2103b646 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:46.088577 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c53d975a-9d84-4f01-b57b-6c1c2103b646 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:46.293085 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d1a2ad51-469b-4cf6-ad13-7ca0f6d0a2b0 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:03:46.295203 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d1a2ad51-469b-4cf6-ad13-7ca0f6d0a2b0 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:46.303762 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d1a2ad51-469b-4cf6-ad13-7ca0f6d0a2b0 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:46.304506 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d1a2ad51-469b-4cf6-ad13-7ca0f6d0a2b0 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:46.305553 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d1a2ad51-469b-4cf6-ad13-7ca0f6d0a2b0 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:46.306165 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d1a2ad51-469b-4cf6-ad13-7ca0f6d0a2b0 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:46.332905 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-c53d975a-9d84-4f01-b57b-6c1c2103b646 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb3421bc9494914bc5f797b15a55643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31af2a6b9424f168dd6084d8d5fd0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:03:46.341172 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c53d975a-9d84-4f01-b57b-6c1c2103b646 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/ab35ab75-5c67-40f1-96d6-eb5220405c13" status: 200 len: 1308 microversion: 2.1 time: 0.277205 Jan 15 21:03:46.342294 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2383/4758] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:03:46 2022] GET /compute/v2.1/servers/ab35ab75-5c67-40f1-96d6-eb5220405c13 => generated 1308 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:03:46.427189 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d1a2ad51-469b-4cf6-ad13-7ca0f6d0a2b0 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action" status: 202 len: 0 microversion: 2.1 time: 0.138164 Jan 15 21:03:46.428534 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2376/4759] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:03:46 2022] POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:03:46.436732 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4139ad40-5166-45f6-bcdd-81a49259aebe tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:03:46.437844 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-4139ad40-5166-45f6-bcdd-81a49259aebe tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:46.445820 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4139ad40-5166-45f6-bcdd-81a49259aebe tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:46.446719 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4139ad40-5166-45f6-bcdd-81a49259aebe tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:46.447725 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4139ad40-5166-45f6-bcdd-81a49259aebe tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:46.448572 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4139ad40-5166-45f6-bcdd-81a49259aebe tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:46.610307 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f09cd6d0-b45b-4f7a-871d-1fd55727b999 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:03:46.611577 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f09cd6d0-b45b-4f7a-871d-1fd55727b999 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:46.625630 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f09cd6d0-b45b-4f7a-871d-1fd55727b999 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:46.626170 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f09cd6d0-b45b-4f7a-871d-1fd55727b999 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:46.627057 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f09cd6d0-b45b-4f7a-871d-1fd55727b999 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:46.627572 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f09cd6d0-b45b-4f7a-871d-1fd55727b999 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:46.687987 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f09cd6d0-b45b-4f7a-871d-1fd55727b999 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.081981 Jan 15 21:03:46.690291 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2377/4760] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:03:46 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:03:46.698329 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-cfae87c7-1c83-4f1a-b81e-05dfd826c781 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:03:46.699798 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-cfae87c7-1c83-4f1a-b81e-05dfd826c781 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:46.712717 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cfae87c7-1c83-4f1a-b81e-05dfd826c781 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:46.713408 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cfae87c7-1c83-4f1a-b81e-05dfd826c781 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:46.714714 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cfae87c7-1c83-4f1a-b81e-05dfd826c781 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:46.715502 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cfae87c7-1c83-4f1a-b81e-05dfd826c781 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:46.723214 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-4139ad40-5166-45f6-bcdd-81a49259aebe tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:03:46.730868 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-4139ad40-5166-45f6-bcdd-81a49259aebe tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9" status: 200 len: 1672 microversion: 2.1 time: 0.298008 Jan 15 21:03:46.732563 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2384/4761] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:03:46 2022] GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9 => generated 1672 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:03:46.777114 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-cfae87c7-1c83-4f1a-b81e-05dfd826c781 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.085076 Jan 15 21:03:46.779589 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2378/4762] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:03:46 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:03:47.361133 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-28030506-e3c4-494f-97d2-ff13e5d8dda7 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:03:47.362188 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-28030506-e3c4-494f-97d2-ff13e5d8dda7 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: ab35ab75-5c67-40f1-96d6-eb5220405c13] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:47.374760 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-28030506-e3c4-494f-97d2-ff13e5d8dda7 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:47.379328 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-28030506-e3c4-494f-97d2-ff13e5d8dda7 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:47.382260 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-28030506-e3c4-494f-97d2-ff13e5d8dda7 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:47.386074 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-28030506-e3c4-494f-97d2-ff13e5d8dda7 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:47.643030 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-28030506-e3c4-494f-97d2-ff13e5d8dda7 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb3421bc9494914bc5f797b15a55643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31af2a6b9424f168dd6084d8d5fd0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:03:47.653084 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-28030506-e3c4-494f-97d2-ff13e5d8dda7 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/ab35ab75-5c67-40f1-96d6-eb5220405c13" status: 200 len: 1308 microversion: 2.1 time: 0.297995 Jan 15 21:03:47.656356 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2385/4763] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:03:47 2022] GET /compute/v2.1/servers/ab35ab75-5c67-40f1-96d6-eb5220405c13 => generated 1308 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:03:47.702215 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-6eb18f57-6761-4e44-82d8-e9f12e6269e9 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:03:47.703323 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-6eb18f57-6761-4e44-82d8-e9f12e6269e9 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:47.717710 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6eb18f57-6761-4e44-82d8-e9f12e6269e9 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:47.721451 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6eb18f57-6761-4e44-82d8-e9f12e6269e9 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:47.727689 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6eb18f57-6761-4e44-82d8-e9f12e6269e9 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:47.728305 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6eb18f57-6761-4e44-82d8-e9f12e6269e9 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:47.751573 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-5768d764-d86f-46ad-bc83-769fc2d73cbe tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:03:47.753854 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-5768d764-d86f-46ad-bc83-769fc2d73cbe tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:47.774082 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5768d764-d86f-46ad-bc83-769fc2d73cbe tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:47.774718 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5768d764-d86f-46ad-bc83-769fc2d73cbe tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:47.775774 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5768d764-d86f-46ad-bc83-769fc2d73cbe tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:47.776138 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5768d764-d86f-46ad-bc83-769fc2d73cbe tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:47.797437 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-6eb18f57-6761-4e44-82d8-e9f12e6269e9 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.096173 Jan 15 21:03:47.801354 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2379/4764] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:03:47 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:03:47.806506 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c8d02d62-5eed-40d9-bcee-08878a7369a6 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:03:47.807505 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c8d02d62-5eed-40d9-bcee-08878a7369a6 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:47.827604 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c8d02d62-5eed-40d9-bcee-08878a7369a6 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:47.828065 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c8d02d62-5eed-40d9-bcee-08878a7369a6 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:47.828875 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c8d02d62-5eed-40d9-bcee-08878a7369a6 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:47.829305 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c8d02d62-5eed-40d9-bcee-08878a7369a6 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:47.906798 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c8d02d62-5eed-40d9-bcee-08878a7369a6 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.101376 Jan 15 21:03:47.907543 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2380/4765] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:03:47 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:03:48.052109 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-5768d764-d86f-46ad-bc83-769fc2d73cbe tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:03:48.067453 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-5768d764-d86f-46ad-bc83-769fc2d73cbe tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9" status: 200 len: 1672 microversion: 2.1 time: 0.321751 Jan 15 21:03:48.080677 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2386/4766] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:03:47 2022] GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9 => generated 1672 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:03:48.679139 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-96c645bb-bf0c-42c6-b0b6-23074e3f9207 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:03:48.680414 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-96c645bb-bf0c-42c6-b0b6-23074e3f9207 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: ab35ab75-5c67-40f1-96d6-eb5220405c13] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:48.697673 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-96c645bb-bf0c-42c6-b0b6-23074e3f9207 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:48.698996 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-96c645bb-bf0c-42c6-b0b6-23074e3f9207 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:48.700423 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-96c645bb-bf0c-42c6-b0b6-23074e3f9207 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:48.702828 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-96c645bb-bf0c-42c6-b0b6-23074e3f9207 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:48.813099 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f3dbae6e-87e2-44ba-a24e-8685a2818393 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:03:48.814102 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f3dbae6e-87e2-44ba-a24e-8685a2818393 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:48.821410 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f3dbae6e-87e2-44ba-a24e-8685a2818393 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:48.822212 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f3dbae6e-87e2-44ba-a24e-8685a2818393 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:48.823087 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f3dbae6e-87e2-44ba-a24e-8685a2818393 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:48.823716 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f3dbae6e-87e2-44ba-a24e-8685a2818393 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:48.878862 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f3dbae6e-87e2-44ba-a24e-8685a2818393 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.070873 Jan 15 21:03:48.884950 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2387/4767] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:03:48 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:03:48.920347 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e05a082b-d0b4-404b-930b-a1d654c57539 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:03:48.921402 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e05a082b-d0b4-404b-930b-a1d654c57539 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:48.928163 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e05a082b-d0b4-404b-930b-a1d654c57539 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:48.928609 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e05a082b-d0b4-404b-930b-a1d654c57539 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:48.929490 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e05a082b-d0b4-404b-930b-a1d654c57539 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:48.929929 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e05a082b-d0b4-404b-930b-a1d654c57539 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:48.980554 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e05a082b-d0b4-404b-930b-a1d654c57539 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.064756 Jan 15 21:03:48.982011 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2388/4768] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:03:48 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:03:48.989798 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-96c645bb-bf0c-42c6-b0b6-23074e3f9207 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb3421bc9494914bc5f797b15a55643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31af2a6b9424f168dd6084d8d5fd0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:03:48.998296 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-96c645bb-bf0c-42c6-b0b6-23074e3f9207 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/ab35ab75-5c67-40f1-96d6-eb5220405c13" status: 200 len: 1308 microversion: 2.1 time: 0.327607 Jan 15 21:03:48.999136 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2381/4769] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:03:48 2022] GET /compute/v2.1/servers/ab35ab75-5c67-40f1-96d6-eb5220405c13 => generated 1308 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:03:49.089095 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-13199904-279b-449a-b2bd-31ae6d53ecae tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:03:49.090710 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-13199904-279b-449a-b2bd-31ae6d53ecae tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:49.098315 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-13199904-279b-449a-b2bd-31ae6d53ecae tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:49.098999 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-13199904-279b-449a-b2bd-31ae6d53ecae tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:49.099802 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-13199904-279b-449a-b2bd-31ae6d53ecae tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:49.100307 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-13199904-279b-449a-b2bd-31ae6d53ecae tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:49.276834 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-13199904-279b-449a-b2bd-31ae6d53ecae tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:03:49.289427 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-13199904-279b-449a-b2bd-31ae6d53ecae tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9" status: 200 len: 1670 microversion: 2.1 time: 0.205877 Jan 15 21:03:49.306456 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2389/4770] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:03:49 2022] GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9 => generated 1670 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:03:49.892397 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-eedbfca7-5d16-422b-8f7a-49f057a04985 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:03:49.893920 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-eedbfca7-5d16-422b-8f7a-49f057a04985 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:49.902249 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-eedbfca7-5d16-422b-8f7a-49f057a04985 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:49.902371 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-eedbfca7-5d16-422b-8f7a-49f057a04985 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:49.907059 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-eedbfca7-5d16-422b-8f7a-49f057a04985 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:49.907927 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-eedbfca7-5d16-422b-8f7a-49f057a04985 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:49.998733 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-914afe8b-51d7-4493-ba7b-4dec75432047 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:03:49.999906 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-914afe8b-51d7-4493-ba7b-4dec75432047 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:50.003640 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-eedbfca7-5d16-422b-8f7a-49f057a04985 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.115383 Jan 15 21:03:50.024880 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2382/4771] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:03:49 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:03:50.031885 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-7dd18ee5-cb9b-4dbd-88a6-10385e2ba3a2 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:03:50.032620 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-7dd18ee5-cb9b-4dbd-88a6-10385e2ba3a2 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: ab35ab75-5c67-40f1-96d6-eb5220405c13] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:50.037995 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-914afe8b-51d7-4493-ba7b-4dec75432047 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:50.038461 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-914afe8b-51d7-4493-ba7b-4dec75432047 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:50.044740 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-914afe8b-51d7-4493-ba7b-4dec75432047 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:50.045962 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-914afe8b-51d7-4493-ba7b-4dec75432047 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:50.078634 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7dd18ee5-cb9b-4dbd-88a6-10385e2ba3a2 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:50.079014 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7dd18ee5-cb9b-4dbd-88a6-10385e2ba3a2 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:50.091751 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7dd18ee5-cb9b-4dbd-88a6-10385e2ba3a2 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:50.093282 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7dd18ee5-cb9b-4dbd-88a6-10385e2ba3a2 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:50.124263 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-914afe8b-51d7-4493-ba7b-4dec75432047 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.129185 Jan 15 21:03:50.124981 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2390/4772] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:03:49 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:03:50.376891 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-7dd18ee5-cb9b-4dbd-88a6-10385e2ba3a2 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb3421bc9494914bc5f797b15a55643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31af2a6b9424f168dd6084d8d5fd0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:03:50.384892 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-7dd18ee5-cb9b-4dbd-88a6-10385e2ba3a2 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/ab35ab75-5c67-40f1-96d6-eb5220405c13" status: 200 len: 1308 microversion: 2.1 time: 0.358534 Jan 15 21:03:50.385501 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2383/4773] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:03:50 2022] GET /compute/v2.1/servers/ab35ab75-5c67-40f1-96d6-eb5220405c13 => generated 1308 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:03:51.027770 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-5a2e7007-cc0a-4a9a-8a57-8ca65bb0aba2 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:03:51.029739 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-5a2e7007-cc0a-4a9a-8a57-8ca65bb0aba2 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:51.043952 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5a2e7007-cc0a-4a9a-8a57-8ca65bb0aba2 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:51.045358 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5a2e7007-cc0a-4a9a-8a57-8ca65bb0aba2 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:51.046926 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5a2e7007-cc0a-4a9a-8a57-8ca65bb0aba2 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:51.047635 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5a2e7007-cc0a-4a9a-8a57-8ca65bb0aba2 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:51.103718 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-5a2e7007-cc0a-4a9a-8a57-8ca65bb0aba2 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.081266 Jan 15 21:03:51.104527 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2391/4774] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:03:51 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:03:51.140197 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ea5dcb28-b545-4c2f-88f6-03fc08f5d3ed tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:03:51.141262 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ea5dcb28-b545-4c2f-88f6-03fc08f5d3ed tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:51.150545 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ea5dcb28-b545-4c2f-88f6-03fc08f5d3ed tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:51.151042 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ea5dcb28-b545-4c2f-88f6-03fc08f5d3ed tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:51.151847 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ea5dcb28-b545-4c2f-88f6-03fc08f5d3ed tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:51.152553 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ea5dcb28-b545-4c2f-88f6-03fc08f5d3ed tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:51.228659 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ea5dcb28-b545-4c2f-88f6-03fc08f5d3ed tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.094901 Jan 15 21:03:51.233997 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2384/4775] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:03:51 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:03:51.404033 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-5f14804a-3fe4-4c2e-a0c5-4940bd111a82 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:03:51.404872 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-5f14804a-3fe4-4c2e-a0c5-4940bd111a82 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: ab35ab75-5c67-40f1-96d6-eb5220405c13] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:51.415136 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5f14804a-3fe4-4c2e-a0c5-4940bd111a82 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:51.415644 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5f14804a-3fe4-4c2e-a0c5-4940bd111a82 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:51.416948 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5f14804a-3fe4-4c2e-a0c5-4940bd111a82 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:51.418189 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5f14804a-3fe4-4c2e-a0c5-4940bd111a82 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:51.624744 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-5f14804a-3fe4-4c2e-a0c5-4940bd111a82 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb3421bc9494914bc5f797b15a55643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31af2a6b9424f168dd6084d8d5fd0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:03:51.633263 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-5f14804a-3fe4-4c2e-a0c5-4940bd111a82 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/ab35ab75-5c67-40f1-96d6-eb5220405c13" status: 200 len: 1308 microversion: 2.1 time: 0.234459 Jan 15 21:03:51.634170 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2392/4776] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:03:51 2022] GET /compute/v2.1/servers/ab35ab75-5c67-40f1-96d6-eb5220405c13 => generated 1308 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:03:52.119100 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-6935e8d9-48c6-4e39-bb32-48fb70a9be39 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:03:52.121718 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-6935e8d9-48c6-4e39-bb32-48fb70a9be39 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:52.131903 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6935e8d9-48c6-4e39-bb32-48fb70a9be39 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:52.132742 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6935e8d9-48c6-4e39-bb32-48fb70a9be39 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:52.133789 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6935e8d9-48c6-4e39-bb32-48fb70a9be39 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:52.134426 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6935e8d9-48c6-4e39-bb32-48fb70a9be39 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:52.200253 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-6935e8d9-48c6-4e39-bb32-48fb70a9be39 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.086966 Jan 15 21:03:52.201077 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2385/4777] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:03:52 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:03:52.261734 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-03bf7d46-7b73-4bcc-b0d0-03590b83661f tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:03:52.265664 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-03bf7d46-7b73-4bcc-b0d0-03590b83661f tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:52.301421 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-03bf7d46-7b73-4bcc-b0d0-03590b83661f tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:52.302113 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-03bf7d46-7b73-4bcc-b0d0-03590b83661f tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:52.303535 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-03bf7d46-7b73-4bcc-b0d0-03590b83661f tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:52.304282 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-03bf7d46-7b73-4bcc-b0d0-03590b83661f tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:52.311234 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-d26341c1-f89a-430a-9e14-d447aba6580b req-21cdafab-4433-4ba9-befc-ce6731e4e50a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab35ab75-5c67-40f1-96d6-eb5220405c13", "name": "network-vif-plugged", "status": "completed", "tag": "d3b0d270-adad-4376-905e-5a5f98d7020b"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:03:52.313173 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:03:52.313173 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:03:52.331603 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-d26341c1-f89a-430a-9e14-d447aba6580b req-21cdafab-4433-4ba9-befc-ce6731e4e50a service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:52.332630 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-d26341c1-f89a-430a-9e14-d447aba6580b req-21cdafab-4433-4ba9-befc-ce6731e4e50a service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:52.369502 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-d26341c1-f89a-430a-9e14-d447aba6580b req-21cdafab-4433-4ba9-befc-ce6731e4e50a service nova] Creating event network-vif-plugged:d3b0d270-adad-4376-905e-5a5f98d7020b for instance ab35ab75-5c67-40f1-96d6-eb5220405c13 on nch1-master-1 Jan 15 21:03:52.384774 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-03bf7d46-7b73-4bcc-b0d0-03590b83661f tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.140733 Jan 15 21:03:52.384774 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2393/4778] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:03:52 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:03:52.386477 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-d26341c1-f89a-430a-9e14-d447aba6580b req-21cdafab-4433-4ba9-befc-ce6731e4e50a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076153 Jan 15 21:03:52.390455 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2386/4779] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:03:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 21:03:52.653520 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d09029e7-e2a3-4c29-9d5f-9085f0c4adb7 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:03:52.655326 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-d09029e7-e2a3-4c29-9d5f-9085f0c4adb7 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: ab35ab75-5c67-40f1-96d6-eb5220405c13] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:52.666175 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d09029e7-e2a3-4c29-9d5f-9085f0c4adb7 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:52.669454 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d09029e7-e2a3-4c29-9d5f-9085f0c4adb7 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:52.671164 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d09029e7-e2a3-4c29-9d5f-9085f0c4adb7 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:52.672986 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d09029e7-e2a3-4c29-9d5f-9085f0c4adb7 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:52.865534 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-d09029e7-e2a3-4c29-9d5f-9085f0c4adb7 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb3421bc9494914bc5f797b15a55643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31af2a6b9424f168dd6084d8d5fd0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:03:52.874029 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d09029e7-e2a3-4c29-9d5f-9085f0c4adb7 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/ab35ab75-5c67-40f1-96d6-eb5220405c13" status: 200 len: 1308 microversion: 2.1 time: 0.227665 Jan 15 21:03:52.884494 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2394/4780] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:03:52 2022] GET /compute/v2.1/servers/ab35ab75-5c67-40f1-96d6-eb5220405c13 => generated 1308 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:03:53.214232 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-0592d89a-0f61-4393-9a2b-2bf574923730 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:03:53.215907 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-0592d89a-0f61-4393-9a2b-2bf574923730 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:53.238546 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0592d89a-0f61-4393-9a2b-2bf574923730 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:53.239681 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0592d89a-0f61-4393-9a2b-2bf574923730 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:53.240829 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0592d89a-0f61-4393-9a2b-2bf574923730 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:53.241932 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0592d89a-0f61-4393-9a2b-2bf574923730 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:53.258026 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-fc92592a-c4b7-4036-a947-f10293759f73 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:03:53.258517 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-fc92592a-c4b7-4036-a947-f10293759f73 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:53.268325 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fc92592a-c4b7-4036-a947-f10293759f73 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:53.269034 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fc92592a-c4b7-4036-a947-f10293759f73 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:53.277188 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fc92592a-c4b7-4036-a947-f10293759f73 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:53.277654 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fc92592a-c4b7-4036-a947-f10293759f73 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:53.321371 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-0592d89a-0f61-4393-9a2b-2bf574923730 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.112006 Jan 15 21:03:53.327146 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2387/4781] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:03:53 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:03:53.409004 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-38f2c4da-7068-42ba-85cc-45b19fb7478e tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:03:53.411377 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-38f2c4da-7068-42ba-85cc-45b19fb7478e tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:53.422650 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-38f2c4da-7068-42ba-85cc-45b19fb7478e tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:53.424547 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-38f2c4da-7068-42ba-85cc-45b19fb7478e tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:53.425788 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-38f2c4da-7068-42ba-85cc-45b19fb7478e tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:53.426400 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-38f2c4da-7068-42ba-85cc-45b19fb7478e tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:53.430706 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.objects.instance [None req-fc92592a-c4b7-4036-a947-f10293759f73 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lazy-loading 'services' on Instance uuid ac78554d-ca29-4e31-a410-00dc4df5c77a {{(pid=129366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 21:03:53.503885 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-38f2c4da-7068-42ba-85cc-45b19fb7478e tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.107909 Jan 15 21:03:53.505465 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2388/4782] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:03:53 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:03:53.537164 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-fc92592a-c4b7-4036-a947-f10293759f73 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "DELETE /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/os-volume_attachments/ca438ded-6045-415d-8f47-bda2befa2363" status: 202 len: 0 microversion: 2.1 time: 0.282583 Jan 15 21:03:53.537791 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2395/4783] 10.222.0.46 () {58 vars in 1415 bytes} [Sat Jan 15 21:03:53 2022] DELETE /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/os-volume_attachments/ca438ded-6045-415d-8f47-bda2befa2363 => generated 0 bytes in 284 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:03:53.892361 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ed23ecef-f5e7-46d1-bef9-6aefd11e76fb tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:03:53.893211 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ed23ecef-f5e7-46d1-bef9-6aefd11e76fb tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: ab35ab75-5c67-40f1-96d6-eb5220405c13] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:53.900895 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ed23ecef-f5e7-46d1-bef9-6aefd11e76fb tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:53.902030 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ed23ecef-f5e7-46d1-bef9-6aefd11e76fb tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:53.903060 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ed23ecef-f5e7-46d1-bef9-6aefd11e76fb tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:53.904439 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ed23ecef-f5e7-46d1-bef9-6aefd11e76fb tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:54.145719 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-ed23ecef-f5e7-46d1-bef9-6aefd11e76fb tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb3421bc9494914bc5f797b15a55643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31af2a6b9424f168dd6084d8d5fd0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:03:54.160712 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ed23ecef-f5e7-46d1-bef9-6aefd11e76fb tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/ab35ab75-5c67-40f1-96d6-eb5220405c13" status: 200 len: 1308 microversion: 2.1 time: 0.268356 Jan 15 21:03:54.171839 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2389/4784] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:03:53 2022] GET /compute/v2.1/servers/ab35ab75-5c67-40f1-96d6-eb5220405c13 => generated 1308 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:03:54.341828 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a8d6dc8c-86db-4cf5-9e24-a99ab7e78c76 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:03:54.344066 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a8d6dc8c-86db-4cf5-9e24-a99ab7e78c76 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:54.362890 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a8d6dc8c-86db-4cf5-9e24-a99ab7e78c76 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:54.363555 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a8d6dc8c-86db-4cf5-9e24-a99ab7e78c76 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:54.364695 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a8d6dc8c-86db-4cf5-9e24-a99ab7e78c76 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:54.365304 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a8d6dc8c-86db-4cf5-9e24-a99ab7e78c76 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:54.460989 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a8d6dc8c-86db-4cf5-9e24-a99ab7e78c76 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.127246 Jan 15 21:03:54.462802 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2396/4785] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:03:54 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:03:54.517089 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-af2ef02b-245d-4c7f-a386-56cfdbfa8d64 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:03:54.518764 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-af2ef02b-245d-4c7f-a386-56cfdbfa8d64 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:54.526246 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-af2ef02b-245d-4c7f-a386-56cfdbfa8d64 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:54.526934 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-af2ef02b-245d-4c7f-a386-56cfdbfa8d64 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:54.528048 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-af2ef02b-245d-4c7f-a386-56cfdbfa8d64 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:54.529267 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-af2ef02b-245d-4c7f-a386-56cfdbfa8d64 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:54.585525 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-af2ef02b-245d-4c7f-a386-56cfdbfa8d64 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.072686 Jan 15 21:03:54.589942 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2390/4786] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:03:54 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:03:54.692687 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e9c6ff53-b1ee-4e0f-a6ad-19c1a1f5d152 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:03:54.703168 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e9c6ff53-b1ee-4e0f-a6ad-19c1a1f5d152 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:54.703995 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e9c6ff53-b1ee-4e0f-a6ad-19c1a1f5d152 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:54.748196 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e9c6ff53-b1ee-4e0f-a6ad-19c1a1f5d152 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Going to try to stop instance {{(pid=129366) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Jan 15 21:03:54.807781 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e9c6ff53-b1ee-4e0f-a6ad-19c1a1f5d152 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action" status: 202 len: 0 microversion: 2.1 time: 0.121580 Jan 15 21:03:54.808757 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2397/4787] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:03:54 2022] POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:03:54.818955 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a6f146d8-4598-4b89-87df-50af896d4aa4 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:03:54.820219 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a6f146d8-4598-4b89-87df-50af896d4aa4 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:54.836302 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a6f146d8-4598-4b89-87df-50af896d4aa4 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:54.836881 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a6f146d8-4598-4b89-87df-50af896d4aa4 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:54.838012 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a6f146d8-4598-4b89-87df-50af896d4aa4 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:54.838510 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a6f146d8-4598-4b89-87df-50af896d4aa4 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:55.051591 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-a6f146d8-4598-4b89-87df-50af896d4aa4 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6097506a2d4e36818310d9d70bf01b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4dad65fccfe481a973f5fcbb9287dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:03:55.065217 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a6f146d8-4598-4b89-87df-50af896d4aa4 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "GET /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a" status: 200 len: 1675 microversion: 2.1 time: 0.251240 Jan 15 21:03:55.076095 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2391/4788] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:03:54 2022] GET /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a => generated 1675 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:03:55.179938 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-423aa2d4-095f-4e84-82a2-d198ff858494 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:03:55.180670 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-423aa2d4-095f-4e84-82a2-d198ff858494 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: ab35ab75-5c67-40f1-96d6-eb5220405c13] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:55.195026 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-423aa2d4-095f-4e84-82a2-d198ff858494 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:55.200638 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-423aa2d4-095f-4e84-82a2-d198ff858494 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:55.202023 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-423aa2d4-095f-4e84-82a2-d198ff858494 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:55.202496 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-423aa2d4-095f-4e84-82a2-d198ff858494 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:55.409839 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-423aa2d4-095f-4e84-82a2-d198ff858494 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb3421bc9494914bc5f797b15a55643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31af2a6b9424f168dd6084d8d5fd0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:03:55.420544 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-423aa2d4-095f-4e84-82a2-d198ff858494 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/ab35ab75-5c67-40f1-96d6-eb5220405c13" status: 200 len: 1489 microversion: 2.1 time: 0.244855 Jan 15 21:03:55.427396 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2398/4789] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:03:55 2022] GET /compute/v2.1/servers/ab35ab75-5c67-40f1-96d6-eb5220405c13 => generated 1489 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:03:55.477086 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-402c34aa-a962-4703-81a9-6eb187ad40a3 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:03:55.478748 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-402c34aa-a962-4703-81a9-6eb187ad40a3 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:55.487054 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-402c34aa-a962-4703-81a9-6eb187ad40a3 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:55.489343 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-402c34aa-a962-4703-81a9-6eb187ad40a3 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:55.490769 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-402c34aa-a962-4703-81a9-6eb187ad40a3 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:55.491377 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-402c34aa-a962-4703-81a9-6eb187ad40a3 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:55.555712 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-402c34aa-a962-4703-81a9-6eb187ad40a3 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.083829 Jan 15 21:03:55.557876 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2392/4790] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:03:55 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:03:55.605818 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-1bbabcc3-be42-4279-a567-a58107d961a9 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-371114858", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "networks": [{"uuid": "0b7cce2c-2308-43f4-b72e-8ea5d98a7ae1"}]}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:03:55.610378 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c5722b4a-bc9d-4103-afe5-e2ba8f522bdf tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:03:55.611353 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c5722b4a-bc9d-4103-afe5-e2ba8f522bdf tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:55.620735 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c5722b4a-bc9d-4103-afe5-e2ba8f522bdf tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:55.621445 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c5722b4a-bc9d-4103-afe5-e2ba8f522bdf tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:55.622486 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c5722b4a-bc9d-4103-afe5-e2ba8f522bdf tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:55.625012 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c5722b4a-bc9d-4103-afe5-e2ba8f522bdf tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:55.703102 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.network.neutron [None req-1bbabcc3-be42-4279-a567-a58107d961a9 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] validate_networks() for [('0b7cce2c-2308-43f4-b72e-8ea5d98a7ae1', None, None, None, None, None)] {{(pid=129365) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 21:03:55.715928 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c5722b4a-bc9d-4103-afe5-e2ba8f522bdf tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.120748 Jan 15 21:03:55.721846 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2399/4791] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:03:55 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:03:56.083784 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f15b367a-deff-4fe4-8e2f-468779e73a57 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:03:56.084492 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f15b367a-deff-4fe4-8e2f-468779e73a57 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:56.092874 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f15b367a-deff-4fe4-8e2f-468779e73a57 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:56.093586 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f15b367a-deff-4fe4-8e2f-468779e73a57 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:56.094579 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f15b367a-deff-4fe4-8e2f-468779e73a57 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:56.095282 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f15b367a-deff-4fe4-8e2f-468779e73a57 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:56.383341 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-1bbabcc3-be42-4279-a567-a58107d961a9 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Flavor limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 21:03:56.384162 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-1bbabcc3-be42-4279-a567-a58107d961a9 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Image limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 21:03:56.385497 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-1bbabcc3-be42-4279-a567-a58107d961a9 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Flavor pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 21:03:56.386083 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-1bbabcc3-be42-4279-a567-a58107d961a9 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Image pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 21:03:56.387617 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-1bbabcc3-be42-4279-a567-a58107d961a9 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 21:03:56.400607 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1bbabcc3-be42-4279-a567-a58107d961a9 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:56.401131 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1bbabcc3-be42-4279-a567-a58107d961a9 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:56.401960 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1bbabcc3-be42-4279-a567-a58107d961a9 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:56.402636 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1bbabcc3-be42-4279-a567-a58107d961a9 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:56.405745 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-f15b367a-deff-4fe4-8e2f-468779e73a57 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6097506a2d4e36818310d9d70bf01b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4dad65fccfe481a973f5fcbb9287dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:03:56.414400 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f15b367a-deff-4fe4-8e2f-468779e73a57 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "GET /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a" status: 200 len: 1675 microversion: 2.1 time: 0.335524 Jan 15 21:03:56.427941 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2400/4792] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:03:56 2022] GET /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a => generated 1675 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:03:56.438645 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-1bbabcc3-be42-4279-a567-a58107d961a9 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Getting quotas for project d31af2a6b9424f168dd6084d8d5fd0c4. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:03:56.444513 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-1bbabcc3-be42-4279-a567-a58107d961a9 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Getting quotas for user 9eb3421bc9494914bc5f797b15a55643 and project d31af2a6b9424f168dd6084d8d5fd0c4. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:03:56.458760 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-1bbabcc3-be42-4279-a567-a58107d961a9 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Going to run 1 instances... {{(pid=129365) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 21:03:56.461290 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-1bbabcc3-be42-4279-a567-a58107d961a9 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: b6942f26-7967-4574-9f6e-9a42a7c66a3b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129365) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 21:03:56.525930 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-1bbabcc3-be42-4279-a567-a58107d961a9 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.924478 Jan 15 21:03:56.527197 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2393/4793] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 21:03:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 928 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 21:03:56.538500 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c0c1f3d6-2c78-48b5-8119-97420be3f82e tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:03:56.539327 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c0c1f3d6-2c78-48b5-8119-97420be3f82e tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: b6942f26-7967-4574-9f6e-9a42a7c66a3b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:56.570744 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-637fc776-d16b-4776-8d7a-66d7a70f6435 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:03:56.572571 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-637fc776-d16b-4776-8d7a-66d7a70f6435 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:56.594885 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-637fc776-d16b-4776-8d7a-66d7a70f6435 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:56.595745 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-637fc776-d16b-4776-8d7a-66d7a70f6435 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:56.602321 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-637fc776-d16b-4776-8d7a-66d7a70f6435 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:56.602804 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-637fc776-d16b-4776-8d7a-66d7a70f6435 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:56.675820 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-637fc776-d16b-4776-8d7a-66d7a70f6435 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.108694 Jan 15 21:03:56.676689 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2394/4794] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:03:56 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:03:56.700170 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-c0c1f3d6-2c78-48b5-8119-97420be3f82e tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb3421bc9494914bc5f797b15a55643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31af2a6b9424f168dd6084d8d5fd0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:03:56.708544 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c0c1f3d6-2c78-48b5-8119-97420be3f82e tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/b6942f26-7967-4574-9f6e-9a42a7c66a3b" status: 200 len: 1208 microversion: 2.1 time: 0.174323 Jan 15 21:03:56.709538 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2401/4795] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:03:56 2022] GET /compute/v2.1/servers/b6942f26-7967-4574-9f6e-9a42a7c66a3b => generated 1208 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:03:56.742705 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-77f161e3-cf28-4610-965a-5d89a7b672fd tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:03:56.743599 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-77f161e3-cf28-4610-965a-5d89a7b672fd tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:56.768782 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-77f161e3-cf28-4610-965a-5d89a7b672fd tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:56.769368 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-77f161e3-cf28-4610-965a-5d89a7b672fd tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:56.770177 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-77f161e3-cf28-4610-965a-5d89a7b672fd tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:56.770612 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-77f161e3-cf28-4610-965a-5d89a7b672fd tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:56.828810 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-77f161e3-cf28-4610-965a-5d89a7b672fd tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.099309 Jan 15 21:03:56.829878 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2395/4796] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:03:56 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:03:57.434561 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-fcb9bb40-88a5-4c62-bf80-a38181022b8e tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:03:57.436703 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-fcb9bb40-88a5-4c62-bf80-a38181022b8e tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:57.445893 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fcb9bb40-88a5-4c62-bf80-a38181022b8e tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:57.447293 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fcb9bb40-88a5-4c62-bf80-a38181022b8e tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:57.448556 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fcb9bb40-88a5-4c62-bf80-a38181022b8e tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:57.449368 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fcb9bb40-88a5-4c62-bf80-a38181022b8e tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:57.690488 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ddaa132e-2997-4fc8-9666-772a7f666250 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:03:57.693328 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ddaa132e-2997-4fc8-9666-772a7f666250 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:57.714033 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ddaa132e-2997-4fc8-9666-772a7f666250 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:57.715566 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ddaa132e-2997-4fc8-9666-772a7f666250 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:57.718421 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ddaa132e-2997-4fc8-9666-772a7f666250 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:57.719068 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ddaa132e-2997-4fc8-9666-772a7f666250 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:57.817458 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ddaa132e-2997-4fc8-9666-772a7f666250 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.132928 Jan 15 21:03:57.821904 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2396/4797] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:03:57 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:03:57.834067 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-be31871d-9a00-447c-984c-30a7e361011a tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:03:57.835087 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-be31871d-9a00-447c-984c-30a7e361011a tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: b6942f26-7967-4574-9f6e-9a42a7c66a3b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:57.861169 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-be31871d-9a00-447c-984c-30a7e361011a tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:57.861622 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-be31871d-9a00-447c-984c-30a7e361011a tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:57.862437 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-be31871d-9a00-447c-984c-30a7e361011a tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:57.863467 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-be31871d-9a00-447c-984c-30a7e361011a tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:58.017493 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-fcb9bb40-88a5-4c62-bf80-a38181022b8e tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6097506a2d4e36818310d9d70bf01b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4dad65fccfe481a973f5fcbb9287dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:03:58.026459 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-fcb9bb40-88a5-4c62-bf80-a38181022b8e tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "GET /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a" status: 200 len: 1675 microversion: 2.1 time: 0.595590 Jan 15 21:03:58.030894 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2402/4798] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:03:57 2022] GET /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a => generated 1675 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:03:58.040831 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1224ed73-5fbb-4f9a-a58f-2b82f3d8b0a8 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:03:58.042084 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-1224ed73-5fbb-4f9a-a58f-2b82f3d8b0a8 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:58.054471 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1224ed73-5fbb-4f9a-a58f-2b82f3d8b0a8 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:58.055034 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1224ed73-5fbb-4f9a-a58f-2b82f3d8b0a8 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:58.056309 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1224ed73-5fbb-4f9a-a58f-2b82f3d8b0a8 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:58.056819 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1224ed73-5fbb-4f9a-a58f-2b82f3d8b0a8 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:58.104632 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-be31871d-9a00-447c-984c-30a7e361011a tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb3421bc9494914bc5f797b15a55643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31af2a6b9424f168dd6084d8d5fd0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:03:58.119495 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-be31871d-9a00-447c-984c-30a7e361011a tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/b6942f26-7967-4574-9f6e-9a42a7c66a3b" status: 200 len: 1278 microversion: 2.1 time: 0.297323 Jan 15 21:03:58.121525 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2397/4799] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:03:57 2022] GET /compute/v2.1/servers/b6942f26-7967-4574-9f6e-9a42a7c66a3b => generated 1278 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:03:58.124706 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-1224ed73-5fbb-4f9a-a58f-2b82f3d8b0a8 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.091892 Jan 15 21:03:58.129541 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2403/4800] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:03:58 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:03:58.832922 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-837d0dad-1de6-4165-9ea5-c954430ed132 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:03:58.835208 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-837d0dad-1de6-4165-9ea5-c954430ed132 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:58.853896 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-837d0dad-1de6-4165-9ea5-c954430ed132 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:58.854633 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-837d0dad-1de6-4165-9ea5-c954430ed132 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:58.855588 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-837d0dad-1de6-4165-9ea5-c954430ed132 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:58.856249 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-837d0dad-1de6-4165-9ea5-c954430ed132 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:58.942284 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-837d0dad-1de6-4165-9ea5-c954430ed132 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.114192 Jan 15 21:03:58.943241 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2398/4801] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:03:58 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:03:59.050083 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-de68e41f-d597-431d-9a43-a8607cc41bb5 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:03:59.051418 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-de68e41f-d597-431d-9a43-a8607cc41bb5 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:59.060958 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-de68e41f-d597-431d-9a43-a8607cc41bb5 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:59.061662 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-de68e41f-d597-431d-9a43-a8607cc41bb5 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:59.062566 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-de68e41f-d597-431d-9a43-a8607cc41bb5 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:59.063102 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-de68e41f-d597-431d-9a43-a8607cc41bb5 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:59.138533 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-0a520c5a-4184-4a0e-b2e9-b8cd79d777c9 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:03:59.139819 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-0a520c5a-4184-4a0e-b2e9-b8cd79d777c9 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:59.166817 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0a520c5a-4184-4a0e-b2e9-b8cd79d777c9 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:59.168240 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0a520c5a-4184-4a0e-b2e9-b8cd79d777c9 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:59.175006 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0a520c5a-4184-4a0e-b2e9-b8cd79d777c9 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:59.178541 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0a520c5a-4184-4a0e-b2e9-b8cd79d777c9 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:59.306583 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-0a520c5a-4184-4a0e-b2e9-b8cd79d777c9 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.173103 Jan 15 21:03:59.308115 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2399/4802] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:03:59 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:03:59.322216 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-426b1496-ad8d-4eb5-9c49-478b101197ee tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:03:59.322983 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-426b1496-ad8d-4eb5-9c49-478b101197ee tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: b6942f26-7967-4574-9f6e-9a42a7c66a3b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:59.347786 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-426b1496-ad8d-4eb5-9c49-478b101197ee tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:59.348255 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-426b1496-ad8d-4eb5-9c49-478b101197ee tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:59.349130 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-426b1496-ad8d-4eb5-9c49-478b101197ee tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:59.349551 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-426b1496-ad8d-4eb5-9c49-478b101197ee tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:59.432045 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-de68e41f-d597-431d-9a43-a8607cc41bb5 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6097506a2d4e36818310d9d70bf01b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4dad65fccfe481a973f5fcbb9287dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:03:59.441331 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-de68e41f-d597-431d-9a43-a8607cc41bb5 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "GET /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a" status: 200 len: 1675 microversion: 2.1 time: 0.396467 Jan 15 21:03:59.453512 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2404/4803] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:03:59 2022] GET /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a => generated 1675 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:03:59.697717 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-426b1496-ad8d-4eb5-9c49-478b101197ee tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb3421bc9494914bc5f797b15a55643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31af2a6b9424f168dd6084d8d5fd0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:03:59.707894 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-426b1496-ad8d-4eb5-9c49-478b101197ee tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/b6942f26-7967-4574-9f6e-9a42a7c66a3b" status: 200 len: 1308 microversion: 2.1 time: 0.398330 Jan 15 21:03:59.709039 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2400/4804] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:03:59 2022] GET /compute/v2.1/servers/b6942f26-7967-4574-9f6e-9a42a7c66a3b => generated 1308 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:03:59.956090 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4d6e39fe-1442-4132-9412-665346374c8c tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:03:59.957104 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-4d6e39fe-1442-4132-9412-665346374c8c tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:03:59.964539 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4d6e39fe-1442-4132-9412-665346374c8c tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:59.965001 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4d6e39fe-1442-4132-9412-665346374c8c tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:03:59.966642 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4d6e39fe-1442-4132-9412-665346374c8c tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:03:59.967246 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4d6e39fe-1442-4132-9412-665346374c8c tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:00.026451 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-4d6e39fe-1442-4132-9412-665346374c8c tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.074364 Jan 15 21:04:00.030172 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2405/4805] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:03:59 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:04:00.272444 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-9d5ed50a-1469-4fac-837e-d9286ccf544f req-f67bd4cb-d1f4-4373-b7dd-cea69a64f31f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6942f26-7967-4574-9f6e-9a42a7c66a3b", "tag": "74176096-39ea-4345-a38f-44719ca01a50"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:00.275917 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:04:00.275917 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:04:00.299528 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-9d5ed50a-1469-4fac-837e-d9286ccf544f req-f67bd4cb-d1f4-4373-b7dd-cea69a64f31f service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:00.300388 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-9d5ed50a-1469-4fac-837e-d9286ccf544f req-f67bd4cb-d1f4-4373-b7dd-cea69a64f31f service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:00.313432 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-9d5ed50a-1469-4fac-837e-d9286ccf544f req-f67bd4cb-d1f4-4373-b7dd-cea69a64f31f service nova] Creating event network-changed:74176096-39ea-4345-a38f-44719ca01a50 for instance b6942f26-7967-4574-9f6e-9a42a7c66a3b on nch2-master-1 Jan 15 21:04:00.322644 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-2c1ce815-5108-44a8-ae9e-aebfa9e1ff3b tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:00.324898 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-2c1ce815-5108-44a8-ae9e-aebfa9e1ff3b tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:00.340168 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-9d5ed50a-1469-4fac-837e-d9286ccf544f req-f67bd4cb-d1f4-4373-b7dd-cea69a64f31f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072693 Jan 15 21:04:00.342020 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2401/4806] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:04:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 21:04:00.342913 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2c1ce815-5108-44a8-ae9e-aebfa9e1ff3b tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:00.343593 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2c1ce815-5108-44a8-ae9e-aebfa9e1ff3b tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:00.344611 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2c1ce815-5108-44a8-ae9e-aebfa9e1ff3b tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:00.346034 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2c1ce815-5108-44a8-ae9e-aebfa9e1ff3b tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:00.410920 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-2c1ce815-5108-44a8-ae9e-aebfa9e1ff3b tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.095301 Jan 15 21:04:00.412178 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2406/4807] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:00 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:04:00.464695 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a2385ad1-4fea-4225-b1fe-1bb7f41b08d6 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:04:00.466084 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a2385ad1-4fea-4225-b1fe-1bb7f41b08d6 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:00.476435 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a2385ad1-4fea-4225-b1fe-1bb7f41b08d6 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:00.476975 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a2385ad1-4fea-4225-b1fe-1bb7f41b08d6 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:00.477992 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a2385ad1-4fea-4225-b1fe-1bb7f41b08d6 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:00.479331 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a2385ad1-4fea-4225-b1fe-1bb7f41b08d6 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:00.726942 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-a2385ad1-4fea-4225-b1fe-1bb7f41b08d6 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6097506a2d4e36818310d9d70bf01b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4dad65fccfe481a973f5fcbb9287dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:00.728589 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-63b4d1da-a6c8-45dd-a6cc-cdd41061b407 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:04:00.729331 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-63b4d1da-a6c8-45dd-a6cc-cdd41061b407 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: b6942f26-7967-4574-9f6e-9a42a7c66a3b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:00.736733 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a2385ad1-4fea-4225-b1fe-1bb7f41b08d6 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "GET /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a" status: 200 len: 1675 microversion: 2.1 time: 0.280396 Jan 15 21:04:00.737782 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2402/4808] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:04:00 2022] GET /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a => generated 1675 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:04:00.754734 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-63b4d1da-a6c8-45dd-a6cc-cdd41061b407 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:00.755190 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-63b4d1da-a6c8-45dd-a6cc-cdd41061b407 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:00.755993 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-63b4d1da-a6c8-45dd-a6cc-cdd41061b407 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:00.761387 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-63b4d1da-a6c8-45dd-a6cc-cdd41061b407 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:00.942227 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-4fba5313-4d91-4cdc-b6be-16c32b50c2f1 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:04:00.942984 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-4fba5313-4d91-4cdc-b6be-16c32b50c2f1 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:00.952287 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4fba5313-4d91-4cdc-b6be-16c32b50c2f1 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:00.953107 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4fba5313-4d91-4cdc-b6be-16c32b50c2f1 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:00.954094 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4fba5313-4d91-4cdc-b6be-16c32b50c2f1 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:00.954830 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4fba5313-4d91-4cdc-b6be-16c32b50c2f1 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:00.997998 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-4fba5313-4d91-4cdc-b6be-16c32b50c2f1 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/os-volume_attachments/0cd4da7e-0abd-4d64-b27e-2f3b80099824" status: 200 len: 194 microversion: 2.20 time: 0.058553 Jan 15 21:04:01.000535 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2403/4809] 10.222.0.46 () {60 vars in 1453 bytes} [Sat Jan 15 21:04:00 2022] GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/os-volume_attachments/0cd4da7e-0abd-4d64-b27e-2f3b80099824 => generated 194 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:04:01.042646 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-141acd74-3b3b-490b-8962-3c83aeae1e49 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:01.045220 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-141acd74-3b3b-490b-8962-3c83aeae1e49 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:01.066389 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-141acd74-3b3b-490b-8962-3c83aeae1e49 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:01.066704 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-141acd74-3b3b-490b-8962-3c83aeae1e49 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:01.067693 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-141acd74-3b3b-490b-8962-3c83aeae1e49 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:01.068141 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-141acd74-3b3b-490b-8962-3c83aeae1e49 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:01.071465 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-63b4d1da-a6c8-45dd-a6cc-cdd41061b407 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb3421bc9494914bc5f797b15a55643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31af2a6b9424f168dd6084d8d5fd0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:01.109220 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-63b4d1da-a6c8-45dd-a6cc-cdd41061b407 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/b6942f26-7967-4574-9f6e-9a42a7c66a3b" status: 200 len: 1308 microversion: 2.1 time: 0.368593 Jan 15 21:04:01.111144 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2407/4810] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:04:00 2022] GET /compute/v2.1/servers/b6942f26-7967-4574-9f6e-9a42a7c66a3b => generated 1308 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:04:01.128118 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-141acd74-3b3b-490b-8962-3c83aeae1e49 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.091322 Jan 15 21:04:01.134897 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2404/4811] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:01 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:04:01.136238 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8987df5d-0642-4ecd-87fd-7a790b4d8628 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:04:01.137090 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-8987df5d-0642-4ecd-87fd-7a790b4d8628 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:01.148501 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8987df5d-0642-4ecd-87fd-7a790b4d8628 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:01.149123 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8987df5d-0642-4ecd-87fd-7a790b4d8628 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:01.151426 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8987df5d-0642-4ecd-87fd-7a790b4d8628 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:01.153857 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8987df5d-0642-4ecd-87fd-7a790b4d8628 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:01.268518 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.objects.instance [None req-8987df5d-0642-4ecd-87fd-7a790b4d8628 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lazy-loading 'services' on Instance uuid 0ac722a3-aadf-4791-b5b1-e5e5efebddc0 {{(pid=129366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 21:04:01.364590 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-8987df5d-0642-4ecd-87fd-7a790b4d8628 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "DELETE /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/os-volume_attachments/0cd4da7e-0abd-4d64-b27e-2f3b80099824" status: 202 len: 0 microversion: 2.20 time: 0.233658 Jan 15 21:04:01.369086 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2408/4812] 10.222.0.46 () {60 vars in 1456 bytes} [Sat Jan 15 21:04:01 2022] DELETE /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/os-volume_attachments/0cd4da7e-0abd-4d64-b27e-2f3b80099824 => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 15 21:04:01.395790 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-212eb204-215a-4c42-8d33-5ca005cd9510 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:04:01.396826 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-212eb204-215a-4c42-8d33-5ca005cd9510 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:01.424018 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-212eb204-215a-4c42-8d33-5ca005cd9510 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:01.424411 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-212eb204-215a-4c42-8d33-5ca005cd9510 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:01.425662 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-452ef3f6-5807-4844-b0fb-5e1428814715 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:01.426976 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-452ef3f6-5807-4844-b0fb-5e1428814715 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:01.433885 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-452ef3f6-5807-4844-b0fb-5e1428814715 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:01.435392 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-452ef3f6-5807-4844-b0fb-5e1428814715 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:01.436658 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-452ef3f6-5807-4844-b0fb-5e1428814715 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:01.437249 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-212eb204-215a-4c42-8d33-5ca005cd9510 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:01.437534 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-452ef3f6-5807-4844-b0fb-5e1428814715 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:01.442158 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-212eb204-215a-4c42-8d33-5ca005cd9510 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:01.491804 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-212eb204-215a-4c42-8d33-5ca005cd9510 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.119672 Jan 15 21:04:01.492526 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2405/4813] 10.222.0.46 () {60 vars in 1342 bytes} [Sat Jan 15 21:04:01 2022] GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/os-volume_attachments => generated 197 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:04:01.528173 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-452ef3f6-5807-4844-b0fb-5e1428814715 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.107260 Jan 15 21:04:01.534607 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2409/4814] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:01 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:04:01.759358 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-fac48e4f-414e-40c6-a9f8-f6716df27fcb tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:04:01.759966 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-fac48e4f-414e-40c6-a9f8-f6716df27fcb tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:01.766687 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fac48e4f-414e-40c6-a9f8-f6716df27fcb tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:01.767156 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fac48e4f-414e-40c6-a9f8-f6716df27fcb tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:01.767959 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fac48e4f-414e-40c6-a9f8-f6716df27fcb tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:01.768401 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fac48e4f-414e-40c6-a9f8-f6716df27fcb tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:02.055044 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-fac48e4f-414e-40c6-a9f8-f6716df27fcb tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6097506a2d4e36818310d9d70bf01b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4dad65fccfe481a973f5fcbb9287dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:02.068874 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-fac48e4f-414e-40c6-a9f8-f6716df27fcb tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "GET /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a" status: 200 len: 1675 microversion: 2.1 time: 0.312638 Jan 15 21:04:02.076977 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2406/4815] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:04:01 2022] GET /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a => generated 1675 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:04:02.133452 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-2802d358-baf5-4d87-8895-391a921040f0 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:04:02.135081 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-2802d358-baf5-4d87-8895-391a921040f0 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: b6942f26-7967-4574-9f6e-9a42a7c66a3b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:02.142483 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b74786ae-175c-4c58-b5c0-3753c730f67e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:02.143405 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b74786ae-175c-4c58-b5c0-3753c730f67e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:02.150312 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2802d358-baf5-4d87-8895-391a921040f0 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:02.151479 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2802d358-baf5-4d87-8895-391a921040f0 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:02.153624 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2802d358-baf5-4d87-8895-391a921040f0 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:02.154935 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2802d358-baf5-4d87-8895-391a921040f0 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:02.155106 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b74786ae-175c-4c58-b5c0-3753c730f67e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:02.159206 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b74786ae-175c-4c58-b5c0-3753c730f67e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:02.160946 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b74786ae-175c-4c58-b5c0-3753c730f67e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:02.161408 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b74786ae-175c-4c58-b5c0-3753c730f67e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:02.250584 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b74786ae-175c-4c58-b5c0-3753c730f67e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.113208 Jan 15 21:04:02.255523 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2407/4816] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:02 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:04:02.385444 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-2802d358-baf5-4d87-8895-391a921040f0 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb3421bc9494914bc5f797b15a55643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31af2a6b9424f168dd6084d8d5fd0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:02.393544 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-2802d358-baf5-4d87-8895-391a921040f0 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/b6942f26-7967-4574-9f6e-9a42a7c66a3b" status: 200 len: 1308 microversion: 2.1 time: 0.267599 Jan 15 21:04:02.394684 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2410/4817] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:04:02 2022] GET /compute/v2.1/servers/b6942f26-7967-4574-9f6e-9a42a7c66a3b => generated 1308 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:04:02.508916 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2134cedf-6e10-4f79-b2e8-fa05aead5c3c tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:04:02.510130 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-2134cedf-6e10-4f79-b2e8-fa05aead5c3c tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:02.518116 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2134cedf-6e10-4f79-b2e8-fa05aead5c3c tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:02.518569 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2134cedf-6e10-4f79-b2e8-fa05aead5c3c tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:02.519501 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2134cedf-6e10-4f79-b2e8-fa05aead5c3c tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:02.519947 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2134cedf-6e10-4f79-b2e8-fa05aead5c3c tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:02.545027 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1960be48-a22f-420d-a31d-c8ea258fc68f tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:02.545948 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-1960be48-a22f-420d-a31d-c8ea258fc68f tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:02.556272 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1960be48-a22f-420d-a31d-c8ea258fc68f tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:02.556722 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1960be48-a22f-420d-a31d-c8ea258fc68f tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:02.560253 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2134cedf-6e10-4f79-b2e8-fa05aead5c3c tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.059106 Jan 15 21:04:02.561337 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1960be48-a22f-420d-a31d-c8ea258fc68f tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:02.561471 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2408/4818] 10.222.0.46 () {60 vars in 1342 bytes} [Sat Jan 15 21:04:02 2022] GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:04:02.562062 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1960be48-a22f-420d-a31d-c8ea258fc68f tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:02.621846 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-1960be48-a22f-420d-a31d-c8ea258fc68f tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.082468 Jan 15 21:04:02.626940 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2411/4819] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:02 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:04:02.646904 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9d1f7e0a-7486-41b3-82a5-4762f0052585 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:04:02.647575 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-9d1f7e0a-7486-41b3-82a5-4762f0052585 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:02.654740 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9d1f7e0a-7486-41b3-82a5-4762f0052585 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:02.655984 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9d1f7e0a-7486-41b3-82a5-4762f0052585 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:02.657122 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9d1f7e0a-7486-41b3-82a5-4762f0052585 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:02.657955 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9d1f7e0a-7486-41b3-82a5-4762f0052585 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:02.692717 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-9d1f7e0a-7486-41b3-82a5-4762f0052585 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Going to try to terminate instance {{(pid=129365) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 21:04:02.812542 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-9d1f7e0a-7486-41b3-82a5-4762f0052585 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "DELETE /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0" status: 204 len: 0 microversion: 2.20 time: 0.174318 Jan 15 21:04:02.816617 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2409/4820] 10.222.0.46 () {60 vars in 1279 bytes} [Sat Jan 15 21:04:02 2022] DELETE /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 15 21:04:02.825761 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-aca689da-59e7-4b65-9dbf-b3362573aca1 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:04:02.827033 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-aca689da-59e7-4b65-9dbf-b3362573aca1 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:02.838652 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-aca689da-59e7-4b65-9dbf-b3362573aca1 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:02.839493 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-aca689da-59e7-4b65-9dbf-b3362573aca1 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:02.844402 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-aca689da-59e7-4b65-9dbf-b3362573aca1 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:02.845108 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-aca689da-59e7-4b65-9dbf-b3362573aca1 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:03.094958 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-eb97f40c-9cb9-4c7e-af7d-c799f60d7909 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:04:03.095645 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-eb97f40c-9cb9-4c7e-af7d-c799f60d7909 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:03.115778 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-eb97f40c-9cb9-4c7e-af7d-c799f60d7909 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:03.116802 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-aca689da-59e7-4b65-9dbf-b3362573aca1 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:03.116960 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-eb97f40c-9cb9-4c7e-af7d-c799f60d7909 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:03.119551 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-eb97f40c-9cb9-4c7e-af7d-c799f60d7909 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:03.120261 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-eb97f40c-9cb9-4c7e-af7d-c799f60d7909 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:03.129380 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-aca689da-59e7-4b65-9dbf-b3362573aca1 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:03.130934 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-aca689da-59e7-4b65-9dbf-b3362573aca1 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:03.132147 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-aca689da-59e7-4b65-9dbf-b3362573aca1 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0" status: 200 len: 1721 microversion: 2.20 time: 0.313619 Jan 15 21:04:03.132720 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2412/4821] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:04:02 2022] GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0 => generated 1721 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 15 21:04:03.275963 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f69146cc-b3ca-4990-b4c5-1ca9abdf24ca tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:03.277016 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f69146cc-b3ca-4990-b4c5-1ca9abdf24ca tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:03.289448 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f69146cc-b3ca-4990-b4c5-1ca9abdf24ca tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:03.291545 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f69146cc-b3ca-4990-b4c5-1ca9abdf24ca tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:03.294905 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f69146cc-b3ca-4990-b4c5-1ca9abdf24ca tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:03.295803 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f69146cc-b3ca-4990-b4c5-1ca9abdf24ca tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:03.395343 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f69146cc-b3ca-4990-b4c5-1ca9abdf24ca tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.122915 Jan 15 21:04:03.403000 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2413/4822] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:03 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:04:03.422413 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-feb3a225-389b-4013-a083-e6c3fd8035e7 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:04:03.424247 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-feb3a225-389b-4013-a083-e6c3fd8035e7 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: b6942f26-7967-4574-9f6e-9a42a7c66a3b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:03.441878 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-feb3a225-389b-4013-a083-e6c3fd8035e7 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:03.442878 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-feb3a225-389b-4013-a083-e6c3fd8035e7 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:03.445763 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-feb3a225-389b-4013-a083-e6c3fd8035e7 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:03.446799 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-feb3a225-389b-4013-a083-e6c3fd8035e7 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:03.555990 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-eb97f40c-9cb9-4c7e-af7d-c799f60d7909 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6097506a2d4e36818310d9d70bf01b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4dad65fccfe481a973f5fcbb9287dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:03.566553 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-eb97f40c-9cb9-4c7e-af7d-c799f60d7909 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "GET /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a" status: 200 len: 1675 microversion: 2.1 time: 0.476114 Jan 15 21:04:03.568345 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2410/4823] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:04:03 2022] GET /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a => generated 1675 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:04:03.635251 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a3babc4f-a652-4795-a96e-0d80c7d3bfba tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:03.641287 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a3babc4f-a652-4795-a96e-0d80c7d3bfba tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:03.650710 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a3babc4f-a652-4795-a96e-0d80c7d3bfba tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:03.651163 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a3babc4f-a652-4795-a96e-0d80c7d3bfba tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:03.652221 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a3babc4f-a652-4795-a96e-0d80c7d3bfba tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:03.652659 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a3babc4f-a652-4795-a96e-0d80c7d3bfba tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:03.718081 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-feb3a225-389b-4013-a083-e6c3fd8035e7 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb3421bc9494914bc5f797b15a55643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31af2a6b9424f168dd6084d8d5fd0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:03.726526 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-feb3a225-389b-4013-a083-e6c3fd8035e7 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/b6942f26-7967-4574-9f6e-9a42a7c66a3b" status: 200 len: 1308 microversion: 2.1 time: 0.317987 Jan 15 21:04:03.728992 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a3babc4f-a652-4795-a96e-0d80c7d3bfba tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.097747 Jan 15 21:04:03.735339 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2411/4824] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:03 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:04:03.735839 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2414/4825] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:04:03 2022] GET /compute/v2.1/servers/b6942f26-7967-4574-9f6e-9a42a7c66a3b => generated 1308 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:04:04.156560 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-79b4ff74-4140-4d67-bf0d-6643a54a5ada tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:04:04.157824 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-79b4ff74-4140-4d67-bf0d-6643a54a5ada tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:04.169355 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-79b4ff74-4140-4d67-bf0d-6643a54a5ada tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:04.170215 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-79b4ff74-4140-4d67-bf0d-6643a54a5ada tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:04.171524 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-79b4ff74-4140-4d67-bf0d-6643a54a5ada tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:04.172604 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-79b4ff74-4140-4d67-bf0d-6643a54a5ada tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:04.390772 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-79b4ff74-4140-4d67-bf0d-6643a54a5ada tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:04.400352 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-79b4ff74-4140-4d67-bf0d-6643a54a5ada tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:04.403088 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-79b4ff74-4140-4d67-bf0d-6643a54a5ada tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:04.405195 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-79b4ff74-4140-4d67-bf0d-6643a54a5ada tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0" status: 200 len: 1721 microversion: 2.20 time: 0.257036 Jan 15 21:04:04.413880 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-852389b6-8048-47c7-9a7e-b6d99e697716 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:04.415647 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-852389b6-8048-47c7-9a7e-b6d99e697716 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:04.417910 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2412/4826] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:04:04 2022] GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0 => generated 1721 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 15 21:04:04.444594 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-852389b6-8048-47c7-9a7e-b6d99e697716 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:04.446539 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-852389b6-8048-47c7-9a7e-b6d99e697716 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:04.448468 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-852389b6-8048-47c7-9a7e-b6d99e697716 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:04.448938 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-852389b6-8048-47c7-9a7e-b6d99e697716 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:04.514194 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-852389b6-8048-47c7-9a7e-b6d99e697716 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.106422 Jan 15 21:04:04.516518 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2415/4827] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:04 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:04:04.587142 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-fab91e58-f3c6-4e54-9ca3-2deae68aebde tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:04:04.587937 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-fab91e58-f3c6-4e54-9ca3-2deae68aebde tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:04.602416 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fab91e58-f3c6-4e54-9ca3-2deae68aebde tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:04.602879 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fab91e58-f3c6-4e54-9ca3-2deae68aebde tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:04.604092 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fab91e58-f3c6-4e54-9ca3-2deae68aebde tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:04.604818 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fab91e58-f3c6-4e54-9ca3-2deae68aebde tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:04.746456 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-cb4dbc60-37fb-4e29-8480-471d28b3d0e3 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:04:04.747989 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-cb4dbc60-37fb-4e29-8480-471d28b3d0e3 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: b6942f26-7967-4574-9f6e-9a42a7c66a3b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:04.766658 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cb4dbc60-37fb-4e29-8480-471d28b3d0e3 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:04.767129 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cb4dbc60-37fb-4e29-8480-471d28b3d0e3 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:04.771615 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cb4dbc60-37fb-4e29-8480-471d28b3d0e3 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:04.772110 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cb4dbc60-37fb-4e29-8480-471d28b3d0e3 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:04.878395 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-fab91e58-f3c6-4e54-9ca3-2deae68aebde tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6097506a2d4e36818310d9d70bf01b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4dad65fccfe481a973f5fcbb9287dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:04.888446 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-fab91e58-f3c6-4e54-9ca3-2deae68aebde tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "GET /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a" status: 200 len: 1675 microversion: 2.1 time: 0.305835 Jan 15 21:04:04.891805 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2413/4828] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:04:04 2022] GET /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a => generated 1675 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:04:04.910232 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-774d1d13-2f85-4743-b8a9-71551caad088 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:04.911516 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-774d1d13-2f85-4743-b8a9-71551caad088 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:04.922600 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-774d1d13-2f85-4743-b8a9-71551caad088 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:04.923908 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-774d1d13-2f85-4743-b8a9-71551caad088 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:04.925423 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-774d1d13-2f85-4743-b8a9-71551caad088 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:04.926611 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-774d1d13-2f85-4743-b8a9-71551caad088 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:04.993406 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-774d1d13-2f85-4743-b8a9-71551caad088 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.089530 Jan 15 21:04:04.994121 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2414/4829] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:04 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:04:05.075584 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-cb4dbc60-37fb-4e29-8480-471d28b3d0e3 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb3421bc9494914bc5f797b15a55643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31af2a6b9424f168dd6084d8d5fd0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:05.084699 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-cb4dbc60-37fb-4e29-8480-471d28b3d0e3 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/b6942f26-7967-4574-9f6e-9a42a7c66a3b" status: 200 len: 1308 microversion: 2.1 time: 0.341721 Jan 15 21:04:05.094607 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2416/4830] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:04:04 2022] GET /compute/v2.1/servers/b6942f26-7967-4574-9f6e-9a42a7c66a3b => generated 1308 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:04:05.426443 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a7059d15-8db3-402a-9756-4c4604d461c7 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:04:05.427144 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a7059d15-8db3-402a-9756-4c4604d461c7 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:05.434760 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a7059d15-8db3-402a-9756-4c4604d461c7 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:05.435479 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-2c6d0a29-1104-403c-be96-a1ae104fa192 req-a9071643-dabf-4f87-9400-6b3e0911f9a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6942f26-7967-4574-9f6e-9a42a7c66a3b", "name": "network-vif-plugged", "status": "completed", "tag": "74176096-39ea-4345-a38f-44719ca01a50"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:05.436751 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a7059d15-8db3-402a-9756-4c4604d461c7 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:05.437253 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:04:05.437253 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:04:05.438002 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a7059d15-8db3-402a-9756-4c4604d461c7 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:05.438605 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a7059d15-8db3-402a-9756-4c4604d461c7 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:05.457816 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-2c6d0a29-1104-403c-be96-a1ae104fa192 req-a9071643-dabf-4f87-9400-6b3e0911f9a0 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:05.458264 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-2c6d0a29-1104-403c-be96-a1ae104fa192 req-a9071643-dabf-4f87-9400-6b3e0911f9a0 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:05.492137 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-2c6d0a29-1104-403c-be96-a1ae104fa192 req-a9071643-dabf-4f87-9400-6b3e0911f9a0 service nova] Creating event network-vif-plugged:74176096-39ea-4345-a38f-44719ca01a50 for instance b6942f26-7967-4574-9f6e-9a42a7c66a3b on nch2-master-1 Jan 15 21:04:05.503231 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-2c6d0a29-1104-403c-be96-a1ae104fa192 req-a9071643-dabf-4f87-9400-6b3e0911f9a0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073212 Jan 15 21:04:05.505981 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2417/4831] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:04:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 21:04:05.543040 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-cb90c45a-8b43-4e40-a8e2-4e2577ca26dc tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:05.545251 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-cb90c45a-8b43-4e40-a8e2-4e2577ca26dc tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:05.555265 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cb90c45a-8b43-4e40-a8e2-4e2577ca26dc tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:05.555989 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cb90c45a-8b43-4e40-a8e2-4e2577ca26dc tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:05.564381 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cb90c45a-8b43-4e40-a8e2-4e2577ca26dc tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:05.570129 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cb90c45a-8b43-4e40-a8e2-4e2577ca26dc tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:05.641836 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-cb90c45a-8b43-4e40-a8e2-4e2577ca26dc tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.110928 Jan 15 21:04:05.643290 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2418/4832] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:05 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:04:05.663814 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-a7059d15-8db3-402a-9756-4c4604d461c7 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:05.677374 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-a7059d15-8db3-402a-9756-4c4604d461c7 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:05.679849 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-a7059d15-8db3-402a-9756-4c4604d461c7 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:05.681638 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a7059d15-8db3-402a-9756-4c4604d461c7 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0" status: 200 len: 1721 microversion: 2.20 time: 0.258865 Jan 15 21:04:05.682693 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2415/4833] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:04:05 2022] GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0 => generated 1721 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 15 21:04:05.909281 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-22b8ec11-89eb-4800-98ca-7d61084f1a18 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:04:05.911568 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-22b8ec11-89eb-4800-98ca-7d61084f1a18 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:05.928677 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-22b8ec11-89eb-4800-98ca-7d61084f1a18 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:05.930653 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-22b8ec11-89eb-4800-98ca-7d61084f1a18 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:05.932554 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-22b8ec11-89eb-4800-98ca-7d61084f1a18 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:05.934704 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-22b8ec11-89eb-4800-98ca-7d61084f1a18 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:06.006123 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a9064629-b20f-433a-be32-9078e7734730 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:06.007067 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a9064629-b20f-433a-be32-9078e7734730 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:06.022901 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a9064629-b20f-433a-be32-9078e7734730 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:06.023621 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a9064629-b20f-433a-be32-9078e7734730 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:06.029588 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a9064629-b20f-433a-be32-9078e7734730 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:06.029928 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a9064629-b20f-433a-be32-9078e7734730 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:06.102944 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a9064629-b20f-433a-be32-9078e7734730 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.099136 Jan 15 21:04:06.109980 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2416/4834] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:06 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:04:06.117290 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2e3dc3cc-011f-4b22-9935-397985d1542d tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:04:06.118757 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-2e3dc3cc-011f-4b22-9935-397985d1542d tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: b6942f26-7967-4574-9f6e-9a42a7c66a3b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:06.135770 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2e3dc3cc-011f-4b22-9935-397985d1542d tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:06.136237 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2e3dc3cc-011f-4b22-9935-397985d1542d tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:06.137316 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2e3dc3cc-011f-4b22-9935-397985d1542d tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:06.139280 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2e3dc3cc-011f-4b22-9935-397985d1542d tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:06.333270 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-22b8ec11-89eb-4800-98ca-7d61084f1a18 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6097506a2d4e36818310d9d70bf01b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4dad65fccfe481a973f5fcbb9287dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:06.354020 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-22b8ec11-89eb-4800-98ca-7d61084f1a18 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "GET /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a" status: 200 len: 1652 microversion: 2.1 time: 0.449182 Jan 15 21:04:06.354611 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2419/4835] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:04:05 2022] GET /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a => generated 1652 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:04:06.359828 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-66679d42-3a2f-4e9f-8495-bb54357864c9 req-7f98604c-58f0-40a3-925c-f416e464be9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ac722a3-aadf-4791-b5b1-e5e5efebddc0", "name": "network-vif-deleted", "tag": "6d958b2a-aaab-40bf-8bb7-ce4cd3fc57b5"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:06.364436 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:04:06.364436 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:04:06.384540 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-66679d42-3a2f-4e9f-8495-bb54357864c9 req-7f98604c-58f0-40a3-925c-f416e464be9e service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:06.389105 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-66679d42-3a2f-4e9f-8495-bb54357864c9 req-7f98604c-58f0-40a3-925c-f416e464be9e service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:06.413780 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-66679d42-3a2f-4e9f-8495-bb54357864c9 req-7f98604c-58f0-40a3-925c-f416e464be9e service nova] Creating event network-vif-deleted:6d958b2a-aaab-40bf-8bb7-ce4cd3fc57b5 for instance 0ac722a3-aadf-4791-b5b1-e5e5efebddc0 on nch2-master-1 Jan 15 21:04:06.445479 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-66679d42-3a2f-4e9f-8495-bb54357864c9 req-7f98604c-58f0-40a3-925c-f416e464be9e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086697 Jan 15 21:04:06.446156 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2420/4836] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:04:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:04:06.462981 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1294ede5-7f62-45cc-931f-12f34c5b7b81 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:06.491366 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1294ede5-7f62-45cc-931f-12f34c5b7b81 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:06.491865 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1294ede5-7f62-45cc-931f-12f34c5b7b81 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:06.564748 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-2e3dc3cc-011f-4b22-9935-397985d1542d tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb3421bc9494914bc5f797b15a55643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31af2a6b9424f168dd6084d8d5fd0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:06.585805 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-1294ede5-7f62-45cc-931f-12f34c5b7b81 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Going to try to start instance {{(pid=129366) start /opt/stack/nova/nova/compute/api.py:2677}} Jan 15 21:04:06.596618 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2e3dc3cc-011f-4b22-9935-397985d1542d tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/b6942f26-7967-4574-9f6e-9a42a7c66a3b" status: 200 len: 1308 microversion: 2.1 time: 0.481906 Jan 15 21:04:06.597333 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2417/4837] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:04:06 2022] GET /compute/v2.1/servers/b6942f26-7967-4574-9f6e-9a42a7c66a3b => generated 1308 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:04:06.655258 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8bccbeca-05c2-4141-93b6-92ee00cdbdec tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:06.657147 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-8bccbeca-05c2-4141-93b6-92ee00cdbdec tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:06.665699 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8bccbeca-05c2-4141-93b6-92ee00cdbdec tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:06.667269 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8bccbeca-05c2-4141-93b6-92ee00cdbdec tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:06.668290 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8bccbeca-05c2-4141-93b6-92ee00cdbdec tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:06.670246 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8bccbeca-05c2-4141-93b6-92ee00cdbdec tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:06.702458 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-1294ede5-7f62-45cc-931f-12f34c5b7b81 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action" status: 202 len: 0 microversion: 2.1 time: 0.249391 Jan 15 21:04:06.703115 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2421/4838] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:04:06 2022] POST /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/action => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:04:06.720298 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1b60eec8-2bce-428a-ab46-bbc5da1badf7 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:04:06.723446 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-1b60eec8-2bce-428a-ab46-bbc5da1badf7 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:06.731254 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1b60eec8-2bce-428a-ab46-bbc5da1badf7 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:06.732227 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1b60eec8-2bce-428a-ab46-bbc5da1badf7 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:06.733415 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1b60eec8-2bce-428a-ab46-bbc5da1badf7 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:06.734546 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1b60eec8-2bce-428a-ab46-bbc5da1badf7 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:06.741253 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-8bccbeca-05c2-4141-93b6-92ee00cdbdec tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.091326 Jan 15 21:04:06.744100 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2418/4839] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:06 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:04:06.753812 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-60672b53-933e-4992-b426-c165e725f932 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:04:06.760672 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-60672b53-933e-4992-b426-c165e725f932 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:06.802971 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-60672b53-933e-4992-b426-c165e725f932 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:06.804641 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-60672b53-933e-4992-b426-c165e725f932 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:06.806367 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-60672b53-933e-4992-b426-c165e725f932 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:06.807830 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-60672b53-933e-4992-b426-c165e725f932 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:06.850085 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1b60eec8-2bce-428a-ab46-bbc5da1badf7 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:06.850825 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1b60eec8-2bce-428a-ab46-bbc5da1badf7 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:06.851455 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.objects.instance [None req-1b60eec8-2bce-428a-ab46-bbc5da1badf7 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lazy-loading 'fault' on Instance uuid 0ac722a3-aadf-4791-b5b1-e5e5efebddc0 {{(pid=129366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 21:04:06.963265 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-1b60eec8-2bce-428a-ab46-bbc5da1badf7 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:06.982654 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-1b60eec8-2bce-428a-ab46-bbc5da1badf7 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:06.986413 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-1b60eec8-2bce-428a-ab46-bbc5da1badf7 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:06.988013 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-1b60eec8-2bce-428a-ab46-bbc5da1badf7 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0" status: 200 len: 1369 microversion: 2.20 time: 0.279886 Jan 15 21:04:06.989949 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2422/4840] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:04:06 2022] GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0 => generated 1369 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:04:07.086650 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-60672b53-933e-4992-b426-c165e725f932 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6097506a2d4e36818310d9d70bf01b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4dad65fccfe481a973f5fcbb9287dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:07.099028 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-60672b53-933e-4992-b426-c165e725f932 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "GET /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a" status: 200 len: 1661 microversion: 2.1 time: 0.352332 Jan 15 21:04:07.100428 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2419/4841] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:04:06 2022] GET /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a => generated 1661 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:04:07.117590 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-6786e9ed-884b-46a4-b34f-d8bfc5dab6fb tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:07.119019 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-6786e9ed-884b-46a4-b34f-d8bfc5dab6fb tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:07.134104 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6786e9ed-884b-46a4-b34f-d8bfc5dab6fb tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:07.134838 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6786e9ed-884b-46a4-b34f-d8bfc5dab6fb tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:07.135891 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6786e9ed-884b-46a4-b34f-d8bfc5dab6fb tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:07.152748 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6786e9ed-884b-46a4-b34f-d8bfc5dab6fb tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:07.271619 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-6786e9ed-884b-46a4-b34f-d8bfc5dab6fb tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.158651 Jan 15 21:04:07.273273 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2423/4842] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:07 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:04:07.614591 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-cb190224-c1a4-48b4-a4c8-c4d2e1c0b957 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:04:07.615281 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-cb190224-c1a4-48b4-a4c8-c4d2e1c0b957 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: b6942f26-7967-4574-9f6e-9a42a7c66a3b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:07.632348 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cb190224-c1a4-48b4-a4c8-c4d2e1c0b957 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:07.634993 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cb190224-c1a4-48b4-a4c8-c4d2e1c0b957 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:07.638489 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cb190224-c1a4-48b4-a4c8-c4d2e1c0b957 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:07.643159 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cb190224-c1a4-48b4-a4c8-c4d2e1c0b957 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:07.759757 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-31c1475e-b181-4f10-a1a7-d9a27e4eea61 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:07.761228 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-31c1475e-b181-4f10-a1a7-d9a27e4eea61 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:07.800773 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-31c1475e-b181-4f10-a1a7-d9a27e4eea61 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:07.801454 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-31c1475e-b181-4f10-a1a7-d9a27e4eea61 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:07.806705 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-31c1475e-b181-4f10-a1a7-d9a27e4eea61 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:07.813622 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-31c1475e-b181-4f10-a1a7-d9a27e4eea61 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:07.931794 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-31c1475e-b181-4f10-a1a7-d9a27e4eea61 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.180395 Jan 15 21:04:07.936911 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2424/4843] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:07 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:04:08.027881 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a27908f1-8271-490d-a404-c9d760d28d72 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:04:08.033105 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a27908f1-8271-490d-a404-c9d760d28d72 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:08.048028 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a27908f1-8271-490d-a404-c9d760d28d72 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:08.048923 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a27908f1-8271-490d-a404-c9d760d28d72 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:08.050000 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a27908f1-8271-490d-a404-c9d760d28d72 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:08.050813 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a27908f1-8271-490d-a404-c9d760d28d72 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:08.077922 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-a27908f1-8271-490d-a404-c9d760d28d72 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] HTTP exception thrown: Instance 0ac722a3-aadf-4791-b5b1-e5e5efebddc0 could not be found. Jan 15 21:04:08.079227 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a27908f1-8271-490d-a404-c9d760d28d72 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Returning 404 to user: Instance 0ac722a3-aadf-4791-b5b1-e5e5efebddc0 could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:04:08.080301 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a27908f1-8271-490d-a404-c9d760d28d72 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0" status: 404 len: 111 microversion: 2.20 time: 0.070292 Jan 15 21:04:08.081861 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2425/4844] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:04:08 2022] GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 15 21:04:08.096367 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-15f97296-6760-4aac-884f-31c544d3a350 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '.version_select at 0x7f30c873a160>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:04:08.156161 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-15f97296-6760-4aac-884f-31c544d3a350 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-957610633" status: 204 len: 0 microversion: 2.20 time: 0.065728 Jan 15 21:04:08.157365 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2426/4845] 10.222.0.46 () {60 vars in 1258 bytes} [Sat Jan 15 21:04:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-957610633 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 15 21:04:08.167950 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-fe13898e-66d0-4e39-aed0-85b038232e9d tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:04:08.171849 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-fe13898e-66d0-4e39-aed0-85b038232e9d tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:08.203111 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fe13898e-66d0-4e39-aed0-85b038232e9d tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:08.203579 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fe13898e-66d0-4e39-aed0-85b038232e9d tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:08.204412 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fe13898e-66d0-4e39-aed0-85b038232e9d tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:08.204869 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fe13898e-66d0-4e39-aed0-85b038232e9d tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:08.662959 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-cb190224-c1a4-48b4-a4c8-c4d2e1c0b957 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb3421bc9494914bc5f797b15a55643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31af2a6b9424f168dd6084d8d5fd0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:08.694472 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-cb190224-c1a4-48b4-a4c8-c4d2e1c0b957 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/b6942f26-7967-4574-9f6e-9a42a7c66a3b" status: 200 len: 1490 microversion: 2.1 time: 1.083963 Jan 15 21:04:08.696474 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2420/4846] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:04:07 2022] GET /compute/v2.1/servers/b6942f26-7967-4574-9f6e-9a42a7c66a3b => generated 1490 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:04:08.726254 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ded8da2c-b07d-492a-b74d-1c500c2bfd20 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:08.734003 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ded8da2c-b07d-492a-b74d-1c500c2bfd20 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:08.746065 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ded8da2c-b07d-492a-b74d-1c500c2bfd20 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:08.747443 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ded8da2c-b07d-492a-b74d-1c500c2bfd20 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:08.748994 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ded8da2c-b07d-492a-b74d-1c500c2bfd20 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:08.750690 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ded8da2c-b07d-492a-b74d-1c500c2bfd20 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:08.789228 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-fe13898e-66d0-4e39-aed0-85b038232e9d tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6097506a2d4e36818310d9d70bf01b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4dad65fccfe481a973f5fcbb9287dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:08.803975 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-fe13898e-66d0-4e39-aed0-85b038232e9d tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "GET /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a" status: 200 len: 1661 microversion: 2.1 time: 0.645460 Jan 15 21:04:08.819956 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2427/4847] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:04:08 2022] GET /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a => generated 1661 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:04:08.825779 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8fe10df5-2d4f-4d00-90f0-1b11da1df4cb tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:04:08.827028 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-8fe10df5-2d4f-4d00-90f0-1b11da1df4cb tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: ab35ab75-5c67-40f1-96d6-eb5220405c13] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:08.833681 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8fe10df5-2d4f-4d00-90f0-1b11da1df4cb tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:08.834356 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8fe10df5-2d4f-4d00-90f0-1b11da1df4cb tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:08.835317 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8fe10df5-2d4f-4d00-90f0-1b11da1df4cb tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:08.836416 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8fe10df5-2d4f-4d00-90f0-1b11da1df4cb tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:08.845831 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ded8da2c-b07d-492a-b74d-1c500c2bfd20 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.145939 Jan 15 21:04:08.846949 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2421/4848] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:08 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:04:08.951350 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c7caad3a-b4e2-4df7-b0e4-590a488a7c01 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:08.953634 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c7caad3a-b4e2-4df7-b0e4-590a488a7c01 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:08.971713 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c7caad3a-b4e2-4df7-b0e4-590a488a7c01 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:08.972400 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c7caad3a-b4e2-4df7-b0e4-590a488a7c01 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:08.973839 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c7caad3a-b4e2-4df7-b0e4-590a488a7c01 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:08.977435 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c7caad3a-b4e2-4df7-b0e4-590a488a7c01 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:09.081007 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c7caad3a-b4e2-4df7-b0e4-590a488a7c01 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.137286 Jan 15 21:04:09.081687 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2422/4849] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:08 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:04:09.191083 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-8fe10df5-2d4f-4d00-90f0-1b11da1df4cb tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb3421bc9494914bc5f797b15a55643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31af2a6b9424f168dd6084d8d5fd0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:09.206613 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-8fe10df5-2d4f-4d00-90f0-1b11da1df4cb tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/ab35ab75-5c67-40f1-96d6-eb5220405c13" status: 200 len: 1489 microversion: 2.1 time: 0.384548 Jan 15 21:04:09.209881 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2428/4850] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:04:08 2022] GET /compute/v2.1/servers/ab35ab75-5c67-40f1-96d6-eb5220405c13 => generated 1489 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:04:09.225340 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ba2d04d2-392f-4dbd-8a9f-7655c3079ed6 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:04:09.226343 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ba2d04d2-392f-4dbd-8a9f-7655c3079ed6 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: b6942f26-7967-4574-9f6e-9a42a7c66a3b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:09.240052 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ba2d04d2-392f-4dbd-8a9f-7655c3079ed6 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:09.241471 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ba2d04d2-392f-4dbd-8a9f-7655c3079ed6 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:09.243416 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ba2d04d2-392f-4dbd-8a9f-7655c3079ed6 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:09.244639 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ba2d04d2-392f-4dbd-8a9f-7655c3079ed6 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:09.508607 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-ba2d04d2-392f-4dbd-8a9f-7655c3079ed6 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb3421bc9494914bc5f797b15a55643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31af2a6b9424f168dd6084d8d5fd0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:09.525104 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ba2d04d2-392f-4dbd-8a9f-7655c3079ed6 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/b6942f26-7967-4574-9f6e-9a42a7c66a3b" status: 200 len: 1490 microversion: 2.1 time: 0.303310 Jan 15 21:04:09.525848 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2423/4851] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:04:09 2022] GET /compute/v2.1/servers/b6942f26-7967-4574-9f6e-9a42a7c66a3b => generated 1490 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:04:09.542678 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-391e19c2-3bf8-4221-b3a6-348cd3c2e6b6 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:04:09.543742 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-391e19c2-3bf8-4221-b3a6-348cd3c2e6b6 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: b6942f26-7967-4574-9f6e-9a42a7c66a3b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:09.552641 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-391e19c2-3bf8-4221-b3a6-348cd3c2e6b6 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:09.553459 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-391e19c2-3bf8-4221-b3a6-348cd3c2e6b6 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:09.554252 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-391e19c2-3bf8-4221-b3a6-348cd3c2e6b6 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:09.554850 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-391e19c2-3bf8-4221-b3a6-348cd3c2e6b6 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:09.582439 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-391e19c2-3bf8-4221-b3a6-348cd3c2e6b6 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: b6942f26-7967-4574-9f6e-9a42a7c66a3b] Going to try to terminate instance {{(pid=129366) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 21:04:09.687927 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-391e19c2-3bf8-4221-b3a6-348cd3c2e6b6 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "DELETE /compute/v2.1/servers/b6942f26-7967-4574-9f6e-9a42a7c66a3b" status: 204 len: 0 microversion: 2.1 time: 0.148036 Jan 15 21:04:09.689364 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2429/4852] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 21:04:09 2022] DELETE /compute/v2.1/servers/b6942f26-7967-4574-9f6e-9a42a7c66a3b => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 21:04:09.697247 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f06e24ff-4247-4463-a72d-64def5ec719c tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:04:09.698733 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f06e24ff-4247-4463-a72d-64def5ec719c tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: b6942f26-7967-4574-9f6e-9a42a7c66a3b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:09.714060 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f06e24ff-4247-4463-a72d-64def5ec719c tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:09.714914 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f06e24ff-4247-4463-a72d-64def5ec719c tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:09.717068 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f06e24ff-4247-4463-a72d-64def5ec719c tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:09.717691 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f06e24ff-4247-4463-a72d-64def5ec719c tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:09.832618 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ec812e2d-a33d-4de5-9c98-1ec91b9c05f1 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:04:09.834315 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ec812e2d-a33d-4de5-9c98-1ec91b9c05f1 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:09.842540 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ec812e2d-a33d-4de5-9c98-1ec91b9c05f1 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:09.843406 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ec812e2d-a33d-4de5-9c98-1ec91b9c05f1 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:09.845147 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ec812e2d-a33d-4de5-9c98-1ec91b9c05f1 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:09.845806 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ec812e2d-a33d-4de5-9c98-1ec91b9c05f1 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:09.938897 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-f06e24ff-4247-4463-a72d-64def5ec719c tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb3421bc9494914bc5f797b15a55643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31af2a6b9424f168dd6084d8d5fd0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:09.961992 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f06e24ff-4247-4463-a72d-64def5ec719c tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/b6942f26-7967-4574-9f6e-9a42a7c66a3b" status: 200 len: 1496 microversion: 2.1 time: 0.268367 Jan 15 21:04:09.966562 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2424/4853] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:04:09 2022] GET /compute/v2.1/servers/b6942f26-7967-4574-9f6e-9a42a7c66a3b => generated 1496 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:04:09.981759 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3ebbb0c2-d65b-4496-a847-083a55c43e53 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:09.982918 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-3ebbb0c2-d65b-4496-a847-083a55c43e53 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:09.995072 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3ebbb0c2-d65b-4496-a847-083a55c43e53 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:09.995800 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3ebbb0c2-d65b-4496-a847-083a55c43e53 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:09.996978 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3ebbb0c2-d65b-4496-a847-083a55c43e53 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:09.998705 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3ebbb0c2-d65b-4496-a847-083a55c43e53 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:10.076640 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3ebbb0c2-d65b-4496-a847-083a55c43e53 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.097230 Jan 15 21:04:10.078436 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2425/4854] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:09 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:04:10.082079 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-ec812e2d-a33d-4de5-9c98-1ec91b9c05f1 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6097506a2d4e36818310d9d70bf01b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4dad65fccfe481a973f5fcbb9287dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:10.086544 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ddff19c4-85d6-4dac-a11e-dc0273a20fd9 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'create', calling method: .version_select at 0x7f30c8528e50>, body: {"keypair": {"name": "tempest-keypair-77400351"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:10.091862 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ec812e2d-a33d-4de5-9c98-1ec91b9c05f1 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "GET /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a" status: 200 len: 1665 microversion: 2.1 time: 0.265811 Jan 15 21:04:10.094593 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2430/4855] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:04:09 2022] GET /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a => generated 1665 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:04:10.102022 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-694559db-25c8-4808-a8d6-92757dc8a8ce tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:10.102934 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-694559db-25c8-4808-a8d6-92757dc8a8ce tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:10.103854 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-ddff19c4-85d6-4dac-a11e-dc0273a20fd9 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Getting quotas for project 818a237ecf6b46e389a244c2f33641d5. Resources: {'key_pairs'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:04:10.117101 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-694559db-25c8-4808-a8d6-92757dc8a8ce tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:10.117834 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-694559db-25c8-4808-a8d6-92757dc8a8ce tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:10.119088 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-694559db-25c8-4808-a8d6-92757dc8a8ce tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:10.119853 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-694559db-25c8-4808-a8d6-92757dc8a8ce tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:10.120362 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-ddff19c4-85d6-4dac-a11e-dc0273a20fd9 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Getting quotas for user ffbeca0a8c6247bb9cf07d84b7c53a9d and project 818a237ecf6b46e389a244c2f33641d5. Resources: {'key_pairs'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:04:10.195876 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-694559db-25c8-4808-a8d6-92757dc8a8ce tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.098645 Jan 15 21:04:10.196861 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2431/4856] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:10 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:04:10.499301 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-ddff19c4-85d6-4dac-a11e-dc0273a20fd9 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Getting quotas for project 818a237ecf6b46e389a244c2f33641d5. Resources: {'key_pairs'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:04:10.505049 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-ddff19c4-85d6-4dac-a11e-dc0273a20fd9 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Getting quotas for user ffbeca0a8c6247bb9cf07d84b7c53a9d and project 818a237ecf6b46e389a244c2f33641d5. Resources: {'key_pairs'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:04:10.521735 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ddff19c4-85d6-4dac-a11e-dc0273a20fd9 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 201 len: 2318 microversion: 2.20 time: 0.441470 Jan 15 21:04:10.522561 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2426/4857] 10.222.0.46 () {62 vars in 1198 bytes} [Sat Jan 15 21:04:10 2022] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 443 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Jan 15 21:04:10.984803 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-243724be-6488-472e-a7fe-d13328c012b6 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:04:10.985912 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-243724be-6488-472e-a7fe-d13328c012b6 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: b6942f26-7967-4574-9f6e-9a42a7c66a3b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:10.996519 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-243724be-6488-472e-a7fe-d13328c012b6 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:10.998219 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-243724be-6488-472e-a7fe-d13328c012b6 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:10.999223 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-243724be-6488-472e-a7fe-d13328c012b6 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:10.999823 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-243724be-6488-472e-a7fe-d13328c012b6 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:11.090770 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3c997bd9-f648-42d5-87de-a6be0554d0d0 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:11.092096 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-3c997bd9-f648-42d5-87de-a6be0554d0d0 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:11.108197 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3c997bd9-f648-42d5-87de-a6be0554d0d0 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:11.108664 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3c997bd9-f648-42d5-87de-a6be0554d0d0 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:11.109509 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3c997bd9-f648-42d5-87de-a6be0554d0d0 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:11.110869 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3c997bd9-f648-42d5-87de-a6be0554d0d0 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:11.186385 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3c997bd9-f648-42d5-87de-a6be0554d0d0 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.100899 Jan 15 21:04:11.192696 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2427/4858] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:11 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:04:11.218931 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5ba11e95-8970-4cf6-835d-775d02b72553 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:11.224761 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-5ba11e95-8970-4cf6-835d-775d02b72553 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:11.246120 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5ba11e95-8970-4cf6-835d-775d02b72553 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:11.246615 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5ba11e95-8970-4cf6-835d-775d02b72553 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:11.253126 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5ba11e95-8970-4cf6-835d-775d02b72553 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:11.253794 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5ba11e95-8970-4cf6-835d-775d02b72553 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:11.352434 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-243724be-6488-472e-a7fe-d13328c012b6 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb3421bc9494914bc5f797b15a55643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31af2a6b9424f168dd6084d8d5fd0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:11.376536 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-243724be-6488-472e-a7fe-d13328c012b6 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/b6942f26-7967-4574-9f6e-9a42a7c66a3b" status: 200 len: 1496 microversion: 2.1 time: 0.391727 Jan 15 21:04:11.378817 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2432/4859] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:04:10 2022] GET /compute/v2.1/servers/b6942f26-7967-4574-9f6e-9a42a7c66a3b => generated 1496 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:04:11.396706 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5ba11e95-8970-4cf6-835d-775d02b72553 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.185491 Jan 15 21:04:11.403053 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2428/4860] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:11 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:04:12.203704 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-63f8f67e-407d-4db2-afea-ad33f5843db6 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:12.205800 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-63f8f67e-407d-4db2-afea-ad33f5843db6 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:12.213829 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-63f8f67e-407d-4db2-afea-ad33f5843db6 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:12.214505 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-63f8f67e-407d-4db2-afea-ad33f5843db6 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:12.215663 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-63f8f67e-407d-4db2-afea-ad33f5843db6 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:12.217337 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-63f8f67e-407d-4db2-afea-ad33f5843db6 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:12.279304 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-63f8f67e-407d-4db2-afea-ad33f5843db6 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.080400 Jan 15 21:04:12.285559 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2433/4861] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:12 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:04:12.395268 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-19a40a56-67b6-41bf-8c78-8716f4c80635 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:04:12.396202 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-19a40a56-67b6-41bf-8c78-8716f4c80635 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: b6942f26-7967-4574-9f6e-9a42a7c66a3b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:12.404718 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-19a40a56-67b6-41bf-8c78-8716f4c80635 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:12.405231 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-19a40a56-67b6-41bf-8c78-8716f4c80635 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:12.406393 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-19a40a56-67b6-41bf-8c78-8716f4c80635 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:12.406838 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-19a40a56-67b6-41bf-8c78-8716f4c80635 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:12.412523 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0804430c-5439-4eb2-841e-0b36919b20e6 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:12.414123 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-0804430c-5439-4eb2-841e-0b36919b20e6 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:12.424110 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0804430c-5439-4eb2-841e-0b36919b20e6 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:12.425124 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0804430c-5439-4eb2-841e-0b36919b20e6 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:12.426156 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0804430c-5439-4eb2-841e-0b36919b20e6 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:12.426813 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0804430c-5439-4eb2-841e-0b36919b20e6 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:12.485211 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0804430c-5439-4eb2-841e-0b36919b20e6 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.076819 Jan 15 21:04:12.486447 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2434/4862] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:12 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:04:12.573119 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-19a40a56-67b6-41bf-8c78-8716f4c80635 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb3421bc9494914bc5f797b15a55643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31af2a6b9424f168dd6084d8d5fd0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:12.588330 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-19a40a56-67b6-41bf-8c78-8716f4c80635 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/b6942f26-7967-4574-9f6e-9a42a7c66a3b" status: 200 len: 1496 microversion: 2.1 time: 0.196675 Jan 15 21:04:12.601285 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2429/4863] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:04:12 2022] GET /compute/v2.1/servers/b6942f26-7967-4574-9f6e-9a42a7c66a3b => generated 1496 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:04:12.983701 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-632f09b5-c222-47f5-acc5-60e12123ac5a req-486f94ab-b478-4d33-b00b-241243b8c5b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6942f26-7967-4574-9f6e-9a42a7c66a3b", "name": "network-vif-deleted", "tag": "74176096-39ea-4345-a38f-44719ca01a50"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:12.986744 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:04:12.986744 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:04:13.009518 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-632f09b5-c222-47f5-acc5-60e12123ac5a req-486f94ab-b478-4d33-b00b-241243b8c5b1 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:13.009989 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-632f09b5-c222-47f5-acc5-60e12123ac5a req-486f94ab-b478-4d33-b00b-241243b8c5b1 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:13.024730 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-632f09b5-c222-47f5-acc5-60e12123ac5a req-486f94ab-b478-4d33-b00b-241243b8c5b1 service nova] Creating event network-vif-deleted:74176096-39ea-4345-a38f-44719ca01a50 for instance b6942f26-7967-4574-9f6e-9a42a7c66a3b on nch2-master-1 Jan 15 21:04:13.031659 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-632f09b5-c222-47f5-acc5-60e12123ac5a req-486f94ab-b478-4d33-b00b-241243b8c5b1 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.333851 Jan 15 21:04:13.032811 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2435/4864] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:04:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:04:13.299493 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-87a5fc39-5b48-4cdc-a1a9-a4303ca6c54c tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:13.300417 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-87a5fc39-5b48-4cdc-a1a9-a4303ca6c54c tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:13.325617 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-87a5fc39-5b48-4cdc-a1a9-a4303ca6c54c tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:13.326739 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-87a5fc39-5b48-4cdc-a1a9-a4303ca6c54c tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:13.329118 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-87a5fc39-5b48-4cdc-a1a9-a4303ca6c54c tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:13.330386 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-87a5fc39-5b48-4cdc-a1a9-a4303ca6c54c tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:13.427268 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-87a5fc39-5b48-4cdc-a1a9-a4303ca6c54c tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.134002 Jan 15 21:04:13.430000 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2430/4865] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:13 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:04:13.503171 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a5c68b89-8f80-4cc2-be6a-c5cb6f21e18b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:13.504416 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a5c68b89-8f80-4cc2-be6a-c5cb6f21e18b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:13.513480 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a5c68b89-8f80-4cc2-be6a-c5cb6f21e18b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:13.514342 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a5c68b89-8f80-4cc2-be6a-c5cb6f21e18b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:13.515823 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a5c68b89-8f80-4cc2-be6a-c5cb6f21e18b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:13.516555 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a5c68b89-8f80-4cc2-be6a-c5cb6f21e18b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:13.532162 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-7d524899-9e1c-4bf7-b426-ea69ecb5e319 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1885698618", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "535f6b6c-b9f5-47ea-8d07-fcc8966ad86d"}], "security_groups": [{"name": "tempest-securitygroup--1067155478"}], "key_name": "tempest-keypair-77400351", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:13.601808 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a5c68b89-8f80-4cc2-be6a-c5cb6f21e18b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.102353 Jan 15 21:04:13.608151 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2436/4866] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:13 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:04:13.616613 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b8277a0f-bd59-4cc5-a994-0910f60f7e4f tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:04:13.617468 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b8277a0f-bd59-4cc5-a994-0910f60f7e4f tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: b6942f26-7967-4574-9f6e-9a42a7c66a3b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:13.624982 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b8277a0f-bd59-4cc5-a994-0910f60f7e4f tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:13.625435 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b8277a0f-bd59-4cc5-a994-0910f60f7e4f tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:13.626228 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b8277a0f-bd59-4cc5-a994-0910f60f7e4f tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:13.626811 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b8277a0f-bd59-4cc5-a994-0910f60f7e4f tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:13.643048 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-b8277a0f-bd59-4cc5-a994-0910f60f7e4f tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] HTTP exception thrown: Instance b6942f26-7967-4574-9f6e-9a42a7c66a3b could not be found. Jan 15 21:04:13.643652 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b8277a0f-bd59-4cc5-a994-0910f60f7e4f tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Returning 404 to user: Instance b6942f26-7967-4574-9f6e-9a42a7c66a3b could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:04:13.644489 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b8277a0f-bd59-4cc5-a994-0910f60f7e4f tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/b6942f26-7967-4574-9f6e-9a42a7c66a3b" status: 404 len: 111 microversion: 2.1 time: 0.034946 Jan 15 21:04:13.648094 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2437/4867] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:04:13 2022] GET /compute/v2.1/servers/b6942f26-7967-4574-9f6e-9a42a7c66a3b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:04:13.655512 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ae92cfa1-33c8-4b54-af65-279cfdbbcbcf tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:04:13.656178 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ae92cfa1-33c8-4b54-af65-279cfdbbcbcf tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: ab35ab75-5c67-40f1-96d6-eb5220405c13] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:13.663685 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ae92cfa1-33c8-4b54-af65-279cfdbbcbcf tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:13.664498 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ae92cfa1-33c8-4b54-af65-279cfdbbcbcf tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:13.665586 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ae92cfa1-33c8-4b54-af65-279cfdbbcbcf tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:13.666261 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ae92cfa1-33c8-4b54-af65-279cfdbbcbcf tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:13.698402 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ae92cfa1-33c8-4b54-af65-279cfdbbcbcf tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: ab35ab75-5c67-40f1-96d6-eb5220405c13] Going to try to terminate instance {{(pid=129366) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 21:04:13.718826 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.network.neutron [None req-7d524899-9e1c-4bf7-b426-ea69ecb5e319 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] validate_networks() for [('535f6b6c-b9f5-47ea-8d07-fcc8966ad86d', None, None, None, None, None)] {{(pid=129365) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 21:04:13.807858 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ae92cfa1-33c8-4b54-af65-279cfdbbcbcf tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "DELETE /compute/v2.1/servers/ab35ab75-5c67-40f1-96d6-eb5220405c13" status: 204 len: 0 microversion: 2.1 time: 0.156224 Jan 15 21:04:13.813364 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2438/4868] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 21:04:13 2022] DELETE /compute/v2.1/servers/ab35ab75-5c67-40f1-96d6-eb5220405c13 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 15 21:04:13.822084 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-2a731964-a234-4bc0-8301-d9362c978f76 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:04:13.822925 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-2a731964-a234-4bc0-8301-d9362c978f76 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: ab35ab75-5c67-40f1-96d6-eb5220405c13] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:13.829728 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2a731964-a234-4bc0-8301-d9362c978f76 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:13.830310 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2a731964-a234-4bc0-8301-d9362c978f76 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:13.831209 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2a731964-a234-4bc0-8301-d9362c978f76 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:13.831749 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2a731964-a234-4bc0-8301-d9362c978f76 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:14.176155 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-2a731964-a234-4bc0-8301-d9362c978f76 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb3421bc9494914bc5f797b15a55643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31af2a6b9424f168dd6084d8d5fd0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:14.195949 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-2a731964-a234-4bc0-8301-d9362c978f76 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/ab35ab75-5c67-40f1-96d6-eb5220405c13" status: 200 len: 1495 microversion: 2.1 time: 0.379492 Jan 15 21:04:14.196642 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2439/4869] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:04:13 2022] GET /compute/v2.1/servers/ab35ab75-5c67-40f1-96d6-eb5220405c13 => generated 1495 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:04:14.444073 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b6000111-7f06-4c2e-a6c6-54dcba3d15e7 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:14.445342 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b6000111-7f06-4c2e-a6c6-54dcba3d15e7 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:14.455492 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b6000111-7f06-4c2e-a6c6-54dcba3d15e7 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:14.455994 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b6000111-7f06-4c2e-a6c6-54dcba3d15e7 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:14.456789 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b6000111-7f06-4c2e-a6c6-54dcba3d15e7 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:14.457453 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b6000111-7f06-4c2e-a6c6-54dcba3d15e7 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:14.508826 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b6000111-7f06-4c2e-a6c6-54dcba3d15e7 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.070888 Jan 15 21:04:14.511053 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2440/4870] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:14 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:04:14.536032 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-7d524899-9e1c-4bf7-b426-ea69ecb5e319 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Flavor limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 21:04:14.538514 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-7d524899-9e1c-4bf7-b426-ea69ecb5e319 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Image limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 21:04:14.539166 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-7d524899-9e1c-4bf7-b426-ea69ecb5e319 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Flavor pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 21:04:14.540143 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-7d524899-9e1c-4bf7-b426-ea69ecb5e319 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Image pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 21:04:14.541458 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-7d524899-9e1c-4bf7-b426-ea69ecb5e319 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 21:04:14.552807 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7d524899-9e1c-4bf7-b426-ea69ecb5e319 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:14.553421 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7d524899-9e1c-4bf7-b426-ea69ecb5e319 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:14.554824 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7d524899-9e1c-4bf7-b426-ea69ecb5e319 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:14.555646 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7d524899-9e1c-4bf7-b426-ea69ecb5e319 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:14.578254 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-7d524899-9e1c-4bf7-b426-ea69ecb5e319 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Getting quotas for project 818a237ecf6b46e389a244c2f33641d5. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:04:14.585345 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-7d524899-9e1c-4bf7-b426-ea69ecb5e319 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Getting quotas for user ffbeca0a8c6247bb9cf07d84b7c53a9d and project 818a237ecf6b46e389a244c2f33641d5. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:04:14.602306 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-7d524899-9e1c-4bf7-b426-ea69ecb5e319 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Going to run 1 instances... {{(pid=129365) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 21:04:14.605772 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-7d524899-9e1c-4bf7-b426-ea69ecb5e319 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129365) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 21:04:14.626613 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-cb03cede-fcbb-4eeb-b146-aafc8386ed8c tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:14.628026 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-cb03cede-fcbb-4eeb-b146-aafc8386ed8c tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:14.646874 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cb03cede-fcbb-4eeb-b146-aafc8386ed8c tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:14.648006 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cb03cede-fcbb-4eeb-b146-aafc8386ed8c tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:14.649478 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cb03cede-fcbb-4eeb-b146-aafc8386ed8c tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:14.650164 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cb03cede-fcbb-4eeb-b146-aafc8386ed8c tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:14.673986 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-7d524899-9e1c-4bf7-b426-ea69ecb5e319 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.147437 Jan 15 21:04:14.676770 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2431/4871] 10.222.0.46 () {62 vars in 1187 bytes} [Sat Jan 15 21:04:13 2022] POST /compute/v2.1/servers => generated 402 bytes in 1151 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jan 15 21:04:14.703473 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-97a8e6fe-bf03-4114-bdd1-18a648cadedf tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:04:14.707469 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-97a8e6fe-bf03-4114-bdd1-18a648cadedf tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:14.751112 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-cb03cede-fcbb-4eeb-b146-aafc8386ed8c tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.139051 Jan 15 21:04:14.760184 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2441/4872] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:14 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:04:15.101739 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-97a8e6fe-bf03-4114-bdd1-18a648cadedf tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:15.115149 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-97a8e6fe-bf03-4114-bdd1-18a648cadedf tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:15.119084 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-97a8e6fe-bf03-4114-bdd1-18a648cadedf tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:15.124164 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-97a8e6fe-bf03-4114-bdd1-18a648cadedf tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42" status: 200 len: 1280 microversion: 2.20 time: 0.438000 Jan 15 21:04:15.124945 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2432/4873] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:04:14 2022] GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42 => generated 1280 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 15 21:04:15.214599 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-65df9255-a35d-499d-9eaf-2a54ef45bf8f tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:04:15.215332 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-65df9255-a35d-499d-9eaf-2a54ef45bf8f tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: ab35ab75-5c67-40f1-96d6-eb5220405c13] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:15.222769 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-65df9255-a35d-499d-9eaf-2a54ef45bf8f tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:15.223221 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-65df9255-a35d-499d-9eaf-2a54ef45bf8f tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:15.224022 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-65df9255-a35d-499d-9eaf-2a54ef45bf8f tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:15.224465 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-65df9255-a35d-499d-9eaf-2a54ef45bf8f tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:15.524667 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-fbfa560d-f9ab-48f6-ba06-510c0314510d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:15.526421 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-fbfa560d-f9ab-48f6-ba06-510c0314510d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:15.535534 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fbfa560d-f9ab-48f6-ba06-510c0314510d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:15.540693 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fbfa560d-f9ab-48f6-ba06-510c0314510d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:15.542457 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fbfa560d-f9ab-48f6-ba06-510c0314510d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:15.543073 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fbfa560d-f9ab-48f6-ba06-510c0314510d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:15.591459 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-65df9255-a35d-499d-9eaf-2a54ef45bf8f tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb3421bc9494914bc5f797b15a55643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31af2a6b9424f168dd6084d8d5fd0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:15.596789 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-fbfa560d-f9ab-48f6-ba06-510c0314510d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.077342 Jan 15 21:04:15.597973 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2433/4874] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:15 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:04:15.607560 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-65df9255-a35d-499d-9eaf-2a54ef45bf8f tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/ab35ab75-5c67-40f1-96d6-eb5220405c13" status: 200 len: 1495 microversion: 2.1 time: 0.397084 Jan 15 21:04:15.608445 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2442/4875] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:04:15 2022] GET /compute/v2.1/servers/ab35ab75-5c67-40f1-96d6-eb5220405c13 => generated 1495 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:04:15.765027 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-507888b4-4b2e-405e-8b95-29cb69b4e7ba tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:15.766167 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-507888b4-4b2e-405e-8b95-29cb69b4e7ba tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:15.773867 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-507888b4-4b2e-405e-8b95-29cb69b4e7ba tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:15.774652 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-507888b4-4b2e-405e-8b95-29cb69b4e7ba tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:15.775751 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-507888b4-4b2e-405e-8b95-29cb69b4e7ba tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:15.776406 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-507888b4-4b2e-405e-8b95-29cb69b4e7ba tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:15.825199 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-507888b4-4b2e-405e-8b95-29cb69b4e7ba tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.064383 Jan 15 21:04:15.826560 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2434/4876] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:15 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:04:16.142601 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-65976685-d3d2-405b-9a97-57522115fc26 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:04:16.143224 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-65976685-d3d2-405b-9a97-57522115fc26 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:16.163710 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-65976685-d3d2-405b-9a97-57522115fc26 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:16.169563 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-65976685-d3d2-405b-9a97-57522115fc26 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:16.170795 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-65976685-d3d2-405b-9a97-57522115fc26 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:16.175792 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-65976685-d3d2-405b-9a97-57522115fc26 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:16.326676 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-65976685-d3d2-405b-9a97-57522115fc26 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:16.343922 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-65976685-d3d2-405b-9a97-57522115fc26 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:16.345828 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-65976685-d3d2-405b-9a97-57522115fc26 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:16.347209 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-65976685-d3d2-405b-9a97-57522115fc26 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42" status: 200 len: 1350 microversion: 2.20 time: 0.208426 Jan 15 21:04:16.360804 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2443/4877] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:04:16 2022] GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42 => generated 1350 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:04:16.417470 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-8129b869-4cc0-4c3d-9091-1ac51b737631 req-b2b6bdf2-43f5-44f6-a913-175e7f1fb34f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab35ab75-5c67-40f1-96d6-eb5220405c13", "name": "network-vif-deleted", "tag": "d3b0d270-adad-4376-905e-5a5f98d7020b"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:16.419325 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:04:16.419325 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:04:16.431149 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-8129b869-4cc0-4c3d-9091-1ac51b737631 req-b2b6bdf2-43f5-44f6-a913-175e7f1fb34f service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:16.431667 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-8129b869-4cc0-4c3d-9091-1ac51b737631 req-b2b6bdf2-43f5-44f6-a913-175e7f1fb34f service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:16.444195 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-8129b869-4cc0-4c3d-9091-1ac51b737631 req-b2b6bdf2-43f5-44f6-a913-175e7f1fb34f service nova] Creating event network-vif-deleted:d3b0d270-adad-4376-905e-5a5f98d7020b for instance ab35ab75-5c67-40f1-96d6-eb5220405c13 on nch1-master-1 Jan 15 21:04:16.450466 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-8129b869-4cc0-4c3d-9091-1ac51b737631 req-b2b6bdf2-43f5-44f6-a913-175e7f1fb34f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036459 Jan 15 21:04:16.451905 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2435/4878] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:04:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:04:16.609544 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4238fd5c-791f-4ef9-9c69-318f32d21b92 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:16.611162 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-4238fd5c-791f-4ef9-9c69-318f32d21b92 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:16.617822 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4238fd5c-791f-4ef9-9c69-318f32d21b92 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:16.618273 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4238fd5c-791f-4ef9-9c69-318f32d21b92 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:16.619332 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4238fd5c-791f-4ef9-9c69-318f32d21b92 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:16.619775 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4238fd5c-791f-4ef9-9c69-318f32d21b92 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:16.626897 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-4de03ce6-e4d0-450e-84b0-225b8e91cf08 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:04:16.627607 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-4de03ce6-e4d0-450e-84b0-225b8e91cf08 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: ab35ab75-5c67-40f1-96d6-eb5220405c13] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:16.637910 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4de03ce6-e4d0-450e-84b0-225b8e91cf08 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:16.638640 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4de03ce6-e4d0-450e-84b0-225b8e91cf08 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:16.639610 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4de03ce6-e4d0-450e-84b0-225b8e91cf08 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:16.640217 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4de03ce6-e4d0-450e-84b0-225b8e91cf08 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:16.680784 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4de03ce6-e4d0-450e-84b0-225b8e91cf08 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:16.681660 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4de03ce6-e4d0-450e-84b0-225b8e91cf08 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:16.682320 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.objects.instance [None req-4de03ce6-e4d0-450e-84b0-225b8e91cf08 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lazy-loading 'fault' on Instance uuid ab35ab75-5c67-40f1-96d6-eb5220405c13 {{(pid=129365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 21:04:16.695844 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-4238fd5c-791f-4ef9-9c69-318f32d21b92 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.090252 Jan 15 21:04:16.696608 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2444/4879] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:16 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:04:16.752760 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-4de03ce6-e4d0-450e-84b0-225b8e91cf08 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb3421bc9494914bc5f797b15a55643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31af2a6b9424f168dd6084d8d5fd0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:16.760524 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-4de03ce6-e4d0-450e-84b0-225b8e91cf08 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/ab35ab75-5c67-40f1-96d6-eb5220405c13" status: 200 len: 1298 microversion: 2.1 time: 0.138963 Jan 15 21:04:16.761272 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2436/4880] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:04:16 2022] GET /compute/v2.1/servers/ab35ab75-5c67-40f1-96d6-eb5220405c13 => generated 1298 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:04:16.838906 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-348a8645-1e91-46bb-acbd-5c5e7a8114ec tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:16.839974 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-348a8645-1e91-46bb-acbd-5c5e7a8114ec tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:16.849249 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-348a8645-1e91-46bb-acbd-5c5e7a8114ec tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:16.850515 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-348a8645-1e91-46bb-acbd-5c5e7a8114ec tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:16.852072 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-348a8645-1e91-46bb-acbd-5c5e7a8114ec tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:16.852738 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-348a8645-1e91-46bb-acbd-5c5e7a8114ec tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:16.913362 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-348a8645-1e91-46bb-acbd-5c5e7a8114ec tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.077247 Jan 15 21:04:16.920654 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2445/4881] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:16 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:04:17.365842 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-6709c3d3-c8f6-4df0-b5ed-824134e89bec tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:04:17.366742 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-6709c3d3-c8f6-4df0-b5ed-824134e89bec tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:17.375379 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6709c3d3-c8f6-4df0-b5ed-824134e89bec tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:17.375843 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6709c3d3-c8f6-4df0-b5ed-824134e89bec tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:17.376661 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6709c3d3-c8f6-4df0-b5ed-824134e89bec tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:17.377130 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6709c3d3-c8f6-4df0-b5ed-824134e89bec tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:17.475846 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-6709c3d3-c8f6-4df0-b5ed-824134e89bec tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:17.497175 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-6709c3d3-c8f6-4df0-b5ed-824134e89bec tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:17.503469 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-6709c3d3-c8f6-4df0-b5ed-824134e89bec tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:17.505146 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-6709c3d3-c8f6-4df0-b5ed-824134e89bec tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42" status: 200 len: 1338 microversion: 2.20 time: 0.143077 Jan 15 21:04:17.519090 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2437/4882] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:04:17 2022] GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42 => generated 1338 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 15 21:04:17.709321 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7ff86b89-f07a-4b94-88e5-9c35b27a2e2f tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:17.710497 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-7ff86b89-f07a-4b94-88e5-9c35b27a2e2f tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:17.731674 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7ff86b89-f07a-4b94-88e5-9c35b27a2e2f tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:17.732128 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7ff86b89-f07a-4b94-88e5-9c35b27a2e2f tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:17.732969 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7ff86b89-f07a-4b94-88e5-9c35b27a2e2f tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:17.733403 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7ff86b89-f07a-4b94-88e5-9c35b27a2e2f tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:17.777749 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c43fc7e7-3188-4b4a-aaa9-2785c84858c4 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:04:17.778619 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c43fc7e7-3188-4b4a-aaa9-2785c84858c4 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: ab35ab75-5c67-40f1-96d6-eb5220405c13] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:17.788374 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c43fc7e7-3188-4b4a-aaa9-2785c84858c4 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:17.788829 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c43fc7e7-3188-4b4a-aaa9-2785c84858c4 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:17.802034 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c43fc7e7-3188-4b4a-aaa9-2785c84858c4 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:17.802488 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c43fc7e7-3188-4b4a-aaa9-2785c84858c4 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:17.847810 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7ff86b89-f07a-4b94-88e5-9c35b27a2e2f tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.142362 Jan 15 21:04:17.848454 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2446/4883] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:17 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:04:17.849315 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-c43fc7e7-3188-4b4a-aaa9-2785c84858c4 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] HTTP exception thrown: Instance ab35ab75-5c67-40f1-96d6-eb5220405c13 could not be found. Jan 15 21:04:17.850095 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c43fc7e7-3188-4b4a-aaa9-2785c84858c4 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Returning 404 to user: Instance ab35ab75-5c67-40f1-96d6-eb5220405c13 could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:04:17.852581 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c43fc7e7-3188-4b4a-aaa9-2785c84858c4 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/ab35ab75-5c67-40f1-96d6-eb5220405c13" status: 404 len: 111 microversion: 2.1 time: 0.078604 Jan 15 21:04:17.861416 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2438/4884] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:04:17 2022] GET /compute/v2.1/servers/ab35ab75-5c67-40f1-96d6-eb5220405c13 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:04:17.927368 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8a0af20e-739c-46a7-bb7d-bdf07a902174 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:17.928292 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-8a0af20e-739c-46a7-bb7d-bdf07a902174 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:17.936071 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8a0af20e-739c-46a7-bb7d-bdf07a902174 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:17.936526 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8a0af20e-739c-46a7-bb7d-bdf07a902174 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:17.941343 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8a0af20e-739c-46a7-bb7d-bdf07a902174 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:17.949393 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8a0af20e-739c-46a7-bb7d-bdf07a902174 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:18.017878 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-8a0af20e-739c-46a7-bb7d-bdf07a902174 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.094059 Jan 15 21:04:18.018661 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-648cc8c9-296b-4535-b298-c5480487abd6 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1877655478", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "networks": [{"uuid": "0b7cce2c-2308-43f4-b72e-8ea5d98a7ae1"}]}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:18.019235 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2439/4885] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:17 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:04:18.098346 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.network.neutron [None req-648cc8c9-296b-4535-b298-c5480487abd6 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] validate_networks() for [('0b7cce2c-2308-43f4-b72e-8ea5d98a7ae1', None, None, None, None, None)] {{(pid=129366) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 21:04:18.528602 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-6e1f3b44-348d-461c-8bc0-9f7e82fe51c0 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:04:18.529335 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-6e1f3b44-348d-461c-8bc0-9f7e82fe51c0 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:18.541599 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6e1f3b44-348d-461c-8bc0-9f7e82fe51c0 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:18.543939 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6e1f3b44-348d-461c-8bc0-9f7e82fe51c0 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:18.544766 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6e1f3b44-348d-461c-8bc0-9f7e82fe51c0 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:18.547585 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6e1f3b44-348d-461c-8bc0-9f7e82fe51c0 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:19.244326 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-6e1f3b44-348d-461c-8bc0-9f7e82fe51c0 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:19.248369 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-648cc8c9-296b-4535-b298-c5480487abd6 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Flavor limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 21:04:19.248795 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-648cc8c9-296b-4535-b298-c5480487abd6 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Image limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 21:04:19.249285 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-648cc8c9-296b-4535-b298-c5480487abd6 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Flavor pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 21:04:19.250267 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-648cc8c9-296b-4535-b298-c5480487abd6 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Image pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 21:04:19.250707 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-648cc8c9-296b-4535-b298-c5480487abd6 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 21:04:19.263544 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-6e1f3b44-348d-461c-8bc0-9f7e82fe51c0 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:19.267229 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-6e1f3b44-348d-461c-8bc0-9f7e82fe51c0 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:19.268788 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-6e1f3b44-348d-461c-8bc0-9f7e82fe51c0 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42" status: 200 len: 1406 microversion: 2.20 time: 0.745036 Jan 15 21:04:19.269569 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2440/4886] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:04:18 2022] GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42 => generated 1406 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 15 21:04:19.283756 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-648cc8c9-296b-4535-b298-c5480487abd6 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:19.284218 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-648cc8c9-296b-4535-b298-c5480487abd6 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:19.285084 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-648cc8c9-296b-4535-b298-c5480487abd6 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:19.285526 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-648cc8c9-296b-4535-b298-c5480487abd6 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:19.286505 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-fce008bc-443d-4ead-88c1-b9a83f2f30cf tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:19.287887 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-fce008bc-443d-4ead-88c1-b9a83f2f30cf tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:19.323278 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fce008bc-443d-4ead-88c1-b9a83f2f30cf tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:19.324512 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fce008bc-443d-4ead-88c1-b9a83f2f30cf tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:19.329937 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fce008bc-443d-4ead-88c1-b9a83f2f30cf tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:19.333255 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fce008bc-443d-4ead-88c1-b9a83f2f30cf tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:19.335739 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-648cc8c9-296b-4535-b298-c5480487abd6 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Getting quotas for project d31af2a6b9424f168dd6084d8d5fd0c4. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:04:19.343234 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-648cc8c9-296b-4535-b298-c5480487abd6 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Getting quotas for user 9eb3421bc9494914bc5f797b15a55643 and project d31af2a6b9424f168dd6084d8d5fd0c4. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:04:19.375834 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-648cc8c9-296b-4535-b298-c5480487abd6 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Going to run 1 instances... {{(pid=129366) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 21:04:19.383810 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-648cc8c9-296b-4535-b298-c5480487abd6 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: 119c04bf-8692-4880-bea0-bc41ec4600de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 21:04:19.452831 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-fce008bc-443d-4ead-88c1-b9a83f2f30cf tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.181746 Jan 15 21:04:19.453672 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2441/4887] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:19 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:04:19.464782 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-1af3bd47-421e-4d2d-a351-1efea9702f86 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:19.469063 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-1af3bd47-421e-4d2d-a351-1efea9702f86 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:19.487086 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1af3bd47-421e-4d2d-a351-1efea9702f86 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:19.487912 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1af3bd47-421e-4d2d-a351-1efea9702f86 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:19.488517 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1af3bd47-421e-4d2d-a351-1efea9702f86 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:19.488995 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1af3bd47-421e-4d2d-a351-1efea9702f86 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:19.521215 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-648cc8c9-296b-4535-b298-c5480487abd6 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.506861 Jan 15 21:04:19.522550 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2447/4888] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 21:04:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1510 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 21:04:19.537141 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4616796a-9a19-4c68-aaab-405206f4cac1 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:04:19.538172 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-4616796a-9a19-4c68-aaab-405206f4cac1 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: 119c04bf-8692-4880-bea0-bc41ec4600de] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:19.585395 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-1af3bd47-421e-4d2d-a351-1efea9702f86 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.117807 Jan 15 21:04:19.596565 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2442/4889] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:19 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:04:19.622205 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-4616796a-9a19-4c68-aaab-405206f4cac1 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb3421bc9494914bc5f797b15a55643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31af2a6b9424f168dd6084d8d5fd0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:19.631211 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-4616796a-9a19-4c68-aaab-405206f4cac1 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/119c04bf-8692-4880-bea0-bc41ec4600de" status: 200 len: 1209 microversion: 2.1 time: 0.101333 Jan 15 21:04:19.631211 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2448/4890] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:04:19 2022] GET /compute/v2.1/servers/119c04bf-8692-4880-bea0-bc41ec4600de => generated 1209 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:04:19.847183 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-abc3fabb-6b5d-4e32-aec8-cfa4ec6c4c91 req-e0790bb9-6e07-4947-a82f-31374c41e995 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1b412a8-0407-44fd-8f16-7cbcd8de3a42", "tag": "d027fed2-822f-40a2-a052-26b22c1aef53"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:19.848866 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:04:19.848866 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:04:19.867558 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-abc3fabb-6b5d-4e32-aec8-cfa4ec6c4c91 req-e0790bb9-6e07-4947-a82f-31374c41e995 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:19.873411 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-abc3fabb-6b5d-4e32-aec8-cfa4ec6c4c91 req-e0790bb9-6e07-4947-a82f-31374c41e995 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:19.901117 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-abc3fabb-6b5d-4e32-aec8-cfa4ec6c4c91 req-e0790bb9-6e07-4947-a82f-31374c41e995 service nova] Creating event network-changed:d027fed2-822f-40a2-a052-26b22c1aef53 for instance a1b412a8-0407-44fd-8f16-7cbcd8de3a42 on nch2-master-1 Jan 15 21:04:19.929829 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-abc3fabb-6b5d-4e32-aec8-cfa4ec6c4c91 req-e0790bb9-6e07-4947-a82f-31374c41e995 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093335 Jan 15 21:04:19.937319 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2443/4891] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:04:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:04:20.290550 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4f751bd0-fc66-46e9-a436-aa0cb4a1f6c4 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:04:20.291144 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-4f751bd0-fc66-46e9-a436-aa0cb4a1f6c4 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:20.311639 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4f751bd0-fc66-46e9-a436-aa0cb4a1f6c4 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:20.313654 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4f751bd0-fc66-46e9-a436-aa0cb4a1f6c4 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:20.314815 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4f751bd0-fc66-46e9-a436-aa0cb4a1f6c4 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:20.315506 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4f751bd0-fc66-46e9-a436-aa0cb4a1f6c4 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:20.467866 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-7e6515f1-9f28-4d21-b560-2601dd040873 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:20.470010 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-7e6515f1-9f28-4d21-b560-2601dd040873 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:20.486565 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7e6515f1-9f28-4d21-b560-2601dd040873 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:20.488302 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7e6515f1-9f28-4d21-b560-2601dd040873 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:20.490072 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7e6515f1-9f28-4d21-b560-2601dd040873 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:20.490784 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7e6515f1-9f28-4d21-b560-2601dd040873 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:20.578006 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-7e6515f1-9f28-4d21-b560-2601dd040873 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.115742 Jan 15 21:04:20.579712 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2444/4892] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:20 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:04:20.604132 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a70fb94d-9c8f-4737-a96a-f484fff55096 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:20.605219 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a70fb94d-9c8f-4737-a96a-f484fff55096 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:20.625029 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a70fb94d-9c8f-4737-a96a-f484fff55096 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:20.626325 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a70fb94d-9c8f-4737-a96a-f484fff55096 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:20.627172 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a70fb94d-9c8f-4737-a96a-f484fff55096 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:20.627626 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a70fb94d-9c8f-4737-a96a-f484fff55096 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:20.688167 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-4f751bd0-fc66-46e9-a436-aa0cb4a1f6c4 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:20.696172 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a70fb94d-9c8f-4737-a96a-f484fff55096 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.095964 Jan 15 21:04:20.696867 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2445/4893] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:20 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:04:20.697030 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-4f751bd0-fc66-46e9-a436-aa0cb4a1f6c4 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:20.699597 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-4f751bd0-fc66-46e9-a436-aa0cb4a1f6c4 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:20.703142 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-49fcd602-8f1d-46f5-a7a8-e8409337afd7 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:04:20.704013 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-49fcd602-8f1d-46f5-a7a8-e8409337afd7 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: 119c04bf-8692-4880-bea0-bc41ec4600de] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:20.705205 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-4f751bd0-fc66-46e9-a436-aa0cb4a1f6c4 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42" status: 200 len: 1406 microversion: 2.20 time: 0.418289 Jan 15 21:04:20.705780 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2449/4894] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:04:20 2022] GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42 => generated 1406 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:04:20.724399 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-49fcd602-8f1d-46f5-a7a8-e8409337afd7 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:20.725505 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-49fcd602-8f1d-46f5-a7a8-e8409337afd7 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:20.727020 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-49fcd602-8f1d-46f5-a7a8-e8409337afd7 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:20.727479 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-49fcd602-8f1d-46f5-a7a8-e8409337afd7 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:20.832897 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-49fcd602-8f1d-46f5-a7a8-e8409337afd7 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb3421bc9494914bc5f797b15a55643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31af2a6b9424f168dd6084d8d5fd0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:20.847118 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-49fcd602-8f1d-46f5-a7a8-e8409337afd7 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/119c04bf-8692-4880-bea0-bc41ec4600de" status: 200 len: 1261 microversion: 2.1 time: 0.148722 Jan 15 21:04:20.847740 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2446/4895] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:04:20 2022] GET /compute/v2.1/servers/119c04bf-8692-4880-bea0-bc41ec4600de => generated 1261 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:04:21.591285 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f77d257d-7a3a-480c-9a46-7cd798d33308 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:21.592664 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f77d257d-7a3a-480c-9a46-7cd798d33308 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:21.599394 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f77d257d-7a3a-480c-9a46-7cd798d33308 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:21.599851 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f77d257d-7a3a-480c-9a46-7cd798d33308 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:21.600644 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f77d257d-7a3a-480c-9a46-7cd798d33308 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:21.601129 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f77d257d-7a3a-480c-9a46-7cd798d33308 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:21.650161 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f77d257d-7a3a-480c-9a46-7cd798d33308 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.063185 Jan 15 21:04:21.651453 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2450/4896] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:21 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:04:21.708072 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-4fbad7ad-f180-4f69-9e31-03d639baaf46 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:21.709185 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-4fbad7ad-f180-4f69-9e31-03d639baaf46 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:21.716011 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4fbad7ad-f180-4f69-9e31-03d639baaf46 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:21.716564 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4fbad7ad-f180-4f69-9e31-03d639baaf46 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:21.718451 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4fbad7ad-f180-4f69-9e31-03d639baaf46 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:21.718451 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4fbad7ad-f180-4f69-9e31-03d639baaf46 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:21.724384 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-60d3eca5-abe9-4982-91e6-2c9a603bdcfc tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:04:21.725115 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-60d3eca5-abe9-4982-91e6-2c9a603bdcfc tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:21.742830 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-60d3eca5-abe9-4982-91e6-2c9a603bdcfc tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:21.743441 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-60d3eca5-abe9-4982-91e6-2c9a603bdcfc tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:21.744909 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-60d3eca5-abe9-4982-91e6-2c9a603bdcfc tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:21.748123 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-60d3eca5-abe9-4982-91e6-2c9a603bdcfc tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:21.780606 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-4fbad7ad-f180-4f69-9e31-03d639baaf46 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.076362 Jan 15 21:04:21.785152 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2447/4897] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:21 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:04:21.866471 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c4ecfcde-bb27-4a4d-bcb7-10a676fc31da tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:04:21.867554 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c4ecfcde-bb27-4a4d-bcb7-10a676fc31da tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: 119c04bf-8692-4880-bea0-bc41ec4600de] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:21.878124 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c4ecfcde-bb27-4a4d-bcb7-10a676fc31da tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:21.878918 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c4ecfcde-bb27-4a4d-bcb7-10a676fc31da tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:21.880162 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c4ecfcde-bb27-4a4d-bcb7-10a676fc31da tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:21.880716 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c4ecfcde-bb27-4a4d-bcb7-10a676fc31da tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:22.023876 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-c4ecfcde-bb27-4a4d-bcb7-10a676fc31da tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb3421bc9494914bc5f797b15a55643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31af2a6b9424f168dd6084d8d5fd0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:22.034976 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c4ecfcde-bb27-4a4d-bcb7-10a676fc31da tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/119c04bf-8692-4880-bea0-bc41ec4600de" status: 200 len: 1267 microversion: 2.1 time: 0.172556 Jan 15 21:04:22.036085 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2448/4898] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:04:21 2022] GET /compute/v2.1/servers/119c04bf-8692-4880-bea0-bc41ec4600de => generated 1267 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:04:22.105461 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-60d3eca5-abe9-4982-91e6-2c9a603bdcfc tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:22.119655 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-60d3eca5-abe9-4982-91e6-2c9a603bdcfc tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:22.123109 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-60d3eca5-abe9-4982-91e6-2c9a603bdcfc tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:22.124364 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-60d3eca5-abe9-4982-91e6-2c9a603bdcfc tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42" status: 200 len: 1406 microversion: 2.20 time: 0.404456 Jan 15 21:04:22.125935 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2451/4899] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:04:21 2022] GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42 => generated 1406 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:04:22.662606 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-921cdbb8-d2b4-40c4-9ee4-9fd302cba1c6 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:22.663531 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-921cdbb8-d2b4-40c4-9ee4-9fd302cba1c6 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:22.670664 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-921cdbb8-d2b4-40c4-9ee4-9fd302cba1c6 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:22.671126 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-921cdbb8-d2b4-40c4-9ee4-9fd302cba1c6 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:22.671934 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-921cdbb8-d2b4-40c4-9ee4-9fd302cba1c6 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:22.672377 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-921cdbb8-d2b4-40c4-9ee4-9fd302cba1c6 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:22.723820 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-921cdbb8-d2b4-40c4-9ee4-9fd302cba1c6 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.064780 Jan 15 21:04:22.726615 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2449/4900] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:22 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:04:22.796998 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8bbb8655-5b45-44d4-9181-1aab668b14fd tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:22.798564 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-8bbb8655-5b45-44d4-9181-1aab668b14fd tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:22.806951 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8bbb8655-5b45-44d4-9181-1aab668b14fd tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:22.807709 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8bbb8655-5b45-44d4-9181-1aab668b14fd tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:22.808706 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8bbb8655-5b45-44d4-9181-1aab668b14fd tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:22.810078 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8bbb8655-5b45-44d4-9181-1aab668b14fd tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:22.859073 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-8bbb8655-5b45-44d4-9181-1aab668b14fd tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.067528 Jan 15 21:04:22.859771 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2452/4901] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:22 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:04:23.054775 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-063743fd-abb0-4a8f-93a2-d964af64dc6f tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:04:23.055864 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-063743fd-abb0-4a8f-93a2-d964af64dc6f tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: 119c04bf-8692-4880-bea0-bc41ec4600de] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:23.065366 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-063743fd-abb0-4a8f-93a2-d964af64dc6f tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:23.066275 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-063743fd-abb0-4a8f-93a2-d964af64dc6f tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:23.067347 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-063743fd-abb0-4a8f-93a2-d964af64dc6f tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:23.068021 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-063743fd-abb0-4a8f-93a2-d964af64dc6f tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:23.143960 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d1871c68-7f26-4d3f-b203-372b777f05c5 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:04:23.145075 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-d1871c68-7f26-4d3f-b203-372b777f05c5 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:23.153841 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d1871c68-7f26-4d3f-b203-372b777f05c5 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:23.155374 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d1871c68-7f26-4d3f-b203-372b777f05c5 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:23.156680 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d1871c68-7f26-4d3f-b203-372b777f05c5 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:23.157417 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d1871c68-7f26-4d3f-b203-372b777f05c5 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:23.775577 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-d1871c68-7f26-4d3f-b203-372b777f05c5 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:23.782111 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-063743fd-abb0-4a8f-93a2-d964af64dc6f tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb3421bc9494914bc5f797b15a55643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31af2a6b9424f168dd6084d8d5fd0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:23.789685 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-063743fd-abb0-4a8f-93a2-d964af64dc6f tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/119c04bf-8692-4880-bea0-bc41ec4600de" status: 200 len: 1309 microversion: 2.1 time: 0.739178 Jan 15 21:04:23.792173 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2450/4902] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:04:23 2022] GET /compute/v2.1/servers/119c04bf-8692-4880-bea0-bc41ec4600de => generated 1309 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:04:23.819703 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-d1871c68-7f26-4d3f-b203-372b777f05c5 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:23.820503 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-b457aded-ad4f-4e98-8846-696231f63775 req-02169193-3a21-4360-b680-4866b716fc54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "119c04bf-8692-4880-bea0-bc41ec4600de", "tag": "840fd692-0a6e-49a1-b8d7-b81d5b98c408"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:23.820723 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-d1871c68-7f26-4d3f-b203-372b777f05c5 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:23.822175 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:04:23.822175 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:04:23.829945 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d1871c68-7f26-4d3f-b203-372b777f05c5 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42" status: 200 len: 1406 microversion: 2.20 time: 0.683242 Jan 15 21:04:23.831440 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2453/4903] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:04:23 2022] GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42 => generated 1406 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 15 21:04:23.837447 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-6f39a50a-2c1d-4536-acd5-44ee90aaae7d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:23.839128 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-6f39a50a-2c1d-4536-acd5-44ee90aaae7d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:23.847130 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6f39a50a-2c1d-4536-acd5-44ee90aaae7d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:23.847807 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6f39a50a-2c1d-4536-acd5-44ee90aaae7d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:23.848769 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6f39a50a-2c1d-4536-acd5-44ee90aaae7d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:23.849422 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6f39a50a-2c1d-4536-acd5-44ee90aaae7d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:23.850941 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-b457aded-ad4f-4e98-8846-696231f63775 req-02169193-3a21-4360-b680-4866b716fc54 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:23.851388 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-b457aded-ad4f-4e98-8846-696231f63775 req-02169193-3a21-4360-b680-4866b716fc54 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:23.871157 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-b457aded-ad4f-4e98-8846-696231f63775 req-02169193-3a21-4360-b680-4866b716fc54 service nova] Creating event network-changed:840fd692-0a6e-49a1-b8d7-b81d5b98c408 for instance 119c04bf-8692-4880-bea0-bc41ec4600de on nch1-master-1 Jan 15 21:04:23.879159 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-b457aded-ad4f-4e98-8846-696231f63775 req-02169193-3a21-4360-b680-4866b716fc54 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072113 Jan 15 21:04:23.879888 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2451/4904] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:04:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:04:23.886211 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8cee79e3-9923-47fb-a9d8-3181d8628970 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:23.888297 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-8cee79e3-9923-47fb-a9d8-3181d8628970 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:23.897123 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8cee79e3-9923-47fb-a9d8-3181d8628970 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:23.897702 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8cee79e3-9923-47fb-a9d8-3181d8628970 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:23.898614 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8cee79e3-9923-47fb-a9d8-3181d8628970 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:23.899289 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8cee79e3-9923-47fb-a9d8-3181d8628970 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:23.910821 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-6f39a50a-2c1d-4536-acd5-44ee90aaae7d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.076287 Jan 15 21:04:23.912153 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2454/4905] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:23 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:04:23.958329 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-8cee79e3-9923-47fb-a9d8-3181d8628970 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.076932 Jan 15 21:04:23.959615 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2452/4906] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:23 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:04:24.487904 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-05309209-186b-4e57-9edb-9429d32c2879 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:04:24.488887 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-05309209-186b-4e57-9edb-9429d32c2879 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:24.496095 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-05309209-186b-4e57-9edb-9429d32c2879 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:24.497072 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-05309209-186b-4e57-9edb-9429d32c2879 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:24.498301 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-05309209-186b-4e57-9edb-9429d32c2879 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:24.498813 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-05309209-186b-4e57-9edb-9429d32c2879 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:24.742615 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-05309209-186b-4e57-9edb-9429d32c2879 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:24.754490 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-05309209-186b-4e57-9edb-9429d32c2879 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9" status: 200 len: 1670 microversion: 2.1 time: 0.271595 Jan 15 21:04:24.755270 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2455/4907] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:04:24 2022] GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9 => generated 1670 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:04:24.775042 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-806426fd-9934-455e-a971-8fedb6d6a14a tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:04:24.775734 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-806426fd-9934-455e-a971-8fedb6d6a14a tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:24.784790 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-806426fd-9934-455e-a971-8fedb6d6a14a tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:24.785378 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-806426fd-9934-455e-a971-8fedb6d6a14a tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:24.786051 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-806426fd-9934-455e-a971-8fedb6d6a14a tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:24.787371 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-806426fd-9934-455e-a971-8fedb6d6a14a tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:24.812383 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c75a9ca2-c3f3-42c2-a185-d967c02359d0 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:04:24.813249 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c75a9ca2-c3f3-42c2-a185-d967c02359d0 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: 119c04bf-8692-4880-bea0-bc41ec4600de] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:24.819637 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c75a9ca2-c3f3-42c2-a185-d967c02359d0 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:24.820273 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c75a9ca2-c3f3-42c2-a185-d967c02359d0 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:24.821723 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c75a9ca2-c3f3-42c2-a185-d967c02359d0 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:24.822163 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c75a9ca2-c3f3-42c2-a185-d967c02359d0 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:25.154009 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-806426fd-9934-455e-a971-8fedb6d6a14a tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:25.163996 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-c75a9ca2-c3f3-42c2-a185-d967c02359d0 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb3421bc9494914bc5f797b15a55643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31af2a6b9424f168dd6084d8d5fd0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:25.169809 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-806426fd-9934-455e-a971-8fedb6d6a14a tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9" status: 200 len: 1670 microversion: 2.1 time: 0.399093 Jan 15 21:04:25.176328 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2453/4908] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:04:24 2022] GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9 => generated 1670 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:04:25.194284 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-95f60dee-6f62-4d27-a2b4-9dd1a72e0541 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:04:25.195500 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-95f60dee-6f62-4d27-a2b4-9dd1a72e0541 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:25.214255 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-95f60dee-6f62-4d27-a2b4-9dd1a72e0541 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:25.215631 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-95f60dee-6f62-4d27-a2b4-9dd1a72e0541 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:25.217234 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-95f60dee-6f62-4d27-a2b4-9dd1a72e0541 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:25.221656 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-95f60dee-6f62-4d27-a2b4-9dd1a72e0541 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:25.223515 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c75a9ca2-c3f3-42c2-a185-d967c02359d0 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/119c04bf-8692-4880-bea0-bc41ec4600de" status: 200 len: 1309 microversion: 2.1 time: 0.415552 Jan 15 21:04:25.236648 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2456/4909] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:04:24 2022] GET /compute/v2.1/servers/119c04bf-8692-4880-bea0-bc41ec4600de => generated 1309 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:04:25.250525 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-56fd9d39-f982-46d1-bdc3-ce0d1f14f64f tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:25.251529 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-56fd9d39-f982-46d1-bdc3-ce0d1f14f64f tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:25.263535 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-56fd9d39-f982-46d1-bdc3-ce0d1f14f64f tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:25.264703 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-56fd9d39-f982-46d1-bdc3-ce0d1f14f64f tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:25.265869 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-56fd9d39-f982-46d1-bdc3-ce0d1f14f64f tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:25.278598 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-56fd9d39-f982-46d1-bdc3-ce0d1f14f64f tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:25.363170 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-56fd9d39-f982-46d1-bdc3-ce0d1f14f64f tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.123954 Jan 15 21:04:25.367535 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2457/4910] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:25 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:04:25.375256 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-13f7419c-7e52-4a27-a2c3-2b92478de3bd tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:25.376551 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-13f7419c-7e52-4a27-a2c3-2b92478de3bd tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:25.395165 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-13f7419c-7e52-4a27-a2c3-2b92478de3bd tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:25.396159 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-13f7419c-7e52-4a27-a2c3-2b92478de3bd tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:25.397693 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-13f7419c-7e52-4a27-a2c3-2b92478de3bd tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:25.398347 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-13f7419c-7e52-4a27-a2c3-2b92478de3bd tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:25.460338 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-13f7419c-7e52-4a27-a2c3-2b92478de3bd tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.091016 Jan 15 21:04:25.461431 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2458/4911] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:25 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:04:25.468681 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f6f84f8f-141b-449e-abcb-547eea2163f1 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-235380816", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "networks": [{"uuid": "694fb227-829a-493b-b1b7-2dc4e238e05e"}]}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:25.537984 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.network.neutron [None req-f6f84f8f-141b-449e-abcb-547eea2163f1 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] validate_networks() for [('694fb227-829a-493b-b1b7-2dc4e238e05e', None, None, None, None, None)] {{(pid=129366) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 21:04:25.595849 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-95f60dee-6f62-4d27-a2b4-9dd1a72e0541 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:25.605077 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-95f60dee-6f62-4d27-a2b4-9dd1a72e0541 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:25.606432 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-95f60dee-6f62-4d27-a2b4-9dd1a72e0541 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:25.607821 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-95f60dee-6f62-4d27-a2b4-9dd1a72e0541 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42" status: 200 len: 1406 microversion: 2.20 time: 0.430389 Jan 15 21:04:25.608468 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2454/4912] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:04:25 2022] GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42 => generated 1406 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:04:25.767344 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-8dc3f072-05ae-48a6-b962-b393589cd8ae req-baa51a09-bc5b-4e2f-b005-e344614081b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1b412a8-0407-44fd-8f16-7cbcd8de3a42", "name": "network-vif-plugged", "status": "completed", "tag": "d027fed2-822f-40a2-a052-26b22c1aef53"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:25.769328 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:04:25.769328 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:04:25.778692 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-8dc3f072-05ae-48a6-b962-b393589cd8ae req-baa51a09-bc5b-4e2f-b005-e344614081b9 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:25.779444 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-8dc3f072-05ae-48a6-b962-b393589cd8ae req-baa51a09-bc5b-4e2f-b005-e344614081b9 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:25.792411 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-8dc3f072-05ae-48a6-b962-b393589cd8ae req-baa51a09-bc5b-4e2f-b005-e344614081b9 service nova] Creating event network-vif-plugged:d027fed2-822f-40a2-a052-26b22c1aef53 for instance a1b412a8-0407-44fd-8f16-7cbcd8de3a42 on nch2-master-1 Jan 15 21:04:25.798819 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-8dc3f072-05ae-48a6-b962-b393589cd8ae req-baa51a09-bc5b-4e2f-b005-e344614081b9 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.188731 Jan 15 21:04:25.799840 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2455/4913] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:04:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:04:26.242432 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-11bc91f3-6428-46c1-9fc7-4cdda7aca6ce tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:04:26.243044 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-11bc91f3-6428-46c1-9fc7-4cdda7aca6ce tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: 119c04bf-8692-4880-bea0-bc41ec4600de] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:26.250928 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-11bc91f3-6428-46c1-9fc7-4cdda7aca6ce tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:26.251638 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-11bc91f3-6428-46c1-9fc7-4cdda7aca6ce tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:26.252810 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-11bc91f3-6428-46c1-9fc7-4cdda7aca6ce tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:26.254717 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-11bc91f3-6428-46c1-9fc7-4cdda7aca6ce tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:26.532447 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-11bc91f3-6428-46c1-9fc7-4cdda7aca6ce tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb3421bc9494914bc5f797b15a55643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31af2a6b9424f168dd6084d8d5fd0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:26.540985 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-11bc91f3-6428-46c1-9fc7-4cdda7aca6ce tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/119c04bf-8692-4880-bea0-bc41ec4600de" status: 200 len: 1309 microversion: 2.1 time: 0.302859 Jan 15 21:04:26.541616 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2456/4914] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:04:26 2022] GET /compute/v2.1/servers/119c04bf-8692-4880-bea0-bc41ec4600de => generated 1309 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:04:26.547545 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a0fbb19d-d7d1-4e4a-a448-d0d8fe360b77 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:26.548686 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a0fbb19d-d7d1-4e4a-a448-d0d8fe360b77 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:26.555587 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a0fbb19d-d7d1-4e4a-a448-d0d8fe360b77 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:26.556255 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a0fbb19d-d7d1-4e4a-a448-d0d8fe360b77 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:26.557440 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a0fbb19d-d7d1-4e4a-a448-d0d8fe360b77 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:26.558077 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a0fbb19d-d7d1-4e4a-a448-d0d8fe360b77 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:26.574530 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-f6f84f8f-141b-449e-abcb-547eea2163f1 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Flavor limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 21:04:26.583088 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-f6f84f8f-141b-449e-abcb-547eea2163f1 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Image limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 21:04:26.587042 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-f6f84f8f-141b-449e-abcb-547eea2163f1 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Flavor pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 21:04:26.587480 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-f6f84f8f-141b-449e-abcb-547eea2163f1 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Image pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 21:04:26.588130 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-f6f84f8f-141b-449e-abcb-547eea2163f1 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 21:04:26.598912 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f6f84f8f-141b-449e-abcb-547eea2163f1 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:26.599393 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f6f84f8f-141b-449e-abcb-547eea2163f1 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:26.600231 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f6f84f8f-141b-449e-abcb-547eea2163f1 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:26.600676 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f6f84f8f-141b-449e-abcb-547eea2163f1 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:26.605033 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a0fbb19d-d7d1-4e4a-a448-d0d8fe360b77 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.061822 Jan 15 21:04:26.606875 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2457/4915] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:26 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:04:26.612202 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-4c8d7c69-541e-4bfd-8974-22a81a9de786 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:26.613442 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-4c8d7c69-541e-4bfd-8974-22a81a9de786 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:26.621360 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4c8d7c69-541e-4bfd-8974-22a81a9de786 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:26.622110 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4c8d7c69-541e-4bfd-8974-22a81a9de786 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:26.622699 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-f6f84f8f-141b-449e-abcb-547eea2163f1 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Getting quotas for project e3a611cade394cb288f103fcf516e4ab. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:04:26.622902 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4c8d7c69-541e-4bfd-8974-22a81a9de786 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:26.623494 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4c8d7c69-541e-4bfd-8974-22a81a9de786 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:26.630718 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-f6f84f8f-141b-449e-abcb-547eea2163f1 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Getting quotas for user 7f1ee75d18ae4db8825653f6e8180b72 and project e3a611cade394cb288f103fcf516e4ab. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:04:26.643992 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f6f84f8f-141b-449e-abcb-547eea2163f1 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Going to run 1 instances... {{(pid=129366) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 21:04:26.646626 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f6f84f8f-141b-449e-abcb-547eea2163f1 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 1d45824f-26ca-49c6-971e-f502336f956f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 21:04:26.672341 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-4c8d7c69-541e-4bfd-8974-22a81a9de786 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.064351 Jan 15 21:04:26.674068 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2458/4916] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:26 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:04:26.679754 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-1fed418d-5fac-4408-a17c-96fa76cba8b3 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:04:26.680676 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-1fed418d-5fac-4408-a17c-96fa76cba8b3 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:26.689099 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1fed418d-5fac-4408-a17c-96fa76cba8b3 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:26.689776 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1fed418d-5fac-4408-a17c-96fa76cba8b3 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:26.690567 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1fed418d-5fac-4408-a17c-96fa76cba8b3 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:26.691002 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1fed418d-5fac-4408-a17c-96fa76cba8b3 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:26.702862 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f6f84f8f-141b-449e-abcb-547eea2163f1 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.239991 Jan 15 21:04:26.703749 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2459/4917] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 21:04:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1242 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 21:04:26.716493 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0aa27bb4-c4c8-4a8b-910f-f58e751635b0 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:04:26.718521 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-0aa27bb4-c4c8-4a8b-910f-f58e751635b0 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 1d45824f-26ca-49c6-971e-f502336f956f] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:26.790636 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-0aa27bb4-c4c8-4a8b-910f-f58e751635b0 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:26.798853 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0aa27bb4-c4c8-4a8b-910f-f58e751635b0 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/1d45824f-26ca-49c6-971e-f502336f956f" status: 200 len: 1214 microversion: 2.1 time: 0.088952 Jan 15 21:04:26.800625 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2460/4918] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:04:26 2022] GET /compute/v2.1/servers/1d45824f-26ca-49c6-971e-f502336f956f => generated 1214 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:04:26.884197 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-1fed418d-5fac-4408-a17c-96fa76cba8b3 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:26.893099 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-1fed418d-5fac-4408-a17c-96fa76cba8b3 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:26.894624 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-1fed418d-5fac-4408-a17c-96fa76cba8b3 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:26.895762 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-1fed418d-5fac-4408-a17c-96fa76cba8b3 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42" status: 200 len: 1406 microversion: 2.20 time: 0.220258 Jan 15 21:04:26.896334 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2459/4919] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:04:26 2022] GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42 => generated 1406 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:04:27.561087 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9f1a943a-50fa-416c-b56e-55d0aa8de0a2 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:04:27.561912 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-9f1a943a-50fa-416c-b56e-55d0aa8de0a2 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: 119c04bf-8692-4880-bea0-bc41ec4600de] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:27.569621 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9f1a943a-50fa-416c-b56e-55d0aa8de0a2 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:27.570142 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9f1a943a-50fa-416c-b56e-55d0aa8de0a2 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:27.571004 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9f1a943a-50fa-416c-b56e-55d0aa8de0a2 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:27.571536 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9f1a943a-50fa-416c-b56e-55d0aa8de0a2 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:27.617250 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-79c6f6b1-3344-4175-b6e2-bddeb9cd74e3 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:27.618982 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-79c6f6b1-3344-4175-b6e2-bddeb9cd74e3 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:27.626421 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-79c6f6b1-3344-4175-b6e2-bddeb9cd74e3 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:27.627134 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-79c6f6b1-3344-4175-b6e2-bddeb9cd74e3 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:27.628331 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-79c6f6b1-3344-4175-b6e2-bddeb9cd74e3 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:27.629035 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-79c6f6b1-3344-4175-b6e2-bddeb9cd74e3 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:27.677620 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-79c6f6b1-3344-4175-b6e2-bddeb9cd74e3 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.063587 Jan 15 21:04:27.678871 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2460/4920] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:27 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:04:27.687601 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5e0602ec-af2f-4235-a2cf-f17fdd694891 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:27.689153 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-5e0602ec-af2f-4235-a2cf-f17fdd694891 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:27.701997 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5e0602ec-af2f-4235-a2cf-f17fdd694891 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:27.702728 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5e0602ec-af2f-4235-a2cf-f17fdd694891 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:27.703635 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5e0602ec-af2f-4235-a2cf-f17fdd694891 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:27.704227 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5e0602ec-af2f-4235-a2cf-f17fdd694891 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:27.732413 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-9f1a943a-50fa-416c-b56e-55d0aa8de0a2 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb3421bc9494914bc5f797b15a55643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31af2a6b9424f168dd6084d8d5fd0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:27.749855 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-9f1a943a-50fa-416c-b56e-55d0aa8de0a2 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/119c04bf-8692-4880-bea0-bc41ec4600de" status: 200 len: 1309 microversion: 2.1 time: 0.192886 Jan 15 21:04:27.751843 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2461/4921] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:04:27 2022] GET /compute/v2.1/servers/119c04bf-8692-4880-bea0-bc41ec4600de => generated 1309 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:04:27.769311 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5e0602ec-af2f-4235-a2cf-f17fdd694891 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.088760 Jan 15 21:04:27.772080 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2461/4922] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:27 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:04:27.818206 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-89ed4c0c-c6c0-4e04-833c-ee4983aca3ff tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:04:27.819053 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-89ed4c0c-c6c0-4e04-833c-ee4983aca3ff tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 1d45824f-26ca-49c6-971e-f502336f956f] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:27.831907 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-89ed4c0c-c6c0-4e04-833c-ee4983aca3ff tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:27.832349 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-89ed4c0c-c6c0-4e04-833c-ee4983aca3ff tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:27.836162 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-89ed4c0c-c6c0-4e04-833c-ee4983aca3ff tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:27.837174 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-89ed4c0c-c6c0-4e04-833c-ee4983aca3ff tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:27.915811 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-78414488-a7a1-4663-88b4-f72c68acd958 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:04:27.916537 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-78414488-a7a1-4663-88b4-f72c68acd958 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:27.934578 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-78414488-a7a1-4663-88b4-f72c68acd958 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:27.935293 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-78414488-a7a1-4663-88b4-f72c68acd958 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:27.936167 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-78414488-a7a1-4663-88b4-f72c68acd958 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:27.936625 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-78414488-a7a1-4663-88b4-f72c68acd958 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:27.976674 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-89ed4c0c-c6c0-4e04-833c-ee4983aca3ff tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:27.986672 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-89ed4c0c-c6c0-4e04-833c-ee4983aca3ff tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/1d45824f-26ca-49c6-971e-f502336f956f" status: 200 len: 1274 microversion: 2.1 time: 0.173072 Jan 15 21:04:27.988705 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2462/4923] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:04:27 2022] GET /compute/v2.1/servers/1d45824f-26ca-49c6-971e-f502336f956f => generated 1274 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:04:28.000504 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-6919319d-7f85-4bba-aa15-041d8a180600 req-f1f12d1d-3593-4e76-9a46-e55b1f84a268 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "119c04bf-8692-4880-bea0-bc41ec4600de", "name": "network-vif-plugged", "status": "completed", "tag": "840fd692-0a6e-49a1-b8d7-b81d5b98c408"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:28.007753 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:04:28.007753 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:04:28.017085 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-6919319d-7f85-4bba-aa15-041d8a180600 req-f1f12d1d-3593-4e76-9a46-e55b1f84a268 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:28.020139 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-6919319d-7f85-4bba-aa15-041d8a180600 req-f1f12d1d-3593-4e76-9a46-e55b1f84a268 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:28.033891 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-6919319d-7f85-4bba-aa15-041d8a180600 req-f1f12d1d-3593-4e76-9a46-e55b1f84a268 service nova] Creating event network-vif-plugged:840fd692-0a6e-49a1-b8d7-b81d5b98c408 for instance 119c04bf-8692-4880-bea0-bc41ec4600de on nch1-master-1 Jan 15 21:04:28.041167 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-6919319d-7f85-4bba-aa15-041d8a180600 req-f1f12d1d-3593-4e76-9a46-e55b1f84a268 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050951 Jan 15 21:04:28.042121 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2463/4924] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:04:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:04:28.140572 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-78414488-a7a1-4663-88b4-f72c68acd958 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:28.152015 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-78414488-a7a1-4663-88b4-f72c68acd958 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:28.154215 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-78414488-a7a1-4663-88b4-f72c68acd958 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:28.155406 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-78414488-a7a1-4663-88b4-f72c68acd958 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42" status: 200 len: 1597 microversion: 2.20 time: 0.245048 Jan 15 21:04:28.155975 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2462/4925] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:04:27 2022] GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42 => generated 1597 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:04:28.175810 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-71fc982d-6cce-4846-b824-bac92d21c163 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:04:28.177002 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-71fc982d-6cce-4846-b824-bac92d21c163 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:28.186225 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-71fc982d-6cce-4846-b824-bac92d21c163 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:28.186687 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-71fc982d-6cce-4846-b824-bac92d21c163 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:28.187491 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-71fc982d-6cce-4846-b824-bac92d21c163 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:28.187929 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-71fc982d-6cce-4846-b824-bac92d21c163 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:28.290839 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-71fc982d-6cce-4846-b824-bac92d21c163 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.119791 Jan 15 21:04:28.291469 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2464/4926] 10.222.0.46 () {60 vars in 1315 bytes} [Sat Jan 15 21:04:28 2022] GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/os-interface => generated 284 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:04:28.690505 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-01b18292-41e9-4070-a942-75710b036cc6 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:28.691829 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-01b18292-41e9-4070-a942-75710b036cc6 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:28.705325 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-01b18292-41e9-4070-a942-75710b036cc6 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:28.706071 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-01b18292-41e9-4070-a942-75710b036cc6 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:28.707011 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-01b18292-41e9-4070-a942-75710b036cc6 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:28.707618 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-01b18292-41e9-4070-a942-75710b036cc6 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:28.776910 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-01b18292-41e9-4070-a942-75710b036cc6 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.090386 Jan 15 21:04:28.778349 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2463/4927] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:28 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:04:28.783673 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-80ff7c32-e98b-497b-88c4-ae5524f8b7c3 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:28.785540 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-6f830fb6-b8e4-4b9a-b97b-d8c5c6ad9add tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:04:28.787698 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-6f830fb6-b8e4-4b9a-b97b-d8c5c6ad9add tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: 119c04bf-8692-4880-bea0-bc41ec4600de] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:28.790279 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-80ff7c32-e98b-497b-88c4-ae5524f8b7c3 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:28.796990 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6f830fb6-b8e4-4b9a-b97b-d8c5c6ad9add tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:28.798029 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6f830fb6-b8e4-4b9a-b97b-d8c5c6ad9add tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:28.799070 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6f830fb6-b8e4-4b9a-b97b-d8c5c6ad9add tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:28.800747 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6f830fb6-b8e4-4b9a-b97b-d8c5c6ad9add tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:28.811594 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-80ff7c32-e98b-497b-88c4-ae5524f8b7c3 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:28.812055 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-80ff7c32-e98b-497b-88c4-ae5524f8b7c3 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:28.813002 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-80ff7c32-e98b-497b-88c4-ae5524f8b7c3 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:28.819542 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-80ff7c32-e98b-497b-88c4-ae5524f8b7c3 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:28.909523 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-80ff7c32-e98b-497b-88c4-ae5524f8b7c3 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.129016 Jan 15 21:04:28.911513 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2464/4928] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:28 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:04:29.008103 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-174bb2b5-c6a0-4f53-b1ea-356a70f473ec tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:04:29.013671 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-174bb2b5-c6a0-4f53-b1ea-356a70f473ec tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 1d45824f-26ca-49c6-971e-f502336f956f] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:29.025483 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-174bb2b5-c6a0-4f53-b1ea-356a70f473ec tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:29.026644 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-174bb2b5-c6a0-4f53-b1ea-356a70f473ec tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:29.029018 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-174bb2b5-c6a0-4f53-b1ea-356a70f473ec tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:29.029894 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-174bb2b5-c6a0-4f53-b1ea-356a70f473ec tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:29.178625 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-6f830fb6-b8e4-4b9a-b97b-d8c5c6ad9add tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb3421bc9494914bc5f797b15a55643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31af2a6b9424f168dd6084d8d5fd0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:29.189171 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-174bb2b5-c6a0-4f53-b1ea-356a70f473ec tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:29.191300 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-6f830fb6-b8e4-4b9a-b97b-d8c5c6ad9add tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/119c04bf-8692-4880-bea0-bc41ec4600de" status: 200 len: 1309 microversion: 2.1 time: 0.426806 Jan 15 21:04:29.193153 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2465/4929] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:04:28 2022] GET /compute/v2.1/servers/119c04bf-8692-4880-bea0-bc41ec4600de => generated 1309 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:04:29.213543 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-174bb2b5-c6a0-4f53-b1ea-356a70f473ec tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/1d45824f-26ca-49c6-971e-f502336f956f" status: 200 len: 1272 microversion: 2.1 time: 0.210325 Jan 15 21:04:29.214449 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2465/4930] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:04:29 2022] GET /compute/v2.1/servers/1d45824f-26ca-49c6-971e-f502336f956f => generated 1272 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:04:29.790846 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-658b7a18-f932-4fff-9b43-30405b323a29 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:29.792724 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-658b7a18-f932-4fff-9b43-30405b323a29 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:29.812174 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-658b7a18-f932-4fff-9b43-30405b323a29 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:29.812907 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-658b7a18-f932-4fff-9b43-30405b323a29 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:29.814601 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-658b7a18-f932-4fff-9b43-30405b323a29 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:29.816321 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-658b7a18-f932-4fff-9b43-30405b323a29 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:29.881928 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-658b7a18-f932-4fff-9b43-30405b323a29 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.095979 Jan 15 21:04:29.887418 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2466/4931] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:29 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:04:29.923613 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-741b2627-0b08-48a3-8ce4-2cb27ddd14d9 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:29.924537 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-741b2627-0b08-48a3-8ce4-2cb27ddd14d9 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:29.931376 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-741b2627-0b08-48a3-8ce4-2cb27ddd14d9 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:29.932092 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-741b2627-0b08-48a3-8ce4-2cb27ddd14d9 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:29.933100 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-741b2627-0b08-48a3-8ce4-2cb27ddd14d9 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:29.934409 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-741b2627-0b08-48a3-8ce4-2cb27ddd14d9 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:29.984394 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-741b2627-0b08-48a3-8ce4-2cb27ddd14d9 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.064453 Jan 15 21:04:29.985845 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2466/4932] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:29 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:04:30.139792 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-167e6ca2-fc61-4ef3-a921-33db585cb4c9 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:30.141919 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-167e6ca2-fc61-4ef3-a921-33db585cb4c9 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:30.155417 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-167e6ca2-fc61-4ef3-a921-33db585cb4c9 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:30.157014 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-167e6ca2-fc61-4ef3-a921-33db585cb4c9 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:30.158065 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-167e6ca2-fc61-4ef3-a921-33db585cb4c9 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:30.159781 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-167e6ca2-fc61-4ef3-a921-33db585cb4c9 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:30.223019 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-167e6ca2-fc61-4ef3-a921-33db585cb4c9 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action" status: 200 len: 14 microversion: 2.20 time: 0.089052 Jan 15 21:04:30.225063 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2467/4933] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:30 2022] POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action => generated 14 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:04:30.235161 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a39a760d-1449-42d4-9bbe-f0eae5966cbb tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:04:30.236157 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a39a760d-1449-42d4-9bbe-f0eae5966cbb tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: 119c04bf-8692-4880-bea0-bc41ec4600de] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:30.244810 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a39a760d-1449-42d4-9bbe-f0eae5966cbb tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:30.246317 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a39a760d-1449-42d4-9bbe-f0eae5966cbb tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:30.247478 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a39a760d-1449-42d4-9bbe-f0eae5966cbb tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:30.248374 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a39a760d-1449-42d4-9bbe-f0eae5966cbb tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:30.405872 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-42c8000a-055a-4e7f-97a6-c712a5cc873b req-79b42b54-409e-4b27-b430-47d5d7377d50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1b412a8-0407-44fd-8f16-7cbcd8de3a42", "tag": "d027fed2-822f-40a2-a052-26b22c1aef53"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:30.407489 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:04:30.407489 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:04:30.415573 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-42c8000a-055a-4e7f-97a6-c712a5cc873b req-79b42b54-409e-4b27-b430-47d5d7377d50 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:30.416245 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-42c8000a-055a-4e7f-97a6-c712a5cc873b req-79b42b54-409e-4b27-b430-47d5d7377d50 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:30.437503 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-42c8000a-055a-4e7f-97a6-c712a5cc873b req-79b42b54-409e-4b27-b430-47d5d7377d50 service nova] Creating event network-changed:d027fed2-822f-40a2-a052-26b22c1aef53 for instance a1b412a8-0407-44fd-8f16-7cbcd8de3a42 on nch2-master-1 Jan 15 21:04:30.444119 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-42c8000a-055a-4e7f-97a6-c712a5cc873b req-79b42b54-409e-4b27-b430-47d5d7377d50 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.305449 Jan 15 21:04:30.445361 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2467/4934] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:04:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:04:30.454719 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c459f187-26c7-4536-9ff1-5d344a44ac92 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:04:30.455709 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c459f187-26c7-4536-9ff1-5d344a44ac92 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 1d45824f-26ca-49c6-971e-f502336f956f] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:30.463608 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c459f187-26c7-4536-9ff1-5d344a44ac92 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:30.466487 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c459f187-26c7-4536-9ff1-5d344a44ac92 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:30.467644 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c459f187-26c7-4536-9ff1-5d344a44ac92 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:30.468108 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c459f187-26c7-4536-9ff1-5d344a44ac92 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:30.645710 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-a39a760d-1449-42d4-9bbe-f0eae5966cbb tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb3421bc9494914bc5f797b15a55643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31af2a6b9424f168dd6084d8d5fd0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:30.657861 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a39a760d-1449-42d4-9bbe-f0eae5966cbb tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/119c04bf-8692-4880-bea0-bc41ec4600de" status: 200 len: 1491 microversion: 2.1 time: 0.428097 Jan 15 21:04:30.669901 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2468/4935] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:04:30 2022] GET /compute/v2.1/servers/119c04bf-8692-4880-bea0-bc41ec4600de => generated 1491 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:04:30.681087 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8a446887-2dee-431a-95cb-9d9eb4113277 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:30.683250 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-8a446887-2dee-431a-95cb-9d9eb4113277 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: 119c04bf-8692-4880-bea0-bc41ec4600de] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:30.700048 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8a446887-2dee-431a-95cb-9d9eb4113277 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:30.700406 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8a446887-2dee-431a-95cb-9d9eb4113277 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:30.701261 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8a446887-2dee-431a-95cb-9d9eb4113277 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:30.701695 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8a446887-2dee-431a-95cb-9d9eb4113277 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:30.841121 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-8a446887-2dee-431a-95cb-9d9eb4113277 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "PUT /compute/v2.1/servers/119c04bf-8692-4880-bea0-bc41ec4600de" status: 200 len: 1086 microversion: 2.1 time: 0.169992 Jan 15 21:04:30.858245 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2469/4936] 10.222.0.46 () {60 vars in 1255 bytes} [Sat Jan 15 21:04:30 2022] PUT /compute/v2.1/servers/119c04bf-8692-4880-bea0-bc41ec4600de => generated 1086 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:04:30.862969 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1aad4616-1ef4-44a1-b9f7-1bf831c33012 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:04:30.878221 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-1aad4616-1ef4-44a1-b9f7-1bf831c33012 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: 119c04bf-8692-4880-bea0-bc41ec4600de] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:30.894414 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1aad4616-1ef4-44a1-b9f7-1bf831c33012 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:30.896481 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1aad4616-1ef4-44a1-b9f7-1bf831c33012 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:30.900791 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1aad4616-1ef4-44a1-b9f7-1bf831c33012 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:30.902088 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1aad4616-1ef4-44a1-b9f7-1bf831c33012 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:31.053099 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-c459f187-26c7-4536-9ff1-5d344a44ac92 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:31.061804 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c459f187-26c7-4536-9ff1-5d344a44ac92 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/1d45824f-26ca-49c6-971e-f502336f956f" status: 200 len: 1314 microversion: 2.1 time: 0.614147 Jan 15 21:04:31.079450 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2468/4937] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:04:30 2022] GET /compute/v2.1/servers/1d45824f-26ca-49c6-971e-f502336f956f => generated 1314 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:04:31.084979 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-6e29ca0e-2a12-4cee-b2b1-a9459932104c tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:31.096160 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-6e29ca0e-2a12-4cee-b2b1-a9459932104c tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:31.112830 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6e29ca0e-2a12-4cee-b2b1-a9459932104c tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:31.113927 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6e29ca0e-2a12-4cee-b2b1-a9459932104c tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:31.115160 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6e29ca0e-2a12-4cee-b2b1-a9459932104c tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:31.116282 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6e29ca0e-2a12-4cee-b2b1-a9459932104c tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:31.214562 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-6e29ca0e-2a12-4cee-b2b1-a9459932104c tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.133136 Jan 15 21:04:31.215942 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2469/4938] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:31 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:04:31.230157 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f36ab5fe-0d79-4221-8bdc-67cef0ebb726 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:31.233515 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f36ab5fe-0d79-4221-8bdc-67cef0ebb726 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:31.247554 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f36ab5fe-0d79-4221-8bdc-67cef0ebb726 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:31.252434 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f36ab5fe-0d79-4221-8bdc-67cef0ebb726 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:31.253247 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f36ab5fe-0d79-4221-8bdc-67cef0ebb726 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:31.253699 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f36ab5fe-0d79-4221-8bdc-67cef0ebb726 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:31.341646 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f36ab5fe-0d79-4221-8bdc-67cef0ebb726 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.123245 Jan 15 21:04:31.342981 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2470/4939] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:31 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:04:31.358753 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f17182e8-79ff-4f6d-ad8f-f483dc7e8b96 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:31.362439 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f17182e8-79ff-4f6d-ad8f-f483dc7e8b96 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:31.384361 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-1aad4616-1ef4-44a1-b9f7-1bf831c33012 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb3421bc9494914bc5f797b15a55643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31af2a6b9424f168dd6084d8d5fd0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:31.389429 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f17182e8-79ff-4f6d-ad8f-f483dc7e8b96 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:31.393405 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f17182e8-79ff-4f6d-ad8f-f483dc7e8b96 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:31.395831 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f17182e8-79ff-4f6d-ad8f-f483dc7e8b96 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:31.397227 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f17182e8-79ff-4f6d-ad8f-f483dc7e8b96 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:31.398052 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-1aad4616-1ef4-44a1-b9f7-1bf831c33012 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/119c04bf-8692-4880-bea0-bc41ec4600de" status: 200 len: 1512 microversion: 2.1 time: 0.538457 Jan 15 21:04:31.406949 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2470/4940] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:04:30 2022] GET /compute/v2.1/servers/119c04bf-8692-4880-bea0-bc41ec4600de => generated 1512 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:04:31.421324 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0cdb9a3c-1d74-4c4b-bbe0-2704ec44a234 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:04:31.422263 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-0cdb9a3c-1d74-4c4b-bbe0-2704ec44a234 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: 119c04bf-8692-4880-bea0-bc41ec4600de] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:31.434119 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0cdb9a3c-1d74-4c4b-bbe0-2704ec44a234 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:31.435689 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0cdb9a3c-1d74-4c4b-bbe0-2704ec44a234 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:31.436680 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0cdb9a3c-1d74-4c4b-bbe0-2704ec44a234 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:31.437322 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0cdb9a3c-1d74-4c4b-bbe0-2704ec44a234 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:31.487792 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f17182e8-79ff-4f6d-ad8f-f483dc7e8b96 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action" status: 200 len: 14 microversion: 2.20 time: 0.140909 Jan 15 21:04:31.492305 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2471/4941] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:31 2022] POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action => generated 14 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:04:32.081619 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-62e0743c-6bc7-4df0-8f7b-b01e884ce080 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:04:32.083062 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-62e0743c-6bc7-4df0-8f7b-b01e884ce080 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 1d45824f-26ca-49c6-971e-f502336f956f] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:32.092392 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-62e0743c-6bc7-4df0-8f7b-b01e884ce080 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:32.093198 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-62e0743c-6bc7-4df0-8f7b-b01e884ce080 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:32.094233 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-62e0743c-6bc7-4df0-8f7b-b01e884ce080 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:32.094889 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-62e0743c-6bc7-4df0-8f7b-b01e884ce080 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:32.171493 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-0cdb9a3c-1d74-4c4b-bbe0-2704ec44a234 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb3421bc9494914bc5f797b15a55643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31af2a6b9424f168dd6084d8d5fd0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:32.185690 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0cdb9a3c-1d74-4c4b-bbe0-2704ec44a234 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/119c04bf-8692-4880-bea0-bc41ec4600de" status: 200 len: 1512 microversion: 2.1 time: 0.768749 Jan 15 21:04:32.198126 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2471/4942] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:04:31 2022] GET /compute/v2.1/servers/119c04bf-8692-4880-bea0-bc41ec4600de => generated 1512 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:04:32.206719 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f7cc7b46-9abe-4f5b-bb1a-84c5b9b880a1 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:04:32.207274 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f7cc7b46-9abe-4f5b-bb1a-84c5b9b880a1 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: 119c04bf-8692-4880-bea0-bc41ec4600de] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:32.227322 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f7cc7b46-9abe-4f5b-bb1a-84c5b9b880a1 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:32.230002 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f7cc7b46-9abe-4f5b-bb1a-84c5b9b880a1 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:32.234298 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f7cc7b46-9abe-4f5b-bb1a-84c5b9b880a1 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:32.235338 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f7cc7b46-9abe-4f5b-bb1a-84c5b9b880a1 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:32.279211 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f7cc7b46-9abe-4f5b-bb1a-84c5b9b880a1 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: 119c04bf-8692-4880-bea0-bc41ec4600de] Going to try to terminate instance {{(pid=129366) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 21:04:32.414170 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-62e0743c-6bc7-4df0-8f7b-b01e884ce080 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:32.419834 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f7cc7b46-9abe-4f5b-bb1a-84c5b9b880a1 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "DELETE /compute/v2.1/servers/119c04bf-8692-4880-bea0-bc41ec4600de" status: 204 len: 0 microversion: 2.1 time: 0.221298 Jan 15 21:04:32.420428 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2472/4943] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 21:04:32 2022] DELETE /compute/v2.1/servers/119c04bf-8692-4880-bea0-bc41ec4600de => generated 0 bytes in 223 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 21:04:32.426773 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-62e0743c-6bc7-4df0-8f7b-b01e884ce080 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/1d45824f-26ca-49c6-971e-f502336f956f" status: 200 len: 1314 microversion: 2.1 time: 0.349329 Jan 15 21:04:32.434932 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2472/4944] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:04:32 2022] GET /compute/v2.1/servers/1d45824f-26ca-49c6-971e-f502336f956f => generated 1314 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:04:32.435125 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f0c5f2cc-7bb0-4f53-9547-ec0363011067 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:32.435125 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f0c5f2cc-7bb0-4f53-9547-ec0363011067 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:32.438757 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-00b8f61d-0a47-47f7-8b4a-e0df99d1d6e8 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:32.439754 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-00b8f61d-0a47-47f7-8b4a-e0df99d1d6e8 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:32.442036 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f0c5f2cc-7bb0-4f53-9547-ec0363011067 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:32.443109 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f0c5f2cc-7bb0-4f53-9547-ec0363011067 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:32.444107 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f0c5f2cc-7bb0-4f53-9547-ec0363011067 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:32.445254 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f0c5f2cc-7bb0-4f53-9547-ec0363011067 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:32.447364 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-00b8f61d-0a47-47f7-8b4a-e0df99d1d6e8 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:32.447909 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-00b8f61d-0a47-47f7-8b4a-e0df99d1d6e8 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:32.448771 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-00b8f61d-0a47-47f7-8b4a-e0df99d1d6e8 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:32.449841 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-00b8f61d-0a47-47f7-8b4a-e0df99d1d6e8 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:32.504873 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f0c5f2cc-7bb0-4f53-9547-ec0363011067 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.082281 Jan 15 21:04:32.506945 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2473/4945] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:32 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:04:32.514733 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c0db4343-331f-49ba-ace9-99721c22e922 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:04:32.515540 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c0db4343-331f-49ba-ace9-99721c22e922 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: 119c04bf-8692-4880-bea0-bc41ec4600de] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:32.525797 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c0db4343-331f-49ba-ace9-99721c22e922 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:32.526331 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c0db4343-331f-49ba-ace9-99721c22e922 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:32.526847 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-00b8f61d-0a47-47f7-8b4a-e0df99d1d6e8 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.097715 Jan 15 21:04:32.527945 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c0db4343-331f-49ba-ace9-99721c22e922 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:32.528109 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2473/4946] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:32 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:04:32.536214 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9cf370bd-a0ee-4e84-a71a-e649c622803e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:32.539154 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c0db4343-331f-49ba-ace9-99721c22e922 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:32.543071 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-9cf370bd-a0ee-4e84-a71a-e649c622803e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:32.568532 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9cf370bd-a0ee-4e84-a71a-e649c622803e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:32.569032 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9cf370bd-a0ee-4e84-a71a-e649c622803e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:32.574661 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9cf370bd-a0ee-4e84-a71a-e649c622803e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:32.575604 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9cf370bd-a0ee-4e84-a71a-e649c622803e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:32.635804 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-9cf370bd-a0ee-4e84-a71a-e649c622803e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action" status: 200 len: 14 microversion: 2.20 time: 0.105903 Jan 15 21:04:32.640368 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2474/4947] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:32 2022] POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action => generated 14 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:04:32.797978 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-c0db4343-331f-49ba-ace9-99721c22e922 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb3421bc9494914bc5f797b15a55643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31af2a6b9424f168dd6084d8d5fd0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:32.812690 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c0db4343-331f-49ba-ace9-99721c22e922 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/119c04bf-8692-4880-bea0-bc41ec4600de" status: 200 len: 1518 microversion: 2.1 time: 0.303610 Jan 15 21:04:32.813326 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2474/4948] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:04:32 2022] GET /compute/v2.1/servers/119c04bf-8692-4880-bea0-bc41ec4600de => generated 1518 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:04:32.939189 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-d786e4c3-c219-4914-86fe-e81e9d43b734 req-e9adcfa2-d2c9-4906-8f87-1eb674592a93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d45824f-26ca-49c6-971e-f502336f956f", "tag": "ab07dc98-af7c-4650-b36e-d8be43ca08c1"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:32.942803 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:04:32.942803 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:04:32.967742 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-d786e4c3-c219-4914-86fe-e81e9d43b734 req-e9adcfa2-d2c9-4906-8f87-1eb674592a93 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:32.968206 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-d786e4c3-c219-4914-86fe-e81e9d43b734 req-e9adcfa2-d2c9-4906-8f87-1eb674592a93 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:32.995064 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-d786e4c3-c219-4914-86fe-e81e9d43b734 req-e9adcfa2-d2c9-4906-8f87-1eb674592a93 service nova] Creating event network-changed:ab07dc98-af7c-4650-b36e-d8be43ca08c1 for instance 1d45824f-26ca-49c6-971e-f502336f956f on nch2-master-1 Jan 15 21:04:33.008140 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-d786e4c3-c219-4914-86fe-e81e9d43b734 req-e9adcfa2-d2c9-4906-8f87-1eb674592a93 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076436 Jan 15 21:04:33.009621 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2475/4949] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:04:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 21:04:33.444663 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c312318d-fe89-4c68-8e4e-f17d65944148 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:04:33.445321 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c312318d-fe89-4c68-8e4e-f17d65944148 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 1d45824f-26ca-49c6-971e-f502336f956f] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:33.455635 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c312318d-fe89-4c68-8e4e-f17d65944148 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:33.457134 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c312318d-fe89-4c68-8e4e-f17d65944148 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:33.458573 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c312318d-fe89-4c68-8e4e-f17d65944148 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:33.459415 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c312318d-fe89-4c68-8e4e-f17d65944148 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:33.528768 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-94f6ec48-4cd6-46cf-aae8-a3adfcd03e8a tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:33.535643 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-94f6ec48-4cd6-46cf-aae8-a3adfcd03e8a tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:33.548756 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-94f6ec48-4cd6-46cf-aae8-a3adfcd03e8a tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:33.553866 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-94f6ec48-4cd6-46cf-aae8-a3adfcd03e8a tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:33.559520 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-94f6ec48-4cd6-46cf-aae8-a3adfcd03e8a tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:33.560336 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-94f6ec48-4cd6-46cf-aae8-a3adfcd03e8a tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:33.608381 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-94f6ec48-4cd6-46cf-aae8-a3adfcd03e8a tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.091579 Jan 15 21:04:33.613037 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2476/4950] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:33 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:04:33.731861 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-c312318d-fe89-4c68-8e4e-f17d65944148 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:33.743865 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c312318d-fe89-4c68-8e4e-f17d65944148 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/1d45824f-26ca-49c6-971e-f502336f956f" status: 200 len: 1314 microversion: 2.1 time: 0.301271 Jan 15 21:04:33.744504 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2475/4951] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:04:33 2022] GET /compute/v2.1/servers/1d45824f-26ca-49c6-971e-f502336f956f => generated 1314 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:04:33.749822 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1cb48ec4-2249-4268-8dfd-8abc474fbd2a tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:33.750738 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-1cb48ec4-2249-4268-8dfd-8abc474fbd2a tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:33.768162 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1cb48ec4-2249-4268-8dfd-8abc474fbd2a tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:33.769352 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1cb48ec4-2249-4268-8dfd-8abc474fbd2a tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:33.770232 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1cb48ec4-2249-4268-8dfd-8abc474fbd2a tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:33.770681 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1cb48ec4-2249-4268-8dfd-8abc474fbd2a tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:33.831524 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-1cb48ec4-2249-4268-8dfd-8abc474fbd2a tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action" status: 200 len: 14 microversion: 2.20 time: 0.085707 Jan 15 21:04:33.836139 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2476/4952] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:33 2022] POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action => generated 14 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:04:33.843654 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0d673fb4-5ecf-46e9-8d55-7df2836328bb tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:04:33.850075 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-0d673fb4-5ecf-46e9-8d55-7df2836328bb tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: 119c04bf-8692-4880-bea0-bc41ec4600de] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:33.863832 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0d673fb4-5ecf-46e9-8d55-7df2836328bb tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:33.869688 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0d673fb4-5ecf-46e9-8d55-7df2836328bb tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:33.870950 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0d673fb4-5ecf-46e9-8d55-7df2836328bb tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:33.873719 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0d673fb4-5ecf-46e9-8d55-7df2836328bb tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:34.017979 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3cd08a39-2eef-49f5-af66-7e2760ebcd87 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:34.020209 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-3cd08a39-2eef-49f5-af66-7e2760ebcd87 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:34.029542 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3cd08a39-2eef-49f5-af66-7e2760ebcd87 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:34.030270 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3cd08a39-2eef-49f5-af66-7e2760ebcd87 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:34.031361 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3cd08a39-2eef-49f5-af66-7e2760ebcd87 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:34.032325 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3cd08a39-2eef-49f5-af66-7e2760ebcd87 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:34.098681 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3cd08a39-2eef-49f5-af66-7e2760ebcd87 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.483066 Jan 15 21:04:34.099617 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2477/4953] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:33 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:04:34.206130 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-0d673fb4-5ecf-46e9-8d55-7df2836328bb tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb3421bc9494914bc5f797b15a55643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31af2a6b9424f168dd6084d8d5fd0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:34.213837 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0d673fb4-5ecf-46e9-8d55-7df2836328bb tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/119c04bf-8692-4880-bea0-bc41ec4600de" status: 200 len: 1518 microversion: 2.1 time: 0.374691 Jan 15 21:04:34.223718 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2477/4954] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:04:33 2022] GET /compute/v2.1/servers/119c04bf-8692-4880-bea0-bc41ec4600de => generated 1518 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:04:34.622312 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8dc80f56-7460-42ec-ac26-ade357a57d70 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:34.624144 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-8dc80f56-7460-42ec-ac26-ade357a57d70 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:34.631501 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8dc80f56-7460-42ec-ac26-ade357a57d70 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:34.632200 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8dc80f56-7460-42ec-ac26-ade357a57d70 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:34.633236 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8dc80f56-7460-42ec-ac26-ade357a57d70 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:34.633868 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8dc80f56-7460-42ec-ac26-ade357a57d70 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:34.692005 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-8dc80f56-7460-42ec-ac26-ade357a57d70 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.074419 Jan 15 21:04:34.693659 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2478/4955] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:34 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:04:34.762226 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-89028a6c-bec8-4844-97af-f6031806db67 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:04:34.763443 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-89028a6c-bec8-4844-97af-f6031806db67 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 1d45824f-26ca-49c6-971e-f502336f956f] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:34.776694 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-89028a6c-bec8-4844-97af-f6031806db67 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:34.777239 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-89028a6c-bec8-4844-97af-f6031806db67 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:34.778402 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-89028a6c-bec8-4844-97af-f6031806db67 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:34.780575 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-89028a6c-bec8-4844-97af-f6031806db67 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:34.855355 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-59e2a3f9-971b-4869-b9c1-738841def9c0 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:34.856760 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-59e2a3f9-971b-4869-b9c1-738841def9c0 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:34.872154 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-59e2a3f9-971b-4869-b9c1-738841def9c0 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:34.873156 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-59e2a3f9-971b-4869-b9c1-738841def9c0 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:34.874472 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-59e2a3f9-971b-4869-b9c1-738841def9c0 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:34.874919 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-59e2a3f9-971b-4869-b9c1-738841def9c0 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:34.933877 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-59e2a3f9-971b-4869-b9c1-738841def9c0 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action" status: 200 len: 14 microversion: 2.20 time: 0.093049 Jan 15 21:04:34.935717 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2479/4956] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:34 2022] POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action => generated 14 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:04:35.031874 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-052f627c-a3d1-42b7-bf17-5316f855c153 req-1ed6beaf-e7b4-45b0-a5c1-d68dc1a1565f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "119c04bf-8692-4880-bea0-bc41ec4600de", "name": "network-vif-deleted", "tag": "840fd692-0a6e-49a1-b8d7-b81d5b98c408"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:35.034118 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:04:35.034118 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:04:35.048376 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-052f627c-a3d1-42b7-bf17-5316f855c153 req-1ed6beaf-e7b4-45b0-a5c1-d68dc1a1565f service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:35.049206 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-052f627c-a3d1-42b7-bf17-5316f855c153 req-1ed6beaf-e7b4-45b0-a5c1-d68dc1a1565f service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:35.064921 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-052f627c-a3d1-42b7-bf17-5316f855c153 req-1ed6beaf-e7b4-45b0-a5c1-d68dc1a1565f service nova] Creating event network-vif-deleted:840fd692-0a6e-49a1-b8d7-b81d5b98c408 for instance 119c04bf-8692-4880-bea0-bc41ec4600de on nch1-master-1 Jan 15 21:04:35.070290 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-052f627c-a3d1-42b7-bf17-5316f855c153 req-1ed6beaf-e7b4-45b0-a5c1-d68dc1a1565f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047091 Jan 15 21:04:35.071430 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2480/4957] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:04:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 21:04:35.118400 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f0bd8463-39e1-4215-bff6-af6487e96a58 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:35.120123 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f0bd8463-39e1-4215-bff6-af6487e96a58 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:35.137634 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f0bd8463-39e1-4215-bff6-af6487e96a58 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:35.138069 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f0bd8463-39e1-4215-bff6-af6487e96a58 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:35.140722 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f0bd8463-39e1-4215-bff6-af6487e96a58 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:35.141585 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f0bd8463-39e1-4215-bff6-af6487e96a58 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:35.181245 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-89028a6c-bec8-4844-97af-f6031806db67 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:35.195170 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-89028a6c-bec8-4844-97af-f6031806db67 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/1d45824f-26ca-49c6-971e-f502336f956f" status: 200 len: 1314 microversion: 2.1 time: 0.436247 Jan 15 21:04:35.206348 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2478/4958] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:04:34 2022] GET /compute/v2.1/servers/1d45824f-26ca-49c6-971e-f502336f956f => generated 1314 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:04:35.239638 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-6c92ce6c-fe6a-4714-8e81-c0ac74dc07fc tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:04:35.240562 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-6c92ce6c-fe6a-4714-8e81-c0ac74dc07fc tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: 119c04bf-8692-4880-bea0-bc41ec4600de] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:35.269810 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f0bd8463-39e1-4215-bff6-af6487e96a58 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.157465 Jan 15 21:04:35.270500 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6c92ce6c-fe6a-4714-8e81-c0ac74dc07fc tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:35.271992 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6c92ce6c-fe6a-4714-8e81-c0ac74dc07fc tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:35.273010 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6c92ce6c-fe6a-4714-8e81-c0ac74dc07fc tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:35.273546 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2481/4959] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:35 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:04:35.275191 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6c92ce6c-fe6a-4714-8e81-c0ac74dc07fc tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:35.314049 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6c92ce6c-fe6a-4714-8e81-c0ac74dc07fc tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:35.314496 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6c92ce6c-fe6a-4714-8e81-c0ac74dc07fc tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:35.314970 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.objects.instance [None req-6c92ce6c-fe6a-4714-8e81-c0ac74dc07fc tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lazy-loading 'fault' on Instance uuid 119c04bf-8692-4880-bea0-bc41ec4600de {{(pid=129366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 21:04:35.381719 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-6c92ce6c-fe6a-4714-8e81-c0ac74dc07fc tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb3421bc9494914bc5f797b15a55643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31af2a6b9424f168dd6084d8d5fd0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:35.390483 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-6c92ce6c-fe6a-4714-8e81-c0ac74dc07fc tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/119c04bf-8692-4880-bea0-bc41ec4600de" status: 200 len: 1320 microversion: 2.1 time: 0.163147 Jan 15 21:04:35.391589 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2479/4960] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:04:35 2022] GET /compute/v2.1/servers/119c04bf-8692-4880-bea0-bc41ec4600de => generated 1320 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:04:35.706903 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-63fcd052-44f6-4815-9a38-9ef300384a69 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:35.707936 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-63fcd052-44f6-4815-9a38-9ef300384a69 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:35.717363 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-63fcd052-44f6-4815-9a38-9ef300384a69 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:35.717861 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-63fcd052-44f6-4815-9a38-9ef300384a69 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:35.719063 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-63fcd052-44f6-4815-9a38-9ef300384a69 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:35.719864 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-63fcd052-44f6-4815-9a38-9ef300384a69 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:35.804823 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-63fcd052-44f6-4815-9a38-9ef300384a69 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.103127 Jan 15 21:04:35.812703 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2482/4961] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:35 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:04:35.945599 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-5e5dfa89-e654-45a6-adaa-15e282aacce1 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:35.952352 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-5e5dfa89-e654-45a6-adaa-15e282aacce1 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:35.958936 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5e5dfa89-e654-45a6-adaa-15e282aacce1 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:35.959389 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5e5dfa89-e654-45a6-adaa-15e282aacce1 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:35.964097 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5e5dfa89-e654-45a6-adaa-15e282aacce1 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:35.965459 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5e5dfa89-e654-45a6-adaa-15e282aacce1 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:36.016728 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-5e5dfa89-e654-45a6-adaa-15e282aacce1 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action" status: 200 len: 14 microversion: 2.20 time: 0.074701 Jan 15 21:04:36.024673 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2480/4962] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:35 2022] POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action => generated 14 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:04:36.213403 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f5be51a6-17b2-4ef8-a171-360034b36999 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:04:36.214097 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f5be51a6-17b2-4ef8-a171-360034b36999 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 1d45824f-26ca-49c6-971e-f502336f956f] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:36.222008 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f5be51a6-17b2-4ef8-a171-360034b36999 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:36.222458 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f5be51a6-17b2-4ef8-a171-360034b36999 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:36.223246 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f5be51a6-17b2-4ef8-a171-360034b36999 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:36.223679 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f5be51a6-17b2-4ef8-a171-360034b36999 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:36.285200 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9c4e2e1b-2899-400c-8cd4-93819d2528c9 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:36.286228 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-9c4e2e1b-2899-400c-8cd4-93819d2528c9 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:36.293919 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9c4e2e1b-2899-400c-8cd4-93819d2528c9 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:36.294608 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9c4e2e1b-2899-400c-8cd4-93819d2528c9 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:36.295550 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9c4e2e1b-2899-400c-8cd4-93819d2528c9 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:36.296313 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9c4e2e1b-2899-400c-8cd4-93819d2528c9 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:36.354482 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-9c4e2e1b-2899-400c-8cd4-93819d2528c9 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.073201 Jan 15 21:04:36.363138 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2481/4963] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:36 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:04:36.417045 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1a5d71ce-bb5a-4156-9f21-f5d0362eb074 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:04:36.417822 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-1a5d71ce-bb5a-4156-9f21-f5d0362eb074 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: 119c04bf-8692-4880-bea0-bc41ec4600de] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:36.425547 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1a5d71ce-bb5a-4156-9f21-f5d0362eb074 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:36.425995 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1a5d71ce-bb5a-4156-9f21-f5d0362eb074 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:36.426789 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1a5d71ce-bb5a-4156-9f21-f5d0362eb074 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:36.427224 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1a5d71ce-bb5a-4156-9f21-f5d0362eb074 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:36.443441 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-1a5d71ce-bb5a-4156-9f21-f5d0362eb074 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] HTTP exception thrown: Instance 119c04bf-8692-4880-bea0-bc41ec4600de could not be found. Jan 15 21:04:36.443952 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1a5d71ce-bb5a-4156-9f21-f5d0362eb074 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Returning 404 to user: Instance 119c04bf-8692-4880-bea0-bc41ec4600de could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:04:36.444789 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-1a5d71ce-bb5a-4156-9f21-f5d0362eb074 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/119c04bf-8692-4880-bea0-bc41ec4600de" status: 404 len: 111 microversion: 2.1 time: 0.035964 Jan 15 21:04:36.454667 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2482/4964] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:04:36 2022] GET /compute/v2.1/servers/119c04bf-8692-4880-bea0-bc41ec4600de => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:04:36.547999 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-2ecdcc36-7f6e-4ae8-a55f-31c56a671ce1 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1286880664", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "networks": [{"uuid": "0b7cce2c-2308-43f4-b72e-8ea5d98a7ae1"}]}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:36.611920 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.network.neutron [None req-2ecdcc36-7f6e-4ae8-a55f-31c56a671ce1 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] validate_networks() for [('0b7cce2c-2308-43f4-b72e-8ea5d98a7ae1', None, None, None, None, None)] {{(pid=129366) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 21:04:36.838039 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-f5be51a6-17b2-4ef8-a171-360034b36999 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:36.848088 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f5be51a6-17b2-4ef8-a171-360034b36999 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/1d45824f-26ca-49c6-971e-f502336f956f" status: 200 len: 1314 microversion: 2.1 time: 0.638273 Jan 15 21:04:36.848725 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2483/4965] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:04:36 2022] GET /compute/v2.1/servers/1d45824f-26ca-49c6-971e-f502336f956f => generated 1314 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:04:36.855687 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-1dd8a23d-0157-4792-ae04-176ca7fbefaa tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:36.857571 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-1dd8a23d-0157-4792-ae04-176ca7fbefaa tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:36.864003 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1dd8a23d-0157-4792-ae04-176ca7fbefaa tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:36.864610 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1dd8a23d-0157-4792-ae04-176ca7fbefaa tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:36.865580 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1dd8a23d-0157-4792-ae04-176ca7fbefaa tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:36.866146 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1dd8a23d-0157-4792-ae04-176ca7fbefaa tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:36.921198 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-1dd8a23d-0157-4792-ae04-176ca7fbefaa tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.070869 Jan 15 21:04:36.923365 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2484/4966] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:36 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:04:37.037823 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-6d6788ff-5281-4213-99ea-7d8f00feeb84 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:37.038858 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-6d6788ff-5281-4213-99ea-7d8f00feeb84 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:37.047732 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6d6788ff-5281-4213-99ea-7d8f00feeb84 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:37.047975 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6d6788ff-5281-4213-99ea-7d8f00feeb84 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:37.048697 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6d6788ff-5281-4213-99ea-7d8f00feeb84 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:37.049180 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6d6788ff-5281-4213-99ea-7d8f00feeb84 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:37.126556 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-6d6788ff-5281-4213-99ea-7d8f00feeb84 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action" status: 200 len: 14 microversion: 2.20 time: 0.093816 Jan 15 21:04:37.127981 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2485/4967] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:37 2022] POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action => generated 14 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:04:37.385769 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a2c7ffff-a262-4cfe-9b9e-a49877d5e636 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:37.389513 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a2c7ffff-a262-4cfe-9b9e-a49877d5e636 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:37.398871 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a2c7ffff-a262-4cfe-9b9e-a49877d5e636 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:37.399769 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a2c7ffff-a262-4cfe-9b9e-a49877d5e636 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:37.401000 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a2c7ffff-a262-4cfe-9b9e-a49877d5e636 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:37.401665 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a2c7ffff-a262-4cfe-9b9e-a49877d5e636 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:37.455512 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a2c7ffff-a262-4cfe-9b9e-a49877d5e636 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.088903 Jan 15 21:04:37.456242 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2486/4968] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:37 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:04:37.601036 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-2ecdcc36-7f6e-4ae8-a55f-31c56a671ce1 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Flavor limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 21:04:37.602408 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-2ecdcc36-7f6e-4ae8-a55f-31c56a671ce1 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Image limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 21:04:37.603064 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-2ecdcc36-7f6e-4ae8-a55f-31c56a671ce1 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Flavor pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 21:04:37.603673 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-2ecdcc36-7f6e-4ae8-a55f-31c56a671ce1 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Image pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 21:04:37.604264 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-2ecdcc36-7f6e-4ae8-a55f-31c56a671ce1 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 21:04:37.614343 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2ecdcc36-7f6e-4ae8-a55f-31c56a671ce1 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:37.615226 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2ecdcc36-7f6e-4ae8-a55f-31c56a671ce1 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:37.616460 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2ecdcc36-7f6e-4ae8-a55f-31c56a671ce1 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:37.617180 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2ecdcc36-7f6e-4ae8-a55f-31c56a671ce1 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:37.638985 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-2ecdcc36-7f6e-4ae8-a55f-31c56a671ce1 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Getting quotas for project d31af2a6b9424f168dd6084d8d5fd0c4. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:04:37.649618 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-2ecdcc36-7f6e-4ae8-a55f-31c56a671ce1 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Getting quotas for user 9eb3421bc9494914bc5f797b15a55643 and project d31af2a6b9424f168dd6084d8d5fd0c4. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:04:37.666096 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-2ecdcc36-7f6e-4ae8-a55f-31c56a671ce1 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Going to run 1 instances... {{(pid=129366) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 21:04:37.669057 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-2ecdcc36-7f6e-4ae8-a55f-31c56a671ce1 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: 8f58ad6d-0fd5-48c7-a969-c7b6503d639b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 21:04:37.742453 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-2ecdcc36-7f6e-4ae8-a55f-31c56a671ce1 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.198614 Jan 15 21:04:37.749401 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2483/4969] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 21:04:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1206 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 15 21:04:37.759290 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-924a50af-ea88-4ff0-9e20-a7ba5716e19f tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:04:37.760039 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-924a50af-ea88-4ff0-9e20-a7ba5716e19f tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: 8f58ad6d-0fd5-48c7-a969-c7b6503d639b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:37.864590 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8923396f-7aaa-4498-b902-16498c0fb7a4 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:04:37.865592 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-8923396f-7aaa-4498-b902-16498c0fb7a4 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 1d45824f-26ca-49c6-971e-f502336f956f] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:37.877334 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8923396f-7aaa-4498-b902-16498c0fb7a4 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:37.877796 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8923396f-7aaa-4498-b902-16498c0fb7a4 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:37.880730 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-924a50af-ea88-4ff0-9e20-a7ba5716e19f tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb3421bc9494914bc5f797b15a55643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31af2a6b9424f168dd6084d8d5fd0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:37.881377 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8923396f-7aaa-4498-b902-16498c0fb7a4 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:37.883575 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8923396f-7aaa-4498-b902-16498c0fb7a4 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:37.891249 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-924a50af-ea88-4ff0-9e20-a7ba5716e19f tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/8f58ad6d-0fd5-48c7-a969-c7b6503d639b" status: 200 len: 1209 microversion: 2.1 time: 0.137105 Jan 15 21:04:37.901151 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2487/4970] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:04:37 2022] GET /compute/v2.1/servers/8f58ad6d-0fd5-48c7-a969-c7b6503d639b => generated 1209 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:04:37.936176 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b0014fc8-198a-464c-82d5-2af7412453b3 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:37.937775 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b0014fc8-198a-464c-82d5-2af7412453b3 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:37.944692 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b0014fc8-198a-464c-82d5-2af7412453b3 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:37.945626 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b0014fc8-198a-464c-82d5-2af7412453b3 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:37.946838 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b0014fc8-198a-464c-82d5-2af7412453b3 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:37.947507 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b0014fc8-198a-464c-82d5-2af7412453b3 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:37.997073 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b0014fc8-198a-464c-82d5-2af7412453b3 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.065259 Jan 15 21:04:37.998752 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2488/4971] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:37 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:04:38.087571 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-8923396f-7aaa-4498-b902-16498c0fb7a4 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:38.095951 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-8923396f-7aaa-4498-b902-16498c0fb7a4 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/1d45824f-26ca-49c6-971e-f502336f956f" status: 200 len: 1314 microversion: 2.1 time: 0.235005 Jan 15 21:04:38.096866 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2484/4972] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:04:37 2022] GET /compute/v2.1/servers/1d45824f-26ca-49c6-971e-f502336f956f => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:04:38.141087 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-86045efd-5433-496c-9969-0238ca048b0f tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:38.142377 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-86045efd-5433-496c-9969-0238ca048b0f tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:38.157204 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-86045efd-5433-496c-9969-0238ca048b0f tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:38.159046 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-86045efd-5433-496c-9969-0238ca048b0f tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:38.159901 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-86045efd-5433-496c-9969-0238ca048b0f tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:38.160369 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-86045efd-5433-496c-9969-0238ca048b0f tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:38.240069 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-86045efd-5433-496c-9969-0238ca048b0f tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action" status: 200 len: 14 microversion: 2.20 time: 0.104449 Jan 15 21:04:38.241919 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2489/4973] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:38 2022] POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action => generated 14 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:04:38.467549 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-fc6d0e68-5448-4ca9-99ae-d1d8d054255c tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:38.468825 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-fc6d0e68-5448-4ca9-99ae-d1d8d054255c tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:38.477453 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fc6d0e68-5448-4ca9-99ae-d1d8d054255c tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:38.477857 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fc6d0e68-5448-4ca9-99ae-d1d8d054255c tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:38.478654 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fc6d0e68-5448-4ca9-99ae-d1d8d054255c tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:38.479131 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fc6d0e68-5448-4ca9-99ae-d1d8d054255c tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:38.533156 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-fc6d0e68-5448-4ca9-99ae-d1d8d054255c tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.064515 Jan 15 21:04:38.537859 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2485/4974] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:38 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:04:38.910891 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2d36f605-666a-4e8c-85dc-62c3a8bea898 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:04:38.911921 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-2d36f605-666a-4e8c-85dc-62c3a8bea898 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: 8f58ad6d-0fd5-48c7-a969-c7b6503d639b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:38.926006 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2d36f605-666a-4e8c-85dc-62c3a8bea898 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:38.927291 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2d36f605-666a-4e8c-85dc-62c3a8bea898 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:38.929484 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2d36f605-666a-4e8c-85dc-62c3a8bea898 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:38.930466 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2d36f605-666a-4e8c-85dc-62c3a8bea898 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:39.010421 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-5ee00c09-1044-49b5-907c-cbe765974f09 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:39.012867 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-5ee00c09-1044-49b5-907c-cbe765974f09 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:39.023401 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-2d36f605-666a-4e8c-85dc-62c3a8bea898 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb3421bc9494914bc5f797b15a55643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31af2a6b9424f168dd6084d8d5fd0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:39.027547 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5ee00c09-1044-49b5-907c-cbe765974f09 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:39.028039 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5ee00c09-1044-49b5-907c-cbe765974f09 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:39.028872 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5ee00c09-1044-49b5-907c-cbe765974f09 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:39.032156 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5ee00c09-1044-49b5-907c-cbe765974f09 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:39.038133 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2d36f605-666a-4e8c-85dc-62c3a8bea898 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/8f58ad6d-0fd5-48c7-a969-c7b6503d639b" status: 200 len: 1261 microversion: 2.1 time: 0.133677 Jan 15 21:04:39.039602 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2490/4975] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:04:38 2022] GET /compute/v2.1/servers/8f58ad6d-0fd5-48c7-a969-c7b6503d639b => generated 1261 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:04:39.114253 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e4170045-b1a5-482b-be0b-615239deafc9 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:04:39.115277 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e4170045-b1a5-482b-be0b-615239deafc9 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 1d45824f-26ca-49c6-971e-f502336f956f] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:39.123022 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e4170045-b1a5-482b-be0b-615239deafc9 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:39.123706 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e4170045-b1a5-482b-be0b-615239deafc9 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:39.124687 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e4170045-b1a5-482b-be0b-615239deafc9 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:39.125421 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e4170045-b1a5-482b-be0b-615239deafc9 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:39.130813 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-5ee00c09-1044-49b5-907c-cbe765974f09 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.124814 Jan 15 21:04:39.134511 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2486/4976] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:39 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:04:39.255645 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-75295a7a-9bc0-4aad-bc8e-2dc7874f2d2f tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:39.257939 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-75295a7a-9bc0-4aad-bc8e-2dc7874f2d2f tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:39.269920 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-75295a7a-9bc0-4aad-bc8e-2dc7874f2d2f tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:39.270373 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-75295a7a-9bc0-4aad-bc8e-2dc7874f2d2f tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:39.271159 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-75295a7a-9bc0-4aad-bc8e-2dc7874f2d2f tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:39.275510 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-75295a7a-9bc0-4aad-bc8e-2dc7874f2d2f tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:39.365989 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-e4170045-b1a5-482b-be0b-615239deafc9 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:39.376413 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-75295a7a-9bc0-4aad-bc8e-2dc7874f2d2f tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action" status: 200 len: 14 microversion: 2.20 time: 0.125932 Jan 15 21:04:39.382247 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2487/4977] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:39 2022] POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action => generated 14 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:04:39.387355 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e4170045-b1a5-482b-be0b-615239deafc9 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/1d45824f-26ca-49c6-971e-f502336f956f" status: 200 len: 1314 microversion: 2.1 time: 0.276318 Jan 15 21:04:39.388553 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2491/4978] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:04:39 2022] GET /compute/v2.1/servers/1d45824f-26ca-49c6-971e-f502336f956f => generated 1314 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:04:39.392541 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-94a5ad17-b156-4c45-ba38-ee5b12fb3036 req-5952c30b-3fff-4dba-9625-44e69e78921d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d45824f-26ca-49c6-971e-f502336f956f", "name": "network-vif-plugged", "status": "completed", "tag": "ab07dc98-af7c-4650-b36e-d8be43ca08c1"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:39.394084 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:04:39.394084 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:04:39.401914 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-94a5ad17-b156-4c45-ba38-ee5b12fb3036 req-5952c30b-3fff-4dba-9625-44e69e78921d service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:39.402647 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-94a5ad17-b156-4c45-ba38-ee5b12fb3036 req-5952c30b-3fff-4dba-9625-44e69e78921d service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:39.416982 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-94a5ad17-b156-4c45-ba38-ee5b12fb3036 req-5952c30b-3fff-4dba-9625-44e69e78921d service nova] Creating event network-vif-plugged:ab07dc98-af7c-4650-b36e-d8be43ca08c1 for instance 1d45824f-26ca-49c6-971e-f502336f956f on nch2-master-1 Jan 15 21:04:39.422914 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-94a5ad17-b156-4c45-ba38-ee5b12fb3036 req-5952c30b-3fff-4dba-9625-44e69e78921d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039282 Jan 15 21:04:39.424060 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2488/4979] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:04:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:04:39.545810 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-0cf328ad-6567-4415-b91e-44caaadac50e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:39.546772 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-0cf328ad-6567-4415-b91e-44caaadac50e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:39.553518 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0cf328ad-6567-4415-b91e-44caaadac50e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:39.553967 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0cf328ad-6567-4415-b91e-44caaadac50e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:39.554749 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0cf328ad-6567-4415-b91e-44caaadac50e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:39.555184 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0cf328ad-6567-4415-b91e-44caaadac50e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:39.604249 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-0cf328ad-6567-4415-b91e-44caaadac50e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.062290 Jan 15 21:04:39.605336 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2492/4980] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:39 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:04:40.057271 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-068debaf-51a5-4bbd-a778-aeae8e613387 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:04:40.057994 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-068debaf-51a5-4bbd-a778-aeae8e613387 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: 8f58ad6d-0fd5-48c7-a969-c7b6503d639b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:40.065630 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-068debaf-51a5-4bbd-a778-aeae8e613387 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:40.066077 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-068debaf-51a5-4bbd-a778-aeae8e613387 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:40.066871 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-068debaf-51a5-4bbd-a778-aeae8e613387 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:40.067278 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-068debaf-51a5-4bbd-a778-aeae8e613387 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:40.131489 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-068debaf-51a5-4bbd-a778-aeae8e613387 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb3421bc9494914bc5f797b15a55643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31af2a6b9424f168dd6084d8d5fd0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:40.139803 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-068debaf-51a5-4bbd-a778-aeae8e613387 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/8f58ad6d-0fd5-48c7-a969-c7b6503d639b" status: 200 len: 1267 microversion: 2.1 time: 0.086584 Jan 15 21:04:40.149591 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2489/4981] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:04:40 2022] GET /compute/v2.1/servers/8f58ad6d-0fd5-48c7-a969-c7b6503d639b => generated 1267 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:04:40.154558 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-dc9adc28-7013-414a-bead-96ceb1a97100 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:40.155564 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-dc9adc28-7013-414a-bead-96ceb1a97100 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:40.163342 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dc9adc28-7013-414a-bead-96ceb1a97100 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:40.163799 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dc9adc28-7013-414a-bead-96ceb1a97100 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:40.164592 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dc9adc28-7013-414a-bead-96ceb1a97100 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:40.165062 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dc9adc28-7013-414a-bead-96ceb1a97100 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:40.212614 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-dc9adc28-7013-414a-bead-96ceb1a97100 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.069092 Jan 15 21:04:40.213319 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2493/4982] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:40 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:04:40.388524 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9afeab4a-d08e-46d8-8ce0-c91612dfd404 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:40.389500 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-9afeab4a-d08e-46d8-8ce0-c91612dfd404 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:40.396389 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9afeab4a-d08e-46d8-8ce0-c91612dfd404 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:40.396693 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9afeab4a-d08e-46d8-8ce0-c91612dfd404 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:40.397686 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9afeab4a-d08e-46d8-8ce0-c91612dfd404 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:40.398271 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9afeab4a-d08e-46d8-8ce0-c91612dfd404 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:40.406653 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ffaee1bd-33ea-4f50-9a72-c394bbdf529d tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:04:40.407472 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ffaee1bd-33ea-4f50-9a72-c394bbdf529d tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 1d45824f-26ca-49c6-971e-f502336f956f] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:40.419984 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ffaee1bd-33ea-4f50-9a72-c394bbdf529d tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:40.429840 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ffaee1bd-33ea-4f50-9a72-c394bbdf529d tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:40.430973 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ffaee1bd-33ea-4f50-9a72-c394bbdf529d tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:40.431424 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ffaee1bd-33ea-4f50-9a72-c394bbdf529d tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:40.526028 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-9afeab4a-d08e-46d8-8ce0-c91612dfd404 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action" status: 200 len: 8204 microversion: 2.20 time: 0.141904 Jan 15 21:04:40.527027 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2490/4983] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:40 2022] POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action => generated 8204 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 15 21:04:40.617312 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-5ab1ee06-7669-4948-95fa-cfc289b94a39 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:40.618390 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-5ab1ee06-7669-4948-95fa-cfc289b94a39 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:40.633337 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5ab1ee06-7669-4948-95fa-cfc289b94a39 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:40.634034 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5ab1ee06-7669-4948-95fa-cfc289b94a39 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:40.635462 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5ab1ee06-7669-4948-95fa-cfc289b94a39 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:40.636170 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5ab1ee06-7669-4948-95fa-cfc289b94a39 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:40.718400 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-5ab1ee06-7669-4948-95fa-cfc289b94a39 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.105007 Jan 15 21:04:40.719996 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2491/4984] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:40 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:04:40.773061 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-ffaee1bd-33ea-4f50-9a72-c394bbdf529d tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:40.782179 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ffaee1bd-33ea-4f50-9a72-c394bbdf529d tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/1d45824f-26ca-49c6-971e-f502336f956f" status: 200 len: 1314 microversion: 2.1 time: 0.381059 Jan 15 21:04:40.783422 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2494/4985] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:04:40 2022] GET /compute/v2.1/servers/1d45824f-26ca-49c6-971e-f502336f956f => generated 1314 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:04:41.159441 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-841bf60e-ed58-42c8-861f-d9d4e574e3bf tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:04:41.160155 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-841bf60e-ed58-42c8-861f-d9d4e574e3bf tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: 8f58ad6d-0fd5-48c7-a969-c7b6503d639b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:41.169526 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-841bf60e-ed58-42c8-861f-d9d4e574e3bf tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:41.169974 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-841bf60e-ed58-42c8-861f-d9d4e574e3bf tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:41.171135 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-841bf60e-ed58-42c8-861f-d9d4e574e3bf tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:41.171572 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-841bf60e-ed58-42c8-861f-d9d4e574e3bf tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:41.226755 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-84929900-3088-44c5-a3c8-d7a6fcd0b242 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:41.227983 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-84929900-3088-44c5-a3c8-d7a6fcd0b242 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:41.236501 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-84929900-3088-44c5-a3c8-d7a6fcd0b242 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:41.237767 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-84929900-3088-44c5-a3c8-d7a6fcd0b242 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:41.238926 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-84929900-3088-44c5-a3c8-d7a6fcd0b242 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:41.239721 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-84929900-3088-44c5-a3c8-d7a6fcd0b242 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:41.293799 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-84929900-3088-44c5-a3c8-d7a6fcd0b242 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.070807 Jan 15 21:04:41.295084 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2495/4986] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:41 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:04:41.469849 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-841bf60e-ed58-42c8-861f-d9d4e574e3bf tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb3421bc9494914bc5f797b15a55643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31af2a6b9424f168dd6084d8d5fd0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:41.478124 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-841bf60e-ed58-42c8-861f-d9d4e574e3bf tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/8f58ad6d-0fd5-48c7-a969-c7b6503d639b" status: 200 len: 1309 microversion: 2.1 time: 0.323768 Jan 15 21:04:41.481250 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2492/4987] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:04:41 2022] GET /compute/v2.1/servers/8f58ad6d-0fd5-48c7-a969-c7b6503d639b => generated 1309 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:04:41.506763 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-985a92c7-c371-4f20-ae57-5af9d188bef8 req-318f33cc-33c3-4374-bbc9-a1978e24747c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f58ad6d-0fd5-48c7-a969-c7b6503d639b", "tag": "c695182a-5eaa-4429-881b-c572b04713b6"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:41.508520 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:04:41.508520 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:04:41.520305 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-985a92c7-c371-4f20-ae57-5af9d188bef8 req-318f33cc-33c3-4374-bbc9-a1978e24747c service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:41.521088 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-985a92c7-c371-4f20-ae57-5af9d188bef8 req-318f33cc-33c3-4374-bbc9-a1978e24747c service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:41.541566 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-6b1d162b-6c57-45b1-bb28-b66cf560c7b0 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:41.543305 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-6b1d162b-6c57-45b1-bb28-b66cf560c7b0 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:41.547162 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-985a92c7-c371-4f20-ae57-5af9d188bef8 req-318f33cc-33c3-4374-bbc9-a1978e24747c service nova] Creating event network-changed:c695182a-5eaa-4429-881b-c572b04713b6 for instance 8f58ad6d-0fd5-48c7-a969-c7b6503d639b on nch1-master-1 Jan 15 21:04:41.552541 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-985a92c7-c371-4f20-ae57-5af9d188bef8 req-318f33cc-33c3-4374-bbc9-a1978e24747c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050019 Jan 15 21:04:41.553871 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6b1d162b-6c57-45b1-bb28-b66cf560c7b0 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:41.554334 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6b1d162b-6c57-45b1-bb28-b66cf560c7b0 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:41.554625 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2496/4988] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:04:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:04:41.565513 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6b1d162b-6c57-45b1-bb28-b66cf560c7b0 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:41.565977 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6b1d162b-6c57-45b1-bb28-b66cf560c7b0 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:41.619609 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-6b1d162b-6c57-45b1-bb28-b66cf560c7b0 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action" status: 200 len: 16398 microversion: 2.20 time: 0.081927 Jan 15 21:04:41.623895 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2493/4989] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:41 2022] POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action => generated 16398 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:04:41.732861 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d0f8b0f0-9153-4db4-8b66-0d0832086682 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:41.734362 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d0f8b0f0-9153-4db4-8b66-0d0832086682 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:41.741016 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d0f8b0f0-9153-4db4-8b66-0d0832086682 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:41.741556 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d0f8b0f0-9153-4db4-8b66-0d0832086682 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:41.742775 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d0f8b0f0-9153-4db4-8b66-0d0832086682 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:41.743329 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d0f8b0f0-9153-4db4-8b66-0d0832086682 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:41.788651 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d0f8b0f0-9153-4db4-8b66-0d0832086682 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.060474 Jan 15 21:04:41.789885 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2497/4990] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:41 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:04:41.800446 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-2209a819-b4c5-498e-ab80-29eb2cdc83d2 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:04:41.801507 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-2209a819-b4c5-498e-ab80-29eb2cdc83d2 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 1d45824f-26ca-49c6-971e-f502336f956f] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:41.809884 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2209a819-b4c5-498e-ab80-29eb2cdc83d2 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:41.810752 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2209a819-b4c5-498e-ab80-29eb2cdc83d2 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:41.812024 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2209a819-b4c5-498e-ab80-29eb2cdc83d2 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:41.813033 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2209a819-b4c5-498e-ab80-29eb2cdc83d2 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:42.032967 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-2209a819-b4c5-498e-ab80-29eb2cdc83d2 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:42.041700 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-2209a819-b4c5-498e-ab80-29eb2cdc83d2 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/1d45824f-26ca-49c6-971e-f502336f956f" status: 200 len: 1502 microversion: 2.1 time: 0.245284 Jan 15 21:04:42.042969 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2494/4991] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:04:41 2022] GET /compute/v2.1/servers/1d45824f-26ca-49c6-971e-f502336f956f => generated 1502 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:04:42.059630 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c9cc7f6f-caeb-4b4c-8277-eb1d7ffc6e66 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:42.060648 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c9cc7f6f-caeb-4b4c-8277-eb1d7ffc6e66 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 1d45824f-26ca-49c6-971e-f502336f956f] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:42.069404 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c9cc7f6f-caeb-4b4c-8277-eb1d7ffc6e66 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:42.070946 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c9cc7f6f-caeb-4b4c-8277-eb1d7ffc6e66 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:42.071797 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c9cc7f6f-caeb-4b4c-8277-eb1d7ffc6e66 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:42.072263 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c9cc7f6f-caeb-4b4c-8277-eb1d7ffc6e66 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:42.310234 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-2aac0441-de18-4339-912d-44b91d2befa3 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:42.311477 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-2aac0441-de18-4339-912d-44b91d2befa3 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:42.328020 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2aac0441-de18-4339-912d-44b91d2befa3 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:42.328580 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2aac0441-de18-4339-912d-44b91d2befa3 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:42.329716 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2aac0441-de18-4339-912d-44b91d2befa3 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:42.331768 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2aac0441-de18-4339-912d-44b91d2befa3 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:42.348557 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.network.security_group_api [None req-c9cc7f6f-caeb-4b4c-8277-eb1d7ffc6e66 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Removing security group 1fdfe926-9397-4b0b-8264-3e6c53a75afd from port ab07dc98-af7c-4650-b36e-d8be43ca08c1 Jan 15 21:04:42.403703 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-2aac0441-de18-4339-912d-44b91d2befa3 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.101211 Jan 15 21:04:42.405070 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2495/4992] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:42 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:04:42.496353 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8e87ae2d-d7cb-4a42-841e-105a4f5021b8 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:04:42.497461 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-8e87ae2d-d7cb-4a42-841e-105a4f5021b8 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: 8f58ad6d-0fd5-48c7-a969-c7b6503d639b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:42.505914 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8e87ae2d-d7cb-4a42-841e-105a4f5021b8 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:42.506762 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8e87ae2d-d7cb-4a42-841e-105a4f5021b8 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:42.507769 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8e87ae2d-d7cb-4a42-841e-105a4f5021b8 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:42.508431 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8e87ae2d-d7cb-4a42-841e-105a4f5021b8 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:43.146720 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-8e87ae2d-d7cb-4a42-841e-105a4f5021b8 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb3421bc9494914bc5f797b15a55643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31af2a6b9424f168dd6084d8d5fd0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:43.155302 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-8e87ae2d-d7cb-4a42-841e-105a4f5021b8 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/8f58ad6d-0fd5-48c7-a969-c7b6503d639b" status: 200 len: 1309 microversion: 2.1 time: 0.663379 Jan 15 21:04:43.155903 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2496/4993] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:04:42 2022] GET /compute/v2.1/servers/8f58ad6d-0fd5-48c7-a969-c7b6503d639b => generated 1309 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:04:43.161052 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f7399b02-56db-43f3-941a-fbc6acaaf0af tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:43.162176 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f7399b02-56db-43f3-941a-fbc6acaaf0af tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:43.172504 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f7399b02-56db-43f3-941a-fbc6acaaf0af tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:43.173102 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f7399b02-56db-43f3-941a-fbc6acaaf0af tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:43.173994 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f7399b02-56db-43f3-941a-fbc6acaaf0af tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:43.174459 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f7399b02-56db-43f3-941a-fbc6acaaf0af tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:43.215916 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f7399b02-56db-43f3-941a-fbc6acaaf0af tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action" status: 200 len: 16398 microversion: 2.20 time: 0.058459 Jan 15 21:04:43.216701 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2497/4994] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:43 2022] POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action => generated 16398 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:04:43.226818 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c8cffd1f-bff7-444b-b3f3-fcd1edbe92d6 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:43.228598 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c8cffd1f-bff7-444b-b3f3-fcd1edbe92d6 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:43.241853 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c8cffd1f-bff7-444b-b3f3-fcd1edbe92d6 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:43.242695 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c8cffd1f-bff7-444b-b3f3-fcd1edbe92d6 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:43.244196 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c8cffd1f-bff7-444b-b3f3-fcd1edbe92d6 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:43.244988 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c8cffd1f-bff7-444b-b3f3-fcd1edbe92d6 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:43.317210 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c8cffd1f-bff7-444b-b3f3-fcd1edbe92d6 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.098196 Jan 15 21:04:43.321601 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2498/4995] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:43 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:04:43.367075 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c9cc7f6f-caeb-4b4c-8277-eb1d7ffc6e66 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "POST /compute/v2.1/servers/1d45824f-26ca-49c6-971e-f502336f956f/action" status: 202 len: 0 microversion: 2.1 time: 1.311648 Jan 15 21:04:43.370888 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2498/4996] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:04:42 2022] POST /compute/v2.1/servers/1d45824f-26ca-49c6-971e-f502336f956f/action => generated 0 bytes in 1316 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:04:43.388451 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-ebcc4ea7-a99d-45ee-a920-a36e1107e8fe req-5181fb11-95a8-4ca2-9b7a-70aaf64d0f5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d45824f-26ca-49c6-971e-f502336f956f", "tag": "ab07dc98-af7c-4650-b36e-d8be43ca08c1"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:43.390140 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:04:43.390140 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:04:43.392497 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e314c659-0cb3-4b60-8746-a71ba07df5da tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:04:43.394387 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e314c659-0cb3-4b60-8746-a71ba07df5da tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 1d45824f-26ca-49c6-971e-f502336f956f] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:43.405226 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-ebcc4ea7-a99d-45ee-a920-a36e1107e8fe req-5181fb11-95a8-4ca2-9b7a-70aaf64d0f5f service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:43.408557 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-ebcc4ea7-a99d-45ee-a920-a36e1107e8fe req-5181fb11-95a8-4ca2-9b7a-70aaf64d0f5f service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:43.431334 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e314c659-0cb3-4b60-8746-a71ba07df5da tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:43.431800 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e314c659-0cb3-4b60-8746-a71ba07df5da tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:43.432613 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e314c659-0cb3-4b60-8746-a71ba07df5da tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:43.433139 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e314c659-0cb3-4b60-8746-a71ba07df5da tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:43.435824 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-ebcc4ea7-a99d-45ee-a920-a36e1107e8fe req-5181fb11-95a8-4ca2-9b7a-70aaf64d0f5f service nova] Creating event network-changed:ab07dc98-af7c-4650-b36e-d8be43ca08c1 for instance 1d45824f-26ca-49c6-971e-f502336f956f on nch2-master-1 Jan 15 21:04:43.444096 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-ebcc4ea7-a99d-45ee-a920-a36e1107e8fe req-5181fb11-95a8-4ca2-9b7a-70aaf64d0f5f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058670 Jan 15 21:04:43.445982 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2499/4997] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:04:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 21:04:43.454035 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-6d8f9f14-3c5a-4bb7-ae6d-ce685dc863eb tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:43.456337 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-6d8f9f14-3c5a-4bb7-ae6d-ce685dc863eb tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:43.468826 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6d8f9f14-3c5a-4bb7-ae6d-ce685dc863eb tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:43.469641 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6d8f9f14-3c5a-4bb7-ae6d-ce685dc863eb tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:43.470982 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6d8f9f14-3c5a-4bb7-ae6d-ce685dc863eb tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:43.471813 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6d8f9f14-3c5a-4bb7-ae6d-ce685dc863eb tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:43.533097 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-6d8f9f14-3c5a-4bb7-ae6d-ce685dc863eb tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.085310 Jan 15 21:04:43.538051 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2500/4998] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:43 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:04:43.698027 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-e314c659-0cb3-4b60-8746-a71ba07df5da tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:43.711479 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e314c659-0cb3-4b60-8746-a71ba07df5da tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/1d45824f-26ca-49c6-971e-f502336f956f" status: 200 len: 1460 microversion: 2.1 time: 0.335395 Jan 15 21:04:43.721486 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2499/4999] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:04:43 2022] GET /compute/v2.1/servers/1d45824f-26ca-49c6-971e-f502336f956f => generated 1460 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:04:43.728892 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a6a9cd56-d3e0-4130-aa43-c05e1c4e4b75 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:04:43.729600 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a6a9cd56-d3e0-4130-aa43-c05e1c4e4b75 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:43.738757 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a6a9cd56-d3e0-4130-aa43-c05e1c4e4b75 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:43.739207 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a6a9cd56-d3e0-4130-aa43-c05e1c4e4b75 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:43.740147 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a6a9cd56-d3e0-4130-aa43-c05e1c4e4b75 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:43.740783 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a6a9cd56-d3e0-4130-aa43-c05e1c4e4b75 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:44.079299 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-a6a9cd56-d3e0-4130-aa43-c05e1c4e4b75 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:44.088820 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a6a9cd56-d3e0-4130-aa43-c05e1c4e4b75 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9" status: 200 len: 1670 microversion: 2.1 time: 0.364259 Jan 15 21:04:44.091650 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2501/5000] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:04:43 2022] GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9 => generated 1670 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:04:44.112886 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c2d6c930-b8dc-47a7-a864-949dccb53415 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:04:44.112886 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c2d6c930-b8dc-47a7-a864-949dccb53415 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:44.120175 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c2d6c930-b8dc-47a7-a864-949dccb53415 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:44.122189 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c2d6c930-b8dc-47a7-a864-949dccb53415 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:44.123175 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c2d6c930-b8dc-47a7-a864-949dccb53415 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:44.123874 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c2d6c930-b8dc-47a7-a864-949dccb53415 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:44.175811 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-6f91313d-99d5-4e07-a988-d15ba30f7145 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:04:44.177389 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-6f91313d-99d5-4e07-a988-d15ba30f7145 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: 8f58ad6d-0fd5-48c7-a969-c7b6503d639b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:44.186697 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6f91313d-99d5-4e07-a988-d15ba30f7145 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:44.187456 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6f91313d-99d5-4e07-a988-d15ba30f7145 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:44.188520 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6f91313d-99d5-4e07-a988-d15ba30f7145 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:44.189199 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6f91313d-99d5-4e07-a988-d15ba30f7145 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:44.508549 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-6f91313d-99d5-4e07-a988-d15ba30f7145 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb3421bc9494914bc5f797b15a55643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31af2a6b9424f168dd6084d8d5fd0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:44.517407 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-6f91313d-99d5-4e07-a988-d15ba30f7145 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/8f58ad6d-0fd5-48c7-a969-c7b6503d639b" status: 200 len: 1309 microversion: 2.1 time: 0.346344 Jan 15 21:04:44.518098 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2502/5001] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:04:44 2022] GET /compute/v2.1/servers/8f58ad6d-0fd5-48c7-a969-c7b6503d639b => generated 1309 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:04:44.523063 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b898967a-7547-419d-bd18-81e42fd24e71 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:44.524045 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b898967a-7547-419d-bd18-81e42fd24e71 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:44.531472 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b898967a-7547-419d-bd18-81e42fd24e71 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:44.531831 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b898967a-7547-419d-bd18-81e42fd24e71 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:44.532829 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b898967a-7547-419d-bd18-81e42fd24e71 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:44.533461 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b898967a-7547-419d-bd18-81e42fd24e71 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:44.535053 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-c2d6c930-b8dc-47a7-a864-949dccb53415 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:44.556642 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c2d6c930-b8dc-47a7-a864-949dccb53415 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9" status: 200 len: 1670 microversion: 2.1 time: 0.449620 Jan 15 21:04:44.557700 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2500/5002] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:04:44 2022] GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9 => generated 1670 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:04:44.588654 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b898967a-7547-419d-bd18-81e42fd24e71 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action" status: 200 len: 16398 microversion: 2.20 time: 0.068428 Jan 15 21:04:44.592426 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2503/5003] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:44 2022] POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action => generated 16398 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:04:44.593873 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f0371b66-6dd3-4441-80ca-bc3f7f0e3ac8 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:44.595039 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f0371b66-6dd3-4441-80ca-bc3f7f0e3ac8 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:44.605579 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-add98f58-7d41-49fd-96e9-6cdb038fbb88 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:44.608387 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-add98f58-7d41-49fd-96e9-6cdb038fbb88 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:44.615091 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f0371b66-6dd3-4441-80ca-bc3f7f0e3ac8 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:44.616957 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f0371b66-6dd3-4441-80ca-bc3f7f0e3ac8 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:44.617867 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f0371b66-6dd3-4441-80ca-bc3f7f0e3ac8 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:44.621528 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f0371b66-6dd3-4441-80ca-bc3f7f0e3ac8 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:44.626003 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-add98f58-7d41-49fd-96e9-6cdb038fbb88 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:44.627279 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-add98f58-7d41-49fd-96e9-6cdb038fbb88 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:44.629098 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-add98f58-7d41-49fd-96e9-6cdb038fbb88 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:44.630160 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-add98f58-7d41-49fd-96e9-6cdb038fbb88 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:44.699337 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f0371b66-6dd3-4441-80ca-bc3f7f0e3ac8 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.126965 Jan 15 21:04:44.700346 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2501/5004] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:44 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:04:44.706786 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-86d6a38a-2fea-456b-9bf8-bf1d1c1fada8 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1350611303", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "networks": [{"uuid": "694fb227-829a-493b-b1b7-2dc4e238e05e"}]}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:44.716240 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-add98f58-7d41-49fd-96e9-6cdb038fbb88 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.121376 Jan 15 21:04:44.718074 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2504/5005] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:44 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:04:44.770013 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.network.neutron [None req-86d6a38a-2fea-456b-9bf8-bf1d1c1fada8 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] validate_networks() for [('694fb227-829a-493b-b1b7-2dc4e238e05e', None, None, None, None, None)] {{(pid=129366) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 21:04:45.263894 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-71e086b8-7303-41d2-9b64-7139b9acedf1 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:04:45.264929 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-71e086b8-7303-41d2-9b64-7139b9acedf1 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:45.272590 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-71e086b8-7303-41d2-9b64-7139b9acedf1 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:45.273040 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-71e086b8-7303-41d2-9b64-7139b9acedf1 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:45.275227 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-71e086b8-7303-41d2-9b64-7139b9acedf1 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:45.275700 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-71e086b8-7303-41d2-9b64-7139b9acedf1 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:45.310571 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-71e086b8-7303-41d2-9b64-7139b9acedf1 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "GET /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051537 Jan 15 21:04:45.311439 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2505/5006] 10.222.0.46 () {58 vars in 1301 bytes} [Sat Jan 15 21:04:45 2022] GET /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 21:04:45.380251 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3e5bd995-c630-4ef6-b7d2-b22a3b4da5c3 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:04:45.380738 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-3e5bd995-c630-4ef6-b7d2-b22a3b4da5c3 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:45.388946 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3e5bd995-c630-4ef6-b7d2-b22a3b4da5c3 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:45.389405 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3e5bd995-c630-4ef6-b7d2-b22a3b4da5c3 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:45.390205 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3e5bd995-c630-4ef6-b7d2-b22a3b4da5c3 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:45.390641 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3e5bd995-c630-4ef6-b7d2-b22a3b4da5c3 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:45.416704 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-3e5bd995-c630-4ef6-b7d2-b22a3b4da5c3 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Going to try to terminate instance {{(pid=129365) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 21:04:45.505024 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3e5bd995-c630-4ef6-b7d2-b22a3b4da5c3 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "DELETE /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a" status: 204 len: 0 microversion: 2.1 time: 0.136676 Jan 15 21:04:45.505967 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2506/5007] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 21:04:45 2022] DELETE /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 15 21:04:45.515039 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e4086d2d-b1c0-4741-9948-78599e2b6ad6 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:04:45.515733 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e4086d2d-b1c0-4741-9948-78599e2b6ad6 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:45.521936 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e4086d2d-b1c0-4741-9948-78599e2b6ad6 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:45.522480 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e4086d2d-b1c0-4741-9948-78599e2b6ad6 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:45.523414 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e4086d2d-b1c0-4741-9948-78599e2b6ad6 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:45.523920 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e4086d2d-b1c0-4741-9948-78599e2b6ad6 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:45.560061 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-86d6a38a-2fea-456b-9bf8-bf1d1c1fada8 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Flavor limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 21:04:45.560517 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-86d6a38a-2fea-456b-9bf8-bf1d1c1fada8 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Image limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 21:04:45.562030 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-86d6a38a-2fea-456b-9bf8-bf1d1c1fada8 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Flavor pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 21:04:45.562030 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-86d6a38a-2fea-456b-9bf8-bf1d1c1fada8 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Image pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 21:04:45.562030 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-86d6a38a-2fea-456b-9bf8-bf1d1c1fada8 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 21:04:45.572933 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-86d6a38a-2fea-456b-9bf8-bf1d1c1fada8 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:45.573391 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-86d6a38a-2fea-456b-9bf8-bf1d1c1fada8 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:45.574245 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-86d6a38a-2fea-456b-9bf8-bf1d1c1fada8 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:45.574855 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-86d6a38a-2fea-456b-9bf8-bf1d1c1fada8 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:45.595925 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-86d6a38a-2fea-456b-9bf8-bf1d1c1fada8 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Getting quotas for project e3a611cade394cb288f103fcf516e4ab. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:04:45.601534 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-86d6a38a-2fea-456b-9bf8-bf1d1c1fada8 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Getting quotas for user 7f1ee75d18ae4db8825653f6e8180b72 and project e3a611cade394cb288f103fcf516e4ab. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:04:45.615374 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-86d6a38a-2fea-456b-9bf8-bf1d1c1fada8 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Going to run 1 instances... {{(pid=129366) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 21:04:45.618200 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-86d6a38a-2fea-456b-9bf8-bf1d1c1fada8 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: df405782-02e0-4416-9c91-818ea05dacaf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 21:04:45.676622 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-86d6a38a-2fea-456b-9bf8-bf1d1c1fada8 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.974872 Jan 15 21:04:45.677427 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2502/5008] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 21:04:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 976 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 21:04:45.682329 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d775cd8c-501e-4099-be31-1f3e7a38ad85 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:04:45.682977 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-d775cd8c-501e-4099-be31-1f3e7a38ad85 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: 8f58ad6d-0fd5-48c7-a969-c7b6503d639b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:45.690147 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d775cd8c-501e-4099-be31-1f3e7a38ad85 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:45.690686 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d775cd8c-501e-4099-be31-1f3e7a38ad85 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:45.691561 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d775cd8c-501e-4099-be31-1f3e7a38ad85 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:45.692110 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d775cd8c-501e-4099-be31-1f3e7a38ad85 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:45.811493 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-e4086d2d-b1c0-4741-9948-78599e2b6ad6 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6097506a2d4e36818310d9d70bf01b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4dad65fccfe481a973f5fcbb9287dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:45.819365 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e4086d2d-b1c0-4741-9948-78599e2b6ad6 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "GET /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a" status: 200 len: 1671 microversion: 2.1 time: 0.309017 Jan 15 21:04:45.833272 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2507/5009] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:04:45 2022] GET /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a => generated 1671 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:04:45.838726 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e98e260d-485d-47fb-b86d-a1dd4e4b59e3 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:45.839766 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e98e260d-485d-47fb-b86d-a1dd4e4b59e3 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:45.846433 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e98e260d-485d-47fb-b86d-a1dd4e4b59e3 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:45.846891 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e98e260d-485d-47fb-b86d-a1dd4e4b59e3 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:45.847682 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e98e260d-485d-47fb-b86d-a1dd4e4b59e3 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:45.861135 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e98e260d-485d-47fb-b86d-a1dd4e4b59e3 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:45.930540 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e98e260d-485d-47fb-b86d-a1dd4e4b59e3 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action" status: 200 len: 16398 microversion: 2.20 time: 0.095434 Jan 15 21:04:45.931543 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2508/5010] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:45 2022] POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action => generated 16398 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:04:45.940821 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d065f464-4ca5-4ae9-a75c-9ce1a500fe3d tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:04:45.941802 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d065f464-4ca5-4ae9-a75c-9ce1a500fe3d tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: df405782-02e0-4416-9c91-818ea05dacaf] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:46.294347 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-d065f464-4ca5-4ae9-a75c-9ce1a500fe3d tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:46.302274 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d065f464-4ca5-4ae9-a75c-9ce1a500fe3d tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/df405782-02e0-4416-9c91-818ea05dacaf" status: 200 len: 1215 microversion: 2.1 time: 0.368805 Jan 15 21:04:46.302915 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2509/5011] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:04:45 2022] GET /compute/v2.1/servers/df405782-02e0-4416-9c91-818ea05dacaf => generated 1215 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:04:46.309968 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-6b0e1869-0b6f-4509-8a47-9eb25ad27646 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:46.311081 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-6b0e1869-0b6f-4509-8a47-9eb25ad27646 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:46.320975 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6b0e1869-0b6f-4509-8a47-9eb25ad27646 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:46.322682 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6b0e1869-0b6f-4509-8a47-9eb25ad27646 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:46.323808 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6b0e1869-0b6f-4509-8a47-9eb25ad27646 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:46.324577 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6b0e1869-0b6f-4509-8a47-9eb25ad27646 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:46.366731 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-d775cd8c-501e-4099-be31-1f3e7a38ad85 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb3421bc9494914bc5f797b15a55643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31af2a6b9424f168dd6084d8d5fd0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:46.374957 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d775cd8c-501e-4099-be31-1f3e7a38ad85 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/8f58ad6d-0fd5-48c7-a969-c7b6503d639b" status: 200 len: 1309 microversion: 2.1 time: 0.696484 Jan 15 21:04:46.379607 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2503/5012] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:04:45 2022] GET /compute/v2.1/servers/8f58ad6d-0fd5-48c7-a969-c7b6503d639b => generated 1309 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:04:46.382829 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-6b0e1869-0b6f-4509-8a47-9eb25ad27646 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.078397 Jan 15 21:04:46.384499 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0a4fe1dd-b301-4eea-afff-e4fcf70c150a tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:46.387025 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-0a4fe1dd-b301-4eea-afff-e4fcf70c150a tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:46.387952 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2510/5013] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:46 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:04:46.393295 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-699b1c0e-989a-48e2-907b-e53b39971fbd req-f8edd57f-2b0a-4d64-b23a-6321f81deb50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f58ad6d-0fd5-48c7-a969-c7b6503d639b", "name": "network-vif-plugged", "status": "completed", "tag": "c695182a-5eaa-4429-881b-c572b04713b6"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:46.393959 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0a4fe1dd-b301-4eea-afff-e4fcf70c150a tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:46.394580 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0a4fe1dd-b301-4eea-afff-e4fcf70c150a tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:46.394798 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:04:46.394798 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:04:46.395850 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0a4fe1dd-b301-4eea-afff-e4fcf70c150a tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:46.396456 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0a4fe1dd-b301-4eea-afff-e4fcf70c150a tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:46.403041 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-699b1c0e-989a-48e2-907b-e53b39971fbd req-f8edd57f-2b0a-4d64-b23a-6321f81deb50 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:46.403544 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-699b1c0e-989a-48e2-907b-e53b39971fbd req-f8edd57f-2b0a-4d64-b23a-6321f81deb50 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:46.415544 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-699b1c0e-989a-48e2-907b-e53b39971fbd req-f8edd57f-2b0a-4d64-b23a-6321f81deb50 service nova] Creating event network-vif-plugged:c695182a-5eaa-4429-881b-c572b04713b6 for instance 8f58ad6d-0fd5-48c7-a969-c7b6503d639b on nch1-master-1 Jan 15 21:04:46.421684 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-699b1c0e-989a-48e2-907b-e53b39971fbd req-f8edd57f-2b0a-4d64-b23a-6321f81deb50 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032376 Jan 15 21:04:46.422290 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2511/5014] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:04:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:04:46.457555 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0a4fe1dd-b301-4eea-afff-e4fcf70c150a tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.076563 Jan 15 21:04:46.459448 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2504/5015] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:46 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:04:46.839983 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-772bd5ee-a71e-42f2-abb8-28ad29196457 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:04:46.840794 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-772bd5ee-a71e-42f2-abb8-28ad29196457 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:46.861391 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-772bd5ee-a71e-42f2-abb8-28ad29196457 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:46.861847 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-772bd5ee-a71e-42f2-abb8-28ad29196457 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:46.862889 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-772bd5ee-a71e-42f2-abb8-28ad29196457 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:46.863444 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-772bd5ee-a71e-42f2-abb8-28ad29196457 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:46.943075 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a1a32e67-b6e9-45ab-a115-14a9711b28d6 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:46.944330 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a1a32e67-b6e9-45ab-a115-14a9711b28d6 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:46.954371 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a1a32e67-b6e9-45ab-a115-14a9711b28d6 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:46.955349 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a1a32e67-b6e9-45ab-a115-14a9711b28d6 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:46.956345 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a1a32e67-b6e9-45ab-a115-14a9711b28d6 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:46.956940 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a1a32e67-b6e9-45ab-a115-14a9711b28d6 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:47.020487 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a1a32e67-b6e9-45ab-a115-14a9711b28d6 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action" status: 200 len: 24570 microversion: 2.20 time: 0.081036 Jan 15 21:04:47.022647 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2505/5016] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:46 2022] POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action => generated 24570 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:04:47.114211 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-772bd5ee-a71e-42f2-abb8-28ad29196457 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6097506a2d4e36818310d9d70bf01b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4dad65fccfe481a973f5fcbb9287dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:47.128079 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-772bd5ee-a71e-42f2-abb8-28ad29196457 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "GET /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a" status: 200 len: 1671 microversion: 2.1 time: 0.293145 Jan 15 21:04:47.129192 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2512/5017] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:04:46 2022] GET /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a => generated 1671 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:04:47.322016 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4bd641ae-d076-448d-8a70-d6fac2f57648 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:04:47.322966 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-4bd641ae-d076-448d-8a70-d6fac2f57648 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: df405782-02e0-4416-9c91-818ea05dacaf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:47.331822 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4bd641ae-d076-448d-8a70-d6fac2f57648 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:47.332623 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4bd641ae-d076-448d-8a70-d6fac2f57648 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:47.333861 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4bd641ae-d076-448d-8a70-d6fac2f57648 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:47.334653 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4bd641ae-d076-448d-8a70-d6fac2f57648 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:47.405104 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-fcca4704-d276-4d68-b963-42137527bb49 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:47.407280 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-fcca4704-d276-4d68-b963-42137527bb49 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:47.427382 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fcca4704-d276-4d68-b963-42137527bb49 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:47.429411 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fcca4704-d276-4d68-b963-42137527bb49 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:47.430505 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fcca4704-d276-4d68-b963-42137527bb49 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:47.434904 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fcca4704-d276-4d68-b963-42137527bb49 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:47.463284 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-4bd641ae-d076-448d-8a70-d6fac2f57648 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:47.474637 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-4bd641ae-d076-448d-8a70-d6fac2f57648 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/df405782-02e0-4416-9c91-818ea05dacaf" status: 200 len: 1273 microversion: 2.1 time: 0.156801 Jan 15 21:04:47.486804 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2506/5018] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:04:47 2022] GET /compute/v2.1/servers/df405782-02e0-4416-9c91-818ea05dacaf => generated 1273 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:04:47.492897 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9ee9af65-8694-46c5-948a-cc2c2c4be5fe tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:04:47.493849 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-9ee9af65-8694-46c5-948a-cc2c2c4be5fe tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: 8f58ad6d-0fd5-48c7-a969-c7b6503d639b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:47.502841 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9ee9af65-8694-46c5-948a-cc2c2c4be5fe tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:47.503543 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9ee9af65-8694-46c5-948a-cc2c2c4be5fe tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:47.504664 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9ee9af65-8694-46c5-948a-cc2c2c4be5fe tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:47.505290 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9ee9af65-8694-46c5-948a-cc2c2c4be5fe tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:47.520098 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-fcca4704-d276-4d68-b963-42137527bb49 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.126980 Jan 15 21:04:47.525790 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2513/5019] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:47 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:04:47.535631 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f78dddc5-0441-4cfe-b354-f36ab5e82caa tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:47.538812 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f78dddc5-0441-4cfe-b354-f36ab5e82caa tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:47.550797 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f78dddc5-0441-4cfe-b354-f36ab5e82caa tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:47.551936 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f78dddc5-0441-4cfe-b354-f36ab5e82caa tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:47.554540 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f78dddc5-0441-4cfe-b354-f36ab5e82caa tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:47.555719 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f78dddc5-0441-4cfe-b354-f36ab5e82caa tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:47.614208 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f78dddc5-0441-4cfe-b354-f36ab5e82caa tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.084841 Jan 15 21:04:47.614887 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2514/5020] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:47 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:04:47.804592 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-9ee9af65-8694-46c5-948a-cc2c2c4be5fe tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb3421bc9494914bc5f797b15a55643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31af2a6b9424f168dd6084d8d5fd0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:47.818289 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-9ee9af65-8694-46c5-948a-cc2c2c4be5fe tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/8f58ad6d-0fd5-48c7-a969-c7b6503d639b" status: 200 len: 1309 microversion: 2.1 time: 0.329757 Jan 15 21:04:47.819274 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2507/5021] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:04:47 2022] GET /compute/v2.1/servers/8f58ad6d-0fd5-48c7-a969-c7b6503d639b => generated 1309 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:04:48.037210 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d9cf6304-cd68-4bd4-8266-280200ad6cb6 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:48.039696 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d9cf6304-cd68-4bd4-8266-280200ad6cb6 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:48.051506 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d9cf6304-cd68-4bd4-8266-280200ad6cb6 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:48.052295 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d9cf6304-cd68-4bd4-8266-280200ad6cb6 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:48.053389 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d9cf6304-cd68-4bd4-8266-280200ad6cb6 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:48.054173 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d9cf6304-cd68-4bd4-8266-280200ad6cb6 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:48.102684 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d9cf6304-cd68-4bd4-8266-280200ad6cb6 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action" status: 200 len: 24570 microversion: 2.20 time: 0.071435 Jan 15 21:04:48.107906 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2515/5022] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:48 2022] POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action => generated 24570 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:04:48.148460 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-5832ee17-96dd-413b-bdec-1cee64ee9491 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:04:48.149312 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-5832ee17-96dd-413b-bdec-1cee64ee9491 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:48.161426 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5832ee17-96dd-413b-bdec-1cee64ee9491 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:48.162258 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5832ee17-96dd-413b-bdec-1cee64ee9491 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:48.163836 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5832ee17-96dd-413b-bdec-1cee64ee9491 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:48.164517 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5832ee17-96dd-413b-bdec-1cee64ee9491 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:48.454153 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-5832ee17-96dd-413b-bdec-1cee64ee9491 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6097506a2d4e36818310d9d70bf01b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4dad65fccfe481a973f5fcbb9287dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:48.463152 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-5832ee17-96dd-413b-bdec-1cee64ee9491 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "GET /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a" status: 200 len: 1671 microversion: 2.1 time: 0.320287 Jan 15 21:04:48.474258 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2508/5023] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:04:48 2022] GET /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a => generated 1671 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:04:48.492684 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-1cc9d32f-8fe3-488b-af5c-03248d81fa70 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:04:48.493709 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-1cc9d32f-8fe3-488b-af5c-03248d81fa70 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: df405782-02e0-4416-9c91-818ea05dacaf] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:48.502924 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1cc9d32f-8fe3-488b-af5c-03248d81fa70 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:48.503785 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1cc9d32f-8fe3-488b-af5c-03248d81fa70 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:48.505046 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1cc9d32f-8fe3-488b-af5c-03248d81fa70 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:48.505855 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1cc9d32f-8fe3-488b-af5c-03248d81fa70 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:48.533431 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-700ff6ca-b000-42f3-bedd-60b63966f13a tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:48.534342 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-700ff6ca-b000-42f3-bedd-60b63966f13a tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:48.553418 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-700ff6ca-b000-42f3-bedd-60b63966f13a tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:48.554153 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-700ff6ca-b000-42f3-bedd-60b63966f13a tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:48.557614 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-700ff6ca-b000-42f3-bedd-60b63966f13a tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:48.560825 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-700ff6ca-b000-42f3-bedd-60b63966f13a tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:48.648228 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-700ff6ca-b000-42f3-bedd-60b63966f13a tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.117445 Jan 15 21:04:48.651155 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2509/5024] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:48 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:04:48.660710 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4b8ca31a-5c45-4d10-8bfd-6c76b7bf67e5 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:48.662137 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-4b8ca31a-5c45-4d10-8bfd-6c76b7bf67e5 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:48.674375 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4b8ca31a-5c45-4d10-8bfd-6c76b7bf67e5 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:48.675426 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4b8ca31a-5c45-4d10-8bfd-6c76b7bf67e5 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:48.676827 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4b8ca31a-5c45-4d10-8bfd-6c76b7bf67e5 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:48.677454 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4b8ca31a-5c45-4d10-8bfd-6c76b7bf67e5 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:48.734405 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-4b8ca31a-5c45-4d10-8bfd-6c76b7bf67e5 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.081533 Jan 15 21:04:48.736070 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2510/5025] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:48 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:04:48.837595 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-09cc941a-3f46-4665-8bf4-4b598284a5ff tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:04:48.838340 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-09cc941a-3f46-4665-8bf4-4b598284a5ff tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: 8f58ad6d-0fd5-48c7-a969-c7b6503d639b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:48.846952 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-09cc941a-3f46-4665-8bf4-4b598284a5ff tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:48.847995 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-09cc941a-3f46-4665-8bf4-4b598284a5ff tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:48.848237 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-09cc941a-3f46-4665-8bf4-4b598284a5ff tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:48.848630 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-09cc941a-3f46-4665-8bf4-4b598284a5ff tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:48.870189 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-1cc9d32f-8fe3-488b-af5c-03248d81fa70 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:48.887014 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-1cc9d32f-8fe3-488b-af5c-03248d81fa70 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/df405782-02e0-4416-9c91-818ea05dacaf" status: 200 len: 1315 microversion: 2.1 time: 0.396567 Jan 15 21:04:48.889055 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2516/5026] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:04:48 2022] GET /compute/v2.1/servers/df405782-02e0-4416-9c91-818ea05dacaf => generated 1315 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:04:49.119217 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-7a471524-474d-4179-9e48-4ca9744dfff0 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:49.124160 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-7a471524-474d-4179-9e48-4ca9744dfff0 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:49.133789 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7a471524-474d-4179-9e48-4ca9744dfff0 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:49.134604 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7a471524-474d-4179-9e48-4ca9744dfff0 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:49.135482 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7a471524-474d-4179-9e48-4ca9744dfff0 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:49.136897 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7a471524-474d-4179-9e48-4ca9744dfff0 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:49.171727 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-09cc941a-3f46-4665-8bf4-4b598284a5ff tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb3421bc9494914bc5f797b15a55643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31af2a6b9424f168dd6084d8d5fd0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:49.181097 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-09cc941a-3f46-4665-8bf4-4b598284a5ff tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/8f58ad6d-0fd5-48c7-a969-c7b6503d639b" status: 200 len: 1491 microversion: 2.1 time: 0.347404 Jan 15 21:04:49.196420 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2511/5027] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:04:48 2022] GET /compute/v2.1/servers/8f58ad6d-0fd5-48c7-a969-c7b6503d639b => generated 1491 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:04:49.205806 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0d056694-f740-45f1-a413-e8a55ac737be tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-2013620670"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:49.207473 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-0d056694-f740-45f1-a413-e8a55ac737be tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: 8f58ad6d-0fd5-48c7-a969-c7b6503d639b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:49.209766 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-7a471524-474d-4179-9e48-4ca9744dfff0 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action" status: 200 len: 24570 microversion: 2.20 time: 0.096193 Jan 15 21:04:49.211195 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2517/5028] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:49 2022] POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action => generated 24570 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:04:49.215320 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0d056694-f740-45f1-a413-e8a55ac737be tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:49.216008 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0d056694-f740-45f1-a413-e8a55ac737be tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:49.217004 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0d056694-f740-45f1-a413-e8a55ac737be tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:49.217613 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0d056694-f740-45f1-a413-e8a55ac737be tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:49.331541 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0d056694-f740-45f1-a413-e8a55ac737be tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "PUT /compute/v2.1/servers/8f58ad6d-0fd5-48c7-a969-c7b6503d639b" status: 200 len: 1076 microversion: 2.1 time: 0.133477 Jan 15 21:04:49.332207 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2512/5029] 10.222.0.46 () {60 vars in 1255 bytes} [Sat Jan 15 21:04:49 2022] PUT /compute/v2.1/servers/8f58ad6d-0fd5-48c7-a969-c7b6503d639b => generated 1076 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:04:49.359549 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-fbb99e4e-2dae-4820-948d-39e36b92316e tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:04:49.360378 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-fbb99e4e-2dae-4820-948d-39e36b92316e tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: 8f58ad6d-0fd5-48c7-a969-c7b6503d639b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:49.390201 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fbb99e4e-2dae-4820-948d-39e36b92316e tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:49.390661 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fbb99e4e-2dae-4820-948d-39e36b92316e tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:49.397991 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fbb99e4e-2dae-4820-948d-39e36b92316e tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:49.398492 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fbb99e4e-2dae-4820-948d-39e36b92316e tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:49.483677 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b0a7b2ed-f739-4b59-b24c-6edb434b7c24 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:04:49.485020 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b0a7b2ed-f739-4b59-b24c-6edb434b7c24 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:49.509507 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b0a7b2ed-f739-4b59-b24c-6edb434b7c24 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:49.515471 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b0a7b2ed-f739-4b59-b24c-6edb434b7c24 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:49.516602 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b0a7b2ed-f739-4b59-b24c-6edb434b7c24 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:49.522596 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b0a7b2ed-f739-4b59-b24c-6edb434b7c24 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:49.747659 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-b0a7b2ed-f739-4b59-b24c-6edb434b7c24 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6097506a2d4e36818310d9d70bf01b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4dad65fccfe481a973f5fcbb9287dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:49.765952 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b0a7b2ed-f739-4b59-b24c-6edb434b7c24 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "GET /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a" status: 200 len: 1603 microversion: 2.1 time: 0.288638 Jan 15 21:04:49.782044 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2513/5030] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:04:49 2022] GET /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a => generated 1603 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:04:49.788995 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-7b1666ae-7f31-4c20-a1b1-c63432531937 req-e78b1e57-49f6-408b-817e-f606c7744392 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac78554d-ca29-4e31-a410-00dc4df5c77a", "name": "network-vif-deleted", "tag": "97667f1d-b2d5-4c9c-b247-ad291c112fa3"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:49.794779 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:04:49.794779 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:04:49.815890 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-7b1666ae-7f31-4c20-a1b1-c63432531937 req-e78b1e57-49f6-408b-817e-f606c7744392 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:49.818153 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-7b1666ae-7f31-4c20-a1b1-c63432531937 req-e78b1e57-49f6-408b-817e-f606c7744392 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:49.849693 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-7b1666ae-7f31-4c20-a1b1-c63432531937 req-e78b1e57-49f6-408b-817e-f606c7744392 service nova] Creating event network-vif-deleted:97667f1d-b2d5-4c9c-b247-ad291c112fa3 for instance ac78554d-ca29-4e31-a410-00dc4df5c77a on nch2-master-1 Jan 15 21:04:49.864102 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-7b1666ae-7f31-4c20-a1b1-c63432531937 req-e78b1e57-49f6-408b-817e-f606c7744392 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080023 Jan 15 21:04:49.868495 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2514/5031] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:04:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:04:49.883245 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-24e86073-12aa-4a4a-b3c6-aa867db5d291 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:49.885989 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-24e86073-12aa-4a4a-b3c6-aa867db5d291 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:49.901466 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-24e86073-12aa-4a4a-b3c6-aa867db5d291 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:49.904804 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-24e86073-12aa-4a4a-b3c6-aa867db5d291 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:49.905776 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-24e86073-12aa-4a4a-b3c6-aa867db5d291 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:49.906229 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-24e86073-12aa-4a4a-b3c6-aa867db5d291 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:49.962218 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-fbb99e4e-2dae-4820-948d-39e36b92316e tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb3421bc9494914bc5f797b15a55643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31af2a6b9424f168dd6084d8d5fd0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:49.981214 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-fbb99e4e-2dae-4820-948d-39e36b92316e tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/8f58ad6d-0fd5-48c7-a969-c7b6503d639b" status: 200 len: 1502 microversion: 2.1 time: 0.637182 Jan 15 21:04:49.988201 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2518/5032] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:04:49 2022] GET /compute/v2.1/servers/8f58ad6d-0fd5-48c7-a969-c7b6503d639b => generated 1502 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:04:50.003205 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e2ef26e9-7b34-49d5-a966-1c7afba10c0b tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:50.004030 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-24e86073-12aa-4a4a-b3c6-aa867db5d291 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.130209 Jan 15 21:04:50.007345 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e2ef26e9-7b34-49d5-a966-1c7afba10c0b tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:50.008929 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2515/5033] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:49 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:04:50.018623 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-29119b45-0bf9-4cd8-968d-bedb203dd871 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:04:50.026436 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-29119b45-0bf9-4cd8-968d-bedb203dd871 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: df405782-02e0-4416-9c91-818ea05dacaf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:50.035935 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e2ef26e9-7b34-49d5-a966-1c7afba10c0b tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:50.036532 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e2ef26e9-7b34-49d5-a966-1c7afba10c0b tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:50.046371 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e2ef26e9-7b34-49d5-a966-1c7afba10c0b tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:50.046950 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e2ef26e9-7b34-49d5-a966-1c7afba10c0b tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:50.049424 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-29119b45-0bf9-4cd8-968d-bedb203dd871 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:50.050148 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-29119b45-0bf9-4cd8-968d-bedb203dd871 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:50.053892 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-29119b45-0bf9-4cd8-968d-bedb203dd871 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:50.054682 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-29119b45-0bf9-4cd8-968d-bedb203dd871 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:50.153831 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e2ef26e9-7b34-49d5-a966-1c7afba10c0b tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.162467 Jan 15 21:04:50.154664 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2519/5034] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:49 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:04:50.168894 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f8cc5bc5-adb6-4b2d-8f8a-7c9ae6ed8e01 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:04:50.169766 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f8cc5bc5-adb6-4b2d-8f8a-7c9ae6ed8e01 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: 8f58ad6d-0fd5-48c7-a969-c7b6503d639b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:50.191460 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f8cc5bc5-adb6-4b2d-8f8a-7c9ae6ed8e01 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:50.191934 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f8cc5bc5-adb6-4b2d-8f8a-7c9ae6ed8e01 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:50.192717 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f8cc5bc5-adb6-4b2d-8f8a-7c9ae6ed8e01 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:50.193187 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f8cc5bc5-adb6-4b2d-8f8a-7c9ae6ed8e01 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:50.784764 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-f8cc5bc5-adb6-4b2d-8f8a-7c9ae6ed8e01 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb3421bc9494914bc5f797b15a55643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31af2a6b9424f168dd6084d8d5fd0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:50.799339 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f8cc5bc5-adb6-4b2d-8f8a-7c9ae6ed8e01 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/8f58ad6d-0fd5-48c7-a969-c7b6503d639b" status: 200 len: 1502 microversion: 2.1 time: 0.643373 Jan 15 21:04:50.800369 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2520/5035] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:04:50 2022] GET /compute/v2.1/servers/8f58ad6d-0fd5-48c7-a969-c7b6503d639b => generated 1502 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:04:50.806826 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f633844b-4d49-47f8-b4e5-e0393cba4cb9 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:50.809316 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f633844b-4d49-47f8-b4e5-e0393cba4cb9 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:50.820664 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f633844b-4d49-47f8-b4e5-e0393cba4cb9 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:50.821167 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f633844b-4d49-47f8-b4e5-e0393cba4cb9 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:50.821995 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f633844b-4d49-47f8-b4e5-e0393cba4cb9 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:50.822445 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f633844b-4d49-47f8-b4e5-e0393cba4cb9 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:50.835741 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-29119b45-0bf9-4cd8-968d-bedb203dd871 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:50.847046 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-29119b45-0bf9-4cd8-968d-bedb203dd871 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/df405782-02e0-4416-9c91-818ea05dacaf" status: 200 len: 1315 microversion: 2.1 time: 0.836174 Jan 15 21:04:50.847890 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2516/5036] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:04:50 2022] GET /compute/v2.1/servers/df405782-02e0-4416-9c91-818ea05dacaf => generated 1315 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:04:50.865853 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f82b870e-d28c-4786-a86a-e3437c9671c5 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:04:50.866966 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f82b870e-d28c-4786-a86a-e3437c9671c5 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:50.877824 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f82b870e-d28c-4786-a86a-e3437c9671c5 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:50.878599 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f633844b-4d49-47f8-b4e5-e0393cba4cb9 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action" status: 200 len: 24570 microversion: 2.20 time: 0.076778 Jan 15 21:04:50.879014 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f82b870e-d28c-4786-a86a-e3437c9671c5 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:50.879708 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2521/5037] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:50 2022] POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action => generated 24570 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:04:50.880760 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f82b870e-d28c-4786-a86a-e3437c9671c5 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:50.881433 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f82b870e-d28c-4786-a86a-e3437c9671c5 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:50.894709 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f48ec55a-79fd-40dc-8a4d-0dcd9c2c0b2b tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:50.903024 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-f82b870e-d28c-4786-a86a-e3437c9671c5 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] HTTP exception thrown: Instance ac78554d-ca29-4e31-a410-00dc4df5c77a could not be found. Jan 15 21:04:50.903793 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f48ec55a-79fd-40dc-8a4d-0dcd9c2c0b2b tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:50.904176 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f82b870e-d28c-4786-a86a-e3437c9671c5 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Returning 404 to user: Instance ac78554d-ca29-4e31-a410-00dc4df5c77a could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:04:50.904327 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f48ec55a-79fd-40dc-8a4d-0dcd9c2c0b2b tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:50.905912 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f82b870e-d28c-4786-a86a-e3437c9671c5 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "GET /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a" status: 404 len: 111 microversion: 2.1 time: 0.056572 Jan 15 21:04:50.910768 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2517/5038] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:04:50 2022] GET /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:04:50.916638 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-32de3e9d-4f5d-43cd-91c5-3f98c91d8c84 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Calling method '.version_select at 0x7f30ceb7a4c0>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:04:50.940325 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-32de3e9d-4f5d-43cd-91c5-3f98c91d8c84 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-92621215" status: 202 len: 0 microversion: 2.1 time: 0.026754 Jan 15 21:04:50.944821 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2518/5039] 10.222.0.46 () {58 vars in 1214 bytes} [Sat Jan 15 21:04:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-92621215 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:04:51.017856 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a7662887-a260-431e-bb9f-aae66fb5b578 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:51.018971 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a7662887-a260-431e-bb9f-aae66fb5b578 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:51.039109 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a7662887-a260-431e-bb9f-aae66fb5b578 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:51.045930 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a7662887-a260-431e-bb9f-aae66fb5b578 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:51.047509 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a7662887-a260-431e-bb9f-aae66fb5b578 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:51.049323 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a7662887-a260-431e-bb9f-aae66fb5b578 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:51.055238 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f48ec55a-79fd-40dc-8a4d-0dcd9c2c0b2b tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: 8f58ad6d-0fd5-48c7-a969-c7b6503d639b] Going to try to stop instance {{(pid=129365) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Jan 15 21:04:51.123687 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f48ec55a-79fd-40dc-8a4d-0dcd9c2c0b2b tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "POST /compute/v2.1/servers/8f58ad6d-0fd5-48c7-a969-c7b6503d639b/action" status: 202 len: 0 microversion: 2.1 time: 0.237159 Jan 15 21:04:51.124302 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2522/5040] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:04:50 2022] POST /compute/v2.1/servers/8f58ad6d-0fd5-48c7-a969-c7b6503d639b/action => generated 0 bytes in 241 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:04:51.133915 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-eceebc32-a984-46b5-8fe9-e1e3c1ef3586 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:04:51.138399 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-eceebc32-a984-46b5-8fe9-e1e3c1ef3586 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: 8f58ad6d-0fd5-48c7-a969-c7b6503d639b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:51.154782 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-eceebc32-a984-46b5-8fe9-e1e3c1ef3586 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:51.155484 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-eceebc32-a984-46b5-8fe9-e1e3c1ef3586 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:51.156245 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-eceebc32-a984-46b5-8fe9-e1e3c1ef3586 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:51.156759 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-eceebc32-a984-46b5-8fe9-e1e3c1ef3586 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:51.157406 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a7662887-a260-431e-bb9f-aae66fb5b578 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.143852 Jan 15 21:04:51.164924 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2519/5041] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:51 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:04:51.188329 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b8f581a2-a00d-4328-8f71-38edcbdc91f9 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:51.191938 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b8f581a2-a00d-4328-8f71-38edcbdc91f9 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:51.221075 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b8f581a2-a00d-4328-8f71-38edcbdc91f9 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:51.222692 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b8f581a2-a00d-4328-8f71-38edcbdc91f9 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:51.224411 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b8f581a2-a00d-4328-8f71-38edcbdc91f9 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:51.227290 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b8f581a2-a00d-4328-8f71-38edcbdc91f9 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:51.300024 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b8f581a2-a00d-4328-8f71-38edcbdc91f9 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.129161 Jan 15 21:04:51.301272 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2520/5042] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:51 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:04:51.610751 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-eceebc32-a984-46b5-8fe9-e1e3c1ef3586 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb3421bc9494914bc5f797b15a55643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31af2a6b9424f168dd6084d8d5fd0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:51.619625 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-eceebc32-a984-46b5-8fe9-e1e3c1ef3586 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/8f58ad6d-0fd5-48c7-a969-c7b6503d639b" status: 200 len: 1512 microversion: 2.1 time: 0.489320 Jan 15 21:04:51.630915 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2523/5043] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:04:51 2022] GET /compute/v2.1/servers/8f58ad6d-0fd5-48c7-a969-c7b6503d639b => generated 1512 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:04:51.872313 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a6e12aa9-260e-4a27-828b-1f22d45f7c2a tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:04:51.873061 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a6e12aa9-260e-4a27-828b-1f22d45f7c2a tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: df405782-02e0-4416-9c91-818ea05dacaf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:51.879983 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a6e12aa9-260e-4a27-828b-1f22d45f7c2a tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:51.880438 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a6e12aa9-260e-4a27-828b-1f22d45f7c2a tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:51.881289 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a6e12aa9-260e-4a27-828b-1f22d45f7c2a tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:51.881731 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a6e12aa9-260e-4a27-828b-1f22d45f7c2a tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:51.885373 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-e8fd3d83-5672-454d-a878-ea0e107ce0e9 req-c2c591b6-592e-4804-9253-e35ded67eefc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df405782-02e0-4416-9c91-818ea05dacaf", "tag": "43dfb9cf-e68a-4c7c-b0c6-7b7fcd77dbf4"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:51.887760 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:04:51.887760 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:04:51.894588 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-e8fd3d83-5672-454d-a878-ea0e107ce0e9 req-c2c591b6-592e-4804-9253-e35ded67eefc service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:51.895229 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-e8fd3d83-5672-454d-a878-ea0e107ce0e9 req-c2c591b6-592e-4804-9253-e35ded67eefc service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:51.910443 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-e8fd3d83-5672-454d-a878-ea0e107ce0e9 req-c2c591b6-592e-4804-9253-e35ded67eefc service nova] Creating event network-changed:43dfb9cf-e68a-4c7c-b0c6-7b7fcd77dbf4 for instance df405782-02e0-4416-9c91-818ea05dacaf on nch1-master-1 Jan 15 21:04:51.918187 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-e8fd3d83-5672-454d-a878-ea0e107ce0e9 req-c2c591b6-592e-4804-9253-e35ded67eefc service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035671 Jan 15 21:04:51.919999 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2524/5044] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:04:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:04:51.927364 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-6d27a8d1-2fc6-4a45-83e6-8ee24249d82c tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:51.928957 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-6d27a8d1-2fc6-4a45-83e6-8ee24249d82c tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:51.937749 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6d27a8d1-2fc6-4a45-83e6-8ee24249d82c tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:51.938581 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6d27a8d1-2fc6-4a45-83e6-8ee24249d82c tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:51.939924 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6d27a8d1-2fc6-4a45-83e6-8ee24249d82c tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:51.940531 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6d27a8d1-2fc6-4a45-83e6-8ee24249d82c tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:51.987976 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-6d27a8d1-2fc6-4a45-83e6-8ee24249d82c tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action" status: 200 len: 24570 microversion: 2.20 time: 0.066253 Jan 15 21:04:51.988798 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2525/5045] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:51 2022] POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action => generated 24570 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:04:52.174431 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a090c22f-deda-4749-b5d0-b8417ee5a629 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:52.175764 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a090c22f-deda-4749-b5d0-b8417ee5a629 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:52.197297 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a090c22f-deda-4749-b5d0-b8417ee5a629 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:52.197976 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a090c22f-deda-4749-b5d0-b8417ee5a629 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:52.199278 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a090c22f-deda-4749-b5d0-b8417ee5a629 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:52.199911 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a090c22f-deda-4749-b5d0-b8417ee5a629 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:52.255937 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a090c22f-deda-4749-b5d0-b8417ee5a629 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.086529 Jan 15 21:04:52.257799 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2526/5046] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:52 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:04:52.312880 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-88d510a3-dc14-4a4c-83bd-42dfe7fd0dd5 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:52.314408 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-88d510a3-dc14-4a4c-83bd-42dfe7fd0dd5 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:52.322641 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-88d510a3-dc14-4a4c-83bd-42dfe7fd0dd5 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:52.324195 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-88d510a3-dc14-4a4c-83bd-42dfe7fd0dd5 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:52.325382 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-88d510a3-dc14-4a4c-83bd-42dfe7fd0dd5 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:52.325935 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-88d510a3-dc14-4a4c-83bd-42dfe7fd0dd5 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:52.377352 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-88d510a3-dc14-4a4c-83bd-42dfe7fd0dd5 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.069073 Jan 15 21:04:52.382795 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2527/5047] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:52 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:04:52.395834 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-a6e12aa9-260e-4a27-828b-1f22d45f7c2a tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:52.406033 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a6e12aa9-260e-4a27-828b-1f22d45f7c2a tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/df405782-02e0-4416-9c91-818ea05dacaf" status: 200 len: 1315 microversion: 2.1 time: 0.539025 Jan 15 21:04:52.406612 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2521/5048] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:04:51 2022] GET /compute/v2.1/servers/df405782-02e0-4416-9c91-818ea05dacaf => generated 1315 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:04:52.482507 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f9821207-ff8d-4b10-b41f-7ae97e1426a8 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'create', calling method: .version_select at 0x7f30c8d644c0>, body: {"keypair": {"name": "tempest-keypair-166944525"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:52.497959 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-f9821207-ff8d-4b10-b41f-7ae97e1426a8 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Getting quotas for project f4dad65fccfe481a973f5fcbb9287dee. Resources: {'key_pairs'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:04:52.504091 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-f9821207-ff8d-4b10-b41f-7ae97e1426a8 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Getting quotas for user 6a6097506a2d4e36818310d9d70bf01b and project f4dad65fccfe481a973f5fcbb9287dee. Resources: {'key_pairs'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:04:52.637343 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-69d32520-85d3-4167-95ae-b613972c978b tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:04:52.638172 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-69d32520-85d3-4167-95ae-b613972c978b tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: 8f58ad6d-0fd5-48c7-a969-c7b6503d639b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:52.647397 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-69d32520-85d3-4167-95ae-b613972c978b tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:52.648004 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-69d32520-85d3-4167-95ae-b613972c978b tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:52.648935 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-69d32520-85d3-4167-95ae-b613972c978b tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:52.649380 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-69d32520-85d3-4167-95ae-b613972c978b tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:52.756549 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-f9821207-ff8d-4b10-b41f-7ae97e1426a8 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Getting quotas for project f4dad65fccfe481a973f5fcbb9287dee. Resources: {'key_pairs'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:04:52.761944 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-f9821207-ff8d-4b10-b41f-7ae97e1426a8 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Getting quotas for user 6a6097506a2d4e36818310d9d70bf01b and project f4dad65fccfe481a973f5fcbb9287dee. Resources: {'key_pairs'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:04:52.777715 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f9821207-ff8d-4b10-b41f-7ae97e1426a8 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.300474 Jan 15 21:04:52.778398 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2528/5049] 10.222.0.46 () {60 vars in 1157 bytes} [Sat Jan 15 21:04:52 2022] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:04:52.881718 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-69d32520-85d3-4167-95ae-b613972c978b tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb3421bc9494914bc5f797b15a55643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31af2a6b9424f168dd6084d8d5fd0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:52.890964 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-69d32520-85d3-4167-95ae-b613972c978b tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/8f58ad6d-0fd5-48c7-a969-c7b6503d639b" status: 200 len: 1512 microversion: 2.1 time: 0.257241 Jan 15 21:04:52.891867 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2522/5050] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:04:52 2022] GET /compute/v2.1/servers/8f58ad6d-0fd5-48c7-a969-c7b6503d639b => generated 1512 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:04:53.000964 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-072ab0dc-b47a-435b-8cff-eeb40ee5f7d6 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:53.001994 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-072ab0dc-b47a-435b-8cff-eeb40ee5f7d6 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:53.012110 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-072ab0dc-b47a-435b-8cff-eeb40ee5f7d6 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:53.012819 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-072ab0dc-b47a-435b-8cff-eeb40ee5f7d6 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:53.013956 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-072ab0dc-b47a-435b-8cff-eeb40ee5f7d6 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:53.014896 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-072ab0dc-b47a-435b-8cff-eeb40ee5f7d6 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:53.060229 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-072ab0dc-b47a-435b-8cff-eeb40ee5f7d6 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action" status: 200 len: 24570 microversion: 2.20 time: 0.063644 Jan 15 21:04:53.061318 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2529/5051] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:52 2022] POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action => generated 24570 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:04:53.275796 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0ece6c3d-766b-4478-905c-da6cf6eb4ed5 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:53.277191 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-0ece6c3d-766b-4478-905c-da6cf6eb4ed5 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:53.284955 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0ece6c3d-766b-4478-905c-da6cf6eb4ed5 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:53.285739 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0ece6c3d-766b-4478-905c-da6cf6eb4ed5 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:53.286777 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0ece6c3d-766b-4478-905c-da6cf6eb4ed5 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:53.287197 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0ece6c3d-766b-4478-905c-da6cf6eb4ed5 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:53.336411 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0ece6c3d-766b-4478-905c-da6cf6eb4ed5 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.066772 Jan 15 21:04:53.340979 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2523/5052] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:53 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:04:53.391461 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8640035e-49b7-44b5-97ea-821740e5a5bc tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:53.393688 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-8640035e-49b7-44b5-97ea-821740e5a5bc tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:53.402630 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8640035e-49b7-44b5-97ea-821740e5a5bc tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:53.403422 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8640035e-49b7-44b5-97ea-821740e5a5bc tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:53.404420 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8640035e-49b7-44b5-97ea-821740e5a5bc tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:53.405073 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8640035e-49b7-44b5-97ea-821740e5a5bc tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:53.425513 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-451a7205-82cf-476a-8140-1ad3abd16f40 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:04:53.426607 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-451a7205-82cf-476a-8140-1ad3abd16f40 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: df405782-02e0-4416-9c91-818ea05dacaf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:53.435365 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-451a7205-82cf-476a-8140-1ad3abd16f40 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:53.436103 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-451a7205-82cf-476a-8140-1ad3abd16f40 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:53.437772 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-451a7205-82cf-476a-8140-1ad3abd16f40 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:53.438455 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-451a7205-82cf-476a-8140-1ad3abd16f40 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:53.456805 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-8640035e-49b7-44b5-97ea-821740e5a5bc tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.070254 Jan 15 21:04:53.465625 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2530/5053] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:53 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:04:53.724670 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-451a7205-82cf-476a-8140-1ad3abd16f40 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:53.734583 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-451a7205-82cf-476a-8140-1ad3abd16f40 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/df405782-02e0-4416-9c91-818ea05dacaf" status: 200 len: 1315 microversion: 2.1 time: 0.313822 Jan 15 21:04:53.735174 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2524/5054] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:04:53 2022] GET /compute/v2.1/servers/df405782-02e0-4416-9c91-818ea05dacaf => generated 1315 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:04:53.909991 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e04c9d8b-ebcc-48c3-9aa0-986c55f3e0e4 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:04:53.910945 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e04c9d8b-ebcc-48c3-9aa0-986c55f3e0e4 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: 8f58ad6d-0fd5-48c7-a969-c7b6503d639b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:53.919715 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e04c9d8b-ebcc-48c3-9aa0-986c55f3e0e4 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:53.920198 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e04c9d8b-ebcc-48c3-9aa0-986c55f3e0e4 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:53.921101 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e04c9d8b-ebcc-48c3-9aa0-986c55f3e0e4 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:53.921872 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e04c9d8b-ebcc-48c3-9aa0-986c55f3e0e4 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:54.071505 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b0b0586b-73b6-4ab8-9909-932d87848058 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:54.072420 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b0b0586b-73b6-4ab8-9909-932d87848058 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:54.079883 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b0b0586b-73b6-4ab8-9909-932d87848058 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:54.080560 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b0b0586b-73b6-4ab8-9909-932d87848058 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:54.081562 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b0b0586b-73b6-4ab8-9909-932d87848058 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:54.082151 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b0b0586b-73b6-4ab8-9909-932d87848058 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:54.136987 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b0b0586b-73b6-4ab8-9909-932d87848058 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action" status: 200 len: 24570 microversion: 2.20 time: 0.068159 Jan 15 21:04:54.141119 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2525/5055] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:54 2022] POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action => generated 24570 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:04:54.213787 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-e04c9d8b-ebcc-48c3-9aa0-986c55f3e0e4 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb3421bc9494914bc5f797b15a55643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31af2a6b9424f168dd6084d8d5fd0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:54.222890 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e04c9d8b-ebcc-48c3-9aa0-986c55f3e0e4 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/8f58ad6d-0fd5-48c7-a969-c7b6503d639b" status: 200 len: 1512 microversion: 2.1 time: 0.317134 Jan 15 21:04:54.224190 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2531/5056] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:04:53 2022] GET /compute/v2.1/servers/8f58ad6d-0fd5-48c7-a969-c7b6503d639b => generated 1512 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:04:54.349907 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-3c5d085c-54f2-435f-91ae-d545ddf80d89 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:54.351688 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-3c5d085c-54f2-435f-91ae-d545ddf80d89 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:54.359688 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3c5d085c-54f2-435f-91ae-d545ddf80d89 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:54.360778 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3c5d085c-54f2-435f-91ae-d545ddf80d89 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:54.361932 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3c5d085c-54f2-435f-91ae-d545ddf80d89 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:54.362377 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3c5d085c-54f2-435f-91ae-d545ddf80d89 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:54.420188 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-3c5d085c-54f2-435f-91ae-d545ddf80d89 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.073944 Jan 15 21:04:54.425781 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2526/5057] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:54 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:04:54.472118 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-28cf6b03-a511-4944-8432-00855945ca6c tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:54.473115 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-28cf6b03-a511-4944-8432-00855945ca6c tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:54.480991 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-28cf6b03-a511-4944-8432-00855945ca6c tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:54.484485 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-28cf6b03-a511-4944-8432-00855945ca6c tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:54.487410 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-28cf6b03-a511-4944-8432-00855945ca6c tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:54.489301 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-28cf6b03-a511-4944-8432-00855945ca6c tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:54.552816 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-28cf6b03-a511-4944-8432-00855945ca6c tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.084414 Jan 15 21:04:54.554248 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2532/5058] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:54 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:04:54.752569 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4d00b8f5-2bfa-4b11-bd61-9e2bdf5ab3df tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:04:54.753599 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-4d00b8f5-2bfa-4b11-bd61-9e2bdf5ab3df tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: df405782-02e0-4416-9c91-818ea05dacaf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:54.761404 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4d00b8f5-2bfa-4b11-bd61-9e2bdf5ab3df tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:54.763125 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4d00b8f5-2bfa-4b11-bd61-9e2bdf5ab3df tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:54.764150 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4d00b8f5-2bfa-4b11-bd61-9e2bdf5ab3df tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:54.764765 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4d00b8f5-2bfa-4b11-bd61-9e2bdf5ab3df tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:54.860052 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-13f61b72-8d0d-4ebd-a51e-647d54703512 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-108024650", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dd26bf3f-ac0f-4779-8f8e-a3094245a610"}], "security_groups": [{"name": "tempest-securitygroup--1027234900"}], "key_name": "tempest-keypair-166944525", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:55.056492 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.network.neutron [None req-13f61b72-8d0d-4ebd-a51e-647d54703512 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] validate_networks() for [('dd26bf3f-ac0f-4779-8f8e-a3094245a610', None, None, None, None, None)] {{(pid=129365) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 21:04:55.082098 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-4d00b8f5-2bfa-4b11-bd61-9e2bdf5ab3df tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:55.095192 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-4d00b8f5-2bfa-4b11-bd61-9e2bdf5ab3df tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/df405782-02e0-4416-9c91-818ea05dacaf" status: 200 len: 1315 microversion: 2.1 time: 0.346665 Jan 15 21:04:55.097020 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2527/5059] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:04:54 2022] GET /compute/v2.1/servers/df405782-02e0-4416-9c91-818ea05dacaf => generated 1315 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:04:55.149492 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-5a62d87f-8475-4f88-9b9a-fe9051eb3bbf tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:55.150871 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-5a62d87f-8475-4f88-9b9a-fe9051eb3bbf tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:55.157655 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5a62d87f-8475-4f88-9b9a-fe9051eb3bbf tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:55.158506 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5a62d87f-8475-4f88-9b9a-fe9051eb3bbf tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:55.159461 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5a62d87f-8475-4f88-9b9a-fe9051eb3bbf tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:55.159888 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5a62d87f-8475-4f88-9b9a-fe9051eb3bbf tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:55.209795 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-5a62d87f-8475-4f88-9b9a-fe9051eb3bbf tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action" status: 200 len: 24570 microversion: 2.20 time: 0.064198 Jan 15 21:04:55.210520 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2528/5060] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:55 2022] POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action => generated 24570 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:04:55.242701 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-91b65f56-36ef-4fb8-b108-0e791ed2b601 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:04:55.244025 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-91b65f56-36ef-4fb8-b108-0e791ed2b601 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: 8f58ad6d-0fd5-48c7-a969-c7b6503d639b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:55.251577 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-91b65f56-36ef-4fb8-b108-0e791ed2b601 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:55.252035 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-91b65f56-36ef-4fb8-b108-0e791ed2b601 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:55.252867 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-91b65f56-36ef-4fb8-b108-0e791ed2b601 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:55.253451 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-91b65f56-36ef-4fb8-b108-0e791ed2b601 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:55.459321 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-91b65f56-36ef-4fb8-b108-0e791ed2b601 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb3421bc9494914bc5f797b15a55643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31af2a6b9424f168dd6084d8d5fd0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:55.468097 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-91b65f56-36ef-4fb8-b108-0e791ed2b601 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/8f58ad6d-0fd5-48c7-a969-c7b6503d639b" status: 200 len: 1512 microversion: 2.1 time: 0.229814 Jan 15 21:04:55.468742 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2529/5061] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:04:55 2022] GET /compute/v2.1/servers/8f58ad6d-0fd5-48c7-a969-c7b6503d639b => generated 1512 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:04:55.474246 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-57bc143e-faf3-4c54-9677-0460ebbccdf9 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:55.475156 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-57bc143e-faf3-4c54-9677-0460ebbccdf9 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:55.491812 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-57bc143e-faf3-4c54-9677-0460ebbccdf9 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:55.492262 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-57bc143e-faf3-4c54-9677-0460ebbccdf9 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:55.493450 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-57bc143e-faf3-4c54-9677-0460ebbccdf9 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:55.494042 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-57bc143e-faf3-4c54-9677-0460ebbccdf9 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:55.550595 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-57bc143e-faf3-4c54-9677-0460ebbccdf9 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.080555 Jan 15 21:04:55.551430 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2530/5062] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:55 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:04:55.568390 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-87902606-0965-4774-af1f-fb5f6d05f82a tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:55.569860 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-87902606-0965-4774-af1f-fb5f6d05f82a tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:55.580741 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-87902606-0965-4774-af1f-fb5f6d05f82a tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:55.581303 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-87902606-0965-4774-af1f-fb5f6d05f82a tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:55.582225 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-87902606-0965-4774-af1f-fb5f6d05f82a tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:55.583059 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-87902606-0965-4774-af1f-fb5f6d05f82a tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:55.634816 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-87902606-0965-4774-af1f-fb5f6d05f82a tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.072123 Jan 15 21:04:55.637151 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2531/5063] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:55 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:04:55.736215 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-13f61b72-8d0d-4ebd-a51e-647d54703512 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Flavor limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 21:04:55.736919 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-13f61b72-8d0d-4ebd-a51e-647d54703512 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Image limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 21:04:55.737775 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-13f61b72-8d0d-4ebd-a51e-647d54703512 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Flavor pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 21:04:55.738419 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-13f61b72-8d0d-4ebd-a51e-647d54703512 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Image pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 21:04:55.738985 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-13f61b72-8d0d-4ebd-a51e-647d54703512 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 21:04:55.749542 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-13f61b72-8d0d-4ebd-a51e-647d54703512 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:55.750410 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-13f61b72-8d0d-4ebd-a51e-647d54703512 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:55.751611 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-13f61b72-8d0d-4ebd-a51e-647d54703512 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:55.752181 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-13f61b72-8d0d-4ebd-a51e-647d54703512 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:55.770882 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-13f61b72-8d0d-4ebd-a51e-647d54703512 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Getting quotas for project f4dad65fccfe481a973f5fcbb9287dee. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:04:55.777366 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-13f61b72-8d0d-4ebd-a51e-647d54703512 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Getting quotas for user 6a6097506a2d4e36818310d9d70bf01b and project f4dad65fccfe481a973f5fcbb9287dee. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:04:55.791408 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-13f61b72-8d0d-4ebd-a51e-647d54703512 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Going to run 1 instances... {{(pid=129365) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 21:04:55.794774 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-13f61b72-8d0d-4ebd-a51e-647d54703512 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: d9db70df-9ffc-4b96-af06-a56b3b35ce91] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129365) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 21:04:55.849554 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-13f61b72-8d0d-4ebd-a51e-647d54703512 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.994454 Jan 15 21:04:55.852883 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2533/5064] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 21:04:54 2022] POST /compute/v2.1/servers => generated 402 bytes in 996 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 15 21:04:55.863041 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0273b324-278e-47fa-836c-961eace19caf tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:04:55.864013 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-0273b324-278e-47fa-836c-961eace19caf tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: d9db70df-9ffc-4b96-af06-a56b3b35ce91] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:55.988803 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-0273b324-278e-47fa-836c-961eace19caf tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6097506a2d4e36818310d9d70bf01b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4dad65fccfe481a973f5fcbb9287dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:56.000742 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0273b324-278e-47fa-836c-961eace19caf tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "GET /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91" status: 200 len: 1236 microversion: 2.1 time: 0.142668 Jan 15 21:04:56.002396 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2532/5065] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:04:55 2022] GET /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91 => generated 1236 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:04:56.119452 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2ddc7976-2ad0-42af-a177-a1d284683ba9 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:04:56.120617 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-2ddc7976-2ad0-42af-a177-a1d284683ba9 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: df405782-02e0-4416-9c91-818ea05dacaf] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:56.147683 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2ddc7976-2ad0-42af-a177-a1d284683ba9 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:56.148473 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2ddc7976-2ad0-42af-a177-a1d284683ba9 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:56.149387 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2ddc7976-2ad0-42af-a177-a1d284683ba9 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:56.149842 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2ddc7976-2ad0-42af-a177-a1d284683ba9 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:56.209375 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-cc55bdfa-2a10-4b21-9513-7a2f41f40bc3 req-cc613246-dfcf-44e5-8206-befaf5baa668 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df405782-02e0-4416-9c91-818ea05dacaf", "name": "network-vif-plugged", "status": "completed", "tag": "43dfb9cf-e68a-4c7c-b0c6-7b7fcd77dbf4"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:56.211659 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:04:56.211659 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:04:56.237911 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-cc55bdfa-2a10-4b21-9513-7a2f41f40bc3 req-cc613246-dfcf-44e5-8206-befaf5baa668 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:56.244545 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-cc55bdfa-2a10-4b21-9513-7a2f41f40bc3 req-cc613246-dfcf-44e5-8206-befaf5baa668 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:56.268350 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-cc55bdfa-2a10-4b21-9513-7a2f41f40bc3 req-cc613246-dfcf-44e5-8206-befaf5baa668 service nova] Creating event network-vif-plugged:43dfb9cf-e68a-4c7c-b0c6-7b7fcd77dbf4 for instance df405782-02e0-4416-9c91-818ea05dacaf on nch1-master-1 Jan 15 21:04:56.275284 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-cc55bdfa-2a10-4b21-9513-7a2f41f40bc3 req-cc613246-dfcf-44e5-8206-befaf5baa668 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071576 Jan 15 21:04:56.276996 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2533/5066] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:04:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 21:04:56.283194 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9aadeb42-24fe-49c7-846a-26531704a629 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:56.284508 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-9aadeb42-24fe-49c7-846a-26531704a629 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:56.294217 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9aadeb42-24fe-49c7-846a-26531704a629 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:56.295030 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9aadeb42-24fe-49c7-846a-26531704a629 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:56.296113 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9aadeb42-24fe-49c7-846a-26531704a629 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:56.296824 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9aadeb42-24fe-49c7-846a-26531704a629 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:56.384553 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-9aadeb42-24fe-49c7-846a-26531704a629 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action" status: 200 len: 24570 microversion: 2.20 time: 0.105595 Jan 15 21:04:56.390465 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2534/5067] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:56 2022] POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action => generated 24570 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:04:56.466867 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-2ddc7976-2ad0-42af-a177-a1d284683ba9 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:56.478098 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2ddc7976-2ad0-42af-a177-a1d284683ba9 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/df405782-02e0-4416-9c91-818ea05dacaf" status: 200 len: 1315 microversion: 2.1 time: 0.367573 Jan 15 21:04:56.486853 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-54b2e2dd-1d1f-4a2a-aa39-6a60d74b9815 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:04:56.487628 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-54b2e2dd-1d1f-4a2a-aa39-6a60d74b9815 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: 8f58ad6d-0fd5-48c7-a969-c7b6503d639b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:56.490276 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2534/5068] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:04:56 2022] GET /compute/v2.1/servers/df405782-02e0-4416-9c91-818ea05dacaf => generated 1315 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:04:56.503004 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-54b2e2dd-1d1f-4a2a-aa39-6a60d74b9815 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:56.503467 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-54b2e2dd-1d1f-4a2a-aa39-6a60d74b9815 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:56.504409 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-54b2e2dd-1d1f-4a2a-aa39-6a60d74b9815 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:56.505050 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-54b2e2dd-1d1f-4a2a-aa39-6a60d74b9815 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:56.567567 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8c8f6b32-68c2-4900-bd16-6e7fcb131878 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:56.568637 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-8c8f6b32-68c2-4900-bd16-6e7fcb131878 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:56.584467 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8c8f6b32-68c2-4900-bd16-6e7fcb131878 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:56.585136 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8c8f6b32-68c2-4900-bd16-6e7fcb131878 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:56.590049 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8c8f6b32-68c2-4900-bd16-6e7fcb131878 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:56.590570 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8c8f6b32-68c2-4900-bd16-6e7fcb131878 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:56.696797 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-54b2e2dd-1d1f-4a2a-aa39-6a60d74b9815 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb3421bc9494914bc5f797b15a55643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31af2a6b9424f168dd6084d8d5fd0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:56.707596 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-54b2e2dd-1d1f-4a2a-aa39-6a60d74b9815 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/8f58ad6d-0fd5-48c7-a969-c7b6503d639b" status: 200 len: 1512 microversion: 2.1 time: 0.225101 Jan 15 21:04:56.708934 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2535/5069] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:04:56 2022] GET /compute/v2.1/servers/8f58ad6d-0fd5-48c7-a969-c7b6503d639b => generated 1512 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:04:56.714810 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8402a7ce-0ead-4dbd-bd8b-a200f4da2cde tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:56.715729 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-8402a7ce-0ead-4dbd-bd8b-a200f4da2cde tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:56.721768 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8402a7ce-0ead-4dbd-bd8b-a200f4da2cde tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:56.722229 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8402a7ce-0ead-4dbd-bd8b-a200f4da2cde tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:56.723183 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8402a7ce-0ead-4dbd-bd8b-a200f4da2cde tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:56.723655 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8402a7ce-0ead-4dbd-bd8b-a200f4da2cde tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:56.771431 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-8c8f6b32-68c2-4900-bd16-6e7fcb131878 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.211545 Jan 15 21:04:56.773119 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2535/5070] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:56 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:04:56.777856 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-8402a7ce-0ead-4dbd-bd8b-a200f4da2cde tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.067061 Jan 15 21:04:56.778655 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2536/5071] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:56 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:04:57.019440 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-21f42a4c-e359-4831-91d1-ebb7b082b004 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:04:57.020146 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-21f42a4c-e359-4831-91d1-ebb7b082b004 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: d9db70df-9ffc-4b96-af06-a56b3b35ce91] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:57.029565 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-21f42a4c-e359-4831-91d1-ebb7b082b004 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:57.030454 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-21f42a4c-e359-4831-91d1-ebb7b082b004 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:57.031464 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-21f42a4c-e359-4831-91d1-ebb7b082b004 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:57.032069 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-21f42a4c-e359-4831-91d1-ebb7b082b004 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:57.101712 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-21f42a4c-e359-4831-91d1-ebb7b082b004 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6097506a2d4e36818310d9d70bf01b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4dad65fccfe481a973f5fcbb9287dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:57.111254 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-21f42a4c-e359-4831-91d1-ebb7b082b004 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "GET /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91" status: 200 len: 1288 microversion: 2.1 time: 0.095775 Jan 15 21:04:57.111844 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2536/5072] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:04:57 2022] GET /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91 => generated 1288 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:04:57.399324 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-319316d1-9f5d-411c-840c-81941ad62669 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:57.400402 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-319316d1-9f5d-411c-840c-81941ad62669 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:57.413719 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-319316d1-9f5d-411c-840c-81941ad62669 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:57.419095 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-319316d1-9f5d-411c-840c-81941ad62669 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:57.420128 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-319316d1-9f5d-411c-840c-81941ad62669 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:57.420790 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-319316d1-9f5d-411c-840c-81941ad62669 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:57.493158 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-319316d1-9f5d-411c-840c-81941ad62669 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action" status: 200 len: 24570 microversion: 2.20 time: 0.097521 Jan 15 21:04:57.500663 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2537/5073] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:57 2022] POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action => generated 24570 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:04:57.523207 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3ccb8ed9-5666-4cff-8172-19ed36b14516 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:04:57.524092 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-3ccb8ed9-5666-4cff-8172-19ed36b14516 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: df405782-02e0-4416-9c91-818ea05dacaf] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:57.534604 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3ccb8ed9-5666-4cff-8172-19ed36b14516 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:57.535060 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3ccb8ed9-5666-4cff-8172-19ed36b14516 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:57.535955 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3ccb8ed9-5666-4cff-8172-19ed36b14516 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:57.536819 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3ccb8ed9-5666-4cff-8172-19ed36b14516 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:57.726936 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-fa3fa8df-bede-4902-aae0-da18c43e3923 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:04:57.727716 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-fa3fa8df-bede-4902-aae0-da18c43e3923 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: 8f58ad6d-0fd5-48c7-a969-c7b6503d639b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:57.738277 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fa3fa8df-bede-4902-aae0-da18c43e3923 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:57.739014 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fa3fa8df-bede-4902-aae0-da18c43e3923 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:57.740060 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fa3fa8df-bede-4902-aae0-da18c43e3923 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:57.740889 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fa3fa8df-bede-4902-aae0-da18c43e3923 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:57.928122 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-3ccb8ed9-5666-4cff-8172-19ed36b14516 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:57.936545 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3ccb8ed9-5666-4cff-8172-19ed36b14516 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/df405782-02e0-4416-9c91-818ea05dacaf" status: 200 len: 1315 microversion: 2.1 time: 0.427575 Jan 15 21:04:57.937753 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2537/5074] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:04:57 2022] GET /compute/v2.1/servers/df405782-02e0-4416-9c91-818ea05dacaf => generated 1315 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:04:57.945645 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9452256d-8b5e-439b-b53a-05427b6d1753 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:57.946850 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-9452256d-8b5e-439b-b53a-05427b6d1753 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:57.954202 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9452256d-8b5e-439b-b53a-05427b6d1753 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:57.954923 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9452256d-8b5e-439b-b53a-05427b6d1753 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:57.955903 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9452256d-8b5e-439b-b53a-05427b6d1753 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:57.956351 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9452256d-8b5e-439b-b53a-05427b6d1753 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:58.003029 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-9452256d-8b5e-439b-b53a-05427b6d1753 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.063746 Jan 15 21:04:58.004969 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2538/5075] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:57 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:04:58.011840 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-736f050d-22bb-4e3c-955f-f5477c7df344 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:58.013284 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-736f050d-22bb-4e3c-955f-f5477c7df344 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:58.020650 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-736f050d-22bb-4e3c-955f-f5477c7df344 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:58.021156 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-736f050d-22bb-4e3c-955f-f5477c7df344 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:58.022150 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-736f050d-22bb-4e3c-955f-f5477c7df344 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:58.022794 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-736f050d-22bb-4e3c-955f-f5477c7df344 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:58.077115 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-736f050d-22bb-4e3c-955f-f5477c7df344 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.070305 Jan 15 21:04:58.077805 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2539/5076] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:58 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:04:58.110547 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-fa3fa8df-bede-4902-aae0-da18c43e3923 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb3421bc9494914bc5f797b15a55643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31af2a6b9424f168dd6084d8d5fd0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:58.121170 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-fa3fa8df-bede-4902-aae0-da18c43e3923 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/8f58ad6d-0fd5-48c7-a969-c7b6503d639b" status: 200 len: 1512 microversion: 2.1 time: 0.398046 Jan 15 21:04:58.121881 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2538/5077] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:04:57 2022] GET /compute/v2.1/servers/8f58ad6d-0fd5-48c7-a969-c7b6503d639b => generated 1512 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:04:58.131422 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-87128e6f-8614-4c74-899e-d14f30bb678b tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:04:58.132288 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-87128e6f-8614-4c74-899e-d14f30bb678b tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: d9db70df-9ffc-4b96-af06-a56b3b35ce91] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:58.144094 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-87128e6f-8614-4c74-899e-d14f30bb678b tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:58.148302 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-87128e6f-8614-4c74-899e-d14f30bb678b tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:58.148302 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-87128e6f-8614-4c74-899e-d14f30bb678b tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:58.148302 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-87128e6f-8614-4c74-899e-d14f30bb678b tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:58.254141 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-87128e6f-8614-4c74-899e-d14f30bb678b tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6097506a2d4e36818310d9d70bf01b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4dad65fccfe481a973f5fcbb9287dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:58.264981 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-87128e6f-8614-4c74-899e-d14f30bb678b tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "GET /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91" status: 200 len: 1294 microversion: 2.1 time: 0.138107 Jan 15 21:04:58.266027 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2540/5078] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:04:58 2022] GET /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91 => generated 1294 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:04:58.510170 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a68676db-9a98-4f0d-86ba-d8b6ffca4d42 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:58.516507 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a68676db-9a98-4f0d-86ba-d8b6ffca4d42 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:58.545155 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a68676db-9a98-4f0d-86ba-d8b6ffca4d42 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:58.545625 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a68676db-9a98-4f0d-86ba-d8b6ffca4d42 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:58.546446 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a68676db-9a98-4f0d-86ba-d8b6ffca4d42 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:58.547048 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a68676db-9a98-4f0d-86ba-d8b6ffca4d42 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:58.608374 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a68676db-9a98-4f0d-86ba-d8b6ffca4d42 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action" status: 200 len: 24570 microversion: 2.20 time: 0.105317 Jan 15 21:04:58.612158 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2539/5079] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:58 2022] POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action => generated 24570 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:04:58.954411 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f78f41af-968f-4fda-8a58-1a8f8f132efe tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:04:58.955023 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f78f41af-968f-4fda-8a58-1a8f8f132efe tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: df405782-02e0-4416-9c91-818ea05dacaf] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:58.964326 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f78f41af-968f-4fda-8a58-1a8f8f132efe tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:58.965216 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f78f41af-968f-4fda-8a58-1a8f8f132efe tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:58.966492 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f78f41af-968f-4fda-8a58-1a8f8f132efe tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:58.967219 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f78f41af-968f-4fda-8a58-1a8f8f132efe tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:59.017271 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-6dd92581-e0ec-4a4a-832b-3580dc005362 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:59.018652 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-6dd92581-e0ec-4a4a-832b-3580dc005362 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:59.030650 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6dd92581-e0ec-4a4a-832b-3580dc005362 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:59.031453 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6dd92581-e0ec-4a4a-832b-3580dc005362 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:59.032338 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6dd92581-e0ec-4a4a-832b-3580dc005362 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:59.033012 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6dd92581-e0ec-4a4a-832b-3580dc005362 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:59.096693 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-6dd92581-e0ec-4a4a-832b-3580dc005362 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.083868 Jan 15 21:04:59.097863 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2540/5080] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:59 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:04:59.117341 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ff1c1cb3-e75e-4292-b4d9-4507a7291999 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:59.118670 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ff1c1cb3-e75e-4292-b4d9-4507a7291999 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:59.126707 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ff1c1cb3-e75e-4292-b4d9-4507a7291999 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:59.127210 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ff1c1cb3-e75e-4292-b4d9-4507a7291999 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:59.127991 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ff1c1cb3-e75e-4292-b4d9-4507a7291999 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:59.128885 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ff1c1cb3-e75e-4292-b4d9-4507a7291999 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:59.202979 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ff1c1cb3-e75e-4292-b4d9-4507a7291999 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.103945 Jan 15 21:04:59.205120 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2541/5081] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:59 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:04:59.213512 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9902a89a-0df5-43d8-a281-2050f522c8f7 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:04:59.215192 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-9902a89a-0df5-43d8-a281-2050f522c8f7 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: 8f58ad6d-0fd5-48c7-a969-c7b6503d639b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:59.225618 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9902a89a-0df5-43d8-a281-2050f522c8f7 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:59.226245 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9902a89a-0df5-43d8-a281-2050f522c8f7 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:59.227320 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9902a89a-0df5-43d8-a281-2050f522c8f7 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:59.227836 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9902a89a-0df5-43d8-a281-2050f522c8f7 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:59.377422 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-f78f41af-968f-4fda-8a58-1a8f8f132efe tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:59.385054 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f78f41af-968f-4fda-8a58-1a8f8f132efe tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/df405782-02e0-4416-9c91-818ea05dacaf" status: 200 len: 1502 microversion: 2.1 time: 0.434846 Jan 15 21:04:59.386248 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2541/5082] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:04:58 2022] GET /compute/v2.1/servers/df405782-02e0-4416-9c91-818ea05dacaf => generated 1502 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:04:59.393664 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d72de854-2722-48c8-aedb-db6516baeb38 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:04:59.394477 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d72de854-2722-48c8-aedb-db6516baeb38 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: d9db70df-9ffc-4b96-af06-a56b3b35ce91] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:59.412491 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d72de854-2722-48c8-aedb-db6516baeb38 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:59.412976 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d72de854-2722-48c8-aedb-db6516baeb38 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:59.413795 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d72de854-2722-48c8-aedb-db6516baeb38 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:59.414244 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d72de854-2722-48c8-aedb-db6516baeb38 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:59.679087 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-9902a89a-0df5-43d8-a281-2050f522c8f7 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb3421bc9494914bc5f797b15a55643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31af2a6b9424f168dd6084d8d5fd0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:59.694226 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-9902a89a-0df5-43d8-a281-2050f522c8f7 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/8f58ad6d-0fd5-48c7-a969-c7b6503d639b" status: 200 len: 1512 microversion: 2.1 time: 0.483783 Jan 15 21:04:59.695251 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2542/5083] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:04:59 2022] GET /compute/v2.1/servers/8f58ad6d-0fd5-48c7-a969-c7b6503d639b => generated 1512 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:04:59.708274 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b29d6e92-9f1b-442b-b27c-dbfc2554c956 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:59.708663 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b29d6e92-9f1b-442b-b27c-dbfc2554c956 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: df405782-02e0-4416-9c91-818ea05dacaf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:59.727541 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b29d6e92-9f1b-442b-b27c-dbfc2554c956 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:59.730773 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b29d6e92-9f1b-442b-b27c-dbfc2554c956 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:59.732015 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b29d6e92-9f1b-442b-b27c-dbfc2554c956 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:59.732705 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b29d6e92-9f1b-442b-b27c-dbfc2554c956 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:59.852754 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-d72de854-2722-48c8-aedb-db6516baeb38 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6097506a2d4e36818310d9d70bf01b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4dad65fccfe481a973f5fcbb9287dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:04:59.856272 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b29d6e92-9f1b-442b-b27c-dbfc2554c956 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "POST /compute/v2.1/servers/df405782-02e0-4416-9c91-818ea05dacaf/action" status: 202 len: 0 microversion: 2.1 time: 0.159251 Jan 15 21:04:59.872055 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d72de854-2722-48c8-aedb-db6516baeb38 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "GET /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91" status: 200 len: 1362 microversion: 2.1 time: 0.481629 Jan 15 21:04:59.872332 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2543/5084] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:04:59 2022] POST /compute/v2.1/servers/df405782-02e0-4416-9c91-818ea05dacaf/action => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:04:59.873249 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2542/5085] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:04:59 2022] GET /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91 => generated 1362 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:04:59.896063 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-531daa4e-1e31-4245-848d-37ad6d7e77c5 req-4515006f-1d28-4039-a7a0-513d5544794f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9db70df-9ffc-4b96-af06-a56b3b35ce91", "tag": "19fc242c-c091-4b78-8fec-c33b6bd5cc60"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:04:59.901856 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:04:59.901856 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:04:59.919756 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-531daa4e-1e31-4245-848d-37ad6d7e77c5 req-4515006f-1d28-4039-a7a0-513d5544794f service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:59.920367 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-531daa4e-1e31-4245-848d-37ad6d7e77c5 req-4515006f-1d28-4039-a7a0-513d5544794f service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:59.940599 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-531daa4e-1e31-4245-848d-37ad6d7e77c5 req-4515006f-1d28-4039-a7a0-513d5544794f service nova] Creating event network-changed:19fc242c-c091-4b78-8fec-c33b6bd5cc60 for instance d9db70df-9ffc-4b96-af06-a56b3b35ce91 on nch2-master-1 Jan 15 21:04:59.951577 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-531daa4e-1e31-4245-848d-37ad6d7e77c5 req-4515006f-1d28-4039-a7a0-513d5544794f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077830 Jan 15 21:04:59.953475 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2544/5086] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:04:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:04:59.973519 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c3547b9e-b343-436c-a65c-802de9c8035b tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:04:59.974707 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c3547b9e-b343-436c-a65c-802de9c8035b tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: df405782-02e0-4416-9c91-818ea05dacaf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:04:59.983939 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c3547b9e-b343-436c-a65c-802de9c8035b tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:59.984534 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c3547b9e-b343-436c-a65c-802de9c8035b tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:04:59.985368 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c3547b9e-b343-436c-a65c-802de9c8035b tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:04:59.985991 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c3547b9e-b343-436c-a65c-802de9c8035b tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:00.184090 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a3163b82-5dac-4d8b-884f-a4e264ba6d5e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:00.186171 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a3163b82-5dac-4d8b-884f-a4e264ba6d5e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:00.196373 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a3163b82-5dac-4d8b-884f-a4e264ba6d5e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:00.197351 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a3163b82-5dac-4d8b-884f-a4e264ba6d5e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:00.199372 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a3163b82-5dac-4d8b-884f-a4e264ba6d5e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:00.200265 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a3163b82-5dac-4d8b-884f-a4e264ba6d5e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:00.266371 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a3163b82-5dac-4d8b-884f-a4e264ba6d5e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action" status: 200 len: 24570 microversion: 2.20 time: 0.391588 Jan 15 21:05:00.270574 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2543/5087] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:04:59 2022] POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action => generated 24570 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:05:00.272557 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f680f82f-73c1-405b-81d5-020eef98c7c1 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:00.273944 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f680f82f-73c1-405b-81d5-020eef98c7c1 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:00.282067 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f680f82f-73c1-405b-81d5-020eef98c7c1 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:00.282618 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f680f82f-73c1-405b-81d5-020eef98c7c1 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:00.284028 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f680f82f-73c1-405b-81d5-020eef98c7c1 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:00.284530 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f680f82f-73c1-405b-81d5-020eef98c7c1 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:00.341507 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f680f82f-73c1-405b-81d5-020eef98c7c1 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.072559 Jan 15 21:05:00.342199 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2544/5088] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:00 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:05:00.351644 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-0e8ff2ae-7f2b-4833-91f4-3de066505fd5 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:00.353456 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-0e8ff2ae-7f2b-4833-91f4-3de066505fd5 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:00.363366 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0e8ff2ae-7f2b-4833-91f4-3de066505fd5 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:00.364003 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0e8ff2ae-7f2b-4833-91f4-3de066505fd5 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:00.365223 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0e8ff2ae-7f2b-4833-91f4-3de066505fd5 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:00.365808 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0e8ff2ae-7f2b-4833-91f4-3de066505fd5 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:00.421174 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-0e8ff2ae-7f2b-4833-91f4-3de066505fd5 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.076469 Jan 15 21:05:00.421874 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-c3547b9e-b343-436c-a65c-802de9c8035b tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:05:00.422972 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2545/5089] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:00 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:05:00.430935 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c3547b9e-b343-436c-a65c-802de9c8035b tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/df405782-02e0-4416-9c91-818ea05dacaf" status: 200 len: 1507 microversion: 2.1 time: 0.474451 Jan 15 21:05:00.431762 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2545/5090] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:04:59 2022] GET /compute/v2.1/servers/df405782-02e0-4416-9c91-818ea05dacaf => generated 1507 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:05:00.712578 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-97396a8d-cfa1-4822-9089-7c1857dd9781 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:05:00.713347 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-97396a8d-cfa1-4822-9089-7c1857dd9781 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: 8f58ad6d-0fd5-48c7-a969-c7b6503d639b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:00.720888 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-97396a8d-cfa1-4822-9089-7c1857dd9781 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:00.721622 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-97396a8d-cfa1-4822-9089-7c1857dd9781 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:00.722614 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-97396a8d-cfa1-4822-9089-7c1857dd9781 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:00.723219 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-97396a8d-cfa1-4822-9089-7c1857dd9781 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:00.889742 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-70d9e76f-262a-4421-9d0e-16f0e5b3cff1 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:05:00.890438 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-70d9e76f-262a-4421-9d0e-16f0e5b3cff1 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: d9db70df-9ffc-4b96-af06-a56b3b35ce91] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:00.897062 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-70d9e76f-262a-4421-9d0e-16f0e5b3cff1 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:00.897739 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-70d9e76f-262a-4421-9d0e-16f0e5b3cff1 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:00.898580 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-70d9e76f-262a-4421-9d0e-16f0e5b3cff1 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:00.899081 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-70d9e76f-262a-4421-9d0e-16f0e5b3cff1 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:01.004536 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-97396a8d-cfa1-4822-9089-7c1857dd9781 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb3421bc9494914bc5f797b15a55643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31af2a6b9424f168dd6084d8d5fd0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:05:01.012747 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-97396a8d-cfa1-4822-9089-7c1857dd9781 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/8f58ad6d-0fd5-48c7-a969-c7b6503d639b" status: 200 len: 1512 microversion: 2.1 time: 0.304131 Jan 15 21:05:01.013559 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2546/5091] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:05:00 2022] GET /compute/v2.1/servers/8f58ad6d-0fd5-48c7-a969-c7b6503d639b => generated 1512 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:05:01.164022 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-70d9e76f-262a-4421-9d0e-16f0e5b3cff1 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6097506a2d4e36818310d9d70bf01b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4dad65fccfe481a973f5fcbb9287dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:05:01.172980 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-70d9e76f-262a-4421-9d0e-16f0e5b3cff1 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "GET /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91" status: 200 len: 1362 microversion: 2.1 time: 0.287341 Jan 15 21:05:01.173658 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2546/5092] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:05:00 2022] GET /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91 => generated 1362 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:05:01.278935 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-03c270e7-f993-4dda-a00d-13ac76cb6921 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:01.280505 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-03c270e7-f993-4dda-a00d-13ac76cb6921 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:01.288375 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-03c270e7-f993-4dda-a00d-13ac76cb6921 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:01.289065 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-03c270e7-f993-4dda-a00d-13ac76cb6921 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:01.290019 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-03c270e7-f993-4dda-a00d-13ac76cb6921 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:01.290462 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-03c270e7-f993-4dda-a00d-13ac76cb6921 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:01.344311 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-03c270e7-f993-4dda-a00d-13ac76cb6921 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action" status: 200 len: 32638 microversion: 2.20 time: 0.069482 Jan 15 21:05:01.348515 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2547/5093] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:01 2022] POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action => generated 32638 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:05:01.353574 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7461a688-4c99-4d5a-9474-7314fa432e02 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:01.354871 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-7461a688-4c99-4d5a-9474-7314fa432e02 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:01.361575 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7461a688-4c99-4d5a-9474-7314fa432e02 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:01.362105 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7461a688-4c99-4d5a-9474-7314fa432e02 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:01.363115 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7461a688-4c99-4d5a-9474-7314fa432e02 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:01.363769 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7461a688-4c99-4d5a-9474-7314fa432e02 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:01.416672 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7461a688-4c99-4d5a-9474-7314fa432e02 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.066334 Jan 15 21:05:01.420182 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2547/5094] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:01 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:05:01.434690 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-91ad5273-44e4-46c3-b09d-5ab75e816eeb tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:01.435943 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-91ad5273-44e4-46c3-b09d-5ab75e816eeb tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:01.448931 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-91ad5273-44e4-46c3-b09d-5ab75e816eeb tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:01.449282 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-40504125-7ca2-44bc-b21b-97d6bd40c6de tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:05:01.449872 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-91ad5273-44e4-46c3-b09d-5ab75e816eeb tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:01.450326 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-40504125-7ca2-44bc-b21b-97d6bd40c6de tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: df405782-02e0-4416-9c91-818ea05dacaf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:01.450874 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-91ad5273-44e4-46c3-b09d-5ab75e816eeb tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:01.451387 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-91ad5273-44e4-46c3-b09d-5ab75e816eeb tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:01.457452 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-40504125-7ca2-44bc-b21b-97d6bd40c6de tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:01.457989 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-40504125-7ca2-44bc-b21b-97d6bd40c6de tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:01.459167 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-40504125-7ca2-44bc-b21b-97d6bd40c6de tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:01.459715 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-40504125-7ca2-44bc-b21b-97d6bd40c6de tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:01.516197 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-91ad5273-44e4-46c3-b09d-5ab75e816eeb tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.086656 Jan 15 21:05:01.520919 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2548/5095] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:01 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:05:01.670238 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-40504125-7ca2-44bc-b21b-97d6bd40c6de tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:05:01.686364 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-40504125-7ca2-44bc-b21b-97d6bd40c6de tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/df405782-02e0-4416-9c91-818ea05dacaf" status: 200 len: 1487 microversion: 2.1 time: 0.242079 Jan 15 21:05:01.693309 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2548/5096] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:05:01 2022] GET /compute/v2.1/servers/df405782-02e0-4416-9c91-818ea05dacaf => generated 1487 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:05:01.704964 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c14d747e-86dc-440a-a33f-cfccb45dd3fa tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:01.705620 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c14d747e-86dc-440a-a33f-cfccb45dd3fa tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: df405782-02e0-4416-9c91-818ea05dacaf] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:01.712540 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c14d747e-86dc-440a-a33f-cfccb45dd3fa tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:01.713034 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c14d747e-86dc-440a-a33f-cfccb45dd3fa tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:01.714579 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c14d747e-86dc-440a-a33f-cfccb45dd3fa tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:01.715040 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c14d747e-86dc-440a-a33f-cfccb45dd3fa tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:01.747477 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.objects.instance [None req-c14d747e-86dc-440a-a33f-cfccb45dd3fa tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lazy-loading 'flavor' on Instance uuid df405782-02e0-4416-9c91-818ea05dacaf {{(pid=129365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 21:05:02.016100 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c14d747e-86dc-440a-a33f-cfccb45dd3fa tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "POST /compute/v2.1/servers/df405782-02e0-4416-9c91-818ea05dacaf/action" status: 202 len: 0 microversion: 2.1 time: 0.316334 Jan 15 21:05:02.019888 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2549/5097] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:05:01 2022] POST /compute/v2.1/servers/df405782-02e0-4416-9c91-818ea05dacaf/action => generated 0 bytes in 319 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:05:02.025151 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4beaa806-2995-4525-be31-d0e34051ad18 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:05:02.025921 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-4beaa806-2995-4525-be31-d0e34051ad18 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: df405782-02e0-4416-9c91-818ea05dacaf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:02.033230 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3d0a1b98-a3bd-48fa-bf3d-7aab7f88c3cd tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:05:02.033912 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4beaa806-2995-4525-be31-d0e34051ad18 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:02.034036 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-3d0a1b98-a3bd-48fa-bf3d-7aab7f88c3cd tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: 8f58ad6d-0fd5-48c7-a969-c7b6503d639b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:02.034378 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4beaa806-2995-4525-be31-d0e34051ad18 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:02.035185 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4beaa806-2995-4525-be31-d0e34051ad18 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:02.035759 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4beaa806-2995-4525-be31-d0e34051ad18 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:02.041357 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3d0a1b98-a3bd-48fa-bf3d-7aab7f88c3cd tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:02.042367 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3d0a1b98-a3bd-48fa-bf3d-7aab7f88c3cd tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:02.046725 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3d0a1b98-a3bd-48fa-bf3d-7aab7f88c3cd tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:02.047200 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3d0a1b98-a3bd-48fa-bf3d-7aab7f88c3cd tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:02.250549 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-4beaa806-2995-4525-be31-d0e34051ad18 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:05:02.254064 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-3d0a1b98-a3bd-48fa-bf3d-7aab7f88c3cd tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb3421bc9494914bc5f797b15a55643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31af2a6b9424f168dd6084d8d5fd0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:05:02.258649 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-4beaa806-2995-4525-be31-d0e34051ad18 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/df405782-02e0-4416-9c91-818ea05dacaf" status: 200 len: 1493 microversion: 2.1 time: 0.237350 Jan 15 21:05:02.259245 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2549/5098] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:05:02 2022] GET /compute/v2.1/servers/df405782-02e0-4416-9c91-818ea05dacaf => generated 1493 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:05:02.265680 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3d0a1b98-a3bd-48fa-bf3d-7aab7f88c3cd tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/8f58ad6d-0fd5-48c7-a969-c7b6503d639b" status: 200 len: 1512 microversion: 2.1 time: 0.239496 Jan 15 21:05:02.267241 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-32eda209-185c-4e11-80a2-4ead76cf3c15 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:05:02.268035 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-32eda209-185c-4e11-80a2-4ead76cf3c15 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: d9db70df-9ffc-4b96-af06-a56b3b35ce91] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:02.275453 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2550/5099] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:05:02 2022] GET /compute/v2.1/servers/8f58ad6d-0fd5-48c7-a969-c7b6503d639b => generated 1512 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:05:02.278678 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-32eda209-185c-4e11-80a2-4ead76cf3c15 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:02.279159 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-32eda209-185c-4e11-80a2-4ead76cf3c15 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:02.280114 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-32eda209-185c-4e11-80a2-4ead76cf3c15 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:02.280550 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-32eda209-185c-4e11-80a2-4ead76cf3c15 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:02.357010 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-75310e05-a8b3-405e-af75-80caae57858f tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:02.359070 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-75310e05-a8b3-405e-af75-80caae57858f tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:02.366595 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-75310e05-a8b3-405e-af75-80caae57858f tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:02.367287 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-75310e05-a8b3-405e-af75-80caae57858f tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:02.369416 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-75310e05-a8b3-405e-af75-80caae57858f tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:02.370231 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-75310e05-a8b3-405e-af75-80caae57858f tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:02.419724 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-75310e05-a8b3-405e-af75-80caae57858f tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action" status: 200 len: 32638 microversion: 2.20 time: 0.066249 Jan 15 21:05:02.420472 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2551/5100] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:02 2022] POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action => generated 32638 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:05:02.431443 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3f4a5f93-73cc-4a1e-80ac-e5793378238e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:02.432635 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-3f4a5f93-73cc-4a1e-80ac-e5793378238e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:02.440376 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3f4a5f93-73cc-4a1e-80ac-e5793378238e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:02.442601 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3f4a5f93-73cc-4a1e-80ac-e5793378238e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:02.443533 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3f4a5f93-73cc-4a1e-80ac-e5793378238e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:02.444365 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3f4a5f93-73cc-4a1e-80ac-e5793378238e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:02.455635 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-32eda209-185c-4e11-80a2-4ead76cf3c15 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6097506a2d4e36818310d9d70bf01b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4dad65fccfe481a973f5fcbb9287dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:05:02.464232 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-32eda209-185c-4e11-80a2-4ead76cf3c15 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "GET /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91" status: 200 len: 1362 microversion: 2.1 time: 0.203248 Jan 15 21:05:02.474021 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2550/5101] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:05:02 2022] GET /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91 => generated 1362 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:05:02.529979 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-048a790d-5930-4efc-8134-8924ec938eb8 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:02.531126 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-048a790d-5930-4efc-8134-8924ec938eb8 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:02.539522 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3f4a5f93-73cc-4a1e-80ac-e5793378238e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.112580 Jan 15 21:05:02.541043 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2552/5102] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:02 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:05:02.541196 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-048a790d-5930-4efc-8134-8924ec938eb8 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:02.541907 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-048a790d-5930-4efc-8134-8924ec938eb8 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:02.542977 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-048a790d-5930-4efc-8134-8924ec938eb8 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:02.543868 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-048a790d-5930-4efc-8134-8924ec938eb8 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:02.591749 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-048a790d-5930-4efc-8134-8924ec938eb8 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.066770 Jan 15 21:05:02.596721 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2551/5103] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:02 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:05:03.276134 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-eeec1a6d-52e9-47b1-a714-4a5f18596357 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:05:03.276777 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-eeec1a6d-52e9-47b1-a714-4a5f18596357 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: df405782-02e0-4416-9c91-818ea05dacaf] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:03.283020 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ce1e1eed-045f-46aa-a0cc-0f8bec2fe6e8 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:05:03.284424 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ce1e1eed-045f-46aa-a0cc-0f8bec2fe6e8 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: 8f58ad6d-0fd5-48c7-a969-c7b6503d639b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:03.287465 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-eeec1a6d-52e9-47b1-a714-4a5f18596357 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:03.288196 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-eeec1a6d-52e9-47b1-a714-4a5f18596357 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:03.289218 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-eeec1a6d-52e9-47b1-a714-4a5f18596357 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:03.289852 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-eeec1a6d-52e9-47b1-a714-4a5f18596357 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:03.291568 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ce1e1eed-045f-46aa-a0cc-0f8bec2fe6e8 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:03.293029 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ce1e1eed-045f-46aa-a0cc-0f8bec2fe6e8 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:03.294418 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ce1e1eed-045f-46aa-a0cc-0f8bec2fe6e8 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:03.295023 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ce1e1eed-045f-46aa-a0cc-0f8bec2fe6e8 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:03.522948 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-ce1e1eed-045f-46aa-a0cc-0f8bec2fe6e8 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb3421bc9494914bc5f797b15a55643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31af2a6b9424f168dd6084d8d5fd0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:05:03.527021 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-eeec1a6d-52e9-47b1-a714-4a5f18596357 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:05:03.532929 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ce1e1eed-045f-46aa-a0cc-0f8bec2fe6e8 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/8f58ad6d-0fd5-48c7-a969-c7b6503d639b" status: 200 len: 1512 microversion: 2.1 time: 0.253704 Jan 15 21:05:03.534074 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2552/5104] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:05:03 2022] GET /compute/v2.1/servers/8f58ad6d-0fd5-48c7-a969-c7b6503d639b => generated 1512 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:05:03.534857 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-eeec1a6d-52e9-47b1-a714-4a5f18596357 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/df405782-02e0-4416-9c91-818ea05dacaf" status: 200 len: 1514 microversion: 2.1 time: 0.262945 Jan 15 21:05:03.535438 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2553/5105] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:05:03 2022] GET /compute/v2.1/servers/df405782-02e0-4416-9c91-818ea05dacaf => generated 1514 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:05:03.541536 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-92731375-3fc8-4758-8494-d4c647e93262 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:05:03.541791 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-04348396-6ecc-4a57-adb1-3fa5b55a022e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:03.542785 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-04348396-6ecc-4a57-adb1-3fa5b55a022e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:03.543030 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-92731375-3fc8-4758-8494-d4c647e93262 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: d9db70df-9ffc-4b96-af06-a56b3b35ce91] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:03.549982 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-92731375-3fc8-4758-8494-d4c647e93262 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:03.550444 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-92731375-3fc8-4758-8494-d4c647e93262 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:03.551245 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-92731375-3fc8-4758-8494-d4c647e93262 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:03.551836 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-92731375-3fc8-4758-8494-d4c647e93262 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:03.561115 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-04348396-6ecc-4a57-adb1-3fa5b55a022e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:03.561575 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-04348396-6ecc-4a57-adb1-3fa5b55a022e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:03.562357 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-04348396-6ecc-4a57-adb1-3fa5b55a022e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:03.562791 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-04348396-6ecc-4a57-adb1-3fa5b55a022e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:03.605500 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-04348396-6ecc-4a57-adb1-3fa5b55a022e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action" status: 200 len: 32638 microversion: 2.20 time: 0.069627 Jan 15 21:05:03.610362 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2553/5106] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:03 2022] POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action => generated 32638 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:05:03.611969 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-5da28d5e-68c8-4270-a29e-87f03a7fb581 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:03.613129 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-5da28d5e-68c8-4270-a29e-87f03a7fb581 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:03.620677 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5da28d5e-68c8-4270-a29e-87f03a7fb581 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:03.621152 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5da28d5e-68c8-4270-a29e-87f03a7fb581 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:03.621983 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5da28d5e-68c8-4270-a29e-87f03a7fb581 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:03.622420 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5da28d5e-68c8-4270-a29e-87f03a7fb581 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:03.676519 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-5da28d5e-68c8-4270-a29e-87f03a7fb581 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.064815 Jan 15 21:05:03.677271 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2554/5107] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:03 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:05:03.682995 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-796eb382-de84-4711-84e1-53a65e5a6cd9 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:03.683992 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-796eb382-de84-4711-84e1-53a65e5a6cd9 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:03.691431 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-796eb382-de84-4711-84e1-53a65e5a6cd9 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:03.691875 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-796eb382-de84-4711-84e1-53a65e5a6cd9 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:03.692671 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-796eb382-de84-4711-84e1-53a65e5a6cd9 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:03.693208 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-796eb382-de84-4711-84e1-53a65e5a6cd9 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:03.713337 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-92731375-3fc8-4758-8494-d4c647e93262 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6097506a2d4e36818310d9d70bf01b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4dad65fccfe481a973f5fcbb9287dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:05:03.721626 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-92731375-3fc8-4758-8494-d4c647e93262 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "GET /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91" status: 200 len: 1362 microversion: 2.1 time: 0.185176 Jan 15 21:05:03.722233 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2554/5108] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:05:03 2022] GET /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91 => generated 1362 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:05:03.748076 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-796eb382-de84-4711-84e1-53a65e5a6cd9 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.069413 Jan 15 21:05:03.749494 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2555/5109] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:03 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:05:04.552708 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3c49d88f-a530-4a81-b133-a556137d0d77 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:05:04.554617 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-3c49d88f-a530-4a81-b133-a556137d0d77 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: 8f58ad6d-0fd5-48c7-a969-c7b6503d639b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:04.561477 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-2cb25bc6-140b-4bf4-83fd-cc62304dd68c tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:05:04.562300 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-2cb25bc6-140b-4bf4-83fd-cc62304dd68c tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: df405782-02e0-4416-9c91-818ea05dacaf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:04.569808 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3c49d88f-a530-4a81-b133-a556137d0d77 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:04.570266 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3c49d88f-a530-4a81-b133-a556137d0d77 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:04.570444 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2cb25bc6-140b-4bf4-83fd-cc62304dd68c tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:04.570965 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2cb25bc6-140b-4bf4-83fd-cc62304dd68c tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:04.571842 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2cb25bc6-140b-4bf4-83fd-cc62304dd68c tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:04.573558 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2cb25bc6-140b-4bf4-83fd-cc62304dd68c tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:04.573915 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3c49d88f-a530-4a81-b133-a556137d0d77 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:04.574384 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3c49d88f-a530-4a81-b133-a556137d0d77 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:04.858308 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-3c49d88f-a530-4a81-b133-a556137d0d77 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb3421bc9494914bc5f797b15a55643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31af2a6b9424f168dd6084d8d5fd0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:05:04.865684 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3c49d88f-a530-4a81-b133-a556137d0d77 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/8f58ad6d-0fd5-48c7-a969-c7b6503d639b" status: 200 len: 1512 microversion: 2.1 time: 0.318254 Jan 15 21:05:04.866810 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2555/5110] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:05:04 2022] GET /compute/v2.1/servers/8f58ad6d-0fd5-48c7-a969-c7b6503d639b => generated 1512 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:05:04.872473 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f46e967c-b99e-4376-85f8-6ec69876cb18 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:04.873664 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f46e967c-b99e-4376-85f8-6ec69876cb18 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:04.879903 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f46e967c-b99e-4376-85f8-6ec69876cb18 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:04.880521 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f46e967c-b99e-4376-85f8-6ec69876cb18 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:04.881520 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f46e967c-b99e-4376-85f8-6ec69876cb18 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:04.882108 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f46e967c-b99e-4376-85f8-6ec69876cb18 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:04.900677 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-2cb25bc6-140b-4bf4-83fd-cc62304dd68c tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:05:04.915152 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-2cb25bc6-140b-4bf4-83fd-cc62304dd68c tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/df405782-02e0-4416-9c91-818ea05dacaf" status: 200 len: 1509 microversion: 2.1 time: 0.354550 Jan 15 21:05:04.916001 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2556/5111] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:05:04 2022] GET /compute/v2.1/servers/df405782-02e0-4416-9c91-818ea05dacaf => generated 1509 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:05:04.934933 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-90867497-63da-411d-a3b3-e31bc9942d40 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:04.935188 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f46e967c-b99e-4376-85f8-6ec69876cb18 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action" status: 200 len: 32638 microversion: 2.20 time: 0.066838 Jan 15 21:05:04.938940 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-90867497-63da-411d-a3b3-e31bc9942d40 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:04.941283 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2556/5112] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:04 2022] POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action => generated 32638 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:05:04.956786 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-90867497-63da-411d-a3b3-e31bc9942d40 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:04.958737 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-02bb8e6c-b1e6-4651-9916-5a37c1820e88 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:05:04.959382 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-90867497-63da-411d-a3b3-e31bc9942d40 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:04.959538 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-02bb8e6c-b1e6-4651-9916-5a37c1820e88 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: d9db70df-9ffc-4b96-af06-a56b3b35ce91] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:04.962405 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-90867497-63da-411d-a3b3-e31bc9942d40 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:04.963001 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-90867497-63da-411d-a3b3-e31bc9942d40 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:04.973179 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-02bb8e6c-b1e6-4651-9916-5a37c1820e88 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:04.973729 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-02bb8e6c-b1e6-4651-9916-5a37c1820e88 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:04.974542 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-02bb8e6c-b1e6-4651-9916-5a37c1820e88 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:04.975332 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-02bb8e6c-b1e6-4651-9916-5a37c1820e88 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:05.053343 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-90867497-63da-411d-a3b3-e31bc9942d40 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.134219 Jan 15 21:05:05.055820 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2557/5113] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:04 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:05:05.066421 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7972c292-90af-4456-92a1-6337f5aec59c tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:05.067409 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-7972c292-90af-4456-92a1-6337f5aec59c tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:05.075183 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7972c292-90af-4456-92a1-6337f5aec59c tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:05.075637 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7972c292-90af-4456-92a1-6337f5aec59c tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:05.076434 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7972c292-90af-4456-92a1-6337f5aec59c tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:05.076895 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7972c292-90af-4456-92a1-6337f5aec59c tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:05.162688 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7972c292-90af-4456-92a1-6337f5aec59c tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.104056 Jan 15 21:05:05.163544 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2558/5114] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:05 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:05:05.254026 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-02bb8e6c-b1e6-4651-9916-5a37c1820e88 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6097506a2d4e36818310d9d70bf01b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4dad65fccfe481a973f5fcbb9287dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:05:05.262401 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-02bb8e6c-b1e6-4651-9916-5a37c1820e88 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "GET /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91" status: 200 len: 1362 microversion: 2.1 time: 0.319206 Jan 15 21:05:05.264361 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2557/5115] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:05:04 2022] GET /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91 => generated 1362 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:05:05.525582 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-22160310-a886-44c4-8f32-348883a1f398 req-bd1cdc16-43b6-4d3a-b346-dc3642acbd90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9db70df-9ffc-4b96-af06-a56b3b35ce91", "name": "network-vif-plugged", "status": "completed", "tag": "19fc242c-c091-4b78-8fec-c33b6bd5cc60"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:05.528281 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:05:05.528281 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:05:05.552573 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-22160310-a886-44c4-8f32-348883a1f398 req-bd1cdc16-43b6-4d3a-b346-dc3642acbd90 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:05.552965 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-22160310-a886-44c4-8f32-348883a1f398 req-bd1cdc16-43b6-4d3a-b346-dc3642acbd90 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:05.600039 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-22160310-a886-44c4-8f32-348883a1f398 req-bd1cdc16-43b6-4d3a-b346-dc3642acbd90 service nova] Creating event network-vif-plugged:19fc242c-c091-4b78-8fec-c33b6bd5cc60 for instance d9db70df-9ffc-4b96-af06-a56b3b35ce91 on nch2-master-1 Jan 15 21:05:05.612329 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-22160310-a886-44c4-8f32-348883a1f398 req-bd1cdc16-43b6-4d3a-b346-dc3642acbd90 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088087 Jan 15 21:05:05.620750 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2559/5116] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:05:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:05:05.883576 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a912f9e0-906f-4008-b143-1c70fb9c43d7 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:05:05.884189 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a912f9e0-906f-4008-b143-1c70fb9c43d7 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: 8f58ad6d-0fd5-48c7-a969-c7b6503d639b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:05.893920 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a912f9e0-906f-4008-b143-1c70fb9c43d7 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:05.894600 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a912f9e0-906f-4008-b143-1c70fb9c43d7 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:05.895893 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a912f9e0-906f-4008-b143-1c70fb9c43d7 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:05.896498 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a912f9e0-906f-4008-b143-1c70fb9c43d7 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:05.942679 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-bc41d4eb-5061-4856-a184-782afe54a945 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:05:05.943442 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-bc41d4eb-5061-4856-a184-782afe54a945 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: df405782-02e0-4416-9c91-818ea05dacaf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:05.954858 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bc41d4eb-5061-4856-a184-782afe54a945 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:05.959820 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bc41d4eb-5061-4856-a184-782afe54a945 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:05.960685 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bc41d4eb-5061-4856-a184-782afe54a945 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:05.961159 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bc41d4eb-5061-4856-a184-782afe54a945 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:06.325670 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-a912f9e0-906f-4008-b143-1c70fb9c43d7 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb3421bc9494914bc5f797b15a55643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31af2a6b9424f168dd6084d8d5fd0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:05:06.335808 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-bc41d4eb-5061-4856-a184-782afe54a945 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:05:06.346892 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-bc41d4eb-5061-4856-a184-782afe54a945 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/df405782-02e0-4416-9c91-818ea05dacaf" status: 200 len: 1509 microversion: 2.1 time: 0.412890 Jan 15 21:05:06.349149 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2560/5117] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:05:05 2022] GET /compute/v2.1/servers/df405782-02e0-4416-9c91-818ea05dacaf => generated 1509 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:05:06.349734 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a912f9e0-906f-4008-b143-1c70fb9c43d7 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/8f58ad6d-0fd5-48c7-a969-c7b6503d639b" status: 200 len: 1512 microversion: 2.1 time: 0.469308 Jan 15 21:05:06.350328 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2558/5118] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:05:05 2022] GET /compute/v2.1/servers/8f58ad6d-0fd5-48c7-a969-c7b6503d639b => generated 1512 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:05:06.369985 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a5142068-3b68-4c88-bf6e-466d2d8f430c tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:06.371080 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a5142068-3b68-4c88-bf6e-466d2d8f430c tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:06.374724 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e2d1af4b-b01c-4bbb-92cc-e135e1d49d47 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:06.376314 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e2d1af4b-b01c-4bbb-92cc-e135e1d49d47 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:06.389965 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a5142068-3b68-4c88-bf6e-466d2d8f430c tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:06.390527 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a5142068-3b68-4c88-bf6e-466d2d8f430c tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:06.391339 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a5142068-3b68-4c88-bf6e-466d2d8f430c tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:06.391780 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a5142068-3b68-4c88-bf6e-466d2d8f430c tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:06.394920 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e2d1af4b-b01c-4bbb-92cc-e135e1d49d47 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:06.395930 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e2d1af4b-b01c-4bbb-92cc-e135e1d49d47 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:06.397188 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e2d1af4b-b01c-4bbb-92cc-e135e1d49d47 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:06.397838 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e2d1af4b-b01c-4bbb-92cc-e135e1d49d47 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:06.455982 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e2d1af4b-b01c-4bbb-92cc-e135e1d49d47 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action" status: 200 len: 32638 microversion: 2.20 time: 0.093232 Jan 15 21:05:06.467830 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2559/5119] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:06 2022] POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action => generated 32638 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:05:06.477367 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b1e183f4-05db-46f9-ac04-40b424ebdc1d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:06.478396 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b1e183f4-05db-46f9-ac04-40b424ebdc1d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:06.496707 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b1e183f4-05db-46f9-ac04-40b424ebdc1d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:06.497418 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b1e183f4-05db-46f9-ac04-40b424ebdc1d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:06.505403 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a5142068-3b68-4c88-bf6e-466d2d8f430c tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.143816 Jan 15 21:05:06.510385 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b1e183f4-05db-46f9-ac04-40b424ebdc1d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:06.511345 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b1e183f4-05db-46f9-ac04-40b424ebdc1d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:06.512507 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2561/5120] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:06 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:05:06.518272 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-be1bc89c-8453-418e-b529-002142d37490 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:05:06.518991 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-be1bc89c-8453-418e-b529-002142d37490 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: d9db70df-9ffc-4b96-af06-a56b3b35ce91] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:06.528683 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-be1bc89c-8453-418e-b529-002142d37490 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:06.529168 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-be1bc89c-8453-418e-b529-002142d37490 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:06.529980 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-be1bc89c-8453-418e-b529-002142d37490 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:06.530422 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-be1bc89c-8453-418e-b529-002142d37490 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:06.578578 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b1e183f4-05db-46f9-ac04-40b424ebdc1d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.108656 Jan 15 21:05:06.596387 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2560/5121] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:06 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:05:06.737012 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-be1bc89c-8453-418e-b529-002142d37490 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6097506a2d4e36818310d9d70bf01b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4dad65fccfe481a973f5fcbb9287dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:05:06.749604 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-be1bc89c-8453-418e-b529-002142d37490 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "GET /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91" status: 200 len: 1362 microversion: 2.1 time: 0.235312 Jan 15 21:05:06.750286 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2562/5122] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:05:06 2022] GET /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91 => generated 1362 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:05:07.365502 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-cff3d263-38df-4bf9-91e8-b14fb7322ed9 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:05:07.371316 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1b6bc76b-002d-42ef-8972-01a0997e1144 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:05:07.372492 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-cff3d263-38df-4bf9-91e8-b14fb7322ed9 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: df405782-02e0-4416-9c91-818ea05dacaf] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:07.373619 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-1b6bc76b-002d-42ef-8972-01a0997e1144 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: 8f58ad6d-0fd5-48c7-a969-c7b6503d639b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:07.385045 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1b6bc76b-002d-42ef-8972-01a0997e1144 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:07.386814 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1b6bc76b-002d-42ef-8972-01a0997e1144 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:07.387661 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1b6bc76b-002d-42ef-8972-01a0997e1144 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:07.388101 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1b6bc76b-002d-42ef-8972-01a0997e1144 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:07.416043 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cff3d263-38df-4bf9-91e8-b14fb7322ed9 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:07.416661 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cff3d263-38df-4bf9-91e8-b14fb7322ed9 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:07.417863 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cff3d263-38df-4bf9-91e8-b14fb7322ed9 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:07.419503 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cff3d263-38df-4bf9-91e8-b14fb7322ed9 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:07.622000 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-1b6bc76b-002d-42ef-8972-01a0997e1144 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb3421bc9494914bc5f797b15a55643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31af2a6b9424f168dd6084d8d5fd0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:05:07.632809 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-1b6bc76b-002d-42ef-8972-01a0997e1144 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/8f58ad6d-0fd5-48c7-a969-c7b6503d639b" status: 200 len: 1512 microversion: 2.1 time: 0.265503 Jan 15 21:05:07.635141 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2563/5123] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:05:07 2022] GET /compute/v2.1/servers/8f58ad6d-0fd5-48c7-a969-c7b6503d639b => generated 1512 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:05:07.646110 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9cfa6f68-4439-48cd-8e5e-559e8e99a861 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:07.647095 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-9cfa6f68-4439-48cd-8e5e-559e8e99a861 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:07.659782 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9cfa6f68-4439-48cd-8e5e-559e8e99a861 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:07.660410 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9cfa6f68-4439-48cd-8e5e-559e8e99a861 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:07.661499 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9cfa6f68-4439-48cd-8e5e-559e8e99a861 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:07.662218 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9cfa6f68-4439-48cd-8e5e-559e8e99a861 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:07.711998 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-9cfa6f68-4439-48cd-8e5e-559e8e99a861 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action" status: 200 len: 32638 microversion: 2.20 time: 0.074667 Jan 15 21:05:07.712913 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2564/5124] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:07 2022] POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action => generated 32638 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:05:07.720750 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e5380562-7c3c-4e14-919c-2eb0035c06ee tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:07.722588 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e5380562-7c3c-4e14-919c-2eb0035c06ee tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:07.754645 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e5380562-7c3c-4e14-919c-2eb0035c06ee tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:07.755216 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e5380562-7c3c-4e14-919c-2eb0035c06ee tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:07.755921 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-cff3d263-38df-4bf9-91e8-b14fb7322ed9 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:05:07.756066 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e5380562-7c3c-4e14-919c-2eb0035c06ee tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:07.756457 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e5380562-7c3c-4e14-919c-2eb0035c06ee tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:07.765742 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-cff3d263-38df-4bf9-91e8-b14fb7322ed9 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/df405782-02e0-4416-9c91-818ea05dacaf" status: 200 len: 1509 microversion: 2.1 time: 0.404304 Jan 15 21:05:07.766415 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2561/5125] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:05:07 2022] GET /compute/v2.1/servers/df405782-02e0-4416-9c91-818ea05dacaf => generated 1509 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:05:07.772320 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d7b09c0c-57ef-461e-aaaa-36dd5f036b3b tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:07.773495 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d7b09c0c-57ef-461e-aaaa-36dd5f036b3b tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:07.780763 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d7b09c0c-57ef-461e-aaaa-36dd5f036b3b tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:07.781472 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d7b09c0c-57ef-461e-aaaa-36dd5f036b3b tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:07.782867 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d7b09c0c-57ef-461e-aaaa-36dd5f036b3b tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:07.783983 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d7b09c0c-57ef-461e-aaaa-36dd5f036b3b tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:07.852873 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d7b09c0c-57ef-461e-aaaa-36dd5f036b3b tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.082608 Jan 15 21:05:07.854367 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2562/5126] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:07 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:05:07.855252 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e5380562-7c3c-4e14-919c-2eb0035c06ee tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.137383 Jan 15 21:05:07.864885 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2565/5127] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:07 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:05:07.872006 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-dce114e9-6a99-4b7c-a47c-628b3bf1ef6e req-1847b0e8-e78e-4672-90b1-52b8307eea71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df405782-02e0-4416-9c91-818ea05dacaf", "name": "network-vif-plugged", "status": "completed", "tag": "43dfb9cf-e68a-4c7c-b0c6-7b7fcd77dbf4"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:07.873500 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9c2be19b-021b-495f-8707-81c330042006 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:05:07.875378 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:05:07.875378 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:05:07.877507 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-9c2be19b-021b-495f-8707-81c330042006 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: d9db70df-9ffc-4b96-af06-a56b3b35ce91] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:07.893948 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-dce114e9-6a99-4b7c-a47c-628b3bf1ef6e req-1847b0e8-e78e-4672-90b1-52b8307eea71 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:07.894390 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-dce114e9-6a99-4b7c-a47c-628b3bf1ef6e req-1847b0e8-e78e-4672-90b1-52b8307eea71 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:07.897967 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9c2be19b-021b-495f-8707-81c330042006 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:07.898486 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9c2be19b-021b-495f-8707-81c330042006 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:07.899332 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9c2be19b-021b-495f-8707-81c330042006 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:07.899718 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9c2be19b-021b-495f-8707-81c330042006 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:07.943479 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-dce114e9-6a99-4b7c-a47c-628b3bf1ef6e req-1847b0e8-e78e-4672-90b1-52b8307eea71 service nova] Creating event network-vif-plugged:43dfb9cf-e68a-4c7c-b0c6-7b7fcd77dbf4 for instance df405782-02e0-4416-9c91-818ea05dacaf on nch1-master-1 Jan 15 21:05:07.952831 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-dce114e9-6a99-4b7c-a47c-628b3bf1ef6e req-1847b0e8-e78e-4672-90b1-52b8307eea71 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094831 Jan 15 21:05:07.954050 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2563/5128] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:05:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:05:08.108551 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-9c2be19b-021b-495f-8707-81c330042006 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6097506a2d4e36818310d9d70bf01b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4dad65fccfe481a973f5fcbb9287dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:05:08.121554 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-9c2be19b-021b-495f-8707-81c330042006 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "GET /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91" status: 200 len: 1549 microversion: 2.1 time: 0.255282 Jan 15 21:05:08.122206 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2566/5129] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:05:07 2022] GET /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91 => generated 1549 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:05:08.139519 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-dd225569-3ad0-4307-ad24-7c8bc96bf649 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:05:08.140112 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-dd225569-3ad0-4307-ad24-7c8bc96bf649 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: d9db70df-9ffc-4b96-af06-a56b3b35ce91] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:08.154168 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dd225569-3ad0-4307-ad24-7c8bc96bf649 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:08.154654 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dd225569-3ad0-4307-ad24-7c8bc96bf649 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:08.155460 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dd225569-3ad0-4307-ad24-7c8bc96bf649 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:08.159021 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dd225569-3ad0-4307-ad24-7c8bc96bf649 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:08.409791 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-dd225569-3ad0-4307-ad24-7c8bc96bf649 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "GET /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.275515 Jan 15 21:05:08.413202 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2564/5130] 10.222.0.46 () {58 vars in 1274 bytes} [Sat Jan 15 21:05:08 2022] GET /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/os-interface => generated 285 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:05:08.659249 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b001a76b-47a7-4e9a-b7cf-b1fb6eba79a4 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:05:08.659879 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b001a76b-47a7-4e9a-b7cf-b1fb6eba79a4 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: 8f58ad6d-0fd5-48c7-a969-c7b6503d639b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:08.684501 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b001a76b-47a7-4e9a-b7cf-b1fb6eba79a4 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:08.685843 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b001a76b-47a7-4e9a-b7cf-b1fb6eba79a4 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:08.686970 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b001a76b-47a7-4e9a-b7cf-b1fb6eba79a4 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:08.687421 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b001a76b-47a7-4e9a-b7cf-b1fb6eba79a4 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:08.733807 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a2057694-506a-4a7f-9cf9-70d89af69205 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:08.734729 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a2057694-506a-4a7f-9cf9-70d89af69205 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:08.751138 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a2057694-506a-4a7f-9cf9-70d89af69205 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:08.751885 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a2057694-506a-4a7f-9cf9-70d89af69205 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:08.752906 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a2057694-506a-4a7f-9cf9-70d89af69205 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:08.756377 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a2057694-506a-4a7f-9cf9-70d89af69205 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:08.815935 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a2057694-506a-4a7f-9cf9-70d89af69205 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action" status: 200 len: 32638 microversion: 2.20 time: 0.093221 Jan 15 21:05:08.817046 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2565/5131] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:08 2022] POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action => generated 32638 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:05:08.828284 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-af75ac5c-351c-4acf-b3ae-a5be3c8939a4 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:05:08.828946 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-af75ac5c-351c-4acf-b3ae-a5be3c8939a4 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: df405782-02e0-4416-9c91-818ea05dacaf] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:08.847620 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-af75ac5c-351c-4acf-b3ae-a5be3c8939a4 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:08.848079 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-af75ac5c-351c-4acf-b3ae-a5be3c8939a4 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:08.852496 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-af75ac5c-351c-4acf-b3ae-a5be3c8939a4 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:08.857683 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-af75ac5c-351c-4acf-b3ae-a5be3c8939a4 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:09.235317 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-b001a76b-47a7-4e9a-b7cf-b1fb6eba79a4 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb3421bc9494914bc5f797b15a55643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31af2a6b9424f168dd6084d8d5fd0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:05:09.253995 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b001a76b-47a7-4e9a-b7cf-b1fb6eba79a4 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/8f58ad6d-0fd5-48c7-a969-c7b6503d639b" status: 200 len: 1512 microversion: 2.1 time: 0.599094 Jan 15 21:05:09.267202 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2567/5132] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:05:08 2022] GET /compute/v2.1/servers/8f58ad6d-0fd5-48c7-a969-c7b6503d639b => generated 1512 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:05:09.274577 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-97da2600-f66e-4079-a65f-f8f0894df1f3 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:09.277992 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-97da2600-f66e-4079-a65f-f8f0894df1f3 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:09.290258 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-97da2600-f66e-4079-a65f-f8f0894df1f3 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:09.291002 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-97da2600-f66e-4079-a65f-f8f0894df1f3 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:09.292393 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-97da2600-f66e-4079-a65f-f8f0894df1f3 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:09.293443 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-97da2600-f66e-4079-a65f-f8f0894df1f3 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:09.354589 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-97da2600-f66e-4079-a65f-f8f0894df1f3 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.078661 Jan 15 21:05:09.356130 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2568/5133] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:09 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:05:09.366547 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-57e5141e-8dd9-48b3-ae7f-251187c76223 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:09.367562 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-57e5141e-8dd9-48b3-ae7f-251187c76223 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:09.389573 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-57e5141e-8dd9-48b3-ae7f-251187c76223 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:09.390526 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-57e5141e-8dd9-48b3-ae7f-251187c76223 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:09.391366 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-57e5141e-8dd9-48b3-ae7f-251187c76223 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:09.391785 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-57e5141e-8dd9-48b3-ae7f-251187c76223 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:09.465116 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-57e5141e-8dd9-48b3-ae7f-251187c76223 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.107163 Jan 15 21:05:09.465926 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2569/5134] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:09 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:05:09.466927 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-af75ac5c-351c-4acf-b3ae-a5be3c8939a4 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:05:09.474515 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-af75ac5c-351c-4acf-b3ae-a5be3c8939a4 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/df405782-02e0-4416-9c91-818ea05dacaf" status: 200 len: 1509 microversion: 2.1 time: 0.655332 Jan 15 21:05:09.475102 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2566/5135] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:05:08 2022] GET /compute/v2.1/servers/df405782-02e0-4416-9c91-818ea05dacaf => generated 1509 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:05:09.829096 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-60c21a1d-9ebb-4fba-8660-1ed728f2e0dd tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:09.830385 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-60c21a1d-9ebb-4fba-8660-1ed728f2e0dd tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:09.838973 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-60c21a1d-9ebb-4fba-8660-1ed728f2e0dd tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:09.839694 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-60c21a1d-9ebb-4fba-8660-1ed728f2e0dd tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:09.840570 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-60c21a1d-9ebb-4fba-8660-1ed728f2e0dd tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:09.841033 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-60c21a1d-9ebb-4fba-8660-1ed728f2e0dd tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:09.884453 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-60c21a1d-9ebb-4fba-8660-1ed728f2e0dd tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action" status: 200 len: 32638 microversion: 2.20 time: 0.059580 Jan 15 21:05:09.885860 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2570/5136] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:09 2022] POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action => generated 32638 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:05:10.271623 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9bf54fbf-1ac8-4b97-bd0e-bacefd4d6f3b tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:05:10.272534 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-9bf54fbf-1ac8-4b97-bd0e-bacefd4d6f3b tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: 8f58ad6d-0fd5-48c7-a969-c7b6503d639b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:10.281769 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9bf54fbf-1ac8-4b97-bd0e-bacefd4d6f3b tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:10.282583 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9bf54fbf-1ac8-4b97-bd0e-bacefd4d6f3b tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:10.283585 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9bf54fbf-1ac8-4b97-bd0e-bacefd4d6f3b tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:10.284192 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9bf54fbf-1ac8-4b97-bd0e-bacefd4d6f3b tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:10.367711 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f5b0b117-34b4-4a64-bd33-dd0da13ef97e tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:10.368643 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f5b0b117-34b4-4a64-bd33-dd0da13ef97e tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:10.391311 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f5b0b117-34b4-4a64-bd33-dd0da13ef97e tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:10.391767 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f5b0b117-34b4-4a64-bd33-dd0da13ef97e tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:10.393193 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f5b0b117-34b4-4a64-bd33-dd0da13ef97e tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:10.398937 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f5b0b117-34b4-4a64-bd33-dd0da13ef97e tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:10.474764 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f5b0b117-34b4-4a64-bd33-dd0da13ef97e tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.110934 Jan 15 21:05:10.476130 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2571/5137] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:10 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:05:10.500358 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a535ef37-39d2-499e-9414-20782689267b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:10.502959 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a535ef37-39d2-499e-9414-20782689267b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:10.521004 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a535ef37-39d2-499e-9414-20782689267b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:10.523548 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a535ef37-39d2-499e-9414-20782689267b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:10.524585 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a535ef37-39d2-499e-9414-20782689267b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:10.526006 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a535ef37-39d2-499e-9414-20782689267b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:10.589857 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-9bf54fbf-1ac8-4b97-bd0e-bacefd4d6f3b tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb3421bc9494914bc5f797b15a55643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31af2a6b9424f168dd6084d8d5fd0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:05:10.597427 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-9bf54fbf-1ac8-4b97-bd0e-bacefd4d6f3b tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/8f58ad6d-0fd5-48c7-a969-c7b6503d639b" status: 200 len: 1512 microversion: 2.1 time: 0.329587 Jan 15 21:05:10.618516 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2567/5138] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:05:10 2022] GET /compute/v2.1/servers/8f58ad6d-0fd5-48c7-a969-c7b6503d639b => generated 1512 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:05:10.623641 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a535ef37-39d2-499e-9414-20782689267b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.145694 Jan 15 21:05:10.631879 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8a4fca57-9e9e-4a25-ae0a-6596dfdeb84b tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:05:10.632199 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2572/5139] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:10 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:05:10.637951 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-8a4fca57-9e9e-4a25-ae0a-6596dfdeb84b tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: df405782-02e0-4416-9c91-818ea05dacaf] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:10.641458 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0f7a3ef6-7844-42f7-bd0e-20a98349ce8d tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:10.645439 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-0f7a3ef6-7844-42f7-bd0e-20a98349ce8d tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: d9db70df-9ffc-4b96-af06-a56b3b35ce91] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:10.649256 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8a4fca57-9e9e-4a25-ae0a-6596dfdeb84b tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:10.656740 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0f7a3ef6-7844-42f7-bd0e-20a98349ce8d tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:10.657611 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8a4fca57-9e9e-4a25-ae0a-6596dfdeb84b tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:10.658615 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8a4fca57-9e9e-4a25-ae0a-6596dfdeb84b tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:10.659406 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8a4fca57-9e9e-4a25-ae0a-6596dfdeb84b tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:10.667271 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0f7a3ef6-7844-42f7-bd0e-20a98349ce8d tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:10.671135 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0f7a3ef6-7844-42f7-bd0e-20a98349ce8d tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:10.671631 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0f7a3ef6-7844-42f7-bd0e-20a98349ce8d tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:10.739060 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0f7a3ef6-7844-42f7-bd0e-20a98349ce8d tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action" status: 200 len: 14 microversion: 2.1 time: 0.103824 Jan 15 21:05:10.740711 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2573/5140] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:05:10 2022] POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action => generated 14 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 21:05:10.750362 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-779cd36d-026f-454d-9256-ef386be8597f req-2a930ce5-db8e-48b0-92e0-f653b7443e36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9db70df-9ffc-4b96-af06-a56b3b35ce91", "tag": "19fc242c-c091-4b78-8fec-c33b6bd5cc60"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:10.754026 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:05:10.754026 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:05:10.778588 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-779cd36d-026f-454d-9256-ef386be8597f req-2a930ce5-db8e-48b0-92e0-f653b7443e36 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:10.779344 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-779cd36d-026f-454d-9256-ef386be8597f req-2a930ce5-db8e-48b0-92e0-f653b7443e36 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:10.802961 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-779cd36d-026f-454d-9256-ef386be8597f req-2a930ce5-db8e-48b0-92e0-f653b7443e36 service nova] Creating event network-changed:19fc242c-c091-4b78-8fec-c33b6bd5cc60 for instance d9db70df-9ffc-4b96-af06-a56b3b35ce91 on nch2-master-1 Jan 15 21:05:10.810273 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-779cd36d-026f-454d-9256-ef386be8597f req-2a930ce5-db8e-48b0-92e0-f653b7443e36 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066218 Jan 15 21:05:10.811318 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2574/5141] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:05:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:05:10.900659 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4e6d66d9-5286-4197-9653-f18c711b4548 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:10.903442 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-4e6d66d9-5286-4197-9653-f18c711b4548 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:10.925900 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-8a4fca57-9e9e-4a25-ae0a-6596dfdeb84b tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:05:10.934476 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4e6d66d9-5286-4197-9653-f18c711b4548 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:10.937770 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4e6d66d9-5286-4197-9653-f18c711b4548 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:10.941527 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-8a4fca57-9e9e-4a25-ae0a-6596dfdeb84b tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/df405782-02e0-4416-9c91-818ea05dacaf" status: 200 len: 1509 microversion: 2.1 time: 0.318045 Jan 15 21:05:10.942357 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2568/5142] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:05:10 2022] GET /compute/v2.1/servers/df405782-02e0-4416-9c91-818ea05dacaf => generated 1509 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:05:10.942836 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4e6d66d9-5286-4197-9653-f18c711b4548 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:10.945470 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4e6d66d9-5286-4197-9653-f18c711b4548 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:11.067147 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-4e6d66d9-5286-4197-9653-f18c711b4548 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action" status: 200 len: 32638 microversion: 2.20 time: 0.171869 Jan 15 21:05:11.071263 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2575/5143] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:10 2022] POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action => generated 32638 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:05:11.492599 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e7a0589a-a751-448b-9dbe-f5e2aaae7d2d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:11.505996 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e7a0589a-a751-448b-9dbe-f5e2aaae7d2d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:11.525405 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e7a0589a-a751-448b-9dbe-f5e2aaae7d2d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:11.527346 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e7a0589a-a751-448b-9dbe-f5e2aaae7d2d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:11.528394 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e7a0589a-a751-448b-9dbe-f5e2aaae7d2d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:11.528834 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e7a0589a-a751-448b-9dbe-f5e2aaae7d2d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:11.607945 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e7a0589a-a751-448b-9dbe-f5e2aaae7d2d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.123615 Jan 15 21:05:11.608702 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2569/5144] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:11 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:05:11.616512 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-591e1f63-aa26-4c61-a352-a742a4508216 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:05:11.617860 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-591e1f63-aa26-4c61-a352-a742a4508216 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: 8f58ad6d-0fd5-48c7-a969-c7b6503d639b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:11.636881 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f3c33f82-58c5-418a-9f89-ff95d766bd16 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:11.638143 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f3c33f82-58c5-418a-9f89-ff95d766bd16 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:11.639298 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-591e1f63-aa26-4c61-a352-a742a4508216 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:11.639750 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-591e1f63-aa26-4c61-a352-a742a4508216 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:11.640538 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-591e1f63-aa26-4c61-a352-a742a4508216 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:11.652551 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-591e1f63-aa26-4c61-a352-a742a4508216 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:11.667595 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f3c33f82-58c5-418a-9f89-ff95d766bd16 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:11.670210 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f3c33f82-58c5-418a-9f89-ff95d766bd16 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:11.682661 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f3c33f82-58c5-418a-9f89-ff95d766bd16 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:11.683574 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f3c33f82-58c5-418a-9f89-ff95d766bd16 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:11.812541 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f3c33f82-58c5-418a-9f89-ff95d766bd16 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.180246 Jan 15 21:05:11.813244 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2570/5145] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:11 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:05:11.841870 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-abedc7a3-fc96-4b41-98c7-be7885fd8ccc tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:11.844736 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-abedc7a3-fc96-4b41-98c7-be7885fd8ccc tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: d9db70df-9ffc-4b96-af06-a56b3b35ce91] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:11.869419 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-abedc7a3-fc96-4b41-98c7-be7885fd8ccc tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:11.870817 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-abedc7a3-fc96-4b41-98c7-be7885fd8ccc tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:11.871834 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-abedc7a3-fc96-4b41-98c7-be7885fd8ccc tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:11.872537 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-abedc7a3-fc96-4b41-98c7-be7885fd8ccc tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:11.955059 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-abedc7a3-fc96-4b41-98c7-be7885fd8ccc tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action" status: 200 len: 14 microversion: 2.1 time: 0.132706 Jan 15 21:05:11.955763 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2571/5146] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:05:11 2022] POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action => generated 14 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 21:05:11.961879 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-28f202e8-5c8e-4ee7-b073-83be9c403ba6 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:05:11.962825 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-28f202e8-5c8e-4ee7-b073-83be9c403ba6 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: df405782-02e0-4416-9c91-818ea05dacaf] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:11.985077 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-28f202e8-5c8e-4ee7-b073-83be9c403ba6 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:11.986976 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-28f202e8-5c8e-4ee7-b073-83be9c403ba6 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:11.988493 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-28f202e8-5c8e-4ee7-b073-83be9c403ba6 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:11.992972 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-28f202e8-5c8e-4ee7-b073-83be9c403ba6 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:12.551305 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-591e1f63-aa26-4c61-a352-a742a4508216 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb3421bc9494914bc5f797b15a55643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31af2a6b9424f168dd6084d8d5fd0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:05:12.583658 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-591e1f63-aa26-4c61-a352-a742a4508216 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/8f58ad6d-0fd5-48c7-a969-c7b6503d639b" status: 200 len: 1512 microversion: 2.1 time: 0.971615 Jan 15 21:05:12.586075 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2576/5147] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:05:11 2022] GET /compute/v2.1/servers/8f58ad6d-0fd5-48c7-a969-c7b6503d639b => generated 1512 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:05:12.601580 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9e242677-0326-4a18-b520-e2e0457b04a7 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:12.605370 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-9e242677-0326-4a18-b520-e2e0457b04a7 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:12.621551 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9e242677-0326-4a18-b520-e2e0457b04a7 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:12.624036 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9e242677-0326-4a18-b520-e2e0457b04a7 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:12.625296 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9e242677-0326-4a18-b520-e2e0457b04a7 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:12.626098 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9e242677-0326-4a18-b520-e2e0457b04a7 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:12.735972 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-9e242677-0326-4a18-b520-e2e0457b04a7 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action" status: 200 len: 32638 microversion: 2.20 time: 0.142819 Jan 15 21:05:12.737948 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2577/5148] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:12 2022] POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action => generated 32638 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:05:12.756360 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0921170f-7f11-497d-b6a0-932cef2e7f2c tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:12.758241 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-0921170f-7f11-497d-b6a0-932cef2e7f2c tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:12.779813 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0921170f-7f11-497d-b6a0-932cef2e7f2c tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:12.780688 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0921170f-7f11-497d-b6a0-932cef2e7f2c tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:12.782135 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0921170f-7f11-497d-b6a0-932cef2e7f2c tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:12.783733 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0921170f-7f11-497d-b6a0-932cef2e7f2c tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:12.845539 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0921170f-7f11-497d-b6a0-932cef2e7f2c tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.104330 Jan 15 21:05:12.847572 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2578/5149] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:12 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:05:12.857943 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-37c30207-ff84-4c51-9c85-438994e5e58e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:12.860438 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-37c30207-ff84-4c51-9c85-438994e5e58e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:12.872079 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-37c30207-ff84-4c51-9c85-438994e5e58e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:12.872876 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-37c30207-ff84-4c51-9c85-438994e5e58e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:12.873922 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-37c30207-ff84-4c51-9c85-438994e5e58e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:12.874615 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-37c30207-ff84-4c51-9c85-438994e5e58e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:12.934644 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-37c30207-ff84-4c51-9c85-438994e5e58e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.085357 Jan 15 21:05:12.935974 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2579/5150] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:12 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:05:12.955963 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-28f202e8-5c8e-4ee7-b073-83be9c403ba6 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:05:12.965829 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-28f202e8-5c8e-4ee7-b073-83be9c403ba6 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/df405782-02e0-4416-9c91-818ea05dacaf" status: 200 len: 1509 microversion: 2.1 time: 1.008638 Jan 15 21:05:12.967013 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-998a01e3-b5c5-4e6a-904c-c52b841c432d tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:12.968247 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-998a01e3-b5c5-4e6a-904c-c52b841c432d tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: d9db70df-9ffc-4b96-af06-a56b3b35ce91] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:12.975870 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-998a01e3-b5c5-4e6a-904c-c52b841c432d tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:12.976570 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-998a01e3-b5c5-4e6a-904c-c52b841c432d tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:12.977548 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-998a01e3-b5c5-4e6a-904c-c52b841c432d tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:12.978132 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-998a01e3-b5c5-4e6a-904c-c52b841c432d tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:12.984023 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2572/5151] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:05:11 2022] GET /compute/v2.1/servers/df405782-02e0-4416-9c91-818ea05dacaf => generated 1509 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:05:13.019256 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-998a01e3-b5c5-4e6a-904c-c52b841c432d tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action" status: 200 len: 14 microversion: 2.1 time: 0.056650 Jan 15 21:05:13.020250 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2580/5152] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:05:12 2022] POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action => generated 14 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 15 21:05:13.644691 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-054252c7-9d35-41cb-9d02-251cdbb880a6 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:05:13.645349 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-054252c7-9d35-41cb-9d02-251cdbb880a6 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: 8f58ad6d-0fd5-48c7-a969-c7b6503d639b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:13.654561 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-054252c7-9d35-41cb-9d02-251cdbb880a6 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:13.655336 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-054252c7-9d35-41cb-9d02-251cdbb880a6 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:13.656353 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-054252c7-9d35-41cb-9d02-251cdbb880a6 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:13.657020 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-054252c7-9d35-41cb-9d02-251cdbb880a6 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:13.781509 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-80cfefba-37b9-4e95-99b0-cb2e2fbfa4c8 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:13.782675 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-80cfefba-37b9-4e95-99b0-cb2e2fbfa4c8 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:13.799853 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-80cfefba-37b9-4e95-99b0-cb2e2fbfa4c8 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:13.800603 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-80cfefba-37b9-4e95-99b0-cb2e2fbfa4c8 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:13.801598 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-80cfefba-37b9-4e95-99b0-cb2e2fbfa4c8 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:13.802191 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-80cfefba-37b9-4e95-99b0-cb2e2fbfa4c8 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:13.883090 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-80cfefba-37b9-4e95-99b0-cb2e2fbfa4c8 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action" status: 200 len: 32638 microversion: 2.20 time: 0.135370 Jan 15 21:05:13.889468 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2581/5153] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:13 2022] POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action => generated 32638 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:05:13.896891 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-054252c7-9d35-41cb-9d02-251cdbb880a6 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb3421bc9494914bc5f797b15a55643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31af2a6b9424f168dd6084d8d5fd0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:05:13.905657 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-054252c7-9d35-41cb-9d02-251cdbb880a6 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/8f58ad6d-0fd5-48c7-a969-c7b6503d639b" status: 200 len: 1512 microversion: 2.1 time: 0.266386 Jan 15 21:05:13.918062 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2573/5154] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:05:13 2022] GET /compute/v2.1/servers/8f58ad6d-0fd5-48c7-a969-c7b6503d639b => generated 1512 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:05:13.918519 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a9216aef-76c3-44a1-8f1b-af395f9eaeb1 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:13.918519 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a9216aef-76c3-44a1-8f1b-af395f9eaeb1 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:13.920672 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a9216aef-76c3-44a1-8f1b-af395f9eaeb1 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:13.921241 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a9216aef-76c3-44a1-8f1b-af395f9eaeb1 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:13.922117 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a9216aef-76c3-44a1-8f1b-af395f9eaeb1 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:13.922814 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a9216aef-76c3-44a1-8f1b-af395f9eaeb1 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:13.946706 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a1d8f937-d29c-4f20-8624-a1439d8d1f4b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:13.947663 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a1d8f937-d29c-4f20-8624-a1439d8d1f4b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:13.966107 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a1d8f937-d29c-4f20-8624-a1439d8d1f4b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:13.967528 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a1d8f937-d29c-4f20-8624-a1439d8d1f4b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:13.968513 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a1d8f937-d29c-4f20-8624-a1439d8d1f4b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:13.969137 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a1d8f937-d29c-4f20-8624-a1439d8d1f4b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:14.006115 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a9216aef-76c3-44a1-8f1b-af395f9eaeb1 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.114178 Jan 15 21:05:14.016261 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2582/5155] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:13 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:05:14.018067 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a1d8f937-d29c-4f20-8624-a1439d8d1f4b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.074671 Jan 15 21:05:14.022485 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2574/5156] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:13 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:05:14.032296 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f4a5a218-589c-4b45-af0a-795fa0740019 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:05:14.034916 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9c9395e8-c029-45ed-94fd-800a871a2dca tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:14.036189 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-9c9395e8-c029-45ed-94fd-800a871a2dca tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: d9db70df-9ffc-4b96-af06-a56b3b35ce91] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:14.037924 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f4a5a218-589c-4b45-af0a-795fa0740019 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: df405782-02e0-4416-9c91-818ea05dacaf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:14.049700 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f4a5a218-589c-4b45-af0a-795fa0740019 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:14.050163 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f4a5a218-589c-4b45-af0a-795fa0740019 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:14.050969 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f4a5a218-589c-4b45-af0a-795fa0740019 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:14.054123 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f4a5a218-589c-4b45-af0a-795fa0740019 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:14.059004 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9c9395e8-c029-45ed-94fd-800a871a2dca tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:14.061386 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9c9395e8-c029-45ed-94fd-800a871a2dca tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:14.062423 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9c9395e8-c029-45ed-94fd-800a871a2dca tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:14.064549 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9c9395e8-c029-45ed-94fd-800a871a2dca tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:14.141838 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-9c9395e8-c029-45ed-94fd-800a871a2dca tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action" status: 200 len: 14 microversion: 2.1 time: 0.113047 Jan 15 21:05:14.145320 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2575/5157] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:05:14 2022] POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action => generated 14 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 21:05:14.256311 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-f4a5a218-589c-4b45-af0a-795fa0740019 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:05:14.267757 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f4a5a218-589c-4b45-af0a-795fa0740019 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/df405782-02e0-4416-9c91-818ea05dacaf" status: 200 len: 1509 microversion: 2.1 time: 0.250073 Jan 15 21:05:14.280703 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2583/5158] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:05:14 2022] GET /compute/v2.1/servers/df405782-02e0-4416-9c91-818ea05dacaf => generated 1509 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:05:14.897801 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e5321f36-77a9-4eea-a0f2-236160e9c2d5 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:14.899239 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e5321f36-77a9-4eea-a0f2-236160e9c2d5 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:14.912289 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e5321f36-77a9-4eea-a0f2-236160e9c2d5 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:14.915925 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e5321f36-77a9-4eea-a0f2-236160e9c2d5 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:14.918925 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e5321f36-77a9-4eea-a0f2-236160e9c2d5 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:14.920549 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e5321f36-77a9-4eea-a0f2-236160e9c2d5 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:14.926841 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-5a14ac6f-e187-49e2-bde4-31b5a5844503 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:05:14.928277 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-5a14ac6f-e187-49e2-bde4-31b5a5844503 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: 8f58ad6d-0fd5-48c7-a969-c7b6503d639b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:14.944196 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5a14ac6f-e187-49e2-bde4-31b5a5844503 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:14.945805 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5a14ac6f-e187-49e2-bde4-31b5a5844503 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:14.949753 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5a14ac6f-e187-49e2-bde4-31b5a5844503 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:14.951866 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5a14ac6f-e187-49e2-bde4-31b5a5844503 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:15.012426 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e5321f36-77a9-4eea-a0f2-236160e9c2d5 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action" status: 200 len: 32638 microversion: 2.20 time: 0.119930 Jan 15 21:05:15.024114 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2576/5159] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:14 2022] POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action => generated 32638 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:05:15.036795 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-7f310042-d5bf-410b-85c5-fcb402c5ae9b tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:15.042274 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-7f310042-d5bf-410b-85c5-fcb402c5ae9b tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:15.050287 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7f310042-d5bf-410b-85c5-fcb402c5ae9b tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:15.051331 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7f310042-d5bf-410b-85c5-fcb402c5ae9b tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:15.052267 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7f310042-d5bf-410b-85c5-fcb402c5ae9b tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:15.052863 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7f310042-d5bf-410b-85c5-fcb402c5ae9b tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:15.101016 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-7f310042-d5bf-410b-85c5-fcb402c5ae9b tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.075231 Jan 15 21:05:15.102200 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2577/5160] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:15 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:05:15.112571 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c8b23020-621b-498b-82aa-e0e68a024857 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:15.114304 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c8b23020-621b-498b-82aa-e0e68a024857 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:15.126034 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c8b23020-621b-498b-82aa-e0e68a024857 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:15.127968 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c8b23020-621b-498b-82aa-e0e68a024857 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:15.130178 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c8b23020-621b-498b-82aa-e0e68a024857 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:15.131647 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c8b23020-621b-498b-82aa-e0e68a024857 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:15.226255 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c8b23020-621b-498b-82aa-e0e68a024857 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.122512 Jan 15 21:05:15.230075 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2578/5161] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:15 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:05:15.239874 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c0de941c-5e2c-44f7-84a8-976e79a747bc tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:15.244805 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c0de941c-5e2c-44f7-84a8-976e79a747bc tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: d9db70df-9ffc-4b96-af06-a56b3b35ce91] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:15.248711 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-5a14ac6f-e187-49e2-bde4-31b5a5844503 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb3421bc9494914bc5f797b15a55643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31af2a6b9424f168dd6084d8d5fd0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:05:15.262899 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-5a14ac6f-e187-49e2-bde4-31b5a5844503 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/8f58ad6d-0fd5-48c7-a969-c7b6503d639b" status: 200 len: 1512 microversion: 2.1 time: 0.340743 Jan 15 21:05:15.263402 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c0de941c-5e2c-44f7-84a8-976e79a747bc tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:15.263873 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c0de941c-5e2c-44f7-84a8-976e79a747bc tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:15.269507 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c0de941c-5e2c-44f7-84a8-976e79a747bc tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:15.269650 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2584/5162] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:05:14 2022] GET /compute/v2.1/servers/8f58ad6d-0fd5-48c7-a969-c7b6503d639b => generated 1512 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:05:15.269962 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c0de941c-5e2c-44f7-84a8-976e79a747bc tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:15.287789 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ab220a9f-c6f9-4d4b-a1bd-898bf3b3d7a6 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:05:15.290332 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ab220a9f-c6f9-4d4b-a1bd-898bf3b3d7a6 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: df405782-02e0-4416-9c91-818ea05dacaf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:15.306810 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ab220a9f-c6f9-4d4b-a1bd-898bf3b3d7a6 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:15.308217 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ab220a9f-c6f9-4d4b-a1bd-898bf3b3d7a6 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:15.311737 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ab220a9f-c6f9-4d4b-a1bd-898bf3b3d7a6 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:15.312512 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ab220a9f-c6f9-4d4b-a1bd-898bf3b3d7a6 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:15.357799 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c0de941c-5e2c-44f7-84a8-976e79a747bc tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action" status: 200 len: 14 microversion: 2.1 time: 0.126202 Jan 15 21:05:15.361074 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2579/5163] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:05:15 2022] POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action => generated 14 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 21:05:15.655074 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-ab220a9f-c6f9-4d4b-a1bd-898bf3b3d7a6 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:05:15.674972 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ab220a9f-c6f9-4d4b-a1bd-898bf3b3d7a6 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/df405782-02e0-4416-9c91-818ea05dacaf" status: 200 len: 1509 microversion: 2.1 time: 0.381188 Jan 15 21:05:15.676007 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2585/5164] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:05:15 2022] GET /compute/v2.1/servers/df405782-02e0-4416-9c91-818ea05dacaf => generated 1509 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:05:16.029525 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-86184c14-5f55-419b-8324-c779213ddfd8 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:16.031211 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-86184c14-5f55-419b-8324-c779213ddfd8 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:16.044063 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-86184c14-5f55-419b-8324-c779213ddfd8 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:16.044903 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-86184c14-5f55-419b-8324-c779213ddfd8 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:16.045775 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-86184c14-5f55-419b-8324-c779213ddfd8 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:16.046407 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-86184c14-5f55-419b-8324-c779213ddfd8 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:16.093101 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-86184c14-5f55-419b-8324-c779213ddfd8 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action" status: 200 len: 32638 microversion: 2.20 time: 0.068487 Jan 15 21:05:16.096468 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2580/5165] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:16 2022] POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action => generated 32638 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:05:16.114292 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9332c38b-d1a8-4f83-92f6-f7bd19f909da tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:16.116133 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-9332c38b-d1a8-4f83-92f6-f7bd19f909da tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:16.126088 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9332c38b-d1a8-4f83-92f6-f7bd19f909da tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:16.135058 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9332c38b-d1a8-4f83-92f6-f7bd19f909da tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:16.140922 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9332c38b-d1a8-4f83-92f6-f7bd19f909da tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:16.142268 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9332c38b-d1a8-4f83-92f6-f7bd19f909da tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:16.221419 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-9332c38b-d1a8-4f83-92f6-f7bd19f909da tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.109150 Jan 15 21:05:16.224307 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2586/5166] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:16 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:05:16.241063 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a2704fc3-dee6-479a-92c7-4e41eda813d8 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:16.242200 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a2704fc3-dee6-479a-92c7-4e41eda813d8 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:16.249843 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a2704fc3-dee6-479a-92c7-4e41eda813d8 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:16.250385 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a2704fc3-dee6-479a-92c7-4e41eda813d8 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:16.251251 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a2704fc3-dee6-479a-92c7-4e41eda813d8 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:16.251758 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a2704fc3-dee6-479a-92c7-4e41eda813d8 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:16.288887 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-763a2bd6-bdfb-4d9d-bfcb-f07b823a25cc tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:05:16.289613 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-763a2bd6-bdfb-4d9d-bfcb-f07b823a25cc tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: 8f58ad6d-0fd5-48c7-a969-c7b6503d639b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:16.297271 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-763a2bd6-bdfb-4d9d-bfcb-f07b823a25cc tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:16.297835 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-763a2bd6-bdfb-4d9d-bfcb-f07b823a25cc tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:16.298699 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-763a2bd6-bdfb-4d9d-bfcb-f07b823a25cc tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:16.299204 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-763a2bd6-bdfb-4d9d-bfcb-f07b823a25cc tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:16.330744 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a2704fc3-dee6-479a-92c7-4e41eda813d8 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.093599 Jan 15 21:05:16.332101 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2581/5167] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:16 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:05:16.370865 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2dba1105-4528-4b5f-b22d-2bef74869351 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:16.379494 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-2dba1105-4528-4b5f-b22d-2bef74869351 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: d9db70df-9ffc-4b96-af06-a56b3b35ce91] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:16.387907 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2dba1105-4528-4b5f-b22d-2bef74869351 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:16.388365 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2dba1105-4528-4b5f-b22d-2bef74869351 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:16.389532 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2dba1105-4528-4b5f-b22d-2bef74869351 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:16.389976 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2dba1105-4528-4b5f-b22d-2bef74869351 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:16.471535 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2dba1105-4528-4b5f-b22d-2bef74869351 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action" status: 200 len: 14 microversion: 2.1 time: 0.105942 Jan 15 21:05:16.486713 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2582/5168] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:05:16 2022] POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action => generated 14 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 15 21:05:16.643417 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-763a2bd6-bdfb-4d9d-bfcb-f07b823a25cc tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb3421bc9494914bc5f797b15a55643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31af2a6b9424f168dd6084d8d5fd0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:05:16.652460 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-763a2bd6-bdfb-4d9d-bfcb-f07b823a25cc tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/8f58ad6d-0fd5-48c7-a969-c7b6503d639b" status: 200 len: 1512 microversion: 2.1 time: 0.369754 Jan 15 21:05:16.665130 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2587/5169] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:05:16 2022] GET /compute/v2.1/servers/8f58ad6d-0fd5-48c7-a969-c7b6503d639b => generated 1512 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:05:16.695148 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-81b68b04-593d-4c53-ae67-cc5f07494b2b tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:05:16.696711 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-81b68b04-593d-4c53-ae67-cc5f07494b2b tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: df405782-02e0-4416-9c91-818ea05dacaf] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:16.711655 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-81b68b04-593d-4c53-ae67-cc5f07494b2b tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:16.715077 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-81b68b04-593d-4c53-ae67-cc5f07494b2b tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:16.717963 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-81b68b04-593d-4c53-ae67-cc5f07494b2b tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:16.721048 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-81b68b04-593d-4c53-ae67-cc5f07494b2b tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:17.046858 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-81b68b04-593d-4c53-ae67-cc5f07494b2b tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:05:17.057756 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-81b68b04-593d-4c53-ae67-cc5f07494b2b tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/df405782-02e0-4416-9c91-818ea05dacaf" status: 200 len: 1509 microversion: 2.1 time: 0.368034 Jan 15 21:05:17.058353 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2583/5170] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:05:16 2022] GET /compute/v2.1/servers/df405782-02e0-4416-9c91-818ea05dacaf => generated 1509 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:05:17.107472 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ed30fc04-7521-485f-a39b-1cf9edb01d5d tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:17.108935 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ed30fc04-7521-485f-a39b-1cf9edb01d5d tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:17.123450 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ed30fc04-7521-485f-a39b-1cf9edb01d5d tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:17.124103 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ed30fc04-7521-485f-a39b-1cf9edb01d5d tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:17.124711 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ed30fc04-7521-485f-a39b-1cf9edb01d5d tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:17.125179 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ed30fc04-7521-485f-a39b-1cf9edb01d5d tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:17.227556 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ed30fc04-7521-485f-a39b-1cf9edb01d5d tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action" status: 200 len: 32638 microversion: 2.20 time: 0.123538 Jan 15 21:05:17.233704 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2588/5171] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:17 2022] POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action => generated 32638 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:05:17.239837 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-dc7d6f13-aa27-4e99-a884-ff5615bdeb86 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:17.240772 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-dc7d6f13-aa27-4e99-a884-ff5615bdeb86 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:17.260604 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dc7d6f13-aa27-4e99-a884-ff5615bdeb86 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:17.260604 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dc7d6f13-aa27-4e99-a884-ff5615bdeb86 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:17.262781 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dc7d6f13-aa27-4e99-a884-ff5615bdeb86 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:17.264870 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dc7d6f13-aa27-4e99-a884-ff5615bdeb86 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:17.348899 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-09dd5633-cd50-42af-b47f-8f879ea188fd tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:17.348899 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-09dd5633-cd50-42af-b47f-8f879ea188fd tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:17.360700 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-09dd5633-cd50-42af-b47f-8f879ea188fd tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:17.365600 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-09dd5633-cd50-42af-b47f-8f879ea188fd tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:17.366650 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-09dd5633-cd50-42af-b47f-8f879ea188fd tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:17.367444 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-09dd5633-cd50-42af-b47f-8f879ea188fd tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:17.414057 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-dc7d6f13-aa27-4e99-a884-ff5615bdeb86 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.178907 Jan 15 21:05:17.420513 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2584/5172] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:17 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:05:17.476389 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-09dd5633-cd50-42af-b47f-8f879ea188fd tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.136839 Jan 15 21:05:17.482940 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2589/5173] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:17 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:05:17.489581 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2255fdc8-bbea-4898-9c7a-657b705535ad tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:17.490812 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-2255fdc8-bbea-4898-9c7a-657b705535ad tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: d9db70df-9ffc-4b96-af06-a56b3b35ce91] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:17.506057 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2255fdc8-bbea-4898-9c7a-657b705535ad tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:17.506517 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2255fdc8-bbea-4898-9c7a-657b705535ad tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:17.507322 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2255fdc8-bbea-4898-9c7a-657b705535ad tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:17.507761 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2255fdc8-bbea-4898-9c7a-657b705535ad tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:17.591781 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2255fdc8-bbea-4898-9c7a-657b705535ad tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action" status: 200 len: 14 microversion: 2.1 time: 0.105653 Jan 15 21:05:17.595631 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2585/5174] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:05:17 2022] POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action => generated 14 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 21:05:17.674539 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-917bd604-29c2-4d30-8b2f-52ff5d54b3d5 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:05:17.675585 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-917bd604-29c2-4d30-8b2f-52ff5d54b3d5 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: 8f58ad6d-0fd5-48c7-a969-c7b6503d639b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:17.687036 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-917bd604-29c2-4d30-8b2f-52ff5d54b3d5 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:17.690672 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-917bd604-29c2-4d30-8b2f-52ff5d54b3d5 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:17.694875 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-917bd604-29c2-4d30-8b2f-52ff5d54b3d5 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:17.695344 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-917bd604-29c2-4d30-8b2f-52ff5d54b3d5 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:17.944737 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-917bd604-29c2-4d30-8b2f-52ff5d54b3d5 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb3421bc9494914bc5f797b15a55643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31af2a6b9424f168dd6084d8d5fd0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:05:17.952411 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-917bd604-29c2-4d30-8b2f-52ff5d54b3d5 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/8f58ad6d-0fd5-48c7-a969-c7b6503d639b" status: 200 len: 1489 microversion: 2.1 time: 0.282408 Jan 15 21:05:17.953023 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2590/5175] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:05:17 2022] GET /compute/v2.1/servers/8f58ad6d-0fd5-48c7-a969-c7b6503d639b => generated 1489 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:05:17.970065 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f204b48e-51f7-4123-97cf-bffddabd3a59 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-738046606"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:17.976945 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f204b48e-51f7-4123-97cf-bffddabd3a59 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: 8f58ad6d-0fd5-48c7-a969-c7b6503d639b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:17.985851 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f204b48e-51f7-4123-97cf-bffddabd3a59 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:17.986305 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f204b48e-51f7-4123-97cf-bffddabd3a59 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:17.987108 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f204b48e-51f7-4123-97cf-bffddabd3a59 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:17.987555 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f204b48e-51f7-4123-97cf-bffddabd3a59 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:18.075258 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-06507d40-ff51-4c57-a716-e7344ad6454b tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:05:18.075875 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-06507d40-ff51-4c57-a716-e7344ad6454b tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: df405782-02e0-4416-9c91-818ea05dacaf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:18.092192 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-06507d40-ff51-4c57-a716-e7344ad6454b tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:18.093577 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-06507d40-ff51-4c57-a716-e7344ad6454b tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:18.095015 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-06507d40-ff51-4c57-a716-e7344ad6454b tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:18.095764 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-06507d40-ff51-4c57-a716-e7344ad6454b tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:18.109499 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f204b48e-51f7-4123-97cf-bffddabd3a59 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "PUT /compute/v2.1/servers/8f58ad6d-0fd5-48c7-a969-c7b6503d639b" status: 200 len: 1061 microversion: 2.1 time: 0.136471 Jan 15 21:05:18.117175 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2586/5176] 10.222.0.46 () {60 vars in 1255 bytes} [Sat Jan 15 21:05:17 2022] PUT /compute/v2.1/servers/8f58ad6d-0fd5-48c7-a969-c7b6503d639b => generated 1061 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:05:18.129437 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-6945f547-062f-42a4-95cc-6cdbe7e19871 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:05:18.132659 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-6945f547-062f-42a4-95cc-6cdbe7e19871 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: 8f58ad6d-0fd5-48c7-a969-c7b6503d639b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:18.148149 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6945f547-062f-42a4-95cc-6cdbe7e19871 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:18.148767 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6945f547-062f-42a4-95cc-6cdbe7e19871 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:18.149615 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6945f547-062f-42a4-95cc-6cdbe7e19871 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:18.150052 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6945f547-062f-42a4-95cc-6cdbe7e19871 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:18.381966 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-06507d40-ff51-4c57-a716-e7344ad6454b tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:05:18.396087 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-06507d40-ff51-4c57-a716-e7344ad6454b tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/df405782-02e0-4416-9c91-818ea05dacaf" status: 200 len: 1509 microversion: 2.1 time: 0.324915 Jan 15 21:05:18.410752 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2591/5177] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:05:18 2022] GET /compute/v2.1/servers/df405782-02e0-4416-9c91-818ea05dacaf => generated 1509 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:05:18.415961 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-71386c41-35d6-4e3d-b80e-6ddaf1970a36 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:18.419230 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-71386c41-35d6-4e3d-b80e-6ddaf1970a36 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:18.430904 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-71386c41-35d6-4e3d-b80e-6ddaf1970a36 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:18.431545 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-71386c41-35d6-4e3d-b80e-6ddaf1970a36 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:18.433062 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-71386c41-35d6-4e3d-b80e-6ddaf1970a36 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:18.433755 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-71386c41-35d6-4e3d-b80e-6ddaf1970a36 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:18.474757 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-6945f547-062f-42a4-95cc-6cdbe7e19871 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb3421bc9494914bc5f797b15a55643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31af2a6b9424f168dd6084d8d5fd0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:05:18.488936 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-6945f547-062f-42a4-95cc-6cdbe7e19871 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/8f58ad6d-0fd5-48c7-a969-c7b6503d639b" status: 200 len: 1488 microversion: 2.1 time: 0.366620 Jan 15 21:05:18.490236 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2587/5178] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:05:18 2022] GET /compute/v2.1/servers/8f58ad6d-0fd5-48c7-a969-c7b6503d639b => generated 1488 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:05:18.496459 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f1476e1a-f96b-42f7-ba5f-164deb9a268e tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:18.498176 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f1476e1a-f96b-42f7-ba5f-164deb9a268e tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:18.502742 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-71386c41-35d6-4e3d-b80e-6ddaf1970a36 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action" status: 200 len: 32638 microversion: 2.20 time: 0.090328 Jan 15 21:05:18.504259 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2592/5179] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:18 2022] POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action => generated 32638 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:05:18.509564 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f1476e1a-f96b-42f7-ba5f-164deb9a268e tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:18.510938 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f1476e1a-f96b-42f7-ba5f-164deb9a268e tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:18.511919 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f1476e1a-f96b-42f7-ba5f-164deb9a268e tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:18.512509 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f1476e1a-f96b-42f7-ba5f-164deb9a268e tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:18.513497 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b9d82bea-7f95-47df-9c1b-e72584275d1d tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:18.514699 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b9d82bea-7f95-47df-9c1b-e72584275d1d tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:18.522819 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b9d82bea-7f95-47df-9c1b-e72584275d1d tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:18.523424 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b9d82bea-7f95-47df-9c1b-e72584275d1d tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:18.524345 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b9d82bea-7f95-47df-9c1b-e72584275d1d tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:18.524967 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b9d82bea-7f95-47df-9c1b-e72584275d1d tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:18.567165 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f1476e1a-f96b-42f7-ba5f-164deb9a268e tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.073376 Jan 15 21:05:18.571028 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2588/5180] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:18 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:05:18.582804 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c6a6395d-38a0-41d6-af76-166e9f9e7672 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:05:18.583524 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c6a6395d-38a0-41d6-af76-166e9f9e7672 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: 8f58ad6d-0fd5-48c7-a969-c7b6503d639b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:18.597873 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c6a6395d-38a0-41d6-af76-166e9f9e7672 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:18.598320 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c6a6395d-38a0-41d6-af76-166e9f9e7672 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:18.599410 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c6a6395d-38a0-41d6-af76-166e9f9e7672 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:18.600225 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c6a6395d-38a0-41d6-af76-166e9f9e7672 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:18.614576 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b9d82bea-7f95-47df-9c1b-e72584275d1d tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.106462 Jan 15 21:05:18.622807 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2593/5181] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:18 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:05:18.632030 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c119e29c-80b2-49cb-bd7c-2f31e36b7cef tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:18.633821 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c119e29c-80b2-49cb-bd7c-2f31e36b7cef tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: d9db70df-9ffc-4b96-af06-a56b3b35ce91] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:18.644696 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c119e29c-80b2-49cb-bd7c-2f31e36b7cef tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:18.645327 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c119e29c-80b2-49cb-bd7c-2f31e36b7cef tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:18.646450 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c119e29c-80b2-49cb-bd7c-2f31e36b7cef tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:18.647136 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c119e29c-80b2-49cb-bd7c-2f31e36b7cef tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:18.717961 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c119e29c-80b2-49cb-bd7c-2f31e36b7cef tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action" status: 200 len: 14 microversion: 2.1 time: 0.093436 Jan 15 21:05:18.721176 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2594/5182] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:05:18 2022] POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action => generated 14 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 21:05:18.929218 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-c6a6395d-38a0-41d6-af76-166e9f9e7672 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb3421bc9494914bc5f797b15a55643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31af2a6b9424f168dd6084d8d5fd0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:05:18.942116 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c6a6395d-38a0-41d6-af76-166e9f9e7672 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/8f58ad6d-0fd5-48c7-a969-c7b6503d639b" status: 200 len: 1488 microversion: 2.1 time: 0.368802 Jan 15 21:05:18.943461 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2589/5183] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:05:18 2022] GET /compute/v2.1/servers/8f58ad6d-0fd5-48c7-a969-c7b6503d639b => generated 1488 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:05:18.958817 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b059cdf0-0e16-4422-b659-54f47ba1ca4e tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:05:18.959396 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b059cdf0-0e16-4422-b659-54f47ba1ca4e tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: 8f58ad6d-0fd5-48c7-a969-c7b6503d639b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:18.972590 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b059cdf0-0e16-4422-b659-54f47ba1ca4e tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:18.973650 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b059cdf0-0e16-4422-b659-54f47ba1ca4e tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:18.974450 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b059cdf0-0e16-4422-b659-54f47ba1ca4e tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:18.974886 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b059cdf0-0e16-4422-b659-54f47ba1ca4e tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:19.022007 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b059cdf0-0e16-4422-b659-54f47ba1ca4e tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: 8f58ad6d-0fd5-48c7-a969-c7b6503d639b] Going to try to terminate instance {{(pid=129366) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 21:05:19.151582 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b059cdf0-0e16-4422-b659-54f47ba1ca4e tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "DELETE /compute/v2.1/servers/8f58ad6d-0fd5-48c7-a969-c7b6503d639b" status: 204 len: 0 microversion: 2.1 time: 0.195954 Jan 15 21:05:19.156758 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2595/5184] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 21:05:18 2022] DELETE /compute/v2.1/servers/8f58ad6d-0fd5-48c7-a969-c7b6503d639b => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 21:05:19.164833 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-7f237d21-e17b-4cc1-9ab9-664a2ebaad0f tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:05:19.165477 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-7f237d21-e17b-4cc1-9ab9-664a2ebaad0f tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: 8f58ad6d-0fd5-48c7-a969-c7b6503d639b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:19.177133 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7f237d21-e17b-4cc1-9ab9-664a2ebaad0f tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:19.177893 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7f237d21-e17b-4cc1-9ab9-664a2ebaad0f tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:19.178966 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7f237d21-e17b-4cc1-9ab9-664a2ebaad0f tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:19.179602 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7f237d21-e17b-4cc1-9ab9-664a2ebaad0f tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:19.418524 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-04c86ec0-0a00-4249-9ecb-6fba2908d76d tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:05:19.419324 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-04c86ec0-0a00-4249-9ecb-6fba2908d76d tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: df405782-02e0-4416-9c91-818ea05dacaf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:19.430498 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-04c86ec0-0a00-4249-9ecb-6fba2908d76d tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:19.431157 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-04c86ec0-0a00-4249-9ecb-6fba2908d76d tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:19.433100 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-04c86ec0-0a00-4249-9ecb-6fba2908d76d tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:19.433884 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-04c86ec0-0a00-4249-9ecb-6fba2908d76d tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:19.473952 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-7f237d21-e17b-4cc1-9ab9-664a2ebaad0f tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb3421bc9494914bc5f797b15a55643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31af2a6b9424f168dd6084d8d5fd0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:05:19.483033 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-7f237d21-e17b-4cc1-9ab9-664a2ebaad0f tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/8f58ad6d-0fd5-48c7-a969-c7b6503d639b" status: 200 len: 1494 microversion: 2.1 time: 0.321981 Jan 15 21:05:19.483620 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2590/5185] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:05:19 2022] GET /compute/v2.1/servers/8f58ad6d-0fd5-48c7-a969-c7b6503d639b => generated 1494 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:05:19.515567 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e0ec2254-2287-4b93-b322-7f6414a6f564 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:19.516477 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e0ec2254-2287-4b93-b322-7f6414a6f564 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:19.522376 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e0ec2254-2287-4b93-b322-7f6414a6f564 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:19.522823 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e0ec2254-2287-4b93-b322-7f6414a6f564 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:19.523600 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e0ec2254-2287-4b93-b322-7f6414a6f564 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:19.524150 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e0ec2254-2287-4b93-b322-7f6414a6f564 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:19.565898 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e0ec2254-2287-4b93-b322-7f6414a6f564 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action" status: 200 len: 32638 microversion: 2.20 time: 0.053804 Jan 15 21:05:19.567438 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2591/5186] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:19 2022] POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action => generated 32638 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:05:19.579062 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-702d5623-5c4c-49d6-8f56-7191c71853b1 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:19.580066 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-702d5623-5c4c-49d6-8f56-7191c71853b1 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:19.587416 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-702d5623-5c4c-49d6-8f56-7191c71853b1 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:19.587870 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-702d5623-5c4c-49d6-8f56-7191c71853b1 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:19.588708 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-702d5623-5c4c-49d6-8f56-7191c71853b1 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:19.589209 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-702d5623-5c4c-49d6-8f56-7191c71853b1 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:19.643136 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-702d5623-5c4c-49d6-8f56-7191c71853b1 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.068033 Jan 15 21:05:19.644333 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2592/5187] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:19 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:05:19.649926 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-44ee74a8-6c48-4dc5-a67e-ac97e8e609f3 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:19.651065 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-44ee74a8-6c48-4dc5-a67e-ac97e8e609f3 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:19.658239 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-44ee74a8-6c48-4dc5-a67e-ac97e8e609f3 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:19.658801 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-44ee74a8-6c48-4dc5-a67e-ac97e8e609f3 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:19.659612 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-44ee74a8-6c48-4dc5-a67e-ac97e8e609f3 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:19.660048 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-44ee74a8-6c48-4dc5-a67e-ac97e8e609f3 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:19.680909 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-04c86ec0-0a00-4249-9ecb-6fba2908d76d tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:05:19.689632 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-04c86ec0-0a00-4249-9ecb-6fba2908d76d tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/df405782-02e0-4416-9c91-818ea05dacaf" status: 200 len: 1509 microversion: 2.1 time: 0.275720 Jan 15 21:05:19.690187 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2596/5188] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:05:19 2022] GET /compute/v2.1/servers/df405782-02e0-4416-9c91-818ea05dacaf => generated 1509 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:05:19.709248 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-44ee74a8-6c48-4dc5-a67e-ac97e8e609f3 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.063242 Jan 15 21:05:19.714413 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2593/5189] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:19 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:05:19.728925 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-2ca66872-d52f-4673-b461-897f476a7e5a tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:19.729891 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-2ca66872-d52f-4673-b461-897f476a7e5a tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: d9db70df-9ffc-4b96-af06-a56b3b35ce91] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:19.735721 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2ca66872-d52f-4673-b461-897f476a7e5a tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:19.736171 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2ca66872-d52f-4673-b461-897f476a7e5a tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:19.736973 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2ca66872-d52f-4673-b461-897f476a7e5a tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:19.737409 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2ca66872-d52f-4673-b461-897f476a7e5a tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:19.787230 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-2ca66872-d52f-4673-b461-897f476a7e5a tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action" status: 200 len: 8208 microversion: 2.1 time: 0.061937 Jan 15 21:05:19.788288 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2597/5190] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:05:19 2022] POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action => generated 8208 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:05:20.499866 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f9773df6-785d-4dc6-bacc-7239f8f73df5 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:05:20.500593 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f9773df6-785d-4dc6-bacc-7239f8f73df5 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: 8f58ad6d-0fd5-48c7-a969-c7b6503d639b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:20.507964 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f9773df6-785d-4dc6-bacc-7239f8f73df5 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:20.508498 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f9773df6-785d-4dc6-bacc-7239f8f73df5 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:20.509511 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f9773df6-785d-4dc6-bacc-7239f8f73df5 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:20.510719 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f9773df6-785d-4dc6-bacc-7239f8f73df5 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:20.579805 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8764b6ec-d628-4d15-9431-6b9407d31de0 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:20.581489 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-8764b6ec-d628-4d15-9431-6b9407d31de0 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:20.590561 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8764b6ec-d628-4d15-9431-6b9407d31de0 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:20.591259 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8764b6ec-d628-4d15-9431-6b9407d31de0 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:20.592214 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8764b6ec-d628-4d15-9431-6b9407d31de0 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:20.592810 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8764b6ec-d628-4d15-9431-6b9407d31de0 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:20.644469 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-8764b6ec-d628-4d15-9431-6b9407d31de0 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action" status: 200 len: 32638 microversion: 2.20 time: 0.069346 Jan 15 21:05:20.645283 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2598/5191] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:20 2022] POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action => generated 32638 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:05:20.657520 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4639a786-7f63-43fa-8699-f286f646e56d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:20.658729 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-4639a786-7f63-43fa-8699-f286f646e56d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:20.671147 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4639a786-7f63-43fa-8699-f286f646e56d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:20.671923 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4639a786-7f63-43fa-8699-f286f646e56d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:20.672895 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4639a786-7f63-43fa-8699-f286f646e56d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:20.673647 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4639a786-7f63-43fa-8699-f286f646e56d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:20.690685 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-f9773df6-785d-4dc6-bacc-7239f8f73df5 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb3421bc9494914bc5f797b15a55643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31af2a6b9424f168dd6084d8d5fd0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:05:20.700422 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f9773df6-785d-4dc6-bacc-7239f8f73df5 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/8f58ad6d-0fd5-48c7-a969-c7b6503d639b" status: 200 len: 1494 microversion: 2.1 time: 0.204482 Jan 15 21:05:20.701060 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2594/5192] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:05:20 2022] GET /compute/v2.1/servers/8f58ad6d-0fd5-48c7-a969-c7b6503d639b => generated 1494 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:05:20.715738 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-1f23ee5f-b591-4690-9516-b23fa5c871a5 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:05:20.717114 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-1f23ee5f-b591-4690-9516-b23fa5c871a5 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: df405782-02e0-4416-9c91-818ea05dacaf] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:20.723930 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1f23ee5f-b591-4690-9516-b23fa5c871a5 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:20.724590 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1f23ee5f-b591-4690-9516-b23fa5c871a5 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:20.725738 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1f23ee5f-b591-4690-9516-b23fa5c871a5 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:20.726356 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1f23ee5f-b591-4690-9516-b23fa5c871a5 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:20.758471 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-4639a786-7f63-43fa-8699-f286f646e56d tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.101592 Jan 15 21:05:20.759948 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2599/5193] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:20 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:05:20.765959 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4927739f-4b07-488f-b766-35c0e80ba079 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:20.767957 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-4927739f-4b07-488f-b766-35c0e80ba079 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:20.777463 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4927739f-4b07-488f-b766-35c0e80ba079 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:20.777997 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4927739f-4b07-488f-b766-35c0e80ba079 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:20.779200 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4927739f-4b07-488f-b766-35c0e80ba079 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:20.779846 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4927739f-4b07-488f-b766-35c0e80ba079 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:20.836103 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-4927739f-4b07-488f-b766-35c0e80ba079 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.075043 Jan 15 21:05:20.838434 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2600/5194] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:20 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:05:20.843809 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d20aa74c-9a7c-4557-8322-ed64b1512133 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:20.844810 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-d20aa74c-9a7c-4557-8322-ed64b1512133 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: d9db70df-9ffc-4b96-af06-a56b3b35ce91] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:20.851822 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d20aa74c-9a7c-4557-8322-ed64b1512133 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:20.852283 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d20aa74c-9a7c-4557-8322-ed64b1512133 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:20.854324 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d20aa74c-9a7c-4557-8322-ed64b1512133 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:20.854787 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d20aa74c-9a7c-4557-8322-ed64b1512133 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:20.890172 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-1f23ee5f-b591-4690-9516-b23fa5c871a5 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:05:20.897912 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-1f23ee5f-b591-4690-9516-b23fa5c871a5 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/df405782-02e0-4416-9c91-818ea05dacaf" status: 200 len: 1506 microversion: 2.1 time: 0.190776 Jan 15 21:05:20.898514 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2595/5195] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:05:20 2022] GET /compute/v2.1/servers/df405782-02e0-4416-9c91-818ea05dacaf => generated 1506 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:05:20.914114 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d20aa74c-9a7c-4557-8322-ed64b1512133 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action" status: 200 len: 16402 microversion: 2.1 time: 0.074251 Jan 15 21:05:20.915019 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2601/5196] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:05:20 2022] POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action => generated 16402 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:05:21.101306 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-f2f29974-c521-4fde-8f41-c7245186b5fc req-abc16c09-5db3-4c91-827b-6f417ed6c305 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f58ad6d-0fd5-48c7-a969-c7b6503d639b", "name": "network-vif-deleted", "tag": "c695182a-5eaa-4429-881b-c572b04713b6"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:21.104506 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:05:21.104506 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:05:21.130366 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-f2f29974-c521-4fde-8f41-c7245186b5fc req-abc16c09-5db3-4c91-827b-6f417ed6c305 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:21.132165 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-f2f29974-c521-4fde-8f41-c7245186b5fc req-abc16c09-5db3-4c91-827b-6f417ed6c305 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:21.149944 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-f2f29974-c521-4fde-8f41-c7245186b5fc req-abc16c09-5db3-4c91-827b-6f417ed6c305 service nova] Creating event network-vif-deleted:c695182a-5eaa-4429-881b-c572b04713b6 for instance 8f58ad6d-0fd5-48c7-a969-c7b6503d639b on nch1-master-1 Jan 15 21:05:21.157956 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-f2f29974-c521-4fde-8f41-c7245186b5fc req-abc16c09-5db3-4c91-827b-6f417ed6c305 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059431 Jan 15 21:05:21.159205 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2596/5197] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:05:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:05:21.659140 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a192a28e-f164-44bb-b6d2-8b8525934dd0 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:21.660158 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a192a28e-f164-44bb-b6d2-8b8525934dd0 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:21.667800 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a192a28e-f164-44bb-b6d2-8b8525934dd0 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:21.669140 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a192a28e-f164-44bb-b6d2-8b8525934dd0 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:21.669422 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a192a28e-f164-44bb-b6d2-8b8525934dd0 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:21.669856 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a192a28e-f164-44bb-b6d2-8b8525934dd0 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:21.716121 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a192a28e-f164-44bb-b6d2-8b8525934dd0 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action" status: 200 len: 32638 microversion: 2.20 time: 0.060887 Jan 15 21:05:21.716810 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2602/5198] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:21 2022] POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action => generated 32638 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:05:21.720777 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9f0d9734-2d1c-4fae-99b7-032b28cc1be8 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:05:21.722924 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-9f0d9734-2d1c-4fae-99b7-032b28cc1be8 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: 8f58ad6d-0fd5-48c7-a969-c7b6503d639b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:21.731253 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9f0d9734-2d1c-4fae-99b7-032b28cc1be8 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:21.731977 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9f0d9734-2d1c-4fae-99b7-032b28cc1be8 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:21.733038 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9f0d9734-2d1c-4fae-99b7-032b28cc1be8 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:21.733709 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9f0d9734-2d1c-4fae-99b7-032b28cc1be8 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:21.751161 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-9f0d9734-2d1c-4fae-99b7-032b28cc1be8 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] HTTP exception thrown: Instance 8f58ad6d-0fd5-48c7-a969-c7b6503d639b could not be found. Jan 15 21:05:21.751916 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9f0d9734-2d1c-4fae-99b7-032b28cc1be8 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Returning 404 to user: Instance 8f58ad6d-0fd5-48c7-a969-c7b6503d639b could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:05:21.752901 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-9f0d9734-2d1c-4fae-99b7-032b28cc1be8 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/8f58ad6d-0fd5-48c7-a969-c7b6503d639b" status: 404 len: 111 microversion: 2.1 time: 0.038535 Jan 15 21:05:21.753584 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2597/5199] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:05:21 2022] GET /compute/v2.1/servers/8f58ad6d-0fd5-48c7-a969-c7b6503d639b => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:05:21.772474 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-52d33d4d-dd98-4605-89e8-80207000075b tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:21.773835 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-52d33d4d-dd98-4605-89e8-80207000075b tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:21.776167 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-6a1c59a4-6f5b-4eb8-aace-110fbeea9963 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:05:21.776447 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-6a1c59a4-6f5b-4eb8-aace-110fbeea9963 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: 8f58ad6d-0fd5-48c7-a969-c7b6503d639b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:21.782363 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-52d33d4d-dd98-4605-89e8-80207000075b tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:21.782971 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-52d33d4d-dd98-4605-89e8-80207000075b tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:21.784062 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-52d33d4d-dd98-4605-89e8-80207000075b tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:21.784577 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-52d33d4d-dd98-4605-89e8-80207000075b tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:21.785916 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6a1c59a4-6f5b-4eb8-aace-110fbeea9963 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:21.786074 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6a1c59a4-6f5b-4eb8-aace-110fbeea9963 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:21.787113 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6a1c59a4-6f5b-4eb8-aace-110fbeea9963 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:21.788109 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6a1c59a4-6f5b-4eb8-aace-110fbeea9963 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:21.805641 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-6a1c59a4-6f5b-4eb8-aace-110fbeea9963 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] HTTP exception thrown: Instance 8f58ad6d-0fd5-48c7-a969-c7b6503d639b could not be found. Jan 15 21:05:21.806407 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-6a1c59a4-6f5b-4eb8-aace-110fbeea9963 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Returning 404 to user: Instance 8f58ad6d-0fd5-48c7-a969-c7b6503d639b could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:05:21.809079 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-6a1c59a4-6f5b-4eb8-aace-110fbeea9963 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "DELETE /compute/v2.1/servers/8f58ad6d-0fd5-48c7-a969-c7b6503d639b" status: 404 len: 111 microversion: 2.1 time: 0.038608 Jan 15 21:05:21.809941 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2598/5200] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 21:05:21 2022] DELETE /compute/v2.1/servers/8f58ad6d-0fd5-48c7-a969-c7b6503d639b => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:05:21.817839 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-11b3672e-c83b-4d7f-b4f3-bffecf2ec34d tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:05:21.818538 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-11b3672e-c83b-4d7f-b4f3-bffecf2ec34d tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: 8f58ad6d-0fd5-48c7-a969-c7b6503d639b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:21.824569 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-11b3672e-c83b-4d7f-b4f3-bffecf2ec34d tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:21.825143 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-11b3672e-c83b-4d7f-b4f3-bffecf2ec34d tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:21.826181 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-11b3672e-c83b-4d7f-b4f3-bffecf2ec34d tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:21.826704 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-11b3672e-c83b-4d7f-b4f3-bffecf2ec34d tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:21.843820 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-11b3672e-c83b-4d7f-b4f3-bffecf2ec34d tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] HTTP exception thrown: Instance 8f58ad6d-0fd5-48c7-a969-c7b6503d639b could not be found. Jan 15 21:05:21.844424 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-11b3672e-c83b-4d7f-b4f3-bffecf2ec34d tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Returning 404 to user: Instance 8f58ad6d-0fd5-48c7-a969-c7b6503d639b could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:05:21.845293 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-11b3672e-c83b-4d7f-b4f3-bffecf2ec34d tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/8f58ad6d-0fd5-48c7-a969-c7b6503d639b" status: 404 len: 111 microversion: 2.1 time: 0.031139 Jan 15 21:05:21.846195 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2599/5201] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:05:21 2022] GET /compute/v2.1/servers/8f58ad6d-0fd5-48c7-a969-c7b6503d639b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:05:21.850450 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-52d33d4d-dd98-4605-89e8-80207000075b tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.082593 Jan 15 21:05:21.852079 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2603/5202] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:21 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:05:21.853384 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9d211874-b098-4801-9e66-2c75e40a8cfd tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:21.855108 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-9d211874-b098-4801-9e66-2c75e40a8cfd tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:21.858694 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-69bfcad0-6b73-41dc-88dd-2d32b6dd2fda tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:05:21.859529 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-69bfcad0-6b73-41dc-88dd-2d32b6dd2fda tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: 119c04bf-8692-4880-bea0-bc41ec4600de] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:21.861764 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9d211874-b098-4801-9e66-2c75e40a8cfd tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:21.862215 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9d211874-b098-4801-9e66-2c75e40a8cfd tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:21.863409 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9d211874-b098-4801-9e66-2c75e40a8cfd tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:21.863858 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9d211874-b098-4801-9e66-2c75e40a8cfd tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:21.867106 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-69bfcad0-6b73-41dc-88dd-2d32b6dd2fda tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:21.867643 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-69bfcad0-6b73-41dc-88dd-2d32b6dd2fda tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:21.868639 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-69bfcad0-6b73-41dc-88dd-2d32b6dd2fda tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:21.870090 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-69bfcad0-6b73-41dc-88dd-2d32b6dd2fda tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:21.884292 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-69bfcad0-6b73-41dc-88dd-2d32b6dd2fda tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] HTTP exception thrown: Instance 119c04bf-8692-4880-bea0-bc41ec4600de could not be found. Jan 15 21:05:21.885268 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-69bfcad0-6b73-41dc-88dd-2d32b6dd2fda tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Returning 404 to user: Instance 119c04bf-8692-4880-bea0-bc41ec4600de could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:05:21.886368 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-69bfcad0-6b73-41dc-88dd-2d32b6dd2fda tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "DELETE /compute/v2.1/servers/119c04bf-8692-4880-bea0-bc41ec4600de" status: 404 len: 111 microversion: 2.1 time: 0.032940 Jan 15 21:05:21.887195 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2604/5203] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 21:05:21 2022] DELETE /compute/v2.1/servers/119c04bf-8692-4880-bea0-bc41ec4600de => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:05:21.894526 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f9e82bf0-30b4-44dc-87e5-51ad9be8b50a tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:05:21.895239 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f9e82bf0-30b4-44dc-87e5-51ad9be8b50a tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: 119c04bf-8692-4880-bea0-bc41ec4600de] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:21.902097 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f9e82bf0-30b4-44dc-87e5-51ad9be8b50a tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:21.902588 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f9e82bf0-30b4-44dc-87e5-51ad9be8b50a tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:21.903378 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f9e82bf0-30b4-44dc-87e5-51ad9be8b50a tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:21.903821 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f9e82bf0-30b4-44dc-87e5-51ad9be8b50a tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:21.910194 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-9d211874-b098-4801-9e66-2c75e40a8cfd tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.060045 Jan 15 21:05:21.911394 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2600/5204] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:21 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:05:21.916778 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-0e5df759-8c98-4ec9-b2f6-a6b92b7550d5 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:05:21.917552 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-0e5df759-8c98-4ec9-b2f6-a6b92b7550d5 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: df405782-02e0-4416-9c91-818ea05dacaf] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:21.922090 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-f9e82bf0-30b4-44dc-87e5-51ad9be8b50a tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] HTTP exception thrown: Instance 119c04bf-8692-4880-bea0-bc41ec4600de could not be found. Jan 15 21:05:21.922687 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f9e82bf0-30b4-44dc-87e5-51ad9be8b50a tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Returning 404 to user: Instance 119c04bf-8692-4880-bea0-bc41ec4600de could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:05:21.923528 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f9e82bf0-30b4-44dc-87e5-51ad9be8b50a tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/119c04bf-8692-4880-bea0-bc41ec4600de" status: 404 len: 111 microversion: 2.1 time: 0.032423 Jan 15 21:05:21.924219 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2605/5205] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:05:21 2022] GET /compute/v2.1/servers/119c04bf-8692-4880-bea0-bc41ec4600de => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 15 21:05:21.926449 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0e5df759-8c98-4ec9-b2f6-a6b92b7550d5 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:21.927077 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0e5df759-8c98-4ec9-b2f6-a6b92b7550d5 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:21.928127 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0e5df759-8c98-4ec9-b2f6-a6b92b7550d5 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:21.928581 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0e5df759-8c98-4ec9-b2f6-a6b92b7550d5 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:21.928713 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d219e425-548f-400b-bfdd-620ea6afb7a6 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:21.929617 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-d219e425-548f-400b-bfdd-620ea6afb7a6 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: d9db70df-9ffc-4b96-af06-a56b3b35ce91] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:21.937163 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d219e425-548f-400b-bfdd-620ea6afb7a6 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:21.938327 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d219e425-548f-400b-bfdd-620ea6afb7a6 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:21.939126 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d219e425-548f-400b-bfdd-620ea6afb7a6 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:21.939568 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d219e425-548f-400b-bfdd-620ea6afb7a6 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:21.980772 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d219e425-548f-400b-bfdd-620ea6afb7a6 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action" status: 200 len: 16402 microversion: 2.1 time: 0.055146 Jan 15 21:05:21.981762 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2606/5206] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:05:21 2022] POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action => generated 16402 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:05:21.987047 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-02db4298-25d2-47fd-9f82-a684f68a3948 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:05:21.987638 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-02db4298-25d2-47fd-9f82-a684f68a3948 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: b6942f26-7967-4574-9f6e-9a42a7c66a3b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:21.995741 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-02db4298-25d2-47fd-9f82-a684f68a3948 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:21.996201 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-02db4298-25d2-47fd-9f82-a684f68a3948 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:21.997030 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-02db4298-25d2-47fd-9f82-a684f68a3948 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:21.997492 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-02db4298-25d2-47fd-9f82-a684f68a3948 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:22.012048 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-02db4298-25d2-47fd-9f82-a684f68a3948 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] HTTP exception thrown: Instance b6942f26-7967-4574-9f6e-9a42a7c66a3b could not be found. Jan 15 21:05:22.012660 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-02db4298-25d2-47fd-9f82-a684f68a3948 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Returning 404 to user: Instance b6942f26-7967-4574-9f6e-9a42a7c66a3b could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:05:22.013525 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-02db4298-25d2-47fd-9f82-a684f68a3948 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "DELETE /compute/v2.1/servers/b6942f26-7967-4574-9f6e-9a42a7c66a3b" status: 404 len: 111 microversion: 2.1 time: 0.030744 Jan 15 21:05:22.014085 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2607/5207] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 21:05:21 2022] DELETE /compute/v2.1/servers/b6942f26-7967-4574-9f6e-9a42a7c66a3b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:05:22.022351 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-66a274d4-7710-49f6-b9d1-895444d2a6bd tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:05:22.022964 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-66a274d4-7710-49f6-b9d1-895444d2a6bd tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: b6942f26-7967-4574-9f6e-9a42a7c66a3b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:22.029381 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-66a274d4-7710-49f6-b9d1-895444d2a6bd tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:22.030050 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-66a274d4-7710-49f6-b9d1-895444d2a6bd tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:22.030616 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-66a274d4-7710-49f6-b9d1-895444d2a6bd tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:22.031062 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-66a274d4-7710-49f6-b9d1-895444d2a6bd tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:22.053037 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-66a274d4-7710-49f6-b9d1-895444d2a6bd tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] HTTP exception thrown: Instance b6942f26-7967-4574-9f6e-9a42a7c66a3b could not be found. Jan 15 21:05:22.053643 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-66a274d4-7710-49f6-b9d1-895444d2a6bd tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Returning 404 to user: Instance b6942f26-7967-4574-9f6e-9a42a7c66a3b could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:05:22.054483 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-66a274d4-7710-49f6-b9d1-895444d2a6bd tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/b6942f26-7967-4574-9f6e-9a42a7c66a3b" status: 404 len: 111 microversion: 2.1 time: 0.035592 Jan 15 21:05:22.055044 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2608/5208] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:05:22 2022] GET /compute/v2.1/servers/b6942f26-7967-4574-9f6e-9a42a7c66a3b => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 15 21:05:22.063828 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d36a28a3-ba16-4d33-b1a7-e0b2008679aa tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:05:22.064317 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-d36a28a3-ba16-4d33-b1a7-e0b2008679aa tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: ab35ab75-5c67-40f1-96d6-eb5220405c13] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:22.071853 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d36a28a3-ba16-4d33-b1a7-e0b2008679aa tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:22.073322 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d36a28a3-ba16-4d33-b1a7-e0b2008679aa tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:22.074288 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d36a28a3-ba16-4d33-b1a7-e0b2008679aa tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:22.074903 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d36a28a3-ba16-4d33-b1a7-e0b2008679aa tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:22.091030 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-d36a28a3-ba16-4d33-b1a7-e0b2008679aa tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] HTTP exception thrown: Instance ab35ab75-5c67-40f1-96d6-eb5220405c13 could not be found. Jan 15 21:05:22.091634 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d36a28a3-ba16-4d33-b1a7-e0b2008679aa tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Returning 404 to user: Instance ab35ab75-5c67-40f1-96d6-eb5220405c13 could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:05:22.092476 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d36a28a3-ba16-4d33-b1a7-e0b2008679aa tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "DELETE /compute/v2.1/servers/ab35ab75-5c67-40f1-96d6-eb5220405c13" status: 404 len: 111 microversion: 2.1 time: 0.032577 Jan 15 21:05:22.093402 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2609/5209] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 21:05:22 2022] DELETE /compute/v2.1/servers/ab35ab75-5c67-40f1-96d6-eb5220405c13 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:05:22.100050 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-0e5df759-8c98-4ec9-b2f6-a6b92b7550d5 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:05:22.101045 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-eb51b822-28c2-4540-9cdd-516adc7278ec tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:05:22.101788 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-eb51b822-28c2-4540-9cdd-516adc7278ec tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: ab35ab75-5c67-40f1-96d6-eb5220405c13] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:22.111006 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-eb51b822-28c2-4540-9cdd-516adc7278ec tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:22.111700 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-eb51b822-28c2-4540-9cdd-516adc7278ec tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:22.112473 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-0e5df759-8c98-4ec9-b2f6-a6b92b7550d5 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/df405782-02e0-4416-9c91-818ea05dacaf" status: 200 len: 1506 microversion: 2.1 time: 0.200239 Jan 15 21:05:22.112705 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-eb51b822-28c2-4540-9cdd-516adc7278ec tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:22.113225 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-eb51b822-28c2-4540-9cdd-516adc7278ec tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:22.114623 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2601/5210] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:05:21 2022] GET /compute/v2.1/servers/df405782-02e0-4416-9c91-818ea05dacaf => generated 1506 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:05:22.129212 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-eb51b822-28c2-4540-9cdd-516adc7278ec tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] HTTP exception thrown: Instance ab35ab75-5c67-40f1-96d6-eb5220405c13 could not be found. Jan 15 21:05:22.129810 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-eb51b822-28c2-4540-9cdd-516adc7278ec tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Returning 404 to user: Instance ab35ab75-5c67-40f1-96d6-eb5220405c13 could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:05:22.130834 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-eb51b822-28c2-4540-9cdd-516adc7278ec tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/ab35ab75-5c67-40f1-96d6-eb5220405c13" status: 404 len: 111 microversion: 2.1 time: 0.033617 Jan 15 21:05:22.131378 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2610/5211] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:05:22 2022] GET /compute/v2.1/servers/ab35ab75-5c67-40f1-96d6-eb5220405c13 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 15 21:05:22.139511 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-51a6e156-09ef-4606-9451-abae3b3877a9 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:05:22.140103 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-51a6e156-09ef-4606-9451-abae3b3877a9 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: bdf3b234-dc0e-4ad2-b0a4-3aaa618bfe73] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:22.146477 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-51a6e156-09ef-4606-9451-abae3b3877a9 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:22.147009 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-51a6e156-09ef-4606-9451-abae3b3877a9 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:22.147885 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-51a6e156-09ef-4606-9451-abae3b3877a9 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:22.148398 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-51a6e156-09ef-4606-9451-abae3b3877a9 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:22.163352 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-51a6e156-09ef-4606-9451-abae3b3877a9 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] HTTP exception thrown: Instance bdf3b234-dc0e-4ad2-b0a4-3aaa618bfe73 could not be found. Jan 15 21:05:22.164048 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-51a6e156-09ef-4606-9451-abae3b3877a9 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Returning 404 to user: Instance bdf3b234-dc0e-4ad2-b0a4-3aaa618bfe73 could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:05:22.164996 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-51a6e156-09ef-4606-9451-abae3b3877a9 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "DELETE /compute/v2.1/servers/bdf3b234-dc0e-4ad2-b0a4-3aaa618bfe73" status: 404 len: 111 microversion: 2.1 time: 0.029205 Jan 15 21:05:22.165868 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2602/5212] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 21:05:22 2022] DELETE /compute/v2.1/servers/bdf3b234-dc0e-4ad2-b0a4-3aaa618bfe73 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 15 21:05:22.177690 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1aa8185b-3402-4628-8b8a-f7f7edc1d00f tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:05:22.179002 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-1aa8185b-3402-4628-8b8a-f7f7edc1d00f tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: bdf3b234-dc0e-4ad2-b0a4-3aaa618bfe73] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:22.189988 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1aa8185b-3402-4628-8b8a-f7f7edc1d00f tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:22.190438 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1aa8185b-3402-4628-8b8a-f7f7edc1d00f tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:22.191670 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1aa8185b-3402-4628-8b8a-f7f7edc1d00f tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:22.192124 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1aa8185b-3402-4628-8b8a-f7f7edc1d00f tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:22.209998 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-1aa8185b-3402-4628-8b8a-f7f7edc1d00f tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] HTTP exception thrown: Instance bdf3b234-dc0e-4ad2-b0a4-3aaa618bfe73 could not be found. Jan 15 21:05:22.210615 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1aa8185b-3402-4628-8b8a-f7f7edc1d00f tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Returning 404 to user: Instance bdf3b234-dc0e-4ad2-b0a4-3aaa618bfe73 could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:05:22.212108 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-1aa8185b-3402-4628-8b8a-f7f7edc1d00f tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/bdf3b234-dc0e-4ad2-b0a4-3aaa618bfe73" status: 404 len: 111 microversion: 2.1 time: 0.040169 Jan 15 21:05:22.213552 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2611/5213] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:05:22 2022] GET /compute/v2.1/servers/bdf3b234-dc0e-4ad2-b0a4-3aaa618bfe73 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:05:22.221999 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-511c72a9-c354-4ea2-a06e-4a5271bd0de9 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:05:22.222518 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-511c72a9-c354-4ea2-a06e-4a5271bd0de9 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: 5a31d952-72c7-4a45-bc31-46cef41d4b53] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:22.230528 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-511c72a9-c354-4ea2-a06e-4a5271bd0de9 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:22.231126 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-511c72a9-c354-4ea2-a06e-4a5271bd0de9 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:22.232147 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-511c72a9-c354-4ea2-a06e-4a5271bd0de9 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:22.232797 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-511c72a9-c354-4ea2-a06e-4a5271bd0de9 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:22.248069 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-511c72a9-c354-4ea2-a06e-4a5271bd0de9 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] HTTP exception thrown: Instance 5a31d952-72c7-4a45-bc31-46cef41d4b53 could not be found. Jan 15 21:05:22.248803 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-511c72a9-c354-4ea2-a06e-4a5271bd0de9 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Returning 404 to user: Instance 5a31d952-72c7-4a45-bc31-46cef41d4b53 could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:05:22.249906 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-511c72a9-c354-4ea2-a06e-4a5271bd0de9 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "DELETE /compute/v2.1/servers/5a31d952-72c7-4a45-bc31-46cef41d4b53" status: 404 len: 111 microversion: 2.1 time: 0.032110 Jan 15 21:05:22.250638 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2603/5214] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 21:05:22 2022] DELETE /compute/v2.1/servers/5a31d952-72c7-4a45-bc31-46cef41d4b53 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:05:22.258566 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4bc2033a-80d9-48e0-9274-bf8b521c598d tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:05:22.259173 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-4bc2033a-80d9-48e0-9274-bf8b521c598d tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: 5a31d952-72c7-4a45-bc31-46cef41d4b53] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:22.265374 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4bc2033a-80d9-48e0-9274-bf8b521c598d tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:22.265829 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4bc2033a-80d9-48e0-9274-bf8b521c598d tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:22.266610 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4bc2033a-80d9-48e0-9274-bf8b521c598d tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:22.267052 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4bc2033a-80d9-48e0-9274-bf8b521c598d tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:22.281173 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-4bc2033a-80d9-48e0-9274-bf8b521c598d tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] HTTP exception thrown: Instance 5a31d952-72c7-4a45-bc31-46cef41d4b53 could not be found. Jan 15 21:05:22.281759 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4bc2033a-80d9-48e0-9274-bf8b521c598d tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Returning 404 to user: Instance 5a31d952-72c7-4a45-bc31-46cef41d4b53 could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:05:22.282578 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-4bc2033a-80d9-48e0-9274-bf8b521c598d tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/5a31d952-72c7-4a45-bc31-46cef41d4b53" status: 404 len: 111 microversion: 2.1 time: 0.027721 Jan 15 21:05:22.283122 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2612/5215] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:05:22 2022] GET /compute/v2.1/servers/5a31d952-72c7-4a45-bc31-46cef41d4b53 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 15 21:05:22.291755 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-6d1be460-16e3-449d-aad6-e9543bd135df tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:05:22.292348 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-6d1be460-16e3-449d-aad6-e9543bd135df tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: 3ddece38-eaf4-4f3a-8f5e-5663727f8574] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:22.298226 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-6d1be460-16e3-449d-aad6-e9543bd135df tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] HTTP exception thrown: Instance 3ddece38-eaf4-4f3a-8f5e-5663727f8574 could not be found. Jan 15 21:05:22.298966 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-6d1be460-16e3-449d-aad6-e9543bd135df tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Returning 404 to user: Instance 3ddece38-eaf4-4f3a-8f5e-5663727f8574 could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:05:22.299765 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-6d1be460-16e3-449d-aad6-e9543bd135df tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "DELETE /compute/v2.1/servers/3ddece38-eaf4-4f3a-8f5e-5663727f8574" status: 404 len: 111 microversion: 2.1 time: 0.012440 Jan 15 21:05:22.300279 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2604/5216] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 21:05:22 2022] DELETE /compute/v2.1/servers/3ddece38-eaf4-4f3a-8f5e-5663727f8574 => generated 111 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:05:22.307901 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-92985ef7-e48a-4f77-8476-1c946a644a7f tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:05:22.308562 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-92985ef7-e48a-4f77-8476-1c946a644a7f tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: 3ddece38-eaf4-4f3a-8f5e-5663727f8574] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:22.314416 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-92985ef7-e48a-4f77-8476-1c946a644a7f tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] HTTP exception thrown: Instance 3ddece38-eaf4-4f3a-8f5e-5663727f8574 could not be found. Jan 15 21:05:22.314986 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-92985ef7-e48a-4f77-8476-1c946a644a7f tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Returning 404 to user: Instance 3ddece38-eaf4-4f3a-8f5e-5663727f8574 could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:05:22.315789 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-92985ef7-e48a-4f77-8476-1c946a644a7f tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/3ddece38-eaf4-4f3a-8f5e-5663727f8574" status: 404 len: 111 microversion: 2.1 time: 0.011632 Jan 15 21:05:22.316308 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2613/5217] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:05:22 2022] GET /compute/v2.1/servers/3ddece38-eaf4-4f3a-8f5e-5663727f8574 => generated 111 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 15 21:05:22.324090 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c1fd58fa-2548-4ce6-bdc2-263490918898 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:05:22.324891 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c1fd58fa-2548-4ce6-bdc2-263490918898 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: 9888e0ee-9a2f-4547-a6e3-c77d3493c63f] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:22.332266 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c1fd58fa-2548-4ce6-bdc2-263490918898 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:22.333029 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c1fd58fa-2548-4ce6-bdc2-263490918898 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:22.334124 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c1fd58fa-2548-4ce6-bdc2-263490918898 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:22.334751 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c1fd58fa-2548-4ce6-bdc2-263490918898 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:22.361893 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c1fd58fa-2548-4ce6-bdc2-263490918898 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: 9888e0ee-9a2f-4547-a6e3-c77d3493c63f] Going to try to terminate instance {{(pid=129365) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 21:05:22.437927 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c1fd58fa-2548-4ce6-bdc2-263490918898 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "DELETE /compute/v2.1/servers/9888e0ee-9a2f-4547-a6e3-c77d3493c63f" status: 204 len: 0 microversion: 2.1 time: 0.117349 Jan 15 21:05:22.438868 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2605/5218] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 21:05:22 2022] DELETE /compute/v2.1/servers/9888e0ee-9a2f-4547-a6e3-c77d3493c63f => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 21:05:22.446678 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-6e9ac287-4c35-4229-82ad-15ef78ee5398 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:05:22.447469 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-6e9ac287-4c35-4229-82ad-15ef78ee5398 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: 9888e0ee-9a2f-4547-a6e3-c77d3493c63f] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:22.455761 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6e9ac287-4c35-4229-82ad-15ef78ee5398 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:22.456209 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6e9ac287-4c35-4229-82ad-15ef78ee5398 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:22.457035 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6e9ac287-4c35-4229-82ad-15ef78ee5398 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:22.457472 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6e9ac287-4c35-4229-82ad-15ef78ee5398 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:22.599902 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-6e9ac287-4c35-4229-82ad-15ef78ee5398 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb3421bc9494914bc5f797b15a55643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31af2a6b9424f168dd6084d8d5fd0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:05:22.607363 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-6e9ac287-4c35-4229-82ad-15ef78ee5398 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/9888e0ee-9a2f-4547-a6e3-c77d3493c63f" status: 200 len: 1480 microversion: 2.1 time: 0.164343 Jan 15 21:05:22.607946 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2614/5219] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:05:22 2022] GET /compute/v2.1/servers/9888e0ee-9a2f-4547-a6e3-c77d3493c63f => generated 1480 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:05:22.729061 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e5681089-3009-4717-bb3f-f4c4fbc65527 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:22.730082 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e5681089-3009-4717-bb3f-f4c4fbc65527 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:22.736924 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e5681089-3009-4717-bb3f-f4c4fbc65527 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:22.737374 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e5681089-3009-4717-bb3f-f4c4fbc65527 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:22.738144 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e5681089-3009-4717-bb3f-f4c4fbc65527 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:22.738574 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e5681089-3009-4717-bb3f-f4c4fbc65527 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:22.783125 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e5681089-3009-4717-bb3f-f4c4fbc65527 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action" status: 200 len: 32638 microversion: 2.20 time: 0.058208 Jan 15 21:05:22.787230 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2606/5220] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:22 2022] POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action => generated 32638 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:05:22.862649 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0cd4d686-473f-4e8f-ac47-37749015affd tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:22.863486 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-0cd4d686-473f-4e8f-ac47-37749015affd tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:22.870617 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0cd4d686-473f-4e8f-ac47-37749015affd tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:22.871077 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0cd4d686-473f-4e8f-ac47-37749015affd tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:22.871893 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0cd4d686-473f-4e8f-ac47-37749015affd tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:22.872339 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0cd4d686-473f-4e8f-ac47-37749015affd tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:22.914923 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0cd4d686-473f-4e8f-ac47-37749015affd tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.055999 Jan 15 21:05:22.915855 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2615/5221] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:22 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:05:22.923667 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-0a09b308-7d7f-4abc-b316-f570a1572c6d tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:22.924671 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-0a09b308-7d7f-4abc-b316-f570a1572c6d tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:22.932629 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0a09b308-7d7f-4abc-b316-f570a1572c6d tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:22.932894 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0a09b308-7d7f-4abc-b316-f570a1572c6d tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:22.933683 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0a09b308-7d7f-4abc-b316-f570a1572c6d tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:22.934124 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0a09b308-7d7f-4abc-b316-f570a1572c6d tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:22.975559 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-0a09b308-7d7f-4abc-b316-f570a1572c6d tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.055847 Jan 15 21:05:22.976425 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2607/5222] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:22 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:05:22.991902 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-85be45b2-7dd8-473c-905b-3c8d8e6231bf tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:22.993037 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-85be45b2-7dd8-473c-905b-3c8d8e6231bf tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: d9db70df-9ffc-4b96-af06-a56b3b35ce91] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:23.000911 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-85be45b2-7dd8-473c-905b-3c8d8e6231bf tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:23.001470 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-85be45b2-7dd8-473c-905b-3c8d8e6231bf tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:23.002312 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-85be45b2-7dd8-473c-905b-3c8d8e6231bf tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:23.002819 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-85be45b2-7dd8-473c-905b-3c8d8e6231bf tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:23.043832 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-85be45b2-7dd8-473c-905b-3c8d8e6231bf tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action" status: 200 len: 16402 microversion: 2.1 time: 0.055581 Jan 15 21:05:23.044666 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2616/5223] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:05:22 2022] POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action => generated 16402 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:05:23.136578 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-eea81bce-3faf-4040-b310-5b093efed81e tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:05:23.137248 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-eea81bce-3faf-4040-b310-5b093efed81e tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: df405782-02e0-4416-9c91-818ea05dacaf] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:23.144195 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-eea81bce-3faf-4040-b310-5b093efed81e tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:23.144639 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-eea81bce-3faf-4040-b310-5b093efed81e tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:23.145448 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-eea81bce-3faf-4040-b310-5b093efed81e tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:23.145887 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-eea81bce-3faf-4040-b310-5b093efed81e tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:23.290172 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-eea81bce-3faf-4040-b310-5b093efed81e tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:05:23.298593 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-eea81bce-3faf-4040-b310-5b093efed81e tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/df405782-02e0-4416-9c91-818ea05dacaf" status: 200 len: 1449 microversion: 2.1 time: 0.167593 Jan 15 21:05:23.299163 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2608/5224] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:05:23 2022] GET /compute/v2.1/servers/df405782-02e0-4416-9c91-818ea05dacaf => generated 1449 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:05:23.315728 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b287ab0a-548c-4e5d-a11c-6386c715806f tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:05:23.316458 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b287ab0a-548c-4e5d-a11c-6386c715806f tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:23.323582 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b287ab0a-548c-4e5d-a11c-6386c715806f tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:23.324028 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b287ab0a-548c-4e5d-a11c-6386c715806f tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:23.324799 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b287ab0a-548c-4e5d-a11c-6386c715806f tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:23.325258 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b287ab0a-548c-4e5d-a11c-6386c715806f tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:23.471372 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-b287ab0a-548c-4e5d-a11c-6386c715806f tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:05:23.480590 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b287ab0a-548c-4e5d-a11c-6386c715806f tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9" status: 200 len: 1670 microversion: 2.1 time: 0.168705 Jan 15 21:05:23.481566 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2617/5225] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:05:23 2022] GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9 => generated 1670 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:05:23.504780 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-659b1a3b-b05a-4075-9d0b-c8cc8258f5a2 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:05:23.505571 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-659b1a3b-b05a-4075-9d0b-c8cc8258f5a2 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:23.513823 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-659b1a3b-b05a-4075-9d0b-c8cc8258f5a2 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:23.514417 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-659b1a3b-b05a-4075-9d0b-c8cc8258f5a2 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:23.515309 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-659b1a3b-b05a-4075-9d0b-c8cc8258f5a2 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:23.515840 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-659b1a3b-b05a-4075-9d0b-c8cc8258f5a2 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:23.625858 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1a9ff9ea-a308-4d3c-947c-ed930bc1bebb tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:05:23.626529 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-1a9ff9ea-a308-4d3c-947c-ed930bc1bebb tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: 9888e0ee-9a2f-4547-a6e3-c77d3493c63f] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:23.632938 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1a9ff9ea-a308-4d3c-947c-ed930bc1bebb tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:23.633443 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1a9ff9ea-a308-4d3c-947c-ed930bc1bebb tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:23.634617 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1a9ff9ea-a308-4d3c-947c-ed930bc1bebb tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:23.635792 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1a9ff9ea-a308-4d3c-947c-ed930bc1bebb tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:23.654369 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-659b1a3b-b05a-4075-9d0b-c8cc8258f5a2 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:05:23.662767 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-659b1a3b-b05a-4075-9d0b-c8cc8258f5a2 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9" status: 200 len: 1670 microversion: 2.1 time: 0.162664 Jan 15 21:05:23.663547 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2609/5226] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:05:23 2022] GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9 => generated 1670 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:05:23.678754 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-4c89abda-1db9-4120-82e9-207d406502c5 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:23.685598 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4c89abda-1db9-4120-82e9-207d406502c5 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:23.686058 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4c89abda-1db9-4120-82e9-207d406502c5 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:23.711325 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-4c89abda-1db9-4120-82e9-207d406502c5 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Going to try to stop instance {{(pid=129365) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Jan 15 21:05:23.757195 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-4c89abda-1db9-4120-82e9-207d406502c5 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action" status: 202 len: 0 microversion: 2.1 time: 0.081805 Jan 15 21:05:23.762929 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2610/5227] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:05:23 2022] POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:05:23.768325 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-65871e5f-10e6-4608-949e-35443938bcb0 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:05:23.769325 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-65871e5f-10e6-4608-949e-35443938bcb0 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:23.776656 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-65871e5f-10e6-4608-949e-35443938bcb0 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:23.777503 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-65871e5f-10e6-4608-949e-35443938bcb0 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:23.778530 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-65871e5f-10e6-4608-949e-35443938bcb0 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:23.779240 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-65871e5f-10e6-4608-949e-35443938bcb0 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:23.781806 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-1a9ff9ea-a308-4d3c-947c-ed930bc1bebb tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb3421bc9494914bc5f797b15a55643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31af2a6b9424f168dd6084d8d5fd0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:05:23.790694 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-1a9ff9ea-a308-4d3c-947c-ed930bc1bebb tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/9888e0ee-9a2f-4547-a6e3-c77d3493c63f" status: 200 len: 1480 microversion: 2.1 time: 0.168835 Jan 15 21:05:23.800533 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2618/5228] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:05:23 2022] GET /compute/v2.1/servers/9888e0ee-9a2f-4547-a6e3-c77d3493c63f => generated 1480 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:05:23.804220 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-67b4e961-9d30-4aed-97ef-760cf6ffda1c tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:23.805692 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-67b4e961-9d30-4aed-97ef-760cf6ffda1c tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:23.812623 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-67b4e961-9d30-4aed-97ef-760cf6ffda1c tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:23.813216 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-67b4e961-9d30-4aed-97ef-760cf6ffda1c tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:23.814144 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-67b4e961-9d30-4aed-97ef-760cf6ffda1c tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:23.814672 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-67b4e961-9d30-4aed-97ef-760cf6ffda1c tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:23.858912 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-67b4e961-9d30-4aed-97ef-760cf6ffda1c tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action" status: 200 len: 32638 microversion: 2.20 time: 0.065348 Jan 15 21:05:23.860079 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2619/5229] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:23 2022] POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action => generated 32638 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:05:23.927851 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-65871e5f-10e6-4608-949e-35443938bcb0 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:05:23.928390 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c8fce199-e6a1-43d0-aae7-706d054b481b tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:23.929528 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c8fce199-e6a1-43d0-aae7-706d054b481b tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:23.937971 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c8fce199-e6a1-43d0-aae7-706d054b481b tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:23.938528 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c8fce199-e6a1-43d0-aae7-706d054b481b tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:23.939388 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c8fce199-e6a1-43d0-aae7-706d054b481b tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:23.939888 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c8fce199-e6a1-43d0-aae7-706d054b481b tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:23.945274 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-65871e5f-10e6-4608-949e-35443938bcb0 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9" status: 200 len: 1680 microversion: 2.1 time: 0.178653 Jan 15 21:05:23.953212 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2611/5230] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:05:23 2022] GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9 => generated 1680 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:05:23.987829 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5bf320db-9954-4bb9-bcd8-e046b3ffa057 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:23.988792 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-5bf320db-9954-4bb9-bcd8-e046b3ffa057 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:23.996297 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5bf320db-9954-4bb9-bcd8-e046b3ffa057 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:23.996979 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5bf320db-9954-4bb9-bcd8-e046b3ffa057 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:23.997765 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5bf320db-9954-4bb9-bcd8-e046b3ffa057 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:23.998203 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5bf320db-9954-4bb9-bcd8-e046b3ffa057 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:23.998987 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c8fce199-e6a1-43d0-aae7-706d054b481b tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action" status: 200 len: 40746 microversion: 2.42 time: 0.074798 Jan 15 21:05:24.004555 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2620/5231] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:23 2022] POST /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/action => generated 40746 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:05:24.010602 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8a1f84c4-084c-427a-a76d-f5d83a10f7c7 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:05:24.011572 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-8a1f84c4-084c-427a-a76d-f5d83a10f7c7 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:24.031945 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8a1f84c4-084c-427a-a76d-f5d83a10f7c7 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:24.032399 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8a1f84c4-084c-427a-a76d-f5d83a10f7c7 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:24.033245 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8a1f84c4-084c-427a-a76d-f5d83a10f7c7 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:24.033685 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8a1f84c4-084c-427a-a76d-f5d83a10f7c7 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:24.058253 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5bf320db-9954-4bb9-bcd8-e046b3ffa057 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.072717 Jan 15 21:05:24.063260 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2612/5232] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:23 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:05:24.077963 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-bd18640e-7741-40f8-8293-9b1df6b62ec4 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:24.079180 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-bd18640e-7741-40f8-8293-9b1df6b62ec4 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: d9db70df-9ffc-4b96-af06-a56b3b35ce91] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:24.091830 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bd18640e-7741-40f8-8293-9b1df6b62ec4 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:24.092282 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bd18640e-7741-40f8-8293-9b1df6b62ec4 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:24.093119 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bd18640e-7741-40f8-8293-9b1df6b62ec4 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:24.093553 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bd18640e-7741-40f8-8293-9b1df6b62ec4 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:24.158784 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-bd18640e-7741-40f8-8293-9b1df6b62ec4 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action" status: 200 len: 16402 microversion: 2.1 time: 0.092633 Jan 15 21:05:24.159965 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2613/5233] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:05:24 2022] POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action => generated 16402 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:05:24.325788 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-8a1f84c4-084c-427a-a76d-f5d83a10f7c7 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:05:24.337031 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-8a1f84c4-084c-427a-a76d-f5d83a10f7c7 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:05:24.339617 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-8a1f84c4-084c-427a-a76d-f5d83a10f7c7 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:05:24.341022 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-8a1f84c4-084c-427a-a76d-f5d83a10f7c7 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "GET /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee" status: 200 len: 2956 microversion: 2.42 time: 0.335078 Jan 15 21:05:24.365730 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2621/5234] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:05:24 2022] GET /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee => generated 2956 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:05:24.391525 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c847599a-0425-40f0-bb18-d1555eed5e58 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:05:24.392143 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c847599a-0425-40f0-bb18-d1555eed5e58 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:24.402614 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c847599a-0425-40f0-bb18-d1555eed5e58 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:24.403202 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c847599a-0425-40f0-bb18-d1555eed5e58 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:24.404104 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c847599a-0425-40f0-bb18-d1555eed5e58 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:24.404641 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c847599a-0425-40f0-bb18-d1555eed5e58 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:24.441669 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-1eff1749-639e-4ba9-9ff4-4c77068bdf6a req-6d1be789-d815-46cf-be77-36faa8d60d48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df405782-02e0-4416-9c91-818ea05dacaf", "name": "network-vif-unplugged", "status": "completed", "tag": "43dfb9cf-e68a-4c7c-b0c6-7b7fcd77dbf4"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:24.443243 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:05:24.443243 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:05:24.467626 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-1eff1749-639e-4ba9-9ff4-4c77068bdf6a req-6d1be789-d815-46cf-be77-36faa8d60d48 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:24.468067 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-1eff1749-639e-4ba9-9ff4-4c77068bdf6a req-6d1be789-d815-46cf-be77-36faa8d60d48 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:24.494716 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.compute.server_external_events [req-1eff1749-639e-4ba9-9ff4-4c77068bdf6a req-6d1be789-d815-46cf-be77-36faa8d60d48 service nova] Unable to find a host for instance df405782-02e0-4416-9c91-818ea05dacaf. Dropping event network-vif-unplugged {{(pid=129366) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Jan 15 21:05:24.495637 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-1eff1749-639e-4ba9-9ff4-4c77068bdf6a req-6d1be789-d815-46cf-be77-36faa8d60d48 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.059056 Jan 15 21:05:24.496371 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2622/5235] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:05:24 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 60 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jan 15 21:05:24.580909 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c847599a-0425-40f0-bb18-d1555eed5e58 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "GET /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.193383 Jan 15 21:05:24.588871 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2614/5236] 10.222.0.46 () {60 vars in 1315 bytes} [Sat Jan 15 21:05:24 2022] GET /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee/os-interface => generated 1831 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:05:24.594300 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-33da829e-18e1-47d1-b22f-84deeef44eec req-4c721efb-c84f-4177-8593-0d7de901b19a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9888e0ee-9a2f-4547-a6e3-c77d3493c63f", "name": "network-vif-deleted", "tag": "4596387d-a489-4634-a84b-5a3a77df49cd"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:24.595971 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:05:24.595971 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:05:24.605053 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-33da829e-18e1-47d1-b22f-84deeef44eec req-4c721efb-c84f-4177-8593-0d7de901b19a service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:24.605646 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-33da829e-18e1-47d1-b22f-84deeef44eec req-4c721efb-c84f-4177-8593-0d7de901b19a service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:24.617221 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-33da829e-18e1-47d1-b22f-84deeef44eec req-4c721efb-c84f-4177-8593-0d7de901b19a service nova] Creating event network-vif-deleted:4596387d-a489-4634-a84b-5a3a77df49cd for instance 9888e0ee-9a2f-4547-a6e3-c77d3493c63f on nch2-master-1 Jan 15 21:05:24.623341 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-33da829e-18e1-47d1-b22f-84deeef44eec req-4c721efb-c84f-4177-8593-0d7de901b19a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032632 Jan 15 21:05:24.623953 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2623/5237] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:05:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:05:24.812698 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d73374a3-e559-4b35-a977-f39f4bd98043 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:05:24.813455 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d73374a3-e559-4b35-a977-f39f4bd98043 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: 9888e0ee-9a2f-4547-a6e3-c77d3493c63f] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:24.819577 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d73374a3-e559-4b35-a977-f39f4bd98043 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:24.820031 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d73374a3-e559-4b35-a977-f39f4bd98043 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:24.820941 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d73374a3-e559-4b35-a977-f39f4bd98043 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:24.821390 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d73374a3-e559-4b35-a977-f39f4bd98043 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:24.857818 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d73374a3-e559-4b35-a977-f39f4bd98043 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:24.858390 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d73374a3-e559-4b35-a977-f39f4bd98043 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:24.858847 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.objects.instance [None req-d73374a3-e559-4b35-a977-f39f4bd98043 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lazy-loading 'fault' on Instance uuid 9888e0ee-9a2f-4547-a6e3-c77d3493c63f {{(pid=129365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 21:05:24.871959 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-851604bc-aa3f-4280-9b8c-abf6226beae0 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:24.873149 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-851604bc-aa3f-4280-9b8c-abf6226beae0 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:24.879743 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-851604bc-aa3f-4280-9b8c-abf6226beae0 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:24.880275 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-851604bc-aa3f-4280-9b8c-abf6226beae0 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:24.881157 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-851604bc-aa3f-4280-9b8c-abf6226beae0 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:24.881657 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-851604bc-aa3f-4280-9b8c-abf6226beae0 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:24.920280 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-d73374a3-e559-4b35-a977-f39f4bd98043 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb3421bc9494914bc5f797b15a55643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd31af2a6b9424f168dd6084d8d5fd0c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:05:24.923737 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-851604bc-aa3f-4280-9b8c-abf6226beae0 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action" status: 200 len: 32638 microversion: 2.20 time: 0.056164 Jan 15 21:05:24.925313 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2624/5238] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:24 2022] POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action => generated 32638 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:05:24.928530 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d73374a3-e559-4b35-a977-f39f4bd98043 tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/9888e0ee-9a2f-4547-a6e3-c77d3493c63f" status: 200 len: 1282 microversion: 2.1 time: 0.120707 Jan 15 21:05:24.929217 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2615/5239] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:05:24 2022] GET /compute/v2.1/servers/9888e0ee-9a2f-4547-a6e3-c77d3493c63f => generated 1282 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:05:24.972225 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f0a67e74-7e1c-4e43-af6a-ed6a9dde7189 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:05:24.973000 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f0a67e74-7e1c-4e43-af6a-ed6a9dde7189 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:24.981338 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f0a67e74-7e1c-4e43-af6a-ed6a9dde7189 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:24.981790 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f0a67e74-7e1c-4e43-af6a-ed6a9dde7189 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:24.982579 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f0a67e74-7e1c-4e43-af6a-ed6a9dde7189 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:24.983018 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f0a67e74-7e1c-4e43-af6a-ed6a9dde7189 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:25.070333 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ff279d1f-650d-422f-9460-65857f05f216 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:25.071281 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ff279d1f-650d-422f-9460-65857f05f216 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:25.081186 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ff279d1f-650d-422f-9460-65857f05f216 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:25.081667 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ff279d1f-650d-422f-9460-65857f05f216 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:25.083638 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ff279d1f-650d-422f-9460-65857f05f216 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:25.084756 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ff279d1f-650d-422f-9460-65857f05f216 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:25.138391 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ff279d1f-650d-422f-9460-65857f05f216 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.071694 Jan 15 21:05:25.140009 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2616/5240] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:25 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:05:25.172617 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c6d82d5a-58b6-4c18-a94c-f719885d67ff tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:25.174984 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c6d82d5a-58b6-4c18-a94c-f719885d67ff tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: d9db70df-9ffc-4b96-af06-a56b3b35ce91] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:25.186118 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c6d82d5a-58b6-4c18-a94c-f719885d67ff tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:25.186533 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c6d82d5a-58b6-4c18-a94c-f719885d67ff tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:25.187979 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c6d82d5a-58b6-4c18-a94c-f719885d67ff tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:25.188591 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c6d82d5a-58b6-4c18-a94c-f719885d67ff tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:25.221328 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-f0a67e74-7e1c-4e43-af6a-ed6a9dde7189 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:05:25.234163 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f0a67e74-7e1c-4e43-af6a-ed6a9dde7189 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9" status: 200 len: 1680 microversion: 2.1 time: 0.265741 Jan 15 21:05:25.235444 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2625/5241] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:05:24 2022] GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9 => generated 1680 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:05:25.244861 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c6d82d5a-58b6-4c18-a94c-f719885d67ff tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action" status: 200 len: 16402 microversion: 2.1 time: 0.071149 Jan 15 21:05:25.244861 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2617/5242] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:05:25 2022] POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action => generated 16402 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:05:25.939781 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-2c0025a2-a0ab-487d-a64c-3728b47b7576 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:25.941511 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-2c0025a2-a0ab-487d-a64c-3728b47b7576 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:25.948226 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5891d784-45a1-48ab-8c45-ea2a9a401dbc tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:05:25.950181 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-5891d784-45a1-48ab-8c45-ea2a9a401dbc tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] [instance: 9888e0ee-9a2f-4547-a6e3-c77d3493c63f] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:25.951665 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2c0025a2-a0ab-487d-a64c-3728b47b7576 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:25.952121 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2c0025a2-a0ab-487d-a64c-3728b47b7576 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:25.953164 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2c0025a2-a0ab-487d-a64c-3728b47b7576 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:25.953710 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2c0025a2-a0ab-487d-a64c-3728b47b7576 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:25.971211 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5891d784-45a1-48ab-8c45-ea2a9a401dbc tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:25.974844 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5891d784-45a1-48ab-8c45-ea2a9a401dbc tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:25.976244 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5891d784-45a1-48ab-8c45-ea2a9a401dbc tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:25.976816 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5891d784-45a1-48ab-8c45-ea2a9a401dbc tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:25.996932 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-5891d784-45a1-48ab-8c45-ea2a9a401dbc tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] HTTP exception thrown: Instance 9888e0ee-9a2f-4547-a6e3-c77d3493c63f could not be found. Jan 15 21:05:25.997684 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5891d784-45a1-48ab-8c45-ea2a9a401dbc tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] Returning 404 to user: Instance 9888e0ee-9a2f-4547-a6e3-c77d3493c63f could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:05:25.998628 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5891d784-45a1-48ab-8c45-ea2a9a401dbc tempest-ServersTestJSON-166996306 tempest-ServersTestJSON-166996306-project] 10.222.0.46 "GET /compute/v2.1/servers/9888e0ee-9a2f-4547-a6e3-c77d3493c63f" status: 404 len: 111 microversion: 2.1 time: 0.056684 Jan 15 21:05:26.002924 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2618/5243] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:05:25 2022] GET /compute/v2.1/servers/9888e0ee-9a2f-4547-a6e3-c77d3493c63f => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:05:26.013722 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-2c0025a2-a0ab-487d-a64c-3728b47b7576 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action" status: 200 len: 32638 microversion: 2.20 time: 0.080888 Jan 15 21:05:26.015520 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2626/5244] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:25 2022] POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action => generated 32638 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:05:26.152819 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-25fb6621-5d4f-4195-861c-28e4d110d582 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:26.154242 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-25fb6621-5d4f-4195-861c-28e4d110d582 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:26.165869 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-25fb6621-5d4f-4195-861c-28e4d110d582 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:26.168455 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-25fb6621-5d4f-4195-861c-28e4d110d582 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:26.174661 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-25fb6621-5d4f-4195-861c-28e4d110d582 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:26.176397 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-25fb6621-5d4f-4195-861c-28e4d110d582 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:26.242844 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-25fb6621-5d4f-4195-861c-28e4d110d582 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.094603 Jan 15 21:05:26.253707 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-89be7162-e71d-48bb-8e24-8464c3a56c5f tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:26.254809 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-89be7162-e71d-48bb-8e24-8464c3a56c5f tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: d9db70df-9ffc-4b96-af06-a56b3b35ce91] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:26.260974 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2619/5245] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:26 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:05:26.268225 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-4030d7db-b0bb-41b0-860c-a525823767cf tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:05:26.275646 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-89be7162-e71d-48bb-8e24-8464c3a56c5f tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:26.277100 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-89be7162-e71d-48bb-8e24-8464c3a56c5f tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:26.277580 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-4030d7db-b0bb-41b0-860c-a525823767cf tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:26.280646 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-89be7162-e71d-48bb-8e24-8464c3a56c5f tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:26.281331 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-89be7162-e71d-48bb-8e24-8464c3a56c5f tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:26.312713 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4030d7db-b0bb-41b0-860c-a525823767cf tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:26.314436 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4030d7db-b0bb-41b0-860c-a525823767cf tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:26.317686 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4030d7db-b0bb-41b0-860c-a525823767cf tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:26.318153 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4030d7db-b0bb-41b0-860c-a525823767cf tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:26.395218 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-89be7162-e71d-48bb-8e24-8464c3a56c5f tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action" status: 200 len: 24574 microversion: 2.1 time: 0.146714 Jan 15 21:05:26.396399 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2627/5246] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:05:26 2022] POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action => generated 24574 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:05:26.678460 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-4030d7db-b0bb-41b0-860c-a525823767cf tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:05:26.689156 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-4030d7db-b0bb-41b0-860c-a525823767cf tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9" status: 200 len: 1680 microversion: 2.1 time: 0.424870 Jan 15 21:05:26.689955 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2620/5247] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:05:26 2022] GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9 => generated 1680 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:05:27.028946 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-2a40b001-837c-408d-b396-9c6a28c117fe tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:27.030610 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-2a40b001-837c-408d-b396-9c6a28c117fe tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:27.040541 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2a40b001-837c-408d-b396-9c6a28c117fe tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:27.041467 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2a40b001-837c-408d-b396-9c6a28c117fe tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:27.042846 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2a40b001-837c-408d-b396-9c6a28c117fe tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:27.043747 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2a40b001-837c-408d-b396-9c6a28c117fe tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:27.117238 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-2a40b001-837c-408d-b396-9c6a28c117fe tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action" status: 200 len: 32638 microversion: 2.20 time: 0.092180 Jan 15 21:05:27.122695 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2628/5248] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:27 2022] POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action => generated 32638 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:05:27.269452 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-40dc1818-8b36-4017-98b0-c3708dbf25db tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:27.270145 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-40dc1818-8b36-4017-98b0-c3708dbf25db tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:27.282358 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-40dc1818-8b36-4017-98b0-c3708dbf25db tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:27.282968 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-40dc1818-8b36-4017-98b0-c3708dbf25db tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:27.283959 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-40dc1818-8b36-4017-98b0-c3708dbf25db tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:27.284811 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-40dc1818-8b36-4017-98b0-c3708dbf25db tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:27.403830 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-40dc1818-8b36-4017-98b0-c3708dbf25db tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.139407 Jan 15 21:05:27.409593 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-fc879dbd-50d5-4a95-81d3-2a6e19f9722d tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:27.410606 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-fc879dbd-50d5-4a95-81d3-2a6e19f9722d tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: d9db70df-9ffc-4b96-af06-a56b3b35ce91] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:27.413699 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2621/5249] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:27 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:05:27.436443 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fc879dbd-50d5-4a95-81d3-2a6e19f9722d tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:27.436915 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fc879dbd-50d5-4a95-81d3-2a6e19f9722d tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:27.437718 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fc879dbd-50d5-4a95-81d3-2a6e19f9722d tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:27.438153 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fc879dbd-50d5-4a95-81d3-2a6e19f9722d tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:27.506709 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-fc879dbd-50d5-4a95-81d3-2a6e19f9722d tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action" status: 200 len: 24574 microversion: 2.1 time: 0.102198 Jan 15 21:05:27.514325 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2629/5250] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:05:27 2022] POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action => generated 24574 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 21:05:27.707172 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-85b37bdd-5712-4b27-b83e-8babd055351c tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:05:27.707879 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-85b37bdd-5712-4b27-b83e-8babd055351c tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:27.715631 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-85b37bdd-5712-4b27-b83e-8babd055351c tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:27.716288 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-85b37bdd-5712-4b27-b83e-8babd055351c tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:27.717110 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-85b37bdd-5712-4b27-b83e-8babd055351c tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:27.717709 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-85b37bdd-5712-4b27-b83e-8babd055351c tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:27.946783 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-85b37bdd-5712-4b27-b83e-8babd055351c tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:05:27.958813 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-85b37bdd-5712-4b27-b83e-8babd055351c tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9" status: 200 len: 1680 microversion: 2.1 time: 0.255793 Jan 15 21:05:27.973027 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2622/5251] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:05:27 2022] GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9 => generated 1680 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:05:28.130820 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9282fded-1576-4ca6-a077-18942b9ab4ad tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:28.132507 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-9282fded-1576-4ca6-a077-18942b9ab4ad tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:28.143570 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9282fded-1576-4ca6-a077-18942b9ab4ad tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:28.144586 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9282fded-1576-4ca6-a077-18942b9ab4ad tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:28.146166 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9282fded-1576-4ca6-a077-18942b9ab4ad tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:28.147113 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9282fded-1576-4ca6-a077-18942b9ab4ad tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:28.214339 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-9282fded-1576-4ca6-a077-18942b9ab4ad tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action" status: 200 len: 32638 microversion: 2.20 time: 0.085807 Jan 15 21:05:28.216950 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2630/5252] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:28 2022] POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action => generated 32638 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:05:28.423827 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b4452660-96c4-4996-baee-ff59d7b55e91 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:28.433648 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b4452660-96c4-4996-baee-ff59d7b55e91 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:28.444186 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b4452660-96c4-4996-baee-ff59d7b55e91 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:28.445073 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b4452660-96c4-4996-baee-ff59d7b55e91 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:28.446150 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b4452660-96c4-4996-baee-ff59d7b55e91 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:28.446800 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b4452660-96c4-4996-baee-ff59d7b55e91 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:28.500356 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b4452660-96c4-4996-baee-ff59d7b55e91 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.079918 Jan 15 21:05:28.505594 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2623/5253] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:28 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:05:28.520438 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-79988243-a3f7-4a5b-8faf-9802cd834995 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:28.521890 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-79988243-a3f7-4a5b-8faf-9802cd834995 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: d9db70df-9ffc-4b96-af06-a56b3b35ce91] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:28.534356 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-79988243-a3f7-4a5b-8faf-9802cd834995 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:28.534820 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-79988243-a3f7-4a5b-8faf-9802cd834995 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:28.535629 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-79988243-a3f7-4a5b-8faf-9802cd834995 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:28.536071 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-79988243-a3f7-4a5b-8faf-9802cd834995 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:28.579003 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-79988243-a3f7-4a5b-8faf-9802cd834995 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action" status: 200 len: 24574 microversion: 2.1 time: 0.062674 Jan 15 21:05:28.580338 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2631/5254] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:05:28 2022] POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action => generated 24574 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:05:28.981311 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f348dd17-8ba9-4eb8-a95b-9f5f80d9d868 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:05:28.982100 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f348dd17-8ba9-4eb8-a95b-9f5f80d9d868 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:28.996915 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f348dd17-8ba9-4eb8-a95b-9f5f80d9d868 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:28.997728 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f348dd17-8ba9-4eb8-a95b-9f5f80d9d868 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:28.998628 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f348dd17-8ba9-4eb8-a95b-9f5f80d9d868 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:28.999249 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f348dd17-8ba9-4eb8-a95b-9f5f80d9d868 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:29.230833 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-2d37fa41-326a-4320-b3dd-da706c0e4dff tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:29.233071 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-2d37fa41-326a-4320-b3dd-da706c0e4dff tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:29.243743 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2d37fa41-326a-4320-b3dd-da706c0e4dff tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:29.244266 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2d37fa41-326a-4320-b3dd-da706c0e4dff tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:29.245187 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2d37fa41-326a-4320-b3dd-da706c0e4dff tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:29.245633 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2d37fa41-326a-4320-b3dd-da706c0e4dff tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:29.342500 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-2d37fa41-326a-4320-b3dd-da706c0e4dff tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action" status: 200 len: 32638 microversion: 2.20 time: 0.117983 Jan 15 21:05:29.347065 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2632/5255] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:29 2022] POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action => generated 32638 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:05:29.393029 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-f348dd17-8ba9-4eb8-a95b-9f5f80d9d868 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:05:29.400743 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f348dd17-8ba9-4eb8-a95b-9f5f80d9d868 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9" status: 200 len: 1680 microversion: 2.1 time: 0.426997 Jan 15 21:05:29.401387 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2624/5256] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:05:28 2022] GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9 => generated 1680 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:05:29.517942 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8c6bf6d7-a170-4108-a49e-153df8aa3925 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:29.519693 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-8c6bf6d7-a170-4108-a49e-153df8aa3925 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:29.529670 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8c6bf6d7-a170-4108-a49e-153df8aa3925 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:29.530524 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8c6bf6d7-a170-4108-a49e-153df8aa3925 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:29.531581 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8c6bf6d7-a170-4108-a49e-153df8aa3925 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:29.532619 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8c6bf6d7-a170-4108-a49e-153df8aa3925 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:29.586413 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-8c6bf6d7-a170-4108-a49e-153df8aa3925 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.076427 Jan 15 21:05:29.591875 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2633/5257] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:29 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:05:29.592074 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-67e9cc76-f96b-4299-a0f1-2821f0988ffa tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:29.592074 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-67e9cc76-f96b-4299-a0f1-2821f0988ffa tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: d9db70df-9ffc-4b96-af06-a56b3b35ce91] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:29.598694 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-67e9cc76-f96b-4299-a0f1-2821f0988ffa tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:29.599349 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-67e9cc76-f96b-4299-a0f1-2821f0988ffa tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:29.599942 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-67e9cc76-f96b-4299-a0f1-2821f0988ffa tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:29.601496 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-67e9cc76-f96b-4299-a0f1-2821f0988ffa tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:29.693199 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-67e9cc76-f96b-4299-a0f1-2821f0988ffa tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action" status: 200 len: 24574 microversion: 2.1 time: 0.106631 Jan 15 21:05:29.694361 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2625/5258] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:05:29 2022] POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action => generated 24574 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 21:05:29.784201 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8c6bf6d7-a170-4108-a49e-153df8aa3925 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:05:29.785599 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-8c6bf6d7-a170-4108-a49e-153df8aa3925 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001925 Jan 15 21:05:29.786045 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2634/5259] 10.222.0.46 () {56 vars in 885 bytes} [Sat Jan 15 21:05:29 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jan 15 21:05:30.356347 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-14d32113-f0fc-4a9e-903e-85d4a6f10d5c tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:30.357770 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-14d32113-f0fc-4a9e-903e-85d4a6f10d5c tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:30.366673 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-14d32113-f0fc-4a9e-903e-85d4a6f10d5c tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:30.367452 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-14d32113-f0fc-4a9e-903e-85d4a6f10d5c tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:30.368579 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-14d32113-f0fc-4a9e-903e-85d4a6f10d5c tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:30.370132 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-14d32113-f0fc-4a9e-903e-85d4a6f10d5c tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:30.434274 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-be2d669d-232e-4b19-a6a3-d6c4ceeb56f8 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:05:30.435245 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-be2d669d-232e-4b19-a6a3-d6c4ceeb56f8 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:30.447747 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-14d32113-f0fc-4a9e-903e-85d4a6f10d5c tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action" status: 200 len: 32638 microversion: 2.20 time: 0.094889 Jan 15 21:05:30.448775 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-be2d669d-232e-4b19-a6a3-d6c4ceeb56f8 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:30.453216 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2626/5260] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:30 2022] POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action => generated 32638 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:05:30.453370 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-be2d669d-232e-4b19-a6a3-d6c4ceeb56f8 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:30.453370 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-be2d669d-232e-4b19-a6a3-d6c4ceeb56f8 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:30.453370 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-be2d669d-232e-4b19-a6a3-d6c4ceeb56f8 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:30.602042 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ef49f695-72e5-4e9b-aa82-d4de1d83da3d tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:30.604629 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ef49f695-72e5-4e9b-aa82-d4de1d83da3d tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:30.612957 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ef49f695-72e5-4e9b-aa82-d4de1d83da3d tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:30.613845 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ef49f695-72e5-4e9b-aa82-d4de1d83da3d tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:30.614874 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ef49f695-72e5-4e9b-aa82-d4de1d83da3d tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:30.615505 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ef49f695-72e5-4e9b-aa82-d4de1d83da3d tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:30.677232 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ef49f695-72e5-4e9b-aa82-d4de1d83da3d tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.081013 Jan 15 21:05:30.680888 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2627/5261] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:30 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:05:30.686691 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-be2d669d-232e-4b19-a6a3-d6c4ceeb56f8 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:05:30.695743 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-be2d669d-232e-4b19-a6a3-d6c4ceeb56f8 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9" status: 200 len: 1680 microversion: 2.1 time: 0.281218 Jan 15 21:05:30.713810 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2635/5262] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:05:30 2022] GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9 => generated 1680 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:05:30.714449 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d37eb533-8800-49bd-8a8f-140b5dc1fee8 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:30.715485 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d37eb533-8800-49bd-8a8f-140b5dc1fee8 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: d9db70df-9ffc-4b96-af06-a56b3b35ce91] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:30.722328 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d37eb533-8800-49bd-8a8f-140b5dc1fee8 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:30.722780 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d37eb533-8800-49bd-8a8f-140b5dc1fee8 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:30.723722 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d37eb533-8800-49bd-8a8f-140b5dc1fee8 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:30.724161 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d37eb533-8800-49bd-8a8f-140b5dc1fee8 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:30.779703 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d37eb533-8800-49bd-8a8f-140b5dc1fee8 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action" status: 200 len: 24574 microversion: 2.1 time: 0.069717 Jan 15 21:05:30.780767 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2628/5263] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:05:30 2022] POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action => generated 24574 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 21:05:31.461536 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-3fa25d78-04e4-44de-ac2f-a9d0797cc02e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:31.464180 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-3fa25d78-04e4-44de-ac2f-a9d0797cc02e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:31.472606 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3fa25d78-04e4-44de-ac2f-a9d0797cc02e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:31.473530 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3fa25d78-04e4-44de-ac2f-a9d0797cc02e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:31.474640 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3fa25d78-04e4-44de-ac2f-a9d0797cc02e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:31.475119 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3fa25d78-04e4-44de-ac2f-a9d0797cc02e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:31.564216 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-3fa25d78-04e4-44de-ac2f-a9d0797cc02e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action" status: 200 len: 32638 microversion: 2.20 time: 0.106929 Jan 15 21:05:31.565794 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2636/5264] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:31 2022] POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action => generated 32638 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:05:31.691829 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-4a084b99-61b2-4997-bab8-a45b31231945 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:31.694877 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-4a084b99-61b2-4997-bab8-a45b31231945 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:31.715625 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4a084b99-61b2-4997-bab8-a45b31231945 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:31.716267 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4a084b99-61b2-4997-bab8-a45b31231945 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:31.717274 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4a084b99-61b2-4997-bab8-a45b31231945 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:31.717855 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-3abbd028-1098-4759-95e5-8f2592d52993 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:05:31.718518 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4a084b99-61b2-4997-bab8-a45b31231945 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:31.718659 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-3abbd028-1098-4759-95e5-8f2592d52993 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:31.740785 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3abbd028-1098-4759-95e5-8f2592d52993 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:31.745071 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3abbd028-1098-4759-95e5-8f2592d52993 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:31.748614 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3abbd028-1098-4759-95e5-8f2592d52993 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:31.749147 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3abbd028-1098-4759-95e5-8f2592d52993 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:31.811264 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-4a084b99-61b2-4997-bab8-a45b31231945 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.124204 Jan 15 21:05:31.811949 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2629/5265] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:31 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:05:31.819752 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-12c3c466-8619-4852-86cf-0f3966077f78 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:31.820893 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-12c3c466-8619-4852-86cf-0f3966077f78 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: d9db70df-9ffc-4b96-af06-a56b3b35ce91] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:31.833090 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-12c3c466-8619-4852-86cf-0f3966077f78 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:31.841190 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-12c3c466-8619-4852-86cf-0f3966077f78 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:31.841892 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-12c3c466-8619-4852-86cf-0f3966077f78 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:31.842334 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-12c3c466-8619-4852-86cf-0f3966077f78 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:31.906727 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-12c3c466-8619-4852-86cf-0f3966077f78 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action" status: 200 len: 24574 microversion: 2.1 time: 0.091831 Jan 15 21:05:31.908090 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2630/5266] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:05:31 2022] POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action => generated 24574 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:05:32.066582 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-3abbd028-1098-4759-95e5-8f2592d52993 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:05:32.076123 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-3abbd028-1098-4759-95e5-8f2592d52993 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9" status: 200 len: 1680 microversion: 2.1 time: 0.364091 Jan 15 21:05:32.077375 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2637/5267] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:05:31 2022] GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9 => generated 1680 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:05:32.577434 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-7e733932-1c5e-469f-9035-93554924ee6f tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:32.578763 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-7e733932-1c5e-469f-9035-93554924ee6f tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:32.586281 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7e733932-1c5e-469f-9035-93554924ee6f tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:32.587052 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7e733932-1c5e-469f-9035-93554924ee6f tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:32.589170 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7e733932-1c5e-469f-9035-93554924ee6f tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:32.589878 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7e733932-1c5e-469f-9035-93554924ee6f tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:32.636575 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-7e733932-1c5e-469f-9035-93554924ee6f tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action" status: 200 len: 32638 microversion: 2.20 time: 0.063841 Jan 15 21:05:32.641112 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2631/5268] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:32 2022] POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action => generated 32638 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:05:32.831867 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-51712f2f-27f7-4ffc-abe3-6e6b3e7c942f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:32.833453 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-51712f2f-27f7-4ffc-abe3-6e6b3e7c942f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:32.843948 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-51712f2f-27f7-4ffc-abe3-6e6b3e7c942f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:32.844820 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-51712f2f-27f7-4ffc-abe3-6e6b3e7c942f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:32.846245 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-51712f2f-27f7-4ffc-abe3-6e6b3e7c942f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:32.846902 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-51712f2f-27f7-4ffc-abe3-6e6b3e7c942f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:32.921265 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b9f667a3-cead-4355-80d4-104645fa5869 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:32.922282 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b9f667a3-cead-4355-80d4-104645fa5869 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: d9db70df-9ffc-4b96-af06-a56b3b35ce91] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:32.926357 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-51712f2f-27f7-4ffc-abe3-6e6b3e7c942f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.105929 Jan 15 21:05:32.932268 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b9f667a3-cead-4355-80d4-104645fa5869 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:32.933040 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b9f667a3-cead-4355-80d4-104645fa5869 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:32.934049 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b9f667a3-cead-4355-80d4-104645fa5869 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:32.934496 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b9f667a3-cead-4355-80d4-104645fa5869 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:32.935544 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2638/5269] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:32 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:05:32.981486 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b9f667a3-cead-4355-80d4-104645fa5869 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action" status: 200 len: 24574 microversion: 2.1 time: 0.065391 Jan 15 21:05:32.985294 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2632/5270] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:05:32 2022] POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action => generated 24574 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 21:05:33.097623 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-17c8706c-780c-428e-8adc-104db7c1b0e3 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:05:33.098322 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-17c8706c-780c-428e-8adc-104db7c1b0e3 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:33.111357 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-17c8706c-780c-428e-8adc-104db7c1b0e3 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:33.112501 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-17c8706c-780c-428e-8adc-104db7c1b0e3 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:33.113670 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-17c8706c-780c-428e-8adc-104db7c1b0e3 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:33.114404 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-17c8706c-780c-428e-8adc-104db7c1b0e3 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:33.402362 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-17c8706c-780c-428e-8adc-104db7c1b0e3 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:05:33.417931 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-17c8706c-780c-428e-8adc-104db7c1b0e3 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9" status: 200 len: 1680 microversion: 2.1 time: 0.327395 Jan 15 21:05:33.418803 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2639/5271] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:05:33 2022] GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9 => generated 1680 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:05:33.656173 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a5ba8a06-3150-40b5-93f9-ab87b5f127dd tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:33.657602 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a5ba8a06-3150-40b5-93f9-ab87b5f127dd tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:33.669967 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a5ba8a06-3150-40b5-93f9-ab87b5f127dd tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:33.670690 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a5ba8a06-3150-40b5-93f9-ab87b5f127dd tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:33.672013 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a5ba8a06-3150-40b5-93f9-ab87b5f127dd tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:33.672984 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a5ba8a06-3150-40b5-93f9-ab87b5f127dd tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:33.725150 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a5ba8a06-3150-40b5-93f9-ab87b5f127dd tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action" status: 200 len: 32638 microversion: 2.20 time: 0.078941 Jan 15 21:05:33.732273 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2633/5272] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:33 2022] POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action => generated 32638 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:05:33.941858 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1530cfa8-3552-4d5c-a464-140c23dd6476 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:33.942793 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-1530cfa8-3552-4d5c-a464-140c23dd6476 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:33.961489 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1530cfa8-3552-4d5c-a464-140c23dd6476 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:33.961951 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1530cfa8-3552-4d5c-a464-140c23dd6476 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:33.962807 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1530cfa8-3552-4d5c-a464-140c23dd6476 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:33.963338 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1530cfa8-3552-4d5c-a464-140c23dd6476 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:33.994461 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-7101c047-d717-4f94-aaaa-da5e589b9ae9 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:33.995502 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-7101c047-d717-4f94-aaaa-da5e589b9ae9 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: d9db70df-9ffc-4b96-af06-a56b3b35ce91] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:34.014471 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7101c047-d717-4f94-aaaa-da5e589b9ae9 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:34.015022 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7101c047-d717-4f94-aaaa-da5e589b9ae9 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:34.015733 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7101c047-d717-4f94-aaaa-da5e589b9ae9 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:34.016179 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7101c047-d717-4f94-aaaa-da5e589b9ae9 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:34.055139 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-1530cfa8-3552-4d5c-a464-140c23dd6476 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.117400 Jan 15 21:05:34.055889 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2640/5273] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:33 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:05:34.118304 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-7101c047-d717-4f94-aaaa-da5e589b9ae9 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action" status: 200 len: 24574 microversion: 2.1 time: 0.127222 Jan 15 21:05:34.123118 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2634/5274] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:05:33 2022] POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action => generated 24574 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 21:05:34.443703 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0d7b0126-5efa-4082-9006-7f4f8a43c5f5 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:05:34.444923 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-0d7b0126-5efa-4082-9006-7f4f8a43c5f5 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:34.457238 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0d7b0126-5efa-4082-9006-7f4f8a43c5f5 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:34.458237 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0d7b0126-5efa-4082-9006-7f4f8a43c5f5 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:34.459422 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0d7b0126-5efa-4082-9006-7f4f8a43c5f5 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:34.460236 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0d7b0126-5efa-4082-9006-7f4f8a43c5f5 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:34.635232 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-0d7b0126-5efa-4082-9006-7f4f8a43c5f5 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:05:34.643426 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0d7b0126-5efa-4082-9006-7f4f8a43c5f5 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9" status: 200 len: 1657 microversion: 2.1 time: 0.211535 Jan 15 21:05:34.644720 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2641/5275] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:05:34 2022] GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9 => generated 1657 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:05:34.662062 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-dd339849-65f2-4f20-a29b-ff27dc639d89 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:34.669945 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dd339849-65f2-4f20-a29b-ff27dc639d89 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:34.670657 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dd339849-65f2-4f20-a29b-ff27dc639d89 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:34.698373 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-dd339849-65f2-4f20-a29b-ff27dc639d89 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Going to try to start instance {{(pid=129365) start /opt/stack/nova/nova/compute/api.py:2677}} Jan 15 21:05:34.742166 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-708f013d-4e85-414c-8913-d4b6c3196cc8 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:34.743486 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-708f013d-4e85-414c-8913-d4b6c3196cc8 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:34.766949 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-dd339849-65f2-4f20-a29b-ff27dc639d89 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action" status: 202 len: 0 microversion: 2.1 time: 0.108787 Jan 15 21:05:34.768602 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2635/5276] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:05:34 2022] POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:05:34.778559 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-708f013d-4e85-414c-8913-d4b6c3196cc8 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:34.780818 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-db690316-8f19-44a2-af49-02256452b1fd tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:05:34.781588 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-db690316-8f19-44a2-af49-02256452b1fd tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:34.782508 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-708f013d-4e85-414c-8913-d4b6c3196cc8 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:34.784251 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-708f013d-4e85-414c-8913-d4b6c3196cc8 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:34.786950 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-708f013d-4e85-414c-8913-d4b6c3196cc8 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:34.801175 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-db690316-8f19-44a2-af49-02256452b1fd tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:34.805369 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-db690316-8f19-44a2-af49-02256452b1fd tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:34.806944 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-db690316-8f19-44a2-af49-02256452b1fd tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:34.807404 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-db690316-8f19-44a2-af49-02256452b1fd tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:34.922919 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-708f013d-4e85-414c-8913-d4b6c3196cc8 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action" status: 200 len: 32638 microversion: 2.20 time: 0.171180 Jan 15 21:05:34.923341 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2642/5277] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:34 2022] POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action => generated 32638 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:05:35.069087 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-798bfa9d-ace0-4fe4-ade7-9b77641d1ee5 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:35.070406 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-798bfa9d-ace0-4fe4-ade7-9b77641d1ee5 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:35.081795 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-798bfa9d-ace0-4fe4-ade7-9b77641d1ee5 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:35.087522 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-798bfa9d-ace0-4fe4-ade7-9b77641d1ee5 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:35.089983 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-798bfa9d-ace0-4fe4-ade7-9b77641d1ee5 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:35.090450 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-798bfa9d-ace0-4fe4-ade7-9b77641d1ee5 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:35.184742 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-798bfa9d-ace0-4fe4-ade7-9b77641d1ee5 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.120275 Jan 15 21:05:35.185868 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2643/5278] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:35 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:05:35.200239 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-299b9a96-281b-49b4-bae2-1ddb17404929 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:35.208243 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-db690316-8f19-44a2-af49-02256452b1fd tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:05:35.219531 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-299b9a96-281b-49b4-bae2-1ddb17404929 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: d9db70df-9ffc-4b96-af06-a56b3b35ce91] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:35.221263 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-db690316-8f19-44a2-af49-02256452b1fd tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9" status: 200 len: 1666 microversion: 2.1 time: 0.449264 Jan 15 21:05:35.223095 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2636/5279] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:05:34 2022] GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9 => generated 1666 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:05:35.236138 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-299b9a96-281b-49b4-bae2-1ddb17404929 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:35.237056 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-299b9a96-281b-49b4-bae2-1ddb17404929 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:35.238173 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-299b9a96-281b-49b4-bae2-1ddb17404929 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:35.238782 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-299b9a96-281b-49b4-bae2-1ddb17404929 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:35.338293 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-299b9a96-281b-49b4-bae2-1ddb17404929 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action" status: 200 len: 24574 microversion: 2.1 time: 0.147259 Jan 15 21:05:35.339284 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2644/5280] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:05:35 2022] POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action => generated 24574 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:05:35.935132 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-24dae107-c993-4f46-85ec-83155a89a299 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:35.936052 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-24dae107-c993-4f46-85ec-83155a89a299 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:35.947772 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-24dae107-c993-4f46-85ec-83155a89a299 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:35.948469 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-24dae107-c993-4f46-85ec-83155a89a299 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:35.951877 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-24dae107-c993-4f46-85ec-83155a89a299 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:35.952334 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-24dae107-c993-4f46-85ec-83155a89a299 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:36.008221 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-24dae107-c993-4f46-85ec-83155a89a299 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action" status: 200 len: 32638 microversion: 2.20 time: 0.077071 Jan 15 21:05:36.012772 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2637/5281] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:35 2022] POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action => generated 32638 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:05:36.198845 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9526149c-7800-4241-be92-a8a2fa74167f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:36.207719 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-9526149c-7800-4241-be92-a8a2fa74167f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:36.219792 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9526149c-7800-4241-be92-a8a2fa74167f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:36.220485 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9526149c-7800-4241-be92-a8a2fa74167f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:36.221480 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9526149c-7800-4241-be92-a8a2fa74167f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:36.222247 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9526149c-7800-4241-be92-a8a2fa74167f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:36.240633 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5da022c7-0c7a-4ed9-aa6b-a68cb1b5e369 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:05:36.242886 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-5da022c7-0c7a-4ed9-aa6b-a68cb1b5e369 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:36.257436 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5da022c7-0c7a-4ed9-aa6b-a68cb1b5e369 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:36.259316 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5da022c7-0c7a-4ed9-aa6b-a68cb1b5e369 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:36.260509 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5da022c7-0c7a-4ed9-aa6b-a68cb1b5e369 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:36.261205 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5da022c7-0c7a-4ed9-aa6b-a68cb1b5e369 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:36.350173 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-9526149c-7800-4241-be92-a8a2fa74167f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.155977 Jan 15 21:05:36.356599 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2645/5282] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:36 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:05:36.365111 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e73a23d7-a01b-49ab-9152-4bf9881b6398 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:36.366903 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e73a23d7-a01b-49ab-9152-4bf9881b6398 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: d9db70df-9ffc-4b96-af06-a56b3b35ce91] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:36.395585 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e73a23d7-a01b-49ab-9152-4bf9881b6398 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:36.396064 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e73a23d7-a01b-49ab-9152-4bf9881b6398 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:36.396982 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e73a23d7-a01b-49ab-9152-4bf9881b6398 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:36.397496 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e73a23d7-a01b-49ab-9152-4bf9881b6398 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:36.453314 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e73a23d7-a01b-49ab-9152-4bf9881b6398 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action" status: 200 len: 24574 microversion: 2.1 time: 0.093099 Jan 15 21:05:36.454973 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2646/5283] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:05:36 2022] POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action => generated 24574 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:05:36.546654 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-5da022c7-0c7a-4ed9-aa6b-a68cb1b5e369 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:05:36.558085 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5da022c7-0c7a-4ed9-aa6b-a68cb1b5e369 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9" status: 200 len: 1666 microversion: 2.1 time: 0.321761 Jan 15 21:05:36.559069 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2638/5284] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:05:36 2022] GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9 => generated 1666 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:05:37.020236 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-64decc8e-e70c-4dce-9fa7-92585d43d0ac tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:37.021268 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-64decc8e-e70c-4dce-9fa7-92585d43d0ac tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:37.028222 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-64decc8e-e70c-4dce-9fa7-92585d43d0ac tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:37.028672 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-64decc8e-e70c-4dce-9fa7-92585d43d0ac tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:37.029485 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-64decc8e-e70c-4dce-9fa7-92585d43d0ac tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:37.030088 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-64decc8e-e70c-4dce-9fa7-92585d43d0ac tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:37.080776 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-64decc8e-e70c-4dce-9fa7-92585d43d0ac tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action" status: 200 len: 32638 microversion: 2.20 time: 0.064450 Jan 15 21:05:37.082657 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2647/5285] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:37 2022] POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action => generated 32638 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:05:37.363380 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ed699042-773d-44fb-9411-76e29fd74a3b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:37.364288 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ed699042-773d-44fb-9411-76e29fd74a3b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:37.375849 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ed699042-773d-44fb-9411-76e29fd74a3b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:37.376295 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ed699042-773d-44fb-9411-76e29fd74a3b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:37.380497 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ed699042-773d-44fb-9411-76e29fd74a3b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:37.380925 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ed699042-773d-44fb-9411-76e29fd74a3b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:37.464714 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ed699042-773d-44fb-9411-76e29fd74a3b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.104908 Jan 15 21:05:37.465944 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2639/5286] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:37 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:05:37.467684 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-736d6ea6-e91a-4405-a2de-1e0ba6d80bbc tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:37.468682 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-736d6ea6-e91a-4405-a2de-1e0ba6d80bbc tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: d9db70df-9ffc-4b96-af06-a56b3b35ce91] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:37.481633 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-736d6ea6-e91a-4405-a2de-1e0ba6d80bbc tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:37.483459 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-736d6ea6-e91a-4405-a2de-1e0ba6d80bbc tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:37.484519 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-736d6ea6-e91a-4405-a2de-1e0ba6d80bbc tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:37.486592 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-736d6ea6-e91a-4405-a2de-1e0ba6d80bbc tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:37.570787 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-736d6ea6-e91a-4405-a2de-1e0ba6d80bbc tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action" status: 200 len: 24574 microversion: 2.1 time: 0.106556 Jan 15 21:05:37.573327 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2648/5287] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:05:37 2022] POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action => generated 24574 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:05:37.577553 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-bf2be8e7-e543-44a1-a53a-77c945709977 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:05:37.578202 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-bf2be8e7-e543-44a1-a53a-77c945709977 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:37.591257 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bf2be8e7-e543-44a1-a53a-77c945709977 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:37.591712 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bf2be8e7-e543-44a1-a53a-77c945709977 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:37.592531 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bf2be8e7-e543-44a1-a53a-77c945709977 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:37.593751 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bf2be8e7-e543-44a1-a53a-77c945709977 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:37.802512 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-bf2be8e7-e543-44a1-a53a-77c945709977 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:05:37.819413 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-bf2be8e7-e543-44a1-a53a-77c945709977 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9" status: 200 len: 1670 microversion: 2.1 time: 0.246393 Jan 15 21:05:37.831684 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2640/5288] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:05:37 2022] GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9 => generated 1670 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:05:37.840577 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-273ab52b-6bd4-428c-8dd2-ebd53605c5e2 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:05:37.842610 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-273ab52b-6bd4-428c-8dd2-ebd53605c5e2 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:37.850786 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-273ab52b-6bd4-428c-8dd2-ebd53605c5e2 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:37.851550 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-273ab52b-6bd4-428c-8dd2-ebd53605c5e2 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:37.852555 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-273ab52b-6bd4-428c-8dd2-ebd53605c5e2 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:37.853233 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-273ab52b-6bd4-428c-8dd2-ebd53605c5e2 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:38.070629 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-273ab52b-6bd4-428c-8dd2-ebd53605c5e2 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:05:38.079444 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-273ab52b-6bd4-428c-8dd2-ebd53605c5e2 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9" status: 200 len: 1670 microversion: 2.1 time: 0.245894 Jan 15 21:05:38.080407 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2649/5289] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:05:37 2022] GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9 => generated 1670 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:05:38.099739 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4c11914d-5f80-4c24-907f-179f3818d818 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:05:38.100588 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-1608bb22-b85b-41c6-b9ea-c167b4f9338f tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:38.101000 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-4c11914d-5f80-4c24-907f-179f3818d818 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:38.101971 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-1608bb22-b85b-41c6-b9ea-c167b4f9338f tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:38.108204 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4c11914d-5f80-4c24-907f-179f3818d818 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:38.109093 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4c11914d-5f80-4c24-907f-179f3818d818 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:38.110321 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4c11914d-5f80-4c24-907f-179f3818d818 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:38.111599 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4c11914d-5f80-4c24-907f-179f3818d818 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:38.113657 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1608bb22-b85b-41c6-b9ea-c167b4f9338f tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:38.114112 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1608bb22-b85b-41c6-b9ea-c167b4f9338f tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:38.114911 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1608bb22-b85b-41c6-b9ea-c167b4f9338f tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:38.115354 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1608bb22-b85b-41c6-b9ea-c167b4f9338f tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:38.205428 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-1608bb22-b85b-41c6-b9ea-c167b4f9338f tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action" status: 200 len: 32638 microversion: 2.20 time: 0.109738 Jan 15 21:05:38.208103 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2641/5290] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:38 2022] POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action => generated 32638 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:05:38.398335 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-4c11914d-5f80-4c24-907f-179f3818d818 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:05:38.410696 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-4c11914d-5f80-4c24-907f-179f3818d818 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9" status: 200 len: 1670 microversion: 2.1 time: 0.313493 Jan 15 21:05:38.424255 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2650/5291] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:05:38 2022] GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9 => generated 1670 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:05:38.429053 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c13be95b-b1ac-4491-99ad-a714d4ab72ce tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:38.429687 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c13be95b-b1ac-4491-99ad-a714d4ab72ce tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:38.438138 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c13be95b-b1ac-4491-99ad-a714d4ab72ce tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:38.438570 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c13be95b-b1ac-4491-99ad-a714d4ab72ce tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:38.439364 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c13be95b-b1ac-4491-99ad-a714d4ab72ce tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:38.439983 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c13be95b-b1ac-4491-99ad-a714d4ab72ce tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:38.481716 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.objects.instance [None req-c13be95b-b1ac-4491-99ad-a714d4ab72ce tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lazy-loading 'flavor' on Instance uuid 4504a13b-d10e-436a-a5ef-991829938dd9 {{(pid=129365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 21:05:38.484472 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a7cad422-b7f9-42c7-be7c-42dba43fc9ad tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:38.488148 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a7cad422-b7f9-42c7-be7c-42dba43fc9ad tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:38.503547 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a7cad422-b7f9-42c7-be7c-42dba43fc9ad tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:38.504810 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a7cad422-b7f9-42c7-be7c-42dba43fc9ad tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:38.506998 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a7cad422-b7f9-42c7-be7c-42dba43fc9ad tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:38.510066 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a7cad422-b7f9-42c7-be7c-42dba43fc9ad tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:38.572412 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a7cad422-b7f9-42c7-be7c-42dba43fc9ad tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.097723 Jan 15 21:05:38.574135 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2651/5292] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:38 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:05:38.592894 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9651cc71-f285-4352-a862-e7ae96cfc2ba tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:38.594411 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-9651cc71-f285-4352-a862-e7ae96cfc2ba tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: d9db70df-9ffc-4b96-af06-a56b3b35ce91] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:38.604556 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9651cc71-f285-4352-a862-e7ae96cfc2ba tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:38.605693 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9651cc71-f285-4352-a862-e7ae96cfc2ba tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:38.614234 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9651cc71-f285-4352-a862-e7ae96cfc2ba tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:38.615261 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9651cc71-f285-4352-a862-e7ae96cfc2ba tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:38.616409 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c13be95b-b1ac-4491-99ad-a714d4ab72ce tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action" status: 202 len: 0 microversion: 2.1 time: 0.191079 Jan 15 21:05:38.622194 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2642/5293] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:05:38 2022] POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:05:38.628735 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-120ae2ef-30d0-457b-ba11-1a9dbb45d97f tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:05:38.629930 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-120ae2ef-30d0-457b-ba11-1a9dbb45d97f tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:38.639855 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-120ae2ef-30d0-457b-ba11-1a9dbb45d97f tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:38.640800 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-120ae2ef-30d0-457b-ba11-1a9dbb45d97f tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:38.642233 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-120ae2ef-30d0-457b-ba11-1a9dbb45d97f tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:38.642955 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-120ae2ef-30d0-457b-ba11-1a9dbb45d97f tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:38.692116 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-9651cc71-f285-4352-a862-e7ae96cfc2ba tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action" status: 200 len: 24574 microversion: 2.1 time: 0.112135 Jan 15 21:05:38.693457 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2652/5294] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:05:38 2022] POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action => generated 24574 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 21:05:38.832295 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-120ae2ef-30d0-457b-ba11-1a9dbb45d97f tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:05:38.843857 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-120ae2ef-30d0-457b-ba11-1a9dbb45d97f tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9" status: 200 len: 1678 microversion: 2.1 time: 0.219176 Jan 15 21:05:38.854831 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2643/5295] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:05:38 2022] GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9 => generated 1678 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:05:39.223935 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7a908017-16a5-4bd1-957f-0d9bce197907 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:39.225713 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-7a908017-16a5-4bd1-957f-0d9bce197907 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:39.247692 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7a908017-16a5-4bd1-957f-0d9bce197907 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:39.248163 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7a908017-16a5-4bd1-957f-0d9bce197907 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:39.256604 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7a908017-16a5-4bd1-957f-0d9bce197907 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:39.257604 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7a908017-16a5-4bd1-957f-0d9bce197907 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:39.331137 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7a908017-16a5-4bd1-957f-0d9bce197907 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action" status: 200 len: 32638 microversion: 2.20 time: 0.114974 Jan 15 21:05:39.332235 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2653/5296] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:39 2022] POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action => generated 32638 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:05:39.588502 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a7588e05-673d-48d6-b250-8be79f156ea8 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:39.589465 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a7588e05-673d-48d6-b250-8be79f156ea8 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:39.598152 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a7588e05-673d-48d6-b250-8be79f156ea8 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:39.599011 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a7588e05-673d-48d6-b250-8be79f156ea8 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:39.600125 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a7588e05-673d-48d6-b250-8be79f156ea8 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:39.600778 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a7588e05-673d-48d6-b250-8be79f156ea8 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:39.654824 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a7588e05-673d-48d6-b250-8be79f156ea8 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.071088 Jan 15 21:05:39.657348 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2644/5297] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:39 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:05:39.706355 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-53e7d6bd-b20d-455e-bc0e-702b9ec9aa0b tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:39.714071 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-53e7d6bd-b20d-455e-bc0e-702b9ec9aa0b tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: d9db70df-9ffc-4b96-af06-a56b3b35ce91] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:39.728615 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-53e7d6bd-b20d-455e-bc0e-702b9ec9aa0b tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:39.729111 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-53e7d6bd-b20d-455e-bc0e-702b9ec9aa0b tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:39.729905 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-53e7d6bd-b20d-455e-bc0e-702b9ec9aa0b tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:39.732000 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-53e7d6bd-b20d-455e-bc0e-702b9ec9aa0b tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:39.810431 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-53e7d6bd-b20d-455e-bc0e-702b9ec9aa0b tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action" status: 200 len: 32646 microversion: 2.1 time: 0.108597 Jan 15 21:05:39.812610 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2654/5298] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:05:39 2022] POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action => generated 32646 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 21:05:39.865214 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5408aaf4-e730-4d3f-9b8d-ebd1213f5870 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:05:39.866456 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-5408aaf4-e730-4d3f-9b8d-ebd1213f5870 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:39.875455 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5408aaf4-e730-4d3f-9b8d-ebd1213f5870 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:39.876154 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5408aaf4-e730-4d3f-9b8d-ebd1213f5870 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:39.877459 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5408aaf4-e730-4d3f-9b8d-ebd1213f5870 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:39.878148 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5408aaf4-e730-4d3f-9b8d-ebd1213f5870 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:40.242274 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-5408aaf4-e730-4d3f-9b8d-ebd1213f5870 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:05:40.251921 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5408aaf4-e730-4d3f-9b8d-ebd1213f5870 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9" status: 200 len: 1661 microversion: 2.1 time: 0.393287 Jan 15 21:05:40.252531 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2645/5299] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:05:39 2022] GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9 => generated 1661 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:05:40.269443 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-5538030e-387a-4db9-ac53-eca319f81ee6 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:40.270343 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-5538030e-387a-4db9-ac53-eca319f81ee6 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:40.278405 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5538030e-387a-4db9-ac53-eca319f81ee6 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:40.279234 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5538030e-387a-4db9-ac53-eca319f81ee6 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:40.280246 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5538030e-387a-4db9-ac53-eca319f81ee6 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:40.280918 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5538030e-387a-4db9-ac53-eca319f81ee6 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:40.344583 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-cb69d2d6-f992-41bc-b2e2-e67890d66c24 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:40.345643 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-cb69d2d6-f992-41bc-b2e2-e67890d66c24 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:40.362259 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cb69d2d6-f992-41bc-b2e2-e67890d66c24 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:40.363117 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cb69d2d6-f992-41bc-b2e2-e67890d66c24 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:40.364330 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cb69d2d6-f992-41bc-b2e2-e67890d66c24 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:40.365197 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cb69d2d6-f992-41bc-b2e2-e67890d66c24 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:40.370705 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-5538030e-387a-4db9-ac53-eca319f81ee6 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action" status: 202 len: 0 microversion: 2.1 time: 0.105121 Jan 15 21:05:40.372355 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2655/5300] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:05:40 2022] POST /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:05:40.388778 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-fc5dcf84-980d-4e53-b7f3-f59e5d922313 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:05:40.389611 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-fc5dcf84-980d-4e53-b7f3-f59e5d922313 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:40.398048 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fc5dcf84-980d-4e53-b7f3-f59e5d922313 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:40.398723 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fc5dcf84-980d-4e53-b7f3-f59e5d922313 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:40.400591 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fc5dcf84-980d-4e53-b7f3-f59e5d922313 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:40.401248 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fc5dcf84-980d-4e53-b7f3-f59e5d922313 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:40.429963 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-cb69d2d6-f992-41bc-b2e2-e67890d66c24 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action" status: 200 len: 32638 microversion: 2.20 time: 0.090079 Jan 15 21:05:40.439075 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2646/5301] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:40 2022] POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action => generated 32638 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:05:40.555668 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-fc5dcf84-980d-4e53-b7f3-f59e5d922313 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:05:40.564626 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-fc5dcf84-980d-4e53-b7f3-f59e5d922313 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9" status: 200 len: 1667 microversion: 2.1 time: 0.181353 Jan 15 21:05:40.565425 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2656/5302] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:05:40 2022] GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9 => generated 1667 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:05:40.669989 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f36bfa9b-4504-4e2b-bff4-8e9a869f7863 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:40.671011 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f36bfa9b-4504-4e2b-bff4-8e9a869f7863 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:40.678160 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f36bfa9b-4504-4e2b-bff4-8e9a869f7863 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:40.678650 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f36bfa9b-4504-4e2b-bff4-8e9a869f7863 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:40.679445 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f36bfa9b-4504-4e2b-bff4-8e9a869f7863 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:40.679884 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f36bfa9b-4504-4e2b-bff4-8e9a869f7863 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:40.724972 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f36bfa9b-4504-4e2b-bff4-8e9a869f7863 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.059366 Jan 15 21:05:40.725948 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2647/5303] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:40 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:05:40.824027 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7c07b01f-c250-4da2-959b-bef349c1c452 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:40.825215 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-7c07b01f-c250-4da2-959b-bef349c1c452 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: d9db70df-9ffc-4b96-af06-a56b3b35ce91] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:40.832609 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7c07b01f-c250-4da2-959b-bef349c1c452 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:40.833289 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7c07b01f-c250-4da2-959b-bef349c1c452 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:40.834413 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7c07b01f-c250-4da2-959b-bef349c1c452 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:40.834857 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7c07b01f-c250-4da2-959b-bef349c1c452 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:40.880033 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7c07b01f-c250-4da2-959b-bef349c1c452 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action" status: 200 len: 32646 microversion: 2.1 time: 0.059928 Jan 15 21:05:40.881464 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2657/5304] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:05:40 2022] POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action => generated 32646 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:05:41.442877 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-152ddf68-4faf-41fc-94fd-417d268b5ad5 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:41.443908 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-152ddf68-4faf-41fc-94fd-417d268b5ad5 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:41.452339 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-152ddf68-4faf-41fc-94fd-417d268b5ad5 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:41.452788 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-152ddf68-4faf-41fc-94fd-417d268b5ad5 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:41.453598 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-152ddf68-4faf-41fc-94fd-417d268b5ad5 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:41.454218 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-152ddf68-4faf-41fc-94fd-417d268b5ad5 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:41.508328 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-152ddf68-4faf-41fc-94fd-417d268b5ad5 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action" status: 200 len: 32638 microversion: 2.20 time: 0.069510 Jan 15 21:05:41.510785 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2648/5305] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:41 2022] POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action => generated 32638 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:05:41.584371 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-3002544b-4d85-4ead-840a-f3f6db36cf31 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:05:41.585864 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-3002544b-4d85-4ead-840a-f3f6db36cf31 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:41.594431 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3002544b-4d85-4ead-840a-f3f6db36cf31 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:41.594904 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3002544b-4d85-4ead-840a-f3f6db36cf31 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:41.595911 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3002544b-4d85-4ead-840a-f3f6db36cf31 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:41.596351 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3002544b-4d85-4ead-840a-f3f6db36cf31 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:41.739726 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-1db26e4e-ce58-4adb-b6f2-eaa4e98b3547 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:41.740909 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-1db26e4e-ce58-4adb-b6f2-eaa4e98b3547 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:41.749456 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1db26e4e-ce58-4adb-b6f2-eaa4e98b3547 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:41.749992 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1db26e4e-ce58-4adb-b6f2-eaa4e98b3547 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:41.750904 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1db26e4e-ce58-4adb-b6f2-eaa4e98b3547 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:41.751446 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1db26e4e-ce58-4adb-b6f2-eaa4e98b3547 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:41.797271 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-1db26e4e-ce58-4adb-b6f2-eaa4e98b3547 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.062154 Jan 15 21:05:41.798312 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2649/5306] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:41 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:05:41.894582 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-6b95a341-6568-4593-addf-b006c1ecfd16 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:41.895780 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-3002544b-4d85-4ead-840a-f3f6db36cf31 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:05:41.898049 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-6b95a341-6568-4593-addf-b006c1ecfd16 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: d9db70df-9ffc-4b96-af06-a56b3b35ce91] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:41.910368 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-3002544b-4d85-4ead-840a-f3f6db36cf31 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9" status: 200 len: 1667 microversion: 2.1 time: 0.329883 Jan 15 21:05:41.912925 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6b95a341-6568-4593-addf-b006c1ecfd16 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:41.913570 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2658/5307] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:05:41 2022] GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9 => generated 1667 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:05:41.914096 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6b95a341-6568-4593-addf-b006c1ecfd16 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:41.914969 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6b95a341-6568-4593-addf-b006c1ecfd16 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:41.915484 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6b95a341-6568-4593-addf-b006c1ecfd16 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:41.962792 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-6b95a341-6568-4593-addf-b006c1ecfd16 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action" status: 200 len: 32646 microversion: 2.1 time: 0.071797 Jan 15 21:05:41.964373 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2650/5308] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:05:41 2022] POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action => generated 32646 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:05:42.521373 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1ea0b981-8863-493b-ab40-b2d9873f57c7 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:42.522622 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-1ea0b981-8863-493b-ab40-b2d9873f57c7 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:42.530845 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1ea0b981-8863-493b-ab40-b2d9873f57c7 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:42.531388 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1ea0b981-8863-493b-ab40-b2d9873f57c7 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:42.532453 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1ea0b981-8863-493b-ab40-b2d9873f57c7 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:42.533125 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1ea0b981-8863-493b-ab40-b2d9873f57c7 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:42.577822 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-1ea0b981-8863-493b-ab40-b2d9873f57c7 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action" status: 200 len: 32638 microversion: 2.20 time: 0.059945 Jan 15 21:05:42.578509 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2659/5309] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:42 2022] POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action => generated 32638 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:05:42.810239 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f4e7d9fe-af9f-4a0e-82ca-b14d8b288e45 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:42.811475 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f4e7d9fe-af9f-4a0e-82ca-b14d8b288e45 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:42.819547 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f4e7d9fe-af9f-4a0e-82ca-b14d8b288e45 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:42.820342 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f4e7d9fe-af9f-4a0e-82ca-b14d8b288e45 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:42.822677 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f4e7d9fe-af9f-4a0e-82ca-b14d8b288e45 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:42.823349 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f4e7d9fe-af9f-4a0e-82ca-b14d8b288e45 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:42.885673 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f4e7d9fe-af9f-4a0e-82ca-b14d8b288e45 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.078245 Jan 15 21:05:42.886935 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2651/5310] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:42 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:05:42.931728 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e7e1240a-f12b-4a29-a974-c40c653fe63b tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:05:42.933277 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e7e1240a-f12b-4a29-a974-c40c653fe63b tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:42.943693 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e7e1240a-f12b-4a29-a974-c40c653fe63b tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:42.944728 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e7e1240a-f12b-4a29-a974-c40c653fe63b tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:42.945829 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e7e1240a-f12b-4a29-a974-c40c653fe63b tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:42.947088 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e7e1240a-f12b-4a29-a974-c40c653fe63b tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:42.974722 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f867a5df-2ac3-43e1-b09d-4982c9f120d9 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:42.976297 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f867a5df-2ac3-43e1-b09d-4982c9f120d9 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: d9db70df-9ffc-4b96-af06-a56b3b35ce91] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:42.996097 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f867a5df-2ac3-43e1-b09d-4982c9f120d9 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:42.997003 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f867a5df-2ac3-43e1-b09d-4982c9f120d9 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:42.997921 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f867a5df-2ac3-43e1-b09d-4982c9f120d9 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:42.998468 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f867a5df-2ac3-43e1-b09d-4982c9f120d9 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:43.081245 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f867a5df-2ac3-43e1-b09d-4982c9f120d9 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action" status: 200 len: 32646 microversion: 2.1 time: 0.110447 Jan 15 21:05:43.086168 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2652/5311] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:05:42 2022] POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action => generated 32646 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 21:05:43.181443 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-e7e1240a-f12b-4a29-a974-c40c653fe63b tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:05:43.194879 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e7e1240a-f12b-4a29-a974-c40c653fe63b tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9" status: 200 len: 1670 microversion: 2.1 time: 0.267394 Jan 15 21:05:43.197167 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2660/5312] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:05:42 2022] GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9 => generated 1670 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:05:43.213371 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5934d5c9-ffe9-4fe1-a84b-c12f6522d02d tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:05:43.214232 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-5934d5c9-ffe9-4fe1-a84b-c12f6522d02d tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:43.227611 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5934d5c9-ffe9-4fe1-a84b-c12f6522d02d tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:43.227611 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5934d5c9-ffe9-4fe1-a84b-c12f6522d02d tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:43.227611 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5934d5c9-ffe9-4fe1-a84b-c12f6522d02d tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:43.227611 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5934d5c9-ffe9-4fe1-a84b-c12f6522d02d tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:43.408214 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-5934d5c9-ffe9-4fe1-a84b-c12f6522d02d tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:05:43.419237 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5934d5c9-ffe9-4fe1-a84b-c12f6522d02d tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9" status: 200 len: 1670 microversion: 2.1 time: 0.211098 Jan 15 21:05:43.436916 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-bfa2f841-11ef-4228-bd38-63c3f7e9a87a tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:05:43.437157 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2653/5313] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:05:43 2022] GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9 => generated 1670 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:05:43.437796 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-bfa2f841-11ef-4228-bd38-63c3f7e9a87a tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: df405782-02e0-4416-9c91-818ea05dacaf] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:43.444970 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bfa2f841-11ef-4228-bd38-63c3f7e9a87a tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:43.445428 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bfa2f841-11ef-4228-bd38-63c3f7e9a87a tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:43.446996 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bfa2f841-11ef-4228-bd38-63c3f7e9a87a tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:43.447618 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bfa2f841-11ef-4228-bd38-63c3f7e9a87a tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:43.484681 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-bfa2f841-11ef-4228-bd38-63c3f7e9a87a tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: df405782-02e0-4416-9c91-818ea05dacaf] Going to try to terminate instance {{(pid=129366) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 21:05:43.492327 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.compute.api [None req-bfa2f841-11ef-4228-bd38-63c3f7e9a87a tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: df405782-02e0-4416-9c91-818ea05dacaf] Working on deleting snapshot a66c63fb-bba3-455a-bd0a-ea4f3f5ea207 from shelved instance... Jan 15 21:05:43.591314 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-bfe99f21-c16a-4c9c-8625-81199152e293 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:43.593025 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-bfe99f21-c16a-4c9c-8625-81199152e293 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:43.600160 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bfe99f21-c16a-4c9c-8625-81199152e293 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:43.600869 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bfe99f21-c16a-4c9c-8625-81199152e293 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:43.605855 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bfe99f21-c16a-4c9c-8625-81199152e293 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:43.606855 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bfe99f21-c16a-4c9c-8625-81199152e293 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:43.682490 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-bfe99f21-c16a-4c9c-8625-81199152e293 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action" status: 200 len: 32638 microversion: 2.20 time: 0.096796 Jan 15 21:05:43.684094 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2654/5314] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:43 2022] POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action => generated 32638 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:05:43.905432 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5d3019c3-c07b-49c6-b957-f1b6cddddd50 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:43.907368 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-5d3019c3-c07b-49c6-b957-f1b6cddddd50 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:43.917391 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5d3019c3-c07b-49c6-b957-f1b6cddddd50 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:43.917833 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5d3019c3-c07b-49c6-b957-f1b6cddddd50 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:43.919146 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5d3019c3-c07b-49c6-b957-f1b6cddddd50 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:43.919790 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5d3019c3-c07b-49c6-b957-f1b6cddddd50 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:44.007508 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5d3019c3-c07b-49c6-b957-f1b6cddddd50 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.111632 Jan 15 21:05:44.008206 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2655/5315] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:43 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:05:44.095291 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-7b745a1a-4bfa-4c32-be83-113f2d2fac6f tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:44.097181 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-7b745a1a-4bfa-4c32-be83-113f2d2fac6f tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: d9db70df-9ffc-4b96-af06-a56b3b35ce91] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:44.106164 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7b745a1a-4bfa-4c32-be83-113f2d2fac6f tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:44.106864 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7b745a1a-4bfa-4c32-be83-113f2d2fac6f tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:44.108404 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7b745a1a-4bfa-4c32-be83-113f2d2fac6f tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:44.109549 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7b745a1a-4bfa-4c32-be83-113f2d2fac6f tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:44.161263 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-7b745a1a-4bfa-4c32-be83-113f2d2fac6f tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action" status: 200 len: 32646 microversion: 2.1 time: 0.069782 Jan 15 21:05:44.161834 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2656/5316] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:05:44 2022] POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action => generated 32646 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 21:05:44.524214 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-bfa2f841-11ef-4228-bd38-63c3f7e9a87a tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: df405782-02e0-4416-9c91-818ea05dacaf] Doing local delete in cell 2935be83-7c51-430d-8ff2-0a8179973c9a(cell1) {{(pid=129366) _delete /opt/stack/nova/nova/compute/api.py:2439}} Jan 15 21:05:44.527255 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bfa2f841-11ef-4228-bd38-63c3f7e9a87a tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:44.528204 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bfa2f841-11ef-4228-bd38-63c3f7e9a87a tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:44.528796 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.compute.api [None req-bfa2f841-11ef-4228-bd38-63c3f7e9a87a tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: df405782-02e0-4416-9c91-818ea05dacaf] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Jan 15 21:05:44.533498 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.network.neutron [None req-bfa2f841-11ef-4228-bd38-63c3f7e9a87a tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: df405782-02e0-4416-9c91-818ea05dacaf] deallocate_for_instance() {{(pid=129366) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1676}} Jan 15 21:05:44.695622 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ba8e72a1-b72e-4bfc-b64b-43305cfc8ba9 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:44.698436 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ba8e72a1-b72e-4bfc-b64b-43305cfc8ba9 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:44.706561 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ba8e72a1-b72e-4bfc-b64b-43305cfc8ba9 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:44.707946 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ba8e72a1-b72e-4bfc-b64b-43305cfc8ba9 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:44.709305 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ba8e72a1-b72e-4bfc-b64b-43305cfc8ba9 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:44.710002 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ba8e72a1-b72e-4bfc-b64b-43305cfc8ba9 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:44.764531 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ba8e72a1-b72e-4bfc-b64b-43305cfc8ba9 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action" status: 200 len: 32638 microversion: 2.20 time: 0.072922 Jan 15 21:05:44.768226 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2657/5317] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:44 2022] POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action => generated 32638 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:05:45.021197 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d2712f01-b729-4c41-9218-afde314f1ad4 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:45.022994 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d2712f01-b729-4c41-9218-afde314f1ad4 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:45.030801 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d2712f01-b729-4c41-9218-afde314f1ad4 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:45.031252 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d2712f01-b729-4c41-9218-afde314f1ad4 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:45.032370 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d2712f01-b729-4c41-9218-afde314f1ad4 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:45.032805 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d2712f01-b729-4c41-9218-afde314f1ad4 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:45.079370 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d2712f01-b729-4c41-9218-afde314f1ad4 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.062205 Jan 15 21:05:45.080173 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2658/5318] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:45 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:05:45.175155 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-24fe332c-fed1-40b4-bb04-408a825dbc87 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:45.177205 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-24fe332c-fed1-40b4-bb04-408a825dbc87 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: d9db70df-9ffc-4b96-af06-a56b3b35ce91] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:45.205880 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-24fe332c-fed1-40b4-bb04-408a825dbc87 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:45.208083 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-24fe332c-fed1-40b4-bb04-408a825dbc87 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:45.209027 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-24fe332c-fed1-40b4-bb04-408a825dbc87 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:45.209691 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-24fe332c-fed1-40b4-bb04-408a825dbc87 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:45.264119 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.network.neutron [None req-bfa2f841-11ef-4228-bd38-63c3f7e9a87a tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: df405782-02e0-4416-9c91-818ea05dacaf] Updating instance_info_cache with network_info: [] {{(pid=129366) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jan 15 21:05:45.279144 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-24fe332c-fed1-40b4-bb04-408a825dbc87 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action" status: 200 len: 32646 microversion: 2.1 time: 0.108842 Jan 15 21:05:45.280938 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2659/5319] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:05:45 2022] POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action => generated 32646 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 21:05:45.290851 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-7e5877e5-cffa-44e0-8ef1-d4e3bda77a04 req-23750c1c-b19f-4ace-b6ef-a0d1997e9c34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df405782-02e0-4416-9c91-818ea05dacaf", "name": "network-vif-deleted", "tag": "43dfb9cf-e68a-4c7c-b0c6-7b7fcd77dbf4"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:45.294652 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:05:45.294652 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:05:45.307793 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-7e5877e5-cffa-44e0-8ef1-d4e3bda77a04 req-23750c1c-b19f-4ace-b6ef-a0d1997e9c34 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:45.308942 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-7e5877e5-cffa-44e0-8ef1-d4e3bda77a04 req-23750c1c-b19f-4ace-b6ef-a0d1997e9c34 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:45.326443 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.compute.server_external_events [req-7e5877e5-cffa-44e0-8ef1-d4e3bda77a04 req-23750c1c-b19f-4ace-b6ef-a0d1997e9c34 service nova] Unable to find a host for instance df405782-02e0-4416-9c91-818ea05dacaf. Dropping event network-vif-deleted {{(pid=129365) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Jan 15 21:05:45.327782 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-7e5877e5-cffa-44e0-8ef1-d4e3bda77a04 req-23750c1c-b19f-4ace-b6ef-a0d1997e9c34 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.045061 Jan 15 21:05:45.329748 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2660/5320] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:05:45 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 48 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jan 15 21:05:45.721041 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-bfa2f841-11ef-4228-bd38-63c3f7e9a87a tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "DELETE /compute/v2.1/servers/df405782-02e0-4416-9c91-818ea05dacaf" status: 204 len: 0 microversion: 2.1 time: 2.287683 Jan 15 21:05:45.721851 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2661/5321] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 21:05:43 2022] DELETE /compute/v2.1/servers/df405782-02e0-4416-9c91-818ea05dacaf => generated 0 bytes in 2289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 21:05:45.731176 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-dec3e3b5-993b-4c87-aa3b-fded8d6784b2 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:05:45.731919 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-dec3e3b5-993b-4c87-aa3b-fded8d6784b2 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: df405782-02e0-4416-9c91-818ea05dacaf] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:45.738184 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dec3e3b5-993b-4c87-aa3b-fded8d6784b2 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:45.738644 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dec3e3b5-993b-4c87-aa3b-fded8d6784b2 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:45.739443 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dec3e3b5-993b-4c87-aa3b-fded8d6784b2 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:45.739888 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dec3e3b5-993b-4c87-aa3b-fded8d6784b2 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:45.760979 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-dec3e3b5-993b-4c87-aa3b-fded8d6784b2 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] HTTP exception thrown: Instance df405782-02e0-4416-9c91-818ea05dacaf could not be found. Jan 15 21:05:45.761588 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-dec3e3b5-993b-4c87-aa3b-fded8d6784b2 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Returning 404 to user: Instance df405782-02e0-4416-9c91-818ea05dacaf could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:05:45.762875 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-dec3e3b5-993b-4c87-aa3b-fded8d6784b2 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/df405782-02e0-4416-9c91-818ea05dacaf" status: 404 len: 111 microversion: 2.1 time: 0.036552 Jan 15 21:05:45.763783 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2661/5322] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:05:45 2022] GET /compute/v2.1/servers/df405782-02e0-4416-9c91-818ea05dacaf => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:05:45.772386 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-732750b6-7ed9-4b77-bd85-389b0b50ad3e tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:05:45.772997 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-732750b6-7ed9-4b77-bd85-389b0b50ad3e tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 1d45824f-26ca-49c6-971e-f502336f956f] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:45.780151 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-732750b6-7ed9-4b77-bd85-389b0b50ad3e tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:45.780998 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-732750b6-7ed9-4b77-bd85-389b0b50ad3e tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:45.781512 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-496294d3-8825-4da9-ab8f-988b4f5e7bd6 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:45.781959 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-732750b6-7ed9-4b77-bd85-389b0b50ad3e tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:45.782393 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-732750b6-7ed9-4b77-bd85-389b0b50ad3e tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:45.783278 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-496294d3-8825-4da9-ab8f-988b4f5e7bd6 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:45.793672 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-496294d3-8825-4da9-ab8f-988b4f5e7bd6 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:45.794362 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-496294d3-8825-4da9-ab8f-988b4f5e7bd6 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:45.795396 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-496294d3-8825-4da9-ab8f-988b4f5e7bd6 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:45.796042 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-496294d3-8825-4da9-ab8f-988b4f5e7bd6 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:45.826282 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-732750b6-7ed9-4b77-bd85-389b0b50ad3e tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 1d45824f-26ca-49c6-971e-f502336f956f] Going to try to terminate instance {{(pid=129366) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 21:05:45.862864 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-496294d3-8825-4da9-ab8f-988b4f5e7bd6 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action" status: 200 len: 32638 microversion: 2.20 time: 0.086282 Jan 15 21:05:45.870000 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2662/5323] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:45 2022] POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action => generated 32638 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:05:45.945070 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-732750b6-7ed9-4b77-bd85-389b0b50ad3e tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "DELETE /compute/v2.1/servers/1d45824f-26ca-49c6-971e-f502336f956f" status: 204 len: 0 microversion: 2.1 time: 0.175796 Jan 15 21:05:45.945627 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2662/5324] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 21:05:45 2022] DELETE /compute/v2.1/servers/1d45824f-26ca-49c6-971e-f502336f956f => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 21:05:45.954647 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-4b7cda8d-2c16-4a95-8615-b92a04da5010 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:05:45.955584 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-4b7cda8d-2c16-4a95-8615-b92a04da5010 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 1d45824f-26ca-49c6-971e-f502336f956f] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:45.963829 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4b7cda8d-2c16-4a95-8615-b92a04da5010 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:45.964567 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4b7cda8d-2c16-4a95-8615-b92a04da5010 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:45.965615 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4b7cda8d-2c16-4a95-8615-b92a04da5010 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:45.966230 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4b7cda8d-2c16-4a95-8615-b92a04da5010 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:46.095278 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-90489aff-f550-4344-9d78-ababe0156955 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:46.097228 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-90489aff-f550-4344-9d78-ababe0156955 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:46.105090 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-90489aff-f550-4344-9d78-ababe0156955 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:46.105819 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-90489aff-f550-4344-9d78-ababe0156955 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:46.107441 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-90489aff-f550-4344-9d78-ababe0156955 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:46.108066 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-90489aff-f550-4344-9d78-ababe0156955 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:46.128785 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-4b7cda8d-2c16-4a95-8615-b92a04da5010 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:05:46.140464 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-4b7cda8d-2c16-4a95-8615-b92a04da5010 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/1d45824f-26ca-49c6-971e-f502336f956f" status: 200 len: 1466 microversion: 2.1 time: 0.190015 Jan 15 21:05:46.142310 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2663/5325] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:05:45 2022] GET /compute/v2.1/servers/1d45824f-26ca-49c6-971e-f502336f956f => generated 1466 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:05:46.186915 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-90489aff-f550-4344-9d78-ababe0156955 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.097495 Jan 15 21:05:46.188918 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2663/5326] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:46 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:05:46.290910 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e8fba4b9-798d-4712-82b4-fa1c0d4eb2bd tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:46.291817 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e8fba4b9-798d-4712-82b4-fa1c0d4eb2bd tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: d9db70df-9ffc-4b96-af06-a56b3b35ce91] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:46.298715 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e8fba4b9-798d-4712-82b4-fa1c0d4eb2bd tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:46.299670 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e8fba4b9-798d-4712-82b4-fa1c0d4eb2bd tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:46.300468 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e8fba4b9-798d-4712-82b4-fa1c0d4eb2bd tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:46.300935 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e8fba4b9-798d-4712-82b4-fa1c0d4eb2bd tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:46.347637 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e8fba4b9-798d-4712-82b4-fa1c0d4eb2bd tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action" status: 200 len: 32646 microversion: 2.1 time: 0.060282 Jan 15 21:05:46.348799 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2664/5327] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:05:46 2022] POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action => generated 32646 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:05:46.877725 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9ac85f52-2d3c-4554-adf6-f71534b460e5 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:46.878864 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-9ac85f52-2d3c-4554-adf6-f71534b460e5 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:46.890266 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9ac85f52-2d3c-4554-adf6-f71534b460e5 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:46.891298 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9ac85f52-2d3c-4554-adf6-f71534b460e5 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:46.892386 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9ac85f52-2d3c-4554-adf6-f71534b460e5 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:46.892827 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9ac85f52-2d3c-4554-adf6-f71534b460e5 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:46.935847 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-9ac85f52-2d3c-4554-adf6-f71534b460e5 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action" status: 200 len: 32638 microversion: 2.20 time: 0.062300 Jan 15 21:05:46.936583 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2664/5328] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:46 2022] POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action => generated 32638 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:05:47.159580 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-bc762614-8276-43a6-b0cb-d68d2a47c7b7 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:05:47.160367 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-bc762614-8276-43a6-b0cb-d68d2a47c7b7 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 1d45824f-26ca-49c6-971e-f502336f956f] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:47.176437 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bc762614-8276-43a6-b0cb-d68d2a47c7b7 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:47.180392 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bc762614-8276-43a6-b0cb-d68d2a47c7b7 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:47.181885 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bc762614-8276-43a6-b0cb-d68d2a47c7b7 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:47.182663 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bc762614-8276-43a6-b0cb-d68d2a47c7b7 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:47.204906 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-5ff86f45-7073-439a-9a4c-a1be226310a6 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:47.206217 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-5ff86f45-7073-439a-9a4c-a1be226310a6 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:47.219674 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5ff86f45-7073-439a-9a4c-a1be226310a6 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:47.220496 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5ff86f45-7073-439a-9a4c-a1be226310a6 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:47.222280 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5ff86f45-7073-439a-9a4c-a1be226310a6 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:47.222976 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5ff86f45-7073-439a-9a4c-a1be226310a6 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:47.286093 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-5ff86f45-7073-439a-9a4c-a1be226310a6 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.087500 Jan 15 21:05:47.295299 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2665/5329] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:47 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:05:47.343806 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-bc762614-8276-43a6-b0cb-d68d2a47c7b7 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:05:47.359858 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c98e8edc-48c6-4959-bf29-b9d303de73c4 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:47.370212 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c98e8edc-48c6-4959-bf29-b9d303de73c4 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: d9db70df-9ffc-4b96-af06-a56b3b35ce91] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:47.371551 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-bc762614-8276-43a6-b0cb-d68d2a47c7b7 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/1d45824f-26ca-49c6-971e-f502336f956f" status: 200 len: 1466 microversion: 2.1 time: 0.216100 Jan 15 21:05:47.380058 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c98e8edc-48c6-4959-bf29-b9d303de73c4 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:47.382027 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2665/5330] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:05:47 2022] GET /compute/v2.1/servers/1d45824f-26ca-49c6-971e-f502336f956f => generated 1466 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:05:47.383315 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c98e8edc-48c6-4959-bf29-b9d303de73c4 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:47.384741 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c98e8edc-48c6-4959-bf29-b9d303de73c4 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:47.385217 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c98e8edc-48c6-4959-bf29-b9d303de73c4 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:47.453539 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c98e8edc-48c6-4959-bf29-b9d303de73c4 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action" status: 200 len: 32646 microversion: 2.1 time: 0.097419 Jan 15 21:05:47.461947 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2666/5331] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:05:47 2022] POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action => generated 32646 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:05:47.951933 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-1b408748-d540-42b1-b0ce-f8cb5b3d1689 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:47.953428 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-1b408748-d540-42b1-b0ce-f8cb5b3d1689 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:47.960932 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1b408748-d540-42b1-b0ce-f8cb5b3d1689 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:47.961362 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1b408748-d540-42b1-b0ce-f8cb5b3d1689 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:47.963490 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1b408748-d540-42b1-b0ce-f8cb5b3d1689 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:47.964175 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1b408748-d540-42b1-b0ce-f8cb5b3d1689 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:48.034863 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-1b408748-d540-42b1-b0ce-f8cb5b3d1689 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action" status: 200 len: 32638 microversion: 2.20 time: 0.085150 Jan 15 21:05:48.038294 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2666/5332] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:47 2022] POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action => generated 32638 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:05:48.082895 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-01e960b7-53a9-4ff0-a88b-dc841bf9e815 req-bee843e9-fa2b-4634-be7a-c6f6981635be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d45824f-26ca-49c6-971e-f502336f956f", "name": "network-vif-deleted", "tag": "ab07dc98-af7c-4650-b36e-d8be43ca08c1"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:48.084922 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:05:48.084922 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:05:48.108202 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-01e960b7-53a9-4ff0-a88b-dc841bf9e815 req-bee843e9-fa2b-4634-be7a-c6f6981635be service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:48.108681 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-01e960b7-53a9-4ff0-a88b-dc841bf9e815 req-bee843e9-fa2b-4634-be7a-c6f6981635be service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:48.130340 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-01e960b7-53a9-4ff0-a88b-dc841bf9e815 req-bee843e9-fa2b-4634-be7a-c6f6981635be service nova] Creating event network-vif-deleted:ab07dc98-af7c-4650-b36e-d8be43ca08c1 for instance 1d45824f-26ca-49c6-971e-f502336f956f on nch2-master-1 Jan 15 21:05:48.136750 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-01e960b7-53a9-4ff0-a88b-dc841bf9e815 req-bee843e9-fa2b-4634-be7a-c6f6981635be service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059814 Jan 15 21:05:48.137936 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2667/5333] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:05:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:05:48.303651 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-1d1c69cf-2557-4b4c-a93a-3027545a480b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:48.305337 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-1d1c69cf-2557-4b4c-a93a-3027545a480b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:48.313270 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1d1c69cf-2557-4b4c-a93a-3027545a480b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:48.313725 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1d1c69cf-2557-4b4c-a93a-3027545a480b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:48.314720 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1d1c69cf-2557-4b4c-a93a-3027545a480b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:48.315162 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1d1c69cf-2557-4b4c-a93a-3027545a480b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:48.360988 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-1d1c69cf-2557-4b4c-a93a-3027545a480b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.061339 Jan 15 21:05:48.361749 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2667/5334] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:48 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:05:48.400831 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b446c23d-d5c3-4985-ac21-eb1c61cb9931 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:05:48.402125 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b446c23d-d5c3-4985-ac21-eb1c61cb9931 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 1d45824f-26ca-49c6-971e-f502336f956f] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:48.410525 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b446c23d-d5c3-4985-ac21-eb1c61cb9931 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:48.411285 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b446c23d-d5c3-4985-ac21-eb1c61cb9931 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:48.412244 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b446c23d-d5c3-4985-ac21-eb1c61cb9931 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:48.412868 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b446c23d-d5c3-4985-ac21-eb1c61cb9931 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:48.456394 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b446c23d-d5c3-4985-ac21-eb1c61cb9931 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:48.456867 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b446c23d-d5c3-4985-ac21-eb1c61cb9931 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:48.457304 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.objects.instance [None req-b446c23d-d5c3-4985-ac21-eb1c61cb9931 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lazy-loading 'fault' on Instance uuid 1d45824f-26ca-49c6-971e-f502336f956f {{(pid=129366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 21:05:48.470125 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2be42e00-2e06-49a3-80f6-0b3816095bb5 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:48.471669 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-2be42e00-2e06-49a3-80f6-0b3816095bb5 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: d9db70df-9ffc-4b96-af06-a56b3b35ce91] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:48.485563 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2be42e00-2e06-49a3-80f6-0b3816095bb5 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:48.486012 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2be42e00-2e06-49a3-80f6-0b3816095bb5 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:48.501958 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2be42e00-2e06-49a3-80f6-0b3816095bb5 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:48.502416 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2be42e00-2e06-49a3-80f6-0b3816095bb5 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:48.545303 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-b446c23d-d5c3-4985-ac21-eb1c61cb9931 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:05:48.560305 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b446c23d-d5c3-4985-ac21-eb1c61cb9931 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/1d45824f-26ca-49c6-971e-f502336f956f" status: 200 len: 1304 microversion: 2.1 time: 0.165266 Jan 15 21:05:48.562096 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2668/5335] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:05:48 2022] GET /compute/v2.1/servers/1d45824f-26ca-49c6-971e-f502336f956f => generated 1304 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:05:48.593795 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2be42e00-2e06-49a3-80f6-0b3816095bb5 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action" status: 200 len: 32646 microversion: 2.1 time: 0.129984 Jan 15 21:05:48.597912 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2668/5336] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:05:48 2022] POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action => generated 32646 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:05:49.048027 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ecc1a6c2-c5d1-4aa6-9bb8-807d0fd92583 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:49.049181 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ecc1a6c2-c5d1-4aa6-9bb8-807d0fd92583 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:49.056929 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ecc1a6c2-c5d1-4aa6-9bb8-807d0fd92583 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:49.057396 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ecc1a6c2-c5d1-4aa6-9bb8-807d0fd92583 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:49.058201 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ecc1a6c2-c5d1-4aa6-9bb8-807d0fd92583 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:49.058854 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ecc1a6c2-c5d1-4aa6-9bb8-807d0fd92583 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:49.112521 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ecc1a6c2-c5d1-4aa6-9bb8-807d0fd92583 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action" status: 200 len: 32638 microversion: 2.20 time: 0.068163 Jan 15 21:05:49.114643 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2669/5337] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:49 2022] POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action => generated 32638 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:05:49.382566 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-0935019a-c452-4812-9043-b155641564ca tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:49.383668 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-0935019a-c452-4812-9043-b155641564ca tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:49.391505 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0935019a-c452-4812-9043-b155641564ca tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:49.392064 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0935019a-c452-4812-9043-b155641564ca tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:49.393116 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0935019a-c452-4812-9043-b155641564ca tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:49.393554 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0935019a-c452-4812-9043-b155641564ca tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:49.442655 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-0935019a-c452-4812-9043-b155641564ca tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.072275 Jan 15 21:05:49.446575 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2669/5338] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:49 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:05:49.579142 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-67c2c529-8721-405a-acff-911cadde0ed3 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:05:49.580283 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-67c2c529-8721-405a-acff-911cadde0ed3 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 1d45824f-26ca-49c6-971e-f502336f956f] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:49.588448 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-67c2c529-8721-405a-acff-911cadde0ed3 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:49.589269 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-67c2c529-8721-405a-acff-911cadde0ed3 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:49.590142 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-67c2c529-8721-405a-acff-911cadde0ed3 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:49.590683 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-67c2c529-8721-405a-acff-911cadde0ed3 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:49.609689 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-67c2c529-8721-405a-acff-911cadde0ed3 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] HTTP exception thrown: Instance 1d45824f-26ca-49c6-971e-f502336f956f could not be found. Jan 15 21:05:49.610905 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-67c2c529-8721-405a-acff-911cadde0ed3 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Returning 404 to user: Instance 1d45824f-26ca-49c6-971e-f502336f956f could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:05:49.611121 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-67c2c529-8721-405a-acff-911cadde0ed3 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/1d45824f-26ca-49c6-971e-f502336f956f" status: 404 len: 111 microversion: 2.1 time: 0.036270 Jan 15 21:05:49.611420 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e6e78829-8f80-4c61-8afc-ae1146acd06b tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:49.613160 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e6e78829-8f80-4c61-8afc-ae1146acd06b tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: d9db70df-9ffc-4b96-af06-a56b3b35ce91] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:49.616052 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2670/5339] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:05:49 2022] GET /compute/v2.1/servers/1d45824f-26ca-49c6-971e-f502336f956f => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:05:49.621640 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-2adf4024-c9d9-4f3d-945b-6c1bb3aefe9c tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:05:49.622385 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-2adf4024-c9d9-4f3d-945b-6c1bb3aefe9c tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: d09ef93d-246f-464d-8c9c-f5a6fa14e4fe] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:49.623802 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e6e78829-8f80-4c61-8afc-ae1146acd06b tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:49.624384 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e6e78829-8f80-4c61-8afc-ae1146acd06b tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:49.625404 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e6e78829-8f80-4c61-8afc-ae1146acd06b tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:49.625847 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e6e78829-8f80-4c61-8afc-ae1146acd06b tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:49.628933 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2adf4024-c9d9-4f3d-945b-6c1bb3aefe9c tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:49.629393 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2adf4024-c9d9-4f3d-945b-6c1bb3aefe9c tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:49.631419 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2adf4024-c9d9-4f3d-945b-6c1bb3aefe9c tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:49.632137 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2adf4024-c9d9-4f3d-945b-6c1bb3aefe9c tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:49.664371 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-2adf4024-c9d9-4f3d-945b-6c1bb3aefe9c tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: d09ef93d-246f-464d-8c9c-f5a6fa14e4fe] Going to try to terminate instance {{(pid=129366) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 21:05:49.679821 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e6e78829-8f80-4c61-8afc-ae1146acd06b tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action" status: 200 len: 32646 microversion: 2.1 time: 0.074397 Jan 15 21:05:49.684367 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2670/5340] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:05:49 2022] POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action => generated 32646 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:05:49.755219 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-2adf4024-c9d9-4f3d-945b-6c1bb3aefe9c tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "DELETE /compute/v2.1/servers/d09ef93d-246f-464d-8c9c-f5a6fa14e4fe" status: 204 len: 0 microversion: 2.1 time: 0.137135 Jan 15 21:05:49.756084 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2671/5341] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 21:05:49 2022] DELETE /compute/v2.1/servers/d09ef93d-246f-464d-8c9c-f5a6fa14e4fe => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 15 21:05:49.770468 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c1468f83-06e5-4382-8d06-18d7ac4f6284 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:05:49.775938 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c1468f83-06e5-4382-8d06-18d7ac4f6284 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: d09ef93d-246f-464d-8c9c-f5a6fa14e4fe] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:49.789092 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c1468f83-06e5-4382-8d06-18d7ac4f6284 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:49.789815 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c1468f83-06e5-4382-8d06-18d7ac4f6284 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:49.792514 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c1468f83-06e5-4382-8d06-18d7ac4f6284 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:49.793636 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c1468f83-06e5-4382-8d06-18d7ac4f6284 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:49.959961 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-c1468f83-06e5-4382-8d06-18d7ac4f6284 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:05:49.967663 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c1468f83-06e5-4382-8d06-18d7ac4f6284 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/d09ef93d-246f-464d-8c9c-f5a6fa14e4fe" status: 200 len: 1509 microversion: 2.1 time: 0.205226 Jan 15 21:05:49.968567 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2671/5342] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:05:49 2022] GET /compute/v2.1/servers/d09ef93d-246f-464d-8c9c-f5a6fa14e4fe => generated 1509 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:05:50.128192 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e246f8b7-0d28-402d-ae70-6177464e36e7 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:50.129495 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e246f8b7-0d28-402d-ae70-6177464e36e7 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:50.137710 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e246f8b7-0d28-402d-ae70-6177464e36e7 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:50.138164 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e246f8b7-0d28-402d-ae70-6177464e36e7 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:50.138946 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e246f8b7-0d28-402d-ae70-6177464e36e7 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:50.139382 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e246f8b7-0d28-402d-ae70-6177464e36e7 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:50.192718 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e246f8b7-0d28-402d-ae70-6177464e36e7 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action" status: 200 len: 32638 microversion: 2.20 time: 0.069109 Jan 15 21:05:50.194149 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2672/5343] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:50 2022] POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action => generated 32638 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:05:50.455488 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8fe62fd7-ee6a-4fda-a88d-a53dcdfe624f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:50.456714 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-8fe62fd7-ee6a-4fda-a88d-a53dcdfe624f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:50.464976 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8fe62fd7-ee6a-4fda-a88d-a53dcdfe624f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:50.465424 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8fe62fd7-ee6a-4fda-a88d-a53dcdfe624f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:50.466389 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8fe62fd7-ee6a-4fda-a88d-a53dcdfe624f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:50.466821 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8fe62fd7-ee6a-4fda-a88d-a53dcdfe624f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:50.516906 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-8fe62fd7-ee6a-4fda-a88d-a53dcdfe624f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.065872 Jan 15 21:05:50.518698 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2672/5344] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:50 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:05:50.928397 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d4d90a6c-019a-41df-be33-23d6825823aa tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:50.929523 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-d4d90a6c-019a-41df-be33-23d6825823aa tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: d9db70df-9ffc-4b96-af06-a56b3b35ce91] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:50.937694 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d4d90a6c-019a-41df-be33-23d6825823aa tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:50.938560 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d4d90a6c-019a-41df-be33-23d6825823aa tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:50.939840 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d4d90a6c-019a-41df-be33-23d6825823aa tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:50.941040 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d4d90a6c-019a-41df-be33-23d6825823aa tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:50.986523 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-41e3dfc4-8dbc-4f11-abf4-09ce4e112739 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:05:50.987579 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-41e3dfc4-8dbc-4f11-abf4-09ce4e112739 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: d09ef93d-246f-464d-8c9c-f5a6fa14e4fe] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:50.991399 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d4d90a6c-019a-41df-be33-23d6825823aa tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action" status: 200 len: 32646 microversion: 2.1 time: 0.300961 Jan 15 21:05:50.992041 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2673/5345] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:05:50 2022] POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action => generated 32646 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:05:50.996488 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-41e3dfc4-8dbc-4f11-abf4-09ce4e112739 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:50.997199 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-41e3dfc4-8dbc-4f11-abf4-09ce4e112739 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:50.998160 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-41e3dfc4-8dbc-4f11-abf4-09ce4e112739 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:50.998656 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-41e3dfc4-8dbc-4f11-abf4-09ce4e112739 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:51.200356 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-41e3dfc4-8dbc-4f11-abf4-09ce4e112739 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:05:51.209235 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-41e3dfc4-8dbc-4f11-abf4-09ce4e112739 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/d09ef93d-246f-464d-8c9c-f5a6fa14e4fe" status: 200 len: 1509 microversion: 2.1 time: 0.227144 Jan 15 21:05:51.219329 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-aec0e8ff-98d3-4dea-b762-a92a18e200dc tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:51.219996 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2673/5346] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:05:50 2022] GET /compute/v2.1/servers/d09ef93d-246f-464d-8c9c-f5a6fa14e4fe => generated 1509 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:05:51.220114 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-aec0e8ff-98d3-4dea-b762-a92a18e200dc tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:51.220830 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-aec0e8ff-98d3-4dea-b762-a92a18e200dc tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:51.221327 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-aec0e8ff-98d3-4dea-b762-a92a18e200dc tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:51.222179 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-aec0e8ff-98d3-4dea-b762-a92a18e200dc tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:51.222805 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-aec0e8ff-98d3-4dea-b762-a92a18e200dc tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:51.270318 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-aec0e8ff-98d3-4dea-b762-a92a18e200dc tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action" status: 200 len: 32638 microversion: 2.20 time: 0.067837 Jan 15 21:05:51.272067 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2674/5347] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:51 2022] POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action => generated 32638 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:05:51.531536 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a62186ff-ea81-456d-bf6a-47f21a180216 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:51.536173 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a62186ff-ea81-456d-bf6a-47f21a180216 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:51.553679 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a62186ff-ea81-456d-bf6a-47f21a180216 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:51.554385 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a62186ff-ea81-456d-bf6a-47f21a180216 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:51.555472 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a62186ff-ea81-456d-bf6a-47f21a180216 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:51.557466 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a62186ff-ea81-456d-bf6a-47f21a180216 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:51.625561 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a62186ff-ea81-456d-bf6a-47f21a180216 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.097995 Jan 15 21:05:51.631194 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2674/5348] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:51 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:05:51.880774 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-ccb6f5f6-a751-4194-8ff8-e44dfa7cb31a req-41faa20a-0bf0-47ec-96b9-7d5b2bd0630e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d09ef93d-246f-464d-8c9c-f5a6fa14e4fe", "name": "network-vif-deleted", "tag": "b02e61ea-6381-4f71-974b-68f69a1343f7"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:51.882640 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:05:51.882640 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:05:51.912507 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-ccb6f5f6-a751-4194-8ff8-e44dfa7cb31a req-41faa20a-0bf0-47ec-96b9-7d5b2bd0630e service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:51.919155 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-ccb6f5f6-a751-4194-8ff8-e44dfa7cb31a req-41faa20a-0bf0-47ec-96b9-7d5b2bd0630e service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:51.931651 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-ccb6f5f6-a751-4194-8ff8-e44dfa7cb31a req-41faa20a-0bf0-47ec-96b9-7d5b2bd0630e service nova] Creating event network-vif-deleted:b02e61ea-6381-4f71-974b-68f69a1343f7 for instance d09ef93d-246f-464d-8c9c-f5a6fa14e4fe on nch1-master-1 Jan 15 21:05:51.937238 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-ccb6f5f6-a751-4194-8ff8-e44dfa7cb31a req-41faa20a-0bf0-47ec-96b9-7d5b2bd0630e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061767 Jan 15 21:05:51.938204 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2675/5349] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:05:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:05:52.010609 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-1a2d0a7d-d7da-454d-bf8c-877f17be34fa tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:52.013324 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-1a2d0a7d-d7da-454d-bf8c-877f17be34fa tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: d9db70df-9ffc-4b96-af06-a56b3b35ce91] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:52.043230 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1a2d0a7d-d7da-454d-bf8c-877f17be34fa tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:52.044611 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1a2d0a7d-d7da-454d-bf8c-877f17be34fa tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:52.045546 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1a2d0a7d-d7da-454d-bf8c-877f17be34fa tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:52.045954 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1a2d0a7d-d7da-454d-bf8c-877f17be34fa tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:52.112786 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-1a2d0a7d-d7da-454d-bf8c-877f17be34fa tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action" status: 200 len: 32646 microversion: 2.1 time: 0.110144 Jan 15 21:05:52.114944 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2675/5350] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:05:51 2022] POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action => generated 32646 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:05:52.229982 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8997462c-4522-4b59-869d-56b7b7b1e537 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:05:52.230685 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-8997462c-4522-4b59-869d-56b7b7b1e537 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: d09ef93d-246f-464d-8c9c-f5a6fa14e4fe] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:52.238330 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8997462c-4522-4b59-869d-56b7b7b1e537 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:52.239683 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8997462c-4522-4b59-869d-56b7b7b1e537 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:52.240755 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8997462c-4522-4b59-869d-56b7b7b1e537 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:52.241555 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8997462c-4522-4b59-869d-56b7b7b1e537 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:52.286071 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8997462c-4522-4b59-869d-56b7b7b1e537 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:52.286765 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8997462c-4522-4b59-869d-56b7b7b1e537 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:52.287387 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.objects.instance [None req-8997462c-4522-4b59-869d-56b7b7b1e537 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lazy-loading 'fault' on Instance uuid d09ef93d-246f-464d-8c9c-f5a6fa14e4fe {{(pid=129366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 21:05:52.289425 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9dada500-d469-4e43-9825-c6aa3289a3a1 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:52.299606 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-9dada500-d469-4e43-9825-c6aa3289a3a1 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:52.313468 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9dada500-d469-4e43-9825-c6aa3289a3a1 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:52.316229 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9dada500-d469-4e43-9825-c6aa3289a3a1 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:52.317842 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9dada500-d469-4e43-9825-c6aa3289a3a1 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:52.318597 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9dada500-d469-4e43-9825-c6aa3289a3a1 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:52.367625 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-8997462c-4522-4b59-869d-56b7b7b1e537 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:05:52.390753 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-8997462c-4522-4b59-869d-56b7b7b1e537 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/d09ef93d-246f-464d-8c9c-f5a6fa14e4fe" status: 200 len: 1305 microversion: 2.1 time: 0.167532 Jan 15 21:05:52.391697 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2676/5351] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:05:52 2022] GET /compute/v2.1/servers/d09ef93d-246f-464d-8c9c-f5a6fa14e4fe => generated 1305 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:05:52.409298 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-9dada500-d469-4e43-9825-c6aa3289a3a1 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action" status: 200 len: 32638 microversion: 2.20 time: 0.128931 Jan 15 21:05:52.410060 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2676/5352] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:52 2022] POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action => generated 32638 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:05:52.639051 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-bb01916d-6072-4350-b173-9df36f38ac25 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:52.640321 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-bb01916d-6072-4350-b173-9df36f38ac25 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:52.646725 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bb01916d-6072-4350-b173-9df36f38ac25 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:52.647176 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bb01916d-6072-4350-b173-9df36f38ac25 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:52.647959 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bb01916d-6072-4350-b173-9df36f38ac25 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:52.648388 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bb01916d-6072-4350-b173-9df36f38ac25 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:52.694919 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-bb01916d-6072-4350-b173-9df36f38ac25 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.058928 Jan 15 21:05:52.696813 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2677/5353] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:52 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:05:53.127820 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c353793c-1f0a-4e79-94b1-73c2ef2a67d0 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:53.130533 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c353793c-1f0a-4e79-94b1-73c2ef2a67d0 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: d9db70df-9ffc-4b96-af06-a56b3b35ce91] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:53.141530 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c353793c-1f0a-4e79-94b1-73c2ef2a67d0 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:53.142238 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c353793c-1f0a-4e79-94b1-73c2ef2a67d0 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:53.143199 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c353793c-1f0a-4e79-94b1-73c2ef2a67d0 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:53.144122 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c353793c-1f0a-4e79-94b1-73c2ef2a67d0 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:53.201709 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c353793c-1f0a-4e79-94b1-73c2ef2a67d0 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action" status: 200 len: 32646 microversion: 2.1 time: 0.079142 Jan 15 21:05:53.202736 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2677/5354] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:05:53 2022] POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action => generated 32646 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:05:53.408005 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e6993729-cbc4-4b13-9ed0-9d38022973cb tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:05:53.408883 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e6993729-cbc4-4b13-9ed0-9d38022973cb tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: d09ef93d-246f-464d-8c9c-f5a6fa14e4fe] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:53.424275 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-1278eaad-086b-4cbb-be65-31e7673b5d4d tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:53.425306 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-1278eaad-086b-4cbb-be65-31e7673b5d4d tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:53.434515 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e6993729-cbc4-4b13-9ed0-9d38022973cb tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:53.437335 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1278eaad-086b-4cbb-be65-31e7673b5d4d tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:53.437791 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1278eaad-086b-4cbb-be65-31e7673b5d4d tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:53.438616 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1278eaad-086b-4cbb-be65-31e7673b5d4d tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:53.439055 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1278eaad-086b-4cbb-be65-31e7673b5d4d tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:53.442472 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e6993729-cbc4-4b13-9ed0-9d38022973cb tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:53.443415 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e6993729-cbc4-4b13-9ed0-9d38022973cb tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:53.443852 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e6993729-cbc4-4b13-9ed0-9d38022973cb tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:53.460070 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-e6993729-cbc4-4b13-9ed0-9d38022973cb tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] HTTP exception thrown: Instance d09ef93d-246f-464d-8c9c-f5a6fa14e4fe could not be found. Jan 15 21:05:53.460690 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e6993729-cbc4-4b13-9ed0-9d38022973cb tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Returning 404 to user: Instance d09ef93d-246f-464d-8c9c-f5a6fa14e4fe could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:05:53.463111 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e6993729-cbc4-4b13-9ed0-9d38022973cb tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/d09ef93d-246f-464d-8c9c-f5a6fa14e4fe" status: 404 len: 111 microversion: 2.1 time: 0.057906 Jan 15 21:05:53.464520 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2678/5355] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:05:53 2022] GET /compute/v2.1/servers/d09ef93d-246f-464d-8c9c-f5a6fa14e4fe => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:05:53.478797 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c9454423-02d2-48a8-b12e-ffc92a13010d tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:05:53.478797 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c9454423-02d2-48a8-b12e-ffc92a13010d tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 11cbafd5-4836-48b9-8db6-440002deb281] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:53.485923 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c9454423-02d2-48a8-b12e-ffc92a13010d tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:53.486497 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c9454423-02d2-48a8-b12e-ffc92a13010d tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:53.487469 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c9454423-02d2-48a8-b12e-ffc92a13010d tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:53.488004 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c9454423-02d2-48a8-b12e-ffc92a13010d tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:53.509809 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-1278eaad-086b-4cbb-be65-31e7673b5d4d tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action" status: 200 len: 32638 microversion: 2.20 time: 0.089659 Jan 15 21:05:53.511380 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2678/5356] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:53 2022] POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action => generated 32638 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:05:53.518854 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c9454423-02d2-48a8-b12e-ffc92a13010d tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 11cbafd5-4836-48b9-8db6-440002deb281] Going to try to terminate instance {{(pid=129366) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 21:05:53.639115 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c9454423-02d2-48a8-b12e-ffc92a13010d tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "DELETE /compute/v2.1/servers/11cbafd5-4836-48b9-8db6-440002deb281" status: 204 len: 0 microversion: 2.1 time: 0.168468 Jan 15 21:05:53.644890 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2679/5357] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 21:05:53 2022] DELETE /compute/v2.1/servers/11cbafd5-4836-48b9-8db6-440002deb281 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 15 21:05:53.650850 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-6c6a4b2c-4e27-4985-817a-a6bbd2f7e5dc tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:05:53.651705 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-6c6a4b2c-4e27-4985-817a-a6bbd2f7e5dc tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 11cbafd5-4836-48b9-8db6-440002deb281] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:53.661030 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6c6a4b2c-4e27-4985-817a-a6bbd2f7e5dc tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:53.661517 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6c6a4b2c-4e27-4985-817a-a6bbd2f7e5dc tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:53.662455 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6c6a4b2c-4e27-4985-817a-a6bbd2f7e5dc tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:53.663144 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6c6a4b2c-4e27-4985-817a-a6bbd2f7e5dc tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:53.708989 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f7bffb4f-e2b0-457f-8fd9-5868e0aece4a tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:53.709988 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f7bffb4f-e2b0-457f-8fd9-5868e0aece4a tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:53.723652 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f7bffb4f-e2b0-457f-8fd9-5868e0aece4a tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:53.724897 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f7bffb4f-e2b0-457f-8fd9-5868e0aece4a tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:53.726251 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f7bffb4f-e2b0-457f-8fd9-5868e0aece4a tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:53.727156 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f7bffb4f-e2b0-457f-8fd9-5868e0aece4a tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:53.784669 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f7bffb4f-e2b0-457f-8fd9-5868e0aece4a tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.079180 Jan 15 21:05:53.792360 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2680/5358] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:53 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:05:53.846108 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-6c6a4b2c-4e27-4985-817a-a6bbd2f7e5dc tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:05:53.856535 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-6c6a4b2c-4e27-4985-817a-a6bbd2f7e5dc tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/11cbafd5-4836-48b9-8db6-440002deb281" status: 200 len: 1495 microversion: 2.1 time: 0.210038 Jan 15 21:05:53.857182 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2679/5359] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:05:53 2022] GET /compute/v2.1/servers/11cbafd5-4836-48b9-8db6-440002deb281 => generated 1495 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:05:54.216413 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-01fc3e35-9a22-4481-bbd7-f4ab08ff07be tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:54.217753 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-01fc3e35-9a22-4481-bbd7-f4ab08ff07be tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: d9db70df-9ffc-4b96-af06-a56b3b35ce91] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:54.228169 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-01fc3e35-9a22-4481-bbd7-f4ab08ff07be tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:54.228893 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-01fc3e35-9a22-4481-bbd7-f4ab08ff07be tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:54.230059 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-01fc3e35-9a22-4481-bbd7-f4ab08ff07be tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:54.231113 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-01fc3e35-9a22-4481-bbd7-f4ab08ff07be tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:54.293964 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-01fc3e35-9a22-4481-bbd7-f4ab08ff07be tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action" status: 200 len: 32646 microversion: 2.1 time: 0.083362 Jan 15 21:05:54.298013 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2681/5360] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:05:54 2022] POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action => generated 32646 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:05:54.521851 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-cb3ccc02-5f3f-4714-9471-6aeb57293c65 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:54.526840 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-cb3ccc02-5f3f-4714-9471-6aeb57293c65 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:54.531974 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cb3ccc02-5f3f-4714-9471-6aeb57293c65 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:54.532491 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cb3ccc02-5f3f-4714-9471-6aeb57293c65 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:54.533403 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cb3ccc02-5f3f-4714-9471-6aeb57293c65 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:54.533930 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cb3ccc02-5f3f-4714-9471-6aeb57293c65 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:54.584436 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-cb3ccc02-5f3f-4714-9471-6aeb57293c65 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action" status: 200 len: 32638 microversion: 2.20 time: 0.066216 Jan 15 21:05:54.585425 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2680/5361] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:54 2022] POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action => generated 32638 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:05:54.799991 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-5c8a94f0-a440-41c6-bd03-cd949d34ba76 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:54.801024 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-5c8a94f0-a440-41c6-bd03-cd949d34ba76 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:54.810088 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5c8a94f0-a440-41c6-bd03-cd949d34ba76 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:54.810697 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5c8a94f0-a440-41c6-bd03-cd949d34ba76 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:54.811739 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5c8a94f0-a440-41c6-bd03-cd949d34ba76 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:54.812524 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5c8a94f0-a440-41c6-bd03-cd949d34ba76 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:54.861258 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-5c8a94f0-a440-41c6-bd03-cd949d34ba76 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.066532 Jan 15 21:05:54.861927 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2682/5362] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:54 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:05:54.874414 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-932979df-09fd-4d0b-8022-9d90b1314ff8 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:05:54.875153 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-932979df-09fd-4d0b-8022-9d90b1314ff8 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 11cbafd5-4836-48b9-8db6-440002deb281] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:54.882233 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-932979df-09fd-4d0b-8022-9d90b1314ff8 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:54.882690 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-932979df-09fd-4d0b-8022-9d90b1314ff8 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:54.884014 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-932979df-09fd-4d0b-8022-9d90b1314ff8 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:54.884460 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-932979df-09fd-4d0b-8022-9d90b1314ff8 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:55.045377 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-932979df-09fd-4d0b-8022-9d90b1314ff8 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:05:55.053842 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-932979df-09fd-4d0b-8022-9d90b1314ff8 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/11cbafd5-4836-48b9-8db6-440002deb281" status: 200 len: 1495 microversion: 2.1 time: 0.183741 Jan 15 21:05:55.054899 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2681/5363] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:05:54 2022] GET /compute/v2.1/servers/11cbafd5-4836-48b9-8db6-440002deb281 => generated 1495 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:05:55.308333 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ae5c599d-b09d-4d0d-b074-82f082c16f43 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:55.309671 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ae5c599d-b09d-4d0d-b074-82f082c16f43 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: d9db70df-9ffc-4b96-af06-a56b3b35ce91] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:55.318211 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ae5c599d-b09d-4d0d-b074-82f082c16f43 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:55.319111 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ae5c599d-b09d-4d0d-b074-82f082c16f43 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:55.320205 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ae5c599d-b09d-4d0d-b074-82f082c16f43 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:55.320853 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ae5c599d-b09d-4d0d-b074-82f082c16f43 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:55.371559 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ae5c599d-b09d-4d0d-b074-82f082c16f43 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action" status: 200 len: 32646 microversion: 2.1 time: 0.069150 Jan 15 21:05:55.373006 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2683/5364] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:05:55 2022] POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action => generated 32646 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:05:55.602125 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-7f501f49-83c5-402e-9931-653ce81cd59c tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:55.606756 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-7f501f49-83c5-402e-9931-653ce81cd59c tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:55.638153 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7f501f49-83c5-402e-9931-653ce81cd59c tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:55.638600 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7f501f49-83c5-402e-9931-653ce81cd59c tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:55.647544 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7f501f49-83c5-402e-9931-653ce81cd59c tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:55.648179 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7f501f49-83c5-402e-9931-653ce81cd59c tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:55.654561 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-d2be3c82-9185-4255-9f0d-1296ab311655 req-d8d17bdb-c003-4eb7-bb62-87ee6d0e62c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11cbafd5-4836-48b9-8db6-440002deb281", "name": "network-vif-deleted", "tag": "f19de7c9-cb20-4177-abf7-73605a4d6a80"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:55.656729 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:05:55.656729 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:05:55.665734 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-d2be3c82-9185-4255-9f0d-1296ab311655 req-d8d17bdb-c003-4eb7-bb62-87ee6d0e62c1 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:55.666183 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-d2be3c82-9185-4255-9f0d-1296ab311655 req-d8d17bdb-c003-4eb7-bb62-87ee6d0e62c1 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:55.678758 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-d2be3c82-9185-4255-9f0d-1296ab311655 req-d8d17bdb-c003-4eb7-bb62-87ee6d0e62c1 service nova] Creating event network-vif-deleted:f19de7c9-cb20-4177-abf7-73605a4d6a80 for instance 11cbafd5-4836-48b9-8db6-440002deb281 on nch1-master-1 Jan 15 21:05:55.685446 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-d2be3c82-9185-4255-9f0d-1296ab311655 req-d8d17bdb-c003-4eb7-bb62-87ee6d0e62c1 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036014 Jan 15 21:05:55.690290 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2684/5365] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:05:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:05:55.727924 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-7f501f49-83c5-402e-9931-653ce81cd59c tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action" status: 200 len: 32638 microversion: 2.20 time: 0.133785 Jan 15 21:05:55.731821 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2682/5366] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:55 2022] POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action => generated 32638 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:05:55.874013 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-432db446-0f07-42cb-8a67-33b49be78d9c tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:55.876377 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-432db446-0f07-42cb-8a67-33b49be78d9c tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:55.884632 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-432db446-0f07-42cb-8a67-33b49be78d9c tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:55.885504 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-432db446-0f07-42cb-8a67-33b49be78d9c tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:55.886640 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-432db446-0f07-42cb-8a67-33b49be78d9c tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:55.887294 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-432db446-0f07-42cb-8a67-33b49be78d9c tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:55.936543 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-432db446-0f07-42cb-8a67-33b49be78d9c tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.066890 Jan 15 21:05:55.937240 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2685/5367] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:55 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:05:56.074313 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-0d3bbde8-05e2-4034-aa6b-cf9e989ebe24 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:05:56.075603 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-0d3bbde8-05e2-4034-aa6b-cf9e989ebe24 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 11cbafd5-4836-48b9-8db6-440002deb281] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:56.085420 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0d3bbde8-05e2-4034-aa6b-cf9e989ebe24 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:56.086184 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0d3bbde8-05e2-4034-aa6b-cf9e989ebe24 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:56.088459 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0d3bbde8-05e2-4034-aa6b-cf9e989ebe24 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:56.088955 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0d3bbde8-05e2-4034-aa6b-cf9e989ebe24 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:56.132232 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0d3bbde8-05e2-4034-aa6b-cf9e989ebe24 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:56.133452 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0d3bbde8-05e2-4034-aa6b-cf9e989ebe24 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:56.134472 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.objects.instance [None req-0d3bbde8-05e2-4034-aa6b-cf9e989ebe24 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lazy-loading 'fault' on Instance uuid 11cbafd5-4836-48b9-8db6-440002deb281 {{(pid=129365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 21:05:56.213545 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-0d3bbde8-05e2-4034-aa6b-cf9e989ebe24 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:05:56.225646 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-0d3bbde8-05e2-4034-aa6b-cf9e989ebe24 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/11cbafd5-4836-48b9-8db6-440002deb281" status: 200 len: 1305 microversion: 2.1 time: 0.156632 Jan 15 21:05:56.226606 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2683/5368] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:05:56 2022] GET /compute/v2.1/servers/11cbafd5-4836-48b9-8db6-440002deb281 => generated 1305 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:05:56.388660 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-31675c76-e02c-419d-bdf3-faab9c4df7bb tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:56.390181 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-31675c76-e02c-419d-bdf3-faab9c4df7bb tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: d9db70df-9ffc-4b96-af06-a56b3b35ce91] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:56.402069 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-31675c76-e02c-419d-bdf3-faab9c4df7bb tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:56.402778 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-31675c76-e02c-419d-bdf3-faab9c4df7bb tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:56.403749 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-31675c76-e02c-419d-bdf3-faab9c4df7bb tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:56.404362 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-31675c76-e02c-419d-bdf3-faab9c4df7bb tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:56.455741 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-31675c76-e02c-419d-bdf3-faab9c4df7bb tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action" status: 200 len: 32646 microversion: 2.1 time: 0.074246 Jan 15 21:05:56.457245 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2686/5369] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:05:56 2022] POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action => generated 32646 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:05:56.742559 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-0bcd91a8-0158-465a-98d3-99784df8601d tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:56.744729 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-0bcd91a8-0158-465a-98d3-99784df8601d tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:56.753103 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0bcd91a8-0158-465a-98d3-99784df8601d tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:56.753608 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0bcd91a8-0158-465a-98d3-99784df8601d tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:56.754452 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0bcd91a8-0158-465a-98d3-99784df8601d tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:56.755072 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0bcd91a8-0158-465a-98d3-99784df8601d tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:56.804489 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-0bcd91a8-0158-465a-98d3-99784df8601d tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action" status: 200 len: 32638 microversion: 2.20 time: 0.065499 Jan 15 21:05:56.806324 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2684/5370] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:56 2022] POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action => generated 32638 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:05:56.949881 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7eb6730a-341a-4c3f-85e3-caf6abc77360 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:56.951042 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-7eb6730a-341a-4c3f-85e3-caf6abc77360 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:56.961363 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7eb6730a-341a-4c3f-85e3-caf6abc77360 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:56.962636 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7eb6730a-341a-4c3f-85e3-caf6abc77360 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:56.964640 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7eb6730a-341a-4c3f-85e3-caf6abc77360 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:56.965332 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7eb6730a-341a-4c3f-85e3-caf6abc77360 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:57.018317 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7eb6730a-341a-4c3f-85e3-caf6abc77360 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.072681 Jan 15 21:05:57.018992 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2687/5371] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:56 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:05:57.247222 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9c58d2bd-9563-45e4-901c-af542553c2ab tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:05:57.247920 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-9c58d2bd-9563-45e4-901c-af542553c2ab tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 11cbafd5-4836-48b9-8db6-440002deb281] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:57.256616 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9c58d2bd-9563-45e4-901c-af542553c2ab tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:57.257346 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9c58d2bd-9563-45e4-901c-af542553c2ab tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:57.259898 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9c58d2bd-9563-45e4-901c-af542553c2ab tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:57.260574 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9c58d2bd-9563-45e4-901c-af542553c2ab tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:57.277578 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-9c58d2bd-9563-45e4-901c-af542553c2ab tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] HTTP exception thrown: Instance 11cbafd5-4836-48b9-8db6-440002deb281 could not be found. Jan 15 21:05:57.278306 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9c58d2bd-9563-45e4-901c-af542553c2ab tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Returning 404 to user: Instance 11cbafd5-4836-48b9-8db6-440002deb281 could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:05:57.279419 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-9c58d2bd-9563-45e4-901c-af542553c2ab tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/11cbafd5-4836-48b9-8db6-440002deb281" status: 404 len: 111 microversion: 2.1 time: 0.036570 Jan 15 21:05:57.280249 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2685/5372] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:05:57 2022] GET /compute/v2.1/servers/11cbafd5-4836-48b9-8db6-440002deb281 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:05:57.296616 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f91053ce-5942-44ec-8174-298a19ff758d tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:05:57.297487 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f91053ce-5942-44ec-8174-298a19ff758d tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:57.307830 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f91053ce-5942-44ec-8174-298a19ff758d tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:57.308991 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f91053ce-5942-44ec-8174-298a19ff758d tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:57.310612 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f91053ce-5942-44ec-8174-298a19ff758d tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:57.311867 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f91053ce-5942-44ec-8174-298a19ff758d tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:57.348436 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f91053ce-5942-44ec-8174-298a19ff758d tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Going to try to terminate instance {{(pid=129366) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 21:05:57.448188 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f91053ce-5942-44ec-8174-298a19ff758d tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "DELETE /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9" status: 204 len: 0 microversion: 2.1 time: 0.161178 Jan 15 21:05:57.449328 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2688/5373] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 21:05:57 2022] DELETE /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 21:05:57.458980 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-44f7721f-1cb8-4ba8-97db-4bdc52470b63 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:05:57.459653 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-44f7721f-1cb8-4ba8-97db-4bdc52470b63 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:57.468760 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-44f7721f-1cb8-4ba8-97db-4bdc52470b63 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:57.469499 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-44f7721f-1cb8-4ba8-97db-4bdc52470b63 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:57.470835 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-44f7721f-1cb8-4ba8-97db-4bdc52470b63 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:57.471492 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-5edbb5cb-2ec1-4ac1-aeb2-efdb1136673c tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:57.471773 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-44f7721f-1cb8-4ba8-97db-4bdc52470b63 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:57.473156 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-5edbb5cb-2ec1-4ac1-aeb2-efdb1136673c tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: d9db70df-9ffc-4b96-af06-a56b3b35ce91] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:57.483013 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5edbb5cb-2ec1-4ac1-aeb2-efdb1136673c tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:57.483465 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5edbb5cb-2ec1-4ac1-aeb2-efdb1136673c tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:57.485196 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5edbb5cb-2ec1-4ac1-aeb2-efdb1136673c tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:57.485710 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5edbb5cb-2ec1-4ac1-aeb2-efdb1136673c tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:57.563665 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-5edbb5cb-2ec1-4ac1-aeb2-efdb1136673c tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action" status: 200 len: 32646 microversion: 2.1 time: 0.096756 Jan 15 21:05:57.565285 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2689/5374] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:05:57 2022] POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action => generated 32646 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:05:57.665006 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-44f7721f-1cb8-4ba8-97db-4bdc52470b63 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:05:57.678898 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-44f7721f-1cb8-4ba8-97db-4bdc52470b63 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9" status: 200 len: 1676 microversion: 2.1 time: 0.223413 Jan 15 21:05:57.680151 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2686/5375] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:05:57 2022] GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9 => generated 1676 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:05:57.818800 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a5627769-0c5a-4658-aca8-6f7ccc072bf3 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:57.820114 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a5627769-0c5a-4658-aca8-6f7ccc072bf3 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:57.828458 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a5627769-0c5a-4658-aca8-6f7ccc072bf3 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:57.828950 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a5627769-0c5a-4658-aca8-6f7ccc072bf3 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:57.830102 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a5627769-0c5a-4658-aca8-6f7ccc072bf3 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:57.830760 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a5627769-0c5a-4658-aca8-6f7ccc072bf3 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:57.879335 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a5627769-0c5a-4658-aca8-6f7ccc072bf3 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action" status: 200 len: 32638 microversion: 2.20 time: 0.065135 Jan 15 21:05:57.880926 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2690/5376] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:57 2022] POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action => generated 32638 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:05:58.031072 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8434c253-8ad4-4678-9845-863b07624446 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:58.032010 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-8434c253-8ad4-4678-9845-863b07624446 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:58.039416 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8434c253-8ad4-4678-9845-863b07624446 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:58.040380 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8434c253-8ad4-4678-9845-863b07624446 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:58.041616 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8434c253-8ad4-4678-9845-863b07624446 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:58.042105 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8434c253-8ad4-4678-9845-863b07624446 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:58.097583 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-8434c253-8ad4-4678-9845-863b07624446 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.070203 Jan 15 21:05:58.098297 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2687/5377] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:58 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:05:58.576998 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-85cc6f7d-d810-4d70-9027-27447fdde3c4 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:58.578151 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-85cc6f7d-d810-4d70-9027-27447fdde3c4 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: d9db70df-9ffc-4b96-af06-a56b3b35ce91] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:58.596393 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-85cc6f7d-d810-4d70-9027-27447fdde3c4 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:58.596927 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-85cc6f7d-d810-4d70-9027-27447fdde3c4 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:58.597722 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-85cc6f7d-d810-4d70-9027-27447fdde3c4 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:58.598329 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-85cc6f7d-d810-4d70-9027-27447fdde3c4 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:58.646767 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-85cc6f7d-d810-4d70-9027-27447fdde3c4 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action" status: 200 len: 32646 microversion: 2.1 time: 0.073942 Jan 15 21:05:58.648167 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2691/5378] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:05:58 2022] POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action => generated 32646 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:05:58.698946 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-082fa5b7-888d-4d8c-94dd-68d85eef9cba tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:05:58.699841 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-082fa5b7-888d-4d8c-94dd-68d85eef9cba tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:58.707851 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-082fa5b7-888d-4d8c-94dd-68d85eef9cba tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:58.708303 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-082fa5b7-888d-4d8c-94dd-68d85eef9cba tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:58.709122 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-082fa5b7-888d-4d8c-94dd-68d85eef9cba tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:58.709577 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-082fa5b7-888d-4d8c-94dd-68d85eef9cba tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:58.856038 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-082fa5b7-888d-4d8c-94dd-68d85eef9cba tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:05:58.865956 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-082fa5b7-888d-4d8c-94dd-68d85eef9cba tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9" status: 200 len: 1676 microversion: 2.1 time: 0.172849 Jan 15 21:05:58.866870 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2688/5379] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:05:58 2022] GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9 => generated 1676 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:05:58.893371 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-515cf7d4-5e35-423c-9dd9-85e51174f34a tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:58.894465 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-515cf7d4-5e35-423c-9dd9-85e51174f34a tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:58.903344 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-515cf7d4-5e35-423c-9dd9-85e51174f34a tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:58.904373 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-515cf7d4-5e35-423c-9dd9-85e51174f34a tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:58.905365 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-515cf7d4-5e35-423c-9dd9-85e51174f34a tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:58.905798 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-515cf7d4-5e35-423c-9dd9-85e51174f34a tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:58.956431 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-515cf7d4-5e35-423c-9dd9-85e51174f34a tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action" status: 200 len: 32638 microversion: 2.20 time: 0.067033 Jan 15 21:05:58.958155 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2692/5380] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:58 2022] POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action => generated 32638 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:05:59.109838 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-1b45496d-b707-44d3-96e3-a9f91184752b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:59.110782 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-1b45496d-b707-44d3-96e3-a9f91184752b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:59.119193 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1b45496d-b707-44d3-96e3-a9f91184752b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:59.119876 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1b45496d-b707-44d3-96e3-a9f91184752b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:59.120859 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1b45496d-b707-44d3-96e3-a9f91184752b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:59.121471 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1b45496d-b707-44d3-96e3-a9f91184752b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:59.166855 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-1b45496d-b707-44d3-96e3-a9f91184752b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.060722 Jan 15 21:05:59.169564 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2689/5381] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:59 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:05:59.662366 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-64a3d61d-8897-4a29-b543-460f5bed2bb1 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:59.663941 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-64a3d61d-8897-4a29-b543-460f5bed2bb1 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: d9db70df-9ffc-4b96-af06-a56b3b35ce91] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:59.673372 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-64a3d61d-8897-4a29-b543-460f5bed2bb1 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:59.674267 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-64a3d61d-8897-4a29-b543-460f5bed2bb1 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:59.675331 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-64a3d61d-8897-4a29-b543-460f5bed2bb1 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:59.676008 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-64a3d61d-8897-4a29-b543-460f5bed2bb1 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:59.724944 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-64a3d61d-8897-4a29-b543-460f5bed2bb1 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action" status: 200 len: 32646 microversion: 2.1 time: 0.066522 Jan 15 21:05:59.727088 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2693/5382] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:05:59 2022] POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action => generated 32646 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:05:59.884122 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-22d0f7fd-2b66-44c2-9912-c25730bdfc6a tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:05:59.885096 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-22d0f7fd-2b66-44c2-9912-c25730bdfc6a tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:59.892477 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-22d0f7fd-2b66-44c2-9912-c25730bdfc6a tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:59.893262 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-22d0f7fd-2b66-44c2-9912-c25730bdfc6a tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:59.894572 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-22d0f7fd-2b66-44c2-9912-c25730bdfc6a tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:59.895795 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-22d0f7fd-2b66-44c2-9912-c25730bdfc6a tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:59.970564 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a11068a9-b1d8-427f-bf17-69938e8ed259 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:05:59.971749 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a11068a9-b1d8-427f-bf17-69938e8ed259 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:05:59.985966 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a11068a9-b1d8-427f-bf17-69938e8ed259 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:59.986426 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a11068a9-b1d8-427f-bf17-69938e8ed259 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:05:59.987231 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a11068a9-b1d8-427f-bf17-69938e8ed259 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:05:59.987674 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a11068a9-b1d8-427f-bf17-69938e8ed259 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:00.077042 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a11068a9-b1d8-427f-bf17-69938e8ed259 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action" status: 200 len: 32638 microversion: 2.20 time: 0.112344 Jan 15 21:06:00.078395 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2694/5383] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:05:59 2022] POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action => generated 32638 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:06:00.115162 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-22d0f7fd-2b66-44c2-9912-c25730bdfc6a tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1ee75d18ae4db8825653f6e8180b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a611cade394cb288f103fcf516e4ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:00.124315 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-22d0f7fd-2b66-44c2-9912-c25730bdfc6a tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9" status: 200 len: 1676 microversion: 2.1 time: 0.244555 Jan 15 21:06:00.124951 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2690/5384] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:05:59 2022] GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9 => generated 1676 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:06:00.184976 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a61fc7bd-9c48-400d-b43d-b7f9186a365b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:06:00.186251 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a61fc7bd-9c48-400d-b43d-b7f9186a365b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:00.194919 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a61fc7bd-9c48-400d-b43d-b7f9186a365b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:00.195152 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a61fc7bd-9c48-400d-b43d-b7f9186a365b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:00.197127 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a61fc7bd-9c48-400d-b43d-b7f9186a365b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:00.197841 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a61fc7bd-9c48-400d-b43d-b7f9186a365b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:00.256499 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a61fc7bd-9c48-400d-b43d-b7f9186a365b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.077322 Jan 15 21:06:00.260110 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2695/5385] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:06:00 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:06:00.480750 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-63827243-af0d-46bb-b463-a4cfa41f1119 req-9f5b4680-310d-43b8-87a1-859ed67dad78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4504a13b-d10e-436a-a5ef-991829938dd9", "name": "network-vif-deleted", "tag": "f7503e3b-a43e-4550-8109-a1fb1aa2d5f1"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:06:00.483023 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:06:00.483023 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:06:00.504487 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-63827243-af0d-46bb-b463-a4cfa41f1119 req-9f5b4680-310d-43b8-87a1-859ed67dad78 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:00.505285 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-63827243-af0d-46bb-b463-a4cfa41f1119 req-9f5b4680-310d-43b8-87a1-859ed67dad78 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:00.522114 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-63827243-af0d-46bb-b463-a4cfa41f1119 req-9f5b4680-310d-43b8-87a1-859ed67dad78 service nova] Creating event network-vif-deleted:f7503e3b-a43e-4550-8109-a1fb1aa2d5f1 for instance 4504a13b-d10e-436a-a5ef-991829938dd9 on nch1-master-1 Jan 15 21:06:00.527265 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-63827243-af0d-46bb-b463-a4cfa41f1119 req-9f5b4680-310d-43b8-87a1-859ed67dad78 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050947 Jan 15 21:06:00.528001 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2691/5386] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:06:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:06:00.738868 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e2a33df9-fa75-4e39-8335-4ee024d46734 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:06:00.740487 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e2a33df9-fa75-4e39-8335-4ee024d46734 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: d9db70df-9ffc-4b96-af06-a56b3b35ce91] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:00.749634 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e2a33df9-fa75-4e39-8335-4ee024d46734 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:00.750396 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e2a33df9-fa75-4e39-8335-4ee024d46734 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:00.751557 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e2a33df9-fa75-4e39-8335-4ee024d46734 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:00.752220 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e2a33df9-fa75-4e39-8335-4ee024d46734 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:00.802543 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e2a33df9-fa75-4e39-8335-4ee024d46734 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action" status: 200 len: 32646 microversion: 2.1 time: 0.066369 Jan 15 21:06:00.804431 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2696/5387] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:06:00 2022] POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action => generated 32646 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 21:06:01.090676 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-efd501b0-228e-4bd3-afce-0c0766e8b289 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:06:01.091799 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-efd501b0-228e-4bd3-afce-0c0766e8b289 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:01.107512 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-efd501b0-228e-4bd3-afce-0c0766e8b289 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:01.109414 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-efd501b0-228e-4bd3-afce-0c0766e8b289 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:01.112762 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-efd501b0-228e-4bd3-afce-0c0766e8b289 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:01.113519 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-efd501b0-228e-4bd3-afce-0c0766e8b289 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:01.146396 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a83b3162-157e-4760-82ee-21df6211cd84 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:06:01.147227 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a83b3162-157e-4760-82ee-21df6211cd84 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] [instance: 4504a13b-d10e-436a-a5ef-991829938dd9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:01.162815 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a83b3162-157e-4760-82ee-21df6211cd84 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:01.165690 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a83b3162-157e-4760-82ee-21df6211cd84 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:01.166528 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a83b3162-157e-4760-82ee-21df6211cd84 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:01.166970 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a83b3162-157e-4760-82ee-21df6211cd84 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:01.192061 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-a83b3162-157e-4760-82ee-21df6211cd84 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] HTTP exception thrown: Instance 4504a13b-d10e-436a-a5ef-991829938dd9 could not be found. Jan 15 21:06:01.198591 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-efd501b0-228e-4bd3-afce-0c0766e8b289 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action" status: 200 len: 32638 microversion: 2.20 time: 0.112090 Jan 15 21:06:01.201849 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2692/5388] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:06:01 2022] POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action => generated 32638 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:06:01.202384 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a83b3162-157e-4760-82ee-21df6211cd84 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Returning 404 to user: Instance 4504a13b-d10e-436a-a5ef-991829938dd9 could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:06:01.203586 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a83b3162-157e-4760-82ee-21df6211cd84 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9" status: 404 len: 111 microversion: 2.1 time: 0.063798 Jan 15 21:06:01.204590 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2697/5389] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:06:01 2022] GET /compute/v2.1/servers/4504a13b-d10e-436a-a5ef-991829938dd9 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 15 21:06:01.217454 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e4eb04af-53f0-4631-aa19-531a277c96d2 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] Calling method '.version_select at 0x7f30c84c7550>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:06:01.248302 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e4eb04af-53f0-4631-aa19-531a277c96d2 tempest-ServerActionsTestJSON-328534574 tempest-ServerActionsTestJSON-328534574-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-617238005" status: 202 len: 0 microversion: 2.1 time: 0.033106 Jan 15 21:06:01.248302 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2693/5390] 10.222.0.46 () {58 vars in 1217 bytes} [Sat Jan 15 21:06:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-617238005 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:06:01.271332 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-cd8c71d3-3bc9-4376-b4fa-4a5a61e0e5fd tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:06:01.272247 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-cd8c71d3-3bc9-4376-b4fa-4a5a61e0e5fd tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:01.278973 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cd8c71d3-3bc9-4376-b4fa-4a5a61e0e5fd tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:01.279425 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cd8c71d3-3bc9-4376-b4fa-4a5a61e0e5fd tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:01.280219 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cd8c71d3-3bc9-4376-b4fa-4a5a61e0e5fd tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:01.280655 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cd8c71d3-3bc9-4376-b4fa-4a5a61e0e5fd tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:01.332153 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-cd8c71d3-3bc9-4376-b4fa-4a5a61e0e5fd tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.064689 Jan 15 21:06:01.332829 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2698/5391] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:06:01 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:06:01.819354 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e7f8250a-640f-41cb-9102-af23893bc7c1 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:06:01.821673 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e7f8250a-640f-41cb-9102-af23893bc7c1 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: d9db70df-9ffc-4b96-af06-a56b3b35ce91] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:01.845745 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e7f8250a-640f-41cb-9102-af23893bc7c1 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:01.853587 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e7f8250a-640f-41cb-9102-af23893bc7c1 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:01.854252 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e7f8250a-640f-41cb-9102-af23893bc7c1 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:01.858076 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e7f8250a-640f-41cb-9102-af23893bc7c1 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:01.932336 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e7f8250a-640f-41cb-9102-af23893bc7c1 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action" status: 200 len: 32646 microversion: 2.1 time: 0.118191 Jan 15 21:06:01.935849 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2694/5392] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:06:01 2022] POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action => generated 32646 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:06:02.213640 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-16f0378e-2624-4c7b-a518-0f8a11855198 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:06:02.215444 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-16f0378e-2624-4c7b-a518-0f8a11855198 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:02.236278 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-16f0378e-2624-4c7b-a518-0f8a11855198 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:02.237150 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-16f0378e-2624-4c7b-a518-0f8a11855198 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:02.238288 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-16f0378e-2624-4c7b-a518-0f8a11855198 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:02.240069 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-16f0378e-2624-4c7b-a518-0f8a11855198 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:02.314428 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-16f0378e-2624-4c7b-a518-0f8a11855198 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action" status: 200 len: 32638 microversion: 2.20 time: 0.106093 Jan 15 21:06:02.318523 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2699/5393] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:06:02 2022] POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action => generated 32638 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:06:02.358729 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e8b9a2f7-0c68-4d5e-ab51-1d4ee1593431 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:06:02.365724 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e8b9a2f7-0c68-4d5e-ab51-1d4ee1593431 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:02.398004 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e8b9a2f7-0c68-4d5e-ab51-1d4ee1593431 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:02.398821 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e8b9a2f7-0c68-4d5e-ab51-1d4ee1593431 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:02.400185 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e8b9a2f7-0c68-4d5e-ab51-1d4ee1593431 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:02.400963 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e8b9a2f7-0c68-4d5e-ab51-1d4ee1593431 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:02.452446 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e8b9a2f7-0c68-4d5e-ab51-1d4ee1593431 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.111403 Jan 15 21:06:02.454470 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2695/5394] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:06:02 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:06:02.947686 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-343aed5e-f822-470c-bd38-5059b3545612 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:06:02.949410 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-343aed5e-f822-470c-bd38-5059b3545612 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: d9db70df-9ffc-4b96-af06-a56b3b35ce91] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:02.959677 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-343aed5e-f822-470c-bd38-5059b3545612 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:02.960488 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-343aed5e-f822-470c-bd38-5059b3545612 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:02.962137 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-343aed5e-f822-470c-bd38-5059b3545612 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:02.962913 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-343aed5e-f822-470c-bd38-5059b3545612 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:03.020893 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-343aed5e-f822-470c-bd38-5059b3545612 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action" status: 200 len: 32646 microversion: 2.1 time: 0.078346 Jan 15 21:06:03.022182 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2700/5395] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:06:02 2022] POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action => generated 32646 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:06:03.331782 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-84fe195a-f24e-402d-bbe5-177f2d8f7b03 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:06:03.332798 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-84fe195a-f24e-402d-bbe5-177f2d8f7b03 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:03.348731 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-84fe195a-f24e-402d-bbe5-177f2d8f7b03 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:03.349205 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-84fe195a-f24e-402d-bbe5-177f2d8f7b03 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:03.350008 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-84fe195a-f24e-402d-bbe5-177f2d8f7b03 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:03.353069 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-84fe195a-f24e-402d-bbe5-177f2d8f7b03 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:03.454014 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-84fe195a-f24e-402d-bbe5-177f2d8f7b03 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action" status: 200 len: 32638 microversion: 2.20 time: 0.129415 Jan 15 21:06:03.455481 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2696/5396] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:06:03 2022] POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action => generated 32638 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:06:03.475792 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b43ae3d7-a6f5-4506-9789-62df1e09244e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:06:03.478371 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b43ae3d7-a6f5-4506-9789-62df1e09244e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:03.501034 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b43ae3d7-a6f5-4506-9789-62df1e09244e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:03.501554 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b43ae3d7-a6f5-4506-9789-62df1e09244e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:03.502771 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b43ae3d7-a6f5-4506-9789-62df1e09244e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:03.504615 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b43ae3d7-a6f5-4506-9789-62df1e09244e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:03.559464 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b43ae3d7-a6f5-4506-9789-62df1e09244e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.093732 Jan 15 21:06:03.560154 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2701/5397] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:06:03 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:06:04.035527 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-05c092a2-71b3-44e0-8e05-59c72ac8f217 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:06:04.037128 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-05c092a2-71b3-44e0-8e05-59c72ac8f217 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: d9db70df-9ffc-4b96-af06-a56b3b35ce91] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:04.055682 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-05c092a2-71b3-44e0-8e05-59c72ac8f217 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:04.056486 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-05c092a2-71b3-44e0-8e05-59c72ac8f217 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:04.057719 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-05c092a2-71b3-44e0-8e05-59c72ac8f217 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:04.058438 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-05c092a2-71b3-44e0-8e05-59c72ac8f217 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:04.130379 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-05c092a2-71b3-44e0-8e05-59c72ac8f217 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action" status: 200 len: 32646 microversion: 2.1 time: 0.099573 Jan 15 21:06:04.141353 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2697/5398] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:06:04 2022] POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action => generated 32646 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:06:04.470830 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9267486b-1c5d-4253-9e93-ef30cf336ae2 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:06:04.472082 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-9267486b-1c5d-4253-9e93-ef30cf336ae2 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:04.489588 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9267486b-1c5d-4253-9e93-ef30cf336ae2 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:04.493336 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9267486b-1c5d-4253-9e93-ef30cf336ae2 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:04.494351 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9267486b-1c5d-4253-9e93-ef30cf336ae2 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:04.494824 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9267486b-1c5d-4253-9e93-ef30cf336ae2 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:04.574312 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b83a43e5-819a-4c51-ba55-36bee790cbd4 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:06:04.576277 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b83a43e5-819a-4c51-ba55-36bee790cbd4 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:04.592086 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-9267486b-1c5d-4253-9e93-ef30cf336ae2 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action" status: 200 len: 32638 microversion: 2.20 time: 0.128852 Jan 15 21:06:04.593712 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2702/5399] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:06:04 2022] POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action => generated 32638 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:06:04.599423 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b83a43e5-819a-4c51-ba55-36bee790cbd4 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:04.609108 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b83a43e5-819a-4c51-ba55-36bee790cbd4 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:04.610400 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b83a43e5-819a-4c51-ba55-36bee790cbd4 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:04.611380 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b83a43e5-819a-4c51-ba55-36bee790cbd4 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:04.672179 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b83a43e5-819a-4c51-ba55-36bee790cbd4 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.103114 Jan 15 21:06:04.673632 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2698/5400] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:06:04 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:06:05.145901 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-6b2af94b-a5da-45e8-a53a-eb90a6e5c6e7 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:06:05.146519 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-6b2af94b-a5da-45e8-a53a-eb90a6e5c6e7 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: d9db70df-9ffc-4b96-af06-a56b3b35ce91] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:05.154062 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6b2af94b-a5da-45e8-a53a-eb90a6e5c6e7 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:05.154771 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6b2af94b-a5da-45e8-a53a-eb90a6e5c6e7 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:05.155742 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6b2af94b-a5da-45e8-a53a-eb90a6e5c6e7 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:05.156337 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6b2af94b-a5da-45e8-a53a-eb90a6e5c6e7 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:05.227597 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-6b2af94b-a5da-45e8-a53a-eb90a6e5c6e7 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action" status: 200 len: 32646 microversion: 2.1 time: 0.085997 Jan 15 21:06:05.229341 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2703/5401] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:06:05 2022] POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action => generated 32646 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:06:05.605148 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-0e0b6e55-04cd-461b-a8b7-73c4cea2a7b5 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:06:05.606971 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-0e0b6e55-04cd-461b-a8b7-73c4cea2a7b5 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:05.628070 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0e0b6e55-04cd-461b-a8b7-73c4cea2a7b5 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:05.628827 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0e0b6e55-04cd-461b-a8b7-73c4cea2a7b5 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:05.630379 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0e0b6e55-04cd-461b-a8b7-73c4cea2a7b5 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:05.635930 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0e0b6e55-04cd-461b-a8b7-73c4cea2a7b5 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:05.693155 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-74aa9674-7d65-4539-b966-6bb3c7d7ec2c tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:06:05.693687 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-0e0b6e55-04cd-461b-a8b7-73c4cea2a7b5 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action" status: 200 len: 32638 microversion: 2.20 time: 0.093064 Jan 15 21:06:05.694568 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-74aa9674-7d65-4539-b966-6bb3c7d7ec2c tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:05.694943 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2699/5402] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:06:05 2022] POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action => generated 32638 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:06:05.705279 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-74aa9674-7d65-4539-b966-6bb3c7d7ec2c tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:05.706014 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-74aa9674-7d65-4539-b966-6bb3c7d7ec2c tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:05.707048 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-74aa9674-7d65-4539-b966-6bb3c7d7ec2c tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:05.708097 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-74aa9674-7d65-4539-b966-6bb3c7d7ec2c tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:05.790756 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-74aa9674-7d65-4539-b966-6bb3c7d7ec2c tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.107268 Jan 15 21:06:05.793499 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2704/5403] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:06:05 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:06:06.241948 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a3752778-c68e-40a9-98a9-d8ca87b65a98 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:06:06.243256 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a3752778-c68e-40a9-98a9-d8ca87b65a98 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: d9db70df-9ffc-4b96-af06-a56b3b35ce91] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:06.252221 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a3752778-c68e-40a9-98a9-d8ca87b65a98 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:06.252988 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a3752778-c68e-40a9-98a9-d8ca87b65a98 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:06.254058 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a3752778-c68e-40a9-98a9-d8ca87b65a98 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:06.254731 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a3752778-c68e-40a9-98a9-d8ca87b65a98 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:06.307883 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a3752778-c68e-40a9-98a9-d8ca87b65a98 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action" status: 200 len: 32646 microversion: 2.1 time: 0.071472 Jan 15 21:06:06.308546 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2700/5404] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:06:06 2022] POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action => generated 32646 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:06:06.706943 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9e9f02ab-e0ac-4d4b-9d56-6a564619e08e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:06:06.708263 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-9e9f02ab-e0ac-4d4b-9d56-6a564619e08e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:06.718957 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9e9f02ab-e0ac-4d4b-9d56-6a564619e08e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:06.719615 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9e9f02ab-e0ac-4d4b-9d56-6a564619e08e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:06.720604 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9e9f02ab-e0ac-4d4b-9d56-6a564619e08e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:06.721416 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9e9f02ab-e0ac-4d4b-9d56-6a564619e08e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:06.804727 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b6a10fa8-c5b0-4306-9597-7ccc7ed94c50 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:06:06.805790 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b6a10fa8-c5b0-4306-9597-7ccc7ed94c50 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:06.816780 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-9e9f02ab-e0ac-4d4b-9d56-6a564619e08e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action" status: 200 len: 32638 microversion: 2.20 time: 0.113771 Jan 15 21:06:06.818002 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2705/5405] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:06:06 2022] POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action => generated 32638 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:06:06.824163 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b6a10fa8-c5b0-4306-9597-7ccc7ed94c50 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:06.824864 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b6a10fa8-c5b0-4306-9597-7ccc7ed94c50 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:06.825843 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b6a10fa8-c5b0-4306-9597-7ccc7ed94c50 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:06.826458 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b6a10fa8-c5b0-4306-9597-7ccc7ed94c50 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:06.874150 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b6a10fa8-c5b0-4306-9597-7ccc7ed94c50 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.073523 Jan 15 21:06:06.875456 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2701/5406] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:06:06 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:06:07.336440 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f24923ae-469b-475f-aee4-a196b2b13348 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:06:07.337864 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f24923ae-469b-475f-aee4-a196b2b13348 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: d9db70df-9ffc-4b96-af06-a56b3b35ce91] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:07.348032 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f24923ae-469b-475f-aee4-a196b2b13348 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:07.348810 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f24923ae-469b-475f-aee4-a196b2b13348 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:07.349835 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f24923ae-469b-475f-aee4-a196b2b13348 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:07.350582 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f24923ae-469b-475f-aee4-a196b2b13348 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:07.426611 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f24923ae-469b-475f-aee4-a196b2b13348 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action" status: 200 len: 32646 microversion: 2.1 time: 0.109784 Jan 15 21:06:07.431738 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2706/5407] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:06:07 2022] POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action => generated 32646 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:06:07.830232 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-1745aece-d330-44dd-ad2f-566d38d90296 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:06:07.831266 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-1745aece-d330-44dd-ad2f-566d38d90296 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:07.842625 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1745aece-d330-44dd-ad2f-566d38d90296 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:07.843486 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1745aece-d330-44dd-ad2f-566d38d90296 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:07.844069 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1745aece-d330-44dd-ad2f-566d38d90296 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:07.844618 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1745aece-d330-44dd-ad2f-566d38d90296 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:07.887736 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8e1f6858-f5ec-4fc7-9cf2-2a97b75b9815 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:06:07.889319 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-8e1f6858-f5ec-4fc7-9cf2-2a97b75b9815 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:07.908061 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-1745aece-d330-44dd-ad2f-566d38d90296 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action" status: 200 len: 32638 microversion: 2.20 time: 0.077294 Jan 15 21:06:07.910342 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2702/5408] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:06:07 2022] POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action => generated 32638 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:06:07.912080 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8e1f6858-f5ec-4fc7-9cf2-2a97b75b9815 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:07.912731 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8e1f6858-f5ec-4fc7-9cf2-2a97b75b9815 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:07.914038 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8e1f6858-f5ec-4fc7-9cf2-2a97b75b9815 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:07.914667 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8e1f6858-f5ec-4fc7-9cf2-2a97b75b9815 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:07.972307 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-8e1f6858-f5ec-4fc7-9cf2-2a97b75b9815 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.088882 Jan 15 21:06:07.973518 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2707/5409] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:06:07 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:06:08.438861 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-02bc0198-e921-475b-8c42-92af4c5bcf46 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:06:08.439872 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-02bc0198-e921-475b-8c42-92af4c5bcf46 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: d9db70df-9ffc-4b96-af06-a56b3b35ce91] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:08.449915 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-02bc0198-e921-475b-8c42-92af4c5bcf46 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:08.450332 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-02bc0198-e921-475b-8c42-92af4c5bcf46 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:08.451133 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-02bc0198-e921-475b-8c42-92af4c5bcf46 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:08.451896 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-02bc0198-e921-475b-8c42-92af4c5bcf46 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:08.505719 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-02bc0198-e921-475b-8c42-92af4c5bcf46 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action" status: 200 len: 32646 microversion: 2.1 time: 0.071075 Jan 15 21:06:08.512183 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2703/5410] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:06:08 2022] POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action => generated 32646 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 21:06:08.923675 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0193f3ea-0a4d-45fc-a30f-3330997eaac6 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:06:08.924253 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-0193f3ea-0a4d-45fc-a30f-3330997eaac6 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:08.934271 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0193f3ea-0a4d-45fc-a30f-3330997eaac6 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:08.934765 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0193f3ea-0a4d-45fc-a30f-3330997eaac6 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:08.935591 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0193f3ea-0a4d-45fc-a30f-3330997eaac6 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:08.936021 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0193f3ea-0a4d-45fc-a30f-3330997eaac6 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:08.984997 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-41788ed5-9081-45d4-b07b-23f13dc89d4a tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:06:08.986360 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-41788ed5-9081-45d4-b07b-23f13dc89d4a tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:08.989365 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0193f3ea-0a4d-45fc-a30f-3330997eaac6 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action" status: 200 len: 32638 microversion: 2.20 time: 0.070196 Jan 15 21:06:08.993106 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2708/5411] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:06:08 2022] POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action => generated 32638 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:06:08.997361 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-41788ed5-9081-45d4-b07b-23f13dc89d4a tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:08.998143 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-41788ed5-9081-45d4-b07b-23f13dc89d4a tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:08.999645 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-41788ed5-9081-45d4-b07b-23f13dc89d4a tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:09.000182 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-41788ed5-9081-45d4-b07b-23f13dc89d4a tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:09.047996 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-41788ed5-9081-45d4-b07b-23f13dc89d4a tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.066551 Jan 15 21:06:09.049285 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2704/5412] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:06:08 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:06:09.395114 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c3406442-1904-477f-9bae-c458c5c4021e tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-1012763609", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "networks": "none"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:06:09.468993 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-c3406442-1904-477f-9bae-c458c5c4021e tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Flavor limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 21:06:09.469427 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-c3406442-1904-477f-9bae-c458c5c4021e tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Image limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 21:06:09.469906 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-c3406442-1904-477f-9bae-c458c5c4021e tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Flavor pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 21:06:09.470313 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-c3406442-1904-477f-9bae-c458c5c4021e tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Image pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 21:06:09.471250 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-c3406442-1904-477f-9bae-c458c5c4021e tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 21:06:09.485139 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c3406442-1904-477f-9bae-c458c5c4021e tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:09.485898 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c3406442-1904-477f-9bae-c458c5c4021e tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:09.487057 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c3406442-1904-477f-9bae-c458c5c4021e tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:09.487663 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c3406442-1904-477f-9bae-c458c5c4021e tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:09.519442 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-c3406442-1904-477f-9bae-c458c5c4021e tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Getting quotas for project b11e8e9465264349892209758f3c396d. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:06:09.520509 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-067f8474-45b4-49ee-83c2-e07d97ae72ef tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:06:09.524072 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-067f8474-45b4-49ee-83c2-e07d97ae72ef tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: d9db70df-9ffc-4b96-af06-a56b3b35ce91] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:09.528467 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-c3406442-1904-477f-9bae-c458c5c4021e tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Getting quotas for user 5556986824774afaa455010da540de2d and project b11e8e9465264349892209758f3c396d. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:06:09.541821 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-067f8474-45b4-49ee-83c2-e07d97ae72ef tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:09.542279 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-067f8474-45b4-49ee-83c2-e07d97ae72ef tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:09.544720 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-067f8474-45b4-49ee-83c2-e07d97ae72ef tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:09.545196 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-067f8474-45b4-49ee-83c2-e07d97ae72ef tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:09.546341 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c3406442-1904-477f-9bae-c458c5c4021e tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Going to run 1 instances... {{(pid=129366) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 21:06:09.550483 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c3406442-1904-477f-9bae-c458c5c4021e tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] [instance: 896b0f6d-8007-44c8-9bdc-db25f69a8d51] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 21:06:09.596109 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-067f8474-45b4-49ee-83c2-e07d97ae72ef tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action" status: 200 len: 32646 microversion: 2.1 time: 0.080617 Jan 15 21:06:09.596827 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2705/5413] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:06:09 2022] POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action => generated 32646 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:06:09.612427 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c3406442-1904-477f-9bae-c458c5c4021e tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.502292 Jan 15 21:06:09.613748 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2709/5414] 10.222.0.46 () {62 vars in 1187 bytes} [Sat Jan 15 21:06:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 504 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jan 15 21:06:09.624128 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-1c6c201e-b9ea-4574-bbfe-a69c9f79da0a tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:06:09.624946 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-1c6c201e-b9ea-4574-bbfe-a69c9f79da0a tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] [instance: 896b0f6d-8007-44c8-9bdc-db25f69a8d51] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:09.701742 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-1c6c201e-b9ea-4574-bbfe-a69c9f79da0a tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5556986824774afaa455010da540de2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b11e8e9465264349892209758f3c396d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:09.725362 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-1c6c201e-b9ea-4574-bbfe-a69c9f79da0a tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5556986824774afaa455010da540de2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b11e8e9465264349892209758f3c396d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:09.728487 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-1c6c201e-b9ea-4574-bbfe-a69c9f79da0a tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5556986824774afaa455010da540de2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b11e8e9465264349892209758f3c396d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:09.729783 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-1c6c201e-b9ea-4574-bbfe-a69c9f79da0a tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] 10.222.0.46 "GET /compute/v2.1/servers/896b0f6d-8007-44c8-9bdc-db25f69a8d51" status: 200 len: 1278 microversion: 2.57 time: 0.109842 Jan 15 21:06:09.733534 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2706/5415] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:06:09 2022] GET /compute/v2.1/servers/896b0f6d-8007-44c8-9bdc-db25f69a8d51 => generated 1278 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:06:10.005504 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-04ea09d5-c887-41b1-97e2-cca117520aa6 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:06:10.006579 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-04ea09d5-c887-41b1-97e2-cca117520aa6 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:10.014776 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-04ea09d5-c887-41b1-97e2-cca117520aa6 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:10.015330 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-04ea09d5-c887-41b1-97e2-cca117520aa6 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:10.016190 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-04ea09d5-c887-41b1-97e2-cca117520aa6 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:10.016628 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-04ea09d5-c887-41b1-97e2-cca117520aa6 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:10.060511 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-04ec40e7-c6dd-4c65-b146-4b6da9ab454f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:06:10.061565 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-04ec40e7-c6dd-4c65-b146-4b6da9ab454f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:10.075748 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-04ec40e7-c6dd-4c65-b146-4b6da9ab454f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:10.076922 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-04ec40e7-c6dd-4c65-b146-4b6da9ab454f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:10.079670 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-04ec40e7-c6dd-4c65-b146-4b6da9ab454f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:10.081096 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-04ec40e7-c6dd-4c65-b146-4b6da9ab454f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:10.093690 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-04ea09d5-c887-41b1-97e2-cca117520aa6 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action" status: 200 len: 32638 microversion: 2.20 time: 0.093525 Jan 15 21:06:10.094761 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2710/5416] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:06:09 2022] POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action => generated 32638 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:06:10.152482 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-04ec40e7-c6dd-4c65-b146-4b6da9ab454f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.095701 Jan 15 21:06:10.157060 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2707/5417] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:06:10 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:06:10.610886 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e1ac56f6-6536-42d0-ac06-657aba52dd45 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:06:10.612589 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e1ac56f6-6536-42d0-ac06-657aba52dd45 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: d9db70df-9ffc-4b96-af06-a56b3b35ce91] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:10.630289 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e1ac56f6-6536-42d0-ac06-657aba52dd45 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:10.631083 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e1ac56f6-6536-42d0-ac06-657aba52dd45 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:10.632180 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e1ac56f6-6536-42d0-ac06-657aba52dd45 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:10.632790 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e1ac56f6-6536-42d0-ac06-657aba52dd45 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:10.691222 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e1ac56f6-6536-42d0-ac06-657aba52dd45 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action" status: 200 len: 32646 microversion: 2.1 time: 0.085991 Jan 15 21:06:10.691971 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2711/5418] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:06:10 2022] POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action => generated 32646 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:06:10.757005 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-067b1687-4993-4694-83fc-5d0b0aed5158 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:06:10.758982 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-067b1687-4993-4694-83fc-5d0b0aed5158 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] [instance: 896b0f6d-8007-44c8-9bdc-db25f69a8d51] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:10.781886 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-067b1687-4993-4694-83fc-5d0b0aed5158 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:10.784614 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-067b1687-4993-4694-83fc-5d0b0aed5158 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:10.786446 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-067b1687-4993-4694-83fc-5d0b0aed5158 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:10.792439 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-067b1687-4993-4694-83fc-5d0b0aed5158 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:10.890015 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-067b1687-4993-4694-83fc-5d0b0aed5158 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5556986824774afaa455010da540de2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b11e8e9465264349892209758f3c396d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:10.902780 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-067b1687-4993-4694-83fc-5d0b0aed5158 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5556986824774afaa455010da540de2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b11e8e9465264349892209758f3c396d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:10.905008 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-067b1687-4993-4694-83fc-5d0b0aed5158 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5556986824774afaa455010da540de2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b11e8e9465264349892209758f3c396d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:10.906634 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-067b1687-4993-4694-83fc-5d0b0aed5158 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] 10.222.0.46 "GET /compute/v2.1/servers/896b0f6d-8007-44c8-9bdc-db25f69a8d51" status: 200 len: 1330 microversion: 2.57 time: 0.158487 Jan 15 21:06:10.907794 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2708/5419] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:06:10 2022] GET /compute/v2.1/servers/896b0f6d-8007-44c8-9bdc-db25f69a8d51 => generated 1330 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:06:11.112331 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-bd3a335e-6c1d-4556-8cf8-d9d59cdd0672 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:06:11.112331 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-bd3a335e-6c1d-4556-8cf8-d9d59cdd0672 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:11.119712 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bd3a335e-6c1d-4556-8cf8-d9d59cdd0672 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:11.120163 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bd3a335e-6c1d-4556-8cf8-d9d59cdd0672 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:11.121312 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bd3a335e-6c1d-4556-8cf8-d9d59cdd0672 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:11.122329 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bd3a335e-6c1d-4556-8cf8-d9d59cdd0672 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:11.169595 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8f3f6f08-a1f0-4e4a-b76e-2db46a1c9b28 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:06:11.170610 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-8f3f6f08-a1f0-4e4a-b76e-2db46a1c9b28 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:11.177410 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8f3f6f08-a1f0-4e4a-b76e-2db46a1c9b28 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:11.177867 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8f3f6f08-a1f0-4e4a-b76e-2db46a1c9b28 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:11.178667 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8f3f6f08-a1f0-4e4a-b76e-2db46a1c9b28 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:11.179101 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8f3f6f08-a1f0-4e4a-b76e-2db46a1c9b28 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:11.189915 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-bd3a335e-6c1d-4556-8cf8-d9d59cdd0672 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action" status: 200 len: 40792 microversion: 2.20 time: 0.082558 Jan 15 21:06:11.191026 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2712/5420] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:06:11 2022] POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action => generated 40792 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:06:11.204580 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-5d41c8a0-33e5-4632-b435-adb7697b7d56 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:06:11.206353 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-5d41c8a0-33e5-4632-b435-adb7697b7d56 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:11.216626 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5d41c8a0-33e5-4632-b435-adb7697b7d56 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:11.217094 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5d41c8a0-33e5-4632-b435-adb7697b7d56 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:11.217912 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5d41c8a0-33e5-4632-b435-adb7697b7d56 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:11.218348 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5d41c8a0-33e5-4632-b435-adb7697b7d56 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:11.242616 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-8f3f6f08-a1f0-4e4a-b76e-2db46a1c9b28 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.079810 Jan 15 21:06:11.248414 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2709/5421] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:06:11 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:06:11.276926 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-5d41c8a0-33e5-4632-b435-adb7697b7d56 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/ips" status: 200 len: 151 microversion: 2.20 time: 0.078422 Jan 15 21:06:11.277763 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2713/5422] 10.222.0.46 () {60 vars in 1288 bytes} [Sat Jan 15 21:06:11 2022] GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/ips => generated 151 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:06:11.706051 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5b74014c-6e0a-4bed-9416-ed4943683807 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:06:11.707184 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-5b74014c-6e0a-4bed-9416-ed4943683807 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: d9db70df-9ffc-4b96-af06-a56b3b35ce91] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:11.719333 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5b74014c-6e0a-4bed-9416-ed4943683807 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:11.720024 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5b74014c-6e0a-4bed-9416-ed4943683807 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:11.721068 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5b74014c-6e0a-4bed-9416-ed4943683807 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:11.721709 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5b74014c-6e0a-4bed-9416-ed4943683807 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:11.777496 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5b74014c-6e0a-4bed-9416-ed4943683807 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action" status: 200 len: 32646 microversion: 2.1 time: 0.077757 Jan 15 21:06:11.778853 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2710/5423] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:06:11 2022] POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action => generated 32646 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:06:11.927875 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e9d61ce8-879e-4b9b-9ed0-baecbc8a358f tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:06:11.928828 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e9d61ce8-879e-4b9b-9ed0-baecbc8a358f tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] [instance: 896b0f6d-8007-44c8-9bdc-db25f69a8d51] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:11.939685 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e9d61ce8-879e-4b9b-9ed0-baecbc8a358f tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:11.940749 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e9d61ce8-879e-4b9b-9ed0-baecbc8a358f tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:11.941859 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e9d61ce8-879e-4b9b-9ed0-baecbc8a358f tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:11.942522 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e9d61ce8-879e-4b9b-9ed0-baecbc8a358f tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:12.042447 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-e9d61ce8-879e-4b9b-9ed0-baecbc8a358f tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5556986824774afaa455010da540de2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b11e8e9465264349892209758f3c396d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:12.054714 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-e9d61ce8-879e-4b9b-9ed0-baecbc8a358f tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5556986824774afaa455010da540de2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b11e8e9465264349892209758f3c396d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:12.058547 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-e9d61ce8-879e-4b9b-9ed0-baecbc8a358f tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5556986824774afaa455010da540de2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b11e8e9465264349892209758f3c396d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:12.060309 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e9d61ce8-879e-4b9b-9ed0-baecbc8a358f tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] 10.222.0.46 "GET /compute/v2.1/servers/896b0f6d-8007-44c8-9bdc-db25f69a8d51" status: 200 len: 1336 microversion: 2.57 time: 0.137382 Jan 15 21:06:12.061338 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2714/5424] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:06:11 2022] GET /compute/v2.1/servers/896b0f6d-8007-44c8-9bdc-db25f69a8d51 => generated 1336 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:06:12.254995 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-37075e1a-31eb-4739-9d71-9869ad049a4f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:06:12.256131 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-37075e1a-31eb-4739-9d71-9869ad049a4f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:12.264585 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-37075e1a-31eb-4739-9d71-9869ad049a4f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:12.265078 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-37075e1a-31eb-4739-9d71-9869ad049a4f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:12.266010 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-37075e1a-31eb-4739-9d71-9869ad049a4f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:12.266467 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-37075e1a-31eb-4739-9d71-9869ad049a4f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:12.317972 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-37075e1a-31eb-4739-9d71-9869ad049a4f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.066837 Jan 15 21:06:12.319553 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2711/5425] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:06:12 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:06:12.790453 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-69daf139-9eaa-449c-97bb-c5b5450de81c tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:06:12.791917 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-69daf139-9eaa-449c-97bb-c5b5450de81c tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: d9db70df-9ffc-4b96-af06-a56b3b35ce91] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:12.801739 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-69daf139-9eaa-449c-97bb-c5b5450de81c tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:12.802341 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-69daf139-9eaa-449c-97bb-c5b5450de81c tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:12.803243 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-69daf139-9eaa-449c-97bb-c5b5450de81c tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:12.803688 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-69daf139-9eaa-449c-97bb-c5b5450de81c tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:12.850171 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-69daf139-9eaa-449c-97bb-c5b5450de81c tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action" status: 200 len: 32646 microversion: 2.1 time: 0.063920 Jan 15 21:06:12.850887 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2715/5426] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:06:12 2022] POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action => generated 32646 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:06:13.090413 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-0778df20-842c-41cd-ab59-0aac84eab6e1 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:06:13.090413 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-0778df20-842c-41cd-ab59-0aac84eab6e1 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] [instance: 896b0f6d-8007-44c8-9bdc-db25f69a8d51] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:13.100093 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0778df20-842c-41cd-ab59-0aac84eab6e1 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:13.100917 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0778df20-842c-41cd-ab59-0aac84eab6e1 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:13.101981 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0778df20-842c-41cd-ab59-0aac84eab6e1 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:13.102418 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0778df20-842c-41cd-ab59-0aac84eab6e1 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:13.194729 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-0778df20-842c-41cd-ab59-0aac84eab6e1 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5556986824774afaa455010da540de2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b11e8e9465264349892209758f3c396d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:13.206980 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-0778df20-842c-41cd-ab59-0aac84eab6e1 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5556986824774afaa455010da540de2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b11e8e9465264349892209758f3c396d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:13.208422 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-0778df20-842c-41cd-ab59-0aac84eab6e1 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5556986824774afaa455010da540de2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b11e8e9465264349892209758f3c396d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:13.210536 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-0778df20-842c-41cd-ab59-0aac84eab6e1 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] 10.222.0.46 "GET /compute/v2.1/servers/896b0f6d-8007-44c8-9bdc-db25f69a8d51" status: 200 len: 1357 microversion: 2.57 time: 0.133725 Jan 15 21:06:13.211259 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2712/5427] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:06:13 2022] GET /compute/v2.1/servers/896b0f6d-8007-44c8-9bdc-db25f69a8d51 => generated 1357 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:06:13.232228 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-902a42d6-0f1a-483e-8303-08dfa758fcd5 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:06:13.235270 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-902a42d6-0f1a-483e-8303-08dfa758fcd5 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] [instance: 896b0f6d-8007-44c8-9bdc-db25f69a8d51] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:13.246133 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-902a42d6-0f1a-483e-8303-08dfa758fcd5 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:13.246953 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-902a42d6-0f1a-483e-8303-08dfa758fcd5 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:13.248417 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-902a42d6-0f1a-483e-8303-08dfa758fcd5 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:13.249528 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-902a42d6-0f1a-483e-8303-08dfa758fcd5 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:13.335335 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f162c622-3fa6-4ebc-8661-85cc11e0fc7d tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:06:13.337982 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f162c622-3fa6-4ebc-8661-85cc11e0fc7d tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:13.355692 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f162c622-3fa6-4ebc-8661-85cc11e0fc7d tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:13.355692 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f162c622-3fa6-4ebc-8661-85cc11e0fc7d tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:13.355692 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f162c622-3fa6-4ebc-8661-85cc11e0fc7d tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:13.355692 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f162c622-3fa6-4ebc-8661-85cc11e0fc7d tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:13.370437 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-902a42d6-0f1a-483e-8303-08dfa758fcd5 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Flavor limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 21:06:13.370868 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-902a42d6-0f1a-483e-8303-08dfa758fcd5 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Image limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 21:06:13.371345 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-902a42d6-0f1a-483e-8303-08dfa758fcd5 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Flavor pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 21:06:13.377537 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-902a42d6-0f1a-483e-8303-08dfa758fcd5 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Image pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 21:06:13.378093 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-902a42d6-0f1a-483e-8303-08dfa758fcd5 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 21:06:13.416514 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f162c622-3fa6-4ebc-8661-85cc11e0fc7d tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.084442 Jan 15 21:06:13.417429 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2713/5428] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:06:13 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:06:13.481556 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-902a42d6-0f1a-483e-8303-08dfa758fcd5 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] [instance: 896b0f6d-8007-44c8-9bdc-db25f69a8d51] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:13.489539 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-902a42d6-0f1a-483e-8303-08dfa758fcd5 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:13.490292 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-902a42d6-0f1a-483e-8303-08dfa758fcd5 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:13.491287 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-902a42d6-0f1a-483e-8303-08dfa758fcd5 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:13.491980 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-902a42d6-0f1a-483e-8303-08dfa758fcd5 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:13.514509 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8ca920f9-d79e-416c-81b8-06a43691d278 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:06:13.515142 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-8ca920f9-d79e-416c-81b8-06a43691d278 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:13.527854 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-902a42d6-0f1a-483e-8303-08dfa758fcd5 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] 10.222.0.46 "POST /compute/v2.1/servers/896b0f6d-8007-44c8-9bdc-db25f69a8d51/action" status: 202 len: 1138 microversion: 2.57 time: 0.301850 Jan 15 21:06:13.528811 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2716/5429] 10.222.0.46 () {62 vars in 1319 bytes} [Sat Jan 15 21:06:13 2022] POST /compute/v2.1/servers/896b0f6d-8007-44c8-9bdc-db25f69a8d51/action => generated 1138 bytes in 304 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jan 15 21:06:13.537450 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8ca920f9-d79e-416c-81b8-06a43691d278 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:13.537983 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8ca920f9-d79e-416c-81b8-06a43691d278 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:13.538825 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8ca920f9-d79e-416c-81b8-06a43691d278 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:13.539512 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8ca920f9-d79e-416c-81b8-06a43691d278 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:13.550636 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-83a38d9a-bdb9-4714-88aa-d17305d9ded7 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:06:13.552671 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-83a38d9a-bdb9-4714-88aa-d17305d9ded7 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] [instance: 896b0f6d-8007-44c8-9bdc-db25f69a8d51] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:13.560550 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-83a38d9a-bdb9-4714-88aa-d17305d9ded7 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:13.561315 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-83a38d9a-bdb9-4714-88aa-d17305d9ded7 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:13.562633 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-83a38d9a-bdb9-4714-88aa-d17305d9ded7 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:13.563443 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-83a38d9a-bdb9-4714-88aa-d17305d9ded7 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:13.592673 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.objects.instance [None req-8ca920f9-d79e-416c-81b8-06a43691d278 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lazy-loading 'flavor' on Instance uuid a1b412a8-0407-44fd-8f16-7cbcd8de3a42 {{(pid=129365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 21:06:13.668632 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-83a38d9a-bdb9-4714-88aa-d17305d9ded7 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5556986824774afaa455010da540de2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b11e8e9465264349892209758f3c396d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:13.681394 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-83a38d9a-bdb9-4714-88aa-d17305d9ded7 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5556986824774afaa455010da540de2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b11e8e9465264349892209758f3c396d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:13.683398 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-83a38d9a-bdb9-4714-88aa-d17305d9ded7 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5556986824774afaa455010da540de2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b11e8e9465264349892209758f3c396d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:13.684621 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-83a38d9a-bdb9-4714-88aa-d17305d9ded7 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] 10.222.0.46 "GET /compute/v2.1/servers/896b0f6d-8007-44c8-9bdc-db25f69a8d51" status: 200 len: 1366 microversion: 2.57 time: 0.138873 Jan 15 21:06:13.686520 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2717/5430] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:06:13 2022] GET /compute/v2.1/servers/896b0f6d-8007-44c8-9bdc-db25f69a8d51 => generated 1366 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:06:13.861900 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8d832735-faa0-4302-ac81-61a8d73dade1 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:06:13.862769 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-8d832735-faa0-4302-ac81-61a8d73dade1 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: d9db70df-9ffc-4b96-af06-a56b3b35ce91] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:13.874206 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8d832735-faa0-4302-ac81-61a8d73dade1 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:13.874934 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8d832735-faa0-4302-ac81-61a8d73dade1 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:13.876732 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8d832735-faa0-4302-ac81-61a8d73dade1 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:13.877442 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8d832735-faa0-4302-ac81-61a8d73dade1 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:13.937291 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-8d832735-faa0-4302-ac81-61a8d73dade1 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action" status: 200 len: 32646 microversion: 2.1 time: 0.078632 Jan 15 21:06:13.937777 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2718/5431] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:06:13 2022] POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action => generated 32646 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 21:06:13.975181 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-8ca920f9-d79e-416c-81b8-06a43691d278 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action" status: 202 len: 0 microversion: 2.20 time: 0.467886 Jan 15 21:06:13.976094 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2714/5432] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:06:13 2022] POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action => generated 0 bytes in 470 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jan 15 21:06:13.986720 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f69902e3-2e69-47df-8509-6439af5e3ea8 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:06:13.987604 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f69902e3-2e69-47df-8509-6439af5e3ea8 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:13.995187 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f69902e3-2e69-47df-8509-6439af5e3ea8 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:13.995711 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f69902e3-2e69-47df-8509-6439af5e3ea8 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:13.996623 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f69902e3-2e69-47df-8509-6439af5e3ea8 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:13.997324 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f69902e3-2e69-47df-8509-6439af5e3ea8 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:14.145977 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-f69902e3-2e69-47df-8509-6439af5e3ea8 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:14.155129 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-f69902e3-2e69-47df-8509-6439af5e3ea8 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:14.156829 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-f69902e3-2e69-47df-8509-6439af5e3ea8 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:14.158305 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f69902e3-2e69-47df-8509-6439af5e3ea8 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42" status: 200 len: 1722 microversion: 2.20 time: 0.176066 Jan 15 21:06:14.158968 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2719/5433] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:06:13 2022] GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42 => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:06:14.435627 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-0cfd156c-debe-403f-a0c3-5d21d93646ef tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:06:14.436639 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-0cfd156c-debe-403f-a0c3-5d21d93646ef tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:14.443075 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0cfd156c-debe-403f-a0c3-5d21d93646ef tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:14.443533 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0cfd156c-debe-403f-a0c3-5d21d93646ef tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:14.444355 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0cfd156c-debe-403f-a0c3-5d21d93646ef tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:14.444796 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0cfd156c-debe-403f-a0c3-5d21d93646ef tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:14.487008 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-0cfd156c-debe-403f-a0c3-5d21d93646ef tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.056517 Jan 15 21:06:14.488996 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2715/5434] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:06:14 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:06:14.706673 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e0e361b4-2774-4703-b09b-f79b219261a9 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:06:14.707198 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e0e361b4-2774-4703-b09b-f79b219261a9 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] [instance: 896b0f6d-8007-44c8-9bdc-db25f69a8d51] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:14.715570 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e0e361b4-2774-4703-b09b-f79b219261a9 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:14.716020 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e0e361b4-2774-4703-b09b-f79b219261a9 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:14.717654 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e0e361b4-2774-4703-b09b-f79b219261a9 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:14.718082 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e0e361b4-2774-4703-b09b-f79b219261a9 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:14.792274 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-e0e361b4-2774-4703-b09b-f79b219261a9 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5556986824774afaa455010da540de2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b11e8e9465264349892209758f3c396d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:14.801694 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-e0e361b4-2774-4703-b09b-f79b219261a9 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5556986824774afaa455010da540de2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b11e8e9465264349892209758f3c396d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:14.803594 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-e0e361b4-2774-4703-b09b-f79b219261a9 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5556986824774afaa455010da540de2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b11e8e9465264349892209758f3c396d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:14.805020 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e0e361b4-2774-4703-b09b-f79b219261a9 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] 10.222.0.46 "GET /compute/v2.1/servers/896b0f6d-8007-44c8-9bdc-db25f69a8d51" status: 200 len: 1366 microversion: 2.57 time: 0.102409 Jan 15 21:06:14.805682 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2720/5435] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:06:14 2022] GET /compute/v2.1/servers/896b0f6d-8007-44c8-9bdc-db25f69a8d51 => generated 1366 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:06:14.949808 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3c01aa88-ee7c-40cd-bf99-9df9d3ef6106 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:06:14.950935 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-3c01aa88-ee7c-40cd-bf99-9df9d3ef6106 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: d9db70df-9ffc-4b96-af06-a56b3b35ce91] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:14.957902 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3c01aa88-ee7c-40cd-bf99-9df9d3ef6106 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:14.958424 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3c01aa88-ee7c-40cd-bf99-9df9d3ef6106 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:14.959217 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3c01aa88-ee7c-40cd-bf99-9df9d3ef6106 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:14.959653 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3c01aa88-ee7c-40cd-bf99-9df9d3ef6106 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:15.003911 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3c01aa88-ee7c-40cd-bf99-9df9d3ef6106 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action" status: 200 len: 32646 microversion: 2.1 time: 0.058379 Jan 15 21:06:15.004568 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2716/5436] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:06:14 2022] POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action => generated 32646 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:06:15.177419 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b4adc1ea-3e03-4cd5-a95f-c800d2914982 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:06:15.181884 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b4adc1ea-3e03-4cd5-a95f-c800d2914982 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:15.190325 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b4adc1ea-3e03-4cd5-a95f-c800d2914982 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:15.191403 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b4adc1ea-3e03-4cd5-a95f-c800d2914982 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:15.192901 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b4adc1ea-3e03-4cd5-a95f-c800d2914982 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:15.193587 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b4adc1ea-3e03-4cd5-a95f-c800d2914982 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:15.383285 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-b4adc1ea-3e03-4cd5-a95f-c800d2914982 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:15.394725 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-b4adc1ea-3e03-4cd5-a95f-c800d2914982 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:15.397087 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-b4adc1ea-3e03-4cd5-a95f-c800d2914982 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:15.400726 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b4adc1ea-3e03-4cd5-a95f-c800d2914982 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42" status: 200 len: 1722 microversion: 2.20 time: 0.226386 Jan 15 21:06:15.412831 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2721/5437] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:06:15 2022] GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42 => generated 1722 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:06:15.499849 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-7669cbce-9a91-4954-bbaf-c11c55570a91 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:06:15.501401 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-7669cbce-9a91-4954-bbaf-c11c55570a91 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:15.508998 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7669cbce-9a91-4954-bbaf-c11c55570a91 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:15.509450 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7669cbce-9a91-4954-bbaf-c11c55570a91 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:15.510232 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7669cbce-9a91-4954-bbaf-c11c55570a91 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:15.510850 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7669cbce-9a91-4954-bbaf-c11c55570a91 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:15.554094 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-7669cbce-9a91-4954-bbaf-c11c55570a91 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.058201 Jan 15 21:06:15.555439 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2717/5438] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:06:15 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:06:15.824069 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-2d9e626c-a120-4648-8a89-1ec64f959f48 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:06:15.824678 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-2d9e626c-a120-4648-8a89-1ec64f959f48 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] [instance: 896b0f6d-8007-44c8-9bdc-db25f69a8d51] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:15.831748 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2d9e626c-a120-4648-8a89-1ec64f959f48 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:15.832164 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2d9e626c-a120-4648-8a89-1ec64f959f48 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:15.832964 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2d9e626c-a120-4648-8a89-1ec64f959f48 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:15.833625 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2d9e626c-a120-4648-8a89-1ec64f959f48 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:15.905517 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-2d9e626c-a120-4648-8a89-1ec64f959f48 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5556986824774afaa455010da540de2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b11e8e9465264349892209758f3c396d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:15.914009 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-2d9e626c-a120-4648-8a89-1ec64f959f48 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5556986824774afaa455010da540de2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b11e8e9465264349892209758f3c396d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:15.915516 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-2d9e626c-a120-4648-8a89-1ec64f959f48 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5556986824774afaa455010da540de2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b11e8e9465264349892209758f3c396d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:15.916677 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-2d9e626c-a120-4648-8a89-1ec64f959f48 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] 10.222.0.46 "GET /compute/v2.1/servers/896b0f6d-8007-44c8-9bdc-db25f69a8d51" status: 200 len: 1366 microversion: 2.57 time: 0.096948 Jan 15 21:06:15.917559 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2722/5439] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:06:15 2022] GET /compute/v2.1/servers/896b0f6d-8007-44c8-9bdc-db25f69a8d51 => generated 1366 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:06:16.017195 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3aed877d-d966-4482-9e1a-b99123fc5428 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:06:16.018211 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-3aed877d-d966-4482-9e1a-b99123fc5428 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: d9db70df-9ffc-4b96-af06-a56b3b35ce91] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:16.025165 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3aed877d-d966-4482-9e1a-b99123fc5428 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:16.025626 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3aed877d-d966-4482-9e1a-b99123fc5428 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:16.026427 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3aed877d-d966-4482-9e1a-b99123fc5428 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:16.026876 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3aed877d-d966-4482-9e1a-b99123fc5428 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:16.070055 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3aed877d-d966-4482-9e1a-b99123fc5428 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action" status: 200 len: 32646 microversion: 2.1 time: 0.056932 Jan 15 21:06:16.070882 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2718/5440] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:06:16 2022] POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action => generated 32646 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:06:16.419858 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f95ff122-34b0-41c2-abdc-6d1502ae8a7c tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:06:16.420447 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f95ff122-34b0-41c2-abdc-6d1502ae8a7c tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:16.426610 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f95ff122-34b0-41c2-abdc-6d1502ae8a7c tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:16.427062 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f95ff122-34b0-41c2-abdc-6d1502ae8a7c tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:16.427840 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f95ff122-34b0-41c2-abdc-6d1502ae8a7c tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:16.428274 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f95ff122-34b0-41c2-abdc-6d1502ae8a7c tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:16.566884 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8d42d3ca-2a26-4f14-814e-353c4e1bb946 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:06:16.567408 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-f95ff122-34b0-41c2-abdc-6d1502ae8a7c tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:16.567884 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-8d42d3ca-2a26-4f14-814e-353c4e1bb946 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:16.576687 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-f95ff122-34b0-41c2-abdc-6d1502ae8a7c tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:16.579237 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-f95ff122-34b0-41c2-abdc-6d1502ae8a7c tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:16.580422 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f95ff122-34b0-41c2-abdc-6d1502ae8a7c tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42" status: 200 len: 1722 microversion: 2.20 time: 0.164582 Jan 15 21:06:16.582096 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2723/5441] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:06:16 2022] GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:06:16.589190 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8d42d3ca-2a26-4f14-814e-353c4e1bb946 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:16.589673 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8d42d3ca-2a26-4f14-814e-353c4e1bb946 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:16.590447 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8d42d3ca-2a26-4f14-814e-353c4e1bb946 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:16.590884 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8d42d3ca-2a26-4f14-814e-353c4e1bb946 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:16.638805 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-8d42d3ca-2a26-4f14-814e-353c4e1bb946 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.076372 Jan 15 21:06:16.643090 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2719/5442] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:06:16 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:06:16.937575 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-3679b0c4-3e50-4cee-90c3-b8cb2ab0dda9 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:06:16.938595 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-3679b0c4-3e50-4cee-90c3-b8cb2ab0dda9 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] [instance: 896b0f6d-8007-44c8-9bdc-db25f69a8d51] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:16.947596 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3679b0c4-3e50-4cee-90c3-b8cb2ab0dda9 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:16.948202 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3679b0c4-3e50-4cee-90c3-b8cb2ab0dda9 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:16.949779 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3679b0c4-3e50-4cee-90c3-b8cb2ab0dda9 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:16.950695 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3679b0c4-3e50-4cee-90c3-b8cb2ab0dda9 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:17.022604 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-3679b0c4-3e50-4cee-90c3-b8cb2ab0dda9 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5556986824774afaa455010da540de2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b11e8e9465264349892209758f3c396d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:17.031383 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-3679b0c4-3e50-4cee-90c3-b8cb2ab0dda9 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5556986824774afaa455010da540de2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b11e8e9465264349892209758f3c396d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:17.035922 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-3679b0c4-3e50-4cee-90c3-b8cb2ab0dda9 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5556986824774afaa455010da540de2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b11e8e9465264349892209758f3c396d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:17.037623 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-3679b0c4-3e50-4cee-90c3-b8cb2ab0dda9 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] 10.222.0.46 "GET /compute/v2.1/servers/896b0f6d-8007-44c8-9bdc-db25f69a8d51" status: 200 len: 1366 microversion: 2.57 time: 0.104878 Jan 15 21:06:17.038298 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2724/5443] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:06:16 2022] GET /compute/v2.1/servers/896b0f6d-8007-44c8-9bdc-db25f69a8d51 => generated 1366 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:06:17.082250 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3bea1f4b-7e3b-4f7e-8310-55bde4c59589 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:06:17.083765 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-3bea1f4b-7e3b-4f7e-8310-55bde4c59589 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: d9db70df-9ffc-4b96-af06-a56b3b35ce91] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:17.092422 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3bea1f4b-7e3b-4f7e-8310-55bde4c59589 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:17.092943 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3bea1f4b-7e3b-4f7e-8310-55bde4c59589 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:17.094049 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3bea1f4b-7e3b-4f7e-8310-55bde4c59589 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:17.094807 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3bea1f4b-7e3b-4f7e-8310-55bde4c59589 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:17.147973 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3bea1f4b-7e3b-4f7e-8310-55bde4c59589 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action" status: 200 len: 32646 microversion: 2.1 time: 0.070239 Jan 15 21:06:17.148919 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2720/5444] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:06:17 2022] POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action => generated 32646 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:06:17.600114 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e65ec032-28c2-46d9-ac90-8dafbef369ac tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:06:17.600731 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e65ec032-28c2-46d9-ac90-8dafbef369ac tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:17.606839 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e65ec032-28c2-46d9-ac90-8dafbef369ac tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:17.607338 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e65ec032-28c2-46d9-ac90-8dafbef369ac tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:17.608366 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e65ec032-28c2-46d9-ac90-8dafbef369ac tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:17.609545 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e65ec032-28c2-46d9-ac90-8dafbef369ac tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:17.651079 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8a5ca08c-3d08-488e-b8ff-045db3407b28 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:06:17.652084 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-8a5ca08c-3d08-488e-b8ff-045db3407b28 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:17.660392 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8a5ca08c-3d08-488e-b8ff-045db3407b28 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:17.661066 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8a5ca08c-3d08-488e-b8ff-045db3407b28 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:17.661931 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8a5ca08c-3d08-488e-b8ff-045db3407b28 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:17.662511 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8a5ca08c-3d08-488e-b8ff-045db3407b28 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:17.709104 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-8a5ca08c-3d08-488e-b8ff-045db3407b28 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.061567 Jan 15 21:06:17.709959 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2721/5445] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:06:17 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:06:17.754731 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-e65ec032-28c2-46d9-ac90-8dafbef369ac tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:17.763058 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-e65ec032-28c2-46d9-ac90-8dafbef369ac tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:17.764552 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-e65ec032-28c2-46d9-ac90-8dafbef369ac tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:17.765776 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e65ec032-28c2-46d9-ac90-8dafbef369ac tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42" status: 200 len: 1722 microversion: 2.20 time: 0.169410 Jan 15 21:06:17.766368 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2725/5446] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:06:17 2022] GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:06:18.057243 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-4ecae5a4-6235-4d0a-8725-81fcf238688b tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:06:18.057978 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-4ecae5a4-6235-4d0a-8725-81fcf238688b tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] [instance: 896b0f6d-8007-44c8-9bdc-db25f69a8d51] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:18.064958 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4ecae5a4-6235-4d0a-8725-81fcf238688b tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:18.065418 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4ecae5a4-6235-4d0a-8725-81fcf238688b tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:18.066206 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4ecae5a4-6235-4d0a-8725-81fcf238688b tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:18.066651 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4ecae5a4-6235-4d0a-8725-81fcf238688b tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:18.130638 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-4ecae5a4-6235-4d0a-8725-81fcf238688b tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5556986824774afaa455010da540de2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b11e8e9465264349892209758f3c396d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:18.139725 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-4ecae5a4-6235-4d0a-8725-81fcf238688b tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5556986824774afaa455010da540de2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b11e8e9465264349892209758f3c396d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:18.141219 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-4ecae5a4-6235-4d0a-8725-81fcf238688b tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5556986824774afaa455010da540de2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b11e8e9465264349892209758f3c396d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:18.142485 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-4ecae5a4-6235-4d0a-8725-81fcf238688b tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] 10.222.0.46 "GET /compute/v2.1/servers/896b0f6d-8007-44c8-9bdc-db25f69a8d51" status: 200 len: 1366 microversion: 2.57 time: 0.089934 Jan 15 21:06:18.143328 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2722/5447] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:06:18 2022] GET /compute/v2.1/servers/896b0f6d-8007-44c8-9bdc-db25f69a8d51 => generated 1366 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:06:18.160721 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-562e531f-f12f-44a3-88c5-a13c673a1bc3 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:06:18.163463 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-562e531f-f12f-44a3-88c5-a13c673a1bc3 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: d9db70df-9ffc-4b96-af06-a56b3b35ce91] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:18.175381 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-562e531f-f12f-44a3-88c5-a13c673a1bc3 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:18.176312 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-562e531f-f12f-44a3-88c5-a13c673a1bc3 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:18.177565 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-562e531f-f12f-44a3-88c5-a13c673a1bc3 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:18.178108 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-562e531f-f12f-44a3-88c5-a13c673a1bc3 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:18.234191 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-562e531f-f12f-44a3-88c5-a13c673a1bc3 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action" status: 200 len: 32646 microversion: 2.1 time: 0.077311 Jan 15 21:06:18.238682 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2726/5448] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:06:18 2022] POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action => generated 32646 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:06:18.722894 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-1a2ca79a-cbb1-4dc4-a281-b625c46f560b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:06:18.723848 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-1a2ca79a-cbb1-4dc4-a281-b625c46f560b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:18.732429 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1a2ca79a-cbb1-4dc4-a281-b625c46f560b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:18.732908 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1a2ca79a-cbb1-4dc4-a281-b625c46f560b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:18.733707 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1a2ca79a-cbb1-4dc4-a281-b625c46f560b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:18.734148 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1a2ca79a-cbb1-4dc4-a281-b625c46f560b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:18.781439 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-1a2ca79a-cbb1-4dc4-a281-b625c46f560b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.062916 Jan 15 21:06:18.782247 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2723/5449] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:06:18 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:06:18.786823 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7cb76e28-9915-4ec3-9205-1c1a9680bfab tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:06:18.787676 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-7cb76e28-9915-4ec3-9205-1c1a9680bfab tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:18.795444 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7cb76e28-9915-4ec3-9205-1c1a9680bfab tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:18.796081 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7cb76e28-9915-4ec3-9205-1c1a9680bfab tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:18.796941 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7cb76e28-9915-4ec3-9205-1c1a9680bfab tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:18.797429 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7cb76e28-9915-4ec3-9205-1c1a9680bfab tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:18.942551 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-7cb76e28-9915-4ec3-9205-1c1a9680bfab tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:18.952135 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-7cb76e28-9915-4ec3-9205-1c1a9680bfab tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:18.953792 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-7cb76e28-9915-4ec3-9205-1c1a9680bfab tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:18.955222 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7cb76e28-9915-4ec3-9205-1c1a9680bfab tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42" status: 200 len: 1722 microversion: 2.20 time: 0.173842 Jan 15 21:06:18.955785 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2727/5450] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:06:18 2022] GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42 => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 15 21:06:19.161994 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-61d02546-0a63-461c-94ba-ee8d9bd6ec20 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:06:19.162737 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-61d02546-0a63-461c-94ba-ee8d9bd6ec20 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] [instance: 896b0f6d-8007-44c8-9bdc-db25f69a8d51] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:19.170465 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-61d02546-0a63-461c-94ba-ee8d9bd6ec20 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:19.170926 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-61d02546-0a63-461c-94ba-ee8d9bd6ec20 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:19.171720 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-61d02546-0a63-461c-94ba-ee8d9bd6ec20 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:19.172162 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-61d02546-0a63-461c-94ba-ee8d9bd6ec20 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:19.247309 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4188ae8f-e13f-4dd6-8df1-43876e06c208 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:06:19.248224 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-4188ae8f-e13f-4dd6-8df1-43876e06c208 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: d9db70df-9ffc-4b96-af06-a56b3b35ce91] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:19.252341 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-61d02546-0a63-461c-94ba-ee8d9bd6ec20 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5556986824774afaa455010da540de2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b11e8e9465264349892209758f3c396d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:19.255758 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4188ae8f-e13f-4dd6-8df1-43876e06c208 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:19.256240 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4188ae8f-e13f-4dd6-8df1-43876e06c208 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:19.257359 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4188ae8f-e13f-4dd6-8df1-43876e06c208 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:19.259332 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4188ae8f-e13f-4dd6-8df1-43876e06c208 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:19.262567 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-61d02546-0a63-461c-94ba-ee8d9bd6ec20 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5556986824774afaa455010da540de2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b11e8e9465264349892209758f3c396d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:19.264089 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-61d02546-0a63-461c-94ba-ee8d9bd6ec20 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5556986824774afaa455010da540de2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b11e8e9465264349892209758f3c396d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:19.265473 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-61d02546-0a63-461c-94ba-ee8d9bd6ec20 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] 10.222.0.46 "GET /compute/v2.1/servers/896b0f6d-8007-44c8-9bdc-db25f69a8d51" status: 200 len: 1366 microversion: 2.57 time: 0.107673 Jan 15 21:06:19.266026 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2724/5451] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:06:19 2022] GET /compute/v2.1/servers/896b0f6d-8007-44c8-9bdc-db25f69a8d51 => generated 1366 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:06:19.299904 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-4188ae8f-e13f-4dd6-8df1-43876e06c208 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action" status: 200 len: 32646 microversion: 2.1 time: 0.056703 Jan 15 21:06:19.300542 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2728/5452] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:06:19 2022] POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action => generated 32646 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:06:19.794149 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5276ae9b-a7f2-43e7-bd40-550bfd17cf80 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:06:19.795227 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-5276ae9b-a7f2-43e7-bd40-550bfd17cf80 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:19.803828 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5276ae9b-a7f2-43e7-bd40-550bfd17cf80 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:19.804444 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5276ae9b-a7f2-43e7-bd40-550bfd17cf80 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:19.805767 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5276ae9b-a7f2-43e7-bd40-550bfd17cf80 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:19.806252 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5276ae9b-a7f2-43e7-bd40-550bfd17cf80 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:19.849222 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5276ae9b-a7f2-43e7-bd40-550bfd17cf80 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.060049 Jan 15 21:06:19.849908 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2725/5453] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:06:19 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:06:19.974097 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-aa6b545e-0c67-4a46-9180-d88c76592b0c tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:06:19.974793 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-aa6b545e-0c67-4a46-9180-d88c76592b0c tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:19.985345 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-aa6b545e-0c67-4a46-9180-d88c76592b0c tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:19.985843 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-aa6b545e-0c67-4a46-9180-d88c76592b0c tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:19.986666 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-aa6b545e-0c67-4a46-9180-d88c76592b0c tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:19.987265 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-aa6b545e-0c67-4a46-9180-d88c76592b0c tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:20.141353 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-aa6b545e-0c67-4a46-9180-d88c76592b0c tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:20.149542 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-aa6b545e-0c67-4a46-9180-d88c76592b0c tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:20.151031 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-aa6b545e-0c67-4a46-9180-d88c76592b0c tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:20.152190 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-aa6b545e-0c67-4a46-9180-d88c76592b0c tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42" status: 200 len: 1722 microversion: 2.20 time: 0.182220 Jan 15 21:06:20.152752 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2729/5454] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:06:19 2022] GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42 => generated 1722 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:06:20.284112 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-730e20e1-3a2e-4c80-8073-b89fb2c95fd0 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:06:20.284941 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-730e20e1-3a2e-4c80-8073-b89fb2c95fd0 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] [instance: 896b0f6d-8007-44c8-9bdc-db25f69a8d51] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:20.292291 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-730e20e1-3a2e-4c80-8073-b89fb2c95fd0 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:20.293022 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-730e20e1-3a2e-4c80-8073-b89fb2c95fd0 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:20.293821 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-730e20e1-3a2e-4c80-8073-b89fb2c95fd0 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:20.294268 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-730e20e1-3a2e-4c80-8073-b89fb2c95fd0 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:20.314284 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9c2dff48-326b-4adc-8d59-35469214f6e6 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:06:20.315378 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-9c2dff48-326b-4adc-8d59-35469214f6e6 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: d9db70df-9ffc-4b96-af06-a56b3b35ce91] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:20.324397 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9c2dff48-326b-4adc-8d59-35469214f6e6 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:20.325019 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9c2dff48-326b-4adc-8d59-35469214f6e6 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:20.325900 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9c2dff48-326b-4adc-8d59-35469214f6e6 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:20.326345 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9c2dff48-326b-4adc-8d59-35469214f6e6 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:20.373823 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-9c2dff48-326b-4adc-8d59-35469214f6e6 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action" status: 200 len: 32646 microversion: 2.1 time: 0.064193 Jan 15 21:06:20.374424 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2730/5455] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:06:20 2022] POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action => generated 32646 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 21:06:20.380606 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-730e20e1-3a2e-4c80-8073-b89fb2c95fd0 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5556986824774afaa455010da540de2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b11e8e9465264349892209758f3c396d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:20.389419 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-730e20e1-3a2e-4c80-8073-b89fb2c95fd0 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5556986824774afaa455010da540de2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b11e8e9465264349892209758f3c396d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:20.391012 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-730e20e1-3a2e-4c80-8073-b89fb2c95fd0 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5556986824774afaa455010da540de2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b11e8e9465264349892209758f3c396d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:20.392341 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-730e20e1-3a2e-4c80-8073-b89fb2c95fd0 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] 10.222.0.46 "GET /compute/v2.1/servers/896b0f6d-8007-44c8-9bdc-db25f69a8d51" status: 200 len: 1366 microversion: 2.57 time: 0.112414 Jan 15 21:06:20.392998 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2726/5456] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:06:20 2022] GET /compute/v2.1/servers/896b0f6d-8007-44c8-9bdc-db25f69a8d51 => generated 1366 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:06:20.862321 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8132cf33-0697-4049-8299-e7dbc1dca285 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:06:20.863324 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-8132cf33-0697-4049-8299-e7dbc1dca285 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:20.870593 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8132cf33-0697-4049-8299-e7dbc1dca285 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:20.871166 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8132cf33-0697-4049-8299-e7dbc1dca285 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:20.872135 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8132cf33-0697-4049-8299-e7dbc1dca285 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:20.872639 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8132cf33-0697-4049-8299-e7dbc1dca285 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:20.918744 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-8132cf33-0697-4049-8299-e7dbc1dca285 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.060268 Jan 15 21:06:20.920408 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2731/5457] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:06:20 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:06:21.171316 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a7e4b9fa-dfd4-445a-9026-00887de68b09 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:06:21.172976 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a7e4b9fa-dfd4-445a-9026-00887de68b09 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:21.181072 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a7e4b9fa-dfd4-445a-9026-00887de68b09 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:21.181526 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a7e4b9fa-dfd4-445a-9026-00887de68b09 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:21.182314 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a7e4b9fa-dfd4-445a-9026-00887de68b09 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:21.183205 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a7e4b9fa-dfd4-445a-9026-00887de68b09 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:21.330589 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-a7e4b9fa-dfd4-445a-9026-00887de68b09 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:21.341365 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-a7e4b9fa-dfd4-445a-9026-00887de68b09 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:21.343565 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-a7e4b9fa-dfd4-445a-9026-00887de68b09 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:21.345403 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a7e4b9fa-dfd4-445a-9026-00887de68b09 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42" status: 200 len: 1722 microversion: 2.20 time: 0.177984 Jan 15 21:06:21.346451 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2727/5458] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:06:21 2022] GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42 => generated 1722 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 15 21:06:21.386122 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b801b2e3-82fb-454f-b4f9-95357c32c759 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:06:21.387092 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b801b2e3-82fb-454f-b4f9-95357c32c759 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: d9db70df-9ffc-4b96-af06-a56b3b35ce91] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:21.393972 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b801b2e3-82fb-454f-b4f9-95357c32c759 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:21.394363 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b801b2e3-82fb-454f-b4f9-95357c32c759 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:21.395159 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b801b2e3-82fb-454f-b4f9-95357c32c759 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:21.395596 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b801b2e3-82fb-454f-b4f9-95357c32c759 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:21.450337 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b801b2e3-82fb-454f-b4f9-95357c32c759 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action" status: 200 len: 32646 microversion: 2.1 time: 0.067953 Jan 15 21:06:21.454478 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2728/5459] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:06:21 2022] POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action => generated 32646 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 21:06:21.456374 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c3e51475-826d-44ae-8aed-828dea4a81f2 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:06:21.457088 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c3e51475-826d-44ae-8aed-828dea4a81f2 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] [instance: 896b0f6d-8007-44c8-9bdc-db25f69a8d51] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:21.465212 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c3e51475-826d-44ae-8aed-828dea4a81f2 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:21.465667 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c3e51475-826d-44ae-8aed-828dea4a81f2 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:21.466444 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c3e51475-826d-44ae-8aed-828dea4a81f2 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:21.466877 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c3e51475-826d-44ae-8aed-828dea4a81f2 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:21.505903 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-bd322d68-f7ac-4621-a3d6-2e1d1b02fc4e tempest-PortsAdminExtendedAttrsIpV6TestJSON-645478489 tempest-PortsAdminExtendedAttrsIpV6TestJSON-645478489-project-admin] Calling method '.version_select at 0x7f30c8573c10>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:06:21.511885 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:06:21.511885 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:06:21.516371 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bd322d68-f7ac-4621-a3d6-2e1d1b02fc4e tempest-PortsAdminExtendedAttrsIpV6TestJSON-645478489 tempest-PortsAdminExtendedAttrsIpV6TestJSON-645478489-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:21.517168 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bd322d68-f7ac-4621-a3d6-2e1d1b02fc4e tempest-PortsAdminExtendedAttrsIpV6TestJSON-645478489 tempest-PortsAdminExtendedAttrsIpV6TestJSON-645478489-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:21.535927 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bd322d68-f7ac-4621-a3d6-2e1d1b02fc4e tempest-PortsAdminExtendedAttrsIpV6TestJSON-645478489 tempest-PortsAdminExtendedAttrsIpV6TestJSON-645478489-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:21.536459 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bd322d68-f7ac-4621-a3d6-2e1d1b02fc4e tempest-PortsAdminExtendedAttrsIpV6TestJSON-645478489 tempest-PortsAdminExtendedAttrsIpV6TestJSON-645478489-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:21.548233 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-c3e51475-826d-44ae-8aed-828dea4a81f2 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5556986824774afaa455010da540de2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b11e8e9465264349892209758f3c396d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:21.548475 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bd322d68-f7ac-4621-a3d6-2e1d1b02fc4e tempest-PortsAdminExtendedAttrsIpV6TestJSON-645478489 tempest-PortsAdminExtendedAttrsIpV6TestJSON-645478489-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:21.548964 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bd322d68-f7ac-4621-a3d6-2e1d1b02fc4e tempest-PortsAdminExtendedAttrsIpV6TestJSON-645478489 tempest-PortsAdminExtendedAttrsIpV6TestJSON-645478489-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:21.555766 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-bd322d68-f7ac-4621-a3d6-2e1d1b02fc4e tempest-PortsAdminExtendedAttrsIpV6TestJSON-645478489 tempest-PortsAdminExtendedAttrsIpV6TestJSON-645478489-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.220261 Jan 15 21:06:21.556384 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2732/5460] 10.222.0.46 () {58 vars in 1145 bytes} [Sat Jan 15 21:06:21 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 21:06:21.557349 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-c3e51475-826d-44ae-8aed-828dea4a81f2 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5556986824774afaa455010da540de2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b11e8e9465264349892209758f3c396d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:21.558874 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-c3e51475-826d-44ae-8aed-828dea4a81f2 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5556986824774afaa455010da540de2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b11e8e9465264349892209758f3c396d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:21.560084 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c3e51475-826d-44ae-8aed-828dea4a81f2 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] 10.222.0.46 "GET /compute/v2.1/servers/896b0f6d-8007-44c8-9bdc-db25f69a8d51" status: 200 len: 1366 microversion: 2.57 time: 0.107448 Jan 15 21:06:21.564937 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2729/5461] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:06:21 2022] GET /compute/v2.1/servers/896b0f6d-8007-44c8-9bdc-db25f69a8d51 => generated 1366 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:06:21.931635 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-65dbf319-712b-4b68-858a-ce88c47b6cb9 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:06:21.933608 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-65dbf319-712b-4b68-858a-ce88c47b6cb9 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:21.943495 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-65dbf319-712b-4b68-858a-ce88c47b6cb9 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:21.943900 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-65dbf319-712b-4b68-858a-ce88c47b6cb9 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:21.944691 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-65dbf319-712b-4b68-858a-ce88c47b6cb9 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:21.945998 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-65dbf319-712b-4b68-858a-ce88c47b6cb9 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:21.993322 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-65dbf319-712b-4b68-858a-ce88c47b6cb9 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.065637 Jan 15 21:06:21.994571 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2733/5462] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:06:21 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:06:22.368776 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-46f1899c-9f59-46ea-a7fa-0f628a7a5da6 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:06:22.370670 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-46f1899c-9f59-46ea-a7fa-0f628a7a5da6 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:22.391587 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-46f1899c-9f59-46ea-a7fa-0f628a7a5da6 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:22.392457 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-46f1899c-9f59-46ea-a7fa-0f628a7a5da6 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:22.393829 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-46f1899c-9f59-46ea-a7fa-0f628a7a5da6 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:22.394508 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-46f1899c-9f59-46ea-a7fa-0f628a7a5da6 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:22.463096 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-52412247-fca8-4b1b-a6f1-c9c9a7015f3e tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:06:22.464674 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-52412247-fca8-4b1b-a6f1-c9c9a7015f3e tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: d9db70df-9ffc-4b96-af06-a56b3b35ce91] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:22.472504 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-52412247-fca8-4b1b-a6f1-c9c9a7015f3e tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:22.473193 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-52412247-fca8-4b1b-a6f1-c9c9a7015f3e tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:22.473986 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-52412247-fca8-4b1b-a6f1-c9c9a7015f3e tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:22.474753 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-52412247-fca8-4b1b-a6f1-c9c9a7015f3e tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:22.519157 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-52412247-fca8-4b1b-a6f1-c9c9a7015f3e tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action" status: 200 len: 32646 microversion: 2.1 time: 0.060397 Jan 15 21:06:22.524275 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2734/5463] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:06:22 2022] POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action => generated 32646 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 21:06:22.579552 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-693748d2-7d63-4ea5-ac1c-e320473ebe73 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:06:22.580263 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-693748d2-7d63-4ea5-ac1c-e320473ebe73 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] [instance: 896b0f6d-8007-44c8-9bdc-db25f69a8d51] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:22.587720 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-693748d2-7d63-4ea5-ac1c-e320473ebe73 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:22.588178 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-693748d2-7d63-4ea5-ac1c-e320473ebe73 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:22.589035 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-693748d2-7d63-4ea5-ac1c-e320473ebe73 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:22.589480 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-693748d2-7d63-4ea5-ac1c-e320473ebe73 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:22.627251 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-46f1899c-9f59-46ea-a7fa-0f628a7a5da6 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:22.636122 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-46f1899c-9f59-46ea-a7fa-0f628a7a5da6 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:22.637674 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-46f1899c-9f59-46ea-a7fa-0f628a7a5da6 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:22.638860 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-46f1899c-9f59-46ea-a7fa-0f628a7a5da6 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42" status: 200 len: 1722 microversion: 2.20 time: 0.275164 Jan 15 21:06:22.639429 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2730/5464] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:06:22 2022] GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42 => generated 1722 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:06:22.666113 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-693748d2-7d63-4ea5-ac1c-e320473ebe73 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5556986824774afaa455010da540de2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b11e8e9465264349892209758f3c396d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:22.675487 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-693748d2-7d63-4ea5-ac1c-e320473ebe73 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5556986824774afaa455010da540de2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b11e8e9465264349892209758f3c396d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:22.676960 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-693748d2-7d63-4ea5-ac1c-e320473ebe73 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5556986824774afaa455010da540de2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b11e8e9465264349892209758f3c396d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:22.678856 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-693748d2-7d63-4ea5-ac1c-e320473ebe73 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] 10.222.0.46 "GET /compute/v2.1/servers/896b0f6d-8007-44c8-9bdc-db25f69a8d51" status: 200 len: 1366 microversion: 2.57 time: 0.103969 Jan 15 21:06:22.680228 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2735/5465] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:06:22 2022] GET /compute/v2.1/servers/896b0f6d-8007-44c8-9bdc-db25f69a8d51 => generated 1366 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 15 21:06:23.006419 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-477133b5-b3c3-4fc4-9b77-34b24ae20e6f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:06:23.008071 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-477133b5-b3c3-4fc4-9b77-34b24ae20e6f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:23.014974 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-477133b5-b3c3-4fc4-9b77-34b24ae20e6f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:23.015356 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-477133b5-b3c3-4fc4-9b77-34b24ae20e6f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:23.016149 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-477133b5-b3c3-4fc4-9b77-34b24ae20e6f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:23.016584 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-477133b5-b3c3-4fc4-9b77-34b24ae20e6f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:23.059270 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-477133b5-b3c3-4fc4-9b77-34b24ae20e6f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.056745 Jan 15 21:06:23.060239 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2731/5466] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:06:23 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:06:23.531634 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-10c5a3ad-8e37-4f0a-8614-8a1c979f33d0 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:06:23.532702 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-10c5a3ad-8e37-4f0a-8614-8a1c979f33d0 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: d9db70df-9ffc-4b96-af06-a56b3b35ce91] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:23.540547 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-10c5a3ad-8e37-4f0a-8614-8a1c979f33d0 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:23.541041 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-10c5a3ad-8e37-4f0a-8614-8a1c979f33d0 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:23.541881 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-10c5a3ad-8e37-4f0a-8614-8a1c979f33d0 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:23.542327 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-10c5a3ad-8e37-4f0a-8614-8a1c979f33d0 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:23.591674 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-10c5a3ad-8e37-4f0a-8614-8a1c979f33d0 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action" status: 200 len: 32646 microversion: 2.1 time: 0.063538 Jan 15 21:06:23.592993 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2736/5467] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:06:23 2022] POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action => generated 32646 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:06:23.658659 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d17c2e7d-04ec-469f-ba2f-37d7714a19eb tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:06:23.659465 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d17c2e7d-04ec-469f-ba2f-37d7714a19eb tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:23.667025 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d17c2e7d-04ec-469f-ba2f-37d7714a19eb tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:23.667476 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d17c2e7d-04ec-469f-ba2f-37d7714a19eb tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:23.668532 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d17c2e7d-04ec-469f-ba2f-37d7714a19eb tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:23.669179 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d17c2e7d-04ec-469f-ba2f-37d7714a19eb tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:23.702312 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b61bda98-1f69-426b-a1fc-d5106c212134 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:06:23.703285 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b61bda98-1f69-426b-a1fc-d5106c212134 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] [instance: 896b0f6d-8007-44c8-9bdc-db25f69a8d51] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:23.713460 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b61bda98-1f69-426b-a1fc-d5106c212134 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:23.713918 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b61bda98-1f69-426b-a1fc-d5106c212134 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:23.714721 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b61bda98-1f69-426b-a1fc-d5106c212134 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:23.715164 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b61bda98-1f69-426b-a1fc-d5106c212134 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:23.803916 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-b61bda98-1f69-426b-a1fc-d5106c212134 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5556986824774afaa455010da540de2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b11e8e9465264349892209758f3c396d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:23.813858 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-b61bda98-1f69-426b-a1fc-d5106c212134 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5556986824774afaa455010da540de2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b11e8e9465264349892209758f3c396d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:23.815457 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-b61bda98-1f69-426b-a1fc-d5106c212134 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5556986824774afaa455010da540de2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b11e8e9465264349892209758f3c396d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:23.819154 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b61bda98-1f69-426b-a1fc-d5106c212134 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] 10.222.0.46 "GET /compute/v2.1/servers/896b0f6d-8007-44c8-9bdc-db25f69a8d51" status: 200 len: 1366 microversion: 2.57 time: 0.125060 Jan 15 21:06:23.819736 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2737/5468] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:06:23 2022] GET /compute/v2.1/servers/896b0f6d-8007-44c8-9bdc-db25f69a8d51 => generated 1366 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 15 21:06:23.919962 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-d17c2e7d-04ec-469f-ba2f-37d7714a19eb tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:23.929599 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-d17c2e7d-04ec-469f-ba2f-37d7714a19eb tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:23.931561 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-d17c2e7d-04ec-469f-ba2f-37d7714a19eb tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:23.932788 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d17c2e7d-04ec-469f-ba2f-37d7714a19eb tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42" status: 200 len: 1722 microversion: 2.20 time: 0.278370 Jan 15 21:06:23.933484 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2732/5469] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:06:23 2022] GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42 => generated 1722 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:06:24.072439 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-03595e59-2449-40bd-8472-f1df6376865c tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:06:24.073589 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-03595e59-2449-40bd-8472-f1df6376865c tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:24.081739 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-03595e59-2449-40bd-8472-f1df6376865c tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:24.081980 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-03595e59-2449-40bd-8472-f1df6376865c tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:24.082753 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-03595e59-2449-40bd-8472-f1df6376865c tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:24.083300 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-03595e59-2449-40bd-8472-f1df6376865c tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:24.128052 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-03595e59-2449-40bd-8472-f1df6376865c tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.059988 Jan 15 21:06:24.130279 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2738/5470] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:06:24 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:06:24.603956 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2922fcb2-f4de-4800-bb9b-d250d3655ec5 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:06:24.605153 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-2922fcb2-f4de-4800-bb9b-d250d3655ec5 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: d9db70df-9ffc-4b96-af06-a56b3b35ce91] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:24.615861 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2922fcb2-f4de-4800-bb9b-d250d3655ec5 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:24.616600 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2922fcb2-f4de-4800-bb9b-d250d3655ec5 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:24.618197 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2922fcb2-f4de-4800-bb9b-d250d3655ec5 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:24.618719 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2922fcb2-f4de-4800-bb9b-d250d3655ec5 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:24.676733 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2922fcb2-f4de-4800-bb9b-d250d3655ec5 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action" status: 200 len: 32646 microversion: 2.1 time: 0.076812 Jan 15 21:06:24.677679 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2733/5471] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:06:24 2022] POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action => generated 32646 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:06:24.837868 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-19919ce1-3c1d-4d91-a221-59461511508b tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:06:24.838572 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-19919ce1-3c1d-4d91-a221-59461511508b tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] [instance: 896b0f6d-8007-44c8-9bdc-db25f69a8d51] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:24.845928 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-19919ce1-3c1d-4d91-a221-59461511508b tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:24.846319 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-19919ce1-3c1d-4d91-a221-59461511508b tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:24.847110 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-19919ce1-3c1d-4d91-a221-59461511508b tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:24.847553 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-19919ce1-3c1d-4d91-a221-59461511508b tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:24.939674 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-19919ce1-3c1d-4d91-a221-59461511508b tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5556986824774afaa455010da540de2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b11e8e9465264349892209758f3c396d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:24.947976 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-19919ce1-3c1d-4d91-a221-59461511508b tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5556986824774afaa455010da540de2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b11e8e9465264349892209758f3c396d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:24.949507 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-19919ce1-3c1d-4d91-a221-59461511508b tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5556986824774afaa455010da540de2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b11e8e9465264349892209758f3c396d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:24.950675 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-19919ce1-3c1d-4d91-a221-59461511508b tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] 10.222.0.46 "GET /compute/v2.1/servers/896b0f6d-8007-44c8-9bdc-db25f69a8d51" status: 200 len: 1366 microversion: 2.57 time: 0.117204 Jan 15 21:06:24.951231 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2739/5472] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:06:24 2022] GET /compute/v2.1/servers/896b0f6d-8007-44c8-9bdc-db25f69a8d51 => generated 1366 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:06:24.962131 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f2a8f34c-8eec-495e-9db2-4259f7471ec4 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:06:24.962131 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f2a8f34c-8eec-495e-9db2-4259f7471ec4 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:24.962131 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f2a8f34c-8eec-495e-9db2-4259f7471ec4 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:24.962131 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f2a8f34c-8eec-495e-9db2-4259f7471ec4 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:24.962131 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f2a8f34c-8eec-495e-9db2-4259f7471ec4 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:24.962131 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f2a8f34c-8eec-495e-9db2-4259f7471ec4 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:25.115707 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-f2a8f34c-8eec-495e-9db2-4259f7471ec4 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:25.123549 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-f2a8f34c-8eec-495e-9db2-4259f7471ec4 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:25.125077 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-f2a8f34c-8eec-495e-9db2-4259f7471ec4 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:25.126234 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f2a8f34c-8eec-495e-9db2-4259f7471ec4 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42" status: 200 len: 1743 microversion: 2.20 time: 0.178793 Jan 15 21:06:25.126800 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2734/5473] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:06:24 2022] GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42 => generated 1743 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 15 21:06:25.142062 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0d53f661-0895-415e-946d-cb0081a93b72 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:06:25.143345 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-0d53f661-0895-415e-946d-cb0081a93b72 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:25.152475 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0d53f661-0895-415e-946d-cb0081a93b72 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:25.153530 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0d53f661-0895-415e-946d-cb0081a93b72 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:25.154583 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0d53f661-0895-415e-946d-cb0081a93b72 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:25.155353 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0d53f661-0895-415e-946d-cb0081a93b72 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:25.204132 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0d53f661-0895-415e-946d-cb0081a93b72 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.066006 Jan 15 21:06:25.204784 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2740/5474] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:06:25 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:06:25.688943 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-aa9ec506-6690-48a4-8552-31080e842680 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:06:25.689953 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-aa9ec506-6690-48a4-8552-31080e842680 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: d9db70df-9ffc-4b96-af06-a56b3b35ce91] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:25.699067 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-aa9ec506-6690-48a4-8552-31080e842680 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:25.699669 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-aa9ec506-6690-48a4-8552-31080e842680 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:25.700550 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-aa9ec506-6690-48a4-8552-31080e842680 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:25.701090 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-aa9ec506-6690-48a4-8552-31080e842680 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:25.744278 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-aa9ec506-6690-48a4-8552-31080e842680 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action" status: 200 len: 32646 microversion: 2.1 time: 0.058869 Jan 15 21:06:25.744964 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2735/5475] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:06:25 2022] POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action => generated 32646 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:06:25.969524 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f8f6652e-c41c-46b6-a4a0-7aca3cc68aa8 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:06:25.970303 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f8f6652e-c41c-46b6-a4a0-7aca3cc68aa8 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] [instance: 896b0f6d-8007-44c8-9bdc-db25f69a8d51] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:25.977983 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f8f6652e-c41c-46b6-a4a0-7aca3cc68aa8 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:25.978499 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f8f6652e-c41c-46b6-a4a0-7aca3cc68aa8 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:25.979345 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f8f6652e-c41c-46b6-a4a0-7aca3cc68aa8 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:25.979781 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f8f6652e-c41c-46b6-a4a0-7aca3cc68aa8 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:26.050143 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-f8f6652e-c41c-46b6-a4a0-7aca3cc68aa8 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5556986824774afaa455010da540de2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b11e8e9465264349892209758f3c396d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:26.059225 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-f8f6652e-c41c-46b6-a4a0-7aca3cc68aa8 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5556986824774afaa455010da540de2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b11e8e9465264349892209758f3c396d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:26.060713 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-f8f6652e-c41c-46b6-a4a0-7aca3cc68aa8 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5556986824774afaa455010da540de2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b11e8e9465264349892209758f3c396d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:26.061901 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f8f6652e-c41c-46b6-a4a0-7aca3cc68aa8 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] 10.222.0.46 "GET /compute/v2.1/servers/896b0f6d-8007-44c8-9bdc-db25f69a8d51" status: 200 len: 1366 microversion: 2.57 time: 0.096467 Jan 15 21:06:26.062465 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2741/5476] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:06:25 2022] GET /compute/v2.1/servers/896b0f6d-8007-44c8-9bdc-db25f69a8d51 => generated 1366 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:06:26.144718 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a5cef221-c010-464a-bcad-8ec734e5d169 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:06:26.145461 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a5cef221-c010-464a-bcad-8ec734e5d169 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:26.153027 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a5cef221-c010-464a-bcad-8ec734e5d169 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:26.153483 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a5cef221-c010-464a-bcad-8ec734e5d169 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:26.154275 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a5cef221-c010-464a-bcad-8ec734e5d169 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:26.154714 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a5cef221-c010-464a-bcad-8ec734e5d169 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:26.216677 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-de28d418-eb98-42ec-bb4e-e60027154327 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:06:26.218108 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-de28d418-eb98-42ec-bb4e-e60027154327 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:26.226592 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-de28d418-eb98-42ec-bb4e-e60027154327 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:26.227325 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-de28d418-eb98-42ec-bb4e-e60027154327 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:26.228854 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-de28d418-eb98-42ec-bb4e-e60027154327 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:26.229505 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-de28d418-eb98-42ec-bb4e-e60027154327 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:26.286456 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-de28d418-eb98-42ec-bb4e-e60027154327 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.073282 Jan 15 21:06:26.287241 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2742/5477] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:06:26 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:06:26.322980 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-a5cef221-c010-464a-bcad-8ec734e5d169 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:26.331168 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-a5cef221-c010-464a-bcad-8ec734e5d169 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:26.332826 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-a5cef221-c010-464a-bcad-8ec734e5d169 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:26.334076 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a5cef221-c010-464a-bcad-8ec734e5d169 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42" status: 200 len: 1743 microversion: 2.20 time: 0.193527 Jan 15 21:06:26.334744 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2736/5478] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:06:26 2022] GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42 => generated 1743 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:06:26.756475 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a65df018-372d-4bdf-b3c8-e97193a6a9f2 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:06:26.757693 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a65df018-372d-4bdf-b3c8-e97193a6a9f2 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: d9db70df-9ffc-4b96-af06-a56b3b35ce91] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:26.764600 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a65df018-372d-4bdf-b3c8-e97193a6a9f2 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:26.765151 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a65df018-372d-4bdf-b3c8-e97193a6a9f2 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:26.766026 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a65df018-372d-4bdf-b3c8-e97193a6a9f2 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:26.766484 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a65df018-372d-4bdf-b3c8-e97193a6a9f2 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:26.810180 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a65df018-372d-4bdf-b3c8-e97193a6a9f2 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action" status: 200 len: 32646 microversion: 2.1 time: 0.057589 Jan 15 21:06:26.814311 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2743/5479] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:06:26 2022] POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action => generated 32646 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:06:27.080780 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-63a0cbe5-564d-4895-8e8f-300057771e67 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:06:27.081538 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-63a0cbe5-564d-4895-8e8f-300057771e67 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] [instance: 896b0f6d-8007-44c8-9bdc-db25f69a8d51] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:27.089250 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-63a0cbe5-564d-4895-8e8f-300057771e67 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:27.089773 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-63a0cbe5-564d-4895-8e8f-300057771e67 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:27.090628 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-63a0cbe5-564d-4895-8e8f-300057771e67 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:27.091245 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-63a0cbe5-564d-4895-8e8f-300057771e67 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:27.162566 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-63a0cbe5-564d-4895-8e8f-300057771e67 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5556986824774afaa455010da540de2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b11e8e9465264349892209758f3c396d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:27.176992 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-63a0cbe5-564d-4895-8e8f-300057771e67 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5556986824774afaa455010da540de2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b11e8e9465264349892209758f3c396d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:27.184257 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-63a0cbe5-564d-4895-8e8f-300057771e67 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5556986824774afaa455010da540de2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b11e8e9465264349892209758f3c396d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:27.186025 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-63a0cbe5-564d-4895-8e8f-300057771e67 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] 10.222.0.46 "GET /compute/v2.1/servers/896b0f6d-8007-44c8-9bdc-db25f69a8d51" status: 200 len: 1366 microversion: 2.57 time: 0.108884 Jan 15 21:06:27.186779 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2737/5480] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:06:27 2022] GET /compute/v2.1/servers/896b0f6d-8007-44c8-9bdc-db25f69a8d51 => generated 1366 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 15 21:06:27.300717 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-fb0938e5-27b8-48ed-9e8f-4b47dec3678e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:06:27.301923 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-fb0938e5-27b8-48ed-9e8f-4b47dec3678e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:27.310265 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fb0938e5-27b8-48ed-9e8f-4b47dec3678e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:27.311093 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fb0938e5-27b8-48ed-9e8f-4b47dec3678e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:27.312272 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fb0938e5-27b8-48ed-9e8f-4b47dec3678e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:27.313043 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fb0938e5-27b8-48ed-9e8f-4b47dec3678e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:27.352965 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-4b535e81-2595-4bd8-a410-773c5c8c9f13 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:06:27.353877 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-4b535e81-2595-4bd8-a410-773c5c8c9f13 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:27.365610 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-fb0938e5-27b8-48ed-9e8f-4b47dec3678e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.069474 Jan 15 21:06:27.366161 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4b535e81-2595-4bd8-a410-773c5c8c9f13 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:27.367215 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2744/5481] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:06:27 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:06:27.367350 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4b535e81-2595-4bd8-a410-773c5c8c9f13 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:27.369759 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4b535e81-2595-4bd8-a410-773c5c8c9f13 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:27.371111 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4b535e81-2595-4bd8-a410-773c5c8c9f13 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:27.620953 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-4b535e81-2595-4bd8-a410-773c5c8c9f13 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:27.637255 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-4b535e81-2595-4bd8-a410-773c5c8c9f13 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:27.639029 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-4b535e81-2595-4bd8-a410-773c5c8c9f13 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:27.639945 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-4b535e81-2595-4bd8-a410-773c5c8c9f13 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42" status: 200 len: 1738 microversion: 2.20 time: 0.290954 Jan 15 21:06:27.640691 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2738/5482] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:06:27 2022] GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42 => generated 1738 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 15 21:06:27.823322 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-53cc2453-fd45-40df-9003-00993578ac3a tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:06:27.824697 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-53cc2453-fd45-40df-9003-00993578ac3a tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: d9db70df-9ffc-4b96-af06-a56b3b35ce91] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:27.831838 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-53cc2453-fd45-40df-9003-00993578ac3a tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:27.832348 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-53cc2453-fd45-40df-9003-00993578ac3a tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:27.833175 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-53cc2453-fd45-40df-9003-00993578ac3a tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:27.833800 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-53cc2453-fd45-40df-9003-00993578ac3a tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:27.890161 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-53cc2453-fd45-40df-9003-00993578ac3a tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action" status: 200 len: 32646 microversion: 2.1 time: 0.071642 Jan 15 21:06:27.892172 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2745/5483] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:06:27 2022] POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action => generated 32646 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 21:06:28.209684 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-abd46406-e364-4675-8b0e-5f99ed5da025 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:06:28.211372 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-abd46406-e364-4675-8b0e-5f99ed5da025 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] [instance: 896b0f6d-8007-44c8-9bdc-db25f69a8d51] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:28.229898 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-abd46406-e364-4675-8b0e-5f99ed5da025 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:28.230826 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-abd46406-e364-4675-8b0e-5f99ed5da025 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:28.232117 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-abd46406-e364-4675-8b0e-5f99ed5da025 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:28.232999 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-abd46406-e364-4675-8b0e-5f99ed5da025 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:28.371773 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-abd46406-e364-4675-8b0e-5f99ed5da025 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5556986824774afaa455010da540de2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b11e8e9465264349892209758f3c396d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:28.381175 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9d1880c9-d739-4c1a-8b8e-857f01eefc3c tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:06:28.382209 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-9d1880c9-d739-4c1a-8b8e-857f01eefc3c tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:28.389742 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-abd46406-e364-4675-8b0e-5f99ed5da025 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5556986824774afaa455010da540de2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b11e8e9465264349892209758f3c396d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:28.392150 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-abd46406-e364-4675-8b0e-5f99ed5da025 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5556986824774afaa455010da540de2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b11e8e9465264349892209758f3c396d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:28.393666 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-abd46406-e364-4675-8b0e-5f99ed5da025 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] 10.222.0.46 "GET /compute/v2.1/servers/896b0f6d-8007-44c8-9bdc-db25f69a8d51" status: 200 len: 1366 microversion: 2.57 time: 0.189786 Jan 15 21:06:28.394887 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2739/5484] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:06:28 2022] GET /compute/v2.1/servers/896b0f6d-8007-44c8-9bdc-db25f69a8d51 => generated 1366 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:06:28.398804 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9d1880c9-d739-4c1a-8b8e-857f01eefc3c tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:28.399478 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9d1880c9-d739-4c1a-8b8e-857f01eefc3c tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:28.400574 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9d1880c9-d739-4c1a-8b8e-857f01eefc3c tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:28.401398 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9d1880c9-d739-4c1a-8b8e-857f01eefc3c tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:28.475049 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-9d1880c9-d739-4c1a-8b8e-857f01eefc3c tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.098104 Jan 15 21:06:28.477552 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2746/5485] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:06:28 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:06:28.659239 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a9686ae0-72a9-4b00-b045-7bffa2eecd63 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:06:28.659783 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a9686ae0-72a9-4b00-b045-7bffa2eecd63 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:28.667272 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a9686ae0-72a9-4b00-b045-7bffa2eecd63 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:28.668375 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a9686ae0-72a9-4b00-b045-7bffa2eecd63 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:28.669580 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a9686ae0-72a9-4b00-b045-7bffa2eecd63 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:28.670111 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a9686ae0-72a9-4b00-b045-7bffa2eecd63 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:28.895224 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-a9686ae0-72a9-4b00-b045-7bffa2eecd63 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:28.904705 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-01d42eea-c954-40c3-a242-d405055bc0a9 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:06:28.905762 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-01d42eea-c954-40c3-a242-d405055bc0a9 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: d9db70df-9ffc-4b96-af06-a56b3b35ce91] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:28.907366 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-a9686ae0-72a9-4b00-b045-7bffa2eecd63 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:28.909230 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-a9686ae0-72a9-4b00-b045-7bffa2eecd63 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:28.910621 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a9686ae0-72a9-4b00-b045-7bffa2eecd63 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42" status: 200 len: 1738 microversion: 2.20 time: 0.255836 Jan 15 21:06:28.911672 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2740/5486] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:06:28 2022] GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42 => generated 1738 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:06:28.921308 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-01d42eea-c954-40c3-a242-d405055bc0a9 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:28.923112 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-01d42eea-c954-40c3-a242-d405055bc0a9 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:28.925395 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-01d42eea-c954-40c3-a242-d405055bc0a9 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:28.925836 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-01d42eea-c954-40c3-a242-d405055bc0a9 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:28.995286 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-01d42eea-c954-40c3-a242-d405055bc0a9 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action" status: 200 len: 32646 microversion: 2.1 time: 0.094907 Jan 15 21:06:28.997128 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2747/5487] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:06:28 2022] POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action => generated 32646 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:06:29.415060 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-acb388e6-d996-4358-9262-75336b16f04e tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:06:29.419968 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-acb388e6-d996-4358-9262-75336b16f04e tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] [instance: 896b0f6d-8007-44c8-9bdc-db25f69a8d51] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:29.428785 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-acb388e6-d996-4358-9262-75336b16f04e tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:29.430552 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-acb388e6-d996-4358-9262-75336b16f04e tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:29.432199 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-acb388e6-d996-4358-9262-75336b16f04e tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:29.432743 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-acb388e6-d996-4358-9262-75336b16f04e tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:29.489354 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-41ff13f6-a66e-4aa6-92cb-636667c07f99 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:06:29.490588 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-41ff13f6-a66e-4aa6-92cb-636667c07f99 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:29.513439 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-41ff13f6-a66e-4aa6-92cb-636667c07f99 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:29.515183 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-41ff13f6-a66e-4aa6-92cb-636667c07f99 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:29.516084 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-41ff13f6-a66e-4aa6-92cb-636667c07f99 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:29.516783 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-41ff13f6-a66e-4aa6-92cb-636667c07f99 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:29.552304 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-acb388e6-d996-4358-9262-75336b16f04e tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5556986824774afaa455010da540de2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b11e8e9465264349892209758f3c396d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:29.571153 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-acb388e6-d996-4358-9262-75336b16f04e tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5556986824774afaa455010da540de2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b11e8e9465264349892209758f3c396d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:29.573428 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-acb388e6-d996-4358-9262-75336b16f04e tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5556986824774afaa455010da540de2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b11e8e9465264349892209758f3c396d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:29.578425 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-acb388e6-d996-4358-9262-75336b16f04e tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] 10.222.0.46 "GET /compute/v2.1/servers/896b0f6d-8007-44c8-9bdc-db25f69a8d51" status: 200 len: 1366 microversion: 2.57 time: 0.169456 Jan 15 21:06:29.579444 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2741/5488] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:06:29 2022] GET /compute/v2.1/servers/896b0f6d-8007-44c8-9bdc-db25f69a8d51 => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:06:29.596049 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-41ff13f6-a66e-4aa6-92cb-636667c07f99 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.111374 Jan 15 21:06:29.603374 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2748/5489] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:06:29 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:06:29.859842 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-603c6aed-5ff6-4555-9b6c-793e1421af53 req-b4f82bd3-6189-441a-b35d-73e3c645bb93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1b412a8-0407-44fd-8f16-7cbcd8de3a42", "name": "network-vif-plugged", "status": "completed", "tag": "d027fed2-822f-40a2-a052-26b22c1aef53"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:06:29.861975 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:06:29.861975 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:06:29.871096 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-603c6aed-5ff6-4555-9b6c-793e1421af53 req-b4f82bd3-6189-441a-b35d-73e3c645bb93 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:29.871921 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-603c6aed-5ff6-4555-9b6c-793e1421af53 req-b4f82bd3-6189-441a-b35d-73e3c645bb93 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:29.884714 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-603c6aed-5ff6-4555-9b6c-793e1421af53 req-b4f82bd3-6189-441a-b35d-73e3c645bb93 service nova] Creating event network-vif-plugged:d027fed2-822f-40a2-a052-26b22c1aef53 for instance a1b412a8-0407-44fd-8f16-7cbcd8de3a42 on nch2-master-1 Jan 15 21:06:29.890397 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-603c6aed-5ff6-4555-9b6c-793e1421af53 req-b4f82bd3-6189-441a-b35d-73e3c645bb93 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035824 Jan 15 21:06:29.891929 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2742/5490] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:06:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 21:06:29.930389 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-57a559e2-e727-404d-836d-1e9173f0a809 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:06:29.931087 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-57a559e2-e727-404d-836d-1e9173f0a809 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:29.942501 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-57a559e2-e727-404d-836d-1e9173f0a809 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:29.942954 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-57a559e2-e727-404d-836d-1e9173f0a809 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:29.943743 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-57a559e2-e727-404d-836d-1e9173f0a809 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:29.949663 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-57a559e2-e727-404d-836d-1e9173f0a809 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:30.011144 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-013e6ac6-3b50-4b47-b0d4-73e7fd28ad86 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:06:30.012143 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-013e6ac6-3b50-4b47-b0d4-73e7fd28ad86 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: d9db70df-9ffc-4b96-af06-a56b3b35ce91] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:30.026164 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-013e6ac6-3b50-4b47-b0d4-73e7fd28ad86 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:30.027200 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-013e6ac6-3b50-4b47-b0d4-73e7fd28ad86 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:30.028165 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-013e6ac6-3b50-4b47-b0d4-73e7fd28ad86 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:30.028611 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-013e6ac6-3b50-4b47-b0d4-73e7fd28ad86 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:30.083424 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-013e6ac6-3b50-4b47-b0d4-73e7fd28ad86 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action" status: 200 len: 32646 microversion: 2.1 time: 0.076370 Jan 15 21:06:30.084211 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2743/5491] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:06:30 2022] POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action => generated 32646 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 21:06:30.203574 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-57a559e2-e727-404d-836d-1e9173f0a809 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:30.212727 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-57a559e2-e727-404d-836d-1e9173f0a809 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:30.214700 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-57a559e2-e727-404d-836d-1e9173f0a809 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:30.216296 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-57a559e2-e727-404d-836d-1e9173f0a809 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42" status: 200 len: 1738 microversion: 2.20 time: 0.290021 Jan 15 21:06:30.229712 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2749/5492] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:06:29 2022] GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42 => generated 1738 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:06:30.608073 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-63903271-bd13-48c4-8d8c-ebbadc792960 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:06:30.609654 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-63903271-bd13-48c4-8d8c-ebbadc792960 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] [instance: 896b0f6d-8007-44c8-9bdc-db25f69a8d51] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:30.618748 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-63903271-bd13-48c4-8d8c-ebbadc792960 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:30.619366 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-63903271-bd13-48c4-8d8c-ebbadc792960 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:30.620334 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-63903271-bd13-48c4-8d8c-ebbadc792960 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:30.620963 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-63903271-bd13-48c4-8d8c-ebbadc792960 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:30.713238 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-63903271-bd13-48c4-8d8c-ebbadc792960 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5556986824774afaa455010da540de2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b11e8e9465264349892209758f3c396d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:30.722755 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-63903271-bd13-48c4-8d8c-ebbadc792960 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5556986824774afaa455010da540de2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b11e8e9465264349892209758f3c396d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:30.724271 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-63903271-bd13-48c4-8d8c-ebbadc792960 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5556986824774afaa455010da540de2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b11e8e9465264349892209758f3c396d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:30.729772 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-63903271-bd13-48c4-8d8c-ebbadc792960 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] 10.222.0.46 "GET /compute/v2.1/servers/896b0f6d-8007-44c8-9bdc-db25f69a8d51" status: 200 len: 1366 microversion: 2.57 time: 0.135125 Jan 15 21:06:30.730134 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-128b70dc-1ccb-43f2-b8c0-99b47cd001a4 tempest-PortsAdminExtendedAttrsTestJSON-985201705 tempest-PortsAdminExtendedAttrsTestJSON-985201705-project-admin] Calling method '.version_select at 0x7f30c83f1160>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:06:30.731008 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2750/5493] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:06:30 2022] GET /compute/v2.1/servers/896b0f6d-8007-44c8-9bdc-db25f69a8d51 => generated 1366 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 15 21:06:30.738589 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-6747b632-ef77-44df-8a85-356bf0605a21 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:06:30.739576 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-6747b632-ef77-44df-8a85-356bf0605a21 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:30.741847 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:06:30.741847 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:06:30.744971 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-128b70dc-1ccb-43f2-b8c0-99b47cd001a4 tempest-PortsAdminExtendedAttrsTestJSON-985201705 tempest-PortsAdminExtendedAttrsTestJSON-985201705-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:30.746050 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-128b70dc-1ccb-43f2-b8c0-99b47cd001a4 tempest-PortsAdminExtendedAttrsTestJSON-985201705 tempest-PortsAdminExtendedAttrsTestJSON-985201705-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:30.749437 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6747b632-ef77-44df-8a85-356bf0605a21 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:30.749900 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6747b632-ef77-44df-8a85-356bf0605a21 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:30.751218 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6747b632-ef77-44df-8a85-356bf0605a21 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:30.751663 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6747b632-ef77-44df-8a85-356bf0605a21 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:30.761581 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-128b70dc-1ccb-43f2-b8c0-99b47cd001a4 tempest-PortsAdminExtendedAttrsTestJSON-985201705 tempest-PortsAdminExtendedAttrsTestJSON-985201705-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:30.762220 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-128b70dc-1ccb-43f2-b8c0-99b47cd001a4 tempest-PortsAdminExtendedAttrsTestJSON-985201705 tempest-PortsAdminExtendedAttrsTestJSON-985201705-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:30.775964 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-128b70dc-1ccb-43f2-b8c0-99b47cd001a4 tempest-PortsAdminExtendedAttrsTestJSON-985201705 tempest-PortsAdminExtendedAttrsTestJSON-985201705-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:30.776723 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-128b70dc-1ccb-43f2-b8c0-99b47cd001a4 tempest-PortsAdminExtendedAttrsTestJSON-985201705 tempest-PortsAdminExtendedAttrsTestJSON-985201705-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:30.789763 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-128b70dc-1ccb-43f2-b8c0-99b47cd001a4 tempest-PortsAdminExtendedAttrsTestJSON-985201705 tempest-PortsAdminExtendedAttrsTestJSON-985201705-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.295544 Jan 15 21:06:30.790361 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2744/5494] 10.222.0.46 () {58 vars in 1145 bytes} [Sat Jan 15 21:06:30 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:06:30.800907 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-6747b632-ef77-44df-8a85-356bf0605a21 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.068496 Jan 15 21:06:30.801666 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2751/5495] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:06:30 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:06:31.095595 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-03242199-838c-41cd-a4d1-1d882868db81 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:06:31.097206 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-03242199-838c-41cd-a4d1-1d882868db81 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: d9db70df-9ffc-4b96-af06-a56b3b35ce91] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:31.104666 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-03242199-838c-41cd-a4d1-1d882868db81 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:31.105431 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-03242199-838c-41cd-a4d1-1d882868db81 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:31.106473 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-03242199-838c-41cd-a4d1-1d882868db81 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:31.107275 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-03242199-838c-41cd-a4d1-1d882868db81 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:31.181192 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-03242199-838c-41cd-a4d1-1d882868db81 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action" status: 200 len: 32646 microversion: 2.1 time: 0.087137 Jan 15 21:06:31.182563 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2745/5496] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:06:31 2022] POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action => generated 32646 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:06:31.262820 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4fa44ccc-a6d6-4808-befb-ded4a4055a50 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:06:31.263920 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-4fa44ccc-a6d6-4808-befb-ded4a4055a50 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:31.283067 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4fa44ccc-a6d6-4808-befb-ded4a4055a50 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:31.284603 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4fa44ccc-a6d6-4808-befb-ded4a4055a50 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:31.285703 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4fa44ccc-a6d6-4808-befb-ded4a4055a50 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:31.286190 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4fa44ccc-a6d6-4808-befb-ded4a4055a50 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:31.556505 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-4fa44ccc-a6d6-4808-befb-ded4a4055a50 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:31.568863 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-4fa44ccc-a6d6-4808-befb-ded4a4055a50 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:31.571080 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-4fa44ccc-a6d6-4808-befb-ded4a4055a50 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:31.572533 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-4fa44ccc-a6d6-4808-befb-ded4a4055a50 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42" status: 200 len: 1738 microversion: 2.20 time: 0.325830 Jan 15 21:06:31.573240 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2752/5497] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:06:31 2022] GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42 => generated 1738 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:06:31.751139 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-803f9588-940b-46bd-97d1-47af7f9bdf67 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:06:31.752606 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-803f9588-940b-46bd-97d1-47af7f9bdf67 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] [instance: 896b0f6d-8007-44c8-9bdc-db25f69a8d51] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:31.765503 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-803f9588-940b-46bd-97d1-47af7f9bdf67 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:31.766131 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-803f9588-940b-46bd-97d1-47af7f9bdf67 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:31.767099 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-803f9588-940b-46bd-97d1-47af7f9bdf67 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:31.767679 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-803f9588-940b-46bd-97d1-47af7f9bdf67 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:31.814237 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-406bde60-2214-45d6-b0e8-5a38244e41c6 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:06:31.815275 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-406bde60-2214-45d6-b0e8-5a38244e41c6 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:31.824103 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-406bde60-2214-45d6-b0e8-5a38244e41c6 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:31.824567 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-406bde60-2214-45d6-b0e8-5a38244e41c6 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:31.833220 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-406bde60-2214-45d6-b0e8-5a38244e41c6 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:31.833770 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-406bde60-2214-45d6-b0e8-5a38244e41c6 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:31.881483 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-803f9588-940b-46bd-97d1-47af7f9bdf67 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5556986824774afaa455010da540de2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b11e8e9465264349892209758f3c396d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:31.882814 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-406bde60-2214-45d6-b0e8-5a38244e41c6 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.071130 Jan 15 21:06:31.883805 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2753/5498] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:06:31 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:06:31.896349 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-803f9588-940b-46bd-97d1-47af7f9bdf67 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5556986824774afaa455010da540de2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b11e8e9465264349892209758f3c396d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:31.899363 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-803f9588-940b-46bd-97d1-47af7f9bdf67 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5556986824774afaa455010da540de2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b11e8e9465264349892209758f3c396d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:31.901632 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-803f9588-940b-46bd-97d1-47af7f9bdf67 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] 10.222.0.46 "GET /compute/v2.1/servers/896b0f6d-8007-44c8-9bdc-db25f69a8d51" status: 200 len: 1366 microversion: 2.57 time: 0.156212 Jan 15 21:06:31.916407 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2746/5499] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:06:31 2022] GET /compute/v2.1/servers/896b0f6d-8007-44c8-9bdc-db25f69a8d51 => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 15 21:06:32.212937 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c2221b7b-63ee-40d1-bbf6-a9f1bd8cb1fe tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:06:32.216643 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c2221b7b-63ee-40d1-bbf6-a9f1bd8cb1fe tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: d9db70df-9ffc-4b96-af06-a56b3b35ce91] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:32.235649 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c2221b7b-63ee-40d1-bbf6-a9f1bd8cb1fe tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:32.236223 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c2221b7b-63ee-40d1-bbf6-a9f1bd8cb1fe tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:32.237134 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c2221b7b-63ee-40d1-bbf6-a9f1bd8cb1fe tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:32.237650 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c2221b7b-63ee-40d1-bbf6-a9f1bd8cb1fe tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:32.318792 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c2221b7b-63ee-40d1-bbf6-a9f1bd8cb1fe tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action" status: 200 len: 32646 microversion: 2.1 time: 0.111935 Jan 15 21:06:32.324053 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2754/5500] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:06:32 2022] POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action => generated 32646 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:06:32.598172 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-593ab0e9-4b9c-484e-8f92-2e40fe508db1 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:06:32.602077 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-593ab0e9-4b9c-484e-8f92-2e40fe508db1 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:32.618176 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-593ab0e9-4b9c-484e-8f92-2e40fe508db1 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:32.618988 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-593ab0e9-4b9c-484e-8f92-2e40fe508db1 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:32.620033 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-593ab0e9-4b9c-484e-8f92-2e40fe508db1 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:32.627095 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-593ab0e9-4b9c-484e-8f92-2e40fe508db1 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:32.896290 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ba2e7411-353f-4dfd-b564-312b1f6b0388 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:06:32.899584 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ba2e7411-353f-4dfd-b564-312b1f6b0388 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:32.909823 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ba2e7411-353f-4dfd-b564-312b1f6b0388 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:32.911034 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ba2e7411-353f-4dfd-b564-312b1f6b0388 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:32.912098 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ba2e7411-353f-4dfd-b564-312b1f6b0388 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:32.913084 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ba2e7411-353f-4dfd-b564-312b1f6b0388 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:32.973823 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ba2e7411-353f-4dfd-b564-312b1f6b0388 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.081903 Jan 15 21:06:32.979615 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2755/5501] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:06:32 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:06:32.987847 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8f31bbcf-cb09-4c42-be3e-39b3a782914e tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:06:32.989004 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-8f31bbcf-cb09-4c42-be3e-39b3a782914e tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] [instance: 896b0f6d-8007-44c8-9bdc-db25f69a8d51] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:32.996899 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8f31bbcf-cb09-4c42-be3e-39b3a782914e tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:32.997667 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8f31bbcf-cb09-4c42-be3e-39b3a782914e tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:32.998684 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8f31bbcf-cb09-4c42-be3e-39b3a782914e tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:32.999337 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8f31bbcf-cb09-4c42-be3e-39b3a782914e tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:33.116317 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-8f31bbcf-cb09-4c42-be3e-39b3a782914e tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5556986824774afaa455010da540de2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b11e8e9465264349892209758f3c396d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:33.118787 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-593ab0e9-4b9c-484e-8f92-2e40fe508db1 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:33.131202 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-593ab0e9-4b9c-484e-8f92-2e40fe508db1 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:33.132542 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-8f31bbcf-cb09-4c42-be3e-39b3a782914e tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5556986824774afaa455010da540de2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b11e8e9465264349892209758f3c396d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:33.134677 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-593ab0e9-4b9c-484e-8f92-2e40fe508db1 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:33.137147 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-593ab0e9-4b9c-484e-8f92-2e40fe508db1 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42" status: 200 len: 1738 microversion: 2.20 time: 0.548712 Jan 15 21:06:33.140308 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-8f31bbcf-cb09-4c42-be3e-39b3a782914e tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5556986824774afaa455010da540de2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b11e8e9465264349892209758f3c396d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:33.143269 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-8f31bbcf-cb09-4c42-be3e-39b3a782914e tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] 10.222.0.46 "GET /compute/v2.1/servers/896b0f6d-8007-44c8-9bdc-db25f69a8d51" status: 200 len: 1366 microversion: 2.57 time: 0.160902 Jan 15 21:06:33.145303 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2756/5502] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:06:32 2022] GET /compute/v2.1/servers/896b0f6d-8007-44c8-9bdc-db25f69a8d51 => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:06:33.150130 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2747/5503] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:06:32 2022] GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42 => generated 1738 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:06:33.337415 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e51c42bc-4ece-4ed8-8604-b1c047d39d5e tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:06:33.339170 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e51c42bc-4ece-4ed8-8604-b1c047d39d5e tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: d9db70df-9ffc-4b96-af06-a56b3b35ce91] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:33.351911 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e51c42bc-4ece-4ed8-8604-b1c047d39d5e tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:33.353896 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e51c42bc-4ece-4ed8-8604-b1c047d39d5e tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:33.357769 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e51c42bc-4ece-4ed8-8604-b1c047d39d5e tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:33.358765 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e51c42bc-4ece-4ed8-8604-b1c047d39d5e tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:33.456089 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e51c42bc-4ece-4ed8-8604-b1c047d39d5e tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action" status: 200 len: 32646 microversion: 2.1 time: 0.125687 Jan 15 21:06:33.461327 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2757/5504] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:06:33 2022] POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action => generated 32646 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:06:33.987853 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-fff03162-38db-4da5-8376-2fff0d370e4b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:06:33.988965 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-fff03162-38db-4da5-8376-2fff0d370e4b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:33.997377 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fff03162-38db-4da5-8376-2fff0d370e4b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:33.998133 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fff03162-38db-4da5-8376-2fff0d370e4b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:33.999150 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fff03162-38db-4da5-8376-2fff0d370e4b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:33.999784 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fff03162-38db-4da5-8376-2fff0d370e4b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:34.066470 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-fff03162-38db-4da5-8376-2fff0d370e4b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.080826 Jan 15 21:06:34.072492 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2748/5505] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:06:33 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:06:34.157579 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1a37b182-332e-453e-8632-17c4ca2ce980 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:06:34.158397 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-1a37b182-332e-453e-8632-17c4ca2ce980 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:34.166890 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e1cb7115-c058-43a8-ad48-b720df7d686c tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:06:34.169400 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e1cb7115-c058-43a8-ad48-b720df7d686c tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] [instance: 896b0f6d-8007-44c8-9bdc-db25f69a8d51] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:34.178192 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1a37b182-332e-453e-8632-17c4ca2ce980 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:34.178674 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1a37b182-332e-453e-8632-17c4ca2ce980 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:34.184779 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e1cb7115-c058-43a8-ad48-b720df7d686c tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:34.185889 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1a37b182-332e-453e-8632-17c4ca2ce980 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:34.186432 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1a37b182-332e-453e-8632-17c4ca2ce980 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:34.186827 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e1cb7115-c058-43a8-ad48-b720df7d686c tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:34.188141 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e1cb7115-c058-43a8-ad48-b720df7d686c tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:34.188879 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e1cb7115-c058-43a8-ad48-b720df7d686c tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:34.357741 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-e1cb7115-c058-43a8-ad48-b720df7d686c tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5556986824774afaa455010da540de2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b11e8e9465264349892209758f3c396d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:34.370247 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-e1cb7115-c058-43a8-ad48-b720df7d686c tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5556986824774afaa455010da540de2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b11e8e9465264349892209758f3c396d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:34.373364 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-e1cb7115-c058-43a8-ad48-b720df7d686c tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5556986824774afaa455010da540de2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b11e8e9465264349892209758f3c396d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:34.374813 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e1cb7115-c058-43a8-ad48-b720df7d686c tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] 10.222.0.46 "GET /compute/v2.1/servers/896b0f6d-8007-44c8-9bdc-db25f69a8d51" status: 200 len: 1366 microversion: 2.57 time: 0.215307 Jan 15 21:06:34.375987 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2749/5506] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:06:34 2022] GET /compute/v2.1/servers/896b0f6d-8007-44c8-9bdc-db25f69a8d51 => generated 1366 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:06:34.488544 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8ccaaedc-9890-4b95-8857-6d870be63aea tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:06:34.490143 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-8ccaaedc-9890-4b95-8857-6d870be63aea tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: d9db70df-9ffc-4b96-af06-a56b3b35ce91] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:34.503817 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8ccaaedc-9890-4b95-8857-6d870be63aea tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:34.508482 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8ccaaedc-9890-4b95-8857-6d870be63aea tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:34.509625 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8ccaaedc-9890-4b95-8857-6d870be63aea tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:34.510412 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8ccaaedc-9890-4b95-8857-6d870be63aea tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:34.539846 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-1a37b182-332e-453e-8632-17c4ca2ce980 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:34.560110 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-1a37b182-332e-453e-8632-17c4ca2ce980 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:34.562214 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-1a37b182-332e-453e-8632-17c4ca2ce980 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:34.563811 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-1a37b182-332e-453e-8632-17c4ca2ce980 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42" status: 200 len: 1738 microversion: 2.20 time: 0.411418 Jan 15 21:06:34.564981 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2758/5507] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:06:34 2022] GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42 => generated 1738 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:06:34.615078 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-8ccaaedc-9890-4b95-8857-6d870be63aea tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action" status: 200 len: 32646 microversion: 2.1 time: 0.129594 Jan 15 21:06:34.616062 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2750/5508] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:06:34 2022] POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action => generated 32646 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:06:35.079433 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a4f8407b-fc54-463b-9f77-40515b04617b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:06:35.081550 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a4f8407b-fc54-463b-9f77-40515b04617b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:35.097784 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a4f8407b-fc54-463b-9f77-40515b04617b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:35.102138 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a4f8407b-fc54-463b-9f77-40515b04617b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:35.103491 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a4f8407b-fc54-463b-9f77-40515b04617b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:35.106553 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a4f8407b-fc54-463b-9f77-40515b04617b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:35.205896 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a4f8407b-fc54-463b-9f77-40515b04617b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.130858 Jan 15 21:06:35.206619 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2759/5509] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:06:35 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:06:35.399817 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-83b54c2b-c77e-44d7-8ff4-17bbab56ce8b tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:06:35.401738 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-83b54c2b-c77e-44d7-8ff4-17bbab56ce8b tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] [instance: 896b0f6d-8007-44c8-9bdc-db25f69a8d51] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:35.409185 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-83b54c2b-c77e-44d7-8ff4-17bbab56ce8b tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:35.409880 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-83b54c2b-c77e-44d7-8ff4-17bbab56ce8b tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:35.411268 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-83b54c2b-c77e-44d7-8ff4-17bbab56ce8b tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:35.411877 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-83b54c2b-c77e-44d7-8ff4-17bbab56ce8b tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:35.542828 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-83b54c2b-c77e-44d7-8ff4-17bbab56ce8b tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5556986824774afaa455010da540de2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b11e8e9465264349892209758f3c396d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:35.558997 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-83b54c2b-c77e-44d7-8ff4-17bbab56ce8b tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5556986824774afaa455010da540de2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b11e8e9465264349892209758f3c396d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:35.567301 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-83b54c2b-c77e-44d7-8ff4-17bbab56ce8b tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5556986824774afaa455010da540de2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b11e8e9465264349892209758f3c396d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:35.569044 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-83b54c2b-c77e-44d7-8ff4-17bbab56ce8b tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] 10.222.0.46 "GET /compute/v2.1/servers/896b0f6d-8007-44c8-9bdc-db25f69a8d51" status: 200 len: 1366 microversion: 2.57 time: 0.175011 Jan 15 21:06:35.581517 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2751/5510] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:06:35 2022] GET /compute/v2.1/servers/896b0f6d-8007-44c8-9bdc-db25f69a8d51 => generated 1366 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:06:35.588500 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c93329a1-6d11-4ea6-958c-063c3c91be0e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:06:35.589460 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c93329a1-6d11-4ea6-958c-063c3c91be0e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:35.597163 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c93329a1-6d11-4ea6-958c-063c3c91be0e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:35.598247 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c93329a1-6d11-4ea6-958c-063c3c91be0e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:35.599267 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c93329a1-6d11-4ea6-958c-063c3c91be0e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:35.599879 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c93329a1-6d11-4ea6-958c-063c3c91be0e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:35.627616 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5559c1a1-52db-4d9b-bb2e-1f153c2c0dbd tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:06:35.628871 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-5559c1a1-52db-4d9b-bb2e-1f153c2c0dbd tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: d9db70df-9ffc-4b96-af06-a56b3b35ce91] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:35.647707 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5559c1a1-52db-4d9b-bb2e-1f153c2c0dbd tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:35.648763 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5559c1a1-52db-4d9b-bb2e-1f153c2c0dbd tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:35.649788 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5559c1a1-52db-4d9b-bb2e-1f153c2c0dbd tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:35.650394 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5559c1a1-52db-4d9b-bb2e-1f153c2c0dbd tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:35.730139 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5559c1a1-52db-4d9b-bb2e-1f153c2c0dbd tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action" status: 200 len: 32646 microversion: 2.1 time: 0.106440 Jan 15 21:06:35.731605 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2752/5511] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:06:35 2022] POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action => generated 32646 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 21:06:35.975465 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-c93329a1-6d11-4ea6-958c-063c3c91be0e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:35.995418 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-c93329a1-6d11-4ea6-958c-063c3c91be0e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:35.997236 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-c93329a1-6d11-4ea6-958c-063c3c91be0e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:35.999103 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c93329a1-6d11-4ea6-958c-063c3c91be0e tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42" status: 200 len: 1738 microversion: 2.20 time: 0.415731 Jan 15 21:06:35.999779 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2760/5512] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:06:35 2022] GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42 => generated 1738 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:06:36.219561 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-fb49882c-baff-4ae9-b895-908279b93903 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:06:36.221333 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-fb49882c-baff-4ae9-b895-908279b93903 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:36.234911 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fb49882c-baff-4ae9-b895-908279b93903 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:36.236762 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fb49882c-baff-4ae9-b895-908279b93903 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:36.238141 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fb49882c-baff-4ae9-b895-908279b93903 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:36.239501 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fb49882c-baff-4ae9-b895-908279b93903 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:36.304704 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-fb49882c-baff-4ae9-b895-908279b93903 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.088501 Jan 15 21:06:36.306490 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2753/5513] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:06:36 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:06:36.592263 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a0bd32f5-e031-42db-ad15-1229e0d08789 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:06:36.595744 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a0bd32f5-e031-42db-ad15-1229e0d08789 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] [instance: 896b0f6d-8007-44c8-9bdc-db25f69a8d51] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:36.608434 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a0bd32f5-e031-42db-ad15-1229e0d08789 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:36.625283 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a0bd32f5-e031-42db-ad15-1229e0d08789 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:36.628004 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a0bd32f5-e031-42db-ad15-1229e0d08789 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:36.629591 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a0bd32f5-e031-42db-ad15-1229e0d08789 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:36.744560 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2be6a73e-f5c8-4a8a-8571-e5acc8f2fa22 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:06:36.745604 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-2be6a73e-f5c8-4a8a-8571-e5acc8f2fa22 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: d9db70df-9ffc-4b96-af06-a56b3b35ce91] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:36.755727 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-a0bd32f5-e031-42db-ad15-1229e0d08789 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5556986824774afaa455010da540de2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b11e8e9465264349892209758f3c396d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:36.766668 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-a0bd32f5-e031-42db-ad15-1229e0d08789 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5556986824774afaa455010da540de2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b11e8e9465264349892209758f3c396d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:36.767779 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2be6a73e-f5c8-4a8a-8571-e5acc8f2fa22 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:36.768465 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2be6a73e-f5c8-4a8a-8571-e5acc8f2fa22 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:36.770139 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2be6a73e-f5c8-4a8a-8571-e5acc8f2fa22 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:36.770741 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2be6a73e-f5c8-4a8a-8571-e5acc8f2fa22 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:36.774178 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-a0bd32f5-e031-42db-ad15-1229e0d08789 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5556986824774afaa455010da540de2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b11e8e9465264349892209758f3c396d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:36.778315 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a0bd32f5-e031-42db-ad15-1229e0d08789 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] 10.222.0.46 "GET /compute/v2.1/servers/896b0f6d-8007-44c8-9bdc-db25f69a8d51" status: 200 len: 1366 microversion: 2.57 time: 0.190907 Jan 15 21:06:36.779289 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2761/5514] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:06:36 2022] GET /compute/v2.1/servers/896b0f6d-8007-44c8-9bdc-db25f69a8d51 => generated 1366 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:06:36.844189 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2be6a73e-f5c8-4a8a-8571-e5acc8f2fa22 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action" status: 200 len: 32646 microversion: 2.1 time: 0.103642 Jan 15 21:06:36.847714 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2754/5515] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:06:36 2022] POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action => generated 32646 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:06:37.018917 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e58cfa58-e9e1-4d6f-bd8b-e3c43165f338 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:06:37.020069 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e58cfa58-e9e1-4d6f-bd8b-e3c43165f338 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:37.028981 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e58cfa58-e9e1-4d6f-bd8b-e3c43165f338 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:37.029854 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e58cfa58-e9e1-4d6f-bd8b-e3c43165f338 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:37.030875 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e58cfa58-e9e1-4d6f-bd8b-e3c43165f338 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:37.031495 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e58cfa58-e9e1-4d6f-bd8b-e3c43165f338 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:37.231980 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-e58cfa58-e9e1-4d6f-bd8b-e3c43165f338 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:37.240476 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-e58cfa58-e9e1-4d6f-bd8b-e3c43165f338 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:37.243166 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-e58cfa58-e9e1-4d6f-bd8b-e3c43165f338 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:37.244598 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e58cfa58-e9e1-4d6f-bd8b-e3c43165f338 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42" status: 200 len: 1738 microversion: 2.20 time: 0.230017 Jan 15 21:06:37.268375 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2762/5516] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:06:37 2022] GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42 => generated 1738 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:06:37.321484 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f21ac9ae-1c79-46a0-b426-79d217ce1a56 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:06:37.322818 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f21ac9ae-1c79-46a0-b426-79d217ce1a56 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:37.332563 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f21ac9ae-1c79-46a0-b426-79d217ce1a56 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:37.333067 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f21ac9ae-1c79-46a0-b426-79d217ce1a56 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:37.334469 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f21ac9ae-1c79-46a0-b426-79d217ce1a56 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:37.334936 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f21ac9ae-1c79-46a0-b426-79d217ce1a56 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:37.410476 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f21ac9ae-1c79-46a0-b426-79d217ce1a56 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.096622 Jan 15 21:06:37.420025 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2755/5517] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:06:37 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:06:37.823598 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ca9417e8-1dce-4551-9ec8-61dc2b199543 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:06:37.824937 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ca9417e8-1dce-4551-9ec8-61dc2b199543 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] [instance: 896b0f6d-8007-44c8-9bdc-db25f69a8d51] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:37.832793 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ca9417e8-1dce-4551-9ec8-61dc2b199543 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:37.833652 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ca9417e8-1dce-4551-9ec8-61dc2b199543 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:37.834698 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ca9417e8-1dce-4551-9ec8-61dc2b199543 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:37.835909 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ca9417e8-1dce-4551-9ec8-61dc2b199543 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:37.860219 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-90599935-8fee-459e-ba7f-40516970563f tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:06:37.861694 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-90599935-8fee-459e-ba7f-40516970563f tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: d9db70df-9ffc-4b96-af06-a56b3b35ce91] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:37.875652 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-90599935-8fee-459e-ba7f-40516970563f tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:37.879123 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-90599935-8fee-459e-ba7f-40516970563f tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:37.880140 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-90599935-8fee-459e-ba7f-40516970563f tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:37.882481 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-90599935-8fee-459e-ba7f-40516970563f tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:37.920354 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-ca9417e8-1dce-4551-9ec8-61dc2b199543 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5556986824774afaa455010da540de2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b11e8e9465264349892209758f3c396d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:37.929140 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-ca9417e8-1dce-4551-9ec8-61dc2b199543 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5556986824774afaa455010da540de2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b11e8e9465264349892209758f3c396d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:37.931041 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-ca9417e8-1dce-4551-9ec8-61dc2b199543 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5556986824774afaa455010da540de2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b11e8e9465264349892209758f3c396d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:37.932588 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ca9417e8-1dce-4551-9ec8-61dc2b199543 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] 10.222.0.46 "GET /compute/v2.1/servers/896b0f6d-8007-44c8-9bdc-db25f69a8d51" status: 200 len: 1366 microversion: 2.57 time: 0.125587 Jan 15 21:06:37.933407 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2763/5518] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:06:37 2022] GET /compute/v2.1/servers/896b0f6d-8007-44c8-9bdc-db25f69a8d51 => generated 1366 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:06:37.936285 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-90599935-8fee-459e-ba7f-40516970563f tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action" status: 200 len: 32646 microversion: 2.1 time: 0.080260 Jan 15 21:06:37.936978 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2756/5519] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:06:37 2022] POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action => generated 32646 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:06:38.265250 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-22f1aea3-8c45-43a9-aa47-eb5ebb7cbc19 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:06:38.266534 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-22f1aea3-8c45-43a9-aa47-eb5ebb7cbc19 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:38.273827 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-22f1aea3-8c45-43a9-aa47-eb5ebb7cbc19 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:38.274606 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-22f1aea3-8c45-43a9-aa47-eb5ebb7cbc19 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:38.275582 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-22f1aea3-8c45-43a9-aa47-eb5ebb7cbc19 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:38.276291 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-22f1aea3-8c45-43a9-aa47-eb5ebb7cbc19 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:38.435907 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2ae743a7-22c1-4af8-bfd7-b20f7ec192b5 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:06:38.437044 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-2ae743a7-22c1-4af8-bfd7-b20f7ec192b5 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:38.444492 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2ae743a7-22c1-4af8-bfd7-b20f7ec192b5 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:38.445098 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2ae743a7-22c1-4af8-bfd7-b20f7ec192b5 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:38.446000 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2ae743a7-22c1-4af8-bfd7-b20f7ec192b5 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:38.446553 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2ae743a7-22c1-4af8-bfd7-b20f7ec192b5 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:38.528215 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-22f1aea3-8c45-43a9-aa47-eb5ebb7cbc19 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:38.539528 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2ae743a7-22c1-4af8-bfd7-b20f7ec192b5 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.106392 Jan 15 21:06:38.540976 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2757/5520] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:06:38 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:06:38.556501 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-22f1aea3-8c45-43a9-aa47-eb5ebb7cbc19 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:38.563345 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-22f1aea3-8c45-43a9-aa47-eb5ebb7cbc19 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:38.565398 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-22f1aea3-8c45-43a9-aa47-eb5ebb7cbc19 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42" status: 200 len: 1738 microversion: 2.20 time: 0.306258 Jan 15 21:06:38.583735 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2764/5521] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:06:38 2022] GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42 => generated 1738 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:06:38.950777 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-1196059e-66f1-4be5-ae74-ab693cc30ba5 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:06:38.951834 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-1196059e-66f1-4be5-ae74-ab693cc30ba5 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: d9db70df-9ffc-4b96-af06-a56b3b35ce91] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:38.952357 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a5fd8d80-f190-44d8-9089-fbab2d4e266c tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:06:38.953594 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a5fd8d80-f190-44d8-9089-fbab2d4e266c tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] [instance: 896b0f6d-8007-44c8-9bdc-db25f69a8d51] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:38.962321 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a5fd8d80-f190-44d8-9089-fbab2d4e266c tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:38.962672 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a5fd8d80-f190-44d8-9089-fbab2d4e266c tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:38.964596 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1196059e-66f1-4be5-ae74-ab693cc30ba5 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:38.964596 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1196059e-66f1-4be5-ae74-ab693cc30ba5 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:38.965402 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1196059e-66f1-4be5-ae74-ab693cc30ba5 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:38.965945 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1196059e-66f1-4be5-ae74-ab693cc30ba5 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:38.976640 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a5fd8d80-f190-44d8-9089-fbab2d4e266c tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:38.977337 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a5fd8d80-f190-44d8-9089-fbab2d4e266c tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:39.070917 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-1196059e-66f1-4be5-ae74-ab693cc30ba5 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action" status: 200 len: 32646 microversion: 2.1 time: 0.123784 Jan 15 21:06:39.073821 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2758/5522] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:06:38 2022] POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action => generated 32646 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:06:39.135310 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-a5fd8d80-f190-44d8-9089-fbab2d4e266c tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5556986824774afaa455010da540de2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b11e8e9465264349892209758f3c396d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:39.151079 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-a5fd8d80-f190-44d8-9089-fbab2d4e266c tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5556986824774afaa455010da540de2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b11e8e9465264349892209758f3c396d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:39.153317 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-a5fd8d80-f190-44d8-9089-fbab2d4e266c tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5556986824774afaa455010da540de2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b11e8e9465264349892209758f3c396d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:39.155333 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a5fd8d80-f190-44d8-9089-fbab2d4e266c tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] 10.222.0.46 "GET /compute/v2.1/servers/896b0f6d-8007-44c8-9bdc-db25f69a8d51" status: 200 len: 1366 microversion: 2.57 time: 0.207288 Jan 15 21:06:39.156559 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2765/5523] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:06:38 2022] GET /compute/v2.1/servers/896b0f6d-8007-44c8-9bdc-db25f69a8d51 => generated 1366 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:06:39.559302 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-599cbdab-5aa9-4ebb-af54-fc4f29a5594c tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:06:39.561744 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-599cbdab-5aa9-4ebb-af54-fc4f29a5594c tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:39.576887 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-599cbdab-5aa9-4ebb-af54-fc4f29a5594c tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:39.580370 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-599cbdab-5aa9-4ebb-af54-fc4f29a5594c tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:39.583012 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-599cbdab-5aa9-4ebb-af54-fc4f29a5594c tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:39.591676 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-534bdbf4-6946-426c-a20b-50a2cc8b6d4a tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:06:39.593570 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-534bdbf4-6946-426c-a20b-50a2cc8b6d4a tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:39.602628 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-599cbdab-5aa9-4ebb-af54-fc4f29a5594c tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:39.609630 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-534bdbf4-6946-426c-a20b-50a2cc8b6d4a tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:39.611313 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-534bdbf4-6946-426c-a20b-50a2cc8b6d4a tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:39.615553 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-534bdbf4-6946-426c-a20b-50a2cc8b6d4a tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:39.619605 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-534bdbf4-6946-426c-a20b-50a2cc8b6d4a tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:39.701990 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-599cbdab-5aa9-4ebb-af54-fc4f29a5594c tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.153725 Jan 15 21:06:39.703068 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2759/5524] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:06:39 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:06:39.959147 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-534bdbf4-6946-426c-a20b-50a2cc8b6d4a tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:39.992744 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-534bdbf4-6946-426c-a20b-50a2cc8b6d4a tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:39.992744 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-534bdbf4-6946-426c-a20b-50a2cc8b6d4a tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:39.993964 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-534bdbf4-6946-426c-a20b-50a2cc8b6d4a tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42" status: 200 len: 1738 microversion: 2.20 time: 0.406168 Jan 15 21:06:39.994967 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2766/5525] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:06:39 2022] GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42 => generated 1738 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 15 21:06:40.086906 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-4bf73c76-3106-45ec-b98a-c44a86f38972 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:06:40.089480 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-4bf73c76-3106-45ec-b98a-c44a86f38972 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: d9db70df-9ffc-4b96-af06-a56b3b35ce91] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:40.107453 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4bf73c76-3106-45ec-b98a-c44a86f38972 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:40.108596 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4bf73c76-3106-45ec-b98a-c44a86f38972 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:40.121099 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4bf73c76-3106-45ec-b98a-c44a86f38972 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:40.121797 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4bf73c76-3106-45ec-b98a-c44a86f38972 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:40.175219 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4d0c1214-26b5-433a-ae8d-98a0b82a2434 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:06:40.175778 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-4d0c1214-26b5-433a-ae8d-98a0b82a2434 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] [instance: 896b0f6d-8007-44c8-9bdc-db25f69a8d51] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:40.196704 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4d0c1214-26b5-433a-ae8d-98a0b82a2434 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:40.197199 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4d0c1214-26b5-433a-ae8d-98a0b82a2434 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:40.198017 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4d0c1214-26b5-433a-ae8d-98a0b82a2434 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:40.198460 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4d0c1214-26b5-433a-ae8d-98a0b82a2434 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:40.208861 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-4bf73c76-3106-45ec-b98a-c44a86f38972 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action" status: 200 len: 32646 microversion: 2.1 time: 0.128639 Jan 15 21:06:40.212216 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2760/5526] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:06:40 2022] POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action => generated 32646 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:06:40.356647 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-4d0c1214-26b5-433a-ae8d-98a0b82a2434 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5556986824774afaa455010da540de2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b11e8e9465264349892209758f3c396d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:40.367420 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-4d0c1214-26b5-433a-ae8d-98a0b82a2434 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5556986824774afaa455010da540de2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b11e8e9465264349892209758f3c396d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:40.369404 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-4d0c1214-26b5-433a-ae8d-98a0b82a2434 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5556986824774afaa455010da540de2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b11e8e9465264349892209758f3c396d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:40.370627 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-4d0c1214-26b5-433a-ae8d-98a0b82a2434 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] 10.222.0.46 "GET /compute/v2.1/servers/896b0f6d-8007-44c8-9bdc-db25f69a8d51" status: 200 len: 1366 microversion: 2.57 time: 0.199955 Jan 15 21:06:40.371233 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2767/5527] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:06:40 2022] GET /compute/v2.1/servers/896b0f6d-8007-44c8-9bdc-db25f69a8d51 => generated 1366 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:06:40.717600 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-79dc5cbd-e940-40a1-b141-9c873a6e46db tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:06:40.718894 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-79dc5cbd-e940-40a1-b141-9c873a6e46db tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:40.727898 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-79dc5cbd-e940-40a1-b141-9c873a6e46db tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:40.728512 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-79dc5cbd-e940-40a1-b141-9c873a6e46db tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:40.729617 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-79dc5cbd-e940-40a1-b141-9c873a6e46db tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:40.730443 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-79dc5cbd-e940-40a1-b141-9c873a6e46db tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:40.782320 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-79dc5cbd-e940-40a1-b141-9c873a6e46db tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.070098 Jan 15 21:06:40.785759 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2761/5528] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:06:40 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:06:41.014641 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a86f36b8-86a1-4694-8b32-52f16fe93799 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:06:41.016983 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a86f36b8-86a1-4694-8b32-52f16fe93799 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:41.026215 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a86f36b8-86a1-4694-8b32-52f16fe93799 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:41.026655 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a86f36b8-86a1-4694-8b32-52f16fe93799 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:41.027809 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a86f36b8-86a1-4694-8b32-52f16fe93799 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:41.029193 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a86f36b8-86a1-4694-8b32-52f16fe93799 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:41.222780 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ad3a1ee8-de50-4c98-88a9-56bd0c4ef598 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:06:41.224405 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ad3a1ee8-de50-4c98-88a9-56bd0c4ef598 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: d9db70df-9ffc-4b96-af06-a56b3b35ce91] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:41.228427 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-a86f36b8-86a1-4694-8b32-52f16fe93799 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:41.234027 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ad3a1ee8-de50-4c98-88a9-56bd0c4ef598 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:41.234480 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ad3a1ee8-de50-4c98-88a9-56bd0c4ef598 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:41.235264 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ad3a1ee8-de50-4c98-88a9-56bd0c4ef598 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:41.235887 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ad3a1ee8-de50-4c98-88a9-56bd0c4ef598 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:41.239554 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-a86f36b8-86a1-4694-8b32-52f16fe93799 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:41.242269 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-a86f36b8-86a1-4694-8b32-52f16fe93799 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:41.243611 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a86f36b8-86a1-4694-8b32-52f16fe93799 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42" status: 200 len: 1720 microversion: 2.20 time: 0.233198 Jan 15 21:06:41.245076 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2768/5529] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:06:41 2022] GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42 => generated 1720 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:06:41.339006 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ad3a1ee8-de50-4c98-88a9-56bd0c4ef598 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action" status: 200 len: 32646 microversion: 2.1 time: 0.108040 Jan 15 21:06:41.342152 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2762/5530] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:06:41 2022] POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action => generated 32646 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 21:06:41.395812 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-df95b157-1fd3-4d10-9863-3af1c6c295de tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:06:41.396418 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-df95b157-1fd3-4d10-9863-3af1c6c295de tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] [instance: 896b0f6d-8007-44c8-9bdc-db25f69a8d51] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:41.410083 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-df95b157-1fd3-4d10-9863-3af1c6c295de tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:41.410537 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-df95b157-1fd3-4d10-9863-3af1c6c295de tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:41.411424 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-df95b157-1fd3-4d10-9863-3af1c6c295de tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:41.411865 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-df95b157-1fd3-4d10-9863-3af1c6c295de tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:41.498037 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-df95b157-1fd3-4d10-9863-3af1c6c295de tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5556986824774afaa455010da540de2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b11e8e9465264349892209758f3c396d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:41.520951 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-df95b157-1fd3-4d10-9863-3af1c6c295de tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5556986824774afaa455010da540de2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b11e8e9465264349892209758f3c396d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:41.522587 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-df95b157-1fd3-4d10-9863-3af1c6c295de tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5556986824774afaa455010da540de2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b11e8e9465264349892209758f3c396d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:41.523803 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-df95b157-1fd3-4d10-9863-3af1c6c295de tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] 10.222.0.46 "GET /compute/v2.1/servers/896b0f6d-8007-44c8-9bdc-db25f69a8d51" status: 200 len: 1372 microversion: 2.57 time: 0.131989 Jan 15 21:06:41.536465 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2769/5531] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:06:41 2022] GET /compute/v2.1/servers/896b0f6d-8007-44c8-9bdc-db25f69a8d51 => generated 1372 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:06:41.801676 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9c58ed75-5d71-45e8-b54d-e1a39909142f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:06:41.802939 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-9c58ed75-5d71-45e8-b54d-e1a39909142f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:41.817101 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9c58ed75-5d71-45e8-b54d-e1a39909142f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:41.817869 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9c58ed75-5d71-45e8-b54d-e1a39909142f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:41.819199 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9c58ed75-5d71-45e8-b54d-e1a39909142f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:41.821956 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9c58ed75-5d71-45e8-b54d-e1a39909142f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:41.894427 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-9c58ed75-5d71-45e8-b54d-e1a39909142f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.098644 Jan 15 21:06:41.895633 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2763/5532] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:06:41 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:06:42.263986 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a52ad571-6c34-4b39-8df0-f82900a1caac tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:06:42.265431 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a52ad571-6c34-4b39-8df0-f82900a1caac tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:42.280569 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a52ad571-6c34-4b39-8df0-f82900a1caac tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:42.281335 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a52ad571-6c34-4b39-8df0-f82900a1caac tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:42.283762 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a52ad571-6c34-4b39-8df0-f82900a1caac tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:42.284210 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a52ad571-6c34-4b39-8df0-f82900a1caac tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:42.352979 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3a42e785-3677-4932-94fd-98d3e7d91c1c tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:06:42.354640 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-3a42e785-3677-4932-94fd-98d3e7d91c1c tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: d9db70df-9ffc-4b96-af06-a56b3b35ce91] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:42.363184 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3a42e785-3677-4932-94fd-98d3e7d91c1c tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:42.363918 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3a42e785-3677-4932-94fd-98d3e7d91c1c tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:42.365001 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3a42e785-3677-4932-94fd-98d3e7d91c1c tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:42.365613 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3a42e785-3677-4932-94fd-98d3e7d91c1c tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:42.432427 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3a42e785-3677-4932-94fd-98d3e7d91c1c tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action" status: 200 len: 32646 microversion: 2.1 time: 0.080080 Jan 15 21:06:42.433721 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2764/5533] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:06:42 2022] POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action => generated 32646 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 21:06:42.524159 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-a52ad571-6c34-4b39-8df0-f82900a1caac tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:42.535978 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-a52ad571-6c34-4b39-8df0-f82900a1caac tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:42.541182 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-a52ad571-6c34-4b39-8df0-f82900a1caac tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:42.543897 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a52ad571-6c34-4b39-8df0-f82900a1caac tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42" status: 200 len: 1720 microversion: 2.20 time: 0.283792 Jan 15 21:06:42.545628 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2770/5534] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:06:42 2022] GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42 => generated 1720 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:06:42.546218 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-99bf189a-e62e-46ff-9b5f-2fdacf5c86b8 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:06:42.547015 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-99bf189a-e62e-46ff-9b5f-2fdacf5c86b8 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] [instance: 896b0f6d-8007-44c8-9bdc-db25f69a8d51] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:42.563905 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-99bf189a-e62e-46ff-9b5f-2fdacf5c86b8 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:42.564363 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-99bf189a-e62e-46ff-9b5f-2fdacf5c86b8 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:42.565846 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-99bf189a-e62e-46ff-9b5f-2fdacf5c86b8 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:42.566291 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-99bf189a-e62e-46ff-9b5f-2fdacf5c86b8 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:42.655340 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-99bf189a-e62e-46ff-9b5f-2fdacf5c86b8 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5556986824774afaa455010da540de2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b11e8e9465264349892209758f3c396d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:42.675486 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-99bf189a-e62e-46ff-9b5f-2fdacf5c86b8 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5556986824774afaa455010da540de2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b11e8e9465264349892209758f3c396d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:42.683301 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-99bf189a-e62e-46ff-9b5f-2fdacf5c86b8 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5556986824774afaa455010da540de2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b11e8e9465264349892209758f3c396d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:42.684778 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-99bf189a-e62e-46ff-9b5f-2fdacf5c86b8 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] 10.222.0.46 "GET /compute/v2.1/servers/896b0f6d-8007-44c8-9bdc-db25f69a8d51" status: 200 len: 1357 microversion: 2.57 time: 0.143841 Jan 15 21:06:42.688604 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2765/5535] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:06:42 2022] GET /compute/v2.1/servers/896b0f6d-8007-44c8-9bdc-db25f69a8d51 => generated 1357 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:06:42.712490 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-aa152f39-91df-4451-abdd-185c8e2b7707 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:06:42.713324 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-aa152f39-91df-4451-abdd-185c8e2b7707 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] [instance: 896b0f6d-8007-44c8-9bdc-db25f69a8d51] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:42.721502 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-aa152f39-91df-4451-abdd-185c8e2b7707 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:42.722131 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-aa152f39-91df-4451-abdd-185c8e2b7707 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:42.723319 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-aa152f39-91df-4451-abdd-185c8e2b7707 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:42.724235 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-aa152f39-91df-4451-abdd-185c8e2b7707 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:42.752920 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-aa152f39-91df-4451-abdd-185c8e2b7707 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] [instance: 896b0f6d-8007-44c8-9bdc-db25f69a8d51] Going to try to terminate instance {{(pid=129366) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 21:06:42.876291 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-aa152f39-91df-4451-abdd-185c8e2b7707 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] 10.222.0.46 "DELETE /compute/v2.1/servers/896b0f6d-8007-44c8-9bdc-db25f69a8d51" status: 204 len: 0 microversion: 2.57 time: 0.167265 Jan 15 21:06:42.877966 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2771/5536] 10.222.0.46 () {60 vars in 1279 bytes} [Sat Jan 15 21:06:42 2022] DELETE /compute/v2.1/servers/896b0f6d-8007-44c8-9bdc-db25f69a8d51 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 15 21:06:42.891209 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-82a5b992-d878-43f7-970b-c2ea9fd9734c tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:06:42.892327 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-82a5b992-d878-43f7-970b-c2ea9fd9734c tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] [instance: 896b0f6d-8007-44c8-9bdc-db25f69a8d51] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:42.909488 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-bdad7ea7-2bd3-4ce1-b646-cfe710d42e80 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:06:42.910148 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-82a5b992-d878-43f7-970b-c2ea9fd9734c tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:42.910508 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-bdad7ea7-2bd3-4ce1-b646-cfe710d42e80 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:42.912073 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-82a5b992-d878-43f7-970b-c2ea9fd9734c tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:42.913464 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-82a5b992-d878-43f7-970b-c2ea9fd9734c tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:42.914142 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-82a5b992-d878-43f7-970b-c2ea9fd9734c tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:42.921306 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bdad7ea7-2bd3-4ce1-b646-cfe710d42e80 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:42.923631 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bdad7ea7-2bd3-4ce1-b646-cfe710d42e80 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:42.927214 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bdad7ea7-2bd3-4ce1-b646-cfe710d42e80 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:42.928020 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bdad7ea7-2bd3-4ce1-b646-cfe710d42e80 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:42.997436 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-bdad7ea7-2bd3-4ce1-b646-cfe710d42e80 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.093206 Jan 15 21:06:42.998692 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2772/5537] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:06:42 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:06:43.023199 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-82a5b992-d878-43f7-970b-c2ea9fd9734c tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5556986824774afaa455010da540de2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b11e8e9465264349892209758f3c396d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:43.039724 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-82a5b992-d878-43f7-970b-c2ea9fd9734c tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5556986824774afaa455010da540de2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b11e8e9465264349892209758f3c396d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:43.043488 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-82a5b992-d878-43f7-970b-c2ea9fd9734c tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5556986824774afaa455010da540de2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b11e8e9465264349892209758f3c396d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:43.046258 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-82a5b992-d878-43f7-970b-c2ea9fd9734c tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] 10.222.0.46 "GET /compute/v2.1/servers/896b0f6d-8007-44c8-9bdc-db25f69a8d51" status: 200 len: 1363 microversion: 2.57 time: 0.163720 Jan 15 21:06:43.047790 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2766/5538] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:06:42 2022] GET /compute/v2.1/servers/896b0f6d-8007-44c8-9bdc-db25f69a8d51 => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:06:43.446403 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-082e9bda-4995-4fd2-b045-86e5c62d20c6 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:06:43.447440 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-082e9bda-4995-4fd2-b045-86e5c62d20c6 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: d9db70df-9ffc-4b96-af06-a56b3b35ce91] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:43.456078 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-082e9bda-4995-4fd2-b045-86e5c62d20c6 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:43.456582 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-082e9bda-4995-4fd2-b045-86e5c62d20c6 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:43.457422 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-082e9bda-4995-4fd2-b045-86e5c62d20c6 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:43.457921 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-082e9bda-4995-4fd2-b045-86e5c62d20c6 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:43.519281 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-082e9bda-4995-4fd2-b045-86e5c62d20c6 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action" status: 200 len: 32646 microversion: 2.1 time: 0.077743 Jan 15 21:06:43.520880 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2773/5539] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:06:43 2022] POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action => generated 32646 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:06:43.563354 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-aeb5ea86-1a21-4066-9ddd-cdc2ac88a7d5 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:06:43.564718 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-aeb5ea86-1a21-4066-9ddd-cdc2ac88a7d5 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:43.583256 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-aeb5ea86-1a21-4066-9ddd-cdc2ac88a7d5 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:43.583906 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-aeb5ea86-1a21-4066-9ddd-cdc2ac88a7d5 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:43.587615 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-aeb5ea86-1a21-4066-9ddd-cdc2ac88a7d5 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:43.588229 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-aeb5ea86-1a21-4066-9ddd-cdc2ac88a7d5 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:43.814877 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-aeb5ea86-1a21-4066-9ddd-cdc2ac88a7d5 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:43.836021 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-aeb5ea86-1a21-4066-9ddd-cdc2ac88a7d5 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:43.837593 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-aeb5ea86-1a21-4066-9ddd-cdc2ac88a7d5 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:43.848717 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-aeb5ea86-1a21-4066-9ddd-cdc2ac88a7d5 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42" status: 200 len: 1720 microversion: 2.20 time: 0.280871 Jan 15 21:06:43.849798 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2767/5540] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:06:43 2022] GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42 => generated 1720 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:06:44.014351 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-91ff9662-6c91-456b-bbec-893d6028eb81 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:06:44.016517 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-91ff9662-6c91-456b-bbec-893d6028eb81 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:44.043608 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-91ff9662-6c91-456b-bbec-893d6028eb81 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:44.044643 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-91ff9662-6c91-456b-bbec-893d6028eb81 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:44.046263 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-91ff9662-6c91-456b-bbec-893d6028eb81 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:44.047243 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-91ff9662-6c91-456b-bbec-893d6028eb81 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:44.072281 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-0fde9055-be98-4397-b42b-7726fdfb7995 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:06:44.074257 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-0fde9055-be98-4397-b42b-7726fdfb7995 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] [instance: 896b0f6d-8007-44c8-9bdc-db25f69a8d51] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:44.093851 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0fde9055-be98-4397-b42b-7726fdfb7995 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:44.094311 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0fde9055-be98-4397-b42b-7726fdfb7995 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:44.095402 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0fde9055-be98-4397-b42b-7726fdfb7995 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:44.096149 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0fde9055-be98-4397-b42b-7726fdfb7995 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:44.102098 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-91ff9662-6c91-456b-bbec-893d6028eb81 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.095245 Jan 15 21:06:44.104882 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2774/5541] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:06:44 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:06:44.166536 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-0fde9055-be98-4397-b42b-7726fdfb7995 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5556986824774afaa455010da540de2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b11e8e9465264349892209758f3c396d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:44.175422 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-0fde9055-be98-4397-b42b-7726fdfb7995 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5556986824774afaa455010da540de2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b11e8e9465264349892209758f3c396d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:44.176963 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-0fde9055-be98-4397-b42b-7726fdfb7995 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5556986824774afaa455010da540de2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b11e8e9465264349892209758f3c396d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:44.178138 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-0fde9055-be98-4397-b42b-7726fdfb7995 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] 10.222.0.46 "GET /compute/v2.1/servers/896b0f6d-8007-44c8-9bdc-db25f69a8d51" status: 200 len: 1363 microversion: 2.57 time: 0.114156 Jan 15 21:06:44.178866 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2768/5542] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:06:44 2022] GET /compute/v2.1/servers/896b0f6d-8007-44c8-9bdc-db25f69a8d51 => generated 1363 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:06:44.532086 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1ac6381a-e817-482a-a837-c6cdfe06fed1 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:06:44.533736 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-1ac6381a-e817-482a-a837-c6cdfe06fed1 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: d9db70df-9ffc-4b96-af06-a56b3b35ce91] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:44.543460 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1ac6381a-e817-482a-a837-c6cdfe06fed1 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:44.544156 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1ac6381a-e817-482a-a837-c6cdfe06fed1 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:44.545086 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1ac6381a-e817-482a-a837-c6cdfe06fed1 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:44.545530 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1ac6381a-e817-482a-a837-c6cdfe06fed1 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:44.610417 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-1ac6381a-e817-482a-a837-c6cdfe06fed1 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action" status: 200 len: 32646 microversion: 2.1 time: 0.082204 Jan 15 21:06:44.612112 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2775/5543] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:06:44 2022] POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action => generated 32646 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:06:44.898114 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ce181fd0-e972-40d0-ba1e-2fae746c25ac tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:06:44.898885 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ce181fd0-e972-40d0-ba1e-2fae746c25ac tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:44.905766 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ce181fd0-e972-40d0-ba1e-2fae746c25ac tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:44.906224 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ce181fd0-e972-40d0-ba1e-2fae746c25ac tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:44.908218 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ce181fd0-e972-40d0-ba1e-2fae746c25ac tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:44.908713 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ce181fd0-e972-40d0-ba1e-2fae746c25ac tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:45.071683 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-ce181fd0-e972-40d0-ba1e-2fae746c25ac tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:45.080357 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-ce181fd0-e972-40d0-ba1e-2fae746c25ac tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:45.081906 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-ce181fd0-e972-40d0-ba1e-2fae746c25ac tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:45.083075 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ce181fd0-e972-40d0-ba1e-2fae746c25ac tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42" status: 200 len: 1663 microversion: 2.20 time: 0.218912 Jan 15 21:06:45.083648 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2769/5544] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:06:44 2022] GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42 => generated 1663 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:06:45.104312 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-6734df1b-31a4-42c6-b10a-0285c5ca4063 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e452f945-747c-45ae-b549-0903752da1dd"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:06:45.105500 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-6734df1b-31a4-42c6-b10a-0285c5ca4063 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:45.115620 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-cc3f6d2a-857c-4808-b981-244c3c3fe4f7 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:06:45.116949 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-cc3f6d2a-857c-4808-b981-244c3c3fe4f7 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:45.119607 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6734df1b-31a4-42c6-b10a-0285c5ca4063 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:45.120059 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6734df1b-31a4-42c6-b10a-0285c5ca4063 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:45.122931 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6734df1b-31a4-42c6-b10a-0285c5ca4063 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:45.123726 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6734df1b-31a4-42c6-b10a-0285c5ca4063 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:45.124712 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cc3f6d2a-857c-4808-b981-244c3c3fe4f7 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:45.125452 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cc3f6d2a-857c-4808-b981-244c3c3fe4f7 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:45.126393 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cc3f6d2a-857c-4808-b981-244c3c3fe4f7 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:45.126905 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cc3f6d2a-857c-4808-b981-244c3c3fe4f7 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:45.184300 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-cc3f6d2a-857c-4808-b981-244c3c3fe4f7 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.072390 Jan 15 21:06:45.185682 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2770/5545] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:06:45 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:06:45.201333 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ac9b06c0-2356-4e83-8571-d9f5bf1268d4 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:06:45.202440 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ac9b06c0-2356-4e83-8571-d9f5bf1268d4 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] [instance: 896b0f6d-8007-44c8-9bdc-db25f69a8d51] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:45.212423 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ac9b06c0-2356-4e83-8571-d9f5bf1268d4 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:45.212902 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ac9b06c0-2356-4e83-8571-d9f5bf1268d4 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:45.213861 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ac9b06c0-2356-4e83-8571-d9f5bf1268d4 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:45.214557 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ac9b06c0-2356-4e83-8571-d9f5bf1268d4 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:45.275327 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ac9b06c0-2356-4e83-8571-d9f5bf1268d4 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:45.275812 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ac9b06c0-2356-4e83-8571-d9f5bf1268d4 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:45.276217 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.objects.instance [None req-ac9b06c0-2356-4e83-8571-d9f5bf1268d4 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lazy-loading 'fault' on Instance uuid 896b0f6d-8007-44c8-9bdc-db25f69a8d51 {{(pid=129365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 21:06:45.359993 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-ac9b06c0-2356-4e83-8571-d9f5bf1268d4 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5556986824774afaa455010da540de2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b11e8e9465264349892209758f3c396d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:45.370596 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-ac9b06c0-2356-4e83-8571-d9f5bf1268d4 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5556986824774afaa455010da540de2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b11e8e9465264349892209758f3c396d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:45.372323 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-ac9b06c0-2356-4e83-8571-d9f5bf1268d4 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5556986824774afaa455010da540de2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b11e8e9465264349892209758f3c396d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:45.374081 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ac9b06c0-2356-4e83-8571-d9f5bf1268d4 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] 10.222.0.46 "GET /compute/v2.1/servers/896b0f6d-8007-44c8-9bdc-db25f69a8d51" status: 200 len: 1368 microversion: 2.57 time: 0.179873 Jan 15 21:06:45.374884 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2771/5546] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:06:45 2022] GET /compute/v2.1/servers/896b0f6d-8007-44c8-9bdc-db25f69a8d51 => generated 1368 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 15 21:06:45.534560 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-6734df1b-31a4-42c6-b10a-0285c5ca4063 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.434941 Jan 15 21:06:45.540707 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2776/5547] 10.222.0.46 () {62 vars in 1363 bytes} [Sat Jan 15 21:06:45 2022] POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/os-volume_attachments => generated 188 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:06:45.623040 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-caccd07b-d14d-40d6-83fd-66753fe24dd4 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:06:45.623955 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-caccd07b-d14d-40d6-83fd-66753fe24dd4 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: d9db70df-9ffc-4b96-af06-a56b3b35ce91] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:45.637212 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-caccd07b-d14d-40d6-83fd-66753fe24dd4 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:45.637671 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-caccd07b-d14d-40d6-83fd-66753fe24dd4 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:45.638564 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-caccd07b-d14d-40d6-83fd-66753fe24dd4 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:45.639004 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-caccd07b-d14d-40d6-83fd-66753fe24dd4 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:45.697217 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-473cf5dc-ecb9-4a07-92c8-bf2f1f25dcd2 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:06:45.697973 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-473cf5dc-ecb9-4a07-92c8-bf2f1f25dcd2 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:45.703790 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-caccd07b-d14d-40d6-83fd-66753fe24dd4 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action" status: 200 len: 32646 microversion: 2.1 time: 0.084215 Jan 15 21:06:45.711948 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2772/5548] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:06:45 2022] POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action => generated 32646 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:06:45.714551 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-473cf5dc-ecb9-4a07-92c8-bf2f1f25dcd2 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:45.715002 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-473cf5dc-ecb9-4a07-92c8-bf2f1f25dcd2 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:45.715789 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-473cf5dc-ecb9-4a07-92c8-bf2f1f25dcd2 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:45.716410 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-473cf5dc-ecb9-4a07-92c8-bf2f1f25dcd2 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:45.939783 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-9b4b3b8c-1f86-442e-8d5c-4d1f277f84c2 req-c561023c-d7ac-4ed1-afa6-f81a51cf4a32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1b412a8-0407-44fd-8f16-7cbcd8de3a42", "name": "network-vif-unplugged", "status": "completed", "tag": "d027fed2-822f-40a2-a052-26b22c1aef53"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:06:45.948102 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:06:45.948102 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:06:45.973443 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-9b4b3b8c-1f86-442e-8d5c-4d1f277f84c2 req-c561023c-d7ac-4ed1-afa6-f81a51cf4a32 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:45.973890 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-9b4b3b8c-1f86-442e-8d5c-4d1f277f84c2 req-c561023c-d7ac-4ed1-afa6-f81a51cf4a32 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:45.988610 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.compute.server_external_events [req-9b4b3b8c-1f86-442e-8d5c-4d1f277f84c2 req-c561023c-d7ac-4ed1-afa6-f81a51cf4a32 service nova] Unable to find a host for instance a1b412a8-0407-44fd-8f16-7cbcd8de3a42. Dropping event network-vif-unplugged {{(pid=129365) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Jan 15 21:06:45.989746 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-9b4b3b8c-1f86-442e-8d5c-4d1f277f84c2 req-c561023c-d7ac-4ed1-afa6-f81a51cf4a32 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.055032 Jan 15 21:06:45.991601 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2773/5549] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:06:45 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 58 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jan 15 21:06:46.009292 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-473cf5dc-ecb9-4a07-92c8-bf2f1f25dcd2 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "DELETE /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/os-volume_attachments/e452f945-747c-45ae-b549-0903752da1dd" status: 202 len: 0 microversion: 2.20 time: 0.318208 Jan 15 21:06:46.012573 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2777/5550] 10.222.0.46 () {60 vars in 1456 bytes} [Sat Jan 15 21:06:45 2022] DELETE /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/os-volume_attachments/e452f945-747c-45ae-b549-0903752da1dd => generated 0 bytes in 323 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jan 15 21:06:46.093305 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8bb2ae25-6252-4251-a256-636971bfc840 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:06:46.094394 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-8bb2ae25-6252-4251-a256-636971bfc840 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:46.103147 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8bb2ae25-6252-4251-a256-636971bfc840 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:46.104288 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8bb2ae25-6252-4251-a256-636971bfc840 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:46.105367 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8bb2ae25-6252-4251-a256-636971bfc840 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:46.106104 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8bb2ae25-6252-4251-a256-636971bfc840 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:46.202681 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d3ff1ddd-1c3b-4c29-9a64-636429634b87 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:06:46.204417 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-d3ff1ddd-1c3b-4c29-9a64-636429634b87 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:46.219687 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d3ff1ddd-1c3b-4c29-9a64-636429634b87 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:46.220510 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d3ff1ddd-1c3b-4c29-9a64-636429634b87 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:46.221739 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d3ff1ddd-1c3b-4c29-9a64-636429634b87 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:46.222227 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d3ff1ddd-1c3b-4c29-9a64-636429634b87 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:46.254911 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-8bb2ae25-6252-4251-a256-636971bfc840 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action" status: 202 len: 0 microversion: 2.20 time: 0.165481 Jan 15 21:06:46.257001 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2774/5551] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:06:46 2022] POST /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/action => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jan 15 21:06:46.271500 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e9810186-5181-437d-9c78-08a308826599 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:06:46.273351 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e9810186-5181-437d-9c78-08a308826599 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:46.291256 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e9810186-5181-437d-9c78-08a308826599 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:46.291713 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e9810186-5181-437d-9c78-08a308826599 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:46.292764 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e9810186-5181-437d-9c78-08a308826599 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:46.302918 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e9810186-5181-437d-9c78-08a308826599 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:46.349732 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d3ff1ddd-1c3b-4c29-9a64-636429634b87 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.154312 Jan 15 21:06:46.352154 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2778/5552] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:06:46 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:06:46.409453 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e69a4d29-ff92-4118-bbe9-8417d8d56468 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:06:46.413590 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e69a4d29-ff92-4118-bbe9-8417d8d56468 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] [instance: 896b0f6d-8007-44c8-9bdc-db25f69a8d51] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:46.437496 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e69a4d29-ff92-4118-bbe9-8417d8d56468 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:46.441800 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e69a4d29-ff92-4118-bbe9-8417d8d56468 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:46.445425 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e69a4d29-ff92-4118-bbe9-8417d8d56468 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:46.446085 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e69a4d29-ff92-4118-bbe9-8417d8d56468 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:46.476323 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-e69a4d29-ff92-4118-bbe9-8417d8d56468 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] HTTP exception thrown: Instance 896b0f6d-8007-44c8-9bdc-db25f69a8d51 could not be found. Jan 15 21:06:46.477712 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e69a4d29-ff92-4118-bbe9-8417d8d56468 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] Returning 404 to user: Instance 896b0f6d-8007-44c8-9bdc-db25f69a8d51 could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:06:46.478917 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e69a4d29-ff92-4118-bbe9-8417d8d56468 tempest-ServerShowV257Test-1235042625 tempest-ServerShowV257Test-1235042625-project] 10.222.0.46 "GET /compute/v2.1/servers/896b0f6d-8007-44c8-9bdc-db25f69a8d51" status: 404 len: 111 microversion: 2.57 time: 0.086850 Jan 15 21:06:46.481246 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2779/5553] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:06:46 2022] GET /compute/v2.1/servers/896b0f6d-8007-44c8-9bdc-db25f69a8d51 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jan 15 21:06:46.544456 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-e9810186-5181-437d-9c78-08a308826599 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:46.554307 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-e9810186-5181-437d-9c78-08a308826599 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:46.556789 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-e9810186-5181-437d-9c78-08a308826599 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:46.558211 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e9810186-5181-437d-9c78-08a308826599 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42" status: 200 len: 1671 microversion: 2.20 time: 0.298301 Jan 15 21:06:46.561164 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2775/5554] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:06:46 2022] GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42 => generated 1671 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:06:46.719236 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9a953ef3-3a30-4862-8c76-460dd5094292 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:06:46.720220 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-9a953ef3-3a30-4862-8c76-460dd5094292 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: d9db70df-9ffc-4b96-af06-a56b3b35ce91] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:46.750034 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9a953ef3-3a30-4862-8c76-460dd5094292 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:46.752081 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9a953ef3-3a30-4862-8c76-460dd5094292 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:46.754073 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9a953ef3-3a30-4862-8c76-460dd5094292 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:46.755296 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9a953ef3-3a30-4862-8c76-460dd5094292 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:46.841610 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-9a953ef3-3a30-4862-8c76-460dd5094292 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action" status: 200 len: 32646 microversion: 2.1 time: 0.127841 Jan 15 21:06:46.844266 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2780/5555] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:06:46 2022] POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action => generated 32646 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:06:47.367661 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d44d6c51-7187-45cb-ae9a-8808df99565a tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:06:47.368869 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d44d6c51-7187-45cb-ae9a-8808df99565a tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:47.396962 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d44d6c51-7187-45cb-ae9a-8808df99565a tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:47.397598 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d44d6c51-7187-45cb-ae9a-8808df99565a tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:47.399245 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d44d6c51-7187-45cb-ae9a-8808df99565a tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:47.399950 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d44d6c51-7187-45cb-ae9a-8808df99565a tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:47.510432 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d44d6c51-7187-45cb-ae9a-8808df99565a tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.146249 Jan 15 21:06:47.511847 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2776/5556] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:06:47 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:06:47.581589 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-647a02e5-b629-4da0-82c9-912b28706a80 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:06:47.582581 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-647a02e5-b629-4da0-82c9-912b28706a80 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:47.603013 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-647a02e5-b629-4da0-82c9-912b28706a80 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:47.603844 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-647a02e5-b629-4da0-82c9-912b28706a80 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:47.604858 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-647a02e5-b629-4da0-82c9-912b28706a80 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:47.605466 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-647a02e5-b629-4da0-82c9-912b28706a80 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:47.856142 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-1e0af804-4af9-46e5-a951-3a1be0bfaecf tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:06:47.857716 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-1e0af804-4af9-46e5-a951-3a1be0bfaecf tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: d9db70df-9ffc-4b96-af06-a56b3b35ce91] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:47.874084 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1e0af804-4af9-46e5-a951-3a1be0bfaecf tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:47.874617 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1e0af804-4af9-46e5-a951-3a1be0bfaecf tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:47.875500 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1e0af804-4af9-46e5-a951-3a1be0bfaecf tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:47.876007 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1e0af804-4af9-46e5-a951-3a1be0bfaecf tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:47.962248 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-1e0af804-4af9-46e5-a951-3a1be0bfaecf tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action" status: 200 len: 32646 microversion: 2.1 time: 0.111929 Jan 15 21:06:47.963216 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2777/5557] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:06:47 2022] POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action => generated 32646 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 21:06:47.993400 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-647a02e5-b629-4da0-82c9-912b28706a80 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:48.004682 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-647a02e5-b629-4da0-82c9-912b28706a80 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:48.006904 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-647a02e5-b629-4da0-82c9-912b28706a80 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:48.009076 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-647a02e5-b629-4da0-82c9-912b28706a80 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42" status: 200 len: 1729 microversion: 2.20 time: 0.432460 Jan 15 21:06:48.026416 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2781/5558] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:06:47 2022] GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42 => generated 1729 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:06:48.526319 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-1afe6da5-a79b-44af-8d9b-4d8ccc9f68b0 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:06:48.528779 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-1afe6da5-a79b-44af-8d9b-4d8ccc9f68b0 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:48.563035 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1afe6da5-a79b-44af-8d9b-4d8ccc9f68b0 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:48.563515 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1afe6da5-a79b-44af-8d9b-4d8ccc9f68b0 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:48.568254 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1afe6da5-a79b-44af-8d9b-4d8ccc9f68b0 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:48.570482 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1afe6da5-a79b-44af-8d9b-4d8ccc9f68b0 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:48.693381 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-1afe6da5-a79b-44af-8d9b-4d8ccc9f68b0 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.172445 Jan 15 21:06:48.695548 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2778/5559] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:06:48 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:06:48.974273 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4984964e-89a6-4d08-ac2c-02b84d9fee4d tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:06:48.975792 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-4984964e-89a6-4d08-ac2c-02b84d9fee4d tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: d9db70df-9ffc-4b96-af06-a56b3b35ce91] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:48.985454 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4984964e-89a6-4d08-ac2c-02b84d9fee4d tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:48.986184 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4984964e-89a6-4d08-ac2c-02b84d9fee4d tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:48.987256 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4984964e-89a6-4d08-ac2c-02b84d9fee4d tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:48.987921 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4984964e-89a6-4d08-ac2c-02b84d9fee4d tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:49.031645 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e191ede5-9aad-465d-bd86-f5aed0cd7894 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:06:49.032798 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e191ede5-9aad-465d-bd86-f5aed0cd7894 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:49.043355 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e191ede5-9aad-465d-bd86-f5aed0cd7894 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:49.044060 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e191ede5-9aad-465d-bd86-f5aed0cd7894 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:49.046207 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e191ede5-9aad-465d-bd86-f5aed0cd7894 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:49.047505 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e191ede5-9aad-465d-bd86-f5aed0cd7894 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:49.050139 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-4984964e-89a6-4d08-ac2c-02b84d9fee4d tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action" status: 200 len: 40801 microversion: 2.1 time: 0.079350 Jan 15 21:06:49.051374 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2782/5560] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:06:48 2022] POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/action => generated 40801 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:06:49.065176 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-91660535-8386-4f48-8f43-5d34441ae302 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:06:49.066266 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-91660535-8386-4f48-8f43-5d34441ae302 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: d9db70df-9ffc-4b96-af06-a56b3b35ce91] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:49.076044 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-91660535-8386-4f48-8f43-5d34441ae302 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:49.076898 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-91660535-8386-4f48-8f43-5d34441ae302 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:49.077977 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-91660535-8386-4f48-8f43-5d34441ae302 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:49.079055 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-91660535-8386-4f48-8f43-5d34441ae302 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:49.129644 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-91660535-8386-4f48-8f43-5d34441ae302 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "GET /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/ips" status: 200 len: 147 microversion: 2.1 time: 0.068549 Jan 15 21:06:49.132509 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2783/5561] 10.222.0.46 () {58 vars in 1247 bytes} [Sat Jan 15 21:06:49 2022] GET /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/ips => generated 147 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:06:49.138108 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-1520aa50-b664-4535-a3ad-a7c42016df7c req-1d31785c-0692-48ba-92f4-e0922be56e66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1b412a8-0407-44fd-8f16-7cbcd8de3a42", "tag": "d027fed2-822f-40a2-a052-26b22c1aef53"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:06:49.140737 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:06:49.140737 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:06:49.153187 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-1520aa50-b664-4535-a3ad-a7c42016df7c req-1d31785c-0692-48ba-92f4-e0922be56e66 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:49.153887 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-1520aa50-b664-4535-a3ad-a7c42016df7c req-1d31785c-0692-48ba-92f4-e0922be56e66 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:49.172529 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-1520aa50-b664-4535-a3ad-a7c42016df7c req-1d31785c-0692-48ba-92f4-e0922be56e66 service nova] Creating event network-changed:d027fed2-822f-40a2-a052-26b22c1aef53 for instance a1b412a8-0407-44fd-8f16-7cbcd8de3a42 on nch1-master-1 Jan 15 21:06:49.192225 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-1520aa50-b664-4535-a3ad-a7c42016df7c req-1d31785c-0692-48ba-92f4-e0922be56e66 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057586 Jan 15 21:06:49.196323 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2784/5562] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:06:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:06:49.708259 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8e98b444-80b4-4d4e-8eeb-80ab6956f60c tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:06:49.709334 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-8e98b444-80b4-4d4e-8eeb-80ab6956f60c tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:49.718228 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8e98b444-80b4-4d4e-8eeb-80ab6956f60c tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:49.720723 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8e98b444-80b4-4d4e-8eeb-80ab6956f60c tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:49.723856 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8e98b444-80b4-4d4e-8eeb-80ab6956f60c tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:49.724407 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8e98b444-80b4-4d4e-8eeb-80ab6956f60c tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:49.798323 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-8e98b444-80b4-4d4e-8eeb-80ab6956f60c tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.094715 Jan 15 21:06:49.803583 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2785/5563] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:06:49 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:06:49.831583 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-e191ede5-9aad-465d-bd86-f5aed0cd7894 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:49.841629 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-e191ede5-9aad-465d-bd86-f5aed0cd7894 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:49.843479 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-e191ede5-9aad-465d-bd86-f5aed0cd7894 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:49.847559 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e191ede5-9aad-465d-bd86-f5aed0cd7894 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42" status: 200 len: 1729 microversion: 2.20 time: 0.820980 Jan 15 21:06:49.848412 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2779/5564] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:06:49 2022] GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42 => generated 1729 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 15 21:06:50.813552 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e36047f7-a0fb-48c1-a50f-63071b8f7af9 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:06:50.815123 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e36047f7-a0fb-48c1-a50f-63071b8f7af9 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:50.838765 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e36047f7-a0fb-48c1-a50f-63071b8f7af9 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:50.839207 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e36047f7-a0fb-48c1-a50f-63071b8f7af9 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:50.846936 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e36047f7-a0fb-48c1-a50f-63071b8f7af9 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:50.848214 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e36047f7-a0fb-48c1-a50f-63071b8f7af9 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:50.873887 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-6a137490-a31a-42ed-b7ee-fe88be4c2521 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:06:50.876208 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-6a137490-a31a-42ed-b7ee-fe88be4c2521 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:50.926848 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6a137490-a31a-42ed-b7ee-fe88be4c2521 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:50.930727 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6a137490-a31a-42ed-b7ee-fe88be4c2521 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:50.934269 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6a137490-a31a-42ed-b7ee-fe88be4c2521 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:50.935299 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6a137490-a31a-42ed-b7ee-fe88be4c2521 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:50.958044 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e36047f7-a0fb-48c1-a50f-63071b8f7af9 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.149775 Jan 15 21:06:50.968791 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2786/5565] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:06:50 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:06:51.440103 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-6a137490-a31a-42ed-b7ee-fe88be4c2521 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:51.450115 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-6a137490-a31a-42ed-b7ee-fe88be4c2521 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:51.451497 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-6a137490-a31a-42ed-b7ee-fe88be4c2521 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:51.452691 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-6a137490-a31a-42ed-b7ee-fe88be4c2521 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42" status: 200 len: 1729 microversion: 2.20 time: 0.590362 Jan 15 21:06:51.474610 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2780/5566] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:06:50 2022] GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42 => generated 1729 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:06:51.592181 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-789f589a-39b4-492d-84cd-95a6787751c0 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-954576232", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "networks": [{"uuid": "b55f2173-9368-4426-891c-2ceb82762521"}]}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:06:51.696698 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.network.neutron [None req-789f589a-39b4-492d-84cd-95a6787751c0 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] validate_networks() for [('b55f2173-9368-4426-891c-2ceb82762521', None, None, None, None, None)] {{(pid=129366) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 21:06:51.824279 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-bbccac9a-3dd6-4e8e-9216-19f66c9b98b9 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "39a9f446-bda4-412e-b835-f0b04d414fed"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:06:51.826106 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-bbccac9a-3dd6-4e8e-9216-19f66c9b98b9 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: d9db70df-9ffc-4b96-af06-a56b3b35ce91] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:51.846769 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bbccac9a-3dd6-4e8e-9216-19f66c9b98b9 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:51.848155 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bbccac9a-3dd6-4e8e-9216-19f66c9b98b9 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:51.853019 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bbccac9a-3dd6-4e8e-9216-19f66c9b98b9 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:51.854609 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bbccac9a-3dd6-4e8e-9216-19f66c9b98b9 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:52.394484 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-bbccac9a-3dd6-4e8e-9216-19f66c9b98b9 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.575366 Jan 15 21:06:52.415994 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2781/5567] 10.222.0.46 () {60 vars in 1322 bytes} [Sat Jan 15 21:06:51 2022] POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/os-volume_attachments => generated 194 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:06:52.434051 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-40c288cc-6d3d-42bf-aed9-f8cadcbc6397 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:06:52.438396 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-40c288cc-6d3d-42bf-aed9-f8cadcbc6397 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:52.459175 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-40c288cc-6d3d-42bf-aed9-f8cadcbc6397 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:52.459679 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-40c288cc-6d3d-42bf-aed9-f8cadcbc6397 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:52.460493 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-40c288cc-6d3d-42bf-aed9-f8cadcbc6397 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:52.460958 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-40c288cc-6d3d-42bf-aed9-f8cadcbc6397 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:52.575764 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-40c288cc-6d3d-42bf-aed9-f8cadcbc6397 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.157794 Jan 15 21:06:52.577580 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2782/5568] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:06:52 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:06:52.596827 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b94a9b11-fbc7-49d9-af2e-6540fe543a2c tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:06:52.598962 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b94a9b11-fbc7-49d9-af2e-6540fe543a2c tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:52.620533 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b94a9b11-fbc7-49d9-af2e-6540fe543a2c tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:52.623566 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b94a9b11-fbc7-49d9-af2e-6540fe543a2c tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:52.624782 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b94a9b11-fbc7-49d9-af2e-6540fe543a2c tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:52.626374 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b94a9b11-fbc7-49d9-af2e-6540fe543a2c tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:53.013161 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-789f589a-39b4-492d-84cd-95a6787751c0 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Flavor limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 21:06:53.014589 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-789f589a-39b4-492d-84cd-95a6787751c0 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Image limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 21:06:53.015346 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-789f589a-39b4-492d-84cd-95a6787751c0 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Flavor pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 21:06:53.016517 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-789f589a-39b4-492d-84cd-95a6787751c0 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Image pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 21:06:53.017232 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-789f589a-39b4-492d-84cd-95a6787751c0 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 21:06:53.064545 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-789f589a-39b4-492d-84cd-95a6787751c0 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:53.065431 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-789f589a-39b4-492d-84cd-95a6787751c0 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:53.067656 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-789f589a-39b4-492d-84cd-95a6787751c0 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:53.073656 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-789f589a-39b4-492d-84cd-95a6787751c0 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:53.148552 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-789f589a-39b4-492d-84cd-95a6787751c0 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Getting quotas for project 95e03e1de077453588cc783a4e6d690e. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:06:53.156228 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-789f589a-39b4-492d-84cd-95a6787751c0 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Getting quotas for user 822f4a2b1fd6459a8a472bdd066d69fc and project 95e03e1de077453588cc783a4e6d690e. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:06:53.224330 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-789f589a-39b4-492d-84cd-95a6787751c0 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Going to run 1 instances... {{(pid=129366) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 21:06:53.228128 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-789f589a-39b4-492d-84cd-95a6787751c0 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] [instance: 552b7547-f4b2-4af0-be24-a4c628408c16] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 21:06:53.302094 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-789f589a-39b4-492d-84cd-95a6787751c0 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.131190 Jan 15 21:06:53.314812 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2787/5569] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 21:06:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 2143 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 21:06:53.327066 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9f2f62a4-2fbb-4e87-933c-8d2fdb4ff758 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:06:53.329521 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-9f2f62a4-2fbb-4e87-933c-8d2fdb4ff758 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] [instance: 552b7547-f4b2-4af0-be24-a4c628408c16] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:53.352597 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-b94a9b11-fbc7-49d9-af2e-6540fe543a2c tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:53.379753 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-b94a9b11-fbc7-49d9-af2e-6540fe543a2c tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:53.382070 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-b94a9b11-fbc7-49d9-af2e-6540fe543a2c tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:53.383333 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b94a9b11-fbc7-49d9-af2e-6540fe543a2c tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42" status: 200 len: 1729 microversion: 2.20 time: 0.804103 Jan 15 21:06:53.383890 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2783/5570] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:06:52 2022] GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42 => generated 1729 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:06:53.516740 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-9f2f62a4-2fbb-4e87-933c-8d2fdb4ff758 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822f4a2b1fd6459a8a472bdd066d69fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e03e1de077453588cc783a4e6d690e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:53.529893 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-9f2f62a4-2fbb-4e87-933c-8d2fdb4ff758 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] 10.222.0.46 "GET /compute/v2.1/servers/552b7547-f4b2-4af0-be24-a4c628408c16" status: 200 len: 1217 microversion: 2.1 time: 0.213637 Jan 15 21:06:53.530906 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2788/5571] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:06:53 2022] GET /compute/v2.1/servers/552b7547-f4b2-4af0-be24-a4c628408c16 => generated 1217 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:06:53.589829 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b4341722-5c9b-4759-94a4-409ec128f4ff tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:06:53.592249 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b4341722-5c9b-4759-94a4-409ec128f4ff tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:53.599350 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b4341722-5c9b-4759-94a4-409ec128f4ff tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:53.600165 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b4341722-5c9b-4759-94a4-409ec128f4ff tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:53.601647 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b4341722-5c9b-4759-94a4-409ec128f4ff tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:53.602567 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b4341722-5c9b-4759-94a4-409ec128f4ff tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:53.824363 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b4341722-5c9b-4759-94a4-409ec128f4ff tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.237752 Jan 15 21:06:53.828864 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2784/5572] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:06:53 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:06:54.403642 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7d91e2db-975b-403c-bf49-428520d9fd2b tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:06:54.404680 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-7d91e2db-975b-403c-bf49-428520d9fd2b tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:54.423178 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7d91e2db-975b-403c-bf49-428520d9fd2b tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:54.425076 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7d91e2db-975b-403c-bf49-428520d9fd2b tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:54.427505 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7d91e2db-975b-403c-bf49-428520d9fd2b tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:54.430436 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7d91e2db-975b-403c-bf49-428520d9fd2b tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:54.549739 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-bc77f8e1-2bb7-4e80-866b-08680cd11f0e tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:06:54.551011 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-bc77f8e1-2bb7-4e80-866b-08680cd11f0e tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] [instance: 552b7547-f4b2-4af0-be24-a4c628408c16] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:54.561976 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bc77f8e1-2bb7-4e80-866b-08680cd11f0e tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:54.562428 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bc77f8e1-2bb7-4e80-866b-08680cd11f0e tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:54.563225 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bc77f8e1-2bb7-4e80-866b-08680cd11f0e tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:54.563734 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bc77f8e1-2bb7-4e80-866b-08680cd11f0e tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:54.830200 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-bc77f8e1-2bb7-4e80-866b-08680cd11f0e tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822f4a2b1fd6459a8a472bdd066d69fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e03e1de077453588cc783a4e6d690e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:54.838675 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-bc77f8e1-2bb7-4e80-866b-08680cd11f0e tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] 10.222.0.46 "GET /compute/v2.1/servers/552b7547-f4b2-4af0-be24-a4c628408c16" status: 200 len: 1213 microversion: 2.1 time: 0.294124 Jan 15 21:06:54.844650 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2785/5573] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:06:54 2022] GET /compute/v2.1/servers/552b7547-f4b2-4af0-be24-a4c628408c16 => generated 1213 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:06:54.858030 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-61cfe21f-54ff-4ab9-9259-c6d9d9716e89 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:06:54.860958 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-61cfe21f-54ff-4ab9-9259-c6d9d9716e89 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:54.875316 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-61cfe21f-54ff-4ab9-9259-c6d9d9716e89 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:54.877340 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-61cfe21f-54ff-4ab9-9259-c6d9d9716e89 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:54.883404 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-61cfe21f-54ff-4ab9-9259-c6d9d9716e89 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:54.884030 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-61cfe21f-54ff-4ab9-9259-c6d9d9716e89 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:54.976776 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-61cfe21f-54ff-4ab9-9259-c6d9d9716e89 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.124657 Jan 15 21:06:54.986970 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2786/5574] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:06:54 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:06:55.093032 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-7d91e2db-975b-403c-bf49-428520d9fd2b tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:55.104906 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-7d91e2db-975b-403c-bf49-428520d9fd2b tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:55.107120 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-7d91e2db-975b-403c-bf49-428520d9fd2b tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:55.109256 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7d91e2db-975b-403c-bf49-428520d9fd2b tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42" status: 200 len: 1729 microversion: 2.20 time: 0.710953 Jan 15 21:06:55.122081 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2789/5575] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:06:54 2022] GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42 => generated 1729 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:06:55.866315 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-996795c1-63ee-4075-a094-8df32d26317d tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:06:55.867858 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-996795c1-63ee-4075-a094-8df32d26317d tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] [instance: 552b7547-f4b2-4af0-be24-a4c628408c16] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:55.891794 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-996795c1-63ee-4075-a094-8df32d26317d tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:55.892819 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-996795c1-63ee-4075-a094-8df32d26317d tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:55.895285 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-996795c1-63ee-4075-a094-8df32d26317d tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:55.899148 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-996795c1-63ee-4075-a094-8df32d26317d tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:55.995883 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-981dc5d0-6e7a-4378-821a-922d8f689f2b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:06:55.995883 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-981dc5d0-6e7a-4378-821a-922d8f689f2b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:56.040308 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-981dc5d0-6e7a-4378-821a-922d8f689f2b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:56.046949 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-981dc5d0-6e7a-4378-821a-922d8f689f2b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:56.051198 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-981dc5d0-6e7a-4378-821a-922d8f689f2b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:56.052716 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-981dc5d0-6e7a-4378-821a-922d8f689f2b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:56.112986 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-996795c1-63ee-4075-a094-8df32d26317d tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822f4a2b1fd6459a8a472bdd066d69fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e03e1de077453588cc783a4e6d690e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:56.123663 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-996795c1-63ee-4075-a094-8df32d26317d tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] 10.222.0.46 "GET /compute/v2.1/servers/552b7547-f4b2-4af0-be24-a4c628408c16" status: 200 len: 1287 microversion: 2.1 time: 0.261981 Jan 15 21:06:56.124272 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2787/5576] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:06:55 2022] GET /compute/v2.1/servers/552b7547-f4b2-4af0-be24-a4c628408c16 => generated 1287 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:06:56.145564 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9995596b-93e4-41bd-a6e8-706cdc99437e tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:06:56.147927 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-9995596b-93e4-41bd-a6e8-706cdc99437e tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: d9db70df-9ffc-4b96-af06-a56b3b35ce91] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:56.163210 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-981dc5d0-6e7a-4378-821a-922d8f689f2b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.172840 Jan 15 21:06:56.164631 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2790/5577] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:06:55 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:06:56.170035 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9995596b-93e4-41bd-a6e8-706cdc99437e tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:56.170493 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9995596b-93e4-41bd-a6e8-706cdc99437e tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:56.171306 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9995596b-93e4-41bd-a6e8-706cdc99437e tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:56.172184 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9995596b-93e4-41bd-a6e8-706cdc99437e tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:56.181446 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1de5e234-1c79-41b8-a944-f9d788e83f11 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:06:56.183778 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-1de5e234-1c79-41b8-a944-f9d788e83f11 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:56.205135 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1de5e234-1c79-41b8-a944-f9d788e83f11 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:56.206384 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1de5e234-1c79-41b8-a944-f9d788e83f11 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:56.208429 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1de5e234-1c79-41b8-a944-f9d788e83f11 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:56.210270 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1de5e234-1c79-41b8-a944-f9d788e83f11 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:56.250900 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-9995596b-93e4-41bd-a6e8-706cdc99437e tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "GET /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.125565 Jan 15 21:06:56.256035 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2788/5578] 10.222.0.46 () {58 vars in 1301 bytes} [Sat Jan 15 21:06:56 2022] GET /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/os-volume_attachments => generated 197 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:06:56.267598 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-0d0e6c42-624f-4533-b084-6f769318fd55 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:06:56.268530 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-0d0e6c42-624f-4533-b084-6f769318fd55 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: d9db70df-9ffc-4b96-af06-a56b3b35ce91] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:56.296569 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0d0e6c42-624f-4533-b084-6f769318fd55 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:56.297067 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0d0e6c42-624f-4533-b084-6f769318fd55 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:56.297879 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0d0e6c42-624f-4533-b084-6f769318fd55 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:56.298312 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0d0e6c42-624f-4533-b084-6f769318fd55 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:56.402304 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-0d0e6c42-624f-4533-b084-6f769318fd55 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "GET /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/os-volume_attachments/39a9f446-bda4-412e-b835-f0b04d414fed" status: 200 len: 194 microversion: 2.1 time: 0.138956 Jan 15 21:06:56.410281 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2789/5579] 10.222.0.46 () {58 vars in 1412 bytes} [Sat Jan 15 21:06:56 2022] GET /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/os-volume_attachments/39a9f446-bda4-412e-b835-f0b04d414fed => generated 194 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 21:06:56.559724 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-1de5e234-1c79-41b8-a944-f9d788e83f11 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:56.577563 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-1de5e234-1c79-41b8-a944-f9d788e83f11 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:56.581164 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-1de5e234-1c79-41b8-a944-f9d788e83f11 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:56.589916 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-1de5e234-1c79-41b8-a944-f9d788e83f11 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42" status: 200 len: 1729 microversion: 2.20 time: 0.418422 Jan 15 21:06:56.590980 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2791/5580] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:06:56 2022] GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42 => generated 1729 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:06:57.144444 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8f93bab0-f1a2-4b31-a7c7-dde41773f5f1 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:06:57.145158 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-8f93bab0-f1a2-4b31-a7c7-dde41773f5f1 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] [instance: 552b7547-f4b2-4af0-be24-a4c628408c16] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:57.164661 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8f93bab0-f1a2-4b31-a7c7-dde41773f5f1 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:57.165587 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8f93bab0-f1a2-4b31-a7c7-dde41773f5f1 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:57.169312 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8f93bab0-f1a2-4b31-a7c7-dde41773f5f1 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:57.170125 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8f93bab0-f1a2-4b31-a7c7-dde41773f5f1 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:57.176590 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-57e04c69-5973-499d-a583-d31683ca54b6 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:06:57.179183 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-57e04c69-5973-499d-a583-d31683ca54b6 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:57.214476 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-57e04c69-5973-499d-a583-d31683ca54b6 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:57.218019 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-57e04c69-5973-499d-a583-d31683ca54b6 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:57.221974 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-57e04c69-5973-499d-a583-d31683ca54b6 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:57.223629 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-57e04c69-5973-499d-a583-d31683ca54b6 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:57.307217 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-57e04c69-5973-499d-a583-d31683ca54b6 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.134881 Jan 15 21:06:57.313359 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2792/5581] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:06:57 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:06:57.346775 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-8f93bab0-f1a2-4b31-a7c7-dde41773f5f1 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822f4a2b1fd6459a8a472bdd066d69fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e03e1de077453588cc783a4e6d690e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:57.387819 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-8f93bab0-f1a2-4b31-a7c7-dde41773f5f1 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] 10.222.0.46 "GET /compute/v2.1/servers/552b7547-f4b2-4af0-be24-a4c628408c16" status: 200 len: 1275 microversion: 2.1 time: 0.227569 Jan 15 21:06:57.393736 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2790/5582] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:06:57 2022] GET /compute/v2.1/servers/552b7547-f4b2-4af0-be24-a4c628408c16 => generated 1275 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:06:57.617310 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-73524c63-e54a-47a4-8eff-97dcd5dd907c tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:06:57.619304 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-73524c63-e54a-47a4-8eff-97dcd5dd907c tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:57.645803 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-73524c63-e54a-47a4-8eff-97dcd5dd907c tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:57.649645 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-73524c63-e54a-47a4-8eff-97dcd5dd907c tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:57.651093 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-73524c63-e54a-47a4-8eff-97dcd5dd907c tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:57.653696 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-73524c63-e54a-47a4-8eff-97dcd5dd907c tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:57.967482 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-73524c63-e54a-47a4-8eff-97dcd5dd907c tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:57.976089 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-73524c63-e54a-47a4-8eff-97dcd5dd907c tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:57.986847 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-73524c63-e54a-47a4-8eff-97dcd5dd907c tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:57.988358 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-73524c63-e54a-47a4-8eff-97dcd5dd907c tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42" status: 200 len: 1729 microversion: 2.20 time: 0.377570 Jan 15 21:06:57.989500 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2793/5583] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:06:57 2022] GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42 => generated 1729 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:06:58.148418 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-478c6e87-12e3-4d84-8c77-b740193cab83 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b0f1d6d3-c0f9-4a5b-9db5-67840615d22f"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:06:58.151284 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-478c6e87-12e3-4d84-8c77-b740193cab83 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: d9db70df-9ffc-4b96-af06-a56b3b35ce91] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:58.163997 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-478c6e87-12e3-4d84-8c77-b740193cab83 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:58.168662 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-478c6e87-12e3-4d84-8c77-b740193cab83 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:58.170363 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-478c6e87-12e3-4d84-8c77-b740193cab83 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:58.172598 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-478c6e87-12e3-4d84-8c77-b740193cab83 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:58.326425 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0a3a29c7-e26f-497e-bae6-e654f1685b76 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:06:58.330147 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-0a3a29c7-e26f-497e-bae6-e654f1685b76 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:58.348746 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0a3a29c7-e26f-497e-bae6-e654f1685b76 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:58.359711 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0a3a29c7-e26f-497e-bae6-e654f1685b76 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:58.365354 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0a3a29c7-e26f-497e-bae6-e654f1685b76 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:58.366635 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0a3a29c7-e26f-497e-bae6-e654f1685b76 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:58.494193 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0a3a29c7-e26f-497e-bae6-e654f1685b76 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.172743 Jan 15 21:06:58.504033 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2794/5584] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:06:58 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:06:58.517124 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-363d67da-dedc-40b4-831f-f16636985c75 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:06:58.518640 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-363d67da-dedc-40b4-831f-f16636985c75 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] [instance: 552b7547-f4b2-4af0-be24-a4c628408c16] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:58.538716 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-363d67da-dedc-40b4-831f-f16636985c75 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:58.539859 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-363d67da-dedc-40b4-831f-f16636985c75 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:58.541472 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-363d67da-dedc-40b4-831f-f16636985c75 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:58.542243 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-363d67da-dedc-40b4-831f-f16636985c75 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:58.635992 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-478c6e87-12e3-4d84-8c77-b740193cab83 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.491963 Jan 15 21:06:58.639399 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2791/5585] 10.222.0.46 () {60 vars in 1322 bytes} [Sat Jan 15 21:06:58 2022] POST /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/os-volume_attachments => generated 194 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:06:59.008354 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-daa39590-fac0-42e1-9687-54aa4ed42137 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:06:59.009104 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-daa39590-fac0-42e1-9687-54aa4ed42137 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:59.016411 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-daa39590-fac0-42e1-9687-54aa4ed42137 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:59.028938 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-daa39590-fac0-42e1-9687-54aa4ed42137 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:59.030081 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-daa39590-fac0-42e1-9687-54aa4ed42137 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:59.030540 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-daa39590-fac0-42e1-9687-54aa4ed42137 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:59.606336 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-daa39590-fac0-42e1-9687-54aa4ed42137 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:59.631306 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-daa39590-fac0-42e1-9687-54aa4ed42137 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:59.637285 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-daa39590-fac0-42e1-9687-54aa4ed42137 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:06:59.638777 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-daa39590-fac0-42e1-9687-54aa4ed42137 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42" status: 200 len: 1729 microversion: 2.20 time: 0.635149 Jan 15 21:06:59.643789 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2792/5586] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:06:59 2022] GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42 => generated 1729 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:06:59.659919 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-04b51830-8327-46fe-bd0c-cf7c3469894b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:06:59.661241 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-04b51830-8327-46fe-bd0c-cf7c3469894b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:06:59.673248 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-04b51830-8327-46fe-bd0c-cf7c3469894b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:59.674725 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-04b51830-8327-46fe-bd0c-cf7c3469894b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:59.678456 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-04b51830-8327-46fe-bd0c-cf7c3469894b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:59.680950 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-04b51830-8327-46fe-bd0c-cf7c3469894b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:59.806436 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-04b51830-8327-46fe-bd0c-cf7c3469894b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.160794 Jan 15 21:06:59.812435 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2793/5587] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:06:59 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:06:59.818381 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-3f3bd802-68f9-466a-bc00-5de9016477af req-03536caa-30b9-441f-9470-856cc512d5bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "552b7547-f4b2-4af0-be24-a4c628408c16", "tag": "490d413f-9553-4a39-a6eb-6d61aef04f25"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:06:59.821468 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:06:59.821468 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:06:59.833274 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-3f3bd802-68f9-466a-bc00-5de9016477af req-03536caa-30b9-441f-9470-856cc512d5bc service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:06:59.835376 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-3f3bd802-68f9-466a-bc00-5de9016477af req-03536caa-30b9-441f-9470-856cc512d5bc service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:06:59.852712 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-3f3bd802-68f9-466a-bc00-5de9016477af req-03536caa-30b9-441f-9470-856cc512d5bc service nova] Creating event network-changed:490d413f-9553-4a39-a6eb-6d61aef04f25 for instance 552b7547-f4b2-4af0-be24-a4c628408c16 on nch1-master-1 Jan 15 21:06:59.858738 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-3f3bd802-68f9-466a-bc00-5de9016477af req-03536caa-30b9-441f-9470-856cc512d5bc service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044524 Jan 15 21:06:59.859654 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2794/5588] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:06:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:07:00.054490 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-363d67da-dedc-40b4-831f-f16636985c75 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822f4a2b1fd6459a8a472bdd066d69fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e03e1de077453588cc783a4e6d690e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:07:00.070886 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-363d67da-dedc-40b4-831f-f16636985c75 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] 10.222.0.46 "GET /compute/v2.1/servers/552b7547-f4b2-4af0-be24-a4c628408c16" status: 200 len: 1317 microversion: 2.1 time: 1.563332 Jan 15 21:07:00.073782 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2795/5589] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:06:58 2022] GET /compute/v2.1/servers/552b7547-f4b2-4af0-be24-a4c628408c16 => generated 1317 bytes in 1569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:07:00.670033 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9c17c222-856b-492b-8abc-362369a0516b tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:07:00.672273 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-9c17c222-856b-492b-8abc-362369a0516b tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:07:00.699187 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9c17c222-856b-492b-8abc-362369a0516b tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:00.699679 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9c17c222-856b-492b-8abc-362369a0516b tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:00.704349 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9c17c222-856b-492b-8abc-362369a0516b tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:00.706217 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9c17c222-856b-492b-8abc-362369a0516b tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:00.821755 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c0393ca0-b33a-4a3b-af8d-7ba4faf9f57f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:07:00.822972 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c0393ca0-b33a-4a3b-af8d-7ba4faf9f57f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:07:00.847589 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c0393ca0-b33a-4a3b-af8d-7ba4faf9f57f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:00.849489 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c0393ca0-b33a-4a3b-af8d-7ba4faf9f57f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:00.854182 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c0393ca0-b33a-4a3b-af8d-7ba4faf9f57f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:00.856281 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c0393ca0-b33a-4a3b-af8d-7ba4faf9f57f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:00.976252 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c0393ca0-b33a-4a3b-af8d-7ba4faf9f57f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.160089 Jan 15 21:07:00.981337 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2796/5590] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:07:00 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:07:01.095548 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-54b567af-9aab-4c92-b034-ff995b3f3ce0 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:07:01.096478 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-54b567af-9aab-4c92-b034-ff995b3f3ce0 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] [instance: 552b7547-f4b2-4af0-be24-a4c628408c16] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:07:01.118253 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-54b567af-9aab-4c92-b034-ff995b3f3ce0 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:01.121834 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-54b567af-9aab-4c92-b034-ff995b3f3ce0 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:01.123157 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-54b567af-9aab-4c92-b034-ff995b3f3ce0 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:01.123597 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-54b567af-9aab-4c92-b034-ff995b3f3ce0 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:01.310251 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-9c17c222-856b-492b-8abc-362369a0516b tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:07:01.324438 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-9c17c222-856b-492b-8abc-362369a0516b tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:07:01.326286 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-9c17c222-856b-492b-8abc-362369a0516b tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:07:01.339767 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-9c17c222-856b-492b-8abc-362369a0516b tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42" status: 200 len: 1729 microversion: 2.20 time: 0.674675 Jan 15 21:07:01.340584 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2795/5591] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:07:00 2022] GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42 => generated 1729 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:07:01.580312 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-54b567af-9aab-4c92-b034-ff995b3f3ce0 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822f4a2b1fd6459a8a472bdd066d69fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e03e1de077453588cc783a4e6d690e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:07:01.598596 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-54b567af-9aab-4c92-b034-ff995b3f3ce0 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] 10.222.0.46 "GET /compute/v2.1/servers/552b7547-f4b2-4af0-be24-a4c628408c16" status: 200 len: 1317 microversion: 2.1 time: 0.510783 Jan 15 21:07:01.600320 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2797/5592] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:07:01 2022] GET /compute/v2.1/servers/552b7547-f4b2-4af0-be24-a4c628408c16 => generated 1317 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:07:01.997548 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-58584299-6e9c-4e0e-b26a-542fd9528523 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:07:01.999914 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-58584299-6e9c-4e0e-b26a-542fd9528523 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:07:02.013687 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-58584299-6e9c-4e0e-b26a-542fd9528523 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:02.014484 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-58584299-6e9c-4e0e-b26a-542fd9528523 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:02.015487 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-58584299-6e9c-4e0e-b26a-542fd9528523 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:02.016107 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-58584299-6e9c-4e0e-b26a-542fd9528523 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:02.366971 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-3c148610-e7f6-4527-992f-cf71d855ca02 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:07:02.368695 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-3c148610-e7f6-4527-992f-cf71d855ca02 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:07:02.384186 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3c148610-e7f6-4527-992f-cf71d855ca02 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:02.384642 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3c148610-e7f6-4527-992f-cf71d855ca02 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:02.385464 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3c148610-e7f6-4527-992f-cf71d855ca02 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:02.386169 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3c148610-e7f6-4527-992f-cf71d855ca02 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:02.522915 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-58584299-6e9c-4e0e-b26a-542fd9528523 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.534955 Jan 15 21:07:02.524928 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2796/5593] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:07:01 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:07:02.563107 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-3c148610-e7f6-4527-992f-cf71d855ca02 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:07:02.573088 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-3c148610-e7f6-4527-992f-cf71d855ca02 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:07:02.575909 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-3c148610-e7f6-4527-992f-cf71d855ca02 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:07:02.577068 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-3c148610-e7f6-4527-992f-cf71d855ca02 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42" status: 200 len: 1729 microversion: 2.20 time: 0.217857 Jan 15 21:07:02.577711 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2798/5594] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:07:02 2022] GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42 => generated 1729 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:07:02.620024 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5316482c-9f1e-4225-bfbb-b9c9a6919e01 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:07:02.620799 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-5316482c-9f1e-4225-bfbb-b9c9a6919e01 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] [instance: 552b7547-f4b2-4af0-be24-a4c628408c16] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:07:02.628100 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5316482c-9f1e-4225-bfbb-b9c9a6919e01 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:02.628637 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5316482c-9f1e-4225-bfbb-b9c9a6919e01 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:02.629510 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5316482c-9f1e-4225-bfbb-b9c9a6919e01 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:02.630046 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5316482c-9f1e-4225-bfbb-b9c9a6919e01 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:02.768905 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-5316482c-9f1e-4225-bfbb-b9c9a6919e01 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822f4a2b1fd6459a8a472bdd066d69fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e03e1de077453588cc783a4e6d690e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:07:02.776721 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5316482c-9f1e-4225-bfbb-b9c9a6919e01 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] 10.222.0.46 "GET /compute/v2.1/servers/552b7547-f4b2-4af0-be24-a4c628408c16" status: 200 len: 1317 microversion: 2.1 time: 0.161976 Jan 15 21:07:02.777331 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2797/5595] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:07:02 2022] GET /compute/v2.1/servers/552b7547-f4b2-4af0-be24-a4c628408c16 => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:07:03.221949 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-67ae4b15-b766-44f9-8e06-8d331b4bcef1 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:07:03.222869 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-67ae4b15-b766-44f9-8e06-8d331b4bcef1 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: d9db70df-9ffc-4b96-af06-a56b3b35ce91] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:07:03.229997 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-67ae4b15-b766-44f9-8e06-8d331b4bcef1 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:03.230775 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-67ae4b15-b766-44f9-8e06-8d331b4bcef1 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:03.231237 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-67ae4b15-b766-44f9-8e06-8d331b4bcef1 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:03.231679 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-67ae4b15-b766-44f9-8e06-8d331b4bcef1 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:03.263362 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-67ae4b15-b766-44f9-8e06-8d331b4bcef1 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "GET /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045339 Jan 15 21:07:03.264120 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2799/5596] 10.222.0.46 () {58 vars in 1301 bytes} [Sat Jan 15 21:07:03 2022] GET /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:07:03.486941 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2aecbad6-365c-4213-adb9-090bf6dd1433 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:07:03.487431 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-2aecbad6-365c-4213-adb9-090bf6dd1433 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: d9db70df-9ffc-4b96-af06-a56b3b35ce91] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:07:03.496311 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2aecbad6-365c-4213-adb9-090bf6dd1433 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:03.497012 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2aecbad6-365c-4213-adb9-090bf6dd1433 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:03.497837 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2aecbad6-365c-4213-adb9-090bf6dd1433 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:03.498331 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2aecbad6-365c-4213-adb9-090bf6dd1433 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:03.529467 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2aecbad6-365c-4213-adb9-090bf6dd1433 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "GET /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/os-volume_attachments/39a9f446-bda4-412e-b835-f0b04d414fed" status: 200 len: 194 microversion: 2.1 time: 0.046413 Jan 15 21:07:03.537676 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2798/5597] 10.222.0.46 () {58 vars in 1412 bytes} [Sat Jan 15 21:07:03 2022] GET /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/os-volume_attachments/39a9f446-bda4-412e-b835-f0b04d414fed => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:07:03.540681 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b2d0d890-25f6-451e-b75c-589ff7be055d tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:07:03.543098 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b2d0d890-25f6-451e-b75c-589ff7be055d tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:07:03.544278 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ab008a09-c90c-40cb-bb27-a0594b3f56bd tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:07:03.545111 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ab008a09-c90c-40cb-bb27-a0594b3f56bd tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: d9db70df-9ffc-4b96-af06-a56b3b35ce91] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:07:03.550420 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b2d0d890-25f6-451e-b75c-589ff7be055d tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:03.551107 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b2d0d890-25f6-451e-b75c-589ff7be055d tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:03.552072 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b2d0d890-25f6-451e-b75c-589ff7be055d tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:03.553563 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b2d0d890-25f6-451e-b75c-589ff7be055d tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:03.553754 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ab008a09-c90c-40cb-bb27-a0594b3f56bd tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:03.554235 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ab008a09-c90c-40cb-bb27-a0594b3f56bd tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:03.562077 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ab008a09-c90c-40cb-bb27-a0594b3f56bd tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:03.562077 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ab008a09-c90c-40cb-bb27-a0594b3f56bd tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:03.607028 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b2d0d890-25f6-451e-b75c-589ff7be055d tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.075389 Jan 15 21:07:03.608063 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2800/5598] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:07:03 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:07:03.613027 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-fbb91d71-478b-4a61-a9a5-711151ce37b4 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:07:03.613726 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-fbb91d71-478b-4a61-a9a5-711151ce37b4 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:07:03.621794 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fbb91d71-478b-4a61-a9a5-711151ce37b4 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:03.622069 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fbb91d71-478b-4a61-a9a5-711151ce37b4 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:03.623060 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fbb91d71-478b-4a61-a9a5-711151ce37b4 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:03.623681 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fbb91d71-478b-4a61-a9a5-711151ce37b4 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:03.669257 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.objects.instance [None req-ab008a09-c90c-40cb-bb27-a0594b3f56bd tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lazy-loading 'services' on Instance uuid d9db70df-9ffc-4b96-af06-a56b3b35ce91 {{(pid=129365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 21:07:03.764300 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ab008a09-c90c-40cb-bb27-a0594b3f56bd tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "DELETE /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/os-volume_attachments/39a9f446-bda4-412e-b835-f0b04d414fed" status: 202 len: 0 microversion: 2.1 time: 0.224891 Jan 15 21:07:03.769741 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2799/5599] 10.222.0.46 () {58 vars in 1415 bytes} [Sat Jan 15 21:07:03 2022] DELETE /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/os-volume_attachments/39a9f446-bda4-412e-b835-f0b04d414fed => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:07:03.798321 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-7afb7b6c-9c62-4f6b-ab04-7a1815902195 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:07:03.810214 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-7afb7b6c-9c62-4f6b-ab04-7a1815902195 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] [instance: 552b7547-f4b2-4af0-be24-a4c628408c16] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:07:03.830255 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7afb7b6c-9c62-4f6b-ab04-7a1815902195 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:03.830778 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7afb7b6c-9c62-4f6b-ab04-7a1815902195 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:03.831688 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7afb7b6c-9c62-4f6b-ab04-7a1815902195 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:03.832201 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7afb7b6c-9c62-4f6b-ab04-7a1815902195 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:03.837511 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-fbb91d71-478b-4a61-a9a5-711151ce37b4 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:07:03.846991 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-fbb91d71-478b-4a61-a9a5-711151ce37b4 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:07:03.854446 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-fbb91d71-478b-4a61-a9a5-711151ce37b4 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:07:03.856389 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-fbb91d71-478b-4a61-a9a5-711151ce37b4 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42" status: 200 len: 1729 microversion: 2.20 time: 0.247226 Jan 15 21:07:03.857370 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2801/5600] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:07:03 2022] GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42 => generated 1729 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:07:04.028135 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-7afb7b6c-9c62-4f6b-ab04-7a1815902195 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822f4a2b1fd6459a8a472bdd066d69fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e03e1de077453588cc783a4e6d690e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:07:04.036690 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-7afb7b6c-9c62-4f6b-ab04-7a1815902195 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] 10.222.0.46 "GET /compute/v2.1/servers/552b7547-f4b2-4af0-be24-a4c628408c16" status: 200 len: 1317 microversion: 2.1 time: 0.245580 Jan 15 21:07:04.038442 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2800/5601] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:07:03 2022] GET /compute/v2.1/servers/552b7547-f4b2-4af0-be24-a4c628408c16 => generated 1317 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:07:04.618567 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-986fd3d3-6b8f-409e-8c63-58fde4fd6437 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:07:04.620160 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-986fd3d3-6b8f-409e-8c63-58fde4fd6437 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:07:04.628899 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-986fd3d3-6b8f-409e-8c63-58fde4fd6437 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:04.629650 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-986fd3d3-6b8f-409e-8c63-58fde4fd6437 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:04.630433 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-986fd3d3-6b8f-409e-8c63-58fde4fd6437 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:04.631750 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-986fd3d3-6b8f-409e-8c63-58fde4fd6437 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:04.679811 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-986fd3d3-6b8f-409e-8c63-58fde4fd6437 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.065149 Jan 15 21:07:04.680553 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2802/5602] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:07:04 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:07:04.875661 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3cc7f663-7823-4cde-9460-04eada56cadd tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:07:04.876609 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-3cc7f663-7823-4cde-9460-04eada56cadd tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:07:04.880915 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-957e8d13-f34e-4e80-9849-a94c69aab6f3 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:07:04.882979 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-957e8d13-f34e-4e80-9849-a94c69aab6f3 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: d9db70df-9ffc-4b96-af06-a56b3b35ce91] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:07:04.884380 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3cc7f663-7823-4cde-9460-04eada56cadd tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:04.884852 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3cc7f663-7823-4cde-9460-04eada56cadd tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:04.886070 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3cc7f663-7823-4cde-9460-04eada56cadd tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:04.886481 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3cc7f663-7823-4cde-9460-04eada56cadd tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:04.889740 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-957e8d13-f34e-4e80-9849-a94c69aab6f3 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:04.890449 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-957e8d13-f34e-4e80-9849-a94c69aab6f3 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:04.891317 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-957e8d13-f34e-4e80-9849-a94c69aab6f3 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:04.891828 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-957e8d13-f34e-4e80-9849-a94c69aab6f3 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:04.923653 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-957e8d13-f34e-4e80-9849-a94c69aab6f3 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "GET /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/os-volume_attachments/b0f1d6d3-c0f9-4a5b-9db5-67840615d22f" status: 200 len: 194 microversion: 2.1 time: 0.047655 Jan 15 21:07:04.930148 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2803/5603] 10.222.0.46 () {58 vars in 1412 bytes} [Sat Jan 15 21:07:04 2022] GET /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/os-volume_attachments/b0f1d6d3-c0f9-4a5b-9db5-67840615d22f => generated 194 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 21:07:04.937764 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0e18055e-88dd-46ee-a31e-feaa8b9a0714 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:07:04.938584 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-0e18055e-88dd-46ee-a31e-feaa8b9a0714 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: d9db70df-9ffc-4b96-af06-a56b3b35ce91] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:07:04.946225 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0e18055e-88dd-46ee-a31e-feaa8b9a0714 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:04.946769 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0e18055e-88dd-46ee-a31e-feaa8b9a0714 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:04.947629 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0e18055e-88dd-46ee-a31e-feaa8b9a0714 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:04.948140 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0e18055e-88dd-46ee-a31e-feaa8b9a0714 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:05.051176 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-3cc7f663-7823-4cde-9460-04eada56cadd tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:07:05.065292 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-3cc7f663-7823-4cde-9460-04eada56cadd tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:07:05.066866 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-3cc7f663-7823-4cde-9460-04eada56cadd tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:07:05.076476 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.objects.instance [None req-0e18055e-88dd-46ee-a31e-feaa8b9a0714 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lazy-loading 'services' on Instance uuid d9db70df-9ffc-4b96-af06-a56b3b35ce91 {{(pid=129366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 21:07:05.080949 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3cc7f663-7823-4cde-9460-04eada56cadd tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42" status: 200 len: 1729 microversion: 2.20 time: 0.196216 Jan 15 21:07:05.081621 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2801/5604] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:07:04 2022] GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42 => generated 1729 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:07:05.092798 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8c3d389a-1c65-4cce-aa92-9e82d590a647 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:07:05.093640 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-8c3d389a-1c65-4cce-aa92-9e82d590a647 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] [instance: 552b7547-f4b2-4af0-be24-a4c628408c16] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:07:05.103534 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8c3d389a-1c65-4cce-aa92-9e82d590a647 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:05.103984 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8c3d389a-1c65-4cce-aa92-9e82d590a647 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:05.105709 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8c3d389a-1c65-4cce-aa92-9e82d590a647 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:05.106145 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8c3d389a-1c65-4cce-aa92-9e82d590a647 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:05.183369 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0e18055e-88dd-46ee-a31e-feaa8b9a0714 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "DELETE /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/os-volume_attachments/b0f1d6d3-c0f9-4a5b-9db5-67840615d22f" status: 202 len: 0 microversion: 2.1 time: 0.249107 Jan 15 21:07:05.188593 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2804/5605] 10.222.0.46 () {58 vars in 1415 bytes} [Sat Jan 15 21:07:04 2022] DELETE /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/os-volume_attachments/b0f1d6d3-c0f9-4a5b-9db5-67840615d22f => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:07:05.395734 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-8c3d389a-1c65-4cce-aa92-9e82d590a647 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822f4a2b1fd6459a8a472bdd066d69fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e03e1de077453588cc783a4e6d690e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:07:05.406942 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-8c3d389a-1c65-4cce-aa92-9e82d590a647 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] 10.222.0.46 "GET /compute/v2.1/servers/552b7547-f4b2-4af0-be24-a4c628408c16" status: 200 len: 1317 microversion: 2.1 time: 0.317641 Jan 15 21:07:05.407669 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2802/5606] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:07:05 2022] GET /compute/v2.1/servers/552b7547-f4b2-4af0-be24-a4c628408c16 => generated 1317 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:07:05.694841 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-72ef366c-ca2b-4c05-ad01-560adfd4ea90 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:07:05.696378 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-72ef366c-ca2b-4c05-ad01-560adfd4ea90 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:07:05.705808 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-72ef366c-ca2b-4c05-ad01-560adfd4ea90 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:05.706430 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-72ef366c-ca2b-4c05-ad01-560adfd4ea90 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:05.707427 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-72ef366c-ca2b-4c05-ad01-560adfd4ea90 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:05.707859 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-72ef366c-ca2b-4c05-ad01-560adfd4ea90 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:05.758648 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-72ef366c-ca2b-4c05-ad01-560adfd4ea90 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action" status: 200 len: 40718 microversion: 2.32 time: 0.069760 Jan 15 21:07:05.759357 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2805/5607] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:07:05 2022] POST /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/action => generated 40718 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:07:05.769886 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-439bb24f-9112-499b-9eb3-385091eff4e1 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:07:05.770592 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-439bb24f-9112-499b-9eb3-385091eff4e1 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:07:05.777566 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-439bb24f-9112-499b-9eb3-385091eff4e1 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:05.778095 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-439bb24f-9112-499b-9eb3-385091eff4e1 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:05.778960 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-439bb24f-9112-499b-9eb3-385091eff4e1 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:05.779390 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-439bb24f-9112-499b-9eb3-385091eff4e1 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:06.011306 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-439bb24f-9112-499b-9eb3-385091eff4e1 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:07:06.025750 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-439bb24f-9112-499b-9eb3-385091eff4e1 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:07:06.027449 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-439bb24f-9112-499b-9eb3-385091eff4e1 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:07:06.034013 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-439bb24f-9112-499b-9eb3-385091eff4e1 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "GET /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220" status: 200 len: 2953 microversion: 2.32 time: 0.262931 Jan 15 21:07:06.035814 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2803/5608] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:07:05 2022] GET /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220 => generated 2953 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 15 21:07:06.066924 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-617905b2-01f4-439a-8fbe-26a1bb826d8f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:07:06.067903 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-617905b2-01f4-439a-8fbe-26a1bb826d8f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:07:06.075329 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-617905b2-01f4-439a-8fbe-26a1bb826d8f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:06.075780 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-617905b2-01f4-439a-8fbe-26a1bb826d8f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:06.076564 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-617905b2-01f4-439a-8fbe-26a1bb826d8f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:06.077022 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-617905b2-01f4-439a-8fbe-26a1bb826d8f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:06.100975 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-df3d2f11-f680-41ed-824e-441b7f22e780 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:07:06.101852 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-df3d2f11-f680-41ed-824e-441b7f22e780 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:07:06.108309 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-df3d2f11-f680-41ed-824e-441b7f22e780 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:06.109088 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-df3d2f11-f680-41ed-824e-441b7f22e780 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:06.109879 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-df3d2f11-f680-41ed-824e-441b7f22e780 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:06.110315 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-df3d2f11-f680-41ed-824e-441b7f22e780 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:06.245763 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-617905b2-01f4-439a-8fbe-26a1bb826d8f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "GET /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/os-interface" status: 200 len: 1833 microversion: 2.32 time: 0.182884 Jan 15 21:07:06.246444 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2806/5609] 10.222.0.46 () {60 vars in 1315 bytes} [Sat Jan 15 21:07:06 2022] GET /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220/os-interface => generated 1833 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:07:06.330251 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-df3d2f11-f680-41ed-824e-441b7f22e780 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:07:06.340521 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-df3d2f11-f680-41ed-824e-441b7f22e780 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:07:06.342153 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-df3d2f11-f680-41ed-824e-441b7f22e780 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:07:06.343545 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-df3d2f11-f680-41ed-824e-441b7f22e780 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42" status: 200 len: 1729 microversion: 2.20 time: 0.246753 Jan 15 21:07:06.344257 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2804/5610] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:07:06 2022] GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42 => generated 1729 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:07:06.376683 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-385508e5-708c-4299-bb54-fd95ef72fd0a tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:07:06.378290 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-385508e5-708c-4299-bb54-fd95ef72fd0a tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: d9db70df-9ffc-4b96-af06-a56b3b35ce91] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:07:06.387678 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-385508e5-708c-4299-bb54-fd95ef72fd0a tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:06.388305 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-385508e5-708c-4299-bb54-fd95ef72fd0a tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:06.389301 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-385508e5-708c-4299-bb54-fd95ef72fd0a tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:06.390000 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-385508e5-708c-4299-bb54-fd95ef72fd0a tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:06.426523 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-00921c26-e32a-4d96-b268-1a3b1b5d493c tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:07:06.427320 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-00921c26-e32a-4d96-b268-1a3b1b5d493c tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] [instance: 552b7547-f4b2-4af0-be24-a4c628408c16] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:07:06.439667 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-00921c26-e32a-4d96-b268-1a3b1b5d493c tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:06.440685 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-00921c26-e32a-4d96-b268-1a3b1b5d493c tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:06.441846 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-00921c26-e32a-4d96-b268-1a3b1b5d493c tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:06.442497 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-00921c26-e32a-4d96-b268-1a3b1b5d493c tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:06.449947 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-385508e5-708c-4299-bb54-fd95ef72fd0a tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "GET /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.077766 Jan 15 21:07:06.451561 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2807/5611] 10.222.0.46 () {58 vars in 1301 bytes} [Sat Jan 15 21:07:06 2022] GET /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/os-volume_attachments => generated 25 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 15 21:07:06.614483 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-72357660-491d-4b51-b479-1104753ba407 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:07:06.615450 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-72357660-491d-4b51-b479-1104753ba407 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: d9db70df-9ffc-4b96-af06-a56b3b35ce91] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:07:06.624057 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-72357660-491d-4b51-b479-1104753ba407 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:06.624518 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-72357660-491d-4b51-b479-1104753ba407 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:06.625748 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-72357660-491d-4b51-b479-1104753ba407 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:06.626255 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-72357660-491d-4b51-b479-1104753ba407 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:06.683592 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-00921c26-e32a-4d96-b268-1a3b1b5d493c tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822f4a2b1fd6459a8a472bdd066d69fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e03e1de077453588cc783a4e6d690e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:07:06.699075 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-00921c26-e32a-4d96-b268-1a3b1b5d493c tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] 10.222.0.46 "GET /compute/v2.1/servers/552b7547-f4b2-4af0-be24-a4c628408c16" status: 200 len: 1317 microversion: 2.1 time: 0.276560 Jan 15 21:07:06.699224 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-72357660-491d-4b51-b479-1104753ba407 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "GET /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.093662 Jan 15 21:07:06.700144 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2808/5613] 10.222.0.46 () {58 vars in 1301 bytes} [Sat Jan 15 21:07:06 2022] GET /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91/os-volume_attachments => generated 25 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 21:07:06.704576 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2805/5613] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:07:06 2022] GET /compute/v2.1/servers/552b7547-f4b2-4af0-be24-a4c628408c16 => generated 1317 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:07:06.775576 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9454a1ca-896a-403d-b887-3d435b49b087 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:07:06.776214 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-9454a1ca-896a-403d-b887-3d435b49b087 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: d9db70df-9ffc-4b96-af06-a56b3b35ce91] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:07:06.783794 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9454a1ca-896a-403d-b887-3d435b49b087 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:06.784332 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9454a1ca-896a-403d-b887-3d435b49b087 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:06.785273 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9454a1ca-896a-403d-b887-3d435b49b087 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:06.785719 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9454a1ca-896a-403d-b887-3d435b49b087 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:06.828114 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-9454a1ca-896a-403d-b887-3d435b49b087 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: d9db70df-9ffc-4b96-af06-a56b3b35ce91] Going to try to terminate instance {{(pid=129366) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 21:07:06.962662 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-9454a1ca-896a-403d-b887-3d435b49b087 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "DELETE /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91" status: 204 len: 0 microversion: 2.1 time: 0.191092 Jan 15 21:07:06.964381 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2809/5614] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 21:07:06 2022] DELETE /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 21:07:06.975326 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5492e979-b8a7-4847-9730-1c859c462011 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:07:06.976357 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-5492e979-b8a7-4847-9730-1c859c462011 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: d9db70df-9ffc-4b96-af06-a56b3b35ce91] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:07:06.983652 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5492e979-b8a7-4847-9730-1c859c462011 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:06.984108 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5492e979-b8a7-4847-9730-1c859c462011 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:06.984997 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5492e979-b8a7-4847-9730-1c859c462011 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:06.986078 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5492e979-b8a7-4847-9730-1c859c462011 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:07.363943 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-6d32d3e2-434f-4ca1-ae6e-b2223378236f tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:07:07.364961 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-6d32d3e2-434f-4ca1-ae6e-b2223378236f tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:07:07.369316 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-5492e979-b8a7-4847-9730-1c859c462011 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6097506a2d4e36818310d9d70bf01b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4dad65fccfe481a973f5fcbb9287dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:07:07.385393 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6d32d3e2-434f-4ca1-ae6e-b2223378236f tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:07.386517 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5492e979-b8a7-4847-9730-1c859c462011 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "GET /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91" status: 200 len: 1674 microversion: 2.1 time: 0.416115 Jan 15 21:07:07.387800 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2806/5615] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:07:06 2022] GET /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91 => generated 1674 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:07:07.388569 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6d32d3e2-434f-4ca1-ae6e-b2223378236f tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:07.389411 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6d32d3e2-434f-4ca1-ae6e-b2223378236f tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:07.390012 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6d32d3e2-434f-4ca1-ae6e-b2223378236f tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:07.611222 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-6d32d3e2-434f-4ca1-ae6e-b2223378236f tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:07:07.620236 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-6d32d3e2-434f-4ca1-ae6e-b2223378236f tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:07:07.621989 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-6d32d3e2-434f-4ca1-ae6e-b2223378236f tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:07:07.622948 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-6d32d3e2-434f-4ca1-ae6e-b2223378236f tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42" status: 200 len: 1729 microversion: 2.20 time: 0.264222 Jan 15 21:07:07.623845 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2810/5616] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:07:07 2022] GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42 => generated 1729 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 15 21:07:07.720194 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2350c115-4f5b-4f1b-adf9-7608e8ed6cd0 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:07:07.729095 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-2350c115-4f5b-4f1b-adf9-7608e8ed6cd0 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] [instance: 552b7547-f4b2-4af0-be24-a4c628408c16] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:07:07.732241 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2350c115-4f5b-4f1b-adf9-7608e8ed6cd0 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:07.732832 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2350c115-4f5b-4f1b-adf9-7608e8ed6cd0 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:07.734192 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2350c115-4f5b-4f1b-adf9-7608e8ed6cd0 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:07.734723 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2350c115-4f5b-4f1b-adf9-7608e8ed6cd0 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:07.960140 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-2350c115-4f5b-4f1b-adf9-7608e8ed6cd0 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822f4a2b1fd6459a8a472bdd066d69fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e03e1de077453588cc783a4e6d690e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:07:07.985198 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2350c115-4f5b-4f1b-adf9-7608e8ed6cd0 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] 10.222.0.46 "GET /compute/v2.1/servers/552b7547-f4b2-4af0-be24-a4c628408c16" status: 200 len: 1317 microversion: 2.1 time: 0.271300 Jan 15 21:07:07.988919 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2807/5617] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:07:07 2022] GET /compute/v2.1/servers/552b7547-f4b2-4af0-be24-a4c628408c16 => generated 1317 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:07:08.405348 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-65dfe834-deb5-47d2-8f83-f196ef0e335b tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:07:08.406675 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-65dfe834-deb5-47d2-8f83-f196ef0e335b tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: d9db70df-9ffc-4b96-af06-a56b3b35ce91] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:07:08.418127 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-65dfe834-deb5-47d2-8f83-f196ef0e335b tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:08.418582 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-65dfe834-deb5-47d2-8f83-f196ef0e335b tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:08.419550 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-65dfe834-deb5-47d2-8f83-f196ef0e335b tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:08.420162 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-65dfe834-deb5-47d2-8f83-f196ef0e335b tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:08.628668 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-65dfe834-deb5-47d2-8f83-f196ef0e335b tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6097506a2d4e36818310d9d70bf01b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4dad65fccfe481a973f5fcbb9287dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:07:08.636270 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-65dfe834-deb5-47d2-8f83-f196ef0e335b tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "GET /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91" status: 200 len: 1674 microversion: 2.1 time: 0.235109 Jan 15 21:07:08.637419 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2811/5618] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:07:08 2022] GET /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91 => generated 1674 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:07:08.642443 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-75cefb4b-1aad-4c8f-ab91-e6c9ba6be2d9 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:07:08.643200 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-75cefb4b-1aad-4c8f-ab91-e6c9ba6be2d9 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:07:08.650233 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-75cefb4b-1aad-4c8f-ab91-e6c9ba6be2d9 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:08.650691 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-75cefb4b-1aad-4c8f-ab91-e6c9ba6be2d9 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:08.651488 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-75cefb4b-1aad-4c8f-ab91-e6c9ba6be2d9 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:08.651930 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-75cefb4b-1aad-4c8f-ab91-e6c9ba6be2d9 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:08.827099 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-75cefb4b-1aad-4c8f-ab91-e6c9ba6be2d9 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:07:08.838106 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-75cefb4b-1aad-4c8f-ab91-e6c9ba6be2d9 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:07:08.840199 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-75cefb4b-1aad-4c8f-ab91-e6c9ba6be2d9 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:07:08.841848 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-75cefb4b-1aad-4c8f-ab91-e6c9ba6be2d9 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42" status: 200 len: 1729 microversion: 2.20 time: 0.203264 Jan 15 21:07:08.842732 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2808/5619] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:07:08 2022] GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42 => generated 1729 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 15 21:07:09.002725 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f9cdee75-ca09-4f2f-9716-03baf323ea58 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:07:09.003336 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f9cdee75-ca09-4f2f-9716-03baf323ea58 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] [instance: 552b7547-f4b2-4af0-be24-a4c628408c16] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:07:09.009982 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f9cdee75-ca09-4f2f-9716-03baf323ea58 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:09.010436 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f9cdee75-ca09-4f2f-9716-03baf323ea58 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:09.011218 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f9cdee75-ca09-4f2f-9716-03baf323ea58 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:09.011654 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f9cdee75-ca09-4f2f-9716-03baf323ea58 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:09.166591 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-f9cdee75-ca09-4f2f-9716-03baf323ea58 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822f4a2b1fd6459a8a472bdd066d69fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e03e1de077453588cc783a4e6d690e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:07:09.182536 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f9cdee75-ca09-4f2f-9716-03baf323ea58 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] 10.222.0.46 "GET /compute/v2.1/servers/552b7547-f4b2-4af0-be24-a4c628408c16" status: 200 len: 1317 microversion: 2.1 time: 0.183648 Jan 15 21:07:09.183350 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2812/5620] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:07:08 2022] GET /compute/v2.1/servers/552b7547-f4b2-4af0-be24-a4c628408c16 => generated 1317 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:07:09.656523 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-12dc3f28-009a-4949-b8ab-4a14e3e8ed54 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:07:09.658144 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-12dc3f28-009a-4949-b8ab-4a14e3e8ed54 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: d9db70df-9ffc-4b96-af06-a56b3b35ce91] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:07:09.678614 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-12dc3f28-009a-4949-b8ab-4a14e3e8ed54 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:09.680293 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-12dc3f28-009a-4949-b8ab-4a14e3e8ed54 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:09.681968 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-12dc3f28-009a-4949-b8ab-4a14e3e8ed54 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:09.683333 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-12dc3f28-009a-4949-b8ab-4a14e3e8ed54 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:09.859524 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ea277332-13c5-4ad3-b9ef-9e90d003b3bc tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:07:09.860134 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ea277332-13c5-4ad3-b9ef-9e90d003b3bc tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:07:09.872724 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ea277332-13c5-4ad3-b9ef-9e90d003b3bc tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:09.873245 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ea277332-13c5-4ad3-b9ef-9e90d003b3bc tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:09.874130 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ea277332-13c5-4ad3-b9ef-9e90d003b3bc tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:09.874626 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ea277332-13c5-4ad3-b9ef-9e90d003b3bc tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:09.918398 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-12dc3f28-009a-4949-b8ab-4a14e3e8ed54 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6097506a2d4e36818310d9d70bf01b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4dad65fccfe481a973f5fcbb9287dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:07:09.930026 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-12dc3f28-009a-4949-b8ab-4a14e3e8ed54 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "GET /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91" status: 200 len: 1674 microversion: 2.1 time: 0.279748 Jan 15 21:07:09.932660 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2809/5621] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:07:09 2022] GET /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91 => generated 1674 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:07:10.100777 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-ea277332-13c5-4ad3-b9ef-9e90d003b3bc tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:07:10.111713 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-ea277332-13c5-4ad3-b9ef-9e90d003b3bc tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:07:10.114833 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-ea277332-13c5-4ad3-b9ef-9e90d003b3bc tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:07:10.116596 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ea277332-13c5-4ad3-b9ef-9e90d003b3bc tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42" status: 200 len: 1729 microversion: 2.20 time: 0.260678 Jan 15 21:07:10.127258 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2813/5622] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:07:09 2022] GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42 => generated 1729 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 15 21:07:10.201999 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-7d847290-d70a-4279-a729-728e801f7bea tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:07:10.202722 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-7d847290-d70a-4279-a729-728e801f7bea tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] [instance: 552b7547-f4b2-4af0-be24-a4c628408c16] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:07:10.216583 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7d847290-d70a-4279-a729-728e801f7bea tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:10.219689 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7d847290-d70a-4279-a729-728e801f7bea tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:10.222036 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7d847290-d70a-4279-a729-728e801f7bea tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:10.224393 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7d847290-d70a-4279-a729-728e801f7bea tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:10.346611 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-28cdea59-96e3-488d-b80f-5b4918b7c336 req-1c9fad32-68a3-4a71-975e-3d2b8f967a44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9db70df-9ffc-4b96-af06-a56b3b35ce91", "name": "network-vif-deleted", "tag": "19fc242c-c091-4b78-8fec-c33b6bd5cc60"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:07:10.348407 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:07:10.348407 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:07:10.368624 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-28cdea59-96e3-488d-b80f-5b4918b7c336 req-1c9fad32-68a3-4a71-975e-3d2b8f967a44 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:10.369327 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-28cdea59-96e3-488d-b80f-5b4918b7c336 req-1c9fad32-68a3-4a71-975e-3d2b8f967a44 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:10.420277 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-28cdea59-96e3-488d-b80f-5b4918b7c336 req-1c9fad32-68a3-4a71-975e-3d2b8f967a44 service nova] Creating event network-vif-deleted:19fc242c-c091-4b78-8fec-c33b6bd5cc60 for instance d9db70df-9ffc-4b96-af06-a56b3b35ce91 on nch2-master-1 Jan 15 21:07:10.430135 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-28cdea59-96e3-488d-b80f-5b4918b7c336 req-1c9fad32-68a3-4a71-975e-3d2b8f967a44 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087187 Jan 15 21:07:10.433252 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2814/5623] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:07:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 21:07:10.760270 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-7d847290-d70a-4279-a729-728e801f7bea tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822f4a2b1fd6459a8a472bdd066d69fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e03e1de077453588cc783a4e6d690e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:07:10.771396 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-7d847290-d70a-4279-a729-728e801f7bea tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] 10.222.0.46 "GET /compute/v2.1/servers/552b7547-f4b2-4af0-be24-a4c628408c16" status: 200 len: 1317 microversion: 2.1 time: 0.573764 Jan 15 21:07:10.773145 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2810/5624] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:07:10 2022] GET /compute/v2.1/servers/552b7547-f4b2-4af0-be24-a4c628408c16 => generated 1317 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:07:10.790412 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-8107baaa-caa9-4775-8b54-3afc69283084 req-8cf15107-c420-43b4-ae16-f7845502ebcb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "552b7547-f4b2-4af0-be24-a4c628408c16", "name": "network-vif-plugged", "status": "completed", "tag": "490d413f-9553-4a39-a6eb-6d61aef04f25"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:07:10.799393 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:07:10.799393 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:07:10.824393 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-8107baaa-caa9-4775-8b54-3afc69283084 req-8cf15107-c420-43b4-ae16-f7845502ebcb service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:10.825257 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-8107baaa-caa9-4775-8b54-3afc69283084 req-8cf15107-c420-43b4-ae16-f7845502ebcb service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:10.866665 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-8107baaa-caa9-4775-8b54-3afc69283084 req-8cf15107-c420-43b4-ae16-f7845502ebcb service nova] Creating event network-vif-plugged:490d413f-9553-4a39-a6eb-6d61aef04f25 for instance 552b7547-f4b2-4af0-be24-a4c628408c16 on nch1-master-1 Jan 15 21:07:10.877354 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-8107baaa-caa9-4775-8b54-3afc69283084 req-8cf15107-c420-43b4-ae16-f7845502ebcb service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094049 Jan 15 21:07:10.883515 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2815/5625] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:07:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:07:10.951997 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9ac098a2-4036-40b9-908a-2e51a611fa49 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:07:10.953148 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-9ac098a2-4036-40b9-908a-2e51a611fa49 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: d9db70df-9ffc-4b96-af06-a56b3b35ce91] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:07:10.970933 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9ac098a2-4036-40b9-908a-2e51a611fa49 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:10.973769 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9ac098a2-4036-40b9-908a-2e51a611fa49 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:10.974887 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9ac098a2-4036-40b9-908a-2e51a611fa49 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:10.978313 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9ac098a2-4036-40b9-908a-2e51a611fa49 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:11.066383 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9ac098a2-4036-40b9-908a-2e51a611fa49 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:11.066899 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9ac098a2-4036-40b9-908a-2e51a611fa49 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:11.067404 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.objects.instance [None req-9ac098a2-4036-40b9-908a-2e51a611fa49 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lazy-loading 'fault' on Instance uuid d9db70df-9ffc-4b96-af06-a56b3b35ce91 {{(pid=129365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 21:07:11.139167 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-5416f6f9-10f4-41fb-9169-f988177a5ac9 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:07:11.140685 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-5416f6f9-10f4-41fb-9169-f988177a5ac9 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:07:11.157078 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5416f6f9-10f4-41fb-9169-f988177a5ac9 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:11.162337 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5416f6f9-10f4-41fb-9169-f988177a5ac9 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:11.163877 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5416f6f9-10f4-41fb-9169-f988177a5ac9 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:11.164504 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5416f6f9-10f4-41fb-9169-f988177a5ac9 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:11.171516 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-9ac098a2-4036-40b9-908a-2e51a611fa49 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6097506a2d4e36818310d9d70bf01b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4dad65fccfe481a973f5fcbb9287dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:07:11.184324 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-9ac098a2-4036-40b9-908a-2e51a611fa49 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "GET /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91" status: 200 len: 1326 microversion: 2.1 time: 0.239365 Jan 15 21:07:11.196605 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2811/5626] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:07:10 2022] GET /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91 => generated 1326 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:07:11.538137 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-5416f6f9-10f4-41fb-9169-f988177a5ac9 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:07:11.550006 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-5416f6f9-10f4-41fb-9169-f988177a5ac9 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:07:11.552293 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-5416f6f9-10f4-41fb-9169-f988177a5ac9 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:07:11.556417 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-5416f6f9-10f4-41fb-9169-f988177a5ac9 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42" status: 200 len: 1729 microversion: 2.20 time: 0.423682 Jan 15 21:07:11.559046 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2816/5627] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:07:11 2022] GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42 => generated 1729 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 15 21:07:11.790687 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d9a6173a-2058-48fc-8999-2d98634fa35a tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:07:11.791879 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d9a6173a-2058-48fc-8999-2d98634fa35a tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] [instance: 552b7547-f4b2-4af0-be24-a4c628408c16] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:07:11.806943 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d9a6173a-2058-48fc-8999-2d98634fa35a tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:11.807917 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d9a6173a-2058-48fc-8999-2d98634fa35a tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:11.808738 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d9a6173a-2058-48fc-8999-2d98634fa35a tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:11.809202 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d9a6173a-2058-48fc-8999-2d98634fa35a tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:12.184099 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-d9a6173a-2058-48fc-8999-2d98634fa35a tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822f4a2b1fd6459a8a472bdd066d69fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e03e1de077453588cc783a4e6d690e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:07:12.203858 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d9a6173a-2058-48fc-8999-2d98634fa35a tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] 10.222.0.46 "GET /compute/v2.1/servers/552b7547-f4b2-4af0-be24-a4c628408c16" status: 200 len: 1317 microversion: 2.1 time: 0.418188 Jan 15 21:07:12.204711 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2812/5628] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:07:11 2022] GET /compute/v2.1/servers/552b7547-f4b2-4af0-be24-a4c628408c16 => generated 1317 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:07:12.216212 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-87875871-c8fc-4049-8235-9f304c8b4ae9 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:07:12.216827 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-87875871-c8fc-4049-8235-9f304c8b4ae9 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: d9db70df-9ffc-4b96-af06-a56b3b35ce91] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:07:12.225957 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-87875871-c8fc-4049-8235-9f304c8b4ae9 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:12.230444 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-87875871-c8fc-4049-8235-9f304c8b4ae9 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:12.231508 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-87875871-c8fc-4049-8235-9f304c8b4ae9 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:12.233127 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-87875871-c8fc-4049-8235-9f304c8b4ae9 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:12.252683 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-87875871-c8fc-4049-8235-9f304c8b4ae9 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] HTTP exception thrown: Instance d9db70df-9ffc-4b96-af06-a56b3b35ce91 could not be found. Jan 15 21:07:12.253573 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-87875871-c8fc-4049-8235-9f304c8b4ae9 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Returning 404 to user: Instance d9db70df-9ffc-4b96-af06-a56b3b35ce91 could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:07:12.254614 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-87875871-c8fc-4049-8235-9f304c8b4ae9 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "GET /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91" status: 404 len: 111 microversion: 2.1 time: 0.042188 Jan 15 21:07:12.255248 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2817/5629] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:07:12 2022] GET /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:07:12.265568 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-716b0684-7005-4877-90be-eccaa860e61d tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Calling method '.version_select at 0x7f30c913e550>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:07:12.301945 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-716b0684-7005-4877-90be-eccaa860e61d tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-166944525" status: 202 len: 0 microversion: 2.1 time: 0.041452 Jan 15 21:07:12.304247 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2813/5630] 10.222.0.46 () {58 vars in 1217 bytes} [Sat Jan 15 21:07:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-166944525 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:07:12.577698 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-84283b23-0531-43db-bb2a-4987c1918495 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:07:12.578329 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-84283b23-0531-43db-bb2a-4987c1918495 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:07:12.590429 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-84283b23-0531-43db-bb2a-4987c1918495 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:12.591191 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-84283b23-0531-43db-bb2a-4987c1918495 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:12.592449 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-84283b23-0531-43db-bb2a-4987c1918495 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:12.593084 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-84283b23-0531-43db-bb2a-4987c1918495 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:12.940721 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-32963690-7c3b-4c43-a016-73c226de3f86 req-5fb9df2b-4c8c-4a26-b157-5b332d0a9e66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1b412a8-0407-44fd-8f16-7cbcd8de3a42", "name": "network-vif-plugged", "status": "completed", "tag": "d027fed2-822f-40a2-a052-26b22c1aef53"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:07:12.943379 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:07:12.943379 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:07:12.945985 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-84283b23-0531-43db-bb2a-4987c1918495 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:07:12.956603 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-84283b23-0531-43db-bb2a-4987c1918495 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:07:12.959681 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-84283b23-0531-43db-bb2a-4987c1918495 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:07:12.962592 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-84283b23-0531-43db-bb2a-4987c1918495 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42" status: 200 len: 1729 microversion: 2.20 time: 0.390548 Jan 15 21:07:12.963160 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2818/5631] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:07:12 2022] GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42 => generated 1729 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:07:12.964328 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-32963690-7c3b-4c43-a016-73c226de3f86 req-5fb9df2b-4c8c-4a26-b157-5b332d0a9e66 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:12.964790 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-32963690-7c3b-4c43-a016-73c226de3f86 req-5fb9df2b-4c8c-4a26-b157-5b332d0a9e66 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:13.000717 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-32963690-7c3b-4c43-a016-73c226de3f86 req-5fb9df2b-4c8c-4a26-b157-5b332d0a9e66 service nova] Creating event network-vif-plugged:d027fed2-822f-40a2-a052-26b22c1aef53 for instance a1b412a8-0407-44fd-8f16-7cbcd8de3a42 on nch1-master-1 Jan 15 21:07:13.030656 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-32963690-7c3b-4c43-a016-73c226de3f86 req-5fb9df2b-4c8c-4a26-b157-5b332d0a9e66 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093205 Jan 15 21:07:13.031704 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2814/5632] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:07:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 21:07:13.229839 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-849adac4-9698-48dd-91b1-4eec06b9d905 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:07:13.230446 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-849adac4-9698-48dd-91b1-4eec06b9d905 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] [instance: 552b7547-f4b2-4af0-be24-a4c628408c16] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:07:13.250654 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-849adac4-9698-48dd-91b1-4eec06b9d905 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:13.251178 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-849adac4-9698-48dd-91b1-4eec06b9d905 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:13.251986 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-849adac4-9698-48dd-91b1-4eec06b9d905 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:13.252583 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-849adac4-9698-48dd-91b1-4eec06b9d905 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:13.600165 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-849adac4-9698-48dd-91b1-4eec06b9d905 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822f4a2b1fd6459a8a472bdd066d69fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e03e1de077453588cc783a4e6d690e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:07:13.617531 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-849adac4-9698-48dd-91b1-4eec06b9d905 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] 10.222.0.46 "GET /compute/v2.1/servers/552b7547-f4b2-4af0-be24-a4c628408c16" status: 200 len: 1508 microversion: 2.1 time: 0.398550 Jan 15 21:07:13.621151 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2819/5633] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:07:13 2022] GET /compute/v2.1/servers/552b7547-f4b2-4af0-be24-a4c628408c16 => generated 1508 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:07:13.983620 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d0062654-93d6-452d-98c7-bbf7ad050775 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:07:13.984348 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d0062654-93d6-452d-98c7-bbf7ad050775 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:07:13.994995 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d0062654-93d6-452d-98c7-bbf7ad050775 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:13.995455 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d0062654-93d6-452d-98c7-bbf7ad050775 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:13.996902 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d0062654-93d6-452d-98c7-bbf7ad050775 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:13.997532 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d0062654-93d6-452d-98c7-bbf7ad050775 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:14.562899 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-d0062654-93d6-452d-98c7-bbf7ad050775 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:07:14.572690 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-d0062654-93d6-452d-98c7-bbf7ad050775 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:07:14.580031 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-d0062654-93d6-452d-98c7-bbf7ad050775 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:07:14.581306 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d0062654-93d6-452d-98c7-bbf7ad050775 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42" status: 200 len: 1729 microversion: 2.20 time: 0.603392 Jan 15 21:07:14.582417 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2815/5634] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:07:13 2022] GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42 => generated 1729 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 15 21:07:15.600524 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-05556c50-9cc3-491c-b322-2ee1e1d7115f tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:07:15.601834 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-05556c50-9cc3-491c-b322-2ee1e1d7115f tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:07:15.609097 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-05556c50-9cc3-491c-b322-2ee1e1d7115f tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:15.609650 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-05556c50-9cc3-491c-b322-2ee1e1d7115f tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:15.610684 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-05556c50-9cc3-491c-b322-2ee1e1d7115f tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:15.610855 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-05556c50-9cc3-491c-b322-2ee1e1d7115f tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:15.872972 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-05556c50-9cc3-491c-b322-2ee1e1d7115f tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:07:15.882504 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-05556c50-9cc3-491c-b322-2ee1e1d7115f tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:07:15.884054 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-05556c50-9cc3-491c-b322-2ee1e1d7115f tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:07:15.885260 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-05556c50-9cc3-491c-b322-2ee1e1d7115f tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42" status: 200 len: 1716 microversion: 2.20 time: 0.289585 Jan 15 21:07:15.885830 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2820/5635] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:07:15 2022] GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42 => generated 1716 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:07:16.253888 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3532bb33-30f8-48d5-a8b4-be15bd59a8f0 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8eb74480-465c-4dac-bef0-e4932fe03475"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:07:16.255765 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-3532bb33-30f8-48d5-a8b4-be15bd59a8f0 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] [instance: 552b7547-f4b2-4af0-be24-a4c628408c16] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:07:16.263822 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3532bb33-30f8-48d5-a8b4-be15bd59a8f0 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:16.264662 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3532bb33-30f8-48d5-a8b4-be15bd59a8f0 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:16.266009 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3532bb33-30f8-48d5-a8b4-be15bd59a8f0 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:16.266818 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3532bb33-30f8-48d5-a8b4-be15bd59a8f0 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:16.600364 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3532bb33-30f8-48d5-a8b4-be15bd59a8f0 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] 10.222.0.46 "POST /compute/v2.1/servers/552b7547-f4b2-4af0-be24-a4c628408c16/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.349347 Jan 15 21:07:16.601846 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2816/5636] 10.222.0.46 () {60 vars in 1322 bytes} [Sat Jan 15 21:07:16 2022] POST /compute/v2.1/servers/552b7547-f4b2-4af0-be24-a4c628408c16/os-volume_attachments => generated 194 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:07:17.050041 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c3cc7165-90ba-402d-957a-5c5d27f93ed0 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:07:17.050487 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c3cc7165-90ba-402d-957a-5c5d27f93ed0 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: d9db70df-9ffc-4b96-af06-a56b3b35ce91] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:07:17.059201 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c3cc7165-90ba-402d-957a-5c5d27f93ed0 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:17.059658 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c3cc7165-90ba-402d-957a-5c5d27f93ed0 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:17.060473 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c3cc7165-90ba-402d-957a-5c5d27f93ed0 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:17.061044 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c3cc7165-90ba-402d-957a-5c5d27f93ed0 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:17.076745 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-c3cc7165-90ba-402d-957a-5c5d27f93ed0 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] HTTP exception thrown: Instance d9db70df-9ffc-4b96-af06-a56b3b35ce91 could not be found. Jan 15 21:07:17.077535 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c3cc7165-90ba-402d-957a-5c5d27f93ed0 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Returning 404 to user: Instance d9db70df-9ffc-4b96-af06-a56b3b35ce91 could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:07:17.078235 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c3cc7165-90ba-402d-957a-5c5d27f93ed0 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "DELETE /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91" status: 404 len: 111 microversion: 2.1 time: 0.032634 Jan 15 21:07:17.078825 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2821/5637] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 21:07:17 2022] DELETE /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:07:17.088576 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8684654c-8f54-47a1-8c9c-61d547050e15 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:07:17.089321 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-8684654c-8f54-47a1-8c9c-61d547050e15 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: d9db70df-9ffc-4b96-af06-a56b3b35ce91] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:07:17.096288 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8684654c-8f54-47a1-8c9c-61d547050e15 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:17.096746 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8684654c-8f54-47a1-8c9c-61d547050e15 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:17.098109 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8684654c-8f54-47a1-8c9c-61d547050e15 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:17.098552 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8684654c-8f54-47a1-8c9c-61d547050e15 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:17.119082 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-8684654c-8f54-47a1-8c9c-61d547050e15 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] HTTP exception thrown: Instance d9db70df-9ffc-4b96-af06-a56b3b35ce91 could not be found. Jan 15 21:07:17.121962 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8684654c-8f54-47a1-8c9c-61d547050e15 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Returning 404 to user: Instance d9db70df-9ffc-4b96-af06-a56b3b35ce91 could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:07:17.122997 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-8684654c-8f54-47a1-8c9c-61d547050e15 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "GET /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91" status: 404 len: 111 microversion: 2.1 time: 0.039615 Jan 15 21:07:17.127534 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2817/5638] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:07:17 2022] GET /compute/v2.1/servers/d9db70df-9ffc-4b96-af06-a56b3b35ce91 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:07:19.348247 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e59b5721-49ed-49f9-a228-4e5755b185c1 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:07:19.348782 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e59b5721-49ed-49f9-a228-4e5755b185c1 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:07:19.356649 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e59b5721-49ed-49f9-a228-4e5755b185c1 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:19.357143 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e59b5721-49ed-49f9-a228-4e5755b185c1 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:19.357951 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e59b5721-49ed-49f9-a228-4e5755b185c1 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:19.358422 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e59b5721-49ed-49f9-a228-4e5755b185c1 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:19.374926 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-e59b5721-49ed-49f9-a228-4e5755b185c1 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] HTTP exception thrown: Instance ac78554d-ca29-4e31-a410-00dc4df5c77a could not be found. Jan 15 21:07:19.375590 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e59b5721-49ed-49f9-a228-4e5755b185c1 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Returning 404 to user: Instance ac78554d-ca29-4e31-a410-00dc4df5c77a could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:07:19.376681 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e59b5721-49ed-49f9-a228-4e5755b185c1 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "DELETE /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a" status: 404 len: 111 microversion: 2.1 time: 0.032397 Jan 15 21:07:19.379050 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2822/5639] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 21:07:19 2022] DELETE /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:07:19.387246 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-dcd6d56e-46b4-4d9d-8f2a-5fcc32290e73 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:07:19.387928 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-dcd6d56e-46b4-4d9d-8f2a-5fcc32290e73 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] [instance: ac78554d-ca29-4e31-a410-00dc4df5c77a] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:07:19.394937 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dcd6d56e-46b4-4d9d-8f2a-5fcc32290e73 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:19.395412 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dcd6d56e-46b4-4d9d-8f2a-5fcc32290e73 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:19.396827 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dcd6d56e-46b4-4d9d-8f2a-5fcc32290e73 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:19.397299 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dcd6d56e-46b4-4d9d-8f2a-5fcc32290e73 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:19.413067 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-dcd6d56e-46b4-4d9d-8f2a-5fcc32290e73 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] HTTP exception thrown: Instance ac78554d-ca29-4e31-a410-00dc4df5c77a could not be found. Jan 15 21:07:19.413670 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-dcd6d56e-46b4-4d9d-8f2a-5fcc32290e73 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] Returning 404 to user: Instance ac78554d-ca29-4e31-a410-00dc4df5c77a could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:07:19.414741 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-dcd6d56e-46b4-4d9d-8f2a-5fcc32290e73 tempest-AttachVolumeTestJSON-1518881454 tempest-AttachVolumeTestJSON-1518881454-project] 10.222.0.46 "GET /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a" status: 404 len: 111 microversion: 2.1 time: 0.031494 Jan 15 21:07:19.415794 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2818/5640] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:07:19 2022] GET /compute/v2.1/servers/ac78554d-ca29-4e31-a410-00dc4df5c77a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:07:21.150834 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ae1cb58d-5c7f-4dd3-87c2-632aee102dce tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1097759265", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "networks": [{"uuid": "b55f2173-9368-4426-891c-2ceb82762521"}]}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:07:21.245727 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.network.neutron [None req-ae1cb58d-5c7f-4dd3-87c2-632aee102dce tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] validate_networks() for [('b55f2173-9368-4426-891c-2ceb82762521', None, None, None, None, None)] {{(pid=129366) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 21:07:22.104089 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-ae1cb58d-5c7f-4dd3-87c2-632aee102dce tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Flavor limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 21:07:22.104669 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-ae1cb58d-5c7f-4dd3-87c2-632aee102dce tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Image limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 21:07:22.105568 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-ae1cb58d-5c7f-4dd3-87c2-632aee102dce tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Flavor pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 21:07:22.106474 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-ae1cb58d-5c7f-4dd3-87c2-632aee102dce tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Image pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 21:07:22.107003 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-ae1cb58d-5c7f-4dd3-87c2-632aee102dce tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 21:07:22.119434 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ae1cb58d-5c7f-4dd3-87c2-632aee102dce tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:22.120895 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ae1cb58d-5c7f-4dd3-87c2-632aee102dce tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:22.122845 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ae1cb58d-5c7f-4dd3-87c2-632aee102dce tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:22.124020 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ae1cb58d-5c7f-4dd3-87c2-632aee102dce tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:22.152249 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-ae1cb58d-5c7f-4dd3-87c2-632aee102dce tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Getting quotas for project 95e03e1de077453588cc783a4e6d690e. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:07:22.160232 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-ae1cb58d-5c7f-4dd3-87c2-632aee102dce tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Getting quotas for user 822f4a2b1fd6459a8a472bdd066d69fc and project 95e03e1de077453588cc783a4e6d690e. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:07:22.175985 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ae1cb58d-5c7f-4dd3-87c2-632aee102dce tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Going to run 1 instances... {{(pid=129366) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 21:07:22.179753 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ae1cb58d-5c7f-4dd3-87c2-632aee102dce tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] [instance: 4295ba6e-d84c-41a2-be24-e03c022fe9b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 21:07:22.256631 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ae1cb58d-5c7f-4dd3-87c2-632aee102dce tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.108150 Jan 15 21:07:22.257897 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2823/5641] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 21:07:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1112 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 21:07:22.268223 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c243f53f-4e0e-4328-a43d-65ec8fd3a972 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:07:22.268922 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c243f53f-4e0e-4328-a43d-65ec8fd3a972 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] [instance: 4295ba6e-d84c-41a2-be24-e03c022fe9b6] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:07:22.390897 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-c243f53f-4e0e-4328-a43d-65ec8fd3a972 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822f4a2b1fd6459a8a472bdd066d69fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e03e1de077453588cc783a4e6d690e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:07:22.401161 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c243f53f-4e0e-4328-a43d-65ec8fd3a972 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] 10.222.0.46 "GET /compute/v2.1/servers/4295ba6e-d84c-41a2-be24-e03c022fe9b6" status: 200 len: 1218 microversion: 2.1 time: 0.137147 Jan 15 21:07:22.402086 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2819/5642] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:07:22 2022] GET /compute/v2.1/servers/4295ba6e-d84c-41a2-be24-e03c022fe9b6 => generated 1218 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:07:23.421393 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d1b4cea9-2b6e-4585-8135-f8924b9b4934 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:07:23.422010 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-d1b4cea9-2b6e-4585-8135-f8924b9b4934 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] [instance: 4295ba6e-d84c-41a2-be24-e03c022fe9b6] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:07:23.432346 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d1b4cea9-2b6e-4585-8135-f8924b9b4934 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:23.433040 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d1b4cea9-2b6e-4585-8135-f8924b9b4934 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:23.435077 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d1b4cea9-2b6e-4585-8135-f8924b9b4934 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:23.437391 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d1b4cea9-2b6e-4585-8135-f8924b9b4934 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:23.599450 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-d1b4cea9-2b6e-4585-8135-f8924b9b4934 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822f4a2b1fd6459a8a472bdd066d69fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e03e1de077453588cc783a4e6d690e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:07:23.612340 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d1b4cea9-2b6e-4585-8135-f8924b9b4934 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] 10.222.0.46 "GET /compute/v2.1/servers/4295ba6e-d84c-41a2-be24-e03c022fe9b6" status: 200 len: 1270 microversion: 2.1 time: 0.197005 Jan 15 21:07:23.613649 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2824/5643] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:07:23 2022] GET /compute/v2.1/servers/4295ba6e-d84c-41a2-be24-e03c022fe9b6 => generated 1270 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:07:24.643685 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ce7a7e55-504c-49f2-91f5-61e3ea0eac28 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:07:24.644349 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ce7a7e55-504c-49f2-91f5-61e3ea0eac28 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] [instance: 4295ba6e-d84c-41a2-be24-e03c022fe9b6] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:07:24.667532 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ce7a7e55-504c-49f2-91f5-61e3ea0eac28 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:24.667996 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ce7a7e55-504c-49f2-91f5-61e3ea0eac28 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:24.678792 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ce7a7e55-504c-49f2-91f5-61e3ea0eac28 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:24.679251 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ce7a7e55-504c-49f2-91f5-61e3ea0eac28 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:25.066019 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-ce7a7e55-504c-49f2-91f5-61e3ea0eac28 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822f4a2b1fd6459a8a472bdd066d69fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e03e1de077453588cc783a4e6d690e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:07:25.086058 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ce7a7e55-504c-49f2-91f5-61e3ea0eac28 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] 10.222.0.46 "GET /compute/v2.1/servers/4295ba6e-d84c-41a2-be24-e03c022fe9b6" status: 200 len: 1318 microversion: 2.1 time: 0.457221 Jan 15 21:07:25.087961 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2820/5644] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:07:24 2022] GET /compute/v2.1/servers/4295ba6e-d84c-41a2-be24-e03c022fe9b6 => generated 1318 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:07:25.714633 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-5c338760-6f7b-48f3-925b-fd66381061e5 req-71bf6d32-36d8-4a5f-9742-0ff5151d2f25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4295ba6e-d84c-41a2-be24-e03c022fe9b6", "tag": "2c1c0dd2-1098-46ae-9791-f62469b9f7da"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:07:25.720081 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:07:25.720081 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:07:25.756443 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-5c338760-6f7b-48f3-925b-fd66381061e5 req-71bf6d32-36d8-4a5f-9742-0ff5151d2f25 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:25.757404 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-5c338760-6f7b-48f3-925b-fd66381061e5 req-71bf6d32-36d8-4a5f-9742-0ff5151d2f25 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:25.831848 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-5c338760-6f7b-48f3-925b-fd66381061e5 req-71bf6d32-36d8-4a5f-9742-0ff5151d2f25 service nova] Creating event network-changed:2c1c0dd2-1098-46ae-9791-f62469b9f7da for instance 4295ba6e-d84c-41a2-be24-e03c022fe9b6 on nch2-master-1 Jan 15 21:07:25.842165 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-5c338760-6f7b-48f3-925b-fd66381061e5 req-71bf6d32-36d8-4a5f-9742-0ff5151d2f25 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130890 Jan 15 21:07:25.843977 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2825/5645] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:07:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:07:26.106217 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ada053e5-5c36-464f-80ad-9a5a36271c2b tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:07:26.106838 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ada053e5-5c36-464f-80ad-9a5a36271c2b tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] [instance: 4295ba6e-d84c-41a2-be24-e03c022fe9b6] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:07:26.113761 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ada053e5-5c36-464f-80ad-9a5a36271c2b tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:26.114216 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ada053e5-5c36-464f-80ad-9a5a36271c2b tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:26.115047 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ada053e5-5c36-464f-80ad-9a5a36271c2b tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:26.115490 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ada053e5-5c36-464f-80ad-9a5a36271c2b tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:26.560625 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-ada053e5-5c36-464f-80ad-9a5a36271c2b tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822f4a2b1fd6459a8a472bdd066d69fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e03e1de077453588cc783a4e6d690e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:07:26.569380 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ada053e5-5c36-464f-80ad-9a5a36271c2b tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] 10.222.0.46 "GET /compute/v2.1/servers/4295ba6e-d84c-41a2-be24-e03c022fe9b6" status: 200 len: 1318 microversion: 2.1 time: 0.467041 Jan 15 21:07:26.569985 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2821/5646] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:07:26 2022] GET /compute/v2.1/servers/4295ba6e-d84c-41a2-be24-e03c022fe9b6 => generated 1318 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:07:27.592098 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-40179598-fbd8-4811-87d9-ff250e69498b tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:07:27.593023 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-40179598-fbd8-4811-87d9-ff250e69498b tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] [instance: 4295ba6e-d84c-41a2-be24-e03c022fe9b6] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:07:27.620460 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-40179598-fbd8-4811-87d9-ff250e69498b tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:27.622199 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-40179598-fbd8-4811-87d9-ff250e69498b tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:27.629704 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-40179598-fbd8-4811-87d9-ff250e69498b tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:27.632268 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-40179598-fbd8-4811-87d9-ff250e69498b tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:27.952075 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-40179598-fbd8-4811-87d9-ff250e69498b tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822f4a2b1fd6459a8a472bdd066d69fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e03e1de077453588cc783a4e6d690e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:07:27.964125 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-40179598-fbd8-4811-87d9-ff250e69498b tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] 10.222.0.46 "GET /compute/v2.1/servers/4295ba6e-d84c-41a2-be24-e03c022fe9b6" status: 200 len: 1318 microversion: 2.1 time: 0.378854 Jan 15 21:07:27.965715 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2826/5647] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:07:27 2022] GET /compute/v2.1/servers/4295ba6e-d84c-41a2-be24-e03c022fe9b6 => generated 1318 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:07:28.981093 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a716ed8a-54e6-468a-8b2b-0130afb43394 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:07:28.981711 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a716ed8a-54e6-468a-8b2b-0130afb43394 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] [instance: 4295ba6e-d84c-41a2-be24-e03c022fe9b6] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:07:28.995027 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a716ed8a-54e6-468a-8b2b-0130afb43394 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:28.995274 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a716ed8a-54e6-468a-8b2b-0130afb43394 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:28.996192 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a716ed8a-54e6-468a-8b2b-0130afb43394 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:28.996635 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a716ed8a-54e6-468a-8b2b-0130afb43394 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:29.108821 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d3c9dbdb-7bee-47b3-82ee-b3f02a3ad3a5 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:07:29.109712 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-d3c9dbdb-7bee-47b3-82ee-b3f02a3ad3a5 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:07:29.123311 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d3c9dbdb-7bee-47b3-82ee-b3f02a3ad3a5 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:29.124358 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d3c9dbdb-7bee-47b3-82ee-b3f02a3ad3a5 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:29.125338 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d3c9dbdb-7bee-47b3-82ee-b3f02a3ad3a5 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:29.125893 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d3c9dbdb-7bee-47b3-82ee-b3f02a3ad3a5 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:29.170389 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-d3c9dbdb-7bee-47b3-82ee-b3f02a3ad3a5 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Going to try to terminate instance {{(pid=129366) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 21:07:29.303929 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d3c9dbdb-7bee-47b3-82ee-b3f02a3ad3a5 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "DELETE /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee" status: 204 len: 0 microversion: 2.42 time: 0.198326 Jan 15 21:07:29.304832 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2827/5648] 10.222.0.46 () {60 vars in 1279 bytes} [Sat Jan 15 21:07:29 2022] DELETE /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jan 15 21:07:29.316306 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-3a33c27f-1756-4689-889e-435c45bd1f55 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:07:29.317084 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-3a33c27f-1756-4689-889e-435c45bd1f55 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:07:29.325646 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3a33c27f-1756-4689-889e-435c45bd1f55 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:29.326863 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3a33c27f-1756-4689-889e-435c45bd1f55 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:29.328270 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3a33c27f-1756-4689-889e-435c45bd1f55 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:29.328884 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3a33c27f-1756-4689-889e-435c45bd1f55 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:29.664596 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-a716ed8a-54e6-468a-8b2b-0130afb43394 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822f4a2b1fd6459a8a472bdd066d69fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e03e1de077453588cc783a4e6d690e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:07:29.676161 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a716ed8a-54e6-468a-8b2b-0130afb43394 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] 10.222.0.46 "GET /compute/v2.1/servers/4295ba6e-d84c-41a2-be24-e03c022fe9b6" status: 200 len: 1318 microversion: 2.1 time: 0.698863 Jan 15 21:07:29.687539 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2822/5649] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:07:28 2022] GET /compute/v2.1/servers/4295ba6e-d84c-41a2-be24-e03c022fe9b6 => generated 1318 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:07:29.811668 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-3a33c27f-1756-4689-889e-435c45bd1f55 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:07:29.822230 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-3a33c27f-1756-4689-889e-435c45bd1f55 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:07:29.825016 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-3a33c27f-1756-4689-889e-435c45bd1f55 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:07:29.827018 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-3a33c27f-1756-4689-889e-435c45bd1f55 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "GET /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee" status: 200 len: 2962 microversion: 2.42 time: 0.517416 Jan 15 21:07:29.828103 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2828/5650] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:07:29 2022] GET /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee => generated 2962 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:07:30.694458 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-56e91ebb-d4e6-4b28-9ce3-16bec9ab2480 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:07:30.695648 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-56e91ebb-d4e6-4b28-9ce3-16bec9ab2480 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] [instance: 4295ba6e-d84c-41a2-be24-e03c022fe9b6] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:07:30.706012 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-56e91ebb-d4e6-4b28-9ce3-16bec9ab2480 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:30.706796 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-56e91ebb-d4e6-4b28-9ce3-16bec9ab2480 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:30.708459 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-56e91ebb-d4e6-4b28-9ce3-16bec9ab2480 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:30.709100 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-56e91ebb-d4e6-4b28-9ce3-16bec9ab2480 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:30.850326 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-dd881bf8-10a8-4e67-9aa0-2919f1be35f0 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:07:30.851089 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-dd881bf8-10a8-4e67-9aa0-2919f1be35f0 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:07:30.858656 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dd881bf8-10a8-4e67-9aa0-2919f1be35f0 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:30.859422 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dd881bf8-10a8-4e67-9aa0-2919f1be35f0 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:30.860463 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dd881bf8-10a8-4e67-9aa0-2919f1be35f0 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:30.861135 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dd881bf8-10a8-4e67-9aa0-2919f1be35f0 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:31.166423 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-56e91ebb-d4e6-4b28-9ce3-16bec9ab2480 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822f4a2b1fd6459a8a472bdd066d69fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e03e1de077453588cc783a4e6d690e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:07:31.190508 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-56e91ebb-d4e6-4b28-9ce3-16bec9ab2480 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] 10.222.0.46 "GET /compute/v2.1/servers/4295ba6e-d84c-41a2-be24-e03c022fe9b6" status: 200 len: 1318 microversion: 2.1 time: 0.499721 Jan 15 21:07:31.195756 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2823/5651] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:07:30 2022] GET /compute/v2.1/servers/4295ba6e-d84c-41a2-be24-e03c022fe9b6 => generated 1318 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:07:31.246019 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-dd881bf8-10a8-4e67-9aa0-2919f1be35f0 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:07:31.256721 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-dd881bf8-10a8-4e67-9aa0-2919f1be35f0 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:07:31.258398 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-dd881bf8-10a8-4e67-9aa0-2919f1be35f0 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:07:31.259855 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-dd881bf8-10a8-4e67-9aa0-2919f1be35f0 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "GET /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee" status: 200 len: 2962 microversion: 2.42 time: 0.413610 Jan 15 21:07:31.260785 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2829/5652] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:07:30 2022] GET /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee => generated 2962 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 15 21:07:32.211527 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a3cc89e5-d7e3-4912-9ad5-047d29a549ec tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:07:32.212242 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a3cc89e5-d7e3-4912-9ad5-047d29a549ec tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] [instance: 4295ba6e-d84c-41a2-be24-e03c022fe9b6] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:07:32.224939 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a3cc89e5-d7e3-4912-9ad5-047d29a549ec tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:32.225701 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a3cc89e5-d7e3-4912-9ad5-047d29a549ec tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:32.226681 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a3cc89e5-d7e3-4912-9ad5-047d29a549ec tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:32.227292 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a3cc89e5-d7e3-4912-9ad5-047d29a549ec tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:32.278862 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-d3a37301-dec4-4b39-8ad7-162f7a19a7e4 req-dda67e41-81a9-4a31-b9db-4be83922a799 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4295ba6e-d84c-41a2-be24-e03c022fe9b6", "name": "network-vif-plugged", "status": "completed", "tag": "2c1c0dd2-1098-46ae-9791-f62469b9f7da"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:07:32.280404 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:07:32.280404 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:07:32.297820 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-d3a37301-dec4-4b39-8ad7-162f7a19a7e4 req-dda67e41-81a9-4a31-b9db-4be83922a799 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:32.298347 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-d3a37301-dec4-4b39-8ad7-162f7a19a7e4 req-dda67e41-81a9-4a31-b9db-4be83922a799 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:32.322833 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-d3a37301-dec4-4b39-8ad7-162f7a19a7e4 req-dda67e41-81a9-4a31-b9db-4be83922a799 service nova] Creating event network-vif-plugged:2c1c0dd2-1098-46ae-9791-f62469b9f7da for instance 4295ba6e-d84c-41a2-be24-e03c022fe9b6 on nch2-master-1 Jan 15 21:07:32.337386 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-d3a37301-dec4-4b39-8ad7-162f7a19a7e4 req-dda67e41-81a9-4a31-b9db-4be83922a799 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062222 Jan 15 21:07:32.348237 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2830/5653] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:07:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:07:32.355661 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e2981247-52f6-4218-88d5-a81aca2381c8 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:07:32.356980 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e2981247-52f6-4218-88d5-a81aca2381c8 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:07:32.376323 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e2981247-52f6-4218-88d5-a81aca2381c8 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:32.377453 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e2981247-52f6-4218-88d5-a81aca2381c8 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:32.378489 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e2981247-52f6-4218-88d5-a81aca2381c8 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:32.379239 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e2981247-52f6-4218-88d5-a81aca2381c8 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:32.844895 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-a3cc89e5-d7e3-4912-9ad5-047d29a549ec tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822f4a2b1fd6459a8a472bdd066d69fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e03e1de077453588cc783a4e6d690e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:07:32.854110 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a3cc89e5-d7e3-4912-9ad5-047d29a549ec tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] 10.222.0.46 "GET /compute/v2.1/servers/4295ba6e-d84c-41a2-be24-e03c022fe9b6" status: 200 len: 1318 microversion: 2.1 time: 0.648564 Jan 15 21:07:32.857587 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2824/5654] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:07:32 2022] GET /compute/v2.1/servers/4295ba6e-d84c-41a2-be24-e03c022fe9b6 => generated 1318 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:07:32.995001 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-e2981247-52f6-4218-88d5-a81aca2381c8 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:07:33.011932 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-e2981247-52f6-4218-88d5-a81aca2381c8 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:07:33.018743 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-e2981247-52f6-4218-88d5-a81aca2381c8 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:07:33.021743 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e2981247-52f6-4218-88d5-a81aca2381c8 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "GET /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee" status: 200 len: 2941 microversion: 2.42 time: 0.671197 Jan 15 21:07:33.025512 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2831/5655] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:07:32 2022] GET /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee => generated 2941 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:07:33.880214 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-95735284-744b-4995-b453-7ab78bd529bf tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:07:33.881702 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-95735284-744b-4995-b453-7ab78bd529bf tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] [instance: 4295ba6e-d84c-41a2-be24-e03c022fe9b6] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:07:33.895408 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-95735284-744b-4995-b453-7ab78bd529bf tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:33.897130 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-95735284-744b-4995-b453-7ab78bd529bf tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:33.902493 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-95735284-744b-4995-b453-7ab78bd529bf tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:33.904347 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-95735284-744b-4995-b453-7ab78bd529bf tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:33.943568 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-ab63c682-1f2e-4b60-a0ed-b179b789d186 req-e9ac43e2-8d83-41cf-a541-04e3282fea0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1884dd3f-949c-4df3-a977-3f6f5a204fee", "name": "network-vif-deleted", "tag": "71565d73-8ba2-4ed6-8fb6-b6d496626525"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:07:33.946060 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:07:33.946060 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:07:33.958783 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-ab63c682-1f2e-4b60-a0ed-b179b789d186 req-e9ac43e2-8d83-41cf-a541-04e3282fea0d service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:33.969440 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-ab63c682-1f2e-4b60-a0ed-b179b789d186 req-e9ac43e2-8d83-41cf-a541-04e3282fea0d service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:33.991721 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-ab63c682-1f2e-4b60-a0ed-b179b789d186 req-e9ac43e2-8d83-41cf-a541-04e3282fea0d service nova] Creating event network-vif-deleted:71565d73-8ba2-4ed6-8fb6-b6d496626525 for instance 1884dd3f-949c-4df3-a977-3f6f5a204fee on nch2-master-1 Jan 15 21:07:34.006056 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-ab63c682-1f2e-4b60-a0ed-b179b789d186 req-e9ac43e2-8d83-41cf-a541-04e3282fea0d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066574 Jan 15 21:07:34.006871 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2832/5656] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:07:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 21:07:34.045450 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-de557dbb-f1cb-4a82-9d9e-76fa5e8ca8c3 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:07:34.046650 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-de557dbb-f1cb-4a82-9d9e-76fa5e8ca8c3 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:07:34.057942 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-de557dbb-f1cb-4a82-9d9e-76fa5e8ca8c3 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:34.060281 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-de557dbb-f1cb-4a82-9d9e-76fa5e8ca8c3 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:34.061404 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-de557dbb-f1cb-4a82-9d9e-76fa5e8ca8c3 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:34.068099 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-de557dbb-f1cb-4a82-9d9e-76fa5e8ca8c3 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:34.305519 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-95735284-744b-4995-b453-7ab78bd529bf tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822f4a2b1fd6459a8a472bdd066d69fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e03e1de077453588cc783a4e6d690e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:07:34.322923 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-95735284-744b-4995-b453-7ab78bd529bf tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] 10.222.0.46 "GET /compute/v2.1/servers/4295ba6e-d84c-41a2-be24-e03c022fe9b6" status: 200 len: 1509 microversion: 2.1 time: 0.451914 Jan 15 21:07:34.324696 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2825/5657] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:07:33 2022] GET /compute/v2.1/servers/4295ba6e-d84c-41a2-be24-e03c022fe9b6 => generated 1509 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:07:34.344146 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a0dbd565-a33c-4626-9eb4-555971aa180f tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8eb74480-465c-4dac-bef0-e4932fe03475"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:07:34.346272 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a0dbd565-a33c-4626-9eb4-555971aa180f tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] [instance: 4295ba6e-d84c-41a2-be24-e03c022fe9b6] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:07:34.382274 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a0dbd565-a33c-4626-9eb4-555971aa180f tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:34.383527 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a0dbd565-a33c-4626-9eb4-555971aa180f tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:34.386621 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a0dbd565-a33c-4626-9eb4-555971aa180f tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:34.387841 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a0dbd565-a33c-4626-9eb4-555971aa180f tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:34.436710 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-de557dbb-f1cb-4a82-9d9e-76fa5e8ca8c3 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:07:34.457628 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-de557dbb-f1cb-4a82-9d9e-76fa5e8ca8c3 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:07:34.465906 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-de557dbb-f1cb-4a82-9d9e-76fa5e8ca8c3 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:07:34.470558 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-de557dbb-f1cb-4a82-9d9e-76fa5e8ca8c3 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "GET /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee" status: 200 len: 2759 microversion: 2.42 time: 0.426155 Jan 15 21:07:34.474276 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2833/5658] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:07:34 2022] GET /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee => generated 2759 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 15 21:07:34.509156 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-cdc9c10a-9dab-49f3-abf6-9e642c6b5d41 req-fe963346-1cd2-4fd1-873e-05d10ad4a52b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1884dd3f-949c-4df3-a977-3f6f5a204fee", "name": "network-vif-unplugged", "status": "completed", "tag": "71565d73-8ba2-4ed6-8fb6-b6d496626525"}, {"server_uuid": "1884dd3f-949c-4df3-a977-3f6f5a204fee", "name": "network-vif-unplugged", "status": "completed", "tag": "e3bdb69c-2e57-497e-80bb-2b7d539e87f7"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:07:34.517417 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:07:34.517417 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:07:34.544351 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-cdc9c10a-9dab-49f3-abf6-9e642c6b5d41 req-fe963346-1cd2-4fd1-873e-05d10ad4a52b service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:34.547324 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-cdc9c10a-9dab-49f3-abf6-9e642c6b5d41 req-fe963346-1cd2-4fd1-873e-05d10ad4a52b service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:34.580265 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-cdc9c10a-9dab-49f3-abf6-9e642c6b5d41 req-fe963346-1cd2-4fd1-873e-05d10ad4a52b service nova] Creating event network-vif-unplugged:71565d73-8ba2-4ed6-8fb6-b6d496626525 for instance 1884dd3f-949c-4df3-a977-3f6f5a204fee on nch2-master-1 Jan 15 21:07:34.582708 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-cdc9c10a-9dab-49f3-abf6-9e642c6b5d41 req-fe963346-1cd2-4fd1-873e-05d10ad4a52b service nova] Creating event network-vif-unplugged:e3bdb69c-2e57-497e-80bb-2b7d539e87f7 for instance 1884dd3f-949c-4df3-a977-3f6f5a204fee on nch2-master-1 Jan 15 21:07:34.594844 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-cdc9c10a-9dab-49f3-abf6-9e642c6b5d41 req-fe963346-1cd2-4fd1-873e-05d10ad4a52b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.115171 Jan 15 21:07:34.598010 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2834/5659] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:07:34 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:07:34.600886 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-a0dbd565-a33c-4626-9eb4-555971aa180f tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] HTTP exception thrown: Invalid volume: volume 8eb74480-465c-4dac-bef0-e4932fe03475 is already attached to instances: 552b7547-f4b2-4af0-be24-a4c628408c16 Jan 15 21:07:34.601749 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a0dbd565-a33c-4626-9eb4-555971aa180f tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Returning 400 to user: Invalid volume: volume 8eb74480-465c-4dac-bef0-e4932fe03475 is already attached to instances: 552b7547-f4b2-4af0-be24-a4c628408c16 {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:07:34.603828 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a0dbd565-a33c-4626-9eb4-555971aa180f tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] 10.222.0.46 "POST /compute/v2.1/servers/4295ba6e-d84c-41a2-be24-e03c022fe9b6/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.264495 Jan 15 21:07:34.606913 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2826/5660] 10.222.0.46 () {60 vars in 1322 bytes} [Sat Jan 15 21:07:34 2022] POST /compute/v2.1/servers/4295ba6e-d84c-41a2-be24-e03c022fe9b6/os-volume_attachments => generated 174 bytes in 269 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jan 15 21:07:34.684452 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-59921bc1-c83e-41f0-b94b-71631744fab9 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:07:34.685339 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-59921bc1-c83e-41f0-b94b-71631744fab9 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] [instance: 552b7547-f4b2-4af0-be24-a4c628408c16] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:07:34.693092 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-59921bc1-c83e-41f0-b94b-71631744fab9 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:34.693977 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-59921bc1-c83e-41f0-b94b-71631744fab9 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:34.695089 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-59921bc1-c83e-41f0-b94b-71631744fab9 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:34.695744 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-59921bc1-c83e-41f0-b94b-71631744fab9 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:34.859911 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.objects.instance [None req-59921bc1-c83e-41f0-b94b-71631744fab9 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lazy-loading 'services' on Instance uuid 552b7547-f4b2-4af0-be24-a4c628408c16 {{(pid=129366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 21:07:35.081599 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-59921bc1-c83e-41f0-b94b-71631744fab9 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] 10.222.0.46 "DELETE /compute/v2.1/servers/552b7547-f4b2-4af0-be24-a4c628408c16/os-volume_attachments/8eb74480-465c-4dac-bef0-e4932fe03475" status: 202 len: 0 microversion: 2.1 time: 0.401834 Jan 15 21:07:35.082897 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2835/5661] 10.222.0.46 () {58 vars in 1415 bytes} [Sat Jan 15 21:07:34 2022] DELETE /compute/v2.1/servers/552b7547-f4b2-4af0-be24-a4c628408c16/os-volume_attachments/8eb74480-465c-4dac-bef0-e4932fe03475 => generated 0 bytes in 404 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:07:35.091491 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-afeebc6c-c1c7-426f-a10a-72b0ef1593c0 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:07:35.093340 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-afeebc6c-c1c7-426f-a10a-72b0ef1593c0 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] [instance: 552b7547-f4b2-4af0-be24-a4c628408c16] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:07:35.102316 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-afeebc6c-c1c7-426f-a10a-72b0ef1593c0 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:35.103415 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-afeebc6c-c1c7-426f-a10a-72b0ef1593c0 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:35.104409 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-afeebc6c-c1c7-426f-a10a-72b0ef1593c0 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:35.105056 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-afeebc6c-c1c7-426f-a10a-72b0ef1593c0 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:35.202617 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-afeebc6c-c1c7-426f-a10a-72b0ef1593c0 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] 10.222.0.46 "GET /compute/v2.1/servers/552b7547-f4b2-4af0-be24-a4c628408c16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.114739 Jan 15 21:07:35.205409 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2827/5662] 10.222.0.46 () {58 vars in 1301 bytes} [Sat Jan 15 21:07:35 2022] GET /compute/v2.1/servers/552b7547-f4b2-4af0-be24-a4c628408c16/os-volume_attachments => generated 197 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:07:35.501304 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-80a93929-0775-4c51-a250-7d6ba43e85ba tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:07:35.503099 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-80a93929-0775-4c51-a250-7d6ba43e85ba tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:07:35.523638 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-80a93929-0775-4c51-a250-7d6ba43e85ba tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:35.524363 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-80a93929-0775-4c51-a250-7d6ba43e85ba tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:35.525370 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-80a93929-0775-4c51-a250-7d6ba43e85ba tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:35.526194 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-80a93929-0775-4c51-a250-7d6ba43e85ba tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:35.855686 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-80a93929-0775-4c51-a250-7d6ba43e85ba tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:07:35.875110 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-80a93929-0775-4c51-a250-7d6ba43e85ba tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:07:35.883093 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-80a93929-0775-4c51-a250-7d6ba43e85ba tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:07:35.890332 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-80a93929-0775-4c51-a250-7d6ba43e85ba tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "GET /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee" status: 200 len: 2712 microversion: 2.42 time: 0.399802 Jan 15 21:07:35.909476 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2836/5663] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:07:35 2022] GET /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee => generated 2712 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:07:36.060139 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-8cbc60e9-60da-44a6-bdf7-d3b6cb57981c req-38583586-b141-4b54-ae72-06a42b98332d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1884dd3f-949c-4df3-a977-3f6f5a204fee", "name": "network-vif-deleted", "tag": "27dce314-8869-41b8-89c3-42aefdb46190"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:07:36.062385 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:07:36.062385 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:07:36.074574 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-8cbc60e9-60da-44a6-bdf7-d3b6cb57981c req-38583586-b141-4b54-ae72-06a42b98332d service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:36.075022 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-8cbc60e9-60da-44a6-bdf7-d3b6cb57981c req-38583586-b141-4b54-ae72-06a42b98332d service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:36.101955 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-8cbc60e9-60da-44a6-bdf7-d3b6cb57981c req-38583586-b141-4b54-ae72-06a42b98332d service nova] Creating event network-vif-deleted:27dce314-8869-41b8-89c3-42aefdb46190 for instance 1884dd3f-949c-4df3-a977-3f6f5a204fee on nch2-master-1 Jan 15 21:07:36.116192 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-8cbc60e9-60da-44a6-bdf7-d3b6cb57981c req-38583586-b141-4b54-ae72-06a42b98332d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060501 Jan 15 21:07:36.119152 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2828/5664] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:07:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:07:36.218544 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-cd78d795-8104-4f54-a9a7-c7e5b9f99b5e tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:07:36.219664 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-cd78d795-8104-4f54-a9a7-c7e5b9f99b5e tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] [instance: 552b7547-f4b2-4af0-be24-a4c628408c16] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:07:36.245483 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cd78d795-8104-4f54-a9a7-c7e5b9f99b5e tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:36.246964 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cd78d795-8104-4f54-a9a7-c7e5b9f99b5e tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:36.248072 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cd78d795-8104-4f54-a9a7-c7e5b9f99b5e tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:36.252073 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cd78d795-8104-4f54-a9a7-c7e5b9f99b5e tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:36.313036 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-cd78d795-8104-4f54-a9a7-c7e5b9f99b5e tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] 10.222.0.46 "GET /compute/v2.1/servers/552b7547-f4b2-4af0-be24-a4c628408c16/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.100662 Jan 15 21:07:36.319674 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2837/5665] 10.222.0.46 () {58 vars in 1301 bytes} [Sat Jan 15 21:07:36 2022] GET /compute/v2.1/servers/552b7547-f4b2-4af0-be24-a4c628408c16/os-volume_attachments => generated 25 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 21:07:36.598988 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-1abbecbe-cd53-4a20-b276-d48f4815d719 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-677936028", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "networks": [{"uuid": "b55f2173-9368-4426-891c-2ceb82762521"}]}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:07:36.622883 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-a4bbb2ce-1fab-403a-b7df-7c7f17920db9 req-31305554-79be-4ee3-8cff-10d369fed5f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1884dd3f-949c-4df3-a977-3f6f5a204fee", "name": "network-vif-unplugged", "status": "completed", "tag": "897218f9-2c52-48ce-af2d-b6ceececef93"}, {"server_uuid": "1884dd3f-949c-4df3-a977-3f6f5a204fee", "name": "network-vif-unplugged", "status": "completed", "tag": "cddf88bd-8f9f-40f9-9dfd-4dad717d9fbf"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:07:36.624542 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:07:36.624542 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:07:36.641795 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-a4bbb2ce-1fab-403a-b7df-7c7f17920db9 req-31305554-79be-4ee3-8cff-10d369fed5f1 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:36.642250 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-a4bbb2ce-1fab-403a-b7df-7c7f17920db9 req-31305554-79be-4ee3-8cff-10d369fed5f1 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:36.678576 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-a4bbb2ce-1fab-403a-b7df-7c7f17920db9 req-31305554-79be-4ee3-8cff-10d369fed5f1 service nova] Creating event network-vif-unplugged:897218f9-2c52-48ce-af2d-b6ceececef93 for instance 1884dd3f-949c-4df3-a977-3f6f5a204fee on nch2-master-1 Jan 15 21:07:36.679131 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-a4bbb2ce-1fab-403a-b7df-7c7f17920db9 req-31305554-79be-4ee3-8cff-10d369fed5f1 service nova] Creating event network-vif-unplugged:cddf88bd-8f9f-40f9-9dfd-4dad717d9fbf for instance 1884dd3f-949c-4df3-a977-3f6f5a204fee on nch2-master-1 Jan 15 21:07:36.694241 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-a4bbb2ce-1fab-403a-b7df-7c7f17920db9 req-31305554-79be-4ee3-8cff-10d369fed5f1 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.075010 Jan 15 21:07:36.698487 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2838/5666] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:07:36 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:07:36.705619 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.network.neutron [None req-1abbecbe-cd53-4a20-b276-d48f4815d719 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] validate_networks() for [('b55f2173-9368-4426-891c-2ceb82762521', None, None, None, None, None)] {{(pid=129365) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 21:07:36.917886 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ac270fdf-d98d-48a8-ad65-63214580b8bc tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:07:36.921053 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ac270fdf-d98d-48a8-ad65-63214580b8bc tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:07:36.938166 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ac270fdf-d98d-48a8-ad65-63214580b8bc tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:36.945367 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ac270fdf-d98d-48a8-ad65-63214580b8bc tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:36.946648 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ac270fdf-d98d-48a8-ad65-63214580b8bc tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:36.950210 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ac270fdf-d98d-48a8-ad65-63214580b8bc tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:37.573545 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-ac270fdf-d98d-48a8-ad65-63214580b8bc tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:07:37.591742 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-ac270fdf-d98d-48a8-ad65-63214580b8bc tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:07:37.597717 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-ac270fdf-d98d-48a8-ad65-63214580b8bc tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:07:37.602445 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ac270fdf-d98d-48a8-ad65-63214580b8bc tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "GET /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee" status: 200 len: 2507 microversion: 2.42 time: 0.689777 Jan 15 21:07:37.603921 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2839/5667] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:07:36 2022] GET /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee => generated 2507 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 15 21:07:37.992206 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-1abbecbe-cd53-4a20-b276-d48f4815d719 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Flavor limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 21:07:37.993442 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-1abbecbe-cd53-4a20-b276-d48f4815d719 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Image limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 21:07:37.994158 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-1abbecbe-cd53-4a20-b276-d48f4815d719 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Flavor pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 21:07:37.994784 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-1abbecbe-cd53-4a20-b276-d48f4815d719 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Image pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 21:07:37.995528 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-1abbecbe-cd53-4a20-b276-d48f4815d719 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 21:07:38.019698 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1abbecbe-cd53-4a20-b276-d48f4815d719 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:38.023716 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1abbecbe-cd53-4a20-b276-d48f4815d719 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:38.029293 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1abbecbe-cd53-4a20-b276-d48f4815d719 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:38.030110 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1abbecbe-cd53-4a20-b276-d48f4815d719 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:38.098106 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-1abbecbe-cd53-4a20-b276-d48f4815d719 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Getting quotas for project 95e03e1de077453588cc783a4e6d690e. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:07:38.120674 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-1abbecbe-cd53-4a20-b276-d48f4815d719 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Getting quotas for user 822f4a2b1fd6459a8a472bdd066d69fc and project 95e03e1de077453588cc783a4e6d690e. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:07:38.165746 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-1abbecbe-cd53-4a20-b276-d48f4815d719 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Going to run 1 instances... {{(pid=129365) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 21:07:38.169068 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-1abbecbe-cd53-4a20-b276-d48f4815d719 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] [instance: 2eb104af-fb2d-44d7-9c7a-e5380040ecb3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129365) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 21:07:38.197451 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-5ad80ee6-e553-4017-9629-f81879f02246 req-1aa75e6b-8dbe-4229-b60d-1a10345c2a17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1884dd3f-949c-4df3-a977-3f6f5a204fee", "name": "network-vif-deleted", "tag": "e3bdb69c-2e57-497e-80bb-2b7d539e87f7"}, {"server_uuid": "1884dd3f-949c-4df3-a977-3f6f5a204fee", "name": "network-vif-deleted", "tag": "cddf88bd-8f9f-40f9-9dfd-4dad717d9fbf"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:07:38.200124 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:07:38.200124 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:07:38.218085 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-5ad80ee6-e553-4017-9629-f81879f02246 req-1aa75e6b-8dbe-4229-b60d-1a10345c2a17 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:38.218753 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-5ad80ee6-e553-4017-9629-f81879f02246 req-1aa75e6b-8dbe-4229-b60d-1a10345c2a17 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:38.256241 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-5ad80ee6-e553-4017-9629-f81879f02246 req-1aa75e6b-8dbe-4229-b60d-1a10345c2a17 service nova] Creating event network-vif-deleted:e3bdb69c-2e57-497e-80bb-2b7d539e87f7 for instance 1884dd3f-949c-4df3-a977-3f6f5a204fee on nch2-master-1 Jan 15 21:07:38.256767 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-5ad80ee6-e553-4017-9629-f81879f02246 req-1aa75e6b-8dbe-4229-b60d-1a10345c2a17 service nova] Creating event network-vif-deleted:cddf88bd-8f9f-40f9-9dfd-4dad717d9fbf for instance 1884dd3f-949c-4df3-a977-3f6f5a204fee on nch2-master-1 Jan 15 21:07:38.262525 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-5ad80ee6-e553-4017-9629-f81879f02246 req-1aa75e6b-8dbe-4229-b60d-1a10345c2a17 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.072045 Jan 15 21:07:38.279024 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2840/5668] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:07:38 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 21:07:38.361642 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-1abbecbe-cd53-4a20-b276-d48f4815d719 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.769163 Jan 15 21:07:38.362364 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2829/5669] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 21:07:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1773 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 21:07:38.378028 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-62a3296a-51f5-4c98-8ffd-b326ebd3a0f7 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:07:38.378889 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-62a3296a-51f5-4c98-8ffd-b326ebd3a0f7 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] [instance: 2eb104af-fb2d-44d7-9c7a-e5380040ecb3] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:07:38.629376 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-18761791-e602-413b-8cdb-834066c5d096 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:07:38.630275 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-18761791-e602-413b-8cdb-834066c5d096 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:07:38.647161 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-18761791-e602-413b-8cdb-834066c5d096 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:38.656928 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-18761791-e602-413b-8cdb-834066c5d096 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:38.659326 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-18761791-e602-413b-8cdb-834066c5d096 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:38.661561 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-18761791-e602-413b-8cdb-834066c5d096 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:38.757474 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-62a3296a-51f5-4c98-8ffd-b326ebd3a0f7 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822f4a2b1fd6459a8a472bdd066d69fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e03e1de077453588cc783a4e6d690e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:07:38.770728 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-62a3296a-51f5-4c98-8ffd-b326ebd3a0f7 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] 10.222.0.46 "GET /compute/v2.1/servers/2eb104af-fb2d-44d7-9c7a-e5380040ecb3" status: 200 len: 1217 microversion: 2.1 time: 0.400316 Jan 15 21:07:38.777177 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2841/5670] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:07:38 2022] GET /compute/v2.1/servers/2eb104af-fb2d-44d7-9c7a-e5380040ecb3 => generated 1217 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:07:39.310533 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-18761791-e602-413b-8cdb-834066c5d096 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:07:39.373826 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-18761791-e602-413b-8cdb-834066c5d096 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:07:39.393673 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-18761791-e602-413b-8cdb-834066c5d096 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:07:39.412391 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-18761791-e602-413b-8cdb-834066c5d096 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "GET /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee" status: 200 len: 2055 microversion: 2.42 time: 0.786909 Jan 15 21:07:39.429037 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2830/5671] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:07:38 2022] GET /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee => generated 2055 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:07:39.799107 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-da4e6329-4d22-43b7-88b1-1d564692c471 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:07:39.799854 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-da4e6329-4d22-43b7-88b1-1d564692c471 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] [instance: 2eb104af-fb2d-44d7-9c7a-e5380040ecb3] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:07:39.836130 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-da4e6329-4d22-43b7-88b1-1d564692c471 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:39.837231 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-da4e6329-4d22-43b7-88b1-1d564692c471 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:39.838409 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-da4e6329-4d22-43b7-88b1-1d564692c471 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:39.840283 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-da4e6329-4d22-43b7-88b1-1d564692c471 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:39.965927 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-da4e6329-4d22-43b7-88b1-1d564692c471 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822f4a2b1fd6459a8a472bdd066d69fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e03e1de077453588cc783a4e6d690e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:07:39.978495 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-da4e6329-4d22-43b7-88b1-1d564692c471 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] 10.222.0.46 "GET /compute/v2.1/servers/2eb104af-fb2d-44d7-9c7a-e5380040ecb3" status: 200 len: 1269 microversion: 2.1 time: 0.186219 Jan 15 21:07:39.979394 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2842/5672] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:07:39 2022] GET /compute/v2.1/servers/2eb104af-fb2d-44d7-9c7a-e5380040ecb3 => generated 1269 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:07:40.338202 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-180f9d69-2b1c-4548-bc67-bc3b4e89bdcb req-498d00b5-8159-49ec-a82d-481ec4347ae1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1884dd3f-949c-4df3-a977-3f6f5a204fee", "name": "network-vif-deleted", "tag": "897218f9-2c52-48ce-af2d-b6ceececef93"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:07:40.341080 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:07:40.341080 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:07:40.367601 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-180f9d69-2b1c-4548-bc67-bc3b4e89bdcb req-498d00b5-8159-49ec-a82d-481ec4347ae1 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:40.368950 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-180f9d69-2b1c-4548-bc67-bc3b4e89bdcb req-498d00b5-8159-49ec-a82d-481ec4347ae1 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:40.404081 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-180f9d69-2b1c-4548-bc67-bc3b4e89bdcb req-498d00b5-8159-49ec-a82d-481ec4347ae1 service nova] Creating event network-vif-deleted:897218f9-2c52-48ce-af2d-b6ceececef93 for instance 1884dd3f-949c-4df3-a977-3f6f5a204fee on nch2-master-1 Jan 15 21:07:40.416145 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-180f9d69-2b1c-4548-bc67-bc3b4e89bdcb req-498d00b5-8159-49ec-a82d-481ec4347ae1 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083457 Jan 15 21:07:40.417573 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2831/5673] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:07:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:07:40.453233 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a7d6e138-7837-4870-bc16-0a092e6f5770 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:07:40.453966 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a7d6e138-7837-4870-bc16-0a092e6f5770 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:07:40.465439 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a7d6e138-7837-4870-bc16-0a092e6f5770 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:40.467797 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a7d6e138-7837-4870-bc16-0a092e6f5770 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:40.472433 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a7d6e138-7837-4870-bc16-0a092e6f5770 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:40.473165 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a7d6e138-7837-4870-bc16-0a092e6f5770 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:40.550345 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a7d6e138-7837-4870-bc16-0a092e6f5770 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:40.552029 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a7d6e138-7837-4870-bc16-0a092e6f5770 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:40.552987 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.objects.instance [None req-a7d6e138-7837-4870-bc16-0a092e6f5770 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lazy-loading 'fault' on Instance uuid 1884dd3f-949c-4df3-a977-3f6f5a204fee {{(pid=129366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 21:07:40.652877 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-a7d6e138-7837-4870-bc16-0a092e6f5770 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:07:40.662584 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-a7d6e138-7837-4870-bc16-0a092e6f5770 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:07:40.665177 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-a7d6e138-7837-4870-bc16-0a092e6f5770 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36d0deec10a44cf7b451501768112c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa080ba5c4e041ae8960caa9e14da5b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:07:40.666928 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a7d6e138-7837-4870-bc16-0a092e6f5770 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "GET /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee" status: 200 len: 1371 microversion: 2.42 time: 0.222796 Jan 15 21:07:40.669239 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2843/5674] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:07:40 2022] GET /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee => generated 1371 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:07:41.000536 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-154ebca4-5c14-42f3-a6aa-b49b55688638 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:07:41.001204 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-154ebca4-5c14-42f3-a6aa-b49b55688638 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] [instance: 2eb104af-fb2d-44d7-9c7a-e5380040ecb3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:07:41.008504 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-154ebca4-5c14-42f3-a6aa-b49b55688638 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:41.009926 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-154ebca4-5c14-42f3-a6aa-b49b55688638 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:41.010909 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-154ebca4-5c14-42f3-a6aa-b49b55688638 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:41.011857 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-154ebca4-5c14-42f3-a6aa-b49b55688638 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:41.307892 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-154ebca4-5c14-42f3-a6aa-b49b55688638 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822f4a2b1fd6459a8a472bdd066d69fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e03e1de077453588cc783a4e6d690e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:07:41.315557 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-154ebca4-5c14-42f3-a6aa-b49b55688638 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] 10.222.0.46 "GET /compute/v2.1/servers/2eb104af-fb2d-44d7-9c7a-e5380040ecb3" status: 200 len: 1317 microversion: 2.1 time: 0.319212 Jan 15 21:07:41.316380 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2832/5675] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:07:40 2022] GET /compute/v2.1/servers/2eb104af-fb2d-44d7-9c7a-e5380040ecb3 => generated 1317 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:07:41.686667 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-95388549-8d4c-4e54-bf1c-5d0363f21b49 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:07:41.687302 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-95388549-8d4c-4e54-bf1c-5d0363f21b49 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:07:41.696635 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-95388549-8d4c-4e54-bf1c-5d0363f21b49 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:41.697123 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-95388549-8d4c-4e54-bf1c-5d0363f21b49 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:41.697926 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-95388549-8d4c-4e54-bf1c-5d0363f21b49 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:41.698368 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-95388549-8d4c-4e54-bf1c-5d0363f21b49 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:41.742391 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-95388549-8d4c-4e54-bf1c-5d0363f21b49 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] HTTP exception thrown: Instance 1884dd3f-949c-4df3-a977-3f6f5a204fee could not be found. Jan 15 21:07:41.743314 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-95388549-8d4c-4e54-bf1c-5d0363f21b49 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Returning 404 to user: Instance 1884dd3f-949c-4df3-a977-3f6f5a204fee could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:07:41.744326 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-95388549-8d4c-4e54-bf1c-5d0363f21b49 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "GET /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee" status: 404 len: 111 microversion: 2.42 time: 0.061447 Jan 15 21:07:41.745371 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2844/5676] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:07:41 2022] GET /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 15 21:07:41.753261 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-cf313cc2-a227-4ad9-bcff-0cb57b491ec2 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Calling method '.version_select at 0x7f30c8e6a9d0>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:07:41.789931 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-cf313cc2-a227-4ad9-bcff-0cb57b491ec2 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-842385728" status: 204 len: 0 microversion: 2.42 time: 0.040057 Jan 15 21:07:41.800281 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2833/5677] 10.222.0.46 () {60 vars in 1258 bytes} [Sat Jan 15 21:07:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-842385728 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 15 21:07:42.337800 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7e05ff88-105e-4552-9afa-b408cb084d91 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:07:42.339304 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-7e05ff88-105e-4552-9afa-b408cb084d91 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] [instance: 2eb104af-fb2d-44d7-9c7a-e5380040ecb3] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:07:42.347175 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7e05ff88-105e-4552-9afa-b408cb084d91 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:42.347659 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7e05ff88-105e-4552-9afa-b408cb084d91 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:42.348508 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7e05ff88-105e-4552-9afa-b408cb084d91 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:42.349036 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7e05ff88-105e-4552-9afa-b408cb084d91 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:42.894753 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-7dce9a21-3349-42db-bed6-3247cb72aa1a req-c3218188-b583-4697-9fe9-7728b59739f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2eb104af-fb2d-44d7-9c7a-e5380040ecb3", "tag": "f0ae0f22-a1b8-49b7-9461-1ae6917cbdb3"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:07:42.900082 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:07:42.900082 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:07:42.934225 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-7dce9a21-3349-42db-bed6-3247cb72aa1a req-c3218188-b583-4697-9fe9-7728b59739f2 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:42.934676 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-7dce9a21-3349-42db-bed6-3247cb72aa1a req-c3218188-b583-4697-9fe9-7728b59739f2 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:42.948353 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-7dce9a21-3349-42db-bed6-3247cb72aa1a req-c3218188-b583-4697-9fe9-7728b59739f2 service nova] Creating event network-changed:f0ae0f22-a1b8-49b7-9461-1ae6917cbdb3 for instance 2eb104af-fb2d-44d7-9c7a-e5380040ecb3 on nch2-master-1 Jan 15 21:07:42.953982 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-7dce9a21-3349-42db-bed6-3247cb72aa1a req-c3218188-b583-4697-9fe9-7728b59739f2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066554 Jan 15 21:07:42.954596 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2834/5678] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:07:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:07:43.061114 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-7e05ff88-105e-4552-9afa-b408cb084d91 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822f4a2b1fd6459a8a472bdd066d69fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e03e1de077453588cc783a4e6d690e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:07:43.073798 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7e05ff88-105e-4552-9afa-b408cb084d91 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] 10.222.0.46 "GET /compute/v2.1/servers/2eb104af-fb2d-44d7-9c7a-e5380040ecb3" status: 200 len: 1317 microversion: 2.1 time: 0.743399 Jan 15 21:07:43.076818 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2845/5679] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:07:42 2022] GET /compute/v2.1/servers/2eb104af-fb2d-44d7-9c7a-e5380040ecb3 => generated 1317 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:07:44.101778 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-da211b04-f949-4abc-9cac-f00227905f12 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:07:44.103409 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-da211b04-f949-4abc-9cac-f00227905f12 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] [instance: 2eb104af-fb2d-44d7-9c7a-e5380040ecb3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:07:44.124641 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-da211b04-f949-4abc-9cac-f00227905f12 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:44.127334 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-da211b04-f949-4abc-9cac-f00227905f12 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:44.132260 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-da211b04-f949-4abc-9cac-f00227905f12 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:44.134696 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-da211b04-f949-4abc-9cac-f00227905f12 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:44.701902 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-da211b04-f949-4abc-9cac-f00227905f12 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822f4a2b1fd6459a8a472bdd066d69fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e03e1de077453588cc783a4e6d690e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:07:44.722517 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-da211b04-f949-4abc-9cac-f00227905f12 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] 10.222.0.46 "GET /compute/v2.1/servers/2eb104af-fb2d-44d7-9c7a-e5380040ecb3" status: 200 len: 1317 microversion: 2.1 time: 0.627720 Jan 15 21:07:44.724054 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2835/5680] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:07:44 2022] GET /compute/v2.1/servers/2eb104af-fb2d-44d7-9c7a-e5380040ecb3 => generated 1317 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:07:45.743000 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d76bf583-5ca3-44ac-8bf7-23c942ee32d5 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:07:45.744893 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-d76bf583-5ca3-44ac-8bf7-23c942ee32d5 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] [instance: 2eb104af-fb2d-44d7-9c7a-e5380040ecb3] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:07:45.753788 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d76bf583-5ca3-44ac-8bf7-23c942ee32d5 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:45.754598 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d76bf583-5ca3-44ac-8bf7-23c942ee32d5 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:45.756223 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d76bf583-5ca3-44ac-8bf7-23c942ee32d5 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:45.758682 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d76bf583-5ca3-44ac-8bf7-23c942ee32d5 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:46.296105 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-d76bf583-5ca3-44ac-8bf7-23c942ee32d5 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822f4a2b1fd6459a8a472bdd066d69fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e03e1de077453588cc783a4e6d690e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:07:46.316032 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d76bf583-5ca3-44ac-8bf7-23c942ee32d5 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] 10.222.0.46 "GET /compute/v2.1/servers/2eb104af-fb2d-44d7-9c7a-e5380040ecb3" status: 200 len: 1317 microversion: 2.1 time: 0.577373 Jan 15 21:07:46.318497 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2846/5681] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:07:45 2022] GET /compute/v2.1/servers/2eb104af-fb2d-44d7-9c7a-e5380040ecb3 => generated 1317 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:07:47.336746 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c3047eb3-4bdc-4522-8055-6c4b4e30fe15 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:07:47.337956 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c3047eb3-4bdc-4522-8055-6c4b4e30fe15 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] [instance: 2eb104af-fb2d-44d7-9c7a-e5380040ecb3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:07:47.370318 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c3047eb3-4bdc-4522-8055-6c4b4e30fe15 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:47.385125 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c3047eb3-4bdc-4522-8055-6c4b4e30fe15 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:47.386596 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c3047eb3-4bdc-4522-8055-6c4b4e30fe15 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:47.387329 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c3047eb3-4bdc-4522-8055-6c4b4e30fe15 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:47.547646 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b92da387-d104-49d8-a5d0-feafe529bbe3 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:07:47.549052 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b92da387-d104-49d8-a5d0-feafe529bbe3 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:07:47.570131 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b92da387-d104-49d8-a5d0-feafe529bbe3 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:47.573578 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b92da387-d104-49d8-a5d0-feafe529bbe3 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:47.574894 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b92da387-d104-49d8-a5d0-feafe529bbe3 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:47.577576 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b92da387-d104-49d8-a5d0-feafe529bbe3 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:47.621515 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-b92da387-d104-49d8-a5d0-feafe529bbe3 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] HTTP exception thrown: Instance 1884dd3f-949c-4df3-a977-3f6f5a204fee could not be found. Jan 15 21:07:47.623990 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b92da387-d104-49d8-a5d0-feafe529bbe3 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Returning 404 to user: Instance 1884dd3f-949c-4df3-a977-3f6f5a204fee could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:07:47.625367 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b92da387-d104-49d8-a5d0-feafe529bbe3 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "DELETE /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee" status: 404 len: 111 microversion: 2.42 time: 0.087816 Jan 15 21:07:47.630800 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2847/5682] 10.222.0.46 () {60 vars in 1279 bytes} [Sat Jan 15 21:07:47 2022] DELETE /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jan 15 21:07:47.645671 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d01adfaf-fe1d-42a7-8d2e-48c67c6a23e9 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:07:47.649203 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-d01adfaf-fe1d-42a7-8d2e-48c67c6a23e9 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] [instance: 1884dd3f-949c-4df3-a977-3f6f5a204fee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:07:47.656710 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d01adfaf-fe1d-42a7-8d2e-48c67c6a23e9 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:47.657767 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d01adfaf-fe1d-42a7-8d2e-48c67c6a23e9 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:47.659306 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d01adfaf-fe1d-42a7-8d2e-48c67c6a23e9 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:47.659924 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d01adfaf-fe1d-42a7-8d2e-48c67c6a23e9 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:47.681355 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-d01adfaf-fe1d-42a7-8d2e-48c67c6a23e9 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] HTTP exception thrown: Instance 1884dd3f-949c-4df3-a977-3f6f5a204fee could not be found. Jan 15 21:07:47.682203 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d01adfaf-fe1d-42a7-8d2e-48c67c6a23e9 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] Returning 404 to user: Instance 1884dd3f-949c-4df3-a977-3f6f5a204fee could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:07:47.683157 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d01adfaf-fe1d-42a7-8d2e-48c67c6a23e9 tempest-TaggedBootDevicesTest_v242-1223982624 tempest-TaggedBootDevicesTest_v242-1223982624-project] 10.222.0.46 "GET /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee" status: 404 len: 111 microversion: 2.42 time: 0.047790 Jan 15 21:07:47.684134 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2848/5683] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:07:47 2022] GET /compute/v2.1/servers/1884dd3f-949c-4df3-a977-3f6f5a204fee => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 15 21:07:47.815930 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-c3047eb3-4bdc-4522-8055-6c4b4e30fe15 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822f4a2b1fd6459a8a472bdd066d69fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e03e1de077453588cc783a4e6d690e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:07:47.834176 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c3047eb3-4bdc-4522-8055-6c4b4e30fe15 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] 10.222.0.46 "GET /compute/v2.1/servers/2eb104af-fb2d-44d7-9c7a-e5380040ecb3" status: 200 len: 1317 microversion: 2.1 time: 0.503258 Jan 15 21:07:47.835090 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2836/5684] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:07:47 2022] GET /compute/v2.1/servers/2eb104af-fb2d-44d7-9c7a-e5380040ecb3 => generated 1317 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:07:48.861213 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9e171b53-f258-463c-8da1-6f2fb900652c tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:07:48.861920 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-9e171b53-f258-463c-8da1-6f2fb900652c tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] [instance: 2eb104af-fb2d-44d7-9c7a-e5380040ecb3] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:07:48.928447 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9e171b53-f258-463c-8da1-6f2fb900652c tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:48.953008 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9e171b53-f258-463c-8da1-6f2fb900652c tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:48.956502 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9e171b53-f258-463c-8da1-6f2fb900652c tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:48.956502 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9e171b53-f258-463c-8da1-6f2fb900652c tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:49.085652 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-951bf13b-1695-405e-82d2-63091eddff98 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:07:49.088084 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-951bf13b-1695-405e-82d2-63091eddff98 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:07:49.110370 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-951bf13b-1695-405e-82d2-63091eddff98 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:49.110824 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-951bf13b-1695-405e-82d2-63091eddff98 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:49.111637 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-951bf13b-1695-405e-82d2-63091eddff98 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:49.112071 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-951bf13b-1695-405e-82d2-63091eddff98 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:49.187870 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-951bf13b-1695-405e-82d2-63091eddff98 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.105693 Jan 15 21:07:49.189574 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2837/5685] 10.222.0.46 () {60 vars in 1342 bytes} [Sat Jan 15 21:07:49 2022] GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42/os-volume_attachments => generated 25 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:07:49.423735 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-91636172-8667-4446-8c01-82c2fd08fb6b tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:07:49.424512 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-91636172-8667-4446-8c01-82c2fd08fb6b tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:07:49.439746 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-91636172-8667-4446-8c01-82c2fd08fb6b tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:49.443043 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-91636172-8667-4446-8c01-82c2fd08fb6b tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:49.445013 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-91636172-8667-4446-8c01-82c2fd08fb6b tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:49.445474 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-91636172-8667-4446-8c01-82c2fd08fb6b tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:49.527578 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-9e171b53-f258-463c-8da1-6f2fb900652c tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822f4a2b1fd6459a8a472bdd066d69fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e03e1de077453588cc783a4e6d690e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:07:49.539192 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-9e171b53-f258-463c-8da1-6f2fb900652c tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] 10.222.0.46 "GET /compute/v2.1/servers/2eb104af-fb2d-44d7-9c7a-e5380040ecb3" status: 200 len: 1317 microversion: 2.1 time: 0.681797 Jan 15 21:07:49.541932 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2849/5686] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:07:48 2022] GET /compute/v2.1/servers/2eb104af-fb2d-44d7-9c7a-e5380040ecb3 => generated 1317 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:07:49.584028 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-91636172-8667-4446-8c01-82c2fd08fb6b tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Going to try to terminate instance {{(pid=129365) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 21:07:49.813102 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-91636172-8667-4446-8c01-82c2fd08fb6b tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "DELETE /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42" status: 204 len: 0 microversion: 2.20 time: 0.395475 Jan 15 21:07:49.816777 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2838/5687] 10.222.0.46 () {60 vars in 1279 bytes} [Sat Jan 15 21:07:49 2022] DELETE /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 15 21:07:49.826890 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-faab6e42-007f-48ed-acaa-3b04aef496aa tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:07:49.828571 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-faab6e42-007f-48ed-acaa-3b04aef496aa tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:07:49.845446 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-faab6e42-007f-48ed-acaa-3b04aef496aa tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:49.845911 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-faab6e42-007f-48ed-acaa-3b04aef496aa tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:49.859401 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-faab6e42-007f-48ed-acaa-3b04aef496aa tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:49.859401 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-faab6e42-007f-48ed-acaa-3b04aef496aa tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:50.123681 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-faab6e42-007f-48ed-acaa-3b04aef496aa tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:07:50.140625 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-faab6e42-007f-48ed-acaa-3b04aef496aa tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:07:50.145913 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-faab6e42-007f-48ed-acaa-3b04aef496aa tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:07:50.150629 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-faab6e42-007f-48ed-acaa-3b04aef496aa tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42" status: 200 len: 1722 microversion: 2.20 time: 0.327844 Jan 15 21:07:50.155873 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2850/5688] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:07:49 2022] GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42 => generated 1722 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:07:50.574114 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-4c04dc4f-f303-48a9-89bd-0dd806902865 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:07:50.578121 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-4c04dc4f-f303-48a9-89bd-0dd806902865 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] [instance: 2eb104af-fb2d-44d7-9c7a-e5380040ecb3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:07:50.594787 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4c04dc4f-f303-48a9-89bd-0dd806902865 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:50.596461 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4c04dc4f-f303-48a9-89bd-0dd806902865 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:50.598275 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4c04dc4f-f303-48a9-89bd-0dd806902865 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:50.599009 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4c04dc4f-f303-48a9-89bd-0dd806902865 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:50.905113 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-4c04dc4f-f303-48a9-89bd-0dd806902865 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822f4a2b1fd6459a8a472bdd066d69fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e03e1de077453588cc783a4e6d690e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:07:50.925753 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-4c04dc4f-f303-48a9-89bd-0dd806902865 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] 10.222.0.46 "GET /compute/v2.1/servers/2eb104af-fb2d-44d7-9c7a-e5380040ecb3" status: 200 len: 1317 microversion: 2.1 time: 0.367864 Jan 15 21:07:50.943054 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2839/5689] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:07:50 2022] GET /compute/v2.1/servers/2eb104af-fb2d-44d7-9c7a-e5380040ecb3 => generated 1317 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:07:51.173968 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4aaf46ad-d174-415c-a281-5f1f4d476eea tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:07:51.175986 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-4aaf46ad-d174-415c-a281-5f1f4d476eea tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:07:51.199682 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4aaf46ad-d174-415c-a281-5f1f4d476eea tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:51.200983 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4aaf46ad-d174-415c-a281-5f1f4d476eea tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:51.202028 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4aaf46ad-d174-415c-a281-5f1f4d476eea tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:51.204221 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4aaf46ad-d174-415c-a281-5f1f4d476eea tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:51.607892 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-4aaf46ad-d174-415c-a281-5f1f4d476eea tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:07:51.622015 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-4aaf46ad-d174-415c-a281-5f1f4d476eea tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:07:51.626345 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-4aaf46ad-d174-415c-a281-5f1f4d476eea tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:07:51.630424 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-4aaf46ad-d174-415c-a281-5f1f4d476eea tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42" status: 200 len: 1722 microversion: 2.20 time: 0.460926 Jan 15 21:07:51.633893 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2851/5690] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:07:51 2022] GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42 => generated 1722 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:07:51.950534 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-7c00200e-63ce-4500-b6ad-08e732436e6e tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:07:51.952357 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-7c00200e-63ce-4500-b6ad-08e732436e6e tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] [instance: 2eb104af-fb2d-44d7-9c7a-e5380040ecb3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:07:51.996917 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7c00200e-63ce-4500-b6ad-08e732436e6e tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:51.999892 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7c00200e-63ce-4500-b6ad-08e732436e6e tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:52.002858 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7c00200e-63ce-4500-b6ad-08e732436e6e tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:52.005378 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7c00200e-63ce-4500-b6ad-08e732436e6e tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:52.369062 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-7c00200e-63ce-4500-b6ad-08e732436e6e tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822f4a2b1fd6459a8a472bdd066d69fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e03e1de077453588cc783a4e6d690e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:07:52.400747 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-7c00200e-63ce-4500-b6ad-08e732436e6e tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] 10.222.0.46 "GET /compute/v2.1/servers/2eb104af-fb2d-44d7-9c7a-e5380040ecb3" status: 200 len: 1317 microversion: 2.1 time: 0.456187 Jan 15 21:07:52.412504 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2840/5691] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:07:51 2022] GET /compute/v2.1/servers/2eb104af-fb2d-44d7-9c7a-e5380040ecb3 => generated 1317 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:07:52.514500 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-b89dd7bd-0643-41d2-b136-374d4e881a3a req-6d8e47c3-a5e5-4938-883e-0fe8943360a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2eb104af-fb2d-44d7-9c7a-e5380040ecb3", "name": "network-vif-plugged", "status": "completed", "tag": "f0ae0f22-a1b8-49b7-9461-1ae6917cbdb3"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:07:52.516359 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:07:52.516359 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:07:52.546429 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-b89dd7bd-0643-41d2-b136-374d4e881a3a req-6d8e47c3-a5e5-4938-883e-0fe8943360a1 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:52.546710 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-b89dd7bd-0643-41d2-b136-374d4e881a3a req-6d8e47c3-a5e5-4938-883e-0fe8943360a1 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:52.587224 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-b89dd7bd-0643-41d2-b136-374d4e881a3a req-6d8e47c3-a5e5-4938-883e-0fe8943360a1 service nova] Creating event network-vif-plugged:f0ae0f22-a1b8-49b7-9461-1ae6917cbdb3 for instance 2eb104af-fb2d-44d7-9c7a-e5380040ecb3 on nch2-master-1 Jan 15 21:07:52.611589 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-b89dd7bd-0643-41d2-b136-374d4e881a3a req-6d8e47c3-a5e5-4938-883e-0fe8943360a1 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100097 Jan 15 21:07:52.614392 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2852/5692] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:07:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:07:52.652503 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-7d5e3181-e569-4616-bcfe-2b6edbe3ad11 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:07:52.653458 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-7d5e3181-e569-4616-bcfe-2b6edbe3ad11 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:07:52.662687 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7d5e3181-e569-4616-bcfe-2b6edbe3ad11 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:52.663146 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7d5e3181-e569-4616-bcfe-2b6edbe3ad11 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:52.663951 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7d5e3181-e569-4616-bcfe-2b6edbe3ad11 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:52.667358 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7d5e3181-e569-4616-bcfe-2b6edbe3ad11 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:52.818006 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-7d5e3181-e569-4616-bcfe-2b6edbe3ad11 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:07:52.835329 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-7d5e3181-e569-4616-bcfe-2b6edbe3ad11 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:07:52.837075 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-7d5e3181-e569-4616-bcfe-2b6edbe3ad11 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:07:52.838297 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-7d5e3181-e569-4616-bcfe-2b6edbe3ad11 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42" status: 200 len: 1654 microversion: 2.20 time: 0.190201 Jan 15 21:07:52.846898 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2841/5693] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:07:52 2022] GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42 => generated 1654 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:07:53.428023 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7b58a8f4-6bf4-4524-afe7-98bf0cfdb5d7 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:07:53.429340 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-7b58a8f4-6bf4-4524-afe7-98bf0cfdb5d7 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] [instance: 2eb104af-fb2d-44d7-9c7a-e5380040ecb3] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:07:53.447119 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7b58a8f4-6bf4-4524-afe7-98bf0cfdb5d7 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:53.447977 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7b58a8f4-6bf4-4524-afe7-98bf0cfdb5d7 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:53.448800 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7b58a8f4-6bf4-4524-afe7-98bf0cfdb5d7 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:53.449274 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7b58a8f4-6bf4-4524-afe7-98bf0cfdb5d7 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:53.763183 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-614c511d-1107-4d40-b7f7-d983aad0cb62 req-22e12a18-d0e8-405a-95e3-8abfc78c54d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1b412a8-0407-44fd-8f16-7cbcd8de3a42", "name": "network-vif-deleted", "tag": "d027fed2-822f-40a2-a052-26b22c1aef53"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:07:53.765739 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:07:53.765739 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:07:53.777647 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-614c511d-1107-4d40-b7f7-d983aad0cb62 req-22e12a18-d0e8-405a-95e3-8abfc78c54d6 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:53.778417 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-614c511d-1107-4d40-b7f7-d983aad0cb62 req-22e12a18-d0e8-405a-95e3-8abfc78c54d6 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:53.796032 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-614c511d-1107-4d40-b7f7-d983aad0cb62 req-22e12a18-d0e8-405a-95e3-8abfc78c54d6 service nova] Creating event network-vif-deleted:d027fed2-822f-40a2-a052-26b22c1aef53 for instance a1b412a8-0407-44fd-8f16-7cbcd8de3a42 on nch1-master-1 Jan 15 21:07:53.839448 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-614c511d-1107-4d40-b7f7-d983aad0cb62 req-22e12a18-d0e8-405a-95e3-8abfc78c54d6 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068550 Jan 15 21:07:53.840505 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2842/5694] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:07:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 21:07:53.865610 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-908b30ef-77c2-47bc-9e1e-c12cf07aa899 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:07:53.867533 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-908b30ef-77c2-47bc-9e1e-c12cf07aa899 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:07:53.883152 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-908b30ef-77c2-47bc-9e1e-c12cf07aa899 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:53.883888 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-908b30ef-77c2-47bc-9e1e-c12cf07aa899 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:53.886630 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-908b30ef-77c2-47bc-9e1e-c12cf07aa899 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:53.888227 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-908b30ef-77c2-47bc-9e1e-c12cf07aa899 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:53.935673 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-908b30ef-77c2-47bc-9e1e-c12cf07aa899 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:53.936443 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-908b30ef-77c2-47bc-9e1e-c12cf07aa899 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:53.937115 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.objects.instance [None req-908b30ef-77c2-47bc-9e1e-c12cf07aa899 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lazy-loading 'fault' on Instance uuid a1b412a8-0407-44fd-8f16-7cbcd8de3a42 {{(pid=129365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 21:07:54.060389 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-908b30ef-77c2-47bc-9e1e-c12cf07aa899 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:07:54.076224 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-908b30ef-77c2-47bc-9e1e-c12cf07aa899 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:07:54.079795 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-908b30ef-77c2-47bc-9e1e-c12cf07aa899 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffbeca0a8c6247bb9cf07d84b7c53a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818a237ecf6b46e389a244c2f33641d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:07:54.083485 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-908b30ef-77c2-47bc-9e1e-c12cf07aa899 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42" status: 200 len: 1370 microversion: 2.20 time: 0.222291 Jan 15 21:07:54.095475 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-7b58a8f4-6bf4-4524-afe7-98bf0cfdb5d7 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822f4a2b1fd6459a8a472bdd066d69fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e03e1de077453588cc783a4e6d690e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:07:54.097073 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2843/5695] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:07:53 2022] GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42 => generated 1370 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 15 21:07:54.105313 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7b58a8f4-6bf4-4524-afe7-98bf0cfdb5d7 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] 10.222.0.46 "GET /compute/v2.1/servers/2eb104af-fb2d-44d7-9c7a-e5380040ecb3" status: 200 len: 1317 microversion: 2.1 time: 0.688947 Jan 15 21:07:54.123160 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2853/5696] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:07:53 2022] GET /compute/v2.1/servers/2eb104af-fb2d-44d7-9c7a-e5380040ecb3 => generated 1317 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:07:55.115757 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f65fb0dc-ba99-4b6b-8a3c-3a31c1bfeb31 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:07:55.116365 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f65fb0dc-ba99-4b6b-8a3c-3a31c1bfeb31 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:07:55.123295 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e2b059cf-2d3b-401a-b9b7-297801c401c1 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:07:55.124655 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e2b059cf-2d3b-401a-b9b7-297801c401c1 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] [instance: 2eb104af-fb2d-44d7-9c7a-e5380040ecb3] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:07:55.138974 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f65fb0dc-ba99-4b6b-8a3c-3a31c1bfeb31 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:55.138974 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f65fb0dc-ba99-4b6b-8a3c-3a31c1bfeb31 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:55.138974 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f65fb0dc-ba99-4b6b-8a3c-3a31c1bfeb31 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:55.138974 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f65fb0dc-ba99-4b6b-8a3c-3a31c1bfeb31 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:55.170558 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e2b059cf-2d3b-401a-b9b7-297801c401c1 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:55.182229 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e2b059cf-2d3b-401a-b9b7-297801c401c1 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:55.183107 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e2b059cf-2d3b-401a-b9b7-297801c401c1 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:55.183561 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e2b059cf-2d3b-401a-b9b7-297801c401c1 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:55.197925 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-f65fb0dc-ba99-4b6b-8a3c-3a31c1bfeb31 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] HTTP exception thrown: Instance a1b412a8-0407-44fd-8f16-7cbcd8de3a42 could not be found. Jan 15 21:07:55.199704 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f65fb0dc-ba99-4b6b-8a3c-3a31c1bfeb31 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Returning 404 to user: Instance a1b412a8-0407-44fd-8f16-7cbcd8de3a42 could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:07:55.201680 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f65fb0dc-ba99-4b6b-8a3c-3a31c1bfeb31 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42" status: 404 len: 111 microversion: 2.20 time: 0.101294 Jan 15 21:07:55.208791 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2844/5697] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:07:55 2022] GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 15 21:07:55.220368 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3392493d-8be3-4da9-84ec-d27ee2325542 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '.version_select at 0x7f30c83c0670>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:07:55.256075 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3392493d-8be3-4da9-84ec-d27ee2325542 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-77400351" status: 204 len: 0 microversion: 2.20 time: 0.044811 Jan 15 21:07:55.261133 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2845/5698] 10.222.0.46 () {60 vars in 1255 bytes} [Sat Jan 15 21:07:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-77400351 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 15 21:07:55.637706 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-e2b059cf-2d3b-401a-b9b7-297801c401c1 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822f4a2b1fd6459a8a472bdd066d69fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e03e1de077453588cc783a4e6d690e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:07:55.654127 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e2b059cf-2d3b-401a-b9b7-297801c401c1 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] 10.222.0.46 "GET /compute/v2.1/servers/2eb104af-fb2d-44d7-9c7a-e5380040ecb3" status: 200 len: 1507 microversion: 2.1 time: 0.528040 Jan 15 21:07:55.655128 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2854/5699] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:07:55 2022] GET /compute/v2.1/servers/2eb104af-fb2d-44d7-9c7a-e5380040ecb3 => generated 1507 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:07:57.415840 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c9508fda-6696-44be-a779-77b043360c5d tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9dd562f9-7a3d-489b-8619-26ee0403ebb9"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:07:57.417462 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c9508fda-6696-44be-a779-77b043360c5d tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] [instance: 2eb104af-fb2d-44d7-9c7a-e5380040ecb3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:07:57.428335 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c9508fda-6696-44be-a779-77b043360c5d tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:57.429285 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c9508fda-6696-44be-a779-77b043360c5d tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:57.430858 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c9508fda-6696-44be-a779-77b043360c5d tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:57.431655 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c9508fda-6696-44be-a779-77b043360c5d tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:57.999224 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c9508fda-6696-44be-a779-77b043360c5d tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] 10.222.0.46 "POST /compute/v2.1/servers/2eb104af-fb2d-44d7-9c7a-e5380040ecb3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.594050 Jan 15 21:07:58.000265 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2846/5700] 10.222.0.46 () {60 vars in 1322 bytes} [Sat Jan 15 21:07:57 2022] POST /compute/v2.1/servers/2eb104af-fb2d-44d7-9c7a-e5380040ecb3/os-volume_attachments => generated 194 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:07:58.377042 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-17489400-ad4d-4466-adad-4dc8f2a87526 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:07:58.377604 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-17489400-ad4d-4466-adad-4dc8f2a87526 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:07:58.385466 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-17489400-ad4d-4466-adad-4dc8f2a87526 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:58.385919 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-17489400-ad4d-4466-adad-4dc8f2a87526 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:58.395130 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-17489400-ad4d-4466-adad-4dc8f2a87526 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:58.395621 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-17489400-ad4d-4466-adad-4dc8f2a87526 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:58.445650 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-17489400-ad4d-4466-adad-4dc8f2a87526 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] HTTP exception thrown: Instance a1b412a8-0407-44fd-8f16-7cbcd8de3a42 could not be found. Jan 15 21:07:58.446176 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-17489400-ad4d-4466-adad-4dc8f2a87526 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Returning 404 to user: Instance a1b412a8-0407-44fd-8f16-7cbcd8de3a42 could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:07:58.454652 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-17489400-ad4d-4466-adad-4dc8f2a87526 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "DELETE /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42" status: 404 len: 111 microversion: 2.20 time: 0.081577 Jan 15 21:07:58.455270 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2855/5701] 10.222.0.46 () {60 vars in 1279 bytes} [Sat Jan 15 21:07:58 2022] DELETE /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jan 15 21:07:58.465369 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-322b4ffc-f872-47e3-982b-4b1c1d5cc270 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:07:58.466215 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-322b4ffc-f872-47e3-982b-4b1c1d5cc270 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: a1b412a8-0407-44fd-8f16-7cbcd8de3a42] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:07:58.480621 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-322b4ffc-f872-47e3-982b-4b1c1d5cc270 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:58.493062 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-322b4ffc-f872-47e3-982b-4b1c1d5cc270 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:58.494677 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-322b4ffc-f872-47e3-982b-4b1c1d5cc270 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:58.495935 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-322b4ffc-f872-47e3-982b-4b1c1d5cc270 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:58.539584 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-322b4ffc-f872-47e3-982b-4b1c1d5cc270 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] HTTP exception thrown: Instance a1b412a8-0407-44fd-8f16-7cbcd8de3a42 could not be found. Jan 15 21:07:58.540750 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-322b4ffc-f872-47e3-982b-4b1c1d5cc270 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Returning 404 to user: Instance a1b412a8-0407-44fd-8f16-7cbcd8de3a42 could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:07:58.543189 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-322b4ffc-f872-47e3-982b-4b1c1d5cc270 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42" status: 404 len: 111 microversion: 2.20 time: 0.082325 Jan 15 21:07:58.546270 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2847/5702] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:07:58 2022] GET /compute/v2.1/servers/a1b412a8-0407-44fd-8f16-7cbcd8de3a42 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 15 21:07:59.903400 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-61b31aa6-5ae9-46c3-a49d-5ca28c64c101 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:07:59.905661 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-61b31aa6-5ae9-46c3-a49d-5ca28c64c101 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:07:59.926267 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-61b31aa6-5ae9-46c3-a49d-5ca28c64c101 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:59.928007 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-61b31aa6-5ae9-46c3-a49d-5ca28c64c101 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:59.929909 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-61b31aa6-5ae9-46c3-a49d-5ca28c64c101 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:59.932409 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-61b31aa6-5ae9-46c3-a49d-5ca28c64c101 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:59.962392 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-61b31aa6-5ae9-46c3-a49d-5ca28c64c101 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] HTTP exception thrown: Instance 0ac722a3-aadf-4791-b5b1-e5e5efebddc0 could not be found. Jan 15 21:07:59.967031 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-61b31aa6-5ae9-46c3-a49d-5ca28c64c101 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Returning 404 to user: Instance 0ac722a3-aadf-4791-b5b1-e5e5efebddc0 could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:07:59.968308 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-61b31aa6-5ae9-46c3-a49d-5ca28c64c101 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "DELETE /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0" status: 404 len: 111 microversion: 2.20 time: 0.072191 Jan 15 21:07:59.969193 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2856/5703] 10.222.0.46 () {60 vars in 1279 bytes} [Sat Jan 15 21:07:59 2022] DELETE /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 15 21:07:59.978820 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e14ea69b-13b0-45a2-a05c-07d7e9c7f796 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:07:59.980225 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e14ea69b-13b0-45a2-a05c-07d7e9c7f796 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] [instance: 0ac722a3-aadf-4791-b5b1-e5e5efebddc0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:07:59.993274 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e14ea69b-13b0-45a2-a05c-07d7e9c7f796 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:59.994810 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e14ea69b-13b0-45a2-a05c-07d7e9c7f796 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:07:59.995758 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e14ea69b-13b0-45a2-a05c-07d7e9c7f796 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:07:59.998954 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e14ea69b-13b0-45a2-a05c-07d7e9c7f796 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:00.021247 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-e14ea69b-13b0-45a2-a05c-07d7e9c7f796 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] HTTP exception thrown: Instance 0ac722a3-aadf-4791-b5b1-e5e5efebddc0 could not be found. Jan 15 21:08:00.022154 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e14ea69b-13b0-45a2-a05c-07d7e9c7f796 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] Returning 404 to user: Instance 0ac722a3-aadf-4791-b5b1-e5e5efebddc0 could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:08:00.023362 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e14ea69b-13b0-45a2-a05c-07d7e9c7f796 tempest-AttachVolumeShelveTestJSON-72753905 tempest-AttachVolumeShelveTestJSON-72753905-project] 10.222.0.46 "GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0" status: 404 len: 111 microversion: 2.20 time: 0.049319 Jan 15 21:08:00.028716 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2848/5704] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:07:59 2022] GET /compute/v2.1/servers/0ac722a3-aadf-4791-b5b1-e5e5efebddc0 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 15 21:08:00.630255 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c1f12ce8-a67f-40bf-a75a-7896b9b6ce19 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1613390051", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "networks": [{"uuid": "2d9d48cd-f1ff-460c-8042-7a2e183af37d"}]}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:08:00.732475 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.network.neutron [None req-c1f12ce8-a67f-40bf-a75a-7896b9b6ce19 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] validate_networks() for [('2d9d48cd-f1ff-460c-8042-7a2e183af37d', None, None, None, None, None)] {{(pid=129366) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 21:08:01.511484 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-c1f12ce8-a67f-40bf-a75a-7896b9b6ce19 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Flavor limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 21:08:01.512609 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-c1f12ce8-a67f-40bf-a75a-7896b9b6ce19 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Image limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 21:08:01.513380 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-c1f12ce8-a67f-40bf-a75a-7896b9b6ce19 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Flavor pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 21:08:01.513532 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-c1f12ce8-a67f-40bf-a75a-7896b9b6ce19 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Image pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 21:08:01.513946 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-c1f12ce8-a67f-40bf-a75a-7896b9b6ce19 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 21:08:01.524465 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c1f12ce8-a67f-40bf-a75a-7896b9b6ce19 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:01.525179 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c1f12ce8-a67f-40bf-a75a-7896b9b6ce19 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:01.526000 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c1f12ce8-a67f-40bf-a75a-7896b9b6ce19 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:01.526609 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c1f12ce8-a67f-40bf-a75a-7896b9b6ce19 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:01.544726 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-c1f12ce8-a67f-40bf-a75a-7896b9b6ce19 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Getting quotas for project 3aa736a1907e4790b2ea49bc7f31e50c. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:08:01.562657 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-c1f12ce8-a67f-40bf-a75a-7896b9b6ce19 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Getting quotas for user 6d2364cc12914bd3922a66feb86c5c80 and project 3aa736a1907e4790b2ea49bc7f31e50c. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:08:01.578474 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c1f12ce8-a67f-40bf-a75a-7896b9b6ce19 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Going to run 1 instances... {{(pid=129366) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 21:08:01.587546 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c1f12ce8-a67f-40bf-a75a-7896b9b6ce19 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] [instance: 86b698ae-0ed3-4195-a604-1f3d1ec13d65] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 21:08:01.659362 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c1f12ce8-a67f-40bf-a75a-7896b9b6ce19 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.041362 Jan 15 21:08:01.660875 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2857/5705] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 21:08:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1044 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 21:08:01.671423 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2ea08892-9ccb-4dc8-a741-7deda497e71a tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:08:01.682887 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-2ea08892-9ccb-4dc8-a741-7deda497e71a tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] [instance: 86b698ae-0ed3-4195-a604-1f3d1ec13d65] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:08:02.034098 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-2ea08892-9ccb-4dc8-a741-7deda497e71a tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2364cc12914bd3922a66feb86c5c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa736a1907e4790b2ea49bc7f31e50c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:08:02.048959 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2ea08892-9ccb-4dc8-a741-7deda497e71a tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] 10.222.0.46 "GET /compute/v2.1/servers/86b698ae-0ed3-4195-a604-1f3d1ec13d65" status: 200 len: 1219 microversion: 2.1 time: 0.381941 Jan 15 21:08:02.062212 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2849/5706] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:08:01 2022] GET /compute/v2.1/servers/86b698ae-0ed3-4195-a604-1f3d1ec13d65 => generated 1219 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:08:02.659323 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1f7eb646-ec10-4ae2-97a8-9ebdc0e934e1 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9dd562f9-7a3d-489b-8619-26ee0403ebb9"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:08:02.663184 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-1f7eb646-ec10-4ae2-97a8-9ebdc0e934e1 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] [instance: 2eb104af-fb2d-44d7-9c7a-e5380040ecb3] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:08:02.681159 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1f7eb646-ec10-4ae2-97a8-9ebdc0e934e1 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:02.685052 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1f7eb646-ec10-4ae2-97a8-9ebdc0e934e1 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:02.686266 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1f7eb646-ec10-4ae2-97a8-9ebdc0e934e1 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:02.688348 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1f7eb646-ec10-4ae2-97a8-9ebdc0e934e1 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:02.826936 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-1f7eb646-ec10-4ae2-97a8-9ebdc0e934e1 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] HTTP exception thrown: Invalid volume: volume 9dd562f9-7a3d-489b-8619-26ee0403ebb9 is already attached to instances: 2eb104af-fb2d-44d7-9c7a-e5380040ecb3 Jan 15 21:08:02.827566 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1f7eb646-ec10-4ae2-97a8-9ebdc0e934e1 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Returning 400 to user: Invalid volume: volume 9dd562f9-7a3d-489b-8619-26ee0403ebb9 is already attached to instances: 2eb104af-fb2d-44d7-9c7a-e5380040ecb3 {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:08:02.829515 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-1f7eb646-ec10-4ae2-97a8-9ebdc0e934e1 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] 10.222.0.46 "POST /compute/v2.1/servers/2eb104af-fb2d-44d7-9c7a-e5380040ecb3/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.174588 Jan 15 21:08:02.834596 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2858/5707] 10.222.0.46 () {60 vars in 1322 bytes} [Sat Jan 15 21:08:02 2022] POST /compute/v2.1/servers/2eb104af-fb2d-44d7-9c7a-e5380040ecb3/os-volume_attachments => generated 174 bytes in 177 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 15 21:08:02.899388 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e295736e-c093-4e20-b2d5-279342d91f7d tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:08:02.900674 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e295736e-c093-4e20-b2d5-279342d91f7d tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] [instance: 2eb104af-fb2d-44d7-9c7a-e5380040ecb3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:08:02.907574 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e295736e-c093-4e20-b2d5-279342d91f7d tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:02.908029 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e295736e-c093-4e20-b2d5-279342d91f7d tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:02.908834 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e295736e-c093-4e20-b2d5-279342d91f7d tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:02.909316 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e295736e-c093-4e20-b2d5-279342d91f7d tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:03.001709 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.objects.instance [None req-e295736e-c093-4e20-b2d5-279342d91f7d tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lazy-loading 'services' on Instance uuid 2eb104af-fb2d-44d7-9c7a-e5380040ecb3 {{(pid=129365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 21:08:03.070376 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-db6079fe-c2d2-4a5e-9618-186d8771b5b8 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:08:03.070981 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-db6079fe-c2d2-4a5e-9618-186d8771b5b8 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] [instance: 86b698ae-0ed3-4195-a604-1f3d1ec13d65] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:08:03.078349 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-db6079fe-c2d2-4a5e-9618-186d8771b5b8 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:03.079823 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-db6079fe-c2d2-4a5e-9618-186d8771b5b8 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:03.094133 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-db6079fe-c2d2-4a5e-9618-186d8771b5b8 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:03.095420 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-db6079fe-c2d2-4a5e-9618-186d8771b5b8 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:03.116120 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e295736e-c093-4e20-b2d5-279342d91f7d tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] 10.222.0.46 "DELETE /compute/v2.1/servers/2eb104af-fb2d-44d7-9c7a-e5380040ecb3/os-volume_attachments/9dd562f9-7a3d-489b-8619-26ee0403ebb9" status: 202 len: 0 microversion: 2.1 time: 0.224064 Jan 15 21:08:03.124262 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2850/5708] 10.222.0.46 () {58 vars in 1415 bytes} [Sat Jan 15 21:08:02 2022] DELETE /compute/v2.1/servers/2eb104af-fb2d-44d7-9c7a-e5380040ecb3/os-volume_attachments/9dd562f9-7a3d-489b-8619-26ee0403ebb9 => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:08:03.149809 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2b00e7c0-2452-41ac-8d9f-8f641e49a2ec tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:08:03.153219 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-2b00e7c0-2452-41ac-8d9f-8f641e49a2ec tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] [instance: 2eb104af-fb2d-44d7-9c7a-e5380040ecb3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:08:03.174085 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2b00e7c0-2452-41ac-8d9f-8f641e49a2ec tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:03.175148 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2b00e7c0-2452-41ac-8d9f-8f641e49a2ec tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:03.176371 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2b00e7c0-2452-41ac-8d9f-8f641e49a2ec tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:03.177113 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2b00e7c0-2452-41ac-8d9f-8f641e49a2ec tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:03.236236 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-db6079fe-c2d2-4a5e-9618-186d8771b5b8 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2364cc12914bd3922a66feb86c5c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa736a1907e4790b2ea49bc7f31e50c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:08:03.241743 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2b00e7c0-2452-41ac-8d9f-8f641e49a2ec tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] 10.222.0.46 "GET /compute/v2.1/servers/2eb104af-fb2d-44d7-9c7a-e5380040ecb3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.101579 Jan 15 21:08:03.244093 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2851/5709] 10.222.0.46 () {58 vars in 1301 bytes} [Sat Jan 15 21:08:03 2022] GET /compute/v2.1/servers/2eb104af-fb2d-44d7-9c7a-e5380040ecb3/os-volume_attachments => generated 197 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:08:03.251147 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-db6079fe-c2d2-4a5e-9618-186d8771b5b8 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] 10.222.0.46 "GET /compute/v2.1/servers/86b698ae-0ed3-4195-a604-1f3d1ec13d65" status: 200 len: 1271 microversion: 2.1 time: 0.182539 Jan 15 21:08:03.263117 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2859/5710] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:08:03 2022] GET /compute/v2.1/servers/86b698ae-0ed3-4195-a604-1f3d1ec13d65 => generated 1271 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:08:04.256388 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-6b407c04-dc24-4f5d-8687-f878789e21ff tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:08:04.257673 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-6b407c04-dc24-4f5d-8687-f878789e21ff tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] [instance: 2eb104af-fb2d-44d7-9c7a-e5380040ecb3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:08:04.270668 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-2d065fc4-dcff-4305-afa8-290e3fb9e02c tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:08:04.271838 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-2d065fc4-dcff-4305-afa8-290e3fb9e02c tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] [instance: 86b698ae-0ed3-4195-a604-1f3d1ec13d65] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:08:04.273073 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6b407c04-dc24-4f5d-8687-f878789e21ff tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:04.273536 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6b407c04-dc24-4f5d-8687-f878789e21ff tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:04.274344 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6b407c04-dc24-4f5d-8687-f878789e21ff tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:04.274784 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6b407c04-dc24-4f5d-8687-f878789e21ff tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:04.287978 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2d065fc4-dcff-4305-afa8-290e3fb9e02c tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:04.288681 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2d065fc4-dcff-4305-afa8-290e3fb9e02c tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:04.289663 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2d065fc4-dcff-4305-afa8-290e3fb9e02c tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:04.290297 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2d065fc4-dcff-4305-afa8-290e3fb9e02c tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:04.333952 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-6b407c04-dc24-4f5d-8687-f878789e21ff tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] 10.222.0.46 "GET /compute/v2.1/servers/2eb104af-fb2d-44d7-9c7a-e5380040ecb3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.082473 Jan 15 21:08:04.334971 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2852/5711] 10.222.0.46 () {58 vars in 1301 bytes} [Sat Jan 15 21:08:04 2022] GET /compute/v2.1/servers/2eb104af-fb2d-44d7-9c7a-e5380040ecb3/os-volume_attachments => generated 25 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 21:08:04.447219 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-2d065fc4-dcff-4305-afa8-290e3fb9e02c tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2364cc12914bd3922a66feb86c5c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa736a1907e4790b2ea49bc7f31e50c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:08:04.462961 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-2d065fc4-dcff-4305-afa8-290e3fb9e02c tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] 10.222.0.46 "GET /compute/v2.1/servers/86b698ae-0ed3-4195-a604-1f3d1ec13d65" status: 200 len: 1277 microversion: 2.1 time: 0.196768 Jan 15 21:08:04.475207 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2860/5712] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:08:04 2022] GET /compute/v2.1/servers/86b698ae-0ed3-4195-a604-1f3d1ec13d65 => generated 1277 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:08:04.592107 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a987ea63-0240-4920-a2a7-e2e51bab1245 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1584487534", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "networks": [{"uuid": "b55f2173-9368-4426-891c-2ceb82762521"}]}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:08:04.679068 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.network.neutron [None req-a987ea63-0240-4920-a2a7-e2e51bab1245 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] validate_networks() for [('b55f2173-9368-4426-891c-2ceb82762521', None, None, None, None, None)] {{(pid=129365) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 21:08:05.483257 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-5c93de92-e6bc-41c2-a0d2-41b026d7725a tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:08:05.483920 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-5c93de92-e6bc-41c2-a0d2-41b026d7725a tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] [instance: 86b698ae-0ed3-4195-a604-1f3d1ec13d65] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:08:05.498499 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5c93de92-e6bc-41c2-a0d2-41b026d7725a tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:05.499313 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5c93de92-e6bc-41c2-a0d2-41b026d7725a tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:05.502684 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5c93de92-e6bc-41c2-a0d2-41b026d7725a tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:05.503319 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5c93de92-e6bc-41c2-a0d2-41b026d7725a tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:05.608458 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-a987ea63-0240-4920-a2a7-e2e51bab1245 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Flavor limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 21:08:05.609015 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-a987ea63-0240-4920-a2a7-e2e51bab1245 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Image limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 21:08:05.609736 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-a987ea63-0240-4920-a2a7-e2e51bab1245 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Flavor pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 21:08:05.610574 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-a987ea63-0240-4920-a2a7-e2e51bab1245 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Image pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 21:08:05.611102 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-a987ea63-0240-4920-a2a7-e2e51bab1245 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 21:08:05.634486 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a987ea63-0240-4920-a2a7-e2e51bab1245 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:05.635273 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a987ea63-0240-4920-a2a7-e2e51bab1245 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:05.636343 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a987ea63-0240-4920-a2a7-e2e51bab1245 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:05.640251 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a987ea63-0240-4920-a2a7-e2e51bab1245 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:05.686970 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-a987ea63-0240-4920-a2a7-e2e51bab1245 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Getting quotas for project 95e03e1de077453588cc783a4e6d690e. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:08:05.700678 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-a987ea63-0240-4920-a2a7-e2e51bab1245 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Getting quotas for user 822f4a2b1fd6459a8a472bdd066d69fc and project 95e03e1de077453588cc783a4e6d690e. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:08:05.745676 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a987ea63-0240-4920-a2a7-e2e51bab1245 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Going to run 1 instances... {{(pid=129365) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 21:08:05.750625 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a987ea63-0240-4920-a2a7-e2e51bab1245 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] [instance: d1ab7c55-42c1-4a32-a9fa-5aa3fce3db3e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129365) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 21:08:05.802828 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-5c93de92-e6bc-41c2-a0d2-41b026d7725a tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2364cc12914bd3922a66feb86c5c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa736a1907e4790b2ea49bc7f31e50c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:08:05.815814 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-5c93de92-e6bc-41c2-a0d2-41b026d7725a tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] 10.222.0.46 "GET /compute/v2.1/servers/86b698ae-0ed3-4195-a604-1f3d1ec13d65" status: 200 len: 1319 microversion: 2.1 time: 0.336429 Jan 15 21:08:05.817232 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2861/5713] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:08:05 2022] GET /compute/v2.1/servers/86b698ae-0ed3-4195-a604-1f3d1ec13d65 => generated 1319 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:08:05.856686 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a987ea63-0240-4920-a2a7-e2e51bab1245 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.268402 Jan 15 21:08:05.862357 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2853/5714] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 21:08:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1275 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 21:08:05.871256 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-5566eb5b-9bcd-4951-b7ef-db0ff6a19342 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:08:05.871885 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-5566eb5b-9bcd-4951-b7ef-db0ff6a19342 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] [instance: d1ab7c55-42c1-4a32-a9fa-5aa3fce3db3e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:08:06.013734 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-5566eb5b-9bcd-4951-b7ef-db0ff6a19342 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822f4a2b1fd6459a8a472bdd066d69fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e03e1de077453588cc783a4e6d690e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:08:06.028265 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-5566eb5b-9bcd-4951-b7ef-db0ff6a19342 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] 10.222.0.46 "GET /compute/v2.1/servers/d1ab7c55-42c1-4a32-a9fa-5aa3fce3db3e" status: 200 len: 1218 microversion: 2.1 time: 0.163683 Jan 15 21:08:06.035612 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2862/5715] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:08:05 2022] GET /compute/v2.1/servers/d1ab7c55-42c1-4a32-a9fa-5aa3fce3db3e => generated 1218 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:08:06.834874 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-30959956-da6e-4e25-b096-a6ab625b380c tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:08:06.835570 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-30959956-da6e-4e25-b096-a6ab625b380c tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] [instance: 86b698ae-0ed3-4195-a604-1f3d1ec13d65] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:08:06.850557 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-30959956-da6e-4e25-b096-a6ab625b380c tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:06.851242 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-30959956-da6e-4e25-b096-a6ab625b380c tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:06.852246 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-30959956-da6e-4e25-b096-a6ab625b380c tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:06.852984 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-30959956-da6e-4e25-b096-a6ab625b380c tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:07.054438 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e1dc9a18-febb-42af-b625-6aafeb194e95 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:08:07.055173 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e1dc9a18-febb-42af-b625-6aafeb194e95 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] [instance: d1ab7c55-42c1-4a32-a9fa-5aa3fce3db3e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:08:07.068229 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e1dc9a18-febb-42af-b625-6aafeb194e95 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:07.075391 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e1dc9a18-febb-42af-b625-6aafeb194e95 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:07.076405 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e1dc9a18-febb-42af-b625-6aafeb194e95 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:07.076874 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e1dc9a18-febb-42af-b625-6aafeb194e95 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:07.305225 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-e1dc9a18-febb-42af-b625-6aafeb194e95 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822f4a2b1fd6459a8a472bdd066d69fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e03e1de077453588cc783a4e6d690e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:08:07.316986 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e1dc9a18-febb-42af-b625-6aafeb194e95 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] 10.222.0.46 "GET /compute/v2.1/servers/d1ab7c55-42c1-4a32-a9fa-5aa3fce3db3e" status: 200 len: 1214 microversion: 2.1 time: 0.267555 Jan 15 21:08:07.317901 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2863/5716] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:08:07 2022] GET /compute/v2.1/servers/d1ab7c55-42c1-4a32-a9fa-5aa3fce3db3e => generated 1214 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:08:07.342752 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-30959956-da6e-4e25-b096-a6ab625b380c tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2364cc12914bd3922a66feb86c5c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa736a1907e4790b2ea49bc7f31e50c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:08:07.360259 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-30959956-da6e-4e25-b096-a6ab625b380c tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] 10.222.0.46 "GET /compute/v2.1/servers/86b698ae-0ed3-4195-a604-1f3d1ec13d65" status: 200 len: 1319 microversion: 2.1 time: 0.525576 Jan 15 21:08:07.362434 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2854/5717] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:08:06 2022] GET /compute/v2.1/servers/86b698ae-0ed3-4195-a604-1f3d1ec13d65 => generated 1319 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:08:08.336167 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-184858b8-291c-4b41-9298-ae117d9b490c tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:08:08.336781 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-184858b8-291c-4b41-9298-ae117d9b490c tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] [instance: d1ab7c55-42c1-4a32-a9fa-5aa3fce3db3e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:08:08.351616 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-184858b8-291c-4b41-9298-ae117d9b490c tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:08.354303 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-184858b8-291c-4b41-9298-ae117d9b490c tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:08.355377 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-184858b8-291c-4b41-9298-ae117d9b490c tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:08.355830 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-184858b8-291c-4b41-9298-ae117d9b490c tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:08.380091 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-cce6fb45-d42b-4dec-9c41-1d7ad4a6ff26 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:08:08.380575 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-cce6fb45-d42b-4dec-9c41-1d7ad4a6ff26 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] [instance: 86b698ae-0ed3-4195-a604-1f3d1ec13d65] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:08:08.396469 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cce6fb45-d42b-4dec-9c41-1d7ad4a6ff26 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:08.402544 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cce6fb45-d42b-4dec-9c41-1d7ad4a6ff26 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:08.403524 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cce6fb45-d42b-4dec-9c41-1d7ad4a6ff26 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:08.405421 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cce6fb45-d42b-4dec-9c41-1d7ad4a6ff26 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:08.474774 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-184858b8-291c-4b41-9298-ae117d9b490c tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822f4a2b1fd6459a8a472bdd066d69fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e03e1de077453588cc783a4e6d690e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:08:08.483589 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-184858b8-291c-4b41-9298-ae117d9b490c tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] 10.222.0.46 "GET /compute/v2.1/servers/d1ab7c55-42c1-4a32-a9fa-5aa3fce3db3e" status: 200 len: 1276 microversion: 2.1 time: 0.151848 Jan 15 21:08:08.495881 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2864/5718] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:08:08 2022] GET /compute/v2.1/servers/d1ab7c55-42c1-4a32-a9fa-5aa3fce3db3e => generated 1276 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:08:08.709989 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-cce6fb45-d42b-4dec-9c41-1d7ad4a6ff26 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2364cc12914bd3922a66feb86c5c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa736a1907e4790b2ea49bc7f31e50c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:08:08.718050 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-cce6fb45-d42b-4dec-9c41-1d7ad4a6ff26 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] 10.222.0.46 "GET /compute/v2.1/servers/86b698ae-0ed3-4195-a604-1f3d1ec13d65" status: 200 len: 1319 microversion: 2.1 time: 0.343229 Jan 15 21:08:08.719846 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2855/5719] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:08:08 2022] GET /compute/v2.1/servers/86b698ae-0ed3-4195-a604-1f3d1ec13d65 => generated 1319 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:08:09.377510 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-25be8e6f-a59f-406d-a78a-819ae5d143fc req-13422a2d-d51e-45a1-b66e-8814ce72a55f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86b698ae-0ed3-4195-a604-1f3d1ec13d65", "tag": "88a0e402-80ed-4694-bcd3-f181c1c18d44"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:08:09.382108 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:08:09.382108 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:08:09.391619 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-25be8e6f-a59f-406d-a78a-819ae5d143fc req-13422a2d-d51e-45a1-b66e-8814ce72a55f service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:09.392157 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-25be8e6f-a59f-406d-a78a-819ae5d143fc req-13422a2d-d51e-45a1-b66e-8814ce72a55f service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:09.403932 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-25be8e6f-a59f-406d-a78a-819ae5d143fc req-13422a2d-d51e-45a1-b66e-8814ce72a55f service nova] Creating event network-changed:88a0e402-80ed-4694-bcd3-f181c1c18d44 for instance 86b698ae-0ed3-4195-a604-1f3d1ec13d65 on nch1-master-1 Jan 15 21:08:09.410676 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-25be8e6f-a59f-406d-a78a-819ae5d143fc req-13422a2d-d51e-45a1-b66e-8814ce72a55f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048341 Jan 15 21:08:09.411876 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2865/5720] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:08:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:08:09.504739 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-94c237a5-6b45-4680-bc46-165f981fad86 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:08:09.511857 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-94c237a5-6b45-4680-bc46-165f981fad86 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] [instance: d1ab7c55-42c1-4a32-a9fa-5aa3fce3db3e] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:08:09.522250 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-94c237a5-6b45-4680-bc46-165f981fad86 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:09.522913 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-94c237a5-6b45-4680-bc46-165f981fad86 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:09.524378 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-94c237a5-6b45-4680-bc46-165f981fad86 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:09.525133 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-94c237a5-6b45-4680-bc46-165f981fad86 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:09.619927 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-94c237a5-6b45-4680-bc46-165f981fad86 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822f4a2b1fd6459a8a472bdd066d69fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e03e1de077453588cc783a4e6d690e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:08:09.627896 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-94c237a5-6b45-4680-bc46-165f981fad86 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] 10.222.0.46 "GET /compute/v2.1/servers/d1ab7c55-42c1-4a32-a9fa-5aa3fce3db3e" status: 200 len: 1276 microversion: 2.1 time: 0.128554 Jan 15 21:08:09.638923 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2856/5721] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:08:09 2022] GET /compute/v2.1/servers/d1ab7c55-42c1-4a32-a9fa-5aa3fce3db3e => generated 1276 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:08:09.735916 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0607f640-2837-45b6-9579-379f3614f466 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:08:09.737122 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-0607f640-2837-45b6-9579-379f3614f466 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] [instance: 86b698ae-0ed3-4195-a604-1f3d1ec13d65] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:08:09.748691 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0607f640-2837-45b6-9579-379f3614f466 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:09.749332 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0607f640-2837-45b6-9579-379f3614f466 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:09.750249 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0607f640-2837-45b6-9579-379f3614f466 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:09.751405 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0607f640-2837-45b6-9579-379f3614f466 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:10.646987 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8c497811-c903-46a2-a5d7-3f6a167b9819 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:08:10.647594 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-8c497811-c903-46a2-a5d7-3f6a167b9819 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] [instance: d1ab7c55-42c1-4a32-a9fa-5aa3fce3db3e] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:08:10.663065 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8c497811-c903-46a2-a5d7-3f6a167b9819 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:10.667711 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8c497811-c903-46a2-a5d7-3f6a167b9819 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:10.668861 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8c497811-c903-46a2-a5d7-3f6a167b9819 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:10.670267 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8c497811-c903-46a2-a5d7-3f6a167b9819 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:10.844971 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-8c497811-c903-46a2-a5d7-3f6a167b9819 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822f4a2b1fd6459a8a472bdd066d69fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e03e1de077453588cc783a4e6d690e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:08:10.858476 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-8c497811-c903-46a2-a5d7-3f6a167b9819 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] 10.222.0.46 "GET /compute/v2.1/servers/d1ab7c55-42c1-4a32-a9fa-5aa3fce3db3e" status: 200 len: 1276 microversion: 2.1 time: 0.214774 Jan 15 21:08:10.861666 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2857/5722] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:08:10 2022] GET /compute/v2.1/servers/d1ab7c55-42c1-4a32-a9fa-5aa3fce3db3e => generated 1276 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:08:10.887025 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-0607f640-2837-45b6-9579-379f3614f466 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2364cc12914bd3922a66feb86c5c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa736a1907e4790b2ea49bc7f31e50c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:08:10.900986 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0607f640-2837-45b6-9579-379f3614f466 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] 10.222.0.46 "GET /compute/v2.1/servers/86b698ae-0ed3-4195-a604-1f3d1ec13d65" status: 200 len: 1319 microversion: 2.1 time: 1.166625 Jan 15 21:08:10.904744 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2866/5723] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:08:09 2022] GET /compute/v2.1/servers/86b698ae-0ed3-4195-a604-1f3d1ec13d65 => generated 1319 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:08:11.875724 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ee43c811-5232-40cd-8fbf-17bf2513e6f2 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:08:11.876439 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ee43c811-5232-40cd-8fbf-17bf2513e6f2 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] [instance: d1ab7c55-42c1-4a32-a9fa-5aa3fce3db3e] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:08:11.897530 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ee43c811-5232-40cd-8fbf-17bf2513e6f2 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:11.899385 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ee43c811-5232-40cd-8fbf-17bf2513e6f2 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:11.900329 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ee43c811-5232-40cd-8fbf-17bf2513e6f2 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:11.901006 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ee43c811-5232-40cd-8fbf-17bf2513e6f2 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:11.918642 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-fb0d12f2-d3a8-40ad-9a84-0d7fb28f4460 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:08:11.919350 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-fb0d12f2-d3a8-40ad-9a84-0d7fb28f4460 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] [instance: 86b698ae-0ed3-4195-a604-1f3d1ec13d65] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:08:11.936391 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fb0d12f2-d3a8-40ad-9a84-0d7fb28f4460 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:11.941751 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fb0d12f2-d3a8-40ad-9a84-0d7fb28f4460 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:11.943823 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fb0d12f2-d3a8-40ad-9a84-0d7fb28f4460 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:11.944716 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fb0d12f2-d3a8-40ad-9a84-0d7fb28f4460 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:12.287172 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-fb0d12f2-d3a8-40ad-9a84-0d7fb28f4460 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2364cc12914bd3922a66feb86c5c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa736a1907e4790b2ea49bc7f31e50c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:08:12.299324 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-fb0d12f2-d3a8-40ad-9a84-0d7fb28f4460 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] 10.222.0.46 "GET /compute/v2.1/servers/86b698ae-0ed3-4195-a604-1f3d1ec13d65" status: 200 len: 1319 microversion: 2.1 time: 0.384643 Jan 15 21:08:12.301269 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2867/5724] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:08:11 2022] GET /compute/v2.1/servers/86b698ae-0ed3-4195-a604-1f3d1ec13d65 => generated 1319 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:08:12.349993 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-ee43c811-5232-40cd-8fbf-17bf2513e6f2 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822f4a2b1fd6459a8a472bdd066d69fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e03e1de077453588cc783a4e6d690e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:08:12.367078 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ee43c811-5232-40cd-8fbf-17bf2513e6f2 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] 10.222.0.46 "GET /compute/v2.1/servers/d1ab7c55-42c1-4a32-a9fa-5aa3fce3db3e" status: 200 len: 1318 microversion: 2.1 time: 0.495377 Jan 15 21:08:12.368259 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2858/5725] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:08:11 2022] GET /compute/v2.1/servers/d1ab7c55-42c1-4a32-a9fa-5aa3fce3db3e => generated 1318 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:08:13.086249 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-1fe3783a-ece6-43b6-905b-cb5d5b2b1320 req-1b4e38a6-b0ca-4b44-9d5b-67ff3095779e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1ab7c55-42c1-4a32-a9fa-5aa3fce3db3e", "tag": "0527c920-da07-47ca-8285-284889ba3d59"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:08:13.091411 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:08:13.091411 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:08:13.111159 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-1fe3783a-ece6-43b6-905b-cb5d5b2b1320 req-1b4e38a6-b0ca-4b44-9d5b-67ff3095779e service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:13.116170 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-1fe3783a-ece6-43b6-905b-cb5d5b2b1320 req-1b4e38a6-b0ca-4b44-9d5b-67ff3095779e service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:13.129729 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-1fe3783a-ece6-43b6-905b-cb5d5b2b1320 req-1b4e38a6-b0ca-4b44-9d5b-67ff3095779e service nova] Creating event network-changed:0527c920-da07-47ca-8285-284889ba3d59 for instance d1ab7c55-42c1-4a32-a9fa-5aa3fce3db3e on nch2-master-1 Jan 15 21:08:13.135229 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-1fe3783a-ece6-43b6-905b-cb5d5b2b1320 req-1b4e38a6-b0ca-4b44-9d5b-67ff3095779e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057755 Jan 15 21:08:13.136506 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2868/5726] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:08:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:08:13.322433 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-455ad399-f698-4561-8c85-a34729e1da46 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:08:13.323449 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-455ad399-f698-4561-8c85-a34729e1da46 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] [instance: 86b698ae-0ed3-4195-a604-1f3d1ec13d65] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:08:13.337492 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-455ad399-f698-4561-8c85-a34729e1da46 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:13.338001 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-455ad399-f698-4561-8c85-a34729e1da46 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:13.338830 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-455ad399-f698-4561-8c85-a34729e1da46 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:13.339277 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-455ad399-f698-4561-8c85-a34729e1da46 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:13.386686 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ad4e4eca-7590-40a9-834c-d88eca2d9a0e tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:08:13.390234 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ad4e4eca-7590-40a9-834c-d88eca2d9a0e tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] [instance: d1ab7c55-42c1-4a32-a9fa-5aa3fce3db3e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:08:13.399797 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ad4e4eca-7590-40a9-834c-d88eca2d9a0e tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:13.404688 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ad4e4eca-7590-40a9-834c-d88eca2d9a0e tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:13.406176 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ad4e4eca-7590-40a9-834c-d88eca2d9a0e tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:13.406813 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ad4e4eca-7590-40a9-834c-d88eca2d9a0e tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:13.913166 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-455ad399-f698-4561-8c85-a34729e1da46 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2364cc12914bd3922a66feb86c5c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa736a1907e4790b2ea49bc7f31e50c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:08:13.921773 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-ad4e4eca-7590-40a9-834c-d88eca2d9a0e tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822f4a2b1fd6459a8a472bdd066d69fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e03e1de077453588cc783a4e6d690e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:08:13.927374 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-455ad399-f698-4561-8c85-a34729e1da46 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] 10.222.0.46 "GET /compute/v2.1/servers/86b698ae-0ed3-4195-a604-1f3d1ec13d65" status: 200 len: 1319 microversion: 2.1 time: 0.611689 Jan 15 21:08:13.928500 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2859/5727] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:08:13 2022] GET /compute/v2.1/servers/86b698ae-0ed3-4195-a604-1f3d1ec13d65 => generated 1319 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:08:13.930736 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ad4e4eca-7590-40a9-834c-d88eca2d9a0e tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] 10.222.0.46 "GET /compute/v2.1/servers/d1ab7c55-42c1-4a32-a9fa-5aa3fce3db3e" status: 200 len: 1318 microversion: 2.1 time: 0.550028 Jan 15 21:08:13.933506 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2869/5728] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:08:13 2022] GET /compute/v2.1/servers/d1ab7c55-42c1-4a32-a9fa-5aa3fce3db3e => generated 1318 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:08:14.754382 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-de971744-b296-49ce-9811-6e8ab40aed4a tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-216154498", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "networks": [{"uuid": "3a04535e-aee7-4868-b63e-486d26da5acd"}]}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:08:14.827949 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.network.neutron [None req-de971744-b296-49ce-9811-6e8ab40aed4a tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] validate_networks() for [('3a04535e-aee7-4868-b63e-486d26da5acd', None, None, None, None, None)] {{(pid=129365) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 21:08:14.950555 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-72120a5f-0272-42f2-8217-7f9ea3d47057 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:08:14.952519 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-72120a5f-0272-42f2-8217-7f9ea3d47057 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] [instance: 86b698ae-0ed3-4195-a604-1f3d1ec13d65] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:08:14.982079 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-72120a5f-0272-42f2-8217-7f9ea3d47057 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:14.984009 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-72120a5f-0272-42f2-8217-7f9ea3d47057 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:14.986367 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-72120a5f-0272-42f2-8217-7f9ea3d47057 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:14.988575 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-72120a5f-0272-42f2-8217-7f9ea3d47057 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:15.540746 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-72120a5f-0272-42f2-8217-7f9ea3d47057 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2364cc12914bd3922a66feb86c5c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa736a1907e4790b2ea49bc7f31e50c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:08:15.554212 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-72120a5f-0272-42f2-8217-7f9ea3d47057 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] 10.222.0.46 "GET /compute/v2.1/servers/86b698ae-0ed3-4195-a604-1f3d1ec13d65" status: 200 len: 1319 microversion: 2.1 time: 0.610483 Jan 15 21:08:15.555054 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2870/5729] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:08:14 2022] GET /compute/v2.1/servers/86b698ae-0ed3-4195-a604-1f3d1ec13d65 => generated 1319 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:08:15.566614 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e9fbd2a6-7906-494e-aa2e-a40b50d22d0e tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:08:15.570869 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e9fbd2a6-7906-494e-aa2e-a40b50d22d0e tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] [instance: d1ab7c55-42c1-4a32-a9fa-5aa3fce3db3e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:08:15.582685 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e9fbd2a6-7906-494e-aa2e-a40b50d22d0e tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:15.583357 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e9fbd2a6-7906-494e-aa2e-a40b50d22d0e tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:15.584462 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e9fbd2a6-7906-494e-aa2e-a40b50d22d0e tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:15.585374 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e9fbd2a6-7906-494e-aa2e-a40b50d22d0e tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:15.746935 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-de971744-b296-49ce-9811-6e8ab40aed4a tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Flavor limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 21:08:15.747766 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-de971744-b296-49ce-9811-6e8ab40aed4a tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Image limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 21:08:15.748596 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-de971744-b296-49ce-9811-6e8ab40aed4a tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Flavor pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 21:08:15.749361 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-de971744-b296-49ce-9811-6e8ab40aed4a tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Image pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 21:08:15.751185 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-de971744-b296-49ce-9811-6e8ab40aed4a tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 21:08:15.767436 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-de971744-b296-49ce-9811-6e8ab40aed4a tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:15.769867 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-de971744-b296-49ce-9811-6e8ab40aed4a tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:15.771286 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-de971744-b296-49ce-9811-6e8ab40aed4a tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:15.772149 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-de971744-b296-49ce-9811-6e8ab40aed4a tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:15.812209 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-de971744-b296-49ce-9811-6e8ab40aed4a tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Getting quotas for project 8d727625d6eb47febd54a3f4071bb7c3. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:08:15.835703 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-de971744-b296-49ce-9811-6e8ab40aed4a tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Getting quotas for user e6809a212fcc4730a3a30c81e8485ce9 and project 8d727625d6eb47febd54a3f4071bb7c3. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:08:15.880442 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-de971744-b296-49ce-9811-6e8ab40aed4a tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Going to run 1 instances... {{(pid=129365) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 21:08:15.892345 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-de971744-b296-49ce-9811-6e8ab40aed4a tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] [instance: 827235d8-4a51-49b0-af9e-f45e37bcf762] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129365) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 21:08:16.014939 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-e9fbd2a6-7906-494e-aa2e-a40b50d22d0e tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822f4a2b1fd6459a8a472bdd066d69fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e03e1de077453588cc783a4e6d690e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:08:16.021891 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-de971744-b296-49ce-9811-6e8ab40aed4a tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.609522 Jan 15 21:08:16.036022 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2860/5730] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 21:08:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1624 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 21:08:16.042270 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e9fbd2a6-7906-494e-aa2e-a40b50d22d0e tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] 10.222.0.46 "GET /compute/v2.1/servers/d1ab7c55-42c1-4a32-a9fa-5aa3fce3db3e" status: 200 len: 1318 microversion: 2.1 time: 0.485226 Jan 15 21:08:16.053293 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2871/5731] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:08:15 2022] GET /compute/v2.1/servers/d1ab7c55-42c1-4a32-a9fa-5aa3fce3db3e => generated 1318 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:08:16.247116 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-1838dbdf-acd8-423a-9893-8b60c61e0fdf tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-943858524", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "networks": [{"uuid": "3a04535e-aee7-4868-b63e-486d26da5acd"}]}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:08:16.371377 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.network.neutron [None req-1838dbdf-acd8-423a-9893-8b60c61e0fdf tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] validate_networks() for [('3a04535e-aee7-4868-b63e-486d26da5acd', None, None, None, None, None)] {{(pid=129365) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 21:08:16.571791 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-eb770bac-b09f-48ad-948b-311d551775fb tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:08:16.572552 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-eb770bac-b09f-48ad-948b-311d551775fb tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] [instance: 86b698ae-0ed3-4195-a604-1f3d1ec13d65] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:08:16.583362 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-eb770bac-b09f-48ad-948b-311d551775fb tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:16.583695 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-eb770bac-b09f-48ad-948b-311d551775fb tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:16.592008 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-eb770bac-b09f-48ad-948b-311d551775fb tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:16.593602 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-eb770bac-b09f-48ad-948b-311d551775fb tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:17.422965 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-eb770bac-b09f-48ad-948b-311d551775fb tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2364cc12914bd3922a66feb86c5c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa736a1907e4790b2ea49bc7f31e50c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:08:17.437913 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-eb770bac-b09f-48ad-948b-311d551775fb tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] 10.222.0.46 "GET /compute/v2.1/servers/86b698ae-0ed3-4195-a604-1f3d1ec13d65" status: 200 len: 1319 microversion: 2.1 time: 0.869676 Jan 15 21:08:17.438844 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2872/5732] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:08:16 2022] GET /compute/v2.1/servers/86b698ae-0ed3-4195-a604-1f3d1ec13d65 => generated 1319 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:08:17.445527 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-68d91e32-c580-418b-81e2-f4f3d501b69a tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:08:17.446142 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-68d91e32-c580-418b-81e2-f4f3d501b69a tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] [instance: d1ab7c55-42c1-4a32-a9fa-5aa3fce3db3e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:08:17.466969 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-68d91e32-c580-418b-81e2-f4f3d501b69a tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:17.474293 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-68d91e32-c580-418b-81e2-f4f3d501b69a tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:17.475385 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-68d91e32-c580-418b-81e2-f4f3d501b69a tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:17.476070 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-68d91e32-c580-418b-81e2-f4f3d501b69a tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:17.843197 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-1838dbdf-acd8-423a-9893-8b60c61e0fdf tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Flavor limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 21:08:17.843649 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-1838dbdf-acd8-423a-9893-8b60c61e0fdf tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Image limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 21:08:17.845405 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-1838dbdf-acd8-423a-9893-8b60c61e0fdf tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Flavor pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 21:08:17.848054 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-1838dbdf-acd8-423a-9893-8b60c61e0fdf tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Image pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 21:08:17.848669 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-1838dbdf-acd8-423a-9893-8b60c61e0fdf tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 21:08:17.885090 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1838dbdf-acd8-423a-9893-8b60c61e0fdf tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:17.886223 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1838dbdf-acd8-423a-9893-8b60c61e0fdf tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:17.890690 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1838dbdf-acd8-423a-9893-8b60c61e0fdf tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:17.896100 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1838dbdf-acd8-423a-9893-8b60c61e0fdf tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:17.963319 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-1838dbdf-acd8-423a-9893-8b60c61e0fdf tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Getting quotas for project 8d727625d6eb47febd54a3f4071bb7c3. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:08:17.987786 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-1838dbdf-acd8-423a-9893-8b60c61e0fdf tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Getting quotas for user e6809a212fcc4730a3a30c81e8485ce9 and project 8d727625d6eb47febd54a3f4071bb7c3. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:08:17.989401 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-68d91e32-c580-418b-81e2-f4f3d501b69a tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822f4a2b1fd6459a8a472bdd066d69fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e03e1de077453588cc783a4e6d690e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:08:17.999395 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-68d91e32-c580-418b-81e2-f4f3d501b69a tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] 10.222.0.46 "GET /compute/v2.1/servers/d1ab7c55-42c1-4a32-a9fa-5aa3fce3db3e" status: 200 len: 1318 microversion: 2.1 time: 0.558472 Jan 15 21:08:18.000879 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2873/5733] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:08:17 2022] GET /compute/v2.1/servers/d1ab7c55-42c1-4a32-a9fa-5aa3fce3db3e => generated 1318 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:08:18.029621 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-1838dbdf-acd8-423a-9893-8b60c61e0fdf tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Going to run 1 instances... {{(pid=129365) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 21:08:18.032690 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-1838dbdf-acd8-423a-9893-8b60c61e0fdf tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] [instance: 6ad265d9-74dd-44bc-80d0-3a10870684e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129365) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 21:08:18.128792 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-1838dbdf-acd8-423a-9893-8b60c61e0fdf tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.885921 Jan 15 21:08:18.133804 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2861/5734] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 21:08:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1892 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 15 21:08:18.395643 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-009dc049-adb8-4408-85d7-43f21d1016fa tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1369277657", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "451", "networks": [{"uuid": "3a04535e-aee7-4868-b63e-486d26da5acd"}]}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:08:18.454925 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9d3e39c1-3287-4534-8ace-c58a811799cc tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:08:18.455788 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-9d3e39c1-3287-4534-8ace-c58a811799cc tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] [instance: 86b698ae-0ed3-4195-a604-1f3d1ec13d65] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:08:18.481506 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9d3e39c1-3287-4534-8ace-c58a811799cc tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:18.484502 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9d3e39c1-3287-4534-8ace-c58a811799cc tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:18.485336 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.network.neutron [None req-009dc049-adb8-4408-85d7-43f21d1016fa tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] validate_networks() for [('3a04535e-aee7-4868-b63e-486d26da5acd', None, None, None, None, None)] {{(pid=129366) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 21:08:18.486033 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9d3e39c1-3287-4534-8ace-c58a811799cc tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:18.486724 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9d3e39c1-3287-4534-8ace-c58a811799cc tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:19.191104 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-9d3e39c1-3287-4534-8ace-c58a811799cc tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2364cc12914bd3922a66feb86c5c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa736a1907e4790b2ea49bc7f31e50c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:08:19.205886 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-9d3e39c1-3287-4534-8ace-c58a811799cc tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] 10.222.0.46 "GET /compute/v2.1/servers/86b698ae-0ed3-4195-a604-1f3d1ec13d65" status: 200 len: 1319 microversion: 2.1 time: 0.754486 Jan 15 21:08:19.223621 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2862/5735] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:08:18 2022] GET /compute/v2.1/servers/86b698ae-0ed3-4195-a604-1f3d1ec13d65 => generated 1319 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:08:19.234898 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-80d06011-0995-4a2f-b787-97a456da3ccc tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:08:19.235536 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-80d06011-0995-4a2f-b787-97a456da3ccc tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] [instance: d1ab7c55-42c1-4a32-a9fa-5aa3fce3db3e] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:08:19.248483 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-80d06011-0995-4a2f-b787-97a456da3ccc tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:19.248974 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-80d06011-0995-4a2f-b787-97a456da3ccc tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:19.250530 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-80d06011-0995-4a2f-b787-97a456da3ccc tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:19.251195 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-80d06011-0995-4a2f-b787-97a456da3ccc tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:19.520675 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-009dc049-adb8-4408-85d7-43f21d1016fa tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Flavor limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 21:08:19.521281 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-009dc049-adb8-4408-85d7-43f21d1016fa tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Image limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 21:08:19.521817 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-009dc049-adb8-4408-85d7-43f21d1016fa tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Flavor pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 21:08:19.522487 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-009dc049-adb8-4408-85d7-43f21d1016fa tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Image pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 21:08:19.523115 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-009dc049-adb8-4408-85d7-43f21d1016fa tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 21:08:19.547927 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-009dc049-adb8-4408-85d7-43f21d1016fa tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:19.554844 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-009dc049-adb8-4408-85d7-43f21d1016fa tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:19.555968 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-009dc049-adb8-4408-85d7-43f21d1016fa tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:19.556575 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-009dc049-adb8-4408-85d7-43f21d1016fa tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:19.604408 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-009dc049-adb8-4408-85d7-43f21d1016fa tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Getting quotas for project 8d727625d6eb47febd54a3f4071bb7c3. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:08:19.617233 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-009dc049-adb8-4408-85d7-43f21d1016fa tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Getting quotas for user e6809a212fcc4730a3a30c81e8485ce9 and project 8d727625d6eb47febd54a3f4071bb7c3. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:08:19.649389 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-009dc049-adb8-4408-85d7-43f21d1016fa tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Going to run 1 instances... {{(pid=129366) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 21:08:19.653399 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-009dc049-adb8-4408-85d7-43f21d1016fa tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] [instance: 25f2d43f-7008-4b4d-ac8d-5959a48ab04d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 21:08:19.679242 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-80d06011-0995-4a2f-b787-97a456da3ccc tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822f4a2b1fd6459a8a472bdd066d69fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e03e1de077453588cc783a4e6d690e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:08:19.696301 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-80d06011-0995-4a2f-b787-97a456da3ccc tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] 10.222.0.46 "GET /compute/v2.1/servers/d1ab7c55-42c1-4a32-a9fa-5aa3fce3db3e" status: 200 len: 1318 microversion: 2.1 time: 0.471042 Jan 15 21:08:19.699929 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2863/5736] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:08:19 2022] GET /compute/v2.1/servers/d1ab7c55-42c1-4a32-a9fa-5aa3fce3db3e => generated 1318 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:08:19.734729 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-670e6e3b-f379-4500-84c0-9d0edcedd2ea req-c4e6a674-b283-4e01-badc-aed9665db0b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86b698ae-0ed3-4195-a604-1f3d1ec13d65", "name": "network-vif-plugged", "status": "completed", "tag": "88a0e402-80ed-4694-bcd3-f181c1c18d44"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:08:19.742092 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:08:19.742092 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:08:19.762963 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-670e6e3b-f379-4500-84c0-9d0edcedd2ea req-c4e6a674-b283-4e01-badc-aed9665db0b2 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:19.763667 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-670e6e3b-f379-4500-84c0-9d0edcedd2ea req-c4e6a674-b283-4e01-badc-aed9665db0b2 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:19.802197 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-009dc049-adb8-4408-85d7-43f21d1016fa tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.411216 Jan 15 21:08:19.802584 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-670e6e3b-f379-4500-84c0-9d0edcedd2ea req-c4e6a674-b283-4e01-badc-aed9665db0b2 service nova] Creating event network-vif-plugged:88a0e402-80ed-4694-bcd3-f181c1c18d44 for instance 86b698ae-0ed3-4195-a604-1f3d1ec13d65 on nch1-master-1 Jan 15 21:08:19.810720 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2874/5737] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 21:08:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1420 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 21:08:19.814340 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-670e6e3b-f379-4500-84c0-9d0edcedd2ea req-c4e6a674-b283-4e01-badc-aed9665db0b2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112016 Jan 15 21:08:19.817146 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2864/5738] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:08:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:08:19.842172 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d8c87fb3-4372-41d2-b225-00441a46815b tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:08:19.842459 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-d8c87fb3-4372-41d2-b225-00441a46815b tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] [instance: 25f2d43f-7008-4b4d-ac8d-5959a48ab04d] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:08:20.060254 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-d8c87fb3-4372-41d2-b225-00441a46815b tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6809a212fcc4730a3a30c81e8485ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d727625d6eb47febd54a3f4071bb7c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:08:20.074184 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d8c87fb3-4372-41d2-b225-00441a46815b tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] 10.222.0.46 "GET /compute/v2.1/servers/25f2d43f-7008-4b4d-ac8d-5959a48ab04d" status: 200 len: 1221 microversion: 2.1 time: 0.256415 Jan 15 21:08:20.075658 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2875/5739] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:08:19 2022] GET /compute/v2.1/servers/25f2d43f-7008-4b4d-ac8d-5959a48ab04d => generated 1221 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:08:20.224854 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8d334c8f-f3ed-477e-bd0c-20560ae8997d tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:08:20.225445 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-8d334c8f-f3ed-477e-bd0c-20560ae8997d tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] [instance: 86b698ae-0ed3-4195-a604-1f3d1ec13d65] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:08:20.235664 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8d334c8f-f3ed-477e-bd0c-20560ae8997d tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:20.242158 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8d334c8f-f3ed-477e-bd0c-20560ae8997d tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:20.243282 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8d334c8f-f3ed-477e-bd0c-20560ae8997d tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:20.244004 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8d334c8f-f3ed-477e-bd0c-20560ae8997d tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:20.620681 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-8d334c8f-f3ed-477e-bd0c-20560ae8997d tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2364cc12914bd3922a66feb86c5c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa736a1907e4790b2ea49bc7f31e50c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:08:20.636088 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-8d334c8f-f3ed-477e-bd0c-20560ae8997d tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] 10.222.0.46 "GET /compute/v2.1/servers/86b698ae-0ed3-4195-a604-1f3d1ec13d65" status: 200 len: 1319 microversion: 2.1 time: 0.415998 Jan 15 21:08:20.638085 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2865/5740] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:08:20 2022] GET /compute/v2.1/servers/86b698ae-0ed3-4195-a604-1f3d1ec13d65 => generated 1319 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:08:20.715247 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-252d8e69-58d3-4e38-8f17-fd4a67c51c44 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:08:20.715854 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-252d8e69-58d3-4e38-8f17-fd4a67c51c44 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] [instance: d1ab7c55-42c1-4a32-a9fa-5aa3fce3db3e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:08:20.723163 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-252d8e69-58d3-4e38-8f17-fd4a67c51c44 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:20.724219 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-252d8e69-58d3-4e38-8f17-fd4a67c51c44 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:20.725309 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-252d8e69-58d3-4e38-8f17-fd4a67c51c44 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:20.726253 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-252d8e69-58d3-4e38-8f17-fd4a67c51c44 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:21.091784 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-7813b6f0-7046-4668-875f-03bef9258566 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:08:21.092624 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-7813b6f0-7046-4668-875f-03bef9258566 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] [instance: 25f2d43f-7008-4b4d-ac8d-5959a48ab04d] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:08:21.105087 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7813b6f0-7046-4668-875f-03bef9258566 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:21.105764 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7813b6f0-7046-4668-875f-03bef9258566 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:21.106726 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7813b6f0-7046-4668-875f-03bef9258566 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:21.107295 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7813b6f0-7046-4668-875f-03bef9258566 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:21.379906 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-7813b6f0-7046-4668-875f-03bef9258566 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6809a212fcc4730a3a30c81e8485ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d727625d6eb47febd54a3f4071bb7c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:08:21.388508 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-252d8e69-58d3-4e38-8f17-fd4a67c51c44 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822f4a2b1fd6459a8a472bdd066d69fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e03e1de077453588cc783a4e6d690e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:08:21.395150 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-7813b6f0-7046-4668-875f-03bef9258566 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] 10.222.0.46 "GET /compute/v2.1/servers/25f2d43f-7008-4b4d-ac8d-5959a48ab04d" status: 200 len: 1217 microversion: 2.1 time: 0.306984 Jan 15 21:08:21.406082 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2866/5741] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:08:21 2022] GET /compute/v2.1/servers/25f2d43f-7008-4b4d-ac8d-5959a48ab04d => generated 1217 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:08:21.408585 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-252d8e69-58d3-4e38-8f17-fd4a67c51c44 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] 10.222.0.46 "GET /compute/v2.1/servers/d1ab7c55-42c1-4a32-a9fa-5aa3fce3db3e" status: 200 len: 1318 microversion: 2.1 time: 0.696845 Jan 15 21:08:21.411947 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2876/5742] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:08:20 2022] GET /compute/v2.1/servers/d1ab7c55-42c1-4a32-a9fa-5aa3fce3db3e => generated 1318 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:08:21.657880 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f5e5f184-15cb-4add-bb01-9127e66ceb41 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:08:21.658493 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f5e5f184-15cb-4add-bb01-9127e66ceb41 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] [instance: 86b698ae-0ed3-4195-a604-1f3d1ec13d65] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:08:21.676683 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f5e5f184-15cb-4add-bb01-9127e66ceb41 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:21.677519 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f5e5f184-15cb-4add-bb01-9127e66ceb41 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:21.680261 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f5e5f184-15cb-4add-bb01-9127e66ceb41 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:21.683481 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f5e5f184-15cb-4add-bb01-9127e66ceb41 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:22.024714 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-f5e5f184-15cb-4add-bb01-9127e66ceb41 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2364cc12914bd3922a66feb86c5c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa736a1907e4790b2ea49bc7f31e50c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:08:22.036636 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f5e5f184-15cb-4add-bb01-9127e66ceb41 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] 10.222.0.46 "GET /compute/v2.1/servers/86b698ae-0ed3-4195-a604-1f3d1ec13d65" status: 200 len: 1319 microversion: 2.1 time: 0.378953 Jan 15 21:08:22.038398 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2867/5743] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:08:21 2022] GET /compute/v2.1/servers/86b698ae-0ed3-4195-a604-1f3d1ec13d65 => generated 1319 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:08:22.327413 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-11a08826-c68a-42fe-a72b-085fa84cd846 req-6e02846c-2163-4471-a5ee-12238eb8a506 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1ab7c55-42c1-4a32-a9fa-5aa3fce3db3e", "name": "network-vif-plugged", "status": "completed", "tag": "0527c920-da07-47ca-8285-284889ba3d59"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:08:22.330455 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:08:22.330455 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:08:22.370775 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-11a08826-c68a-42fe-a72b-085fa84cd846 req-6e02846c-2163-4471-a5ee-12238eb8a506 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:22.371246 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-11a08826-c68a-42fe-a72b-085fa84cd846 req-6e02846c-2163-4471-a5ee-12238eb8a506 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:22.396235 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-11a08826-c68a-42fe-a72b-085fa84cd846 req-6e02846c-2163-4471-a5ee-12238eb8a506 service nova] Creating event network-vif-plugged:0527c920-da07-47ca-8285-284889ba3d59 for instance d1ab7c55-42c1-4a32-a9fa-5aa3fce3db3e on nch2-master-1 Jan 15 21:08:22.406183 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-11a08826-c68a-42fe-a72b-085fa84cd846 req-6e02846c-2163-4471-a5ee-12238eb8a506 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084177 Jan 15 21:08:22.410002 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2877/5744] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:08:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:08:22.419629 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-516a2a35-ff0b-4f96-a6bc-adb5d51464f1 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:08:22.421686 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-516a2a35-ff0b-4f96-a6bc-adb5d51464f1 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] [instance: 25f2d43f-7008-4b4d-ac8d-5959a48ab04d] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:08:22.429313 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1a6be051-224c-4f35-b415-644cb76d3dda tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:08:22.430127 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-1a6be051-224c-4f35-b415-644cb76d3dda tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] [instance: d1ab7c55-42c1-4a32-a9fa-5aa3fce3db3e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:08:22.435892 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-516a2a35-ff0b-4f96-a6bc-adb5d51464f1 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:22.436548 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-516a2a35-ff0b-4f96-a6bc-adb5d51464f1 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:22.437723 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-516a2a35-ff0b-4f96-a6bc-adb5d51464f1 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:22.438349 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-516a2a35-ff0b-4f96-a6bc-adb5d51464f1 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:22.443608 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1a6be051-224c-4f35-b415-644cb76d3dda tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:22.447353 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1a6be051-224c-4f35-b415-644cb76d3dda tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:22.449843 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1a6be051-224c-4f35-b415-644cb76d3dda tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:22.452105 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1a6be051-224c-4f35-b415-644cb76d3dda tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:22.632979 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-516a2a35-ff0b-4f96-a6bc-adb5d51464f1 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6809a212fcc4730a3a30c81e8485ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d727625d6eb47febd54a3f4071bb7c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:08:22.661623 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-516a2a35-ff0b-4f96-a6bc-adb5d51464f1 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] 10.222.0.46 "GET /compute/v2.1/servers/25f2d43f-7008-4b4d-ac8d-5959a48ab04d" status: 200 len: 1279 microversion: 2.1 time: 0.250982 Jan 15 21:08:22.662272 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2868/5745] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:08:22 2022] GET /compute/v2.1/servers/25f2d43f-7008-4b4d-ac8d-5959a48ab04d => generated 1279 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:08:22.708958 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-e190efb1-e894-4b05-9b70-bf79c057807a req-26be57f8-8ef3-41b3-b52e-3eacc66030ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "827235d8-4a51-49b0-af9e-f45e37bcf762", "tag": "f3be8950-449a-4055-b53b-ad46640f964d"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:08:22.710682 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:08:22.710682 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:08:22.749560 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-e190efb1-e894-4b05-9b70-bf79c057807a req-26be57f8-8ef3-41b3-b52e-3eacc66030ec service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:22.755530 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-e190efb1-e894-4b05-9b70-bf79c057807a req-26be57f8-8ef3-41b3-b52e-3eacc66030ec service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:22.773622 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-1a6be051-224c-4f35-b415-644cb76d3dda tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822f4a2b1fd6459a8a472bdd066d69fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e03e1de077453588cc783a4e6d690e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:08:22.789141 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-1a6be051-224c-4f35-b415-644cb76d3dda tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] 10.222.0.46 "GET /compute/v2.1/servers/d1ab7c55-42c1-4a32-a9fa-5aa3fce3db3e" status: 200 len: 1318 microversion: 2.1 time: 0.365365 Jan 15 21:08:22.798539 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2878/5746] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:08:22 2022] GET /compute/v2.1/servers/d1ab7c55-42c1-4a32-a9fa-5aa3fce3db3e => generated 1318 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:08:22.818387 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-e190efb1-e894-4b05-9b70-bf79c057807a req-26be57f8-8ef3-41b3-b52e-3eacc66030ec service nova] Creating event network-changed:f3be8950-449a-4055-b53b-ad46640f964d for instance 827235d8-4a51-49b0-af9e-f45e37bcf762 on nch1-master-1 Jan 15 21:08:22.830733 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-e190efb1-e894-4b05-9b70-bf79c057807a req-26be57f8-8ef3-41b3-b52e-3eacc66030ec service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.160385 Jan 15 21:08:22.835612 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2869/5747] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:08:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:08:23.059616 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f73ab77e-5fd0-4879-8ecc-25119cdf17c1 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:08:23.060754 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f73ab77e-5fd0-4879-8ecc-25119cdf17c1 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] [instance: 86b698ae-0ed3-4195-a604-1f3d1ec13d65] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:08:23.069929 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f73ab77e-5fd0-4879-8ecc-25119cdf17c1 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:23.075320 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f73ab77e-5fd0-4879-8ecc-25119cdf17c1 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:23.080015 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f73ab77e-5fd0-4879-8ecc-25119cdf17c1 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:23.084385 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f73ab77e-5fd0-4879-8ecc-25119cdf17c1 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:23.531388 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-f73ab77e-5fd0-4879-8ecc-25119cdf17c1 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2364cc12914bd3922a66feb86c5c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa736a1907e4790b2ea49bc7f31e50c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:08:23.541514 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f73ab77e-5fd0-4879-8ecc-25119cdf17c1 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] 10.222.0.46 "GET /compute/v2.1/servers/86b698ae-0ed3-4195-a604-1f3d1ec13d65" status: 200 len: 1509 microversion: 2.1 time: 0.488305 Jan 15 21:08:23.546354 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2879/5748] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:08:23 2022] GET /compute/v2.1/servers/86b698ae-0ed3-4195-a604-1f3d1ec13d65 => generated 1509 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:08:23.683371 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-83c1dda1-ee68-4fc9-aacb-285c197e4ecb tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:08:23.684393 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-83c1dda1-ee68-4fc9-aacb-285c197e4ecb tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] [instance: 25f2d43f-7008-4b4d-ac8d-5959a48ab04d] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:08:23.702388 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-83c1dda1-ee68-4fc9-aacb-285c197e4ecb tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:23.703604 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-83c1dda1-ee68-4fc9-aacb-285c197e4ecb tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:23.707668 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-83c1dda1-ee68-4fc9-aacb-285c197e4ecb tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:23.708932 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-83c1dda1-ee68-4fc9-aacb-285c197e4ecb tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:23.818010 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ee3713f6-a069-4202-bdfa-e69c0d6819b8 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:08:23.818802 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ee3713f6-a069-4202-bdfa-e69c0d6819b8 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] [instance: d1ab7c55-42c1-4a32-a9fa-5aa3fce3db3e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:08:23.830307 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ee3713f6-a069-4202-bdfa-e69c0d6819b8 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:23.831666 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ee3713f6-a069-4202-bdfa-e69c0d6819b8 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:23.832986 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ee3713f6-a069-4202-bdfa-e69c0d6819b8 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:23.834248 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ee3713f6-a069-4202-bdfa-e69c0d6819b8 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:24.408769 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-83c1dda1-ee68-4fc9-aacb-285c197e4ecb tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6809a212fcc4730a3a30c81e8485ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d727625d6eb47febd54a3f4071bb7c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:08:24.417663 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-83c1dda1-ee68-4fc9-aacb-285c197e4ecb tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] 10.222.0.46 "GET /compute/v2.1/servers/25f2d43f-7008-4b4d-ac8d-5959a48ab04d" status: 200 len: 1279 microversion: 2.1 time: 0.741115 Jan 15 21:08:24.419902 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2870/5749] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:08:23 2022] GET /compute/v2.1/servers/25f2d43f-7008-4b4d-ac8d-5959a48ab04d => generated 1279 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:08:24.611810 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-ee3713f6-a069-4202-bdfa-e69c0d6819b8 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822f4a2b1fd6459a8a472bdd066d69fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e03e1de077453588cc783a4e6d690e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:08:24.620434 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ee3713f6-a069-4202-bdfa-e69c0d6819b8 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] 10.222.0.46 "GET /compute/v2.1/servers/d1ab7c55-42c1-4a32-a9fa-5aa3fce3db3e" status: 200 len: 1318 microversion: 2.1 time: 0.809448 Jan 15 21:08:24.637904 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2880/5750] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:08:23 2022] GET /compute/v2.1/servers/d1ab7c55-42c1-4a32-a9fa-5aa3fce3db3e => generated 1318 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:08:25.436499 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-03536003-19a5-43d1-bf8d-0f2cceac4cbe tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:08:25.437339 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-03536003-19a5-43d1-bf8d-0f2cceac4cbe tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] [instance: 25f2d43f-7008-4b4d-ac8d-5959a48ab04d] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:08:25.451535 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-03536003-19a5-43d1-bf8d-0f2cceac4cbe tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:25.454800 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-03536003-19a5-43d1-bf8d-0f2cceac4cbe tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:25.457659 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-03536003-19a5-43d1-bf8d-0f2cceac4cbe tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:25.458375 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-03536003-19a5-43d1-bf8d-0f2cceac4cbe tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:25.649128 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0e2dbb31-9512-4da6-a7a0-0073e65db0c0 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:08:25.650810 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-0e2dbb31-9512-4da6-a7a0-0073e65db0c0 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] [instance: d1ab7c55-42c1-4a32-a9fa-5aa3fce3db3e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:08:25.662563 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0e2dbb31-9512-4da6-a7a0-0073e65db0c0 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:25.663928 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0e2dbb31-9512-4da6-a7a0-0073e65db0c0 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:25.665334 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0e2dbb31-9512-4da6-a7a0-0073e65db0c0 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:25.666191 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0e2dbb31-9512-4da6-a7a0-0073e65db0c0 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:25.956431 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-03536003-19a5-43d1-bf8d-0f2cceac4cbe tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6809a212fcc4730a3a30c81e8485ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d727625d6eb47febd54a3f4071bb7c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:08:25.968572 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-03536003-19a5-43d1-bf8d-0f2cceac4cbe tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] 10.222.0.46 "GET /compute/v2.1/servers/25f2d43f-7008-4b4d-ac8d-5959a48ab04d" status: 200 len: 1321 microversion: 2.1 time: 0.537838 Jan 15 21:08:25.969434 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2871/5751] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:08:25 2022] GET /compute/v2.1/servers/25f2d43f-7008-4b4d-ac8d-5959a48ab04d => generated 1321 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:08:26.027859 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-0e2dbb31-9512-4da6-a7a0-0073e65db0c0 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822f4a2b1fd6459a8a472bdd066d69fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e03e1de077453588cc783a4e6d690e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:08:26.039680 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0e2dbb31-9512-4da6-a7a0-0073e65db0c0 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] 10.222.0.46 "GET /compute/v2.1/servers/d1ab7c55-42c1-4a32-a9fa-5aa3fce3db3e" status: 200 len: 1508 microversion: 2.1 time: 0.405835 Jan 15 21:08:26.042884 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2881/5752] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:08:25 2022] GET /compute/v2.1/servers/d1ab7c55-42c1-4a32-a9fa-5aa3fce3db3e => generated 1508 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:08:26.571515 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c61e2f5f-41e5-4354-8ae6-2c0f3919b517 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1df1f210-c337-4c2c-9ab2-6ce7c8ff1134", "device": "/dev/sdb"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:08:26.574407 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c61e2f5f-41e5-4354-8ae6-2c0f3919b517 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] [instance: 86b698ae-0ed3-4195-a604-1f3d1ec13d65] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:08:26.602173 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c61e2f5f-41e5-4354-8ae6-2c0f3919b517 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:26.605044 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c61e2f5f-41e5-4354-8ae6-2c0f3919b517 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:26.609840 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c61e2f5f-41e5-4354-8ae6-2c0f3919b517 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:26.614069 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c61e2f5f-41e5-4354-8ae6-2c0f3919b517 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:26.987721 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-5676a37a-4b4b-4540-a26f-7ab2e70c73ab tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:08:26.989019 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-5676a37a-4b4b-4540-a26f-7ab2e70c73ab tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] [instance: 25f2d43f-7008-4b4d-ac8d-5959a48ab04d] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:08:27.006658 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5676a37a-4b4b-4540-a26f-7ab2e70c73ab tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:27.007122 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5676a37a-4b4b-4540-a26f-7ab2e70c73ab tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:27.008349 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5676a37a-4b4b-4540-a26f-7ab2e70c73ab tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:27.009210 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5676a37a-4b4b-4540-a26f-7ab2e70c73ab tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:27.044178 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c61e2f5f-41e5-4354-8ae6-2c0f3919b517 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] 10.222.0.46 "POST /compute/v2.1/servers/86b698ae-0ed3-4195-a604-1f3d1ec13d65/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.477628 Jan 15 21:08:27.052501 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2872/5753] 10.222.0.46 () {60 vars in 1322 bytes} [Sat Jan 15 21:08:26 2022] POST /compute/v2.1/servers/86b698ae-0ed3-4195-a604-1f3d1ec13d65/os-volume_attachments => generated 194 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:08:27.143991 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-e60c4e20-2db5-4fbe-a0f5-d12157b796d7 req-fb3ebc2c-2ef7-42f3-9941-4adf08fd1f68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ad265d9-74dd-44bc-80d0-3a10870684e0", "tag": "05b918a9-ba4e-497c-b753-eb391f56ed6d"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:08:27.161518 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:08:27.161518 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:08:27.180400 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-e60c4e20-2db5-4fbe-a0f5-d12157b796d7 req-fb3ebc2c-2ef7-42f3-9941-4adf08fd1f68 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:27.191740 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-e60c4e20-2db5-4fbe-a0f5-d12157b796d7 req-fb3ebc2c-2ef7-42f3-9941-4adf08fd1f68 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:27.247795 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-e60c4e20-2db5-4fbe-a0f5-d12157b796d7 req-fb3ebc2c-2ef7-42f3-9941-4adf08fd1f68 service nova] Creating event network-changed:05b918a9-ba4e-497c-b753-eb391f56ed6d for instance 6ad265d9-74dd-44bc-80d0-3a10870684e0 on nch2-master-1 Jan 15 21:08:27.272904 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-e60c4e20-2db5-4fbe-a0f5-d12157b796d7 req-fb3ebc2c-2ef7-42f3-9941-4adf08fd1f68 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120891 Jan 15 21:08:27.277032 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2873/5754] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:08:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:08:27.559020 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-5676a37a-4b4b-4540-a26f-7ab2e70c73ab tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6809a212fcc4730a3a30c81e8485ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d727625d6eb47febd54a3f4071bb7c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:08:27.568327 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-5676a37a-4b4b-4540-a26f-7ab2e70c73ab tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] 10.222.0.46 "GET /compute/v2.1/servers/25f2d43f-7008-4b4d-ac8d-5959a48ab04d" status: 200 len: 1321 microversion: 2.1 time: 0.585166 Jan 15 21:08:27.573020 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2882/5755] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:08:26 2022] GET /compute/v2.1/servers/25f2d43f-7008-4b4d-ac8d-5959a48ab04d => generated 1321 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:08:27.717901 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-36d8e9e0-ec17-4c69-b547-0777f09b6b91 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f739d784-56d6-47b6-a3a0-4b21da8e89e8"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:08:27.719068 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-36d8e9e0-ec17-4c69-b547-0777f09b6b91 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] [instance: d1ab7c55-42c1-4a32-a9fa-5aa3fce3db3e] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:08:27.754213 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-36d8e9e0-ec17-4c69-b547-0777f09b6b91 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:27.754768 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-36d8e9e0-ec17-4c69-b547-0777f09b6b91 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:27.757802 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-36d8e9e0-ec17-4c69-b547-0777f09b6b91 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:27.758280 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-36d8e9e0-ec17-4c69-b547-0777f09b6b91 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:28.176014 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-36d8e9e0-ec17-4c69-b547-0777f09b6b91 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] 10.222.0.46 "POST /compute/v2.1/servers/d1ab7c55-42c1-4a32-a9fa-5aa3fce3db3e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.462675 Jan 15 21:08:28.177235 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2874/5756] 10.222.0.46 () {60 vars in 1322 bytes} [Sat Jan 15 21:08:27 2022] POST /compute/v2.1/servers/d1ab7c55-42c1-4a32-a9fa-5aa3fce3db3e/os-volume_attachments => generated 194 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:08:28.593962 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8271c8ee-eca8-4cc8-9357-c324a9e155a3 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:08:28.594909 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-8271c8ee-eca8-4cc8-9357-c324a9e155a3 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] [instance: 25f2d43f-7008-4b4d-ac8d-5959a48ab04d] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:08:28.616076 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8271c8ee-eca8-4cc8-9357-c324a9e155a3 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:28.619475 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8271c8ee-eca8-4cc8-9357-c324a9e155a3 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:28.620329 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8271c8ee-eca8-4cc8-9357-c324a9e155a3 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:28.620766 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8271c8ee-eca8-4cc8-9357-c324a9e155a3 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:29.397750 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-8271c8ee-eca8-4cc8-9357-c324a9e155a3 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6809a212fcc4730a3a30c81e8485ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d727625d6eb47febd54a3f4071bb7c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:08:29.428589 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-8271c8ee-eca8-4cc8-9357-c324a9e155a3 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] 10.222.0.46 "GET /compute/v2.1/servers/25f2d43f-7008-4b4d-ac8d-5959a48ab04d" status: 200 len: 1321 microversion: 2.1 time: 0.836823 Jan 15 21:08:29.430576 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2883/5757] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:08:28 2022] GET /compute/v2.1/servers/25f2d43f-7008-4b4d-ac8d-5959a48ab04d => generated 1321 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:08:29.758188 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-e4bd21c0-e60a-4d7f-9657-9dcdfdc0b769 req-c63c17b2-2c5a-4ef5-a966-fbcbee68314c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25f2d43f-7008-4b4d-ac8d-5959a48ab04d", "tag": "ff65d28b-c16d-4f12-aa41-9bb138a73168"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:08:29.760012 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:08:29.760012 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:08:29.777902 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-e4bd21c0-e60a-4d7f-9657-9dcdfdc0b769 req-c63c17b2-2c5a-4ef5-a966-fbcbee68314c service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:29.778225 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-e4bd21c0-e60a-4d7f-9657-9dcdfdc0b769 req-c63c17b2-2c5a-4ef5-a966-fbcbee68314c service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:29.808170 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-e4bd21c0-e60a-4d7f-9657-9dcdfdc0b769 req-c63c17b2-2c5a-4ef5-a966-fbcbee68314c service nova] Creating event network-changed:ff65d28b-c16d-4f12-aa41-9bb138a73168 for instance 25f2d43f-7008-4b4d-ac8d-5959a48ab04d on nch1-master-1 Jan 15 21:08:29.813840 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-e4bd21c0-e60a-4d7f-9657-9dcdfdc0b769 req-c63c17b2-2c5a-4ef5-a966-fbcbee68314c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061196 Jan 15 21:08:29.815157 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2875/5758] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:08:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:08:30.448350 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7c1bb09e-ce53-472d-81d9-460449f99fd0 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:08:30.449017 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-7c1bb09e-ce53-472d-81d9-460449f99fd0 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] [instance: 25f2d43f-7008-4b4d-ac8d-5959a48ab04d] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:08:30.467034 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7c1bb09e-ce53-472d-81d9-460449f99fd0 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:30.468165 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7c1bb09e-ce53-472d-81d9-460449f99fd0 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:30.474357 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7c1bb09e-ce53-472d-81d9-460449f99fd0 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:30.479886 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7c1bb09e-ce53-472d-81d9-460449f99fd0 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:30.905363 ncdv-master-1 devstack@n-api.service[129366]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 15 21:08:30.906347 ncdv-master-1 devstack@n-api.service[129366]: Sat Jan 15 21:08:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/25f2d43f-7008-4b4d-ac8d-5959a48ab04d (ip 10.222.0.46) !!! Jan 15 21:08:31.142246 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-7c1bb09e-ce53-472d-81d9-460449f99fd0 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6809a212fcc4730a3a30c81e8485ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d727625d6eb47febd54a3f4071bb7c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:08:31.163621 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7c1bb09e-ce53-472d-81d9-460449f99fd0 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] 10.222.0.46 "GET /compute/v2.1/servers/25f2d43f-7008-4b4d-ac8d-5959a48ab04d" status: 200 len: 1321 microversion: 2.1 time: 0.719806 Jan 15 21:08:31.169658 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2884/5759] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:08:30 2022] GET /compute/v2.1/servers/25f2d43f-7008-4b4d-ac8d-5959a48ab04d => generated 1321 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:08:31.993284 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d1e262b4-9a7f-4a61-b34b-d5bbbb17fef1 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:08:31.993864 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d1e262b4-9a7f-4a61-b34b-d5bbbb17fef1 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] [instance: d1ab7c55-42c1-4a32-a9fa-5aa3fce3db3e] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:08:32.011385 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d1e262b4-9a7f-4a61-b34b-d5bbbb17fef1 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:32.012017 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d1e262b4-9a7f-4a61-b34b-d5bbbb17fef1 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:32.014963 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d1e262b4-9a7f-4a61-b34b-d5bbbb17fef1 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:32.015561 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d1e262b4-9a7f-4a61-b34b-d5bbbb17fef1 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:32.120963 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.objects.instance [None req-d1e262b4-9a7f-4a61-b34b-d5bbbb17fef1 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lazy-loading 'services' on Instance uuid d1ab7c55-42c1-4a32-a9fa-5aa3fce3db3e {{(pid=129365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 21:08:32.181398 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c6a242df-53b9-487a-9866-21acb29be4a0 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:08:32.182086 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c6a242df-53b9-487a-9866-21acb29be4a0 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] [instance: 25f2d43f-7008-4b4d-ac8d-5959a48ab04d] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:08:32.195518 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c6a242df-53b9-487a-9866-21acb29be4a0 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:32.198170 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c6a242df-53b9-487a-9866-21acb29be4a0 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:32.200983 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c6a242df-53b9-487a-9866-21acb29be4a0 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:32.202671 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c6a242df-53b9-487a-9866-21acb29be4a0 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:32.227514 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d1e262b4-9a7f-4a61-b34b-d5bbbb17fef1 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] 10.222.0.46 "DELETE /compute/v2.1/servers/d1ab7c55-42c1-4a32-a9fa-5aa3fce3db3e/os-volume_attachments/f739d784-56d6-47b6-a3a0-4b21da8e89e8" status: 202 len: 0 microversion: 2.1 time: 0.240369 Jan 15 21:08:32.228133 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2876/5760] 10.222.0.46 () {58 vars in 1415 bytes} [Sat Jan 15 21:08:31 2022] DELETE /compute/v2.1/servers/d1ab7c55-42c1-4a32-a9fa-5aa3fce3db3e/os-volume_attachments/f739d784-56d6-47b6-a3a0-4b21da8e89e8 => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:08:32.245536 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-abec9464-2e7c-4651-a5ae-e135ea496a0e tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:08:32.249545 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-abec9464-2e7c-4651-a5ae-e135ea496a0e tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] [instance: d1ab7c55-42c1-4a32-a9fa-5aa3fce3db3e] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:08:32.265502 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-abec9464-2e7c-4651-a5ae-e135ea496a0e tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:32.266523 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-abec9464-2e7c-4651-a5ae-e135ea496a0e tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:32.272286 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-abec9464-2e7c-4651-a5ae-e135ea496a0e tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:32.273634 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-abec9464-2e7c-4651-a5ae-e135ea496a0e tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:32.380429 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-abec9464-2e7c-4651-a5ae-e135ea496a0e tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] 10.222.0.46 "GET /compute/v2.1/servers/d1ab7c55-42c1-4a32-a9fa-5aa3fce3db3e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.145383 Jan 15 21:08:32.388900 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2877/5761] 10.222.0.46 () {58 vars in 1301 bytes} [Sat Jan 15 21:08:32 2022] GET /compute/v2.1/servers/d1ab7c55-42c1-4a32-a9fa-5aa3fce3db3e/os-volume_attachments => generated 197 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:08:32.574902 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-c6a242df-53b9-487a-9866-21acb29be4a0 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6809a212fcc4730a3a30c81e8485ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d727625d6eb47febd54a3f4071bb7c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:08:32.587626 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c6a242df-53b9-487a-9866-21acb29be4a0 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] 10.222.0.46 "GET /compute/v2.1/servers/25f2d43f-7008-4b4d-ac8d-5959a48ab04d" status: 200 len: 1321 microversion: 2.1 time: 0.410439 Jan 15 21:08:32.597552 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2885/5762] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:08:32 2022] GET /compute/v2.1/servers/25f2d43f-7008-4b4d-ac8d-5959a48ab04d => generated 1321 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:08:33.333091 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-35b40413-a5fc-42df-a97d-3386d6aca7a8 req-3518bd13-0876-4503-8c72-09af4e8fdc3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "827235d8-4a51-49b0-af9e-f45e37bcf762", "name": "network-vif-plugged", "status": "completed", "tag": "f3be8950-449a-4055-b53b-ad46640f964d"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:08:33.335537 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:08:33.335537 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:08:33.354039 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-35b40413-a5fc-42df-a97d-3386d6aca7a8 req-3518bd13-0876-4503-8c72-09af4e8fdc3e service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:33.357119 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-35b40413-a5fc-42df-a97d-3386d6aca7a8 req-3518bd13-0876-4503-8c72-09af4e8fdc3e service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:33.389890 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-35b40413-a5fc-42df-a97d-3386d6aca7a8 req-3518bd13-0876-4503-8c72-09af4e8fdc3e service nova] Creating event network-vif-plugged:f3be8950-449a-4055-b53b-ad46640f964d for instance 827235d8-4a51-49b0-af9e-f45e37bcf762 on nch1-master-1 Jan 15 21:08:33.401147 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-35667067-4598-4676-925e-ac0f8de9aa5e tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:08:33.403132 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-35667067-4598-4676-925e-ac0f8de9aa5e tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] [instance: d1ab7c55-42c1-4a32-a9fa-5aa3fce3db3e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:08:33.404810 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-35b40413-a5fc-42df-a97d-3386d6aca7a8 req-3518bd13-0876-4503-8c72-09af4e8fdc3e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072816 Jan 15 21:08:33.405665 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2878/5763] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:08:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:08:33.445619 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-35667067-4598-4676-925e-ac0f8de9aa5e tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:33.447963 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-35667067-4598-4676-925e-ac0f8de9aa5e tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:33.459489 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-35667067-4598-4676-925e-ac0f8de9aa5e tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:33.460024 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-35667067-4598-4676-925e-ac0f8de9aa5e tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:33.531461 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-35667067-4598-4676-925e-ac0f8de9aa5e tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] 10.222.0.46 "GET /compute/v2.1/servers/d1ab7c55-42c1-4a32-a9fa-5aa3fce3db3e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.134827 Jan 15 21:08:33.532361 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2886/5764] 10.222.0.46 () {58 vars in 1301 bytes} [Sat Jan 15 21:08:33 2022] GET /compute/v2.1/servers/d1ab7c55-42c1-4a32-a9fa-5aa3fce3db3e/os-volume_attachments => generated 25 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 21:08:33.606961 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f0953e83-8fd0-4788-8ab9-785bffea101e tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:08:33.612514 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f0953e83-8fd0-4788-8ab9-785bffea101e tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] [instance: 25f2d43f-7008-4b4d-ac8d-5959a48ab04d] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:08:33.624004 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f0953e83-8fd0-4788-8ab9-785bffea101e tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:33.624508 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f0953e83-8fd0-4788-8ab9-785bffea101e tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:33.632589 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f0953e83-8fd0-4788-8ab9-785bffea101e tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:33.632589 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f0953e83-8fd0-4788-8ab9-785bffea101e tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:34.022172 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-f0953e83-8fd0-4788-8ab9-785bffea101e tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6809a212fcc4730a3a30c81e8485ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d727625d6eb47febd54a3f4071bb7c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:08:34.037335 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f0953e83-8fd0-4788-8ab9-785bffea101e tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] 10.222.0.46 "GET /compute/v2.1/servers/25f2d43f-7008-4b4d-ac8d-5959a48ab04d" status: 200 len: 1321 microversion: 2.1 time: 0.434935 Jan 15 21:08:34.037951 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2879/5765] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:08:33 2022] GET /compute/v2.1/servers/25f2d43f-7008-4b4d-ac8d-5959a48ab04d => generated 1321 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:08:34.891991 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-603d9f27-6f9c-4f00-959b-205b39700179 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:08:34.892469 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-603d9f27-6f9c-4f00-959b-205b39700179 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] [instance: d1ab7c55-42c1-4a32-a9fa-5aa3fce3db3e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:08:34.903550 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-603d9f27-6f9c-4f00-959b-205b39700179 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:34.903899 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-603d9f27-6f9c-4f00-959b-205b39700179 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:34.905883 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-603d9f27-6f9c-4f00-959b-205b39700179 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:34.906488 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-603d9f27-6f9c-4f00-959b-205b39700179 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:34.992305 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-603d9f27-6f9c-4f00-959b-205b39700179 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] [instance: d1ab7c55-42c1-4a32-a9fa-5aa3fce3db3e] Going to try to terminate instance {{(pid=129366) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 21:08:35.054600 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-39acbc3b-a0c9-4737-b920-ab63d5147064 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:08:35.055253 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-39acbc3b-a0c9-4737-b920-ab63d5147064 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] [instance: 25f2d43f-7008-4b4d-ac8d-5959a48ab04d] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:08:35.065896 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-39acbc3b-a0c9-4737-b920-ab63d5147064 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:35.066279 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-39acbc3b-a0c9-4737-b920-ab63d5147064 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:35.071968 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-39acbc3b-a0c9-4737-b920-ab63d5147064 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:35.072804 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-39acbc3b-a0c9-4737-b920-ab63d5147064 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:35.220555 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-603d9f27-6f9c-4f00-959b-205b39700179 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] 10.222.0.46 "DELETE /compute/v2.1/servers/d1ab7c55-42c1-4a32-a9fa-5aa3fce3db3e" status: 204 len: 0 microversion: 2.1 time: 0.332572 Jan 15 21:08:35.221797 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2887/5766] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 21:08:34 2022] DELETE /compute/v2.1/servers/d1ab7c55-42c1-4a32-a9fa-5aa3fce3db3e => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 21:08:35.236397 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b6a02912-711a-445c-954b-fb7ac78402d8 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:08:35.240160 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b6a02912-711a-445c-954b-fb7ac78402d8 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] [instance: d1ab7c55-42c1-4a32-a9fa-5aa3fce3db3e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:08:35.250526 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b6a02912-711a-445c-954b-fb7ac78402d8 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:35.251299 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b6a02912-711a-445c-954b-fb7ac78402d8 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:35.252691 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b6a02912-711a-445c-954b-fb7ac78402d8 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:35.253774 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b6a02912-711a-445c-954b-fb7ac78402d8 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:35.578555 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-39acbc3b-a0c9-4737-b920-ab63d5147064 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6809a212fcc4730a3a30c81e8485ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d727625d6eb47febd54a3f4071bb7c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:08:35.589283 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-39acbc3b-a0c9-4737-b920-ab63d5147064 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] 10.222.0.46 "GET /compute/v2.1/servers/25f2d43f-7008-4b4d-ac8d-5959a48ab04d" status: 200 len: 1321 microversion: 2.1 time: 0.538548 Jan 15 21:08:35.593100 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2880/5767] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:08:35 2022] GET /compute/v2.1/servers/25f2d43f-7008-4b4d-ac8d-5959a48ab04d => generated 1321 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:08:35.608417 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-21cbd48a-3b7c-4c69-8979-07dd41eaa627 req-43924a89-bbb1-41a4-94dd-9aa5920b1ba9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ad265d9-74dd-44bc-80d0-3a10870684e0", "name": "network-vif-plugged", "status": "completed", "tag": "05b918a9-ba4e-497c-b753-eb391f56ed6d"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:08:35.618752 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:08:35.618752 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:08:35.643934 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-21cbd48a-3b7c-4c69-8979-07dd41eaa627 req-43924a89-bbb1-41a4-94dd-9aa5920b1ba9 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:35.644561 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-21cbd48a-3b7c-4c69-8979-07dd41eaa627 req-43924a89-bbb1-41a4-94dd-9aa5920b1ba9 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:35.679193 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-21cbd48a-3b7c-4c69-8979-07dd41eaa627 req-43924a89-bbb1-41a4-94dd-9aa5920b1ba9 service nova] Creating event network-vif-plugged:05b918a9-ba4e-497c-b753-eb391f56ed6d for instance 6ad265d9-74dd-44bc-80d0-3a10870684e0 on nch2-master-1 Jan 15 21:08:35.691692 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-21cbd48a-3b7c-4c69-8979-07dd41eaa627 req-43924a89-bbb1-41a4-94dd-9aa5920b1ba9 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089109 Jan 15 21:08:35.692320 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2881/5768] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:08:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:08:35.820722 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-b6a02912-711a-445c-954b-fb7ac78402d8 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822f4a2b1fd6459a8a472bdd066d69fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e03e1de077453588cc783a4e6d690e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:08:35.831579 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b6a02912-711a-445c-954b-fb7ac78402d8 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] 10.222.0.46 "GET /compute/v2.1/servers/d1ab7c55-42c1-4a32-a9fa-5aa3fce3db3e" status: 200 len: 1514 microversion: 2.1 time: 0.600688 Jan 15 21:08:35.834412 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2888/5769] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:08:35 2022] GET /compute/v2.1/servers/d1ab7c55-42c1-4a32-a9fa-5aa3fce3db3e => generated 1514 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:08:36.611140 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9e7fa2e8-6d47-408d-9546-555978167b67 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:08:36.613950 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-9e7fa2e8-6d47-408d-9546-555978167b67 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] [instance: 25f2d43f-7008-4b4d-ac8d-5959a48ab04d] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:08:36.625935 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9e7fa2e8-6d47-408d-9546-555978167b67 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:36.626623 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9e7fa2e8-6d47-408d-9546-555978167b67 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:36.628484 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9e7fa2e8-6d47-408d-9546-555978167b67 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:36.629259 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9e7fa2e8-6d47-408d-9546-555978167b67 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:36.816260 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-9e7fa2e8-6d47-408d-9546-555978167b67 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6809a212fcc4730a3a30c81e8485ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d727625d6eb47febd54a3f4071bb7c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:08:36.829333 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-9e7fa2e8-6d47-408d-9546-555978167b67 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] 10.222.0.46 "GET /compute/v2.1/servers/25f2d43f-7008-4b4d-ac8d-5959a48ab04d" status: 200 len: 1321 microversion: 2.1 time: 0.222931 Jan 15 21:08:36.830783 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2882/5770] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:08:36 2022] GET /compute/v2.1/servers/25f2d43f-7008-4b4d-ac8d-5959a48ab04d => generated 1321 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:08:36.851586 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b78cf56a-10a1-44ed-b6bd-24bb8d749260 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:08:36.852868 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b78cf56a-10a1-44ed-b6bd-24bb8d749260 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] [instance: d1ab7c55-42c1-4a32-a9fa-5aa3fce3db3e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:08:36.861252 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b78cf56a-10a1-44ed-b6bd-24bb8d749260 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:36.868498 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b78cf56a-10a1-44ed-b6bd-24bb8d749260 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:36.869670 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b78cf56a-10a1-44ed-b6bd-24bb8d749260 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:36.872749 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b78cf56a-10a1-44ed-b6bd-24bb8d749260 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:37.852234 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-30ce978e-0af8-44ca-aae5-46874f92b61b tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:08:37.852968 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-30ce978e-0af8-44ca-aae5-46874f92b61b tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] [instance: 25f2d43f-7008-4b4d-ac8d-5959a48ab04d] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:08:37.868498 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-30ce978e-0af8-44ca-aae5-46874f92b61b tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:37.868957 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-30ce978e-0af8-44ca-aae5-46874f92b61b tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:37.869765 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-30ce978e-0af8-44ca-aae5-46874f92b61b tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:37.870205 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-30ce978e-0af8-44ca-aae5-46874f92b61b tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:37.889782 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-b78cf56a-10a1-44ed-b6bd-24bb8d749260 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822f4a2b1fd6459a8a472bdd066d69fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e03e1de077453588cc783a4e6d690e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:08:37.903854 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b78cf56a-10a1-44ed-b6bd-24bb8d749260 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] 10.222.0.46 "GET /compute/v2.1/servers/d1ab7c55-42c1-4a32-a9fa-5aa3fce3db3e" status: 200 len: 1514 microversion: 2.1 time: 1.056309 Jan 15 21:08:37.906834 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2889/5771] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:08:36 2022] GET /compute/v2.1/servers/d1ab7c55-42c1-4a32-a9fa-5aa3fce3db3e => generated 1514 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:08:38.558200 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-7ca40725-2bad-4ef3-94e7-fd4df39c0427 req-cafb8b38-6a64-4d5a-b90b-548691db3ead service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1ab7c55-42c1-4a32-a9fa-5aa3fce3db3e", "name": "network-vif-deleted", "tag": "0527c920-da07-47ca-8285-284889ba3d59"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:08:38.559510 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:08:38.559510 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:08:38.587867 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-7ca40725-2bad-4ef3-94e7-fd4df39c0427 req-cafb8b38-6a64-4d5a-b90b-548691db3ead service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:38.591320 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-7ca40725-2bad-4ef3-94e7-fd4df39c0427 req-cafb8b38-6a64-4d5a-b90b-548691db3ead service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:38.640192 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-7ca40725-2bad-4ef3-94e7-fd4df39c0427 req-cafb8b38-6a64-4d5a-b90b-548691db3ead service nova] Creating event network-vif-deleted:0527c920-da07-47ca-8285-284889ba3d59 for instance d1ab7c55-42c1-4a32-a9fa-5aa3fce3db3e on nch2-master-1 Jan 15 21:08:38.661154 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-7ca40725-2bad-4ef3-94e7-fd4df39c0427 req-cafb8b38-6a64-4d5a-b90b-548691db3ead service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109028 Jan 15 21:08:38.669156 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2890/5772] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:08:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 21:08:38.716732 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-30ce978e-0af8-44ca-aae5-46874f92b61b tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6809a212fcc4730a3a30c81e8485ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d727625d6eb47febd54a3f4071bb7c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:08:38.728350 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-30ce978e-0af8-44ca-aae5-46874f92b61b tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] 10.222.0.46 "GET /compute/v2.1/servers/25f2d43f-7008-4b4d-ac8d-5959a48ab04d" status: 200 len: 1321 microversion: 2.1 time: 0.884737 Jan 15 21:08:38.730105 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2883/5773] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:08:37 2022] GET /compute/v2.1/servers/25f2d43f-7008-4b4d-ac8d-5959a48ab04d => generated 1321 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:08:38.925509 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9ad5d84e-44fd-498b-ac48-7512f3053ace tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:08:38.935750 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-9ad5d84e-44fd-498b-ac48-7512f3053ace tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] [instance: d1ab7c55-42c1-4a32-a9fa-5aa3fce3db3e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:08:38.957688 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9ad5d84e-44fd-498b-ac48-7512f3053ace tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:38.960342 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9ad5d84e-44fd-498b-ac48-7512f3053ace tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:38.961179 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9ad5d84e-44fd-498b-ac48-7512f3053ace tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:38.961626 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9ad5d84e-44fd-498b-ac48-7512f3053ace tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:39.044740 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9ad5d84e-44fd-498b-ac48-7512f3053ace tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:39.045251 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9ad5d84e-44fd-498b-ac48-7512f3053ace tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:39.049083 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.objects.instance [None req-9ad5d84e-44fd-498b-ac48-7512f3053ace tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lazy-loading 'fault' on Instance uuid d1ab7c55-42c1-4a32-a9fa-5aa3fce3db3e {{(pid=129366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 21:08:39.227421 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-9ad5d84e-44fd-498b-ac48-7512f3053ace tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822f4a2b1fd6459a8a472bdd066d69fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e03e1de077453588cc783a4e6d690e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:08:39.240762 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-9ad5d84e-44fd-498b-ac48-7512f3053ace tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] 10.222.0.46 "GET /compute/v2.1/servers/d1ab7c55-42c1-4a32-a9fa-5aa3fce3db3e" status: 200 len: 1308 microversion: 2.1 time: 0.321686 Jan 15 21:08:39.242499 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2891/5774] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:08:38 2022] GET /compute/v2.1/servers/d1ab7c55-42c1-4a32-a9fa-5aa3fce3db3e => generated 1308 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:08:39.580816 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-c3db6ab9-dba7-48d1-bc01-b07e7aa2bf6b req-dee7d5f2-f70d-4b7f-bb1e-eec32d76b61d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25f2d43f-7008-4b4d-ac8d-5959a48ab04d", "name": "network-vif-plugged", "status": "completed", "tag": "ff65d28b-c16d-4f12-aa41-9bb138a73168"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:08:39.583346 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:08:39.583346 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:08:39.607355 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-c3db6ab9-dba7-48d1-bc01-b07e7aa2bf6b req-dee7d5f2-f70d-4b7f-bb1e-eec32d76b61d service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:39.607808 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-c3db6ab9-dba7-48d1-bc01-b07e7aa2bf6b req-dee7d5f2-f70d-4b7f-bb1e-eec32d76b61d service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:39.637889 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-c3db6ab9-dba7-48d1-bc01-b07e7aa2bf6b req-dee7d5f2-f70d-4b7f-bb1e-eec32d76b61d service nova] Creating event network-vif-plugged:ff65d28b-c16d-4f12-aa41-9bb138a73168 for instance 25f2d43f-7008-4b4d-ac8d-5959a48ab04d on nch1-master-1 Jan 15 21:08:39.650768 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-c3db6ab9-dba7-48d1-bc01-b07e7aa2bf6b req-dee7d5f2-f70d-4b7f-bb1e-eec32d76b61d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073525 Jan 15 21:08:39.654576 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2884/5775] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:08:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:08:39.746983 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a1cc541e-e70b-42dc-adc9-923fed83682b tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:08:39.747604 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a1cc541e-e70b-42dc-adc9-923fed83682b tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] [instance: 25f2d43f-7008-4b4d-ac8d-5959a48ab04d] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:08:39.757695 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a1cc541e-e70b-42dc-adc9-923fed83682b tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:39.758077 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a1cc541e-e70b-42dc-adc9-923fed83682b tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:39.758886 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a1cc541e-e70b-42dc-adc9-923fed83682b tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:39.759328 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a1cc541e-e70b-42dc-adc9-923fed83682b tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:40.045966 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-a1cc541e-e70b-42dc-adc9-923fed83682b tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6809a212fcc4730a3a30c81e8485ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d727625d6eb47febd54a3f4071bb7c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:08:40.071055 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a1cc541e-e70b-42dc-adc9-923fed83682b tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] 10.222.0.46 "GET /compute/v2.1/servers/25f2d43f-7008-4b4d-ac8d-5959a48ab04d" status: 200 len: 1321 microversion: 2.1 time: 0.327620 Jan 15 21:08:40.086431 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2892/5776] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:08:39 2022] GET /compute/v2.1/servers/25f2d43f-7008-4b4d-ac8d-5959a48ab04d => generated 1321 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:08:40.259954 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e41c20bd-af52-428a-95be-8415d7fcb127 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:08:40.260671 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e41c20bd-af52-428a-95be-8415d7fcb127 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] [instance: d1ab7c55-42c1-4a32-a9fa-5aa3fce3db3e] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:08:40.271601 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e41c20bd-af52-428a-95be-8415d7fcb127 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:40.272143 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e41c20bd-af52-428a-95be-8415d7fcb127 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:40.273951 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e41c20bd-af52-428a-95be-8415d7fcb127 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:40.273951 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e41c20bd-af52-428a-95be-8415d7fcb127 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:40.295764 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-e41c20bd-af52-428a-95be-8415d7fcb127 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] HTTP exception thrown: Instance d1ab7c55-42c1-4a32-a9fa-5aa3fce3db3e could not be found. Jan 15 21:08:40.296517 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e41c20bd-af52-428a-95be-8415d7fcb127 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Returning 404 to user: Instance d1ab7c55-42c1-4a32-a9fa-5aa3fce3db3e could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:08:40.297412 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e41c20bd-af52-428a-95be-8415d7fcb127 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] 10.222.0.46 "GET /compute/v2.1/servers/d1ab7c55-42c1-4a32-a9fa-5aa3fce3db3e" status: 404 len: 111 microversion: 2.1 time: 0.041805 Jan 15 21:08:40.302191 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2885/5777] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:08:40 2022] GET /compute/v2.1/servers/d1ab7c55-42c1-4a32-a9fa-5aa3fce3db3e => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:08:41.094583 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c49e5783-b231-4def-99ad-d4998f389e91 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:08:41.095451 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c49e5783-b231-4def-99ad-d4998f389e91 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] [instance: 25f2d43f-7008-4b4d-ac8d-5959a48ab04d] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:08:41.111011 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c49e5783-b231-4def-99ad-d4998f389e91 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:41.112550 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c49e5783-b231-4def-99ad-d4998f389e91 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:41.113843 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c49e5783-b231-4def-99ad-d4998f389e91 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:41.114959 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c49e5783-b231-4def-99ad-d4998f389e91 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:41.407358 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-c49e5783-b231-4def-99ad-d4998f389e91 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6809a212fcc4730a3a30c81e8485ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d727625d6eb47febd54a3f4071bb7c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:08:41.419439 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c49e5783-b231-4def-99ad-d4998f389e91 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] 10.222.0.46 "GET /compute/v2.1/servers/25f2d43f-7008-4b4d-ac8d-5959a48ab04d" status: 200 len: 1321 microversion: 2.1 time: 0.329701 Jan 15 21:08:41.430936 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2893/5778] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:08:41 2022] GET /compute/v2.1/servers/25f2d43f-7008-4b4d-ac8d-5959a48ab04d => generated 1321 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:08:41.528482 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3e822438-0fb6-4e52-86dd-622855d7c615 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:08:41.529619 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-3e822438-0fb6-4e52-86dd-622855d7c615 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] [instance: 2eb104af-fb2d-44d7-9c7a-e5380040ecb3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:08:41.548658 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3e822438-0fb6-4e52-86dd-622855d7c615 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:41.550478 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3e822438-0fb6-4e52-86dd-622855d7c615 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:41.551316 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3e822438-0fb6-4e52-86dd-622855d7c615 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:41.551763 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3e822438-0fb6-4e52-86dd-622855d7c615 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:41.600710 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-3e822438-0fb6-4e52-86dd-622855d7c615 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] [instance: 2eb104af-fb2d-44d7-9c7a-e5380040ecb3] Going to try to terminate instance {{(pid=129365) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 21:08:41.706498 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3e822438-0fb6-4e52-86dd-622855d7c615 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] 10.222.0.46 "DELETE /compute/v2.1/servers/2eb104af-fb2d-44d7-9c7a-e5380040ecb3" status: 204 len: 0 microversion: 2.1 time: 0.181744 Jan 15 21:08:41.711086 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2886/5779] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 21:08:41 2022] DELETE /compute/v2.1/servers/2eb104af-fb2d-44d7-9c7a-e5380040ecb3 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 21:08:41.715938 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-53476e51-3cc5-42bb-a85c-8cd583324412 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:08:41.716546 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-53476e51-3cc5-42bb-a85c-8cd583324412 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] [instance: 2eb104af-fb2d-44d7-9c7a-e5380040ecb3] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:08:41.726113 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-53476e51-3cc5-42bb-a85c-8cd583324412 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:41.726789 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-53476e51-3cc5-42bb-a85c-8cd583324412 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:41.727762 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-53476e51-3cc5-42bb-a85c-8cd583324412 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:41.728527 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-53476e51-3cc5-42bb-a85c-8cd583324412 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:41.887847 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-53476e51-3cc5-42bb-a85c-8cd583324412 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822f4a2b1fd6459a8a472bdd066d69fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e03e1de077453588cc783a4e6d690e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:08:41.897514 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-53476e51-3cc5-42bb-a85c-8cd583324412 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] 10.222.0.46 "GET /compute/v2.1/servers/2eb104af-fb2d-44d7-9c7a-e5380040ecb3" status: 200 len: 1513 microversion: 2.1 time: 0.185395 Jan 15 21:08:41.898113 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2894/5780] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:08:41 2022] GET /compute/v2.1/servers/2eb104af-fb2d-44d7-9c7a-e5380040ecb3 => generated 1513 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:08:42.437451 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-efd9c1a5-7e66-4c83-96d8-9ba1889c0f56 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:08:42.438459 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-efd9c1a5-7e66-4c83-96d8-9ba1889c0f56 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] [instance: 25f2d43f-7008-4b4d-ac8d-5959a48ab04d] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:08:42.464356 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-efd9c1a5-7e66-4c83-96d8-9ba1889c0f56 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:42.467161 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-efd9c1a5-7e66-4c83-96d8-9ba1889c0f56 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:42.467994 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-efd9c1a5-7e66-4c83-96d8-9ba1889c0f56 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:42.468441 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-efd9c1a5-7e66-4c83-96d8-9ba1889c0f56 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:42.725463 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-efd9c1a5-7e66-4c83-96d8-9ba1889c0f56 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6809a212fcc4730a3a30c81e8485ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d727625d6eb47febd54a3f4071bb7c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:08:42.734463 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-efd9c1a5-7e66-4c83-96d8-9ba1889c0f56 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] 10.222.0.46 "GET /compute/v2.1/servers/25f2d43f-7008-4b4d-ac8d-5959a48ab04d" status: 200 len: 1511 microversion: 2.1 time: 0.301484 Jan 15 21:08:42.735067 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2887/5781] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:08:42 2022] GET /compute/v2.1/servers/25f2d43f-7008-4b4d-ac8d-5959a48ab04d => generated 1511 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:08:42.751664 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f821ea3b-8a25-49f8-96ad-4e99dcd2b2c5 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:08:42.754140 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f821ea3b-8a25-49f8-96ad-4e99dcd2b2c5 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] [instance: 827235d8-4a51-49b0-af9e-f45e37bcf762] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:08:42.765621 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f821ea3b-8a25-49f8-96ad-4e99dcd2b2c5 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:42.766416 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f821ea3b-8a25-49f8-96ad-4e99dcd2b2c5 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:42.767361 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f821ea3b-8a25-49f8-96ad-4e99dcd2b2c5 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:42.775563 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f821ea3b-8a25-49f8-96ad-4e99dcd2b2c5 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:42.918127 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-920e9118-9ae8-412a-84e6-152f989f2d7c tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:08:42.919003 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-920e9118-9ae8-412a-84e6-152f989f2d7c tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] [instance: 2eb104af-fb2d-44d7-9c7a-e5380040ecb3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:08:42.934659 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-920e9118-9ae8-412a-84e6-152f989f2d7c tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:42.938030 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-920e9118-9ae8-412a-84e6-152f989f2d7c tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:42.939134 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-920e9118-9ae8-412a-84e6-152f989f2d7c tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:42.940257 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-920e9118-9ae8-412a-84e6-152f989f2d7c tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:43.030591 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-f821ea3b-8a25-49f8-96ad-4e99dcd2b2c5 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6809a212fcc4730a3a30c81e8485ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d727625d6eb47febd54a3f4071bb7c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:08:43.042692 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f821ea3b-8a25-49f8-96ad-4e99dcd2b2c5 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] 10.222.0.46 "GET /compute/v2.1/servers/827235d8-4a51-49b0-af9e-f45e37bcf762" status: 200 len: 1510 microversion: 2.1 time: 0.294799 Jan 15 21:08:43.043571 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2895/5782] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:08:42 2022] GET /compute/v2.1/servers/827235d8-4a51-49b0-af9e-f45e37bcf762 => generated 1510 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:08:43.060249 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f7469121-80f4-4392-91dd-61460754c468 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:08:43.061250 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f7469121-80f4-4392-91dd-61460754c468 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] [instance: 6ad265d9-74dd-44bc-80d0-3a10870684e0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:08:43.070143 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f7469121-80f4-4392-91dd-61460754c468 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:43.070924 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f7469121-80f4-4392-91dd-61460754c468 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:43.071905 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f7469121-80f4-4392-91dd-61460754c468 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:43.072514 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f7469121-80f4-4392-91dd-61460754c468 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:43.191681 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-920e9118-9ae8-412a-84e6-152f989f2d7c tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822f4a2b1fd6459a8a472bdd066d69fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e03e1de077453588cc783a4e6d690e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:08:43.200550 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-920e9118-9ae8-412a-84e6-152f989f2d7c tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] 10.222.0.46 "GET /compute/v2.1/servers/2eb104af-fb2d-44d7-9c7a-e5380040ecb3" status: 200 len: 1513 microversion: 2.1 time: 0.287613 Jan 15 21:08:43.202893 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2888/5783] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:08:42 2022] GET /compute/v2.1/servers/2eb104af-fb2d-44d7-9c7a-e5380040ecb3 => generated 1513 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:08:43.297369 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-f7469121-80f4-4392-91dd-61460754c468 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6809a212fcc4730a3a30c81e8485ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d727625d6eb47febd54a3f4071bb7c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:08:43.315077 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f7469121-80f4-4392-91dd-61460754c468 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] 10.222.0.46 "GET /compute/v2.1/servers/6ad265d9-74dd-44bc-80d0-3a10870684e0" status: 200 len: 1510 microversion: 2.1 time: 0.258745 Jan 15 21:08:43.315974 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2896/5784] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:08:43 2022] GET /compute/v2.1/servers/6ad265d9-74dd-44bc-80d0-3a10870684e0 => generated 1510 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:08:43.333056 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d1f6024f-3ddd-4f3d-870f-b6ee268e68aa tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:08:43.342258 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:08:43.342258 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:08:43.344552 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-d1f6024f-3ddd-4f3d-870f-b6ee268e68aa tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e6809a212fcc4730a3a30c81e8485ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d727625d6eb47febd54a3f4071bb7c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:08:43.346491 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d1f6024f-3ddd-4f3d-870f-b6ee268e68aa tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '8d727625d6eb47febd54a3f4071bb7c3'} {{(pid=129365) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 15 21:08:43.363861 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d1f6024f-3ddd-4f3d-870f-b6ee268e68aa tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:43.364516 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d1f6024f-3ddd-4f3d-870f-b6ee268e68aa tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:43.365460 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d1f6024f-3ddd-4f3d-870f-b6ee268e68aa tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:43.366000 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d1f6024f-3ddd-4f3d-870f-b6ee268e68aa tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:43.473631 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.multi_cell_list [None req-d1f6024f-3ddd-4f3d-870f-b6ee268e68aa tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=129365) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jan 15 21:08:43.565165 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-d1f6024f-3ddd-4f3d-870f-b6ee268e68aa tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6809a212fcc4730a3a30c81e8485ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d727625d6eb47febd54a3f4071bb7c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:08:43.573353 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d1f6024f-3ddd-4f3d-870f-b6ee268e68aa tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:43.573992 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d1f6024f-3ddd-4f3d-870f-b6ee268e68aa tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:43.726773 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d1f6024f-3ddd-4f3d-870f-b6ee268e68aa tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] 10.222.0.46 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1514 microversion: 2.1 time: 0.397714 Jan 15 21:08:43.727992 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2889/5785] 10.222.0.46 () {58 vars in 1166 bytes} [Sat Jan 15 21:08:43 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1514 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:08:43.745447 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0ca35cef-bf22-4f9b-aae1-ef74910db57b tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:08:43.749456 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:08:43.749456 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:08:43.750901 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-0ca35cef-bf22-4f9b-aae1-ef74910db57b tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e6809a212fcc4730a3a30c81e8485ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d727625d6eb47febd54a3f4071bb7c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:08:43.752448 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-0ca35cef-bf22-4f9b-aae1-ef74910db57b tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-216154498', 'deleted': False, 'project_id': '8d727625d6eb47febd54a3f4071bb7c3'} {{(pid=129366) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 15 21:08:43.758738 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0ca35cef-bf22-4f9b-aae1-ef74910db57b tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:43.759408 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0ca35cef-bf22-4f9b-aae1-ef74910db57b tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:43.760373 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0ca35cef-bf22-4f9b-aae1-ef74910db57b tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:43.761148 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0ca35cef-bf22-4f9b-aae1-ef74910db57b tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:43.865089 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.multi_cell_list [None req-0ca35cef-bf22-4f9b-aae1-ef74910db57b tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=129366) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jan 15 21:08:43.952234 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-0ca35cef-bf22-4f9b-aae1-ef74910db57b tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6809a212fcc4730a3a30c81e8485ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d727625d6eb47febd54a3f4071bb7c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:08:43.961001 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0ca35cef-bf22-4f9b-aae1-ef74910db57b tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:43.961987 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0ca35cef-bf22-4f9b-aae1-ef74910db57b tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:44.217938 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-6a3a8971-1e30-4f1a-a526-a78c497582f9 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:08:44.218546 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-6a3a8971-1e30-4f1a-a526-a78c497582f9 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] [instance: 2eb104af-fb2d-44d7-9c7a-e5380040ecb3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:08:44.225679 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6a3a8971-1e30-4f1a-a526-a78c497582f9 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:44.226336 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6a3a8971-1e30-4f1a-a526-a78c497582f9 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:44.227473 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6a3a8971-1e30-4f1a-a526-a78c497582f9 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:44.228395 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6a3a8971-1e30-4f1a-a526-a78c497582f9 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:44.267448 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0ca35cef-bf22-4f9b-aae1-ef74910db57b tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] 10.222.0.46 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-216154498" status: 200 len: 1513 microversion: 2.1 time: 0.525533 Jan 15 21:08:44.280969 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2897/5786] 10.222.0.46 () {58 vars in 1260 bytes} [Sat Jan 15 21:08:43 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-216154498 => generated 1513 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:08:44.287379 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f65966c6-9286-4ee6-b198-4b71f6a98d57 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:08:44.290653 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:08:44.290653 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:08:44.292360 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-f65966c6-9286-4ee6-b198-4b71f6a98d57 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e6809a212fcc4730a3a30c81e8485ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d727625d6eb47febd54a3f4071bb7c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:08:44.293391 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f65966c6-9286-4ee6-b198-4b71f6a98d57 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '8d727625d6eb47febd54a3f4071bb7c3'} {{(pid=129366) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 15 21:08:44.298967 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f65966c6-9286-4ee6-b198-4b71f6a98d57 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:44.299855 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f65966c6-9286-4ee6-b198-4b71f6a98d57 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:44.300233 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f65966c6-9286-4ee6-b198-4b71f6a98d57 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:44.300668 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f65966c6-9286-4ee6-b198-4b71f6a98d57 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:44.448887 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.multi_cell_list [None req-f65966c6-9286-4ee6-b198-4b71f6a98d57 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=129366) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jan 15 21:08:44.544490 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-6a3a8971-1e30-4f1a-a526-a78c497582f9 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822f4a2b1fd6459a8a472bdd066d69fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e03e1de077453588cc783a4e6d690e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:08:44.552479 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-6a3a8971-1e30-4f1a-a526-a78c497582f9 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] 10.222.0.46 "GET /compute/v2.1/servers/2eb104af-fb2d-44d7-9c7a-e5380040ecb3" status: 200 len: 1513 microversion: 2.1 time: 0.338213 Jan 15 21:08:44.564274 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2890/5787] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:08:44 2022] GET /compute/v2.1/servers/2eb104af-fb2d-44d7-9c7a-e5380040ecb3 => generated 1513 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:08:44.589245 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-feedd4ca-ace3-48ed-a614-880406a2daed req-42df0c0f-af8d-4ac0-8208-95108a2afdad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2eb104af-fb2d-44d7-9c7a-e5380040ecb3", "name": "network-vif-deleted", "tag": "f0ae0f22-a1b8-49b7-9461-1ae6917cbdb3"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:08:44.590970 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:08:44.590970 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:08:44.608227 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-feedd4ca-ace3-48ed-a614-880406a2daed req-42df0c0f-af8d-4ac0-8208-95108a2afdad service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:44.616505 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-feedd4ca-ace3-48ed-a614-880406a2daed req-42df0c0f-af8d-4ac0-8208-95108a2afdad service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:44.646985 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-feedd4ca-ace3-48ed-a614-880406a2daed req-42df0c0f-af8d-4ac0-8208-95108a2afdad service nova] Creating event network-vif-deleted:f0ae0f22-a1b8-49b7-9461-1ae6917cbdb3 for instance 2eb104af-fb2d-44d7-9c7a-e5380040ecb3 on nch2-master-1 Jan 15 21:08:44.662031 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-feedd4ca-ace3-48ed-a614-880406a2daed req-42df0c0f-af8d-4ac0-8208-95108a2afdad service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076301 Jan 15 21:08:44.671319 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-f65966c6-9286-4ee6-b198-4b71f6a98d57 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6809a212fcc4730a3a30c81e8485ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d727625d6eb47febd54a3f4071bb7c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:08:44.671955 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2891/5788] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:08:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 21:08:44.690245 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f65966c6-9286-4ee6-b198-4b71f6a98d57 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:44.694348 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f65966c6-9286-4ee6-b198-4b71f6a98d57 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:44.963072 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f65966c6-9286-4ee6-b198-4b71f6a98d57 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] 10.222.0.46 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4514 microversion: 2.1 time: 0.679767 Jan 15 21:08:44.983506 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2898/5789] 10.222.0.46 () {58 vars in 1172 bytes} [Sat Jan 15 21:08:44 2022] GET /compute/v2.1/servers/detail?status=active => generated 4514 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:08:44.992533 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-898fbd84-ba8f-48f4-b3b9-f0eba0bc3a2a tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:08:44.996004 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:08:44.996004 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:08:44.997059 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-898fbd84-ba8f-48f4-b3b9-f0eba0bc3a2a tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e6809a212fcc4730a3a30c81e8485ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d727625d6eb47febd54a3f4071bb7c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:08:44.997522 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.compute.servers [None req-898fbd84-ba8f-48f4-b3b9-f0eba0bc3a2a tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Removing options 'limit' from query {{(pid=129365) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1474}} Jan 15 21:08:44.998422 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-898fbd84-ba8f-48f4-b3b9-f0eba0bc3a2a tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Searching by: {'deleted': False, 'project_id': '8d727625d6eb47febd54a3f4071bb7c3'} {{(pid=129365) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 15 21:08:45.005294 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-898fbd84-ba8f-48f4-b3b9-f0eba0bc3a2a tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:45.005744 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-898fbd84-ba8f-48f4-b3b9-f0eba0bc3a2a tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:45.006568 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-898fbd84-ba8f-48f4-b3b9-f0eba0bc3a2a tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:45.007174 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-898fbd84-ba8f-48f4-b3b9-f0eba0bc3a2a tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:45.044795 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-898fbd84-ba8f-48f4-b3b9-f0eba0bc3a2a tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6809a212fcc4730a3a30c81e8485ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d727625d6eb47febd54a3f4071bb7c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:08:45.051136 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-898fbd84-ba8f-48f4-b3b9-f0eba0bc3a2a tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:45.051531 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-898fbd84-ba8f-48f4-b3b9-f0eba0bc3a2a tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:45.204920 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-898fbd84-ba8f-48f4-b3b9-f0eba0bc3a2a tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] 10.222.0.46 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1660 microversion: 2.1 time: 0.216038 Jan 15 21:08:45.205958 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2892/5790] 10.222.0.46 () {58 vars in 1160 bytes} [Sat Jan 15 21:08:44 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1660 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:08:45.226928 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-fb31028c-5c4a-4be9-b70d-5cf404beb38f tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:08:45.230432 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:08:45.230432 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:08:45.231694 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-fb31028c-5c4a-4be9-b70d-5cf404beb38f tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e6809a212fcc4730a3a30c81e8485ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d727625d6eb47febd54a3f4071bb7c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:08:45.232181 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-fb31028c-5c4a-4be9-b70d-5cf404beb38f tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '8d727625d6eb47febd54a3f4071bb7c3'} {{(pid=129366) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 15 21:08:45.241189 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fb31028c-5c4a-4be9-b70d-5cf404beb38f tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:45.241639 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fb31028c-5c4a-4be9-b70d-5cf404beb38f tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:45.242646 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fb31028c-5c4a-4be9-b70d-5cf404beb38f tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:45.243370 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fb31028c-5c4a-4be9-b70d-5cf404beb38f tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:45.272079 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.multi_cell_list [None req-fb31028c-5c4a-4be9-b70d-5cf404beb38f tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=129366) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jan 15 21:08:45.305405 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-fb31028c-5c4a-4be9-b70d-5cf404beb38f tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] 10.222.0.46 "GET /compute/v2.1/servers?status=active" status: 200 len: 1010 microversion: 2.1 time: 0.082967 Jan 15 21:08:45.306102 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2899/5791] 10.222.0.46 () {58 vars in 1151 bytes} [Sat Jan 15 21:08:45 2022] GET /compute/v2.1/servers?status=active => generated 1010 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:08:45.323708 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5157433e-fa70-4046-a4e0-9e8405c71e83 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:08:45.333140 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:08:45.333140 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:08:45.335199 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-5157433e-fa70-4046-a4e0-9e8405c71e83 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e6809a212fcc4730a3a30c81e8485ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d727625d6eb47febd54a3f4071bb7c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:08:45.336230 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.compute.servers [None req-5157433e-fa70-4046-a4e0-9e8405c71e83 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Removing options 'limit' from query {{(pid=129365) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1474}} Jan 15 21:08:45.337119 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-5157433e-fa70-4046-a4e0-9e8405c71e83 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Searching by: {'deleted': False, 'project_id': '8d727625d6eb47febd54a3f4071bb7c3'} {{(pid=129365) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 15 21:08:45.344707 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5157433e-fa70-4046-a4e0-9e8405c71e83 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:45.345410 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5157433e-fa70-4046-a4e0-9e8405c71e83 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:45.346697 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5157433e-fa70-4046-a4e0-9e8405c71e83 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:45.347946 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5157433e-fa70-4046-a4e0-9e8405c71e83 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:45.383011 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.multi_cell_list [None req-5157433e-fa70-4046-a4e0-9e8405c71e83 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=129365) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jan 15 21:08:45.433307 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5157433e-fa70-4046-a4e0-9e8405c71e83 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] 10.222.0.46 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1010 microversion: 2.1 time: 0.113616 Jan 15 21:08:45.438722 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2893/5792] 10.222.0.46 () {58 vars in 1149 bytes} [Sat Jan 15 21:08:45 2022] GET /compute/v2.1/servers?limit=100000 => generated 1010 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:08:45.456084 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-fdb3557b-425d-435b-9dc5-e4be84852e96 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:08:45.461957 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:08:45.461957 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:08:45.461957 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-fdb3557b-425d-435b-9dc5-e4be84852e96 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e6809a212fcc4730a3a30c81e8485ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d727625d6eb47febd54a3f4071bb7c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:08:45.461957 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-fdb3557b-425d-435b-9dc5-e4be84852e96 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Searching by: {'deleted': False, 'project_id': '8d727625d6eb47febd54a3f4071bb7c3'} {{(pid=129366) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 15 21:08:45.467630 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fdb3557b-425d-435b-9dc5-e4be84852e96 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:45.468129 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fdb3557b-425d-435b-9dc5-e4be84852e96 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:45.469138 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fdb3557b-425d-435b-9dc5-e4be84852e96 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:45.469729 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fdb3557b-425d-435b-9dc5-e4be84852e96 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:45.529688 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.multi_cell_list [None req-fdb3557b-425d-435b-9dc5-e4be84852e96 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=129366) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jan 15 21:08:45.566850 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-fdb3557b-425d-435b-9dc5-e4be84852e96 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] 10.222.0.46 "GET /compute/v2.1/servers" status: 200 len: 1010 microversion: 2.1 time: 0.117260 Jan 15 21:08:45.567733 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2900/5793] 10.222.0.46 () {58 vars in 1124 bytes} [Sat Jan 15 21:08:45 2022] GET /compute/v2.1/servers => generated 1010 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:08:45.573360 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c7461dc2-23a7-4e5d-a58f-975bf1d52fde tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:08:45.574520 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c7461dc2-23a7-4e5d-a58f-975bf1d52fde tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] [instance: 2eb104af-fb2d-44d7-9c7a-e5380040ecb3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:08:45.578508 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1be67140-edfc-4f92-a67b-bfca774dc853 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:08:45.582459 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:08:45.582459 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:08:45.582697 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c7461dc2-23a7-4e5d-a58f-975bf1d52fde tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:45.583418 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c7461dc2-23a7-4e5d-a58f-975bf1d52fde tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:45.583787 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-1be67140-edfc-4f92-a67b-bfca774dc853 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e6809a212fcc4730a3a30c81e8485ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d727625d6eb47febd54a3f4071bb7c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:08:45.584681 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-1be67140-edfc-4f92-a67b-bfca774dc853 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '8d727625d6eb47febd54a3f4071bb7c3'} {{(pid=129366) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 15 21:08:45.585808 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c7461dc2-23a7-4e5d-a58f-975bf1d52fde tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:45.587205 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c7461dc2-23a7-4e5d-a58f-975bf1d52fde tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:45.599624 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1be67140-edfc-4f92-a67b-bfca774dc853 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:45.600564 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1be67140-edfc-4f92-a67b-bfca774dc853 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:45.601623 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1be67140-edfc-4f92-a67b-bfca774dc853 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:45.602246 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1be67140-edfc-4f92-a67b-bfca774dc853 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:45.618649 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-c7461dc2-23a7-4e5d-a58f-975bf1d52fde tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] HTTP exception thrown: Instance 2eb104af-fb2d-44d7-9c7a-e5380040ecb3 could not be found. Jan 15 21:08:45.619788 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c7461dc2-23a7-4e5d-a58f-975bf1d52fde tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Returning 404 to user: Instance 2eb104af-fb2d-44d7-9c7a-e5380040ecb3 could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:08:45.622390 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c7461dc2-23a7-4e5d-a58f-975bf1d52fde tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] 10.222.0.46 "GET /compute/v2.1/servers/2eb104af-fb2d-44d7-9c7a-e5380040ecb3" status: 404 len: 111 microversion: 2.1 time: 0.054677 Jan 15 21:08:45.623066 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2894/5794] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:08:45 2022] GET /compute/v2.1/servers/2eb104af-fb2d-44d7-9c7a-e5380040ecb3 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 15 21:08:45.633404 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-74b18752-2e78-4d38-b7ef-8f217f3621eb tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:08:45.634161 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-74b18752-2e78-4d38-b7ef-8f217f3621eb tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] [instance: 4295ba6e-d84c-41a2-be24-e03c022fe9b6] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:08:45.646844 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-74b18752-2e78-4d38-b7ef-8f217f3621eb tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:45.647979 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-74b18752-2e78-4d38-b7ef-8f217f3621eb tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:45.649017 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-74b18752-2e78-4d38-b7ef-8f217f3621eb tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:45.649648 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-74b18752-2e78-4d38-b7ef-8f217f3621eb tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:45.681006 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-74b18752-2e78-4d38-b7ef-8f217f3621eb tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] [instance: 4295ba6e-d84c-41a2-be24-e03c022fe9b6] Going to try to terminate instance {{(pid=129365) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 21:08:45.707413 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.multi_cell_list [None req-1be67140-edfc-4f92-a67b-bfca774dc853 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=129366) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jan 15 21:08:45.778127 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-1be67140-edfc-4f92-a67b-bfca774dc853 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] 10.222.0.46 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 346 microversion: 2.1 time: 0.202443 Jan 15 21:08:45.779028 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2901/5795] 10.222.0.46 () {58 vars in 1145 bytes} [Sat Jan 15 21:08:45 2022] GET /compute/v2.1/servers?flavor=451 => generated 346 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:08:45.791851 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f004ab6c-457a-4f23-b016-a3326ff8fef4 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:08:45.796765 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:08:45.796765 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:08:45.797831 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-f004ab6c-457a-4f23-b016-a3326ff8fef4 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e6809a212fcc4730a3a30c81e8485ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d727625d6eb47febd54a3f4071bb7c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:08:45.800123 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.compute.servers [None req-f004ab6c-457a-4f23-b016-a3326ff8fef4 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Removing options 'limit' from query {{(pid=129366) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1474}} Jan 15 21:08:45.802080 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f004ab6c-457a-4f23-b016-a3326ff8fef4 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Searching by: {'deleted': False, 'project_id': '8d727625d6eb47febd54a3f4071bb7c3'} {{(pid=129366) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 15 21:08:45.816028 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f004ab6c-457a-4f23-b016-a3326ff8fef4 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:45.820423 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f004ab6c-457a-4f23-b016-a3326ff8fef4 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:45.820654 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-74b18752-2e78-4d38-b7ef-8f217f3621eb tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] 10.222.0.46 "DELETE /compute/v2.1/servers/4295ba6e-d84c-41a2-be24-e03c022fe9b6" status: 204 len: 0 microversion: 2.1 time: 0.190589 Jan 15 21:08:45.821333 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f004ab6c-457a-4f23-b016-a3326ff8fef4 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:45.821623 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2895/5796] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 21:08:45 2022] DELETE /compute/v2.1/servers/4295ba6e-d84c-41a2-be24-e03c022fe9b6 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 21:08:45.821773 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f004ab6c-457a-4f23-b016-a3326ff8fef4 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:45.829785 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5fa9448a-d65d-4883-9435-6a73a62e73e2 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:08:45.830616 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-5fa9448a-d65d-4883-9435-6a73a62e73e2 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] [instance: 4295ba6e-d84c-41a2-be24-e03c022fe9b6] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:08:45.836714 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5fa9448a-d65d-4883-9435-6a73a62e73e2 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:45.837865 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5fa9448a-d65d-4883-9435-6a73a62e73e2 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:45.839101 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5fa9448a-d65d-4883-9435-6a73a62e73e2 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:45.840001 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5fa9448a-d65d-4883-9435-6a73a62e73e2 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:45.862385 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f004ab6c-457a-4f23-b016-a3326ff8fef4 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] 10.222.0.46 "GET /compute/v2.1/servers?limit=1" status: 200 len: 485 microversion: 2.1 time: 0.074131 Jan 15 21:08:45.862982 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2902/5797] 10.222.0.46 () {58 vars in 1139 bytes} [Sat Jan 15 21:08:45 2022] GET /compute/v2.1/servers?limit=1 => generated 485 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 21:08:45.881966 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-027881b7-d447-4329-a24b-21f8be9b9d23 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:08:45.895955 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:08:45.895955 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:08:45.897866 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-027881b7-d447-4329-a24b-21f8be9b9d23 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e6809a212fcc4730a3a30c81e8485ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d727625d6eb47febd54a3f4071bb7c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:08:45.901761 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-027881b7-d447-4329-a24b-21f8be9b9d23 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-216154498', 'deleted': False, 'project_id': '8d727625d6eb47febd54a3f4071bb7c3'} {{(pid=129366) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 15 21:08:45.911925 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-027881b7-d447-4329-a24b-21f8be9b9d23 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:45.912764 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-027881b7-d447-4329-a24b-21f8be9b9d23 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:45.914995 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-027881b7-d447-4329-a24b-21f8be9b9d23 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:45.916230 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-027881b7-d447-4329-a24b-21f8be9b9d23 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:46.001585 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-5fa9448a-d65d-4883-9435-6a73a62e73e2 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822f4a2b1fd6459a8a472bdd066d69fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e03e1de077453588cc783a4e6d690e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:08:46.009815 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5fa9448a-d65d-4883-9435-6a73a62e73e2 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] 10.222.0.46 "GET /compute/v2.1/servers/4295ba6e-d84c-41a2-be24-e03c022fe9b6" status: 200 len: 1515 microversion: 2.1 time: 0.183895 Jan 15 21:08:46.012819 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2896/5798] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:08:45 2022] GET /compute/v2.1/servers/4295ba6e-d84c-41a2-be24-e03c022fe9b6 => generated 1515 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:08:46.026434 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.multi_cell_list [None req-027881b7-d447-4329-a24b-21f8be9b9d23 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=129366) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jan 15 21:08:46.090474 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-027881b7-d447-4329-a24b-21f8be9b9d23 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] 10.222.0.46 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-216154498" status: 200 len: 345 microversion: 2.1 time: 0.219075 Jan 15 21:08:46.091423 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2903/5799] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Jan 15 21:08:45 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-216154498 => generated 345 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:08:46.102489 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c722a1f8-c2ac-4faa-baa8-5a1f0fef09fc tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:08:46.108997 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c722a1f8-c2ac-4faa-baa8-5a1f0fef09fc tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:46.109650 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c722a1f8-c2ac-4faa-baa8-5a1f0fef09fc tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:46.143666 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c722a1f8-c2ac-4faa-baa8-5a1f0fef09fc tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] [instance: 827235d8-4a51-49b0-af9e-f45e37bcf762] Going to try to stop instance {{(pid=129365) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Jan 15 21:08:46.197927 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c722a1f8-c2ac-4faa-baa8-5a1f0fef09fc tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] 10.222.0.46 "POST /compute/v2.1/servers/827235d8-4a51-49b0-af9e-f45e37bcf762/action" status: 202 len: 0 microversion: 2.1 time: 0.098923 Jan 15 21:08:46.198908 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2897/5800] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:08:46 2022] POST /compute/v2.1/servers/827235d8-4a51-49b0-af9e-f45e37bcf762/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:08:46.207582 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-118fbf32-252f-4614-81c7-d15a19a5a25e tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:08:46.209175 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-118fbf32-252f-4614-81c7-d15a19a5a25e tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] [instance: 827235d8-4a51-49b0-af9e-f45e37bcf762] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:08:46.217620 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-118fbf32-252f-4614-81c7-d15a19a5a25e tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:46.218411 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-118fbf32-252f-4614-81c7-d15a19a5a25e tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:46.219425 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-118fbf32-252f-4614-81c7-d15a19a5a25e tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:46.220245 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-118fbf32-252f-4614-81c7-d15a19a5a25e tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:46.373198 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-118fbf32-252f-4614-81c7-d15a19a5a25e tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6809a212fcc4730a3a30c81e8485ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d727625d6eb47febd54a3f4071bb7c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:08:46.381080 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-118fbf32-252f-4614-81c7-d15a19a5a25e tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] 10.222.0.46 "GET /compute/v2.1/servers/827235d8-4a51-49b0-af9e-f45e37bcf762" status: 200 len: 1520 microversion: 2.1 time: 0.177652 Jan 15 21:08:46.382024 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2904/5801] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:08:46 2022] GET /compute/v2.1/servers/827235d8-4a51-49b0-af9e-f45e37bcf762 => generated 1520 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:08:47.031032 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2ede788a-c3b5-46af-93f9-f7b691a8cc21 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:08:47.032496 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-2ede788a-c3b5-46af-93f9-f7b691a8cc21 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] [instance: 4295ba6e-d84c-41a2-be24-e03c022fe9b6] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:08:47.039639 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2ede788a-c3b5-46af-93f9-f7b691a8cc21 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:47.040459 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2ede788a-c3b5-46af-93f9-f7b691a8cc21 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:47.041480 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2ede788a-c3b5-46af-93f9-f7b691a8cc21 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:47.042356 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2ede788a-c3b5-46af-93f9-f7b691a8cc21 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:47.245126 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-2ede788a-c3b5-46af-93f9-f7b691a8cc21 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822f4a2b1fd6459a8a472bdd066d69fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e03e1de077453588cc783a4e6d690e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:08:47.258026 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2ede788a-c3b5-46af-93f9-f7b691a8cc21 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] 10.222.0.46 "GET /compute/v2.1/servers/4295ba6e-d84c-41a2-be24-e03c022fe9b6" status: 200 len: 1515 microversion: 2.1 time: 0.231972 Jan 15 21:08:47.258894 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2898/5802] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:08:47 2022] GET /compute/v2.1/servers/4295ba6e-d84c-41a2-be24-e03c022fe9b6 => generated 1515 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:08:47.402190 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-6ca0d8fc-b7c7-4225-a84e-a938ec02b040 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:08:47.402934 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-6ca0d8fc-b7c7-4225-a84e-a938ec02b040 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] [instance: 827235d8-4a51-49b0-af9e-f45e37bcf762] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:08:47.417454 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6ca0d8fc-b7c7-4225-a84e-a938ec02b040 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:47.419578 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6ca0d8fc-b7c7-4225-a84e-a938ec02b040 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:47.421207 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6ca0d8fc-b7c7-4225-a84e-a938ec02b040 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:47.422755 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6ca0d8fc-b7c7-4225-a84e-a938ec02b040 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:48.030762 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-6ca0d8fc-b7c7-4225-a84e-a938ec02b040 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6809a212fcc4730a3a30c81e8485ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d727625d6eb47febd54a3f4071bb7c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:08:48.035743 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-a5ea1725-da94-46d6-8182-140a9278a157 req-630f09bb-b674-4eb2-9012-fbfbc240e6af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4295ba6e-d84c-41a2-be24-e03c022fe9b6", "name": "network-vif-deleted", "tag": "2c1c0dd2-1098-46ae-9791-f62469b9f7da"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:08:48.044512 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:08:48.044512 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:08:48.055845 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-6ca0d8fc-b7c7-4225-a84e-a938ec02b040 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] 10.222.0.46 "GET /compute/v2.1/servers/827235d8-4a51-49b0-af9e-f45e37bcf762" status: 200 len: 1520 microversion: 2.1 time: 0.659650 Jan 15 21:08:48.057917 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2905/5803] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:08:47 2022] GET /compute/v2.1/servers/827235d8-4a51-49b0-af9e-f45e37bcf762 => generated 1520 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:08:48.061408 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-a5ea1725-da94-46d6-8182-140a9278a157 req-630f09bb-b674-4eb2-9012-fbfbc240e6af service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:48.061865 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-a5ea1725-da94-46d6-8182-140a9278a157 req-630f09bb-b674-4eb2-9012-fbfbc240e6af service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:48.075657 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-a5ea1725-da94-46d6-8182-140a9278a157 req-630f09bb-b674-4eb2-9012-fbfbc240e6af service nova] Creating event network-vif-deleted:2c1c0dd2-1098-46ae-9791-f62469b9f7da for instance 4295ba6e-d84c-41a2-be24-e03c022fe9b6 on nch2-master-1 Jan 15 21:08:48.115951 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-a5ea1725-da94-46d6-8182-140a9278a157 req-630f09bb-b674-4eb2-9012-fbfbc240e6af service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077827 Jan 15 21:08:48.119217 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2899/5804] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:08:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:08:48.274545 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7114d3ad-aab0-4cd2-a66b-a1165de5434e tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:08:48.275634 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-7114d3ad-aab0-4cd2-a66b-a1165de5434e tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] [instance: 4295ba6e-d84c-41a2-be24-e03c022fe9b6] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:08:48.281702 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7114d3ad-aab0-4cd2-a66b-a1165de5434e tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:48.282461 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7114d3ad-aab0-4cd2-a66b-a1165de5434e tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:48.284240 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7114d3ad-aab0-4cd2-a66b-a1165de5434e tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:48.284903 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7114d3ad-aab0-4cd2-a66b-a1165de5434e tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:48.322181 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7114d3ad-aab0-4cd2-a66b-a1165de5434e tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:48.322805 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7114d3ad-aab0-4cd2-a66b-a1165de5434e tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:48.323401 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.objects.instance [None req-7114d3ad-aab0-4cd2-a66b-a1165de5434e tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lazy-loading 'fault' on Instance uuid 4295ba6e-d84c-41a2-be24-e03c022fe9b6 {{(pid=129366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 21:08:48.383009 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-7114d3ad-aab0-4cd2-a66b-a1165de5434e tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822f4a2b1fd6459a8a472bdd066d69fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e03e1de077453588cc783a4e6d690e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:08:48.402174 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7114d3ad-aab0-4cd2-a66b-a1165de5434e tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] 10.222.0.46 "GET /compute/v2.1/servers/4295ba6e-d84c-41a2-be24-e03c022fe9b6" status: 200 len: 1308 microversion: 2.1 time: 0.131173 Jan 15 21:08:48.402785 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2906/5805] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:08:48 2022] GET /compute/v2.1/servers/4295ba6e-d84c-41a2-be24-e03c022fe9b6 => generated 1308 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:08:49.074501 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5f0d6ee6-2d15-4545-97fa-6cb9d71bb135 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:08:49.075374 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-5f0d6ee6-2d15-4545-97fa-6cb9d71bb135 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] [instance: 827235d8-4a51-49b0-af9e-f45e37bcf762] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:08:49.083853 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5f0d6ee6-2d15-4545-97fa-6cb9d71bb135 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:49.084600 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5f0d6ee6-2d15-4545-97fa-6cb9d71bb135 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:49.085697 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5f0d6ee6-2d15-4545-97fa-6cb9d71bb135 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:49.086231 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5f0d6ee6-2d15-4545-97fa-6cb9d71bb135 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:49.340166 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-5f0d6ee6-2d15-4545-97fa-6cb9d71bb135 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6809a212fcc4730a3a30c81e8485ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d727625d6eb47febd54a3f4071bb7c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:08:49.348033 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5f0d6ee6-2d15-4545-97fa-6cb9d71bb135 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] 10.222.0.46 "GET /compute/v2.1/servers/827235d8-4a51-49b0-af9e-f45e37bcf762" status: 200 len: 1520 microversion: 2.1 time: 0.277810 Jan 15 21:08:49.358769 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2900/5806] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:08:49 2022] GET /compute/v2.1/servers/827235d8-4a51-49b0-af9e-f45e37bcf762 => generated 1520 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:08:49.419997 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-edd0470a-14b5-4397-ae5e-02bfcf75241c tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:08:49.421157 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-edd0470a-14b5-4397-ae5e-02bfcf75241c tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] [instance: 4295ba6e-d84c-41a2-be24-e03c022fe9b6] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:08:49.433325 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-edd0470a-14b5-4397-ae5e-02bfcf75241c tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:49.433778 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-edd0470a-14b5-4397-ae5e-02bfcf75241c tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:49.434573 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-edd0470a-14b5-4397-ae5e-02bfcf75241c tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:49.435047 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-edd0470a-14b5-4397-ae5e-02bfcf75241c tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:49.458192 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-edd0470a-14b5-4397-ae5e-02bfcf75241c tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] HTTP exception thrown: Instance 4295ba6e-d84c-41a2-be24-e03c022fe9b6 could not be found. Jan 15 21:08:49.459059 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-edd0470a-14b5-4397-ae5e-02bfcf75241c tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Returning 404 to user: Instance 4295ba6e-d84c-41a2-be24-e03c022fe9b6 could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:08:49.460051 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-edd0470a-14b5-4397-ae5e-02bfcf75241c tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] 10.222.0.46 "GET /compute/v2.1/servers/4295ba6e-d84c-41a2-be24-e03c022fe9b6" status: 404 len: 111 microversion: 2.1 time: 0.044480 Jan 15 21:08:49.460769 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2907/5807] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:08:49 2022] GET /compute/v2.1/servers/4295ba6e-d84c-41a2-be24-e03c022fe9b6 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:08:50.364430 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b34f5530-1869-4b44-8768-f9ca7033c7a1 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:08:50.365087 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b34f5530-1869-4b44-8768-f9ca7033c7a1 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] [instance: 827235d8-4a51-49b0-af9e-f45e37bcf762] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:08:50.371952 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b34f5530-1869-4b44-8768-f9ca7033c7a1 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:50.372442 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b34f5530-1869-4b44-8768-f9ca7033c7a1 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:50.373271 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b34f5530-1869-4b44-8768-f9ca7033c7a1 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:50.373917 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b34f5530-1869-4b44-8768-f9ca7033c7a1 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:50.618481 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-b34f5530-1869-4b44-8768-f9ca7033c7a1 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6809a212fcc4730a3a30c81e8485ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d727625d6eb47febd54a3f4071bb7c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:08:50.634411 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b34f5530-1869-4b44-8768-f9ca7033c7a1 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] 10.222.0.46 "GET /compute/v2.1/servers/827235d8-4a51-49b0-af9e-f45e37bcf762" status: 200 len: 1520 microversion: 2.1 time: 0.273568 Jan 15 21:08:50.635541 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2901/5808] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:08:50 2022] GET /compute/v2.1/servers/827235d8-4a51-49b0-af9e-f45e37bcf762 => generated 1520 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:08:50.677228 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-3bd599ca-2c10-4582-bd7e-80efc6d8aa62 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:08:50.677790 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-3bd599ca-2c10-4582-bd7e-80efc6d8aa62 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] [instance: 552b7547-f4b2-4af0-be24-a4c628408c16] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:08:50.694665 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3bd599ca-2c10-4582-bd7e-80efc6d8aa62 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:50.695935 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3bd599ca-2c10-4582-bd7e-80efc6d8aa62 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:50.698326 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3bd599ca-2c10-4582-bd7e-80efc6d8aa62 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:50.699059 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3bd599ca-2c10-4582-bd7e-80efc6d8aa62 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:50.735246 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-3bd599ca-2c10-4582-bd7e-80efc6d8aa62 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] [instance: 552b7547-f4b2-4af0-be24-a4c628408c16] Going to try to terminate instance {{(pid=129366) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 21:08:50.859891 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-3bd599ca-2c10-4582-bd7e-80efc6d8aa62 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] 10.222.0.46 "DELETE /compute/v2.1/servers/552b7547-f4b2-4af0-be24-a4c628408c16" status: 204 len: 0 microversion: 2.1 time: 0.187494 Jan 15 21:08:50.860680 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2908/5809] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 21:08:50 2022] DELETE /compute/v2.1/servers/552b7547-f4b2-4af0-be24-a4c628408c16 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 21:08:50.870444 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-7298a512-b0ad-44ec-b839-69db73e0ddf5 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:08:50.871068 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-7298a512-b0ad-44ec-b839-69db73e0ddf5 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] [instance: 552b7547-f4b2-4af0-be24-a4c628408c16] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:08:50.879640 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7298a512-b0ad-44ec-b839-69db73e0ddf5 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:50.880099 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7298a512-b0ad-44ec-b839-69db73e0ddf5 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:50.881268 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7298a512-b0ad-44ec-b839-69db73e0ddf5 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:50.882002 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7298a512-b0ad-44ec-b839-69db73e0ddf5 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:51.077476 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-7298a512-b0ad-44ec-b839-69db73e0ddf5 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822f4a2b1fd6459a8a472bdd066d69fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e03e1de077453588cc783a4e6d690e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:08:51.085150 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-7298a512-b0ad-44ec-b839-69db73e0ddf5 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] 10.222.0.46 "GET /compute/v2.1/servers/552b7547-f4b2-4af0-be24-a4c628408c16" status: 200 len: 1514 microversion: 2.1 time: 0.218977 Jan 15 21:08:51.096668 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2902/5810] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:08:50 2022] GET /compute/v2.1/servers/552b7547-f4b2-4af0-be24-a4c628408c16 => generated 1514 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:08:51.660995 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d9805618-2c15-4a13-8bfd-60e492bc482f tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:08:51.662987 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-d9805618-2c15-4a13-8bfd-60e492bc482f tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] [instance: 827235d8-4a51-49b0-af9e-f45e37bcf762] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:08:51.670034 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d9805618-2c15-4a13-8bfd-60e492bc482f tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:51.670875 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d9805618-2c15-4a13-8bfd-60e492bc482f tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:51.672705 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d9805618-2c15-4a13-8bfd-60e492bc482f tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:51.673653 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d9805618-2c15-4a13-8bfd-60e492bc482f tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:51.912369 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-d9805618-2c15-4a13-8bfd-60e492bc482f tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6809a212fcc4730a3a30c81e8485ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d727625d6eb47febd54a3f4071bb7c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:08:51.922610 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d9805618-2c15-4a13-8bfd-60e492bc482f tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] 10.222.0.46 "GET /compute/v2.1/servers/827235d8-4a51-49b0-af9e-f45e37bcf762" status: 200 len: 1520 microversion: 2.1 time: 0.268797 Jan 15 21:08:51.923399 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2909/5811] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:08:51 2022] GET /compute/v2.1/servers/827235d8-4a51-49b0-af9e-f45e37bcf762 => generated 1520 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:08:52.103641 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-683a4d50-4618-4883-a8ef-0786fad204b1 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:08:52.105496 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-683a4d50-4618-4883-a8ef-0786fad204b1 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] [instance: 552b7547-f4b2-4af0-be24-a4c628408c16] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:08:52.118838 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-683a4d50-4618-4883-a8ef-0786fad204b1 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:52.119606 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-683a4d50-4618-4883-a8ef-0786fad204b1 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:52.120592 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-683a4d50-4618-4883-a8ef-0786fad204b1 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:52.121252 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-683a4d50-4618-4883-a8ef-0786fad204b1 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:52.334457 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-683a4d50-4618-4883-a8ef-0786fad204b1 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822f4a2b1fd6459a8a472bdd066d69fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e03e1de077453588cc783a4e6d690e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:08:52.347661 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-683a4d50-4618-4883-a8ef-0786fad204b1 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] 10.222.0.46 "GET /compute/v2.1/servers/552b7547-f4b2-4af0-be24-a4c628408c16" status: 200 len: 1514 microversion: 2.1 time: 0.249367 Jan 15 21:08:52.348271 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2903/5812] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:08:52 2022] GET /compute/v2.1/servers/552b7547-f4b2-4af0-be24-a4c628408c16 => generated 1514 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:08:52.941106 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-908599fb-c77b-48fc-8411-a60f00e0f24e tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:08:52.942431 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-908599fb-c77b-48fc-8411-a60f00e0f24e tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] [instance: 827235d8-4a51-49b0-af9e-f45e37bcf762] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:08:52.948566 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-908599fb-c77b-48fc-8411-a60f00e0f24e tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:52.949050 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-908599fb-c77b-48fc-8411-a60f00e0f24e tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:52.949838 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-908599fb-c77b-48fc-8411-a60f00e0f24e tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:52.951415 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-908599fb-c77b-48fc-8411-a60f00e0f24e tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:53.115968 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-908599fb-c77b-48fc-8411-a60f00e0f24e tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6809a212fcc4730a3a30c81e8485ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d727625d6eb47febd54a3f4071bb7c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:08:53.123404 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-908599fb-c77b-48fc-8411-a60f00e0f24e tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] 10.222.0.46 "GET /compute/v2.1/servers/827235d8-4a51-49b0-af9e-f45e37bcf762" status: 200 len: 1520 microversion: 2.1 time: 0.186562 Jan 15 21:08:53.124172 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2910/5813] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:08:52 2022] GET /compute/v2.1/servers/827235d8-4a51-49b0-af9e-f45e37bcf762 => generated 1520 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:08:53.364486 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-49a3fbe1-3d8a-4ad0-927f-368cb8b96a2f tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:08:53.365124 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-49a3fbe1-3d8a-4ad0-927f-368cb8b96a2f tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] [instance: 552b7547-f4b2-4af0-be24-a4c628408c16] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:08:53.374416 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-49a3fbe1-3d8a-4ad0-927f-368cb8b96a2f tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:53.374882 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-49a3fbe1-3d8a-4ad0-927f-368cb8b96a2f tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:53.375695 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-49a3fbe1-3d8a-4ad0-927f-368cb8b96a2f tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:53.376156 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-49a3fbe1-3d8a-4ad0-927f-368cb8b96a2f tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:53.412469 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-a6b140ab-500d-4628-8de0-68eee15397f9 req-8c38d759-27fc-488e-8207-9170253e126f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "552b7547-f4b2-4af0-be24-a4c628408c16", "name": "network-vif-deleted", "tag": "490d413f-9553-4a39-a6eb-6d61aef04f25"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:08:53.423538 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:08:53.423538 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:08:53.448229 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-a6b140ab-500d-4628-8de0-68eee15397f9 req-8c38d759-27fc-488e-8207-9170253e126f service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:53.448767 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-a6b140ab-500d-4628-8de0-68eee15397f9 req-8c38d759-27fc-488e-8207-9170253e126f service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:53.475474 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-a6b140ab-500d-4628-8de0-68eee15397f9 req-8c38d759-27fc-488e-8207-9170253e126f service nova] Creating event network-vif-deleted:490d413f-9553-4a39-a6eb-6d61aef04f25 for instance 552b7547-f4b2-4af0-be24-a4c628408c16 on nch1-master-1 Jan 15 21:08:53.480193 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-49a3fbe1-3d8a-4ad0-927f-368cb8b96a2f tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822f4a2b1fd6459a8a472bdd066d69fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e03e1de077453588cc783a4e6d690e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:08:53.481110 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-a6b140ab-500d-4628-8de0-68eee15397f9 req-8c38d759-27fc-488e-8207-9170253e126f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074598 Jan 15 21:08:53.481891 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2911/5814] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:08:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 21:08:53.493017 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-49a3fbe1-3d8a-4ad0-927f-368cb8b96a2f tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] 10.222.0.46 "GET /compute/v2.1/servers/552b7547-f4b2-4af0-be24-a4c628408c16" status: 200 len: 1472 microversion: 2.1 time: 0.132689 Jan 15 21:08:53.494274 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2904/5815] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:08:53 2022] GET /compute/v2.1/servers/552b7547-f4b2-4af0-be24-a4c628408c16 => generated 1472 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:08:54.143617 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-520dd03a-25dc-436a-9ae6-48108fcb61df tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:08:54.144311 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-520dd03a-25dc-436a-9ae6-48108fcb61df tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] [instance: 827235d8-4a51-49b0-af9e-f45e37bcf762] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:08:54.154824 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-520dd03a-25dc-436a-9ae6-48108fcb61df tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:54.155290 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-520dd03a-25dc-436a-9ae6-48108fcb61df tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:54.156079 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-520dd03a-25dc-436a-9ae6-48108fcb61df tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:54.156509 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-520dd03a-25dc-436a-9ae6-48108fcb61df tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:54.500539 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-520dd03a-25dc-436a-9ae6-48108fcb61df tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6809a212fcc4730a3a30c81e8485ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d727625d6eb47febd54a3f4071bb7c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:08:54.510939 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-cc246181-df31-460a-a84f-64cf0c269293 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:08:54.511545 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-cc246181-df31-460a-a84f-64cf0c269293 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] [instance: 552b7547-f4b2-4af0-be24-a4c628408c16] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:08:54.518492 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-520dd03a-25dc-436a-9ae6-48108fcb61df tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] 10.222.0.46 "GET /compute/v2.1/servers/827235d8-4a51-49b0-af9e-f45e37bcf762" status: 200 len: 1520 microversion: 2.1 time: 0.380349 Jan 15 21:08:54.519098 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2912/5816] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:08:54 2022] GET /compute/v2.1/servers/827235d8-4a51-49b0-af9e-f45e37bcf762 => generated 1520 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:08:54.526525 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cc246181-df31-460a-a84f-64cf0c269293 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:54.526986 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cc246181-df31-460a-a84f-64cf0c269293 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:54.527787 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cc246181-df31-460a-a84f-64cf0c269293 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:54.533125 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cc246181-df31-460a-a84f-64cf0c269293 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:54.560242 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-cc246181-df31-460a-a84f-64cf0c269293 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] HTTP exception thrown: Instance 552b7547-f4b2-4af0-be24-a4c628408c16 could not be found. Jan 15 21:08:54.569902 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-cc246181-df31-460a-a84f-64cf0c269293 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] Returning 404 to user: Instance 552b7547-f4b2-4af0-be24-a4c628408c16 could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:08:54.576288 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-cc246181-df31-460a-a84f-64cf0c269293 tempest-AttachVolumeNegativeTest-2126621568 tempest-AttachVolumeNegativeTest-2126621568-project] 10.222.0.46 "GET /compute/v2.1/servers/552b7547-f4b2-4af0-be24-a4c628408c16" status: 404 len: 111 microversion: 2.1 time: 0.066087 Jan 15 21:08:54.577426 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2905/5817] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:08:54 2022] GET /compute/v2.1/servers/552b7547-f4b2-4af0-be24-a4c628408c16 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:08:55.540416 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a8ba53fc-95a2-4715-b627-7e89835130f5 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:08:55.542634 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a8ba53fc-95a2-4715-b627-7e89835130f5 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] [instance: 827235d8-4a51-49b0-af9e-f45e37bcf762] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:08:55.558442 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a8ba53fc-95a2-4715-b627-7e89835130f5 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:55.559220 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a8ba53fc-95a2-4715-b627-7e89835130f5 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:55.560439 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a8ba53fc-95a2-4715-b627-7e89835130f5 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:55.560952 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a8ba53fc-95a2-4715-b627-7e89835130f5 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:55.809141 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-a8ba53fc-95a2-4715-b627-7e89835130f5 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6809a212fcc4730a3a30c81e8485ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d727625d6eb47febd54a3f4071bb7c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:08:55.820895 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a8ba53fc-95a2-4715-b627-7e89835130f5 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] 10.222.0.46 "GET /compute/v2.1/servers/827235d8-4a51-49b0-af9e-f45e37bcf762" status: 200 len: 1520 microversion: 2.1 time: 0.288152 Jan 15 21:08:55.832452 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2913/5818] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:08:55 2022] GET /compute/v2.1/servers/827235d8-4a51-49b0-af9e-f45e37bcf762 => generated 1520 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:08:56.840600 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-879b6808-6891-43c0-8099-d41b6ab38725 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:08:56.842693 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-879b6808-6891-43c0-8099-d41b6ab38725 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] [instance: 827235d8-4a51-49b0-af9e-f45e37bcf762] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:08:56.852477 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-879b6808-6891-43c0-8099-d41b6ab38725 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:56.853349 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-879b6808-6891-43c0-8099-d41b6ab38725 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:56.854456 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-879b6808-6891-43c0-8099-d41b6ab38725 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:56.855618 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-879b6808-6891-43c0-8099-d41b6ab38725 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:57.057770 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-879b6808-6891-43c0-8099-d41b6ab38725 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6809a212fcc4730a3a30c81e8485ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d727625d6eb47febd54a3f4071bb7c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:08:57.067758 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-879b6808-6891-43c0-8099-d41b6ab38725 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] 10.222.0.46 "GET /compute/v2.1/servers/827235d8-4a51-49b0-af9e-f45e37bcf762" status: 200 len: 1520 microversion: 2.1 time: 0.231543 Jan 15 21:08:57.068967 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2906/5819] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:08:56 2022] GET /compute/v2.1/servers/827235d8-4a51-49b0-af9e-f45e37bcf762 => generated 1520 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:08:57.296164 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-debcbbd9-dc4b-4133-a547-d41597733bed tempest-VolumesNegativeTest-601338691 tempest-VolumesNegativeTest-601338691-project] Action: 'create', calling method: .version_select at 0x7f30c904d310>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1930767875", "metadata": {"Type": "work"}}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:08:57.297950 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-debcbbd9-dc4b-4133-a547-d41597733bed tempest-VolumesNegativeTest-601338691 tempest-VolumesNegativeTest-601338691-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:08:57.298973 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-debcbbd9-dc4b-4133-a547-d41597733bed tempest-VolumesNegativeTest-601338691 tempest-VolumesNegativeTest-601338691-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.135675 Jan 15 21:08:57.299645 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2914/5820] 10.222.0.46 () {60 vars in 1155 bytes} [Sat Jan 15 21:08:57 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 137 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 15 21:08:57.309151 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-39e074eb-3825-48e9-8f9f-cb97aa6a9e68 tempest-VolumesNegativeTest-601338691 tempest-VolumesNegativeTest-601338691-project] Action: 'create', calling method: .version_select at 0x7f30c8547d30>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1511506982", "metadata": {"Type": "work"}}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:08:57.310613 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-39e074eb-3825-48e9-8f9f-cb97aa6a9e68 tempest-VolumesNegativeTest-601338691 tempest-VolumesNegativeTest-601338691-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:08:57.311412 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-39e074eb-3825-48e9-8f9f-cb97aa6a9e68 tempest-VolumesNegativeTest-601338691 tempest-VolumesNegativeTest-601338691-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.005908 Jan 15 21:08:57.311936 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2907/5821] 10.222.0.46 () {60 vars in 1155 bytes} [Sat Jan 15 21:08:57 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 15 21:08:57.325018 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-140dc27d-4065-454a-81db-13c8415a65b9 tempest-VolumesNegativeTest-601338691 tempest-VolumesNegativeTest-601338691-project] Action: 'create', calling method: .version_select at 0x7f30c8ef5f70>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-513782173", "metadata": {"Type": "work"}}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:08:57.326339 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-140dc27d-4065-454a-81db-13c8415a65b9 tempest-VolumesNegativeTest-601338691 tempest-VolumesNegativeTest-601338691-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:08:57.327126 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-140dc27d-4065-454a-81db-13c8415a65b9 tempest-VolumesNegativeTest-601338691 tempest-VolumesNegativeTest-601338691-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009184 Jan 15 21:08:57.327636 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2915/5822] 10.222.0.46 () {60 vars in 1155 bytes} [Sat Jan 15 21:08:57 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 15 21:08:57.338485 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c465ac8e-0ea5-415c-b7f1-5c6ac2716ac1 tempest-VolumesNegativeTest-601338691 tempest-VolumesNegativeTest-601338691-project] Calling method '.version_select at 0x7f30c952fca0>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:08:57.373540 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-c465ac8e-0ea5-415c-b7f1-5c6ac2716ac1 tempest-VolumesNegativeTest-601338691 tempest-VolumesNegativeTest-601338691-project] HTTP exception thrown: Volume tempest-invalid-253347126 could not be found. Jan 15 21:08:57.374136 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c465ac8e-0ea5-415c-b7f1-5c6ac2716ac1 tempest-VolumesNegativeTest-601338691 tempest-VolumesNegativeTest-601338691-project] Returning 404 to user: Volume tempest-invalid-253347126 could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:08:57.375140 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c465ac8e-0ea5-415c-b7f1-5c6ac2716ac1 tempest-VolumesNegativeTest-601338691 tempest-VolumesNegativeTest-601338691-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/tempest-invalid-253347126" status: 404 len: 98 microversion: 2.1 time: 0.040354 Jan 15 21:08:57.375693 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2908/5823] 10.222.0.46 () {58 vars in 1214 bytes} [Sat Jan 15 21:08:57 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-253347126 => generated 98 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jan 15 21:08:57.387177 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-075258ea-2f2b-494f-8464-5aaf0a8e45f2 tempest-VolumesNegativeTest-601338691 tempest-VolumesNegativeTest-601338691-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004531 Jan 15 21:08:57.388884 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2916/5824] 10.222.0.46 () {58 vars in 1139 bytes} [Sat Jan 15 21:08:57 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jan 15 21:08:57.399219 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-42f5f681-8cab-4824-b3fc-37e461c75cc9 tempest-VolumesNegativeTest-601338691 tempest-VolumesNegativeTest-601338691-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003745 Jan 15 21:08:57.399830 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2909/5825] 10.222.0.46 () {58 vars in 1136 bytes} [Sat Jan 15 21:08:57 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jan 15 21:08:57.409728 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b5aba7a0-48b3-425c-90ac-00e134470068 tempest-VolumesNegativeTest-601338691 tempest-VolumesNegativeTest-601338691-project] Calling method '.version_select at 0x7f30c8ef5310>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:08:57.440753 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-b5aba7a0-48b3-425c-90ac-00e134470068 tempest-VolumesNegativeTest-601338691 tempest-VolumesNegativeTest-601338691-project] HTTP exception thrown: Volume 2313102d-9459-4564-8d03-f7aa4dcfbeb2 could not be found. Jan 15 21:08:57.441378 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b5aba7a0-48b3-425c-90ac-00e134470068 tempest-VolumesNegativeTest-601338691 tempest-VolumesNegativeTest-601338691-project] Returning 404 to user: Volume 2313102d-9459-4564-8d03-f7aa4dcfbeb2 could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:08:57.442204 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b5aba7a0-48b3-425c-90ac-00e134470068 tempest-VolumesNegativeTest-601338691 tempest-VolumesNegativeTest-601338691-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/2313102d-9459-4564-8d03-f7aa4dcfbeb2" status: 404 len: 109 microversion: 2.1 time: 0.037161 Jan 15 21:08:57.442792 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2917/5826] 10.222.0.46 () {58 vars in 1247 bytes} [Sat Jan 15 21:08:57 2022] DELETE /compute/v2.1/os-volumes/2313102d-9459-4564-8d03-f7aa4dcfbeb2 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 15 21:08:57.452339 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5100165f-1d63-4599-80b5-236dc641bdd3 tempest-VolumesNegativeTest-601338691 tempest-VolumesNegativeTest-601338691-project] Calling method '.version_select at 0x7f30c952f160>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:08:57.483502 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-5100165f-1d63-4599-80b5-236dc641bdd3 tempest-VolumesNegativeTest-601338691 tempest-VolumesNegativeTest-601338691-project] HTTP exception thrown: Volume d39c355c-7157-4baf-9995-21ff4a57ecc0 could not be found. Jan 15 21:08:57.484170 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5100165f-1d63-4599-80b5-236dc641bdd3 tempest-VolumesNegativeTest-601338691 tempest-VolumesNegativeTest-601338691-project] Returning 404 to user: Volume d39c355c-7157-4baf-9995-21ff4a57ecc0 could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:08:57.485108 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5100165f-1d63-4599-80b5-236dc641bdd3 tempest-VolumesNegativeTest-601338691 tempest-VolumesNegativeTest-601338691-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/d39c355c-7157-4baf-9995-21ff4a57ecc0" status: 404 len: 109 microversion: 2.1 time: 0.036865 Jan 15 21:08:57.486243 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2910/5827] 10.222.0.46 () {58 vars in 1244 bytes} [Sat Jan 15 21:08:57 2022] GET /compute/v2.1/os-volumes/d39c355c-7157-4baf-9995-21ff4a57ecc0 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:08:58.086677 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a0ece7fd-801e-4540-85f7-2986ff8ba16c tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:08:58.087668 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a0ece7fd-801e-4540-85f7-2986ff8ba16c tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] [instance: 827235d8-4a51-49b0-af9e-f45e37bcf762] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:08:58.108914 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a0ece7fd-801e-4540-85f7-2986ff8ba16c tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:58.109445 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a0ece7fd-801e-4540-85f7-2986ff8ba16c tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:58.112151 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a0ece7fd-801e-4540-85f7-2986ff8ba16c tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:58.112734 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a0ece7fd-801e-4540-85f7-2986ff8ba16c tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:58.469384 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-a0ece7fd-801e-4540-85f7-2986ff8ba16c tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6809a212fcc4730a3a30c81e8485ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d727625d6eb47febd54a3f4071bb7c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:08:58.479378 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a0ece7fd-801e-4540-85f7-2986ff8ba16c tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] 10.222.0.46 "GET /compute/v2.1/servers/827235d8-4a51-49b0-af9e-f45e37bcf762" status: 200 len: 1520 microversion: 2.1 time: 0.396784 Jan 15 21:08:58.480477 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2918/5828] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:08:58 2022] GET /compute/v2.1/servers/827235d8-4a51-49b0-af9e-f45e37bcf762 => generated 1520 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:08:59.518420 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e7d8554a-03eb-4012-9bcd-24993b199a38 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:08:59.519272 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e7d8554a-03eb-4012-9bcd-24993b199a38 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] [instance: 827235d8-4a51-49b0-af9e-f45e37bcf762] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:08:59.538467 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e7d8554a-03eb-4012-9bcd-24993b199a38 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:59.542039 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e7d8554a-03eb-4012-9bcd-24993b199a38 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:59.544403 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e7d8554a-03eb-4012-9bcd-24993b199a38 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:08:59.545878 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e7d8554a-03eb-4012-9bcd-24993b199a38 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:08:59.974061 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-e7d8554a-03eb-4012-9bcd-24993b199a38 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6809a212fcc4730a3a30c81e8485ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d727625d6eb47febd54a3f4071bb7c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:08:59.983676 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e7d8554a-03eb-4012-9bcd-24993b199a38 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] 10.222.0.46 "GET /compute/v2.1/servers/827235d8-4a51-49b0-af9e-f45e37bcf762" status: 200 len: 1520 microversion: 2.1 time: 0.480232 Jan 15 21:08:59.994608 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2911/5829] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:08:59 2022] GET /compute/v2.1/servers/827235d8-4a51-49b0-af9e-f45e37bcf762 => generated 1520 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:09:01.005375 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-5f0f78f5-d9f6-4807-80a5-2407e28d1ff4 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:09:01.006135 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-5f0f78f5-d9f6-4807-80a5-2407e28d1ff4 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] [instance: 827235d8-4a51-49b0-af9e-f45e37bcf762] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:09:01.024252 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5f0f78f5-d9f6-4807-80a5-2407e28d1ff4 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:01.024252 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5f0f78f5-d9f6-4807-80a5-2407e28d1ff4 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:01.024252 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5f0f78f5-d9f6-4807-80a5-2407e28d1ff4 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:01.024631 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5f0f78f5-d9f6-4807-80a5-2407e28d1ff4 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:01.380819 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-5f0f78f5-d9f6-4807-80a5-2407e28d1ff4 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6809a212fcc4730a3a30c81e8485ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d727625d6eb47febd54a3f4071bb7c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:09:01.389901 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-5f0f78f5-d9f6-4807-80a5-2407e28d1ff4 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] 10.222.0.46 "GET /compute/v2.1/servers/827235d8-4a51-49b0-af9e-f45e37bcf762" status: 200 len: 1520 microversion: 2.1 time: 0.389141 Jan 15 21:09:01.390642 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2919/5830] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:09:00 2022] GET /compute/v2.1/servers/827235d8-4a51-49b0-af9e-f45e37bcf762 => generated 1520 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:09:02.409313 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8afb6cfd-839d-4f3d-8800-077b1c3b4cbe tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:09:02.410587 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-8afb6cfd-839d-4f3d-8800-077b1c3b4cbe tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] [instance: 827235d8-4a51-49b0-af9e-f45e37bcf762] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:09:02.417950 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8afb6cfd-839d-4f3d-8800-077b1c3b4cbe tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:02.418395 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8afb6cfd-839d-4f3d-8800-077b1c3b4cbe tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:02.419362 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8afb6cfd-839d-4f3d-8800-077b1c3b4cbe tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:02.419800 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8afb6cfd-839d-4f3d-8800-077b1c3b4cbe tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:02.640229 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-8afb6cfd-839d-4f3d-8800-077b1c3b4cbe tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6809a212fcc4730a3a30c81e8485ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d727625d6eb47febd54a3f4071bb7c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:09:02.657282 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-8afb6cfd-839d-4f3d-8800-077b1c3b4cbe tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] 10.222.0.46 "GET /compute/v2.1/servers/827235d8-4a51-49b0-af9e-f45e37bcf762" status: 200 len: 1520 microversion: 2.1 time: 0.252466 Jan 15 21:09:02.658562 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2912/5831] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:09:02 2022] GET /compute/v2.1/servers/827235d8-4a51-49b0-af9e-f45e37bcf762 => generated 1520 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:09:03.674919 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-6a7989b8-b8ae-4cd1-b9b8-c7ba086de39f tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:09:03.675523 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-6a7989b8-b8ae-4cd1-b9b8-c7ba086de39f tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] [instance: 827235d8-4a51-49b0-af9e-f45e37bcf762] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:09:03.682885 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6a7989b8-b8ae-4cd1-b9b8-c7ba086de39f tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:03.683520 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6a7989b8-b8ae-4cd1-b9b8-c7ba086de39f tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:03.684514 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6a7989b8-b8ae-4cd1-b9b8-c7ba086de39f tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:03.685177 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6a7989b8-b8ae-4cd1-b9b8-c7ba086de39f tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:03.937862 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-6a7989b8-b8ae-4cd1-b9b8-c7ba086de39f tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6809a212fcc4730a3a30c81e8485ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d727625d6eb47febd54a3f4071bb7c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:09:03.956085 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-6a7989b8-b8ae-4cd1-b9b8-c7ba086de39f tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] 10.222.0.46 "GET /compute/v2.1/servers/827235d8-4a51-49b0-af9e-f45e37bcf762" status: 200 len: 1520 microversion: 2.1 time: 0.284973 Jan 15 21:09:03.956624 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2920/5832] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:09:03 2022] GET /compute/v2.1/servers/827235d8-4a51-49b0-af9e-f45e37bcf762 => generated 1520 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:09:04.975879 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-809ffd34-c3e2-4598-b525-25ed1ce0d5c9 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:09:04.976650 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-809ffd34-c3e2-4598-b525-25ed1ce0d5c9 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] [instance: 827235d8-4a51-49b0-af9e-f45e37bcf762] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:09:04.990113 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-809ffd34-c3e2-4598-b525-25ed1ce0d5c9 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:04.991133 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-809ffd34-c3e2-4598-b525-25ed1ce0d5c9 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:04.991870 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-809ffd34-c3e2-4598-b525-25ed1ce0d5c9 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:04.992310 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-809ffd34-c3e2-4598-b525-25ed1ce0d5c9 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:05.180161 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-809ffd34-c3e2-4598-b525-25ed1ce0d5c9 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6809a212fcc4730a3a30c81e8485ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d727625d6eb47febd54a3f4071bb7c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:09:05.188044 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-809ffd34-c3e2-4598-b525-25ed1ce0d5c9 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] 10.222.0.46 "GET /compute/v2.1/servers/827235d8-4a51-49b0-af9e-f45e37bcf762" status: 200 len: 1520 microversion: 2.1 time: 0.218369 Jan 15 21:09:05.189189 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2913/5833] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:09:04 2022] GET /compute/v2.1/servers/827235d8-4a51-49b0-af9e-f45e37bcf762 => generated 1520 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:09:06.205382 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7679ad31-a19e-4449-b23c-0e3c86873107 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:09:06.205982 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-7679ad31-a19e-4449-b23c-0e3c86873107 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] [instance: 827235d8-4a51-49b0-af9e-f45e37bcf762] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:09:06.217869 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7679ad31-a19e-4449-b23c-0e3c86873107 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:06.218622 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7679ad31-a19e-4449-b23c-0e3c86873107 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:06.221368 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7679ad31-a19e-4449-b23c-0e3c86873107 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:06.222360 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7679ad31-a19e-4449-b23c-0e3c86873107 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:06.381295 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-7679ad31-a19e-4449-b23c-0e3c86873107 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6809a212fcc4730a3a30c81e8485ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d727625d6eb47febd54a3f4071bb7c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:09:06.389028 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7679ad31-a19e-4449-b23c-0e3c86873107 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] 10.222.0.46 "GET /compute/v2.1/servers/827235d8-4a51-49b0-af9e-f45e37bcf762" status: 200 len: 1520 microversion: 2.1 time: 0.187766 Jan 15 21:09:06.389606 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2921/5834] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:09:06 2022] GET /compute/v2.1/servers/827235d8-4a51-49b0-af9e-f45e37bcf762 => generated 1520 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:09:07.407953 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-818101b5-50d5-4606-b405-e5d0c9838447 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:09:07.409924 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-818101b5-50d5-4606-b405-e5d0c9838447 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] [instance: 827235d8-4a51-49b0-af9e-f45e37bcf762] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:09:07.428609 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-818101b5-50d5-4606-b405-e5d0c9838447 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:07.429771 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-818101b5-50d5-4606-b405-e5d0c9838447 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:07.431162 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-818101b5-50d5-4606-b405-e5d0c9838447 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:07.431840 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-818101b5-50d5-4606-b405-e5d0c9838447 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:07.650160 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-818101b5-50d5-4606-b405-e5d0c9838447 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6809a212fcc4730a3a30c81e8485ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d727625d6eb47febd54a3f4071bb7c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:09:07.659147 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-818101b5-50d5-4606-b405-e5d0c9838447 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] 10.222.0.46 "GET /compute/v2.1/servers/827235d8-4a51-49b0-af9e-f45e37bcf762" status: 200 len: 1497 microversion: 2.1 time: 0.256399 Jan 15 21:09:07.659816 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2914/5835] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:09:07 2022] GET /compute/v2.1/servers/827235d8-4a51-49b0-af9e-f45e37bcf762 => generated 1497 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:09:07.676526 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e19c3246-9685-44bb-a71c-945819159b1d tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:09:07.680581 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:09:07.680581 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:09:07.682190 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-e19c3246-9685-44bb-a71c-945819159b1d tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e6809a212fcc4730a3a30c81e8485ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d727625d6eb47febd54a3f4071bb7c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:09:07.683380 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e19c3246-9685-44bb-a71c-945819159b1d tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': '8d727625d6eb47febd54a3f4071bb7c3'} {{(pid=129366) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 15 21:09:07.694401 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e19c3246-9685-44bb-a71c-945819159b1d tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:07.695198 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e19c3246-9685-44bb-a71c-945819159b1d tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:07.696479 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e19c3246-9685-44bb-a71c-945819159b1d tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:07.697358 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e19c3246-9685-44bb-a71c-945819159b1d tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:07.742972 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.multi_cell_list [None req-e19c3246-9685-44bb-a71c-945819159b1d tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=129366) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jan 15 21:09:07.773895 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e19c3246-9685-44bb-a71c-945819159b1d tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] 10.222.0.46 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 345 microversion: 2.1 time: 0.101695 Jan 15 21:09:07.774803 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2922/5836] 10.222.0.46 () {58 vars in 1153 bytes} [Sat Jan 15 21:09:07 2022] GET /compute/v2.1/servers?status=shutoff => generated 345 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:09:07.785820 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-27e07dae-4f49-42d2-83b8-15f2d6e96466 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:09:07.801376 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-27e07dae-4f49-42d2-83b8-15f2d6e96466 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:07.801849 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-27e07dae-4f49-42d2-83b8-15f2d6e96466 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:07.842474 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-27e07dae-4f49-42d2-83b8-15f2d6e96466 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] [instance: 827235d8-4a51-49b0-af9e-f45e37bcf762] Going to try to start instance {{(pid=129365) start /opt/stack/nova/nova/compute/api.py:2677}} Jan 15 21:09:07.916955 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-27e07dae-4f49-42d2-83b8-15f2d6e96466 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] 10.222.0.46 "POST /compute/v2.1/servers/827235d8-4a51-49b0-af9e-f45e37bcf762/action" status: 202 len: 0 microversion: 2.1 time: 0.134451 Jan 15 21:09:07.917736 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2915/5837] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:09:07 2022] POST /compute/v2.1/servers/827235d8-4a51-49b0-af9e-f45e37bcf762/action => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:09:07.933539 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b4973412-dbef-45f4-b13d-6ad366605163 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:09:07.935513 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b4973412-dbef-45f4-b13d-6ad366605163 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] [instance: 827235d8-4a51-49b0-af9e-f45e37bcf762] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:09:07.948103 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b4973412-dbef-45f4-b13d-6ad366605163 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:07.948785 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b4973412-dbef-45f4-b13d-6ad366605163 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:07.950123 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b4973412-dbef-45f4-b13d-6ad366605163 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:07.950913 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b4973412-dbef-45f4-b13d-6ad366605163 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:08.143824 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-b4973412-dbef-45f4-b13d-6ad366605163 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6809a212fcc4730a3a30c81e8485ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d727625d6eb47febd54a3f4071bb7c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:09:08.151262 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b4973412-dbef-45f4-b13d-6ad366605163 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] 10.222.0.46 "GET /compute/v2.1/servers/827235d8-4a51-49b0-af9e-f45e37bcf762" status: 200 len: 1506 microversion: 2.1 time: 0.229296 Jan 15 21:09:08.152091 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2923/5838] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:09:07 2022] GET /compute/v2.1/servers/827235d8-4a51-49b0-af9e-f45e37bcf762 => generated 1506 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:09:09.171112 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5c90db09-65a1-45a8-8ce6-f98d477dfc01 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:09:09.172407 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-5c90db09-65a1-45a8-8ce6-f98d477dfc01 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] [instance: 827235d8-4a51-49b0-af9e-f45e37bcf762] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:09:09.179670 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5c90db09-65a1-45a8-8ce6-f98d477dfc01 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:09.180438 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5c90db09-65a1-45a8-8ce6-f98d477dfc01 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:09.181451 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5c90db09-65a1-45a8-8ce6-f98d477dfc01 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:09.182045 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5c90db09-65a1-45a8-8ce6-f98d477dfc01 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:09.455853 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-5c90db09-65a1-45a8-8ce6-f98d477dfc01 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6809a212fcc4730a3a30c81e8485ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d727625d6eb47febd54a3f4071bb7c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:09:09.481332 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5c90db09-65a1-45a8-8ce6-f98d477dfc01 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] 10.222.0.46 "GET /compute/v2.1/servers/827235d8-4a51-49b0-af9e-f45e37bcf762" status: 200 len: 1506 microversion: 2.1 time: 0.315330 Jan 15 21:09:09.484810 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2916/5839] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:09:09 2022] GET /compute/v2.1/servers/827235d8-4a51-49b0-af9e-f45e37bcf762 => generated 1506 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:09:10.194978 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-3310904e-9213-441e-b2e7-34cba5de9c3f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:09:10.195466 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-3310904e-9213-441e-b2e7-34cba5de9c3f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:09:10.210352 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3310904e-9213-441e-b2e7-34cba5de9c3f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:10.210820 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3310904e-9213-441e-b2e7-34cba5de9c3f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:10.212273 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3310904e-9213-441e-b2e7-34cba5de9c3f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:10.218836 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3310904e-9213-441e-b2e7-34cba5de9c3f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:10.262585 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-3310904e-9213-441e-b2e7-34cba5de9c3f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Going to try to terminate instance {{(pid=129366) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 21:09:10.419690 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-3310904e-9213-441e-b2e7-34cba5de9c3f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "DELETE /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220" status: 204 len: 0 microversion: 2.32 time: 0.228192 Jan 15 21:09:10.421899 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2924/5840] 10.222.0.46 () {60 vars in 1279 bytes} [Sat Jan 15 21:09:10 2022] DELETE /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 15 21:09:10.430386 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-73eff27f-387c-4fee-9084-24143d25ad1b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:09:10.431006 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-73eff27f-387c-4fee-9084-24143d25ad1b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:09:10.446249 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-73eff27f-387c-4fee-9084-24143d25ad1b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:10.447480 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-73eff27f-387c-4fee-9084-24143d25ad1b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:10.449140 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-73eff27f-387c-4fee-9084-24143d25ad1b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:10.453681 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-73eff27f-387c-4fee-9084-24143d25ad1b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:10.504931 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c31ed0cb-cb54-4fd3-9f61-6e76e98b296a tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:09:10.506653 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c31ed0cb-cb54-4fd3-9f61-6e76e98b296a tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] [instance: 827235d8-4a51-49b0-af9e-f45e37bcf762] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:09:10.523958 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c31ed0cb-cb54-4fd3-9f61-6e76e98b296a tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:10.525011 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c31ed0cb-cb54-4fd3-9f61-6e76e98b296a tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:10.532990 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c31ed0cb-cb54-4fd3-9f61-6e76e98b296a tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:10.533591 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c31ed0cb-cb54-4fd3-9f61-6e76e98b296a tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:10.877225 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-73eff27f-387c-4fee-9084-24143d25ad1b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:09:10.891652 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-73eff27f-387c-4fee-9084-24143d25ad1b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:09:10.893753 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-73eff27f-387c-4fee-9084-24143d25ad1b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:09:10.897176 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-73eff27f-387c-4fee-9084-24143d25ad1b tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "GET /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220" status: 200 len: 2959 microversion: 2.32 time: 0.469896 Jan 15 21:09:10.900372 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2917/5841] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:09:10 2022] GET /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220 => generated 2959 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:09:10.922216 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-c31ed0cb-cb54-4fd3-9f61-6e76e98b296a tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6809a212fcc4730a3a30c81e8485ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d727625d6eb47febd54a3f4071bb7c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:09:10.931262 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c31ed0cb-cb54-4fd3-9f61-6e76e98b296a tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] 10.222.0.46 "GET /compute/v2.1/servers/827235d8-4a51-49b0-af9e-f45e37bcf762" status: 200 len: 1510 microversion: 2.1 time: 0.432162 Jan 15 21:09:10.934342 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2925/5842] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:09:10 2022] GET /compute/v2.1/servers/827235d8-4a51-49b0-af9e-f45e37bcf762 => generated 1510 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:09:10.961181 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2b1aa574-6019-485c-bfdd-1ffbd7c4485b tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:09:10.968168 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:09:10.968168 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:09:10.969377 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-2b1aa574-6019-485c-bfdd-1ffbd7c4485b tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e6809a212fcc4730a3a30c81e8485ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d727625d6eb47febd54a3f4071bb7c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:09:10.969815 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.compute.servers [None req-2b1aa574-6019-485c-bfdd-1ffbd7c4485b tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Removing options 'limit' from query {{(pid=129365) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1474}} Jan 15 21:09:10.974045 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-2b1aa574-6019-485c-bfdd-1ffbd7c4485b tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Searching by: {'deleted': False, 'project_id': '8d727625d6eb47febd54a3f4071bb7c3'} {{(pid=129365) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 15 21:09:10.975909 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2b1aa574-6019-485c-bfdd-1ffbd7c4485b tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:10.979597 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2b1aa574-6019-485c-bfdd-1ffbd7c4485b tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:10.983586 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2b1aa574-6019-485c-bfdd-1ffbd7c4485b tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:10.988775 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2b1aa574-6019-485c-bfdd-1ffbd7c4485b tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:10.988775 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2b1aa574-6019-485c-bfdd-1ffbd7c4485b tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] 10.222.0.46 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.029418 Jan 15 21:09:10.997308 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2918/5843] 10.222.0.46 () {58 vars in 1139 bytes} [Sat Jan 15 21:09:10 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 21:09:11.003255 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-924782c5-eaa4-49a2-9fd1-58465f965ff4 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:09:11.004095 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-924782c5-eaa4-49a2-9fd1-58465f965ff4 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] [instance: 827235d8-4a51-49b0-af9e-f45e37bcf762] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:09:11.012235 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-924782c5-eaa4-49a2-9fd1-58465f965ff4 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:11.013776 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-924782c5-eaa4-49a2-9fd1-58465f965ff4 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:11.018884 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-924782c5-eaa4-49a2-9fd1-58465f965ff4 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:11.019580 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-924782c5-eaa4-49a2-9fd1-58465f965ff4 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:11.490195 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-924782c5-eaa4-49a2-9fd1-58465f965ff4 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6809a212fcc4730a3a30c81e8485ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d727625d6eb47febd54a3f4071bb7c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:09:11.498429 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-924782c5-eaa4-49a2-9fd1-58465f965ff4 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] 10.222.0.46 "GET /compute/v2.1/servers/827235d8-4a51-49b0-af9e-f45e37bcf762" status: 200 len: 1510 microversion: 2.1 time: 0.500552 Jan 15 21:09:11.504169 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2926/5844] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:09:10 2022] GET /compute/v2.1/servers/827235d8-4a51-49b0-af9e-f45e37bcf762 => generated 1510 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:09:11.516230 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-932018c4-b409-4640-8749-12ec655d9298 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:09:11.518693 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-932018c4-b409-4640-8749-12ec655d9298 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] [instance: 6ad265d9-74dd-44bc-80d0-3a10870684e0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:09:11.531824 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-932018c4-b409-4640-8749-12ec655d9298 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:11.532320 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-932018c4-b409-4640-8749-12ec655d9298 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:11.535587 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-932018c4-b409-4640-8749-12ec655d9298 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:11.536444 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-932018c4-b409-4640-8749-12ec655d9298 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:11.783642 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-932018c4-b409-4640-8749-12ec655d9298 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6809a212fcc4730a3a30c81e8485ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d727625d6eb47febd54a3f4071bb7c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:09:11.796897 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-932018c4-b409-4640-8749-12ec655d9298 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] 10.222.0.46 "GET /compute/v2.1/servers/6ad265d9-74dd-44bc-80d0-3a10870684e0" status: 200 len: 1510 microversion: 2.1 time: 0.284156 Jan 15 21:09:11.797579 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2919/5845] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:09:11 2022] GET /compute/v2.1/servers/6ad265d9-74dd-44bc-80d0-3a10870684e0 => generated 1510 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:09:11.814988 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-afc72470-369e-4eb0-9e55-20f2fbe91420 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:09:11.815800 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-afc72470-369e-4eb0-9e55-20f2fbe91420 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] [instance: 25f2d43f-7008-4b4d-ac8d-5959a48ab04d] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:09:11.826436 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-afc72470-369e-4eb0-9e55-20f2fbe91420 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:11.827075 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-afc72470-369e-4eb0-9e55-20f2fbe91420 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:11.827854 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-afc72470-369e-4eb0-9e55-20f2fbe91420 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:11.828272 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-afc72470-369e-4eb0-9e55-20f2fbe91420 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:11.921169 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-54c21a4a-0105-4ce4-b841-9e75e168432c tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:09:11.922016 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-54c21a4a-0105-4ce4-b841-9e75e168432c tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:09:11.940869 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-54c21a4a-0105-4ce4-b841-9e75e168432c tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:11.943706 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-54c21a4a-0105-4ce4-b841-9e75e168432c tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:11.944537 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-54c21a4a-0105-4ce4-b841-9e75e168432c tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:11.946939 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-54c21a4a-0105-4ce4-b841-9e75e168432c tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:12.275069 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-afc72470-369e-4eb0-9e55-20f2fbe91420 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6809a212fcc4730a3a30c81e8485ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d727625d6eb47febd54a3f4071bb7c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:09:12.283616 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-afc72470-369e-4eb0-9e55-20f2fbe91420 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] 10.222.0.46 "GET /compute/v2.1/servers/25f2d43f-7008-4b4d-ac8d-5959a48ab04d" status: 200 len: 1511 microversion: 2.1 time: 0.473013 Jan 15 21:09:12.284397 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2927/5846] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:09:11 2022] GET /compute/v2.1/servers/25f2d43f-7008-4b4d-ac8d-5959a48ab04d => generated 1511 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:09:12.300462 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ae096899-1d6c-4f94-b1e5-1150b1e3ccca tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:09:12.303852 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:09:12.303852 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:09:12.305223 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-ae096899-1d6c-4f94-b1e5-1150b1e3ccca tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e6809a212fcc4730a3a30c81e8485ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d727625d6eb47febd54a3f4071bb7c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:09:12.306162 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ae096899-1d6c-4f94-b1e5-1150b1e3ccca tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Searching by: {'ip': '172.20.0.8', 'deleted': False, 'project_id': '8d727625d6eb47febd54a3f4071bb7c3'} {{(pid=129366) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 15 21:09:12.431576 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ae096899-1d6c-4f94-b1e5-1150b1e3ccca tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:12.432417 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ae096899-1d6c-4f94-b1e5-1150b1e3ccca tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:12.433677 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ae096899-1d6c-4f94-b1e5-1150b1e3ccca tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:12.434256 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ae096899-1d6c-4f94-b1e5-1150b1e3ccca tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:12.451556 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-54c21a4a-0105-4ce4-b841-9e75e168432c tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:09:12.473351 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-54c21a4a-0105-4ce4-b841-9e75e168432c tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:09:12.476594 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-54c21a4a-0105-4ce4-b841-9e75e168432c tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:09:12.480772 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-54c21a4a-0105-4ce4-b841-9e75e168432c tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "GET /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220" status: 200 len: 2959 microversion: 2.32 time: 0.560910 Jan 15 21:09:12.489564 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2920/5847] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:09:11 2022] GET /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220 => generated 2959 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 15 21:09:12.635765 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.multi_cell_list [None req-ae096899-1d6c-4f94-b1e5-1150b1e3ccca tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=129366) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jan 15 21:09:12.713580 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ae096899-1d6c-4f94-b1e5-1150b1e3ccca tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] 10.222.0.46 "GET /compute/v2.1/servers?ip=172.20.0.8" status: 200 len: 346 microversion: 2.1 time: 0.416761 Jan 15 21:09:12.723271 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2928/5848] 10.222.0.46 () {58 vars in 1151 bytes} [Sat Jan 15 21:09:12 2022] GET /compute/v2.1/servers?ip=172.20.0.8 => generated 346 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:09:12.727792 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9e3d6624-538c-4b7d-8c61-5f0225b25d87 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:09:12.728454 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-9e3d6624-538c-4b7d-8c61-5f0225b25d87 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] [instance: 827235d8-4a51-49b0-af9e-f45e37bcf762] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:09:12.740031 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9e3d6624-538c-4b7d-8c61-5f0225b25d87 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:12.745071 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9e3d6624-538c-4b7d-8c61-5f0225b25d87 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:12.746350 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9e3d6624-538c-4b7d-8c61-5f0225b25d87 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:12.748191 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9e3d6624-538c-4b7d-8c61-5f0225b25d87 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:13.505019 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-db0fb17e-66f7-4dd1-ab93-6c297c747760 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:09:13.505778 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-db0fb17e-66f7-4dd1-ab93-6c297c747760 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:09:13.520271 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-db0fb17e-66f7-4dd1-ab93-6c297c747760 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:13.520271 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-db0fb17e-66f7-4dd1-ab93-6c297c747760 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:13.520271 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-db0fb17e-66f7-4dd1-ab93-6c297c747760 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:13.520271 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-db0fb17e-66f7-4dd1-ab93-6c297c747760 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:13.529740 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-9e3d6624-538c-4b7d-8c61-5f0225b25d87 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6809a212fcc4730a3a30c81e8485ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d727625d6eb47febd54a3f4071bb7c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:09:13.548878 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-9e3d6624-538c-4b7d-8c61-5f0225b25d87 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] 10.222.0.46 "GET /compute/v2.1/servers/827235d8-4a51-49b0-af9e-f45e37bcf762" status: 200 len: 1510 microversion: 2.1 time: 0.824750 Jan 15 21:09:13.550507 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2921/5849] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:09:12 2022] GET /compute/v2.1/servers/827235d8-4a51-49b0-af9e-f45e37bcf762 => generated 1510 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:09:13.571897 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-016aabb7-5618-4918-a2ce-9bc1a48bf4ab tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:09:13.572786 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-016aabb7-5618-4918-a2ce-9bc1a48bf4ab tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] [instance: 6ad265d9-74dd-44bc-80d0-3a10870684e0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:09:13.581187 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-016aabb7-5618-4918-a2ce-9bc1a48bf4ab tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:13.582043 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-016aabb7-5618-4918-a2ce-9bc1a48bf4ab tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:13.583254 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-016aabb7-5618-4918-a2ce-9bc1a48bf4ab tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:13.584086 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-016aabb7-5618-4918-a2ce-9bc1a48bf4ab tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:14.179197 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-016aabb7-5618-4918-a2ce-9bc1a48bf4ab tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6809a212fcc4730a3a30c81e8485ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d727625d6eb47febd54a3f4071bb7c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:09:14.192431 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-016aabb7-5618-4918-a2ce-9bc1a48bf4ab tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] 10.222.0.46 "GET /compute/v2.1/servers/6ad265d9-74dd-44bc-80d0-3a10870684e0" status: 200 len: 1510 microversion: 2.1 time: 0.630977 Jan 15 21:09:14.197691 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2922/5850] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:09:13 2022] GET /compute/v2.1/servers/6ad265d9-74dd-44bc-80d0-3a10870684e0 => generated 1510 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:09:14.220457 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-85380666-ebc3-4174-8f71-2bad206a27ff tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:09:14.224864 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-85380666-ebc3-4174-8f71-2bad206a27ff tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] [instance: 25f2d43f-7008-4b4d-ac8d-5959a48ab04d] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:09:14.249788 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-85380666-ebc3-4174-8f71-2bad206a27ff tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:14.253525 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-85380666-ebc3-4174-8f71-2bad206a27ff tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:14.254661 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-85380666-ebc3-4174-8f71-2bad206a27ff tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:14.255285 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-db0fb17e-66f7-4dd1-ab93-6c297c747760 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:09:14.259178 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-85380666-ebc3-4174-8f71-2bad206a27ff tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:14.264516 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-db0fb17e-66f7-4dd1-ab93-6c297c747760 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:09:14.266055 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-db0fb17e-66f7-4dd1-ab93-6c297c747760 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:09:14.267741 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-db0fb17e-66f7-4dd1-ab93-6c297c747760 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "GET /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220" status: 200 len: 2938 microversion: 2.32 time: 0.766952 Jan 15 21:09:14.268307 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2929/5851] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:09:13 2022] GET /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220 => generated 2938 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 15 21:09:14.509964 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-85380666-ebc3-4174-8f71-2bad206a27ff tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6809a212fcc4730a3a30c81e8485ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d727625d6eb47febd54a3f4071bb7c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:09:14.522102 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-85380666-ebc3-4174-8f71-2bad206a27ff tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] 10.222.0.46 "GET /compute/v2.1/servers/25f2d43f-7008-4b4d-ac8d-5959a48ab04d" status: 200 len: 1511 microversion: 2.1 time: 0.314065 Jan 15 21:09:14.523673 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2923/5852] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:09:14 2022] GET /compute/v2.1/servers/25f2d43f-7008-4b4d-ac8d-5959a48ab04d => generated 1511 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:09:14.541776 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e0761fa8-7733-42d7-bb4d-20d1a8e901a2 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:09:14.545454 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:09:14.545454 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:09:14.546754 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-e0761fa8-7733-42d7-bb4d-20d1a8e901a2 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e6809a212fcc4730a3a30c81e8485ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d727625d6eb47febd54a3f4071bb7c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:09:14.547885 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e0761fa8-7733-42d7-bb4d-20d1a8e901a2 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Searching by: {'deleted': False, 'project_id': '8d727625d6eb47febd54a3f4071bb7c3'} {{(pid=129366) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 15 21:09:14.554351 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e0761fa8-7733-42d7-bb4d-20d1a8e901a2 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:14.555245 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e0761fa8-7733-42d7-bb4d-20d1a8e901a2 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:14.558925 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e0761fa8-7733-42d7-bb4d-20d1a8e901a2 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:14.559335 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e0761fa8-7733-42d7-bb4d-20d1a8e901a2 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:14.626466 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.multi_cell_list [None req-e0761fa8-7733-42d7-bb4d-20d1a8e901a2 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=129366) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jan 15 21:09:14.671959 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-e0761fa8-7733-42d7-bb4d-20d1a8e901a2 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6809a212fcc4730a3a30c81e8485ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d727625d6eb47febd54a3f4071bb7c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:09:14.681706 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e0761fa8-7733-42d7-bb4d-20d1a8e901a2 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:14.682497 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e0761fa8-7733-42d7-bb4d-20d1a8e901a2 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:14.918626 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e0761fa8-7733-42d7-bb4d-20d1a8e901a2 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] 10.222.0.46 "GET /compute/v2.1/servers/detail" status: 200 len: 4514 microversion: 2.1 time: 0.382801 Jan 15 21:09:14.932867 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2930/5853] 10.222.0.46 () {58 vars in 1145 bytes} [Sat Jan 15 21:09:14 2022] GET /compute/v2.1/servers/detail => generated 4514 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:09:14.945217 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a02b2ce1-8b9e-4497-b409-9e64deb3e920 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:09:14.949464 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:09:14.949464 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:09:14.951971 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-a02b2ce1-8b9e-4497-b409-9e64deb3e920 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e6809a212fcc4730a3a30c81e8485ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d727625d6eb47febd54a3f4071bb7c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:09:14.953153 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a02b2ce1-8b9e-4497-b409-9e64deb3e920 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': '8d727625d6eb47febd54a3f4071bb7c3'} {{(pid=129365) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 15 21:09:15.241759 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a02b2ce1-8b9e-4497-b409-9e64deb3e920 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:15.242915 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a02b2ce1-8b9e-4497-b409-9e64deb3e920 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:15.243788 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a02b2ce1-8b9e-4497-b409-9e64deb3e920 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:15.244261 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a02b2ce1-8b9e-4497-b409-9e64deb3e920 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:15.289189 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-fe1ec5a0-1229-4d24-8a30-241371c6c4f4 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:09:15.290082 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-fe1ec5a0-1229-4d24-8a30-241371c6c4f4 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:09:15.302709 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fe1ec5a0-1229-4d24-8a30-241371c6c4f4 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:15.303829 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fe1ec5a0-1229-4d24-8a30-241371c6c4f4 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:15.305396 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fe1ec5a0-1229-4d24-8a30-241371c6c4f4 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:15.310073 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fe1ec5a0-1229-4d24-8a30-241371c6c4f4 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:15.458559 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.multi_cell_list [None req-a02b2ce1-8b9e-4497-b409-9e64deb3e920 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=129365) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jan 15 21:09:15.532887 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a02b2ce1-8b9e-4497-b409-9e64deb3e920 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] 10.222.0.46 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1010 microversion: 2.1 time: 0.591466 Jan 15 21:09:15.535350 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2924/5854] 10.222.0.46 () {58 vars in 1149 bytes} [Sat Jan 15 21:09:14 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1010 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:09:15.551401 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-4d63dc97-9224-4bd9-b141-ba8f2ac49304 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:09:15.555347 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:09:15.555347 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:09:15.556629 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-4d63dc97-9224-4bd9-b141-ba8f2ac49304 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e6809a212fcc4730a3a30c81e8485ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d727625d6eb47febd54a3f4071bb7c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:09:15.557426 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-4d63dc97-9224-4bd9-b141-ba8f2ac49304 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': '8d727625d6eb47febd54a3f4071bb7c3'} {{(pid=129365) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 15 21:09:15.564824 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4d63dc97-9224-4bd9-b141-ba8f2ac49304 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:15.565299 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4d63dc97-9224-4bd9-b141-ba8f2ac49304 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:15.566120 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4d63dc97-9224-4bd9-b141-ba8f2ac49304 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:15.566554 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4d63dc97-9224-4bd9-b141-ba8f2ac49304 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:15.747094 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.multi_cell_list [None req-4d63dc97-9224-4bd9-b141-ba8f2ac49304 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=129365) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jan 15 21:09:15.847066 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-fe1ec5a0-1229-4d24-8a30-241371c6c4f4 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:09:15.858553 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-fe1ec5a0-1229-4d24-8a30-241371c6c4f4 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:09:15.860523 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-fe1ec5a0-1229-4d24-8a30-241371c6c4f4 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:09:15.862099 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-fe1ec5a0-1229-4d24-8a30-241371c6c4f4 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "GET /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220" status: 200 len: 2917 microversion: 2.32 time: 0.577384 Jan 15 21:09:15.863262 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2931/5855] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:09:15 2022] GET /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220 => generated 2917 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:09:15.868138 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-78fc33e8-2e41-403f-9101-04350bd34d0c req-7dd60f5f-f44b-40a2-811b-afef719a247d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "686aa731-082f-4584-8607-5a40f0d63220", "name": "network-vif-unplugged", "status": "completed", "tag": "9f31cf46-d654-4aef-ada4-dab1fc37d328"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:09:15.869896 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:09:15.869896 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:09:15.884296 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-78fc33e8-2e41-403f-9101-04350bd34d0c req-7dd60f5f-f44b-40a2-811b-afef719a247d service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:15.887103 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-78fc33e8-2e41-403f-9101-04350bd34d0c req-7dd60f5f-f44b-40a2-811b-afef719a247d service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:15.930312 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-78fc33e8-2e41-403f-9101-04350bd34d0c req-7dd60f5f-f44b-40a2-811b-afef719a247d service nova] Creating event network-vif-unplugged:9f31cf46-d654-4aef-ada4-dab1fc37d328 for instance 686aa731-082f-4584-8607-5a40f0d63220 on nch1-master-1 Jan 15 21:09:15.934300 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-4d63dc97-9224-4bd9-b141-ba8f2ac49304 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] 10.222.0.46 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1010 microversion: 2.1 time: 0.387729 Jan 15 21:09:15.935444 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2925/5856] 10.222.0.46 () {58 vars in 1211 bytes} [Sat Jan 15 21:09:15 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1010 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:09:15.943019 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-78fc33e8-2e41-403f-9101-04350bd34d0c req-7dd60f5f-f44b-40a2-811b-afef719a247d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.077521 Jan 15 21:09:15.943303 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2932/5857] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:09:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:09:15.947830 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d7b21d8d-63f4-43c9-a544-fce3d2b5958c tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:09:15.951332 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:09:15.951332 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:09:15.952407 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-d7b21d8d-63f4-43c9-a544-fce3d2b5958c tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e6809a212fcc4730a3a30c81e8485ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d727625d6eb47febd54a3f4071bb7c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:09:15.953042 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d7b21d8d-63f4-43c9-a544-fce3d2b5958c tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': '8d727625d6eb47febd54a3f4071bb7c3'} {{(pid=129365) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 15 21:09:15.960208 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d7b21d8d-63f4-43c9-a544-fce3d2b5958c tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:15.961187 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d7b21d8d-63f4-43c9-a544-fce3d2b5958c tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:15.962676 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d7b21d8d-63f4-43c9-a544-fce3d2b5958c tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:15.963580 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d7b21d8d-63f4-43c9-a544-fce3d2b5958c tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:16.092136 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.multi_cell_list [None req-d7b21d8d-63f4-43c9-a544-fce3d2b5958c tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=129365) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jan 15 21:09:16.180132 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d7b21d8d-63f4-43c9-a544-fce3d2b5958c tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] 10.222.0.46 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1010 microversion: 2.1 time: 0.235566 Jan 15 21:09:16.187456 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2926/5858] 10.222.0.46 () {58 vars in 1195 bytes} [Sat Jan 15 21:09:15 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1010 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:09:16.194667 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c3aa1fbf-b87e-40bc-9cdc-0e84fb3d733a tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:09:16.200923 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:09:16.200923 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:09:16.204824 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-c3aa1fbf-b87e-40bc-9cdc-0e84fb3d733a tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e6809a212fcc4730a3a30c81e8485ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d727625d6eb47febd54a3f4071bb7c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:09:16.205256 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c3aa1fbf-b87e-40bc-9cdc-0e84fb3d733a tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Searching by: {'name': '-216154498', 'deleted': False, 'project_id': '8d727625d6eb47febd54a3f4071bb7c3'} {{(pid=129366) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 15 21:09:16.221738 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c3aa1fbf-b87e-40bc-9cdc-0e84fb3d733a tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:16.223916 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c3aa1fbf-b87e-40bc-9cdc-0e84fb3d733a tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:16.224880 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c3aa1fbf-b87e-40bc-9cdc-0e84fb3d733a tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:16.226803 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c3aa1fbf-b87e-40bc-9cdc-0e84fb3d733a tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:16.416971 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.multi_cell_list [None req-c3aa1fbf-b87e-40bc-9cdc-0e84fb3d733a tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=129366) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jan 15 21:09:16.555240 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c3aa1fbf-b87e-40bc-9cdc-0e84fb3d733a tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] 10.222.0.46 "GET /compute/v2.1/servers?name=-216154498" status: 200 len: 345 microversion: 2.1 time: 0.365565 Jan 15 21:09:16.561168 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2933/5859] 10.222.0.46 () {58 vars in 1155 bytes} [Sat Jan 15 21:09:16 2022] GET /compute/v2.1/servers?name=-216154498 => generated 345 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 21:09:16.568225 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-1a61cce1-aafd-48ae-aed1-d0ec42f2f374 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:09:16.572470 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:09:16.572470 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:09:16.575176 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-1a61cce1-aafd-48ae-aed1-d0ec42f2f374 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e6809a212fcc4730a3a30c81e8485ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d727625d6eb47febd54a3f4071bb7c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:09:16.576561 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-1a61cce1-aafd-48ae-aed1-d0ec42f2f374 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': '8d727625d6eb47febd54a3f4071bb7c3'} {{(pid=129365) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 15 21:09:16.591878 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1a61cce1-aafd-48ae-aed1-d0ec42f2f374 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:16.592542 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1a61cce1-aafd-48ae-aed1-d0ec42f2f374 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:16.593618 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1a61cce1-aafd-48ae-aed1-d0ec42f2f374 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:16.597431 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1a61cce1-aafd-48ae-aed1-d0ec42f2f374 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:16.828103 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.multi_cell_list [None req-1a61cce1-aafd-48ae-aed1-d0ec42f2f374 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=129365) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jan 15 21:09:16.906782 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-892675e2-bc00-49a6-b1db-accda690912f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:09:16.908428 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-892675e2-bc00-49a6-b1db-accda690912f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:09:16.939809 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-892675e2-bc00-49a6-b1db-accda690912f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:16.946256 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-892675e2-bc00-49a6-b1db-accda690912f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:16.950802 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-892675e2-bc00-49a6-b1db-accda690912f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:16.951578 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-892675e2-bc00-49a6-b1db-accda690912f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:16.992308 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-1a61cce1-aafd-48ae-aed1-d0ec42f2f374 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] 10.222.0.46 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1010 microversion: 2.1 time: 0.427583 Jan 15 21:09:16.995291 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2927/5860] 10.222.0.46 () {58 vars in 1153 bytes} [Sat Jan 15 21:09:16 2022] GET /compute/v2.1/servers?name=-instance => generated 1010 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:09:17.011675 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2eb4332b-0ad5-4e1b-b59e-6eb8ab40bf13 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:09:17.019463 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:09:17.019463 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:09:17.022932 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-2eb4332b-0ad5-4e1b-b59e-6eb8ab40bf13 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e6809a212fcc4730a3a30c81e8485ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d727625d6eb47febd54a3f4071bb7c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:09:17.023818 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-2eb4332b-0ad5-4e1b-b59e-6eb8ab40bf13 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-21615449', 'deleted': False, 'project_id': '8d727625d6eb47febd54a3f4071bb7c3'} {{(pid=129365) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 15 21:09:17.037968 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2eb4332b-0ad5-4e1b-b59e-6eb8ab40bf13 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:17.041658 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2eb4332b-0ad5-4e1b-b59e-6eb8ab40bf13 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:17.045618 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2eb4332b-0ad5-4e1b-b59e-6eb8ab40bf13 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:17.046274 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2eb4332b-0ad5-4e1b-b59e-6eb8ab40bf13 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:17.257307 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.multi_cell_list [None req-2eb4332b-0ad5-4e1b-b59e-6eb8ab40bf13 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=129365) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jan 15 21:09:17.384481 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2eb4332b-0ad5-4e1b-b59e-6eb8ab40bf13 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] 10.222.0.46 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-21615449" status: 200 len: 345 microversion: 2.1 time: 0.382067 Jan 15 21:09:17.396196 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2928/5861] 10.222.0.46 () {58 vars in 1225 bytes} [Sat Jan 15 21:09:17 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-21615449 => generated 345 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:09:17.402040 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-93de8ed6-7dd2-4742-8828-0d4ec6af21a0 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:09:17.403170 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-93de8ed6-7dd2-4742-8828-0d4ec6af21a0 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] [instance: 25f2d43f-7008-4b4d-ac8d-5959a48ab04d] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:09:17.421163 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-93de8ed6-7dd2-4742-8828-0d4ec6af21a0 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:17.424156 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-93de8ed6-7dd2-4742-8828-0d4ec6af21a0 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:17.425941 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-93de8ed6-7dd2-4742-8828-0d4ec6af21a0 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:17.426992 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-93de8ed6-7dd2-4742-8828-0d4ec6af21a0 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:17.427671 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-892675e2-bc00-49a6-b1db-accda690912f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:09:17.441042 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-892675e2-bc00-49a6-b1db-accda690912f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:09:17.444172 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-892675e2-bc00-49a6-b1db-accda690912f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:09:17.445603 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-892675e2-bc00-49a6-b1db-accda690912f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "GET /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220" status: 200 len: 2870 microversion: 2.32 time: 0.551309 Jan 15 21:09:17.452162 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2934/5862] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:09:16 2022] GET /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220 => generated 2870 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:09:17.487595 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-93de8ed6-7dd2-4742-8828-0d4ec6af21a0 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] [instance: 25f2d43f-7008-4b4d-ac8d-5959a48ab04d] Going to try to terminate instance {{(pid=129365) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 21:09:17.665336 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-93de8ed6-7dd2-4742-8828-0d4ec6af21a0 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] 10.222.0.46 "DELETE /compute/v2.1/servers/25f2d43f-7008-4b4d-ac8d-5959a48ab04d" status: 204 len: 0 microversion: 2.1 time: 0.266891 Jan 15 21:09:17.668222 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2929/5863] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 21:09:17 2022] DELETE /compute/v2.1/servers/25f2d43f-7008-4b4d-ac8d-5959a48ab04d => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 15 21:09:17.677369 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b2ad8bd2-ecec-4925-9a41-d5811b94e514 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:09:17.677977 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b2ad8bd2-ecec-4925-9a41-d5811b94e514 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] [instance: 25f2d43f-7008-4b4d-ac8d-5959a48ab04d] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:09:17.698056 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b2ad8bd2-ecec-4925-9a41-d5811b94e514 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:17.701484 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b2ad8bd2-ecec-4925-9a41-d5811b94e514 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:17.702709 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b2ad8bd2-ecec-4925-9a41-d5811b94e514 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:17.705028 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b2ad8bd2-ecec-4925-9a41-d5811b94e514 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:18.065740 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-b2ad8bd2-ecec-4925-9a41-d5811b94e514 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6809a212fcc4730a3a30c81e8485ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d727625d6eb47febd54a3f4071bb7c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:09:18.078126 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b2ad8bd2-ecec-4925-9a41-d5811b94e514 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] 10.222.0.46 "GET /compute/v2.1/servers/25f2d43f-7008-4b4d-ac8d-5959a48ab04d" status: 200 len: 1517 microversion: 2.1 time: 0.404611 Jan 15 21:09:18.082516 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2935/5864] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:09:17 2022] GET /compute/v2.1/servers/25f2d43f-7008-4b4d-ac8d-5959a48ab04d => generated 1517 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:09:18.403556 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-67c06b05-b29e-4894-8b66-c349b55059b9 req-8b8d281a-bd51-40bb-9b3f-c79e018eaa86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "686aa731-082f-4584-8607-5a40f0d63220", "name": "network-vif-unplugged", "status": "completed", "tag": "64cf49a0-1762-46ea-8738-821b466cb2c9"}, {"server_uuid": "686aa731-082f-4584-8607-5a40f0d63220", "name": "network-vif-unplugged", "status": "completed", "tag": "a63ec384-e15d-441f-b027-6fb09676099b"}, {"server_uuid": "686aa731-082f-4584-8607-5a40f0d63220", "name": "network-vif-unplugged", "status": "completed", "tag": "e70cfdd0-1455-44d5-8de1-57e6af6d6aac"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:09:18.406033 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:09:18.406033 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:09:18.437689 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-67c06b05-b29e-4894-8b66-c349b55059b9 req-8b8d281a-bd51-40bb-9b3f-c79e018eaa86 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:18.441817 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-67c06b05-b29e-4894-8b66-c349b55059b9 req-8b8d281a-bd51-40bb-9b3f-c79e018eaa86 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:18.493751 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-67c06b05-b29e-4894-8b66-c349b55059b9 req-8b8d281a-bd51-40bb-9b3f-c79e018eaa86 service nova] Creating event network-vif-unplugged:64cf49a0-1762-46ea-8738-821b466cb2c9 for instance 686aa731-082f-4584-8607-5a40f0d63220 on nch1-master-1 Jan 15 21:09:18.496965 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-67c06b05-b29e-4894-8b66-c349b55059b9 req-8b8d281a-bd51-40bb-9b3f-c79e018eaa86 service nova] Creating event network-vif-unplugged:a63ec384-e15d-441f-b027-6fb09676099b for instance 686aa731-082f-4584-8607-5a40f0d63220 on nch1-master-1 Jan 15 21:09:18.498784 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-67c06b05-b29e-4894-8b66-c349b55059b9 req-8b8d281a-bd51-40bb-9b3f-c79e018eaa86 service nova] Creating event network-vif-unplugged:e70cfdd0-1455-44d5-8de1-57e6af6d6aac for instance 686aa731-082f-4584-8607-5a40f0d63220 on nch1-master-1 Jan 15 21:09:18.526416 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-67c06b05-b29e-4894-8b66-c349b55059b9 req-8b8d281a-bd51-40bb-9b3f-c79e018eaa86 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 531 microversion: 2.1 time: 0.118350 Jan 15 21:09:18.527537 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2936/5865] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:09:18 2022] POST /compute/v2.1/os-server-external-events => generated 531 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 21:09:18.545682 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b4f01b3e-849c-4fbe-86fa-24b5af57b200 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:09:18.551351 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b4f01b3e-849c-4fbe-86fa-24b5af57b200 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:09:18.573707 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b4f01b3e-849c-4fbe-86fa-24b5af57b200 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:18.574409 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b4f01b3e-849c-4fbe-86fa-24b5af57b200 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:18.576667 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b4f01b3e-849c-4fbe-86fa-24b5af57b200 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:18.581159 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b4f01b3e-849c-4fbe-86fa-24b5af57b200 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:18.740367 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-60a21067-ed15-4ffe-ae4d-d810d21aa540 req-c4fc1dac-74fb-45ce-b360-070b8adeb2c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "686aa731-082f-4584-8607-5a40f0d63220", "name": "network-vif-deleted", "tag": "1c682467-fd92-4011-a1b3-79b4e61291df"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:09:18.742696 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:09:18.742696 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:09:18.760173 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-60a21067-ed15-4ffe-ae4d-d810d21aa540 req-c4fc1dac-74fb-45ce-b360-070b8adeb2c0 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:18.763111 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-60a21067-ed15-4ffe-ae4d-d810d21aa540 req-c4fc1dac-74fb-45ce-b360-070b8adeb2c0 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:18.788944 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-60a21067-ed15-4ffe-ae4d-d810d21aa540 req-c4fc1dac-74fb-45ce-b360-070b8adeb2c0 service nova] Creating event network-vif-deleted:1c682467-fd92-4011-a1b3-79b4e61291df for instance 686aa731-082f-4584-8607-5a40f0d63220 on nch1-master-1 Jan 15 21:09:18.816897 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-60a21067-ed15-4ffe-ae4d-d810d21aa540 req-c4fc1dac-74fb-45ce-b360-070b8adeb2c0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.683309 Jan 15 21:09:18.818583 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2930/5866] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:09:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:09:19.035415 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-b4f01b3e-849c-4fbe-86fa-24b5af57b200 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:09:19.050879 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-b4f01b3e-849c-4fbe-86fa-24b5af57b200 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:09:19.054751 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-b4f01b3e-849c-4fbe-86fa-24b5af57b200 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:09:19.056481 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b4f01b3e-849c-4fbe-86fa-24b5af57b200 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "GET /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220" status: 200 len: 2870 microversion: 2.32 time: 0.526526 Jan 15 21:09:19.073067 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2937/5867] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:09:18 2022] GET /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220 => generated 2870 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:09:19.100720 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-425189ba-a113-411a-b9da-3071046d37a1 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:09:19.101371 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-425189ba-a113-411a-b9da-3071046d37a1 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] [instance: 25f2d43f-7008-4b4d-ac8d-5959a48ab04d] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:09:19.122934 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-425189ba-a113-411a-b9da-3071046d37a1 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:19.125011 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-425189ba-a113-411a-b9da-3071046d37a1 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:19.127531 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-425189ba-a113-411a-b9da-3071046d37a1 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:19.129347 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-425189ba-a113-411a-b9da-3071046d37a1 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:19.466866 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-425189ba-a113-411a-b9da-3071046d37a1 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6809a212fcc4730a3a30c81e8485ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d727625d6eb47febd54a3f4071bb7c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:09:19.475907 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-425189ba-a113-411a-b9da-3071046d37a1 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] 10.222.0.46 "GET /compute/v2.1/servers/25f2d43f-7008-4b4d-ac8d-5959a48ab04d" status: 200 len: 1517 microversion: 2.1 time: 0.380713 Jan 15 21:09:19.481410 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2931/5868] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:09:19 2022] GET /compute/v2.1/servers/25f2d43f-7008-4b4d-ac8d-5959a48ab04d => generated 1517 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:09:20.080065 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-72c3a578-234b-44d7-ab0d-421e3fffbfa8 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:09:20.082499 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-72c3a578-234b-44d7-ab0d-421e3fffbfa8 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:09:20.112189 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-72c3a578-234b-44d7-ab0d-421e3fffbfa8 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:20.116578 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-72c3a578-234b-44d7-ab0d-421e3fffbfa8 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:20.117711 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-72c3a578-234b-44d7-ab0d-421e3fffbfa8 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:20.118167 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-72c3a578-234b-44d7-ab0d-421e3fffbfa8 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:20.498236 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-564c3799-1868-4fca-93b5-0101c537798f tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:09:20.499493 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-564c3799-1868-4fca-93b5-0101c537798f tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] [instance: 25f2d43f-7008-4b4d-ac8d-5959a48ab04d] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:09:20.517937 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-564c3799-1868-4fca-93b5-0101c537798f tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:20.518679 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-564c3799-1868-4fca-93b5-0101c537798f tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:20.520630 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-564c3799-1868-4fca-93b5-0101c537798f tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:20.523332 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-564c3799-1868-4fca-93b5-0101c537798f tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:20.740103 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-72c3a578-234b-44d7-ab0d-421e3fffbfa8 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:09:20.751252 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-72c3a578-234b-44d7-ab0d-421e3fffbfa8 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:09:20.753104 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-72c3a578-234b-44d7-ab0d-421e3fffbfa8 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:09:20.754884 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-72c3a578-234b-44d7-ab0d-421e3fffbfa8 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "GET /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220" status: 200 len: 2535 microversion: 2.32 time: 0.679615 Jan 15 21:09:20.769279 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2938/5869] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:09:20 2022] GET /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220 => generated 2535 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:09:20.842179 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-564c3799-1868-4fca-93b5-0101c537798f tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6809a212fcc4730a3a30c81e8485ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d727625d6eb47febd54a3f4071bb7c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:09:20.851488 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-564c3799-1868-4fca-93b5-0101c537798f tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] 10.222.0.46 "GET /compute/v2.1/servers/25f2d43f-7008-4b4d-ac8d-5959a48ab04d" status: 200 len: 1475 microversion: 2.1 time: 0.357051 Jan 15 21:09:20.852101 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2932/5870] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:09:20 2022] GET /compute/v2.1/servers/25f2d43f-7008-4b4d-ac8d-5959a48ab04d => generated 1475 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:09:20.908706 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-17c7a1c9-28b1-49a3-a259-85ec1164123c req-120f1c36-7363-4db8-87f7-c50f85b36ae1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "686aa731-082f-4584-8607-5a40f0d63220", "name": "network-vif-deleted", "tag": "e70cfdd0-1455-44d5-8de1-57e6af6d6aac"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:09:20.921764 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:09:20.921764 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:09:20.952753 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-17c7a1c9-28b1-49a3-a259-85ec1164123c req-120f1c36-7363-4db8-87f7-c50f85b36ae1 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:20.955642 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-17c7a1c9-28b1-49a3-a259-85ec1164123c req-120f1c36-7363-4db8-87f7-c50f85b36ae1 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:20.982194 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-17c7a1c9-28b1-49a3-a259-85ec1164123c req-120f1c36-7363-4db8-87f7-c50f85b36ae1 service nova] Creating event network-vif-deleted:e70cfdd0-1455-44d5-8de1-57e6af6d6aac for instance 686aa731-082f-4584-8607-5a40f0d63220 on nch1-master-1 Jan 15 21:09:20.993493 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-17c7a1c9-28b1-49a3-a259-85ec1164123c req-120f1c36-7363-4db8-87f7-c50f85b36ae1 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093407 Jan 15 21:09:20.994967 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2939/5871] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:09:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:09:21.777820 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-711b238f-1308-4b9c-b066-67d8107d1a0f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:09:21.778440 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-711b238f-1308-4b9c-b066-67d8107d1a0f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:09:21.785092 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-711b238f-1308-4b9c-b066-67d8107d1a0f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:21.785552 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-711b238f-1308-4b9c-b066-67d8107d1a0f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:21.786354 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-711b238f-1308-4b9c-b066-67d8107d1a0f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:21.786795 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-711b238f-1308-4b9c-b066-67d8107d1a0f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:21.872747 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0b199914-0d6d-46a1-ae4c-a8097ed8a2a7 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:09:21.873518 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-0b199914-0d6d-46a1-ae4c-a8097ed8a2a7 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] [instance: 25f2d43f-7008-4b4d-ac8d-5959a48ab04d] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:09:21.886587 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0b199914-0d6d-46a1-ae4c-a8097ed8a2a7 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:21.889697 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0b199914-0d6d-46a1-ae4c-a8097ed8a2a7 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:21.894773 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0b199914-0d6d-46a1-ae4c-a8097ed8a2a7 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:21.896717 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0b199914-0d6d-46a1-ae4c-a8097ed8a2a7 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:21.930003 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-0b199914-0d6d-46a1-ae4c-a8097ed8a2a7 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] HTTP exception thrown: Instance 25f2d43f-7008-4b4d-ac8d-5959a48ab04d could not be found. Jan 15 21:09:21.931104 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0b199914-0d6d-46a1-ae4c-a8097ed8a2a7 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Returning 404 to user: Instance 25f2d43f-7008-4b4d-ac8d-5959a48ab04d could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:09:21.933859 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0b199914-0d6d-46a1-ae4c-a8097ed8a2a7 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] 10.222.0.46 "GET /compute/v2.1/servers/25f2d43f-7008-4b4d-ac8d-5959a48ab04d" status: 404 len: 111 microversion: 2.1 time: 0.066477 Jan 15 21:09:21.934199 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2940/5872] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:09:21 2022] GET /compute/v2.1/servers/25f2d43f-7008-4b4d-ac8d-5959a48ab04d => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:09:21.950866 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0f1f3b80-6486-4325-9e86-98fa52c367d4 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:09:21.951848 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-0f1f3b80-6486-4325-9e86-98fa52c367d4 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] [instance: 6ad265d9-74dd-44bc-80d0-3a10870684e0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:09:21.965279 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0f1f3b80-6486-4325-9e86-98fa52c367d4 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:21.966730 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0f1f3b80-6486-4325-9e86-98fa52c367d4 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:21.967794 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0f1f3b80-6486-4325-9e86-98fa52c367d4 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:21.968481 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0f1f3b80-6486-4325-9e86-98fa52c367d4 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:22.022907 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-0f1f3b80-6486-4325-9e86-98fa52c367d4 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] [instance: 6ad265d9-74dd-44bc-80d0-3a10870684e0] Going to try to terminate instance {{(pid=129366) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 21:09:22.173743 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0f1f3b80-6486-4325-9e86-98fa52c367d4 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] 10.222.0.46 "DELETE /compute/v2.1/servers/6ad265d9-74dd-44bc-80d0-3a10870684e0" status: 204 len: 0 microversion: 2.1 time: 0.226395 Jan 15 21:09:22.177936 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2941/5873] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 21:09:21 2022] DELETE /compute/v2.1/servers/6ad265d9-74dd-44bc-80d0-3a10870684e0 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 21:09:22.195374 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-da5c19a7-e1c2-4300-8871-4489e08c6413 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:09:22.196961 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-da5c19a7-e1c2-4300-8871-4489e08c6413 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] [instance: 6ad265d9-74dd-44bc-80d0-3a10870684e0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:09:22.215286 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-da5c19a7-e1c2-4300-8871-4489e08c6413 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:22.217127 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-da5c19a7-e1c2-4300-8871-4489e08c6413 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:22.221747 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-da5c19a7-e1c2-4300-8871-4489e08c6413 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:22.222443 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-da5c19a7-e1c2-4300-8871-4489e08c6413 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:22.756717 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-711b238f-1308-4b9c-b066-67d8107d1a0f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:09:22.762470 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-da5c19a7-e1c2-4300-8871-4489e08c6413 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6809a212fcc4730a3a30c81e8485ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d727625d6eb47febd54a3f4071bb7c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:09:22.770934 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-da5c19a7-e1c2-4300-8871-4489e08c6413 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] 10.222.0.46 "GET /compute/v2.1/servers/6ad265d9-74dd-44bc-80d0-3a10870684e0" status: 200 len: 1516 microversion: 2.1 time: 0.588519 Jan 15 21:09:22.772798 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-711b238f-1308-4b9c-b066-67d8107d1a0f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:09:22.774910 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2942/5874] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:09:22 2022] GET /compute/v2.1/servers/6ad265d9-74dd-44bc-80d0-3a10870684e0 => generated 1516 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:09:22.776714 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-711b238f-1308-4b9c-b066-67d8107d1a0f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:09:22.791150 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-711b238f-1308-4b9c-b066-67d8107d1a0f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "GET /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220" status: 200 len: 2374 microversion: 2.32 time: 1.008388 Jan 15 21:09:22.797314 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2933/5875] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:09:21 2022] GET /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220 => generated 2374 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:09:23.050175 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-3f44bf2e-2926-4b9e-a383-4bc7b9ae033b req-9fa517ca-c42a-4ffb-8fcd-92c6cb834022 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25f2d43f-7008-4b4d-ac8d-5959a48ab04d", "name": "network-vif-deleted", "tag": "ff65d28b-c16d-4f12-aa41-9bb138a73168"}, {"server_uuid": "686aa731-082f-4584-8607-5a40f0d63220", "name": "network-vif-deleted", "tag": "64cf49a0-1762-46ea-8738-821b466cb2c9"}, {"server_uuid": "686aa731-082f-4584-8607-5a40f0d63220", "name": "network-vif-deleted", "tag": "9f31cf46-d654-4aef-ada4-dab1fc37d328"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:09:23.052660 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:09:23.052660 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:09:23.075066 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-3f44bf2e-2926-4b9e-a383-4bc7b9ae033b req-9fa517ca-c42a-4ffb-8fcd-92c6cb834022 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:23.075695 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-3f44bf2e-2926-4b9e-a383-4bc7b9ae033b req-9fa517ca-c42a-4ffb-8fcd-92c6cb834022 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:23.132401 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-3f44bf2e-2926-4b9e-a383-4bc7b9ae033b req-9fa517ca-c42a-4ffb-8fcd-92c6cb834022 service nova] Creating event network-vif-deleted:ff65d28b-c16d-4f12-aa41-9bb138a73168 for instance 25f2d43f-7008-4b4d-ac8d-5959a48ab04d on nch1-master-1 Jan 15 21:09:23.134433 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-3f44bf2e-2926-4b9e-a383-4bc7b9ae033b req-9fa517ca-c42a-4ffb-8fcd-92c6cb834022 service nova] Creating event network-vif-deleted:64cf49a0-1762-46ea-8738-821b466cb2c9 for instance 686aa731-082f-4584-8607-5a40f0d63220 on nch1-master-1 Jan 15 21:09:23.134936 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-3f44bf2e-2926-4b9e-a383-4bc7b9ae033b req-9fa517ca-c42a-4ffb-8fcd-92c6cb834022 service nova] Creating event network-vif-deleted:9f31cf46-d654-4aef-ada4-dab1fc37d328 for instance 686aa731-082f-4584-8607-5a40f0d63220 on nch1-master-1 Jan 15 21:09:23.152108 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-3f44bf2e-2926-4b9e-a383-4bc7b9ae033b req-9fa517ca-c42a-4ffb-8fcd-92c6cb834022 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.107848 Jan 15 21:09:23.153976 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2943/5876] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:09:23 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:09:23.788157 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b0dba06b-95b6-47c7-a7c7-5122cfd3d5b4 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:09:23.788359 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b0dba06b-95b6-47c7-a7c7-5122cfd3d5b4 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] [instance: 6ad265d9-74dd-44bc-80d0-3a10870684e0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:09:23.798893 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b0dba06b-95b6-47c7-a7c7-5122cfd3d5b4 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:23.799504 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b0dba06b-95b6-47c7-a7c7-5122cfd3d5b4 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:23.800427 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b0dba06b-95b6-47c7-a7c7-5122cfd3d5b4 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:23.802327 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b0dba06b-95b6-47c7-a7c7-5122cfd3d5b4 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:23.811464 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0e3be5d2-0cd0-434e-bd27-ac9e81a0a19f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:09:23.812369 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-0e3be5d2-0cd0-434e-bd27-ac9e81a0a19f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:09:23.825409 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0e3be5d2-0cd0-434e-bd27-ac9e81a0a19f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:23.826071 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0e3be5d2-0cd0-434e-bd27-ac9e81a0a19f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:23.827151 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0e3be5d2-0cd0-434e-bd27-ac9e81a0a19f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:23.833342 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0e3be5d2-0cd0-434e-bd27-ac9e81a0a19f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:24.119685 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-0e3be5d2-0cd0-434e-bd27-ac9e81a0a19f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:09:24.142059 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-0e3be5d2-0cd0-434e-bd27-ac9e81a0a19f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:09:24.149345 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-0e3be5d2-0cd0-434e-bd27-ac9e81a0a19f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f11dc7a8a21449b1b7de146145d51ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b36b007e8a9409783a549b87017c8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:09:24.150773 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0e3be5d2-0cd0-434e-bd27-ac9e81a0a19f tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "GET /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220" status: 200 len: 1603 microversion: 2.32 time: 0.343955 Jan 15 21:09:24.151354 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2944/5877] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:09:23 2022] GET /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220 => generated 1603 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 15 21:09:24.532261 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-b0dba06b-95b6-47c7-a7c7-5122cfd3d5b4 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6809a212fcc4730a3a30c81e8485ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d727625d6eb47febd54a3f4071bb7c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:09:24.543907 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b0dba06b-95b6-47c7-a7c7-5122cfd3d5b4 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] 10.222.0.46 "GET /compute/v2.1/servers/6ad265d9-74dd-44bc-80d0-3a10870684e0" status: 200 len: 1516 microversion: 2.1 time: 0.759457 Jan 15 21:09:24.547722 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2934/5878] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:09:23 2022] GET /compute/v2.1/servers/6ad265d9-74dd-44bc-80d0-3a10870684e0 => generated 1516 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:09:25.175383 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-192a204d-7554-4cc2-b26b-0582a83fd40e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:09:25.176184 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-192a204d-7554-4cc2-b26b-0582a83fd40e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:09:25.184076 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-192a204d-7554-4cc2-b26b-0582a83fd40e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:25.184537 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-192a204d-7554-4cc2-b26b-0582a83fd40e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:25.185361 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-192a204d-7554-4cc2-b26b-0582a83fd40e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:25.185793 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-192a204d-7554-4cc2-b26b-0582a83fd40e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:25.190484 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-5b3164d3-a71e-4f76-99ea-7caa21d6f80e req-8e1cbf21-333d-4538-88fb-21e1fdf28edb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "686aa731-082f-4584-8607-5a40f0d63220", "name": "network-vif-deleted", "tag": "a63ec384-e15d-441f-b027-6fb09676099b"}, {"server_uuid": "6ad265d9-74dd-44bc-80d0-3a10870684e0", "name": "network-vif-deleted", "tag": "05b918a9-ba4e-497c-b753-eb391f56ed6d"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:09:25.193560 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:09:25.193560 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:09:25.208160 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-5b3164d3-a71e-4f76-99ea-7caa21d6f80e req-8e1cbf21-333d-4538-88fb-21e1fdf28edb service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:25.209177 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-5b3164d3-a71e-4f76-99ea-7caa21d6f80e req-8e1cbf21-333d-4538-88fb-21e1fdf28edb service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:25.217495 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-192a204d-7554-4cc2-b26b-0582a83fd40e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] HTTP exception thrown: Instance 686aa731-082f-4584-8607-5a40f0d63220 could not be found. Jan 15 21:09:25.218115 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-192a204d-7554-4cc2-b26b-0582a83fd40e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Returning 404 to user: Instance 686aa731-082f-4584-8607-5a40f0d63220 could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:09:25.218997 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-192a204d-7554-4cc2-b26b-0582a83fd40e tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "GET /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220" status: 404 len: 111 microversion: 2.32 time: 0.051793 Jan 15 21:09:25.236757 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2945/5879] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:09:25 2022] GET /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 15 21:09:25.248247 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-5b3164d3-a71e-4f76-99ea-7caa21d6f80e req-8e1cbf21-333d-4538-88fb-21e1fdf28edb service nova] Creating event network-vif-deleted:a63ec384-e15d-441f-b027-6fb09676099b for instance 686aa731-082f-4584-8607-5a40f0d63220 on nch1-master-1 Jan 15 21:09:25.249318 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-5b3164d3-a71e-4f76-99ea-7caa21d6f80e req-8e1cbf21-333d-4538-88fb-21e1fdf28edb service nova] Creating event network-vif-deleted:05b918a9-ba4e-497c-b753-eb391f56ed6d for instance 6ad265d9-74dd-44bc-80d0-3a10870684e0 on nch2-master-1 Jan 15 21:09:25.250513 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-92911ff9-a132-45e9-9a13-0f31f4a8485a tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Calling method '.version_select at 0x7f30c90e1040>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:09:25.269645 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-5b3164d3-a71e-4f76-99ea-7caa21d6f80e req-8e1cbf21-333d-4538-88fb-21e1fdf28edb service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.087781 Jan 15 21:09:25.270484 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2935/5880] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:09:25 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 21:09:25.288331 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-92911ff9-a132-45e9-9a13-0f31f4a8485a tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-16403008" status: 204 len: 0 microversion: 2.32 time: 0.049286 Jan 15 21:09:25.293518 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2946/5881] 10.222.0.46 () {60 vars in 1255 bytes} [Sat Jan 15 21:09:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-16403008 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 15 21:09:25.568577 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-55531c51-4690-4add-aef8-e701b0bc2629 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:09:25.569722 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-55531c51-4690-4add-aef8-e701b0bc2629 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] [instance: 6ad265d9-74dd-44bc-80d0-3a10870684e0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:09:25.582798 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-55531c51-4690-4add-aef8-e701b0bc2629 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:25.583575 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-55531c51-4690-4add-aef8-e701b0bc2629 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:25.585156 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-55531c51-4690-4add-aef8-e701b0bc2629 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:25.586842 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-55531c51-4690-4add-aef8-e701b0bc2629 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:25.618829 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-55531c51-4690-4add-aef8-e701b0bc2629 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] HTTP exception thrown: Instance 6ad265d9-74dd-44bc-80d0-3a10870684e0 could not be found. Jan 15 21:09:25.621345 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-55531c51-4690-4add-aef8-e701b0bc2629 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Returning 404 to user: Instance 6ad265d9-74dd-44bc-80d0-3a10870684e0 could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:09:25.624295 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-55531c51-4690-4add-aef8-e701b0bc2629 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] 10.222.0.46 "GET /compute/v2.1/servers/6ad265d9-74dd-44bc-80d0-3a10870684e0" status: 404 len: 111 microversion: 2.1 time: 0.061721 Jan 15 21:09:25.625072 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2936/5882] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:09:25 2022] GET /compute/v2.1/servers/6ad265d9-74dd-44bc-80d0-3a10870684e0 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:09:25.644299 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e4b3797d-7672-4328-8b99-106dc5daa55c tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:09:25.644855 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e4b3797d-7672-4328-8b99-106dc5daa55c tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] [instance: 827235d8-4a51-49b0-af9e-f45e37bcf762] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:09:25.655778 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e4b3797d-7672-4328-8b99-106dc5daa55c tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:25.656254 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e4b3797d-7672-4328-8b99-106dc5daa55c tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:25.660518 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e4b3797d-7672-4328-8b99-106dc5daa55c tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:25.661088 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e4b3797d-7672-4328-8b99-106dc5daa55c tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:25.731078 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e4b3797d-7672-4328-8b99-106dc5daa55c tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] [instance: 827235d8-4a51-49b0-af9e-f45e37bcf762] Going to try to terminate instance {{(pid=129366) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 21:09:25.918069 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e4b3797d-7672-4328-8b99-106dc5daa55c tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] 10.222.0.46 "DELETE /compute/v2.1/servers/827235d8-4a51-49b0-af9e-f45e37bcf762" status: 204 len: 0 microversion: 2.1 time: 0.287644 Jan 15 21:09:25.918983 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2947/5883] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 21:09:25 2022] DELETE /compute/v2.1/servers/827235d8-4a51-49b0-af9e-f45e37bcf762 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 15 21:09:25.928014 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-4591a91f-5c2b-4a7a-be71-a907a390bb00 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:09:25.928833 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-4591a91f-5c2b-4a7a-be71-a907a390bb00 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] [instance: 827235d8-4a51-49b0-af9e-f45e37bcf762] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:09:25.939585 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4591a91f-5c2b-4a7a-be71-a907a390bb00 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:25.942232 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4591a91f-5c2b-4a7a-be71-a907a390bb00 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:25.943218 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4591a91f-5c2b-4a7a-be71-a907a390bb00 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:25.946598 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4591a91f-5c2b-4a7a-be71-a907a390bb00 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:26.833012 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-4591a91f-5c2b-4a7a-be71-a907a390bb00 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6809a212fcc4730a3a30c81e8485ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d727625d6eb47febd54a3f4071bb7c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:09:26.846863 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-4591a91f-5c2b-4a7a-be71-a907a390bb00 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] 10.222.0.46 "GET /compute/v2.1/servers/827235d8-4a51-49b0-af9e-f45e37bcf762" status: 200 len: 1516 microversion: 2.1 time: 0.923240 Jan 15 21:09:26.848940 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2937/5884] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:09:25 2022] GET /compute/v2.1/servers/827235d8-4a51-49b0-af9e-f45e37bcf762 => generated 1516 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:09:27.866499 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-2bdbd949-35ac-4e86-8872-a13a895e5f58 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:09:27.868037 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-2bdbd949-35ac-4e86-8872-a13a895e5f58 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] [instance: 827235d8-4a51-49b0-af9e-f45e37bcf762] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:09:27.877677 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2bdbd949-35ac-4e86-8872-a13a895e5f58 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:27.878470 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2bdbd949-35ac-4e86-8872-a13a895e5f58 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:27.879554 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2bdbd949-35ac-4e86-8872-a13a895e5f58 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:27.880708 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2bdbd949-35ac-4e86-8872-a13a895e5f58 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:28.300583 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-2bdbd949-35ac-4e86-8872-a13a895e5f58 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6809a212fcc4730a3a30c81e8485ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d727625d6eb47febd54a3f4071bb7c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:09:28.310172 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-2bdbd949-35ac-4e86-8872-a13a895e5f58 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] 10.222.0.46 "GET /compute/v2.1/servers/827235d8-4a51-49b0-af9e-f45e37bcf762" status: 200 len: 1516 microversion: 2.1 time: 0.449772 Jan 15 21:09:28.311043 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2948/5885] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:09:27 2022] GET /compute/v2.1/servers/827235d8-4a51-49b0-af9e-f45e37bcf762 => generated 1516 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:09:28.722258 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-12af485b-fcad-4b07-be4e-89cc77ea33e1 req-0453f877-0274-4321-8939-deeffbbc16bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "827235d8-4a51-49b0-af9e-f45e37bcf762", "name": "network-vif-deleted", "tag": "f3be8950-449a-4055-b53b-ad46640f964d"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:09:28.723866 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:09:28.723866 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:09:28.755388 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-12af485b-fcad-4b07-be4e-89cc77ea33e1 req-0453f877-0274-4321-8939-deeffbbc16bc service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:28.756340 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-12af485b-fcad-4b07-be4e-89cc77ea33e1 req-0453f877-0274-4321-8939-deeffbbc16bc service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:28.784722 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-12af485b-fcad-4b07-be4e-89cc77ea33e1 req-0453f877-0274-4321-8939-deeffbbc16bc service nova] Creating event network-vif-deleted:f3be8950-449a-4055-b53b-ad46640f964d for instance 827235d8-4a51-49b0-af9e-f45e37bcf762 on nch1-master-1 Jan 15 21:09:28.810929 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-12af485b-fcad-4b07-be4e-89cc77ea33e1 req-0453f877-0274-4321-8939-deeffbbc16bc service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092281 Jan 15 21:09:28.811909 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2938/5886] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:09:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:09:29.328301 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-648e4cf1-0d75-483b-9e0d-7aab24409585 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:09:29.329745 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-648e4cf1-0d75-483b-9e0d-7aab24409585 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] [instance: 827235d8-4a51-49b0-af9e-f45e37bcf762] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:09:29.347478 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-648e4cf1-0d75-483b-9e0d-7aab24409585 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:29.348189 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-648e4cf1-0d75-483b-9e0d-7aab24409585 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:29.349287 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-648e4cf1-0d75-483b-9e0d-7aab24409585 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:29.349964 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-648e4cf1-0d75-483b-9e0d-7aab24409585 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:29.447002 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-648e4cf1-0d75-483b-9e0d-7aab24409585 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:29.447449 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-648e4cf1-0d75-483b-9e0d-7aab24409585 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:29.455805 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.objects.instance [None req-648e4cf1-0d75-483b-9e0d-7aab24409585 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lazy-loading 'fault' on Instance uuid 827235d8-4a51-49b0-af9e-f45e37bcf762 {{(pid=129366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 21:09:29.643804 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-648e4cf1-0d75-483b-9e0d-7aab24409585 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6809a212fcc4730a3a30c81e8485ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d727625d6eb47febd54a3f4071bb7c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:09:29.658104 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-648e4cf1-0d75-483b-9e0d-7aab24409585 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] 10.222.0.46 "GET /compute/v2.1/servers/827235d8-4a51-49b0-af9e-f45e37bcf762" status: 200 len: 1310 microversion: 2.1 time: 0.333310 Jan 15 21:09:29.658698 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2949/5887] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:09:29 2022] GET /compute/v2.1/servers/827235d8-4a51-49b0-af9e-f45e37bcf762 => generated 1310 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:09:30.677706 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-fb7a48b8-647e-4549-b898-bf36df0803e0 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:09:30.678439 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-fb7a48b8-647e-4549-b898-bf36df0803e0 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] [instance: 827235d8-4a51-49b0-af9e-f45e37bcf762] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:09:30.697762 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fb7a48b8-647e-4549-b898-bf36df0803e0 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:30.698440 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fb7a48b8-647e-4549-b898-bf36df0803e0 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:30.699407 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fb7a48b8-647e-4549-b898-bf36df0803e0 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:30.699853 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fb7a48b8-647e-4549-b898-bf36df0803e0 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:30.716369 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-fb7a48b8-647e-4549-b898-bf36df0803e0 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] HTTP exception thrown: Instance 827235d8-4a51-49b0-af9e-f45e37bcf762 could not be found. Jan 15 21:09:30.726807 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-fb7a48b8-647e-4549-b898-bf36df0803e0 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] Returning 404 to user: Instance 827235d8-4a51-49b0-af9e-f45e37bcf762 could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:09:30.728024 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-fb7a48b8-647e-4549-b898-bf36df0803e0 tempest-ListServerFiltersTestJSON-889084796 tempest-ListServerFiltersTestJSON-889084796-project] 10.222.0.46 "GET /compute/v2.1/servers/827235d8-4a51-49b0-af9e-f45e37bcf762" status: 404 len: 111 microversion: 2.1 time: 0.056222 Jan 15 21:09:30.728763 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2939/5888] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:09:30 2022] GET /compute/v2.1/servers/827235d8-4a51-49b0-af9e-f45e37bcf762 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:09:31.530069 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-6c720cb3-e001-4621-a047-ec82a519d3e4 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:09:31.531557 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-6c720cb3-e001-4621-a047-ec82a519d3e4 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:09:31.548128 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6c720cb3-e001-4621-a047-ec82a519d3e4 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:31.548802 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6c720cb3-e001-4621-a047-ec82a519d3e4 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:31.550162 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6c720cb3-e001-4621-a047-ec82a519d3e4 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:31.558319 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6c720cb3-e001-4621-a047-ec82a519d3e4 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:31.600756 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-6c720cb3-e001-4621-a047-ec82a519d3e4 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] HTTP exception thrown: Instance 686aa731-082f-4584-8607-5a40f0d63220 could not be found. Jan 15 21:09:31.602431 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-6c720cb3-e001-4621-a047-ec82a519d3e4 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Returning 404 to user: Instance 686aa731-082f-4584-8607-5a40f0d63220 could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:09:31.604207 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-6c720cb3-e001-4621-a047-ec82a519d3e4 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "DELETE /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220" status: 404 len: 111 microversion: 2.32 time: 0.080130 Jan 15 21:09:31.606260 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2950/5889] 10.222.0.46 () {60 vars in 1279 bytes} [Sat Jan 15 21:09:31 2022] DELETE /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 15 21:09:31.613937 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e28d8cc6-43ff-4005-87cd-4d314636c664 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:09:31.614545 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e28d8cc6-43ff-4005-87cd-4d314636c664 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] [instance: 686aa731-082f-4584-8607-5a40f0d63220] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:09:31.620784 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e28d8cc6-43ff-4005-87cd-4d314636c664 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:31.621549 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e28d8cc6-43ff-4005-87cd-4d314636c664 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:31.622507 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e28d8cc6-43ff-4005-87cd-4d314636c664 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:31.623105 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e28d8cc6-43ff-4005-87cd-4d314636c664 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:31.644324 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-e28d8cc6-43ff-4005-87cd-4d314636c664 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] HTTP exception thrown: Instance 686aa731-082f-4584-8607-5a40f0d63220 could not be found. Jan 15 21:09:31.644951 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e28d8cc6-43ff-4005-87cd-4d314636c664 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] Returning 404 to user: Instance 686aa731-082f-4584-8607-5a40f0d63220 could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:09:31.645852 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e28d8cc6-43ff-4005-87cd-4d314636c664 tempest-TaggedBootDevicesTest-1219595898 tempest-TaggedBootDevicesTest-1219595898-project] 10.222.0.46 "GET /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220" status: 404 len: 111 microversion: 2.32 time: 0.035785 Jan 15 21:09:31.646643 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2940/5890] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:09:31 2022] GET /compute/v2.1/servers/686aa731-082f-4584-8607-5a40f0d63220 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 15 21:09:44.742953 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-55ae7e46-cae6-4756-8db3-9c0e44346e53 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1814503910", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "networks": [{"uuid": "2fa5a3aa-4ace-46fa-b2bd-304536abb207"}]}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:09:44.820957 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.network.neutron [None req-55ae7e46-cae6-4756-8db3-9c0e44346e53 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] validate_networks() for [('2fa5a3aa-4ace-46fa-b2bd-304536abb207', None, None, None, None, None)] {{(pid=129366) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 21:09:45.817092 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-55ae7e46-cae6-4756-8db3-9c0e44346e53 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Flavor limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 21:09:45.817690 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-55ae7e46-cae6-4756-8db3-9c0e44346e53 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Image limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 21:09:45.819296 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-55ae7e46-cae6-4756-8db3-9c0e44346e53 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Flavor pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 21:09:45.820200 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-55ae7e46-cae6-4756-8db3-9c0e44346e53 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Image pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 21:09:45.820701 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-55ae7e46-cae6-4756-8db3-9c0e44346e53 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 21:09:45.838853 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-55ae7e46-cae6-4756-8db3-9c0e44346e53 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:45.839664 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-55ae7e46-cae6-4756-8db3-9c0e44346e53 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:45.840611 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-55ae7e46-cae6-4756-8db3-9c0e44346e53 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:45.841223 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-55ae7e46-cae6-4756-8db3-9c0e44346e53 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:45.870924 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-55ae7e46-cae6-4756-8db3-9c0e44346e53 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Getting quotas for project 07c8dd6789ba45a7a04452dc080a37cf. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:09:45.878524 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-55ae7e46-cae6-4756-8db3-9c0e44346e53 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Getting quotas for user a8117ed926ac40dbbdcbca53cd668c41 and project 07c8dd6789ba45a7a04452dc080a37cf. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:09:45.904390 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-55ae7e46-cae6-4756-8db3-9c0e44346e53 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Going to run 1 instances... {{(pid=129366) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 21:09:45.924431 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-55ae7e46-cae6-4756-8db3-9c0e44346e53 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] [instance: a908b8d0-88c5-44e7-920a-1d9f54de7cb1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 21:09:46.021805 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-55ae7e46-cae6-4756-8db3-9c0e44346e53 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.282654 Jan 15 21:09:46.026051 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2951/5891] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 21:09:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1287 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 21:09:46.038766 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-371be0dd-5b7c-40c5-99c6-5a96217e6ff0 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:09:46.039528 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-371be0dd-5b7c-40c5-99c6-5a96217e6ff0 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] [instance: a908b8d0-88c5-44e7-920a-1d9f54de7cb1] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:09:46.174390 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-371be0dd-5b7c-40c5-99c6-5a96217e6ff0 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8117ed926ac40dbbdcbca53cd668c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c8dd6789ba45a7a04452dc080a37cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:09:46.186009 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-371be0dd-5b7c-40c5-99c6-5a96217e6ff0 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] 10.222.0.46 "GET /compute/v2.1/servers/a908b8d0-88c5-44e7-920a-1d9f54de7cb1" status: 200 len: 1214 microversion: 2.1 time: 0.153754 Jan 15 21:09:46.189593 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2941/5892] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:09:46 2022] GET /compute/v2.1/servers/a908b8d0-88c5-44e7-920a-1d9f54de7cb1 => generated 1214 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:09:47.209021 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-3ae756e9-95fa-4066-be1f-8a7695bb7b7e tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:09:47.209649 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-3ae756e9-95fa-4066-be1f-8a7695bb7b7e tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] [instance: a908b8d0-88c5-44e7-920a-1d9f54de7cb1] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:09:47.232002 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3ae756e9-95fa-4066-be1f-8a7695bb7b7e tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:47.232475 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3ae756e9-95fa-4066-be1f-8a7695bb7b7e tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:47.233328 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3ae756e9-95fa-4066-be1f-8a7695bb7b7e tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:47.234967 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3ae756e9-95fa-4066-be1f-8a7695bb7b7e tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:47.397404 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-3ae756e9-95fa-4066-be1f-8a7695bb7b7e tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8117ed926ac40dbbdcbca53cd668c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c8dd6789ba45a7a04452dc080a37cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:09:47.405470 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-3ae756e9-95fa-4066-be1f-8a7695bb7b7e tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] 10.222.0.46 "GET /compute/v2.1/servers/a908b8d0-88c5-44e7-920a-1d9f54de7cb1" status: 200 len: 1266 microversion: 2.1 time: 0.202677 Jan 15 21:09:47.406720 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2952/5893] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:09:47 2022] GET /compute/v2.1/servers/a908b8d0-88c5-44e7-920a-1d9f54de7cb1 => generated 1266 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:09:48.431822 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e227288e-0bfb-4d34-a842-829c634efd81 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:09:48.433380 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e227288e-0bfb-4d34-a842-829c634efd81 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] [instance: a908b8d0-88c5-44e7-920a-1d9f54de7cb1] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:09:48.449571 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e227288e-0bfb-4d34-a842-829c634efd81 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:48.450036 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e227288e-0bfb-4d34-a842-829c634efd81 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:48.454040 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e227288e-0bfb-4d34-a842-829c634efd81 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:48.454538 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e227288e-0bfb-4d34-a842-829c634efd81 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:48.665789 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-e227288e-0bfb-4d34-a842-829c634efd81 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8117ed926ac40dbbdcbca53cd668c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c8dd6789ba45a7a04452dc080a37cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:09:48.679693 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e227288e-0bfb-4d34-a842-829c634efd81 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] 10.222.0.46 "GET /compute/v2.1/servers/a908b8d0-88c5-44e7-920a-1d9f54de7cb1" status: 200 len: 1272 microversion: 2.1 time: 0.260162 Jan 15 21:09:48.680307 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2942/5894] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:09:48 2022] GET /compute/v2.1/servers/a908b8d0-88c5-44e7-920a-1d9f54de7cb1 => generated 1272 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:09:49.699675 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-440378b0-41ca-4d27-9639-2f7489644c93 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:09:49.701105 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-440378b0-41ca-4d27-9639-2f7489644c93 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] [instance: a908b8d0-88c5-44e7-920a-1d9f54de7cb1] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:09:49.714984 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-440378b0-41ca-4d27-9639-2f7489644c93 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:49.720439 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-440378b0-41ca-4d27-9639-2f7489644c93 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:49.721619 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-440378b0-41ca-4d27-9639-2f7489644c93 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:49.724605 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-440378b0-41ca-4d27-9639-2f7489644c93 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:50.447155 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-440378b0-41ca-4d27-9639-2f7489644c93 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8117ed926ac40dbbdcbca53cd668c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c8dd6789ba45a7a04452dc080a37cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:09:50.456350 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-440378b0-41ca-4d27-9639-2f7489644c93 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] 10.222.0.46 "GET /compute/v2.1/servers/a908b8d0-88c5-44e7-920a-1d9f54de7cb1" status: 200 len: 1314 microversion: 2.1 time: 0.762970 Jan 15 21:09:50.457729 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2953/5895] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:09:49 2022] GET /compute/v2.1/servers/a908b8d0-88c5-44e7-920a-1d9f54de7cb1 => generated 1314 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:09:51.474822 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b60bd0bc-3a49-4760-8939-e5aa8692912e tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:09:51.475957 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b60bd0bc-3a49-4760-8939-e5aa8692912e tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] [instance: a908b8d0-88c5-44e7-920a-1d9f54de7cb1] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:09:51.484230 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b60bd0bc-3a49-4760-8939-e5aa8692912e tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:51.484696 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b60bd0bc-3a49-4760-8939-e5aa8692912e tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:51.485515 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b60bd0bc-3a49-4760-8939-e5aa8692912e tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:51.485956 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b60bd0bc-3a49-4760-8939-e5aa8692912e tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:51.821687 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-b60bd0bc-3a49-4760-8939-e5aa8692912e tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8117ed926ac40dbbdcbca53cd668c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c8dd6789ba45a7a04452dc080a37cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:09:51.833276 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b60bd0bc-3a49-4760-8939-e5aa8692912e tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] 10.222.0.46 "GET /compute/v2.1/servers/a908b8d0-88c5-44e7-920a-1d9f54de7cb1" status: 200 len: 1314 microversion: 2.1 time: 0.361524 Jan 15 21:09:51.848090 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2943/5896] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:09:51 2022] GET /compute/v2.1/servers/a908b8d0-88c5-44e7-920a-1d9f54de7cb1 => generated 1314 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:09:52.123556 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-8bc7a52e-176e-42cb-816c-b10928a1f807 req-8df6c953-97be-4fdf-97a9-58f6f8467589 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a908b8d0-88c5-44e7-920a-1d9f54de7cb1", "tag": "0ec24633-6357-4924-9ce3-f732c91c179a"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:09:52.125324 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:09:52.125324 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:09:52.141401 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-8bc7a52e-176e-42cb-816c-b10928a1f807 req-8df6c953-97be-4fdf-97a9-58f6f8467589 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:52.141839 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-8bc7a52e-176e-42cb-816c-b10928a1f807 req-8df6c953-97be-4fdf-97a9-58f6f8467589 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:52.161511 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-8bc7a52e-176e-42cb-816c-b10928a1f807 req-8df6c953-97be-4fdf-97a9-58f6f8467589 service nova] Creating event network-changed:0ec24633-6357-4924-9ce3-f732c91c179a for instance a908b8d0-88c5-44e7-920a-1d9f54de7cb1 on nch2-master-1 Jan 15 21:09:52.178663 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-8bc7a52e-176e-42cb-816c-b10928a1f807 req-8df6c953-97be-4fdf-97a9-58f6f8467589 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059082 Jan 15 21:09:52.179589 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2954/5897] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:09:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:09:52.853830 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-107b1db7-6d3e-4656-9be0-c3b72a06c622 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:09:52.855230 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-107b1db7-6d3e-4656-9be0-c3b72a06c622 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] [instance: a908b8d0-88c5-44e7-920a-1d9f54de7cb1] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:09:52.864523 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-107b1db7-6d3e-4656-9be0-c3b72a06c622 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:52.865357 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-107b1db7-6d3e-4656-9be0-c3b72a06c622 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:52.866907 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-107b1db7-6d3e-4656-9be0-c3b72a06c622 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:52.867734 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-107b1db7-6d3e-4656-9be0-c3b72a06c622 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:53.139024 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-107b1db7-6d3e-4656-9be0-c3b72a06c622 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8117ed926ac40dbbdcbca53cd668c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c8dd6789ba45a7a04452dc080a37cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:09:53.147199 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-107b1db7-6d3e-4656-9be0-c3b72a06c622 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] 10.222.0.46 "GET /compute/v2.1/servers/a908b8d0-88c5-44e7-920a-1d9f54de7cb1" status: 200 len: 1314 microversion: 2.1 time: 0.297562 Jan 15 21:09:53.151047 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2944/5898] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:09:52 2022] GET /compute/v2.1/servers/a908b8d0-88c5-44e7-920a-1d9f54de7cb1 => generated 1314 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:09:54.173070 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d69c989b-cf71-496b-9b33-fa4f06193e97 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:09:54.175115 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-d69c989b-cf71-496b-9b33-fa4f06193e97 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] [instance: a908b8d0-88c5-44e7-920a-1d9f54de7cb1] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:09:54.191077 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d69c989b-cf71-496b-9b33-fa4f06193e97 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:54.191536 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d69c989b-cf71-496b-9b33-fa4f06193e97 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:54.192371 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d69c989b-cf71-496b-9b33-fa4f06193e97 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:54.192814 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d69c989b-cf71-496b-9b33-fa4f06193e97 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:54.380624 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-d69c989b-cf71-496b-9b33-fa4f06193e97 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8117ed926ac40dbbdcbca53cd668c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c8dd6789ba45a7a04452dc080a37cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:09:54.392303 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d69c989b-cf71-496b-9b33-fa4f06193e97 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] 10.222.0.46 "GET /compute/v2.1/servers/a908b8d0-88c5-44e7-920a-1d9f54de7cb1" status: 200 len: 1314 microversion: 2.1 time: 0.225081 Jan 15 21:09:54.393222 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2955/5899] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:09:54 2022] GET /compute/v2.1/servers/a908b8d0-88c5-44e7-920a-1d9f54de7cb1 => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:09:55.410785 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a6dde88c-549b-4348-9d1b-fb1f2222f4ff tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:09:55.412077 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a6dde88c-549b-4348-9d1b-fb1f2222f4ff tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] [instance: a908b8d0-88c5-44e7-920a-1d9f54de7cb1] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:09:55.421252 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a6dde88c-549b-4348-9d1b-fb1f2222f4ff tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:55.422039 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a6dde88c-549b-4348-9d1b-fb1f2222f4ff tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:55.423257 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a6dde88c-549b-4348-9d1b-fb1f2222f4ff tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:55.423959 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a6dde88c-549b-4348-9d1b-fb1f2222f4ff tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:55.660261 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-a6dde88c-549b-4348-9d1b-fb1f2222f4ff tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8117ed926ac40dbbdcbca53cd668c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c8dd6789ba45a7a04452dc080a37cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:09:55.668775 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a6dde88c-549b-4348-9d1b-fb1f2222f4ff tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] 10.222.0.46 "GET /compute/v2.1/servers/a908b8d0-88c5-44e7-920a-1d9f54de7cb1" status: 200 len: 1314 microversion: 2.1 time: 0.261883 Jan 15 21:09:55.672070 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2945/5900] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:09:55 2022] GET /compute/v2.1/servers/a908b8d0-88c5-44e7-920a-1d9f54de7cb1 => generated 1314 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:09:56.690314 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0ef1c2a7-327d-40cc-9037-bd77d5f78ee4 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:09:56.694085 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-0ef1c2a7-327d-40cc-9037-bd77d5f78ee4 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] [instance: a908b8d0-88c5-44e7-920a-1d9f54de7cb1] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:09:56.709891 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0ef1c2a7-327d-40cc-9037-bd77d5f78ee4 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:56.710776 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0ef1c2a7-327d-40cc-9037-bd77d5f78ee4 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:56.711771 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0ef1c2a7-327d-40cc-9037-bd77d5f78ee4 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:56.714220 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0ef1c2a7-327d-40cc-9037-bd77d5f78ee4 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:57.122978 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-0ef1c2a7-327d-40cc-9037-bd77d5f78ee4 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8117ed926ac40dbbdcbca53cd668c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c8dd6789ba45a7a04452dc080a37cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:09:57.140303 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0ef1c2a7-327d-40cc-9037-bd77d5f78ee4 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] 10.222.0.46 "GET /compute/v2.1/servers/a908b8d0-88c5-44e7-920a-1d9f54de7cb1" status: 200 len: 1314 microversion: 2.1 time: 0.454873 Jan 15 21:09:57.144017 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2956/5901] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:09:56 2022] GET /compute/v2.1/servers/a908b8d0-88c5-44e7-920a-1d9f54de7cb1 => generated 1314 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:09:57.843450 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f6f69fb7-df5c-4104-a7e2-5d4029ad86bc tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-216519998", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "networks": [{"uuid": "9e601050-ec11-415f-a692-bc6382a8d02d"}]}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:09:57.913009 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.network.neutron [None req-f6f69fb7-df5c-4104-a7e2-5d4029ad86bc tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] validate_networks() for [('9e601050-ec11-415f-a692-bc6382a8d02d', None, None, None, None, None)] {{(pid=129365) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 21:09:58.161697 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c057b1cb-64e2-4dc9-aae0-1c506e4ff5bf tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:09:58.162308 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c057b1cb-64e2-4dc9-aae0-1c506e4ff5bf tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] [instance: a908b8d0-88c5-44e7-920a-1d9f54de7cb1] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:09:58.171396 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c057b1cb-64e2-4dc9-aae0-1c506e4ff5bf tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:58.171872 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c057b1cb-64e2-4dc9-aae0-1c506e4ff5bf tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:58.172678 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c057b1cb-64e2-4dc9-aae0-1c506e4ff5bf tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:58.173149 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c057b1cb-64e2-4dc9-aae0-1c506e4ff5bf tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:58.829369 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-c057b1cb-64e2-4dc9-aae0-1c506e4ff5bf tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8117ed926ac40dbbdcbca53cd668c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c8dd6789ba45a7a04452dc080a37cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:09:58.840209 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c057b1cb-64e2-4dc9-aae0-1c506e4ff5bf tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] 10.222.0.46 "GET /compute/v2.1/servers/a908b8d0-88c5-44e7-920a-1d9f54de7cb1" status: 200 len: 1314 microversion: 2.1 time: 0.682243 Jan 15 21:09:58.841469 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2957/5902] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:09:58 2022] GET /compute/v2.1/servers/a908b8d0-88c5-44e7-920a-1d9f54de7cb1 => generated 1314 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:09:58.876377 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-f6f69fb7-df5c-4104-a7e2-5d4029ad86bc tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Flavor limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 21:09:58.876920 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-f6f69fb7-df5c-4104-a7e2-5d4029ad86bc tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Image limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 21:09:58.877468 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-f6f69fb7-df5c-4104-a7e2-5d4029ad86bc tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Flavor pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 21:09:58.877976 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-f6f69fb7-df5c-4104-a7e2-5d4029ad86bc tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Image pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 21:09:58.878541 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-f6f69fb7-df5c-4104-a7e2-5d4029ad86bc tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 21:09:58.889197 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f6f69fb7-df5c-4104-a7e2-5d4029ad86bc tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:58.890332 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f6f69fb7-df5c-4104-a7e2-5d4029ad86bc tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:58.892503 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f6f69fb7-df5c-4104-a7e2-5d4029ad86bc tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:58.893334 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f6f69fb7-df5c-4104-a7e2-5d4029ad86bc tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:58.913785 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-f6f69fb7-df5c-4104-a7e2-5d4029ad86bc tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Getting quotas for project 755ac4fd2f294bd4862f38492f48d4f6. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:09:58.919502 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-f6f69fb7-df5c-4104-a7e2-5d4029ad86bc tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Getting quotas for user 4f0f3e53babe4627a41e11ee3e2992f6 and project 755ac4fd2f294bd4862f38492f48d4f6. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:09:58.935280 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f6f69fb7-df5c-4104-a7e2-5d4029ad86bc tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Going to run 1 instances... {{(pid=129365) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 21:09:58.939114 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f6f69fb7-df5c-4104-a7e2-5d4029ad86bc tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] [instance: 9be0e0fd-270c-4d4e-a290-084ae916a1ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129365) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 21:09:59.001378 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f6f69fb7-df5c-4104-a7e2-5d4029ad86bc tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.389102 Jan 15 21:09:59.002070 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2946/5903] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 21:09:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1391 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 21:09:59.011545 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-73d689b3-89f3-4bb5-a6b9-ed8ef7291fe3 tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:09:59.012677 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-73d689b3-89f3-4bb5-a6b9-ed8ef7291fe3 tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] [instance: 9be0e0fd-270c-4d4e-a290-084ae916a1ea] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:09:59.173174 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-73d689b3-89f3-4bb5-a6b9-ed8ef7291fe3 tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0f3e53babe4627a41e11ee3e2992f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755ac4fd2f294bd4862f38492f48d4f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:09:59.181168 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-73d689b3-89f3-4bb5-a6b9-ed8ef7291fe3 tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] 10.222.0.46 "GET /compute/v2.1/servers/9be0e0fd-270c-4d4e-a290-084ae916a1ea" status: 200 len: 1216 microversion: 2.1 time: 0.173151 Jan 15 21:09:59.192541 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2958/5904] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:09:59 2022] GET /compute/v2.1/servers/9be0e0fd-270c-4d4e-a290-084ae916a1ea => generated 1216 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:09:59.258379 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-f06e4767-2aa0-4086-baf2-926573ae4ecd req-3626dbab-2037-41c3-8f38-813b26931bea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a908b8d0-88c5-44e7-920a-1d9f54de7cb1", "name": "network-vif-plugged", "status": "completed", "tag": "0ec24633-6357-4924-9ce3-f732c91c179a"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:09:59.260014 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:09:59.260014 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:09:59.273797 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-f06e4767-2aa0-4086-baf2-926573ae4ecd req-3626dbab-2037-41c3-8f38-813b26931bea service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:59.274854 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-f06e4767-2aa0-4086-baf2-926573ae4ecd req-3626dbab-2037-41c3-8f38-813b26931bea service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:59.306436 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-f06e4767-2aa0-4086-baf2-926573ae4ecd req-3626dbab-2037-41c3-8f38-813b26931bea service nova] Creating event network-vif-plugged:0ec24633-6357-4924-9ce3-f732c91c179a for instance a908b8d0-88c5-44e7-920a-1d9f54de7cb1 on nch2-master-1 Jan 15 21:09:59.318196 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-f06e4767-2aa0-4086-baf2-926573ae4ecd req-3626dbab-2037-41c3-8f38-813b26931bea service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.303648 Jan 15 21:09:59.319921 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2947/5905] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:09:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 21:09:59.862313 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1758cbe4-4b51-44f3-8c6e-ecfb5988da84 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:09:59.863593 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-1758cbe4-4b51-44f3-8c6e-ecfb5988da84 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] [instance: a908b8d0-88c5-44e7-920a-1d9f54de7cb1] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:09:59.875995 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1758cbe4-4b51-44f3-8c6e-ecfb5988da84 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:59.877248 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1758cbe4-4b51-44f3-8c6e-ecfb5988da84 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:09:59.878603 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1758cbe4-4b51-44f3-8c6e-ecfb5988da84 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:09:59.879253 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1758cbe4-4b51-44f3-8c6e-ecfb5988da84 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:00.065754 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-1758cbe4-4b51-44f3-8c6e-ecfb5988da84 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8117ed926ac40dbbdcbca53cd668c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c8dd6789ba45a7a04452dc080a37cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:10:00.075350 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-1758cbe4-4b51-44f3-8c6e-ecfb5988da84 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] 10.222.0.46 "GET /compute/v2.1/servers/a908b8d0-88c5-44e7-920a-1d9f54de7cb1" status: 200 len: 1314 microversion: 2.1 time: 0.219632 Jan 15 21:10:00.077653 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2959/5906] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:09:59 2022] GET /compute/v2.1/servers/a908b8d0-88c5-44e7-920a-1d9f54de7cb1 => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:10:00.199062 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-dab7b013-c7af-4037-ab44-d4c918a456fd tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:10:00.199765 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-dab7b013-c7af-4037-ab44-d4c918a456fd tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] [instance: 9be0e0fd-270c-4d4e-a290-084ae916a1ea] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:10:00.221807 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dab7b013-c7af-4037-ab44-d4c918a456fd tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:00.222573 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dab7b013-c7af-4037-ab44-d4c918a456fd tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:00.223616 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dab7b013-c7af-4037-ab44-d4c918a456fd tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:00.224335 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dab7b013-c7af-4037-ab44-d4c918a456fd tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:00.346055 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-dab7b013-c7af-4037-ab44-d4c918a456fd tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0f3e53babe4627a41e11ee3e2992f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755ac4fd2f294bd4862f38492f48d4f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:10:00.363710 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-dab7b013-c7af-4037-ab44-d4c918a456fd tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] 10.222.0.46 "GET /compute/v2.1/servers/9be0e0fd-270c-4d4e-a290-084ae916a1ea" status: 200 len: 1276 microversion: 2.1 time: 0.169411 Jan 15 21:10:00.364300 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2948/5907] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:10:00 2022] GET /compute/v2.1/servers/9be0e0fd-270c-4d4e-a290-084ae916a1ea => generated 1276 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:10:01.095977 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c4b7155f-86ed-414f-ac6a-a635cfdf55e9 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:10:01.097858 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c4b7155f-86ed-414f-ac6a-a635cfdf55e9 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] [instance: a908b8d0-88c5-44e7-920a-1d9f54de7cb1] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:10:01.130210 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c4b7155f-86ed-414f-ac6a-a635cfdf55e9 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:01.130655 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c4b7155f-86ed-414f-ac6a-a635cfdf55e9 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:01.131625 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c4b7155f-86ed-414f-ac6a-a635cfdf55e9 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:01.132093 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c4b7155f-86ed-414f-ac6a-a635cfdf55e9 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:01.350223 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-c4b7155f-86ed-414f-ac6a-a635cfdf55e9 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8117ed926ac40dbbdcbca53cd668c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c8dd6789ba45a7a04452dc080a37cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:10:01.360612 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c4b7155f-86ed-414f-ac6a-a635cfdf55e9 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] 10.222.0.46 "GET /compute/v2.1/servers/a908b8d0-88c5-44e7-920a-1d9f54de7cb1" status: 200 len: 1497 microversion: 2.1 time: 0.270124 Jan 15 21:10:01.361228 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2960/5908] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:10:01 2022] GET /compute/v2.1/servers/a908b8d0-88c5-44e7-920a-1d9f54de7cb1 => generated 1497 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:10:01.381529 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9df2f798-259f-4e2f-966b-7ead52981388 tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:10:01.383090 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-9df2f798-259f-4e2f-966b-7ead52981388 tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] [instance: 9be0e0fd-270c-4d4e-a290-084ae916a1ea] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:10:01.392868 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9df2f798-259f-4e2f-966b-7ead52981388 tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:01.393579 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9df2f798-259f-4e2f-966b-7ead52981388 tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:01.396286 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9df2f798-259f-4e2f-966b-7ead52981388 tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:01.397738 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9df2f798-259f-4e2f-966b-7ead52981388 tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:01.694868 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-9df2f798-259f-4e2f-966b-7ead52981388 tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0f3e53babe4627a41e11ee3e2992f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755ac4fd2f294bd4862f38492f48d4f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:10:01.701173 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-9df2f798-259f-4e2f-966b-7ead52981388 tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] 10.222.0.46 "GET /compute/v2.1/servers/9be0e0fd-270c-4d4e-a290-084ae916a1ea" status: 200 len: 1316 microversion: 2.1 time: 0.324424 Jan 15 21:10:01.702928 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2949/5909] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:10:01 2022] GET /compute/v2.1/servers/9be0e0fd-270c-4d4e-a290-084ae916a1ea => generated 1316 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:10:01.940792 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1ef2dc8e-b01e-4cea-bcfe-e2a2a802d4bf tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:10:01.941620 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-1ef2dc8e-b01e-4cea-bcfe-e2a2a802d4bf tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] [instance: a908b8d0-88c5-44e7-920a-1d9f54de7cb1] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:10:01.949125 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1ef2dc8e-b01e-4cea-bcfe-e2a2a802d4bf tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:01.949748 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1ef2dc8e-b01e-4cea-bcfe-e2a2a802d4bf tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:01.950784 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1ef2dc8e-b01e-4cea-bcfe-e2a2a802d4bf tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:01.951295 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1ef2dc8e-b01e-4cea-bcfe-e2a2a802d4bf tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:02.031865 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-1ef2dc8e-b01e-4cea-bcfe-e2a2a802d4bf tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] [instance: a908b8d0-88c5-44e7-920a-1d9f54de7cb1] Going to try to terminate instance {{(pid=129366) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 21:10:02.205317 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-1ef2dc8e-b01e-4cea-bcfe-e2a2a802d4bf tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] 10.222.0.46 "DELETE /compute/v2.1/servers/a908b8d0-88c5-44e7-920a-1d9f54de7cb1" status: 204 len: 0 microversion: 2.1 time: 0.269548 Jan 15 21:10:02.207917 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2961/5910] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 21:10:01 2022] DELETE /compute/v2.1/servers/a908b8d0-88c5-44e7-920a-1d9f54de7cb1 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 15 21:10:02.216349 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8db994d0-4d77-4671-a7d5-23569436cb84 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:10:02.217019 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-8db994d0-4d77-4671-a7d5-23569436cb84 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] [instance: a908b8d0-88c5-44e7-920a-1d9f54de7cb1] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:10:02.225793 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8db994d0-4d77-4671-a7d5-23569436cb84 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:02.226274 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8db994d0-4d77-4671-a7d5-23569436cb84 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:02.227081 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8db994d0-4d77-4671-a7d5-23569436cb84 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:02.227532 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8db994d0-4d77-4671-a7d5-23569436cb84 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:02.378858 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-c705b11e-a609-4d89-9b4e-19e046eb0d70 req-03013afd-674c-4e03-be1b-a6b43d2949e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9be0e0fd-270c-4d4e-a290-084ae916a1ea", "tag": "545a7b8f-5716-4583-a500-c410de25d9d8"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:10:02.380405 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:10:02.380405 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:10:02.401726 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-c705b11e-a609-4d89-9b4e-19e046eb0d70 req-03013afd-674c-4e03-be1b-a6b43d2949e6 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:02.402530 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-c705b11e-a609-4d89-9b4e-19e046eb0d70 req-03013afd-674c-4e03-be1b-a6b43d2949e6 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:02.432343 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-c705b11e-a609-4d89-9b4e-19e046eb0d70 req-03013afd-674c-4e03-be1b-a6b43d2949e6 service nova] Creating event network-changed:545a7b8f-5716-4583-a500-c410de25d9d8 for instance 9be0e0fd-270c-4d4e-a290-084ae916a1ea on nch1-master-1 Jan 15 21:10:02.439064 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-c705b11e-a609-4d89-9b4e-19e046eb0d70 req-03013afd-674c-4e03-be1b-a6b43d2949e6 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067622 Jan 15 21:10:02.440268 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2962/5911] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:10:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:10:02.701505 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-8db994d0-4d77-4671-a7d5-23569436cb84 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8117ed926ac40dbbdcbca53cd668c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c8dd6789ba45a7a04452dc080a37cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:10:02.711011 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-8db994d0-4d77-4671-a7d5-23569436cb84 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] 10.222.0.46 "GET /compute/v2.1/servers/a908b8d0-88c5-44e7-920a-1d9f54de7cb1" status: 200 len: 1503 microversion: 2.1 time: 0.498651 Jan 15 21:10:02.718943 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e5bc3681-2f1d-401b-8a4d-754c22ec8b5d tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:10:02.719944 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e5bc3681-2f1d-401b-8a4d-754c22ec8b5d tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] [instance: 9be0e0fd-270c-4d4e-a290-084ae916a1ea] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:10:02.737081 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e5bc3681-2f1d-401b-8a4d-754c22ec8b5d tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:02.743008 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e5bc3681-2f1d-401b-8a4d-754c22ec8b5d tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:02.744070 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e5bc3681-2f1d-401b-8a4d-754c22ec8b5d tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:02.744696 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e5bc3681-2f1d-401b-8a4d-754c22ec8b5d tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:02.746223 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2950/5912] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:10:02 2022] GET /compute/v2.1/servers/a908b8d0-88c5-44e7-920a-1d9f54de7cb1 => generated 1503 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:10:03.176605 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-e5bc3681-2f1d-401b-8a4d-754c22ec8b5d tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0f3e53babe4627a41e11ee3e2992f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755ac4fd2f294bd4862f38492f48d4f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:10:03.205882 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e5bc3681-2f1d-401b-8a4d-754c22ec8b5d tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] 10.222.0.46 "GET /compute/v2.1/servers/9be0e0fd-270c-4d4e-a290-084ae916a1ea" status: 200 len: 1316 microversion: 2.1 time: 0.487154 Jan 15 21:10:03.215300 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2963/5913] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:10:02 2022] GET /compute/v2.1/servers/9be0e0fd-270c-4d4e-a290-084ae916a1ea => generated 1316 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:10:03.753044 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d31358e1-362f-4459-aa1e-3cb67703054f tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:10:03.753656 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d31358e1-362f-4459-aa1e-3cb67703054f tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] [instance: a908b8d0-88c5-44e7-920a-1d9f54de7cb1] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:10:03.767539 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d31358e1-362f-4459-aa1e-3cb67703054f tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:03.767985 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d31358e1-362f-4459-aa1e-3cb67703054f tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:03.768783 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d31358e1-362f-4459-aa1e-3cb67703054f tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:03.769241 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d31358e1-362f-4459-aa1e-3cb67703054f tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:04.220180 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-582b0180-2b97-446f-9595-36b7f1eac5aa tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:10:04.220807 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-582b0180-2b97-446f-9595-36b7f1eac5aa tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] [instance: 9be0e0fd-270c-4d4e-a290-084ae916a1ea] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:10:04.232878 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-582b0180-2b97-446f-9595-36b7f1eac5aa tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:04.235876 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-582b0180-2b97-446f-9595-36b7f1eac5aa tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:04.238812 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-582b0180-2b97-446f-9595-36b7f1eac5aa tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:04.239543 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-582b0180-2b97-446f-9595-36b7f1eac5aa tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:04.672950 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-d31358e1-362f-4459-aa1e-3cb67703054f tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8117ed926ac40dbbdcbca53cd668c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c8dd6789ba45a7a04452dc080a37cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:10:04.684477 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d31358e1-362f-4459-aa1e-3cb67703054f tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] 10.222.0.46 "GET /compute/v2.1/servers/a908b8d0-88c5-44e7-920a-1d9f54de7cb1" status: 200 len: 1503 microversion: 2.1 time: 0.935455 Jan 15 21:10:04.696559 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2951/5914] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:10:03 2022] GET /compute/v2.1/servers/a908b8d0-88c5-44e7-920a-1d9f54de7cb1 => generated 1503 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:10:04.803782 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-582b0180-2b97-446f-9595-36b7f1eac5aa tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0f3e53babe4627a41e11ee3e2992f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755ac4fd2f294bd4862f38492f48d4f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:10:04.829097 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-582b0180-2b97-446f-9595-36b7f1eac5aa tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] 10.222.0.46 "GET /compute/v2.1/servers/9be0e0fd-270c-4d4e-a290-084ae916a1ea" status: 200 len: 1316 microversion: 2.1 time: 0.612952 Jan 15 21:10:04.844340 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2964/5915] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:10:04 2022] GET /compute/v2.1/servers/9be0e0fd-270c-4d4e-a290-084ae916a1ea => generated 1316 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:10:05.270690 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-af69c15c-b5a6-431f-8947-4c9f0fcc10bc req-59dd0490-254e-431d-9fc5-5782cd1c944f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a908b8d0-88c5-44e7-920a-1d9f54de7cb1", "name": "network-vif-deleted", "tag": "0ec24633-6357-4924-9ce3-f732c91c179a"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:10:05.273046 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:10:05.273046 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:10:05.310420 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-af69c15c-b5a6-431f-8947-4c9f0fcc10bc req-59dd0490-254e-431d-9fc5-5782cd1c944f service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:05.311545 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-af69c15c-b5a6-431f-8947-4c9f0fcc10bc req-59dd0490-254e-431d-9fc5-5782cd1c944f service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:05.336274 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-af69c15c-b5a6-431f-8947-4c9f0fcc10bc req-59dd0490-254e-431d-9fc5-5782cd1c944f service nova] Creating event network-vif-deleted:0ec24633-6357-4924-9ce3-f732c91c179a for instance a908b8d0-88c5-44e7-920a-1d9f54de7cb1 on nch2-master-1 Jan 15 21:10:05.350600 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-af69c15c-b5a6-431f-8947-4c9f0fcc10bc req-59dd0490-254e-431d-9fc5-5782cd1c944f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088461 Jan 15 21:10:05.357653 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2952/5916] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:10:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:10:05.704640 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e301acc5-0d5d-46e0-9f9f-17d3c7b9f29e tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:10:05.705194 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e301acc5-0d5d-46e0-9f9f-17d3c7b9f29e tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] [instance: a908b8d0-88c5-44e7-920a-1d9f54de7cb1] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:10:05.722793 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e301acc5-0d5d-46e0-9f9f-17d3c7b9f29e tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:05.724584 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e301acc5-0d5d-46e0-9f9f-17d3c7b9f29e tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:05.726838 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e301acc5-0d5d-46e0-9f9f-17d3c7b9f29e tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:05.728164 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e301acc5-0d5d-46e0-9f9f-17d3c7b9f29e tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:05.778994 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e301acc5-0d5d-46e0-9f9f-17d3c7b9f29e tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:05.779547 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e301acc5-0d5d-46e0-9f9f-17d3c7b9f29e tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:05.780113 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.objects.instance [None req-e301acc5-0d5d-46e0-9f9f-17d3c7b9f29e tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lazy-loading 'fault' on Instance uuid a908b8d0-88c5-44e7-920a-1d9f54de7cb1 {{(pid=129366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 21:10:05.851229 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f7ff5012-f040-4ba0-a7a7-399d38f9fea3 tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:10:05.852002 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f7ff5012-f040-4ba0-a7a7-399d38f9fea3 tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] [instance: 9be0e0fd-270c-4d4e-a290-084ae916a1ea] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:10:05.865198 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f7ff5012-f040-4ba0-a7a7-399d38f9fea3 tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:05.865662 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f7ff5012-f040-4ba0-a7a7-399d38f9fea3 tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:05.868935 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f7ff5012-f040-4ba0-a7a7-399d38f9fea3 tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:05.869379 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f7ff5012-f040-4ba0-a7a7-399d38f9fea3 tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:05.967152 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-e301acc5-0d5d-46e0-9f9f-17d3c7b9f29e tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8117ed926ac40dbbdcbca53cd668c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c8dd6789ba45a7a04452dc080a37cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:10:05.980230 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e301acc5-0d5d-46e0-9f9f-17d3c7b9f29e tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] 10.222.0.46 "GET /compute/v2.1/servers/a908b8d0-88c5-44e7-920a-1d9f54de7cb1" status: 200 len: 1304 microversion: 2.1 time: 0.277795 Jan 15 21:10:05.986995 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2965/5917] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:10:05 2022] GET /compute/v2.1/servers/a908b8d0-88c5-44e7-920a-1d9f54de7cb1 => generated 1304 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:10:06.497588 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-f7ff5012-f040-4ba0-a7a7-399d38f9fea3 tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0f3e53babe4627a41e11ee3e2992f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755ac4fd2f294bd4862f38492f48d4f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:10:06.507178 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f7ff5012-f040-4ba0-a7a7-399d38f9fea3 tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] 10.222.0.46 "GET /compute/v2.1/servers/9be0e0fd-270c-4d4e-a290-084ae916a1ea" status: 200 len: 1316 microversion: 2.1 time: 0.660963 Jan 15 21:10:06.507780 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2953/5918] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:10:05 2022] GET /compute/v2.1/servers/9be0e0fd-270c-4d4e-a290-084ae916a1ea => generated 1316 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:10:07.002991 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-6766e0ab-e424-44ad-b9a5-01c6464cc7d1 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:10:07.004246 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-6766e0ab-e424-44ad-b9a5-01c6464cc7d1 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] [instance: a908b8d0-88c5-44e7-920a-1d9f54de7cb1] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:10:07.010387 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6766e0ab-e424-44ad-b9a5-01c6464cc7d1 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:07.011166 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6766e0ab-e424-44ad-b9a5-01c6464cc7d1 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:07.012117 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6766e0ab-e424-44ad-b9a5-01c6464cc7d1 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:07.012700 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6766e0ab-e424-44ad-b9a5-01c6464cc7d1 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:07.044690 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-6766e0ab-e424-44ad-b9a5-01c6464cc7d1 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] HTTP exception thrown: Instance a908b8d0-88c5-44e7-920a-1d9f54de7cb1 could not be found. Jan 15 21:10:07.046043 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-6766e0ab-e424-44ad-b9a5-01c6464cc7d1 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Returning 404 to user: Instance a908b8d0-88c5-44e7-920a-1d9f54de7cb1 could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:10:07.047641 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-6766e0ab-e424-44ad-b9a5-01c6464cc7d1 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] 10.222.0.46 "GET /compute/v2.1/servers/a908b8d0-88c5-44e7-920a-1d9f54de7cb1" status: 404 len: 111 microversion: 2.1 time: 0.049687 Jan 15 21:10:07.049168 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2966/5919] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:10:06 2022] GET /compute/v2.1/servers/a908b8d0-88c5-44e7-920a-1d9f54de7cb1 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 15 21:10:07.225967 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c51281ff-cb67-46c6-851b-5a47c27b4d57 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-279581824", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "networks": [{"uuid": "2fa5a3aa-4ace-46fa-b2bd-304536abb207"}]}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:10:07.322936 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.network.neutron [None req-c51281ff-cb67-46c6-851b-5a47c27b4d57 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] validate_networks() for [('2fa5a3aa-4ace-46fa-b2bd-304536abb207', None, None, None, None, None)] {{(pid=129365) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 21:10:07.525445 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b0de2e9b-f6ce-45e1-b07b-fb4314632b2e tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:10:07.526100 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b0de2e9b-f6ce-45e1-b07b-fb4314632b2e tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] [instance: 9be0e0fd-270c-4d4e-a290-084ae916a1ea] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:10:07.536038 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b0de2e9b-f6ce-45e1-b07b-fb4314632b2e tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:07.537090 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b0de2e9b-f6ce-45e1-b07b-fb4314632b2e tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:07.538221 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b0de2e9b-f6ce-45e1-b07b-fb4314632b2e tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:07.538901 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b0de2e9b-f6ce-45e1-b07b-fb4314632b2e tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:08.004611 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-b0de2e9b-f6ce-45e1-b07b-fb4314632b2e tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0f3e53babe4627a41e11ee3e2992f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755ac4fd2f294bd4862f38492f48d4f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:10:08.017685 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b0de2e9b-f6ce-45e1-b07b-fb4314632b2e tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] 10.222.0.46 "GET /compute/v2.1/servers/9be0e0fd-270c-4d4e-a290-084ae916a1ea" status: 200 len: 1316 microversion: 2.1 time: 0.494481 Jan 15 21:10:08.017685 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2967/5920] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:10:07 2022] GET /compute/v2.1/servers/9be0e0fd-270c-4d4e-a290-084ae916a1ea => generated 1316 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:10:08.022859 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-01e7a845-3d83-4466-87eb-af96ab2e482a req-c22713c1-825c-47f3-b0b8-a89102ee9cb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9be0e0fd-270c-4d4e-a290-084ae916a1ea", "name": "network-vif-plugged", "status": "completed", "tag": "545a7b8f-5716-4583-a500-c410de25d9d8"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:10:08.024471 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:10:08.024471 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:10:08.035729 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-01e7a845-3d83-4466-87eb-af96ab2e482a req-c22713c1-825c-47f3-b0b8-a89102ee9cb0 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:08.036267 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-01e7a845-3d83-4466-87eb-af96ab2e482a req-c22713c1-825c-47f3-b0b8-a89102ee9cb0 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:08.051905 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-01e7a845-3d83-4466-87eb-af96ab2e482a req-c22713c1-825c-47f3-b0b8-a89102ee9cb0 service nova] Creating event network-vif-plugged:545a7b8f-5716-4583-a500-c410de25d9d8 for instance 9be0e0fd-270c-4d4e-a290-084ae916a1ea on nch1-master-1 Jan 15 21:10:08.059840 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-01e7a845-3d83-4466-87eb-af96ab2e482a req-c22713c1-825c-47f3-b0b8-a89102ee9cb0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040529 Jan 15 21:10:08.060655 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2968/5921] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:10:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:10:08.282967 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-c51281ff-cb67-46c6-851b-5a47c27b4d57 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Flavor limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 21:10:08.283463 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-c51281ff-cb67-46c6-851b-5a47c27b4d57 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Image limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 21:10:08.283840 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-c51281ff-cb67-46c6-851b-5a47c27b4d57 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Flavor pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 21:10:08.284243 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-c51281ff-cb67-46c6-851b-5a47c27b4d57 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Image pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 21:10:08.284647 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-c51281ff-cb67-46c6-851b-5a47c27b4d57 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 21:10:08.297808 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c51281ff-cb67-46c6-851b-5a47c27b4d57 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:08.298222 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c51281ff-cb67-46c6-851b-5a47c27b4d57 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:08.299191 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c51281ff-cb67-46c6-851b-5a47c27b4d57 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:08.299644 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c51281ff-cb67-46c6-851b-5a47c27b4d57 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:08.320277 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-c51281ff-cb67-46c6-851b-5a47c27b4d57 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Getting quotas for project 07c8dd6789ba45a7a04452dc080a37cf. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:10:08.328043 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-c51281ff-cb67-46c6-851b-5a47c27b4d57 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Getting quotas for user a8117ed926ac40dbbdcbca53cd668c41 and project 07c8dd6789ba45a7a04452dc080a37cf. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:10:08.344073 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c51281ff-cb67-46c6-851b-5a47c27b4d57 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Going to run 1 instances... {{(pid=129365) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 21:10:08.346949 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c51281ff-cb67-46c6-851b-5a47c27b4d57 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] [instance: c150ed13-89c9-4f8a-b20b-819effbc3bcc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129365) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 21:10:08.423898 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c51281ff-cb67-46c6-851b-5a47c27b4d57 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.201600 Jan 15 21:10:08.425280 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2954/5922] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 21:10:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1204 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 15 21:10:08.447755 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8f7a66cb-ca3d-4c62-97c8-5319747dd423 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:10:08.448658 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-8f7a66cb-ca3d-4c62-97c8-5319747dd423 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] [instance: c150ed13-89c9-4f8a-b20b-819effbc3bcc] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:10:08.598546 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-8f7a66cb-ca3d-4c62-97c8-5319747dd423 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8117ed926ac40dbbdcbca53cd668c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c8dd6789ba45a7a04452dc080a37cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:10:08.636971 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-8f7a66cb-ca3d-4c62-97c8-5319747dd423 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] 10.222.0.46 "GET /compute/v2.1/servers/c150ed13-89c9-4f8a-b20b-819effbc3bcc" status: 200 len: 1213 microversion: 2.1 time: 0.205095 Jan 15 21:10:08.647151 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2969/5923] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:10:08 2022] GET /compute/v2.1/servers/c150ed13-89c9-4f8a-b20b-819effbc3bcc => generated 1213 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:10:09.033917 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-598d4f4f-254a-49f1-bc1c-4cd4064e001c tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:10:09.034535 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-598d4f4f-254a-49f1-bc1c-4cd4064e001c tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] [instance: 9be0e0fd-270c-4d4e-a290-084ae916a1ea] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:10:09.043747 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-598d4f4f-254a-49f1-bc1c-4cd4064e001c tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:09.044205 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-598d4f4f-254a-49f1-bc1c-4cd4064e001c tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:09.045042 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-598d4f4f-254a-49f1-bc1c-4cd4064e001c tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:09.045784 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-598d4f4f-254a-49f1-bc1c-4cd4064e001c tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:09.191072 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-553e5d1c-1ad1-4357-8185-599ef0fb4030 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:10:09.192273 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-553e5d1c-1ad1-4357-8185-599ef0fb4030 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] [instance: 86b698ae-0ed3-4195-a604-1f3d1ec13d65] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:10:09.204523 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-553e5d1c-1ad1-4357-8185-599ef0fb4030 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:09.205417 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-553e5d1c-1ad1-4357-8185-599ef0fb4030 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:09.206558 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-553e5d1c-1ad1-4357-8185-599ef0fb4030 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:09.207258 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-553e5d1c-1ad1-4357-8185-599ef0fb4030 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:09.414379 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.objects.instance [None req-553e5d1c-1ad1-4357-8185-599ef0fb4030 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lazy-loading 'services' on Instance uuid 86b698ae-0ed3-4195-a604-1f3d1ec13d65 {{(pid=129366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 21:10:09.534619 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-553e5d1c-1ad1-4357-8185-599ef0fb4030 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] 10.222.0.46 "DELETE /compute/v2.1/servers/86b698ae-0ed3-4195-a604-1f3d1ec13d65/os-volume_attachments/1df1f210-c337-4c2c-9ab2-6ce7c8ff1134" status: 202 len: 0 microversion: 2.1 time: 0.334416 Jan 15 21:10:09.536518 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2970/5924] 10.222.0.46 () {58 vars in 1415 bytes} [Sat Jan 15 21:10:09 2022] DELETE /compute/v2.1/servers/86b698ae-0ed3-4195-a604-1f3d1ec13d65/os-volume_attachments/1df1f210-c337-4c2c-9ab2-6ce7c8ff1134 => generated 0 bytes in 353 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:10:09.597188 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-598d4f4f-254a-49f1-bc1c-4cd4064e001c tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0f3e53babe4627a41e11ee3e2992f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755ac4fd2f294bd4862f38492f48d4f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:10:09.605101 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-598d4f4f-254a-49f1-bc1c-4cd4064e001c tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] 10.222.0.46 "GET /compute/v2.1/servers/9be0e0fd-270c-4d4e-a290-084ae916a1ea" status: 200 len: 1316 microversion: 2.1 time: 0.575085 Jan 15 21:10:09.619161 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2955/5925] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:10:09 2022] GET /compute/v2.1/servers/9be0e0fd-270c-4d4e-a290-084ae916a1ea => generated 1316 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:10:09.666653 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-86526a11-6cd3-464b-9832-566ffe5ed46a tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:10:09.667496 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-86526a11-6cd3-464b-9832-566ffe5ed46a tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] [instance: c150ed13-89c9-4f8a-b20b-819effbc3bcc] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:10:09.677936 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-86526a11-6cd3-464b-9832-566ffe5ed46a tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:09.678512 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-86526a11-6cd3-464b-9832-566ffe5ed46a tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:09.679387 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-86526a11-6cd3-464b-9832-566ffe5ed46a tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:09.680034 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-86526a11-6cd3-464b-9832-566ffe5ed46a tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:09.804371 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-86526a11-6cd3-464b-9832-566ffe5ed46a tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8117ed926ac40dbbdcbca53cd668c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c8dd6789ba45a7a04452dc080a37cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:10:09.818097 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-86526a11-6cd3-464b-9832-566ffe5ed46a tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] 10.222.0.46 "GET /compute/v2.1/servers/c150ed13-89c9-4f8a-b20b-819effbc3bcc" status: 200 len: 1265 microversion: 2.1 time: 0.154596 Jan 15 21:10:09.819446 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2971/5926] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:10:09 2022] GET /compute/v2.1/servers/c150ed13-89c9-4f8a-b20b-819effbc3bcc => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:10:10.627360 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-04fada0d-3d7c-4cca-9db8-640b15750e5f tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:10:10.627964 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-04fada0d-3d7c-4cca-9db8-640b15750e5f tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] [instance: 9be0e0fd-270c-4d4e-a290-084ae916a1ea] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:10:10.649248 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-04fada0d-3d7c-4cca-9db8-640b15750e5f tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:10.649744 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-04fada0d-3d7c-4cca-9db8-640b15750e5f tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:10.650581 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-04fada0d-3d7c-4cca-9db8-640b15750e5f tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:10.653124 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-04fada0d-3d7c-4cca-9db8-640b15750e5f tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:10.763540 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-21fb82f7-3066-403a-a843-9fe4b7b60341 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:10:10.764293 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-21fb82f7-3066-403a-a843-9fe4b7b60341 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] [instance: 86b698ae-0ed3-4195-a604-1f3d1ec13d65] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:10:10.775484 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-21fb82f7-3066-403a-a843-9fe4b7b60341 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:10.777445 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-21fb82f7-3066-403a-a843-9fe4b7b60341 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:10.778290 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-21fb82f7-3066-403a-a843-9fe4b7b60341 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:10.781225 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-21fb82f7-3066-403a-a843-9fe4b7b60341 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:10.834405 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-21fb82f7-3066-403a-a843-9fe4b7b60341 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] [instance: 86b698ae-0ed3-4195-a604-1f3d1ec13d65] Going to try to terminate instance {{(pid=129366) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 21:10:10.988512 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-21fb82f7-3066-403a-a843-9fe4b7b60341 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] 10.222.0.46 "DELETE /compute/v2.1/servers/86b698ae-0ed3-4195-a604-1f3d1ec13d65" status: 204 len: 0 microversion: 2.1 time: 0.229183 Jan 15 21:10:10.989538 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2972/5927] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 21:10:10 2022] DELETE /compute/v2.1/servers/86b698ae-0ed3-4195-a604-1f3d1ec13d65 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 21:10:10.995785 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-60345014-e247-4126-87cf-63940ef49dbe tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:10:10.996903 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-60345014-e247-4126-87cf-63940ef49dbe tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] [instance: c150ed13-89c9-4f8a-b20b-819effbc3bcc] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:10:11.008731 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-60345014-e247-4126-87cf-63940ef49dbe tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:11.009733 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-60345014-e247-4126-87cf-63940ef49dbe tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:11.010942 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-60345014-e247-4126-87cf-63940ef49dbe tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:11.011618 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-60345014-e247-4126-87cf-63940ef49dbe tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:11.152025 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-04fada0d-3d7c-4cca-9db8-640b15750e5f tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0f3e53babe4627a41e11ee3e2992f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755ac4fd2f294bd4862f38492f48d4f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:10:11.168400 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-04fada0d-3d7c-4cca-9db8-640b15750e5f tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] 10.222.0.46 "GET /compute/v2.1/servers/9be0e0fd-270c-4d4e-a290-084ae916a1ea" status: 200 len: 1504 microversion: 2.1 time: 0.547605 Jan 15 21:10:11.169847 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2956/5928] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:10:10 2022] GET /compute/v2.1/servers/9be0e0fd-270c-4d4e-a290-084ae916a1ea => generated 1504 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:10:11.175472 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2a0b239b-5528-4ad1-8cb2-b355cc7dee56 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:10:11.176331 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-2a0b239b-5528-4ad1-8cb2-b355cc7dee56 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] [instance: 86b698ae-0ed3-4195-a604-1f3d1ec13d65] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:10:11.187315 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2a0b239b-5528-4ad1-8cb2-b355cc7dee56 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:11.188085 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2a0b239b-5528-4ad1-8cb2-b355cc7dee56 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:11.189387 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2a0b239b-5528-4ad1-8cb2-b355cc7dee56 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:11.190305 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2a0b239b-5528-4ad1-8cb2-b355cc7dee56 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:11.569952 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-60345014-e247-4126-87cf-63940ef49dbe tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8117ed926ac40dbbdcbca53cd668c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c8dd6789ba45a7a04452dc080a37cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:10:11.580916 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-60345014-e247-4126-87cf-63940ef49dbe tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] 10.222.0.46 "GET /compute/v2.1/servers/c150ed13-89c9-4f8a-b20b-819effbc3bcc" status: 200 len: 1313 microversion: 2.1 time: 0.589695 Jan 15 21:10:11.582015 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2973/5929] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:10:10 2022] GET /compute/v2.1/servers/c150ed13-89c9-4f8a-b20b-819effbc3bcc => generated 1313 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:10:11.601229 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-2a0b239b-5528-4ad1-8cb2-b355cc7dee56 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2364cc12914bd3922a66feb86c5c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa736a1907e4790b2ea49bc7f31e50c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:10:11.602237 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-09efe396-c975-45d1-8967-0788da11ca95 tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:10:11.604583 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-09efe396-c975-45d1-8967-0788da11ca95 tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] [instance: 9be0e0fd-270c-4d4e-a290-084ae916a1ea] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:10:11.614948 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2a0b239b-5528-4ad1-8cb2-b355cc7dee56 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] 10.222.0.46 "GET /compute/v2.1/servers/86b698ae-0ed3-4195-a604-1f3d1ec13d65" status: 200 len: 1515 microversion: 2.1 time: 0.442267 Jan 15 21:10:11.615867 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2957/5930] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:10:11 2022] GET /compute/v2.1/servers/86b698ae-0ed3-4195-a604-1f3d1ec13d65 => generated 1515 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:10:11.621356 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-09efe396-c975-45d1-8967-0788da11ca95 tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:11.622404 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-09efe396-c975-45d1-8967-0788da11ca95 tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:11.625820 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-09efe396-c975-45d1-8967-0788da11ca95 tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:11.627378 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-09efe396-c975-45d1-8967-0788da11ca95 tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:11.687346 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-09efe396-c975-45d1-8967-0788da11ca95 tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': '4f0f3e53babe4627a41e11ee3e2992f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755ac4fd2f294bd4862f38492f48d4f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:10:11.688517 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-09efe396-c975-45d1-8967-0788da11ca95 tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] 10.222.0.46 "GET /compute/v2.1/servers/9be0e0fd-270c-4d4e-a290-084ae916a1ea/os-instance-actions/req-f6f69fb7-df5c-4104-a7e2-5d4029ad86bc" status: 200 len: 313 microversion: 2.1 time: 0.103971 Jan 15 21:10:11.697287 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2974/5931] 10.222.0.46 () {58 vars in 1418 bytes} [Sat Jan 15 21:10:11 2022] GET /compute/v2.1/servers/9be0e0fd-270c-4d4e-a290-084ae916a1ea/os-instance-actions/req-f6f69fb7-df5c-4104-a7e2-5d4029ad86bc => generated 313 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:10:11.705904 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-229cd60a-3559-4b6a-80a9-1b25d93f6db4 tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:10:11.706397 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-229cd60a-3559-4b6a-80a9-1b25d93f6db4 tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] [instance: 9be0e0fd-270c-4d4e-a290-084ae916a1ea] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:10:11.724735 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-229cd60a-3559-4b6a-80a9-1b25d93f6db4 tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:11.729294 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-229cd60a-3559-4b6a-80a9-1b25d93f6db4 tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:11.730467 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-229cd60a-3559-4b6a-80a9-1b25d93f6db4 tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:11.731234 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-229cd60a-3559-4b6a-80a9-1b25d93f6db4 tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:11.865171 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-229cd60a-3559-4b6a-80a9-1b25d93f6db4 tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] 10.222.0.46 "POST /compute/v2.1/servers/9be0e0fd-270c-4d4e-a290-084ae916a1ea/action" status: 202 len: 0 microversion: 2.1 time: 0.164118 Jan 15 21:10:11.869476 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2958/5932] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:10:11 2022] POST /compute/v2.1/servers/9be0e0fd-270c-4d4e-a290-084ae916a1ea/action => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:10:11.875449 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a8dd098a-1b3a-4328-9ace-23a3b9c48c1a tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:10:11.876215 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a8dd098a-1b3a-4328-9ace-23a3b9c48c1a tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] [instance: 9be0e0fd-270c-4d4e-a290-084ae916a1ea] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:10:11.885301 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a8dd098a-1b3a-4328-9ace-23a3b9c48c1a tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:11.887278 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a8dd098a-1b3a-4328-9ace-23a3b9c48c1a tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:11.888299 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a8dd098a-1b3a-4328-9ace-23a3b9c48c1a tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:11.889018 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a8dd098a-1b3a-4328-9ace-23a3b9c48c1a tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:12.145856 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-a8dd098a-1b3a-4328-9ace-23a3b9c48c1a tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0f3e53babe4627a41e11ee3e2992f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755ac4fd2f294bd4862f38492f48d4f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:10:12.156660 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a8dd098a-1b3a-4328-9ace-23a3b9c48c1a tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] 10.222.0.46 "GET /compute/v2.1/servers/9be0e0fd-270c-4d4e-a290-084ae916a1ea" status: 200 len: 1506 microversion: 2.1 time: 0.286300 Jan 15 21:10:12.163032 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2975/5933] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:10:11 2022] GET /compute/v2.1/servers/9be0e0fd-270c-4d4e-a290-084ae916a1ea => generated 1506 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:10:12.179066 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-023a813e-ba3a-49b3-8d91-7dd31322463a req-7cd57220-4004-4dca-9acb-b5a7346f0131 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c150ed13-89c9-4f8a-b20b-819effbc3bcc", "tag": "58f07104-e0f7-47d8-9ec4-ca6f4efcb046"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:10:12.184566 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:10:12.184566 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:10:12.194853 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-023a813e-ba3a-49b3-8d91-7dd31322463a req-7cd57220-4004-4dca-9acb-b5a7346f0131 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:12.195959 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-023a813e-ba3a-49b3-8d91-7dd31322463a req-7cd57220-4004-4dca-9acb-b5a7346f0131 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:12.216329 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-023a813e-ba3a-49b3-8d91-7dd31322463a req-7cd57220-4004-4dca-9acb-b5a7346f0131 service nova] Creating event network-changed:58f07104-e0f7-47d8-9ec4-ca6f4efcb046 for instance c150ed13-89c9-4f8a-b20b-819effbc3bcc on nch2-master-1 Jan 15 21:10:12.223969 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-023a813e-ba3a-49b3-8d91-7dd31322463a req-7cd57220-4004-4dca-9acb-b5a7346f0131 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061274 Jan 15 21:10:12.226223 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2959/5934] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:10:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 21:10:12.604577 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a93dfc47-9986-46c0-920f-26d7cedf355d tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:10:12.605213 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a93dfc47-9986-46c0-920f-26d7cedf355d tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] [instance: c150ed13-89c9-4f8a-b20b-819effbc3bcc] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:10:12.614790 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a93dfc47-9986-46c0-920f-26d7cedf355d tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:12.615682 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a93dfc47-9986-46c0-920f-26d7cedf355d tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:12.617085 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a93dfc47-9986-46c0-920f-26d7cedf355d tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:12.617876 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a93dfc47-9986-46c0-920f-26d7cedf355d tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:12.636252 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-583f9794-6cf8-4599-b309-e4e07ecc796b tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:10:12.637273 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-583f9794-6cf8-4599-b309-e4e07ecc796b tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] [instance: 86b698ae-0ed3-4195-a604-1f3d1ec13d65] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:10:12.656035 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-583f9794-6cf8-4599-b309-e4e07ecc796b tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:12.656961 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-583f9794-6cf8-4599-b309-e4e07ecc796b tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:12.658154 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-583f9794-6cf8-4599-b309-e4e07ecc796b tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:12.659220 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-583f9794-6cf8-4599-b309-e4e07ecc796b tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:13.056270 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-a93dfc47-9986-46c0-920f-26d7cedf355d tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8117ed926ac40dbbdcbca53cd668c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c8dd6789ba45a7a04452dc080a37cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:10:13.066182 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a93dfc47-9986-46c0-920f-26d7cedf355d tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] 10.222.0.46 "GET /compute/v2.1/servers/c150ed13-89c9-4f8a-b20b-819effbc3bcc" status: 200 len: 1313 microversion: 2.1 time: 0.465271 Jan 15 21:10:13.066777 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2976/5935] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:10:12 2022] GET /compute/v2.1/servers/c150ed13-89c9-4f8a-b20b-819effbc3bcc => generated 1313 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:10:13.105014 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-583f9794-6cf8-4599-b309-e4e07ecc796b tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2364cc12914bd3922a66feb86c5c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa736a1907e4790b2ea49bc7f31e50c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:10:13.116497 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-583f9794-6cf8-4599-b309-e4e07ecc796b tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] 10.222.0.46 "GET /compute/v2.1/servers/86b698ae-0ed3-4195-a604-1f3d1ec13d65" status: 200 len: 1515 microversion: 2.1 time: 0.484471 Jan 15 21:10:13.118018 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2960/5936] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:10:12 2022] GET /compute/v2.1/servers/86b698ae-0ed3-4195-a604-1f3d1ec13d65 => generated 1515 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:10:13.181256 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-acadc8a9-4253-42e5-a456-8dac8b03c56a tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:10:13.182061 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-acadc8a9-4253-42e5-a456-8dac8b03c56a tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] [instance: 9be0e0fd-270c-4d4e-a290-084ae916a1ea] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:10:13.194249 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-acadc8a9-4253-42e5-a456-8dac8b03c56a tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:13.194854 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-acadc8a9-4253-42e5-a456-8dac8b03c56a tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:13.195657 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-acadc8a9-4253-42e5-a456-8dac8b03c56a tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:13.196095 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-acadc8a9-4253-42e5-a456-8dac8b03c56a tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:13.750102 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-acadc8a9-4253-42e5-a456-8dac8b03c56a tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0f3e53babe4627a41e11ee3e2992f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755ac4fd2f294bd4862f38492f48d4f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:10:13.763215 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-acadc8a9-4253-42e5-a456-8dac8b03c56a tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] 10.222.0.46 "GET /compute/v2.1/servers/9be0e0fd-270c-4d4e-a290-084ae916a1ea" status: 200 len: 1506 microversion: 2.1 time: 0.585767 Jan 15 21:10:13.764197 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2977/5937] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:10:13 2022] GET /compute/v2.1/servers/9be0e0fd-270c-4d4e-a290-084ae916a1ea => generated 1506 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:10:14.084509 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2126dc4b-a7f7-4c68-ab3b-c56c2f0027f6 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:10:14.085368 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-2126dc4b-a7f7-4c68-ab3b-c56c2f0027f6 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] [instance: c150ed13-89c9-4f8a-b20b-819effbc3bcc] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:10:14.099566 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2126dc4b-a7f7-4c68-ab3b-c56c2f0027f6 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:14.100019 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2126dc4b-a7f7-4c68-ab3b-c56c2f0027f6 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:14.100820 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2126dc4b-a7f7-4c68-ab3b-c56c2f0027f6 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:14.101278 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2126dc4b-a7f7-4c68-ab3b-c56c2f0027f6 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:14.135571 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-77d177aa-0dbf-47a4-8bae-c3b4621439af tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:10:14.136807 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-77d177aa-0dbf-47a4-8bae-c3b4621439af tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] [instance: 86b698ae-0ed3-4195-a604-1f3d1ec13d65] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:10:14.150846 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-77d177aa-0dbf-47a4-8bae-c3b4621439af tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:14.151584 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-77d177aa-0dbf-47a4-8bae-c3b4621439af tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:14.152560 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-77d177aa-0dbf-47a4-8bae-c3b4621439af tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:14.153394 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-77d177aa-0dbf-47a4-8bae-c3b4621439af tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:14.512637 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-2126dc4b-a7f7-4c68-ab3b-c56c2f0027f6 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8117ed926ac40dbbdcbca53cd668c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c8dd6789ba45a7a04452dc080a37cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:10:14.528341 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2126dc4b-a7f7-4c68-ab3b-c56c2f0027f6 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] 10.222.0.46 "GET /compute/v2.1/servers/c150ed13-89c9-4f8a-b20b-819effbc3bcc" status: 200 len: 1313 microversion: 2.1 time: 0.444202 Jan 15 21:10:14.530115 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2961/5938] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:10:14 2022] GET /compute/v2.1/servers/c150ed13-89c9-4f8a-b20b-819effbc3bcc => generated 1313 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:10:14.593721 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-77d177aa-0dbf-47a4-8bae-c3b4621439af tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2364cc12914bd3922a66feb86c5c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa736a1907e4790b2ea49bc7f31e50c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:10:14.608367 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-77d177aa-0dbf-47a4-8bae-c3b4621439af tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] 10.222.0.46 "GET /compute/v2.1/servers/86b698ae-0ed3-4195-a604-1f3d1ec13d65" status: 200 len: 1515 microversion: 2.1 time: 0.470890 Jan 15 21:10:14.609750 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2978/5939] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:10:14 2022] GET /compute/v2.1/servers/86b698ae-0ed3-4195-a604-1f3d1ec13d65 => generated 1515 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:10:14.777252 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-95d45fb9-383d-4676-9de4-cf7e828557d9 req-f4138441-243a-4192-a15a-cd6a9e196002 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86b698ae-0ed3-4195-a604-1f3d1ec13d65", "name": "network-vif-deleted", "tag": "88a0e402-80ed-4694-bcd3-f181c1c18d44"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:10:14.781571 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-059c2c39-093c-4168-8f40-883d88e0219a tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:10:14.782174 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-059c2c39-093c-4168-8f40-883d88e0219a tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] [instance: 9be0e0fd-270c-4d4e-a290-084ae916a1ea] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:10:14.782301 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:10:14.782301 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:10:14.791400 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-059c2c39-093c-4168-8f40-883d88e0219a tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:14.791849 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-059c2c39-093c-4168-8f40-883d88e0219a tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:14.792638 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-059c2c39-093c-4168-8f40-883d88e0219a tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:14.793096 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-059c2c39-093c-4168-8f40-883d88e0219a tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:14.829857 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-95d45fb9-383d-4676-9de4-cf7e828557d9 req-f4138441-243a-4192-a15a-cd6a9e196002 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:14.835252 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-95d45fb9-383d-4676-9de4-cf7e828557d9 req-f4138441-243a-4192-a15a-cd6a9e196002 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:14.851384 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-95d45fb9-383d-4676-9de4-cf7e828557d9 req-f4138441-243a-4192-a15a-cd6a9e196002 service nova] Creating event network-vif-deleted:88a0e402-80ed-4694-bcd3-f181c1c18d44 for instance 86b698ae-0ed3-4195-a604-1f3d1ec13d65 on nch1-master-1 Jan 15 21:10:14.857236 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-95d45fb9-383d-4676-9de4-cf7e828557d9 req-f4138441-243a-4192-a15a-cd6a9e196002 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087310 Jan 15 21:10:14.859207 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2962/5940] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:10:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:10:15.408535 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-059c2c39-093c-4168-8f40-883d88e0219a tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0f3e53babe4627a41e11ee3e2992f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755ac4fd2f294bd4862f38492f48d4f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:10:15.416121 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-059c2c39-093c-4168-8f40-883d88e0219a tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] 10.222.0.46 "GET /compute/v2.1/servers/9be0e0fd-270c-4d4e-a290-084ae916a1ea" status: 200 len: 1504 microversion: 2.1 time: 0.638592 Jan 15 21:10:15.416708 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2979/5941] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:10:14 2022] GET /compute/v2.1/servers/9be0e0fd-270c-4d4e-a290-084ae916a1ea => generated 1504 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:10:15.435058 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-924e092e-8e15-4571-9f1e-4c80e4593ed3 tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Calling method '.version_select at 0x7f30ceb5f4c0>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:10:15.435555 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-924e092e-8e15-4571-9f1e-4c80e4593ed3 tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] [instance: 9be0e0fd-270c-4d4e-a290-084ae916a1ea] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:10:15.450496 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-924e092e-8e15-4571-9f1e-4c80e4593ed3 tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:15.451487 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-924e092e-8e15-4571-9f1e-4c80e4593ed3 tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:15.453457 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-924e092e-8e15-4571-9f1e-4c80e4593ed3 tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:15.459762 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-924e092e-8e15-4571-9f1e-4c80e4593ed3 tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:15.537191 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-924e092e-8e15-4571-9f1e-4c80e4593ed3 tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] 10.222.0.46 "GET /compute/v2.1/servers/9be0e0fd-270c-4d4e-a290-084ae916a1ea/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.107115 Jan 15 21:10:15.540137 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2963/5942] 10.222.0.46 () {58 vars in 1295 bytes} [Sat Jan 15 21:10:15 2022] GET /compute/v2.1/servers/9be0e0fd-270c-4d4e-a290-084ae916a1ea/os-instance-actions => generated 611 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:10:15.548313 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-47445aa6-18ca-4f0e-9748-be35961eeaac tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:10:15.548911 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-47445aa6-18ca-4f0e-9748-be35961eeaac tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] [instance: c150ed13-89c9-4f8a-b20b-819effbc3bcc] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:10:15.568401 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b782dbb8-193c-4a3f-aa47-f71c3e68346e tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:10:15.568806 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-47445aa6-18ca-4f0e-9748-be35961eeaac tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:15.569286 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-47445aa6-18ca-4f0e-9748-be35961eeaac tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:15.569931 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b782dbb8-193c-4a3f-aa47-f71c3e68346e tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] [instance: 9be0e0fd-270c-4d4e-a290-084ae916a1ea] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:10:15.573961 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-47445aa6-18ca-4f0e-9748-be35961eeaac tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:15.574650 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-47445aa6-18ca-4f0e-9748-be35961eeaac tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:15.581665 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b782dbb8-193c-4a3f-aa47-f71c3e68346e tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:15.582338 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b782dbb8-193c-4a3f-aa47-f71c3e68346e tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:15.583994 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b782dbb8-193c-4a3f-aa47-f71c3e68346e tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:15.584787 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b782dbb8-193c-4a3f-aa47-f71c3e68346e tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:15.635127 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b782dbb8-193c-4a3f-aa47-f71c3e68346e tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] [instance: 9be0e0fd-270c-4d4e-a290-084ae916a1ea] Going to try to terminate instance {{(pid=129365) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 21:10:15.753353 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b782dbb8-193c-4a3f-aa47-f71c3e68346e tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] 10.222.0.46 "DELETE /compute/v2.1/servers/9be0e0fd-270c-4d4e-a290-084ae916a1ea" status: 204 len: 0 microversion: 2.1 time: 0.194004 Jan 15 21:10:15.755728 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2964/5943] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 21:10:15 2022] DELETE /compute/v2.1/servers/9be0e0fd-270c-4d4e-a290-084ae916a1ea => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 21:10:15.765537 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-4dc86aeb-d335-4e27-ac27-1dd4eb3d5e07 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:10:15.767477 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-4dc86aeb-d335-4e27-ac27-1dd4eb3d5e07 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] [instance: 86b698ae-0ed3-4195-a604-1f3d1ec13d65] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:10:15.776318 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4dc86aeb-d335-4e27-ac27-1dd4eb3d5e07 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:15.777021 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4dc86aeb-d335-4e27-ac27-1dd4eb3d5e07 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:15.778108 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4dc86aeb-d335-4e27-ac27-1dd4eb3d5e07 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:15.778826 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4dc86aeb-d335-4e27-ac27-1dd4eb3d5e07 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:15.800956 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-4dc86aeb-d335-4e27-ac27-1dd4eb3d5e07 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] HTTP exception thrown: Instance 86b698ae-0ed3-4195-a604-1f3d1ec13d65 could not be found. Jan 15 21:10:15.802081 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-4dc86aeb-d335-4e27-ac27-1dd4eb3d5e07 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Returning 404 to user: Instance 86b698ae-0ed3-4195-a604-1f3d1ec13d65 could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:10:15.803128 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-4dc86aeb-d335-4e27-ac27-1dd4eb3d5e07 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] 10.222.0.46 "GET /compute/v2.1/servers/86b698ae-0ed3-4195-a604-1f3d1ec13d65" status: 404 len: 111 microversion: 2.1 time: 0.045929 Jan 15 21:10:15.815495 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2965/5944] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:10:15 2022] GET /compute/v2.1/servers/86b698ae-0ed3-4195-a604-1f3d1ec13d65 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:10:15.821377 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3b264f0c-9392-4586-9fdf-316b954c636d tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:10:15.823403 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-3b264f0c-9392-4586-9fdf-316b954c636d tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] [instance: 9be0e0fd-270c-4d4e-a290-084ae916a1ea] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:10:15.830402 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3b264f0c-9392-4586-9fdf-316b954c636d tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:15.830815 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3b264f0c-9392-4586-9fdf-316b954c636d tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:15.832150 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3b264f0c-9392-4586-9fdf-316b954c636d tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:15.832658 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3b264f0c-9392-4586-9fdf-316b954c636d tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:15.952823 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-47445aa6-18ca-4f0e-9748-be35961eeaac tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8117ed926ac40dbbdcbca53cd668c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c8dd6789ba45a7a04452dc080a37cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:10:15.963764 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-47445aa6-18ca-4f0e-9748-be35961eeaac tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] 10.222.0.46 "GET /compute/v2.1/servers/c150ed13-89c9-4f8a-b20b-819effbc3bcc" status: 200 len: 1313 microversion: 2.1 time: 0.420557 Jan 15 21:10:15.966633 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2980/5945] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:10:15 2022] GET /compute/v2.1/servers/c150ed13-89c9-4f8a-b20b-819effbc3bcc => generated 1313 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:10:16.132371 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-3b264f0c-9392-4586-9fdf-316b954c636d tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0f3e53babe4627a41e11ee3e2992f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755ac4fd2f294bd4862f38492f48d4f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:10:16.146504 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3b264f0c-9392-4586-9fdf-316b954c636d tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] 10.222.0.46 "GET /compute/v2.1/servers/9be0e0fd-270c-4d4e-a290-084ae916a1ea" status: 200 len: 1510 microversion: 2.1 time: 0.324237 Jan 15 21:10:16.147430 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2966/5946] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:10:15 2022] GET /compute/v2.1/servers/9be0e0fd-270c-4d4e-a290-084ae916a1ea => generated 1510 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:10:16.984611 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-05f02194-f32e-4d24-ad66-dbd246b980f1 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:10:16.985396 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-05f02194-f32e-4d24-ad66-dbd246b980f1 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] [instance: c150ed13-89c9-4f8a-b20b-819effbc3bcc] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:10:16.992507 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-05f02194-f32e-4d24-ad66-dbd246b980f1 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:16.993009 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-05f02194-f32e-4d24-ad66-dbd246b980f1 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:16.993837 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-05f02194-f32e-4d24-ad66-dbd246b980f1 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:16.994273 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-05f02194-f32e-4d24-ad66-dbd246b980f1 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:17.164572 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b56411d5-7540-4817-9547-60cd0cd70497 tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:10:17.166548 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b56411d5-7540-4817-9547-60cd0cd70497 tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] [instance: 9be0e0fd-270c-4d4e-a290-084ae916a1ea] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:10:17.188057 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b56411d5-7540-4817-9547-60cd0cd70497 tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:17.188509 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b56411d5-7540-4817-9547-60cd0cd70497 tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:17.199436 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b56411d5-7540-4817-9547-60cd0cd70497 tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:17.203725 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b56411d5-7540-4817-9547-60cd0cd70497 tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:17.418348 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-05f02194-f32e-4d24-ad66-dbd246b980f1 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8117ed926ac40dbbdcbca53cd668c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c8dd6789ba45a7a04452dc080a37cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:10:17.427615 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-05f02194-f32e-4d24-ad66-dbd246b980f1 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] 10.222.0.46 "GET /compute/v2.1/servers/c150ed13-89c9-4f8a-b20b-819effbc3bcc" status: 200 len: 1313 microversion: 2.1 time: 0.447071 Jan 15 21:10:17.432149 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2981/5947] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:10:16 2022] GET /compute/v2.1/servers/c150ed13-89c9-4f8a-b20b-819effbc3bcc => generated 1313 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:10:17.574802 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-b56411d5-7540-4817-9547-60cd0cd70497 tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0f3e53babe4627a41e11ee3e2992f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755ac4fd2f294bd4862f38492f48d4f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:10:17.585847 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b56411d5-7540-4817-9547-60cd0cd70497 tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] 10.222.0.46 "GET /compute/v2.1/servers/9be0e0fd-270c-4d4e-a290-084ae916a1ea" status: 200 len: 1510 microversion: 2.1 time: 0.425369 Jan 15 21:10:17.586960 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2967/5948] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:10:17 2022] GET /compute/v2.1/servers/9be0e0fd-270c-4d4e-a290-084ae916a1ea => generated 1510 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:10:17.958217 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-a7c5e94b-c66f-406b-a12c-8667574645ae req-5d8d812c-b829-4718-a16e-ff0e2110c8fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9be0e0fd-270c-4d4e-a290-084ae916a1ea", "name": "network-vif-deleted", "tag": "545a7b8f-5716-4583-a500-c410de25d9d8"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:10:17.959904 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:10:17.959904 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:10:17.971727 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-a7c5e94b-c66f-406b-a12c-8667574645ae req-5d8d812c-b829-4718-a16e-ff0e2110c8fd service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:17.972209 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-a7c5e94b-c66f-406b-a12c-8667574645ae req-5d8d812c-b829-4718-a16e-ff0e2110c8fd service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:17.985889 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-a7c5e94b-c66f-406b-a12c-8667574645ae req-5d8d812c-b829-4718-a16e-ff0e2110c8fd service nova] Creating event network-vif-deleted:545a7b8f-5716-4583-a500-c410de25d9d8 for instance 9be0e0fd-270c-4d4e-a290-084ae916a1ea on nch1-master-1 Jan 15 21:10:17.991933 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-a7c5e94b-c66f-406b-a12c-8667574645ae req-5d8d812c-b829-4718-a16e-ff0e2110c8fd service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037417 Jan 15 21:10:17.992781 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2982/5949] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:10:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:10:18.455163 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5b4a7361-fad3-4fce-a182-cb7ea799537a tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:10:18.457028 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-5b4a7361-fad3-4fce-a182-cb7ea799537a tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] [instance: c150ed13-89c9-4f8a-b20b-819effbc3bcc] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:10:18.475588 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5b4a7361-fad3-4fce-a182-cb7ea799537a tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:18.479883 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5b4a7361-fad3-4fce-a182-cb7ea799537a tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:18.482271 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5b4a7361-fad3-4fce-a182-cb7ea799537a tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:18.484458 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5b4a7361-fad3-4fce-a182-cb7ea799537a tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:18.603555 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-904fccb7-0aa6-4280-80d6-454d11007394 tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:10:18.604552 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-904fccb7-0aa6-4280-80d6-454d11007394 tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] [instance: 9be0e0fd-270c-4d4e-a290-084ae916a1ea] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:10:18.619766 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-904fccb7-0aa6-4280-80d6-454d11007394 tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:18.627953 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-904fccb7-0aa6-4280-80d6-454d11007394 tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:18.631220 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-904fccb7-0aa6-4280-80d6-454d11007394 tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:18.631902 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-904fccb7-0aa6-4280-80d6-454d11007394 tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:18.740691 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-904fccb7-0aa6-4280-80d6-454d11007394 tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:18.743187 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-904fccb7-0aa6-4280-80d6-454d11007394 tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:18.745781 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.objects.instance [None req-904fccb7-0aa6-4280-80d6-454d11007394 tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Lazy-loading 'fault' on Instance uuid 9be0e0fd-270c-4d4e-a290-084ae916a1ea {{(pid=129366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 21:10:18.824893 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-904fccb7-0aa6-4280-80d6-454d11007394 tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0f3e53babe4627a41e11ee3e2992f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755ac4fd2f294bd4862f38492f48d4f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:10:18.828747 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-5b4a7361-fad3-4fce-a182-cb7ea799537a tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8117ed926ac40dbbdcbca53cd668c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c8dd6789ba45a7a04452dc080a37cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:10:18.837050 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5b4a7361-fad3-4fce-a182-cb7ea799537a tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] 10.222.0.46 "GET /compute/v2.1/servers/c150ed13-89c9-4f8a-b20b-819effbc3bcc" status: 200 len: 1313 microversion: 2.1 time: 0.393277 Jan 15 21:10:18.837919 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2968/5950] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:10:18 2022] GET /compute/v2.1/servers/c150ed13-89c9-4f8a-b20b-819effbc3bcc => generated 1313 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:10:18.849242 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-904fccb7-0aa6-4280-80d6-454d11007394 tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] 10.222.0.46 "GET /compute/v2.1/servers/9be0e0fd-270c-4d4e-a290-084ae916a1ea" status: 200 len: 1306 microversion: 2.1 time: 0.249627 Jan 15 21:10:18.849875 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2983/5951] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:10:18 2022] GET /compute/v2.1/servers/9be0e0fd-270c-4d4e-a290-084ae916a1ea => generated 1306 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:10:19.047587 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-34a85043-b0cc-4399-af57-aa0f0a86bee2 req-44e0da30-130b-42af-bef9-71de912866fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c150ed13-89c9-4f8a-b20b-819effbc3bcc", "name": "network-vif-plugged", "status": "completed", "tag": "58f07104-e0f7-47d8-9ec4-ca6f4efcb046"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:10:19.050452 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:10:19.050452 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:10:19.065586 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-34a85043-b0cc-4399-af57-aa0f0a86bee2 req-44e0da30-130b-42af-bef9-71de912866fb service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:19.066043 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-34a85043-b0cc-4399-af57-aa0f0a86bee2 req-44e0da30-130b-42af-bef9-71de912866fb service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:19.082142 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-34a85043-b0cc-4399-af57-aa0f0a86bee2 req-44e0da30-130b-42af-bef9-71de912866fb service nova] Creating event network-vif-plugged:58f07104-e0f7-47d8-9ec4-ca6f4efcb046 for instance c150ed13-89c9-4f8a-b20b-819effbc3bcc on nch2-master-1 Jan 15 21:10:19.088023 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-34a85043-b0cc-4399-af57-aa0f0a86bee2 req-44e0da30-130b-42af-bef9-71de912866fb service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044852 Jan 15 21:10:19.089055 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2969/5952] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:10:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:10:19.854268 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1c21eb1c-31df-4f01-a957-75cde92fcdf4 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:10:19.854876 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-1c21eb1c-31df-4f01-a957-75cde92fcdf4 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] [instance: c150ed13-89c9-4f8a-b20b-819effbc3bcc] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:10:19.867550 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1c21eb1c-31df-4f01-a957-75cde92fcdf4 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:19.868020 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1c21eb1c-31df-4f01-a957-75cde92fcdf4 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:19.869657 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1c21eb1c-31df-4f01-a957-75cde92fcdf4 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:19.869901 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8e9dd5b6-c21a-4e9c-904d-f3072d4ec124 tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:10:19.870348 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1c21eb1c-31df-4f01-a957-75cde92fcdf4 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:19.870624 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-8e9dd5b6-c21a-4e9c-904d-f3072d4ec124 tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] [instance: 9be0e0fd-270c-4d4e-a290-084ae916a1ea] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:10:19.883829 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8e9dd5b6-c21a-4e9c-904d-f3072d4ec124 tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:19.884997 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8e9dd5b6-c21a-4e9c-904d-f3072d4ec124 tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:19.887582 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8e9dd5b6-c21a-4e9c-904d-f3072d4ec124 tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:19.888176 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8e9dd5b6-c21a-4e9c-904d-f3072d4ec124 tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:19.924167 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-8e9dd5b6-c21a-4e9c-904d-f3072d4ec124 tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] HTTP exception thrown: Instance 9be0e0fd-270c-4d4e-a290-084ae916a1ea could not be found. Jan 15 21:10:19.928553 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8e9dd5b6-c21a-4e9c-904d-f3072d4ec124 tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] Returning 404 to user: Instance 9be0e0fd-270c-4d4e-a290-084ae916a1ea could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:10:19.930641 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-8e9dd5b6-c21a-4e9c-904d-f3072d4ec124 tempest-InstanceActionsTestJSON-376729662 tempest-InstanceActionsTestJSON-376729662-project] 10.222.0.46 "GET /compute/v2.1/servers/9be0e0fd-270c-4d4e-a290-084ae916a1ea" status: 404 len: 111 microversion: 2.1 time: 0.067385 Jan 15 21:10:19.937138 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2970/5953] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:10:19 2022] GET /compute/v2.1/servers/9be0e0fd-270c-4d4e-a290-084ae916a1ea => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 15 21:10:20.181197 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-1c21eb1c-31df-4f01-a957-75cde92fcdf4 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8117ed926ac40dbbdcbca53cd668c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c8dd6789ba45a7a04452dc080a37cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:10:20.194979 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-1c21eb1c-31df-4f01-a957-75cde92fcdf4 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] 10.222.0.46 "GET /compute/v2.1/servers/c150ed13-89c9-4f8a-b20b-819effbc3bcc" status: 200 len: 1313 microversion: 2.1 time: 0.342637 Jan 15 21:10:20.196260 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2984/5954] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:10:19 2022] GET /compute/v2.1/servers/c150ed13-89c9-4f8a-b20b-819effbc3bcc => generated 1313 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:10:21.212481 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-149e294d-c5bf-4931-bb42-35f87159547b tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:10:21.213850 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-149e294d-c5bf-4931-bb42-35f87159547b tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] [instance: c150ed13-89c9-4f8a-b20b-819effbc3bcc] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:10:21.223415 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-149e294d-c5bf-4931-bb42-35f87159547b tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:21.227689 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-149e294d-c5bf-4931-bb42-35f87159547b tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:21.228877 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-149e294d-c5bf-4931-bb42-35f87159547b tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:21.232428 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-149e294d-c5bf-4931-bb42-35f87159547b tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:21.649571 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-149e294d-c5bf-4931-bb42-35f87159547b tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8117ed926ac40dbbdcbca53cd668c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c8dd6789ba45a7a04452dc080a37cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:10:21.660295 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-149e294d-c5bf-4931-bb42-35f87159547b tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] 10.222.0.46 "GET /compute/v2.1/servers/c150ed13-89c9-4f8a-b20b-819effbc3bcc" status: 200 len: 1496 microversion: 2.1 time: 0.450518 Jan 15 21:10:21.672654 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2971/5955] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:10:21 2022] GET /compute/v2.1/servers/c150ed13-89c9-4f8a-b20b-819effbc3bcc => generated 1496 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:10:22.179412 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-532342f8-86f5-4f67-8b24-168c37810cc6 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:10:22.181334 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-532342f8-86f5-4f67-8b24-168c37810cc6 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] [instance: c150ed13-89c9-4f8a-b20b-819effbc3bcc] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:10:22.191845 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-532342f8-86f5-4f67-8b24-168c37810cc6 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:22.192554 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-532342f8-86f5-4f67-8b24-168c37810cc6 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:22.194113 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-532342f8-86f5-4f67-8b24-168c37810cc6 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:22.195101 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-532342f8-86f5-4f67-8b24-168c37810cc6 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:22.230468 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-532342f8-86f5-4f67-8b24-168c37810cc6 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] [instance: c150ed13-89c9-4f8a-b20b-819effbc3bcc] Going to try to terminate instance {{(pid=129366) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 21:10:22.338788 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-532342f8-86f5-4f67-8b24-168c37810cc6 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] 10.222.0.46 "DELETE /compute/v2.1/servers/c150ed13-89c9-4f8a-b20b-819effbc3bcc" status: 204 len: 0 microversion: 2.1 time: 0.162524 Jan 15 21:10:22.343543 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2985/5956] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 21:10:22 2022] DELETE /compute/v2.1/servers/c150ed13-89c9-4f8a-b20b-819effbc3bcc => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 21:10:22.349918 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a753bc52-876e-4df7-b6f3-84542d132427 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:10:22.350529 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a753bc52-876e-4df7-b6f3-84542d132427 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] [instance: c150ed13-89c9-4f8a-b20b-819effbc3bcc] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:10:22.358113 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a753bc52-876e-4df7-b6f3-84542d132427 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:22.359597 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a753bc52-876e-4df7-b6f3-84542d132427 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:22.360739 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a753bc52-876e-4df7-b6f3-84542d132427 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:22.361356 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a753bc52-876e-4df7-b6f3-84542d132427 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:22.409608 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f357b826-c778-4430-bc1d-fb6b71d75fd7 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-277463428", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "networks": [{"uuid": "2d9d48cd-f1ff-460c-8042-7a2e183af37d"}]}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:10:22.517836 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.network.neutron [None req-f357b826-c778-4430-bc1d-fb6b71d75fd7 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] validate_networks() for [('2d9d48cd-f1ff-460c-8042-7a2e183af37d', None, None, None, None, None)] {{(pid=129366) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 21:10:22.798788 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-a753bc52-876e-4df7-b6f3-84542d132427 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8117ed926ac40dbbdcbca53cd668c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c8dd6789ba45a7a04452dc080a37cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:10:22.812229 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a753bc52-876e-4df7-b6f3-84542d132427 tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] 10.222.0.46 "GET /compute/v2.1/servers/c150ed13-89c9-4f8a-b20b-819effbc3bcc" status: 200 len: 1502 microversion: 2.1 time: 0.466386 Jan 15 21:10:22.817455 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2972/5957] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:10:22 2022] GET /compute/v2.1/servers/c150ed13-89c9-4f8a-b20b-819effbc3bcc => generated 1502 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:10:23.262483 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-f357b826-c778-4430-bc1d-fb6b71d75fd7 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Flavor limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 21:10:23.264360 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-f357b826-c778-4430-bc1d-fb6b71d75fd7 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Image limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 21:10:23.265432 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-f357b826-c778-4430-bc1d-fb6b71d75fd7 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Flavor pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 21:10:23.265994 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-f357b826-c778-4430-bc1d-fb6b71d75fd7 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Image pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 21:10:23.266726 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-f357b826-c778-4430-bc1d-fb6b71d75fd7 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 21:10:23.293650 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f357b826-c778-4430-bc1d-fb6b71d75fd7 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:23.294938 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f357b826-c778-4430-bc1d-fb6b71d75fd7 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:23.296543 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f357b826-c778-4430-bc1d-fb6b71d75fd7 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:23.297597 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f357b826-c778-4430-bc1d-fb6b71d75fd7 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:23.331740 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-f357b826-c778-4430-bc1d-fb6b71d75fd7 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Getting quotas for project 3aa736a1907e4790b2ea49bc7f31e50c. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:10:23.341267 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-f357b826-c778-4430-bc1d-fb6b71d75fd7 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Getting quotas for user 6d2364cc12914bd3922a66feb86c5c80 and project 3aa736a1907e4790b2ea49bc7f31e50c. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:10:23.368680 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f357b826-c778-4430-bc1d-fb6b71d75fd7 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Going to run 1 instances... {{(pid=129366) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 21:10:23.373991 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f357b826-c778-4430-bc1d-fb6b71d75fd7 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] [instance: e978b725-2efe-42a9-83cb-e6343f132d14] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 21:10:23.452318 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f357b826-c778-4430-bc1d-fb6b71d75fd7 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.046831 Jan 15 21:10:23.453402 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2986/5958] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 21:10:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1049 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 21:10:23.465300 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b3ce0ab3-fabe-4027-8cd4-c1b54323fed2 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:10:23.465909 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b3ce0ab3-fabe-4027-8cd4-c1b54323fed2 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] [instance: e978b725-2efe-42a9-83cb-e6343f132d14] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:10:23.853656 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-b3ce0ab3-fabe-4027-8cd4-c1b54323fed2 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2364cc12914bd3922a66feb86c5c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa736a1907e4790b2ea49bc7f31e50c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:10:23.866548 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b3ce0ab3-fabe-4027-8cd4-c1b54323fed2 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] 10.222.0.46 "GET /compute/v2.1/servers/e978b725-2efe-42a9-83cb-e6343f132d14" status: 200 len: 1218 microversion: 2.1 time: 0.405144 Jan 15 21:10:23.881750 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2973/5959] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:10:23 2022] GET /compute/v2.1/servers/e978b725-2efe-42a9-83cb-e6343f132d14 => generated 1218 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:10:23.897083 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-6279a555-76dc-4ed4-a1b2-664e55e2edcc tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:10:23.897083 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-6279a555-76dc-4ed4-a1b2-664e55e2edcc tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] [instance: c150ed13-89c9-4f8a-b20b-819effbc3bcc] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:10:23.914106 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6279a555-76dc-4ed4-a1b2-664e55e2edcc tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:23.914892 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6279a555-76dc-4ed4-a1b2-664e55e2edcc tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:23.917462 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6279a555-76dc-4ed4-a1b2-664e55e2edcc tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:23.919457 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6279a555-76dc-4ed4-a1b2-664e55e2edcc tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:24.022827 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-041e4826-45c0-45da-ba10-61aa633fd097 tempest-MultipleCreateNegativeTestJSON-1231685015 tempest-MultipleCreateNegativeTestJSON-1231685015-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1803196568", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:10:24.024714 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-041e4826-45c0-45da-ba10-61aa633fd097 tempest-MultipleCreateNegativeTestJSON-1231685015 tempest-MultipleCreateNegativeTestJSON-1231685015-project] HTTP exception thrown: min_count must be <= max_count Jan 15 21:10:24.026216 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-041e4826-45c0-45da-ba10-61aa633fd097 tempest-MultipleCreateNegativeTestJSON-1231685015 tempest-MultipleCreateNegativeTestJSON-1231685015-project] Returning 400 to user: min_count must be <= max_count {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:10:24.027236 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-041e4826-45c0-45da-ba10-61aa633fd097 tempest-MultipleCreateNegativeTestJSON-1231685015 tempest-MultipleCreateNegativeTestJSON-1231685015-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.478046 Jan 15 21:10:24.030330 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2987/5960] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 21:10:23 2022] POST /compute/v2.1/servers => generated 74 bytes in 482 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Jan 15 21:10:24.116393 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8451065c-6c4b-4ab0-a63e-d0b08030af37 tempest-MultipleCreateNegativeTestJSON-1231685015 tempest-MultipleCreateNegativeTestJSON-1231685015-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1641025215", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "max_count": 0}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:10:24.118075 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8451065c-6c4b-4ab0-a63e-d0b08030af37 tempest-MultipleCreateNegativeTestJSON-1231685015 tempest-MultipleCreateNegativeTestJSON-1231685015-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:10:24.122481 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-8451065c-6c4b-4ab0-a63e-d0b08030af37 tempest-MultipleCreateNegativeTestJSON-1231685015 tempest-MultipleCreateNegativeTestJSON-1231685015-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.010184 Jan 15 21:10:24.123218 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2988/5961] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 21:10:24 2022] POST /compute/v2.1/servers => generated 130 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jan 15 21:10:24.207278 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-302e60bc-4ed2-4319-bdb4-4655a551a009 tempest-MultipleCreateNegativeTestJSON-1231685015 tempest-MultipleCreateNegativeTestJSON-1231685015-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2113281916", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "max_count": 2.5}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:10:24.210243 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-302e60bc-4ed2-4319-bdb4-4655a551a009 tempest-MultipleCreateNegativeTestJSON-1231685015 tempest-MultipleCreateNegativeTestJSON-1231685015-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:10:24.211757 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-302e60bc-4ed2-4319-bdb4-4655a551a009 tempest-MultipleCreateNegativeTestJSON-1231685015 tempest-MultipleCreateNegativeTestJSON-1231685015-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.010469 Jan 15 21:10:24.219946 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2989/5962] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 21:10:24 2022] POST /compute/v2.1/servers => generated 139 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jan 15 21:10:24.356062 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1d358600-832a-4c64-acca-e620e30bb7a5 tempest-MultipleCreateNegativeTestJSON-1231685015 tempest-MultipleCreateNegativeTestJSON-1231685015-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1396583110", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "min_count": 0}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:10:24.366899 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1d358600-832a-4c64-acca-e620e30bb7a5 tempest-MultipleCreateNegativeTestJSON-1231685015 tempest-MultipleCreateNegativeTestJSON-1231685015-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:10:24.368303 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-1d358600-832a-4c64-acca-e620e30bb7a5 tempest-MultipleCreateNegativeTestJSON-1231685015 tempest-MultipleCreateNegativeTestJSON-1231685015-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.016090 Jan 15 21:10:24.369841 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2990/5963] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 21:10:24 2022] POST /compute/v2.1/servers => generated 130 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 15 21:10:24.435995 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ba2b07e1-9ade-4d69-a996-6784ba42c3f7 tempest-MultipleCreateNegativeTestJSON-1231685015 tempest-MultipleCreateNegativeTestJSON-1231685015-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-147118824", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "min_count": 2.5}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:10:24.437544 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ba2b07e1-9ade-4d69-a996-6784ba42c3f7 tempest-MultipleCreateNegativeTestJSON-1231685015 tempest-MultipleCreateNegativeTestJSON-1231685015-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:10:24.438557 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ba2b07e1-9ade-4d69-a996-6784ba42c3f7 tempest-MultipleCreateNegativeTestJSON-1231685015 tempest-MultipleCreateNegativeTestJSON-1231685015-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.007296 Jan 15 21:10:24.439730 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2991/5964] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 21:10:24 2022] POST /compute/v2.1/servers => generated 139 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jan 15 21:10:24.620350 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-6279a555-76dc-4ed4-a1b2-664e55e2edcc tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8117ed926ac40dbbdcbca53cd668c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c8dd6789ba45a7a04452dc080a37cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:10:24.631967 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-6279a555-76dc-4ed4-a1b2-664e55e2edcc tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] 10.222.0.46 "GET /compute/v2.1/servers/c150ed13-89c9-4f8a-b20b-819effbc3bcc" status: 200 len: 1502 microversion: 2.1 time: 0.748597 Jan 15 21:10:24.644391 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2974/5965] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:10:23 2022] GET /compute/v2.1/servers/c150ed13-89c9-4f8a-b20b-819effbc3bcc => generated 1502 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:10:24.649152 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-732a1428-de5d-47b5-a46f-05f4af9a5c38 req-86626ef1-52b6-400b-8f44-bdeeb1a0a580 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c150ed13-89c9-4f8a-b20b-819effbc3bcc", "name": "network-vif-deleted", "tag": "58f07104-e0f7-47d8-9ec4-ca6f4efcb046"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:10:24.651871 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:10:24.651871 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:10:24.670167 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-732a1428-de5d-47b5-a46f-05f4af9a5c38 req-86626ef1-52b6-400b-8f44-bdeeb1a0a580 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:24.674715 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-732a1428-de5d-47b5-a46f-05f4af9a5c38 req-86626ef1-52b6-400b-8f44-bdeeb1a0a580 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:24.698351 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-732a1428-de5d-47b5-a46f-05f4af9a5c38 req-86626ef1-52b6-400b-8f44-bdeeb1a0a580 service nova] Creating event network-vif-deleted:58f07104-e0f7-47d8-9ec4-ca6f4efcb046 for instance c150ed13-89c9-4f8a-b20b-819effbc3bcc on nch2-master-1 Jan 15 21:10:24.703824 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-732a1428-de5d-47b5-a46f-05f4af9a5c38 req-86626ef1-52b6-400b-8f44-bdeeb1a0a580 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058389 Jan 15 21:10:24.704937 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2992/5966] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:10:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:10:24.885748 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-358f27b8-4347-4e7a-abfe-c0edc752a294 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:10:24.886358 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-358f27b8-4347-4e7a-abfe-c0edc752a294 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] [instance: e978b725-2efe-42a9-83cb-e6343f132d14] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:10:24.902704 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-358f27b8-4347-4e7a-abfe-c0edc752a294 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:24.903791 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-358f27b8-4347-4e7a-abfe-c0edc752a294 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:24.908197 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-358f27b8-4347-4e7a-abfe-c0edc752a294 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:24.908616 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-358f27b8-4347-4e7a-abfe-c0edc752a294 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:25.093190 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-358f27b8-4347-4e7a-abfe-c0edc752a294 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2364cc12914bd3922a66feb86c5c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa736a1907e4790b2ea49bc7f31e50c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:10:25.102225 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-358f27b8-4347-4e7a-abfe-c0edc752a294 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] 10.222.0.46 "GET /compute/v2.1/servers/e978b725-2efe-42a9-83cb-e6343f132d14" status: 200 len: 1270 microversion: 2.1 time: 0.221105 Jan 15 21:10:25.102813 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2975/5967] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:10:24 2022] GET /compute/v2.1/servers/e978b725-2efe-42a9-83cb-e6343f132d14 => generated 1270 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:10:25.658870 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4955467f-ed53-434e-9ebf-b117d85fb53b tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:10:25.659568 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-4955467f-ed53-434e-9ebf-b117d85fb53b tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] [instance: c150ed13-89c9-4f8a-b20b-819effbc3bcc] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:10:25.666388 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4955467f-ed53-434e-9ebf-b117d85fb53b tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:25.667191 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4955467f-ed53-434e-9ebf-b117d85fb53b tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:25.668365 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4955467f-ed53-434e-9ebf-b117d85fb53b tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:25.668797 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4955467f-ed53-434e-9ebf-b117d85fb53b tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:25.683303 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-4955467f-ed53-434e-9ebf-b117d85fb53b tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] HTTP exception thrown: Instance c150ed13-89c9-4f8a-b20b-819effbc3bcc could not be found. Jan 15 21:10:25.684233 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4955467f-ed53-434e-9ebf-b117d85fb53b tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] Returning 404 to user: Instance c150ed13-89c9-4f8a-b20b-819effbc3bcc could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:10:25.685854 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-4955467f-ed53-434e-9ebf-b117d85fb53b tempest-VolumesActionsTest-777683023 tempest-VolumesActionsTest-777683023-project] 10.222.0.46 "GET /compute/v2.1/servers/c150ed13-89c9-4f8a-b20b-819effbc3bcc" status: 404 len: 111 microversion: 2.1 time: 0.038579 Jan 15 21:10:25.686935 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2993/5968] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:10:25 2022] GET /compute/v2.1/servers/c150ed13-89c9-4f8a-b20b-819effbc3bcc => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:10:26.119319 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-041d1e04-1a1f-47ef-80d7-4c86f1cceb24 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:10:26.119926 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-041d1e04-1a1f-47ef-80d7-4c86f1cceb24 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] [instance: e978b725-2efe-42a9-83cb-e6343f132d14] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:10:26.136954 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-041d1e04-1a1f-47ef-80d7-4c86f1cceb24 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:26.142658 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-041d1e04-1a1f-47ef-80d7-4c86f1cceb24 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:26.143951 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-041d1e04-1a1f-47ef-80d7-4c86f1cceb24 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:26.145066 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-041d1e04-1a1f-47ef-80d7-4c86f1cceb24 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:26.666831 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-041d1e04-1a1f-47ef-80d7-4c86f1cceb24 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2364cc12914bd3922a66feb86c5c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa736a1907e4790b2ea49bc7f31e50c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:10:26.677510 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-041d1e04-1a1f-47ef-80d7-4c86f1cceb24 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] 10.222.0.46 "GET /compute/v2.1/servers/e978b725-2efe-42a9-83cb-e6343f132d14" status: 200 len: 1318 microversion: 2.1 time: 0.559456 Jan 15 21:10:26.678135 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2976/5969] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:10:26 2022] GET /compute/v2.1/servers/e978b725-2efe-42a9-83cb-e6343f132d14 => generated 1318 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:10:27.694762 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1ea64d4a-d818-4301-a1dd-a90a2e094144 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:10:27.695503 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-1ea64d4a-d818-4301-a1dd-a90a2e094144 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] [instance: e978b725-2efe-42a9-83cb-e6343f132d14] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:10:27.708324 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1ea64d4a-d818-4301-a1dd-a90a2e094144 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:27.709682 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1ea64d4a-d818-4301-a1dd-a90a2e094144 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:27.710651 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1ea64d4a-d818-4301-a1dd-a90a2e094144 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:27.720668 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1ea64d4a-d818-4301-a1dd-a90a2e094144 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:27.752485 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-2a17de59-017c-4fff-88f5-ca1287f6bcbf req-068d52ad-4ffa-4616-909f-c18a85e9c472 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e978b725-2efe-42a9-83cb-e6343f132d14", "tag": "d46b9724-0123-47b5-a443-4daf591a33d4"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:10:27.756261 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:10:27.756261 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:10:27.799801 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-2a17de59-017c-4fff-88f5-ca1287f6bcbf req-068d52ad-4ffa-4616-909f-c18a85e9c472 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:27.803495 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-2a17de59-017c-4fff-88f5-ca1287f6bcbf req-068d52ad-4ffa-4616-909f-c18a85e9c472 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:27.845103 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-2a17de59-017c-4fff-88f5-ca1287f6bcbf req-068d52ad-4ffa-4616-909f-c18a85e9c472 service nova] Creating event network-changed:d46b9724-0123-47b5-a443-4daf591a33d4 for instance e978b725-2efe-42a9-83cb-e6343f132d14 on nch1-master-1 Jan 15 21:10:27.856101 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-2a17de59-017c-4fff-88f5-ca1287f6bcbf req-068d52ad-4ffa-4616-909f-c18a85e9c472 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110258 Jan 15 21:10:27.859530 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2977/5970] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:10:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:10:28.372589 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-1ea64d4a-d818-4301-a1dd-a90a2e094144 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2364cc12914bd3922a66feb86c5c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa736a1907e4790b2ea49bc7f31e50c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:10:28.385935 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-1ea64d4a-d818-4301-a1dd-a90a2e094144 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] 10.222.0.46 "GET /compute/v2.1/servers/e978b725-2efe-42a9-83cb-e6343f132d14" status: 200 len: 1318 microversion: 2.1 time: 0.694444 Jan 15 21:10:28.389257 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2994/5971] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:10:27 2022] GET /compute/v2.1/servers/e978b725-2efe-42a9-83cb-e6343f132d14 => generated 1318 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:10:29.416233 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f61088d0-fd1c-4c3c-a944-7a9f2a990abc tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:10:29.418623 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f61088d0-fd1c-4c3c-a944-7a9f2a990abc tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] [instance: e978b725-2efe-42a9-83cb-e6343f132d14] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:10:29.438562 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f61088d0-fd1c-4c3c-a944-7a9f2a990abc tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:29.442166 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f61088d0-fd1c-4c3c-a944-7a9f2a990abc tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:29.444182 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f61088d0-fd1c-4c3c-a944-7a9f2a990abc tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:29.445867 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f61088d0-fd1c-4c3c-a944-7a9f2a990abc tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:30.317956 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-f61088d0-fd1c-4c3c-a944-7a9f2a990abc tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2364cc12914bd3922a66feb86c5c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa736a1907e4790b2ea49bc7f31e50c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:10:30.343943 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f61088d0-fd1c-4c3c-a944-7a9f2a990abc tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] 10.222.0.46 "GET /compute/v2.1/servers/e978b725-2efe-42a9-83cb-e6343f132d14" status: 200 len: 1318 microversion: 2.1 time: 0.943812 Jan 15 21:10:30.344547 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2978/5972] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:10:29 2022] GET /compute/v2.1/servers/e978b725-2efe-42a9-83cb-e6343f132d14 => generated 1318 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:10:31.360541 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-31dba610-866e-4b25-858f-2e8c6a6adb96 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:10:31.364358 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-31dba610-866e-4b25-858f-2e8c6a6adb96 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] [instance: e978b725-2efe-42a9-83cb-e6343f132d14] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:10:31.383561 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-31dba610-866e-4b25-858f-2e8c6a6adb96 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:31.384012 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-31dba610-866e-4b25-858f-2e8c6a6adb96 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:31.384806 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-31dba610-866e-4b25-858f-2e8c6a6adb96 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:31.385403 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-31dba610-866e-4b25-858f-2e8c6a6adb96 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:32.002258 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-31dba610-866e-4b25-858f-2e8c6a6adb96 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2364cc12914bd3922a66feb86c5c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa736a1907e4790b2ea49bc7f31e50c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:10:32.025483 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-31dba610-866e-4b25-858f-2e8c6a6adb96 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] 10.222.0.46 "GET /compute/v2.1/servers/e978b725-2efe-42a9-83cb-e6343f132d14" status: 200 len: 1318 microversion: 2.1 time: 0.668999 Jan 15 21:10:32.026788 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2995/5973] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:10:31 2022] GET /compute/v2.1/servers/e978b725-2efe-42a9-83cb-e6343f132d14 => generated 1318 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:10:33.046529 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e9d4b833-038d-4c0d-9d17-5a0b76af5b5a tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:10:33.047212 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e9d4b833-038d-4c0d-9d17-5a0b76af5b5a tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] [instance: e978b725-2efe-42a9-83cb-e6343f132d14] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:10:33.064346 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e9d4b833-038d-4c0d-9d17-5a0b76af5b5a tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:33.065830 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e9d4b833-038d-4c0d-9d17-5a0b76af5b5a tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:33.069082 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e9d4b833-038d-4c0d-9d17-5a0b76af5b5a tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:33.071737 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e9d4b833-038d-4c0d-9d17-5a0b76af5b5a tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:33.754954 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-0bc8b59a-29b5-4721-ad41-531765499479 req-ac00b674-edb9-4410-85b5-eb5da2871577 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e978b725-2efe-42a9-83cb-e6343f132d14", "name": "network-vif-plugged", "status": "completed", "tag": "d46b9724-0123-47b5-a443-4daf591a33d4"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:10:33.761830 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:10:33.761830 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:10:33.796071 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-0bc8b59a-29b5-4721-ad41-531765499479 req-ac00b674-edb9-4410-85b5-eb5da2871577 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:33.797033 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-0bc8b59a-29b5-4721-ad41-531765499479 req-ac00b674-edb9-4410-85b5-eb5da2871577 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:33.826981 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-0bc8b59a-29b5-4721-ad41-531765499479 req-ac00b674-edb9-4410-85b5-eb5da2871577 service nova] Creating event network-vif-plugged:d46b9724-0123-47b5-a443-4daf591a33d4 for instance e978b725-2efe-42a9-83cb-e6343f132d14 on nch1-master-1 Jan 15 21:10:33.840250 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-0bc8b59a-29b5-4721-ad41-531765499479 req-ac00b674-edb9-4410-85b5-eb5da2871577 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095067 Jan 15 21:10:33.842905 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2996/5974] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:10:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:10:33.887470 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-e9d4b833-038d-4c0d-9d17-5a0b76af5b5a tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2364cc12914bd3922a66feb86c5c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa736a1907e4790b2ea49bc7f31e50c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:10:33.898424 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e9d4b833-038d-4c0d-9d17-5a0b76af5b5a tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] 10.222.0.46 "GET /compute/v2.1/servers/e978b725-2efe-42a9-83cb-e6343f132d14" status: 200 len: 1318 microversion: 2.1 time: 0.857870 Jan 15 21:10:33.899255 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2979/5975] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:10:33 2022] GET /compute/v2.1/servers/e978b725-2efe-42a9-83cb-e6343f132d14 => generated 1318 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:10:34.917893 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7389917d-68d0-4e33-a7a9-f9eb44e9563f tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:10:34.918623 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-7389917d-68d0-4e33-a7a9-f9eb44e9563f tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] [instance: e978b725-2efe-42a9-83cb-e6343f132d14] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:10:34.943610 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7389917d-68d0-4e33-a7a9-f9eb44e9563f tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:34.944057 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7389917d-68d0-4e33-a7a9-f9eb44e9563f tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:34.944889 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7389917d-68d0-4e33-a7a9-f9eb44e9563f tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:34.945329 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7389917d-68d0-4e33-a7a9-f9eb44e9563f tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:35.836506 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-7389917d-68d0-4e33-a7a9-f9eb44e9563f tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2364cc12914bd3922a66feb86c5c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa736a1907e4790b2ea49bc7f31e50c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:10:35.849328 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7389917d-68d0-4e33-a7a9-f9eb44e9563f tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] 10.222.0.46 "GET /compute/v2.1/servers/e978b725-2efe-42a9-83cb-e6343f132d14" status: 200 len: 1318 microversion: 2.1 time: 0.936774 Jan 15 21:10:35.865736 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2997/5976] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:10:34 2022] GET /compute/v2.1/servers/e978b725-2efe-42a9-83cb-e6343f132d14 => generated 1318 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:10:36.871055 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-1b968fa1-3b65-41fa-9e2c-9da081c79ef9 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:10:36.872119 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-1b968fa1-3b65-41fa-9e2c-9da081c79ef9 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] [instance: e978b725-2efe-42a9-83cb-e6343f132d14] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:10:36.904642 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1b968fa1-3b65-41fa-9e2c-9da081c79ef9 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:36.906925 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1b968fa1-3b65-41fa-9e2c-9da081c79ef9 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:36.912115 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1b968fa1-3b65-41fa-9e2c-9da081c79ef9 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:36.912741 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1b968fa1-3b65-41fa-9e2c-9da081c79ef9 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:37.521923 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-1b968fa1-3b65-41fa-9e2c-9da081c79ef9 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2364cc12914bd3922a66feb86c5c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa736a1907e4790b2ea49bc7f31e50c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:10:37.529937 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-1b968fa1-3b65-41fa-9e2c-9da081c79ef9 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] 10.222.0.46 "GET /compute/v2.1/servers/e978b725-2efe-42a9-83cb-e6343f132d14" status: 200 len: 1507 microversion: 2.1 time: 0.665144 Jan 15 21:10:37.545260 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2980/5977] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:10:36 2022] GET /compute/v2.1/servers/e978b725-2efe-42a9-83cb-e6343f132d14 => generated 1507 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:10:37.547352 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-cb8dcd5d-2987-4eae-a6c4-690dfbb529cf tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "54e36e7f-6e75-428b-97f3-c673d414e0e9", "device": "/dev/sdb"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:10:37.549378 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-cb8dcd5d-2987-4eae-a6c4-690dfbb529cf tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] [instance: e978b725-2efe-42a9-83cb-e6343f132d14] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:10:37.570439 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cb8dcd5d-2987-4eae-a6c4-690dfbb529cf tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:37.578006 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cb8dcd5d-2987-4eae-a6c4-690dfbb529cf tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:37.579361 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cb8dcd5d-2987-4eae-a6c4-690dfbb529cf tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:37.585085 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cb8dcd5d-2987-4eae-a6c4-690dfbb529cf tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:38.151656 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-cb8dcd5d-2987-4eae-a6c4-690dfbb529cf tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] 10.222.0.46 "POST /compute/v2.1/servers/e978b725-2efe-42a9-83cb-e6343f132d14/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.608394 Jan 15 21:10:38.170156 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2998/5978] 10.222.0.46 () {60 vars in 1322 bytes} [Sat Jan 15 21:10:37 2022] POST /compute/v2.1/servers/e978b725-2efe-42a9-83cb-e6343f132d14/os-volume_attachments => generated 194 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:10:41.600461 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-58d7a3dc-83fb-4c05-b08d-b74f6b70d652 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1630351223", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "199105de-00cd-44b3-8e15-12c91d44ad90"}]}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:10:41.737235 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.network.neutron [None req-58d7a3dc-83fb-4c05-b08d-b74f6b70d652 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] validate_networks() for [('199105de-00cd-44b3-8e15-12c91d44ad90', None, None, None, None, None)] {{(pid=129365) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 21:10:43.255191 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-58d7a3dc-83fb-4c05-b08d-b74f6b70d652 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Flavor limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 21:10:43.256586 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-58d7a3dc-83fb-4c05-b08d-b74f6b70d652 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Image limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 21:10:43.257516 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-58d7a3dc-83fb-4c05-b08d-b74f6b70d652 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Flavor pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 21:10:43.258211 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-58d7a3dc-83fb-4c05-b08d-b74f6b70d652 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Image pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 21:10:43.258879 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-58d7a3dc-83fb-4c05-b08d-b74f6b70d652 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 21:10:43.291267 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-58d7a3dc-83fb-4c05-b08d-b74f6b70d652 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:43.292781 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-58d7a3dc-83fb-4c05-b08d-b74f6b70d652 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:43.297826 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-58d7a3dc-83fb-4c05-b08d-b74f6b70d652 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:43.299957 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-58d7a3dc-83fb-4c05-b08d-b74f6b70d652 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:43.363723 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-58d7a3dc-83fb-4c05-b08d-b74f6b70d652 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Getting quotas for project 7d4a162d96614ece8caf16ccbc99ad5f. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:10:43.398314 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-58d7a3dc-83fb-4c05-b08d-b74f6b70d652 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Getting quotas for user 0e6aa71a6c814c758e2a28a5d7c6e5a6 and project 7d4a162d96614ece8caf16ccbc99ad5f. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:10:43.454018 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-58d7a3dc-83fb-4c05-b08d-b74f6b70d652 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Going to run 1 instances... {{(pid=129365) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 21:10:43.474096 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-58d7a3dc-83fb-4c05-b08d-b74f6b70d652 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] [instance: 20b5b2d2-e5cc-4c06-9420-9fbf3569996c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129365) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 21:10:43.658370 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-58d7a3dc-83fb-4c05-b08d-b74f6b70d652 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.389015 Jan 15 21:10:43.659327 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2981/5979] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 21:10:41 2022] POST /compute/v2.1/servers => generated 383 bytes in 2391 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 21:10:43.671912 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-592122f3-23ac-4c91-83ad-480063c9ee37 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:10:43.673304 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-592122f3-23ac-4c91-83ad-480063c9ee37 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] [instance: 20b5b2d2-e5cc-4c06-9420-9fbf3569996c] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:10:43.811712 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-592122f3-23ac-4c91-83ad-480063c9ee37 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6aa71a6c814c758e2a28a5d7c6e5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4a162d96614ece8caf16ccbc99ad5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:10:43.820171 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-592122f3-23ac-4c91-83ad-480063c9ee37 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] 10.222.0.46 "GET /compute/v2.1/servers/20b5b2d2-e5cc-4c06-9420-9fbf3569996c" status: 200 len: 1214 microversion: 2.1 time: 0.154556 Jan 15 21:10:43.824201 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 2999/5980] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:10:43 2022] GET /compute/v2.1/servers/20b5b2d2-e5cc-4c06-9420-9fbf3569996c => generated 1214 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:10:44.837676 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-613fa471-5f83-4741-9bbc-5bc0e8b16ff4 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:10:44.838333 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-613fa471-5f83-4741-9bbc-5bc0e8b16ff4 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] [instance: 20b5b2d2-e5cc-4c06-9420-9fbf3569996c] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:10:44.852249 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-613fa471-5f83-4741-9bbc-5bc0e8b16ff4 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:44.852707 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-613fa471-5f83-4741-9bbc-5bc0e8b16ff4 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:44.873346 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-613fa471-5f83-4741-9bbc-5bc0e8b16ff4 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:44.873794 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-613fa471-5f83-4741-9bbc-5bc0e8b16ff4 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:45.174500 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-613fa471-5f83-4741-9bbc-5bc0e8b16ff4 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6aa71a6c814c758e2a28a5d7c6e5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4a162d96614ece8caf16ccbc99ad5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:10:45.189708 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-613fa471-5f83-4741-9bbc-5bc0e8b16ff4 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] 10.222.0.46 "GET /compute/v2.1/servers/20b5b2d2-e5cc-4c06-9420-9fbf3569996c" status: 200 len: 1210 microversion: 2.1 time: 0.355494 Jan 15 21:10:45.195224 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2982/5981] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:10:44 2022] GET /compute/v2.1/servers/20b5b2d2-e5cc-4c06-9420-9fbf3569996c => generated 1210 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:10:46.207770 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-2fbb8340-25fb-4b19-aa06-bb8ada8642ef tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:10:46.208865 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-2fbb8340-25fb-4b19-aa06-bb8ada8642ef tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] [instance: 20b5b2d2-e5cc-4c06-9420-9fbf3569996c] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:10:46.233441 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2fbb8340-25fb-4b19-aa06-bb8ada8642ef tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:46.237121 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2fbb8340-25fb-4b19-aa06-bb8ada8642ef tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:46.240907 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2fbb8340-25fb-4b19-aa06-bb8ada8642ef tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:46.242634 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2fbb8340-25fb-4b19-aa06-bb8ada8642ef tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:46.480196 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-2fbb8340-25fb-4b19-aa06-bb8ada8642ef tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6aa71a6c814c758e2a28a5d7c6e5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4a162d96614ece8caf16ccbc99ad5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:10:46.495957 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-2fbb8340-25fb-4b19-aa06-bb8ada8642ef tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] 10.222.0.46 "GET /compute/v2.1/servers/20b5b2d2-e5cc-4c06-9420-9fbf3569996c" status: 200 len: 1272 microversion: 2.1 time: 0.292341 Jan 15 21:10:46.502982 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3000/5982] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:10:46 2022] GET /compute/v2.1/servers/20b5b2d2-e5cc-4c06-9420-9fbf3569996c => generated 1272 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:10:47.516186 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e6013c39-64bc-43c6-9bd9-dfd22692ba3d tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:10:47.516790 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e6013c39-64bc-43c6-9bd9-dfd22692ba3d tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] [instance: 20b5b2d2-e5cc-4c06-9420-9fbf3569996c] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:10:47.530266 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e6013c39-64bc-43c6-9bd9-dfd22692ba3d tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:47.530628 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e6013c39-64bc-43c6-9bd9-dfd22692ba3d tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:47.531420 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e6013c39-64bc-43c6-9bd9-dfd22692ba3d tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:47.546658 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e6013c39-64bc-43c6-9bd9-dfd22692ba3d tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:47.666277 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-e6013c39-64bc-43c6-9bd9-dfd22692ba3d tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6aa71a6c814c758e2a28a5d7c6e5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4a162d96614ece8caf16ccbc99ad5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:10:47.688800 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e6013c39-64bc-43c6-9bd9-dfd22692ba3d tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] 10.222.0.46 "GET /compute/v2.1/servers/20b5b2d2-e5cc-4c06-9420-9fbf3569996c" status: 200 len: 1272 microversion: 2.1 time: 0.176776 Jan 15 21:10:47.702270 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2983/5983] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:10:47 2022] GET /compute/v2.1/servers/20b5b2d2-e5cc-4c06-9420-9fbf3569996c => generated 1272 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:10:48.707760 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7f0da540-c4a9-4a60-b567-4c8935b63340 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:10:48.708365 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-7f0da540-c4a9-4a60-b567-4c8935b63340 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] [instance: 20b5b2d2-e5cc-4c06-9420-9fbf3569996c] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:10:48.735257 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7f0da540-c4a9-4a60-b567-4c8935b63340 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:48.737347 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7f0da540-c4a9-4a60-b567-4c8935b63340 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:48.742170 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7f0da540-c4a9-4a60-b567-4c8935b63340 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:48.744549 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7f0da540-c4a9-4a60-b567-4c8935b63340 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:49.542466 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-7f0da540-c4a9-4a60-b567-4c8935b63340 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6aa71a6c814c758e2a28a5d7c6e5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4a162d96614ece8caf16ccbc99ad5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:10:49.566896 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7f0da540-c4a9-4a60-b567-4c8935b63340 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] 10.222.0.46 "GET /compute/v2.1/servers/20b5b2d2-e5cc-4c06-9420-9fbf3569996c" status: 200 len: 1314 microversion: 2.1 time: 0.863044 Jan 15 21:10:49.589730 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3001/5984] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:10:48 2022] GET /compute/v2.1/servers/20b5b2d2-e5cc-4c06-9420-9fbf3569996c => generated 1314 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:10:50.584934 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3f764c5c-0e95-4749-8ef4-be8baf5257c7 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:10:50.585582 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-3f764c5c-0e95-4749-8ef4-be8baf5257c7 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] [instance: 20b5b2d2-e5cc-4c06-9420-9fbf3569996c] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:10:50.609395 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3f764c5c-0e95-4749-8ef4-be8baf5257c7 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:50.614021 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3f764c5c-0e95-4749-8ef4-be8baf5257c7 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:50.614887 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3f764c5c-0e95-4749-8ef4-be8baf5257c7 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:50.615328 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3f764c5c-0e95-4749-8ef4-be8baf5257c7 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:51.478709 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-3f764c5c-0e95-4749-8ef4-be8baf5257c7 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6aa71a6c814c758e2a28a5d7c6e5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4a162d96614ece8caf16ccbc99ad5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:10:51.489944 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3f764c5c-0e95-4749-8ef4-be8baf5257c7 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] 10.222.0.46 "GET /compute/v2.1/servers/20b5b2d2-e5cc-4c06-9420-9fbf3569996c" status: 200 len: 1314 microversion: 2.1 time: 0.909321 Jan 15 21:10:51.504487 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2984/5985] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:10:50 2022] GET /compute/v2.1/servers/20b5b2d2-e5cc-4c06-9420-9fbf3569996c => generated 1314 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:10:52.511522 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c901ee59-ae52-4874-b019-2644ad745ad7 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:10:52.512927 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c901ee59-ae52-4874-b019-2644ad745ad7 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] [instance: 20b5b2d2-e5cc-4c06-9420-9fbf3569996c] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:10:52.527914 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c901ee59-ae52-4874-b019-2644ad745ad7 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:52.532821 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c901ee59-ae52-4874-b019-2644ad745ad7 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:52.536612 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c901ee59-ae52-4874-b019-2644ad745ad7 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:52.537266 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c901ee59-ae52-4874-b019-2644ad745ad7 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:52.814390 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-8c9c67e0-0537-4395-a4c4-e57cd61c702f req-3c9305d2-6048-4937-9b2c-0e8cb0a2eed8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20b5b2d2-e5cc-4c06-9420-9fbf3569996c", "tag": "6a3f67e3-ca30-403f-b17c-08c9e8c882f1"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:10:52.815957 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:10:52.815957 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:10:52.827808 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-8c9c67e0-0537-4395-a4c4-e57cd61c702f req-3c9305d2-6048-4937-9b2c-0e8cb0a2eed8 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:52.828244 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-8c9c67e0-0537-4395-a4c4-e57cd61c702f req-3c9305d2-6048-4937-9b2c-0e8cb0a2eed8 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:52.860323 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-8c9c67e0-0537-4395-a4c4-e57cd61c702f req-3c9305d2-6048-4937-9b2c-0e8cb0a2eed8 service nova] Creating event network-changed:6a3f67e3-ca30-403f-b17c-08c9e8c882f1 for instance 20b5b2d2-e5cc-4c06-9420-9fbf3569996c on nch2-master-1 Jan 15 21:10:52.876601 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-8c9c67e0-0537-4395-a4c4-e57cd61c702f req-3c9305d2-6048-4937-9b2c-0e8cb0a2eed8 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067500 Jan 15 21:10:52.877581 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2985/5986] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:10:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:10:52.912120 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-c901ee59-ae52-4874-b019-2644ad745ad7 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6aa71a6c814c758e2a28a5d7c6e5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4a162d96614ece8caf16ccbc99ad5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:10:52.922732 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c901ee59-ae52-4874-b019-2644ad745ad7 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] 10.222.0.46 "GET /compute/v2.1/servers/20b5b2d2-e5cc-4c06-9420-9fbf3569996c" status: 200 len: 1314 microversion: 2.1 time: 0.415243 Jan 15 21:10:52.928230 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3002/5987] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:10:52 2022] GET /compute/v2.1/servers/20b5b2d2-e5cc-4c06-9420-9fbf3569996c => generated 1314 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:10:53.946578 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ded706e6-3565-4747-ac14-eec5ecbefbda tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:10:53.947939 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ded706e6-3565-4747-ac14-eec5ecbefbda tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] [instance: 20b5b2d2-e5cc-4c06-9420-9fbf3569996c] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:10:53.960414 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ded706e6-3565-4747-ac14-eec5ecbefbda tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:53.963942 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ded706e6-3565-4747-ac14-eec5ecbefbda tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:53.967866 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ded706e6-3565-4747-ac14-eec5ecbefbda tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:53.969207 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ded706e6-3565-4747-ac14-eec5ecbefbda tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:54.483500 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-ded706e6-3565-4747-ac14-eec5ecbefbda tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6aa71a6c814c758e2a28a5d7c6e5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4a162d96614ece8caf16ccbc99ad5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:10:54.500116 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ded706e6-3565-4747-ac14-eec5ecbefbda tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] 10.222.0.46 "GET /compute/v2.1/servers/20b5b2d2-e5cc-4c06-9420-9fbf3569996c" status: 200 len: 1314 microversion: 2.1 time: 0.555564 Jan 15 21:10:54.526627 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2986/5988] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:10:53 2022] GET /compute/v2.1/servers/20b5b2d2-e5cc-4c06-9420-9fbf3569996c => generated 1314 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:10:55.521211 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-76200d3d-f951-4789-8205-c69127c09878 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:10:55.521769 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-76200d3d-f951-4789-8205-c69127c09878 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] [instance: 20b5b2d2-e5cc-4c06-9420-9fbf3569996c] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:10:55.532153 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-76200d3d-f951-4789-8205-c69127c09878 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:55.534419 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-76200d3d-f951-4789-8205-c69127c09878 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:55.536402 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-76200d3d-f951-4789-8205-c69127c09878 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:55.537026 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-76200d3d-f951-4789-8205-c69127c09878 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:56.108145 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-76200d3d-f951-4789-8205-c69127c09878 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6aa71a6c814c758e2a28a5d7c6e5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4a162d96614ece8caf16ccbc99ad5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:10:56.117352 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-76200d3d-f951-4789-8205-c69127c09878 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] 10.222.0.46 "GET /compute/v2.1/servers/20b5b2d2-e5cc-4c06-9420-9fbf3569996c" status: 200 len: 1314 microversion: 2.1 time: 0.601686 Jan 15 21:10:56.118538 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3003/5989] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:10:55 2022] GET /compute/v2.1/servers/20b5b2d2-e5cc-4c06-9420-9fbf3569996c => generated 1314 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:10:57.138965 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3d3ab289-0c60-4b12-82f3-a9512dfd931c tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:10:57.140511 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-3d3ab289-0c60-4b12-82f3-a9512dfd931c tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] [instance: 20b5b2d2-e5cc-4c06-9420-9fbf3569996c] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:10:57.175385 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3d3ab289-0c60-4b12-82f3-a9512dfd931c tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:57.178085 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3d3ab289-0c60-4b12-82f3-a9512dfd931c tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:57.179157 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3d3ab289-0c60-4b12-82f3-a9512dfd931c tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:57.180473 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3d3ab289-0c60-4b12-82f3-a9512dfd931c tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:57.720354 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-3d3ab289-0c60-4b12-82f3-a9512dfd931c tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6aa71a6c814c758e2a28a5d7c6e5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4a162d96614ece8caf16ccbc99ad5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:10:57.751823 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3d3ab289-0c60-4b12-82f3-a9512dfd931c tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] 10.222.0.46 "GET /compute/v2.1/servers/20b5b2d2-e5cc-4c06-9420-9fbf3569996c" status: 200 len: 1314 microversion: 2.1 time: 0.619162 Jan 15 21:10:57.767285 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2987/5990] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:10:57 2022] GET /compute/v2.1/servers/20b5b2d2-e5cc-4c06-9420-9fbf3569996c => generated 1314 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:10:58.773472 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d4c1162f-9058-42cf-b666-2334ec0b9f1a tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:10:58.775015 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-d4c1162f-9058-42cf-b666-2334ec0b9f1a tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] [instance: 20b5b2d2-e5cc-4c06-9420-9fbf3569996c] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:10:58.794405 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d4c1162f-9058-42cf-b666-2334ec0b9f1a tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:58.795974 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d4c1162f-9058-42cf-b666-2334ec0b9f1a tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:58.797545 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d4c1162f-9058-42cf-b666-2334ec0b9f1a tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:58.800711 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d4c1162f-9058-42cf-b666-2334ec0b9f1a tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:59.204771 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-f123440d-5add-455a-ab0a-d86ca37490fb req-554ae4f4-86e8-4309-8335-798abab6890c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20b5b2d2-e5cc-4c06-9420-9fbf3569996c", "name": "network-vif-plugged", "status": "completed", "tag": "6a3f67e3-ca30-403f-b17c-08c9e8c882f1"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:10:59.206497 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:10:59.206497 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:10:59.247581 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-f123440d-5add-455a-ab0a-d86ca37490fb req-554ae4f4-86e8-4309-8335-798abab6890c service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:10:59.248387 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-f123440d-5add-455a-ab0a-d86ca37490fb req-554ae4f4-86e8-4309-8335-798abab6890c service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:10:59.262047 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-f123440d-5add-455a-ab0a-d86ca37490fb req-554ae4f4-86e8-4309-8335-798abab6890c service nova] Creating event network-vif-plugged:6a3f67e3-ca30-403f-b17c-08c9e8c882f1 for instance 20b5b2d2-e5cc-4c06-9420-9fbf3569996c on nch2-master-1 Jan 15 21:10:59.280958 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-f123440d-5add-455a-ab0a-d86ca37490fb req-554ae4f4-86e8-4309-8335-798abab6890c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077431 Jan 15 21:10:59.284270 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2988/5991] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:10:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 21:10:59.370351 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-d4c1162f-9058-42cf-b666-2334ec0b9f1a tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6aa71a6c814c758e2a28a5d7c6e5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4a162d96614ece8caf16ccbc99ad5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:10:59.389391 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d4c1162f-9058-42cf-b666-2334ec0b9f1a tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] 10.222.0.46 "GET /compute/v2.1/servers/20b5b2d2-e5cc-4c06-9420-9fbf3569996c" status: 200 len: 1314 microversion: 2.1 time: 0.618713 Jan 15 21:10:59.406340 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3004/5992] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:10:58 2022] GET /compute/v2.1/servers/20b5b2d2-e5cc-4c06-9420-9fbf3569996c => generated 1314 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:11:00.419457 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ed65c12d-043c-4d94-96c0-ba17e6b0f2aa tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:11:00.420169 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ed65c12d-043c-4d94-96c0-ba17e6b0f2aa tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] [instance: 20b5b2d2-e5cc-4c06-9420-9fbf3569996c] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:11:00.440194 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ed65c12d-043c-4d94-96c0-ba17e6b0f2aa tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:00.440537 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ed65c12d-043c-4d94-96c0-ba17e6b0f2aa tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:00.441352 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ed65c12d-043c-4d94-96c0-ba17e6b0f2aa tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:00.441799 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ed65c12d-043c-4d94-96c0-ba17e6b0f2aa tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:00.948967 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-ed65c12d-043c-4d94-96c0-ba17e6b0f2aa tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6aa71a6c814c758e2a28a5d7c6e5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4a162d96614ece8caf16ccbc99ad5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:11:00.958792 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ed65c12d-043c-4d94-96c0-ba17e6b0f2aa tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] 10.222.0.46 "GET /compute/v2.1/servers/20b5b2d2-e5cc-4c06-9420-9fbf3569996c" status: 200 len: 1314 microversion: 2.1 time: 0.545386 Jan 15 21:11:00.961352 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2989/5993] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:11:00 2022] GET /compute/v2.1/servers/20b5b2d2-e5cc-4c06-9420-9fbf3569996c => generated 1314 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:11:01.977975 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b5b4f47d-320f-4977-8bfa-426d5493aaac tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:11:01.980465 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b5b4f47d-320f-4977-8bfa-426d5493aaac tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] [instance: 20b5b2d2-e5cc-4c06-9420-9fbf3569996c] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:11:01.994016 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b5b4f47d-320f-4977-8bfa-426d5493aaac tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:01.995995 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b5b4f47d-320f-4977-8bfa-426d5493aaac tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:02.000308 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b5b4f47d-320f-4977-8bfa-426d5493aaac tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:02.001997 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b5b4f47d-320f-4977-8bfa-426d5493aaac tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:02.433586 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-b5b4f47d-320f-4977-8bfa-426d5493aaac tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6aa71a6c814c758e2a28a5d7c6e5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4a162d96614ece8caf16ccbc99ad5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:11:02.442470 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b5b4f47d-320f-4977-8bfa-426d5493aaac tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] 10.222.0.46 "GET /compute/v2.1/servers/20b5b2d2-e5cc-4c06-9420-9fbf3569996c" status: 200 len: 1501 microversion: 2.1 time: 0.469974 Jan 15 21:11:02.443618 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3005/5994] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:11:01 2022] GET /compute/v2.1/servers/20b5b2d2-e5cc-4c06-9420-9fbf3569996c => generated 1501 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:11:02.459525 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b51a0cb8-deca-4e0d-a5ef-00f56924459e tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:11:02.460459 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b51a0cb8-deca-4e0d-a5ef-00f56924459e tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] [instance: 20b5b2d2-e5cc-4c06-9420-9fbf3569996c] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:11:02.468630 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b51a0cb8-deca-4e0d-a5ef-00f56924459e tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:02.469110 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b51a0cb8-deca-4e0d-a5ef-00f56924459e tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:02.469892 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b51a0cb8-deca-4e0d-a5ef-00f56924459e tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:02.470323 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b51a0cb8-deca-4e0d-a5ef-00f56924459e tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:02.501048 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.objects.instance [None req-b51a0cb8-deca-4e0d-a5ef-00f56924459e tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lazy-loading 'flavor' on Instance uuid 20b5b2d2-e5cc-4c06-9420-9fbf3569996c {{(pid=129365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 21:11:02.634198 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b51a0cb8-deca-4e0d-a5ef-00f56924459e tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] 10.222.0.46 "POST /compute/v2.1/servers/20b5b2d2-e5cc-4c06-9420-9fbf3569996c/action" status: 200 len: 32 microversion: 2.1 time: 0.177377 Jan 15 21:11:02.636825 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2990/5995] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:11:02 2022] POST /compute/v2.1/servers/20b5b2d2-e5cc-4c06-9420-9fbf3569996c/action => generated 32 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 21:11:02.652269 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-29b1c220-1c16-409d-8358-77f80a3f25a5 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:11:02.653170 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-29b1c220-1c16-409d-8358-77f80a3f25a5 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] [instance: 20b5b2d2-e5cc-4c06-9420-9fbf3569996c] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:11:02.667448 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-29b1c220-1c16-409d-8358-77f80a3f25a5 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:02.669736 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-29b1c220-1c16-409d-8358-77f80a3f25a5 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:02.671625 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-29b1c220-1c16-409d-8358-77f80a3f25a5 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:02.672248 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-29b1c220-1c16-409d-8358-77f80a3f25a5 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:03.120596 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-29b1c220-1c16-409d-8358-77f80a3f25a5 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6aa71a6c814c758e2a28a5d7c6e5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4a162d96614ece8caf16ccbc99ad5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:11:03.144565 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-29b1c220-1c16-409d-8358-77f80a3f25a5 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] 10.222.0.46 "GET /compute/v2.1/servers/20b5b2d2-e5cc-4c06-9420-9fbf3569996c" status: 200 len: 1507 microversion: 2.1 time: 0.498187 Jan 15 21:11:03.154060 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3006/5996] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:11:02 2022] GET /compute/v2.1/servers/20b5b2d2-e5cc-4c06-9420-9fbf3569996c => generated 1507 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:11:04.169797 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a7a959f1-99cf-41f0-97dd-aab1e5b9bdc7 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:11:04.170410 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a7a959f1-99cf-41f0-97dd-aab1e5b9bdc7 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] [instance: 20b5b2d2-e5cc-4c06-9420-9fbf3569996c] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:11:04.182991 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a7a959f1-99cf-41f0-97dd-aab1e5b9bdc7 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:04.184164 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a7a959f1-99cf-41f0-97dd-aab1e5b9bdc7 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:04.185186 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a7a959f1-99cf-41f0-97dd-aab1e5b9bdc7 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:04.185780 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a7a959f1-99cf-41f0-97dd-aab1e5b9bdc7 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:04.795331 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-a7a959f1-99cf-41f0-97dd-aab1e5b9bdc7 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6aa71a6c814c758e2a28a5d7c6e5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4a162d96614ece8caf16ccbc99ad5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:11:04.811878 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a7a959f1-99cf-41f0-97dd-aab1e5b9bdc7 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] 10.222.0.46 "GET /compute/v2.1/servers/20b5b2d2-e5cc-4c06-9420-9fbf3569996c" status: 200 len: 1507 microversion: 2.1 time: 0.648188 Jan 15 21:11:04.813000 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2991/5997] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:11:04 2022] GET /compute/v2.1/servers/20b5b2d2-e5cc-4c06-9420-9fbf3569996c => generated 1507 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:11:05.843724 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f104ccf6-d83b-4ffe-8637-fb18e580c8c5 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:11:05.844345 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f104ccf6-d83b-4ffe-8637-fb18e580c8c5 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] [instance: 20b5b2d2-e5cc-4c06-9420-9fbf3569996c] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:11:05.886879 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f104ccf6-d83b-4ffe-8637-fb18e580c8c5 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:05.890932 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f104ccf6-d83b-4ffe-8637-fb18e580c8c5 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:05.892280 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f104ccf6-d83b-4ffe-8637-fb18e580c8c5 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:05.892905 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f104ccf6-d83b-4ffe-8637-fb18e580c8c5 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:06.484210 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-f104ccf6-d83b-4ffe-8637-fb18e580c8c5 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6aa71a6c814c758e2a28a5d7c6e5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4a162d96614ece8caf16ccbc99ad5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:11:06.492427 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f104ccf6-d83b-4ffe-8637-fb18e580c8c5 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] 10.222.0.46 "GET /compute/v2.1/servers/20b5b2d2-e5cc-4c06-9420-9fbf3569996c" status: 200 len: 1507 microversion: 2.1 time: 0.664788 Jan 15 21:11:06.497829 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3007/5998] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:11:05 2022] GET /compute/v2.1/servers/20b5b2d2-e5cc-4c06-9420-9fbf3569996c => generated 1507 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:11:07.510466 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f2679f70-c217-496d-b381-d7058776a376 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:11:07.512261 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f2679f70-c217-496d-b381-d7058776a376 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] [instance: 20b5b2d2-e5cc-4c06-9420-9fbf3569996c] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:11:07.520030 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f2679f70-c217-496d-b381-d7058776a376 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:07.520474 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f2679f70-c217-496d-b381-d7058776a376 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:07.521308 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f2679f70-c217-496d-b381-d7058776a376 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:07.521843 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f2679f70-c217-496d-b381-d7058776a376 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:07.832089 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-f2679f70-c217-496d-b381-d7058776a376 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6aa71a6c814c758e2a28a5d7c6e5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4a162d96614ece8caf16ccbc99ad5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:11:07.847635 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f2679f70-c217-496d-b381-d7058776a376 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] 10.222.0.46 "GET /compute/v2.1/servers/20b5b2d2-e5cc-4c06-9420-9fbf3569996c" status: 200 len: 1507 microversion: 2.1 time: 0.342905 Jan 15 21:11:07.848348 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2992/5999] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:11:07 2022] GET /compute/v2.1/servers/20b5b2d2-e5cc-4c06-9420-9fbf3569996c => generated 1507 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:11:08.873258 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c0bd015d-da76-4fd0-b4bb-368bde7ba38b tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:11:08.874943 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c0bd015d-da76-4fd0-b4bb-368bde7ba38b tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] [instance: 20b5b2d2-e5cc-4c06-9420-9fbf3569996c] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:11:08.920543 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c0bd015d-da76-4fd0-b4bb-368bde7ba38b tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:08.926852 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c0bd015d-da76-4fd0-b4bb-368bde7ba38b tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:08.928206 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c0bd015d-da76-4fd0-b4bb-368bde7ba38b tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:08.934452 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c0bd015d-da76-4fd0-b4bb-368bde7ba38b tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:09.841201 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-c0bd015d-da76-4fd0-b4bb-368bde7ba38b tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6aa71a6c814c758e2a28a5d7c6e5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4a162d96614ece8caf16ccbc99ad5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:11:09.851349 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c0bd015d-da76-4fd0-b4bb-368bde7ba38b tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] 10.222.0.46 "GET /compute/v2.1/servers/20b5b2d2-e5cc-4c06-9420-9fbf3569996c" status: 200 len: 1507 microversion: 2.1 time: 0.986925 Jan 15 21:11:09.864284 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3008/6000] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:11:08 2022] GET /compute/v2.1/servers/20b5b2d2-e5cc-4c06-9420-9fbf3569996c => generated 1507 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:11:10.875077 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-452d6074-680d-4530-b371-e0c69a555afd tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:11:10.877337 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-452d6074-680d-4530-b371-e0c69a555afd tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] [instance: 20b5b2d2-e5cc-4c06-9420-9fbf3569996c] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:11:10.904770 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-452d6074-680d-4530-b371-e0c69a555afd tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:10.906502 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-452d6074-680d-4530-b371-e0c69a555afd tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:10.909505 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-452d6074-680d-4530-b371-e0c69a555afd tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:10.910861 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-452d6074-680d-4530-b371-e0c69a555afd tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:11.781019 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-452d6074-680d-4530-b371-e0c69a555afd tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6aa71a6c814c758e2a28a5d7c6e5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4a162d96614ece8caf16ccbc99ad5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:11:11.794804 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-452d6074-680d-4530-b371-e0c69a555afd tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] 10.222.0.46 "GET /compute/v2.1/servers/20b5b2d2-e5cc-4c06-9420-9fbf3569996c" status: 200 len: 1507 microversion: 2.1 time: 0.926923 Jan 15 21:11:11.796090 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2993/6001] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:11:10 2022] GET /compute/v2.1/servers/20b5b2d2-e5cc-4c06-9420-9fbf3569996c => generated 1507 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:11:12.815596 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ffd34631-9f63-4cb1-851a-5d936cf29c09 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:11:12.816665 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ffd34631-9f63-4cb1-851a-5d936cf29c09 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] [instance: 20b5b2d2-e5cc-4c06-9420-9fbf3569996c] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:11:12.835489 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ffd34631-9f63-4cb1-851a-5d936cf29c09 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:12.836034 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ffd34631-9f63-4cb1-851a-5d936cf29c09 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:12.837270 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ffd34631-9f63-4cb1-851a-5d936cf29c09 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:12.838030 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ffd34631-9f63-4cb1-851a-5d936cf29c09 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:13.067204 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-ffd34631-9f63-4cb1-851a-5d936cf29c09 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6aa71a6c814c758e2a28a5d7c6e5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4a162d96614ece8caf16ccbc99ad5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:11:13.079077 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ffd34631-9f63-4cb1-851a-5d936cf29c09 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] 10.222.0.46 "GET /compute/v2.1/servers/20b5b2d2-e5cc-4c06-9420-9fbf3569996c" status: 200 len: 1507 microversion: 2.1 time: 0.269540 Jan 15 21:11:13.086631 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3009/6002] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:11:12 2022] GET /compute/v2.1/servers/20b5b2d2-e5cc-4c06-9420-9fbf3569996c => generated 1507 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:11:14.097320 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a43fd1fc-ac23-4fdb-a4ba-8a8416cecb18 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:11:14.098561 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a43fd1fc-ac23-4fdb-a4ba-8a8416cecb18 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] [instance: 20b5b2d2-e5cc-4c06-9420-9fbf3569996c] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:11:14.109521 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a43fd1fc-ac23-4fdb-a4ba-8a8416cecb18 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:14.109657 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a43fd1fc-ac23-4fdb-a4ba-8a8416cecb18 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:14.110645 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a43fd1fc-ac23-4fdb-a4ba-8a8416cecb18 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:14.110774 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a43fd1fc-ac23-4fdb-a4ba-8a8416cecb18 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:14.350612 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-a43fd1fc-ac23-4fdb-a4ba-8a8416cecb18 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6aa71a6c814c758e2a28a5d7c6e5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4a162d96614ece8caf16ccbc99ad5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:11:14.364033 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a43fd1fc-ac23-4fdb-a4ba-8a8416cecb18 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] 10.222.0.46 "GET /compute/v2.1/servers/20b5b2d2-e5cc-4c06-9420-9fbf3569996c" status: 200 len: 1507 microversion: 2.1 time: 0.270758 Jan 15 21:11:14.365171 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2994/6003] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:11:14 2022] GET /compute/v2.1/servers/20b5b2d2-e5cc-4c06-9420-9fbf3569996c => generated 1507 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:11:15.264612 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-988e3768-875c-47cc-a529-78f8458651ef tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-2001506251", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:11:15.343563 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.network.neutron [None req-988e3768-875c-47cc-a529-78f8458651ef tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] validate_networks() for None {{(pid=129366) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 21:11:15.383407 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b2b4bd91-f51b-46d3-8a76-3e7aef481808 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:11:15.384477 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b2b4bd91-f51b-46d3-8a76-3e7aef481808 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] [instance: 20b5b2d2-e5cc-4c06-9420-9fbf3569996c] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:11:15.396025 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b2b4bd91-f51b-46d3-8a76-3e7aef481808 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:15.398657 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b2b4bd91-f51b-46d3-8a76-3e7aef481808 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:15.399992 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b2b4bd91-f51b-46d3-8a76-3e7aef481808 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:15.400607 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b2b4bd91-f51b-46d3-8a76-3e7aef481808 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:15.960555 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-b2b4bd91-f51b-46d3-8a76-3e7aef481808 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6aa71a6c814c758e2a28a5d7c6e5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4a162d96614ece8caf16ccbc99ad5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:11:15.975394 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b2b4bd91-f51b-46d3-8a76-3e7aef481808 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] 10.222.0.46 "GET /compute/v2.1/servers/20b5b2d2-e5cc-4c06-9420-9fbf3569996c" status: 200 len: 1507 microversion: 2.1 time: 0.595395 Jan 15 21:11:15.977532 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2995/6004] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:11:15 2022] GET /compute/v2.1/servers/20b5b2d2-e5cc-4c06-9420-9fbf3569996c => generated 1507 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:11:16.054615 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-988e3768-875c-47cc-a529-78f8458651ef tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] Flavor limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 21:11:16.055597 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-988e3768-875c-47cc-a529-78f8458651ef tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] Image limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 21:11:16.056969 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-988e3768-875c-47cc-a529-78f8458651ef tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] Flavor pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 21:11:16.057587 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-988e3768-875c-47cc-a529-78f8458651ef tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] Image pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 21:11:16.059037 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-988e3768-875c-47cc-a529-78f8458651ef tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 21:11:16.071065 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-988e3768-875c-47cc-a529-78f8458651ef tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:16.071555 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-988e3768-875c-47cc-a529-78f8458651ef tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:16.072492 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-988e3768-875c-47cc-a529-78f8458651ef tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:16.073157 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-988e3768-875c-47cc-a529-78f8458651ef tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:16.096700 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-988e3768-875c-47cc-a529-78f8458651ef tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] Getting quotas for project 581f23bb65c648408f2707a199a990e3. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:11:16.102374 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-988e3768-875c-47cc-a529-78f8458651ef tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] Getting quotas for user 3b33ce60fd114adf982f585dde34ed04 and project 581f23bb65c648408f2707a199a990e3. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:11:16.118301 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-988e3768-875c-47cc-a529-78f8458651ef tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] Going to run 1 instances... {{(pid=129366) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 21:11:16.121557 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-988e3768-875c-47cc-a529-78f8458651ef tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] [instance: b3dd3992-80af-4b32-9542-0d000187e277] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 21:11:16.179025 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-988e3768-875c-47cc-a529-78f8458651ef tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.918372 Jan 15 21:11:16.179797 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3010/6005] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 21:11:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 920 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 21:11:16.191382 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e9b5f20d-80d0-48f4-9308-a315fda940af tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:11:16.192973 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e9b5f20d-80d0-48f4-9308-a315fda940af tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] [instance: b3dd3992-80af-4b32-9542-0d000187e277] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:11:16.335984 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-e9b5f20d-80d0-48f4-9308-a315fda940af tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b33ce60fd114adf982f585dde34ed04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581f23bb65c648408f2707a199a990e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:11:16.388620 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e9b5f20d-80d0-48f4-9308-a315fda940af tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] 10.222.0.46 "GET /compute/v2.1/servers/b3dd3992-80af-4b32-9542-0d000187e277" status: 200 len: 1214 microversion: 2.1 time: 0.198628 Jan 15 21:11:16.390357 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2996/6006] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:11:16 2022] GET /compute/v2.1/servers/b3dd3992-80af-4b32-9542-0d000187e277 => generated 1214 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:11:16.994807 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-07d27f91-7361-40e6-88ea-22dcd39073b1 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:11:16.995416 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-07d27f91-7361-40e6-88ea-22dcd39073b1 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] [instance: 20b5b2d2-e5cc-4c06-9420-9fbf3569996c] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:11:17.007969 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-07d27f91-7361-40e6-88ea-22dcd39073b1 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:17.009589 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-07d27f91-7361-40e6-88ea-22dcd39073b1 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:17.012063 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-07d27f91-7361-40e6-88ea-22dcd39073b1 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:17.012894 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-07d27f91-7361-40e6-88ea-22dcd39073b1 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:17.327681 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-07d27f91-7361-40e6-88ea-22dcd39073b1 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6aa71a6c814c758e2a28a5d7c6e5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4a162d96614ece8caf16ccbc99ad5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:11:17.337576 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-07d27f91-7361-40e6-88ea-22dcd39073b1 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] 10.222.0.46 "GET /compute/v2.1/servers/20b5b2d2-e5cc-4c06-9420-9fbf3569996c" status: 200 len: 1507 microversion: 2.1 time: 0.346634 Jan 15 21:11:17.338501 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3011/6007] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:11:16 2022] GET /compute/v2.1/servers/20b5b2d2-e5cc-4c06-9420-9fbf3569996c => generated 1507 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:11:17.407017 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3c4262a2-73ec-4dd5-8fc3-6a98d3b81a47 tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:11:17.408248 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-3c4262a2-73ec-4dd5-8fc3-6a98d3b81a47 tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] [instance: b3dd3992-80af-4b32-9542-0d000187e277] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:11:17.416622 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3c4262a2-73ec-4dd5-8fc3-6a98d3b81a47 tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:17.418227 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3c4262a2-73ec-4dd5-8fc3-6a98d3b81a47 tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:17.419338 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3c4262a2-73ec-4dd5-8fc3-6a98d3b81a47 tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:17.419941 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3c4262a2-73ec-4dd5-8fc3-6a98d3b81a47 tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:17.540831 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-3c4262a2-73ec-4dd5-8fc3-6a98d3b81a47 tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b33ce60fd114adf982f585dde34ed04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581f23bb65c648408f2707a199a990e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:11:17.552272 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3c4262a2-73ec-4dd5-8fc3-6a98d3b81a47 tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] 10.222.0.46 "GET /compute/v2.1/servers/b3dd3992-80af-4b32-9542-0d000187e277" status: 200 len: 1266 microversion: 2.1 time: 0.149144 Jan 15 21:11:17.563578 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2997/6008] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:11:17 2022] GET /compute/v2.1/servers/b3dd3992-80af-4b32-9542-0d000187e277 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:11:18.353827 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7d641764-f4a2-4dc4-b8c6-c656281ec67b tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:11:18.354386 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-7d641764-f4a2-4dc4-b8c6-c656281ec67b tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] [instance: 20b5b2d2-e5cc-4c06-9420-9fbf3569996c] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:11:18.366066 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7d641764-f4a2-4dc4-b8c6-c656281ec67b tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:18.366532 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7d641764-f4a2-4dc4-b8c6-c656281ec67b tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:18.367326 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7d641764-f4a2-4dc4-b8c6-c656281ec67b tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:18.367770 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7d641764-f4a2-4dc4-b8c6-c656281ec67b tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:18.575134 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ad2aaf87-e973-4433-ac06-404b9f760de9 tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:11:18.577589 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ad2aaf87-e973-4433-ac06-404b9f760de9 tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] [instance: b3dd3992-80af-4b32-9542-0d000187e277] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:11:18.597861 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ad2aaf87-e973-4433-ac06-404b9f760de9 tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:18.598673 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ad2aaf87-e973-4433-ac06-404b9f760de9 tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:18.606714 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ad2aaf87-e973-4433-ac06-404b9f760de9 tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:18.610797 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ad2aaf87-e973-4433-ac06-404b9f760de9 tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:18.786022 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-7d641764-f4a2-4dc4-b8c6-c656281ec67b tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6aa71a6c814c758e2a28a5d7c6e5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4a162d96614ece8caf16ccbc99ad5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:11:18.801808 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7d641764-f4a2-4dc4-b8c6-c656281ec67b tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] 10.222.0.46 "GET /compute/v2.1/servers/20b5b2d2-e5cc-4c06-9420-9fbf3569996c" status: 200 len: 1507 microversion: 2.1 time: 0.451591 Jan 15 21:11:18.807761 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-ad2aaf87-e973-4433-ac06-404b9f760de9 tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b33ce60fd114adf982f585dde34ed04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581f23bb65c648408f2707a199a990e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:11:18.820306 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3012/6009] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:11:18 2022] GET /compute/v2.1/servers/20b5b2d2-e5cc-4c06-9420-9fbf3569996c => generated 1507 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:11:18.823274 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ad2aaf87-e973-4433-ac06-404b9f760de9 tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] 10.222.0.46 "GET /compute/v2.1/servers/b3dd3992-80af-4b32-9542-0d000187e277" status: 200 len: 1272 microversion: 2.1 time: 0.254736 Jan 15 21:11:18.825073 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2998/6010] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:11:18 2022] GET /compute/v2.1/servers/b3dd3992-80af-4b32-9542-0d000187e277 => generated 1272 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:11:19.837596 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-34d593a2-d612-49aa-883b-6074536075d8 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:11:19.839491 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-34d593a2-d612-49aa-883b-6074536075d8 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] [instance: 20b5b2d2-e5cc-4c06-9420-9fbf3569996c] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:11:19.846720 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-34d593a2-d612-49aa-883b-6074536075d8 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:19.847495 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-34d593a2-d612-49aa-883b-6074536075d8 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:19.849174 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-34d593a2-d612-49aa-883b-6074536075d8 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:19.850105 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-34d593a2-d612-49aa-883b-6074536075d8 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:19.850832 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-7026119a-d895-4bf7-b7cc-61413e121d50 tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:11:19.853043 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-7026119a-d895-4bf7-b7cc-61413e121d50 tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] [instance: b3dd3992-80af-4b32-9542-0d000187e277] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:11:19.865641 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7026119a-d895-4bf7-b7cc-61413e121d50 tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:19.866091 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7026119a-d895-4bf7-b7cc-61413e121d50 tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:19.868177 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7026119a-d895-4bf7-b7cc-61413e121d50 tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:19.868619 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7026119a-d895-4bf7-b7cc-61413e121d50 tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:20.286424 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-34d593a2-d612-49aa-883b-6074536075d8 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6aa71a6c814c758e2a28a5d7c6e5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4a162d96614ece8caf16ccbc99ad5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:11:20.295864 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-34d593a2-d612-49aa-883b-6074536075d8 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] 10.222.0.46 "GET /compute/v2.1/servers/20b5b2d2-e5cc-4c06-9420-9fbf3569996c" status: 200 len: 1507 microversion: 2.1 time: 0.462899 Jan 15 21:11:20.296764 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3013/6011] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:11:19 2022] GET /compute/v2.1/servers/20b5b2d2-e5cc-4c06-9420-9fbf3569996c => generated 1507 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:11:20.316320 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-7026119a-d895-4bf7-b7cc-61413e121d50 tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b33ce60fd114adf982f585dde34ed04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581f23bb65c648408f2707a199a990e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:11:20.324489 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-7026119a-d895-4bf7-b7cc-61413e121d50 tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] 10.222.0.46 "GET /compute/v2.1/servers/b3dd3992-80af-4b32-9542-0d000187e277" status: 200 len: 1314 microversion: 2.1 time: 0.481276 Jan 15 21:11:20.337061 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 2999/6012] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:11:19 2022] GET /compute/v2.1/servers/b3dd3992-80af-4b32-9542-0d000187e277 => generated 1314 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:11:21.314915 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d2275d81-3dec-4f3f-aadd-04f3f9406beb tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:11:21.317005 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-d2275d81-3dec-4f3f-aadd-04f3f9406beb tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] [instance: 20b5b2d2-e5cc-4c06-9420-9fbf3569996c] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:11:21.327975 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d2275d81-3dec-4f3f-aadd-04f3f9406beb tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:21.328780 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d2275d81-3dec-4f3f-aadd-04f3f9406beb tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:21.331520 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d2275d81-3dec-4f3f-aadd-04f3f9406beb tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:21.333352 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d2275d81-3dec-4f3f-aadd-04f3f9406beb tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:21.346560 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ddc9051c-d450-4ac6-9209-64a278148b03 tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:11:21.356229 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ddc9051c-d450-4ac6-9209-64a278148b03 tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] [instance: b3dd3992-80af-4b32-9542-0d000187e277] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:11:21.381448 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ddc9051c-d450-4ac6-9209-64a278148b03 tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:21.381448 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ddc9051c-d450-4ac6-9209-64a278148b03 tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:21.382392 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ddc9051c-d450-4ac6-9209-64a278148b03 tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:21.382926 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ddc9051c-d450-4ac6-9209-64a278148b03 tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:22.381020 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-d2275d81-3dec-4f3f-aadd-04f3f9406beb tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6aa71a6c814c758e2a28a5d7c6e5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4a162d96614ece8caf16ccbc99ad5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:11:22.388071 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-ddc9051c-d450-4ac6-9209-64a278148b03 tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b33ce60fd114adf982f585dde34ed04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581f23bb65c648408f2707a199a990e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:11:22.394711 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d2275d81-3dec-4f3f-aadd-04f3f9406beb tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] 10.222.0.46 "GET /compute/v2.1/servers/20b5b2d2-e5cc-4c06-9420-9fbf3569996c" status: 200 len: 1507 microversion: 2.1 time: 1.084758 Jan 15 21:11:22.405224 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3014/6013] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:11:21 2022] GET /compute/v2.1/servers/20b5b2d2-e5cc-4c06-9420-9fbf3569996c => generated 1507 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:11:22.405351 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ddc9051c-d450-4ac6-9209-64a278148b03 tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] 10.222.0.46 "GET /compute/v2.1/servers/b3dd3992-80af-4b32-9542-0d000187e277" status: 200 len: 1314 microversion: 2.1 time: 1.060010 Jan 15 21:11:22.405449 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-d7c7e0e2-9ac1-45f6-b315-9ef2256dd11d req-c9b9571d-a6f5-4e01-98c7-133bf2f08a25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3dd3992-80af-4b32-9542-0d000187e277", "tag": "f2e8d311-9ea4-4bf4-83cb-f4cbf0099ba8"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:11:22.405910 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:11:22.405910 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:11:22.413841 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3000/6014] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:11:21 2022] GET /compute/v2.1/servers/b3dd3992-80af-4b32-9542-0d000187e277 => generated 1314 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:11:22.419085 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-d7c7e0e2-9ac1-45f6-b315-9ef2256dd11d req-c9b9571d-a6f5-4e01-98c7-133bf2f08a25 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:22.419518 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-d7c7e0e2-9ac1-45f6-b315-9ef2256dd11d req-c9b9571d-a6f5-4e01-98c7-133bf2f08a25 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:22.438661 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-d7c7e0e2-9ac1-45f6-b315-9ef2256dd11d req-c9b9571d-a6f5-4e01-98c7-133bf2f08a25 service nova] Creating event network-changed:f2e8d311-9ea4-4bf4-83cb-f4cbf0099ba8 for instance b3dd3992-80af-4b32-9542-0d000187e277 on nch1-master-1 Jan 15 21:11:22.445951 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-d7c7e0e2-9ac1-45f6-b315-9ef2256dd11d req-c9b9571d-a6f5-4e01-98c7-133bf2f08a25 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048198 Jan 15 21:11:22.446990 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3015/6015] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:11:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:11:23.419997 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e785b6b1-2029-4186-805d-cd39726dac7d tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:11:23.425628 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e785b6b1-2029-4186-805d-cd39726dac7d tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] [instance: 20b5b2d2-e5cc-4c06-9420-9fbf3569996c] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:11:23.428462 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f7b556cb-b6dc-412d-a9c1-7bc0edfd0c5a tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:11:23.431900 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f7b556cb-b6dc-412d-a9c1-7bc0edfd0c5a tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] [instance: b3dd3992-80af-4b32-9542-0d000187e277] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:11:23.460856 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e785b6b1-2029-4186-805d-cd39726dac7d tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:23.463963 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e785b6b1-2029-4186-805d-cd39726dac7d tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:23.467405 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f7b556cb-b6dc-412d-a9c1-7bc0edfd0c5a tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:23.468338 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f7b556cb-b6dc-412d-a9c1-7bc0edfd0c5a tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:23.469794 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e785b6b1-2029-4186-805d-cd39726dac7d tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:23.474723 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f7b556cb-b6dc-412d-a9c1-7bc0edfd0c5a tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:23.475141 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e785b6b1-2029-4186-805d-cd39726dac7d tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:23.476729 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f7b556cb-b6dc-412d-a9c1-7bc0edfd0c5a tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:23.985387 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-e785b6b1-2029-4186-805d-cd39726dac7d tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6aa71a6c814c758e2a28a5d7c6e5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4a162d96614ece8caf16ccbc99ad5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:11:24.000484 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e785b6b1-2029-4186-805d-cd39726dac7d tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] 10.222.0.46 "GET /compute/v2.1/servers/20b5b2d2-e5cc-4c06-9420-9fbf3569996c" status: 200 len: 1507 microversion: 2.1 time: 0.592289 Jan 15 21:11:24.001437 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3001/6016] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:11:23 2022] GET /compute/v2.1/servers/20b5b2d2-e5cc-4c06-9420-9fbf3569996c => generated 1507 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:11:24.059471 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-f7b556cb-b6dc-412d-a9c1-7bc0edfd0c5a tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b33ce60fd114adf982f585dde34ed04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581f23bb65c648408f2707a199a990e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:11:24.068574 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f7b556cb-b6dc-412d-a9c1-7bc0edfd0c5a tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] 10.222.0.46 "GET /compute/v2.1/servers/b3dd3992-80af-4b32-9542-0d000187e277" status: 200 len: 1314 microversion: 2.1 time: 0.654521 Jan 15 21:11:24.070032 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3016/6017] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:11:23 2022] GET /compute/v2.1/servers/b3dd3992-80af-4b32-9542-0d000187e277 => generated 1314 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:11:25.018454 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-338f2035-18c8-4004-a625-4a54d3711421 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:11:25.019997 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-338f2035-18c8-4004-a625-4a54d3711421 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] [instance: 20b5b2d2-e5cc-4c06-9420-9fbf3569996c] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:11:25.029003 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-338f2035-18c8-4004-a625-4a54d3711421 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:25.029889 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-338f2035-18c8-4004-a625-4a54d3711421 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:25.030901 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-338f2035-18c8-4004-a625-4a54d3711421 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:25.031597 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-338f2035-18c8-4004-a625-4a54d3711421 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:25.086972 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-fa29ba71-76ac-454b-a3e8-b36e4fd1c35a tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:11:25.087876 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-fa29ba71-76ac-454b-a3e8-b36e4fd1c35a tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] [instance: b3dd3992-80af-4b32-9542-0d000187e277] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:11:25.100393 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fa29ba71-76ac-454b-a3e8-b36e4fd1c35a tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:25.101964 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fa29ba71-76ac-454b-a3e8-b36e4fd1c35a tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:25.105315 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fa29ba71-76ac-454b-a3e8-b36e4fd1c35a tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:25.105763 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fa29ba71-76ac-454b-a3e8-b36e4fd1c35a tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:25.847708 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-fa29ba71-76ac-454b-a3e8-b36e4fd1c35a tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b33ce60fd114adf982f585dde34ed04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581f23bb65c648408f2707a199a990e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:11:25.853938 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-338f2035-18c8-4004-a625-4a54d3711421 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6aa71a6c814c758e2a28a5d7c6e5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4a162d96614ece8caf16ccbc99ad5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:11:25.860625 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-fa29ba71-76ac-454b-a3e8-b36e4fd1c35a tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] 10.222.0.46 "GET /compute/v2.1/servers/b3dd3992-80af-4b32-9542-0d000187e277" status: 200 len: 1314 microversion: 2.1 time: 0.777806 Jan 15 21:11:25.861724 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3017/6018] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:11:25 2022] GET /compute/v2.1/servers/b3dd3992-80af-4b32-9542-0d000187e277 => generated 1314 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:11:25.864024 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-338f2035-18c8-4004-a625-4a54d3711421 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] 10.222.0.46 "GET /compute/v2.1/servers/20b5b2d2-e5cc-4c06-9420-9fbf3569996c" status: 200 len: 1507 microversion: 2.1 time: 0.849403 Jan 15 21:11:25.864756 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3002/6019] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:11:25 2022] GET /compute/v2.1/servers/20b5b2d2-e5cc-4c06-9420-9fbf3569996c => generated 1507 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:11:26.878167 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-5ea1c729-0ea5-45d1-8e7e-3baf9b3066cc tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:11:26.880010 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-5ea1c729-0ea5-45d1-8e7e-3baf9b3066cc tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] [instance: b3dd3992-80af-4b32-9542-0d000187e277] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:11:26.881934 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-dd4ed3eb-69ad-4de8-8d3e-1467b1220802 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:11:26.882546 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-dd4ed3eb-69ad-4de8-8d3e-1467b1220802 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] [instance: 20b5b2d2-e5cc-4c06-9420-9fbf3569996c] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:11:26.893224 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5ea1c729-0ea5-45d1-8e7e-3baf9b3066cc tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:26.893692 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5ea1c729-0ea5-45d1-8e7e-3baf9b3066cc tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:26.894390 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dd4ed3eb-69ad-4de8-8d3e-1467b1220802 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:26.894510 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5ea1c729-0ea5-45d1-8e7e-3baf9b3066cc tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:26.894956 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dd4ed3eb-69ad-4de8-8d3e-1467b1220802 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:26.895040 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5ea1c729-0ea5-45d1-8e7e-3baf9b3066cc tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:26.895623 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dd4ed3eb-69ad-4de8-8d3e-1467b1220802 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:26.896067 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dd4ed3eb-69ad-4de8-8d3e-1467b1220802 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:27.337516 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-5ea1c729-0ea5-45d1-8e7e-3baf9b3066cc tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b33ce60fd114adf982f585dde34ed04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581f23bb65c648408f2707a199a990e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:11:27.352289 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-5ea1c729-0ea5-45d1-8e7e-3baf9b3066cc tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] 10.222.0.46 "GET /compute/v2.1/servers/b3dd3992-80af-4b32-9542-0d000187e277" status: 200 len: 1314 microversion: 2.1 time: 0.478101 Jan 15 21:11:27.353501 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3018/6020] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:11:26 2022] GET /compute/v2.1/servers/b3dd3992-80af-4b32-9542-0d000187e277 => generated 1314 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:11:27.616530 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-dd4ed3eb-69ad-4de8-8d3e-1467b1220802 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6aa71a6c814c758e2a28a5d7c6e5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4a162d96614ece8caf16ccbc99ad5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:11:27.631903 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-dd4ed3eb-69ad-4de8-8d3e-1467b1220802 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] 10.222.0.46 "GET /compute/v2.1/servers/20b5b2d2-e5cc-4c06-9420-9fbf3569996c" status: 200 len: 1507 microversion: 2.1 time: 0.754092 Jan 15 21:11:27.633109 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3003/6021] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:11:26 2022] GET /compute/v2.1/servers/20b5b2d2-e5cc-4c06-9420-9fbf3569996c => generated 1507 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:11:28.031124 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-571fa4b4-dca5-44f9-ac01-4feb089b7a59 req-8607c49e-0a66-4c99-b763-c58fb02170f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3dd3992-80af-4b32-9542-0d000187e277", "name": "network-vif-plugged", "status": "completed", "tag": "f2e8d311-9ea4-4bf4-83cb-f4cbf0099ba8"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:11:28.033866 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:11:28.033866 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:11:28.056262 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-571fa4b4-dca5-44f9-ac01-4feb089b7a59 req-8607c49e-0a66-4c99-b763-c58fb02170f9 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:28.056737 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-571fa4b4-dca5-44f9-ac01-4feb089b7a59 req-8607c49e-0a66-4c99-b763-c58fb02170f9 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:28.083983 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-571fa4b4-dca5-44f9-ac01-4feb089b7a59 req-8607c49e-0a66-4c99-b763-c58fb02170f9 service nova] Creating event network-vif-plugged:f2e8d311-9ea4-4bf4-83cb-f4cbf0099ba8 for instance b3dd3992-80af-4b32-9542-0d000187e277 on nch1-master-1 Jan 15 21:11:28.093339 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-571fa4b4-dca5-44f9-ac01-4feb089b7a59 req-8607c49e-0a66-4c99-b763-c58fb02170f9 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065734 Jan 15 21:11:28.097624 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3019/6022] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:11:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:11:28.374826 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ed56de06-caf7-4ebd-912b-d983cc52db35 tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:11:28.378587 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ed56de06-caf7-4ebd-912b-d983cc52db35 tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] [instance: b3dd3992-80af-4b32-9542-0d000187e277] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:11:28.398027 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ed56de06-caf7-4ebd-912b-d983cc52db35 tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:28.404291 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ed56de06-caf7-4ebd-912b-d983cc52db35 tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:28.409859 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ed56de06-caf7-4ebd-912b-d983cc52db35 tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:28.410406 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ed56de06-caf7-4ebd-912b-d983cc52db35 tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:28.650103 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-661c0fa2-2a9a-4cef-9008-955150dd83ca tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:11:28.651798 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-661c0fa2-2a9a-4cef-9008-955150dd83ca tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] [instance: 20b5b2d2-e5cc-4c06-9420-9fbf3569996c] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:11:28.666783 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-661c0fa2-2a9a-4cef-9008-955150dd83ca tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:28.667401 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-661c0fa2-2a9a-4cef-9008-955150dd83ca tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:28.670478 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-661c0fa2-2a9a-4cef-9008-955150dd83ca tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:28.672171 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-661c0fa2-2a9a-4cef-9008-955150dd83ca tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:29.526944 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-ed56de06-caf7-4ebd-912b-d983cc52db35 tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b33ce60fd114adf982f585dde34ed04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581f23bb65c648408f2707a199a990e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:11:29.536498 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ed56de06-caf7-4ebd-912b-d983cc52db35 tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] 10.222.0.46 "GET /compute/v2.1/servers/b3dd3992-80af-4b32-9542-0d000187e277" status: 200 len: 1314 microversion: 2.1 time: 1.170679 Jan 15 21:11:29.537263 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3004/6023] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:11:28 2022] GET /compute/v2.1/servers/b3dd3992-80af-4b32-9542-0d000187e277 => generated 1314 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:11:29.555543 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-661c0fa2-2a9a-4cef-9008-955150dd83ca tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6aa71a6c814c758e2a28a5d7c6e5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4a162d96614ece8caf16ccbc99ad5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:11:29.566087 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-661c0fa2-2a9a-4cef-9008-955150dd83ca tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] 10.222.0.46 "GET /compute/v2.1/servers/20b5b2d2-e5cc-4c06-9420-9fbf3569996c" status: 200 len: 1507 microversion: 2.1 time: 0.921222 Jan 15 21:11:29.566679 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3020/6024] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:11:28 2022] GET /compute/v2.1/servers/20b5b2d2-e5cc-4c06-9420-9fbf3569996c => generated 1507 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:11:30.559969 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-46f10f99-8fb2-4460-acf6-39c1c368b7fe tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:11:30.561802 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-46f10f99-8fb2-4460-acf6-39c1c368b7fe tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] [instance: b3dd3992-80af-4b32-9542-0d000187e277] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:11:30.584013 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7e8a15c8-fd2c-4345-8878-497110146b07 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:11:30.584630 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-7e8a15c8-fd2c-4345-8878-497110146b07 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] [instance: 20b5b2d2-e5cc-4c06-9420-9fbf3569996c] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:11:30.601288 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-46f10f99-8fb2-4460-acf6-39c1c368b7fe tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:30.604763 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-46f10f99-8fb2-4460-acf6-39c1c368b7fe tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:30.609752 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-46f10f99-8fb2-4460-acf6-39c1c368b7fe tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:30.610321 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7e8a15c8-fd2c-4345-8878-497110146b07 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:30.611662 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7e8a15c8-fd2c-4345-8878-497110146b07 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:30.612593 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-46f10f99-8fb2-4460-acf6-39c1c368b7fe tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:30.615395 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7e8a15c8-fd2c-4345-8878-497110146b07 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:30.615823 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7e8a15c8-fd2c-4345-8878-497110146b07 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:31.246899 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-46f10f99-8fb2-4460-acf6-39c1c368b7fe tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b33ce60fd114adf982f585dde34ed04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581f23bb65c648408f2707a199a990e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:11:31.255023 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-7e8a15c8-fd2c-4345-8878-497110146b07 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6aa71a6c814c758e2a28a5d7c6e5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4a162d96614ece8caf16ccbc99ad5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:11:31.277777 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-46f10f99-8fb2-4460-acf6-39c1c368b7fe tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] 10.222.0.46 "GET /compute/v2.1/servers/b3dd3992-80af-4b32-9542-0d000187e277" status: 200 len: 1463 microversion: 2.1 time: 0.725964 Jan 15 21:11:31.282431 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7e8a15c8-fd2c-4345-8878-497110146b07 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] 10.222.0.46 "GET /compute/v2.1/servers/20b5b2d2-e5cc-4c06-9420-9fbf3569996c" status: 200 len: 1507 microversion: 2.1 time: 0.701328 Jan 15 21:11:31.289527 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3005/6025] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:11:30 2022] GET /compute/v2.1/servers/b3dd3992-80af-4b32-9542-0d000187e277 => generated 1463 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:11:31.296281 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3021/6026] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:11:30 2022] GET /compute/v2.1/servers/20b5b2d2-e5cc-4c06-9420-9fbf3569996c => generated 1507 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:11:31.308374 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8fee27d2-331a-4453-a3d7-12a8dd83a370 tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c02f8a1d-b762-40be-9f64-e353ef1c9a98", "device": "/dev/sdb"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:11:31.309606 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-8fee27d2-331a-4453-a3d7-12a8dd83a370 tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] [instance: b3dd3992-80af-4b32-9542-0d000187e277] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:11:31.316133 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8fee27d2-331a-4453-a3d7-12a8dd83a370 tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:31.316854 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8fee27d2-331a-4453-a3d7-12a8dd83a370 tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:31.317849 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8fee27d2-331a-4453-a3d7-12a8dd83a370 tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:31.318456 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8fee27d2-331a-4453-a3d7-12a8dd83a370 tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:31.676465 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-8fee27d2-331a-4453-a3d7-12a8dd83a370 tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] 10.222.0.46 "POST /compute/v2.1/servers/b3dd3992-80af-4b32-9542-0d000187e277/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.372040 Jan 15 21:11:31.677526 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3006/6027] 10.222.0.46 () {60 vars in 1322 bytes} [Sat Jan 15 21:11:31 2022] POST /compute/v2.1/servers/b3dd3992-80af-4b32-9542-0d000187e277/os-volume_attachments => generated 194 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 21:11:32.300976 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1e858b49-135b-47f2-b31d-23709621d768 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:11:32.301708 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-1e858b49-135b-47f2-b31d-23709621d768 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] [instance: 20b5b2d2-e5cc-4c06-9420-9fbf3569996c] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:11:32.316517 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1e858b49-135b-47f2-b31d-23709621d768 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:32.318858 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1e858b49-135b-47f2-b31d-23709621d768 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:32.320107 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1e858b49-135b-47f2-b31d-23709621d768 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:32.325611 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1e858b49-135b-47f2-b31d-23709621d768 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:33.346253 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-1e858b49-135b-47f2-b31d-23709621d768 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6aa71a6c814c758e2a28a5d7c6e5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4a162d96614ece8caf16ccbc99ad5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:11:33.362354 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-1e858b49-135b-47f2-b31d-23709621d768 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] 10.222.0.46 "GET /compute/v2.1/servers/20b5b2d2-e5cc-4c06-9420-9fbf3569996c" status: 200 len: 1487 microversion: 2.1 time: 1.066272 Jan 15 21:11:33.363417 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3022/6028] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:11:32 2022] GET /compute/v2.1/servers/20b5b2d2-e5cc-4c06-9420-9fbf3569996c => generated 1487 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:11:33.649044 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-4342f047-6ffa-4a96-b662-00d1a7f1524a tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1477945576", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "199105de-00cd-44b3-8e15-12c91d44ad90"}]}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:11:33.777041 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.network.neutron [None req-4342f047-6ffa-4a96-b662-00d1a7f1524a tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] validate_networks() for [('199105de-00cd-44b3-8e15-12c91d44ad90', None, None, None, None, None)] {{(pid=129365) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 21:11:35.584626 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-4342f047-6ffa-4a96-b662-00d1a7f1524a tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Flavor limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 21:11:35.586194 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-4342f047-6ffa-4a96-b662-00d1a7f1524a tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Image limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 21:11:35.586926 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-4342f047-6ffa-4a96-b662-00d1a7f1524a tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Flavor pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 21:11:35.589207 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-4342f047-6ffa-4a96-b662-00d1a7f1524a tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Image pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 21:11:35.590024 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-4342f047-6ffa-4a96-b662-00d1a7f1524a tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 21:11:35.614328 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4342f047-6ffa-4a96-b662-00d1a7f1524a tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:35.615207 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4342f047-6ffa-4a96-b662-00d1a7f1524a tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:35.616345 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4342f047-6ffa-4a96-b662-00d1a7f1524a tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:35.619473 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4342f047-6ffa-4a96-b662-00d1a7f1524a tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:35.673964 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-4342f047-6ffa-4a96-b662-00d1a7f1524a tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Getting quotas for project 7d4a162d96614ece8caf16ccbc99ad5f. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:11:35.686462 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-4342f047-6ffa-4a96-b662-00d1a7f1524a tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Getting quotas for user 0e6aa71a6c814c758e2a28a5d7c6e5a6 and project 7d4a162d96614ece8caf16ccbc99ad5f. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:11:35.726972 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-4342f047-6ffa-4a96-b662-00d1a7f1524a tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Going to run 1 instances... {{(pid=129365) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 21:11:35.733976 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-4342f047-6ffa-4a96-b662-00d1a7f1524a tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] [instance: 462c1966-4e42-42e4-9bce-7c6e28d73918] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129365) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 21:11:35.810845 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-4342f047-6ffa-4a96-b662-00d1a7f1524a tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.166514 Jan 15 21:11:35.812609 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3007/6029] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 21:11:33 2022] POST /compute/v2.1/servers => generated 383 bytes in 2169 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 21:11:35.824438 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f300c370-80ed-41ea-991c-93630426336d tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:11:35.830477 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f300c370-80ed-41ea-991c-93630426336d tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] [instance: 462c1966-4e42-42e4-9bce-7c6e28d73918] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:11:36.017761 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-f300c370-80ed-41ea-991c-93630426336d tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6aa71a6c814c758e2a28a5d7c6e5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4a162d96614ece8caf16ccbc99ad5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:11:36.029148 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f300c370-80ed-41ea-991c-93630426336d tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] 10.222.0.46 "GET /compute/v2.1/servers/462c1966-4e42-42e4-9bce-7c6e28d73918" status: 200 len: 1214 microversion: 2.1 time: 0.209040 Jan 15 21:11:36.030770 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3023/6030] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:11:35 2022] GET /compute/v2.1/servers/462c1966-4e42-42e4-9bce-7c6e28d73918 => generated 1214 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:11:37.048471 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3f087aea-e234-49f5-8a2d-a44578f7ccfe tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:11:37.049661 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-3f087aea-e234-49f5-8a2d-a44578f7ccfe tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] [instance: 462c1966-4e42-42e4-9bce-7c6e28d73918] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:11:37.064160 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3f087aea-e234-49f5-8a2d-a44578f7ccfe tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:37.064617 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3f087aea-e234-49f5-8a2d-a44578f7ccfe tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:37.065450 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3f087aea-e234-49f5-8a2d-a44578f7ccfe tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:37.077576 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3f087aea-e234-49f5-8a2d-a44578f7ccfe tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:37.200091 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-3f087aea-e234-49f5-8a2d-a44578f7ccfe tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6aa71a6c814c758e2a28a5d7c6e5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4a162d96614ece8caf16ccbc99ad5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:11:37.212741 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3f087aea-e234-49f5-8a2d-a44578f7ccfe tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] 10.222.0.46 "GET /compute/v2.1/servers/462c1966-4e42-42e4-9bce-7c6e28d73918" status: 200 len: 1266 microversion: 2.1 time: 0.168163 Jan 15 21:11:37.212860 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3008/6031] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:11:37 2022] GET /compute/v2.1/servers/462c1966-4e42-42e4-9bce-7c6e28d73918 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:11:38.232611 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a24ee043-8ce8-4b9e-ba5d-3fe7d33fd835 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:11:38.234006 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a24ee043-8ce8-4b9e-ba5d-3fe7d33fd835 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] [instance: 462c1966-4e42-42e4-9bce-7c6e28d73918] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:11:38.251766 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a24ee043-8ce8-4b9e-ba5d-3fe7d33fd835 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:38.253146 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a24ee043-8ce8-4b9e-ba5d-3fe7d33fd835 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:38.254046 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a24ee043-8ce8-4b9e-ba5d-3fe7d33fd835 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:38.254492 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a24ee043-8ce8-4b9e-ba5d-3fe7d33fd835 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:38.768740 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-a24ee043-8ce8-4b9e-ba5d-3fe7d33fd835 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6aa71a6c814c758e2a28a5d7c6e5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4a162d96614ece8caf16ccbc99ad5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:11:38.785975 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a24ee043-8ce8-4b9e-ba5d-3fe7d33fd835 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] 10.222.0.46 "GET /compute/v2.1/servers/462c1966-4e42-42e4-9bce-7c6e28d73918" status: 200 len: 1272 microversion: 2.1 time: 0.559595 Jan 15 21:11:38.787037 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3024/6032] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:11:38 2022] GET /compute/v2.1/servers/462c1966-4e42-42e4-9bce-7c6e28d73918 => generated 1272 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:11:38.996559 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-03a54cda-dbc1-42c3-8560-b391742201a5 tempest-TestAggregatesBasicOps-1870798950 tempest-TestAggregatesBasicOps-1870798950-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-1165389208", "availability_zone": "foo_zone"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:11:39.050715 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:11:39.050715 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:11:39.052953 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.objects.aggregate [None req-03a54cda-dbc1-42c3-8560-b391742201a5 tempest-TestAggregatesBasicOps-1870798950 tempest-TestAggregatesBasicOps-1870798950-project-admin] Generated uuid 0bd95acf-ed9b-4002-a181-3c0d8ccc8da3 for aggregate {{(pid=129365) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jan 15 21:11:39.145261 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-03a54cda-dbc1-42c3-8560-b391742201a5 tempest-TestAggregatesBasicOps-1870798950 tempest-TestAggregatesBasicOps-1870798950-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates" status: 200 len: 209 microversion: 2.1 time: 0.382776 Jan 15 21:11:39.158877 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3009/6033] 10.222.0.46 () {60 vars in 1163 bytes} [Sat Jan 15 21:11:38 2022] POST /compute/v2.1/os-aggregates => generated 209 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:11:39.171513 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-3ae0f4c6-c22d-4bde-9023-c570c2395f98 tempest-TestAggregatesBasicOps-1870798950 tempest-TestAggregatesBasicOps-1870798950-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:11:39.173124 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:11:39.173124 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:11:39.186586 ncdv-master-1 devstack@n-api.service[129366]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3ae0f4c6-c22d-4bde-9023-c570c2395f98 tempest-TestAggregatesBasicOps-1870798950 tempest-TestAggregatesBasicOps-1870798950-project-admin] [a52769e9-7192-415f-a0d1-17e471a26ade] AMQP server on 10.222.0.46:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 15 21:11:39.803710 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-6c6ddb8e-0608-4e90-9b6e-049d360300a3 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:11:39.804820 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-6c6ddb8e-0608-4e90-9b6e-049d360300a3 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] [instance: 462c1966-4e42-42e4-9bce-7c6e28d73918] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:11:39.815241 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6c6ddb8e-0608-4e90-9b6e-049d360300a3 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:39.816047 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6c6ddb8e-0608-4e90-9b6e-049d360300a3 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:39.817248 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6c6ddb8e-0608-4e90-9b6e-049d360300a3 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:39.817945 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6c6ddb8e-0608-4e90-9b6e-049d360300a3 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:39.978143 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-6c6ddb8e-0608-4e90-9b6e-049d360300a3 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6aa71a6c814c758e2a28a5d7c6e5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4a162d96614ece8caf16ccbc99ad5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:11:39.988692 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-6c6ddb8e-0608-4e90-9b6e-049d360300a3 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] 10.222.0.46 "GET /compute/v2.1/servers/462c1966-4e42-42e4-9bce-7c6e28d73918" status: 200 len: 1272 microversion: 2.1 time: 0.188528 Jan 15 21:11:39.990765 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3010/6034] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:11:39 2022] GET /compute/v2.1/servers/462c1966-4e42-42e4-9bce-7c6e28d73918 => generated 1272 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:11:40.195801 ncdv-master-1 devstack@n-api.service[129366]: INFO oslo.messaging._drivers.impl_rabbit [None req-3ae0f4c6-c22d-4bde-9023-c570c2395f98 tempest-TestAggregatesBasicOps-1870798950 tempest-TestAggregatesBasicOps-1870798950-project-admin] [a52769e9-7192-415f-a0d1-17e471a26ade] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 50064. Jan 15 21:11:40.227447 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-3ae0f4c6-c22d-4bde-9023-c570c2395f98 tempest-TestAggregatesBasicOps-1870798950 tempest-TestAggregatesBasicOps-1870798950-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 319 microversion: 2.1 time: 1.062690 Jan 15 21:11:40.228831 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3025/6035] 10.222.0.46 () {60 vars in 1193 bytes} [Sat Jan 15 21:11:39 2022] POST /compute/v2.1/os-aggregates/19/action => generated 319 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:11:40.248423 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-40093703-1d2b-41c0-8ac0-20e67a6f6bff tempest-TestAggregatesBasicOps-1870798950 tempest-TestAggregatesBasicOps-1870798950-project-admin] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:11:40.262908 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:11:40.262908 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:11:40.278501 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-40093703-1d2b-41c0-8ac0-20e67a6f6bff tempest-TestAggregatesBasicOps-1870798950 tempest-TestAggregatesBasicOps-1870798950-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:40.278966 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-40093703-1d2b-41c0-8ac0-20e67a6f6bff tempest-TestAggregatesBasicOps-1870798950 tempest-TestAggregatesBasicOps-1870798950-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:40.279959 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-40093703-1d2b-41c0-8ac0-20e67a6f6bff tempest-TestAggregatesBasicOps-1870798950 tempest-TestAggregatesBasicOps-1870798950-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:40.280400 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-40093703-1d2b-41c0-8ac0-20e67a6f6bff tempest-TestAggregatesBasicOps-1870798950 tempest-TestAggregatesBasicOps-1870798950-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:40.334122 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-40093703-1d2b-41c0-8ac0-20e67a6f6bff tempest-TestAggregatesBasicOps-1870798950 tempest-TestAggregatesBasicOps-1870798950-project-admin] 10.222.0.46 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.097645 Jan 15 21:11:40.334770 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3011/6036] 10.222.0.46 () {58 vars in 1175 bytes} [Sat Jan 15 21:11:40 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:11:40.349903 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-94df4437-f604-47a1-96ab-3396e4697c02 tempest-TestAggregatesBasicOps-1870798950 tempest-TestAggregatesBasicOps-1870798950-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:11:40.351132 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:11:40.351132 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:11:40.360257 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-94df4437-f604-47a1-96ab-3396e4697c02 tempest-TestAggregatesBasicOps-1870798950 tempest-TestAggregatesBasicOps-1870798950-project-admin] 10.222.0.46 "GET /compute/v2.1/os-aggregates" status: 200 len: 298 microversion: 2.1 time: 0.018311 Jan 15 21:11:40.374194 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3f8db7aa-42bc-469c-ae80-6445280b88a1 tempest-TestAggregatesBasicOps-1870798950 tempest-TestAggregatesBasicOps-1870798950-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:11:40.375705 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:11:40.375705 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:11:40.378396 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3026/6037] 10.222.0.46 () {58 vars in 1142 bytes} [Sat Jan 15 21:11:40 2022] GET /compute/v2.1/os-aggregates => generated 298 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:11:40.393183 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3f8db7aa-42bc-469c-ae80-6445280b88a1 tempest-TestAggregatesBasicOps-1870798950 tempest-TestAggregatesBasicOps-1870798950-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:40.393937 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3f8db7aa-42bc-469c-ae80-6445280b88a1 tempest-TestAggregatesBasicOps-1870798950 tempest-TestAggregatesBasicOps-1870798950-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:40.750656 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3f8db7aa-42bc-469c-ae80-6445280b88a1 tempest-TestAggregatesBasicOps-1870798950 tempest-TestAggregatesBasicOps-1870798950-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 310 microversion: 2.1 time: 0.382413 Jan 15 21:11:40.751851 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3012/6038] 10.222.0.46 () {60 vars in 1193 bytes} [Sat Jan 15 21:11:40 2022] POST /compute/v2.1/os-aggregates/19/action => generated 310 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:11:40.761480 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-669877c5-2147-4233-b84d-85b4c151e450 tempest-TestAggregatesBasicOps-1870798950 tempest-TestAggregatesBasicOps-1870798950-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:11:40.763147 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:11:40.763147 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:11:40.774553 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-669877c5-2147-4233-b84d-85b4c151e450 tempest-TestAggregatesBasicOps-1870798950 tempest-TestAggregatesBasicOps-1870798950-project-admin] 10.222.0.46 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 310 microversion: 2.1 time: 0.016887 Jan 15 21:11:40.775460 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3027/6039] 10.222.0.46 () {58 vars in 1151 bytes} [Sat Jan 15 21:11:40 2022] GET /compute/v2.1/os-aggregates/19 => generated 310 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:11:40.786299 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b14208e2-06f4-480c-9bbd-93f3e47e3f69 tempest-TestAggregatesBasicOps-1870798950 tempest-TestAggregatesBasicOps-1870798950-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-1878183905", "availability_zone": "foo_zone"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:11:40.864492 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:11:40.864492 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:11:40.912613 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b14208e2-06f4-480c-9bbd-93f3e47e3f69 tempest-TestAggregatesBasicOps-1870798950 tempest-TestAggregatesBasicOps-1870798950-project-admin] 10.222.0.46 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 342 microversion: 2.1 time: 0.129886 Jan 15 21:11:40.920209 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3013/6040] 10.222.0.46 () {60 vars in 1172 bytes} [Sat Jan 15 21:11:40 2022] PUT /compute/v2.1/os-aggregates/19 => generated 342 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:11:40.925649 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-aaa3282e-ea0d-48e9-9fba-82ad257e280b tempest-TestAggregatesBasicOps-1870798950 tempest-TestAggregatesBasicOps-1870798950-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:11:40.927160 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:11:40.927160 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:11:40.961354 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-aaa3282e-ea0d-48e9-9fba-82ad257e280b tempest-TestAggregatesBasicOps-1870798950 tempest-TestAggregatesBasicOps-1870798950-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 356 microversion: 2.1 time: 0.039405 Jan 15 21:11:40.963109 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3028/6041] 10.222.0.46 () {60 vars in 1193 bytes} [Sat Jan 15 21:11:40 2022] POST /compute/v2.1/os-aggregates/19/action => generated 356 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 21:11:40.988774 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-643f1ae1-fbbe-485d-aeba-a9c4e5ed6a6b tempest-TestAggregatesBasicOps-1870798950 tempest-TestAggregatesBasicOps-1870798950-project-admin] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:11:40.989650 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:11:40.989650 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:11:41.003604 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-643f1ae1-fbbe-485d-aeba-a9c4e5ed6a6b tempest-TestAggregatesBasicOps-1870798950 tempest-TestAggregatesBasicOps-1870798950-project-admin] 10.222.0.46 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 356 microversion: 2.1 time: 0.032193 Jan 15 21:11:41.004547 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3014/6042] 10.222.0.46 () {58 vars in 1151 bytes} [Sat Jan 15 21:11:40 2022] GET /compute/v2.1/os-aggregates/19 => generated 356 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:11:41.009689 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7f470940-4a02-46b2-86dc-ceb2ec16226c tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:11:41.009689 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-7f470940-4a02-46b2-86dc-ceb2ec16226c tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] [instance: 462c1966-4e42-42e4-9bce-7c6e28d73918] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:11:41.024922 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f8ab2f4c-257b-45fe-8275-8a64f6f2ab19 tempest-TestAggregatesBasicOps-1870798950 tempest-TestAggregatesBasicOps-1870798950-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:11:41.026548 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:11:41.026548 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:11:41.030205 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7f470940-4a02-46b2-86dc-ceb2ec16226c tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:41.031388 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7f470940-4a02-46b2-86dc-ceb2ec16226c tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:41.034544 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7f470940-4a02-46b2-86dc-ceb2ec16226c tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:41.035031 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7f470940-4a02-46b2-86dc-ceb2ec16226c tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:41.046146 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f8ab2f4c-257b-45fe-8275-8a64f6f2ab19 tempest-TestAggregatesBasicOps-1870798950 tempest-TestAggregatesBasicOps-1870798950-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:41.046596 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f8ab2f4c-257b-45fe-8275-8a64f6f2ab19 tempest-TestAggregatesBasicOps-1870798950 tempest-TestAggregatesBasicOps-1870798950-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:41.360324 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f8ab2f4c-257b-45fe-8275-8a64f6f2ab19 tempest-TestAggregatesBasicOps-1870798950 tempest-TestAggregatesBasicOps-1870798950-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 341 microversion: 2.1 time: 0.346938 Jan 15 21:11:41.385459 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3015/6043] 10.222.0.46 () {60 vars in 1193 bytes} [Sat Jan 15 21:11:41 2022] POST /compute/v2.1/os-aggregates/19/action => generated 341 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:11:41.421456 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-7f470940-4a02-46b2-86dc-ceb2ec16226c tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6aa71a6c814c758e2a28a5d7c6e5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4a162d96614ece8caf16ccbc99ad5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:11:41.434821 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7f470940-4a02-46b2-86dc-ceb2ec16226c tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] 10.222.0.46 "GET /compute/v2.1/servers/462c1966-4e42-42e4-9bce-7c6e28d73918" status: 200 len: 1318 microversion: 2.1 time: 0.430958 Jan 15 21:11:41.440102 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3029/6044] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:11:41 2022] GET /compute/v2.1/servers/462c1966-4e42-42e4-9bce-7c6e28d73918 => generated 1318 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:11:41.448450 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-81ff8117-a42f-4b48-b334-0a109e940921 tempest-TestAggregatesBasicOps-1870798950 tempest-TestAggregatesBasicOps-1870798950-project-admin] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:11:41.450400 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:11:41.450400 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:11:41.487008 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-81ff8117-a42f-4b48-b334-0a109e940921 tempest-TestAggregatesBasicOps-1870798950 tempest-TestAggregatesBasicOps-1870798950-project-admin] 10.222.0.46 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.089313 Jan 15 21:11:41.488261 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3016/6045] 10.222.0.46 () {58 vars in 1154 bytes} [Sat Jan 15 21:11:41 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jan 15 21:11:42.082828 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-68367172-5d26-4e36-8abb-4fe60ea9a3bf tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:11:42.083318 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-68367172-5d26-4e36-8abb-4fe60ea9a3bf tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] [instance: b3dd3992-80af-4b32-9542-0d000187e277] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:11:42.092348 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-68367172-5d26-4e36-8abb-4fe60ea9a3bf tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:42.093362 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-68367172-5d26-4e36-8abb-4fe60ea9a3bf tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:42.094304 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-68367172-5d26-4e36-8abb-4fe60ea9a3bf tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:42.094922 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-68367172-5d26-4e36-8abb-4fe60ea9a3bf tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:42.205447 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.objects.instance [None req-68367172-5d26-4e36-8abb-4fe60ea9a3bf tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] Lazy-loading 'services' on Instance uuid b3dd3992-80af-4b32-9542-0d000187e277 {{(pid=129366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 21:11:42.415190 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-68367172-5d26-4e36-8abb-4fe60ea9a3bf tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] 10.222.0.46 "DELETE /compute/v2.1/servers/b3dd3992-80af-4b32-9542-0d000187e277/os-volume_attachments/c02f8a1d-b762-40be-9f64-e353ef1c9a98" status: 202 len: 0 microversion: 2.1 time: 0.335523 Jan 15 21:11:42.416624 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3030/6046] 10.222.0.46 () {58 vars in 1415 bytes} [Sat Jan 15 21:11:42 2022] DELETE /compute/v2.1/servers/b3dd3992-80af-4b32-9542-0d000187e277/os-volume_attachments/c02f8a1d-b762-40be-9f64-e353ef1c9a98 => generated 0 bytes in 338 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:11:42.458135 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b9026470-8532-402d-acef-3befb0e6a28d tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:11:42.459605 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b9026470-8532-402d-acef-3befb0e6a28d tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] [instance: 462c1966-4e42-42e4-9bce-7c6e28d73918] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:11:42.479264 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b9026470-8532-402d-acef-3befb0e6a28d tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:42.481197 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b9026470-8532-402d-acef-3befb0e6a28d tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:42.483414 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b9026470-8532-402d-acef-3befb0e6a28d tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:42.485194 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b9026470-8532-402d-acef-3befb0e6a28d tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:42.835468 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-b9026470-8532-402d-acef-3befb0e6a28d tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6aa71a6c814c758e2a28a5d7c6e5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4a162d96614ece8caf16ccbc99ad5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:11:42.849994 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b9026470-8532-402d-acef-3befb0e6a28d tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] 10.222.0.46 "GET /compute/v2.1/servers/462c1966-4e42-42e4-9bce-7c6e28d73918" status: 200 len: 1314 microversion: 2.1 time: 0.397346 Jan 15 21:11:42.850591 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3017/6047] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:11:42 2022] GET /compute/v2.1/servers/462c1966-4e42-42e4-9bce-7c6e28d73918 => generated 1314 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:11:43.688022 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-cae297bc-bbb1-4d43-af91-b94fa9f96b18 tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:11:43.689600 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-cae297bc-bbb1-4d43-af91-b94fa9f96b18 tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] [instance: b3dd3992-80af-4b32-9542-0d000187e277] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:11:43.708745 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cae297bc-bbb1-4d43-af91-b94fa9f96b18 tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:43.709208 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cae297bc-bbb1-4d43-af91-b94fa9f96b18 tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:43.718743 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cae297bc-bbb1-4d43-af91-b94fa9f96b18 tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:43.719206 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cae297bc-bbb1-4d43-af91-b94fa9f96b18 tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:43.790851 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-cae297bc-bbb1-4d43-af91-b94fa9f96b18 tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] [instance: b3dd3992-80af-4b32-9542-0d000187e277] Going to try to terminate instance {{(pid=129366) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 21:11:43.867923 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f69db693-1589-4628-b076-7c9c133d43b4 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:11:43.869155 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f69db693-1589-4628-b076-7c9c133d43b4 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] [instance: 462c1966-4e42-42e4-9bce-7c6e28d73918] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:11:43.889331 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f69db693-1589-4628-b076-7c9c133d43b4 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:43.891570 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f69db693-1589-4628-b076-7c9c133d43b4 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:43.893793 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f69db693-1589-4628-b076-7c9c133d43b4 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:43.895696 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f69db693-1589-4628-b076-7c9c133d43b4 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:44.008440 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-cae297bc-bbb1-4d43-af91-b94fa9f96b18 tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] 10.222.0.46 "DELETE /compute/v2.1/servers/b3dd3992-80af-4b32-9542-0d000187e277" status: 204 len: 0 microversion: 2.1 time: 0.326401 Jan 15 21:11:44.010264 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3031/6048] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 21:11:43 2022] DELETE /compute/v2.1/servers/b3dd3992-80af-4b32-9542-0d000187e277 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 21:11:44.022692 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d7c63ec1-85db-40a7-a752-60d1943e9422 tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:11:44.023732 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-d7c63ec1-85db-40a7-a752-60d1943e9422 tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] [instance: b3dd3992-80af-4b32-9542-0d000187e277] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:11:44.049567 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d7c63ec1-85db-40a7-a752-60d1943e9422 tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:44.050697 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d7c63ec1-85db-40a7-a752-60d1943e9422 tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:44.054020 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d7c63ec1-85db-40a7-a752-60d1943e9422 tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:44.054858 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d7c63ec1-85db-40a7-a752-60d1943e9422 tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:44.768633 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-d7c63ec1-85db-40a7-a752-60d1943e9422 tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b33ce60fd114adf982f585dde34ed04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581f23bb65c648408f2707a199a990e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:11:44.783856 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d7c63ec1-85db-40a7-a752-60d1943e9422 tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] 10.222.0.46 "GET /compute/v2.1/servers/b3dd3992-80af-4b32-9542-0d000187e277" status: 200 len: 1469 microversion: 2.1 time: 0.769232 Jan 15 21:11:44.813912 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3032/6049] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:11:44 2022] GET /compute/v2.1/servers/b3dd3992-80af-4b32-9542-0d000187e277 => generated 1469 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:11:44.842996 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-17b9ea13-7057-4c5c-806c-486e3ffc349a req-979e8c3d-fe75-4422-9046-7ac0830efde9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "462c1966-4e42-42e4-9bce-7c6e28d73918", "tag": "50bb49c7-3617-4308-844c-7a5f3d2c58b0"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:11:44.847202 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:11:44.847202 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:11:44.858809 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-17b9ea13-7057-4c5c-806c-486e3ffc349a req-979e8c3d-fe75-4422-9046-7ac0830efde9 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:44.859596 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-17b9ea13-7057-4c5c-806c-486e3ffc349a req-979e8c3d-fe75-4422-9046-7ac0830efde9 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:44.867469 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-f69db693-1589-4628-b076-7c9c133d43b4 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6aa71a6c814c758e2a28a5d7c6e5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4a162d96614ece8caf16ccbc99ad5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:11:44.874853 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-17b9ea13-7057-4c5c-806c-486e3ffc349a req-979e8c3d-fe75-4422-9046-7ac0830efde9 service nova] Creating event network-changed:50bb49c7-3617-4308-844c-7a5f3d2c58b0 for instance 462c1966-4e42-42e4-9bce-7c6e28d73918 on nch2-master-1 Jan 15 21:11:44.877534 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f69db693-1589-4628-b076-7c9c133d43b4 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] 10.222.0.46 "GET /compute/v2.1/servers/462c1966-4e42-42e4-9bce-7c6e28d73918" status: 200 len: 1314 microversion: 2.1 time: 1.014363 Jan 15 21:11:44.881812 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-17b9ea13-7057-4c5c-806c-486e3ffc349a req-979e8c3d-fe75-4422-9046-7ac0830efde9 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064838 Jan 15 21:11:44.882516 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3018/6050] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:11:43 2022] GET /compute/v2.1/servers/462c1966-4e42-42e4-9bce-7c6e28d73918 => generated 1314 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:11:44.883735 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3033/6051] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:11:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:11:45.799783 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-871477b1-f764-4fcb-a6df-84916edb3698 tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-207623656", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:11:45.802065 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b4230fec-9ec8-4e1f-a882-b58f79a3f99f tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:11:45.802838 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b4230fec-9ec8-4e1f-a882-b58f79a3f99f tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] [instance: b3dd3992-80af-4b32-9542-0d000187e277] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:11:45.811580 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b4230fec-9ec8-4e1f-a882-b58f79a3f99f tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:45.812119 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b4230fec-9ec8-4e1f-a882-b58f79a3f99f tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:45.813246 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b4230fec-9ec8-4e1f-a882-b58f79a3f99f tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:45.814064 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b4230fec-9ec8-4e1f-a882-b58f79a3f99f tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:45.891881 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.network.neutron [None req-871477b1-f764-4fcb-a6df-84916edb3698 tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] validate_networks() for None {{(pid=129365) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 21:11:46.227757 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-b4230fec-9ec8-4e1f-a882-b58f79a3f99f tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b33ce60fd114adf982f585dde34ed04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581f23bb65c648408f2707a199a990e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:11:46.261368 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b4230fec-9ec8-4e1f-a882-b58f79a3f99f tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] 10.222.0.46 "GET /compute/v2.1/servers/b3dd3992-80af-4b32-9542-0d000187e277" status: 200 len: 1469 microversion: 2.1 time: 0.463200 Jan 15 21:11:46.262432 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3034/6052] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:11:45 2022] GET /compute/v2.1/servers/b3dd3992-80af-4b32-9542-0d000187e277 => generated 1469 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:11:46.268981 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4e9970c2-d429-47b1-9ded-5313de457818 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:11:46.270574 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-4e9970c2-d429-47b1-9ded-5313de457818 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] [instance: 462c1966-4e42-42e4-9bce-7c6e28d73918] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:11:46.279720 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4e9970c2-d429-47b1-9ded-5313de457818 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:46.280282 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4e9970c2-d429-47b1-9ded-5313de457818 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:46.281209 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4e9970c2-d429-47b1-9ded-5313de457818 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:46.281739 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4e9970c2-d429-47b1-9ded-5313de457818 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:46.442017 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-871477b1-f764-4fcb-a6df-84916edb3698 tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] Flavor limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 21:11:46.442614 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-871477b1-f764-4fcb-a6df-84916edb3698 tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] Image limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 21:11:46.443223 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-871477b1-f764-4fcb-a6df-84916edb3698 tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] Flavor pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 21:11:46.443812 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-871477b1-f764-4fcb-a6df-84916edb3698 tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] Image pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 21:11:46.444383 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-871477b1-f764-4fcb-a6df-84916edb3698 tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 21:11:46.453985 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-871477b1-f764-4fcb-a6df-84916edb3698 tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:46.454431 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-871477b1-f764-4fcb-a6df-84916edb3698 tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:46.455417 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-871477b1-f764-4fcb-a6df-84916edb3698 tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:46.456211 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-871477b1-f764-4fcb-a6df-84916edb3698 tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:46.473974 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-871477b1-f764-4fcb-a6df-84916edb3698 tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] Getting quotas for project e469a5c2748947d2b8a9103dafc74172. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:11:46.479178 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-871477b1-f764-4fcb-a6df-84916edb3698 tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] Getting quotas for user 941792efba534f3eb072b727046cfdc9 and project e469a5c2748947d2b8a9103dafc74172. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:11:46.492479 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-871477b1-f764-4fcb-a6df-84916edb3698 tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] Going to run 1 instances... {{(pid=129365) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 21:11:46.495516 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-871477b1-f764-4fcb-a6df-84916edb3698 tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] [instance: e56a1dea-de89-4cff-9629-da5fd7c83706] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129365) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 21:11:46.550393 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-871477b1-f764-4fcb-a6df-84916edb3698 tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.756248 Jan 15 21:11:46.553286 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3019/6053] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 21:11:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 760 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 21:11:46.565728 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-29ad0f53-314e-4227-a917-fe49ffd17567 tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:11:46.566859 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-29ad0f53-314e-4227-a917-fe49ffd17567 tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] [instance: e56a1dea-de89-4cff-9629-da5fd7c83706] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:11:46.665321 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-4e9970c2-d429-47b1-9ded-5313de457818 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6aa71a6c814c758e2a28a5d7c6e5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4a162d96614ece8caf16ccbc99ad5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:11:46.680157 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-4e9970c2-d429-47b1-9ded-5313de457818 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] 10.222.0.46 "GET /compute/v2.1/servers/462c1966-4e42-42e4-9bce-7c6e28d73918" status: 200 len: 1314 microversion: 2.1 time: 0.415710 Jan 15 21:11:46.680912 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3035/6054] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:11:46 2022] GET /compute/v2.1/servers/462c1966-4e42-42e4-9bce-7c6e28d73918 => generated 1314 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:11:46.681420 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-29ad0f53-314e-4227-a917-fe49ffd17567 tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '941792efba534f3eb072b727046cfdc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e469a5c2748947d2b8a9103dafc74172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:11:46.694945 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-29ad0f53-314e-4227-a917-fe49ffd17567 tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] 10.222.0.46 "GET /compute/v2.1/servers/e56a1dea-de89-4cff-9629-da5fd7c83706" status: 200 len: 1214 microversion: 2.1 time: 0.133191 Jan 15 21:11:46.695926 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3020/6055] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:11:46 2022] GET /compute/v2.1/servers/e56a1dea-de89-4cff-9629-da5fd7c83706 => generated 1214 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:11:47.287214 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e934b50f-e0a4-4208-adfe-95e33156e1f6 tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:11:47.288517 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e934b50f-e0a4-4208-adfe-95e33156e1f6 tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] [instance: b3dd3992-80af-4b32-9542-0d000187e277] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:11:47.298288 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e934b50f-e0a4-4208-adfe-95e33156e1f6 tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:47.299080 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e934b50f-e0a4-4208-adfe-95e33156e1f6 tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:47.300267 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e934b50f-e0a4-4208-adfe-95e33156e1f6 tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:47.300947 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e934b50f-e0a4-4208-adfe-95e33156e1f6 tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:47.699902 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-992f95c0-d903-4681-8cd3-114ec7a32b11 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:11:47.701436 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-992f95c0-d903-4681-8cd3-114ec7a32b11 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] [instance: 462c1966-4e42-42e4-9bce-7c6e28d73918] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:11:47.723273 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-992f95c0-d903-4681-8cd3-114ec7a32b11 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:47.724074 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-992f95c0-d903-4681-8cd3-114ec7a32b11 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:47.725155 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-992f95c0-d903-4681-8cd3-114ec7a32b11 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:47.725757 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-992f95c0-d903-4681-8cd3-114ec7a32b11 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:48.666974 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-e934b50f-e0a4-4208-adfe-95e33156e1f6 tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b33ce60fd114adf982f585dde34ed04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581f23bb65c648408f2707a199a990e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:11:48.674111 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e934b50f-e0a4-4208-adfe-95e33156e1f6 tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] 10.222.0.46 "GET /compute/v2.1/servers/b3dd3992-80af-4b32-9542-0d000187e277" status: 200 len: 1469 microversion: 2.1 time: 1.392911 Jan 15 21:11:48.676316 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3036/6056] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:11:47 2022] GET /compute/v2.1/servers/b3dd3992-80af-4b32-9542-0d000187e277 => generated 1469 bytes in 1395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:11:48.681788 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-afc41455-7336-4254-8f86-f04f4294283b tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:11:48.683123 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-afc41455-7336-4254-8f86-f04f4294283b tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] [instance: e56a1dea-de89-4cff-9629-da5fd7c83706] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:11:48.689303 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-afc41455-7336-4254-8f86-f04f4294283b tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:48.689930 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-afc41455-7336-4254-8f86-f04f4294283b tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:48.690900 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-afc41455-7336-4254-8f86-f04f4294283b tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:48.691491 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-afc41455-7336-4254-8f86-f04f4294283b tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:48.838078 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-afc41455-7336-4254-8f86-f04f4294283b tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '941792efba534f3eb072b727046cfdc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e469a5c2748947d2b8a9103dafc74172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:11:48.857517 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-992f95c0-d903-4681-8cd3-114ec7a32b11 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6aa71a6c814c758e2a28a5d7c6e5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4a162d96614ece8caf16ccbc99ad5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:11:48.870002 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-afc41455-7336-4254-8f86-f04f4294283b tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] 10.222.0.46 "GET /compute/v2.1/servers/e56a1dea-de89-4cff-9629-da5fd7c83706" status: 200 len: 1272 microversion: 2.1 time: 0.187827 Jan 15 21:11:48.871222 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3037/6057] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:11:48 2022] GET /compute/v2.1/servers/e56a1dea-de89-4cff-9629-da5fd7c83706 => generated 1272 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:11:48.876274 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-992f95c0-d903-4681-8cd3-114ec7a32b11 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] 10.222.0.46 "GET /compute/v2.1/servers/462c1966-4e42-42e4-9bce-7c6e28d73918" status: 200 len: 1314 microversion: 2.1 time: 1.180975 Jan 15 21:11:48.879048 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3021/6058] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:11:47 2022] GET /compute/v2.1/servers/462c1966-4e42-42e4-9bce-7c6e28d73918 => generated 1314 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:11:48.881623 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-38da6b52-287c-4c2b-9554-fb1d51a1103c req-39971cef-8341-4a1b-b8cb-ce7349e20766 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3dd3992-80af-4b32-9542-0d000187e277", "name": "network-vif-deleted", "tag": "f2e8d311-9ea4-4bf4-83cb-f4cbf0099ba8"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:11:48.883925 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:11:48.883925 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:11:48.893345 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-38da6b52-287c-4c2b-9554-fb1d51a1103c req-39971cef-8341-4a1b-b8cb-ce7349e20766 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:48.894111 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-38da6b52-287c-4c2b-9554-fb1d51a1103c req-39971cef-8341-4a1b-b8cb-ce7349e20766 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:48.919039 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-38da6b52-287c-4c2b-9554-fb1d51a1103c req-39971cef-8341-4a1b-b8cb-ce7349e20766 service nova] Creating event network-vif-deleted:f2e8d311-9ea4-4bf4-83cb-f4cbf0099ba8 for instance b3dd3992-80af-4b32-9542-0d000187e277 on nch1-master-1 Jan 15 21:11:48.925098 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-38da6b52-287c-4c2b-9554-fb1d51a1103c req-39971cef-8341-4a1b-b8cb-ce7349e20766 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050664 Jan 15 21:11:48.944331 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3038/6059] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:11:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:11:49.467673 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-b693663a-0df6-461d-bd4d-77eb6d40ab66 req-6be73d74-d24e-4041-86e8-3ba107b7ffee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "462c1966-4e42-42e4-9bce-7c6e28d73918", "name": "network-vif-plugged", "status": "completed", "tag": "50bb49c7-3617-4308-844c-7a5f3d2c58b0"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:11:49.470070 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:11:49.470070 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:11:49.492769 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-b693663a-0df6-461d-bd4d-77eb6d40ab66 req-6be73d74-d24e-4041-86e8-3ba107b7ffee service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:49.497400 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-b693663a-0df6-461d-bd4d-77eb6d40ab66 req-6be73d74-d24e-4041-86e8-3ba107b7ffee service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:49.524757 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-b693663a-0df6-461d-bd4d-77eb6d40ab66 req-6be73d74-d24e-4041-86e8-3ba107b7ffee service nova] Creating event network-vif-plugged:50bb49c7-3617-4308-844c-7a5f3d2c58b0 for instance 462c1966-4e42-42e4-9bce-7c6e28d73918 on nch2-master-1 Jan 15 21:11:49.535403 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-b693663a-0df6-461d-bd4d-77eb6d40ab66 req-6be73d74-d24e-4041-86e8-3ba107b7ffee service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074034 Jan 15 21:11:49.540646 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3022/6060] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:11:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:11:49.698318 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-90a8912c-fad6-4a92-865a-bbe913d79cb2 tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:11:49.699122 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-90a8912c-fad6-4a92-865a-bbe913d79cb2 tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] [instance: b3dd3992-80af-4b32-9542-0d000187e277] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:11:49.719575 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-90a8912c-fad6-4a92-865a-bbe913d79cb2 tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:49.723637 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-90a8912c-fad6-4a92-865a-bbe913d79cb2 tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:49.726753 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-90a8912c-fad6-4a92-865a-bbe913d79cb2 tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:49.727403 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-90a8912c-fad6-4a92-865a-bbe913d79cb2 tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:49.744680 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-90a8912c-fad6-4a92-865a-bbe913d79cb2 tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] HTTP exception thrown: Instance b3dd3992-80af-4b32-9542-0d000187e277 could not be found. Jan 15 21:11:49.745625 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-90a8912c-fad6-4a92-865a-bbe913d79cb2 tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] Returning 404 to user: Instance b3dd3992-80af-4b32-9542-0d000187e277 could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:11:49.746689 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-90a8912c-fad6-4a92-865a-bbe913d79cb2 tempest-VolumesBackupsTest-197440665 tempest-VolumesBackupsTest-197440665-project] 10.222.0.46 "GET /compute/v2.1/servers/b3dd3992-80af-4b32-9542-0d000187e277" status: 404 len: 111 microversion: 2.1 time: 0.058279 Jan 15 21:11:49.747599 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3039/6061] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:11:49 2022] GET /compute/v2.1/servers/b3dd3992-80af-4b32-9542-0d000187e277 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:11:49.891908 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e8db847f-8fc1-4626-945e-b363bc8465b0 tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:11:49.893389 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e8db847f-8fc1-4626-945e-b363bc8465b0 tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] [instance: e56a1dea-de89-4cff-9629-da5fd7c83706] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:11:49.896614 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-98f962c0-dfc2-4a4f-87c4-888440ed0c01 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:11:49.896993 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-98f962c0-dfc2-4a4f-87c4-888440ed0c01 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] [instance: 462c1966-4e42-42e4-9bce-7c6e28d73918] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:11:49.904113 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e8db847f-8fc1-4626-945e-b363bc8465b0 tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:49.904886 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e8db847f-8fc1-4626-945e-b363bc8465b0 tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:49.905969 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e8db847f-8fc1-4626-945e-b363bc8465b0 tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:49.906661 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e8db847f-8fc1-4626-945e-b363bc8465b0 tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:49.909762 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-98f962c0-dfc2-4a4f-87c4-888440ed0c01 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:49.911560 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-98f962c0-dfc2-4a4f-87c4-888440ed0c01 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:49.912555 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-98f962c0-dfc2-4a4f-87c4-888440ed0c01 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:49.913172 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-98f962c0-dfc2-4a4f-87c4-888440ed0c01 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:50.040534 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-e8db847f-8fc1-4626-945e-b363bc8465b0 tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '941792efba534f3eb072b727046cfdc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e469a5c2748947d2b8a9103dafc74172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:11:50.050867 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e8db847f-8fc1-4626-945e-b363bc8465b0 tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] 10.222.0.46 "GET /compute/v2.1/servers/e56a1dea-de89-4cff-9629-da5fd7c83706" status: 200 len: 1272 microversion: 2.1 time: 0.166787 Jan 15 21:11:50.062351 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3023/6062] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:11:49 2022] GET /compute/v2.1/servers/e56a1dea-de89-4cff-9629-da5fd7c83706 => generated 1272 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:11:50.178032 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-98f962c0-dfc2-4a4f-87c4-888440ed0c01 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6aa71a6c814c758e2a28a5d7c6e5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4a162d96614ece8caf16ccbc99ad5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:11:50.190211 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-98f962c0-dfc2-4a4f-87c4-888440ed0c01 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] 10.222.0.46 "GET /compute/v2.1/servers/462c1966-4e42-42e4-9bce-7c6e28d73918" status: 200 len: 1314 microversion: 2.1 time: 0.297729 Jan 15 21:11:50.217250 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3040/6063] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:11:49 2022] GET /compute/v2.1/servers/462c1966-4e42-42e4-9bce-7c6e28d73918 => generated 1314 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:11:51.080954 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-12b80f98-38e8-4982-9984-f7b84ea20d3e tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:11:51.082539 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-12b80f98-38e8-4982-9984-f7b84ea20d3e tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] [instance: e56a1dea-de89-4cff-9629-da5fd7c83706] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:11:51.135726 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-12b80f98-38e8-4982-9984-f7b84ea20d3e tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:51.137960 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-12b80f98-38e8-4982-9984-f7b84ea20d3e tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:51.138997 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-12b80f98-38e8-4982-9984-f7b84ea20d3e tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:51.145188 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-12b80f98-38e8-4982-9984-f7b84ea20d3e tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:51.213163 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c2de2afb-8257-4596-af8c-a102fbe56099 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:11:51.215212 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c2de2afb-8257-4596-af8c-a102fbe56099 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] [instance: 462c1966-4e42-42e4-9bce-7c6e28d73918] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:11:51.252411 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c2de2afb-8257-4596-af8c-a102fbe56099 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:51.254441 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c2de2afb-8257-4596-af8c-a102fbe56099 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:51.257388 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c2de2afb-8257-4596-af8c-a102fbe56099 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:51.258350 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c2de2afb-8257-4596-af8c-a102fbe56099 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:52.393821 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-c2de2afb-8257-4596-af8c-a102fbe56099 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6aa71a6c814c758e2a28a5d7c6e5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4a162d96614ece8caf16ccbc99ad5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:11:52.396892 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-12b80f98-38e8-4982-9984-f7b84ea20d3e tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '941792efba534f3eb072b727046cfdc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e469a5c2748947d2b8a9103dafc74172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:11:52.405938 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c2de2afb-8257-4596-af8c-a102fbe56099 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] 10.222.0.46 "GET /compute/v2.1/servers/462c1966-4e42-42e4-9bce-7c6e28d73918" status: 200 len: 1500 microversion: 2.1 time: 1.197665 Jan 15 21:11:52.407044 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3041/6064] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:11:51 2022] GET /compute/v2.1/servers/462c1966-4e42-42e4-9bce-7c6e28d73918 => generated 1500 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:11:52.412408 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-023a9977-9db6-4074-9c8d-a50736e68da4 req-47389818-cb09-4cc4-8706-54c70df8ef42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e56a1dea-de89-4cff-9629-da5fd7c83706", "tag": "6245ff41-74f7-477d-93d6-d7012a6fb3b2"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:11:52.415246 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:11:52.415246 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:11:52.419222 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-12b80f98-38e8-4982-9984-f7b84ea20d3e tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] 10.222.0.46 "GET /compute/v2.1/servers/e56a1dea-de89-4cff-9629-da5fd7c83706" status: 200 len: 1314 microversion: 2.1 time: 1.352854 Jan 15 21:11:52.423576 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-023a9977-9db6-4074-9c8d-a50736e68da4 req-47389818-cb09-4cc4-8706-54c70df8ef42 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:52.425087 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-023a9977-9db6-4074-9c8d-a50736e68da4 req-47389818-cb09-4cc4-8706-54c70df8ef42 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:52.429449 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3024/6065] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:11:51 2022] GET /compute/v2.1/servers/e56a1dea-de89-4cff-9629-da5fd7c83706 => generated 1314 bytes in 1364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:11:52.438702 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-bdca9175-171c-465f-8966-d25c2e9fb74e tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:11:52.439837 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-023a9977-9db6-4074-9c8d-a50736e68da4 req-47389818-cb09-4cc4-8706-54c70df8ef42 service nova] Creating event network-changed:6245ff41-74f7-477d-93d6-d7012a6fb3b2 for instance e56a1dea-de89-4cff-9629-da5fd7c83706 on nch1-master-1 Jan 15 21:11:52.440341 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-bdca9175-171c-465f-8966-d25c2e9fb74e tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] [instance: 462c1966-4e42-42e4-9bce-7c6e28d73918] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:11:52.446435 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-023a9977-9db6-4074-9c8d-a50736e68da4 req-47389818-cb09-4cc4-8706-54c70df8ef42 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037790 Jan 15 21:11:52.447251 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3042/6066] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:11:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:11:52.449209 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bdca9175-171c-465f-8966-d25c2e9fb74e tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:52.449726 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bdca9175-171c-465f-8966-d25c2e9fb74e tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:52.450832 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bdca9175-171c-465f-8966-d25c2e9fb74e tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:52.451477 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bdca9175-171c-465f-8966-d25c2e9fb74e tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:52.506297 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.objects.instance [None req-bdca9175-171c-465f-8966-d25c2e9fb74e tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lazy-loading 'flavor' on Instance uuid 462c1966-4e42-42e4-9bce-7c6e28d73918 {{(pid=129365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 21:11:52.601646 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-bdca9175-171c-465f-8966-d25c2e9fb74e tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] 10.222.0.46 "POST /compute/v2.1/servers/462c1966-4e42-42e4-9bce-7c6e28d73918/action" status: 200 len: 32 microversion: 2.1 time: 0.169820 Jan 15 21:11:52.610588 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3025/6067] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:11:52 2022] POST /compute/v2.1/servers/462c1966-4e42-42e4-9bce-7c6e28d73918/action => generated 32 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 21:11:52.617191 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ed49642e-9971-4127-af4d-91bc886bc2eb tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:11:52.618129 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ed49642e-9971-4127-af4d-91bc886bc2eb tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] [instance: 462c1966-4e42-42e4-9bce-7c6e28d73918] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:11:52.632641 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ed49642e-9971-4127-af4d-91bc886bc2eb tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:52.633091 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ed49642e-9971-4127-af4d-91bc886bc2eb tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:52.634159 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ed49642e-9971-4127-af4d-91bc886bc2eb tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:52.634590 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ed49642e-9971-4127-af4d-91bc886bc2eb tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:53.276822 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-ed49642e-9971-4127-af4d-91bc886bc2eb tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6aa71a6c814c758e2a28a5d7c6e5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4a162d96614ece8caf16ccbc99ad5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:11:53.290534 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ed49642e-9971-4127-af4d-91bc886bc2eb tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] 10.222.0.46 "GET /compute/v2.1/servers/462c1966-4e42-42e4-9bce-7c6e28d73918" status: 200 len: 1506 microversion: 2.1 time: 0.677240 Jan 15 21:11:53.293029 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3043/6068] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:11:52 2022] GET /compute/v2.1/servers/462c1966-4e42-42e4-9bce-7c6e28d73918 => generated 1506 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:11:53.437262 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-26b2f8d8-d3a5-43e5-ba8a-8b12a408b26d tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:11:53.438580 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-26b2f8d8-d3a5-43e5-ba8a-8b12a408b26d tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] [instance: e56a1dea-de89-4cff-9629-da5fd7c83706] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:11:53.445065 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-26b2f8d8-d3a5-43e5-ba8a-8b12a408b26d tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:53.445769 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-26b2f8d8-d3a5-43e5-ba8a-8b12a408b26d tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:53.446753 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-26b2f8d8-d3a5-43e5-ba8a-8b12a408b26d tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:53.447385 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-26b2f8d8-d3a5-43e5-ba8a-8b12a408b26d tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:53.892932 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-26b2f8d8-d3a5-43e5-ba8a-8b12a408b26d tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '941792efba534f3eb072b727046cfdc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e469a5c2748947d2b8a9103dafc74172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:11:53.909006 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-26b2f8d8-d3a5-43e5-ba8a-8b12a408b26d tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] 10.222.0.46 "GET /compute/v2.1/servers/e56a1dea-de89-4cff-9629-da5fd7c83706" status: 200 len: 1314 microversion: 2.1 time: 0.472978 Jan 15 21:11:53.910178 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3026/6069] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:11:53 2022] GET /compute/v2.1/servers/e56a1dea-de89-4cff-9629-da5fd7c83706 => generated 1314 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:11:54.308530 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-6160877e-eb67-49ee-8db2-f23a4c2f3d37 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:11:54.309331 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-6160877e-eb67-49ee-8db2-f23a4c2f3d37 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] [instance: 462c1966-4e42-42e4-9bce-7c6e28d73918] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:11:54.316804 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6160877e-eb67-49ee-8db2-f23a4c2f3d37 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:54.317278 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6160877e-eb67-49ee-8db2-f23a4c2f3d37 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:54.318090 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6160877e-eb67-49ee-8db2-f23a4c2f3d37 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:54.318524 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6160877e-eb67-49ee-8db2-f23a4c2f3d37 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:54.803814 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-6160877e-eb67-49ee-8db2-f23a4c2f3d37 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6aa71a6c814c758e2a28a5d7c6e5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4a162d96614ece8caf16ccbc99ad5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:11:54.811873 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-6160877e-eb67-49ee-8db2-f23a4c2f3d37 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] 10.222.0.46 "GET /compute/v2.1/servers/462c1966-4e42-42e4-9bce-7c6e28d73918" status: 200 len: 1506 microversion: 2.1 time: 0.507658 Jan 15 21:11:54.812452 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3044/6070] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:11:54 2022] GET /compute/v2.1/servers/462c1966-4e42-42e4-9bce-7c6e28d73918 => generated 1506 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:11:54.927364 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d905ccdc-d75e-45eb-af50-293cfea4dd89 tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:11:54.927972 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d905ccdc-d75e-45eb-af50-293cfea4dd89 tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] [instance: e56a1dea-de89-4cff-9629-da5fd7c83706] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:11:54.936278 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d905ccdc-d75e-45eb-af50-293cfea4dd89 tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:54.937193 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d905ccdc-d75e-45eb-af50-293cfea4dd89 tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:54.937898 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d905ccdc-d75e-45eb-af50-293cfea4dd89 tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:54.938740 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d905ccdc-d75e-45eb-af50-293cfea4dd89 tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:55.289205 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-d905ccdc-d75e-45eb-af50-293cfea4dd89 tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '941792efba534f3eb072b727046cfdc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e469a5c2748947d2b8a9103dafc74172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:11:55.303508 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d905ccdc-d75e-45eb-af50-293cfea4dd89 tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] 10.222.0.46 "GET /compute/v2.1/servers/e56a1dea-de89-4cff-9629-da5fd7c83706" status: 200 len: 1314 microversion: 2.1 time: 0.376133 Jan 15 21:11:55.304321 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3027/6071] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:11:54 2022] GET /compute/v2.1/servers/e56a1dea-de89-4cff-9629-da5fd7c83706 => generated 1314 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:11:55.843044 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d7b70f91-8547-4641-95e5-93211a8ea51f tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:11:55.844737 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-d7b70f91-8547-4641-95e5-93211a8ea51f tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] [instance: 462c1966-4e42-42e4-9bce-7c6e28d73918] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:11:55.878128 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d7b70f91-8547-4641-95e5-93211a8ea51f tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:55.878921 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d7b70f91-8547-4641-95e5-93211a8ea51f tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:55.883299 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d7b70f91-8547-4641-95e5-93211a8ea51f tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:55.883905 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d7b70f91-8547-4641-95e5-93211a8ea51f tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:56.328205 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-18958119-459e-4493-b228-495f187db77e tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:11:56.330150 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-18958119-459e-4493-b228-495f187db77e tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] [instance: e56a1dea-de89-4cff-9629-da5fd7c83706] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:11:56.359444 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-18958119-459e-4493-b228-495f187db77e tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:56.360015 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-18958119-459e-4493-b228-495f187db77e tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:56.360963 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-18958119-459e-4493-b228-495f187db77e tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:56.362049 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-18958119-459e-4493-b228-495f187db77e tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:56.617857 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-d7b70f91-8547-4641-95e5-93211a8ea51f tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6aa71a6c814c758e2a28a5d7c6e5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4a162d96614ece8caf16ccbc99ad5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:11:56.634360 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d7b70f91-8547-4641-95e5-93211a8ea51f tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] 10.222.0.46 "GET /compute/v2.1/servers/462c1966-4e42-42e4-9bce-7c6e28d73918" status: 200 len: 1506 microversion: 2.1 time: 0.808354 Jan 15 21:11:56.645728 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3045/6072] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:11:55 2022] GET /compute/v2.1/servers/462c1966-4e42-42e4-9bce-7c6e28d73918 => generated 1506 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:11:57.310145 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-18958119-459e-4493-b228-495f187db77e tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '941792efba534f3eb072b727046cfdc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e469a5c2748947d2b8a9103dafc74172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:11:57.325630 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-18958119-459e-4493-b228-495f187db77e tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] 10.222.0.46 "GET /compute/v2.1/servers/e56a1dea-de89-4cff-9629-da5fd7c83706" status: 200 len: 1314 microversion: 2.1 time: 1.006981 Jan 15 21:11:57.326524 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3028/6073] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:11:56 2022] GET /compute/v2.1/servers/e56a1dea-de89-4cff-9629-da5fd7c83706 => generated 1314 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:11:57.654445 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-adde9ef2-a9ec-45e5-9d34-2ee85530c803 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:11:57.655363 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-adde9ef2-a9ec-45e5-9d34-2ee85530c803 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] [instance: 462c1966-4e42-42e4-9bce-7c6e28d73918] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:11:57.670359 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-adde9ef2-a9ec-45e5-9d34-2ee85530c803 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:57.670809 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-adde9ef2-a9ec-45e5-9d34-2ee85530c803 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:57.671665 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-adde9ef2-a9ec-45e5-9d34-2ee85530c803 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:57.672119 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-adde9ef2-a9ec-45e5-9d34-2ee85530c803 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:58.043096 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-f4846894-9ce8-4a48-a953-b42f634d393a req-24792bd6-d024-4d8f-acbb-18f8e3154873 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e56a1dea-de89-4cff-9629-da5fd7c83706", "name": "network-vif-plugged", "status": "completed", "tag": "6245ff41-74f7-477d-93d6-d7012a6fb3b2"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:11:58.050811 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:11:58.050811 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:11:58.065576 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-f4846894-9ce8-4a48-a953-b42f634d393a req-24792bd6-d024-4d8f-acbb-18f8e3154873 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:58.066159 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-f4846894-9ce8-4a48-a953-b42f634d393a req-24792bd6-d024-4d8f-acbb-18f8e3154873 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:58.080749 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-f4846894-9ce8-4a48-a953-b42f634d393a req-24792bd6-d024-4d8f-acbb-18f8e3154873 service nova] Creating event network-vif-plugged:6245ff41-74f7-477d-93d6-d7012a6fb3b2 for instance e56a1dea-de89-4cff-9629-da5fd7c83706 on nch1-master-1 Jan 15 21:11:58.089588 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-f4846894-9ce8-4a48-a953-b42f634d393a req-24792bd6-d024-4d8f-acbb-18f8e3154873 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048865 Jan 15 21:11:58.090453 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3029/6074] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:11:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 21:11:58.304180 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-adde9ef2-a9ec-45e5-9d34-2ee85530c803 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6aa71a6c814c758e2a28a5d7c6e5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4a162d96614ece8caf16ccbc99ad5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:11:58.314482 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-adde9ef2-a9ec-45e5-9d34-2ee85530c803 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] 10.222.0.46 "GET /compute/v2.1/servers/462c1966-4e42-42e4-9bce-7c6e28d73918" status: 200 len: 1506 microversion: 2.1 time: 0.664410 Jan 15 21:11:58.315221 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3046/6075] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:11:57 2022] GET /compute/v2.1/servers/462c1966-4e42-42e4-9bce-7c6e28d73918 => generated 1506 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:11:58.346904 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-7646050a-148d-4cfd-92fc-3ee52fa9a784 tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:11:58.347723 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-7646050a-148d-4cfd-92fc-3ee52fa9a784 tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] [instance: e56a1dea-de89-4cff-9629-da5fd7c83706] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:11:58.365480 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7646050a-148d-4cfd-92fc-3ee52fa9a784 tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:58.366205 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7646050a-148d-4cfd-92fc-3ee52fa9a784 tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:58.367578 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7646050a-148d-4cfd-92fc-3ee52fa9a784 tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:58.368198 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7646050a-148d-4cfd-92fc-3ee52fa9a784 tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:58.913683 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-7646050a-148d-4cfd-92fc-3ee52fa9a784 tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '941792efba534f3eb072b727046cfdc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e469a5c2748947d2b8a9103dafc74172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:11:58.937944 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-7646050a-148d-4cfd-92fc-3ee52fa9a784 tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] 10.222.0.46 "GET /compute/v2.1/servers/e56a1dea-de89-4cff-9629-da5fd7c83706" status: 200 len: 1314 microversion: 2.1 time: 0.596058 Jan 15 21:11:58.940869 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3030/6076] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:11:58 2022] GET /compute/v2.1/servers/e56a1dea-de89-4cff-9629-da5fd7c83706 => generated 1314 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:11:59.337961 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1b7ab0fe-61f8-4d1c-ba58-5249bf70e894 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:11:59.340540 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-1b7ab0fe-61f8-4d1c-ba58-5249bf70e894 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] [instance: 462c1966-4e42-42e4-9bce-7c6e28d73918] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:11:59.380329 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1b7ab0fe-61f8-4d1c-ba58-5249bf70e894 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:59.381316 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1b7ab0fe-61f8-4d1c-ba58-5249bf70e894 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:59.382501 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1b7ab0fe-61f8-4d1c-ba58-5249bf70e894 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:59.383092 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1b7ab0fe-61f8-4d1c-ba58-5249bf70e894 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:59.841223 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-1b7ab0fe-61f8-4d1c-ba58-5249bf70e894 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6aa71a6c814c758e2a28a5d7c6e5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4a162d96614ece8caf16ccbc99ad5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:11:59.861505 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-1b7ab0fe-61f8-4d1c-ba58-5249bf70e894 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] 10.222.0.46 "GET /compute/v2.1/servers/462c1966-4e42-42e4-9bce-7c6e28d73918" status: 200 len: 1506 microversion: 2.1 time: 0.531582 Jan 15 21:11:59.862741 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3047/6077] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:11:59 2022] GET /compute/v2.1/servers/462c1966-4e42-42e4-9bce-7c6e28d73918 => generated 1506 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:11:59.964703 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9d3d0bd3-60e0-4c84-8c9e-f4ee7613292f tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:11:59.966962 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-9d3d0bd3-60e0-4c84-8c9e-f4ee7613292f tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] [instance: e56a1dea-de89-4cff-9629-da5fd7c83706] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:11:59.993043 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9d3d0bd3-60e0-4c84-8c9e-f4ee7613292f tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:59.995972 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9d3d0bd3-60e0-4c84-8c9e-f4ee7613292f tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:11:59.997232 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9d3d0bd3-60e0-4c84-8c9e-f4ee7613292f tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:11:59.997901 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9d3d0bd3-60e0-4c84-8c9e-f4ee7613292f tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:00.371960 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-9d3d0bd3-60e0-4c84-8c9e-f4ee7613292f tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '941792efba534f3eb072b727046cfdc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e469a5c2748947d2b8a9103dafc74172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:12:00.395257 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-9d3d0bd3-60e0-4c84-8c9e-f4ee7613292f tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] 10.222.0.46 "GET /compute/v2.1/servers/e56a1dea-de89-4cff-9629-da5fd7c83706" status: 200 len: 1464 microversion: 2.1 time: 0.425115 Jan 15 21:12:00.395257 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3031/6078] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:11:59 2022] GET /compute/v2.1/servers/e56a1dea-de89-4cff-9629-da5fd7c83706 => generated 1464 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:12:00.432324 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-23a8731a-8636-45e2-9e44-504171fc4bf2 tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:12:00.432945 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-23a8731a-8636-45e2-9e44-504171fc4bf2 tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] [instance: e56a1dea-de89-4cff-9629-da5fd7c83706] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:12:00.440419 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-23a8731a-8636-45e2-9e44-504171fc4bf2 tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:00.440721 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-23a8731a-8636-45e2-9e44-504171fc4bf2 tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:00.441559 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-23a8731a-8636-45e2-9e44-504171fc4bf2 tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:00.442000 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-23a8731a-8636-45e2-9e44-504171fc4bf2 tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:00.490092 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-23a8731a-8636-45e2-9e44-504171fc4bf2 tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] [instance: e56a1dea-de89-4cff-9629-da5fd7c83706] Going to try to terminate instance {{(pid=129366) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 21:12:00.649164 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-23a8731a-8636-45e2-9e44-504171fc4bf2 tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] 10.222.0.46 "DELETE /compute/v2.1/servers/e56a1dea-de89-4cff-9629-da5fd7c83706" status: 204 len: 0 microversion: 2.1 time: 0.220288 Jan 15 21:12:00.651105 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3048/6079] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 21:12:00 2022] DELETE /compute/v2.1/servers/e56a1dea-de89-4cff-9629-da5fd7c83706 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 21:12:00.659462 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-68b0d10a-f782-4b04-96f9-f11ec5a4c963 tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:12:00.660285 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-68b0d10a-f782-4b04-96f9-f11ec5a4c963 tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] [instance: e56a1dea-de89-4cff-9629-da5fd7c83706] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:12:00.670043 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-68b0d10a-f782-4b04-96f9-f11ec5a4c963 tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:00.670722 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-68b0d10a-f782-4b04-96f9-f11ec5a4c963 tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:00.672648 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-68b0d10a-f782-4b04-96f9-f11ec5a4c963 tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:00.673876 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-68b0d10a-f782-4b04-96f9-f11ec5a4c963 tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:00.880124 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c0daa20e-c057-486b-b19a-47800dfabd1c tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:12:00.880829 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c0daa20e-c057-486b-b19a-47800dfabd1c tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] [instance: 462c1966-4e42-42e4-9bce-7c6e28d73918] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:12:00.889829 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-68b0d10a-f782-4b04-96f9-f11ec5a4c963 tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '941792efba534f3eb072b727046cfdc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e469a5c2748947d2b8a9103dafc74172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:12:00.892204 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c0daa20e-c057-486b-b19a-47800dfabd1c tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:00.892893 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c0daa20e-c057-486b-b19a-47800dfabd1c tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:00.893923 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c0daa20e-c057-486b-b19a-47800dfabd1c tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:00.894554 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c0daa20e-c057-486b-b19a-47800dfabd1c tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:00.902728 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-68b0d10a-f782-4b04-96f9-f11ec5a4c963 tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] 10.222.0.46 "GET /compute/v2.1/servers/e56a1dea-de89-4cff-9629-da5fd7c83706" status: 200 len: 1470 microversion: 2.1 time: 0.247086 Jan 15 21:12:00.912401 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3032/6080] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:12:00 2022] GET /compute/v2.1/servers/e56a1dea-de89-4cff-9629-da5fd7c83706 => generated 1470 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:12:01.306509 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-c0daa20e-c057-486b-b19a-47800dfabd1c tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6aa71a6c814c758e2a28a5d7c6e5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4a162d96614ece8caf16ccbc99ad5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:12:01.315906 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c0daa20e-c057-486b-b19a-47800dfabd1c tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] 10.222.0.46 "GET /compute/v2.1/servers/462c1966-4e42-42e4-9bce-7c6e28d73918" status: 200 len: 1506 microversion: 2.1 time: 0.439819 Jan 15 21:12:01.327417 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3049/6081] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:12:00 2022] GET /compute/v2.1/servers/462c1966-4e42-42e4-9bce-7c6e28d73918 => generated 1506 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:12:01.921431 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-01aadd7d-4c70-4e5d-bc6e-8f6f1ec2daa5 tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:12:01.923187 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-01aadd7d-4c70-4e5d-bc6e-8f6f1ec2daa5 tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] [instance: e56a1dea-de89-4cff-9629-da5fd7c83706] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:12:01.976311 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-01aadd7d-4c70-4e5d-bc6e-8f6f1ec2daa5 tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:01.976946 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-01aadd7d-4c70-4e5d-bc6e-8f6f1ec2daa5 tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:01.982036 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-01aadd7d-4c70-4e5d-bc6e-8f6f1ec2daa5 tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:01.982982 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-01aadd7d-4c70-4e5d-bc6e-8f6f1ec2daa5 tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:02.300653 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-01aadd7d-4c70-4e5d-bc6e-8f6f1ec2daa5 tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '941792efba534f3eb072b727046cfdc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e469a5c2748947d2b8a9103dafc74172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:12:02.312974 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-01aadd7d-4c70-4e5d-bc6e-8f6f1ec2daa5 tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] 10.222.0.46 "GET /compute/v2.1/servers/e56a1dea-de89-4cff-9629-da5fd7c83706" status: 200 len: 1470 microversion: 2.1 time: 0.395731 Jan 15 21:12:02.314852 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3033/6082] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:12:01 2022] GET /compute/v2.1/servers/e56a1dea-de89-4cff-9629-da5fd7c83706 => generated 1470 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:12:02.333397 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-5592c180-e406-4d30-9822-7c9d8bc4a977 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:12:02.336034 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-5592c180-e406-4d30-9822-7c9d8bc4a977 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] [instance: 462c1966-4e42-42e4-9bce-7c6e28d73918] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:12:02.343536 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5592c180-e406-4d30-9822-7c9d8bc4a977 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:02.343980 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5592c180-e406-4d30-9822-7c9d8bc4a977 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:02.345224 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5592c180-e406-4d30-9822-7c9d8bc4a977 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:02.345979 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5592c180-e406-4d30-9822-7c9d8bc4a977 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:02.505017 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-5592c180-e406-4d30-9822-7c9d8bc4a977 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6aa71a6c814c758e2a28a5d7c6e5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4a162d96614ece8caf16ccbc99ad5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:12:02.513566 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-5592c180-e406-4d30-9822-7c9d8bc4a977 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] 10.222.0.46 "GET /compute/v2.1/servers/462c1966-4e42-42e4-9bce-7c6e28d73918" status: 200 len: 1506 microversion: 2.1 time: 0.184477 Jan 15 21:12:02.514134 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3050/6083] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:12:02 2022] GET /compute/v2.1/servers/462c1966-4e42-42e4-9bce-7c6e28d73918 => generated 1506 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:12:03.172829 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-958e5e94-6047-4250-8cd1-e8f12b117beb req-146a0a0f-d245-470a-80c8-19f088e4c497 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e56a1dea-de89-4cff-9629-da5fd7c83706", "name": "network-vif-deleted", "tag": "6245ff41-74f7-477d-93d6-d7012a6fb3b2"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:12:03.175229 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:12:03.175229 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:12:03.183895 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-958e5e94-6047-4250-8cd1-e8f12b117beb req-146a0a0f-d245-470a-80c8-19f088e4c497 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:03.184699 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-958e5e94-6047-4250-8cd1-e8f12b117beb req-146a0a0f-d245-470a-80c8-19f088e4c497 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:03.204226 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-958e5e94-6047-4250-8cd1-e8f12b117beb req-146a0a0f-d245-470a-80c8-19f088e4c497 service nova] Creating event network-vif-deleted:6245ff41-74f7-477d-93d6-d7012a6fb3b2 for instance e56a1dea-de89-4cff-9629-da5fd7c83706 on nch1-master-1 Jan 15 21:12:03.222290 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-958e5e94-6047-4250-8cd1-e8f12b117beb req-146a0a0f-d245-470a-80c8-19f088e4c497 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052893 Jan 15 21:12:03.223045 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3034/6084] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:12:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:12:03.331537 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-bf1af75d-6f97-430f-be37-5fb2562886ea tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:12:03.332146 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-bf1af75d-6f97-430f-be37-5fb2562886ea tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] [instance: e56a1dea-de89-4cff-9629-da5fd7c83706] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:12:03.339343 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bf1af75d-6f97-430f-be37-5fb2562886ea tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:03.340767 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bf1af75d-6f97-430f-be37-5fb2562886ea tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:03.342104 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bf1af75d-6f97-430f-be37-5fb2562886ea tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:03.342912 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bf1af75d-6f97-430f-be37-5fb2562886ea tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:03.443318 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bf1af75d-6f97-430f-be37-5fb2562886ea tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:03.445748 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bf1af75d-6f97-430f-be37-5fb2562886ea tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:03.447081 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.objects.instance [None req-bf1af75d-6f97-430f-be37-5fb2562886ea tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] Lazy-loading 'fault' on Instance uuid e56a1dea-de89-4cff-9629-da5fd7c83706 {{(pid=129366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 21:12:03.544451 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-06ecef27-2fe7-4c49-a0bb-84993a89395d tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:12:03.545705 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-06ecef27-2fe7-4c49-a0bb-84993a89395d tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] [instance: 462c1966-4e42-42e4-9bce-7c6e28d73918] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:12:03.557037 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-06ecef27-2fe7-4c49-a0bb-84993a89395d tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:03.557585 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-06ecef27-2fe7-4c49-a0bb-84993a89395d tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:03.558493 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-06ecef27-2fe7-4c49-a0bb-84993a89395d tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:03.559074 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-06ecef27-2fe7-4c49-a0bb-84993a89395d tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:03.781759 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-bf1af75d-6f97-430f-be37-5fb2562886ea tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '941792efba534f3eb072b727046cfdc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e469a5c2748947d2b8a9103dafc74172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:12:03.791142 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-bf1af75d-6f97-430f-be37-5fb2562886ea tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] 10.222.0.46 "GET /compute/v2.1/servers/e56a1dea-de89-4cff-9629-da5fd7c83706" status: 200 len: 1304 microversion: 2.1 time: 0.463115 Jan 15 21:12:03.794278 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3051/6085] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:12:03 2022] GET /compute/v2.1/servers/e56a1dea-de89-4cff-9629-da5fd7c83706 => generated 1304 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:12:04.041605 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-06ecef27-2fe7-4c49-a0bb-84993a89395d tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6aa71a6c814c758e2a28a5d7c6e5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4a162d96614ece8caf16ccbc99ad5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:12:04.050563 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-06ecef27-2fe7-4c49-a0bb-84993a89395d tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] 10.222.0.46 "GET /compute/v2.1/servers/462c1966-4e42-42e4-9bce-7c6e28d73918" status: 200 len: 1506 microversion: 2.1 time: 0.523989 Jan 15 21:12:04.051679 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3035/6086] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:12:03 2022] GET /compute/v2.1/servers/462c1966-4e42-42e4-9bce-7c6e28d73918 => generated 1506 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:12:04.811736 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1ffedc8c-166f-489f-a9db-63a21c1bff68 tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:12:04.813304 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-1ffedc8c-166f-489f-a9db-63a21c1bff68 tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] [instance: e56a1dea-de89-4cff-9629-da5fd7c83706] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:12:04.820230 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1ffedc8c-166f-489f-a9db-63a21c1bff68 tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:04.820682 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1ffedc8c-166f-489f-a9db-63a21c1bff68 tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:04.821779 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1ffedc8c-166f-489f-a9db-63a21c1bff68 tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:04.822315 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1ffedc8c-166f-489f-a9db-63a21c1bff68 tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:04.842450 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-1ffedc8c-166f-489f-a9db-63a21c1bff68 tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] HTTP exception thrown: Instance e56a1dea-de89-4cff-9629-da5fd7c83706 could not be found. Jan 15 21:12:04.843299 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1ffedc8c-166f-489f-a9db-63a21c1bff68 tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] Returning 404 to user: Instance e56a1dea-de89-4cff-9629-da5fd7c83706 could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:12:04.844638 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-1ffedc8c-166f-489f-a9db-63a21c1bff68 tempest-VolumesNegativeTest-263050443 tempest-VolumesNegativeTest-263050443-project] 10.222.0.46 "GET /compute/v2.1/servers/e56a1dea-de89-4cff-9629-da5fd7c83706" status: 404 len: 111 microversion: 2.1 time: 0.036937 Jan 15 21:12:04.845832 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3052/6087] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:12:04 2022] GET /compute/v2.1/servers/e56a1dea-de89-4cff-9629-da5fd7c83706 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:12:05.070398 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ed61d117-840e-4a31-8603-1b7e9bb80b6c tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:12:05.073552 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ed61d117-840e-4a31-8603-1b7e9bb80b6c tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] [instance: 462c1966-4e42-42e4-9bce-7c6e28d73918] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:12:05.090947 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ed61d117-840e-4a31-8603-1b7e9bb80b6c tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:05.093633 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ed61d117-840e-4a31-8603-1b7e9bb80b6c tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:05.095377 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ed61d117-840e-4a31-8603-1b7e9bb80b6c tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:05.096056 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ed61d117-840e-4a31-8603-1b7e9bb80b6c tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:05.399148 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-ed61d117-840e-4a31-8603-1b7e9bb80b6c tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6aa71a6c814c758e2a28a5d7c6e5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4a162d96614ece8caf16ccbc99ad5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:12:05.410883 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ed61d117-840e-4a31-8603-1b7e9bb80b6c tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] 10.222.0.46 "GET /compute/v2.1/servers/462c1966-4e42-42e4-9bce-7c6e28d73918" status: 200 len: 1506 microversion: 2.1 time: 0.345057 Jan 15 21:12:05.411489 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3036/6088] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:12:05 2022] GET /compute/v2.1/servers/462c1966-4e42-42e4-9bce-7c6e28d73918 => generated 1506 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:12:06.013470 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-47223ffd-d98f-4c6c-8335-fe63c28c96d5 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Action: 'create', calling method: .version_select at 0x7f30cec59ca0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-335220064"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:12:06.066314 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-47223ffd-d98f-4c6c-8335-fe63c28c96d5 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Getting quotas for project ed86e4d7dcdb4ea7ad79628b2ae2462d. Resources: {'key_pairs'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:12:06.079008 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-47223ffd-d98f-4c6c-8335-fe63c28c96d5 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Getting quotas for user 7f0f0e03b03e4d24ae0a7e5d3b9b7104 and project ed86e4d7dcdb4ea7ad79628b2ae2462d. Resources: {'key_pairs'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:12:06.430911 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ff82d128-eddf-4ea2-a158-1129e4d3aa86 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:12:06.441917 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ff82d128-eddf-4ea2-a158-1129e4d3aa86 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] [instance: 462c1966-4e42-42e4-9bce-7c6e28d73918] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:12:06.461193 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ff82d128-eddf-4ea2-a158-1129e4d3aa86 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:06.462563 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ff82d128-eddf-4ea2-a158-1129e4d3aa86 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:06.464875 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ff82d128-eddf-4ea2-a158-1129e4d3aa86 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:06.467267 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ff82d128-eddf-4ea2-a158-1129e4d3aa86 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:06.691562 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-47223ffd-d98f-4c6c-8335-fe63c28c96d5 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Getting quotas for project ed86e4d7dcdb4ea7ad79628b2ae2462d. Resources: {'key_pairs'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:12:06.723197 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-47223ffd-d98f-4c6c-8335-fe63c28c96d5 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Getting quotas for user 7f0f0e03b03e4d24ae0a7e5d3b9b7104 and project ed86e4d7dcdb4ea7ad79628b2ae2462d. Resources: {'key_pairs'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:12:06.779361 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-47223ffd-d98f-4c6c-8335-fe63c28c96d5 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 2321 microversion: 2.1 time: 1.089641 Jan 15 21:12:06.785465 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3053/6089] 10.222.0.46 () {60 vars in 1157 bytes} [Sat Jan 15 21:12:05 2022] POST /compute/v2.1/os-keypairs => generated 2321 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:12:06.899852 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-ff82d128-eddf-4ea2-a158-1129e4d3aa86 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6aa71a6c814c758e2a28a5d7c6e5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4a162d96614ece8caf16ccbc99ad5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:12:06.922518 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ff82d128-eddf-4ea2-a158-1129e4d3aa86 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] 10.222.0.46 "GET /compute/v2.1/servers/462c1966-4e42-42e4-9bce-7c6e28d73918" status: 200 len: 1506 microversion: 2.1 time: 0.492821 Jan 15 21:12:06.933018 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3037/6090] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:12:06 2022] GET /compute/v2.1/servers/462c1966-4e42-42e4-9bce-7c6e28d73918 => generated 1506 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:12:07.944507 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d8e7e3f9-4f85-4e1b-9ded-bdddd2c6e5f7 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:12:07.946270 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-d8e7e3f9-4f85-4e1b-9ded-bdddd2c6e5f7 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] [instance: 462c1966-4e42-42e4-9bce-7c6e28d73918] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:12:07.971284 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d8e7e3f9-4f85-4e1b-9ded-bdddd2c6e5f7 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:07.972241 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d8e7e3f9-4f85-4e1b-9ded-bdddd2c6e5f7 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:07.973758 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d8e7e3f9-4f85-4e1b-9ded-bdddd2c6e5f7 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:07.974569 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d8e7e3f9-4f85-4e1b-9ded-bdddd2c6e5f7 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:08.446597 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-d8e7e3f9-4f85-4e1b-9ded-bdddd2c6e5f7 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6aa71a6c814c758e2a28a5d7c6e5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4a162d96614ece8caf16ccbc99ad5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:12:08.468438 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d8e7e3f9-4f85-4e1b-9ded-bdddd2c6e5f7 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] 10.222.0.46 "GET /compute/v2.1/servers/462c1966-4e42-42e4-9bce-7c6e28d73918" status: 200 len: 1506 microversion: 2.1 time: 0.528347 Jan 15 21:12:08.468438 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3054/6091] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:12:07 2022] GET /compute/v2.1/servers/462c1966-4e42-42e4-9bce-7c6e28d73918 => generated 1506 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:12:09.491139 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-090e0326-d9da-4718-8c53-d72e763c9d64 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:12:09.493929 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-090e0326-d9da-4718-8c53-d72e763c9d64 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] [instance: 462c1966-4e42-42e4-9bce-7c6e28d73918] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:12:09.507687 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-090e0326-d9da-4718-8c53-d72e763c9d64 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:09.508650 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-090e0326-d9da-4718-8c53-d72e763c9d64 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:09.513550 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-090e0326-d9da-4718-8c53-d72e763c9d64 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:09.521471 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-090e0326-d9da-4718-8c53-d72e763c9d64 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:09.925988 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-090e0326-d9da-4718-8c53-d72e763c9d64 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6aa71a6c814c758e2a28a5d7c6e5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4a162d96614ece8caf16ccbc99ad5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:12:09.944158 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-090e0326-d9da-4718-8c53-d72e763c9d64 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] 10.222.0.46 "GET /compute/v2.1/servers/462c1966-4e42-42e4-9bce-7c6e28d73918" status: 200 len: 1506 microversion: 2.1 time: 0.453337 Jan 15 21:12:09.944158 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3038/6092] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:12:09 2022] GET /compute/v2.1/servers/462c1966-4e42-42e4-9bce-7c6e28d73918 => generated 1506 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:12:10.960736 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-bba839db-89e6-4928-95ca-3a288d953b74 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:12:10.962334 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-bba839db-89e6-4928-95ca-3a288d953b74 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] [instance: 462c1966-4e42-42e4-9bce-7c6e28d73918] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:12:10.979779 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bba839db-89e6-4928-95ca-3a288d953b74 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:10.980739 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bba839db-89e6-4928-95ca-3a288d953b74 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:10.981071 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bba839db-89e6-4928-95ca-3a288d953b74 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:10.981590 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bba839db-89e6-4928-95ca-3a288d953b74 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:11.309107 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-bba839db-89e6-4928-95ca-3a288d953b74 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6aa71a6c814c758e2a28a5d7c6e5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4a162d96614ece8caf16ccbc99ad5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:12:11.323719 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-bba839db-89e6-4928-95ca-3a288d953b74 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] 10.222.0.46 "GET /compute/v2.1/servers/462c1966-4e42-42e4-9bce-7c6e28d73918" status: 200 len: 1506 microversion: 2.1 time: 0.366640 Jan 15 21:12:11.325526 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3055/6093] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:12:10 2022] GET /compute/v2.1/servers/462c1966-4e42-42e4-9bce-7c6e28d73918 => generated 1506 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:12:12.344529 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-74eb6113-cd73-4305-8536-f028dc572bb1 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:12:12.346134 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-74eb6113-cd73-4305-8536-f028dc572bb1 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] [instance: 462c1966-4e42-42e4-9bce-7c6e28d73918] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:12:12.356828 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-74eb6113-cd73-4305-8536-f028dc572bb1 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:12.357609 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-74eb6113-cd73-4305-8536-f028dc572bb1 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:12.358584 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-74eb6113-cd73-4305-8536-f028dc572bb1 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:12.359009 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-74eb6113-cd73-4305-8536-f028dc572bb1 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:12.688539 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-74eb6113-cd73-4305-8536-f028dc572bb1 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6aa71a6c814c758e2a28a5d7c6e5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4a162d96614ece8caf16ccbc99ad5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:12:12.707500 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-74eb6113-cd73-4305-8536-f028dc572bb1 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] 10.222.0.46 "GET /compute/v2.1/servers/462c1966-4e42-42e4-9bce-7c6e28d73918" status: 200 len: 1506 microversion: 2.1 time: 0.365893 Jan 15 21:12:12.709879 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3039/6094] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:12:12 2022] GET /compute/v2.1/servers/462c1966-4e42-42e4-9bce-7c6e28d73918 => generated 1506 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:12:13.726893 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9a5a3d8d-35e8-40ed-85aa-5dd720fcfce0 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:12:13.727747 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-9a5a3d8d-35e8-40ed-85aa-5dd720fcfce0 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] [instance: 462c1966-4e42-42e4-9bce-7c6e28d73918] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:12:13.736512 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9a5a3d8d-35e8-40ed-85aa-5dd720fcfce0 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:13.737006 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9a5a3d8d-35e8-40ed-85aa-5dd720fcfce0 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:13.752460 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9a5a3d8d-35e8-40ed-85aa-5dd720fcfce0 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:13.753226 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9a5a3d8d-35e8-40ed-85aa-5dd720fcfce0 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:13.993184 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-9a5a3d8d-35e8-40ed-85aa-5dd720fcfce0 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6aa71a6c814c758e2a28a5d7c6e5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4a162d96614ece8caf16ccbc99ad5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:12:14.007671 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-9a5a3d8d-35e8-40ed-85aa-5dd720fcfce0 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] 10.222.0.46 "GET /compute/v2.1/servers/462c1966-4e42-42e4-9bce-7c6e28d73918" status: 200 len: 1506 microversion: 2.1 time: 0.284326 Jan 15 21:12:14.015060 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3056/6095] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:12:13 2022] GET /compute/v2.1/servers/462c1966-4e42-42e4-9bce-7c6e28d73918 => generated 1506 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:12:15.035279 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f279e420-0b2a-4794-a4d9-743989404e2e tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:12:15.037308 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f279e420-0b2a-4794-a4d9-743989404e2e tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] [instance: 462c1966-4e42-42e4-9bce-7c6e28d73918] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:12:15.055102 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f279e420-0b2a-4794-a4d9-743989404e2e tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:15.055719 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f279e420-0b2a-4794-a4d9-743989404e2e tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:15.057535 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f279e420-0b2a-4794-a4d9-743989404e2e tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:15.060002 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f279e420-0b2a-4794-a4d9-743989404e2e tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:15.378468 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-f279e420-0b2a-4794-a4d9-743989404e2e tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6aa71a6c814c758e2a28a5d7c6e5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4a162d96614ece8caf16ccbc99ad5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:12:15.391834 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f279e420-0b2a-4794-a4d9-743989404e2e tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] 10.222.0.46 "GET /compute/v2.1/servers/462c1966-4e42-42e4-9bce-7c6e28d73918" status: 200 len: 1506 microversion: 2.1 time: 0.361201 Jan 15 21:12:15.402305 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3040/6096] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:12:15 2022] GET /compute/v2.1/servers/462c1966-4e42-42e4-9bce-7c6e28d73918 => generated 1506 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:12:16.413099 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-08dcee7c-a51c-4382-9b06-67bd7c999281 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:12:16.414445 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-08dcee7c-a51c-4382-9b06-67bd7c999281 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] [instance: 462c1966-4e42-42e4-9bce-7c6e28d73918] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:12:16.470521 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-08dcee7c-a51c-4382-9b06-67bd7c999281 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:16.471350 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-08dcee7c-a51c-4382-9b06-67bd7c999281 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:16.472451 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-08dcee7c-a51c-4382-9b06-67bd7c999281 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:16.473246 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-08dcee7c-a51c-4382-9b06-67bd7c999281 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:17.344659 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-08dcee7c-a51c-4382-9b06-67bd7c999281 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6aa71a6c814c758e2a28a5d7c6e5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4a162d96614ece8caf16ccbc99ad5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:12:17.361203 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-08dcee7c-a51c-4382-9b06-67bd7c999281 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] 10.222.0.46 "GET /compute/v2.1/servers/462c1966-4e42-42e4-9bce-7c6e28d73918" status: 200 len: 1506 microversion: 2.1 time: 0.952231 Jan 15 21:12:17.361829 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3057/6097] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:12:16 2022] GET /compute/v2.1/servers/462c1966-4e42-42e4-9bce-7c6e28d73918 => generated 1506 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:12:18.381149 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-478db4cb-6431-4cba-8bd2-2b023e3a3926 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:12:18.383481 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-478db4cb-6431-4cba-8bd2-2b023e3a3926 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] [instance: 462c1966-4e42-42e4-9bce-7c6e28d73918] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:12:18.417203 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-478db4cb-6431-4cba-8bd2-2b023e3a3926 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:18.421554 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-478db4cb-6431-4cba-8bd2-2b023e3a3926 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:18.424418 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-478db4cb-6431-4cba-8bd2-2b023e3a3926 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:18.425139 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-478db4cb-6431-4cba-8bd2-2b023e3a3926 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:19.491615 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-478db4cb-6431-4cba-8bd2-2b023e3a3926 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6aa71a6c814c758e2a28a5d7c6e5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4a162d96614ece8caf16ccbc99ad5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:12:19.501554 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-478db4cb-6431-4cba-8bd2-2b023e3a3926 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] 10.222.0.46 "GET /compute/v2.1/servers/462c1966-4e42-42e4-9bce-7c6e28d73918" status: 200 len: 1506 microversion: 2.1 time: 1.124828 Jan 15 21:12:19.507467 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3041/6098] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:12:18 2022] GET /compute/v2.1/servers/462c1966-4e42-42e4-9bce-7c6e28d73918 => generated 1506 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:12:20.031439 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-de53118d-cce0-4ed3-bd05-5e9e48b584b1 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:12:20.033180 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-de53118d-cce0-4ed3-bd05-5e9e48b584b1 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] [instance: e978b725-2efe-42a9-83cb-e6343f132d14] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:12:20.048124 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-de53118d-cce0-4ed3-bd05-5e9e48b584b1 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:20.048583 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-de53118d-cce0-4ed3-bd05-5e9e48b584b1 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:20.064786 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-de53118d-cce0-4ed3-bd05-5e9e48b584b1 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:20.065276 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-de53118d-cce0-4ed3-bd05-5e9e48b584b1 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:20.290168 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.objects.instance [None req-de53118d-cce0-4ed3-bd05-5e9e48b584b1 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lazy-loading 'services' on Instance uuid e978b725-2efe-42a9-83cb-e6343f132d14 {{(pid=129366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 21:12:20.467246 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-de53118d-cce0-4ed3-bd05-5e9e48b584b1 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] 10.222.0.46 "DELETE /compute/v2.1/servers/e978b725-2efe-42a9-83cb-e6343f132d14/os-volume_attachments/54e36e7f-6e75-428b-97f3-c673d414e0e9" status: 202 len: 0 microversion: 2.1 time: 0.438901 Jan 15 21:12:20.474726 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3058/6099] 10.222.0.46 () {58 vars in 1415 bytes} [Sat Jan 15 21:12:20 2022] DELETE /compute/v2.1/servers/e978b725-2efe-42a9-83cb-e6343f132d14/os-volume_attachments/54e36e7f-6e75-428b-97f3-c673d414e0e9 => generated 0 bytes in 443 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:12:20.524149 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5aaf7213-1e74-44a7-a60e-3e4a1c0847f6 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:12:20.526461 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-5aaf7213-1e74-44a7-a60e-3e4a1c0847f6 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] [instance: 462c1966-4e42-42e4-9bce-7c6e28d73918] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:12:20.547463 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5aaf7213-1e74-44a7-a60e-3e4a1c0847f6 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:20.549315 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5aaf7213-1e74-44a7-a60e-3e4a1c0847f6 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:20.552130 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5aaf7213-1e74-44a7-a60e-3e4a1c0847f6 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:20.569261 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5aaf7213-1e74-44a7-a60e-3e4a1c0847f6 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:21.570715 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-fda58e86-f82e-4b03-a9f9-9657c311083c tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-944731173", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "networks": [{"uuid": "f6497646-b979-4631-b8ee-bbc83d8bed66"}], "key_name": "tempest-TestNetworkAdvancedServerOps-335220064", "security_groups": [{"name": "tempest-secgroup-smoke-1220531184"}]}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:12:21.596720 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-5aaf7213-1e74-44a7-a60e-3e4a1c0847f6 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6aa71a6c814c758e2a28a5d7c6e5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4a162d96614ece8caf16ccbc99ad5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:12:21.605811 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5aaf7213-1e74-44a7-a60e-3e4a1c0847f6 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] 10.222.0.46 "GET /compute/v2.1/servers/462c1966-4e42-42e4-9bce-7c6e28d73918" status: 200 len: 1506 microversion: 2.1 time: 1.085362 Jan 15 21:12:21.611376 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3042/6100] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:12:20 2022] GET /compute/v2.1/servers/462c1966-4e42-42e4-9bce-7c6e28d73918 => generated 1506 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:12:21.725083 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-47598825-67ff-4cd5-b5e7-08835bcb8c14 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:12:21.725648 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-47598825-67ff-4cd5-b5e7-08835bcb8c14 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] [instance: e978b725-2efe-42a9-83cb-e6343f132d14] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:12:21.732808 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-47598825-67ff-4cd5-b5e7-08835bcb8c14 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:21.733288 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-47598825-67ff-4cd5-b5e7-08835bcb8c14 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:21.734087 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-47598825-67ff-4cd5-b5e7-08835bcb8c14 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:21.734812 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-47598825-67ff-4cd5-b5e7-08835bcb8c14 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:21.785249 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-47598825-67ff-4cd5-b5e7-08835bcb8c14 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] [instance: e978b725-2efe-42a9-83cb-e6343f132d14] Going to try to terminate instance {{(pid=129365) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 21:12:21.996447 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-47598825-67ff-4cd5-b5e7-08835bcb8c14 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] 10.222.0.46 "DELETE /compute/v2.1/servers/e978b725-2efe-42a9-83cb-e6343f132d14" status: 204 len: 0 microversion: 2.1 time: 0.266427 Jan 15 21:12:21.997421 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3043/6101] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 21:12:21 2022] DELETE /compute/v2.1/servers/e978b725-2efe-42a9-83cb-e6343f132d14 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 21:12:22.014372 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-153cd016-139d-4812-8e60-6864acbc6b77 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:12:22.016375 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-153cd016-139d-4812-8e60-6864acbc6b77 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] [instance: e978b725-2efe-42a9-83cb-e6343f132d14] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:12:22.042489 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-153cd016-139d-4812-8e60-6864acbc6b77 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:22.043619 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-153cd016-139d-4812-8e60-6864acbc6b77 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:22.044769 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-153cd016-139d-4812-8e60-6864acbc6b77 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:22.047438 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-153cd016-139d-4812-8e60-6864acbc6b77 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:22.299593 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.network.neutron [None req-fda58e86-f82e-4b03-a9f9-9657c311083c tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] validate_networks() for [('f6497646-b979-4631-b8ee-bbc83d8bed66', None, None, None, None, None)] {{(pid=129366) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 21:12:23.271430 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-153cd016-139d-4812-8e60-6864acbc6b77 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2364cc12914bd3922a66feb86c5c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa736a1907e4790b2ea49bc7f31e50c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:12:23.293185 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-153cd016-139d-4812-8e60-6864acbc6b77 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] 10.222.0.46 "GET /compute/v2.1/servers/e978b725-2efe-42a9-83cb-e6343f132d14" status: 200 len: 1513 microversion: 2.1 time: 1.279770 Jan 15 21:12:23.293861 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3044/6102] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:12:22 2022] GET /compute/v2.1/servers/e978b725-2efe-42a9-83cb-e6343f132d14 => generated 1513 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:12:23.298838 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e7958dcd-373e-4afb-8c3e-b8ef8301eb4d tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:12:23.299440 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e7958dcd-373e-4afb-8c3e-b8ef8301eb4d tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] [instance: 462c1966-4e42-42e4-9bce-7c6e28d73918] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:12:23.310838 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e7958dcd-373e-4afb-8c3e-b8ef8301eb4d tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:23.311836 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e7958dcd-373e-4afb-8c3e-b8ef8301eb4d tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:23.312964 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e7958dcd-373e-4afb-8c3e-b8ef8301eb4d tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:23.313609 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e7958dcd-373e-4afb-8c3e-b8ef8301eb4d tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:23.973716 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-e7958dcd-373e-4afb-8c3e-b8ef8301eb4d tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6aa71a6c814c758e2a28a5d7c6e5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4a162d96614ece8caf16ccbc99ad5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:12:23.988198 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e7958dcd-373e-4afb-8c3e-b8ef8301eb4d tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] 10.222.0.46 "GET /compute/v2.1/servers/462c1966-4e42-42e4-9bce-7c6e28d73918" status: 200 len: 1486 microversion: 2.1 time: 0.692801 Jan 15 21:12:23.988798 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3045/6103] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:12:23 2022] GET /compute/v2.1/servers/462c1966-4e42-42e4-9bce-7c6e28d73918 => generated 1486 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:12:24.010436 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-db85fea6-3d8f-4308-ace5-4a763aad2530 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:12:24.010883 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-db85fea6-3d8f-4308-ace5-4a763aad2530 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] [instance: 462c1966-4e42-42e4-9bce-7c6e28d73918] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:12:24.024412 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-db85fea6-3d8f-4308-ace5-4a763aad2530 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:24.025170 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-db85fea6-3d8f-4308-ace5-4a763aad2530 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:24.026030 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-db85fea6-3d8f-4308-ace5-4a763aad2530 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:24.026425 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-db85fea6-3d8f-4308-ace5-4a763aad2530 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:24.162283 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-db85fea6-3d8f-4308-ace5-4a763aad2530 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] 10.222.0.46 "POST /compute/v2.1/servers/462c1966-4e42-42e4-9bce-7c6e28d73918/action" status: 202 len: 0 microversion: 2.1 time: 0.156398 Jan 15 21:12:24.163318 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3046/6104] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:12:24 2022] POST /compute/v2.1/servers/462c1966-4e42-42e4-9bce-7c6e28d73918/action => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:12:24.172769 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-7669ff58-429d-4fd5-a12c-9e8a4fa15d52 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:12:24.184192 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-7669ff58-429d-4fd5-a12c-9e8a4fa15d52 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] [instance: 462c1966-4e42-42e4-9bce-7c6e28d73918] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:12:24.191396 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7669ff58-429d-4fd5-a12c-9e8a4fa15d52 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:24.192019 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7669ff58-429d-4fd5-a12c-9e8a4fa15d52 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:24.193009 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7669ff58-429d-4fd5-a12c-9e8a4fa15d52 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:24.193626 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7669ff58-429d-4fd5-a12c-9e8a4fa15d52 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:24.829203 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-fda58e86-f82e-4b03-a9f9-9657c311083c tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Flavor limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 21:12:24.830963 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-fda58e86-f82e-4b03-a9f9-9657c311083c tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Image limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 21:12:24.831630 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-fda58e86-f82e-4b03-a9f9-9657c311083c tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Flavor pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 21:12:24.832237 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-fda58e86-f82e-4b03-a9f9-9657c311083c tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Image pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 21:12:24.833575 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-fda58e86-f82e-4b03-a9f9-9657c311083c tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 21:12:24.847549 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fda58e86-f82e-4b03-a9f9-9657c311083c tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:24.849456 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fda58e86-f82e-4b03-a9f9-9657c311083c tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:24.851352 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fda58e86-f82e-4b03-a9f9-9657c311083c tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:24.852473 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fda58e86-f82e-4b03-a9f9-9657c311083c tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:24.894177 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-fda58e86-f82e-4b03-a9f9-9657c311083c tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Getting quotas for project ed86e4d7dcdb4ea7ad79628b2ae2462d. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:12:24.913135 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-fda58e86-f82e-4b03-a9f9-9657c311083c tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Getting quotas for user 7f0f0e03b03e4d24ae0a7e5d3b9b7104 and project ed86e4d7dcdb4ea7ad79628b2ae2462d. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:12:24.942721 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-fda58e86-f82e-4b03-a9f9-9657c311083c tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Going to run 1 instances... {{(pid=129366) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 21:12:24.949318 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-fda58e86-f82e-4b03-a9f9-9657c311083c tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: 913a9b5a-dfd5-478a-9424-0114ea3a5006] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 21:12:24.984175 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-7669ff58-429d-4fd5-a12c-9e8a4fa15d52 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6aa71a6c814c758e2a28a5d7c6e5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4a162d96614ece8caf16ccbc99ad5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:12:25.005867 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-7669ff58-429d-4fd5-a12c-9e8a4fa15d52 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] 10.222.0.46 "GET /compute/v2.1/servers/462c1966-4e42-42e4-9bce-7c6e28d73918" status: 200 len: 1494 microversion: 2.1 time: 0.836534 Jan 15 21:12:25.009097 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3047/6105] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:12:24 2022] GET /compute/v2.1/servers/462c1966-4e42-42e4-9bce-7c6e28d73918 => generated 1494 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:12:25.025868 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-4144af77-e377-4577-9985-74d7b54368a4 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:12:25.027630 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-4144af77-e377-4577-9985-74d7b54368a4 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] [instance: e978b725-2efe-42a9-83cb-e6343f132d14] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:12:25.046557 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4144af77-e377-4577-9985-74d7b54368a4 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:25.048639 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4144af77-e377-4577-9985-74d7b54368a4 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:25.051317 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4144af77-e377-4577-9985-74d7b54368a4 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:25.052086 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4144af77-e377-4577-9985-74d7b54368a4 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:25.095794 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-fda58e86-f82e-4b03-a9f9-9657c311083c tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 3.524604 Jan 15 21:12:25.099201 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3059/6106] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 21:12:21 2022] POST /compute/v2.1/servers => generated 406 bytes in 3533 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 21:12:25.115930 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-d34ec799-85f0-457f-8794-bb282d06367d req-4141cd34-363a-46db-a592-fbc1f0f365bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e978b725-2efe-42a9-83cb-e6343f132d14", "name": "network-vif-deleted", "tag": "d46b9724-0123-47b5-a443-4daf591a33d4"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:12:25.124623 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:12:25.124623 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:12:25.136760 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-d34ec799-85f0-457f-8794-bb282d06367d req-4141cd34-363a-46db-a592-fbc1f0f365bb service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:25.137484 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-d34ec799-85f0-457f-8794-bb282d06367d req-4141cd34-363a-46db-a592-fbc1f0f365bb service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:25.159391 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-d34ec799-85f0-457f-8794-bb282d06367d req-4141cd34-363a-46db-a592-fbc1f0f365bb service nova] Creating event network-vif-deleted:d46b9724-0123-47b5-a443-4daf591a33d4 for instance e978b725-2efe-42a9-83cb-e6343f132d14 on nch1-master-1 Jan 15 21:12:25.168200 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-d34ec799-85f0-457f-8794-bb282d06367d req-4141cd34-363a-46db-a592-fbc1f0f365bb service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067054 Jan 15 21:12:25.169521 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3060/6107] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:12:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:12:25.178125 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-21ce864f-5ab6-4d13-92fd-355a561df161 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:12:25.179460 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-21ce864f-5ab6-4d13-92fd-355a561df161 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: 913a9b5a-dfd5-478a-9424-0114ea3a5006] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:12:25.244066 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-4144af77-e377-4577-9985-74d7b54368a4 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2364cc12914bd3922a66feb86c5c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa736a1907e4790b2ea49bc7f31e50c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:12:25.256006 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-4144af77-e377-4577-9985-74d7b54368a4 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] 10.222.0.46 "GET /compute/v2.1/servers/e978b725-2efe-42a9-83cb-e6343f132d14" status: 200 len: 1303 microversion: 2.1 time: 0.245267 Jan 15 21:12:25.259591 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3048/6108] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:12:25 2022] GET /compute/v2.1/servers/e978b725-2efe-42a9-83cb-e6343f132d14 => generated 1303 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:12:25.317915 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-21ce864f-5ab6-4d13-92fd-355a561df161 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:12:25.328114 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-21ce864f-5ab6-4d13-92fd-355a561df161 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/913a9b5a-dfd5-478a-9424-0114ea3a5006" status: 200 len: 1265 microversion: 2.1 time: 0.156108 Jan 15 21:12:25.329658 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3061/6109] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:12:25 2022] GET /compute/v2.1/servers/913a9b5a-dfd5-478a-9424-0114ea3a5006 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:12:26.028810 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d98c4dcb-573b-4b05-82b9-9685f7f03a14 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:12:26.029481 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d98c4dcb-573b-4b05-82b9-9685f7f03a14 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] [instance: 462c1966-4e42-42e4-9bce-7c6e28d73918] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:12:26.052601 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d98c4dcb-573b-4b05-82b9-9685f7f03a14 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:26.054634 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d98c4dcb-573b-4b05-82b9-9685f7f03a14 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:26.058436 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d98c4dcb-573b-4b05-82b9-9685f7f03a14 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:26.061526 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d98c4dcb-573b-4b05-82b9-9685f7f03a14 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:26.284237 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-03bd8dc3-2a3f-4678-8455-f3e6777b2337 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:12:26.285431 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-03bd8dc3-2a3f-4678-8455-f3e6777b2337 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] [instance: e978b725-2efe-42a9-83cb-e6343f132d14] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:12:26.294706 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-03bd8dc3-2a3f-4678-8455-f3e6777b2337 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:26.295163 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-03bd8dc3-2a3f-4678-8455-f3e6777b2337 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:26.295964 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-03bd8dc3-2a3f-4678-8455-f3e6777b2337 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:26.296407 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-03bd8dc3-2a3f-4678-8455-f3e6777b2337 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:26.356578 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-03bd8dc3-2a3f-4678-8455-f3e6777b2337 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] HTTP exception thrown: Instance e978b725-2efe-42a9-83cb-e6343f132d14 could not be found. Jan 15 21:12:26.364692 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-03bd8dc3-2a3f-4678-8455-f3e6777b2337 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] Returning 404 to user: Instance e978b725-2efe-42a9-83cb-e6343f132d14 could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:12:26.366919 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-03bd8dc3-2a3f-4678-8455-f3e6777b2337 tempest-VolumesSnapshotTestJSON-711254379 tempest-VolumesSnapshotTestJSON-711254379-project] 10.222.0.46 "GET /compute/v2.1/servers/e978b725-2efe-42a9-83cb-e6343f132d14" status: 404 len: 111 microversion: 2.1 time: 0.086469 Jan 15 21:12:26.381222 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3062/6110] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:12:26 2022] GET /compute/v2.1/servers/e978b725-2efe-42a9-83cb-e6343f132d14 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:12:26.392514 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-606838eb-03fb-4d8d-9348-d092c081d623 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:12:26.401814 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-606838eb-03fb-4d8d-9348-d092c081d623 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: 913a9b5a-dfd5-478a-9424-0114ea3a5006] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:12:26.415078 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-606838eb-03fb-4d8d-9348-d092c081d623 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:26.422263 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-606838eb-03fb-4d8d-9348-d092c081d623 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:26.423398 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-606838eb-03fb-4d8d-9348-d092c081d623 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:26.425414 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-606838eb-03fb-4d8d-9348-d092c081d623 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:26.678810 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-606838eb-03fb-4d8d-9348-d092c081d623 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:12:26.693271 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-606838eb-03fb-4d8d-9348-d092c081d623 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/913a9b5a-dfd5-478a-9424-0114ea3a5006" status: 200 len: 1317 microversion: 2.1 time: 0.310438 Jan 15 21:12:26.693868 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3063/6111] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:12:26 2022] GET /compute/v2.1/servers/913a9b5a-dfd5-478a-9424-0114ea3a5006 => generated 1317 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:12:27.030533 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-d98c4dcb-573b-4b05-82b9-9685f7f03a14 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6aa71a6c814c758e2a28a5d7c6e5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4a162d96614ece8caf16ccbc99ad5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:12:27.040272 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d98c4dcb-573b-4b05-82b9-9685f7f03a14 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] 10.222.0.46 "GET /compute/v2.1/servers/462c1966-4e42-42e4-9bce-7c6e28d73918" status: 200 len: 1494 microversion: 2.1 time: 1.016424 Jan 15 21:12:27.054610 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3049/6112] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:12:26 2022] GET /compute/v2.1/servers/462c1966-4e42-42e4-9bce-7c6e28d73918 => generated 1494 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:12:27.710953 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-aa0386e2-9168-4615-8717-bda763251f3e tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:12:27.711701 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-aa0386e2-9168-4615-8717-bda763251f3e tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: 913a9b5a-dfd5-478a-9424-0114ea3a5006] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:12:27.723145 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-aa0386e2-9168-4615-8717-bda763251f3e tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:27.732365 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-aa0386e2-9168-4615-8717-bda763251f3e tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:27.733570 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-aa0386e2-9168-4615-8717-bda763251f3e tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:27.738299 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-aa0386e2-9168-4615-8717-bda763251f3e tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:27.916594 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-aa0386e2-9168-4615-8717-bda763251f3e tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:12:27.927691 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-aa0386e2-9168-4615-8717-bda763251f3e tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/913a9b5a-dfd5-478a-9424-0114ea3a5006" status: 200 len: 1323 microversion: 2.1 time: 0.220298 Jan 15 21:12:27.928657 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3064/6113] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:12:27 2022] GET /compute/v2.1/servers/913a9b5a-dfd5-478a-9424-0114ea3a5006 => generated 1323 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:12:28.067527 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-83a0051f-66b6-4598-8b9f-35cfa8a25e79 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:12:28.068136 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-83a0051f-66b6-4598-8b9f-35cfa8a25e79 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] [instance: 462c1966-4e42-42e4-9bce-7c6e28d73918] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:12:28.079130 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-83a0051f-66b6-4598-8b9f-35cfa8a25e79 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:28.079580 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-83a0051f-66b6-4598-8b9f-35cfa8a25e79 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:28.080376 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-83a0051f-66b6-4598-8b9f-35cfa8a25e79 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:28.080807 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-83a0051f-66b6-4598-8b9f-35cfa8a25e79 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:28.947035 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0ef3c97c-6cf0-4efb-914a-7f20b8eea482 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:12:28.947919 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-0ef3c97c-6cf0-4efb-914a-7f20b8eea482 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: 913a9b5a-dfd5-478a-9424-0114ea3a5006] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:12:28.956492 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0ef3c97c-6cf0-4efb-914a-7f20b8eea482 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:28.960530 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0ef3c97c-6cf0-4efb-914a-7f20b8eea482 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:28.963709 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0ef3c97c-6cf0-4efb-914a-7f20b8eea482 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:28.966514 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0ef3c97c-6cf0-4efb-914a-7f20b8eea482 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:29.226931 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-0ef3c97c-6cf0-4efb-914a-7f20b8eea482 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:12:29.237570 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0ef3c97c-6cf0-4efb-914a-7f20b8eea482 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/913a9b5a-dfd5-478a-9424-0114ea3a5006" status: 200 len: 1323 microversion: 2.1 time: 0.293914 Jan 15 21:12:29.239781 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3065/6114] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:12:28 2022] GET /compute/v2.1/servers/913a9b5a-dfd5-478a-9424-0114ea3a5006 => generated 1323 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:12:29.356610 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-83a0051f-66b6-4598-8b9f-35cfa8a25e79 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6aa71a6c814c758e2a28a5d7c6e5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4a162d96614ece8caf16ccbc99ad5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:12:29.374721 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-83a0051f-66b6-4598-8b9f-35cfa8a25e79 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] 10.222.0.46 "GET /compute/v2.1/servers/462c1966-4e42-42e4-9bce-7c6e28d73918" status: 200 len: 1500 microversion: 2.1 time: 1.310646 Jan 15 21:12:29.375631 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3050/6115] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:12:28 2022] GET /compute/v2.1/servers/462c1966-4e42-42e4-9bce-7c6e28d73918 => generated 1500 bytes in 1312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:12:29.407681 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-5bc50d8a-2c61-4e06-8939-d6b3d1f74e4d tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:12:29.409524 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-5bc50d8a-2c61-4e06-8939-d6b3d1f74e4d tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] [instance: 462c1966-4e42-42e4-9bce-7c6e28d73918] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:12:29.424909 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5bc50d8a-2c61-4e06-8939-d6b3d1f74e4d tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:29.425642 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5bc50d8a-2c61-4e06-8939-d6b3d1f74e4d tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:29.431000 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5bc50d8a-2c61-4e06-8939-d6b3d1f74e4d tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:29.432445 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5bc50d8a-2c61-4e06-8939-d6b3d1f74e4d tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:29.560176 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-5bc50d8a-2c61-4e06-8939-d6b3d1f74e4d tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] [instance: 462c1966-4e42-42e4-9bce-7c6e28d73918] Going to try to terminate instance {{(pid=129366) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 21:12:29.778917 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-5bc50d8a-2c61-4e06-8939-d6b3d1f74e4d tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] 10.222.0.46 "DELETE /compute/v2.1/servers/462c1966-4e42-42e4-9bce-7c6e28d73918" status: 204 len: 0 microversion: 2.1 time: 0.376313 Jan 15 21:12:29.780978 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3066/6116] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 21:12:29 2022] DELETE /compute/v2.1/servers/462c1966-4e42-42e4-9bce-7c6e28d73918 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 21:12:29.789978 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8e7fdf74-2370-440d-8778-9a9b2cdf4d84 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:12:29.790697 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-8e7fdf74-2370-440d-8778-9a9b2cdf4d84 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] [instance: 462c1966-4e42-42e4-9bce-7c6e28d73918] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:12:29.809775 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8e7fdf74-2370-440d-8778-9a9b2cdf4d84 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:29.810333 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8e7fdf74-2370-440d-8778-9a9b2cdf4d84 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:29.811242 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8e7fdf74-2370-440d-8778-9a9b2cdf4d84 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:29.815705 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8e7fdf74-2370-440d-8778-9a9b2cdf4d84 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:30.264333 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ae3a3e69-9204-4205-ae6c-8854a5a99981 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:12:30.266164 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ae3a3e69-9204-4205-ae6c-8854a5a99981 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: 913a9b5a-dfd5-478a-9424-0114ea3a5006] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:12:30.294116 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ae3a3e69-9204-4205-ae6c-8854a5a99981 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:30.297192 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ae3a3e69-9204-4205-ae6c-8854a5a99981 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:30.302676 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ae3a3e69-9204-4205-ae6c-8854a5a99981 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:30.304615 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ae3a3e69-9204-4205-ae6c-8854a5a99981 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:30.855003 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-8e7fdf74-2370-440d-8778-9a9b2cdf4d84 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6aa71a6c814c758e2a28a5d7c6e5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4a162d96614ece8caf16ccbc99ad5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:12:30.862846 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-8e7fdf74-2370-440d-8778-9a9b2cdf4d84 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] 10.222.0.46 "GET /compute/v2.1/servers/462c1966-4e42-42e4-9bce-7c6e28d73918" status: 200 len: 1506 microversion: 2.1 time: 1.077825 Jan 15 21:12:30.863467 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3051/6117] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:12:29 2022] GET /compute/v2.1/servers/462c1966-4e42-42e4-9bce-7c6e28d73918 => generated 1506 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:12:31.069786 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-ae3a3e69-9204-4205-ae6c-8854a5a99981 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:12:31.079223 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ae3a3e69-9204-4205-ae6c-8854a5a99981 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/913a9b5a-dfd5-478a-9424-0114ea3a5006" status: 200 len: 1391 microversion: 2.1 time: 0.821302 Jan 15 21:12:31.091162 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3067/6118] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:12:30 2022] GET /compute/v2.1/servers/913a9b5a-dfd5-478a-9424-0114ea3a5006 => generated 1391 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:12:31.884204 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2cc8df37-15b2-4ec5-8820-3feaa2fadf65 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:12:31.885540 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-2cc8df37-15b2-4ec5-8820-3feaa2fadf65 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] [instance: 462c1966-4e42-42e4-9bce-7c6e28d73918] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:12:31.908783 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2cc8df37-15b2-4ec5-8820-3feaa2fadf65 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:31.909926 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2cc8df37-15b2-4ec5-8820-3feaa2fadf65 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:31.915635 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2cc8df37-15b2-4ec5-8820-3feaa2fadf65 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:31.917715 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2cc8df37-15b2-4ec5-8820-3feaa2fadf65 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:32.121497 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7719ba4c-8e38-407e-b7da-510d12c5abc8 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:12:32.122137 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-7719ba4c-8e38-407e-b7da-510d12c5abc8 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: 913a9b5a-dfd5-478a-9424-0114ea3a5006] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:12:32.142546 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7719ba4c-8e38-407e-b7da-510d12c5abc8 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:32.142998 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7719ba4c-8e38-407e-b7da-510d12c5abc8 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:32.145122 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7719ba4c-8e38-407e-b7da-510d12c5abc8 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:32.148405 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7719ba4c-8e38-407e-b7da-510d12c5abc8 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:32.870447 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-2cc8df37-15b2-4ec5-8820-3feaa2fadf65 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6aa71a6c814c758e2a28a5d7c6e5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4a162d96614ece8caf16ccbc99ad5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:12:32.879212 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2cc8df37-15b2-4ec5-8820-3feaa2fadf65 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] 10.222.0.46 "GET /compute/v2.1/servers/462c1966-4e42-42e4-9bce-7c6e28d73918" status: 200 len: 1506 microversion: 2.1 time: 1.000007 Jan 15 21:12:32.900822 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3052/6119] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:12:31 2022] GET /compute/v2.1/servers/462c1966-4e42-42e4-9bce-7c6e28d73918 => generated 1506 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:12:32.919661 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-a70d3ff3-3eb9-4b4b-b3f6-9c6695475019 req-a19898bd-9f59-4565-a31e-0b5741383c66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "913a9b5a-dfd5-478a-9424-0114ea3a5006", "tag": "00a046e1-4575-48fc-acfb-813600567478"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:12:32.921860 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:12:32.921860 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:12:32.944681 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-a70d3ff3-3eb9-4b4b-b3f6-9c6695475019 req-a19898bd-9f59-4565-a31e-0b5741383c66 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:32.945382 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-a70d3ff3-3eb9-4b4b-b3f6-9c6695475019 req-a19898bd-9f59-4565-a31e-0b5741383c66 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:32.996141 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-a70d3ff3-3eb9-4b4b-b3f6-9c6695475019 req-a19898bd-9f59-4565-a31e-0b5741383c66 service nova] Creating event network-changed:00a046e1-4575-48fc-acfb-813600567478 for instance 913a9b5a-dfd5-478a-9424-0114ea3a5006 on nch1-master-1 Jan 15 21:12:33.011899 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-a70d3ff3-3eb9-4b4b-b3f6-9c6695475019 req-a19898bd-9f59-4565-a31e-0b5741383c66 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109635 Jan 15 21:12:33.018422 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3053/6120] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:12:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:12:33.051189 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-7719ba4c-8e38-407e-b7da-510d12c5abc8 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:12:33.078158 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7719ba4c-8e38-407e-b7da-510d12c5abc8 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/913a9b5a-dfd5-478a-9424-0114ea3a5006" status: 200 len: 1391 microversion: 2.1 time: 0.964033 Jan 15 21:12:33.079474 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3068/6121] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:12:32 2022] GET /compute/v2.1/servers/913a9b5a-dfd5-478a-9424-0114ea3a5006 => generated 1391 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:12:33.911879 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3c3ae489-c047-4b86-a0fa-626a031c516c tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:12:33.912660 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-3c3ae489-c047-4b86-a0fa-626a031c516c tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] [instance: 462c1966-4e42-42e4-9bce-7c6e28d73918] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:12:33.926513 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3c3ae489-c047-4b86-a0fa-626a031c516c tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:33.926966 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3c3ae489-c047-4b86-a0fa-626a031c516c tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:33.927813 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3c3ae489-c047-4b86-a0fa-626a031c516c tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:33.929030 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3c3ae489-c047-4b86-a0fa-626a031c516c tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:34.102679 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c5bbc405-6098-4acb-be38-bb9dc277f587 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:12:34.104432 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c5bbc405-6098-4acb-be38-bb9dc277f587 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: 913a9b5a-dfd5-478a-9424-0114ea3a5006] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:12:34.118519 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c5bbc405-6098-4acb-be38-bb9dc277f587 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:34.118971 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c5bbc405-6098-4acb-be38-bb9dc277f587 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:34.121654 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c5bbc405-6098-4acb-be38-bb9dc277f587 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:34.122106 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c5bbc405-6098-4acb-be38-bb9dc277f587 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:35.720105 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-c5bbc405-6098-4acb-be38-bb9dc277f587 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:12:35.725944 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-3c3ae489-c047-4b86-a0fa-626a031c516c tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6aa71a6c814c758e2a28a5d7c6e5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4a162d96614ece8caf16ccbc99ad5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:12:35.743803 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3c3ae489-c047-4b86-a0fa-626a031c516c tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] 10.222.0.46 "GET /compute/v2.1/servers/462c1966-4e42-42e4-9bce-7c6e28d73918" status: 200 len: 1506 microversion: 2.1 time: 1.839897 Jan 15 21:12:35.744804 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3054/6122] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:12:33 2022] GET /compute/v2.1/servers/462c1966-4e42-42e4-9bce-7c6e28d73918 => generated 1506 bytes in 1842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:12:35.750782 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-4108d08c-94b5-4649-b442-3fa84d427696 req-29bdadb7-0139-4164-84fc-c328d818dbfc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "462c1966-4e42-42e4-9bce-7c6e28d73918", "name": "network-vif-deleted", "tag": "50bb49c7-3617-4308-844c-7a5f3d2c58b0"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:12:35.752522 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:12:35.752522 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:12:35.755551 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c5bbc405-6098-4acb-be38-bb9dc277f587 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/913a9b5a-dfd5-478a-9424-0114ea3a5006" status: 200 len: 1391 microversion: 2.1 time: 1.637141 Jan 15 21:12:35.765711 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3069/6123] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:12:34 2022] GET /compute/v2.1/servers/913a9b5a-dfd5-478a-9424-0114ea3a5006 => generated 1391 bytes in 1670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:12:35.776189 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-4108d08c-94b5-4649-b442-3fa84d427696 req-29bdadb7-0139-4164-84fc-c328d818dbfc service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:35.776641 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-4108d08c-94b5-4649-b442-3fa84d427696 req-29bdadb7-0139-4164-84fc-c328d818dbfc service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:35.815318 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-4108d08c-94b5-4649-b442-3fa84d427696 req-29bdadb7-0139-4164-84fc-c328d818dbfc service nova] Creating event network-vif-deleted:50bb49c7-3617-4308-844c-7a5f3d2c58b0 for instance 462c1966-4e42-42e4-9bce-7c6e28d73918 on nch2-master-1 Jan 15 21:12:35.865560 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-4108d08c-94b5-4649-b442-3fa84d427696 req-29bdadb7-0139-4164-84fc-c328d818dbfc service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116929 Jan 15 21:12:35.866711 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3055/6124] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:12:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:12:36.761853 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-fcff4cd4-5d1e-4e41-9e30-5b872acab205 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:12:36.762487 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-fcff4cd4-5d1e-4e41-9e30-5b872acab205 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] [instance: 462c1966-4e42-42e4-9bce-7c6e28d73918] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:12:36.772976 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-aab6deee-ca06-474b-95e0-dcfb891d5e50 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:12:36.774521 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-aab6deee-ca06-474b-95e0-dcfb891d5e50 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: 913a9b5a-dfd5-478a-9424-0114ea3a5006] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:12:36.777153 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fcff4cd4-5d1e-4e41-9e30-5b872acab205 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:36.777614 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fcff4cd4-5d1e-4e41-9e30-5b872acab205 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:36.778418 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fcff4cd4-5d1e-4e41-9e30-5b872acab205 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:36.778858 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fcff4cd4-5d1e-4e41-9e30-5b872acab205 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:36.790832 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-aab6deee-ca06-474b-95e0-dcfb891d5e50 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:36.796316 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-aab6deee-ca06-474b-95e0-dcfb891d5e50 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:36.798190 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-aab6deee-ca06-474b-95e0-dcfb891d5e50 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:36.802390 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-aab6deee-ca06-474b-95e0-dcfb891d5e50 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:36.815505 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-fcff4cd4-5d1e-4e41-9e30-5b872acab205 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] HTTP exception thrown: Instance 462c1966-4e42-42e4-9bce-7c6e28d73918 could not be found. Jan 15 21:12:36.816190 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-fcff4cd4-5d1e-4e41-9e30-5b872acab205 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Returning 404 to user: Instance 462c1966-4e42-42e4-9bce-7c6e28d73918 could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:12:36.817078 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-fcff4cd4-5d1e-4e41-9e30-5b872acab205 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] 10.222.0.46 "GET /compute/v2.1/servers/462c1966-4e42-42e4-9bce-7c6e28d73918" status: 404 len: 111 microversion: 2.1 time: 0.059813 Jan 15 21:12:36.824298 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3070/6125] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:12:36 2022] GET /compute/v2.1/servers/462c1966-4e42-42e4-9bce-7c6e28d73918 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:12:36.838025 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9e8ecfc6-49a0-4582-8e43-7a3b7ba63649 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:12:36.838655 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-9e8ecfc6-49a0-4582-8e43-7a3b7ba63649 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] [instance: 20b5b2d2-e5cc-4c06-9420-9fbf3569996c] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:12:36.855028 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9e8ecfc6-49a0-4582-8e43-7a3b7ba63649 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:36.855486 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9e8ecfc6-49a0-4582-8e43-7a3b7ba63649 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:36.856287 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9e8ecfc6-49a0-4582-8e43-7a3b7ba63649 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:36.856724 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9e8ecfc6-49a0-4582-8e43-7a3b7ba63649 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:36.921681 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-9e8ecfc6-49a0-4582-8e43-7a3b7ba63649 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] [instance: 20b5b2d2-e5cc-4c06-9420-9fbf3569996c] Going to try to terminate instance {{(pid=129366) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 21:12:37.099584 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-9e8ecfc6-49a0-4582-8e43-7a3b7ba63649 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] 10.222.0.46 "DELETE /compute/v2.1/servers/20b5b2d2-e5cc-4c06-9420-9fbf3569996c" status: 204 len: 0 microversion: 2.1 time: 0.273885 Jan 15 21:12:37.100548 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3071/6126] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 21:12:36 2022] DELETE /compute/v2.1/servers/20b5b2d2-e5cc-4c06-9420-9fbf3569996c => generated 0 bytes in 275 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 21:12:37.109228 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-444a2e84-1144-4110-8c0d-f25ca590e573 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:12:37.112987 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-444a2e84-1144-4110-8c0d-f25ca590e573 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] [instance: 20b5b2d2-e5cc-4c06-9420-9fbf3569996c] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:12:37.131574 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-444a2e84-1144-4110-8c0d-f25ca590e573 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:37.132311 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-444a2e84-1144-4110-8c0d-f25ca590e573 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:37.135705 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-444a2e84-1144-4110-8c0d-f25ca590e573 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:37.136343 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-444a2e84-1144-4110-8c0d-f25ca590e573 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:37.784218 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-aab6deee-ca06-474b-95e0-dcfb891d5e50 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:12:37.838435 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-aab6deee-ca06-474b-95e0-dcfb891d5e50 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/913a9b5a-dfd5-478a-9424-0114ea3a5006" status: 200 len: 1391 microversion: 2.1 time: 1.069129 Jan 15 21:12:37.839811 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3056/6127] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:12:36 2022] GET /compute/v2.1/servers/913a9b5a-dfd5-478a-9424-0114ea3a5006 => generated 1391 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:12:38.052559 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-444a2e84-1144-4110-8c0d-f25ca590e573 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6aa71a6c814c758e2a28a5d7c6e5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4a162d96614ece8caf16ccbc99ad5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:12:38.081747 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-444a2e84-1144-4110-8c0d-f25ca590e573 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] 10.222.0.46 "GET /compute/v2.1/servers/20b5b2d2-e5cc-4c06-9420-9fbf3569996c" status: 200 len: 1493 microversion: 2.1 time: 0.976558 Jan 15 21:12:38.092280 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3072/6128] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:12:37 2022] GET /compute/v2.1/servers/20b5b2d2-e5cc-4c06-9420-9fbf3569996c => generated 1493 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:12:38.856563 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-469f979f-0cc9-43ff-9afd-e300adbfaea3 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:12:38.858921 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-469f979f-0cc9-43ff-9afd-e300adbfaea3 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: 913a9b5a-dfd5-478a-9424-0114ea3a5006] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:12:38.875269 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-469f979f-0cc9-43ff-9afd-e300adbfaea3 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:38.878472 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-469f979f-0cc9-43ff-9afd-e300adbfaea3 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:38.886215 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-469f979f-0cc9-43ff-9afd-e300adbfaea3 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:38.887044 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-469f979f-0cc9-43ff-9afd-e300adbfaea3 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:39.105825 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-cb9febbc-aac6-4df7-8bb6-ae2ad1b56e78 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:12:39.106526 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-cb9febbc-aac6-4df7-8bb6-ae2ad1b56e78 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] [instance: 20b5b2d2-e5cc-4c06-9420-9fbf3569996c] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:12:39.124973 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cb9febbc-aac6-4df7-8bb6-ae2ad1b56e78 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:39.126382 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cb9febbc-aac6-4df7-8bb6-ae2ad1b56e78 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:39.136098 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cb9febbc-aac6-4df7-8bb6-ae2ad1b56e78 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:39.140097 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cb9febbc-aac6-4df7-8bb6-ae2ad1b56e78 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:39.708028 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-469f979f-0cc9-43ff-9afd-e300adbfaea3 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:12:39.732182 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-469f979f-0cc9-43ff-9afd-e300adbfaea3 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/913a9b5a-dfd5-478a-9424-0114ea3a5006" status: 200 len: 1391 microversion: 2.1 time: 0.880079 Jan 15 21:12:39.732818 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3057/6129] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:12:38 2022] GET /compute/v2.1/servers/913a9b5a-dfd5-478a-9424-0114ea3a5006 => generated 1391 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:12:40.109349 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-cb9febbc-aac6-4df7-8bb6-ae2ad1b56e78 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6aa71a6c814c758e2a28a5d7c6e5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4a162d96614ece8caf16ccbc99ad5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:12:40.143440 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-cb9febbc-aac6-4df7-8bb6-ae2ad1b56e78 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] 10.222.0.46 "GET /compute/v2.1/servers/20b5b2d2-e5cc-4c06-9420-9fbf3569996c" status: 200 len: 1493 microversion: 2.1 time: 1.048230 Jan 15 21:12:40.167808 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3073/6130] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:12:39 2022] GET /compute/v2.1/servers/20b5b2d2-e5cc-4c06-9420-9fbf3569996c => generated 1493 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:12:40.751112 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5008d01c-9c96-4689-8bbb-4a9e285560c6 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:12:40.752251 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-5008d01c-9c96-4689-8bbb-4a9e285560c6 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: 913a9b5a-dfd5-478a-9424-0114ea3a5006] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:12:40.767633 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5008d01c-9c96-4689-8bbb-4a9e285560c6 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:40.768344 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5008d01c-9c96-4689-8bbb-4a9e285560c6 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:40.769368 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5008d01c-9c96-4689-8bbb-4a9e285560c6 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:40.770313 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5008d01c-9c96-4689-8bbb-4a9e285560c6 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:41.161647 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d947ef7b-720e-4af2-9ca6-0902f6e82ea1 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:12:41.162252 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-d947ef7b-720e-4af2-9ca6-0902f6e82ea1 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] [instance: 20b5b2d2-e5cc-4c06-9420-9fbf3569996c] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:12:41.182636 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d947ef7b-720e-4af2-9ca6-0902f6e82ea1 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:41.183091 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d947ef7b-720e-4af2-9ca6-0902f6e82ea1 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:41.185371 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d947ef7b-720e-4af2-9ca6-0902f6e82ea1 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:41.186726 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d947ef7b-720e-4af2-9ca6-0902f6e82ea1 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:41.352412 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-5008d01c-9c96-4689-8bbb-4a9e285560c6 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:12:41.363303 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5008d01c-9c96-4689-8bbb-4a9e285560c6 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/913a9b5a-dfd5-478a-9424-0114ea3a5006" status: 200 len: 1391 microversion: 2.1 time: 0.617416 Jan 15 21:12:41.374313 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3058/6131] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:12:40 2022] GET /compute/v2.1/servers/913a9b5a-dfd5-478a-9424-0114ea3a5006 => generated 1391 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:12:41.956720 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-d947ef7b-720e-4af2-9ca6-0902f6e82ea1 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6aa71a6c814c758e2a28a5d7c6e5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4a162d96614ece8caf16ccbc99ad5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:12:41.969931 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d947ef7b-720e-4af2-9ca6-0902f6e82ea1 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] 10.222.0.46 "GET /compute/v2.1/servers/20b5b2d2-e5cc-4c06-9420-9fbf3569996c" status: 200 len: 1493 microversion: 2.1 time: 0.812037 Jan 15 21:12:42.005111 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3074/6132] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:12:41 2022] GET /compute/v2.1/servers/20b5b2d2-e5cc-4c06-9420-9fbf3569996c => generated 1493 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:12:42.383476 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-855040a3-f811-49fa-93bc-2d771f672f9f tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:12:42.384096 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-855040a3-f811-49fa-93bc-2d771f672f9f tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: 913a9b5a-dfd5-478a-9424-0114ea3a5006] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:12:42.392036 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-855040a3-f811-49fa-93bc-2d771f672f9f tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:42.392500 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-855040a3-f811-49fa-93bc-2d771f672f9f tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:42.393576 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-855040a3-f811-49fa-93bc-2d771f672f9f tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:42.395696 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-855040a3-f811-49fa-93bc-2d771f672f9f tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:42.795204 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-28187e66-cda3-4bc6-9a90-22e3e3a957c4 req-bd0d692c-f6da-401c-a40b-cf46abb4cea1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20b5b2d2-e5cc-4c06-9420-9fbf3569996c", "name": "network-vif-deleted", "tag": "6a3f67e3-ca30-403f-b17c-08c9e8c882f1"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:12:42.798154 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:12:42.798154 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:12:42.818447 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-28187e66-cda3-4bc6-9a90-22e3e3a957c4 req-bd0d692c-f6da-401c-a40b-cf46abb4cea1 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:42.825588 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-28187e66-cda3-4bc6-9a90-22e3e3a957c4 req-bd0d692c-f6da-401c-a40b-cf46abb4cea1 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:42.846089 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-28187e66-cda3-4bc6-9a90-22e3e3a957c4 req-bd0d692c-f6da-401c-a40b-cf46abb4cea1 service nova] Creating event network-vif-deleted:6a3f67e3-ca30-403f-b17c-08c9e8c882f1 for instance 20b5b2d2-e5cc-4c06-9420-9fbf3569996c on nch2-master-1 Jan 15 21:12:42.862306 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-28187e66-cda3-4bc6-9a90-22e3e3a957c4 req-bd0d692c-f6da-401c-a40b-cf46abb4cea1 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069070 Jan 15 21:12:42.863468 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3075/6133] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:12:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 21:12:42.928609 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-855040a3-f811-49fa-93bc-2d771f672f9f tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:12:42.943863 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-855040a3-f811-49fa-93bc-2d771f672f9f tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/913a9b5a-dfd5-478a-9424-0114ea3a5006" status: 200 len: 1391 microversion: 2.1 time: 0.562985 Jan 15 21:12:42.949057 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3059/6134] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:12:42 2022] GET /compute/v2.1/servers/913a9b5a-dfd5-478a-9424-0114ea3a5006 => generated 1391 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:12:42.987974 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1609ee9b-26cd-4cf3-b92e-051147dcb666 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:12:42.988803 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-1609ee9b-26cd-4cf3-b92e-051147dcb666 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] [instance: 20b5b2d2-e5cc-4c06-9420-9fbf3569996c] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:12:43.006395 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1609ee9b-26cd-4cf3-b92e-051147dcb666 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:43.007002 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1609ee9b-26cd-4cf3-b92e-051147dcb666 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:43.008764 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1609ee9b-26cd-4cf3-b92e-051147dcb666 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:43.015719 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1609ee9b-26cd-4cf3-b92e-051147dcb666 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:43.113671 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1609ee9b-26cd-4cf3-b92e-051147dcb666 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:43.115637 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1609ee9b-26cd-4cf3-b92e-051147dcb666 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:43.117249 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.objects.instance [None req-1609ee9b-26cd-4cf3-b92e-051147dcb666 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lazy-loading 'fault' on Instance uuid 20b5b2d2-e5cc-4c06-9420-9fbf3569996c {{(pid=129366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 21:12:43.222079 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-1609ee9b-26cd-4cf3-b92e-051147dcb666 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6aa71a6c814c758e2a28a5d7c6e5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4a162d96614ece8caf16ccbc99ad5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:12:43.232415 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-1609ee9b-26cd-4cf3-b92e-051147dcb666 tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] 10.222.0.46 "GET /compute/v2.1/servers/20b5b2d2-e5cc-4c06-9420-9fbf3569996c" status: 200 len: 1304 microversion: 2.1 time: 0.249110 Jan 15 21:12:43.245695 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3076/6135] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:12:42 2022] GET /compute/v2.1/servers/20b5b2d2-e5cc-4c06-9420-9fbf3569996c => generated 1304 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:12:43.305572 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-9bc5f0fe-fa29-4ca3-851a-a89cb43791ed req-a9193736-38fd-43b1-810b-8b3c94660f0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "913a9b5a-dfd5-478a-9424-0114ea3a5006", "name": "network-vif-plugged", "status": "completed", "tag": "00a046e1-4575-48fc-acfb-813600567478"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:12:43.307437 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:12:43.307437 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:12:43.322175 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-9bc5f0fe-fa29-4ca3-851a-a89cb43791ed req-a9193736-38fd-43b1-810b-8b3c94660f0a service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:43.326780 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-9bc5f0fe-fa29-4ca3-851a-a89cb43791ed req-a9193736-38fd-43b1-810b-8b3c94660f0a service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:43.356067 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-9bc5f0fe-fa29-4ca3-851a-a89cb43791ed req-a9193736-38fd-43b1-810b-8b3c94660f0a service nova] Creating event network-vif-plugged:00a046e1-4575-48fc-acfb-813600567478 for instance 913a9b5a-dfd5-478a-9424-0114ea3a5006 on nch1-master-1 Jan 15 21:12:43.368952 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-9bc5f0fe-fa29-4ca3-851a-a89cb43791ed req-a9193736-38fd-43b1-810b-8b3c94660f0a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066982 Jan 15 21:12:43.374419 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3060/6136] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:12:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:12:43.966077 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-3f48a436-d854-4163-8bf4-12dfb9795ecc tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:12:43.966782 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-3f48a436-d854-4163-8bf4-12dfb9795ecc tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: 913a9b5a-dfd5-478a-9424-0114ea3a5006] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:12:43.992766 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3f48a436-d854-4163-8bf4-12dfb9795ecc tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:43.994982 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3f48a436-d854-4163-8bf4-12dfb9795ecc tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:43.996216 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3f48a436-d854-4163-8bf4-12dfb9795ecc tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:43.996657 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3f48a436-d854-4163-8bf4-12dfb9795ecc tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:44.266949 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b97747ff-6f38-45c0-a121-15fd5a6d63ab tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:12:44.267855 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b97747ff-6f38-45c0-a121-15fd5a6d63ab tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] [instance: 20b5b2d2-e5cc-4c06-9420-9fbf3569996c] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:12:44.285228 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b97747ff-6f38-45c0-a121-15fd5a6d63ab tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:44.285747 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b97747ff-6f38-45c0-a121-15fd5a6d63ab tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:44.290513 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b97747ff-6f38-45c0-a121-15fd5a6d63ab tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:44.290949 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b97747ff-6f38-45c0-a121-15fd5a6d63ab tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:44.316657 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-b97747ff-6f38-45c0-a121-15fd5a6d63ab tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] HTTP exception thrown: Instance 20b5b2d2-e5cc-4c06-9420-9fbf3569996c could not be found. Jan 15 21:12:44.323580 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b97747ff-6f38-45c0-a121-15fd5a6d63ab tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] Returning 404 to user: Instance 20b5b2d2-e5cc-4c06-9420-9fbf3569996c could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:12:44.324752 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b97747ff-6f38-45c0-a121-15fd5a6d63ab tempest-ServerRescueTestJSON-1685103139 tempest-ServerRescueTestJSON-1685103139-project] 10.222.0.46 "GET /compute/v2.1/servers/20b5b2d2-e5cc-4c06-9420-9fbf3569996c" status: 404 len: 111 microversion: 2.1 time: 0.065023 Jan 15 21:12:44.325568 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3061/6137] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:12:44 2022] GET /compute/v2.1/servers/20b5b2d2-e5cc-4c06-9420-9fbf3569996c => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 15 21:12:44.330622 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-3f48a436-d854-4163-8bf4-12dfb9795ecc tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:12:44.342518 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-3f48a436-d854-4163-8bf4-12dfb9795ecc tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/913a9b5a-dfd5-478a-9424-0114ea3a5006" status: 200 len: 1391 microversion: 2.1 time: 0.380334 Jan 15 21:12:44.355398 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3077/6138] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:12:43 2022] GET /compute/v2.1/servers/913a9b5a-dfd5-478a-9424-0114ea3a5006 => generated 1391 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:12:45.362082 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-418570f8-9f82-4376-8279-0901ad7ee3ef tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:12:45.362591 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-418570f8-9f82-4376-8279-0901ad7ee3ef tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: 913a9b5a-dfd5-478a-9424-0114ea3a5006] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:12:45.390489 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-418570f8-9f82-4376-8279-0901ad7ee3ef tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:45.390934 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-418570f8-9f82-4376-8279-0901ad7ee3ef tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:45.391742 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-418570f8-9f82-4376-8279-0901ad7ee3ef tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:45.392167 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-418570f8-9f82-4376-8279-0901ad7ee3ef tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:45.934367 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-33919ef0-820c-4865-a9cc-d7be97193efb tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Action: 'create', calling method: .version_select at 0x7f30c8eb41f0>, body: {"keypair": {"name": "tempest-TestServerBasicOps-374494054"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:12:45.955254 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-418570f8-9f82-4376-8279-0901ad7ee3ef tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:12:45.966559 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-418570f8-9f82-4376-8279-0901ad7ee3ef tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/913a9b5a-dfd5-478a-9424-0114ea3a5006" status: 200 len: 1563 microversion: 2.1 time: 0.608960 Jan 15 21:12:45.967285 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-33919ef0-820c-4865-a9cc-d7be97193efb tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Getting quotas for project 1c5c2a0c042c4bf3aa18d87ce1d003eb. Resources: {'key_pairs'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:12:45.972962 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3062/6139] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:12:45 2022] GET /compute/v2.1/servers/913a9b5a-dfd5-478a-9424-0114ea3a5006 => generated 1563 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:12:45.990273 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-33919ef0-820c-4865-a9cc-d7be97193efb tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Getting quotas for user 25467d5284f04a159432b780e0eb10d0 and project 1c5c2a0c042c4bf3aa18d87ce1d003eb. Resources: {'key_pairs'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:12:45.996872 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-36033d1f-3040-464b-959d-d366dd0e80cf tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:12:45.997912 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-36033d1f-3040-464b-959d-d366dd0e80cf tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: 913a9b5a-dfd5-478a-9424-0114ea3a5006] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:12:46.018693 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-36033d1f-3040-464b-959d-d366dd0e80cf tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:46.028265 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-36033d1f-3040-464b-959d-d366dd0e80cf tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:46.030712 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-36033d1f-3040-464b-959d-d366dd0e80cf tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:46.031506 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-36033d1f-3040-464b-959d-d366dd0e80cf tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:46.560040 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-33919ef0-820c-4865-a9cc-d7be97193efb tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Getting quotas for project 1c5c2a0c042c4bf3aa18d87ce1d003eb. Resources: {'key_pairs'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:12:46.566138 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-33919ef0-820c-4865-a9cc-d7be97193efb tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Getting quotas for user 25467d5284f04a159432b780e0eb10d0 and project 1c5c2a0c042c4bf3aa18d87ce1d003eb. Resources: {'key_pairs'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:12:46.588031 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-33919ef0-820c-4865-a9cc-d7be97193efb tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 1.058703 Jan 15 21:12:46.589221 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3078/6140] 10.222.0.46 () {60 vars in 1157 bytes} [Sat Jan 15 21:12:45 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:12:46.738267 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-36033d1f-3040-464b-959d-d366dd0e80cf tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:12:46.775076 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-36033d1f-3040-464b-959d-d366dd0e80cf tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/913a9b5a-dfd5-478a-9424-0114ea3a5006" status: 200 len: 1563 microversion: 2.1 time: 0.785063 Jan 15 21:12:46.780303 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3063/6141] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:12:45 2022] GET /compute/v2.1/servers/913a9b5a-dfd5-478a-9424-0114ea3a5006 => generated 1563 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:12:51.910418 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7eaec2a4-ec4d-4c6c-811f-19fcbad87d66 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-1962495409", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-374494054", "security_groups": [{"name": "tempest-secgroup-smoke-1541233251"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "c449301e-98ed-4b3a-8c7c-09506771241a"}]}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:12:52.069339 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.network.neutron [None req-7eaec2a4-ec4d-4c6c-811f-19fcbad87d66 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] validate_networks() for [('c449301e-98ed-4b3a-8c7c-09506771241a', None, None, None, None, None)] {{(pid=129366) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 21:12:52.698548 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-7eaec2a4-ec4d-4c6c-811f-19fcbad87d66 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Getting quotas for project 1c5c2a0c042c4bf3aa18d87ce1d003eb. Resources: dict_keys(['metadata_items']) {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:12:52.726094 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-7eaec2a4-ec4d-4c6c-811f-19fcbad87d66 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Getting quotas for user 25467d5284f04a159432b780e0eb10d0 and project 1c5c2a0c042c4bf3aa18d87ce1d003eb. Resources: dict_keys(['metadata_items']) {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:12:52.764125 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-7eaec2a4-ec4d-4c6c-811f-19fcbad87d66 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Flavor limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 21:12:52.764746 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-7eaec2a4-ec4d-4c6c-811f-19fcbad87d66 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Image limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 21:12:52.765404 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-7eaec2a4-ec4d-4c6c-811f-19fcbad87d66 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Flavor pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 21:12:52.766223 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-7eaec2a4-ec4d-4c6c-811f-19fcbad87d66 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Image pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 21:12:52.767081 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-7eaec2a4-ec4d-4c6c-811f-19fcbad87d66 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 21:12:52.784597 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7eaec2a4-ec4d-4c6c-811f-19fcbad87d66 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:52.785072 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7eaec2a4-ec4d-4c6c-811f-19fcbad87d66 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:52.786330 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7eaec2a4-ec4d-4c6c-811f-19fcbad87d66 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:52.786330 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7eaec2a4-ec4d-4c6c-811f-19fcbad87d66 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:52.818334 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-7eaec2a4-ec4d-4c6c-811f-19fcbad87d66 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Getting quotas for project 1c5c2a0c042c4bf3aa18d87ce1d003eb. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:12:52.825832 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-7eaec2a4-ec4d-4c6c-811f-19fcbad87d66 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Getting quotas for user 25467d5284f04a159432b780e0eb10d0 and project 1c5c2a0c042c4bf3aa18d87ce1d003eb. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:12:52.845852 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-7eaec2a4-ec4d-4c6c-811f-19fcbad87d66 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Going to run 1 instances... {{(pid=129366) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 21:12:52.853382 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-7eaec2a4-ec4d-4c6c-811f-19fcbad87d66 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] [instance: abffb1a6-17ea-4e1a-9218-4339c3407c3c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 21:12:52.959720 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7eaec2a4-ec4d-4c6c-811f-19fcbad87d66 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.051804 Jan 15 21:12:52.962865 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3079/6142] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 21:12:51 2022] POST /compute/v2.1/servers => generated 406 bytes in 1057 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 21:12:52.971555 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-99d092c3-fd71-4dcf-b377-0b0a0f2af5b8 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:12:52.972167 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-99d092c3-fd71-4dcf-b377-0b0a0f2af5b8 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] [instance: abffb1a6-17ea-4e1a-9218-4339c3407c3c] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:12:53.087849 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-99d092c3-fd71-4dcf-b377-0b0a0f2af5b8 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25467d5284f04a159432b780e0eb10d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c5c2a0c042c4bf3aa18d87ce1d003eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:12:53.099902 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-99d092c3-fd71-4dcf-b377-0b0a0f2af5b8 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] 10.222.0.46 "GET /compute/v2.1/servers/abffb1a6-17ea-4e1a-9218-4339c3407c3c" status: 200 len: 1302 microversion: 2.1 time: 0.131834 Jan 15 21:12:53.100655 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3064/6143] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:12:52 2022] GET /compute/v2.1/servers/abffb1a6-17ea-4e1a-9218-4339c3407c3c => generated 1302 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:12:54.128785 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ba5495bc-3ee1-465b-9eb6-258b9d7fd9ee tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:12:54.129499 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ba5495bc-3ee1-465b-9eb6-258b9d7fd9ee tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] [instance: abffb1a6-17ea-4e1a-9218-4339c3407c3c] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:12:54.143742 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ba5495bc-3ee1-465b-9eb6-258b9d7fd9ee tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:54.147704 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ba5495bc-3ee1-465b-9eb6-258b9d7fd9ee tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:54.150076 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ba5495bc-3ee1-465b-9eb6-258b9d7fd9ee tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:54.152384 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ba5495bc-3ee1-465b-9eb6-258b9d7fd9ee tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:54.335662 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-ba5495bc-3ee1-465b-9eb6-258b9d7fd9ee tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25467d5284f04a159432b780e0eb10d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c5c2a0c042c4bf3aa18d87ce1d003eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:12:54.350186 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ba5495bc-3ee1-465b-9eb6-258b9d7fd9ee tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] 10.222.0.46 "GET /compute/v2.1/servers/abffb1a6-17ea-4e1a-9218-4339c3407c3c" status: 200 len: 1354 microversion: 2.1 time: 0.234380 Jan 15 21:12:54.363772 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3080/6144] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:12:54 2022] GET /compute/v2.1/servers/abffb1a6-17ea-4e1a-9218-4339c3407c3c => generated 1354 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:12:55.370467 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-22ec2f8b-b4be-44f8-902c-5a3849713018 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:12:55.374743 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-22ec2f8b-b4be-44f8-902c-5a3849713018 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] [instance: abffb1a6-17ea-4e1a-9218-4339c3407c3c] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:12:55.385876 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-22ec2f8b-b4be-44f8-902c-5a3849713018 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:55.386787 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-22ec2f8b-b4be-44f8-902c-5a3849713018 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:55.387847 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-22ec2f8b-b4be-44f8-902c-5a3849713018 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:55.388521 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-22ec2f8b-b4be-44f8-902c-5a3849713018 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:55.912622 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-22ec2f8b-b4be-44f8-902c-5a3849713018 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25467d5284f04a159432b780e0eb10d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c5c2a0c042c4bf3aa18d87ce1d003eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:12:55.926367 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-22ec2f8b-b4be-44f8-902c-5a3849713018 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] 10.222.0.46 "GET /compute/v2.1/servers/abffb1a6-17ea-4e1a-9218-4339c3407c3c" status: 200 len: 1360 microversion: 2.1 time: 0.560810 Jan 15 21:12:55.927348 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3065/6145] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:12:55 2022] GET /compute/v2.1/servers/abffb1a6-17ea-4e1a-9218-4339c3407c3c => generated 1360 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:12:56.943714 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-daf5e3ea-ab77-49bb-8a46-685d73477171 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:12:56.945591 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-daf5e3ea-ab77-49bb-8a46-685d73477171 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] [instance: abffb1a6-17ea-4e1a-9218-4339c3407c3c] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:12:56.956719 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-daf5e3ea-ab77-49bb-8a46-685d73477171 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:56.957914 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-daf5e3ea-ab77-49bb-8a46-685d73477171 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:56.961782 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-daf5e3ea-ab77-49bb-8a46-685d73477171 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:56.962503 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-daf5e3ea-ab77-49bb-8a46-685d73477171 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:57.087102 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-daf5e3ea-ab77-49bb-8a46-685d73477171 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25467d5284f04a159432b780e0eb10d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c5c2a0c042c4bf3aa18d87ce1d003eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:12:57.097865 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-daf5e3ea-ab77-49bb-8a46-685d73477171 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] 10.222.0.46 "GET /compute/v2.1/servers/abffb1a6-17ea-4e1a-9218-4339c3407c3c" status: 200 len: 1360 microversion: 2.1 time: 0.157874 Jan 15 21:12:57.105096 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3081/6146] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:12:56 2022] GET /compute/v2.1/servers/abffb1a6-17ea-4e1a-9218-4339c3407c3c => generated 1360 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:12:57.134888 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-150de3ca-9373-49ac-89a9-22fe67139278 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:12:57.141592 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-150de3ca-9373-49ac-89a9-22fe67139278 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: 913a9b5a-dfd5-478a-9424-0114ea3a5006] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:12:57.152188 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-6cb6eaac-d1af-465f-82ef-fe7f642e1267 req-d88e763e-e28e-489e-be24-b4694265e4dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "913a9b5a-dfd5-478a-9424-0114ea3a5006", "tag": "00a046e1-4575-48fc-acfb-813600567478"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:12:57.155729 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:12:57.155729 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:12:57.189192 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-150de3ca-9373-49ac-89a9-22fe67139278 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:57.191892 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-150de3ca-9373-49ac-89a9-22fe67139278 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:57.192713 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-6cb6eaac-d1af-465f-82ef-fe7f642e1267 req-d88e763e-e28e-489e-be24-b4694265e4dd service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:57.194660 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-6cb6eaac-d1af-465f-82ef-fe7f642e1267 req-d88e763e-e28e-489e-be24-b4694265e4dd service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:57.203590 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-150de3ca-9373-49ac-89a9-22fe67139278 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:57.205768 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-150de3ca-9373-49ac-89a9-22fe67139278 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:57.273556 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-6cb6eaac-d1af-465f-82ef-fe7f642e1267 req-d88e763e-e28e-489e-be24-b4694265e4dd service nova] Creating event network-changed:00a046e1-4575-48fc-acfb-813600567478 for instance 913a9b5a-dfd5-478a-9424-0114ea3a5006 on nch1-master-1 Jan 15 21:12:57.298645 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-6cb6eaac-d1af-465f-82ef-fe7f642e1267 req-d88e763e-e28e-489e-be24-b4694265e4dd service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.149526 Jan 15 21:12:57.299518 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3082/6147] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:12:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:12:58.119819 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-5b4b465a-fe0f-4a2b-8dbf-63ddb72d9ba6 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:12:58.120557 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-5b4b465a-fe0f-4a2b-8dbf-63ddb72d9ba6 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] [instance: abffb1a6-17ea-4e1a-9218-4339c3407c3c] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:12:58.148982 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5b4b465a-fe0f-4a2b-8dbf-63ddb72d9ba6 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:58.149734 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5b4b465a-fe0f-4a2b-8dbf-63ddb72d9ba6 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:58.152044 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5b4b465a-fe0f-4a2b-8dbf-63ddb72d9ba6 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:58.154449 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5b4b465a-fe0f-4a2b-8dbf-63ddb72d9ba6 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:58.233472 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-150de3ca-9373-49ac-89a9-22fe67139278 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:12:58.255356 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-150de3ca-9373-49ac-89a9-22fe67139278 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/913a9b5a-dfd5-478a-9424-0114ea3a5006" status: 200 len: 1563 microversion: 2.1 time: 1.122899 Jan 15 21:12:58.274505 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3066/6148] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:12:57 2022] GET /compute/v2.1/servers/913a9b5a-dfd5-478a-9424-0114ea3a5006 => generated 1563 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:12:58.287035 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-5b4b465a-fe0f-4a2b-8dbf-63ddb72d9ba6 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25467d5284f04a159432b780e0eb10d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c5c2a0c042c4bf3aa18d87ce1d003eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:12:58.306761 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-5b4b465a-fe0f-4a2b-8dbf-63ddb72d9ba6 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] 10.222.0.46 "GET /compute/v2.1/servers/abffb1a6-17ea-4e1a-9218-4339c3407c3c" status: 200 len: 1360 microversion: 2.1 time: 0.194434 Jan 15 21:12:58.309081 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3083/6149] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:12:58 2022] GET /compute/v2.1/servers/abffb1a6-17ea-4e1a-9218-4339c3407c3c => generated 1360 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:12:59.327675 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-82b46f4a-0f2f-44f7-97be-b54613d82154 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:12:59.328880 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-82b46f4a-0f2f-44f7-97be-b54613d82154 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] [instance: abffb1a6-17ea-4e1a-9218-4339c3407c3c] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:12:59.354111 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-82b46f4a-0f2f-44f7-97be-b54613d82154 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:59.354973 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-82b46f4a-0f2f-44f7-97be-b54613d82154 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:59.356009 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-82b46f4a-0f2f-44f7-97be-b54613d82154 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:59.358623 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-82b46f4a-0f2f-44f7-97be-b54613d82154 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:59.472668 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-4fab500f-c62b-4b9b-9190-285ff6070eb3 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-289993086", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "networks": "none"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:12:59.586645 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-4fab500f-c62b-4b9b-9190-285ff6070eb3 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Flavor limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 21:12:59.589014 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-4fab500f-c62b-4b9b-9190-285ff6070eb3 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Image limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 21:12:59.593011 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-4fab500f-c62b-4b9b-9190-285ff6070eb3 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Flavor pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 21:12:59.595411 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-4fab500f-c62b-4b9b-9190-285ff6070eb3 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Image pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 21:12:59.597157 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-4fab500f-c62b-4b9b-9190-285ff6070eb3 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 21:12:59.625533 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4fab500f-c62b-4b9b-9190-285ff6070eb3 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:59.627432 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4fab500f-c62b-4b9b-9190-285ff6070eb3 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:59.631355 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-82b46f4a-0f2f-44f7-97be-b54613d82154 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25467d5284f04a159432b780e0eb10d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c5c2a0c042c4bf3aa18d87ce1d003eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:12:59.640185 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4fab500f-c62b-4b9b-9190-285ff6070eb3 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:12:59.648293 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4fab500f-c62b-4b9b-9190-285ff6070eb3 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:12:59.652149 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-82b46f4a-0f2f-44f7-97be-b54613d82154 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] 10.222.0.46 "GET /compute/v2.1/servers/abffb1a6-17ea-4e1a-9218-4339c3407c3c" status: 200 len: 1360 microversion: 2.1 time: 0.332306 Jan 15 21:12:59.655868 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3084/6150] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:12:59 2022] GET /compute/v2.1/servers/abffb1a6-17ea-4e1a-9218-4339c3407c3c => generated 1360 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:12:59.702009 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-4fab500f-c62b-4b9b-9190-285ff6070eb3 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Getting quotas for project 52caab26f74c4651baf8c681c316c08e. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:12:59.717633 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-4fab500f-c62b-4b9b-9190-285ff6070eb3 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Getting quotas for user b97ba840be5947569b6c0edf81b76d16 and project 52caab26f74c4651baf8c681c316c08e. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:12:59.751929 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-4fab500f-c62b-4b9b-9190-285ff6070eb3 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Going to run 1 instances... {{(pid=129365) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 21:12:59.758629 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-4fab500f-c62b-4b9b-9190-285ff6070eb3 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] [instance: 6dbb87c7-d73f-4af4-82f5-3ff4396a3cee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129365) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 21:12:59.877918 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-4fab500f-c62b-4b9b-9190-285ff6070eb3 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.733021 Jan 15 21:12:59.878852 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3067/6151] 10.222.0.46 () {62 vars in 1187 bytes} [Sat Jan 15 21:12:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 735 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jan 15 21:12:59.890363 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-df2f4f3f-915a-4f5b-942f-c0e54f9ade54 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:12:59.891151 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-df2f4f3f-915a-4f5b-942f-c0e54f9ade54 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] [instance: 6dbb87c7-d73f-4af4-82f5-3ff4396a3cee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:13:00.226050 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-df2f4f3f-915a-4f5b-942f-c0e54f9ade54 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97ba840be5947569b6c0edf81b76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52caab26f74c4651baf8c681c316c08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:00.238396 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-df2f4f3f-915a-4f5b-942f-c0e54f9ade54 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97ba840be5947569b6c0edf81b76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52caab26f74c4651baf8c681c316c08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:00.257673 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-df2f4f3f-915a-4f5b-942f-c0e54f9ade54 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97ba840be5947569b6c0edf81b76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52caab26f74c4651baf8c681c316c08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:00.261838 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-df2f4f3f-915a-4f5b-942f-c0e54f9ade54 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] 10.222.0.46 "GET /compute/v2.1/servers/6dbb87c7-d73f-4af4-82f5-3ff4396a3cee" status: 200 len: 1277 microversion: 2.47 time: 0.373523 Jan 15 21:13:00.264375 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3085/6152] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:12:59 2022] GET /compute/v2.1/servers/6dbb87c7-d73f-4af4-82f5-3ff4396a3cee => generated 1277 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:13:00.531131 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-319c03d2-cd4d-4833-94b4-242fcc5373f3 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-277123431", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "networks": "none"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:13:00.654186 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-319c03d2-cd4d-4833-94b4-242fcc5373f3 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Flavor limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 21:13:00.654714 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-319c03d2-cd4d-4833-94b4-242fcc5373f3 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Image limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 21:13:00.655442 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-319c03d2-cd4d-4833-94b4-242fcc5373f3 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Flavor pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 21:13:00.656075 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-319c03d2-cd4d-4833-94b4-242fcc5373f3 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Image pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 21:13:00.656709 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-319c03d2-cd4d-4833-94b4-242fcc5373f3 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 21:13:00.674527 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a48bd018-cb10-4137-a275-4a184b77cf15 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:13:00.675136 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a48bd018-cb10-4137-a275-4a184b77cf15 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] [instance: abffb1a6-17ea-4e1a-9218-4339c3407c3c] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:13:00.686105 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-319c03d2-cd4d-4833-94b4-242fcc5373f3 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:00.686908 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-319c03d2-cd4d-4833-94b4-242fcc5373f3 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:00.689872 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-319c03d2-cd4d-4833-94b4-242fcc5373f3 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:00.690592 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-319c03d2-cd4d-4833-94b4-242fcc5373f3 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:00.700636 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a48bd018-cb10-4137-a275-4a184b77cf15 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:00.703789 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a48bd018-cb10-4137-a275-4a184b77cf15 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:00.707806 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a48bd018-cb10-4137-a275-4a184b77cf15 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:00.713609 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a48bd018-cb10-4137-a275-4a184b77cf15 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:00.737469 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-319c03d2-cd4d-4833-94b4-242fcc5373f3 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Getting quotas for project 52caab26f74c4651baf8c681c316c08e. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:13:00.747733 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-319c03d2-cd4d-4833-94b4-242fcc5373f3 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Getting quotas for user b97ba840be5947569b6c0edf81b76d16 and project 52caab26f74c4651baf8c681c316c08e. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:13:00.776226 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-319c03d2-cd4d-4833-94b4-242fcc5373f3 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Going to run 1 instances... {{(pid=129365) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 21:13:00.784953 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-319c03d2-cd4d-4833-94b4-242fcc5373f3 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] [instance: b901c166-bba5-475c-a495-e92321720bb5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129365) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 21:13:00.890889 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-319c03d2-cd4d-4833-94b4-242fcc5373f3 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.364583 Jan 15 21:13:00.892140 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3068/6153] 10.222.0.46 () {62 vars in 1187 bytes} [Sat Jan 15 21:13:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 367 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jan 15 21:13:00.902572 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b1a7a643-efba-4ff3-bf8c-5949dc637984 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:13:00.903855 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b1a7a643-efba-4ff3-bf8c-5949dc637984 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] [instance: b901c166-bba5-475c-a495-e92321720bb5] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:13:01.055531 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b1a7a643-efba-4ff3-bf8c-5949dc637984 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] 10.222.0.46 "PUT /compute/v2.1/servers/b901c166-bba5-475c-a495-e92321720bb5" status: 200 len: 991 microversion: 2.47 time: 0.157546 Jan 15 21:13:01.068990 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3069/6154] 10.222.0.46 () {62 vars in 1296 bytes} [Sat Jan 15 21:13:00 2022] PUT /compute/v2.1/servers/b901c166-bba5-475c-a495-e92321720bb5 => generated 991 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:13:01.075051 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-4f37960f-e240-49a7-8597-ae3077bc24ac tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:13:01.075793 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-4f37960f-e240-49a7-8597-ae3077bc24ac tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] [instance: b901c166-bba5-475c-a495-e92321720bb5] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:13:01.476388 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-4f37960f-e240-49a7-8597-ae3077bc24ac tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97ba840be5947569b6c0edf81b76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52caab26f74c4651baf8c681c316c08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:01.486281 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-4f37960f-e240-49a7-8597-ae3077bc24ac tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97ba840be5947569b6c0edf81b76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52caab26f74c4651baf8c681c316c08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:01.489617 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-4f37960f-e240-49a7-8597-ae3077bc24ac tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97ba840be5947569b6c0edf81b76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52caab26f74c4651baf8c681c316c08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:01.490646 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-a48bd018-cb10-4137-a275-4a184b77cf15 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25467d5284f04a159432b780e0eb10d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c5c2a0c042c4bf3aa18d87ce1d003eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:01.494949 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-4f37960f-e240-49a7-8597-ae3077bc24ac tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] 10.222.0.46 "GET /compute/v2.1/servers/b901c166-bba5-475c-a495-e92321720bb5" status: 200 len: 1277 microversion: 2.47 time: 0.421891 Jan 15 21:13:01.496558 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3070/6155] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:13:01 2022] GET /compute/v2.1/servers/b901c166-bba5-475c-a495-e92321720bb5 => generated 1277 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:13:01.501485 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a48bd018-cb10-4137-a275-4a184b77cf15 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] 10.222.0.46 "GET /compute/v2.1/servers/abffb1a6-17ea-4e1a-9218-4339c3407c3c" status: 200 len: 1428 microversion: 2.1 time: 0.830469 Jan 15 21:13:01.502801 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3086/6156] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:13:00 2022] GET /compute/v2.1/servers/abffb1a6-17ea-4e1a-9218-4339c3407c3c => generated 1428 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:13:02.524748 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-804962e1-865e-40c8-8a5a-b8c1f5a197f7 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:13:02.530777 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d7dc29b6-aa9c-4e46-bb39-a147451c8d43 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:13:02.533067 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-d7dc29b6-aa9c-4e46-bb39-a147451c8d43 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] [instance: abffb1a6-17ea-4e1a-9218-4339c3407c3c] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:13:02.534200 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-804962e1-865e-40c8-8a5a-b8c1f5a197f7 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] [instance: b901c166-bba5-475c-a495-e92321720bb5] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:13:02.566348 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d7dc29b6-aa9c-4e46-bb39-a147451c8d43 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:02.578610 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-804962e1-865e-40c8-8a5a-b8c1f5a197f7 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:02.579088 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-804962e1-865e-40c8-8a5a-b8c1f5a197f7 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:02.579953 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-804962e1-865e-40c8-8a5a-b8c1f5a197f7 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:02.580397 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-804962e1-865e-40c8-8a5a-b8c1f5a197f7 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:02.584547 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d7dc29b6-aa9c-4e46-bb39-a147451c8d43 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:02.584754 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d7dc29b6-aa9c-4e46-bb39-a147451c8d43 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:02.585390 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d7dc29b6-aa9c-4e46-bb39-a147451c8d43 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:03.039942 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-804962e1-865e-40c8-8a5a-b8c1f5a197f7 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97ba840be5947569b6c0edf81b76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52caab26f74c4651baf8c681c316c08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:03.053486 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-804962e1-865e-40c8-8a5a-b8c1f5a197f7 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97ba840be5947569b6c0edf81b76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52caab26f74c4651baf8c681c316c08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:03.055860 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-804962e1-865e-40c8-8a5a-b8c1f5a197f7 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97ba840be5947569b6c0edf81b76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52caab26f74c4651baf8c681c316c08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:03.057495 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-804962e1-865e-40c8-8a5a-b8c1f5a197f7 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] 10.222.0.46 "GET /compute/v2.1/servers/b901c166-bba5-475c-a495-e92321720bb5" status: 200 len: 1273 microversion: 2.47 time: 0.537134 Jan 15 21:13:03.058406 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3071/6157] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:13:02 2022] GET /compute/v2.1/servers/b901c166-bba5-475c-a495-e92321720bb5 => generated 1273 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:13:03.380019 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-d7dc29b6-aa9c-4e46-bb39-a147451c8d43 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25467d5284f04a159432b780e0eb10d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c5c2a0c042c4bf3aa18d87ce1d003eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:03.391136 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d7dc29b6-aa9c-4e46-bb39-a147451c8d43 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] 10.222.0.46 "GET /compute/v2.1/servers/abffb1a6-17ea-4e1a-9218-4339c3407c3c" status: 200 len: 1428 microversion: 2.1 time: 0.874333 Jan 15 21:13:03.392327 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3087/6158] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:13:02 2022] GET /compute/v2.1/servers/abffb1a6-17ea-4e1a-9218-4339c3407c3c => generated 1428 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:13:03.507927 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-6853935e-43ca-416b-9c20-b2909cb5300d req-451ecb2f-b3ca-40dd-af33-8c4fcac4e89b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "abffb1a6-17ea-4e1a-9218-4339c3407c3c", "tag": "87023fcd-0a43-4fa7-a414-0a614f09ac8e"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:13:03.509658 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:13:03.509658 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:13:03.525751 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-6853935e-43ca-416b-9c20-b2909cb5300d req-451ecb2f-b3ca-40dd-af33-8c4fcac4e89b service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:03.526417 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-6853935e-43ca-416b-9c20-b2909cb5300d req-451ecb2f-b3ca-40dd-af33-8c4fcac4e89b service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:03.571324 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-6853935e-43ca-416b-9c20-b2909cb5300d req-451ecb2f-b3ca-40dd-af33-8c4fcac4e89b service nova] Creating event network-changed:87023fcd-0a43-4fa7-a414-0a614f09ac8e for instance abffb1a6-17ea-4e1a-9218-4339c3407c3c on nch2-master-1 Jan 15 21:13:03.587459 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-6853935e-43ca-416b-9c20-b2909cb5300d req-451ecb2f-b3ca-40dd-af33-8c4fcac4e89b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083900 Jan 15 21:13:03.587990 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3072/6159] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:13:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:13:04.080796 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f87524aa-e80f-409b-b4aa-7e2e939d32c0 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:13:04.082373 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f87524aa-e80f-409b-b4aa-7e2e939d32c0 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] [instance: b901c166-bba5-475c-a495-e92321720bb5] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:13:04.109816 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f87524aa-e80f-409b-b4aa-7e2e939d32c0 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:04.111027 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f87524aa-e80f-409b-b4aa-7e2e939d32c0 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:04.112189 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f87524aa-e80f-409b-b4aa-7e2e939d32c0 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:04.112969 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f87524aa-e80f-409b-b4aa-7e2e939d32c0 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:04.411119 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5594855d-7726-4c12-9437-b116aea1f930 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:13:04.412059 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-5594855d-7726-4c12-9437-b116aea1f930 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] [instance: abffb1a6-17ea-4e1a-9218-4339c3407c3c] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:13:04.436603 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5594855d-7726-4c12-9437-b116aea1f930 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:04.437117 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5594855d-7726-4c12-9437-b116aea1f930 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:04.437932 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5594855d-7726-4c12-9437-b116aea1f930 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:04.438375 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5594855d-7726-4c12-9437-b116aea1f930 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:04.647241 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-f87524aa-e80f-409b-b4aa-7e2e939d32c0 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97ba840be5947569b6c0edf81b76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52caab26f74c4651baf8c681c316c08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:04.663846 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-f87524aa-e80f-409b-b4aa-7e2e939d32c0 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97ba840be5947569b6c0edf81b76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52caab26f74c4651baf8c681c316c08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:04.667231 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-f87524aa-e80f-409b-b4aa-7e2e939d32c0 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97ba840be5947569b6c0edf81b76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52caab26f74c4651baf8c681c316c08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:04.668660 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f87524aa-e80f-409b-b4aa-7e2e939d32c0 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] 10.222.0.46 "GET /compute/v2.1/servers/b901c166-bba5-475c-a495-e92321720bb5" status: 200 len: 1335 microversion: 2.47 time: 0.592468 Jan 15 21:13:04.670069 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3088/6160] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:13:04 2022] GET /compute/v2.1/servers/b901c166-bba5-475c-a495-e92321720bb5 => generated 1335 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:13:05.073063 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-5594855d-7726-4c12-9437-b116aea1f930 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25467d5284f04a159432b780e0eb10d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c5c2a0c042c4bf3aa18d87ce1d003eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:05.092557 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5594855d-7726-4c12-9437-b116aea1f930 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] 10.222.0.46 "GET /compute/v2.1/servers/abffb1a6-17ea-4e1a-9218-4339c3407c3c" status: 200 len: 1428 microversion: 2.1 time: 0.687313 Jan 15 21:13:05.094311 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3073/6161] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:13:04 2022] GET /compute/v2.1/servers/abffb1a6-17ea-4e1a-9218-4339c3407c3c => generated 1428 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:13:05.699455 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-5c172076-1f8f-466c-86f1-bdbb687b5d7d tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:13:05.700508 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-5c172076-1f8f-466c-86f1-bdbb687b5d7d tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] [instance: b901c166-bba5-475c-a495-e92321720bb5] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:13:05.718012 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5c172076-1f8f-466c-86f1-bdbb687b5d7d tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:05.722787 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5c172076-1f8f-466c-86f1-bdbb687b5d7d tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:05.724434 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5c172076-1f8f-466c-86f1-bdbb687b5d7d tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:05.724928 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5c172076-1f8f-466c-86f1-bdbb687b5d7d tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:05.839525 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-5c172076-1f8f-466c-86f1-bdbb687b5d7d tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97ba840be5947569b6c0edf81b76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52caab26f74c4651baf8c681c316c08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:05.872975 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-5c172076-1f8f-466c-86f1-bdbb687b5d7d tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97ba840be5947569b6c0edf81b76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52caab26f74c4651baf8c681c316c08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:05.876560 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-5c172076-1f8f-466c-86f1-bdbb687b5d7d tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97ba840be5947569b6c0edf81b76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52caab26f74c4651baf8c681c316c08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:05.886979 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-5c172076-1f8f-466c-86f1-bdbb687b5d7d tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] 10.222.0.46 "GET /compute/v2.1/servers/b901c166-bba5-475c-a495-e92321720bb5" status: 200 len: 1335 microversion: 2.47 time: 0.196528 Jan 15 21:13:05.889085 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3089/6162] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:13:05 2022] GET /compute/v2.1/servers/b901c166-bba5-475c-a495-e92321720bb5 => generated 1335 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:13:06.111149 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-11fc6894-5bbc-4ee6-9b1d-5d17df701d9e tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:13:06.111757 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-11fc6894-5bbc-4ee6-9b1d-5d17df701d9e tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] [instance: abffb1a6-17ea-4e1a-9218-4339c3407c3c] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:13:06.134147 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-11fc6894-5bbc-4ee6-9b1d-5d17df701d9e tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:06.135027 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-11fc6894-5bbc-4ee6-9b1d-5d17df701d9e tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:06.135869 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-11fc6894-5bbc-4ee6-9b1d-5d17df701d9e tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:06.138706 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-11fc6894-5bbc-4ee6-9b1d-5d17df701d9e tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:06.862721 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-11fc6894-5bbc-4ee6-9b1d-5d17df701d9e tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25467d5284f04a159432b780e0eb10d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c5c2a0c042c4bf3aa18d87ce1d003eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:06.871999 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-11fc6894-5bbc-4ee6-9b1d-5d17df701d9e tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] 10.222.0.46 "GET /compute/v2.1/servers/abffb1a6-17ea-4e1a-9218-4339c3407c3c" status: 200 len: 1428 microversion: 2.1 time: 0.765155 Jan 15 21:13:06.872927 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3074/6163] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:13:06 2022] GET /compute/v2.1/servers/abffb1a6-17ea-4e1a-9218-4339c3407c3c => generated 1428 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:13:06.909775 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-cb9237af-ec7e-4139-b522-3ac97c542f29 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:13:06.910388 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-cb9237af-ec7e-4139-b522-3ac97c542f29 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] [instance: b901c166-bba5-475c-a495-e92321720bb5] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:13:06.932503 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cb9237af-ec7e-4139-b522-3ac97c542f29 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:06.934799 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cb9237af-ec7e-4139-b522-3ac97c542f29 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:06.941838 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cb9237af-ec7e-4139-b522-3ac97c542f29 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:06.942484 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cb9237af-ec7e-4139-b522-3ac97c542f29 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:07.114748 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-cb9237af-ec7e-4139-b522-3ac97c542f29 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97ba840be5947569b6c0edf81b76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52caab26f74c4651baf8c681c316c08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:07.123401 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-cb9237af-ec7e-4139-b522-3ac97c542f29 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97ba840be5947569b6c0edf81b76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52caab26f74c4651baf8c681c316c08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:07.125207 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-cb9237af-ec7e-4139-b522-3ac97c542f29 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97ba840be5947569b6c0edf81b76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52caab26f74c4651baf8c681c316c08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:07.129508 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-cb9237af-ec7e-4139-b522-3ac97c542f29 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] 10.222.0.46 "GET /compute/v2.1/servers/b901c166-bba5-475c-a495-e92321720bb5" status: 200 len: 1356 microversion: 2.47 time: 0.221745 Jan 15 21:13:07.130913 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3090/6164] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:13:06 2022] GET /compute/v2.1/servers/b901c166-bba5-475c-a495-e92321720bb5 => generated 1356 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:13:07.153206 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-7b616819-389d-4f62-87c1-25669a260872 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:13:07.156973 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-7b616819-389d-4f62-87c1-25669a260872 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] [instance: b901c166-bba5-475c-a495-e92321720bb5] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:13:07.186153 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7b616819-389d-4f62-87c1-25669a260872 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:07.186614 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7b616819-389d-4f62-87c1-25669a260872 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:07.188250 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7b616819-389d-4f62-87c1-25669a260872 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:07.188633 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7b616819-389d-4f62-87c1-25669a260872 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:07.343733 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-7b616819-389d-4f62-87c1-25669a260872 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Flavor limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 21:13:07.344918 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-7b616819-389d-4f62-87c1-25669a260872 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Image limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 21:13:07.360983 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-7b616819-389d-4f62-87c1-25669a260872 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Flavor pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 21:13:07.361419 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-7b616819-389d-4f62-87c1-25669a260872 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Image pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 21:13:07.361823 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-7b616819-389d-4f62-87c1-25669a260872 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 21:13:07.464169 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-7b616819-389d-4f62-87c1-25669a260872 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] [instance: b901c166-bba5-475c-a495-e92321720bb5] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:13:07.479156 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7b616819-389d-4f62-87c1-25669a260872 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:07.482968 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7b616819-389d-4f62-87c1-25669a260872 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:07.486301 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7b616819-389d-4f62-87c1-25669a260872 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:07.486963 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7b616819-389d-4f62-87c1-25669a260872 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:07.562955 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-7b616819-389d-4f62-87c1-25669a260872 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] 10.222.0.46 "POST /compute/v2.1/servers/b901c166-bba5-475c-a495-e92321720bb5/action" status: 202 len: 1078 microversion: 2.47 time: 0.417761 Jan 15 21:13:07.568734 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3075/6165] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jan 15 21:13:07 2022] POST /compute/v2.1/servers/b901c166-bba5-475c-a495-e92321720bb5/action => generated 1078 bytes in 424 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jan 15 21:13:07.588533 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-66c0b7f1-3412-41de-91f8-ad6d8657e77d tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:13:07.591394 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-66c0b7f1-3412-41de-91f8-ad6d8657e77d tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] [instance: b901c166-bba5-475c-a495-e92321720bb5] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:13:07.604714 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-66c0b7f1-3412-41de-91f8-ad6d8657e77d tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:07.605588 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-66c0b7f1-3412-41de-91f8-ad6d8657e77d tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:07.608966 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-66c0b7f1-3412-41de-91f8-ad6d8657e77d tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:07.610736 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-66c0b7f1-3412-41de-91f8-ad6d8657e77d tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:07.766254 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-66c0b7f1-3412-41de-91f8-ad6d8657e77d tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97ba840be5947569b6c0edf81b76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52caab26f74c4651baf8c681c316c08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:07.778295 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-66c0b7f1-3412-41de-91f8-ad6d8657e77d tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97ba840be5947569b6c0edf81b76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52caab26f74c4651baf8c681c316c08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:07.789689 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-66c0b7f1-3412-41de-91f8-ad6d8657e77d tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97ba840be5947569b6c0edf81b76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52caab26f74c4651baf8c681c316c08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:07.791091 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-66c0b7f1-3412-41de-91f8-ad6d8657e77d tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] 10.222.0.46 "GET /compute/v2.1/servers/b901c166-bba5-475c-a495-e92321720bb5" status: 200 len: 1365 microversion: 2.47 time: 0.214828 Jan 15 21:13:07.791766 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3091/6166] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:13:07 2022] GET /compute/v2.1/servers/b901c166-bba5-475c-a495-e92321720bb5 => generated 1365 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:13:07.889015 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-6de25a8e-0b4d-4818-b192-63bc6b044655 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:13:07.889640 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-6de25a8e-0b4d-4818-b192-63bc6b044655 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] [instance: abffb1a6-17ea-4e1a-9218-4339c3407c3c] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:13:07.899628 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6de25a8e-0b4d-4818-b192-63bc6b044655 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:07.900091 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6de25a8e-0b4d-4818-b192-63bc6b044655 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:07.902407 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6de25a8e-0b4d-4818-b192-63bc6b044655 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:07.906451 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6de25a8e-0b4d-4818-b192-63bc6b044655 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:08.252536 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-6de25a8e-0b4d-4818-b192-63bc6b044655 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25467d5284f04a159432b780e0eb10d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c5c2a0c042c4bf3aa18d87ce1d003eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:08.267042 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-6de25a8e-0b4d-4818-b192-63bc6b044655 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] 10.222.0.46 "GET /compute/v2.1/servers/abffb1a6-17ea-4e1a-9218-4339c3407c3c" status: 200 len: 1428 microversion: 2.1 time: 0.381612 Jan 15 21:13:08.278727 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3076/6167] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:13:07 2022] GET /compute/v2.1/servers/abffb1a6-17ea-4e1a-9218-4339c3407c3c => generated 1428 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:13:08.815854 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-37cafa3b-4000-4fa1-8645-24a308d621ea tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:13:08.816348 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-37cafa3b-4000-4fa1-8645-24a308d621ea tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] [instance: b901c166-bba5-475c-a495-e92321720bb5] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:13:08.829957 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-37cafa3b-4000-4fa1-8645-24a308d621ea tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:08.832014 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-37cafa3b-4000-4fa1-8645-24a308d621ea tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:08.833230 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-37cafa3b-4000-4fa1-8645-24a308d621ea tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:08.834154 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-37cafa3b-4000-4fa1-8645-24a308d621ea tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:08.931307 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-37cafa3b-4000-4fa1-8645-24a308d621ea tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97ba840be5947569b6c0edf81b76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52caab26f74c4651baf8c681c316c08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:08.943666 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-37cafa3b-4000-4fa1-8645-24a308d621ea tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97ba840be5947569b6c0edf81b76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52caab26f74c4651baf8c681c316c08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:08.946555 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-37cafa3b-4000-4fa1-8645-24a308d621ea tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97ba840be5947569b6c0edf81b76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52caab26f74c4651baf8c681c316c08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:08.947765 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-37cafa3b-4000-4fa1-8645-24a308d621ea tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] 10.222.0.46 "GET /compute/v2.1/servers/b901c166-bba5-475c-a495-e92321720bb5" status: 200 len: 1365 microversion: 2.47 time: 0.141147 Jan 15 21:13:08.948557 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3092/6168] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:13:08 2022] GET /compute/v2.1/servers/b901c166-bba5-475c-a495-e92321720bb5 => generated 1365 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 15 21:13:09.286384 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8a76a482-1056-476b-a5c1-a0a526a28633 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:13:09.286924 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-8a76a482-1056-476b-a5c1-a0a526a28633 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] [instance: abffb1a6-17ea-4e1a-9218-4339c3407c3c] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:13:09.294540 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8a76a482-1056-476b-a5c1-a0a526a28633 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:09.294998 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8a76a482-1056-476b-a5c1-a0a526a28633 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:09.295813 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8a76a482-1056-476b-a5c1-a0a526a28633 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:09.296254 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8a76a482-1056-476b-a5c1-a0a526a28633 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:09.585585 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-8a76a482-1056-476b-a5c1-a0a526a28633 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25467d5284f04a159432b780e0eb10d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c5c2a0c042c4bf3aa18d87ce1d003eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:09.594550 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-8a76a482-1056-476b-a5c1-a0a526a28633 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] 10.222.0.46 "GET /compute/v2.1/servers/abffb1a6-17ea-4e1a-9218-4339c3407c3c" status: 200 len: 1428 microversion: 2.1 time: 0.311884 Jan 15 21:13:09.595409 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3077/6169] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:13:09 2022] GET /compute/v2.1/servers/abffb1a6-17ea-4e1a-9218-4339c3407c3c => generated 1428 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:13:09.968350 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1b765a69-851b-4090-b699-f057d7fbccac tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:13:09.968878 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-1b765a69-851b-4090-b699-f057d7fbccac tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] [instance: b901c166-bba5-475c-a495-e92321720bb5] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:13:09.980360 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1b765a69-851b-4090-b699-f057d7fbccac tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:09.983422 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1b765a69-851b-4090-b699-f057d7fbccac tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:09.984810 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1b765a69-851b-4090-b699-f057d7fbccac tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:09.986158 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1b765a69-851b-4090-b699-f057d7fbccac tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:10.323881 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-4c5bf25b-7487-43da-9677-32826631d1ec req-1ea00968-919f-495d-9bb8-50674b4cc5a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abffb1a6-17ea-4e1a-9218-4339c3407c3c", "name": "network-vif-plugged", "status": "completed", "tag": "87023fcd-0a43-4fa7-a414-0a614f09ac8e"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:13:10.326512 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:13:10.326512 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:13:10.340900 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-4c5bf25b-7487-43da-9677-32826631d1ec req-1ea00968-919f-495d-9bb8-50674b4cc5a9 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:10.342899 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-4c5bf25b-7487-43da-9677-32826631d1ec req-1ea00968-919f-495d-9bb8-50674b4cc5a9 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:10.358213 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-4c5bf25b-7487-43da-9677-32826631d1ec req-1ea00968-919f-495d-9bb8-50674b4cc5a9 service nova] Creating event network-vif-plugged:87023fcd-0a43-4fa7-a414-0a614f09ac8e for instance abffb1a6-17ea-4e1a-9218-4339c3407c3c on nch2-master-1 Jan 15 21:13:10.368072 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-4c5bf25b-7487-43da-9677-32826631d1ec req-1ea00968-919f-495d-9bb8-50674b4cc5a9 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049642 Jan 15 21:13:10.369451 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3078/6170] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:13:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 21:13:10.524472 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-1b765a69-851b-4090-b699-f057d7fbccac tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97ba840be5947569b6c0edf81b76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52caab26f74c4651baf8c681c316c08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:10.536325 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-1b765a69-851b-4090-b699-f057d7fbccac tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97ba840be5947569b6c0edf81b76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52caab26f74c4651baf8c681c316c08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:10.538179 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-1b765a69-851b-4090-b699-f057d7fbccac tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97ba840be5947569b6c0edf81b76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52caab26f74c4651baf8c681c316c08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:10.539917 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-1b765a69-851b-4090-b699-f057d7fbccac tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] 10.222.0.46 "GET /compute/v2.1/servers/b901c166-bba5-475c-a495-e92321720bb5" status: 200 len: 1365 microversion: 2.47 time: 0.576456 Jan 15 21:13:10.545252 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3093/6171] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:13:09 2022] GET /compute/v2.1/servers/b901c166-bba5-475c-a495-e92321720bb5 => generated 1365 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:13:10.599579 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a42000e4-a0e6-4e85-a036-fe8aede18a64 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:13:10.603132 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a42000e4-a0e6-4e85-a036-fe8aede18a64 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: 913a9b5a-dfd5-478a-9424-0114ea3a5006] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:13:10.619711 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8eb33f25-604e-4376-a4bb-4f06df2fd731 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:13:10.621796 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-8eb33f25-604e-4376-a4bb-4f06df2fd731 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] [instance: abffb1a6-17ea-4e1a-9218-4339c3407c3c] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:13:10.632775 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8eb33f25-604e-4376-a4bb-4f06df2fd731 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:10.635142 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8eb33f25-604e-4376-a4bb-4f06df2fd731 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:10.635876 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a42000e4-a0e6-4e85-a036-fe8aede18a64 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:10.639568 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a42000e4-a0e6-4e85-a036-fe8aede18a64 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:10.640428 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8eb33f25-604e-4376-a4bb-4f06df2fd731 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:10.641507 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a42000e4-a0e6-4e85-a036-fe8aede18a64 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:10.641983 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8eb33f25-604e-4376-a4bb-4f06df2fd731 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:10.645162 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a42000e4-a0e6-4e85-a036-fe8aede18a64 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:10.764140 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a42000e4-a0e6-4e85-a036-fe8aede18a64 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "POST /compute/v2.1/servers/913a9b5a-dfd5-478a-9424-0114ea3a5006/action" status: 200 len: 24578 microversion: 2.1 time: 0.169461 Jan 15 21:13:10.774462 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3079/6172] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:13:10 2022] POST /compute/v2.1/servers/913a9b5a-dfd5-478a-9424-0114ea3a5006/action => generated 24578 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:13:11.113006 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-8eb33f25-604e-4376-a4bb-4f06df2fd731 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25467d5284f04a159432b780e0eb10d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c5c2a0c042c4bf3aa18d87ce1d003eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:11.122321 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-8eb33f25-604e-4376-a4bb-4f06df2fd731 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] 10.222.0.46 "GET /compute/v2.1/servers/abffb1a6-17ea-4e1a-9218-4339c3407c3c" status: 200 len: 1428 microversion: 2.1 time: 0.514324 Jan 15 21:13:11.125713 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3094/6173] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:13:10 2022] GET /compute/v2.1/servers/abffb1a6-17ea-4e1a-9218-4339c3407c3c => generated 1428 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:13:11.562304 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-26357dad-19ca-43df-852c-5ba36fe6aae8 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:13:11.563096 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-26357dad-19ca-43df-852c-5ba36fe6aae8 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] [instance: b901c166-bba5-475c-a495-e92321720bb5] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:13:11.579956 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-26357dad-19ca-43df-852c-5ba36fe6aae8 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:11.584118 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-26357dad-19ca-43df-852c-5ba36fe6aae8 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:11.585512 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-26357dad-19ca-43df-852c-5ba36fe6aae8 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:11.585651 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-26357dad-19ca-43df-852c-5ba36fe6aae8 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:11.722650 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-26357dad-19ca-43df-852c-5ba36fe6aae8 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97ba840be5947569b6c0edf81b76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52caab26f74c4651baf8c681c316c08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:11.755541 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-26357dad-19ca-43df-852c-5ba36fe6aae8 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97ba840be5947569b6c0edf81b76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52caab26f74c4651baf8c681c316c08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:11.758221 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-26357dad-19ca-43df-852c-5ba36fe6aae8 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97ba840be5947569b6c0edf81b76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52caab26f74c4651baf8c681c316c08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:11.760763 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-26357dad-19ca-43df-852c-5ba36fe6aae8 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] 10.222.0.46 "GET /compute/v2.1/servers/b901c166-bba5-475c-a495-e92321720bb5" status: 200 len: 1365 microversion: 2.47 time: 0.202709 Jan 15 21:13:11.776541 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3080/6174] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:13:11 2022] GET /compute/v2.1/servers/b901c166-bba5-475c-a495-e92321720bb5 => generated 1365 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:13:12.140782 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f8637e51-ee1a-4644-a337-41528897fdd3 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:13:12.146027 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f8637e51-ee1a-4644-a337-41528897fdd3 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] [instance: abffb1a6-17ea-4e1a-9218-4339c3407c3c] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:13:12.177862 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f8637e51-ee1a-4644-a337-41528897fdd3 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:12.182123 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f8637e51-ee1a-4644-a337-41528897fdd3 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:12.186806 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f8637e51-ee1a-4644-a337-41528897fdd3 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:12.187288 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f8637e51-ee1a-4644-a337-41528897fdd3 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:12.391199 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-f8637e51-ee1a-4644-a337-41528897fdd3 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25467d5284f04a159432b780e0eb10d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c5c2a0c042c4bf3aa18d87ce1d003eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:12.400018 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f8637e51-ee1a-4644-a337-41528897fdd3 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] 10.222.0.46 "GET /compute/v2.1/servers/abffb1a6-17ea-4e1a-9218-4339c3407c3c" status: 200 len: 1609 microversion: 2.1 time: 0.264327 Jan 15 21:13:12.401089 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3095/6175] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:13:12 2022] GET /compute/v2.1/servers/abffb1a6-17ea-4e1a-9218-4339c3407c3c => generated 1609 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:13:12.419195 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b03a734a-f963-4256-8317-f4d0b9e3f398 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:13:12.419796 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b03a734a-f963-4256-8317-f4d0b9e3f398 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] [instance: abffb1a6-17ea-4e1a-9218-4339c3407c3c] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:13:12.428116 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b03a734a-f963-4256-8317-f4d0b9e3f398 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:12.429156 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b03a734a-f963-4256-8317-f4d0b9e3f398 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:12.431970 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b03a734a-f963-4256-8317-f4d0b9e3f398 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:12.432420 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b03a734a-f963-4256-8317-f4d0b9e3f398 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:12.682710 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-b03a734a-f963-4256-8317-f4d0b9e3f398 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25467d5284f04a159432b780e0eb10d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c5c2a0c042c4bf3aa18d87ce1d003eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:12.697961 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b03a734a-f963-4256-8317-f4d0b9e3f398 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] 10.222.0.46 "GET /compute/v2.1/servers/abffb1a6-17ea-4e1a-9218-4339c3407c3c" status: 200 len: 1609 microversion: 2.1 time: 0.281307 Jan 15 21:13:12.699887 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3081/6176] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:13:12 2022] GET /compute/v2.1/servers/abffb1a6-17ea-4e1a-9218-4339c3407c3c => generated 1609 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:13:12.716195 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-77348199-c932-44f4-b023-f33bddb58997 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:13:12.717390 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-77348199-c932-44f4-b023-f33bddb58997 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] [instance: abffb1a6-17ea-4e1a-9218-4339c3407c3c] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:13:12.733358 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-77348199-c932-44f4-b023-f33bddb58997 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:12.735528 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-77348199-c932-44f4-b023-f33bddb58997 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:12.736711 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-77348199-c932-44f4-b023-f33bddb58997 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:12.738014 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-77348199-c932-44f4-b023-f33bddb58997 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:12.781437 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-19141cb5-f694-471d-a4d2-feb33d04eae0 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:13:12.782254 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-19141cb5-f694-471d-a4d2-feb33d04eae0 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] [instance: b901c166-bba5-475c-a495-e92321720bb5] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:13:12.805175 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-19141cb5-f694-471d-a4d2-feb33d04eae0 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:12.806242 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-19141cb5-f694-471d-a4d2-feb33d04eae0 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:12.809991 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-19141cb5-f694-471d-a4d2-feb33d04eae0 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:12.810903 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-19141cb5-f694-471d-a4d2-feb33d04eae0 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:12.998885 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-19141cb5-f694-471d-a4d2-feb33d04eae0 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97ba840be5947569b6c0edf81b76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52caab26f74c4651baf8c681c316c08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:13.013417 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-19141cb5-f694-471d-a4d2-feb33d04eae0 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97ba840be5947569b6c0edf81b76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52caab26f74c4651baf8c681c316c08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:13.015244 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-19141cb5-f694-471d-a4d2-feb33d04eae0 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97ba840be5947569b6c0edf81b76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52caab26f74c4651baf8c681c316c08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:13.032997 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-19141cb5-f694-471d-a4d2-feb33d04eae0 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] 10.222.0.46 "GET /compute/v2.1/servers/b901c166-bba5-475c-a495-e92321720bb5" status: 200 len: 1365 microversion: 2.47 time: 0.255889 Jan 15 21:13:13.034992 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3082/6177] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:13:12 2022] GET /compute/v2.1/servers/b901c166-bba5-475c-a495-e92321720bb5 => generated 1365 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:13:13.077006 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-77348199-c932-44f4-b023-f33bddb58997 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25467d5284f04a159432b780e0eb10d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c5c2a0c042c4bf3aa18d87ce1d003eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:13.088705 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-77348199-c932-44f4-b023-f33bddb58997 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] 10.222.0.46 "GET /compute/v2.1/servers/abffb1a6-17ea-4e1a-9218-4339c3407c3c" status: 200 len: 1609 microversion: 2.1 time: 0.375901 Jan 15 21:13:13.099599 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3096/6178] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:13:12 2022] GET /compute/v2.1/servers/abffb1a6-17ea-4e1a-9218-4339c3407c3c => generated 1609 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:13:14.057069 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-80a60c87-9d3a-4f23-895a-7f58158fae70 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:13:14.057543 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-80a60c87-9d3a-4f23-895a-7f58158fae70 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] [instance: b901c166-bba5-475c-a495-e92321720bb5] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:13:14.071911 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-80a60c87-9d3a-4f23-895a-7f58158fae70 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:14.072362 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-80a60c87-9d3a-4f23-895a-7f58158fae70 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:14.073227 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-80a60c87-9d3a-4f23-895a-7f58158fae70 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:14.073674 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-80a60c87-9d3a-4f23-895a-7f58158fae70 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:14.266431 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-80a60c87-9d3a-4f23-895a-7f58158fae70 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97ba840be5947569b6c0edf81b76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52caab26f74c4651baf8c681c316c08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:14.284531 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-80a60c87-9d3a-4f23-895a-7f58158fae70 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97ba840be5947569b6c0edf81b76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52caab26f74c4651baf8c681c316c08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:14.286910 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-80a60c87-9d3a-4f23-895a-7f58158fae70 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97ba840be5947569b6c0edf81b76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52caab26f74c4651baf8c681c316c08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:14.291606 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-80a60c87-9d3a-4f23-895a-7f58158fae70 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] 10.222.0.46 "GET /compute/v2.1/servers/b901c166-bba5-475c-a495-e92321720bb5" status: 200 len: 1365 microversion: 2.47 time: 0.239598 Jan 15 21:13:14.295492 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3083/6179] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:13:14 2022] GET /compute/v2.1/servers/b901c166-bba5-475c-a495-e92321720bb5 => generated 1365 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:13:15.321841 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c99fd45f-ba0f-4b39-897c-de1ee0989ca0 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:13:15.323081 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c99fd45f-ba0f-4b39-897c-de1ee0989ca0 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] [instance: b901c166-bba5-475c-a495-e92321720bb5] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:13:15.329621 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c99fd45f-ba0f-4b39-897c-de1ee0989ca0 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:15.330278 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c99fd45f-ba0f-4b39-897c-de1ee0989ca0 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:15.331077 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c99fd45f-ba0f-4b39-897c-de1ee0989ca0 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:15.331517 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c99fd45f-ba0f-4b39-897c-de1ee0989ca0 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:15.452244 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-c99fd45f-ba0f-4b39-897c-de1ee0989ca0 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97ba840be5947569b6c0edf81b76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52caab26f74c4651baf8c681c316c08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:15.461175 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-c99fd45f-ba0f-4b39-897c-de1ee0989ca0 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97ba840be5947569b6c0edf81b76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52caab26f74c4651baf8c681c316c08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:15.462694 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-c99fd45f-ba0f-4b39-897c-de1ee0989ca0 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97ba840be5947569b6c0edf81b76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52caab26f74c4651baf8c681c316c08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:15.463875 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c99fd45f-ba0f-4b39-897c-de1ee0989ca0 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] 10.222.0.46 "GET /compute/v2.1/servers/b901c166-bba5-475c-a495-e92321720bb5" status: 200 len: 1365 microversion: 2.47 time: 0.147333 Jan 15 21:13:15.464442 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3097/6180] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:13:15 2022] GET /compute/v2.1/servers/b901c166-bba5-475c-a495-e92321720bb5 => generated 1365 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:13:16.484073 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-daafb398-9d3e-4634-b7b2-6b1193d5284d tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:13:16.484747 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-daafb398-9d3e-4634-b7b2-6b1193d5284d tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] [instance: b901c166-bba5-475c-a495-e92321720bb5] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:13:16.506201 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-daafb398-9d3e-4634-b7b2-6b1193d5284d tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:16.508095 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-daafb398-9d3e-4634-b7b2-6b1193d5284d tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:16.509519 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-daafb398-9d3e-4634-b7b2-6b1193d5284d tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:16.510227 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-daafb398-9d3e-4634-b7b2-6b1193d5284d tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:16.688075 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-daafb398-9d3e-4634-b7b2-6b1193d5284d tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97ba840be5947569b6c0edf81b76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52caab26f74c4651baf8c681c316c08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:16.704945 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-daafb398-9d3e-4634-b7b2-6b1193d5284d tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97ba840be5947569b6c0edf81b76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52caab26f74c4651baf8c681c316c08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:16.711873 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-daafb398-9d3e-4634-b7b2-6b1193d5284d tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97ba840be5947569b6c0edf81b76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52caab26f74c4651baf8c681c316c08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:16.718100 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-daafb398-9d3e-4634-b7b2-6b1193d5284d tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] 10.222.0.46 "GET /compute/v2.1/servers/b901c166-bba5-475c-a495-e92321720bb5" status: 200 len: 1365 microversion: 2.47 time: 0.236166 Jan 15 21:13:16.719743 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3084/6181] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:13:16 2022] GET /compute/v2.1/servers/b901c166-bba5-475c-a495-e92321720bb5 => generated 1365 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:13:17.192694 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8e0c5eab-7c1c-4e4c-9229-f71f7e02e70e tempest-TestNetworkAdvancedServerOps-958360157 tempest-TestNetworkAdvancedServerOps-958360157-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:13:17.194805 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-8e0c5eab-7c1c-4e4c-9229-f71f7e02e70e tempest-TestNetworkAdvancedServerOps-958360157 tempest-TestNetworkAdvancedServerOps-958360157-project-admin] [instance: 913a9b5a-dfd5-478a-9424-0114ea3a5006] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:13:17.212596 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8e0c5eab-7c1c-4e4c-9229-f71f7e02e70e tempest-TestNetworkAdvancedServerOps-958360157 tempest-TestNetworkAdvancedServerOps-958360157-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:17.213444 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8e0c5eab-7c1c-4e4c-9229-f71f7e02e70e tempest-TestNetworkAdvancedServerOps-958360157 tempest-TestNetworkAdvancedServerOps-958360157-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:17.214687 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8e0c5eab-7c1c-4e4c-9229-f71f7e02e70e tempest-TestNetworkAdvancedServerOps-958360157 tempest-TestNetworkAdvancedServerOps-958360157-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:17.215887 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8e0c5eab-7c1c-4e4c-9229-f71f7e02e70e tempest-TestNetworkAdvancedServerOps-958360157 tempest-TestNetworkAdvancedServerOps-958360157-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:17.738279 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c7dda3cc-4205-4112-bd30-51480f9026df tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:13:17.739964 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c7dda3cc-4205-4112-bd30-51480f9026df tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] [instance: b901c166-bba5-475c-a495-e92321720bb5] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:13:17.759665 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c7dda3cc-4205-4112-bd30-51480f9026df tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:17.767526 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c7dda3cc-4205-4112-bd30-51480f9026df tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:17.768765 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c7dda3cc-4205-4112-bd30-51480f9026df tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:17.771678 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c7dda3cc-4205-4112-bd30-51480f9026df tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:17.860417 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-8e0c5eab-7c1c-4e4c-9229-f71f7e02e70e tempest-TestNetworkAdvancedServerOps-958360157 tempest-TestNetworkAdvancedServerOps-958360157-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/913a9b5a-dfd5-478a-9424-0114ea3a5006" status: 200 len: 1832 microversion: 2.1 time: 0.672395 Jan 15 21:13:17.880321 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3098/6182] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:13:17 2022] GET /compute/v2.1/servers/913a9b5a-dfd5-478a-9424-0114ea3a5006 => generated 1832 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:13:17.938779 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-c7dda3cc-4205-4112-bd30-51480f9026df tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97ba840be5947569b6c0edf81b76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52caab26f74c4651baf8c681c316c08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:17.959053 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-c7dda3cc-4205-4112-bd30-51480f9026df tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97ba840be5947569b6c0edf81b76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52caab26f74c4651baf8c681c316c08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:17.963257 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-c7dda3cc-4205-4112-bd30-51480f9026df tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97ba840be5947569b6c0edf81b76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52caab26f74c4651baf8c681c316c08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:17.965026 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c7dda3cc-4205-4112-bd30-51480f9026df tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] 10.222.0.46 "GET /compute/v2.1/servers/b901c166-bba5-475c-a495-e92321720bb5" status: 200 len: 1365 microversion: 2.47 time: 0.230696 Jan 15 21:13:17.966473 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3085/6183] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:13:17 2022] GET /compute/v2.1/servers/b901c166-bba5-475c-a495-e92321720bb5 => generated 1365 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:13:17.978992 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-afe40343-8b45-40eb-ab93-d4334421e588 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:13:17.980380 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-afe40343-8b45-40eb-ab93-d4334421e588 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: 913a9b5a-dfd5-478a-9424-0114ea3a5006] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:13:17.988323 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-afe40343-8b45-40eb-ab93-d4334421e588 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:17.989943 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-afe40343-8b45-40eb-ab93-d4334421e588 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:17.992191 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-afe40343-8b45-40eb-ab93-d4334421e588 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:17.992926 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-afe40343-8b45-40eb-ab93-d4334421e588 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:18.219770 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-0f12e4bf-dc9f-4fb7-a974-d14b31496901 req-fbd76faa-d343-4068-ab3e-feca4f055fcd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "abffb1a6-17ea-4e1a-9218-4339c3407c3c", "tag": "87023fcd-0a43-4fa7-a414-0a614f09ac8e"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:13:18.221356 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:13:18.221356 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:13:18.229886 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-afe40343-8b45-40eb-ab93-d4334421e588 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:18.236794 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-0f12e4bf-dc9f-4fb7-a974-d14b31496901 req-fbd76faa-d343-4068-ab3e-feca4f055fcd service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:18.237127 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-0f12e4bf-dc9f-4fb7-a974-d14b31496901 req-fbd76faa-d343-4068-ab3e-feca4f055fcd service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:18.242430 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-afe40343-8b45-40eb-ab93-d4334421e588 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/913a9b5a-dfd5-478a-9424-0114ea3a5006" status: 200 len: 1681 microversion: 2.1 time: 0.273435 Jan 15 21:13:18.255434 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3086/6184] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:13:17 2022] GET /compute/v2.1/servers/913a9b5a-dfd5-478a-9424-0114ea3a5006 => generated 1681 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:13:18.270758 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-0f12e4bf-dc9f-4fb7-a974-d14b31496901 req-fbd76faa-d343-4068-ab3e-feca4f055fcd service nova] Creating event network-changed:87023fcd-0a43-4fa7-a414-0a614f09ac8e for instance abffb1a6-17ea-4e1a-9218-4339c3407c3c on nch2-master-1 Jan 15 21:13:18.284778 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-0f12e4bf-dc9f-4fb7-a974-d14b31496901 req-fbd76faa-d343-4068-ab3e-feca4f055fcd service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.401215 Jan 15 21:13:18.286035 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3099/6185] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:13:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:13:18.365455 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5e527f8c-3a70-438e-878b-5751af652ea9 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:13:18.367143 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-5e527f8c-3a70-438e-878b-5751af652ea9 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: 913a9b5a-dfd5-478a-9424-0114ea3a5006] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:13:18.377563 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5e527f8c-3a70-438e-878b-5751af652ea9 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:18.380690 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5e527f8c-3a70-438e-878b-5751af652ea9 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:18.381944 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5e527f8c-3a70-438e-878b-5751af652ea9 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:18.382813 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5e527f8c-3a70-438e-878b-5751af652ea9 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:18.444726 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5e527f8c-3a70-438e-878b-5751af652ea9 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "POST /compute/v2.1/servers/913a9b5a-dfd5-478a-9424-0114ea3a5006/action" status: 200 len: 32647 microversion: 2.1 time: 0.082916 Jan 15 21:13:18.446881 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3087/6186] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:13:18 2022] POST /compute/v2.1/servers/913a9b5a-dfd5-478a-9424-0114ea3a5006/action => generated 32647 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:13:18.628138 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-5f3b7ff8-e944-46e8-97e8-ce263d484acc tempest-TestNetworkAdvancedServerOps-958360157 tempest-TestNetworkAdvancedServerOps-958360157-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:13:18.629331 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-5f3b7ff8-e944-46e8-97e8-ce263d484acc tempest-TestNetworkAdvancedServerOps-958360157 tempest-TestNetworkAdvancedServerOps-958360157-project-admin] [instance: 913a9b5a-dfd5-478a-9424-0114ea3a5006] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:13:18.639399 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5f3b7ff8-e944-46e8-97e8-ce263d484acc tempest-TestNetworkAdvancedServerOps-958360157 tempest-TestNetworkAdvancedServerOps-958360157-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:18.640147 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5f3b7ff8-e944-46e8-97e8-ce263d484acc tempest-TestNetworkAdvancedServerOps-958360157 tempest-TestNetworkAdvancedServerOps-958360157-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:18.641799 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5f3b7ff8-e944-46e8-97e8-ce263d484acc tempest-TestNetworkAdvancedServerOps-958360157 tempest-TestNetworkAdvancedServerOps-958360157-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:18.642508 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5f3b7ff8-e944-46e8-97e8-ce263d484acc tempest-TestNetworkAdvancedServerOps-958360157 tempest-TestNetworkAdvancedServerOps-958360157-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:18.719716 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-5f3b7ff8-e944-46e8-97e8-ce263d484acc tempest-TestNetworkAdvancedServerOps-958360157 tempest-TestNetworkAdvancedServerOps-958360157-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '7f42d62d41934d5aa4aba6f9a1e1f920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8baf49b7c04879833db37012ebfd04', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:18.720953 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-5f3b7ff8-e944-46e8-97e8-ce263d484acc tempest-TestNetworkAdvancedServerOps-958360157 tempest-TestNetworkAdvancedServerOps-958360157-project-admin] [instance: 913a9b5a-dfd5-478a-9424-0114ea3a5006] flavor_id is None. Assuming migration. {{(pid=129366) resize /opt/stack/nova/nova/compute/api.py:4073}} Jan 15 21:13:18.721720 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-5f3b7ff8-e944-46e8-97e8-ce263d484acc tempest-TestNetworkAdvancedServerOps-958360157 tempest-TestNetworkAdvancedServerOps-958360157-project-admin] [instance: 913a9b5a-dfd5-478a-9424-0114ea3a5006] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=129366) resize /opt/stack/nova/nova/compute/api.py:4097}} Jan 15 21:13:18.985852 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-bc7a084b-6868-4d01-8732-5b3aefbf38be tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:13:18.987335 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-bc7a084b-6868-4d01-8732-5b3aefbf38be tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] [instance: b901c166-bba5-475c-a495-e92321720bb5] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:13:18.997260 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bc7a084b-6868-4d01-8732-5b3aefbf38be tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:18.998062 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bc7a084b-6868-4d01-8732-5b3aefbf38be tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:18.999284 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bc7a084b-6868-4d01-8732-5b3aefbf38be tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:18.999964 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bc7a084b-6868-4d01-8732-5b3aefbf38be tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:19.021612 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-5f3b7ff8-e944-46e8-97e8-ce263d484acc tempest-TestNetworkAdvancedServerOps-958360157 tempest-TestNetworkAdvancedServerOps-958360157-project-admin] 10.222.0.46 "POST /compute/v2.1/servers/913a9b5a-dfd5-478a-9424-0114ea3a5006/action" status: 202 len: 0 microversion: 2.1 time: 0.398002 Jan 15 21:13:19.023438 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3100/6187] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:13:18 2022] POST /compute/v2.1/servers/913a9b5a-dfd5-478a-9424-0114ea3a5006/action => generated 0 bytes in 401 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:13:19.031528 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-3247f527-2667-4fd2-906a-a2c9860bf454 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:13:19.032393 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-3247f527-2667-4fd2-906a-a2c9860bf454 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: 913a9b5a-dfd5-478a-9424-0114ea3a5006] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:13:19.041162 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3247f527-2667-4fd2-906a-a2c9860bf454 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:19.042505 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3247f527-2667-4fd2-906a-a2c9860bf454 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:19.043509 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3247f527-2667-4fd2-906a-a2c9860bf454 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:19.044120 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3247f527-2667-4fd2-906a-a2c9860bf454 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:19.112907 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-bc7a084b-6868-4d01-8732-5b3aefbf38be tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97ba840be5947569b6c0edf81b76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52caab26f74c4651baf8c681c316c08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:19.127566 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-bc7a084b-6868-4d01-8732-5b3aefbf38be tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97ba840be5947569b6c0edf81b76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52caab26f74c4651baf8c681c316c08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:19.130143 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-bc7a084b-6868-4d01-8732-5b3aefbf38be tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97ba840be5947569b6c0edf81b76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52caab26f74c4651baf8c681c316c08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:19.131429 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-bc7a084b-6868-4d01-8732-5b3aefbf38be tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] 10.222.0.46 "GET /compute/v2.1/servers/b901c166-bba5-475c-a495-e92321720bb5" status: 200 len: 1365 microversion: 2.47 time: 0.150607 Jan 15 21:13:19.145996 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3088/6188] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:13:18 2022] GET /compute/v2.1/servers/b901c166-bba5-475c-a495-e92321720bb5 => generated 1365 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 15 21:13:19.310036 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-3247f527-2667-4fd2-906a-a2c9860bf454 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:19.322823 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-3247f527-2667-4fd2-906a-a2c9860bf454 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/913a9b5a-dfd5-478a-9424-0114ea3a5006" status: 200 len: 1690 microversion: 2.1 time: 0.295303 Jan 15 21:13:19.323932 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3101/6189] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:13:19 2022] GET /compute/v2.1/servers/913a9b5a-dfd5-478a-9424-0114ea3a5006 => generated 1690 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:13:20.150792 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8cf60570-784e-4dca-8549-00cd2575adc3 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:13:20.152177 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-8cf60570-784e-4dca-8549-00cd2575adc3 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] [instance: b901c166-bba5-475c-a495-e92321720bb5] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:13:20.170376 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8cf60570-784e-4dca-8549-00cd2575adc3 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:20.170842 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8cf60570-784e-4dca-8549-00cd2575adc3 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:20.171653 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8cf60570-784e-4dca-8549-00cd2575adc3 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:20.177492 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8cf60570-784e-4dca-8549-00cd2575adc3 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:20.343595 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-13023ef3-0264-4de5-9365-4dcbc178b612 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:13:20.344185 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-13023ef3-0264-4de5-9365-4dcbc178b612 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: 913a9b5a-dfd5-478a-9424-0114ea3a5006] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:13:20.360098 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-13023ef3-0264-4de5-9365-4dcbc178b612 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:20.360939 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-13023ef3-0264-4de5-9365-4dcbc178b612 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:20.362154 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-13023ef3-0264-4de5-9365-4dcbc178b612 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:20.363232 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-13023ef3-0264-4de5-9365-4dcbc178b612 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:20.388715 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-8cf60570-784e-4dca-8549-00cd2575adc3 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97ba840be5947569b6c0edf81b76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52caab26f74c4651baf8c681c316c08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:20.411459 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-8cf60570-784e-4dca-8549-00cd2575adc3 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97ba840be5947569b6c0edf81b76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52caab26f74c4651baf8c681c316c08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:20.414195 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-8cf60570-784e-4dca-8549-00cd2575adc3 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97ba840be5947569b6c0edf81b76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52caab26f74c4651baf8c681c316c08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:20.417329 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-8cf60570-784e-4dca-8549-00cd2575adc3 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] 10.222.0.46 "GET /compute/v2.1/servers/b901c166-bba5-475c-a495-e92321720bb5" status: 200 len: 1365 microversion: 2.47 time: 0.271892 Jan 15 21:13:20.420881 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3089/6190] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:13:20 2022] GET /compute/v2.1/servers/b901c166-bba5-475c-a495-e92321720bb5 => generated 1365 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:13:20.762213 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-13023ef3-0264-4de5-9365-4dcbc178b612 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:20.770314 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-13023ef3-0264-4de5-9365-4dcbc178b612 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/913a9b5a-dfd5-478a-9424-0114ea3a5006" status: 200 len: 1690 microversion: 2.1 time: 0.430664 Jan 15 21:13:20.770995 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3102/6191] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:13:20 2022] GET /compute/v2.1/servers/913a9b5a-dfd5-478a-9424-0114ea3a5006 => generated 1690 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:13:21.438683 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5518c6c6-dc37-47fb-932b-bb09f3cf35bc tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:13:21.439317 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-5518c6c6-dc37-47fb-932b-bb09f3cf35bc tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] [instance: b901c166-bba5-475c-a495-e92321720bb5] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:13:21.445317 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5518c6c6-dc37-47fb-932b-bb09f3cf35bc tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:21.445759 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5518c6c6-dc37-47fb-932b-bb09f3cf35bc tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:21.446599 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5518c6c6-dc37-47fb-932b-bb09f3cf35bc tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:21.447042 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5518c6c6-dc37-47fb-932b-bb09f3cf35bc tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:21.512046 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-5518c6c6-dc37-47fb-932b-bb09f3cf35bc tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97ba840be5947569b6c0edf81b76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52caab26f74c4651baf8c681c316c08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:21.519917 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-5518c6c6-dc37-47fb-932b-bb09f3cf35bc tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97ba840be5947569b6c0edf81b76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52caab26f74c4651baf8c681c316c08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:21.521456 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-5518c6c6-dc37-47fb-932b-bb09f3cf35bc tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97ba840be5947569b6c0edf81b76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52caab26f74c4651baf8c681c316c08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:21.522611 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5518c6c6-dc37-47fb-932b-bb09f3cf35bc tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] 10.222.0.46 "GET /compute/v2.1/servers/b901c166-bba5-475c-a495-e92321720bb5" status: 200 len: 1365 microversion: 2.47 time: 0.088674 Jan 15 21:13:21.523168 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3090/6192] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:13:21 2022] GET /compute/v2.1/servers/b901c166-bba5-475c-a495-e92321720bb5 => generated 1365 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 15 21:13:21.790904 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-fe1defdd-68d6-4d71-88ad-64fcd2409940 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:13:21.791747 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-fe1defdd-68d6-4d71-88ad-64fcd2409940 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: 913a9b5a-dfd5-478a-9424-0114ea3a5006] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:13:21.802593 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fe1defdd-68d6-4d71-88ad-64fcd2409940 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:21.803491 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fe1defdd-68d6-4d71-88ad-64fcd2409940 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:21.804536 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fe1defdd-68d6-4d71-88ad-64fcd2409940 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:21.805758 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fe1defdd-68d6-4d71-88ad-64fcd2409940 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:22.115356 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-fe1defdd-68d6-4d71-88ad-64fcd2409940 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:22.128599 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-fe1defdd-68d6-4d71-88ad-64fcd2409940 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/913a9b5a-dfd5-478a-9424-0114ea3a5006" status: 200 len: 1690 microversion: 2.1 time: 0.342735 Jan 15 21:13:22.129979 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3103/6193] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:13:21 2022] GET /compute/v2.1/servers/913a9b5a-dfd5-478a-9424-0114ea3a5006 => generated 1690 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:13:22.546226 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-cd576d22-08e8-4008-961e-2d2722eabbb6 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:13:22.547402 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-cd576d22-08e8-4008-961e-2d2722eabbb6 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] [instance: b901c166-bba5-475c-a495-e92321720bb5] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:13:22.556663 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cd576d22-08e8-4008-961e-2d2722eabbb6 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:22.557419 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cd576d22-08e8-4008-961e-2d2722eabbb6 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:22.558532 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cd576d22-08e8-4008-961e-2d2722eabbb6 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:22.559063 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cd576d22-08e8-4008-961e-2d2722eabbb6 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:22.722738 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-cd576d22-08e8-4008-961e-2d2722eabbb6 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97ba840be5947569b6c0edf81b76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52caab26f74c4651baf8c681c316c08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:22.747739 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-cd576d22-08e8-4008-961e-2d2722eabbb6 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97ba840be5947569b6c0edf81b76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52caab26f74c4651baf8c681c316c08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:22.749570 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-cd576d22-08e8-4008-961e-2d2722eabbb6 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97ba840be5947569b6c0edf81b76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52caab26f74c4651baf8c681c316c08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:22.750808 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-cd576d22-08e8-4008-961e-2d2722eabbb6 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] 10.222.0.46 "GET /compute/v2.1/servers/b901c166-bba5-475c-a495-e92321720bb5" status: 200 len: 1365 microversion: 2.47 time: 0.211086 Jan 15 21:13:22.751392 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3091/6194] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:13:22 2022] GET /compute/v2.1/servers/b901c166-bba5-475c-a495-e92321720bb5 => generated 1365 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:13:23.149813 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-59591d1d-391d-47cc-8842-7030232c4ba1 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:13:23.150647 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-59591d1d-391d-47cc-8842-7030232c4ba1 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: 913a9b5a-dfd5-478a-9424-0114ea3a5006] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:13:23.158167 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-59591d1d-391d-47cc-8842-7030232c4ba1 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:23.158886 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-59591d1d-391d-47cc-8842-7030232c4ba1 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:23.159859 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-59591d1d-391d-47cc-8842-7030232c4ba1 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:23.160661 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-59591d1d-391d-47cc-8842-7030232c4ba1 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:23.334817 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-59591d1d-391d-47cc-8842-7030232c4ba1 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:23.342621 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-59591d1d-391d-47cc-8842-7030232c4ba1 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/913a9b5a-dfd5-478a-9424-0114ea3a5006" status: 200 len: 1695 microversion: 2.1 time: 0.197491 Jan 15 21:13:23.343724 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3104/6195] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:13:23 2022] GET /compute/v2.1/servers/913a9b5a-dfd5-478a-9424-0114ea3a5006 => generated 1695 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:13:23.769329 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c578786f-0300-4504-bd53-1a75787ef392 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:13:23.769967 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c578786f-0300-4504-bd53-1a75787ef392 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] [instance: b901c166-bba5-475c-a495-e92321720bb5] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:13:23.780155 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c578786f-0300-4504-bd53-1a75787ef392 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:23.782762 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c578786f-0300-4504-bd53-1a75787ef392 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:23.786190 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c578786f-0300-4504-bd53-1a75787ef392 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:23.786567 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c578786f-0300-4504-bd53-1a75787ef392 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:24.001738 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-c578786f-0300-4504-bd53-1a75787ef392 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97ba840be5947569b6c0edf81b76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52caab26f74c4651baf8c681c316c08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:24.015311 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-c578786f-0300-4504-bd53-1a75787ef392 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97ba840be5947569b6c0edf81b76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52caab26f74c4651baf8c681c316c08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:24.017361 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-c578786f-0300-4504-bd53-1a75787ef392 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97ba840be5947569b6c0edf81b76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52caab26f74c4651baf8c681c316c08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:24.019610 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c578786f-0300-4504-bd53-1a75787ef392 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] 10.222.0.46 "GET /compute/v2.1/servers/b901c166-bba5-475c-a495-e92321720bb5" status: 200 len: 1365 microversion: 2.47 time: 0.254359 Jan 15 21:13:24.020738 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3092/6196] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:13:23 2022] GET /compute/v2.1/servers/b901c166-bba5-475c-a495-e92321720bb5 => generated 1365 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:13:24.360699 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-06bb2d46-4362-4229-9c22-109bf2a01d29 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:13:24.361375 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-06bb2d46-4362-4229-9c22-109bf2a01d29 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: 913a9b5a-dfd5-478a-9424-0114ea3a5006] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:13:24.370330 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-06bb2d46-4362-4229-9c22-109bf2a01d29 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:24.370797 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-06bb2d46-4362-4229-9c22-109bf2a01d29 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:24.371609 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-06bb2d46-4362-4229-9c22-109bf2a01d29 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:24.372361 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-06bb2d46-4362-4229-9c22-109bf2a01d29 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:24.593250 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-06bb2d46-4362-4229-9c22-109bf2a01d29 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:24.601778 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-06bb2d46-4362-4229-9c22-109bf2a01d29 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/913a9b5a-dfd5-478a-9424-0114ea3a5006" status: 200 len: 1695 microversion: 2.1 time: 0.244973 Jan 15 21:13:24.602371 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3105/6197] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:13:24 2022] GET /compute/v2.1/servers/913a9b5a-dfd5-478a-9424-0114ea3a5006 => generated 1695 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:13:25.042052 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-0e67f065-0985-4572-9a45-735cdd04bbee tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:13:25.043419 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-0e67f065-0985-4572-9a45-735cdd04bbee tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] [instance: b901c166-bba5-475c-a495-e92321720bb5] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:13:25.054900 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0e67f065-0985-4572-9a45-735cdd04bbee tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:25.055588 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0e67f065-0985-4572-9a45-735cdd04bbee tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:25.057191 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0e67f065-0985-4572-9a45-735cdd04bbee tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:25.057828 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0e67f065-0985-4572-9a45-735cdd04bbee tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:25.151646 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-0e67f065-0985-4572-9a45-735cdd04bbee tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97ba840be5947569b6c0edf81b76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52caab26f74c4651baf8c681c316c08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:25.163045 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-0e67f065-0985-4572-9a45-735cdd04bbee tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97ba840be5947569b6c0edf81b76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52caab26f74c4651baf8c681c316c08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:25.164905 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-0e67f065-0985-4572-9a45-735cdd04bbee tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97ba840be5947569b6c0edf81b76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52caab26f74c4651baf8c681c316c08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:25.166097 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-0e67f065-0985-4572-9a45-735cdd04bbee tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] 10.222.0.46 "GET /compute/v2.1/servers/b901c166-bba5-475c-a495-e92321720bb5" status: 200 len: 1365 microversion: 2.47 time: 0.130794 Jan 15 21:13:25.183475 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3093/6198] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:13:25 2022] GET /compute/v2.1/servers/b901c166-bba5-475c-a495-e92321720bb5 => generated 1365 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:13:25.619669 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-46e237cf-7966-4524-a167-2bba557c65c2 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:13:25.620329 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-46e237cf-7966-4524-a167-2bba557c65c2 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: 913a9b5a-dfd5-478a-9424-0114ea3a5006] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:13:25.632652 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-46e237cf-7966-4524-a167-2bba557c65c2 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:25.634942 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-46e237cf-7966-4524-a167-2bba557c65c2 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:25.635795 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-46e237cf-7966-4524-a167-2bba557c65c2 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:25.636240 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-46e237cf-7966-4524-a167-2bba557c65c2 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:25.936105 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-46e237cf-7966-4524-a167-2bba557c65c2 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:25.958081 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-46e237cf-7966-4524-a167-2bba557c65c2 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/913a9b5a-dfd5-478a-9424-0114ea3a5006" status: 200 len: 1695 microversion: 2.1 time: 0.342020 Jan 15 21:13:25.964174 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3106/6199] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:13:25 2022] GET /compute/v2.1/servers/913a9b5a-dfd5-478a-9424-0114ea3a5006 => generated 1695 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:13:26.207368 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d42aa842-1c33-4e14-99a6-ff0dcbcc12ad tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:13:26.210303 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d42aa842-1c33-4e14-99a6-ff0dcbcc12ad tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] [instance: b901c166-bba5-475c-a495-e92321720bb5] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:13:26.225713 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d42aa842-1c33-4e14-99a6-ff0dcbcc12ad tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:26.227274 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d42aa842-1c33-4e14-99a6-ff0dcbcc12ad tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:26.229041 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d42aa842-1c33-4e14-99a6-ff0dcbcc12ad tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:26.230190 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d42aa842-1c33-4e14-99a6-ff0dcbcc12ad tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:26.417214 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-d42aa842-1c33-4e14-99a6-ff0dcbcc12ad tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97ba840be5947569b6c0edf81b76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52caab26f74c4651baf8c681c316c08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:26.440261 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-d42aa842-1c33-4e14-99a6-ff0dcbcc12ad tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97ba840be5947569b6c0edf81b76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52caab26f74c4651baf8c681c316c08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:26.444253 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-d42aa842-1c33-4e14-99a6-ff0dcbcc12ad tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97ba840be5947569b6c0edf81b76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52caab26f74c4651baf8c681c316c08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:26.446892 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d42aa842-1c33-4e14-99a6-ff0dcbcc12ad tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] 10.222.0.46 "GET /compute/v2.1/servers/b901c166-bba5-475c-a495-e92321720bb5" status: 200 len: 1365 microversion: 2.47 time: 0.251147 Jan 15 21:13:26.458753 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3094/6200] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:13:26 2022] GET /compute/v2.1/servers/b901c166-bba5-475c-a495-e92321720bb5 => generated 1365 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:13:26.978878 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8b13d7b9-e549-4129-b4f1-bb5d13a73bab tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:13:26.979503 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-8b13d7b9-e549-4129-b4f1-bb5d13a73bab tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: 913a9b5a-dfd5-478a-9424-0114ea3a5006] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:13:26.986076 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8b13d7b9-e549-4129-b4f1-bb5d13a73bab tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:26.986902 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8b13d7b9-e549-4129-b4f1-bb5d13a73bab tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:26.987961 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8b13d7b9-e549-4129-b4f1-bb5d13a73bab tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:26.988637 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8b13d7b9-e549-4129-b4f1-bb5d13a73bab tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:27.242024 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-8b13d7b9-e549-4129-b4f1-bb5d13a73bab tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:27.255350 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-8b13d7b9-e549-4129-b4f1-bb5d13a73bab tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/913a9b5a-dfd5-478a-9424-0114ea3a5006" status: 200 len: 1695 microversion: 2.1 time: 0.276245 Jan 15 21:13:27.267154 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3107/6201] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:13:26 2022] GET /compute/v2.1/servers/913a9b5a-dfd5-478a-9424-0114ea3a5006 => generated 1695 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:13:27.477244 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b08915d5-61c7-4d4c-92cf-a794a918adc3 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:13:27.477849 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b08915d5-61c7-4d4c-92cf-a794a918adc3 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] [instance: b901c166-bba5-475c-a495-e92321720bb5] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:13:27.484739 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b08915d5-61c7-4d4c-92cf-a794a918adc3 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:27.485464 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b08915d5-61c7-4d4c-92cf-a794a918adc3 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:27.486432 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b08915d5-61c7-4d4c-92cf-a794a918adc3 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:27.487046 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b08915d5-61c7-4d4c-92cf-a794a918adc3 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:27.582763 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-b08915d5-61c7-4d4c-92cf-a794a918adc3 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97ba840be5947569b6c0edf81b76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52caab26f74c4651baf8c681c316c08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:27.593465 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-b08915d5-61c7-4d4c-92cf-a794a918adc3 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97ba840be5947569b6c0edf81b76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52caab26f74c4651baf8c681c316c08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:27.595526 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-b08915d5-61c7-4d4c-92cf-a794a918adc3 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97ba840be5947569b6c0edf81b76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52caab26f74c4651baf8c681c316c08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:27.596925 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b08915d5-61c7-4d4c-92cf-a794a918adc3 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] 10.222.0.46 "GET /compute/v2.1/servers/b901c166-bba5-475c-a495-e92321720bb5" status: 200 len: 1365 microversion: 2.47 time: 0.123563 Jan 15 21:13:27.597892 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3095/6202] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:13:27 2022] GET /compute/v2.1/servers/b901c166-bba5-475c-a495-e92321720bb5 => generated 1365 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:13:28.275324 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-6f4e1988-f55f-4654-882f-e557132125d8 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:13:28.275939 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-6f4e1988-f55f-4654-882f-e557132125d8 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: 913a9b5a-dfd5-478a-9424-0114ea3a5006] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:13:28.282730 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6f4e1988-f55f-4654-882f-e557132125d8 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:28.283190 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6f4e1988-f55f-4654-882f-e557132125d8 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:28.283976 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6f4e1988-f55f-4654-882f-e557132125d8 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:28.284620 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6f4e1988-f55f-4654-882f-e557132125d8 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:28.616964 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-1f8f3fab-af03-4798-b94b-39e134341ce9 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:13:28.617578 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-1f8f3fab-af03-4798-b94b-39e134341ce9 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] [instance: b901c166-bba5-475c-a495-e92321720bb5] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:13:28.624301 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1f8f3fab-af03-4798-b94b-39e134341ce9 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:28.624755 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1f8f3fab-af03-4798-b94b-39e134341ce9 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:28.625585 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1f8f3fab-af03-4798-b94b-39e134341ce9 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:28.626023 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1f8f3fab-af03-4798-b94b-39e134341ce9 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:28.759978 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-1f8f3fab-af03-4798-b94b-39e134341ce9 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97ba840be5947569b6c0edf81b76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52caab26f74c4651baf8c681c316c08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:28.769396 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-1f8f3fab-af03-4798-b94b-39e134341ce9 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97ba840be5947569b6c0edf81b76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52caab26f74c4651baf8c681c316c08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:28.770905 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-1f8f3fab-af03-4798-b94b-39e134341ce9 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97ba840be5947569b6c0edf81b76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52caab26f74c4651baf8c681c316c08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:28.772947 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-1f8f3fab-af03-4798-b94b-39e134341ce9 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] 10.222.0.46 "GET /compute/v2.1/servers/b901c166-bba5-475c-a495-e92321720bb5" status: 200 len: 1365 microversion: 2.47 time: 0.160718 Jan 15 21:13:28.784091 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3096/6203] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:13:28 2022] GET /compute/v2.1/servers/b901c166-bba5-475c-a495-e92321720bb5 => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 15 21:13:28.848058 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-6f4e1988-f55f-4654-882f-e557132125d8 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:28.856352 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-6f4e1988-f55f-4654-882f-e557132125d8 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/913a9b5a-dfd5-478a-9424-0114ea3a5006" status: 200 len: 1695 microversion: 2.1 time: 0.585578 Jan 15 21:13:28.857270 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3108/6204] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:13:28 2022] GET /compute/v2.1/servers/913a9b5a-dfd5-478a-9424-0114ea3a5006 => generated 1695 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:13:29.795818 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-cd1e4ddf-24a8-4c17-b09e-ff1b5dd38d62 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:13:29.797649 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-cd1e4ddf-24a8-4c17-b09e-ff1b5dd38d62 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] [instance: b901c166-bba5-475c-a495-e92321720bb5] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:13:29.805993 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cd1e4ddf-24a8-4c17-b09e-ff1b5dd38d62 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:29.806652 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cd1e4ddf-24a8-4c17-b09e-ff1b5dd38d62 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:29.807838 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cd1e4ddf-24a8-4c17-b09e-ff1b5dd38d62 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:29.808909 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cd1e4ddf-24a8-4c17-b09e-ff1b5dd38d62 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:29.873733 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4c65b20d-257e-45dc-90eb-71ab40ddfdfa tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:13:29.874351 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-4c65b20d-257e-45dc-90eb-71ab40ddfdfa tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: 913a9b5a-dfd5-478a-9424-0114ea3a5006] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:13:29.884999 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4c65b20d-257e-45dc-90eb-71ab40ddfdfa tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:29.885409 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4c65b20d-257e-45dc-90eb-71ab40ddfdfa tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:29.886248 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4c65b20d-257e-45dc-90eb-71ab40ddfdfa tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:29.886630 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4c65b20d-257e-45dc-90eb-71ab40ddfdfa tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:29.924200 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-cd1e4ddf-24a8-4c17-b09e-ff1b5dd38d62 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97ba840be5947569b6c0edf81b76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52caab26f74c4651baf8c681c316c08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:29.934985 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-cd1e4ddf-24a8-4c17-b09e-ff1b5dd38d62 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97ba840be5947569b6c0edf81b76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52caab26f74c4651baf8c681c316c08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:29.937298 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-cd1e4ddf-24a8-4c17-b09e-ff1b5dd38d62 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97ba840be5947569b6c0edf81b76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52caab26f74c4651baf8c681c316c08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:29.939443 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-cd1e4ddf-24a8-4c17-b09e-ff1b5dd38d62 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] 10.222.0.46 "GET /compute/v2.1/servers/b901c166-bba5-475c-a495-e92321720bb5" status: 200 len: 1365 microversion: 2.47 time: 0.150481 Jan 15 21:13:29.953188 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3097/6205] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:13:29 2022] GET /compute/v2.1/servers/b901c166-bba5-475c-a495-e92321720bb5 => generated 1365 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:13:30.120071 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-4c65b20d-257e-45dc-90eb-71ab40ddfdfa tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:30.128394 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-4c65b20d-257e-45dc-90eb-71ab40ddfdfa tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/913a9b5a-dfd5-478a-9424-0114ea3a5006" status: 200 len: 1695 microversion: 2.1 time: 0.258227 Jan 15 21:13:30.140906 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3109/6206] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:13:29 2022] GET /compute/v2.1/servers/913a9b5a-dfd5-478a-9424-0114ea3a5006 => generated 1695 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:13:30.958962 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-601c036b-c6ab-4e9b-8037-1bc904d3b3a5 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:13:30.960437 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-601c036b-c6ab-4e9b-8037-1bc904d3b3a5 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] [instance: b901c166-bba5-475c-a495-e92321720bb5] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:13:30.968725 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-601c036b-c6ab-4e9b-8037-1bc904d3b3a5 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:30.969581 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-601c036b-c6ab-4e9b-8037-1bc904d3b3a5 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:30.970813 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-601c036b-c6ab-4e9b-8037-1bc904d3b3a5 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:30.971666 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-601c036b-c6ab-4e9b-8037-1bc904d3b3a5 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:31.076854 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-601c036b-c6ab-4e9b-8037-1bc904d3b3a5 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97ba840be5947569b6c0edf81b76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52caab26f74c4651baf8c681c316c08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:31.088284 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-601c036b-c6ab-4e9b-8037-1bc904d3b3a5 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97ba840be5947569b6c0edf81b76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52caab26f74c4651baf8c681c316c08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:31.090271 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-601c036b-c6ab-4e9b-8037-1bc904d3b3a5 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97ba840be5947569b6c0edf81b76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52caab26f74c4651baf8c681c316c08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:31.091795 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-601c036b-c6ab-4e9b-8037-1bc904d3b3a5 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] 10.222.0.46 "GET /compute/v2.1/servers/b901c166-bba5-475c-a495-e92321720bb5" status: 200 len: 1365 microversion: 2.47 time: 0.136501 Jan 15 21:13:31.092989 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3098/6207] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:13:30 2022] GET /compute/v2.1/servers/b901c166-bba5-475c-a495-e92321720bb5 => generated 1365 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:13:31.149751 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-26e3c1f3-0078-4fae-a949-d0343be8597c tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:13:31.150525 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-26e3c1f3-0078-4fae-a949-d0343be8597c tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: 913a9b5a-dfd5-478a-9424-0114ea3a5006] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:13:31.163620 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-26e3c1f3-0078-4fae-a949-d0343be8597c tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:31.165286 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-26e3c1f3-0078-4fae-a949-d0343be8597c tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:31.166668 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-26e3c1f3-0078-4fae-a949-d0343be8597c tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:31.167385 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-26e3c1f3-0078-4fae-a949-d0343be8597c tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:31.456528 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-26e3c1f3-0078-4fae-a949-d0343be8597c tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:31.470658 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-26e3c1f3-0078-4fae-a949-d0343be8597c tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/913a9b5a-dfd5-478a-9424-0114ea3a5006" status: 200 len: 1695 microversion: 2.1 time: 0.326446 Jan 15 21:13:31.471256 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3110/6208] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:13:31 2022] GET /compute/v2.1/servers/913a9b5a-dfd5-478a-9424-0114ea3a5006 => generated 1695 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:13:32.111386 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-be8ee061-32a1-45cc-8ba2-f315fb52e54c tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:13:32.112044 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-be8ee061-32a1-45cc-8ba2-f315fb52e54c tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] [instance: b901c166-bba5-475c-a495-e92321720bb5] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:13:32.123030 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-be8ee061-32a1-45cc-8ba2-f315fb52e54c tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:32.123782 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-be8ee061-32a1-45cc-8ba2-f315fb52e54c tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:32.124888 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-be8ee061-32a1-45cc-8ba2-f315fb52e54c tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:32.125598 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-be8ee061-32a1-45cc-8ba2-f315fb52e54c tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:32.480112 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-be8ee061-32a1-45cc-8ba2-f315fb52e54c tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97ba840be5947569b6c0edf81b76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52caab26f74c4651baf8c681c316c08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:32.488285 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-82ef7b7b-c31c-415c-aacf-cae74fabf70d tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:13:32.488932 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-82ef7b7b-c31c-415c-aacf-cae74fabf70d tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: 913a9b5a-dfd5-478a-9424-0114ea3a5006] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:13:32.500820 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-82ef7b7b-c31c-415c-aacf-cae74fabf70d tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:32.501304 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-82ef7b7b-c31c-415c-aacf-cae74fabf70d tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:32.502098 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-82ef7b7b-c31c-415c-aacf-cae74fabf70d tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:32.503686 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-be8ee061-32a1-45cc-8ba2-f315fb52e54c tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97ba840be5947569b6c0edf81b76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52caab26f74c4651baf8c681c316c08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:32.513248 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-be8ee061-32a1-45cc-8ba2-f315fb52e54c tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97ba840be5947569b6c0edf81b76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52caab26f74c4651baf8c681c316c08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:32.513483 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-82ef7b7b-c31c-415c-aacf-cae74fabf70d tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:32.519470 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-be8ee061-32a1-45cc-8ba2-f315fb52e54c tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] 10.222.0.46 "GET /compute/v2.1/servers/b901c166-bba5-475c-a495-e92321720bb5" status: 200 len: 1365 microversion: 2.47 time: 0.410906 Jan 15 21:13:32.525822 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3099/6209] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:13:32 2022] GET /compute/v2.1/servers/b901c166-bba5-475c-a495-e92321720bb5 => generated 1365 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:13:32.920396 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-82ef7b7b-c31c-415c-aacf-cae74fabf70d tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:32.936864 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-82ef7b7b-c31c-415c-aacf-cae74fabf70d tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/913a9b5a-dfd5-478a-9424-0114ea3a5006" status: 200 len: 1695 microversion: 2.1 time: 0.452818 Jan 15 21:13:32.938062 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3111/6210] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:13:32 2022] GET /compute/v2.1/servers/913a9b5a-dfd5-478a-9424-0114ea3a5006 => generated 1695 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:13:33.576201 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5aa6e49d-cd46-4d78-80b4-5a8698a74107 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:13:33.576855 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-5aa6e49d-cd46-4d78-80b4-5a8698a74107 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] [instance: b901c166-bba5-475c-a495-e92321720bb5] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:13:33.591871 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5aa6e49d-cd46-4d78-80b4-5a8698a74107 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:33.592944 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5aa6e49d-cd46-4d78-80b4-5a8698a74107 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:33.594898 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5aa6e49d-cd46-4d78-80b4-5a8698a74107 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:33.598863 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5aa6e49d-cd46-4d78-80b4-5a8698a74107 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:33.742772 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-5aa6e49d-cd46-4d78-80b4-5a8698a74107 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97ba840be5947569b6c0edf81b76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52caab26f74c4651baf8c681c316c08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:33.760674 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-5aa6e49d-cd46-4d78-80b4-5a8698a74107 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97ba840be5947569b6c0edf81b76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52caab26f74c4651baf8c681c316c08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:33.764505 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-5aa6e49d-cd46-4d78-80b4-5a8698a74107 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97ba840be5947569b6c0edf81b76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52caab26f74c4651baf8c681c316c08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:33.767508 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5aa6e49d-cd46-4d78-80b4-5a8698a74107 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] 10.222.0.46 "GET /compute/v2.1/servers/b901c166-bba5-475c-a495-e92321720bb5" status: 200 len: 1365 microversion: 2.47 time: 0.225003 Jan 15 21:13:33.790903 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3100/6211] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:13:33 2022] GET /compute/v2.1/servers/b901c166-bba5-475c-a495-e92321720bb5 => generated 1365 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:13:33.955136 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-3212227e-799b-40fc-87a0-e9739b56a7f4 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:13:33.956346 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-3212227e-799b-40fc-87a0-e9739b56a7f4 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: 913a9b5a-dfd5-478a-9424-0114ea3a5006] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:13:33.968568 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3212227e-799b-40fc-87a0-e9739b56a7f4 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:33.971456 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3212227e-799b-40fc-87a0-e9739b56a7f4 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:33.972309 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3212227e-799b-40fc-87a0-e9739b56a7f4 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:33.972760 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3212227e-799b-40fc-87a0-e9739b56a7f4 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:34.323079 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-3212227e-799b-40fc-87a0-e9739b56a7f4 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:34.339536 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-3212227e-799b-40fc-87a0-e9739b56a7f4 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/913a9b5a-dfd5-478a-9424-0114ea3a5006" status: 200 len: 1695 microversion: 2.1 time: 0.388316 Jan 15 21:13:34.341288 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3112/6212] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:13:33 2022] GET /compute/v2.1/servers/913a9b5a-dfd5-478a-9424-0114ea3a5006 => generated 1695 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:13:34.796447 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5da4d4bc-f31b-4943-8d57-64d94d8eaa13 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:13:34.797425 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-5da4d4bc-f31b-4943-8d57-64d94d8eaa13 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] [instance: b901c166-bba5-475c-a495-e92321720bb5] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:13:34.807688 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5da4d4bc-f31b-4943-8d57-64d94d8eaa13 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:34.809093 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5da4d4bc-f31b-4943-8d57-64d94d8eaa13 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:34.810322 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5da4d4bc-f31b-4943-8d57-64d94d8eaa13 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:34.811079 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5da4d4bc-f31b-4943-8d57-64d94d8eaa13 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:34.906566 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-5da4d4bc-f31b-4943-8d57-64d94d8eaa13 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97ba840be5947569b6c0edf81b76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52caab26f74c4651baf8c681c316c08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:34.917875 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-5da4d4bc-f31b-4943-8d57-64d94d8eaa13 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97ba840be5947569b6c0edf81b76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52caab26f74c4651baf8c681c316c08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:34.919966 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-5da4d4bc-f31b-4943-8d57-64d94d8eaa13 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97ba840be5947569b6c0edf81b76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52caab26f74c4651baf8c681c316c08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:34.921302 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5da4d4bc-f31b-4943-8d57-64d94d8eaa13 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] 10.222.0.46 "GET /compute/v2.1/servers/b901c166-bba5-475c-a495-e92321720bb5" status: 200 len: 1365 microversion: 2.47 time: 0.129131 Jan 15 21:13:34.934789 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3101/6213] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:13:34 2022] GET /compute/v2.1/servers/b901c166-bba5-475c-a495-e92321720bb5 => generated 1365 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:13:35.375172 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-723d4846-f525-46c7-b665-9b6e92a7e3c8 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:13:35.378142 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-723d4846-f525-46c7-b665-9b6e92a7e3c8 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: 913a9b5a-dfd5-478a-9424-0114ea3a5006] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:13:35.413380 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-723d4846-f525-46c7-b665-9b6e92a7e3c8 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:35.416006 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-723d4846-f525-46c7-b665-9b6e92a7e3c8 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:35.418642 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-723d4846-f525-46c7-b665-9b6e92a7e3c8 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:35.419631 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-723d4846-f525-46c7-b665-9b6e92a7e3c8 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:35.941922 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a715cd6c-0e9a-4ee3-a8c5-f12ecad903ed tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:13:35.943675 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a715cd6c-0e9a-4ee3-a8c5-f12ecad903ed tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] [instance: b901c166-bba5-475c-a495-e92321720bb5] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:13:35.960735 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a715cd6c-0e9a-4ee3-a8c5-f12ecad903ed tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:35.962982 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a715cd6c-0e9a-4ee3-a8c5-f12ecad903ed tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:35.967654 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a715cd6c-0e9a-4ee3-a8c5-f12ecad903ed tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:35.968374 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a715cd6c-0e9a-4ee3-a8c5-f12ecad903ed tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:36.194857 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-a715cd6c-0e9a-4ee3-a8c5-f12ecad903ed tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97ba840be5947569b6c0edf81b76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52caab26f74c4651baf8c681c316c08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:36.205238 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-a715cd6c-0e9a-4ee3-a8c5-f12ecad903ed tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97ba840be5947569b6c0edf81b76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52caab26f74c4651baf8c681c316c08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:36.217734 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-723d4846-f525-46c7-b665-9b6e92a7e3c8 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:36.228804 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-a715cd6c-0e9a-4ee3-a8c5-f12ecad903ed tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97ba840be5947569b6c0edf81b76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52caab26f74c4651baf8c681c316c08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:36.230895 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a715cd6c-0e9a-4ee3-a8c5-f12ecad903ed tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] 10.222.0.46 "GET /compute/v2.1/servers/b901c166-bba5-475c-a495-e92321720bb5" status: 200 len: 1365 microversion: 2.47 time: 0.293005 Jan 15 21:13:36.243332 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-723d4846-f525-46c7-b665-9b6e92a7e3c8 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/913a9b5a-dfd5-478a-9424-0114ea3a5006" status: 200 len: 1695 microversion: 2.1 time: 0.876367 Jan 15 21:13:36.255747 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3102/6214] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:13:35 2022] GET /compute/v2.1/servers/b901c166-bba5-475c-a495-e92321720bb5 => generated 1365 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 15 21:13:36.266596 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3113/6215] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:13:35 2022] GET /compute/v2.1/servers/913a9b5a-dfd5-478a-9424-0114ea3a5006 => generated 1695 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:13:36.714352 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9a973066-f9b9-4625-b941-98f018c80763 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Action: 'create', calling method: .version_select at 0x7f30c83a0d30>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1902473020"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:13:36.730031 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-9a973066-f9b9-4625-b941-98f018c80763 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Getting quotas for project de60cd8289224f1f81ef0db9ec3c6f87. Resources: {'key_pairs'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:13:36.737461 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-9a973066-f9b9-4625-b941-98f018c80763 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Getting quotas for user 4b0d769340dc4d36b83436c7fc78bbe5 and project de60cd8289224f1f81ef0db9ec3c6f87. Resources: {'key_pairs'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:13:36.860626 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-9a973066-f9b9-4625-b941-98f018c80763 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Getting quotas for project de60cd8289224f1f81ef0db9ec3c6f87. Resources: {'key_pairs'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:13:36.866483 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-9a973066-f9b9-4625-b941-98f018c80763 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Getting quotas for user 4b0d769340dc4d36b83436c7fc78bbe5 and project de60cd8289224f1f81ef0db9ec3c6f87. Resources: {'key_pairs'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:13:36.902772 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-9a973066-f9b9-4625-b941-98f018c80763 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 2317 microversion: 2.1 time: 0.192794 Jan 15 21:13:36.903975 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3103/6216] 10.222.0.46 () {60 vars in 1157 bytes} [Sat Jan 15 21:13:36 2022] POST /compute/v2.1/os-keypairs => generated 2317 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:13:37.255740 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8d1337c1-1b5f-4cc9-84c6-3491147ea196 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:13:37.257085 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-8d1337c1-1b5f-4cc9-84c6-3491147ea196 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] [instance: b901c166-bba5-475c-a495-e92321720bb5] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:13:37.260394 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-76597a61-c151-46f2-8e45-951c63d58800 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:13:37.262981 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-76597a61-c151-46f2-8e45-951c63d58800 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: 913a9b5a-dfd5-478a-9424-0114ea3a5006] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:13:37.281618 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8d1337c1-1b5f-4cc9-84c6-3491147ea196 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:37.282102 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8d1337c1-1b5f-4cc9-84c6-3491147ea196 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:37.282966 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8d1337c1-1b5f-4cc9-84c6-3491147ea196 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:37.283457 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8d1337c1-1b5f-4cc9-84c6-3491147ea196 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:37.292259 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-76597a61-c151-46f2-8e45-951c63d58800 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:37.298847 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-76597a61-c151-46f2-8e45-951c63d58800 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:37.317498 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-76597a61-c151-46f2-8e45-951c63d58800 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:37.333680 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-76597a61-c151-46f2-8e45-951c63d58800 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:38.216108 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-76597a61-c151-46f2-8e45-951c63d58800 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:38.242925 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-76597a61-c151-46f2-8e45-951c63d58800 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/913a9b5a-dfd5-478a-9424-0114ea3a5006" status: 200 len: 1695 microversion: 2.1 time: 0.984195 Jan 15 21:13:38.246402 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3104/6217] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:13:37 2022] GET /compute/v2.1/servers/913a9b5a-dfd5-478a-9424-0114ea3a5006 => generated 1695 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:13:38.323658 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-8d1337c1-1b5f-4cc9-84c6-3491147ea196 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97ba840be5947569b6c0edf81b76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52caab26f74c4651baf8c681c316c08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:38.332377 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-8d1337c1-1b5f-4cc9-84c6-3491147ea196 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97ba840be5947569b6c0edf81b76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52caab26f74c4651baf8c681c316c08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:38.338498 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-8d1337c1-1b5f-4cc9-84c6-3491147ea196 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97ba840be5947569b6c0edf81b76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52caab26f74c4651baf8c681c316c08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:38.343566 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-8d1337c1-1b5f-4cc9-84c6-3491147ea196 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] 10.222.0.46 "GET /compute/v2.1/servers/b901c166-bba5-475c-a495-e92321720bb5" status: 200 len: 1365 microversion: 2.47 time: 1.093330 Jan 15 21:13:38.344263 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3114/6218] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:13:37 2022] GET /compute/v2.1/servers/b901c166-bba5-475c-a495-e92321720bb5 => generated 1365 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:13:39.269967 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-979af6ef-aa67-4712-be49-291b00d3b1e1 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:13:39.271003 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-979af6ef-aa67-4712-be49-291b00d3b1e1 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: 913a9b5a-dfd5-478a-9424-0114ea3a5006] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:13:39.285108 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-979af6ef-aa67-4712-be49-291b00d3b1e1 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:39.290033 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-979af6ef-aa67-4712-be49-291b00d3b1e1 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:39.294068 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-979af6ef-aa67-4712-be49-291b00d3b1e1 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:39.294773 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-979af6ef-aa67-4712-be49-291b00d3b1e1 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:39.374606 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-238d114a-9f1f-4a94-8665-44280f56e94e tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:13:39.382798 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-238d114a-9f1f-4a94-8665-44280f56e94e tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] [instance: b901c166-bba5-475c-a495-e92321720bb5] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:13:39.412448 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-238d114a-9f1f-4a94-8665-44280f56e94e tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:39.413203 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-238d114a-9f1f-4a94-8665-44280f56e94e tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:39.415645 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-238d114a-9f1f-4a94-8665-44280f56e94e tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:39.416260 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-238d114a-9f1f-4a94-8665-44280f56e94e tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:39.916966 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-238d114a-9f1f-4a94-8665-44280f56e94e tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97ba840be5947569b6c0edf81b76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52caab26f74c4651baf8c681c316c08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:39.931075 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-238d114a-9f1f-4a94-8665-44280f56e94e tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97ba840be5947569b6c0edf81b76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52caab26f74c4651baf8c681c316c08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:39.937311 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-238d114a-9f1f-4a94-8665-44280f56e94e tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97ba840be5947569b6c0edf81b76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52caab26f74c4651baf8c681c316c08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:39.939027 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-238d114a-9f1f-4a94-8665-44280f56e94e tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] 10.222.0.46 "GET /compute/v2.1/servers/b901c166-bba5-475c-a495-e92321720bb5" status: 200 len: 1365 microversion: 2.47 time: 0.579730 Jan 15 21:13:39.943575 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3115/6219] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:13:39 2022] GET /compute/v2.1/servers/b901c166-bba5-475c-a495-e92321720bb5 => generated 1365 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 15 21:13:40.321263 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-979af6ef-aa67-4712-be49-291b00d3b1e1 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:40.337818 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-979af6ef-aa67-4712-be49-291b00d3b1e1 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/913a9b5a-dfd5-478a-9424-0114ea3a5006" status: 200 len: 1695 microversion: 2.1 time: 1.078222 Jan 15 21:13:40.338533 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3105/6220] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:13:39 2022] GET /compute/v2.1/servers/913a9b5a-dfd5-478a-9424-0114ea3a5006 => generated 1695 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:13:40.961749 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-dd78273a-062b-4fdf-a91e-777f0abccda9 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:13:40.962352 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-dd78273a-062b-4fdf-a91e-777f0abccda9 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] [instance: b901c166-bba5-475c-a495-e92321720bb5] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:13:40.970845 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dd78273a-062b-4fdf-a91e-777f0abccda9 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:40.981969 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dd78273a-062b-4fdf-a91e-777f0abccda9 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:40.982994 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dd78273a-062b-4fdf-a91e-777f0abccda9 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:40.983615 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dd78273a-062b-4fdf-a91e-777f0abccda9 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:41.100902 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-c71f75cb-41d6-48c5-b40b-0123721215e9 req-f802e54a-fbe0-4f57-a829-e4c8b7596d6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "913a9b5a-dfd5-478a-9424-0114ea3a5006", "name": "network-vif-unplugged", "status": "completed", "tag": "00a046e1-4575-48fc-acfb-813600567478"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:13:41.102833 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:13:41.102833 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:13:41.114246 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-dd78273a-062b-4fdf-a91e-777f0abccda9 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97ba840be5947569b6c0edf81b76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52caab26f74c4651baf8c681c316c08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:41.117113 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-c71f75cb-41d6-48c5-b40b-0123721215e9 req-f802e54a-fbe0-4f57-a829-e4c8b7596d6d service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:41.117575 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-c71f75cb-41d6-48c5-b40b-0123721215e9 req-f802e54a-fbe0-4f57-a829-e4c8b7596d6d service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:41.126800 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-dd78273a-062b-4fdf-a91e-777f0abccda9 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97ba840be5947569b6c0edf81b76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52caab26f74c4651baf8c681c316c08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:41.128299 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-dd78273a-062b-4fdf-a91e-777f0abccda9 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97ba840be5947569b6c0edf81b76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52caab26f74c4651baf8c681c316c08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:41.129950 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-dd78273a-062b-4fdf-a91e-777f0abccda9 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] 10.222.0.46 "GET /compute/v2.1/servers/b901c166-bba5-475c-a495-e92321720bb5" status: 200 len: 1371 microversion: 2.47 time: 0.172678 Jan 15 21:13:41.133630 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3116/6221] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:13:40 2022] GET /compute/v2.1/servers/b901c166-bba5-475c-a495-e92321720bb5 => generated 1371 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:13:41.140425 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-c71f75cb-41d6-48c5-b40b-0123721215e9 req-f802e54a-fbe0-4f57-a829-e4c8b7596d6d service nova] Creating event network-vif-unplugged:00a046e1-4575-48fc-acfb-813600567478 for instance 913a9b5a-dfd5-478a-9424-0114ea3a5006 on nch2-master-1 Jan 15 21:13:41.149579 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [req-c71f75cb-41d6-48c5-b40b-0123721215e9 req-f802e54a-fbe0-4f57-a829-e4c8b7596d6d service nova] Instance 913a9b5a-dfd5-478a-9424-0114ea3a5006 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=129365) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Jan 15 21:13:41.167745 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-c71f75cb-41d6-48c5-b40b-0123721215e9 req-f802e54a-fbe0-4f57-a829-e4c8b7596d6d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.071519 Jan 15 21:13:41.170872 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3106/6222] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:13:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 21:13:41.367583 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e23c12c2-642e-4e4b-8b0c-b2cf63062d60 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:13:41.368703 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e23c12c2-642e-4e4b-8b0c-b2cf63062d60 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: 913a9b5a-dfd5-478a-9424-0114ea3a5006] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:13:41.389116 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e23c12c2-642e-4e4b-8b0c-b2cf63062d60 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:41.393021 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e23c12c2-642e-4e4b-8b0c-b2cf63062d60 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:41.394720 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e23c12c2-642e-4e4b-8b0c-b2cf63062d60 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:41.395347 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e23c12c2-642e-4e4b-8b0c-b2cf63062d60 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:41.823363 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-e23c12c2-642e-4e4b-8b0c-b2cf63062d60 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:41.852440 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e23c12c2-642e-4e4b-8b0c-b2cf63062d60 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/913a9b5a-dfd5-478a-9424-0114ea3a5006" status: 200 len: 1694 microversion: 2.1 time: 0.493542 Jan 15 21:13:41.866222 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3117/6223] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:13:41 2022] GET /compute/v2.1/servers/913a9b5a-dfd5-478a-9424-0114ea3a5006 => generated 1694 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:13:42.159149 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-19abe511-4952-4500-9bce-2f663b178cc5 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:13:42.160113 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-19abe511-4952-4500-9bce-2f663b178cc5 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] [instance: b901c166-bba5-475c-a495-e92321720bb5] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:13:42.190440 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-19abe511-4952-4500-9bce-2f663b178cc5 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:42.190897 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-19abe511-4952-4500-9bce-2f663b178cc5 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:42.196493 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-19abe511-4952-4500-9bce-2f663b178cc5 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:42.200057 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-19abe511-4952-4500-9bce-2f663b178cc5 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:42.403744 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-19abe511-4952-4500-9bce-2f663b178cc5 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97ba840be5947569b6c0edf81b76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52caab26f74c4651baf8c681c316c08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:42.421557 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-19abe511-4952-4500-9bce-2f663b178cc5 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97ba840be5947569b6c0edf81b76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52caab26f74c4651baf8c681c316c08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:42.430052 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-19abe511-4952-4500-9bce-2f663b178cc5 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97ba840be5947569b6c0edf81b76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52caab26f74c4651baf8c681c316c08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:42.437281 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-19abe511-4952-4500-9bce-2f663b178cc5 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] 10.222.0.46 "GET /compute/v2.1/servers/b901c166-bba5-475c-a495-e92321720bb5" status: 200 len: 1356 microversion: 2.47 time: 0.281512 Jan 15 21:13:42.442509 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3107/6224] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:13:42 2022] GET /compute/v2.1/servers/b901c166-bba5-475c-a495-e92321720bb5 => generated 1356 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:13:42.471995 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-6794d4d5-1515-4d2d-813d-4442e379e62a tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:13:42.476433 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:13:42.476433 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:13:42.479934 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-6794d4d5-1515-4d2d-813d-4442e379e62a tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b97ba840be5947569b6c0edf81b76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52caab26f74c4651baf8c681c316c08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:42.484498 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-6794d4d5-1515-4d2d-813d-4442e379e62a tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Searching by: {'deleted': False, 'project_id': '52caab26f74c4651baf8c681c316c08e'} {{(pid=129366) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 15 21:13:42.510884 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6794d4d5-1515-4d2d-813d-4442e379e62a tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:42.514435 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6794d4d5-1515-4d2d-813d-4442e379e62a tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:42.521495 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6794d4d5-1515-4d2d-813d-4442e379e62a tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:42.522096 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6794d4d5-1515-4d2d-813d-4442e379e62a tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:42.680042 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2b0acd0a-c287-4a3b-ae57-1058cd6f1a46 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-239860241", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "networks": [{"uuid": "65f802dd-98dd-4371-b43c-7230f851e671"}], "key_name": "tempest-TestNetworkBasicOps-1902473020", "security_groups": [{"name": "tempest-secgroup-smoke-1376798545"}]}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:13:42.862637 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.multi_cell_list [None req-6794d4d5-1515-4d2d-813d-4442e379e62a tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=129366) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jan 15 21:13:43.040235 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.network.neutron [None req-2b0acd0a-c287-4a3b-ae57-1058cd6f1a46 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] validate_networks() for [('65f802dd-98dd-4371-b43c-7230f851e671', None, None, None, None, None)] {{(pid=129365) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 21:13:43.054149 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-6794d4d5-1515-4d2d-813d-4442e379e62a tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97ba840be5947569b6c0edf81b76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52caab26f74c4651baf8c681c316c08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:43.062997 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6794d4d5-1515-4d2d-813d-4442e379e62a tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:43.063452 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6794d4d5-1515-4d2d-813d-4442e379e62a tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:43.078976 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-6794d4d5-1515-4d2d-813d-4442e379e62a tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97ba840be5947569b6c0edf81b76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52caab26f74c4651baf8c681c316c08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:43.080755 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-6794d4d5-1515-4d2d-813d-4442e379e62a tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97ba840be5947569b6c0edf81b76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52caab26f74c4651baf8c681c316c08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:43.421160 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-6794d4d5-1515-4d2d-813d-4442e379e62a tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] 10.222.0.46 "GET /compute/v2.1/servers/detail" status: 200 len: 2705 microversion: 2.47 time: 0.961514 Jan 15 21:13:43.422695 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3118/6225] 10.222.0.46 () {60 vars in 1186 bytes} [Sat Jan 15 21:13:42 2022] GET /compute/v2.1/servers/detail => generated 2705 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:13:43.428035 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7642c7d9-5019-4acd-99f9-943cf2f576e4 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:13:43.428864 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-7642c7d9-5019-4acd-99f9-943cf2f576e4 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: 913a9b5a-dfd5-478a-9424-0114ea3a5006] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:13:43.454116 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7642c7d9-5019-4acd-99f9-943cf2f576e4 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:43.454874 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7642c7d9-5019-4acd-99f9-943cf2f576e4 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:43.455888 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7642c7d9-5019-4acd-99f9-943cf2f576e4 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:43.456502 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7642c7d9-5019-4acd-99f9-943cf2f576e4 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:43.986080 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-7642c7d9-5019-4acd-99f9-943cf2f576e4 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:43.994924 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7642c7d9-5019-4acd-99f9-943cf2f576e4 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/913a9b5a-dfd5-478a-9424-0114ea3a5006" status: 200 len: 1694 microversion: 2.1 time: 0.571151 Jan 15 21:13:43.995509 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3119/6226] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:13:43 2022] GET /compute/v2.1/servers/913a9b5a-dfd5-478a-9424-0114ea3a5006 => generated 1694 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:13:44.000378 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-6b092874-457e-4cba-83da-59e2a03d8801 req-cf39e1e0-ba73-429b-b394-211b4192753e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "913a9b5a-dfd5-478a-9424-0114ea3a5006", "tag": "00a046e1-4575-48fc-acfb-813600567478"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:13:44.001795 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:13:44.001795 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:13:44.009796 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-6b092874-457e-4cba-83da-59e2a03d8801 req-cf39e1e0-ba73-429b-b394-211b4192753e service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:44.010365 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-6b092874-457e-4cba-83da-59e2a03d8801 req-cf39e1e0-ba73-429b-b394-211b4192753e service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:44.034794 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-6b092874-457e-4cba-83da-59e2a03d8801 req-cf39e1e0-ba73-429b-b394-211b4192753e service nova] Creating event network-changed:00a046e1-4575-48fc-acfb-813600567478 for instance 913a9b5a-dfd5-478a-9424-0114ea3a5006 on nch2-master-1 Jan 15 21:13:44.041226 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [req-6b092874-457e-4cba-83da-59e2a03d8801 req-cf39e1e0-ba73-429b-b394-211b4192753e service nova] Instance 913a9b5a-dfd5-478a-9424-0114ea3a5006 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=129366) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Jan 15 21:13:44.054284 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-6b092874-457e-4cba-83da-59e2a03d8801 req-cf39e1e0-ba73-429b-b394-211b4192753e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057418 Jan 15 21:13:44.055270 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3120/6227] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:13:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:13:44.060639 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b7269c3a-a38d-4a07-9ddd-7e3da1bc26bf tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:13:44.061257 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b7269c3a-a38d-4a07-9ddd-7e3da1bc26bf tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] [instance: b901c166-bba5-475c-a495-e92321720bb5] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:13:44.068566 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b7269c3a-a38d-4a07-9ddd-7e3da1bc26bf tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:44.069227 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b7269c3a-a38d-4a07-9ddd-7e3da1bc26bf tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:44.070212 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b7269c3a-a38d-4a07-9ddd-7e3da1bc26bf tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:44.070805 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b7269c3a-a38d-4a07-9ddd-7e3da1bc26bf tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:44.098531 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b7269c3a-a38d-4a07-9ddd-7e3da1bc26bf tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] [instance: b901c166-bba5-475c-a495-e92321720bb5] Going to try to terminate instance {{(pid=129366) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 21:13:44.221909 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b7269c3a-a38d-4a07-9ddd-7e3da1bc26bf tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] 10.222.0.46 "DELETE /compute/v2.1/servers/b901c166-bba5-475c-a495-e92321720bb5" status: 204 len: 0 microversion: 2.47 time: 0.164841 Jan 15 21:13:44.223039 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3121/6228] 10.222.0.46 () {60 vars in 1279 bytes} [Sat Jan 15 21:13:44 2022] DELETE /compute/v2.1/servers/b901c166-bba5-475c-a495-e92321720bb5 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 15 21:13:44.233609 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e76da32a-22b2-4dc0-a1ef-6f466ce23eb8 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:13:44.234865 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e76da32a-22b2-4dc0-a1ef-6f466ce23eb8 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] [instance: b901c166-bba5-475c-a495-e92321720bb5] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:13:44.242379 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e76da32a-22b2-4dc0-a1ef-6f466ce23eb8 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:44.243249 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e76da32a-22b2-4dc0-a1ef-6f466ce23eb8 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:44.244595 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e76da32a-22b2-4dc0-a1ef-6f466ce23eb8 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:44.245269 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e76da32a-22b2-4dc0-a1ef-6f466ce23eb8 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:44.403258 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-e76da32a-22b2-4dc0-a1ef-6f466ce23eb8 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97ba840be5947569b6c0edf81b76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52caab26f74c4651baf8c681c316c08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:44.416388 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-e76da32a-22b2-4dc0-a1ef-6f466ce23eb8 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97ba840be5947569b6c0edf81b76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52caab26f74c4651baf8c681c316c08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:44.418031 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-e76da32a-22b2-4dc0-a1ef-6f466ce23eb8 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97ba840be5947569b6c0edf81b76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52caab26f74c4651baf8c681c316c08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:44.419238 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e76da32a-22b2-4dc0-a1ef-6f466ce23eb8 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] 10.222.0.46 "GET /compute/v2.1/servers/b901c166-bba5-475c-a495-e92321720bb5" status: 200 len: 1362 microversion: 2.47 time: 0.191225 Jan 15 21:13:44.419802 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3122/6229] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:13:44 2022] GET /compute/v2.1/servers/b901c166-bba5-475c-a495-e92321720bb5 => generated 1362 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 15 21:13:44.618758 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-2b0acd0a-c287-4a3b-ae57-1058cd6f1a46 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Flavor limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 21:13:44.619186 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-2b0acd0a-c287-4a3b-ae57-1058cd6f1a46 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Image limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 21:13:44.619710 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-2b0acd0a-c287-4a3b-ae57-1058cd6f1a46 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Flavor pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 21:13:44.620207 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-2b0acd0a-c287-4a3b-ae57-1058cd6f1a46 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Image pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 21:13:44.621171 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-2b0acd0a-c287-4a3b-ae57-1058cd6f1a46 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 21:13:44.630341 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2b0acd0a-c287-4a3b-ae57-1058cd6f1a46 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:44.630880 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2b0acd0a-c287-4a3b-ae57-1058cd6f1a46 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:44.631925 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2b0acd0a-c287-4a3b-ae57-1058cd6f1a46 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:44.632431 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2b0acd0a-c287-4a3b-ae57-1058cd6f1a46 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:44.650774 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-2b0acd0a-c287-4a3b-ae57-1058cd6f1a46 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Getting quotas for project de60cd8289224f1f81ef0db9ec3c6f87. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:13:44.656447 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-2b0acd0a-c287-4a3b-ae57-1058cd6f1a46 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Getting quotas for user 4b0d769340dc4d36b83436c7fc78bbe5 and project de60cd8289224f1f81ef0db9ec3c6f87. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:13:44.673286 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-2b0acd0a-c287-4a3b-ae57-1058cd6f1a46 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Going to run 1 instances... {{(pid=129365) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 21:13:44.676642 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-2b0acd0a-c287-4a3b-ae57-1058cd6f1a46 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] [instance: 7ebb1b58-541d-4104-b003-8e0b91c1634f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129365) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 21:13:44.730165 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2b0acd0a-c287-4a3b-ae57-1058cd6f1a46 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.054541 Jan 15 21:13:44.731007 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3108/6230] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 21:13:42 2022] POST /compute/v2.1/servers => generated 406 bytes in 2056 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 15 21:13:44.743293 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-bfb00fd1-4247-4cc5-8b28-779cb19d23f8 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:13:44.744142 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-bfb00fd1-4247-4cc5-8b28-779cb19d23f8 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] [instance: 7ebb1b58-541d-4104-b003-8e0b91c1634f] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:13:45.011529 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5b0f5a78-e25c-4d8e-a459-32b1db60213e tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:13:45.012140 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-5b0f5a78-e25c-4d8e-a459-32b1db60213e tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: 913a9b5a-dfd5-478a-9424-0114ea3a5006] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:13:45.018764 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5b0f5a78-e25c-4d8e-a459-32b1db60213e tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:45.019480 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5b0f5a78-e25c-4d8e-a459-32b1db60213e tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:45.020456 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5b0f5a78-e25c-4d8e-a459-32b1db60213e tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:45.021731 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5b0f5a78-e25c-4d8e-a459-32b1db60213e tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:45.101296 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-bfb00fd1-4247-4cc5-8b28-779cb19d23f8 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0d769340dc4d36b83436c7fc78bbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de60cd8289224f1f81ef0db9ec3c6f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:45.110304 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-bfb00fd1-4247-4cc5-8b28-779cb19d23f8 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] 10.222.0.46 "GET /compute/v2.1/servers/7ebb1b58-541d-4104-b003-8e0b91c1634f" status: 200 len: 1248 microversion: 2.1 time: 0.371343 Jan 15 21:13:45.121248 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3123/6231] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:13:44 2022] GET /compute/v2.1/servers/7ebb1b58-541d-4104-b003-8e0b91c1634f => generated 1248 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:13:45.390952 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-5b0f5a78-e25c-4d8e-a459-32b1db60213e tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:45.400636 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5b0f5a78-e25c-4d8e-a459-32b1db60213e tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/913a9b5a-dfd5-478a-9424-0114ea3a5006" status: 200 len: 1692 microversion: 2.1 time: 0.392761 Jan 15 21:13:45.401578 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3109/6232] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:13:45 2022] GET /compute/v2.1/servers/913a9b5a-dfd5-478a-9424-0114ea3a5006 => generated 1692 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:13:45.437209 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-04a9bbb9-5509-4031-900a-7cf186fd82bf tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:13:45.437815 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-04a9bbb9-5509-4031-900a-7cf186fd82bf tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] [instance: b901c166-bba5-475c-a495-e92321720bb5] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:13:45.445731 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-04a9bbb9-5509-4031-900a-7cf186fd82bf tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:45.446520 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-04a9bbb9-5509-4031-900a-7cf186fd82bf tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:45.447718 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-04a9bbb9-5509-4031-900a-7cf186fd82bf tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:45.448324 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-04a9bbb9-5509-4031-900a-7cf186fd82bf tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:45.574335 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-04a9bbb9-5509-4031-900a-7cf186fd82bf tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97ba840be5947569b6c0edf81b76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52caab26f74c4651baf8c681c316c08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:45.585022 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-04a9bbb9-5509-4031-900a-7cf186fd82bf tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97ba840be5947569b6c0edf81b76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52caab26f74c4651baf8c681c316c08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:45.586806 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-04a9bbb9-5509-4031-900a-7cf186fd82bf tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97ba840be5947569b6c0edf81b76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52caab26f74c4651baf8c681c316c08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:45.587987 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-04a9bbb9-5509-4031-900a-7cf186fd82bf tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] 10.222.0.46 "GET /compute/v2.1/servers/b901c166-bba5-475c-a495-e92321720bb5" status: 200 len: 1362 microversion: 2.47 time: 0.154751 Jan 15 21:13:45.599434 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3124/6233] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:13:45 2022] GET /compute/v2.1/servers/b901c166-bba5-475c-a495-e92321720bb5 => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:13:46.129478 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-92013149-4871-4fef-bfdb-ac3a0ce94edb tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:13:46.130670 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-92013149-4871-4fef-bfdb-ac3a0ce94edb tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] [instance: 7ebb1b58-541d-4104-b003-8e0b91c1634f] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:13:46.137697 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-92013149-4871-4fef-bfdb-ac3a0ce94edb tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:46.138147 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-92013149-4871-4fef-bfdb-ac3a0ce94edb tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:46.138931 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-92013149-4871-4fef-bfdb-ac3a0ce94edb tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:46.139368 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-92013149-4871-4fef-bfdb-ac3a0ce94edb tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:46.283138 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-92013149-4871-4fef-bfdb-ac3a0ce94edb tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0d769340dc4d36b83436c7fc78bbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de60cd8289224f1f81ef0db9ec3c6f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:46.298500 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-92013149-4871-4fef-bfdb-ac3a0ce94edb tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] 10.222.0.46 "GET /compute/v2.1/servers/7ebb1b58-541d-4104-b003-8e0b91c1634f" status: 200 len: 1306 microversion: 2.1 time: 0.173307 Jan 15 21:13:46.299102 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3110/6234] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:13:46 2022] GET /compute/v2.1/servers/7ebb1b58-541d-4104-b003-8e0b91c1634f => generated 1306 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:13:46.418929 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0c80b678-2ad2-45ff-b807-4ff0c7677e8f tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:13:46.419530 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-0c80b678-2ad2-45ff-b807-4ff0c7677e8f tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: 913a9b5a-dfd5-478a-9424-0114ea3a5006] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:13:46.437168 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0c80b678-2ad2-45ff-b807-4ff0c7677e8f tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:46.443214 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0c80b678-2ad2-45ff-b807-4ff0c7677e8f tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:46.446875 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0c80b678-2ad2-45ff-b807-4ff0c7677e8f tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:46.447561 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0c80b678-2ad2-45ff-b807-4ff0c7677e8f tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:46.610637 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-26b5d26d-ab66-48f1-8d41-8550eb4ddb66 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:13:46.611544 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-26b5d26d-ab66-48f1-8d41-8550eb4ddb66 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] [instance: b901c166-bba5-475c-a495-e92321720bb5] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:13:46.621645 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-26b5d26d-ab66-48f1-8d41-8550eb4ddb66 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:46.622640 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-26b5d26d-ab66-48f1-8d41-8550eb4ddb66 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:46.624883 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-26b5d26d-ab66-48f1-8d41-8550eb4ddb66 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:46.625819 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-26b5d26d-ab66-48f1-8d41-8550eb4ddb66 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:46.671063 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-26b5d26d-ab66-48f1-8d41-8550eb4ddb66 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:46.671780 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-26b5d26d-ab66-48f1-8d41-8550eb4ddb66 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:46.672394 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.objects.instance [None req-26b5d26d-ab66-48f1-8d41-8550eb4ddb66 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lazy-loading 'fault' on Instance uuid b901c166-bba5-475c-a495-e92321720bb5 {{(pid=129365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 21:13:46.791988 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-26b5d26d-ab66-48f1-8d41-8550eb4ddb66 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97ba840be5947569b6c0edf81b76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52caab26f74c4651baf8c681c316c08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:46.800149 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-26b5d26d-ab66-48f1-8d41-8550eb4ddb66 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97ba840be5947569b6c0edf81b76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52caab26f74c4651baf8c681c316c08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:46.801709 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-26b5d26d-ab66-48f1-8d41-8550eb4ddb66 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97ba840be5947569b6c0edf81b76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52caab26f74c4651baf8c681c316c08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:46.803040 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-26b5d26d-ab66-48f1-8d41-8550eb4ddb66 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] 10.222.0.46 "GET /compute/v2.1/servers/b901c166-bba5-475c-a495-e92321720bb5" status: 200 len: 1367 microversion: 2.47 time: 0.199590 Jan 15 21:13:46.814584 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3111/6235] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:13:46 2022] GET /compute/v2.1/servers/b901c166-bba5-475c-a495-e92321720bb5 => generated 1367 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:13:46.889318 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-0c80b678-2ad2-45ff-b807-4ff0c7677e8f tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:46.897691 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0c80b678-2ad2-45ff-b807-4ff0c7677e8f tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/913a9b5a-dfd5-478a-9424-0114ea3a5006" status: 200 len: 1689 microversion: 2.1 time: 0.482527 Jan 15 21:13:46.898284 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3125/6236] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:13:46 2022] GET /compute/v2.1/servers/913a9b5a-dfd5-478a-9424-0114ea3a5006 => generated 1689 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:13:46.915469 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-36eba258-1029-44c7-828c-32cbbd9995d5 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:13:46.916454 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-36eba258-1029-44c7-828c-32cbbd9995d5 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: 913a9b5a-dfd5-478a-9424-0114ea3a5006] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:13:46.923571 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-36eba258-1029-44c7-828c-32cbbd9995d5 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:46.924683 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-36eba258-1029-44c7-828c-32cbbd9995d5 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:46.925038 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-36eba258-1029-44c7-828c-32cbbd9995d5 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:46.927872 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-36eba258-1029-44c7-828c-32cbbd9995d5 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:46.995718 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-36eba258-1029-44c7-828c-32cbbd9995d5 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "POST /compute/v2.1/servers/913a9b5a-dfd5-478a-9424-0114ea3a5006/action" status: 204 len: 0 microversion: 2.1 time: 0.084976 Jan 15 21:13:46.996919 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3112/6237] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:13:46 2022] POST /compute/v2.1/servers/913a9b5a-dfd5-478a-9424-0114ea3a5006/action => generated 0 bytes in 87 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 21:13:47.006646 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d655d601-5e6d-42a7-a30b-5765ef7b48f8 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:13:47.008607 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-d655d601-5e6d-42a7-a30b-5765ef7b48f8 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: 913a9b5a-dfd5-478a-9424-0114ea3a5006] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:13:47.016590 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d655d601-5e6d-42a7-a30b-5765ef7b48f8 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:47.017365 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d655d601-5e6d-42a7-a30b-5765ef7b48f8 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:47.018596 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d655d601-5e6d-42a7-a30b-5765ef7b48f8 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:47.019190 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d655d601-5e6d-42a7-a30b-5765ef7b48f8 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:47.316700 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-547b79bb-01b9-4512-ac52-154ce4d6994c tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:13:47.317560 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-547b79bb-01b9-4512-ac52-154ce4d6994c tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] [instance: 7ebb1b58-541d-4104-b003-8e0b91c1634f] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:13:47.329799 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-547b79bb-01b9-4512-ac52-154ce4d6994c tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:47.330262 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-547b79bb-01b9-4512-ac52-154ce4d6994c tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:47.331059 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-547b79bb-01b9-4512-ac52-154ce4d6994c tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:47.331500 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-547b79bb-01b9-4512-ac52-154ce4d6994c tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:47.443908 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-d655d601-5e6d-42a7-a30b-5765ef7b48f8 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:47.455598 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d655d601-5e6d-42a7-a30b-5765ef7b48f8 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/913a9b5a-dfd5-478a-9424-0114ea3a5006" status: 200 len: 1689 microversion: 2.1 time: 0.453616 Jan 15 21:13:47.460088 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3126/6238] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:13:47 2022] GET /compute/v2.1/servers/913a9b5a-dfd5-478a-9424-0114ea3a5006 => generated 1689 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:13:47.823323 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b282e9bf-dad1-48b0-9d7a-d3a133e8176e tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:13:47.823948 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b282e9bf-dad1-48b0-9d7a-d3a133e8176e tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] [instance: b901c166-bba5-475c-a495-e92321720bb5] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:13:47.829993 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b282e9bf-dad1-48b0-9d7a-d3a133e8176e tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:47.830717 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b282e9bf-dad1-48b0-9d7a-d3a133e8176e tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:47.831678 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b282e9bf-dad1-48b0-9d7a-d3a133e8176e tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:47.832270 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b282e9bf-dad1-48b0-9d7a-d3a133e8176e tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:47.851197 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-b282e9bf-dad1-48b0-9d7a-d3a133e8176e tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] HTTP exception thrown: Instance b901c166-bba5-475c-a495-e92321720bb5 could not be found. Jan 15 21:13:47.852121 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b282e9bf-dad1-48b0-9d7a-d3a133e8176e tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Returning 404 to user: Instance b901c166-bba5-475c-a495-e92321720bb5 could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:13:47.853370 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b282e9bf-dad1-48b0-9d7a-d3a133e8176e tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] 10.222.0.46 "GET /compute/v2.1/servers/b901c166-bba5-475c-a495-e92321720bb5" status: 404 len: 111 microversion: 2.47 time: 0.035408 Jan 15 21:13:47.854867 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3127/6239] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:13:47 2022] GET /compute/v2.1/servers/b901c166-bba5-475c-a495-e92321720bb5 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jan 15 21:13:47.862057 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-5b4451a5-57ca-4f22-8a84-b7163d223a61 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:13:47.862948 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-5b4451a5-57ca-4f22-8a84-b7163d223a61 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] [instance: 6dbb87c7-d73f-4af4-82f5-3ff4396a3cee] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:13:47.870937 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5b4451a5-57ca-4f22-8a84-b7163d223a61 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:47.871694 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5b4451a5-57ca-4f22-8a84-b7163d223a61 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:47.872677 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5b4451a5-57ca-4f22-8a84-b7163d223a61 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:47.873357 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5b4451a5-57ca-4f22-8a84-b7163d223a61 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:47.900734 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-547b79bb-01b9-4512-ac52-154ce4d6994c tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0d769340dc4d36b83436c7fc78bbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de60cd8289224f1f81ef0db9ec3c6f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:47.908741 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-5b4451a5-57ca-4f22-8a84-b7163d223a61 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] [instance: 6dbb87c7-d73f-4af4-82f5-3ff4396a3cee] Going to try to terminate instance {{(pid=129366) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 21:13:47.909498 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-547b79bb-01b9-4512-ac52-154ce4d6994c tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] 10.222.0.46 "GET /compute/v2.1/servers/7ebb1b58-541d-4104-b003-8e0b91c1634f" status: 200 len: 1374 microversion: 2.1 time: 0.596824 Jan 15 21:13:47.914080 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3113/6240] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:13:47 2022] GET /compute/v2.1/servers/7ebb1b58-541d-4104-b003-8e0b91c1634f => generated 1374 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:13:48.029396 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-5b4451a5-57ca-4f22-8a84-b7163d223a61 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] 10.222.0.46 "DELETE /compute/v2.1/servers/6dbb87c7-d73f-4af4-82f5-3ff4396a3cee" status: 204 len: 0 microversion: 2.47 time: 0.169852 Jan 15 21:13:48.031492 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3128/6241] 10.222.0.46 () {60 vars in 1279 bytes} [Sat Jan 15 21:13:47 2022] DELETE /compute/v2.1/servers/6dbb87c7-d73f-4af4-82f5-3ff4396a3cee => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jan 15 21:13:48.041524 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-4dd95874-8a20-4346-961d-35da8f5be9ef tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:13:48.045040 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-4dd95874-8a20-4346-961d-35da8f5be9ef tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] [instance: 6dbb87c7-d73f-4af4-82f5-3ff4396a3cee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:13:48.056042 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4dd95874-8a20-4346-961d-35da8f5be9ef tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:48.057101 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4dd95874-8a20-4346-961d-35da8f5be9ef tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:48.058116 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4dd95874-8a20-4346-961d-35da8f5be9ef tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:48.059686 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4dd95874-8a20-4346-961d-35da8f5be9ef tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:48.128206 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-59574f64-1310-48f1-956f-9d4798711243 req-a3b0ae57-ab41-4378-891d-18d37369c8d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "913a9b5a-dfd5-478a-9424-0114ea3a5006", "name": "network-vif-plugged", "status": "completed", "tag": "00a046e1-4575-48fc-acfb-813600567478"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:13:48.131864 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:13:48.131864 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:13:48.143081 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-59574f64-1310-48f1-956f-9d4798711243 req-a3b0ae57-ab41-4378-891d-18d37369c8d9 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:48.144205 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-59574f64-1310-48f1-956f-9d4798711243 req-a3b0ae57-ab41-4378-891d-18d37369c8d9 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:48.164094 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-4dd95874-8a20-4346-961d-35da8f5be9ef tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97ba840be5947569b6c0edf81b76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52caab26f74c4651baf8c681c316c08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:48.183664 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-4dd95874-8a20-4346-961d-35da8f5be9ef tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97ba840be5947569b6c0edf81b76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52caab26f74c4651baf8c681c316c08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:48.186991 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-4dd95874-8a20-4346-961d-35da8f5be9ef tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97ba840be5947569b6c0edf81b76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52caab26f74c4651baf8c681c316c08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:48.188228 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-4dd95874-8a20-4346-961d-35da8f5be9ef tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] 10.222.0.46 "GET /compute/v2.1/servers/6dbb87c7-d73f-4af4-82f5-3ff4396a3cee" status: 200 len: 1362 microversion: 2.47 time: 0.152721 Jan 15 21:13:48.195441 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-59574f64-1310-48f1-956f-9d4798711243 req-a3b0ae57-ab41-4378-891d-18d37369c8d9 service nova] Creating event network-vif-plugged:00a046e1-4575-48fc-acfb-813600567478 for instance 913a9b5a-dfd5-478a-9424-0114ea3a5006 on nch2-master-1 Jan 15 21:13:48.199928 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3114/6242] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:13:48 2022] GET /compute/v2.1/servers/6dbb87c7-d73f-4af4-82f5-3ff4396a3cee => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:13:48.207612 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [req-59574f64-1310-48f1-956f-9d4798711243 req-a3b0ae57-ab41-4378-891d-18d37369c8d9 service nova] Instance 913a9b5a-dfd5-478a-9424-0114ea3a5006 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=129366) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Jan 15 21:13:48.227600 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-59574f64-1310-48f1-956f-9d4798711243 req-a3b0ae57-ab41-4378-891d-18d37369c8d9 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107699 Jan 15 21:13:48.230827 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3129/6243] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:13:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 21:13:48.478595 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-76f1f1c2-067d-471d-bfdf-a9393de6e48d tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:13:48.479728 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-76f1f1c2-067d-471d-bfdf-a9393de6e48d tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: 913a9b5a-dfd5-478a-9424-0114ea3a5006] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:13:48.487049 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-76f1f1c2-067d-471d-bfdf-a9393de6e48d tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:48.487502 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-76f1f1c2-067d-471d-bfdf-a9393de6e48d tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:48.488992 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-76f1f1c2-067d-471d-bfdf-a9393de6e48d tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:48.489444 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-76f1f1c2-067d-471d-bfdf-a9393de6e48d tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:48.736967 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-76f1f1c2-067d-471d-bfdf-a9393de6e48d tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:48.747226 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-76f1f1c2-067d-471d-bfdf-a9393de6e48d tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/913a9b5a-dfd5-478a-9424-0114ea3a5006" status: 200 len: 1689 microversion: 2.1 time: 0.272792 Jan 15 21:13:48.748108 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3115/6244] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:13:48 2022] GET /compute/v2.1/servers/913a9b5a-dfd5-478a-9424-0114ea3a5006 => generated 1689 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:13:48.940462 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d1119586-dd61-4f89-b64c-fb8956de1a88 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:13:48.941061 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-d1119586-dd61-4f89-b64c-fb8956de1a88 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] [instance: 7ebb1b58-541d-4104-b003-8e0b91c1634f] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:13:48.968705 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d1119586-dd61-4f89-b64c-fb8956de1a88 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:48.969181 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d1119586-dd61-4f89-b64c-fb8956de1a88 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:48.969979 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d1119586-dd61-4f89-b64c-fb8956de1a88 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:48.970411 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d1119586-dd61-4f89-b64c-fb8956de1a88 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:49.216424 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-7ffb388a-b378-4a47-a076-35ff690dd6a6 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:13:49.217668 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-7ffb388a-b378-4a47-a076-35ff690dd6a6 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] [instance: 6dbb87c7-d73f-4af4-82f5-3ff4396a3cee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:13:49.269972 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7ffb388a-b378-4a47-a076-35ff690dd6a6 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:49.274525 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7ffb388a-b378-4a47-a076-35ff690dd6a6 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:49.276746 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7ffb388a-b378-4a47-a076-35ff690dd6a6 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:49.279174 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7ffb388a-b378-4a47-a076-35ff690dd6a6 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:49.338437 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-d1119586-dd61-4f89-b64c-fb8956de1a88 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0d769340dc4d36b83436c7fc78bbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de60cd8289224f1f81ef0db9ec3c6f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:49.348627 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d1119586-dd61-4f89-b64c-fb8956de1a88 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] 10.222.0.46 "GET /compute/v2.1/servers/7ebb1b58-541d-4104-b003-8e0b91c1634f" status: 200 len: 1374 microversion: 2.1 time: 0.416545 Jan 15 21:13:49.350202 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3130/6245] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:13:48 2022] GET /compute/v2.1/servers/7ebb1b58-541d-4104-b003-8e0b91c1634f => generated 1374 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:13:49.414690 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-7ffb388a-b378-4a47-a076-35ff690dd6a6 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97ba840be5947569b6c0edf81b76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52caab26f74c4651baf8c681c316c08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:49.431164 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-87f5c5db-8163-491e-8e2e-cf8c6bf47e8c req-4f93cc3a-d50e-44e5-8ac3-f35452024dad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ebb1b58-541d-4104-b003-8e0b91c1634f", "tag": "909658a8-c02e-4ffe-95b9-0a5acbcbdac7"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:13:49.434472 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:13:49.434472 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:13:49.447148 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-7ffb388a-b378-4a47-a076-35ff690dd6a6 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97ba840be5947569b6c0edf81b76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52caab26f74c4651baf8c681c316c08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:49.453041 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-7ffb388a-b378-4a47-a076-35ff690dd6a6 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97ba840be5947569b6c0edf81b76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52caab26f74c4651baf8c681c316c08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:49.455465 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-87f5c5db-8163-491e-8e2e-cf8c6bf47e8c req-4f93cc3a-d50e-44e5-8ac3-f35452024dad service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:49.456106 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-87f5c5db-8163-491e-8e2e-cf8c6bf47e8c req-4f93cc3a-d50e-44e5-8ac3-f35452024dad service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:49.460910 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-7ffb388a-b378-4a47-a076-35ff690dd6a6 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] 10.222.0.46 "GET /compute/v2.1/servers/6dbb87c7-d73f-4af4-82f5-3ff4396a3cee" status: 200 len: 1362 microversion: 2.47 time: 0.248842 Jan 15 21:13:49.462076 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3116/6246] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:13:49 2022] GET /compute/v2.1/servers/6dbb87c7-d73f-4af4-82f5-3ff4396a3cee => generated 1362 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:13:49.477418 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-87f5c5db-8163-491e-8e2e-cf8c6bf47e8c req-4f93cc3a-d50e-44e5-8ac3-f35452024dad service nova] Creating event network-changed:909658a8-c02e-4ffe-95b9-0a5acbcbdac7 for instance 7ebb1b58-541d-4104-b003-8e0b91c1634f on nch1-master-1 Jan 15 21:13:49.483142 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-87f5c5db-8163-491e-8e2e-cf8c6bf47e8c req-4f93cc3a-d50e-44e5-8ac3-f35452024dad service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062477 Jan 15 21:13:49.483959 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3131/6247] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:13:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 21:13:49.766604 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8ceb0750-6e69-4564-aecc-18c0d53dfcf8 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:13:49.767212 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-8ceb0750-6e69-4564-aecc-18c0d53dfcf8 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: 913a9b5a-dfd5-478a-9424-0114ea3a5006] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:13:49.774867 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8ceb0750-6e69-4564-aecc-18c0d53dfcf8 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:49.775318 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8ceb0750-6e69-4564-aecc-18c0d53dfcf8 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:49.776113 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8ceb0750-6e69-4564-aecc-18c0d53dfcf8 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:49.776549 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8ceb0750-6e69-4564-aecc-18c0d53dfcf8 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:49.925363 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-8ceb0750-6e69-4564-aecc-18c0d53dfcf8 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:49.937437 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-8ceb0750-6e69-4564-aecc-18c0d53dfcf8 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/913a9b5a-dfd5-478a-9424-0114ea3a5006" status: 200 len: 1681 microversion: 2.1 time: 0.174548 Jan 15 21:13:49.941000 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3117/6248] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:13:49 2022] GET /compute/v2.1/servers/913a9b5a-dfd5-478a-9424-0114ea3a5006 => generated 1681 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:13:50.367297 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-41b03ef0-784d-4d80-9acb-7cd9b448b7d6 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:13:50.367993 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-41b03ef0-784d-4d80-9acb-7cd9b448b7d6 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] [instance: 7ebb1b58-541d-4104-b003-8e0b91c1634f] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:13:50.376070 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-41b03ef0-784d-4d80-9acb-7cd9b448b7d6 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:50.376673 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-41b03ef0-784d-4d80-9acb-7cd9b448b7d6 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:50.377581 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-41b03ef0-784d-4d80-9acb-7cd9b448b7d6 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:50.378147 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-41b03ef0-784d-4d80-9acb-7cd9b448b7d6 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:50.479333 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ad76b2bd-d9ec-4950-99c8-c7b501dbf2e4 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:13:50.483371 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ad76b2bd-d9ec-4950-99c8-c7b501dbf2e4 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] [instance: 6dbb87c7-d73f-4af4-82f5-3ff4396a3cee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:13:50.494393 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ad76b2bd-d9ec-4950-99c8-c7b501dbf2e4 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:50.495120 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ad76b2bd-d9ec-4950-99c8-c7b501dbf2e4 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:50.496133 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ad76b2bd-d9ec-4950-99c8-c7b501dbf2e4 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:50.497230 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ad76b2bd-d9ec-4950-99c8-c7b501dbf2e4 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:50.559253 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ad76b2bd-d9ec-4950-99c8-c7b501dbf2e4 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:50.560445 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ad76b2bd-d9ec-4950-99c8-c7b501dbf2e4 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:50.561002 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.objects.instance [None req-ad76b2bd-d9ec-4950-99c8-c7b501dbf2e4 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lazy-loading 'fault' on Instance uuid 6dbb87c7-d73f-4af4-82f5-3ff4396a3cee {{(pid=129365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 21:13:50.657982 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-ad76b2bd-d9ec-4950-99c8-c7b501dbf2e4 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97ba840be5947569b6c0edf81b76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52caab26f74c4651baf8c681c316c08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:50.670971 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-ad76b2bd-d9ec-4950-99c8-c7b501dbf2e4 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97ba840be5947569b6c0edf81b76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52caab26f74c4651baf8c681c316c08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:50.673346 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-ad76b2bd-d9ec-4950-99c8-c7b501dbf2e4 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97ba840be5947569b6c0edf81b76d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52caab26f74c4651baf8c681c316c08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:50.674697 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ad76b2bd-d9ec-4950-99c8-c7b501dbf2e4 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] 10.222.0.46 "GET /compute/v2.1/servers/6dbb87c7-d73f-4af4-82f5-3ff4396a3cee" status: 200 len: 1367 microversion: 2.47 time: 0.199059 Jan 15 21:13:50.675617 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3118/6249] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:13:50 2022] GET /compute/v2.1/servers/6dbb87c7-d73f-4af4-82f5-3ff4396a3cee => generated 1367 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 15 21:13:50.759431 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-41b03ef0-784d-4d80-9acb-7cd9b448b7d6 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0d769340dc4d36b83436c7fc78bbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de60cd8289224f1f81ef0db9ec3c6f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:50.767730 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-41b03ef0-784d-4d80-9acb-7cd9b448b7d6 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] 10.222.0.46 "GET /compute/v2.1/servers/7ebb1b58-541d-4104-b003-8e0b91c1634f" status: 200 len: 1374 microversion: 2.1 time: 0.405202 Jan 15 21:13:50.768829 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3132/6250] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:13:50 2022] GET /compute/v2.1/servers/7ebb1b58-541d-4104-b003-8e0b91c1634f => generated 1374 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:13:51.696786 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3ec6bc41-adeb-4c6f-9417-dd2b592669f8 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:13:51.698434 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-3ec6bc41-adeb-4c6f-9417-dd2b592669f8 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] [instance: 6dbb87c7-d73f-4af4-82f5-3ff4396a3cee] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:13:51.707202 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3ec6bc41-adeb-4c6f-9417-dd2b592669f8 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:51.707724 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3ec6bc41-adeb-4c6f-9417-dd2b592669f8 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:51.716744 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3ec6bc41-adeb-4c6f-9417-dd2b592669f8 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:51.718333 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3ec6bc41-adeb-4c6f-9417-dd2b592669f8 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:51.735923 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-3ec6bc41-adeb-4c6f-9417-dd2b592669f8 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] HTTP exception thrown: Instance 6dbb87c7-d73f-4af4-82f5-3ff4396a3cee could not be found. Jan 15 21:13:51.736862 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3ec6bc41-adeb-4c6f-9417-dd2b592669f8 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] Returning 404 to user: Instance 6dbb87c7-d73f-4af4-82f5-3ff4396a3cee could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:13:51.737908 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3ec6bc41-adeb-4c6f-9417-dd2b592669f8 tempest-ServerShowV247Test-833555347 tempest-ServerShowV247Test-833555347-project] 10.222.0.46 "GET /compute/v2.1/servers/6dbb87c7-d73f-4af4-82f5-3ff4396a3cee" status: 404 len: 111 microversion: 2.47 time: 0.046413 Jan 15 21:13:51.738696 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3119/6251] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jan 15 21:13:51 2022] GET /compute/v2.1/servers/6dbb87c7-d73f-4af4-82f5-3ff4396a3cee => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 15 21:13:51.786540 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b0380c23-2d71-47e6-a9fa-49b6cb5dd013 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:13:51.787429 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b0380c23-2d71-47e6-a9fa-49b6cb5dd013 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] [instance: 7ebb1b58-541d-4104-b003-8e0b91c1634f] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:13:51.799653 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b0380c23-2d71-47e6-a9fa-49b6cb5dd013 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:51.801411 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b0380c23-2d71-47e6-a9fa-49b6cb5dd013 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:51.803124 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b0380c23-2d71-47e6-a9fa-49b6cb5dd013 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:51.805492 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b0380c23-2d71-47e6-a9fa-49b6cb5dd013 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:52.178894 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-b0380c23-2d71-47e6-a9fa-49b6cb5dd013 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0d769340dc4d36b83436c7fc78bbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de60cd8289224f1f81ef0db9ec3c6f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:52.188127 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b0380c23-2d71-47e6-a9fa-49b6cb5dd013 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] 10.222.0.46 "GET /compute/v2.1/servers/7ebb1b58-541d-4104-b003-8e0b91c1634f" status: 200 len: 1374 microversion: 2.1 time: 0.406678 Jan 15 21:13:52.188715 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3133/6252] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:13:51 2022] GET /compute/v2.1/servers/7ebb1b58-541d-4104-b003-8e0b91c1634f => generated 1374 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:13:53.207355 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-13b3b27d-33c7-45e3-9f65-0381f105a39a tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:13:53.209204 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-13b3b27d-33c7-45e3-9f65-0381f105a39a tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] [instance: 7ebb1b58-541d-4104-b003-8e0b91c1634f] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:13:53.217559 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-13b3b27d-33c7-45e3-9f65-0381f105a39a tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:53.218157 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-13b3b27d-33c7-45e3-9f65-0381f105a39a tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:53.219524 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-13b3b27d-33c7-45e3-9f65-0381f105a39a tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:53.219657 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-13b3b27d-33c7-45e3-9f65-0381f105a39a tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:53.837168 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-13b3b27d-33c7-45e3-9f65-0381f105a39a tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0d769340dc4d36b83436c7fc78bbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de60cd8289224f1f81ef0db9ec3c6f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:53.846526 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-13b3b27d-33c7-45e3-9f65-0381f105a39a tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] 10.222.0.46 "GET /compute/v2.1/servers/7ebb1b58-541d-4104-b003-8e0b91c1634f" status: 200 len: 1374 microversion: 2.1 time: 0.645391 Jan 15 21:13:53.847120 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3120/6253] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:13:53 2022] GET /compute/v2.1/servers/7ebb1b58-541d-4104-b003-8e0b91c1634f => generated 1374 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:13:54.867464 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b9251632-6271-43d3-b362-2597e4746b87 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:13:54.870590 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b9251632-6271-43d3-b362-2597e4746b87 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] [instance: 7ebb1b58-541d-4104-b003-8e0b91c1634f] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:13:54.888056 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b9251632-6271-43d3-b362-2597e4746b87 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:54.891421 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b9251632-6271-43d3-b362-2597e4746b87 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:54.892254 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b9251632-6271-43d3-b362-2597e4746b87 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:54.892701 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b9251632-6271-43d3-b362-2597e4746b87 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:55.474797 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-b9251632-6271-43d3-b362-2597e4746b87 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0d769340dc4d36b83436c7fc78bbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de60cd8289224f1f81ef0db9ec3c6f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:55.485712 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b9251632-6271-43d3-b362-2597e4746b87 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] 10.222.0.46 "GET /compute/v2.1/servers/7ebb1b58-541d-4104-b003-8e0b91c1634f" status: 200 len: 1374 microversion: 2.1 time: 0.623219 Jan 15 21:13:55.488442 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3134/6254] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:13:54 2022] GET /compute/v2.1/servers/7ebb1b58-541d-4104-b003-8e0b91c1634f => generated 1374 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:13:55.766128 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-6076a537-2f2c-436b-8f04-807dedd39945 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:13:55.767459 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-6076a537-2f2c-436b-8f04-807dedd39945 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] [instance: abffb1a6-17ea-4e1a-9218-4339c3407c3c] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:13:55.779769 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6076a537-2f2c-436b-8f04-807dedd39945 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:55.780527 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6076a537-2f2c-436b-8f04-807dedd39945 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:55.781905 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6076a537-2f2c-436b-8f04-807dedd39945 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:55.782975 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6076a537-2f2c-436b-8f04-807dedd39945 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:55.825273 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-6076a537-2f2c-436b-8f04-807dedd39945 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] 10.222.0.46 "GET /compute/v2.1/servers/abffb1a6-17ea-4e1a-9218-4339c3407c3c/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.063923 Jan 15 21:13:55.830726 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3121/6255] 10.222.0.46 () {58 vars in 1292 bytes} [Sat Jan 15 21:13:55 2022] GET /compute/v2.1/servers/abffb1a6-17ea-4e1a-9218-4339c3407c3c/os-server-password => generated 116 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:13:56.505858 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-660b7161-0158-4b71-9e4c-8fe66828a900 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:13:56.506495 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-660b7161-0158-4b71-9e4c-8fe66828a900 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] [instance: 7ebb1b58-541d-4104-b003-8e0b91c1634f] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:13:56.524367 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-660b7161-0158-4b71-9e4c-8fe66828a900 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:56.524820 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-660b7161-0158-4b71-9e4c-8fe66828a900 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:56.525654 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-660b7161-0158-4b71-9e4c-8fe66828a900 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:56.526086 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-660b7161-0158-4b71-9e4c-8fe66828a900 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:56.622722 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e538a040-1ea2-497d-b9b3-67f6aa8f4820 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-712651931", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "networks": [{"uuid": "84d2c5a2-b550-4f8e-b1d9-357aedfbd096"}]}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:13:56.700819 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.network.neutron [None req-e538a040-1ea2-497d-b9b3-67f6aa8f4820 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] validate_networks() for [('84d2c5a2-b550-4f8e-b1d9-357aedfbd096', None, None, None, None, None)] {{(pid=129366) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 21:13:57.023566 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-660b7161-0158-4b71-9e4c-8fe66828a900 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0d769340dc4d36b83436c7fc78bbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de60cd8289224f1f81ef0db9ec3c6f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:57.033152 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-660b7161-0158-4b71-9e4c-8fe66828a900 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] 10.222.0.46 "GET /compute/v2.1/servers/7ebb1b58-541d-4104-b003-8e0b91c1634f" status: 200 len: 1374 microversion: 2.1 time: 0.531690 Jan 15 21:13:57.033741 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3122/6256] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:13:56 2022] GET /compute/v2.1/servers/7ebb1b58-541d-4104-b003-8e0b91c1634f => generated 1374 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:13:57.939775 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-e538a040-1ea2-497d-b9b3-67f6aa8f4820 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Flavor limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 21:13:57.940297 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-e538a040-1ea2-497d-b9b3-67f6aa8f4820 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Image limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 21:13:57.941031 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-e538a040-1ea2-497d-b9b3-67f6aa8f4820 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Flavor pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 21:13:57.941606 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-e538a040-1ea2-497d-b9b3-67f6aa8f4820 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Image pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 21:13:57.942962 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-e538a040-1ea2-497d-b9b3-67f6aa8f4820 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 21:13:57.964378 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e538a040-1ea2-497d-b9b3-67f6aa8f4820 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:57.965057 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e538a040-1ea2-497d-b9b3-67f6aa8f4820 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:57.966046 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e538a040-1ea2-497d-b9b3-67f6aa8f4820 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:57.966888 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e538a040-1ea2-497d-b9b3-67f6aa8f4820 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:58.022725 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-e538a040-1ea2-497d-b9b3-67f6aa8f4820 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Getting quotas for project 8f293bb4f2d84755a7fd006995ae5f87. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:13:58.038161 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-e538a040-1ea2-497d-b9b3-67f6aa8f4820 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Getting quotas for user b618c4cabb8e47c49e10f659fd1e1490 and project 8f293bb4f2d84755a7fd006995ae5f87. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:13:58.051111 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-6ee64dbd-e4a4-478d-ab25-5cd943fa3e48 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:13:58.052971 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-6ee64dbd-e4a4-478d-ab25-5cd943fa3e48 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] [instance: 7ebb1b58-541d-4104-b003-8e0b91c1634f] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:13:58.075573 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e538a040-1ea2-497d-b9b3-67f6aa8f4820 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Going to run 1 instances... {{(pid=129366) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 21:13:58.081487 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6ee64dbd-e4a4-478d-ab25-5cd943fa3e48 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:58.081989 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6ee64dbd-e4a4-478d-ab25-5cd943fa3e48 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:58.082892 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6ee64dbd-e4a4-478d-ab25-5cd943fa3e48 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:58.083333 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6ee64dbd-e4a4-478d-ab25-5cd943fa3e48 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:58.083671 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e538a040-1ea2-497d-b9b3-67f6aa8f4820 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 21:13:58.195212 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e538a040-1ea2-497d-b9b3-67f6aa8f4820 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.836622 Jan 15 21:13:58.199862 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3135/6257] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 21:13:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1842 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 21:13:58.210670 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-84e90ffc-3a55-46c4-a89e-7d21d2bbe595 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:13:58.211596 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-84e90ffc-3a55-46c4-a89e-7d21d2bbe595 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:13:58.287369 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-84e90ffc-3a55-46c4-a89e-7d21d2bbe595 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:58.300422 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-84e90ffc-3a55-46c4-a89e-7d21d2bbe595 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1216 microversion: 2.1 time: 0.097216 Jan 15 21:13:58.301042 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3136/6258] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:13:58 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1216 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:13:58.538709 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-6ee64dbd-e4a4-478d-ab25-5cd943fa3e48 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0d769340dc4d36b83436c7fc78bbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de60cd8289224f1f81ef0db9ec3c6f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:58.561601 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-6ee64dbd-e4a4-478d-ab25-5cd943fa3e48 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] 10.222.0.46 "GET /compute/v2.1/servers/7ebb1b58-541d-4104-b003-8e0b91c1634f" status: 200 len: 1374 microversion: 2.1 time: 0.513952 Jan 15 21:13:58.563000 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3123/6259] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:13:58 2022] GET /compute/v2.1/servers/7ebb1b58-541d-4104-b003-8e0b91c1634f => generated 1374 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:13:59.096828 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-5af72e1a-1578-495e-82c9-8659f5213b46 req-fb839e74-9c8c-4706-9ead-406f2c7846db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ebb1b58-541d-4104-b003-8e0b91c1634f", "name": "network-vif-plugged", "status": "completed", "tag": "909658a8-c02e-4ffe-95b9-0a5acbcbdac7"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:13:59.099547 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:13:59.099547 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:13:59.117043 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-5af72e1a-1578-495e-82c9-8659f5213b46 req-fb839e74-9c8c-4706-9ead-406f2c7846db service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:59.121011 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-5af72e1a-1578-495e-82c9-8659f5213b46 req-fb839e74-9c8c-4706-9ead-406f2c7846db service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:59.157435 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-5af72e1a-1578-495e-82c9-8659f5213b46 req-fb839e74-9c8c-4706-9ead-406f2c7846db service nova] Creating event network-vif-plugged:909658a8-c02e-4ffe-95b9-0a5acbcbdac7 for instance 7ebb1b58-541d-4104-b003-8e0b91c1634f on nch1-master-1 Jan 15 21:13:59.168620 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-5af72e1a-1578-495e-82c9-8659f5213b46 req-fb839e74-9c8c-4706-9ead-406f2c7846db service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075203 Jan 15 21:13:59.170272 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3137/6260] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:13:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:13:59.318506 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c8c495f2-301c-4578-b8a8-328cdb133c95 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:13:59.319726 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c8c495f2-301c-4578-b8a8-328cdb133c95 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:13:59.333932 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c8c495f2-301c-4578-b8a8-328cdb133c95 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:59.334711 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c8c495f2-301c-4578-b8a8-328cdb133c95 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:59.335731 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c8c495f2-301c-4578-b8a8-328cdb133c95 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:59.340174 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c8c495f2-301c-4578-b8a8-328cdb133c95 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:59.457858 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-c8c495f2-301c-4578-b8a8-328cdb133c95 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:59.473443 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c8c495f2-301c-4578-b8a8-328cdb133c95 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1268 microversion: 2.1 time: 0.159220 Jan 15 21:13:59.484927 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3124/6261] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:13:59 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1268 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:13:59.580417 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-82c5bf96-f69d-4585-acb0-230fe6330f20 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:13:59.581556 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-82c5bf96-f69d-4585-acb0-230fe6330f20 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] [instance: 7ebb1b58-541d-4104-b003-8e0b91c1634f] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:13:59.594118 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-82c5bf96-f69d-4585-acb0-230fe6330f20 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:59.601856 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-82c5bf96-f69d-4585-acb0-230fe6330f20 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:59.603227 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-82c5bf96-f69d-4585-acb0-230fe6330f20 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:13:59.603912 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-82c5bf96-f69d-4585-acb0-230fe6330f20 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:13:59.870617 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-82c5bf96-f69d-4585-acb0-230fe6330f20 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0d769340dc4d36b83436c7fc78bbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de60cd8289224f1f81ef0db9ec3c6f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:13:59.880277 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-82c5bf96-f69d-4585-acb0-230fe6330f20 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] 10.222.0.46 "GET /compute/v2.1/servers/7ebb1b58-541d-4104-b003-8e0b91c1634f" status: 200 len: 1374 microversion: 2.1 time: 0.303419 Jan 15 21:13:59.882917 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3138/6262] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:13:59 2022] GET /compute/v2.1/servers/7ebb1b58-541d-4104-b003-8e0b91c1634f => generated 1374 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:14:00.492750 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-bab328ce-5ce2-4932-a69b-fbefadf53451 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:14:00.494312 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-bab328ce-5ce2-4932-a69b-fbefadf53451 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:14:00.507855 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bab328ce-5ce2-4932-a69b-fbefadf53451 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:00.508701 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bab328ce-5ce2-4932-a69b-fbefadf53451 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:00.510073 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bab328ce-5ce2-4932-a69b-fbefadf53451 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:00.510996 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bab328ce-5ce2-4932-a69b-fbefadf53451 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:00.830848 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-bab328ce-5ce2-4932-a69b-fbefadf53451 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:14:00.840731 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-bab328ce-5ce2-4932-a69b-fbefadf53451 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1316 microversion: 2.1 time: 0.353642 Jan 15 21:14:00.844480 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3125/6263] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:14:00 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1316 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:14:00.898859 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e94ef5bb-31f2-4379-8aba-326172003d6a tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:14:00.899569 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e94ef5bb-31f2-4379-8aba-326172003d6a tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] [instance: 7ebb1b58-541d-4104-b003-8e0b91c1634f] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:14:00.907549 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e94ef5bb-31f2-4379-8aba-326172003d6a tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:00.908011 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e94ef5bb-31f2-4379-8aba-326172003d6a tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:00.909050 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e94ef5bb-31f2-4379-8aba-326172003d6a tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:00.909813 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e94ef5bb-31f2-4379-8aba-326172003d6a tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:01.760778 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-e94ef5bb-31f2-4379-8aba-326172003d6a tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0d769340dc4d36b83436c7fc78bbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de60cd8289224f1f81ef0db9ec3c6f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:14:01.768699 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e94ef5bb-31f2-4379-8aba-326172003d6a tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] 10.222.0.46 "GET /compute/v2.1/servers/7ebb1b58-541d-4104-b003-8e0b91c1634f" status: 200 len: 1546 microversion: 2.1 time: 0.874954 Jan 15 21:14:01.769396 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3139/6264] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:14:00 2022] GET /compute/v2.1/servers/7ebb1b58-541d-4104-b003-8e0b91c1634f => generated 1546 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:14:01.784814 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-440c3460-fe88-4383-ac50-c9de831365df tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:14:01.785463 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-440c3460-fe88-4383-ac50-c9de831365df tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] [instance: 7ebb1b58-541d-4104-b003-8e0b91c1634f] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:14:01.792465 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-440c3460-fe88-4383-ac50-c9de831365df tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:01.793248 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-440c3460-fe88-4383-ac50-c9de831365df tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:01.794217 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-440c3460-fe88-4383-ac50-c9de831365df tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:01.794648 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-440c3460-fe88-4383-ac50-c9de831365df tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:01.863837 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-35ea7cc5-f03d-44fa-aaa1-534e6907df75 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:14:01.865441 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-35ea7cc5-f03d-44fa-aaa1-534e6907df75 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:14:01.872001 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-35ea7cc5-f03d-44fa-aaa1-534e6907df75 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:01.872535 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-35ea7cc5-f03d-44fa-aaa1-534e6907df75 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:01.873440 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-35ea7cc5-f03d-44fa-aaa1-534e6907df75 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:01.874009 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-35ea7cc5-f03d-44fa-aaa1-534e6907df75 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:02.212611 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-440c3460-fe88-4383-ac50-c9de831365df tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0d769340dc4d36b83436c7fc78bbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de60cd8289224f1f81ef0db9ec3c6f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:14:02.223753 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-440c3460-fe88-4383-ac50-c9de831365df tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] 10.222.0.46 "GET /compute/v2.1/servers/7ebb1b58-541d-4104-b003-8e0b91c1634f" status: 200 len: 1546 microversion: 2.1 time: 0.442338 Jan 15 21:14:02.224513 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3126/6265] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:14:01 2022] GET /compute/v2.1/servers/7ebb1b58-541d-4104-b003-8e0b91c1634f => generated 1546 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:14:02.229392 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-c8aecaa0-20da-4dc1-916b-b07d5eb00d25 req-d167002d-9862-4228-8002-335e2fc4dc87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b10c8309-687a-4474-8f64-9956816741db", "tag": "bdd3b358-3871-4d07-a30c-af2f31f8d4cf"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:14:02.231089 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:14:02.231089 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:14:02.238423 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-c8aecaa0-20da-4dc1-916b-b07d5eb00d25 req-d167002d-9862-4228-8002-335e2fc4dc87 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:02.239705 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-c8aecaa0-20da-4dc1-916b-b07d5eb00d25 req-d167002d-9862-4228-8002-335e2fc4dc87 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:02.251297 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-c8aecaa0-20da-4dc1-916b-b07d5eb00d25 req-d167002d-9862-4228-8002-335e2fc4dc87 service nova] Creating event network-changed:bdd3b358-3871-4d07-a30c-af2f31f8d4cf for instance b10c8309-687a-4474-8f64-9956816741db on nch2-master-1 Jan 15 21:14:02.257958 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-c8aecaa0-20da-4dc1-916b-b07d5eb00d25 req-d167002d-9862-4228-8002-335e2fc4dc87 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031886 Jan 15 21:14:02.258906 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3127/6266] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:14:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:14:02.267582 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-35ea7cc5-f03d-44fa-aaa1-534e6907df75 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:14:02.278088 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-35ea7cc5-f03d-44fa-aaa1-534e6907df75 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1316 microversion: 2.1 time: 0.421184 Jan 15 21:14:02.279767 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3140/6267] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:14:01 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1316 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:14:03.312543 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-bb7b366f-9383-4764-927f-ea2a4cca87bc tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:14:03.313772 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-bb7b366f-9383-4764-927f-ea2a4cca87bc tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:14:03.343532 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bb7b366f-9383-4764-927f-ea2a4cca87bc tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:03.343996 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bb7b366f-9383-4764-927f-ea2a4cca87bc tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:03.345700 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bb7b366f-9383-4764-927f-ea2a4cca87bc tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:03.346362 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bb7b366f-9383-4764-927f-ea2a4cca87bc tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:03.650628 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-bb7b366f-9383-4764-927f-ea2a4cca87bc tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:14:03.657862 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-bb7b366f-9383-4764-927f-ea2a4cca87bc tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1316 microversion: 2.1 time: 0.363682 Jan 15 21:14:03.658447 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3128/6268] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:14:03 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1316 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:14:04.674760 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-006b3620-19c2-4402-b04a-c833b2cdbdac tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:14:04.675409 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-006b3620-19c2-4402-b04a-c833b2cdbdac tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:14:04.683662 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-006b3620-19c2-4402-b04a-c833b2cdbdac tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:04.684180 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-006b3620-19c2-4402-b04a-c833b2cdbdac tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:04.685013 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-006b3620-19c2-4402-b04a-c833b2cdbdac tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:04.685417 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-006b3620-19c2-4402-b04a-c833b2cdbdac tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:05.021799 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-006b3620-19c2-4402-b04a-c833b2cdbdac tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:14:05.030663 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-006b3620-19c2-4402-b04a-c833b2cdbdac tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1316 microversion: 2.1 time: 0.359476 Jan 15 21:14:05.031959 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3141/6269] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:14:04 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1316 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:14:06.003902 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-1888d1ca-dcf3-47f2-8e03-9a69dd4e698b req-5e317300-032c-48c9-a8c7-5bc566a3a862 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ebb1b58-541d-4104-b003-8e0b91c1634f", "tag": "909658a8-c02e-4ffe-95b9-0a5acbcbdac7"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:14:06.008083 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:14:06.008083 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:14:06.015992 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-1888d1ca-dcf3-47f2-8e03-9a69dd4e698b req-5e317300-032c-48c9-a8c7-5bc566a3a862 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:06.017091 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-1888d1ca-dcf3-47f2-8e03-9a69dd4e698b req-5e317300-032c-48c9-a8c7-5bc566a3a862 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:06.032562 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-1888d1ca-dcf3-47f2-8e03-9a69dd4e698b req-5e317300-032c-48c9-a8c7-5bc566a3a862 service nova] Creating event network-changed:909658a8-c02e-4ffe-95b9-0a5acbcbdac7 for instance 7ebb1b58-541d-4104-b003-8e0b91c1634f on nch1-master-1 Jan 15 21:14:06.039453 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-1888d1ca-dcf3-47f2-8e03-9a69dd4e698b req-5e317300-032c-48c9-a8c7-5bc566a3a862 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050036 Jan 15 21:14:06.040704 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3129/6270] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:14:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:14:06.049232 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4ae43de6-d3d4-4360-a5c6-4b102085c416 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:14:06.050483 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-4ae43de6-d3d4-4360-a5c6-4b102085c416 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:14:06.062348 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4ae43de6-d3d4-4360-a5c6-4b102085c416 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:06.063134 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4ae43de6-d3d4-4360-a5c6-4b102085c416 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:06.064174 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4ae43de6-d3d4-4360-a5c6-4b102085c416 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:06.064717 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4ae43de6-d3d4-4360-a5c6-4b102085c416 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:06.478702 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-4ae43de6-d3d4-4360-a5c6-4b102085c416 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:14:06.491878 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-4ae43de6-d3d4-4360-a5c6-4b102085c416 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1316 microversion: 2.1 time: 0.446818 Jan 15 21:14:06.493337 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3142/6271] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:14:06 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1316 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:14:06.995718 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-12868657-f46d-49a6-9a6e-20ca8118ea14 req-b1c276b1-4307-4222-b37e-20e4e60324a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b10c8309-687a-4474-8f64-9956816741db", "name": "network-vif-plugged", "status": "completed", "tag": "bdd3b358-3871-4d07-a30c-af2f31f8d4cf"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:14:06.997884 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:14:06.997884 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:14:07.016552 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-12868657-f46d-49a6-9a6e-20ca8118ea14 req-b1c276b1-4307-4222-b37e-20e4e60324a1 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:07.018003 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-12868657-f46d-49a6-9a6e-20ca8118ea14 req-b1c276b1-4307-4222-b37e-20e4e60324a1 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:07.042115 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-12868657-f46d-49a6-9a6e-20ca8118ea14 req-b1c276b1-4307-4222-b37e-20e4e60324a1 service nova] Creating event network-vif-plugged:bdd3b358-3871-4d07-a30c-af2f31f8d4cf for instance b10c8309-687a-4474-8f64-9956816741db on nch2-master-1 Jan 15 21:14:07.047243 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-12868657-f46d-49a6-9a6e-20ca8118ea14 req-b1c276b1-4307-4222-b37e-20e4e60324a1 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060232 Jan 15 21:14:07.048066 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3130/6272] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:14:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:14:07.509754 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-68482f45-e69d-4a39-b679-23c89389d071 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:14:07.511828 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-68482f45-e69d-4a39-b679-23c89389d071 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:14:07.522221 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-68482f45-e69d-4a39-b679-23c89389d071 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:07.523233 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-68482f45-e69d-4a39-b679-23c89389d071 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:07.525020 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-68482f45-e69d-4a39-b679-23c89389d071 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:07.525923 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-68482f45-e69d-4a39-b679-23c89389d071 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:07.789206 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-68482f45-e69d-4a39-b679-23c89389d071 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:14:07.800425 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-68482f45-e69d-4a39-b679-23c89389d071 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1316 microversion: 2.1 time: 0.295189 Jan 15 21:14:07.806801 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3143/6273] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:14:07 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1316 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:14:08.826115 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ea6004f7-f86c-4d1f-b83e-dd9e5ceb9061 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:14:08.826911 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ea6004f7-f86c-4d1f-b83e-dd9e5ceb9061 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:14:08.834625 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ea6004f7-f86c-4d1f-b83e-dd9e5ceb9061 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:08.835605 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ea6004f7-f86c-4d1f-b83e-dd9e5ceb9061 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:08.836695 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ea6004f7-f86c-4d1f-b83e-dd9e5ceb9061 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:08.837252 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ea6004f7-f86c-4d1f-b83e-dd9e5ceb9061 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:09.325310 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-ea6004f7-f86c-4d1f-b83e-dd9e5ceb9061 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:14:09.340128 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ea6004f7-f86c-4d1f-b83e-dd9e5ceb9061 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1505 microversion: 2.1 time: 0.519377 Jan 15 21:14:09.355132 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3131/6274] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:14:08 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1505 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:14:09.418162 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-938bbac7-7bb2-4aa5-a6ff-f1c70c668d49 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-231963924", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "networks": [{"uuid": "84d2c5a2-b550-4f8e-b1d9-357aedfbd096"}]}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:14:09.501766 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.network.neutron [None req-938bbac7-7bb2-4aa5-a6ff-f1c70c668d49 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] validate_networks() for [('84d2c5a2-b550-4f8e-b1d9-357aedfbd096', None, None, None, None, None)] {{(pid=129366) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 21:14:10.308807 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-938bbac7-7bb2-4aa5-a6ff-f1c70c668d49 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Flavor limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 21:14:10.309137 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-938bbac7-7bb2-4aa5-a6ff-f1c70c668d49 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Image limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 21:14:10.310476 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-938bbac7-7bb2-4aa5-a6ff-f1c70c668d49 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Flavor pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 21:14:10.311051 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-938bbac7-7bb2-4aa5-a6ff-f1c70c668d49 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Image pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 21:14:10.312076 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-938bbac7-7bb2-4aa5-a6ff-f1c70c668d49 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 21:14:10.330463 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-938bbac7-7bb2-4aa5-a6ff-f1c70c668d49 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:10.331200 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-938bbac7-7bb2-4aa5-a6ff-f1c70c668d49 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:10.332228 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-938bbac7-7bb2-4aa5-a6ff-f1c70c668d49 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:10.333549 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-938bbac7-7bb2-4aa5-a6ff-f1c70c668d49 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:10.365107 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-938bbac7-7bb2-4aa5-a6ff-f1c70c668d49 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Getting quotas for project 8f293bb4f2d84755a7fd006995ae5f87. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:14:10.379698 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-938bbac7-7bb2-4aa5-a6ff-f1c70c668d49 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Getting quotas for user b618c4cabb8e47c49e10f659fd1e1490 and project 8f293bb4f2d84755a7fd006995ae5f87. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:14:10.410182 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-938bbac7-7bb2-4aa5-a6ff-f1c70c668d49 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Going to run 1 instances... {{(pid=129366) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 21:14:10.412630 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-938bbac7-7bb2-4aa5-a6ff-f1c70c668d49 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: f816a600-ed27-4a5e-a067-b845b368384d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 21:14:10.514740 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-938bbac7-7bb2-4aa5-a6ff-f1c70c668d49 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.100413 Jan 15 21:14:10.516130 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3144/6275] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 21:14:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1103 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 21:14:10.527287 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3ec84097-c3e8-4269-afe9-d3f1000cde72 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:14:10.527925 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-3ec84097-c3e8-4269-afe9-d3f1000cde72 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: f816a600-ed27-4a5e-a067-b845b368384d] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:14:10.686999 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-3ec84097-c3e8-4269-afe9-d3f1000cde72 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:14:10.696293 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3ec84097-c3e8-4269-afe9-d3f1000cde72 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/f816a600-ed27-4a5e-a067-b845b368384d" status: 200 len: 1216 microversion: 2.1 time: 0.173180 Jan 15 21:14:10.706318 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3132/6276] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:14:10 2022] GET /compute/v2.1/servers/f816a600-ed27-4a5e-a067-b845b368384d => generated 1216 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:14:11.719050 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-aba1fad5-f95d-4535-ad0f-6a67d5b8b80e tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:14:11.720431 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-aba1fad5-f95d-4535-ad0f-6a67d5b8b80e tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: f816a600-ed27-4a5e-a067-b845b368384d] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:14:11.733123 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-aba1fad5-f95d-4535-ad0f-6a67d5b8b80e tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:11.734008 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-aba1fad5-f95d-4535-ad0f-6a67d5b8b80e tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:11.735839 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-aba1fad5-f95d-4535-ad0f-6a67d5b8b80e tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:11.736888 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-aba1fad5-f95d-4535-ad0f-6a67d5b8b80e tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:11.898467 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-aba1fad5-f95d-4535-ad0f-6a67d5b8b80e tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:14:11.906371 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-aba1fad5-f95d-4535-ad0f-6a67d5b8b80e tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/f816a600-ed27-4a5e-a067-b845b368384d" status: 200 len: 1268 microversion: 2.1 time: 0.196404 Jan 15 21:14:11.909253 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3145/6277] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:14:11 2022] GET /compute/v2.1/servers/f816a600-ed27-4a5e-a067-b845b368384d => generated 1268 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:14:12.927453 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b1862477-b9b9-4350-9e2b-e353f68ff30e tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:14:12.928234 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b1862477-b9b9-4350-9e2b-e353f68ff30e tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: f816a600-ed27-4a5e-a067-b845b368384d] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:14:12.959692 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b1862477-b9b9-4350-9e2b-e353f68ff30e tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:12.960661 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b1862477-b9b9-4350-9e2b-e353f68ff30e tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:12.969377 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b1862477-b9b9-4350-9e2b-e353f68ff30e tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:12.969922 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b1862477-b9b9-4350-9e2b-e353f68ff30e tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:13.359163 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-b1862477-b9b9-4350-9e2b-e353f68ff30e tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:14:13.385701 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b1862477-b9b9-4350-9e2b-e353f68ff30e tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/f816a600-ed27-4a5e-a067-b845b368384d" status: 200 len: 1316 microversion: 2.1 time: 0.449660 Jan 15 21:14:13.397334 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3133/6278] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:14:12 2022] GET /compute/v2.1/servers/f816a600-ed27-4a5e-a067-b845b368384d => generated 1316 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:14:13.800242 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-a342f98f-5de6-44d4-9596-6f65cd4516af req-3dfcc34c-f37b-40bc-9846-f0c19b1a4e5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f816a600-ed27-4a5e-a067-b845b368384d", "tag": "516c2e54-8b18-402b-b57e-3067f2d41dbe"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:14:13.802437 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:14:13.802437 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:14:13.821164 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-a342f98f-5de6-44d4-9596-6f65cd4516af req-3dfcc34c-f37b-40bc-9846-f0c19b1a4e5e service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:13.823453 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-a342f98f-5de6-44d4-9596-6f65cd4516af req-3dfcc34c-f37b-40bc-9846-f0c19b1a4e5e service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:14.139438 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b02ad70b-ef68-4bdd-a5d5-d17111572d80 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:14:14.141667 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b02ad70b-ef68-4bdd-a5d5-d17111572d80 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: 913a9b5a-dfd5-478a-9424-0114ea3a5006] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:14:14.163476 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b02ad70b-ef68-4bdd-a5d5-d17111572d80 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:14.167688 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b02ad70b-ef68-4bdd-a5d5-d17111572d80 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:14.173618 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b02ad70b-ef68-4bdd-a5d5-d17111572d80 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:14.174454 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b02ad70b-ef68-4bdd-a5d5-d17111572d80 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:14.292379 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b02ad70b-ef68-4bdd-a5d5-d17111572d80 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "POST /compute/v2.1/servers/913a9b5a-dfd5-478a-9424-0114ea3a5006/action" status: 200 len: 24518 microversion: 2.1 time: 0.156455 Jan 15 21:14:14.293174 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-a342f98f-5de6-44d4-9596-6f65cd4516af req-3dfcc34c-f37b-40bc-9846-f0c19b1a4e5e service nova] Creating event network-changed:516c2e54-8b18-402b-b57e-3067f2d41dbe for instance f816a600-ed27-4a5e-a067-b845b368384d on nch1-master-1 Jan 15 21:14:14.301328 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3134/6279] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:14:14 2022] POST /compute/v2.1/servers/913a9b5a-dfd5-478a-9424-0114ea3a5006/action => generated 24518 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 21:14:14.322444 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-a342f98f-5de6-44d4-9596-6f65cd4516af req-3dfcc34c-f37b-40bc-9846-f0c19b1a4e5e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.526051 Jan 15 21:14:14.326750 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3146/6280] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:14:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:14:14.405155 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-fb0f6991-bc1d-46ab-8ed7-ac91a7dec460 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:14:14.405854 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-fb0f6991-bc1d-46ab-8ed7-ac91a7dec460 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: f816a600-ed27-4a5e-a067-b845b368384d] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:14:14.417480 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fb0f6991-bc1d-46ab-8ed7-ac91a7dec460 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:14.418360 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fb0f6991-bc1d-46ab-8ed7-ac91a7dec460 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:14.419425 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fb0f6991-bc1d-46ab-8ed7-ac91a7dec460 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:14.420082 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fb0f6991-bc1d-46ab-8ed7-ac91a7dec460 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:14.664508 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-fb0f6991-bc1d-46ab-8ed7-ac91a7dec460 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:14:14.682490 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-fb0f6991-bc1d-46ab-8ed7-ac91a7dec460 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/f816a600-ed27-4a5e-a067-b845b368384d" status: 200 len: 1316 microversion: 2.1 time: 0.281961 Jan 15 21:14:14.683310 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3135/6281] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:14:14 2022] GET /compute/v2.1/servers/f816a600-ed27-4a5e-a067-b845b368384d => generated 1316 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:14:15.700798 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f14d1698-b1a4-4619-af5d-293ce746c7ca tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:14:15.702558 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f14d1698-b1a4-4619-af5d-293ce746c7ca tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: f816a600-ed27-4a5e-a067-b845b368384d] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:14:15.710669 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f14d1698-b1a4-4619-af5d-293ce746c7ca tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:15.711485 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f14d1698-b1a4-4619-af5d-293ce746c7ca tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:15.712783 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f14d1698-b1a4-4619-af5d-293ce746c7ca tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:15.713470 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f14d1698-b1a4-4619-af5d-293ce746c7ca tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:15.913062 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-f14d1698-b1a4-4619-af5d-293ce746c7ca tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:14:15.921444 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f14d1698-b1a4-4619-af5d-293ce746c7ca tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/f816a600-ed27-4a5e-a067-b845b368384d" status: 200 len: 1316 microversion: 2.1 time: 0.225880 Jan 15 21:14:15.928887 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3147/6282] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:14:15 2022] GET /compute/v2.1/servers/f816a600-ed27-4a5e-a067-b845b368384d => generated 1316 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:14:16.945878 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-336e6d29-addb-4503-9031-dd42cceeb9d8 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:14:16.947071 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-336e6d29-addb-4503-9031-dd42cceeb9d8 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: f816a600-ed27-4a5e-a067-b845b368384d] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:14:16.954813 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-336e6d29-addb-4503-9031-dd42cceeb9d8 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:16.955634 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-336e6d29-addb-4503-9031-dd42cceeb9d8 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:16.956663 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-336e6d29-addb-4503-9031-dd42cceeb9d8 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:16.957469 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-336e6d29-addb-4503-9031-dd42cceeb9d8 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:17.215905 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-336e6d29-addb-4503-9031-dd42cceeb9d8 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:14:17.224028 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-336e6d29-addb-4503-9031-dd42cceeb9d8 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/f816a600-ed27-4a5e-a067-b845b368384d" status: 200 len: 1316 microversion: 2.1 time: 0.282810 Jan 15 21:14:17.224621 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3136/6283] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:14:16 2022] GET /compute/v2.1/servers/f816a600-ed27-4a5e-a067-b845b368384d => generated 1316 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:14:18.241926 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-756274c7-6717-4a79-b692-fc4bb7c7a855 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:14:18.242878 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-756274c7-6717-4a79-b692-fc4bb7c7a855 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: f816a600-ed27-4a5e-a067-b845b368384d] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:14:18.251619 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-756274c7-6717-4a79-b692-fc4bb7c7a855 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:18.252337 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-756274c7-6717-4a79-b692-fc4bb7c7a855 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:18.253292 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-756274c7-6717-4a79-b692-fc4bb7c7a855 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:18.254221 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-756274c7-6717-4a79-b692-fc4bb7c7a855 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:18.537290 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-1a75332b-4494-4990-88cc-d29dba54d62f req-4bd454b1-d4dd-4929-ae7d-d5fffa049af5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f816a600-ed27-4a5e-a067-b845b368384d", "name": "network-vif-plugged", "status": "completed", "tag": "516c2e54-8b18-402b-b57e-3067f2d41dbe"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:14:18.539891 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:14:18.539891 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:14:18.553335 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-1a75332b-4494-4990-88cc-d29dba54d62f req-4bd454b1-d4dd-4929-ae7d-d5fffa049af5 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:18.554222 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-1a75332b-4494-4990-88cc-d29dba54d62f req-4bd454b1-d4dd-4929-ae7d-d5fffa049af5 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:18.569551 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-1a75332b-4494-4990-88cc-d29dba54d62f req-4bd454b1-d4dd-4929-ae7d-d5fffa049af5 service nova] Creating event network-vif-plugged:516c2e54-8b18-402b-b57e-3067f2d41dbe for instance f816a600-ed27-4a5e-a067-b845b368384d on nch1-master-1 Jan 15 21:14:18.575392 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-1a75332b-4494-4990-88cc-d29dba54d62f req-4bd454b1-d4dd-4929-ae7d-d5fffa049af5 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042542 Jan 15 21:14:18.576771 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3137/6284] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:14:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:14:19.095099 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-756274c7-6717-4a79-b692-fc4bb7c7a855 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:14:19.104199 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-756274c7-6717-4a79-b692-fc4bb7c7a855 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/f816a600-ed27-4a5e-a067-b845b368384d" status: 200 len: 1316 microversion: 2.1 time: 0.867530 Jan 15 21:14:19.104786 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3148/6285] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:14:18 2022] GET /compute/v2.1/servers/f816a600-ed27-4a5e-a067-b845b368384d => generated 1316 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:14:20.122846 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-94a43007-40c0-4a60-b4a9-613293da2c43 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:14:20.124307 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-94a43007-40c0-4a60-b4a9-613293da2c43 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: f816a600-ed27-4a5e-a067-b845b368384d] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:14:20.147869 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-94a43007-40c0-4a60-b4a9-613293da2c43 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:20.152331 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-94a43007-40c0-4a60-b4a9-613293da2c43 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:20.153465 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-94a43007-40c0-4a60-b4a9-613293da2c43 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:20.154186 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-94a43007-40c0-4a60-b4a9-613293da2c43 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:20.503010 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c9359c6a-0b85-408f-ba3e-bee54e4a9380 tempest-TestNetworkAdvancedServerOps-958360157 tempest-TestNetworkAdvancedServerOps-958360157-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:14:20.504655 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c9359c6a-0b85-408f-ba3e-bee54e4a9380 tempest-TestNetworkAdvancedServerOps-958360157 tempest-TestNetworkAdvancedServerOps-958360157-project-admin] [instance: 913a9b5a-dfd5-478a-9424-0114ea3a5006] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:14:20.512292 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c9359c6a-0b85-408f-ba3e-bee54e4a9380 tempest-TestNetworkAdvancedServerOps-958360157 tempest-TestNetworkAdvancedServerOps-958360157-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:20.513083 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c9359c6a-0b85-408f-ba3e-bee54e4a9380 tempest-TestNetworkAdvancedServerOps-958360157 tempest-TestNetworkAdvancedServerOps-958360157-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:20.514175 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c9359c6a-0b85-408f-ba3e-bee54e4a9380 tempest-TestNetworkAdvancedServerOps-958360157 tempest-TestNetworkAdvancedServerOps-958360157-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:20.514865 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c9359c6a-0b85-408f-ba3e-bee54e4a9380 tempest-TestNetworkAdvancedServerOps-958360157 tempest-TestNetworkAdvancedServerOps-958360157-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:20.600441 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-94a43007-40c0-4a60-b4a9-613293da2c43 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:14:20.620955 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-94a43007-40c0-4a60-b4a9-613293da2c43 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/f816a600-ed27-4a5e-a067-b845b368384d" status: 200 len: 1504 microversion: 2.1 time: 0.502332 Jan 15 21:14:20.625663 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3138/6286] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:14:20 2022] GET /compute/v2.1/servers/f816a600-ed27-4a5e-a067-b845b368384d => generated 1504 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:14:20.639842 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9a1bf383-b952-47a9-8151-b273c3156a55 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:14:20.641200 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-9a1bf383-b952-47a9-8151-b273c3156a55 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: f816a600-ed27-4a5e-a067-b845b368384d] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:14:20.650977 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9a1bf383-b952-47a9-8151-b273c3156a55 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:20.651811 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9a1bf383-b952-47a9-8151-b273c3156a55 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:20.652912 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9a1bf383-b952-47a9-8151-b273c3156a55 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:20.653700 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9a1bf383-b952-47a9-8151-b273c3156a55 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:20.700632 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-9a1bf383-b952-47a9-8151-b273c3156a55 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: f816a600-ed27-4a5e-a067-b845b368384d] Going to try to terminate instance {{(pid=129365) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 21:14:20.849601 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c9359c6a-0b85-408f-ba3e-bee54e4a9380 tempest-TestNetworkAdvancedServerOps-958360157 tempest-TestNetworkAdvancedServerOps-958360157-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/913a9b5a-dfd5-478a-9424-0114ea3a5006" status: 200 len: 1832 microversion: 2.1 time: 0.350064 Jan 15 21:14:20.850901 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3149/6287] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:14:20 2022] GET /compute/v2.1/servers/913a9b5a-dfd5-478a-9424-0114ea3a5006 => generated 1832 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:14:20.864503 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-9a1bf383-b952-47a9-8151-b273c3156a55 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "DELETE /compute/v2.1/servers/f816a600-ed27-4a5e-a067-b845b368384d" status: 204 len: 0 microversion: 2.1 time: 0.228020 Jan 15 21:14:20.865656 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3139/6288] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 21:14:20 2022] DELETE /compute/v2.1/servers/f816a600-ed27-4a5e-a067-b845b368384d => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 15 21:14:20.874907 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f8bc3199-3b62-4de1-bdc6-9a8e2ea850fe tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:14:20.876507 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f8bc3199-3b62-4de1-bdc6-9a8e2ea850fe tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: f816a600-ed27-4a5e-a067-b845b368384d] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:14:20.890541 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f8bc3199-3b62-4de1-bdc6-9a8e2ea850fe tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:20.894320 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f8bc3199-3b62-4de1-bdc6-9a8e2ea850fe tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:20.896364 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f8bc3199-3b62-4de1-bdc6-9a8e2ea850fe tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:20.897042 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f8bc3199-3b62-4de1-bdc6-9a8e2ea850fe tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:21.362763 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-f8bc3199-3b62-4de1-bdc6-9a8e2ea850fe tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:14:21.372681 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f8bc3199-3b62-4de1-bdc6-9a8e2ea850fe tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/f816a600-ed27-4a5e-a067-b845b368384d" status: 200 len: 1510 microversion: 2.1 time: 0.502860 Jan 15 21:14:21.374490 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3150/6289] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:14:20 2022] GET /compute/v2.1/servers/f816a600-ed27-4a5e-a067-b845b368384d => generated 1510 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:14:22.391243 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-533e7270-f11a-45ae-a7e6-6a58fe4cf825 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:14:22.392564 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-533e7270-f11a-45ae-a7e6-6a58fe4cf825 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: f816a600-ed27-4a5e-a067-b845b368384d] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:14:22.400019 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-533e7270-f11a-45ae-a7e6-6a58fe4cf825 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:22.401158 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-533e7270-f11a-45ae-a7e6-6a58fe4cf825 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:22.402167 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-533e7270-f11a-45ae-a7e6-6a58fe4cf825 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:22.402963 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-533e7270-f11a-45ae-a7e6-6a58fe4cf825 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:22.757521 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-533e7270-f11a-45ae-a7e6-6a58fe4cf825 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:14:22.771543 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-533e7270-f11a-45ae-a7e6-6a58fe4cf825 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/f816a600-ed27-4a5e-a067-b845b368384d" status: 200 len: 1510 microversion: 2.1 time: 0.383954 Jan 15 21:14:22.772613 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3140/6290] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:14:22 2022] GET /compute/v2.1/servers/f816a600-ed27-4a5e-a067-b845b368384d => generated 1510 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:14:23.248178 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-faf4ea9a-a3b8-4e0f-bcc2-b30b92f0bef2 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:14:23.249258 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-faf4ea9a-a3b8-4e0f-bcc2-b30b92f0bef2 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: 913a9b5a-dfd5-478a-9424-0114ea3a5006] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:14:23.251012 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-56680e65-eabe-4c18-abd6-70884ad2703e req-5d157be5-631d-496e-938c-b988d0789fd3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "913a9b5a-dfd5-478a-9424-0114ea3a5006", "tag": "00a046e1-4575-48fc-acfb-813600567478"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:14:23.252736 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:14:23.252736 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:14:23.264250 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-faf4ea9a-a3b8-4e0f-bcc2-b30b92f0bef2 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:23.264767 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-faf4ea9a-a3b8-4e0f-bcc2-b30b92f0bef2 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:23.265622 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-faf4ea9a-a3b8-4e0f-bcc2-b30b92f0bef2 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:23.266059 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-faf4ea9a-a3b8-4e0f-bcc2-b30b92f0bef2 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:23.266591 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-56680e65-eabe-4c18-abd6-70884ad2703e req-5d157be5-631d-496e-938c-b988d0789fd3 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:23.267219 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-56680e65-eabe-4c18-abd6-70884ad2703e req-5d157be5-631d-496e-938c-b988d0789fd3 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:23.293465 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-56680e65-eabe-4c18-abd6-70884ad2703e req-5d157be5-631d-496e-938c-b988d0789fd3 service nova] Creating event network-changed:00a046e1-4575-48fc-acfb-813600567478 for instance 913a9b5a-dfd5-478a-9424-0114ea3a5006 on nch2-master-1 Jan 15 21:14:23.305934 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-56680e65-eabe-4c18-abd6-70884ad2703e req-5d157be5-631d-496e-938c-b988d0789fd3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058333 Jan 15 21:14:23.314726 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3141/6291] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:14:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:14:23.344430 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-faf4ea9a-a3b8-4e0f-bcc2-b30b92f0bef2 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: 913a9b5a-dfd5-478a-9424-0114ea3a5006] Going to try to terminate instance {{(pid=129366) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 21:14:23.521096 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-faf4ea9a-a3b8-4e0f-bcc2-b30b92f0bef2 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "DELETE /compute/v2.1/servers/913a9b5a-dfd5-478a-9424-0114ea3a5006" status: 204 len: 0 microversion: 2.1 time: 0.277973 Jan 15 21:14:23.522092 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3151/6292] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 21:14:23 2022] DELETE /compute/v2.1/servers/913a9b5a-dfd5-478a-9424-0114ea3a5006 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 21:14:23.540541 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c8e9fd3f-997a-479f-aae7-daa1e2e892cf tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:14:23.541742 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c8e9fd3f-997a-479f-aae7-daa1e2e892cf tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: 913a9b5a-dfd5-478a-9424-0114ea3a5006] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:14:23.558833 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c8e9fd3f-997a-479f-aae7-daa1e2e892cf tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:23.559453 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c8e9fd3f-997a-479f-aae7-daa1e2e892cf tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:23.560284 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c8e9fd3f-997a-479f-aae7-daa1e2e892cf tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:23.563452 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c8e9fd3f-997a-479f-aae7-daa1e2e892cf tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:23.649299 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-aebd2b99-4c7b-4788-9ebd-ddb8cf64667d req-0abc827f-70c9-4f50-923e-28289e5cfaa2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f816a600-ed27-4a5e-a067-b845b368384d", "name": "network-vif-deleted", "tag": "516c2e54-8b18-402b-b57e-3067f2d41dbe"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:14:23.652728 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:14:23.652728 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:14:23.676023 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-aebd2b99-4c7b-4788-9ebd-ddb8cf64667d req-0abc827f-70c9-4f50-923e-28289e5cfaa2 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:23.676023 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-aebd2b99-4c7b-4788-9ebd-ddb8cf64667d req-0abc827f-70c9-4f50-923e-28289e5cfaa2 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:23.709934 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-aebd2b99-4c7b-4788-9ebd-ddb8cf64667d req-0abc827f-70c9-4f50-923e-28289e5cfaa2 service nova] Creating event network-vif-deleted:516c2e54-8b18-402b-b57e-3067f2d41dbe for instance f816a600-ed27-4a5e-a067-b845b368384d on nch1-master-1 Jan 15 21:14:23.716563 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-aebd2b99-4c7b-4788-9ebd-ddb8cf64667d req-0abc827f-70c9-4f50-923e-28289e5cfaa2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.255770 Jan 15 21:14:23.717519 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3142/6293] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:14:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:14:23.790927 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-edc908a0-a26b-449c-a99e-16094016ce82 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:14:23.792091 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-edc908a0-a26b-449c-a99e-16094016ce82 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: f816a600-ed27-4a5e-a067-b845b368384d] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:14:23.812797 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-edc908a0-a26b-449c-a99e-16094016ce82 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:23.834457 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-edc908a0-a26b-449c-a99e-16094016ce82 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:23.835711 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-edc908a0-a26b-449c-a99e-16094016ce82 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:23.836353 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-edc908a0-a26b-449c-a99e-16094016ce82 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:23.943130 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-edc908a0-a26b-449c-a99e-16094016ce82 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:23.944676 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-edc908a0-a26b-449c-a99e-16094016ce82 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:23.946995 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.objects.instance [None req-edc908a0-a26b-449c-a99e-16094016ce82 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lazy-loading 'fault' on Instance uuid f816a600-ed27-4a5e-a067-b845b368384d {{(pid=129365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 21:14:24.049660 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-c8e9fd3f-997a-479f-aae7-daa1e2e892cf tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:14:24.063143 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c8e9fd3f-997a-479f-aae7-daa1e2e892cf tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/913a9b5a-dfd5-478a-9424-0114ea3a5006" status: 200 len: 1687 microversion: 2.1 time: 0.534701 Jan 15 21:14:24.066123 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3152/6294] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:14:23 2022] GET /compute/v2.1/servers/913a9b5a-dfd5-478a-9424-0114ea3a5006 => generated 1687 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:14:24.140458 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-edc908a0-a26b-449c-a99e-16094016ce82 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:14:24.161745 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-edc908a0-a26b-449c-a99e-16094016ce82 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/f816a600-ed27-4a5e-a067-b845b368384d" status: 200 len: 1306 microversion: 2.1 time: 0.370813 Jan 15 21:14:24.172032 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3143/6295] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:14:23 2022] GET /compute/v2.1/servers/f816a600-ed27-4a5e-a067-b845b368384d => generated 1306 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:14:25.084571 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-04913a0e-183a-4d7b-a7c8-b526b51d9934 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:14:25.084571 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-04913a0e-183a-4d7b-a7c8-b526b51d9934 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: 913a9b5a-dfd5-478a-9424-0114ea3a5006] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:14:25.093508 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-04913a0e-183a-4d7b-a7c8-b526b51d9934 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:25.094298 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-04913a0e-183a-4d7b-a7c8-b526b51d9934 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:25.095592 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-04913a0e-183a-4d7b-a7c8-b526b51d9934 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:25.096087 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-04913a0e-183a-4d7b-a7c8-b526b51d9934 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:25.181132 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-35e58eb9-f180-4326-9acf-761b533440f0 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:14:25.182754 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-35e58eb9-f180-4326-9acf-761b533440f0 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: f816a600-ed27-4a5e-a067-b845b368384d] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:14:25.190351 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-35e58eb9-f180-4326-9acf-761b533440f0 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:25.191521 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-35e58eb9-f180-4326-9acf-761b533440f0 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:25.192626 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-35e58eb9-f180-4326-9acf-761b533440f0 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:25.193312 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-35e58eb9-f180-4326-9acf-761b533440f0 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:25.216174 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-35e58eb9-f180-4326-9acf-761b533440f0 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] HTTP exception thrown: Instance f816a600-ed27-4a5e-a067-b845b368384d could not be found. Jan 15 21:14:25.217465 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-35e58eb9-f180-4326-9acf-761b533440f0 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Returning 404 to user: Instance f816a600-ed27-4a5e-a067-b845b368384d could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:14:25.218796 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-35e58eb9-f180-4326-9acf-761b533440f0 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/f816a600-ed27-4a5e-a067-b845b368384d" status: 404 len: 111 microversion: 2.1 time: 0.041446 Jan 15 21:14:25.221362 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3144/6296] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:14:25 2022] GET /compute/v2.1/servers/f816a600-ed27-4a5e-a067-b845b368384d => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:14:25.233775 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-cf5edbb4-4284-43b6-b0c6-b95cee5e25ea tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:14:25.234690 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-cf5edbb4-4284-43b6-b0c6-b95cee5e25ea tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:14:25.252106 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cf5edbb4-4284-43b6-b0c6-b95cee5e25ea tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:25.252987 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cf5edbb4-4284-43b6-b0c6-b95cee5e25ea tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:25.254011 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cf5edbb4-4284-43b6-b0c6-b95cee5e25ea tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:25.255032 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cf5edbb4-4284-43b6-b0c6-b95cee5e25ea tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:25.329566 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-04913a0e-183a-4d7b-a7c8-b526b51d9934 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:14:25.353488 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-04913a0e-183a-4d7b-a7c8-b526b51d9934 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/913a9b5a-dfd5-478a-9424-0114ea3a5006" status: 200 len: 1569 microversion: 2.1 time: 0.273399 Jan 15 21:14:25.361790 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3153/6297] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:14:25 2022] GET /compute/v2.1/servers/913a9b5a-dfd5-478a-9424-0114ea3a5006 => generated 1569 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:14:25.463185 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-cf5edbb4-4284-43b6-b0c6-b95cee5e25ea tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:14:25.473798 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-cf5edbb4-4284-43b6-b0c6-b95cee5e25ea tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1505 microversion: 2.1 time: 0.243855 Jan 15 21:14:25.484576 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3145/6298] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:14:25 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1505 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:14:25.539273 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e218c483-214a-4f4b-bdcb-4c35b684b55f tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "networks": [{"uuid": "84d2c5a2-b550-4f8e-b1d9-357aedfbd096"}]}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:14:25.540675 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e218c483-214a-4f4b-bdcb-4c35b684b55f tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:14:25.541663 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e218c483-214a-4f4b-bdcb-4c35b684b55f tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.008513 Jan 15 21:14:25.542378 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3154/6299] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 21:14:25 2022] POST /compute/v2.1/servers => generated 127 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 15 21:14:25.551351 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d322490c-a090-481e-8705-85470aba59d3 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:14:25.552733 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d322490c-a090-481e-8705-85470aba59d3 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:14:25.559401 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d322490c-a090-481e-8705-85470aba59d3 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:25.562086 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d322490c-a090-481e-8705-85470aba59d3 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:25.562086 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d322490c-a090-481e-8705-85470aba59d3 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:25.562086 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d322490c-a090-481e-8705-85470aba59d3 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:25.719838 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-d322490c-a090-481e-8705-85470aba59d3 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:14:25.733810 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d322490c-a090-481e-8705-85470aba59d3 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1505 microversion: 2.1 time: 0.185638 Jan 15 21:14:25.740790 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3146/6300] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:14:25 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1505 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:14:25.752483 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-6fbc12bc-6e2d-456c-a5ff-6e726f467138 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:14:25.753606 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-6fbc12bc-6e2d-456c-a5ff-6e726f467138 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:14:25.762741 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6fbc12bc-6e2d-456c-a5ff-6e726f467138 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:25.764285 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6fbc12bc-6e2d-456c-a5ff-6e726f467138 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:25.765327 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6fbc12bc-6e2d-456c-a5ff-6e726f467138 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:25.765969 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6fbc12bc-6e2d-456c-a5ff-6e726f467138 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:25.950495 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-6fbc12bc-6e2d-456c-a5ff-6e726f467138 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:14:25.958666 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-6fbc12bc-6e2d-456c-a5ff-6e726f467138 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1505 microversion: 2.1 time: 0.210799 Jan 15 21:14:25.959518 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3155/6301] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:14:25 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1505 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:14:26.359921 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-1965edc1-9f07-4853-8e9a-d7cbb97af7ab req-f5db9521-1042-4f26-90a4-a5ca14717380 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "913a9b5a-dfd5-478a-9424-0114ea3a5006", "name": "network-vif-deleted", "tag": "00a046e1-4575-48fc-acfb-813600567478"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:14:26.361622 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:14:26.361622 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:14:26.371476 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-fbdfa11a-5685-41fe-be1b-3ae1c43625f9 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:14:26.372188 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-fbdfa11a-5685-41fe-be1b-3ae1c43625f9 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: 913a9b5a-dfd5-478a-9424-0114ea3a5006] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:14:26.403642 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fbdfa11a-5685-41fe-be1b-3ae1c43625f9 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:26.404152 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fbdfa11a-5685-41fe-be1b-3ae1c43625f9 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:26.413738 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-1965edc1-9f07-4853-8e9a-d7cbb97af7ab req-f5db9521-1042-4f26-90a4-a5ca14717380 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:26.414942 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fbdfa11a-5685-41fe-be1b-3ae1c43625f9 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:26.415386 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fbdfa11a-5685-41fe-be1b-3ae1c43625f9 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:26.418539 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-1965edc1-9f07-4853-8e9a-d7cbb97af7ab req-f5db9521-1042-4f26-90a4-a5ca14717380 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:26.443197 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-1965edc1-9f07-4853-8e9a-d7cbb97af7ab req-f5db9521-1042-4f26-90a4-a5ca14717380 service nova] Creating event network-vif-deleted:00a046e1-4575-48fc-acfb-813600567478 for instance 913a9b5a-dfd5-478a-9424-0114ea3a5006 on nch2-master-1 Jan 15 21:14:26.451901 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-1965edc1-9f07-4853-8e9a-d7cbb97af7ab req-f5db9521-1042-4f26-90a4-a5ca14717380 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095949 Jan 15 21:14:26.463220 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3147/6302] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:14:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:14:26.472342 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fbdfa11a-5685-41fe-be1b-3ae1c43625f9 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:26.473065 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fbdfa11a-5685-41fe-be1b-3ae1c43625f9 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:26.474191 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.objects.instance [None req-fbdfa11a-5685-41fe-be1b-3ae1c43625f9 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lazy-loading 'fault' on Instance uuid 913a9b5a-dfd5-478a-9424-0114ea3a5006 {{(pid=129366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 21:14:26.529201 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-fbdfa11a-5685-41fe-be1b-3ae1c43625f9 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:14:26.538917 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-fbdfa11a-5685-41fe-be1b-3ae1c43625f9 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/913a9b5a-dfd5-478a-9424-0114ea3a5006" status: 200 len: 1355 microversion: 2.1 time: 0.170658 Jan 15 21:14:26.548975 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3156/6303] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:14:26 2022] GET /compute/v2.1/servers/913a9b5a-dfd5-478a-9424-0114ea3a5006 => generated 1355 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:14:27.455583 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-edb825e6-f1f4-46f3-8454-4368c6fb6ac3 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:14:27.457561 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-edb825e6-f1f4-46f3-8454-4368c6fb6ac3 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] [instance: 7ebb1b58-541d-4104-b003-8e0b91c1634f] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:14:27.474815 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-edb825e6-f1f4-46f3-8454-4368c6fb6ac3 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:27.474815 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-edb825e6-f1f4-46f3-8454-4368c6fb6ac3 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:27.474815 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-edb825e6-f1f4-46f3-8454-4368c6fb6ac3 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:27.475223 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-edb825e6-f1f4-46f3-8454-4368c6fb6ac3 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:27.522335 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e70a7dcc-648d-4bdc-a99d-5d8d4d1172ef tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1828993012", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "304a8d50-c297-4024-a907-a1bd0aed3922", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "84d2c5a2-b550-4f8e-b1d9-357aedfbd096"}]}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:14:27.557217 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-edb825e6-f1f4-46f3-8454-4368c6fb6ac3 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] 10.222.0.46 "POST /compute/v2.1/servers/7ebb1b58-541d-4104-b003-8e0b91c1634f/action" status: 200 len: 24569 microversion: 2.1 time: 0.106751 Jan 15 21:14:27.558142 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3148/6304] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:14:27 2022] POST /compute/v2.1/servers/7ebb1b58-541d-4104-b003-8e0b91c1634f/action => generated 24569 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:14:27.568567 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-66016d9b-37e6-44b6-9cd3-5bec7229b08f tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:14:27.569565 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-66016d9b-37e6-44b6-9cd3-5bec7229b08f tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: 913a9b5a-dfd5-478a-9424-0114ea3a5006] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:14:27.601268 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-66016d9b-37e6-44b6-9cd3-5bec7229b08f tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:27.606578 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-66016d9b-37e6-44b6-9cd3-5bec7229b08f tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:27.609150 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-66016d9b-37e6-44b6-9cd3-5bec7229b08f tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:27.609977 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-66016d9b-37e6-44b6-9cd3-5bec7229b08f tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:27.639297 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-e70a7dcc-648d-4bdc-a99d-5d8d4d1172ef tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] HTTP exception thrown: Block Device 304a8d50-c297-4024-a907-a1bd0aed3922 is not bootable. Jan 15 21:14:27.640002 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e70a7dcc-648d-4bdc-a99d-5d8d4d1172ef tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Returning 400 to user: Block Device 304a8d50-c297-4024-a907-a1bd0aed3922 is not bootable. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:14:27.641350 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e70a7dcc-648d-4bdc-a99d-5d8d4d1172ef tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.124075 Jan 15 21:14:27.642009 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3157/6305] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 21:14:27 2022] POST /compute/v2.1/servers => generated 110 bytes in 126 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jan 15 21:14:27.650614 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-66016d9b-37e6-44b6-9cd3-5bec7229b08f tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] HTTP exception thrown: Instance 913a9b5a-dfd5-478a-9424-0114ea3a5006 could not be found. Jan 15 21:14:27.651217 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-66016d9b-37e6-44b6-9cd3-5bec7229b08f tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Returning 404 to user: Instance 913a9b5a-dfd5-478a-9424-0114ea3a5006 could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:14:27.651735 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a3fcd2ea-eedd-4104-8346-e64c18832a46 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:14:27.652057 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-66016d9b-37e6-44b6-9cd3-5bec7229b08f tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/913a9b5a-dfd5-478a-9424-0114ea3a5006" status: 404 len: 111 microversion: 2.1 time: 0.092310 Jan 15 21:14:27.652344 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a3fcd2ea-eedd-4104-8346-e64c18832a46 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:14:27.652611 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3149/6306] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:14:27 2022] GET /compute/v2.1/servers/913a9b5a-dfd5-478a-9424-0114ea3a5006 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:14:27.678072 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a3fcd2ea-eedd-4104-8346-e64c18832a46 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:27.679342 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a3fcd2ea-eedd-4104-8346-e64c18832a46 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:27.681908 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a3fcd2ea-eedd-4104-8346-e64c18832a46 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:27.682732 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a3fcd2ea-eedd-4104-8346-e64c18832a46 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:27.973904 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-a3fcd2ea-eedd-4104-8346-e64c18832a46 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:14:27.986252 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a3fcd2ea-eedd-4104-8346-e64c18832a46 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1505 microversion: 2.1 time: 0.338927 Jan 15 21:14:27.987178 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3158/6307] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:14:27 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1505 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:14:28.022607 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b981b6a5-3808-4b1b-97b4-6877e92bbfb6 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:14:28.025775 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b981b6a5-3808-4b1b-97b4-6877e92bbfb6 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:14:28.038001 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b981b6a5-3808-4b1b-97b4-6877e92bbfb6 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:28.039405 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b981b6a5-3808-4b1b-97b4-6877e92bbfb6 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:28.040490 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b981b6a5-3808-4b1b-97b4-6877e92bbfb6 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:28.041191 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b981b6a5-3808-4b1b-97b4-6877e92bbfb6 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:28.266710 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-b981b6a5-3808-4b1b-97b4-6877e92bbfb6 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:14:28.277624 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b981b6a5-3808-4b1b-97b4-6877e92bbfb6 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1505 microversion: 2.1 time: 0.271601 Jan 15 21:14:28.289582 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3150/6308] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:14:28 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1505 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:14:29.798308 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-861f94c3-c880-4b61-8fe5-5a1c269b29b6 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1284181119", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "destination_type": "local"}, {"source_type": "volume", "uuid": "856107bf-7053-4ece-a849-e0b2c800dc88", "destination_type": "invalid"}], "networks": [{"uuid": "84d2c5a2-b550-4f8e-b1d9-357aedfbd096"}]}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:14:29.801713 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-861f94c3-c880-4b61-8fe5-5a1c269b29b6 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:14:29.802790 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-861f94c3-c880-4b61-8fe5-5a1c269b29b6 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.016541 Jan 15 21:14:29.808147 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3159/6309] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 21:14:29 2022] POST /compute/v2.1/servers => generated 155 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 15 21:14:29.814419 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-dacb294e-e2bd-401a-8a2f-db9d06e6b4a9 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:14:29.815094 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-dacb294e-e2bd-401a-8a2f-db9d06e6b4a9 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:14:29.831222 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dacb294e-e2bd-401a-8a2f-db9d06e6b4a9 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:29.832628 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dacb294e-e2bd-401a-8a2f-db9d06e6b4a9 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:29.835182 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dacb294e-e2bd-401a-8a2f-db9d06e6b4a9 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:29.838320 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dacb294e-e2bd-401a-8a2f-db9d06e6b4a9 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:30.245823 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-dacb294e-e2bd-401a-8a2f-db9d06e6b4a9 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:14:30.262729 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-dacb294e-e2bd-401a-8a2f-db9d06e6b4a9 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1505 microversion: 2.1 time: 0.454722 Jan 15 21:14:30.263648 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3151/6310] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:14:29 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1505 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:14:30.284524 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b2e99273-5698-49a3-9870-88cf28cc4bd5 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:14:30.292070 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b2e99273-5698-49a3-9870-88cf28cc4bd5 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:14:30.306625 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b2e99273-5698-49a3-9870-88cf28cc4bd5 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:30.307572 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b2e99273-5698-49a3-9870-88cf28cc4bd5 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:30.308678 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b2e99273-5698-49a3-9870-88cf28cc4bd5 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:30.309385 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b2e99273-5698-49a3-9870-88cf28cc4bd5 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:30.580091 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-b2e99273-5698-49a3-9870-88cf28cc4bd5 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:14:30.597008 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b2e99273-5698-49a3-9870-88cf28cc4bd5 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1505 microversion: 2.1 time: 0.315406 Jan 15 21:14:30.599260 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3160/6311] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:14:30 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1505 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:14:30.664291 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2000062d-cc12-4cff-b357-bcb066a8de2b tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1999123093", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "84d2c5a2-b550-4f8e-b1d9-357aedfbd096"}]}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:14:30.665904 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2000062d-cc12-4cff-b357-bcb066a8de2b tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:14:30.666886 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2000062d-cc12-4cff-b357-bcb066a8de2b tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.008156 Jan 15 21:14:30.667953 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3152/6312] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 21:14:30 2022] POST /compute/v2.1/servers => generated 624 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 15 21:14:30.677407 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-93b955aa-2142-4d43-8753-f83b8fcdd98e tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:14:30.678633 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-93b955aa-2142-4d43-8753-f83b8fcdd98e tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:14:30.693805 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-93b955aa-2142-4d43-8753-f83b8fcdd98e tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:30.694259 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-93b955aa-2142-4d43-8753-f83b8fcdd98e tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:30.695064 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-93b955aa-2142-4d43-8753-f83b8fcdd98e tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:30.695502 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-93b955aa-2142-4d43-8753-f83b8fcdd98e tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:31.030328 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-93b955aa-2142-4d43-8753-f83b8fcdd98e tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:14:31.044301 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-93b955aa-2142-4d43-8753-f83b8fcdd98e tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1505 microversion: 2.1 time: 0.371060 Jan 15 21:14:31.045820 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3161/6313] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:14:30 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1505 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:14:31.069126 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c6d44d6c-c69c-48c4-aef5-80edb5588382 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:14:31.070923 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c6d44d6c-c69c-48c4-aef5-80edb5588382 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:14:31.082186 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c6d44d6c-c69c-48c4-aef5-80edb5588382 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:31.083936 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c6d44d6c-c69c-48c4-aef5-80edb5588382 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:31.085807 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c6d44d6c-c69c-48c4-aef5-80edb5588382 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:31.086657 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c6d44d6c-c69c-48c4-aef5-80edb5588382 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:31.412754 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-c6d44d6c-c69c-48c4-aef5-80edb5588382 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:14:31.428426 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c6d44d6c-c69c-48c4-aef5-80edb5588382 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1505 microversion: 2.1 time: 0.366803 Jan 15 21:14:31.429794 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3153/6314] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:14:31 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1505 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:14:31.493611 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-70dc5fe0-149d-4b98-bb3b-5499ff67d5c8 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "networks": [{"uuid": "84d2c5a2-b550-4f8e-b1d9-357aedfbd096"}]}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:14:31.495116 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-70dc5fe0-149d-4b98-bb3b-5499ff67d5c8 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:14:31.496300 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-70dc5fe0-149d-4b98-bb3b-5499ff67d5c8 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.009623 Jan 15 21:14:31.507729 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d714eda3-7790-4a8a-8794-f865b1b2db1c tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:14:31.509311 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d714eda3-7790-4a8a-8794-f865b1b2db1c tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:14:31.514225 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3162/6315] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 21:14:31 2022] POST /compute/v2.1/servers => generated 619 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 15 21:14:31.520235 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d714eda3-7790-4a8a-8794-f865b1b2db1c tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:31.521032 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d714eda3-7790-4a8a-8794-f865b1b2db1c tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:31.523035 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d714eda3-7790-4a8a-8794-f865b1b2db1c tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:31.523640 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d714eda3-7790-4a8a-8794-f865b1b2db1c tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:31.887088 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-d714eda3-7790-4a8a-8794-f865b1b2db1c tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:14:31.902001 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d714eda3-7790-4a8a-8794-f865b1b2db1c tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1505 microversion: 2.1 time: 0.399168 Jan 15 21:14:31.902893 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3154/6316] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:14:31 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1505 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:14:31.926548 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-29b7e660-d7a5-4bab-887c-276b1d87a449 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:14:31.927505 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-29b7e660-d7a5-4bab-887c-276b1d87a449 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:14:31.942913 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-29b7e660-d7a5-4bab-887c-276b1d87a449 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:31.944164 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-29b7e660-d7a5-4bab-887c-276b1d87a449 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:31.948047 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-29b7e660-d7a5-4bab-887c-276b1d87a449 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:31.948856 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-29b7e660-d7a5-4bab-887c-276b1d87a449 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:32.414896 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-29b7e660-d7a5-4bab-887c-276b1d87a449 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:14:32.425493 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-29b7e660-d7a5-4bab-887c-276b1d87a449 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1505 microversion: 2.1 time: 0.505258 Jan 15 21:14:32.426925 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3163/6317] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:14:31 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1505 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:14:32.516168 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2389df48-861f-4505-922e-6a07c3fadc43 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1175227427", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": -1, "networks": [{"uuid": "84d2c5a2-b550-4f8e-b1d9-357aedfbd096"}]}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:14:32.531830 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-2389df48-861f-4505-922e-6a07c3fadc43 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] HTTP exception thrown: Flavor -1 could not be found. Jan 15 21:14:32.532681 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2389df48-861f-4505-922e-6a07c3fadc43 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:14:32.534122 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2389df48-861f-4505-922e-6a07c3fadc43 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.023370 Jan 15 21:14:32.560066 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-25069741-d40e-4cf2-893f-c811cddcc606 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:14:32.561423 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-25069741-d40e-4cf2-893f-c811cddcc606 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:14:32.562492 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3155/6318] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 21:14:32 2022] POST /compute/v2.1/servers => generated 73 bytes in 52 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jan 15 21:14:32.571626 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-25069741-d40e-4cf2-893f-c811cddcc606 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:32.573370 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-25069741-d40e-4cf2-893f-c811cddcc606 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:32.574988 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-25069741-d40e-4cf2-893f-c811cddcc606 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:32.575760 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-25069741-d40e-4cf2-893f-c811cddcc606 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:33.412199 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-25069741-d40e-4cf2-893f-c811cddcc606 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:14:33.437246 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-25069741-d40e-4cf2-893f-c811cddcc606 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1505 microversion: 2.1 time: 0.895386 Jan 15 21:14:33.439381 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3164/6319] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:14:32 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1505 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:14:33.469360 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-43784a6b-3f4f-4236-900f-a789ca01cd93 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:14:33.469977 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-43784a6b-3f4f-4236-900f-a789ca01cd93 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:14:33.477880 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-43784a6b-3f4f-4236-900f-a789ca01cd93 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:33.485495 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-43784a6b-3f4f-4236-900f-a789ca01cd93 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:33.486770 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-43784a6b-3f4f-4236-900f-a789ca01cd93 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:33.487410 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-43784a6b-3f4f-4236-900f-a789ca01cd93 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:33.854072 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-43784a6b-3f4f-4236-900f-a789ca01cd93 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:14:33.867541 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-43784a6b-3f4f-4236-900f-a789ca01cd93 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1505 microversion: 2.1 time: 0.403511 Jan 15 21:14:33.880872 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3156/6320] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:14:33 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1505 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:14:33.981656 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7fc54a1d-e937-441e-8c3f-98f045ab3ba5 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1491863500", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "84d2c5a2-b550-4f8e-b1d9-357aedfbd096"}]}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:14:34.007201 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7fc54a1d-e937-441e-8c3f-98f045ab3ba5 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:14:34.009797 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7fc54a1d-e937-441e-8c3f-98f045ab3ba5 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.032750 Jan 15 21:14:34.019863 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-83da5f9c-eb97-4dd7-a3e9-4e043c731477 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:14:34.021064 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-83da5f9c-eb97-4dd7-a3e9-4e043c731477 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:14:34.025798 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3165/6321] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 21:14:33 2022] POST /compute/v2.1/servers => generated 145 bytes in 40 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 15 21:14:34.028458 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-83da5f9c-eb97-4dd7-a3e9-4e043c731477 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:34.029115 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-83da5f9c-eb97-4dd7-a3e9-4e043c731477 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:34.030090 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-83da5f9c-eb97-4dd7-a3e9-4e043c731477 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:34.031234 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-83da5f9c-eb97-4dd7-a3e9-4e043c731477 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:34.407285 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-5b407389-71af-4a1c-8dbf-4e64bf332195 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '.version_select at 0x7f30c86fc310>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:14:34.466050 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-5b407389-71af-4a1c-8dbf-4e64bf332195 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-335220064" status: 202 len: 0 microversion: 2.1 time: 0.067057 Jan 15 21:14:34.471479 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3166/6322] 10.222.0.46 () {58 vars in 1280 bytes} [Sat Jan 15 21:14:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-335220064 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:14:34.498511 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-bb279041-9c21-45d5-8a87-f3ce8d589a30 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Action: 'create', calling method: .version_select at 0x7f30c868eaf0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1400537109"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:14:34.537602 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-bb279041-9c21-45d5-8a87-f3ce8d589a30 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Getting quotas for project ed86e4d7dcdb4ea7ad79628b2ae2462d. Resources: {'key_pairs'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:14:34.558154 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-bb279041-9c21-45d5-8a87-f3ce8d589a30 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Getting quotas for user 7f0f0e03b03e4d24ae0a7e5d3b9b7104 and project ed86e4d7dcdb4ea7ad79628b2ae2462d. Resources: {'key_pairs'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:14:34.749476 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-83da5f9c-eb97-4dd7-a3e9-4e043c731477 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:14:34.759302 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-83da5f9c-eb97-4dd7-a3e9-4e043c731477 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1505 microversion: 2.1 time: 0.743348 Jan 15 21:14:34.775564 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3157/6323] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:14:34 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1505 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:14:34.790052 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-96315218-dfca-4d1b-a6af-707e93063a5d tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:14:34.790674 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-96315218-dfca-4d1b-a6af-707e93063a5d tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:14:34.808807 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-96315218-dfca-4d1b-a6af-707e93063a5d tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:34.809299 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-96315218-dfca-4d1b-a6af-707e93063a5d tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:34.810220 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-96315218-dfca-4d1b-a6af-707e93063a5d tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:34.810668 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-96315218-dfca-4d1b-a6af-707e93063a5d tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:35.118232 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-96315218-dfca-4d1b-a6af-707e93063a5d tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:14:35.127055 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-96315218-dfca-4d1b-a6af-707e93063a5d tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1505 microversion: 2.1 time: 0.340766 Jan 15 21:14:35.129841 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3158/6324] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:14:34 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1505 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:14:35.220708 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-6966eb11-e1b5-458d-b886-f359368af83f tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1638315586", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:14:35.223951 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-6966eb11-e1b5-458d-b886-f359368af83f tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jan 15 21:14:35.229940 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-6966eb11-e1b5-458d-b886-f359368af83f tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:14:35.231385 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-6966eb11-e1b5-458d-b886-f359368af83f tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.014262 Jan 15 21:14:35.241706 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3159/6325] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 21:14:35 2022] POST /compute/v2.1/servers => generated 123 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 15 21:14:35.249825 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5f4667c0-3b55-4bce-8a52-4dbc9149643a tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:14:35.250701 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-5f4667c0-3b55-4bce-8a52-4dbc9149643a tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:14:35.269999 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5f4667c0-3b55-4bce-8a52-4dbc9149643a tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:35.270589 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5f4667c0-3b55-4bce-8a52-4dbc9149643a tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:35.271251 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5f4667c0-3b55-4bce-8a52-4dbc9149643a tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:35.271696 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5f4667c0-3b55-4bce-8a52-4dbc9149643a tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:35.502231 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-bb279041-9c21-45d5-8a87-f3ce8d589a30 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Getting quotas for project ed86e4d7dcdb4ea7ad79628b2ae2462d. Resources: {'key_pairs'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:14:35.509808 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-bb279041-9c21-45d5-8a87-f3ce8d589a30 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Getting quotas for user 7f0f0e03b03e4d24ae0a7e5d3b9b7104 and project ed86e4d7dcdb4ea7ad79628b2ae2462d. Resources: {'key_pairs'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:14:35.548649 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-bb279041-9c21-45d5-8a87-f3ce8d589a30 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 2322 microversion: 2.1 time: 1.053763 Jan 15 21:14:35.551719 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3167/6326] 10.222.0.46 () {60 vars in 1157 bytes} [Sat Jan 15 21:14:34 2022] POST /compute/v2.1/os-keypairs => generated 2322 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:14:35.886237 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-5f4667c0-3b55-4bce-8a52-4dbc9149643a tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:14:35.897325 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5f4667c0-3b55-4bce-8a52-4dbc9149643a tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1505 microversion: 2.1 time: 0.650820 Jan 15 21:14:35.899051 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3160/6327] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:14:35 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1505 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:14:35.922294 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b546cd45-a142-4cb1-b1a5-033245b83b67 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:14:35.923632 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b546cd45-a142-4cb1-b1a5-033245b83b67 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:14:35.939287 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b546cd45-a142-4cb1-b1a5-033245b83b67 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:35.939790 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b546cd45-a142-4cb1-b1a5-033245b83b67 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:35.941260 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b546cd45-a142-4cb1-b1a5-033245b83b67 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:35.945573 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b546cd45-a142-4cb1-b1a5-033245b83b67 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:36.394091 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-b546cd45-a142-4cb1-b1a5-033245b83b67 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:14:36.402519 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b546cd45-a142-4cb1-b1a5-033245b83b67 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1505 microversion: 2.1 time: 0.485319 Jan 15 21:14:36.404292 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3168/6328] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:14:35 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1505 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:14:36.556180 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c15d4844-929f-4ade-8332-6745fb6f15dd tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1703188807", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "key_name": "tempest-key-95755903", "networks": [{"uuid": "84d2c5a2-b550-4f8e-b1d9-357aedfbd096"}]}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:14:36.700749 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.network.neutron [None req-c15d4844-929f-4ade-8332-6745fb6f15dd tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] validate_networks() for [('84d2c5a2-b550-4f8e-b1d9-357aedfbd096', None, None, None, None, None)] {{(pid=129365) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 21:14:37.277192 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-c15d4844-929f-4ade-8332-6745fb6f15dd tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] HTTP exception thrown: Invalid key_name provided. Jan 15 21:14:37.296175 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c15d4844-929f-4ade-8332-6745fb6f15dd tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Returning 400 to user: Invalid key_name provided. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:14:37.303005 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c15d4844-929f-4ade-8332-6745fb6f15dd tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.747454 Jan 15 21:14:37.310176 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3161/6329] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 21:14:36 2022] POST /compute/v2.1/servers => generated 70 bytes in 760 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jan 15 21:14:37.313359 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-75da18cf-0260-4a1c-94b3-8fe7c44f3a7c tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:14:37.314082 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-75da18cf-0260-4a1c-94b3-8fe7c44f3a7c tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:14:37.330038 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-75da18cf-0260-4a1c-94b3-8fe7c44f3a7c tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:37.330822 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-75da18cf-0260-4a1c-94b3-8fe7c44f3a7c tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:37.332633 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-75da18cf-0260-4a1c-94b3-8fe7c44f3a7c tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:37.333292 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-75da18cf-0260-4a1c-94b3-8fe7c44f3a7c tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:37.875679 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-75da18cf-0260-4a1c-94b3-8fe7c44f3a7c tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:14:37.888084 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-75da18cf-0260-4a1c-94b3-8fe7c44f3a7c tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1505 microversion: 2.1 time: 0.578763 Jan 15 21:14:37.889033 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3169/6330] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:14:37 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1505 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:14:37.908044 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2cce392f-93a9-4c33-9adc-d4c5e837944b tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:14:37.908627 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-2cce392f-93a9-4c33-9adc-d4c5e837944b tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:14:37.939879 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2cce392f-93a9-4c33-9adc-d4c5e837944b tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:37.939879 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2cce392f-93a9-4c33-9adc-d4c5e837944b tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:37.940127 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2cce392f-93a9-4c33-9adc-d4c5e837944b tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:37.964700 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2cce392f-93a9-4c33-9adc-d4c5e837944b tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:38.366575 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-2cce392f-93a9-4c33-9adc-d4c5e837944b tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:14:38.389789 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2cce392f-93a9-4c33-9adc-d4c5e837944b tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1505 microversion: 2.1 time: 0.487201 Jan 15 21:14:38.422289 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3162/6331] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:14:37 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1505 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:14:38.483939 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a5a0534d-d9d2-4e0b-b4a7-13a3198ece4a tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1338883489", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "84d2c5a2-b550-4f8e-b1d9-357aedfbd096"}]}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:14:39.171636 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.network.security_group_api [None req-a5a0534d-d9d2-4e0b-b4a7-13a3198ece4a tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Neutron security group does_not_exist not found {{(pid=129366) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Jan 15 21:14:39.172239 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-a5a0534d-d9d2-4e0b-b4a7-13a3198ece4a tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Jan 15 21:14:39.172829 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a5a0534d-d9d2-4e0b-b4a7-13a3198ece4a tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:14:39.174046 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a5a0534d-d9d2-4e0b-b4a7-13a3198ece4a tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.694117 Jan 15 21:14:39.175749 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3170/6332] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 21:14:38 2022] POST /compute/v2.1/servers => generated 106 bytes in 696 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 15 21:14:39.183653 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3acac596-d274-4ab9-bd54-75e814c1644e tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:14:39.184572 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-3acac596-d274-4ab9-bd54-75e814c1644e tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:14:39.193895 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3acac596-d274-4ab9-bd54-75e814c1644e tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:39.194348 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3acac596-d274-4ab9-bd54-75e814c1644e tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:39.195371 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3acac596-d274-4ab9-bd54-75e814c1644e tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:39.195782 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3acac596-d274-4ab9-bd54-75e814c1644e tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:39.665588 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-3acac596-d274-4ab9-bd54-75e814c1644e tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:14:39.676718 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3acac596-d274-4ab9-bd54-75e814c1644e tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1505 microversion: 2.1 time: 0.494345 Jan 15 21:14:39.693292 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3163/6333] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:14:39 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1505 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:14:39.697748 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-26eb4525-d1f9-4abc-a1ef-45249fe6e0e8 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:14:39.698497 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-26eb4525-d1f9-4abc-a1ef-45249fe6e0e8 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:14:39.708959 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-26eb4525-d1f9-4abc-a1ef-45249fe6e0e8 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:39.714994 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-26eb4525-d1f9-4abc-a1ef-45249fe6e0e8 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:39.720784 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-26eb4525-d1f9-4abc-a1ef-45249fe6e0e8 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:39.721757 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-26eb4525-d1f9-4abc-a1ef-45249fe6e0e8 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:40.322391 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-26eb4525-d1f9-4abc-a1ef-45249fe6e0e8 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:14:40.334645 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-26eb4525-d1f9-4abc-a1ef-45249fe6e0e8 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1505 microversion: 2.1 time: 0.640506 Jan 15 21:14:40.367472 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-33d0a7d3-ec29-4376-ac7e-9d1e961f4112 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:14:40.368094 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-33d0a7d3-ec29-4376-ac7e-9d1e961f4112 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: 72421a6a-9b04-42ef-bbd4-816b333e818a] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:14:40.374989 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3171/6334] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:14:39 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1505 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:14:40.378469 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-33d0a7d3-ec29-4376-ac7e-9d1e961f4112 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] HTTP exception thrown: Instance 72421a6a-9b04-42ef-bbd4-816b333e818a could not be found. Jan 15 21:14:40.389215 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-33d0a7d3-ec29-4376-ac7e-9d1e961f4112 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Returning 404 to user: Instance 72421a6a-9b04-42ef-bbd4-816b333e818a could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:14:40.390245 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-33d0a7d3-ec29-4376-ac7e-9d1e961f4112 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "DELETE /compute/v2.1/servers/72421a6a-9b04-42ef-bbd4-816b333e818a" status: 404 len: 111 microversion: 2.1 time: 0.039754 Jan 15 21:14:40.392457 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3164/6335] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 21:14:40 2022] DELETE /compute/v2.1/servers/72421a6a-9b04-42ef-bbd4-816b333e818a => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:14:40.402298 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-80fa2611-5307-4230-9e75-51c0b2aee454 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:14:40.402910 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-80fa2611-5307-4230-9e75-51c0b2aee454 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:14:40.423004 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-80fa2611-5307-4230-9e75-51c0b2aee454 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:40.423468 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-80fa2611-5307-4230-9e75-51c0b2aee454 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:40.424277 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-80fa2611-5307-4230-9e75-51c0b2aee454 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:40.424797 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-80fa2611-5307-4230-9e75-51c0b2aee454 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:40.829877 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-80fa2611-5307-4230-9e75-51c0b2aee454 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:14:40.840513 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-80fa2611-5307-4230-9e75-51c0b2aee454 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1505 microversion: 2.1 time: 0.442072 Jan 15 21:14:40.841495 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3172/6336] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:14:40 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1505 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:14:40.861869 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-fa1652a3-100e-4c54-b943-9d18be2e962d tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:14:40.864824 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-fa1652a3-100e-4c54-b943-9d18be2e962d tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:14:40.885342 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fa1652a3-100e-4c54-b943-9d18be2e962d tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:40.886289 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fa1652a3-100e-4c54-b943-9d18be2e962d tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:40.888044 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fa1652a3-100e-4c54-b943-9d18be2e962d tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:40.888500 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fa1652a3-100e-4c54-b943-9d18be2e962d tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:41.441833 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-fa1652a3-100e-4c54-b943-9d18be2e962d tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:14:41.458875 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-fa1652a3-100e-4c54-b943-9d18be2e962d tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1505 microversion: 2.1 time: 0.601165 Jan 15 21:14:41.462685 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3165/6337] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:14:40 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1505 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:14:41.488098 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-73871faf-dd5a-49fb-8701-02bd69194f2b tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:14:41.488569 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-73871faf-dd5a-49fb-8701-02bd69194f2b tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Failed to fetch instance by id 9223372036854775808 {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2871}} Jan 15 21:14:41.488873 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-73871faf-dd5a-49fb-8701-02bd69194f2b tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Jan 15 21:14:41.489444 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-73871faf-dd5a-49fb-8701-02bd69194f2b tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:14:41.490784 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-73871faf-dd5a-49fb-8701-02bd69194f2b tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.015917 Jan 15 21:14:41.494696 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3173/6338] 10.222.0.46 () {58 vars in 1187 bytes} [Sat Jan 15 21:14:41 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jan 15 21:14:41.501374 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2d8f9909-3f5a-4e98-a142-59d0ac70b9cf tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:14:41.501584 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-2d8f9909-3f5a-4e98-a142-59d0ac70b9cf tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:14:41.512093 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2d8f9909-3f5a-4e98-a142-59d0ac70b9cf tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:41.512666 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2d8f9909-3f5a-4e98-a142-59d0ac70b9cf tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:41.513715 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2d8f9909-3f5a-4e98-a142-59d0ac70b9cf tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:41.514321 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2d8f9909-3f5a-4e98-a142-59d0ac70b9cf tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:41.717667 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-2d8f9909-3f5a-4e98-a142-59d0ac70b9cf tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:14:41.725563 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2d8f9909-3f5a-4e98-a142-59d0ac70b9cf tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1505 microversion: 2.1 time: 0.228859 Jan 15 21:14:41.733303 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3166/6339] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:14:41 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1505 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:14:41.755309 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a819e3ae-791e-42f0-a7eb-11fd55ea8995 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:14:41.756010 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a819e3ae-791e-42f0-a7eb-11fd55ea8995 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:14:41.774350 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a819e3ae-791e-42f0-a7eb-11fd55ea8995 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:41.775102 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a819e3ae-791e-42f0-a7eb-11fd55ea8995 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:41.777691 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a819e3ae-791e-42f0-a7eb-11fd55ea8995 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:41.778155 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a819e3ae-791e-42f0-a7eb-11fd55ea8995 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:42.000241 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-a819e3ae-791e-42f0-a7eb-11fd55ea8995 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:14:42.009673 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a819e3ae-791e-42f0-a7eb-11fd55ea8995 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1505 microversion: 2.1 time: 0.263551 Jan 15 21:14:42.010683 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3174/6340] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:14:41 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1505 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:14:42.031488 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-99abaf28-8cc9-49d0-8e06-d9b40fe94400 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:14:42.033047 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-99abaf28-8cc9-49d0-8e06-d9b40fe94400 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Failed to fetch instance by id -1 {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2871}} Jan 15 21:14:42.033555 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-99abaf28-8cc9-49d0-8e06-d9b40fe94400 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] HTTP exception thrown: Instance -1 could not be found. Jan 15 21:14:42.035158 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-99abaf28-8cc9-49d0-8e06-d9b40fe94400 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Returning 404 to user: Instance -1 could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:14:42.036172 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-99abaf28-8cc9-49d0-8e06-d9b40fe94400 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.012904 Jan 15 21:14:42.036733 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3167/6341] 10.222.0.46 () {58 vars in 1136 bytes} [Sat Jan 15 21:14:42 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jan 15 21:14:42.051067 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b6e50f17-2034-4548-b3b7-14124f5ddccc tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:14:42.052716 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b6e50f17-2034-4548-b3b7-14124f5ddccc tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:14:42.062749 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b6e50f17-2034-4548-b3b7-14124f5ddccc tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:42.063205 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b6e50f17-2034-4548-b3b7-14124f5ddccc tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:42.064002 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b6e50f17-2034-4548-b3b7-14124f5ddccc tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:42.064440 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b6e50f17-2034-4548-b3b7-14124f5ddccc tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:42.227293 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-b6e50f17-2034-4548-b3b7-14124f5ddccc tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:14:42.235696 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b6e50f17-2034-4548-b3b7-14124f5ddccc tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1505 microversion: 2.1 time: 0.194383 Jan 15 21:14:42.236450 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3175/6342] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:14:42 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1505 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:14:42.254475 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-16b7f64e-48a6-4ce4-b112-713631fe0fc5 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:14:42.255090 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-16b7f64e-48a6-4ce4-b112-713631fe0fc5 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:14:42.264489 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-16b7f64e-48a6-4ce4-b112-713631fe0fc5 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:42.265431 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-16b7f64e-48a6-4ce4-b112-713631fe0fc5 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:42.266281 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-16b7f64e-48a6-4ce4-b112-713631fe0fc5 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:42.266727 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-16b7f64e-48a6-4ce4-b112-713631fe0fc5 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:42.441313 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-16b7f64e-48a6-4ce4-b112-713631fe0fc5 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:14:42.450946 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-16b7f64e-48a6-4ce4-b112-713631fe0fc5 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1505 microversion: 2.1 time: 0.200544 Jan 15 21:14:42.464110 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3168/6343] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:14:42 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1505 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:14:42.470030 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1a3700c3-c08f-44d9-ac92-0c8033a0a84e tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:14:42.470787 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-1a3700c3-c08f-44d9-ac92-0c8033a0a84e tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: 94f34f6d-eefd-4930-8cd5-b3f5d98e02c3] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:14:42.476880 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-1a3700c3-c08f-44d9-ac92-0c8033a0a84e tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] HTTP exception thrown: Instance 94f34f6d-eefd-4930-8cd5-b3f5d98e02c3 could not be found. Jan 15 21:14:42.477666 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1a3700c3-c08f-44d9-ac92-0c8033a0a84e tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Returning 404 to user: Instance 94f34f6d-eefd-4930-8cd5-b3f5d98e02c3 could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:14:42.478849 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-1a3700c3-c08f-44d9-ac92-0c8033a0a84e tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "POST /compute/v2.1/servers/94f34f6d-eefd-4930-8cd5-b3f5d98e02c3/action" status: 404 len: 111 microversion: 2.1 time: 0.013113 Jan 15 21:14:42.480245 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3176/6344] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:14:42 2022] POST /compute/v2.1/servers/94f34f6d-eefd-4930-8cd5-b3f5d98e02c3/action => generated 111 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:14:42.489675 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-fdc76faf-5eb4-479c-874c-2875bd4b976d tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:14:42.490541 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-fdc76faf-5eb4-479c-874c-2875bd4b976d tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:14:42.497747 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fdc76faf-5eb4-479c-874c-2875bd4b976d tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:42.498686 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fdc76faf-5eb4-479c-874c-2875bd4b976d tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:42.500002 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fdc76faf-5eb4-479c-874c-2875bd4b976d tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:42.500705 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fdc76faf-5eb4-479c-874c-2875bd4b976d tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:42.653075 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-fdc76faf-5eb4-479c-874c-2875bd4b976d tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:14:42.663187 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-fdc76faf-5eb4-479c-874c-2875bd4b976d tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1505 microversion: 2.1 time: 0.178123 Jan 15 21:14:42.664439 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3169/6345] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:14:42 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1505 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:14:42.681611 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-096db01e-4725-4b12-abc0-cf2daf658ad6 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:14:42.682212 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-096db01e-4725-4b12-abc0-cf2daf658ad6 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:14:42.689185 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-096db01e-4725-4b12-abc0-cf2daf658ad6 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:42.689569 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-096db01e-4725-4b12-abc0-cf2daf658ad6 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:42.691100 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-096db01e-4725-4b12-abc0-cf2daf658ad6 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:42.691887 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-096db01e-4725-4b12-abc0-cf2daf658ad6 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:42.905317 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-096db01e-4725-4b12-abc0-cf2daf658ad6 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:14:42.915309 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-096db01e-4725-4b12-abc0-cf2daf658ad6 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1505 microversion: 2.1 time: 0.237233 Jan 15 21:14:42.927317 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3177/6346] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:14:42 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1505 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:14:42.933527 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-1c444a14-d402-4ffa-9d2f-2882e78cd82f tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:14:42.934986 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-1c444a14-d402-4ffa-9d2f-2882e78cd82f tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: fcc758d7-17cc-4684-9c20-969f8dd725d0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:14:42.942253 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-1c444a14-d402-4ffa-9d2f-2882e78cd82f tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] HTTP exception thrown: Instance fcc758d7-17cc-4684-9c20-969f8dd725d0 could not be found. Jan 15 21:14:42.942792 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-1c444a14-d402-4ffa-9d2f-2882e78cd82f tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Returning 404 to user: Instance fcc758d7-17cc-4684-9c20-969f8dd725d0 could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:14:42.943899 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-1c444a14-d402-4ffa-9d2f-2882e78cd82f tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "POST /compute/v2.1/servers/fcc758d7-17cc-4684-9c20-969f8dd725d0/action" status: 404 len: 111 microversion: 2.1 time: 0.015624 Jan 15 21:14:42.945215 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3170/6347] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:14:42 2022] POST /compute/v2.1/servers/fcc758d7-17cc-4684-9c20-969f8dd725d0/action => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:14:42.952765 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-64617c90-00e6-4dd1-9314-0f4cd00ed8f7 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:14:42.953545 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-64617c90-00e6-4dd1-9314-0f4cd00ed8f7 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:14:42.960357 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-64617c90-00e6-4dd1-9314-0f4cd00ed8f7 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:42.961146 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-64617c90-00e6-4dd1-9314-0f4cd00ed8f7 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:42.962214 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-64617c90-00e6-4dd1-9314-0f4cd00ed8f7 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:42.962880 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-64617c90-00e6-4dd1-9314-0f4cd00ed8f7 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:43.130751 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-64617c90-00e6-4dd1-9314-0f4cd00ed8f7 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:14:43.141022 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-64617c90-00e6-4dd1-9314-0f4cd00ed8f7 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1505 microversion: 2.1 time: 0.191770 Jan 15 21:14:43.142314 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3178/6348] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:14:42 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1505 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:14:43.159307 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f07bd854-171a-4cd8-adcc-c6e2229e5cd6 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:14:43.159910 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f07bd854-171a-4cd8-adcc-c6e2229e5cd6 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:14:43.167608 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f07bd854-171a-4cd8-adcc-c6e2229e5cd6 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:43.168064 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f07bd854-171a-4cd8-adcc-c6e2229e5cd6 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:43.168891 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f07bd854-171a-4cd8-adcc-c6e2229e5cd6 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:43.169339 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f07bd854-171a-4cd8-adcc-c6e2229e5cd6 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:43.372220 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-f07bd854-171a-4cd8-adcc-c6e2229e5cd6 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:14:43.390024 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f07bd854-171a-4cd8-adcc-c6e2229e5cd6 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1505 microversion: 2.1 time: 0.234138 Jan 15 21:14:43.408341 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-782d384b-a80d-4b01-8715-1d9e3a1b4245 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:14:43.409706 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-782d384b-a80d-4b01-8715-1d9e3a1b4245 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: d3031acc-ea67-4695-95ec-ae9b18a83889] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:14:43.417313 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3171/6349] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:14:43 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1505 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:14:43.426780 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-782d384b-a80d-4b01-8715-1d9e3a1b4245 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] HTTP exception thrown: Instance d3031acc-ea67-4695-95ec-ae9b18a83889 could not be found. Jan 15 21:14:43.427446 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-782d384b-a80d-4b01-8715-1d9e3a1b4245 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Returning 404 to user: Instance d3031acc-ea67-4695-95ec-ae9b18a83889 could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:14:43.428458 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-57c31859-ba25-48c0-8be4-d008c16d5d48 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Action: 'create', calling method: .version_select at 0x7f30c8442670>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-514936718"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:14:43.432462 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-782d384b-a80d-4b01-8715-1d9e3a1b4245 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/d3031acc-ea67-4695-95ec-ae9b18a83889" status: 404 len: 111 microversion: 2.1 time: 0.023996 Jan 15 21:14:43.437201 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3179/6350] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:14:43 2022] GET /compute/v2.1/servers/d3031acc-ea67-4695-95ec-ae9b18a83889 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:14:43.442616 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c4831e27-cf33-46a0-9b1b-5763fddab428 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:14:43.443237 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c4831e27-cf33-46a0-9b1b-5763fddab428 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:14:43.459813 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c4831e27-cf33-46a0-9b1b-5763fddab428 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:43.460274 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c4831e27-cf33-46a0-9b1b-5763fddab428 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:43.461117 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c4831e27-cf33-46a0-9b1b-5763fddab428 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:43.461559 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c4831e27-cf33-46a0-9b1b-5763fddab428 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:43.468501 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-57c31859-ba25-48c0-8be4-d008c16d5d48 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Getting quotas for project de60cd8289224f1f81ef0db9ec3c6f87. Resources: {'key_pairs'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:14:43.475999 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-57c31859-ba25-48c0-8be4-d008c16d5d48 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Getting quotas for user 4b0d769340dc4d36b83436c7fc78bbe5 and project de60cd8289224f1f81ef0db9ec3c6f87. Resources: {'key_pairs'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:14:43.775146 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-57c31859-ba25-48c0-8be4-d008c16d5d48 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Getting quotas for project de60cd8289224f1f81ef0db9ec3c6f87. Resources: {'key_pairs'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:14:43.781811 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-57c31859-ba25-48c0-8be4-d008c16d5d48 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Getting quotas for user 4b0d769340dc4d36b83436c7fc78bbe5 and project de60cd8289224f1f81ef0db9ec3c6f87. Resources: {'key_pairs'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:14:43.800419 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-57c31859-ba25-48c0-8be4-d008c16d5d48 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 0.380011 Jan 15 21:14:43.801294 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3172/6351] 10.222.0.46 () {60 vars in 1157 bytes} [Sat Jan 15 21:14:43 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:14:43.861560 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-c4831e27-cf33-46a0-9b1b-5763fddab428 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:14:43.871139 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c4831e27-cf33-46a0-9b1b-5763fddab428 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1505 microversion: 2.1 time: 0.432780 Jan 15 21:14:43.874460 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3180/6352] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:14:43 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1505 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:14:43.895285 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-300a5d08-4068-423b-93b7-e970936b3688 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:14:43.896504 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-300a5d08-4068-423b-93b7-e970936b3688 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:14:43.905630 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-300a5d08-4068-423b-93b7-e970936b3688 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:43.906572 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-300a5d08-4068-423b-93b7-e970936b3688 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:43.907616 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-300a5d08-4068-423b-93b7-e970936b3688 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:43.908329 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-300a5d08-4068-423b-93b7-e970936b3688 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:44.712330 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-300a5d08-4068-423b-93b7-e970936b3688 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:14:44.724723 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-300a5d08-4068-423b-93b7-e970936b3688 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1505 microversion: 2.1 time: 0.832396 Jan 15 21:14:44.727620 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3173/6353] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:14:43 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1505 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:14:44.819747 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d1558254-2020-4a56-8508-6327ae7e8f25 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1686276363", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "84d2c5a2-b550-4f8e-b1d9-357aedfbd096"}]}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:14:44.822212 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d1558254-2020-4a56-8508-6327ae7e8f25 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:14:44.823163 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d1558254-2020-4a56-8508-6327ae7e8f25 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.007920 Jan 15 21:14:44.824636 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3181/6354] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 21:14:44 2022] POST /compute/v2.1/servers => generated 139 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 15 21:14:44.836497 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-75124ce7-5310-451a-b185-98a528790f0e tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:14:44.837439 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-75124ce7-5310-451a-b185-98a528790f0e tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:14:44.850664 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-75124ce7-5310-451a-b185-98a528790f0e tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:44.851263 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-75124ce7-5310-451a-b185-98a528790f0e tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:44.854031 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-75124ce7-5310-451a-b185-98a528790f0e tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:44.854700 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-75124ce7-5310-451a-b185-98a528790f0e tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:45.416241 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-75124ce7-5310-451a-b185-98a528790f0e tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:14:45.424349 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-75124ce7-5310-451a-b185-98a528790f0e tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1505 microversion: 2.1 time: 0.595567 Jan 15 21:14:45.430318 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3174/6355] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:14:44 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1505 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:14:45.452182 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0a8429d9-35b8-445e-8f0b-b89c42e392f8 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:14:45.453046 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-0a8429d9-35b8-445e-8f0b-b89c42e392f8 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:14:45.474954 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0a8429d9-35b8-445e-8f0b-b89c42e392f8 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:45.477125 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0a8429d9-35b8-445e-8f0b-b89c42e392f8 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:45.478538 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0a8429d9-35b8-445e-8f0b-b89c42e392f8 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:45.478992 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0a8429d9-35b8-445e-8f0b-b89c42e392f8 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:46.727900 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-0a8429d9-35b8-445e-8f0b-b89c42e392f8 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:14:46.776366 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0a8429d9-35b8-445e-8f0b-b89c42e392f8 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1505 microversion: 2.1 time: 1.325938 Jan 15 21:14:46.778893 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3182/6356] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:14:45 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1505 bytes in 1332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:14:46.865204 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-90acaced-e393-47c7-8259-c2b6552c6f55 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1065530236", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "84d2c5a2-b550-4f8e-b1d9-357aedfbd096"}]}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:14:46.870255 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-90acaced-e393-47c7-8259-c2b6552c6f55 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:14:46.872665 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-90acaced-e393-47c7-8259-c2b6552c6f55 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.011629 Jan 15 21:14:46.876657 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3175/6357] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 21:14:46 2022] POST /compute/v2.1/servers => generated 133 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 15 21:14:46.883680 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-59a6e34b-1ac6-49e4-a19f-cf2c0542b80e tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:14:46.884229 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-59a6e34b-1ac6-49e4-a19f-cf2c0542b80e tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:14:46.894773 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-59a6e34b-1ac6-49e4-a19f-cf2c0542b80e tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:46.895227 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-59a6e34b-1ac6-49e4-a19f-cf2c0542b80e tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:46.896030 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-59a6e34b-1ac6-49e4-a19f-cf2c0542b80e tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:46.896463 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-59a6e34b-1ac6-49e4-a19f-cf2c0542b80e tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:47.359997 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-59a6e34b-1ac6-49e4-a19f-cf2c0542b80e tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:14:47.374040 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-59a6e34b-1ac6-49e4-a19f-cf2c0542b80e tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1505 microversion: 2.1 time: 0.495865 Jan 15 21:14:47.375243 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3183/6358] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:14:46 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1505 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:14:47.395808 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a64154a9-5796-4baf-a4d1-cd3d2d834e16 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:14:47.396691 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a64154a9-5796-4baf-a4d1-cd3d2d834e16 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:14:47.449366 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a64154a9-5796-4baf-a4d1-cd3d2d834e16 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:47.453349 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a64154a9-5796-4baf-a4d1-cd3d2d834e16 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:47.454502 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a64154a9-5796-4baf-a4d1-cd3d2d834e16 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:47.454945 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a64154a9-5796-4baf-a4d1-cd3d2d834e16 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:47.991308 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-a64154a9-5796-4baf-a4d1-cd3d2d834e16 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:14:48.008696 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a64154a9-5796-4baf-a4d1-cd3d2d834e16 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1505 microversion: 2.1 time: 0.619070 Jan 15 21:14:48.009446 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3176/6359] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:14:47 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1505 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:14:48.025859 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-bbb61934-64cb-4657-ac02-aefec0c85fd4 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:14:48.028480 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-bbb61934-64cb-4657-ac02-aefec0c85fd4 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: 0787dd8a-a7ab-4363-a59c-6287ea37b878] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:14:48.040307 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-bbb61934-64cb-4657-ac02-aefec0c85fd4 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] HTTP exception thrown: Instance 0787dd8a-a7ab-4363-a59c-6287ea37b878 could not be found. Jan 15 21:14:48.041741 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-bbb61934-64cb-4657-ac02-aefec0c85fd4 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Returning 404 to user: Instance 0787dd8a-a7ab-4363-a59c-6287ea37b878 could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:14:48.044514 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-bbb61934-64cb-4657-ac02-aefec0c85fd4 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "POST /compute/v2.1/servers/0787dd8a-a7ab-4363-a59c-6287ea37b878/action" status: 404 len: 111 microversion: 2.1 time: 0.022784 Jan 15 21:14:48.047008 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3184/6360] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:14:48 2022] POST /compute/v2.1/servers/0787dd8a-a7ab-4363-a59c-6287ea37b878/action => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:14:48.057266 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d39a0a40-20ba-449c-bd01-a69da536a9db tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:14:48.058192 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d39a0a40-20ba-449c-bd01-a69da536a9db tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:14:48.064905 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d39a0a40-20ba-449c-bd01-a69da536a9db tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:48.067194 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d39a0a40-20ba-449c-bd01-a69da536a9db tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:48.068218 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d39a0a40-20ba-449c-bd01-a69da536a9db tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:48.069050 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d39a0a40-20ba-449c-bd01-a69da536a9db tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:49.008560 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-d39a0a40-20ba-449c-bd01-a69da536a9db tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:14:49.023147 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d39a0a40-20ba-449c-bd01-a69da536a9db tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1505 microversion: 2.1 time: 0.969564 Jan 15 21:14:49.025388 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3177/6361] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:14:48 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1505 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:14:49.045063 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-46c62cb9-1828-45ef-b899-e3542b7d14ab tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:14:49.045990 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-46c62cb9-1828-45ef-b899-e3542b7d14ab tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:14:49.059751 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-46c62cb9-1828-45ef-b899-e3542b7d14ab tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:49.070330 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-46c62cb9-1828-45ef-b899-e3542b7d14ab tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:49.071353 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-46c62cb9-1828-45ef-b899-e3542b7d14ab tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:49.072222 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-46c62cb9-1828-45ef-b899-e3542b7d14ab tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:49.566943 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-46c62cb9-1828-45ef-b899-e3542b7d14ab tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:14:49.583994 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-46c62cb9-1828-45ef-b899-e3542b7d14ab tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1505 microversion: 2.1 time: 0.544983 Jan 15 21:14:49.592138 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3185/6362] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:14:49 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1505 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:14:49.609319 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ae84b353-a57a-438c-8742-8c41b1adb457 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:14:49.610458 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ae84b353-a57a-438c-8742-8c41b1adb457 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:14:49.625245 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ae84b353-a57a-438c-8742-8c41b1adb457 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:49.625702 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ae84b353-a57a-438c-8742-8c41b1adb457 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:49.626516 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ae84b353-a57a-438c-8742-8c41b1adb457 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:49.626954 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ae84b353-a57a-438c-8742-8c41b1adb457 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:49.778489 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ae84b353-a57a-438c-8742-8c41b1adb457 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "POST /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db/action" status: 202 len: 0 microversion: 2.1 time: 0.173074 Jan 15 21:14:49.779391 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3178/6363] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:14:49 2022] POST /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db/action => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:14:49.788749 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f12948ec-3a64-43d3-afb7-1a4ca53f684e tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:14:49.790293 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f12948ec-3a64-43d3-afb7-1a4ca53f684e tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:14:49.805370 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f12948ec-3a64-43d3-afb7-1a4ca53f684e tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:49.809106 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f12948ec-3a64-43d3-afb7-1a4ca53f684e tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:49.810826 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f12948ec-3a64-43d3-afb7-1a4ca53f684e tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:49.813165 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f12948ec-3a64-43d3-afb7-1a4ca53f684e tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:50.008971 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a141c3ca-4e05-483d-915e-3d5b8eff9e09 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1167130381", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "networks": [{"uuid": "1f8a0ef4-ec80-4354-87ef-19071fcdb8c4"}], "key_name": "tempest-TestNetworkBasicOps-514936718", "security_groups": [{"name": "tempest-secgroup-smoke-1083933567"}]}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:14:50.642244 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.network.neutron [None req-a141c3ca-4e05-483d-915e-3d5b8eff9e09 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] validate_networks() for [('1f8a0ef4-ec80-4354-87ef-19071fcdb8c4', None, None, None, None, None)] {{(pid=129365) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 21:14:50.681036 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-f12948ec-3a64-43d3-afb7-1a4ca53f684e tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:14:50.695155 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f12948ec-3a64-43d3-afb7-1a4ca53f684e tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1510 microversion: 2.1 time: 0.911509 Jan 15 21:14:50.695929 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3186/6364] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:14:49 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1510 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:14:51.608278 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-a141c3ca-4e05-483d-915e-3d5b8eff9e09 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Flavor limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 21:14:51.608966 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-a141c3ca-4e05-483d-915e-3d5b8eff9e09 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Image limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 21:14:51.609773 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-a141c3ca-4e05-483d-915e-3d5b8eff9e09 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Flavor pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 21:14:51.610312 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-a141c3ca-4e05-483d-915e-3d5b8eff9e09 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Image pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 21:14:51.610865 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-a141c3ca-4e05-483d-915e-3d5b8eff9e09 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 21:14:51.632244 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a141c3ca-4e05-483d-915e-3d5b8eff9e09 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:51.632908 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a141c3ca-4e05-483d-915e-3d5b8eff9e09 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:51.639456 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a141c3ca-4e05-483d-915e-3d5b8eff9e09 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:51.640048 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a141c3ca-4e05-483d-915e-3d5b8eff9e09 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:51.685549 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-a141c3ca-4e05-483d-915e-3d5b8eff9e09 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Getting quotas for project de60cd8289224f1f81ef0db9ec3c6f87. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:14:51.696503 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-a141c3ca-4e05-483d-915e-3d5b8eff9e09 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Getting quotas for user 4b0d769340dc4d36b83436c7fc78bbe5 and project de60cd8289224f1f81ef0db9ec3c6f87. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:14:51.712868 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-cf231428-0999-40a1-8ac8-9bda2dd2701f tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:14:51.713654 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-cf231428-0999-40a1-8ac8-9bda2dd2701f tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:14:51.723903 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cf231428-0999-40a1-8ac8-9bda2dd2701f tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:51.724361 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cf231428-0999-40a1-8ac8-9bda2dd2701f tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:51.725202 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cf231428-0999-40a1-8ac8-9bda2dd2701f tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:51.725639 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cf231428-0999-40a1-8ac8-9bda2dd2701f tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:51.740008 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a141c3ca-4e05-483d-915e-3d5b8eff9e09 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Going to run 1 instances... {{(pid=129365) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 21:14:51.742544 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a141c3ca-4e05-483d-915e-3d5b8eff9e09 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] [instance: d5d3c9af-fa53-4de5-a559-6d2cd4857a38] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129365) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 21:14:51.867562 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a141c3ca-4e05-483d-915e-3d5b8eff9e09 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.863841 Jan 15 21:14:51.869086 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3179/6365] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 21:14:50 2022] POST /compute/v2.1/servers => generated 406 bytes in 1866 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 21:14:51.895900 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2138e065-aec3-48a4-b818-07be1cc98305 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:14:51.896971 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-2138e065-aec3-48a4-b818-07be1cc98305 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] [instance: d5d3c9af-fa53-4de5-a559-6d2cd4857a38] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:14:52.138695 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-2138e065-aec3-48a4-b818-07be1cc98305 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0d769340dc4d36b83436c7fc78bbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de60cd8289224f1f81ef0db9ec3c6f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:14:52.165410 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2138e065-aec3-48a4-b818-07be1cc98305 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] 10.222.0.46 "GET /compute/v2.1/servers/d5d3c9af-fa53-4de5-a559-6d2cd4857a38" status: 200 len: 1248 microversion: 2.1 time: 0.287988 Jan 15 21:14:52.167275 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3180/6366] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:14:51 2022] GET /compute/v2.1/servers/d5d3c9af-fa53-4de5-a559-6d2cd4857a38 => generated 1248 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:14:52.588626 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-cf231428-0999-40a1-8ac8-9bda2dd2701f tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:14:52.598164 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-cf231428-0999-40a1-8ac8-9bda2dd2701f tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1490 microversion: 2.1 time: 0.888632 Jan 15 21:14:52.609749 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3187/6367] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:14:51 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1490 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:14:52.614679 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b8177b76-5306-4719-bb61-cf205c83dbb2 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:14:52.615197 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b8177b76-5306-4719-bb61-cf205c83dbb2 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:14:52.625822 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b8177b76-5306-4719-bb61-cf205c83dbb2 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:52.626275 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b8177b76-5306-4719-bb61-cf205c83dbb2 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:52.635437 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b8177b76-5306-4719-bb61-cf205c83dbb2 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:52.635841 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b8177b76-5306-4719-bb61-cf205c83dbb2 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:52.689307 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-b8177b76-5306-4719-bb61-cf205c83dbb2 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] HTTP exception thrown: Cannot 'pause' instance b10c8309-687a-4474-8f64-9956816741db while it is in vm_state paused Jan 15 21:14:52.692359 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b8177b76-5306-4719-bb61-cf205c83dbb2 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Returning 409 to user: Cannot 'pause' instance b10c8309-687a-4474-8f64-9956816741db while it is in vm_state paused {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:14:52.694518 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b8177b76-5306-4719-bb61-cf205c83dbb2 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "POST /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db/action" status: 409 len: 143 microversion: 2.1 time: 0.083803 Jan 15 21:14:52.701383 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3181/6368] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:14:52 2022] POST /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db/action => generated 143 bytes in 91 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jan 15 21:14:52.707641 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c937fe8c-d2d2-4066-8774-6d3e40d401fa tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:14:52.708320 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c937fe8c-d2d2-4066-8774-6d3e40d401fa tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:14:52.733739 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c937fe8c-d2d2-4066-8774-6d3e40d401fa tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:52.734440 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c937fe8c-d2d2-4066-8774-6d3e40d401fa tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:52.735178 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c937fe8c-d2d2-4066-8774-6d3e40d401fa tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:52.735629 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c937fe8c-d2d2-4066-8774-6d3e40d401fa tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:52.848875 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c937fe8c-d2d2-4066-8774-6d3e40d401fa tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "POST /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db/action" status: 202 len: 0 microversion: 2.1 time: 0.139152 Jan 15 21:14:52.850612 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3188/6369] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:14:52 2022] POST /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db/action => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:14:52.857765 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-fffaf282-ea06-483f-8046-1234a0da2ebe tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:14:52.858371 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-fffaf282-ea06-483f-8046-1234a0da2ebe tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:14:52.869143 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fffaf282-ea06-483f-8046-1234a0da2ebe tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:52.871111 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fffaf282-ea06-483f-8046-1234a0da2ebe tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:52.876957 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fffaf282-ea06-483f-8046-1234a0da2ebe tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:52.878072 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fffaf282-ea06-483f-8046-1234a0da2ebe tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:53.184800 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0538ea11-cb2c-46ea-b307-8aab67995d2a tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:14:53.186300 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-0538ea11-cb2c-46ea-b307-8aab67995d2a tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] [instance: d5d3c9af-fa53-4de5-a559-6d2cd4857a38] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:14:53.201922 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0538ea11-cb2c-46ea-b307-8aab67995d2a tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:53.202760 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0538ea11-cb2c-46ea-b307-8aab67995d2a tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:53.209981 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0538ea11-cb2c-46ea-b307-8aab67995d2a tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:53.210626 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0538ea11-cb2c-46ea-b307-8aab67995d2a tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:53.364345 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-0538ea11-cb2c-46ea-b307-8aab67995d2a tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0d769340dc4d36b83436c7fc78bbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de60cd8289224f1f81ef0db9ec3c6f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:14:53.388323 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0538ea11-cb2c-46ea-b307-8aab67995d2a tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] 10.222.0.46 "GET /compute/v2.1/servers/d5d3c9af-fa53-4de5-a559-6d2cd4857a38" status: 200 len: 1300 microversion: 2.1 time: 0.204366 Jan 15 21:14:53.389706 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3189/6370] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:14:53 2022] GET /compute/v2.1/servers/d5d3c9af-fa53-4de5-a559-6d2cd4857a38 => generated 1300 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:14:53.868048 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-fffaf282-ea06-483f-8046-1234a0da2ebe tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:14:53.875789 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-fffaf282-ea06-483f-8046-1234a0da2ebe tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1497 microversion: 2.1 time: 1.021497 Jan 15 21:14:53.876377 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3182/6371] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:14:52 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1497 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:14:54.406768 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-3c9c05c4-3d74-4fe2-91ed-d66840393f22 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:14:54.407515 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-3c9c05c4-3d74-4fe2-91ed-d66840393f22 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] [instance: d5d3c9af-fa53-4de5-a559-6d2cd4857a38] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:14:54.417053 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3c9c05c4-3d74-4fe2-91ed-d66840393f22 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:54.417517 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3c9c05c4-3d74-4fe2-91ed-d66840393f22 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:54.418309 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3c9c05c4-3d74-4fe2-91ed-d66840393f22 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:54.418752 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3c9c05c4-3d74-4fe2-91ed-d66840393f22 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:54.894642 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2e832dda-3add-487e-9dbd-ff050cbc9657 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:14:54.895317 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-2e832dda-3add-487e-9dbd-ff050cbc9657 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:14:54.908996 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2e832dda-3add-487e-9dbd-ff050cbc9657 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:54.909459 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2e832dda-3add-487e-9dbd-ff050cbc9657 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:54.928434 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2e832dda-3add-487e-9dbd-ff050cbc9657 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:54.929111 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2e832dda-3add-487e-9dbd-ff050cbc9657 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:55.141926 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-3c9c05c4-3d74-4fe2-91ed-d66840393f22 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0d769340dc4d36b83436c7fc78bbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de60cd8289224f1f81ef0db9ec3c6f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:14:55.154662 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-3c9c05c4-3d74-4fe2-91ed-d66840393f22 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] 10.222.0.46 "GET /compute/v2.1/servers/d5d3c9af-fa53-4de5-a559-6d2cd4857a38" status: 200 len: 1374 microversion: 2.1 time: 0.749897 Jan 15 21:14:55.157183 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3190/6372] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:14:54 2022] GET /compute/v2.1/servers/d5d3c9af-fa53-4de5-a559-6d2cd4857a38 => generated 1374 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:14:55.800197 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9484c9f8-a0ac-46ec-8801-febde2fcef17 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-276143975", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "networks": [{"uuid": "e8902453-93d9-48d2-8641-d9165e87af61"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1400537109", "security_groups": [{"name": "tempest-secgroup-smoke-734528489"}]}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:14:56.622148 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.network.neutron [None req-9484c9f8-a0ac-46ec-8801-febde2fcef17 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] validate_networks() for [('e8902453-93d9-48d2-8641-d9165e87af61', None, None, None, None, None)] {{(pid=129366) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 21:14:56.876603 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-2e832dda-3add-487e-9dbd-ff050cbc9657 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:14:56.889894 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2e832dda-3add-487e-9dbd-ff050cbc9657 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1505 microversion: 2.1 time: 2.000707 Jan 15 21:14:56.898946 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3183/6373] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:14:54 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1505 bytes in 2010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:14:56.913341 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-649bc0a7-ba8b-4ccc-81dc-90f88a2823f4 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:14:56.914057 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-649bc0a7-ba8b-4ccc-81dc-90f88a2823f4 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] [instance: d5d3c9af-fa53-4de5-a559-6d2cd4857a38] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:14:56.934703 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-649bc0a7-ba8b-4ccc-81dc-90f88a2823f4 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:56.937587 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-649bc0a7-ba8b-4ccc-81dc-90f88a2823f4 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:56.938625 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-649bc0a7-ba8b-4ccc-81dc-90f88a2823f4 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:56.939250 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-649bc0a7-ba8b-4ccc-81dc-90f88a2823f4 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:57.653686 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-649bc0a7-ba8b-4ccc-81dc-90f88a2823f4 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0d769340dc4d36b83436c7fc78bbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de60cd8289224f1f81ef0db9ec3c6f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:14:57.665944 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-649bc0a7-ba8b-4ccc-81dc-90f88a2823f4 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] 10.222.0.46 "GET /compute/v2.1/servers/d5d3c9af-fa53-4de5-a559-6d2cd4857a38" status: 200 len: 1374 microversion: 2.1 time: 0.765738 Jan 15 21:14:57.668457 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3184/6374] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:14:56 2022] GET /compute/v2.1/servers/d5d3c9af-fa53-4de5-a559-6d2cd4857a38 => generated 1374 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:14:57.677801 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-f9ab6e89-2568-428f-a791-133856b11ada req-38cb8dec-8d05-405e-bdad-4ab4b24120de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5d3c9af-fa53-4de5-a559-6d2cd4857a38", "tag": "a324cd95-18a9-4be1-9b39-644e1887801c"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:14:57.679731 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:14:57.679731 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:14:57.691925 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-f9ab6e89-2568-428f-a791-133856b11ada req-38cb8dec-8d05-405e-bdad-4ab4b24120de service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:57.692625 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-f9ab6e89-2568-428f-a791-133856b11ada req-38cb8dec-8d05-405e-bdad-4ab4b24120de service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:57.708990 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-f9ab6e89-2568-428f-a791-133856b11ada req-38cb8dec-8d05-405e-bdad-4ab4b24120de service nova] Creating event network-changed:a324cd95-18a9-4be1-9b39-644e1887801c for instance d5d3c9af-fa53-4de5-a559-6d2cd4857a38 on nch1-master-1 Jan 15 21:14:57.719176 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-f9ab6e89-2568-428f-a791-133856b11ada req-38cb8dec-8d05-405e-bdad-4ab4b24120de service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047809 Jan 15 21:14:57.720165 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3185/6375] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:14:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:14:57.757721 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ff2131f4-1b67-401c-a52c-71555b1c8301 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:14:57.758653 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ff2131f4-1b67-401c-a52c-71555b1c8301 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:14:57.778421 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ff2131f4-1b67-401c-a52c-71555b1c8301 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:57.779011 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ff2131f4-1b67-401c-a52c-71555b1c8301 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:57.780027 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ff2131f4-1b67-401c-a52c-71555b1c8301 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:57.780986 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ff2131f4-1b67-401c-a52c-71555b1c8301 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:58.066510 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-9484c9f8-a0ac-46ec-8801-febde2fcef17 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Flavor limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 21:14:58.067884 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-9484c9f8-a0ac-46ec-8801-febde2fcef17 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Image limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 21:14:58.068653 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-9484c9f8-a0ac-46ec-8801-febde2fcef17 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Flavor pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 21:14:58.069320 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-9484c9f8-a0ac-46ec-8801-febde2fcef17 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Image pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 21:14:58.071133 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-9484c9f8-a0ac-46ec-8801-febde2fcef17 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 21:14:58.100410 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9484c9f8-a0ac-46ec-8801-febde2fcef17 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:58.100923 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9484c9f8-a0ac-46ec-8801-febde2fcef17 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:58.108339 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9484c9f8-a0ac-46ec-8801-febde2fcef17 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:58.108870 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9484c9f8-a0ac-46ec-8801-febde2fcef17 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:58.188619 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-9484c9f8-a0ac-46ec-8801-febde2fcef17 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Getting quotas for project ed86e4d7dcdb4ea7ad79628b2ae2462d. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:14:58.209247 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-9484c9f8-a0ac-46ec-8801-febde2fcef17 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Getting quotas for user 7f0f0e03b03e4d24ae0a7e5d3b9b7104 and project ed86e4d7dcdb4ea7ad79628b2ae2462d. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:14:58.239466 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-9484c9f8-a0ac-46ec-8801-febde2fcef17 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Going to run 1 instances... {{(pid=129366) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 21:14:58.248667 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-9484c9f8-a0ac-46ec-8801-febde2fcef17 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: 315ce600-cbfd-4885-bc3d-5ab129d57681] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 21:14:58.401432 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-9484c9f8-a0ac-46ec-8801-febde2fcef17 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.605032 Jan 15 21:14:58.404260 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3191/6376] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 21:14:55 2022] POST /compute/v2.1/servers => generated 405 bytes in 2608 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 15 21:14:58.414854 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c34fb712-0b2f-4f2e-a64d-76e4723a3f7a tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:14:58.419741 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c34fb712-0b2f-4f2e-a64d-76e4723a3f7a tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: 315ce600-cbfd-4885-bc3d-5ab129d57681] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:14:59.168569 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-ff2131f4-1b67-401c-a52c-71555b1c8301 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:14:59.174922 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-c34fb712-0b2f-4f2e-a64d-76e4723a3f7a tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:14:59.183969 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ff2131f4-1b67-401c-a52c-71555b1c8301 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1505 microversion: 2.1 time: 1.448646 Jan 15 21:14:59.185003 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3186/6377] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:14:57 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1505 bytes in 1451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:14:59.194855 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d449e269-7496-4289-b894-8c64b365fe6c tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:14:59.197716 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d449e269-7496-4289-b894-8c64b365fe6c tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] [instance: d5d3c9af-fa53-4de5-a559-6d2cd4857a38] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:14:59.199480 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c34fb712-0b2f-4f2e-a64d-76e4723a3f7a tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/315ce600-cbfd-4885-bc3d-5ab129d57681" status: 200 len: 1266 microversion: 2.1 time: 0.788500 Jan 15 21:14:59.207643 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d449e269-7496-4289-b894-8c64b365fe6c tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:59.208337 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d449e269-7496-4289-b894-8c64b365fe6c tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:59.209470 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d449e269-7496-4289-b894-8c64b365fe6c tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:59.210107 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d449e269-7496-4289-b894-8c64b365fe6c tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:59.210328 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3192/6378] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:14:58 2022] GET /compute/v2.1/servers/315ce600-cbfd-4885-bc3d-5ab129d57681 => generated 1266 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:14:59.215486 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-853d91a5-f327-4106-886d-4c63ad63f499 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:14:59.216572 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-853d91a5-f327-4106-886d-4c63ad63f499 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: f816a600-ed27-4a5e-a067-b845b368384d] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:14:59.225668 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-853d91a5-f327-4106-886d-4c63ad63f499 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:59.226218 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-853d91a5-f327-4106-886d-4c63ad63f499 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:59.227336 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-853d91a5-f327-4106-886d-4c63ad63f499 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:59.247214 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-853d91a5-f327-4106-886d-4c63ad63f499 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:59.286958 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-853d91a5-f327-4106-886d-4c63ad63f499 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] HTTP exception thrown: Instance f816a600-ed27-4a5e-a067-b845b368384d could not be found. Jan 15 21:14:59.289302 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-853d91a5-f327-4106-886d-4c63ad63f499 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Returning 404 to user: Instance f816a600-ed27-4a5e-a067-b845b368384d could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:14:59.296188 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-853d91a5-f327-4106-886d-4c63ad63f499 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "POST /compute/v2.1/servers/f816a600-ed27-4a5e-a067-b845b368384d/action" status: 404 len: 111 microversion: 2.1 time: 0.079262 Jan 15 21:14:59.300343 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3193/6379] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:14:59 2022] POST /compute/v2.1/servers/f816a600-ed27-4a5e-a067-b845b368384d/action => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:14:59.308674 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-70cceb37-94a6-4ac0-9fd1-2c1a73ef4095 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:14:59.309324 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-70cceb37-94a6-4ac0-9fd1-2c1a73ef4095 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:14:59.328815 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-70cceb37-94a6-4ac0-9fd1-2c1a73ef4095 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:59.333579 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-70cceb37-94a6-4ac0-9fd1-2c1a73ef4095 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:59.336932 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-70cceb37-94a6-4ac0-9fd1-2c1a73ef4095 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:59.338680 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-70cceb37-94a6-4ac0-9fd1-2c1a73ef4095 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:59.693483 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-70cceb37-94a6-4ac0-9fd1-2c1a73ef4095 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:14:59.705918 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-70cceb37-94a6-4ac0-9fd1-2c1a73ef4095 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1505 microversion: 2.1 time: 0.399740 Jan 15 21:14:59.707239 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3194/6380] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:14:59 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1505 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:14:59.723385 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f0376c40-acc7-4449-b9d4-065a76927955 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:14:59.724047 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f0376c40-acc7-4449-b9d4-065a76927955 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:14:59.735885 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f0376c40-acc7-4449-b9d4-065a76927955 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:59.736415 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f0376c40-acc7-4449-b9d4-065a76927955 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:14:59.737452 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f0376c40-acc7-4449-b9d4-065a76927955 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:14:59.737897 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f0376c40-acc7-4449-b9d4-065a76927955 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:00.154658 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-f0376c40-acc7-4449-b9d4-065a76927955 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:15:00.167098 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f0376c40-acc7-4449-b9d4-065a76927955 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1505 microversion: 2.1 time: 0.447446 Jan 15 21:15:00.169787 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3195/6381] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:14:59 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1505 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:15:00.186898 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e21f9f4a-1620-4876-8770-e3c27136fbb0 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:15:00.188724 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e21f9f4a-1620-4876-8770-e3c27136fbb0 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b48fb8a2-4aab-45b2-abd3-68a01a96b32d] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:15:00.199378 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-e21f9f4a-1620-4876-8770-e3c27136fbb0 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] HTTP exception thrown: Instance b48fb8a2-4aab-45b2-abd3-68a01a96b32d could not be found. Jan 15 21:15:00.199853 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-d449e269-7496-4289-b894-8c64b365fe6c tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0d769340dc4d36b83436c7fc78bbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de60cd8289224f1f81ef0db9ec3c6f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:15:00.200743 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e21f9f4a-1620-4876-8770-e3c27136fbb0 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Returning 404 to user: Instance b48fb8a2-4aab-45b2-abd3-68a01a96b32d could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:15:00.201815 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e21f9f4a-1620-4876-8770-e3c27136fbb0 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "POST /compute/v2.1/servers/b48fb8a2-4aab-45b2-abd3-68a01a96b32d/action" status: 404 len: 111 microversion: 2.1 time: 0.018918 Jan 15 21:15:00.202926 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3196/6382] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:15:00 2022] POST /compute/v2.1/servers/b48fb8a2-4aab-45b2-abd3-68a01a96b32d/action => generated 111 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:15:00.209469 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d449e269-7496-4289-b894-8c64b365fe6c tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] 10.222.0.46 "GET /compute/v2.1/servers/d5d3c9af-fa53-4de5-a559-6d2cd4857a38" status: 200 len: 1374 microversion: 2.1 time: 1.021501 Jan 15 21:15:00.212891 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3187/6383] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:14:59 2022] GET /compute/v2.1/servers/d5d3c9af-fa53-4de5-a559-6d2cd4857a38 => generated 1374 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:15:00.217361 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-28214e94-5819-497a-a550-665a5174a0e8 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:15:00.218380 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-28214e94-5819-497a-a550-665a5174a0e8 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:15:00.227489 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8fb18c09-bf81-40e1-9013-8ca3a29bc750 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:15:00.228193 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-8fb18c09-bf81-40e1-9013-8ca3a29bc750 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: 315ce600-cbfd-4885-bc3d-5ab129d57681] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:15:00.245399 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-28214e94-5819-497a-a550-665a5174a0e8 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:00.246131 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-28214e94-5819-497a-a550-665a5174a0e8 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:00.248147 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-28214e94-5819-497a-a550-665a5174a0e8 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:00.249176 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-28214e94-5819-497a-a550-665a5174a0e8 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:00.255129 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8fb18c09-bf81-40e1-9013-8ca3a29bc750 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:00.256234 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8fb18c09-bf81-40e1-9013-8ca3a29bc750 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:00.259119 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8fb18c09-bf81-40e1-9013-8ca3a29bc750 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:00.281050 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8fb18c09-bf81-40e1-9013-8ca3a29bc750 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:00.424525 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-8fb18c09-bf81-40e1-9013-8ca3a29bc750 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:15:00.432882 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-8fb18c09-bf81-40e1-9013-8ca3a29bc750 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/315ce600-cbfd-4885-bc3d-5ab129d57681" status: 200 len: 1336 microversion: 2.1 time: 0.217658 Jan 15 21:15:00.444561 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3188/6384] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:15:00 2022] GET /compute/v2.1/servers/315ce600-cbfd-4885-bc3d-5ab129d57681 => generated 1336 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:15:00.566539 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-28214e94-5819-497a-a550-665a5174a0e8 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:15:00.575072 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-28214e94-5819-497a-a550-665a5174a0e8 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1505 microversion: 2.1 time: 0.365918 Jan 15 21:15:00.576663 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3197/6385] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:15:00 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1505 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:15:00.595582 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-396953df-2310-4dde-a676-003547400fbc tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:15:00.597516 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-396953df-2310-4dde-a676-003547400fbc tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:15:00.604334 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-396953df-2310-4dde-a676-003547400fbc tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:00.605249 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-396953df-2310-4dde-a676-003547400fbc tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:00.606369 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-396953df-2310-4dde-a676-003547400fbc tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:00.607122 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-396953df-2310-4dde-a676-003547400fbc tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:00.966131 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-396953df-2310-4dde-a676-003547400fbc tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:15:00.986975 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-396953df-2310-4dde-a676-003547400fbc tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1505 microversion: 2.1 time: 0.395319 Jan 15 21:15:00.988653 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3189/6386] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:15:00 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1505 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:15:01.005336 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-2949f5bf-90c2-4ebd-b253-c9dcba0e41e2 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:15:01.006688 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-2949f5bf-90c2-4ebd-b253-c9dcba0e41e2 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: f816a600-ed27-4a5e-a067-b845b368384d] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:15:01.013844 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2949f5bf-90c2-4ebd-b253-c9dcba0e41e2 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:01.014292 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2949f5bf-90c2-4ebd-b253-c9dcba0e41e2 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:01.015313 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2949f5bf-90c2-4ebd-b253-c9dcba0e41e2 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:01.015933 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2949f5bf-90c2-4ebd-b253-c9dcba0e41e2 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:01.030630 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-2949f5bf-90c2-4ebd-b253-c9dcba0e41e2 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] HTTP exception thrown: Instance f816a600-ed27-4a5e-a067-b845b368384d could not be found. Jan 15 21:15:01.031232 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-2949f5bf-90c2-4ebd-b253-c9dcba0e41e2 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Returning 404 to user: Instance f816a600-ed27-4a5e-a067-b845b368384d could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:15:01.032495 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-2949f5bf-90c2-4ebd-b253-c9dcba0e41e2 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "POST /compute/v2.1/servers/f816a600-ed27-4a5e-a067-b845b368384d/action" status: 404 len: 111 microversion: 2.1 time: 0.032419 Jan 15 21:15:01.033116 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3198/6387] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:15:00 2022] POST /compute/v2.1/servers/f816a600-ed27-4a5e-a067-b845b368384d/action => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:15:01.041787 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ff4cb0df-60d3-4165-aaf8-c583a1beeb2e tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:15:01.042387 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ff4cb0df-60d3-4165-aaf8-c583a1beeb2e tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:15:01.051063 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ff4cb0df-60d3-4165-aaf8-c583a1beeb2e tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:01.052156 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ff4cb0df-60d3-4165-aaf8-c583a1beeb2e tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:01.053714 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ff4cb0df-60d3-4165-aaf8-c583a1beeb2e tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:01.054304 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ff4cb0df-60d3-4165-aaf8-c583a1beeb2e tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:01.213227 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-ff4cb0df-60d3-4165-aaf8-c583a1beeb2e tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:15:01.224169 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ff4cb0df-60d3-4165-aaf8-c583a1beeb2e tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1505 microversion: 2.1 time: 0.186218 Jan 15 21:15:01.230704 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b6346beb-e79e-4f7b-9517-06f60b6550d4 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:15:01.232164 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b6346beb-e79e-4f7b-9517-06f60b6550d4 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] [instance: d5d3c9af-fa53-4de5-a559-6d2cd4857a38] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:15:01.233570 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3190/6388] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:15:01 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1505 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:15:01.240335 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b6346beb-e79e-4f7b-9517-06f60b6550d4 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:01.240971 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b6346beb-e79e-4f7b-9517-06f60b6550d4 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:01.242169 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b6346beb-e79e-4f7b-9517-06f60b6550d4 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:01.242772 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b6346beb-e79e-4f7b-9517-06f60b6550d4 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:01.258961 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-fb2c80dc-24d7-4a5a-9d01-5e4fd9797665 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:15:01.262431 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-fb2c80dc-24d7-4a5a-9d01-5e4fd9797665 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:15:01.275584 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fb2c80dc-24d7-4a5a-9d01-5e4fd9797665 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:01.276547 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fb2c80dc-24d7-4a5a-9d01-5e4fd9797665 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:01.277986 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fb2c80dc-24d7-4a5a-9d01-5e4fd9797665 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:01.279352 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fb2c80dc-24d7-4a5a-9d01-5e4fd9797665 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:01.519065 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-b6346beb-e79e-4f7b-9517-06f60b6550d4 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0d769340dc4d36b83436c7fc78bbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de60cd8289224f1f81ef0db9ec3c6f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:15:01.531480 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b6346beb-e79e-4f7b-9517-06f60b6550d4 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] 10.222.0.46 "GET /compute/v2.1/servers/d5d3c9af-fa53-4de5-a559-6d2cd4857a38" status: 200 len: 1374 microversion: 2.1 time: 0.305090 Jan 15 21:15:01.542199 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3199/6389] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:15:01 2022] GET /compute/v2.1/servers/d5d3c9af-fa53-4de5-a559-6d2cd4857a38 => generated 1374 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:15:01.542199 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c816c2d9-6f18-4c73-ab31-4a5ea62c9e90 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:15:01.545206 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c816c2d9-6f18-4c73-ab31-4a5ea62c9e90 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: 315ce600-cbfd-4885-bc3d-5ab129d57681] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:15:01.554800 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c816c2d9-6f18-4c73-ab31-4a5ea62c9e90 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:01.555612 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c816c2d9-6f18-4c73-ab31-4a5ea62c9e90 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:01.556728 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c816c2d9-6f18-4c73-ab31-4a5ea62c9e90 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:01.557406 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c816c2d9-6f18-4c73-ab31-4a5ea62c9e90 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:01.615360 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-fb2c80dc-24d7-4a5a-9d01-5e4fd9797665 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:15:01.630256 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-fb2c80dc-24d7-4a5a-9d01-5e4fd9797665 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1505 microversion: 2.1 time: 0.379329 Jan 15 21:15:01.631827 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3191/6390] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:15:01 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1505 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:15:01.650110 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-1f7c4019-56fe-4883-8e40-eca47b30b5e0 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:15:01.652427 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-1f7c4019-56fe-4883-8e40-eca47b30b5e0 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: 6f9be742-3aa4-45df-9e0b-e700c537e648] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:15:01.653963 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-c816c2d9-6f18-4c73-ab31-4a5ea62c9e90 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:15:01.667434 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-1f7c4019-56fe-4883-8e40-eca47b30b5e0 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] HTTP exception thrown: Instance 6f9be742-3aa4-45df-9e0b-e700c537e648 could not be found. Jan 15 21:15:01.668047 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-1f7c4019-56fe-4883-8e40-eca47b30b5e0 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Returning 404 to user: Instance 6f9be742-3aa4-45df-9e0b-e700c537e648 could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:15:01.671046 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-1f7c4019-56fe-4883-8e40-eca47b30b5e0 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "POST /compute/v2.1/servers/6f9be742-3aa4-45df-9e0b-e700c537e648/action" status: 404 len: 111 microversion: 2.1 time: 0.023952 Jan 15 21:15:01.671669 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c816c2d9-6f18-4c73-ab31-4a5ea62c9e90 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/315ce600-cbfd-4885-bc3d-5ab129d57681" status: 200 len: 1324 microversion: 2.1 time: 0.134505 Jan 15 21:15:01.672792 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3200/6391] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:15:01 2022] GET /compute/v2.1/servers/315ce600-cbfd-4885-bc3d-5ab129d57681 => generated 1324 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:15:01.675757 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3192/6392] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:15:01 2022] POST /compute/v2.1/servers/6f9be742-3aa4-45df-9e0b-e700c537e648/action => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:15:01.682557 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4252a9af-09df-4e69-aacd-d99f083c014f tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:15:01.683612 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-4252a9af-09df-4e69-aacd-d99f083c014f tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:15:01.695046 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4252a9af-09df-4e69-aacd-d99f083c014f tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:01.695849 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4252a9af-09df-4e69-aacd-d99f083c014f tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:01.696948 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4252a9af-09df-4e69-aacd-d99f083c014f tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:01.697627 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4252a9af-09df-4e69-aacd-d99f083c014f tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:02.117547 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-4252a9af-09df-4e69-aacd-d99f083c014f tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:15:02.133264 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-4252a9af-09df-4e69-aacd-d99f083c014f tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1505 microversion: 2.1 time: 0.455446 Jan 15 21:15:02.133896 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3201/6393] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:15:01 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1505 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:15:02.151070 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-1dc6d0c2-b92c-48e9-ab8b-e05606a7ed77 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:15:02.151694 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-1dc6d0c2-b92c-48e9-ab8b-e05606a7ed77 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:15:02.161285 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1dc6d0c2-b92c-48e9-ab8b-e05606a7ed77 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:02.162436 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1dc6d0c2-b92c-48e9-ab8b-e05606a7ed77 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:02.163514 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1dc6d0c2-b92c-48e9-ab8b-e05606a7ed77 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:02.163951 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1dc6d0c2-b92c-48e9-ab8b-e05606a7ed77 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:02.433428 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-1dc6d0c2-b92c-48e9-ab8b-e05606a7ed77 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:15:02.442250 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-1dc6d0c2-b92c-48e9-ab8b-e05606a7ed77 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1505 microversion: 2.1 time: 0.294977 Jan 15 21:15:02.443406 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3193/6394] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:15:02 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1505 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:15:02.473635 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1459bb8b-6c5e-4a6a-b793-f948d5c242cb tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:15:02.476665 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-1459bb8b-6c5e-4a6a-b793-f948d5c242cb tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: f827a231-b720-4c82-b9ad-c5e9a83c1c5a] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:15:02.488789 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-1459bb8b-6c5e-4a6a-b793-f948d5c242cb tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] HTTP exception thrown: Instance f827a231-b720-4c82-b9ad-c5e9a83c1c5a could not be found. Jan 15 21:15:02.489664 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1459bb8b-6c5e-4a6a-b793-f948d5c242cb tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Returning 404 to user: Instance f827a231-b720-4c82-b9ad-c5e9a83c1c5a could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:15:02.490872 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-1459bb8b-6c5e-4a6a-b793-f948d5c242cb tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "POST /compute/v2.1/servers/f827a231-b720-4c82-b9ad-c5e9a83c1c5a/action" status: 404 len: 111 microversion: 2.1 time: 0.033864 Jan 15 21:15:02.510458 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-43ccc017-1622-49bf-9762-510efeb6bcac tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:15:02.511314 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-43ccc017-1622-49bf-9762-510efeb6bcac tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:15:02.519792 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3202/6395] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:15:02 2022] POST /compute/v2.1/servers/f827a231-b720-4c82-b9ad-c5e9a83c1c5a/action => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:15:02.529136 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-43ccc017-1622-49bf-9762-510efeb6bcac tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:02.534133 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-43ccc017-1622-49bf-9762-510efeb6bcac tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:02.535703 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-43ccc017-1622-49bf-9762-510efeb6bcac tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:02.536242 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-43ccc017-1622-49bf-9762-510efeb6bcac tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:02.549929 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-3d839c0d-6146-43fb-ab4a-edaa621510e1 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:15:02.550677 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-3d839c0d-6146-43fb-ab4a-edaa621510e1 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] [instance: d5d3c9af-fa53-4de5-a559-6d2cd4857a38] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:15:02.572068 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3d839c0d-6146-43fb-ab4a-edaa621510e1 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:02.576862 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3d839c0d-6146-43fb-ab4a-edaa621510e1 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:02.577735 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3d839c0d-6146-43fb-ab4a-edaa621510e1 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:02.578183 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3d839c0d-6146-43fb-ab4a-edaa621510e1 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:03.103819 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-43ccc017-1622-49bf-9762-510efeb6bcac tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:15:03.110102 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-3d839c0d-6146-43fb-ab4a-edaa621510e1 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0d769340dc4d36b83436c7fc78bbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de60cd8289224f1f81ef0db9ec3c6f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:15:03.115588 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-43ccc017-1622-49bf-9762-510efeb6bcac tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1505 microversion: 2.1 time: 0.609909 Jan 15 21:15:03.116217 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3194/6396] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:15:02 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1505 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:15:03.134150 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-3d839c0d-6146-43fb-ab4a-edaa621510e1 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] 10.222.0.46 "GET /compute/v2.1/servers/d5d3c9af-fa53-4de5-a559-6d2cd4857a38" status: 200 len: 1374 microversion: 2.1 time: 0.575356 Jan 15 21:15:03.134150 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3203/6397] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:15:02 2022] GET /compute/v2.1/servers/d5d3c9af-fa53-4de5-a559-6d2cd4857a38 => generated 1374 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:15:03.139225 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ac5b5e34-68f3-4e5b-894e-b1ce879ba8b7 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:15:03.141007 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ac5b5e34-68f3-4e5b-894e-b1ce879ba8b7 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: 315ce600-cbfd-4885-bc3d-5ab129d57681] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:15:03.144431 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-59bb2532-6232-45cd-a80c-81a4b3945adc tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:15:03.145554 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-59bb2532-6232-45cd-a80c-81a4b3945adc tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:15:03.152075 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-59bb2532-6232-45cd-a80c-81a4b3945adc tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:03.152885 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-59bb2532-6232-45cd-a80c-81a4b3945adc tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:03.153897 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-59bb2532-6232-45cd-a80c-81a4b3945adc tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:03.154218 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ac5b5e34-68f3-4e5b-894e-b1ce879ba8b7 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:03.154628 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ac5b5e34-68f3-4e5b-894e-b1ce879ba8b7 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:03.154968 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-59bb2532-6232-45cd-a80c-81a4b3945adc tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:03.155434 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ac5b5e34-68f3-4e5b-894e-b1ce879ba8b7 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:03.155894 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ac5b5e34-68f3-4e5b-894e-b1ce879ba8b7 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:03.960248 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-59bb2532-6232-45cd-a80c-81a4b3945adc tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:15:03.962552 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-ac5b5e34-68f3-4e5b-894e-b1ce879ba8b7 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:15:03.971463 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ac5b5e34-68f3-4e5b-894e-b1ce879ba8b7 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/315ce600-cbfd-4885-bc3d-5ab129d57681" status: 200 len: 1391 microversion: 2.1 time: 0.846465 Jan 15 21:15:03.986738 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3204/6398] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:15:03 2022] GET /compute/v2.1/servers/315ce600-cbfd-4885-bc3d-5ab129d57681 => generated 1391 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:15:03.995658 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-59bb2532-6232-45cd-a80c-81a4b3945adc tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1505 microversion: 2.1 time: 0.857267 Jan 15 21:15:03.995943 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-be3bafe7-e830-4fc6-9d38-8beaa46ae58b req-b06fde37-c50b-400f-a3b0-71eb0d536888 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "315ce600-cbfd-4885-bc3d-5ab129d57681", "tag": "5946fdbc-5c0f-444f-9903-f401907ec9ec"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:15:04.002814 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:15:04.002814 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:15:04.015693 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3195/6399] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:15:03 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1505 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:15:04.027150 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-be3bafe7-e830-4fc6-9d38-8beaa46ae58b req-b06fde37-c50b-400f-a3b0-71eb0d536888 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:04.036381 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-be3bafe7-e830-4fc6-9d38-8beaa46ae58b req-b06fde37-c50b-400f-a3b0-71eb0d536888 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:04.055294 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e998cf19-c824-4cda-ad55-b4faf15eb212 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:15:04.057796 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e998cf19-c824-4cda-ad55-b4faf15eb212 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:15:04.068256 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-be3bafe7-e830-4fc6-9d38-8beaa46ae58b req-b06fde37-c50b-400f-a3b0-71eb0d536888 service nova] Creating event network-changed:5946fdbc-5c0f-444f-9903-f401907ec9ec for instance 315ce600-cbfd-4885-bc3d-5ab129d57681 on nch2-master-1 Jan 15 21:15:04.075615 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e998cf19-c824-4cda-ad55-b4faf15eb212 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:04.075977 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e998cf19-c824-4cda-ad55-b4faf15eb212 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:04.077026 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e998cf19-c824-4cda-ad55-b4faf15eb212 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:04.077230 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-be3bafe7-e830-4fc6-9d38-8beaa46ae58b req-b06fde37-c50b-400f-a3b0-71eb0d536888 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088758 Jan 15 21:15:04.077847 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3205/6400] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:15:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:15:04.078128 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e998cf19-c824-4cda-ad55-b4faf15eb212 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:04.142368 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-e998cf19-c824-4cda-ad55-b4faf15eb212 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] HTTP exception thrown: Cannot 'restore' instance b10c8309-687a-4474-8f64-9956816741db while it is in vm_state active Jan 15 21:15:04.144043 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e998cf19-c824-4cda-ad55-b4faf15eb212 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Returning 409 to user: Cannot 'restore' instance b10c8309-687a-4474-8f64-9956816741db while it is in vm_state active {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:15:04.145107 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e998cf19-c824-4cda-ad55-b4faf15eb212 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "POST /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db/action" status: 409 len: 145 microversion: 2.1 time: 0.126446 Jan 15 21:15:04.149329 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3196/6401] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:15:04 2022] POST /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db/action => generated 145 bytes in 133 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jan 15 21:15:04.151033 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8a64c8bb-be24-4b54-87c6-dc71f72a7400 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:15:04.151759 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-8a64c8bb-be24-4b54-87c6-dc71f72a7400 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] [instance: d5d3c9af-fa53-4de5-a559-6d2cd4857a38] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:15:04.154628 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-88104ace-03b3-4c78-a499-7b78717bd99e tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:15:04.155446 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-88104ace-03b3-4c78-a499-7b78717bd99e tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:15:04.163756 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-88104ace-03b3-4c78-a499-7b78717bd99e tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:04.164477 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-88104ace-03b3-4c78-a499-7b78717bd99e tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:04.165531 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-88104ace-03b3-4c78-a499-7b78717bd99e tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:04.165964 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-88104ace-03b3-4c78-a499-7b78717bd99e tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:04.171632 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8a64c8bb-be24-4b54-87c6-dc71f72a7400 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:04.171938 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8a64c8bb-be24-4b54-87c6-dc71f72a7400 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:04.172757 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8a64c8bb-be24-4b54-87c6-dc71f72a7400 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:04.173350 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8a64c8bb-be24-4b54-87c6-dc71f72a7400 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:04.731614 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-88104ace-03b3-4c78-a499-7b78717bd99e tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:15:04.747766 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-88104ace-03b3-4c78-a499-7b78717bd99e tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1505 microversion: 2.1 time: 0.597091 Jan 15 21:15:04.749576 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3197/6402] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:15:04 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1505 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:15:04.766371 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2e51f644-6eb4-49f1-a31f-88e9c1d427a5 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:15:04.767273 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-2e51f644-6eb4-49f1-a31f-88e9c1d427a5 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:15:04.778814 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2e51f644-6eb4-49f1-a31f-88e9c1d427a5 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:04.781376 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2e51f644-6eb4-49f1-a31f-88e9c1d427a5 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:04.788593 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2e51f644-6eb4-49f1-a31f-88e9c1d427a5 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:04.789439 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2e51f644-6eb4-49f1-a31f-88e9c1d427a5 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:04.954109 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-8a64c8bb-be24-4b54-87c6-dc71f72a7400 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0d769340dc4d36b83436c7fc78bbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de60cd8289224f1f81ef0db9ec3c6f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:15:04.966756 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-8a64c8bb-be24-4b54-87c6-dc71f72a7400 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] 10.222.0.46 "GET /compute/v2.1/servers/d5d3c9af-fa53-4de5-a559-6d2cd4857a38" status: 200 len: 1374 microversion: 2.1 time: 0.820548 Jan 15 21:15:04.968081 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3206/6403] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:15:04 2022] GET /compute/v2.1/servers/d5d3c9af-fa53-4de5-a559-6d2cd4857a38 => generated 1374 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:15:05.199920 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-38e7c874-0891-4174-bc22-fb0aee378241 req-fc6efa71-da12-46ef-a734-15a4492cfe5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5d3c9af-fa53-4de5-a559-6d2cd4857a38", "name": "network-vif-plugged", "status": "completed", "tag": "a324cd95-18a9-4be1-9b39-644e1887801c"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:15:05.201523 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:15:05.201523 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:15:05.210410 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-38e7c874-0891-4174-bc22-fb0aee378241 req-fc6efa71-da12-46ef-a734-15a4492cfe5e service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:05.211147 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-38e7c874-0891-4174-bc22-fb0aee378241 req-fc6efa71-da12-46ef-a734-15a4492cfe5e service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:05.225811 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-38e7c874-0891-4174-bc22-fb0aee378241 req-fc6efa71-da12-46ef-a734-15a4492cfe5e service nova] Creating event network-vif-plugged:a324cd95-18a9-4be1-9b39-644e1887801c for instance d5d3c9af-fa53-4de5-a559-6d2cd4857a38 on nch1-master-1 Jan 15 21:15:05.232269 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-38e7c874-0891-4174-bc22-fb0aee378241 req-fc6efa71-da12-46ef-a734-15a4492cfe5e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.249623 Jan 15 21:15:05.233487 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3207/6404] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:15:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:15:05.241621 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-2e51f644-6eb4-49f1-a31f-88e9c1d427a5 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:15:05.256590 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2e51f644-6eb4-49f1-a31f-88e9c1d427a5 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1505 microversion: 2.1 time: 0.492104 Jan 15 21:15:05.270434 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-375d6f66-d56e-4e66-879e-ac7528423329 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:15:05.271192 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-375d6f66-d56e-4e66-879e-ac7528423329 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: 315ce600-cbfd-4885-bc3d-5ab129d57681] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:15:05.277026 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3198/6405] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:15:04 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1505 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:15:05.278625 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-375d6f66-d56e-4e66-879e-ac7528423329 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:05.279306 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-375d6f66-d56e-4e66-879e-ac7528423329 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:05.280344 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-375d6f66-d56e-4e66-879e-ac7528423329 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:05.280969 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-375d6f66-d56e-4e66-879e-ac7528423329 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:05.291548 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-698191be-165d-4593-8aa3-c784b0032c36 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:15:05.293074 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-698191be-165d-4593-8aa3-c784b0032c36 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: 4a9f618f-314b-4fee-ab60-6742c182af4d] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:15:05.301190 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-698191be-165d-4593-8aa3-c784b0032c36 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] HTTP exception thrown: Instance 4a9f618f-314b-4fee-ab60-6742c182af4d could not be found. Jan 15 21:15:05.302405 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-698191be-165d-4593-8aa3-c784b0032c36 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Returning 404 to user: Instance 4a9f618f-314b-4fee-ab60-6742c182af4d could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:15:05.303605 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-698191be-165d-4593-8aa3-c784b0032c36 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "POST /compute/v2.1/servers/4a9f618f-314b-4fee-ab60-6742c182af4d/action" status: 404 len: 111 microversion: 2.1 time: 0.024699 Jan 15 21:15:05.309129 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3199/6406] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:15:05 2022] POST /compute/v2.1/servers/4a9f618f-314b-4fee-ab60-6742c182af4d/action => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:15:05.316304 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f879c7d8-f3b4-43bf-aae0-96d3b99484f7 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:15:05.317318 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f879c7d8-f3b4-43bf-aae0-96d3b99484f7 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:15:05.326551 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f879c7d8-f3b4-43bf-aae0-96d3b99484f7 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:05.327418 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f879c7d8-f3b4-43bf-aae0-96d3b99484f7 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:05.329222 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f879c7d8-f3b4-43bf-aae0-96d3b99484f7 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:05.330003 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f879c7d8-f3b4-43bf-aae0-96d3b99484f7 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:05.971353 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-f879c7d8-f3b4-43bf-aae0-96d3b99484f7 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:15:05.983298 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f879c7d8-f3b4-43bf-aae0-96d3b99484f7 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1505 microversion: 2.1 time: 0.672428 Jan 15 21:15:05.997826 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3200/6407] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:15:05 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1505 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:15:05.997826 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-34562d0b-df15-41a2-ae56-9b3d99321533 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:15:05.997826 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-34562d0b-df15-41a2-ae56-9b3d99321533 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] [instance: d5d3c9af-fa53-4de5-a559-6d2cd4857a38] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:15:06.007792 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-375d6f66-d56e-4e66-879e-ac7528423329 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:15:06.013464 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-34562d0b-df15-41a2-ae56-9b3d99321533 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:06.013794 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-34562d0b-df15-41a2-ae56-9b3d99321533 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:06.014598 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-34562d0b-df15-41a2-ae56-9b3d99321533 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:06.015036 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-34562d0b-df15-41a2-ae56-9b3d99321533 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:06.034071 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-375d6f66-d56e-4e66-879e-ac7528423329 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/315ce600-cbfd-4885-bc3d-5ab129d57681" status: 200 len: 1391 microversion: 2.1 time: 0.795497 Jan 15 21:15:06.034751 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3208/6408] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:15:05 2022] GET /compute/v2.1/servers/315ce600-cbfd-4885-bc3d-5ab129d57681 => generated 1391 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:15:06.039769 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-388293fb-b2d6-4dfb-bf70-50c2c0312f0c tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:15:06.049715 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-388293fb-b2d6-4dfb-bf70-50c2c0312f0c tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:15:06.075912 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-388293fb-b2d6-4dfb-bf70-50c2c0312f0c tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:06.076878 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-388293fb-b2d6-4dfb-bf70-50c2c0312f0c tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:06.080532 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-388293fb-b2d6-4dfb-bf70-50c2c0312f0c tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:06.082471 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-388293fb-b2d6-4dfb-bf70-50c2c0312f0c tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:06.404229 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-34562d0b-df15-41a2-ae56-9b3d99321533 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0d769340dc4d36b83436c7fc78bbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de60cd8289224f1f81ef0db9ec3c6f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:15:06.415352 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-34562d0b-df15-41a2-ae56-9b3d99321533 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] 10.222.0.46 "GET /compute/v2.1/servers/d5d3c9af-fa53-4de5-a559-6d2cd4857a38" status: 200 len: 1374 microversion: 2.1 time: 0.430110 Jan 15 21:15:06.417629 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3201/6409] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:15:05 2022] GET /compute/v2.1/servers/d5d3c9af-fa53-4de5-a559-6d2cd4857a38 => generated 1374 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:15:06.795751 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-388293fb-b2d6-4dfb-bf70-50c2c0312f0c tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:15:06.818954 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-388293fb-b2d6-4dfb-bf70-50c2c0312f0c tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1505 microversion: 2.1 time: 0.782838 Jan 15 21:15:06.821026 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3209/6410] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:15:06 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1505 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:15:06.837886 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-df0cacea-e98e-43e9-8ad2-e354ba8f4218 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:15:06.838232 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-df0cacea-e98e-43e9-8ad2-e354ba8f4218 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:15:06.850432 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-df0cacea-e98e-43e9-8ad2-e354ba8f4218 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:06.851046 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-df0cacea-e98e-43e9-8ad2-e354ba8f4218 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:06.851914 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-df0cacea-e98e-43e9-8ad2-e354ba8f4218 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:06.852363 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-df0cacea-e98e-43e9-8ad2-e354ba8f4218 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:06.920236 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-df0cacea-e98e-43e9-8ad2-e354ba8f4218 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] HTTP exception thrown: Cannot 'resume' instance b10c8309-687a-4474-8f64-9956816741db while it is in vm_state active Jan 15 21:15:06.920851 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-df0cacea-e98e-43e9-8ad2-e354ba8f4218 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Returning 409 to user: Cannot 'resume' instance b10c8309-687a-4474-8f64-9956816741db while it is in vm_state active {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:15:06.921873 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-df0cacea-e98e-43e9-8ad2-e354ba8f4218 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "POST /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db/action" status: 409 len: 144 microversion: 2.1 time: 0.088030 Jan 15 21:15:06.924631 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3202/6411] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:15:06 2022] POST /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db/action => generated 144 bytes in 91 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jan 15 21:15:06.936769 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-6004b145-c02a-439d-9fbc-7758ffcc7033 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:15:06.937479 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-6004b145-c02a-439d-9fbc-7758ffcc7033 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:15:06.952170 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6004b145-c02a-439d-9fbc-7758ffcc7033 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:06.952680 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6004b145-c02a-439d-9fbc-7758ffcc7033 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:06.953564 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6004b145-c02a-439d-9fbc-7758ffcc7033 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:06.954006 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6004b145-c02a-439d-9fbc-7758ffcc7033 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:07.056253 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2ed83f00-0bb6-42e6-a987-a287bbabb0bd tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:15:07.057168 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-2ed83f00-0bb6-42e6-a987-a287bbabb0bd tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: 315ce600-cbfd-4885-bc3d-5ab129d57681] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:15:07.073347 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2ed83f00-0bb6-42e6-a987-a287bbabb0bd tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:07.073799 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2ed83f00-0bb6-42e6-a987-a287bbabb0bd tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:07.074812 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2ed83f00-0bb6-42e6-a987-a287bbabb0bd tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:07.075464 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2ed83f00-0bb6-42e6-a987-a287bbabb0bd tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:07.418062 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-6004b145-c02a-439d-9fbc-7758ffcc7033 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:15:07.443318 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-6004b145-c02a-439d-9fbc-7758ffcc7033 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1505 microversion: 2.1 time: 0.512922 Jan 15 21:15:07.457174 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3210/6412] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:15:06 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1505 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:15:07.467786 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-db298fed-fb9f-4edd-ba33-91b852d6de93 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:15:07.469094 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-db298fed-fb9f-4edd-ba33-91b852d6de93 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] [instance: d5d3c9af-fa53-4de5-a559-6d2cd4857a38] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:15:07.477063 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-db298fed-fb9f-4edd-ba33-91b852d6de93 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:07.479304 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-db298fed-fb9f-4edd-ba33-91b852d6de93 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:07.480629 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-db298fed-fb9f-4edd-ba33-91b852d6de93 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:07.481344 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-db298fed-fb9f-4edd-ba33-91b852d6de93 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:07.667678 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-2ed83f00-0bb6-42e6-a987-a287bbabb0bd tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:15:07.683877 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2ed83f00-0bb6-42e6-a987-a287bbabb0bd tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/315ce600-cbfd-4885-bc3d-5ab129d57681" status: 200 len: 1391 microversion: 2.1 time: 0.635944 Jan 15 21:15:07.696923 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3203/6413] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:15:07 2022] GET /compute/v2.1/servers/315ce600-cbfd-4885-bc3d-5ab129d57681 => generated 1391 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:15:07.708880 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-fcc4a550-da7c-402a-b2b7-9283d3372059 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:15:07.709828 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-fcc4a550-da7c-402a-b2b7-9283d3372059 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:15:07.718559 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fcc4a550-da7c-402a-b2b7-9283d3372059 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:07.720962 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fcc4a550-da7c-402a-b2b7-9283d3372059 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:07.722278 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fcc4a550-da7c-402a-b2b7-9283d3372059 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:07.723108 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fcc4a550-da7c-402a-b2b7-9283d3372059 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:07.930917 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-db298fed-fb9f-4edd-ba33-91b852d6de93 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0d769340dc4d36b83436c7fc78bbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de60cd8289224f1f81ef0db9ec3c6f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:15:07.939012 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-db298fed-fb9f-4edd-ba33-91b852d6de93 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] 10.222.0.46 "GET /compute/v2.1/servers/d5d3c9af-fa53-4de5-a559-6d2cd4857a38" status: 200 len: 1547 microversion: 2.1 time: 0.480342 Jan 15 21:15:07.946678 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3211/6414] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:15:07 2022] GET /compute/v2.1/servers/d5d3c9af-fa53-4de5-a559-6d2cd4857a38 => generated 1547 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:15:07.965264 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-de03bdff-ffa6-4b9d-bddd-4b354a2cf45d tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:15:07.966642 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-de03bdff-ffa6-4b9d-bddd-4b354a2cf45d tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] [instance: d5d3c9af-fa53-4de5-a559-6d2cd4857a38] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:15:07.978268 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-de03bdff-ffa6-4b9d-bddd-4b354a2cf45d tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:07.978856 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-de03bdff-ffa6-4b9d-bddd-4b354a2cf45d tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:07.980294 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-de03bdff-ffa6-4b9d-bddd-4b354a2cf45d tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:07.980990 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-de03bdff-ffa6-4b9d-bddd-4b354a2cf45d tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:08.107710 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-fcc4a550-da7c-402a-b2b7-9283d3372059 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:15:08.132147 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-fcc4a550-da7c-402a-b2b7-9283d3372059 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1505 microversion: 2.1 time: 0.432455 Jan 15 21:15:08.134303 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3204/6415] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:15:07 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1505 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:15:08.272829 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-de03bdff-ffa6-4b9d-bddd-4b354a2cf45d tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0d769340dc4d36b83436c7fc78bbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de60cd8289224f1f81ef0db9ec3c6f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:15:08.280732 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-de03bdff-ffa6-4b9d-bddd-4b354a2cf45d tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] 10.222.0.46 "GET /compute/v2.1/servers/d5d3c9af-fa53-4de5-a559-6d2cd4857a38" status: 200 len: 1547 microversion: 2.1 time: 0.322125 Jan 15 21:15:08.284309 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3212/6416] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:15:07 2022] GET /compute/v2.1/servers/d5d3c9af-fa53-4de5-a559-6d2cd4857a38 => generated 1547 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:15:08.310618 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-bb371fb1-5b8d-4e1d-91ea-bccf412818f3 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "networks": [{"uuid": "84d2c5a2-b550-4f8e-b1d9-357aedfbd096"}]}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:15:08.316763 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-bb371fb1-5b8d-4e1d-91ea-bccf412818f3 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:15:08.319946 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-bb371fb1-5b8d-4e1d-91ea-bccf412818f3 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.011209 Jan 15 21:15:08.321539 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3205/6417] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 21:15:08 2022] POST /compute/v2.1/servers => generated 108 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 15 21:15:08.330780 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-6dfd6973-f974-468f-bda9-4d4d5fe603dc tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:15:08.330780 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-6dfd6973-f974-468f-bda9-4d4d5fe603dc tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:15:08.340474 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6dfd6973-f974-468f-bda9-4d4d5fe603dc tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:08.348999 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6dfd6973-f974-468f-bda9-4d4d5fe603dc tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:08.350128 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6dfd6973-f974-468f-bda9-4d4d5fe603dc tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:08.350591 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6dfd6973-f974-468f-bda9-4d4d5fe603dc tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:08.701947 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-75f5448d-222d-41df-82e4-00402b92a913 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:15:08.703342 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-75f5448d-222d-41df-82e4-00402b92a913 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: 315ce600-cbfd-4885-bc3d-5ab129d57681] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:15:08.715565 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-75f5448d-222d-41df-82e4-00402b92a913 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:08.716034 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-75f5448d-222d-41df-82e4-00402b92a913 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:08.716860 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-75f5448d-222d-41df-82e4-00402b92a913 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:08.717294 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-75f5448d-222d-41df-82e4-00402b92a913 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:08.718048 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-6dfd6973-f974-468f-bda9-4d4d5fe603dc tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:15:08.742476 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-6dfd6973-f974-468f-bda9-4d4d5fe603dc tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1505 microversion: 2.1 time: 0.416454 Jan 15 21:15:08.780174 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3213/6418] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:15:08 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1505 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:15:08.803495 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-da5def1c-10e0-45d6-a0af-8f81ee3752dc tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:15:08.804744 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-da5def1c-10e0-45d6-a0af-8f81ee3752dc tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:15:08.819507 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-da5def1c-10e0-45d6-a0af-8f81ee3752dc tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:08.822909 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-da5def1c-10e0-45d6-a0af-8f81ee3752dc tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:08.824652 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-da5def1c-10e0-45d6-a0af-8f81ee3752dc tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:08.825421 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-da5def1c-10e0-45d6-a0af-8f81ee3752dc tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:09.654962 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-da5def1c-10e0-45d6-a0af-8f81ee3752dc tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:15:09.668659 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-da5def1c-10e0-45d6-a0af-8f81ee3752dc tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1505 microversion: 2.1 time: 0.873139 Jan 15 21:15:09.671290 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3214/6419] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:15:08 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1505 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:15:09.688388 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-05a0b0ee-1f5e-42fb-8bdf-29f6787137c5 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:15:09.688968 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-05a0b0ee-1f5e-42fb-8bdf-29f6787137c5 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: 428ca905-1c88-4ef8-af03-9b451a43617e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:15:09.698696 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-05a0b0ee-1f5e-42fb-8bdf-29f6787137c5 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] HTTP exception thrown: Instance 428ca905-1c88-4ef8-af03-9b451a43617e could not be found. Jan 15 21:15:09.699293 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-05a0b0ee-1f5e-42fb-8bdf-29f6787137c5 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Returning 404 to user: Instance 428ca905-1c88-4ef8-af03-9b451a43617e could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:15:09.700122 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-05a0b0ee-1f5e-42fb-8bdf-29f6787137c5 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "POST /compute/v2.1/servers/428ca905-1c88-4ef8-af03-9b451a43617e/action" status: 404 len: 111 microversion: 2.1 time: 0.016122 Jan 15 21:15:09.700700 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3215/6420] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:15:09 2022] POST /compute/v2.1/servers/428ca905-1c88-4ef8-af03-9b451a43617e/action => generated 111 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:15:09.710241 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0111dfc6-3437-4cac-88ad-60361d7a7ae5 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:15:09.710900 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-0111dfc6-3437-4cac-88ad-60361d7a7ae5 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:15:09.718434 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0111dfc6-3437-4cac-88ad-60361d7a7ae5 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:09.719105 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0111dfc6-3437-4cac-88ad-60361d7a7ae5 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:09.719808 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0111dfc6-3437-4cac-88ad-60361d7a7ae5 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:09.720240 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0111dfc6-3437-4cac-88ad-60361d7a7ae5 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:09.804788 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-75f5448d-222d-41df-82e4-00402b92a913 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:15:09.819808 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-75f5448d-222d-41df-82e4-00402b92a913 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/315ce600-cbfd-4885-bc3d-5ab129d57681" status: 200 len: 1391 microversion: 2.1 time: 1.121422 Jan 15 21:15:09.824144 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3206/6421] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:15:08 2022] GET /compute/v2.1/servers/315ce600-cbfd-4885-bc3d-5ab129d57681 => generated 1391 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:15:10.133662 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-0111dfc6-3437-4cac-88ad-60361d7a7ae5 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:15:10.149666 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0111dfc6-3437-4cac-88ad-60361d7a7ae5 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1505 microversion: 2.1 time: 0.443550 Jan 15 21:15:10.151109 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3216/6422] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:15:09 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1505 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:15:10.178913 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3f93dbe0-a261-4664-9cb4-53db82f2bfab tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:15:10.179678 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-3f93dbe0-a261-4664-9cb4-53db82f2bfab tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:15:10.187148 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3f93dbe0-a261-4664-9cb4-53db82f2bfab tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:10.187596 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3f93dbe0-a261-4664-9cb4-53db82f2bfab tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:10.188993 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3f93dbe0-a261-4664-9cb4-53db82f2bfab tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:10.189868 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3f93dbe0-a261-4664-9cb4-53db82f2bfab tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:10.602917 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-3f93dbe0-a261-4664-9cb4-53db82f2bfab tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:15:10.626276 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3f93dbe0-a261-4664-9cb4-53db82f2bfab tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1505 microversion: 2.1 time: 0.455777 Jan 15 21:15:10.644019 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0649780f-20e7-47c2-a258-69ec16e3d5a2 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:15:10.644285 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-0649780f-20e7-47c2-a258-69ec16e3d5a2 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:15:10.644490 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3207/6423] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:15:10 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1505 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:15:10.651081 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0649780f-20e7-47c2-a258-69ec16e3d5a2 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:10.651934 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0649780f-20e7-47c2-a258-69ec16e3d5a2 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:10.652985 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0649780f-20e7-47c2-a258-69ec16e3d5a2 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:10.653657 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0649780f-20e7-47c2-a258-69ec16e3d5a2 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:10.679518 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.objects.instance [None req-0649780f-20e7-47c2-a258-69ec16e3d5a2 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lazy-loading 'flavor' on Instance uuid b10c8309-687a-4474-8f64-9956816741db {{(pid=129366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 21:15:10.842395 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-1e6ef245-9032-4f33-9589-d7ed006c3e7b tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:15:10.844007 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-1e6ef245-9032-4f33-9589-d7ed006c3e7b tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: 315ce600-cbfd-4885-bc3d-5ab129d57681] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:15:10.860576 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1e6ef245-9032-4f33-9589-d7ed006c3e7b tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:10.861021 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1e6ef245-9032-4f33-9589-d7ed006c3e7b tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:10.862633 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1e6ef245-9032-4f33-9589-d7ed006c3e7b tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:10.863084 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1e6ef245-9032-4f33-9589-d7ed006c3e7b tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:11.116400 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0649780f-20e7-47c2-a258-69ec16e3d5a2 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "POST /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db/action" status: 202 len: 0 microversion: 2.1 time: 0.476015 Jan 15 21:15:11.117385 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3217/6424] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:15:10 2022] POST /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db/action => generated 0 bytes in 478 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:15:11.125858 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-52e40e7a-7b10-44f1-891a-899745381137 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:15:11.127216 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-52e40e7a-7b10-44f1-891a-899745381137 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:15:11.138476 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-52e40e7a-7b10-44f1-891a-899745381137 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:11.138629 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-52e40e7a-7b10-44f1-891a-899745381137 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:11.139584 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-52e40e7a-7b10-44f1-891a-899745381137 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:11.140874 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-52e40e7a-7b10-44f1-891a-899745381137 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:11.582627 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-1e6ef245-9032-4f33-9589-d7ed006c3e7b tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:15:11.595867 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-1e6ef245-9032-4f33-9589-d7ed006c3e7b tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/315ce600-cbfd-4885-bc3d-5ab129d57681" status: 200 len: 1391 microversion: 2.1 time: 0.756640 Jan 15 21:15:11.597046 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3208/6425] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:15:10 2022] GET /compute/v2.1/servers/315ce600-cbfd-4885-bc3d-5ab129d57681 => generated 1391 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:15:11.660885 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-52e40e7a-7b10-44f1-891a-899745381137 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:15:11.671758 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-52e40e7a-7b10-44f1-891a-899745381137 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1511 microversion: 2.1 time: 0.549936 Jan 15 21:15:11.683108 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3218/6426] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:15:11 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1511 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:15:12.279156 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-15daa4a3-8e5e-4692-ba46-c619144590d1 req-92e7abb0-02df-41cb-9c62-cdebcf48febb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "315ce600-cbfd-4885-bc3d-5ab129d57681", "name": "network-vif-plugged", "status": "completed", "tag": "5946fdbc-5c0f-444f-9903-f401907ec9ec"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:15:12.281849 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:15:12.281849 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:15:12.320218 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-15daa4a3-8e5e-4692-ba46-c619144590d1 req-92e7abb0-02df-41cb-9c62-cdebcf48febb service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:12.321217 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-15daa4a3-8e5e-4692-ba46-c619144590d1 req-92e7abb0-02df-41cb-9c62-cdebcf48febb service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:12.336486 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-15daa4a3-8e5e-4692-ba46-c619144590d1 req-92e7abb0-02df-41cb-9c62-cdebcf48febb service nova] Creating event network-vif-plugged:5946fdbc-5c0f-444f-9903-f401907ec9ec for instance 315ce600-cbfd-4885-bc3d-5ab129d57681 on nch2-master-1 Jan 15 21:15:12.344360 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-15daa4a3-8e5e-4692-ba46-c619144590d1 req-92e7abb0-02df-41cb-9c62-cdebcf48febb service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070244 Jan 15 21:15:12.346397 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3209/6427] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:15:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:15:12.613311 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-29fb91d4-7280-4550-bc6d-bedeaffa79d2 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:15:12.614533 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-29fb91d4-7280-4550-bc6d-bedeaffa79d2 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: 315ce600-cbfd-4885-bc3d-5ab129d57681] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:15:12.621456 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-29fb91d4-7280-4550-bc6d-bedeaffa79d2 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:12.622144 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-29fb91d4-7280-4550-bc6d-bedeaffa79d2 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:12.623141 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-29fb91d4-7280-4550-bc6d-bedeaffa79d2 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:12.623754 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-29fb91d4-7280-4550-bc6d-bedeaffa79d2 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:12.690450 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-65b2f3be-828c-4e83-ad40-df3a65c84edf tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:15:12.692057 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-65b2f3be-828c-4e83-ad40-df3a65c84edf tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:15:12.699743 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-65b2f3be-828c-4e83-ad40-df3a65c84edf tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:12.700197 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-65b2f3be-828c-4e83-ad40-df3a65c84edf tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:12.701666 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-65b2f3be-828c-4e83-ad40-df3a65c84edf tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:12.702108 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-65b2f3be-828c-4e83-ad40-df3a65c84edf tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:13.342655 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-29fb91d4-7280-4550-bc6d-bedeaffa79d2 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:15:13.353922 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-29fb91d4-7280-4550-bc6d-bedeaffa79d2 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/315ce600-cbfd-4885-bc3d-5ab129d57681" status: 200 len: 1391 microversion: 2.1 time: 0.744268 Jan 15 21:15:13.365242 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3219/6428] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:15:12 2022] GET /compute/v2.1/servers/315ce600-cbfd-4885-bc3d-5ab129d57681 => generated 1391 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:15:13.612141 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-65b2f3be-828c-4e83-ad40-df3a65c84edf tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:15:13.622827 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-65b2f3be-828c-4e83-ad40-df3a65c84edf tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1511 microversion: 2.1 time: 0.936983 Jan 15 21:15:13.624596 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3210/6429] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:15:12 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1511 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:15:14.372116 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4f1971b7-d185-46ce-8109-a7d32b69c5fc tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:15:14.372881 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-4f1971b7-d185-46ce-8109-a7d32b69c5fc tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: 315ce600-cbfd-4885-bc3d-5ab129d57681] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:15:14.391022 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4f1971b7-d185-46ce-8109-a7d32b69c5fc tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:14.391483 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4f1971b7-d185-46ce-8109-a7d32b69c5fc tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:14.393339 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4f1971b7-d185-46ce-8109-a7d32b69c5fc tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:14.393963 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4f1971b7-d185-46ce-8109-a7d32b69c5fc tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:14.641562 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3baceac0-a955-4c64-baea-b0a1d0037bd1 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:15:14.642487 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-3baceac0-a955-4c64-baea-b0a1d0037bd1 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:15:14.653734 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3baceac0-a955-4c64-baea-b0a1d0037bd1 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:14.663042 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3baceac0-a955-4c64-baea-b0a1d0037bd1 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:14.664474 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3baceac0-a955-4c64-baea-b0a1d0037bd1 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:14.665187 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3baceac0-a955-4c64-baea-b0a1d0037bd1 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:14.935475 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-4f1971b7-d185-46ce-8109-a7d32b69c5fc tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:15:14.951726 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-4f1971b7-d185-46ce-8109-a7d32b69c5fc tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/315ce600-cbfd-4885-bc3d-5ab129d57681" status: 200 len: 1563 microversion: 2.1 time: 0.583992 Jan 15 21:15:14.952336 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3220/6430] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:15:14 2022] GET /compute/v2.1/servers/315ce600-cbfd-4885-bc3d-5ab129d57681 => generated 1563 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:15:14.968384 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-246e82b3-80d5-4446-95ca-c7c17ae9ff48 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:15:14.969306 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-246e82b3-80d5-4446-95ca-c7c17ae9ff48 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: 315ce600-cbfd-4885-bc3d-5ab129d57681] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:15:14.979013 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-246e82b3-80d5-4446-95ca-c7c17ae9ff48 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:14.979768 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-246e82b3-80d5-4446-95ca-c7c17ae9ff48 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:14.983113 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-246e82b3-80d5-4446-95ca-c7c17ae9ff48 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:14.983802 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-246e82b3-80d5-4446-95ca-c7c17ae9ff48 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:15.203003 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-3baceac0-a955-4c64-baea-b0a1d0037bd1 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:15:15.237074 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3baceac0-a955-4c64-baea-b0a1d0037bd1 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1511 microversion: 2.1 time: 0.599341 Jan 15 21:15:15.238467 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3211/6431] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:15:14 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1511 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:15:15.330101 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-246e82b3-80d5-4446-95ca-c7c17ae9ff48 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:15:15.345451 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-246e82b3-80d5-4446-95ca-c7c17ae9ff48 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/315ce600-cbfd-4885-bc3d-5ab129d57681" status: 200 len: 1563 microversion: 2.1 time: 0.380035 Jan 15 21:15:15.347210 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3221/6432] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:15:14 2022] GET /compute/v2.1/servers/315ce600-cbfd-4885-bc3d-5ab129d57681 => generated 1563 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:15:16.259604 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-38c260f9-15a1-4c41-bc54-be18ce8cb1dc tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:15:16.260235 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-38c260f9-15a1-4c41-bc54-be18ce8cb1dc tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:15:16.280186 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-38c260f9-15a1-4c41-bc54-be18ce8cb1dc tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:16.280635 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-38c260f9-15a1-4c41-bc54-be18ce8cb1dc tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:16.281488 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-38c260f9-15a1-4c41-bc54-be18ce8cb1dc tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:16.281926 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-38c260f9-15a1-4c41-bc54-be18ce8cb1dc tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:16.569173 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-38c260f9-15a1-4c41-bc54-be18ce8cb1dc tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:15:16.581640 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-38c260f9-15a1-4c41-bc54-be18ce8cb1dc tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1511 microversion: 2.1 time: 0.330461 Jan 15 21:15:16.593732 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3212/6433] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:15:16 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1511 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:15:17.603720 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0f3cc9fe-710b-4fca-9d1c-164e5a2a48aa tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:15:17.604550 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-0f3cc9fe-710b-4fca-9d1c-164e5a2a48aa tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:15:17.617152 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0f3cc9fe-710b-4fca-9d1c-164e5a2a48aa tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:17.617703 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0f3cc9fe-710b-4fca-9d1c-164e5a2a48aa tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:17.618850 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0f3cc9fe-710b-4fca-9d1c-164e5a2a48aa tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:17.619388 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0f3cc9fe-710b-4fca-9d1c-164e5a2a48aa tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:17.986270 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-0f3cc9fe-710b-4fca-9d1c-164e5a2a48aa tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:15:18.006352 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0f3cc9fe-710b-4fca-9d1c-164e5a2a48aa tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1511 microversion: 2.1 time: 0.409233 Jan 15 21:15:18.017852 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3222/6434] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:15:17 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1511 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:15:19.023824 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-0fef3b34-49e6-44e3-800b-1eca3da21bfe tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:15:19.024380 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-0fef3b34-49e6-44e3-800b-1eca3da21bfe tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:15:19.031165 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0fef3b34-49e6-44e3-800b-1eca3da21bfe tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:19.031564 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0fef3b34-49e6-44e3-800b-1eca3da21bfe tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:19.032343 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0fef3b34-49e6-44e3-800b-1eca3da21bfe tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:19.033488 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0fef3b34-49e6-44e3-800b-1eca3da21bfe tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:19.817219 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-0fef3b34-49e6-44e3-800b-1eca3da21bfe tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:15:19.824641 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-0fef3b34-49e6-44e3-800b-1eca3da21bfe tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1511 microversion: 2.1 time: 0.804616 Jan 15 21:15:19.825248 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3213/6435] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:15:19 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1511 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:15:20.117838 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1b8726a0-50e3-4218-a90a-ec8abd09d597 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:15:20.118432 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-1b8726a0-50e3-4218-a90a-ec8abd09d597 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: 315ce600-cbfd-4885-bc3d-5ab129d57681] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:15:20.125234 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-79ddd0af-95f0-49da-a064-582beb28fef2 req-9c5595c6-a5df-45ff-8ab6-6d4ec3bb8aad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "315ce600-cbfd-4885-bc3d-5ab129d57681", "tag": "5946fdbc-5c0f-444f-9903-f401907ec9ec"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:15:20.125728 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1b8726a0-50e3-4218-a90a-ec8abd09d597 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:20.125728 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1b8726a0-50e3-4218-a90a-ec8abd09d597 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:20.126792 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1b8726a0-50e3-4218-a90a-ec8abd09d597 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:20.127423 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1b8726a0-50e3-4218-a90a-ec8abd09d597 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:20.129077 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:15:20.129077 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:15:20.140566 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-79ddd0af-95f0-49da-a064-582beb28fef2 req-9c5595c6-a5df-45ff-8ab6-6d4ec3bb8aad service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:20.141409 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-79ddd0af-95f0-49da-a064-582beb28fef2 req-9c5595c6-a5df-45ff-8ab6-6d4ec3bb8aad service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:20.159533 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-79ddd0af-95f0-49da-a064-582beb28fef2 req-9c5595c6-a5df-45ff-8ab6-6d4ec3bb8aad service nova] Creating event network-changed:5946fdbc-5c0f-444f-9903-f401907ec9ec for instance 315ce600-cbfd-4885-bc3d-5ab129d57681 on nch2-master-1 Jan 15 21:15:20.165891 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-79ddd0af-95f0-49da-a064-582beb28fef2 req-9c5595c6-a5df-45ff-8ab6-6d4ec3bb8aad service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045263 Jan 15 21:15:20.166502 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3214/6436] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:15:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 21:15:20.553773 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-1b8726a0-50e3-4218-a90a-ec8abd09d597 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:15:20.562960 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-1b8726a0-50e3-4218-a90a-ec8abd09d597 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/315ce600-cbfd-4885-bc3d-5ab129d57681" status: 200 len: 1563 microversion: 2.1 time: 0.448709 Jan 15 21:15:20.564363 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3223/6437] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:15:20 2022] GET /compute/v2.1/servers/315ce600-cbfd-4885-bc3d-5ab129d57681 => generated 1563 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:15:20.842347 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f42370ef-a0ec-45ab-9e51-60e1f68f488f tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:15:20.843754 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f42370ef-a0ec-45ab-9e51-60e1f68f488f tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:15:20.850344 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f42370ef-a0ec-45ab-9e51-60e1f68f488f tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:20.851201 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f42370ef-a0ec-45ab-9e51-60e1f68f488f tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:20.852249 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f42370ef-a0ec-45ab-9e51-60e1f68f488f tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:20.853098 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f42370ef-a0ec-45ab-9e51-60e1f68f488f tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:21.193680 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-f42370ef-a0ec-45ab-9e51-60e1f68f488f tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:15:21.201800 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f42370ef-a0ec-45ab-9e51-60e1f68f488f tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1511 microversion: 2.1 time: 0.363497 Jan 15 21:15:21.205867 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3215/6438] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:15:20 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1511 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:15:22.219531 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-25d3caf3-b2f2-47cf-9211-47ef175d7604 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:15:22.222278 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-25d3caf3-b2f2-47cf-9211-47ef175d7604 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:15:22.229816 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-25d3caf3-b2f2-47cf-9211-47ef175d7604 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:22.230581 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-25d3caf3-b2f2-47cf-9211-47ef175d7604 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:22.231712 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-25d3caf3-b2f2-47cf-9211-47ef175d7604 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:22.232315 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-25d3caf3-b2f2-47cf-9211-47ef175d7604 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:22.413292 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-25d3caf3-b2f2-47cf-9211-47ef175d7604 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:15:22.422231 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-25d3caf3-b2f2-47cf-9211-47ef175d7604 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1511 microversion: 2.1 time: 0.206175 Jan 15 21:15:22.424147 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3224/6439] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:15:22 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1511 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:15:23.442520 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9c3013c5-06be-4cbd-a3e5-27b59f7ae311 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:15:23.443955 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-9c3013c5-06be-4cbd-a3e5-27b59f7ae311 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:15:23.452328 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9c3013c5-06be-4cbd-a3e5-27b59f7ae311 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:23.453929 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9c3013c5-06be-4cbd-a3e5-27b59f7ae311 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:23.456480 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9c3013c5-06be-4cbd-a3e5-27b59f7ae311 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:23.457195 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9c3013c5-06be-4cbd-a3e5-27b59f7ae311 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:23.673924 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-9c3013c5-06be-4cbd-a3e5-27b59f7ae311 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:15:23.683000 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-9c3013c5-06be-4cbd-a3e5-27b59f7ae311 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1511 microversion: 2.1 time: 0.246089 Jan 15 21:15:23.684441 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3216/6440] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:15:23 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1511 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:15:24.702005 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c6e8fc94-2728-44fd-8a46-2a9452e8fdcb tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:15:24.702794 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c6e8fc94-2728-44fd-8a46-2a9452e8fdcb tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:15:24.711747 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c6e8fc94-2728-44fd-8a46-2a9452e8fdcb tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:24.712546 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c6e8fc94-2728-44fd-8a46-2a9452e8fdcb tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:24.713742 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c6e8fc94-2728-44fd-8a46-2a9452e8fdcb tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:24.714379 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c6e8fc94-2728-44fd-8a46-2a9452e8fdcb tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:25.022255 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-c6e8fc94-2728-44fd-8a46-2a9452e8fdcb tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:15:25.031088 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c6e8fc94-2728-44fd-8a46-2a9452e8fdcb tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1511 microversion: 2.1 time: 0.331824 Jan 15 21:15:25.033894 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3225/6441] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:15:24 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1511 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:15:26.054218 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d50553e3-5f66-4aa4-9bf4-726099a7c6b6 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:15:26.054837 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d50553e3-5f66-4aa4-9bf4-726099a7c6b6 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:15:26.066565 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d50553e3-5f66-4aa4-9bf4-726099a7c6b6 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:26.067318 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d50553e3-5f66-4aa4-9bf4-726099a7c6b6 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:26.068456 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d50553e3-5f66-4aa4-9bf4-726099a7c6b6 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:26.068946 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d50553e3-5f66-4aa4-9bf4-726099a7c6b6 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:26.267798 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-d50553e3-5f66-4aa4-9bf4-726099a7c6b6 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:15:26.278132 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d50553e3-5f66-4aa4-9bf4-726099a7c6b6 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1511 microversion: 2.1 time: 0.231891 Jan 15 21:15:26.282072 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3217/6442] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:15:26 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1511 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:15:27.298829 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-21fae34a-26ab-4b1d-b9bf-25810a92ee85 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:15:27.299522 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-21fae34a-26ab-4b1d-b9bf-25810a92ee85 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:15:27.308102 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-21fae34a-26ab-4b1d-b9bf-25810a92ee85 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:27.308546 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-21fae34a-26ab-4b1d-b9bf-25810a92ee85 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:27.309365 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-21fae34a-26ab-4b1d-b9bf-25810a92ee85 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:27.309797 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-21fae34a-26ab-4b1d-b9bf-25810a92ee85 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:27.465838 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-21fae34a-26ab-4b1d-b9bf-25810a92ee85 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:15:27.475334 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-21fae34a-26ab-4b1d-b9bf-25810a92ee85 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1532 microversion: 2.1 time: 0.180824 Jan 15 21:15:27.476075 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3226/6443] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:15:27 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1532 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:15:28.493148 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d477d598-9b1f-4053-a3ac-beb62c33bbdf tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:15:28.494366 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d477d598-9b1f-4053-a3ac-beb62c33bbdf tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:15:28.504164 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d477d598-9b1f-4053-a3ac-beb62c33bbdf tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:28.504688 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d477d598-9b1f-4053-a3ac-beb62c33bbdf tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:28.505592 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d477d598-9b1f-4053-a3ac-beb62c33bbdf tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:28.506028 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d477d598-9b1f-4053-a3ac-beb62c33bbdf tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:28.648385 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-d477d598-9b1f-4053-a3ac-beb62c33bbdf tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:15:28.657683 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d477d598-9b1f-4053-a3ac-beb62c33bbdf tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1532 microversion: 2.1 time: 0.167680 Jan 15 21:15:28.658333 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3218/6444] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:15:28 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1532 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:15:29.674891 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-eb0c9675-263d-4c57-a3cc-a82a30604c28 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:15:29.676190 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-eb0c9675-263d-4c57-a3cc-a82a30604c28 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:15:29.696197 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-eb0c9675-263d-4c57-a3cc-a82a30604c28 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:29.696876 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-eb0c9675-263d-4c57-a3cc-a82a30604c28 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:29.697750 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-eb0c9675-263d-4c57-a3cc-a82a30604c28 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:29.698196 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-eb0c9675-263d-4c57-a3cc-a82a30604c28 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:29.953644 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-eb0c9675-263d-4c57-a3cc-a82a30604c28 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:15:29.964631 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-eb0c9675-263d-4c57-a3cc-a82a30604c28 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1527 microversion: 2.1 time: 0.293388 Jan 15 21:15:29.967433 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3227/6445] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:15:29 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1527 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:15:30.994544 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d25fb9f0-a985-4678-9f0c-85da018401b1 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:15:30.995181 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d25fb9f0-a985-4678-9f0c-85da018401b1 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:15:31.017414 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d25fb9f0-a985-4678-9f0c-85da018401b1 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:31.018188 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d25fb9f0-a985-4678-9f0c-85da018401b1 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:31.019553 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d25fb9f0-a985-4678-9f0c-85da018401b1 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:31.021357 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d25fb9f0-a985-4678-9f0c-85da018401b1 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:31.372814 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-d25fb9f0-a985-4678-9f0c-85da018401b1 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:15:31.384540 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d25fb9f0-a985-4678-9f0c-85da018401b1 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1527 microversion: 2.1 time: 0.402084 Jan 15 21:15:31.385446 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3219/6446] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:15:30 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1527 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:15:32.400992 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-96809e07-40a2-48bd-9acf-f31617293621 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:15:32.401641 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-96809e07-40a2-48bd-9acf-f31617293621 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:15:32.417558 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-96809e07-40a2-48bd-9acf-f31617293621 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:32.418016 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-96809e07-40a2-48bd-9acf-f31617293621 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:32.418807 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-96809e07-40a2-48bd-9acf-f31617293621 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:32.419533 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-96809e07-40a2-48bd-9acf-f31617293621 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:32.552240 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-d93924a5-a2d2-467a-9bb6-2968bdc2a4af req-0b228fd0-9014-4829-81c0-844e04db1eb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b10c8309-687a-4474-8f64-9956816741db", "name": "network-vif-plugged", "status": "completed", "tag": "bdd3b358-3871-4d07-a30c-af2f31f8d4cf"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:15:32.554716 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:15:32.554716 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:15:32.568609 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-d93924a5-a2d2-467a-9bb6-2968bdc2a4af req-0b228fd0-9014-4829-81c0-844e04db1eb2 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:32.574814 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-d93924a5-a2d2-467a-9bb6-2968bdc2a4af req-0b228fd0-9014-4829-81c0-844e04db1eb2 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:32.605066 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-d93924a5-a2d2-467a-9bb6-2968bdc2a4af req-0b228fd0-9014-4829-81c0-844e04db1eb2 service nova] Creating event network-vif-plugged:bdd3b358-3871-4d07-a30c-af2f31f8d4cf for instance b10c8309-687a-4474-8f64-9956816741db on nch2-master-1 Jan 15 21:15:32.619167 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-d93924a5-a2d2-467a-9bb6-2968bdc2a4af req-0b228fd0-9014-4829-81c0-844e04db1eb2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073301 Jan 15 21:15:32.619790 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3220/6447] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:15:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:15:32.829417 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-96809e07-40a2-48bd-9acf-f31617293621 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:15:32.843703 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-96809e07-40a2-48bd-9acf-f31617293621 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1527 microversion: 2.1 time: 0.446308 Jan 15 21:15:32.849513 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3228/6448] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:15:32 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1527 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:15:33.865737 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-824a8cfb-77a6-48c5-b3d7-05896b40e519 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:15:33.866584 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-824a8cfb-77a6-48c5-b3d7-05896b40e519 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:15:33.881448 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-824a8cfb-77a6-48c5-b3d7-05896b40e519 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:33.890373 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-824a8cfb-77a6-48c5-b3d7-05896b40e519 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:33.892002 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-824a8cfb-77a6-48c5-b3d7-05896b40e519 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:33.893653 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-824a8cfb-77a6-48c5-b3d7-05896b40e519 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:34.485091 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-824a8cfb-77a6-48c5-b3d7-05896b40e519 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:15:34.494025 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-824a8cfb-77a6-48c5-b3d7-05896b40e519 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1527 microversion: 2.1 time: 0.632783 Jan 15 21:15:34.501147 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3221/6449] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:15:33 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1527 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:15:35.517337 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-273a3b6a-3918-4088-b03f-7a0a24ce7bc8 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:15:35.517945 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-273a3b6a-3918-4088-b03f-7a0a24ce7bc8 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:15:35.529247 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-273a3b6a-3918-4088-b03f-7a0a24ce7bc8 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:35.529688 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-273a3b6a-3918-4088-b03f-7a0a24ce7bc8 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:35.543063 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-273a3b6a-3918-4088-b03f-7a0a24ce7bc8 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:35.545714 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-273a3b6a-3918-4088-b03f-7a0a24ce7bc8 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:35.807030 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-273a3b6a-3918-4088-b03f-7a0a24ce7bc8 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:15:35.827133 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-273a3b6a-3918-4088-b03f-7a0a24ce7bc8 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1527 microversion: 2.1 time: 0.315188 Jan 15 21:15:35.839246 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3229/6450] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:15:35 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1527 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:15:36.847133 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-cfa5eb38-2528-4208-a16d-2687246eb429 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:15:36.848231 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-cfa5eb38-2528-4208-a16d-2687246eb429 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:15:36.862453 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cfa5eb38-2528-4208-a16d-2687246eb429 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:36.862949 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cfa5eb38-2528-4208-a16d-2687246eb429 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:36.863984 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cfa5eb38-2528-4208-a16d-2687246eb429 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:36.864608 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cfa5eb38-2528-4208-a16d-2687246eb429 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:37.025311 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a48c35de-6ba4-4370-a089-1e3e6b23e14f tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:15:37.026002 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a48c35de-6ba4-4370-a089-1e3e6b23e14f tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] [instance: d5d3c9af-fa53-4de5-a559-6d2cd4857a38] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:15:37.042753 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a48c35de-6ba4-4370-a089-1e3e6b23e14f tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:37.053426 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a48c35de-6ba4-4370-a089-1e3e6b23e14f tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:37.054433 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a48c35de-6ba4-4370-a089-1e3e6b23e14f tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:37.054888 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a48c35de-6ba4-4370-a089-1e3e6b23e14f tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:37.077175 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-cfa5eb38-2528-4208-a16d-2687246eb429 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:15:37.089065 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-cfa5eb38-2528-4208-a16d-2687246eb429 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1527 microversion: 2.1 time: 0.247795 Jan 15 21:15:37.090389 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3222/6451] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:15:36 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1527 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:15:37.129242 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a48c35de-6ba4-4370-a089-1e3e6b23e14f tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] [instance: d5d3c9af-fa53-4de5-a559-6d2cd4857a38] Going to try to terminate instance {{(pid=129366) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 21:15:37.323668 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a48c35de-6ba4-4370-a089-1e3e6b23e14f tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] 10.222.0.46 "DELETE /compute/v2.1/servers/d5d3c9af-fa53-4de5-a559-6d2cd4857a38" status: 204 len: 0 microversion: 2.1 time: 0.303156 Jan 15 21:15:37.324988 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3230/6452] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 21:15:37 2022] DELETE /compute/v2.1/servers/d5d3c9af-fa53-4de5-a559-6d2cd4857a38 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 21:15:37.333917 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ea88b823-5a08-44b7-bc50-dcf43c24995b tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:15:37.334996 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ea88b823-5a08-44b7-bc50-dcf43c24995b tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] [instance: d5d3c9af-fa53-4de5-a559-6d2cd4857a38] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:15:37.347347 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ea88b823-5a08-44b7-bc50-dcf43c24995b tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:37.347809 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ea88b823-5a08-44b7-bc50-dcf43c24995b tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:37.348616 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ea88b823-5a08-44b7-bc50-dcf43c24995b tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:37.349073 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ea88b823-5a08-44b7-bc50-dcf43c24995b tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:37.646576 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-ea88b823-5a08-44b7-bc50-dcf43c24995b tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0d769340dc4d36b83436c7fc78bbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de60cd8289224f1f81ef0db9ec3c6f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:15:37.655456 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ea88b823-5a08-44b7-bc50-dcf43c24995b tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] 10.222.0.46 "GET /compute/v2.1/servers/d5d3c9af-fa53-4de5-a559-6d2cd4857a38" status: 200 len: 1553 microversion: 2.1 time: 0.326087 Jan 15 21:15:37.669027 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3223/6453] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:15:37 2022] GET /compute/v2.1/servers/d5d3c9af-fa53-4de5-a559-6d2cd4857a38 => generated 1553 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:15:38.106599 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-483dfcb5-930b-4a58-8f3f-fdeddc8d7fa0 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:15:38.107298 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-483dfcb5-930b-4a58-8f3f-fdeddc8d7fa0 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:15:38.123561 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-483dfcb5-930b-4a58-8f3f-fdeddc8d7fa0 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:38.124238 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-483dfcb5-930b-4a58-8f3f-fdeddc8d7fa0 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:38.125543 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-483dfcb5-930b-4a58-8f3f-fdeddc8d7fa0 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:38.126162 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-483dfcb5-930b-4a58-8f3f-fdeddc8d7fa0 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:38.419033 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-483dfcb5-930b-4a58-8f3f-fdeddc8d7fa0 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:15:38.440449 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-483dfcb5-930b-4a58-8f3f-fdeddc8d7fa0 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1527 microversion: 2.1 time: 0.334651 Jan 15 21:15:38.442374 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3231/6454] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:15:38 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1527 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:15:38.682130 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-869c4ef8-6da5-4a8b-aa6d-58c3eefc12b7 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:15:38.683345 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-869c4ef8-6da5-4a8b-aa6d-58c3eefc12b7 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] [instance: d5d3c9af-fa53-4de5-a559-6d2cd4857a38] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:15:38.695105 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-869c4ef8-6da5-4a8b-aa6d-58c3eefc12b7 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:38.695787 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-869c4ef8-6da5-4a8b-aa6d-58c3eefc12b7 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:38.697399 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-869c4ef8-6da5-4a8b-aa6d-58c3eefc12b7 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:38.698131 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-869c4ef8-6da5-4a8b-aa6d-58c3eefc12b7 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:39.283373 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-869c4ef8-6da5-4a8b-aa6d-58c3eefc12b7 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0d769340dc4d36b83436c7fc78bbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de60cd8289224f1f81ef0db9ec3c6f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:15:39.296945 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-869c4ef8-6da5-4a8b-aa6d-58c3eefc12b7 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] 10.222.0.46 "GET /compute/v2.1/servers/d5d3c9af-fa53-4de5-a559-6d2cd4857a38" status: 200 len: 1553 microversion: 2.1 time: 0.625331 Jan 15 21:15:39.298031 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3224/6455] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:15:38 2022] GET /compute/v2.1/servers/d5d3c9af-fa53-4de5-a559-6d2cd4857a38 => generated 1553 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:15:39.459525 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c2c09b7d-54ba-49cd-8465-96e79ee4e0ec tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:15:39.460129 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c2c09b7d-54ba-49cd-8465-96e79ee4e0ec tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:15:39.494538 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c2c09b7d-54ba-49cd-8465-96e79ee4e0ec tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:39.494694 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c2c09b7d-54ba-49cd-8465-96e79ee4e0ec tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:39.495457 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c2c09b7d-54ba-49cd-8465-96e79ee4e0ec tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:39.495885 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c2c09b7d-54ba-49cd-8465-96e79ee4e0ec tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:39.891785 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-c2c09b7d-54ba-49cd-8465-96e79ee4e0ec tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:15:39.901407 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c2c09b7d-54ba-49cd-8465-96e79ee4e0ec tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1527 microversion: 2.1 time: 0.446519 Jan 15 21:15:39.902557 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3232/6456] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:15:39 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1527 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:15:39.942414 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-525dc69d-dc81-445b-aebe-3cc41a4e9d70 req-4df05942-cb00-47f7-89fc-fabf5ef23c31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5d3c9af-fa53-4de5-a559-6d2cd4857a38", "name": "network-vif-deleted", "tag": "a324cd95-18a9-4be1-9b39-644e1887801c"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:15:39.944821 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:15:39.944821 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:15:39.972727 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-525dc69d-dc81-445b-aebe-3cc41a4e9d70 req-4df05942-cb00-47f7-89fc-fabf5ef23c31 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:39.973526 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-525dc69d-dc81-445b-aebe-3cc41a4e9d70 req-4df05942-cb00-47f7-89fc-fabf5ef23c31 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:39.994847 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-525dc69d-dc81-445b-aebe-3cc41a4e9d70 req-4df05942-cb00-47f7-89fc-fabf5ef23c31 service nova] Creating event network-vif-deleted:a324cd95-18a9-4be1-9b39-644e1887801c for instance d5d3c9af-fa53-4de5-a559-6d2cd4857a38 on nch1-master-1 Jan 15 21:15:40.012272 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-525dc69d-dc81-445b-aebe-3cc41a4e9d70 req-4df05942-cb00-47f7-89fc-fabf5ef23c31 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078848 Jan 15 21:15:40.012921 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3225/6457] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:15:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:15:40.314597 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0b9e57b6-d934-42eb-bb9c-b00e0892cf7e tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:15:40.315203 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-0b9e57b6-d934-42eb-bb9c-b00e0892cf7e tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] [instance: d5d3c9af-fa53-4de5-a559-6d2cd4857a38] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:15:40.330477 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0b9e57b6-d934-42eb-bb9c-b00e0892cf7e tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:40.331204 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0b9e57b6-d934-42eb-bb9c-b00e0892cf7e tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:40.332191 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0b9e57b6-d934-42eb-bb9c-b00e0892cf7e tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:40.332793 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0b9e57b6-d934-42eb-bb9c-b00e0892cf7e tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:40.417605 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0b9e57b6-d934-42eb-bb9c-b00e0892cf7e tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:40.418305 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0b9e57b6-d934-42eb-bb9c-b00e0892cf7e tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:40.418955 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.objects.instance [None req-0b9e57b6-d934-42eb-bb9c-b00e0892cf7e tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lazy-loading 'fault' on Instance uuid d5d3c9af-fa53-4de5-a559-6d2cd4857a38 {{(pid=129366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 21:15:40.520740 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-0b9e57b6-d934-42eb-bb9c-b00e0892cf7e tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0d769340dc4d36b83436c7fc78bbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de60cd8289224f1f81ef0db9ec3c6f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:15:40.533855 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0b9e57b6-d934-42eb-bb9c-b00e0892cf7e tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] 10.222.0.46 "GET /compute/v2.1/servers/d5d3c9af-fa53-4de5-a559-6d2cd4857a38" status: 200 len: 1338 microversion: 2.1 time: 0.222277 Jan 15 21:15:40.535069 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3233/6458] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:15:40 2022] GET /compute/v2.1/servers/d5d3c9af-fa53-4de5-a559-6d2cd4857a38 => generated 1338 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:15:40.922643 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ed2ffa8b-449f-4b4d-99c1-0e6ba24265a0 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:15:40.923760 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ed2ffa8b-449f-4b4d-99c1-0e6ba24265a0 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:15:40.930959 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ed2ffa8b-449f-4b4d-99c1-0e6ba24265a0 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:40.932062 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ed2ffa8b-449f-4b4d-99c1-0e6ba24265a0 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:40.933137 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ed2ffa8b-449f-4b4d-99c1-0e6ba24265a0 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:40.933760 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ed2ffa8b-449f-4b4d-99c1-0e6ba24265a0 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:41.291069 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-ed2ffa8b-449f-4b4d-99c1-0e6ba24265a0 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:15:41.303701 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ed2ffa8b-449f-4b4d-99c1-0e6ba24265a0 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1527 microversion: 2.1 time: 0.387547 Jan 15 21:15:41.305062 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3226/6459] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:15:40 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1527 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:15:41.554552 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4036b126-9876-4da7-ac1b-15cf46be910b tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:15:41.555545 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-4036b126-9876-4da7-ac1b-15cf46be910b tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] [instance: d5d3c9af-fa53-4de5-a559-6d2cd4857a38] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:15:41.574828 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4036b126-9876-4da7-ac1b-15cf46be910b tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:41.575422 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4036b126-9876-4da7-ac1b-15cf46be910b tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:41.576338 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4036b126-9876-4da7-ac1b-15cf46be910b tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:41.577297 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4036b126-9876-4da7-ac1b-15cf46be910b tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:41.592293 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-4036b126-9876-4da7-ac1b-15cf46be910b tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] HTTP exception thrown: Instance d5d3c9af-fa53-4de5-a559-6d2cd4857a38 could not be found. Jan 15 21:15:41.593086 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4036b126-9876-4da7-ac1b-15cf46be910b tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Returning 404 to user: Instance d5d3c9af-fa53-4de5-a559-6d2cd4857a38 could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:15:41.594622 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-4036b126-9876-4da7-ac1b-15cf46be910b tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] 10.222.0.46 "GET /compute/v2.1/servers/d5d3c9af-fa53-4de5-a559-6d2cd4857a38" status: 404 len: 111 microversion: 2.1 time: 0.045939 Jan 15 21:15:41.595288 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3234/6460] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:15:41 2022] GET /compute/v2.1/servers/d5d3c9af-fa53-4de5-a559-6d2cd4857a38 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:15:41.845017 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f152cf0c-3021-423c-822b-09ad1372662e tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Calling method '.version_select at 0x7f30c8421d30>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:15:41.881777 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f152cf0c-3021-423c-822b-09ad1372662e tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-514936718" status: 202 len: 0 microversion: 2.1 time: 0.040845 Jan 15 21:15:41.882378 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3227/6461] 10.222.0.46 () {58 vars in 1253 bytes} [Sat Jan 15 21:15:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-514936718 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:15:42.190222 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-392453d0-3489-49b6-a23d-ffc70a0fcf96 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:15:42.192446 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-392453d0-3489-49b6-a23d-ffc70a0fcf96 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: 315ce600-cbfd-4885-bc3d-5ab129d57681] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:15:42.204587 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-392453d0-3489-49b6-a23d-ffc70a0fcf96 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:42.205463 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-392453d0-3489-49b6-a23d-ffc70a0fcf96 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:42.206817 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-392453d0-3489-49b6-a23d-ffc70a0fcf96 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:42.207535 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-392453d0-3489-49b6-a23d-ffc70a0fcf96 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:42.281643 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-392453d0-3489-49b6-a23d-ffc70a0fcf96 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "POST /compute/v2.1/servers/315ce600-cbfd-4885-bc3d-5ab129d57681/action" status: 200 len: 24563 microversion: 2.1 time: 0.096588 Jan 15 21:15:42.282326 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3235/6462] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:15:42 2022] POST /compute/v2.1/servers/315ce600-cbfd-4885-bc3d-5ab129d57681/action => generated 24563 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:15:42.324546 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-36308b4c-69a2-40e9-b989-52794d2dc3fb tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:15:42.325313 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-36308b4c-69a2-40e9-b989-52794d2dc3fb tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:15:42.367286 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-36308b4c-69a2-40e9-b989-52794d2dc3fb tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:42.373310 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-36308b4c-69a2-40e9-b989-52794d2dc3fb tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:42.375260 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-36308b4c-69a2-40e9-b989-52794d2dc3fb tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:42.375951 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-36308b4c-69a2-40e9-b989-52794d2dc3fb tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:42.803833 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-36308b4c-69a2-40e9-b989-52794d2dc3fb tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:15:42.811878 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-36308b4c-69a2-40e9-b989-52794d2dc3fb tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1527 microversion: 2.1 time: 0.493858 Jan 15 21:15:42.816032 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3228/6463] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:15:42 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1527 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:15:43.834903 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a82fbe88-42ca-4bb1-a197-53528594be0c tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:15:43.836020 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a82fbe88-42ca-4bb1-a197-53528594be0c tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:15:43.880977 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a82fbe88-42ca-4bb1-a197-53528594be0c tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:43.884195 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a82fbe88-42ca-4bb1-a197-53528594be0c tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:43.885254 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a82fbe88-42ca-4bb1-a197-53528594be0c tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:43.887359 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a82fbe88-42ca-4bb1-a197-53528594be0c tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:44.492155 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-a82fbe88-42ca-4bb1-a197-53528594be0c tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:15:44.502119 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a82fbe88-42ca-4bb1-a197-53528594be0c tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1527 microversion: 2.1 time: 0.672526 Jan 15 21:15:44.523474 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3236/6464] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:15:43 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1527 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:15:45.307661 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-43012e3e-1291-4eb6-aeb9-3a7c8a7a5c99 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:15:45.308156 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-43012e3e-1291-4eb6-aeb9-3a7c8a7a5c99 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] [instance: 7ebb1b58-541d-4104-b003-8e0b91c1634f] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:15:45.314243 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-4c2eac36-6eb9-4d3f-8997-e1b65612bdc1 req-09ecac33-92f1-4934-a3cc-5f79804a006f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ebb1b58-541d-4104-b003-8e0b91c1634f", "tag": "909658a8-c02e-4ffe-95b9-0a5acbcbdac7"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:15:45.316945 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:15:45.316945 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:15:45.327852 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-43012e3e-1291-4eb6-aeb9-3a7c8a7a5c99 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:45.331712 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-43012e3e-1291-4eb6-aeb9-3a7c8a7a5c99 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:45.332862 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-43012e3e-1291-4eb6-aeb9-3a7c8a7a5c99 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:45.333540 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-43012e3e-1291-4eb6-aeb9-3a7c8a7a5c99 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:45.337355 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-4c2eac36-6eb9-4d3f-8997-e1b65612bdc1 req-09ecac33-92f1-4934-a3cc-5f79804a006f service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:45.339248 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-4c2eac36-6eb9-4d3f-8997-e1b65612bdc1 req-09ecac33-92f1-4934-a3cc-5f79804a006f service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:45.373053 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-4c2eac36-6eb9-4d3f-8997-e1b65612bdc1 req-09ecac33-92f1-4934-a3cc-5f79804a006f service nova] Creating event network-changed:909658a8-c02e-4ffe-95b9-0a5acbcbdac7 for instance 7ebb1b58-541d-4104-b003-8e0b91c1634f on nch1-master-1 Jan 15 21:15:45.390473 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-4c2eac36-6eb9-4d3f-8997-e1b65612bdc1 req-09ecac33-92f1-4934-a3cc-5f79804a006f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079655 Jan 15 21:15:45.396222 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3237/6465] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:15:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:15:45.401959 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-43012e3e-1291-4eb6-aeb9-3a7c8a7a5c99 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] [instance: 7ebb1b58-541d-4104-b003-8e0b91c1634f] Going to try to terminate instance {{(pid=129365) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 21:15:45.531580 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7843fcac-885e-471e-8e82-f8da0f2909c5 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:15:45.533371 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-7843fcac-885e-471e-8e82-f8da0f2909c5 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:15:45.554832 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7843fcac-885e-471e-8e82-f8da0f2909c5 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:45.556812 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7843fcac-885e-471e-8e82-f8da0f2909c5 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:45.562091 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7843fcac-885e-471e-8e82-f8da0f2909c5 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:45.568073 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7843fcac-885e-471e-8e82-f8da0f2909c5 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:45.628579 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-43012e3e-1291-4eb6-aeb9-3a7c8a7a5c99 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] 10.222.0.46 "DELETE /compute/v2.1/servers/7ebb1b58-541d-4104-b003-8e0b91c1634f" status: 204 len: 0 microversion: 2.1 time: 0.324252 Jan 15 21:15:45.635459 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3229/6466] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 21:15:45 2022] DELETE /compute/v2.1/servers/7ebb1b58-541d-4104-b003-8e0b91c1634f => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 21:15:45.648180 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ff959410-e61f-4a68-b8ec-a3355c1f5f50 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:15:45.652823 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ff959410-e61f-4a68-b8ec-a3355c1f5f50 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] [instance: 7ebb1b58-541d-4104-b003-8e0b91c1634f] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:15:45.667261 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ff959410-e61f-4a68-b8ec-a3355c1f5f50 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:45.668132 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ff959410-e61f-4a68-b8ec-a3355c1f5f50 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:45.669237 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ff959410-e61f-4a68-b8ec-a3355c1f5f50 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:45.669920 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ff959410-e61f-4a68-b8ec-a3355c1f5f50 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:46.269669 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-7843fcac-885e-471e-8e82-f8da0f2909c5 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:15:46.288579 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7843fcac-885e-471e-8e82-f8da0f2909c5 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1527 microversion: 2.1 time: 0.759246 Jan 15 21:15:46.290812 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-ff959410-e61f-4a68-b8ec-a3355c1f5f50 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0d769340dc4d36b83436c7fc78bbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de60cd8289224f1f81ef0db9ec3c6f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:15:46.301224 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3238/6467] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:15:45 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1527 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:15:46.307868 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ff959410-e61f-4a68-b8ec-a3355c1f5f50 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] 10.222.0.46 "GET /compute/v2.1/servers/7ebb1b58-541d-4104-b003-8e0b91c1634f" status: 200 len: 1670 microversion: 2.1 time: 0.667774 Jan 15 21:15:46.315891 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3230/6468] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:15:45 2022] GET /compute/v2.1/servers/7ebb1b58-541d-4104-b003-8e0b91c1634f => generated 1670 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:15:47.310629 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-2696a84d-52cb-4890-bd14-bba70a8835a0 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:15:47.311914 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-2696a84d-52cb-4890-bd14-bba70a8835a0 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:15:47.326817 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3bb504e0-6d84-4389-a429-609da88e256c tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:15:47.327706 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-3bb504e0-6d84-4389-a429-609da88e256c tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] [instance: 7ebb1b58-541d-4104-b003-8e0b91c1634f] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:15:47.335293 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2696a84d-52cb-4890-bd14-bba70a8835a0 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:47.337608 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2696a84d-52cb-4890-bd14-bba70a8835a0 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:47.341252 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2696a84d-52cb-4890-bd14-bba70a8835a0 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:47.342282 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2696a84d-52cb-4890-bd14-bba70a8835a0 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:47.351037 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3bb504e0-6d84-4389-a429-609da88e256c tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:47.351504 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3bb504e0-6d84-4389-a429-609da88e256c tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:47.354975 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3bb504e0-6d84-4389-a429-609da88e256c tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:47.355424 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3bb504e0-6d84-4389-a429-609da88e256c tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:48.465419 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-2696a84d-52cb-4890-bd14-bba70a8835a0 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:15:48.480359 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-2696a84d-52cb-4890-bd14-bba70a8835a0 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1527 microversion: 2.1 time: 1.173593 Jan 15 21:15:48.495165 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3239/6469] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:15:47 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1527 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:15:48.505241 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-f2c1b6c1-0473-468c-bda3-38233555f817 req-fb2dee59-f88f-431c-b5f4-0d7292219022 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ebb1b58-541d-4104-b003-8e0b91c1634f", "name": "network-vif-deleted", "tag": "909658a8-c02e-4ffe-95b9-0a5acbcbdac7"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:15:48.507944 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:15:48.507944 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:15:48.516150 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-3bb504e0-6d84-4389-a429-609da88e256c tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0d769340dc4d36b83436c7fc78bbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de60cd8289224f1f81ef0db9ec3c6f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:15:48.521823 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-f2c1b6c1-0473-468c-bda3-38233555f817 req-fb2dee59-f88f-431c-b5f4-0d7292219022 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:48.522584 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-f2c1b6c1-0473-468c-bda3-38233555f817 req-fb2dee59-f88f-431c-b5f4-0d7292219022 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:48.536555 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-f2c1b6c1-0473-468c-bda3-38233555f817 req-fb2dee59-f88f-431c-b5f4-0d7292219022 service nova] Creating event network-vif-deleted:909658a8-c02e-4ffe-95b9-0a5acbcbdac7 for instance 7ebb1b58-541d-4104-b003-8e0b91c1634f on nch1-master-1 Jan 15 21:15:48.536822 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3bb504e0-6d84-4389-a429-609da88e256c tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] 10.222.0.46 "GET /compute/v2.1/servers/7ebb1b58-541d-4104-b003-8e0b91c1634f" status: 200 len: 1552 microversion: 2.1 time: 1.213996 Jan 15 21:15:48.538464 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3231/6470] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:15:47 2022] GET /compute/v2.1/servers/7ebb1b58-541d-4104-b003-8e0b91c1634f => generated 1552 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:15:48.555767 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-f2c1b6c1-0473-468c-bda3-38233555f817 req-fb2dee59-f88f-431c-b5f4-0d7292219022 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055398 Jan 15 21:15:48.557944 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3240/6471] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:15:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:15:49.503119 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-120ce397-92c6-4a2b-ac4a-3ee187100ee6 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:15:49.503738 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-120ce397-92c6-4a2b-ac4a-3ee187100ee6 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:15:49.513531 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-120ce397-92c6-4a2b-ac4a-3ee187100ee6 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:49.513531 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-120ce397-92c6-4a2b-ac4a-3ee187100ee6 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:49.514328 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-120ce397-92c6-4a2b-ac4a-3ee187100ee6 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:49.514769 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-120ce397-92c6-4a2b-ac4a-3ee187100ee6 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:49.567519 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7b7072d4-22bf-4e54-a6e8-09988d303445 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:15:49.569073 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-7b7072d4-22bf-4e54-a6e8-09988d303445 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] [instance: 7ebb1b58-541d-4104-b003-8e0b91c1634f] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:15:49.577212 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7b7072d4-22bf-4e54-a6e8-09988d303445 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:49.577938 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7b7072d4-22bf-4e54-a6e8-09988d303445 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:49.579056 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7b7072d4-22bf-4e54-a6e8-09988d303445 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:49.579663 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7b7072d4-22bf-4e54-a6e8-09988d303445 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:49.595859 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-7b7072d4-22bf-4e54-a6e8-09988d303445 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] HTTP exception thrown: Instance 7ebb1b58-541d-4104-b003-8e0b91c1634f could not be found. Jan 15 21:15:49.596551 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7b7072d4-22bf-4e54-a6e8-09988d303445 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Returning 404 to user: Instance 7ebb1b58-541d-4104-b003-8e0b91c1634f could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:15:49.597633 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7b7072d4-22bf-4e54-a6e8-09988d303445 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] 10.222.0.46 "GET /compute/v2.1/servers/7ebb1b58-541d-4104-b003-8e0b91c1634f" status: 404 len: 111 microversion: 2.1 time: 0.037825 Jan 15 21:15:49.602514 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3241/6472] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:15:49 2022] GET /compute/v2.1/servers/7ebb1b58-541d-4104-b003-8e0b91c1634f => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 15 21:15:49.815883 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-120ce397-92c6-4a2b-ac4a-3ee187100ee6 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:15:49.832005 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-120ce397-92c6-4a2b-ac4a-3ee187100ee6 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1527 microversion: 2.1 time: 0.333104 Jan 15 21:15:49.833498 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3232/6473] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:15:49 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1527 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:15:49.952597 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4b4e475c-315a-4f87-bfd5-5acaa9669f6a tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Calling method '.version_select at 0x7f30ced034c0>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:15:49.984019 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-4b4e475c-315a-4f87-bfd5-5acaa9669f6a tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1902473020" status: 202 len: 0 microversion: 2.1 time: 0.036068 Jan 15 21:15:49.985424 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3242/6474] 10.222.0.46 () {58 vars in 1256 bytes} [Sat Jan 15 21:15:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1902473020 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:15:50.864060 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9f44ca58-f129-40fa-9f7f-c8fe0f523832 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:15:50.865381 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-9f44ca58-f129-40fa-9f7f-c8fe0f523832 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:15:50.876430 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9f44ca58-f129-40fa-9f7f-c8fe0f523832 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:50.877038 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9f44ca58-f129-40fa-9f7f-c8fe0f523832 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:50.883550 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9f44ca58-f129-40fa-9f7f-c8fe0f523832 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:50.884989 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9f44ca58-f129-40fa-9f7f-c8fe0f523832 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:51.344898 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-9f44ca58-f129-40fa-9f7f-c8fe0f523832 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:15:51.353767 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-9f44ca58-f129-40fa-9f7f-c8fe0f523832 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1509 microversion: 2.1 time: 0.494834 Jan 15 21:15:51.355071 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3233/6475] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:15:50 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1509 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:15:52.373132 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-95c260f7-f531-4b63-b72b-d02aaa0827df tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:15:52.375289 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-95c260f7-f531-4b63-b72b-d02aaa0827df tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:15:52.386748 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-95c260f7-f531-4b63-b72b-d02aaa0827df tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:52.387988 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-95c260f7-f531-4b63-b72b-d02aaa0827df tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:52.389400 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-95c260f7-f531-4b63-b72b-d02aaa0827df tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:52.389999 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-95c260f7-f531-4b63-b72b-d02aaa0827df tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:53.069941 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-95c260f7-f531-4b63-b72b-d02aaa0827df tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:15:53.089757 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-95c260f7-f531-4b63-b72b-d02aaa0827df tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1509 microversion: 2.1 time: 0.721710 Jan 15 21:15:53.090381 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3243/6476] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:15:52 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1509 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:15:53.417903 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-83493ba0-9880-4ba9-945f-471bb8138bc0 tempest-TestNetworkAdvancedServerOps-958360157 tempest-TestNetworkAdvancedServerOps-958360157-project-admin] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:15:53.419111 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-83493ba0-9880-4ba9-945f-471bb8138bc0 tempest-TestNetworkAdvancedServerOps-958360157 tempest-TestNetworkAdvancedServerOps-958360157-project-admin] [instance: 315ce600-cbfd-4885-bc3d-5ab129d57681] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:15:53.433921 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-83493ba0-9880-4ba9-945f-471bb8138bc0 tempest-TestNetworkAdvancedServerOps-958360157 tempest-TestNetworkAdvancedServerOps-958360157-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:53.438724 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-83493ba0-9880-4ba9-945f-471bb8138bc0 tempest-TestNetworkAdvancedServerOps-958360157 tempest-TestNetworkAdvancedServerOps-958360157-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:53.439754 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-83493ba0-9880-4ba9-945f-471bb8138bc0 tempest-TestNetworkAdvancedServerOps-958360157 tempest-TestNetworkAdvancedServerOps-958360157-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:53.441229 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-83493ba0-9880-4ba9-945f-471bb8138bc0 tempest-TestNetworkAdvancedServerOps-958360157 tempest-TestNetworkAdvancedServerOps-958360157-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:53.762649 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-83493ba0-9880-4ba9-945f-471bb8138bc0 tempest-TestNetworkAdvancedServerOps-958360157 tempest-TestNetworkAdvancedServerOps-958360157-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/315ce600-cbfd-4885-bc3d-5ab129d57681" status: 200 len: 1832 microversion: 2.1 time: 0.348150 Jan 15 21:15:53.763889 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3234/6477] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:15:53 2022] GET /compute/v2.1/servers/315ce600-cbfd-4885-bc3d-5ab129d57681 => generated 1832 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:15:53.786508 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-167b8cf1-fee7-45fe-b3dd-e2b734270efd tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:15:53.788246 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-167b8cf1-fee7-45fe-b3dd-e2b734270efd tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: 315ce600-cbfd-4885-bc3d-5ab129d57681] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:15:53.796467 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-167b8cf1-fee7-45fe-b3dd-e2b734270efd tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:53.797861 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-167b8cf1-fee7-45fe-b3dd-e2b734270efd tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:53.798889 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-167b8cf1-fee7-45fe-b3dd-e2b734270efd tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:53.799567 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-167b8cf1-fee7-45fe-b3dd-e2b734270efd tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:54.108833 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5f03511f-3e7c-4343-ab3f-95239b4e1f8a tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:15:54.110663 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-5f03511f-3e7c-4343-ab3f-95239b4e1f8a tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:15:54.120614 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5f03511f-3e7c-4343-ab3f-95239b4e1f8a tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:54.121110 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5f03511f-3e7c-4343-ab3f-95239b4e1f8a tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:54.121918 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5f03511f-3e7c-4343-ab3f-95239b4e1f8a tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:54.122348 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5f03511f-3e7c-4343-ab3f-95239b4e1f8a tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:54.358544 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-167b8cf1-fee7-45fe-b3dd-e2b734270efd tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:15:54.370233 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-167b8cf1-fee7-45fe-b3dd-e2b734270efd tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/315ce600-cbfd-4885-bc3d-5ab129d57681" status: 200 len: 1681 microversion: 2.1 time: 0.587482 Jan 15 21:15:54.371977 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3244/6478] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:15:53 2022] GET /compute/v2.1/servers/315ce600-cbfd-4885-bc3d-5ab129d57681 => generated 1681 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:15:54.532739 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1757c1bb-9f82-4495-ba61-0343702d8b71 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:15:54.533726 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-1757c1bb-9f82-4495-ba61-0343702d8b71 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: 315ce600-cbfd-4885-bc3d-5ab129d57681] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:15:54.548651 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1757c1bb-9f82-4495-ba61-0343702d8b71 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:54.549172 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1757c1bb-9f82-4495-ba61-0343702d8b71 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:54.551304 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1757c1bb-9f82-4495-ba61-0343702d8b71 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:54.552889 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1757c1bb-9f82-4495-ba61-0343702d8b71 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:54.578845 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-5f03511f-3e7c-4343-ab3f-95239b4e1f8a tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:15:54.590770 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5f03511f-3e7c-4343-ab3f-95239b4e1f8a tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1452 microversion: 2.1 time: 0.482572 Jan 15 21:15:54.591773 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3235/6479] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:15:54 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1452 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:15:54.609685 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b54d3131-6a62-423a-aa78-0e5a7f24eb7e tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:15:54.610820 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b54d3131-6a62-423a-aa78-0e5a7f24eb7e tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:15:54.619199 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b54d3131-6a62-423a-aa78-0e5a7f24eb7e tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:54.619651 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b54d3131-6a62-423a-aa78-0e5a7f24eb7e tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:54.620882 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b54d3131-6a62-423a-aa78-0e5a7f24eb7e tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:54.621504 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b54d3131-6a62-423a-aa78-0e5a7f24eb7e tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:54.650862 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-1757c1bb-9f82-4495-ba61-0343702d8b71 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "POST /compute/v2.1/servers/315ce600-cbfd-4885-bc3d-5ab129d57681/action" status: 200 len: 32634 microversion: 2.1 time: 0.122673 Jan 15 21:15:54.652213 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3245/6480] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:15:54 2022] POST /compute/v2.1/servers/315ce600-cbfd-4885-bc3d-5ab129d57681/action => generated 32634 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:15:54.810876 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4b8b3e58-f440-40d4-98b5-bb83b2f89945 tempest-TestNetworkAdvancedServerOps-958360157 tempest-TestNetworkAdvancedServerOps-958360157-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:15:54.813395 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-4b8b3e58-f440-40d4-98b5-bb83b2f89945 tempest-TestNetworkAdvancedServerOps-958360157 tempest-TestNetworkAdvancedServerOps-958360157-project-admin] [instance: 315ce600-cbfd-4885-bc3d-5ab129d57681] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:15:54.826669 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4b8b3e58-f440-40d4-98b5-bb83b2f89945 tempest-TestNetworkAdvancedServerOps-958360157 tempest-TestNetworkAdvancedServerOps-958360157-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:54.827613 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4b8b3e58-f440-40d4-98b5-bb83b2f89945 tempest-TestNetworkAdvancedServerOps-958360157 tempest-TestNetworkAdvancedServerOps-958360157-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:54.829574 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4b8b3e58-f440-40d4-98b5-bb83b2f89945 tempest-TestNetworkAdvancedServerOps-958360157 tempest-TestNetworkAdvancedServerOps-958360157-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:54.830032 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4b8b3e58-f440-40d4-98b5-bb83b2f89945 tempest-TestNetworkAdvancedServerOps-958360157 tempest-TestNetworkAdvancedServerOps-958360157-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:54.877897 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-4b8b3e58-f440-40d4-98b5-bb83b2f89945 tempest-TestNetworkAdvancedServerOps-958360157 tempest-TestNetworkAdvancedServerOps-958360157-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '7f42d62d41934d5aa4aba6f9a1e1f920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8baf49b7c04879833db37012ebfd04', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:15:54.878485 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-4b8b3e58-f440-40d4-98b5-bb83b2f89945 tempest-TestNetworkAdvancedServerOps-958360157 tempest-TestNetworkAdvancedServerOps-958360157-project-admin] [instance: 315ce600-cbfd-4885-bc3d-5ab129d57681] flavor_id is None. Assuming migration. {{(pid=129366) resize /opt/stack/nova/nova/compute/api.py:4073}} Jan 15 21:15:54.878922 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-4b8b3e58-f440-40d4-98b5-bb83b2f89945 tempest-TestNetworkAdvancedServerOps-958360157 tempest-TestNetworkAdvancedServerOps-958360157-project-admin] [instance: 315ce600-cbfd-4885-bc3d-5ab129d57681] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=129366) resize /opt/stack/nova/nova/compute/api.py:4097}} Jan 15 21:15:55.047605 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-4b8b3e58-f440-40d4-98b5-bb83b2f89945 tempest-TestNetworkAdvancedServerOps-958360157 tempest-TestNetworkAdvancedServerOps-958360157-project-admin] 10.222.0.46 "POST /compute/v2.1/servers/315ce600-cbfd-4885-bc3d-5ab129d57681/action" status: 202 len: 0 microversion: 2.1 time: 0.243757 Jan 15 21:15:55.053113 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3246/6481] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:15:54 2022] POST /compute/v2.1/servers/315ce600-cbfd-4885-bc3d-5ab129d57681/action => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:15:55.059429 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-7811848c-f122-466d-ab84-0f52eb95608e req-14554cbe-b033-4575-a27e-68418862d502 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b10c8309-687a-4474-8f64-9956816741db", "name": "network-vif-unplugged", "status": "completed", "tag": "bdd3b358-3871-4d07-a30c-af2f31f8d4cf"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:15:55.063819 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:15:55.063819 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:15:55.076513 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-7811848c-f122-466d-ab84-0f52eb95608e req-14554cbe-b033-4575-a27e-68418862d502 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:55.077571 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-7811848c-f122-466d-ab84-0f52eb95608e req-14554cbe-b033-4575-a27e-68418862d502 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:55.119823 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.compute.server_external_events [req-7811848c-f122-466d-ab84-0f52eb95608e req-14554cbe-b033-4575-a27e-68418862d502 service nova] Unable to find a host for instance b10c8309-687a-4474-8f64-9956816741db. Dropping event network-vif-unplugged {{(pid=129366) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Jan 15 21:15:55.126850 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-7811848c-f122-466d-ab84-0f52eb95608e req-14554cbe-b033-4575-a27e-68418862d502 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.072274 Jan 15 21:15:55.127731 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3247/6482] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:15:55 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 74 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jan 15 21:15:55.139759 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f222a214-68b9-4501-b9a7-55db3b43319d tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:15:55.140631 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f222a214-68b9-4501-b9a7-55db3b43319d tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: 315ce600-cbfd-4885-bc3d-5ab129d57681] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:15:55.158240 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f222a214-68b9-4501-b9a7-55db3b43319d tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:55.160934 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f222a214-68b9-4501-b9a7-55db3b43319d tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:55.162493 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f222a214-68b9-4501-b9a7-55db3b43319d tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:55.164989 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f222a214-68b9-4501-b9a7-55db3b43319d tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:55.169941 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-b54d3131-6a62-423a-aa78-0e5a7f24eb7e tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:15:55.184366 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b54d3131-6a62-423a-aa78-0e5a7f24eb7e tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1452 microversion: 2.1 time: 0.580776 Jan 15 21:15:55.195837 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3236/6483] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:15:54 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1452 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:15:55.266016 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-bbecfa1f-3422-4d24-953f-1cfcc73ba934 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:15:55.266684 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-bbecfa1f-3422-4d24-953f-1cfcc73ba934 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:15:55.274950 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bbecfa1f-3422-4d24-953f-1cfcc73ba934 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:55.275807 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bbecfa1f-3422-4d24-953f-1cfcc73ba934 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:55.276867 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bbecfa1f-3422-4d24-953f-1cfcc73ba934 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:55.277615 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bbecfa1f-3422-4d24-953f-1cfcc73ba934 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:55.307714 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.objects.instance [None req-bbecfa1f-3422-4d24-953f-1cfcc73ba934 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lazy-loading 'flavor' on Instance uuid b10c8309-687a-4474-8f64-9956816741db {{(pid=129365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 21:15:55.320633 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-bbecfa1f-3422-4d24-953f-1cfcc73ba934 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] HTTP exception thrown: Cannot 'shelve' instance b10c8309-687a-4474-8f64-9956816741db while it is in vm_state shelved_offloaded Jan 15 21:15:55.322156 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-bbecfa1f-3422-4d24-953f-1cfcc73ba934 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Returning 409 to user: Cannot 'shelve' instance b10c8309-687a-4474-8f64-9956816741db while it is in vm_state shelved_offloaded {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:15:55.323342 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-bbecfa1f-3422-4d24-953f-1cfcc73ba934 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "POST /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db/action" status: 409 len: 155 microversion: 2.1 time: 0.061234 Jan 15 21:15:55.324371 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3237/6484] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:15:55 2022] POST /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db/action => generated 155 bytes in 63 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jan 15 21:15:55.333401 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-7a2210f3-d315-467b-98a7-b1c4a8a7fcb9 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:15:55.334249 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-7a2210f3-d315-467b-98a7-b1c4a8a7fcb9 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:15:55.341097 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7a2210f3-d315-467b-98a7-b1c4a8a7fcb9 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:55.341569 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7a2210f3-d315-467b-98a7-b1c4a8a7fcb9 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:55.342373 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7a2210f3-d315-467b-98a7-b1c4a8a7fcb9 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:55.343004 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7a2210f3-d315-467b-98a7-b1c4a8a7fcb9 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:55.479707 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-7a2210f3-d315-467b-98a7-b1c4a8a7fcb9 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "POST /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db/action" status: 202 len: 0 microversion: 2.1 time: 0.146561 Jan 15 21:15:55.481078 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3238/6485] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:15:55 2022] POST /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db/action => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:15:55.491239 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5165ec17-79cf-4d61-a660-e8ec524b7043 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:15:55.493331 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-5165ec17-79cf-4d61-a660-e8ec524b7043 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:15:55.506420 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5165ec17-79cf-4d61-a660-e8ec524b7043 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:55.511768 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5165ec17-79cf-4d61-a660-e8ec524b7043 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:55.515969 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5165ec17-79cf-4d61-a660-e8ec524b7043 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:55.516584 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5165ec17-79cf-4d61-a660-e8ec524b7043 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:55.757377 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-f222a214-68b9-4501-b9a7-55db3b43319d tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:15:55.778897 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f222a214-68b9-4501-b9a7-55db3b43319d tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/315ce600-cbfd-4885-bc3d-5ab129d57681" status: 200 len: 1690 microversion: 2.1 time: 0.647725 Jan 15 21:15:55.779968 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3248/6486] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:15:55 2022] GET /compute/v2.1/servers/315ce600-cbfd-4885-bc3d-5ab129d57681 => generated 1690 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:15:56.198535 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-5165ec17-79cf-4d61-a660-e8ec524b7043 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:15:56.212989 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5165ec17-79cf-4d61-a660-e8ec524b7043 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1460 microversion: 2.1 time: 0.722972 Jan 15 21:15:56.227104 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3239/6487] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:15:55 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1460 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:15:56.804462 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-5104a42a-bb12-4006-a1b4-da7acc4335f6 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:15:56.805133 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-5104a42a-bb12-4006-a1b4-da7acc4335f6 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: 315ce600-cbfd-4885-bc3d-5ab129d57681] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:15:56.819856 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5104a42a-bb12-4006-a1b4-da7acc4335f6 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:56.820336 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5104a42a-bb12-4006-a1b4-da7acc4335f6 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:56.821944 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5104a42a-bb12-4006-a1b4-da7acc4335f6 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:56.823169 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5104a42a-bb12-4006-a1b4-da7acc4335f6 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:57.234694 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-08e2c8c3-1915-4bfc-a5fe-fa2ff2ad9b84 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:15:57.236450 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-08e2c8c3-1915-4bfc-a5fe-fa2ff2ad9b84 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:15:57.245587 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-08e2c8c3-1915-4bfc-a5fe-fa2ff2ad9b84 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:57.246514 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-08e2c8c3-1915-4bfc-a5fe-fa2ff2ad9b84 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:57.248339 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-08e2c8c3-1915-4bfc-a5fe-fa2ff2ad9b84 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:57.249564 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-08e2c8c3-1915-4bfc-a5fe-fa2ff2ad9b84 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:57.751883 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-5104a42a-bb12-4006-a1b4-da7acc4335f6 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:15:57.805553 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-5104a42a-bb12-4006-a1b4-da7acc4335f6 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/315ce600-cbfd-4885-bc3d-5ab129d57681" status: 200 len: 1690 microversion: 2.1 time: 1.008659 Jan 15 21:15:57.806337 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3249/6488] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:15:56 2022] GET /compute/v2.1/servers/315ce600-cbfd-4885-bc3d-5ab129d57681 => generated 1690 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:15:57.822418 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-08e2c8c3-1915-4bfc-a5fe-fa2ff2ad9b84 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:15:57.831006 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-08e2c8c3-1915-4bfc-a5fe-fa2ff2ad9b84 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1460 microversion: 2.1 time: 0.600430 Jan 15 21:15:57.832300 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3240/6489] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:15:57 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1460 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:15:58.824804 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d779c3a9-b458-4717-bf76-d159cb24a90b tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:15:58.826527 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-d779c3a9-b458-4717-bf76-d159cb24a90b tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: 315ce600-cbfd-4885-bc3d-5ab129d57681] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:15:58.839087 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d779c3a9-b458-4717-bf76-d159cb24a90b tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:58.839644 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d779c3a9-b458-4717-bf76-d159cb24a90b tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:58.840720 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d779c3a9-b458-4717-bf76-d159cb24a90b tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:58.841422 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d779c3a9-b458-4717-bf76-d159cb24a90b tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:58.849897 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ae4b5cb2-bad9-46ae-b7c3-dff809b21b71 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:15:58.850732 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ae4b5cb2-bad9-46ae-b7c3-dff809b21b71 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:15:58.861841 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ae4b5cb2-bad9-46ae-b7c3-dff809b21b71 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:58.862641 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ae4b5cb2-bad9-46ae-b7c3-dff809b21b71 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:58.863688 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ae4b5cb2-bad9-46ae-b7c3-dff809b21b71 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:15:58.864419 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ae4b5cb2-bad9-46ae-b7c3-dff809b21b71 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:15:59.201233 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-ae4b5cb2-bad9-46ae-b7c3-dff809b21b71 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:15:59.206288 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-d779c3a9-b458-4717-bf76-d159cb24a90b tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:15:59.218168 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d779c3a9-b458-4717-bf76-d159cb24a90b tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/315ce600-cbfd-4885-bc3d-5ab129d57681" status: 200 len: 1690 microversion: 2.1 time: 0.397767 Jan 15 21:15:59.220752 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3250/6490] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:15:58 2022] GET /compute/v2.1/servers/315ce600-cbfd-4885-bc3d-5ab129d57681 => generated 1690 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:15:59.222821 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ae4b5cb2-bad9-46ae-b7c3-dff809b21b71 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1518 microversion: 2.1 time: 0.376804 Jan 15 21:15:59.223589 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3241/6491] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:15:58 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1518 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:16:00.145165 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-cf84e498-f9b8-49b5-9454-91817d76273a req-e299318c-e24b-4e6d-9811-7f6b4fd5972f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b10c8309-687a-4474-8f64-9956816741db", "tag": "bdd3b358-3871-4d07-a30c-af2f31f8d4cf"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:16:00.146608 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:16:00.146608 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:16:00.170615 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-cf84e498-f9b8-49b5-9454-91817d76273a req-e299318c-e24b-4e6d-9811-7f6b4fd5972f service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:00.171128 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-cf84e498-f9b8-49b5-9454-91817d76273a req-e299318c-e24b-4e6d-9811-7f6b4fd5972f service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:00.187772 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-cf84e498-f9b8-49b5-9454-91817d76273a req-e299318c-e24b-4e6d-9811-7f6b4fd5972f service nova] Creating event network-changed:bdd3b358-3871-4d07-a30c-af2f31f8d4cf for instance b10c8309-687a-4474-8f64-9956816741db on nch1-master-1 Jan 15 21:16:00.194886 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-cf84e498-f9b8-49b5-9454-91817d76273a req-e299318c-e24b-4e6d-9811-7f6b4fd5972f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055504 Jan 15 21:16:00.196020 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3251/6492] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:16:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:16:00.237891 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-18b63649-6d7b-44a7-90ad-058b4ce9a18e tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:16:00.238707 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-18b63649-6d7b-44a7-90ad-058b4ce9a18e tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: 315ce600-cbfd-4885-bc3d-5ab129d57681] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:16:00.247413 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-75622f36-1362-4f18-b950-37c6a963bf2d tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:16:00.252433 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-18b63649-6d7b-44a7-90ad-058b4ce9a18e tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:00.253996 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-18b63649-6d7b-44a7-90ad-058b4ce9a18e tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:00.255051 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-18b63649-6d7b-44a7-90ad-058b4ce9a18e tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:00.255374 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-75622f36-1362-4f18-b950-37c6a963bf2d tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:16:00.257386 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-18b63649-6d7b-44a7-90ad-058b4ce9a18e tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:00.268395 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-75622f36-1362-4f18-b950-37c6a963bf2d tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:00.269143 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-75622f36-1362-4f18-b950-37c6a963bf2d tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:00.270558 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-75622f36-1362-4f18-b950-37c6a963bf2d tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:00.271668 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-75622f36-1362-4f18-b950-37c6a963bf2d tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:00.548405 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-18b63649-6d7b-44a7-90ad-058b4ce9a18e tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:16:00.548593 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-75622f36-1362-4f18-b950-37c6a963bf2d tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:16:00.556121 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-75622f36-1362-4f18-b950-37c6a963bf2d tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1518 microversion: 2.1 time: 0.312412 Jan 15 21:16:00.556478 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3252/6493] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:16:00 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1518 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:16:00.559210 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-18b63649-6d7b-44a7-90ad-058b4ce9a18e tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/315ce600-cbfd-4885-bc3d-5ab129d57681" status: 200 len: 1695 microversion: 2.1 time: 0.326143 Jan 15 21:16:00.559987 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3242/6494] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:16:00 2022] GET /compute/v2.1/servers/315ce600-cbfd-4885-bc3d-5ab129d57681 => generated 1695 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:16:01.580954 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1d935512-e946-4fbd-a5cb-eaacff7a290f tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:16:01.583026 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-7fb658f1-973b-4ed4-8038-008f88cdcb48 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:16:01.583713 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-1d935512-e946-4fbd-a5cb-eaacff7a290f tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:16:01.585461 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-7fb658f1-973b-4ed4-8038-008f88cdcb48 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: 315ce600-cbfd-4885-bc3d-5ab129d57681] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:16:01.597970 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1d935512-e946-4fbd-a5cb-eaacff7a290f tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:01.601835 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7fb658f1-973b-4ed4-8038-008f88cdcb48 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:01.602700 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1d935512-e946-4fbd-a5cb-eaacff7a290f tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:01.603840 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1d935512-e946-4fbd-a5cb-eaacff7a290f tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:01.604586 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7fb658f1-973b-4ed4-8038-008f88cdcb48 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:01.605330 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1d935512-e946-4fbd-a5cb-eaacff7a290f tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:01.606382 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7fb658f1-973b-4ed4-8038-008f88cdcb48 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:01.609940 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7fb658f1-973b-4ed4-8038-008f88cdcb48 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:02.315151 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-7fb658f1-973b-4ed4-8038-008f88cdcb48 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:16:02.335296 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-7fb658f1-973b-4ed4-8038-008f88cdcb48 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/315ce600-cbfd-4885-bc3d-5ab129d57681" status: 200 len: 1695 microversion: 2.1 time: 0.759883 Jan 15 21:16:02.338065 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3243/6495] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:16:01 2022] GET /compute/v2.1/servers/315ce600-cbfd-4885-bc3d-5ab129d57681 => generated 1695 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:16:02.358969 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-1d935512-e946-4fbd-a5cb-eaacff7a290f tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:16:02.371270 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-1d935512-e946-4fbd-a5cb-eaacff7a290f tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1518 microversion: 2.1 time: 0.801224 Jan 15 21:16:02.378492 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3253/6496] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:16:01 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1518 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:16:03.360071 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-38067fd2-f83e-4d40-8b2f-964022ece82a tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:16:03.361993 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-38067fd2-f83e-4d40-8b2f-964022ece82a tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: 315ce600-cbfd-4885-bc3d-5ab129d57681] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:16:03.395535 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-54525772-1a23-4356-a871-d7d553fd3037 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:16:03.397859 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-54525772-1a23-4356-a871-d7d553fd3037 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:16:03.411909 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-38067fd2-f83e-4d40-8b2f-964022ece82a tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:03.412624 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-38067fd2-f83e-4d40-8b2f-964022ece82a tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:03.413468 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-38067fd2-f83e-4d40-8b2f-964022ece82a tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:03.413909 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-38067fd2-f83e-4d40-8b2f-964022ece82a tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:03.423094 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-54525772-1a23-4356-a871-d7d553fd3037 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:03.423838 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-54525772-1a23-4356-a871-d7d553fd3037 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:03.425119 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-54525772-1a23-4356-a871-d7d553fd3037 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:03.426038 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-54525772-1a23-4356-a871-d7d553fd3037 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:04.885515 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-38067fd2-f83e-4d40-8b2f-964022ece82a tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:16:04.918059 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-38067fd2-f83e-4d40-8b2f-964022ece82a tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/315ce600-cbfd-4885-bc3d-5ab129d57681" status: 200 len: 1695 microversion: 2.1 time: 1.565841 Jan 15 21:16:04.919718 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3244/6497] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:16:03 2022] GET /compute/v2.1/servers/315ce600-cbfd-4885-bc3d-5ab129d57681 => generated 1695 bytes in 1568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:16:05.145567 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-54525772-1a23-4356-a871-d7d553fd3037 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:16:05.182829 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-54525772-1a23-4356-a871-d7d553fd3037 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1518 microversion: 2.1 time: 1.791871 Jan 15 21:16:05.189199 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3254/6498] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:16:03 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1518 bytes in 1799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:16:05.937733 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-21b61147-2e6c-4a37-93d1-b94b2dc4034b tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:16:05.939188 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-21b61147-2e6c-4a37-93d1-b94b2dc4034b tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: 315ce600-cbfd-4885-bc3d-5ab129d57681] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:16:05.954568 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-21b61147-2e6c-4a37-93d1-b94b2dc4034b tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:05.965223 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-21b61147-2e6c-4a37-93d1-b94b2dc4034b tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:05.966546 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-21b61147-2e6c-4a37-93d1-b94b2dc4034b tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:05.970892 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-21b61147-2e6c-4a37-93d1-b94b2dc4034b tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:06.205345 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-59fe5cab-4001-483e-bfe4-35a73e82e76c tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:16:06.208515 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-59fe5cab-4001-483e-bfe4-35a73e82e76c tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:16:06.223009 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-59fe5cab-4001-483e-bfe4-35a73e82e76c tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:06.225870 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-59fe5cab-4001-483e-bfe4-35a73e82e76c tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:06.228124 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-59fe5cab-4001-483e-bfe4-35a73e82e76c tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:06.228800 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-59fe5cab-4001-483e-bfe4-35a73e82e76c tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:06.705727 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-21b61147-2e6c-4a37-93d1-b94b2dc4034b tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:16:06.757362 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-21b61147-2e6c-4a37-93d1-b94b2dc4034b tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/315ce600-cbfd-4885-bc3d-5ab129d57681" status: 200 len: 1695 microversion: 2.1 time: 0.821084 Jan 15 21:16:06.761897 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3245/6499] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:16:05 2022] GET /compute/v2.1/servers/315ce600-cbfd-4885-bc3d-5ab129d57681 => generated 1695 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:16:07.260096 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-59fe5cab-4001-483e-bfe4-35a73e82e76c tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:16:07.278589 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-59fe5cab-4001-483e-bfe4-35a73e82e76c tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1518 microversion: 2.1 time: 1.077791 Jan 15 21:16:07.280807 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3255/6500] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:16:06 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1518 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:16:07.783867 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-7d8fe29e-c8cf-4c75-b3f4-88cfc0bc506f tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:16:07.785733 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-7d8fe29e-c8cf-4c75-b3f4-88cfc0bc506f tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: 315ce600-cbfd-4885-bc3d-5ab129d57681] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:16:07.803549 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7d8fe29e-c8cf-4c75-b3f4-88cfc0bc506f tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:07.804397 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7d8fe29e-c8cf-4c75-b3f4-88cfc0bc506f tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:07.805522 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7d8fe29e-c8cf-4c75-b3f4-88cfc0bc506f tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:07.806447 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7d8fe29e-c8cf-4c75-b3f4-88cfc0bc506f tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:08.302320 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a2347441-97fb-45ce-b9b1-70188d848ccf tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:16:08.303602 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a2347441-97fb-45ce-b9b1-70188d848ccf tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:16:08.321324 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a2347441-97fb-45ce-b9b1-70188d848ccf tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:08.327239 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a2347441-97fb-45ce-b9b1-70188d848ccf tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:08.328427 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a2347441-97fb-45ce-b9b1-70188d848ccf tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:08.330983 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a2347441-97fb-45ce-b9b1-70188d848ccf tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:08.716319 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-7d8fe29e-c8cf-4c75-b3f4-88cfc0bc506f tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:16:08.729544 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-7d8fe29e-c8cf-4c75-b3f4-88cfc0bc506f tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/315ce600-cbfd-4885-bc3d-5ab129d57681" status: 200 len: 1695 microversion: 2.1 time: 0.952193 Jan 15 21:16:08.731689 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3246/6501] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:16:07 2022] GET /compute/v2.1/servers/315ce600-cbfd-4885-bc3d-5ab129d57681 => generated 1695 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:16:08.800978 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-a2347441-97fb-45ce-b9b1-70188d848ccf tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:16:08.814520 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a2347441-97fb-45ce-b9b1-70188d848ccf tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1518 microversion: 2.1 time: 0.517740 Jan 15 21:16:08.816159 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3256/6502] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:16:08 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1518 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:16:09.748753 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d1a42e8e-1e46-45a0-8a30-830625e7a492 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:16:09.751654 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d1a42e8e-1e46-45a0-8a30-830625e7a492 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: 315ce600-cbfd-4885-bc3d-5ab129d57681] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:16:09.767254 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d1a42e8e-1e46-45a0-8a30-830625e7a492 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:09.769304 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d1a42e8e-1e46-45a0-8a30-830625e7a492 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:09.773438 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d1a42e8e-1e46-45a0-8a30-830625e7a492 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:09.774323 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d1a42e8e-1e46-45a0-8a30-830625e7a492 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:09.833584 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-57a79fff-6763-453a-932a-486d12881d47 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:16:09.835218 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-57a79fff-6763-453a-932a-486d12881d47 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:16:09.844357 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-57a79fff-6763-453a-932a-486d12881d47 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:09.862318 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-57a79fff-6763-453a-932a-486d12881d47 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:09.863198 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-57a79fff-6763-453a-932a-486d12881d47 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:09.863647 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-57a79fff-6763-453a-932a-486d12881d47 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:10.535876 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-d1a42e8e-1e46-45a0-8a30-830625e7a492 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:16:10.550906 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d1a42e8e-1e46-45a0-8a30-830625e7a492 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/315ce600-cbfd-4885-bc3d-5ab129d57681" status: 200 len: 1695 microversion: 2.1 time: 0.806808 Jan 15 21:16:10.552957 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3247/6503] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:16:09 2022] GET /compute/v2.1/servers/315ce600-cbfd-4885-bc3d-5ab129d57681 => generated 1695 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:16:10.636305 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-57a79fff-6763-453a-932a-486d12881d47 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:16:10.672641 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-57a79fff-6763-453a-932a-486d12881d47 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1518 microversion: 2.1 time: 0.842425 Jan 15 21:16:10.673796 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3257/6504] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:16:09 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1518 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:16:11.572525 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-13cab72a-29e5-4093-93e1-9494c3768e37 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:16:11.573280 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-13cab72a-29e5-4093-93e1-9494c3768e37 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: 315ce600-cbfd-4885-bc3d-5ab129d57681] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:16:11.583116 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-13cab72a-29e5-4093-93e1-9494c3768e37 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:11.587230 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-13cab72a-29e5-4093-93e1-9494c3768e37 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:11.589678 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-13cab72a-29e5-4093-93e1-9494c3768e37 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:11.591656 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-13cab72a-29e5-4093-93e1-9494c3768e37 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:11.694584 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a594cd48-8a21-409d-9b6e-9d767266c875 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:16:11.695177 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a594cd48-8a21-409d-9b6e-9d767266c875 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:16:11.706047 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a594cd48-8a21-409d-9b6e-9d767266c875 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:11.706813 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a594cd48-8a21-409d-9b6e-9d767266c875 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:11.711576 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a594cd48-8a21-409d-9b6e-9d767266c875 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:11.712290 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a594cd48-8a21-409d-9b6e-9d767266c875 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:13.044464 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-13cab72a-29e5-4093-93e1-9494c3768e37 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:16:13.057386 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-13cab72a-29e5-4093-93e1-9494c3768e37 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/315ce600-cbfd-4885-bc3d-5ab129d57681" status: 200 len: 1695 microversion: 2.1 time: 1.488981 Jan 15 21:16:13.057989 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3248/6505] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:16:11 2022] GET /compute/v2.1/servers/315ce600-cbfd-4885-bc3d-5ab129d57681 => generated 1695 bytes in 1490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:16:13.065649 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ee617b67-68e8-48d3-9400-74530ca0a454 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Action: 'create', calling method: .version_select at 0x7f30c8421700>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1974703774"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:16:13.107335 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-ee617b67-68e8-48d3-9400-74530ca0a454 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Getting quotas for project de60cd8289224f1f81ef0db9ec3c6f87. Resources: {'key_pairs'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:16:13.119291 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-ee617b67-68e8-48d3-9400-74530ca0a454 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Getting quotas for user 4b0d769340dc4d36b83436c7fc78bbe5 and project de60cd8289224f1f81ef0db9ec3c6f87. Resources: {'key_pairs'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:16:13.290802 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-a594cd48-8a21-409d-9b6e-9d767266c875 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:16:13.300397 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a594cd48-8a21-409d-9b6e-9d767266c875 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1518 microversion: 2.1 time: 1.609476 Jan 15 21:16:13.305168 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3258/6506] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:16:11 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1518 bytes in 1615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:16:13.759259 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-ee617b67-68e8-48d3-9400-74530ca0a454 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Getting quotas for project de60cd8289224f1f81ef0db9ec3c6f87. Resources: {'key_pairs'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:16:13.774898 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-ee617b67-68e8-48d3-9400-74530ca0a454 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Getting quotas for user 4b0d769340dc4d36b83436c7fc78bbe5 and project de60cd8289224f1f81ef0db9ec3c6f87. Resources: {'key_pairs'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:16:13.797032 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ee617b67-68e8-48d3-9400-74530ca0a454 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 2317 microversion: 2.1 time: 0.737663 Jan 15 21:16:13.797947 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3249/6507] 10.222.0.46 () {60 vars in 1157 bytes} [Sat Jan 15 21:16:13 2022] POST /compute/v2.1/os-keypairs => generated 2317 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:16:14.076658 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-92845c3e-742a-4254-8972-7e262d288e7c tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:16:14.077705 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-92845c3e-742a-4254-8972-7e262d288e7c tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: 315ce600-cbfd-4885-bc3d-5ab129d57681] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:16:14.084107 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-92845c3e-742a-4254-8972-7e262d288e7c tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:14.084564 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-92845c3e-742a-4254-8972-7e262d288e7c tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:14.085403 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-92845c3e-742a-4254-8972-7e262d288e7c tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:14.085850 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-92845c3e-742a-4254-8972-7e262d288e7c tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:14.322199 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ed9fb736-99b1-4a2a-97be-f8173adba504 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:16:14.323561 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ed9fb736-99b1-4a2a-97be-f8173adba504 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:16:14.334955 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ed9fb736-99b1-4a2a-97be-f8173adba504 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:14.336161 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ed9fb736-99b1-4a2a-97be-f8173adba504 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:14.339390 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ed9fb736-99b1-4a2a-97be-f8173adba504 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:14.343336 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ed9fb736-99b1-4a2a-97be-f8173adba504 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:14.416988 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-92845c3e-742a-4254-8972-7e262d288e7c tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:16:14.426753 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-92845c3e-742a-4254-8972-7e262d288e7c tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/315ce600-cbfd-4885-bc3d-5ab129d57681" status: 200 len: 1695 microversion: 2.1 time: 0.353729 Jan 15 21:16:14.442416 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3259/6508] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:16:14 2022] GET /compute/v2.1/servers/315ce600-cbfd-4885-bc3d-5ab129d57681 => generated 1695 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:16:14.751669 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-ed9fb736-99b1-4a2a-97be-f8173adba504 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:16:14.771569 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ed9fb736-99b1-4a2a-97be-f8173adba504 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1518 microversion: 2.1 time: 0.453006 Jan 15 21:16:14.784012 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3250/6509] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:16:14 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1518 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:16:15.444797 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f005dc0f-fd12-4d54-bf0f-28eab5929319 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:16:15.445451 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f005dc0f-fd12-4d54-bf0f-28eab5929319 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: 315ce600-cbfd-4885-bc3d-5ab129d57681] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:16:15.458107 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f005dc0f-fd12-4d54-bf0f-28eab5929319 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:15.458577 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f005dc0f-fd12-4d54-bf0f-28eab5929319 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:15.459395 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f005dc0f-fd12-4d54-bf0f-28eab5929319 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:15.459841 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f005dc0f-fd12-4d54-bf0f-28eab5929319 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:15.791246 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5c2628d5-b185-4638-8607-614f717d50d2 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:16:15.792518 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-5c2628d5-b185-4638-8607-614f717d50d2 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:16:15.817382 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5c2628d5-b185-4638-8607-614f717d50d2 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:15.818580 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5c2628d5-b185-4638-8607-614f717d50d2 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:15.820241 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5c2628d5-b185-4638-8607-614f717d50d2 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:15.821284 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5c2628d5-b185-4638-8607-614f717d50d2 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:15.831230 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-f005dc0f-fd12-4d54-bf0f-28eab5929319 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:16:15.839620 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f005dc0f-fd12-4d54-bf0f-28eab5929319 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/315ce600-cbfd-4885-bc3d-5ab129d57681" status: 200 len: 1695 microversion: 2.1 time: 0.398464 Jan 15 21:16:15.842345 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3260/6510] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:16:15 2022] GET /compute/v2.1/servers/315ce600-cbfd-4885-bc3d-5ab129d57681 => generated 1695 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:16:16.025147 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-5c2628d5-b185-4638-8607-614f717d50d2 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:16:16.042405 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5c2628d5-b185-4638-8607-614f717d50d2 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1518 microversion: 2.1 time: 0.253587 Jan 15 21:16:16.043359 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3251/6511] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:16:15 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1518 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:16:16.271093 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-97141239-1df1-4936-b2cd-c0c5e0cd4be9 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-48157980", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "networks": [{"uuid": "9b6e92d5-4ead-4aec-a8af-bdc5348adf8e"}], "key_name": "tempest-TestNetworkBasicOps-1974703774", "security_groups": [{"name": "tempest-secgroup-smoke-59564750"}]}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:16:16.389087 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.network.neutron [None req-97141239-1df1-4936-b2cd-c0c5e0cd4be9 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] validate_networks() for [('9b6e92d5-4ead-4aec-a8af-bdc5348adf8e', None, None, None, None, None)] {{(pid=129366) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 21:16:16.860482 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-20d84adb-6572-4345-874d-1ad1ada72bfd tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:16:16.861264 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-20d84adb-6572-4345-874d-1ad1ada72bfd tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: 315ce600-cbfd-4885-bc3d-5ab129d57681] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:16:16.870124 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-20d84adb-6572-4345-874d-1ad1ada72bfd tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:16.873133 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-20d84adb-6572-4345-874d-1ad1ada72bfd tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:16.874619 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-20d84adb-6572-4345-874d-1ad1ada72bfd tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:16.877302 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-20d84adb-6572-4345-874d-1ad1ada72bfd tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:16.926086 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-97141239-1df1-4936-b2cd-c0c5e0cd4be9 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Flavor limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 21:16:16.927370 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-97141239-1df1-4936-b2cd-c0c5e0cd4be9 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Image limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 21:16:16.927853 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-97141239-1df1-4936-b2cd-c0c5e0cd4be9 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Flavor pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 21:16:16.928651 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-97141239-1df1-4936-b2cd-c0c5e0cd4be9 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Image pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 21:16:16.929287 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-97141239-1df1-4936-b2cd-c0c5e0cd4be9 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 21:16:16.941178 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-97141239-1df1-4936-b2cd-c0c5e0cd4be9 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:16.941881 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-97141239-1df1-4936-b2cd-c0c5e0cd4be9 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:16.943534 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-97141239-1df1-4936-b2cd-c0c5e0cd4be9 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:16.944868 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-97141239-1df1-4936-b2cd-c0c5e0cd4be9 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:16.974135 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-97141239-1df1-4936-b2cd-c0c5e0cd4be9 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Getting quotas for project de60cd8289224f1f81ef0db9ec3c6f87. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:16:16.984600 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-97141239-1df1-4936-b2cd-c0c5e0cd4be9 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Getting quotas for user 4b0d769340dc4d36b83436c7fc78bbe5 and project de60cd8289224f1f81ef0db9ec3c6f87. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:16:16.999207 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-97141239-1df1-4936-b2cd-c0c5e0cd4be9 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Going to run 1 instances... {{(pid=129366) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 21:16:17.002384 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-97141239-1df1-4936-b2cd-c0c5e0cd4be9 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] [instance: 57f7b510-e7b8-484b-9be5-468ac3063f29] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 21:16:17.060385 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-97141239-1df1-4936-b2cd-c0c5e0cd4be9 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.793296 Jan 15 21:16:17.062636 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3261/6512] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 21:16:16 2022] POST /compute/v2.1/servers => generated 404 bytes in 796 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 21:16:17.067602 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4b20dade-6c26-4af3-96c7-32892b70318b tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:16:17.068492 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-4b20dade-6c26-4af3-96c7-32892b70318b tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:16:17.075195 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4b20dade-6c26-4af3-96c7-32892b70318b tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:17.075930 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4b20dade-6c26-4af3-96c7-32892b70318b tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:17.076906 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4b20dade-6c26-4af3-96c7-32892b70318b tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:17.077353 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4b20dade-6c26-4af3-96c7-32892b70318b tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:17.102179 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-20d84adb-6572-4345-874d-1ad1ada72bfd tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:16:17.115031 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-20d84adb-6572-4345-874d-1ad1ada72bfd tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/315ce600-cbfd-4885-bc3d-5ab129d57681" status: 200 len: 1694 microversion: 2.1 time: 0.259258 Jan 15 21:16:17.115817 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3252/6513] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:16:16 2022] GET /compute/v2.1/servers/315ce600-cbfd-4885-bc3d-5ab129d57681 => generated 1694 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:16:17.130650 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-03cbb3d0-9b3f-44b7-b236-ccd5ac59043d tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:16:17.131570 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-03cbb3d0-9b3f-44b7-b236-ccd5ac59043d tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] [instance: 57f7b510-e7b8-484b-9be5-468ac3063f29] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:16:17.214573 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-03cbb3d0-9b3f-44b7-b236-ccd5ac59043d tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0d769340dc4d36b83436c7fc78bbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de60cd8289224f1f81ef0db9ec3c6f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:16:17.228893 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-03cbb3d0-9b3f-44b7-b236-ccd5ac59043d tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] 10.222.0.46 "GET /compute/v2.1/servers/57f7b510-e7b8-484b-9be5-468ac3063f29" status: 200 len: 1247 microversion: 2.1 time: 0.101779 Jan 15 21:16:17.229574 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3253/6514] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:16:17 2022] GET /compute/v2.1/servers/57f7b510-e7b8-484b-9be5-468ac3063f29 => generated 1247 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:16:17.324552 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-4b20dade-6c26-4af3-96c7-32892b70318b tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:16:17.341171 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-4b20dade-6c26-4af3-96c7-32892b70318b tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1518 microversion: 2.1 time: 0.277253 Jan 15 21:16:17.352786 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3262/6515] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:16:17 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1518 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:16:17.878416 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-93a64bb9-fe05-4204-a3fe-ef7174ef8aaa req-96df0f92-dec3-40f6-b7d6-6c1a6f994056 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "315ce600-cbfd-4885-bc3d-5ab129d57681", "name": "network-vif-unplugged", "status": "completed", "tag": "5946fdbc-5c0f-444f-9903-f401907ec9ec"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:16:17.880147 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:16:17.880147 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:16:17.898885 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-93a64bb9-fe05-4204-a3fe-ef7174ef8aaa req-96df0f92-dec3-40f6-b7d6-6c1a6f994056 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:17.899421 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-93a64bb9-fe05-4204-a3fe-ef7174ef8aaa req-96df0f92-dec3-40f6-b7d6-6c1a6f994056 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:17.914862 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-93a64bb9-fe05-4204-a3fe-ef7174ef8aaa req-96df0f92-dec3-40f6-b7d6-6c1a6f994056 service nova] Creating event network-vif-unplugged:5946fdbc-5c0f-444f-9903-f401907ec9ec for instance 315ce600-cbfd-4885-bc3d-5ab129d57681 on nch1-master-1 Jan 15 21:16:17.923341 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [req-93a64bb9-fe05-4204-a3fe-ef7174ef8aaa req-96df0f92-dec3-40f6-b7d6-6c1a6f994056 service nova] Instance 315ce600-cbfd-4885-bc3d-5ab129d57681 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=129365) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Jan 15 21:16:17.945087 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-93a64bb9-fe05-4204-a3fe-ef7174ef8aaa req-96df0f92-dec3-40f6-b7d6-6c1a6f994056 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.070817 Jan 15 21:16:17.946981 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3254/6516] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:16:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:16:18.132705 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e4f3ef30-fb96-4438-9a0f-e51f0cc7ff69 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:16:18.133627 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e4f3ef30-fb96-4438-9a0f-e51f0cc7ff69 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: 315ce600-cbfd-4885-bc3d-5ab129d57681] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:16:18.141504 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e4f3ef30-fb96-4438-9a0f-e51f0cc7ff69 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:18.142190 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e4f3ef30-fb96-4438-9a0f-e51f0cc7ff69 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:18.142980 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e4f3ef30-fb96-4438-9a0f-e51f0cc7ff69 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:18.143588 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e4f3ef30-fb96-4438-9a0f-e51f0cc7ff69 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:18.247403 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3f374909-62ec-4ba3-a4ed-a219a95c9bc2 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:16:18.248282 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-3f374909-62ec-4ba3-a4ed-a219a95c9bc2 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] [instance: 57f7b510-e7b8-484b-9be5-468ac3063f29] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:16:18.255763 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3f374909-62ec-4ba3-a4ed-a219a95c9bc2 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:18.256313 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3f374909-62ec-4ba3-a4ed-a219a95c9bc2 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:18.257133 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3f374909-62ec-4ba3-a4ed-a219a95c9bc2 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:18.257685 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3f374909-62ec-4ba3-a4ed-a219a95c9bc2 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:18.358171 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-e4f3ef30-fb96-4438-9a0f-e51f0cc7ff69 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:16:18.366939 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e4f3ef30-fb96-4438-9a0f-e51f0cc7ff69 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/315ce600-cbfd-4885-bc3d-5ab129d57681" status: 200 len: 1694 microversion: 2.1 time: 0.237994 Jan 15 21:16:18.367456 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-3f374909-62ec-4ba3-a4ed-a219a95c9bc2 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0d769340dc4d36b83436c7fc78bbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de60cd8289224f1f81ef0db9ec3c6f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:16:18.368449 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3263/6517] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:16:18 2022] GET /compute/v2.1/servers/315ce600-cbfd-4885-bc3d-5ab129d57681 => generated 1694 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:16:18.373314 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-69803c82-0afa-4321-bb7e-2b210f76c960 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:16:18.374220 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-69803c82-0afa-4321-bb7e-2b210f76c960 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:16:18.380531 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-69803c82-0afa-4321-bb7e-2b210f76c960 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:18.380802 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3f374909-62ec-4ba3-a4ed-a219a95c9bc2 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] 10.222.0.46 "GET /compute/v2.1/servers/57f7b510-e7b8-484b-9be5-468ac3063f29" status: 200 len: 1299 microversion: 2.1 time: 0.137413 Jan 15 21:16:18.381488 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-69803c82-0afa-4321-bb7e-2b210f76c960 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:18.381780 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3255/6518] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:16:18 2022] GET /compute/v2.1/servers/57f7b510-e7b8-484b-9be5-468ac3063f29 => generated 1299 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:16:18.392505 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-69803c82-0afa-4321-bb7e-2b210f76c960 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:18.393220 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-69803c82-0afa-4321-bb7e-2b210f76c960 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:18.548197 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-69803c82-0afa-4321-bb7e-2b210f76c960 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:16:18.556060 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-69803c82-0afa-4321-bb7e-2b210f76c960 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1518 microversion: 2.1 time: 0.186307 Jan 15 21:16:18.556951 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3264/6519] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:16:18 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1518 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:16:19.045206 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-acefba40-4704-46b9-b4b3-a0f2be5472f8 req-aaf6ea93-af0d-4132-8852-ae5e821deee5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b10c8309-687a-4474-8f64-9956816741db", "name": "network-vif-plugged", "status": "completed", "tag": "bdd3b358-3871-4d07-a30c-af2f31f8d4cf"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:16:19.046837 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:16:19.046837 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:16:19.054370 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-acefba40-4704-46b9-b4b3-a0f2be5472f8 req-aaf6ea93-af0d-4132-8852-ae5e821deee5 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:19.055177 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-acefba40-4704-46b9-b4b3-a0f2be5472f8 req-aaf6ea93-af0d-4132-8852-ae5e821deee5 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:19.069983 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-acefba40-4704-46b9-b4b3-a0f2be5472f8 req-aaf6ea93-af0d-4132-8852-ae5e821deee5 service nova] Creating event network-vif-plugged:bdd3b358-3871-4d07-a30c-af2f31f8d4cf for instance b10c8309-687a-4474-8f64-9956816741db on nch1-master-1 Jan 15 21:16:19.075573 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-acefba40-4704-46b9-b4b3-a0f2be5472f8 req-aaf6ea93-af0d-4132-8852-ae5e821deee5 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038697 Jan 15 21:16:19.076573 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3256/6520] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:16:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:16:19.385914 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4c139dee-cdcd-4946-a278-407b1fff9610 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:16:19.386634 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-4c139dee-cdcd-4946-a278-407b1fff9610 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: 315ce600-cbfd-4885-bc3d-5ab129d57681] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:16:19.398397 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4c139dee-cdcd-4946-a278-407b1fff9610 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:19.399604 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-334f080a-e85e-4aa7-b859-c1ee56b01028 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:16:19.400327 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-334f080a-e85e-4aa7-b859-c1ee56b01028 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] [instance: 57f7b510-e7b8-484b-9be5-468ac3063f29] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:16:19.400902 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4c139dee-cdcd-4946-a278-407b1fff9610 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:19.401796 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4c139dee-cdcd-4946-a278-407b1fff9610 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:19.405425 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4c139dee-cdcd-4946-a278-407b1fff9610 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:19.408492 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-334f080a-e85e-4aa7-b859-c1ee56b01028 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:19.408977 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-334f080a-e85e-4aa7-b859-c1ee56b01028 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:19.410002 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-334f080a-e85e-4aa7-b859-c1ee56b01028 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:19.410613 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-334f080a-e85e-4aa7-b859-c1ee56b01028 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:19.558531 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-334f080a-e85e-4aa7-b859-c1ee56b01028 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0d769340dc4d36b83436c7fc78bbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de60cd8289224f1f81ef0db9ec3c6f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:16:19.566889 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-334f080a-e85e-4aa7-b859-c1ee56b01028 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] 10.222.0.46 "GET /compute/v2.1/servers/57f7b510-e7b8-484b-9be5-468ac3063f29" status: 200 len: 1305 microversion: 2.1 time: 0.171321 Jan 15 21:16:19.567917 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3257/6521] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:16:19 2022] GET /compute/v2.1/servers/57f7b510-e7b8-484b-9be5-468ac3063f29 => generated 1305 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:16:19.573009 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-1f1d7299-9bbd-4b8c-bca4-a90546755236 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:16:19.573906 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-1f1d7299-9bbd-4b8c-bca4-a90546755236 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:16:19.580650 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1f1d7299-9bbd-4b8c-bca4-a90546755236 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:19.581250 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1f1d7299-9bbd-4b8c-bca4-a90546755236 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:19.582153 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1f1d7299-9bbd-4b8c-bca4-a90546755236 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:19.585943 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1f1d7299-9bbd-4b8c-bca4-a90546755236 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:19.699225 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-4c139dee-cdcd-4946-a278-407b1fff9610 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:16:19.711870 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-4c139dee-cdcd-4946-a278-407b1fff9610 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/315ce600-cbfd-4885-bc3d-5ab129d57681" status: 200 len: 1694 microversion: 2.1 time: 0.329841 Jan 15 21:16:19.712538 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3265/6522] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:16:19 2022] GET /compute/v2.1/servers/315ce600-cbfd-4885-bc3d-5ab129d57681 => generated 1694 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:16:19.770267 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-1f1d7299-9bbd-4b8c-bca4-a90546755236 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:16:19.782249 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-1f1d7299-9bbd-4b8c-bca4-a90546755236 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1518 microversion: 2.1 time: 0.212876 Jan 15 21:16:19.783039 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3258/6523] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:16:19 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1518 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:16:19.979005 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-16fd2d24-d66b-4008-96a3-297f42849da2 req-afd62159-2cf0-4065-8247-e586ad90e7f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "315ce600-cbfd-4885-bc3d-5ab129d57681", "tag": "5946fdbc-5c0f-444f-9903-f401907ec9ec"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:16:19.981261 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:16:19.981261 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:16:19.990913 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-16fd2d24-d66b-4008-96a3-297f42849da2 req-afd62159-2cf0-4065-8247-e586ad90e7f1 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:19.991362 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-16fd2d24-d66b-4008-96a3-297f42849da2 req-afd62159-2cf0-4065-8247-e586ad90e7f1 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:20.004090 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-16fd2d24-d66b-4008-96a3-297f42849da2 req-afd62159-2cf0-4065-8247-e586ad90e7f1 service nova] Creating event network-changed:5946fdbc-5c0f-444f-9903-f401907ec9ec for instance 315ce600-cbfd-4885-bc3d-5ab129d57681 on nch1-master-1 Jan 15 21:16:20.010194 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [req-16fd2d24-d66b-4008-96a3-297f42849da2 req-afd62159-2cf0-4065-8247-e586ad90e7f1 service nova] Instance 315ce600-cbfd-4885-bc3d-5ab129d57681 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=129366) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Jan 15 21:16:20.022052 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-16fd2d24-d66b-4008-96a3-297f42849da2 req-afd62159-2cf0-4065-8247-e586ad90e7f1 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046661 Jan 15 21:16:20.022980 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3266/6524] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:16:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:16:20.587212 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-166c2448-56b5-4a7d-a99a-83d0d92f69aa tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:16:20.588616 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-166c2448-56b5-4a7d-a99a-83d0d92f69aa tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] [instance: 57f7b510-e7b8-484b-9be5-468ac3063f29] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:16:20.600127 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-166c2448-56b5-4a7d-a99a-83d0d92f69aa tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:20.600595 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-166c2448-56b5-4a7d-a99a-83d0d92f69aa tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:20.601906 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-166c2448-56b5-4a7d-a99a-83d0d92f69aa tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:20.602602 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-166c2448-56b5-4a7d-a99a-83d0d92f69aa tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:20.739859 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d4087cef-e934-4997-867d-3dd520ca0d25 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:16:20.741200 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-d4087cef-e934-4997-867d-3dd520ca0d25 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: 315ce600-cbfd-4885-bc3d-5ab129d57681] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:16:20.762128 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d4087cef-e934-4997-867d-3dd520ca0d25 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:20.762832 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d4087cef-e934-4997-867d-3dd520ca0d25 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:20.766393 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d4087cef-e934-4997-867d-3dd520ca0d25 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:20.767149 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d4087cef-e934-4997-867d-3dd520ca0d25 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:20.953137 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-166c2448-56b5-4a7d-a99a-83d0d92f69aa tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0d769340dc4d36b83436c7fc78bbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de60cd8289224f1f81ef0db9ec3c6f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:16:20.979793 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-166c2448-56b5-4a7d-a99a-83d0d92f69aa tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] 10.222.0.46 "GET /compute/v2.1/servers/57f7b510-e7b8-484b-9be5-468ac3063f29" status: 200 len: 1371 microversion: 2.1 time: 0.398761 Jan 15 21:16:20.980916 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3259/6525] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:16:20 2022] GET /compute/v2.1/servers/57f7b510-e7b8-484b-9be5-468ac3063f29 => generated 1371 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:16:20.988668 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d8ae16d1-1eda-4351-9f75-3d5ab0f7f9c5 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:16:20.989886 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d8ae16d1-1eda-4351-9f75-3d5ab0f7f9c5 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:16:21.002632 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d8ae16d1-1eda-4351-9f75-3d5ab0f7f9c5 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:21.003811 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d8ae16d1-1eda-4351-9f75-3d5ab0f7f9c5 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:21.006775 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d8ae16d1-1eda-4351-9f75-3d5ab0f7f9c5 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:21.007619 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d8ae16d1-1eda-4351-9f75-3d5ab0f7f9c5 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:21.560221 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-d4087cef-e934-4997-867d-3dd520ca0d25 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:16:21.578744 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d4087cef-e934-4997-867d-3dd520ca0d25 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/315ce600-cbfd-4885-bc3d-5ab129d57681" status: 200 len: 1694 microversion: 2.1 time: 0.852839 Jan 15 21:16:21.579357 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3267/6526] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:16:20 2022] GET /compute/v2.1/servers/315ce600-cbfd-4885-bc3d-5ab129d57681 => generated 1694 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:16:21.673058 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-d8ae16d1-1eda-4351-9f75-3d5ab0f7f9c5 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:16:21.685904 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d8ae16d1-1eda-4351-9f75-3d5ab0f7f9c5 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1518 microversion: 2.1 time: 0.702908 Jan 15 21:16:21.687227 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3260/6527] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:16:20 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1518 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:16:21.997423 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-29cc189e-df5f-48d8-a0f8-223b6d34773b tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:16:21.998085 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-29cc189e-df5f-48d8-a0f8-223b6d34773b tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] [instance: 57f7b510-e7b8-484b-9be5-468ac3063f29] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:16:22.005418 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-29cc189e-df5f-48d8-a0f8-223b6d34773b tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:22.005877 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-29cc189e-df5f-48d8-a0f8-223b6d34773b tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:22.006892 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-29cc189e-df5f-48d8-a0f8-223b6d34773b tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:22.007552 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-29cc189e-df5f-48d8-a0f8-223b6d34773b tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:22.196208 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-91e7560b-e8ba-4b3e-9c6d-869bb11935a4 req-9b253ae8-2c3b-4894-befa-0091c1b7dcae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57f7b510-e7b8-484b-9be5-468ac3063f29", "tag": "84cfe8ad-5c43-40f1-89bd-977866e8ad66"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:16:22.205145 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:16:22.205145 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:16:22.226265 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-91e7560b-e8ba-4b3e-9c6d-869bb11935a4 req-9b253ae8-2c3b-4894-befa-0091c1b7dcae service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:22.226905 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-91e7560b-e8ba-4b3e-9c6d-869bb11935a4 req-9b253ae8-2c3b-4894-befa-0091c1b7dcae service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:22.246971 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-91e7560b-e8ba-4b3e-9c6d-869bb11935a4 req-9b253ae8-2c3b-4894-befa-0091c1b7dcae service nova] Creating event network-changed:84cfe8ad-5c43-40f1-89bd-977866e8ad66 for instance 57f7b510-e7b8-484b-9be5-468ac3063f29 on nch1-master-1 Jan 15 21:16:22.254439 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-91e7560b-e8ba-4b3e-9c6d-869bb11935a4 req-9b253ae8-2c3b-4894-befa-0091c1b7dcae service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061813 Jan 15 21:16:22.256003 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3261/6528] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:16:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:16:22.344174 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-29cc189e-df5f-48d8-a0f8-223b6d34773b tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0d769340dc4d36b83436c7fc78bbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de60cd8289224f1f81ef0db9ec3c6f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:16:22.363437 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-29cc189e-df5f-48d8-a0f8-223b6d34773b tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] 10.222.0.46 "GET /compute/v2.1/servers/57f7b510-e7b8-484b-9be5-468ac3063f29" status: 200 len: 1371 microversion: 2.1 time: 0.362272 Jan 15 21:16:22.365222 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3268/6529] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:16:21 2022] GET /compute/v2.1/servers/57f7b510-e7b8-484b-9be5-468ac3063f29 => generated 1371 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:16:22.605673 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-69358529-508d-4b92-a018-a2b4492e7c36 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:16:22.607343 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-69358529-508d-4b92-a018-a2b4492e7c36 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: 315ce600-cbfd-4885-bc3d-5ab129d57681] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:16:22.619705 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-69358529-508d-4b92-a018-a2b4492e7c36 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:22.620658 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-69358529-508d-4b92-a018-a2b4492e7c36 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:22.628742 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-69358529-508d-4b92-a018-a2b4492e7c36 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:22.630794 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-69358529-508d-4b92-a018-a2b4492e7c36 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:22.704061 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-2fc405cb-692f-43c0-9433-75578a21a9ab tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:16:22.705053 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-2fc405cb-692f-43c0-9433-75578a21a9ab tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:16:22.712042 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2fc405cb-692f-43c0-9433-75578a21a9ab tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:22.712491 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2fc405cb-692f-43c0-9433-75578a21a9ab tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:22.713325 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2fc405cb-692f-43c0-9433-75578a21a9ab tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:22.713761 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2fc405cb-692f-43c0-9433-75578a21a9ab tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:22.974975 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-69358529-508d-4b92-a018-a2b4492e7c36 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:16:22.990286 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-69358529-508d-4b92-a018-a2b4492e7c36 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/315ce600-cbfd-4885-bc3d-5ab129d57681" status: 200 len: 1689 microversion: 2.1 time: 0.398122 Jan 15 21:16:22.991268 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3262/6530] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:16:22 2022] GET /compute/v2.1/servers/315ce600-cbfd-4885-bc3d-5ab129d57681 => generated 1689 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:16:23.012050 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-043ea9cf-d5c5-4c2b-990a-ab3bb026a879 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:16:23.012686 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-043ea9cf-d5c5-4c2b-990a-ab3bb026a879 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: 315ce600-cbfd-4885-bc3d-5ab129d57681] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:16:23.022708 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-043ea9cf-d5c5-4c2b-990a-ab3bb026a879 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:23.023625 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-043ea9cf-d5c5-4c2b-990a-ab3bb026a879 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:23.025749 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-043ea9cf-d5c5-4c2b-990a-ab3bb026a879 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:23.026616 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-043ea9cf-d5c5-4c2b-990a-ab3bb026a879 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:23.053682 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-2fc405cb-692f-43c0-9433-75578a21a9ab tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:16:23.067931 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-2fc405cb-692f-43c0-9433-75578a21a9ab tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1505 microversion: 2.1 time: 0.368187 Jan 15 21:16:23.068516 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3269/6531] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:16:22 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1505 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:16:23.087517 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b5185715-73e2-4314-9d63-3d40793ab891 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:16:23.088234 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b5185715-73e2-4314-9d63-3d40793ab891 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:16:23.100526 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b5185715-73e2-4314-9d63-3d40793ab891 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:23.102121 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b5185715-73e2-4314-9d63-3d40793ab891 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:23.103838 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b5185715-73e2-4314-9d63-3d40793ab891 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:23.106389 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b5185715-73e2-4314-9d63-3d40793ab891 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:23.316072 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-043ea9cf-d5c5-4c2b-990a-ab3bb026a879 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "POST /compute/v2.1/servers/315ce600-cbfd-4885-bc3d-5ab129d57681/action" status: 202 len: 0 microversion: 2.1 time: 0.308733 Jan 15 21:16:23.318102 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3263/6532] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:16:23 2022] POST /compute/v2.1/servers/315ce600-cbfd-4885-bc3d-5ab129d57681/action => generated 0 bytes in 313 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:16:23.329405 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a45a13d1-9d80-476a-a4ce-06641ede1cca tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:16:23.330115 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a45a13d1-9d80-476a-a4ce-06641ede1cca tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: 315ce600-cbfd-4885-bc3d-5ab129d57681] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:16:23.339227 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a45a13d1-9d80-476a-a4ce-06641ede1cca tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:23.340319 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a45a13d1-9d80-476a-a4ce-06641ede1cca tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:23.341354 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a45a13d1-9d80-476a-a4ce-06641ede1cca tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:23.343208 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a45a13d1-9d80-476a-a4ce-06641ede1cca tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:23.371381 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-b5185715-73e2-4314-9d63-3d40793ab891 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:16:23.387183 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b5185715-73e2-4314-9d63-3d40793ab891 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1505 microversion: 2.1 time: 0.303316 Jan 15 21:16:23.388940 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3270/6533] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:16:23 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1505 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:16:23.397737 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b0e342a3-3cae-4d42-a743-e7e3bd2c9506 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:16:23.398599 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b0e342a3-3cae-4d42-a743-e7e3bd2c9506 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] [instance: 57f7b510-e7b8-484b-9be5-468ac3063f29] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:16:23.406666 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b0e342a3-3cae-4d42-a743-e7e3bd2c9506 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:23.407401 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b0e342a3-3cae-4d42-a743-e7e3bd2c9506 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:23.408370 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b0e342a3-3cae-4d42-a743-e7e3bd2c9506 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:23.409903 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b0e342a3-3cae-4d42-a743-e7e3bd2c9506 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:23.746876 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-a45a13d1-9d80-476a-a4ce-06641ede1cca tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:16:23.760022 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a45a13d1-9d80-476a-a4ce-06641ede1cca tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/315ce600-cbfd-4885-bc3d-5ab129d57681" status: 200 len: 1688 microversion: 2.1 time: 0.436558 Jan 15 21:16:23.775536 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3264/6534] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:16:23 2022] GET /compute/v2.1/servers/315ce600-cbfd-4885-bc3d-5ab129d57681 => generated 1688 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:16:23.783344 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-83fc0cd8-703b-406c-bba6-315ce190f063 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:16:23.784887 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-83fc0cd8-703b-406c-bba6-315ce190f063 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:16:23.797215 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-83fc0cd8-703b-406c-bba6-315ce190f063 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:23.797998 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-83fc0cd8-703b-406c-bba6-315ce190f063 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:23.798976 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-83fc0cd8-703b-406c-bba6-315ce190f063 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:23.799580 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-83fc0cd8-703b-406c-bba6-315ce190f063 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:23.862087 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-b0e342a3-3cae-4d42-a743-e7e3bd2c9506 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0d769340dc4d36b83436c7fc78bbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de60cd8289224f1f81ef0db9ec3c6f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:16:23.871593 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b0e342a3-3cae-4d42-a743-e7e3bd2c9506 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] 10.222.0.46 "GET /compute/v2.1/servers/57f7b510-e7b8-484b-9be5-468ac3063f29" status: 200 len: 1371 microversion: 2.1 time: 0.480785 Jan 15 21:16:23.886351 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3271/6535] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:16:23 2022] GET /compute/v2.1/servers/57f7b510-e7b8-484b-9be5-468ac3063f29 => generated 1371 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:16:24.053212 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-83fc0cd8-703b-406c-bba6-315ce190f063 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:16:24.062334 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-83fc0cd8-703b-406c-bba6-315ce190f063 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1505 microversion: 2.1 time: 0.285168 Jan 15 21:16:24.063052 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3265/6536] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:16:23 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1505 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:16:24.078884 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d74f4040-ae1d-42ac-b2af-7e0b2d4b11d5 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:16:24.085285 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-d74f4040-ae1d-42ac-b2af-7e0b2d4b11d5 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] HTTP exception thrown: Instance 4a854c73-1182-489f-99c2-623f6e7b7fbd has no mapping to a cell. Jan 15 21:16:24.085875 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d74f4040-ae1d-42ac-b2af-7e0b2d4b11d5 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Returning 404 to user: Instance 4a854c73-1182-489f-99c2-623f6e7b7fbd has no mapping to a cell. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:16:24.086708 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d74f4040-ae1d-42ac-b2af-7e0b2d4b11d5 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "POST /compute/v2.1/servers/4a854c73-1182-489f-99c2-623f6e7b7fbd/action" status: 404 len: 117 microversion: 2.1 time: 0.012051 Jan 15 21:16:24.087489 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3272/6537] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:16:24 2022] POST /compute/v2.1/servers/4a854c73-1182-489f-99c2-623f6e7b7fbd/action => generated 117 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:16:24.095779 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-0bae0c1b-c84d-4324-8bae-a2e2f0975c18 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:16:24.096509 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-0bae0c1b-c84d-4324-8bae-a2e2f0975c18 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:16:24.103335 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0bae0c1b-c84d-4324-8bae-a2e2f0975c18 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:24.104220 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0bae0c1b-c84d-4324-8bae-a2e2f0975c18 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:24.105142 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0bae0c1b-c84d-4324-8bae-a2e2f0975c18 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:24.105656 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0bae0c1b-c84d-4324-8bae-a2e2f0975c18 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:24.305746 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-0bae0c1b-c84d-4324-8bae-a2e2f0975c18 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:16:24.318725 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-0bae0c1b-c84d-4324-8bae-a2e2f0975c18 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1505 microversion: 2.1 time: 0.226451 Jan 15 21:16:24.321283 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3266/6538] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:16:24 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1505 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:16:24.343012 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-6b97aa72-98ae-4f2c-a838-626071a72c9a tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:16:24.343950 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-6b97aa72-98ae-4f2c-a838-626071a72c9a tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:16:24.352063 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6b97aa72-98ae-4f2c-a838-626071a72c9a tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:24.355096 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6b97aa72-98ae-4f2c-a838-626071a72c9a tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:24.357018 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6b97aa72-98ae-4f2c-a838-626071a72c9a tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:24.357755 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6b97aa72-98ae-4f2c-a838-626071a72c9a tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:24.568477 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-6b97aa72-98ae-4f2c-a838-626071a72c9a tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:16:24.579548 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-6b97aa72-98ae-4f2c-a838-626071a72c9a tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1505 microversion: 2.1 time: 0.241059 Jan 15 21:16:24.593504 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3273/6539] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:16:24 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1505 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:16:24.599510 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-28931be7-4496-421b-aa96-af8eb1affa3f tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:16:24.600347 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-28931be7-4496-421b-aa96-af8eb1affa3f tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: 07809cde-4777-4efc-85f0-7c901c09ac97] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:16:24.610137 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-28931be7-4496-421b-aa96-af8eb1affa3f tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] HTTP exception thrown: Instance 07809cde-4777-4efc-85f0-7c901c09ac97 could not be found. Jan 15 21:16:24.611126 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-28931be7-4496-421b-aa96-af8eb1affa3f tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Returning 404 to user: Instance 07809cde-4777-4efc-85f0-7c901c09ac97 could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:16:24.612351 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-28931be7-4496-421b-aa96-af8eb1affa3f tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "POST /compute/v2.1/servers/07809cde-4777-4efc-85f0-7c901c09ac97/action" status: 404 len: 111 microversion: 2.1 time: 0.017622 Jan 15 21:16:24.617853 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3267/6540] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:16:24 2022] POST /compute/v2.1/servers/07809cde-4777-4efc-85f0-7c901c09ac97/action => generated 111 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:16:24.621916 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-cd2431a5-0a63-4f47-b932-88f8188bb65e tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:16:24.622521 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-cd2431a5-0a63-4f47-b932-88f8188bb65e tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:16:24.631119 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cd2431a5-0a63-4f47-b932-88f8188bb65e tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:24.631479 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cd2431a5-0a63-4f47-b932-88f8188bb65e tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:24.632452 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cd2431a5-0a63-4f47-b932-88f8188bb65e tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:24.633093 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cd2431a5-0a63-4f47-b932-88f8188bb65e tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:24.784276 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c1e012bc-856c-499b-b2cf-c6abdfa2a20f tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:16:24.785490 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c1e012bc-856c-499b-b2cf-c6abdfa2a20f tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: 315ce600-cbfd-4885-bc3d-5ab129d57681] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:16:24.801100 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c1e012bc-856c-499b-b2cf-c6abdfa2a20f tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:24.802609 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c1e012bc-856c-499b-b2cf-c6abdfa2a20f tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:24.805717 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c1e012bc-856c-499b-b2cf-c6abdfa2a20f tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:24.807811 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c1e012bc-856c-499b-b2cf-c6abdfa2a20f tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:25.069029 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-cd2431a5-0a63-4f47-b932-88f8188bb65e tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:16:25.078757 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-cd2431a5-0a63-4f47-b932-88f8188bb65e tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1505 microversion: 2.1 time: 0.460485 Jan 15 21:16:25.082193 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3274/6541] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:16:24 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1505 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:16:25.103192 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-78808373-4c0c-43a5-979a-414605714937 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:16:25.107319 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-78808373-4c0c-43a5-979a-414605714937 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] [instance: 57f7b510-e7b8-484b-9be5-468ac3063f29] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:16:25.120021 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-78808373-4c0c-43a5-979a-414605714937 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:25.120401 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-78808373-4c0c-43a5-979a-414605714937 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:25.121229 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-78808373-4c0c-43a5-979a-414605714937 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:25.121665 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-78808373-4c0c-43a5-979a-414605714937 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:25.187050 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-c1e012bc-856c-499b-b2cf-c6abdfa2a20f tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:16:25.198456 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c1e012bc-856c-499b-b2cf-c6abdfa2a20f tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/315ce600-cbfd-4885-bc3d-5ab129d57681" status: 200 len: 1688 microversion: 2.1 time: 0.421158 Jan 15 21:16:25.200069 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3268/6542] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:16:24 2022] GET /compute/v2.1/servers/315ce600-cbfd-4885-bc3d-5ab129d57681 => generated 1688 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:16:25.221518 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ce06b784-5206-4926-b159-de249e385363 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:16:25.222934 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ce06b784-5206-4926-b159-de249e385363 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:16:25.231983 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ce06b784-5206-4926-b159-de249e385363 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:25.233592 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ce06b784-5206-4926-b159-de249e385363 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:25.234677 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ce06b784-5206-4926-b159-de249e385363 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:25.235728 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ce06b784-5206-4926-b159-de249e385363 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:25.603205 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-78808373-4c0c-43a5-979a-414605714937 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0d769340dc4d36b83436c7fc78bbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de60cd8289224f1f81ef0db9ec3c6f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:16:25.612224 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-78808373-4c0c-43a5-979a-414605714937 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] 10.222.0.46 "GET /compute/v2.1/servers/57f7b510-e7b8-484b-9be5-468ac3063f29" status: 200 len: 1371 microversion: 2.1 time: 0.528321 Jan 15 21:16:25.612820 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3275/6543] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:16:25 2022] GET /compute/v2.1/servers/57f7b510-e7b8-484b-9be5-468ac3063f29 => generated 1371 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:16:25.618952 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-e8cf98e5-782a-48b8-a786-6c11b5b9e998 req-b828c89f-894f-4d14-82ab-1c94114a2df0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "315ce600-cbfd-4885-bc3d-5ab129d57681", "name": "network-vif-plugged", "status": "completed", "tag": "5946fdbc-5c0f-444f-9903-f401907ec9ec"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:16:25.620542 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:16:25.620542 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:16:25.628512 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-e8cf98e5-782a-48b8-a786-6c11b5b9e998 req-b828c89f-894f-4d14-82ab-1c94114a2df0 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:25.629273 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-e8cf98e5-782a-48b8-a786-6c11b5b9e998 req-b828c89f-894f-4d14-82ab-1c94114a2df0 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:25.646121 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-e8cf98e5-782a-48b8-a786-6c11b5b9e998 req-b828c89f-894f-4d14-82ab-1c94114a2df0 service nova] Creating event network-vif-plugged:5946fdbc-5c0f-444f-9903-f401907ec9ec for instance 315ce600-cbfd-4885-bc3d-5ab129d57681 on nch1-master-1 Jan 15 21:16:25.652290 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [req-e8cf98e5-782a-48b8-a786-6c11b5b9e998 req-b828c89f-894f-4d14-82ab-1c94114a2df0 service nova] Instance 315ce600-cbfd-4885-bc3d-5ab129d57681 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=129366) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Jan 15 21:16:25.662748 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-ce06b784-5206-4926-b159-de249e385363 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:16:25.666041 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-e8cf98e5-782a-48b8-a786-6c11b5b9e998 req-b828c89f-894f-4d14-82ab-1c94114a2df0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051935 Jan 15 21:16:25.666707 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3276/6544] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:16:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:16:25.670558 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ce06b784-5206-4926-b159-de249e385363 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1505 microversion: 2.1 time: 0.455770 Jan 15 21:16:25.671360 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3269/6545] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:16:25 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1505 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:16:25.691067 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7dc7199f-fcfb-4b70-b916-af632ff207a3 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:16:25.691830 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-7dc7199f-fcfb-4b70-b916-af632ff207a3 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:16:25.698625 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7dc7199f-fcfb-4b70-b916-af632ff207a3 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:25.699453 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7dc7199f-fcfb-4b70-b916-af632ff207a3 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:25.702777 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7dc7199f-fcfb-4b70-b916-af632ff207a3 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:25.703314 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7dc7199f-fcfb-4b70-b916-af632ff207a3 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:25.730490 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.objects.instance [None req-7dc7199f-fcfb-4b70-b916-af632ff207a3 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lazy-loading 'flavor' on Instance uuid b10c8309-687a-4474-8f64-9956816741db {{(pid=129366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 21:16:25.856302 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7dc7199f-fcfb-4b70-b916-af632ff207a3 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "POST /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db/action" status: 202 len: 0 microversion: 2.1 time: 0.171065 Jan 15 21:16:25.857041 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3277/6546] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:16:25 2022] POST /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db/action => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:16:25.865424 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-07611a3d-5da3-4956-9957-8ca75a0b2a80 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:16:25.866041 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-07611a3d-5da3-4956-9957-8ca75a0b2a80 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:16:25.879097 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-07611a3d-5da3-4956-9957-8ca75a0b2a80 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:25.879569 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-07611a3d-5da3-4956-9957-8ca75a0b2a80 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:25.881718 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-07611a3d-5da3-4956-9957-8ca75a0b2a80 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:25.889007 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-07611a3d-5da3-4956-9957-8ca75a0b2a80 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:26.217851 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ead0c5d2-c902-4c62-acdd-bf4f6e11f08e tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:16:26.219612 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ead0c5d2-c902-4c62-acdd-bf4f6e11f08e tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: 315ce600-cbfd-4885-bc3d-5ab129d57681] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:16:26.226375 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ead0c5d2-c902-4c62-acdd-bf4f6e11f08e tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:26.226899 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ead0c5d2-c902-4c62-acdd-bf4f6e11f08e tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:26.227707 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ead0c5d2-c902-4c62-acdd-bf4f6e11f08e tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:26.229999 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ead0c5d2-c902-4c62-acdd-bf4f6e11f08e tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:26.733144 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-07611a3d-5da3-4956-9957-8ca75a0b2a80 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:16:26.748159 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-07611a3d-5da3-4956-9957-8ca75a0b2a80 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1513 microversion: 2.1 time: 0.883882 Jan 15 21:16:26.750851 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3270/6547] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:16:25 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1513 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:16:26.769387 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-27823009-e21c-4e2f-8c61-08fc51386e7b tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:16:26.771013 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-27823009-e21c-4e2f-8c61-08fc51386e7b tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] [instance: 57f7b510-e7b8-484b-9be5-468ac3063f29] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:16:26.779346 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-27823009-e21c-4e2f-8c61-08fc51386e7b tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:26.780073 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-27823009-e21c-4e2f-8c61-08fc51386e7b tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:26.781084 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-27823009-e21c-4e2f-8c61-08fc51386e7b tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:26.781688 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-27823009-e21c-4e2f-8c61-08fc51386e7b tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:26.792444 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-ead0c5d2-c902-4c62-acdd-bf4f6e11f08e tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:16:26.802786 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ead0c5d2-c902-4c62-acdd-bf4f6e11f08e tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/315ce600-cbfd-4885-bc3d-5ab129d57681" status: 200 len: 1688 microversion: 2.1 time: 0.590500 Jan 15 21:16:26.814517 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3278/6548] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:16:26 2022] GET /compute/v2.1/servers/315ce600-cbfd-4885-bc3d-5ab129d57681 => generated 1688 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:16:27.116000 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-27823009-e21c-4e2f-8c61-08fc51386e7b tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0d769340dc4d36b83436c7fc78bbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de60cd8289224f1f81ef0db9ec3c6f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:16:27.141176 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-27823009-e21c-4e2f-8c61-08fc51386e7b tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] 10.222.0.46 "GET /compute/v2.1/servers/57f7b510-e7b8-484b-9be5-468ac3063f29" status: 200 len: 1371 microversion: 2.1 time: 0.385816 Jan 15 21:16:27.144292 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3271/6549] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:16:26 2022] GET /compute/v2.1/servers/57f7b510-e7b8-484b-9be5-468ac3063f29 => generated 1371 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:16:27.768048 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-3c744983-8114-4aa2-a765-056a891f5dc8 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:16:27.769340 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-3c744983-8114-4aa2-a765-056a891f5dc8 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:16:27.780177 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3c744983-8114-4aa2-a765-056a891f5dc8 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:27.782655 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3c744983-8114-4aa2-a765-056a891f5dc8 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:27.783505 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3c744983-8114-4aa2-a765-056a891f5dc8 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:27.783946 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3c744983-8114-4aa2-a765-056a891f5dc8 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:27.824423 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-683500b9-1120-45ed-93d1-1c6bb05594d5 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:16:27.827498 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-683500b9-1120-45ed-93d1-1c6bb05594d5 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: 315ce600-cbfd-4885-bc3d-5ab129d57681] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:16:27.851558 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-683500b9-1120-45ed-93d1-1c6bb05594d5 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:27.855707 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-683500b9-1120-45ed-93d1-1c6bb05594d5 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:27.856749 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-683500b9-1120-45ed-93d1-1c6bb05594d5 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:27.859245 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-683500b9-1120-45ed-93d1-1c6bb05594d5 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:28.337303 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-683500b9-1120-45ed-93d1-1c6bb05594d5 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:16:28.356037 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-3c744983-8114-4aa2-a765-056a891f5dc8 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:16:28.359988 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-683500b9-1120-45ed-93d1-1c6bb05594d5 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/315ce600-cbfd-4885-bc3d-5ab129d57681" status: 200 len: 1688 microversion: 2.1 time: 0.539406 Jan 15 21:16:28.361346 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3272/6550] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:16:27 2022] GET /compute/v2.1/servers/315ce600-cbfd-4885-bc3d-5ab129d57681 => generated 1688 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:16:28.378101 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-31ae5da3-e65c-4d6d-bf0e-d61cdc353fe7 req-8ca1b441-75a6-4a27-91e3-31fb1281fc43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "315ce600-cbfd-4885-bc3d-5ab129d57681", "name": "network-vif-unplugged", "status": "completed", "tag": "5946fdbc-5c0f-444f-9903-f401907ec9ec"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:16:28.380162 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:16:28.380162 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:16:28.388225 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-3c744983-8114-4aa2-a765-056a891f5dc8 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1496 microversion: 2.1 time: 0.624364 Jan 15 21:16:28.388930 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3279/6551] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:16:27 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1496 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:16:28.393370 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-debaab6e-5d80-4e1b-b557-47c008b49152 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:16:28.393968 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-debaab6e-5d80-4e1b-b557-47c008b49152 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] [instance: 57f7b510-e7b8-484b-9be5-468ac3063f29] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:16:28.397418 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-31ae5da3-e65c-4d6d-bf0e-d61cdc353fe7 req-8ca1b441-75a6-4a27-91e3-31fb1281fc43 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:28.398015 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-31ae5da3-e65c-4d6d-bf0e-d61cdc353fe7 req-8ca1b441-75a6-4a27-91e3-31fb1281fc43 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:28.424824 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-debaab6e-5d80-4e1b-b557-47c008b49152 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:28.425439 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-debaab6e-5d80-4e1b-b557-47c008b49152 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:28.427866 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-31ae5da3-e65c-4d6d-bf0e-d61cdc353fe7 req-8ca1b441-75a6-4a27-91e3-31fb1281fc43 service nova] Creating event network-vif-unplugged:5946fdbc-5c0f-444f-9903-f401907ec9ec for instance 315ce600-cbfd-4885-bc3d-5ab129d57681 on nch2-master-1 Jan 15 21:16:28.432331 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-debaab6e-5d80-4e1b-b557-47c008b49152 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:28.440266 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-debaab6e-5d80-4e1b-b557-47c008b49152 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:28.443427 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [req-31ae5da3-e65c-4d6d-bf0e-d61cdc353fe7 req-8ca1b441-75a6-4a27-91e3-31fb1281fc43 service nova] Instance 315ce600-cbfd-4885-bc3d-5ab129d57681 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=129365) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Jan 15 21:16:28.467034 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-31ae5da3-e65c-4d6d-bf0e-d61cdc353fe7 req-8ca1b441-75a6-4a27-91e3-31fb1281fc43 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.103849 Jan 15 21:16:28.470145 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3273/6552] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:16:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:16:28.483230 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-50f77196-86bf-47c8-acfa-bb823269718a tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:16:28.483875 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-50f77196-86bf-47c8-acfa-bb823269718a tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:16:28.499479 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-50f77196-86bf-47c8-acfa-bb823269718a tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:28.500203 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-50f77196-86bf-47c8-acfa-bb823269718a tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:28.501191 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-50f77196-86bf-47c8-acfa-bb823269718a tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:28.501626 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-50f77196-86bf-47c8-acfa-bb823269718a tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:28.563590 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.objects.instance [None req-50f77196-86bf-47c8-acfa-bb823269718a tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lazy-loading 'flavor' on Instance uuid b10c8309-687a-4474-8f64-9956816741db {{(pid=129365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 21:16:28.603604 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-50f77196-86bf-47c8-acfa-bb823269718a tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] HTTP exception thrown: Cannot 'suspend' instance b10c8309-687a-4474-8f64-9956816741db while it is in vm_state suspended Jan 15 21:16:28.604322 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-50f77196-86bf-47c8-acfa-bb823269718a tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Returning 409 to user: Cannot 'suspend' instance b10c8309-687a-4474-8f64-9956816741db while it is in vm_state suspended {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:16:28.605231 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-50f77196-86bf-47c8-acfa-bb823269718a tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "POST /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db/action" status: 409 len: 148 microversion: 2.1 time: 0.133859 Jan 15 21:16:28.612051 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3274/6553] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:16:28 2022] POST /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db/action => generated 148 bytes in 141 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jan 15 21:16:28.632021 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ae9dbe28-6b93-4ae1-9bef-c759c86b0e55 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:16:28.632593 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ae9dbe28-6b93-4ae1-9bef-c759c86b0e55 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:16:28.655668 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ae9dbe28-6b93-4ae1-9bef-c759c86b0e55 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:28.657519 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ae9dbe28-6b93-4ae1-9bef-c759c86b0e55 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:28.661602 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ae9dbe28-6b93-4ae1-9bef-c759c86b0e55 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:28.664371 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ae9dbe28-6b93-4ae1-9bef-c759c86b0e55 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:28.690097 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-debaab6e-5d80-4e1b-b557-47c008b49152 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0d769340dc4d36b83436c7fc78bbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de60cd8289224f1f81ef0db9ec3c6f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:16:28.702414 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-debaab6e-5d80-4e1b-b557-47c008b49152 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] 10.222.0.46 "GET /compute/v2.1/servers/57f7b510-e7b8-484b-9be5-468ac3063f29" status: 200 len: 1371 microversion: 2.1 time: 0.311348 Jan 15 21:16:28.711971 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3280/6554] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:16:28 2022] GET /compute/v2.1/servers/57f7b510-e7b8-484b-9be5-468ac3063f29 => generated 1371 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:16:28.789344 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ae9dbe28-6b93-4ae1-9bef-c759c86b0e55 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "POST /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db/action" status: 202 len: 0 microversion: 2.1 time: 0.172381 Jan 15 21:16:28.791233 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3275/6555] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:16:28 2022] POST /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db/action => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:16:28.804000 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b89d43b7-d6bc-4765-9cbc-dcdf57602658 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:16:28.809401 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b89d43b7-d6bc-4765-9cbc-dcdf57602658 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:16:28.828276 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b89d43b7-d6bc-4765-9cbc-dcdf57602658 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:28.829098 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b89d43b7-d6bc-4765-9cbc-dcdf57602658 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:28.830058 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b89d43b7-d6bc-4765-9cbc-dcdf57602658 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:28.830655 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b89d43b7-d6bc-4765-9cbc-dcdf57602658 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:29.042340 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-b89d43b7-d6bc-4765-9cbc-dcdf57602658 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:16:29.052358 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b89d43b7-d6bc-4765-9cbc-dcdf57602658 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1502 microversion: 2.1 time: 0.255888 Jan 15 21:16:29.057637 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3281/6556] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:16:28 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1502 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:16:29.387455 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ef1e48e6-5e9e-4a19-9caa-a28646cb7660 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:16:29.387833 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ef1e48e6-5e9e-4a19-9caa-a28646cb7660 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: 315ce600-cbfd-4885-bc3d-5ab129d57681] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:16:29.394102 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ef1e48e6-5e9e-4a19-9caa-a28646cb7660 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:29.394817 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ef1e48e6-5e9e-4a19-9caa-a28646cb7660 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:29.395950 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ef1e48e6-5e9e-4a19-9caa-a28646cb7660 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:29.396569 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ef1e48e6-5e9e-4a19-9caa-a28646cb7660 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:29.598560 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-ef1e48e6-5e9e-4a19-9caa-a28646cb7660 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:16:29.607422 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ef1e48e6-5e9e-4a19-9caa-a28646cb7660 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/315ce600-cbfd-4885-bc3d-5ab129d57681" status: 200 len: 1688 microversion: 2.1 time: 0.227519 Jan 15 21:16:29.609160 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3276/6557] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:16:29 2022] GET /compute/v2.1/servers/315ce600-cbfd-4885-bc3d-5ab129d57681 => generated 1688 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:16:29.720057 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d080ee02-8ab2-49e7-8075-b2672a293472 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:16:29.720557 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-d080ee02-8ab2-49e7-8075-b2672a293472 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] [instance: 57f7b510-e7b8-484b-9be5-468ac3063f29] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:16:29.727414 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d080ee02-8ab2-49e7-8075-b2672a293472 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:29.727928 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d080ee02-8ab2-49e7-8075-b2672a293472 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:29.735340 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d080ee02-8ab2-49e7-8075-b2672a293472 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:29.735861 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d080ee02-8ab2-49e7-8075-b2672a293472 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:30.072795 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c8e6dfd9-f207-4cdf-8a1b-3157ff849717 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:16:30.074892 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c8e6dfd9-f207-4cdf-8a1b-3157ff849717 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:16:30.084289 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c8e6dfd9-f207-4cdf-8a1b-3157ff849717 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:30.085283 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c8e6dfd9-f207-4cdf-8a1b-3157ff849717 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:30.086373 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c8e6dfd9-f207-4cdf-8a1b-3157ff849717 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:30.087050 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c8e6dfd9-f207-4cdf-8a1b-3157ff849717 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:30.117106 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-d080ee02-8ab2-49e7-8075-b2672a293472 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0d769340dc4d36b83436c7fc78bbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de60cd8289224f1f81ef0db9ec3c6f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:16:30.130364 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d080ee02-8ab2-49e7-8075-b2672a293472 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] 10.222.0.46 "GET /compute/v2.1/servers/57f7b510-e7b8-484b-9be5-468ac3063f29" status: 200 len: 1371 microversion: 2.1 time: 0.414067 Jan 15 21:16:30.130970 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3282/6558] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:16:29 2022] GET /compute/v2.1/servers/57f7b510-e7b8-484b-9be5-468ac3063f29 => generated 1371 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:16:30.301466 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-c8e6dfd9-f207-4cdf-8a1b-3157ff849717 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:16:30.310292 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c8e6dfd9-f207-4cdf-8a1b-3157ff849717 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1502 microversion: 2.1 time: 0.242447 Jan 15 21:16:30.311741 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3277/6559] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:16:30 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1502 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:16:30.500872 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-f0ba3924-4571-4d8d-bd78-e5b19497f42f req-6f9c21d9-df84-4a0c-b029-25b6417d45ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "315ce600-cbfd-4885-bc3d-5ab129d57681", "tag": "5946fdbc-5c0f-444f-9903-f401907ec9ec"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:16:30.502761 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:16:30.502761 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:16:30.510535 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-f0ba3924-4571-4d8d-bd78-e5b19497f42f req-6f9c21d9-df84-4a0c-b029-25b6417d45ae service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:30.511093 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-f0ba3924-4571-4d8d-bd78-e5b19497f42f req-6f9c21d9-df84-4a0c-b029-25b6417d45ae service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:30.524996 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-f0ba3924-4571-4d8d-bd78-e5b19497f42f req-6f9c21d9-df84-4a0c-b029-25b6417d45ae service nova] Creating event network-changed:5946fdbc-5c0f-444f-9903-f401907ec9ec for instance 315ce600-cbfd-4885-bc3d-5ab129d57681 on nch2-master-1 Jan 15 21:16:30.531258 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [req-f0ba3924-4571-4d8d-bd78-e5b19497f42f req-6f9c21d9-df84-4a0c-b029-25b6417d45ae service nova] Instance 315ce600-cbfd-4885-bc3d-5ab129d57681 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=129366) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Jan 15 21:16:30.543560 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-f0ba3924-4571-4d8d-bd78-e5b19497f42f req-6f9c21d9-df84-4a0c-b029-25b6417d45ae service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048658 Jan 15 21:16:30.544262 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3283/6560] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:16:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:16:30.625843 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-7ababfea-5cf3-45a0-a7eb-6c5b2cc99c8f tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:16:30.626443 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-7ababfea-5cf3-45a0-a7eb-6c5b2cc99c8f tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: 315ce600-cbfd-4885-bc3d-5ab129d57681] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:16:30.633570 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7ababfea-5cf3-45a0-a7eb-6c5b2cc99c8f tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:30.634018 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7ababfea-5cf3-45a0-a7eb-6c5b2cc99c8f tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:30.634811 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7ababfea-5cf3-45a0-a7eb-6c5b2cc99c8f tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:30.635249 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7ababfea-5cf3-45a0-a7eb-6c5b2cc99c8f tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:30.897333 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-7ababfea-5cf3-45a0-a7eb-6c5b2cc99c8f tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:16:30.910292 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-7ababfea-5cf3-45a0-a7eb-6c5b2cc99c8f tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/315ce600-cbfd-4885-bc3d-5ab129d57681" status: 200 len: 1688 microversion: 2.1 time: 0.288044 Jan 15 21:16:30.913803 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3278/6561] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:16:30 2022] GET /compute/v2.1/servers/315ce600-cbfd-4885-bc3d-5ab129d57681 => generated 1688 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:16:31.151365 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-93d444d4-6a9c-4a40-9dfa-3138a796a8db tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:16:31.152084 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-93d444d4-6a9c-4a40-9dfa-3138a796a8db tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] [instance: 57f7b510-e7b8-484b-9be5-468ac3063f29] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:16:31.169741 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-93d444d4-6a9c-4a40-9dfa-3138a796a8db tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:31.175410 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-93d444d4-6a9c-4a40-9dfa-3138a796a8db tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:31.177305 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-93d444d4-6a9c-4a40-9dfa-3138a796a8db tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:31.177860 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-93d444d4-6a9c-4a40-9dfa-3138a796a8db tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:31.313469 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-18c807f4-a27c-4b0b-847a-3619073dcbf6 req-3a665347-1d8b-43cb-a5c5-4651daa340b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57f7b510-e7b8-484b-9be5-468ac3063f29", "name": "network-vif-plugged", "status": "completed", "tag": "84cfe8ad-5c43-40f1-89bd-977866e8ad66"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:16:31.315298 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:16:31.315298 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:16:31.344246 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-18c807f4-a27c-4b0b-847a-3619073dcbf6 req-3a665347-1d8b-43cb-a5c5-4651daa340b2 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:31.347909 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-18c807f4-a27c-4b0b-847a-3619073dcbf6 req-3a665347-1d8b-43cb-a5c5-4651daa340b2 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:31.382368 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-18c807f4-a27c-4b0b-847a-3619073dcbf6 req-3a665347-1d8b-43cb-a5c5-4651daa340b2 service nova] Creating event network-vif-plugged:84cfe8ad-5c43-40f1-89bd-977866e8ad66 for instance 57f7b510-e7b8-484b-9be5-468ac3063f29 on nch1-master-1 Jan 15 21:16:31.390456 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-18c807f4-a27c-4b0b-847a-3619073dcbf6 req-3a665347-1d8b-43cb-a5c5-4651daa340b2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084242 Jan 15 21:16:31.396124 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3279/6562] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:16:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:16:31.411272 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b5727d07-07cc-4e54-ad7e-d333723b1449 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:16:31.412585 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b5727d07-07cc-4e54-ad7e-d333723b1449 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:16:31.425427 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b5727d07-07cc-4e54-ad7e-d333723b1449 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:31.429265 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b5727d07-07cc-4e54-ad7e-d333723b1449 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:31.430421 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b5727d07-07cc-4e54-ad7e-d333723b1449 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:31.431063 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b5727d07-07cc-4e54-ad7e-d333723b1449 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:31.770734 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-93d444d4-6a9c-4a40-9dfa-3138a796a8db tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0d769340dc4d36b83436c7fc78bbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de60cd8289224f1f81ef0db9ec3c6f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:16:31.778616 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-93d444d4-6a9c-4a40-9dfa-3138a796a8db tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] 10.222.0.46 "GET /compute/v2.1/servers/57f7b510-e7b8-484b-9be5-468ac3063f29" status: 200 len: 1371 microversion: 2.1 time: 0.633840 Jan 15 21:16:31.780663 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3284/6563] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:16:31 2022] GET /compute/v2.1/servers/57f7b510-e7b8-484b-9be5-468ac3063f29 => generated 1371 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:16:31.822940 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-b5727d07-07cc-4e54-ad7e-d333723b1449 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:16:31.831462 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b5727d07-07cc-4e54-ad7e-d333723b1449 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1505 microversion: 2.1 time: 0.433703 Jan 15 21:16:31.832706 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3280/6564] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:16:31 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1505 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:16:31.851153 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-caf1960d-95c1-48ba-8608-f4390577d7ec tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:16:31.851339 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-caf1960d-95c1-48ba-8608-f4390577d7ec tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:16:31.857722 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-caf1960d-95c1-48ba-8608-f4390577d7ec tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:31.858018 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-caf1960d-95c1-48ba-8608-f4390577d7ec tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:31.858805 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-caf1960d-95c1-48ba-8608-f4390577d7ec tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:31.859235 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-caf1960d-95c1-48ba-8608-f4390577d7ec tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:31.930625 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8618f438-e07a-4202-aa80-f2dfc81b1a72 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:16:31.932452 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-8618f438-e07a-4202-aa80-f2dfc81b1a72 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: 315ce600-cbfd-4885-bc3d-5ab129d57681] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:16:31.940424 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8618f438-e07a-4202-aa80-f2dfc81b1a72 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:31.941209 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8618f438-e07a-4202-aa80-f2dfc81b1a72 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:31.942214 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8618f438-e07a-4202-aa80-f2dfc81b1a72 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:31.942834 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8618f438-e07a-4202-aa80-f2dfc81b1a72 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:32.667084 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-caf1960d-95c1-48ba-8608-f4390577d7ec tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:16:32.677079 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-8618f438-e07a-4202-aa80-f2dfc81b1a72 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:16:32.681557 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-caf1960d-95c1-48ba-8608-f4390577d7ec tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1505 microversion: 2.1 time: 0.835291 Jan 15 21:16:32.682349 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3285/6565] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:16:31 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1505 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:16:32.685624 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-8618f438-e07a-4202-aa80-f2dfc81b1a72 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/315ce600-cbfd-4885-bc3d-5ab129d57681" status: 200 len: 1688 microversion: 2.1 time: 0.758748 Jan 15 21:16:32.686284 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3281/6566] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:16:31 2022] GET /compute/v2.1/servers/315ce600-cbfd-4885-bc3d-5ab129d57681 => generated 1688 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:16:32.700306 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1a2311fd-2440-4b2d-b3c0-c4643d146c36 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:16:32.700948 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-1a2311fd-2440-4b2d-b3c0-c4643d146c36 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: 652d66d2-2b4e-414d-b727-71a5d34d4f2e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:16:32.706463 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-1a2311fd-2440-4b2d-b3c0-c4643d146c36 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] HTTP exception thrown: Instance 652d66d2-2b4e-414d-b727-71a5d34d4f2e could not be found. Jan 15 21:16:32.707049 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1a2311fd-2440-4b2d-b3c0-c4643d146c36 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Returning 404 to user: Instance 652d66d2-2b4e-414d-b727-71a5d34d4f2e could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:16:32.707868 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-1a2311fd-2440-4b2d-b3c0-c4643d146c36 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "POST /compute/v2.1/servers/652d66d2-2b4e-414d-b727-71a5d34d4f2e/action" status: 404 len: 111 microversion: 2.1 time: 0.012455 Jan 15 21:16:32.708445 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3286/6567] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:16:32 2022] POST /compute/v2.1/servers/652d66d2-2b4e-414d-b727-71a5d34d4f2e/action => generated 111 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:16:32.716685 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c2797ba5-0e34-4d9c-b077-d079f26916c8 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:16:32.717863 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c2797ba5-0e34-4d9c-b077-d079f26916c8 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:16:32.723776 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c2797ba5-0e34-4d9c-b077-d079f26916c8 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:32.724226 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c2797ba5-0e34-4d9c-b077-d079f26916c8 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:32.725262 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c2797ba5-0e34-4d9c-b077-d079f26916c8 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:32.725701 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c2797ba5-0e34-4d9c-b077-d079f26916c8 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:32.798576 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1dfeaba0-70fd-4147-ae5c-a82003c5fe9b tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:16:32.801541 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-1dfeaba0-70fd-4147-ae5c-a82003c5fe9b tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] [instance: 57f7b510-e7b8-484b-9be5-468ac3063f29] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:16:32.809740 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1dfeaba0-70fd-4147-ae5c-a82003c5fe9b tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:32.810425 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1dfeaba0-70fd-4147-ae5c-a82003c5fe9b tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:32.811645 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1dfeaba0-70fd-4147-ae5c-a82003c5fe9b tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:32.812477 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1dfeaba0-70fd-4147-ae5c-a82003c5fe9b tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:32.871874 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-c2797ba5-0e34-4d9c-b077-d079f26916c8 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:16:32.883990 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c2797ba5-0e34-4d9c-b077-d079f26916c8 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1505 microversion: 2.1 time: 0.168237 Jan 15 21:16:32.885208 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3282/6568] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:16:32 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1505 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:16:32.901430 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-da996358-a03f-45e3-b85e-13037db15113 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:16:32.902311 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-da996358-a03f-45e3-b85e-13037db15113 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:16:32.909272 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-da996358-a03f-45e3-b85e-13037db15113 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:32.909952 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-da996358-a03f-45e3-b85e-13037db15113 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:32.910935 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-da996358-a03f-45e3-b85e-13037db15113 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:32.911545 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-da996358-a03f-45e3-b85e-13037db15113 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:33.050697 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-1dfeaba0-70fd-4147-ae5c-a82003c5fe9b tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0d769340dc4d36b83436c7fc78bbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de60cd8289224f1f81ef0db9ec3c6f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:16:33.059411 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-1dfeaba0-70fd-4147-ae5c-a82003c5fe9b tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] 10.222.0.46 "GET /compute/v2.1/servers/57f7b510-e7b8-484b-9be5-468ac3063f29" status: 200 len: 1371 microversion: 2.1 time: 0.265522 Jan 15 21:16:33.060278 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3287/6569] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:16:32 2022] GET /compute/v2.1/servers/57f7b510-e7b8-484b-9be5-468ac3063f29 => generated 1371 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:16:33.103436 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-da996358-a03f-45e3-b85e-13037db15113 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:16:33.111917 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-da996358-a03f-45e3-b85e-13037db15113 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1505 microversion: 2.1 time: 0.214214 Jan 15 21:16:33.112506 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3283/6570] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:16:32 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1505 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:16:33.130257 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-446d0831-8984-4567-9ed6-95ff98226726 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:16:33.131143 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-446d0831-8984-4567-9ed6-95ff98226726 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:16:33.138086 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-446d0831-8984-4567-9ed6-95ff98226726 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:33.138532 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-446d0831-8984-4567-9ed6-95ff98226726 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:33.139414 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-446d0831-8984-4567-9ed6-95ff98226726 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:33.139848 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-446d0831-8984-4567-9ed6-95ff98226726 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:33.164244 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-446d0831-8984-4567-9ed6-95ff98226726 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] HTTP exception thrown: Cannot 'unpause' instance b10c8309-687a-4474-8f64-9956816741db while it is in vm_state active Jan 15 21:16:33.164929 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-446d0831-8984-4567-9ed6-95ff98226726 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Returning 409 to user: Cannot 'unpause' instance b10c8309-687a-4474-8f64-9956816741db while it is in vm_state active {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:16:33.165699 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-446d0831-8984-4567-9ed6-95ff98226726 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "POST /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db/action" status: 409 len: 145 microversion: 2.1 time: 0.039266 Jan 15 21:16:33.166255 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3288/6571] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:16:33 2022] POST /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db/action => generated 145 bytes in 40 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jan 15 21:16:33.175841 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-20189fe2-5ed1-4a84-9a5e-7fb12e24fbf9 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:16:33.176697 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-20189fe2-5ed1-4a84-9a5e-7fb12e24fbf9 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:16:33.183047 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-20189fe2-5ed1-4a84-9a5e-7fb12e24fbf9 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:33.183496 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-20189fe2-5ed1-4a84-9a5e-7fb12e24fbf9 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:33.184462 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-20189fe2-5ed1-4a84-9a5e-7fb12e24fbf9 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:33.184924 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-20189fe2-5ed1-4a84-9a5e-7fb12e24fbf9 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:33.334528 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-20189fe2-5ed1-4a84-9a5e-7fb12e24fbf9 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:16:33.343250 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-20189fe2-5ed1-4a84-9a5e-7fb12e24fbf9 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1505 microversion: 2.1 time: 0.171443 Jan 15 21:16:33.343942 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3284/6572] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:16:33 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1505 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:16:33.366579 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1c6f0169-8ac2-4e94-a4eb-cd4571f13dd6 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:16:33.367230 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-1c6f0169-8ac2-4e94-a4eb-cd4571f13dd6 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:16:33.376712 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1c6f0169-8ac2-4e94-a4eb-cd4571f13dd6 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:33.377261 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1c6f0169-8ac2-4e94-a4eb-cd4571f13dd6 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:33.379100 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1c6f0169-8ac2-4e94-a4eb-cd4571f13dd6 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:33.379877 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1c6f0169-8ac2-4e94-a4eb-cd4571f13dd6 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:33.538522 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-1c6f0169-8ac2-4e94-a4eb-cd4571f13dd6 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:16:33.546652 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-1c6f0169-8ac2-4e94-a4eb-cd4571f13dd6 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1505 microversion: 2.1 time: 0.189216 Jan 15 21:16:33.547236 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3289/6573] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:16:33 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1505 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:16:33.562838 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c19e02a9-7959-441b-8ffe-1945530f1da6 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:16:33.563446 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c19e02a9-7959-441b-8ffe-1945530f1da6 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: 5b8897f4-028f-43c7-99a4-5c444cfa4ed2] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:16:33.568791 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-c19e02a9-7959-441b-8ffe-1945530f1da6 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] HTTP exception thrown: Instance 5b8897f4-028f-43c7-99a4-5c444cfa4ed2 could not be found. Jan 15 21:16:33.569410 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c19e02a9-7959-441b-8ffe-1945530f1da6 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Returning 404 to user: Instance 5b8897f4-028f-43c7-99a4-5c444cfa4ed2 could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:16:33.570264 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c19e02a9-7959-441b-8ffe-1945530f1da6 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "POST /compute/v2.1/servers/5b8897f4-028f-43c7-99a4-5c444cfa4ed2/action" status: 404 len: 111 microversion: 2.1 time: 0.011451 Jan 15 21:16:33.570825 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3285/6574] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:16:33 2022] POST /compute/v2.1/servers/5b8897f4-028f-43c7-99a4-5c444cfa4ed2/action => generated 111 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 15 21:16:33.579034 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b25a3dc6-d9dd-46aa-afea-2dc0600c8b53 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:16:33.579636 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b25a3dc6-d9dd-46aa-afea-2dc0600c8b53 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:16:33.585956 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b25a3dc6-d9dd-46aa-afea-2dc0600c8b53 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:33.586404 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b25a3dc6-d9dd-46aa-afea-2dc0600c8b53 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:33.587183 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b25a3dc6-d9dd-46aa-afea-2dc0600c8b53 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:33.587762 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b25a3dc6-d9dd-46aa-afea-2dc0600c8b53 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:33.703264 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-189c3624-6f3d-40f1-bb5f-84951d785edf tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:16:33.704185 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-189c3624-6f3d-40f1-bb5f-84951d785edf tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: 315ce600-cbfd-4885-bc3d-5ab129d57681] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:16:33.713687 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-189c3624-6f3d-40f1-bb5f-84951d785edf tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:33.714173 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-189c3624-6f3d-40f1-bb5f-84951d785edf tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:33.715020 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-189c3624-6f3d-40f1-bb5f-84951d785edf tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:33.715469 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-189c3624-6f3d-40f1-bb5f-84951d785edf tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:33.734012 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-b25a3dc6-d9dd-46aa-afea-2dc0600c8b53 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:16:33.743795 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b25a3dc6-d9dd-46aa-afea-2dc0600c8b53 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1505 microversion: 2.1 time: 0.168586 Jan 15 21:16:33.744389 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3290/6575] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:16:33 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1505 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:16:33.761752 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e93c208c-a6b1-4c88-8015-4404df8b7451 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:16:33.762466 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e93c208c-a6b1-4c88-8015-4404df8b7451 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:16:33.769076 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e93c208c-a6b1-4c88-8015-4404df8b7451 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:33.769657 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e93c208c-a6b1-4c88-8015-4404df8b7451 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:33.770875 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e93c208c-a6b1-4c88-8015-4404df8b7451 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:33.771471 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e93c208c-a6b1-4c88-8015-4404df8b7451 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:33.991508 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-189c3624-6f3d-40f1-bb5f-84951d785edf tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:16:33.999756 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-189c3624-6f3d-40f1-bb5f-84951d785edf tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/315ce600-cbfd-4885-bc3d-5ab129d57681" status: 200 len: 1681 microversion: 2.1 time: 0.301543 Jan 15 21:16:34.000528 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3286/6576] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:16:33 2022] GET /compute/v2.1/servers/315ce600-cbfd-4885-bc3d-5ab129d57681 => generated 1681 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:16:34.031497 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-e93c208c-a6b1-4c88-8015-4404df8b7451 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:16:34.039407 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e93c208c-a6b1-4c88-8015-4404df8b7451 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1505 microversion: 2.1 time: 0.281396 Jan 15 21:16:34.051655 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3291/6577] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:16:33 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1505 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:16:34.056689 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2d06e5e3-6588-448e-bd9d-3ac1ef1d7632 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:16:34.057299 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-2d06e5e3-6588-448e-bd9d-3ac1ef1d7632 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:16:34.065990 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2d06e5e3-6588-448e-bd9d-3ac1ef1d7632 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:34.066649 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2d06e5e3-6588-448e-bd9d-3ac1ef1d7632 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:34.067760 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2d06e5e3-6588-448e-bd9d-3ac1ef1d7632 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:34.068366 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2d06e5e3-6588-448e-bd9d-3ac1ef1d7632 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:34.076932 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-6a9ba9c4-34a6-4b18-b885-0705abc88ca3 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:16:34.077488 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-6a9ba9c4-34a6-4b18-b885-0705abc88ca3 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] [instance: 57f7b510-e7b8-484b-9be5-468ac3063f29] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:16:34.084223 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6a9ba9c4-34a6-4b18-b885-0705abc88ca3 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:34.084680 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6a9ba9c4-34a6-4b18-b885-0705abc88ca3 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:34.085512 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6a9ba9c4-34a6-4b18-b885-0705abc88ca3 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:34.085950 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6a9ba9c4-34a6-4b18-b885-0705abc88ca3 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:34.095199 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-2d06e5e3-6588-448e-bd9d-3ac1ef1d7632 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] HTTP exception thrown: Cannot 'unshelve' instance b10c8309-687a-4474-8f64-9956816741db while it is in vm_state active Jan 15 21:16:34.096168 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2d06e5e3-6588-448e-bd9d-3ac1ef1d7632 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Returning 409 to user: Cannot 'unshelve' instance b10c8309-687a-4474-8f64-9956816741db while it is in vm_state active {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:16:34.097137 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2d06e5e3-6588-448e-bd9d-3ac1ef1d7632 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "POST /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db/action" status: 409 len: 146 microversion: 2.1 time: 0.044660 Jan 15 21:16:34.098332 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3287/6578] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:16:34 2022] POST /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db/action => generated 146 bytes in 46 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jan 15 21:16:34.112135 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-6d67b930-4477-4ded-91e4-16aedba15529 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:16:34.116915 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-6d67b930-4477-4ded-91e4-16aedba15529 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:16:34.126654 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6d67b930-4477-4ded-91e4-16aedba15529 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:34.127236 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6d67b930-4477-4ded-91e4-16aedba15529 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:34.128150 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6d67b930-4477-4ded-91e4-16aedba15529 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:34.128669 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6d67b930-4477-4ded-91e4-16aedba15529 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:34.308942 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-6a9ba9c4-34a6-4b18-b885-0705abc88ca3 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0d769340dc4d36b83436c7fc78bbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de60cd8289224f1f81ef0db9ec3c6f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:16:34.319169 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-6a9ba9c4-34a6-4b18-b885-0705abc88ca3 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] 10.222.0.46 "GET /compute/v2.1/servers/57f7b510-e7b8-484b-9be5-468ac3063f29" status: 200 len: 1544 microversion: 2.1 time: 0.245824 Jan 15 21:16:34.320265 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3292/6579] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:16:34 2022] GET /compute/v2.1/servers/57f7b510-e7b8-484b-9be5-468ac3063f29 => generated 1544 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:16:34.337918 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ac9d5098-55dc-45dc-aee1-72d757d8e3f2 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:16:34.339436 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ac9d5098-55dc-45dc-aee1-72d757d8e3f2 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] [instance: 57f7b510-e7b8-484b-9be5-468ac3063f29] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:16:34.344312 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-6d67b930-4477-4ded-91e4-16aedba15529 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:16:34.346657 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ac9d5098-55dc-45dc-aee1-72d757d8e3f2 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:34.347307 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ac9d5098-55dc-45dc-aee1-72d757d8e3f2 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:34.348275 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ac9d5098-55dc-45dc-aee1-72d757d8e3f2 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:34.349030 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ac9d5098-55dc-45dc-aee1-72d757d8e3f2 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:34.358970 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-6d67b930-4477-4ded-91e4-16aedba15529 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1505 microversion: 2.1 time: 0.252610 Jan 15 21:16:34.361367 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3288/6580] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:16:34 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1505 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:16:34.377407 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-82cbcf9f-b3a2-4ebe-8b9c-7ecda4cbf104 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:16:34.378296 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-82cbcf9f-b3a2-4ebe-8b9c-7ecda4cbf104 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:16:34.392359 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-82cbcf9f-b3a2-4ebe-8b9c-7ecda4cbf104 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:34.393063 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-82cbcf9f-b3a2-4ebe-8b9c-7ecda4cbf104 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:34.394954 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-82cbcf9f-b3a2-4ebe-8b9c-7ecda4cbf104 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:34.395560 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-82cbcf9f-b3a2-4ebe-8b9c-7ecda4cbf104 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:34.606473 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-82cbcf9f-b3a2-4ebe-8b9c-7ecda4cbf104 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:16:34.617981 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-82cbcf9f-b3a2-4ebe-8b9c-7ecda4cbf104 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1505 microversion: 2.1 time: 0.245040 Jan 15 21:16:34.620558 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3289/6581] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:16:34 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1505 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:16:34.622543 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-ac9d5098-55dc-45dc-aee1-72d757d8e3f2 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0d769340dc4d36b83436c7fc78bbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de60cd8289224f1f81ef0db9ec3c6f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:16:34.633658 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ac9d5098-55dc-45dc-aee1-72d757d8e3f2 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] 10.222.0.46 "GET /compute/v2.1/servers/57f7b510-e7b8-484b-9be5-468ac3063f29" status: 200 len: 1544 microversion: 2.1 time: 0.299968 Jan 15 21:16:34.637340 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e5e2d2f5-7e9f-479c-938f-b871f4c93d64 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2130534932_updated"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:16:34.645528 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3293/6582] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:16:34 2022] GET /compute/v2.1/servers/57f7b510-e7b8-484b-9be5-468ac3063f29 => generated 1544 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:16:34.647424 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e5e2d2f5-7e9f-479c-938f-b871f4c93d64 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: 2e74d6af-47d0-4c9a-8ac9-bdc27d49c32d] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:16:34.654925 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-e5e2d2f5-7e9f-479c-938f-b871f4c93d64 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] HTTP exception thrown: Instance 2e74d6af-47d0-4c9a-8ac9-bdc27d49c32d could not be found. Jan 15 21:16:34.655863 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e5e2d2f5-7e9f-479c-938f-b871f4c93d64 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Returning 404 to user: Instance 2e74d6af-47d0-4c9a-8ac9-bdc27d49c32d could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:16:34.657286 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e5e2d2f5-7e9f-479c-938f-b871f4c93d64 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "PUT /compute/v2.1/servers/2e74d6af-47d0-4c9a-8ac9-bdc27d49c32d" status: 404 len: 111 microversion: 2.1 time: 0.023398 Jan 15 21:16:34.658225 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3290/6583] 10.222.0.46 () {60 vars in 1255 bytes} [Sat Jan 15 21:16:34 2022] PUT /compute/v2.1/servers/2e74d6af-47d0-4c9a-8ac9-bdc27d49c32d => generated 111 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 15 21:16:34.666744 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f2f3f6ab-7107-41a8-b8a8-6201e24bc81a tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:16:34.667337 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f2f3f6ab-7107-41a8-b8a8-6201e24bc81a tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:16:34.675582 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f2f3f6ab-7107-41a8-b8a8-6201e24bc81a tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:34.676224 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f2f3f6ab-7107-41a8-b8a8-6201e24bc81a tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:34.677253 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f2f3f6ab-7107-41a8-b8a8-6201e24bc81a tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:34.677862 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f2f3f6ab-7107-41a8-b8a8-6201e24bc81a tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:34.875958 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-f2f3f6ab-7107-41a8-b8a8-6201e24bc81a tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:16:34.887999 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f2f3f6ab-7107-41a8-b8a8-6201e24bc81a tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1505 microversion: 2.1 time: 0.225003 Jan 15 21:16:34.891028 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3294/6584] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:16:34 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1505 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:16:34.906384 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d74433aa-7dc0-4306-b027-0e1f3307c14b tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:16:34.907289 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d74433aa-7dc0-4306-b027-0e1f3307c14b tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:16:34.915765 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d74433aa-7dc0-4306-b027-0e1f3307c14b tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:34.916493 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d74433aa-7dc0-4306-b027-0e1f3307c14b tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:34.917324 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d74433aa-7dc0-4306-b027-0e1f3307c14b tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:34.917925 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d74433aa-7dc0-4306-b027-0e1f3307c14b tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:35.168126 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-d74433aa-7dc0-4306-b027-0e1f3307c14b tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:16:35.177209 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d74433aa-7dc0-4306-b027-0e1f3307c14b tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1505 microversion: 2.1 time: 0.274536 Jan 15 21:16:35.178917 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3291/6585] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:16:34 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1505 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:16:35.195178 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-71a725b9-5407-418a-9d19-53261298f051 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:16:35.197393 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-71a725b9-5407-418a-9d19-53261298f051 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:16:35.198586 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-71a725b9-5407-418a-9d19-53261298f051 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "PUT /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 400 len: 619 microversion: 2.1 time: 0.007503 Jan 15 21:16:35.199641 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3295/6586] 10.222.0.46 () {60 vars in 1256 bytes} [Sat Jan 15 21:16:35 2022] PUT /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 619 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 15 21:16:35.209877 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a29ef8cc-02f6-4cce-9181-e4fcf15a77b4 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:16:35.210670 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a29ef8cc-02f6-4cce-9181-e4fcf15a77b4 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:16:35.218224 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a29ef8cc-02f6-4cce-9181-e4fcf15a77b4 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:35.219224 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a29ef8cc-02f6-4cce-9181-e4fcf15a77b4 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:35.220136 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a29ef8cc-02f6-4cce-9181-e4fcf15a77b4 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:35.220769 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a29ef8cc-02f6-4cce-9181-e4fcf15a77b4 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:35.436296 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-a29ef8cc-02f6-4cce-9181-e4fcf15a77b4 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:16:35.448307 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a29ef8cc-02f6-4cce-9181-e4fcf15a77b4 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1505 microversion: 2.1 time: 0.243849 Jan 15 21:16:35.449335 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3292/6587] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:16:35 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1505 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:16:35.470099 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-56413575-257b-4948-87a1-7f1031d7ee36 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:16:35.470826 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-56413575-257b-4948-87a1-7f1031d7ee36 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:16:35.480479 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-56413575-257b-4948-87a1-7f1031d7ee36 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:35.481497 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-56413575-257b-4948-87a1-7f1031d7ee36 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:35.485742 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-56413575-257b-4948-87a1-7f1031d7ee36 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:35.486343 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-56413575-257b-4948-87a1-7f1031d7ee36 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:35.750842 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-56413575-257b-4948-87a1-7f1031d7ee36 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:16:35.763180 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-56413575-257b-4948-87a1-7f1031d7ee36 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1505 microversion: 2.1 time: 0.298804 Jan 15 21:16:35.764622 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3296/6588] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:16:35 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1505 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:16:35.783894 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b4cca379-b8dc-4807-a164-595c347c9641 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:16:35.786561 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b4cca379-b8dc-4807-a164-595c347c9641 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:16:35.788181 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b4cca379-b8dc-4807-a164-595c347c9641 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "PUT /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 400 len: 108 microversion: 2.1 time: 0.011636 Jan 15 21:16:35.789209 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3293/6589] 10.222.0.46 () {60 vars in 1255 bytes} [Sat Jan 15 21:16:35 2022] PUT /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 108 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 15 21:16:35.798053 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-50c6f81a-9762-46ac-b8c8-879424086dfc tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:16:35.798665 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-50c6f81a-9762-46ac-b8c8-879424086dfc tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:16:35.805268 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-50c6f81a-9762-46ac-b8c8-879424086dfc tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:35.806276 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-50c6f81a-9762-46ac-b8c8-879424086dfc tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:35.807272 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-50c6f81a-9762-46ac-b8c8-879424086dfc tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:35.807704 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-50c6f81a-9762-46ac-b8c8-879424086dfc tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:36.085217 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-50c6f81a-9762-46ac-b8c8-879424086dfc tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:16:36.094192 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-50c6f81a-9762-46ac-b8c8-879424086dfc tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1505 microversion: 2.1 time: 0.300041 Jan 15 21:16:36.094707 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3297/6590] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:16:35 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1505 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:16:36.647365 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-18ad1236-3112-4919-b4c6-db48f6945805 req-9a083350-5de1-4c9a-8641-543cd4b41d6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "315ce600-cbfd-4885-bc3d-5ab129d57681", "name": "network-vif-plugged", "status": "completed", "tag": "5946fdbc-5c0f-444f-9903-f401907ec9ec"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:16:36.649564 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:16:36.649564 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:16:36.679055 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-18ad1236-3112-4919-b4c6-db48f6945805 req-9a083350-5de1-4c9a-8641-543cd4b41d6f service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:36.679437 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-18ad1236-3112-4919-b4c6-db48f6945805 req-9a083350-5de1-4c9a-8641-543cd4b41d6f service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:36.706537 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-18ad1236-3112-4919-b4c6-db48f6945805 req-9a083350-5de1-4c9a-8641-543cd4b41d6f service nova] Creating event network-vif-plugged:5946fdbc-5c0f-444f-9903-f401907ec9ec for instance 315ce600-cbfd-4885-bc3d-5ab129d57681 on nch2-master-1 Jan 15 21:16:36.722779 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-18ad1236-3112-4919-b4c6-db48f6945805 req-9a083350-5de1-4c9a-8641-543cd4b41d6f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078726 Jan 15 21:16:36.723435 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3294/6591] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:16:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:16:37.447767 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-13a9f7f0-7b7f-4398-8726-aebf994b0418 req-98d79376-c375-4c6a-852f-8a60298e1e59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57f7b510-e7b8-484b-9be5-468ac3063f29", "tag": "84cfe8ad-5c43-40f1-89bd-977866e8ad66"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:16:37.449995 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:16:37.449995 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:16:37.464307 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-13a9f7f0-7b7f-4398-8726-aebf994b0418 req-98d79376-c375-4c6a-852f-8a60298e1e59 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:37.468116 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-13a9f7f0-7b7f-4398-8726-aebf994b0418 req-98d79376-c375-4c6a-852f-8a60298e1e59 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:37.494437 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-13a9f7f0-7b7f-4398-8726-aebf994b0418 req-98d79376-c375-4c6a-852f-8a60298e1e59 service nova] Creating event network-changed:84cfe8ad-5c43-40f1-89bd-977866e8ad66 for instance 57f7b510-e7b8-484b-9be5-468ac3063f29 on nch1-master-1 Jan 15 21:16:37.505325 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-13a9f7f0-7b7f-4398-8726-aebf994b0418 req-98d79376-c375-4c6a-852f-8a60298e1e59 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060132 Jan 15 21:16:37.507441 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3298/6592] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:16:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:16:38.620213 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-629a8717-25ba-4f72-bbd7-b2c5f14b20b3 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:16:38.621279 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-629a8717-25ba-4f72-bbd7-b2c5f14b20b3 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: f816a600-ed27-4a5e-a067-b845b368384d] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:16:38.663111 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-629a8717-25ba-4f72-bbd7-b2c5f14b20b3 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:38.664665 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-629a8717-25ba-4f72-bbd7-b2c5f14b20b3 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:38.672322 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-629a8717-25ba-4f72-bbd7-b2c5f14b20b3 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:38.673073 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-629a8717-25ba-4f72-bbd7-b2c5f14b20b3 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:38.699860 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-629a8717-25ba-4f72-bbd7-b2c5f14b20b3 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] HTTP exception thrown: Instance f816a600-ed27-4a5e-a067-b845b368384d could not be found. Jan 15 21:16:38.701321 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-629a8717-25ba-4f72-bbd7-b2c5f14b20b3 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Returning 404 to user: Instance f816a600-ed27-4a5e-a067-b845b368384d could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:16:38.704430 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-629a8717-25ba-4f72-bbd7-b2c5f14b20b3 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "DELETE /compute/v2.1/servers/f816a600-ed27-4a5e-a067-b845b368384d" status: 404 len: 111 microversion: 2.1 time: 0.098782 Jan 15 21:16:38.708902 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3295/6593] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 21:16:38 2022] DELETE /compute/v2.1/servers/f816a600-ed27-4a5e-a067-b845b368384d => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:16:38.714975 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ab14285c-e69c-499d-8e27-c00f3ab50da2 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:16:38.715896 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ab14285c-e69c-499d-8e27-c00f3ab50da2 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: f816a600-ed27-4a5e-a067-b845b368384d] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:16:38.728293 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ab14285c-e69c-499d-8e27-c00f3ab50da2 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:38.730821 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ab14285c-e69c-499d-8e27-c00f3ab50da2 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:38.731904 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ab14285c-e69c-499d-8e27-c00f3ab50da2 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:38.733530 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ab14285c-e69c-499d-8e27-c00f3ab50da2 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:38.761507 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-ab14285c-e69c-499d-8e27-c00f3ab50da2 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] HTTP exception thrown: Instance f816a600-ed27-4a5e-a067-b845b368384d could not be found. Jan 15 21:16:38.762472 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ab14285c-e69c-499d-8e27-c00f3ab50da2 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Returning 404 to user: Instance f816a600-ed27-4a5e-a067-b845b368384d could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:16:38.763547 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ab14285c-e69c-499d-8e27-c00f3ab50da2 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/f816a600-ed27-4a5e-a067-b845b368384d" status: 404 len: 111 microversion: 2.1 time: 0.053535 Jan 15 21:16:38.764718 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3299/6594] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:16:38 2022] GET /compute/v2.1/servers/f816a600-ed27-4a5e-a067-b845b368384d => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 15 21:16:38.773261 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e61eac0e-4730-4519-b30b-488f5e1a25a2 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:16:38.773768 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e61eac0e-4730-4519-b30b-488f5e1a25a2 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:16:38.783175 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e61eac0e-4730-4519-b30b-488f5e1a25a2 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:38.783649 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e61eac0e-4730-4519-b30b-488f5e1a25a2 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:38.787314 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e61eac0e-4730-4519-b30b-488f5e1a25a2 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:38.788106 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e61eac0e-4730-4519-b30b-488f5e1a25a2 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:38.859367 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e61eac0e-4730-4519-b30b-488f5e1a25a2 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Going to try to terminate instance {{(pid=129365) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 21:16:38.981179 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e61eac0e-4730-4519-b30b-488f5e1a25a2 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "DELETE /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 204 len: 0 microversion: 2.1 time: 0.211888 Jan 15 21:16:38.983826 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3296/6595] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 21:16:38 2022] DELETE /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 0 bytes in 215 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 21:16:38.994778 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a4a53b17-c94a-4f0d-9e4d-5ac3e3ff5877 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:16:39.001099 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a4a53b17-c94a-4f0d-9e4d-5ac3e3ff5877 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:16:39.010643 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a4a53b17-c94a-4f0d-9e4d-5ac3e3ff5877 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:39.011314 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a4a53b17-c94a-4f0d-9e4d-5ac3e3ff5877 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:39.012292 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a4a53b17-c94a-4f0d-9e4d-5ac3e3ff5877 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:39.012960 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a4a53b17-c94a-4f0d-9e4d-5ac3e3ff5877 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:39.200303 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-a4a53b17-c94a-4f0d-9e4d-5ac3e3ff5877 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:16:39.221554 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a4a53b17-c94a-4f0d-9e4d-5ac3e3ff5877 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1511 microversion: 2.1 time: 0.229112 Jan 15 21:16:39.233188 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3300/6596] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:16:38 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1511 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:16:40.239913 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c9532d84-bf72-48d5-adb9-aab77baf8c81 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:16:40.240742 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c9532d84-bf72-48d5-adb9-aab77baf8c81 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:16:40.253320 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c9532d84-bf72-48d5-adb9-aab77baf8c81 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:40.253781 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c9532d84-bf72-48d5-adb9-aab77baf8c81 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:40.254591 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c9532d84-bf72-48d5-adb9-aab77baf8c81 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:40.255031 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c9532d84-bf72-48d5-adb9-aab77baf8c81 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:40.456103 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-c9532d84-bf72-48d5-adb9-aab77baf8c81 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:16:40.463941 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c9532d84-bf72-48d5-adb9-aab77baf8c81 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1511 microversion: 2.1 time: 0.228292 Jan 15 21:16:40.464528 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3297/6597] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:16:40 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1511 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:16:41.480805 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-887fba7f-ee8a-4095-b867-2a2ea595bb20 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:16:41.481590 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-887fba7f-ee8a-4095-b867-2a2ea595bb20 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:16:41.488116 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-887fba7f-ee8a-4095-b867-2a2ea595bb20 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:41.488782 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-887fba7f-ee8a-4095-b867-2a2ea595bb20 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:41.489898 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-887fba7f-ee8a-4095-b867-2a2ea595bb20 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:41.490511 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-887fba7f-ee8a-4095-b867-2a2ea595bb20 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:41.585626 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-887fba7f-ee8a-4095-b867-2a2ea595bb20 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b618c4cabb8e47c49e10f659fd1e1490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f293bb4f2d84755a7fd006995ae5f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:16:41.595542 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-887fba7f-ee8a-4095-b867-2a2ea595bb20 tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 200 len: 1469 microversion: 2.1 time: 0.118294 Jan 15 21:16:41.607704 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3301/6598] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:16:41 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 1469 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:16:41.627344 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-29e59868-82cd-4c23-bdbf-93979eb06f68 req-5a68796e-1064-408a-8933-77dee8b35197 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b10c8309-687a-4474-8f64-9956816741db", "name": "network-vif-deleted", "tag": "bdd3b358-3871-4d07-a30c-af2f31f8d4cf"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:16:41.629826 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:16:41.629826 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:16:41.640335 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-29e59868-82cd-4c23-bdbf-93979eb06f68 req-5a68796e-1064-408a-8933-77dee8b35197 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:41.641162 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-29e59868-82cd-4c23-bdbf-93979eb06f68 req-5a68796e-1064-408a-8933-77dee8b35197 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:41.655440 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-29e59868-82cd-4c23-bdbf-93979eb06f68 req-5a68796e-1064-408a-8933-77dee8b35197 service nova] Creating event network-vif-deleted:bdd3b358-3871-4d07-a30c-af2f31f8d4cf for instance b10c8309-687a-4474-8f64-9956816741db on nch1-master-1 Jan 15 21:16:41.661990 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-29e59868-82cd-4c23-bdbf-93979eb06f68 req-5a68796e-1064-408a-8933-77dee8b35197 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039302 Jan 15 21:16:41.663480 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3298/6599] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:16:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:16:42.614292 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-fb8f35d4-8e80-41d5-90ae-e72fe7e6855e tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:16:42.614906 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-fb8f35d4-8e80-41d5-90ae-e72fe7e6855e tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] [instance: b10c8309-687a-4474-8f64-9956816741db] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:16:42.622048 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fb8f35d4-8e80-41d5-90ae-e72fe7e6855e tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:42.625295 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fb8f35d4-8e80-41d5-90ae-e72fe7e6855e tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:42.626113 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fb8f35d4-8e80-41d5-90ae-e72fe7e6855e tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:42.626591 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fb8f35d4-8e80-41d5-90ae-e72fe7e6855e tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:42.657515 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-fb8f35d4-8e80-41d5-90ae-e72fe7e6855e tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] HTTP exception thrown: Instance b10c8309-687a-4474-8f64-9956816741db could not be found. Jan 15 21:16:42.658163 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-fb8f35d4-8e80-41d5-90ae-e72fe7e6855e tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] Returning 404 to user: Instance b10c8309-687a-4474-8f64-9956816741db could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:16:42.660305 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-fb8f35d4-8e80-41d5-90ae-e72fe7e6855e tempest-ServersNegativeTestJSON-1331787346 tempest-ServersNegativeTestJSON-1331787346-project] 10.222.0.46 "GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db" status: 404 len: 111 microversion: 2.1 time: 0.049731 Jan 15 21:16:42.661760 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3302/6600] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:16:42 2022] GET /compute/v2.1/servers/b10c8309-687a-4474-8f64-9956816741db => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:16:49.065367 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-22007d12-d0fb-480a-92d2-07060aa2bbfe tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-1266186125", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "networks": [{"uuid": "9d9e7434-2bab-4826-a01a-df969a0e0685"}]}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:16:49.127000 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.network.neutron [None req-22007d12-d0fb-480a-92d2-07060aa2bbfe tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] validate_networks() for [('9d9e7434-2bab-4826-a01a-df969a0e0685', None, None, None, None, None)] {{(pid=129365) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 21:16:49.701821 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-22007d12-d0fb-480a-92d2-07060aa2bbfe tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] Flavor limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 21:16:49.702257 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-22007d12-d0fb-480a-92d2-07060aa2bbfe tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] Image limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 21:16:49.702927 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-22007d12-d0fb-480a-92d2-07060aa2bbfe tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] Flavor pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 21:16:49.703353 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-22007d12-d0fb-480a-92d2-07060aa2bbfe tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] Image pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 21:16:49.703777 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-22007d12-d0fb-480a-92d2-07060aa2bbfe tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 21:16:49.716170 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-22007d12-d0fb-480a-92d2-07060aa2bbfe tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:49.716867 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-22007d12-d0fb-480a-92d2-07060aa2bbfe tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:49.717999 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-22007d12-d0fb-480a-92d2-07060aa2bbfe tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:49.718553 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-22007d12-d0fb-480a-92d2-07060aa2bbfe tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:49.742069 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-22007d12-d0fb-480a-92d2-07060aa2bbfe tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] Getting quotas for project 63e26c2f40334b0e8558e39716312ee9. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:16:49.749538 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-22007d12-d0fb-480a-92d2-07060aa2bbfe tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] Getting quotas for user 689d9fefdfa84f18bf46810b32608130 and project 63e26c2f40334b0e8558e39716312ee9. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:16:49.765260 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-22007d12-d0fb-480a-92d2-07060aa2bbfe tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] Going to run 1 instances... {{(pid=129365) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 21:16:49.768400 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-22007d12-d0fb-480a-92d2-07060aa2bbfe tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] [instance: c54ca28b-b0d1-44e7-b74f-d3a73e81ca2c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129365) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 21:16:49.830407 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-22007d12-d0fb-480a-92d2-07060aa2bbfe tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.929053 Jan 15 21:16:49.836459 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3299/6601] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 21:16:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 936 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 21:16:49.841441 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-76558a37-8eba-4ed5-80e6-53db157cb01c tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:16:49.842835 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-76558a37-8eba-4ed5-80e6-53db157cb01c tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] [instance: c54ca28b-b0d1-44e7-b74f-d3a73e81ca2c] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:16:49.945970 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-76558a37-8eba-4ed5-80e6-53db157cb01c tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689d9fefdfa84f18bf46810b32608130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63e26c2f40334b0e8558e39716312ee9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:16:49.960142 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-76558a37-8eba-4ed5-80e6-53db157cb01c tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] 10.222.0.46 "GET /compute/v2.1/servers/c54ca28b-b0d1-44e7-b74f-d3a73e81ca2c" status: 200 len: 1228 microversion: 2.1 time: 0.121962 Jan 15 21:16:49.962651 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3303/6602] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:16:49 2022] GET /compute/v2.1/servers/c54ca28b-b0d1-44e7-b74f-d3a73e81ca2c => generated 1228 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:16:50.980158 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b7ed58c2-860a-43c6-b404-af4c8adf03d9 tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:16:50.980766 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b7ed58c2-860a-43c6-b404-af4c8adf03d9 tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] [instance: c54ca28b-b0d1-44e7-b74f-d3a73e81ca2c] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:16:50.990176 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b7ed58c2-860a-43c6-b404-af4c8adf03d9 tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:50.991021 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b7ed58c2-860a-43c6-b404-af4c8adf03d9 tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:50.992051 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b7ed58c2-860a-43c6-b404-af4c8adf03d9 tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:50.992711 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b7ed58c2-860a-43c6-b404-af4c8adf03d9 tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:51.102986 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-b7ed58c2-860a-43c6-b404-af4c8adf03d9 tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689d9fefdfa84f18bf46810b32608130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63e26c2f40334b0e8558e39716312ee9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:16:51.123358 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b7ed58c2-860a-43c6-b404-af4c8adf03d9 tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] 10.222.0.46 "GET /compute/v2.1/servers/c54ca28b-b0d1-44e7-b74f-d3a73e81ca2c" status: 200 len: 1280 microversion: 2.1 time: 0.148109 Jan 15 21:16:51.131228 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3300/6603] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:16:50 2022] GET /compute/v2.1/servers/c54ca28b-b0d1-44e7-b74f-d3a73e81ca2c => generated 1280 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:16:52.140297 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-63a6cf90-c8a1-47f7-8124-1b25707a5f3e tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:16:52.141650 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-63a6cf90-c8a1-47f7-8124-1b25707a5f3e tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] [instance: c54ca28b-b0d1-44e7-b74f-d3a73e81ca2c] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:16:52.160284 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-63a6cf90-c8a1-47f7-8124-1b25707a5f3e tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:52.161132 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-63a6cf90-c8a1-47f7-8124-1b25707a5f3e tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:52.165682 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-63a6cf90-c8a1-47f7-8124-1b25707a5f3e tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:52.166511 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-63a6cf90-c8a1-47f7-8124-1b25707a5f3e tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:52.811205 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-4df0d858-67c1-44cc-8bfb-dc13c26ef1ee req-5bf6ee8a-bd06-4d2a-98f4-a93e4e72df09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c54ca28b-b0d1-44e7-b74f-d3a73e81ca2c", "tag": "4669d801-5157-4dfa-936f-528903a4a350"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:16:52.822686 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:16:52.822686 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:16:52.848362 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-4df0d858-67c1-44cc-8bfb-dc13c26ef1ee req-5bf6ee8a-bd06-4d2a-98f4-a93e4e72df09 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:52.848810 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-4df0d858-67c1-44cc-8bfb-dc13c26ef1ee req-5bf6ee8a-bd06-4d2a-98f4-a93e4e72df09 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:52.874904 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-4df0d858-67c1-44cc-8bfb-dc13c26ef1ee req-5bf6ee8a-bd06-4d2a-98f4-a93e4e72df09 service nova] Creating event network-changed:4669d801-5157-4dfa-936f-528903a4a350 for instance c54ca28b-b0d1-44e7-b74f-d3a73e81ca2c on nch1-master-1 Jan 15 21:16:52.889826 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-4df0d858-67c1-44cc-8bfb-dc13c26ef1ee req-5bf6ee8a-bd06-4d2a-98f4-a93e4e72df09 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109480 Jan 15 21:16:52.890605 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3301/6604] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:16:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:16:52.935293 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-63a6cf90-c8a1-47f7-8124-1b25707a5f3e tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689d9fefdfa84f18bf46810b32608130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63e26c2f40334b0e8558e39716312ee9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:16:52.951881 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-63a6cf90-c8a1-47f7-8124-1b25707a5f3e tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] 10.222.0.46 "GET /compute/v2.1/servers/c54ca28b-b0d1-44e7-b74f-d3a73e81ca2c" status: 200 len: 1328 microversion: 2.1 time: 0.808841 Jan 15 21:16:52.953252 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3304/6605] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:16:52 2022] GET /compute/v2.1/servers/c54ca28b-b0d1-44e7-b74f-d3a73e81ca2c => generated 1328 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:16:53.972334 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f3b27e73-4f8f-4677-bbfd-1555d225ebcd tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:16:53.973635 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f3b27e73-4f8f-4677-bbfd-1555d225ebcd tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] [instance: c54ca28b-b0d1-44e7-b74f-d3a73e81ca2c] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:16:53.979943 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f3b27e73-4f8f-4677-bbfd-1555d225ebcd tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:53.980389 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f3b27e73-4f8f-4677-bbfd-1555d225ebcd tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:53.981216 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f3b27e73-4f8f-4677-bbfd-1555d225ebcd tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:53.982732 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f3b27e73-4f8f-4677-bbfd-1555d225ebcd tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:54.230701 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-f3b27e73-4f8f-4677-bbfd-1555d225ebcd tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689d9fefdfa84f18bf46810b32608130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63e26c2f40334b0e8558e39716312ee9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:16:54.241977 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f3b27e73-4f8f-4677-bbfd-1555d225ebcd tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] 10.222.0.46 "GET /compute/v2.1/servers/c54ca28b-b0d1-44e7-b74f-d3a73e81ca2c" status: 200 len: 1328 microversion: 2.1 time: 0.274518 Jan 15 21:16:54.242574 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3302/6606] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:16:53 2022] GET /compute/v2.1/servers/c54ca28b-b0d1-44e7-b74f-d3a73e81ca2c => generated 1328 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:16:55.259052 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-059cdd0b-d48a-4a5e-bacb-53969075c6e0 tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:16:55.260214 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-059cdd0b-d48a-4a5e-bacb-53969075c6e0 tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] [instance: c54ca28b-b0d1-44e7-b74f-d3a73e81ca2c] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:16:55.268151 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-059cdd0b-d48a-4a5e-bacb-53969075c6e0 tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:55.268605 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-059cdd0b-d48a-4a5e-bacb-53969075c6e0 tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:55.269438 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-059cdd0b-d48a-4a5e-bacb-53969075c6e0 tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:55.269880 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-059cdd0b-d48a-4a5e-bacb-53969075c6e0 tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:55.440860 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-059cdd0b-d48a-4a5e-bacb-53969075c6e0 tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689d9fefdfa84f18bf46810b32608130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63e26c2f40334b0e8558e39716312ee9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:16:55.449418 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-059cdd0b-d48a-4a5e-bacb-53969075c6e0 tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] 10.222.0.46 "GET /compute/v2.1/servers/c54ca28b-b0d1-44e7-b74f-d3a73e81ca2c" status: 200 len: 1328 microversion: 2.1 time: 0.194019 Jan 15 21:16:55.450277 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3305/6607] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:16:55 2022] GET /compute/v2.1/servers/c54ca28b-b0d1-44e7-b74f-d3a73e81ca2c => generated 1328 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:16:56.466764 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-82d45b3e-46e6-4a73-b260-ddab4b2c7b89 tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:16:56.467388 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-82d45b3e-46e6-4a73-b260-ddab4b2c7b89 tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] [instance: c54ca28b-b0d1-44e7-b74f-d3a73e81ca2c] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:16:56.474312 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-82d45b3e-46e6-4a73-b260-ddab4b2c7b89 tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:56.474768 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-82d45b3e-46e6-4a73-b260-ddab4b2c7b89 tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:56.475738 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-82d45b3e-46e6-4a73-b260-ddab4b2c7b89 tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:56.476186 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-82d45b3e-46e6-4a73-b260-ddab4b2c7b89 tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:56.704477 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-82d45b3e-46e6-4a73-b260-ddab4b2c7b89 tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689d9fefdfa84f18bf46810b32608130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63e26c2f40334b0e8558e39716312ee9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:16:56.721040 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-82d45b3e-46e6-4a73-b260-ddab4b2c7b89 tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] 10.222.0.46 "GET /compute/v2.1/servers/c54ca28b-b0d1-44e7-b74f-d3a73e81ca2c" status: 200 len: 1328 microversion: 2.1 time: 0.258091 Jan 15 21:16:56.731102 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3303/6608] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:16:56 2022] GET /compute/v2.1/servers/c54ca28b-b0d1-44e7-b74f-d3a73e81ca2c => generated 1328 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:16:57.221057 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-5aef6ce5-ee30-4c1a-922d-65155050e7dd req-af66b23f-ad3f-4ba9-9efd-623f84065dcf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c54ca28b-b0d1-44e7-b74f-d3a73e81ca2c", "name": "network-vif-plugged", "status": "completed", "tag": "4669d801-5157-4dfa-936f-528903a4a350"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:16:57.223739 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:16:57.223739 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:16:57.237239 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-5aef6ce5-ee30-4c1a-922d-65155050e7dd req-af66b23f-ad3f-4ba9-9efd-623f84065dcf service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:57.237705 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-5aef6ce5-ee30-4c1a-922d-65155050e7dd req-af66b23f-ad3f-4ba9-9efd-623f84065dcf service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:57.249594 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-5aef6ce5-ee30-4c1a-922d-65155050e7dd req-af66b23f-ad3f-4ba9-9efd-623f84065dcf service nova] Creating event network-vif-plugged:4669d801-5157-4dfa-936f-528903a4a350 for instance c54ca28b-b0d1-44e7-b74f-d3a73e81ca2c on nch1-master-1 Jan 15 21:16:57.254679 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-5aef6ce5-ee30-4c1a-922d-65155050e7dd req-af66b23f-ad3f-4ba9-9efd-623f84065dcf service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038431 Jan 15 21:16:57.255443 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3306/6609] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:16:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:16:57.738813 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3c3a6476-0b4b-4810-a6e7-0010a10c9704 tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:16:57.740156 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-3c3a6476-0b4b-4810-a6e7-0010a10c9704 tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] [instance: c54ca28b-b0d1-44e7-b74f-d3a73e81ca2c] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:16:57.748888 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3c3a6476-0b4b-4810-a6e7-0010a10c9704 tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:57.749461 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3c3a6476-0b4b-4810-a6e7-0010a10c9704 tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:57.750518 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3c3a6476-0b4b-4810-a6e7-0010a10c9704 tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:57.751037 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3c3a6476-0b4b-4810-a6e7-0010a10c9704 tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:57.909855 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-3c3a6476-0b4b-4810-a6e7-0010a10c9704 tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689d9fefdfa84f18bf46810b32608130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63e26c2f40334b0e8558e39716312ee9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:16:57.919964 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3c3a6476-0b4b-4810-a6e7-0010a10c9704 tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] 10.222.0.46 "GET /compute/v2.1/servers/c54ca28b-b0d1-44e7-b74f-d3a73e81ca2c" status: 200 len: 1328 microversion: 2.1 time: 0.184819 Jan 15 21:16:57.923431 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3304/6610] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:16:57 2022] GET /compute/v2.1/servers/c54ca28b-b0d1-44e7-b74f-d3a73e81ca2c => generated 1328 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:16:58.941499 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7c11d89d-451a-4444-b9f1-5026d013f078 tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:16:58.942198 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-7c11d89d-451a-4444-b9f1-5026d013f078 tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] [instance: c54ca28b-b0d1-44e7-b74f-d3a73e81ca2c] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:16:58.948644 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7c11d89d-451a-4444-b9f1-5026d013f078 tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:58.949146 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7c11d89d-451a-4444-b9f1-5026d013f078 tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:58.950729 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7c11d89d-451a-4444-b9f1-5026d013f078 tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:58.951722 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7c11d89d-451a-4444-b9f1-5026d013f078 tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:58.986311 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-bfa6544f-84ed-41b2-abd4-cb8362c52410 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:16:58.987345 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-bfa6544f-84ed-41b2-abd4-cb8362c52410 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] [instance: 57f7b510-e7b8-484b-9be5-468ac3063f29] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:16:58.994729 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bfa6544f-84ed-41b2-abd4-cb8362c52410 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:58.995189 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bfa6544f-84ed-41b2-abd4-cb8362c52410 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:58.996127 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bfa6544f-84ed-41b2-abd4-cb8362c52410 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:58.996592 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bfa6544f-84ed-41b2-abd4-cb8362c52410 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:59.048746 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-bfa6544f-84ed-41b2-abd4-cb8362c52410 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] 10.222.0.46 "POST /compute/v2.1/servers/57f7b510-e7b8-484b-9be5-468ac3063f29/action" status: 200 len: 24572 microversion: 2.1 time: 0.066089 Jan 15 21:16:59.049445 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3305/6611] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:16:58 2022] POST /compute/v2.1/servers/57f7b510-e7b8-484b-9be5-468ac3063f29/action => generated 24572 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:16:59.095128 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-7c11d89d-451a-4444-b9f1-5026d013f078 tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689d9fefdfa84f18bf46810b32608130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63e26c2f40334b0e8558e39716312ee9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:16:59.102514 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7c11d89d-451a-4444-b9f1-5026d013f078 tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] 10.222.0.46 "GET /compute/v2.1/servers/c54ca28b-b0d1-44e7-b74f-d3a73e81ca2c" status: 200 len: 1529 microversion: 2.1 time: 0.166024 Jan 15 21:16:59.103902 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3307/6612] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:16:58 2022] GET /compute/v2.1/servers/c54ca28b-b0d1-44e7-b74f-d3a73e81ca2c => generated 1529 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:16:59.119262 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-cd09c84a-ba5b-4bb4-a562-200caf1c1a00 tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:16:59.119911 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-cd09c84a-ba5b-4bb4-a562-200caf1c1a00 tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] [instance: c54ca28b-b0d1-44e7-b74f-d3a73e81ca2c] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:16:59.127761 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cd09c84a-ba5b-4bb4-a562-200caf1c1a00 tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:59.128222 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cd09c84a-ba5b-4bb4-a562-200caf1c1a00 tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:59.129049 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cd09c84a-ba5b-4bb4-a562-200caf1c1a00 tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:59.129498 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cd09c84a-ba5b-4bb4-a562-200caf1c1a00 tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:59.266857 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-cd09c84a-ba5b-4bb4-a562-200caf1c1a00 tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689d9fefdfa84f18bf46810b32608130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63e26c2f40334b0e8558e39716312ee9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:16:59.274484 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-cd09c84a-ba5b-4bb4-a562-200caf1c1a00 tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] 10.222.0.46 "GET /compute/v2.1/servers/c54ca28b-b0d1-44e7-b74f-d3a73e81ca2c" status: 200 len: 1529 microversion: 2.1 time: 0.159360 Jan 15 21:16:59.275068 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3306/6613] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:16:59 2022] GET /compute/v2.1/servers/c54ca28b-b0d1-44e7-b74f-d3a73e81ca2c => generated 1529 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:16:59.348647 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8db355e9-c267-43e7-83fd-a87216ffa6f5 tempest-ServersNegativeTestMultiTenantJSON-1761235612 tempest-ServersNegativeTestMultiTenantJSON-1761235612-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:16:59.349266 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-8db355e9-c267-43e7-83fd-a87216ffa6f5 tempest-ServersNegativeTestMultiTenantJSON-1761235612 tempest-ServersNegativeTestMultiTenantJSON-1761235612-project] [instance: c54ca28b-b0d1-44e7-b74f-d3a73e81ca2c] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:16:59.356944 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8db355e9-c267-43e7-83fd-a87216ffa6f5 tempest-ServersNegativeTestMultiTenantJSON-1761235612 tempest-ServersNegativeTestMultiTenantJSON-1761235612-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:59.357618 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8db355e9-c267-43e7-83fd-a87216ffa6f5 tempest-ServersNegativeTestMultiTenantJSON-1761235612 tempest-ServersNegativeTestMultiTenantJSON-1761235612-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:59.358522 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8db355e9-c267-43e7-83fd-a87216ffa6f5 tempest-ServersNegativeTestMultiTenantJSON-1761235612 tempest-ServersNegativeTestMultiTenantJSON-1761235612-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:59.358956 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8db355e9-c267-43e7-83fd-a87216ffa6f5 tempest-ServersNegativeTestMultiTenantJSON-1761235612 tempest-ServersNegativeTestMultiTenantJSON-1761235612-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:59.374838 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-8db355e9-c267-43e7-83fd-a87216ffa6f5 tempest-ServersNegativeTestMultiTenantJSON-1761235612 tempest-ServersNegativeTestMultiTenantJSON-1761235612-project] HTTP exception thrown: Instance c54ca28b-b0d1-44e7-b74f-d3a73e81ca2c could not be found. Jan 15 21:16:59.375445 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8db355e9-c267-43e7-83fd-a87216ffa6f5 tempest-ServersNegativeTestMultiTenantJSON-1761235612 tempest-ServersNegativeTestMultiTenantJSON-1761235612-project] Returning 404 to user: Instance c54ca28b-b0d1-44e7-b74f-d3a73e81ca2c could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:16:59.376286 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-8db355e9-c267-43e7-83fd-a87216ffa6f5 tempest-ServersNegativeTestMultiTenantJSON-1761235612 tempest-ServersNegativeTestMultiTenantJSON-1761235612-project] 10.222.0.46 "DELETE /compute/v2.1/servers/c54ca28b-b0d1-44e7-b74f-d3a73e81ca2c" status: 404 len: 111 microversion: 2.1 time: 0.089280 Jan 15 21:16:59.376879 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3308/6614] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 21:16:59 2022] DELETE /compute/v2.1/servers/c54ca28b-b0d1-44e7-b74f-d3a73e81ca2c => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:16:59.398216 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-cc19b058-b1d5-439a-940f-dc901c94a767 tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:16:59.398909 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-cc19b058-b1d5-439a-940f-dc901c94a767 tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] [instance: c54ca28b-b0d1-44e7-b74f-d3a73e81ca2c] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:16:59.406512 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cc19b058-b1d5-439a-940f-dc901c94a767 tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:59.406966 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cc19b058-b1d5-439a-940f-dc901c94a767 tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:59.407956 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cc19b058-b1d5-439a-940f-dc901c94a767 tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:59.408540 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cc19b058-b1d5-439a-940f-dc901c94a767 tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:59.572070 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-cc19b058-b1d5-439a-940f-dc901c94a767 tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689d9fefdfa84f18bf46810b32608130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63e26c2f40334b0e8558e39716312ee9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:16:59.580624 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-cc19b058-b1d5-439a-940f-dc901c94a767 tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] 10.222.0.46 "GET /compute/v2.1/servers/c54ca28b-b0d1-44e7-b74f-d3a73e81ca2c" status: 200 len: 1529 microversion: 2.1 time: 0.198183 Jan 15 21:16:59.581486 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3307/6615] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:16:59 2022] GET /compute/v2.1/servers/c54ca28b-b0d1-44e7-b74f-d3a73e81ca2c => generated 1529 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:16:59.597846 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-208ff0e3-ba47-420a-8434-fe1f0353b2b4 tempest-ServersNegativeTestMultiTenantJSON-1761235612 tempest-ServersNegativeTestMultiTenantJSON-1761235612-project] Action: 'update', calling method: >, body: {"server": {"name": "c54ca28b-b0d1-44e7-b74f-d3a73e81ca2c_new"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:16:59.599154 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-208ff0e3-ba47-420a-8434-fe1f0353b2b4 tempest-ServersNegativeTestMultiTenantJSON-1761235612 tempest-ServersNegativeTestMultiTenantJSON-1761235612-project] [instance: c54ca28b-b0d1-44e7-b74f-d3a73e81ca2c] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:16:59.605179 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-208ff0e3-ba47-420a-8434-fe1f0353b2b4 tempest-ServersNegativeTestMultiTenantJSON-1761235612 tempest-ServersNegativeTestMultiTenantJSON-1761235612-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:59.605633 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-208ff0e3-ba47-420a-8434-fe1f0353b2b4 tempest-ServersNegativeTestMultiTenantJSON-1761235612 tempest-ServersNegativeTestMultiTenantJSON-1761235612-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:59.607157 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-208ff0e3-ba47-420a-8434-fe1f0353b2b4 tempest-ServersNegativeTestMultiTenantJSON-1761235612 tempest-ServersNegativeTestMultiTenantJSON-1761235612-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:59.607613 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-208ff0e3-ba47-420a-8434-fe1f0353b2b4 tempest-ServersNegativeTestMultiTenantJSON-1761235612 tempest-ServersNegativeTestMultiTenantJSON-1761235612-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:59.624687 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-208ff0e3-ba47-420a-8434-fe1f0353b2b4 tempest-ServersNegativeTestMultiTenantJSON-1761235612 tempest-ServersNegativeTestMultiTenantJSON-1761235612-project] HTTP exception thrown: Instance c54ca28b-b0d1-44e7-b74f-d3a73e81ca2c could not be found. Jan 15 21:16:59.625308 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-208ff0e3-ba47-420a-8434-fe1f0353b2b4 tempest-ServersNegativeTestMultiTenantJSON-1761235612 tempest-ServersNegativeTestMultiTenantJSON-1761235612-project] Returning 404 to user: Instance c54ca28b-b0d1-44e7-b74f-d3a73e81ca2c could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:16:59.626136 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-208ff0e3-ba47-420a-8434-fe1f0353b2b4 tempest-ServersNegativeTestMultiTenantJSON-1761235612 tempest-ServersNegativeTestMultiTenantJSON-1761235612-project] 10.222.0.46 "PUT /compute/v2.1/servers/c54ca28b-b0d1-44e7-b74f-d3a73e81ca2c" status: 404 len: 111 microversion: 2.1 time: 0.032173 Jan 15 21:16:59.626698 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3309/6616] 10.222.0.46 () {60 vars in 1255 bytes} [Sat Jan 15 21:16:59 2022] PUT /compute/v2.1/servers/c54ca28b-b0d1-44e7-b74f-d3a73e81ca2c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:16:59.635174 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2feace58-6d2f-44ca-9bbb-b56013a4ec44 tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:16:59.635673 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-2feace58-6d2f-44ca-9bbb-b56013a4ec44 tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] [instance: c54ca28b-b0d1-44e7-b74f-d3a73e81ca2c] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:16:59.642783 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2feace58-6d2f-44ca-9bbb-b56013a4ec44 tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:59.643242 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2feace58-6d2f-44ca-9bbb-b56013a4ec44 tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:59.644056 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2feace58-6d2f-44ca-9bbb-b56013a4ec44 tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:59.644498 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2feace58-6d2f-44ca-9bbb-b56013a4ec44 tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:59.670429 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-2feace58-6d2f-44ca-9bbb-b56013a4ec44 tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] [instance: c54ca28b-b0d1-44e7-b74f-d3a73e81ca2c] Going to try to terminate instance {{(pid=129365) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 21:16:59.753036 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2feace58-6d2f-44ca-9bbb-b56013a4ec44 tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] 10.222.0.46 "DELETE /compute/v2.1/servers/c54ca28b-b0d1-44e7-b74f-d3a73e81ca2c" status: 204 len: 0 microversion: 2.1 time: 0.121213 Jan 15 21:16:59.753640 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3308/6617] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 21:16:59 2022] DELETE /compute/v2.1/servers/c54ca28b-b0d1-44e7-b74f-d3a73e81ca2c => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 21:16:59.761694 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-00151ca1-bd62-4252-b450-16a8e6b5b1d1 tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:16:59.762301 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-00151ca1-bd62-4252-b450-16a8e6b5b1d1 tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] [instance: c54ca28b-b0d1-44e7-b74f-d3a73e81ca2c] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:16:59.769543 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-00151ca1-bd62-4252-b450-16a8e6b5b1d1 tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:59.769996 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-00151ca1-bd62-4252-b450-16a8e6b5b1d1 tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:59.770773 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-00151ca1-bd62-4252-b450-16a8e6b5b1d1 tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:16:59.771208 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-00151ca1-bd62-4252-b450-16a8e6b5b1d1 tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:16:59.920090 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-00151ca1-bd62-4252-b450-16a8e6b5b1d1 tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689d9fefdfa84f18bf46810b32608130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63e26c2f40334b0e8558e39716312ee9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:16:59.927764 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-00151ca1-bd62-4252-b450-16a8e6b5b1d1 tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] 10.222.0.46 "GET /compute/v2.1/servers/c54ca28b-b0d1-44e7-b74f-d3a73e81ca2c" status: 200 len: 1535 microversion: 2.1 time: 0.169699 Jan 15 21:16:59.928359 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3310/6618] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:16:59 2022] GET /compute/v2.1/servers/c54ca28b-b0d1-44e7-b74f-d3a73e81ca2c => generated 1535 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:17:00.244961 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-0055bdc1-acf7-485f-ab7d-823dff14ac39 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:17:00.246119 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-0055bdc1-acf7-485f-ab7d-823dff14ac39 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: 315ce600-cbfd-4885-bc3d-5ab129d57681] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:17:00.254214 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0055bdc1-acf7-485f-ab7d-823dff14ac39 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:17:00.254695 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0055bdc1-acf7-485f-ab7d-823dff14ac39 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:17:00.255499 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0055bdc1-acf7-485f-ab7d-823dff14ac39 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:17:00.255932 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0055bdc1-acf7-485f-ab7d-823dff14ac39 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:17:00.319015 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-0055bdc1-acf7-485f-ab7d-823dff14ac39 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "POST /compute/v2.1/servers/315ce600-cbfd-4885-bc3d-5ab129d57681/action" status: 200 len: 63168 microversion: 2.1 time: 0.078325 Jan 15 21:17:00.320722 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3309/6619] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:17:00 2022] POST /compute/v2.1/servers/315ce600-cbfd-4885-bc3d-5ab129d57681/action => generated 63168 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 21:17:00.945538 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-35938aa5-8056-4bae-b939-e30845700bd2 tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:17:00.946503 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-35938aa5-8056-4bae-b939-e30845700bd2 tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] [instance: c54ca28b-b0d1-44e7-b74f-d3a73e81ca2c] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:17:00.953755 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-35938aa5-8056-4bae-b939-e30845700bd2 tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:17:00.954197 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-35938aa5-8056-4bae-b939-e30845700bd2 tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:17:00.955149 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-35938aa5-8056-4bae-b939-e30845700bd2 tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:17:00.955731 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-35938aa5-8056-4bae-b939-e30845700bd2 tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:17:01.103324 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-35938aa5-8056-4bae-b939-e30845700bd2 tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689d9fefdfa84f18bf46810b32608130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63e26c2f40334b0e8558e39716312ee9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:17:01.114300 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-35938aa5-8056-4bae-b939-e30845700bd2 tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] 10.222.0.46 "GET /compute/v2.1/servers/c54ca28b-b0d1-44e7-b74f-d3a73e81ca2c" status: 200 len: 1535 microversion: 2.1 time: 0.173080 Jan 15 21:17:01.115142 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3311/6620] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:17:00 2022] GET /compute/v2.1/servers/c54ca28b-b0d1-44e7-b74f-d3a73e81ca2c => generated 1535 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:17:02.008984 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-85bfd134-7a96-40cb-90ce-a26e5aaa9c60 req-85ebb488-68ed-443d-a610-d2914d5bf8fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c54ca28b-b0d1-44e7-b74f-d3a73e81ca2c", "name": "network-vif-deleted", "tag": "4669d801-5157-4dfa-936f-528903a4a350"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:17:02.011177 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:17:02.011177 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:17:02.023350 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-85bfd134-7a96-40cb-90ce-a26e5aaa9c60 req-85ebb488-68ed-443d-a610-d2914d5bf8fe service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:17:02.023875 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-85bfd134-7a96-40cb-90ce-a26e5aaa9c60 req-85ebb488-68ed-443d-a610-d2914d5bf8fe service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:17:02.039419 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-85bfd134-7a96-40cb-90ce-a26e5aaa9c60 req-85ebb488-68ed-443d-a610-d2914d5bf8fe service nova] Creating event network-vif-deleted:4669d801-5157-4dfa-936f-528903a4a350 for instance c54ca28b-b0d1-44e7-b74f-d3a73e81ca2c on nch1-master-1 Jan 15 21:17:02.045220 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-85bfd134-7a96-40cb-90ce-a26e5aaa9c60 req-85ebb488-68ed-443d-a610-d2914d5bf8fe service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040269 Jan 15 21:17:02.045839 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3310/6621] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:17:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:17:02.131361 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-429e7652-2429-409c-bafd-54bf9b12620c tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:17:02.131867 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-429e7652-2429-409c-bafd-54bf9b12620c tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] [instance: c54ca28b-b0d1-44e7-b74f-d3a73e81ca2c] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:17:02.139578 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-429e7652-2429-409c-bafd-54bf9b12620c tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:17:02.140024 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-429e7652-2429-409c-bafd-54bf9b12620c tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:17:02.140809 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-429e7652-2429-409c-bafd-54bf9b12620c tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:17:02.141416 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-429e7652-2429-409c-bafd-54bf9b12620c tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:17:02.173663 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-429e7652-2429-409c-bafd-54bf9b12620c tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:17:02.174112 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-429e7652-2429-409c-bafd-54bf9b12620c tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:17:02.174556 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.objects.instance [None req-429e7652-2429-409c-bafd-54bf9b12620c tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] Lazy-loading 'fault' on Instance uuid c54ca28b-b0d1-44e7-b74f-d3a73e81ca2c {{(pid=129366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 21:17:02.213201 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-429e7652-2429-409c-bafd-54bf9b12620c tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689d9fefdfa84f18bf46810b32608130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63e26c2f40334b0e8558e39716312ee9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:17:02.221418 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-429e7652-2429-409c-bafd-54bf9b12620c tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] 10.222.0.46 "GET /compute/v2.1/servers/c54ca28b-b0d1-44e7-b74f-d3a73e81ca2c" status: 200 len: 1318 microversion: 2.1 time: 0.093833 Jan 15 21:17:02.222342 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3312/6622] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:17:02 2022] GET /compute/v2.1/servers/c54ca28b-b0d1-44e7-b74f-d3a73e81ca2c => generated 1318 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:17:03.239238 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-aa82991b-e427-48e1-b345-63cf676ffa8b tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:17:03.239944 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-aa82991b-e427-48e1-b345-63cf676ffa8b tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] [instance: c54ca28b-b0d1-44e7-b74f-d3a73e81ca2c] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:17:03.247569 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-aa82991b-e427-48e1-b345-63cf676ffa8b tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:17:03.248028 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-aa82991b-e427-48e1-b345-63cf676ffa8b tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:17:03.248830 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-aa82991b-e427-48e1-b345-63cf676ffa8b tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:17:03.249289 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-aa82991b-e427-48e1-b345-63cf676ffa8b tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:17:03.263433 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-aa82991b-e427-48e1-b345-63cf676ffa8b tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] HTTP exception thrown: Instance c54ca28b-b0d1-44e7-b74f-d3a73e81ca2c could not be found. Jan 15 21:17:03.264025 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-aa82991b-e427-48e1-b345-63cf676ffa8b tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] Returning 404 to user: Instance c54ca28b-b0d1-44e7-b74f-d3a73e81ca2c could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:17:03.264872 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-aa82991b-e427-48e1-b345-63cf676ffa8b tempest-ServersNegativeTestMultiTenantJSON-1991534151 tempest-ServersNegativeTestMultiTenantJSON-1991534151-project] 10.222.0.46 "GET /compute/v2.1/servers/c54ca28b-b0d1-44e7-b74f-d3a73e81ca2c" status: 404 len: 111 microversion: 2.1 time: 0.029934 Jan 15 21:17:03.265430 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3311/6623] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:17:03 2022] GET /compute/v2.1/servers/c54ca28b-b0d1-44e7-b74f-d3a73e81ca2c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:17:06.462663 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-934cf71e-7b1d-480f-9382-53afbf6cb24e tempest-QuotasTestJSON-322383609 tempest-QuotasTestJSON-322383609-project] Calling method '.version_select at 0x7f30c9000dc0>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:17:06.527337 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-934cf71e-7b1d-480f-9382-53afbf6cb24e tempest-QuotasTestJSON-322383609 tempest-QuotasTestJSON-322383609-project] 10.222.0.46 "GET /compute/v2.1/os-quota-sets/f2a36c0beddd43028dbfc6310fd00500/defaults" status: 200 len: 371 microversion: 2.1 time: 0.200869 Jan 15 21:17:06.528660 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3313/6624] 10.222.0.46 () {58 vars in 1268 bytes} [Sat Jan 15 21:17:06 2022] GET /compute/v2.1/os-quota-sets/f2a36c0beddd43028dbfc6310fd00500/defaults => generated 371 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:17:06.539330 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-fb5d0887-2450-4b21-8750-5101e5061867 tempest-QuotasTestJSON-322383609 tempest-QuotasTestJSON-322383609-project] Calling method '.version_select at 0x7f30c85289d0>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:17:06.617358 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4affe487-8ec6-4dae-a294-70462f1d1e89 tempest-TestNetworkAdvancedServerOps-958360157 tempest-TestNetworkAdvancedServerOps-958360157-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:17:06.618126 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-4affe487-8ec6-4dae-a294-70462f1d1e89 tempest-TestNetworkAdvancedServerOps-958360157 tempest-TestNetworkAdvancedServerOps-958360157-project-admin] [instance: 315ce600-cbfd-4885-bc3d-5ab129d57681] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:17:06.620411 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-fb5d0887-2450-4b21-8750-5101e5061867 tempest-QuotasTestJSON-322383609 tempest-QuotasTestJSON-322383609-project] 10.222.0.46 "GET /compute/v2.1/os-quota-sets/f2a36c0beddd43028dbfc6310fd00500" status: 200 len: 371 microversion: 2.1 time: 0.085263 Jan 15 21:17:06.621035 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3312/6625] 10.222.0.46 () {58 vars in 1241 bytes} [Sat Jan 15 21:17:06 2022] GET /compute/v2.1/os-quota-sets/f2a36c0beddd43028dbfc6310fd00500 => generated 371 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:17:06.625837 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4affe487-8ec6-4dae-a294-70462f1d1e89 tempest-TestNetworkAdvancedServerOps-958360157 tempest-TestNetworkAdvancedServerOps-958360157-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:17:06.626289 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4affe487-8ec6-4dae-a294-70462f1d1e89 tempest-TestNetworkAdvancedServerOps-958360157 tempest-TestNetworkAdvancedServerOps-958360157-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:17:06.627317 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4affe487-8ec6-4dae-a294-70462f1d1e89 tempest-TestNetworkAdvancedServerOps-958360157 tempest-TestNetworkAdvancedServerOps-958360157-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:17:06.627803 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4affe487-8ec6-4dae-a294-70462f1d1e89 tempest-TestNetworkAdvancedServerOps-958360157 tempest-TestNetworkAdvancedServerOps-958360157-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:17:06.634848 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-694e94cf-337c-401b-b36c-485a8c9bb45d tempest-QuotasTestJSON-322383609 tempest-QuotasTestJSON-322383609-project] Calling method '.version_select at 0x7f30ceb76310>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:17:06.705899 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-694e94cf-337c-401b-b36c-485a8c9bb45d tempest-QuotasTestJSON-322383609 tempest-QuotasTestJSON-322383609-project] 10.222.0.46 "GET /compute/v2.1/os-quota-sets/f2a36c0beddd43028dbfc6310fd00500/defaults" status: 200 len: 371 microversion: 2.1 time: 0.074833 Jan 15 21:17:06.706499 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3313/6626] 10.222.0.46 () {58 vars in 1268 bytes} [Sat Jan 15 21:17:06 2022] GET /compute/v2.1/os-quota-sets/f2a36c0beddd43028dbfc6310fd00500/defaults => generated 371 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 21:17:06.721645 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-330b0643-5786-4737-be14-c2e6e748570b tempest-QuotasTestJSON-322383609 tempest-QuotasTestJSON-322383609-project] Calling method '.version_select at 0x7f30ceb5f820>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:17:06.778757 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-4affe487-8ec6-4dae-a294-70462f1d1e89 tempest-TestNetworkAdvancedServerOps-958360157 tempest-TestNetworkAdvancedServerOps-958360157-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/315ce600-cbfd-4885-bc3d-5ab129d57681" status: 200 len: 1832 microversion: 2.1 time: 0.165376 Jan 15 21:17:06.791866 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3314/6627] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:17:06 2022] GET /compute/v2.1/servers/315ce600-cbfd-4885-bc3d-5ab129d57681 => generated 1832 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:17:06.814874 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-330b0643-5786-4737-be14-c2e6e748570b tempest-QuotasTestJSON-322383609 tempest-QuotasTestJSON-322383609-project] 10.222.0.46 "GET /compute/v2.1/os-quota-sets/f2a36c0beddd43028dbfc6310fd00500" status: 200 len: 371 microversion: 2.1 time: 0.096770 Jan 15 21:17:06.815855 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3314/6628] 10.222.0.46 () {58 vars in 1241 bytes} [Sat Jan 15 21:17:06 2022] GET /compute/v2.1/os-quota-sets/f2a36c0beddd43028dbfc6310fd00500 => generated 371 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:17:06.825806 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f03608b0-7318-4d11-a141-89d5cbfc70e0 tempest-QuotasTestJSON-322383609 tempest-QuotasTestJSON-322383609-project] Calling method '.version_select at 0x7f30c8f1da60>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:17:06.914143 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f03608b0-7318-4d11-a141-89d5cbfc70e0 tempest-QuotasTestJSON-322383609 tempest-QuotasTestJSON-322383609-project] 10.222.0.46 "GET /compute/v2.1/os-quota-sets/f2a36c0beddd43028dbfc6310fd00500?user_id=a69e08a6432d4950aade8f91b36903b7" status: 200 len: 371 microversion: 2.1 time: 0.091941 Jan 15 21:17:06.914734 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3315/6629] 10.222.0.46 () {58 vars in 1322 bytes} [Sat Jan 15 21:17:06 2022] GET /compute/v2.1/os-quota-sets/f2a36c0beddd43028dbfc6310fd00500?user_id=a69e08a6432d4950aade8f91b36903b7 => generated 371 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:17:08.063998 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b236a1cb-48f2-4fc4-a1b0-615655ba963c tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:17:08.065243 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b236a1cb-48f2-4fc4-a1b0-615655ba963c tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: 315ce600-cbfd-4885-bc3d-5ab129d57681] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:17:08.070957 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-1104229e-d5dd-4632-b246-0d25d67cba52 req-2ee14f4b-e918-45e1-9976-2bc8ec81027b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "315ce600-cbfd-4885-bc3d-5ab129d57681", "tag": "5946fdbc-5c0f-444f-9903-f401907ec9ec"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:17:08.073320 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:17:08.073320 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:17:08.073497 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b236a1cb-48f2-4fc4-a1b0-615655ba963c tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:17:08.073869 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b236a1cb-48f2-4fc4-a1b0-615655ba963c tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:17:08.074843 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b236a1cb-48f2-4fc4-a1b0-615655ba963c tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:17:08.075600 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b236a1cb-48f2-4fc4-a1b0-615655ba963c tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:17:08.086261 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-1104229e-d5dd-4632-b246-0d25d67cba52 req-2ee14f4b-e918-45e1-9976-2bc8ec81027b service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:17:08.086557 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-1104229e-d5dd-4632-b246-0d25d67cba52 req-2ee14f4b-e918-45e1-9976-2bc8ec81027b service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:17:08.098542 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-1104229e-d5dd-4632-b246-0d25d67cba52 req-2ee14f4b-e918-45e1-9976-2bc8ec81027b service nova] Creating event network-changed:5946fdbc-5c0f-444f-9903-f401907ec9ec for instance 315ce600-cbfd-4885-bc3d-5ab129d57681 on nch2-master-1 Jan 15 21:17:08.104281 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-1104229e-d5dd-4632-b246-0d25d67cba52 req-2ee14f4b-e918-45e1-9976-2bc8ec81027b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037752 Jan 15 21:17:08.105444 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3316/6630] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:17:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 21:17:08.114730 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b236a1cb-48f2-4fc4-a1b0-615655ba963c tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: 315ce600-cbfd-4885-bc3d-5ab129d57681] Going to try to terminate instance {{(pid=129365) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 21:17:08.248866 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b236a1cb-48f2-4fc4-a1b0-615655ba963c tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "DELETE /compute/v2.1/servers/315ce600-cbfd-4885-bc3d-5ab129d57681" status: 204 len: 0 microversion: 2.1 time: 0.191616 Jan 15 21:17:08.249525 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3315/6631] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 21:17:08 2022] DELETE /compute/v2.1/servers/315ce600-cbfd-4885-bc3d-5ab129d57681 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 21:17:08.258498 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8f7580a7-48a5-4bb8-a52a-5c023047d385 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:17:08.266252 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-8f7580a7-48a5-4bb8-a52a-5c023047d385 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: 315ce600-cbfd-4885-bc3d-5ab129d57681] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:17:08.271141 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8f7580a7-48a5-4bb8-a52a-5c023047d385 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:17:08.271640 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8f7580a7-48a5-4bb8-a52a-5c023047d385 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:17:08.272452 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8f7580a7-48a5-4bb8-a52a-5c023047d385 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:17:08.272943 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8f7580a7-48a5-4bb8-a52a-5c023047d385 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:17:08.506307 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-8f7580a7-48a5-4bb8-a52a-5c023047d385 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:17:08.517217 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-8f7580a7-48a5-4bb8-a52a-5c023047d385 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/315ce600-cbfd-4885-bc3d-5ab129d57681" status: 200 len: 1687 microversion: 2.1 time: 0.261011 Jan 15 21:17:08.518221 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3317/6632] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:17:08 2022] GET /compute/v2.1/servers/315ce600-cbfd-4885-bc3d-5ab129d57681 => generated 1687 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:17:09.539738 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-54421ed8-2dcb-4bca-ba67-da118f5c1158 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:17:09.540774 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-54421ed8-2dcb-4bca-ba67-da118f5c1158 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: 315ce600-cbfd-4885-bc3d-5ab129d57681] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:17:09.550218 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-54421ed8-2dcb-4bca-ba67-da118f5c1158 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:17:09.550764 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-54421ed8-2dcb-4bca-ba67-da118f5c1158 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:17:09.551631 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-54421ed8-2dcb-4bca-ba67-da118f5c1158 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:17:09.552486 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-54421ed8-2dcb-4bca-ba67-da118f5c1158 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:17:09.768548 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-54421ed8-2dcb-4bca-ba67-da118f5c1158 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:17:09.777789 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-54421ed8-2dcb-4bca-ba67-da118f5c1158 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/315ce600-cbfd-4885-bc3d-5ab129d57681" status: 200 len: 1569 microversion: 2.1 time: 0.244625 Jan 15 21:17:09.780941 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3316/6633] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:17:09 2022] GET /compute/v2.1/servers/315ce600-cbfd-4885-bc3d-5ab129d57681 => generated 1569 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:17:10.141414 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-daf762ba-333f-4102-bfff-6bb93957dcaf tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:17:10.143381 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-daf762ba-333f-4102-bfff-6bb93957dcaf tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] [instance: 57f7b510-e7b8-484b-9be5-468ac3063f29] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:17:10.151546 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-daf762ba-333f-4102-bfff-6bb93957dcaf tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:17:10.151991 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-daf762ba-333f-4102-bfff-6bb93957dcaf tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:17:10.153906 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-daf762ba-333f-4102-bfff-6bb93957dcaf tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:17:10.154430 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-daf762ba-333f-4102-bfff-6bb93957dcaf tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:17:10.224778 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-daf762ba-333f-4102-bfff-6bb93957dcaf tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] 10.222.0.46 "POST /compute/v2.1/servers/57f7b510-e7b8-484b-9be5-468ac3063f29/action" status: 200 len: 32642 microversion: 2.1 time: 0.086975 Jan 15 21:17:10.227455 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3318/6634] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:17:10 2022] POST /compute/v2.1/servers/57f7b510-e7b8-484b-9be5-468ac3063f29/action => generated 32642 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:17:10.394560 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-065465ee-44ce-49a8-9a85-282414e2bada req-f5879bb1-12aa-476f-87c8-6c0aed7b965e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "315ce600-cbfd-4885-bc3d-5ab129d57681", "name": "network-vif-deleted", "tag": "5946fdbc-5c0f-444f-9903-f401907ec9ec"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:17:10.396133 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:17:10.396133 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:17:10.406867 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-065465ee-44ce-49a8-9a85-282414e2bada req-f5879bb1-12aa-476f-87c8-6c0aed7b965e service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:17:10.407322 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-065465ee-44ce-49a8-9a85-282414e2bada req-f5879bb1-12aa-476f-87c8-6c0aed7b965e service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:17:10.420274 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-065465ee-44ce-49a8-9a85-282414e2bada req-f5879bb1-12aa-476f-87c8-6c0aed7b965e service nova] Creating event network-vif-deleted:5946fdbc-5c0f-444f-9903-f401907ec9ec for instance 315ce600-cbfd-4885-bc3d-5ab129d57681 on nch2-master-1 Jan 15 21:17:10.425914 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-065465ee-44ce-49a8-9a85-282414e2bada req-f5879bb1-12aa-476f-87c8-6c0aed7b965e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034893 Jan 15 21:17:10.427076 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3317/6635] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:17:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:17:10.796237 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e75465cd-f625-4704-b287-90834fcfeefd tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:17:10.796984 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e75465cd-f625-4704-b287-90834fcfeefd tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: 315ce600-cbfd-4885-bc3d-5ab129d57681] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:17:10.805054 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e75465cd-f625-4704-b287-90834fcfeefd tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:17:10.805722 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e75465cd-f625-4704-b287-90834fcfeefd tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:17:10.806808 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e75465cd-f625-4704-b287-90834fcfeefd tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:17:10.807257 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e75465cd-f625-4704-b287-90834fcfeefd tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:17:10.856678 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e75465cd-f625-4704-b287-90834fcfeefd tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:17:10.857433 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e75465cd-f625-4704-b287-90834fcfeefd tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:17:10.858052 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.objects.instance [None req-e75465cd-f625-4704-b287-90834fcfeefd tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lazy-loading 'fault' on Instance uuid 315ce600-cbfd-4885-bc3d-5ab129d57681 {{(pid=129366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 21:17:10.928815 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-e75465cd-f625-4704-b287-90834fcfeefd tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:17:10.937875 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e75465cd-f625-4704-b287-90834fcfeefd tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/315ce600-cbfd-4885-bc3d-5ab129d57681" status: 200 len: 1356 microversion: 2.1 time: 0.145718 Jan 15 21:17:10.939140 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3319/6636] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:17:10 2022] GET /compute/v2.1/servers/315ce600-cbfd-4885-bc3d-5ab129d57681 => generated 1356 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:17:11.957161 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-27aabfcd-99e7-46dd-a1dc-42bdfb63aca0 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:17:11.957856 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-27aabfcd-99e7-46dd-a1dc-42bdfb63aca0 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: 315ce600-cbfd-4885-bc3d-5ab129d57681] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:17:11.964456 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-27aabfcd-99e7-46dd-a1dc-42bdfb63aca0 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:17:11.965014 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-27aabfcd-99e7-46dd-a1dc-42bdfb63aca0 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:17:11.965822 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-27aabfcd-99e7-46dd-a1dc-42bdfb63aca0 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:17:11.966448 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-27aabfcd-99e7-46dd-a1dc-42bdfb63aca0 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:17:11.982577 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-27aabfcd-99e7-46dd-a1dc-42bdfb63aca0 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] HTTP exception thrown: Instance 315ce600-cbfd-4885-bc3d-5ab129d57681 could not be found. Jan 15 21:17:11.983176 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-27aabfcd-99e7-46dd-a1dc-42bdfb63aca0 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Returning 404 to user: Instance 315ce600-cbfd-4885-bc3d-5ab129d57681 could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:17:11.984093 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-27aabfcd-99e7-46dd-a1dc-42bdfb63aca0 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/315ce600-cbfd-4885-bc3d-5ab129d57681" status: 404 len: 111 microversion: 2.1 time: 0.031802 Jan 15 21:17:11.984655 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3318/6637] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:17:11 2022] GET /compute/v2.1/servers/315ce600-cbfd-4885-bc3d-5ab129d57681 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:17:12.104465 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f83008cd-6031-448a-bf76-1a228f3f9efa tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:17:12.105935 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f83008cd-6031-448a-bf76-1a228f3f9efa tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] [instance: 57f7b510-e7b8-484b-9be5-468ac3063f29] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:17:12.111458 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-be3c7914-199a-4206-9135-13fd2aa0aa9c req-eb2704e5-069c-44e9-afa0-e55a7ddcf297 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57f7b510-e7b8-484b-9be5-468ac3063f29", "tag": "84cfe8ad-5c43-40f1-89bd-977866e8ad66"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:17:12.113079 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:17:12.113079 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:17:12.119924 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f83008cd-6031-448a-bf76-1a228f3f9efa tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:17:12.120466 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f83008cd-6031-448a-bf76-1a228f3f9efa tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:17:12.123575 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-be3c7914-199a-4206-9135-13fd2aa0aa9c req-eb2704e5-069c-44e9-afa0-e55a7ddcf297 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:17:12.123940 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f83008cd-6031-448a-bf76-1a228f3f9efa tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:17:12.124103 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-be3c7914-199a-4206-9135-13fd2aa0aa9c req-eb2704e5-069c-44e9-afa0-e55a7ddcf297 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:17:12.125482 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f83008cd-6031-448a-bf76-1a228f3f9efa tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:17:12.149602 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-be3c7914-199a-4206-9135-13fd2aa0aa9c req-eb2704e5-069c-44e9-afa0-e55a7ddcf297 service nova] Creating event network-changed:84cfe8ad-5c43-40f1-89bd-977866e8ad66 for instance 57f7b510-e7b8-484b-9be5-468ac3063f29 on nch1-master-1 Jan 15 21:17:12.165204 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-be3c7914-199a-4206-9135-13fd2aa0aa9c req-eb2704e5-069c-44e9-afa0-e55a7ddcf297 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057161 Jan 15 21:17:12.170233 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3319/6638] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:17:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 21:17:12.193844 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f83008cd-6031-448a-bf76-1a228f3f9efa tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] [instance: 57f7b510-e7b8-484b-9be5-468ac3063f29] Going to try to terminate instance {{(pid=129366) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 21:17:12.379639 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f83008cd-6031-448a-bf76-1a228f3f9efa tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] 10.222.0.46 "DELETE /compute/v2.1/servers/57f7b510-e7b8-484b-9be5-468ac3063f29" status: 204 len: 0 microversion: 2.1 time: 0.279301 Jan 15 21:17:12.380407 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3320/6639] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 21:17:12 2022] DELETE /compute/v2.1/servers/57f7b510-e7b8-484b-9be5-468ac3063f29 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 21:17:12.390704 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-1f43d363-a820-4945-a4a3-18d398e16035 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:17:12.391419 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-1f43d363-a820-4945-a4a3-18d398e16035 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] [instance: 57f7b510-e7b8-484b-9be5-468ac3063f29] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:17:12.404054 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1f43d363-a820-4945-a4a3-18d398e16035 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:17:12.404614 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1f43d363-a820-4945-a4a3-18d398e16035 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:17:12.406230 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1f43d363-a820-4945-a4a3-18d398e16035 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:17:12.407199 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1f43d363-a820-4945-a4a3-18d398e16035 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:17:12.620701 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-1f43d363-a820-4945-a4a3-18d398e16035 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0d769340dc4d36b83436c7fc78bbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de60cd8289224f1f81ef0db9ec3c6f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:17:12.629457 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-1f43d363-a820-4945-a4a3-18d398e16035 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] 10.222.0.46 "GET /compute/v2.1/servers/57f7b510-e7b8-484b-9be5-468ac3063f29" status: 200 len: 1668 microversion: 2.1 time: 0.243785 Jan 15 21:17:12.637412 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3320/6640] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:17:12 2022] GET /compute/v2.1/servers/57f7b510-e7b8-484b-9be5-468ac3063f29 => generated 1668 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:17:13.650739 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-34212d5d-1950-4d97-9c22-97c521d2efcb tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:17:13.661112 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-34212d5d-1950-4d97-9c22-97c521d2efcb tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] [instance: 57f7b510-e7b8-484b-9be5-468ac3063f29] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:17:13.671460 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-34212d5d-1950-4d97-9c22-97c521d2efcb tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:17:13.672237 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-34212d5d-1950-4d97-9c22-97c521d2efcb tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:17:13.673498 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-34212d5d-1950-4d97-9c22-97c521d2efcb tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:17:13.674210 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-34212d5d-1950-4d97-9c22-97c521d2efcb tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:17:13.920607 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-34212d5d-1950-4d97-9c22-97c521d2efcb tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0d769340dc4d36b83436c7fc78bbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de60cd8289224f1f81ef0db9ec3c6f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:17:13.931229 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-34212d5d-1950-4d97-9c22-97c521d2efcb tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] 10.222.0.46 "GET /compute/v2.1/servers/57f7b510-e7b8-484b-9be5-468ac3063f29" status: 200 len: 1550 microversion: 2.1 time: 0.284516 Jan 15 21:17:13.932605 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3321/6641] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:17:13 2022] GET /compute/v2.1/servers/57f7b510-e7b8-484b-9be5-468ac3063f29 => generated 1550 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:17:14.950922 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e9326f90-c33e-44fb-b6a2-2dbbcc029253 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:17:14.951393 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e9326f90-c33e-44fb-b6a2-2dbbcc029253 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] [instance: 57f7b510-e7b8-484b-9be5-468ac3063f29] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:17:14.963114 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e9326f90-c33e-44fb-b6a2-2dbbcc029253 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:17:14.963887 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e9326f90-c33e-44fb-b6a2-2dbbcc029253 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:17:14.967925 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e9326f90-c33e-44fb-b6a2-2dbbcc029253 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:17:14.968925 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e9326f90-c33e-44fb-b6a2-2dbbcc029253 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:17:15.036090 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-29c5f97c-45ec-4baf-a431-7f89c321ec7f req-8b7a8197-616f-4103-b9c5-5ee0da484b18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57f7b510-e7b8-484b-9be5-468ac3063f29", "name": "network-vif-deleted", "tag": "84cfe8ad-5c43-40f1-89bd-977866e8ad66"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:17:15.038684 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:17:15.038684 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:17:15.048043 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-29c5f97c-45ec-4baf-a431-7f89c321ec7f req-8b7a8197-616f-4103-b9c5-5ee0da484b18 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:17:15.048741 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-29c5f97c-45ec-4baf-a431-7f89c321ec7f req-8b7a8197-616f-4103-b9c5-5ee0da484b18 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:17:15.059620 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-e9326f90-c33e-44fb-b6a2-2dbbcc029253 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0d769340dc4d36b83436c7fc78bbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de60cd8289224f1f81ef0db9ec3c6f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:17:15.062657 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-29c5f97c-45ec-4baf-a431-7f89c321ec7f req-8b7a8197-616f-4103-b9c5-5ee0da484b18 service nova] Creating event network-vif-deleted:84cfe8ad-5c43-40f1-89bd-977866e8ad66 for instance 57f7b510-e7b8-484b-9be5-468ac3063f29 on nch1-master-1 Jan 15 21:17:15.069464 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-29c5f97c-45ec-4baf-a431-7f89c321ec7f req-8b7a8197-616f-4103-b9c5-5ee0da484b18 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036842 Jan 15 21:17:15.070320 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3322/6642] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:17:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 21:17:15.077610 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e9326f90-c33e-44fb-b6a2-2dbbcc029253 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] 10.222.0.46 "GET /compute/v2.1/servers/57f7b510-e7b8-484b-9be5-468ac3063f29" status: 200 len: 1484 microversion: 2.1 time: 0.131492 Jan 15 21:17:15.078569 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3321/6643] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:17:14 2022] GET /compute/v2.1/servers/57f7b510-e7b8-484b-9be5-468ac3063f29 => generated 1484 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:17:16.097504 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0e42d357-d693-47fd-baae-e80c492f946d tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:17:16.098298 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-0e42d357-d693-47fd-baae-e80c492f946d tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] [instance: 57f7b510-e7b8-484b-9be5-468ac3063f29] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:17:16.109436 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0e42d357-d693-47fd-baae-e80c492f946d tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:17:16.114402 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0e42d357-d693-47fd-baae-e80c492f946d tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:17:16.115642 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0e42d357-d693-47fd-baae-e80c492f946d tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:17:16.116243 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0e42d357-d693-47fd-baae-e80c492f946d tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:17:16.144029 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-0e42d357-d693-47fd-baae-e80c492f946d tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] HTTP exception thrown: Instance 57f7b510-e7b8-484b-9be5-468ac3063f29 could not be found. Jan 15 21:17:16.144935 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0e42d357-d693-47fd-baae-e80c492f946d tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Returning 404 to user: Instance 57f7b510-e7b8-484b-9be5-468ac3063f29 could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:17:16.156036 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0e42d357-d693-47fd-baae-e80c492f946d tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] 10.222.0.46 "GET /compute/v2.1/servers/57f7b510-e7b8-484b-9be5-468ac3063f29" status: 404 len: 111 microversion: 2.1 time: 0.053474 Jan 15 21:17:16.158105 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3323/6644] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:17:16 2022] GET /compute/v2.1/servers/57f7b510-e7b8-484b-9be5-468ac3063f29 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:17:16.641374 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-0a530394-ba08-489c-8c81-1fc6cf205fa6 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] Calling method '.version_select at 0x7f30ceb9faf0>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:17:16.670736 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-0a530394-ba08-489c-8c81-1fc6cf205fa6 tempest-TestNetworkBasicOps-1834082990 tempest-TestNetworkBasicOps-1834082990-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1974703774" status: 202 len: 0 microversion: 2.1 time: 0.034261 Jan 15 21:17:16.671912 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3322/6645] 10.222.0.46 () {58 vars in 1256 bytes} [Sat Jan 15 21:17:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1974703774 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:17:18.073005 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-603e6bba-555f-4da3-a5be-03b57b789b34 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '.version_select at 0x7f30c8e354c0>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:17:18.101302 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-603e6bba-555f-4da3-a5be-03b57b789b34 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1400537109" status: 202 len: 0 microversion: 2.1 time: 0.032711 Jan 15 21:17:18.108645 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3324/6646] 10.222.0.46 () {58 vars in 1283 bytes} [Sat Jan 15 21:17:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1400537109 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:17:18.135086 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-0d99153c-cc31-42e7-8b4d-9d1eaed94c88 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Action: 'create', calling method: .version_select at 0x7f30c872eee0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1383309457"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:17:18.151495 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-0d99153c-cc31-42e7-8b4d-9d1eaed94c88 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Getting quotas for project ed86e4d7dcdb4ea7ad79628b2ae2462d. Resources: {'key_pairs'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:17:18.157557 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-0d99153c-cc31-42e7-8b4d-9d1eaed94c88 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Getting quotas for user 7f0f0e03b03e4d24ae0a7e5d3b9b7104 and project ed86e4d7dcdb4ea7ad79628b2ae2462d. Resources: {'key_pairs'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:17:18.644471 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-0d99153c-cc31-42e7-8b4d-9d1eaed94c88 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Getting quotas for project ed86e4d7dcdb4ea7ad79628b2ae2462d. Resources: {'key_pairs'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:17:18.649709 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-0d99153c-cc31-42e7-8b4d-9d1eaed94c88 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Getting quotas for user 7f0f0e03b03e4d24ae0a7e5d3b9b7104 and project ed86e4d7dcdb4ea7ad79628b2ae2462d. Resources: {'key_pairs'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:17:18.704770 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-0d99153c-cc31-42e7-8b4d-9d1eaed94c88 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 2322 microversion: 2.1 time: 0.574425 Jan 15 21:17:18.709765 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3323/6647] 10.222.0.46 () {60 vars in 1157 bytes} [Sat Jan 15 21:17:18 2022] POST /compute/v2.1/os-keypairs => generated 2322 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:17:28.454296 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-43aaee31-a354-48d4-a9cb-4e354d3e747c tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1083431073", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "networks": [{"uuid": "9ce7cdf5-6bfa-49dd-a387-56f78a4b820d"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1383309457", "security_groups": [{"name": "tempest-secgroup-smoke-1485052325"}]}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:17:28.635897 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.network.neutron [None req-43aaee31-a354-48d4-a9cb-4e354d3e747c tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] validate_networks() for [('9ce7cdf5-6bfa-49dd-a387-56f78a4b820d', None, None, None, None, None)] {{(pid=129366) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 21:17:29.700879 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-43aaee31-a354-48d4-a9cb-4e354d3e747c tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Flavor limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 21:17:29.701537 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-43aaee31-a354-48d4-a9cb-4e354d3e747c tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Image limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 21:17:29.702140 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-43aaee31-a354-48d4-a9cb-4e354d3e747c tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Flavor pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 21:17:29.702649 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-43aaee31-a354-48d4-a9cb-4e354d3e747c tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Image pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 21:17:29.703286 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-43aaee31-a354-48d4-a9cb-4e354d3e747c tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 21:17:29.718102 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-43aaee31-a354-48d4-a9cb-4e354d3e747c tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:17:29.718576 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-43aaee31-a354-48d4-a9cb-4e354d3e747c tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:17:29.719813 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-43aaee31-a354-48d4-a9cb-4e354d3e747c tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:17:29.720301 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-43aaee31-a354-48d4-a9cb-4e354d3e747c tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:17:29.745516 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-43aaee31-a354-48d4-a9cb-4e354d3e747c tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Getting quotas for project ed86e4d7dcdb4ea7ad79628b2ae2462d. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:17:29.753334 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-43aaee31-a354-48d4-a9cb-4e354d3e747c tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Getting quotas for user 7f0f0e03b03e4d24ae0a7e5d3b9b7104 and project ed86e4d7dcdb4ea7ad79628b2ae2462d. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:17:29.770097 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-43aaee31-a354-48d4-a9cb-4e354d3e747c tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Going to run 1 instances... {{(pid=129366) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 21:17:29.772752 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-43aaee31-a354-48d4-a9cb-4e354d3e747c tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: de6b8c07-8b58-47b9-ba66-29a517f105ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 21:17:29.841008 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-43aaee31-a354-48d4-a9cb-4e354d3e747c tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.389351 Jan 15 21:17:29.841995 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3325/6648] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 21:17:28 2022] POST /compute/v2.1/servers => generated 406 bytes in 1394 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 21:17:29.863336 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b6bf8cd6-e2d3-4819-b131-fe3b6ffed81a tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:17:29.863949 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b6bf8cd6-e2d3-4819-b131-fe3b6ffed81a tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: de6b8c07-8b58-47b9-ba66-29a517f105ef] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:17:29.984658 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-b6bf8cd6-e2d3-4819-b131-fe3b6ffed81a tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:17:29.995726 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b6bf8cd6-e2d3-4819-b131-fe3b6ffed81a tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/de6b8c07-8b58-47b9-ba66-29a517f105ef" status: 200 len: 1267 microversion: 2.1 time: 0.146489 Jan 15 21:17:30.005237 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3326/6649] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:17:29 2022] GET /compute/v2.1/servers/de6b8c07-8b58-47b9-ba66-29a517f105ef => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:17:30.101913 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3f6e7fc4-af67-4414-82e8-4c1dfd2bcecd tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Action: 'create', calling method: .version_select at 0x7f30c84383a0>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-870193259"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:17:30.138620 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-3f6e7fc4-af67-4414-82e8-4c1dfd2bcecd tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Getting quotas for project 5b63757470b845b3ad6e5b18314f2c57. Resources: {'key_pairs'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:17:30.174742 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-3f6e7fc4-af67-4414-82e8-4c1dfd2bcecd tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Getting quotas for user 3740026776904d36be28fd3a206a3361 and project 5b63757470b845b3ad6e5b18314f2c57. Resources: {'key_pairs'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:17:30.525388 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-3f6e7fc4-af67-4414-82e8-4c1dfd2bcecd tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Getting quotas for project 5b63757470b845b3ad6e5b18314f2c57. Resources: {'key_pairs'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:17:30.540580 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-3f6e7fc4-af67-4414-82e8-4c1dfd2bcecd tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Getting quotas for user 3740026776904d36be28fd3a206a3361 and project 5b63757470b845b3ad6e5b18314f2c57. Resources: {'key_pairs'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:17:30.599588 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3f6e7fc4-af67-4414-82e8-4c1dfd2bcecd tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 2319 microversion: 2.1 time: 0.911101 Jan 15 21:17:30.603084 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3324/6650] 10.222.0.46 () {60 vars in 1157 bytes} [Sat Jan 15 21:17:29 2022] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:17:31.020517 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a329a97d-b731-4d24-83ec-9d8a8855f70b tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:17:31.024054 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a329a97d-b731-4d24-83ec-9d8a8855f70b tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: de6b8c07-8b58-47b9-ba66-29a517f105ef] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:17:31.054982 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a329a97d-b731-4d24-83ec-9d8a8855f70b tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:17:31.059596 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a329a97d-b731-4d24-83ec-9d8a8855f70b tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:17:31.066377 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a329a97d-b731-4d24-83ec-9d8a8855f70b tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:17:31.069044 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a329a97d-b731-4d24-83ec-9d8a8855f70b tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:17:31.256639 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-a329a97d-b731-4d24-83ec-9d8a8855f70b tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:17:31.270820 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a329a97d-b731-4d24-83ec-9d8a8855f70b tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/de6b8c07-8b58-47b9-ba66-29a517f105ef" status: 200 len: 1319 microversion: 2.1 time: 0.258994 Jan 15 21:17:31.271423 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3327/6651] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:17:31 2022] GET /compute/v2.1/servers/de6b8c07-8b58-47b9-ba66-29a517f105ef => generated 1319 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:17:32.291306 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-83e1e5fb-a274-4ce8-9720-183b8afabd1d tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:17:32.292014 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-83e1e5fb-a274-4ce8-9720-183b8afabd1d tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: de6b8c07-8b58-47b9-ba66-29a517f105ef] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:17:32.303863 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-83e1e5fb-a274-4ce8-9720-183b8afabd1d tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:17:32.308962 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-83e1e5fb-a274-4ce8-9720-183b8afabd1d tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:17:32.310741 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-83e1e5fb-a274-4ce8-9720-183b8afabd1d tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:17:32.313452 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-83e1e5fb-a274-4ce8-9720-183b8afabd1d tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:17:32.439900 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-83e1e5fb-a274-4ce8-9720-183b8afabd1d tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:17:32.447979 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-83e1e5fb-a274-4ce8-9720-183b8afabd1d tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/de6b8c07-8b58-47b9-ba66-29a517f105ef" status: 200 len: 1325 microversion: 2.1 time: 0.162458 Jan 15 21:17:32.449179 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3325/6652] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:17:32 2022] GET /compute/v2.1/servers/de6b8c07-8b58-47b9-ba66-29a517f105ef => generated 1325 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:17:33.467291 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-227727b1-4e0b-48ac-a813-d12500ebb46a tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:17:33.467982 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-227727b1-4e0b-48ac-a813-d12500ebb46a tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: de6b8c07-8b58-47b9-ba66-29a517f105ef] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:17:33.475359 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-227727b1-4e0b-48ac-a813-d12500ebb46a tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:17:33.475841 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-227727b1-4e0b-48ac-a813-d12500ebb46a tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:17:33.477165 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-227727b1-4e0b-48ac-a813-d12500ebb46a tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:17:33.477773 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-227727b1-4e0b-48ac-a813-d12500ebb46a tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:17:33.638515 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-227727b1-4e0b-48ac-a813-d12500ebb46a tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:17:33.646598 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-227727b1-4e0b-48ac-a813-d12500ebb46a tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/de6b8c07-8b58-47b9-ba66-29a517f105ef" status: 200 len: 1393 microversion: 2.1 time: 0.184074 Jan 15 21:17:33.647197 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3328/6653] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:17:33 2022] GET /compute/v2.1/servers/de6b8c07-8b58-47b9-ba66-29a517f105ef => generated 1393 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:17:34.570611 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-66dc1d5c-ae63-4396-8e6d-5d684941868c req-a8656400-4096-4d48-85e4-b3cb873b8ee4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de6b8c07-8b58-47b9-ba66-29a517f105ef", "tag": "fdfa8ea6-1cbd-4860-b0c5-c0801d8e3ecc"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:17:34.578359 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:17:34.578359 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:17:34.621992 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-66dc1d5c-ae63-4396-8e6d-5d684941868c req-a8656400-4096-4d48-85e4-b3cb873b8ee4 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:17:34.623012 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-66dc1d5c-ae63-4396-8e6d-5d684941868c req-a8656400-4096-4d48-85e4-b3cb873b8ee4 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:17:34.650735 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-66dc1d5c-ae63-4396-8e6d-5d684941868c req-a8656400-4096-4d48-85e4-b3cb873b8ee4 service nova] Creating event network-changed:fdfa8ea6-1cbd-4860-b0c5-c0801d8e3ecc for instance de6b8c07-8b58-47b9-ba66-29a517f105ef on nch1-master-1 Jan 15 21:17:34.666709 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-36c2e25f-d9db-4743-af1e-420e885420cb tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:17:34.667481 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-36c2e25f-d9db-4743-af1e-420e885420cb tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: de6b8c07-8b58-47b9-ba66-29a517f105ef] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:17:34.668863 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-66dc1d5c-ae63-4396-8e6d-5d684941868c req-a8656400-4096-4d48-85e4-b3cb873b8ee4 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127221 Jan 15 21:17:34.670303 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3326/6654] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:17:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:17:34.689392 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-36c2e25f-d9db-4743-af1e-420e885420cb tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:17:34.692275 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-36c2e25f-d9db-4743-af1e-420e885420cb tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:17:34.694568 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-36c2e25f-d9db-4743-af1e-420e885420cb tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:17:34.696597 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-36c2e25f-d9db-4743-af1e-420e885420cb tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:17:35.033637 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-36c2e25f-d9db-4743-af1e-420e885420cb tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:17:35.046055 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-36c2e25f-d9db-4743-af1e-420e885420cb tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/de6b8c07-8b58-47b9-ba66-29a517f105ef" status: 200 len: 1393 microversion: 2.1 time: 0.384301 Jan 15 21:17:35.060410 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3329/6655] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:17:34 2022] GET /compute/v2.1/servers/de6b8c07-8b58-47b9-ba66-29a517f105ef => generated 1393 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:17:36.064301 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-6286880f-c5b8-4d44-9085-851338533c4f tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:17:36.065040 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-6286880f-c5b8-4d44-9085-851338533c4f tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: de6b8c07-8b58-47b9-ba66-29a517f105ef] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:17:36.077473 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6286880f-c5b8-4d44-9085-851338533c4f tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:17:36.077933 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6286880f-c5b8-4d44-9085-851338533c4f tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:17:36.078751 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6286880f-c5b8-4d44-9085-851338533c4f tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:17:36.079197 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6286880f-c5b8-4d44-9085-851338533c4f tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:17:36.645205 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-6286880f-c5b8-4d44-9085-851338533c4f tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:17:36.653345 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-6286880f-c5b8-4d44-9085-851338533c4f tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/de6b8c07-8b58-47b9-ba66-29a517f105ef" status: 200 len: 1393 microversion: 2.1 time: 0.593022 Jan 15 21:17:36.654342 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3327/6656] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:17:36 2022] GET /compute/v2.1/servers/de6b8c07-8b58-47b9-ba66-29a517f105ef => generated 1393 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:17:37.671080 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-128c428b-964a-4bf2-b9f3-03a048732315 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:17:37.672300 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-128c428b-964a-4bf2-b9f3-03a048732315 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: de6b8c07-8b58-47b9-ba66-29a517f105ef] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:17:37.682431 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-128c428b-964a-4bf2-b9f3-03a048732315 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:17:37.683964 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-128c428b-964a-4bf2-b9f3-03a048732315 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:17:37.688402 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-128c428b-964a-4bf2-b9f3-03a048732315 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:17:37.693716 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-128c428b-964a-4bf2-b9f3-03a048732315 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:17:38.125263 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-128c428b-964a-4bf2-b9f3-03a048732315 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:17:38.137907 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-128c428b-964a-4bf2-b9f3-03a048732315 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/de6b8c07-8b58-47b9-ba66-29a517f105ef" status: 200 len: 1393 microversion: 2.1 time: 0.471473 Jan 15 21:17:38.139088 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3330/6657] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:17:37 2022] GET /compute/v2.1/servers/de6b8c07-8b58-47b9-ba66-29a517f105ef => generated 1393 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:17:39.157689 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-4d961372-83a5-4fce-a085-dd13597ce507 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:17:39.158884 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-4d961372-83a5-4fce-a085-dd13597ce507 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: de6b8c07-8b58-47b9-ba66-29a517f105ef] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:17:39.169483 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4d961372-83a5-4fce-a085-dd13597ce507 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:17:39.170252 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4d961372-83a5-4fce-a085-dd13597ce507 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:17:39.171395 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4d961372-83a5-4fce-a085-dd13597ce507 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:17:39.172006 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4d961372-83a5-4fce-a085-dd13597ce507 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:17:39.426369 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-7bf0593d-6efc-4052-9b2a-f1cfccd88e8f req-62d89c89-782f-416e-b3fb-fe2327123b2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de6b8c07-8b58-47b9-ba66-29a517f105ef", "name": "network-vif-plugged", "status": "completed", "tag": "fdfa8ea6-1cbd-4860-b0c5-c0801d8e3ecc"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:17:39.427980 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:17:39.427980 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:17:39.447469 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-7bf0593d-6efc-4052-9b2a-f1cfccd88e8f req-62d89c89-782f-416e-b3fb-fe2327123b2a service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:17:39.447929 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-7bf0593d-6efc-4052-9b2a-f1cfccd88e8f req-62d89c89-782f-416e-b3fb-fe2327123b2a service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:17:39.480659 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-7bf0593d-6efc-4052-9b2a-f1cfccd88e8f req-62d89c89-782f-416e-b3fb-fe2327123b2a service nova] Creating event network-vif-plugged:fdfa8ea6-1cbd-4860-b0c5-c0801d8e3ecc for instance de6b8c07-8b58-47b9-ba66-29a517f105ef on nch1-master-1 Jan 15 21:17:39.501289 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-7bf0593d-6efc-4052-9b2a-f1cfccd88e8f req-62d89c89-782f-416e-b3fb-fe2327123b2a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077663 Jan 15 21:17:39.505188 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3331/6658] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:17:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 21:17:39.575359 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-4d961372-83a5-4fce-a085-dd13597ce507 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:17:39.591155 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-4d961372-83a5-4fce-a085-dd13597ce507 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/de6b8c07-8b58-47b9-ba66-29a517f105ef" status: 200 len: 1393 microversion: 2.1 time: 0.440260 Jan 15 21:17:39.591768 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3328/6659] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:17:39 2022] GET /compute/v2.1/servers/de6b8c07-8b58-47b9-ba66-29a517f105ef => generated 1393 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:17:40.362894 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-fd92a808-b8a8-4a16-9a24-005538b957ed tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-2044461148-access_point-429104537", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "networks": [{"uuid": "4a57373f-def7-4d62-bbcc-60677c51e02c"}], "key_name": "tempest-TestSecurityGroupsBasicOps-870193259", "security_groups": [{"name": "tempest-secgroup_access--971946336"}, {"name": "tempest-secgroup_general--1653926590"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:17:40.610392 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-aded17bd-14ab-4a0b-8372-a461a5fd87ce tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:17:40.612237 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-aded17bd-14ab-4a0b-8372-a461a5fd87ce tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: de6b8c07-8b58-47b9-ba66-29a517f105ef] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:17:40.638727 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-aded17bd-14ab-4a0b-8372-a461a5fd87ce tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:17:40.652933 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-aded17bd-14ab-4a0b-8372-a461a5fd87ce tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:17:40.659397 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-aded17bd-14ab-4a0b-8372-a461a5fd87ce tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:17:40.660101 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-aded17bd-14ab-4a0b-8372-a461a5fd87ce tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:17:40.703132 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.network.neutron [None req-fd92a808-b8a8-4a16-9a24-005538b957ed tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] validate_networks() for [('4a57373f-def7-4d62-bbcc-60677c51e02c', None, None, None, None, None)] {{(pid=129366) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 21:17:41.138412 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-aded17bd-14ab-4a0b-8372-a461a5fd87ce tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:17:41.161629 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-aded17bd-14ab-4a0b-8372-a461a5fd87ce tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/de6b8c07-8b58-47b9-ba66-29a517f105ef" status: 200 len: 1393 microversion: 2.1 time: 0.549865 Jan 15 21:17:41.172870 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3329/6660] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:17:40 2022] GET /compute/v2.1/servers/de6b8c07-8b58-47b9-ba66-29a517f105ef => generated 1393 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:17:41.710601 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-fd92a808-b8a8-4a16-9a24-005538b957ed tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Flavor limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 21:17:41.712711 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-fd92a808-b8a8-4a16-9a24-005538b957ed tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Image limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 21:17:41.713491 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-fd92a808-b8a8-4a16-9a24-005538b957ed tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Flavor pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 21:17:41.714803 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-fd92a808-b8a8-4a16-9a24-005538b957ed tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Image pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 21:17:41.716929 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-fd92a808-b8a8-4a16-9a24-005538b957ed tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 21:17:41.751759 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fd92a808-b8a8-4a16-9a24-005538b957ed tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:17:41.751759 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fd92a808-b8a8-4a16-9a24-005538b957ed tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:17:41.751759 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fd92a808-b8a8-4a16-9a24-005538b957ed tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:17:41.752491 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fd92a808-b8a8-4a16-9a24-005538b957ed tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:17:41.783083 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-fd92a808-b8a8-4a16-9a24-005538b957ed tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Getting quotas for project 5b63757470b845b3ad6e5b18314f2c57. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:17:41.790915 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-fd92a808-b8a8-4a16-9a24-005538b957ed tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Getting quotas for user 3740026776904d36be28fd3a206a3361 and project 5b63757470b845b3ad6e5b18314f2c57. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:17:41.804403 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-fd92a808-b8a8-4a16-9a24-005538b957ed tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Going to run 1 instances... {{(pid=129366) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 21:17:41.806582 ncdv-master-1 devstack@n-api.service[129366]: WARNING nova.utils [None req-fd92a808-b8a8-4a16-9a24-005538b957ed tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-2044461148-access_point-429104537 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-2044461148-ac Jan 15 21:17:41.807400 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-fd92a808-b8a8-4a16-9a24-005538b957ed tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] [instance: c46baa1b-9f5b-42ce-a3f8-f1432c526691] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 21:17:41.893873 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-fd92a808-b8a8-4a16-9a24-005538b957ed tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 457 microversion: 2.1 time: 1.535735 Jan 15 21:17:41.894538 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3332/6661] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 21:17:40 2022] POST /compute/v2.1/servers => generated 457 bytes in 1537 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 21:17:41.909220 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b29d36fe-734c-4dd8-96c3-9ba7f66b0d28 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:17:41.910004 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b29d36fe-734c-4dd8-96c3-9ba7f66b0d28 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] [instance: c46baa1b-9f5b-42ce-a3f8-f1432c526691] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:17:42.077286 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-b29d36fe-734c-4dd8-96c3-9ba7f66b0d28 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3740026776904d36be28fd3a206a3361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b63757470b845b3ad6e5b18314f2c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:17:42.086440 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b29d36fe-734c-4dd8-96c3-9ba7f66b0d28 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] 10.222.0.46 "GET /compute/v2.1/servers/c46baa1b-9f5b-42ce-a3f8-f1432c526691" status: 200 len: 1293 microversion: 2.1 time: 0.182254 Jan 15 21:17:42.087354 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3330/6662] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:17:41 2022] GET /compute/v2.1/servers/c46baa1b-9f5b-42ce-a3f8-f1432c526691 => generated 1293 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:17:42.179810 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b309e7e0-c407-4981-9212-194920ff411b tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:17:42.180430 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b309e7e0-c407-4981-9212-194920ff411b tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: de6b8c07-8b58-47b9-ba66-29a517f105ef] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:17:42.191184 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b309e7e0-c407-4981-9212-194920ff411b tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:17:42.191635 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b309e7e0-c407-4981-9212-194920ff411b tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:17:42.193274 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b309e7e0-c407-4981-9212-194920ff411b tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:17:42.193899 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b309e7e0-c407-4981-9212-194920ff411b tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:17:42.429884 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-b309e7e0-c407-4981-9212-194920ff411b tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:17:42.442798 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b309e7e0-c407-4981-9212-194920ff411b tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/de6b8c07-8b58-47b9-ba66-29a517f105ef" status: 200 len: 1565 microversion: 2.1 time: 0.266682 Jan 15 21:17:42.443397 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3333/6663] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:17:42 2022] GET /compute/v2.1/servers/de6b8c07-8b58-47b9-ba66-29a517f105ef => generated 1565 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:17:42.459852 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-17a0176f-0909-442b-825d-5429792c7416 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:17:42.469055 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-17a0176f-0909-442b-825d-5429792c7416 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: de6b8c07-8b58-47b9-ba66-29a517f105ef] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:17:42.489942 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-17a0176f-0909-442b-825d-5429792c7416 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:17:42.491137 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-17a0176f-0909-442b-825d-5429792c7416 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:17:42.492334 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-17a0176f-0909-442b-825d-5429792c7416 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:17:42.493369 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-17a0176f-0909-442b-825d-5429792c7416 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:17:42.698846 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-17a0176f-0909-442b-825d-5429792c7416 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:17:42.710582 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-17a0176f-0909-442b-825d-5429792c7416 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/de6b8c07-8b58-47b9-ba66-29a517f105ef" status: 200 len: 1565 microversion: 2.1 time: 0.254349 Jan 15 21:17:42.711557 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3331/6664] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:17:42 2022] GET /compute/v2.1/servers/de6b8c07-8b58-47b9-ba66-29a517f105ef => generated 1565 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:17:43.104563 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-bb866121-c049-4b09-b8e0-bbc880c33e6e tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:17:43.111342 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-bb866121-c049-4b09-b8e0-bbc880c33e6e tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] [instance: c46baa1b-9f5b-42ce-a3f8-f1432c526691] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:17:43.122481 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bb866121-c049-4b09-b8e0-bbc880c33e6e tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:17:43.123079 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bb866121-c049-4b09-b8e0-bbc880c33e6e tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:17:43.124020 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bb866121-c049-4b09-b8e0-bbc880c33e6e tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:17:43.124569 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bb866121-c049-4b09-b8e0-bbc880c33e6e tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:17:43.316086 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-bb866121-c049-4b09-b8e0-bbc880c33e6e tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3740026776904d36be28fd3a206a3361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b63757470b845b3ad6e5b18314f2c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:17:43.329488 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-bb866121-c049-4b09-b8e0-bbc880c33e6e tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] 10.222.0.46 "GET /compute/v2.1/servers/c46baa1b-9f5b-42ce-a3f8-f1432c526691" status: 200 len: 1345 microversion: 2.1 time: 0.228047 Jan 15 21:17:43.333660 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3334/6665] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:17:43 2022] GET /compute/v2.1/servers/c46baa1b-9f5b-42ce-a3f8-f1432c526691 => generated 1345 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:17:44.351183 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8775f531-1eac-45ec-8bd3-ef8388b964cf tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:17:44.353996 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-8775f531-1eac-45ec-8bd3-ef8388b964cf tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] [instance: c46baa1b-9f5b-42ce-a3f8-f1432c526691] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:17:44.364534 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8775f531-1eac-45ec-8bd3-ef8388b964cf tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:17:44.365261 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8775f531-1eac-45ec-8bd3-ef8388b964cf tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:17:44.366739 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8775f531-1eac-45ec-8bd3-ef8388b964cf tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:17:44.367413 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8775f531-1eac-45ec-8bd3-ef8388b964cf tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:17:44.467296 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-8775f531-1eac-45ec-8bd3-ef8388b964cf tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3740026776904d36be28fd3a206a3361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b63757470b845b3ad6e5b18314f2c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:17:44.478300 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-8775f531-1eac-45ec-8bd3-ef8388b964cf tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] 10.222.0.46 "GET /compute/v2.1/servers/c46baa1b-9f5b-42ce-a3f8-f1432c526691" status: 200 len: 1351 microversion: 2.1 time: 0.134995 Jan 15 21:17:44.489571 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3332/6666] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:17:44 2022] GET /compute/v2.1/servers/c46baa1b-9f5b-42ce-a3f8-f1432c526691 => generated 1351 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:17:45.496498 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-44d91929-76ae-42b1-893d-5b1d11e23c1c tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:17:45.497944 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-44d91929-76ae-42b1-893d-5b1d11e23c1c tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] [instance: c46baa1b-9f5b-42ce-a3f8-f1432c526691] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:17:45.505937 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-44d91929-76ae-42b1-893d-5b1d11e23c1c tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:17:45.506549 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-44d91929-76ae-42b1-893d-5b1d11e23c1c tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:17:45.507614 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-44d91929-76ae-42b1-893d-5b1d11e23c1c tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:17:45.508207 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-44d91929-76ae-42b1-893d-5b1d11e23c1c tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:17:45.712795 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-44d91929-76ae-42b1-893d-5b1d11e23c1c tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3740026776904d36be28fd3a206a3361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b63757470b845b3ad6e5b18314f2c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:17:45.726689 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-44d91929-76ae-42b1-893d-5b1d11e23c1c tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] 10.222.0.46 "GET /compute/v2.1/servers/c46baa1b-9f5b-42ce-a3f8-f1432c526691" status: 200 len: 1470 microversion: 2.1 time: 0.233909 Jan 15 21:17:45.727864 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3335/6667] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:17:45 2022] GET /compute/v2.1/servers/c46baa1b-9f5b-42ce-a3f8-f1432c526691 => generated 1470 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:17:46.615464 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-2dd9eec0-60af-49fd-8ac8-39925a637378 req-21dde200-31e2-4ae1-a537-fa34b79900f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c46baa1b-9f5b-42ce-a3f8-f1432c526691", "tag": "d97caf67-f7a7-4dae-ab1d-958cb300e495"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:17:46.618572 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:17:46.618572 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:17:46.650162 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-2dd9eec0-60af-49fd-8ac8-39925a637378 req-21dde200-31e2-4ae1-a537-fa34b79900f4 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:17:46.650608 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-2dd9eec0-60af-49fd-8ac8-39925a637378 req-21dde200-31e2-4ae1-a537-fa34b79900f4 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:17:46.686851 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-2dd9eec0-60af-49fd-8ac8-39925a637378 req-21dde200-31e2-4ae1-a537-fa34b79900f4 service nova] Creating event network-changed:d97caf67-f7a7-4dae-ab1d-958cb300e495 for instance c46baa1b-9f5b-42ce-a3f8-f1432c526691 on nch2-master-1 Jan 15 21:17:46.700015 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-2dd9eec0-60af-49fd-8ac8-39925a637378 req-21dde200-31e2-4ae1-a537-fa34b79900f4 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091749 Jan 15 21:17:46.702944 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3333/6668] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:17:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:17:46.704161 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f9a227a0-cfdf-453b-8aeb-df30818782fd tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:17:46.704785 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f9a227a0-cfdf-453b-8aeb-df30818782fd tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: de6b8c07-8b58-47b9-ba66-29a517f105ef] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:17:46.719169 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f9a227a0-cfdf-453b-8aeb-df30818782fd tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:17:46.719941 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f9a227a0-cfdf-453b-8aeb-df30818782fd tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:17:46.721043 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f9a227a0-cfdf-453b-8aeb-df30818782fd tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:17:46.721640 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f9a227a0-cfdf-453b-8aeb-df30818782fd tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:17:46.753113 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-851058f9-1c49-4ce2-9a18-c54c70546114 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:17:46.754144 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-851058f9-1c49-4ce2-9a18-c54c70546114 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] [instance: c46baa1b-9f5b-42ce-a3f8-f1432c526691] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:17:46.765733 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-851058f9-1c49-4ce2-9a18-c54c70546114 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:17:46.768079 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-851058f9-1c49-4ce2-9a18-c54c70546114 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:17:46.769242 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-851058f9-1c49-4ce2-9a18-c54c70546114 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:17:46.771069 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-851058f9-1c49-4ce2-9a18-c54c70546114 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:17:46.955516 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-f9a227a0-cfdf-453b-8aeb-df30818782fd tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:17:46.966401 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f9a227a0-cfdf-453b-8aeb-df30818782fd tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/de6b8c07-8b58-47b9-ba66-29a517f105ef" status: 200 len: 1565 microversion: 2.1 time: 0.276798 Jan 15 21:17:46.968755 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3336/6669] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:17:46 2022] GET /compute/v2.1/servers/de6b8c07-8b58-47b9-ba66-29a517f105ef => generated 1565 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:17:47.061535 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-851058f9-1c49-4ce2-9a18-c54c70546114 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3740026776904d36be28fd3a206a3361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b63757470b845b3ad6e5b18314f2c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:17:47.072193 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-851058f9-1c49-4ce2-9a18-c54c70546114 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] 10.222.0.46 "GET /compute/v2.1/servers/c46baa1b-9f5b-42ce-a3f8-f1432c526691" status: 200 len: 1470 microversion: 2.1 time: 0.324744 Jan 15 21:17:47.072793 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3334/6670] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:17:46 2022] GET /compute/v2.1/servers/c46baa1b-9f5b-42ce-a3f8-f1432c526691 => generated 1470 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:17:48.096089 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-cec3f6b7-e849-4d4e-8580-726808b23654 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:17:48.097307 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-cec3f6b7-e849-4d4e-8580-726808b23654 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] [instance: c46baa1b-9f5b-42ce-a3f8-f1432c526691] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:17:48.112060 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cec3f6b7-e849-4d4e-8580-726808b23654 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:17:48.112905 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cec3f6b7-e849-4d4e-8580-726808b23654 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:17:48.113936 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cec3f6b7-e849-4d4e-8580-726808b23654 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:17:48.115948 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cec3f6b7-e849-4d4e-8580-726808b23654 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:17:48.282401 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-cec3f6b7-e849-4d4e-8580-726808b23654 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3740026776904d36be28fd3a206a3361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b63757470b845b3ad6e5b18314f2c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:17:48.290340 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-cec3f6b7-e849-4d4e-8580-726808b23654 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] 10.222.0.46 "GET /compute/v2.1/servers/c46baa1b-9f5b-42ce-a3f8-f1432c526691" status: 200 len: 1470 microversion: 2.1 time: 0.201973 Jan 15 21:17:48.290999 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3337/6671] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:17:48 2022] GET /compute/v2.1/servers/c46baa1b-9f5b-42ce-a3f8-f1432c526691 => generated 1470 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:17:48.747600 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-34ab9a36-8eda-4df3-af4e-7069f2191a8a req-a6ea8f45-bb71-4ddc-87e5-7e9911837567 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de6b8c07-8b58-47b9-ba66-29a517f105ef", "tag": "fdfa8ea6-1cbd-4860-b0c5-c0801d8e3ecc"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:17:48.749679 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:17:48.749679 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:17:48.759124 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-34ab9a36-8eda-4df3-af4e-7069f2191a8a req-a6ea8f45-bb71-4ddc-87e5-7e9911837567 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:17:48.759760 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-34ab9a36-8eda-4df3-af4e-7069f2191a8a req-a6ea8f45-bb71-4ddc-87e5-7e9911837567 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:17:48.771626 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-34ab9a36-8eda-4df3-af4e-7069f2191a8a req-a6ea8f45-bb71-4ddc-87e5-7e9911837567 service nova] Creating event network-changed:fdfa8ea6-1cbd-4860-b0c5-c0801d8e3ecc for instance de6b8c07-8b58-47b9-ba66-29a517f105ef on nch1-master-1 Jan 15 21:17:48.778235 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-34ab9a36-8eda-4df3-af4e-7069f2191a8a req-a6ea8f45-bb71-4ddc-87e5-7e9911837567 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034872 Jan 15 21:17:48.778842 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3335/6672] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:17:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:17:49.310377 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b729fc00-5d88-4ab1-a86a-f1fc695d2269 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:17:49.311057 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b729fc00-5d88-4ab1-a86a-f1fc695d2269 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] [instance: c46baa1b-9f5b-42ce-a3f8-f1432c526691] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:17:49.320295 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b729fc00-5d88-4ab1-a86a-f1fc695d2269 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:17:49.320751 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b729fc00-5d88-4ab1-a86a-f1fc695d2269 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:17:49.322243 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b729fc00-5d88-4ab1-a86a-f1fc695d2269 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:17:49.322994 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b729fc00-5d88-4ab1-a86a-f1fc695d2269 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:17:49.476500 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-b729fc00-5d88-4ab1-a86a-f1fc695d2269 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3740026776904d36be28fd3a206a3361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b63757470b845b3ad6e5b18314f2c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:17:49.484765 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b729fc00-5d88-4ab1-a86a-f1fc695d2269 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] 10.222.0.46 "GET /compute/v2.1/servers/c46baa1b-9f5b-42ce-a3f8-f1432c526691" status: 200 len: 1470 microversion: 2.1 time: 0.178962 Jan 15 21:17:49.485460 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3338/6673] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:17:49 2022] GET /compute/v2.1/servers/c46baa1b-9f5b-42ce-a3f8-f1432c526691 => generated 1470 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:17:50.503097 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-724b950e-1b35-4d7d-bf1b-ad582c1e8e11 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:17:50.503913 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-724b950e-1b35-4d7d-bf1b-ad582c1e8e11 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] [instance: c46baa1b-9f5b-42ce-a3f8-f1432c526691] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:17:50.511087 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-724b950e-1b35-4d7d-bf1b-ad582c1e8e11 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:17:50.511606 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-724b950e-1b35-4d7d-bf1b-ad582c1e8e11 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:17:50.512407 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-724b950e-1b35-4d7d-bf1b-ad582c1e8e11 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:17:50.512865 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-724b950e-1b35-4d7d-bf1b-ad582c1e8e11 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:17:50.743265 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-724b950e-1b35-4d7d-bf1b-ad582c1e8e11 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3740026776904d36be28fd3a206a3361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b63757470b845b3ad6e5b18314f2c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:17:50.751269 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-724b950e-1b35-4d7d-bf1b-ad582c1e8e11 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] 10.222.0.46 "GET /compute/v2.1/servers/c46baa1b-9f5b-42ce-a3f8-f1432c526691" status: 200 len: 1470 microversion: 2.1 time: 0.253108 Jan 15 21:17:50.751861 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3336/6674] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:17:50 2022] GET /compute/v2.1/servers/c46baa1b-9f5b-42ce-a3f8-f1432c526691 => generated 1470 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:17:51.768794 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a83004ed-3cdb-40a9-aa89-c5795d4eabf9 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:17:51.769435 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a83004ed-3cdb-40a9-aa89-c5795d4eabf9 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] [instance: c46baa1b-9f5b-42ce-a3f8-f1432c526691] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:17:51.776446 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a83004ed-3cdb-40a9-aa89-c5795d4eabf9 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:17:51.776960 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a83004ed-3cdb-40a9-aa89-c5795d4eabf9 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:17:51.779563 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a83004ed-3cdb-40a9-aa89-c5795d4eabf9 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:17:51.779563 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a83004ed-3cdb-40a9-aa89-c5795d4eabf9 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:17:51.931966 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-a83004ed-3cdb-40a9-aa89-c5795d4eabf9 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3740026776904d36be28fd3a206a3361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b63757470b845b3ad6e5b18314f2c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:17:51.940002 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a83004ed-3cdb-40a9-aa89-c5795d4eabf9 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] 10.222.0.46 "GET /compute/v2.1/servers/c46baa1b-9f5b-42ce-a3f8-f1432c526691" status: 200 len: 1470 microversion: 2.1 time: 0.175465 Jan 15 21:17:51.940583 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3339/6675] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:17:51 2022] GET /compute/v2.1/servers/c46baa1b-9f5b-42ce-a3f8-f1432c526691 => generated 1470 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:17:52.838538 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-8f5c4baa-962d-4d83-806d-835ce0e61473 req-44d96138-4381-473f-8c10-d898feb831b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c46baa1b-9f5b-42ce-a3f8-f1432c526691", "name": "network-vif-plugged", "status": "completed", "tag": "d97caf67-f7a7-4dae-ab1d-958cb300e495"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:17:52.840285 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:17:52.840285 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:17:52.849372 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-8f5c4baa-962d-4d83-806d-835ce0e61473 req-44d96138-4381-473f-8c10-d898feb831b8 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:17:52.850163 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-8f5c4baa-962d-4d83-806d-835ce0e61473 req-44d96138-4381-473f-8c10-d898feb831b8 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:17:52.863087 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-8f5c4baa-962d-4d83-806d-835ce0e61473 req-44d96138-4381-473f-8c10-d898feb831b8 service nova] Creating event network-vif-plugged:d97caf67-f7a7-4dae-ab1d-958cb300e495 for instance c46baa1b-9f5b-42ce-a3f8-f1432c526691 on nch2-master-1 Jan 15 21:17:52.868219 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-8f5c4baa-962d-4d83-806d-835ce0e61473 req-44d96138-4381-473f-8c10-d898feb831b8 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033420 Jan 15 21:17:52.868817 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3337/6676] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:17:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:17:52.958758 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-55aa78d9-96e6-49db-a8de-295dd2b045e9 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:17:52.959456 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-55aa78d9-96e6-49db-a8de-295dd2b045e9 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] [instance: c46baa1b-9f5b-42ce-a3f8-f1432c526691] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:17:52.966162 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-55aa78d9-96e6-49db-a8de-295dd2b045e9 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:17:52.966698 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-55aa78d9-96e6-49db-a8de-295dd2b045e9 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:17:52.967567 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-55aa78d9-96e6-49db-a8de-295dd2b045e9 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:17:52.968084 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-55aa78d9-96e6-49db-a8de-295dd2b045e9 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:17:53.125531 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-55aa78d9-96e6-49db-a8de-295dd2b045e9 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3740026776904d36be28fd3a206a3361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b63757470b845b3ad6e5b18314f2c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:17:53.133525 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-55aa78d9-96e6-49db-a8de-295dd2b045e9 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] 10.222.0.46 "GET /compute/v2.1/servers/c46baa1b-9f5b-42ce-a3f8-f1432c526691" status: 200 len: 1470 microversion: 2.1 time: 0.179478 Jan 15 21:17:53.134433 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3340/6677] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:17:52 2022] GET /compute/v2.1/servers/c46baa1b-9f5b-42ce-a3f8-f1432c526691 => generated 1470 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:17:54.153054 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-50dbc22a-40ea-49c4-8d06-734319500d4e tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:17:54.154705 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-50dbc22a-40ea-49c4-8d06-734319500d4e tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] [instance: c46baa1b-9f5b-42ce-a3f8-f1432c526691] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:17:54.163495 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-50dbc22a-40ea-49c4-8d06-734319500d4e tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:17:54.163959 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-50dbc22a-40ea-49c4-8d06-734319500d4e tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:17:54.164756 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-50dbc22a-40ea-49c4-8d06-734319500d4e tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:17:54.165251 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-50dbc22a-40ea-49c4-8d06-734319500d4e tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:17:54.372153 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-50dbc22a-40ea-49c4-8d06-734319500d4e tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3740026776904d36be28fd3a206a3361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b63757470b845b3ad6e5b18314f2c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:17:54.388429 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-50dbc22a-40ea-49c4-8d06-734319500d4e tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] 10.222.0.46 "GET /compute/v2.1/servers/c46baa1b-9f5b-42ce-a3f8-f1432c526691" status: 200 len: 1470 microversion: 2.1 time: 0.240624 Jan 15 21:17:54.400073 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3338/6678] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:17:54 2022] GET /compute/v2.1/servers/c46baa1b-9f5b-42ce-a3f8-f1432c526691 => generated 1470 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:17:55.406513 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ef3fe7e6-1c17-4c31-a779-75bd0976c455 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:17:55.407193 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ef3fe7e6-1c17-4c31-a779-75bd0976c455 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] [instance: c46baa1b-9f5b-42ce-a3f8-f1432c526691] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:17:55.415872 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ef3fe7e6-1c17-4c31-a779-75bd0976c455 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:17:55.416332 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ef3fe7e6-1c17-4c31-a779-75bd0976c455 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:17:55.417138 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ef3fe7e6-1c17-4c31-a779-75bd0976c455 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:17:55.417833 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ef3fe7e6-1c17-4c31-a779-75bd0976c455 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:17:55.589037 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-ef3fe7e6-1c17-4c31-a779-75bd0976c455 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3740026776904d36be28fd3a206a3361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b63757470b845b3ad6e5b18314f2c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:17:55.597484 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ef3fe7e6-1c17-4c31-a779-75bd0976c455 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] 10.222.0.46 "GET /compute/v2.1/servers/c46baa1b-9f5b-42ce-a3f8-f1432c526691" status: 200 len: 1643 microversion: 2.1 time: 0.194894 Jan 15 21:17:55.601348 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3341/6679] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:17:55 2022] GET /compute/v2.1/servers/c46baa1b-9f5b-42ce-a3f8-f1432c526691 => generated 1643 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:17:55.614723 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-499d8bfd-7d6b-42e1-94be-59711952d304 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:17:55.615962 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-499d8bfd-7d6b-42e1-94be-59711952d304 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] [instance: c46baa1b-9f5b-42ce-a3f8-f1432c526691] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:17:55.624115 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-499d8bfd-7d6b-42e1-94be-59711952d304 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:17:55.624568 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-499d8bfd-7d6b-42e1-94be-59711952d304 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:17:55.625387 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-499d8bfd-7d6b-42e1-94be-59711952d304 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:17:55.625821 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-499d8bfd-7d6b-42e1-94be-59711952d304 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:17:55.779742 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-499d8bfd-7d6b-42e1-94be-59711952d304 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3740026776904d36be28fd3a206a3361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b63757470b845b3ad6e5b18314f2c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:17:55.788015 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-499d8bfd-7d6b-42e1-94be-59711952d304 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] 10.222.0.46 "GET /compute/v2.1/servers/c46baa1b-9f5b-42ce-a3f8-f1432c526691" status: 200 len: 1643 microversion: 2.1 time: 0.177080 Jan 15 21:17:55.800491 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3339/6680] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:17:55 2022] GET /compute/v2.1/servers/c46baa1b-9f5b-42ce-a3f8-f1432c526691 => generated 1643 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:17:55.806862 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-bb5acb03-65ea-49f0-8a72-d06cd6db8bf4 tempest-TestSecurityGroupsBasicOps-1216966125 tempest-TestSecurityGroupsBasicOps-1216966125-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:17:55.808090 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-bb5acb03-65ea-49f0-8a72-d06cd6db8bf4 tempest-TestSecurityGroupsBasicOps-1216966125 tempest-TestSecurityGroupsBasicOps-1216966125-project-admin] [instance: c46baa1b-9f5b-42ce-a3f8-f1432c526691] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:17:55.815284 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bb5acb03-65ea-49f0-8a72-d06cd6db8bf4 tempest-TestSecurityGroupsBasicOps-1216966125 tempest-TestSecurityGroupsBasicOps-1216966125-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:17:55.815799 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bb5acb03-65ea-49f0-8a72-d06cd6db8bf4 tempest-TestSecurityGroupsBasicOps-1216966125 tempest-TestSecurityGroupsBasicOps-1216966125-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:17:55.816593 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bb5acb03-65ea-49f0-8a72-d06cd6db8bf4 tempest-TestSecurityGroupsBasicOps-1216966125 tempest-TestSecurityGroupsBasicOps-1216966125-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:17:55.817137 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bb5acb03-65ea-49f0-8a72-d06cd6db8bf4 tempest-TestSecurityGroupsBasicOps-1216966125 tempest-TestSecurityGroupsBasicOps-1216966125-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:17:56.092456 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-bb5acb03-65ea-49f0-8a72-d06cd6db8bf4 tempest-TestSecurityGroupsBasicOps-1216966125 tempest-TestSecurityGroupsBasicOps-1216966125-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/c46baa1b-9f5b-42ce-a3f8-f1432c526691" status: 200 len: 1794 microversion: 2.1 time: 0.290007 Jan 15 21:17:56.093060 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3342/6681] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:17:55 2022] GET /compute/v2.1/servers/c46baa1b-9f5b-42ce-a3f8-f1432c526691 => generated 1794 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:17:58.313168 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-bc990f1c-3d43-4b3c-b1f7-67722c452ee6 req-a03fb222-867a-4832-89cc-0e6882fd2db0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c46baa1b-9f5b-42ce-a3f8-f1432c526691", "tag": "d97caf67-f7a7-4dae-ab1d-958cb300e495"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:17:58.314712 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:17:58.314712 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:17:58.323972 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-bc990f1c-3d43-4b3c-b1f7-67722c452ee6 req-a03fb222-867a-4832-89cc-0e6882fd2db0 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:17:58.324425 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-bc990f1c-3d43-4b3c-b1f7-67722c452ee6 req-a03fb222-867a-4832-89cc-0e6882fd2db0 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:17:58.336524 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-bc990f1c-3d43-4b3c-b1f7-67722c452ee6 req-a03fb222-867a-4832-89cc-0e6882fd2db0 service nova] Creating event network-changed:d97caf67-f7a7-4dae-ab1d-958cb300e495 for instance c46baa1b-9f5b-42ce-a3f8-f1432c526691 on nch2-master-1 Jan 15 21:17:58.343196 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-bc990f1c-3d43-4b3c-b1f7-67722c452ee6 req-a03fb222-867a-4832-89cc-0e6882fd2db0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034493 Jan 15 21:17:58.343795 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3340/6682] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:17:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 21:17:59.455492 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-642b3e82-9f12-47d2-a491-ab788c670312 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:17:59.455999 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-642b3e82-9f12-47d2-a491-ab788c670312 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] [instance: abffb1a6-17ea-4e1a-9218-4339c3407c3c] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:17:59.469424 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-642b3e82-9f12-47d2-a491-ab788c670312 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:17:59.474185 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-642b3e82-9f12-47d2-a491-ab788c670312 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:17:59.475115 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-642b3e82-9f12-47d2-a491-ab788c670312 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:17:59.475573 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-642b3e82-9f12-47d2-a491-ab788c670312 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:17:59.521925 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-642b3e82-9f12-47d2-a491-ab788c670312 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] [instance: abffb1a6-17ea-4e1a-9218-4339c3407c3c] Going to try to terminate instance {{(pid=129366) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 21:17:59.672519 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-642b3e82-9f12-47d2-a491-ab788c670312 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] 10.222.0.46 "DELETE /compute/v2.1/servers/abffb1a6-17ea-4e1a-9218-4339c3407c3c" status: 204 len: 0 microversion: 2.1 time: 0.515400 Jan 15 21:17:59.675247 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3343/6683] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 21:17:59 2022] DELETE /compute/v2.1/servers/abffb1a6-17ea-4e1a-9218-4339c3407c3c => generated 0 bytes in 519 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 15 21:17:59.686868 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9faf75d8-71ae-455e-a7ae-6d1a1a41466f tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:17:59.688198 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-9faf75d8-71ae-455e-a7ae-6d1a1a41466f tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] [instance: abffb1a6-17ea-4e1a-9218-4339c3407c3c] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:17:59.697741 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9faf75d8-71ae-455e-a7ae-6d1a1a41466f tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:17:59.698398 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9faf75d8-71ae-455e-a7ae-6d1a1a41466f tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:17:59.699403 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9faf75d8-71ae-455e-a7ae-6d1a1a41466f tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:17:59.700123 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9faf75d8-71ae-455e-a7ae-6d1a1a41466f tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:17:59.892627 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-9faf75d8-71ae-455e-a7ae-6d1a1a41466f tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25467d5284f04a159432b780e0eb10d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c5c2a0c042c4bf3aa18d87ce1d003eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:17:59.901301 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-9faf75d8-71ae-455e-a7ae-6d1a1a41466f tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] 10.222.0.46 "GET /compute/v2.1/servers/abffb1a6-17ea-4e1a-9218-4339c3407c3c" status: 200 len: 1734 microversion: 2.1 time: 0.220249 Jan 15 21:17:59.902786 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3341/6684] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:17:59 2022] GET /compute/v2.1/servers/abffb1a6-17ea-4e1a-9218-4339c3407c3c => generated 1734 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:18:00.921689 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8b16a5b2-1781-46e4-ad55-28087c6e78a1 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:18:00.922939 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-8b16a5b2-1781-46e4-ad55-28087c6e78a1 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] [instance: abffb1a6-17ea-4e1a-9218-4339c3407c3c] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:18:00.929956 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8b16a5b2-1781-46e4-ad55-28087c6e78a1 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:18:00.930704 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8b16a5b2-1781-46e4-ad55-28087c6e78a1 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:18:00.932661 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8b16a5b2-1781-46e4-ad55-28087c6e78a1 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:18:00.933537 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8b16a5b2-1781-46e4-ad55-28087c6e78a1 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:18:01.111835 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-8b16a5b2-1781-46e4-ad55-28087c6e78a1 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25467d5284f04a159432b780e0eb10d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c5c2a0c042c4bf3aa18d87ce1d003eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:18:01.120695 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-8b16a5b2-1781-46e4-ad55-28087c6e78a1 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] 10.222.0.46 "GET /compute/v2.1/servers/abffb1a6-17ea-4e1a-9218-4339c3407c3c" status: 200 len: 1734 microversion: 2.1 time: 0.204470 Jan 15 21:18:01.121928 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3344/6685] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:18:00 2022] GET /compute/v2.1/servers/abffb1a6-17ea-4e1a-9218-4339c3407c3c => generated 1734 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:18:02.139229 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-145e792f-58c2-4f0f-8bcf-9ae3c71213df tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:18:02.139996 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-145e792f-58c2-4f0f-8bcf-9ae3c71213df tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] [instance: abffb1a6-17ea-4e1a-9218-4339c3407c3c] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:18:02.153097 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-145e792f-58c2-4f0f-8bcf-9ae3c71213df tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:18:02.153567 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-145e792f-58c2-4f0f-8bcf-9ae3c71213df tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:18:02.157308 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-145e792f-58c2-4f0f-8bcf-9ae3c71213df tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:18:02.157981 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-145e792f-58c2-4f0f-8bcf-9ae3c71213df tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:18:02.240639 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-145e792f-58c2-4f0f-8bcf-9ae3c71213df tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25467d5284f04a159432b780e0eb10d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c5c2a0c042c4bf3aa18d87ce1d003eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:18:02.252109 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-145e792f-58c2-4f0f-8bcf-9ae3c71213df tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] 10.222.0.46 "GET /compute/v2.1/servers/abffb1a6-17ea-4e1a-9218-4339c3407c3c" status: 200 len: 1666 microversion: 2.1 time: 0.116590 Jan 15 21:18:02.256657 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3342/6686] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:18:02 2022] GET /compute/v2.1/servers/abffb1a6-17ea-4e1a-9218-4339c3407c3c => generated 1666 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:18:02.831793 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-e02456a9-e28d-4a45-b136-d1f6ed68ed85 req-34bfd59d-8ce4-4b87-84fd-495ee76b3e62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abffb1a6-17ea-4e1a-9218-4339c3407c3c", "name": "network-vif-deleted", "tag": "87023fcd-0a43-4fa7-a414-0a614f09ac8e"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:18:02.833529 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:18:02.833529 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:18:02.845362 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-e02456a9-e28d-4a45-b136-d1f6ed68ed85 req-34bfd59d-8ce4-4b87-84fd-495ee76b3e62 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:18:02.846073 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-e02456a9-e28d-4a45-b136-d1f6ed68ed85 req-34bfd59d-8ce4-4b87-84fd-495ee76b3e62 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:18:02.860688 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-e02456a9-e28d-4a45-b136-d1f6ed68ed85 req-34bfd59d-8ce4-4b87-84fd-495ee76b3e62 service nova] Creating event network-vif-deleted:87023fcd-0a43-4fa7-a414-0a614f09ac8e for instance abffb1a6-17ea-4e1a-9218-4339c3407c3c on nch2-master-1 Jan 15 21:18:02.866200 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-e02456a9-e28d-4a45-b136-d1f6ed68ed85 req-34bfd59d-8ce4-4b87-84fd-495ee76b3e62 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038110 Jan 15 21:18:02.867119 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3345/6687] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:18:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:18:03.271064 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-fc275b48-0ebc-4ac8-b72e-d9c8305b48be tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:18:03.271679 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-fc275b48-0ebc-4ac8-b72e-d9c8305b48be tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] [instance: abffb1a6-17ea-4e1a-9218-4339c3407c3c] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:18:03.299847 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fc275b48-0ebc-4ac8-b72e-d9c8305b48be tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:18:03.300776 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fc275b48-0ebc-4ac8-b72e-d9c8305b48be tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:18:03.302391 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fc275b48-0ebc-4ac8-b72e-d9c8305b48be tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:18:03.303373 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fc275b48-0ebc-4ac8-b72e-d9c8305b48be tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:18:03.366343 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fc275b48-0ebc-4ac8-b72e-d9c8305b48be tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:18:03.367755 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fc275b48-0ebc-4ac8-b72e-d9c8305b48be tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:18:03.368369 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.objects.instance [None req-fc275b48-0ebc-4ac8-b72e-d9c8305b48be tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Lazy-loading 'fault' on Instance uuid abffb1a6-17ea-4e1a-9218-4339c3407c3c {{(pid=129365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 21:18:03.426264 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-fc275b48-0ebc-4ac8-b72e-d9c8305b48be tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25467d5284f04a159432b780e0eb10d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c5c2a0c042c4bf3aa18d87ce1d003eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:18:03.433998 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-fc275b48-0ebc-4ac8-b72e-d9c8305b48be tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] 10.222.0.46 "GET /compute/v2.1/servers/abffb1a6-17ea-4e1a-9218-4339c3407c3c" status: 200 len: 1388 microversion: 2.1 time: 0.167227 Jan 15 21:18:03.434596 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3343/6688] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:18:03 2022] GET /compute/v2.1/servers/abffb1a6-17ea-4e1a-9218-4339c3407c3c => generated 1388 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:18:04.454089 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d6ac565f-cf5b-4a07-b552-feb1e8df8e00 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:18:04.454897 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-d6ac565f-cf5b-4a07-b552-feb1e8df8e00 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] [instance: abffb1a6-17ea-4e1a-9218-4339c3407c3c] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:18:04.461637 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d6ac565f-cf5b-4a07-b552-feb1e8df8e00 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:18:04.462296 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d6ac565f-cf5b-4a07-b552-feb1e8df8e00 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:18:04.464135 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d6ac565f-cf5b-4a07-b552-feb1e8df8e00 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:18:04.464572 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d6ac565f-cf5b-4a07-b552-feb1e8df8e00 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:18:04.478116 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-d6ac565f-cf5b-4a07-b552-feb1e8df8e00 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] HTTP exception thrown: Instance abffb1a6-17ea-4e1a-9218-4339c3407c3c could not be found. Jan 15 21:18:04.478737 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d6ac565f-cf5b-4a07-b552-feb1e8df8e00 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Returning 404 to user: Instance abffb1a6-17ea-4e1a-9218-4339c3407c3c could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:18:04.479648 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d6ac565f-cf5b-4a07-b552-feb1e8df8e00 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] 10.222.0.46 "GET /compute/v2.1/servers/abffb1a6-17ea-4e1a-9218-4339c3407c3c" status: 404 len: 111 microversion: 2.1 time: 0.032155 Jan 15 21:18:04.480216 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3346/6689] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:18:04 2022] GET /compute/v2.1/servers/abffb1a6-17ea-4e1a-9218-4339c3407c3c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:18:04.981497 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-0b1f99db-5ac4-4c04-b878-76ef76bcfb4c tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:18:04.982372 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-0b1f99db-5ac4-4c04-b878-76ef76bcfb4c tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] [instance: abffb1a6-17ea-4e1a-9218-4339c3407c3c] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:18:04.990127 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0b1f99db-5ac4-4c04-b878-76ef76bcfb4c tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:18:04.990835 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0b1f99db-5ac4-4c04-b878-76ef76bcfb4c tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:18:04.991736 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0b1f99db-5ac4-4c04-b878-76ef76bcfb4c tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:18:04.992294 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0b1f99db-5ac4-4c04-b878-76ef76bcfb4c tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:18:05.015204 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-0b1f99db-5ac4-4c04-b878-76ef76bcfb4c tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] HTTP exception thrown: Instance abffb1a6-17ea-4e1a-9218-4339c3407c3c could not be found. Jan 15 21:18:05.015940 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-0b1f99db-5ac4-4c04-b878-76ef76bcfb4c tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Returning 404 to user: Instance abffb1a6-17ea-4e1a-9218-4339c3407c3c could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:18:05.017093 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-0b1f99db-5ac4-4c04-b878-76ef76bcfb4c tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] 10.222.0.46 "DELETE /compute/v2.1/servers/abffb1a6-17ea-4e1a-9218-4339c3407c3c" status: 404 len: 111 microversion: 2.1 time: 0.040805 Jan 15 21:18:05.017799 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3344/6690] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 21:18:04 2022] DELETE /compute/v2.1/servers/abffb1a6-17ea-4e1a-9218-4339c3407c3c => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 15 21:18:05.027397 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f74c7bd8-0001-4f48-8b4d-f5b1d9904743 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:18:05.028288 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f74c7bd8-0001-4f48-8b4d-f5b1d9904743 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] [instance: abffb1a6-17ea-4e1a-9218-4339c3407c3c] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:18:05.038659 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f74c7bd8-0001-4f48-8b4d-f5b1d9904743 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:18:05.041689 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f74c7bd8-0001-4f48-8b4d-f5b1d9904743 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:18:05.042529 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f74c7bd8-0001-4f48-8b4d-f5b1d9904743 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:18:05.042959 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f74c7bd8-0001-4f48-8b4d-f5b1d9904743 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:18:05.062442 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-f74c7bd8-0001-4f48-8b4d-f5b1d9904743 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] HTTP exception thrown: Instance abffb1a6-17ea-4e1a-9218-4339c3407c3c could not be found. Jan 15 21:18:05.062970 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f74c7bd8-0001-4f48-8b4d-f5b1d9904743 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Returning 404 to user: Instance abffb1a6-17ea-4e1a-9218-4339c3407c3c could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:18:05.063807 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f74c7bd8-0001-4f48-8b4d-f5b1d9904743 tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] 10.222.0.46 "GET /compute/v2.1/servers/abffb1a6-17ea-4e1a-9218-4339c3407c3c" status: 404 len: 111 microversion: 2.1 time: 0.041779 Jan 15 21:18:05.064381 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3347/6691] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:18:05 2022] GET /compute/v2.1/servers/abffb1a6-17ea-4e1a-9218-4339c3407c3c => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:18:05.296454 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-38aa1aca-7ff7-4c25-a2dc-47963f750d07 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:18:05.297937 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-38aa1aca-7ff7-4c25-a2dc-47963f750d07 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: de6b8c07-8b58-47b9-ba66-29a517f105ef] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:18:05.305959 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-38aa1aca-7ff7-4c25-a2dc-47963f750d07 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:18:05.306406 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-38aa1aca-7ff7-4c25-a2dc-47963f750d07 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:18:05.307820 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-38aa1aca-7ff7-4c25-a2dc-47963f750d07 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:18:05.308438 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-38aa1aca-7ff7-4c25-a2dc-47963f750d07 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:18:05.350597 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-44dff670-e836-42da-9766-78ea570166ee tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] Calling method '.version_select at 0x7f30c8e3cdc0>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:18:05.368508 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-38aa1aca-7ff7-4c25-a2dc-47963f750d07 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "POST /compute/v2.1/servers/de6b8c07-8b58-47b9-ba66-29a517f105ef/action" status: 200 len: 24566 microversion: 2.1 time: 0.076520 Jan 15 21:18:05.372082 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3345/6692] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:18:05 2022] POST /compute/v2.1/servers/de6b8c07-8b58-47b9-ba66-29a517f105ef/action => generated 24566 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:18:05.389421 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-44dff670-e836-42da-9766-78ea570166ee tempest-TestServerBasicOps-1811346630 tempest-TestServerBasicOps-1811346630-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-374494054" status: 202 len: 0 microversion: 2.1 time: 0.043553 Jan 15 21:18:05.390479 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3348/6693] 10.222.0.46 () {58 vars in 1250 bytes} [Sat Jan 15 21:18:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-374494054 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:18:16.422660 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e52cfb67-887b-4b02-ad96-9472fc029383 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:18:16.424200 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e52cfb67-887b-4b02-ad96-9472fc029383 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: de6b8c07-8b58-47b9-ba66-29a517f105ef] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:18:16.446488 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e52cfb67-887b-4b02-ad96-9472fc029383 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:18:16.450213 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e52cfb67-887b-4b02-ad96-9472fc029383 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:18:16.452425 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e52cfb67-887b-4b02-ad96-9472fc029383 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:18:16.454290 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e52cfb67-887b-4b02-ad96-9472fc029383 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:18:17.026515 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-e52cfb67-887b-4b02-ad96-9472fc029383 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:18:17.036228 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e52cfb67-887b-4b02-ad96-9472fc029383 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/de6b8c07-8b58-47b9-ba66-29a517f105ef" status: 200 len: 1682 microversion: 2.1 time: 0.617971 Jan 15 21:18:17.051487 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3346/6694] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:18:16 2022] GET /compute/v2.1/servers/de6b8c07-8b58-47b9-ba66-29a517f105ef => generated 1682 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:18:17.160203 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a200a204-7da2-4390-8642-5d0f35b448f3 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:18:17.161764 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a200a204-7da2-4390-8642-5d0f35b448f3 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: de6b8c07-8b58-47b9-ba66-29a517f105ef] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:18:17.170917 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a200a204-7da2-4390-8642-5d0f35b448f3 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:18:17.171686 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a200a204-7da2-4390-8642-5d0f35b448f3 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:18:17.172627 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a200a204-7da2-4390-8642-5d0f35b448f3 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:18:17.173337 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a200a204-7da2-4390-8642-5d0f35b448f3 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:18:17.244747 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a200a204-7da2-4390-8642-5d0f35b448f3 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "POST /compute/v2.1/servers/de6b8c07-8b58-47b9-ba66-29a517f105ef/action" status: 200 len: 32639 microversion: 2.1 time: 0.087939 Jan 15 21:18:17.245759 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3349/6695] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:18:17 2022] POST /compute/v2.1/servers/de6b8c07-8b58-47b9-ba66-29a517f105ef/action => generated 32639 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:18:17.433807 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2a63d6b7-7c9b-4be1-b063-098e4c7178ff tempest-TestNetworkAdvancedServerOps-958360157 tempest-TestNetworkAdvancedServerOps-958360157-project-admin] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:18:17.434471 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-2a63d6b7-7c9b-4be1-b063-098e4c7178ff tempest-TestNetworkAdvancedServerOps-958360157 tempest-TestNetworkAdvancedServerOps-958360157-project-admin] [instance: de6b8c07-8b58-47b9-ba66-29a517f105ef] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:18:17.443858 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2a63d6b7-7c9b-4be1-b063-098e4c7178ff tempest-TestNetworkAdvancedServerOps-958360157 tempest-TestNetworkAdvancedServerOps-958360157-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:18:17.444739 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2a63d6b7-7c9b-4be1-b063-098e4c7178ff tempest-TestNetworkAdvancedServerOps-958360157 tempest-TestNetworkAdvancedServerOps-958360157-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:18:17.445676 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2a63d6b7-7c9b-4be1-b063-098e4c7178ff tempest-TestNetworkAdvancedServerOps-958360157 tempest-TestNetworkAdvancedServerOps-958360157-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:18:17.446226 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2a63d6b7-7c9b-4be1-b063-098e4c7178ff tempest-TestNetworkAdvancedServerOps-958360157 tempest-TestNetworkAdvancedServerOps-958360157-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:18:17.606589 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2a63d6b7-7c9b-4be1-b063-098e4c7178ff tempest-TestNetworkAdvancedServerOps-958360157 tempest-TestNetworkAdvancedServerOps-958360157-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/de6b8c07-8b58-47b9-ba66-29a517f105ef" status: 200 len: 1833 microversion: 2.1 time: 0.177594 Jan 15 21:18:17.607656 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3347/6696] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:18:17 2022] GET /compute/v2.1/servers/de6b8c07-8b58-47b9-ba66-29a517f105ef => generated 1833 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:18:17.629004 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-65f20e77-b4e1-4164-98f6-f0c4d2d103ea tempest-TestNetworkAdvancedServerOps-958360157 tempest-TestNetworkAdvancedServerOps-958360157-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:18:17.635022 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-65f20e77-b4e1-4164-98f6-f0c4d2d103ea tempest-TestNetworkAdvancedServerOps-958360157 tempest-TestNetworkAdvancedServerOps-958360157-project-admin] [instance: de6b8c07-8b58-47b9-ba66-29a517f105ef] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:18:17.654927 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-65f20e77-b4e1-4164-98f6-f0c4d2d103ea tempest-TestNetworkAdvancedServerOps-958360157 tempest-TestNetworkAdvancedServerOps-958360157-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:18:17.655462 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-65f20e77-b4e1-4164-98f6-f0c4d2d103ea tempest-TestNetworkAdvancedServerOps-958360157 tempest-TestNetworkAdvancedServerOps-958360157-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:18:17.656411 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-65f20e77-b4e1-4164-98f6-f0c4d2d103ea tempest-TestNetworkAdvancedServerOps-958360157 tempest-TestNetworkAdvancedServerOps-958360157-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:18:17.656942 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-65f20e77-b4e1-4164-98f6-f0c4d2d103ea tempest-TestNetworkAdvancedServerOps-958360157 tempest-TestNetworkAdvancedServerOps-958360157-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:18:17.691027 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.objects.instance [None req-65f20e77-b4e1-4164-98f6-f0c4d2d103ea tempest-TestNetworkAdvancedServerOps-958360157 tempest-TestNetworkAdvancedServerOps-958360157-project-admin] Lazy-loading 'flavor' on Instance uuid de6b8c07-8b58-47b9-ba66-29a517f105ef {{(pid=129366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 21:18:17.718653 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-65f20e77-b4e1-4164-98f6-f0c4d2d103ea tempest-TestNetworkAdvancedServerOps-958360157 tempest-TestNetworkAdvancedServerOps-958360157-project-admin] [instance: de6b8c07-8b58-47b9-ba66-29a517f105ef] Going to try to live migrate instance to another host {{(pid=129366) live_migrate /opt/stack/nova/nova/compute/api.py:5255}} Jan 15 21:18:20.018114 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-65f20e77-b4e1-4164-98f6-f0c4d2d103ea tempest-TestNetworkAdvancedServerOps-958360157 tempest-TestNetworkAdvancedServerOps-958360157-project-admin] 10.222.0.46 "POST /compute/v2.1/servers/de6b8c07-8b58-47b9-ba66-29a517f105ef/action" status: 202 len: 0 microversion: 2.1 time: 2.396685 Jan 15 21:18:20.019058 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3350/6697] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:18:17 2022] POST /compute/v2.1/servers/de6b8c07-8b58-47b9-ba66-29a517f105ef/action => generated 0 bytes in 2398 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:18:20.030301 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f1bb904f-6670-4d70-90e4-7176f1e42fee tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:18:20.031921 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f1bb904f-6670-4d70-90e4-7176f1e42fee tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: de6b8c07-8b58-47b9-ba66-29a517f105ef] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:18:20.078428 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f1bb904f-6670-4d70-90e4-7176f1e42fee tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:18:20.079387 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f1bb904f-6670-4d70-90e4-7176f1e42fee tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:18:20.081330 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f1bb904f-6670-4d70-90e4-7176f1e42fee tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:18:20.082031 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f1bb904f-6670-4d70-90e4-7176f1e42fee tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:18:20.457406 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-f1bb904f-6670-4d70-90e4-7176f1e42fee tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:18:20.469217 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f1bb904f-6670-4d70-90e4-7176f1e42fee tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/de6b8c07-8b58-47b9-ba66-29a517f105ef" status: 200 len: 1692 microversion: 2.1 time: 0.445626 Jan 15 21:18:20.470689 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3348/6698] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:18:20 2022] GET /compute/v2.1/servers/de6b8c07-8b58-47b9-ba66-29a517f105ef => generated 1692 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:18:21.394264 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-05dbbad0-aae3-4092-b7b0-2310ace01ab3 req-165ac444-b8ad-44af-ac61-01567afc27f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de6b8c07-8b58-47b9-ba66-29a517f105ef", "name": "network-vif-unplugged", "status": "completed", "tag": "fdfa8ea6-1cbd-4860-b0c5-c0801d8e3ecc"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:18:21.396977 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:18:21.396977 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:18:21.423126 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-05dbbad0-aae3-4092-b7b0-2310ace01ab3 req-165ac444-b8ad-44af-ac61-01567afc27f2 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:18:21.423706 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-05dbbad0-aae3-4092-b7b0-2310ace01ab3 req-165ac444-b8ad-44af-ac61-01567afc27f2 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:18:21.445765 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-05dbbad0-aae3-4092-b7b0-2310ace01ab3 req-165ac444-b8ad-44af-ac61-01567afc27f2 service nova] Creating event network-vif-unplugged:fdfa8ea6-1cbd-4860-b0c5-c0801d8e3ecc for instance de6b8c07-8b58-47b9-ba66-29a517f105ef on nch1-master-1 Jan 15 21:18:21.466284 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-05dbbad0-aae3-4092-b7b0-2310ace01ab3 req-165ac444-b8ad-44af-ac61-01567afc27f2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.076378 Jan 15 21:18:21.467044 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3351/6699] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:18:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 21:18:21.488527 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-eec879cd-1007-4135-a5e6-e932b61dffac tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:18:21.489745 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-eec879cd-1007-4135-a5e6-e932b61dffac tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: de6b8c07-8b58-47b9-ba66-29a517f105ef] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:18:21.503875 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-eec879cd-1007-4135-a5e6-e932b61dffac tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:18:21.504444 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-eec879cd-1007-4135-a5e6-e932b61dffac tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:18:21.507040 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-eec879cd-1007-4135-a5e6-e932b61dffac tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:18:21.510968 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-eec879cd-1007-4135-a5e6-e932b61dffac tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:18:21.935351 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-eec879cd-1007-4135-a5e6-e932b61dffac tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:18:21.943159 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-eec879cd-1007-4135-a5e6-e932b61dffac tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/de6b8c07-8b58-47b9-ba66-29a517f105ef" status: 200 len: 1692 microversion: 2.1 time: 0.459438 Jan 15 21:18:21.954498 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3349/6700] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:18:21 2022] GET /compute/v2.1/servers/de6b8c07-8b58-47b9-ba66-29a517f105ef => generated 1692 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:18:22.841185 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-40942d0f-5750-41a4-991c-ef95267abcb4 req-914d9f7d-a3e8-4fec-ba35-b5d6181e8bf0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de6b8c07-8b58-47b9-ba66-29a517f105ef", "name": "network-vif-plugged", "status": "completed", "tag": "fdfa8ea6-1cbd-4860-b0c5-c0801d8e3ecc"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:18:22.843441 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:18:22.843441 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:18:22.851757 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-40942d0f-5750-41a4-991c-ef95267abcb4 req-914d9f7d-a3e8-4fec-ba35-b5d6181e8bf0 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:18:22.852409 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-40942d0f-5750-41a4-991c-ef95267abcb4 req-914d9f7d-a3e8-4fec-ba35-b5d6181e8bf0 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:18:22.865604 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-40942d0f-5750-41a4-991c-ef95267abcb4 req-914d9f7d-a3e8-4fec-ba35-b5d6181e8bf0 service nova] Creating event network-vif-plugged:fdfa8ea6-1cbd-4860-b0c5-c0801d8e3ecc for instance de6b8c07-8b58-47b9-ba66-29a517f105ef on nch1-master-1 Jan 15 21:18:22.872454 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-40942d0f-5750-41a4-991c-ef95267abcb4 req-914d9f7d-a3e8-4fec-ba35-b5d6181e8bf0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036753 Jan 15 21:18:22.873660 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3352/6701] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:18:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:18:22.966649 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-1c6ea068-c18d-4167-9007-8546ec073834 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:18:22.968660 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-1c6ea068-c18d-4167-9007-8546ec073834 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: de6b8c07-8b58-47b9-ba66-29a517f105ef] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:18:22.980728 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1c6ea068-c18d-4167-9007-8546ec073834 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:18:22.981460 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1c6ea068-c18d-4167-9007-8546ec073834 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:18:22.983196 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1c6ea068-c18d-4167-9007-8546ec073834 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:18:22.983974 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1c6ea068-c18d-4167-9007-8546ec073834 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:18:23.491460 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-2efaff17-a0c8-44d5-9054-a63b8e9ae668 req-c6a6b0c3-94da-40c8-b0a8-a0e3d8f7d9ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de6b8c07-8b58-47b9-ba66-29a517f105ef", "tag": "fdfa8ea6-1cbd-4860-b0c5-c0801d8e3ecc"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:18:23.493001 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:18:23.493001 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:18:23.501923 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-2efaff17-a0c8-44d5-9054-a63b8e9ae668 req-c6a6b0c3-94da-40c8-b0a8-a0e3d8f7d9ca service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:18:23.505852 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-2efaff17-a0c8-44d5-9054-a63b8e9ae668 req-c6a6b0c3-94da-40c8-b0a8-a0e3d8f7d9ca service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:18:23.523131 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-2efaff17-a0c8-44d5-9054-a63b8e9ae668 req-c6a6b0c3-94da-40c8-b0a8-a0e3d8f7d9ca service nova] Creating event network-changed:fdfa8ea6-1cbd-4860-b0c5-c0801d8e3ecc for instance de6b8c07-8b58-47b9-ba66-29a517f105ef on nch1-master-1 Jan 15 21:18:23.530094 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-2efaff17-a0c8-44d5-9054-a63b8e9ae668 req-c6a6b0c3-94da-40c8-b0a8-a0e3d8f7d9ca service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043005 Jan 15 21:18:23.534822 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3353/6702] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:18:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:18:23.575635 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-1c6ea068-c18d-4167-9007-8546ec073834 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:18:23.598729 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-1c6ea068-c18d-4167-9007-8546ec073834 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/de6b8c07-8b58-47b9-ba66-29a517f105ef" status: 200 len: 1692 microversion: 2.1 time: 0.640685 Jan 15 21:18:23.599717 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3350/6703] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:18:22 2022] GET /compute/v2.1/servers/de6b8c07-8b58-47b9-ba66-29a517f105ef => generated 1692 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:18:24.623529 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-485af5ce-93f2-410a-ae3a-27756e2324d6 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:18:24.625355 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-485af5ce-93f2-410a-ae3a-27756e2324d6 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: de6b8c07-8b58-47b9-ba66-29a517f105ef] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:18:24.658833 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-485af5ce-93f2-410a-ae3a-27756e2324d6 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:18:24.663377 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-485af5ce-93f2-410a-ae3a-27756e2324d6 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:18:24.664239 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-485af5ce-93f2-410a-ae3a-27756e2324d6 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:18:24.669516 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-485af5ce-93f2-410a-ae3a-27756e2324d6 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:18:25.006373 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-485af5ce-93f2-410a-ae3a-27756e2324d6 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:18:25.022892 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-485af5ce-93f2-410a-ae3a-27756e2324d6 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/de6b8c07-8b58-47b9-ba66-29a517f105ef" status: 200 len: 1692 microversion: 2.1 time: 0.409722 Jan 15 21:18:25.024533 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3354/6704] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:18:24 2022] GET /compute/v2.1/servers/de6b8c07-8b58-47b9-ba66-29a517f105ef => generated 1692 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:18:26.046078 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-aab9fdcf-512e-436f-965d-74051e57b5dd tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:18:26.046755 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-aab9fdcf-512e-436f-965d-74051e57b5dd tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: de6b8c07-8b58-47b9-ba66-29a517f105ef] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:18:26.062743 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-aab9fdcf-512e-436f-965d-74051e57b5dd tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:18:26.063237 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-aab9fdcf-512e-436f-965d-74051e57b5dd tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:18:26.064122 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-aab9fdcf-512e-436f-965d-74051e57b5dd tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:18:26.064893 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-aab9fdcf-512e-436f-965d-74051e57b5dd tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:18:26.357995 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-aab9fdcf-512e-436f-965d-74051e57b5dd tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:18:26.370028 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-aab9fdcf-512e-436f-965d-74051e57b5dd tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/de6b8c07-8b58-47b9-ba66-29a517f105ef" status: 200 len: 1692 microversion: 2.1 time: 0.327498 Jan 15 21:18:26.381818 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3351/6705] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:18:26 2022] GET /compute/v2.1/servers/de6b8c07-8b58-47b9-ba66-29a517f105ef => generated 1692 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:18:27.387874 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7719b028-94c2-4195-9b0d-43d96bf67e45 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:18:27.388482 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-7719b028-94c2-4195-9b0d-43d96bf67e45 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: de6b8c07-8b58-47b9-ba66-29a517f105ef] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:18:27.401250 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7719b028-94c2-4195-9b0d-43d96bf67e45 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:18:27.402353 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7719b028-94c2-4195-9b0d-43d96bf67e45 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:18:27.403345 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7719b028-94c2-4195-9b0d-43d96bf67e45 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:18:27.410212 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7719b028-94c2-4195-9b0d-43d96bf67e45 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:18:27.641585 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-7719b028-94c2-4195-9b0d-43d96bf67e45 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:18:27.652151 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7719b028-94c2-4195-9b0d-43d96bf67e45 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/de6b8c07-8b58-47b9-ba66-29a517f105ef" status: 200 len: 1692 microversion: 2.1 time: 0.267416 Jan 15 21:18:27.653296 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3355/6706] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:18:27 2022] GET /compute/v2.1/servers/de6b8c07-8b58-47b9-ba66-29a517f105ef => generated 1692 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:18:28.676826 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-21010052-340b-42c9-9ca7-4cf731121541 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:18:28.679530 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-21010052-340b-42c9-9ca7-4cf731121541 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: de6b8c07-8b58-47b9-ba66-29a517f105ef] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:18:28.722865 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-21010052-340b-42c9-9ca7-4cf731121541 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:18:28.723586 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-21010052-340b-42c9-9ca7-4cf731121541 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:18:28.725669 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-21010052-340b-42c9-9ca7-4cf731121541 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:18:28.728795 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-21010052-340b-42c9-9ca7-4cf731121541 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:18:29.034022 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-6ffe4b15-e55a-4876-afd1-3b16dfb130ec req-9b801071-1f55-4a1e-a074-ba7820b6d01a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de6b8c07-8b58-47b9-ba66-29a517f105ef", "name": "network-vif-unplugged", "status": "completed", "tag": "fdfa8ea6-1cbd-4860-b0c5-c0801d8e3ecc"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:18:29.036028 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:18:29.036028 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:18:29.055365 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-6ffe4b15-e55a-4876-afd1-3b16dfb130ec req-9b801071-1f55-4a1e-a074-ba7820b6d01a service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:18:29.055948 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-6ffe4b15-e55a-4876-afd1-3b16dfb130ec req-9b801071-1f55-4a1e-a074-ba7820b6d01a service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:18:29.100671 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-6ffe4b15-e55a-4876-afd1-3b16dfb130ec req-9b801071-1f55-4a1e-a074-ba7820b6d01a service nova] Creating event network-vif-unplugged:fdfa8ea6-1cbd-4860-b0c5-c0801d8e3ecc for instance de6b8c07-8b58-47b9-ba66-29a517f105ef on nch1-master-1 Jan 15 21:18:29.118300 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-6ffe4b15-e55a-4876-afd1-3b16dfb130ec req-9b801071-1f55-4a1e-a074-ba7820b6d01a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.086792 Jan 15 21:18:29.120010 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3356/6707] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:18:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:18:29.237389 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-21010052-340b-42c9-9ca7-4cf731121541 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:18:29.259381 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-21010052-340b-42c9-9ca7-4cf731121541 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/de6b8c07-8b58-47b9-ba66-29a517f105ef" status: 200 len: 1692 microversion: 2.1 time: 0.580746 Jan 15 21:18:29.260677 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3352/6708] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:18:28 2022] GET /compute/v2.1/servers/de6b8c07-8b58-47b9-ba66-29a517f105ef => generated 1692 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:18:30.278752 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-13dbe768-fe25-43b4-9019-b7b6e0d7e4a8 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:18:30.279457 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-13dbe768-fe25-43b4-9019-b7b6e0d7e4a8 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: de6b8c07-8b58-47b9-ba66-29a517f105ef] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:18:30.295348 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-13dbe768-fe25-43b4-9019-b7b6e0d7e4a8 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:18:30.295803 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-13dbe768-fe25-43b4-9019-b7b6e0d7e4a8 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:18:30.296616 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-13dbe768-fe25-43b4-9019-b7b6e0d7e4a8 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:18:30.297088 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-13dbe768-fe25-43b4-9019-b7b6e0d7e4a8 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:18:30.626341 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-13dbe768-fe25-43b4-9019-b7b6e0d7e4a8 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:18:30.638471 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-13dbe768-fe25-43b4-9019-b7b6e0d7e4a8 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/de6b8c07-8b58-47b9-ba66-29a517f105ef" status: 200 len: 1692 microversion: 2.1 time: 0.364651 Jan 15 21:18:30.661807 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3357/6709] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:18:30 2022] GET /compute/v2.1/servers/de6b8c07-8b58-47b9-ba66-29a517f105ef => generated 1692 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:18:31.656397 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a5efa140-9ed6-4391-95d6-5eec7d889ea2 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:18:31.657233 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a5efa140-9ed6-4391-95d6-5eec7d889ea2 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: de6b8c07-8b58-47b9-ba66-29a517f105ef] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:18:31.667918 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a5efa140-9ed6-4391-95d6-5eec7d889ea2 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:18:31.675311 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a5efa140-9ed6-4391-95d6-5eec7d889ea2 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:18:31.676443 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a5efa140-9ed6-4391-95d6-5eec7d889ea2 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:18:31.676936 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a5efa140-9ed6-4391-95d6-5eec7d889ea2 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:18:32.021196 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-a5efa140-9ed6-4391-95d6-5eec7d889ea2 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:18:32.038945 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a5efa140-9ed6-4391-95d6-5eec7d889ea2 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/de6b8c07-8b58-47b9-ba66-29a517f105ef" status: 200 len: 1692 microversion: 2.1 time: 0.385585 Jan 15 21:18:32.041797 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3353/6710] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:18:31 2022] GET /compute/v2.1/servers/de6b8c07-8b58-47b9-ba66-29a517f105ef => generated 1692 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:18:33.059308 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f20a3446-fa56-43ea-842f-7853be0f2d94 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:18:33.059849 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f20a3446-fa56-43ea-842f-7853be0f2d94 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: de6b8c07-8b58-47b9-ba66-29a517f105ef] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:18:33.077737 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f20a3446-fa56-43ea-842f-7853be0f2d94 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:18:33.078548 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f20a3446-fa56-43ea-842f-7853be0f2d94 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:18:33.081436 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f20a3446-fa56-43ea-842f-7853be0f2d94 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:18:33.082406 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f20a3446-fa56-43ea-842f-7853be0f2d94 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:18:33.486100 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-f20a3446-fa56-43ea-842f-7853be0f2d94 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:18:33.505543 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f20a3446-fa56-43ea-842f-7853be0f2d94 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/de6b8c07-8b58-47b9-ba66-29a517f105ef" status: 200 len: 1682 microversion: 2.1 time: 0.443865 Jan 15 21:18:33.506817 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3358/6711] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:18:33 2022] GET /compute/v2.1/servers/de6b8c07-8b58-47b9-ba66-29a517f105ef => generated 1682 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:18:33.529104 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ab7e2efb-f4f1-4c38-b1ef-dec5c786c76b tempest-TestNetworkAdvancedServerOps-958360157 tempest-TestNetworkAdvancedServerOps-958360157-project-admin] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:18:33.538487 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ab7e2efb-f4f1-4c38-b1ef-dec5c786c76b tempest-TestNetworkAdvancedServerOps-958360157 tempest-TestNetworkAdvancedServerOps-958360157-project-admin] [instance: de6b8c07-8b58-47b9-ba66-29a517f105ef] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:18:33.553605 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ab7e2efb-f4f1-4c38-b1ef-dec5c786c76b tempest-TestNetworkAdvancedServerOps-958360157 tempest-TestNetworkAdvancedServerOps-958360157-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:18:33.554215 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ab7e2efb-f4f1-4c38-b1ef-dec5c786c76b tempest-TestNetworkAdvancedServerOps-958360157 tempest-TestNetworkAdvancedServerOps-958360157-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:18:33.555142 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ab7e2efb-f4f1-4c38-b1ef-dec5c786c76b tempest-TestNetworkAdvancedServerOps-958360157 tempest-TestNetworkAdvancedServerOps-958360157-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:18:33.556426 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ab7e2efb-f4f1-4c38-b1ef-dec5c786c76b tempest-TestNetworkAdvancedServerOps-958360157 tempest-TestNetworkAdvancedServerOps-958360157-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:18:33.916295 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ab7e2efb-f4f1-4c38-b1ef-dec5c786c76b tempest-TestNetworkAdvancedServerOps-958360157 tempest-TestNetworkAdvancedServerOps-958360157-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/de6b8c07-8b58-47b9-ba66-29a517f105ef" status: 200 len: 1833 microversion: 2.1 time: 0.395578 Jan 15 21:18:33.929321 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3354/6712] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:18:33 2022] GET /compute/v2.1/servers/de6b8c07-8b58-47b9-ba66-29a517f105ef => generated 1833 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:18:33.934849 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-5d439c6f-0ec5-4144-83ec-335f551da4b8 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:18:33.935810 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-5d439c6f-0ec5-4144-83ec-335f551da4b8 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: de6b8c07-8b58-47b9-ba66-29a517f105ef] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:18:33.946411 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5d439c6f-0ec5-4144-83ec-335f551da4b8 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:18:33.950372 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5d439c6f-0ec5-4144-83ec-335f551da4b8 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:18:33.953377 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5d439c6f-0ec5-4144-83ec-335f551da4b8 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:18:33.954039 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5d439c6f-0ec5-4144-83ec-335f551da4b8 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:18:34.516483 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-5d439c6f-0ec5-4144-83ec-335f551da4b8 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:18:34.531924 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-5d439c6f-0ec5-4144-83ec-335f551da4b8 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/de6b8c07-8b58-47b9-ba66-29a517f105ef" status: 200 len: 1682 microversion: 2.1 time: 0.602181 Jan 15 21:18:34.533950 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3359/6713] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:18:33 2022] GET /compute/v2.1/servers/de6b8c07-8b58-47b9-ba66-29a517f105ef => generated 1682 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:18:34.904994 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-fb4ae076-b9d1-4771-af3c-ee3d02b87223 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:18:34.906729 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-fb4ae076-b9d1-4771-af3c-ee3d02b87223 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: de6b8c07-8b58-47b9-ba66-29a517f105ef] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:18:34.921969 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fb4ae076-b9d1-4771-af3c-ee3d02b87223 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:18:34.924374 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fb4ae076-b9d1-4771-af3c-ee3d02b87223 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:18:34.925666 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fb4ae076-b9d1-4771-af3c-ee3d02b87223 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:18:34.927945 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fb4ae076-b9d1-4771-af3c-ee3d02b87223 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:18:35.015648 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-fb4ae076-b9d1-4771-af3c-ee3d02b87223 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "POST /compute/v2.1/servers/de6b8c07-8b58-47b9-ba66-29a517f105ef/action" status: 200 len: 38630 microversion: 2.1 time: 0.125447 Jan 15 21:18:35.016498 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3355/6714] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:18:34 2022] POST /compute/v2.1/servers/de6b8c07-8b58-47b9-ba66-29a517f105ef/action => generated 38630 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:18:38.454873 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8994592b-c6a5-4ec3-8c4f-c34a4216ac9a tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:18:38.456360 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-8994592b-c6a5-4ec3-8c4f-c34a4216ac9a tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: de6b8c07-8b58-47b9-ba66-29a517f105ef] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:18:38.464691 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8994592b-c6a5-4ec3-8c4f-c34a4216ac9a tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:18:38.465301 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8994592b-c6a5-4ec3-8c4f-c34a4216ac9a tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:18:38.466364 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8994592b-c6a5-4ec3-8c4f-c34a4216ac9a tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:18:38.466905 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8994592b-c6a5-4ec3-8c4f-c34a4216ac9a tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:18:38.502096 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-8994592b-c6a5-4ec3-8c4f-c34a4216ac9a tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: de6b8c07-8b58-47b9-ba66-29a517f105ef] Going to try to terminate instance {{(pid=129366) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 21:18:38.679443 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-8994592b-c6a5-4ec3-8c4f-c34a4216ac9a tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "DELETE /compute/v2.1/servers/de6b8c07-8b58-47b9-ba66-29a517f105ef" status: 204 len: 0 microversion: 2.1 time: 0.228575 Jan 15 21:18:38.691170 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3360/6715] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 21:18:38 2022] DELETE /compute/v2.1/servers/de6b8c07-8b58-47b9-ba66-29a517f105ef => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 21:18:38.708706 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-2ba437e7-31e1-4e33-b71a-f3999e3672be tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:18:38.710043 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-2ba437e7-31e1-4e33-b71a-f3999e3672be tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: de6b8c07-8b58-47b9-ba66-29a517f105ef] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:18:38.717301 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2ba437e7-31e1-4e33-b71a-f3999e3672be tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:18:38.718017 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2ba437e7-31e1-4e33-b71a-f3999e3672be tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:18:38.719053 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2ba437e7-31e1-4e33-b71a-f3999e3672be tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:18:38.719720 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2ba437e7-31e1-4e33-b71a-f3999e3672be tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:18:38.870648 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-86cae507-2206-494c-add9-ab89269decae req-455139b0-9e10-4f47-873d-4c917063c11e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de6b8c07-8b58-47b9-ba66-29a517f105ef", "tag": "fdfa8ea6-1cbd-4860-b0c5-c0801d8e3ecc"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:18:38.872545 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:18:38.872545 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:18:38.890373 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-86cae507-2206-494c-add9-ab89269decae req-455139b0-9e10-4f47-873d-4c917063c11e service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:18:38.891311 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-86cae507-2206-494c-add9-ab89269decae req-455139b0-9e10-4f47-873d-4c917063c11e service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:18:38.904632 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-86cae507-2206-494c-add9-ab89269decae req-455139b0-9e10-4f47-873d-4c917063c11e service nova] Creating event network-changed:fdfa8ea6-1cbd-4860-b0c5-c0801d8e3ecc for instance de6b8c07-8b58-47b9-ba66-29a517f105ef on nch2-master-1 Jan 15 21:18:38.912760 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-86cae507-2206-494c-add9-ab89269decae req-455139b0-9e10-4f47-873d-4c917063c11e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.454228 Jan 15 21:18:38.915617 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3356/6716] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:18:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:18:39.245106 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-2ba437e7-31e1-4e33-b71a-f3999e3672be tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:18:39.253070 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-2ba437e7-31e1-4e33-b71a-f3999e3672be tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/de6b8c07-8b58-47b9-ba66-29a517f105ef" status: 200 len: 1688 microversion: 2.1 time: 0.555769 Jan 15 21:18:39.253663 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3361/6717] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:18:38 2022] GET /compute/v2.1/servers/de6b8c07-8b58-47b9-ba66-29a517f105ef => generated 1688 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:18:39.637191 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-7eae238e-4a52-483b-bd95-20d7fc30c5c6 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1729597540", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "274cedd9-95a5-4b3a-a418-b81944457fed", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "250ac663-a6c2-4755-b702-91a1aec1e824"}]}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:18:39.894958 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.network.neutron [None req-7eae238e-4a52-483b-bd95-20d7fc30c5c6 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] validate_networks() for [('250ac663-a6c2-4755-b702-91a1aec1e824', None, None, None, None, None)] {{(pid=129365) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 21:18:40.272486 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-2ef12466-e408-4117-9acd-1e8aed4ae478 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:18:40.274449 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-2ef12466-e408-4117-9acd-1e8aed4ae478 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: de6b8c07-8b58-47b9-ba66-29a517f105ef] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:18:40.289002 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2ef12466-e408-4117-9acd-1e8aed4ae478 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:18:40.290098 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2ef12466-e408-4117-9acd-1e8aed4ae478 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:18:40.290973 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2ef12466-e408-4117-9acd-1e8aed4ae478 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:18:40.291433 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2ef12466-e408-4117-9acd-1e8aed4ae478 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:18:41.094610 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-2ef12466-e408-4117-9acd-1e8aed4ae478 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:18:41.107567 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-2ef12466-e408-4117-9acd-1e8aed4ae478 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/de6b8c07-8b58-47b9-ba66-29a517f105ef" status: 200 len: 1688 microversion: 2.1 time: 0.839764 Jan 15 21:18:41.108160 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3362/6718] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:18:40 2022] GET /compute/v2.1/servers/de6b8c07-8b58-47b9-ba66-29a517f105ef => generated 1688 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:18:41.129912 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-7eae238e-4a52-483b-bd95-20d7fc30c5c6 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Flavor limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 21:18:41.130448 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-7eae238e-4a52-483b-bd95-20d7fc30c5c6 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Image limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 21:18:41.131308 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-7eae238e-4a52-483b-bd95-20d7fc30c5c6 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Flavor pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 21:18:41.134016 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-7eae238e-4a52-483b-bd95-20d7fc30c5c6 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Image pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 21:18:41.143615 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-7eae238e-4a52-483b-bd95-20d7fc30c5c6 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 21:18:41.187398 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7eae238e-4a52-483b-bd95-20d7fc30c5c6 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:18:41.187895 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7eae238e-4a52-483b-bd95-20d7fc30c5c6 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:18:41.189358 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7eae238e-4a52-483b-bd95-20d7fc30c5c6 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:18:41.189805 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7eae238e-4a52-483b-bd95-20d7fc30c5c6 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:18:41.226616 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-7eae238e-4a52-483b-bd95-20d7fc30c5c6 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Getting quotas for project 7f2ae6f05c2843469190cd96f39ac794. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:18:41.241382 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-7eae238e-4a52-483b-bd95-20d7fc30c5c6 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Getting quotas for user f0fc1955b0d446458f8f355550de971b and project 7f2ae6f05c2843469190cd96f39ac794. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:18:41.286319 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-7eae238e-4a52-483b-bd95-20d7fc30c5c6 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Going to run 1 instances... {{(pid=129365) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 21:18:41.295501 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-7eae238e-4a52-483b-bd95-20d7fc30c5c6 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: 15929a27-a8a3-435f-a31c-4abbddfcb142] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='274cedd9-95a5-4b3a-a418-b81944457fed',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129365) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 21:18:41.493473 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-7eae238e-4a52-483b-bd95-20d7fc30c5c6 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.857846 Jan 15 21:18:41.495289 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3357/6719] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 21:18:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1865 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 21:18:41.505945 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4b4c6349-92fd-4200-ac86-d7c344b63e69 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:18:41.507259 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-4b4c6349-92fd-4200-ac86-d7c344b63e69 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: 15929a27-a8a3-435f-a31c-4abbddfcb142] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:18:41.890542 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-53ce8391-2761-4f0a-b554-c849c953a963 req-477d054e-6300-4dc9-9f44-751d16ea77d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de6b8c07-8b58-47b9-ba66-29a517f105ef", "name": "network-vif-deleted", "tag": "fdfa8ea6-1cbd-4860-b0c5-c0801d8e3ecc"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:18:41.892739 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:18:41.892739 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:18:41.913813 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-53ce8391-2761-4f0a-b554-c849c953a963 req-477d054e-6300-4dc9-9f44-751d16ea77d3 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:18:41.914710 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-53ce8391-2761-4f0a-b554-c849c953a963 req-477d054e-6300-4dc9-9f44-751d16ea77d3 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:18:41.957431 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-53ce8391-2761-4f0a-b554-c849c953a963 req-477d054e-6300-4dc9-9f44-751d16ea77d3 service nova] Creating event network-vif-deleted:fdfa8ea6-1cbd-4860-b0c5-c0801d8e3ecc for instance de6b8c07-8b58-47b9-ba66-29a517f105ef on nch2-master-1 Jan 15 21:18:41.978089 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-53ce8391-2761-4f0a-b554-c849c953a963 req-477d054e-6300-4dc9-9f44-751d16ea77d3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091344 Jan 15 21:18:41.982610 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3358/6720] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:18:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:18:42.171271 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-02361299-b703-41f9-b385-f078aca1aec7 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:18:42.172125 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-02361299-b703-41f9-b385-f078aca1aec7 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: de6b8c07-8b58-47b9-ba66-29a517f105ef] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:18:42.202581 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-02361299-b703-41f9-b385-f078aca1aec7 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:18:42.260208 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-02361299-b703-41f9-b385-f078aca1aec7 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:18:42.266614 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-02361299-b703-41f9-b385-f078aca1aec7 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:18:42.270535 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-02361299-b703-41f9-b385-f078aca1aec7 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:18:42.276435 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-4b4c6349-92fd-4200-ac86-d7c344b63e69 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fc1955b0d446458f8f355550de971b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ae6f05c2843469190cd96f39ac794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:18:42.308059 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-4b4c6349-92fd-4200-ac86-d7c344b63e69 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] 10.222.0.46 "GET /compute/v2.1/servers/15929a27-a8a3-435f-a31c-4abbddfcb142" status: 200 len: 1057 microversion: 2.1 time: 0.805865 Jan 15 21:18:42.308597 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3363/6721] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:18:41 2022] GET /compute/v2.1/servers/15929a27-a8a3-435f-a31c-4abbddfcb142 => generated 1057 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:18:42.829316 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-02361299-b703-41f9-b385-f078aca1aec7 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:18:42.839916 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-02361299-b703-41f9-b385-f078aca1aec7 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/de6b8c07-8b58-47b9-ba66-29a517f105ef" status: 200 len: 1352 microversion: 2.1 time: 0.716609 Jan 15 21:18:42.842749 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3359/6722] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:18:42 2022] GET /compute/v2.1/servers/de6b8c07-8b58-47b9-ba66-29a517f105ef => generated 1352 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:18:43.325545 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-857e70b7-8393-4234-9145-1d96ac40a807 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:18:43.326197 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-857e70b7-8393-4234-9145-1d96ac40a807 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: 15929a27-a8a3-435f-a31c-4abbddfcb142] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:18:43.339749 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-857e70b7-8393-4234-9145-1d96ac40a807 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:18:43.343232 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-857e70b7-8393-4234-9145-1d96ac40a807 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:18:43.346138 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-857e70b7-8393-4234-9145-1d96ac40a807 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:18:43.347911 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-857e70b7-8393-4234-9145-1d96ac40a807 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:18:43.544429 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-857e70b7-8393-4234-9145-1d96ac40a807 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fc1955b0d446458f8f355550de971b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ae6f05c2843469190cd96f39ac794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:18:43.554378 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-857e70b7-8393-4234-9145-1d96ac40a807 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] 10.222.0.46 "GET /compute/v2.1/servers/15929a27-a8a3-435f-a31c-4abbddfcb142" status: 200 len: 1127 microversion: 2.1 time: 0.232909 Jan 15 21:18:43.560110 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3364/6723] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:18:43 2022] GET /compute/v2.1/servers/15929a27-a8a3-435f-a31c-4abbddfcb142 => generated 1127 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:18:43.860972 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5fc7cf39-f810-4607-be50-8533e74d4a98 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:18:43.861790 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-5fc7cf39-f810-4607-be50-8533e74d4a98 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: de6b8c07-8b58-47b9-ba66-29a517f105ef] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:18:43.877077 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5fc7cf39-f810-4607-be50-8533e74d4a98 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:18:43.879738 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5fc7cf39-f810-4607-be50-8533e74d4a98 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:18:43.882459 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5fc7cf39-f810-4607-be50-8533e74d4a98 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:18:43.886349 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5fc7cf39-f810-4607-be50-8533e74d4a98 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:18:43.937308 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-5fc7cf39-f810-4607-be50-8533e74d4a98 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] HTTP exception thrown: Instance de6b8c07-8b58-47b9-ba66-29a517f105ef could not be found. Jan 15 21:18:43.940539 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5fc7cf39-f810-4607-be50-8533e74d4a98 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Returning 404 to user: Instance de6b8c07-8b58-47b9-ba66-29a517f105ef could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:18:43.941478 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5fc7cf39-f810-4607-be50-8533e74d4a98 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/de6b8c07-8b58-47b9-ba66-29a517f105ef" status: 404 len: 111 microversion: 2.1 time: 0.085746 Jan 15 21:18:43.942514 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3360/6724] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:18:43 2022] GET /compute/v2.1/servers/de6b8c07-8b58-47b9-ba66-29a517f105ef => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:18:44.573920 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e9cbd2af-c2c6-44ac-ade3-f87f8f1354cf tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:18:44.575203 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e9cbd2af-c2c6-44ac-ade3-f87f8f1354cf tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: 15929a27-a8a3-435f-a31c-4abbddfcb142] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:18:44.587684 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e9cbd2af-c2c6-44ac-ade3-f87f8f1354cf tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:18:44.589001 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e9cbd2af-c2c6-44ac-ade3-f87f8f1354cf tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:18:44.590131 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e9cbd2af-c2c6-44ac-ade3-f87f8f1354cf tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:18:44.590776 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e9cbd2af-c2c6-44ac-ade3-f87f8f1354cf tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:18:45.330302 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-e9cbd2af-c2c6-44ac-ade3-f87f8f1354cf tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fc1955b0d446458f8f355550de971b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ae6f05c2843469190cd96f39ac794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:18:45.342346 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e9cbd2af-c2c6-44ac-ade3-f87f8f1354cf tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] 10.222.0.46 "GET /compute/v2.1/servers/15929a27-a8a3-435f-a31c-4abbddfcb142" status: 200 len: 1169 microversion: 2.1 time: 0.773902 Jan 15 21:18:45.345810 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3365/6725] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:18:44 2022] GET /compute/v2.1/servers/15929a27-a8a3-435f-a31c-4abbddfcb142 => generated 1169 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:18:45.884306 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-8f7f5887-c040-482d-8c4e-ef300c5dfb8d req-9441a2cb-3992-4155-9c78-af293f63aad1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15929a27-a8a3-435f-a31c-4abbddfcb142", "tag": "413745ec-f8bf-4c8c-91e8-e735e6ecab61"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:18:45.902361 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:18:45.902361 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:18:45.933182 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-8f7f5887-c040-482d-8c4e-ef300c5dfb8d req-9441a2cb-3992-4155-9c78-af293f63aad1 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:18:45.933644 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-8f7f5887-c040-482d-8c4e-ef300c5dfb8d req-9441a2cb-3992-4155-9c78-af293f63aad1 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:18:45.962921 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-8f7f5887-c040-482d-8c4e-ef300c5dfb8d req-9441a2cb-3992-4155-9c78-af293f63aad1 service nova] Creating event network-changed:413745ec-f8bf-4c8c-91e8-e735e6ecab61 for instance 15929a27-a8a3-435f-a31c-4abbddfcb142 on nch1-master-1 Jan 15 21:18:45.970783 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-8f7f5887-c040-482d-8c4e-ef300c5dfb8d req-9441a2cb-3992-4155-9c78-af293f63aad1 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091902 Jan 15 21:18:45.972195 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3361/6726] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:18:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:18:46.363311 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e33d3f3c-1654-4aba-80df-569efe204cdc tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:18:46.364204 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e33d3f3c-1654-4aba-80df-569efe204cdc tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: 15929a27-a8a3-435f-a31c-4abbddfcb142] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:18:46.386625 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e33d3f3c-1654-4aba-80df-569efe204cdc tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:18:46.390603 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e33d3f3c-1654-4aba-80df-569efe204cdc tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:18:46.393336 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e33d3f3c-1654-4aba-80df-569efe204cdc tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:18:46.393874 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e33d3f3c-1654-4aba-80df-569efe204cdc tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:18:46.894436 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-e33d3f3c-1654-4aba-80df-569efe204cdc tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fc1955b0d446458f8f355550de971b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ae6f05c2843469190cd96f39ac794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:18:46.909450 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-697b59ff-47c2-4822-80d5-089caa8fe0ef tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-1032722014", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "networks": [{"uuid": "08142f91-41be-481b-8c94-bfc6c2841073"}], "key_name": "tempest-TestSecurityGroupsBasicOps-870193259", "security_groups": []}, "os:scheduler_hints": {"different_host": ["c46baa1b-9f5b-42ce-a3f8-f1432c526691"]}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:18:46.920139 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e33d3f3c-1654-4aba-80df-569efe204cdc tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] 10.222.0.46 "GET /compute/v2.1/servers/15929a27-a8a3-435f-a31c-4abbddfcb142" status: 200 len: 1169 microversion: 2.1 time: 0.560389 Jan 15 21:18:46.920757 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3366/6727] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:18:46 2022] GET /compute/v2.1/servers/15929a27-a8a3-435f-a31c-4abbddfcb142 => generated 1169 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:18:47.004684 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.network.neutron [None req-697b59ff-47c2-4822-80d5-089caa8fe0ef tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] validate_networks() for [('08142f91-41be-481b-8c94-bfc6c2841073', None, None, None, None, None)] {{(pid=129365) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 21:18:47.937735 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b5371cdb-4040-4f3c-a8fb-6919403d0ff2 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:18:47.938505 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b5371cdb-4040-4f3c-a8fb-6919403d0ff2 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: 15929a27-a8a3-435f-a31c-4abbddfcb142] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:18:47.951783 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b5371cdb-4040-4f3c-a8fb-6919403d0ff2 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:18:47.952992 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b5371cdb-4040-4f3c-a8fb-6919403d0ff2 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:18:47.958933 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b5371cdb-4040-4f3c-a8fb-6919403d0ff2 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:18:47.959759 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b5371cdb-4040-4f3c-a8fb-6919403d0ff2 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:18:48.513223 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-b5371cdb-4040-4f3c-a8fb-6919403d0ff2 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fc1955b0d446458f8f355550de971b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ae6f05c2843469190cd96f39ac794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:18:48.526130 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b5371cdb-4040-4f3c-a8fb-6919403d0ff2 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] 10.222.0.46 "GET /compute/v2.1/servers/15929a27-a8a3-435f-a31c-4abbddfcb142" status: 200 len: 1169 microversion: 2.1 time: 0.592344 Jan 15 21:18:48.535391 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3367/6728] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:18:47 2022] GET /compute/v2.1/servers/15929a27-a8a3-435f-a31c-4abbddfcb142 => generated 1169 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:18:49.324249 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-697b59ff-47c2-4822-80d5-089caa8fe0ef tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Flavor limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 21:18:49.324738 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-697b59ff-47c2-4822-80d5-089caa8fe0ef tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Image limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 21:18:49.325206 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-697b59ff-47c2-4822-80d5-089caa8fe0ef tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Flavor pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 21:18:49.325622 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-697b59ff-47c2-4822-80d5-089caa8fe0ef tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Image pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 21:18:49.326040 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-697b59ff-47c2-4822-80d5-089caa8fe0ef tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 21:18:49.349515 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-697b59ff-47c2-4822-80d5-089caa8fe0ef tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:18:49.365464 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-697b59ff-47c2-4822-80d5-089caa8fe0ef tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:18:49.366594 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-697b59ff-47c2-4822-80d5-089caa8fe0ef tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:18:49.367053 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-697b59ff-47c2-4822-80d5-089caa8fe0ef tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:18:49.435580 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-697b59ff-47c2-4822-80d5-089caa8fe0ef tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Getting quotas for project 5b63757470b845b3ad6e5b18314f2c57. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:18:49.456671 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-697b59ff-47c2-4822-80d5-089caa8fe0ef tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Getting quotas for user 3740026776904d36be28fd3a206a3361 and project 5b63757470b845b3ad6e5b18314f2c57. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:18:49.493221 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-697b59ff-47c2-4822-80d5-089caa8fe0ef tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Going to run 1 instances... {{(pid=129365) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 21:18:49.499747 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-697b59ff-47c2-4822-80d5-089caa8fe0ef tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] [instance: e8d37bbd-bee9-4a16-9633-2d26ea56a884] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129365) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 21:18:49.544232 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4bbf1dcd-d469-45eb-912d-939e29a010d4 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:18:49.544873 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-4bbf1dcd-d469-45eb-912d-939e29a010d4 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: 15929a27-a8a3-435f-a31c-4abbddfcb142] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:18:49.569642 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4bbf1dcd-d469-45eb-912d-939e29a010d4 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:18:49.573488 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4bbf1dcd-d469-45eb-912d-939e29a010d4 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:18:49.574547 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4bbf1dcd-d469-45eb-912d-939e29a010d4 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:18:49.579379 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4bbf1dcd-d469-45eb-912d-939e29a010d4 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:18:49.627761 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-697b59ff-47c2-4822-80d5-089caa8fe0ef tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 2.727778 Jan 15 21:18:49.633868 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3362/6729] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 21:18:46 2022] POST /compute/v2.1/servers => generated 361 bytes in 2735 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 15 21:18:49.646171 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-66f2ca44-f9c6-42e2-a7d6-0f6454daa6b4 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:18:49.650934 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-66f2ca44-f9c6-42e2-a7d6-0f6454daa6b4 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] [instance: e8d37bbd-bee9-4a16-9633-2d26ea56a884] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:18:49.819909 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-66f2ca44-f9c6-42e2-a7d6-0f6454daa6b4 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3740026776904d36be28fd3a206a3361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b63757470b845b3ad6e5b18314f2c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:18:49.827938 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-66f2ca44-f9c6-42e2-a7d6-0f6454daa6b4 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] 10.222.0.46 "GET /compute/v2.1/servers/e8d37bbd-bee9-4a16-9633-2d26ea56a884" status: 200 len: 1241 microversion: 2.1 time: 0.185793 Jan 15 21:18:49.828534 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3363/6730] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:18:49 2022] GET /compute/v2.1/servers/e8d37bbd-bee9-4a16-9633-2d26ea56a884 => generated 1241 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:18:50.511531 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-4bbf1dcd-d469-45eb-912d-939e29a010d4 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fc1955b0d446458f8f355550de971b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ae6f05c2843469190cd96f39ac794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:18:50.521148 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-4bbf1dcd-d469-45eb-912d-939e29a010d4 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] 10.222.0.46 "GET /compute/v2.1/servers/15929a27-a8a3-435f-a31c-4abbddfcb142" status: 200 len: 1215 microversion: 2.1 time: 0.980414 Jan 15 21:18:50.525029 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3368/6731] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:18:49 2022] GET /compute/v2.1/servers/15929a27-a8a3-435f-a31c-4abbddfcb142 => generated 1215 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:18:50.845676 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b9bfcb3c-d114-4be7-95a4-5a6fad4c7016 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:18:50.846450 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b9bfcb3c-d114-4be7-95a4-5a6fad4c7016 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] [instance: e8d37bbd-bee9-4a16-9633-2d26ea56a884] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:18:50.860931 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b9bfcb3c-d114-4be7-95a4-5a6fad4c7016 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:18:50.868620 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b9bfcb3c-d114-4be7-95a4-5a6fad4c7016 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:18:50.869779 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b9bfcb3c-d114-4be7-95a4-5a6fad4c7016 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:18:50.874527 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b9bfcb3c-d114-4be7-95a4-5a6fad4c7016 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:18:51.014469 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-b9bfcb3c-d114-4be7-95a4-5a6fad4c7016 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3740026776904d36be28fd3a206a3361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b63757470b845b3ad6e5b18314f2c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:18:51.022143 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b9bfcb3c-d114-4be7-95a4-5a6fad4c7016 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] 10.222.0.46 "GET /compute/v2.1/servers/e8d37bbd-bee9-4a16-9633-2d26ea56a884" status: 200 len: 1293 microversion: 2.1 time: 0.180246 Jan 15 21:18:51.025712 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3364/6732] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:18:50 2022] GET /compute/v2.1/servers/e8d37bbd-bee9-4a16-9633-2d26ea56a884 => generated 1293 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:18:51.543386 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a8e0a9ce-f5d0-4c87-80d8-267ed354b494 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:18:51.544339 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a8e0a9ce-f5d0-4c87-80d8-267ed354b494 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: 15929a27-a8a3-435f-a31c-4abbddfcb142] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:18:51.584362 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a8e0a9ce-f5d0-4c87-80d8-267ed354b494 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:18:51.589642 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a8e0a9ce-f5d0-4c87-80d8-267ed354b494 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:18:51.599791 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a8e0a9ce-f5d0-4c87-80d8-267ed354b494 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:18:51.602688 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a8e0a9ce-f5d0-4c87-80d8-267ed354b494 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:18:52.043079 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-7a0a2121-bc46-4e43-9314-0277e75c9218 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:18:52.045064 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-7a0a2121-bc46-4e43-9314-0277e75c9218 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] [instance: e8d37bbd-bee9-4a16-9633-2d26ea56a884] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:18:52.053000 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7a0a2121-bc46-4e43-9314-0277e75c9218 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:18:52.053880 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7a0a2121-bc46-4e43-9314-0277e75c9218 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:18:52.056451 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7a0a2121-bc46-4e43-9314-0277e75c9218 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:18:52.057459 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7a0a2121-bc46-4e43-9314-0277e75c9218 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:18:52.126968 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-a8e0a9ce-f5d0-4c87-80d8-267ed354b494 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fc1955b0d446458f8f355550de971b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ae6f05c2843469190cd96f39ac794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:18:52.139205 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a8e0a9ce-f5d0-4c87-80d8-267ed354b494 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] 10.222.0.46 "GET /compute/v2.1/servers/15929a27-a8a3-435f-a31c-4abbddfcb142" status: 200 len: 1203 microversion: 2.1 time: 0.604596 Jan 15 21:18:52.139933 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3369/6733] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:18:51 2022] GET /compute/v2.1/servers/15929a27-a8a3-435f-a31c-4abbddfcb142 => generated 1203 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:18:52.177012 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-7a0a2121-bc46-4e43-9314-0277e75c9218 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3740026776904d36be28fd3a206a3361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b63757470b845b3ad6e5b18314f2c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:18:52.198318 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-7a0a2121-bc46-4e43-9314-0277e75c9218 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] 10.222.0.46 "GET /compute/v2.1/servers/e8d37bbd-bee9-4a16-9633-2d26ea56a884" status: 200 len: 1299 microversion: 2.1 time: 0.160097 Jan 15 21:18:52.199629 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3365/6734] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:18:52 2022] GET /compute/v2.1/servers/e8d37bbd-bee9-4a16-9633-2d26ea56a884 => generated 1299 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:18:53.172417 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7de489b9-7a3d-41c4-b664-13276cc62705 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:18:53.174272 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-7de489b9-7a3d-41c4-b664-13276cc62705 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: 15929a27-a8a3-435f-a31c-4abbddfcb142] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:18:53.188863 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7de489b9-7a3d-41c4-b664-13276cc62705 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:18:53.189590 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7de489b9-7a3d-41c4-b664-13276cc62705 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:18:53.194638 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7de489b9-7a3d-41c4-b664-13276cc62705 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:18:53.197903 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7de489b9-7a3d-41c4-b664-13276cc62705 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:18:53.216172 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-03fa726f-d7ee-4637-a3d4-7de55e8b8bd9 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:18:53.217089 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-03fa726f-d7ee-4637-a3d4-7de55e8b8bd9 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] [instance: e8d37bbd-bee9-4a16-9633-2d26ea56a884] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:18:53.233046 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-03fa726f-d7ee-4637-a3d4-7de55e8b8bd9 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:18:53.233572 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-03fa726f-d7ee-4637-a3d4-7de55e8b8bd9 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:18:53.235739 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-03fa726f-d7ee-4637-a3d4-7de55e8b8bd9 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:18:53.237056 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-03fa726f-d7ee-4637-a3d4-7de55e8b8bd9 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:18:53.333251 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-03fa726f-d7ee-4637-a3d4-7de55e8b8bd9 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3740026776904d36be28fd3a206a3361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b63757470b845b3ad6e5b18314f2c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:18:53.346173 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-03fa726f-d7ee-4637-a3d4-7de55e8b8bd9 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] 10.222.0.46 "GET /compute/v2.1/servers/e8d37bbd-bee9-4a16-9633-2d26ea56a884" status: 200 len: 1299 microversion: 2.1 time: 0.133718 Jan 15 21:18:53.361802 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3366/6735] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:18:53 2022] GET /compute/v2.1/servers/e8d37bbd-bee9-4a16-9633-2d26ea56a884 => generated 1299 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:18:53.440200 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-7de489b9-7a3d-41c4-b664-13276cc62705 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fc1955b0d446458f8f355550de971b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ae6f05c2843469190cd96f39ac794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:18:53.450304 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7de489b9-7a3d-41c4-b664-13276cc62705 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] 10.222.0.46 "GET /compute/v2.1/servers/15929a27-a8a3-435f-a31c-4abbddfcb142" status: 200 len: 1203 microversion: 2.1 time: 0.296809 Jan 15 21:18:53.451270 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3370/6736] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:18:53 2022] GET /compute/v2.1/servers/15929a27-a8a3-435f-a31c-4abbddfcb142 => generated 1203 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:18:53.752528 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-448631ce-2db6-4d1c-b39d-d2c10e1b3c6c tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '.version_select at 0x7f30ceb798b0>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:18:53.818948 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-448631ce-2db6-4d1c-b39d-d2c10e1b3c6c tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1383309457" status: 202 len: 0 microversion: 2.1 time: 0.071373 Jan 15 21:18:53.819966 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3367/6737] 10.222.0.46 () {58 vars in 1283 bytes} [Sat Jan 15 21:18:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1383309457 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:18:53.852327 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-5b87dd69-a2a2-4e01-b0c7-a192ecf6f03b tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Action: 'create', calling method: .version_select at 0x7f30c88175e0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-38628784"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:18:53.888700 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-5b87dd69-a2a2-4e01-b0c7-a192ecf6f03b tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Getting quotas for project ed86e4d7dcdb4ea7ad79628b2ae2462d. Resources: {'key_pairs'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:18:53.910306 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-5b87dd69-a2a2-4e01-b0c7-a192ecf6f03b tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Getting quotas for user 7f0f0e03b03e4d24ae0a7e5d3b9b7104 and project ed86e4d7dcdb4ea7ad79628b2ae2462d. Resources: {'key_pairs'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:18:54.293273 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-5b87dd69-a2a2-4e01-b0c7-a192ecf6f03b tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Getting quotas for project ed86e4d7dcdb4ea7ad79628b2ae2462d. Resources: {'key_pairs'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:18:54.300924 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-5b87dd69-a2a2-4e01-b0c7-a192ecf6f03b tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Getting quotas for user 7f0f0e03b03e4d24ae0a7e5d3b9b7104 and project ed86e4d7dcdb4ea7ad79628b2ae2462d. Resources: {'key_pairs'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:18:54.326774 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-5b87dd69-a2a2-4e01-b0c7-a192ecf6f03b tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 2320 microversion: 2.1 time: 0.478707 Jan 15 21:18:54.327969 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3371/6738] 10.222.0.46 () {60 vars in 1157 bytes} [Sat Jan 15 21:18:53 2022] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:18:54.370917 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-843d6e3b-571d-4457-85a0-34981c9e811c tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:18:54.373581 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-843d6e3b-571d-4457-85a0-34981c9e811c tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] [instance: e8d37bbd-bee9-4a16-9633-2d26ea56a884] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:18:54.389378 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-843d6e3b-571d-4457-85a0-34981c9e811c tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:18:54.389598 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-843d6e3b-571d-4457-85a0-34981c9e811c tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:18:54.390326 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-843d6e3b-571d-4457-85a0-34981c9e811c tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:18:54.390764 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-843d6e3b-571d-4457-85a0-34981c9e811c tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:18:54.467917 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7ec78443-cf14-4962-bdb3-446fdf02e900 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:18:54.468538 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-7ec78443-cf14-4962-bdb3-446fdf02e900 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: 15929a27-a8a3-435f-a31c-4abbddfcb142] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:18:54.480199 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7ec78443-cf14-4962-bdb3-446fdf02e900 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:18:54.480669 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7ec78443-cf14-4962-bdb3-446fdf02e900 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:18:54.481512 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7ec78443-cf14-4962-bdb3-446fdf02e900 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:18:54.481959 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7ec78443-cf14-4962-bdb3-446fdf02e900 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:18:54.725286 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-843d6e3b-571d-4457-85a0-34981c9e811c tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3740026776904d36be28fd3a206a3361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b63757470b845b3ad6e5b18314f2c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:18:54.739314 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-843d6e3b-571d-4457-85a0-34981c9e811c tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] 10.222.0.46 "GET /compute/v2.1/servers/e8d37bbd-bee9-4a16-9633-2d26ea56a884" status: 200 len: 1299 microversion: 2.1 time: 0.371675 Jan 15 21:18:54.750968 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3368/6739] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:18:54 2022] GET /compute/v2.1/servers/e8d37bbd-bee9-4a16-9633-2d26ea56a884 => generated 1299 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:18:54.875620 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-7ec78443-cf14-4962-bdb3-446fdf02e900 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fc1955b0d446458f8f355550de971b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ae6f05c2843469190cd96f39ac794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:18:54.893974 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7ec78443-cf14-4962-bdb3-446fdf02e900 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] 10.222.0.46 "GET /compute/v2.1/servers/15929a27-a8a3-435f-a31c-4abbddfcb142" status: 200 len: 1203 microversion: 2.1 time: 0.429969 Jan 15 21:18:54.912041 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3372/6740] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:18:54 2022] GET /compute/v2.1/servers/15929a27-a8a3-435f-a31c-4abbddfcb142 => generated 1203 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:18:55.758996 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f0ea8eb6-00e2-4803-a628-55d3aad7be23 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:18:55.759619 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f0ea8eb6-00e2-4803-a628-55d3aad7be23 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] [instance: e8d37bbd-bee9-4a16-9633-2d26ea56a884] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:18:55.792933 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f0ea8eb6-00e2-4803-a628-55d3aad7be23 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:18:55.793373 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f0ea8eb6-00e2-4803-a628-55d3aad7be23 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:18:55.803644 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f0ea8eb6-00e2-4803-a628-55d3aad7be23 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:18:55.804111 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f0ea8eb6-00e2-4803-a628-55d3aad7be23 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:18:55.813409 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-64102976-65ff-4528-887e-90a5be70b7c8 req-a9352325-e857-4567-8454-21396342fffd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8d37bbd-bee9-4a16-9633-2d26ea56a884", "tag": "c4ab5d7e-fc83-4860-aa6b-417708cf16c0"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:18:55.816177 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:18:55.816177 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:18:55.848184 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-64102976-65ff-4528-887e-90a5be70b7c8 req-a9352325-e857-4567-8454-21396342fffd service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:18:55.849251 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-64102976-65ff-4528-887e-90a5be70b7c8 req-a9352325-e857-4567-8454-21396342fffd service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:18:55.875778 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-64102976-65ff-4528-887e-90a5be70b7c8 req-a9352325-e857-4567-8454-21396342fffd service nova] Creating event network-changed:c4ab5d7e-fc83-4860-aa6b-417708cf16c0 for instance e8d37bbd-bee9-4a16-9633-2d26ea56a884 on nch1-master-1 Jan 15 21:18:55.898399 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-64102976-65ff-4528-887e-90a5be70b7c8 req-a9352325-e857-4567-8454-21396342fffd service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089220 Jan 15 21:18:55.899371 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3373/6741] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:18:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 21:18:55.931261 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7c41a9f4-0855-47f6-930f-30b6de033e19 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:18:55.932215 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-7c41a9f4-0855-47f6-930f-30b6de033e19 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: 15929a27-a8a3-435f-a31c-4abbddfcb142] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:18:55.944442 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7c41a9f4-0855-47f6-930f-30b6de033e19 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:18:55.945323 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7c41a9f4-0855-47f6-930f-30b6de033e19 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:18:55.946581 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7c41a9f4-0855-47f6-930f-30b6de033e19 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:18:55.947175 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7c41a9f4-0855-47f6-930f-30b6de033e19 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:18:56.423934 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-f0ea8eb6-00e2-4803-a628-55d3aad7be23 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3740026776904d36be28fd3a206a3361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b63757470b845b3ad6e5b18314f2c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:18:56.435287 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f0ea8eb6-00e2-4803-a628-55d3aad7be23 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] 10.222.0.46 "GET /compute/v2.1/servers/e8d37bbd-bee9-4a16-9633-2d26ea56a884" status: 200 len: 1299 microversion: 2.1 time: 0.680867 Jan 15 21:18:56.441957 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3369/6742] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:18:55 2022] GET /compute/v2.1/servers/e8d37bbd-bee9-4a16-9633-2d26ea56a884 => generated 1299 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:18:56.474482 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-7c41a9f4-0855-47f6-930f-30b6de033e19 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fc1955b0d446458f8f355550de971b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ae6f05c2843469190cd96f39ac794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:18:56.500863 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7c41a9f4-0855-47f6-930f-30b6de033e19 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] 10.222.0.46 "GET /compute/v2.1/servers/15929a27-a8a3-435f-a31c-4abbddfcb142" status: 200 len: 1203 microversion: 2.1 time: 0.574858 Jan 15 21:18:56.501947 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3374/6743] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:18:55 2022] GET /compute/v2.1/servers/15929a27-a8a3-435f-a31c-4abbddfcb142 => generated 1203 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:18:57.457205 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-55bdefaf-5070-462f-a402-303502be915e tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:18:57.457814 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-55bdefaf-5070-462f-a402-303502be915e tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] [instance: e8d37bbd-bee9-4a16-9633-2d26ea56a884] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:18:57.465900 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-55bdefaf-5070-462f-a402-303502be915e tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:18:57.466351 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-55bdefaf-5070-462f-a402-303502be915e tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:18:57.467296 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-55bdefaf-5070-462f-a402-303502be915e tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:18:57.467824 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-55bdefaf-5070-462f-a402-303502be915e tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:18:57.518291 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b9e2bec2-6c93-470b-a67d-7e8ffb22a192 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:18:57.518881 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b9e2bec2-6c93-470b-a67d-7e8ffb22a192 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: 15929a27-a8a3-435f-a31c-4abbddfcb142] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:18:57.526428 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b9e2bec2-6c93-470b-a67d-7e8ffb22a192 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:18:57.526877 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b9e2bec2-6c93-470b-a67d-7e8ffb22a192 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:18:57.527662 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b9e2bec2-6c93-470b-a67d-7e8ffb22a192 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:18:57.528094 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b9e2bec2-6c93-470b-a67d-7e8ffb22a192 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:18:57.571181 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-55bdefaf-5070-462f-a402-303502be915e tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3740026776904d36be28fd3a206a3361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b63757470b845b3ad6e5b18314f2c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:18:57.588287 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-55bdefaf-5070-462f-a402-303502be915e tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] 10.222.0.46 "GET /compute/v2.1/servers/e8d37bbd-bee9-4a16-9633-2d26ea56a884" status: 200 len: 1299 microversion: 2.1 time: 0.134964 Jan 15 21:18:57.600540 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3370/6744] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:18:57 2022] GET /compute/v2.1/servers/e8d37bbd-bee9-4a16-9633-2d26ea56a884 => generated 1299 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:18:57.688380 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-b9e2bec2-6c93-470b-a67d-7e8ffb22a192 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fc1955b0d446458f8f355550de971b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ae6f05c2843469190cd96f39ac794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:18:57.698734 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b9e2bec2-6c93-470b-a67d-7e8ffb22a192 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] 10.222.0.46 "GET /compute/v2.1/servers/15929a27-a8a3-435f-a31c-4abbddfcb142" status: 200 len: 1203 microversion: 2.1 time: 0.184065 Jan 15 21:18:57.699612 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3375/6745] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:18:57 2022] GET /compute/v2.1/servers/15929a27-a8a3-435f-a31c-4abbddfcb142 => generated 1203 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:18:57.824032 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-4093ec7a-a681-4c85-8f13-c274bcd6a689 req-4835c3ad-d865-4dca-9ac4-2a72b26b2d42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15929a27-a8a3-435f-a31c-4abbddfcb142", "name": "network-vif-plugged", "status": "completed", "tag": "413745ec-f8bf-4c8c-91e8-e735e6ecab61"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:18:57.825904 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:18:57.825904 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:18:57.837679 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-4093ec7a-a681-4c85-8f13-c274bcd6a689 req-4835c3ad-d865-4dca-9ac4-2a72b26b2d42 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:18:57.838227 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-4093ec7a-a681-4c85-8f13-c274bcd6a689 req-4835c3ad-d865-4dca-9ac4-2a72b26b2d42 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:18:57.850786 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-4093ec7a-a681-4c85-8f13-c274bcd6a689 req-4835c3ad-d865-4dca-9ac4-2a72b26b2d42 service nova] Creating event network-vif-plugged:413745ec-f8bf-4c8c-91e8-e735e6ecab61 for instance 15929a27-a8a3-435f-a31c-4abbddfcb142 on nch1-master-1 Jan 15 21:18:57.856795 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-4093ec7a-a681-4c85-8f13-c274bcd6a689 req-4835c3ad-d865-4dca-9ac4-2a72b26b2d42 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036737 Jan 15 21:18:57.857788 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3371/6746] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:18:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:18:58.607722 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-af789232-5c78-42ef-b253-56938e846492 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:18:58.609437 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-af789232-5c78-42ef-b253-56938e846492 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] [instance: e8d37bbd-bee9-4a16-9633-2d26ea56a884] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:18:58.619196 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-af789232-5c78-42ef-b253-56938e846492 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:18:58.619889 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-af789232-5c78-42ef-b253-56938e846492 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:18:58.621067 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-af789232-5c78-42ef-b253-56938e846492 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:18:58.621652 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-af789232-5c78-42ef-b253-56938e846492 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:18:58.716992 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-662a518a-75c7-4b4a-a5ee-064b12ba15fe tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:18:58.718344 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-662a518a-75c7-4b4a-a5ee-064b12ba15fe tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: 15929a27-a8a3-435f-a31c-4abbddfcb142] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:18:58.725638 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-662a518a-75c7-4b4a-a5ee-064b12ba15fe tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:18:58.726723 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-662a518a-75c7-4b4a-a5ee-064b12ba15fe tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:18:58.727702 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-662a518a-75c7-4b4a-a5ee-064b12ba15fe tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:18:58.728297 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-662a518a-75c7-4b4a-a5ee-064b12ba15fe tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:18:58.762926 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-af789232-5c78-42ef-b253-56938e846492 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3740026776904d36be28fd3a206a3361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b63757470b845b3ad6e5b18314f2c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:18:58.774204 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-af789232-5c78-42ef-b253-56938e846492 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] 10.222.0.46 "GET /compute/v2.1/servers/e8d37bbd-bee9-4a16-9633-2d26ea56a884" status: 200 len: 1299 microversion: 2.1 time: 0.170409 Jan 15 21:18:58.785179 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3376/6747] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:18:58 2022] GET /compute/v2.1/servers/e8d37bbd-bee9-4a16-9633-2d26ea56a884 => generated 1299 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:18:58.941895 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-662a518a-75c7-4b4a-a5ee-064b12ba15fe tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fc1955b0d446458f8f355550de971b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ae6f05c2843469190cd96f39ac794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:18:58.950873 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-662a518a-75c7-4b4a-a5ee-064b12ba15fe tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] 10.222.0.46 "GET /compute/v2.1/servers/15929a27-a8a3-435f-a31c-4abbddfcb142" status: 200 len: 1203 microversion: 2.1 time: 0.238695 Jan 15 21:18:58.961327 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3372/6748] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:18:58 2022] GET /compute/v2.1/servers/15929a27-a8a3-435f-a31c-4abbddfcb142 => generated 1203 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:18:59.792517 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d88944c0-8a13-422a-a4c8-c84edb207bff tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:18:59.793155 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-d88944c0-8a13-422a-a4c8-c84edb207bff tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] [instance: e8d37bbd-bee9-4a16-9633-2d26ea56a884] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:18:59.800205 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d88944c0-8a13-422a-a4c8-c84edb207bff tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:18:59.800925 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d88944c0-8a13-422a-a4c8-c84edb207bff tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:18:59.801727 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d88944c0-8a13-422a-a4c8-c84edb207bff tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:18:59.802245 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d88944c0-8a13-422a-a4c8-c84edb207bff tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:18:59.968213 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b3101934-9c27-4736-b7d8-99944aacf756 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:18:59.968851 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b3101934-9c27-4736-b7d8-99944aacf756 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: 15929a27-a8a3-435f-a31c-4abbddfcb142] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:18:59.975957 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b3101934-9c27-4736-b7d8-99944aacf756 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:18:59.977203 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b3101934-9c27-4736-b7d8-99944aacf756 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:18:59.978237 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b3101934-9c27-4736-b7d8-99944aacf756 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:18:59.978683 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b3101934-9c27-4736-b7d8-99944aacf756 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:00.085591 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-d88944c0-8a13-422a-a4c8-c84edb207bff tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3740026776904d36be28fd3a206a3361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b63757470b845b3ad6e5b18314f2c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:19:00.092978 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d88944c0-8a13-422a-a4c8-c84edb207bff tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] 10.222.0.46 "GET /compute/v2.1/servers/e8d37bbd-bee9-4a16-9633-2d26ea56a884" status: 200 len: 1299 microversion: 2.1 time: 0.304896 Jan 15 21:19:00.093561 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3377/6749] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:18:59 2022] GET /compute/v2.1/servers/e8d37bbd-bee9-4a16-9633-2d26ea56a884 => generated 1299 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:19:00.302573 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-b3101934-9c27-4736-b7d8-99944aacf756 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fc1955b0d446458f8f355550de971b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ae6f05c2843469190cd96f39ac794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:19:00.318620 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b3101934-9c27-4736-b7d8-99944aacf756 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] 10.222.0.46 "GET /compute/v2.1/servers/15929a27-a8a3-435f-a31c-4abbddfcb142" status: 200 len: 1390 microversion: 2.1 time: 0.354421 Jan 15 21:19:00.319359 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3373/6750] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:18:59 2022] GET /compute/v2.1/servers/15929a27-a8a3-435f-a31c-4abbddfcb142 => generated 1390 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:19:00.336241 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-2b324a2d-c660-499e-b816-0faf078429bb tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:19:00.336999 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-2b324a2d-c660-499e-b816-0faf078429bb tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: 15929a27-a8a3-435f-a31c-4abbddfcb142] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:19:00.346973 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2b324a2d-c660-499e-b816-0faf078429bb tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:00.347497 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2b324a2d-c660-499e-b816-0faf078429bb tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:00.348355 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2b324a2d-c660-499e-b816-0faf078429bb tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:00.348800 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2b324a2d-c660-499e-b816-0faf078429bb tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:00.634728 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-2b324a2d-c660-499e-b816-0faf078429bb tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fc1955b0d446458f8f355550de971b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ae6f05c2843469190cd96f39ac794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:19:00.642847 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-2b324a2d-c660-499e-b816-0faf078429bb tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] 10.222.0.46 "GET /compute/v2.1/servers/15929a27-a8a3-435f-a31c-4abbddfcb142" status: 200 len: 1390 microversion: 2.1 time: 0.310977 Jan 15 21:19:00.652878 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3378/6751] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:19:00 2022] GET /compute/v2.1/servers/15929a27-a8a3-435f-a31c-4abbddfcb142 => generated 1390 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:19:00.671065 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-4f6939e6-d600-44e3-9696-be0d3de34ed4 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:19:00.672006 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-4f6939e6-d600-44e3-9696-be0d3de34ed4 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: 15929a27-a8a3-435f-a31c-4abbddfcb142] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:19:00.681809 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4f6939e6-d600-44e3-9696-be0d3de34ed4 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:00.682446 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4f6939e6-d600-44e3-9696-be0d3de34ed4 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:00.683468 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4f6939e6-d600-44e3-9696-be0d3de34ed4 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:00.684057 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4f6939e6-d600-44e3-9696-be0d3de34ed4 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:00.861556 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-4f6939e6-d600-44e3-9696-be0d3de34ed4 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fc1955b0d446458f8f355550de971b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ae6f05c2843469190cd96f39ac794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:19:00.873740 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-4f6939e6-d600-44e3-9696-be0d3de34ed4 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] 10.222.0.46 "GET /compute/v2.1/servers/15929a27-a8a3-435f-a31c-4abbddfcb142" status: 200 len: 1390 microversion: 2.1 time: 0.211565 Jan 15 21:19:00.874852 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3374/6752] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:19:00 2022] GET /compute/v2.1/servers/15929a27-a8a3-435f-a31c-4abbddfcb142 => generated 1390 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:19:00.960029 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-5f8fe8bc-f353-4024-9981-e06d3f7810a3 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:19:00.961165 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-5f8fe8bc-f353-4024-9981-e06d3f7810a3 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: 15929a27-a8a3-435f-a31c-4abbddfcb142] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:19:00.975566 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5f8fe8bc-f353-4024-9981-e06d3f7810a3 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:00.976502 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5f8fe8bc-f353-4024-9981-e06d3f7810a3 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:00.979926 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5f8fe8bc-f353-4024-9981-e06d3f7810a3 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:00.980604 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5f8fe8bc-f353-4024-9981-e06d3f7810a3 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:01.009505 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-5f8fe8bc-f353-4024-9981-e06d3f7810a3 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: 15929a27-a8a3-435f-a31c-4abbddfcb142] Going to try to terminate instance {{(pid=129366) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 21:19:01.102364 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-5f8fe8bc-f353-4024-9981-e06d3f7810a3 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] 10.222.0.46 "DELETE /compute/v2.1/servers/15929a27-a8a3-435f-a31c-4abbddfcb142" status: 204 len: 0 microversion: 2.1 time: 0.145529 Jan 15 21:19:01.106432 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3379/6753] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 21:19:00 2022] DELETE /compute/v2.1/servers/15929a27-a8a3-435f-a31c-4abbddfcb142 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 21:19:01.110460 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-202d3b02-9f4e-4eb5-ad40-b8a830121894 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:19:01.111034 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-202d3b02-9f4e-4eb5-ad40-b8a830121894 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] [instance: e8d37bbd-bee9-4a16-9633-2d26ea56a884] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:19:01.114329 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-5b7a71c0-9de7-4a9a-b7cd-9bb7841b1839 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:19:01.115533 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-5b7a71c0-9de7-4a9a-b7cd-9bb7841b1839 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: 15929a27-a8a3-435f-a31c-4abbddfcb142] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:19:01.119647 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-202d3b02-9f4e-4eb5-ad40-b8a830121894 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:01.120142 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-202d3b02-9f4e-4eb5-ad40-b8a830121894 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:01.121335 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-202d3b02-9f4e-4eb5-ad40-b8a830121894 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:01.121540 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-202d3b02-9f4e-4eb5-ad40-b8a830121894 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:01.126802 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5b7a71c0-9de7-4a9a-b7cd-9bb7841b1839 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:01.127488 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5b7a71c0-9de7-4a9a-b7cd-9bb7841b1839 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:01.128455 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5b7a71c0-9de7-4a9a-b7cd-9bb7841b1839 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:01.129076 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5b7a71c0-9de7-4a9a-b7cd-9bb7841b1839 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:01.289563 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-202d3b02-9f4e-4eb5-ad40-b8a830121894 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3740026776904d36be28fd3a206a3361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b63757470b845b3ad6e5b18314f2c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:19:01.304405 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-202d3b02-9f4e-4eb5-ad40-b8a830121894 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] 10.222.0.46 "GET /compute/v2.1/servers/e8d37bbd-bee9-4a16-9633-2d26ea56a884" status: 200 len: 1299 microversion: 2.1 time: 0.195762 Jan 15 21:19:01.305782 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3375/6754] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:19:01 2022] GET /compute/v2.1/servers/e8d37bbd-bee9-4a16-9633-2d26ea56a884 => generated 1299 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:19:01.382080 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-5b7a71c0-9de7-4a9a-b7cd-9bb7841b1839 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fc1955b0d446458f8f355550de971b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ae6f05c2843469190cd96f39ac794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:19:01.391061 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-5b7a71c0-9de7-4a9a-b7cd-9bb7841b1839 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] 10.222.0.46 "GET /compute/v2.1/servers/15929a27-a8a3-435f-a31c-4abbddfcb142" status: 200 len: 1396 microversion: 2.1 time: 0.283010 Jan 15 21:19:01.402698 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3380/6755] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:19:01 2022] GET /compute/v2.1/servers/15929a27-a8a3-435f-a31c-4abbddfcb142 => generated 1396 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:19:02.327549 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-18282cf7-2ab1-4ca3-a6fb-6c26bd97e6df tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:19:02.329320 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-18282cf7-2ab1-4ca3-a6fb-6c26bd97e6df tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] [instance: e8d37bbd-bee9-4a16-9633-2d26ea56a884] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:19:02.343559 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-18282cf7-2ab1-4ca3-a6fb-6c26bd97e6df tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:02.345487 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-18282cf7-2ab1-4ca3-a6fb-6c26bd97e6df tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:02.346504 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-18282cf7-2ab1-4ca3-a6fb-6c26bd97e6df tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:02.348401 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-18282cf7-2ab1-4ca3-a6fb-6c26bd97e6df tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:02.412954 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ed9ad3fc-41e3-4fb0-ba90-25af95a0d410 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:19:02.414652 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ed9ad3fc-41e3-4fb0-ba90-25af95a0d410 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: 15929a27-a8a3-435f-a31c-4abbddfcb142] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:19:02.446597 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ed9ad3fc-41e3-4fb0-ba90-25af95a0d410 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:02.447363 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ed9ad3fc-41e3-4fb0-ba90-25af95a0d410 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:02.449115 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ed9ad3fc-41e3-4fb0-ba90-25af95a0d410 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:02.449792 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ed9ad3fc-41e3-4fb0-ba90-25af95a0d410 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:02.628695 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-18282cf7-2ab1-4ca3-a6fb-6c26bd97e6df tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3740026776904d36be28fd3a206a3361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b63757470b845b3ad6e5b18314f2c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:19:02.638165 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-18282cf7-2ab1-4ca3-a6fb-6c26bd97e6df tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] 10.222.0.46 "GET /compute/v2.1/servers/e8d37bbd-bee9-4a16-9633-2d26ea56a884" status: 200 len: 1299 microversion: 2.1 time: 0.317183 Jan 15 21:19:02.639242 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3376/6756] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:19:02 2022] GET /compute/v2.1/servers/e8d37bbd-bee9-4a16-9633-2d26ea56a884 => generated 1299 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:19:02.737824 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-ed9ad3fc-41e3-4fb0-ba90-25af95a0d410 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fc1955b0d446458f8f355550de971b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ae6f05c2843469190cd96f39ac794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:19:02.744392 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-e3266097-73cd-438e-b8a4-132215190767 req-db129179-8c9c-435a-bd20-91606ba85eb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8d37bbd-bee9-4a16-9633-2d26ea56a884", "name": "network-vif-plugged", "status": "completed", "tag": "c4ab5d7e-fc83-4860-aa6b-417708cf16c0"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:19:02.747350 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:19:02.747350 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:19:02.748001 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ed9ad3fc-41e3-4fb0-ba90-25af95a0d410 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] 10.222.0.46 "GET /compute/v2.1/servers/15929a27-a8a3-435f-a31c-4abbddfcb142" status: 200 len: 1396 microversion: 2.1 time: 0.342147 Jan 15 21:19:02.749096 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3381/6757] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:19:02 2022] GET /compute/v2.1/servers/15929a27-a8a3-435f-a31c-4abbddfcb142 => generated 1396 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:19:02.762119 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-e3266097-73cd-438e-b8a4-132215190767 req-db129179-8c9c-435a-bd20-91606ba85eb4 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:02.762568 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-e3266097-73cd-438e-b8a4-132215190767 req-db129179-8c9c-435a-bd20-91606ba85eb4 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:02.782335 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-e3266097-73cd-438e-b8a4-132215190767 req-db129179-8c9c-435a-bd20-91606ba85eb4 service nova] Creating event network-vif-plugged:c4ab5d7e-fc83-4860-aa6b-417708cf16c0 for instance e8d37bbd-bee9-4a16-9633-2d26ea56a884 on nch1-master-1 Jan 15 21:19:02.787937 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-e3266097-73cd-438e-b8a4-132215190767 req-db129179-8c9c-435a-bd20-91606ba85eb4 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047571 Jan 15 21:19:02.789889 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3377/6758] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:19:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 21:19:03.658530 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d4e99bae-6460-4f50-aa71-38ba15dd420c tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:19:03.659155 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-d4e99bae-6460-4f50-aa71-38ba15dd420c tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] [instance: e8d37bbd-bee9-4a16-9633-2d26ea56a884] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:19:03.680710 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d4e99bae-6460-4f50-aa71-38ba15dd420c tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:03.681104 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d4e99bae-6460-4f50-aa71-38ba15dd420c tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:03.682126 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d4e99bae-6460-4f50-aa71-38ba15dd420c tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:03.683660 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d4e99bae-6460-4f50-aa71-38ba15dd420c tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:03.767533 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e9e55667-ccf0-4455-b3a5-fbe01549f22b tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:19:03.767988 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e9e55667-ccf0-4455-b3a5-fbe01549f22b tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: 15929a27-a8a3-435f-a31c-4abbddfcb142] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:19:03.783839 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e9e55667-ccf0-4455-b3a5-fbe01549f22b tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:03.791469 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e9e55667-ccf0-4455-b3a5-fbe01549f22b tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:03.792586 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e9e55667-ccf0-4455-b3a5-fbe01549f22b tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:03.800283 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e9e55667-ccf0-4455-b3a5-fbe01549f22b tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:04.055814 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-d4e99bae-6460-4f50-aa71-38ba15dd420c tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3740026776904d36be28fd3a206a3361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b63757470b845b3ad6e5b18314f2c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:19:04.081144 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d4e99bae-6460-4f50-aa71-38ba15dd420c tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] 10.222.0.46 "GET /compute/v2.1/servers/e8d37bbd-bee9-4a16-9633-2d26ea56a884" status: 200 len: 1299 microversion: 2.1 time: 0.429607 Jan 15 21:19:04.082763 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3382/6759] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:19:03 2022] GET /compute/v2.1/servers/e8d37bbd-bee9-4a16-9633-2d26ea56a884 => generated 1299 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:19:04.235143 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-e9e55667-ccf0-4455-b3a5-fbe01549f22b tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fc1955b0d446458f8f355550de971b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ae6f05c2843469190cd96f39ac794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:19:04.252291 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e9e55667-ccf0-4455-b3a5-fbe01549f22b tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] 10.222.0.46 "GET /compute/v2.1/servers/15929a27-a8a3-435f-a31c-4abbddfcb142" status: 200 len: 1396 microversion: 2.1 time: 0.489752 Jan 15 21:19:04.271478 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3378/6760] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:19:03 2022] GET /compute/v2.1/servers/15929a27-a8a3-435f-a31c-4abbddfcb142 => generated 1396 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:19:04.593782 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-c35f418c-e760-406f-94df-9922945ea279 req-c9d214de-d99a-4163-b5c0-206007b3dffd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15929a27-a8a3-435f-a31c-4abbddfcb142", "name": "network-vif-deleted", "tag": "413745ec-f8bf-4c8c-91e8-e735e6ecab61"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:19:04.601657 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:19:04.601657 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:19:04.636456 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-c35f418c-e760-406f-94df-9922945ea279 req-c9d214de-d99a-4163-b5c0-206007b3dffd service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:04.636950 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-c35f418c-e760-406f-94df-9922945ea279 req-c9d214de-d99a-4163-b5c0-206007b3dffd service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:04.668658 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-c35f418c-e760-406f-94df-9922945ea279 req-c9d214de-d99a-4163-b5c0-206007b3dffd service nova] Creating event network-vif-deleted:413745ec-f8bf-4c8c-91e8-e735e6ecab61 for instance 15929a27-a8a3-435f-a31c-4abbddfcb142 on nch1-master-1 Jan 15 21:19:04.681488 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-c35f418c-e760-406f-94df-9922945ea279 req-c9d214de-d99a-4163-b5c0-206007b3dffd service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085378 Jan 15 21:19:04.682751 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3383/6761] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:19:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:19:05.104396 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ebf8ed61-4c92-437e-bb03-8478257d3f94 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:19:05.105544 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ebf8ed61-4c92-437e-bb03-8478257d3f94 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] [instance: e8d37bbd-bee9-4a16-9633-2d26ea56a884] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:19:05.131882 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ebf8ed61-4c92-437e-bb03-8478257d3f94 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:05.135371 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ebf8ed61-4c92-437e-bb03-8478257d3f94 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:05.136706 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ebf8ed61-4c92-437e-bb03-8478257d3f94 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:05.137360 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ebf8ed61-4c92-437e-bb03-8478257d3f94 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:05.306760 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ac8214e8-31b9-4e73-9db6-fe60b0c9e0b9 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:19:05.307546 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ac8214e8-31b9-4e73-9db6-fe60b0c9e0b9 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: 15929a27-a8a3-435f-a31c-4abbddfcb142] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:19:05.323929 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ac8214e8-31b9-4e73-9db6-fe60b0c9e0b9 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:05.324397 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ac8214e8-31b9-4e73-9db6-fe60b0c9e0b9 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:05.325242 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ac8214e8-31b9-4e73-9db6-fe60b0c9e0b9 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:05.325689 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ac8214e8-31b9-4e73-9db6-fe60b0c9e0b9 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:05.429967 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ac8214e8-31b9-4e73-9db6-fe60b0c9e0b9 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:05.430432 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ac8214e8-31b9-4e73-9db6-fe60b0c9e0b9 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:05.430930 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.objects.instance [None req-ac8214e8-31b9-4e73-9db6-fe60b0c9e0b9 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lazy-loading 'fault' on Instance uuid 15929a27-a8a3-435f-a31c-4abbddfcb142 {{(pid=129366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 21:19:06.066487 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-ac8214e8-31b9-4e73-9db6-fe60b0c9e0b9 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fc1955b0d446458f8f355550de971b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ae6f05c2843469190cd96f39ac794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:19:06.076376 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ac8214e8-31b9-4e73-9db6-fe60b0c9e0b9 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] 10.222.0.46 "GET /compute/v2.1/servers/15929a27-a8a3-435f-a31c-4abbddfcb142" status: 200 len: 1147 microversion: 2.1 time: 0.790134 Jan 15 21:19:06.077719 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3384/6762] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:19:05 2022] GET /compute/v2.1/servers/15929a27-a8a3-435f-a31c-4abbddfcb142 => generated 1147 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:19:06.241080 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-ebf8ed61-4c92-437e-bb03-8478257d3f94 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3740026776904d36be28fd3a206a3361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b63757470b845b3ad6e5b18314f2c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:19:06.250076 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ebf8ed61-4c92-437e-bb03-8478257d3f94 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] 10.222.0.46 "GET /compute/v2.1/servers/e8d37bbd-bee9-4a16-9633-2d26ea56a884" status: 200 len: 1472 microversion: 2.1 time: 1.154247 Jan 15 21:19:06.253473 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3379/6763] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:19:05 2022] GET /compute/v2.1/servers/e8d37bbd-bee9-4a16-9633-2d26ea56a884 => generated 1472 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:19:06.272019 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ce07fcba-1843-4907-9dd2-f912ca85e77f tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:19:06.274218 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ce07fcba-1843-4907-9dd2-f912ca85e77f tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] [instance: e8d37bbd-bee9-4a16-9633-2d26ea56a884] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:19:06.286426 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ce07fcba-1843-4907-9dd2-f912ca85e77f tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:06.288012 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ce07fcba-1843-4907-9dd2-f912ca85e77f tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:06.289462 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ce07fcba-1843-4907-9dd2-f912ca85e77f tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:06.290147 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ce07fcba-1843-4907-9dd2-f912ca85e77f tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:06.450876 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-ce07fcba-1843-4907-9dd2-f912ca85e77f tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3740026776904d36be28fd3a206a3361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b63757470b845b3ad6e5b18314f2c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:19:06.463353 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ce07fcba-1843-4907-9dd2-f912ca85e77f tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] 10.222.0.46 "GET /compute/v2.1/servers/e8d37bbd-bee9-4a16-9633-2d26ea56a884" status: 200 len: 1472 microversion: 2.1 time: 0.194999 Jan 15 21:19:06.465339 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3385/6764] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:19:06 2022] GET /compute/v2.1/servers/e8d37bbd-bee9-4a16-9633-2d26ea56a884 => generated 1472 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:19:06.481072 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d2364075-4647-4464-ac2a-d4880613f093 tempest-TestSecurityGroupsBasicOps-1216966125 tempest-TestSecurityGroupsBasicOps-1216966125-project-admin] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:19:06.481688 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d2364075-4647-4464-ac2a-d4880613f093 tempest-TestSecurityGroupsBasicOps-1216966125 tempest-TestSecurityGroupsBasicOps-1216966125-project-admin] [instance: e8d37bbd-bee9-4a16-9633-2d26ea56a884] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:19:06.496518 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d2364075-4647-4464-ac2a-d4880613f093 tempest-TestSecurityGroupsBasicOps-1216966125 tempest-TestSecurityGroupsBasicOps-1216966125-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:06.497188 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d2364075-4647-4464-ac2a-d4880613f093 tempest-TestSecurityGroupsBasicOps-1216966125 tempest-TestSecurityGroupsBasicOps-1216966125-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:06.498232 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d2364075-4647-4464-ac2a-d4880613f093 tempest-TestSecurityGroupsBasicOps-1216966125 tempest-TestSecurityGroupsBasicOps-1216966125-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:06.498811 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d2364075-4647-4464-ac2a-d4880613f093 tempest-TestSecurityGroupsBasicOps-1216966125 tempest-TestSecurityGroupsBasicOps-1216966125-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:06.704579 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d2364075-4647-4464-ac2a-d4880613f093 tempest-TestSecurityGroupsBasicOps-1216966125 tempest-TestSecurityGroupsBasicOps-1216966125-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/e8d37bbd-bee9-4a16-9633-2d26ea56a884" status: 200 len: 1623 microversion: 2.1 time: 0.226870 Jan 15 21:19:06.717661 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3380/6765] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:19:06 2022] GET /compute/v2.1/servers/e8d37bbd-bee9-4a16-9633-2d26ea56a884 => generated 1623 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:19:06.723579 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-acfb113a-bbd2-478c-9065-8b17972f7c1a tempest-TestSecurityGroupsBasicOps-1216966125 tempest-TestSecurityGroupsBasicOps-1216966125-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:19:06.724392 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-acfb113a-bbd2-478c-9065-8b17972f7c1a tempest-TestSecurityGroupsBasicOps-1216966125 tempest-TestSecurityGroupsBasicOps-1216966125-project-admin] [instance: c46baa1b-9f5b-42ce-a3f8-f1432c526691] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:19:06.733951 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-acfb113a-bbd2-478c-9065-8b17972f7c1a tempest-TestSecurityGroupsBasicOps-1216966125 tempest-TestSecurityGroupsBasicOps-1216966125-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:06.734642 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-acfb113a-bbd2-478c-9065-8b17972f7c1a tempest-TestSecurityGroupsBasicOps-1216966125 tempest-TestSecurityGroupsBasicOps-1216966125-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:06.735669 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-acfb113a-bbd2-478c-9065-8b17972f7c1a tempest-TestSecurityGroupsBasicOps-1216966125 tempest-TestSecurityGroupsBasicOps-1216966125-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:06.736325 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-acfb113a-bbd2-478c-9065-8b17972f7c1a tempest-TestSecurityGroupsBasicOps-1216966125 tempest-TestSecurityGroupsBasicOps-1216966125-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:06.742973 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-649bffb0-6cc7-4a35-bca6-26ca81e1d335 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-283823744", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "networks": [{"uuid": "921a4e76-3faa-4124-ad27-485c52c7c2f6"}], "key_name": "tempest-TestNetworkAdvancedServerOps-38628784", "security_groups": [{"name": "tempest-secgroup-smoke-988538030"}]}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:19:07.029427 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.network.neutron [None req-649bffb0-6cc7-4a35-bca6-26ca81e1d335 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] validate_networks() for [('921a4e76-3faa-4124-ad27-485c52c7c2f6', None, None, None, None, None)] {{(pid=129365) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 21:19:07.374840 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-acfb113a-bbd2-478c-9065-8b17972f7c1a tempest-TestSecurityGroupsBasicOps-1216966125 tempest-TestSecurityGroupsBasicOps-1216966125-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/c46baa1b-9f5b-42ce-a3f8-f1432c526691" status: 200 len: 1913 microversion: 2.1 time: 0.655683 Jan 15 21:19:07.376750 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3386/6766] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:19:06 2022] GET /compute/v2.1/servers/c46baa1b-9f5b-42ce-a3f8-f1432c526691 => generated 1913 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:19:07.392442 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4ef51107-e0ea-44f9-acbf-60d0adf790e1 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:19:07.393562 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-4ef51107-e0ea-44f9-acbf-60d0adf790e1 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: 15929a27-a8a3-435f-a31c-4abbddfcb142] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:19:07.414630 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4ef51107-e0ea-44f9-acbf-60d0adf790e1 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:07.415635 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4ef51107-e0ea-44f9-acbf-60d0adf790e1 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:07.417101 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4ef51107-e0ea-44f9-acbf-60d0adf790e1 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:07.421253 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4ef51107-e0ea-44f9-acbf-60d0adf790e1 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:07.452284 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-4ef51107-e0ea-44f9-acbf-60d0adf790e1 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] HTTP exception thrown: Instance 15929a27-a8a3-435f-a31c-4abbddfcb142 could not be found. Jan 15 21:19:07.457678 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4ef51107-e0ea-44f9-acbf-60d0adf790e1 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Returning 404 to user: Instance 15929a27-a8a3-435f-a31c-4abbddfcb142 could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:19:07.461604 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-4ef51107-e0ea-44f9-acbf-60d0adf790e1 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] 10.222.0.46 "GET /compute/v2.1/servers/15929a27-a8a3-435f-a31c-4abbddfcb142" status: 404 len: 111 microversion: 2.1 time: 0.080641 Jan 15 21:19:07.462472 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3387/6767] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:19:07 2022] GET /compute/v2.1/servers/15929a27-a8a3-435f-a31c-4abbddfcb142 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:19:07.503196 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-6fb96ec4-bc25-49cc-bb1c-3c91390cd6a6 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:19:07.503924 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-6fb96ec4-bc25-49cc-bb1c-3c91390cd6a6 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: 15929a27-a8a3-435f-a31c-4abbddfcb142] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:19:07.513344 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6fb96ec4-bc25-49cc-bb1c-3c91390cd6a6 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:07.514409 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6fb96ec4-bc25-49cc-bb1c-3c91390cd6a6 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:07.515641 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6fb96ec4-bc25-49cc-bb1c-3c91390cd6a6 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:07.516281 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6fb96ec4-bc25-49cc-bb1c-3c91390cd6a6 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:07.567187 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-6fb96ec4-bc25-49cc-bb1c-3c91390cd6a6 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] HTTP exception thrown: Instance 15929a27-a8a3-435f-a31c-4abbddfcb142 could not be found. Jan 15 21:19:07.567775 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-6fb96ec4-bc25-49cc-bb1c-3c91390cd6a6 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Returning 404 to user: Instance 15929a27-a8a3-435f-a31c-4abbddfcb142 could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:19:07.568649 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-6fb96ec4-bc25-49cc-bb1c-3c91390cd6a6 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] 10.222.0.46 "DELETE /compute/v2.1/servers/15929a27-a8a3-435f-a31c-4abbddfcb142" status: 404 len: 111 microversion: 2.1 time: 0.071042 Jan 15 21:19:07.579260 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3388/6768] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 21:19:07 2022] DELETE /compute/v2.1/servers/15929a27-a8a3-435f-a31c-4abbddfcb142 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:19:07.598902 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d26287ad-442a-4337-a3e4-7d26bbc17161 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:19:07.599625 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-d26287ad-442a-4337-a3e4-7d26bbc17161 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: 15929a27-a8a3-435f-a31c-4abbddfcb142] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:19:07.634389 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d26287ad-442a-4337-a3e4-7d26bbc17161 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:07.634991 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d26287ad-442a-4337-a3e4-7d26bbc17161 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:07.645080 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d26287ad-442a-4337-a3e4-7d26bbc17161 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:07.645675 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d26287ad-442a-4337-a3e4-7d26bbc17161 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:07.672671 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-d26287ad-442a-4337-a3e4-7d26bbc17161 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] HTTP exception thrown: Instance 15929a27-a8a3-435f-a31c-4abbddfcb142 could not be found. Jan 15 21:19:07.673309 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d26287ad-442a-4337-a3e4-7d26bbc17161 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Returning 404 to user: Instance 15929a27-a8a3-435f-a31c-4abbddfcb142 could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:19:07.674163 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d26287ad-442a-4337-a3e4-7d26bbc17161 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] 10.222.0.46 "GET /compute/v2.1/servers/15929a27-a8a3-435f-a31c-4abbddfcb142" status: 404 len: 111 microversion: 2.1 time: 0.091531 Jan 15 21:19:07.686223 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3389/6769] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:19:07 2022] GET /compute/v2.1/servers/15929a27-a8a3-435f-a31c-4abbddfcb142 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:19:07.699270 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-bd6eadf3-0caf-4439-a7f0-66ac7ae79ecf tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:19:07.702472 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-bd6eadf3-0caf-4439-a7f0-66ac7ae79ecf tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] [instance: e8d37bbd-bee9-4a16-9633-2d26ea56a884] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:19:07.722573 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bd6eadf3-0caf-4439-a7f0-66ac7ae79ecf tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:07.723058 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bd6eadf3-0caf-4439-a7f0-66ac7ae79ecf tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:07.728137 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bd6eadf3-0caf-4439-a7f0-66ac7ae79ecf tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:07.728611 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bd6eadf3-0caf-4439-a7f0-66ac7ae79ecf tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:07.798040 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-bd6eadf3-0caf-4439-a7f0-66ac7ae79ecf tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] [instance: e8d37bbd-bee9-4a16-9633-2d26ea56a884] Going to try to terminate instance {{(pid=129366) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 21:19:07.920300 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-bd6eadf3-0caf-4439-a7f0-66ac7ae79ecf tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] 10.222.0.46 "DELETE /compute/v2.1/servers/e8d37bbd-bee9-4a16-9633-2d26ea56a884" status: 204 len: 0 microversion: 2.1 time: 0.232480 Jan 15 21:19:07.921057 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3390/6770] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 21:19:07 2022] DELETE /compute/v2.1/servers/e8d37bbd-bee9-4a16-9633-2d26ea56a884 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 21:19:07.932096 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8b4cbb9c-7af7-439c-90e7-62db725fc040 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:19:07.933373 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-8b4cbb9c-7af7-439c-90e7-62db725fc040 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] [instance: e8d37bbd-bee9-4a16-9633-2d26ea56a884] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:19:07.944188 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8b4cbb9c-7af7-439c-90e7-62db725fc040 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:07.945623 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8b4cbb9c-7af7-439c-90e7-62db725fc040 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:07.946842 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8b4cbb9c-7af7-439c-90e7-62db725fc040 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:07.947918 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8b4cbb9c-7af7-439c-90e7-62db725fc040 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:08.124052 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-649bffb0-6cc7-4a35-bca6-26ca81e1d335 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Flavor limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 21:19:08.124613 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-649bffb0-6cc7-4a35-bca6-26ca81e1d335 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Image limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 21:19:08.125105 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-649bffb0-6cc7-4a35-bca6-26ca81e1d335 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Flavor pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 21:19:08.125682 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-649bffb0-6cc7-4a35-bca6-26ca81e1d335 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Image pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 21:19:08.126264 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-649bffb0-6cc7-4a35-bca6-26ca81e1d335 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 21:19:08.139746 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-649bffb0-6cc7-4a35-bca6-26ca81e1d335 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:08.140251 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-649bffb0-6cc7-4a35-bca6-26ca81e1d335 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:08.141123 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-649bffb0-6cc7-4a35-bca6-26ca81e1d335 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:08.141558 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-649bffb0-6cc7-4a35-bca6-26ca81e1d335 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:08.164028 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-649bffb0-6cc7-4a35-bca6-26ca81e1d335 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Getting quotas for project ed86e4d7dcdb4ea7ad79628b2ae2462d. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:19:08.169667 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-649bffb0-6cc7-4a35-bca6-26ca81e1d335 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Getting quotas for user 7f0f0e03b03e4d24ae0a7e5d3b9b7104 and project ed86e4d7dcdb4ea7ad79628b2ae2462d. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:19:08.183178 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-649bffb0-6cc7-4a35-bca6-26ca81e1d335 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Going to run 1 instances... {{(pid=129365) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 21:19:08.185568 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-649bffb0-6cc7-4a35-bca6-26ca81e1d335 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: ae51bd6b-96a9-42fa-ad05-234547d3f5d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129365) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 21:19:08.236369 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-649bffb0-6cc7-4a35-bca6-26ca81e1d335 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.498112 Jan 15 21:19:08.237955 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3381/6771] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 21:19:06 2022] POST /compute/v2.1/servers => generated 405 bytes in 1500 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 21:19:08.245098 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-8b4cbb9c-7af7-439c-90e7-62db725fc040 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3740026776904d36be28fd3a206a3361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b63757470b845b3ad6e5b18314f2c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:19:08.249403 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-4ca459da-d513-49ad-9264-566e7cb1e574 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:19:08.250230 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-4ca459da-d513-49ad-9264-566e7cb1e574 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: ae51bd6b-96a9-42fa-ad05-234547d3f5d3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:19:08.276942 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-8b4cbb9c-7af7-439c-90e7-62db725fc040 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] 10.222.0.46 "GET /compute/v2.1/servers/e8d37bbd-bee9-4a16-9633-2d26ea56a884" status: 200 len: 1478 microversion: 2.1 time: 0.348561 Jan 15 21:19:08.278136 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3391/6772] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:19:07 2022] GET /compute/v2.1/servers/e8d37bbd-bee9-4a16-9633-2d26ea56a884 => generated 1478 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:19:08.325940 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-4ca459da-d513-49ad-9264-566e7cb1e574 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:19:08.339386 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-4ca459da-d513-49ad-9264-566e7cb1e574 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/ae51bd6b-96a9-42fa-ad05-234547d3f5d3" status: 200 len: 1264 microversion: 2.1 time: 0.094506 Jan 15 21:19:08.341136 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3382/6773] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:19:08 2022] GET /compute/v2.1/servers/ae51bd6b-96a9-42fa-ad05-234547d3f5d3 => generated 1264 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:19:09.300537 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-479d35b0-dc98-4ae7-8c1d-c761430a10cf tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:19:09.302564 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-479d35b0-dc98-4ae7-8c1d-c761430a10cf tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] [instance: e8d37bbd-bee9-4a16-9633-2d26ea56a884] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:19:09.323764 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-479d35b0-dc98-4ae7-8c1d-c761430a10cf tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:09.324926 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-479d35b0-dc98-4ae7-8c1d-c761430a10cf tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:09.325938 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-479d35b0-dc98-4ae7-8c1d-c761430a10cf tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:09.338067 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-479d35b0-dc98-4ae7-8c1d-c761430a10cf tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:09.366818 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b4204118-adba-47f9-a813-d3f127dec29e tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:19:09.368462 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b4204118-adba-47f9-a813-d3f127dec29e tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: ae51bd6b-96a9-42fa-ad05-234547d3f5d3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:19:09.393436 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b4204118-adba-47f9-a813-d3f127dec29e tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:09.394777 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b4204118-adba-47f9-a813-d3f127dec29e tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:09.401405 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b4204118-adba-47f9-a813-d3f127dec29e tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:09.403558 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b4204118-adba-47f9-a813-d3f127dec29e tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:09.525803 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-b4204118-adba-47f9-a813-d3f127dec29e tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:19:09.543413 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b4204118-adba-47f9-a813-d3f127dec29e tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/ae51bd6b-96a9-42fa-ad05-234547d3f5d3" status: 200 len: 1316 microversion: 2.1 time: 0.182919 Jan 15 21:19:09.544429 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3383/6774] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:19:09 2022] GET /compute/v2.1/servers/ae51bd6b-96a9-42fa-ad05-234547d3f5d3 => generated 1316 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:19:09.682358 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-479d35b0-dc98-4ae7-8c1d-c761430a10cf tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3740026776904d36be28fd3a206a3361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b63757470b845b3ad6e5b18314f2c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:19:09.693851 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-479d35b0-dc98-4ae7-8c1d-c761430a10cf tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] 10.222.0.46 "GET /compute/v2.1/servers/e8d37bbd-bee9-4a16-9633-2d26ea56a884" status: 200 len: 1478 microversion: 2.1 time: 0.401773 Jan 15 21:19:09.702605 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3392/6775] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:19:09 2022] GET /compute/v2.1/servers/e8d37bbd-bee9-4a16-9633-2d26ea56a884 => generated 1478 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:19:10.562488 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b9f67faa-967f-4800-808e-de091d37bc96 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:19:10.563705 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b9f67faa-967f-4800-808e-de091d37bc96 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: ae51bd6b-96a9-42fa-ad05-234547d3f5d3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:19:10.570693 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b9f67faa-967f-4800-808e-de091d37bc96 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:10.573846 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b9f67faa-967f-4800-808e-de091d37bc96 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:10.579982 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b9f67faa-967f-4800-808e-de091d37bc96 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:10.589977 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b9f67faa-967f-4800-808e-de091d37bc96 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:10.734648 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-501b1703-6e14-42ed-b814-df1d534cde9d tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:19:10.737203 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-501b1703-6e14-42ed-b814-df1d534cde9d tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] [instance: e8d37bbd-bee9-4a16-9633-2d26ea56a884] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:19:10.751045 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-501b1703-6e14-42ed-b814-df1d534cde9d tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:10.751761 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-501b1703-6e14-42ed-b814-df1d534cde9d tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:10.752792 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-501b1703-6e14-42ed-b814-df1d534cde9d tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:10.753778 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-501b1703-6e14-42ed-b814-df1d534cde9d tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:10.816193 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-b9f67faa-967f-4800-808e-de091d37bc96 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:19:10.838598 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b9f67faa-967f-4800-808e-de091d37bc96 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/ae51bd6b-96a9-42fa-ad05-234547d3f5d3" status: 200 len: 1322 microversion: 2.1 time: 0.280080 Jan 15 21:19:10.845875 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3384/6776] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:19:10 2022] GET /compute/v2.1/servers/ae51bd6b-96a9-42fa-ad05-234547d3f5d3 => generated 1322 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:19:10.877797 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-0658cf9c-3252-4e37-ab5d-c0263e812ed3 req-ca39cfb4-9c1e-40f3-bd62-e6df500518c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8d37bbd-bee9-4a16-9633-2d26ea56a884", "name": "network-vif-deleted", "tag": "c4ab5d7e-fc83-4860-aa6b-417708cf16c0"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:19:10.885762 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:19:10.885762 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:19:10.903337 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-0658cf9c-3252-4e37-ab5d-c0263e812ed3 req-ca39cfb4-9c1e-40f3-bd62-e6df500518c8 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:10.903787 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-0658cf9c-3252-4e37-ab5d-c0263e812ed3 req-ca39cfb4-9c1e-40f3-bd62-e6df500518c8 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:10.932787 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-0658cf9c-3252-4e37-ab5d-c0263e812ed3 req-ca39cfb4-9c1e-40f3-bd62-e6df500518c8 service nova] Creating event network-vif-deleted:c4ab5d7e-fc83-4860-aa6b-417708cf16c0 for instance e8d37bbd-bee9-4a16-9633-2d26ea56a884 on nch1-master-1 Jan 15 21:19:10.942285 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-0658cf9c-3252-4e37-ab5d-c0263e812ed3 req-ca39cfb4-9c1e-40f3-bd62-e6df500518c8 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094156 Jan 15 21:19:10.944221 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3385/6777] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:19:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:19:10.990302 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-501b1703-6e14-42ed-b814-df1d534cde9d tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3740026776904d36be28fd3a206a3361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b63757470b845b3ad6e5b18314f2c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:19:11.017193 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-501b1703-6e14-42ed-b814-df1d534cde9d tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] 10.222.0.46 "GET /compute/v2.1/servers/e8d37bbd-bee9-4a16-9633-2d26ea56a884" status: 200 len: 1478 microversion: 2.1 time: 0.300348 Jan 15 21:19:11.019717 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3393/6778] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:19:10 2022] GET /compute/v2.1/servers/e8d37bbd-bee9-4a16-9633-2d26ea56a884 => generated 1478 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:19:11.863476 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-35ad0997-27de-4646-8b28-c7c83326a600 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:19:11.864504 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-35ad0997-27de-4646-8b28-c7c83326a600 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: ae51bd6b-96a9-42fa-ad05-234547d3f5d3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:19:11.880108 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-35ad0997-27de-4646-8b28-c7c83326a600 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:11.880108 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-35ad0997-27de-4646-8b28-c7c83326a600 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:11.880108 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-35ad0997-27de-4646-8b28-c7c83326a600 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:11.880108 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-35ad0997-27de-4646-8b28-c7c83326a600 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:12.018457 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-35ad0997-27de-4646-8b28-c7c83326a600 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:19:12.030675 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-35ad0997-27de-4646-8b28-c7c83326a600 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/ae51bd6b-96a9-42fa-ad05-234547d3f5d3" status: 200 len: 1322 microversion: 2.1 time: 0.171836 Jan 15 21:19:12.031793 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3386/6779] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:19:11 2022] GET /compute/v2.1/servers/ae51bd6b-96a9-42fa-ad05-234547d3f5d3 => generated 1322 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:19:12.046373 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-144e8983-0fdc-4ebd-81e0-9a9553b23ca4 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:19:12.047656 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-144e8983-0fdc-4ebd-81e0-9a9553b23ca4 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] [instance: e8d37bbd-bee9-4a16-9633-2d26ea56a884] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:19:12.061462 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-144e8983-0fdc-4ebd-81e0-9a9553b23ca4 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:12.062910 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-144e8983-0fdc-4ebd-81e0-9a9553b23ca4 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:12.063938 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-144e8983-0fdc-4ebd-81e0-9a9553b23ca4 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:12.064789 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-144e8983-0fdc-4ebd-81e0-9a9553b23ca4 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:12.099805 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-144e8983-0fdc-4ebd-81e0-9a9553b23ca4 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] HTTP exception thrown: Instance e8d37bbd-bee9-4a16-9633-2d26ea56a884 could not be found. Jan 15 21:19:12.101073 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-144e8983-0fdc-4ebd-81e0-9a9553b23ca4 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Returning 404 to user: Instance e8d37bbd-bee9-4a16-9633-2d26ea56a884 could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:19:12.102161 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-144e8983-0fdc-4ebd-81e0-9a9553b23ca4 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] 10.222.0.46 "GET /compute/v2.1/servers/e8d37bbd-bee9-4a16-9633-2d26ea56a884" status: 404 len: 111 microversion: 2.1 time: 0.070281 Jan 15 21:19:12.107024 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3394/6780] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:19:12 2022] GET /compute/v2.1/servers/e8d37bbd-bee9-4a16-9633-2d26ea56a884 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:19:13.058203 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-0ee4c7b2-7c99-4ca2-8d5e-980164adc690 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:19:13.061284 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-0ee4c7b2-7c99-4ca2-8d5e-980164adc690 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: ae51bd6b-96a9-42fa-ad05-234547d3f5d3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:19:13.074860 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0ee4c7b2-7c99-4ca2-8d5e-980164adc690 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:13.075628 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0ee4c7b2-7c99-4ca2-8d5e-980164adc690 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:13.078273 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0ee4c7b2-7c99-4ca2-8d5e-980164adc690 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:13.078888 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0ee4c7b2-7c99-4ca2-8d5e-980164adc690 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:13.323380 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-0ee4c7b2-7c99-4ca2-8d5e-980164adc690 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:19:13.332500 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-0ee4c7b2-7c99-4ca2-8d5e-980164adc690 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/ae51bd6b-96a9-42fa-ad05-234547d3f5d3" status: 200 len: 1389 microversion: 2.1 time: 0.287517 Jan 15 21:19:13.333481 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3387/6781] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:19:13 2022] GET /compute/v2.1/servers/ae51bd6b-96a9-42fa-ad05-234547d3f5d3 => generated 1389 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:19:14.204415 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-78e99728-603f-4a1d-bb8b-d18bb7bc0f68 req-0cbfa945-fb30-469c-98f6-c8ff4c75b6f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae51bd6b-96a9-42fa-ad05-234547d3f5d3", "tag": "8a3eca19-0e64-45e1-ba8b-83d5de1d3c69"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:19:14.208220 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:19:14.208220 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:19:14.224473 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-78e99728-603f-4a1d-bb8b-d18bb7bc0f68 req-0cbfa945-fb30-469c-98f6-c8ff4c75b6f4 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:14.229363 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-78e99728-603f-4a1d-bb8b-d18bb7bc0f68 req-0cbfa945-fb30-469c-98f6-c8ff4c75b6f4 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:14.256866 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-78e99728-603f-4a1d-bb8b-d18bb7bc0f68 req-0cbfa945-fb30-469c-98f6-c8ff4c75b6f4 service nova] Creating event network-changed:8a3eca19-0e64-45e1-ba8b-83d5de1d3c69 for instance ae51bd6b-96a9-42fa-ad05-234547d3f5d3 on nch2-master-1 Jan 15 21:19:14.279878 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-78e99728-603f-4a1d-bb8b-d18bb7bc0f68 req-0cbfa945-fb30-469c-98f6-c8ff4c75b6f4 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075408 Jan 15 21:19:14.279878 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3395/6782] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:19:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:19:14.359555 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-35d6312c-432f-48c4-998f-e1e60e5a0a9f tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:19:14.360106 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-35d6312c-432f-48c4-998f-e1e60e5a0a9f tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: ae51bd6b-96a9-42fa-ad05-234547d3f5d3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:19:14.374115 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-35d6312c-432f-48c4-998f-e1e60e5a0a9f tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:14.375981 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-35d6312c-432f-48c4-998f-e1e60e5a0a9f tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:14.379582 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-35d6312c-432f-48c4-998f-e1e60e5a0a9f tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:14.380798 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-35d6312c-432f-48c4-998f-e1e60e5a0a9f tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:14.589907 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-6fe9a3e1-749b-41e8-8674-9220e7a11669 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1315553007", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "5a60bb93-fa3d-4edd-92d3-808762b016b9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "250ac663-a6c2-4755-b702-91a1aec1e824"}]}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:19:14.670578 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.network.neutron [None req-6fe9a3e1-749b-41e8-8674-9220e7a11669 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] validate_networks() for [('250ac663-a6c2-4755-b702-91a1aec1e824', None, None, None, None, None)] {{(pid=129366) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 21:19:15.202675 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-35d6312c-432f-48c4-998f-e1e60e5a0a9f tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:19:15.211011 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-35d6312c-432f-48c4-998f-e1e60e5a0a9f tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/ae51bd6b-96a9-42fa-ad05-234547d3f5d3" status: 200 len: 1389 microversion: 2.1 time: 0.864609 Jan 15 21:19:15.211639 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3388/6783] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:19:14 2022] GET /compute/v2.1/servers/ae51bd6b-96a9-42fa-ad05-234547d3f5d3 => generated 1389 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:19:16.024298 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-6fe9a3e1-749b-41e8-8674-9220e7a11669 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Flavor limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 21:19:16.025467 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-6fe9a3e1-749b-41e8-8674-9220e7a11669 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Image limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 21:19:16.026108 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-6fe9a3e1-749b-41e8-8674-9220e7a11669 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Flavor pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 21:19:16.026689 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-6fe9a3e1-749b-41e8-8674-9220e7a11669 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Image pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 21:19:16.027108 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-6fe9a3e1-749b-41e8-8674-9220e7a11669 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 21:19:16.037923 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6fe9a3e1-749b-41e8-8674-9220e7a11669 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:16.038774 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6fe9a3e1-749b-41e8-8674-9220e7a11669 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:16.039801 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6fe9a3e1-749b-41e8-8674-9220e7a11669 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:16.040435 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6fe9a3e1-749b-41e8-8674-9220e7a11669 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:16.059770 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-6fe9a3e1-749b-41e8-8674-9220e7a11669 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Getting quotas for project 7f2ae6f05c2843469190cd96f39ac794. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:19:16.065294 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-6fe9a3e1-749b-41e8-8674-9220e7a11669 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Getting quotas for user f0fc1955b0d446458f8f355550de971b and project 7f2ae6f05c2843469190cd96f39ac794. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:19:16.128177 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-6fe9a3e1-749b-41e8-8674-9220e7a11669 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Going to run 1 instances... {{(pid=129366) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 21:19:16.130663 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-6fe9a3e1-749b-41e8-8674-9220e7a11669 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: 2cd6a61c-b80b-4d1d-989d-f402b88a355e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5a60bb93-fa3d-4edd-92d3-808762b016b9',volume_size=None,volume_type=None)] {{(pid=129366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 21:19:16.235514 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-11c12559-cb26-4b3d-9ad7-6721b64fe668 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:19:16.237348 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-11c12559-cb26-4b3d-9ad7-6721b64fe668 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: ae51bd6b-96a9-42fa-ad05-234547d3f5d3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:19:16.299982 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-11c12559-cb26-4b3d-9ad7-6721b64fe668 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:16.300680 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-11c12559-cb26-4b3d-9ad7-6721b64fe668 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:16.310786 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-11c12559-cb26-4b3d-9ad7-6721b64fe668 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:16.316701 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-11c12559-cb26-4b3d-9ad7-6721b64fe668 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:16.456832 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-6fe9a3e1-749b-41e8-8674-9220e7a11669 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.871794 Jan 15 21:19:16.460826 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3396/6784] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 21:19:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1877 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 15 21:19:16.470556 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-13eb5e80-3adf-4710-b01e-a6db0ce9ab48 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:19:16.473586 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-13eb5e80-3adf-4710-b01e-a6db0ce9ab48 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: 2cd6a61c-b80b-4d1d-989d-f402b88a355e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:19:16.924434 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-13eb5e80-3adf-4710-b01e-a6db0ce9ab48 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fc1955b0d446458f8f355550de971b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ae6f05c2843469190cd96f39ac794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:19:16.941670 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-13eb5e80-3adf-4710-b01e-a6db0ce9ab48 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] 10.222.0.46 "GET /compute/v2.1/servers/2cd6a61c-b80b-4d1d-989d-f402b88a355e" status: 200 len: 1071 microversion: 2.1 time: 0.467790 Jan 15 21:19:16.954483 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3397/6785] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:19:16 2022] GET /compute/v2.1/servers/2cd6a61c-b80b-4d1d-989d-f402b88a355e => generated 1071 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:19:17.332215 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-11c12559-cb26-4b3d-9ad7-6721b64fe668 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:19:17.342237 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-11c12559-cb26-4b3d-9ad7-6721b64fe668 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/ae51bd6b-96a9-42fa-ad05-234547d3f5d3" status: 200 len: 1389 microversion: 2.1 time: 1.117367 Jan 15 21:19:17.358136 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3389/6786] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:19:16 2022] GET /compute/v2.1/servers/ae51bd6b-96a9-42fa-ad05-234547d3f5d3 => generated 1389 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:19:17.959325 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-31c31fc7-320c-432a-813c-14371a4e9ec0 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:19:17.960913 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-31c31fc7-320c-432a-813c-14371a4e9ec0 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: 2cd6a61c-b80b-4d1d-989d-f402b88a355e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:19:17.978354 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-31c31fc7-320c-432a-813c-14371a4e9ec0 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:17.981508 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-31c31fc7-320c-432a-813c-14371a4e9ec0 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:17.985056 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-31c31fc7-320c-432a-813c-14371a4e9ec0 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:17.989602 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-31c31fc7-320c-432a-813c-14371a4e9ec0 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:18.364564 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e4741bd7-5ef6-408e-b1ef-cfa8131648c0 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:19:18.365291 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e4741bd7-5ef6-408e-b1ef-cfa8131648c0 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: ae51bd6b-96a9-42fa-ad05-234547d3f5d3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:19:18.392883 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e4741bd7-5ef6-408e-b1ef-cfa8131648c0 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:18.393348 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e4741bd7-5ef6-408e-b1ef-cfa8131648c0 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:18.394204 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e4741bd7-5ef6-408e-b1ef-cfa8131648c0 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:18.394657 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e4741bd7-5ef6-408e-b1ef-cfa8131648c0 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:18.622397 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-31c31fc7-320c-432a-813c-14371a4e9ec0 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fc1955b0d446458f8f355550de971b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ae6f05c2843469190cd96f39ac794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:19:18.634519 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-31c31fc7-320c-432a-813c-14371a4e9ec0 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] 10.222.0.46 "GET /compute/v2.1/servers/2cd6a61c-b80b-4d1d-989d-f402b88a355e" status: 200 len: 1177 microversion: 2.1 time: 0.677617 Jan 15 21:19:18.654973 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3398/6787] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:19:17 2022] GET /compute/v2.1/servers/2cd6a61c-b80b-4d1d-989d-f402b88a355e => generated 1177 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:19:19.031482 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-e4741bd7-5ef6-408e-b1ef-cfa8131648c0 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:19:19.040319 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e4741bd7-5ef6-408e-b1ef-cfa8131648c0 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/ae51bd6b-96a9-42fa-ad05-234547d3f5d3" status: 200 len: 1389 microversion: 2.1 time: 0.679539 Jan 15 21:19:19.045206 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3390/6788] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:19:18 2022] GET /compute/v2.1/servers/ae51bd6b-96a9-42fa-ad05-234547d3f5d3 => generated 1389 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:19:19.652176 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4e6f8d71-0fef-4c77-bfe1-13bb9c23910a tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:19:19.652794 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-4e6f8d71-0fef-4c77-bfe1-13bb9c23910a tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: 2cd6a61c-b80b-4d1d-989d-f402b88a355e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:19:19.667252 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4e6f8d71-0fef-4c77-bfe1-13bb9c23910a tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:19.669404 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4e6f8d71-0fef-4c77-bfe1-13bb9c23910a tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:19.670235 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4e6f8d71-0fef-4c77-bfe1-13bb9c23910a tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:19.670681 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4e6f8d71-0fef-4c77-bfe1-13bb9c23910a tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:19.966692 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-4e6f8d71-0fef-4c77-bfe1-13bb9c23910a tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fc1955b0d446458f8f355550de971b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ae6f05c2843469190cd96f39ac794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:19:19.978633 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-4e6f8d71-0fef-4c77-bfe1-13bb9c23910a tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] 10.222.0.46 "GET /compute/v2.1/servers/2cd6a61c-b80b-4d1d-989d-f402b88a355e" status: 200 len: 1229 microversion: 2.1 time: 0.330685 Jan 15 21:19:19.980551 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3399/6789] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:19:19 2022] GET /compute/v2.1/servers/2cd6a61c-b80b-4d1d-989d-f402b88a355e => generated 1229 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:19:20.057576 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-17a14638-ba06-46a1-b0aa-c46ae8527e04 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:19:20.058334 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-17a14638-ba06-46a1-b0aa-c46ae8527e04 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: ae51bd6b-96a9-42fa-ad05-234547d3f5d3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:19:20.072927 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-17a14638-ba06-46a1-b0aa-c46ae8527e04 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:20.078564 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-17a14638-ba06-46a1-b0aa-c46ae8527e04 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:20.079585 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-17a14638-ba06-46a1-b0aa-c46ae8527e04 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:20.085620 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-17a14638-ba06-46a1-b0aa-c46ae8527e04 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:20.425265 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-17a14638-ba06-46a1-b0aa-c46ae8527e04 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:19:20.435853 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-17a14638-ba06-46a1-b0aa-c46ae8527e04 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/ae51bd6b-96a9-42fa-ad05-234547d3f5d3" status: 200 len: 1389 microversion: 2.1 time: 0.380419 Jan 15 21:19:20.446804 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3391/6790] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:19:20 2022] GET /compute/v2.1/servers/ae51bd6b-96a9-42fa-ad05-234547d3f5d3 => generated 1389 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:19:20.915285 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-446b9f17-9413-4b02-b14c-75ce3c49e18d tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:19:20.915796 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-446b9f17-9413-4b02-b14c-75ce3c49e18d tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] [instance: c46baa1b-9f5b-42ce-a3f8-f1432c526691] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:19:20.930279 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-446b9f17-9413-4b02-b14c-75ce3c49e18d tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:20.936993 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-d07e30b2-ab68-4910-be2b-7f96efcbe49f req-e2b76ba5-8f01-4b8a-ada3-eddac48823ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c46baa1b-9f5b-42ce-a3f8-f1432c526691", "tag": "d97caf67-f7a7-4dae-ab1d-958cb300e495"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:19:20.939074 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:19:20.939074 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:19:20.942841 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-446b9f17-9413-4b02-b14c-75ce3c49e18d tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:20.946536 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-446b9f17-9413-4b02-b14c-75ce3c49e18d tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:20.947207 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-446b9f17-9413-4b02-b14c-75ce3c49e18d tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:20.952027 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-d07e30b2-ab68-4910-be2b-7f96efcbe49f req-e2b76ba5-8f01-4b8a-ada3-eddac48823ab service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:20.956139 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-d07e30b2-ab68-4910-be2b-7f96efcbe49f req-e2b76ba5-8f01-4b8a-ada3-eddac48823ab service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:20.986432 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-d07e30b2-ab68-4910-be2b-7f96efcbe49f req-e2b76ba5-8f01-4b8a-ada3-eddac48823ab service nova] Creating event network-changed:d97caf67-f7a7-4dae-ab1d-958cb300e495 for instance c46baa1b-9f5b-42ce-a3f8-f1432c526691 on nch2-master-1 Jan 15 21:19:20.997652 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-d07e30b2-ab68-4910-be2b-7f96efcbe49f req-e2b76ba5-8f01-4b8a-ada3-eddac48823ab service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065136 Jan 15 21:19:20.999192 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3392/6791] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:19:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 21:19:21.015117 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5795f7fd-11d1-476f-988b-74d325be93c5 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:19:21.016316 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-5795f7fd-11d1-476f-988b-74d325be93c5 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: 2cd6a61c-b80b-4d1d-989d-f402b88a355e] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:19:21.020525 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-446b9f17-9413-4b02-b14c-75ce3c49e18d tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] [instance: c46baa1b-9f5b-42ce-a3f8-f1432c526691] Going to try to terminate instance {{(pid=129366) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 21:19:21.034487 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5795f7fd-11d1-476f-988b-74d325be93c5 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:21.036173 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5795f7fd-11d1-476f-988b-74d325be93c5 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:21.040368 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5795f7fd-11d1-476f-988b-74d325be93c5 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:21.043822 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5795f7fd-11d1-476f-988b-74d325be93c5 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:21.221933 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-446b9f17-9413-4b02-b14c-75ce3c49e18d tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] 10.222.0.46 "DELETE /compute/v2.1/servers/c46baa1b-9f5b-42ce-a3f8-f1432c526691" status: 204 len: 0 microversion: 2.1 time: 0.310513 Jan 15 21:19:21.223610 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3400/6792] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 21:19:20 2022] DELETE /compute/v2.1/servers/c46baa1b-9f5b-42ce-a3f8-f1432c526691 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 21:19:21.232499 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-4ccc8de7-9cfe-4edd-9c48-5c9d1c6db97d req-4a2ba6d7-8c1c-46f4-83b5-a211aedbbaad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2cd6a61c-b80b-4d1d-989d-f402b88a355e", "tag": "96b7e3c2-4582-40bc-b5cb-c0d74adbdb24"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:19:21.234492 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:19:21.234492 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:19:21.246496 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-4ccc8de7-9cfe-4edd-9c48-5c9d1c6db97d req-4a2ba6d7-8c1c-46f4-83b5-a211aedbbaad service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:21.247010 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-4ccc8de7-9cfe-4edd-9c48-5c9d1c6db97d req-4a2ba6d7-8c1c-46f4-83b5-a211aedbbaad service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:21.262491 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-4ccc8de7-9cfe-4edd-9c48-5c9d1c6db97d req-4a2ba6d7-8c1c-46f4-83b5-a211aedbbaad service nova] Creating event network-changed:96b7e3c2-4582-40bc-b5cb-c0d74adbdb24 for instance 2cd6a61c-b80b-4d1d-989d-f402b88a355e on nch1-master-1 Jan 15 21:19:21.267821 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-4ccc8de7-9cfe-4edd-9c48-5c9d1c6db97d req-4a2ba6d7-8c1c-46f4-83b5-a211aedbbaad service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042366 Jan 15 21:19:21.269229 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3401/6793] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:19:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:19:21.276637 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-44d0f0bc-0128-4cf6-867c-d180da0537ff tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:19:21.278101 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-44d0f0bc-0128-4cf6-867c-d180da0537ff tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] [instance: c46baa1b-9f5b-42ce-a3f8-f1432c526691] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:19:21.285991 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-44d0f0bc-0128-4cf6-867c-d180da0537ff tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:21.286435 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-44d0f0bc-0128-4cf6-867c-d180da0537ff tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:21.287290 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-44d0f0bc-0128-4cf6-867c-d180da0537ff tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:21.288265 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-44d0f0bc-0128-4cf6-867c-d180da0537ff tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:21.445047 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-5795f7fd-11d1-476f-988b-74d325be93c5 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fc1955b0d446458f8f355550de971b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ae6f05c2843469190cd96f39ac794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:19:21.468150 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5795f7fd-11d1-476f-988b-74d325be93c5 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] 10.222.0.46 "GET /compute/v2.1/servers/2cd6a61c-b80b-4d1d-989d-f402b88a355e" status: 200 len: 1217 microversion: 2.1 time: 0.456926 Jan 15 21:19:21.468777 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3393/6794] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:19:21 2022] GET /compute/v2.1/servers/2cd6a61c-b80b-4d1d-989d-f402b88a355e => generated 1217 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:19:21.482896 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3d97ed2b-cd3c-4443-8e3c-3d103151dc0c tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:19:21.483744 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-3d97ed2b-cd3c-4443-8e3c-3d103151dc0c tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: ae51bd6b-96a9-42fa-ad05-234547d3f5d3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:19:21.496125 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3d97ed2b-cd3c-4443-8e3c-3d103151dc0c tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:21.498069 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3d97ed2b-cd3c-4443-8e3c-3d103151dc0c tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:21.499422 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3d97ed2b-cd3c-4443-8e3c-3d103151dc0c tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:21.500284 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3d97ed2b-cd3c-4443-8e3c-3d103151dc0c tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:21.557177 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-44d0f0bc-0128-4cf6-867c-d180da0537ff tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3740026776904d36be28fd3a206a3361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b63757470b845b3ad6e5b18314f2c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:19:21.566711 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-44d0f0bc-0128-4cf6-867c-d180da0537ff tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] 10.222.0.46 "GET /compute/v2.1/servers/c46baa1b-9f5b-42ce-a3f8-f1432c526691" status: 200 len: 1768 microversion: 2.1 time: 0.296101 Jan 15 21:19:21.567601 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3402/6795] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:19:21 2022] GET /compute/v2.1/servers/c46baa1b-9f5b-42ce-a3f8-f1432c526691 => generated 1768 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:19:21.703658 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-3d97ed2b-cd3c-4443-8e3c-3d103151dc0c tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:19:21.714642 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3d97ed2b-cd3c-4443-8e3c-3d103151dc0c tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/ae51bd6b-96a9-42fa-ad05-234547d3f5d3" status: 200 len: 1389 microversion: 2.1 time: 0.244500 Jan 15 21:19:21.715574 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3394/6796] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:19:21 2022] GET /compute/v2.1/servers/ae51bd6b-96a9-42fa-ad05-234547d3f5d3 => generated 1389 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:19:21.974670 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-e7a0e98b-402f-465a-9a83-1d40f77b34d4 req-67b91b7a-41f3-4b25-b94a-b559adc87f59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae51bd6b-96a9-42fa-ad05-234547d3f5d3", "name": "network-vif-plugged", "status": "completed", "tag": "8a3eca19-0e64-45e1-ba8b-83d5de1d3c69"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:19:21.977810 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:19:21.977810 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:19:21.988609 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-e7a0e98b-402f-465a-9a83-1d40f77b34d4 req-67b91b7a-41f3-4b25-b94a-b559adc87f59 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:21.989840 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-e7a0e98b-402f-465a-9a83-1d40f77b34d4 req-67b91b7a-41f3-4b25-b94a-b559adc87f59 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:22.007707 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-e7a0e98b-402f-465a-9a83-1d40f77b34d4 req-67b91b7a-41f3-4b25-b94a-b559adc87f59 service nova] Creating event network-vif-plugged:8a3eca19-0e64-45e1-ba8b-83d5de1d3c69 for instance ae51bd6b-96a9-42fa-ad05-234547d3f5d3 on nch2-master-1 Jan 15 21:19:22.015304 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-e7a0e98b-402f-465a-9a83-1d40f77b34d4 req-67b91b7a-41f3-4b25-b94a-b559adc87f59 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044190 Jan 15 21:19:22.016515 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3403/6797] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:19:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:19:22.488609 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-35481d0f-dbcf-47d9-a46a-24913228f4d4 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:19:22.489616 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-35481d0f-dbcf-47d9-a46a-24913228f4d4 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: 2cd6a61c-b80b-4d1d-989d-f402b88a355e] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:19:22.506152 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-35481d0f-dbcf-47d9-a46a-24913228f4d4 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:22.508226 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-35481d0f-dbcf-47d9-a46a-24913228f4d4 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:22.509642 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-35481d0f-dbcf-47d9-a46a-24913228f4d4 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:22.511860 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-35481d0f-dbcf-47d9-a46a-24913228f4d4 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:22.592111 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-df3cde61-951b-4fb4-b233-de4673e0f2ff tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:19:22.593443 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-df3cde61-951b-4fb4-b233-de4673e0f2ff tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] [instance: c46baa1b-9f5b-42ce-a3f8-f1432c526691] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:19:22.611088 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-df3cde61-951b-4fb4-b233-de4673e0f2ff tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:22.612594 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-df3cde61-951b-4fb4-b233-de4673e0f2ff tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:22.615428 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-df3cde61-951b-4fb4-b233-de4673e0f2ff tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:22.621096 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-df3cde61-951b-4fb4-b233-de4673e0f2ff tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:22.726972 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-35481d0f-dbcf-47d9-a46a-24913228f4d4 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fc1955b0d446458f8f355550de971b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ae6f05c2843469190cd96f39ac794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:19:22.734985 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-35481d0f-dbcf-47d9-a46a-24913228f4d4 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] 10.222.0.46 "GET /compute/v2.1/servers/2cd6a61c-b80b-4d1d-989d-f402b88a355e" status: 200 len: 1217 microversion: 2.1 time: 0.251221 Jan 15 21:19:22.735573 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3395/6798] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:19:22 2022] GET /compute/v2.1/servers/2cd6a61c-b80b-4d1d-989d-f402b88a355e => generated 1217 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:19:22.740484 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ea576c88-0d87-408e-aa4d-02176822dd8a tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:19:22.741611 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ea576c88-0d87-408e-aa4d-02176822dd8a tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: ae51bd6b-96a9-42fa-ad05-234547d3f5d3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:19:22.748525 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ea576c88-0d87-408e-aa4d-02176822dd8a tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:22.749049 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ea576c88-0d87-408e-aa4d-02176822dd8a tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:22.749902 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ea576c88-0d87-408e-aa4d-02176822dd8a tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:22.751095 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ea576c88-0d87-408e-aa4d-02176822dd8a tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:22.857117 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-df3cde61-951b-4fb4-b233-de4673e0f2ff tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3740026776904d36be28fd3a206a3361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b63757470b845b3ad6e5b18314f2c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:19:22.869532 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-df3cde61-951b-4fb4-b233-de4673e0f2ff tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] 10.222.0.46 "GET /compute/v2.1/servers/c46baa1b-9f5b-42ce-a3f8-f1432c526691" status: 200 len: 1649 microversion: 2.1 time: 0.285857 Jan 15 21:19:22.870886 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3404/6799] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:19:22 2022] GET /compute/v2.1/servers/c46baa1b-9f5b-42ce-a3f8-f1432c526691 => generated 1649 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:19:22.941521 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-ea576c88-0d87-408e-aa4d-02176822dd8a tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:19:22.949664 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ea576c88-0d87-408e-aa4d-02176822dd8a tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/ae51bd6b-96a9-42fa-ad05-234547d3f5d3" status: 200 len: 1389 microversion: 2.1 time: 0.212831 Jan 15 21:19:22.950351 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3396/6800] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:19:22 2022] GET /compute/v2.1/servers/ae51bd6b-96a9-42fa-ad05-234547d3f5d3 => generated 1389 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:19:23.412311 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-2b52aec7-efee-4373-aebb-460a1a36fab7 req-5c2b042b-b2c8-40dd-a029-e00f4d808bb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c46baa1b-9f5b-42ce-a3f8-f1432c526691", "name": "network-vif-deleted", "tag": "d97caf67-f7a7-4dae-ab1d-958cb300e495"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:19:23.414020 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:19:23.414020 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:19:23.422175 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-2b52aec7-efee-4373-aebb-460a1a36fab7 req-5c2b042b-b2c8-40dd-a029-e00f4d808bb7 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:23.422620 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-2b52aec7-efee-4373-aebb-460a1a36fab7 req-5c2b042b-b2c8-40dd-a029-e00f4d808bb7 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:23.436496 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-2b52aec7-efee-4373-aebb-460a1a36fab7 req-5c2b042b-b2c8-40dd-a029-e00f4d808bb7 service nova] Creating event network-vif-deleted:d97caf67-f7a7-4dae-ab1d-958cb300e495 for instance c46baa1b-9f5b-42ce-a3f8-f1432c526691 on nch2-master-1 Jan 15 21:19:23.445154 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-2b52aec7-efee-4373-aebb-460a1a36fab7 req-5c2b042b-b2c8-40dd-a029-e00f4d808bb7 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034391 Jan 15 21:19:23.445989 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3405/6801] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:19:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:19:23.752219 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3b99eee0-416d-4538-84b0-6ba892772cca tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:19:23.753933 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-3b99eee0-416d-4538-84b0-6ba892772cca tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: 2cd6a61c-b80b-4d1d-989d-f402b88a355e] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:19:23.762556 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3b99eee0-416d-4538-84b0-6ba892772cca tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:23.763752 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3b99eee0-416d-4538-84b0-6ba892772cca tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:23.765088 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3b99eee0-416d-4538-84b0-6ba892772cca tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:23.766114 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3b99eee0-416d-4538-84b0-6ba892772cca tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:23.889557 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4945fe62-d731-4668-ba70-2efdbda2f916 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:19:23.890591 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-4945fe62-d731-4668-ba70-2efdbda2f916 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] [instance: c46baa1b-9f5b-42ce-a3f8-f1432c526691] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:19:23.919304 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4945fe62-d731-4668-ba70-2efdbda2f916 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:23.926211 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4945fe62-d731-4668-ba70-2efdbda2f916 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:23.927175 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4945fe62-d731-4668-ba70-2efdbda2f916 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:23.927689 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4945fe62-d731-4668-ba70-2efdbda2f916 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:23.992417 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-3b99eee0-416d-4538-84b0-6ba892772cca tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fc1955b0d446458f8f355550de971b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ae6f05c2843469190cd96f39ac794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:19:24.004976 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3b99eee0-416d-4538-84b0-6ba892772cca tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] 10.222.0.46 "GET /compute/v2.1/servers/2cd6a61c-b80b-4d1d-989d-f402b88a355e" status: 200 len: 1217 microversion: 2.1 time: 0.256937 Jan 15 21:19:24.005659 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3397/6802] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:19:23 2022] GET /compute/v2.1/servers/2cd6a61c-b80b-4d1d-989d-f402b88a355e => generated 1217 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:19:24.011866 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4945fe62-d731-4668-ba70-2efdbda2f916 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:24.012514 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4945fe62-d731-4668-ba70-2efdbda2f916 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:24.016289 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-18f290ea-2128-4a66-96f6-e526e581f6fb tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:19:24.016989 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-18f290ea-2128-4a66-96f6-e526e581f6fb tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: ae51bd6b-96a9-42fa-ad05-234547d3f5d3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:19:24.019801 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.objects.instance [None req-4945fe62-d731-4668-ba70-2efdbda2f916 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lazy-loading 'fault' on Instance uuid c46baa1b-9f5b-42ce-a3f8-f1432c526691 {{(pid=129366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 21:19:24.027082 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-18f290ea-2128-4a66-96f6-e526e581f6fb tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:24.028064 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-18f290ea-2128-4a66-96f6-e526e581f6fb tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:24.029440 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-18f290ea-2128-4a66-96f6-e526e581f6fb tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:24.029960 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-18f290ea-2128-4a66-96f6-e526e581f6fb tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:24.065875 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-4945fe62-d731-4668-ba70-2efdbda2f916 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3740026776904d36be28fd3a206a3361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b63757470b845b3ad6e5b18314f2c57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:19:24.074316 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-4945fe62-d731-4668-ba70-2efdbda2f916 tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] 10.222.0.46 "GET /compute/v2.1/servers/c46baa1b-9f5b-42ce-a3f8-f1432c526691" status: 200 len: 1383 microversion: 2.1 time: 0.190751 Jan 15 21:19:24.074907 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3406/6803] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:19:23 2022] GET /compute/v2.1/servers/c46baa1b-9f5b-42ce-a3f8-f1432c526691 => generated 1383 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:19:24.199796 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-18f290ea-2128-4a66-96f6-e526e581f6fb tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:19:24.207513 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-18f290ea-2128-4a66-96f6-e526e581f6fb tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/ae51bd6b-96a9-42fa-ad05-234547d3f5d3" status: 200 len: 1561 microversion: 2.1 time: 0.198207 Jan 15 21:19:24.208101 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3398/6804] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:19:24 2022] GET /compute/v2.1/servers/ae51bd6b-96a9-42fa-ad05-234547d3f5d3 => generated 1561 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:19:24.224239 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-3af20c46-ba72-455c-ab21-d88e0137161a tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:19:24.225556 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-3af20c46-ba72-455c-ab21-d88e0137161a tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: ae51bd6b-96a9-42fa-ad05-234547d3f5d3] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:19:24.231784 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3af20c46-ba72-455c-ab21-d88e0137161a tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:24.232342 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3af20c46-ba72-455c-ab21-d88e0137161a tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:24.233263 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3af20c46-ba72-455c-ab21-d88e0137161a tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:24.233697 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3af20c46-ba72-455c-ab21-d88e0137161a tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:24.388702 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-3af20c46-ba72-455c-ab21-d88e0137161a tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:19:24.397924 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-3af20c46-ba72-455c-ab21-d88e0137161a tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/ae51bd6b-96a9-42fa-ad05-234547d3f5d3" status: 200 len: 1561 microversion: 2.1 time: 0.176478 Jan 15 21:19:24.398946 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3407/6805] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:19:24 2022] GET /compute/v2.1/servers/ae51bd6b-96a9-42fa-ad05-234547d3f5d3 => generated 1561 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:19:25.023860 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2a3430c9-dc27-40f4-8318-1d96ae0b4bdc tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:19:25.024468 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-2a3430c9-dc27-40f4-8318-1d96ae0b4bdc tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: 2cd6a61c-b80b-4d1d-989d-f402b88a355e] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:19:25.031791 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2a3430c9-dc27-40f4-8318-1d96ae0b4bdc tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:25.032246 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2a3430c9-dc27-40f4-8318-1d96ae0b4bdc tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:25.033092 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2a3430c9-dc27-40f4-8318-1d96ae0b4bdc tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:25.033529 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2a3430c9-dc27-40f4-8318-1d96ae0b4bdc tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:25.100784 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-52c35c95-e4e4-49bc-8aaf-34a4556cd80f tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:19:25.101353 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-52c35c95-e4e4-49bc-8aaf-34a4556cd80f tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] [instance: c46baa1b-9f5b-42ce-a3f8-f1432c526691] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:19:25.108170 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-52c35c95-e4e4-49bc-8aaf-34a4556cd80f tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:25.108630 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-52c35c95-e4e4-49bc-8aaf-34a4556cd80f tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:25.109450 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-52c35c95-e4e4-49bc-8aaf-34a4556cd80f tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:25.110116 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-52c35c95-e4e4-49bc-8aaf-34a4556cd80f tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:25.128216 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-52c35c95-e4e4-49bc-8aaf-34a4556cd80f tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] HTTP exception thrown: Instance c46baa1b-9f5b-42ce-a3f8-f1432c526691 could not be found. Jan 15 21:19:25.129777 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-52c35c95-e4e4-49bc-8aaf-34a4556cd80f tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Returning 404 to user: Instance c46baa1b-9f5b-42ce-a3f8-f1432c526691 could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:19:25.133836 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-52c35c95-e4e4-49bc-8aaf-34a4556cd80f tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] 10.222.0.46 "GET /compute/v2.1/servers/c46baa1b-9f5b-42ce-a3f8-f1432c526691" status: 404 len: 111 microversion: 2.1 time: 0.036406 Jan 15 21:19:25.134834 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3408/6806] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:19:25 2022] GET /compute/v2.1/servers/c46baa1b-9f5b-42ce-a3f8-f1432c526691 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:19:25.275296 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-2a3430c9-dc27-40f4-8318-1d96ae0b4bdc tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fc1955b0d446458f8f355550de971b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ae6f05c2843469190cd96f39ac794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:19:25.292014 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2a3430c9-dc27-40f4-8318-1d96ae0b4bdc tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] 10.222.0.46 "GET /compute/v2.1/servers/2cd6a61c-b80b-4d1d-989d-f402b88a355e" status: 200 len: 1217 microversion: 2.1 time: 0.272009 Jan 15 21:19:25.295997 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3399/6807] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:19:25 2022] GET /compute/v2.1/servers/2cd6a61c-b80b-4d1d-989d-f402b88a355e => generated 1217 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:19:26.313416 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-717c127f-c2ac-496c-80fa-e52d4ebc5008 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:19:26.314033 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-717c127f-c2ac-496c-80fa-e52d4ebc5008 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: 2cd6a61c-b80b-4d1d-989d-f402b88a355e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:19:26.328458 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-717c127f-c2ac-496c-80fa-e52d4ebc5008 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:26.328945 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-717c127f-c2ac-496c-80fa-e52d4ebc5008 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:26.329929 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-717c127f-c2ac-496c-80fa-e52d4ebc5008 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:26.330379 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-717c127f-c2ac-496c-80fa-e52d4ebc5008 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:26.616081 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-717c127f-c2ac-496c-80fa-e52d4ebc5008 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fc1955b0d446458f8f355550de971b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ae6f05c2843469190cd96f39ac794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:19:26.624043 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-717c127f-c2ac-496c-80fa-e52d4ebc5008 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] 10.222.0.46 "GET /compute/v2.1/servers/2cd6a61c-b80b-4d1d-989d-f402b88a355e" status: 200 len: 1217 microversion: 2.1 time: 0.314869 Jan 15 21:19:26.624626 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3409/6808] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:19:26 2022] GET /compute/v2.1/servers/2cd6a61c-b80b-4d1d-989d-f402b88a355e => generated 1217 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:19:26.736408 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-34df203b-01e2-4157-929d-661c2956f154 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:19:26.737064 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-34df203b-01e2-4157-929d-661c2956f154 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: ae51bd6b-96a9-42fa-ad05-234547d3f5d3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:19:26.749496 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-34df203b-01e2-4157-929d-661c2956f154 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:26.750229 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-34df203b-01e2-4157-929d-661c2956f154 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:26.751047 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-34df203b-01e2-4157-929d-661c2956f154 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:26.751491 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-34df203b-01e2-4157-929d-661c2956f154 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:26.925691 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-84d91acb-29ac-47d8-80ea-7aa3bf289c56 req-ef5a54e0-c972-4516-80f7-5b32d366b3e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae51bd6b-96a9-42fa-ad05-234547d3f5d3", "tag": "8a3eca19-0e64-45e1-ba8b-83d5de1d3c69"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:19:26.927555 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:19:26.927555 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:19:26.939822 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-84d91acb-29ac-47d8-80ea-7aa3bf289c56 req-ef5a54e0-c972-4516-80f7-5b32d366b3e3 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:26.940283 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-84d91acb-29ac-47d8-80ea-7aa3bf289c56 req-ef5a54e0-c972-4516-80f7-5b32d366b3e3 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:26.967302 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-84d91acb-29ac-47d8-80ea-7aa3bf289c56 req-ef5a54e0-c972-4516-80f7-5b32d366b3e3 service nova] Creating event network-changed:8a3eca19-0e64-45e1-ba8b-83d5de1d3c69 for instance ae51bd6b-96a9-42fa-ad05-234547d3f5d3 on nch2-master-1 Jan 15 21:19:26.978154 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-84d91acb-29ac-47d8-80ea-7aa3bf289c56 req-ef5a54e0-c972-4516-80f7-5b32d366b3e3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.235778 Jan 15 21:19:26.989593 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3410/6809] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:19:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:19:27.590393 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-34df203b-01e2-4157-929d-661c2956f154 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:19:27.606799 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-34df203b-01e2-4157-929d-661c2956f154 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/ae51bd6b-96a9-42fa-ad05-234547d3f5d3" status: 200 len: 1561 microversion: 2.1 time: 0.874550 Jan 15 21:19:27.609121 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3400/6810] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:19:26 2022] GET /compute/v2.1/servers/ae51bd6b-96a9-42fa-ad05-234547d3f5d3 => generated 1561 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:19:27.644361 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ec611b57-87eb-4c6e-8118-9488bfdaddf7 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:19:27.646074 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ec611b57-87eb-4c6e-8118-9488bfdaddf7 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: 2cd6a61c-b80b-4d1d-989d-f402b88a355e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:19:27.665110 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ec611b57-87eb-4c6e-8118-9488bfdaddf7 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:27.665567 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ec611b57-87eb-4c6e-8118-9488bfdaddf7 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:27.666364 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ec611b57-87eb-4c6e-8118-9488bfdaddf7 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:27.666796 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ec611b57-87eb-4c6e-8118-9488bfdaddf7 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:28.175958 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-ec611b57-87eb-4c6e-8118-9488bfdaddf7 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fc1955b0d446458f8f355550de971b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ae6f05c2843469190cd96f39ac794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:19:28.194731 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ec611b57-87eb-4c6e-8118-9488bfdaddf7 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] 10.222.0.46 "GET /compute/v2.1/servers/2cd6a61c-b80b-4d1d-989d-f402b88a355e" status: 200 len: 1217 microversion: 2.1 time: 0.556401 Jan 15 21:19:28.207740 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3411/6811] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:19:27 2022] GET /compute/v2.1/servers/2cd6a61c-b80b-4d1d-989d-f402b88a355e => generated 1217 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:19:28.354941 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-0be5e2cc-bf0d-42b0-8933-766d894227db req-0570a0d3-d7bb-4027-ae2a-e1c608525de7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cd6a61c-b80b-4d1d-989d-f402b88a355e", "name": "network-vif-plugged", "status": "completed", "tag": "96b7e3c2-4582-40bc-b5cb-c0d74adbdb24"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:19:28.356985 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:19:28.356985 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:19:28.382452 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-0be5e2cc-bf0d-42b0-8933-766d894227db req-0570a0d3-d7bb-4027-ae2a-e1c608525de7 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:28.383122 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-0be5e2cc-bf0d-42b0-8933-766d894227db req-0570a0d3-d7bb-4027-ae2a-e1c608525de7 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:28.398864 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-0be5e2cc-bf0d-42b0-8933-766d894227db req-0570a0d3-d7bb-4027-ae2a-e1c608525de7 service nova] Creating event network-vif-plugged:96b7e3c2-4582-40bc-b5cb-c0d74adbdb24 for instance 2cd6a61c-b80b-4d1d-989d-f402b88a355e on nch1-master-1 Jan 15 21:19:28.410357 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-0be5e2cc-bf0d-42b0-8933-766d894227db req-0570a0d3-d7bb-4027-ae2a-e1c608525de7 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059094 Jan 15 21:19:28.411575 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3401/6812] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:19:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:19:29.217374 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-74719a68-d35c-4e1a-9b79-e5d02501fce2 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:19:29.218158 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-74719a68-d35c-4e1a-9b79-e5d02501fce2 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: 2cd6a61c-b80b-4d1d-989d-f402b88a355e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:19:29.233012 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-74719a68-d35c-4e1a-9b79-e5d02501fce2 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:29.233479 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-74719a68-d35c-4e1a-9b79-e5d02501fce2 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:29.234307 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-74719a68-d35c-4e1a-9b79-e5d02501fce2 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:29.234754 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-74719a68-d35c-4e1a-9b79-e5d02501fce2 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:29.501914 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-74719a68-d35c-4e1a-9b79-e5d02501fce2 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fc1955b0d446458f8f355550de971b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ae6f05c2843469190cd96f39ac794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:19:29.516584 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-74719a68-d35c-4e1a-9b79-e5d02501fce2 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] 10.222.0.46 "GET /compute/v2.1/servers/2cd6a61c-b80b-4d1d-989d-f402b88a355e" status: 200 len: 1217 microversion: 2.1 time: 0.304682 Jan 15 21:19:29.517441 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3412/6813] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:19:29 2022] GET /compute/v2.1/servers/2cd6a61c-b80b-4d1d-989d-f402b88a355e => generated 1217 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:19:30.542342 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-db6b7b73-4842-41f5-98c6-2d377e8b4985 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:19:30.543096 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-db6b7b73-4842-41f5-98c6-2d377e8b4985 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: 2cd6a61c-b80b-4d1d-989d-f402b88a355e] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:19:30.573192 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-db6b7b73-4842-41f5-98c6-2d377e8b4985 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:30.574020 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-db6b7b73-4842-41f5-98c6-2d377e8b4985 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:30.579975 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-db6b7b73-4842-41f5-98c6-2d377e8b4985 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:30.580501 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-db6b7b73-4842-41f5-98c6-2d377e8b4985 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:30.886690 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-db6b7b73-4842-41f5-98c6-2d377e8b4985 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fc1955b0d446458f8f355550de971b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ae6f05c2843469190cd96f39ac794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:19:30.894532 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-db6b7b73-4842-41f5-98c6-2d377e8b4985 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] 10.222.0.46 "GET /compute/v2.1/servers/2cd6a61c-b80b-4d1d-989d-f402b88a355e" status: 200 len: 1405 microversion: 2.1 time: 0.362700 Jan 15 21:19:30.905563 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3402/6814] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:19:30 2022] GET /compute/v2.1/servers/2cd6a61c-b80b-4d1d-989d-f402b88a355e => generated 1405 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:19:30.912057 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c44f1d02-7135-4e95-a065-dff73ea5dc55 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:19:30.913784 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c44f1d02-7135-4e95-a065-dff73ea5dc55 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: 2cd6a61c-b80b-4d1d-989d-f402b88a355e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:19:30.921314 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c44f1d02-7135-4e95-a065-dff73ea5dc55 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:30.922056 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c44f1d02-7135-4e95-a065-dff73ea5dc55 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:30.922926 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c44f1d02-7135-4e95-a065-dff73ea5dc55 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:30.923359 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c44f1d02-7135-4e95-a065-dff73ea5dc55 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:31.214975 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-344ffec5-c17b-4011-986a-5cc142c40ffe tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] Calling method '.version_select at 0x7f30c954a5e0>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:19:31.237845 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-344ffec5-c17b-4011-986a-5cc142c40ffe tempest-TestSecurityGroupsBasicOps-2044461148 tempest-TestSecurityGroupsBasicOps-2044461148-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-870193259" status: 202 len: 0 microversion: 2.1 time: 0.026962 Jan 15 21:19:31.238566 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3403/6815] 10.222.0.46 () {58 vars in 1274 bytes} [Sat Jan 15 21:19:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-870193259 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:19:31.263448 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-c44f1d02-7135-4e95-a065-dff73ea5dc55 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fc1955b0d446458f8f355550de971b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ae6f05c2843469190cd96f39ac794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:19:31.272988 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c44f1d02-7135-4e95-a065-dff73ea5dc55 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] 10.222.0.46 "GET /compute/v2.1/servers/2cd6a61c-b80b-4d1d-989d-f402b88a355e" status: 200 len: 1405 microversion: 2.1 time: 0.366033 Jan 15 21:19:31.273898 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3413/6816] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:19:30 2022] GET /compute/v2.1/servers/2cd6a61c-b80b-4d1d-989d-f402b88a355e => generated 1405 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:19:31.297171 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b9913d06-f56d-48a4-b151-78a39c033506 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-2056870522"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:19:31.297171 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b9913d06-f56d-48a4-b151-78a39c033506 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: 2cd6a61c-b80b-4d1d-989d-f402b88a355e] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:19:31.302391 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b9913d06-f56d-48a4-b151-78a39c033506 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:31.302935 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b9913d06-f56d-48a4-b151-78a39c033506 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:31.304636 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b9913d06-f56d-48a4-b151-78a39c033506 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:31.305221 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b9913d06-f56d-48a4-b151-78a39c033506 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:31.454426 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.compute.api [None req-b9913d06-f56d-48a4-b151-78a39c033506 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: 2cd6a61c-b80b-4d1d-989d-f402b88a355e] Attempting to quiesce instance before volume snapshot. Jan 15 21:19:31.521194 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.compute.api [None req-b9913d06-f56d-48a4-b151-78a39c033506 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: 2cd6a61c-b80b-4d1d-989d-f402b88a355e] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Jan 15 21:19:31.631583 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b9913d06-f56d-48a4-b151-78a39c033506 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: 2cd6a61c-b80b-4d1d-989d-f402b88a355e] Creating snapshot from volume 5a60bb93-fa3d-4edd-92d3-808762b016b9. {{(pid=129365) snapshot_instance /opt/stack/nova/nova/compute/api.py:3399}} Jan 15 21:19:33.086282 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b9913d06-f56d-48a4-b151-78a39c033506 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] 10.222.0.46 "POST /compute/v2.1/servers/2cd6a61c-b80b-4d1d-989d-f402b88a355e/action" status: 202 len: 0 microversion: 2.1 time: 1.795612 Jan 15 21:19:33.086944 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3404/6817] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:19:31 2022] POST /compute/v2.1/servers/2cd6a61c-b80b-4d1d-989d-f402b88a355e/action => generated 0 bytes in 1798 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jan 15 21:19:33.300197 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-6005084a-cbc9-4ee8-b5d4-e504e7518abc tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-390848803", "imageRef": "89fdf877-cfa3-4d5c-90c6-a3fc2c30089c", "flavorRef": "452", "networks": [{"uuid": "250ac663-a6c2-4755-b702-91a1aec1e824"}]}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:19:33.360913 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.network.neutron [None req-6005084a-cbc9-4ee8-b5d4-e504e7518abc tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] validate_networks() for [('250ac663-a6c2-4755-b702-91a1aec1e824', None, None, None, None, None)] {{(pid=129366) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 21:19:33.873432 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-6005084a-cbc9-4ee8-b5d4-e504e7518abc tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Flavor limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 21:19:33.873852 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-6005084a-cbc9-4ee8-b5d4-e504e7518abc tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Image limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 21:19:33.874325 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-6005084a-cbc9-4ee8-b5d4-e504e7518abc tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Flavor pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 21:19:33.874733 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-6005084a-cbc9-4ee8-b5d4-e504e7518abc tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Image pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 21:19:33.875144 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-6005084a-cbc9-4ee8-b5d4-e504e7518abc tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 21:19:33.885089 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6005084a-cbc9-4ee8-b5d4-e504e7518abc tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:33.885544 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6005084a-cbc9-4ee8-b5d4-e504e7518abc tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:33.886393 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6005084a-cbc9-4ee8-b5d4-e504e7518abc tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:33.886851 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6005084a-cbc9-4ee8-b5d4-e504e7518abc tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:33.907896 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-6005084a-cbc9-4ee8-b5d4-e504e7518abc tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Getting quotas for project 7f2ae6f05c2843469190cd96f39ac794. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:19:33.915322 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-6005084a-cbc9-4ee8-b5d4-e504e7518abc tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Getting quotas for user f0fc1955b0d446458f8f355550de971b and project 7f2ae6f05c2843469190cd96f39ac794. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:19:33.928829 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-6005084a-cbc9-4ee8-b5d4-e504e7518abc tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Going to run 1 instances... {{(pid=129366) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 21:19:33.932312 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-6005084a-cbc9-4ee8-b5d4-e504e7518abc tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: 86b8c510-27f4-4f20-ad7f-fe8df0ed4869] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='773cf368-b8b6-44db-9909-9b312ca3b6bc',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=129366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 21:19:34.021330 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-6005084a-cbc9-4ee8-b5d4-e504e7518abc tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.728096 Jan 15 21:19:34.022682 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3414/6818] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 21:19:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 731 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 15 21:19:34.033979 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-7b26953b-6e5f-4f3f-a082-b17eb71686be tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:19:34.034995 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-7b26953b-6e5f-4f3f-a082-b17eb71686be tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: 86b8c510-27f4-4f20-ad7f-fe8df0ed4869] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:19:34.104816 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-7b26953b-6e5f-4f3f-a082-b17eb71686be tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fc1955b0d446458f8f355550de971b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ae6f05c2843469190cd96f39ac794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:19:34.113144 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-7b26953b-6e5f-4f3f-a082-b17eb71686be tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] 10.222.0.46 "GET /compute/v2.1/servers/86b8c510-27f4-4f20-ad7f-fe8df0ed4869" status: 200 len: 1229 microversion: 2.1 time: 0.084313 Jan 15 21:19:34.123841 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3405/6819] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:19:34 2022] GET /compute/v2.1/servers/86b8c510-27f4-4f20-ad7f-fe8df0ed4869 => generated 1229 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:19:35.134760 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1fb8d8ba-55a2-48b8-88a5-0dbb16b01b62 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:19:35.136680 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-1fb8d8ba-55a2-48b8-88a5-0dbb16b01b62 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: 86b8c510-27f4-4f20-ad7f-fe8df0ed4869] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:19:35.145444 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1fb8d8ba-55a2-48b8-88a5-0dbb16b01b62 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:35.146004 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1fb8d8ba-55a2-48b8-88a5-0dbb16b01b62 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:35.147404 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1fb8d8ba-55a2-48b8-88a5-0dbb16b01b62 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:35.147917 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1fb8d8ba-55a2-48b8-88a5-0dbb16b01b62 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:35.262332 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-1fb8d8ba-55a2-48b8-88a5-0dbb16b01b62 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fc1955b0d446458f8f355550de971b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ae6f05c2843469190cd96f39ac794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:19:35.274352 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-1fb8d8ba-55a2-48b8-88a5-0dbb16b01b62 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] 10.222.0.46 "GET /compute/v2.1/servers/86b8c510-27f4-4f20-ad7f-fe8df0ed4869" status: 200 len: 1299 microversion: 2.1 time: 0.147305 Jan 15 21:19:35.284215 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3415/6820] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:19:35 2022] GET /compute/v2.1/servers/86b8c510-27f4-4f20-ad7f-fe8df0ed4869 => generated 1299 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:19:36.301239 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e37a3ea9-bdaa-48f5-b548-e6e628cdcd40 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:19:36.302010 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e37a3ea9-bdaa-48f5-b548-e6e628cdcd40 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: 86b8c510-27f4-4f20-ad7f-fe8df0ed4869] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:19:36.322833 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e37a3ea9-bdaa-48f5-b548-e6e628cdcd40 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:36.323492 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e37a3ea9-bdaa-48f5-b548-e6e628cdcd40 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:36.324358 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e37a3ea9-bdaa-48f5-b548-e6e628cdcd40 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:36.324892 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e37a3ea9-bdaa-48f5-b548-e6e628cdcd40 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:36.583139 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-e37a3ea9-bdaa-48f5-b548-e6e628cdcd40 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fc1955b0d446458f8f355550de971b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ae6f05c2843469190cd96f39ac794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:19:36.592583 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e37a3ea9-bdaa-48f5-b548-e6e628cdcd40 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] 10.222.0.46 "GET /compute/v2.1/servers/86b8c510-27f4-4f20-ad7f-fe8df0ed4869" status: 200 len: 1341 microversion: 2.1 time: 0.304372 Jan 15 21:19:36.593533 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3406/6821] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:19:36 2022] GET /compute/v2.1/servers/86b8c510-27f4-4f20-ad7f-fe8df0ed4869 => generated 1341 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:19:37.139549 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-a3ab8aec-75ce-4c96-bd22-a51f719138f2 req-3e180345-69b9-4a05-8c59-1740e636ed47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86b8c510-27f4-4f20-ad7f-fe8df0ed4869", "tag": "faece3cd-f6e8-4e1d-9a77-625a7d4e63e1"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:19:37.148751 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:19:37.148751 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:19:37.166894 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-a3ab8aec-75ce-4c96-bd22-a51f719138f2 req-3e180345-69b9-4a05-8c59-1740e636ed47 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:37.171031 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-a3ab8aec-75ce-4c96-bd22-a51f719138f2 req-3e180345-69b9-4a05-8c59-1740e636ed47 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:37.193064 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-a3ab8aec-75ce-4c96-bd22-a51f719138f2 req-3e180345-69b9-4a05-8c59-1740e636ed47 service nova] Creating event network-changed:faece3cd-f6e8-4e1d-9a77-625a7d4e63e1 for instance 86b8c510-27f4-4f20-ad7f-fe8df0ed4869 on nch1-master-1 Jan 15 21:19:37.200276 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-a3ab8aec-75ce-4c96-bd22-a51f719138f2 req-3e180345-69b9-4a05-8c59-1740e636ed47 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064514 Jan 15 21:19:37.201567 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3416/6822] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:19:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:19:37.611493 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d7d0ae35-218f-4891-b1de-95ac3c6c413c tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:19:37.612060 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d7d0ae35-218f-4891-b1de-95ac3c6c413c tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: 86b8c510-27f4-4f20-ad7f-fe8df0ed4869] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:19:37.622366 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d7d0ae35-218f-4891-b1de-95ac3c6c413c tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:37.622843 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d7d0ae35-218f-4891-b1de-95ac3c6c413c tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:37.623655 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d7d0ae35-218f-4891-b1de-95ac3c6c413c tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:37.624108 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d7d0ae35-218f-4891-b1de-95ac3c6c413c tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:37.794550 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-d7d0ae35-218f-4891-b1de-95ac3c6c413c tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fc1955b0d446458f8f355550de971b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ae6f05c2843469190cd96f39ac794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:19:37.811360 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d7d0ae35-218f-4891-b1de-95ac3c6c413c tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] 10.222.0.46 "GET /compute/v2.1/servers/86b8c510-27f4-4f20-ad7f-fe8df0ed4869" status: 200 len: 1341 microversion: 2.1 time: 0.204547 Jan 15 21:19:37.812071 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3407/6823] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:19:37 2022] GET /compute/v2.1/servers/86b8c510-27f4-4f20-ad7f-fe8df0ed4869 => generated 1341 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:19:37.821417 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-700712ac-3d49-4e8a-b2ee-6798735fd064 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-79166302", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "networks": [{"uuid": "93892b34-ebb2-470c-b3e3-a2f8019bba50"}]}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:19:37.878811 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.network.neutron [None req-700712ac-3d49-4e8a-b2ee-6798735fd064 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] validate_networks() for [('93892b34-ebb2-470c-b3e3-a2f8019bba50', None, None, None, None, None)] {{(pid=129366) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 21:19:38.327161 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-700712ac-3d49-4e8a-b2ee-6798735fd064 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Flavor limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 21:19:38.327709 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-700712ac-3d49-4e8a-b2ee-6798735fd064 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Image limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 21:19:38.328040 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-700712ac-3d49-4e8a-b2ee-6798735fd064 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Flavor pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 21:19:38.328446 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-700712ac-3d49-4e8a-b2ee-6798735fd064 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Image pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 21:19:38.328885 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-700712ac-3d49-4e8a-b2ee-6798735fd064 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 21:19:38.345961 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-700712ac-3d49-4e8a-b2ee-6798735fd064 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:38.346561 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-700712ac-3d49-4e8a-b2ee-6798735fd064 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:38.347994 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-700712ac-3d49-4e8a-b2ee-6798735fd064 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:38.348939 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-700712ac-3d49-4e8a-b2ee-6798735fd064 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:38.373572 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-700712ac-3d49-4e8a-b2ee-6798735fd064 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Getting quotas for project 7e9a0df7dedb47ca920ad4d833dfcc41. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:19:38.381016 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-700712ac-3d49-4e8a-b2ee-6798735fd064 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Getting quotas for user d99322a1d0c54f2cb6021ae4cf37a447 and project 7e9a0df7dedb47ca920ad4d833dfcc41. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:19:38.396084 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-700712ac-3d49-4e8a-b2ee-6798735fd064 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Going to run 1 instances... {{(pid=129366) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 21:19:38.398864 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-700712ac-3d49-4e8a-b2ee-6798735fd064 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] [instance: 67f7add7-918d-4aee-9015-7bf2830ca59b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 21:19:38.449697 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-700712ac-3d49-4e8a-b2ee-6798735fd064 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.801269 Jan 15 21:19:38.455595 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3417/6824] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 21:19:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 803 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 15 21:19:38.464906 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2f208468-5d4b-454d-8602-75f843eecb71 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:19:38.464906 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-2f208468-5d4b-454d-8602-75f843eecb71 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] [instance: 67f7add7-918d-4aee-9015-7bf2830ca59b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:19:38.523510 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-2f208468-5d4b-454d-8602-75f843eecb71 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd99322a1d0c54f2cb6021ae4cf37a447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9a0df7dedb47ca920ad4d833dfcc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:19:38.531332 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2f208468-5d4b-454d-8602-75f843eecb71 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] 10.222.0.46 "GET /compute/v2.1/servers/67f7add7-918d-4aee-9015-7bf2830ca59b" status: 200 len: 1213 microversion: 2.1 time: 0.074013 Jan 15 21:19:38.532148 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3408/6825] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:19:38 2022] GET /compute/v2.1/servers/67f7add7-918d-4aee-9015-7bf2830ca59b => generated 1213 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:19:38.828241 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-6a0714c7-f758-48bf-8f91-a0a4b52bf8d3 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:19:38.829575 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-6a0714c7-f758-48bf-8f91-a0a4b52bf8d3 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: 86b8c510-27f4-4f20-ad7f-fe8df0ed4869] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:19:38.840229 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6a0714c7-f758-48bf-8f91-a0a4b52bf8d3 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:38.845420 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6a0714c7-f758-48bf-8f91-a0a4b52bf8d3 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:38.847067 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6a0714c7-f758-48bf-8f91-a0a4b52bf8d3 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:38.848010 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6a0714c7-f758-48bf-8f91-a0a4b52bf8d3 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:39.051599 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-6a0714c7-f758-48bf-8f91-a0a4b52bf8d3 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fc1955b0d446458f8f355550de971b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ae6f05c2843469190cd96f39ac794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:19:39.059188 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-6a0714c7-f758-48bf-8f91-a0a4b52bf8d3 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] 10.222.0.46 "GET /compute/v2.1/servers/86b8c510-27f4-4f20-ad7f-fe8df0ed4869" status: 200 len: 1341 microversion: 2.1 time: 0.234776 Jan 15 21:19:39.060884 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3418/6826] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:19:38 2022] GET /compute/v2.1/servers/86b8c510-27f4-4f20-ad7f-fe8df0ed4869 => generated 1341 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:19:39.553931 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-7feb626e-bff9-44d6-a097-95bc7ee7d8e4 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:19:39.555208 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-7feb626e-bff9-44d6-a097-95bc7ee7d8e4 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] [instance: 67f7add7-918d-4aee-9015-7bf2830ca59b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:19:39.567797 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7feb626e-bff9-44d6-a097-95bc7ee7d8e4 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:39.570941 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7feb626e-bff9-44d6-a097-95bc7ee7d8e4 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:39.576897 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7feb626e-bff9-44d6-a097-95bc7ee7d8e4 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:39.577656 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7feb626e-bff9-44d6-a097-95bc7ee7d8e4 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:39.743947 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-7feb626e-bff9-44d6-a097-95bc7ee7d8e4 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd99322a1d0c54f2cb6021ae4cf37a447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9a0df7dedb47ca920ad4d833dfcc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:19:39.752992 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-7feb626e-bff9-44d6-a097-95bc7ee7d8e4 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] 10.222.0.46 "GET /compute/v2.1/servers/67f7add7-918d-4aee-9015-7bf2830ca59b" status: 200 len: 1273 microversion: 2.1 time: 0.207146 Jan 15 21:19:39.753905 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3409/6827] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:19:39 2022] GET /compute/v2.1/servers/67f7add7-918d-4aee-9015-7bf2830ca59b => generated 1273 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:19:40.085197 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b08f4fc2-1ac3-40f2-97d1-261db1b13bc6 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:19:40.086632 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b08f4fc2-1ac3-40f2-97d1-261db1b13bc6 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: 86b8c510-27f4-4f20-ad7f-fe8df0ed4869] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:19:40.101451 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b08f4fc2-1ac3-40f2-97d1-261db1b13bc6 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:40.103016 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b08f4fc2-1ac3-40f2-97d1-261db1b13bc6 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:40.104206 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b08f4fc2-1ac3-40f2-97d1-261db1b13bc6 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:40.104669 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b08f4fc2-1ac3-40f2-97d1-261db1b13bc6 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:40.338632 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-b08f4fc2-1ac3-40f2-97d1-261db1b13bc6 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fc1955b0d446458f8f355550de971b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ae6f05c2843469190cd96f39ac794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:19:40.348367 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b08f4fc2-1ac3-40f2-97d1-261db1b13bc6 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] 10.222.0.46 "GET /compute/v2.1/servers/86b8c510-27f4-4f20-ad7f-fe8df0ed4869" status: 200 len: 1387 microversion: 2.1 time: 0.269517 Jan 15 21:19:40.360990 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3419/6828] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:19:40 2022] GET /compute/v2.1/servers/86b8c510-27f4-4f20-ad7f-fe8df0ed4869 => generated 1387 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:19:40.772144 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a5eef891-8ab5-4c98-b7b4-bd1a337d5392 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:19:40.772625 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a5eef891-8ab5-4c98-b7b4-bd1a337d5392 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] [instance: 67f7add7-918d-4aee-9015-7bf2830ca59b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:19:40.782265 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a5eef891-8ab5-4c98-b7b4-bd1a337d5392 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:40.782715 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a5eef891-8ab5-4c98-b7b4-bd1a337d5392 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:40.783519 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a5eef891-8ab5-4c98-b7b4-bd1a337d5392 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:40.783966 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a5eef891-8ab5-4c98-b7b4-bd1a337d5392 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:40.940341 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-a5eef891-8ab5-4c98-b7b4-bd1a337d5392 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd99322a1d0c54f2cb6021ae4cf37a447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9a0df7dedb47ca920ad4d833dfcc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:19:40.949783 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a5eef891-8ab5-4c98-b7b4-bd1a337d5392 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] 10.222.0.46 "GET /compute/v2.1/servers/67f7add7-918d-4aee-9015-7bf2830ca59b" status: 200 len: 1313 microversion: 2.1 time: 0.182577 Jan 15 21:19:40.950548 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3410/6829] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:19:40 2022] GET /compute/v2.1/servers/67f7add7-918d-4aee-9015-7bf2830ca59b => generated 1313 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:19:41.292462 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-6d5bf6d3-dbf3-4e20-bcf3-f6905eb4db47 req-35bd0b8e-7dce-435f-b600-37fbfc9e2aab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67f7add7-918d-4aee-9015-7bf2830ca59b", "tag": "ff4b38f7-41bd-4dcc-9838-e09499d0b96a"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:19:41.294590 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:19:41.294590 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:19:41.312150 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-6d5bf6d3-dbf3-4e20-bcf3-f6905eb4db47 req-35bd0b8e-7dce-435f-b600-37fbfc9e2aab service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:41.312915 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-6d5bf6d3-dbf3-4e20-bcf3-f6905eb4db47 req-35bd0b8e-7dce-435f-b600-37fbfc9e2aab service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:41.337044 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-6d5bf6d3-dbf3-4e20-bcf3-f6905eb4db47 req-35bd0b8e-7dce-435f-b600-37fbfc9e2aab service nova] Creating event network-changed:ff4b38f7-41bd-4dcc-9838-e09499d0b96a for instance 67f7add7-918d-4aee-9015-7bf2830ca59b on nch2-master-1 Jan 15 21:19:41.360600 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-6d5bf6d3-dbf3-4e20-bcf3-f6905eb4db47 req-35bd0b8e-7dce-435f-b600-37fbfc9e2aab service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071754 Jan 15 21:19:41.367898 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3420/6830] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:19:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:19:41.373818 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9217e363-f4eb-4383-ab4b-8f3f17b343f8 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:19:41.378480 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-9217e363-f4eb-4383-ab4b-8f3f17b343f8 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: 86b8c510-27f4-4f20-ad7f-fe8df0ed4869] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:19:41.385801 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9217e363-f4eb-4383-ab4b-8f3f17b343f8 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:41.386272 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9217e363-f4eb-4383-ab4b-8f3f17b343f8 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:41.387359 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9217e363-f4eb-4383-ab4b-8f3f17b343f8 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:41.387882 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9217e363-f4eb-4383-ab4b-8f3f17b343f8 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:41.609401 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-9217e363-f4eb-4383-ab4b-8f3f17b343f8 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fc1955b0d446458f8f355550de971b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ae6f05c2843469190cd96f39ac794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:19:41.618686 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-9217e363-f4eb-4383-ab4b-8f3f17b343f8 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] 10.222.0.46 "GET /compute/v2.1/servers/86b8c510-27f4-4f20-ad7f-fe8df0ed4869" status: 200 len: 1375 microversion: 2.1 time: 0.256434 Jan 15 21:19:41.621152 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3411/6831] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:19:41 2022] GET /compute/v2.1/servers/86b8c510-27f4-4f20-ad7f-fe8df0ed4869 => generated 1375 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:19:41.970756 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f604b553-5003-4518-b200-bc8796b5bf92 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:19:41.971755 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f604b553-5003-4518-b200-bc8796b5bf92 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] [instance: 67f7add7-918d-4aee-9015-7bf2830ca59b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:19:41.981267 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f604b553-5003-4518-b200-bc8796b5bf92 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:41.982058 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f604b553-5003-4518-b200-bc8796b5bf92 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:41.983600 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f604b553-5003-4518-b200-bc8796b5bf92 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:41.984409 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f604b553-5003-4518-b200-bc8796b5bf92 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:42.218042 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-f604b553-5003-4518-b200-bc8796b5bf92 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd99322a1d0c54f2cb6021ae4cf37a447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9a0df7dedb47ca920ad4d833dfcc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:19:42.228448 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f604b553-5003-4518-b200-bc8796b5bf92 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] 10.222.0.46 "GET /compute/v2.1/servers/67f7add7-918d-4aee-9015-7bf2830ca59b" status: 200 len: 1313 microversion: 2.1 time: 0.264375 Jan 15 21:19:42.229661 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3421/6832] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:19:41 2022] GET /compute/v2.1/servers/67f7add7-918d-4aee-9015-7bf2830ca59b => generated 1313 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:19:42.637073 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-864e1f65-5e9a-442b-8530-5b14b53097ce tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:19:42.637622 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-864e1f65-5e9a-442b-8530-5b14b53097ce tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: 86b8c510-27f4-4f20-ad7f-fe8df0ed4869] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:19:42.644526 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-864e1f65-5e9a-442b-8530-5b14b53097ce tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:42.645044 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-864e1f65-5e9a-442b-8530-5b14b53097ce tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:42.645844 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-864e1f65-5e9a-442b-8530-5b14b53097ce tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:42.646332 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-864e1f65-5e9a-442b-8530-5b14b53097ce tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:42.779338 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-864e1f65-5e9a-442b-8530-5b14b53097ce tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fc1955b0d446458f8f355550de971b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ae6f05c2843469190cd96f39ac794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:19:42.787753 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-864e1f65-5e9a-442b-8530-5b14b53097ce tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] 10.222.0.46 "GET /compute/v2.1/servers/86b8c510-27f4-4f20-ad7f-fe8df0ed4869" status: 200 len: 1375 microversion: 2.1 time: 0.153807 Jan 15 21:19:42.788331 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3412/6833] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:19:42 2022] GET /compute/v2.1/servers/86b8c510-27f4-4f20-ad7f-fe8df0ed4869 => generated 1375 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:19:43.244978 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e9cae205-ca5b-40a6-b32e-ef62b6b329b1 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:19:43.245585 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e9cae205-ca5b-40a6-b32e-ef62b6b329b1 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] [instance: 67f7add7-918d-4aee-9015-7bf2830ca59b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:19:43.252241 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e9cae205-ca5b-40a6-b32e-ef62b6b329b1 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:43.252686 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e9cae205-ca5b-40a6-b32e-ef62b6b329b1 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:43.253490 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e9cae205-ca5b-40a6-b32e-ef62b6b329b1 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:43.253921 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e9cae205-ca5b-40a6-b32e-ef62b6b329b1 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:43.401958 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-e9cae205-ca5b-40a6-b32e-ef62b6b329b1 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd99322a1d0c54f2cb6021ae4cf37a447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9a0df7dedb47ca920ad4d833dfcc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:19:43.409978 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e9cae205-ca5b-40a6-b32e-ef62b6b329b1 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] 10.222.0.46 "GET /compute/v2.1/servers/67f7add7-918d-4aee-9015-7bf2830ca59b" status: 200 len: 1313 microversion: 2.1 time: 0.168289 Jan 15 21:19:43.410547 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3422/6834] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:19:43 2022] GET /compute/v2.1/servers/67f7add7-918d-4aee-9015-7bf2830ca59b => generated 1313 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:19:43.805409 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-af659eda-aa6c-4137-a14a-b6da37aa8229 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:19:43.805976 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-af659eda-aa6c-4137-a14a-b6da37aa8229 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: 86b8c510-27f4-4f20-ad7f-fe8df0ed4869] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:19:43.812867 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-af659eda-aa6c-4137-a14a-b6da37aa8229 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:43.813350 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-af659eda-aa6c-4137-a14a-b6da37aa8229 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:43.814152 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-af659eda-aa6c-4137-a14a-b6da37aa8229 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:43.814595 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-af659eda-aa6c-4137-a14a-b6da37aa8229 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:43.970261 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-af659eda-aa6c-4137-a14a-b6da37aa8229 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fc1955b0d446458f8f355550de971b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ae6f05c2843469190cd96f39ac794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:19:43.978595 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-af659eda-aa6c-4137-a14a-b6da37aa8229 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] 10.222.0.46 "GET /compute/v2.1/servers/86b8c510-27f4-4f20-ad7f-fe8df0ed4869" status: 200 len: 1375 microversion: 2.1 time: 0.177856 Jan 15 21:19:43.979182 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3413/6835] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:19:43 2022] GET /compute/v2.1/servers/86b8c510-27f4-4f20-ad7f-fe8df0ed4869 => generated 1375 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:19:44.427310 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-22736a23-0fe3-4364-8571-3d7c08bf8cb1 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:19:44.427937 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-22736a23-0fe3-4364-8571-3d7c08bf8cb1 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] [instance: 67f7add7-918d-4aee-9015-7bf2830ca59b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:19:44.434472 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-22736a23-0fe3-4364-8571-3d7c08bf8cb1 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:44.434917 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-22736a23-0fe3-4364-8571-3d7c08bf8cb1 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:44.435687 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-22736a23-0fe3-4364-8571-3d7c08bf8cb1 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:44.436117 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-22736a23-0fe3-4364-8571-3d7c08bf8cb1 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:44.569319 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-22736a23-0fe3-4364-8571-3d7c08bf8cb1 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd99322a1d0c54f2cb6021ae4cf37a447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9a0df7dedb47ca920ad4d833dfcc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:19:44.576550 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-22736a23-0fe3-4364-8571-3d7c08bf8cb1 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] 10.222.0.46 "GET /compute/v2.1/servers/67f7add7-918d-4aee-9015-7bf2830ca59b" status: 200 len: 1313 microversion: 2.1 time: 0.153009 Jan 15 21:19:44.577158 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3423/6836] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:19:44 2022] GET /compute/v2.1/servers/67f7add7-918d-4aee-9015-7bf2830ca59b => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:19:44.995719 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-914de7a6-54a2-4048-a6cc-0e9c8a666dd2 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:19:44.996344 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-914de7a6-54a2-4048-a6cc-0e9c8a666dd2 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: 86b8c510-27f4-4f20-ad7f-fe8df0ed4869] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:19:45.003109 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-914de7a6-54a2-4048-a6cc-0e9c8a666dd2 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:45.003571 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-914de7a6-54a2-4048-a6cc-0e9c8a666dd2 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:45.004363 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-914de7a6-54a2-4048-a6cc-0e9c8a666dd2 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:45.004814 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-914de7a6-54a2-4048-a6cc-0e9c8a666dd2 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:45.151444 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-914de7a6-54a2-4048-a6cc-0e9c8a666dd2 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fc1955b0d446458f8f355550de971b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ae6f05c2843469190cd96f39ac794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:19:45.163188 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-914de7a6-54a2-4048-a6cc-0e9c8a666dd2 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] 10.222.0.46 "GET /compute/v2.1/servers/86b8c510-27f4-4f20-ad7f-fe8df0ed4869" status: 200 len: 1375 microversion: 2.1 time: 0.170943 Jan 15 21:19:45.163962 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3414/6837] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:19:44 2022] GET /compute/v2.1/servers/86b8c510-27f4-4f20-ad7f-fe8df0ed4869 => generated 1375 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:19:45.593467 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a9636ce2-7559-4463-bb9a-876dfef1d86c tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:19:45.594199 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a9636ce2-7559-4463-bb9a-876dfef1d86c tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] [instance: 67f7add7-918d-4aee-9015-7bf2830ca59b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:19:45.603180 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a9636ce2-7559-4463-bb9a-876dfef1d86c tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:45.603813 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a9636ce2-7559-4463-bb9a-876dfef1d86c tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:45.604942 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a9636ce2-7559-4463-bb9a-876dfef1d86c tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:45.605616 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a9636ce2-7559-4463-bb9a-876dfef1d86c tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:45.764926 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-a9636ce2-7559-4463-bb9a-876dfef1d86c tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd99322a1d0c54f2cb6021ae4cf37a447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9a0df7dedb47ca920ad4d833dfcc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:19:45.773675 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a9636ce2-7559-4463-bb9a-876dfef1d86c tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] 10.222.0.46 "GET /compute/v2.1/servers/67f7add7-918d-4aee-9015-7bf2830ca59b" status: 200 len: 1313 microversion: 2.1 time: 0.183868 Jan 15 21:19:45.774255 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3424/6838] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:19:45 2022] GET /compute/v2.1/servers/67f7add7-918d-4aee-9015-7bf2830ca59b => generated 1313 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:19:45.945101 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-8dcc5a6c-c50a-46ac-86fd-f615683f52e1 req-d6038dcc-f293-4b57-b1df-ca985c2a5666 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86b8c510-27f4-4f20-ad7f-fe8df0ed4869", "name": "network-vif-plugged", "status": "completed", "tag": "faece3cd-f6e8-4e1d-9a77-625a7d4e63e1"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:19:45.946853 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:19:45.946853 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:19:45.955018 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-8dcc5a6c-c50a-46ac-86fd-f615683f52e1 req-d6038dcc-f293-4b57-b1df-ca985c2a5666 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:45.955429 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-8dcc5a6c-c50a-46ac-86fd-f615683f52e1 req-d6038dcc-f293-4b57-b1df-ca985c2a5666 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:45.969970 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-8dcc5a6c-c50a-46ac-86fd-f615683f52e1 req-d6038dcc-f293-4b57-b1df-ca985c2a5666 service nova] Creating event network-vif-plugged:faece3cd-f6e8-4e1d-9a77-625a7d4e63e1 for instance 86b8c510-27f4-4f20-ad7f-fe8df0ed4869 on nch1-master-1 Jan 15 21:19:45.975242 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-8dcc5a6c-c50a-46ac-86fd-f615683f52e1 req-d6038dcc-f293-4b57-b1df-ca985c2a5666 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034596 Jan 15 21:19:45.975851 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3415/6839] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:19:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:19:46.179483 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-298f10c3-18dc-4211-ba14-f650f07cf24b tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:19:46.180099 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-298f10c3-18dc-4211-ba14-f650f07cf24b tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: 86b8c510-27f4-4f20-ad7f-fe8df0ed4869] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:19:46.186130 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-298f10c3-18dc-4211-ba14-f650f07cf24b tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:46.186572 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-298f10c3-18dc-4211-ba14-f650f07cf24b tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:46.187349 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-298f10c3-18dc-4211-ba14-f650f07cf24b tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:46.187781 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-298f10c3-18dc-4211-ba14-f650f07cf24b tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:46.328236 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-298f10c3-18dc-4211-ba14-f650f07cf24b tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fc1955b0d446458f8f355550de971b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ae6f05c2843469190cd96f39ac794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:19:46.336399 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-298f10c3-18dc-4211-ba14-f650f07cf24b tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] 10.222.0.46 "GET /compute/v2.1/servers/86b8c510-27f4-4f20-ad7f-fe8df0ed4869" status: 200 len: 1375 microversion: 2.1 time: 0.160771 Jan 15 21:19:46.337014 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3425/6840] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:19:46 2022] GET /compute/v2.1/servers/86b8c510-27f4-4f20-ad7f-fe8df0ed4869 => generated 1375 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:19:46.792057 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8c5d3a75-81dd-437c-9561-2ccc430b2142 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:19:46.792775 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-8c5d3a75-81dd-437c-9561-2ccc430b2142 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] [instance: 67f7add7-918d-4aee-9015-7bf2830ca59b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:19:46.799049 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8c5d3a75-81dd-437c-9561-2ccc430b2142 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:46.799522 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8c5d3a75-81dd-437c-9561-2ccc430b2142 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:46.800313 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8c5d3a75-81dd-437c-9561-2ccc430b2142 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:46.800770 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8c5d3a75-81dd-437c-9561-2ccc430b2142 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:46.950391 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-8c5d3a75-81dd-437c-9561-2ccc430b2142 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd99322a1d0c54f2cb6021ae4cf37a447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9a0df7dedb47ca920ad4d833dfcc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:19:46.953204 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-8c5d3a75-81dd-437c-9561-2ccc430b2142 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] 10.222.0.46 "GET /compute/v2.1/servers/67f7add7-918d-4aee-9015-7bf2830ca59b" status: 200 len: 1313 microversion: 2.1 time: 0.165933 Jan 15 21:19:46.953770 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3416/6841] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:19:46 2022] GET /compute/v2.1/servers/67f7add7-918d-4aee-9015-7bf2830ca59b => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:19:47.354500 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-3f29e0cf-3690-4d61-9287-cccf26eda2f8 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:19:47.355118 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-3f29e0cf-3690-4d61-9287-cccf26eda2f8 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: 86b8c510-27f4-4f20-ad7f-fe8df0ed4869] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:19:47.366178 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3f29e0cf-3690-4d61-9287-cccf26eda2f8 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:47.366971 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3f29e0cf-3690-4d61-9287-cccf26eda2f8 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:47.368046 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3f29e0cf-3690-4d61-9287-cccf26eda2f8 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:47.368716 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3f29e0cf-3690-4d61-9287-cccf26eda2f8 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:47.519931 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-3f29e0cf-3690-4d61-9287-cccf26eda2f8 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fc1955b0d446458f8f355550de971b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ae6f05c2843469190cd96f39ac794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:19:47.528011 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-3f29e0cf-3690-4d61-9287-cccf26eda2f8 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] 10.222.0.46 "GET /compute/v2.1/servers/86b8c510-27f4-4f20-ad7f-fe8df0ed4869" status: 200 len: 1563 microversion: 2.1 time: 0.177466 Jan 15 21:19:47.528698 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3426/6842] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:19:47 2022] GET /compute/v2.1/servers/86b8c510-27f4-4f20-ad7f-fe8df0ed4869 => generated 1563 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:19:47.544795 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3625531c-8834-4106-8dbf-83916ec60870 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:19:47.545442 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-3625531c-8834-4106-8dbf-83916ec60870 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: 86b8c510-27f4-4f20-ad7f-fe8df0ed4869] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:19:47.551627 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3625531c-8834-4106-8dbf-83916ec60870 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:47.552038 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3625531c-8834-4106-8dbf-83916ec60870 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:47.553752 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3625531c-8834-4106-8dbf-83916ec60870 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:47.554209 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3625531c-8834-4106-8dbf-83916ec60870 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:47.694229 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-3625531c-8834-4106-8dbf-83916ec60870 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fc1955b0d446458f8f355550de971b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ae6f05c2843469190cd96f39ac794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:19:47.701643 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3625531c-8834-4106-8dbf-83916ec60870 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] 10.222.0.46 "GET /compute/v2.1/servers/86b8c510-27f4-4f20-ad7f-fe8df0ed4869" status: 200 len: 1563 microversion: 2.1 time: 0.160546 Jan 15 21:19:47.702232 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3417/6843] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:19:47 2022] GET /compute/v2.1/servers/86b8c510-27f4-4f20-ad7f-fe8df0ed4869 => generated 1563 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:19:47.770019 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f46b9061-f5bb-4d0c-a41f-1c7ca48f1069 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:19:47.770517 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f46b9061-f5bb-4d0c-a41f-1c7ca48f1069 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: 86b8c510-27f4-4f20-ad7f-fe8df0ed4869] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:19:47.778729 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f46b9061-f5bb-4d0c-a41f-1c7ca48f1069 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:47.779187 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f46b9061-f5bb-4d0c-a41f-1c7ca48f1069 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:47.779980 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f46b9061-f5bb-4d0c-a41f-1c7ca48f1069 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:47.781117 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f46b9061-f5bb-4d0c-a41f-1c7ca48f1069 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:47.811545 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f46b9061-f5bb-4d0c-a41f-1c7ca48f1069 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: 86b8c510-27f4-4f20-ad7f-fe8df0ed4869] Going to try to terminate instance {{(pid=129366) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 21:19:47.891110 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f46b9061-f5bb-4d0c-a41f-1c7ca48f1069 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] 10.222.0.46 "DELETE /compute/v2.1/servers/86b8c510-27f4-4f20-ad7f-fe8df0ed4869" status: 204 len: 0 microversion: 2.1 time: 0.124665 Jan 15 21:19:47.894979 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3427/6844] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 21:19:47 2022] DELETE /compute/v2.1/servers/86b8c510-27f4-4f20-ad7f-fe8df0ed4869 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 21:19:47.901038 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-63e7bbe7-1cb6-4cae-966b-f70534996ed2 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:19:47.901763 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-63e7bbe7-1cb6-4cae-966b-f70534996ed2 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: 86b8c510-27f4-4f20-ad7f-fe8df0ed4869] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:19:47.908648 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-63e7bbe7-1cb6-4cae-966b-f70534996ed2 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:47.909522 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-63e7bbe7-1cb6-4cae-966b-f70534996ed2 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:47.910384 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-63e7bbe7-1cb6-4cae-966b-f70534996ed2 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:47.910835 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-63e7bbe7-1cb6-4cae-966b-f70534996ed2 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:47.970827 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e76b3963-d0ff-4f63-8c72-62a970c990bf tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:19:47.971548 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e76b3963-d0ff-4f63-8c72-62a970c990bf tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] [instance: 67f7add7-918d-4aee-9015-7bf2830ca59b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:19:47.978690 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e76b3963-d0ff-4f63-8c72-62a970c990bf tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:47.979363 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e76b3963-d0ff-4f63-8c72-62a970c990bf tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:47.980481 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e76b3963-d0ff-4f63-8c72-62a970c990bf tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:47.980867 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e76b3963-d0ff-4f63-8c72-62a970c990bf tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:48.086533 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-63e7bbe7-1cb6-4cae-966b-f70534996ed2 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fc1955b0d446458f8f355550de971b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ae6f05c2843469190cd96f39ac794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:19:48.096738 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-63e7bbe7-1cb6-4cae-966b-f70534996ed2 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] 10.222.0.46 "GET /compute/v2.1/servers/86b8c510-27f4-4f20-ad7f-fe8df0ed4869" status: 200 len: 1569 microversion: 2.1 time: 0.199929 Jan 15 21:19:48.098121 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3418/6845] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:19:47 2022] GET /compute/v2.1/servers/86b8c510-27f4-4f20-ad7f-fe8df0ed4869 => generated 1569 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:19:48.102931 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-2e46a25d-2adb-4d26-a353-f6ba7f4afffc req-58662643-d9a4-41b6-8727-6f0f975bccbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67f7add7-918d-4aee-9015-7bf2830ca59b", "name": "network-vif-plugged", "status": "completed", "tag": "ff4b38f7-41bd-4dcc-9838-e09499d0b96a"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:19:48.104782 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:19:48.104782 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:19:48.112151 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-2e46a25d-2adb-4d26-a353-f6ba7f4afffc req-58662643-d9a4-41b6-8727-6f0f975bccbb service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:48.112976 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-2e46a25d-2adb-4d26-a353-f6ba7f4afffc req-58662643-d9a4-41b6-8727-6f0f975bccbb service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:48.125164 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-2e46a25d-2adb-4d26-a353-f6ba7f4afffc req-58662643-d9a4-41b6-8727-6f0f975bccbb service nova] Creating event network-vif-plugged:ff4b38f7-41bd-4dcc-9838-e09499d0b96a for instance 67f7add7-918d-4aee-9015-7bf2830ca59b on nch2-master-1 Jan 15 21:19:48.134080 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-2e46a25d-2adb-4d26-a353-f6ba7f4afffc req-58662643-d9a4-41b6-8727-6f0f975bccbb service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034512 Jan 15 21:19:48.134975 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3419/6846] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:19:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:19:48.190088 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-e76b3963-d0ff-4f63-8c72-62a970c990bf tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd99322a1d0c54f2cb6021ae4cf37a447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9a0df7dedb47ca920ad4d833dfcc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:19:48.199327 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e76b3963-d0ff-4f63-8c72-62a970c990bf tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] 10.222.0.46 "GET /compute/v2.1/servers/67f7add7-918d-4aee-9015-7bf2830ca59b" status: 200 len: 1313 microversion: 2.1 time: 0.232511 Jan 15 21:19:48.200230 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3428/6847] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:19:47 2022] GET /compute/v2.1/servers/67f7add7-918d-4aee-9015-7bf2830ca59b => generated 1313 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:19:49.117786 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ee99d834-d1fc-49fc-bfc8-7eb94fbdbce2 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:19:49.118493 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ee99d834-d1fc-49fc-bfc8-7eb94fbdbce2 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: 86b8c510-27f4-4f20-ad7f-fe8df0ed4869] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:19:49.124924 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ee99d834-d1fc-49fc-bfc8-7eb94fbdbce2 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:49.125349 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ee99d834-d1fc-49fc-bfc8-7eb94fbdbce2 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:49.126137 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ee99d834-d1fc-49fc-bfc8-7eb94fbdbce2 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:49.126587 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ee99d834-d1fc-49fc-bfc8-7eb94fbdbce2 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:49.217752 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-efec2316-7731-4ac4-8ef2-20ba066cb139 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:19:49.218357 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-efec2316-7731-4ac4-8ef2-20ba066cb139 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] [instance: 67f7add7-918d-4aee-9015-7bf2830ca59b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:19:49.226457 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-efec2316-7731-4ac4-8ef2-20ba066cb139 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:49.226974 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-efec2316-7731-4ac4-8ef2-20ba066cb139 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:49.227787 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-efec2316-7731-4ac4-8ef2-20ba066cb139 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:49.228454 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-efec2316-7731-4ac4-8ef2-20ba066cb139 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:49.282170 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-ee99d834-d1fc-49fc-bfc8-7eb94fbdbce2 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fc1955b0d446458f8f355550de971b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ae6f05c2843469190cd96f39ac794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:19:49.290233 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ee99d834-d1fc-49fc-bfc8-7eb94fbdbce2 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] 10.222.0.46 "GET /compute/v2.1/servers/86b8c510-27f4-4f20-ad7f-fe8df0ed4869" status: 200 len: 1569 microversion: 2.1 time: 0.178477 Jan 15 21:19:49.290820 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3420/6848] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:19:49 2022] GET /compute/v2.1/servers/86b8c510-27f4-4f20-ad7f-fe8df0ed4869 => generated 1569 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:19:49.378780 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-efec2316-7731-4ac4-8ef2-20ba066cb139 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd99322a1d0c54f2cb6021ae4cf37a447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9a0df7dedb47ca920ad4d833dfcc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:19:49.387663 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-efec2316-7731-4ac4-8ef2-20ba066cb139 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] 10.222.0.46 "GET /compute/v2.1/servers/67f7add7-918d-4aee-9015-7bf2830ca59b" status: 200 len: 1313 microversion: 2.1 time: 0.173774 Jan 15 21:19:49.388312 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3429/6849] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:19:49 2022] GET /compute/v2.1/servers/67f7add7-918d-4aee-9015-7bf2830ca59b => generated 1313 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:19:50.310390 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-072a66cd-242e-43d6-8bf3-4a6b891f7314 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:19:50.311813 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-072a66cd-242e-43d6-8bf3-4a6b891f7314 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: 86b8c510-27f4-4f20-ad7f-fe8df0ed4869] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:19:50.323465 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-072a66cd-242e-43d6-8bf3-4a6b891f7314 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:50.324434 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-072a66cd-242e-43d6-8bf3-4a6b891f7314 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:50.325828 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-072a66cd-242e-43d6-8bf3-4a6b891f7314 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:50.326292 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-072a66cd-242e-43d6-8bf3-4a6b891f7314 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:50.377850 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4f4f379b-169d-4407-af17-906b5f8a2a8e tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:19:50.378782 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-4f4f379b-169d-4407-af17-906b5f8a2a8e tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: ae51bd6b-96a9-42fa-ad05-234547d3f5d3] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:19:50.401030 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4f4f379b-169d-4407-af17-906b5f8a2a8e tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:50.401485 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4f4f379b-169d-4407-af17-906b5f8a2a8e tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:50.404220 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4f4f379b-169d-4407-af17-906b5f8a2a8e tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:50.410346 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4f4f379b-169d-4407-af17-906b5f8a2a8e tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:50.480492 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-072a66cd-242e-43d6-8bf3-4a6b891f7314 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fc1955b0d446458f8f355550de971b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ae6f05c2843469190cd96f39ac794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:19:50.488379 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-072a66cd-242e-43d6-8bf3-4a6b891f7314 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] 10.222.0.46 "GET /compute/v2.1/servers/86b8c510-27f4-4f20-ad7f-fe8df0ed4869" status: 200 len: 1527 microversion: 2.1 time: 0.183590 Jan 15 21:19:50.491175 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3421/6850] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:19:50 2022] GET /compute/v2.1/servers/86b8c510-27f4-4f20-ad7f-fe8df0ed4869 => generated 1527 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:19:50.495271 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-7829634a-05dd-4872-8e07-76d750c32dc6 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:19:50.502743 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-7829634a-05dd-4872-8e07-76d750c32dc6 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] [instance: 67f7add7-918d-4aee-9015-7bf2830ca59b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:19:50.509889 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-4f4f379b-169d-4407-af17-906b5f8a2a8e tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "POST /compute/v2.1/servers/ae51bd6b-96a9-42fa-ad05-234547d3f5d3/action" status: 200 len: 24571 microversion: 2.1 time: 0.135343 Jan 15 21:19:50.517245 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3430/6851] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:19:50 2022] POST /compute/v2.1/servers/ae51bd6b-96a9-42fa-ad05-234547d3f5d3/action => generated 24571 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:19:50.519590 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7829634a-05dd-4872-8e07-76d750c32dc6 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:50.520115 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7829634a-05dd-4872-8e07-76d750c32dc6 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:50.521021 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7829634a-05dd-4872-8e07-76d750c32dc6 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:50.521477 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7829634a-05dd-4872-8e07-76d750c32dc6 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:50.527435 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-f67c84a5-8f7a-48a4-a764-5be73d3997d1 req-97c7c445-e533-4216-9ad0-a0e9b2329179 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86b8c510-27f4-4f20-ad7f-fe8df0ed4869", "name": "network-vif-deleted", "tag": "faece3cd-f6e8-4e1d-9a77-625a7d4e63e1"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:19:50.532979 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:19:50.532979 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:19:50.577043 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-f67c84a5-8f7a-48a4-a764-5be73d3997d1 req-97c7c445-e533-4216-9ad0-a0e9b2329179 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:50.578353 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-f67c84a5-8f7a-48a4-a764-5be73d3997d1 req-97c7c445-e533-4216-9ad0-a0e9b2329179 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:50.602201 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-f67c84a5-8f7a-48a4-a764-5be73d3997d1 req-97c7c445-e533-4216-9ad0-a0e9b2329179 service nova] Creating event network-vif-deleted:faece3cd-f6e8-4e1d-9a77-625a7d4e63e1 for instance 86b8c510-27f4-4f20-ad7f-fe8df0ed4869 on nch1-master-1 Jan 15 21:19:50.609485 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-f67c84a5-8f7a-48a4-a764-5be73d3997d1 req-97c7c445-e533-4216-9ad0-a0e9b2329179 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090105 Jan 15 21:19:50.610402 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3431/6852] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:19:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:19:50.801090 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-7829634a-05dd-4872-8e07-76d750c32dc6 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd99322a1d0c54f2cb6021ae4cf37a447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9a0df7dedb47ca920ad4d833dfcc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:19:50.811355 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-7829634a-05dd-4872-8e07-76d750c32dc6 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] 10.222.0.46 "GET /compute/v2.1/servers/67f7add7-918d-4aee-9015-7bf2830ca59b" status: 200 len: 1500 microversion: 2.1 time: 0.319546 Jan 15 21:19:50.811999 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3422/6853] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:19:50 2022] GET /compute/v2.1/servers/67f7add7-918d-4aee-9015-7bf2830ca59b => generated 1500 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:19:50.833954 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f9a4c39e-c0bc-4a95-9345-e2ee10075500 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:19:50.834898 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f9a4c39e-c0bc-4a95-9345-e2ee10075500 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] [instance: 67f7add7-918d-4aee-9015-7bf2830ca59b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:19:50.847261 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f9a4c39e-c0bc-4a95-9345-e2ee10075500 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:50.847901 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f9a4c39e-c0bc-4a95-9345-e2ee10075500 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:50.850325 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f9a4c39e-c0bc-4a95-9345-e2ee10075500 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:50.850880 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f9a4c39e-c0bc-4a95-9345-e2ee10075500 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:50.995639 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-f9a4c39e-c0bc-4a95-9345-e2ee10075500 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd99322a1d0c54f2cb6021ae4cf37a447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9a0df7dedb47ca920ad4d833dfcc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:19:51.003998 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f9a4c39e-c0bc-4a95-9345-e2ee10075500 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] 10.222.0.46 "GET /compute/v2.1/servers/67f7add7-918d-4aee-9015-7bf2830ca59b" status: 200 len: 1500 microversion: 2.1 time: 0.178365 Jan 15 21:19:51.004786 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3432/6854] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:19:50 2022] GET /compute/v2.1/servers/67f7add7-918d-4aee-9015-7bf2830ca59b => generated 1500 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:19:51.022996 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e02814c4-fbf0-46f7-8f55-24e68716adfb tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:19:51.023664 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e02814c4-fbf0-46f7-8f55-24e68716adfb tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] [instance: 67f7add7-918d-4aee-9015-7bf2830ca59b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:19:51.030467 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e02814c4-fbf0-46f7-8f55-24e68716adfb tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:51.030981 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e02814c4-fbf0-46f7-8f55-24e68716adfb tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:51.031912 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e02814c4-fbf0-46f7-8f55-24e68716adfb tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:51.032466 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e02814c4-fbf0-46f7-8f55-24e68716adfb tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:51.058120 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.objects.instance [None req-e02814c4-fbf0-46f7-8f55-24e68716adfb tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lazy-loading 'flavor' on Instance uuid 67f7add7-918d-4aee-9015-7bf2830ca59b {{(pid=129365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 21:19:51.134899 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e02814c4-fbf0-46f7-8f55-24e68716adfb tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] 10.222.0.46 "POST /compute/v2.1/servers/67f7add7-918d-4aee-9015-7bf2830ca59b/action" status: 202 len: 0 microversion: 2.1 time: 0.116183 Jan 15 21:19:51.138655 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3423/6855] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:19:51 2022] POST /compute/v2.1/servers/67f7add7-918d-4aee-9015-7bf2830ca59b/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:19:51.144282 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-dd54db89-0ef8-436e-bfb1-ce3f642b2414 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:19:51.145245 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-dd54db89-0ef8-436e-bfb1-ce3f642b2414 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] [instance: 67f7add7-918d-4aee-9015-7bf2830ca59b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:19:51.152996 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dd54db89-0ef8-436e-bfb1-ce3f642b2414 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:51.154364 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dd54db89-0ef8-436e-bfb1-ce3f642b2414 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:51.156381 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dd54db89-0ef8-436e-bfb1-ce3f642b2414 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:51.157160 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dd54db89-0ef8-436e-bfb1-ce3f642b2414 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:51.341152 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-dd54db89-0ef8-436e-bfb1-ce3f642b2414 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd99322a1d0c54f2cb6021ae4cf37a447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9a0df7dedb47ca920ad4d833dfcc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:19:51.351932 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-dd54db89-0ef8-436e-bfb1-ce3f642b2414 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] 10.222.0.46 "GET /compute/v2.1/servers/67f7add7-918d-4aee-9015-7bf2830ca59b" status: 200 len: 1508 microversion: 2.1 time: 0.211746 Jan 15 21:19:51.353236 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3433/6856] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:19:51 2022] GET /compute/v2.1/servers/67f7add7-918d-4aee-9015-7bf2830ca59b => generated 1508 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:19:51.511085 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8dbdae3a-7861-4d8f-9843-ebd6b3638f65 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:19:51.511750 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-8dbdae3a-7861-4d8f-9843-ebd6b3638f65 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: 86b8c510-27f4-4f20-ad7f-fe8df0ed4869] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:19:51.519487 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8dbdae3a-7861-4d8f-9843-ebd6b3638f65 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:51.520070 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8dbdae3a-7861-4d8f-9843-ebd6b3638f65 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:51.521431 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8dbdae3a-7861-4d8f-9843-ebd6b3638f65 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:51.521882 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8dbdae3a-7861-4d8f-9843-ebd6b3638f65 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:51.543430 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-8dbdae3a-7861-4d8f-9843-ebd6b3638f65 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] HTTP exception thrown: Instance 86b8c510-27f4-4f20-ad7f-fe8df0ed4869 could not be found. Jan 15 21:19:51.544168 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8dbdae3a-7861-4d8f-9843-ebd6b3638f65 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Returning 404 to user: Instance 86b8c510-27f4-4f20-ad7f-fe8df0ed4869 could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:19:51.545249 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-8dbdae3a-7861-4d8f-9843-ebd6b3638f65 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] 10.222.0.46 "GET /compute/v2.1/servers/86b8c510-27f4-4f20-ad7f-fe8df0ed4869" status: 404 len: 111 microversion: 2.1 time: 0.039728 Jan 15 21:19:51.545908 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3424/6857] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:19:51 2022] GET /compute/v2.1/servers/86b8c510-27f4-4f20-ad7f-fe8df0ed4869 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:19:52.370227 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-3a76f7ef-e412-4950-8ff3-81e07004c73b tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:19:52.370964 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-3a76f7ef-e412-4950-8ff3-81e07004c73b tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] [instance: 67f7add7-918d-4aee-9015-7bf2830ca59b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:19:52.379792 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3a76f7ef-e412-4950-8ff3-81e07004c73b tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:52.381097 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3a76f7ef-e412-4950-8ff3-81e07004c73b tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:52.381597 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3a76f7ef-e412-4950-8ff3-81e07004c73b tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:52.382557 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3a76f7ef-e412-4950-8ff3-81e07004c73b tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:52.598301 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-3a76f7ef-e412-4950-8ff3-81e07004c73b tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd99322a1d0c54f2cb6021ae4cf37a447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9a0df7dedb47ca920ad4d833dfcc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:19:52.606101 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-3a76f7ef-e412-4950-8ff3-81e07004c73b tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] 10.222.0.46 "GET /compute/v2.1/servers/67f7add7-918d-4aee-9015-7bf2830ca59b" status: 200 len: 1491 microversion: 2.1 time: 0.239793 Jan 15 21:19:52.606695 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3434/6858] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:19:52 2022] GET /compute/v2.1/servers/67f7add7-918d-4aee-9015-7bf2830ca59b => generated 1491 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:19:52.625606 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ac79494f-4b37-4474-97c0-7f3a5f78719d tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:19:52.626153 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ac79494f-4b37-4474-97c0-7f3a5f78719d tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] [instance: 67f7add7-918d-4aee-9015-7bf2830ca59b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:19:52.633674 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ac79494f-4b37-4474-97c0-7f3a5f78719d tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:52.634147 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ac79494f-4b37-4474-97c0-7f3a5f78719d tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:52.634951 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ac79494f-4b37-4474-97c0-7f3a5f78719d tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:52.635403 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ac79494f-4b37-4474-97c0-7f3a5f78719d tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:52.705327 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ac79494f-4b37-4474-97c0-7f3a5f78719d tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] 10.222.0.46 "POST /compute/v2.1/servers/67f7add7-918d-4aee-9015-7bf2830ca59b/action" status: 202 len: 0 microversion: 2.1 time: 0.083273 Jan 15 21:19:52.705962 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3425/6859] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:19:52 2022] POST /compute/v2.1/servers/67f7add7-918d-4aee-9015-7bf2830ca59b/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:19:52.714793 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-3df3366c-3a1f-4723-ae0b-d9952fb06624 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:19:52.715764 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-3df3366c-3a1f-4723-ae0b-d9952fb06624 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] [instance: 67f7add7-918d-4aee-9015-7bf2830ca59b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:19:52.721939 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3df3366c-3a1f-4723-ae0b-d9952fb06624 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:52.722397 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3df3366c-3a1f-4723-ae0b-d9952fb06624 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:52.723296 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3df3366c-3a1f-4723-ae0b-d9952fb06624 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:52.723969 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3df3366c-3a1f-4723-ae0b-d9952fb06624 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:52.939706 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-3df3366c-3a1f-4723-ae0b-d9952fb06624 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd99322a1d0c54f2cb6021ae4cf37a447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9a0df7dedb47ca920ad4d833dfcc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:19:52.948739 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-3df3366c-3a1f-4723-ae0b-d9952fb06624 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] 10.222.0.46 "GET /compute/v2.1/servers/67f7add7-918d-4aee-9015-7bf2830ca59b" status: 200 len: 1497 microversion: 2.1 time: 0.237581 Jan 15 21:19:52.949350 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3435/6860] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:19:52 2022] GET /compute/v2.1/servers/67f7add7-918d-4aee-9015-7bf2830ca59b => generated 1497 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:19:53.977916 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a72693d3-d773-43fe-a22e-42d0c0f19436 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:19:53.978655 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a72693d3-d773-43fe-a22e-42d0c0f19436 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] [instance: 67f7add7-918d-4aee-9015-7bf2830ca59b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:19:53.985444 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a72693d3-d773-43fe-a22e-42d0c0f19436 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:53.985906 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a72693d3-d773-43fe-a22e-42d0c0f19436 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:53.986702 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a72693d3-d773-43fe-a22e-42d0c0f19436 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:53.987151 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a72693d3-d773-43fe-a22e-42d0c0f19436 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:54.143083 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-a72693d3-d773-43fe-a22e-42d0c0f19436 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd99322a1d0c54f2cb6021ae4cf37a447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9a0df7dedb47ca920ad4d833dfcc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:19:54.152004 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a72693d3-d773-43fe-a22e-42d0c0f19436 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] 10.222.0.46 "GET /compute/v2.1/servers/67f7add7-918d-4aee-9015-7bf2830ca59b" status: 200 len: 1497 microversion: 2.1 time: 0.179197 Jan 15 21:19:54.152597 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3426/6861] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:19:53 2022] GET /compute/v2.1/servers/67f7add7-918d-4aee-9015-7bf2830ca59b => generated 1497 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:19:55.169802 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-77a9a0ee-ae0c-4ed0-8200-d775ffe44498 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:19:55.170477 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-77a9a0ee-ae0c-4ed0-8200-d775ffe44498 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] [instance: 67f7add7-918d-4aee-9015-7bf2830ca59b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:19:55.178213 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-77a9a0ee-ae0c-4ed0-8200-d775ffe44498 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:55.178759 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-77a9a0ee-ae0c-4ed0-8200-d775ffe44498 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:55.179639 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-77a9a0ee-ae0c-4ed0-8200-d775ffe44498 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:55.180140 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-77a9a0ee-ae0c-4ed0-8200-d775ffe44498 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:55.326420 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-77a9a0ee-ae0c-4ed0-8200-d775ffe44498 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd99322a1d0c54f2cb6021ae4cf37a447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9a0df7dedb47ca920ad4d833dfcc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:19:55.334865 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-77a9a0ee-ae0c-4ed0-8200-d775ffe44498 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] 10.222.0.46 "GET /compute/v2.1/servers/67f7add7-918d-4aee-9015-7bf2830ca59b" status: 200 len: 1500 microversion: 2.1 time: 0.168918 Jan 15 21:19:55.335452 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3436/6862] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:19:55 2022] GET /compute/v2.1/servers/67f7add7-918d-4aee-9015-7bf2830ca59b => generated 1500 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:19:55.361508 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5448d65d-7cd2-4167-8aac-d77c3988754d tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:19:55.362063 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-5448d65d-7cd2-4167-8aac-d77c3988754d tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] [instance: 67f7add7-918d-4aee-9015-7bf2830ca59b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:19:55.370095 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5448d65d-7cd2-4167-8aac-d77c3988754d tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:55.370638 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5448d65d-7cd2-4167-8aac-d77c3988754d tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:55.371742 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5448d65d-7cd2-4167-8aac-d77c3988754d tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:55.372518 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5448d65d-7cd2-4167-8aac-d77c3988754d tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:55.403937 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.objects.instance [None req-5448d65d-7cd2-4167-8aac-d77c3988754d tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lazy-loading 'flavor' on Instance uuid 67f7add7-918d-4aee-9015-7bf2830ca59b {{(pid=129365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 21:19:55.487969 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5448d65d-7cd2-4167-8aac-d77c3988754d tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] 10.222.0.46 "POST /compute/v2.1/servers/67f7add7-918d-4aee-9015-7bf2830ca59b/action" status: 202 len: 0 microversion: 2.1 time: 0.129767 Jan 15 21:19:55.488787 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3427/6863] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:19:55 2022] POST /compute/v2.1/servers/67f7add7-918d-4aee-9015-7bf2830ca59b/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:19:55.499911 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0d91a0f6-f289-464c-8d22-d539a823bc21 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:19:55.500909 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-0d91a0f6-f289-464c-8d22-d539a823bc21 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] [instance: 67f7add7-918d-4aee-9015-7bf2830ca59b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:19:55.511706 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0d91a0f6-f289-464c-8d22-d539a823bc21 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:55.512652 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0d91a0f6-f289-464c-8d22-d539a823bc21 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:55.514710 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0d91a0f6-f289-464c-8d22-d539a823bc21 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:55.515565 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0d91a0f6-f289-464c-8d22-d539a823bc21 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:55.679993 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-0d91a0f6-f289-464c-8d22-d539a823bc21 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd99322a1d0c54f2cb6021ae4cf37a447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9a0df7dedb47ca920ad4d833dfcc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:19:55.688139 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0d91a0f6-f289-464c-8d22-d539a823bc21 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] 10.222.0.46 "GET /compute/v2.1/servers/67f7add7-918d-4aee-9015-7bf2830ca59b" status: 200 len: 1508 microversion: 2.1 time: 0.193265 Jan 15 21:19:55.688936 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3437/6864] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:19:55 2022] GET /compute/v2.1/servers/67f7add7-918d-4aee-9015-7bf2830ca59b => generated 1508 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:19:56.709091 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-6a3b6a64-25e0-4551-817c-d5c5089c37e2 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:19:56.710493 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-6a3b6a64-25e0-4551-817c-d5c5089c37e2 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] [instance: 67f7add7-918d-4aee-9015-7bf2830ca59b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:19:56.717889 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6a3b6a64-25e0-4551-817c-d5c5089c37e2 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:56.718411 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6a3b6a64-25e0-4551-817c-d5c5089c37e2 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:56.719364 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6a3b6a64-25e0-4551-817c-d5c5089c37e2 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:56.720012 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6a3b6a64-25e0-4551-817c-d5c5089c37e2 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:56.912952 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-6a3b6a64-25e0-4551-817c-d5c5089c37e2 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd99322a1d0c54f2cb6021ae4cf37a447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9a0df7dedb47ca920ad4d833dfcc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:19:56.921326 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-6a3b6a64-25e0-4551-817c-d5c5089c37e2 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] 10.222.0.46 "GET /compute/v2.1/servers/67f7add7-918d-4aee-9015-7bf2830ca59b" status: 200 len: 1491 microversion: 2.1 time: 0.218639 Jan 15 21:19:56.921905 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3428/6865] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:19:56 2022] GET /compute/v2.1/servers/67f7add7-918d-4aee-9015-7bf2830ca59b => generated 1491 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:19:56.944700 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-2c9307d4-fdf4-454b-978d-008ff9e2a745 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:19:56.945270 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-2c9307d4-fdf4-454b-978d-008ff9e2a745 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] [instance: 67f7add7-918d-4aee-9015-7bf2830ca59b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:19:56.952952 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2c9307d4-fdf4-454b-978d-008ff9e2a745 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:56.953362 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2c9307d4-fdf4-454b-978d-008ff9e2a745 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:56.954169 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2c9307d4-fdf4-454b-978d-008ff9e2a745 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:56.954605 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2c9307d4-fdf4-454b-978d-008ff9e2a745 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:57.035413 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-2c9307d4-fdf4-454b-978d-008ff9e2a745 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] 10.222.0.46 "POST /compute/v2.1/servers/67f7add7-918d-4aee-9015-7bf2830ca59b/action" status: 202 len: 0 microversion: 2.1 time: 0.095046 Jan 15 21:19:57.037634 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3438/6866] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:19:56 2022] POST /compute/v2.1/servers/67f7add7-918d-4aee-9015-7bf2830ca59b/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:19:57.046912 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8398f6a3-b113-4f6d-9a33-381949ba7c3d tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:19:57.047640 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-8398f6a3-b113-4f6d-9a33-381949ba7c3d tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] [instance: 67f7add7-918d-4aee-9015-7bf2830ca59b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:19:57.055630 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8398f6a3-b113-4f6d-9a33-381949ba7c3d tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:57.055830 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8398f6a3-b113-4f6d-9a33-381949ba7c3d tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:57.056748 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8398f6a3-b113-4f6d-9a33-381949ba7c3d tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:57.057204 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8398f6a3-b113-4f6d-9a33-381949ba7c3d tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:57.228621 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-8398f6a3-b113-4f6d-9a33-381949ba7c3d tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd99322a1d0c54f2cb6021ae4cf37a447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9a0df7dedb47ca920ad4d833dfcc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:19:57.237706 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-8398f6a3-b113-4f6d-9a33-381949ba7c3d tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] 10.222.0.46 "GET /compute/v2.1/servers/67f7add7-918d-4aee-9015-7bf2830ca59b" status: 200 len: 1497 microversion: 2.1 time: 0.195028 Jan 15 21:19:57.238289 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3429/6867] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:19:57 2022] GET /compute/v2.1/servers/67f7add7-918d-4aee-9015-7bf2830ca59b => generated 1497 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:19:58.263527 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-06053967-7fcb-4e37-a43b-1731196e9e96 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:19:58.266116 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-06053967-7fcb-4e37-a43b-1731196e9e96 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] [instance: 67f7add7-918d-4aee-9015-7bf2830ca59b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:19:58.283789 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-06053967-7fcb-4e37-a43b-1731196e9e96 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:58.284740 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-06053967-7fcb-4e37-a43b-1731196e9e96 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:58.287025 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-06053967-7fcb-4e37-a43b-1731196e9e96 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:58.287701 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-06053967-7fcb-4e37-a43b-1731196e9e96 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:58.494312 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-06053967-7fcb-4e37-a43b-1731196e9e96 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd99322a1d0c54f2cb6021ae4cf37a447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9a0df7dedb47ca920ad4d833dfcc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:19:58.504502 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-06053967-7fcb-4e37-a43b-1731196e9e96 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] 10.222.0.46 "GET /compute/v2.1/servers/67f7add7-918d-4aee-9015-7bf2830ca59b" status: 200 len: 1497 microversion: 2.1 time: 0.252344 Jan 15 21:19:58.506619 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3439/6868] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:19:58 2022] GET /compute/v2.1/servers/67f7add7-918d-4aee-9015-7bf2830ca59b => generated 1497 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:19:59.524580 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c006a4b1-9b09-45f6-b0fa-e7c38764b0a5 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:19:59.525366 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c006a4b1-9b09-45f6-b0fa-e7c38764b0a5 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] [instance: 67f7add7-918d-4aee-9015-7bf2830ca59b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:19:59.532627 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c006a4b1-9b09-45f6-b0fa-e7c38764b0a5 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:59.533054 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c006a4b1-9b09-45f6-b0fa-e7c38764b0a5 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:19:59.533890 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c006a4b1-9b09-45f6-b0fa-e7c38764b0a5 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:19:59.534581 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c006a4b1-9b09-45f6-b0fa-e7c38764b0a5 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:00.022633 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-c006a4b1-9b09-45f6-b0fa-e7c38764b0a5 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd99322a1d0c54f2cb6021ae4cf37a447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9a0df7dedb47ca920ad4d833dfcc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:20:00.030456 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c006a4b1-9b09-45f6-b0fa-e7c38764b0a5 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] 10.222.0.46 "GET /compute/v2.1/servers/67f7add7-918d-4aee-9015-7bf2830ca59b" status: 200 len: 1500 microversion: 2.1 time: 0.510319 Jan 15 21:20:00.031058 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3430/6869] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:19:59 2022] GET /compute/v2.1/servers/67f7add7-918d-4aee-9015-7bf2830ca59b => generated 1500 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:20:00.052710 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f32c469a-09af-484e-aa85-50c41dbe6e92 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:20:00.053670 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f32c469a-09af-484e-aa85-50c41dbe6e92 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] [instance: 67f7add7-918d-4aee-9015-7bf2830ca59b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:20:00.061268 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f32c469a-09af-484e-aa85-50c41dbe6e92 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:00.061981 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f32c469a-09af-484e-aa85-50c41dbe6e92 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:00.062843 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f32c469a-09af-484e-aa85-50c41dbe6e92 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:00.063546 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f32c469a-09af-484e-aa85-50c41dbe6e92 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:00.090990 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f32c469a-09af-484e-aa85-50c41dbe6e92 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] [instance: 67f7add7-918d-4aee-9015-7bf2830ca59b] Going to try to terminate instance {{(pid=129366) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 21:20:00.188039 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f32c469a-09af-484e-aa85-50c41dbe6e92 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] 10.222.0.46 "DELETE /compute/v2.1/servers/67f7add7-918d-4aee-9015-7bf2830ca59b" status: 204 len: 0 microversion: 2.1 time: 0.140345 Jan 15 21:20:00.192529 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3440/6870] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 21:20:00 2022] DELETE /compute/v2.1/servers/67f7add7-918d-4aee-9015-7bf2830ca59b => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 21:20:00.199688 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-6362130f-bbd1-42e7-836d-03993266ebf7 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:20:00.200353 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-6362130f-bbd1-42e7-836d-03993266ebf7 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] [instance: 67f7add7-918d-4aee-9015-7bf2830ca59b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:20:00.212055 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6362130f-bbd1-42e7-836d-03993266ebf7 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:00.212671 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6362130f-bbd1-42e7-836d-03993266ebf7 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:00.213800 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6362130f-bbd1-42e7-836d-03993266ebf7 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:00.214557 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6362130f-bbd1-42e7-836d-03993266ebf7 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:00.359087 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-6362130f-bbd1-42e7-836d-03993266ebf7 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd99322a1d0c54f2cb6021ae4cf37a447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9a0df7dedb47ca920ad4d833dfcc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:20:00.366819 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-6362130f-bbd1-42e7-836d-03993266ebf7 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] 10.222.0.46 "GET /compute/v2.1/servers/67f7add7-918d-4aee-9015-7bf2830ca59b" status: 200 len: 1506 microversion: 2.1 time: 0.172935 Jan 15 21:20:00.367401 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3431/6871] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:20:00 2022] GET /compute/v2.1/servers/67f7add7-918d-4aee-9015-7bf2830ca59b => generated 1506 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:20:00.485282 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7126888a-8a21-4bfa-acd7-f7028cf4fda5 tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-153159050", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "networks": [{"uuid": "43f3a0fb-ea42-4a02-82fa-c1ba7986a1c6"}]}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:20:00.534817 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.network.neutron [None req-7126888a-8a21-4bfa-acd7-f7028cf4fda5 tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] validate_networks() for [('43f3a0fb-ea42-4a02-82fa-c1ba7986a1c6', None, None, None, None, None)] {{(pid=129366) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 21:20:00.888542 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-7126888a-8a21-4bfa-acd7-f7028cf4fda5 tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] Flavor limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 21:20:00.889017 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-7126888a-8a21-4bfa-acd7-f7028cf4fda5 tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] Image limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 21:20:00.889481 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-7126888a-8a21-4bfa-acd7-f7028cf4fda5 tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] Flavor pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 21:20:00.889880 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-7126888a-8a21-4bfa-acd7-f7028cf4fda5 tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] Image pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 21:20:00.890312 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-7126888a-8a21-4bfa-acd7-f7028cf4fda5 tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 21:20:00.899721 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7126888a-8a21-4bfa-acd7-f7028cf4fda5 tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:00.900165 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7126888a-8a21-4bfa-acd7-f7028cf4fda5 tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:00.901036 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7126888a-8a21-4bfa-acd7-f7028cf4fda5 tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:00.901466 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7126888a-8a21-4bfa-acd7-f7028cf4fda5 tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:00.917632 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-7126888a-8a21-4bfa-acd7-f7028cf4fda5 tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] Getting quotas for project 5aca9c053ec54853934a057b46a98733. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:20:00.922605 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-7126888a-8a21-4bfa-acd7-f7028cf4fda5 tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] Getting quotas for user ed2d1c33594b4b508c6bf1cc7fd33784 and project 5aca9c053ec54853934a057b46a98733. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:20:00.934543 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-7126888a-8a21-4bfa-acd7-f7028cf4fda5 tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] Going to run 1 instances... {{(pid=129366) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 21:20:00.936929 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-7126888a-8a21-4bfa-acd7-f7028cf4fda5 tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] [instance: 3df06136-2b41-44b8-a0ab-79390c2d7d96] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 21:20:00.982242 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7126888a-8a21-4bfa-acd7-f7028cf4fda5 tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.636554 Jan 15 21:20:00.983067 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3441/6872] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 21:20:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 638 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 15 21:20:00.993486 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b700eb6d-ab5d-452a-9787-f33da016cde6 tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:20:00.994106 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b700eb6d-ab5d-452a-9787-f33da016cde6 tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] [instance: 3df06136-2b41-44b8-a0ab-79390c2d7d96] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:20:01.046892 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-b700eb6d-ab5d-452a-9787-f33da016cde6 tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2d1c33594b4b508c6bf1cc7fd33784', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aca9c053ec54853934a057b46a98733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:20:01.054016 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b700eb6d-ab5d-452a-9787-f33da016cde6 tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] 10.222.0.46 "GET /compute/v2.1/servers/3df06136-2b41-44b8-a0ab-79390c2d7d96" status: 200 len: 1213 microversion: 2.1 time: 0.065171 Jan 15 21:20:01.062401 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3432/6873] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:20:00 2022] GET /compute/v2.1/servers/3df06136-2b41-44b8-a0ab-79390c2d7d96 => generated 1213 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:20:01.385141 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7d5993b4-3fb5-413b-8a23-e3ec88f64f9c tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:20:01.385954 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-7d5993b4-3fb5-413b-8a23-e3ec88f64f9c tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] [instance: 67f7add7-918d-4aee-9015-7bf2830ca59b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:20:01.394867 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7d5993b4-3fb5-413b-8a23-e3ec88f64f9c tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:01.395860 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7d5993b4-3fb5-413b-8a23-e3ec88f64f9c tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:01.396694 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7d5993b4-3fb5-413b-8a23-e3ec88f64f9c tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:01.397164 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7d5993b4-3fb5-413b-8a23-e3ec88f64f9c tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:01.415208 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-64dc0514-64af-4a6c-8ce1-9ef89ca63cee tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:20:01.417319 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-64dc0514-64af-4a6c-8ce1-9ef89ca63cee tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: ae51bd6b-96a9-42fa-ad05-234547d3f5d3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:20:01.425042 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-64dc0514-64af-4a6c-8ce1-9ef89ca63cee tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:01.425817 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-64dc0514-64af-4a6c-8ce1-9ef89ca63cee tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:01.427346 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-64dc0514-64af-4a6c-8ce1-9ef89ca63cee tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:01.428001 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-64dc0514-64af-4a6c-8ce1-9ef89ca63cee tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:01.517334 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-64dc0514-64af-4a6c-8ce1-9ef89ca63cee tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Flavor limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 21:20:01.517751 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-64dc0514-64af-4a6c-8ce1-9ef89ca63cee tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Image limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 21:20:01.518302 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-64dc0514-64af-4a6c-8ce1-9ef89ca63cee tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Flavor pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 21:20:01.518998 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-64dc0514-64af-4a6c-8ce1-9ef89ca63cee tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Image pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 21:20:01.519451 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-64dc0514-64af-4a6c-8ce1-9ef89ca63cee tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 21:20:01.552659 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-7d5993b4-3fb5-413b-8a23-e3ec88f64f9c tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd99322a1d0c54f2cb6021ae4cf37a447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9a0df7dedb47ca920ad4d833dfcc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:20:01.561093 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7d5993b4-3fb5-413b-8a23-e3ec88f64f9c tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] 10.222.0.46 "GET /compute/v2.1/servers/67f7add7-918d-4aee-9015-7bf2830ca59b" status: 200 len: 1506 microversion: 2.1 time: 0.179781 Jan 15 21:20:01.577620 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3442/6874] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:20:01 2022] GET /compute/v2.1/servers/67f7add7-918d-4aee-9015-7bf2830ca59b => generated 1506 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:20:01.590097 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-64dc0514-64af-4a6c-8ce1-9ef89ca63cee tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: ae51bd6b-96a9-42fa-ad05-234547d3f5d3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:20:01.596432 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-64dc0514-64af-4a6c-8ce1-9ef89ca63cee tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:01.596922 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-64dc0514-64af-4a6c-8ce1-9ef89ca63cee tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:01.597738 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-64dc0514-64af-4a6c-8ce1-9ef89ca63cee tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:01.598187 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-64dc0514-64af-4a6c-8ce1-9ef89ca63cee tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:01.627928 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-64dc0514-64af-4a6c-8ce1-9ef89ca63cee tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "POST /compute/v2.1/servers/ae51bd6b-96a9-42fa-ad05-234547d3f5d3/action" status: 202 len: 1137 microversion: 2.1 time: 0.216699 Jan 15 21:20:01.628676 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3433/6875] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:20:01 2022] POST /compute/v2.1/servers/ae51bd6b-96a9-42fa-ad05-234547d3f5d3/action => generated 1137 bytes in 218 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 15 21:20:01.646908 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d35cd337-ce01-4c7f-a481-f091447d9805 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:20:01.647564 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-d35cd337-ce01-4c7f-a481-f091447d9805 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: ae51bd6b-96a9-42fa-ad05-234547d3f5d3] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:20:01.654719 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d35cd337-ce01-4c7f-a481-f091447d9805 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:01.655289 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d35cd337-ce01-4c7f-a481-f091447d9805 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:01.656197 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d35cd337-ce01-4c7f-a481-f091447d9805 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:01.656729 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d35cd337-ce01-4c7f-a481-f091447d9805 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:01.820014 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-d35cd337-ce01-4c7f-a481-f091447d9805 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:20:01.828028 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d35cd337-ce01-4c7f-a481-f091447d9805 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/ae51bd6b-96a9-42fa-ad05-234547d3f5d3" status: 200 len: 1689 microversion: 2.1 time: 0.186274 Jan 15 21:20:01.828517 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3443/6876] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:20:01 2022] GET /compute/v2.1/servers/ae51bd6b-96a9-42fa-ad05-234547d3f5d3 => generated 1689 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:20:02.072074 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-188b6fd7-1bc1-4336-9838-4ae4afcb38fc tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:20:02.073531 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-188b6fd7-1bc1-4336-9838-4ae4afcb38fc tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] [instance: 3df06136-2b41-44b8-a0ab-79390c2d7d96] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:20:02.081520 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-188b6fd7-1bc1-4336-9838-4ae4afcb38fc tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:02.082294 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-188b6fd7-1bc1-4336-9838-4ae4afcb38fc tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:02.084153 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-188b6fd7-1bc1-4336-9838-4ae4afcb38fc tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:02.084768 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-188b6fd7-1bc1-4336-9838-4ae4afcb38fc tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:02.156362 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-188b6fd7-1bc1-4336-9838-4ae4afcb38fc tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2d1c33594b4b508c6bf1cc7fd33784', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aca9c053ec54853934a057b46a98733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:20:02.165965 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-188b6fd7-1bc1-4336-9838-4ae4afcb38fc tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] 10.222.0.46 "GET /compute/v2.1/servers/3df06136-2b41-44b8-a0ab-79390c2d7d96" status: 200 len: 1273 microversion: 2.1 time: 0.098354 Jan 15 21:20:02.166870 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3434/6877] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:20:02 2022] GET /compute/v2.1/servers/3df06136-2b41-44b8-a0ab-79390c2d7d96 => generated 1273 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:20:02.594992 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-faf7cd45-6ab6-4960-92d6-211a3e0243a4 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:20:02.597329 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-faf7cd45-6ab6-4960-92d6-211a3e0243a4 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] [instance: 67f7add7-918d-4aee-9015-7bf2830ca59b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:20:02.606063 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-faf7cd45-6ab6-4960-92d6-211a3e0243a4 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:02.606914 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-faf7cd45-6ab6-4960-92d6-211a3e0243a4 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:02.608072 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-faf7cd45-6ab6-4960-92d6-211a3e0243a4 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:02.608519 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-faf7cd45-6ab6-4960-92d6-211a3e0243a4 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:02.771172 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-faf7cd45-6ab6-4960-92d6-211a3e0243a4 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd99322a1d0c54f2cb6021ae4cf37a447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9a0df7dedb47ca920ad4d833dfcc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:20:02.781232 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-faf7cd45-6ab6-4960-92d6-211a3e0243a4 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] 10.222.0.46 "GET /compute/v2.1/servers/67f7add7-918d-4aee-9015-7bf2830ca59b" status: 200 len: 1506 microversion: 2.1 time: 0.189831 Jan 15 21:20:02.782005 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3444/6878] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:20:02 2022] GET /compute/v2.1/servers/67f7add7-918d-4aee-9015-7bf2830ca59b => generated 1506 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:20:02.848697 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5fc6b685-c047-42b4-9b23-25047739470a tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:20:02.849439 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-5fc6b685-c047-42b4-9b23-25047739470a tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: ae51bd6b-96a9-42fa-ad05-234547d3f5d3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:20:02.855456 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5fc6b685-c047-42b4-9b23-25047739470a tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:02.856161 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5fc6b685-c047-42b4-9b23-25047739470a tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:02.857002 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5fc6b685-c047-42b4-9b23-25047739470a tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:02.857461 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5fc6b685-c047-42b4-9b23-25047739470a tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:03.021324 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-5fc6b685-c047-42b4-9b23-25047739470a tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:20:03.032716 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5fc6b685-c047-42b4-9b23-25047739470a tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/ae51bd6b-96a9-42fa-ad05-234547d3f5d3" status: 200 len: 1689 microversion: 2.1 time: 0.187968 Jan 15 21:20:03.033493 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3435/6879] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:20:02 2022] GET /compute/v2.1/servers/ae51bd6b-96a9-42fa-ad05-234547d3f5d3 => generated 1689 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:20:03.185873 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-171a95c4-ff4b-4837-a8b3-c28c0799a527 tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:20:03.186908 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-171a95c4-ff4b-4837-a8b3-c28c0799a527 tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] [instance: 3df06136-2b41-44b8-a0ab-79390c2d7d96] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:20:03.194251 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-171a95c4-ff4b-4837-a8b3-c28c0799a527 tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:03.194827 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-171a95c4-ff4b-4837-a8b3-c28c0799a527 tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:03.195797 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-171a95c4-ff4b-4837-a8b3-c28c0799a527 tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:03.196353 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-171a95c4-ff4b-4837-a8b3-c28c0799a527 tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:03.275818 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-171a95c4-ff4b-4837-a8b3-c28c0799a527 tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2d1c33594b4b508c6bf1cc7fd33784', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aca9c053ec54853934a057b46a98733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:20:03.291371 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-171a95c4-ff4b-4837-a8b3-c28c0799a527 tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] 10.222.0.46 "GET /compute/v2.1/servers/3df06136-2b41-44b8-a0ab-79390c2d7d96" status: 200 len: 1271 microversion: 2.1 time: 0.110349 Jan 15 21:20:03.292612 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3445/6880] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:20:03 2022] GET /compute/v2.1/servers/3df06136-2b41-44b8-a0ab-79390c2d7d96 => generated 1271 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:20:03.454297 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-33d58ba2-bd98-43ec-b40b-4d1a234451f9 req-0a748bbc-3325-4e93-814f-2e9f4a18647c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67f7add7-918d-4aee-9015-7bf2830ca59b", "name": "network-vif-deleted", "tag": "ff4b38f7-41bd-4dcc-9838-e09499d0b96a"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:20:03.456196 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:20:03.456196 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:20:03.470188 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-33d58ba2-bd98-43ec-b40b-4d1a234451f9 req-0a748bbc-3325-4e93-814f-2e9f4a18647c service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:03.471173 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-33d58ba2-bd98-43ec-b40b-4d1a234451f9 req-0a748bbc-3325-4e93-814f-2e9f4a18647c service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:03.485965 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-33d58ba2-bd98-43ec-b40b-4d1a234451f9 req-0a748bbc-3325-4e93-814f-2e9f4a18647c service nova] Creating event network-vif-deleted:ff4b38f7-41bd-4dcc-9838-e09499d0b96a for instance 67f7add7-918d-4aee-9015-7bf2830ca59b on nch2-master-1 Jan 15 21:20:03.495974 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-33d58ba2-bd98-43ec-b40b-4d1a234451f9 req-0a748bbc-3325-4e93-814f-2e9f4a18647c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044675 Jan 15 21:20:03.497510 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3436/6881] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:20:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:20:03.798571 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1d666a89-3433-4bc7-a95c-62008c608990 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:20:03.799774 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-1d666a89-3433-4bc7-a95c-62008c608990 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] [instance: 67f7add7-918d-4aee-9015-7bf2830ca59b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:20:03.807053 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1d666a89-3433-4bc7-a95c-62008c608990 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:03.807737 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1d666a89-3433-4bc7-a95c-62008c608990 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:03.808521 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1d666a89-3433-4bc7-a95c-62008c608990 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:03.808997 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1d666a89-3433-4bc7-a95c-62008c608990 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:03.856063 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1d666a89-3433-4bc7-a95c-62008c608990 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:03.856904 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1d666a89-3433-4bc7-a95c-62008c608990 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:03.857463 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.objects.instance [None req-1d666a89-3433-4bc7-a95c-62008c608990 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lazy-loading 'fault' on Instance uuid 67f7add7-918d-4aee-9015-7bf2830ca59b {{(pid=129366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 21:20:03.908800 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-1d666a89-3433-4bc7-a95c-62008c608990 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd99322a1d0c54f2cb6021ae4cf37a447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9a0df7dedb47ca920ad4d833dfcc41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:20:03.920785 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-1d666a89-3433-4bc7-a95c-62008c608990 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] 10.222.0.46 "GET /compute/v2.1/servers/67f7add7-918d-4aee-9015-7bf2830ca59b" status: 200 len: 1303 microversion: 2.1 time: 0.125368 Jan 15 21:20:03.921891 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3446/6882] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:20:03 2022] GET /compute/v2.1/servers/67f7add7-918d-4aee-9015-7bf2830ca59b => generated 1303 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:20:04.055379 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-1d4382c5-8a84-4d79-a28e-d70d0b061050 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:20:04.056625 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-1d4382c5-8a84-4d79-a28e-d70d0b061050 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: ae51bd6b-96a9-42fa-ad05-234547d3f5d3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:20:04.065101 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1d4382c5-8a84-4d79-a28e-d70d0b061050 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:04.065901 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1d4382c5-8a84-4d79-a28e-d70d0b061050 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:04.068012 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1d4382c5-8a84-4d79-a28e-d70d0b061050 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:04.068832 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1d4382c5-8a84-4d79-a28e-d70d0b061050 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:04.228891 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-1d4382c5-8a84-4d79-a28e-d70d0b061050 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:20:04.237224 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-1d4382c5-8a84-4d79-a28e-d70d0b061050 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/ae51bd6b-96a9-42fa-ad05-234547d3f5d3" status: 200 len: 1689 microversion: 2.1 time: 0.187508 Jan 15 21:20:04.237823 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3437/6883] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:20:04 2022] GET /compute/v2.1/servers/ae51bd6b-96a9-42fa-ad05-234547d3f5d3 => generated 1689 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:20:04.313165 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-830d926e-cd0f-454b-8584-d20ce7e67f80 tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:20:04.314150 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-830d926e-cd0f-454b-8584-d20ce7e67f80 tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] [instance: 3df06136-2b41-44b8-a0ab-79390c2d7d96] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:20:04.322795 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-830d926e-cd0f-454b-8584-d20ce7e67f80 tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:04.324322 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-830d926e-cd0f-454b-8584-d20ce7e67f80 tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:04.325226 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-830d926e-cd0f-454b-8584-d20ce7e67f80 tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:04.325867 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-830d926e-cd0f-454b-8584-d20ce7e67f80 tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:04.474133 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-830d926e-cd0f-454b-8584-d20ce7e67f80 tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2d1c33594b4b508c6bf1cc7fd33784', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aca9c053ec54853934a057b46a98733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:20:04.483716 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-830d926e-cd0f-454b-8584-d20ce7e67f80 tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] 10.222.0.46 "GET /compute/v2.1/servers/3df06136-2b41-44b8-a0ab-79390c2d7d96" status: 200 len: 1313 microversion: 2.1 time: 0.176897 Jan 15 21:20:04.484722 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3447/6884] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:20:04 2022] GET /compute/v2.1/servers/3df06136-2b41-44b8-a0ab-79390c2d7d96 => generated 1313 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:20:04.944364 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ef255ae8-f838-41fa-918a-0e057036b226 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:20:04.945104 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ef255ae8-f838-41fa-918a-0e057036b226 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] [instance: 67f7add7-918d-4aee-9015-7bf2830ca59b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:20:04.951948 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ef255ae8-f838-41fa-918a-0e057036b226 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:04.952403 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ef255ae8-f838-41fa-918a-0e057036b226 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:04.953231 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ef255ae8-f838-41fa-918a-0e057036b226 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:04.953672 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ef255ae8-f838-41fa-918a-0e057036b226 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:04.972912 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-ef255ae8-f838-41fa-918a-0e057036b226 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] HTTP exception thrown: Instance 67f7add7-918d-4aee-9015-7bf2830ca59b could not be found. Jan 15 21:20:04.973150 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ef255ae8-f838-41fa-918a-0e057036b226 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] Returning 404 to user: Instance 67f7add7-918d-4aee-9015-7bf2830ca59b could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:20:04.974183 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ef255ae8-f838-41fa-918a-0e057036b226 tempest-TestServerAdvancedOps-620740096 tempest-TestServerAdvancedOps-620740096-project] 10.222.0.46 "GET /compute/v2.1/servers/67f7add7-918d-4aee-9015-7bf2830ca59b" status: 404 len: 111 microversion: 2.1 time: 0.034479 Jan 15 21:20:04.974845 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3438/6885] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:20:04 2022] GET /compute/v2.1/servers/67f7add7-918d-4aee-9015-7bf2830ca59b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:20:05.257085 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-10cad4a8-adda-4c2d-9d6d-bbfcb9b12e14 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:20:05.258454 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-10cad4a8-adda-4c2d-9d6d-bbfcb9b12e14 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: ae51bd6b-96a9-42fa-ad05-234547d3f5d3] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:20:05.267708 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-10cad4a8-adda-4c2d-9d6d-bbfcb9b12e14 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:05.268170 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-10cad4a8-adda-4c2d-9d6d-bbfcb9b12e14 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:05.269156 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-10cad4a8-adda-4c2d-9d6d-bbfcb9b12e14 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:05.269745 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-10cad4a8-adda-4c2d-9d6d-bbfcb9b12e14 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:05.503177 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-4c53a6da-22b6-447d-ab74-d1574da1b738 tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:20:05.503843 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-4c53a6da-22b6-447d-ab74-d1574da1b738 tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] [instance: 3df06136-2b41-44b8-a0ab-79390c2d7d96] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:20:05.510589 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4c53a6da-22b6-447d-ab74-d1574da1b738 tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:05.511072 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4c53a6da-22b6-447d-ab74-d1574da1b738 tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:05.511907 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4c53a6da-22b6-447d-ab74-d1574da1b738 tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:05.512351 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4c53a6da-22b6-447d-ab74-d1574da1b738 tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:05.513271 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-10cad4a8-adda-4c2d-9d6d-bbfcb9b12e14 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:20:05.521217 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-10cad4a8-adda-4c2d-9d6d-bbfcb9b12e14 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/ae51bd6b-96a9-42fa-ad05-234547d3f5d3" status: 200 len: 1689 microversion: 2.1 time: 0.269630 Jan 15 21:20:05.521890 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3448/6886] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:20:05 2022] GET /compute/v2.1/servers/ae51bd6b-96a9-42fa-ad05-234547d3f5d3 => generated 1689 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:20:05.527409 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-1d8c3c63-7876-47e4-b38e-52bb54a98d65 req-bbad7ca5-b5e5-41d4-96dc-7acad139c912 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3df06136-2b41-44b8-a0ab-79390c2d7d96", "tag": "f959f682-88bf-46fd-b330-3f3ca3ad1faa"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:20:05.529704 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:20:05.529704 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:20:05.538858 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-1d8c3c63-7876-47e4-b38e-52bb54a98d65 req-bbad7ca5-b5e5-41d4-96dc-7acad139c912 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:05.539785 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-1d8c3c63-7876-47e4-b38e-52bb54a98d65 req-bbad7ca5-b5e5-41d4-96dc-7acad139c912 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:05.557455 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-1d8c3c63-7876-47e4-b38e-52bb54a98d65 req-bbad7ca5-b5e5-41d4-96dc-7acad139c912 service nova] Creating event network-changed:f959f682-88bf-46fd-b330-3f3ca3ad1faa for instance 3df06136-2b41-44b8-a0ab-79390c2d7d96 on nch1-master-1 Jan 15 21:20:05.561867 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-1d8c3c63-7876-47e4-b38e-52bb54a98d65 req-bbad7ca5-b5e5-41d4-96dc-7acad139c912 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038589 Jan 15 21:20:05.562477 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3449/6887] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:20:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:20:05.820498 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-4c53a6da-22b6-447d-ab74-d1574da1b738 tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2d1c33594b4b508c6bf1cc7fd33784', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aca9c053ec54853934a057b46a98733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:20:05.829874 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-4c53a6da-22b6-447d-ab74-d1574da1b738 tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] 10.222.0.46 "GET /compute/v2.1/servers/3df06136-2b41-44b8-a0ab-79390c2d7d96" status: 200 len: 1313 microversion: 2.1 time: 0.330361 Jan 15 21:20:05.830906 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3439/6888] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:20:05 2022] GET /compute/v2.1/servers/3df06136-2b41-44b8-a0ab-79390c2d7d96 => generated 1313 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:20:06.543029 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-945b28d3-2c3a-4761-8ce7-1c85cc5dac30 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:20:06.543736 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-945b28d3-2c3a-4761-8ce7-1c85cc5dac30 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: ae51bd6b-96a9-42fa-ad05-234547d3f5d3] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:20:06.550440 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-945b28d3-2c3a-4761-8ce7-1c85cc5dac30 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:06.551473 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-945b28d3-2c3a-4761-8ce7-1c85cc5dac30 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:06.552699 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-945b28d3-2c3a-4761-8ce7-1c85cc5dac30 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:06.553253 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-945b28d3-2c3a-4761-8ce7-1c85cc5dac30 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:06.711163 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-945b28d3-2c3a-4761-8ce7-1c85cc5dac30 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:20:06.720625 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-945b28d3-2c3a-4761-8ce7-1c85cc5dac30 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/ae51bd6b-96a9-42fa-ad05-234547d3f5d3" status: 200 len: 1689 microversion: 2.1 time: 0.184785 Jan 15 21:20:06.721247 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3450/6889] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:20:06 2022] GET /compute/v2.1/servers/ae51bd6b-96a9-42fa-ad05-234547d3f5d3 => generated 1689 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:20:06.849707 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a7ed07ba-6524-4876-903b-b67131f5d05a tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:20:06.851534 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a7ed07ba-6524-4876-903b-b67131f5d05a tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] [instance: 3df06136-2b41-44b8-a0ab-79390c2d7d96] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:20:06.859531 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a7ed07ba-6524-4876-903b-b67131f5d05a tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:06.860171 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a7ed07ba-6524-4876-903b-b67131f5d05a tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:06.861166 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a7ed07ba-6524-4876-903b-b67131f5d05a tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:06.861791 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a7ed07ba-6524-4876-903b-b67131f5d05a tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:07.011483 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-a7ed07ba-6524-4876-903b-b67131f5d05a tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2d1c33594b4b508c6bf1cc7fd33784', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aca9c053ec54853934a057b46a98733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:20:07.019193 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a7ed07ba-6524-4876-903b-b67131f5d05a tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] 10.222.0.46 "GET /compute/v2.1/servers/3df06136-2b41-44b8-a0ab-79390c2d7d96" status: 200 len: 1313 microversion: 2.1 time: 0.174038 Jan 15 21:20:07.019731 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3440/6890] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:20:06 2022] GET /compute/v2.1/servers/3df06136-2b41-44b8-a0ab-79390c2d7d96 => generated 1313 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:20:07.739480 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c462a7e2-e71e-4cd0-a016-9bfeb531d4c9 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:20:07.740542 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c462a7e2-e71e-4cd0-a016-9bfeb531d4c9 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: ae51bd6b-96a9-42fa-ad05-234547d3f5d3] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:20:07.747951 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c462a7e2-e71e-4cd0-a016-9bfeb531d4c9 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:07.748406 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c462a7e2-e71e-4cd0-a016-9bfeb531d4c9 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:07.749365 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c462a7e2-e71e-4cd0-a016-9bfeb531d4c9 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:07.749854 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c462a7e2-e71e-4cd0-a016-9bfeb531d4c9 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:07.914939 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-c462a7e2-e71e-4cd0-a016-9bfeb531d4c9 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:20:07.924948 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c462a7e2-e71e-4cd0-a016-9bfeb531d4c9 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/ae51bd6b-96a9-42fa-ad05-234547d3f5d3" status: 200 len: 1689 microversion: 2.1 time: 0.190434 Jan 15 21:20:07.925972 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3451/6891] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:20:07 2022] GET /compute/v2.1/servers/ae51bd6b-96a9-42fa-ad05-234547d3f5d3 => generated 1689 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:20:08.038473 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-4a43f614-e787-4eef-997c-fe31784c1a00 tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:20:08.039158 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-4a43f614-e787-4eef-997c-fe31784c1a00 tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] [instance: 3df06136-2b41-44b8-a0ab-79390c2d7d96] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:20:08.048688 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4a43f614-e787-4eef-997c-fe31784c1a00 tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:08.049523 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4a43f614-e787-4eef-997c-fe31784c1a00 tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:08.050666 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4a43f614-e787-4eef-997c-fe31784c1a00 tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:08.052816 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4a43f614-e787-4eef-997c-fe31784c1a00 tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:08.241786 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-96bb887d-b559-48ae-8c21-d552d6e87e0b req-cf1d3901-61d7-4e09-9962-51c2c6997b25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3df06136-2b41-44b8-a0ab-79390c2d7d96", "name": "network-vif-plugged", "status": "completed", "tag": "f959f682-88bf-46fd-b330-3f3ca3ad1faa"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:20:08.243767 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:20:08.243767 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:20:08.253312 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-96bb887d-b559-48ae-8c21-d552d6e87e0b req-cf1d3901-61d7-4e09-9962-51c2c6997b25 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:08.253963 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-96bb887d-b559-48ae-8c21-d552d6e87e0b req-cf1d3901-61d7-4e09-9962-51c2c6997b25 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:08.262699 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-4a43f614-e787-4eef-997c-fe31784c1a00 tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2d1c33594b4b508c6bf1cc7fd33784', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aca9c053ec54853934a057b46a98733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:20:08.270521 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-4a43f614-e787-4eef-997c-fe31784c1a00 tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] 10.222.0.46 "GET /compute/v2.1/servers/3df06136-2b41-44b8-a0ab-79390c2d7d96" status: 200 len: 1313 microversion: 2.1 time: 0.237763 Jan 15 21:20:08.271382 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3441/6892] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:20:08 2022] GET /compute/v2.1/servers/3df06136-2b41-44b8-a0ab-79390c2d7d96 => generated 1313 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:20:08.275435 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-96bb887d-b559-48ae-8c21-d552d6e87e0b req-cf1d3901-61d7-4e09-9962-51c2c6997b25 service nova] Creating event network-vif-plugged:f959f682-88bf-46fd-b330-3f3ca3ad1faa for instance 3df06136-2b41-44b8-a0ab-79390c2d7d96 on nch1-master-1 Jan 15 21:20:08.280786 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-96bb887d-b559-48ae-8c21-d552d6e87e0b req-cf1d3901-61d7-4e09-9962-51c2c6997b25 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.214879 Jan 15 21:20:08.281650 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3452/6893] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:20:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 21:20:08.943884 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-69de069a-ed6c-41ab-a2f4-a5cdf25bfd30 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:20:08.944504 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-69de069a-ed6c-41ab-a2f4-a5cdf25bfd30 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: ae51bd6b-96a9-42fa-ad05-234547d3f5d3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:20:08.952315 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-69de069a-ed6c-41ab-a2f4-a5cdf25bfd30 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:08.953101 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-69de069a-ed6c-41ab-a2f4-a5cdf25bfd30 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:08.954160 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-69de069a-ed6c-41ab-a2f4-a5cdf25bfd30 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:08.954964 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-69de069a-ed6c-41ab-a2f4-a5cdf25bfd30 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:09.140396 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-69de069a-ed6c-41ab-a2f4-a5cdf25bfd30 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:20:09.149587 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-69de069a-ed6c-41ab-a2f4-a5cdf25bfd30 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/ae51bd6b-96a9-42fa-ad05-234547d3f5d3" status: 200 len: 1689 microversion: 2.1 time: 0.209972 Jan 15 21:20:09.150376 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3442/6894] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:20:08 2022] GET /compute/v2.1/servers/ae51bd6b-96a9-42fa-ad05-234547d3f5d3 => generated 1689 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:20:09.289454 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-3962bc97-130e-432f-b4d9-e678c1ac8d5b tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:20:09.290854 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-3962bc97-130e-432f-b4d9-e678c1ac8d5b tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] [instance: 3df06136-2b41-44b8-a0ab-79390c2d7d96] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:20:09.310107 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3962bc97-130e-432f-b4d9-e678c1ac8d5b tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:09.312408 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3962bc97-130e-432f-b4d9-e678c1ac8d5b tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:09.313402 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3962bc97-130e-432f-b4d9-e678c1ac8d5b tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:09.313992 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3962bc97-130e-432f-b4d9-e678c1ac8d5b tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:09.579175 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-3962bc97-130e-432f-b4d9-e678c1ac8d5b tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2d1c33594b4b508c6bf1cc7fd33784', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aca9c053ec54853934a057b46a98733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:20:09.596257 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-3962bc97-130e-432f-b4d9-e678c1ac8d5b tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] 10.222.0.46 "GET /compute/v2.1/servers/3df06136-2b41-44b8-a0ab-79390c2d7d96" status: 200 len: 1313 microversion: 2.1 time: 0.310887 Jan 15 21:20:09.597223 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3453/6895] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:20:09 2022] GET /compute/v2.1/servers/3df06136-2b41-44b8-a0ab-79390c2d7d96 => generated 1313 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:20:10.168560 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-100ed91e-ba5c-4419-aa56-022830bd1bae tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:20:10.174865 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-100ed91e-ba5c-4419-aa56-022830bd1bae tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: ae51bd6b-96a9-42fa-ad05-234547d3f5d3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:20:10.183226 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-100ed91e-ba5c-4419-aa56-022830bd1bae tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:10.184076 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-100ed91e-ba5c-4419-aa56-022830bd1bae tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:10.184988 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-100ed91e-ba5c-4419-aa56-022830bd1bae tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:10.185448 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-100ed91e-ba5c-4419-aa56-022830bd1bae tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:10.386299 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-100ed91e-ba5c-4419-aa56-022830bd1bae tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:20:10.395696 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-100ed91e-ba5c-4419-aa56-022830bd1bae tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/ae51bd6b-96a9-42fa-ad05-234547d3f5d3" status: 200 len: 1689 microversion: 2.1 time: 0.230910 Jan 15 21:20:10.397698 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3443/6896] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:20:10 2022] GET /compute/v2.1/servers/ae51bd6b-96a9-42fa-ad05-234547d3f5d3 => generated 1689 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:20:10.615130 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c74a6d85-7ae7-4a30-b84f-f154941eda45 tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:20:10.615740 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c74a6d85-7ae7-4a30-b84f-f154941eda45 tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] [instance: 3df06136-2b41-44b8-a0ab-79390c2d7d96] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:20:10.625244 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c74a6d85-7ae7-4a30-b84f-f154941eda45 tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:10.625787 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c74a6d85-7ae7-4a30-b84f-f154941eda45 tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:10.626657 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c74a6d85-7ae7-4a30-b84f-f154941eda45 tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:10.627164 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c74a6d85-7ae7-4a30-b84f-f154941eda45 tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:10.825914 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-c74a6d85-7ae7-4a30-b84f-f154941eda45 tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2d1c33594b4b508c6bf1cc7fd33784', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aca9c053ec54853934a057b46a98733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:20:10.835023 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c74a6d85-7ae7-4a30-b84f-f154941eda45 tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] 10.222.0.46 "GET /compute/v2.1/servers/3df06136-2b41-44b8-a0ab-79390c2d7d96" status: 200 len: 1496 microversion: 2.1 time: 0.224290 Jan 15 21:20:10.836288 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3454/6897] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:20:10 2022] GET /compute/v2.1/servers/3df06136-2b41-44b8-a0ab-79390c2d7d96 => generated 1496 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:20:11.417779 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-535380f2-c09b-4408-a0fa-aee25f534e99 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:20:11.419067 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-535380f2-c09b-4408-a0fa-aee25f534e99 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: ae51bd6b-96a9-42fa-ad05-234547d3f5d3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:20:11.430802 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-535380f2-c09b-4408-a0fa-aee25f534e99 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:11.431273 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-535380f2-c09b-4408-a0fa-aee25f534e99 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:11.435277 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-535380f2-c09b-4408-a0fa-aee25f534e99 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:11.435958 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-535380f2-c09b-4408-a0fa-aee25f534e99 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:11.801714 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-535380f2-c09b-4408-a0fa-aee25f534e99 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:20:11.810614 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-535380f2-c09b-4408-a0fa-aee25f534e99 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/ae51bd6b-96a9-42fa-ad05-234547d3f5d3" status: 200 len: 1689 microversion: 2.1 time: 0.397324 Jan 15 21:20:11.811313 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3444/6898] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:20:11 2022] GET /compute/v2.1/servers/ae51bd6b-96a9-42fa-ad05-234547d3f5d3 => generated 1689 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:20:12.829070 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e56f5753-50d9-45be-862c-7eab910b59b4 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:20:12.830530 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e56f5753-50d9-45be-862c-7eab910b59b4 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: ae51bd6b-96a9-42fa-ad05-234547d3f5d3] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:20:12.849173 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e56f5753-50d9-45be-862c-7eab910b59b4 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:12.849633 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e56f5753-50d9-45be-862c-7eab910b59b4 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:12.850449 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e56f5753-50d9-45be-862c-7eab910b59b4 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:12.850894 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e56f5753-50d9-45be-862c-7eab910b59b4 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:13.335265 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-e56f5753-50d9-45be-862c-7eab910b59b4 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:20:13.351786 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e56f5753-50d9-45be-862c-7eab910b59b4 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/ae51bd6b-96a9-42fa-ad05-234547d3f5d3" status: 200 len: 1689 microversion: 2.1 time: 0.526866 Jan 15 21:20:13.374501 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3455/6899] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:20:12 2022] GET /compute/v2.1/servers/ae51bd6b-96a9-42fa-ad05-234547d3f5d3 => generated 1689 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:20:13.828984 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-095a99c3-1368-494a-b8b2-e4d21350d063 tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:20:13.833689 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-095a99c3-1368-494a-b8b2-e4d21350d063 tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] [instance: 3df06136-2b41-44b8-a0ab-79390c2d7d96] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:20:13.850561 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-095a99c3-1368-494a-b8b2-e4d21350d063 tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:13.851328 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-095a99c3-1368-494a-b8b2-e4d21350d063 tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:13.852365 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-095a99c3-1368-494a-b8b2-e4d21350d063 tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:13.853012 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-095a99c3-1368-494a-b8b2-e4d21350d063 tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:13.888872 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-095a99c3-1368-494a-b8b2-e4d21350d063 tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] [instance: 3df06136-2b41-44b8-a0ab-79390c2d7d96] Going to try to terminate instance {{(pid=129365) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 21:20:13.978107 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-095a99c3-1368-494a-b8b2-e4d21350d063 tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] 10.222.0.46 "DELETE /compute/v2.1/servers/3df06136-2b41-44b8-a0ab-79390c2d7d96" status: 204 len: 0 microversion: 2.1 time: 0.154894 Jan 15 21:20:13.978589 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3445/6900] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 21:20:13 2022] DELETE /compute/v2.1/servers/3df06136-2b41-44b8-a0ab-79390c2d7d96 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 21:20:13.986885 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-5b123c87-fd0a-440b-a6b8-77f8d3e723ef tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:20:13.987496 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-5b123c87-fd0a-440b-a6b8-77f8d3e723ef tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] [instance: 3df06136-2b41-44b8-a0ab-79390c2d7d96] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:20:13.995698 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5b123c87-fd0a-440b-a6b8-77f8d3e723ef tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:13.996150 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5b123c87-fd0a-440b-a6b8-77f8d3e723ef tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:13.997056 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5b123c87-fd0a-440b-a6b8-77f8d3e723ef tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:13.997497 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5b123c87-fd0a-440b-a6b8-77f8d3e723ef tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:14.150831 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-5b123c87-fd0a-440b-a6b8-77f8d3e723ef tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2d1c33594b4b508c6bf1cc7fd33784', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aca9c053ec54853934a057b46a98733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:20:14.174557 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-5b123c87-fd0a-440b-a6b8-77f8d3e723ef tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] 10.222.0.46 "GET /compute/v2.1/servers/3df06136-2b41-44b8-a0ab-79390c2d7d96" status: 200 len: 1502 microversion: 2.1 time: 0.181785 Jan 15 21:20:14.175250 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3456/6901] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:20:13 2022] GET /compute/v2.1/servers/3df06136-2b41-44b8-a0ab-79390c2d7d96 => generated 1502 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:20:14.383150 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-4ed158f5-8fb0-4778-90df-8baa44769044 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:20:14.384353 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-4ed158f5-8fb0-4778-90df-8baa44769044 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: ae51bd6b-96a9-42fa-ad05-234547d3f5d3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:20:14.392424 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4ed158f5-8fb0-4778-90df-8baa44769044 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:14.393136 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4ed158f5-8fb0-4778-90df-8baa44769044 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:14.394027 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4ed158f5-8fb0-4778-90df-8baa44769044 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:14.396770 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4ed158f5-8fb0-4778-90df-8baa44769044 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:14.557076 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-4ed158f5-8fb0-4778-90df-8baa44769044 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:20:14.564540 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-4ed158f5-8fb0-4778-90df-8baa44769044 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/ae51bd6b-96a9-42fa-ad05-234547d3f5d3" status: 200 len: 1695 microversion: 2.1 time: 0.186875 Jan 15 21:20:14.565186 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3446/6902] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:20:14 2022] GET /compute/v2.1/servers/ae51bd6b-96a9-42fa-ad05-234547d3f5d3 => generated 1695 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:20:15.193350 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-64e3dc77-90c4-4d4c-b7d7-0eb45339bb8d tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:20:15.195541 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-64e3dc77-90c4-4d4c-b7d7-0eb45339bb8d tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] [instance: 3df06136-2b41-44b8-a0ab-79390c2d7d96] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:20:15.203481 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-64e3dc77-90c4-4d4c-b7d7-0eb45339bb8d tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:15.204314 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-64e3dc77-90c4-4d4c-b7d7-0eb45339bb8d tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:15.205385 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-64e3dc77-90c4-4d4c-b7d7-0eb45339bb8d tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:15.206045 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-64e3dc77-90c4-4d4c-b7d7-0eb45339bb8d tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:15.420512 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-64e3dc77-90c4-4d4c-b7d7-0eb45339bb8d tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2d1c33594b4b508c6bf1cc7fd33784', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aca9c053ec54853934a057b46a98733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:20:15.430033 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-64e3dc77-90c4-4d4c-b7d7-0eb45339bb8d tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] 10.222.0.46 "GET /compute/v2.1/servers/3df06136-2b41-44b8-a0ab-79390c2d7d96" status: 200 len: 1502 microversion: 2.1 time: 0.240917 Jan 15 21:20:15.430823 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3457/6903] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:20:15 2022] GET /compute/v2.1/servers/3df06136-2b41-44b8-a0ab-79390c2d7d96 => generated 1502 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:20:15.583046 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-662b84e8-5ba8-41f1-af17-dfa139141377 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:20:15.583723 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-662b84e8-5ba8-41f1-af17-dfa139141377 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: ae51bd6b-96a9-42fa-ad05-234547d3f5d3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:20:15.591588 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-662b84e8-5ba8-41f1-af17-dfa139141377 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:15.592254 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-662b84e8-5ba8-41f1-af17-dfa139141377 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:15.593225 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-662b84e8-5ba8-41f1-af17-dfa139141377 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:15.593673 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-662b84e8-5ba8-41f1-af17-dfa139141377 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:16.112833 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-662b84e8-5ba8-41f1-af17-dfa139141377 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:20:16.123974 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-662b84e8-5ba8-41f1-af17-dfa139141377 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/ae51bd6b-96a9-42fa-ad05-234547d3f5d3" status: 200 len: 1695 microversion: 2.1 time: 0.544935 Jan 15 21:20:16.125777 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3447/6904] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:20:15 2022] GET /compute/v2.1/servers/ae51bd6b-96a9-42fa-ad05-234547d3f5d3 => generated 1695 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:20:16.417022 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-533a04f3-2498-4ad0-a0c1-7bdeac97db47 req-0c1d4fb8-1311-4ddb-b94f-fb8bb07adce3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3df06136-2b41-44b8-a0ab-79390c2d7d96", "name": "network-vif-deleted", "tag": "f959f682-88bf-46fd-b330-3f3ca3ad1faa"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:20:16.419189 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:20:16.419189 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:20:16.435633 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-533a04f3-2498-4ad0-a0c1-7bdeac97db47 req-0c1d4fb8-1311-4ddb-b94f-fb8bb07adce3 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:16.436435 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-533a04f3-2498-4ad0-a0c1-7bdeac97db47 req-0c1d4fb8-1311-4ddb-b94f-fb8bb07adce3 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:16.447317 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-1519cae8-2f0a-4e3c-9d19-7601f44b5b5f tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:20:16.448422 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-1519cae8-2f0a-4e3c-9d19-7601f44b5b5f tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] [instance: 3df06136-2b41-44b8-a0ab-79390c2d7d96] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:20:16.464164 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1519cae8-2f0a-4e3c-9d19-7601f44b5b5f tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:16.473858 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1519cae8-2f0a-4e3c-9d19-7601f44b5b5f tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:16.474755 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1519cae8-2f0a-4e3c-9d19-7601f44b5b5f tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:16.475203 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1519cae8-2f0a-4e3c-9d19-7601f44b5b5f tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:16.494994 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-533a04f3-2498-4ad0-a0c1-7bdeac97db47 req-0c1d4fb8-1311-4ddb-b94f-fb8bb07adce3 service nova] Creating event network-vif-deleted:f959f682-88bf-46fd-b330-3f3ca3ad1faa for instance 3df06136-2b41-44b8-a0ab-79390c2d7d96 on nch1-master-1 Jan 15 21:20:16.507447 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-533a04f3-2498-4ad0-a0c1-7bdeac97db47 req-0c1d4fb8-1311-4ddb-b94f-fb8bb07adce3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093590 Jan 15 21:20:16.508784 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3458/6905] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:20:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 21:20:16.590679 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-1519cae8-2f0a-4e3c-9d19-7601f44b5b5f tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2d1c33594b4b508c6bf1cc7fd33784', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aca9c053ec54853934a057b46a98733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:20:16.598699 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-1519cae8-2f0a-4e3c-9d19-7601f44b5b5f tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] 10.222.0.46 "GET /compute/v2.1/servers/3df06136-2b41-44b8-a0ab-79390c2d7d96" status: 200 len: 1298 microversion: 2.1 time: 0.154882 Jan 15 21:20:16.599403 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3448/6906] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:20:16 2022] GET /compute/v2.1/servers/3df06136-2b41-44b8-a0ab-79390c2d7d96 => generated 1298 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:20:17.142842 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7ec3dca2-8bcb-4146-8efb-9ac48640178d tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:20:17.143558 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-7ec3dca2-8bcb-4146-8efb-9ac48640178d tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: ae51bd6b-96a9-42fa-ad05-234547d3f5d3] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:20:17.153426 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7ec3dca2-8bcb-4146-8efb-9ac48640178d tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:17.154015 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7ec3dca2-8bcb-4146-8efb-9ac48640178d tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:17.154919 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7ec3dca2-8bcb-4146-8efb-9ac48640178d tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:17.155437 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7ec3dca2-8bcb-4146-8efb-9ac48640178d tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:17.403081 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-7ec3dca2-8bcb-4146-8efb-9ac48640178d tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:20:17.423985 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7ec3dca2-8bcb-4146-8efb-9ac48640178d tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/ae51bd6b-96a9-42fa-ad05-234547d3f5d3" status: 200 len: 1680 microversion: 2.1 time: 0.281303 Jan 15 21:20:17.425647 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3459/6907] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:20:17 2022] GET /compute/v2.1/servers/ae51bd6b-96a9-42fa-ad05-234547d3f5d3 => generated 1680 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:20:17.617130 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2a0383a7-1162-4496-a8f1-e931c5ffac80 tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:20:17.618610 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-2a0383a7-1162-4496-a8f1-e931c5ffac80 tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] [instance: 3df06136-2b41-44b8-a0ab-79390c2d7d96] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:20:17.630248 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2a0383a7-1162-4496-a8f1-e931c5ffac80 tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:17.630720 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2a0383a7-1162-4496-a8f1-e931c5ffac80 tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:17.631543 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2a0383a7-1162-4496-a8f1-e931c5ffac80 tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:17.631994 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2a0383a7-1162-4496-a8f1-e931c5ffac80 tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:17.651600 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-2a0383a7-1162-4496-a8f1-e931c5ffac80 tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] HTTP exception thrown: Instance 3df06136-2b41-44b8-a0ab-79390c2d7d96 could not be found. Jan 15 21:20:17.654683 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2a0383a7-1162-4496-a8f1-e931c5ffac80 tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] Returning 404 to user: Instance 3df06136-2b41-44b8-a0ab-79390c2d7d96 could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:20:17.655733 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2a0383a7-1162-4496-a8f1-e931c5ffac80 tempest-VolumesActionsTest-1908025685 tempest-VolumesActionsTest-1908025685-project] 10.222.0.46 "GET /compute/v2.1/servers/3df06136-2b41-44b8-a0ab-79390c2d7d96" status: 404 len: 111 microversion: 2.1 time: 0.043695 Jan 15 21:20:17.656627 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3449/6908] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:20:17 2022] GET /compute/v2.1/servers/3df06136-2b41-44b8-a0ab-79390c2d7d96 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:20:17.773555 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-ec2d2825-183f-40fa-a42a-c913b9ec8cba req-832741b4-5251-4513-8acc-8c906e5308de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae51bd6b-96a9-42fa-ad05-234547d3f5d3", "name": "network-vif-unplugged", "status": "completed", "tag": "8a3eca19-0e64-45e1-ba8b-83d5de1d3c69"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:20:17.775658 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:20:17.775658 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:20:17.796582 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-ec2d2825-183f-40fa-a42a-c913b9ec8cba req-832741b4-5251-4513-8acc-8c906e5308de service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:17.798616 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-ec2d2825-183f-40fa-a42a-c913b9ec8cba req-832741b4-5251-4513-8acc-8c906e5308de service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:17.824563 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-ec2d2825-183f-40fa-a42a-c913b9ec8cba req-832741b4-5251-4513-8acc-8c906e5308de service nova] Creating event network-vif-unplugged:8a3eca19-0e64-45e1-ba8b-83d5de1d3c69 for instance ae51bd6b-96a9-42fa-ad05-234547d3f5d3 on nch2-master-1 Jan 15 21:20:17.829776 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-ec2d2825-183f-40fa-a42a-c913b9ec8cba req-832741b4-5251-4513-8acc-8c906e5308de service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.064096 Jan 15 21:20:17.830631 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3460/6909] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:20:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:20:21.190042 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2fd80827-0a1c-4842-bc9b-81ba53faf175 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:20:21.194588 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:20:21.194588 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:20:21.196250 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2fd80827-0a1c-4842-bc9b-81ba53faf175 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:21.196714 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2fd80827-0a1c-4842-bc9b-81ba53faf175 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:21.197586 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2fd80827-0a1c-4842-bc9b-81ba53faf175 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:21.198038 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2fd80827-0a1c-4842-bc9b-81ba53faf175 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:21.229884 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2fd80827-0a1c-4842-bc9b-81ba53faf175 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] 10.222.0.46 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 613 microversion: 2.1 time: 0.202980 Jan 15 21:20:21.231018 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3450/6910] 10.222.0.46 () {58 vars in 1184 bytes} [Sat Jan 15 21:20:21 2022] GET /compute/v2.1/os-availability-zone/detail => generated 613 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:20:21.350612 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f7c4803b-63ed-431a-a8f8-5d44383ecd82 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1435913057", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "availability_zone": "nova:nch2-master-1", "networks": [{"uuid": "3450f0ec-f58a-4422-a96d-dbc93e487db1"}]}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:20:21.437052 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.network.neutron [None req-f7c4803b-63ed-431a-a8f8-5d44383ecd82 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] validate_networks() for [('3450f0ec-f58a-4422-a96d-dbc93e487db1', None, None, None, None, None)] {{(pid=129366) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 21:20:21.554555 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-caac766c-56b7-46ae-8d42-d86421f789d9 req-e802acc3-bb4f-4b7b-8fd2-3d7779223021 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae51bd6b-96a9-42fa-ad05-234547d3f5d3", "name": "network-vif-plugged", "status": "completed", "tag": "8a3eca19-0e64-45e1-ba8b-83d5de1d3c69"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:20:21.556435 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:20:21.556435 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:20:21.568034 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-caac766c-56b7-46ae-8d42-d86421f789d9 req-e802acc3-bb4f-4b7b-8fd2-3d7779223021 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:21.568545 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-caac766c-56b7-46ae-8d42-d86421f789d9 req-e802acc3-bb4f-4b7b-8fd2-3d7779223021 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:21.602816 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-caac766c-56b7-46ae-8d42-d86421f789d9 req-e802acc3-bb4f-4b7b-8fd2-3d7779223021 service nova] Creating event network-vif-plugged:8a3eca19-0e64-45e1-ba8b-83d5de1d3c69 for instance ae51bd6b-96a9-42fa-ad05-234547d3f5d3 on nch2-master-1 Jan 15 21:20:21.610029 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-caac766c-56b7-46ae-8d42-d86421f789d9 req-e802acc3-bb4f-4b7b-8fd2-3d7779223021 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061031 Jan 15 21:20:21.610644 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3451/6911] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:20:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 21:20:21.907988 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-f7c4803b-63ed-431a-a8f8-5d44383ecd82 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Flavor limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 21:20:21.908555 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-f7c4803b-63ed-431a-a8f8-5d44383ecd82 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Image limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 21:20:21.909525 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-f7c4803b-63ed-431a-a8f8-5d44383ecd82 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Flavor pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 21:20:21.910560 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-f7c4803b-63ed-431a-a8f8-5d44383ecd82 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Image pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 21:20:21.911379 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-f7c4803b-63ed-431a-a8f8-5d44383ecd82 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 21:20:21.923483 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f7c4803b-63ed-431a-a8f8-5d44383ecd82 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:21.924177 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f7c4803b-63ed-431a-a8f8-5d44383ecd82 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:21.925445 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f7c4803b-63ed-431a-a8f8-5d44383ecd82 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:21.927152 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f7c4803b-63ed-431a-a8f8-5d44383ecd82 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:21.948303 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-f7c4803b-63ed-431a-a8f8-5d44383ecd82 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Getting quotas for project be87d54300704fa8a180845f0ae0701b. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:20:21.955852 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-f7c4803b-63ed-431a-a8f8-5d44383ecd82 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Getting quotas for user d3db2b76852d42c1ab1a48493e26615a and project be87d54300704fa8a180845f0ae0701b. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:20:21.970653 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f7c4803b-63ed-431a-a8f8-5d44383ecd82 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Going to run 1 instances... {{(pid=129366) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 21:20:21.974101 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f7c4803b-63ed-431a-a8f8-5d44383ecd82 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] [instance: 7533b876-6474-4cfa-9241-116dd4f6502b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 21:20:22.027197 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f7c4803b-63ed-431a-a8f8-5d44383ecd82 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.682508 Jan 15 21:20:22.028442 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3461/6912] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 21:20:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 685 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 21:20:22.040534 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-739e9a2b-ddb5-44ff-8beb-cc6edfd6a866 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:20:22.046090 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-739e9a2b-ddb5-44ff-8beb-cc6edfd6a866 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] [instance: 7533b876-6474-4cfa-9241-116dd4f6502b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:20:22.064872 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d1ff8e51-b6f2-486c-a1a5-592ea347b4ca tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:20:22.065464 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-d1ff8e51-b6f2-486c-a1a5-592ea347b4ca tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: 2cd6a61c-b80b-4d1d-989d-f402b88a355e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:20:22.076918 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d1ff8e51-b6f2-486c-a1a5-592ea347b4ca tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:22.077621 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d1ff8e51-b6f2-486c-a1a5-592ea347b4ca tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:22.078581 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d1ff8e51-b6f2-486c-a1a5-592ea347b4ca tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:22.079197 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d1ff8e51-b6f2-486c-a1a5-592ea347b4ca tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:22.137188 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-d1ff8e51-b6f2-486c-a1a5-592ea347b4ca tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: 2cd6a61c-b80b-4d1d-989d-f402b88a355e] Going to try to terminate instance {{(pid=129366) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 21:20:22.155016 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-739e9a2b-ddb5-44ff-8beb-cc6edfd6a866 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/7533b876-6474-4cfa-9241-116dd4f6502b" status: 200 len: 1329 microversion: 2.1 time: 0.119702 Jan 15 21:20:22.161060 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3452/6913] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:20:22 2022] GET /compute/v2.1/servers/7533b876-6474-4cfa-9241-116dd4f6502b => generated 1329 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:20:22.267750 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d1ff8e51-b6f2-486c-a1a5-592ea347b4ca tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] 10.222.0.46 "DELETE /compute/v2.1/servers/2cd6a61c-b80b-4d1d-989d-f402b88a355e" status: 204 len: 0 microversion: 2.1 time: 0.207585 Jan 15 21:20:22.268435 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3462/6914] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 21:20:22 2022] DELETE /compute/v2.1/servers/2cd6a61c-b80b-4d1d-989d-f402b88a355e => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 15 21:20:22.278076 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c4e5dffd-0e3d-4f44-b004-2b8c6111239e tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:20:22.279289 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c4e5dffd-0e3d-4f44-b004-2b8c6111239e tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: 2cd6a61c-b80b-4d1d-989d-f402b88a355e] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:20:22.287611 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c4e5dffd-0e3d-4f44-b004-2b8c6111239e tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:22.288085 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c4e5dffd-0e3d-4f44-b004-2b8c6111239e tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:22.289155 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c4e5dffd-0e3d-4f44-b004-2b8c6111239e tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:22.289619 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c4e5dffd-0e3d-4f44-b004-2b8c6111239e tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:22.530547 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-c4e5dffd-0e3d-4f44-b004-2b8c6111239e tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fc1955b0d446458f8f355550de971b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ae6f05c2843469190cd96f39ac794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:20:22.544376 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c4e5dffd-0e3d-4f44-b004-2b8c6111239e tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] 10.222.0.46 "GET /compute/v2.1/servers/2cd6a61c-b80b-4d1d-989d-f402b88a355e" status: 200 len: 1411 microversion: 2.1 time: 0.269973 Jan 15 21:20:22.545546 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3453/6915] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:20:22 2022] GET /compute/v2.1/servers/2cd6a61c-b80b-4d1d-989d-f402b88a355e => generated 1411 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:20:23.174432 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-67caa605-efae-4235-82c4-43766c83120f tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:20:23.175131 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-67caa605-efae-4235-82c4-43766c83120f tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] [instance: 7533b876-6474-4cfa-9241-116dd4f6502b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:20:23.182393 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-67caa605-efae-4235-82c4-43766c83120f tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:23.182836 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-67caa605-efae-4235-82c4-43766c83120f tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:23.183854 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-67caa605-efae-4235-82c4-43766c83120f tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:23.184527 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-67caa605-efae-4235-82c4-43766c83120f tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:23.264865 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-67caa605-efae-4235-82c4-43766c83120f tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/7533b876-6474-4cfa-9241-116dd4f6502b" status: 200 len: 1416 microversion: 2.1 time: 0.094324 Jan 15 21:20:23.265597 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3463/6916] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:20:23 2022] GET /compute/v2.1/servers/7533b876-6474-4cfa-9241-116dd4f6502b => generated 1416 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:20:23.563448 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8a6ef00d-1592-47ab-a5f0-45f98afab11d tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:20:23.564788 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-8a6ef00d-1592-47ab-a5f0-45f98afab11d tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: 2cd6a61c-b80b-4d1d-989d-f402b88a355e] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:20:23.574664 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8a6ef00d-1592-47ab-a5f0-45f98afab11d tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:23.575635 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8a6ef00d-1592-47ab-a5f0-45f98afab11d tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:23.576704 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8a6ef00d-1592-47ab-a5f0-45f98afab11d tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:23.577398 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8a6ef00d-1592-47ab-a5f0-45f98afab11d tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:23.733894 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-8a6ef00d-1592-47ab-a5f0-45f98afab11d tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fc1955b0d446458f8f355550de971b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ae6f05c2843469190cd96f39ac794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:20:23.743994 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-8a6ef00d-1592-47ab-a5f0-45f98afab11d tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] 10.222.0.46 "GET /compute/v2.1/servers/2cd6a61c-b80b-4d1d-989d-f402b88a355e" status: 200 len: 1411 microversion: 2.1 time: 0.184022 Jan 15 21:20:23.745279 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3454/6917] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:20:23 2022] GET /compute/v2.1/servers/2cd6a61c-b80b-4d1d-989d-f402b88a355e => generated 1411 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:20:24.282751 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-12aa3732-a018-4ac4-bbd7-33194307168d tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:20:24.283367 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-12aa3732-a018-4ac4-bbd7-33194307168d tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] [instance: 7533b876-6474-4cfa-9241-116dd4f6502b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:20:24.303180 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-12aa3732-a018-4ac4-bbd7-33194307168d tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:24.303643 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-12aa3732-a018-4ac4-bbd7-33194307168d tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:24.304766 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-12aa3732-a018-4ac4-bbd7-33194307168d tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:24.305656 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-12aa3732-a018-4ac4-bbd7-33194307168d tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:24.575864 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-12aa3732-a018-4ac4-bbd7-33194307168d tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/7533b876-6474-4cfa-9241-116dd4f6502b" status: 200 len: 1464 microversion: 2.1 time: 0.296491 Jan 15 21:20:24.577333 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3464/6918] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:20:24 2022] GET /compute/v2.1/servers/7533b876-6474-4cfa-9241-116dd4f6502b => generated 1464 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:20:24.779049 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c923d18d-53db-446d-b3db-e1e1ad6d2824 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:20:24.779729 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c923d18d-53db-446d-b3db-e1e1ad6d2824 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: 2cd6a61c-b80b-4d1d-989d-f402b88a355e] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:20:24.798480 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c923d18d-53db-446d-b3db-e1e1ad6d2824 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:24.799776 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c923d18d-53db-446d-b3db-e1e1ad6d2824 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:24.800868 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c923d18d-53db-446d-b3db-e1e1ad6d2824 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:24.801955 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c923d18d-53db-446d-b3db-e1e1ad6d2824 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:24.876126 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-c923d18d-53db-446d-b3db-e1e1ad6d2824 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fc1955b0d446458f8f355550de971b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ae6f05c2843469190cd96f39ac794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:20:24.886324 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c923d18d-53db-446d-b3db-e1e1ad6d2824 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] 10.222.0.46 "GET /compute/v2.1/servers/2cd6a61c-b80b-4d1d-989d-f402b88a355e" status: 200 len: 1369 microversion: 2.1 time: 0.127888 Jan 15 21:20:24.887317 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3455/6919] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:20:24 2022] GET /compute/v2.1/servers/2cd6a61c-b80b-4d1d-989d-f402b88a355e => generated 1369 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:20:24.897421 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-bda69d54-7fcd-4bed-80aa-919aaa4a0194 req-85c00fbf-47ad-4410-b348-ce2694313be9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cd6a61c-b80b-4d1d-989d-f402b88a355e", "name": "network-vif-deleted", "tag": "96b7e3c2-4582-40bc-b5cb-c0d74adbdb24"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:20:24.899604 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:20:24.899604 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:20:24.914050 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-bda69d54-7fcd-4bed-80aa-919aaa4a0194 req-85c00fbf-47ad-4410-b348-ce2694313be9 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:24.916750 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-bda69d54-7fcd-4bed-80aa-919aaa4a0194 req-85c00fbf-47ad-4410-b348-ce2694313be9 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:24.936564 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-bda69d54-7fcd-4bed-80aa-919aaa4a0194 req-85c00fbf-47ad-4410-b348-ce2694313be9 service nova] Creating event network-vif-deleted:96b7e3c2-4582-40bc-b5cb-c0d74adbdb24 for instance 2cd6a61c-b80b-4d1d-989d-f402b88a355e on nch1-master-1 Jan 15 21:20:24.943489 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-bda69d54-7fcd-4bed-80aa-919aaa4a0194 req-85c00fbf-47ad-4410-b348-ce2694313be9 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050160 Jan 15 21:20:24.944322 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3465/6920] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:20:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:20:25.596940 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-0462f865-3141-4504-b05e-23b81caaba50 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:20:25.599702 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-0462f865-3141-4504-b05e-23b81caaba50 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] [instance: 7533b876-6474-4cfa-9241-116dd4f6502b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:20:25.612002 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0462f865-3141-4504-b05e-23b81caaba50 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:25.612964 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0462f865-3141-4504-b05e-23b81caaba50 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:25.614936 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0462f865-3141-4504-b05e-23b81caaba50 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:25.615720 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0462f865-3141-4504-b05e-23b81caaba50 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:25.904982 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-0462f865-3141-4504-b05e-23b81caaba50 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/7533b876-6474-4cfa-9241-116dd4f6502b" status: 200 len: 1464 microversion: 2.1 time: 0.313960 Jan 15 21:20:25.906154 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3456/6921] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:20:25 2022] GET /compute/v2.1/servers/7533b876-6474-4cfa-9241-116dd4f6502b => generated 1464 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:20:25.920018 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c0cf77ba-f858-44d5-aa79-20ffe8ccbd40 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:20:25.923484 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c0cf77ba-f858-44d5-aa79-20ffe8ccbd40 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: 2cd6a61c-b80b-4d1d-989d-f402b88a355e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:20:25.934233 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c0cf77ba-f858-44d5-aa79-20ffe8ccbd40 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:25.934621 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c0cf77ba-f858-44d5-aa79-20ffe8ccbd40 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:25.935404 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c0cf77ba-f858-44d5-aa79-20ffe8ccbd40 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:25.935995 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c0cf77ba-f858-44d5-aa79-20ffe8ccbd40 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:25.967721 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-c0cf77ba-f858-44d5-aa79-20ffe8ccbd40 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] HTTP exception thrown: Instance 2cd6a61c-b80b-4d1d-989d-f402b88a355e could not be found. Jan 15 21:20:25.969169 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c0cf77ba-f858-44d5-aa79-20ffe8ccbd40 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Returning 404 to user: Instance 2cd6a61c-b80b-4d1d-989d-f402b88a355e could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:20:25.970327 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c0cf77ba-f858-44d5-aa79-20ffe8ccbd40 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] 10.222.0.46 "GET /compute/v2.1/servers/2cd6a61c-b80b-4d1d-989d-f402b88a355e" status: 404 len: 111 microversion: 2.1 time: 0.065576 Jan 15 21:20:25.970942 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3466/6922] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:20:25 2022] GET /compute/v2.1/servers/2cd6a61c-b80b-4d1d-989d-f402b88a355e => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:20:26.925219 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b682f4b6-1bd2-4a42-870d-c6007841d9c7 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:20:26.926451 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b682f4b6-1bd2-4a42-870d-c6007841d9c7 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] [instance: 7533b876-6474-4cfa-9241-116dd4f6502b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:20:26.933278 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b682f4b6-1bd2-4a42-870d-c6007841d9c7 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:26.933748 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b682f4b6-1bd2-4a42-870d-c6007841d9c7 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:26.934551 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b682f4b6-1bd2-4a42-870d-c6007841d9c7 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:26.935003 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b682f4b6-1bd2-4a42-870d-c6007841d9c7 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:26.964125 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-ec3d9880-d580-49db-9710-c6d50be2b73b req-c287f0d9-13a0-4325-b07f-61313fc8c491 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7533b876-6474-4cfa-9241-116dd4f6502b", "tag": "130ab256-0e99-430b-8dc1-e4ea192596b6"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:20:26.965659 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:20:26.965659 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:20:26.973726 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-ec3d9880-d580-49db-9710-c6d50be2b73b req-c287f0d9-13a0-4325-b07f-61313fc8c491 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:26.974169 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-ec3d9880-d580-49db-9710-c6d50be2b73b req-c287f0d9-13a0-4325-b07f-61313fc8c491 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:26.985630 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-ec3d9880-d580-49db-9710-c6d50be2b73b req-c287f0d9-13a0-4325-b07f-61313fc8c491 service nova] Creating event network-changed:130ab256-0e99-430b-8dc1-e4ea192596b6 for instance 7533b876-6474-4cfa-9241-116dd4f6502b on nch2-master-1 Jan 15 21:20:26.991211 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-ec3d9880-d580-49db-9710-c6d50be2b73b req-c287f0d9-13a0-4325-b07f-61313fc8c491 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030608 Jan 15 21:20:26.991813 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3467/6923] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:20:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 21:20:27.067252 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b682f4b6-1bd2-4a42-870d-c6007841d9c7 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/7533b876-6474-4cfa-9241-116dd4f6502b" status: 200 len: 1464 microversion: 2.1 time: 0.147473 Jan 15 21:20:27.067792 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3457/6924] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:20:26 2022] GET /compute/v2.1/servers/7533b876-6474-4cfa-9241-116dd4f6502b => generated 1464 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:20:27.072363 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-535ea59f-4cff-411b-81c9-d795100fce9f tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:20:27.072984 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-535ea59f-4cff-411b-81c9-d795100fce9f tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: 86b8c510-27f4-4f20-ad7f-fe8df0ed4869] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:20:27.081942 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-535ea59f-4cff-411b-81c9-d795100fce9f tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:27.081942 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-535ea59f-4cff-411b-81c9-d795100fce9f tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:27.082192 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-535ea59f-4cff-411b-81c9-d795100fce9f tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:27.082780 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-535ea59f-4cff-411b-81c9-d795100fce9f tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:27.096132 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-535ea59f-4cff-411b-81c9-d795100fce9f tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] HTTP exception thrown: Instance 86b8c510-27f4-4f20-ad7f-fe8df0ed4869 could not be found. Jan 15 21:20:27.096712 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-535ea59f-4cff-411b-81c9-d795100fce9f tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Returning 404 to user: Instance 86b8c510-27f4-4f20-ad7f-fe8df0ed4869 could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:20:27.098119 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-535ea59f-4cff-411b-81c9-d795100fce9f tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] 10.222.0.46 "DELETE /compute/v2.1/servers/86b8c510-27f4-4f20-ad7f-fe8df0ed4869" status: 404 len: 111 microversion: 2.1 time: 0.029450 Jan 15 21:20:27.098676 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3468/6925] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 21:20:27 2022] DELETE /compute/v2.1/servers/86b8c510-27f4-4f20-ad7f-fe8df0ed4869 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:20:27.106766 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-87e3ac12-55af-4956-8cf3-540239e78970 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:20:27.107393 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-87e3ac12-55af-4956-8cf3-540239e78970 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: 86b8c510-27f4-4f20-ad7f-fe8df0ed4869] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:20:27.114282 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-87e3ac12-55af-4956-8cf3-540239e78970 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:27.114736 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-87e3ac12-55af-4956-8cf3-540239e78970 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:27.115528 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-87e3ac12-55af-4956-8cf3-540239e78970 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:27.115970 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-87e3ac12-55af-4956-8cf3-540239e78970 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:27.129224 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-87e3ac12-55af-4956-8cf3-540239e78970 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] HTTP exception thrown: Instance 86b8c510-27f4-4f20-ad7f-fe8df0ed4869 could not be found. Jan 15 21:20:27.129829 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-87e3ac12-55af-4956-8cf3-540239e78970 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Returning 404 to user: Instance 86b8c510-27f4-4f20-ad7f-fe8df0ed4869 could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:20:27.130818 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-87e3ac12-55af-4956-8cf3-540239e78970 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] 10.222.0.46 "GET /compute/v2.1/servers/86b8c510-27f4-4f20-ad7f-fe8df0ed4869" status: 404 len: 111 microversion: 2.1 time: 0.027761 Jan 15 21:20:27.131365 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3458/6926] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:20:27 2022] GET /compute/v2.1/servers/86b8c510-27f4-4f20-ad7f-fe8df0ed4869 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:20:27.699639 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f6ea58b2-ac7c-4995-bb01-803861894d06 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:20:27.700360 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f6ea58b2-ac7c-4995-bb01-803861894d06 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: 2cd6a61c-b80b-4d1d-989d-f402b88a355e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:20:27.710941 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f6ea58b2-ac7c-4995-bb01-803861894d06 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:27.711373 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f6ea58b2-ac7c-4995-bb01-803861894d06 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:27.712178 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f6ea58b2-ac7c-4995-bb01-803861894d06 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:27.712616 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f6ea58b2-ac7c-4995-bb01-803861894d06 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:27.731976 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-f6ea58b2-ac7c-4995-bb01-803861894d06 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] HTTP exception thrown: Instance 2cd6a61c-b80b-4d1d-989d-f402b88a355e could not be found. Jan 15 21:20:27.733674 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f6ea58b2-ac7c-4995-bb01-803861894d06 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Returning 404 to user: Instance 2cd6a61c-b80b-4d1d-989d-f402b88a355e could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:20:27.735937 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f6ea58b2-ac7c-4995-bb01-803861894d06 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] 10.222.0.46 "DELETE /compute/v2.1/servers/2cd6a61c-b80b-4d1d-989d-f402b88a355e" status: 404 len: 111 microversion: 2.1 time: 0.039528 Jan 15 21:20:27.736570 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3469/6927] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 21:20:27 2022] DELETE /compute/v2.1/servers/2cd6a61c-b80b-4d1d-989d-f402b88a355e => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:20:27.745161 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-00e97032-fbe5-4a83-86b8-2a89c73a9b23 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:20:27.745569 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-00e97032-fbe5-4a83-86b8-2a89c73a9b23 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: 2cd6a61c-b80b-4d1d-989d-f402b88a355e] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:20:27.751843 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-00e97032-fbe5-4a83-86b8-2a89c73a9b23 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:27.752604 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-00e97032-fbe5-4a83-86b8-2a89c73a9b23 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:27.754579 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-00e97032-fbe5-4a83-86b8-2a89c73a9b23 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:27.755133 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-00e97032-fbe5-4a83-86b8-2a89c73a9b23 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:27.770778 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-00e97032-fbe5-4a83-86b8-2a89c73a9b23 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] HTTP exception thrown: Instance 2cd6a61c-b80b-4d1d-989d-f402b88a355e could not be found. Jan 15 21:20:27.771765 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-00e97032-fbe5-4a83-86b8-2a89c73a9b23 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Returning 404 to user: Instance 2cd6a61c-b80b-4d1d-989d-f402b88a355e could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:20:27.772707 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-00e97032-fbe5-4a83-86b8-2a89c73a9b23 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] 10.222.0.46 "GET /compute/v2.1/servers/2cd6a61c-b80b-4d1d-989d-f402b88a355e" status: 404 len: 111 microversion: 2.1 time: 0.031713 Jan 15 21:20:27.776545 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3459/6928] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:20:27 2022] GET /compute/v2.1/servers/2cd6a61c-b80b-4d1d-989d-f402b88a355e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:20:27.840273 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-debeff8a-3b94-420d-99bd-11ebca61aaa1 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Action: 'create', calling method: .version_select at 0x7f30c8685d30>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-441039095"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:20:27.854408 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-debeff8a-3b94-420d-99bd-11ebca61aaa1 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Getting quotas for project 7f2ae6f05c2843469190cd96f39ac794. Resources: {'key_pairs'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:20:27.859499 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-debeff8a-3b94-420d-99bd-11ebca61aaa1 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Getting quotas for user f0fc1955b0d446458f8f355550de971b and project 7f2ae6f05c2843469190cd96f39ac794. Resources: {'key_pairs'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:20:28.078636 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-debeff8a-3b94-420d-99bd-11ebca61aaa1 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Getting quotas for project 7f2ae6f05c2843469190cd96f39ac794. Resources: {'key_pairs'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:20:28.083864 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9957069b-1715-450d-bda8-0423c13ba131 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:20:28.084479 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-9957069b-1715-450d-bda8-0423c13ba131 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] [instance: 7533b876-6474-4cfa-9241-116dd4f6502b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:20:28.084724 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-debeff8a-3b94-420d-99bd-11ebca61aaa1 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Getting quotas for user f0fc1955b0d446458f8f355550de971b and project 7f2ae6f05c2843469190cd96f39ac794. Resources: {'key_pairs'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:20:28.091349 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9957069b-1715-450d-bda8-0423c13ba131 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:28.091762 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9957069b-1715-450d-bda8-0423c13ba131 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:28.092548 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9957069b-1715-450d-bda8-0423c13ba131 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:28.093027 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9957069b-1715-450d-bda8-0423c13ba131 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:28.099622 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-debeff8a-3b94-420d-99bd-11ebca61aaa1 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 0.263900 Jan 15 21:20:28.100566 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3470/6929] 10.222.0.46 () {60 vars in 1157 bytes} [Sat Jan 15 21:20:27 2022] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:20:28.283504 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-9957069b-1715-450d-bda8-0423c13ba131 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/7533b876-6474-4cfa-9241-116dd4f6502b" status: 200 len: 1464 microversion: 2.1 time: 0.203278 Jan 15 21:20:28.284372 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3460/6930] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:20:28 2022] GET /compute/v2.1/servers/7533b876-6474-4cfa-9241-116dd4f6502b => generated 1464 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:20:29.301859 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e6f391c1-e332-4949-90b2-e262075f9fc3 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:20:29.302553 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e6f391c1-e332-4949-90b2-e262075f9fc3 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] [instance: 7533b876-6474-4cfa-9241-116dd4f6502b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:20:29.309648 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e6f391c1-e332-4949-90b2-e262075f9fc3 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:29.310310 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e6f391c1-e332-4949-90b2-e262075f9fc3 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:29.311090 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e6f391c1-e332-4949-90b2-e262075f9fc3 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:29.311631 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e6f391c1-e332-4949-90b2-e262075f9fc3 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:29.475134 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e6f391c1-e332-4949-90b2-e262075f9fc3 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/7533b876-6474-4cfa-9241-116dd4f6502b" status: 200 len: 1464 microversion: 2.1 time: 0.177969 Jan 15 21:20:29.475989 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3471/6931] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:20:29 2022] GET /compute/v2.1/servers/7533b876-6474-4cfa-9241-116dd4f6502b => generated 1464 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:20:30.492499 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d0eb01d7-2338-4fca-a3ec-a5eeae520ca1 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:20:30.493145 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d0eb01d7-2338-4fca-a3ec-a5eeae520ca1 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] [instance: 7533b876-6474-4cfa-9241-116dd4f6502b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:20:30.500117 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d0eb01d7-2338-4fca-a3ec-a5eeae520ca1 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:30.500931 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d0eb01d7-2338-4fca-a3ec-a5eeae520ca1 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:30.501737 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d0eb01d7-2338-4fca-a3ec-a5eeae520ca1 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:30.502183 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d0eb01d7-2338-4fca-a3ec-a5eeae520ca1 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:30.640632 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d0eb01d7-2338-4fca-a3ec-a5eeae520ca1 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/7533b876-6474-4cfa-9241-116dd4f6502b" status: 200 len: 1464 microversion: 2.1 time: 0.152921 Jan 15 21:20:30.641314 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3461/6932] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:20:30 2022] GET /compute/v2.1/servers/7533b876-6474-4cfa-9241-116dd4f6502b => generated 1464 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:20:30.782722 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9264964c-055a-4dec-8df9-d6d72ec03388 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1725910327", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-441039095", "security_groups": [{"name": "tempest-secgroup-smoke-1645086404"}], "block_device_mapping_v2": [{"uuid": "dbdfa075-f51a-46ac-b2a2-565a50bd7426", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "250ac663-a6c2-4755-b702-91a1aec1e824"}]}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:20:30.910068 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.network.neutron [None req-9264964c-055a-4dec-8df9-d6d72ec03388 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] validate_networks() for [('250ac663-a6c2-4755-b702-91a1aec1e824', None, None, None, None, None)] {{(pid=129366) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 21:20:31.309338 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-9264964c-055a-4dec-8df9-d6d72ec03388 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Flavor limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 21:20:31.309838 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-9264964c-055a-4dec-8df9-d6d72ec03388 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Image limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 21:20:31.310324 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-9264964c-055a-4dec-8df9-d6d72ec03388 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Flavor pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 21:20:31.310730 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-9264964c-055a-4dec-8df9-d6d72ec03388 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Image pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 21:20:31.311139 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-9264964c-055a-4dec-8df9-d6d72ec03388 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 21:20:31.321210 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9264964c-055a-4dec-8df9-d6d72ec03388 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:31.321662 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9264964c-055a-4dec-8df9-d6d72ec03388 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:31.322473 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9264964c-055a-4dec-8df9-d6d72ec03388 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:31.322902 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9264964c-055a-4dec-8df9-d6d72ec03388 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:31.341576 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-9264964c-055a-4dec-8df9-d6d72ec03388 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Getting quotas for project 7f2ae6f05c2843469190cd96f39ac794. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:20:31.346756 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-9264964c-055a-4dec-8df9-d6d72ec03388 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Getting quotas for user f0fc1955b0d446458f8f355550de971b and project 7f2ae6f05c2843469190cd96f39ac794. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:20:31.413718 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-9264964c-055a-4dec-8df9-d6d72ec03388 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Going to run 1 instances... {{(pid=129366) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 21:20:31.416166 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-9264964c-055a-4dec-8df9-d6d72ec03388 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: b4f980ed-4669-4cfc-b196-aecea77de875] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='dbdfa075-f51a-46ac-b2a2-565a50bd7426',volume_size=None,volume_type=None)] {{(pid=129366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 21:20:31.588515 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-9264964c-055a-4dec-8df9-d6d72ec03388 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.809362 Jan 15 21:20:31.589535 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3472/6933] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 21:20:30 2022] POST /compute/v2.1/servers => generated 406 bytes in 811 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 21:20:31.604294 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-25960bc0-06f0-4421-b26a-a52f374fa350 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:20:31.605127 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-25960bc0-06f0-4421-b26a-a52f374fa350 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: b4f980ed-4669-4cfc-b196-aecea77de875] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:20:31.658276 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-efd1c977-71b5-4bba-955a-8b6112b185d8 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:20:31.659327 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-efd1c977-71b5-4bba-955a-8b6112b185d8 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] [instance: 7533b876-6474-4cfa-9241-116dd4f6502b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:20:31.667024 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-efd1c977-71b5-4bba-955a-8b6112b185d8 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:31.667551 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-efd1c977-71b5-4bba-955a-8b6112b185d8 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:31.668443 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-efd1c977-71b5-4bba-955a-8b6112b185d8 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:31.669048 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-efd1c977-71b5-4bba-955a-8b6112b185d8 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:31.678201 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-25960bc0-06f0-4421-b26a-a52f374fa350 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fc1955b0d446458f8f355550de971b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ae6f05c2843469190cd96f39ac794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:20:31.689156 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-25960bc0-06f0-4421-b26a-a52f374fa350 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] 10.222.0.46 "GET /compute/v2.1/servers/b4f980ed-4669-4cfc-b196-aecea77de875" status: 200 len: 1094 microversion: 2.1 time: 0.089245 Jan 15 21:20:31.692999 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3462/6934] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:20:31 2022] GET /compute/v2.1/servers/b4f980ed-4669-4cfc-b196-aecea77de875 => generated 1094 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:20:31.701738 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-e57c951b-8de0-408d-b697-cb4b12de2643 req-8f8de9bc-6255-4cca-bdcb-6d81388408c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7533b876-6474-4cfa-9241-116dd4f6502b", "name": "network-vif-plugged", "status": "completed", "tag": "130ab256-0e99-430b-8dc1-e4ea192596b6"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:20:31.710120 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:20:31.710120 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:20:31.730026 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-e57c951b-8de0-408d-b697-cb4b12de2643 req-8f8de9bc-6255-4cca-bdcb-6d81388408c1 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:31.730723 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-e57c951b-8de0-408d-b697-cb4b12de2643 req-8f8de9bc-6255-4cca-bdcb-6d81388408c1 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:31.744129 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-e57c951b-8de0-408d-b697-cb4b12de2643 req-8f8de9bc-6255-4cca-bdcb-6d81388408c1 service nova] Creating event network-vif-plugged:130ab256-0e99-430b-8dc1-e4ea192596b6 for instance 7533b876-6474-4cfa-9241-116dd4f6502b on nch2-master-1 Jan 15 21:20:31.750630 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-e57c951b-8de0-408d-b697-cb4b12de2643 req-8f8de9bc-6255-4cca-bdcb-6d81388408c1 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055703 Jan 15 21:20:31.751417 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3463/6935] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:20:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:20:31.865009 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-efd1c977-71b5-4bba-955a-8b6112b185d8 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/7533b876-6474-4cfa-9241-116dd4f6502b" status: 200 len: 1464 microversion: 2.1 time: 0.210302 Jan 15 21:20:31.868903 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3473/6936] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:20:31 2022] GET /compute/v2.1/servers/7533b876-6474-4cfa-9241-116dd4f6502b => generated 1464 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:20:32.709872 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-0e6702a0-81d3-45fc-a9a7-98752b29eb36 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:20:32.710724 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-0e6702a0-81d3-45fc-a9a7-98752b29eb36 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: b4f980ed-4669-4cfc-b196-aecea77de875] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:20:32.717921 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0e6702a0-81d3-45fc-a9a7-98752b29eb36 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:32.718503 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0e6702a0-81d3-45fc-a9a7-98752b29eb36 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:32.719593 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0e6702a0-81d3-45fc-a9a7-98752b29eb36 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:32.719987 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0e6702a0-81d3-45fc-a9a7-98752b29eb36 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:32.783465 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-0e6702a0-81d3-45fc-a9a7-98752b29eb36 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fc1955b0d446458f8f355550de971b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ae6f05c2843469190cd96f39ac794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:20:32.792692 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-0e6702a0-81d3-45fc-a9a7-98752b29eb36 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] 10.222.0.46 "GET /compute/v2.1/servers/b4f980ed-4669-4cfc-b196-aecea77de875" status: 200 len: 1210 microversion: 2.1 time: 0.087347 Jan 15 21:20:32.801895 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3464/6937] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:20:32 2022] GET /compute/v2.1/servers/b4f980ed-4669-4cfc-b196-aecea77de875 => generated 1210 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:20:32.883405 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9ba95987-6c02-49e4-b15c-34d1c7c34c62 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:20:32.884241 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-9ba95987-6c02-49e4-b15c-34d1c7c34c62 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] [instance: 7533b876-6474-4cfa-9241-116dd4f6502b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:20:32.892572 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9ba95987-6c02-49e4-b15c-34d1c7c34c62 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:32.893315 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9ba95987-6c02-49e4-b15c-34d1c7c34c62 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:32.894660 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9ba95987-6c02-49e4-b15c-34d1c7c34c62 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:32.895250 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9ba95987-6c02-49e4-b15c-34d1c7c34c62 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:33.044439 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-9ba95987-6c02-49e4-b15c-34d1c7c34c62 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/7533b876-6474-4cfa-9241-116dd4f6502b" status: 200 len: 1464 microversion: 2.1 time: 0.165661 Jan 15 21:20:33.055008 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3474/6938] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:20:32 2022] GET /compute/v2.1/servers/7533b876-6474-4cfa-9241-116dd4f6502b => generated 1464 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:20:33.810598 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-bec83321-099a-4cc6-a86f-8caafc3ebc78 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:20:33.811340 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-bec83321-099a-4cc6-a86f-8caafc3ebc78 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: b4f980ed-4669-4cfc-b196-aecea77de875] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:20:33.819651 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bec83321-099a-4cc6-a86f-8caafc3ebc78 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:33.820506 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bec83321-099a-4cc6-a86f-8caafc3ebc78 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:33.821603 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bec83321-099a-4cc6-a86f-8caafc3ebc78 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:33.822263 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bec83321-099a-4cc6-a86f-8caafc3ebc78 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:33.988484 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-bec83321-099a-4cc6-a86f-8caafc3ebc78 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fc1955b0d446458f8f355550de971b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ae6f05c2843469190cd96f39ac794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:20:33.996449 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-bec83321-099a-4cc6-a86f-8caafc3ebc78 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] 10.222.0.46 "GET /compute/v2.1/servers/b4f980ed-4669-4cfc-b196-aecea77de875" status: 200 len: 1278 microversion: 2.1 time: 0.189617 Jan 15 21:20:33.997307 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3465/6939] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:20:33 2022] GET /compute/v2.1/servers/b4f980ed-4669-4cfc-b196-aecea77de875 => generated 1278 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:20:34.062375 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f7bdc88d-1711-4bf0-a88c-1dacb27f8437 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:20:34.063295 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f7bdc88d-1711-4bf0-a88c-1dacb27f8437 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] [instance: 7533b876-6474-4cfa-9241-116dd4f6502b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:20:34.071321 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f7bdc88d-1711-4bf0-a88c-1dacb27f8437 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:34.071909 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f7bdc88d-1711-4bf0-a88c-1dacb27f8437 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:34.073073 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f7bdc88d-1711-4bf0-a88c-1dacb27f8437 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:34.073608 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f7bdc88d-1711-4bf0-a88c-1dacb27f8437 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:34.161610 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-51fd35cc-c96a-4d81-92b7-80530cebff2a req-3b18bb5d-71e3-47aa-a209-5c930f47618d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4f980ed-4669-4cfc-b196-aecea77de875", "tag": "f70df7d5-47e6-45b0-9a91-605cfa5f5d33"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:20:34.163886 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:20:34.163886 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:20:34.187785 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-51fd35cc-c96a-4d81-92b7-80530cebff2a req-3b18bb5d-71e3-47aa-a209-5c930f47618d service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:34.188431 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-51fd35cc-c96a-4d81-92b7-80530cebff2a req-3b18bb5d-71e3-47aa-a209-5c930f47618d service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:34.214417 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-51fd35cc-c96a-4d81-92b7-80530cebff2a req-3b18bb5d-71e3-47aa-a209-5c930f47618d service nova] Creating event network-changed:f70df7d5-47e6-45b0-9a91-605cfa5f5d33 for instance b4f980ed-4669-4cfc-b196-aecea77de875 on nch1-master-1 Jan 15 21:20:34.220334 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-51fd35cc-c96a-4d81-92b7-80530cebff2a req-3b18bb5d-71e3-47aa-a209-5c930f47618d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063048 Jan 15 21:20:34.221934 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3466/6940] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:20:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:20:34.246364 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f7bdc88d-1711-4bf0-a88c-1dacb27f8437 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/7533b876-6474-4cfa-9241-116dd4f6502b" status: 200 len: 1649 microversion: 2.1 time: 0.187614 Jan 15 21:20:34.247071 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3475/6941] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:20:34 2022] GET /compute/v2.1/servers/7533b876-6474-4cfa-9241-116dd4f6502b => generated 1649 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:20:34.263779 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-091be6a9-bd9a-47dd-b1d5-432b3ad37348 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:20:34.264501 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-091be6a9-bd9a-47dd-b1d5-432b3ad37348 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] [instance: 7533b876-6474-4cfa-9241-116dd4f6502b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:20:34.272588 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-091be6a9-bd9a-47dd-b1d5-432b3ad37348 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:34.273097 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-091be6a9-bd9a-47dd-b1d5-432b3ad37348 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:34.274041 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-091be6a9-bd9a-47dd-b1d5-432b3ad37348 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:34.274570 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-091be6a9-bd9a-47dd-b1d5-432b3ad37348 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:34.514249 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-091be6a9-bd9a-47dd-b1d5-432b3ad37348 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/7533b876-6474-4cfa-9241-116dd4f6502b" status: 200 len: 1649 microversion: 2.1 time: 0.254445 Jan 15 21:20:34.515325 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3467/6942] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:20:34 2022] GET /compute/v2.1/servers/7533b876-6474-4cfa-9241-116dd4f6502b => generated 1649 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:20:34.531200 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f4dde75e-6926-40e1-a378-8e3f67b3e730 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:20:34.531724 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f4dde75e-6926-40e1-a378-8e3f67b3e730 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] [instance: 7533b876-6474-4cfa-9241-116dd4f6502b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:20:34.540728 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f4dde75e-6926-40e1-a378-8e3f67b3e730 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:34.541211 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f4dde75e-6926-40e1-a378-8e3f67b3e730 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:34.542469 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f4dde75e-6926-40e1-a378-8e3f67b3e730 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:34.542906 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f4dde75e-6926-40e1-a378-8e3f67b3e730 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:34.704729 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f4dde75e-6926-40e1-a378-8e3f67b3e730 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/7533b876-6474-4cfa-9241-116dd4f6502b" status: 200 len: 1649 microversion: 2.1 time: 0.177759 Jan 15 21:20:34.709710 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3476/6943] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:20:34 2022] GET /compute/v2.1/servers/7533b876-6474-4cfa-9241-116dd4f6502b => generated 1649 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:20:34.760420 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-06d20ada-2778-4919-9110-a1c43b722e77 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1402271820", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "availability_zone": "nova:nch1-master-1", "networks": [{"uuid": "3450f0ec-f58a-4422-a96d-dbc93e487db1"}]}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:20:34.820287 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.network.neutron [None req-06d20ada-2778-4919-9110-a1c43b722e77 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] validate_networks() for [('3450f0ec-f58a-4422-a96d-dbc93e487db1', None, None, None, None, None)] {{(pid=129365) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 21:20:35.013171 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-cf38c626-ccb2-4ec4-b6aa-dea9f10b52db tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:20:35.013785 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-cf38c626-ccb2-4ec4-b6aa-dea9f10b52db tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: b4f980ed-4669-4cfc-b196-aecea77de875] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:20:35.020650 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cf38c626-ccb2-4ec4-b6aa-dea9f10b52db tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:35.021162 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cf38c626-ccb2-4ec4-b6aa-dea9f10b52db tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:35.021979 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cf38c626-ccb2-4ec4-b6aa-dea9f10b52db tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:35.022422 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cf38c626-ccb2-4ec4-b6aa-dea9f10b52db tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:35.399777 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-06d20ada-2778-4919-9110-a1c43b722e77 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Flavor limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 21:20:35.400203 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-06d20ada-2778-4919-9110-a1c43b722e77 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Image limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 21:20:35.400686 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-06d20ada-2778-4919-9110-a1c43b722e77 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Flavor pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 21:20:35.401146 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-06d20ada-2778-4919-9110-a1c43b722e77 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Image pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 21:20:35.401570 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-06d20ada-2778-4919-9110-a1c43b722e77 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 21:20:35.405791 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-cf38c626-ccb2-4ec4-b6aa-dea9f10b52db tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fc1955b0d446458f8f355550de971b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ae6f05c2843469190cd96f39ac794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:20:35.413586 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-06d20ada-2778-4919-9110-a1c43b722e77 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:35.414051 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-06d20ada-2778-4919-9110-a1c43b722e77 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:35.414876 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-06d20ada-2778-4919-9110-a1c43b722e77 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:35.414987 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-cf38c626-ccb2-4ec4-b6aa-dea9f10b52db tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] 10.222.0.46 "GET /compute/v2.1/servers/b4f980ed-4669-4cfc-b196-aecea77de875" status: 200 len: 1266 microversion: 2.1 time: 0.405342 Jan 15 21:20:35.415327 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-06d20ada-2778-4919-9110-a1c43b722e77 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:35.415853 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3477/6944] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:20:35 2022] GET /compute/v2.1/servers/b4f980ed-4669-4cfc-b196-aecea77de875 => generated 1266 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:20:35.434166 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-06d20ada-2778-4919-9110-a1c43b722e77 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Getting quotas for project be87d54300704fa8a180845f0ae0701b. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:20:35.440550 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-06d20ada-2778-4919-9110-a1c43b722e77 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Getting quotas for user d3db2b76852d42c1ab1a48493e26615a and project be87d54300704fa8a180845f0ae0701b. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:20:35.454729 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-06d20ada-2778-4919-9110-a1c43b722e77 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Going to run 1 instances... {{(pid=129365) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 21:20:35.457415 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-06d20ada-2778-4919-9110-a1c43b722e77 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] [instance: d1ad319f-a3a5-4bb8-953d-8edb75ab161d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129365) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 21:20:35.522399 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-06d20ada-2778-4919-9110-a1c43b722e77 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.765553 Jan 15 21:20:35.523068 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3468/6945] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 21:20:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 767 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 21:20:35.532871 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b5e7ff8f-8826-4b7b-9f96-c24f2f5d4631 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:20:35.533480 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b5e7ff8f-8826-4b7b-9f96-c24f2f5d4631 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] [instance: d1ad319f-a3a5-4bb8-953d-8edb75ab161d] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:20:35.593143 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b5e7ff8f-8826-4b7b-9f96-c24f2f5d4631 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/d1ad319f-a3a5-4bb8-953d-8edb75ab161d" status: 200 len: 1329 microversion: 2.1 time: 0.063863 Jan 15 21:20:35.595716 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3478/6946] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:20:35 2022] GET /compute/v2.1/servers/d1ad319f-a3a5-4bb8-953d-8edb75ab161d => generated 1329 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:20:36.435165 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-73455458-29ca-4342-99e4-634034636bd5 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:20:36.436013 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-73455458-29ca-4342-99e4-634034636bd5 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: b4f980ed-4669-4cfc-b196-aecea77de875] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:20:36.444267 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-73455458-29ca-4342-99e4-634034636bd5 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:36.444781 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-73455458-29ca-4342-99e4-634034636bd5 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:36.445924 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-73455458-29ca-4342-99e4-634034636bd5 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:36.446343 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-73455458-29ca-4342-99e4-634034636bd5 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:36.610700 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0f6143f9-a146-4982-a873-32596e8eebbd tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:20:36.611971 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-0f6143f9-a146-4982-a873-32596e8eebbd tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] [instance: d1ad319f-a3a5-4bb8-953d-8edb75ab161d] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:20:36.621086 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0f6143f9-a146-4982-a873-32596e8eebbd tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:36.621544 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0f6143f9-a146-4982-a873-32596e8eebbd tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:36.622326 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0f6143f9-a146-4982-a873-32596e8eebbd tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:36.623043 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0f6143f9-a146-4982-a873-32596e8eebbd tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:36.663401 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-73455458-29ca-4342-99e4-634034636bd5 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fc1955b0d446458f8f355550de971b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ae6f05c2843469190cd96f39ac794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:20:36.671645 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-73455458-29ca-4342-99e4-634034636bd5 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] 10.222.0.46 "GET /compute/v2.1/servers/b4f980ed-4669-4cfc-b196-aecea77de875" status: 200 len: 1266 microversion: 2.1 time: 0.242135 Jan 15 21:20:36.672882 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3469/6947] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:20:36 2022] GET /compute/v2.1/servers/b4f980ed-4669-4cfc-b196-aecea77de875 => generated 1266 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:20:36.720622 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0f6143f9-a146-4982-a873-32596e8eebbd tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/d1ad319f-a3a5-4bb8-953d-8edb75ab161d" status: 200 len: 1422 microversion: 2.1 time: 0.113926 Jan 15 21:20:36.721802 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3479/6948] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:20:36 2022] GET /compute/v2.1/servers/d1ad319f-a3a5-4bb8-953d-8edb75ab161d => generated 1422 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:20:37.689242 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c16fbce0-e3f1-4944-b94b-d25eae09f7dc tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:20:37.689891 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c16fbce0-e3f1-4944-b94b-d25eae09f7dc tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: b4f980ed-4669-4cfc-b196-aecea77de875] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:20:37.696829 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c16fbce0-e3f1-4944-b94b-d25eae09f7dc tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:37.697325 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c16fbce0-e3f1-4944-b94b-d25eae09f7dc tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:37.698113 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c16fbce0-e3f1-4944-b94b-d25eae09f7dc tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:37.698565 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c16fbce0-e3f1-4944-b94b-d25eae09f7dc tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:37.735516 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-44518097-bdb3-4413-b2ea-8a4db2cb1950 req-6e4bbdee-5c41-42b7-9504-a3e3e8e4772d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1ad319f-a3a5-4bb8-953d-8edb75ab161d", "tag": "c37b0a50-dc89-4e76-a351-eaa8132da409"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:20:37.739293 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:20:37.739293 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:20:37.760752 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-44518097-bdb3-4413-b2ea-8a4db2cb1950 req-6e4bbdee-5c41-42b7-9504-a3e3e8e4772d service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:37.761237 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-44518097-bdb3-4413-b2ea-8a4db2cb1950 req-6e4bbdee-5c41-42b7-9504-a3e3e8e4772d service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:37.774706 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-44518097-bdb3-4413-b2ea-8a4db2cb1950 req-6e4bbdee-5c41-42b7-9504-a3e3e8e4772d service nova] Creating event network-changed:c37b0a50-dc89-4e76-a351-eaa8132da409 for instance d1ad319f-a3a5-4bb8-953d-8edb75ab161d on nch1-master-1 Jan 15 21:20:37.780063 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-44518097-bdb3-4413-b2ea-8a4db2cb1950 req-6e4bbdee-5c41-42b7-9504-a3e3e8e4772d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048460 Jan 15 21:20:37.780941 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3480/6949] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:20:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 21:20:37.792914 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4b92b752-c0b7-461c-af83-ddcaf240e677 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:20:37.793846 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-4b92b752-c0b7-461c-af83-ddcaf240e677 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] [instance: d1ad319f-a3a5-4bb8-953d-8edb75ab161d] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:20:37.801563 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4b92b752-c0b7-461c-af83-ddcaf240e677 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:37.802269 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4b92b752-c0b7-461c-af83-ddcaf240e677 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:37.803261 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4b92b752-c0b7-461c-af83-ddcaf240e677 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:37.803871 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4b92b752-c0b7-461c-af83-ddcaf240e677 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:37.852904 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-c16fbce0-e3f1-4944-b94b-d25eae09f7dc tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fc1955b0d446458f8f355550de971b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ae6f05c2843469190cd96f39ac794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:20:37.861120 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c16fbce0-e3f1-4944-b94b-d25eae09f7dc tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] 10.222.0.46 "GET /compute/v2.1/servers/b4f980ed-4669-4cfc-b196-aecea77de875" status: 200 len: 1266 microversion: 2.1 time: 0.175515 Jan 15 21:20:37.872446 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3470/6950] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:20:37 2022] GET /compute/v2.1/servers/b4f980ed-4669-4cfc-b196-aecea77de875 => generated 1266 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:20:37.955987 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-4b92b752-c0b7-461c-af83-ddcaf240e677 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/d1ad319f-a3a5-4bb8-953d-8edb75ab161d" status: 200 len: 1464 microversion: 2.1 time: 0.173589 Jan 15 21:20:37.957622 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3481/6951] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:20:37 2022] GET /compute/v2.1/servers/d1ad319f-a3a5-4bb8-953d-8edb75ab161d => generated 1464 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:20:38.879871 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-6640a3ac-0456-4044-bf72-4a3ae31c7619 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:20:38.880393 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-6640a3ac-0456-4044-bf72-4a3ae31c7619 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: b4f980ed-4669-4cfc-b196-aecea77de875] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:20:38.887187 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6640a3ac-0456-4044-bf72-4a3ae31c7619 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:38.887658 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6640a3ac-0456-4044-bf72-4a3ae31c7619 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:38.888452 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6640a3ac-0456-4044-bf72-4a3ae31c7619 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:38.888930 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6640a3ac-0456-4044-bf72-4a3ae31c7619 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:38.973636 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-2929a74d-03b0-474e-831e-b140e44ebbda tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:20:38.974764 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-2929a74d-03b0-474e-831e-b140e44ebbda tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] [instance: d1ad319f-a3a5-4bb8-953d-8edb75ab161d] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:20:38.981789 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2929a74d-03b0-474e-831e-b140e44ebbda tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:38.982247 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2929a74d-03b0-474e-831e-b140e44ebbda tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:38.983042 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2929a74d-03b0-474e-831e-b140e44ebbda tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:38.983484 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2929a74d-03b0-474e-831e-b140e44ebbda tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:39.034573 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-6640a3ac-0456-4044-bf72-4a3ae31c7619 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fc1955b0d446458f8f355550de971b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ae6f05c2843469190cd96f39ac794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:20:39.042190 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-6640a3ac-0456-4044-bf72-4a3ae31c7619 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] 10.222.0.46 "GET /compute/v2.1/servers/b4f980ed-4669-4cfc-b196-aecea77de875" status: 200 len: 1266 microversion: 2.1 time: 0.166574 Jan 15 21:20:39.042861 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3471/6952] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:20:38 2022] GET /compute/v2.1/servers/b4f980ed-4669-4cfc-b196-aecea77de875 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:20:39.115059 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-2929a74d-03b0-474e-831e-b140e44ebbda tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/d1ad319f-a3a5-4bb8-953d-8edb75ab161d" status: 200 len: 1464 microversion: 2.1 time: 0.145545 Jan 15 21:20:39.115646 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3482/6953] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:20:38 2022] GET /compute/v2.1/servers/d1ad319f-a3a5-4bb8-953d-8edb75ab161d => generated 1464 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:20:40.059683 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a245e805-4d54-41b9-a79e-08b2daa93193 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:20:40.060328 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a245e805-4d54-41b9-a79e-08b2daa93193 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: b4f980ed-4669-4cfc-b196-aecea77de875] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:20:40.067983 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a245e805-4d54-41b9-a79e-08b2daa93193 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:40.068444 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a245e805-4d54-41b9-a79e-08b2daa93193 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:40.069294 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a245e805-4d54-41b9-a79e-08b2daa93193 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:40.069744 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a245e805-4d54-41b9-a79e-08b2daa93193 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:40.132885 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1cae2faf-c141-4cdb-8967-6e9ca65999f2 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:20:40.133759 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-1cae2faf-c141-4cdb-8967-6e9ca65999f2 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] [instance: d1ad319f-a3a5-4bb8-953d-8edb75ab161d] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:20:40.140722 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1cae2faf-c141-4cdb-8967-6e9ca65999f2 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:40.141282 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1cae2faf-c141-4cdb-8967-6e9ca65999f2 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:40.142307 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1cae2faf-c141-4cdb-8967-6e9ca65999f2 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:40.142811 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1cae2faf-c141-4cdb-8967-6e9ca65999f2 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:40.247337 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-a245e805-4d54-41b9-a79e-08b2daa93193 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fc1955b0d446458f8f355550de971b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ae6f05c2843469190cd96f39ac794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:20:40.257708 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a245e805-4d54-41b9-a79e-08b2daa93193 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] 10.222.0.46 "GET /compute/v2.1/servers/b4f980ed-4669-4cfc-b196-aecea77de875" status: 200 len: 1266 microversion: 2.1 time: 0.201649 Jan 15 21:20:40.258779 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3472/6954] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:20:40 2022] GET /compute/v2.1/servers/b4f980ed-4669-4cfc-b196-aecea77de875 => generated 1266 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:20:40.305959 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-d641d702-7a5f-406d-b176-0742503cd735 req-419d4d90-d1d6-4993-b290-744f1f23ffaa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4f980ed-4669-4cfc-b196-aecea77de875", "name": "network-vif-plugged", "status": "completed", "tag": "f70df7d5-47e6-45b0-9a91-605cfa5f5d33"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:20:40.307724 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:20:40.307724 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:20:40.317311 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-d641d702-7a5f-406d-b176-0742503cd735 req-419d4d90-d1d6-4993-b290-744f1f23ffaa service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:40.318423 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-d641d702-7a5f-406d-b176-0742503cd735 req-419d4d90-d1d6-4993-b290-744f1f23ffaa service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:40.319199 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-1cae2faf-c141-4cdb-8967-6e9ca65999f2 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/d1ad319f-a3a5-4bb8-953d-8edb75ab161d" status: 200 len: 1464 microversion: 2.1 time: 0.190727 Jan 15 21:20:40.320328 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3483/6955] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:20:40 2022] GET /compute/v2.1/servers/d1ad319f-a3a5-4bb8-953d-8edb75ab161d => generated 1464 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:20:40.330767 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-d641d702-7a5f-406d-b176-0742503cd735 req-419d4d90-d1d6-4993-b290-744f1f23ffaa service nova] Creating event network-vif-plugged:f70df7d5-47e6-45b0-9a91-605cfa5f5d33 for instance b4f980ed-4669-4cfc-b196-aecea77de875 on nch1-master-1 Jan 15 21:20:40.335853 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-d641d702-7a5f-406d-b176-0742503cd735 req-419d4d90-d1d6-4993-b290-744f1f23ffaa service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033674 Jan 15 21:20:40.336462 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3473/6956] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:20:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:20:41.274608 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d1a05958-b581-4d5c-8eea-1d0da5f079ed tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:20:41.275211 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-d1a05958-b581-4d5c-8eea-1d0da5f079ed tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: b4f980ed-4669-4cfc-b196-aecea77de875] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:20:41.281988 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d1a05958-b581-4d5c-8eea-1d0da5f079ed tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:41.282443 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d1a05958-b581-4d5c-8eea-1d0da5f079ed tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:41.283219 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d1a05958-b581-4d5c-8eea-1d0da5f079ed tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:41.283962 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d1a05958-b581-4d5c-8eea-1d0da5f079ed tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:41.339113 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-34eb0497-01e6-4395-b26b-254ad6182b0c tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:20:41.339820 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-34eb0497-01e6-4395-b26b-254ad6182b0c tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] [instance: d1ad319f-a3a5-4bb8-953d-8edb75ab161d] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:20:41.346487 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-34eb0497-01e6-4395-b26b-254ad6182b0c tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:41.347458 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-34eb0497-01e6-4395-b26b-254ad6182b0c tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:41.348271 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-34eb0497-01e6-4395-b26b-254ad6182b0c tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:41.348736 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-34eb0497-01e6-4395-b26b-254ad6182b0c tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:41.461371 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-d1a05958-b581-4d5c-8eea-1d0da5f079ed tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fc1955b0d446458f8f355550de971b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ae6f05c2843469190cd96f39ac794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:20:41.469006 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d1a05958-b581-4d5c-8eea-1d0da5f079ed tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] 10.222.0.46 "GET /compute/v2.1/servers/b4f980ed-4669-4cfc-b196-aecea77de875" status: 200 len: 1266 microversion: 2.1 time: 0.198043 Jan 15 21:20:41.469625 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3484/6957] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:20:41 2022] GET /compute/v2.1/servers/b4f980ed-4669-4cfc-b196-aecea77de875 => generated 1266 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:20:41.526582 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-34eb0497-01e6-4395-b26b-254ad6182b0c tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/d1ad319f-a3a5-4bb8-953d-8edb75ab161d" status: 200 len: 1464 microversion: 2.1 time: 0.192434 Jan 15 21:20:41.527134 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3474/6958] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:20:41 2022] GET /compute/v2.1/servers/d1ad319f-a3a5-4bb8-953d-8edb75ab161d => generated 1464 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:20:42.361474 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-d2d7b4fa-95dc-41ac-84ba-0d4d127c68aa req-150adbcb-c4e6-4be4-a997-293e6745d164 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1ad319f-a3a5-4bb8-953d-8edb75ab161d", "name": "network-vif-plugged", "status": "completed", "tag": "c37b0a50-dc89-4e76-a351-eaa8132da409"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:20:42.363103 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:20:42.363103 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:20:42.370756 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-d2d7b4fa-95dc-41ac-84ba-0d4d127c68aa req-150adbcb-c4e6-4be4-a997-293e6745d164 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:42.371197 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-d2d7b4fa-95dc-41ac-84ba-0d4d127c68aa req-150adbcb-c4e6-4be4-a997-293e6745d164 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:42.382416 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-d2d7b4fa-95dc-41ac-84ba-0d4d127c68aa req-150adbcb-c4e6-4be4-a997-293e6745d164 service nova] Creating event network-vif-plugged:c37b0a50-dc89-4e76-a351-eaa8132da409 for instance d1ad319f-a3a5-4bb8-953d-8edb75ab161d on nch1-master-1 Jan 15 21:20:42.387204 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-d2d7b4fa-95dc-41ac-84ba-0d4d127c68aa req-150adbcb-c4e6-4be4-a997-293e6745d164 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029318 Jan 15 21:20:42.387846 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3485/6959] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:20:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:20:42.486251 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8bafd00b-be45-41bc-bf7d-a73e567b76ab tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:20:42.486875 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-8bafd00b-be45-41bc-bf7d-a73e567b76ab tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: b4f980ed-4669-4cfc-b196-aecea77de875] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:20:42.494371 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8bafd00b-be45-41bc-bf7d-a73e567b76ab tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:42.494838 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8bafd00b-be45-41bc-bf7d-a73e567b76ab tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:42.495698 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8bafd00b-be45-41bc-bf7d-a73e567b76ab tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:42.496149 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8bafd00b-be45-41bc-bf7d-a73e567b76ab tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:42.544610 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-333af581-750a-4dfe-aa7e-e03f0d879868 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:20:42.545652 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-333af581-750a-4dfe-aa7e-e03f0d879868 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] [instance: d1ad319f-a3a5-4bb8-953d-8edb75ab161d] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:20:42.552029 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-333af581-750a-4dfe-aa7e-e03f0d879868 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:42.552484 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-333af581-750a-4dfe-aa7e-e03f0d879868 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:42.553286 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-333af581-750a-4dfe-aa7e-e03f0d879868 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:42.553723 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-333af581-750a-4dfe-aa7e-e03f0d879868 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:42.665737 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-8bafd00b-be45-41bc-bf7d-a73e567b76ab tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fc1955b0d446458f8f355550de971b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ae6f05c2843469190cd96f39ac794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:20:42.673414 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-8bafd00b-be45-41bc-bf7d-a73e567b76ab tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] 10.222.0.46 "GET /compute/v2.1/servers/b4f980ed-4669-4cfc-b196-aecea77de875" status: 200 len: 1453 microversion: 2.1 time: 0.190957 Jan 15 21:20:42.674290 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3475/6960] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:20:42 2022] GET /compute/v2.1/servers/b4f980ed-4669-4cfc-b196-aecea77de875 => generated 1453 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:20:42.691841 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c58bfbfa-1640-4c3f-bffc-312271b6e13a tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:20:42.692469 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c58bfbfa-1640-4c3f-bffc-312271b6e13a tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: b4f980ed-4669-4cfc-b196-aecea77de875] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:20:42.698350 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c58bfbfa-1640-4c3f-bffc-312271b6e13a tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:42.698813 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c58bfbfa-1640-4c3f-bffc-312271b6e13a tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:42.699670 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c58bfbfa-1640-4c3f-bffc-312271b6e13a tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:42.700158 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c58bfbfa-1640-4c3f-bffc-312271b6e13a tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:42.713431 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-333af581-750a-4dfe-aa7e-e03f0d879868 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/d1ad319f-a3a5-4bb8-953d-8edb75ab161d" status: 200 len: 1464 microversion: 2.1 time: 0.172688 Jan 15 21:20:42.714329 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3486/6961] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:20:42 2022] GET /compute/v2.1/servers/d1ad319f-a3a5-4bb8-953d-8edb75ab161d => generated 1464 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:20:42.834573 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-c58bfbfa-1640-4c3f-bffc-312271b6e13a tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fc1955b0d446458f8f355550de971b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ae6f05c2843469190cd96f39ac794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:20:42.842009 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c58bfbfa-1640-4c3f-bffc-312271b6e13a tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] 10.222.0.46 "GET /compute/v2.1/servers/b4f980ed-4669-4cfc-b196-aecea77de875" status: 200 len: 1453 microversion: 2.1 time: 0.155009 Jan 15 21:20:42.842586 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3476/6962] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:20:42 2022] GET /compute/v2.1/servers/b4f980ed-4669-4cfc-b196-aecea77de875 => generated 1453 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:20:43.661262 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b57e403c-0dff-4406-be69-253a4a485be3 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:20:43.662199 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b57e403c-0dff-4406-be69-253a4a485be3 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: ae51bd6b-96a9-42fa-ad05-234547d3f5d3] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:20:43.669656 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b57e403c-0dff-4406-be69-253a4a485be3 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:43.670478 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b57e403c-0dff-4406-be69-253a4a485be3 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:43.671896 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b57e403c-0dff-4406-be69-253a4a485be3 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:43.672668 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b57e403c-0dff-4406-be69-253a4a485be3 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:43.731220 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2e07a348-23c4-4897-aef5-fc669d3725a8 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:20:43.732105 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-2e07a348-23c4-4897-aef5-fc669d3725a8 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] [instance: d1ad319f-a3a5-4bb8-953d-8edb75ab161d] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:20:43.734349 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b57e403c-0dff-4406-be69-253a4a485be3 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "POST /compute/v2.1/servers/ae51bd6b-96a9-42fa-ad05-234547d3f5d3/action" status: 200 len: 24562 microversion: 2.1 time: 0.077627 Jan 15 21:20:43.735818 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3487/6963] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:20:43 2022] POST /compute/v2.1/servers/ae51bd6b-96a9-42fa-ad05-234547d3f5d3/action => generated 24562 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:20:43.739923 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2e07a348-23c4-4897-aef5-fc669d3725a8 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:43.740680 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2e07a348-23c4-4897-aef5-fc669d3725a8 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:43.741606 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2e07a348-23c4-4897-aef5-fc669d3725a8 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:43.742283 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2e07a348-23c4-4897-aef5-fc669d3725a8 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:44.296675 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2e07a348-23c4-4897-aef5-fc669d3725a8 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/d1ad319f-a3a5-4bb8-953d-8edb75ab161d" status: 200 len: 1650 microversion: 2.1 time: 0.569229 Jan 15 21:20:44.297285 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3477/6964] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:20:43 2022] GET /compute/v2.1/servers/d1ad319f-a3a5-4bb8-953d-8edb75ab161d => generated 1650 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:20:44.314063 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f0ffff4c-730f-47fc-98d1-52c63984c46a tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:20:44.314756 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f0ffff4c-730f-47fc-98d1-52c63984c46a tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] [instance: d1ad319f-a3a5-4bb8-953d-8edb75ab161d] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:20:44.322238 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f0ffff4c-730f-47fc-98d1-52c63984c46a tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:44.322676 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f0ffff4c-730f-47fc-98d1-52c63984c46a tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:44.323460 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f0ffff4c-730f-47fc-98d1-52c63984c46a tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:44.323893 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f0ffff4c-730f-47fc-98d1-52c63984c46a tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:44.551457 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f0ffff4c-730f-47fc-98d1-52c63984c46a tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/d1ad319f-a3a5-4bb8-953d-8edb75ab161d" status: 200 len: 1650 microversion: 2.1 time: 0.241826 Jan 15 21:20:44.552056 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3488/6965] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:20:44 2022] GET /compute/v2.1/servers/d1ad319f-a3a5-4bb8-953d-8edb75ab161d => generated 1650 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:20:44.567821 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-53e3b45a-e5ec-4d5f-bfce-a2fbf5b37ed8 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:20:44.568441 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-53e3b45a-e5ec-4d5f-bfce-a2fbf5b37ed8 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] [instance: d1ad319f-a3a5-4bb8-953d-8edb75ab161d] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:20:44.574632 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-53e3b45a-e5ec-4d5f-bfce-a2fbf5b37ed8 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:44.575109 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-53e3b45a-e5ec-4d5f-bfce-a2fbf5b37ed8 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:44.575926 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-53e3b45a-e5ec-4d5f-bfce-a2fbf5b37ed8 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:44.576417 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-53e3b45a-e5ec-4d5f-bfce-a2fbf5b37ed8 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:44.845457 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-53e3b45a-e5ec-4d5f-bfce-a2fbf5b37ed8 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/d1ad319f-a3a5-4bb8-953d-8edb75ab161d" status: 200 len: 1650 microversion: 2.1 time: 0.281974 Jan 15 21:20:44.856540 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3478/6966] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:20:44 2022] GET /compute/v2.1/servers/d1ad319f-a3a5-4bb8-953d-8edb75ab161d => generated 1650 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:20:44.861572 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8621201e-18cb-4d4e-b2b8-b718fdb81a23 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:20:44.862620 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-8621201e-18cb-4d4e-b2b8-b718fdb81a23 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] [instance: d1ad319f-a3a5-4bb8-953d-8edb75ab161d] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:20:44.870149 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8621201e-18cb-4d4e-b2b8-b718fdb81a23 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:44.870592 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8621201e-18cb-4d4e-b2b8-b718fdb81a23 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:44.871390 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8621201e-18cb-4d4e-b2b8-b718fdb81a23 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:44.871822 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8621201e-18cb-4d4e-b2b8-b718fdb81a23 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:44.896340 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-8621201e-18cb-4d4e-b2b8-b718fdb81a23 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] [instance: d1ad319f-a3a5-4bb8-953d-8edb75ab161d] Going to try to terminate instance {{(pid=129366) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 21:20:44.971310 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-8621201e-18cb-4d4e-b2b8-b718fdb81a23 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] 10.222.0.46 "DELETE /compute/v2.1/servers/d1ad319f-a3a5-4bb8-953d-8edb75ab161d" status: 204 len: 0 microversion: 2.1 time: 0.113063 Jan 15 21:20:44.972621 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3489/6967] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 21:20:44 2022] DELETE /compute/v2.1/servers/d1ad319f-a3a5-4bb8-953d-8edb75ab161d => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 21:20:44.981861 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c99d8d0b-889c-41f0-878d-da4deb45c766 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:20:44.982723 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c99d8d0b-889c-41f0-878d-da4deb45c766 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] [instance: d1ad319f-a3a5-4bb8-953d-8edb75ab161d] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:20:44.989301 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c99d8d0b-889c-41f0-878d-da4deb45c766 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:44.989770 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c99d8d0b-889c-41f0-878d-da4deb45c766 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:44.990575 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c99d8d0b-889c-41f0-878d-da4deb45c766 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:44.991029 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c99d8d0b-889c-41f0-878d-da4deb45c766 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:45.224767 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c99d8d0b-889c-41f0-878d-da4deb45c766 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/d1ad319f-a3a5-4bb8-953d-8edb75ab161d" status: 200 len: 1656 microversion: 2.1 time: 0.247693 Jan 15 21:20:45.227302 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3479/6968] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:20:44 2022] GET /compute/v2.1/servers/d1ad319f-a3a5-4bb8-953d-8edb75ab161d => generated 1656 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:20:45.294547 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-67a8a0a7-3fb3-41aa-a1fa-07bef585247b req-987ad0a8-b492-4520-b6b8-ff0410d55aa3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4f980ed-4669-4cfc-b196-aecea77de875", "tag": "f70df7d5-47e6-45b0-9a91-605cfa5f5d33"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:20:45.296199 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:20:45.296199 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:20:45.305541 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-67a8a0a7-3fb3-41aa-a1fa-07bef585247b req-987ad0a8-b492-4520-b6b8-ff0410d55aa3 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:45.305978 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-67a8a0a7-3fb3-41aa-a1fa-07bef585247b req-987ad0a8-b492-4520-b6b8-ff0410d55aa3 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:45.317578 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-67a8a0a7-3fb3-41aa-a1fa-07bef585247b req-987ad0a8-b492-4520-b6b8-ff0410d55aa3 service nova] Creating event network-changed:f70df7d5-47e6-45b0-9a91-605cfa5f5d33 for instance b4f980ed-4669-4cfc-b196-aecea77de875 on nch1-master-1 Jan 15 21:20:45.322542 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-67a8a0a7-3fb3-41aa-a1fa-07bef585247b req-987ad0a8-b492-4520-b6b8-ff0410d55aa3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032336 Jan 15 21:20:45.323165 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3490/6969] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:20:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:20:46.244743 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-56ab310b-1753-49f3-bfed-8222110f1861 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:20:46.245676 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-56ab310b-1753-49f3-bfed-8222110f1861 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] [instance: d1ad319f-a3a5-4bb8-953d-8edb75ab161d] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:20:46.253817 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-56ab310b-1753-49f3-bfed-8222110f1861 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:46.254596 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-56ab310b-1753-49f3-bfed-8222110f1861 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:46.255484 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-56ab310b-1753-49f3-bfed-8222110f1861 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:46.256028 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-56ab310b-1753-49f3-bfed-8222110f1861 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:46.402496 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-56ab310b-1753-49f3-bfed-8222110f1861 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/d1ad319f-a3a5-4bb8-953d-8edb75ab161d" status: 200 len: 1656 microversion: 2.1 time: 0.161350 Jan 15 21:20:46.403261 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3480/6970] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:20:46 2022] GET /compute/v2.1/servers/d1ad319f-a3a5-4bb8-953d-8edb75ab161d => generated 1656 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:20:46.765090 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-983586ed-7c6e-4abb-b322-ff3662648118 req-877605e0-7724-44b8-b5d2-d3076e1a798b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1ad319f-a3a5-4bb8-953d-8edb75ab161d", "name": "network-vif-deleted", "tag": "c37b0a50-dc89-4e76-a351-eaa8132da409"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:20:46.767339 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:20:46.767339 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:20:46.776168 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-983586ed-7c6e-4abb-b322-ff3662648118 req-877605e0-7724-44b8-b5d2-d3076e1a798b service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:46.776824 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-983586ed-7c6e-4abb-b322-ff3662648118 req-877605e0-7724-44b8-b5d2-d3076e1a798b service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:46.790412 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-983586ed-7c6e-4abb-b322-ff3662648118 req-877605e0-7724-44b8-b5d2-d3076e1a798b service nova] Creating event network-vif-deleted:c37b0a50-dc89-4e76-a351-eaa8132da409 for instance d1ad319f-a3a5-4bb8-953d-8edb75ab161d on nch1-master-1 Jan 15 21:20:46.795563 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-983586ed-7c6e-4abb-b322-ff3662648118 req-877605e0-7724-44b8-b5d2-d3076e1a798b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034333 Jan 15 21:20:46.802126 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3491/6971] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:20:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:20:47.419382 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3e485785-5d6e-4a49-86db-facf632a1c97 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:20:47.420001 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-3e485785-5d6e-4a49-86db-facf632a1c97 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] [instance: d1ad319f-a3a5-4bb8-953d-8edb75ab161d] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:20:47.428175 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3e485785-5d6e-4a49-86db-facf632a1c97 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:47.428641 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3e485785-5d6e-4a49-86db-facf632a1c97 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:47.429462 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3e485785-5d6e-4a49-86db-facf632a1c97 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:47.429906 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3e485785-5d6e-4a49-86db-facf632a1c97 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:47.442724 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-3e485785-5d6e-4a49-86db-facf632a1c97 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] HTTP exception thrown: Instance d1ad319f-a3a5-4bb8-953d-8edb75ab161d could not be found. Jan 15 21:20:47.443315 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3e485785-5d6e-4a49-86db-facf632a1c97 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Returning 404 to user: Instance d1ad319f-a3a5-4bb8-953d-8edb75ab161d could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:20:47.444139 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3e485785-5d6e-4a49-86db-facf632a1c97 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/d1ad319f-a3a5-4bb8-953d-8edb75ab161d" status: 404 len: 111 microversion: 2.1 time: 0.028572 Jan 15 21:20:47.444664 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3481/6972] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:20:47 2022] GET /compute/v2.1/servers/d1ad319f-a3a5-4bb8-953d-8edb75ab161d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:20:47.453247 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b3b31b0f-c79f-491a-9b0a-689540edbd9e tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:20:47.453831 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b3b31b0f-c79f-491a-9b0a-689540edbd9e tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] [instance: 7533b876-6474-4cfa-9241-116dd4f6502b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:20:47.459982 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b3b31b0f-c79f-491a-9b0a-689540edbd9e tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:47.460423 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b3b31b0f-c79f-491a-9b0a-689540edbd9e tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:47.461258 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b3b31b0f-c79f-491a-9b0a-689540edbd9e tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:47.461688 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b3b31b0f-c79f-491a-9b0a-689540edbd9e tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:47.488381 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b3b31b0f-c79f-491a-9b0a-689540edbd9e tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] [instance: 7533b876-6474-4cfa-9241-116dd4f6502b] Going to try to terminate instance {{(pid=129366) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 21:20:47.558974 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b3b31b0f-c79f-491a-9b0a-689540edbd9e tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] 10.222.0.46 "DELETE /compute/v2.1/servers/7533b876-6474-4cfa-9241-116dd4f6502b" status: 204 len: 0 microversion: 2.1 time: 0.109579 Jan 15 21:20:47.559807 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3492/6973] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 21:20:47 2022] DELETE /compute/v2.1/servers/7533b876-6474-4cfa-9241-116dd4f6502b => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 21:20:47.568360 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2c6ad5b7-aaca-4355-9c17-c1a99f3d2fec tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:20:47.569061 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-2c6ad5b7-aaca-4355-9c17-c1a99f3d2fec tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] [instance: 7533b876-6474-4cfa-9241-116dd4f6502b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:20:47.575022 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2c6ad5b7-aaca-4355-9c17-c1a99f3d2fec tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:47.575470 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2c6ad5b7-aaca-4355-9c17-c1a99f3d2fec tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:47.576264 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2c6ad5b7-aaca-4355-9c17-c1a99f3d2fec tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:47.576717 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2c6ad5b7-aaca-4355-9c17-c1a99f3d2fec tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:47.704797 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2c6ad5b7-aaca-4355-9c17-c1a99f3d2fec tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/7533b876-6474-4cfa-9241-116dd4f6502b" status: 200 len: 1655 microversion: 2.1 time: 0.140202 Jan 15 21:20:47.705395 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3482/6974] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:20:47 2022] GET /compute/v2.1/servers/7533b876-6474-4cfa-9241-116dd4f6502b => generated 1655 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:20:48.722407 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e0ed0ecc-e0d7-4602-bb30-f054a6557f82 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:20:48.723126 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e0ed0ecc-e0d7-4602-bb30-f054a6557f82 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] [instance: 7533b876-6474-4cfa-9241-116dd4f6502b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:20:48.730363 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e0ed0ecc-e0d7-4602-bb30-f054a6557f82 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:48.730818 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e0ed0ecc-e0d7-4602-bb30-f054a6557f82 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:48.731590 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e0ed0ecc-e0d7-4602-bb30-f054a6557f82 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:48.732020 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e0ed0ecc-e0d7-4602-bb30-f054a6557f82 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:48.865326 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e0ed0ecc-e0d7-4602-bb30-f054a6557f82 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/7533b876-6474-4cfa-9241-116dd4f6502b" status: 200 len: 1655 microversion: 2.1 time: 0.147036 Jan 15 21:20:48.875699 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3493/6975] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:20:48 2022] GET /compute/v2.1/servers/7533b876-6474-4cfa-9241-116dd4f6502b => generated 1655 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:20:49.395786 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-cbb3000e-a064-4736-8d65-05cdc3ef6fd9 req-b9d920fd-71ab-4784-88b6-086c663de298 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7533b876-6474-4cfa-9241-116dd4f6502b", "name": "network-vif-deleted", "tag": "130ab256-0e99-430b-8dc1-e4ea192596b6"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:20:49.398075 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:20:49.398075 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:20:49.407591 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-cbb3000e-a064-4736-8d65-05cdc3ef6fd9 req-b9d920fd-71ab-4784-88b6-086c663de298 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:49.408196 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-cbb3000e-a064-4736-8d65-05cdc3ef6fd9 req-b9d920fd-71ab-4784-88b6-086c663de298 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:49.421054 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-cbb3000e-a064-4736-8d65-05cdc3ef6fd9 req-b9d920fd-71ab-4784-88b6-086c663de298 service nova] Creating event network-vif-deleted:130ab256-0e99-430b-8dc1-e4ea192596b6 for instance 7533b876-6474-4cfa-9241-116dd4f6502b on nch2-master-1 Jan 15 21:20:49.426437 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-cbb3000e-a064-4736-8d65-05cdc3ef6fd9 req-b9d920fd-71ab-4784-88b6-086c663de298 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037024 Jan 15 21:20:49.427051 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3483/6976] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:20:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:20:49.884123 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-6ec98a76-e17b-423a-9102-ade36c6c5508 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:20:49.884731 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-6ec98a76-e17b-423a-9102-ade36c6c5508 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] [instance: 7533b876-6474-4cfa-9241-116dd4f6502b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:20:49.892063 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6ec98a76-e17b-423a-9102-ade36c6c5508 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:49.892507 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6ec98a76-e17b-423a-9102-ade36c6c5508 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:49.893347 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6ec98a76-e17b-423a-9102-ade36c6c5508 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:49.893782 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6ec98a76-e17b-423a-9102-ade36c6c5508 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:49.909203 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-6ec98a76-e17b-423a-9102-ade36c6c5508 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] HTTP exception thrown: Instance 7533b876-6474-4cfa-9241-116dd4f6502b could not be found. Jan 15 21:20:49.910417 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-6ec98a76-e17b-423a-9102-ade36c6c5508 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] Returning 404 to user: Instance 7533b876-6474-4cfa-9241-116dd4f6502b could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:20:49.911470 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-6ec98a76-e17b-423a-9102-ade36c6c5508 tempest-TestServerMultinode-1143177832 tempest-TestServerMultinode-1143177832-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/7533b876-6474-4cfa-9241-116dd4f6502b" status: 404 len: 111 microversion: 2.1 time: 0.031732 Jan 15 21:20:49.912029 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3494/6977] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:20:49 2022] GET /compute/v2.1/servers/7533b876-6474-4cfa-9241-116dd4f6502b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:20:56.112280 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b514617a-a61f-4a7b-a2e8-cd21a12753da tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:20:56.113109 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b514617a-a61f-4a7b-a2e8-cd21a12753da tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: ae51bd6b-96a9-42fa-ad05-234547d3f5d3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:20:56.119806 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b514617a-a61f-4a7b-a2e8-cd21a12753da tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:56.120242 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b514617a-a61f-4a7b-a2e8-cd21a12753da tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:56.121167 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b514617a-a61f-4a7b-a2e8-cd21a12753da tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:56.121557 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b514617a-a61f-4a7b-a2e8-cd21a12753da tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:56.133092 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-46cf0364-e7a7-4379-b3ce-81b29e1c3451 req-07c5af6a-0d43-4b6f-8707-887a248d5c44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae51bd6b-96a9-42fa-ad05-234547d3f5d3", "tag": "8a3eca19-0e64-45e1-ba8b-83d5de1d3c69"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:20:56.135451 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:20:56.135451 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:20:56.147418 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-46cf0364-e7a7-4379-b3ce-81b29e1c3451 req-07c5af6a-0d43-4b6f-8707-887a248d5c44 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:56.148550 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-46cf0364-e7a7-4379-b3ce-81b29e1c3451 req-07c5af6a-0d43-4b6f-8707-887a248d5c44 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:56.171755 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b514617a-a61f-4a7b-a2e8-cd21a12753da tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: ae51bd6b-96a9-42fa-ad05-234547d3f5d3] Going to try to terminate instance {{(pid=129365) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 21:20:56.180301 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-46cf0364-e7a7-4379-b3ce-81b29e1c3451 req-07c5af6a-0d43-4b6f-8707-887a248d5c44 service nova] Creating event network-changed:8a3eca19-0e64-45e1-ba8b-83d5de1d3c69 for instance ae51bd6b-96a9-42fa-ad05-234547d3f5d3 on nch2-master-1 Jan 15 21:20:56.198394 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-46cf0364-e7a7-4379-b3ce-81b29e1c3451 req-07c5af6a-0d43-4b6f-8707-887a248d5c44 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069024 Jan 15 21:20:56.200235 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3495/6978] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:20:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:20:56.278652 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b514617a-a61f-4a7b-a2e8-cd21a12753da tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "DELETE /compute/v2.1/servers/ae51bd6b-96a9-42fa-ad05-234547d3f5d3" status: 204 len: 0 microversion: 2.1 time: 0.171336 Jan 15 21:20:56.279748 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3484/6979] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 21:20:56 2022] DELETE /compute/v2.1/servers/ae51bd6b-96a9-42fa-ad05-234547d3f5d3 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 21:20:56.289385 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e78dfc6a-af9e-4085-9984-efd9fcaff42d tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:20:56.291062 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e78dfc6a-af9e-4085-9984-efd9fcaff42d tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: ae51bd6b-96a9-42fa-ad05-234547d3f5d3] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:20:56.302179 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e78dfc6a-af9e-4085-9984-efd9fcaff42d tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:56.302633 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e78dfc6a-af9e-4085-9984-efd9fcaff42d tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:56.303491 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e78dfc6a-af9e-4085-9984-efd9fcaff42d tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:56.303936 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e78dfc6a-af9e-4085-9984-efd9fcaff42d tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:56.583420 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-e78dfc6a-af9e-4085-9984-efd9fcaff42d tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:20:56.611075 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e78dfc6a-af9e-4085-9984-efd9fcaff42d tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/ae51bd6b-96a9-42fa-ad05-234547d3f5d3" status: 200 len: 1686 microversion: 2.1 time: 0.322062 Jan 15 21:20:56.612250 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3496/6980] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:20:56 2022] GET /compute/v2.1/servers/ae51bd6b-96a9-42fa-ad05-234547d3f5d3 => generated 1686 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:20:57.633029 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e3ae0234-8846-4d42-807d-ebb42d6a22a7 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:20:57.633857 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e3ae0234-8846-4d42-807d-ebb42d6a22a7 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: ae51bd6b-96a9-42fa-ad05-234547d3f5d3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:20:57.641777 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e3ae0234-8846-4d42-807d-ebb42d6a22a7 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:57.642329 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e3ae0234-8846-4d42-807d-ebb42d6a22a7 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:57.643391 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e3ae0234-8846-4d42-807d-ebb42d6a22a7 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:57.643933 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e3ae0234-8846-4d42-807d-ebb42d6a22a7 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:57.787639 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-e3ae0234-8846-4d42-807d-ebb42d6a22a7 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0f0e03b03e4d24ae0a7e5d3b9b7104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86e4d7dcdb4ea7ad79628b2ae2462d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:20:57.795247 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e3ae0234-8846-4d42-807d-ebb42d6a22a7 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/ae51bd6b-96a9-42fa-ad05-234547d3f5d3" status: 200 len: 1567 microversion: 2.1 time: 0.167233 Jan 15 21:20:57.806265 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3485/6981] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:20:57 2022] GET /compute/v2.1/servers/ae51bd6b-96a9-42fa-ad05-234547d3f5d3 => generated 1567 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:20:58.264461 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-f71045e2-c674-4c61-a878-390ec446e749 req-991f4953-7100-411b-a295-12ec73b52881 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae51bd6b-96a9-42fa-ad05-234547d3f5d3", "name": "network-vif-deleted", "tag": "8a3eca19-0e64-45e1-ba8b-83d5de1d3c69"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:20:58.266345 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:20:58.266345 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:20:58.274054 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-f71045e2-c674-4c61-a878-390ec446e749 req-991f4953-7100-411b-a295-12ec73b52881 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:58.274492 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-f71045e2-c674-4c61-a878-390ec446e749 req-991f4953-7100-411b-a295-12ec73b52881 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:58.286687 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-f71045e2-c674-4c61-a878-390ec446e749 req-991f4953-7100-411b-a295-12ec73b52881 service nova] Creating event network-vif-deleted:8a3eca19-0e64-45e1-ba8b-83d5de1d3c69 for instance ae51bd6b-96a9-42fa-ad05-234547d3f5d3 on nch2-master-1 Jan 15 21:20:58.291849 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-f71045e2-c674-4c61-a878-390ec446e749 req-991f4953-7100-411b-a295-12ec73b52881 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030981 Jan 15 21:20:58.292615 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3497/6982] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:20:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:20:58.813339 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ca5c211e-17f7-4817-92a2-1784ccacd654 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:20:58.814071 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ca5c211e-17f7-4817-92a2-1784ccacd654 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] [instance: ae51bd6b-96a9-42fa-ad05-234547d3f5d3] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:20:58.823299 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ca5c211e-17f7-4817-92a2-1784ccacd654 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:58.823983 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ca5c211e-17f7-4817-92a2-1784ccacd654 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:58.824805 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ca5c211e-17f7-4817-92a2-1784ccacd654 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:20:58.825322 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ca5c211e-17f7-4817-92a2-1784ccacd654 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:20:58.840623 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-ca5c211e-17f7-4817-92a2-1784ccacd654 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] HTTP exception thrown: Instance ae51bd6b-96a9-42fa-ad05-234547d3f5d3 could not be found. Jan 15 21:20:58.841383 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ca5c211e-17f7-4817-92a2-1784ccacd654 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Returning 404 to user: Instance ae51bd6b-96a9-42fa-ad05-234547d3f5d3 could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:20:58.842228 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ca5c211e-17f7-4817-92a2-1784ccacd654 tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "GET /compute/v2.1/servers/ae51bd6b-96a9-42fa-ad05-234547d3f5d3" status: 404 len: 111 microversion: 2.1 time: 0.033124 Jan 15 21:20:58.843044 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3486/6983] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:20:58 2022] GET /compute/v2.1/servers/ae51bd6b-96a9-42fa-ad05-234547d3f5d3 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:21:03.110868 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0f8d26f9-1a79-429a-9831-97fd26078fbf tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] Calling method '.version_select at 0x7f30c85b0b80>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:21:03.135314 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0f8d26f9-1a79-429a-9831-97fd26078fbf tempest-TestNetworkAdvancedServerOps-660705759 tempest-TestNetworkAdvancedServerOps-660705759-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-38628784" status: 202 len: 0 microversion: 2.1 time: 0.030072 Jan 15 21:21:03.135922 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3498/6984] 10.222.0.46 () {58 vars in 1277 bytes} [Sat Jan 15 21:21:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-38628784 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:21:26.778257 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f2c4f8b2-b944-46e8-a145-682f65d6bc74 tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] Action: 'create', calling method: .version_select at 0x7f30c913edc0>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-1999422895"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:21:26.793446 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-f2c4f8b2-b944-46e8-a145-682f65d6bc74 tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] Getting quotas for project 295ec7c21a074bc4b8bdf0bcedf5e7a3. Resources: {'key_pairs'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:21:26.798324 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-f2c4f8b2-b944-46e8-a145-682f65d6bc74 tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] Getting quotas for user 585670f672774f178f07e8cf2398b54d and project 295ec7c21a074bc4b8bdf0bcedf5e7a3. Resources: {'key_pairs'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:21:27.105931 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-f2c4f8b2-b944-46e8-a145-682f65d6bc74 tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] Getting quotas for project 295ec7c21a074bc4b8bdf0bcedf5e7a3. Resources: {'key_pairs'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:21:27.110624 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-f2c4f8b2-b944-46e8-a145-682f65d6bc74 tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] Getting quotas for user 585670f672774f178f07e8cf2398b54d and project 295ec7c21a074bc4b8bdf0bcedf5e7a3. Resources: {'key_pairs'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:21:27.124339 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f2c4f8b2-b944-46e8-a145-682f65d6bc74 tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 2321 microversion: 2.1 time: 0.349845 Jan 15 21:21:27.124965 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3487/6985] 10.222.0.46 () {60 vars in 1157 bytes} [Sat Jan 15 21:21:26 2022] POST /compute/v2.1/os-keypairs => generated 2321 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:21:28.061985 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-663d0c54-a005-4aab-b3d2-568557be2aec tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-1836801606", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "bd619176-6e0b-4a31-92d4-89d5b07e409a", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-1999422895", "security_groups": [{"name": "tempest-secgroup-smoke-771993882"}], "networks": [{"uuid": "fd40f033-9f30-4342-bda0-cdb60f17f62b"}]}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:21:28.180708 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.network.neutron [None req-663d0c54-a005-4aab-b3d2-568557be2aec tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] validate_networks() for [('fd40f033-9f30-4342-bda0-cdb60f17f62b', None, None, None, None, None)] {{(pid=129366) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 21:21:28.546812 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-663d0c54-a005-4aab-b3d2-568557be2aec tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] Flavor limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 21:21:28.547234 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-663d0c54-a005-4aab-b3d2-568557be2aec tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] Image limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 21:21:28.547704 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-663d0c54-a005-4aab-b3d2-568557be2aec tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] Flavor pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 21:21:28.548110 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-663d0c54-a005-4aab-b3d2-568557be2aec tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] Image pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 21:21:28.548517 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-663d0c54-a005-4aab-b3d2-568557be2aec tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 21:21:28.558070 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-663d0c54-a005-4aab-b3d2-568557be2aec tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:21:28.558517 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-663d0c54-a005-4aab-b3d2-568557be2aec tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:21:28.559317 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-663d0c54-a005-4aab-b3d2-568557be2aec tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:21:28.559746 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-663d0c54-a005-4aab-b3d2-568557be2aec tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:21:28.575663 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-663d0c54-a005-4aab-b3d2-568557be2aec tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] Getting quotas for project 295ec7c21a074bc4b8bdf0bcedf5e7a3. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:21:28.580687 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-663d0c54-a005-4aab-b3d2-568557be2aec tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] Getting quotas for user 585670f672774f178f07e8cf2398b54d and project 295ec7c21a074bc4b8bdf0bcedf5e7a3. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:21:28.637133 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-663d0c54-a005-4aab-b3d2-568557be2aec tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] Going to run 1 instances... {{(pid=129366) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 21:21:28.639927 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-663d0c54-a005-4aab-b3d2-568557be2aec tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] [instance: 4882d3ac-814e-43a1-a277-ef3317f310a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bd619176-6e0b-4a31-92d4-89d5b07e409a',volume_size=None,volume_type=None)] {{(pid=129366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 21:21:28.760755 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-663d0c54-a005-4aab-b3d2-568557be2aec tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.703679 Jan 15 21:21:28.761456 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3499/6986] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 21:21:28 2022] POST /compute/v2.1/servers => generated 405 bytes in 705 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 21:21:28.772946 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e8d3d081-7291-46c7-abbf-6d9915ca4794 tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:21:28.773596 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e8d3d081-7291-46c7-abbf-6d9915ca4794 tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] [instance: 4882d3ac-814e-43a1-a277-ef3317f310a9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:21:28.826596 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-e8d3d081-7291-46c7-abbf-6d9915ca4794 tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585670f672774f178f07e8cf2398b54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '295ec7c21a074bc4b8bdf0bcedf5e7a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:21:28.835125 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e8d3d081-7291-46c7-abbf-6d9915ca4794 tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] 10.222.0.46 "GET /compute/v2.1/servers/4882d3ac-814e-43a1-a277-ef3317f310a9" status: 200 len: 1099 microversion: 2.1 time: 0.067611 Jan 15 21:21:28.835699 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3488/6987] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:21:28 2022] GET /compute/v2.1/servers/4882d3ac-814e-43a1-a277-ef3317f310a9 => generated 1099 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:21:29.852389 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e2199048-2980-4524-aae3-1e1ed3f6231f tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:21:29.853132 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e2199048-2980-4524-aae3-1e1ed3f6231f tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] [instance: 4882d3ac-814e-43a1-a277-ef3317f310a9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:21:29.860057 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e2199048-2980-4524-aae3-1e1ed3f6231f tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:21:29.860507 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e2199048-2980-4524-aae3-1e1ed3f6231f tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:21:29.861316 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e2199048-2980-4524-aae3-1e1ed3f6231f tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:21:29.861751 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e2199048-2980-4524-aae3-1e1ed3f6231f tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:21:29.925219 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-e2199048-2980-4524-aae3-1e1ed3f6231f tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585670f672774f178f07e8cf2398b54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '295ec7c21a074bc4b8bdf0bcedf5e7a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:21:29.933340 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e2199048-2980-4524-aae3-1e1ed3f6231f tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] 10.222.0.46 "GET /compute/v2.1/servers/4882d3ac-814e-43a1-a277-ef3317f310a9" status: 200 len: 1215 microversion: 2.1 time: 0.085449 Jan 15 21:21:29.933930 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3500/6988] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:21:29 2022] GET /compute/v2.1/servers/4882d3ac-814e-43a1-a277-ef3317f310a9 => generated 1215 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:21:30.952496 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c0275b0b-36d1-4b3c-83bc-70aac31e0d45 tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:21:30.953774 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c0275b0b-36d1-4b3c-83bc-70aac31e0d45 tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] [instance: 4882d3ac-814e-43a1-a277-ef3317f310a9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:21:30.962052 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c0275b0b-36d1-4b3c-83bc-70aac31e0d45 tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:21:30.962568 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c0275b0b-36d1-4b3c-83bc-70aac31e0d45 tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:21:30.963708 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c0275b0b-36d1-4b3c-83bc-70aac31e0d45 tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:21:30.964212 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c0275b0b-36d1-4b3c-83bc-70aac31e0d45 tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:21:31.121863 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-c0275b0b-36d1-4b3c-83bc-70aac31e0d45 tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585670f672774f178f07e8cf2398b54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '295ec7c21a074bc4b8bdf0bcedf5e7a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:21:31.133874 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c0275b0b-36d1-4b3c-83bc-70aac31e0d45 tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] 10.222.0.46 "GET /compute/v2.1/servers/4882d3ac-814e-43a1-a277-ef3317f310a9" status: 200 len: 1270 microversion: 2.1 time: 0.185932 Jan 15 21:21:31.134550 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3489/6989] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:21:30 2022] GET /compute/v2.1/servers/4882d3ac-814e-43a1-a277-ef3317f310a9 => generated 1270 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:21:31.218858 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-c8c852d9-35e8-419b-be92-4138bc8a90df req-7fbf5735-b9a2-428b-86ff-2754b018540b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4882d3ac-814e-43a1-a277-ef3317f310a9", "tag": "f4d625c8-a862-4b48-a735-42899f57aa0c"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:21:31.220772 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:21:31.220772 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:21:31.232300 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-c8c852d9-35e8-419b-be92-4138bc8a90df req-7fbf5735-b9a2-428b-86ff-2754b018540b service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:21:31.233461 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-c8c852d9-35e8-419b-be92-4138bc8a90df req-7fbf5735-b9a2-428b-86ff-2754b018540b service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:21:31.247961 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-c8c852d9-35e8-419b-be92-4138bc8a90df req-7fbf5735-b9a2-428b-86ff-2754b018540b service nova] Creating event network-changed:f4d625c8-a862-4b48-a735-42899f57aa0c for instance 4882d3ac-814e-43a1-a277-ef3317f310a9 on nch2-master-1 Jan 15 21:21:31.254343 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-c8c852d9-35e8-419b-be92-4138bc8a90df req-7fbf5735-b9a2-428b-86ff-2754b018540b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038689 Jan 15 21:21:31.255807 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3501/6990] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:21:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:21:32.152189 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b7a7e58c-31cd-482c-a662-73d399c6df5e tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:21:32.152823 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b7a7e58c-31cd-482c-a662-73d399c6df5e tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] [instance: 4882d3ac-814e-43a1-a277-ef3317f310a9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:21:32.160215 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b7a7e58c-31cd-482c-a662-73d399c6df5e tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:21:32.160719 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b7a7e58c-31cd-482c-a662-73d399c6df5e tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:21:32.161614 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b7a7e58c-31cd-482c-a662-73d399c6df5e tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:21:32.162130 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b7a7e58c-31cd-482c-a662-73d399c6df5e tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:21:32.320263 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-b7a7e58c-31cd-482c-a662-73d399c6df5e tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585670f672774f178f07e8cf2398b54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '295ec7c21a074bc4b8bdf0bcedf5e7a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:21:32.331643 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b7a7e58c-31cd-482c-a662-73d399c6df5e tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] 10.222.0.46 "GET /compute/v2.1/servers/4882d3ac-814e-43a1-a277-ef3317f310a9" status: 200 len: 1270 microversion: 2.1 time: 0.183775 Jan 15 21:21:32.332687 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3490/6991] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:21:32 2022] GET /compute/v2.1/servers/4882d3ac-814e-43a1-a277-ef3317f310a9 => generated 1270 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:21:33.354493 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-99ee0670-3102-4beb-a88e-b0e3ef10c9c0 tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:21:33.355191 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-99ee0670-3102-4beb-a88e-b0e3ef10c9c0 tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] [instance: 4882d3ac-814e-43a1-a277-ef3317f310a9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:21:33.362424 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-99ee0670-3102-4beb-a88e-b0e3ef10c9c0 tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:21:33.362880 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-99ee0670-3102-4beb-a88e-b0e3ef10c9c0 tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:21:33.363686 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-99ee0670-3102-4beb-a88e-b0e3ef10c9c0 tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:21:33.364129 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-99ee0670-3102-4beb-a88e-b0e3ef10c9c0 tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:21:33.521990 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-99ee0670-3102-4beb-a88e-b0e3ef10c9c0 tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585670f672774f178f07e8cf2398b54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '295ec7c21a074bc4b8bdf0bcedf5e7a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:21:33.529738 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-99ee0670-3102-4beb-a88e-b0e3ef10c9c0 tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] 10.222.0.46 "GET /compute/v2.1/servers/4882d3ac-814e-43a1-a277-ef3317f310a9" status: 200 len: 1270 microversion: 2.1 time: 0.180950 Jan 15 21:21:33.530328 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3502/6992] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:21:33 2022] GET /compute/v2.1/servers/4882d3ac-814e-43a1-a277-ef3317f310a9 => generated 1270 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:21:34.547863 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b11c67fa-3283-43f4-98ac-63eb7ce3cb8d tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:21:34.548495 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b11c67fa-3283-43f4-98ac-63eb7ce3cb8d tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] [instance: 4882d3ac-814e-43a1-a277-ef3317f310a9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:21:34.556548 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b11c67fa-3283-43f4-98ac-63eb7ce3cb8d tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:21:34.557032 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b11c67fa-3283-43f4-98ac-63eb7ce3cb8d tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:21:34.557817 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b11c67fa-3283-43f4-98ac-63eb7ce3cb8d tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:21:34.558265 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b11c67fa-3283-43f4-98ac-63eb7ce3cb8d tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:21:34.701592 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-b11c67fa-3283-43f4-98ac-63eb7ce3cb8d tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585670f672774f178f07e8cf2398b54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '295ec7c21a074bc4b8bdf0bcedf5e7a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:21:34.711628 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b11c67fa-3283-43f4-98ac-63eb7ce3cb8d tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] 10.222.0.46 "GET /compute/v2.1/servers/4882d3ac-814e-43a1-a277-ef3317f310a9" status: 200 len: 1270 microversion: 2.1 time: 0.167198 Jan 15 21:21:34.712522 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3491/6993] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:21:34 2022] GET /compute/v2.1/servers/4882d3ac-814e-43a1-a277-ef3317f310a9 => generated 1270 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:21:35.731268 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-6b2470b4-f9ae-4b7f-9b5d-22fec1e2fbc2 tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:21:35.731925 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-6b2470b4-f9ae-4b7f-9b5d-22fec1e2fbc2 tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] [instance: 4882d3ac-814e-43a1-a277-ef3317f310a9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:21:35.739738 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6b2470b4-f9ae-4b7f-9b5d-22fec1e2fbc2 tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:21:35.740300 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6b2470b4-f9ae-4b7f-9b5d-22fec1e2fbc2 tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:21:35.741120 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6b2470b4-f9ae-4b7f-9b5d-22fec1e2fbc2 tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:21:35.741553 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6b2470b4-f9ae-4b7f-9b5d-22fec1e2fbc2 tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:21:35.898445 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-6b2470b4-f9ae-4b7f-9b5d-22fec1e2fbc2 tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585670f672774f178f07e8cf2398b54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '295ec7c21a074bc4b8bdf0bcedf5e7a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:21:35.907371 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-6b2470b4-f9ae-4b7f-9b5d-22fec1e2fbc2 tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] 10.222.0.46 "GET /compute/v2.1/servers/4882d3ac-814e-43a1-a277-ef3317f310a9" status: 200 len: 1270 microversion: 2.1 time: 0.180579 Jan 15 21:21:35.908357 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3503/6994] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:21:35 2022] GET /compute/v2.1/servers/4882d3ac-814e-43a1-a277-ef3317f310a9 => generated 1270 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:21:36.926017 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9d8d60fb-36b3-4765-91ff-1831d3ed2273 tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:21:36.927348 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-9d8d60fb-36b3-4765-91ff-1831d3ed2273 tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] [instance: 4882d3ac-814e-43a1-a277-ef3317f310a9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:21:36.934136 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9d8d60fb-36b3-4765-91ff-1831d3ed2273 tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:21:36.934595 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9d8d60fb-36b3-4765-91ff-1831d3ed2273 tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:21:36.935377 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9d8d60fb-36b3-4765-91ff-1831d3ed2273 tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:21:36.935822 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9d8d60fb-36b3-4765-91ff-1831d3ed2273 tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:21:37.070089 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-9d8d60fb-36b3-4765-91ff-1831d3ed2273 tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585670f672774f178f07e8cf2398b54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '295ec7c21a074bc4b8bdf0bcedf5e7a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:21:37.077538 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-9d8d60fb-36b3-4765-91ff-1831d3ed2273 tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] 10.222.0.46 "GET /compute/v2.1/servers/4882d3ac-814e-43a1-a277-ef3317f310a9" status: 200 len: 1270 microversion: 2.1 time: 0.155244 Jan 15 21:21:37.078105 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3492/6995] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:21:36 2022] GET /compute/v2.1/servers/4882d3ac-814e-43a1-a277-ef3317f310a9 => generated 1270 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:21:37.974339 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-5c74f972-f9db-446d-b8e2-eafec55a9959 req-c464244d-ceab-4595-a628-fe12728048b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4882d3ac-814e-43a1-a277-ef3317f310a9", "name": "network-vif-plugged", "status": "completed", "tag": "f4d625c8-a862-4b48-a735-42899f57aa0c"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:21:37.975897 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:21:37.975897 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:21:37.984690 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-5c74f972-f9db-446d-b8e2-eafec55a9959 req-c464244d-ceab-4595-a628-fe12728048b4 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:21:37.985284 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-5c74f972-f9db-446d-b8e2-eafec55a9959 req-c464244d-ceab-4595-a628-fe12728048b4 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:21:37.999674 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-5c74f972-f9db-446d-b8e2-eafec55a9959 req-c464244d-ceab-4595-a628-fe12728048b4 service nova] Creating event network-vif-plugged:f4d625c8-a862-4b48-a735-42899f57aa0c for instance 4882d3ac-814e-43a1-a277-ef3317f310a9 on nch2-master-1 Jan 15 21:21:38.004620 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-5c74f972-f9db-446d-b8e2-eafec55a9959 req-c464244d-ceab-4595-a628-fe12728048b4 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034389 Jan 15 21:21:38.006132 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3504/6996] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:21:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:21:38.094726 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-059b3cd4-9869-40f8-96a6-9ef50ce28825 tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:21:38.095445 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-059b3cd4-9869-40f8-96a6-9ef50ce28825 tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] [instance: 4882d3ac-814e-43a1-a277-ef3317f310a9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:21:38.103052 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-059b3cd4-9869-40f8-96a6-9ef50ce28825 tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:21:38.103515 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-059b3cd4-9869-40f8-96a6-9ef50ce28825 tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:21:38.104316 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-059b3cd4-9869-40f8-96a6-9ef50ce28825 tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:21:38.104764 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-059b3cd4-9869-40f8-96a6-9ef50ce28825 tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:21:38.242967 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-059b3cd4-9869-40f8-96a6-9ef50ce28825 tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585670f672774f178f07e8cf2398b54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '295ec7c21a074bc4b8bdf0bcedf5e7a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:21:38.250784 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-059b3cd4-9869-40f8-96a6-9ef50ce28825 tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] 10.222.0.46 "GET /compute/v2.1/servers/4882d3ac-814e-43a1-a277-ef3317f310a9" status: 200 len: 1270 microversion: 2.1 time: 0.159965 Jan 15 21:21:38.251360 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3493/6997] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:21:38 2022] GET /compute/v2.1/servers/4882d3ac-814e-43a1-a277-ef3317f310a9 => generated 1270 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:21:39.268962 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-38a33eb6-5ed3-43b5-ab4b-9b1e2a96d158 tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:21:39.269656 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-38a33eb6-5ed3-43b5-ab4b-9b1e2a96d158 tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] [instance: 4882d3ac-814e-43a1-a277-ef3317f310a9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:21:39.276452 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-38a33eb6-5ed3-43b5-ab4b-9b1e2a96d158 tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:21:39.276927 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-38a33eb6-5ed3-43b5-ab4b-9b1e2a96d158 tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:21:39.277710 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-38a33eb6-5ed3-43b5-ab4b-9b1e2a96d158 tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:21:39.278149 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-38a33eb6-5ed3-43b5-ab4b-9b1e2a96d158 tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:21:39.421447 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-38a33eb6-5ed3-43b5-ab4b-9b1e2a96d158 tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585670f672774f178f07e8cf2398b54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '295ec7c21a074bc4b8bdf0bcedf5e7a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:21:39.429516 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-38a33eb6-5ed3-43b5-ab4b-9b1e2a96d158 tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] 10.222.0.46 "GET /compute/v2.1/servers/4882d3ac-814e-43a1-a277-ef3317f310a9" status: 200 len: 1270 microversion: 2.1 time: 0.165473 Jan 15 21:21:39.430098 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3505/6998] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:21:39 2022] GET /compute/v2.1/servers/4882d3ac-814e-43a1-a277-ef3317f310a9 => generated 1270 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:21:40.446990 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-43887a90-2bc8-4810-bc19-fc5dd66f7c78 tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:21:40.447603 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-43887a90-2bc8-4810-bc19-fc5dd66f7c78 tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] [instance: 4882d3ac-814e-43a1-a277-ef3317f310a9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:21:40.454321 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-43887a90-2bc8-4810-bc19-fc5dd66f7c78 tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:21:40.454784 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-43887a90-2bc8-4810-bc19-fc5dd66f7c78 tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:21:40.455568 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-43887a90-2bc8-4810-bc19-fc5dd66f7c78 tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:21:40.456013 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-43887a90-2bc8-4810-bc19-fc5dd66f7c78 tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:21:40.587519 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-43887a90-2bc8-4810-bc19-fc5dd66f7c78 tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585670f672774f178f07e8cf2398b54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '295ec7c21a074bc4b8bdf0bcedf5e7a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:21:40.594919 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-43887a90-2bc8-4810-bc19-fc5dd66f7c78 tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] 10.222.0.46 "GET /compute/v2.1/servers/4882d3ac-814e-43a1-a277-ef3317f310a9" status: 200 len: 1459 microversion: 2.1 time: 0.152301 Jan 15 21:21:40.595488 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3494/6999] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:21:40 2022] GET /compute/v2.1/servers/4882d3ac-814e-43a1-a277-ef3317f310a9 => generated 1459 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:21:40.610836 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-fefb454c-b993-436e-b99b-18bede897b1d tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:21:40.611442 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-fefb454c-b993-436e-b99b-18bede897b1d tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] [instance: 4882d3ac-814e-43a1-a277-ef3317f310a9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:21:40.618682 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fefb454c-b993-436e-b99b-18bede897b1d tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:21:40.619137 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fefb454c-b993-436e-b99b-18bede897b1d tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:21:40.619914 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fefb454c-b993-436e-b99b-18bede897b1d tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:21:40.620350 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fefb454c-b993-436e-b99b-18bede897b1d tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:21:40.754193 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-fefb454c-b993-436e-b99b-18bede897b1d tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585670f672774f178f07e8cf2398b54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '295ec7c21a074bc4b8bdf0bcedf5e7a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:21:40.762640 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-fefb454c-b993-436e-b99b-18bede897b1d tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] 10.222.0.46 "GET /compute/v2.1/servers/4882d3ac-814e-43a1-a277-ef3317f310a9" status: 200 len: 1459 microversion: 2.1 time: 0.155459 Jan 15 21:21:40.763213 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3506/7000] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:21:40 2022] GET /compute/v2.1/servers/4882d3ac-814e-43a1-a277-ef3317f310a9 => generated 1459 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:21:42.805293 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-6b2ad0d0-34c0-4b01-aa64-496ebd927f2e req-498661a5-8b5c-4246-a2cd-bb3e1fc6ffcd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4882d3ac-814e-43a1-a277-ef3317f310a9", "tag": "f4d625c8-a862-4b48-a735-42899f57aa0c"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:21:42.805293 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:21:42.805293 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:21:42.813942 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-6b2ad0d0-34c0-4b01-aa64-496ebd927f2e req-498661a5-8b5c-4246-a2cd-bb3e1fc6ffcd service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:21:42.814618 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-6b2ad0d0-34c0-4b01-aa64-496ebd927f2e req-498661a5-8b5c-4246-a2cd-bb3e1fc6ffcd service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:21:42.829460 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-6b2ad0d0-34c0-4b01-aa64-496ebd927f2e req-498661a5-8b5c-4246-a2cd-bb3e1fc6ffcd service nova] Creating event network-changed:f4d625c8-a862-4b48-a735-42899f57aa0c for instance 4882d3ac-814e-43a1-a277-ef3317f310a9 on nch2-master-1 Jan 15 21:21:42.837082 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-6b2ad0d0-34c0-4b01-aa64-496ebd927f2e req-498661a5-8b5c-4246-a2cd-bb3e1fc6ffcd service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037781 Jan 15 21:21:42.838088 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3495/7001] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:21:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:21:44.851458 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-7eb3ab8d-caef-4928-9b09-ffb021d72b9a req-be38bd10-7b42-488c-9b53-a23de1428e3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4882d3ac-814e-43a1-a277-ef3317f310a9", "tag": "f4d625c8-a862-4b48-a735-42899f57aa0c"}, {"name": "network-changed", "server_uuid": "4882d3ac-814e-43a1-a277-ef3317f310a9", "tag": "f4d625c8-a862-4b48-a735-42899f57aa0c"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:21:44.853114 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:21:44.853114 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:21:44.860510 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-7eb3ab8d-caef-4928-9b09-ffb021d72b9a req-be38bd10-7b42-488c-9b53-a23de1428e3c service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:21:44.861000 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-7eb3ab8d-caef-4928-9b09-ffb021d72b9a req-be38bd10-7b42-488c-9b53-a23de1428e3c service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:21:44.872625 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-7eb3ab8d-caef-4928-9b09-ffb021d72b9a req-be38bd10-7b42-488c-9b53-a23de1428e3c service nova] Creating event network-changed:f4d625c8-a862-4b48-a735-42899f57aa0c for instance 4882d3ac-814e-43a1-a277-ef3317f310a9 on nch2-master-1 Jan 15 21:21:44.873172 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-7eb3ab8d-caef-4928-9b09-ffb021d72b9a req-be38bd10-7b42-488c-9b53-a23de1428e3c service nova] Creating event network-changed:f4d625c8-a862-4b48-a735-42899f57aa0c for instance 4882d3ac-814e-43a1-a277-ef3317f310a9 on nch2-master-1 Jan 15 21:21:44.878088 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-7eb3ab8d-caef-4928-9b09-ffb021d72b9a req-be38bd10-7b42-488c-9b53-a23de1428e3c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.030461 Jan 15 21:21:44.879038 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3507/7002] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:21:44 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:22:27.185653 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-40ae6df0-fa83-4420-971c-0ae3f19939a3 tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:22:27.186696 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-40ae6df0-fa83-4420-971c-0ae3f19939a3 tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] [instance: 4882d3ac-814e-43a1-a277-ef3317f310a9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:22:27.190032 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-222def1a-7ac2-41a9-9943-8969bdd1ee1f req-6f144901-73cf-4978-9331-5b94cb44c189 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4882d3ac-814e-43a1-a277-ef3317f310a9", "tag": "f4d625c8-a862-4b48-a735-42899f57aa0c"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:22:27.191534 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:22:27.191534 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:22:27.200559 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-40ae6df0-fa83-4420-971c-0ae3f19939a3 tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:22:27.201329 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-40ae6df0-fa83-4420-971c-0ae3f19939a3 tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:22:27.202141 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-222def1a-7ac2-41a9-9943-8969bdd1ee1f req-6f144901-73cf-4978-9331-5b94cb44c189 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:22:27.202828 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-222def1a-7ac2-41a9-9943-8969bdd1ee1f req-6f144901-73cf-4978-9331-5b94cb44c189 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:22:27.203703 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-40ae6df0-fa83-4420-971c-0ae3f19939a3 tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:22:27.205032 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-40ae6df0-fa83-4420-971c-0ae3f19939a3 tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:22:27.218638 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-222def1a-7ac2-41a9-9943-8969bdd1ee1f req-6f144901-73cf-4978-9331-5b94cb44c189 service nova] Creating event network-changed:f4d625c8-a862-4b48-a735-42899f57aa0c for instance 4882d3ac-814e-43a1-a277-ef3317f310a9 on nch2-master-1 Jan 15 21:22:27.224625 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-222def1a-7ac2-41a9-9943-8969bdd1ee1f req-6f144901-73cf-4978-9331-5b94cb44c189 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038595 Jan 15 21:22:27.229666 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3508/7003] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:22:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 21:22:27.249801 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-40ae6df0-fa83-4420-971c-0ae3f19939a3 tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] [instance: 4882d3ac-814e-43a1-a277-ef3317f310a9] Going to try to terminate instance {{(pid=129365) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 21:22:27.408463 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-40ae6df0-fa83-4420-971c-0ae3f19939a3 tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] 10.222.0.46 "DELETE /compute/v2.1/servers/4882d3ac-814e-43a1-a277-ef3317f310a9" status: 204 len: 0 microversion: 2.1 time: 0.226750 Jan 15 21:22:27.408463 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3496/7004] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 21:22:27 2022] DELETE /compute/v2.1/servers/4882d3ac-814e-43a1-a277-ef3317f310a9 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 21:22:27.419891 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-21736144-0475-43b6-8882-90ec9aad2411 tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:22:27.420130 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-21736144-0475-43b6-8882-90ec9aad2411 tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] [instance: 4882d3ac-814e-43a1-a277-ef3317f310a9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:22:27.427795 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-21736144-0475-43b6-8882-90ec9aad2411 tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:22:27.429255 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-21736144-0475-43b6-8882-90ec9aad2411 tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:22:27.429473 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-21736144-0475-43b6-8882-90ec9aad2411 tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:22:27.429973 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-21736144-0475-43b6-8882-90ec9aad2411 tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:22:27.611293 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-21736144-0475-43b6-8882-90ec9aad2411 tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585670f672774f178f07e8cf2398b54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '295ec7c21a074bc4b8bdf0bcedf5e7a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:22:27.621083 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-21736144-0475-43b6-8882-90ec9aad2411 tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] 10.222.0.46 "GET /compute/v2.1/servers/4882d3ac-814e-43a1-a277-ef3317f310a9" status: 200 len: 1584 microversion: 2.1 time: 0.206605 Jan 15 21:22:27.621739 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3509/7005] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:22:27 2022] GET /compute/v2.1/servers/4882d3ac-814e-43a1-a277-ef3317f310a9 => generated 1584 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:22:28.640531 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-80def36c-f5bf-49e6-8382-f36077a395ef tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:22:28.641181 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-80def36c-f5bf-49e6-8382-f36077a395ef tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] [instance: 4882d3ac-814e-43a1-a277-ef3317f310a9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:22:28.648697 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-80def36c-f5bf-49e6-8382-f36077a395ef tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:22:28.649188 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-80def36c-f5bf-49e6-8382-f36077a395ef tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:22:28.649977 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-80def36c-f5bf-49e6-8382-f36077a395ef tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:22:28.650425 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-80def36c-f5bf-49e6-8382-f36077a395ef tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:22:28.784192 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-80def36c-f5bf-49e6-8382-f36077a395ef tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585670f672774f178f07e8cf2398b54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '295ec7c21a074bc4b8bdf0bcedf5e7a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:22:28.791907 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-80def36c-f5bf-49e6-8382-f36077a395ef tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] 10.222.0.46 "GET /compute/v2.1/servers/4882d3ac-814e-43a1-a277-ef3317f310a9" status: 200 len: 1465 microversion: 2.1 time: 0.155513 Jan 15 21:22:28.792485 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3497/7006] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:22:28 2022] GET /compute/v2.1/servers/4882d3ac-814e-43a1-a277-ef3317f310a9 => generated 1465 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:22:29.656453 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-b191047b-884b-4b96-8eb9-0a4476a9d535 req-6de4d27d-8693-4f3c-a09a-990017a58872 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4882d3ac-814e-43a1-a277-ef3317f310a9", "name": "network-vif-deleted", "tag": "f4d625c8-a862-4b48-a735-42899f57aa0c"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:22:29.658285 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:22:29.658285 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:22:29.667062 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-b191047b-884b-4b96-8eb9-0a4476a9d535 req-6de4d27d-8693-4f3c-a09a-990017a58872 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:22:29.667504 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-b191047b-884b-4b96-8eb9-0a4476a9d535 req-6de4d27d-8693-4f3c-a09a-990017a58872 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:22:29.679106 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-b191047b-884b-4b96-8eb9-0a4476a9d535 req-6de4d27d-8693-4f3c-a09a-990017a58872 service nova] Creating event network-vif-deleted:f4d625c8-a862-4b48-a735-42899f57aa0c for instance 4882d3ac-814e-43a1-a277-ef3317f310a9 on nch2-master-1 Jan 15 21:22:29.684109 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-b191047b-884b-4b96-8eb9-0a4476a9d535 req-6de4d27d-8693-4f3c-a09a-990017a58872 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031376 Jan 15 21:22:29.684716 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3510/7007] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:22:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:22:29.809342 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-36e49b70-15db-4e8a-af8b-11d81ad6008a tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:22:29.809894 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-36e49b70-15db-4e8a-af8b-11d81ad6008a tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] [instance: 4882d3ac-814e-43a1-a277-ef3317f310a9] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:22:29.817657 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-36e49b70-15db-4e8a-af8b-11d81ad6008a tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:22:29.817657 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-36e49b70-15db-4e8a-af8b-11d81ad6008a tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:22:29.817930 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-36e49b70-15db-4e8a-af8b-11d81ad6008a tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:22:29.818272 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-36e49b70-15db-4e8a-af8b-11d81ad6008a tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:22:29.886904 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-36e49b70-15db-4e8a-af8b-11d81ad6008a tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585670f672774f178f07e8cf2398b54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '295ec7c21a074bc4b8bdf0bcedf5e7a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:22:29.895370 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-36e49b70-15db-4e8a-af8b-11d81ad6008a tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] 10.222.0.46 "GET /compute/v2.1/servers/4882d3ac-814e-43a1-a277-ef3317f310a9" status: 200 len: 1230 microversion: 2.1 time: 0.089079 Jan 15 21:22:29.896061 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3498/7008] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:22:29 2022] GET /compute/v2.1/servers/4882d3ac-814e-43a1-a277-ef3317f310a9 => generated 1230 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:22:30.913729 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7616fa13-bc96-4e8f-95be-f0dc6b190b9d tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:22:30.914432 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-7616fa13-bc96-4e8f-95be-f0dc6b190b9d tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] [instance: 4882d3ac-814e-43a1-a277-ef3317f310a9] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:22:30.920534 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7616fa13-bc96-4e8f-95be-f0dc6b190b9d tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:22:30.921018 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7616fa13-bc96-4e8f-95be-f0dc6b190b9d tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:22:30.921785 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7616fa13-bc96-4e8f-95be-f0dc6b190b9d tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:22:30.922211 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7616fa13-bc96-4e8f-95be-f0dc6b190b9d tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:22:30.935607 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-7616fa13-bc96-4e8f-95be-f0dc6b190b9d tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] HTTP exception thrown: Instance 4882d3ac-814e-43a1-a277-ef3317f310a9 could not be found. Jan 15 21:22:30.936195 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7616fa13-bc96-4e8f-95be-f0dc6b190b9d tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] Returning 404 to user: Instance 4882d3ac-814e-43a1-a277-ef3317f310a9 could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:22:30.937053 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7616fa13-bc96-4e8f-95be-f0dc6b190b9d tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] 10.222.0.46 "GET /compute/v2.1/servers/4882d3ac-814e-43a1-a277-ef3317f310a9" status: 404 len: 111 microversion: 2.1 time: 0.028535 Jan 15 21:22:30.937597 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3511/7009] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:22:30 2022] GET /compute/v2.1/servers/4882d3ac-814e-43a1-a277-ef3317f310a9 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:22:31.098553 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-6baeb742-f669-4406-8a40-2352c77cfd82 tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] Calling method '.version_select at 0x7f30c8371a60>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:22:31.118217 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-6baeb742-f669-4406-8a40-2352c77cfd82 tempest-TestVolumeBackupRestore-1457821269 tempest-TestVolumeBackupRestore-1457821269-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1999422895" status: 202 len: 0 microversion: 2.1 time: 0.023214 Jan 15 21:22:31.119169 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3499/7010] 10.222.0.46 () {58 vars in 1268 bytes} [Sat Jan 15 21:22:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1999422895 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:22:58.732343 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f9d05660-0615-4def-a1b8-38c10436ef4a tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:22:58.732965 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f9d05660-0615-4def-a1b8-38c10436ef4a tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: b4f980ed-4669-4cfc-b196-aecea77de875] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:22:58.738935 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f9d05660-0615-4def-a1b8-38c10436ef4a tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:22:58.739392 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f9d05660-0615-4def-a1b8-38c10436ef4a tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:22:58.740203 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f9d05660-0615-4def-a1b8-38c10436ef4a tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:22:58.740641 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f9d05660-0615-4def-a1b8-38c10436ef4a tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:22:58.765223 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f9d05660-0615-4def-a1b8-38c10436ef4a tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: b4f980ed-4669-4cfc-b196-aecea77de875] Going to try to terminate instance {{(pid=129366) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 21:22:58.841798 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f9d05660-0615-4def-a1b8-38c10436ef4a tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] 10.222.0.46 "DELETE /compute/v2.1/servers/b4f980ed-4669-4cfc-b196-aecea77de875" status: 204 len: 0 microversion: 2.1 time: 0.112440 Jan 15 21:22:58.842606 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3512/7011] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 21:22:58 2022] DELETE /compute/v2.1/servers/b4f980ed-4669-4cfc-b196-aecea77de875 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 21:22:58.854638 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-94ab22db-dcb3-4e45-9246-02479056c0d9 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:22:58.855253 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-94ab22db-dcb3-4e45-9246-02479056c0d9 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: b4f980ed-4669-4cfc-b196-aecea77de875] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:22:58.861895 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-94ab22db-dcb3-4e45-9246-02479056c0d9 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:22:58.862355 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-94ab22db-dcb3-4e45-9246-02479056c0d9 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:22:58.863134 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-94ab22db-dcb3-4e45-9246-02479056c0d9 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:22:58.863579 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-94ab22db-dcb3-4e45-9246-02479056c0d9 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:22:58.999655 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-94ab22db-dcb3-4e45-9246-02479056c0d9 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fc1955b0d446458f8f355550de971b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ae6f05c2843469190cd96f39ac794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:22:59.007086 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-94ab22db-dcb3-4e45-9246-02479056c0d9 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] 10.222.0.46 "GET /compute/v2.1/servers/b4f980ed-4669-4cfc-b196-aecea77de875" status: 200 len: 1578 microversion: 2.1 time: 0.158528 Jan 15 21:22:59.007656 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3500/7012] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:22:58 2022] GET /compute/v2.1/servers/b4f980ed-4669-4cfc-b196-aecea77de875 => generated 1578 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:23:00.025073 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b8e1a546-2c78-48d0-a67d-fd650eeb74b0 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:23:00.025805 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b8e1a546-2c78-48d0-a67d-fd650eeb74b0 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: b4f980ed-4669-4cfc-b196-aecea77de875] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:23:00.032822 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b8e1a546-2c78-48d0-a67d-fd650eeb74b0 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:23:00.033307 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b8e1a546-2c78-48d0-a67d-fd650eeb74b0 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:23:00.034291 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b8e1a546-2c78-48d0-a67d-fd650eeb74b0 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:23:00.034735 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b8e1a546-2c78-48d0-a67d-fd650eeb74b0 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:23:00.166061 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-b8e1a546-2c78-48d0-a67d-fd650eeb74b0 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fc1955b0d446458f8f355550de971b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ae6f05c2843469190cd96f39ac794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:23:00.173706 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b8e1a546-2c78-48d0-a67d-fd650eeb74b0 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] 10.222.0.46 "GET /compute/v2.1/servers/b4f980ed-4669-4cfc-b196-aecea77de875" status: 200 len: 1578 microversion: 2.1 time: 0.153009 Jan 15 21:23:00.174293 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3513/7013] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:23:00 2022] GET /compute/v2.1/servers/b4f980ed-4669-4cfc-b196-aecea77de875 => generated 1578 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:23:01.191534 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d7e1a0d3-4897-40e6-8685-7d14cf2f3c50 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:23:01.192151 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d7e1a0d3-4897-40e6-8685-7d14cf2f3c50 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: b4f980ed-4669-4cfc-b196-aecea77de875] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:23:01.200016 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d7e1a0d3-4897-40e6-8685-7d14cf2f3c50 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:23:01.200485 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d7e1a0d3-4897-40e6-8685-7d14cf2f3c50 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:23:01.201344 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d7e1a0d3-4897-40e6-8685-7d14cf2f3c50 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:23:01.201822 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d7e1a0d3-4897-40e6-8685-7d14cf2f3c50 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:23:01.227552 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-353d9e6e-9ae8-4d36-8b3d-99820808e634 req-07355ce3-9d98-4498-b369-94fb55e21c33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4f980ed-4669-4cfc-b196-aecea77de875", "name": "network-vif-deleted", "tag": "f70df7d5-47e6-45b0-9a91-605cfa5f5d33"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:23:01.229081 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:23:01.229081 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:23:01.247510 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-353d9e6e-9ae8-4d36-8b3d-99820808e634 req-07355ce3-9d98-4498-b369-94fb55e21c33 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:23:01.255590 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-353d9e6e-9ae8-4d36-8b3d-99820808e634 req-07355ce3-9d98-4498-b369-94fb55e21c33 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:23:01.268259 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-353d9e6e-9ae8-4d36-8b3d-99820808e634 req-07355ce3-9d98-4498-b369-94fb55e21c33 service nova] Creating event network-vif-deleted:f70df7d5-47e6-45b0-9a91-605cfa5f5d33 for instance b4f980ed-4669-4cfc-b196-aecea77de875 on nch1-master-1 Jan 15 21:23:01.274296 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-353d9e6e-9ae8-4d36-8b3d-99820808e634 req-07355ce3-9d98-4498-b369-94fb55e21c33 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050417 Jan 15 21:23:01.275487 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3514/7014] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:23:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 21:23:01.336993 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-d7e1a0d3-4897-40e6-8685-7d14cf2f3c50 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fc1955b0d446458f8f355550de971b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ae6f05c2843469190cd96f39ac794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:23:01.346205 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d7e1a0d3-4897-40e6-8685-7d14cf2f3c50 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] 10.222.0.46 "GET /compute/v2.1/servers/b4f980ed-4669-4cfc-b196-aecea77de875" status: 200 len: 1510 microversion: 2.1 time: 0.158490 Jan 15 21:23:01.347992 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3501/7015] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:23:01 2022] GET /compute/v2.1/servers/b4f980ed-4669-4cfc-b196-aecea77de875 => generated 1510 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:23:02.366912 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-2727ff6e-b2ef-4ebf-a084-85f6d0219f3f tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:23:02.368133 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-2727ff6e-b2ef-4ebf-a084-85f6d0219f3f tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: b4f980ed-4669-4cfc-b196-aecea77de875] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:23:02.374554 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2727ff6e-b2ef-4ebf-a084-85f6d0219f3f tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:23:02.375580 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2727ff6e-b2ef-4ebf-a084-85f6d0219f3f tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:23:02.376182 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2727ff6e-b2ef-4ebf-a084-85f6d0219f3f tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:23:02.376182 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2727ff6e-b2ef-4ebf-a084-85f6d0219f3f tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:23:02.390101 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-2727ff6e-b2ef-4ebf-a084-85f6d0219f3f tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] HTTP exception thrown: Instance b4f980ed-4669-4cfc-b196-aecea77de875 could not be found. Jan 15 21:23:02.390687 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-2727ff6e-b2ef-4ebf-a084-85f6d0219f3f tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Returning 404 to user: Instance b4f980ed-4669-4cfc-b196-aecea77de875 could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:23:02.391547 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-2727ff6e-b2ef-4ebf-a084-85f6d0219f3f tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] 10.222.0.46 "GET /compute/v2.1/servers/b4f980ed-4669-4cfc-b196-aecea77de875" status: 404 len: 111 microversion: 2.1 time: 0.030530 Jan 15 21:23:02.392089 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3515/7016] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:23:02 2022] GET /compute/v2.1/servers/b4f980ed-4669-4cfc-b196-aecea77de875 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:23:02.486676 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-1994ab5e-709b-4b59-b8c2-5ee28c276383 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-746237966", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-441039095", "security_groups": [{"name": "tempest-secgroup-smoke-1645086404"}], "block_device_mapping_v2": [{"uuid": "dbdfa075-f51a-46ac-b2a2-565a50bd7426", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "250ac663-a6c2-4755-b702-91a1aec1e824"}]}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:23:02.595582 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.network.neutron [None req-1994ab5e-709b-4b59-b8c2-5ee28c276383 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] validate_networks() for [('250ac663-a6c2-4755-b702-91a1aec1e824', None, None, None, None, None)] {{(pid=129365) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 21:23:03.399383 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-1994ab5e-709b-4b59-b8c2-5ee28c276383 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Flavor limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 21:23:03.399812 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-1994ab5e-709b-4b59-b8c2-5ee28c276383 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Image limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 21:23:03.400288 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-1994ab5e-709b-4b59-b8c2-5ee28c276383 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Flavor pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 21:23:03.400704 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-1994ab5e-709b-4b59-b8c2-5ee28c276383 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Image pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 21:23:03.401142 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-1994ab5e-709b-4b59-b8c2-5ee28c276383 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 21:23:03.410145 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1994ab5e-709b-4b59-b8c2-5ee28c276383 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:23:03.410600 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1994ab5e-709b-4b59-b8c2-5ee28c276383 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:23:03.411416 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1994ab5e-709b-4b59-b8c2-5ee28c276383 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:23:03.411859 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1994ab5e-709b-4b59-b8c2-5ee28c276383 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:23:03.428513 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-1994ab5e-709b-4b59-b8c2-5ee28c276383 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Getting quotas for project 7f2ae6f05c2843469190cd96f39ac794. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:23:03.433675 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-1994ab5e-709b-4b59-b8c2-5ee28c276383 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Getting quotas for user f0fc1955b0d446458f8f355550de971b and project 7f2ae6f05c2843469190cd96f39ac794. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:23:03.491467 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-1994ab5e-709b-4b59-b8c2-5ee28c276383 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Going to run 1 instances... {{(pid=129365) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 21:23:03.493677 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-1994ab5e-709b-4b59-b8c2-5ee28c276383 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: 09b5e585-22e2-410f-a734-73c1e5b2aace] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='dbdfa075-f51a-46ac-b2a2-565a50bd7426',volume_size=None,volume_type=None)] {{(pid=129365) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 21:23:03.616731 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-1994ab5e-709b-4b59-b8c2-5ee28c276383 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.133579 Jan 15 21:23:03.617422 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3502/7017] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 21:23:02 2022] POST /compute/v2.1/servers => generated 406 bytes in 1135 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 21:23:03.629704 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-36fc9311-262d-458f-bb3d-e1c05c45cf0f tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:23:03.630313 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-36fc9311-262d-458f-bb3d-e1c05c45cf0f tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: 09b5e585-22e2-410f-a734-73c1e5b2aace] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:23:03.684720 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-36fc9311-262d-458f-bb3d-e1c05c45cf0f tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fc1955b0d446458f8f355550de971b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ae6f05c2843469190cd96f39ac794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:23:03.691969 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-36fc9311-262d-458f-bb3d-e1c05c45cf0f tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] 10.222.0.46 "GET /compute/v2.1/servers/09b5e585-22e2-410f-a734-73c1e5b2aace" status: 200 len: 1093 microversion: 2.1 time: 0.066030 Jan 15 21:23:03.692527 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3516/7018] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:23:03 2022] GET /compute/v2.1/servers/09b5e585-22e2-410f-a734-73c1e5b2aace => generated 1093 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:23:04.708746 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f653b66e-b262-406f-9d46-dfe519a1e956 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:23:04.709873 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f653b66e-b262-406f-9d46-dfe519a1e956 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: 09b5e585-22e2-410f-a734-73c1e5b2aace] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:23:04.761868 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-f653b66e-b262-406f-9d46-dfe519a1e956 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fc1955b0d446458f8f355550de971b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ae6f05c2843469190cd96f39ac794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:23:04.768448 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f653b66e-b262-406f-9d46-dfe519a1e956 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] 10.222.0.46 "GET /compute/v2.1/servers/09b5e585-22e2-410f-a734-73c1e5b2aace" status: 200 len: 1093 microversion: 2.1 time: 0.063466 Jan 15 21:23:04.769054 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3503/7019] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:23:04 2022] GET /compute/v2.1/servers/09b5e585-22e2-410f-a734-73c1e5b2aace => generated 1093 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:23:05.785709 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-558d4572-99b0-4e54-9431-96e4c9deda9e tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:23:05.786414 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-558d4572-99b0-4e54-9431-96e4c9deda9e tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: 09b5e585-22e2-410f-a734-73c1e5b2aace] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:23:05.844180 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-558d4572-99b0-4e54-9431-96e4c9deda9e tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fc1955b0d446458f8f355550de971b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ae6f05c2843469190cd96f39ac794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:23:05.851675 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-558d4572-99b0-4e54-9431-96e4c9deda9e tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] 10.222.0.46 "GET /compute/v2.1/servers/09b5e585-22e2-410f-a734-73c1e5b2aace" status: 200 len: 1093 microversion: 2.1 time: 0.069947 Jan 15 21:23:05.852248 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3517/7020] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:23:05 2022] GET /compute/v2.1/servers/09b5e585-22e2-410f-a734-73c1e5b2aace => generated 1093 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:23:06.868028 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f79115a3-0956-4634-8e52-76fe2df179c6 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:23:06.868774 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f79115a3-0956-4634-8e52-76fe2df179c6 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: 09b5e585-22e2-410f-a734-73c1e5b2aace] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:23:06.921520 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-f79115a3-0956-4634-8e52-76fe2df179c6 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fc1955b0d446458f8f355550de971b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ae6f05c2843469190cd96f39ac794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:23:06.929317 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f79115a3-0956-4634-8e52-76fe2df179c6 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] 10.222.0.46 "GET /compute/v2.1/servers/09b5e585-22e2-410f-a734-73c1e5b2aace" status: 200 len: 1093 microversion: 2.1 time: 0.065507 Jan 15 21:23:06.929941 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3504/7021] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:23:06 2022] GET /compute/v2.1/servers/09b5e585-22e2-410f-a734-73c1e5b2aace => generated 1093 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:23:07.946592 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ecd1f8aa-3fee-471d-8c6d-e529fbfed586 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:23:07.947194 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ecd1f8aa-3fee-471d-8c6d-e529fbfed586 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: 09b5e585-22e2-410f-a734-73c1e5b2aace] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:23:07.954331 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ecd1f8aa-3fee-471d-8c6d-e529fbfed586 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:23:07.954779 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ecd1f8aa-3fee-471d-8c6d-e529fbfed586 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:23:07.955549 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ecd1f8aa-3fee-471d-8c6d-e529fbfed586 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:23:07.955980 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ecd1f8aa-3fee-471d-8c6d-e529fbfed586 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:23:08.017566 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-ecd1f8aa-3fee-471d-8c6d-e529fbfed586 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fc1955b0d446458f8f355550de971b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ae6f05c2843469190cd96f39ac794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:23:08.025120 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ecd1f8aa-3fee-471d-8c6d-e529fbfed586 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] 10.222.0.46 "GET /compute/v2.1/servers/09b5e585-22e2-410f-a734-73c1e5b2aace" status: 200 len: 1143 microversion: 2.1 time: 0.082895 Jan 15 21:23:08.025706 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3518/7022] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:23:07 2022] GET /compute/v2.1/servers/09b5e585-22e2-410f-a734-73c1e5b2aace => generated 1143 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:23:09.042508 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-71dfaa0d-cebc-4fb6-ba7f-d80b476cb4a9 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:23:09.043179 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-71dfaa0d-cebc-4fb6-ba7f-d80b476cb4a9 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: 09b5e585-22e2-410f-a734-73c1e5b2aace] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:23:09.050674 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-71dfaa0d-cebc-4fb6-ba7f-d80b476cb4a9 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:23:09.051328 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-71dfaa0d-cebc-4fb6-ba7f-d80b476cb4a9 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:23:09.052568 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-71dfaa0d-cebc-4fb6-ba7f-d80b476cb4a9 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:23:09.052747 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-71dfaa0d-cebc-4fb6-ba7f-d80b476cb4a9 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:23:09.114881 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-71dfaa0d-cebc-4fb6-ba7f-d80b476cb4a9 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fc1955b0d446458f8f355550de971b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ae6f05c2843469190cd96f39ac794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:23:09.123785 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-71dfaa0d-cebc-4fb6-ba7f-d80b476cb4a9 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] 10.222.0.46 "GET /compute/v2.1/servers/09b5e585-22e2-410f-a734-73c1e5b2aace" status: 200 len: 1209 microversion: 2.1 time: 0.085074 Jan 15 21:23:09.124366 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3505/7023] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:23:09 2022] GET /compute/v2.1/servers/09b5e585-22e2-410f-a734-73c1e5b2aace => generated 1209 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:23:10.027252 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-3a588450-f845-4538-b4cb-70417cec5ea4 req-d0521d98-1224-4dc0-b085-c0b4c04f5b12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09b5e585-22e2-410f-a734-73c1e5b2aace", "tag": "a28a42a0-433d-4c6a-b9e1-8345775f4b05"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:23:10.029294 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:23:10.029294 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:23:10.065393 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-3a588450-f845-4538-b4cb-70417cec5ea4 req-d0521d98-1224-4dc0-b085-c0b4c04f5b12 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:23:10.065835 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-3a588450-f845-4538-b4cb-70417cec5ea4 req-d0521d98-1224-4dc0-b085-c0b4c04f5b12 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:23:10.084588 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-3a588450-f845-4538-b4cb-70417cec5ea4 req-d0521d98-1224-4dc0-b085-c0b4c04f5b12 service nova] Creating event network-changed:a28a42a0-433d-4c6a-b9e1-8345775f4b05 for instance 09b5e585-22e2-410f-a734-73c1e5b2aace on nch2-master-1 Jan 15 21:23:10.090649 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-3a588450-f845-4538-b4cb-70417cec5ea4 req-d0521d98-1224-4dc0-b085-c0b4c04f5b12 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068644 Jan 15 21:23:10.091259 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3519/7024] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:23:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:23:10.142013 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a4b4ad3d-8ded-40a3-813c-a9aa4619ee39 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:23:10.142628 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a4b4ad3d-8ded-40a3-813c-a9aa4619ee39 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: 09b5e585-22e2-410f-a734-73c1e5b2aace] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:23:10.150883 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a4b4ad3d-8ded-40a3-813c-a9aa4619ee39 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:23:10.151349 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a4b4ad3d-8ded-40a3-813c-a9aa4619ee39 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:23:10.152150 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a4b4ad3d-8ded-40a3-813c-a9aa4619ee39 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:23:10.152594 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a4b4ad3d-8ded-40a3-813c-a9aa4619ee39 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:23:10.310876 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-a4b4ad3d-8ded-40a3-813c-a9aa4619ee39 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fc1955b0d446458f8f355550de971b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ae6f05c2843469190cd96f39ac794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:23:10.319178 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a4b4ad3d-8ded-40a3-813c-a9aa4619ee39 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] 10.222.0.46 "GET /compute/v2.1/servers/09b5e585-22e2-410f-a734-73c1e5b2aace" status: 200 len: 1265 microversion: 2.1 time: 0.180984 Jan 15 21:23:10.319769 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3506/7025] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:23:10 2022] GET /compute/v2.1/servers/09b5e585-22e2-410f-a734-73c1e5b2aace => generated 1265 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:23:11.337018 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-2724256c-8984-4529-bc9d-6b4767637968 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:23:11.337714 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-2724256c-8984-4529-bc9d-6b4767637968 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: 09b5e585-22e2-410f-a734-73c1e5b2aace] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:23:11.343876 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2724256c-8984-4529-bc9d-6b4767637968 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:23:11.344326 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2724256c-8984-4529-bc9d-6b4767637968 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:23:11.345163 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2724256c-8984-4529-bc9d-6b4767637968 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:23:11.345601 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2724256c-8984-4529-bc9d-6b4767637968 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:23:11.480606 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-2724256c-8984-4529-bc9d-6b4767637968 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fc1955b0d446458f8f355550de971b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ae6f05c2843469190cd96f39ac794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:23:11.488610 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-2724256c-8984-4529-bc9d-6b4767637968 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] 10.222.0.46 "GET /compute/v2.1/servers/09b5e585-22e2-410f-a734-73c1e5b2aace" status: 200 len: 1265 microversion: 2.1 time: 0.156457 Jan 15 21:23:11.489231 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3520/7026] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:23:11 2022] GET /compute/v2.1/servers/09b5e585-22e2-410f-a734-73c1e5b2aace => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:23:12.505968 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-27df4d81-8eb7-470c-aeb2-d86b0253b3c9 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:23:12.506624 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-27df4d81-8eb7-470c-aeb2-d86b0253b3c9 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: 09b5e585-22e2-410f-a734-73c1e5b2aace] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:23:12.513406 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-27df4d81-8eb7-470c-aeb2-d86b0253b3c9 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:23:12.513868 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-27df4d81-8eb7-470c-aeb2-d86b0253b3c9 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:23:12.514649 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-27df4d81-8eb7-470c-aeb2-d86b0253b3c9 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:23:12.515093 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-27df4d81-8eb7-470c-aeb2-d86b0253b3c9 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:23:12.647553 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-27df4d81-8eb7-470c-aeb2-d86b0253b3c9 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fc1955b0d446458f8f355550de971b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ae6f05c2843469190cd96f39ac794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:23:12.655013 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-27df4d81-8eb7-470c-aeb2-d86b0253b3c9 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] 10.222.0.46 "GET /compute/v2.1/servers/09b5e585-22e2-410f-a734-73c1e5b2aace" status: 200 len: 1265 microversion: 2.1 time: 0.153299 Jan 15 21:23:12.655607 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3507/7027] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:23:12 2022] GET /compute/v2.1/servers/09b5e585-22e2-410f-a734-73c1e5b2aace => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:23:13.673407 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7732f4fc-24ec-4dad-ba69-e32944408f43 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:23:13.674043 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-7732f4fc-24ec-4dad-ba69-e32944408f43 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: 09b5e585-22e2-410f-a734-73c1e5b2aace] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:23:13.681941 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7732f4fc-24ec-4dad-ba69-e32944408f43 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:23:13.682382 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7732f4fc-24ec-4dad-ba69-e32944408f43 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:23:13.683153 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7732f4fc-24ec-4dad-ba69-e32944408f43 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:23:13.683586 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7732f4fc-24ec-4dad-ba69-e32944408f43 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:23:13.819383 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-7732f4fc-24ec-4dad-ba69-e32944408f43 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fc1955b0d446458f8f355550de971b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ae6f05c2843469190cd96f39ac794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:23:13.826965 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7732f4fc-24ec-4dad-ba69-e32944408f43 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] 10.222.0.46 "GET /compute/v2.1/servers/09b5e585-22e2-410f-a734-73c1e5b2aace" status: 200 len: 1265 microversion: 2.1 time: 0.158005 Jan 15 21:23:13.827546 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3521/7028] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:23:13 2022] GET /compute/v2.1/servers/09b5e585-22e2-410f-a734-73c1e5b2aace => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:23:14.843671 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-7a9d550a-7fc1-426d-abf0-1b384074872c tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:23:14.844293 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-7a9d550a-7fc1-426d-abf0-1b384074872c tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: 09b5e585-22e2-410f-a734-73c1e5b2aace] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:23:14.851186 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7a9d550a-7fc1-426d-abf0-1b384074872c tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:23:14.851650 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7a9d550a-7fc1-426d-abf0-1b384074872c tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:23:14.852437 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7a9d550a-7fc1-426d-abf0-1b384074872c tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:23:14.852936 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7a9d550a-7fc1-426d-abf0-1b384074872c tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:23:14.985764 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-7a9d550a-7fc1-426d-abf0-1b384074872c tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fc1955b0d446458f8f355550de971b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ae6f05c2843469190cd96f39ac794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:23:14.994588 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-7a9d550a-7fc1-426d-abf0-1b384074872c tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] 10.222.0.46 "GET /compute/v2.1/servers/09b5e585-22e2-410f-a734-73c1e5b2aace" status: 200 len: 1265 microversion: 2.1 time: 0.154625 Jan 15 21:23:14.995182 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3508/7029] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:23:14 2022] GET /compute/v2.1/servers/09b5e585-22e2-410f-a734-73c1e5b2aace => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:23:16.012133 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0fabecfa-48b8-4f36-b782-7e3a01ae926f tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:23:16.012720 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-0fabecfa-48b8-4f36-b782-7e3a01ae926f tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: 09b5e585-22e2-410f-a734-73c1e5b2aace] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:23:16.019501 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0fabecfa-48b8-4f36-b782-7e3a01ae926f tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:23:16.019947 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0fabecfa-48b8-4f36-b782-7e3a01ae926f tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:23:16.020714 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0fabecfa-48b8-4f36-b782-7e3a01ae926f tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:23:16.021286 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0fabecfa-48b8-4f36-b782-7e3a01ae926f tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:23:16.153489 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-0fabecfa-48b8-4f36-b782-7e3a01ae926f tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fc1955b0d446458f8f355550de971b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ae6f05c2843469190cd96f39ac794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:23:16.161038 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0fabecfa-48b8-4f36-b782-7e3a01ae926f tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] 10.222.0.46 "GET /compute/v2.1/servers/09b5e585-22e2-410f-a734-73c1e5b2aace" status: 200 len: 1265 microversion: 2.1 time: 0.152748 Jan 15 21:23:16.162052 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3522/7030] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:23:16 2022] GET /compute/v2.1/servers/09b5e585-22e2-410f-a734-73c1e5b2aace => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:23:16.505109 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-e8f2208f-3d74-4034-b06a-2d48589dcb2a req-373e0b47-cc49-4dce-92de-b3ebcd5d6c08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09b5e585-22e2-410f-a734-73c1e5b2aace", "name": "network-vif-plugged", "status": "completed", "tag": "a28a42a0-433d-4c6a-b9e1-8345775f4b05"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:23:16.507365 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:23:16.507365 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:23:16.515645 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-e8f2208f-3d74-4034-b06a-2d48589dcb2a req-373e0b47-cc49-4dce-92de-b3ebcd5d6c08 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:23:16.516107 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-e8f2208f-3d74-4034-b06a-2d48589dcb2a req-373e0b47-cc49-4dce-92de-b3ebcd5d6c08 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:23:16.528464 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-e8f2208f-3d74-4034-b06a-2d48589dcb2a req-373e0b47-cc49-4dce-92de-b3ebcd5d6c08 service nova] Creating event network-vif-plugged:a28a42a0-433d-4c6a-b9e1-8345775f4b05 for instance 09b5e585-22e2-410f-a734-73c1e5b2aace on nch2-master-1 Jan 15 21:23:16.533762 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-e8f2208f-3d74-4034-b06a-2d48589dcb2a req-373e0b47-cc49-4dce-92de-b3ebcd5d6c08 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032381 Jan 15 21:23:16.534420 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3509/7031] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:23:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:23:17.177868 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-6016a02a-3e29-4fc7-ae8f-f90579ab5114 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:23:17.178462 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-6016a02a-3e29-4fc7-ae8f-f90579ab5114 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: 09b5e585-22e2-410f-a734-73c1e5b2aace] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:23:17.185235 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6016a02a-3e29-4fc7-ae8f-f90579ab5114 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:23:17.185684 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6016a02a-3e29-4fc7-ae8f-f90579ab5114 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:23:17.186452 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6016a02a-3e29-4fc7-ae8f-f90579ab5114 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:23:17.186885 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6016a02a-3e29-4fc7-ae8f-f90579ab5114 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:23:17.318703 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-6016a02a-3e29-4fc7-ae8f-f90579ab5114 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fc1955b0d446458f8f355550de971b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ae6f05c2843469190cd96f39ac794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:23:17.326385 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-6016a02a-3e29-4fc7-ae8f-f90579ab5114 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] 10.222.0.46 "GET /compute/v2.1/servers/09b5e585-22e2-410f-a734-73c1e5b2aace" status: 200 len: 1265 microversion: 2.1 time: 0.152315 Jan 15 21:23:17.326955 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3523/7032] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:23:17 2022] GET /compute/v2.1/servers/09b5e585-22e2-410f-a734-73c1e5b2aace => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:23:18.344713 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d6f2d005-d95f-40ae-9089-5180ec098d66 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:23:18.345459 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d6f2d005-d95f-40ae-9089-5180ec098d66 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: 09b5e585-22e2-410f-a734-73c1e5b2aace] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:23:18.359097 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d6f2d005-d95f-40ae-9089-5180ec098d66 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:23:18.359817 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d6f2d005-d95f-40ae-9089-5180ec098d66 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:23:18.361122 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d6f2d005-d95f-40ae-9089-5180ec098d66 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:23:18.361828 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d6f2d005-d95f-40ae-9089-5180ec098d66 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:23:18.502224 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-d6f2d005-d95f-40ae-9089-5180ec098d66 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fc1955b0d446458f8f355550de971b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ae6f05c2843469190cd96f39ac794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:23:18.510841 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d6f2d005-d95f-40ae-9089-5180ec098d66 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] 10.222.0.46 "GET /compute/v2.1/servers/09b5e585-22e2-410f-a734-73c1e5b2aace" status: 200 len: 1453 microversion: 2.1 time: 0.170398 Jan 15 21:23:18.516915 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3510/7033] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:23:18 2022] GET /compute/v2.1/servers/09b5e585-22e2-410f-a734-73c1e5b2aace => generated 1453 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:23:18.530426 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a3dadc32-fa42-4113-a9a5-bd261b3eac3f tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:23:18.531082 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a3dadc32-fa42-4113-a9a5-bd261b3eac3f tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: 09b5e585-22e2-410f-a734-73c1e5b2aace] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:23:18.540976 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a3dadc32-fa42-4113-a9a5-bd261b3eac3f tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:23:18.541441 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a3dadc32-fa42-4113-a9a5-bd261b3eac3f tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:23:18.542251 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a3dadc32-fa42-4113-a9a5-bd261b3eac3f tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:23:18.542692 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a3dadc32-fa42-4113-a9a5-bd261b3eac3f tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:23:18.679212 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-a3dadc32-fa42-4113-a9a5-bd261b3eac3f tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fc1955b0d446458f8f355550de971b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ae6f05c2843469190cd96f39ac794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:23:18.686648 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a3dadc32-fa42-4113-a9a5-bd261b3eac3f tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] 10.222.0.46 "GET /compute/v2.1/servers/09b5e585-22e2-410f-a734-73c1e5b2aace" status: 200 len: 1453 microversion: 2.1 time: 0.163071 Jan 15 21:23:18.687221 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3524/7034] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:23:18 2022] GET /compute/v2.1/servers/09b5e585-22e2-410f-a734-73c1e5b2aace => generated 1453 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:23:20.573721 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-c8815271-7c84-4800-b5d7-00bb68e13078 req-ac6f0d6d-bb40-4aa5-9725-aa17c9f7a4f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09b5e585-22e2-410f-a734-73c1e5b2aace", "tag": "a28a42a0-433d-4c6a-b9e1-8345775f4b05"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:23:20.575228 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:23:20.575228 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:23:20.583682 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-c8815271-7c84-4800-b5d7-00bb68e13078 req-ac6f0d6d-bb40-4aa5-9725-aa17c9f7a4f8 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:23:20.584400 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-c8815271-7c84-4800-b5d7-00bb68e13078 req-ac6f0d6d-bb40-4aa5-9725-aa17c9f7a4f8 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:23:20.595033 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-c8815271-7c84-4800-b5d7-00bb68e13078 req-ac6f0d6d-bb40-4aa5-9725-aa17c9f7a4f8 service nova] Creating event network-changed:a28a42a0-433d-4c6a-b9e1-8345775f4b05 for instance 09b5e585-22e2-410f-a734-73c1e5b2aace on nch2-master-1 Jan 15 21:23:20.600624 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-c8815271-7c84-4800-b5d7-00bb68e13078 req-ac6f0d6d-bb40-4aa5-9725-aa17c9f7a4f8 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030524 Jan 15 21:23:20.601257 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3511/7035] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:23:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:23:31.017798 ncdv-master-1 devstack@n-api.service[129366]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 15 21:23:31.018354 ncdv-master-1 devstack@n-api.service[129366]: Sat Jan 15 21:23:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 15 21:25:11.285223 ncdv-master-1 devstack@n-api.service[129365]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 15 21:25:11.285787 ncdv-master-1 devstack@n-api.service[129365]: Sat Jan 15 21:25:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 15 21:25:11.861170 ncdv-master-1 devstack@n-api.service[129366]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4346cd47-e793-4d94-9b2f-ad282883a042] AMQP server on 10.222.0.46:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jan 15 21:25:11.862336 ncdv-master-1 devstack@n-api.service[129366]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f3ab03e4-0e3e-4ca8-9e53-9b880d1e14ab] AMQP server on 10.222.0.46:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jan 15 21:25:11.866630 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b926bf32-0cb3-4b72-a74f-bcd6b3a471aa tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1419492816", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-441039095", "security_groups": [{"name": "tempest-secgroup-smoke-1645086404"}], "block_device_mapping_v2": [{"uuid": "efc59638-e0bd-48fc-bfbe-832ab08a7c77", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "250ac663-a6c2-4755-b702-91a1aec1e824"}]}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:25:12.090280 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.network.neutron [None req-b926bf32-0cb3-4b72-a74f-bcd6b3a471aa tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] validate_networks() for [('250ac663-a6c2-4755-b702-91a1aec1e824', None, None, None, None, None)] {{(pid=129366) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 21:25:12.511427 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-b926bf32-0cb3-4b72-a74f-bcd6b3a471aa tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Flavor limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 21:25:12.511849 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-b926bf32-0cb3-4b72-a74f-bcd6b3a471aa tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Image limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 21:25:12.512341 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-b926bf32-0cb3-4b72-a74f-bcd6b3a471aa tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Flavor pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 21:25:12.512780 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-b926bf32-0cb3-4b72-a74f-bcd6b3a471aa tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Image pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 21:25:12.513217 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-b926bf32-0cb3-4b72-a74f-bcd6b3a471aa tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 21:25:12.522666 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b926bf32-0cb3-4b72-a74f-bcd6b3a471aa tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:25:12.523047 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b926bf32-0cb3-4b72-a74f-bcd6b3a471aa tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:25:12.523847 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b926bf32-0cb3-4b72-a74f-bcd6b3a471aa tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:25:12.524277 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b926bf32-0cb3-4b72-a74f-bcd6b3a471aa tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:25:12.541031 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-b926bf32-0cb3-4b72-a74f-bcd6b3a471aa tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Getting quotas for project 7f2ae6f05c2843469190cd96f39ac794. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:25:12.546001 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-b926bf32-0cb3-4b72-a74f-bcd6b3a471aa tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Getting quotas for user f0fc1955b0d446458f8f355550de971b and project 7f2ae6f05c2843469190cd96f39ac794. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:25:12.601688 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b926bf32-0cb3-4b72-a74f-bcd6b3a471aa tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Going to run 1 instances... {{(pid=129366) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 21:25:12.603841 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b926bf32-0cb3-4b72-a74f-bcd6b3a471aa tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: 00f6efda-d64b-4119-8494-f9a44b0622df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='efc59638-e0bd-48fc-bfbe-832ab08a7c77',volume_size=None,volume_type=None)] {{(pid=129366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 21:25:12.726604 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b926bf32-0cb3-4b72-a74f-bcd6b3a471aa tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.867116 Jan 15 21:25:12.727261 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3525/7036] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 21:25:11 2022] POST /compute/v2.1/servers => generated 406 bytes in 868 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 21:25:12.736270 ncdv-master-1 devstack@n-api.service[129365]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b9368858-1d3b-40ae-ba09-78025e088160] AMQP server on 10.222.0.46:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 15 21:25:12.737642 ncdv-master-1 devstack@n-api.service[129365]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4ccfdfad-4291-4179-af77-e203370d1c4c] AMQP server on 10.222.0.46:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jan 15 21:25:12.742618 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-470b0d43-1255-4ccd-a076-a156c3c31d38 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:25:12.743542 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-470b0d43-1255-4ccd-a076-a156c3c31d38 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: 00f6efda-d64b-4119-8494-f9a44b0622df] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:25:12.858326 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-470b0d43-1255-4ccd-a076-a156c3c31d38 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fc1955b0d446458f8f355550de971b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ae6f05c2843469190cd96f39ac794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:25:12.865402 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-470b0d43-1255-4ccd-a076-a156c3c31d38 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] 10.222.0.46 "GET /compute/v2.1/servers/00f6efda-d64b-4119-8494-f9a44b0622df" status: 200 len: 1094 microversion: 2.1 time: 0.131103 Jan 15 21:25:12.865961 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3512/7037] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:25:12 2022] GET /compute/v2.1/servers/00f6efda-d64b-4119-8494-f9a44b0622df => generated 1094 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:25:13.887407 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9e8a58d7-fd75-4587-ae4b-d47bdb82aa5b tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:25:13.888053 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-9e8a58d7-fd75-4587-ae4b-d47bdb82aa5b tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: 00f6efda-d64b-4119-8494-f9a44b0622df] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:25:13.906085 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9e8a58d7-fd75-4587-ae4b-d47bdb82aa5b tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:25:13.906535 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9e8a58d7-fd75-4587-ae4b-d47bdb82aa5b tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:25:13.907330 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9e8a58d7-fd75-4587-ae4b-d47bdb82aa5b tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:25:13.907760 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9e8a58d7-fd75-4587-ae4b-d47bdb82aa5b tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:25:13.908397 ncdv-master-1 devstack@n-api.service[129366]: INFO oslo.messaging._drivers.impl_rabbit [-] [f3ab03e4-0e3e-4ca8-9e53-9b880d1e14ab] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 36560. Jan 15 21:25:13.909237 ncdv-master-1 devstack@n-api.service[129366]: INFO oslo.messaging._drivers.impl_rabbit [-] [4346cd47-e793-4d94-9b2f-ad282883a042] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 36558. Jan 15 21:25:13.973427 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-9e8a58d7-fd75-4587-ae4b-d47bdb82aa5b tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fc1955b0d446458f8f355550de971b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ae6f05c2843469190cd96f39ac794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:25:13.981999 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-9e8a58d7-fd75-4587-ae4b-d47bdb82aa5b tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] 10.222.0.46 "GET /compute/v2.1/servers/00f6efda-d64b-4119-8494-f9a44b0622df" status: 200 len: 1210 microversion: 2.1 time: 0.102168 Jan 15 21:25:13.992015 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3526/7038] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:25:13 2022] GET /compute/v2.1/servers/00f6efda-d64b-4119-8494-f9a44b0622df => generated 1210 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:25:14.999654 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-fdd25660-9181-40ad-a81c-9d96f16bf1c8 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:25:15.000309 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-fdd25660-9181-40ad-a81c-9d96f16bf1c8 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: 00f6efda-d64b-4119-8494-f9a44b0622df] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:25:15.014086 ncdv-master-1 devstack@n-api.service[129365]: INFO oslo.messaging._drivers.impl_rabbit [-] [4ccfdfad-4291-4179-af77-e203370d1c4c] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 36578. Jan 15 21:25:15.022003 ncdv-master-1 devstack@n-api.service[129365]: INFO oslo.messaging._drivers.impl_rabbit [-] [b9368858-1d3b-40ae-ba09-78025e088160] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 36576. Jan 15 21:25:15.027240 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fdd25660-9181-40ad-a81c-9d96f16bf1c8 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:25:15.027977 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fdd25660-9181-40ad-a81c-9d96f16bf1c8 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:25:15.028746 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fdd25660-9181-40ad-a81c-9d96f16bf1c8 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:25:15.029242 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fdd25660-9181-40ad-a81c-9d96f16bf1c8 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:25:15.181354 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-fdd25660-9181-40ad-a81c-9d96f16bf1c8 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fc1955b0d446458f8f355550de971b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ae6f05c2843469190cd96f39ac794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:25:15.189338 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-fdd25660-9181-40ad-a81c-9d96f16bf1c8 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] 10.222.0.46 "GET /compute/v2.1/servers/00f6efda-d64b-4119-8494-f9a44b0622df" status: 200 len: 1266 microversion: 2.1 time: 0.193371 Jan 15 21:25:15.201074 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3513/7039] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:25:14 2022] GET /compute/v2.1/servers/00f6efda-d64b-4119-8494-f9a44b0622df => generated 1266 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:25:15.262406 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-8b0d9b84-2bbb-45d2-85a0-85021184759a req-351fc351-aa52-46c7-8bfb-673de7a5241a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00f6efda-d64b-4119-8494-f9a44b0622df", "tag": "a6892721-44db-47e1-916c-eda3bf98dbb5"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:25:15.264591 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:25:15.264591 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:25:15.272626 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-8b0d9b84-2bbb-45d2-85a0-85021184759a req-351fc351-aa52-46c7-8bfb-673de7a5241a service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:25:15.273192 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-8b0d9b84-2bbb-45d2-85a0-85021184759a req-351fc351-aa52-46c7-8bfb-673de7a5241a service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:25:15.285343 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-8b0d9b84-2bbb-45d2-85a0-85021184759a req-351fc351-aa52-46c7-8bfb-673de7a5241a service nova] Creating event network-changed:a6892721-44db-47e1-916c-eda3bf98dbb5 for instance 00f6efda-d64b-4119-8494-f9a44b0622df on nch1-master-1 Jan 15 21:25:15.292456 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-8b0d9b84-2bbb-45d2-85a0-85021184759a req-351fc351-aa52-46c7-8bfb-673de7a5241a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118207 Jan 15 21:25:15.293113 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3527/7040] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:25:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:25:16.213081 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-6b619f61-ee78-4263-80a3-ecc3119b4372 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:25:16.213698 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-6b619f61-ee78-4263-80a3-ecc3119b4372 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: 00f6efda-d64b-4119-8494-f9a44b0622df] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:25:16.220398 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6b619f61-ee78-4263-80a3-ecc3119b4372 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:25:16.220886 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6b619f61-ee78-4263-80a3-ecc3119b4372 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:25:16.221678 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6b619f61-ee78-4263-80a3-ecc3119b4372 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:25:16.222128 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6b619f61-ee78-4263-80a3-ecc3119b4372 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:25:16.360007 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-6b619f61-ee78-4263-80a3-ecc3119b4372 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fc1955b0d446458f8f355550de971b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ae6f05c2843469190cd96f39ac794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:25:16.367376 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-6b619f61-ee78-4263-80a3-ecc3119b4372 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] 10.222.0.46 "GET /compute/v2.1/servers/00f6efda-d64b-4119-8494-f9a44b0622df" status: 200 len: 1266 microversion: 2.1 time: 0.158769 Jan 15 21:25:16.367948 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3514/7041] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:25:16 2022] GET /compute/v2.1/servers/00f6efda-d64b-4119-8494-f9a44b0622df => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:25:17.384151 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e84c7880-e738-440c-8ff8-d273990dffa0 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:25:17.384871 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e84c7880-e738-440c-8ff8-d273990dffa0 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: 00f6efda-d64b-4119-8494-f9a44b0622df] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:25:17.392890 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e84c7880-e738-440c-8ff8-d273990dffa0 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:25:17.393350 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e84c7880-e738-440c-8ff8-d273990dffa0 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:25:17.394140 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e84c7880-e738-440c-8ff8-d273990dffa0 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:25:17.394583 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e84c7880-e738-440c-8ff8-d273990dffa0 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:25:17.533145 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-e84c7880-e738-440c-8ff8-d273990dffa0 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fc1955b0d446458f8f355550de971b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ae6f05c2843469190cd96f39ac794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:25:17.541299 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e84c7880-e738-440c-8ff8-d273990dffa0 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] 10.222.0.46 "GET /compute/v2.1/servers/00f6efda-d64b-4119-8494-f9a44b0622df" status: 200 len: 1266 microversion: 2.1 time: 0.161379 Jan 15 21:25:17.542105 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3528/7042] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:25:17 2022] GET /compute/v2.1/servers/00f6efda-d64b-4119-8494-f9a44b0622df => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:25:18.558281 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-84a0698e-5060-4d98-836c-01b04797c31a tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:25:18.558900 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-84a0698e-5060-4d98-836c-01b04797c31a tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: 00f6efda-d64b-4119-8494-f9a44b0622df] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:25:18.565701 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-84a0698e-5060-4d98-836c-01b04797c31a tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:25:18.566162 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-84a0698e-5060-4d98-836c-01b04797c31a tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:25:18.566948 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-84a0698e-5060-4d98-836c-01b04797c31a tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:25:18.567890 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-84a0698e-5060-4d98-836c-01b04797c31a tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:25:18.701266 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-84a0698e-5060-4d98-836c-01b04797c31a tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fc1955b0d446458f8f355550de971b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ae6f05c2843469190cd96f39ac794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:25:18.709488 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-84a0698e-5060-4d98-836c-01b04797c31a tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] 10.222.0.46 "GET /compute/v2.1/servers/00f6efda-d64b-4119-8494-f9a44b0622df" status: 200 len: 1266 microversion: 2.1 time: 0.154892 Jan 15 21:25:18.710066 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3515/7043] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:25:18 2022] GET /compute/v2.1/servers/00f6efda-d64b-4119-8494-f9a44b0622df => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:25:19.726784 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-6fd4daf1-868b-4376-821a-61256f2e6393 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:25:19.727418 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-6fd4daf1-868b-4376-821a-61256f2e6393 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: 00f6efda-d64b-4119-8494-f9a44b0622df] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:25:19.734379 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6fd4daf1-868b-4376-821a-61256f2e6393 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:25:19.734946 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6fd4daf1-868b-4376-821a-61256f2e6393 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:25:19.735850 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6fd4daf1-868b-4376-821a-61256f2e6393 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:25:19.736366 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6fd4daf1-868b-4376-821a-61256f2e6393 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:25:19.770337 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-801de164-9900-46aa-976e-427bfc879efe req-0dcf38bd-1d89-4af0-a8cb-22cb9918d34e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00f6efda-d64b-4119-8494-f9a44b0622df", "name": "network-vif-plugged", "status": "completed", "tag": "a6892721-44db-47e1-916c-eda3bf98dbb5"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:25:19.771920 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:25:19.771920 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:25:19.779209 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-801de164-9900-46aa-976e-427bfc879efe req-0dcf38bd-1d89-4af0-a8cb-22cb9918d34e service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:25:19.779643 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-801de164-9900-46aa-976e-427bfc879efe req-0dcf38bd-1d89-4af0-a8cb-22cb9918d34e service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:25:19.791368 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-801de164-9900-46aa-976e-427bfc879efe req-0dcf38bd-1d89-4af0-a8cb-22cb9918d34e service nova] Creating event network-vif-plugged:a6892721-44db-47e1-916c-eda3bf98dbb5 for instance 00f6efda-d64b-4119-8494-f9a44b0622df on nch1-master-1 Jan 15 21:25:19.796350 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-801de164-9900-46aa-976e-427bfc879efe req-0dcf38bd-1d89-4af0-a8cb-22cb9918d34e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107754 Jan 15 21:25:19.797091 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3529/7044] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:25:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:25:19.875361 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-6fd4daf1-868b-4376-821a-61256f2e6393 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fc1955b0d446458f8f355550de971b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ae6f05c2843469190cd96f39ac794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:25:19.883655 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-6fd4daf1-868b-4376-821a-61256f2e6393 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] 10.222.0.46 "GET /compute/v2.1/servers/00f6efda-d64b-4119-8494-f9a44b0622df" status: 200 len: 1266 microversion: 2.1 time: 0.161189 Jan 15 21:25:19.884223 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3516/7045] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:25:19 2022] GET /compute/v2.1/servers/00f6efda-d64b-4119-8494-f9a44b0622df => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:25:20.902389 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-53f89de8-835a-4080-bb19-80f32be13440 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:25:20.903105 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-53f89de8-835a-4080-bb19-80f32be13440 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: 00f6efda-d64b-4119-8494-f9a44b0622df] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:25:20.909586 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-53f89de8-835a-4080-bb19-80f32be13440 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:25:20.910114 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-53f89de8-835a-4080-bb19-80f32be13440 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:25:20.911454 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-53f89de8-835a-4080-bb19-80f32be13440 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:25:20.911998 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-53f89de8-835a-4080-bb19-80f32be13440 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:25:21.054852 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-53f89de8-835a-4080-bb19-80f32be13440 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fc1955b0d446458f8f355550de971b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ae6f05c2843469190cd96f39ac794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:25:21.062333 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-53f89de8-835a-4080-bb19-80f32be13440 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] 10.222.0.46 "GET /compute/v2.1/servers/00f6efda-d64b-4119-8494-f9a44b0622df" status: 200 len: 1266 microversion: 2.1 time: 0.164869 Jan 15 21:25:21.062909 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3530/7046] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:25:20 2022] GET /compute/v2.1/servers/00f6efda-d64b-4119-8494-f9a44b0622df => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:25:22.079065 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-fdf68ec6-f10c-46da-a4c2-ab704fa87e38 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:25:22.079723 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-fdf68ec6-f10c-46da-a4c2-ab704fa87e38 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: 00f6efda-d64b-4119-8494-f9a44b0622df] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:25:22.086836 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fdf68ec6-f10c-46da-a4c2-ab704fa87e38 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:25:22.087300 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fdf68ec6-f10c-46da-a4c2-ab704fa87e38 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:25:22.088128 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fdf68ec6-f10c-46da-a4c2-ab704fa87e38 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:25:22.088579 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fdf68ec6-f10c-46da-a4c2-ab704fa87e38 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:25:22.221383 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-fdf68ec6-f10c-46da-a4c2-ab704fa87e38 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fc1955b0d446458f8f355550de971b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ae6f05c2843469190cd96f39ac794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:25:22.229330 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-fdf68ec6-f10c-46da-a4c2-ab704fa87e38 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] 10.222.0.46 "GET /compute/v2.1/servers/00f6efda-d64b-4119-8494-f9a44b0622df" status: 200 len: 1453 microversion: 2.1 time: 0.154025 Jan 15 21:25:22.229899 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3517/7047] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:25:22 2022] GET /compute/v2.1/servers/00f6efda-d64b-4119-8494-f9a44b0622df => generated 1453 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:25:22.245712 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c1d3e584-ad14-4479-880d-91932212f8aa tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:25:22.246380 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c1d3e584-ad14-4479-880d-91932212f8aa tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: 00f6efda-d64b-4119-8494-f9a44b0622df] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:25:22.253130 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c1d3e584-ad14-4479-880d-91932212f8aa tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:25:22.253587 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c1d3e584-ad14-4479-880d-91932212f8aa tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:25:22.254359 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c1d3e584-ad14-4479-880d-91932212f8aa tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:25:22.254817 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c1d3e584-ad14-4479-880d-91932212f8aa tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:25:22.403734 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-c1d3e584-ad14-4479-880d-91932212f8aa tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fc1955b0d446458f8f355550de971b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ae6f05c2843469190cd96f39ac794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:25:22.412035 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c1d3e584-ad14-4479-880d-91932212f8aa tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] 10.222.0.46 "GET /compute/v2.1/servers/00f6efda-d64b-4119-8494-f9a44b0622df" status: 200 len: 1453 microversion: 2.1 time: 0.170004 Jan 15 21:25:22.412608 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3531/7048] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:25:22 2022] GET /compute/v2.1/servers/00f6efda-d64b-4119-8494-f9a44b0622df => generated 1453 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:25:24.139232 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-608d4bfc-85c8-41f8-81b8-9133a65cb66f req-ed46b7be-3c22-4e32-a557-e4a45a7c4c41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00f6efda-d64b-4119-8494-f9a44b0622df", "tag": "a6892721-44db-47e1-916c-eda3bf98dbb5"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:25:24.140826 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:25:24.140826 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:25:24.149156 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-608d4bfc-85c8-41f8-81b8-9133a65cb66f req-ed46b7be-3c22-4e32-a557-e4a45a7c4c41 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:25:24.149902 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-608d4bfc-85c8-41f8-81b8-9133a65cb66f req-ed46b7be-3c22-4e32-a557-e4a45a7c4c41 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:25:24.162831 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-608d4bfc-85c8-41f8-81b8-9133a65cb66f req-ed46b7be-3c22-4e32-a557-e4a45a7c4c41 service nova] Creating event network-changed:a6892721-44db-47e1-916c-eda3bf98dbb5 for instance 00f6efda-d64b-4119-8494-f9a44b0622df on nch1-master-1 Jan 15 21:25:24.168418 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-608d4bfc-85c8-41f8-81b8-9133a65cb66f req-ed46b7be-3c22-4e32-a557-e4a45a7c4c41 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100963 Jan 15 21:25:24.169066 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3518/7049] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:25:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:26:50.956178 ncdv-master-1 devstack@n-api.service[129366]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 15 21:26:50.956699 ncdv-master-1 devstack@n-api.service[129366]: Sat Jan 15 21:26:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 15 21:27:04.273936 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f9d7fed4-8c83-4fcd-adbc-761dacbc7f7a tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:27:04.274623 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f9d7fed4-8c83-4fcd-adbc-761dacbc7f7a tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: 00f6efda-d64b-4119-8494-f9a44b0622df] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:27:04.282192 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f9d7fed4-8c83-4fcd-adbc-761dacbc7f7a tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:27:04.282729 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f9d7fed4-8c83-4fcd-adbc-761dacbc7f7a tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:27:04.283621 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f9d7fed4-8c83-4fcd-adbc-761dacbc7f7a tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:27:04.284130 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f9d7fed4-8c83-4fcd-adbc-761dacbc7f7a tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:27:04.284502 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-9d63013c-fd3e-42db-b460-0fe8f47749a1 req-2a4bb79b-ab30-40bd-88b9-cc3172e48000 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00f6efda-d64b-4119-8494-f9a44b0622df", "tag": "a6892721-44db-47e1-916c-eda3bf98dbb5"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:27:04.286177 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:27:04.286177 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:27:04.293416 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-9d63013c-fd3e-42db-b460-0fe8f47749a1 req-2a4bb79b-ab30-40bd-88b9-cc3172e48000 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:27:04.293880 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-9d63013c-fd3e-42db-b460-0fe8f47749a1 req-2a4bb79b-ab30-40bd-88b9-cc3172e48000 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:27:04.305280 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-9d63013c-fd3e-42db-b460-0fe8f47749a1 req-2a4bb79b-ab30-40bd-88b9-cc3172e48000 service nova] Creating event network-changed:a6892721-44db-47e1-916c-eda3bf98dbb5 for instance 00f6efda-d64b-4119-8494-f9a44b0622df on nch1-master-1 Jan 15 21:27:04.310826 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-9d63013c-fd3e-42db-b460-0fe8f47749a1 req-2a4bb79b-ab30-40bd-88b9-cc3172e48000 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031504 Jan 15 21:27:04.311757 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3519/7050] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:27:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:27:04.314014 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f9d7fed4-8c83-4fcd-adbc-761dacbc7f7a tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: 00f6efda-d64b-4119-8494-f9a44b0622df] Going to try to terminate instance {{(pid=129366) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 21:27:04.408939 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f9d7fed4-8c83-4fcd-adbc-761dacbc7f7a tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] 10.222.0.46 "DELETE /compute/v2.1/servers/00f6efda-d64b-4119-8494-f9a44b0622df" status: 204 len: 0 microversion: 2.1 time: 0.139649 Jan 15 21:27:04.413361 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3532/7051] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 21:27:04 2022] DELETE /compute/v2.1/servers/00f6efda-d64b-4119-8494-f9a44b0622df => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 21:27:04.420114 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-86271023-b65b-40d9-ab46-2765f3470591 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:27:04.420905 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-86271023-b65b-40d9-ab46-2765f3470591 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: 00f6efda-d64b-4119-8494-f9a44b0622df] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:27:04.428250 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-86271023-b65b-40d9-ab46-2765f3470591 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:27:04.428708 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-86271023-b65b-40d9-ab46-2765f3470591 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:27:04.429560 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-86271023-b65b-40d9-ab46-2765f3470591 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:27:04.430009 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-86271023-b65b-40d9-ab46-2765f3470591 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:27:04.584979 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-86271023-b65b-40d9-ab46-2765f3470591 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fc1955b0d446458f8f355550de971b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ae6f05c2843469190cd96f39ac794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:27:04.594043 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-86271023-b65b-40d9-ab46-2765f3470591 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] 10.222.0.46 "GET /compute/v2.1/servers/00f6efda-d64b-4119-8494-f9a44b0622df" status: 200 len: 1578 microversion: 2.1 time: 0.178700 Jan 15 21:27:04.594852 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3520/7052] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:27:04 2022] GET /compute/v2.1/servers/00f6efda-d64b-4119-8494-f9a44b0622df => generated 1578 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:27:05.612927 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d76df917-531d-4860-8d25-1b1aba4efa6b tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:27:05.613531 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-d76df917-531d-4860-8d25-1b1aba4efa6b tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: 00f6efda-d64b-4119-8494-f9a44b0622df] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:27:05.620775 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d76df917-531d-4860-8d25-1b1aba4efa6b tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:27:05.621277 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d76df917-531d-4860-8d25-1b1aba4efa6b tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:27:05.622037 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d76df917-531d-4860-8d25-1b1aba4efa6b tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:27:05.622468 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d76df917-531d-4860-8d25-1b1aba4efa6b tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:27:05.753956 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-d76df917-531d-4860-8d25-1b1aba4efa6b tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fc1955b0d446458f8f355550de971b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ae6f05c2843469190cd96f39ac794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:27:05.762426 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d76df917-531d-4860-8d25-1b1aba4efa6b tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] 10.222.0.46 "GET /compute/v2.1/servers/00f6efda-d64b-4119-8494-f9a44b0622df" status: 200 len: 1459 microversion: 2.1 time: 0.154505 Jan 15 21:27:05.763019 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3533/7053] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:27:05 2022] GET /compute/v2.1/servers/00f6efda-d64b-4119-8494-f9a44b0622df => generated 1459 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:27:06.454571 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-aebb06a2-5c7b-420d-a1ed-936f267471f1 req-f06e9806-c32e-4e46-b598-6d0e0f1bbc83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00f6efda-d64b-4119-8494-f9a44b0622df", "name": "network-vif-deleted", "tag": "a6892721-44db-47e1-916c-eda3bf98dbb5"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:27:06.456165 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:27:06.456165 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:27:06.466435 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-aebb06a2-5c7b-420d-a1ed-936f267471f1 req-f06e9806-c32e-4e46-b598-6d0e0f1bbc83 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:27:06.466884 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-aebb06a2-5c7b-420d-a1ed-936f267471f1 req-f06e9806-c32e-4e46-b598-6d0e0f1bbc83 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:27:06.478495 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-aebb06a2-5c7b-420d-a1ed-936f267471f1 req-f06e9806-c32e-4e46-b598-6d0e0f1bbc83 service nova] Creating event network-vif-deleted:a6892721-44db-47e1-916c-eda3bf98dbb5 for instance 00f6efda-d64b-4119-8494-f9a44b0622df on nch1-master-1 Jan 15 21:27:06.483676 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-aebb06a2-5c7b-420d-a1ed-936f267471f1 req-f06e9806-c32e-4e46-b598-6d0e0f1bbc83 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032912 Jan 15 21:27:06.484279 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3521/7054] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:27:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:27:06.779641 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-3133510b-485d-478e-ad02-949f1e623d4a tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:27:06.780249 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-3133510b-485d-478e-ad02-949f1e623d4a tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: 00f6efda-d64b-4119-8494-f9a44b0622df] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:27:06.787368 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3133510b-485d-478e-ad02-949f1e623d4a tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:27:06.787817 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3133510b-485d-478e-ad02-949f1e623d4a tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:27:06.788609 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3133510b-485d-478e-ad02-949f1e623d4a tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:27:06.789076 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3133510b-485d-478e-ad02-949f1e623d4a tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:27:06.824537 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3133510b-485d-478e-ad02-949f1e623d4a tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:27:06.825022 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3133510b-485d-478e-ad02-949f1e623d4a tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:27:06.825477 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.objects.instance [None req-3133510b-485d-478e-ad02-949f1e623d4a tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lazy-loading 'fault' on Instance uuid 00f6efda-d64b-4119-8494-f9a44b0622df {{(pid=129366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 21:27:06.869538 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-3133510b-485d-478e-ad02-949f1e623d4a tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fc1955b0d446458f8f355550de971b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ae6f05c2843469190cd96f39ac794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:27:06.877318 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-3133510b-485d-478e-ad02-949f1e623d4a tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] 10.222.0.46 "GET /compute/v2.1/servers/00f6efda-d64b-4119-8494-f9a44b0622df" status: 200 len: 1230 microversion: 2.1 time: 0.101559 Jan 15 21:27:06.877911 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3534/7055] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:27:06 2022] GET /compute/v2.1/servers/00f6efda-d64b-4119-8494-f9a44b0622df => generated 1230 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:27:07.897961 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8287ea1d-cdf3-45ef-9b3d-d620ec3955d7 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:27:07.898683 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-8287ea1d-cdf3-45ef-9b3d-d620ec3955d7 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: 00f6efda-d64b-4119-8494-f9a44b0622df] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:27:07.905694 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8287ea1d-cdf3-45ef-9b3d-d620ec3955d7 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:27:07.906162 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8287ea1d-cdf3-45ef-9b3d-d620ec3955d7 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:27:07.906968 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8287ea1d-cdf3-45ef-9b3d-d620ec3955d7 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:27:07.907476 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8287ea1d-cdf3-45ef-9b3d-d620ec3955d7 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:27:07.921663 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-8287ea1d-cdf3-45ef-9b3d-d620ec3955d7 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] HTTP exception thrown: Instance 00f6efda-d64b-4119-8494-f9a44b0622df could not be found. Jan 15 21:27:07.922295 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8287ea1d-cdf3-45ef-9b3d-d620ec3955d7 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Returning 404 to user: Instance 00f6efda-d64b-4119-8494-f9a44b0622df could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:27:07.923135 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-8287ea1d-cdf3-45ef-9b3d-d620ec3955d7 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] 10.222.0.46 "GET /compute/v2.1/servers/00f6efda-d64b-4119-8494-f9a44b0622df" status: 404 len: 111 microversion: 2.1 time: 0.031651 Jan 15 21:27:07.923672 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3522/7056] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:27:07 2022] GET /compute/v2.1/servers/00f6efda-d64b-4119-8494-f9a44b0622df => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:27:40.739878 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e02a4e82-e14b-4461-9ea8-4fc6bd389a29 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:27:40.740765 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e02a4e82-e14b-4461-9ea8-4fc6bd389a29 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: 09b5e585-22e2-410f-a734-73c1e5b2aace] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:27:40.740921 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-317f4e22-e645-4285-af69-158488375bb1 req-046d26e3-8892-4be8-ba2d-3004af8cd4a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09b5e585-22e2-410f-a734-73c1e5b2aace", "tag": "a28a42a0-433d-4c6a-b9e1-8345775f4b05"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:27:40.744488 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:27:40.744488 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:27:40.749372 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e02a4e82-e14b-4461-9ea8-4fc6bd389a29 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:27:40.749828 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e02a4e82-e14b-4461-9ea8-4fc6bd389a29 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:27:40.750655 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e02a4e82-e14b-4461-9ea8-4fc6bd389a29 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:27:40.751092 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e02a4e82-e14b-4461-9ea8-4fc6bd389a29 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:27:40.754367 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-317f4e22-e645-4285-af69-158488375bb1 req-046d26e3-8892-4be8-ba2d-3004af8cd4a6 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:27:40.755507 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-317f4e22-e645-4285-af69-158488375bb1 req-046d26e3-8892-4be8-ba2d-3004af8cd4a6 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:27:40.769988 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-317f4e22-e645-4285-af69-158488375bb1 req-046d26e3-8892-4be8-ba2d-3004af8cd4a6 service nova] Creating event network-changed:a28a42a0-433d-4c6a-b9e1-8345775f4b05 for instance 09b5e585-22e2-410f-a734-73c1e5b2aace on nch2-master-1 Jan 15 21:27:40.775365 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-317f4e22-e645-4285-af69-158488375bb1 req-046d26e3-8892-4be8-ba2d-3004af8cd4a6 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038463 Jan 15 21:27:40.776085 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3523/7057] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:27:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:27:40.780424 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e02a4e82-e14b-4461-9ea8-4fc6bd389a29 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: 09b5e585-22e2-410f-a734-73c1e5b2aace] Going to try to terminate instance {{(pid=129366) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 21:27:40.871203 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e02a4e82-e14b-4461-9ea8-4fc6bd389a29 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] 10.222.0.46 "DELETE /compute/v2.1/servers/09b5e585-22e2-410f-a734-73c1e5b2aace" status: 204 len: 0 microversion: 2.1 time: 0.136612 Jan 15 21:27:40.872651 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3535/7058] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 21:27:40 2022] DELETE /compute/v2.1/servers/09b5e585-22e2-410f-a734-73c1e5b2aace => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 21:27:40.882181 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-4df4af8c-6947-4fd5-8b55-477b6232a500 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:27:40.882901 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-4df4af8c-6947-4fd5-8b55-477b6232a500 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: 09b5e585-22e2-410f-a734-73c1e5b2aace] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:27:40.892622 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4df4af8c-6947-4fd5-8b55-477b6232a500 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:27:40.893149 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4df4af8c-6947-4fd5-8b55-477b6232a500 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:27:40.894008 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4df4af8c-6947-4fd5-8b55-477b6232a500 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:27:40.894481 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4df4af8c-6947-4fd5-8b55-477b6232a500 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:27:41.041774 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-4df4af8c-6947-4fd5-8b55-477b6232a500 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fc1955b0d446458f8f355550de971b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ae6f05c2843469190cd96f39ac794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:27:41.050528 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-4df4af8c-6947-4fd5-8b55-477b6232a500 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] 10.222.0.46 "GET /compute/v2.1/servers/09b5e585-22e2-410f-a734-73c1e5b2aace" status: 200 len: 1577 microversion: 2.1 time: 0.173267 Jan 15 21:27:41.051573 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3524/7059] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:27:40 2022] GET /compute/v2.1/servers/09b5e585-22e2-410f-a734-73c1e5b2aace => generated 1577 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:27:42.071643 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-6e540da2-736a-42b5-8dbe-6f57f5f26fde tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:27:42.072455 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-6e540da2-736a-42b5-8dbe-6f57f5f26fde tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: 09b5e585-22e2-410f-a734-73c1e5b2aace] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:27:42.079495 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6e540da2-736a-42b5-8dbe-6f57f5f26fde tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:27:42.079939 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6e540da2-736a-42b5-8dbe-6f57f5f26fde tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:27:42.080705 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6e540da2-736a-42b5-8dbe-6f57f5f26fde tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:27:42.081170 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6e540da2-736a-42b5-8dbe-6f57f5f26fde tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:27:42.213720 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-6e540da2-736a-42b5-8dbe-6f57f5f26fde tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fc1955b0d446458f8f355550de971b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ae6f05c2843469190cd96f39ac794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:27:42.221224 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-6e540da2-736a-42b5-8dbe-6f57f5f26fde tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] 10.222.0.46 "GET /compute/v2.1/servers/09b5e585-22e2-410f-a734-73c1e5b2aace" status: 200 len: 1459 microversion: 2.1 time: 0.154169 Jan 15 21:27:42.221794 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3536/7060] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:27:42 2022] GET /compute/v2.1/servers/09b5e585-22e2-410f-a734-73c1e5b2aace => generated 1459 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:27:43.111664 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-ef9eb391-7294-48b3-8aaf-d2c6b75261ba req-b78fbb14-4624-47fc-ba7a-94e361d0ae8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09b5e585-22e2-410f-a734-73c1e5b2aace", "name": "network-vif-deleted", "tag": "a28a42a0-433d-4c6a-b9e1-8345775f4b05"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:27:43.113254 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:27:43.113254 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:27:43.121643 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-ef9eb391-7294-48b3-8aaf-d2c6b75261ba req-b78fbb14-4624-47fc-ba7a-94e361d0ae8c service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:27:43.122127 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-ef9eb391-7294-48b3-8aaf-d2c6b75261ba req-b78fbb14-4624-47fc-ba7a-94e361d0ae8c service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:27:43.134869 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-ef9eb391-7294-48b3-8aaf-d2c6b75261ba req-b78fbb14-4624-47fc-ba7a-94e361d0ae8c service nova] Creating event network-vif-deleted:a28a42a0-433d-4c6a-b9e1-8345775f4b05 for instance 09b5e585-22e2-410f-a734-73c1e5b2aace on nch2-master-1 Jan 15 21:27:43.140150 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-ef9eb391-7294-48b3-8aaf-d2c6b75261ba req-b78fbb14-4624-47fc-ba7a-94e361d0ae8c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032153 Jan 15 21:27:43.140740 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3525/7061] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:27:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:27:43.238455 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e335ee48-d864-4245-90b6-8fdf029e0d48 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:27:43.239086 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e335ee48-d864-4245-90b6-8fdf029e0d48 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: 09b5e585-22e2-410f-a734-73c1e5b2aace] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:27:43.245846 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e335ee48-d864-4245-90b6-8fdf029e0d48 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:27:43.246288 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e335ee48-d864-4245-90b6-8fdf029e0d48 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:27:43.247060 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e335ee48-d864-4245-90b6-8fdf029e0d48 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:27:43.247489 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e335ee48-d864-4245-90b6-8fdf029e0d48 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:27:43.311806 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-e335ee48-d864-4245-90b6-8fdf029e0d48 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fc1955b0d446458f8f355550de971b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2ae6f05c2843469190cd96f39ac794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:27:43.319509 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e335ee48-d864-4245-90b6-8fdf029e0d48 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] 10.222.0.46 "GET /compute/v2.1/servers/09b5e585-22e2-410f-a734-73c1e5b2aace" status: 200 len: 1224 microversion: 2.1 time: 0.084756 Jan 15 21:27:43.320085 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3537/7062] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:27:43 2022] GET /compute/v2.1/servers/09b5e585-22e2-410f-a734-73c1e5b2aace => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:27:44.339249 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e8ff9f57-4464-4330-8706-901f278d47c9 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:27:44.339957 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e8ff9f57-4464-4330-8706-901f278d47c9 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: 09b5e585-22e2-410f-a734-73c1e5b2aace] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:27:44.346529 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e8ff9f57-4464-4330-8706-901f278d47c9 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:27:44.346987 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e8ff9f57-4464-4330-8706-901f278d47c9 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:27:44.347769 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e8ff9f57-4464-4330-8706-901f278d47c9 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:27:44.348217 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e8ff9f57-4464-4330-8706-901f278d47c9 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:27:44.363354 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-e8ff9f57-4464-4330-8706-901f278d47c9 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] HTTP exception thrown: Instance 09b5e585-22e2-410f-a734-73c1e5b2aace could not be found. Jan 15 21:27:44.363945 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e8ff9f57-4464-4330-8706-901f278d47c9 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Returning 404 to user: Instance 09b5e585-22e2-410f-a734-73c1e5b2aace could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:27:44.364779 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e8ff9f57-4464-4330-8706-901f278d47c9 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] 10.222.0.46 "GET /compute/v2.1/servers/09b5e585-22e2-410f-a734-73c1e5b2aace" status: 404 len: 111 microversion: 2.1 time: 0.030453 Jan 15 21:27:44.365342 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3526/7063] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:27:44 2022] GET /compute/v2.1/servers/09b5e585-22e2-410f-a734-73c1e5b2aace => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:27:44.815225 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-fa71f295-146e-4035-8098-000b40a51318 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:27:44.815842 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-fa71f295-146e-4035-8098-000b40a51318 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: b4f980ed-4669-4cfc-b196-aecea77de875] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:27:44.822414 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fa71f295-146e-4035-8098-000b40a51318 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:27:44.822855 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fa71f295-146e-4035-8098-000b40a51318 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:27:44.823628 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fa71f295-146e-4035-8098-000b40a51318 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:27:44.824057 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fa71f295-146e-4035-8098-000b40a51318 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:27:44.840090 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-fa71f295-146e-4035-8098-000b40a51318 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] HTTP exception thrown: Instance b4f980ed-4669-4cfc-b196-aecea77de875 could not be found. Jan 15 21:27:44.840675 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-fa71f295-146e-4035-8098-000b40a51318 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Returning 404 to user: Instance b4f980ed-4669-4cfc-b196-aecea77de875 could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:27:44.841599 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-fa71f295-146e-4035-8098-000b40a51318 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] 10.222.0.46 "DELETE /compute/v2.1/servers/b4f980ed-4669-4cfc-b196-aecea77de875" status: 404 len: 111 microversion: 2.1 time: 0.030088 Jan 15 21:27:44.842157 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3538/7064] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 21:27:44 2022] DELETE /compute/v2.1/servers/b4f980ed-4669-4cfc-b196-aecea77de875 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:27:44.850157 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-27fe3ec3-5147-4bab-939a-a3df0360c577 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:27:44.850778 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-27fe3ec3-5147-4bab-939a-a3df0360c577 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] [instance: b4f980ed-4669-4cfc-b196-aecea77de875] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:27:44.857960 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-27fe3ec3-5147-4bab-939a-a3df0360c577 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:27:44.858430 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-27fe3ec3-5147-4bab-939a-a3df0360c577 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:27:44.859257 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-27fe3ec3-5147-4bab-939a-a3df0360c577 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:27:44.859705 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-27fe3ec3-5147-4bab-939a-a3df0360c577 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:27:44.874351 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-27fe3ec3-5147-4bab-939a-a3df0360c577 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] HTTP exception thrown: Instance b4f980ed-4669-4cfc-b196-aecea77de875 could not be found. Jan 15 21:27:44.874945 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-27fe3ec3-5147-4bab-939a-a3df0360c577 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Returning 404 to user: Instance b4f980ed-4669-4cfc-b196-aecea77de875 could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:27:44.875778 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-27fe3ec3-5147-4bab-939a-a3df0360c577 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] 10.222.0.46 "GET /compute/v2.1/servers/b4f980ed-4669-4cfc-b196-aecea77de875" status: 404 len: 111 microversion: 2.1 time: 0.029374 Jan 15 21:27:44.876315 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3527/7065] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:27:44 2022] GET /compute/v2.1/servers/b4f980ed-4669-4cfc-b196-aecea77de875 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:27:46.154997 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ceb6efe4-c6a9-492a-8a40-8cd5de120676 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] Calling method '.version_select at 0x7f30c8623f70>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:27:46.185938 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ceb6efe4-c6a9-492a-8a40-8cd5de120676 tempest-TestVolumeBootPattern-1854138725 tempest-TestVolumeBootPattern-1854138725-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-441039095" status: 202 len: 0 microversion: 2.1 time: 0.031216 Jan 15 21:27:46.185938 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3539/7066] 10.222.0.46 () {58 vars in 1259 bytes} [Sat Jan 15 21:27:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-441039095 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:28:04.576922 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-214ce524-b971-49c6-98d7-5061d5c097d8 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-930566299", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:28:04.626609 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.network.neutron [None req-214ce524-b971-49c6-98d7-5061d5c097d8 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] validate_networks() for None {{(pid=129365) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 21:28:04.922481 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-214ce524-b971-49c6-98d7-5061d5c097d8 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] Flavor limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 21:28:04.922915 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-214ce524-b971-49c6-98d7-5061d5c097d8 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] Image limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 21:28:04.923401 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-214ce524-b971-49c6-98d7-5061d5c097d8 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] Flavor pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 21:28:04.923850 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-214ce524-b971-49c6-98d7-5061d5c097d8 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] Image pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 21:28:04.924281 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-214ce524-b971-49c6-98d7-5061d5c097d8 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 21:28:04.933830 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-214ce524-b971-49c6-98d7-5061d5c097d8 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:28:04.934294 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-214ce524-b971-49c6-98d7-5061d5c097d8 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:28:04.935118 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-214ce524-b971-49c6-98d7-5061d5c097d8 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:28:04.935600 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-214ce524-b971-49c6-98d7-5061d5c097d8 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:28:04.953593 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-214ce524-b971-49c6-98d7-5061d5c097d8 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] Getting quotas for project c845ba3da9154b27a33c0d7254c33025. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:28:04.958688 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-214ce524-b971-49c6-98d7-5061d5c097d8 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] Getting quotas for user 89236f5f246c43c4a07692e5ee03d58b and project c845ba3da9154b27a33c0d7254c33025. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:28:04.971571 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-214ce524-b971-49c6-98d7-5061d5c097d8 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] Going to run 1 instances... {{(pid=129365) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 21:28:04.973976 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-214ce524-b971-49c6-98d7-5061d5c097d8 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] [instance: 6f326697-d22e-4b06-beb4-0f95833d9824] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129365) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 21:28:05.014248 ncdv-master-1 devstack@n-api.service[129365]: ERROR oslo.messaging._drivers.impl_rabbit [None req-214ce524-b971-49c6-98d7-5061d5c097d8 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] [c9407883-f990-4a97-b813-b51b9ecbc106] AMQP server on 10.222.0.46:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 15 21:28:06.021327 ncdv-master-1 devstack@n-api.service[129365]: INFO oslo.messaging._drivers.impl_rabbit [None req-214ce524-b971-49c6-98d7-5061d5c097d8 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] [c9407883-f990-4a97-b813-b51b9ecbc106] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 36972. Jan 15 21:28:06.026367 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-214ce524-b971-49c6-98d7-5061d5c097d8 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.560040 Jan 15 21:28:06.027043 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3528/7067] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 21:28:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1561 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 21:28:06.037973 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-95ea364d-c39a-45ef-a3b9-9ef2ca98f947 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:28:06.038573 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-95ea364d-c39a-45ef-a3b9-9ef2ca98f947 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] [instance: 6f326697-d22e-4b06-beb4-0f95833d9824] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:28:06.089694 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-95ea364d-c39a-45ef-a3b9-9ef2ca98f947 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89236f5f246c43c4a07692e5ee03d58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c845ba3da9154b27a33c0d7254c33025', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:28:06.096199 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-95ea364d-c39a-45ef-a3b9-9ef2ca98f947 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] 10.222.0.46 "GET /compute/v2.1/servers/6f326697-d22e-4b06-beb4-0f95833d9824" status: 200 len: 1221 microversion: 2.1 time: 0.062676 Jan 15 21:28:06.096755 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3540/7068] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:28:06 2022] GET /compute/v2.1/servers/6f326697-d22e-4b06-beb4-0f95833d9824 => generated 1221 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:28:07.114722 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c63cf980-5f2a-43ba-8270-cf837978c461 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:28:07.115339 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c63cf980-5f2a-43ba-8270-cf837978c461 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] [instance: 6f326697-d22e-4b06-beb4-0f95833d9824] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:28:07.169092 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-c63cf980-5f2a-43ba-8270-cf837978c461 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89236f5f246c43c4a07692e5ee03d58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c845ba3da9154b27a33c0d7254c33025', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:28:07.175828 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c63cf980-5f2a-43ba-8270-cf837978c461 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] 10.222.0.46 "GET /compute/v2.1/servers/6f326697-d22e-4b06-beb4-0f95833d9824" status: 200 len: 1221 microversion: 2.1 time: 0.065661 Jan 15 21:28:07.176399 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3529/7069] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:28:07 2022] GET /compute/v2.1/servers/6f326697-d22e-4b06-beb4-0f95833d9824 => generated 1221 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:28:08.192809 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-939c9319-408b-4a00-b052-124260f74f40 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:28:08.193505 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-939c9319-408b-4a00-b052-124260f74f40 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] [instance: 6f326697-d22e-4b06-beb4-0f95833d9824] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:28:08.251065 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-939c9319-408b-4a00-b052-124260f74f40 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89236f5f246c43c4a07692e5ee03d58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c845ba3da9154b27a33c0d7254c33025', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:28:08.259937 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-939c9319-408b-4a00-b052-124260f74f40 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] 10.222.0.46 "GET /compute/v2.1/servers/6f326697-d22e-4b06-beb4-0f95833d9824" status: 200 len: 1221 microversion: 2.1 time: 0.070774 Jan 15 21:28:08.260660 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3541/7070] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:28:08 2022] GET /compute/v2.1/servers/6f326697-d22e-4b06-beb4-0f95833d9824 => generated 1221 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:28:09.275992 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8eeb2e3c-ae33-4950-b140-e07ac8cc17f4 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:28:09.277015 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-8eeb2e3c-ae33-4950-b140-e07ac8cc17f4 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] [instance: 6f326697-d22e-4b06-beb4-0f95833d9824] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:28:09.329189 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-8eeb2e3c-ae33-4950-b140-e07ac8cc17f4 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89236f5f246c43c4a07692e5ee03d58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c845ba3da9154b27a33c0d7254c33025', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:28:09.336132 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-8eeb2e3c-ae33-4950-b140-e07ac8cc17f4 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] 10.222.0.46 "GET /compute/v2.1/servers/6f326697-d22e-4b06-beb4-0f95833d9824" status: 200 len: 1221 microversion: 2.1 time: 0.063987 Jan 15 21:28:09.336723 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3530/7071] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:28:09 2022] GET /compute/v2.1/servers/6f326697-d22e-4b06-beb4-0f95833d9824 => generated 1221 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:28:10.353820 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-18a7ca77-b5f6-4862-8662-a2c56f71f8a1 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:28:10.354433 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-18a7ca77-b5f6-4862-8662-a2c56f71f8a1 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] [instance: 6f326697-d22e-4b06-beb4-0f95833d9824] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:28:10.361718 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-18a7ca77-b5f6-4862-8662-a2c56f71f8a1 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:28:10.362165 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-18a7ca77-b5f6-4862-8662-a2c56f71f8a1 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:28:10.362975 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-18a7ca77-b5f6-4862-8662-a2c56f71f8a1 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:28:10.363408 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-18a7ca77-b5f6-4862-8662-a2c56f71f8a1 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:28:10.422934 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-18a7ca77-b5f6-4862-8662-a2c56f71f8a1 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89236f5f246c43c4a07692e5ee03d58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c845ba3da9154b27a33c0d7254c33025', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:28:10.430575 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-18a7ca77-b5f6-4862-8662-a2c56f71f8a1 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] 10.222.0.46 "GET /compute/v2.1/servers/6f326697-d22e-4b06-beb4-0f95833d9824" status: 200 len: 1225 microversion: 2.1 time: 0.081189 Jan 15 21:28:10.431146 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3542/7072] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:28:10 2022] GET /compute/v2.1/servers/6f326697-d22e-4b06-beb4-0f95833d9824 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:28:11.448462 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-6b1eb048-fea2-4cce-b22d-bd1d7db8032d tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:28:11.449121 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-6b1eb048-fea2-4cce-b22d-bd1d7db8032d tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] [instance: 6f326697-d22e-4b06-beb4-0f95833d9824] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:28:11.456381 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6b1eb048-fea2-4cce-b22d-bd1d7db8032d tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:28:11.456858 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6b1eb048-fea2-4cce-b22d-bd1d7db8032d tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:28:11.457673 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6b1eb048-fea2-4cce-b22d-bd1d7db8032d tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:28:11.458123 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6b1eb048-fea2-4cce-b22d-bd1d7db8032d tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:28:11.521614 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-6b1eb048-fea2-4cce-b22d-bd1d7db8032d tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89236f5f246c43c4a07692e5ee03d58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c845ba3da9154b27a33c0d7254c33025', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:28:11.529728 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-6b1eb048-fea2-4cce-b22d-bd1d7db8032d tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] 10.222.0.46 "GET /compute/v2.1/servers/6f326697-d22e-4b06-beb4-0f95833d9824" status: 200 len: 1279 microversion: 2.1 time: 0.085898 Jan 15 21:28:11.530391 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3531/7073] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:28:11 2022] GET /compute/v2.1/servers/6f326697-d22e-4b06-beb4-0f95833d9824 => generated 1279 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:28:12.548478 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-482462b1-ae40-4fa7-8253-62df4ab29108 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:28:12.549124 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-482462b1-ae40-4fa7-8253-62df4ab29108 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] [instance: 6f326697-d22e-4b06-beb4-0f95833d9824] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:28:12.555871 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-482462b1-ae40-4fa7-8253-62df4ab29108 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:28:12.556325 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-482462b1-ae40-4fa7-8253-62df4ab29108 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:28:12.557131 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-482462b1-ae40-4fa7-8253-62df4ab29108 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:28:12.557567 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-482462b1-ae40-4fa7-8253-62df4ab29108 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:28:12.592435 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-de7ee72e-37fe-45ac-a8db-a6132a89a0f3 req-4f9fe42f-b11b-4850-bc09-b1ee9c04ba7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f326697-d22e-4b06-beb4-0f95833d9824", "tag": "27c84566-e4d6-4ef2-8eab-a944de8dbfa1"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:28:12.594193 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:28:12.594193 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:28:12.607120 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-de7ee72e-37fe-45ac-a8db-a6132a89a0f3 req-4f9fe42f-b11b-4850-bc09-b1ee9c04ba7b service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:28:12.607841 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-de7ee72e-37fe-45ac-a8db-a6132a89a0f3 req-4f9fe42f-b11b-4850-bc09-b1ee9c04ba7b service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:28:12.622491 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-de7ee72e-37fe-45ac-a8db-a6132a89a0f3 req-4f9fe42f-b11b-4850-bc09-b1ee9c04ba7b service nova] Creating event network-changed:27c84566-e4d6-4ef2-8eab-a944de8dbfa1 for instance 6f326697-d22e-4b06-beb4-0f95833d9824 on nch2-master-1 Jan 15 21:28:12.628339 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-de7ee72e-37fe-45ac-a8db-a6132a89a0f3 req-4f9fe42f-b11b-4850-bc09-b1ee9c04ba7b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040689 Jan 15 21:28:12.630107 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3532/7074] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:28:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 21:28:12.719098 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-482462b1-ae40-4fa7-8253-62df4ab29108 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89236f5f246c43c4a07692e5ee03d58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c845ba3da9154b27a33c0d7254c33025', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:28:12.727203 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-482462b1-ae40-4fa7-8253-62df4ab29108 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] 10.222.0.46 "GET /compute/v2.1/servers/6f326697-d22e-4b06-beb4-0f95833d9824" status: 200 len: 1321 microversion: 2.1 time: 0.183693 Jan 15 21:28:12.727794 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3543/7075] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:28:12 2022] GET /compute/v2.1/servers/6f326697-d22e-4b06-beb4-0f95833d9824 => generated 1321 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:28:13.745937 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-868e3c74-5d21-41a1-a7d1-c3eb1b2d805e tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:28:13.746763 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-868e3c74-5d21-41a1-a7d1-c3eb1b2d805e tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] [instance: 6f326697-d22e-4b06-beb4-0f95833d9824] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:28:13.753912 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-868e3c74-5d21-41a1-a7d1-c3eb1b2d805e tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:28:13.754385 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-868e3c74-5d21-41a1-a7d1-c3eb1b2d805e tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:28:13.755190 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-868e3c74-5d21-41a1-a7d1-c3eb1b2d805e tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:28:13.755702 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-868e3c74-5d21-41a1-a7d1-c3eb1b2d805e tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:28:13.890846 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-868e3c74-5d21-41a1-a7d1-c3eb1b2d805e tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89236f5f246c43c4a07692e5ee03d58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c845ba3da9154b27a33c0d7254c33025', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:28:13.898414 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-868e3c74-5d21-41a1-a7d1-c3eb1b2d805e tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] 10.222.0.46 "GET /compute/v2.1/servers/6f326697-d22e-4b06-beb4-0f95833d9824" status: 200 len: 1321 microversion: 2.1 time: 0.157062 Jan 15 21:28:13.898980 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3533/7076] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:28:13 2022] GET /compute/v2.1/servers/6f326697-d22e-4b06-beb4-0f95833d9824 => generated 1321 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:28:14.916624 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1956d230-890c-4404-8367-ed30ca003ada tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:28:14.917288 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-1956d230-890c-4404-8367-ed30ca003ada tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] [instance: 6f326697-d22e-4b06-beb4-0f95833d9824] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:28:14.923387 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1956d230-890c-4404-8367-ed30ca003ada tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:28:14.923857 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1956d230-890c-4404-8367-ed30ca003ada tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:28:14.924628 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1956d230-890c-4404-8367-ed30ca003ada tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:28:14.925108 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1956d230-890c-4404-8367-ed30ca003ada tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:28:15.053848 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-1956d230-890c-4404-8367-ed30ca003ada tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89236f5f246c43c4a07692e5ee03d58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c845ba3da9154b27a33c0d7254c33025', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:28:15.061925 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-1956d230-890c-4404-8367-ed30ca003ada tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] 10.222.0.46 "GET /compute/v2.1/servers/6f326697-d22e-4b06-beb4-0f95833d9824" status: 200 len: 1321 microversion: 2.1 time: 0.149712 Jan 15 21:28:15.062504 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3544/7077] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:28:14 2022] GET /compute/v2.1/servers/6f326697-d22e-4b06-beb4-0f95833d9824 => generated 1321 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:28:16.079267 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c6b46142-1ef2-482c-bbf5-dceed0fe9e80 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:28:16.079769 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c6b46142-1ef2-482c-bbf5-dceed0fe9e80 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] [instance: 6f326697-d22e-4b06-beb4-0f95833d9824] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:28:16.086087 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c6b46142-1ef2-482c-bbf5-dceed0fe9e80 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:28:16.086546 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c6b46142-1ef2-482c-bbf5-dceed0fe9e80 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:28:16.087327 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c6b46142-1ef2-482c-bbf5-dceed0fe9e80 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:28:16.087841 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c6b46142-1ef2-482c-bbf5-dceed0fe9e80 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:28:16.220006 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-c6b46142-1ef2-482c-bbf5-dceed0fe9e80 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89236f5f246c43c4a07692e5ee03d58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c845ba3da9154b27a33c0d7254c33025', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:28:16.227299 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c6b46142-1ef2-482c-bbf5-dceed0fe9e80 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] 10.222.0.46 "GET /compute/v2.1/servers/6f326697-d22e-4b06-beb4-0f95833d9824" status: 200 len: 1321 microversion: 2.1 time: 0.151907 Jan 15 21:28:16.227896 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3534/7078] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:28:16 2022] GET /compute/v2.1/servers/6f326697-d22e-4b06-beb4-0f95833d9824 => generated 1321 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:28:17.243309 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-84bae575-cd44-4b1d-b311-285f31ee9766 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:28:17.243877 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-84bae575-cd44-4b1d-b311-285f31ee9766 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] [instance: 6f326697-d22e-4b06-beb4-0f95833d9824] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:28:17.250697 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-84bae575-cd44-4b1d-b311-285f31ee9766 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:28:17.251137 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-84bae575-cd44-4b1d-b311-285f31ee9766 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:28:17.251911 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-84bae575-cd44-4b1d-b311-285f31ee9766 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:28:17.252341 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-84bae575-cd44-4b1d-b311-285f31ee9766 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:28:17.385254 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-84bae575-cd44-4b1d-b311-285f31ee9766 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89236f5f246c43c4a07692e5ee03d58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c845ba3da9154b27a33c0d7254c33025', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:28:17.392521 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-84bae575-cd44-4b1d-b311-285f31ee9766 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] 10.222.0.46 "GET /compute/v2.1/servers/6f326697-d22e-4b06-beb4-0f95833d9824" status: 200 len: 1321 microversion: 2.1 time: 0.152970 Jan 15 21:28:17.393130 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3545/7079] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:28:17 2022] GET /compute/v2.1/servers/6f326697-d22e-4b06-beb4-0f95833d9824 => generated 1321 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:28:17.934648 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-2f332b23-ac19-4799-8346-b0ec630bfe71 req-6e52c149-37ab-46bc-861c-5ca7492b54b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f326697-d22e-4b06-beb4-0f95833d9824", "name": "network-vif-plugged", "status": "completed", "tag": "27c84566-e4d6-4ef2-8eab-a944de8dbfa1"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:28:17.936237 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:28:17.936237 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:28:17.944074 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-2f332b23-ac19-4799-8346-b0ec630bfe71 req-6e52c149-37ab-46bc-861c-5ca7492b54b0 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:28:17.944377 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-2f332b23-ac19-4799-8346-b0ec630bfe71 req-6e52c149-37ab-46bc-861c-5ca7492b54b0 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:28:17.956091 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-2f332b23-ac19-4799-8346-b0ec630bfe71 req-6e52c149-37ab-46bc-861c-5ca7492b54b0 service nova] Creating event network-vif-plugged:27c84566-e4d6-4ef2-8eab-a944de8dbfa1 for instance 6f326697-d22e-4b06-beb4-0f95833d9824 on nch2-master-1 Jan 15 21:28:17.960833 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-2f332b23-ac19-4799-8346-b0ec630bfe71 req-6e52c149-37ab-46bc-861c-5ca7492b54b0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030439 Jan 15 21:28:17.961535 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3535/7080] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:28:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:28:18.409909 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a52b4544-ce64-443f-9be1-a02473cfbc42 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:28:18.410515 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a52b4544-ce64-443f-9be1-a02473cfbc42 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] [instance: 6f326697-d22e-4b06-beb4-0f95833d9824] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:28:18.418101 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a52b4544-ce64-443f-9be1-a02473cfbc42 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:28:18.418551 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a52b4544-ce64-443f-9be1-a02473cfbc42 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:28:18.419337 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a52b4544-ce64-443f-9be1-a02473cfbc42 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:28:18.419786 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a52b4544-ce64-443f-9be1-a02473cfbc42 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:28:18.557557 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-a52b4544-ce64-443f-9be1-a02473cfbc42 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89236f5f246c43c4a07692e5ee03d58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c845ba3da9154b27a33c0d7254c33025', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:28:18.564825 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a52b4544-ce64-443f-9be1-a02473cfbc42 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] 10.222.0.46 "GET /compute/v2.1/servers/6f326697-d22e-4b06-beb4-0f95833d9824" status: 200 len: 1321 microversion: 2.1 time: 0.158654 Jan 15 21:28:18.565432 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3546/7081] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:28:18 2022] GET /compute/v2.1/servers/6f326697-d22e-4b06-beb4-0f95833d9824 => generated 1321 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:28:19.582201 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2d52ca0a-688f-42f0-bb27-0bb302e2efc3 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:28:19.582959 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-2d52ca0a-688f-42f0-bb27-0bb302e2efc3 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] [instance: 6f326697-d22e-4b06-beb4-0f95833d9824] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:28:19.590345 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2d52ca0a-688f-42f0-bb27-0bb302e2efc3 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:28:19.590681 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2d52ca0a-688f-42f0-bb27-0bb302e2efc3 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:28:19.591480 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2d52ca0a-688f-42f0-bb27-0bb302e2efc3 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:28:19.591929 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2d52ca0a-688f-42f0-bb27-0bb302e2efc3 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:28:19.732732 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-2d52ca0a-688f-42f0-bb27-0bb302e2efc3 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89236f5f246c43c4a07692e5ee03d58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c845ba3da9154b27a33c0d7254c33025', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:28:19.740482 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2d52ca0a-688f-42f0-bb27-0bb302e2efc3 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] 10.222.0.46 "GET /compute/v2.1/servers/6f326697-d22e-4b06-beb4-0f95833d9824" status: 200 len: 1471 microversion: 2.1 time: 0.163295 Jan 15 21:28:19.741362 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3536/7082] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:28:19 2022] GET /compute/v2.1/servers/6f326697-d22e-4b06-beb4-0f95833d9824 => generated 1471 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:28:19.814950 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4ca32526-8c39-429b-873a-3534fe84a500 tempest-ServersAdminNegativeTestJSON-1244768382 tempest-ServersAdminNegativeTestJSON-1244768382-project-admin] Calling method '.version_select at 0x7f30c86c4040>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:28:19.879817 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-4ca32526-8c39-429b-873a-3534fe84a500 tempest-ServersAdminNegativeTestJSON-1244768382 tempest-ServersAdminNegativeTestJSON-1244768382-project-admin] 10.222.0.46 "GET /compute/v2.1/os-quota-sets/e38fcc46b0df429c82b0b369fb480396" status: 200 len: 371 microversion: 2.1 time: 0.124237 Jan 15 21:28:19.880648 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3547/7083] 10.222.0.46 () {58 vars in 1241 bytes} [Sat Jan 15 21:28:19 2022] GET /compute/v2.1/os-quota-sets/e38fcc46b0df429c82b0b369fb480396 => generated 371 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:28:19.891843 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b4447aeb-a72b-4f17-b974-8d4618c96e98 tempest-ServersAdminNegativeTestJSON-1244768382 tempest-ServersAdminNegativeTestJSON-1244768382-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-788678028", "id": 1269433399, "os-flavor-access:is_public": "True"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:28:19.893478 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:28:19.893478 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:28:19.908490 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b4447aeb-a72b-4f17-b974-8d4618c96e98 tempest-ServersAdminNegativeTestJSON-1244768382 tempest-ServersAdminNegativeTestJSON-1244768382-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.020231 Jan 15 21:28:19.909109 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3537/7084] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 21:28:19 2022] POST /compute/v2.1/flavors => generated 437 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:28:19.920225 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a548441d-8964-47e8-8884-8867c81388eb tempest-ServersAdminNegativeTestJSON-1244768382 tempest-ServersAdminNegativeTestJSON-1244768382-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1269433399"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:28:19.921216 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a548441d-8964-47e8-8884-8867c81388eb tempest-ServersAdminNegativeTestJSON-1244768382 tempest-ServersAdminNegativeTestJSON-1244768382-project-admin] [instance: 6f326697-d22e-4b06-beb4-0f95833d9824] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:28:19.927173 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a548441d-8964-47e8-8884-8867c81388eb tempest-ServersAdminNegativeTestJSON-1244768382 tempest-ServersAdminNegativeTestJSON-1244768382-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:28:19.927625 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a548441d-8964-47e8-8884-8867c81388eb tempest-ServersAdminNegativeTestJSON-1244768382 tempest-ServersAdminNegativeTestJSON-1244768382-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:28:19.928401 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a548441d-8964-47e8-8884-8867c81388eb tempest-ServersAdminNegativeTestJSON-1244768382 tempest-ServersAdminNegativeTestJSON-1244768382-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:28:19.928861 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a548441d-8964-47e8-8884-8867c81388eb tempest-ServersAdminNegativeTestJSON-1244768382 tempest-ServersAdminNegativeTestJSON-1244768382-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:28:20.016686 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-a548441d-8964-47e8-8884-8867c81388eb tempest-ServersAdminNegativeTestJSON-1244768382 tempest-ServersAdminNegativeTestJSON-1244768382-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '6cf8e387e2a14f448692c5014750db16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fcc46b0df429c82b0b369fb480396', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:28:20.022965 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a548441d-8964-47e8-8884-8867c81388eb tempest-ServersAdminNegativeTestJSON-1244768382 tempest-ServersAdminNegativeTestJSON-1244768382-project-admin] [instance: 6f326697-d22e-4b06-beb4-0f95833d9824] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-788678028 {{(pid=129366) resize /opt/stack/nova/nova/compute/api.py:4097}} Jan 15 21:28:20.024013 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a548441d-8964-47e8-8884-8867c81388eb tempest-ServersAdminNegativeTestJSON-1244768382 tempest-ServersAdminNegativeTestJSON-1244768382-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:28:20.024458 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a548441d-8964-47e8-8884-8867c81388eb tempest-ServersAdminNegativeTestJSON-1244768382 tempest-ServersAdminNegativeTestJSON-1244768382-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:28:20.025797 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a548441d-8964-47e8-8884-8867c81388eb tempest-ServersAdminNegativeTestJSON-1244768382 tempest-ServersAdminNegativeTestJSON-1244768382-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:28:20.026244 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a548441d-8964-47e8-8884-8867c81388eb tempest-ServersAdminNegativeTestJSON-1244768382 tempest-ServersAdminNegativeTestJSON-1244768382-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:28:20.046423 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-a548441d-8964-47e8-8884-8867c81388eb tempest-ServersAdminNegativeTestJSON-1244768382 tempest-ServersAdminNegativeTestJSON-1244768382-project-admin] Getting quotas for project c845ba3da9154b27a33c0d7254c33025. Resources: {'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:28:20.051202 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-a548441d-8964-47e8-8884-8867c81388eb tempest-ServersAdminNegativeTestJSON-1244768382 tempest-ServersAdminNegativeTestJSON-1244768382-project-admin] Getting quotas for user 89236f5f246c43c4a07692e5ee03d58b and project c845ba3da9154b27a33c0d7254c33025. Resources: {'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:28:20.063724 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.compute.api [None req-a548441d-8964-47e8-8884-8867c81388eb tempest-ServersAdminNegativeTestJSON-1244768382 tempest-ServersAdminNegativeTestJSON-1244768382-project-admin] ram quota exceeded for e38fcc46b0df429c82b0b369fb480396, tried to resize instance. Jan 15 21:28:20.064266 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-a548441d-8964-47e8-8884-8867c81388eb tempest-ServersAdminNegativeTestJSON-1244768382 tempest-ServersAdminNegativeTestJSON-1244768382-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jan 15 21:28:20.064866 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a548441d-8964-47e8-8884-8867c81388eb tempest-ServersAdminNegativeTestJSON-1244768382 tempest-ServersAdminNegativeTestJSON-1244768382-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:28:20.065699 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a548441d-8964-47e8-8884-8867c81388eb tempest-ServersAdminNegativeTestJSON-1244768382 tempest-ServersAdminNegativeTestJSON-1244768382-project-admin] 10.222.0.46 "POST /compute/v2.1/servers/6f326697-d22e-4b06-beb4-0f95833d9824/action" status: 403 len: 118 microversion: 2.1 time: 0.149873 Jan 15 21:28:20.066277 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3548/7085] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:28:19 2022] POST /compute/v2.1/servers/6f326697-d22e-4b06-beb4-0f95833d9824/action => generated 118 bytes in 151 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jan 15 21:28:20.075322 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-6838586d-dd52-4dcd-b800-ca3b0b53545c tempest-ServersAdminNegativeTestJSON-1244768382 tempest-ServersAdminNegativeTestJSON-1244768382-project-admin] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:28:20.076083 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:28:20.076083 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:28:20.092008 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-6838586d-dd52-4dcd-b800-ca3b0b53545c tempest-ServersAdminNegativeTestJSON-1244768382 tempest-ServersAdminNegativeTestJSON-1244768382-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/1269433399" status: 202 len: 0 microversion: 2.1 time: 0.021142 Jan 15 21:28:20.092554 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3538/7086] 10.222.0.46 () {58 vars in 1160 bytes} [Sat Jan 15 21:28:20 2022] DELETE /compute/v2.1/flavors/1269433399 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:28:20.100329 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a5ca7429-188b-46bc-bdf0-76d00bd3a096 tempest-ServersAdminNegativeTestJSON-1244768382 tempest-ServersAdminNegativeTestJSON-1244768382-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:28:20.119873 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a5ca7429-188b-46bc-bdf0-76d00bd3a096 tempest-ServersAdminNegativeTestJSON-1244768382 tempest-ServersAdminNegativeTestJSON-1244768382-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.022497 Jan 15 21:28:20.120498 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3549/7087] 10.222.0.46 () {58 vars in 1145 bytes} [Sat Jan 15 21:28:20 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:28:20.137597 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-df9e3b74-5554-4d6b-a557-87aac4011d42 tempest-ServersAdminNegativeTestJSON-1244768382 tempest-ServersAdminNegativeTestJSON-1244768382-project-admin] Calling method '.version_select at 0x7f30c8dd81f0>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:28:20.204764 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-df9e3b74-5554-4d6b-a557-87aac4011d42 tempest-ServersAdminNegativeTestJSON-1244768382 tempest-ServersAdminNegativeTestJSON-1244768382-project-admin] 10.222.0.46 "GET /compute/v2.1/os-quota-sets/e38fcc46b0df429c82b0b369fb480396" status: 200 len: 371 microversion: 2.1 time: 0.070761 Jan 15 21:28:20.205362 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3539/7088] 10.222.0.46 () {58 vars in 1241 bytes} [Sat Jan 15 21:28:20 2022] GET /compute/v2.1/os-quota-sets/e38fcc46b0df429c82b0b369fb480396 => generated 371 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:28:20.215434 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9cb728df-fd6f-4585-8333-82a8bf6417b1 tempest-ServersAdminNegativeTestJSON-1244768382 tempest-ServersAdminNegativeTestJSON-1244768382-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-223906679", "id": 1242004839, "os-flavor-access:is_public": "True"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:28:20.217055 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:28:20.217055 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:28:20.232868 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-9cb728df-fd6f-4585-8333-82a8bf6417b1 tempest-ServersAdminNegativeTestJSON-1244768382 tempest-ServersAdminNegativeTestJSON-1244768382-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.021266 Jan 15 21:28:20.233442 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3550/7089] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 21:28:20 2022] POST /compute/v2.1/flavors => generated 436 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:28:20.243597 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-bb688042-590e-4479-bcc2-810f3c3b8f30 tempest-ServersAdminNegativeTestJSON-1244768382 tempest-ServersAdminNegativeTestJSON-1244768382-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1242004839"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:28:20.245522 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-bb688042-590e-4479-bcc2-810f3c3b8f30 tempest-ServersAdminNegativeTestJSON-1244768382 tempest-ServersAdminNegativeTestJSON-1244768382-project-admin] [instance: 6f326697-d22e-4b06-beb4-0f95833d9824] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:28:20.251453 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bb688042-590e-4479-bcc2-810f3c3b8f30 tempest-ServersAdminNegativeTestJSON-1244768382 tempest-ServersAdminNegativeTestJSON-1244768382-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:28:20.251917 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bb688042-590e-4479-bcc2-810f3c3b8f30 tempest-ServersAdminNegativeTestJSON-1244768382 tempest-ServersAdminNegativeTestJSON-1244768382-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:28:20.252711 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bb688042-590e-4479-bcc2-810f3c3b8f30 tempest-ServersAdminNegativeTestJSON-1244768382 tempest-ServersAdminNegativeTestJSON-1244768382-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:28:20.253184 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bb688042-590e-4479-bcc2-810f3c3b8f30 tempest-ServersAdminNegativeTestJSON-1244768382 tempest-ServersAdminNegativeTestJSON-1244768382-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:28:20.447692 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-bb688042-590e-4479-bcc2-810f3c3b8f30 tempest-ServersAdminNegativeTestJSON-1244768382 tempest-ServersAdminNegativeTestJSON-1244768382-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '6cf8e387e2a14f448692c5014750db16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fcc46b0df429c82b0b369fb480396', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:28:20.454062 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-bb688042-590e-4479-bcc2-810f3c3b8f30 tempest-ServersAdminNegativeTestJSON-1244768382 tempest-ServersAdminNegativeTestJSON-1244768382-project-admin] [instance: 6f326697-d22e-4b06-beb4-0f95833d9824] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-223906679 {{(pid=129365) resize /opt/stack/nova/nova/compute/api.py:4097}} Jan 15 21:28:20.455159 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bb688042-590e-4479-bcc2-810f3c3b8f30 tempest-ServersAdminNegativeTestJSON-1244768382 tempest-ServersAdminNegativeTestJSON-1244768382-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:28:20.455629 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bb688042-590e-4479-bcc2-810f3c3b8f30 tempest-ServersAdminNegativeTestJSON-1244768382 tempest-ServersAdminNegativeTestJSON-1244768382-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:28:20.456420 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bb688042-590e-4479-bcc2-810f3c3b8f30 tempest-ServersAdminNegativeTestJSON-1244768382 tempest-ServersAdminNegativeTestJSON-1244768382-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:28:20.456892 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bb688042-590e-4479-bcc2-810f3c3b8f30 tempest-ServersAdminNegativeTestJSON-1244768382 tempest-ServersAdminNegativeTestJSON-1244768382-project-admin] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:28:20.480399 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-bb688042-590e-4479-bcc2-810f3c3b8f30 tempest-ServersAdminNegativeTestJSON-1244768382 tempest-ServersAdminNegativeTestJSON-1244768382-project-admin] Getting quotas for project c845ba3da9154b27a33c0d7254c33025. Resources: {'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:28:20.485234 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-bb688042-590e-4479-bcc2-810f3c3b8f30 tempest-ServersAdminNegativeTestJSON-1244768382 tempest-ServersAdminNegativeTestJSON-1244768382-project-admin] Getting quotas for user 89236f5f246c43c4a07692e5ee03d58b and project c845ba3da9154b27a33c0d7254c33025. Resources: {'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:28:20.497949 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.compute.api [None req-bb688042-590e-4479-bcc2-810f3c3b8f30 tempest-ServersAdminNegativeTestJSON-1244768382 tempest-ServersAdminNegativeTestJSON-1244768382-project-admin] cores quota exceeded for e38fcc46b0df429c82b0b369fb480396, tried to resize instance. Jan 15 21:28:20.498500 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-bb688042-590e-4479-bcc2-810f3c3b8f30 tempest-ServersAdminNegativeTestJSON-1244768382 tempest-ServersAdminNegativeTestJSON-1244768382-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jan 15 21:28:20.499096 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-bb688042-590e-4479-bcc2-810f3c3b8f30 tempest-ServersAdminNegativeTestJSON-1244768382 tempest-ServersAdminNegativeTestJSON-1244768382-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:28:20.499936 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-bb688042-590e-4479-bcc2-810f3c3b8f30 tempest-ServersAdminNegativeTestJSON-1244768382 tempest-ServersAdminNegativeTestJSON-1244768382-project-admin] 10.222.0.46 "POST /compute/v2.1/servers/6f326697-d22e-4b06-beb4-0f95833d9824/action" status: 403 len: 113 microversion: 2.1 time: 0.260193 Jan 15 21:28:20.500518 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3540/7090] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:28:20 2022] POST /compute/v2.1/servers/6f326697-d22e-4b06-beb4-0f95833d9824/action => generated 113 bytes in 261 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:28:20.508566 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-18d506c0-cb51-4613-b6c2-6b80fb1afba2 tempest-ServersAdminNegativeTestJSON-1244768382 tempest-ServersAdminNegativeTestJSON-1244768382-project-admin] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:28:20.509362 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:28:20.509362 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:28:20.525922 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-18d506c0-cb51-4613-b6c2-6b80fb1afba2 tempest-ServersAdminNegativeTestJSON-1244768382 tempest-ServersAdminNegativeTestJSON-1244768382-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/1242004839" status: 202 len: 0 microversion: 2.1 time: 0.020414 Jan 15 21:28:20.526617 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3551/7091] 10.222.0.46 () {58 vars in 1160 bytes} [Sat Jan 15 21:28:20 2022] DELETE /compute/v2.1/flavors/1242004839 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:28:20.534470 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-eb2a4bfd-a831-41f2-9d2a-1a7e16825f6c tempest-ServersAdminNegativeTestJSON-1244768382 tempest-ServersAdminNegativeTestJSON-1244768382-project-admin] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:28:20.553818 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-eb2a4bfd-a831-41f2-9d2a-1a7e16825f6c tempest-ServersAdminNegativeTestJSON-1244768382 tempest-ServersAdminNegativeTestJSON-1244768382-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.022867 Jan 15 21:28:20.554387 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3541/7092] 10.222.0.46 () {58 vars in 1145 bytes} [Sat Jan 15 21:28:20 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:28:20.570936 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b365d82e-fc6e-4251-8203-5abf62bf5223 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:28:20.571409 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b365d82e-fc6e-4251-8203-5abf62bf5223 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] [instance: 6f326697-d22e-4b06-beb4-0f95833d9824] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:28:20.577450 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b365d82e-fc6e-4251-8203-5abf62bf5223 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:28:20.577895 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b365d82e-fc6e-4251-8203-5abf62bf5223 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:28:20.578663 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b365d82e-fc6e-4251-8203-5abf62bf5223 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:28:20.579092 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b365d82e-fc6e-4251-8203-5abf62bf5223 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:28:20.604151 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b365d82e-fc6e-4251-8203-5abf62bf5223 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] [instance: 6f326697-d22e-4b06-beb4-0f95833d9824] Going to try to terminate instance {{(pid=129366) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 21:28:20.679659 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b365d82e-fc6e-4251-8203-5abf62bf5223 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] 10.222.0.46 "DELETE /compute/v2.1/servers/6f326697-d22e-4b06-beb4-0f95833d9824" status: 204 len: 0 microversion: 2.1 time: 0.112014 Jan 15 21:28:20.680461 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3552/7093] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 21:28:20 2022] DELETE /compute/v2.1/servers/6f326697-d22e-4b06-beb4-0f95833d9824 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 15 21:28:20.688778 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-05b3688e-9528-4ef6-a172-3d3b02570bd3 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:28:20.689677 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-05b3688e-9528-4ef6-a172-3d3b02570bd3 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] [instance: 6f326697-d22e-4b06-beb4-0f95833d9824] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:28:20.698870 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-05b3688e-9528-4ef6-a172-3d3b02570bd3 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:28:20.699343 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-05b3688e-9528-4ef6-a172-3d3b02570bd3 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:28:20.700154 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-05b3688e-9528-4ef6-a172-3d3b02570bd3 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:28:20.700607 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-05b3688e-9528-4ef6-a172-3d3b02570bd3 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:28:20.830605 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-05b3688e-9528-4ef6-a172-3d3b02570bd3 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89236f5f246c43c4a07692e5ee03d58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c845ba3da9154b27a33c0d7254c33025', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:28:20.839104 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-05b3688e-9528-4ef6-a172-3d3b02570bd3 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] 10.222.0.46 "GET /compute/v2.1/servers/6f326697-d22e-4b06-beb4-0f95833d9824" status: 200 len: 1477 microversion: 2.1 time: 0.153300 Jan 15 21:28:20.839690 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3542/7094] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:28:20 2022] GET /compute/v2.1/servers/6f326697-d22e-4b06-beb4-0f95833d9824 => generated 1477 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:28:21.857197 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-3a593df3-0e2e-49de-bd3e-c58b30be9a03 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:28:21.857897 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-3a593df3-0e2e-49de-bd3e-c58b30be9a03 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] [instance: 6f326697-d22e-4b06-beb4-0f95833d9824] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:28:21.864487 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3a593df3-0e2e-49de-bd3e-c58b30be9a03 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:28:21.864980 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3a593df3-0e2e-49de-bd3e-c58b30be9a03 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:28:21.865772 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3a593df3-0e2e-49de-bd3e-c58b30be9a03 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:28:21.866212 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3a593df3-0e2e-49de-bd3e-c58b30be9a03 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:28:22.007682 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-3a593df3-0e2e-49de-bd3e-c58b30be9a03 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89236f5f246c43c4a07692e5ee03d58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c845ba3da9154b27a33c0d7254c33025', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:28:22.016740 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-3a593df3-0e2e-49de-bd3e-c58b30be9a03 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] 10.222.0.46 "GET /compute/v2.1/servers/6f326697-d22e-4b06-beb4-0f95833d9824" status: 200 len: 1477 microversion: 2.1 time: 0.163864 Jan 15 21:28:22.017353 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3553/7095] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:28:21 2022] GET /compute/v2.1/servers/6f326697-d22e-4b06-beb4-0f95833d9824 => generated 1477 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:28:22.570593 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-f35121b2-d482-4dd7-9fcb-be20c8765865 req-7246200a-cd4a-4218-b9b4-2df2229f5603 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f326697-d22e-4b06-beb4-0f95833d9824", "name": "network-vif-deleted", "tag": "27c84566-e4d6-4ef2-8eab-a944de8dbfa1"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:28:22.572921 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:28:22.572921 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:28:22.583220 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-f35121b2-d482-4dd7-9fcb-be20c8765865 req-7246200a-cd4a-4218-b9b4-2df2229f5603 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:28:22.583674 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-f35121b2-d482-4dd7-9fcb-be20c8765865 req-7246200a-cd4a-4218-b9b4-2df2229f5603 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:28:22.597204 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-f35121b2-d482-4dd7-9fcb-be20c8765865 req-7246200a-cd4a-4218-b9b4-2df2229f5603 service nova] Creating event network-vif-deleted:27c84566-e4d6-4ef2-8eab-a944de8dbfa1 for instance 6f326697-d22e-4b06-beb4-0f95833d9824 on nch2-master-1 Jan 15 21:28:22.603200 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-f35121b2-d482-4dd7-9fcb-be20c8765865 req-7246200a-cd4a-4218-b9b4-2df2229f5603 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036896 Jan 15 21:28:22.604502 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3543/7096] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:28:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:28:23.033955 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4f815b0e-18be-4fbe-ad3f-d5858ffea965 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:28:23.034566 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-4f815b0e-18be-4fbe-ad3f-d5858ffea965 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] [instance: 6f326697-d22e-4b06-beb4-0f95833d9824] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:28:23.041674 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4f815b0e-18be-4fbe-ad3f-d5858ffea965 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:28:23.042142 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4f815b0e-18be-4fbe-ad3f-d5858ffea965 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:28:23.042952 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4f815b0e-18be-4fbe-ad3f-d5858ffea965 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:28:23.043396 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4f815b0e-18be-4fbe-ad3f-d5858ffea965 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:28:23.076526 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4f815b0e-18be-4fbe-ad3f-d5858ffea965 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:28:23.077010 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4f815b0e-18be-4fbe-ad3f-d5858ffea965 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:28:23.077461 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.objects.instance [None req-4f815b0e-18be-4fbe-ad3f-d5858ffea965 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] Lazy-loading 'fault' on Instance uuid 6f326697-d22e-4b06-beb4-0f95833d9824 {{(pid=129366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 21:28:23.117941 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-4f815b0e-18be-4fbe-ad3f-d5858ffea965 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89236f5f246c43c4a07692e5ee03d58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c845ba3da9154b27a33c0d7254c33025', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:28:23.125243 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-4f815b0e-18be-4fbe-ad3f-d5858ffea965 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] 10.222.0.46 "GET /compute/v2.1/servers/6f326697-d22e-4b06-beb4-0f95833d9824" status: 200 len: 1311 microversion: 2.1 time: 0.094899 Jan 15 21:28:23.125830 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3554/7097] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:28:23 2022] GET /compute/v2.1/servers/6f326697-d22e-4b06-beb4-0f95833d9824 => generated 1311 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:28:24.143023 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-28e9ff0d-9357-42a9-884f-4e568c225fb3 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:28:24.143732 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-28e9ff0d-9357-42a9-884f-4e568c225fb3 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] [instance: 6f326697-d22e-4b06-beb4-0f95833d9824] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:28:24.150708 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-28e9ff0d-9357-42a9-884f-4e568c225fb3 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:28:24.151390 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-28e9ff0d-9357-42a9-884f-4e568c225fb3 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:28:24.152181 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-28e9ff0d-9357-42a9-884f-4e568c225fb3 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:28:24.152625 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-28e9ff0d-9357-42a9-884f-4e568c225fb3 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:28:24.165817 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-28e9ff0d-9357-42a9-884f-4e568c225fb3 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] HTTP exception thrown: Instance 6f326697-d22e-4b06-beb4-0f95833d9824 could not be found. Jan 15 21:28:24.166404 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-28e9ff0d-9357-42a9-884f-4e568c225fb3 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] Returning 404 to user: Instance 6f326697-d22e-4b06-beb4-0f95833d9824 could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:28:24.167724 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-28e9ff0d-9357-42a9-884f-4e568c225fb3 tempest-ServersAdminNegativeTestJSON-1251446709 tempest-ServersAdminNegativeTestJSON-1251446709-project] 10.222.0.46 "GET /compute/v2.1/servers/6f326697-d22e-4b06-beb4-0f95833d9824" status: 404 len: 111 microversion: 2.1 time: 0.028881 Jan 15 21:28:24.168255 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3544/7098] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:28:24 2022] GET /compute/v2.1/servers/6f326697-d22e-4b06-beb4-0f95833d9824 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:28:26.830775 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-119b4846-44a1-424a-a9e2-9c803f20ea3b tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1449346417", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "networks": [{"uuid": "84e6a93e-a723-4218-9782-8327f3465e6e"}]}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:28:26.883052 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.network.neutron [None req-119b4846-44a1-424a-a9e2-9c803f20ea3b tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] validate_networks() for [('84e6a93e-a723-4218-9782-8327f3465e6e', None, None, None, None, None)] {{(pid=129366) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 21:28:27.237699 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-119b4846-44a1-424a-a9e2-9c803f20ea3b tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Flavor limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 21:28:27.238124 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-119b4846-44a1-424a-a9e2-9c803f20ea3b tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Image limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 21:28:27.238628 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-119b4846-44a1-424a-a9e2-9c803f20ea3b tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Flavor pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 21:28:27.239035 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-119b4846-44a1-424a-a9e2-9c803f20ea3b tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Image pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 21:28:27.239444 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-119b4846-44a1-424a-a9e2-9c803f20ea3b tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 21:28:27.249506 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-119b4846-44a1-424a-a9e2-9c803f20ea3b tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:28:27.250047 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-119b4846-44a1-424a-a9e2-9c803f20ea3b tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:28:27.250926 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-119b4846-44a1-424a-a9e2-9c803f20ea3b tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:28:27.251431 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-119b4846-44a1-424a-a9e2-9c803f20ea3b tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:28:27.268998 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-119b4846-44a1-424a-a9e2-9c803f20ea3b tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Getting quotas for project 7a33df632a564f848cd29e58e05f06e0. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:28:27.274044 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-119b4846-44a1-424a-a9e2-9c803f20ea3b tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Getting quotas for user 4f8432db75534b2e90e74f8cda85c482 and project 7a33df632a564f848cd29e58e05f06e0. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:28:27.287048 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-119b4846-44a1-424a-a9e2-9c803f20ea3b tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Going to run 1 instances... {{(pid=129366) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 21:28:27.289401 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-119b4846-44a1-424a-a9e2-9c803f20ea3b tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] [instance: e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 21:28:27.337298 ncdv-master-1 devstack@n-api.service[129366]: ERROR oslo.messaging._drivers.impl_rabbit [None req-119b4846-44a1-424a-a9e2-9c803f20ea3b tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] [26274f21-2fc1-471c-a33b-036373cfca54] AMQP server on 10.222.0.46:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 15 21:28:28.347200 ncdv-master-1 devstack@n-api.service[129366]: INFO oslo.messaging._drivers.impl_rabbit [None req-119b4846-44a1-424a-a9e2-9c803f20ea3b tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] [26274f21-2fc1-471c-a33b-036373cfca54] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 37124. Jan 15 21:28:28.356739 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-119b4846-44a1-424a-a9e2-9c803f20ea3b tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.643956 Jan 15 21:28:28.357487 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3555/7099] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 21:28:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1645 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 21:28:28.367851 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d6459fb2-ace0-4ea5-b7b4-e4efcfdb74f4 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:28:28.368476 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d6459fb2-ace0-4ea5-b7b4-e4efcfdb74f4 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] [instance: e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:28:28.433670 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-d6459fb2-ace0-4ea5-b7b4-e4efcfdb74f4 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8432db75534b2e90e74f8cda85c482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a33df632a564f848cd29e58e05f06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:28:28.441264 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d6459fb2-ace0-4ea5-b7b4-e4efcfdb74f4 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] 10.222.0.46 "GET /compute/v2.1/servers/e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e" status: 200 len: 1215 microversion: 2.1 time: 0.077185 Jan 15 21:28:28.442062 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3545/7100] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:28:28 2022] GET /compute/v2.1/servers/e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e => generated 1215 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:28:29.458982 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8160375b-f0e8-485a-8532-3c3b3b9eed8c tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:28:29.459662 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-8160375b-f0e8-485a-8532-3c3b3b9eed8c tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] [instance: e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:28:29.466403 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8160375b-f0e8-485a-8532-3c3b3b9eed8c tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:28:29.466956 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8160375b-f0e8-485a-8532-3c3b3b9eed8c tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:28:29.468115 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8160375b-f0e8-485a-8532-3c3b3b9eed8c tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:28:29.468579 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8160375b-f0e8-485a-8532-3c3b3b9eed8c tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:28:29.530287 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-8160375b-f0e8-485a-8532-3c3b3b9eed8c tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8432db75534b2e90e74f8cda85c482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a33df632a564f848cd29e58e05f06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:28:29.538348 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-8160375b-f0e8-485a-8532-3c3b3b9eed8c tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] 10.222.0.46 "GET /compute/v2.1/servers/e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e" status: 200 len: 1273 microversion: 2.1 time: 0.083815 Jan 15 21:28:29.538940 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3556/7101] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:28:29 2022] GET /compute/v2.1/servers/e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e => generated 1273 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:28:30.555451 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-4e23fb63-f37b-41d1-9f5b-0179e4fffd0f tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:28:30.556327 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-4e23fb63-f37b-41d1-9f5b-0179e4fffd0f tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] [instance: e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:28:30.559769 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-6058a101-2e75-4963-bd73-1f97f089fed0 req-941ba4a4-e900-4a1f-ae93-632a8d306a7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e", "tag": "8e8cab91-6949-4229-9f6f-1641aced301c"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:28:30.564382 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4e23fb63-f37b-41d1-9f5b-0179e4fffd0f tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:28:30.564876 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4e23fb63-f37b-41d1-9f5b-0179e4fffd0f tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:28:30.566123 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4e23fb63-f37b-41d1-9f5b-0179e4fffd0f tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:28:30.566598 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4e23fb63-f37b-41d1-9f5b-0179e4fffd0f tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:28:30.566927 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:28:30.566927 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:28:30.577962 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-6058a101-2e75-4963-bd73-1f97f089fed0 req-941ba4a4-e900-4a1f-ae93-632a8d306a7b service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:28:30.578404 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-6058a101-2e75-4963-bd73-1f97f089fed0 req-941ba4a4-e900-4a1f-ae93-632a8d306a7b service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:28:30.597515 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-6058a101-2e75-4963-bd73-1f97f089fed0 req-941ba4a4-e900-4a1f-ae93-632a8d306a7b service nova] Creating event network-changed:8e8cab91-6949-4229-9f6f-1641aced301c for instance e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e on nch2-master-1 Jan 15 21:28:30.602666 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-6058a101-2e75-4963-bd73-1f97f089fed0 req-941ba4a4-e900-4a1f-ae93-632a8d306a7b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049174 Jan 15 21:28:30.603476 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3557/7102] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:28:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 21:28:30.711519 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-4e23fb63-f37b-41d1-9f5b-0179e4fffd0f tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8432db75534b2e90e74f8cda85c482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a33df632a564f848cd29e58e05f06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:28:30.718963 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-4e23fb63-f37b-41d1-9f5b-0179e4fffd0f tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] 10.222.0.46 "GET /compute/v2.1/servers/e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e" status: 200 len: 1315 microversion: 2.1 time: 0.167245 Jan 15 21:28:30.719542 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3546/7103] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:28:30 2022] GET /compute/v2.1/servers/e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:28:31.293815 ncdv-master-1 devstack@n-api.service[129365]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 15 21:28:31.294003 ncdv-master-1 devstack@n-api.service[129365]: Sat Jan 15 21:28:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 15 21:28:31.738141 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-2a7db009-6893-4752-8cb9-95c10cac92c3 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:28:31.738822 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-2a7db009-6893-4752-8cb9-95c10cac92c3 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] [instance: e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:28:31.745007 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2a7db009-6893-4752-8cb9-95c10cac92c3 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:28:31.745451 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2a7db009-6893-4752-8cb9-95c10cac92c3 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:28:31.746341 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2a7db009-6893-4752-8cb9-95c10cac92c3 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:28:31.746869 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2a7db009-6893-4752-8cb9-95c10cac92c3 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:28:31.875340 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-2a7db009-6893-4752-8cb9-95c10cac92c3 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8432db75534b2e90e74f8cda85c482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a33df632a564f848cd29e58e05f06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:28:31.882723 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-2a7db009-6893-4752-8cb9-95c10cac92c3 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] 10.222.0.46 "GET /compute/v2.1/servers/e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e" status: 200 len: 1315 microversion: 2.1 time: 0.149750 Jan 15 21:28:31.883302 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3558/7104] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:28:31 2022] GET /compute/v2.1/servers/e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:28:32.899003 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9079ec6f-eafe-4225-8e24-15afbb25a22a tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:28:32.899692 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-9079ec6f-eafe-4225-8e24-15afbb25a22a tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] [instance: e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:28:32.907006 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9079ec6f-eafe-4225-8e24-15afbb25a22a tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:28:32.907465 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9079ec6f-eafe-4225-8e24-15afbb25a22a tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:28:32.908249 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9079ec6f-eafe-4225-8e24-15afbb25a22a tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:28:32.908693 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9079ec6f-eafe-4225-8e24-15afbb25a22a tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:28:33.042803 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-9079ec6f-eafe-4225-8e24-15afbb25a22a tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8432db75534b2e90e74f8cda85c482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a33df632a564f848cd29e58e05f06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:28:33.050631 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-9079ec6f-eafe-4225-8e24-15afbb25a22a tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] 10.222.0.46 "GET /compute/v2.1/servers/e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e" status: 200 len: 1315 microversion: 2.1 time: 0.155320 Jan 15 21:28:33.051199 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3547/7105] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:28:32 2022] GET /compute/v2.1/servers/e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:28:34.068011 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4015aa65-3659-420b-89cc-e05e50c5b2f0 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:28:34.068692 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-4015aa65-3659-420b-89cc-e05e50c5b2f0 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] [instance: e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:28:34.077398 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4015aa65-3659-420b-89cc-e05e50c5b2f0 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:28:34.077765 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4015aa65-3659-420b-89cc-e05e50c5b2f0 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:28:34.078571 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4015aa65-3659-420b-89cc-e05e50c5b2f0 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:28:34.079006 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4015aa65-3659-420b-89cc-e05e50c5b2f0 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:28:34.218328 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-4015aa65-3659-420b-89cc-e05e50c5b2f0 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8432db75534b2e90e74f8cda85c482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a33df632a564f848cd29e58e05f06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:28:34.226629 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-4015aa65-3659-420b-89cc-e05e50c5b2f0 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] 10.222.0.46 "GET /compute/v2.1/servers/e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e" status: 200 len: 1315 microversion: 2.1 time: 0.162431 Jan 15 21:28:34.227239 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3559/7106] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:28:34 2022] GET /compute/v2.1/servers/e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:28:35.243676 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-cad831de-245e-4b52-8bbd-91002384f0e7 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:28:35.244224 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-cad831de-245e-4b52-8bbd-91002384f0e7 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] [instance: e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:28:35.252124 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cad831de-245e-4b52-8bbd-91002384f0e7 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:28:35.252590 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cad831de-245e-4b52-8bbd-91002384f0e7 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:28:35.253417 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cad831de-245e-4b52-8bbd-91002384f0e7 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:28:35.253871 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cad831de-245e-4b52-8bbd-91002384f0e7 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:28:35.385015 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-cad831de-245e-4b52-8bbd-91002384f0e7 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8432db75534b2e90e74f8cda85c482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a33df632a564f848cd29e58e05f06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:28:35.393034 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-cad831de-245e-4b52-8bbd-91002384f0e7 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] 10.222.0.46 "GET /compute/v2.1/servers/e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e" status: 200 len: 1315 microversion: 2.1 time: 0.153239 Jan 15 21:28:35.393607 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3548/7107] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:28:35 2022] GET /compute/v2.1/servers/e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:28:36.003742 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-c495f2bf-d88e-44d6-a3b2-99bd968c7e39 req-6e802cdd-f4f4-4bf9-a4b7-381187aaa7b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e", "name": "network-vif-plugged", "status": "completed", "tag": "8e8cab91-6949-4229-9f6f-1641aced301c"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:28:36.005293 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:28:36.005293 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:28:36.014308 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-c495f2bf-d88e-44d6-a3b2-99bd968c7e39 req-6e802cdd-f4f4-4bf9-a4b7-381187aaa7b2 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:28:36.014971 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-c495f2bf-d88e-44d6-a3b2-99bd968c7e39 req-6e802cdd-f4f4-4bf9-a4b7-381187aaa7b2 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:28:36.028833 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-c495f2bf-d88e-44d6-a3b2-99bd968c7e39 req-6e802cdd-f4f4-4bf9-a4b7-381187aaa7b2 service nova] Creating event network-vif-plugged:8e8cab91-6949-4229-9f6f-1641aced301c for instance e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e on nch2-master-1 Jan 15 21:28:36.034046 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-c495f2bf-d88e-44d6-a3b2-99bd968c7e39 req-6e802cdd-f4f4-4bf9-a4b7-381187aaa7b2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033947 Jan 15 21:28:36.034654 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3560/7108] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:28:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:28:36.410769 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-035b016d-fdf2-4e64-b89b-5808c24d82dd tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:28:36.411407 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-035b016d-fdf2-4e64-b89b-5808c24d82dd tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] [instance: e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:28:36.418222 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-035b016d-fdf2-4e64-b89b-5808c24d82dd tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:28:36.418713 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-035b016d-fdf2-4e64-b89b-5808c24d82dd tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:28:36.419502 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-035b016d-fdf2-4e64-b89b-5808c24d82dd tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:28:36.419951 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-035b016d-fdf2-4e64-b89b-5808c24d82dd tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:28:36.553055 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-035b016d-fdf2-4e64-b89b-5808c24d82dd tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8432db75534b2e90e74f8cda85c482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a33df632a564f848cd29e58e05f06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:28:36.561990 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-035b016d-fdf2-4e64-b89b-5808c24d82dd tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] 10.222.0.46 "GET /compute/v2.1/servers/e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e" status: 200 len: 1315 microversion: 2.1 time: 0.154919 Jan 15 21:28:36.562572 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3549/7109] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:28:36 2022] GET /compute/v2.1/servers/e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:28:37.580345 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d59b1ab5-1292-4e99-a98a-868b4e639a96 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:28:37.581071 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-d59b1ab5-1292-4e99-a98a-868b4e639a96 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] [instance: e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:28:37.588178 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d59b1ab5-1292-4e99-a98a-868b4e639a96 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:28:37.588634 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d59b1ab5-1292-4e99-a98a-868b4e639a96 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:28:37.589449 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d59b1ab5-1292-4e99-a98a-868b4e639a96 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:28:37.589890 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d59b1ab5-1292-4e99-a98a-868b4e639a96 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:28:37.721341 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-d59b1ab5-1292-4e99-a98a-868b4e639a96 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8432db75534b2e90e74f8cda85c482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a33df632a564f848cd29e58e05f06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:28:37.728805 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d59b1ab5-1292-4e99-a98a-868b4e639a96 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] 10.222.0.46 "GET /compute/v2.1/servers/e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e" status: 200 len: 1502 microversion: 2.1 time: 0.153398 Jan 15 21:28:37.729395 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3561/7110] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:28:37 2022] GET /compute/v2.1/servers/e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e => generated 1502 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:28:37.745224 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-918af252-e50c-47b2-8650-cf180d108e03 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:28:37.746222 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-918af252-e50c-47b2-8650-cf180d108e03 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] [instance: e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:28:37.753908 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-918af252-e50c-47b2-8650-cf180d108e03 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:28:37.754366 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-918af252-e50c-47b2-8650-cf180d108e03 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:28:37.755147 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-918af252-e50c-47b2-8650-cf180d108e03 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:28:37.755593 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-918af252-e50c-47b2-8650-cf180d108e03 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:28:37.782903 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-918af252-e50c-47b2-8650-cf180d108e03 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '4f8432db75534b2e90e74f8cda85c482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a33df632a564f848cd29e58e05f06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:28:37.788501 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-918af252-e50c-47b2-8650-cf180d108e03 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] [instance: e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e] Old instance type m1.heat2, new instance type m1.heat {{(pid=129365) resize /opt/stack/nova/nova/compute/api.py:4097}} Jan 15 21:28:37.794494 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-918af252-e50c-47b2-8650-cf180d108e03 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Flavor limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 21:28:37.794922 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-918af252-e50c-47b2-8650-cf180d108e03 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Image limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 21:28:37.795401 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-918af252-e50c-47b2-8650-cf180d108e03 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Flavor pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 21:28:37.795815 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-918af252-e50c-47b2-8650-cf180d108e03 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Image pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 21:28:37.796233 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-918af252-e50c-47b2-8650-cf180d108e03 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 21:28:37.856702 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-918af252-e50c-47b2-8650-cf180d108e03 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] 10.222.0.46 "POST /compute/v2.1/servers/e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e/action" status: 202 len: 0 microversion: 2.1 time: 0.114768 Jan 15 21:28:37.857347 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3550/7111] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:28:37 2022] POST /compute/v2.1/servers/e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:28:37.865262 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1d810d41-7aea-4b86-8686-affcf8587417 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:28:37.865877 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-1d810d41-7aea-4b86-8686-affcf8587417 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] [instance: e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:28:37.872482 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1d810d41-7aea-4b86-8686-affcf8587417 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:28:37.873185 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1d810d41-7aea-4b86-8686-affcf8587417 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:28:37.874136 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1d810d41-7aea-4b86-8686-affcf8587417 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:28:37.874577 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1d810d41-7aea-4b86-8686-affcf8587417 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:28:38.056403 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-1d810d41-7aea-4b86-8686-affcf8587417 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8432db75534b2e90e74f8cda85c482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a33df632a564f848cd29e58e05f06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:28:38.065111 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-1d810d41-7aea-4b86-8686-affcf8587417 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] 10.222.0.46 "GET /compute/v2.1/servers/e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e" status: 200 len: 1511 microversion: 2.1 time: 0.203516 Jan 15 21:28:38.065701 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3562/7112] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:28:37 2022] GET /compute/v2.1/servers/e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e => generated 1511 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:28:39.083383 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-0c09f634-2c01-470c-b1f6-937ed6a67f48 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:28:39.083958 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-0c09f634-2c01-470c-b1f6-937ed6a67f48 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] [instance: e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:28:39.090568 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0c09f634-2c01-470c-b1f6-937ed6a67f48 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:28:39.091032 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0c09f634-2c01-470c-b1f6-937ed6a67f48 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:28:39.091812 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0c09f634-2c01-470c-b1f6-937ed6a67f48 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:28:39.092256 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0c09f634-2c01-470c-b1f6-937ed6a67f48 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:28:39.226849 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-0c09f634-2c01-470c-b1f6-937ed6a67f48 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8432db75534b2e90e74f8cda85c482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a33df632a564f848cd29e58e05f06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:28:39.234974 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-0c09f634-2c01-470c-b1f6-937ed6a67f48 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] 10.222.0.46 "GET /compute/v2.1/servers/e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e" status: 200 len: 1511 microversion: 2.1 time: 0.156180 Jan 15 21:28:39.235707 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3551/7113] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:28:39 2022] GET /compute/v2.1/servers/e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e => generated 1511 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:28:40.254382 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-993bc85f-2918-4e35-9e9f-cec11c3987dd tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:28:40.255039 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-993bc85f-2918-4e35-9e9f-cec11c3987dd tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] [instance: e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:28:40.263269 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-993bc85f-2918-4e35-9e9f-cec11c3987dd tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:28:40.263824 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-993bc85f-2918-4e35-9e9f-cec11c3987dd tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:28:40.264623 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-993bc85f-2918-4e35-9e9f-cec11c3987dd tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:28:40.265110 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-993bc85f-2918-4e35-9e9f-cec11c3987dd tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:28:40.420610 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-993bc85f-2918-4e35-9e9f-cec11c3987dd tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8432db75534b2e90e74f8cda85c482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a33df632a564f848cd29e58e05f06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:28:40.428116 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-993bc85f-2918-4e35-9e9f-cec11c3987dd tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] 10.222.0.46 "GET /compute/v2.1/servers/e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e" status: 200 len: 1516 microversion: 2.1 time: 0.178494 Jan 15 21:28:40.428699 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3563/7114] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:28:40 2022] GET /compute/v2.1/servers/e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e => generated 1516 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:28:41.447330 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c6a4574c-044c-4c2a-b243-8c8668b5c8ab tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:28:41.447954 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c6a4574c-044c-4c2a-b243-8c8668b5c8ab tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] [instance: e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:28:41.456060 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c6a4574c-044c-4c2a-b243-8c8668b5c8ab tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:28:41.456519 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c6a4574c-044c-4c2a-b243-8c8668b5c8ab tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:28:41.457364 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c6a4574c-044c-4c2a-b243-8c8668b5c8ab tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:28:41.457814 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c6a4574c-044c-4c2a-b243-8c8668b5c8ab tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:28:41.590609 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-c6a4574c-044c-4c2a-b243-8c8668b5c8ab tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8432db75534b2e90e74f8cda85c482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a33df632a564f848cd29e58e05f06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:28:41.598094 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c6a4574c-044c-4c2a-b243-8c8668b5c8ab tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] 10.222.0.46 "GET /compute/v2.1/servers/e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e" status: 200 len: 1516 microversion: 2.1 time: 0.154454 Jan 15 21:28:41.598661 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3552/7115] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:28:41 2022] GET /compute/v2.1/servers/e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:28:42.614898 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d764426b-4cb6-4da9-a86e-dcfeae5013d6 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:28:42.615500 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-d764426b-4cb6-4da9-a86e-dcfeae5013d6 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] [instance: e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:28:42.622342 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d764426b-4cb6-4da9-a86e-dcfeae5013d6 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:28:42.622871 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d764426b-4cb6-4da9-a86e-dcfeae5013d6 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:28:42.623644 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d764426b-4cb6-4da9-a86e-dcfeae5013d6 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:28:42.624079 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d764426b-4cb6-4da9-a86e-dcfeae5013d6 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:28:42.758537 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-d764426b-4cb6-4da9-a86e-dcfeae5013d6 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8432db75534b2e90e74f8cda85c482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a33df632a564f848cd29e58e05f06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:28:42.766641 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d764426b-4cb6-4da9-a86e-dcfeae5013d6 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] 10.222.0.46 "GET /compute/v2.1/servers/e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e" status: 200 len: 1516 microversion: 2.1 time: 0.155428 Jan 15 21:28:42.767222 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3564/7116] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:28:42 2022] GET /compute/v2.1/servers/e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:28:43.784070 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-76d3205c-1e02-4651-8328-a44a86c08721 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:28:43.784681 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-76d3205c-1e02-4651-8328-a44a86c08721 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] [instance: e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:28:43.791690 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-76d3205c-1e02-4651-8328-a44a86c08721 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:28:43.792154 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-76d3205c-1e02-4651-8328-a44a86c08721 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:28:43.792969 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-76d3205c-1e02-4651-8328-a44a86c08721 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:28:43.793417 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-76d3205c-1e02-4651-8328-a44a86c08721 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:28:43.926554 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-76d3205c-1e02-4651-8328-a44a86c08721 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8432db75534b2e90e74f8cda85c482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a33df632a564f848cd29e58e05f06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:28:43.934136 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-76d3205c-1e02-4651-8328-a44a86c08721 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] 10.222.0.46 "GET /compute/v2.1/servers/e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e" status: 200 len: 1516 microversion: 2.1 time: 0.153715 Jan 15 21:28:43.935358 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3553/7117] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:28:43 2022] GET /compute/v2.1/servers/e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:28:44.952380 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4efc8328-113f-4845-b00c-f5faa1afb616 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:28:44.953024 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-4efc8328-113f-4845-b00c-f5faa1afb616 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] [instance: e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:28:44.960491 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4efc8328-113f-4845-b00c-f5faa1afb616 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:28:44.961353 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4efc8328-113f-4845-b00c-f5faa1afb616 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:28:44.962748 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4efc8328-113f-4845-b00c-f5faa1afb616 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:28:44.963543 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4efc8328-113f-4845-b00c-f5faa1afb616 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:28:45.098259 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-4efc8328-113f-4845-b00c-f5faa1afb616 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8432db75534b2e90e74f8cda85c482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a33df632a564f848cd29e58e05f06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:28:45.105587 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-4efc8328-113f-4845-b00c-f5faa1afb616 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] 10.222.0.46 "GET /compute/v2.1/servers/e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e" status: 200 len: 1516 microversion: 2.1 time: 0.157349 Jan 15 21:28:45.106158 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3565/7118] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:28:44 2022] GET /compute/v2.1/servers/e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:28:46.122957 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-40a9e3b8-ca68-49d3-af99-c2175c2cac38 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:28:46.123573 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-40a9e3b8-ca68-49d3-af99-c2175c2cac38 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] [instance: e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:28:46.129703 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-40a9e3b8-ca68-49d3-af99-c2175c2cac38 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:28:46.130173 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-40a9e3b8-ca68-49d3-af99-c2175c2cac38 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:28:46.130963 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-40a9e3b8-ca68-49d3-af99-c2175c2cac38 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:28:46.131418 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-40a9e3b8-ca68-49d3-af99-c2175c2cac38 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:28:46.265251 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-40a9e3b8-ca68-49d3-af99-c2175c2cac38 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8432db75534b2e90e74f8cda85c482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a33df632a564f848cd29e58e05f06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:28:46.272506 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-40a9e3b8-ca68-49d3-af99-c2175c2cac38 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] 10.222.0.46 "GET /compute/v2.1/servers/e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e" status: 200 len: 1516 microversion: 2.1 time: 0.153543 Jan 15 21:28:46.273115 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3554/7119] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:28:46 2022] GET /compute/v2.1/servers/e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:28:47.290511 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0fc257b5-e24c-4da8-8027-46252672a3fe tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:28:47.291056 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-0fc257b5-e24c-4da8-8027-46252672a3fe tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] [instance: e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:28:47.298047 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0fc257b5-e24c-4da8-8027-46252672a3fe tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:28:47.298501 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0fc257b5-e24c-4da8-8027-46252672a3fe tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:28:47.299282 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0fc257b5-e24c-4da8-8027-46252672a3fe tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:28:47.299726 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0fc257b5-e24c-4da8-8027-46252672a3fe tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:28:47.431273 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-0fc257b5-e24c-4da8-8027-46252672a3fe tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8432db75534b2e90e74f8cda85c482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a33df632a564f848cd29e58e05f06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:28:47.439250 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0fc257b5-e24c-4da8-8027-46252672a3fe tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] 10.222.0.46 "GET /compute/v2.1/servers/e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e" status: 200 len: 1516 microversion: 2.1 time: 0.152547 Jan 15 21:28:47.439825 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3566/7120] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:28:47 2022] GET /compute/v2.1/servers/e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e => generated 1516 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:28:48.456220 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-7eda0aae-b592-40da-a1a3-6d0478fa2c0e tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:28:48.456863 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-7eda0aae-b592-40da-a1a3-6d0478fa2c0e tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] [instance: e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:28:48.463700 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7eda0aae-b592-40da-a1a3-6d0478fa2c0e tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:28:48.464156 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7eda0aae-b592-40da-a1a3-6d0478fa2c0e tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:28:48.464966 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7eda0aae-b592-40da-a1a3-6d0478fa2c0e tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:28:48.465414 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7eda0aae-b592-40da-a1a3-6d0478fa2c0e tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:28:48.600189 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-7eda0aae-b592-40da-a1a3-6d0478fa2c0e tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8432db75534b2e90e74f8cda85c482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a33df632a564f848cd29e58e05f06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:28:48.607652 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-7eda0aae-b592-40da-a1a3-6d0478fa2c0e tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] 10.222.0.46 "GET /compute/v2.1/servers/e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e" status: 200 len: 1516 microversion: 2.1 time: 0.155125 Jan 15 21:28:48.608239 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3555/7121] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:28:48 2022] GET /compute/v2.1/servers/e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:28:49.626274 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-6822d02e-8771-433c-98e4-6799cf66a1ea tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:28:49.626877 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-6822d02e-8771-433c-98e4-6799cf66a1ea tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] [instance: e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:28:49.633632 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6822d02e-8771-433c-98e4-6799cf66a1ea tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:28:49.634044 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6822d02e-8771-433c-98e4-6799cf66a1ea tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:28:49.634794 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6822d02e-8771-433c-98e4-6799cf66a1ea tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:28:49.635222 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6822d02e-8771-433c-98e4-6799cf66a1ea tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:28:49.765922 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-6822d02e-8771-433c-98e4-6799cf66a1ea tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8432db75534b2e90e74f8cda85c482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a33df632a564f848cd29e58e05f06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:28:49.773178 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-6822d02e-8771-433c-98e4-6799cf66a1ea tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] 10.222.0.46 "GET /compute/v2.1/servers/e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e" status: 200 len: 1516 microversion: 2.1 time: 0.151571 Jan 15 21:28:49.773747 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3567/7122] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:28:49 2022] GET /compute/v2.1/servers/e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e => generated 1516 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:28:50.791188 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-6627e7d8-45bf-48bf-8c1e-1a06ccd961e8 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:28:50.791798 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-6627e7d8-45bf-48bf-8c1e-1a06ccd961e8 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] [instance: e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:28:50.799175 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6627e7d8-45bf-48bf-8c1e-1a06ccd961e8 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:28:50.799631 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6627e7d8-45bf-48bf-8c1e-1a06ccd961e8 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:28:50.800414 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6627e7d8-45bf-48bf-8c1e-1a06ccd961e8 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:28:50.800883 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6627e7d8-45bf-48bf-8c1e-1a06ccd961e8 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:28:50.933435 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-6627e7d8-45bf-48bf-8c1e-1a06ccd961e8 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8432db75534b2e90e74f8cda85c482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a33df632a564f848cd29e58e05f06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:28:50.942070 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-6627e7d8-45bf-48bf-8c1e-1a06ccd961e8 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] 10.222.0.46 "GET /compute/v2.1/servers/e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e" status: 200 len: 1516 microversion: 2.1 time: 0.154760 Jan 15 21:28:50.942647 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3556/7123] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:28:50 2022] GET /compute/v2.1/servers/e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:28:51.959859 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-10e0fae6-4e13-4d99-a74a-485d643154b8 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:28:51.960441 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-10e0fae6-4e13-4d99-a74a-485d643154b8 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] [instance: e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:28:51.967252 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-10e0fae6-4e13-4d99-a74a-485d643154b8 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:28:51.967695 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-10e0fae6-4e13-4d99-a74a-485d643154b8 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:28:51.968564 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-10e0fae6-4e13-4d99-a74a-485d643154b8 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:28:51.969228 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-10e0fae6-4e13-4d99-a74a-485d643154b8 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:28:52.103587 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-10e0fae6-4e13-4d99-a74a-485d643154b8 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8432db75534b2e90e74f8cda85c482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a33df632a564f848cd29e58e05f06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:28:52.111045 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-10e0fae6-4e13-4d99-a74a-485d643154b8 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] 10.222.0.46 "GET /compute/v2.1/servers/e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e" status: 200 len: 1516 microversion: 2.1 time: 0.155090 Jan 15 21:28:52.111618 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3568/7124] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:28:51 2022] GET /compute/v2.1/servers/e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:28:53.127442 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e1598e02-c92f-4618-b53c-35930a060d28 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:28:53.128057 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e1598e02-c92f-4618-b53c-35930a060d28 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] [instance: e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:28:53.134976 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e1598e02-c92f-4618-b53c-35930a060d28 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:28:53.135430 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e1598e02-c92f-4618-b53c-35930a060d28 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:28:53.136209 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e1598e02-c92f-4618-b53c-35930a060d28 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:28:53.136653 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e1598e02-c92f-4618-b53c-35930a060d28 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:28:53.266615 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-e1598e02-c92f-4618-b53c-35930a060d28 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8432db75534b2e90e74f8cda85c482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a33df632a564f848cd29e58e05f06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:28:53.274080 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e1598e02-c92f-4618-b53c-35930a060d28 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] 10.222.0.46 "GET /compute/v2.1/servers/e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e" status: 200 len: 1516 microversion: 2.1 time: 0.150305 Jan 15 21:28:53.274666 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3557/7125] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:28:53 2022] GET /compute/v2.1/servers/e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e => generated 1516 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:28:54.291834 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-25354e40-6d53-4631-9c6a-587ad1e5ec5f tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:28:54.292437 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-25354e40-6d53-4631-9c6a-587ad1e5ec5f tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] [instance: e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:28:54.299900 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-25354e40-6d53-4631-9c6a-587ad1e5ec5f tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:28:54.300341 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-25354e40-6d53-4631-9c6a-587ad1e5ec5f tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:28:54.301179 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-25354e40-6d53-4631-9c6a-587ad1e5ec5f tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:28:54.301614 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-25354e40-6d53-4631-9c6a-587ad1e5ec5f tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:28:54.439022 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-25354e40-6d53-4631-9c6a-587ad1e5ec5f tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8432db75534b2e90e74f8cda85c482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a33df632a564f848cd29e58e05f06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:28:54.446424 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-25354e40-6d53-4631-9c6a-587ad1e5ec5f tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] 10.222.0.46 "GET /compute/v2.1/servers/e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e" status: 200 len: 1516 microversion: 2.1 time: 0.158858 Jan 15 21:28:54.447037 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3569/7126] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:28:54 2022] GET /compute/v2.1/servers/e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e => generated 1516 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:28:55.463357 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d92ab2cb-49aa-4815-b423-04c95780af01 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:28:55.463999 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d92ab2cb-49aa-4815-b423-04c95780af01 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] [instance: e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:28:55.470958 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d92ab2cb-49aa-4815-b423-04c95780af01 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:28:55.471420 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d92ab2cb-49aa-4815-b423-04c95780af01 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:28:55.472198 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d92ab2cb-49aa-4815-b423-04c95780af01 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:28:55.472642 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d92ab2cb-49aa-4815-b423-04c95780af01 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:28:55.608635 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-d92ab2cb-49aa-4815-b423-04c95780af01 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8432db75534b2e90e74f8cda85c482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a33df632a564f848cd29e58e05f06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:28:55.616015 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d92ab2cb-49aa-4815-b423-04c95780af01 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] 10.222.0.46 "GET /compute/v2.1/servers/e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e" status: 200 len: 1516 microversion: 2.1 time: 0.156403 Jan 15 21:28:55.616590 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3558/7127] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:28:55 2022] GET /compute/v2.1/servers/e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:28:56.633478 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7c0fc87c-7185-4904-a65a-b7257c0a7208 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:28:56.634013 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-7c0fc87c-7185-4904-a65a-b7257c0a7208 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] [instance: e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:28:56.641528 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7c0fc87c-7185-4904-a65a-b7257c0a7208 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:28:56.641976 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7c0fc87c-7185-4904-a65a-b7257c0a7208 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:28:56.642750 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7c0fc87c-7185-4904-a65a-b7257c0a7208 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:28:56.643179 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7c0fc87c-7185-4904-a65a-b7257c0a7208 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:28:56.780726 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-7c0fc87c-7185-4904-a65a-b7257c0a7208 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8432db75534b2e90e74f8cda85c482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a33df632a564f848cd29e58e05f06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:28:56.788124 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7c0fc87c-7185-4904-a65a-b7257c0a7208 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] 10.222.0.46 "GET /compute/v2.1/servers/e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e" status: 200 len: 1516 microversion: 2.1 time: 0.158400 Jan 15 21:28:56.788700 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3570/7128] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:28:56 2022] GET /compute/v2.1/servers/e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e => generated 1516 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:28:57.806395 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-0d5135af-e376-472a-a4f1-8ccee7ce36a3 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:28:57.807049 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-0d5135af-e376-472a-a4f1-8ccee7ce36a3 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] [instance: e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:28:57.813868 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0d5135af-e376-472a-a4f1-8ccee7ce36a3 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:28:57.814344 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0d5135af-e376-472a-a4f1-8ccee7ce36a3 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:28:57.815122 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0d5135af-e376-472a-a4f1-8ccee7ce36a3 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:28:57.815570 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0d5135af-e376-472a-a4f1-8ccee7ce36a3 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:28:57.945217 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-0d5135af-e376-472a-a4f1-8ccee7ce36a3 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8432db75534b2e90e74f8cda85c482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a33df632a564f848cd29e58e05f06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:28:57.953331 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-0d5135af-e376-472a-a4f1-8ccee7ce36a3 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] 10.222.0.46 "GET /compute/v2.1/servers/e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e" status: 200 len: 1516 microversion: 2.1 time: 0.150635 Jan 15 21:28:57.953901 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3559/7129] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:28:57 2022] GET /compute/v2.1/servers/e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e => generated 1516 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:28:58.970732 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8f6f4343-1cf0-46e0-b5c3-2b0ccbb33f92 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:28:58.971332 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-8f6f4343-1cf0-46e0-b5c3-2b0ccbb33f92 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] [instance: e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:28:58.978084 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8f6f4343-1cf0-46e0-b5c3-2b0ccbb33f92 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:28:58.978531 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8f6f4343-1cf0-46e0-b5c3-2b0ccbb33f92 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:28:58.979297 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8f6f4343-1cf0-46e0-b5c3-2b0ccbb33f92 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:28:58.979728 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8f6f4343-1cf0-46e0-b5c3-2b0ccbb33f92 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:28:59.117610 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-8f6f4343-1cf0-46e0-b5c3-2b0ccbb33f92 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8432db75534b2e90e74f8cda85c482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a33df632a564f848cd29e58e05f06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:28:59.125290 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-8f6f4343-1cf0-46e0-b5c3-2b0ccbb33f92 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] 10.222.0.46 "GET /compute/v2.1/servers/e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e" status: 200 len: 1516 microversion: 2.1 time: 0.158232 Jan 15 21:28:59.125866 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3571/7130] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:28:58 2022] GET /compute/v2.1/servers/e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e => generated 1516 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:29:00.142367 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c3ff0d8a-ca93-4746-a996-9d8c742b4eff tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:29:00.142981 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c3ff0d8a-ca93-4746-a996-9d8c742b4eff tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] [instance: e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:29:00.149721 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c3ff0d8a-ca93-4746-a996-9d8c742b4eff tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:29:00.150180 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c3ff0d8a-ca93-4746-a996-9d8c742b4eff tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:29:00.150961 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c3ff0d8a-ca93-4746-a996-9d8c742b4eff tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:29:00.151408 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c3ff0d8a-ca93-4746-a996-9d8c742b4eff tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:29:00.286237 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-c3ff0d8a-ca93-4746-a996-9d8c742b4eff tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8432db75534b2e90e74f8cda85c482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a33df632a564f848cd29e58e05f06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:29:00.293678 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c3ff0d8a-ca93-4746-a996-9d8c742b4eff tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] 10.222.0.46 "GET /compute/v2.1/servers/e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e" status: 200 len: 1516 microversion: 2.1 time: 0.155250 Jan 15 21:29:00.294992 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3560/7131] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:29:00 2022] GET /compute/v2.1/servers/e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:29:01.310864 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f7e1f0c3-c70c-412c-b280-e90310de7144 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:29:01.311415 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f7e1f0c3-c70c-412c-b280-e90310de7144 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] [instance: e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:29:01.318814 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f7e1f0c3-c70c-412c-b280-e90310de7144 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:29:01.319262 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f7e1f0c3-c70c-412c-b280-e90310de7144 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:29:01.320040 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f7e1f0c3-c70c-412c-b280-e90310de7144 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:29:01.320472 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f7e1f0c3-c70c-412c-b280-e90310de7144 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:29:01.450908 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-f7e1f0c3-c70c-412c-b280-e90310de7144 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8432db75534b2e90e74f8cda85c482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a33df632a564f848cd29e58e05f06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:29:01.458347 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f7e1f0c3-c70c-412c-b280-e90310de7144 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] 10.222.0.46 "GET /compute/v2.1/servers/e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e" status: 200 len: 1516 microversion: 2.1 time: 0.151259 Jan 15 21:29:01.458925 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3572/7132] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:29:01 2022] GET /compute/v2.1/servers/e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e => generated 1516 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:29:02.475283 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e0d67003-73b5-4e8c-9e75-823653341395 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:29:02.475907 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e0d67003-73b5-4e8c-9e75-823653341395 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] [instance: e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:29:02.483179 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e0d67003-73b5-4e8c-9e75-823653341395 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:29:02.483771 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e0d67003-73b5-4e8c-9e75-823653341395 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:29:02.484632 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e0d67003-73b5-4e8c-9e75-823653341395 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:29:02.485114 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e0d67003-73b5-4e8c-9e75-823653341395 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:29:02.960253 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-e0d67003-73b5-4e8c-9e75-823653341395 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8432db75534b2e90e74f8cda85c482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a33df632a564f848cd29e58e05f06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:29:02.967708 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e0d67003-73b5-4e8c-9e75-823653341395 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] 10.222.0.46 "GET /compute/v2.1/servers/e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e" status: 200 len: 1516 microversion: 2.1 time: 0.496089 Jan 15 21:29:02.968245 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3561/7133] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:29:02 2022] GET /compute/v2.1/servers/e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e => generated 1516 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:29:03.984287 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-48615d86-925e-4623-a3aa-61d29993e23f tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:29:03.984934 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-48615d86-925e-4623-a3aa-61d29993e23f tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] [instance: e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:29:03.991731 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-48615d86-925e-4623-a3aa-61d29993e23f tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:29:03.992186 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-48615d86-925e-4623-a3aa-61d29993e23f tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:29:03.993028 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-48615d86-925e-4623-a3aa-61d29993e23f tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:29:03.993471 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-48615d86-925e-4623-a3aa-61d29993e23f tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:29:04.122695 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-48615d86-925e-4623-a3aa-61d29993e23f tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8432db75534b2e90e74f8cda85c482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a33df632a564f848cd29e58e05f06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:29:04.131088 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-48615d86-925e-4623-a3aa-61d29993e23f tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] 10.222.0.46 "GET /compute/v2.1/servers/e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e" status: 200 len: 1516 microversion: 2.1 time: 0.150613 Jan 15 21:29:04.131667 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3573/7134] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:29:03 2022] GET /compute/v2.1/servers/e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e => generated 1516 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:29:05.148871 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-287506cc-26d6-4e88-9c8f-29249687e43b tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:29:05.149519 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-287506cc-26d6-4e88-9c8f-29249687e43b tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] [instance: e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:29:05.156736 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-287506cc-26d6-4e88-9c8f-29249687e43b tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:29:05.157233 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-287506cc-26d6-4e88-9c8f-29249687e43b tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:29:05.158036 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-287506cc-26d6-4e88-9c8f-29249687e43b tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:29:05.158492 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-287506cc-26d6-4e88-9c8f-29249687e43b tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:29:05.291803 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-287506cc-26d6-4e88-9c8f-29249687e43b tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8432db75534b2e90e74f8cda85c482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a33df632a564f848cd29e58e05f06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:29:05.299895 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-287506cc-26d6-4e88-9c8f-29249687e43b tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] 10.222.0.46 "GET /compute/v2.1/servers/e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e" status: 200 len: 1516 microversion: 2.1 time: 0.154758 Jan 15 21:29:05.300487 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3562/7135] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:29:05 2022] GET /compute/v2.1/servers/e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:29:06.318011 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ae4a5d5e-7198-4832-88f4-d5095c3d2d50 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:29:06.318616 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ae4a5d5e-7198-4832-88f4-d5095c3d2d50 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] [instance: e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:29:06.325339 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ae4a5d5e-7198-4832-88f4-d5095c3d2d50 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:29:06.325792 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ae4a5d5e-7198-4832-88f4-d5095c3d2d50 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:29:06.326570 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ae4a5d5e-7198-4832-88f4-d5095c3d2d50 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:29:06.327008 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ae4a5d5e-7198-4832-88f4-d5095c3d2d50 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:29:06.457958 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-ae4a5d5e-7198-4832-88f4-d5095c3d2d50 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8432db75534b2e90e74f8cda85c482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a33df632a564f848cd29e58e05f06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:29:06.465287 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ae4a5d5e-7198-4832-88f4-d5095c3d2d50 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] 10.222.0.46 "GET /compute/v2.1/servers/e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e" status: 200 len: 1516 microversion: 2.1 time: 0.150952 Jan 15 21:29:06.465875 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3574/7136] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:29:06 2022] GET /compute/v2.1/servers/e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e => generated 1516 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:29:07.199923 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-4c68c34c-7a7d-46a6-8fe2-88ff50980ebe req-98906cd4-e5d8-4c39-8bfc-57d539defc32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e", "name": "network-vif-unplugged", "status": "completed", "tag": "8e8cab91-6949-4229-9f6f-1641aced301c"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:29:07.201490 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:29:07.201490 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:29:07.211663 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-4c68c34c-7a7d-46a6-8fe2-88ff50980ebe req-98906cd4-e5d8-4c39-8bfc-57d539defc32 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:29:07.211792 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-4c68c34c-7a7d-46a6-8fe2-88ff50980ebe req-98906cd4-e5d8-4c39-8bfc-57d539defc32 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:29:07.224165 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-4c68c34c-7a7d-46a6-8fe2-88ff50980ebe req-98906cd4-e5d8-4c39-8bfc-57d539defc32 service nova] Creating event network-vif-unplugged:8e8cab91-6949-4229-9f6f-1641aced301c for instance e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e on nch1-master-1 Jan 15 21:29:07.229640 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [req-4c68c34c-7a7d-46a6-8fe2-88ff50980ebe req-98906cd4-e5d8-4c39-8bfc-57d539defc32 service nova] Instance e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=129365) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Jan 15 21:29:07.240539 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-4c68c34c-7a7d-46a6-8fe2-88ff50980ebe req-98906cd4-e5d8-4c39-8bfc-57d539defc32 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044318 Jan 15 21:29:07.241246 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3563/7137] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:29:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:29:07.482291 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4a9046f2-8d6c-4460-9690-59235dc8dfaf tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:29:07.482903 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-4a9046f2-8d6c-4460-9690-59235dc8dfaf tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] [instance: e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:29:07.489896 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4a9046f2-8d6c-4460-9690-59235dc8dfaf tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:29:07.490355 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4a9046f2-8d6c-4460-9690-59235dc8dfaf tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:29:07.491155 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4a9046f2-8d6c-4460-9690-59235dc8dfaf tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:29:07.491594 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4a9046f2-8d6c-4460-9690-59235dc8dfaf tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:29:07.626721 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-4a9046f2-8d6c-4460-9690-59235dc8dfaf tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8432db75534b2e90e74f8cda85c482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a33df632a564f848cd29e58e05f06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:29:07.634221 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-4a9046f2-8d6c-4460-9690-59235dc8dfaf tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] 10.222.0.46 "GET /compute/v2.1/servers/e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e" status: 200 len: 1515 microversion: 2.1 time: 0.155616 Jan 15 21:29:07.634801 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3575/7138] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:29:07 2022] GET /compute/v2.1/servers/e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:29:08.653131 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b64d1514-8177-4968-9158-4d5648f7dc77 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:29:08.653840 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b64d1514-8177-4968-9158-4d5648f7dc77 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] [instance: e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:29:08.660267 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b64d1514-8177-4968-9158-4d5648f7dc77 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:29:08.660817 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b64d1514-8177-4968-9158-4d5648f7dc77 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:29:08.661637 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b64d1514-8177-4968-9158-4d5648f7dc77 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:29:08.662089 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b64d1514-8177-4968-9158-4d5648f7dc77 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:29:08.800463 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-b64d1514-8177-4968-9158-4d5648f7dc77 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8432db75534b2e90e74f8cda85c482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a33df632a564f848cd29e58e05f06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:29:08.808274 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b64d1514-8177-4968-9158-4d5648f7dc77 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] 10.222.0.46 "GET /compute/v2.1/servers/e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e" status: 200 len: 1513 microversion: 2.1 time: 0.160081 Jan 15 21:29:08.809080 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3564/7139] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:29:08 2022] GET /compute/v2.1/servers/e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e => generated 1513 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:29:09.255450 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-f90a61e0-1ca5-4d83-b3f1-a64421d0aeda req-5606da75-90e5-460e-b485-17379fe70ec8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e", "tag": "8e8cab91-6949-4229-9f6f-1641aced301c"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:29:09.256982 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:29:09.256982 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:29:09.264545 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-f90a61e0-1ca5-4d83-b3f1-a64421d0aeda req-5606da75-90e5-460e-b485-17379fe70ec8 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:29:09.265027 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-f90a61e0-1ca5-4d83-b3f1-a64421d0aeda req-5606da75-90e5-460e-b485-17379fe70ec8 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:29:09.276812 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-f90a61e0-1ca5-4d83-b3f1-a64421d0aeda req-5606da75-90e5-460e-b485-17379fe70ec8 service nova] Creating event network-changed:8e8cab91-6949-4229-9f6f-1641aced301c for instance e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e on nch1-master-1 Jan 15 21:29:09.283099 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [req-f90a61e0-1ca5-4d83-b3f1-a64421d0aeda req-5606da75-90e5-460e-b485-17379fe70ec8 service nova] Instance e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=129366) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Jan 15 21:29:09.293870 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-f90a61e0-1ca5-4d83-b3f1-a64421d0aeda req-5606da75-90e5-460e-b485-17379fe70ec8 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042017 Jan 15 21:29:09.294601 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3576/7140] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:29:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:29:09.826714 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-322849f7-9fea-41c6-8d0d-ba5e28623c42 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:29:09.827279 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-322849f7-9fea-41c6-8d0d-ba5e28623c42 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] [instance: e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:29:09.834748 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-322849f7-9fea-41c6-8d0d-ba5e28623c42 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:29:09.835216 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-322849f7-9fea-41c6-8d0d-ba5e28623c42 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:29:09.836015 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-322849f7-9fea-41c6-8d0d-ba5e28623c42 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:29:09.836465 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-322849f7-9fea-41c6-8d0d-ba5e28623c42 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:29:09.967830 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-322849f7-9fea-41c6-8d0d-ba5e28623c42 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8432db75534b2e90e74f8cda85c482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a33df632a564f848cd29e58e05f06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:29:09.975457 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-322849f7-9fea-41c6-8d0d-ba5e28623c42 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] 10.222.0.46 "GET /compute/v2.1/servers/e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e" status: 200 len: 1510 microversion: 2.1 time: 0.152563 Jan 15 21:29:09.976041 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3565/7141] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:29:09 2022] GET /compute/v2.1/servers/e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e => generated 1510 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:29:09.992099 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-65f0f430-e436-433c-bee8-9f32c6527f61 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:29:09.992772 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-65f0f430-e436-433c-bee8-9f32c6527f61 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] [instance: e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:29:09.998921 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-65f0f430-e436-433c-bee8-9f32c6527f61 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:29:09.999498 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-65f0f430-e436-433c-bee8-9f32c6527f61 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:29:10.001504 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-65f0f430-e436-433c-bee8-9f32c6527f61 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:29:10.001968 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-65f0f430-e436-433c-bee8-9f32c6527f61 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:29:10.028292 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-65f0f430-e436-433c-bee8-9f32c6527f61 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] [instance: e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e] Going to try to terminate instance {{(pid=129366) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 21:29:10.081882 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.compute.api [None req-65f0f430-e436-433c-bee8-9f32c6527f61 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] [instance: e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e] Found an unconfirmed migration during delete, id: 16, status: finished Jan 15 21:29:11.811842 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-65f0f430-e436-433c-bee8-9f32c6527f61 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] 10.222.0.46 "DELETE /compute/v2.1/servers/e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e" status: 204 len: 0 microversion: 2.1 time: 1.823543 Jan 15 21:29:11.813958 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3577/7142] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 21:29:09 2022] DELETE /compute/v2.1/servers/e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e => generated 0 bytes in 1827 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 15 21:29:11.822197 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2a30f78a-a24d-42d4-9754-f8dc51b1f94f tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:29:11.822842 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-2a30f78a-a24d-42d4-9754-f8dc51b1f94f tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] [instance: e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:29:11.830074 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2a30f78a-a24d-42d4-9754-f8dc51b1f94f tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:29:11.830534 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2a30f78a-a24d-42d4-9754-f8dc51b1f94f tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:29:11.831317 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2a30f78a-a24d-42d4-9754-f8dc51b1f94f tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:29:11.831759 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2a30f78a-a24d-42d4-9754-f8dc51b1f94f tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:29:11.966552 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-2a30f78a-a24d-42d4-9754-f8dc51b1f94f tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8432db75534b2e90e74f8cda85c482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a33df632a564f848cd29e58e05f06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:29:11.974217 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2a30f78a-a24d-42d4-9754-f8dc51b1f94f tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] 10.222.0.46 "GET /compute/v2.1/servers/e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e" status: 200 len: 1502 microversion: 2.1 time: 0.156192 Jan 15 21:29:11.974793 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3566/7143] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:29:11 2022] GET /compute/v2.1/servers/e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e => generated 1502 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:29:12.723467 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-bf30684c-6bcd-4b78-9f0f-4fdb891c35b0 req-ffd0c012-171c-4399-a17a-90bcc5ad98da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e", "name": "network-vif-plugged", "status": "completed", "tag": "8e8cab91-6949-4229-9f6f-1641aced301c"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:29:12.725194 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:29:12.725194 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:29:12.734210 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-bf30684c-6bcd-4b78-9f0f-4fdb891c35b0 req-ffd0c012-171c-4399-a17a-90bcc5ad98da service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:29:12.734683 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-bf30684c-6bcd-4b78-9f0f-4fdb891c35b0 req-ffd0c012-171c-4399-a17a-90bcc5ad98da service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:29:12.747843 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-bf30684c-6bcd-4b78-9f0f-4fdb891c35b0 req-ffd0c012-171c-4399-a17a-90bcc5ad98da service nova] Creating event network-vif-plugged:8e8cab91-6949-4229-9f6f-1641aced301c for instance e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e on nch1-master-1 Jan 15 21:29:12.752834 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-bf30684c-6bcd-4b78-9f0f-4fdb891c35b0 req-ffd0c012-171c-4399-a17a-90bcc5ad98da service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034225 Jan 15 21:29:12.753529 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3578/7144] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:29:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:29:12.991975 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9f98e316-9d8e-4e14-8376-6c5f9fbd5a88 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:29:12.992595 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-9f98e316-9d8e-4e14-8376-6c5f9fbd5a88 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] [instance: e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:29:12.999646 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9f98e316-9d8e-4e14-8376-6c5f9fbd5a88 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:29:13.000108 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9f98e316-9d8e-4e14-8376-6c5f9fbd5a88 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:29:13.001598 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9f98e316-9d8e-4e14-8376-6c5f9fbd5a88 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:29:13.002046 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9f98e316-9d8e-4e14-8376-6c5f9fbd5a88 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:29:13.151227 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-9f98e316-9d8e-4e14-8376-6c5f9fbd5a88 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8432db75534b2e90e74f8cda85c482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a33df632a564f848cd29e58e05f06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:29:13.159231 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-9f98e316-9d8e-4e14-8376-6c5f9fbd5a88 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] 10.222.0.46 "GET /compute/v2.1/servers/e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e" status: 200 len: 1502 microversion: 2.1 time: 0.171560 Jan 15 21:29:13.159828 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3567/7145] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:29:12 2022] GET /compute/v2.1/servers/e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e => generated 1502 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:29:13.570703 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-de75ae56-acdc-41cc-8515-a19843730471 req-ff547751-790f-45cc-a1c8-f18101c89c52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e", "name": "network-vif-deleted", "tag": "8e8cab91-6949-4229-9f6f-1641aced301c"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:29:13.572321 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:29:13.572321 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:29:13.579696 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-de75ae56-acdc-41cc-8515-a19843730471 req-ff547751-790f-45cc-a1c8-f18101c89c52 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:29:13.580135 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-de75ae56-acdc-41cc-8515-a19843730471 req-ff547751-790f-45cc-a1c8-f18101c89c52 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:29:13.591586 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-de75ae56-acdc-41cc-8515-a19843730471 req-ff547751-790f-45cc-a1c8-f18101c89c52 service nova] Creating event network-vif-deleted:8e8cab91-6949-4229-9f6f-1641aced301c for instance e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e on nch1-master-1 Jan 15 21:29:13.596997 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-de75ae56-acdc-41cc-8515-a19843730471 req-ff547751-790f-45cc-a1c8-f18101c89c52 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030640 Jan 15 21:29:13.597608 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3579/7146] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:29:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:29:14.176697 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8d5fb9a3-d6e4-4e69-abc9-d410b43d2bb9 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:29:14.177353 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-8d5fb9a3-d6e4-4e69-abc9-d410b43d2bb9 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] [instance: e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:29:14.184148 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8d5fb9a3-d6e4-4e69-abc9-d410b43d2bb9 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:29:14.184613 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8d5fb9a3-d6e4-4e69-abc9-d410b43d2bb9 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:29:14.185437 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8d5fb9a3-d6e4-4e69-abc9-d410b43d2bb9 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:29:14.185892 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8d5fb9a3-d6e4-4e69-abc9-d410b43d2bb9 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:29:14.199153 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-8d5fb9a3-d6e4-4e69-abc9-d410b43d2bb9 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] HTTP exception thrown: Instance e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e could not be found. Jan 15 21:29:14.199778 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8d5fb9a3-d6e4-4e69-abc9-d410b43d2bb9 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Returning 404 to user: Instance e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:29:14.200630 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-8d5fb9a3-d6e4-4e69-abc9-d410b43d2bb9 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] 10.222.0.46 "GET /compute/v2.1/servers/e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e" status: 404 len: 111 microversion: 2.1 time: 0.027837 Jan 15 21:29:14.201189 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3568/7147] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:29:14 2022] GET /compute/v2.1/servers/e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:29:14.217098 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-aeeed460-d981-4f59-89c7-64332e1a5a31 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:29:14.217686 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-aeeed460-d981-4f59-89c7-64332e1a5a31 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] [instance: e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:29:14.224516 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-aeeed460-d981-4f59-89c7-64332e1a5a31 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:29:14.225016 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-aeeed460-d981-4f59-89c7-64332e1a5a31 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:29:14.225798 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-aeeed460-d981-4f59-89c7-64332e1a5a31 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:29:14.226236 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-aeeed460-d981-4f59-89c7-64332e1a5a31 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:29:14.239165 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-aeeed460-d981-4f59-89c7-64332e1a5a31 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] HTTP exception thrown: Instance e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e could not be found. Jan 15 21:29:14.239752 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-aeeed460-d981-4f59-89c7-64332e1a5a31 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Returning 404 to user: Instance e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:29:14.240596 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-aeeed460-d981-4f59-89c7-64332e1a5a31 tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] 10.222.0.46 "DELETE /compute/v2.1/servers/e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e" status: 404 len: 111 microversion: 2.1 time: 0.028420 Jan 15 21:29:14.241165 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3580/7148] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 21:29:14 2022] DELETE /compute/v2.1/servers/e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:29:14.248811 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-dfa8aea8-08a8-4856-9cd2-27db04aa1a3e tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:29:14.249449 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-dfa8aea8-08a8-4856-9cd2-27db04aa1a3e tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] [instance: e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:29:14.255815 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dfa8aea8-08a8-4856-9cd2-27db04aa1a3e tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:29:14.256275 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dfa8aea8-08a8-4856-9cd2-27db04aa1a3e tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:29:14.257100 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dfa8aea8-08a8-4856-9cd2-27db04aa1a3e tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:29:14.257546 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dfa8aea8-08a8-4856-9cd2-27db04aa1a3e tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:29:14.270933 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-dfa8aea8-08a8-4856-9cd2-27db04aa1a3e tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] HTTP exception thrown: Instance e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e could not be found. Jan 15 21:29:14.271518 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-dfa8aea8-08a8-4856-9cd2-27db04aa1a3e tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] Returning 404 to user: Instance e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:29:14.272473 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-dfa8aea8-08a8-4856-9cd2-27db04aa1a3e tempest-DeleteServersTestJSON-1038757589 tempest-DeleteServersTestJSON-1038757589-project] 10.222.0.46 "GET /compute/v2.1/servers/e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e" status: 404 len: 111 microversion: 2.1 time: 0.027354 Jan 15 21:29:14.273028 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3569/7149] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:29:14 2022] GET /compute/v2.1/servers/e6bef3ae-fd61-47d9-b3b0-6de80ba86c6e => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:29:16.807104 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-59baec45-45a5-4c53-b078-e9ded704b1d0 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-746275674", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "networks": [{"uuid": "20140db7-b287-4e34-b35e-a51d2875af4b"}]}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:29:16.856571 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.network.neutron [None req-59baec45-45a5-4c53-b078-e9ded704b1d0 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] validate_networks() for [('20140db7-b287-4e34-b35e-a51d2875af4b', None, None, None, None, None)] {{(pid=129366) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 21:29:17.198721 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-59baec45-45a5-4c53-b078-e9ded704b1d0 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Flavor limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 21:29:17.199132 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-59baec45-45a5-4c53-b078-e9ded704b1d0 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Image limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 21:29:17.199598 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-59baec45-45a5-4c53-b078-e9ded704b1d0 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Flavor pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 21:29:17.199997 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-59baec45-45a5-4c53-b078-e9ded704b1d0 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Image pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 21:29:17.200397 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-59baec45-45a5-4c53-b078-e9ded704b1d0 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 21:29:17.209642 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-59baec45-45a5-4c53-b078-e9ded704b1d0 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:29:17.210071 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-59baec45-45a5-4c53-b078-e9ded704b1d0 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:29:17.211046 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-59baec45-45a5-4c53-b078-e9ded704b1d0 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:29:17.211487 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-59baec45-45a5-4c53-b078-e9ded704b1d0 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:29:17.228439 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-59baec45-45a5-4c53-b078-e9ded704b1d0 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Getting quotas for project 92c07aae567b4d718b53dbc4e126c768. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:29:17.233451 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-59baec45-45a5-4c53-b078-e9ded704b1d0 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Getting quotas for user bd432681d7da4322a9cb7ec79c016614 and project 92c07aae567b4d718b53dbc4e126c768. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:29:17.245128 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-59baec45-45a5-4c53-b078-e9ded704b1d0 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Going to run 1 instances... {{(pid=129366) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 21:29:17.247399 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-59baec45-45a5-4c53-b078-e9ded704b1d0 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] [instance: 0ca394fe-2987-449e-89bf-9dfc44bbd605] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 21:29:17.292267 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-59baec45-45a5-4c53-b078-e9ded704b1d0 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.613885 Jan 15 21:29:17.292940 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3581/7150] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 21:29:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 615 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 21:29:17.302909 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-318fa62f-03eb-4806-aced-8cf9514fb0cc tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:29:17.303521 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-318fa62f-03eb-4806-aced-8cf9514fb0cc tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] [instance: 0ca394fe-2987-449e-89bf-9dfc44bbd605] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:29:17.361729 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-318fa62f-03eb-4806-aced-8cf9514fb0cc tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd432681d7da4322a9cb7ec79c016614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c07aae567b4d718b53dbc4e126c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:29:17.369057 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-318fa62f-03eb-4806-aced-8cf9514fb0cc tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] 10.222.0.46 "GET /compute/v2.1/servers/0ca394fe-2987-449e-89bf-9dfc44bbd605" status: 200 len: 1217 microversion: 2.1 time: 0.069884 Jan 15 21:29:17.369662 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3570/7151] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:29:17 2022] GET /compute/v2.1/servers/0ca394fe-2987-449e-89bf-9dfc44bbd605 => generated 1217 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:29:18.388401 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8618936c-4b1d-4058-9bcd-5ebc6aad7036 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:29:18.389380 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-8618936c-4b1d-4058-9bcd-5ebc6aad7036 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] [instance: 0ca394fe-2987-449e-89bf-9dfc44bbd605] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:29:18.395959 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8618936c-4b1d-4058-9bcd-5ebc6aad7036 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:29:18.396419 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8618936c-4b1d-4058-9bcd-5ebc6aad7036 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:29:18.397322 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8618936c-4b1d-4058-9bcd-5ebc6aad7036 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:29:18.397705 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8618936c-4b1d-4058-9bcd-5ebc6aad7036 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:29:18.461453 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-8618936c-4b1d-4058-9bcd-5ebc6aad7036 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd432681d7da4322a9cb7ec79c016614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c07aae567b4d718b53dbc4e126c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:29:18.468911 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-8618936c-4b1d-4058-9bcd-5ebc6aad7036 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] 10.222.0.46 "GET /compute/v2.1/servers/0ca394fe-2987-449e-89bf-9dfc44bbd605" status: 200 len: 1275 microversion: 2.1 time: 0.085311 Jan 15 21:29:18.470080 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3582/7152] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:29:18 2022] GET /compute/v2.1/servers/0ca394fe-2987-449e-89bf-9dfc44bbd605 => generated 1275 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:29:19.444373 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-03f64772-64e7-478b-bbad-c4a16b942c66 req-43d53336-9da2-44ef-9bb8-882dc8c34b2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ca394fe-2987-449e-89bf-9dfc44bbd605", "tag": "56297d7b-5525-4c45-be7d-f585e2f7374a"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:29:19.446321 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:29:19.446321 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:29:19.456664 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-03f64772-64e7-478b-bbad-c4a16b942c66 req-43d53336-9da2-44ef-9bb8-882dc8c34b2b service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:29:19.457452 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-03f64772-64e7-478b-bbad-c4a16b942c66 req-43d53336-9da2-44ef-9bb8-882dc8c34b2b service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:29:19.469212 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-03f64772-64e7-478b-bbad-c4a16b942c66 req-43d53336-9da2-44ef-9bb8-882dc8c34b2b service nova] Creating event network-changed:56297d7b-5525-4c45-be7d-f585e2f7374a for instance 0ca394fe-2987-449e-89bf-9dfc44bbd605 on nch1-master-1 Jan 15 21:29:19.475042 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-03f64772-64e7-478b-bbad-c4a16b942c66 req-43d53336-9da2-44ef-9bb8-882dc8c34b2b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034406 Jan 15 21:29:19.475651 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3571/7153] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:29:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 21:29:19.487406 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-560092ba-bc68-4e05-bf3a-fbc9789cbe7c tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:29:19.488107 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-560092ba-bc68-4e05-bf3a-fbc9789cbe7c tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] [instance: 0ca394fe-2987-449e-89bf-9dfc44bbd605] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:29:19.494888 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-560092ba-bc68-4e05-bf3a-fbc9789cbe7c tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:29:19.495347 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-560092ba-bc68-4e05-bf3a-fbc9789cbe7c tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:29:19.496143 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-560092ba-bc68-4e05-bf3a-fbc9789cbe7c tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:29:19.496585 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-560092ba-bc68-4e05-bf3a-fbc9789cbe7c tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:29:19.629646 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-560092ba-bc68-4e05-bf3a-fbc9789cbe7c tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd432681d7da4322a9cb7ec79c016614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c07aae567b4d718b53dbc4e126c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:29:19.636954 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-560092ba-bc68-4e05-bf3a-fbc9789cbe7c tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] 10.222.0.46 "GET /compute/v2.1/servers/0ca394fe-2987-449e-89bf-9dfc44bbd605" status: 200 len: 1317 microversion: 2.1 time: 0.154124 Jan 15 21:29:19.637534 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3583/7154] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:29:19 2022] GET /compute/v2.1/servers/0ca394fe-2987-449e-89bf-9dfc44bbd605 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:29:20.654842 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f7976831-5532-45d5-97ae-1eee84de58ad tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:29:20.655808 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f7976831-5532-45d5-97ae-1eee84de58ad tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] [instance: 0ca394fe-2987-449e-89bf-9dfc44bbd605] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:29:20.662038 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f7976831-5532-45d5-97ae-1eee84de58ad tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:29:20.662492 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f7976831-5532-45d5-97ae-1eee84de58ad tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:29:20.663274 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f7976831-5532-45d5-97ae-1eee84de58ad tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:29:20.663719 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f7976831-5532-45d5-97ae-1eee84de58ad tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:29:20.798887 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-f7976831-5532-45d5-97ae-1eee84de58ad tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd432681d7da4322a9cb7ec79c016614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c07aae567b4d718b53dbc4e126c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:29:20.806281 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f7976831-5532-45d5-97ae-1eee84de58ad tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] 10.222.0.46 "GET /compute/v2.1/servers/0ca394fe-2987-449e-89bf-9dfc44bbd605" status: 200 len: 1317 microversion: 2.1 time: 0.156281 Jan 15 21:29:20.806858 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3572/7155] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:29:20 2022] GET /compute/v2.1/servers/0ca394fe-2987-449e-89bf-9dfc44bbd605 => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:29:21.822940 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-fbe239aa-36ce-4625-b1ac-803b83cf94e5 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:29:21.823526 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-fbe239aa-36ce-4625-b1ac-803b83cf94e5 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] [instance: 0ca394fe-2987-449e-89bf-9dfc44bbd605] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:29:21.831059 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fbe239aa-36ce-4625-b1ac-803b83cf94e5 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:29:21.831507 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fbe239aa-36ce-4625-b1ac-803b83cf94e5 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:29:21.832281 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fbe239aa-36ce-4625-b1ac-803b83cf94e5 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:29:21.832718 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fbe239aa-36ce-4625-b1ac-803b83cf94e5 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:29:21.961203 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-fbe239aa-36ce-4625-b1ac-803b83cf94e5 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd432681d7da4322a9cb7ec79c016614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c07aae567b4d718b53dbc4e126c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:29:21.968628 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-fbe239aa-36ce-4625-b1ac-803b83cf94e5 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] 10.222.0.46 "GET /compute/v2.1/servers/0ca394fe-2987-449e-89bf-9dfc44bbd605" status: 200 len: 1317 microversion: 2.1 time: 0.149451 Jan 15 21:29:21.969564 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3584/7156] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:29:21 2022] GET /compute/v2.1/servers/0ca394fe-2987-449e-89bf-9dfc44bbd605 => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:29:22.986961 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e62cc8fa-0ba0-4d9f-a50f-3b58cb8177f4 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:29:22.987592 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e62cc8fa-0ba0-4d9f-a50f-3b58cb8177f4 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] [instance: 0ca394fe-2987-449e-89bf-9dfc44bbd605] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:29:22.994399 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e62cc8fa-0ba0-4d9f-a50f-3b58cb8177f4 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:29:22.994869 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e62cc8fa-0ba0-4d9f-a50f-3b58cb8177f4 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:29:22.995668 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e62cc8fa-0ba0-4d9f-a50f-3b58cb8177f4 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:29:22.996128 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e62cc8fa-0ba0-4d9f-a50f-3b58cb8177f4 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:29:23.131503 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-e62cc8fa-0ba0-4d9f-a50f-3b58cb8177f4 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd432681d7da4322a9cb7ec79c016614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c07aae567b4d718b53dbc4e126c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:29:23.138999 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e62cc8fa-0ba0-4d9f-a50f-3b58cb8177f4 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] 10.222.0.46 "GET /compute/v2.1/servers/0ca394fe-2987-449e-89bf-9dfc44bbd605" status: 200 len: 1317 microversion: 2.1 time: 0.156104 Jan 15 21:29:23.139585 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3573/7157] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:29:22 2022] GET /compute/v2.1/servers/0ca394fe-2987-449e-89bf-9dfc44bbd605 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:29:24.157819 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7075bb8e-0544-4e83-9262-b356c72b8b83 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:29:24.158430 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-7075bb8e-0544-4e83-9262-b356c72b8b83 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] [instance: 0ca394fe-2987-449e-89bf-9dfc44bbd605] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:29:24.165183 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7075bb8e-0544-4e83-9262-b356c72b8b83 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:29:24.165634 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7075bb8e-0544-4e83-9262-b356c72b8b83 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:29:24.166409 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7075bb8e-0544-4e83-9262-b356c72b8b83 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:29:24.166843 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7075bb8e-0544-4e83-9262-b356c72b8b83 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:29:24.302684 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-7075bb8e-0544-4e83-9262-b356c72b8b83 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd432681d7da4322a9cb7ec79c016614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c07aae567b4d718b53dbc4e126c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:29:24.309987 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7075bb8e-0544-4e83-9262-b356c72b8b83 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] 10.222.0.46 "GET /compute/v2.1/servers/0ca394fe-2987-449e-89bf-9dfc44bbd605" status: 200 len: 1317 microversion: 2.1 time: 0.156848 Jan 15 21:29:24.310554 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3585/7158] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:29:24 2022] GET /compute/v2.1/servers/0ca394fe-2987-449e-89bf-9dfc44bbd605 => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:29:24.788903 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-3e32285e-8a83-4bda-bb57-f4d416553865 req-5fad0cba-2b9b-4039-883f-76f05cb269c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ca394fe-2987-449e-89bf-9dfc44bbd605", "name": "network-vif-plugged", "status": "completed", "tag": "56297d7b-5525-4c45-be7d-f585e2f7374a"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:29:24.790425 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:29:24.790425 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:29:24.798449 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-3e32285e-8a83-4bda-bb57-f4d416553865 req-5fad0cba-2b9b-4039-883f-76f05cb269c3 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:29:24.798963 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-3e32285e-8a83-4bda-bb57-f4d416553865 req-5fad0cba-2b9b-4039-883f-76f05cb269c3 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:29:24.809849 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-3e32285e-8a83-4bda-bb57-f4d416553865 req-5fad0cba-2b9b-4039-883f-76f05cb269c3 service nova] Creating event network-vif-plugged:56297d7b-5525-4c45-be7d-f585e2f7374a for instance 0ca394fe-2987-449e-89bf-9dfc44bbd605 on nch1-master-1 Jan 15 21:29:24.815134 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-3e32285e-8a83-4bda-bb57-f4d416553865 req-5fad0cba-2b9b-4039-883f-76f05cb269c3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029965 Jan 15 21:29:24.815730 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3574/7159] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:29:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:29:25.327140 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-87a5984f-e633-42b7-af1a-e5be58a96ffd tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:29:25.327714 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-87a5984f-e633-42b7-af1a-e5be58a96ffd tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] [instance: 0ca394fe-2987-449e-89bf-9dfc44bbd605] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:29:25.334492 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-87a5984f-e633-42b7-af1a-e5be58a96ffd tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:29:25.334936 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-87a5984f-e633-42b7-af1a-e5be58a96ffd tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:29:25.335710 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-87a5984f-e633-42b7-af1a-e5be58a96ffd tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:29:25.336150 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-87a5984f-e633-42b7-af1a-e5be58a96ffd tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:29:25.468023 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-87a5984f-e633-42b7-af1a-e5be58a96ffd tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd432681d7da4322a9cb7ec79c016614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c07aae567b4d718b53dbc4e126c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:29:25.475925 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-87a5984f-e633-42b7-af1a-e5be58a96ffd tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] 10.222.0.46 "GET /compute/v2.1/servers/0ca394fe-2987-449e-89bf-9dfc44bbd605" status: 200 len: 1317 microversion: 2.1 time: 0.152550 Jan 15 21:29:25.476504 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3586/7160] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:29:25 2022] GET /compute/v2.1/servers/0ca394fe-2987-449e-89bf-9dfc44bbd605 => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:29:26.494161 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e5732af6-f72a-484f-8593-af4b54dfb94a tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:29:26.494871 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e5732af6-f72a-484f-8593-af4b54dfb94a tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] [instance: 0ca394fe-2987-449e-89bf-9dfc44bbd605] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:29:26.501632 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e5732af6-f72a-484f-8593-af4b54dfb94a tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:29:26.502084 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e5732af6-f72a-484f-8593-af4b54dfb94a tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:29:26.503063 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e5732af6-f72a-484f-8593-af4b54dfb94a tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:29:26.503511 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e5732af6-f72a-484f-8593-af4b54dfb94a tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:29:26.637656 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-e5732af6-f72a-484f-8593-af4b54dfb94a tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd432681d7da4322a9cb7ec79c016614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c07aae567b4d718b53dbc4e126c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:29:26.645555 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e5732af6-f72a-484f-8593-af4b54dfb94a tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] 10.222.0.46 "GET /compute/v2.1/servers/0ca394fe-2987-449e-89bf-9dfc44bbd605" status: 200 len: 1508 microversion: 2.1 time: 0.156289 Jan 15 21:29:26.646124 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3575/7161] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:29:26 2022] GET /compute/v2.1/servers/0ca394fe-2987-449e-89bf-9dfc44bbd605 => generated 1508 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:29:26.661792 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-19781d5f-8e15-487d-8e08-16036b2c7f85 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:29:26.662402 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-19781d5f-8e15-487d-8e08-16036b2c7f85 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] [instance: 0ca394fe-2987-449e-89bf-9dfc44bbd605] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:29:26.669105 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-19781d5f-8e15-487d-8e08-16036b2c7f85 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:29:26.669557 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-19781d5f-8e15-487d-8e08-16036b2c7f85 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:29:26.670342 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-19781d5f-8e15-487d-8e08-16036b2c7f85 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:29:26.670786 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-19781d5f-8e15-487d-8e08-16036b2c7f85 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:29:26.800861 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-19781d5f-8e15-487d-8e08-16036b2c7f85 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd432681d7da4322a9cb7ec79c016614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c07aae567b4d718b53dbc4e126c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:29:26.808159 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-19781d5f-8e15-487d-8e08-16036b2c7f85 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] 10.222.0.46 "GET /compute/v2.1/servers/0ca394fe-2987-449e-89bf-9dfc44bbd605" status: 200 len: 1508 microversion: 2.1 time: 0.149977 Jan 15 21:29:26.808737 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3587/7162] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:29:26 2022] GET /compute/v2.1/servers/0ca394fe-2987-449e-89bf-9dfc44bbd605 => generated 1508 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:29:26.825717 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-fae8a44a-e62b-4559-9b3a-c59d9581d218 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:29:26.826858 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-fae8a44a-e62b-4559-9b3a-c59d9581d218 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] [instance: 0ca394fe-2987-449e-89bf-9dfc44bbd605] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:29:26.833041 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fae8a44a-e62b-4559-9b3a-c59d9581d218 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:29:26.833501 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fae8a44a-e62b-4559-9b3a-c59d9581d218 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:29:26.834282 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fae8a44a-e62b-4559-9b3a-c59d9581d218 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:29:26.834725 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fae8a44a-e62b-4559-9b3a-c59d9581d218 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:29:26.895063 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-fae8a44a-e62b-4559-9b3a-c59d9581d218 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] 10.222.0.46 "PUT /compute/v2.1/servers/0ca394fe-2987-449e-89bf-9dfc44bbd605" status: 200 len: 1080 microversion: 2.1 time: 0.073934 Jan 15 21:29:26.896705 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3576/7163] 10.222.0.46 () {60 vars in 1255 bytes} [Sat Jan 15 21:29:26 2022] PUT /compute/v2.1/servers/0ca394fe-2987-449e-89bf-9dfc44bbd605 => generated 1080 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:29:26.909105 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-99021926-7c46-487e-9039-851e17e5ca2d tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:29:26.909704 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-99021926-7c46-487e-9039-851e17e5ca2d tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] [instance: 0ca394fe-2987-449e-89bf-9dfc44bbd605] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:29:26.915524 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-99021926-7c46-487e-9039-851e17e5ca2d tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:29:26.915964 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-99021926-7c46-487e-9039-851e17e5ca2d tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:29:26.916731 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-99021926-7c46-487e-9039-851e17e5ca2d tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:29:26.917203 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-99021926-7c46-487e-9039-851e17e5ca2d tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:29:27.050339 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-99021926-7c46-487e-9039-851e17e5ca2d tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd432681d7da4322a9cb7ec79c016614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c07aae567b4d718b53dbc4e126c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:29:27.057613 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-99021926-7c46-487e-9039-851e17e5ca2d tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] 10.222.0.46 "GET /compute/v2.1/servers/0ca394fe-2987-449e-89bf-9dfc44bbd605" status: 200 len: 1506 microversion: 2.1 time: 0.152406 Jan 15 21:29:27.058188 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3588/7164] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:29:26 2022] GET /compute/v2.1/servers/0ca394fe-2987-449e-89bf-9dfc44bbd605 => generated 1506 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:29:27.073355 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a0825fe1-4027-4b9f-a76c-4e848c65253a tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:29:27.073964 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a0825fe1-4027-4b9f-a76c-4e848c65253a tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] [instance: 0ca394fe-2987-449e-89bf-9dfc44bbd605] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:29:27.079989 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a0825fe1-4027-4b9f-a76c-4e848c65253a tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:29:27.080452 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a0825fe1-4027-4b9f-a76c-4e848c65253a tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:29:27.081345 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a0825fe1-4027-4b9f-a76c-4e848c65253a tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:29:27.081800 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a0825fe1-4027-4b9f-a76c-4e848c65253a tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:29:27.216249 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-a0825fe1-4027-4b9f-a76c-4e848c65253a tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd432681d7da4322a9cb7ec79c016614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c07aae567b4d718b53dbc4e126c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:29:27.224158 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a0825fe1-4027-4b9f-a76c-4e848c65253a tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] 10.222.0.46 "GET /compute/v2.1/servers/0ca394fe-2987-449e-89bf-9dfc44bbd605" status: 200 len: 1506 microversion: 2.1 time: 0.154495 Jan 15 21:29:27.224728 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3577/7165] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:29:27 2022] GET /compute/v2.1/servers/0ca394fe-2987-449e-89bf-9dfc44bbd605 => generated 1506 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:29:27.240342 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-705b5531-d9f6-4df5-9e05-fb9f0d5b876d tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:29:27.241392 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-705b5531-d9f6-4df5-9e05-fb9f0d5b876d tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] [instance: 0ca394fe-2987-449e-89bf-9dfc44bbd605] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:29:27.247170 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-705b5531-d9f6-4df5-9e05-fb9f0d5b876d tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:29:27.247614 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-705b5531-d9f6-4df5-9e05-fb9f0d5b876d tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:29:27.248378 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-705b5531-d9f6-4df5-9e05-fb9f0d5b876d tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:29:27.248806 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-705b5531-d9f6-4df5-9e05-fb9f0d5b876d tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:29:27.275162 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-705b5531-d9f6-4df5-9e05-fb9f0d5b876d tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'bd432681d7da4322a9cb7ec79c016614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c07aae567b4d718b53dbc4e126c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:29:27.281081 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-705b5531-d9f6-4df5-9e05-fb9f0d5b876d tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] [instance: 0ca394fe-2987-449e-89bf-9dfc44bbd605] Old instance type m1.heat2, new instance type m1.heat {{(pid=129366) resize /opt/stack/nova/nova/compute/api.py:4097}} Jan 15 21:29:27.287690 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-705b5531-d9f6-4df5-9e05-fb9f0d5b876d tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Flavor limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 21:29:27.288105 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-705b5531-d9f6-4df5-9e05-fb9f0d5b876d tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Image limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 21:29:27.288573 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-705b5531-d9f6-4df5-9e05-fb9f0d5b876d tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Flavor pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 21:29:27.289020 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-705b5531-d9f6-4df5-9e05-fb9f0d5b876d tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Image pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 21:29:27.289426 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-705b5531-d9f6-4df5-9e05-fb9f0d5b876d tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 21:29:27.353472 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-705b5531-d9f6-4df5-9e05-fb9f0d5b876d tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] 10.222.0.46 "POST /compute/v2.1/servers/0ca394fe-2987-449e-89bf-9dfc44bbd605/action" status: 202 len: 0 microversion: 2.1 time: 0.115536 Jan 15 21:29:27.353472 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3589/7166] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:29:27 2022] POST /compute/v2.1/servers/0ca394fe-2987-449e-89bf-9dfc44bbd605/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:29:27.362376 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-aebf1875-c1bd-48e0-98cc-bea0c75f3736 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:29:27.363007 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-aebf1875-c1bd-48e0-98cc-bea0c75f3736 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] [instance: 0ca394fe-2987-449e-89bf-9dfc44bbd605] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:29:27.369350 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-aebf1875-c1bd-48e0-98cc-bea0c75f3736 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:29:27.369813 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-aebf1875-c1bd-48e0-98cc-bea0c75f3736 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:29:27.370611 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-aebf1875-c1bd-48e0-98cc-bea0c75f3736 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:29:27.371057 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-aebf1875-c1bd-48e0-98cc-bea0c75f3736 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:29:27.534280 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-aebf1875-c1bd-48e0-98cc-bea0c75f3736 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd432681d7da4322a9cb7ec79c016614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c07aae567b4d718b53dbc4e126c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:29:27.541858 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-aebf1875-c1bd-48e0-98cc-bea0c75f3736 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] 10.222.0.46 "GET /compute/v2.1/servers/0ca394fe-2987-449e-89bf-9dfc44bbd605" status: 200 len: 1517 microversion: 2.1 time: 0.184728 Jan 15 21:29:27.542423 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3578/7167] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:29:27 2022] GET /compute/v2.1/servers/0ca394fe-2987-449e-89bf-9dfc44bbd605 => generated 1517 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:29:28.560894 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-3b516ead-7218-4758-b990-817cd2845b9e tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:29:28.561508 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-3b516ead-7218-4758-b990-817cd2845b9e tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] [instance: 0ca394fe-2987-449e-89bf-9dfc44bbd605] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:29:28.569790 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3b516ead-7218-4758-b990-817cd2845b9e tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:29:28.570488 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3b516ead-7218-4758-b990-817cd2845b9e tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:29:28.571099 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3b516ead-7218-4758-b990-817cd2845b9e tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:29:28.571536 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3b516ead-7218-4758-b990-817cd2845b9e tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:29:28.725122 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-3b516ead-7218-4758-b990-817cd2845b9e tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd432681d7da4322a9cb7ec79c016614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c07aae567b4d718b53dbc4e126c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:29:28.732595 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-3b516ead-7218-4758-b990-817cd2845b9e tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] 10.222.0.46 "GET /compute/v2.1/servers/0ca394fe-2987-449e-89bf-9dfc44bbd605" status: 200 len: 1517 microversion: 2.1 time: 0.176382 Jan 15 21:29:28.733209 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3590/7168] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:29:28 2022] GET /compute/v2.1/servers/0ca394fe-2987-449e-89bf-9dfc44bbd605 => generated 1517 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:29:29.749737 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-82637836-a9a2-426a-8313-c19b6167bc57 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:29:29.750353 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-82637836-a9a2-426a-8313-c19b6167bc57 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] [instance: 0ca394fe-2987-449e-89bf-9dfc44bbd605] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:29:29.757794 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-82637836-a9a2-426a-8313-c19b6167bc57 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:29:29.758253 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-82637836-a9a2-426a-8313-c19b6167bc57 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:29:29.759033 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-82637836-a9a2-426a-8313-c19b6167bc57 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:29:29.759509 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-82637836-a9a2-426a-8313-c19b6167bc57 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:29:29.891774 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-82637836-a9a2-426a-8313-c19b6167bc57 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd432681d7da4322a9cb7ec79c016614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c07aae567b4d718b53dbc4e126c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:29:29.899346 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-82637836-a9a2-426a-8313-c19b6167bc57 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] 10.222.0.46 "GET /compute/v2.1/servers/0ca394fe-2987-449e-89bf-9dfc44bbd605" status: 200 len: 1522 microversion: 2.1 time: 0.153231 Jan 15 21:29:29.899934 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3579/7169] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:29:29 2022] GET /compute/v2.1/servers/0ca394fe-2987-449e-89bf-9dfc44bbd605 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:29:30.917027 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-bff22d50-1444-4865-a871-011d80e66945 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:29:30.917631 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-bff22d50-1444-4865-a871-011d80e66945 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] [instance: 0ca394fe-2987-449e-89bf-9dfc44bbd605] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:29:30.924751 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bff22d50-1444-4865-a871-011d80e66945 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:29:30.925228 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bff22d50-1444-4865-a871-011d80e66945 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:29:30.926011 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bff22d50-1444-4865-a871-011d80e66945 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:29:30.926446 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bff22d50-1444-4865-a871-011d80e66945 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:29:31.060756 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-bff22d50-1444-4865-a871-011d80e66945 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd432681d7da4322a9cb7ec79c016614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c07aae567b4d718b53dbc4e126c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:29:31.068537 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-bff22d50-1444-4865-a871-011d80e66945 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] 10.222.0.46 "GET /compute/v2.1/servers/0ca394fe-2987-449e-89bf-9dfc44bbd605" status: 200 len: 1522 microversion: 2.1 time: 0.155196 Jan 15 21:29:31.069130 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3591/7170] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:29:30 2022] GET /compute/v2.1/servers/0ca394fe-2987-449e-89bf-9dfc44bbd605 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:29:32.086060 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e1d8847a-d3dd-4383-9d89-09242a4f25fe tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:29:32.086692 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e1d8847a-d3dd-4383-9d89-09242a4f25fe tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] [instance: 0ca394fe-2987-449e-89bf-9dfc44bbd605] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:29:32.093498 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e1d8847a-d3dd-4383-9d89-09242a4f25fe tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:29:32.093963 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e1d8847a-d3dd-4383-9d89-09242a4f25fe tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:29:32.094757 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e1d8847a-d3dd-4383-9d89-09242a4f25fe tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:29:32.096123 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e1d8847a-d3dd-4383-9d89-09242a4f25fe tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:29:32.227391 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-e1d8847a-d3dd-4383-9d89-09242a4f25fe tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd432681d7da4322a9cb7ec79c016614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c07aae567b4d718b53dbc4e126c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:29:32.234824 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e1d8847a-d3dd-4383-9d89-09242a4f25fe tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] 10.222.0.46 "GET /compute/v2.1/servers/0ca394fe-2987-449e-89bf-9dfc44bbd605" status: 200 len: 1522 microversion: 2.1 time: 0.152525 Jan 15 21:29:32.235396 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3580/7171] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:29:32 2022] GET /compute/v2.1/servers/0ca394fe-2987-449e-89bf-9dfc44bbd605 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:29:33.252252 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-eff5d2ad-2ac8-4367-ac91-760d3cd294f6 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:29:33.252917 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-eff5d2ad-2ac8-4367-ac91-760d3cd294f6 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] [instance: 0ca394fe-2987-449e-89bf-9dfc44bbd605] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:29:33.259661 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-eff5d2ad-2ac8-4367-ac91-760d3cd294f6 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:29:33.260140 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-eff5d2ad-2ac8-4367-ac91-760d3cd294f6 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:29:33.260949 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-eff5d2ad-2ac8-4367-ac91-760d3cd294f6 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:29:33.261384 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-eff5d2ad-2ac8-4367-ac91-760d3cd294f6 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:29:33.396275 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-eff5d2ad-2ac8-4367-ac91-760d3cd294f6 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd432681d7da4322a9cb7ec79c016614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c07aae567b4d718b53dbc4e126c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:29:33.403554 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-eff5d2ad-2ac8-4367-ac91-760d3cd294f6 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] 10.222.0.46 "GET /compute/v2.1/servers/0ca394fe-2987-449e-89bf-9dfc44bbd605" status: 200 len: 1522 microversion: 2.1 time: 0.155555 Jan 15 21:29:33.404123 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3592/7172] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:29:33 2022] GET /compute/v2.1/servers/0ca394fe-2987-449e-89bf-9dfc44bbd605 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:29:34.421475 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-85913ae0-32ab-4662-b73c-e93911715af0 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:29:34.422121 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-85913ae0-32ab-4662-b73c-e93911715af0 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] [instance: 0ca394fe-2987-449e-89bf-9dfc44bbd605] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:29:34.429318 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-85913ae0-32ab-4662-b73c-e93911715af0 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:29:34.429778 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-85913ae0-32ab-4662-b73c-e93911715af0 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:29:34.430560 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-85913ae0-32ab-4662-b73c-e93911715af0 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:29:34.431003 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-85913ae0-32ab-4662-b73c-e93911715af0 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:29:34.560426 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-85913ae0-32ab-4662-b73c-e93911715af0 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd432681d7da4322a9cb7ec79c016614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c07aae567b4d718b53dbc4e126c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:29:34.567854 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-85913ae0-32ab-4662-b73c-e93911715af0 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] 10.222.0.46 "GET /compute/v2.1/servers/0ca394fe-2987-449e-89bf-9dfc44bbd605" status: 200 len: 1522 microversion: 2.1 time: 0.150343 Jan 15 21:29:34.568413 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3581/7173] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:29:34 2022] GET /compute/v2.1/servers/0ca394fe-2987-449e-89bf-9dfc44bbd605 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:29:35.585131 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9795428f-c6aa-4e19-bdce-f4de34520f95 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:29:35.585731 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-9795428f-c6aa-4e19-bdce-f4de34520f95 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] [instance: 0ca394fe-2987-449e-89bf-9dfc44bbd605] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:29:35.592651 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9795428f-c6aa-4e19-bdce-f4de34520f95 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:29:35.593132 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9795428f-c6aa-4e19-bdce-f4de34520f95 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:29:35.593901 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9795428f-c6aa-4e19-bdce-f4de34520f95 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:29:35.594333 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9795428f-c6aa-4e19-bdce-f4de34520f95 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:29:35.727408 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-9795428f-c6aa-4e19-bdce-f4de34520f95 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd432681d7da4322a9cb7ec79c016614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c07aae567b4d718b53dbc4e126c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:29:35.734873 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-9795428f-c6aa-4e19-bdce-f4de34520f95 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] 10.222.0.46 "GET /compute/v2.1/servers/0ca394fe-2987-449e-89bf-9dfc44bbd605" status: 200 len: 1522 microversion: 2.1 time: 0.153374 Jan 15 21:29:35.735433 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3593/7174] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:29:35 2022] GET /compute/v2.1/servers/0ca394fe-2987-449e-89bf-9dfc44bbd605 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:29:36.752677 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-7d110beb-0441-4a96-9e2f-8dcad86c41bc tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:29:36.753309 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-7d110beb-0441-4a96-9e2f-8dcad86c41bc tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] [instance: 0ca394fe-2987-449e-89bf-9dfc44bbd605] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:29:36.759920 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7d110beb-0441-4a96-9e2f-8dcad86c41bc tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:29:36.760377 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7d110beb-0441-4a96-9e2f-8dcad86c41bc tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:29:36.761190 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7d110beb-0441-4a96-9e2f-8dcad86c41bc tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:29:36.761629 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7d110beb-0441-4a96-9e2f-8dcad86c41bc tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:29:36.890784 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-7d110beb-0441-4a96-9e2f-8dcad86c41bc tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd432681d7da4322a9cb7ec79c016614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c07aae567b4d718b53dbc4e126c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:29:36.898370 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-7d110beb-0441-4a96-9e2f-8dcad86c41bc tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] 10.222.0.46 "GET /compute/v2.1/servers/0ca394fe-2987-449e-89bf-9dfc44bbd605" status: 200 len: 1522 microversion: 2.1 time: 0.150184 Jan 15 21:29:36.899071 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3582/7175] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:29:36 2022] GET /compute/v2.1/servers/0ca394fe-2987-449e-89bf-9dfc44bbd605 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:29:37.916111 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-dc74ddb7-39dc-40b9-a00e-af66b3753235 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:29:37.916741 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-dc74ddb7-39dc-40b9-a00e-af66b3753235 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] [instance: 0ca394fe-2987-449e-89bf-9dfc44bbd605] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:29:37.924681 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dc74ddb7-39dc-40b9-a00e-af66b3753235 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:29:37.925158 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dc74ddb7-39dc-40b9-a00e-af66b3753235 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:29:37.925980 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dc74ddb7-39dc-40b9-a00e-af66b3753235 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:29:37.926417 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dc74ddb7-39dc-40b9-a00e-af66b3753235 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:29:38.058286 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-dc74ddb7-39dc-40b9-a00e-af66b3753235 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd432681d7da4322a9cb7ec79c016614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c07aae567b4d718b53dbc4e126c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:29:38.066031 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-dc74ddb7-39dc-40b9-a00e-af66b3753235 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] 10.222.0.46 "GET /compute/v2.1/servers/0ca394fe-2987-449e-89bf-9dfc44bbd605" status: 200 len: 1522 microversion: 2.1 time: 0.153609 Jan 15 21:29:38.066649 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3594/7176] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:29:37 2022] GET /compute/v2.1/servers/0ca394fe-2987-449e-89bf-9dfc44bbd605 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:29:39.082875 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3e2c725f-4922-48c5-9058-1ecbce8b5dfc tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:29:39.083531 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-3e2c725f-4922-48c5-9058-1ecbce8b5dfc tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] [instance: 0ca394fe-2987-449e-89bf-9dfc44bbd605] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:29:39.090304 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3e2c725f-4922-48c5-9058-1ecbce8b5dfc tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:29:39.090805 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3e2c725f-4922-48c5-9058-1ecbce8b5dfc tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:29:39.091607 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3e2c725f-4922-48c5-9058-1ecbce8b5dfc tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:29:39.092062 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3e2c725f-4922-48c5-9058-1ecbce8b5dfc tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:29:39.229027 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-3e2c725f-4922-48c5-9058-1ecbce8b5dfc tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd432681d7da4322a9cb7ec79c016614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c07aae567b4d718b53dbc4e126c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:29:39.237679 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3e2c725f-4922-48c5-9058-1ecbce8b5dfc tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] 10.222.0.46 "GET /compute/v2.1/servers/0ca394fe-2987-449e-89bf-9dfc44bbd605" status: 200 len: 1522 microversion: 2.1 time: 0.158560 Jan 15 21:29:39.238190 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3583/7177] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:29:39 2022] GET /compute/v2.1/servers/0ca394fe-2987-449e-89bf-9dfc44bbd605 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:29:40.254677 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9d44db95-c756-46e4-85b7-c9a5cdd1bda0 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:29:40.255305 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-9d44db95-c756-46e4-85b7-c9a5cdd1bda0 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] [instance: 0ca394fe-2987-449e-89bf-9dfc44bbd605] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:29:40.262947 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9d44db95-c756-46e4-85b7-c9a5cdd1bda0 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:29:40.263525 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9d44db95-c756-46e4-85b7-c9a5cdd1bda0 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:29:40.264362 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9d44db95-c756-46e4-85b7-c9a5cdd1bda0 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:29:40.264796 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9d44db95-c756-46e4-85b7-c9a5cdd1bda0 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:29:40.399053 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-9d44db95-c756-46e4-85b7-c9a5cdd1bda0 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd432681d7da4322a9cb7ec79c016614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c07aae567b4d718b53dbc4e126c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:29:40.406661 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-9d44db95-c756-46e4-85b7-c9a5cdd1bda0 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] 10.222.0.46 "GET /compute/v2.1/servers/0ca394fe-2987-449e-89bf-9dfc44bbd605" status: 200 len: 1522 microversion: 2.1 time: 0.155830 Jan 15 21:29:40.407287 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3595/7178] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:29:40 2022] GET /compute/v2.1/servers/0ca394fe-2987-449e-89bf-9dfc44bbd605 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:29:41.424079 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-6b9d80fb-4add-4b32-a542-88cab8fe1e92 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:29:41.424704 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-6b9d80fb-4add-4b32-a542-88cab8fe1e92 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] [instance: 0ca394fe-2987-449e-89bf-9dfc44bbd605] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:29:41.431482 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6b9d80fb-4add-4b32-a542-88cab8fe1e92 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:29:41.432124 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6b9d80fb-4add-4b32-a542-88cab8fe1e92 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:29:41.432930 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6b9d80fb-4add-4b32-a542-88cab8fe1e92 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:29:41.433410 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6b9d80fb-4add-4b32-a542-88cab8fe1e92 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:29:41.567647 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-6b9d80fb-4add-4b32-a542-88cab8fe1e92 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd432681d7da4322a9cb7ec79c016614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c07aae567b4d718b53dbc4e126c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:29:41.575193 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-6b9d80fb-4add-4b32-a542-88cab8fe1e92 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] 10.222.0.46 "GET /compute/v2.1/servers/0ca394fe-2987-449e-89bf-9dfc44bbd605" status: 200 len: 1522 microversion: 2.1 time: 0.155428 Jan 15 21:29:41.575764 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3584/7179] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:29:41 2022] GET /compute/v2.1/servers/0ca394fe-2987-449e-89bf-9dfc44bbd605 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:29:42.591324 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-efb4aaa8-1df9-4fcf-87f8-4958e4386a3a tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:29:42.591872 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-efb4aaa8-1df9-4fcf-87f8-4958e4386a3a tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] [instance: 0ca394fe-2987-449e-89bf-9dfc44bbd605] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:29:42.598666 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-efb4aaa8-1df9-4fcf-87f8-4958e4386a3a tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:29:42.599111 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-efb4aaa8-1df9-4fcf-87f8-4958e4386a3a tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:29:42.599877 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-efb4aaa8-1df9-4fcf-87f8-4958e4386a3a tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:29:42.600313 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-efb4aaa8-1df9-4fcf-87f8-4958e4386a3a tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:29:42.729872 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-efb4aaa8-1df9-4fcf-87f8-4958e4386a3a tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd432681d7da4322a9cb7ec79c016614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c07aae567b4d718b53dbc4e126c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:29:42.737809 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-efb4aaa8-1df9-4fcf-87f8-4958e4386a3a tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] 10.222.0.46 "GET /compute/v2.1/servers/0ca394fe-2987-449e-89bf-9dfc44bbd605" status: 200 len: 1522 microversion: 2.1 time: 0.150229 Jan 15 21:29:42.738385 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3596/7180] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:29:42 2022] GET /compute/v2.1/servers/0ca394fe-2987-449e-89bf-9dfc44bbd605 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:29:43.754740 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-dc3281c8-1538-4282-a71b-876c9e1261bf tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:29:43.755372 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-dc3281c8-1538-4282-a71b-876c9e1261bf tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] [instance: 0ca394fe-2987-449e-89bf-9dfc44bbd605] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:29:43.762021 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dc3281c8-1538-4282-a71b-876c9e1261bf tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:29:43.762474 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dc3281c8-1538-4282-a71b-876c9e1261bf tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:29:43.763257 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dc3281c8-1538-4282-a71b-876c9e1261bf tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:29:43.763702 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dc3281c8-1538-4282-a71b-876c9e1261bf tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:29:43.893918 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-dc3281c8-1538-4282-a71b-876c9e1261bf tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd432681d7da4322a9cb7ec79c016614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c07aae567b4d718b53dbc4e126c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:29:43.902541 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-dc3281c8-1538-4282-a71b-876c9e1261bf tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] 10.222.0.46 "GET /compute/v2.1/servers/0ca394fe-2987-449e-89bf-9dfc44bbd605" status: 200 len: 1522 microversion: 2.1 time: 0.152148 Jan 15 21:29:43.903123 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3585/7181] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:29:43 2022] GET /compute/v2.1/servers/0ca394fe-2987-449e-89bf-9dfc44bbd605 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:29:44.921237 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c313a9ed-4d85-421c-8c77-a8a77db5f3d0 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:29:44.921895 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c313a9ed-4d85-421c-8c77-a8a77db5f3d0 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] [instance: 0ca394fe-2987-449e-89bf-9dfc44bbd605] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:29:44.928624 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c313a9ed-4d85-421c-8c77-a8a77db5f3d0 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:29:44.929121 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c313a9ed-4d85-421c-8c77-a8a77db5f3d0 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:29:44.929888 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c313a9ed-4d85-421c-8c77-a8a77db5f3d0 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:29:44.930324 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c313a9ed-4d85-421c-8c77-a8a77db5f3d0 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:29:45.063957 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-c313a9ed-4d85-421c-8c77-a8a77db5f3d0 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd432681d7da4322a9cb7ec79c016614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c07aae567b4d718b53dbc4e126c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:29:45.071423 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c313a9ed-4d85-421c-8c77-a8a77db5f3d0 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] 10.222.0.46 "GET /compute/v2.1/servers/0ca394fe-2987-449e-89bf-9dfc44bbd605" status: 200 len: 1522 microversion: 2.1 time: 0.154165 Jan 15 21:29:45.072004 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3597/7182] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:29:44 2022] GET /compute/v2.1/servers/0ca394fe-2987-449e-89bf-9dfc44bbd605 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:29:46.088828 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5fb5d9ea-551a-43e7-8d8c-c09a84fa5d7c tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:29:46.089382 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-5fb5d9ea-551a-43e7-8d8c-c09a84fa5d7c tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] [instance: 0ca394fe-2987-449e-89bf-9dfc44bbd605] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:29:46.096057 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5fb5d9ea-551a-43e7-8d8c-c09a84fa5d7c tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:29:46.096512 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5fb5d9ea-551a-43e7-8d8c-c09a84fa5d7c tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:29:46.097318 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5fb5d9ea-551a-43e7-8d8c-c09a84fa5d7c tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:29:46.097764 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5fb5d9ea-551a-43e7-8d8c-c09a84fa5d7c tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:29:46.235424 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-5fb5d9ea-551a-43e7-8d8c-c09a84fa5d7c tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd432681d7da4322a9cb7ec79c016614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c07aae567b4d718b53dbc4e126c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:29:46.242753 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5fb5d9ea-551a-43e7-8d8c-c09a84fa5d7c tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] 10.222.0.46 "GET /compute/v2.1/servers/0ca394fe-2987-449e-89bf-9dfc44bbd605" status: 200 len: 1522 microversion: 2.1 time: 0.157749 Jan 15 21:29:46.243330 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3586/7183] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:29:46 2022] GET /compute/v2.1/servers/0ca394fe-2987-449e-89bf-9dfc44bbd605 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:29:47.259473 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-11593e04-1a57-4aad-8959-07e6aca484d5 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:29:47.260027 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-11593e04-1a57-4aad-8959-07e6aca484d5 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] [instance: 0ca394fe-2987-449e-89bf-9dfc44bbd605] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:29:47.267831 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-11593e04-1a57-4aad-8959-07e6aca484d5 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:29:47.268286 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-11593e04-1a57-4aad-8959-07e6aca484d5 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:29:47.269109 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-11593e04-1a57-4aad-8959-07e6aca484d5 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:29:47.269554 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-11593e04-1a57-4aad-8959-07e6aca484d5 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:29:47.405045 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-11593e04-1a57-4aad-8959-07e6aca484d5 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd432681d7da4322a9cb7ec79c016614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c07aae567b4d718b53dbc4e126c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:29:47.413272 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-11593e04-1a57-4aad-8959-07e6aca484d5 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] 10.222.0.46 "GET /compute/v2.1/servers/0ca394fe-2987-449e-89bf-9dfc44bbd605" status: 200 len: 1522 microversion: 2.1 time: 0.157622 Jan 15 21:29:47.413848 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3598/7184] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:29:47 2022] GET /compute/v2.1/servers/0ca394fe-2987-449e-89bf-9dfc44bbd605 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:29:48.430093 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-feafde9e-794a-4a47-a3b2-4f73851b0cc6 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:29:48.430833 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-feafde9e-794a-4a47-a3b2-4f73851b0cc6 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] [instance: 0ca394fe-2987-449e-89bf-9dfc44bbd605] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:29:48.437564 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-feafde9e-794a-4a47-a3b2-4f73851b0cc6 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:29:48.438045 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-feafde9e-794a-4a47-a3b2-4f73851b0cc6 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:29:48.438834 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-feafde9e-794a-4a47-a3b2-4f73851b0cc6 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:29:48.439315 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-feafde9e-794a-4a47-a3b2-4f73851b0cc6 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:29:48.574627 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-feafde9e-794a-4a47-a3b2-4f73851b0cc6 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd432681d7da4322a9cb7ec79c016614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c07aae567b4d718b53dbc4e126c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:29:48.582619 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-feafde9e-794a-4a47-a3b2-4f73851b0cc6 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] 10.222.0.46 "GET /compute/v2.1/servers/0ca394fe-2987-449e-89bf-9dfc44bbd605" status: 200 len: 1522 microversion: 2.1 time: 0.156232 Jan 15 21:29:48.583194 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3587/7185] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:29:48 2022] GET /compute/v2.1/servers/0ca394fe-2987-449e-89bf-9dfc44bbd605 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:29:49.600778 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-fff13568-7814-4ac2-aa8a-a84977a2504c tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:29:49.601430 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-fff13568-7814-4ac2-aa8a-a84977a2504c tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] [instance: 0ca394fe-2987-449e-89bf-9dfc44bbd605] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:29:49.608126 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fff13568-7814-4ac2-aa8a-a84977a2504c tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:29:49.608574 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fff13568-7814-4ac2-aa8a-a84977a2504c tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:29:49.609376 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fff13568-7814-4ac2-aa8a-a84977a2504c tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:29:49.609808 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fff13568-7814-4ac2-aa8a-a84977a2504c tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:29:49.742926 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-fff13568-7814-4ac2-aa8a-a84977a2504c tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd432681d7da4322a9cb7ec79c016614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c07aae567b4d718b53dbc4e126c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:29:49.750416 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-fff13568-7814-4ac2-aa8a-a84977a2504c tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] 10.222.0.46 "GET /compute/v2.1/servers/0ca394fe-2987-449e-89bf-9dfc44bbd605" status: 200 len: 1522 microversion: 2.1 time: 0.154508 Jan 15 21:29:49.750996 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3599/7186] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:29:49 2022] GET /compute/v2.1/servers/0ca394fe-2987-449e-89bf-9dfc44bbd605 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:29:50.768032 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9e694e2c-f44e-4463-81fd-606288e06a05 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:29:50.768856 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-9e694e2c-f44e-4463-81fd-606288e06a05 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] [instance: 0ca394fe-2987-449e-89bf-9dfc44bbd605] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:29:50.775576 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9e694e2c-f44e-4463-81fd-606288e06a05 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:29:50.776072 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9e694e2c-f44e-4463-81fd-606288e06a05 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:29:50.777004 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9e694e2c-f44e-4463-81fd-606288e06a05 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:29:50.777506 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9e694e2c-f44e-4463-81fd-606288e06a05 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:29:50.905159 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-9e694e2c-f44e-4463-81fd-606288e06a05 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd432681d7da4322a9cb7ec79c016614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c07aae567b4d718b53dbc4e126c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:29:50.913698 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-9e694e2c-f44e-4463-81fd-606288e06a05 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] 10.222.0.46 "GET /compute/v2.1/servers/0ca394fe-2987-449e-89bf-9dfc44bbd605" status: 200 len: 1522 microversion: 2.1 time: 0.150052 Jan 15 21:29:50.914277 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3588/7187] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:29:50 2022] GET /compute/v2.1/servers/0ca394fe-2987-449e-89bf-9dfc44bbd605 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:29:51.930719 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-08103dd9-cb9a-42da-b52a-3bce2f695277 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:29:51.931356 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-08103dd9-cb9a-42da-b52a-3bce2f695277 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] [instance: 0ca394fe-2987-449e-89bf-9dfc44bbd605] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:29:51.937982 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-08103dd9-cb9a-42da-b52a-3bce2f695277 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:29:51.938424 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-08103dd9-cb9a-42da-b52a-3bce2f695277 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:29:51.939190 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-08103dd9-cb9a-42da-b52a-3bce2f695277 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:29:51.939698 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-08103dd9-cb9a-42da-b52a-3bce2f695277 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:29:52.071767 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-08103dd9-cb9a-42da-b52a-3bce2f695277 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd432681d7da4322a9cb7ec79c016614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c07aae567b4d718b53dbc4e126c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:29:52.079319 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-08103dd9-cb9a-42da-b52a-3bce2f695277 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] 10.222.0.46 "GET /compute/v2.1/servers/0ca394fe-2987-449e-89bf-9dfc44bbd605" status: 200 len: 1522 microversion: 2.1 time: 0.152273 Jan 15 21:29:52.079907 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3600/7188] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:29:51 2022] GET /compute/v2.1/servers/0ca394fe-2987-449e-89bf-9dfc44bbd605 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:29:53.097235 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-38b043f8-fc0f-457f-aa21-6a4bad12a7ae tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:29:53.097910 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-38b043f8-fc0f-457f-aa21-6a4bad12a7ae tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] [instance: 0ca394fe-2987-449e-89bf-9dfc44bbd605] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:29:53.104605 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-38b043f8-fc0f-457f-aa21-6a4bad12a7ae tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:29:53.105104 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-38b043f8-fc0f-457f-aa21-6a4bad12a7ae tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:29:53.105908 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-38b043f8-fc0f-457f-aa21-6a4bad12a7ae tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:29:53.106361 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-38b043f8-fc0f-457f-aa21-6a4bad12a7ae tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:29:53.243029 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-38b043f8-fc0f-457f-aa21-6a4bad12a7ae tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd432681d7da4322a9cb7ec79c016614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c07aae567b4d718b53dbc4e126c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:29:53.250305 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-38b043f8-fc0f-457f-aa21-6a4bad12a7ae tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] 10.222.0.46 "GET /compute/v2.1/servers/0ca394fe-2987-449e-89bf-9dfc44bbd605" status: 200 len: 1522 microversion: 2.1 time: 0.157417 Jan 15 21:29:53.250911 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3589/7189] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:29:53 2022] GET /compute/v2.1/servers/0ca394fe-2987-449e-89bf-9dfc44bbd605 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:29:54.266701 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d3e0b29e-4a97-463e-af3e-c3b481c486d6 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:29:54.267292 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-d3e0b29e-4a97-463e-af3e-c3b481c486d6 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] [instance: 0ca394fe-2987-449e-89bf-9dfc44bbd605] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:29:54.274846 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d3e0b29e-4a97-463e-af3e-c3b481c486d6 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:29:54.275291 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d3e0b29e-4a97-463e-af3e-c3b481c486d6 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:29:54.276086 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d3e0b29e-4a97-463e-af3e-c3b481c486d6 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:29:54.276497 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d3e0b29e-4a97-463e-af3e-c3b481c486d6 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:29:54.408934 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-d3e0b29e-4a97-463e-af3e-c3b481c486d6 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd432681d7da4322a9cb7ec79c016614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c07aae567b4d718b53dbc4e126c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:29:54.416483 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d3e0b29e-4a97-463e-af3e-c3b481c486d6 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] 10.222.0.46 "GET /compute/v2.1/servers/0ca394fe-2987-449e-89bf-9dfc44bbd605" status: 200 len: 1522 microversion: 2.1 time: 0.153547 Jan 15 21:29:54.417075 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3601/7190] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:29:54 2022] GET /compute/v2.1/servers/0ca394fe-2987-449e-89bf-9dfc44bbd605 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:29:55.433455 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9c2448d7-93ca-4cf6-9535-a4de367f12ef tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:29:55.434072 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-9c2448d7-93ca-4cf6-9535-a4de367f12ef tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] [instance: 0ca394fe-2987-449e-89bf-9dfc44bbd605] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:29:55.441411 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9c2448d7-93ca-4cf6-9535-a4de367f12ef tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:29:55.441873 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9c2448d7-93ca-4cf6-9535-a4de367f12ef tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:29:55.442654 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9c2448d7-93ca-4cf6-9535-a4de367f12ef tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:29:55.443095 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9c2448d7-93ca-4cf6-9535-a4de367f12ef tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:29:55.575927 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-9c2448d7-93ca-4cf6-9535-a4de367f12ef tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd432681d7da4322a9cb7ec79c016614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c07aae567b4d718b53dbc4e126c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:29:55.583983 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-9c2448d7-93ca-4cf6-9535-a4de367f12ef tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] 10.222.0.46 "GET /compute/v2.1/servers/0ca394fe-2987-449e-89bf-9dfc44bbd605" status: 200 len: 1522 microversion: 2.1 time: 0.154259 Jan 15 21:29:55.584559 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3590/7191] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:29:55 2022] GET /compute/v2.1/servers/0ca394fe-2987-449e-89bf-9dfc44bbd605 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:29:56.476618 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-f126684c-a9f9-470e-8b5a-82d1f9a46087 req-1fc4f457-6c0d-4ed3-bee4-b2609e3ce254 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ca394fe-2987-449e-89bf-9dfc44bbd605", "name": "network-vif-unplugged", "status": "completed", "tag": "56297d7b-5525-4c45-be7d-f585e2f7374a"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:29:56.478174 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:29:56.478174 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:29:56.486392 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-f126684c-a9f9-470e-8b5a-82d1f9a46087 req-1fc4f457-6c0d-4ed3-bee4-b2609e3ce254 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:29:56.486932 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-f126684c-a9f9-470e-8b5a-82d1f9a46087 req-1fc4f457-6c0d-4ed3-bee4-b2609e3ce254 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:29:56.500619 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-f126684c-a9f9-470e-8b5a-82d1f9a46087 req-1fc4f457-6c0d-4ed3-bee4-b2609e3ce254 service nova] Creating event network-vif-unplugged:56297d7b-5525-4c45-be7d-f585e2f7374a for instance 0ca394fe-2987-449e-89bf-9dfc44bbd605 on nch2-master-1 Jan 15 21:29:56.506872 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [req-f126684c-a9f9-470e-8b5a-82d1f9a46087 req-1fc4f457-6c0d-4ed3-bee4-b2609e3ce254 service nova] Instance 0ca394fe-2987-449e-89bf-9dfc44bbd605 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=129366) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Jan 15 21:29:56.522781 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-f126684c-a9f9-470e-8b5a-82d1f9a46087 req-1fc4f457-6c0d-4ed3-bee4-b2609e3ce254 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049370 Jan 15 21:29:56.523547 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3602/7192] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:29:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 21:29:56.600097 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-0033b771-3452-466a-a122-4e85357e1b1d tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:29:56.600747 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-0033b771-3452-466a-a122-4e85357e1b1d tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] [instance: 0ca394fe-2987-449e-89bf-9dfc44bbd605] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:29:56.607416 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0033b771-3452-466a-a122-4e85357e1b1d tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:29:56.607876 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0033b771-3452-466a-a122-4e85357e1b1d tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:29:56.608662 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0033b771-3452-466a-a122-4e85357e1b1d tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:29:56.609157 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0033b771-3452-466a-a122-4e85357e1b1d tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:29:56.750174 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-0033b771-3452-466a-a122-4e85357e1b1d tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd432681d7da4322a9cb7ec79c016614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c07aae567b4d718b53dbc4e126c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:29:56.760868 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-0033b771-3452-466a-a122-4e85357e1b1d tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] 10.222.0.46 "GET /compute/v2.1/servers/0ca394fe-2987-449e-89bf-9dfc44bbd605" status: 200 len: 1521 microversion: 2.1 time: 0.164354 Jan 15 21:29:56.772442 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3591/7193] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:29:56 2022] GET /compute/v2.1/servers/0ca394fe-2987-449e-89bf-9dfc44bbd605 => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:29:57.780116 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-107bb86c-ba0c-4b7b-8f05-10873183fd6a tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:29:57.780816 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-107bb86c-ba0c-4b7b-8f05-10873183fd6a tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] [instance: 0ca394fe-2987-449e-89bf-9dfc44bbd605] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:29:57.787995 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-107bb86c-ba0c-4b7b-8f05-10873183fd6a tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:29:57.788448 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-107bb86c-ba0c-4b7b-8f05-10873183fd6a tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:29:57.789272 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-107bb86c-ba0c-4b7b-8f05-10873183fd6a tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:29:57.789710 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-107bb86c-ba0c-4b7b-8f05-10873183fd6a tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:29:57.917350 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-107bb86c-ba0c-4b7b-8f05-10873183fd6a tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd432681d7da4322a9cb7ec79c016614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c07aae567b4d718b53dbc4e126c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:29:57.925038 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-107bb86c-ba0c-4b7b-8f05-10873183fd6a tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] 10.222.0.46 "GET /compute/v2.1/servers/0ca394fe-2987-449e-89bf-9dfc44bbd605" status: 200 len: 1519 microversion: 2.1 time: 0.149731 Jan 15 21:29:57.925620 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3603/7194] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:29:57 2022] GET /compute/v2.1/servers/0ca394fe-2987-449e-89bf-9dfc44bbd605 => generated 1519 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:29:58.537139 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-9728be8b-14c4-4997-b008-879e12a4b457 req-0860add9-84a9-48f3-bbab-59f829a1e3d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ca394fe-2987-449e-89bf-9dfc44bbd605", "tag": "56297d7b-5525-4c45-be7d-f585e2f7374a"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:29:58.538675 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:29:58.538675 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:29:58.546444 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-9728be8b-14c4-4997-b008-879e12a4b457 req-0860add9-84a9-48f3-bbab-59f829a1e3d8 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:29:58.546916 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-9728be8b-14c4-4997-b008-879e12a4b457 req-0860add9-84a9-48f3-bbab-59f829a1e3d8 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:29:58.557975 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-9728be8b-14c4-4997-b008-879e12a4b457 req-0860add9-84a9-48f3-bbab-59f829a1e3d8 service nova] Creating event network-changed:56297d7b-5525-4c45-be7d-f585e2f7374a for instance 0ca394fe-2987-449e-89bf-9dfc44bbd605 on nch2-master-1 Jan 15 21:29:58.563230 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [req-9728be8b-14c4-4997-b008-879e12a4b457 req-0860add9-84a9-48f3-bbab-59f829a1e3d8 service nova] Instance 0ca394fe-2987-449e-89bf-9dfc44bbd605 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=129365) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Jan 15 21:29:58.574588 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-9728be8b-14c4-4997-b008-879e12a4b457 req-0860add9-84a9-48f3-bbab-59f829a1e3d8 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041563 Jan 15 21:29:58.575365 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3592/7195] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:29:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:29:58.942566 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-fbca3551-69e6-4a61-a603-9f720231a360 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:29:58.943121 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-fbca3551-69e6-4a61-a603-9f720231a360 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] [instance: 0ca394fe-2987-449e-89bf-9dfc44bbd605] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:29:58.950675 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fbca3551-69e6-4a61-a603-9f720231a360 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:29:58.951323 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fbca3551-69e6-4a61-a603-9f720231a360 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:29:58.952247 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fbca3551-69e6-4a61-a603-9f720231a360 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:29:58.952760 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fbca3551-69e6-4a61-a603-9f720231a360 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:29:59.098219 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-fbca3551-69e6-4a61-a603-9f720231a360 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd432681d7da4322a9cb7ec79c016614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c07aae567b4d718b53dbc4e126c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:29:59.106016 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-fbca3551-69e6-4a61-a603-9f720231a360 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] 10.222.0.46 "GET /compute/v2.1/servers/0ca394fe-2987-449e-89bf-9dfc44bbd605" status: 200 len: 1519 microversion: 2.1 time: 0.167953 Jan 15 21:29:59.106616 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3604/7196] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:29:58 2022] GET /compute/v2.1/servers/0ca394fe-2987-449e-89bf-9dfc44bbd605 => generated 1519 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:30:00.124825 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c5d2ba4d-d8dc-4bfa-a9e9-2741a1a5edba tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:30:00.125462 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c5d2ba4d-d8dc-4bfa-a9e9-2741a1a5edba tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] [instance: 0ca394fe-2987-449e-89bf-9dfc44bbd605] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:30:00.131675 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c5d2ba4d-d8dc-4bfa-a9e9-2741a1a5edba tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:00.132132 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c5d2ba4d-d8dc-4bfa-a9e9-2741a1a5edba tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:00.132943 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c5d2ba4d-d8dc-4bfa-a9e9-2741a1a5edba tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:00.133388 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c5d2ba4d-d8dc-4bfa-a9e9-2741a1a5edba tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:00.266148 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-c5d2ba4d-d8dc-4bfa-a9e9-2741a1a5edba tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd432681d7da4322a9cb7ec79c016614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c07aae567b4d718b53dbc4e126c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:30:00.274919 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c5d2ba4d-d8dc-4bfa-a9e9-2741a1a5edba tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] 10.222.0.46 "GET /compute/v2.1/servers/0ca394fe-2987-449e-89bf-9dfc44bbd605" status: 200 len: 1516 microversion: 2.1 time: 0.154880 Jan 15 21:30:00.275526 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3593/7197] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:30:00 2022] GET /compute/v2.1/servers/0ca394fe-2987-449e-89bf-9dfc44bbd605 => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:30:00.292154 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c1c8a7d6-223d-4076-93b7-fe715710e532 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:30:00.293312 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c1c8a7d6-223d-4076-93b7-fe715710e532 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] [instance: 0ca394fe-2987-449e-89bf-9dfc44bbd605] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:30:00.300589 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c1c8a7d6-223d-4076-93b7-fe715710e532 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:00.301071 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c1c8a7d6-223d-4076-93b7-fe715710e532 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:00.301860 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c1c8a7d6-223d-4076-93b7-fe715710e532 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:00.302298 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c1c8a7d6-223d-4076-93b7-fe715710e532 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:00.364625 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c1c8a7d6-223d-4076-93b7-fe715710e532 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] 10.222.0.46 "POST /compute/v2.1/servers/0ca394fe-2987-449e-89bf-9dfc44bbd605/action" status: 204 len: 0 microversion: 2.1 time: 0.076104 Jan 15 21:30:00.368335 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3605/7198] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:30:00 2022] POST /compute/v2.1/servers/0ca394fe-2987-449e-89bf-9dfc44bbd605/action => generated 0 bytes in 78 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 21:30:00.373264 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-694dc346-af2b-4154-9042-e42ee4b45b1f tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:30:00.374169 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-694dc346-af2b-4154-9042-e42ee4b45b1f tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] [instance: 0ca394fe-2987-449e-89bf-9dfc44bbd605] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:30:00.380660 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-694dc346-af2b-4154-9042-e42ee4b45b1f tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:00.381018 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-694dc346-af2b-4154-9042-e42ee4b45b1f tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:00.382104 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-694dc346-af2b-4154-9042-e42ee4b45b1f tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:00.382788 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-694dc346-af2b-4154-9042-e42ee4b45b1f tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:00.529575 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-694dc346-af2b-4154-9042-e42ee4b45b1f tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd432681d7da4322a9cb7ec79c016614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c07aae567b4d718b53dbc4e126c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:30:00.538247 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-694dc346-af2b-4154-9042-e42ee4b45b1f tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] 10.222.0.46 "GET /compute/v2.1/servers/0ca394fe-2987-449e-89bf-9dfc44bbd605" status: 200 len: 1516 microversion: 2.1 time: 0.168697 Jan 15 21:30:00.538840 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3594/7199] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:30:00 2022] GET /compute/v2.1/servers/0ca394fe-2987-449e-89bf-9dfc44bbd605 => generated 1516 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:30:01.557407 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-cd3ef6df-147d-408c-b2f6-6ef871b1102b tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:30:01.558128 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-cd3ef6df-147d-408c-b2f6-6ef871b1102b tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] [instance: 0ca394fe-2987-449e-89bf-9dfc44bbd605] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:30:01.564278 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cd3ef6df-147d-408c-b2f6-6ef871b1102b tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:01.564737 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cd3ef6df-147d-408c-b2f6-6ef871b1102b tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:01.565560 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cd3ef6df-147d-408c-b2f6-6ef871b1102b tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:01.566001 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cd3ef6df-147d-408c-b2f6-6ef871b1102b tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:01.699416 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-cd3ef6df-147d-408c-b2f6-6ef871b1102b tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd432681d7da4322a9cb7ec79c016614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c07aae567b4d718b53dbc4e126c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:30:01.707003 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-cd3ef6df-147d-408c-b2f6-6ef871b1102b tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] 10.222.0.46 "GET /compute/v2.1/servers/0ca394fe-2987-449e-89bf-9dfc44bbd605" status: 200 len: 1508 microversion: 2.1 time: 0.154779 Jan 15 21:30:01.707575 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3606/7200] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:30:01 2022] GET /compute/v2.1/servers/0ca394fe-2987-449e-89bf-9dfc44bbd605 => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:30:01.724315 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-13fc3d3b-74db-4aed-93c2-851927551460 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:30:01.724990 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-13fc3d3b-74db-4aed-93c2-851927551460 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] [instance: 0ca394fe-2987-449e-89bf-9dfc44bbd605] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:30:01.731755 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-13fc3d3b-74db-4aed-93c2-851927551460 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:01.732220 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-13fc3d3b-74db-4aed-93c2-851927551460 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:01.733040 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-13fc3d3b-74db-4aed-93c2-851927551460 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:01.733489 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-13fc3d3b-74db-4aed-93c2-851927551460 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:01.872233 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-13fc3d3b-74db-4aed-93c2-851927551460 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd432681d7da4322a9cb7ec79c016614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c07aae567b4d718b53dbc4e126c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:30:01.879696 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-13fc3d3b-74db-4aed-93c2-851927551460 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] 10.222.0.46 "GET /compute/v2.1/servers/0ca394fe-2987-449e-89bf-9dfc44bbd605" status: 200 len: 1508 microversion: 2.1 time: 0.159527 Jan 15 21:30:01.880270 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3595/7201] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:30:01 2022] GET /compute/v2.1/servers/0ca394fe-2987-449e-89bf-9dfc44bbd605 => generated 1508 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:30:01.895697 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-74249c49-cec5-4cbe-930a-3a564d79d9db tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:30:01.896299 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-74249c49-cec5-4cbe-930a-3a564d79d9db tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] [instance: 0ca394fe-2987-449e-89bf-9dfc44bbd605] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:30:01.902224 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-74249c49-cec5-4cbe-930a-3a564d79d9db tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:01.902610 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-74249c49-cec5-4cbe-930a-3a564d79d9db tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:01.903393 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-74249c49-cec5-4cbe-930a-3a564d79d9db tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:01.903806 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-74249c49-cec5-4cbe-930a-3a564d79d9db tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:02.030226 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-74249c49-cec5-4cbe-930a-3a564d79d9db tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd432681d7da4322a9cb7ec79c016614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c07aae567b4d718b53dbc4e126c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:30:02.038579 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-74249c49-cec5-4cbe-930a-3a564d79d9db tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] 10.222.0.46 "GET /compute/v2.1/servers/0ca394fe-2987-449e-89bf-9dfc44bbd605" status: 200 len: 1508 microversion: 2.1 time: 0.147065 Jan 15 21:30:02.039145 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3607/7202] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:30:01 2022] GET /compute/v2.1/servers/0ca394fe-2987-449e-89bf-9dfc44bbd605 => generated 1508 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:30:02.054946 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2a693c69-40ac-46a8-a086-acd69e3da3e5 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:30:02.055451 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-2a693c69-40ac-46a8-a086-acd69e3da3e5 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] [instance: 0ca394fe-2987-449e-89bf-9dfc44bbd605] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:30:02.061357 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2a693c69-40ac-46a8-a086-acd69e3da3e5 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:02.061826 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2a693c69-40ac-46a8-a086-acd69e3da3e5 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:02.062617 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2a693c69-40ac-46a8-a086-acd69e3da3e5 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:02.063067 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2a693c69-40ac-46a8-a086-acd69e3da3e5 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:02.087680 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-2a693c69-40ac-46a8-a086-acd69e3da3e5 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] [instance: 0ca394fe-2987-449e-89bf-9dfc44bbd605] Going to try to terminate instance {{(pid=129365) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 21:30:02.161294 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2a693c69-40ac-46a8-a086-acd69e3da3e5 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] 10.222.0.46 "DELETE /compute/v2.1/servers/0ca394fe-2987-449e-89bf-9dfc44bbd605" status: 204 len: 0 microversion: 2.1 time: 0.109318 Jan 15 21:30:02.162311 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3596/7203] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 21:30:02 2022] DELETE /compute/v2.1/servers/0ca394fe-2987-449e-89bf-9dfc44bbd605 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 15 21:30:02.221582 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e22693c2-0732-416e-8a1b-9b1c3621f8c5 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1965662722", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "networks": [{"uuid": "20140db7-b287-4e34-b35e-a51d2875af4b"}]}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:30:02.271073 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.network.neutron [None req-e22693c2-0732-416e-8a1b-9b1c3621f8c5 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] validate_networks() for [('20140db7-b287-4e34-b35e-a51d2875af4b', None, None, None, None, None)] {{(pid=129366) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 21:30:02.458772 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-5b1085de-a89f-40a9-94af-e46c63a16b4d req-f31ed3b4-b8ca-4588-946d-ec3c8c67dcca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ca394fe-2987-449e-89bf-9dfc44bbd605", "name": "network-vif-plugged", "status": "completed", "tag": "56297d7b-5525-4c45-be7d-f585e2f7374a"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:30:02.461032 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:30:02.461032 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:30:02.468693 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-5b1085de-a89f-40a9-94af-e46c63a16b4d req-f31ed3b4-b8ca-4588-946d-ec3c8c67dcca service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:02.469193 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-5b1085de-a89f-40a9-94af-e46c63a16b4d req-f31ed3b4-b8ca-4588-946d-ec3c8c67dcca service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:02.480936 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-5b1085de-a89f-40a9-94af-e46c63a16b4d req-f31ed3b4-b8ca-4588-946d-ec3c8c67dcca service nova] Creating event network-vif-plugged:56297d7b-5525-4c45-be7d-f585e2f7374a for instance 0ca394fe-2987-449e-89bf-9dfc44bbd605 on nch2-master-1 Jan 15 21:30:02.485732 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-5b1085de-a89f-40a9-94af-e46c63a16b4d req-f31ed3b4-b8ca-4588-946d-ec3c8c67dcca service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032740 Jan 15 21:30:02.486734 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3597/7204] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:30:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 21:30:02.666168 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-e22693c2-0732-416e-8a1b-9b1c3621f8c5 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Flavor limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 21:30:02.666622 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-e22693c2-0732-416e-8a1b-9b1c3621f8c5 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Image limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 21:30:02.667096 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-e22693c2-0732-416e-8a1b-9b1c3621f8c5 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Flavor pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 21:30:02.667523 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-e22693c2-0732-416e-8a1b-9b1c3621f8c5 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Image pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 21:30:02.667982 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-e22693c2-0732-416e-8a1b-9b1c3621f8c5 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 21:30:02.677343 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e22693c2-0732-416e-8a1b-9b1c3621f8c5 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:02.677733 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e22693c2-0732-416e-8a1b-9b1c3621f8c5 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:02.678552 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e22693c2-0732-416e-8a1b-9b1c3621f8c5 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:02.678986 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e22693c2-0732-416e-8a1b-9b1c3621f8c5 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:02.696173 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-e22693c2-0732-416e-8a1b-9b1c3621f8c5 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Getting quotas for project 92c07aae567b4d718b53dbc4e126c768. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:30:02.701199 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-e22693c2-0732-416e-8a1b-9b1c3621f8c5 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Getting quotas for user bd432681d7da4322a9cb7ec79c016614 and project 92c07aae567b4d718b53dbc4e126c768. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:30:02.713056 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e22693c2-0732-416e-8a1b-9b1c3621f8c5 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Going to run 1 instances... {{(pid=129366) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 21:30:02.715353 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e22693c2-0732-416e-8a1b-9b1c3621f8c5 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] [instance: f8623ab8-cb6d-4127-a85a-6222c7141d72] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 21:30:02.758945 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e22693c2-0732-416e-8a1b-9b1c3621f8c5 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.541751 Jan 15 21:30:02.759605 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3608/7205] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 21:30:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 543 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 21:30:02.771017 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9b9c18b1-37c1-418c-9308-9b3faf142df5 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:30:02.771730 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-9b9c18b1-37c1-418c-9308-9b3faf142df5 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] [instance: f8623ab8-cb6d-4127-a85a-6222c7141d72] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:30:02.824749 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-9b9c18b1-37c1-418c-9308-9b3faf142df5 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd432681d7da4322a9cb7ec79c016614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c07aae567b4d718b53dbc4e126c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:30:02.831602 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-9b9c18b1-37c1-418c-9308-9b3faf142df5 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] 10.222.0.46 "GET /compute/v2.1/servers/f8623ab8-cb6d-4127-a85a-6222c7141d72" status: 200 len: 1218 microversion: 2.1 time: 0.065602 Jan 15 21:30:02.832263 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3598/7206] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:30:02 2022] GET /compute/v2.1/servers/f8623ab8-cb6d-4127-a85a-6222c7141d72 => generated 1218 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:30:03.849638 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9cc2f834-512b-4cbf-be77-2ba07ea69fef tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:30:03.850350 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-9cc2f834-512b-4cbf-be77-2ba07ea69fef tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] [instance: f8623ab8-cb6d-4127-a85a-6222c7141d72] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:30:03.857303 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9cc2f834-512b-4cbf-be77-2ba07ea69fef tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:03.857758 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9cc2f834-512b-4cbf-be77-2ba07ea69fef tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:03.858563 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9cc2f834-512b-4cbf-be77-2ba07ea69fef tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:03.858997 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9cc2f834-512b-4cbf-be77-2ba07ea69fef tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:03.920553 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-9cc2f834-512b-4cbf-be77-2ba07ea69fef tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd432681d7da4322a9cb7ec79c016614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c07aae567b4d718b53dbc4e126c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:30:03.928482 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-9cc2f834-512b-4cbf-be77-2ba07ea69fef tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] 10.222.0.46 "GET /compute/v2.1/servers/f8623ab8-cb6d-4127-a85a-6222c7141d72" status: 200 len: 1276 microversion: 2.1 time: 0.083344 Jan 15 21:30:03.929329 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3609/7207] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:30:03 2022] GET /compute/v2.1/servers/f8623ab8-cb6d-4127-a85a-6222c7141d72 => generated 1276 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:30:04.352745 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-acad370f-5f5a-422b-bf56-67f0bc163ccd req-5786f48b-327c-4f39-81fc-24d7214529b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ca394fe-2987-449e-89bf-9dfc44bbd605", "name": "network-vif-deleted", "tag": "56297d7b-5525-4c45-be7d-f585e2f7374a"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:30:04.355794 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:30:04.355794 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:30:04.367643 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-acad370f-5f5a-422b-bf56-67f0bc163ccd req-5786f48b-327c-4f39-81fc-24d7214529b2 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:04.368588 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-acad370f-5f5a-422b-bf56-67f0bc163ccd req-5786f48b-327c-4f39-81fc-24d7214529b2 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:04.387205 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-acad370f-5f5a-422b-bf56-67f0bc163ccd req-5786f48b-327c-4f39-81fc-24d7214529b2 service nova] Creating event network-vif-deleted:56297d7b-5525-4c45-be7d-f585e2f7374a for instance 0ca394fe-2987-449e-89bf-9dfc44bbd605 on nch2-master-1 Jan 15 21:30:04.392613 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-acad370f-5f5a-422b-bf56-67f0bc163ccd req-5786f48b-327c-4f39-81fc-24d7214529b2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044436 Jan 15 21:30:04.393519 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3599/7208] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:30:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:30:04.947232 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-66479f1a-975a-4b68-b1e4-13984b4ff9cc tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:30:04.948411 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-66479f1a-975a-4b68-b1e4-13984b4ff9cc tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] [instance: f8623ab8-cb6d-4127-a85a-6222c7141d72] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:30:04.956088 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-66479f1a-975a-4b68-b1e4-13984b4ff9cc tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:04.956537 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-66479f1a-975a-4b68-b1e4-13984b4ff9cc tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:04.957344 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-66479f1a-975a-4b68-b1e4-13984b4ff9cc tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:04.957776 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-66479f1a-975a-4b68-b1e4-13984b4ff9cc tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:05.102790 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-66479f1a-975a-4b68-b1e4-13984b4ff9cc tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd432681d7da4322a9cb7ec79c016614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c07aae567b4d718b53dbc4e126c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:30:05.110281 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-66479f1a-975a-4b68-b1e4-13984b4ff9cc tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] 10.222.0.46 "GET /compute/v2.1/servers/f8623ab8-cb6d-4127-a85a-6222c7141d72" status: 200 len: 1318 microversion: 2.1 time: 0.166686 Jan 15 21:30:05.119469 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3610/7209] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:30:04 2022] GET /compute/v2.1/servers/f8623ab8-cb6d-4127-a85a-6222c7141d72 => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:30:06.128284 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5ced01ad-a7cb-45ee-bdff-aa2066fbf43e tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:30:06.129016 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-5ced01ad-a7cb-45ee-bdff-aa2066fbf43e tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] [instance: f8623ab8-cb6d-4127-a85a-6222c7141d72] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:30:06.135270 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5ced01ad-a7cb-45ee-bdff-aa2066fbf43e tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:06.135764 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5ced01ad-a7cb-45ee-bdff-aa2066fbf43e tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:06.136546 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5ced01ad-a7cb-45ee-bdff-aa2066fbf43e tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:06.137028 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5ced01ad-a7cb-45ee-bdff-aa2066fbf43e tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:06.266990 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-5ced01ad-a7cb-45ee-bdff-aa2066fbf43e tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd432681d7da4322a9cb7ec79c016614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c07aae567b4d718b53dbc4e126c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:30:06.274425 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5ced01ad-a7cb-45ee-bdff-aa2066fbf43e tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] 10.222.0.46 "GET /compute/v2.1/servers/f8623ab8-cb6d-4127-a85a-6222c7141d72" status: 200 len: 1318 microversion: 2.1 time: 0.151145 Jan 15 21:30:06.275007 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3600/7210] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:30:06 2022] GET /compute/v2.1/servers/f8623ab8-cb6d-4127-a85a-6222c7141d72 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:30:06.418567 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-8c108fd9-2b15-4c39-ad33-e98e1b413965 req-32dd838a-1e0e-4c3e-b8e4-36d6c1e5d658 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8623ab8-cb6d-4127-a85a-6222c7141d72", "tag": "3b86deb7-4d84-4b73-b2c8-2edafc3ffb0c"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:30:06.420142 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:30:06.420142 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:30:06.427812 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-8c108fd9-2b15-4c39-ad33-e98e1b413965 req-32dd838a-1e0e-4c3e-b8e4-36d6c1e5d658 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:06.428253 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-8c108fd9-2b15-4c39-ad33-e98e1b413965 req-32dd838a-1e0e-4c3e-b8e4-36d6c1e5d658 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:06.438691 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-8c108fd9-2b15-4c39-ad33-e98e1b413965 req-32dd838a-1e0e-4c3e-b8e4-36d6c1e5d658 service nova] Creating event network-changed:3b86deb7-4d84-4b73-b2c8-2edafc3ffb0c for instance f8623ab8-cb6d-4127-a85a-6222c7141d72 on nch1-master-1 Jan 15 21:30:06.443649 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-8c108fd9-2b15-4c39-ad33-e98e1b413965 req-32dd838a-1e0e-4c3e-b8e4-36d6c1e5d658 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028649 Jan 15 21:30:06.444237 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3611/7211] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:30:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:30:07.292401 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f62e6474-33a0-4625-bdbb-5d70a649e996 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:30:07.293036 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f62e6474-33a0-4625-bdbb-5d70a649e996 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] [instance: f8623ab8-cb6d-4127-a85a-6222c7141d72] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:30:07.300626 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f62e6474-33a0-4625-bdbb-5d70a649e996 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:07.301111 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f62e6474-33a0-4625-bdbb-5d70a649e996 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:07.301906 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f62e6474-33a0-4625-bdbb-5d70a649e996 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:07.302354 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f62e6474-33a0-4625-bdbb-5d70a649e996 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:07.432343 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-f62e6474-33a0-4625-bdbb-5d70a649e996 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd432681d7da4322a9cb7ec79c016614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c07aae567b4d718b53dbc4e126c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:30:07.440315 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f62e6474-33a0-4625-bdbb-5d70a649e996 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] 10.222.0.46 "GET /compute/v2.1/servers/f8623ab8-cb6d-4127-a85a-6222c7141d72" status: 200 len: 1318 microversion: 2.1 time: 0.151904 Jan 15 21:30:07.440899 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3601/7212] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:30:07 2022] GET /compute/v2.1/servers/f8623ab8-cb6d-4127-a85a-6222c7141d72 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:30:08.459141 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a9f8f2d1-182c-4c55-b571-73d87fb33a50 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:30:08.459842 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a9f8f2d1-182c-4c55-b571-73d87fb33a50 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] [instance: f8623ab8-cb6d-4127-a85a-6222c7141d72] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:30:08.465979 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a9f8f2d1-182c-4c55-b571-73d87fb33a50 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:08.466431 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a9f8f2d1-182c-4c55-b571-73d87fb33a50 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:08.467205 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a9f8f2d1-182c-4c55-b571-73d87fb33a50 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:08.467638 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a9f8f2d1-182c-4c55-b571-73d87fb33a50 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:08.602366 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-a9f8f2d1-182c-4c55-b571-73d87fb33a50 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd432681d7da4322a9cb7ec79c016614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c07aae567b4d718b53dbc4e126c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:30:08.609666 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a9f8f2d1-182c-4c55-b571-73d87fb33a50 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] 10.222.0.46 "GET /compute/v2.1/servers/f8623ab8-cb6d-4127-a85a-6222c7141d72" status: 200 len: 1318 microversion: 2.1 time: 0.156163 Jan 15 21:30:08.610234 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3612/7213] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:30:08 2022] GET /compute/v2.1/servers/f8623ab8-cb6d-4127-a85a-6222c7141d72 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:30:09.626398 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c4cdea2a-c632-4722-a911-f09f7675ba97 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:30:09.627013 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c4cdea2a-c632-4722-a911-f09f7675ba97 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] [instance: f8623ab8-cb6d-4127-a85a-6222c7141d72] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:30:09.634148 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c4cdea2a-c632-4722-a911-f09f7675ba97 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:09.634631 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c4cdea2a-c632-4722-a911-f09f7675ba97 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:09.635475 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c4cdea2a-c632-4722-a911-f09f7675ba97 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:09.635945 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c4cdea2a-c632-4722-a911-f09f7675ba97 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:09.765768 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-c4cdea2a-c632-4722-a911-f09f7675ba97 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd432681d7da4322a9cb7ec79c016614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c07aae567b4d718b53dbc4e126c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:30:09.773760 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c4cdea2a-c632-4722-a911-f09f7675ba97 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] 10.222.0.46 "GET /compute/v2.1/servers/f8623ab8-cb6d-4127-a85a-6222c7141d72" status: 200 len: 1318 microversion: 2.1 time: 0.151098 Jan 15 21:30:09.774333 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3602/7214] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:30:09 2022] GET /compute/v2.1/servers/f8623ab8-cb6d-4127-a85a-6222c7141d72 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:30:10.790720 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f3600988-ec60-440f-8858-257dc97a9648 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:30:10.791945 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f3600988-ec60-440f-8858-257dc97a9648 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] [instance: f8623ab8-cb6d-4127-a85a-6222c7141d72] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:30:10.798746 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f3600988-ec60-440f-8858-257dc97a9648 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:10.799206 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f3600988-ec60-440f-8858-257dc97a9648 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:10.800558 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f3600988-ec60-440f-8858-257dc97a9648 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:10.801033 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f3600988-ec60-440f-8858-257dc97a9648 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:10.938029 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-f3600988-ec60-440f-8858-257dc97a9648 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd432681d7da4322a9cb7ec79c016614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c07aae567b4d718b53dbc4e126c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:30:10.946544 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f3600988-ec60-440f-8858-257dc97a9648 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] 10.222.0.46 "GET /compute/v2.1/servers/f8623ab8-cb6d-4127-a85a-6222c7141d72" status: 200 len: 1318 microversion: 2.1 time: 0.159452 Jan 15 21:30:10.947142 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3613/7215] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:30:10 2022] GET /compute/v2.1/servers/f8623ab8-cb6d-4127-a85a-6222c7141d72 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:30:10.964111 ncdv-master-1 devstack@n-api.service[129366]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 15 21:30:10.964365 ncdv-master-1 devstack@n-api.service[129366]: Sat Jan 15 21:30:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 15 21:30:11.098579 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-a00e74cb-a105-463d-8377-f41b3d1849b7 req-69834f1f-0831-427c-bf53-a3f88e017a6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8623ab8-cb6d-4127-a85a-6222c7141d72", "name": "network-vif-plugged", "status": "completed", "tag": "3b86deb7-4d84-4b73-b2c8-2edafc3ffb0c"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:30:11.100273 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:30:11.100273 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:30:11.110019 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-a00e74cb-a105-463d-8377-f41b3d1849b7 req-69834f1f-0831-427c-bf53-a3f88e017a6d service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:11.110479 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-a00e74cb-a105-463d-8377-f41b3d1849b7 req-69834f1f-0831-427c-bf53-a3f88e017a6d service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:11.122628 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-a00e74cb-a105-463d-8377-f41b3d1849b7 req-69834f1f-0831-427c-bf53-a3f88e017a6d service nova] Creating event network-vif-plugged:3b86deb7-4d84-4b73-b2c8-2edafc3ffb0c for instance f8623ab8-cb6d-4127-a85a-6222c7141d72 on nch1-master-1 Jan 15 21:30:11.128149 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-a00e74cb-a105-463d-8377-f41b3d1849b7 req-69834f1f-0831-427c-bf53-a3f88e017a6d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032727 Jan 15 21:30:11.128964 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3603/7216] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:30:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:30:11.963434 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-cc2601a7-4eee-4d9e-83ce-540cc00284e8 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:30:11.964035 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-cc2601a7-4eee-4d9e-83ce-540cc00284e8 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] [instance: f8623ab8-cb6d-4127-a85a-6222c7141d72] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:30:11.971889 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cc2601a7-4eee-4d9e-83ce-540cc00284e8 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:11.972346 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cc2601a7-4eee-4d9e-83ce-540cc00284e8 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:11.973156 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cc2601a7-4eee-4d9e-83ce-540cc00284e8 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:11.973595 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cc2601a7-4eee-4d9e-83ce-540cc00284e8 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:12.186291 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-cc2601a7-4eee-4d9e-83ce-540cc00284e8 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd432681d7da4322a9cb7ec79c016614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c07aae567b4d718b53dbc4e126c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:30:12.193663 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-cc2601a7-4eee-4d9e-83ce-540cc00284e8 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] 10.222.0.46 "GET /compute/v2.1/servers/f8623ab8-cb6d-4127-a85a-6222c7141d72" status: 200 len: 1318 microversion: 2.1 time: 0.233969 Jan 15 21:30:12.194236 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3614/7217] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:30:11 2022] GET /compute/v2.1/servers/f8623ab8-cb6d-4127-a85a-6222c7141d72 => generated 1318 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:30:13.211838 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-403b748f-814e-4c83-a78e-599c343b9f8c tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:30:13.212549 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-403b748f-814e-4c83-a78e-599c343b9f8c tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] [instance: f8623ab8-cb6d-4127-a85a-6222c7141d72] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:30:13.220361 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-403b748f-814e-4c83-a78e-599c343b9f8c tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:13.220822 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-403b748f-814e-4c83-a78e-599c343b9f8c tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:13.222785 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-403b748f-814e-4c83-a78e-599c343b9f8c tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:13.223232 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-403b748f-814e-4c83-a78e-599c343b9f8c tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:13.415658 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-403b748f-814e-4c83-a78e-599c343b9f8c tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd432681d7da4322a9cb7ec79c016614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c07aae567b4d718b53dbc4e126c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:30:13.423040 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-403b748f-814e-4c83-a78e-599c343b9f8c tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] 10.222.0.46 "GET /compute/v2.1/servers/f8623ab8-cb6d-4127-a85a-6222c7141d72" status: 200 len: 1508 microversion: 2.1 time: 0.215307 Jan 15 21:30:13.423606 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3604/7218] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:30:13 2022] GET /compute/v2.1/servers/f8623ab8-cb6d-4127-a85a-6222c7141d72 => generated 1508 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:30:13.438639 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0efe7e7d-50cb-434b-a2bd-72592a4473c9 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:30:13.439232 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-0efe7e7d-50cb-434b-a2bd-72592a4473c9 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] [instance: f8623ab8-cb6d-4127-a85a-6222c7141d72] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:30:13.446763 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0efe7e7d-50cb-434b-a2bd-72592a4473c9 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:13.447463 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0efe7e7d-50cb-434b-a2bd-72592a4473c9 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:13.449004 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0efe7e7d-50cb-434b-a2bd-72592a4473c9 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:13.449786 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0efe7e7d-50cb-434b-a2bd-72592a4473c9 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:13.585299 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-0efe7e7d-50cb-434b-a2bd-72592a4473c9 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd432681d7da4322a9cb7ec79c016614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c07aae567b4d718b53dbc4e126c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:30:13.592794 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0efe7e7d-50cb-434b-a2bd-72592a4473c9 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] 10.222.0.46 "GET /compute/v2.1/servers/f8623ab8-cb6d-4127-a85a-6222c7141d72" status: 200 len: 1508 microversion: 2.1 time: 0.157728 Jan 15 21:30:13.593448 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3615/7219] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:30:13 2022] GET /compute/v2.1/servers/f8623ab8-cb6d-4127-a85a-6222c7141d72 => generated 1508 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:30:13.608671 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b1cd10d9-2c89-4015-9b93-1718332846c1 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:30:13.609688 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b1cd10d9-2c89-4015-9b93-1718332846c1 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] [instance: f8623ab8-cb6d-4127-a85a-6222c7141d72] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:30:13.616206 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b1cd10d9-2c89-4015-9b93-1718332846c1 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:13.616671 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b1cd10d9-2c89-4015-9b93-1718332846c1 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:13.617485 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b1cd10d9-2c89-4015-9b93-1718332846c1 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:13.617934 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b1cd10d9-2c89-4015-9b93-1718332846c1 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:13.646349 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-b1cd10d9-2c89-4015-9b93-1718332846c1 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'bd432681d7da4322a9cb7ec79c016614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c07aae567b4d718b53dbc4e126c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:30:13.653297 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b1cd10d9-2c89-4015-9b93-1718332846c1 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] [instance: f8623ab8-cb6d-4127-a85a-6222c7141d72] Old instance type m1.heat2, new instance type m1.heat {{(pid=129365) resize /opt/stack/nova/nova/compute/api.py:4097}} Jan 15 21:30:13.659984 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-b1cd10d9-2c89-4015-9b93-1718332846c1 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Flavor limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 21:30:13.660407 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-b1cd10d9-2c89-4015-9b93-1718332846c1 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Image limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 21:30:13.660915 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-b1cd10d9-2c89-4015-9b93-1718332846c1 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Flavor pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 21:30:13.661333 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-b1cd10d9-2c89-4015-9b93-1718332846c1 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Image pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 21:30:13.661746 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-b1cd10d9-2c89-4015-9b93-1718332846c1 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 21:30:13.723816 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b1cd10d9-2c89-4015-9b93-1718332846c1 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] 10.222.0.46 "POST /compute/v2.1/servers/f8623ab8-cb6d-4127-a85a-6222c7141d72/action" status: 202 len: 0 microversion: 2.1 time: 0.118789 Jan 15 21:30:13.724429 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3605/7220] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:30:13 2022] POST /compute/v2.1/servers/f8623ab8-cb6d-4127-a85a-6222c7141d72/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:30:13.732295 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-cec67b9f-3fe4-4d69-983f-e17156bfff26 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:30:13.732928 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-cec67b9f-3fe4-4d69-983f-e17156bfff26 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] [instance: f8623ab8-cb6d-4127-a85a-6222c7141d72] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:30:13.739558 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cec67b9f-3fe4-4d69-983f-e17156bfff26 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:13.740010 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cec67b9f-3fe4-4d69-983f-e17156bfff26 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:13.740798 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cec67b9f-3fe4-4d69-983f-e17156bfff26 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:13.741275 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cec67b9f-3fe4-4d69-983f-e17156bfff26 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:13.900896 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-cec67b9f-3fe4-4d69-983f-e17156bfff26 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd432681d7da4322a9cb7ec79c016614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c07aae567b4d718b53dbc4e126c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:30:13.908916 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-cec67b9f-3fe4-4d69-983f-e17156bfff26 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] 10.222.0.46 "GET /compute/v2.1/servers/f8623ab8-cb6d-4127-a85a-6222c7141d72" status: 200 len: 1515 microversion: 2.1 time: 0.180208 Jan 15 21:30:13.909661 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3616/7221] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:30:13 2022] GET /compute/v2.1/servers/f8623ab8-cb6d-4127-a85a-6222c7141d72 => generated 1515 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:30:14.927205 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-483fd345-bd16-40e9-b132-34e395040f6a tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:30:14.927840 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-483fd345-bd16-40e9-b132-34e395040f6a tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] [instance: f8623ab8-cb6d-4127-a85a-6222c7141d72] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:30:14.933854 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-483fd345-bd16-40e9-b132-34e395040f6a tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:14.934327 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-483fd345-bd16-40e9-b132-34e395040f6a tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:14.935122 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-483fd345-bd16-40e9-b132-34e395040f6a tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:14.935568 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-483fd345-bd16-40e9-b132-34e395040f6a tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:15.076532 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-483fd345-bd16-40e9-b132-34e395040f6a tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd432681d7da4322a9cb7ec79c016614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c07aae567b4d718b53dbc4e126c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:30:15.084676 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-483fd345-bd16-40e9-b132-34e395040f6a tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] 10.222.0.46 "GET /compute/v2.1/servers/f8623ab8-cb6d-4127-a85a-6222c7141d72" status: 200 len: 1515 microversion: 2.1 time: 0.162158 Jan 15 21:30:15.085295 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3606/7222] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:30:14 2022] GET /compute/v2.1/servers/f8623ab8-cb6d-4127-a85a-6222c7141d72 => generated 1515 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:30:16.102188 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-6d056848-8c09-4795-98ea-02ba20edc52f tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:30:16.102791 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-6d056848-8c09-4795-98ea-02ba20edc52f tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] [instance: f8623ab8-cb6d-4127-a85a-6222c7141d72] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:30:16.109563 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6d056848-8c09-4795-98ea-02ba20edc52f tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:16.110240 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6d056848-8c09-4795-98ea-02ba20edc52f tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:16.111036 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6d056848-8c09-4795-98ea-02ba20edc52f tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:16.111481 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6d056848-8c09-4795-98ea-02ba20edc52f tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:16.245930 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-6d056848-8c09-4795-98ea-02ba20edc52f tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd432681d7da4322a9cb7ec79c016614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c07aae567b4d718b53dbc4e126c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:30:16.253400 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-6d056848-8c09-4795-98ea-02ba20edc52f tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] 10.222.0.46 "GET /compute/v2.1/servers/f8623ab8-cb6d-4127-a85a-6222c7141d72" status: 200 len: 1520 microversion: 2.1 time: 0.154891 Jan 15 21:30:16.253983 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3617/7223] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:30:16 2022] GET /compute/v2.1/servers/f8623ab8-cb6d-4127-a85a-6222c7141d72 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:30:17.271757 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c7f9caeb-bb39-445f-b46f-44c3f3e262ce tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:30:17.272356 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c7f9caeb-bb39-445f-b46f-44c3f3e262ce tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] [instance: f8623ab8-cb6d-4127-a85a-6222c7141d72] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:30:17.279085 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c7f9caeb-bb39-445f-b46f-44c3f3e262ce tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:17.279540 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c7f9caeb-bb39-445f-b46f-44c3f3e262ce tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:17.280320 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c7f9caeb-bb39-445f-b46f-44c3f3e262ce tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:17.280760 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c7f9caeb-bb39-445f-b46f-44c3f3e262ce tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:17.418112 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-c7f9caeb-bb39-445f-b46f-44c3f3e262ce tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd432681d7da4322a9cb7ec79c016614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c07aae567b4d718b53dbc4e126c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:30:17.426229 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c7f9caeb-bb39-445f-b46f-44c3f3e262ce tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] 10.222.0.46 "GET /compute/v2.1/servers/f8623ab8-cb6d-4127-a85a-6222c7141d72" status: 200 len: 1520 microversion: 2.1 time: 0.158327 Jan 15 21:30:17.426793 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3607/7224] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:30:17 2022] GET /compute/v2.1/servers/f8623ab8-cb6d-4127-a85a-6222c7141d72 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:30:18.443200 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ad15e73e-a305-44ce-aa1b-f1cb960966dd tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:30:18.443814 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ad15e73e-a305-44ce-aa1b-f1cb960966dd tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] [instance: f8623ab8-cb6d-4127-a85a-6222c7141d72] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:30:18.450549 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ad15e73e-a305-44ce-aa1b-f1cb960966dd tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:18.450989 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ad15e73e-a305-44ce-aa1b-f1cb960966dd tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:18.451770 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ad15e73e-a305-44ce-aa1b-f1cb960966dd tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:18.452212 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ad15e73e-a305-44ce-aa1b-f1cb960966dd tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:18.583678 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-ad15e73e-a305-44ce-aa1b-f1cb960966dd tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd432681d7da4322a9cb7ec79c016614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c07aae567b4d718b53dbc4e126c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:30:18.591079 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ad15e73e-a305-44ce-aa1b-f1cb960966dd tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] 10.222.0.46 "GET /compute/v2.1/servers/f8623ab8-cb6d-4127-a85a-6222c7141d72" status: 200 len: 1520 microversion: 2.1 time: 0.151681 Jan 15 21:30:18.591645 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3618/7225] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:30:18 2022] GET /compute/v2.1/servers/f8623ab8-cb6d-4127-a85a-6222c7141d72 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:30:19.608567 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-026a39cc-9cab-4822-850d-1ac2450147a1 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:30:19.609219 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-026a39cc-9cab-4822-850d-1ac2450147a1 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] [instance: f8623ab8-cb6d-4127-a85a-6222c7141d72] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:30:19.616958 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-026a39cc-9cab-4822-850d-1ac2450147a1 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:19.617414 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-026a39cc-9cab-4822-850d-1ac2450147a1 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:19.618194 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-026a39cc-9cab-4822-850d-1ac2450147a1 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:19.618634 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-026a39cc-9cab-4822-850d-1ac2450147a1 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:19.753371 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-026a39cc-9cab-4822-850d-1ac2450147a1 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd432681d7da4322a9cb7ec79c016614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c07aae567b4d718b53dbc4e126c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:30:19.760621 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-026a39cc-9cab-4822-850d-1ac2450147a1 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] 10.222.0.46 "GET /compute/v2.1/servers/f8623ab8-cb6d-4127-a85a-6222c7141d72" status: 200 len: 1520 microversion: 2.1 time: 0.155726 Jan 15 21:30:19.761214 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3608/7226] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:30:19 2022] GET /compute/v2.1/servers/f8623ab8-cb6d-4127-a85a-6222c7141d72 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:30:20.777675 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-605d0991-bcb8-4ba2-bf84-102cec5defd4 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:30:20.778293 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-605d0991-bcb8-4ba2-bf84-102cec5defd4 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] [instance: f8623ab8-cb6d-4127-a85a-6222c7141d72] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:30:20.785867 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-605d0991-bcb8-4ba2-bf84-102cec5defd4 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:20.786330 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-605d0991-bcb8-4ba2-bf84-102cec5defd4 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:20.787116 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-605d0991-bcb8-4ba2-bf84-102cec5defd4 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:20.787558 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-605d0991-bcb8-4ba2-bf84-102cec5defd4 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:20.915279 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-605d0991-bcb8-4ba2-bf84-102cec5defd4 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd432681d7da4322a9cb7ec79c016614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c07aae567b4d718b53dbc4e126c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:30:20.922656 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-605d0991-bcb8-4ba2-bf84-102cec5defd4 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] 10.222.0.46 "GET /compute/v2.1/servers/f8623ab8-cb6d-4127-a85a-6222c7141d72" status: 200 len: 1520 microversion: 2.1 time: 0.148943 Jan 15 21:30:20.923174 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3619/7227] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:30:20 2022] GET /compute/v2.1/servers/f8623ab8-cb6d-4127-a85a-6222c7141d72 => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:30:21.939579 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-773be16e-ab8c-4181-89d3-0a81aab72cab tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:30:21.940733 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-773be16e-ab8c-4181-89d3-0a81aab72cab tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] [instance: f8623ab8-cb6d-4127-a85a-6222c7141d72] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:30:21.947496 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-773be16e-ab8c-4181-89d3-0a81aab72cab tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:21.947950 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-773be16e-ab8c-4181-89d3-0a81aab72cab tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:21.948726 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-773be16e-ab8c-4181-89d3-0a81aab72cab tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:21.949194 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-773be16e-ab8c-4181-89d3-0a81aab72cab tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:22.082634 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-773be16e-ab8c-4181-89d3-0a81aab72cab tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd432681d7da4322a9cb7ec79c016614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c07aae567b4d718b53dbc4e126c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:30:22.090369 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-773be16e-ab8c-4181-89d3-0a81aab72cab tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] 10.222.0.46 "GET /compute/v2.1/servers/f8623ab8-cb6d-4127-a85a-6222c7141d72" status: 200 len: 1520 microversion: 2.1 time: 0.154407 Jan 15 21:30:22.090950 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3609/7228] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:30:21 2022] GET /compute/v2.1/servers/f8623ab8-cb6d-4127-a85a-6222c7141d72 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:30:23.107282 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-3040eac5-d996-4918-bc09-699c298f1758 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:30:23.107928 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-3040eac5-d996-4918-bc09-699c298f1758 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] [instance: f8623ab8-cb6d-4127-a85a-6222c7141d72] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:30:23.115527 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3040eac5-d996-4918-bc09-699c298f1758 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:23.116008 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3040eac5-d996-4918-bc09-699c298f1758 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:23.116787 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3040eac5-d996-4918-bc09-699c298f1758 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:23.117245 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3040eac5-d996-4918-bc09-699c298f1758 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:23.244870 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-3040eac5-d996-4918-bc09-699c298f1758 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd432681d7da4322a9cb7ec79c016614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c07aae567b4d718b53dbc4e126c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:30:23.252165 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-3040eac5-d996-4918-bc09-699c298f1758 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] 10.222.0.46 "GET /compute/v2.1/servers/f8623ab8-cb6d-4127-a85a-6222c7141d72" status: 200 len: 1520 microversion: 2.1 time: 0.148751 Jan 15 21:30:23.253306 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3620/7229] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:30:23 2022] GET /compute/v2.1/servers/f8623ab8-cb6d-4127-a85a-6222c7141d72 => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:30:24.269530 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-cc7af91e-7e53-4709-8813-94f8d0480b3d tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:30:24.270154 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-cc7af91e-7e53-4709-8813-94f8d0480b3d tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] [instance: f8623ab8-cb6d-4127-a85a-6222c7141d72] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:30:24.277497 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cc7af91e-7e53-4709-8813-94f8d0480b3d tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:24.277964 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cc7af91e-7e53-4709-8813-94f8d0480b3d tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:24.278764 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cc7af91e-7e53-4709-8813-94f8d0480b3d tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:24.279221 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cc7af91e-7e53-4709-8813-94f8d0480b3d tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:24.412536 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-cc7af91e-7e53-4709-8813-94f8d0480b3d tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd432681d7da4322a9cb7ec79c016614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c07aae567b4d718b53dbc4e126c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:30:24.420206 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-cc7af91e-7e53-4709-8813-94f8d0480b3d tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] 10.222.0.46 "GET /compute/v2.1/servers/f8623ab8-cb6d-4127-a85a-6222c7141d72" status: 200 len: 1520 microversion: 2.1 time: 0.155067 Jan 15 21:30:24.420783 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3610/7230] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:30:24 2022] GET /compute/v2.1/servers/f8623ab8-cb6d-4127-a85a-6222c7141d72 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:30:25.437807 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a0a874b8-10cb-4b31-93bf-fcaee17d6897 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:30:25.438408 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a0a874b8-10cb-4b31-93bf-fcaee17d6897 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] [instance: f8623ab8-cb6d-4127-a85a-6222c7141d72] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:30:25.445216 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a0a874b8-10cb-4b31-93bf-fcaee17d6897 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:25.445661 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a0a874b8-10cb-4b31-93bf-fcaee17d6897 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:25.446433 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a0a874b8-10cb-4b31-93bf-fcaee17d6897 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:25.446864 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a0a874b8-10cb-4b31-93bf-fcaee17d6897 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:25.827599 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-a0a874b8-10cb-4b31-93bf-fcaee17d6897 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd432681d7da4322a9cb7ec79c016614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c07aae567b4d718b53dbc4e126c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:30:25.837435 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a0a874b8-10cb-4b31-93bf-fcaee17d6897 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] 10.222.0.46 "GET /compute/v2.1/servers/f8623ab8-cb6d-4127-a85a-6222c7141d72" status: 200 len: 1520 microversion: 2.1 time: 0.403268 Jan 15 21:30:25.838269 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3621/7231] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:30:25 2022] GET /compute/v2.1/servers/f8623ab8-cb6d-4127-a85a-6222c7141d72 => generated 1520 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:30:26.854982 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-fd04dac8-95c6-4674-880e-3084462f2e98 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:30:26.855601 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-fd04dac8-95c6-4674-880e-3084462f2e98 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] [instance: f8623ab8-cb6d-4127-a85a-6222c7141d72] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:30:26.862695 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fd04dac8-95c6-4674-880e-3084462f2e98 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:26.863153 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fd04dac8-95c6-4674-880e-3084462f2e98 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:26.863969 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fd04dac8-95c6-4674-880e-3084462f2e98 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:26.864410 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fd04dac8-95c6-4674-880e-3084462f2e98 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:26.991980 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-fd04dac8-95c6-4674-880e-3084462f2e98 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd432681d7da4322a9cb7ec79c016614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c07aae567b4d718b53dbc4e126c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:30:26.999378 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-fd04dac8-95c6-4674-880e-3084462f2e98 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] 10.222.0.46 "GET /compute/v2.1/servers/f8623ab8-cb6d-4127-a85a-6222c7141d72" status: 200 len: 1520 microversion: 2.1 time: 0.148199 Jan 15 21:30:26.999944 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3611/7232] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:30:26 2022] GET /compute/v2.1/servers/f8623ab8-cb6d-4127-a85a-6222c7141d72 => generated 1520 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:30:28.016241 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-58e6c478-d2b8-4f3b-bc75-452d73ba52f5 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:30:28.016867 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-58e6c478-d2b8-4f3b-bc75-452d73ba52f5 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] [instance: f8623ab8-cb6d-4127-a85a-6222c7141d72] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:30:28.023853 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-58e6c478-d2b8-4f3b-bc75-452d73ba52f5 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:28.024304 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-58e6c478-d2b8-4f3b-bc75-452d73ba52f5 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:28.025136 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-58e6c478-d2b8-4f3b-bc75-452d73ba52f5 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:28.025574 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-58e6c478-d2b8-4f3b-bc75-452d73ba52f5 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:28.159859 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-58e6c478-d2b8-4f3b-bc75-452d73ba52f5 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd432681d7da4322a9cb7ec79c016614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c07aae567b4d718b53dbc4e126c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:30:28.167348 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-58e6c478-d2b8-4f3b-bc75-452d73ba52f5 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] 10.222.0.46 "GET /compute/v2.1/servers/f8623ab8-cb6d-4127-a85a-6222c7141d72" status: 200 len: 1520 microversion: 2.1 time: 0.154829 Jan 15 21:30:28.167926 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3622/7233] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:30:28 2022] GET /compute/v2.1/servers/f8623ab8-cb6d-4127-a85a-6222c7141d72 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:30:29.184177 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9db7d8c7-04ce-4e5e-9547-8708caad064f tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:30:29.184829 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-9db7d8c7-04ce-4e5e-9547-8708caad064f tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] [instance: f8623ab8-cb6d-4127-a85a-6222c7141d72] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:30:29.192481 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9db7d8c7-04ce-4e5e-9547-8708caad064f tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:29.193099 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9db7d8c7-04ce-4e5e-9547-8708caad064f tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:29.193905 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9db7d8c7-04ce-4e5e-9547-8708caad064f tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:29.194361 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9db7d8c7-04ce-4e5e-9547-8708caad064f tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:29.323671 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-9db7d8c7-04ce-4e5e-9547-8708caad064f tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd432681d7da4322a9cb7ec79c016614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c07aae567b4d718b53dbc4e126c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:30:29.330994 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-9db7d8c7-04ce-4e5e-9547-8708caad064f tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] 10.222.0.46 "GET /compute/v2.1/servers/f8623ab8-cb6d-4127-a85a-6222c7141d72" status: 200 len: 1520 microversion: 2.1 time: 0.150496 Jan 15 21:30:29.331562 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3612/7234] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:30:29 2022] GET /compute/v2.1/servers/f8623ab8-cb6d-4127-a85a-6222c7141d72 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:30:30.347920 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-2b2ea0ea-1c3e-4af1-af96-3df1efbdd36c tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:30:30.348520 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-2b2ea0ea-1c3e-4af1-af96-3df1efbdd36c tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] [instance: f8623ab8-cb6d-4127-a85a-6222c7141d72] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:30:30.355684 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2b2ea0ea-1c3e-4af1-af96-3df1efbdd36c tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:30.356189 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2b2ea0ea-1c3e-4af1-af96-3df1efbdd36c tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:30.357133 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2b2ea0ea-1c3e-4af1-af96-3df1efbdd36c tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:30.357775 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2b2ea0ea-1c3e-4af1-af96-3df1efbdd36c tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:30.490274 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-2b2ea0ea-1c3e-4af1-af96-3df1efbdd36c tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd432681d7da4322a9cb7ec79c016614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c07aae567b4d718b53dbc4e126c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:30:30.497584 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-2b2ea0ea-1c3e-4af1-af96-3df1efbdd36c tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] 10.222.0.46 "GET /compute/v2.1/servers/f8623ab8-cb6d-4127-a85a-6222c7141d72" status: 200 len: 1520 microversion: 2.1 time: 0.153485 Jan 15 21:30:30.498158 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3623/7235] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:30:30 2022] GET /compute/v2.1/servers/f8623ab8-cb6d-4127-a85a-6222c7141d72 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:30:31.514654 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3e43d1ac-1c9a-4869-b700-77cbcf1bc080 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:30:31.515278 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-3e43d1ac-1c9a-4869-b700-77cbcf1bc080 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] [instance: f8623ab8-cb6d-4127-a85a-6222c7141d72] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:30:31.523228 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3e43d1ac-1c9a-4869-b700-77cbcf1bc080 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:31.523693 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3e43d1ac-1c9a-4869-b700-77cbcf1bc080 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:31.524608 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3e43d1ac-1c9a-4869-b700-77cbcf1bc080 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:31.525084 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3e43d1ac-1c9a-4869-b700-77cbcf1bc080 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:31.657065 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-3e43d1ac-1c9a-4869-b700-77cbcf1bc080 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd432681d7da4322a9cb7ec79c016614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c07aae567b4d718b53dbc4e126c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:30:31.665044 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3e43d1ac-1c9a-4869-b700-77cbcf1bc080 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] 10.222.0.46 "GET /compute/v2.1/servers/f8623ab8-cb6d-4127-a85a-6222c7141d72" status: 200 len: 1520 microversion: 2.1 time: 0.154013 Jan 15 21:30:31.665633 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3613/7236] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:30:31 2022] GET /compute/v2.1/servers/f8623ab8-cb6d-4127-a85a-6222c7141d72 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:30:32.682664 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-83f39c5f-7414-4e88-90d7-dc0b4bab2282 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:30:32.683264 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-83f39c5f-7414-4e88-90d7-dc0b4bab2282 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] [instance: f8623ab8-cb6d-4127-a85a-6222c7141d72] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:30:32.691110 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-83f39c5f-7414-4e88-90d7-dc0b4bab2282 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:32.691558 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-83f39c5f-7414-4e88-90d7-dc0b4bab2282 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:32.692535 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-83f39c5f-7414-4e88-90d7-dc0b4bab2282 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:32.693013 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-83f39c5f-7414-4e88-90d7-dc0b4bab2282 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:32.824608 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-83f39c5f-7414-4e88-90d7-dc0b4bab2282 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd432681d7da4322a9cb7ec79c016614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c07aae567b4d718b53dbc4e126c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:30:32.832351 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-83f39c5f-7414-4e88-90d7-dc0b4bab2282 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] 10.222.0.46 "GET /compute/v2.1/servers/f8623ab8-cb6d-4127-a85a-6222c7141d72" status: 200 len: 1520 microversion: 2.1 time: 0.153474 Jan 15 21:30:32.832942 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3624/7237] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:30:32 2022] GET /compute/v2.1/servers/f8623ab8-cb6d-4127-a85a-6222c7141d72 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:30:33.849404 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-04e94083-de25-4a76-99f8-d41e57d29f0b tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:30:33.850043 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-04e94083-de25-4a76-99f8-d41e57d29f0b tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] [instance: f8623ab8-cb6d-4127-a85a-6222c7141d72] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:30:33.856700 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-04e94083-de25-4a76-99f8-d41e57d29f0b tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:33.857187 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-04e94083-de25-4a76-99f8-d41e57d29f0b tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:33.857977 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-04e94083-de25-4a76-99f8-d41e57d29f0b tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:33.858418 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-04e94083-de25-4a76-99f8-d41e57d29f0b tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:33.994371 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-04e94083-de25-4a76-99f8-d41e57d29f0b tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd432681d7da4322a9cb7ec79c016614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c07aae567b4d718b53dbc4e126c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:30:34.001662 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-04e94083-de25-4a76-99f8-d41e57d29f0b tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] 10.222.0.46 "GET /compute/v2.1/servers/f8623ab8-cb6d-4127-a85a-6222c7141d72" status: 200 len: 1520 microversion: 2.1 time: 0.155955 Jan 15 21:30:34.002234 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3614/7238] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:30:33 2022] GET /compute/v2.1/servers/f8623ab8-cb6d-4127-a85a-6222c7141d72 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:30:35.020219 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d2d8ebfd-8be8-494e-8a30-d27c7f767f5f tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:30:35.020874 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-d2d8ebfd-8be8-494e-8a30-d27c7f767f5f tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] [instance: f8623ab8-cb6d-4127-a85a-6222c7141d72] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:30:35.027565 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d2d8ebfd-8be8-494e-8a30-d27c7f767f5f tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:35.028010 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d2d8ebfd-8be8-494e-8a30-d27c7f767f5f tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:35.028775 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d2d8ebfd-8be8-494e-8a30-d27c7f767f5f tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:35.029592 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d2d8ebfd-8be8-494e-8a30-d27c7f767f5f tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:35.159539 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-d2d8ebfd-8be8-494e-8a30-d27c7f767f5f tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd432681d7da4322a9cb7ec79c016614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c07aae567b4d718b53dbc4e126c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:30:35.166919 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d2d8ebfd-8be8-494e-8a30-d27c7f767f5f tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] 10.222.0.46 "GET /compute/v2.1/servers/f8623ab8-cb6d-4127-a85a-6222c7141d72" status: 200 len: 1520 microversion: 2.1 time: 0.151202 Jan 15 21:30:35.167489 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3625/7239] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:30:35 2022] GET /compute/v2.1/servers/f8623ab8-cb6d-4127-a85a-6222c7141d72 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:30:36.184521 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-6d30cd19-dff1-47db-bc44-e1445cfe1e0e tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:30:36.185161 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-6d30cd19-dff1-47db-bc44-e1445cfe1e0e tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] [instance: f8623ab8-cb6d-4127-a85a-6222c7141d72] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:30:36.192162 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6d30cd19-dff1-47db-bc44-e1445cfe1e0e tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:36.192620 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6d30cd19-dff1-47db-bc44-e1445cfe1e0e tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:36.193430 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6d30cd19-dff1-47db-bc44-e1445cfe1e0e tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:36.193876 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6d30cd19-dff1-47db-bc44-e1445cfe1e0e tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:36.328760 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-6d30cd19-dff1-47db-bc44-e1445cfe1e0e tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd432681d7da4322a9cb7ec79c016614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c07aae567b4d718b53dbc4e126c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:30:36.336356 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-6d30cd19-dff1-47db-bc44-e1445cfe1e0e tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] 10.222.0.46 "GET /compute/v2.1/servers/f8623ab8-cb6d-4127-a85a-6222c7141d72" status: 200 len: 1520 microversion: 2.1 time: 0.155576 Jan 15 21:30:36.336992 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3615/7240] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:30:36 2022] GET /compute/v2.1/servers/f8623ab8-cb6d-4127-a85a-6222c7141d72 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:30:37.352799 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-3d7608c9-55ac-4dda-a8f6-6b8790ca45a1 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:30:37.353487 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-3d7608c9-55ac-4dda-a8f6-6b8790ca45a1 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] [instance: f8623ab8-cb6d-4127-a85a-6222c7141d72] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:30:37.360747 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3d7608c9-55ac-4dda-a8f6-6b8790ca45a1 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:37.361227 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3d7608c9-55ac-4dda-a8f6-6b8790ca45a1 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:37.363103 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3d7608c9-55ac-4dda-a8f6-6b8790ca45a1 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:37.363544 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3d7608c9-55ac-4dda-a8f6-6b8790ca45a1 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:37.497095 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-3d7608c9-55ac-4dda-a8f6-6b8790ca45a1 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd432681d7da4322a9cb7ec79c016614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c07aae567b4d718b53dbc4e126c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:30:37.505099 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-3d7608c9-55ac-4dda-a8f6-6b8790ca45a1 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] 10.222.0.46 "GET /compute/v2.1/servers/f8623ab8-cb6d-4127-a85a-6222c7141d72" status: 200 len: 1520 microversion: 2.1 time: 0.156141 Jan 15 21:30:37.505683 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3626/7241] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:30:37 2022] GET /compute/v2.1/servers/f8623ab8-cb6d-4127-a85a-6222c7141d72 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:30:38.522415 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-91f72c2c-9641-466a-8fc7-d85c20be60a4 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:30:38.523064 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-91f72c2c-9641-466a-8fc7-d85c20be60a4 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] [instance: f8623ab8-cb6d-4127-a85a-6222c7141d72] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:30:38.529827 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-91f72c2c-9641-466a-8fc7-d85c20be60a4 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:38.530299 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-91f72c2c-9641-466a-8fc7-d85c20be60a4 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:38.531090 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-91f72c2c-9641-466a-8fc7-d85c20be60a4 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:38.531538 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-91f72c2c-9641-466a-8fc7-d85c20be60a4 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:38.661767 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-91f72c2c-9641-466a-8fc7-d85c20be60a4 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd432681d7da4322a9cb7ec79c016614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c07aae567b4d718b53dbc4e126c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:30:38.669105 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-91f72c2c-9641-466a-8fc7-d85c20be60a4 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] 10.222.0.46 "GET /compute/v2.1/servers/f8623ab8-cb6d-4127-a85a-6222c7141d72" status: 200 len: 1520 microversion: 2.1 time: 0.151059 Jan 15 21:30:38.669685 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3616/7242] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:30:38 2022] GET /compute/v2.1/servers/f8623ab8-cb6d-4127-a85a-6222c7141d72 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:30:39.686355 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1479bc8a-fd8f-4444-8498-f66c9dd7c6b3 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:30:39.686994 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-1479bc8a-fd8f-4444-8498-f66c9dd7c6b3 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] [instance: f8623ab8-cb6d-4127-a85a-6222c7141d72] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:30:39.694217 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1479bc8a-fd8f-4444-8498-f66c9dd7c6b3 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:39.694663 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1479bc8a-fd8f-4444-8498-f66c9dd7c6b3 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:39.695432 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1479bc8a-fd8f-4444-8498-f66c9dd7c6b3 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:39.695870 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1479bc8a-fd8f-4444-8498-f66c9dd7c6b3 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:39.829151 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-1479bc8a-fd8f-4444-8498-f66c9dd7c6b3 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd432681d7da4322a9cb7ec79c016614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c07aae567b4d718b53dbc4e126c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:30:39.837048 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-1479bc8a-fd8f-4444-8498-f66c9dd7c6b3 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] 10.222.0.46 "GET /compute/v2.1/servers/f8623ab8-cb6d-4127-a85a-6222c7141d72" status: 200 len: 1520 microversion: 2.1 time: 0.154300 Jan 15 21:30:39.837615 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3627/7243] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:30:39 2022] GET /compute/v2.1/servers/f8623ab8-cb6d-4127-a85a-6222c7141d72 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:30:40.854543 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-43931667-f762-4a9b-940c-8da0b590ec74 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:30:40.855170 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-43931667-f762-4a9b-940c-8da0b590ec74 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] [instance: f8623ab8-cb6d-4127-a85a-6222c7141d72] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:30:40.862099 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-43931667-f762-4a9b-940c-8da0b590ec74 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:40.862585 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-43931667-f762-4a9b-940c-8da0b590ec74 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:40.863397 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-43931667-f762-4a9b-940c-8da0b590ec74 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:40.863846 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-43931667-f762-4a9b-940c-8da0b590ec74 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:40.995461 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-43931667-f762-4a9b-940c-8da0b590ec74 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd432681d7da4322a9cb7ec79c016614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c07aae567b4d718b53dbc4e126c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:30:41.004249 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-43931667-f762-4a9b-940c-8da0b590ec74 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] 10.222.0.46 "GET /compute/v2.1/servers/f8623ab8-cb6d-4127-a85a-6222c7141d72" status: 200 len: 1520 microversion: 2.1 time: 0.153447 Jan 15 21:30:41.004816 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3617/7244] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:30:40 2022] GET /compute/v2.1/servers/f8623ab8-cb6d-4127-a85a-6222c7141d72 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:30:42.021178 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-645c64b7-feb1-444b-9292-f6c16909ea34 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:30:42.021765 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-645c64b7-feb1-444b-9292-f6c16909ea34 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] [instance: f8623ab8-cb6d-4127-a85a-6222c7141d72] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:30:42.029602 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-645c64b7-feb1-444b-9292-f6c16909ea34 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:42.030050 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-645c64b7-feb1-444b-9292-f6c16909ea34 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:42.030834 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-645c64b7-feb1-444b-9292-f6c16909ea34 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:42.031265 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-645c64b7-feb1-444b-9292-f6c16909ea34 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:42.184347 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-645c64b7-feb1-444b-9292-f6c16909ea34 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd432681d7da4322a9cb7ec79c016614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c07aae567b4d718b53dbc4e126c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:30:42.200951 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-645c64b7-feb1-444b-9292-f6c16909ea34 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] 10.222.0.46 "GET /compute/v2.1/servers/f8623ab8-cb6d-4127-a85a-6222c7141d72" status: 200 len: 1520 microversion: 2.1 time: 0.183398 Jan 15 21:30:42.201554 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3628/7245] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:30:42 2022] GET /compute/v2.1/servers/f8623ab8-cb6d-4127-a85a-6222c7141d72 => generated 1520 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:30:43.141469 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-e303b4c4-db2a-45db-a548-7ab6c1ea7766 req-9534c1aa-94e9-4d4c-be1c-bcd68d958337 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8623ab8-cb6d-4127-a85a-6222c7141d72", "name": "network-vif-unplugged", "status": "completed", "tag": "3b86deb7-4d84-4b73-b2c8-2edafc3ffb0c"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:30:43.143045 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:30:43.143045 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:30:43.150222 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-e303b4c4-db2a-45db-a548-7ab6c1ea7766 req-9534c1aa-94e9-4d4c-be1c-bcd68d958337 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:43.150678 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-e303b4c4-db2a-45db-a548-7ab6c1ea7766 req-9534c1aa-94e9-4d4c-be1c-bcd68d958337 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:43.163291 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-e303b4c4-db2a-45db-a548-7ab6c1ea7766 req-9534c1aa-94e9-4d4c-be1c-bcd68d958337 service nova] Creating event network-vif-unplugged:3b86deb7-4d84-4b73-b2c8-2edafc3ffb0c for instance f8623ab8-cb6d-4127-a85a-6222c7141d72 on nch2-master-1 Jan 15 21:30:43.168879 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [req-e303b4c4-db2a-45db-a548-7ab6c1ea7766 req-9534c1aa-94e9-4d4c-be1c-bcd68d958337 service nova] Instance f8623ab8-cb6d-4127-a85a-6222c7141d72 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=129365) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Jan 15 21:30:43.180590 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-e303b4c4-db2a-45db-a548-7ab6c1ea7766 req-9534c1aa-94e9-4d4c-be1c-bcd68d958337 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.116589 Jan 15 21:30:43.181531 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3618/7246] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:30:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:30:43.218495 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-bd85a81a-1192-4a2a-a761-f40b64dab1d7 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:30:43.220551 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-bd85a81a-1192-4a2a-a761-f40b64dab1d7 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] [instance: f8623ab8-cb6d-4127-a85a-6222c7141d72] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:30:43.227728 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bd85a81a-1192-4a2a-a761-f40b64dab1d7 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:43.228172 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bd85a81a-1192-4a2a-a761-f40b64dab1d7 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:43.228993 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bd85a81a-1192-4a2a-a761-f40b64dab1d7 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:43.229470 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bd85a81a-1192-4a2a-a761-f40b64dab1d7 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:43.367597 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-bd85a81a-1192-4a2a-a761-f40b64dab1d7 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd432681d7da4322a9cb7ec79c016614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c07aae567b4d718b53dbc4e126c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:30:43.375823 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-bd85a81a-1192-4a2a-a761-f40b64dab1d7 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] 10.222.0.46 "GET /compute/v2.1/servers/f8623ab8-cb6d-4127-a85a-6222c7141d72" status: 200 len: 1519 microversion: 2.1 time: 0.161179 Jan 15 21:30:43.376405 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3629/7247] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:30:43 2022] GET /compute/v2.1/servers/f8623ab8-cb6d-4127-a85a-6222c7141d72 => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:30:44.393710 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-13305b54-599a-4a97-968e-10e8e683b953 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:30:44.394565 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-13305b54-599a-4a97-968e-10e8e683b953 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] [instance: f8623ab8-cb6d-4127-a85a-6222c7141d72] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:30:44.401841 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-13305b54-599a-4a97-968e-10e8e683b953 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:44.402301 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-13305b54-599a-4a97-968e-10e8e683b953 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:44.403106 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-13305b54-599a-4a97-968e-10e8e683b953 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:44.403557 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-13305b54-599a-4a97-968e-10e8e683b953 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:44.539552 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-13305b54-599a-4a97-968e-10e8e683b953 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd432681d7da4322a9cb7ec79c016614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c07aae567b4d718b53dbc4e126c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:30:44.546992 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-13305b54-599a-4a97-968e-10e8e683b953 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] 10.222.0.46 "GET /compute/v2.1/servers/f8623ab8-cb6d-4127-a85a-6222c7141d72" status: 200 len: 1517 microversion: 2.1 time: 0.157368 Jan 15 21:30:44.547599 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3619/7248] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:30:44 2022] GET /compute/v2.1/servers/f8623ab8-cb6d-4127-a85a-6222c7141d72 => generated 1517 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:30:45.202831 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-d5c156d2-3c1d-443c-b7fd-e5c2cd4ea1b4 req-f85716cc-0ea3-41c7-a225-591bb030f9a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8623ab8-cb6d-4127-a85a-6222c7141d72", "tag": "3b86deb7-4d84-4b73-b2c8-2edafc3ffb0c"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:30:45.204364 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:30:45.204364 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:30:45.211589 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-d5c156d2-3c1d-443c-b7fd-e5c2cd4ea1b4 req-f85716cc-0ea3-41c7-a225-591bb030f9a1 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:45.212023 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-d5c156d2-3c1d-443c-b7fd-e5c2cd4ea1b4 req-f85716cc-0ea3-41c7-a225-591bb030f9a1 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:45.223554 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-d5c156d2-3c1d-443c-b7fd-e5c2cd4ea1b4 req-f85716cc-0ea3-41c7-a225-591bb030f9a1 service nova] Creating event network-changed:3b86deb7-4d84-4b73-b2c8-2edafc3ffb0c for instance f8623ab8-cb6d-4127-a85a-6222c7141d72 on nch2-master-1 Jan 15 21:30:45.228724 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [req-d5c156d2-3c1d-443c-b7fd-e5c2cd4ea1b4 req-f85716cc-0ea3-41c7-a225-591bb030f9a1 service nova] Instance f8623ab8-cb6d-4127-a85a-6222c7141d72 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=129366) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Jan 15 21:30:45.239963 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-d5c156d2-3c1d-443c-b7fd-e5c2cd4ea1b4 req-f85716cc-0ea3-41c7-a225-591bb030f9a1 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040808 Jan 15 21:30:45.240578 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3630/7249] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:30:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:30:45.564939 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c87a5e5a-51db-40f3-8bfb-a302891bda1f tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:30:45.565572 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c87a5e5a-51db-40f3-8bfb-a302891bda1f tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] [instance: f8623ab8-cb6d-4127-a85a-6222c7141d72] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:30:45.575842 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c87a5e5a-51db-40f3-8bfb-a302891bda1f tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:45.576384 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c87a5e5a-51db-40f3-8bfb-a302891bda1f tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:45.577234 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c87a5e5a-51db-40f3-8bfb-a302891bda1f tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:45.577691 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c87a5e5a-51db-40f3-8bfb-a302891bda1f tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:45.718937 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-c87a5e5a-51db-40f3-8bfb-a302891bda1f tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd432681d7da4322a9cb7ec79c016614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c07aae567b4d718b53dbc4e126c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:30:45.727150 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c87a5e5a-51db-40f3-8bfb-a302891bda1f tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] 10.222.0.46 "GET /compute/v2.1/servers/f8623ab8-cb6d-4127-a85a-6222c7141d72" status: 200 len: 1514 microversion: 2.1 time: 0.165968 Jan 15 21:30:45.727740 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3620/7250] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:30:45 2022] GET /compute/v2.1/servers/f8623ab8-cb6d-4127-a85a-6222c7141d72 => generated 1514 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:30:45.745504 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-3452bade-ac16-4e42-b42b-0543a0d7bd4b tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:30:45.746127 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-3452bade-ac16-4e42-b42b-0543a0d7bd4b tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] [instance: f8623ab8-cb6d-4127-a85a-6222c7141d72] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:30:45.752226 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3452bade-ac16-4e42-b42b-0543a0d7bd4b tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:45.752682 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3452bade-ac16-4e42-b42b-0543a0d7bd4b tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:45.753499 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3452bade-ac16-4e42-b42b-0543a0d7bd4b tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:45.754000 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3452bade-ac16-4e42-b42b-0543a0d7bd4b tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:45.813353 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-3452bade-ac16-4e42-b42b-0543a0d7bd4b tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] 10.222.0.46 "POST /compute/v2.1/servers/f8623ab8-cb6d-4127-a85a-6222c7141d72/action" status: 204 len: 0 microversion: 2.1 time: 0.071947 Jan 15 21:30:45.814018 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3631/7251] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:30:45 2022] POST /compute/v2.1/servers/f8623ab8-cb6d-4127-a85a-6222c7141d72/action => generated 0 bytes in 74 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 15 21:30:45.822128 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-6a3d3b48-ea3f-481c-9bb8-d0aafaccc255 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:30:45.822757 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-6a3d3b48-ea3f-481c-9bb8-d0aafaccc255 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] [instance: f8623ab8-cb6d-4127-a85a-6222c7141d72] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:30:45.829898 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6a3d3b48-ea3f-481c-9bb8-d0aafaccc255 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:45.830373 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6a3d3b48-ea3f-481c-9bb8-d0aafaccc255 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:45.831176 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6a3d3b48-ea3f-481c-9bb8-d0aafaccc255 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:45.831630 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6a3d3b48-ea3f-481c-9bb8-d0aafaccc255 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:45.970493 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-6a3d3b48-ea3f-481c-9bb8-d0aafaccc255 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd432681d7da4322a9cb7ec79c016614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c07aae567b4d718b53dbc4e126c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:30:45.978586 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-6a3d3b48-ea3f-481c-9bb8-d0aafaccc255 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] 10.222.0.46 "GET /compute/v2.1/servers/f8623ab8-cb6d-4127-a85a-6222c7141d72" status: 200 len: 1514 microversion: 2.1 time: 0.160128 Jan 15 21:30:45.979775 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3621/7252] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:30:45 2022] GET /compute/v2.1/servers/f8623ab8-cb6d-4127-a85a-6222c7141d72 => generated 1514 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:30:46.998003 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c40b179d-d262-4959-9c04-2ef9d390bc18 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:30:46.998803 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c40b179d-d262-4959-9c04-2ef9d390bc18 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] [instance: f8623ab8-cb6d-4127-a85a-6222c7141d72] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:30:47.013535 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c40b179d-d262-4959-9c04-2ef9d390bc18 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:47.037953 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c40b179d-d262-4959-9c04-2ef9d390bc18 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:47.039001 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c40b179d-d262-4959-9c04-2ef9d390bc18 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:47.042251 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c40b179d-d262-4959-9c04-2ef9d390bc18 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:47.205148 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-c40b179d-d262-4959-9c04-2ef9d390bc18 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd432681d7da4322a9cb7ec79c016614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c07aae567b4d718b53dbc4e126c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:30:47.213404 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c40b179d-d262-4959-9c04-2ef9d390bc18 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] 10.222.0.46 "GET /compute/v2.1/servers/f8623ab8-cb6d-4127-a85a-6222c7141d72" status: 200 len: 1514 microversion: 2.1 time: 0.220369 Jan 15 21:30:47.213975 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3632/7253] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:30:46 2022] GET /compute/v2.1/servers/f8623ab8-cb6d-4127-a85a-6222c7141d72 => generated 1514 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:30:48.231675 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-11eab173-4917-495c-a6e4-fe797acccb16 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:30:48.232263 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-11eab173-4917-495c-a6e4-fe797acccb16 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] [instance: f8623ab8-cb6d-4127-a85a-6222c7141d72] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:30:48.239707 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-11eab173-4917-495c-a6e4-fe797acccb16 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:48.240173 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-11eab173-4917-495c-a6e4-fe797acccb16 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:48.241050 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-11eab173-4917-495c-a6e4-fe797acccb16 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:48.241500 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-11eab173-4917-495c-a6e4-fe797acccb16 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:48.383248 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-11eab173-4917-495c-a6e4-fe797acccb16 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd432681d7da4322a9cb7ec79c016614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c07aae567b4d718b53dbc4e126c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:30:48.391887 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-11eab173-4917-495c-a6e4-fe797acccb16 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] 10.222.0.46 "GET /compute/v2.1/servers/f8623ab8-cb6d-4127-a85a-6222c7141d72" status: 200 len: 1506 microversion: 2.1 time: 0.163971 Jan 15 21:30:48.392725 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3622/7254] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:30:48 2022] GET /compute/v2.1/servers/f8623ab8-cb6d-4127-a85a-6222c7141d72 => generated 1506 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:30:48.410594 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ff331c10-ef69-494d-bd38-89fbe4d61566 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:30:48.411312 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ff331c10-ef69-494d-bd38-89fbe4d61566 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] [instance: f8623ab8-cb6d-4127-a85a-6222c7141d72] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:30:48.418432 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ff331c10-ef69-494d-bd38-89fbe4d61566 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:48.418877 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ff331c10-ef69-494d-bd38-89fbe4d61566 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:48.419653 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ff331c10-ef69-494d-bd38-89fbe4d61566 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:48.420084 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ff331c10-ef69-494d-bd38-89fbe4d61566 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:48.561552 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-ff331c10-ef69-494d-bd38-89fbe4d61566 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd432681d7da4322a9cb7ec79c016614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c07aae567b4d718b53dbc4e126c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:30:48.570663 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ff331c10-ef69-494d-bd38-89fbe4d61566 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] 10.222.0.46 "GET /compute/v2.1/servers/f8623ab8-cb6d-4127-a85a-6222c7141d72" status: 200 len: 1506 microversion: 2.1 time: 0.165745 Jan 15 21:30:48.571258 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3633/7255] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:30:48 2022] GET /compute/v2.1/servers/f8623ab8-cb6d-4127-a85a-6222c7141d72 => generated 1506 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:30:48.586592 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-767949cc-c9c6-4543-8c1f-897bf76fc66e tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:30:48.587225 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-767949cc-c9c6-4543-8c1f-897bf76fc66e tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] [instance: f8623ab8-cb6d-4127-a85a-6222c7141d72] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:30:48.593569 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-767949cc-c9c6-4543-8c1f-897bf76fc66e tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:48.594074 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-767949cc-c9c6-4543-8c1f-897bf76fc66e tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:48.594824 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-767949cc-c9c6-4543-8c1f-897bf76fc66e tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:48.595265 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-767949cc-c9c6-4543-8c1f-897bf76fc66e tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:48.753260 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-767949cc-c9c6-4543-8c1f-897bf76fc66e tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd432681d7da4322a9cb7ec79c016614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c07aae567b4d718b53dbc4e126c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:30:48.763273 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-767949cc-c9c6-4543-8c1f-897bf76fc66e tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] 10.222.0.46 "GET /compute/v2.1/servers/f8623ab8-cb6d-4127-a85a-6222c7141d72" status: 200 len: 1506 microversion: 2.1 time: 0.179404 Jan 15 21:30:48.763870 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3623/7256] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:30:48 2022] GET /compute/v2.1/servers/f8623ab8-cb6d-4127-a85a-6222c7141d72 => generated 1506 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:30:48.779795 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d8b72224-349e-4dde-b0fd-eeac6af9b72a tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:30:48.780307 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d8b72224-349e-4dde-b0fd-eeac6af9b72a tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] [instance: f8623ab8-cb6d-4127-a85a-6222c7141d72] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:30:48.789288 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d8b72224-349e-4dde-b0fd-eeac6af9b72a tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:48.789424 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d8b72224-349e-4dde-b0fd-eeac6af9b72a tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:48.790176 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d8b72224-349e-4dde-b0fd-eeac6af9b72a tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:48.790622 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d8b72224-349e-4dde-b0fd-eeac6af9b72a tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:48.821521 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d8b72224-349e-4dde-b0fd-eeac6af9b72a tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] [instance: f8623ab8-cb6d-4127-a85a-6222c7141d72] Going to try to terminate instance {{(pid=129365) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 21:30:48.850155 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-7c68b5f6-22f7-4723-be1c-1cb6fe023007 req-956eb3a2-fe69-4f54-a3dd-5411d8b71d8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8623ab8-cb6d-4127-a85a-6222c7141d72", "name": "network-vif-plugged", "status": "completed", "tag": "3b86deb7-4d84-4b73-b2c8-2edafc3ffb0c"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:30:48.851717 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:30:48.851717 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:30:48.858931 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-7c68b5f6-22f7-4723-be1c-1cb6fe023007 req-956eb3a2-fe69-4f54-a3dd-5411d8b71d8e service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:48.861957 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-7c68b5f6-22f7-4723-be1c-1cb6fe023007 req-956eb3a2-fe69-4f54-a3dd-5411d8b71d8e service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:48.876016 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-7c68b5f6-22f7-4723-be1c-1cb6fe023007 req-956eb3a2-fe69-4f54-a3dd-5411d8b71d8e service nova] Creating event network-vif-plugged:3b86deb7-4d84-4b73-b2c8-2edafc3ffb0c for instance f8623ab8-cb6d-4127-a85a-6222c7141d72 on nch2-master-1 Jan 15 21:30:48.882189 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-7c68b5f6-22f7-4723-be1c-1cb6fe023007 req-956eb3a2-fe69-4f54-a3dd-5411d8b71d8e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147414 Jan 15 21:30:48.883143 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3634/7257] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:30:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 21:30:48.913528 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d8b72224-349e-4dde-b0fd-eeac6af9b72a tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] 10.222.0.46 "DELETE /compute/v2.1/servers/f8623ab8-cb6d-4127-a85a-6222c7141d72" status: 204 len: 0 microversion: 2.1 time: 0.137374 Jan 15 21:30:48.914228 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3624/7258] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 21:30:48 2022] DELETE /compute/v2.1/servers/f8623ab8-cb6d-4127-a85a-6222c7141d72 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 15 21:30:48.930624 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8b0fa3b1-ec49-4f04-a3ee-858430edb499 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:30:48.931218 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-8b0fa3b1-ec49-4f04-a3ee-858430edb499 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] [instance: f8623ab8-cb6d-4127-a85a-6222c7141d72] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:30:48.938096 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8b0fa3b1-ec49-4f04-a3ee-858430edb499 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:48.938550 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8b0fa3b1-ec49-4f04-a3ee-858430edb499 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:48.939341 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8b0fa3b1-ec49-4f04-a3ee-858430edb499 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:48.939779 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8b0fa3b1-ec49-4f04-a3ee-858430edb499 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:48.967331 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-8b0fa3b1-ec49-4f04-a3ee-858430edb499 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] [instance: f8623ab8-cb6d-4127-a85a-6222c7141d72] Going to try to terminate instance {{(pid=129366) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 21:30:49.012610 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.compute.api [None req-8b0fa3b1-ec49-4f04-a3ee-858430edb499 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] [instance: f8623ab8-cb6d-4127-a85a-6222c7141d72] Instance is already in deleting state, ignoring this request Jan 15 21:30:49.014496 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-8b0fa3b1-ec49-4f04-a3ee-858430edb499 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] 10.222.0.46 "DELETE /compute/v2.1/servers/f8623ab8-cb6d-4127-a85a-6222c7141d72" status: 204 len: 0 microversion: 2.1 time: 0.090301 Jan 15 21:30:49.015082 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3635/7259] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 21:30:48 2022] DELETE /compute/v2.1/servers/f8623ab8-cb6d-4127-a85a-6222c7141d72 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 15 21:30:49.023793 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-6e96a3b2-e223-4601-ba22-7abc5db78677 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:30:49.024518 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-6e96a3b2-e223-4601-ba22-7abc5db78677 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] [instance: f8623ab8-cb6d-4127-a85a-6222c7141d72] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:30:49.031749 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6e96a3b2-e223-4601-ba22-7abc5db78677 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:49.032504 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6e96a3b2-e223-4601-ba22-7abc5db78677 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:49.033517 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6e96a3b2-e223-4601-ba22-7abc5db78677 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:49.033968 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6e96a3b2-e223-4601-ba22-7abc5db78677 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:49.171266 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-6e96a3b2-e223-4601-ba22-7abc5db78677 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd432681d7da4322a9cb7ec79c016614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c07aae567b4d718b53dbc4e126c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:30:49.179793 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-6e96a3b2-e223-4601-ba22-7abc5db78677 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] 10.222.0.46 "GET /compute/v2.1/servers/f8623ab8-cb6d-4127-a85a-6222c7141d72" status: 200 len: 1512 microversion: 2.1 time: 0.160175 Jan 15 21:30:49.180539 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3625/7260] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:30:49 2022] GET /compute/v2.1/servers/f8623ab8-cb6d-4127-a85a-6222c7141d72 => generated 1512 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:30:50.197464 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c273bc0d-c4d4-4b48-a24f-156360154179 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:30:50.198125 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c273bc0d-c4d4-4b48-a24f-156360154179 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] [instance: f8623ab8-cb6d-4127-a85a-6222c7141d72] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:30:50.205106 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c273bc0d-c4d4-4b48-a24f-156360154179 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:50.205567 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c273bc0d-c4d4-4b48-a24f-156360154179 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:50.206358 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c273bc0d-c4d4-4b48-a24f-156360154179 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:50.208183 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c273bc0d-c4d4-4b48-a24f-156360154179 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:50.354714 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-c273bc0d-c4d4-4b48-a24f-156360154179 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd432681d7da4322a9cb7ec79c016614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c07aae567b4d718b53dbc4e126c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:30:50.365296 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c273bc0d-c4d4-4b48-a24f-156360154179 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] 10.222.0.46 "GET /compute/v2.1/servers/f8623ab8-cb6d-4127-a85a-6222c7141d72" status: 200 len: 1512 microversion: 2.1 time: 0.171467 Jan 15 21:30:50.365926 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3636/7261] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:30:50 2022] GET /compute/v2.1/servers/f8623ab8-cb6d-4127-a85a-6222c7141d72 => generated 1512 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:30:50.792940 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-b71e9121-6676-4684-8910-52cdcd7d2953 req-69fbf05f-edf6-4a97-90a8-d3fa3ca3ba7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8623ab8-cb6d-4127-a85a-6222c7141d72", "name": "network-vif-deleted", "tag": "3b86deb7-4d84-4b73-b2c8-2edafc3ffb0c"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:30:50.794551 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:30:50.794551 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:30:50.805658 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-b71e9121-6676-4684-8910-52cdcd7d2953 req-69fbf05f-edf6-4a97-90a8-d3fa3ca3ba7a service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:50.806168 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-b71e9121-6676-4684-8910-52cdcd7d2953 req-69fbf05f-edf6-4a97-90a8-d3fa3ca3ba7a service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:50.826381 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-b71e9121-6676-4684-8910-52cdcd7d2953 req-69fbf05f-edf6-4a97-90a8-d3fa3ca3ba7a service nova] Creating event network-vif-deleted:3b86deb7-4d84-4b73-b2c8-2edafc3ffb0c for instance f8623ab8-cb6d-4127-a85a-6222c7141d72 on nch2-master-1 Jan 15 21:30:50.831398 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-b71e9121-6676-4684-8910-52cdcd7d2953 req-69fbf05f-edf6-4a97-90a8-d3fa3ca3ba7a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042593 Jan 15 21:30:50.832182 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3626/7262] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:30:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:30:51.383245 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-047b0db2-e689-4928-8c3f-dfbd2a5498a9 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:30:51.383851 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-047b0db2-e689-4928-8c3f-dfbd2a5498a9 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] [instance: f8623ab8-cb6d-4127-a85a-6222c7141d72] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:30:51.391852 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-047b0db2-e689-4928-8c3f-dfbd2a5498a9 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:51.392307 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-047b0db2-e689-4928-8c3f-dfbd2a5498a9 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:51.393176 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-047b0db2-e689-4928-8c3f-dfbd2a5498a9 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:51.393612 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-047b0db2-e689-4928-8c3f-dfbd2a5498a9 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:51.409035 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-047b0db2-e689-4928-8c3f-dfbd2a5498a9 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] HTTP exception thrown: Instance f8623ab8-cb6d-4127-a85a-6222c7141d72 could not be found. Jan 15 21:30:51.409633 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-047b0db2-e689-4928-8c3f-dfbd2a5498a9 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Returning 404 to user: Instance f8623ab8-cb6d-4127-a85a-6222c7141d72 could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:30:51.410906 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-047b0db2-e689-4928-8c3f-dfbd2a5498a9 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] 10.222.0.46 "GET /compute/v2.1/servers/f8623ab8-cb6d-4127-a85a-6222c7141d72" status: 404 len: 111 microversion: 2.1 time: 0.032021 Jan 15 21:30:51.411471 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3637/7263] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:30:51 2022] GET /compute/v2.1/servers/f8623ab8-cb6d-4127-a85a-6222c7141d72 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:30:51.419883 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-19c941db-e51a-41bc-b4b4-7d1eeecc166c tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:30:51.420486 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-19c941db-e51a-41bc-b4b4-7d1eeecc166c tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] [instance: 0ca394fe-2987-449e-89bf-9dfc44bbd605] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:30:51.427576 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-19c941db-e51a-41bc-b4b4-7d1eeecc166c tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:51.428070 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-19c941db-e51a-41bc-b4b4-7d1eeecc166c tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:51.428905 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-19c941db-e51a-41bc-b4b4-7d1eeecc166c tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:51.429330 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-19c941db-e51a-41bc-b4b4-7d1eeecc166c tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:51.443759 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-19c941db-e51a-41bc-b4b4-7d1eeecc166c tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] HTTP exception thrown: Instance 0ca394fe-2987-449e-89bf-9dfc44bbd605 could not be found. Jan 15 21:30:51.444397 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-19c941db-e51a-41bc-b4b4-7d1eeecc166c tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Returning 404 to user: Instance 0ca394fe-2987-449e-89bf-9dfc44bbd605 could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:30:51.445248 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-19c941db-e51a-41bc-b4b4-7d1eeecc166c tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] 10.222.0.46 "DELETE /compute/v2.1/servers/0ca394fe-2987-449e-89bf-9dfc44bbd605" status: 404 len: 111 microversion: 2.1 time: 0.029367 Jan 15 21:30:51.445804 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3627/7264] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 21:30:51 2022] DELETE /compute/v2.1/servers/0ca394fe-2987-449e-89bf-9dfc44bbd605 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:30:51.453829 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-5e036b62-ed26-4a37-9aa4-61ffc3c06476 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:30:51.454496 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-5e036b62-ed26-4a37-9aa4-61ffc3c06476 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] [instance: 0ca394fe-2987-449e-89bf-9dfc44bbd605] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:30:51.461199 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5e036b62-ed26-4a37-9aa4-61ffc3c06476 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:51.461654 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5e036b62-ed26-4a37-9aa4-61ffc3c06476 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:51.462713 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5e036b62-ed26-4a37-9aa4-61ffc3c06476 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:30:51.463151 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5e036b62-ed26-4a37-9aa4-61ffc3c06476 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:30:51.478286 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-5e036b62-ed26-4a37-9aa4-61ffc3c06476 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] HTTP exception thrown: Instance 0ca394fe-2987-449e-89bf-9dfc44bbd605 could not be found. Jan 15 21:30:51.478909 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-5e036b62-ed26-4a37-9aa4-61ffc3c06476 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] Returning 404 to user: Instance 0ca394fe-2987-449e-89bf-9dfc44bbd605 could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:30:51.479908 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-5e036b62-ed26-4a37-9aa4-61ffc3c06476 tempest-ServerDiskConfigTestJSON-460054218 tempest-ServerDiskConfigTestJSON-460054218-project] 10.222.0.46 "GET /compute/v2.1/servers/0ca394fe-2987-449e-89bf-9dfc44bbd605" status: 404 len: 111 microversion: 2.1 time: 0.029810 Jan 15 21:30:51.480463 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3638/7265] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:30:51 2022] GET /compute/v2.1/servers/0ca394fe-2987-449e-89bf-9dfc44bbd605 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:30:57.809851 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8bda7b21-66a4-47b2-945b-6c1cb518dc31 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'create', calling method: .version_select at 0x7f30b8729280>, body: {"keypair": {"name": "tempest-keypair-176324375"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:30:57.825414 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-8bda7b21-66a4-47b2-945b-6c1cb518dc31 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Getting quotas for project 2d89bb23cded412ea3ca57cc844bfabf. Resources: {'key_pairs'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:30:57.831484 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-8bda7b21-66a4-47b2-945b-6c1cb518dc31 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Getting quotas for user b3fbd604b5a640b480e5d115e469375e and project 2d89bb23cded412ea3ca57cc844bfabf. Resources: {'key_pairs'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:30:58.235391 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-8bda7b21-66a4-47b2-945b-6c1cb518dc31 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Getting quotas for project 2d89bb23cded412ea3ca57cc844bfabf. Resources: {'key_pairs'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:30:58.241399 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-8bda7b21-66a4-47b2-945b-6c1cb518dc31 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Getting quotas for user b3fbd604b5a640b480e5d115e469375e and project 2d89bb23cded412ea3ca57cc844bfabf. Resources: {'key_pairs'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:30:58.256335 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-8bda7b21-66a4-47b2-945b-6c1cb518dc31 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.585882 Jan 15 21:30:58.256969 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3628/7266] 10.222.0.46 () {60 vars in 1157 bytes} [Sat Jan 15 21:30:57 2022] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:30:59.564772 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-103c1562-aa1a-430b-bfbe-b26420605405 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-870313759", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "72520288-27af-458f-aef8-ae08e1543c11"}], "security_groups": [{"name": "tempest-securitygroup--1432803138"}], "key_name": "tempest-keypair-176324375", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:30:59.668813 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.network.neutron [None req-103c1562-aa1a-430b-bfbe-b26420605405 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] validate_networks() for [('72520288-27af-458f-aef8-ae08e1543c11', None, None, None, None, None)] {{(pid=129366) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 21:31:00.150016 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-103c1562-aa1a-430b-bfbe-b26420605405 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Flavor limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 21:31:00.150510 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-103c1562-aa1a-430b-bfbe-b26420605405 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Image limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 21:31:00.150987 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-103c1562-aa1a-430b-bfbe-b26420605405 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Flavor pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 21:31:00.151420 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-103c1562-aa1a-430b-bfbe-b26420605405 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Image pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 21:31:00.151829 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-103c1562-aa1a-430b-bfbe-b26420605405 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 21:31:00.161227 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-103c1562-aa1a-430b-bfbe-b26420605405 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:31:00.161679 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-103c1562-aa1a-430b-bfbe-b26420605405 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:31:00.162499 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-103c1562-aa1a-430b-bfbe-b26420605405 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:31:00.162942 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-103c1562-aa1a-430b-bfbe-b26420605405 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:31:00.180651 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-103c1562-aa1a-430b-bfbe-b26420605405 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Getting quotas for project 2d89bb23cded412ea3ca57cc844bfabf. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:31:00.185731 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-103c1562-aa1a-430b-bfbe-b26420605405 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Getting quotas for user b3fbd604b5a640b480e5d115e469375e and project 2d89bb23cded412ea3ca57cc844bfabf. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:31:00.198851 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-103c1562-aa1a-430b-bfbe-b26420605405 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Going to run 1 instances... {{(pid=129366) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 21:31:00.201241 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-103c1562-aa1a-430b-bfbe-b26420605405 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 21:31:00.247887 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-103c1562-aa1a-430b-bfbe-b26420605405 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.687032 Jan 15 21:31:00.253211 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3639/7267] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 21:30:59 2022] POST /compute/v2.1/servers => generated 409 bytes in 688 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 21:31:00.259768 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-01ef3546-4f32-447a-b593-6f0c67509e02 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:31:00.260500 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-01ef3546-4f32-447a-b593-6f0c67509e02 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:31:00.347338 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-01ef3546-4f32-447a-b593-6f0c67509e02 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:31:00.356462 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-01ef3546-4f32-447a-b593-6f0c67509e02 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df" status: 200 len: 1237 microversion: 2.1 time: 0.101157 Jan 15 21:31:00.357351 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3629/7268] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:31:00 2022] GET /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df => generated 1237 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:31:01.376765 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e46a9304-db96-4a95-ad61-d6324511bf77 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:31:01.377565 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e46a9304-db96-4a95-ad61-d6324511bf77 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:31:01.393192 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e46a9304-db96-4a95-ad61-d6324511bf77 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:31:01.393941 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e46a9304-db96-4a95-ad61-d6324511bf77 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:31:01.394907 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e46a9304-db96-4a95-ad61-d6324511bf77 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:31:01.395569 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e46a9304-db96-4a95-ad61-d6324511bf77 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:31:01.462937 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-e46a9304-db96-4a95-ad61-d6324511bf77 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:31:01.470529 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e46a9304-db96-4a95-ad61-d6324511bf77 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df" status: 200 len: 1295 microversion: 2.1 time: 0.098563 Jan 15 21:31:01.471108 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3640/7269] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:31:01 2022] GET /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df => generated 1295 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:31:02.488605 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-54b1204a-512b-4eb9-b683-75513b7f6868 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:31:02.489441 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-54b1204a-512b-4eb9-b683-75513b7f6868 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:31:02.498408 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-54b1204a-512b-4eb9-b683-75513b7f6868 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:31:02.498955 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-54b1204a-512b-4eb9-b683-75513b7f6868 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:31:02.499869 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-54b1204a-512b-4eb9-b683-75513b7f6868 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:31:02.500384 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-54b1204a-512b-4eb9-b683-75513b7f6868 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:31:02.674396 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-b629c9e5-8a30-4d70-8443-d4f9dc786349 req-d30c0758-d4d8-4d69-8427-98c8676fab39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f63c13ee-f437-4649-8e7a-abb7909aa3df", "tag": "08c8c499-9a20-44b6-a253-314116581cdd"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:31:02.678627 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:31:02.678627 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:31:02.713893 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-b629c9e5-8a30-4d70-8443-d4f9dc786349 req-d30c0758-d4d8-4d69-8427-98c8676fab39 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:31:02.714601 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-b629c9e5-8a30-4d70-8443-d4f9dc786349 req-d30c0758-d4d8-4d69-8427-98c8676fab39 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:31:02.730665 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-b629c9e5-8a30-4d70-8443-d4f9dc786349 req-d30c0758-d4d8-4d69-8427-98c8676fab39 service nova] Creating event network-changed:08c8c499-9a20-44b6-a253-314116581cdd for instance f63c13ee-f437-4649-8e7a-abb7909aa3df on nch1-master-1 Jan 15 21:31:02.735904 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-b629c9e5-8a30-4d70-8443-d4f9dc786349 req-d30c0758-d4d8-4d69-8427-98c8676fab39 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071222 Jan 15 21:31:02.736683 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3641/7270] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:31:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:31:02.902138 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-54b1204a-512b-4eb9-b683-75513b7f6868 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:31:02.910118 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-54b1204a-512b-4eb9-b683-75513b7f6868 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df" status: 200 len: 1363 microversion: 2.1 time: 0.425706 Jan 15 21:31:02.910766 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3630/7271] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:31:02 2022] GET /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df => generated 1363 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:31:03.927400 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a9b11a59-4a52-4817-b8fa-1e4f83d31d95 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:31:03.928081 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a9b11a59-4a52-4817-b8fa-1e4f83d31d95 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:31:03.934255 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a9b11a59-4a52-4817-b8fa-1e4f83d31d95 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:31:03.934732 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a9b11a59-4a52-4817-b8fa-1e4f83d31d95 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:31:03.935500 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a9b11a59-4a52-4817-b8fa-1e4f83d31d95 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:31:03.935934 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a9b11a59-4a52-4817-b8fa-1e4f83d31d95 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:31:04.065826 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-a9b11a59-4a52-4817-b8fa-1e4f83d31d95 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:31:04.073779 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a9b11a59-4a52-4817-b8fa-1e4f83d31d95 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df" status: 200 len: 1363 microversion: 2.1 time: 0.151345 Jan 15 21:31:04.074353 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3642/7272] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:31:03 2022] GET /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:31:05.091092 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c0d19d35-c43d-4702-9b08-6686191e3900 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:31:05.091716 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c0d19d35-c43d-4702-9b08-6686191e3900 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:31:05.098586 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c0d19d35-c43d-4702-9b08-6686191e3900 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:31:05.099039 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c0d19d35-c43d-4702-9b08-6686191e3900 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:31:05.099860 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c0d19d35-c43d-4702-9b08-6686191e3900 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:31:05.100306 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c0d19d35-c43d-4702-9b08-6686191e3900 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:31:05.228975 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-c0d19d35-c43d-4702-9b08-6686191e3900 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:31:05.236282 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c0d19d35-c43d-4702-9b08-6686191e3900 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df" status: 200 len: 1363 microversion: 2.1 time: 0.148850 Jan 15 21:31:05.236876 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3631/7273] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:31:05 2022] GET /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:31:06.254123 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-151a2607-8d5f-4e9c-821d-e78bc1472e2b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:31:06.254727 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-151a2607-8d5f-4e9c-821d-e78bc1472e2b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:31:06.261434 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-151a2607-8d5f-4e9c-821d-e78bc1472e2b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:31:06.261874 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-151a2607-8d5f-4e9c-821d-e78bc1472e2b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:31:06.262637 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-151a2607-8d5f-4e9c-821d-e78bc1472e2b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:31:06.263062 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-151a2607-8d5f-4e9c-821d-e78bc1472e2b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:31:06.398802 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-151a2607-8d5f-4e9c-821d-e78bc1472e2b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:31:06.406126 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-151a2607-8d5f-4e9c-821d-e78bc1472e2b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df" status: 200 len: 1363 microversion: 2.1 time: 0.155836 Jan 15 21:31:06.406720 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3643/7274] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:31:06 2022] GET /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:31:07.423942 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a5fcda9b-df4a-4b7c-a5f8-ea3a29ce6ef5 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:31:07.424557 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a5fcda9b-df4a-4b7c-a5f8-ea3a29ce6ef5 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:31:07.432164 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a5fcda9b-df4a-4b7c-a5f8-ea3a29ce6ef5 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:31:07.432625 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a5fcda9b-df4a-4b7c-a5f8-ea3a29ce6ef5 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:31:07.433495 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a5fcda9b-df4a-4b7c-a5f8-ea3a29ce6ef5 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:31:07.433943 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a5fcda9b-df4a-4b7c-a5f8-ea3a29ce6ef5 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:31:07.565619 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-a5fcda9b-df4a-4b7c-a5f8-ea3a29ce6ef5 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:31:07.572950 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a5fcda9b-df4a-4b7c-a5f8-ea3a29ce6ef5 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df" status: 200 len: 1363 microversion: 2.1 time: 0.152598 Jan 15 21:31:07.573528 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3632/7275] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:31:07 2022] GET /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:31:08.589765 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-21d28283-86cf-4f71-91b3-53427b37f5cf tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:31:08.590303 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-21d28283-86cf-4f71-91b3-53427b37f5cf tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:31:08.597020 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-21d28283-86cf-4f71-91b3-53427b37f5cf tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:31:08.597757 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-21d28283-86cf-4f71-91b3-53427b37f5cf tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:31:08.598652 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-21d28283-86cf-4f71-91b3-53427b37f5cf tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:31:08.599090 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-21d28283-86cf-4f71-91b3-53427b37f5cf tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:31:08.729692 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-21d28283-86cf-4f71-91b3-53427b37f5cf tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:31:08.737007 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-21d28283-86cf-4f71-91b3-53427b37f5cf tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df" status: 200 len: 1363 microversion: 2.1 time: 0.151110 Jan 15 21:31:08.737585 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3644/7276] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:31:08 2022] GET /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:31:09.187364 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-47533655-fa02-4f92-a281-d77be3d22b5d req-3d093331-a40a-417b-9416-734f7546d5a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f63c13ee-f437-4649-8e7a-abb7909aa3df", "name": "network-vif-plugged", "status": "completed", "tag": "08c8c499-9a20-44b6-a253-314116581cdd"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:31:09.189017 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:31:09.189017 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:31:09.197528 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-47533655-fa02-4f92-a281-d77be3d22b5d req-3d093331-a40a-417b-9416-734f7546d5a4 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:31:09.198768 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-47533655-fa02-4f92-a281-d77be3d22b5d req-3d093331-a40a-417b-9416-734f7546d5a4 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:31:09.210024 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-47533655-fa02-4f92-a281-d77be3d22b5d req-3d093331-a40a-417b-9416-734f7546d5a4 service nova] Creating event network-vif-plugged:08c8c499-9a20-44b6-a253-314116581cdd for instance f63c13ee-f437-4649-8e7a-abb7909aa3df on nch1-master-1 Jan 15 21:31:09.215145 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-47533655-fa02-4f92-a281-d77be3d22b5d req-3d093331-a40a-417b-9416-734f7546d5a4 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031782 Jan 15 21:31:09.215728 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3633/7277] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:31:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:31:09.754779 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-bef79fa5-1358-409c-8359-9a9ad466c35c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:31:09.755387 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-bef79fa5-1358-409c-8359-9a9ad466c35c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:31:09.762136 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bef79fa5-1358-409c-8359-9a9ad466c35c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:31:09.762593 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bef79fa5-1358-409c-8359-9a9ad466c35c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:31:09.763377 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bef79fa5-1358-409c-8359-9a9ad466c35c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:31:09.763820 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bef79fa5-1358-409c-8359-9a9ad466c35c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:31:09.891686 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-bef79fa5-1358-409c-8359-9a9ad466c35c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:31:09.899774 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-bef79fa5-1358-409c-8359-9a9ad466c35c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df" status: 200 len: 1363 microversion: 2.1 time: 0.149409 Jan 15 21:31:09.900347 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3645/7278] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:31:09 2022] GET /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:31:10.917567 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-0829f230-68d9-482b-880a-899fe6a469c7 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:31:10.918270 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-0829f230-68d9-482b-880a-899fe6a469c7 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:31:10.925361 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0829f230-68d9-482b-880a-899fe6a469c7 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:31:10.926021 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0829f230-68d9-482b-880a-899fe6a469c7 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:31:10.926810 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0829f230-68d9-482b-880a-899fe6a469c7 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:31:10.927272 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0829f230-68d9-482b-880a-899fe6a469c7 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:31:11.061545 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-0829f230-68d9-482b-880a-899fe6a469c7 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:31:11.068968 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-0829f230-68d9-482b-880a-899fe6a469c7 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df" status: 200 len: 1549 microversion: 2.1 time: 0.155487 Jan 15 21:31:11.069537 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3634/7279] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:31:10 2022] GET /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df => generated 1549 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:31:11.085491 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-65e77277-51d6-4a2e-b68d-58e2c7d3b099 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:31:11.085999 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-65e77277-51d6-4a2e-b68d-58e2c7d3b099 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:31:11.092705 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-65e77277-51d6-4a2e-b68d-58e2c7d3b099 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:31:11.093203 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-65e77277-51d6-4a2e-b68d-58e2c7d3b099 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:31:11.093988 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-65e77277-51d6-4a2e-b68d-58e2c7d3b099 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:31:11.094429 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-65e77277-51d6-4a2e-b68d-58e2c7d3b099 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:31:11.173658 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-65e77277-51d6-4a2e-b68d-58e2c7d3b099 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092451 Jan 15 21:31:11.174275 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3646/7280] 10.222.0.46 () {58 vars in 1274 bytes} [Sat Jan 15 21:31:11 2022] GET /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 21:31:12.146758 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a9cb728e-1030-4ffd-97c6-46130c552dcf tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:31:12.147687 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a9cb728e-1030-4ffd-97c6-46130c552dcf tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:31:12.164087 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a9cb728e-1030-4ffd-97c6-46130c552dcf tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:31:12.164538 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a9cb728e-1030-4ffd-97c6-46130c552dcf tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:31:12.165446 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a9cb728e-1030-4ffd-97c6-46130c552dcf tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:31:12.165895 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a9cb728e-1030-4ffd-97c6-46130c552dcf tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:31:12.205347 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a9cb728e-1030-4ffd-97c6-46130c552dcf tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action" status: 200 len: 14 microversion: 2.1 time: 0.063157 Jan 15 21:31:12.207340 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3635/7281] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:31:12 2022] POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action => generated 14 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 21:31:12.226176 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-9217d06a-19ad-4f99-bb7d-ed2755ce70ee req-c46c4809-7f10-4b96-866b-45fbb3a14044 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f63c13ee-f437-4649-8e7a-abb7909aa3df", "tag": "08c8c499-9a20-44b6-a253-314116581cdd"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:31:12.227720 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:31:12.227720 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:31:12.234625 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-9217d06a-19ad-4f99-bb7d-ed2755ce70ee req-c46c4809-7f10-4b96-866b-45fbb3a14044 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:31:12.235065 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-9217d06a-19ad-4f99-bb7d-ed2755ce70ee req-c46c4809-7f10-4b96-866b-45fbb3a14044 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:31:12.246811 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-9217d06a-19ad-4f99-bb7d-ed2755ce70ee req-c46c4809-7f10-4b96-866b-45fbb3a14044 service nova] Creating event network-changed:08c8c499-9a20-44b6-a253-314116581cdd for instance f63c13ee-f437-4649-8e7a-abb7909aa3df on nch1-master-1 Jan 15 21:31:12.251923 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-9217d06a-19ad-4f99-bb7d-ed2755ce70ee req-c46c4809-7f10-4b96-866b-45fbb3a14044 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107455 Jan 15 21:31:12.252900 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3647/7282] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:31:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:31:13.216923 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a2f1bae7-5146-4f53-8eb2-b54a5842015a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:31:13.217957 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a2f1bae7-5146-4f53-8eb2-b54a5842015a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:31:13.226929 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a2f1bae7-5146-4f53-8eb2-b54a5842015a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:31:13.227444 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a2f1bae7-5146-4f53-8eb2-b54a5842015a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:31:13.228317 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a2f1bae7-5146-4f53-8eb2-b54a5842015a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:31:13.228770 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a2f1bae7-5146-4f53-8eb2-b54a5842015a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:31:13.265859 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a2f1bae7-5146-4f53-8eb2-b54a5842015a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action" status: 200 len: 14 microversion: 2.1 time: 0.052886 Jan 15 21:31:13.266478 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3636/7283] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:31:13 2022] POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action => generated 14 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 21:31:14.277713 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-6d3a9039-4c0a-4eb4-8adf-ab5f553a0095 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:31:14.278720 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-6d3a9039-4c0a-4eb4-8adf-ab5f553a0095 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:31:14.285557 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6d3a9039-4c0a-4eb4-8adf-ab5f553a0095 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:31:14.285999 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6d3a9039-4c0a-4eb4-8adf-ab5f553a0095 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:31:14.286765 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6d3a9039-4c0a-4eb4-8adf-ab5f553a0095 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:31:14.287194 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6d3a9039-4c0a-4eb4-8adf-ab5f553a0095 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:31:14.325241 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-6d3a9039-4c0a-4eb4-8adf-ab5f553a0095 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action" status: 200 len: 14 microversion: 2.1 time: 0.051383 Jan 15 21:31:14.326022 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3648/7284] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:31:14 2022] POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action => generated 14 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 21:31:15.336862 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-4e02cfbe-cc1a-4b20-825c-ff9247c150c1 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:31:15.337869 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-4e02cfbe-cc1a-4b20-825c-ff9247c150c1 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:31:15.345025 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4e02cfbe-cc1a-4b20-825c-ff9247c150c1 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:31:15.345492 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4e02cfbe-cc1a-4b20-825c-ff9247c150c1 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:31:15.346282 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4e02cfbe-cc1a-4b20-825c-ff9247c150c1 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:31:15.346731 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4e02cfbe-cc1a-4b20-825c-ff9247c150c1 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:31:15.385194 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-4e02cfbe-cc1a-4b20-825c-ff9247c150c1 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action" status: 200 len: 14 microversion: 2.1 time: 0.052180 Jan 15 21:31:15.385906 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3637/7285] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:31:15 2022] POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action => generated 14 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 21:31:16.396393 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ff9ac8a0-72cd-4696-9fea-e2dc75a3ac0e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:31:16.397425 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ff9ac8a0-72cd-4696-9fea-e2dc75a3ac0e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:31:16.404854 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ff9ac8a0-72cd-4696-9fea-e2dc75a3ac0e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:31:16.405313 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ff9ac8a0-72cd-4696-9fea-e2dc75a3ac0e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:31:16.406091 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ff9ac8a0-72cd-4696-9fea-e2dc75a3ac0e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:31:16.406525 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ff9ac8a0-72cd-4696-9fea-e2dc75a3ac0e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:31:16.443675 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ff9ac8a0-72cd-4696-9fea-e2dc75a3ac0e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action" status: 200 len: 14 microversion: 2.1 time: 0.051228 Jan 15 21:31:16.444302 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3649/7286] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:31:16 2022] POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action => generated 14 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 21:31:17.455306 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ce272dfb-56e4-46c7-a29f-6c83e140d249 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:31:17.457020 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ce272dfb-56e4-46c7-a29f-6c83e140d249 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:31:17.464416 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ce272dfb-56e4-46c7-a29f-6c83e140d249 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:31:17.464894 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ce272dfb-56e4-46c7-a29f-6c83e140d249 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:31:17.465679 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ce272dfb-56e4-46c7-a29f-6c83e140d249 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:31:17.466123 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ce272dfb-56e4-46c7-a29f-6c83e140d249 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:31:17.501970 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ce272dfb-56e4-46c7-a29f-6c83e140d249 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action" status: 200 len: 14 microversion: 2.1 time: 0.050538 Jan 15 21:31:17.502722 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3638/7287] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:31:17 2022] POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action => generated 14 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 21:31:18.514101 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e8debf4e-ca2e-46f2-9982-8b13f652bff8 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:31:18.515036 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e8debf4e-ca2e-46f2-9982-8b13f652bff8 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:31:18.522844 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e8debf4e-ca2e-46f2-9982-8b13f652bff8 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:31:18.523296 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e8debf4e-ca2e-46f2-9982-8b13f652bff8 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:31:18.524078 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e8debf4e-ca2e-46f2-9982-8b13f652bff8 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:31:18.524513 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e8debf4e-ca2e-46f2-9982-8b13f652bff8 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:31:18.563471 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e8debf4e-ca2e-46f2-9982-8b13f652bff8 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action" status: 200 len: 14 microversion: 2.1 time: 0.053459 Jan 15 21:31:18.564100 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3650/7288] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:31:18 2022] POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action => generated 14 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 21:31:19.574384 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c55bd2c2-0085-4029-801c-ea80273f5a72 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:31:19.575441 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c55bd2c2-0085-4029-801c-ea80273f5a72 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:31:19.582739 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c55bd2c2-0085-4029-801c-ea80273f5a72 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:31:19.583473 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c55bd2c2-0085-4029-801c-ea80273f5a72 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:31:19.584263 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c55bd2c2-0085-4029-801c-ea80273f5a72 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:31:19.584698 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c55bd2c2-0085-4029-801c-ea80273f5a72 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:31:19.624295 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c55bd2c2-0085-4029-801c-ea80273f5a72 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action" status: 200 len: 14 microversion: 2.1 time: 0.053870 Jan 15 21:31:19.624967 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3639/7289] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:31:19 2022] POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action => generated 14 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 15 21:31:20.635947 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-fe4609c7-07ce-49c0-8ffa-5f0edc2e4bfa tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:31:20.636864 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-fe4609c7-07ce-49c0-8ffa-5f0edc2e4bfa tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:31:20.644269 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fe4609c7-07ce-49c0-8ffa-5f0edc2e4bfa tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:31:20.644800 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fe4609c7-07ce-49c0-8ffa-5f0edc2e4bfa tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:31:20.645678 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fe4609c7-07ce-49c0-8ffa-5f0edc2e4bfa tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:31:20.646025 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fe4609c7-07ce-49c0-8ffa-5f0edc2e4bfa tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:31:20.683620 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-fe4609c7-07ce-49c0-8ffa-5f0edc2e4bfa tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action" status: 200 len: 14 microversion: 2.1 time: 0.051620 Jan 15 21:31:20.684430 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3651/7290] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:31:20 2022] POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action => generated 14 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 21:31:21.694931 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-02224045-2e78-4fc2-8fe0-b21cbb7db030 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:31:21.695943 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-02224045-2e78-4fc2-8fe0-b21cbb7db030 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:31:21.703291 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-02224045-2e78-4fc2-8fe0-b21cbb7db030 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:31:21.703754 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-02224045-2e78-4fc2-8fe0-b21cbb7db030 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:31:21.704541 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-02224045-2e78-4fc2-8fe0-b21cbb7db030 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:31:21.705099 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-02224045-2e78-4fc2-8fe0-b21cbb7db030 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:31:21.741378 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-02224045-2e78-4fc2-8fe0-b21cbb7db030 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action" status: 200 len: 14 microversion: 2.1 time: 0.050348 Jan 15 21:31:21.741988 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3640/7291] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:31:21 2022] POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action => generated 14 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 21:31:22.752100 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-3a387dc8-5925-4a5d-864e-f47b7e82297b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:31:22.753162 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-3a387dc8-5925-4a5d-864e-f47b7e82297b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:31:22.760644 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3a387dc8-5925-4a5d-864e-f47b7e82297b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:31:22.761113 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3a387dc8-5925-4a5d-864e-f47b7e82297b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:31:22.761883 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3a387dc8-5925-4a5d-864e-f47b7e82297b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:31:22.762315 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3a387dc8-5925-4a5d-864e-f47b7e82297b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:31:22.813063 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-3a387dc8-5925-4a5d-864e-f47b7e82297b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action" status: 200 len: 8205 microversion: 2.1 time: 0.064896 Jan 15 21:31:22.813727 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3652/7292] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:31:22 2022] POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action => generated 8205 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:31:23.824306 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5840a5ff-b27a-4937-89d7-92075afe3883 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:31:23.825354 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-5840a5ff-b27a-4937-89d7-92075afe3883 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:31:23.832697 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5840a5ff-b27a-4937-89d7-92075afe3883 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:31:23.833192 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5840a5ff-b27a-4937-89d7-92075afe3883 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:31:23.834023 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5840a5ff-b27a-4937-89d7-92075afe3883 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:31:23.834473 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5840a5ff-b27a-4937-89d7-92075afe3883 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:31:23.881810 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5840a5ff-b27a-4937-89d7-92075afe3883 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action" status: 200 len: 16396 microversion: 2.1 time: 0.061399 Jan 15 21:31:23.882450 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3641/7293] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:31:23 2022] POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action => generated 16396 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:31:24.893542 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-773d4be1-6f46-40fd-8623-80ea8478e898 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:31:24.895194 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-773d4be1-6f46-40fd-8623-80ea8478e898 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:31:24.902512 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-773d4be1-6f46-40fd-8623-80ea8478e898 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:31:24.902962 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-773d4be1-6f46-40fd-8623-80ea8478e898 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:31:24.903747 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-773d4be1-6f46-40fd-8623-80ea8478e898 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:31:24.904181 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-773d4be1-6f46-40fd-8623-80ea8478e898 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:31:24.941840 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-773d4be1-6f46-40fd-8623-80ea8478e898 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action" status: 200 len: 16396 microversion: 2.1 time: 0.051704 Jan 15 21:31:24.942466 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3653/7294] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:31:24 2022] POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action => generated 16396 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:31:25.953607 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-1ba5649e-0c36-43a1-85ab-3ebb7f1645ee tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:31:25.954629 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-1ba5649e-0c36-43a1-85ab-3ebb7f1645ee tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:31:25.962457 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1ba5649e-0c36-43a1-85ab-3ebb7f1645ee tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:31:25.963239 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1ba5649e-0c36-43a1-85ab-3ebb7f1645ee tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:31:25.963699 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1ba5649e-0c36-43a1-85ab-3ebb7f1645ee tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:31:25.964163 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1ba5649e-0c36-43a1-85ab-3ebb7f1645ee tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:31:26.003067 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-1ba5649e-0c36-43a1-85ab-3ebb7f1645ee tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action" status: 200 len: 16396 microversion: 2.1 time: 0.053447 Jan 15 21:31:26.003923 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3642/7295] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:31:25 2022] POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action => generated 16396 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:31:27.014974 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-402cdeec-c1db-42df-b5c7-ee4277b975d0 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:31:27.015998 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-402cdeec-c1db-42df-b5c7-ee4277b975d0 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:31:27.023366 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-402cdeec-c1db-42df-b5c7-ee4277b975d0 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:31:27.023815 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-402cdeec-c1db-42df-b5c7-ee4277b975d0 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:31:27.024590 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-402cdeec-c1db-42df-b5c7-ee4277b975d0 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:31:27.025059 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-402cdeec-c1db-42df-b5c7-ee4277b975d0 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:31:27.063575 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-402cdeec-c1db-42df-b5c7-ee4277b975d0 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action" status: 200 len: 16396 microversion: 2.1 time: 0.052602 Jan 15 21:31:27.064194 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3654/7296] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:31:27 2022] POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action => generated 16396 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:31:28.075261 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-1e1b0136-a405-4ad4-9de3-73c68b23eefd tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:31:28.076260 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-1e1b0136-a405-4ad4-9de3-73c68b23eefd tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:31:28.084261 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1e1b0136-a405-4ad4-9de3-73c68b23eefd tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:31:28.084716 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1e1b0136-a405-4ad4-9de3-73c68b23eefd tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:31:28.085528 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1e1b0136-a405-4ad4-9de3-73c68b23eefd tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:31:28.085974 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1e1b0136-a405-4ad4-9de3-73c68b23eefd tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:31:28.133568 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-1e1b0136-a405-4ad4-9de3-73c68b23eefd tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action" status: 200 len: 24571 microversion: 2.1 time: 0.062251 Jan 15 21:31:28.134437 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3643/7297] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:31:28 2022] POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action => generated 24571 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:31:29.146063 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-cbcbfdc3-b922-4a0b-97a6-ed7980f88738 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:31:29.147064 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-cbcbfdc3-b922-4a0b-97a6-ed7980f88738 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:31:29.154375 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cbcbfdc3-b922-4a0b-97a6-ed7980f88738 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:31:29.154829 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cbcbfdc3-b922-4a0b-97a6-ed7980f88738 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:31:29.155600 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cbcbfdc3-b922-4a0b-97a6-ed7980f88738 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:31:29.156036 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cbcbfdc3-b922-4a0b-97a6-ed7980f88738 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:31:29.196116 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-cbcbfdc3-b922-4a0b-97a6-ed7980f88738 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action" status: 200 len: 24571 microversion: 2.1 time: 0.054408 Jan 15 21:31:29.197085 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3655/7298] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:31:29 2022] POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action => generated 24571 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:31:30.208863 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d01266ca-32f7-44b4-aba5-74f1d24887b3 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:31:30.209867 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d01266ca-32f7-44b4-aba5-74f1d24887b3 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:31:30.217086 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d01266ca-32f7-44b4-aba5-74f1d24887b3 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:31:30.217547 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d01266ca-32f7-44b4-aba5-74f1d24887b3 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:31:30.218322 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d01266ca-32f7-44b4-aba5-74f1d24887b3 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:31:30.218762 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d01266ca-32f7-44b4-aba5-74f1d24887b3 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:31:30.256713 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d01266ca-32f7-44b4-aba5-74f1d24887b3 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action" status: 200 len: 24571 microversion: 2.1 time: 0.052480 Jan 15 21:31:30.257591 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3644/7299] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:31:30 2022] POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action => generated 24571 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:31:31.268241 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-23c4d815-60a3-47cf-9cd7-a7cc4cc7f638 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:31:31.269784 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-23c4d815-60a3-47cf-9cd7-a7cc4cc7f638 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:31:31.277483 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-23c4d815-60a3-47cf-9cd7-a7cc4cc7f638 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:31:31.277940 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-23c4d815-60a3-47cf-9cd7-a7cc4cc7f638 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:31:31.278717 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-23c4d815-60a3-47cf-9cd7-a7cc4cc7f638 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:31:31.279147 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-23c4d815-60a3-47cf-9cd7-a7cc4cc7f638 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:31:31.321254 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-23c4d815-60a3-47cf-9cd7-a7cc4cc7f638 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action" status: 200 len: 24571 microversion: 2.1 time: 0.056922 Jan 15 21:31:31.321828 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3656/7300] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:31:31 2022] POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action => generated 24571 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:31:32.333882 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e8a4ce89-5fad-424d-aed2-63ea910c0cdb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:31:32.334901 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e8a4ce89-5fad-424d-aed2-63ea910c0cdb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:31:32.342172 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e8a4ce89-5fad-424d-aed2-63ea910c0cdb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:31:32.342635 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e8a4ce89-5fad-424d-aed2-63ea910c0cdb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:31:32.343415 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e8a4ce89-5fad-424d-aed2-63ea910c0cdb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:31:32.343865 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e8a4ce89-5fad-424d-aed2-63ea910c0cdb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:31:32.388161 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e8a4ce89-5fad-424d-aed2-63ea910c0cdb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action" status: 200 len: 24571 microversion: 2.1 time: 0.058780 Jan 15 21:31:32.388823 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3645/7301] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:31:32 2022] POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action => generated 24571 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:31:33.400179 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f46d0b44-3f10-4dc1-b579-bcc67ba5308e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:31:33.401187 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f46d0b44-3f10-4dc1-b579-bcc67ba5308e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:31:33.408644 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f46d0b44-3f10-4dc1-b579-bcc67ba5308e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:31:33.409111 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f46d0b44-3f10-4dc1-b579-bcc67ba5308e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:31:33.409889 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f46d0b44-3f10-4dc1-b579-bcc67ba5308e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:31:33.410519 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f46d0b44-3f10-4dc1-b579-bcc67ba5308e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:31:33.450028 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f46d0b44-3f10-4dc1-b579-bcc67ba5308e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action" status: 200 len: 24571 microversion: 2.1 time: 0.053857 Jan 15 21:31:33.450652 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3657/7302] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:31:33 2022] POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action => generated 24571 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:31:34.462585 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-430f9152-16bb-4ccf-9026-4e6c3b471a14 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:31:34.463689 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-430f9152-16bb-4ccf-9026-4e6c3b471a14 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:31:34.470916 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-430f9152-16bb-4ccf-9026-4e6c3b471a14 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:31:34.471383 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-430f9152-16bb-4ccf-9026-4e6c3b471a14 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:31:34.472751 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-430f9152-16bb-4ccf-9026-4e6c3b471a14 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:31:34.473228 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-430f9152-16bb-4ccf-9026-4e6c3b471a14 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:31:34.512159 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-430f9152-16bb-4ccf-9026-4e6c3b471a14 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action" status: 200 len: 24571 microversion: 2.1 time: 0.053683 Jan 15 21:31:34.512782 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3646/7303] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:31:34 2022] POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action => generated 24571 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:31:35.523396 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a9ce5ed6-a4cb-4429-afde-1a72811fe3f1 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:31:35.524385 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a9ce5ed6-a4cb-4429-afde-1a72811fe3f1 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:31:35.531629 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a9ce5ed6-a4cb-4429-afde-1a72811fe3f1 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:31:35.532074 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a9ce5ed6-a4cb-4429-afde-1a72811fe3f1 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:31:35.532855 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a9ce5ed6-a4cb-4429-afde-1a72811fe3f1 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:31:35.533542 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a9ce5ed6-a4cb-4429-afde-1a72811fe3f1 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:31:35.574197 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a9ce5ed6-a4cb-4429-afde-1a72811fe3f1 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action" status: 200 len: 24571 microversion: 2.1 time: 0.054842 Jan 15 21:31:35.574848 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3658/7304] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:31:35 2022] POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action => generated 24571 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:31:36.586245 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3003c3f1-565d-45c9-a77f-dc6838aea854 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:31:36.587274 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-3003c3f1-565d-45c9-a77f-dc6838aea854 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:31:36.594669 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3003c3f1-565d-45c9-a77f-dc6838aea854 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:31:36.595140 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3003c3f1-565d-45c9-a77f-dc6838aea854 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:31:36.595936 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3003c3f1-565d-45c9-a77f-dc6838aea854 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:31:36.596392 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3003c3f1-565d-45c9-a77f-dc6838aea854 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:31:36.637233 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3003c3f1-565d-45c9-a77f-dc6838aea854 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action" status: 200 len: 24571 microversion: 2.1 time: 0.054928 Jan 15 21:31:36.637928 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3647/7305] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:31:36 2022] POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action => generated 24571 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:31:37.649140 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-80566dd4-a381-4f67-b555-a1cfa4f9bf37 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:31:37.650037 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-80566dd4-a381-4f67-b555-a1cfa4f9bf37 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:31:37.657297 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-80566dd4-a381-4f67-b555-a1cfa4f9bf37 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:31:37.657743 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-80566dd4-a381-4f67-b555-a1cfa4f9bf37 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:31:37.658770 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-80566dd4-a381-4f67-b555-a1cfa4f9bf37 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:31:37.659197 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-80566dd4-a381-4f67-b555-a1cfa4f9bf37 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:31:37.696992 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-80566dd4-a381-4f67-b555-a1cfa4f9bf37 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action" status: 200 len: 24571 microversion: 2.1 time: 0.052557 Jan 15 21:31:37.697645 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3659/7306] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:31:37 2022] POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action => generated 24571 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:31:38.709235 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-585b658e-2f3b-4e22-a2e0-2cec38a67266 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:31:38.710254 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-585b658e-2f3b-4e22-a2e0-2cec38a67266 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:31:38.717568 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-585b658e-2f3b-4e22-a2e0-2cec38a67266 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:31:38.718035 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-585b658e-2f3b-4e22-a2e0-2cec38a67266 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:31:38.718824 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-585b658e-2f3b-4e22-a2e0-2cec38a67266 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:31:38.719276 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-585b658e-2f3b-4e22-a2e0-2cec38a67266 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:31:38.763106 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-585b658e-2f3b-4e22-a2e0-2cec38a67266 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action" status: 200 len: 24571 microversion: 2.1 time: 0.058885 Jan 15 21:31:38.763962 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3648/7307] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:31:38 2022] POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action => generated 24571 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:31:39.774855 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-dc7e9d3e-de94-4cad-ba95-0aa6c2128101 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:31:39.775857 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-dc7e9d3e-de94-4cad-ba95-0aa6c2128101 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:31:39.783410 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dc7e9d3e-de94-4cad-ba95-0aa6c2128101 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:31:39.783861 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dc7e9d3e-de94-4cad-ba95-0aa6c2128101 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:31:39.784630 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dc7e9d3e-de94-4cad-ba95-0aa6c2128101 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:31:39.785753 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dc7e9d3e-de94-4cad-ba95-0aa6c2128101 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:31:39.826550 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-dc7e9d3e-de94-4cad-ba95-0aa6c2128101 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action" status: 200 len: 24571 microversion: 2.1 time: 0.055645 Jan 15 21:31:39.827199 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3660/7308] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:31:39 2022] POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action => generated 24571 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:31:40.839310 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3a985dbd-342d-412f-95c7-148399c83fe9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:31:40.840327 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-3a985dbd-342d-412f-95c7-148399c83fe9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:31:40.848422 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3a985dbd-342d-412f-95c7-148399c83fe9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:31:40.848925 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3a985dbd-342d-412f-95c7-148399c83fe9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:31:40.849722 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3a985dbd-342d-412f-95c7-148399c83fe9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:31:40.850175 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3a985dbd-342d-412f-95c7-148399c83fe9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:31:40.898952 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3a985dbd-342d-412f-95c7-148399c83fe9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action" status: 200 len: 32641 microversion: 2.1 time: 0.063622 Jan 15 21:31:40.899584 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3649/7309] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:31:40 2022] POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action => generated 32641 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:31:41.911483 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-024ab7e8-afc1-452c-9e8d-f8b1753cb232 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:31:41.912472 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-024ab7e8-afc1-452c-9e8d-f8b1753cb232 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:31:41.919694 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-024ab7e8-afc1-452c-9e8d-f8b1753cb232 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:31:41.920142 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-024ab7e8-afc1-452c-9e8d-f8b1753cb232 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:31:41.920934 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-024ab7e8-afc1-452c-9e8d-f8b1753cb232 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:31:41.921374 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-024ab7e8-afc1-452c-9e8d-f8b1753cb232 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:31:41.961646 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-024ab7e8-afc1-452c-9e8d-f8b1753cb232 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action" status: 200 len: 32641 microversion: 2.1 time: 0.054544 Jan 15 21:31:41.962311 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3661/7310] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:31:41 2022] POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action => generated 32641 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:31:42.973218 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-96a3684e-c73d-4362-b8b6-8c6b6d2a6d63 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:31:42.974258 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-96a3684e-c73d-4362-b8b6-8c6b6d2a6d63 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:31:42.981511 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-96a3684e-c73d-4362-b8b6-8c6b6d2a6d63 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:31:42.981972 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-96a3684e-c73d-4362-b8b6-8c6b6d2a6d63 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:31:42.982751 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-96a3684e-c73d-4362-b8b6-8c6b6d2a6d63 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:31:42.983195 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-96a3684e-c73d-4362-b8b6-8c6b6d2a6d63 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:31:43.022225 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-96a3684e-c73d-4362-b8b6-8c6b6d2a6d63 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action" status: 200 len: 32641 microversion: 2.1 time: 0.053498 Jan 15 21:31:43.023135 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3650/7311] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:31:42 2022] POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action => generated 32641 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:31:44.035144 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-6d2f9e44-b474-4874-8db8-17c41d32f24e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:31:44.036165 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-6d2f9e44-b474-4874-8db8-17c41d32f24e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:31:44.043775 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6d2f9e44-b474-4874-8db8-17c41d32f24e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:31:44.044240 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6d2f9e44-b474-4874-8db8-17c41d32f24e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:31:44.045067 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6d2f9e44-b474-4874-8db8-17c41d32f24e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:31:44.045510 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6d2f9e44-b474-4874-8db8-17c41d32f24e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:31:44.094967 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-6d2f9e44-b474-4874-8db8-17c41d32f24e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action" status: 200 len: 32641 microversion: 2.1 time: 0.064485 Jan 15 21:31:44.095684 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3662/7312] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:31:44 2022] POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action => generated 32641 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:31:45.107037 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-0c9d41fd-1d78-4927-b54c-03e85bf373e0 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:31:45.108083 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-0c9d41fd-1d78-4927-b54c-03e85bf373e0 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:31:45.115315 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0c9d41fd-1d78-4927-b54c-03e85bf373e0 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:31:45.115783 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0c9d41fd-1d78-4927-b54c-03e85bf373e0 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:31:45.116573 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0c9d41fd-1d78-4927-b54c-03e85bf373e0 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:31:45.117060 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0c9d41fd-1d78-4927-b54c-03e85bf373e0 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:31:45.161223 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-0c9d41fd-1d78-4927-b54c-03e85bf373e0 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action" status: 200 len: 32641 microversion: 2.1 time: 0.057677 Jan 15 21:31:45.162377 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3651/7313] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:31:45 2022] POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action => generated 32641 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:31:46.175045 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-be5f9e52-e7b4-4ef9-acdb-9dd05a3f07aa tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:31:46.176584 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-be5f9e52-e7b4-4ef9-acdb-9dd05a3f07aa tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:31:46.184110 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-be5f9e52-e7b4-4ef9-acdb-9dd05a3f07aa tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:31:46.184556 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-be5f9e52-e7b4-4ef9-acdb-9dd05a3f07aa tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:31:46.185367 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-be5f9e52-e7b4-4ef9-acdb-9dd05a3f07aa tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:31:46.185806 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-be5f9e52-e7b4-4ef9-acdb-9dd05a3f07aa tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:31:46.226092 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-be5f9e52-e7b4-4ef9-acdb-9dd05a3f07aa tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action" status: 200 len: 32641 microversion: 2.1 time: 0.054981 Jan 15 21:31:46.226737 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3663/7314] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:31:46 2022] POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action => generated 32641 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:31:47.238988 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9951b920-7bf6-4ccc-bde2-e38ff5d2f7a9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:31:47.240344 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-9951b920-7bf6-4ccc-bde2-e38ff5d2f7a9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:31:47.247696 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9951b920-7bf6-4ccc-bde2-e38ff5d2f7a9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:31:47.248158 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9951b920-7bf6-4ccc-bde2-e38ff5d2f7a9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:31:47.248991 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9951b920-7bf6-4ccc-bde2-e38ff5d2f7a9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:31:47.249447 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9951b920-7bf6-4ccc-bde2-e38ff5d2f7a9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:31:47.288437 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-9951b920-7bf6-4ccc-bde2-e38ff5d2f7a9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action" status: 200 len: 32641 microversion: 2.1 time: 0.054040 Jan 15 21:31:47.289362 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3652/7315] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:31:47 2022] POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action => generated 32641 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:31:48.300027 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4222e582-aaf7-4f2e-b987-364b2da54142 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:31:48.301146 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-4222e582-aaf7-4f2e-b987-364b2da54142 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:31:48.308451 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4222e582-aaf7-4f2e-b987-364b2da54142 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:31:48.308918 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4222e582-aaf7-4f2e-b987-364b2da54142 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:31:48.309692 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4222e582-aaf7-4f2e-b987-364b2da54142 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:31:48.310121 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4222e582-aaf7-4f2e-b987-364b2da54142 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:31:48.349769 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-4222e582-aaf7-4f2e-b987-364b2da54142 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action" status: 200 len: 32641 microversion: 2.1 time: 0.053818 Jan 15 21:31:48.350670 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3664/7316] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:31:48 2022] POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action => generated 32641 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:31:49.361985 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8ae790be-5ef4-48b0-aacf-0f84d2547439 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:31:49.362929 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-8ae790be-5ef4-48b0-aacf-0f84d2547439 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:31:49.371507 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8ae790be-5ef4-48b0-aacf-0f84d2547439 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:31:49.371975 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8ae790be-5ef4-48b0-aacf-0f84d2547439 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:31:49.372776 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8ae790be-5ef4-48b0-aacf-0f84d2547439 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:31:49.373252 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8ae790be-5ef4-48b0-aacf-0f84d2547439 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:31:49.413642 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-8ae790be-5ef4-48b0-aacf-0f84d2547439 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action" status: 200 len: 32641 microversion: 2.1 time: 0.055674 Jan 15 21:31:49.414274 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3653/7317] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:31:49 2022] POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action => generated 32641 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:31:50.425185 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e608ffa6-5283-4433-8202-c776af8883d5 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:31:50.426915 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e608ffa6-5283-4433-8202-c776af8883d5 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:31:50.434234 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e608ffa6-5283-4433-8202-c776af8883d5 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:31:50.434676 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e608ffa6-5283-4433-8202-c776af8883d5 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:31:50.435441 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e608ffa6-5283-4433-8202-c776af8883d5 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:31:50.435871 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e608ffa6-5283-4433-8202-c776af8883d5 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:31:50.476912 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e608ffa6-5283-4433-8202-c776af8883d5 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action" status: 200 len: 32641 microversion: 2.1 time: 0.055654 Jan 15 21:31:50.477589 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3665/7318] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:31:50 2022] POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action => generated 32641 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:31:51.488727 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a512b17c-7b0b-4943-bf85-81ea0683a277 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:31:51.489882 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a512b17c-7b0b-4943-bf85-81ea0683a277 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:31:51.497328 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a512b17c-7b0b-4943-bf85-81ea0683a277 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:31:51.497796 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a512b17c-7b0b-4943-bf85-81ea0683a277 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:31:51.498595 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a512b17c-7b0b-4943-bf85-81ea0683a277 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:31:51.499049 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a512b17c-7b0b-4943-bf85-81ea0683a277 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:31:51.539329 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a512b17c-7b0b-4943-bf85-81ea0683a277 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action" status: 200 len: 32641 microversion: 2.1 time: 0.055031 Jan 15 21:31:51.539977 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3654/7319] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:31:51 2022] POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action => generated 32641 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:31:52.551987 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-44ca2382-29f2-497f-9f3a-77e6538b9994 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:31:52.553003 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-44ca2382-29f2-497f-9f3a-77e6538b9994 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:31:52.560219 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-44ca2382-29f2-497f-9f3a-77e6538b9994 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:31:52.560666 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-44ca2382-29f2-497f-9f3a-77e6538b9994 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:31:52.561468 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-44ca2382-29f2-497f-9f3a-77e6538b9994 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:31:52.561900 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-44ca2382-29f2-497f-9f3a-77e6538b9994 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:31:52.601655 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-44ca2382-29f2-497f-9f3a-77e6538b9994 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action" status: 200 len: 32641 microversion: 2.1 time: 0.054021 Jan 15 21:31:52.602286 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3666/7320] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:31:52 2022] POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action => generated 32641 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:31:53.614519 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8dd25309-83ee-4ea0-bc62-7ee48e4658d3 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:31:53.615520 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-8dd25309-83ee-4ea0-bc62-7ee48e4658d3 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:31:53.622859 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8dd25309-83ee-4ea0-bc62-7ee48e4658d3 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:31:53.623321 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8dd25309-83ee-4ea0-bc62-7ee48e4658d3 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:31:53.624108 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8dd25309-83ee-4ea0-bc62-7ee48e4658d3 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:31:53.624552 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8dd25309-83ee-4ea0-bc62-7ee48e4658d3 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:31:53.663070 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-8dd25309-83ee-4ea0-bc62-7ee48e4658d3 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action" status: 200 len: 32641 microversion: 2.1 time: 0.053088 Jan 15 21:31:53.663695 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3655/7321] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:31:53 2022] POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action => generated 32641 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:31:54.674225 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-2f1533a3-b00e-499b-bda9-97f4269b5c60 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:31:54.675221 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-2f1533a3-b00e-499b-bda9-97f4269b5c60 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:31:54.683101 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2f1533a3-b00e-499b-bda9-97f4269b5c60 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:31:54.683543 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2f1533a3-b00e-499b-bda9-97f4269b5c60 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:31:54.684310 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2f1533a3-b00e-499b-bda9-97f4269b5c60 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:31:54.684742 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2f1533a3-b00e-499b-bda9-97f4269b5c60 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:31:54.728305 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-2f1533a3-b00e-499b-bda9-97f4269b5c60 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action" status: 200 len: 32641 microversion: 2.1 time: 0.058081 Jan 15 21:31:54.728978 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3667/7322] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:31:54 2022] POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action => generated 32641 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:31:55.741368 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8826697b-5f9e-4273-acd9-ccd0ba84c4aa tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:31:55.742489 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-8826697b-5f9e-4273-acd9-ccd0ba84c4aa tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:31:55.750187 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8826697b-5f9e-4273-acd9-ccd0ba84c4aa tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:31:55.750644 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8826697b-5f9e-4273-acd9-ccd0ba84c4aa tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:31:55.751435 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8826697b-5f9e-4273-acd9-ccd0ba84c4aa tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:31:55.751876 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8826697b-5f9e-4273-acd9-ccd0ba84c4aa tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:31:55.796990 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-8826697b-5f9e-4273-acd9-ccd0ba84c4aa tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action" status: 200 len: 32641 microversion: 2.1 time: 0.059963 Jan 15 21:31:55.797999 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3656/7323] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:31:55 2022] POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action => generated 32641 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 21:31:56.809149 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9cb80882-f953-4f72-8801-a3c35137d8b1 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:31:56.810139 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-9cb80882-f953-4f72-8801-a3c35137d8b1 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:31:56.817419 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9cb80882-f953-4f72-8801-a3c35137d8b1 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:31:56.817863 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9cb80882-f953-4f72-8801-a3c35137d8b1 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:31:56.818625 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9cb80882-f953-4f72-8801-a3c35137d8b1 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:31:56.819055 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9cb80882-f953-4f72-8801-a3c35137d8b1 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:31:56.860621 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-9cb80882-f953-4f72-8801-a3c35137d8b1 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action" status: 200 len: 32641 microversion: 2.1 time: 0.055457 Jan 15 21:31:56.861289 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3668/7324] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:31:56 2022] POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action => generated 32641 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:31:57.873256 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-bba05cf0-e87f-43b9-a058-80d28ccc5e9c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:31:57.874303 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-bba05cf0-e87f-43b9-a058-80d28ccc5e9c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:31:57.881710 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bba05cf0-e87f-43b9-a058-80d28ccc5e9c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:31:57.882174 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bba05cf0-e87f-43b9-a058-80d28ccc5e9c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:31:57.882958 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bba05cf0-e87f-43b9-a058-80d28ccc5e9c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:31:57.883406 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bba05cf0-e87f-43b9-a058-80d28ccc5e9c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:31:57.926695 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-bba05cf0-e87f-43b9-a058-80d28ccc5e9c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action" status: 200 len: 32641 microversion: 2.1 time: 0.056681 Jan 15 21:31:57.927341 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3657/7325] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:31:57 2022] POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action => generated 32641 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:31:58.939043 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b63c368c-c96f-4579-8016-20225a53a1c9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:31:58.940022 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b63c368c-c96f-4579-8016-20225a53a1c9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:31:58.947810 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b63c368c-c96f-4579-8016-20225a53a1c9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:31:58.948248 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b63c368c-c96f-4579-8016-20225a53a1c9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:31:58.949053 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b63c368c-c96f-4579-8016-20225a53a1c9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:31:58.949481 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b63c368c-c96f-4579-8016-20225a53a1c9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:31:58.987014 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b63c368c-c96f-4579-8016-20225a53a1c9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action" status: 200 len: 32641 microversion: 2.1 time: 0.052006 Jan 15 21:31:58.987637 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3669/7326] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:31:58 2022] POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action => generated 32641 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:31:59.999532 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-0eea3c60-66dc-4ec7-9d3b-20b9e2b482c4 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:32:00.000548 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-0eea3c60-66dc-4ec7-9d3b-20b9e2b482c4 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:32:00.008807 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0eea3c60-66dc-4ec7-9d3b-20b9e2b482c4 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:32:00.009317 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0eea3c60-66dc-4ec7-9d3b-20b9e2b482c4 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:32:00.010106 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0eea3c60-66dc-4ec7-9d3b-20b9e2b482c4 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:32:00.010550 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0eea3c60-66dc-4ec7-9d3b-20b9e2b482c4 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:32:00.051679 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-0eea3c60-66dc-4ec7-9d3b-20b9e2b482c4 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action" status: 200 len: 32641 microversion: 2.1 time: 0.055795 Jan 15 21:32:00.055642 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3658/7327] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:31:59 2022] POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action => generated 32641 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:32:01.063772 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b3cad04a-3d6d-4425-a0b7-a2c746a84a05 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:32:01.064891 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b3cad04a-3d6d-4425-a0b7-a2c746a84a05 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:32:01.072575 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b3cad04a-3d6d-4425-a0b7-a2c746a84a05 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:32:01.073051 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b3cad04a-3d6d-4425-a0b7-a2c746a84a05 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:32:01.073850 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b3cad04a-3d6d-4425-a0b7-a2c746a84a05 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:32:01.074299 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b3cad04a-3d6d-4425-a0b7-a2c746a84a05 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:32:01.116712 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b3cad04a-3d6d-4425-a0b7-a2c746a84a05 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action" status: 200 len: 32641 microversion: 2.1 time: 0.056797 Jan 15 21:32:01.117404 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3670/7328] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:32:01 2022] POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action => generated 32641 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:32:02.129507 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2d0b0ca0-3aad-4c53-bdfe-098902b7a087 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:32:02.130537 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-2d0b0ca0-3aad-4c53-bdfe-098902b7a087 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:32:02.138072 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2d0b0ca0-3aad-4c53-bdfe-098902b7a087 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:32:02.138534 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2d0b0ca0-3aad-4c53-bdfe-098902b7a087 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:32:02.139321 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2d0b0ca0-3aad-4c53-bdfe-098902b7a087 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:32:02.139764 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2d0b0ca0-3aad-4c53-bdfe-098902b7a087 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:32:02.180986 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2d0b0ca0-3aad-4c53-bdfe-098902b7a087 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action" status: 200 len: 32641 microversion: 2.1 time: 0.055962 Jan 15 21:32:02.181628 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3659/7329] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:32:02 2022] POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action => generated 32641 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:32:03.193858 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-95bf3d7a-c0d8-42ea-b18b-bfa7d59b3f06 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:32:03.194847 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-95bf3d7a-c0d8-42ea-b18b-bfa7d59b3f06 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:32:03.202089 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-95bf3d7a-c0d8-42ea-b18b-bfa7d59b3f06 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:32:03.202540 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-95bf3d7a-c0d8-42ea-b18b-bfa7d59b3f06 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:32:03.203314 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-95bf3d7a-c0d8-42ea-b18b-bfa7d59b3f06 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:32:03.203753 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-95bf3d7a-c0d8-42ea-b18b-bfa7d59b3f06 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:32:03.244695 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-95bf3d7a-c0d8-42ea-b18b-bfa7d59b3f06 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action" status: 200 len: 32641 microversion: 2.1 time: 0.055424 Jan 15 21:32:03.245547 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3671/7330] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:32:03 2022] POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action => generated 32641 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:32:04.257690 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b2fce9b7-e9f9-4a95-be1f-9abc4c7f5157 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:32:04.258754 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b2fce9b7-e9f9-4a95-be1f-9abc4c7f5157 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:32:04.266039 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b2fce9b7-e9f9-4a95-be1f-9abc4c7f5157 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:32:04.266503 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b2fce9b7-e9f9-4a95-be1f-9abc4c7f5157 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:32:04.267287 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b2fce9b7-e9f9-4a95-be1f-9abc4c7f5157 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:32:04.267731 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b2fce9b7-e9f9-4a95-be1f-9abc4c7f5157 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:32:04.306855 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b2fce9b7-e9f9-4a95-be1f-9abc4c7f5157 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action" status: 200 len: 32641 microversion: 2.1 time: 0.053144 Jan 15 21:32:04.307509 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3660/7331] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:32:04 2022] POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action => generated 32641 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:32:05.319226 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0a2f1144-beae-4b9b-ac06-23a7d2dfbfb9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:32:05.320132 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-0a2f1144-beae-4b9b-ac06-23a7d2dfbfb9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:32:05.327563 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0a2f1144-beae-4b9b-ac06-23a7d2dfbfb9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:32:05.328007 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0a2f1144-beae-4b9b-ac06-23a7d2dfbfb9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:32:05.328773 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0a2f1144-beae-4b9b-ac06-23a7d2dfbfb9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:32:05.329230 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0a2f1144-beae-4b9b-ac06-23a7d2dfbfb9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:32:05.368478 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0a2f1144-beae-4b9b-ac06-23a7d2dfbfb9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action" status: 200 len: 32641 microversion: 2.1 time: 0.053558 Jan 15 21:32:05.369162 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3672/7332] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:32:05 2022] POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action => generated 32641 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:32:06.380751 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-120db1bb-5f0e-4933-b363-e328a7c62c26 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:32:06.381806 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-120db1bb-5f0e-4933-b363-e328a7c62c26 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:32:06.389124 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-120db1bb-5f0e-4933-b363-e328a7c62c26 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:32:06.389582 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-120db1bb-5f0e-4933-b363-e328a7c62c26 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:32:06.390366 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-120db1bb-5f0e-4933-b363-e328a7c62c26 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:32:06.390811 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-120db1bb-5f0e-4933-b363-e328a7c62c26 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:32:06.430050 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-120db1bb-5f0e-4933-b363-e328a7c62c26 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action" status: 200 len: 32641 microversion: 2.1 time: 0.053929 Jan 15 21:32:06.430692 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3661/7333] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:32:06 2022] POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action => generated 32641 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:32:07.442229 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-45a9a8cb-4fbd-4b3f-a98b-e00d6418a4fb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:32:07.443284 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-45a9a8cb-4fbd-4b3f-a98b-e00d6418a4fb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:32:07.450462 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-45a9a8cb-4fbd-4b3f-a98b-e00d6418a4fb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:32:07.450905 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-45a9a8cb-4fbd-4b3f-a98b-e00d6418a4fb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:32:07.451672 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-45a9a8cb-4fbd-4b3f-a98b-e00d6418a4fb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:32:07.452098 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-45a9a8cb-4fbd-4b3f-a98b-e00d6418a4fb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:32:07.492561 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-45a9a8cb-4fbd-4b3f-a98b-e00d6418a4fb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action" status: 200 len: 32641 microversion: 2.1 time: 0.054312 Jan 15 21:32:07.493232 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3673/7334] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:32:07 2022] POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action => generated 32641 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:32:08.504933 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5fb0c982-f11d-43a6-bd8a-4cb8dcb6e7f9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:32:08.506166 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-5fb0c982-f11d-43a6-bd8a-4cb8dcb6e7f9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:32:08.513608 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5fb0c982-f11d-43a6-bd8a-4cb8dcb6e7f9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:32:08.514067 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5fb0c982-f11d-43a6-bd8a-4cb8dcb6e7f9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:32:08.514844 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5fb0c982-f11d-43a6-bd8a-4cb8dcb6e7f9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:32:08.515287 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5fb0c982-f11d-43a6-bd8a-4cb8dcb6e7f9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:32:08.555302 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5fb0c982-f11d-43a6-bd8a-4cb8dcb6e7f9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action" status: 200 len: 32641 microversion: 2.1 time: 0.054686 Jan 15 21:32:08.555931 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3662/7335] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:32:08 2022] POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action => generated 32641 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:32:09.567315 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b500121c-62b4-4ddd-88a4-bcde60784cee tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:32:09.568947 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b500121c-62b4-4ddd-88a4-bcde60784cee tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:32:09.576204 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b500121c-62b4-4ddd-88a4-bcde60784cee tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:32:09.576646 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b500121c-62b4-4ddd-88a4-bcde60784cee tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:32:09.577449 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b500121c-62b4-4ddd-88a4-bcde60784cee tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:32:09.577881 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b500121c-62b4-4ddd-88a4-bcde60784cee tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:32:09.619489 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b500121c-62b4-4ddd-88a4-bcde60784cee tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action" status: 200 len: 32641 microversion: 2.1 time: 0.056069 Jan 15 21:32:09.620145 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3674/7336] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:32:09 2022] POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action => generated 32641 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:32:10.631430 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-0b5330b1-e1a3-4657-9d72-8f2a477dcf2d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:32:10.632355 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-0b5330b1-e1a3-4657-9d72-8f2a477dcf2d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:32:10.639615 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0b5330b1-e1a3-4657-9d72-8f2a477dcf2d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:32:10.640076 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0b5330b1-e1a3-4657-9d72-8f2a477dcf2d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:32:10.640883 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0b5330b1-e1a3-4657-9d72-8f2a477dcf2d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:32:10.641328 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0b5330b1-e1a3-4657-9d72-8f2a477dcf2d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:32:10.685980 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-0b5330b1-e1a3-4657-9d72-8f2a477dcf2d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action" status: 200 len: 32641 microversion: 2.1 time: 0.058988 Jan 15 21:32:10.686638 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3663/7337] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:32:10 2022] POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action => generated 32641 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:32:11.697566 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-cefdb3dd-27de-483d-ad23-1d3c39de7e6f tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:32:11.698561 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-cefdb3dd-27de-483d-ad23-1d3c39de7e6f tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:32:11.706152 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cefdb3dd-27de-483d-ad23-1d3c39de7e6f tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:32:11.706607 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cefdb3dd-27de-483d-ad23-1d3c39de7e6f tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:32:11.707394 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cefdb3dd-27de-483d-ad23-1d3c39de7e6f tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:32:11.707860 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cefdb3dd-27de-483d-ad23-1d3c39de7e6f tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:32:11.746650 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-cefdb3dd-27de-483d-ad23-1d3c39de7e6f tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action" status: 200 len: 32641 microversion: 2.1 time: 0.053168 Jan 15 21:32:11.747528 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3675/7338] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:32:11 2022] POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action => generated 32641 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:32:12.758715 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-cceb4d11-41ed-4cd2-a55e-d9742c375dfb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:32:12.759713 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-cceb4d11-41ed-4cd2-a55e-d9742c375dfb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:32:12.767255 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cceb4d11-41ed-4cd2-a55e-d9742c375dfb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:32:12.767725 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cceb4d11-41ed-4cd2-a55e-d9742c375dfb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:32:12.768544 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cceb4d11-41ed-4cd2-a55e-d9742c375dfb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:32:12.769024 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cceb4d11-41ed-4cd2-a55e-d9742c375dfb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:32:12.809001 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-cceb4d11-41ed-4cd2-a55e-d9742c375dfb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action" status: 200 len: 32641 microversion: 2.1 time: 0.054944 Jan 15 21:32:12.809651 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3664/7339] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:32:12 2022] POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action => generated 32641 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:32:13.822002 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7ce68ff8-2370-41d5-9de9-e777b17e265c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:32:13.822994 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-7ce68ff8-2370-41d5-9de9-e777b17e265c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:32:13.830260 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7ce68ff8-2370-41d5-9de9-e777b17e265c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:32:13.830715 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7ce68ff8-2370-41d5-9de9-e777b17e265c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:32:13.831487 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7ce68ff8-2370-41d5-9de9-e777b17e265c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:32:13.831921 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7ce68ff8-2370-41d5-9de9-e777b17e265c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:32:13.870303 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7ce68ff8-2370-41d5-9de9-e777b17e265c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action" status: 200 len: 32641 microversion: 2.1 time: 0.052978 Jan 15 21:32:13.870968 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3676/7340] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:32:13 2022] POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action => generated 32641 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:32:14.882910 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-fa595d51-59c4-45dc-8302-53f3a9c35495 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:32:14.883934 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-fa595d51-59c4-45dc-8302-53f3a9c35495 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:32:14.891335 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fa595d51-59c4-45dc-8302-53f3a9c35495 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:32:14.891802 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fa595d51-59c4-45dc-8302-53f3a9c35495 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:32:14.892601 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fa595d51-59c4-45dc-8302-53f3a9c35495 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:32:14.893085 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fa595d51-59c4-45dc-8302-53f3a9c35495 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:32:14.931284 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-fa595d51-59c4-45dc-8302-53f3a9c35495 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action" status: 200 len: 32641 microversion: 2.1 time: 0.053087 Jan 15 21:32:14.931948 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3665/7341] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:32:14 2022] POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action => generated 32641 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:32:15.942955 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-49056b87-67bb-47cf-8a4a-a8bdbf4d2d9d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:32:15.943952 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-49056b87-67bb-47cf-8a4a-a8bdbf4d2d9d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:32:15.951265 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-49056b87-67bb-47cf-8a4a-a8bdbf4d2d9d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:32:15.951722 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-49056b87-67bb-47cf-8a4a-a8bdbf4d2d9d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:32:15.952495 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-49056b87-67bb-47cf-8a4a-a8bdbf4d2d9d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:32:15.952956 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-49056b87-67bb-47cf-8a4a-a8bdbf4d2d9d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:32:15.992351 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-49056b87-67bb-47cf-8a4a-a8bdbf4d2d9d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action" status: 200 len: 32641 microversion: 2.1 time: 0.052612 Jan 15 21:32:15.993126 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3677/7342] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:32:15 2022] POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action => generated 32641 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:32:17.004802 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9d89d66a-8f53-4060-b386-5e734e55583e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:32:17.005871 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-9d89d66a-8f53-4060-b386-5e734e55583e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:32:17.012968 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9d89d66a-8f53-4060-b386-5e734e55583e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:32:17.013429 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9d89d66a-8f53-4060-b386-5e734e55583e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:32:17.014214 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9d89d66a-8f53-4060-b386-5e734e55583e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:32:17.014658 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9d89d66a-8f53-4060-b386-5e734e55583e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:32:17.055545 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-9d89d66a-8f53-4060-b386-5e734e55583e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action" status: 200 len: 32641 microversion: 2.1 time: 0.054988 Jan 15 21:32:17.056451 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3666/7343] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:32:16 2022] POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action => generated 32641 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:32:18.067284 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7f138eae-ba94-42aa-86b5-eda6e7682231 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:32:18.068277 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-7f138eae-ba94-42aa-86b5-eda6e7682231 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:32:18.075652 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7f138eae-ba94-42aa-86b5-eda6e7682231 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:32:18.076125 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7f138eae-ba94-42aa-86b5-eda6e7682231 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:32:18.076924 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7f138eae-ba94-42aa-86b5-eda6e7682231 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:32:18.077363 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7f138eae-ba94-42aa-86b5-eda6e7682231 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:32:18.117820 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7f138eae-ba94-42aa-86b5-eda6e7682231 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action" status: 200 len: 32641 microversion: 2.1 time: 0.053587 Jan 15 21:32:18.118382 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3678/7344] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:32:18 2022] POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action => generated 32641 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:32:19.129582 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ecc60a69-f68a-4e07-8c46-e6b19403c2bc tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:32:19.130587 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ecc60a69-f68a-4e07-8c46-e6b19403c2bc tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:32:19.139064 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ecc60a69-f68a-4e07-8c46-e6b19403c2bc tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:32:19.139533 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ecc60a69-f68a-4e07-8c46-e6b19403c2bc tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:32:19.140335 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ecc60a69-f68a-4e07-8c46-e6b19403c2bc tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:32:19.140793 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ecc60a69-f68a-4e07-8c46-e6b19403c2bc tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:32:19.179848 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ecc60a69-f68a-4e07-8c46-e6b19403c2bc tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action" status: 200 len: 32641 microversion: 2.1 time: 0.053679 Jan 15 21:32:19.180485 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3667/7345] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:32:19 2022] POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action => generated 32641 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:32:20.191937 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ee58cd47-a113-4b96-a0dc-76277df6cdbd tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:32:20.192985 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ee58cd47-a113-4b96-a0dc-76277df6cdbd tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:32:20.200895 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ee58cd47-a113-4b96-a0dc-76277df6cdbd tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:32:20.201351 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ee58cd47-a113-4b96-a0dc-76277df6cdbd tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:32:20.202135 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ee58cd47-a113-4b96-a0dc-76277df6cdbd tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:32:20.202577 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ee58cd47-a113-4b96-a0dc-76277df6cdbd tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:32:20.242087 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ee58cd47-a113-4b96-a0dc-76277df6cdbd tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action" status: 200 len: 32641 microversion: 2.1 time: 0.053996 Jan 15 21:32:20.242731 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3679/7346] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:32:20 2022] POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action => generated 32641 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:32:21.254154 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-af0cb291-e5b2-4f1d-9447-b66444aef907 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:32:21.255179 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-af0cb291-e5b2-4f1d-9447-b66444aef907 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:32:21.262683 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-af0cb291-e5b2-4f1d-9447-b66444aef907 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:32:21.263148 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-af0cb291-e5b2-4f1d-9447-b66444aef907 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:32:21.263933 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-af0cb291-e5b2-4f1d-9447-b66444aef907 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:32:21.264382 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-af0cb291-e5b2-4f1d-9447-b66444aef907 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:32:21.304564 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-af0cb291-e5b2-4f1d-9447-b66444aef907 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action" status: 200 len: 32641 microversion: 2.1 time: 0.053802 Jan 15 21:32:21.305516 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3668/7347] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:32:21 2022] POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action => generated 32641 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:32:22.316161 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c563f878-aa77-4afa-a489-15822d3fdedd tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:32:22.317186 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c563f878-aa77-4afa-a489-15822d3fdedd tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:32:22.325176 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c563f878-aa77-4afa-a489-15822d3fdedd tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:32:22.325620 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c563f878-aa77-4afa-a489-15822d3fdedd tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:32:22.326391 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c563f878-aa77-4afa-a489-15822d3fdedd tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:32:22.326822 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c563f878-aa77-4afa-a489-15822d3fdedd tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:32:22.369412 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c563f878-aa77-4afa-a489-15822d3fdedd tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action" status: 200 len: 32641 microversion: 2.1 time: 0.057221 Jan 15 21:32:22.370222 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3680/7348] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:32:22 2022] POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action => generated 32641 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:32:23.381611 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c2cd61cc-7eb6-4509-b323-011725f9ab55 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:32:23.382626 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c2cd61cc-7eb6-4509-b323-011725f9ab55 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:32:23.390744 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c2cd61cc-7eb6-4509-b323-011725f9ab55 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:32:23.391230 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c2cd61cc-7eb6-4509-b323-011725f9ab55 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:32:23.392143 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c2cd61cc-7eb6-4509-b323-011725f9ab55 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:32:23.392737 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c2cd61cc-7eb6-4509-b323-011725f9ab55 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:32:23.435262 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c2cd61cc-7eb6-4509-b323-011725f9ab55 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action" status: 200 len: 32641 microversion: 2.1 time: 0.057573 Jan 15 21:32:23.435898 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3669/7349] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:32:23 2022] POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action => generated 32641 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:32:24.448034 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-69a5dcc6-09dd-43d0-be6f-749f85982f8d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:32:24.449095 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-69a5dcc6-09dd-43d0-be6f-749f85982f8d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:32:24.456321 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-69a5dcc6-09dd-43d0-be6f-749f85982f8d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:32:24.456766 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-69a5dcc6-09dd-43d0-be6f-749f85982f8d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:32:24.457635 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-69a5dcc6-09dd-43d0-be6f-749f85982f8d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:32:24.458069 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-69a5dcc6-09dd-43d0-be6f-749f85982f8d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:32:24.500176 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-69a5dcc6-09dd-43d0-be6f-749f85982f8d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action" status: 200 len: 32641 microversion: 2.1 time: 0.056670 Jan 15 21:32:24.500825 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3681/7350] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:32:24 2022] POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action => generated 32641 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:32:25.511767 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c626f7c9-9f43-4b2e-a593-65159d5df20b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:32:25.512876 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c626f7c9-9f43-4b2e-a593-65159d5df20b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:32:25.520190 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c626f7c9-9f43-4b2e-a593-65159d5df20b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:32:25.520659 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c626f7c9-9f43-4b2e-a593-65159d5df20b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:32:25.521467 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c626f7c9-9f43-4b2e-a593-65159d5df20b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:32:25.521918 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c626f7c9-9f43-4b2e-a593-65159d5df20b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:32:25.560933 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c626f7c9-9f43-4b2e-a593-65159d5df20b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action" status: 200 len: 32641 microversion: 2.1 time: 0.053185 Jan 15 21:32:25.561704 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3670/7351] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:32:25 2022] POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action => generated 32641 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:32:26.573410 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-5209be55-deb0-4a01-afc9-9cbf9c34b956 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:32:26.574395 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-5209be55-deb0-4a01-afc9-9cbf9c34b956 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:32:26.581811 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5209be55-deb0-4a01-afc9-9cbf9c34b956 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:32:26.582262 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5209be55-deb0-4a01-afc9-9cbf9c34b956 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:32:26.583029 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5209be55-deb0-4a01-afc9-9cbf9c34b956 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:32:26.583463 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5209be55-deb0-4a01-afc9-9cbf9c34b956 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:32:26.621313 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-5209be55-deb0-4a01-afc9-9cbf9c34b956 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action" status: 200 len: 32641 microversion: 2.1 time: 0.052574 Jan 15 21:32:26.621968 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3682/7352] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:32:26 2022] POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action => generated 32641 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:32:27.633980 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3ea24d2c-b9a5-4fad-8950-fcf2ae176266 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:32:27.634858 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-3ea24d2c-b9a5-4fad-8950-fcf2ae176266 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:32:27.642124 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3ea24d2c-b9a5-4fad-8950-fcf2ae176266 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:32:27.642586 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3ea24d2c-b9a5-4fad-8950-fcf2ae176266 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:32:27.643369 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3ea24d2c-b9a5-4fad-8950-fcf2ae176266 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:32:27.643815 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3ea24d2c-b9a5-4fad-8950-fcf2ae176266 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:32:27.683218 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3ea24d2c-b9a5-4fad-8950-fcf2ae176266 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action" status: 200 len: 32641 microversion: 2.1 time: 0.053884 Jan 15 21:32:27.684084 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3671/7353] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:32:27 2022] POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action => generated 32641 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:32:28.695602 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e2c8a3e2-062b-4730-a251-25392c7e1d2b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:32:28.696616 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e2c8a3e2-062b-4730-a251-25392c7e1d2b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:32:28.704076 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e2c8a3e2-062b-4730-a251-25392c7e1d2b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:32:28.704527 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e2c8a3e2-062b-4730-a251-25392c7e1d2b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:32:28.705343 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e2c8a3e2-062b-4730-a251-25392c7e1d2b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:32:28.705786 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e2c8a3e2-062b-4730-a251-25392c7e1d2b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:32:28.745830 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e2c8a3e2-062b-4730-a251-25392c7e1d2b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action" status: 200 len: 32641 microversion: 2.1 time: 0.054344 Jan 15 21:32:28.746715 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3683/7354] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:32:28 2022] POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action => generated 32641 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:32:29.758101 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5468729f-ec20-447e-9412-11355d4e0ca3 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:32:29.759151 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-5468729f-ec20-447e-9412-11355d4e0ca3 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:32:29.766486 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5468729f-ec20-447e-9412-11355d4e0ca3 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:32:29.766951 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5468729f-ec20-447e-9412-11355d4e0ca3 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:32:29.767742 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5468729f-ec20-447e-9412-11355d4e0ca3 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:32:29.768189 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5468729f-ec20-447e-9412-11355d4e0ca3 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:32:29.806828 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5468729f-ec20-447e-9412-11355d4e0ca3 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action" status: 200 len: 32641 microversion: 2.1 time: 0.053400 Jan 15 21:32:29.807448 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3672/7355] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:32:29 2022] POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action => generated 32641 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:32:30.818947 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-79b9a2bf-94e9-4341-8f76-d6a8be704244 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:32:30.820931 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-79b9a2bf-94e9-4341-8f76-d6a8be704244 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:32:30.828673 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-79b9a2bf-94e9-4341-8f76-d6a8be704244 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:32:30.829152 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-79b9a2bf-94e9-4341-8f76-d6a8be704244 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:32:30.829922 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-79b9a2bf-94e9-4341-8f76-d6a8be704244 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:32:30.830357 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-79b9a2bf-94e9-4341-8f76-d6a8be704244 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:32:30.870131 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-79b9a2bf-94e9-4341-8f76-d6a8be704244 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action" status: 200 len: 32641 microversion: 2.1 time: 0.055134 Jan 15 21:32:30.870811 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3684/7356] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:32:30 2022] POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action => generated 32641 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:32:31.882847 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-608207c7-c538-460f-aaca-ef49b886bcf0 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:32:31.883881 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-608207c7-c538-460f-aaca-ef49b886bcf0 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:32:31.891181 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-608207c7-c538-460f-aaca-ef49b886bcf0 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:32:31.891641 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-608207c7-c538-460f-aaca-ef49b886bcf0 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:32:31.892420 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-608207c7-c538-460f-aaca-ef49b886bcf0 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:32:31.892882 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-608207c7-c538-460f-aaca-ef49b886bcf0 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:32:31.930782 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-608207c7-c538-460f-aaca-ef49b886bcf0 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action" status: 200 len: 32641 microversion: 2.1 time: 0.052501 Jan 15 21:32:31.931691 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3673/7357] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:32:31 2022] POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action => generated 32641 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:32:32.942839 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-6e6ff3c3-33f2-41cc-8a3a-1fc3d716e5f5 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:32:32.943832 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-6e6ff3c3-33f2-41cc-8a3a-1fc3d716e5f5 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:32:32.951795 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6e6ff3c3-33f2-41cc-8a3a-1fc3d716e5f5 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:32:32.952240 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6e6ff3c3-33f2-41cc-8a3a-1fc3d716e5f5 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:32:32.953352 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6e6ff3c3-33f2-41cc-8a3a-1fc3d716e5f5 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:32:32.953789 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6e6ff3c3-33f2-41cc-8a3a-1fc3d716e5f5 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:32:32.993402 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-6e6ff3c3-33f2-41cc-8a3a-1fc3d716e5f5 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action" status: 200 len: 32641 microversion: 2.1 time: 0.054456 Jan 15 21:32:32.994270 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3685/7358] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:32:32 2022] POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action => generated 32641 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:32:34.005628 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-1025d710-8af8-4f5b-a919-da509a925b1b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:32:34.006721 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-1025d710-8af8-4f5b-a919-da509a925b1b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:32:34.014049 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1025d710-8af8-4f5b-a919-da509a925b1b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:32:34.014516 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1025d710-8af8-4f5b-a919-da509a925b1b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:32:34.015309 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1025d710-8af8-4f5b-a919-da509a925b1b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:32:34.015760 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1025d710-8af8-4f5b-a919-da509a925b1b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:32:34.057176 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-1025d710-8af8-4f5b-a919-da509a925b1b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action" status: 200 len: 32641 microversion: 2.1 time: 0.055340 Jan 15 21:32:34.057809 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3674/7359] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:32:34 2022] POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action => generated 32641 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:32:35.070098 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8b1acb63-de8b-41fc-bc16-ca8d2280ce04 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:32:35.071256 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-8b1acb63-de8b-41fc-bc16-ca8d2280ce04 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:32:35.079145 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8b1acb63-de8b-41fc-bc16-ca8d2280ce04 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:32:35.079145 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8b1acb63-de8b-41fc-bc16-ca8d2280ce04 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:32:35.079862 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8b1acb63-de8b-41fc-bc16-ca8d2280ce04 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:32:35.080296 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8b1acb63-de8b-41fc-bc16-ca8d2280ce04 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:32:35.122002 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-8b1acb63-de8b-41fc-bc16-ca8d2280ce04 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action" status: 200 len: 32641 microversion: 2.1 time: 0.056581 Jan 15 21:32:35.122905 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3686/7360] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:32:35 2022] POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action => generated 32641 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:32:36.134558 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-158af851-1787-49ba-8d96-fe937deb13fb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:32:36.135557 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-158af851-1787-49ba-8d96-fe937deb13fb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:32:36.142820 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-158af851-1787-49ba-8d96-fe937deb13fb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:32:36.143278 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-158af851-1787-49ba-8d96-fe937deb13fb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:32:36.144054 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-158af851-1787-49ba-8d96-fe937deb13fb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:32:36.144493 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-158af851-1787-49ba-8d96-fe937deb13fb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:32:36.185273 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-158af851-1787-49ba-8d96-fe937deb13fb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action" status: 200 len: 32641 microversion: 2.1 time: 0.055088 Jan 15 21:32:36.185903 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3675/7361] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:32:36 2022] POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action => generated 32641 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:32:37.196635 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-278e246e-b05c-488e-9e73-5ec3654ca529 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:32:37.199880 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-278e246e-b05c-488e-9e73-5ec3654ca529 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:32:37.204867 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-278e246e-b05c-488e-9e73-5ec3654ca529 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:32:37.205558 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-278e246e-b05c-488e-9e73-5ec3654ca529 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:32:37.206325 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-278e246e-b05c-488e-9e73-5ec3654ca529 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:32:37.206756 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-278e246e-b05c-488e-9e73-5ec3654ca529 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:32:37.246118 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-278e246e-b05c-488e-9e73-5ec3654ca529 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action" status: 200 len: 32641 microversion: 2.1 time: 0.053470 Jan 15 21:32:37.246752 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3687/7362] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:32:37 2022] POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action => generated 32641 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:32:38.258048 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5c071241-c547-4ede-baa2-03b763c433dd tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:32:38.259067 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-5c071241-c547-4ede-baa2-03b763c433dd tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:32:38.266437 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5c071241-c547-4ede-baa2-03b763c433dd tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:32:38.266907 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5c071241-c547-4ede-baa2-03b763c433dd tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:32:38.267702 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5c071241-c547-4ede-baa2-03b763c433dd tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:32:38.268158 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5c071241-c547-4ede-baa2-03b763c433dd tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:32:38.307047 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5c071241-c547-4ede-baa2-03b763c433dd tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action" status: 200 len: 32641 microversion: 2.1 time: 0.053309 Jan 15 21:32:38.307678 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3676/7363] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:32:38 2022] POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action => generated 32641 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:32:39.319101 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-6f3e0479-a615-4169-b8d1-c2e540a92853 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:32:39.320698 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-6f3e0479-a615-4169-b8d1-c2e540a92853 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:32:39.328092 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6f3e0479-a615-4169-b8d1-c2e540a92853 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:32:39.328550 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6f3e0479-a615-4169-b8d1-c2e540a92853 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:32:39.329367 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6f3e0479-a615-4169-b8d1-c2e540a92853 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:32:39.329811 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6f3e0479-a615-4169-b8d1-c2e540a92853 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:32:39.368456 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-6f3e0479-a615-4169-b8d1-c2e540a92853 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action" status: 200 len: 32641 microversion: 2.1 time: 0.053225 Jan 15 21:32:39.369177 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3688/7364] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:32:39 2022] POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action => generated 32641 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:32:40.381245 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-76662c6a-724c-49b4-ae38-ac6deb0b3f8e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:32:40.382892 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-76662c6a-724c-49b4-ae38-ac6deb0b3f8e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:32:40.390253 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-76662c6a-724c-49b4-ae38-ac6deb0b3f8e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:32:40.390718 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-76662c6a-724c-49b4-ae38-ac6deb0b3f8e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:32:40.391543 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-76662c6a-724c-49b4-ae38-ac6deb0b3f8e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:32:40.391992 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-76662c6a-724c-49b4-ae38-ac6deb0b3f8e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:32:40.432736 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-76662c6a-724c-49b4-ae38-ac6deb0b3f8e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action" status: 200 len: 32641 microversion: 2.1 time: 0.055456 Jan 15 21:32:40.433645 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3677/7365] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:32:40 2022] POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action => generated 32641 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:32:41.444545 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-dcbff13d-2e9e-4824-b383-333fc5e0af67 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:32:41.445576 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-dcbff13d-2e9e-4824-b383-333fc5e0af67 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:32:41.452951 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dcbff13d-2e9e-4824-b383-333fc5e0af67 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:32:41.453409 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dcbff13d-2e9e-4824-b383-333fc5e0af67 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:32:41.454189 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dcbff13d-2e9e-4824-b383-333fc5e0af67 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:32:41.454631 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dcbff13d-2e9e-4824-b383-333fc5e0af67 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:32:41.495499 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-dcbff13d-2e9e-4824-b383-333fc5e0af67 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action" status: 200 len: 32641 microversion: 2.1 time: 0.054969 Jan 15 21:32:41.496139 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3689/7366] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:32:41 2022] POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action => generated 32641 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:32:42.507612 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-fa59a7da-f207-4827-b8d2-762e6791e34d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:32:42.508654 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-fa59a7da-f207-4827-b8d2-762e6791e34d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:32:42.515986 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fa59a7da-f207-4827-b8d2-762e6791e34d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:32:42.516452 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fa59a7da-f207-4827-b8d2-762e6791e34d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:32:42.517267 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fa59a7da-f207-4827-b8d2-762e6791e34d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:32:42.517717 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fa59a7da-f207-4827-b8d2-762e6791e34d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:32:42.556005 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-fa59a7da-f207-4827-b8d2-762e6791e34d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action" status: 200 len: 32641 microversion: 2.1 time: 0.052887 Jan 15 21:32:42.556623 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3678/7367] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:32:42 2022] POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action => generated 32641 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:32:43.568076 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d723f7c3-64b1-4b4c-af63-3a683d8981f5 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:32:43.569684 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-d723f7c3-64b1-4b4c-af63-3a683d8981f5 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:32:43.576973 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d723f7c3-64b1-4b4c-af63-3a683d8981f5 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:32:43.577431 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d723f7c3-64b1-4b4c-af63-3a683d8981f5 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:32:43.578219 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d723f7c3-64b1-4b4c-af63-3a683d8981f5 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:32:43.578658 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d723f7c3-64b1-4b4c-af63-3a683d8981f5 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:32:43.618305 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d723f7c3-64b1-4b4c-af63-3a683d8981f5 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action" status: 200 len: 32641 microversion: 2.1 time: 0.054228 Jan 15 21:32:43.618943 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3690/7368] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:32:43 2022] POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action => generated 32641 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:32:44.630332 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-db9a8fce-90f2-4fed-93af-dab4c60c9d3b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:32:44.631280 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-db9a8fce-90f2-4fed-93af-dab4c60c9d3b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:32:44.638662 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-db9a8fce-90f2-4fed-93af-dab4c60c9d3b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:32:44.639126 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-db9a8fce-90f2-4fed-93af-dab4c60c9d3b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:32:44.639916 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-db9a8fce-90f2-4fed-93af-dab4c60c9d3b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:32:44.640364 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-db9a8fce-90f2-4fed-93af-dab4c60c9d3b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:32:44.680664 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-db9a8fce-90f2-4fed-93af-dab4c60c9d3b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action" status: 200 len: 32641 microversion: 2.1 time: 0.054268 Jan 15 21:32:44.681390 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3679/7369] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:32:44 2022] POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action => generated 32641 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:32:45.692896 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-78ce59ea-3abc-4e57-96a4-78a6afac723b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:32:45.693905 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-78ce59ea-3abc-4e57-96a4-78a6afac723b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:32:45.701170 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-78ce59ea-3abc-4e57-96a4-78a6afac723b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:32:45.701632 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-78ce59ea-3abc-4e57-96a4-78a6afac723b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:32:45.702464 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-78ce59ea-3abc-4e57-96a4-78a6afac723b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:32:45.702901 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-78ce59ea-3abc-4e57-96a4-78a6afac723b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:32:45.746569 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-78ce59ea-3abc-4e57-96a4-78a6afac723b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action" status: 200 len: 32641 microversion: 2.1 time: 0.057652 Jan 15 21:32:45.747230 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3691/7370] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:32:45 2022] POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action => generated 32641 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:32:46.758725 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-7e5e834c-e931-4239-a9a3-7589a87e810b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:32:46.759732 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-7e5e834c-e931-4239-a9a3-7589a87e810b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:32:46.766655 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7e5e834c-e931-4239-a9a3-7589a87e810b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:32:46.767115 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7e5e834c-e931-4239-a9a3-7589a87e810b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:32:46.767894 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7e5e834c-e931-4239-a9a3-7589a87e810b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:32:46.768342 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7e5e834c-e931-4239-a9a3-7589a87e810b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:32:46.809455 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-7e5e834c-e931-4239-a9a3-7589a87e810b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action" status: 200 len: 32641 microversion: 2.1 time: 0.055485 Jan 15 21:32:46.810082 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3680/7371] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:32:46 2022] POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action => generated 32641 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:32:47.822209 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7726e966-d0af-40b4-bc14-2605a4fc531e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:32:47.823206 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-7726e966-d0af-40b4-bc14-2605a4fc531e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:32:47.830845 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7726e966-d0af-40b4-bc14-2605a4fc531e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:32:47.831297 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7726e966-d0af-40b4-bc14-2605a4fc531e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:32:47.832078 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7726e966-d0af-40b4-bc14-2605a4fc531e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:32:47.832526 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7726e966-d0af-40b4-bc14-2605a4fc531e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:32:47.887588 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7726e966-d0af-40b4-bc14-2605a4fc531e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action" status: 200 len: 40787 microversion: 2.1 time: 0.069872 Jan 15 21:32:47.888240 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3692/7372] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:32:47 2022] POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action => generated 40787 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:32:47.899618 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5ae6717c-7fe6-42c5-8f8d-892c6d936c40 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:32:47.900328 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-5ae6717c-7fe6-42c5-8f8d-892c6d936c40 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:32:47.907586 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5ae6717c-7fe6-42c5-8f8d-892c6d936c40 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:32:47.908042 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5ae6717c-7fe6-42c5-8f8d-892c6d936c40 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:32:47.908819 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5ae6717c-7fe6-42c5-8f8d-892c6d936c40 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:32:47.909540 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5ae6717c-7fe6-42c5-8f8d-892c6d936c40 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:32:48.057063 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-5ae6717c-7fe6-42c5-8f8d-892c6d936c40 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:32:48.064472 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5ae6717c-7fe6-42c5-8f8d-892c6d936c40 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df" status: 200 len: 1668 microversion: 2.1 time: 0.169670 Jan 15 21:32:48.065067 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3681/7373] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:32:47 2022] GET /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df => generated 1668 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:32:48.081735 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-250ecffd-64ef-446a-b183-1ec107e22e09 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:32:48.082697 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-250ecffd-64ef-446a-b183-1ec107e22e09 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:32:48.090132 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-250ecffd-64ef-446a-b183-1ec107e22e09 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:32:48.090573 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-250ecffd-64ef-446a-b183-1ec107e22e09 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:32:48.091345 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-250ecffd-64ef-446a-b183-1ec107e22e09 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:32:48.091777 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-250ecffd-64ef-446a-b183-1ec107e22e09 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:32:48.123159 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-250ecffd-64ef-446a-b183-1ec107e22e09 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:32:48.128787 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-250ecffd-64ef-446a-b183-1ec107e22e09 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Old instance type m1.heat2, new instance type m1.heat {{(pid=129366) resize /opt/stack/nova/nova/compute/api.py:4097}} Jan 15 21:32:48.135294 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-250ecffd-64ef-446a-b183-1ec107e22e09 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Flavor limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 21:32:48.135707 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-250ecffd-64ef-446a-b183-1ec107e22e09 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Image limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 21:32:48.136174 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-250ecffd-64ef-446a-b183-1ec107e22e09 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Flavor pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 21:32:48.136574 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-250ecffd-64ef-446a-b183-1ec107e22e09 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Image pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 21:32:48.137076 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-250ecffd-64ef-446a-b183-1ec107e22e09 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 21:32:48.198153 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-250ecffd-64ef-446a-b183-1ec107e22e09 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action" status: 202 len: 0 microversion: 2.1 time: 0.120420 Jan 15 21:32:48.198784 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3693/7374] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:32:48 2022] POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:32:48.206734 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d1ac6a22-d97e-4aea-9643-6129ed7d4e0c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:32:48.207354 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d1ac6a22-d97e-4aea-9643-6129ed7d4e0c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:32:48.214487 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d1ac6a22-d97e-4aea-9643-6129ed7d4e0c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:32:48.214977 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d1ac6a22-d97e-4aea-9643-6129ed7d4e0c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:32:48.215966 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d1ac6a22-d97e-4aea-9643-6129ed7d4e0c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:32:48.216414 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d1ac6a22-d97e-4aea-9643-6129ed7d4e0c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:32:48.377041 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-d1ac6a22-d97e-4aea-9643-6129ed7d4e0c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:32:48.385193 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d1ac6a22-d97e-4aea-9643-6129ed7d4e0c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df" status: 200 len: 1677 microversion: 2.1 time: 0.182139 Jan 15 21:32:48.385777 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3682/7375] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:32:48 2022] GET /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df => generated 1677 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:32:49.403723 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ac7b4de5-d4a3-4706-a10d-5c063d85c301 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:32:49.404362 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ac7b4de5-d4a3-4706-a10d-5c063d85c301 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:32:49.411646 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ac7b4de5-d4a3-4706-a10d-5c063d85c301 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:32:49.412242 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ac7b4de5-d4a3-4706-a10d-5c063d85c301 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:32:49.413063 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ac7b4de5-d4a3-4706-a10d-5c063d85c301 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:32:49.413496 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ac7b4de5-d4a3-4706-a10d-5c063d85c301 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:32:49.553520 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-ac7b4de5-d4a3-4706-a10d-5c063d85c301 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:32:49.561816 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ac7b4de5-d4a3-4706-a10d-5c063d85c301 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df" status: 200 len: 1677 microversion: 2.1 time: 0.163149 Jan 15 21:32:49.562399 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3694/7376] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:32:49 2022] GET /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df => generated 1677 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:32:50.579265 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-1e8324c5-0daf-4107-97e3-746243a2d56d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:32:50.579893 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-1e8324c5-0daf-4107-97e3-746243a2d56d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:32:50.586663 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1e8324c5-0daf-4107-97e3-746243a2d56d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:32:50.587224 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1e8324c5-0daf-4107-97e3-746243a2d56d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:32:50.588011 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1e8324c5-0daf-4107-97e3-746243a2d56d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:32:50.588458 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1e8324c5-0daf-4107-97e3-746243a2d56d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:32:50.719669 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-1e8324c5-0daf-4107-97e3-746243a2d56d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:32:50.727126 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-1e8324c5-0daf-4107-97e3-746243a2d56d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df" status: 200 len: 1682 microversion: 2.1 time: 0.151510 Jan 15 21:32:50.727697 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3683/7377] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:32:50 2022] GET /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:32:51.744473 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-6ba7dfa5-b512-4089-911d-3250bf113fe5 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:32:51.745111 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-6ba7dfa5-b512-4089-911d-3250bf113fe5 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:32:51.751966 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6ba7dfa5-b512-4089-911d-3250bf113fe5 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:32:51.752436 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6ba7dfa5-b512-4089-911d-3250bf113fe5 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:32:51.753222 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6ba7dfa5-b512-4089-911d-3250bf113fe5 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:32:51.753658 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6ba7dfa5-b512-4089-911d-3250bf113fe5 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:32:51.884318 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-6ba7dfa5-b512-4089-911d-3250bf113fe5 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:32:51.891729 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-6ba7dfa5-b512-4089-911d-3250bf113fe5 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df" status: 200 len: 1682 microversion: 2.1 time: 0.151079 Jan 15 21:32:51.892301 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3695/7378] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:32:51 2022] GET /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:32:52.909413 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b8445e8c-fa24-45fb-a86b-8a487c4acfea tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:32:52.910038 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b8445e8c-fa24-45fb-a86b-8a487c4acfea tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:32:52.917460 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b8445e8c-fa24-45fb-a86b-8a487c4acfea tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:32:52.917914 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b8445e8c-fa24-45fb-a86b-8a487c4acfea tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:32:52.918688 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b8445e8c-fa24-45fb-a86b-8a487c4acfea tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:32:52.919130 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b8445e8c-fa24-45fb-a86b-8a487c4acfea tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:32:53.053674 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-b8445e8c-fa24-45fb-a86b-8a487c4acfea tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:32:53.061154 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b8445e8c-fa24-45fb-a86b-8a487c4acfea tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df" status: 200 len: 1682 microversion: 2.1 time: 0.155648 Jan 15 21:32:53.061729 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3684/7379] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:32:52 2022] GET /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:32:54.078481 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1669f5b5-3ca8-4139-8407-ae464a480227 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:32:54.079108 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-1669f5b5-3ca8-4139-8407-ae464a480227 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:32:54.085888 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1669f5b5-3ca8-4139-8407-ae464a480227 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:32:54.086345 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1669f5b5-3ca8-4139-8407-ae464a480227 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:32:54.087114 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1669f5b5-3ca8-4139-8407-ae464a480227 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:32:54.087548 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1669f5b5-3ca8-4139-8407-ae464a480227 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:32:54.230537 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-1669f5b5-3ca8-4139-8407-ae464a480227 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:32:54.237996 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-1669f5b5-3ca8-4139-8407-ae464a480227 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df" status: 200 len: 1682 microversion: 2.1 time: 0.163231 Jan 15 21:32:54.238578 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3696/7380] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:32:54 2022] GET /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:32:55.263206 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-15ee96ca-d0f2-4e80-9af5-0ec759eced06 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:32:55.263857 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-15ee96ca-d0f2-4e80-9af5-0ec759eced06 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:32:55.270696 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-15ee96ca-d0f2-4e80-9af5-0ec759eced06 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:32:55.271156 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-15ee96ca-d0f2-4e80-9af5-0ec759eced06 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:32:55.271942 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-15ee96ca-d0f2-4e80-9af5-0ec759eced06 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:32:55.272393 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-15ee96ca-d0f2-4e80-9af5-0ec759eced06 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:32:55.405872 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-15ee96ca-d0f2-4e80-9af5-0ec759eced06 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:32:55.413465 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-15ee96ca-d0f2-4e80-9af5-0ec759eced06 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df" status: 200 len: 1682 microversion: 2.1 time: 0.153940 Jan 15 21:32:55.414574 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3685/7381] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:32:55 2022] GET /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:32:56.431093 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f1611679-a529-406c-9d01-be0953f87571 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:32:56.431689 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f1611679-a529-406c-9d01-be0953f87571 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:32:56.438316 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f1611679-a529-406c-9d01-be0953f87571 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:32:56.438756 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f1611679-a529-406c-9d01-be0953f87571 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:32:56.439524 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f1611679-a529-406c-9d01-be0953f87571 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:32:56.439954 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f1611679-a529-406c-9d01-be0953f87571 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:32:56.570515 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-f1611679-a529-406c-9d01-be0953f87571 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:32:56.578186 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f1611679-a529-406c-9d01-be0953f87571 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df" status: 200 len: 1682 microversion: 2.1 time: 0.150841 Jan 15 21:32:56.578775 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3697/7382] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:32:56 2022] GET /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:32:57.594319 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9b320b96-3201-4427-bd54-14102c461b43 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:32:57.594938 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-9b320b96-3201-4427-bd54-14102c461b43 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:32:57.601769 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9b320b96-3201-4427-bd54-14102c461b43 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:32:57.602224 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9b320b96-3201-4427-bd54-14102c461b43 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:32:57.603021 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9b320b96-3201-4427-bd54-14102c461b43 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:32:57.603471 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9b320b96-3201-4427-bd54-14102c461b43 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:32:57.731976 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-9b320b96-3201-4427-bd54-14102c461b43 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:32:57.739384 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-9b320b96-3201-4427-bd54-14102c461b43 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df" status: 200 len: 1682 microversion: 2.1 time: 0.148868 Jan 15 21:32:57.739948 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3686/7383] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:32:57 2022] GET /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df => generated 1682 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:32:58.756476 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-bfcb8b9e-d574-4f07-9425-e2e8f7ae4a8c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:32:58.757110 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-bfcb8b9e-d574-4f07-9425-e2e8f7ae4a8c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:32:58.764421 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bfcb8b9e-d574-4f07-9425-e2e8f7ae4a8c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:32:58.764901 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bfcb8b9e-d574-4f07-9425-e2e8f7ae4a8c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:32:58.765679 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bfcb8b9e-d574-4f07-9425-e2e8f7ae4a8c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:32:58.766113 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bfcb8b9e-d574-4f07-9425-e2e8f7ae4a8c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:32:58.900584 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-bfcb8b9e-d574-4f07-9425-e2e8f7ae4a8c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:32:58.908033 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-bfcb8b9e-d574-4f07-9425-e2e8f7ae4a8c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df" status: 200 len: 1682 microversion: 2.1 time: 0.155289 Jan 15 21:32:58.908612 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3698/7384] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:32:58 2022] GET /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:32:59.925534 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-15eb6679-e2ef-46a6-8599-03b2657ccd84 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:32:59.926119 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-15eb6679-e2ef-46a6-8599-03b2657ccd84 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:32:59.934208 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-15eb6679-e2ef-46a6-8599-03b2657ccd84 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:32:59.934674 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-15eb6679-e2ef-46a6-8599-03b2657ccd84 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:32:59.935464 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-15eb6679-e2ef-46a6-8599-03b2657ccd84 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:32:59.935910 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-15eb6679-e2ef-46a6-8599-03b2657ccd84 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:00.069599 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-15eb6679-e2ef-46a6-8599-03b2657ccd84 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:33:00.077900 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-15eb6679-e2ef-46a6-8599-03b2657ccd84 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df" status: 200 len: 1682 microversion: 2.1 time: 0.156410 Jan 15 21:33:00.078509 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3687/7385] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:32:59 2022] GET /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:33:01.094479 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d6b101fe-4f41-43ee-81b8-36a1c355c311 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:33:01.095103 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-d6b101fe-4f41-43ee-81b8-36a1c355c311 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:33:01.101847 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d6b101fe-4f41-43ee-81b8-36a1c355c311 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:01.102304 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d6b101fe-4f41-43ee-81b8-36a1c355c311 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:01.103082 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d6b101fe-4f41-43ee-81b8-36a1c355c311 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:01.103522 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d6b101fe-4f41-43ee-81b8-36a1c355c311 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:01.234377 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-d6b101fe-4f41-43ee-81b8-36a1c355c311 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:33:01.241760 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d6b101fe-4f41-43ee-81b8-36a1c355c311 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df" status: 200 len: 1682 microversion: 2.1 time: 0.151008 Jan 15 21:33:01.242829 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3699/7386] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:33:01 2022] GET /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:33:02.259835 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-12e3f48c-3d2e-490a-8af0-f1204b793387 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:33:02.260462 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-12e3f48c-3d2e-490a-8af0-f1204b793387 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:33:02.267150 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-12e3f48c-3d2e-490a-8af0-f1204b793387 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:02.267612 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-12e3f48c-3d2e-490a-8af0-f1204b793387 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:02.268396 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-12e3f48c-3d2e-490a-8af0-f1204b793387 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:02.268861 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-12e3f48c-3d2e-490a-8af0-f1204b793387 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:02.405618 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-12e3f48c-3d2e-490a-8af0-f1204b793387 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:33:02.413802 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-12e3f48c-3d2e-490a-8af0-f1204b793387 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df" status: 200 len: 1681 microversion: 2.1 time: 0.158097 Jan 15 21:33:02.414986 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3688/7387] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:33:02 2022] GET /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:33:02.445307 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-aa0ec0d8-0428-4fc6-af2f-d7c01599a98a req-e88f4700-6e1b-4348-9962-cb6b7eb4f7c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f63c13ee-f437-4649-8e7a-abb7909aa3df", "name": "network-vif-unplugged", "status": "completed", "tag": "08c8c499-9a20-44b6-a253-314116581cdd"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:33:02.447602 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:33:02.447602 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:33:02.455859 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-aa0ec0d8-0428-4fc6-af2f-d7c01599a98a req-e88f4700-6e1b-4348-9962-cb6b7eb4f7c2 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:02.456497 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-aa0ec0d8-0428-4fc6-af2f-d7c01599a98a req-e88f4700-6e1b-4348-9962-cb6b7eb4f7c2 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:02.468937 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-aa0ec0d8-0428-4fc6-af2f-d7c01599a98a req-e88f4700-6e1b-4348-9962-cb6b7eb4f7c2 service nova] Creating event network-vif-unplugged:08c8c499-9a20-44b6-a253-314116581cdd for instance f63c13ee-f437-4649-8e7a-abb7909aa3df on nch2-master-1 Jan 15 21:33:02.474375 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [req-aa0ec0d8-0428-4fc6-af2f-d7c01599a98a req-e88f4700-6e1b-4348-9962-cb6b7eb4f7c2 service nova] Instance f63c13ee-f437-4649-8e7a-abb7909aa3df is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=129366) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Jan 15 21:33:02.485216 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-aa0ec0d8-0428-4fc6-af2f-d7c01599a98a req-e88f4700-6e1b-4348-9962-cb6b7eb4f7c2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043636 Jan 15 21:33:02.486016 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3700/7388] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:33:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:33:03.434104 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-53a3ff5f-6f82-4d15-a9df-b50587431043 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:33:03.434723 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-53a3ff5f-6f82-4d15-a9df-b50587431043 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:33:03.441465 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-53a3ff5f-6f82-4d15-a9df-b50587431043 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:03.441926 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-53a3ff5f-6f82-4d15-a9df-b50587431043 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:03.442716 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-53a3ff5f-6f82-4d15-a9df-b50587431043 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:03.443168 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-53a3ff5f-6f82-4d15-a9df-b50587431043 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:03.579504 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-53a3ff5f-6f82-4d15-a9df-b50587431043 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:33:03.587121 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-53a3ff5f-6f82-4d15-a9df-b50587431043 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df" status: 200 len: 1681 microversion: 2.1 time: 0.157436 Jan 15 21:33:03.587685 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3689/7389] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:33:03 2022] GET /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:33:04.503228 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-730eabbd-c322-488c-aee2-fada63b4e85f req-cda1dedb-4760-4891-baa5-9eceebcb85eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f63c13ee-f437-4649-8e7a-abb7909aa3df", "tag": "08c8c499-9a20-44b6-a253-314116581cdd"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:33:04.504719 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:33:04.504719 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:33:04.512162 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-730eabbd-c322-488c-aee2-fada63b4e85f req-cda1dedb-4760-4891-baa5-9eceebcb85eb service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:04.512604 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-730eabbd-c322-488c-aee2-fada63b4e85f req-cda1dedb-4760-4891-baa5-9eceebcb85eb service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:04.523669 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-730eabbd-c322-488c-aee2-fada63b4e85f req-cda1dedb-4760-4891-baa5-9eceebcb85eb service nova] Creating event network-changed:08c8c499-9a20-44b6-a253-314116581cdd for instance f63c13ee-f437-4649-8e7a-abb7909aa3df on nch2-master-1 Jan 15 21:33:04.529053 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [req-730eabbd-c322-488c-aee2-fada63b4e85f req-cda1dedb-4760-4891-baa5-9eceebcb85eb service nova] Instance f63c13ee-f437-4649-8e7a-abb7909aa3df is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=129366) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Jan 15 21:33:04.540384 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-730eabbd-c322-488c-aee2-fada63b4e85f req-cda1dedb-4760-4891-baa5-9eceebcb85eb service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041706 Jan 15 21:33:04.540987 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3701/7390] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:33:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:33:04.603937 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5319ba74-e0e9-4dea-b202-5c05a43e8d7c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:33:04.604780 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-5319ba74-e0e9-4dea-b202-5c05a43e8d7c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:33:04.611828 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5319ba74-e0e9-4dea-b202-5c05a43e8d7c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:04.612286 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5319ba74-e0e9-4dea-b202-5c05a43e8d7c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:04.613107 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5319ba74-e0e9-4dea-b202-5c05a43e8d7c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:04.613557 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5319ba74-e0e9-4dea-b202-5c05a43e8d7c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:04.744761 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-5319ba74-e0e9-4dea-b202-5c05a43e8d7c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:33:04.752345 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5319ba74-e0e9-4dea-b202-5c05a43e8d7c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df" status: 200 len: 1679 microversion: 2.1 time: 0.152714 Jan 15 21:33:04.753214 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3690/7391] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:33:04 2022] GET /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:33:05.770884 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-3f82e639-a0a3-45a5-aedf-9a418bb2ee39 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:33:05.771584 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-3f82e639-a0a3-45a5-aedf-9a418bb2ee39 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:33:05.777878 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3f82e639-a0a3-45a5-aedf-9a418bb2ee39 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:05.778327 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3f82e639-a0a3-45a5-aedf-9a418bb2ee39 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:05.779113 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3f82e639-a0a3-45a5-aedf-9a418bb2ee39 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:05.779552 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3f82e639-a0a3-45a5-aedf-9a418bb2ee39 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:05.911246 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-3f82e639-a0a3-45a5-aedf-9a418bb2ee39 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:33:05.919285 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-3f82e639-a0a3-45a5-aedf-9a418bb2ee39 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df" status: 200 len: 1676 microversion: 2.1 time: 0.153259 Jan 15 21:33:05.919858 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3702/7392] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:33:05 2022] GET /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:33:05.935974 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-4573089f-2f9e-4342-afd5-54fcb169dfcd tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:33:05.936516 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-4573089f-2f9e-4342-afd5-54fcb169dfcd tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:33:05.943158 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4573089f-2f9e-4342-afd5-54fcb169dfcd tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:05.943616 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4573089f-2f9e-4342-afd5-54fcb169dfcd tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:05.944397 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4573089f-2f9e-4342-afd5-54fcb169dfcd tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:05.944856 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4573089f-2f9e-4342-afd5-54fcb169dfcd tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:06.000656 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-4573089f-2f9e-4342-afd5-54fcb169dfcd tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action" status: 204 len: 0 microversion: 2.1 time: 0.068132 Jan 15 21:33:06.001495 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3691/7393] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:33:05 2022] POST /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df/action => generated 0 bytes in 70 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 21:33:06.010239 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7c8310ea-718f-443c-abcc-8aefbad1c73c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:33:06.010927 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-7c8310ea-718f-443c-abcc-8aefbad1c73c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:33:06.017568 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7c8310ea-718f-443c-abcc-8aefbad1c73c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:06.018100 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7c8310ea-718f-443c-abcc-8aefbad1c73c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:06.019146 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7c8310ea-718f-443c-abcc-8aefbad1c73c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:06.019595 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7c8310ea-718f-443c-abcc-8aefbad1c73c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:06.162305 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-7c8310ea-718f-443c-abcc-8aefbad1c73c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:33:06.170730 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7c8310ea-718f-443c-abcc-8aefbad1c73c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df" status: 200 len: 1676 microversion: 2.1 time: 0.165093 Jan 15 21:33:06.171313 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3703/7394] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:33:06 2022] GET /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df => generated 1676 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:33:07.189834 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-6d5daea6-72a5-4f71-a22c-c626f409c1bc tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:33:07.190599 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-6d5daea6-72a5-4f71-a22c-c626f409c1bc tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:33:07.198427 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6d5daea6-72a5-4f71-a22c-c626f409c1bc tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:07.198902 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6d5daea6-72a5-4f71-a22c-c626f409c1bc tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:07.199708 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6d5daea6-72a5-4f71-a22c-c626f409c1bc tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:07.200165 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6d5daea6-72a5-4f71-a22c-c626f409c1bc tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:07.339179 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-6d5daea6-72a5-4f71-a22c-c626f409c1bc tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:33:07.346721 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-6d5daea6-72a5-4f71-a22c-c626f409c1bc tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df" status: 200 len: 1668 microversion: 2.1 time: 0.161867 Jan 15 21:33:07.347298 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3692/7395] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:33:07 2022] GET /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df => generated 1668 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:33:07.364697 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f19635a4-bece-45b4-abd4-11be41c1f076 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:33:07.365271 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f19635a4-bece-45b4-abd4-11be41c1f076 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:33:07.373982 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f19635a4-bece-45b4-abd4-11be41c1f076 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:07.374471 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f19635a4-bece-45b4-abd4-11be41c1f076 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:07.375276 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f19635a4-bece-45b4-abd4-11be41c1f076 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:07.375715 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f19635a4-bece-45b4-abd4-11be41c1f076 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:07.477257 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-c7319af3-1e20-4d75-9008-93e0b985651a req-35e8c78e-5651-4ae0-8b93-903f4c6ca3b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f63c13ee-f437-4649-8e7a-abb7909aa3df", "name": "network-vif-plugged", "status": "completed", "tag": "08c8c499-9a20-44b6-a253-314116581cdd"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:33:07.480065 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:33:07.480065 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:33:07.489328 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-c7319af3-1e20-4d75-9008-93e0b985651a req-35e8c78e-5651-4ae0-8b93-903f4c6ca3b8 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:07.489695 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-c7319af3-1e20-4d75-9008-93e0b985651a req-35e8c78e-5651-4ae0-8b93-903f4c6ca3b8 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:07.502510 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-c7319af3-1e20-4d75-9008-93e0b985651a req-35e8c78e-5651-4ae0-8b93-903f4c6ca3b8 service nova] Creating event network-vif-plugged:08c8c499-9a20-44b6-a253-314116581cdd for instance f63c13ee-f437-4649-8e7a-abb7909aa3df on nch2-master-1 Jan 15 21:33:07.509981 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-c7319af3-1e20-4d75-9008-93e0b985651a req-35e8c78e-5651-4ae0-8b93-903f4c6ca3b8 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037667 Jan 15 21:33:07.510593 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3693/7396] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:33:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:33:07.516479 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-f19635a4-bece-45b4-abd4-11be41c1f076 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:33:07.524182 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f19635a4-bece-45b4-abd4-11be41c1f076 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df" status: 200 len: 1668 microversion: 2.1 time: 0.163458 Jan 15 21:33:07.525091 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3704/7397] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:33:07 2022] GET /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df => generated 1668 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:33:07.542452 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-eafe33e4-5d3e-44cf-8872-5c1be81513db tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:33:07.543072 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-eafe33e4-5d3e-44cf-8872-5c1be81513db tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:33:07.550273 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-eafe33e4-5d3e-44cf-8872-5c1be81513db tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:07.550738 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-eafe33e4-5d3e-44cf-8872-5c1be81513db tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:07.551536 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-eafe33e4-5d3e-44cf-8872-5c1be81513db tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:07.551978 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-eafe33e4-5d3e-44cf-8872-5c1be81513db tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:07.686574 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-eafe33e4-5d3e-44cf-8872-5c1be81513db tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:33:07.694085 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-eafe33e4-5d3e-44cf-8872-5c1be81513db tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df" status: 200 len: 1668 microversion: 2.1 time: 0.156433 Jan 15 21:33:07.694655 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3694/7398] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:33:07 2022] GET /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df => generated 1668 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:33:07.709766 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-5f365187-9bee-431c-a052-d38c109f6109 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:33:07.710269 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-5f365187-9bee-431c-a052-d38c109f6109 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:33:07.716982 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5f365187-9bee-431c-a052-d38c109f6109 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:07.717440 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5f365187-9bee-431c-a052-d38c109f6109 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:07.718374 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5f365187-9bee-431c-a052-d38c109f6109 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:07.718890 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5f365187-9bee-431c-a052-d38c109f6109 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:07.743884 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-5f365187-9bee-431c-a052-d38c109f6109 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Going to try to terminate instance {{(pid=129366) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 21:33:07.819842 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-5f365187-9bee-431c-a052-d38c109f6109 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "DELETE /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df" status: 204 len: 0 microversion: 2.1 time: 0.113359 Jan 15 21:33:07.820429 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3705/7399] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 21:33:07 2022] DELETE /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 21:33:07.829027 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-bb9a2822-bfae-49ef-b5e6-14395815cadd tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:33:07.829647 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-bb9a2822-bfae-49ef-b5e6-14395815cadd tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:33:07.835593 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bb9a2822-bfae-49ef-b5e6-14395815cadd tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:07.836562 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bb9a2822-bfae-49ef-b5e6-14395815cadd tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:07.837364 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bb9a2822-bfae-49ef-b5e6-14395815cadd tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:07.837809 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bb9a2822-bfae-49ef-b5e6-14395815cadd tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:07.968635 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-bb9a2822-bfae-49ef-b5e6-14395815cadd tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:33:07.980076 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-bb9a2822-bfae-49ef-b5e6-14395815cadd tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df" status: 200 len: 1674 microversion: 2.1 time: 0.154439 Jan 15 21:33:07.980752 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3695/7400] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:33:07 2022] GET /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df => generated 1674 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:33:09.002041 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-85edf8b7-2ca4-4cab-80a3-b03131d0046e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:33:09.002740 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-85edf8b7-2ca4-4cab-80a3-b03131d0046e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:33:09.010139 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-85edf8b7-2ca4-4cab-80a3-b03131d0046e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:09.010593 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-85edf8b7-2ca4-4cab-80a3-b03131d0046e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:09.011379 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-85edf8b7-2ca4-4cab-80a3-b03131d0046e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:09.011822 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-85edf8b7-2ca4-4cab-80a3-b03131d0046e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:09.146700 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-85edf8b7-2ca4-4cab-80a3-b03131d0046e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:33:09.154629 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-85edf8b7-2ca4-4cab-80a3-b03131d0046e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df" status: 200 len: 1674 microversion: 2.1 time: 0.156782 Jan 15 21:33:09.155208 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3706/7401] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:33:08 2022] GET /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df => generated 1674 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:33:10.086873 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-ec8d0d38-c735-4a14-8521-120947f10358 req-8d404b32-b946-40c6-9be3-b5c00a048fcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f63c13ee-f437-4649-8e7a-abb7909aa3df", "name": "network-vif-deleted", "tag": "08c8c499-9a20-44b6-a253-314116581cdd"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:33:10.088504 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:33:10.088504 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:33:10.098806 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-ec8d0d38-c735-4a14-8521-120947f10358 req-8d404b32-b946-40c6-9be3-b5c00a048fcd service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:10.099491 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-ec8d0d38-c735-4a14-8521-120947f10358 req-8d404b32-b946-40c6-9be3-b5c00a048fcd service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:10.114576 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-ec8d0d38-c735-4a14-8521-120947f10358 req-8d404b32-b946-40c6-9be3-b5c00a048fcd service nova] Creating event network-vif-deleted:08c8c499-9a20-44b6-a253-314116581cdd for instance f63c13ee-f437-4649-8e7a-abb7909aa3df on nch2-master-1 Jan 15 21:33:10.121448 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-ec8d0d38-c735-4a14-8521-120947f10358 req-8d404b32-b946-40c6-9be3-b5c00a048fcd service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038631 Jan 15 21:33:10.122259 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3696/7402] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:33:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 21:33:10.172950 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0921e4bd-ed04-42c5-8fd4-72f88fe5e69e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:33:10.174162 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-0921e4bd-ed04-42c5-8fd4-72f88fe5e69e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:33:10.181767 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0921e4bd-ed04-42c5-8fd4-72f88fe5e69e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:10.182231 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0921e4bd-ed04-42c5-8fd4-72f88fe5e69e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:10.183042 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0921e4bd-ed04-42c5-8fd4-72f88fe5e69e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:10.183486 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0921e4bd-ed04-42c5-8fd4-72f88fe5e69e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:10.215723 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0921e4bd-ed04-42c5-8fd4-72f88fe5e69e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:10.216303 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0921e4bd-ed04-42c5-8fd4-72f88fe5e69e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:10.216831 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.objects.instance [None req-0921e4bd-ed04-42c5-8fd4-72f88fe5e69e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lazy-loading 'fault' on Instance uuid f63c13ee-f437-4649-8e7a-abb7909aa3df {{(pid=129366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 21:33:10.256053 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-0921e4bd-ed04-42c5-8fd4-72f88fe5e69e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:33:10.263689 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0921e4bd-ed04-42c5-8fd4-72f88fe5e69e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df" status: 200 len: 1327 microversion: 2.1 time: 0.094763 Jan 15 21:33:10.264268 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3707/7403] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:33:10 2022] GET /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df => generated 1327 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:33:11.281182 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e1723d2c-6753-4d28-a619-6e1ab66b9d54 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:33:11.281884 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e1723d2c-6753-4d28-a619-6e1ab66b9d54 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:33:11.289637 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e1723d2c-6753-4d28-a619-6e1ab66b9d54 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:11.290210 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e1723d2c-6753-4d28-a619-6e1ab66b9d54 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:11.291066 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e1723d2c-6753-4d28-a619-6e1ab66b9d54 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:11.291508 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e1723d2c-6753-4d28-a619-6e1ab66b9d54 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:11.304305 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-e1723d2c-6753-4d28-a619-6e1ab66b9d54 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] HTTP exception thrown: Instance f63c13ee-f437-4649-8e7a-abb7909aa3df could not be found. Jan 15 21:33:11.305836 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e1723d2c-6753-4d28-a619-6e1ab66b9d54 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Returning 404 to user: Instance f63c13ee-f437-4649-8e7a-abb7909aa3df could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:33:11.306666 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e1723d2c-6753-4d28-a619-6e1ab66b9d54 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df" status: 404 len: 111 microversion: 2.1 time: 0.029661 Jan 15 21:33:11.307198 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3697/7404] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:33:11 2022] GET /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:33:11.318620 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-18b4135b-60d8-4f42-8e00-37a911d33ff9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:33:11.319227 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-18b4135b-60d8-4f42-8e00-37a911d33ff9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:33:11.326798 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-18b4135b-60d8-4f42-8e00-37a911d33ff9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:11.327245 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-18b4135b-60d8-4f42-8e00-37a911d33ff9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:11.328018 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-18b4135b-60d8-4f42-8e00-37a911d33ff9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:11.328449 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-18b4135b-60d8-4f42-8e00-37a911d33ff9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:11.341522 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-18b4135b-60d8-4f42-8e00-37a911d33ff9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] HTTP exception thrown: Instance f63c13ee-f437-4649-8e7a-abb7909aa3df could not be found. Jan 15 21:33:11.342100 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-18b4135b-60d8-4f42-8e00-37a911d33ff9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Returning 404 to user: Instance f63c13ee-f437-4649-8e7a-abb7909aa3df could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:33:11.342937 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-18b4135b-60d8-4f42-8e00-37a911d33ff9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df" status: 404 len: 111 microversion: 2.1 time: 0.028021 Jan 15 21:33:11.343467 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3708/7405] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:33:11 2022] GET /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:33:11.393276 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c029eade-1465-423d-91ff-a049bbfcf181 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1045483708", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "networks": [{"uuid": "72520288-27af-458f-aef8-ae08e1543c11"}], "security_groups": [{"name": "tempest-securitygroup--1432803138"}], "key_name": "tempest-keypair-176324375", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:33:11.494208 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.network.neutron [None req-c029eade-1465-423d-91ff-a049bbfcf181 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] validate_networks() for [('72520288-27af-458f-aef8-ae08e1543c11', None, None, None, None, None)] {{(pid=129365) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 21:33:11.865840 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-c029eade-1465-423d-91ff-a049bbfcf181 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Flavor limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 21:33:11.866277 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-c029eade-1465-423d-91ff-a049bbfcf181 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Image limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 21:33:11.866762 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-c029eade-1465-423d-91ff-a049bbfcf181 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Flavor pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 21:33:11.867247 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-c029eade-1465-423d-91ff-a049bbfcf181 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Image pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 21:33:11.867788 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-c029eade-1465-423d-91ff-a049bbfcf181 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 21:33:11.876537 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c029eade-1465-423d-91ff-a049bbfcf181 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:11.877034 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c029eade-1465-423d-91ff-a049bbfcf181 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:11.877861 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c029eade-1465-423d-91ff-a049bbfcf181 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:11.878310 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c029eade-1465-423d-91ff-a049bbfcf181 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:11.895230 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-c029eade-1465-423d-91ff-a049bbfcf181 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Getting quotas for project 2d89bb23cded412ea3ca57cc844bfabf. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:33:11.900997 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-c029eade-1465-423d-91ff-a049bbfcf181 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Getting quotas for user b3fbd604b5a640b480e5d115e469375e and project 2d89bb23cded412ea3ca57cc844bfabf. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:33:11.913223 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c029eade-1465-423d-91ff-a049bbfcf181 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Going to run 1 instances... {{(pid=129365) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 21:33:11.915649 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c029eade-1465-423d-91ff-a049bbfcf181 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129365) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 21:33:11.958803 ncdv-master-1 devstack@n-api.service[129365]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c029eade-1465-423d-91ff-a049bbfcf181 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [c9407883-f990-4a97-b813-b51b9ecbc106] AMQP server on 10.222.0.46:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 15 21:33:12.966570 ncdv-master-1 devstack@n-api.service[129365]: INFO oslo.messaging._drivers.impl_rabbit [None req-c029eade-1465-423d-91ff-a049bbfcf181 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [c9407883-f990-4a97-b813-b51b9ecbc106] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 38108. Jan 15 21:33:12.970916 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c029eade-1465-423d-91ff-a049bbfcf181 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.581324 Jan 15 21:33:12.971563 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3698/7406] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 21:33:11 2022] POST /compute/v2.1/servers => generated 406 bytes in 1583 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 21:33:12.981939 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-6a5534b3-6815-40e3-af08-f9b702b2b598 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:33:12.982539 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-6a5534b3-6815-40e3-af08-f9b702b2b598 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:33:13.036688 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-6a5534b3-6815-40e3-af08-f9b702b2b598 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:33:13.044176 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-6a5534b3-6815-40e3-af08-f9b702b2b598 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316" status: 200 len: 1238 microversion: 2.1 time: 0.066115 Jan 15 21:33:13.044736 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3709/7407] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:33:12 2022] GET /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316 => generated 1238 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:33:14.062750 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f023444e-95fe-4ad2-8261-4a9cad7c0037 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:33:14.063497 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f023444e-95fe-4ad2-8261-4a9cad7c0037 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:33:14.069971 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f023444e-95fe-4ad2-8261-4a9cad7c0037 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:14.071484 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f023444e-95fe-4ad2-8261-4a9cad7c0037 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:14.072189 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f023444e-95fe-4ad2-8261-4a9cad7c0037 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:14.072716 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f023444e-95fe-4ad2-8261-4a9cad7c0037 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:14.134319 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-f023444e-95fe-4ad2-8261-4a9cad7c0037 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:33:14.142014 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f023444e-95fe-4ad2-8261-4a9cad7c0037 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316" status: 200 len: 1296 microversion: 2.1 time: 0.083856 Jan 15 21:33:14.142879 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3699/7408] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:33:14 2022] GET /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316 => generated 1296 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:33:15.161273 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d45366ec-5eea-4577-b714-ac43b2acf20d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:33:15.161918 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-d45366ec-5eea-4577-b714-ac43b2acf20d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:33:15.169788 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d45366ec-5eea-4577-b714-ac43b2acf20d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:15.170365 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d45366ec-5eea-4577-b714-ac43b2acf20d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:15.171280 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d45366ec-5eea-4577-b714-ac43b2acf20d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:15.172318 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d45366ec-5eea-4577-b714-ac43b2acf20d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:15.292613 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-192ac5d2-faf6-4a1b-9643-4732cc3cfe2e req-d29ec4cc-872c-477e-b8f8-24e29ff33c6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c3971ed-826f-4ae9-812c-e1be325fa316", "tag": "1b7605bd-3638-4843-a16b-644d5f3ec0fd"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:33:15.294973 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:33:15.294973 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:33:15.308546 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-192ac5d2-faf6-4a1b-9643-4732cc3cfe2e req-d29ec4cc-872c-477e-b8f8-24e29ff33c6c service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:15.309407 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-192ac5d2-faf6-4a1b-9643-4732cc3cfe2e req-d29ec4cc-872c-477e-b8f8-24e29ff33c6c service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:15.324557 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-d45366ec-5eea-4577-b714-ac43b2acf20d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:33:15.332197 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d45366ec-5eea-4577-b714-ac43b2acf20d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316" status: 200 len: 1364 microversion: 2.1 time: 0.175003 Jan 15 21:33:15.332414 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-192ac5d2-faf6-4a1b-9643-4732cc3cfe2e req-d29ec4cc-872c-477e-b8f8-24e29ff33c6c service nova] Creating event network-changed:1b7605bd-3638-4843-a16b-644d5f3ec0fd for instance 1c3971ed-826f-4ae9-812c-e1be325fa316 on nch2-master-1 Jan 15 21:33:15.334101 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3710/7409] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:33:15 2022] GET /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316 => generated 1364 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:33:15.340289 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-192ac5d2-faf6-4a1b-9643-4732cc3cfe2e req-d29ec4cc-872c-477e-b8f8-24e29ff33c6c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052548 Jan 15 21:33:15.345776 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3700/7410] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:33:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:33:16.350917 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d8b806cb-512a-4616-9b1a-186827ffbb17 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:33:16.352024 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-d8b806cb-512a-4616-9b1a-186827ffbb17 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:33:16.358837 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d8b806cb-512a-4616-9b1a-186827ffbb17 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:16.359279 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d8b806cb-512a-4616-9b1a-186827ffbb17 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:16.360050 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d8b806cb-512a-4616-9b1a-186827ffbb17 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:16.360478 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d8b806cb-512a-4616-9b1a-186827ffbb17 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:16.489501 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-d8b806cb-512a-4616-9b1a-186827ffbb17 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:33:16.497543 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d8b806cb-512a-4616-9b1a-186827ffbb17 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316" status: 200 len: 1364 microversion: 2.1 time: 0.150388 Jan 15 21:33:16.498115 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3711/7411] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:33:16 2022] GET /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316 => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:33:17.516092 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f84762d8-6fd1-4b60-8f3e-b44b0b374bfb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:33:17.516806 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f84762d8-6fd1-4b60-8f3e-b44b0b374bfb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:33:17.522975 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f84762d8-6fd1-4b60-8f3e-b44b0b374bfb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:17.523952 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f84762d8-6fd1-4b60-8f3e-b44b0b374bfb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:17.524800 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f84762d8-6fd1-4b60-8f3e-b44b0b374bfb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:17.525272 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f84762d8-6fd1-4b60-8f3e-b44b0b374bfb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:17.661727 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-f84762d8-6fd1-4b60-8f3e-b44b0b374bfb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:33:17.669850 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f84762d8-6fd1-4b60-8f3e-b44b0b374bfb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316" status: 200 len: 1364 microversion: 2.1 time: 0.158634 Jan 15 21:33:17.670424 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3701/7412] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:33:17 2022] GET /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316 => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:33:18.687087 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0c462717-23b5-456c-bea1-17bc6864aa1f tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:33:18.687688 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-0c462717-23b5-456c-bea1-17bc6864aa1f tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:33:18.694433 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0c462717-23b5-456c-bea1-17bc6864aa1f tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:18.694878 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0c462717-23b5-456c-bea1-17bc6864aa1f tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:18.696143 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0c462717-23b5-456c-bea1-17bc6864aa1f tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:18.696569 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0c462717-23b5-456c-bea1-17bc6864aa1f tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:18.828495 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-0c462717-23b5-456c-bea1-17bc6864aa1f tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:33:18.836456 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0c462717-23b5-456c-bea1-17bc6864aa1f tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316" status: 200 len: 1364 microversion: 2.1 time: 0.152358 Jan 15 21:33:18.837205 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3712/7413] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:33:18 2022] GET /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316 => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:33:19.474110 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-97eead11-47a4-4040-a402-797019f42dce req-7b08aa2e-2889-420b-8de3-549cc9468638 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c3971ed-826f-4ae9-812c-e1be325fa316", "name": "network-vif-plugged", "status": "completed", "tag": "1b7605bd-3638-4843-a16b-644d5f3ec0fd"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:33:19.475623 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:33:19.475623 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:33:19.484076 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-97eead11-47a4-4040-a402-797019f42dce req-7b08aa2e-2889-420b-8de3-549cc9468638 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:19.484591 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-97eead11-47a4-4040-a402-797019f42dce req-7b08aa2e-2889-420b-8de3-549cc9468638 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:19.496020 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-97eead11-47a4-4040-a402-797019f42dce req-7b08aa2e-2889-420b-8de3-549cc9468638 service nova] Creating event network-vif-plugged:1b7605bd-3638-4843-a16b-644d5f3ec0fd for instance 1c3971ed-826f-4ae9-812c-e1be325fa316 on nch2-master-1 Jan 15 21:33:19.500871 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-97eead11-47a4-4040-a402-797019f42dce req-7b08aa2e-2889-420b-8de3-549cc9468638 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030502 Jan 15 21:33:19.501661 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3702/7414] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:33:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:33:19.854286 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e5f0ede0-a9ff-4a19-b92e-b96c1f866f4a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:33:19.854887 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e5f0ede0-a9ff-4a19-b92e-b96c1f866f4a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:33:19.861621 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e5f0ede0-a9ff-4a19-b92e-b96c1f866f4a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:19.862072 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e5f0ede0-a9ff-4a19-b92e-b96c1f866f4a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:19.862843 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e5f0ede0-a9ff-4a19-b92e-b96c1f866f4a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:19.863276 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e5f0ede0-a9ff-4a19-b92e-b96c1f866f4a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:19.994819 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-e5f0ede0-a9ff-4a19-b92e-b96c1f866f4a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:33:20.002183 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e5f0ede0-a9ff-4a19-b92e-b96c1f866f4a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316" status: 200 len: 1364 microversion: 2.1 time: 0.152126 Jan 15 21:33:20.002751 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3713/7415] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:33:19 2022] GET /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316 => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:33:21.020909 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-acb039a1-05be-4073-9b2f-8b4b05a8a261 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:33:21.021565 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-acb039a1-05be-4073-9b2f-8b4b05a8a261 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:33:21.028363 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-acb039a1-05be-4073-9b2f-8b4b05a8a261 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:21.028823 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-acb039a1-05be-4073-9b2f-8b4b05a8a261 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:21.029651 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-acb039a1-05be-4073-9b2f-8b4b05a8a261 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:21.030101 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-acb039a1-05be-4073-9b2f-8b4b05a8a261 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:21.169680 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-acb039a1-05be-4073-9b2f-8b4b05a8a261 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:33:21.177083 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-acb039a1-05be-4073-9b2f-8b4b05a8a261 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316" status: 200 len: 1550 microversion: 2.1 time: 0.161157 Jan 15 21:33:21.177660 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3703/7416] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:33:21 2022] GET /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316 => generated 1550 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:33:21.193839 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f85e8b70-90ed-44e7-81ae-7206b02ba676 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:33:21.194344 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f85e8b70-90ed-44e7-81ae-7206b02ba676 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:33:21.200948 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f85e8b70-90ed-44e7-81ae-7206b02ba676 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:21.201395 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f85e8b70-90ed-44e7-81ae-7206b02ba676 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:21.202192 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f85e8b70-90ed-44e7-81ae-7206b02ba676 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:21.202621 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f85e8b70-90ed-44e7-81ae-7206b02ba676 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:21.280438 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f85e8b70-90ed-44e7-81ae-7206b02ba676 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090135 Jan 15 21:33:21.281074 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3714/7417] 10.222.0.46 () {58 vars in 1274 bytes} [Sat Jan 15 21:33:21 2022] GET /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:33:22.454399 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8f4d8c19-b2fb-4821-a94c-af86d1cb63c6 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:33:22.455348 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-8f4d8c19-b2fb-4821-a94c-af86d1cb63c6 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:33:22.456619 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-ecd500de-d8a6-4c98-a56e-858a3955309a req-c59698d9-b620-4259-a5f7-59227ca5bae5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c3971ed-826f-4ae9-812c-e1be325fa316", "tag": "1b7605bd-3638-4843-a16b-644d5f3ec0fd"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:33:22.458461 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:33:22.458461 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:33:22.462484 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8f4d8c19-b2fb-4821-a94c-af86d1cb63c6 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:22.462945 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8f4d8c19-b2fb-4821-a94c-af86d1cb63c6 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:22.463959 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8f4d8c19-b2fb-4821-a94c-af86d1cb63c6 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:22.464410 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8f4d8c19-b2fb-4821-a94c-af86d1cb63c6 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:22.466260 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-ecd500de-d8a6-4c98-a56e-858a3955309a req-c59698d9-b620-4259-a5f7-59227ca5bae5 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:22.466737 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-ecd500de-d8a6-4c98-a56e-858a3955309a req-c59698d9-b620-4259-a5f7-59227ca5bae5 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:22.478603 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-ecd500de-d8a6-4c98-a56e-858a3955309a req-c59698d9-b620-4259-a5f7-59227ca5bae5 service nova] Creating event network-changed:1b7605bd-3638-4843-a16b-644d5f3ec0fd for instance 1c3971ed-826f-4ae9-812c-e1be325fa316 on nch2-master-1 Jan 15 21:33:22.483798 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-ecd500de-d8a6-4c98-a56e-858a3955309a req-c59698d9-b620-4259-a5f7-59227ca5bae5 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031875 Jan 15 21:33:22.484711 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3715/7418] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:33:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:33:22.505852 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-8f4d8c19-b2fb-4821-a94c-af86d1cb63c6 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action" status: 200 len: 14 microversion: 2.1 time: 0.056319 Jan 15 21:33:22.508290 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3704/7419] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:33:22 2022] POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action => generated 14 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 21:33:23.519163 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ced3ddae-44e8-4211-9515-504d1699ed69 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:33:23.520090 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ced3ddae-44e8-4211-9515-504d1699ed69 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:33:23.526422 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ced3ddae-44e8-4211-9515-504d1699ed69 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:23.526880 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ced3ddae-44e8-4211-9515-504d1699ed69 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:23.527666 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ced3ddae-44e8-4211-9515-504d1699ed69 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:23.528101 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ced3ddae-44e8-4211-9515-504d1699ed69 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:23.566025 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ced3ddae-44e8-4211-9515-504d1699ed69 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action" status: 200 len: 14 microversion: 2.1 time: 0.051651 Jan 15 21:33:23.569476 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3716/7420] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:33:23 2022] POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action => generated 14 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 21:33:24.578173 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-dfd25bd2-f99a-42a5-8e66-570c6f20f3b3 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:33:24.579107 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-dfd25bd2-f99a-42a5-8e66-570c6f20f3b3 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:33:24.588179 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dfd25bd2-f99a-42a5-8e66-570c6f20f3b3 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:24.588639 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dfd25bd2-f99a-42a5-8e66-570c6f20f3b3 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:24.589485 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dfd25bd2-f99a-42a5-8e66-570c6f20f3b3 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:24.589936 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dfd25bd2-f99a-42a5-8e66-570c6f20f3b3 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:24.628596 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-dfd25bd2-f99a-42a5-8e66-570c6f20f3b3 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action" status: 200 len: 14 microversion: 2.1 time: 0.054424 Jan 15 21:33:24.629512 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3705/7421] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:33:24 2022] POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action => generated 14 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 21:33:25.639773 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ea3453bb-2377-4501-a42e-60e1700264f3 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:33:25.640704 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ea3453bb-2377-4501-a42e-60e1700264f3 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:33:25.648053 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ea3453bb-2377-4501-a42e-60e1700264f3 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:25.648501 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ea3453bb-2377-4501-a42e-60e1700264f3 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:25.649311 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ea3453bb-2377-4501-a42e-60e1700264f3 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:25.649739 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ea3453bb-2377-4501-a42e-60e1700264f3 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:25.695716 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ea3453bb-2377-4501-a42e-60e1700264f3 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action" status: 200 len: 14 microversion: 2.1 time: 0.059875 Jan 15 21:33:25.698900 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3717/7422] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:33:25 2022] POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action => generated 14 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 21:33:26.707839 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-da888b9f-8aba-4ffa-a520-9a1b393dd0a2 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:33:26.708955 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-da888b9f-8aba-4ffa-a520-9a1b393dd0a2 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:33:26.717058 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-da888b9f-8aba-4ffa-a520-9a1b393dd0a2 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:26.717518 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-da888b9f-8aba-4ffa-a520-9a1b393dd0a2 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:26.718297 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-da888b9f-8aba-4ffa-a520-9a1b393dd0a2 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:26.718741 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-da888b9f-8aba-4ffa-a520-9a1b393dd0a2 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:26.756134 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-da888b9f-8aba-4ffa-a520-9a1b393dd0a2 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action" status: 200 len: 14 microversion: 2.1 time: 0.052825 Jan 15 21:33:26.756885 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3706/7423] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:33:26 2022] POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action => generated 14 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 21:33:27.767756 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c25f03cb-9969-43b5-a6b7-6dffc07c95eb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:33:27.768808 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c25f03cb-9969-43b5-a6b7-6dffc07c95eb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:33:27.776498 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c25f03cb-9969-43b5-a6b7-6dffc07c95eb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:27.776981 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c25f03cb-9969-43b5-a6b7-6dffc07c95eb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:27.777755 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c25f03cb-9969-43b5-a6b7-6dffc07c95eb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:27.778194 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c25f03cb-9969-43b5-a6b7-6dffc07c95eb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:27.817000 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c25f03cb-9969-43b5-a6b7-6dffc07c95eb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action" status: 200 len: 14 microversion: 2.1 time: 0.053194 Jan 15 21:33:27.817789 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3718/7424] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:33:27 2022] POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action => generated 14 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 21:33:28.828164 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-49436c8d-6c8f-4229-ac0f-5472fd39a20f tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:33:28.829219 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-49436c8d-6c8f-4229-ac0f-5472fd39a20f tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:33:28.837136 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-49436c8d-6c8f-4229-ac0f-5472fd39a20f tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:28.837611 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-49436c8d-6c8f-4229-ac0f-5472fd39a20f tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:28.838398 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-49436c8d-6c8f-4229-ac0f-5472fd39a20f tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:28.838847 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-49436c8d-6c8f-4229-ac0f-5472fd39a20f tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:28.875453 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-49436c8d-6c8f-4229-ac0f-5472fd39a20f tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action" status: 200 len: 14 microversion: 2.1 time: 0.051286 Jan 15 21:33:28.876074 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3707/7425] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:33:28 2022] POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action => generated 14 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 21:33:29.886892 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-628984c6-d846-4123-8104-d6ed2aed07c2 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:33:29.887928 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-628984c6-d846-4123-8104-d6ed2aed07c2 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:33:29.895521 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-628984c6-d846-4123-8104-d6ed2aed07c2 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:29.895975 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-628984c6-d846-4123-8104-d6ed2aed07c2 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:29.896761 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-628984c6-d846-4123-8104-d6ed2aed07c2 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:29.897229 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-628984c6-d846-4123-8104-d6ed2aed07c2 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:29.938856 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-628984c6-d846-4123-8104-d6ed2aed07c2 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action" status: 200 len: 14 microversion: 2.1 time: 0.056538 Jan 15 21:33:29.939483 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3719/7426] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:33:29 2022] POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action => generated 14 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 21:33:30.950305 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-21d464d2-9f9e-406c-b453-71642fdd37dd tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:33:30.951377 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-21d464d2-9f9e-406c-b453-71642fdd37dd tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:33:30.958667 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-21d464d2-9f9e-406c-b453-71642fdd37dd tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:30.959127 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-21d464d2-9f9e-406c-b453-71642fdd37dd tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:30.959908 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-21d464d2-9f9e-406c-b453-71642fdd37dd tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:30.960350 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-21d464d2-9f9e-406c-b453-71642fdd37dd tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:30.972363 ncdv-master-1 devstack@n-api.service[129366]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 15 21:33:30.972874 ncdv-master-1 devstack@n-api.service[129366]: Sat Jan 15 21:33:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 15 21:33:31.000397 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-21d464d2-9f9e-406c-b453-71642fdd37dd tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action" status: 200 len: 14 microversion: 2.1 time: 0.053972 Jan 15 21:33:31.001027 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3708/7427] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:33:30 2022] POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action => generated 14 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 21:33:31.304404 ncdv-master-1 devstack@n-api.service[129365]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 15 21:33:31.304591 ncdv-master-1 devstack@n-api.service[129365]: Sat Jan 15 21:33:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 15 21:33:32.012974 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-6208f50e-2458-4b0e-999e-352ffb32427a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:33:32.013960 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-6208f50e-2458-4b0e-999e-352ffb32427a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:33:32.021252 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6208f50e-2458-4b0e-999e-352ffb32427a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:32.021695 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6208f50e-2458-4b0e-999e-352ffb32427a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:32.022460 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6208f50e-2458-4b0e-999e-352ffb32427a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:32.023091 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6208f50e-2458-4b0e-999e-352ffb32427a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:32.060325 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-6208f50e-2458-4b0e-999e-352ffb32427a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action" status: 200 len: 14 microversion: 2.1 time: 0.051376 Jan 15 21:33:32.060974 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3720/7428] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:33:32 2022] POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action => generated 14 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 21:33:33.072250 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-fb9e0fa8-13e2-402c-8997-965ae4f8b2b4 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:33:33.073282 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-fb9e0fa8-13e2-402c-8997-965ae4f8b2b4 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:33:33.081180 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fb9e0fa8-13e2-402c-8997-965ae4f8b2b4 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:33.081643 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fb9e0fa8-13e2-402c-8997-965ae4f8b2b4 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:33.082426 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fb9e0fa8-13e2-402c-8997-965ae4f8b2b4 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:33.082868 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fb9e0fa8-13e2-402c-8997-965ae4f8b2b4 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:33.121310 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-fb9e0fa8-13e2-402c-8997-965ae4f8b2b4 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action" status: 200 len: 14 microversion: 2.1 time: 0.053487 Jan 15 21:33:33.121921 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3709/7429] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:33:33 2022] POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action => generated 14 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 21:33:34.132719 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-27db861a-764c-4da7-97cb-8a90ccf2bd41 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:33:34.133820 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-27db861a-764c-4da7-97cb-8a90ccf2bd41 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:33:34.141046 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-27db861a-764c-4da7-97cb-8a90ccf2bd41 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:34.141491 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-27db861a-764c-4da7-97cb-8a90ccf2bd41 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:34.142257 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-27db861a-764c-4da7-97cb-8a90ccf2bd41 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:34.142686 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-27db861a-764c-4da7-97cb-8a90ccf2bd41 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:34.195436 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-27db861a-764c-4da7-97cb-8a90ccf2bd41 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action" status: 200 len: 8207 microversion: 2.1 time: 0.066339 Jan 15 21:33:34.196055 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3721/7430] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:33:34 2022] POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action => generated 8207 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:33:35.206875 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-86b6ad34-b064-426b-88ee-ea7f60d7a915 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:33:35.207885 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-86b6ad34-b064-426b-88ee-ea7f60d7a915 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:33:35.216032 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-86b6ad34-b064-426b-88ee-ea7f60d7a915 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:35.216498 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-86b6ad34-b064-426b-88ee-ea7f60d7a915 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:35.217321 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-86b6ad34-b064-426b-88ee-ea7f60d7a915 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:35.217772 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-86b6ad34-b064-426b-88ee-ea7f60d7a915 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:35.269311 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-86b6ad34-b064-426b-88ee-ea7f60d7a915 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action" status: 200 len: 16399 microversion: 2.1 time: 0.066367 Jan 15 21:33:35.270152 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3710/7431] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:33:35 2022] POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action => generated 16399 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:33:36.281725 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a2b41fd3-6d07-45e4-ad71-9cbd28c1796a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:33:36.282723 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a2b41fd3-6d07-45e4-ad71-9cbd28c1796a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:33:36.290451 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a2b41fd3-6d07-45e4-ad71-9cbd28c1796a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:36.290906 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a2b41fd3-6d07-45e4-ad71-9cbd28c1796a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:36.291691 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a2b41fd3-6d07-45e4-ad71-9cbd28c1796a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:36.292133 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a2b41fd3-6d07-45e4-ad71-9cbd28c1796a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:36.332105 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a2b41fd3-6d07-45e4-ad71-9cbd28c1796a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action" status: 200 len: 16399 microversion: 2.1 time: 0.054322 Jan 15 21:33:36.332742 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3722/7432] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:33:36 2022] POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action => generated 16399 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:33:37.344240 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-38808cf8-1aea-4fbb-8451-4dfc7ed60548 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:33:37.345279 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-38808cf8-1aea-4fbb-8451-4dfc7ed60548 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:33:37.353042 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-38808cf8-1aea-4fbb-8451-4dfc7ed60548 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:37.353761 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-38808cf8-1aea-4fbb-8451-4dfc7ed60548 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:37.354850 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-38808cf8-1aea-4fbb-8451-4dfc7ed60548 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:37.355304 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-38808cf8-1aea-4fbb-8451-4dfc7ed60548 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:37.395272 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-38808cf8-1aea-4fbb-8451-4dfc7ed60548 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action" status: 200 len: 16399 microversion: 2.1 time: 0.054980 Jan 15 21:33:37.396152 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3711/7433] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:33:37 2022] POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action => generated 16399 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:33:38.408880 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-14fe9415-02d3-4042-8a5e-9dc7e71860ac tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:33:38.410188 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-14fe9415-02d3-4042-8a5e-9dc7e71860ac tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:33:38.417301 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-14fe9415-02d3-4042-8a5e-9dc7e71860ac tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:38.417754 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-14fe9415-02d3-4042-8a5e-9dc7e71860ac tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:38.418532 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-14fe9415-02d3-4042-8a5e-9dc7e71860ac tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:38.418972 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-14fe9415-02d3-4042-8a5e-9dc7e71860ac tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:38.462492 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-14fe9415-02d3-4042-8a5e-9dc7e71860ac tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action" status: 200 len: 16399 microversion: 2.1 time: 0.058344 Jan 15 21:33:38.463264 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3723/7434] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:33:38 2022] POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action => generated 16399 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:33:39.473838 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c368cebf-202c-4cd4-a823-3ef807c7a061 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:33:39.474855 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c368cebf-202c-4cd4-a823-3ef807c7a061 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:33:39.482560 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c368cebf-202c-4cd4-a823-3ef807c7a061 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:39.483031 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c368cebf-202c-4cd4-a823-3ef807c7a061 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:39.483823 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c368cebf-202c-4cd4-a823-3ef807c7a061 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:39.484273 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c368cebf-202c-4cd4-a823-3ef807c7a061 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:39.538886 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c368cebf-202c-4cd4-a823-3ef807c7a061 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action" status: 200 len: 24565 microversion: 2.1 time: 0.069087 Jan 15 21:33:39.540581 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3712/7435] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:33:39 2022] POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action => generated 24565 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:33:40.552314 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-303ef05b-0d4a-43f7-848e-597d3a54367d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:33:40.553401 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-303ef05b-0d4a-43f7-848e-597d3a54367d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:33:40.561037 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-303ef05b-0d4a-43f7-848e-597d3a54367d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:40.561495 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-303ef05b-0d4a-43f7-848e-597d3a54367d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:40.562272 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-303ef05b-0d4a-43f7-848e-597d3a54367d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:40.562713 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-303ef05b-0d4a-43f7-848e-597d3a54367d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:40.603899 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-303ef05b-0d4a-43f7-848e-597d3a54367d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action" status: 200 len: 24565 microversion: 2.1 time: 0.055885 Jan 15 21:33:40.604739 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3724/7436] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:33:40 2022] POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action => generated 24565 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:33:41.616049 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c21df363-a688-44a3-b484-dd84508ec7c4 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:33:41.617203 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c21df363-a688-44a3-b484-dd84508ec7c4 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:33:41.625081 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c21df363-a688-44a3-b484-dd84508ec7c4 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:41.625550 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c21df363-a688-44a3-b484-dd84508ec7c4 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:41.626341 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c21df363-a688-44a3-b484-dd84508ec7c4 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:41.626791 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c21df363-a688-44a3-b484-dd84508ec7c4 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:41.668392 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c21df363-a688-44a3-b484-dd84508ec7c4 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action" status: 200 len: 24565 microversion: 2.1 time: 0.056254 Jan 15 21:33:41.669056 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3713/7437] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:33:41 2022] POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action => generated 24565 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:33:42.681247 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8aac49d2-21d5-4ebd-be14-b5aede81052f tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:33:42.682265 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-8aac49d2-21d5-4ebd-be14-b5aede81052f tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:33:42.689596 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8aac49d2-21d5-4ebd-be14-b5aede81052f tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:42.690053 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8aac49d2-21d5-4ebd-be14-b5aede81052f tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:42.690844 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8aac49d2-21d5-4ebd-be14-b5aede81052f tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:42.691554 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8aac49d2-21d5-4ebd-be14-b5aede81052f tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:42.736086 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-8aac49d2-21d5-4ebd-be14-b5aede81052f tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action" status: 200 len: 24565 microversion: 2.1 time: 0.059645 Jan 15 21:33:42.736747 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3725/7438] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:33:42 2022] POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action => generated 24565 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:33:43.748144 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f688e28b-3c9c-4471-b3b2-64e1a92e05af tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:33:43.749215 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f688e28b-3c9c-4471-b3b2-64e1a92e05af tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:33:43.756766 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f688e28b-3c9c-4471-b3b2-64e1a92e05af tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:43.757259 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f688e28b-3c9c-4471-b3b2-64e1a92e05af tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:43.758712 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f688e28b-3c9c-4471-b3b2-64e1a92e05af tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:43.759275 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f688e28b-3c9c-4471-b3b2-64e1a92e05af tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:43.799855 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f688e28b-3c9c-4471-b3b2-64e1a92e05af tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action" status: 200 len: 24565 microversion: 2.1 time: 0.055640 Jan 15 21:33:43.800768 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3714/7439] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:33:43 2022] POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action => generated 24565 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:33:44.812376 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8ca0b033-ba85-4869-bad0-919d5c1c69ea tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:33:44.813439 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-8ca0b033-ba85-4869-bad0-919d5c1c69ea tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:33:44.821301 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8ca0b033-ba85-4869-bad0-919d5c1c69ea tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:44.821756 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8ca0b033-ba85-4869-bad0-919d5c1c69ea tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:44.822539 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8ca0b033-ba85-4869-bad0-919d5c1c69ea tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:44.822979 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8ca0b033-ba85-4869-bad0-919d5c1c69ea tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:44.864720 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-8ca0b033-ba85-4869-bad0-919d5c1c69ea tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action" status: 200 len: 24565 microversion: 2.1 time: 0.056354 Jan 15 21:33:44.865589 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3726/7440] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:33:44 2022] POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action => generated 24565 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:33:45.876737 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b2c29e43-cbe3-4eef-b323-dcdc0fe92a01 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:33:45.877782 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b2c29e43-cbe3-4eef-b323-dcdc0fe92a01 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:33:45.885639 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b2c29e43-cbe3-4eef-b323-dcdc0fe92a01 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:45.886108 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b2c29e43-cbe3-4eef-b323-dcdc0fe92a01 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:45.887009 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b2c29e43-cbe3-4eef-b323-dcdc0fe92a01 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:45.887490 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b2c29e43-cbe3-4eef-b323-dcdc0fe92a01 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:45.929641 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b2c29e43-cbe3-4eef-b323-dcdc0fe92a01 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action" status: 200 len: 24565 microversion: 2.1 time: 0.056872 Jan 15 21:33:45.930935 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3715/7441] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:33:45 2022] POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action => generated 24565 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:33:46.942680 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-6f7fce10-8661-43f1-8eab-2973379d72bd tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:33:46.943672 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-6f7fce10-8661-43f1-8eab-2973379d72bd tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:33:46.953368 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6f7fce10-8661-43f1-8eab-2973379d72bd tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:46.953828 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6f7fce10-8661-43f1-8eab-2973379d72bd tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:46.954620 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6f7fce10-8661-43f1-8eab-2973379d72bd tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:46.955058 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6f7fce10-8661-43f1-8eab-2973379d72bd tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:46.997307 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-6f7fce10-8661-43f1-8eab-2973379d72bd tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action" status: 200 len: 24565 microversion: 2.1 time: 0.058807 Jan 15 21:33:46.997954 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3727/7442] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:33:46 2022] POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action => generated 24565 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:33:48.010266 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-65435133-8a9a-4fb2-afee-1f6a229a136d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:33:48.011280 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-65435133-8a9a-4fb2-afee-1f6a229a136d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:33:48.018773 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-65435133-8a9a-4fb2-afee-1f6a229a136d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:48.019241 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-65435133-8a9a-4fb2-afee-1f6a229a136d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:48.020042 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-65435133-8a9a-4fb2-afee-1f6a229a136d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:48.020494 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-65435133-8a9a-4fb2-afee-1f6a229a136d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:48.060215 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-65435133-8a9a-4fb2-afee-1f6a229a136d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action" status: 200 len: 24565 microversion: 2.1 time: 0.054421 Jan 15 21:33:48.060860 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3716/7443] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:33:48 2022] POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action => generated 24565 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:33:49.073436 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b4b41219-bc03-4a65-971d-fcf039b0278c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:33:49.074439 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b4b41219-bc03-4a65-971d-fcf039b0278c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:33:49.081769 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b4b41219-bc03-4a65-971d-fcf039b0278c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:49.082217 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b4b41219-bc03-4a65-971d-fcf039b0278c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:49.082993 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b4b41219-bc03-4a65-971d-fcf039b0278c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:49.083425 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b4b41219-bc03-4a65-971d-fcf039b0278c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:49.124181 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b4b41219-bc03-4a65-971d-fcf039b0278c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action" status: 200 len: 24565 microversion: 2.1 time: 0.055912 Jan 15 21:33:49.124944 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3728/7444] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:33:49 2022] POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action => generated 24565 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:33:50.136378 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-176f024c-2b4b-4c96-848d-b0fea087e3a4 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:33:50.137396 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-176f024c-2b4b-4c96-848d-b0fea087e3a4 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:33:50.144599 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-176f024c-2b4b-4c96-848d-b0fea087e3a4 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:50.145095 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-176f024c-2b4b-4c96-848d-b0fea087e3a4 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:50.145877 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-176f024c-2b4b-4c96-848d-b0fea087e3a4 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:50.146323 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-176f024c-2b4b-4c96-848d-b0fea087e3a4 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:50.188714 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-176f024c-2b4b-4c96-848d-b0fea087e3a4 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action" status: 200 len: 24565 microversion: 2.1 time: 0.056516 Jan 15 21:33:50.189378 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3717/7445] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:33:50 2022] POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action => generated 24565 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:33:51.200991 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8655ffd3-e752-4aca-9ae6-dda1b5142b79 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:33:51.201978 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-8655ffd3-e752-4aca-9ae6-dda1b5142b79 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:33:51.209360 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8655ffd3-e752-4aca-9ae6-dda1b5142b79 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:51.209830 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8655ffd3-e752-4aca-9ae6-dda1b5142b79 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:51.210595 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8655ffd3-e752-4aca-9ae6-dda1b5142b79 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:51.211024 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8655ffd3-e752-4aca-9ae6-dda1b5142b79 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:51.250537 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-8655ffd3-e752-4aca-9ae6-dda1b5142b79 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action" status: 200 len: 24565 microversion: 2.1 time: 0.054174 Jan 15 21:33:51.251894 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3729/7446] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:33:51 2022] POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action => generated 24565 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:33:52.262429 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a0ca2b41-bfae-4c48-9e3e-f4aff8dbaa60 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:33:52.263357 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a0ca2b41-bfae-4c48-9e3e-f4aff8dbaa60 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:33:52.270696 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a0ca2b41-bfae-4c48-9e3e-f4aff8dbaa60 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:52.271162 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a0ca2b41-bfae-4c48-9e3e-f4aff8dbaa60 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:52.271950 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a0ca2b41-bfae-4c48-9e3e-f4aff8dbaa60 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:52.272398 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a0ca2b41-bfae-4c48-9e3e-f4aff8dbaa60 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:52.311196 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a0ca2b41-bfae-4c48-9e3e-f4aff8dbaa60 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action" status: 200 len: 24565 microversion: 2.1 time: 0.053315 Jan 15 21:33:52.312065 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3718/7447] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:33:52 2022] POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action => generated 24565 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:33:53.322854 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-cbf5abe5-0b65-4710-a7ad-64c0c5ddb3d6 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:33:53.323847 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-cbf5abe5-0b65-4710-a7ad-64c0c5ddb3d6 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:33:53.332166 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cbf5abe5-0b65-4710-a7ad-64c0c5ddb3d6 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:53.332611 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cbf5abe5-0b65-4710-a7ad-64c0c5ddb3d6 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:53.333427 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cbf5abe5-0b65-4710-a7ad-64c0c5ddb3d6 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:53.333859 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cbf5abe5-0b65-4710-a7ad-64c0c5ddb3d6 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:53.386507 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-cbf5abe5-0b65-4710-a7ad-64c0c5ddb3d6 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action" status: 200 len: 32640 microversion: 2.1 time: 0.067497 Jan 15 21:33:53.387391 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3730/7448] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:33:53 2022] POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action => generated 32640 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:33:54.398393 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-0857005a-811a-443f-a151-85d29eb036f7 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:33:54.399406 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-0857005a-811a-443f-a151-85d29eb036f7 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:33:54.407156 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0857005a-811a-443f-a151-85d29eb036f7 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:54.407619 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0857005a-811a-443f-a151-85d29eb036f7 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:54.408411 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0857005a-811a-443f-a151-85d29eb036f7 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:54.408882 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0857005a-811a-443f-a151-85d29eb036f7 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:54.450107 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-0857005a-811a-443f-a151-85d29eb036f7 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action" status: 200 len: 32640 microversion: 2.1 time: 0.055588 Jan 15 21:33:54.450809 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3719/7449] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:33:54 2022] POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action => generated 32640 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:33:55.462933 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-621fd7c8-e276-483c-821c-4d27881fa231 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:33:55.463902 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-621fd7c8-e276-483c-821c-4d27881fa231 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:33:55.471252 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-621fd7c8-e276-483c-821c-4d27881fa231 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:55.471700 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-621fd7c8-e276-483c-821c-4d27881fa231 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:55.472464 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-621fd7c8-e276-483c-821c-4d27881fa231 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:55.472916 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-621fd7c8-e276-483c-821c-4d27881fa231 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:55.516898 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-621fd7c8-e276-483c-821c-4d27881fa231 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action" status: 200 len: 32640 microversion: 2.1 time: 0.058443 Jan 15 21:33:55.517590 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3731/7450] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:33:55 2022] POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action => generated 32640 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:33:56.529859 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-de326fd0-e5c8-4c21-a5c5-a79d2484ac2d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:33:56.530883 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-de326fd0-e5c8-4c21-a5c5-a79d2484ac2d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:33:56.538532 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-de326fd0-e5c8-4c21-a5c5-a79d2484ac2d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:56.538999 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-de326fd0-e5c8-4c21-a5c5-a79d2484ac2d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:56.539826 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-de326fd0-e5c8-4c21-a5c5-a79d2484ac2d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:56.540953 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-de326fd0-e5c8-4c21-a5c5-a79d2484ac2d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:56.581360 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-de326fd0-e5c8-4c21-a5c5-a79d2484ac2d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action" status: 200 len: 32640 microversion: 2.1 time: 0.055401 Jan 15 21:33:56.581995 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3720/7451] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:33:56 2022] POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action => generated 32640 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:33:57.593665 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1e5e8c08-a2f3-4c7e-be4e-394bebf604bf tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:33:57.594672 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-1e5e8c08-a2f3-4c7e-be4e-394bebf604bf tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:33:57.601896 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1e5e8c08-a2f3-4c7e-be4e-394bebf604bf tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:57.602342 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1e5e8c08-a2f3-4c7e-be4e-394bebf604bf tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:57.603688 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1e5e8c08-a2f3-4c7e-be4e-394bebf604bf tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:57.604121 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1e5e8c08-a2f3-4c7e-be4e-394bebf604bf tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:57.648124 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-1e5e8c08-a2f3-4c7e-be4e-394bebf604bf tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action" status: 200 len: 32640 microversion: 2.1 time: 0.058277 Jan 15 21:33:57.648665 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3732/7452] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:33:57 2022] POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action => generated 32640 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:33:58.660380 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-7bcf6e6d-9285-47c9-9940-70867cc4221b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:33:58.661438 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-7bcf6e6d-9285-47c9-9940-70867cc4221b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:33:58.668916 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7bcf6e6d-9285-47c9-9940-70867cc4221b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:58.669382 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7bcf6e6d-9285-47c9-9940-70867cc4221b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:58.670172 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7bcf6e6d-9285-47c9-9940-70867cc4221b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:58.670625 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7bcf6e6d-9285-47c9-9940-70867cc4221b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:58.713653 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-7bcf6e6d-9285-47c9-9940-70867cc4221b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action" status: 200 len: 32640 microversion: 2.1 time: 0.057524 Jan 15 21:33:58.714329 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3721/7453] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:33:58 2022] POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action => generated 32640 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:33:59.725816 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-13e1fcef-f011-4e86-aec8-85e8c833daca tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:33:59.726903 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-13e1fcef-f011-4e86-aec8-85e8c833daca tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:33:59.734295 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-13e1fcef-f011-4e86-aec8-85e8c833daca tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:59.734747 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-13e1fcef-f011-4e86-aec8-85e8c833daca tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:59.735529 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-13e1fcef-f011-4e86-aec8-85e8c833daca tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:33:59.735968 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-13e1fcef-f011-4e86-aec8-85e8c833daca tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:33:59.780956 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-13e1fcef-f011-4e86-aec8-85e8c833daca tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action" status: 200 len: 32640 microversion: 2.1 time: 0.059084 Jan 15 21:33:59.781588 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3733/7454] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:33:59 2022] POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action => generated 32640 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:34:00.793190 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5e25cc23-a513-456d-8a97-9a2e7ed3d2bf tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:34:00.794340 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-5e25cc23-a513-456d-8a97-9a2e7ed3d2bf tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:34:00.803286 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5e25cc23-a513-456d-8a97-9a2e7ed3d2bf tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:34:00.803918 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5e25cc23-a513-456d-8a97-9a2e7ed3d2bf tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:34:00.804767 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5e25cc23-a513-456d-8a97-9a2e7ed3d2bf tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:34:00.805247 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5e25cc23-a513-456d-8a97-9a2e7ed3d2bf tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:34:00.851561 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5e25cc23-a513-456d-8a97-9a2e7ed3d2bf tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action" status: 200 len: 32640 microversion: 2.1 time: 0.062386 Jan 15 21:34:00.852205 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3722/7455] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:34:00 2022] POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action => generated 32640 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:34:01.863856 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-2275cf87-257b-4b0c-bfdc-e9171118c141 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:34:01.864859 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-2275cf87-257b-4b0c-bfdc-e9171118c141 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:34:01.872321 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2275cf87-257b-4b0c-bfdc-e9171118c141 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:34:01.872763 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2275cf87-257b-4b0c-bfdc-e9171118c141 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:34:01.873553 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2275cf87-257b-4b0c-bfdc-e9171118c141 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:34:01.873982 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2275cf87-257b-4b0c-bfdc-e9171118c141 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:34:01.918419 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-2275cf87-257b-4b0c-bfdc-e9171118c141 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action" status: 200 len: 32640 microversion: 2.1 time: 0.058565 Jan 15 21:34:01.919051 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3734/7456] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:34:01 2022] POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action => generated 32640 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:34:02.931592 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5ff4dfdf-6aea-4bf8-b66e-aaf0591487f4 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:34:02.932610 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-5ff4dfdf-6aea-4bf8-b66e-aaf0591487f4 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:34:02.939991 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5ff4dfdf-6aea-4bf8-b66e-aaf0591487f4 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:34:02.940455 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5ff4dfdf-6aea-4bf8-b66e-aaf0591487f4 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:34:02.941276 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5ff4dfdf-6aea-4bf8-b66e-aaf0591487f4 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:34:02.941726 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5ff4dfdf-6aea-4bf8-b66e-aaf0591487f4 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:34:02.986068 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5ff4dfdf-6aea-4bf8-b66e-aaf0591487f4 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action" status: 200 len: 32640 microversion: 2.1 time: 0.059433 Jan 15 21:34:02.987039 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3723/7457] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:34:02 2022] POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action => generated 32640 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:34:03.998117 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-92bf8121-1dc6-418d-b92f-ff65b3392817 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:34:03.999122 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-92bf8121-1dc6-418d-b92f-ff65b3392817 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:34:04.006476 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-92bf8121-1dc6-418d-b92f-ff65b3392817 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:34:04.006928 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-92bf8121-1dc6-418d-b92f-ff65b3392817 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:34:04.007717 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-92bf8121-1dc6-418d-b92f-ff65b3392817 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:34:04.008157 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-92bf8121-1dc6-418d-b92f-ff65b3392817 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:34:04.052858 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-92bf8121-1dc6-418d-b92f-ff65b3392817 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action" status: 200 len: 32640 microversion: 2.1 time: 0.059204 Jan 15 21:34:04.053909 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3735/7458] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:34:03 2022] POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action => generated 32640 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:34:05.065913 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-748cf344-1e1b-4f13-bb96-2c2df92fa9cf tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:34:05.066934 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-748cf344-1e1b-4f13-bb96-2c2df92fa9cf tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:34:05.075026 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-748cf344-1e1b-4f13-bb96-2c2df92fa9cf tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:34:05.075487 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-748cf344-1e1b-4f13-bb96-2c2df92fa9cf tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:34:05.076265 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-748cf344-1e1b-4f13-bb96-2c2df92fa9cf tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:34:05.076717 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-748cf344-1e1b-4f13-bb96-2c2df92fa9cf tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:34:05.120154 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-748cf344-1e1b-4f13-bb96-2c2df92fa9cf tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action" status: 200 len: 32640 microversion: 2.1 time: 0.058208 Jan 15 21:34:05.121070 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3724/7459] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:34:05 2022] POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action => generated 32640 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:34:06.132614 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-6a4e8c29-e84d-4f75-ba40-568d2a96fccc tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:34:06.133642 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-6a4e8c29-e84d-4f75-ba40-568d2a96fccc tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:34:06.141214 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6a4e8c29-e84d-4f75-ba40-568d2a96fccc tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:34:06.141665 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6a4e8c29-e84d-4f75-ba40-568d2a96fccc tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:34:06.142441 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6a4e8c29-e84d-4f75-ba40-568d2a96fccc tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:34:06.142875 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6a4e8c29-e84d-4f75-ba40-568d2a96fccc tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:34:06.188476 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-6a4e8c29-e84d-4f75-ba40-568d2a96fccc tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action" status: 200 len: 32640 microversion: 2.1 time: 0.059823 Jan 15 21:34:06.189158 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3736/7460] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:34:06 2022] POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action => generated 32640 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:34:07.201811 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5c47ee45-c498-4cf2-9138-668949ca571a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:34:07.202878 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-5c47ee45-c498-4cf2-9138-668949ca571a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:34:07.210214 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5c47ee45-c498-4cf2-9138-668949ca571a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:34:07.210680 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5c47ee45-c498-4cf2-9138-668949ca571a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:34:07.211471 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5c47ee45-c498-4cf2-9138-668949ca571a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:34:07.211918 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5c47ee45-c498-4cf2-9138-668949ca571a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:34:07.254647 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5c47ee45-c498-4cf2-9138-668949ca571a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action" status: 200 len: 32640 microversion: 2.1 time: 0.057841 Jan 15 21:34:07.255316 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3725/7461] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:34:07 2022] POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action => generated 32640 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:34:08.267090 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-374652c6-a625-4b1c-9f5d-62228c037f85 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:34:08.267993 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-374652c6-a625-4b1c-9f5d-62228c037f85 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:34:08.275303 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-374652c6-a625-4b1c-9f5d-62228c037f85 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:34:08.275747 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-374652c6-a625-4b1c-9f5d-62228c037f85 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:34:08.276538 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-374652c6-a625-4b1c-9f5d-62228c037f85 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:34:08.277623 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-374652c6-a625-4b1c-9f5d-62228c037f85 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:34:08.320755 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-374652c6-a625-4b1c-9f5d-62228c037f85 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action" status: 200 len: 32640 microversion: 2.1 time: 0.057582 Jan 15 21:34:08.322913 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3737/7462] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:34:08 2022] POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action => generated 32640 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:34:09.333369 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2c2633bc-9b3b-4415-82bf-068a039d0b10 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:34:09.334380 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-2c2633bc-9b3b-4415-82bf-068a039d0b10 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:34:09.342035 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2c2633bc-9b3b-4415-82bf-068a039d0b10 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:34:09.342501 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2c2633bc-9b3b-4415-82bf-068a039d0b10 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:34:09.343286 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2c2633bc-9b3b-4415-82bf-068a039d0b10 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:34:09.343734 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2c2633bc-9b3b-4415-82bf-068a039d0b10 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:34:09.385198 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2c2633bc-9b3b-4415-82bf-068a039d0b10 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action" status: 200 len: 32640 microversion: 2.1 time: 0.055658 Jan 15 21:34:09.385857 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3726/7463] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:34:09 2022] POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action => generated 32640 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:34:10.397868 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-602ef859-150b-45fb-87fe-fca021fe7454 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:34:10.398863 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-602ef859-150b-45fb-87fe-fca021fe7454 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:34:10.406190 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-602ef859-150b-45fb-87fe-fca021fe7454 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:34:10.406639 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-602ef859-150b-45fb-87fe-fca021fe7454 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:34:10.407412 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-602ef859-150b-45fb-87fe-fca021fe7454 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:34:10.407847 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-602ef859-150b-45fb-87fe-fca021fe7454 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:34:10.454167 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-602ef859-150b-45fb-87fe-fca021fe7454 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action" status: 200 len: 32640 microversion: 2.1 time: 0.060378 Jan 15 21:34:10.454798 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3738/7464] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:34:10 2022] POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action => generated 32640 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:34:11.467048 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f27b2da8-2533-4b5c-afc8-f8bc7894d8e5 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:34:11.468055 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f27b2da8-2533-4b5c-afc8-f8bc7894d8e5 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:34:11.475364 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f27b2da8-2533-4b5c-afc8-f8bc7894d8e5 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:34:11.475823 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f27b2da8-2533-4b5c-afc8-f8bc7894d8e5 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:34:11.476598 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f27b2da8-2533-4b5c-afc8-f8bc7894d8e5 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:34:11.477070 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f27b2da8-2533-4b5c-afc8-f8bc7894d8e5 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:34:11.524248 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f27b2da8-2533-4b5c-afc8-f8bc7894d8e5 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action" status: 200 len: 32640 microversion: 2.1 time: 0.061757 Jan 15 21:34:11.525311 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3727/7465] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:34:11 2022] POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action => generated 32640 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 21:34:12.537535 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a5074ef6-64ff-4bdb-9aa9-a8f50885fcd6 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:34:12.538438 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a5074ef6-64ff-4bdb-9aa9-a8f50885fcd6 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:34:12.546549 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a5074ef6-64ff-4bdb-9aa9-a8f50885fcd6 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:34:12.547024 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a5074ef6-64ff-4bdb-9aa9-a8f50885fcd6 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:34:12.547798 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a5074ef6-64ff-4bdb-9aa9-a8f50885fcd6 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:34:12.548233 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a5074ef6-64ff-4bdb-9aa9-a8f50885fcd6 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:34:12.594087 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a5074ef6-64ff-4bdb-9aa9-a8f50885fcd6 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action" status: 200 len: 32640 microversion: 2.1 time: 0.060851 Jan 15 21:34:12.594776 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3739/7466] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:34:12 2022] POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action => generated 32640 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:34:13.606913 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3ef0bc57-fead-4be2-8bf7-8869d799591c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:34:13.607942 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-3ef0bc57-fead-4be2-8bf7-8869d799591c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:34:13.615349 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3ef0bc57-fead-4be2-8bf7-8869d799591c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:34:13.615817 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3ef0bc57-fead-4be2-8bf7-8869d799591c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:34:13.616610 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3ef0bc57-fead-4be2-8bf7-8869d799591c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:34:13.617090 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3ef0bc57-fead-4be2-8bf7-8869d799591c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:34:13.662979 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3ef0bc57-fead-4be2-8bf7-8869d799591c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action" status: 200 len: 32640 microversion: 2.1 time: 0.060575 Jan 15 21:34:13.664069 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3728/7467] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:34:13 2022] POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action => generated 32640 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:34:14.675584 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c47e7a5b-7c71-4455-a993-db08bf798ef6 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:34:14.676580 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c47e7a5b-7c71-4455-a993-db08bf798ef6 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:34:14.683419 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c47e7a5b-7c71-4455-a993-db08bf798ef6 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:34:14.684495 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c47e7a5b-7c71-4455-a993-db08bf798ef6 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:34:14.685299 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c47e7a5b-7c71-4455-a993-db08bf798ef6 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:34:14.685729 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c47e7a5b-7c71-4455-a993-db08bf798ef6 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:34:14.728814 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c47e7a5b-7c71-4455-a993-db08bf798ef6 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action" status: 200 len: 32640 microversion: 2.1 time: 0.057321 Jan 15 21:34:14.729568 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3740/7468] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:34:14 2022] POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action => generated 32640 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:34:15.742205 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-43d39fed-26af-46f9-a60e-80431d1b131a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:34:15.743215 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-43d39fed-26af-46f9-a60e-80431d1b131a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:34:15.750733 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-43d39fed-26af-46f9-a60e-80431d1b131a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:34:15.751195 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-43d39fed-26af-46f9-a60e-80431d1b131a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:34:15.751987 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-43d39fed-26af-46f9-a60e-80431d1b131a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:34:15.752465 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-43d39fed-26af-46f9-a60e-80431d1b131a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:34:15.797166 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-43d39fed-26af-46f9-a60e-80431d1b131a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action" status: 200 len: 32640 microversion: 2.1 time: 0.058992 Jan 15 21:34:15.798032 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3729/7469] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:34:15 2022] POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action => generated 32640 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:34:16.810226 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c761f1b9-09af-4b38-a470-f07164149245 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:34:16.811240 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c761f1b9-09af-4b38-a470-f07164149245 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:34:16.818524 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c761f1b9-09af-4b38-a470-f07164149245 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:34:16.818978 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c761f1b9-09af-4b38-a470-f07164149245 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:34:16.819751 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c761f1b9-09af-4b38-a470-f07164149245 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:34:16.820186 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c761f1b9-09af-4b38-a470-f07164149245 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:34:16.863609 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c761f1b9-09af-4b38-a470-f07164149245 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action" status: 200 len: 32640 microversion: 2.1 time: 0.058035 Jan 15 21:34:16.864243 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3741/7470] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:34:16 2022] POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action => generated 32640 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:34:17.876334 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-68ad2be5-0e49-4144-9bde-931911f8aed7 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:34:17.877379 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-68ad2be5-0e49-4144-9bde-931911f8aed7 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:34:17.884630 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-68ad2be5-0e49-4144-9bde-931911f8aed7 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:34:17.885124 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-68ad2be5-0e49-4144-9bde-931911f8aed7 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:34:17.885913 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-68ad2be5-0e49-4144-9bde-931911f8aed7 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:34:17.886365 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-68ad2be5-0e49-4144-9bde-931911f8aed7 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:34:17.930429 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-68ad2be5-0e49-4144-9bde-931911f8aed7 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action" status: 200 len: 32640 microversion: 2.1 time: 0.058118 Jan 15 21:34:17.931076 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3730/7471] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:34:17 2022] POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action => generated 32640 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:34:18.943804 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-672416a6-d21e-4bcb-bbbe-92112e003d52 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:34:18.944850 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-672416a6-d21e-4bcb-bbbe-92112e003d52 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:34:18.952659 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-672416a6-d21e-4bcb-bbbe-92112e003d52 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:34:18.953133 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-672416a6-d21e-4bcb-bbbe-92112e003d52 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:34:18.953910 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-672416a6-d21e-4bcb-bbbe-92112e003d52 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:34:18.954344 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-672416a6-d21e-4bcb-bbbe-92112e003d52 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:34:18.997800 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-672416a6-d21e-4bcb-bbbe-92112e003d52 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action" status: 200 len: 32640 microversion: 2.1 time: 0.057953 Jan 15 21:34:18.998696 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3742/7472] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:34:18 2022] POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action => generated 32640 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:34:20.010254 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-6fd330c5-00ba-4060-94bb-ad44ce69bee5 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:34:20.011267 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-6fd330c5-00ba-4060-94bb-ad44ce69bee5 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:34:20.019340 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6fd330c5-00ba-4060-94bb-ad44ce69bee5 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:34:20.019804 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6fd330c5-00ba-4060-94bb-ad44ce69bee5 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:34:20.020597 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6fd330c5-00ba-4060-94bb-ad44ce69bee5 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:34:20.021077 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6fd330c5-00ba-4060-94bb-ad44ce69bee5 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:34:20.066043 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-6fd330c5-00ba-4060-94bb-ad44ce69bee5 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action" status: 200 len: 32640 microversion: 2.1 time: 0.059809 Jan 15 21:34:20.066914 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3731/7473] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:34:20 2022] POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action => generated 32640 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:34:21.078697 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-dbcc6771-7a25-447e-8e0c-2f0763fb968c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:34:21.079608 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-dbcc6771-7a25-447e-8e0c-2f0763fb968c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:34:21.087377 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dbcc6771-7a25-447e-8e0c-2f0763fb968c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:34:21.087937 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dbcc6771-7a25-447e-8e0c-2f0763fb968c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:34:21.088753 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dbcc6771-7a25-447e-8e0c-2f0763fb968c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:34:21.089236 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dbcc6771-7a25-447e-8e0c-2f0763fb968c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:34:21.136315 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-dbcc6771-7a25-447e-8e0c-2f0763fb968c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action" status: 200 len: 32640 microversion: 2.1 time: 0.062058 Jan 15 21:34:21.138118 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3743/7474] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:34:21 2022] POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action => generated 32640 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 21:34:22.149089 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-14c91cca-678d-4a09-a457-98f0ddf7f8d1 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:34:22.150093 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-14c91cca-678d-4a09-a457-98f0ddf7f8d1 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:34:22.157499 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-14c91cca-678d-4a09-a457-98f0ddf7f8d1 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:34:22.157963 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-14c91cca-678d-4a09-a457-98f0ddf7f8d1 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:34:22.158745 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-14c91cca-678d-4a09-a457-98f0ddf7f8d1 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:34:22.159187 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-14c91cca-678d-4a09-a457-98f0ddf7f8d1 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:34:22.205727 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-14c91cca-678d-4a09-a457-98f0ddf7f8d1 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action" status: 200 len: 32640 microversion: 2.1 time: 0.060556 Jan 15 21:34:22.206374 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3732/7475] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:34:22 2022] POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action => generated 32640 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:34:23.218671 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0e8fa7df-c630-48d3-a425-d357e5d55ef7 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:34:23.219698 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-0e8fa7df-c630-48d3-a425-d357e5d55ef7 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:34:23.227012 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0e8fa7df-c630-48d3-a425-d357e5d55ef7 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:34:23.227501 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0e8fa7df-c630-48d3-a425-d357e5d55ef7 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:34:23.228233 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0e8fa7df-c630-48d3-a425-d357e5d55ef7 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:34:23.228664 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0e8fa7df-c630-48d3-a425-d357e5d55ef7 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:34:23.272657 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0e8fa7df-c630-48d3-a425-d357e5d55ef7 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action" status: 200 len: 32640 microversion: 2.1 time: 0.058708 Jan 15 21:34:23.273452 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3744/7476] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:34:23 2022] POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action => generated 32640 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:34:24.284774 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-77cf60a4-fdd1-415a-bdd9-934086cba10a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:34:24.286179 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-77cf60a4-fdd1-415a-bdd9-934086cba10a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:34:24.294423 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-77cf60a4-fdd1-415a-bdd9-934086cba10a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:34:24.294885 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-77cf60a4-fdd1-415a-bdd9-934086cba10a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:34:24.295674 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-77cf60a4-fdd1-415a-bdd9-934086cba10a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:34:24.296117 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-77cf60a4-fdd1-415a-bdd9-934086cba10a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:34:24.346293 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-77cf60a4-fdd1-415a-bdd9-934086cba10a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action" status: 200 len: 32640 microversion: 2.1 time: 0.065421 Jan 15 21:34:24.346940 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3733/7477] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:34:24 2022] POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action => generated 32640 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:34:25.358820 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-664568cb-9e5e-4104-a7ac-d435f20dfc6b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:34:25.359819 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-664568cb-9e5e-4104-a7ac-d435f20dfc6b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:34:25.367482 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-664568cb-9e5e-4104-a7ac-d435f20dfc6b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:34:25.367925 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-664568cb-9e5e-4104-a7ac-d435f20dfc6b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:34:25.368697 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-664568cb-9e5e-4104-a7ac-d435f20dfc6b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:34:25.369187 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-664568cb-9e5e-4104-a7ac-d435f20dfc6b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:34:25.415443 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-664568cb-9e5e-4104-a7ac-d435f20dfc6b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action" status: 200 len: 32640 microversion: 2.1 time: 0.061061 Jan 15 21:34:25.416228 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3745/7478] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:34:25 2022] POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action => generated 32640 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:34:26.428200 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-bc540973-9195-48a4-ac10-82f101889e2e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:34:26.429354 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-bc540973-9195-48a4-ac10-82f101889e2e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:34:26.437207 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bc540973-9195-48a4-ac10-82f101889e2e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:34:26.437679 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bc540973-9195-48a4-ac10-82f101889e2e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:34:26.438494 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bc540973-9195-48a4-ac10-82f101889e2e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:34:26.438989 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bc540973-9195-48a4-ac10-82f101889e2e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:34:26.484718 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-bc540973-9195-48a4-ac10-82f101889e2e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action" status: 200 len: 32640 microversion: 2.1 time: 0.060567 Jan 15 21:34:26.485393 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3734/7479] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:34:26 2022] POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action => generated 32640 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:34:27.496341 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-28cd3625-c65c-4a83-abed-4d52bacd04b0 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:34:27.497397 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-28cd3625-c65c-4a83-abed-4d52bacd04b0 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:34:27.504763 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-28cd3625-c65c-4a83-abed-4d52bacd04b0 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:34:27.505244 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-28cd3625-c65c-4a83-abed-4d52bacd04b0 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:34:27.506025 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-28cd3625-c65c-4a83-abed-4d52bacd04b0 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:34:27.506465 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-28cd3625-c65c-4a83-abed-4d52bacd04b0 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:34:27.550855 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-28cd3625-c65c-4a83-abed-4d52bacd04b0 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action" status: 200 len: 32640 microversion: 2.1 time: 0.058630 Jan 15 21:34:27.551622 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3746/7480] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:34:27 2022] POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action => generated 32640 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:34:28.563266 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5ce5f855-2256-4ddf-b560-c8f6f3212552 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:34:28.564311 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-5ce5f855-2256-4ddf-b560-c8f6f3212552 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:34:28.571794 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5ce5f855-2256-4ddf-b560-c8f6f3212552 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:34:28.572266 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5ce5f855-2256-4ddf-b560-c8f6f3212552 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:34:28.573094 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5ce5f855-2256-4ddf-b560-c8f6f3212552 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:34:28.573551 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5ce5f855-2256-4ddf-b560-c8f6f3212552 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:34:28.618825 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5ce5f855-2256-4ddf-b560-c8f6f3212552 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action" status: 200 len: 32640 microversion: 2.1 time: 0.059592 Jan 15 21:34:28.619476 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3735/7481] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:34:28 2022] POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action => generated 32640 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:34:29.631241 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-2de1637d-5246-47b6-bcd5-1da96e301044 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:34:29.632261 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-2de1637d-5246-47b6-bcd5-1da96e301044 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:34:29.639554 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2de1637d-5246-47b6-bcd5-1da96e301044 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:34:29.640002 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2de1637d-5246-47b6-bcd5-1da96e301044 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:34:29.640782 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2de1637d-5246-47b6-bcd5-1da96e301044 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:34:29.641241 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2de1637d-5246-47b6-bcd5-1da96e301044 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:34:29.685616 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-2de1637d-5246-47b6-bcd5-1da96e301044 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action" status: 200 len: 32640 microversion: 2.1 time: 0.058410 Jan 15 21:34:29.686223 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3747/7482] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:34:29 2022] POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action => generated 32640 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:34:30.698051 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8f77e2e6-360a-469b-a0a8-59e008526fa5 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:34:30.699148 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-8f77e2e6-360a-469b-a0a8-59e008526fa5 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:34:30.706495 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8f77e2e6-360a-469b-a0a8-59e008526fa5 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:34:30.706963 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8f77e2e6-360a-469b-a0a8-59e008526fa5 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:34:30.707758 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8f77e2e6-360a-469b-a0a8-59e008526fa5 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:34:30.708205 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8f77e2e6-360a-469b-a0a8-59e008526fa5 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:34:30.754677 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-8f77e2e6-360a-469b-a0a8-59e008526fa5 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action" status: 200 len: 32640 microversion: 2.1 time: 0.060489 Jan 15 21:34:30.756692 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3736/7483] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:34:30 2022] POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action => generated 32640 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:34:31.767248 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1d065ed2-86bf-491f-b873-04ab1c4bf28e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:34:31.768241 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-1d065ed2-86bf-491f-b873-04ab1c4bf28e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:34:31.775554 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1d065ed2-86bf-491f-b873-04ab1c4bf28e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:34:31.776028 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1d065ed2-86bf-491f-b873-04ab1c4bf28e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:34:31.776803 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1d065ed2-86bf-491f-b873-04ab1c4bf28e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:34:31.777271 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1d065ed2-86bf-491f-b873-04ab1c4bf28e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:34:31.828213 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-1d065ed2-86bf-491f-b873-04ab1c4bf28e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action" status: 200 len: 32640 microversion: 2.1 time: 0.064928 Jan 15 21:34:31.829118 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3748/7484] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:34:31 2022] POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action => generated 32640 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 21:34:32.840446 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ac912ed8-9aad-49d5-8603-53653303474b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:34:32.841475 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ac912ed8-9aad-49d5-8603-53653303474b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:34:32.848771 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ac912ed8-9aad-49d5-8603-53653303474b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:34:32.849259 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ac912ed8-9aad-49d5-8603-53653303474b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:34:32.850041 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ac912ed8-9aad-49d5-8603-53653303474b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:34:32.850485 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ac912ed8-9aad-49d5-8603-53653303474b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:34:32.894675 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ac912ed8-9aad-49d5-8603-53653303474b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action" status: 200 len: 32640 microversion: 2.1 time: 0.058204 Jan 15 21:34:32.895619 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3737/7485] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:34:32 2022] POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action => generated 32640 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:34:33.906820 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-211fa813-3962-43ce-88f1-6649a9be44fd tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:34:33.907838 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-211fa813-3962-43ce-88f1-6649a9be44fd tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:34:33.915349 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-211fa813-3962-43ce-88f1-6649a9be44fd tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:34:33.915793 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-211fa813-3962-43ce-88f1-6649a9be44fd tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:34:33.916590 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-211fa813-3962-43ce-88f1-6649a9be44fd tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:34:33.917059 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-211fa813-3962-43ce-88f1-6649a9be44fd tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:34:33.965147 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-211fa813-3962-43ce-88f1-6649a9be44fd tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action" status: 200 len: 32640 microversion: 2.1 time: 0.062060 Jan 15 21:34:33.965792 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3749/7486] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:34:33 2022] POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action => generated 32640 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 21:34:34.977240 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-801df357-46a5-4498-b4c4-3dd3fc90b0c8 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:34:34.978257 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-801df357-46a5-4498-b4c4-3dd3fc90b0c8 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:34:34.985903 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-801df357-46a5-4498-b4c4-3dd3fc90b0c8 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:34:34.986364 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-801df357-46a5-4498-b4c4-3dd3fc90b0c8 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:34:34.987153 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-801df357-46a5-4498-b4c4-3dd3fc90b0c8 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:34:34.987605 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-801df357-46a5-4498-b4c4-3dd3fc90b0c8 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:34:35.032104 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-801df357-46a5-4498-b4c4-3dd3fc90b0c8 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action" status: 200 len: 32640 microversion: 2.1 time: 0.058923 Jan 15 21:34:35.032739 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3738/7487] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:34:34 2022] POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action => generated 32640 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:34:36.044719 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-fc2a19a3-4e47-4a60-8298-ee154ce6bbcc tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:34:36.045728 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-fc2a19a3-4e47-4a60-8298-ee154ce6bbcc tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:34:36.053063 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fc2a19a3-4e47-4a60-8298-ee154ce6bbcc tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:34:36.053514 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fc2a19a3-4e47-4a60-8298-ee154ce6bbcc tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:34:36.054284 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fc2a19a3-4e47-4a60-8298-ee154ce6bbcc tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:34:36.054719 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fc2a19a3-4e47-4a60-8298-ee154ce6bbcc tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:34:36.096052 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-fc2a19a3-4e47-4a60-8298-ee154ce6bbcc tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action" status: 200 len: 32640 microversion: 2.1 time: 0.055993 Jan 15 21:34:36.096685 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3750/7488] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:34:36 2022] POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action => generated 32640 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:34:37.108481 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-4674d491-fe78-42a4-91fd-c88097512643 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:34:37.109548 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-4674d491-fe78-42a4-91fd-c88097512643 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:34:37.116804 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4674d491-fe78-42a4-91fd-c88097512643 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:34:37.117291 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4674d491-fe78-42a4-91fd-c88097512643 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:34:37.118081 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4674d491-fe78-42a4-91fd-c88097512643 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:34:37.118518 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4674d491-fe78-42a4-91fd-c88097512643 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:34:37.165298 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-4674d491-fe78-42a4-91fd-c88097512643 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action" status: 200 len: 32640 microversion: 2.1 time: 0.060914 Jan 15 21:34:37.165961 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3739/7489] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:34:37 2022] POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action => generated 32640 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:34:38.177265 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c60bec0e-b67f-43ec-9824-400e975f823f tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:34:38.178254 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c60bec0e-b67f-43ec-9824-400e975f823f tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:34:38.186057 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c60bec0e-b67f-43ec-9824-400e975f823f tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:34:38.186507 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c60bec0e-b67f-43ec-9824-400e975f823f tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:34:38.187284 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c60bec0e-b67f-43ec-9824-400e975f823f tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:34:38.187718 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c60bec0e-b67f-43ec-9824-400e975f823f tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:34:38.232620 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c60bec0e-b67f-43ec-9824-400e975f823f tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action" status: 200 len: 32640 microversion: 2.1 time: 0.059254 Jan 15 21:34:38.233298 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3751/7490] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:34:38 2022] POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action => generated 32640 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:34:39.244610 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9a515d8f-723c-47a7-ad14-a7567b7e3be3 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:34:39.245669 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-9a515d8f-723c-47a7-ad14-a7567b7e3be3 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:34:39.253824 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9a515d8f-723c-47a7-ad14-a7567b7e3be3 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:34:39.254302 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9a515d8f-723c-47a7-ad14-a7567b7e3be3 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:34:39.255183 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9a515d8f-723c-47a7-ad14-a7567b7e3be3 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:34:39.255639 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9a515d8f-723c-47a7-ad14-a7567b7e3be3 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:34:39.300833 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-9a515d8f-723c-47a7-ad14-a7567b7e3be3 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action" status: 200 len: 32640 microversion: 2.1 time: 0.060458 Jan 15 21:34:39.301519 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3740/7491] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:34:39 2022] POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action => generated 32640 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:34:40.313245 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b4df475f-c914-47ff-a1b1-c1dc6f25d1e8 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:34:40.314290 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b4df475f-c914-47ff-a1b1-c1dc6f25d1e8 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:34:40.322071 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b4df475f-c914-47ff-a1b1-c1dc6f25d1e8 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:34:40.322528 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b4df475f-c914-47ff-a1b1-c1dc6f25d1e8 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:34:40.323320 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b4df475f-c914-47ff-a1b1-c1dc6f25d1e8 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:34:40.323792 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b4df475f-c914-47ff-a1b1-c1dc6f25d1e8 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:34:40.373183 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b4df475f-c914-47ff-a1b1-c1dc6f25d1e8 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action" status: 200 len: 32640 microversion: 2.1 time: 0.064552 Jan 15 21:34:40.374107 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3752/7492] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:34:40 2022] POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action => generated 32640 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:34:41.385082 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c9c35968-7989-4f50-b409-0e508d213269 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:34:41.386188 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c9c35968-7989-4f50-b409-0e508d213269 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:34:41.394165 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c9c35968-7989-4f50-b409-0e508d213269 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:34:41.394563 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c9c35968-7989-4f50-b409-0e508d213269 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:34:41.395362 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c9c35968-7989-4f50-b409-0e508d213269 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:34:41.395816 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c9c35968-7989-4f50-b409-0e508d213269 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:34:41.442943 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c9c35968-7989-4f50-b409-0e508d213269 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action" status: 200 len: 32640 microversion: 2.1 time: 0.061765 Jan 15 21:34:41.443840 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3741/7493] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:34:41 2022] POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action => generated 32640 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:34:42.456210 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-11734eb1-dbe5-413b-860a-a4fdbda6d4c0 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:34:42.457226 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-11734eb1-dbe5-413b-860a-a4fdbda6d4c0 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:34:42.464562 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-11734eb1-dbe5-413b-860a-a4fdbda6d4c0 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:34:42.466304 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-11734eb1-dbe5-413b-860a-a4fdbda6d4c0 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:34:42.467149 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-11734eb1-dbe5-413b-860a-a4fdbda6d4c0 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:34:42.467626 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-11734eb1-dbe5-413b-860a-a4fdbda6d4c0 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:34:42.518458 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-11734eb1-dbe5-413b-860a-a4fdbda6d4c0 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action" status: 200 len: 32640 microversion: 2.1 time: 0.066223 Jan 15 21:34:42.519131 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3753/7494] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:34:42 2022] POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action => generated 32640 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:34:43.530791 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-6eacc955-fe4e-4a63-8bf5-11aedb3c7540 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:34:43.531791 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-6eacc955-fe4e-4a63-8bf5-11aedb3c7540 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:34:43.539332 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6eacc955-fe4e-4a63-8bf5-11aedb3c7540 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:34:43.539791 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6eacc955-fe4e-4a63-8bf5-11aedb3c7540 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:34:43.540575 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6eacc955-fe4e-4a63-8bf5-11aedb3c7540 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:34:43.541048 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6eacc955-fe4e-4a63-8bf5-11aedb3c7540 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:34:43.585167 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-6eacc955-fe4e-4a63-8bf5-11aedb3c7540 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action" status: 200 len: 32640 microversion: 2.1 time: 0.058408 Jan 15 21:34:43.585843 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3742/7495] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:34:43 2022] POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action => generated 32640 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:34:44.597582 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-fd35df33-7395-4be7-9f29-c834edb247ce tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:34:44.598903 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-fd35df33-7395-4be7-9f29-c834edb247ce tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:34:44.607064 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fd35df33-7395-4be7-9f29-c834edb247ce tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:34:44.607552 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fd35df33-7395-4be7-9f29-c834edb247ce tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:34:44.608348 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fd35df33-7395-4be7-9f29-c834edb247ce tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:34:44.608797 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fd35df33-7395-4be7-9f29-c834edb247ce tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:34:44.652720 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-fd35df33-7395-4be7-9f29-c834edb247ce tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action" status: 200 len: 32640 microversion: 2.1 time: 0.058666 Jan 15 21:34:44.653344 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3754/7496] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:34:44 2022] POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action => generated 32640 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:34:45.664800 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-de3d6cad-8177-44cb-95b3-e158956b602c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:34:45.665826 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-de3d6cad-8177-44cb-95b3-e158956b602c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:34:45.673698 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-de3d6cad-8177-44cb-95b3-e158956b602c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:34:45.674158 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-de3d6cad-8177-44cb-95b3-e158956b602c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:34:45.674939 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-de3d6cad-8177-44cb-95b3-e158956b602c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:34:45.675381 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-de3d6cad-8177-44cb-95b3-e158956b602c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:34:45.719585 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-de3d6cad-8177-44cb-95b3-e158956b602c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action" status: 200 len: 32640 microversion: 2.1 time: 0.059110 Jan 15 21:34:45.720536 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3743/7497] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:34:45 2022] POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action => generated 32640 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:34:46.732466 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-356fee89-9225-4efc-a671-6b5e76b2e082 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:34:46.733511 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-356fee89-9225-4efc-a671-6b5e76b2e082 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:34:46.740861 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-356fee89-9225-4efc-a671-6b5e76b2e082 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:34:46.741325 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-356fee89-9225-4efc-a671-6b5e76b2e082 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:34:46.742093 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-356fee89-9225-4efc-a671-6b5e76b2e082 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:34:46.742529 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-356fee89-9225-4efc-a671-6b5e76b2e082 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:34:46.790095 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-356fee89-9225-4efc-a671-6b5e76b2e082 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action" status: 200 len: 32640 microversion: 2.1 time: 0.062225 Jan 15 21:34:46.790979 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3755/7498] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:34:46 2022] POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action => generated 32640 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:34:47.804398 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e5dfe46c-0c4e-4c86-9b9d-6d829b7b9d94 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:34:47.805992 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e5dfe46c-0c4e-4c86-9b9d-6d829b7b9d94 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:34:47.814943 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e5dfe46c-0c4e-4c86-9b9d-6d829b7b9d94 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:34:47.815419 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e5dfe46c-0c4e-4c86-9b9d-6d829b7b9d94 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:34:47.816218 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e5dfe46c-0c4e-4c86-9b9d-6d829b7b9d94 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:34:47.816673 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e5dfe46c-0c4e-4c86-9b9d-6d829b7b9d94 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:34:47.863054 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e5dfe46c-0c4e-4c86-9b9d-6d829b7b9d94 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action" status: 200 len: 32640 microversion: 2.1 time: 0.063301 Jan 15 21:34:47.863689 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3744/7499] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:34:47 2022] POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action => generated 32640 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:34:48.875730 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8d8e206f-e2a5-446d-b410-9e26c85cde3a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:34:48.876753 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-8d8e206f-e2a5-446d-b410-9e26c85cde3a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:34:48.884081 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8d8e206f-e2a5-446d-b410-9e26c85cde3a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:34:48.884532 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8d8e206f-e2a5-446d-b410-9e26c85cde3a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:34:48.885329 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8d8e206f-e2a5-446d-b410-9e26c85cde3a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:34:48.885767 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8d8e206f-e2a5-446d-b410-9e26c85cde3a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:34:48.931138 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-8d8e206f-e2a5-446d-b410-9e26c85cde3a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action" status: 200 len: 32640 microversion: 2.1 time: 0.060156 Jan 15 21:34:48.931779 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3756/7500] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:34:48 2022] POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action => generated 32640 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:34:49.943996 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f371c705-2783-410e-9829-5f3b8189c5c3 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:34:49.945041 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f371c705-2783-410e-9829-5f3b8189c5c3 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:34:49.952700 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f371c705-2783-410e-9829-5f3b8189c5c3 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:34:49.953198 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f371c705-2783-410e-9829-5f3b8189c5c3 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:34:49.953995 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f371c705-2783-410e-9829-5f3b8189c5c3 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:34:49.954448 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f371c705-2783-410e-9829-5f3b8189c5c3 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:34:50.001308 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f371c705-2783-410e-9829-5f3b8189c5c3 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action" status: 200 len: 32640 microversion: 2.1 time: 0.061371 Jan 15 21:34:50.001977 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3745/7501] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:34:49 2022] POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action => generated 32640 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:34:51.014325 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-89c70fc3-4c3c-4589-af05-f4f419ad0d55 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:34:51.015258 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-89c70fc3-4c3c-4589-af05-f4f419ad0d55 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:34:51.022471 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-89c70fc3-4c3c-4589-af05-f4f419ad0d55 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:34:51.022917 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-89c70fc3-4c3c-4589-af05-f4f419ad0d55 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:34:51.023685 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-89c70fc3-4c3c-4589-af05-f4f419ad0d55 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:34:51.024117 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-89c70fc3-4c3c-4589-af05-f4f419ad0d55 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:34:51.067442 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-89c70fc3-4c3c-4589-af05-f4f419ad0d55 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action" status: 200 len: 32640 microversion: 2.1 time: 0.057763 Jan 15 21:34:51.068092 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3757/7502] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:34:51 2022] POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action => generated 32640 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:34:52.080181 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a5049c7a-5f48-49bb-b1fb-5aed9621adc9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:34:52.081211 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a5049c7a-5f48-49bb-b1fb-5aed9621adc9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:34:52.088729 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a5049c7a-5f48-49bb-b1fb-5aed9621adc9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:34:52.089267 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a5049c7a-5f48-49bb-b1fb-5aed9621adc9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:34:52.091228 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a5049c7a-5f48-49bb-b1fb-5aed9621adc9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:34:52.091680 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a5049c7a-5f48-49bb-b1fb-5aed9621adc9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:34:52.402762 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a5049c7a-5f48-49bb-b1fb-5aed9621adc9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action" status: 200 len: 32640 microversion: 2.1 time: 0.326124 Jan 15 21:34:52.403497 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3746/7503] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:34:52 2022] POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action => generated 32640 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:34:53.414938 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e9cb198e-dc12-4fd3-80b0-a3c87c8b05f6 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:34:53.415940 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e9cb198e-dc12-4fd3-80b0-a3c87c8b05f6 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:34:53.423411 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e9cb198e-dc12-4fd3-80b0-a3c87c8b05f6 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:34:53.423868 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e9cb198e-dc12-4fd3-80b0-a3c87c8b05f6 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:34:53.424679 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e9cb198e-dc12-4fd3-80b0-a3c87c8b05f6 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:34:53.425146 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e9cb198e-dc12-4fd3-80b0-a3c87c8b05f6 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:34:53.469950 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e9cb198e-dc12-4fd3-80b0-a3c87c8b05f6 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action" status: 200 len: 32640 microversion: 2.1 time: 0.059261 Jan 15 21:34:53.470834 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3758/7504] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:34:53 2022] POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action => generated 32640 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:34:54.483058 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-926079d2-760b-472d-b3bb-fc55906bc488 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:34:54.484095 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-926079d2-760b-472d-b3bb-fc55906bc488 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:34:54.491466 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-926079d2-760b-472d-b3bb-fc55906bc488 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:34:54.491939 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-926079d2-760b-472d-b3bb-fc55906bc488 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:34:54.492726 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-926079d2-760b-472d-b3bb-fc55906bc488 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:34:54.493206 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-926079d2-760b-472d-b3bb-fc55906bc488 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:34:54.537781 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-926079d2-760b-472d-b3bb-fc55906bc488 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action" status: 200 len: 32640 microversion: 2.1 time: 0.059254 Jan 15 21:34:54.542135 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3747/7505] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:34:54 2022] POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action => generated 32640 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:34:55.550371 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4506978d-a226-445c-aefc-e3eabd4d8d3c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:34:55.551366 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-4506978d-a226-445c-aefc-e3eabd4d8d3c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:34:55.558713 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4506978d-a226-445c-aefc-e3eabd4d8d3c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:34:55.559189 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4506978d-a226-445c-aefc-e3eabd4d8d3c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:34:55.559965 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4506978d-a226-445c-aefc-e3eabd4d8d3c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:34:55.560399 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4506978d-a226-445c-aefc-e3eabd4d8d3c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:34:55.607377 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-4506978d-a226-445c-aefc-e3eabd4d8d3c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action" status: 200 len: 32640 microversion: 2.1 time: 0.061066 Jan 15 21:34:55.608752 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3759/7506] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:34:55 2022] POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action => generated 32640 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:34:56.619726 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-569193c9-e583-49ad-9cff-baff38d0ac4d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:34:56.620741 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-569193c9-e583-49ad-9cff-baff38d0ac4d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:34:56.629144 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-569193c9-e583-49ad-9cff-baff38d0ac4d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:34:56.629562 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-569193c9-e583-49ad-9cff-baff38d0ac4d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:34:56.630360 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-569193c9-e583-49ad-9cff-baff38d0ac4d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:34:56.630813 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-569193c9-e583-49ad-9cff-baff38d0ac4d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:34:56.675917 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-569193c9-e583-49ad-9cff-baff38d0ac4d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action" status: 200 len: 32640 microversion: 2.1 time: 0.060174 Jan 15 21:34:56.676758 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3748/7507] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:34:56 2022] POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action => generated 32640 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:34:57.687959 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a2b24129-02e2-44f8-9024-4ce60c517108 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:34:57.688977 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a2b24129-02e2-44f8-9024-4ce60c517108 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:34:57.696339 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a2b24129-02e2-44f8-9024-4ce60c517108 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:34:57.696784 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a2b24129-02e2-44f8-9024-4ce60c517108 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:34:57.697593 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a2b24129-02e2-44f8-9024-4ce60c517108 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:34:57.698019 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a2b24129-02e2-44f8-9024-4ce60c517108 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:34:57.742805 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a2b24129-02e2-44f8-9024-4ce60c517108 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action" status: 200 len: 32640 microversion: 2.1 time: 0.059368 Jan 15 21:34:57.743425 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3760/7508] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:34:57 2022] POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action => generated 32640 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:34:58.754732 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-427071e2-edeb-4017-8dc8-9eca024b83a8 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:34:58.755736 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-427071e2-edeb-4017-8dc8-9eca024b83a8 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:34:58.763156 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-427071e2-edeb-4017-8dc8-9eca024b83a8 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:34:58.763620 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-427071e2-edeb-4017-8dc8-9eca024b83a8 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:34:58.764403 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-427071e2-edeb-4017-8dc8-9eca024b83a8 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:34:58.764876 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-427071e2-edeb-4017-8dc8-9eca024b83a8 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:34:58.807673 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-427071e2-edeb-4017-8dc8-9eca024b83a8 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action" status: 200 len: 32640 microversion: 2.1 time: 0.056905 Jan 15 21:34:58.808269 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3749/7509] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:34:58 2022] POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action => generated 32640 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:34:59.820446 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ad41c2e4-098e-421c-87e4-9ace0ed2c901 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:34:59.821491 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ad41c2e4-098e-421c-87e4-9ace0ed2c901 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:34:59.829948 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ad41c2e4-098e-421c-87e4-9ace0ed2c901 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:34:59.830398 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ad41c2e4-098e-421c-87e4-9ace0ed2c901 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:34:59.831174 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ad41c2e4-098e-421c-87e4-9ace0ed2c901 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:34:59.831610 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ad41c2e4-098e-421c-87e4-9ace0ed2c901 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:34:59.878602 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ad41c2e4-098e-421c-87e4-9ace0ed2c901 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action" status: 200 len: 32640 microversion: 2.1 time: 0.062088 Jan 15 21:34:59.879246 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3761/7510] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:34:59 2022] POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action => generated 32640 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:35:00.891521 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a61f1170-1487-4817-8be1-08707585b16d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:35:00.892601 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a61f1170-1487-4817-8be1-08707585b16d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:35:00.899974 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a61f1170-1487-4817-8be1-08707585b16d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:00.900445 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a61f1170-1487-4817-8be1-08707585b16d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:00.901271 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a61f1170-1487-4817-8be1-08707585b16d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:00.901733 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a61f1170-1487-4817-8be1-08707585b16d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:00.943545 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a61f1170-1487-4817-8be1-08707585b16d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action" status: 200 len: 32640 microversion: 2.1 time: 0.056652 Jan 15 21:35:00.944177 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3750/7511] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:35:00 2022] POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action => generated 32640 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:35:01.956182 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c7ab7919-8cc5-4584-a931-0609fd6a7b18 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:35:01.957221 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c7ab7919-8cc5-4584-a931-0609fd6a7b18 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:35:01.964572 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c7ab7919-8cc5-4584-a931-0609fd6a7b18 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:01.965057 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c7ab7919-8cc5-4584-a931-0609fd6a7b18 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:01.965838 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c7ab7919-8cc5-4584-a931-0609fd6a7b18 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:01.966276 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c7ab7919-8cc5-4584-a931-0609fd6a7b18 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:02.276691 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c7ab7919-8cc5-4584-a931-0609fd6a7b18 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action" status: 200 len: 40788 microversion: 2.1 time: 0.324780 Jan 15 21:35:02.277590 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3762/7512] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:35:01 2022] POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action => generated 40788 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:35:02.287986 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2b58010e-7e02-4c95-84e6-0033652c10fa tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:35:02.295454 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2b58010e-7e02-4c95-84e6-0033652c10fa tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:02.296588 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2b58010e-7e02-4c95-84e6-0033652c10fa tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:02.321765 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-2b58010e-7e02-4c95-84e6-0033652c10fa tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Going to try to stop instance {{(pid=129365) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Jan 15 21:35:02.361777 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2b58010e-7e02-4c95-84e6-0033652c10fa tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action" status: 202 len: 0 microversion: 2.1 time: 0.077987 Jan 15 21:35:02.362385 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3751/7513] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:35:02 2022] POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:35:02.370767 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-72ab0c50-7b43-4042-985a-abf70c72b628 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:35:02.371466 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-72ab0c50-7b43-4042-985a-abf70c72b628 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:35:02.380299 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-72ab0c50-7b43-4042-985a-abf70c72b628 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:02.380754 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-72ab0c50-7b43-4042-985a-abf70c72b628 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:02.381590 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-72ab0c50-7b43-4042-985a-abf70c72b628 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:02.382070 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-72ab0c50-7b43-4042-985a-abf70c72b628 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:02.520343 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-72ab0c50-7b43-4042-985a-abf70c72b628 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:35:02.527712 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-72ab0c50-7b43-4042-985a-abf70c72b628 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316" status: 200 len: 1679 microversion: 2.1 time: 0.160908 Jan 15 21:35:02.528208 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3763/7514] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:35:02 2022] GET /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316 => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:35:03.547539 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-22bc9015-cb12-4dfe-b8bf-5e24c83f728f tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:35:03.548174 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-22bc9015-cb12-4dfe-b8bf-5e24c83f728f tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:35:03.554471 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-22bc9015-cb12-4dfe-b8bf-5e24c83f728f tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:03.554926 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-22bc9015-cb12-4dfe-b8bf-5e24c83f728f tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:03.555715 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-22bc9015-cb12-4dfe-b8bf-5e24c83f728f tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:03.556162 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-22bc9015-cb12-4dfe-b8bf-5e24c83f728f tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:03.688539 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-22bc9015-cb12-4dfe-b8bf-5e24c83f728f tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:35:03.695913 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-22bc9015-cb12-4dfe-b8bf-5e24c83f728f tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316" status: 200 len: 1679 microversion: 2.1 time: 0.154009 Jan 15 21:35:03.696471 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3752/7515] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:35:03 2022] GET /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316 => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:35:04.712561 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-fee72b43-2fe6-43f8-bbd3-7dfb206cd062 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:35:04.713216 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-fee72b43-2fe6-43f8-bbd3-7dfb206cd062 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:35:04.720824 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fee72b43-2fe6-43f8-bbd3-7dfb206cd062 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:04.721312 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fee72b43-2fe6-43f8-bbd3-7dfb206cd062 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:04.722138 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fee72b43-2fe6-43f8-bbd3-7dfb206cd062 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:04.722585 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fee72b43-2fe6-43f8-bbd3-7dfb206cd062 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:04.852399 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-fee72b43-2fe6-43f8-bbd3-7dfb206cd062 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:35:04.860250 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-fee72b43-2fe6-43f8-bbd3-7dfb206cd062 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316" status: 200 len: 1679 microversion: 2.1 time: 0.151431 Jan 15 21:35:04.860814 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3764/7516] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:35:04 2022] GET /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316 => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:35:05.876814 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-6af09108-e7c0-4923-acba-aaa72113bc14 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:35:05.877477 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-6af09108-e7c0-4923-acba-aaa72113bc14 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:35:05.884228 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6af09108-e7c0-4923-acba-aaa72113bc14 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:05.884688 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6af09108-e7c0-4923-acba-aaa72113bc14 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:05.885498 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6af09108-e7c0-4923-acba-aaa72113bc14 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:05.885942 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6af09108-e7c0-4923-acba-aaa72113bc14 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:06.014917 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-6af09108-e7c0-4923-acba-aaa72113bc14 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:35:06.022291 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-6af09108-e7c0-4923-acba-aaa72113bc14 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316" status: 200 len: 1679 microversion: 2.1 time: 0.149811 Jan 15 21:35:06.022859 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3753/7517] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:35:05 2022] GET /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316 => generated 1679 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:35:07.038970 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-385ebc79-5bc3-4c02-8660-fd952cf541d3 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:35:07.039572 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-385ebc79-5bc3-4c02-8660-fd952cf541d3 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:35:07.046453 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-385ebc79-5bc3-4c02-8660-fd952cf541d3 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:07.046900 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-385ebc79-5bc3-4c02-8660-fd952cf541d3 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:07.047676 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-385ebc79-5bc3-4c02-8660-fd952cf541d3 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:07.048111 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-385ebc79-5bc3-4c02-8660-fd952cf541d3 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:07.176129 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-385ebc79-5bc3-4c02-8660-fd952cf541d3 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:35:07.183458 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-385ebc79-5bc3-4c02-8660-fd952cf541d3 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316" status: 200 len: 1679 microversion: 2.1 time: 0.148520 Jan 15 21:35:07.184012 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3765/7518] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:35:07 2022] GET /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316 => generated 1679 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:35:08.201140 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5fbf447a-f4f5-4f54-bc6d-4c122a5d6b22 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:35:08.201767 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-5fbf447a-f4f5-4f54-bc6d-4c122a5d6b22 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:35:08.208508 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5fbf447a-f4f5-4f54-bc6d-4c122a5d6b22 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:08.209024 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5fbf447a-f4f5-4f54-bc6d-4c122a5d6b22 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:08.209827 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5fbf447a-f4f5-4f54-bc6d-4c122a5d6b22 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:08.210284 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5fbf447a-f4f5-4f54-bc6d-4c122a5d6b22 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:08.343396 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-5fbf447a-f4f5-4f54-bc6d-4c122a5d6b22 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:35:08.350734 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5fbf447a-f4f5-4f54-bc6d-4c122a5d6b22 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316" status: 200 len: 1679 microversion: 2.1 time: 0.153310 Jan 15 21:35:08.351305 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3754/7519] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:35:08 2022] GET /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316 => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:35:09.367243 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1c11be36-4319-4792-8638-f825a94657d3 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:35:09.367843 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-1c11be36-4319-4792-8638-f825a94657d3 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:35:09.375856 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1c11be36-4319-4792-8638-f825a94657d3 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:09.376307 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1c11be36-4319-4792-8638-f825a94657d3 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:09.377207 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1c11be36-4319-4792-8638-f825a94657d3 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:09.377647 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1c11be36-4319-4792-8638-f825a94657d3 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:09.513992 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-1c11be36-4319-4792-8638-f825a94657d3 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:35:09.521308 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-1c11be36-4319-4792-8638-f825a94657d3 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316" status: 200 len: 1679 microversion: 2.1 time: 0.157740 Jan 15 21:35:09.521903 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3766/7520] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:35:09 2022] GET /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316 => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:35:10.538941 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-0e7f5cb3-437b-4177-818a-d5c0dc61c507 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:35:10.539548 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-0e7f5cb3-437b-4177-818a-d5c0dc61c507 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:35:10.546804 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0e7f5cb3-437b-4177-818a-d5c0dc61c507 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:10.547254 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0e7f5cb3-437b-4177-818a-d5c0dc61c507 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:10.548036 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0e7f5cb3-437b-4177-818a-d5c0dc61c507 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:10.548484 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0e7f5cb3-437b-4177-818a-d5c0dc61c507 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:10.683940 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-0e7f5cb3-437b-4177-818a-d5c0dc61c507 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:35:10.692110 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-0e7f5cb3-437b-4177-818a-d5c0dc61c507 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316" status: 200 len: 1679 microversion: 2.1 time: 0.157151 Jan 15 21:35:10.692679 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3755/7521] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:35:10 2022] GET /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316 => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:35:11.709126 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e9ce3a71-61fc-4fe0-9acb-fb280b2d8730 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:35:11.709758 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e9ce3a71-61fc-4fe0-9acb-fb280b2d8730 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:35:11.716393 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e9ce3a71-61fc-4fe0-9acb-fb280b2d8730 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:11.716853 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e9ce3a71-61fc-4fe0-9acb-fb280b2d8730 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:11.717681 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e9ce3a71-61fc-4fe0-9acb-fb280b2d8730 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:11.718111 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e9ce3a71-61fc-4fe0-9acb-fb280b2d8730 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:11.908221 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-e9ce3a71-61fc-4fe0-9acb-fb280b2d8730 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:35:11.915833 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e9ce3a71-61fc-4fe0-9acb-fb280b2d8730 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316" status: 200 len: 1679 microversion: 2.1 time: 0.210407 Jan 15 21:35:11.916418 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3767/7522] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:35:11 2022] GET /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316 => generated 1679 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:35:12.932991 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-626f23c2-35b8-4aad-957a-9d4b280f17f0 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:35:12.933616 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-626f23c2-35b8-4aad-957a-9d4b280f17f0 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:35:12.941342 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-626f23c2-35b8-4aad-957a-9d4b280f17f0 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:12.941811 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-626f23c2-35b8-4aad-957a-9d4b280f17f0 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:12.942609 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-626f23c2-35b8-4aad-957a-9d4b280f17f0 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:12.943062 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-626f23c2-35b8-4aad-957a-9d4b280f17f0 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:13.071385 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-626f23c2-35b8-4aad-957a-9d4b280f17f0 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:35:13.079571 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-626f23c2-35b8-4aad-957a-9d4b280f17f0 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316" status: 200 len: 1656 microversion: 2.1 time: 0.150351 Jan 15 21:35:13.080137 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3756/7523] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:35:12 2022] GET /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316 => generated 1656 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:35:13.096137 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-36cde142-272e-47a7-9fcb-e1824d8790b7 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:35:13.097107 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-36cde142-272e-47a7-9fcb-e1824d8790b7 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:35:13.103812 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-36cde142-272e-47a7-9fcb-e1824d8790b7 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:13.104256 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-36cde142-272e-47a7-9fcb-e1824d8790b7 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:13.105053 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-36cde142-272e-47a7-9fcb-e1824d8790b7 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:13.105481 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-36cde142-272e-47a7-9fcb-e1824d8790b7 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:13.132545 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-36cde142-272e-47a7-9fcb-e1824d8790b7 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:35:13.138192 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-36cde142-272e-47a7-9fcb-e1824d8790b7 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Old instance type m1.heat2, new instance type m1.heat {{(pid=129366) resize /opt/stack/nova/nova/compute/api.py:4097}} Jan 15 21:35:13.144833 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-36cde142-272e-47a7-9fcb-e1824d8790b7 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Flavor limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 21:35:13.145273 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-36cde142-272e-47a7-9fcb-e1824d8790b7 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Image limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 21:35:13.145746 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-36cde142-272e-47a7-9fcb-e1824d8790b7 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Flavor pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 21:35:13.146145 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-36cde142-272e-47a7-9fcb-e1824d8790b7 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Image pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 21:35:13.146545 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-36cde142-272e-47a7-9fcb-e1824d8790b7 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 21:35:13.208067 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-36cde142-272e-47a7-9fcb-e1824d8790b7 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action" status: 202 len: 0 microversion: 2.1 time: 0.116026 Jan 15 21:35:13.208582 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3768/7524] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:35:13 2022] POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:35:13.216634 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f7405965-4de7-4074-ba64-b2db4f126d28 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:35:13.217330 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f7405965-4de7-4074-ba64-b2db4f126d28 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:35:13.223166 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f7405965-4de7-4074-ba64-b2db4f126d28 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:13.223633 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f7405965-4de7-4074-ba64-b2db4f126d28 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:13.224423 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f7405965-4de7-4074-ba64-b2db4f126d28 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:13.224911 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f7405965-4de7-4074-ba64-b2db4f126d28 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:13.394422 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-f7405965-4de7-4074-ba64-b2db4f126d28 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:35:13.404226 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f7405965-4de7-4074-ba64-b2db4f126d28 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316" status: 200 len: 1679 microversion: 2.1 time: 0.190737 Jan 15 21:35:13.414674 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3757/7525] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:35:13 2022] GET /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316 => generated 1679 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:35:14.422859 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-fc455bca-3c3e-49c7-bbbf-073611abad77 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:35:14.423468 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-fc455bca-3c3e-49c7-bbbf-073611abad77 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:35:14.429499 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fc455bca-3c3e-49c7-bbbf-073611abad77 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:14.429957 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fc455bca-3c3e-49c7-bbbf-073611abad77 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:14.430767 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fc455bca-3c3e-49c7-bbbf-073611abad77 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:14.431205 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fc455bca-3c3e-49c7-bbbf-073611abad77 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:14.565242 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-fc455bca-3c3e-49c7-bbbf-073611abad77 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:35:14.572676 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-fc455bca-3c3e-49c7-bbbf-073611abad77 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316" status: 200 len: 1679 microversion: 2.1 time: 0.154430 Jan 15 21:35:14.573271 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3769/7526] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:35:14 2022] GET /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:35:15.589854 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-103bee88-aeeb-42f4-8f95-53c8bb7911cf tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:35:15.590465 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-103bee88-aeeb-42f4-8f95-53c8bb7911cf tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:35:15.597209 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-103bee88-aeeb-42f4-8f95-53c8bb7911cf tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:15.597669 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-103bee88-aeeb-42f4-8f95-53c8bb7911cf tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:15.598448 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-103bee88-aeeb-42f4-8f95-53c8bb7911cf tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:15.598889 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-103bee88-aeeb-42f4-8f95-53c8bb7911cf tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:15.787264 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-103bee88-aeeb-42f4-8f95-53c8bb7911cf tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:35:15.794908 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-103bee88-aeeb-42f4-8f95-53c8bb7911cf tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316" status: 200 len: 1679 microversion: 2.1 time: 0.208799 Jan 15 21:35:15.795470 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3758/7527] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:35:15 2022] GET /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316 => generated 1679 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:35:16.810945 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-579a64a8-8d83-4c14-a21d-9600555be2e5 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:35:16.812594 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-579a64a8-8d83-4c14-a21d-9600555be2e5 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:35:16.819056 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-579a64a8-8d83-4c14-a21d-9600555be2e5 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:16.819504 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-579a64a8-8d83-4c14-a21d-9600555be2e5 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:16.820271 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-579a64a8-8d83-4c14-a21d-9600555be2e5 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:16.820703 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-579a64a8-8d83-4c14-a21d-9600555be2e5 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:16.950893 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-579a64a8-8d83-4c14-a21d-9600555be2e5 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:35:16.958526 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-579a64a8-8d83-4c14-a21d-9600555be2e5 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316" status: 200 len: 1679 microversion: 2.1 time: 0.151339 Jan 15 21:35:16.959094 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3770/7528] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:35:16 2022] GET /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316 => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:35:17.975773 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-1dadfac0-f4bb-44c5-9622-7cacd665245e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:35:17.976391 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-1dadfac0-f4bb-44c5-9622-7cacd665245e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:35:17.984562 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1dadfac0-f4bb-44c5-9622-7cacd665245e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:17.985056 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1dadfac0-f4bb-44c5-9622-7cacd665245e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:17.985868 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1dadfac0-f4bb-44c5-9622-7cacd665245e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:17.986316 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1dadfac0-f4bb-44c5-9622-7cacd665245e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:18.129382 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-1dadfac0-f4bb-44c5-9622-7cacd665245e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:35:18.137061 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-1dadfac0-f4bb-44c5-9622-7cacd665245e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316" status: 200 len: 1679 microversion: 2.1 time: 0.164943 Jan 15 21:35:18.138010 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3759/7529] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:35:17 2022] GET /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316 => generated 1679 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:35:19.155303 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-2ee0d445-b1d8-4a30-aee9-15f2a70805d7 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:35:19.156079 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-2ee0d445-b1d8-4a30-aee9-15f2a70805d7 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:35:19.163066 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2ee0d445-b1d8-4a30-aee9-15f2a70805d7 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:19.163606 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2ee0d445-b1d8-4a30-aee9-15f2a70805d7 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:19.164420 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2ee0d445-b1d8-4a30-aee9-15f2a70805d7 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:19.165436 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2ee0d445-b1d8-4a30-aee9-15f2a70805d7 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:19.295697 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-2ee0d445-b1d8-4a30-aee9-15f2a70805d7 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:35:19.303161 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-2ee0d445-b1d8-4a30-aee9-15f2a70805d7 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316" status: 200 len: 1684 microversion: 2.1 time: 0.151683 Jan 15 21:35:19.303721 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3771/7530] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:35:19 2022] GET /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316 => generated 1684 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:35:20.321053 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a22d2246-fd3c-4b90-8095-01f95fa8ba86 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:35:20.321663 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a22d2246-fd3c-4b90-8095-01f95fa8ba86 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:35:20.329617 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a22d2246-fd3c-4b90-8095-01f95fa8ba86 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:20.330076 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a22d2246-fd3c-4b90-8095-01f95fa8ba86 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:20.330863 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a22d2246-fd3c-4b90-8095-01f95fa8ba86 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:20.331309 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a22d2246-fd3c-4b90-8095-01f95fa8ba86 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:20.465842 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-a22d2246-fd3c-4b90-8095-01f95fa8ba86 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:35:20.473890 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a22d2246-fd3c-4b90-8095-01f95fa8ba86 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316" status: 200 len: 1684 microversion: 2.1 time: 0.156620 Jan 15 21:35:20.474457 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3760/7531] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:35:20 2022] GET /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316 => generated 1684 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:35:21.491932 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-75215e25-ec90-42dd-90a6-91238f19d99e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:35:21.492513 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-75215e25-ec90-42dd-90a6-91238f19d99e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:35:21.499881 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-75215e25-ec90-42dd-90a6-91238f19d99e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:21.500408 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-75215e25-ec90-42dd-90a6-91238f19d99e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:21.501334 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-75215e25-ec90-42dd-90a6-91238f19d99e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:21.501777 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-75215e25-ec90-42dd-90a6-91238f19d99e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:21.637421 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-75215e25-ec90-42dd-90a6-91238f19d99e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:35:21.645837 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-75215e25-ec90-42dd-90a6-91238f19d99e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316" status: 200 len: 1684 microversion: 2.1 time: 0.159013 Jan 15 21:35:21.646413 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3772/7532] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:35:21 2022] GET /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316 => generated 1684 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:35:22.146424 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-9909fba2-4570-4293-83c6-36fc1dec168e req-d0837b10-ecc7-4084-862d-d6963984cbc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c3971ed-826f-4ae9-812c-e1be325fa316", "name": "network-vif-unplugged", "status": "completed", "tag": "1b7605bd-3638-4843-a16b-644d5f3ec0fd"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:35:22.148091 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:35:22.148091 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:35:22.157263 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-9909fba2-4570-4293-83c6-36fc1dec168e req-d0837b10-ecc7-4084-862d-d6963984cbc6 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:22.157727 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-9909fba2-4570-4293-83c6-36fc1dec168e req-d0837b10-ecc7-4084-862d-d6963984cbc6 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:22.173803 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-9909fba2-4570-4293-83c6-36fc1dec168e req-d0837b10-ecc7-4084-862d-d6963984cbc6 service nova] Creating event network-vif-unplugged:1b7605bd-3638-4843-a16b-644d5f3ec0fd for instance 1c3971ed-826f-4ae9-812c-e1be325fa316 on nch1-master-1 Jan 15 21:35:22.179535 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [req-9909fba2-4570-4293-83c6-36fc1dec168e req-d0837b10-ecc7-4084-862d-d6963984cbc6 service nova] Instance 1c3971ed-826f-4ae9-812c-e1be325fa316 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=129365) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Jan 15 21:35:22.190969 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-9909fba2-4570-4293-83c6-36fc1dec168e req-d0837b10-ecc7-4084-862d-d6963984cbc6 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048511 Jan 15 21:35:22.191781 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3761/7533] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:35:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:35:22.663495 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-2803d4bf-6cef-4193-99b5-a8d61eb8d6b9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:35:22.664127 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-2803d4bf-6cef-4193-99b5-a8d61eb8d6b9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:35:22.672422 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2803d4bf-6cef-4193-99b5-a8d61eb8d6b9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:22.672909 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2803d4bf-6cef-4193-99b5-a8d61eb8d6b9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:22.673719 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2803d4bf-6cef-4193-99b5-a8d61eb8d6b9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:22.674160 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2803d4bf-6cef-4193-99b5-a8d61eb8d6b9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:22.811964 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-2803d4bf-6cef-4193-99b5-a8d61eb8d6b9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:35:22.819448 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-2803d4bf-6cef-4193-99b5-a8d61eb8d6b9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316" status: 200 len: 1683 microversion: 2.1 time: 0.160181 Jan 15 21:35:22.820039 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3773/7534] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:35:22 2022] GET /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316 => generated 1683 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:35:23.838508 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-febf0bca-8f78-4aac-b8a8-137738842df9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:35:23.839124 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-febf0bca-8f78-4aac-b8a8-137738842df9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:35:23.846171 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-febf0bca-8f78-4aac-b8a8-137738842df9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:23.846632 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-febf0bca-8f78-4aac-b8a8-137738842df9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:23.847418 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-febf0bca-8f78-4aac-b8a8-137738842df9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:23.847861 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-febf0bca-8f78-4aac-b8a8-137738842df9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:23.981927 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-febf0bca-8f78-4aac-b8a8-137738842df9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:35:23.990159 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-febf0bca-8f78-4aac-b8a8-137738842df9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316" status: 200 len: 1681 microversion: 2.1 time: 0.156645 Jan 15 21:35:23.990740 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3762/7535] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:35:23 2022] GET /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:35:24.208865 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-b99f66dd-e1f1-4aa9-8af6-c91ee170974b req-3781b342-f5b4-43d7-9522-1739eb854821 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c3971ed-826f-4ae9-812c-e1be325fa316", "tag": "1b7605bd-3638-4843-a16b-644d5f3ec0fd"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:35:24.210390 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:35:24.210390 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:35:24.219236 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-b99f66dd-e1f1-4aa9-8af6-c91ee170974b req-3781b342-f5b4-43d7-9522-1739eb854821 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:24.219681 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-b99f66dd-e1f1-4aa9-8af6-c91ee170974b req-3781b342-f5b4-43d7-9522-1739eb854821 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:24.230816 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-b99f66dd-e1f1-4aa9-8af6-c91ee170974b req-3781b342-f5b4-43d7-9522-1739eb854821 service nova] Creating event network-changed:1b7605bd-3638-4843-a16b-644d5f3ec0fd for instance 1c3971ed-826f-4ae9-812c-e1be325fa316 on nch1-master-1 Jan 15 21:35:24.235986 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [req-b99f66dd-e1f1-4aa9-8af6-c91ee170974b req-3781b342-f5b4-43d7-9522-1739eb854821 service nova] Instance 1c3971ed-826f-4ae9-812c-e1be325fa316 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=129366) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Jan 15 21:35:24.246922 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-b99f66dd-e1f1-4aa9-8af6-c91ee170974b req-3781b342-f5b4-43d7-9522-1739eb854821 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042064 Jan 15 21:35:24.247507 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3774/7536] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:35:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:35:25.007417 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3bea50e2-3b6f-4b00-bf29-8e3417f50188 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:35:25.008036 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-3bea50e2-3b6f-4b00-bf29-8e3417f50188 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:35:25.015059 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3bea50e2-3b6f-4b00-bf29-8e3417f50188 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:25.015525 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3bea50e2-3b6f-4b00-bf29-8e3417f50188 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:25.016321 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3bea50e2-3b6f-4b00-bf29-8e3417f50188 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:25.016764 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3bea50e2-3b6f-4b00-bf29-8e3417f50188 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:25.153024 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-3bea50e2-3b6f-4b00-bf29-8e3417f50188 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:35:25.161544 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3bea50e2-3b6f-4b00-bf29-8e3417f50188 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316" status: 200 len: 1677 microversion: 2.1 time: 0.157815 Jan 15 21:35:25.162155 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3763/7537] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:35:25 2022] GET /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316 => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:35:25.178982 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f375fa72-029e-410d-b544-fc005adcce0c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:35:25.179668 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f375fa72-029e-410d-b544-fc005adcce0c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:35:25.185946 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f375fa72-029e-410d-b544-fc005adcce0c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:25.186567 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f375fa72-029e-410d-b544-fc005adcce0c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:25.187342 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f375fa72-029e-410d-b544-fc005adcce0c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:25.187775 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f375fa72-029e-410d-b544-fc005adcce0c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:25.244541 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f375fa72-029e-410d-b544-fc005adcce0c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action" status: 204 len: 0 microversion: 2.1 time: 0.069465 Jan 15 21:35:25.245242 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3775/7538] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:35:25 2022] POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action => generated 0 bytes in 71 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 21:35:25.254533 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-1347d988-192b-4201-8b75-f457c3953bb8 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:35:25.255168 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-1347d988-192b-4201-8b75-f457c3953bb8 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:35:25.261419 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1347d988-192b-4201-8b75-f457c3953bb8 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:25.261883 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1347d988-192b-4201-8b75-f457c3953bb8 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:25.262684 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1347d988-192b-4201-8b75-f457c3953bb8 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:25.263124 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1347d988-192b-4201-8b75-f457c3953bb8 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:25.405797 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-1347d988-192b-4201-8b75-f457c3953bb8 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:35:25.414149 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-1347d988-192b-4201-8b75-f457c3953bb8 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316" status: 200 len: 1677 microversion: 2.1 time: 0.164571 Jan 15 21:35:25.414738 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3764/7539] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:35:25 2022] GET /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316 => generated 1677 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:35:26.434095 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0269b54c-df3b-4b22-a1c0-b9dc2eeda4b1 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:35:26.434795 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-0269b54c-df3b-4b22-a1c0-b9dc2eeda4b1 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:35:26.444928 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0269b54c-df3b-4b22-a1c0-b9dc2eeda4b1 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:26.445421 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0269b54c-df3b-4b22-a1c0-b9dc2eeda4b1 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:26.446247 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0269b54c-df3b-4b22-a1c0-b9dc2eeda4b1 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:26.446711 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0269b54c-df3b-4b22-a1c0-b9dc2eeda4b1 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:26.598002 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-0269b54c-df3b-4b22-a1c0-b9dc2eeda4b1 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:35:26.606928 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0269b54c-df3b-4b22-a1c0-b9dc2eeda4b1 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316" status: 200 len: 1656 microversion: 2.1 time: 0.178416 Jan 15 21:35:26.607543 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3776/7540] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:35:26 2022] GET /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316 => generated 1656 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:35:26.627463 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-54a9b9e1-cf28-418e-a0b3-2ee3869c5067 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:35:26.628254 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-54a9b9e1-cf28-418e-a0b3-2ee3869c5067 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:35:26.635283 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-54a9b9e1-cf28-418e-a0b3-2ee3869c5067 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:26.635753 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-54a9b9e1-cf28-418e-a0b3-2ee3869c5067 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:26.636714 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-54a9b9e1-cf28-418e-a0b3-2ee3869c5067 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:26.637202 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-54a9b9e1-cf28-418e-a0b3-2ee3869c5067 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:26.780977 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-54a9b9e1-cf28-418e-a0b3-2ee3869c5067 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:35:26.788794 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-54a9b9e1-cf28-418e-a0b3-2ee3869c5067 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316" status: 200 len: 1656 microversion: 2.1 time: 0.166219 Jan 15 21:35:26.789492 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3765/7541] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:35:26 2022] GET /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316 => generated 1656 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:35:26.805725 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a84c58d7-738b-4dd9-b022-6993f4be9bfb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:35:26.812231 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a84c58d7-738b-4dd9-b022-6993f4be9bfb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:26.812674 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a84c58d7-738b-4dd9-b022-6993f4be9bfb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:26.834643 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a84c58d7-738b-4dd9-b022-6993f4be9bfb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Going to try to start instance {{(pid=129366) start /opt/stack/nova/nova/compute/api.py:2677}} Jan 15 21:35:26.874427 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a84c58d7-738b-4dd9-b022-6993f4be9bfb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action" status: 202 len: 0 microversion: 2.1 time: 0.071753 Jan 15 21:35:26.875025 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3777/7542] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:35:26 2022] POST /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316/action => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:35:26.883158 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-6b2f5ec5-4852-4108-96a3-8f069c27e657 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:35:26.883790 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-6b2f5ec5-4852-4108-96a3-8f069c27e657 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:35:26.890688 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6b2f5ec5-4852-4108-96a3-8f069c27e657 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:26.891424 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6b2f5ec5-4852-4108-96a3-8f069c27e657 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:26.892236 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6b2f5ec5-4852-4108-96a3-8f069c27e657 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:26.892732 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6b2f5ec5-4852-4108-96a3-8f069c27e657 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:27.023583 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-6b2f5ec5-4852-4108-96a3-8f069c27e657 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:35:27.031320 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-6b2f5ec5-4852-4108-96a3-8f069c27e657 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316" status: 200 len: 1665 microversion: 2.1 time: 0.151876 Jan 15 21:35:27.031923 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3766/7543] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:35:26 2022] GET /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316 => generated 1665 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:35:28.050239 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-20334280-b4b8-4c4d-89a5-b685488d08d3 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:35:28.050935 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-20334280-b4b8-4c4d-89a5-b685488d08d3 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:35:28.057087 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-20334280-b4b8-4c4d-89a5-b685488d08d3 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:28.057534 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-20334280-b4b8-4c4d-89a5-b685488d08d3 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:28.058294 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-20334280-b4b8-4c4d-89a5-b685488d08d3 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:28.058726 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-20334280-b4b8-4c4d-89a5-b685488d08d3 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:28.195899 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-20334280-b4b8-4c4d-89a5-b685488d08d3 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:35:28.204408 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-20334280-b4b8-4c4d-89a5-b685488d08d3 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316" status: 200 len: 1669 microversion: 2.1 time: 0.159197 Jan 15 21:35:28.205164 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3778/7544] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:35:28 2022] GET /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316 => generated 1669 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:35:28.221009 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-77ae9765-19b1-4750-976d-2d2fd173c421 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:35:28.221576 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-77ae9765-19b1-4750-976d-2d2fd173c421 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:35:28.228513 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-77ae9765-19b1-4750-976d-2d2fd173c421 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:28.229009 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-77ae9765-19b1-4750-976d-2d2fd173c421 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:28.229822 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-77ae9765-19b1-4750-976d-2d2fd173c421 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:28.230273 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-77ae9765-19b1-4750-976d-2d2fd173c421 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:28.257492 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-77ae9765-19b1-4750-976d-2d2fd173c421 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Going to try to terminate instance {{(pid=129365) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 21:35:28.339723 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-77ae9765-19b1-4750-976d-2d2fd173c421 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "DELETE /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316" status: 204 len: 0 microversion: 2.1 time: 0.121942 Jan 15 21:35:28.340244 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3767/7545] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 21:35:28 2022] DELETE /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 21:35:28.349244 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4c56a760-5428-47cd-bce1-c97abb1ab4ce tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:35:28.350208 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-4c56a760-5428-47cd-bce1-c97abb1ab4ce tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:35:28.357580 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4c56a760-5428-47cd-bce1-c97abb1ab4ce tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:28.358758 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4c56a760-5428-47cd-bce1-c97abb1ab4ce tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:28.359917 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4c56a760-5428-47cd-bce1-c97abb1ab4ce tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:28.360533 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4c56a760-5428-47cd-bce1-c97abb1ab4ce tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:28.464595 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-807a4998-5343-470a-a35b-335274dc7144 req-30a583c8-da3c-46bc-9348-2a2184a80559 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c3971ed-826f-4ae9-812c-e1be325fa316", "name": "network-vif-plugged", "status": "completed", "tag": "1b7605bd-3638-4843-a16b-644d5f3ec0fd"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:35:28.467574 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:35:28.467574 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:35:28.476361 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-807a4998-5343-470a-a35b-335274dc7144 req-30a583c8-da3c-46bc-9348-2a2184a80559 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:28.477158 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-807a4998-5343-470a-a35b-335274dc7144 req-30a583c8-da3c-46bc-9348-2a2184a80559 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:28.491185 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-807a4998-5343-470a-a35b-335274dc7144 req-30a583c8-da3c-46bc-9348-2a2184a80559 service nova] Creating event network-vif-plugged:1b7605bd-3638-4843-a16b-644d5f3ec0fd for instance 1c3971ed-826f-4ae9-812c-e1be325fa316 on nch1-master-1 Jan 15 21:35:28.496671 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-807a4998-5343-470a-a35b-335274dc7144 req-30a583c8-da3c-46bc-9348-2a2184a80559 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036337 Jan 15 21:35:28.497438 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3768/7546] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:35:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:35:28.509650 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-4c56a760-5428-47cd-bce1-c97abb1ab4ce tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:35:28.517883 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-4c56a760-5428-47cd-bce1-c97abb1ab4ce tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316" status: 200 len: 1675 microversion: 2.1 time: 0.172493 Jan 15 21:35:28.518452 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3779/7547] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:35:28 2022] GET /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316 => generated 1675 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:35:29.536638 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-bddf1a3f-5581-4096-b818-5f2300e6f0e9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:35:29.537285 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-bddf1a3f-5581-4096-b818-5f2300e6f0e9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:35:29.543389 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bddf1a3f-5581-4096-b818-5f2300e6f0e9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:29.543848 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bddf1a3f-5581-4096-b818-5f2300e6f0e9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:29.544624 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bddf1a3f-5581-4096-b818-5f2300e6f0e9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:29.545094 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bddf1a3f-5581-4096-b818-5f2300e6f0e9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:29.681592 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-bddf1a3f-5581-4096-b818-5f2300e6f0e9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:35:29.689338 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-bddf1a3f-5581-4096-b818-5f2300e6f0e9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316" status: 200 len: 1675 microversion: 2.1 time: 0.157832 Jan 15 21:35:29.689927 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3769/7548] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:35:29 2022] GET /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316 => generated 1675 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:35:30.468362 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-f3e797e9-89d3-42f4-9fe6-29aff6477f00 req-5bf85219-88d3-4999-8c59-3e27226a075e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c3971ed-826f-4ae9-812c-e1be325fa316", "name": "network-vif-deleted", "tag": "1b7605bd-3638-4843-a16b-644d5f3ec0fd"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:35:30.469925 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:35:30.469925 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:35:30.478094 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-f3e797e9-89d3-42f4-9fe6-29aff6477f00 req-5bf85219-88d3-4999-8c59-3e27226a075e service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:30.478543 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-f3e797e9-89d3-42f4-9fe6-29aff6477f00 req-5bf85219-88d3-4999-8c59-3e27226a075e service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:30.493826 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-f3e797e9-89d3-42f4-9fe6-29aff6477f00 req-5bf85219-88d3-4999-8c59-3e27226a075e service nova] Creating event network-vif-deleted:1b7605bd-3638-4843-a16b-644d5f3ec0fd for instance 1c3971ed-826f-4ae9-812c-e1be325fa316 on nch1-master-1 Jan 15 21:35:30.499787 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-f3e797e9-89d3-42f4-9fe6-29aff6477f00 req-5bf85219-88d3-4999-8c59-3e27226a075e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035610 Jan 15 21:35:30.500456 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3780/7549] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:35:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:35:30.706679 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-461acd9e-b9b5-469d-8b61-74b9b15b4e9d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:35:30.707513 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-461acd9e-b9b5-469d-8b61-74b9b15b4e9d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:35:30.715353 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-461acd9e-b9b5-469d-8b61-74b9b15b4e9d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:30.715821 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-461acd9e-b9b5-469d-8b61-74b9b15b4e9d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:30.716886 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-461acd9e-b9b5-469d-8b61-74b9b15b4e9d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:30.717539 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-461acd9e-b9b5-469d-8b61-74b9b15b4e9d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:30.731309 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-461acd9e-b9b5-469d-8b61-74b9b15b4e9d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] HTTP exception thrown: Instance 1c3971ed-826f-4ae9-812c-e1be325fa316 could not be found. Jan 15 21:35:30.731922 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-461acd9e-b9b5-469d-8b61-74b9b15b4e9d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Returning 404 to user: Instance 1c3971ed-826f-4ae9-812c-e1be325fa316 could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:35:30.732779 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-461acd9e-b9b5-469d-8b61-74b9b15b4e9d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316" status: 404 len: 111 microversion: 2.1 time: 0.030694 Jan 15 21:35:30.733857 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3770/7550] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:35:30 2022] GET /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 15 21:35:30.783106 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8e52e6ec-1c9f-48ab-9a30-93635cf78fe8 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:35:30.783812 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-8e52e6ec-1c9f-48ab-9a30-93635cf78fe8 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:35:30.790416 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8e52e6ec-1c9f-48ab-9a30-93635cf78fe8 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:30.790868 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8e52e6ec-1c9f-48ab-9a30-93635cf78fe8 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:30.791677 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8e52e6ec-1c9f-48ab-9a30-93635cf78fe8 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:30.792083 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8e52e6ec-1c9f-48ab-9a30-93635cf78fe8 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:30.806730 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-8e52e6ec-1c9f-48ab-9a30-93635cf78fe8 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] HTTP exception thrown: Instance 1c3971ed-826f-4ae9-812c-e1be325fa316 could not be found. Jan 15 21:35:30.807373 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8e52e6ec-1c9f-48ab-9a30-93635cf78fe8 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Returning 404 to user: Instance 1c3971ed-826f-4ae9-812c-e1be325fa316 could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:35:30.808183 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-8e52e6ec-1c9f-48ab-9a30-93635cf78fe8 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316" status: 404 len: 111 microversion: 2.1 time: 0.029329 Jan 15 21:35:30.808741 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3781/7551] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:35:30 2022] GET /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:35:30.857246 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ad7bbc78-4fee-480c-b8a3-452d577635fb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-279922892", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "networks": [{"uuid": "72520288-27af-458f-aef8-ae08e1543c11"}], "security_groups": [{"name": "tempest-securitygroup--1432803138"}], "key_name": "tempest-keypair-176324375", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:35:30.958473 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.network.neutron [None req-ad7bbc78-4fee-480c-b8a3-452d577635fb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] validate_networks() for [('72520288-27af-458f-aef8-ae08e1543c11', None, None, None, None, None)] {{(pid=129365) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 21:35:31.393313 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-ad7bbc78-4fee-480c-b8a3-452d577635fb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Flavor limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 21:35:31.393783 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-ad7bbc78-4fee-480c-b8a3-452d577635fb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Image limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 21:35:31.394266 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-ad7bbc78-4fee-480c-b8a3-452d577635fb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Flavor pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 21:35:31.394679 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-ad7bbc78-4fee-480c-b8a3-452d577635fb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Image pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 21:35:31.395121 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-ad7bbc78-4fee-480c-b8a3-452d577635fb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 21:35:31.404632 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ad7bbc78-4fee-480c-b8a3-452d577635fb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:31.405300 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ad7bbc78-4fee-480c-b8a3-452d577635fb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:31.406307 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ad7bbc78-4fee-480c-b8a3-452d577635fb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:31.406836 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ad7bbc78-4fee-480c-b8a3-452d577635fb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:31.424792 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-ad7bbc78-4fee-480c-b8a3-452d577635fb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Getting quotas for project 2d89bb23cded412ea3ca57cc844bfabf. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:35:31.431250 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-ad7bbc78-4fee-480c-b8a3-452d577635fb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Getting quotas for user b3fbd604b5a640b480e5d115e469375e and project 2d89bb23cded412ea3ca57cc844bfabf. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:35:31.444913 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ad7bbc78-4fee-480c-b8a3-452d577635fb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Going to run 1 instances... {{(pid=129365) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 21:35:31.447601 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ad7bbc78-4fee-480c-b8a3-452d577635fb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129365) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 21:35:31.499144 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ad7bbc78-4fee-480c-b8a3-452d577635fb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.645025 Jan 15 21:35:31.501244 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3771/7552] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 21:35:30 2022] POST /compute/v2.1/servers => generated 406 bytes in 648 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 21:35:31.509780 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-5a923c88-a006-4aae-8f95-f42ae78b30a1 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:35:31.510381 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-5a923c88-a006-4aae-8f95-f42ae78b30a1 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:35:31.564455 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-5a923c88-a006-4aae-8f95-f42ae78b30a1 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:35:31.571226 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-5a923c88-a006-4aae-8f95-f42ae78b30a1 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af" status: 200 len: 1237 microversion: 2.1 time: 0.065146 Jan 15 21:35:31.571796 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3782/7553] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:35:31 2022] GET /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af => generated 1237 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:35:32.588871 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-89b9c6be-2986-4407-93f2-a1e4b9195f6c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:35:32.590141 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-89b9c6be-2986-4407-93f2-a1e4b9195f6c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:35:32.598276 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-89b9c6be-2986-4407-93f2-a1e4b9195f6c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:32.598778 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-89b9c6be-2986-4407-93f2-a1e4b9195f6c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:32.599578 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-89b9c6be-2986-4407-93f2-a1e4b9195f6c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:32.600031 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-89b9c6be-2986-4407-93f2-a1e4b9195f6c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:32.665953 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-89b9c6be-2986-4407-93f2-a1e4b9195f6c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:35:32.674105 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-89b9c6be-2986-4407-93f2-a1e4b9195f6c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af" status: 200 len: 1295 microversion: 2.1 time: 0.089198 Jan 15 21:35:32.674679 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3772/7554] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:35:32 2022] GET /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af => generated 1295 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:35:33.692269 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-92987c24-c10d-4bfc-827b-23283406c0dc tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:35:33.692896 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-92987c24-c10d-4bfc-827b-23283406c0dc tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:35:33.700630 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-92987c24-c10d-4bfc-827b-23283406c0dc tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:33.701216 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-92987c24-c10d-4bfc-827b-23283406c0dc tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:33.702884 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-92987c24-c10d-4bfc-827b-23283406c0dc tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:33.703390 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-92987c24-c10d-4bfc-827b-23283406c0dc tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:33.836382 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-92987c24-c10d-4bfc-827b-23283406c0dc tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:35:33.845153 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-92987c24-c10d-4bfc-827b-23283406c0dc tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af" status: 200 len: 1363 microversion: 2.1 time: 0.156535 Jan 15 21:35:33.846273 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3783/7555] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:35:33 2022] GET /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:35:34.084653 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-22c3945d-319e-40e1-a156-209847d0d309 req-11d0987c-9c03-412b-9462-1517ed7c8b76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e727515-c789-4ce3-a870-c575fb06a6af", "tag": "3eaece6a-5dd7-4b7d-96c5-3f1558d9320c"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:35:34.087697 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:35:34.087697 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:35:34.114122 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-22c3945d-319e-40e1-a156-209847d0d309 req-11d0987c-9c03-412b-9462-1517ed7c8b76 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:34.115520 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-22c3945d-319e-40e1-a156-209847d0d309 req-11d0987c-9c03-412b-9462-1517ed7c8b76 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:34.144593 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-22c3945d-319e-40e1-a156-209847d0d309 req-11d0987c-9c03-412b-9462-1517ed7c8b76 service nova] Creating event network-changed:3eaece6a-5dd7-4b7d-96c5-3f1558d9320c for instance 8e727515-c789-4ce3-a870-c575fb06a6af on nch2-master-1 Jan 15 21:35:34.156443 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-22c3945d-319e-40e1-a156-209847d0d309 req-11d0987c-9c03-412b-9462-1517ed7c8b76 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077277 Jan 15 21:35:34.158028 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3773/7556] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:35:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 21:35:34.862239 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-cf0ca445-eccb-4d73-a6e7-5882beeaa504 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:35:34.862860 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-cf0ca445-eccb-4d73-a6e7-5882beeaa504 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:35:34.869655 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cf0ca445-eccb-4d73-a6e7-5882beeaa504 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:34.870116 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cf0ca445-eccb-4d73-a6e7-5882beeaa504 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:34.870918 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cf0ca445-eccb-4d73-a6e7-5882beeaa504 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:34.871361 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cf0ca445-eccb-4d73-a6e7-5882beeaa504 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:35.003074 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-cf0ca445-eccb-4d73-a6e7-5882beeaa504 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:35:35.010467 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-cf0ca445-eccb-4d73-a6e7-5882beeaa504 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af" status: 200 len: 1363 microversion: 2.1 time: 0.151937 Jan 15 21:35:35.011049 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3784/7557] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:35:34 2022] GET /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:35:36.029706 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-7e072fa7-aa65-410d-b3be-fcc78ecc8a61 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:35:36.031136 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-7e072fa7-aa65-410d-b3be-fcc78ecc8a61 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:35:36.037702 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7e072fa7-aa65-410d-b3be-fcc78ecc8a61 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:36.038162 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7e072fa7-aa65-410d-b3be-fcc78ecc8a61 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:36.038951 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7e072fa7-aa65-410d-b3be-fcc78ecc8a61 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:36.039397 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7e072fa7-aa65-410d-b3be-fcc78ecc8a61 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:36.170744 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-7e072fa7-aa65-410d-b3be-fcc78ecc8a61 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:35:36.178093 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-7e072fa7-aa65-410d-b3be-fcc78ecc8a61 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af" status: 200 len: 1363 microversion: 2.1 time: 0.153319 Jan 15 21:35:36.178676 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3774/7558] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:35:36 2022] GET /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:35:37.195298 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-93278fb2-207f-43ed-8d4c-18a266df13ae tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:35:37.195913 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-93278fb2-207f-43ed-8d4c-18a266df13ae tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:35:37.202816 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-93278fb2-207f-43ed-8d4c-18a266df13ae tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:37.203268 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-93278fb2-207f-43ed-8d4c-18a266df13ae tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:37.204049 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-93278fb2-207f-43ed-8d4c-18a266df13ae tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:37.204490 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-93278fb2-207f-43ed-8d4c-18a266df13ae tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:37.332909 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-93278fb2-207f-43ed-8d4c-18a266df13ae tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:35:37.340194 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-93278fb2-207f-43ed-8d4c-18a266df13ae tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af" status: 200 len: 1363 microversion: 2.1 time: 0.148622 Jan 15 21:35:37.340760 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3785/7559] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:35:37 2022] GET /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:35:38.357837 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d5508c27-fe1f-41c5-b57b-ae02419e3d76 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:35:38.358514 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d5508c27-fe1f-41c5-b57b-ae02419e3d76 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:35:38.365185 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d5508c27-fe1f-41c5-b57b-ae02419e3d76 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:38.365645 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d5508c27-fe1f-41c5-b57b-ae02419e3d76 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:38.366427 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d5508c27-fe1f-41c5-b57b-ae02419e3d76 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:38.366872 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d5508c27-fe1f-41c5-b57b-ae02419e3d76 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:38.505047 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-d5508c27-fe1f-41c5-b57b-ae02419e3d76 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:35:38.519967 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d5508c27-fe1f-41c5-b57b-ae02419e3d76 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af" status: 200 len: 1363 microversion: 2.1 time: 0.165390 Jan 15 21:35:38.521690 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3775/7560] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:35:38 2022] GET /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:35:39.539641 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-df12544d-72df-431d-947c-4aea3a400aea tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:35:39.540171 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-df12544d-72df-431d-947c-4aea3a400aea tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:35:39.547708 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-df12544d-72df-431d-947c-4aea3a400aea tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:39.548153 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-df12544d-72df-431d-947c-4aea3a400aea tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:39.548970 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-df12544d-72df-431d-947c-4aea3a400aea tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:39.549407 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-df12544d-72df-431d-947c-4aea3a400aea tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:39.680243 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-df12544d-72df-431d-947c-4aea3a400aea tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:35:39.687631 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-df12544d-72df-431d-947c-4aea3a400aea tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af" status: 200 len: 1363 microversion: 2.1 time: 0.151984 Jan 15 21:35:39.688227 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3786/7561] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:35:39 2022] GET /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:35:40.214628 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-804af5fc-a0cb-4986-bbb9-41d08f1bb952 req-74665909-adc1-4519-91cc-ebf95b106608 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e727515-c789-4ce3-a870-c575fb06a6af", "name": "network-vif-plugged", "status": "completed", "tag": "3eaece6a-5dd7-4b7d-96c5-3f1558d9320c"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:35:40.216171 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:35:40.216171 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:35:40.224210 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-804af5fc-a0cb-4986-bbb9-41d08f1bb952 req-74665909-adc1-4519-91cc-ebf95b106608 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:40.224638 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-804af5fc-a0cb-4986-bbb9-41d08f1bb952 req-74665909-adc1-4519-91cc-ebf95b106608 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:40.236610 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-804af5fc-a0cb-4986-bbb9-41d08f1bb952 req-74665909-adc1-4519-91cc-ebf95b106608 service nova] Creating event network-vif-plugged:3eaece6a-5dd7-4b7d-96c5-3f1558d9320c for instance 8e727515-c789-4ce3-a870-c575fb06a6af on nch2-master-1 Jan 15 21:35:40.242058 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-804af5fc-a0cb-4986-bbb9-41d08f1bb952 req-74665909-adc1-4519-91cc-ebf95b106608 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031225 Jan 15 21:35:40.242690 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3776/7562] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:35:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 21:35:40.704769 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f3b62a83-598d-424e-8f17-200b9959c7d3 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:35:40.705408 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f3b62a83-598d-424e-8f17-200b9959c7d3 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:35:40.712139 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f3b62a83-598d-424e-8f17-200b9959c7d3 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:40.712587 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f3b62a83-598d-424e-8f17-200b9959c7d3 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:40.713419 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f3b62a83-598d-424e-8f17-200b9959c7d3 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:40.713853 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f3b62a83-598d-424e-8f17-200b9959c7d3 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:40.849272 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-f3b62a83-598d-424e-8f17-200b9959c7d3 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:35:40.856564 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f3b62a83-598d-424e-8f17-200b9959c7d3 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af" status: 200 len: 1363 microversion: 2.1 time: 0.155684 Jan 15 21:35:40.857185 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3787/7563] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:35:40 2022] GET /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:35:41.876737 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-41a1a0ce-8bd3-458c-bb2f-59fc3776abbb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:35:41.877472 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-41a1a0ce-8bd3-458c-bb2f-59fc3776abbb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:35:41.883829 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-41a1a0ce-8bd3-458c-bb2f-59fc3776abbb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:41.884296 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-41a1a0ce-8bd3-458c-bb2f-59fc3776abbb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:41.885120 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-41a1a0ce-8bd3-458c-bb2f-59fc3776abbb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:41.885580 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-41a1a0ce-8bd3-458c-bb2f-59fc3776abbb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:42.017234 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-41a1a0ce-8bd3-458c-bb2f-59fc3776abbb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:35:42.024604 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-41a1a0ce-8bd3-458c-bb2f-59fc3776abbb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af" status: 200 len: 1549 microversion: 2.1 time: 0.153845 Jan 15 21:35:42.025208 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3777/7564] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:35:41 2022] GET /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af => generated 1549 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:35:42.041882 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-30b1e1df-8c90-4eb4-893d-954f2b5d82b7 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:35:42.042388 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-30b1e1df-8c90-4eb4-893d-954f2b5d82b7 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:35:42.050231 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-30b1e1df-8c90-4eb4-893d-954f2b5d82b7 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:42.050730 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-30b1e1df-8c90-4eb4-893d-954f2b5d82b7 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:42.051528 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-30b1e1df-8c90-4eb4-893d-954f2b5d82b7 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:42.051969 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-30b1e1df-8c90-4eb4-893d-954f2b5d82b7 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:42.133654 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-30b1e1df-8c90-4eb4-893d-954f2b5d82b7 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095464 Jan 15 21:35:42.134270 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3788/7565] 10.222.0.46 () {58 vars in 1274 bytes} [Sat Jan 15 21:35:42 2022] GET /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:35:43.311427 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-344010f3-7e9f-4ac6-a383-d6c94e3068a8 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:35:43.317438 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-344010f3-7e9f-4ac6-a383-d6c94e3068a8 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:35:43.321134 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-0c579de2-b2a4-43a5-ba6a-9c434087d445 req-0afdc3b9-dc62-44cd-876a-905f3ad07db8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e727515-c789-4ce3-a870-c575fb06a6af", "tag": "3eaece6a-5dd7-4b7d-96c5-3f1558d9320c"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:35:43.322773 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:35:43.322773 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:35:43.324991 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-344010f3-7e9f-4ac6-a383-d6c94e3068a8 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:43.325496 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-344010f3-7e9f-4ac6-a383-d6c94e3068a8 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:43.326669 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-344010f3-7e9f-4ac6-a383-d6c94e3068a8 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:43.326816 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-344010f3-7e9f-4ac6-a383-d6c94e3068a8 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:43.330841 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-0c579de2-b2a4-43a5-ba6a-9c434087d445 req-0afdc3b9-dc62-44cd-876a-905f3ad07db8 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:43.331541 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-0c579de2-b2a4-43a5-ba6a-9c434087d445 req-0afdc3b9-dc62-44cd-876a-905f3ad07db8 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:43.345304 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-0c579de2-b2a4-43a5-ba6a-9c434087d445 req-0afdc3b9-dc62-44cd-876a-905f3ad07db8 service nova] Creating event network-changed:3eaece6a-5dd7-4b7d-96c5-3f1558d9320c for instance 8e727515-c789-4ce3-a870-c575fb06a6af on nch2-master-1 Jan 15 21:35:43.351093 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-0c579de2-b2a4-43a5-ba6a-9c434087d445 req-0afdc3b9-dc62-44cd-876a-905f3ad07db8 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040952 Jan 15 21:35:43.352625 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3789/7566] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:35:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:35:43.375875 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-344010f3-7e9f-4ac6-a383-d6c94e3068a8 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action" status: 200 len: 14 microversion: 2.1 time: 0.069017 Jan 15 21:35:43.379476 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3778/7567] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:35:43 2022] POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action => generated 14 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 21:35:44.388657 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-5b9ab6cf-69a3-4b0e-aeb8-7de8ebbdacb1 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:35:44.390864 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-5b9ab6cf-69a3-4b0e-aeb8-7de8ebbdacb1 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:35:44.397145 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5b9ab6cf-69a3-4b0e-aeb8-7de8ebbdacb1 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:44.397597 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5b9ab6cf-69a3-4b0e-aeb8-7de8ebbdacb1 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:44.398412 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5b9ab6cf-69a3-4b0e-aeb8-7de8ebbdacb1 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:44.398852 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5b9ab6cf-69a3-4b0e-aeb8-7de8ebbdacb1 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:44.436973 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-5b9ab6cf-69a3-4b0e-aeb8-7de8ebbdacb1 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action" status: 200 len: 14 microversion: 2.1 time: 0.053160 Jan 15 21:35:44.440076 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3790/7568] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:35:44 2022] POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action => generated 14 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 21:35:45.448593 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-31b6dda2-ba2d-428d-bf07-da3e4c6154d6 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:35:45.449566 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-31b6dda2-ba2d-428d-bf07-da3e4c6154d6 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:35:45.457610 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-31b6dda2-ba2d-428d-bf07-da3e4c6154d6 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:45.458079 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-31b6dda2-ba2d-428d-bf07-da3e4c6154d6 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:45.458876 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-31b6dda2-ba2d-428d-bf07-da3e4c6154d6 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:45.459335 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-31b6dda2-ba2d-428d-bf07-da3e4c6154d6 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:45.498016 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-31b6dda2-ba2d-428d-bf07-da3e4c6154d6 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action" status: 200 len: 14 microversion: 2.1 time: 0.053702 Jan 15 21:35:45.499156 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3779/7569] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:35:45 2022] POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action => generated 14 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 21:35:46.509962 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-19a62cc0-f371-4dc0-a710-0ff06b74b98b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:35:46.510989 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-19a62cc0-f371-4dc0-a710-0ff06b74b98b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:35:46.518801 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-19a62cc0-f371-4dc0-a710-0ff06b74b98b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:46.519250 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-19a62cc0-f371-4dc0-a710-0ff06b74b98b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:46.520019 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-19a62cc0-f371-4dc0-a710-0ff06b74b98b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:46.520453 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-19a62cc0-f371-4dc0-a710-0ff06b74b98b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:46.557547 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-19a62cc0-f371-4dc0-a710-0ff06b74b98b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action" status: 200 len: 14 microversion: 2.1 time: 0.051502 Jan 15 21:35:46.558190 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3791/7570] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:35:46 2022] POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action => generated 14 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 15 21:35:47.568309 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-70ad4ef6-f051-499d-8400-9c981f7d0ade tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:35:47.569272 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-70ad4ef6-f051-499d-8400-9c981f7d0ade tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:35:47.577399 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-70ad4ef6-f051-499d-8400-9c981f7d0ade tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:47.577607 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-70ad4ef6-f051-499d-8400-9c981f7d0ade tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:47.578400 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-70ad4ef6-f051-499d-8400-9c981f7d0ade tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:47.578853 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-70ad4ef6-f051-499d-8400-9c981f7d0ade tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:47.615815 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-70ad4ef6-f051-499d-8400-9c981f7d0ade tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action" status: 200 len: 14 microversion: 2.1 time: 0.051605 Jan 15 21:35:47.616423 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3780/7571] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:35:47 2022] POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action => generated 14 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 21:35:48.627193 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c5230cca-1577-4a7b-a12d-e0d7b90d318a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:35:48.628246 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c5230cca-1577-4a7b-a12d-e0d7b90d318a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:35:48.636144 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c5230cca-1577-4a7b-a12d-e0d7b90d318a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:48.636600 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c5230cca-1577-4a7b-a12d-e0d7b90d318a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:48.637427 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c5230cca-1577-4a7b-a12d-e0d7b90d318a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:48.637872 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c5230cca-1577-4a7b-a12d-e0d7b90d318a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:48.676138 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c5230cca-1577-4a7b-a12d-e0d7b90d318a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action" status: 200 len: 14 microversion: 2.1 time: 0.052961 Jan 15 21:35:48.676760 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3792/7572] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:35:48 2022] POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action => generated 14 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 21:35:49.688230 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-275714b9-84dd-4680-925d-37f9137be84b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:35:49.689281 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-275714b9-84dd-4680-925d-37f9137be84b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:35:49.696663 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-275714b9-84dd-4680-925d-37f9137be84b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:49.697165 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-275714b9-84dd-4680-925d-37f9137be84b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:49.697958 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-275714b9-84dd-4680-925d-37f9137be84b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:49.698404 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-275714b9-84dd-4680-925d-37f9137be84b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:49.734738 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-275714b9-84dd-4680-925d-37f9137be84b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action" status: 200 len: 14 microversion: 2.1 time: 0.051049 Jan 15 21:35:49.735336 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3781/7573] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:35:49 2022] POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action => generated 14 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 21:35:50.746984 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-de5bdb9b-1d5f-4612-852e-678edf7a0567 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:35:50.747980 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-de5bdb9b-1d5f-4612-852e-678edf7a0567 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:35:50.755626 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-de5bdb9b-1d5f-4612-852e-678edf7a0567 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:50.756054 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-de5bdb9b-1d5f-4612-852e-678edf7a0567 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:50.756825 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-de5bdb9b-1d5f-4612-852e-678edf7a0567 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:50.757282 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-de5bdb9b-1d5f-4612-852e-678edf7a0567 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:50.794509 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-de5bdb9b-1d5f-4612-852e-678edf7a0567 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action" status: 200 len: 14 microversion: 2.1 time: 0.051538 Jan 15 21:35:50.795819 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3793/7574] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:35:50 2022] POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action => generated 14 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 21:35:51.807329 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3e5512d7-6abe-438f-ac02-b076a052d6e9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:35:51.808339 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-3e5512d7-6abe-438f-ac02-b076a052d6e9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:35:51.817123 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3e5512d7-6abe-438f-ac02-b076a052d6e9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:51.817591 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3e5512d7-6abe-438f-ac02-b076a052d6e9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:51.818394 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3e5512d7-6abe-438f-ac02-b076a052d6e9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:51.818850 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3e5512d7-6abe-438f-ac02-b076a052d6e9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:51.855988 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3e5512d7-6abe-438f-ac02-b076a052d6e9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action" status: 200 len: 14 microversion: 2.1 time: 0.052656 Jan 15 21:35:51.856592 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3782/7575] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:35:51 2022] POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action => generated 14 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 15 21:35:52.868171 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-97367010-46d3-4a63-a111-4ecaf0418bce tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:35:52.869216 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-97367010-46d3-4a63-a111-4ecaf0418bce tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:35:52.877468 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-97367010-46d3-4a63-a111-4ecaf0418bce tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:52.877927 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-97367010-46d3-4a63-a111-4ecaf0418bce tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:52.878751 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-97367010-46d3-4a63-a111-4ecaf0418bce tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:52.879225 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-97367010-46d3-4a63-a111-4ecaf0418bce tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:52.917011 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-97367010-46d3-4a63-a111-4ecaf0418bce tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action" status: 200 len: 14 microversion: 2.1 time: 0.052746 Jan 15 21:35:52.917664 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3794/7576] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:35:52 2022] POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action => generated 14 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 21:35:53.928340 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-84895128-7804-4664-b4d1-e1e95d51c167 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:35:53.929414 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-84895128-7804-4664-b4d1-e1e95d51c167 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:35:53.937458 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-84895128-7804-4664-b4d1-e1e95d51c167 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:53.937922 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-84895128-7804-4664-b4d1-e1e95d51c167 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:53.938742 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-84895128-7804-4664-b4d1-e1e95d51c167 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:53.939193 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-84895128-7804-4664-b4d1-e1e95d51c167 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:53.989749 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-84895128-7804-4664-b4d1-e1e95d51c167 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action" status: 200 len: 8205 microversion: 2.1 time: 0.065381 Jan 15 21:35:53.990377 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3783/7577] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:35:53 2022] POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action => generated 8205 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:35:55.002228 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-595a28f7-cb0f-469b-a86e-5aa3822e9a14 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:35:55.003225 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-595a28f7-cb0f-469b-a86e-5aa3822e9a14 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:35:55.010480 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-595a28f7-cb0f-469b-a86e-5aa3822e9a14 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:55.010926 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-595a28f7-cb0f-469b-a86e-5aa3822e9a14 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:55.011756 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-595a28f7-cb0f-469b-a86e-5aa3822e9a14 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:55.012146 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-595a28f7-cb0f-469b-a86e-5aa3822e9a14 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:55.056063 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-595a28f7-cb0f-469b-a86e-5aa3822e9a14 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action" status: 200 len: 8205 microversion: 2.1 time: 0.058564 Jan 15 21:35:55.056758 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3795/7578] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:35:54 2022] POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action => generated 8205 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:35:56.068094 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-725b8076-cf84-4b25-a430-2273a243c668 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:35:56.069152 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-725b8076-cf84-4b25-a430-2273a243c668 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:35:56.077150 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-725b8076-cf84-4b25-a430-2273a243c668 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:56.077637 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-725b8076-cf84-4b25-a430-2273a243c668 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:56.078442 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-725b8076-cf84-4b25-a430-2273a243c668 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:56.078901 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-725b8076-cf84-4b25-a430-2273a243c668 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:56.130847 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-725b8076-cf84-4b25-a430-2273a243c668 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action" status: 200 len: 16397 microversion: 2.1 time: 0.066755 Jan 15 21:35:56.131487 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3784/7579] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:35:56 2022] POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action => generated 16397 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:35:57.143348 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-bfcdb867-303d-42a8-85d1-d4d48e0f4aee tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:35:57.144353 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-bfcdb867-303d-42a8-85d1-d4d48e0f4aee tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:35:57.151787 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bfcdb867-303d-42a8-85d1-d4d48e0f4aee tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:57.152248 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bfcdb867-303d-42a8-85d1-d4d48e0f4aee tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:57.153060 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bfcdb867-303d-42a8-85d1-d4d48e0f4aee tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:57.153505 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bfcdb867-303d-42a8-85d1-d4d48e0f4aee tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:57.193297 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-bfcdb867-303d-42a8-85d1-d4d48e0f4aee tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action" status: 200 len: 16397 microversion: 2.1 time: 0.054553 Jan 15 21:35:57.193935 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3796/7580] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:35:57 2022] POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action => generated 16397 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:35:58.270961 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d6b5141e-522b-4ed5-8f6d-bbc90e0d93d5 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:35:58.272652 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d6b5141e-522b-4ed5-8f6d-bbc90e0d93d5 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:35:58.283246 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d6b5141e-522b-4ed5-8f6d-bbc90e0d93d5 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:58.283726 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d6b5141e-522b-4ed5-8f6d-bbc90e0d93d5 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:58.284549 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d6b5141e-522b-4ed5-8f6d-bbc90e0d93d5 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:58.285132 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d6b5141e-522b-4ed5-8f6d-bbc90e0d93d5 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:58.330438 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d6b5141e-522b-4ed5-8f6d-bbc90e0d93d5 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action" status: 200 len: 16397 microversion: 2.1 time: 0.129200 Jan 15 21:35:58.331076 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3785/7581] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:35:58 2022] POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action => generated 16397 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:35:59.342499 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-887eed25-88e0-4a43-954b-03291e04cae9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:35:59.344307 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-887eed25-88e0-4a43-954b-03291e04cae9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:35:59.351814 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-887eed25-88e0-4a43-954b-03291e04cae9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:59.352272 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-887eed25-88e0-4a43-954b-03291e04cae9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:59.353093 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-887eed25-88e0-4a43-954b-03291e04cae9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:35:59.353548 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-887eed25-88e0-4a43-954b-03291e04cae9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:35:59.396415 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-887eed25-88e0-4a43-954b-03291e04cae9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action" status: 200 len: 16397 microversion: 2.1 time: 0.057954 Jan 15 21:35:59.397101 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3797/7582] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:35:59 2022] POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action => generated 16397 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:36:00.408661 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-061d67bd-49bf-4cfe-a65e-713abeb500ab tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:36:00.409834 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-061d67bd-49bf-4cfe-a65e-713abeb500ab tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:36:00.417410 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-061d67bd-49bf-4cfe-a65e-713abeb500ab tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:36:00.417868 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-061d67bd-49bf-4cfe-a65e-713abeb500ab tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:36:00.418652 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-061d67bd-49bf-4cfe-a65e-713abeb500ab tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:36:00.419096 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-061d67bd-49bf-4cfe-a65e-713abeb500ab tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:36:00.470262 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-061d67bd-49bf-4cfe-a65e-713abeb500ab tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action" status: 200 len: 24562 microversion: 2.1 time: 0.066109 Jan 15 21:36:00.470885 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3786/7583] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:36:00 2022] POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action => generated 24562 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:36:01.483597 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-62ede623-7ba1-4297-925f-81a1b8ff36c6 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:36:01.484527 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-62ede623-7ba1-4297-925f-81a1b8ff36c6 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:36:01.491854 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-62ede623-7ba1-4297-925f-81a1b8ff36c6 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:36:01.492306 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-62ede623-7ba1-4297-925f-81a1b8ff36c6 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:36:01.493116 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-62ede623-7ba1-4297-925f-81a1b8ff36c6 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:36:01.493562 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-62ede623-7ba1-4297-925f-81a1b8ff36c6 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:36:01.536579 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-62ede623-7ba1-4297-925f-81a1b8ff36c6 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action" status: 200 len: 24562 microversion: 2.1 time: 0.057888 Jan 15 21:36:01.537291 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3798/7584] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:36:01 2022] POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action => generated 24562 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 21:36:02.547965 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-6e5649fb-04b8-4a1f-94f4-64bafb30bf83 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:36:02.549025 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-6e5649fb-04b8-4a1f-94f4-64bafb30bf83 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:36:02.556384 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6e5649fb-04b8-4a1f-94f4-64bafb30bf83 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:36:02.556873 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6e5649fb-04b8-4a1f-94f4-64bafb30bf83 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:36:02.557672 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6e5649fb-04b8-4a1f-94f4-64bafb30bf83 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:36:02.558126 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6e5649fb-04b8-4a1f-94f4-64bafb30bf83 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:36:02.597599 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-6e5649fb-04b8-4a1f-94f4-64bafb30bf83 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action" status: 200 len: 24562 microversion: 2.1 time: 0.053661 Jan 15 21:36:02.598219 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3787/7585] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:36:02 2022] POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action => generated 24562 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:36:03.610244 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-01b87563-98c2-46d8-9283-0559268f04b7 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:36:03.611189 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-01b87563-98c2-46d8-9283-0559268f04b7 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:36:03.619393 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-01b87563-98c2-46d8-9283-0559268f04b7 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:36:03.619839 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-01b87563-98c2-46d8-9283-0559268f04b7 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:36:03.620625 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-01b87563-98c2-46d8-9283-0559268f04b7 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:36:03.621156 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-01b87563-98c2-46d8-9283-0559268f04b7 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:36:03.660537 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-01b87563-98c2-46d8-9283-0559268f04b7 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action" status: 200 len: 24562 microversion: 2.1 time: 0.055247 Jan 15 21:36:03.661475 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3799/7586] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:36:03 2022] POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action => generated 24562 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:36:04.673468 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8244b987-9707-43a2-aafc-e6e0377c6221 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:36:04.674540 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-8244b987-9707-43a2-aafc-e6e0377c6221 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:36:04.681965 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8244b987-9707-43a2-aafc-e6e0377c6221 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:36:04.682434 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8244b987-9707-43a2-aafc-e6e0377c6221 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:36:04.683229 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8244b987-9707-43a2-aafc-e6e0377c6221 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:36:04.683680 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8244b987-9707-43a2-aafc-e6e0377c6221 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:36:04.723254 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-8244b987-9707-43a2-aafc-e6e0377c6221 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action" status: 200 len: 24562 microversion: 2.1 time: 0.054317 Jan 15 21:36:04.723869 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3788/7587] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:36:04 2022] POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action => generated 24562 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:36:05.735601 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-27d16749-e495-49be-9b1e-075331600f36 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:36:05.736595 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-27d16749-e495-49be-9b1e-075331600f36 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:36:05.743876 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-27d16749-e495-49be-9b1e-075331600f36 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:36:05.744323 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-27d16749-e495-49be-9b1e-075331600f36 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:36:05.745130 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-27d16749-e495-49be-9b1e-075331600f36 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:36:05.745563 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-27d16749-e495-49be-9b1e-075331600f36 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:36:05.787036 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-27d16749-e495-49be-9b1e-075331600f36 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action" status: 200 len: 24562 microversion: 2.1 time: 0.055435 Jan 15 21:36:05.787670 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3800/7588] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:36:05 2022] POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action => generated 24562 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:36:06.799732 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ab808148-6935-487e-8f5d-9adbfc74fa26 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:36:06.800761 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ab808148-6935-487e-8f5d-9adbfc74fa26 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:36:06.808197 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ab808148-6935-487e-8f5d-9adbfc74fa26 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:36:06.808664 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ab808148-6935-487e-8f5d-9adbfc74fa26 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:36:06.809508 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ab808148-6935-487e-8f5d-9adbfc74fa26 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:36:06.809961 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ab808148-6935-487e-8f5d-9adbfc74fa26 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:36:06.850163 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ab808148-6935-487e-8f5d-9adbfc74fa26 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action" status: 200 len: 24562 microversion: 2.1 time: 0.055102 Jan 15 21:36:06.850779 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3789/7589] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:36:06 2022] POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action => generated 24562 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:36:07.862259 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-371aa7a3-aba8-4d68-a816-f50c08fbe8a2 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:36:07.863263 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-371aa7a3-aba8-4d68-a816-f50c08fbe8a2 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:36:07.870525 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-371aa7a3-aba8-4d68-a816-f50c08fbe8a2 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:36:07.870979 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-371aa7a3-aba8-4d68-a816-f50c08fbe8a2 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:36:07.871756 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-371aa7a3-aba8-4d68-a816-f50c08fbe8a2 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:36:07.872193 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-371aa7a3-aba8-4d68-a816-f50c08fbe8a2 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:36:07.915548 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-371aa7a3-aba8-4d68-a816-f50c08fbe8a2 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action" status: 200 len: 24562 microversion: 2.1 time: 0.057315 Jan 15 21:36:07.916409 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3801/7590] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:36:07 2022] POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action => generated 24562 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:36:08.927626 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9a1d9862-d8df-487e-bef1-b51abb823b18 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:36:08.928639 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-9a1d9862-d8df-487e-bef1-b51abb823b18 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:36:08.936205 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9a1d9862-d8df-487e-bef1-b51abb823b18 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:36:08.936673 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9a1d9862-d8df-487e-bef1-b51abb823b18 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:36:08.937487 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9a1d9862-d8df-487e-bef1-b51abb823b18 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:36:08.937934 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9a1d9862-d8df-487e-bef1-b51abb823b18 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:36:08.975956 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-9a1d9862-d8df-487e-bef1-b51abb823b18 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action" status: 200 len: 24562 microversion: 2.1 time: 0.052347 Jan 15 21:36:08.976574 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3790/7591] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:36:08 2022] POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action => generated 24562 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:36:09.987869 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-47a0435b-6f54-4e6b-8c23-94812c85aade tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:36:09.988945 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-47a0435b-6f54-4e6b-8c23-94812c85aade tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:36:09.996428 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-47a0435b-6f54-4e6b-8c23-94812c85aade tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:36:09.996973 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-47a0435b-6f54-4e6b-8c23-94812c85aade tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:36:09.997774 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-47a0435b-6f54-4e6b-8c23-94812c85aade tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:36:09.998348 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-47a0435b-6f54-4e6b-8c23-94812c85aade tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:36:10.036593 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-47a0435b-6f54-4e6b-8c23-94812c85aade tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action" status: 200 len: 24562 microversion: 2.1 time: 0.052450 Jan 15 21:36:10.037288 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3802/7592] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:36:09 2022] POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action => generated 24562 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:36:11.048931 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d59429d0-bd65-422c-a217-b51a2cee32ea tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:36:11.049956 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d59429d0-bd65-422c-a217-b51a2cee32ea tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:36:11.057349 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d59429d0-bd65-422c-a217-b51a2cee32ea tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:36:11.057812 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d59429d0-bd65-422c-a217-b51a2cee32ea tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:36:11.058596 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d59429d0-bd65-422c-a217-b51a2cee32ea tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:36:11.059046 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d59429d0-bd65-422c-a217-b51a2cee32ea tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:36:11.101829 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d59429d0-bd65-422c-a217-b51a2cee32ea tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action" status: 200 len: 24562 microversion: 2.1 time: 0.057048 Jan 15 21:36:11.102499 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3791/7593] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:36:11 2022] POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action => generated 24562 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:36:12.113919 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-01b7ab7e-7bb1-419d-bab9-916195e8abcc tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:36:12.114910 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-01b7ab7e-7bb1-419d-bab9-916195e8abcc tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:36:12.122214 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-01b7ab7e-7bb1-419d-bab9-916195e8abcc tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:36:12.122663 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-01b7ab7e-7bb1-419d-bab9-916195e8abcc tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:36:12.123474 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-01b7ab7e-7bb1-419d-bab9-916195e8abcc tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:36:12.123902 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-01b7ab7e-7bb1-419d-bab9-916195e8abcc tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:36:12.163241 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-01b7ab7e-7bb1-419d-bab9-916195e8abcc tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action" status: 200 len: 24562 microversion: 2.1 time: 0.053272 Jan 15 21:36:12.163970 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3803/7594] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:36:12 2022] POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action => generated 24562 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:36:13.175939 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3c4e8cbf-069b-4074-94bc-7ab178bf351c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:36:13.176981 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-3c4e8cbf-069b-4074-94bc-7ab178bf351c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:36:13.184336 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3c4e8cbf-069b-4074-94bc-7ab178bf351c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:36:13.184800 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3c4e8cbf-069b-4074-94bc-7ab178bf351c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:36:13.185613 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3c4e8cbf-069b-4074-94bc-7ab178bf351c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:36:13.186064 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3c4e8cbf-069b-4074-94bc-7ab178bf351c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:36:13.223957 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3c4e8cbf-069b-4074-94bc-7ab178bf351c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action" status: 200 len: 24562 microversion: 2.1 time: 0.052045 Jan 15 21:36:13.224572 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3792/7595] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:36:13 2022] POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action => generated 24562 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:36:14.236467 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8472bde1-1249-4d07-b9df-026a63155a4a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:36:14.237479 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-8472bde1-1249-4d07-b9df-026a63155a4a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:36:14.244385 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8472bde1-1249-4d07-b9df-026a63155a4a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:36:14.244831 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8472bde1-1249-4d07-b9df-026a63155a4a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:36:14.245648 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8472bde1-1249-4d07-b9df-026a63155a4a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:36:14.246081 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8472bde1-1249-4d07-b9df-026a63155a4a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:36:14.299750 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-8472bde1-1249-4d07-b9df-026a63155a4a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action" status: 200 len: 32635 microversion: 2.1 time: 0.067835 Jan 15 21:36:14.300395 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3804/7596] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:36:14 2022] POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action => generated 32635 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:36:15.312166 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-387309ac-9aa9-47f6-93b5-f8704b1bd192 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:36:15.313204 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-387309ac-9aa9-47f6-93b5-f8704b1bd192 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:36:15.320357 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-387309ac-9aa9-47f6-93b5-f8704b1bd192 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:36:15.320826 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-387309ac-9aa9-47f6-93b5-f8704b1bd192 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:36:15.321647 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-387309ac-9aa9-47f6-93b5-f8704b1bd192 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:36:15.322099 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-387309ac-9aa9-47f6-93b5-f8704b1bd192 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:36:15.364728 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-387309ac-9aa9-47f6-93b5-f8704b1bd192 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action" status: 200 len: 32635 microversion: 2.1 time: 0.056579 Jan 15 21:36:15.365652 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3793/7597] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:36:15 2022] POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action => generated 32635 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:36:16.376568 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-336169eb-8cd7-49e0-9557-99ac0c207e5b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:36:16.377602 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-336169eb-8cd7-49e0-9557-99ac0c207e5b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:36:16.385631 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-336169eb-8cd7-49e0-9557-99ac0c207e5b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:36:16.386081 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-336169eb-8cd7-49e0-9557-99ac0c207e5b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:36:16.386869 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-336169eb-8cd7-49e0-9557-99ac0c207e5b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:36:16.387306 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-336169eb-8cd7-49e0-9557-99ac0c207e5b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:36:16.428009 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-336169eb-8cd7-49e0-9557-99ac0c207e5b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action" status: 200 len: 32635 microversion: 2.1 time: 0.055899 Jan 15 21:36:16.428906 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3805/7598] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:36:16 2022] POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action => generated 32635 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:36:17.440330 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-76c7743d-a256-4498-8282-0b18288b7a39 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:36:17.441371 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-76c7743d-a256-4498-8282-0b18288b7a39 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:36:17.448696 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-76c7743d-a256-4498-8282-0b18288b7a39 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:36:17.449130 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-76c7743d-a256-4498-8282-0b18288b7a39 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:36:17.449944 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-76c7743d-a256-4498-8282-0b18288b7a39 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:36:17.450382 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-76c7743d-a256-4498-8282-0b18288b7a39 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:36:17.490873 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-76c7743d-a256-4498-8282-0b18288b7a39 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action" status: 200 len: 32635 microversion: 2.1 time: 0.054564 Jan 15 21:36:17.491500 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3794/7599] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:36:17 2022] POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action => generated 32635 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:36:18.503679 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-02499bc4-f1b9-440e-8952-9afa620bc5ae tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:36:18.504709 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-02499bc4-f1b9-440e-8952-9afa620bc5ae tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:36:18.512117 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-02499bc4-f1b9-440e-8952-9afa620bc5ae tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:36:18.512578 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-02499bc4-f1b9-440e-8952-9afa620bc5ae tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:36:18.514234 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-02499bc4-f1b9-440e-8952-9afa620bc5ae tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:36:18.514691 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-02499bc4-f1b9-440e-8952-9afa620bc5ae tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:36:18.558046 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-02499bc4-f1b9-440e-8952-9afa620bc5ae tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action" status: 200 len: 32635 microversion: 2.1 time: 0.058301 Jan 15 21:36:18.558697 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3806/7600] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:36:18 2022] POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action => generated 32635 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 21:36:19.571126 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-6d4cd9a1-0623-4cdd-83da-40e3e0fbce76 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:36:19.572079 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-6d4cd9a1-0623-4cdd-83da-40e3e0fbce76 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:36:19.580561 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6d4cd9a1-0623-4cdd-83da-40e3e0fbce76 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:36:19.581070 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6d4cd9a1-0623-4cdd-83da-40e3e0fbce76 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:36:19.581880 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6d4cd9a1-0623-4cdd-83da-40e3e0fbce76 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:36:19.582342 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6d4cd9a1-0623-4cdd-83da-40e3e0fbce76 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:36:19.623898 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-6d4cd9a1-0623-4cdd-83da-40e3e0fbce76 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action" status: 200 len: 32635 microversion: 2.1 time: 0.056714 Jan 15 21:36:19.624675 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3795/7601] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:36:19 2022] POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action => generated 32635 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:36:20.636514 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-90e4775f-01fc-4a85-9baf-14eb80692ecc tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:36:20.637491 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-90e4775f-01fc-4a85-9baf-14eb80692ecc tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:36:20.644990 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-90e4775f-01fc-4a85-9baf-14eb80692ecc tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:36:20.645482 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-90e4775f-01fc-4a85-9baf-14eb80692ecc tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:36:20.646472 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-90e4775f-01fc-4a85-9baf-14eb80692ecc tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:36:20.646930 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-90e4775f-01fc-4a85-9baf-14eb80692ecc tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:36:20.696898 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-90e4775f-01fc-4a85-9baf-14eb80692ecc tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action" status: 200 len: 32635 microversion: 2.1 time: 0.064482 Jan 15 21:36:20.697562 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3807/7602] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:36:20 2022] POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action => generated 32635 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:36:21.709040 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b6b5b8e1-83df-4cfb-bfca-72686475b28b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:36:21.710066 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b6b5b8e1-83df-4cfb-bfca-72686475b28b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:36:21.717967 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b6b5b8e1-83df-4cfb-bfca-72686475b28b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:36:21.718433 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b6b5b8e1-83df-4cfb-bfca-72686475b28b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:36:21.719231 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b6b5b8e1-83df-4cfb-bfca-72686475b28b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:36:21.719677 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b6b5b8e1-83df-4cfb-bfca-72686475b28b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:36:21.766524 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b6b5b8e1-83df-4cfb-bfca-72686475b28b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action" status: 200 len: 32635 microversion: 2.1 time: 0.061506 Jan 15 21:36:21.767168 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3796/7603] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:36:21 2022] POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action => generated 32635 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 21:36:22.778683 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1f4fe23c-a709-4db5-ae81-80b1e9ed34d8 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:36:22.779682 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-1f4fe23c-a709-4db5-ae81-80b1e9ed34d8 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:36:22.787293 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1f4fe23c-a709-4db5-ae81-80b1e9ed34d8 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:36:22.787741 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1f4fe23c-a709-4db5-ae81-80b1e9ed34d8 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:36:22.788512 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1f4fe23c-a709-4db5-ae81-80b1e9ed34d8 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:36:22.788971 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1f4fe23c-a709-4db5-ae81-80b1e9ed34d8 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:36:22.833610 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-1f4fe23c-a709-4db5-ae81-80b1e9ed34d8 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action" status: 200 len: 32635 microversion: 2.1 time: 0.058862 Jan 15 21:36:22.834524 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3808/7604] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:36:22 2022] POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action => generated 32635 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:36:23.846435 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e5e8b702-b5e2-4abb-92c1-ac70e632e7f0 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:36:23.847487 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e5e8b702-b5e2-4abb-92c1-ac70e632e7f0 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:36:23.854912 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e5e8b702-b5e2-4abb-92c1-ac70e632e7f0 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:36:23.855378 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e5e8b702-b5e2-4abb-92c1-ac70e632e7f0 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:36:23.856172 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e5e8b702-b5e2-4abb-92c1-ac70e632e7f0 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:36:23.856623 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e5e8b702-b5e2-4abb-92c1-ac70e632e7f0 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:36:23.906995 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e5e8b702-b5e2-4abb-92c1-ac70e632e7f0 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action" status: 200 len: 32635 microversion: 2.1 time: 0.065551 Jan 15 21:36:23.907683 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3797/7605] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:36:23 2022] POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action => generated 32635 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:36:24.919329 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f92b7aee-f6bc-4232-98c2-f7447fe28a88 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:36:24.920333 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f92b7aee-f6bc-4232-98c2-f7447fe28a88 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:36:24.927712 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f92b7aee-f6bc-4232-98c2-f7447fe28a88 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:36:24.928164 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f92b7aee-f6bc-4232-98c2-f7447fe28a88 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:36:24.928973 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f92b7aee-f6bc-4232-98c2-f7447fe28a88 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:36:24.929413 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f92b7aee-f6bc-4232-98c2-f7447fe28a88 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:36:24.976363 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f92b7aee-f6bc-4232-98c2-f7447fe28a88 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action" status: 200 len: 32635 microversion: 2.1 time: 0.060977 Jan 15 21:36:24.977076 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3809/7606] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:36:24 2022] POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action => generated 32635 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:36:25.988678 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-861c40cb-d35b-4d41-a20c-54e6cc8de18a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:36:25.989726 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-861c40cb-d35b-4d41-a20c-54e6cc8de18a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:36:25.997133 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-861c40cb-d35b-4d41-a20c-54e6cc8de18a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:36:25.997602 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-861c40cb-d35b-4d41-a20c-54e6cc8de18a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:36:25.998392 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-861c40cb-d35b-4d41-a20c-54e6cc8de18a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:36:25.998960 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-861c40cb-d35b-4d41-a20c-54e6cc8de18a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:36:26.043609 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-861c40cb-d35b-4d41-a20c-54e6cc8de18a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action" status: 200 len: 32635 microversion: 2.1 time: 0.058909 Jan 15 21:36:26.044478 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3798/7607] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:36:25 2022] POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action => generated 32635 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 21:36:27.056168 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-93d5ad24-5127-4aa2-836a-ac5d66eae695 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:36:27.057193 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-93d5ad24-5127-4aa2-836a-ac5d66eae695 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:36:27.065123 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-93d5ad24-5127-4aa2-836a-ac5d66eae695 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:36:27.065576 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-93d5ad24-5127-4aa2-836a-ac5d66eae695 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:36:27.066353 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-93d5ad24-5127-4aa2-836a-ac5d66eae695 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:36:27.066790 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-93d5ad24-5127-4aa2-836a-ac5d66eae695 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:36:27.111401 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-93d5ad24-5127-4aa2-836a-ac5d66eae695 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action" status: 200 len: 32635 microversion: 2.1 time: 0.059248 Jan 15 21:36:27.112277 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3810/7608] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:36:27 2022] POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action => generated 32635 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:36:28.124457 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e9431724-5e1d-4665-89bd-5f2e6c3d73cd tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:36:28.125535 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e9431724-5e1d-4665-89bd-5f2e6c3d73cd tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:36:28.132860 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e9431724-5e1d-4665-89bd-5f2e6c3d73cd tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:36:28.133334 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e9431724-5e1d-4665-89bd-5f2e6c3d73cd tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:36:28.134156 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e9431724-5e1d-4665-89bd-5f2e6c3d73cd tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:36:28.134608 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e9431724-5e1d-4665-89bd-5f2e6c3d73cd tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:36:28.179169 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e9431724-5e1d-4665-89bd-5f2e6c3d73cd tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action" status: 200 len: 32635 microversion: 2.1 time: 0.059273 Jan 15 21:36:28.180043 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3799/7609] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:36:28 2022] POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action => generated 32635 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:36:29.191483 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-cc78a6ad-28a8-40ae-b846-7e22421c062b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:36:29.192491 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-cc78a6ad-28a8-40ae-b846-7e22421c062b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:36:29.199936 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cc78a6ad-28a8-40ae-b846-7e22421c062b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:36:29.200396 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cc78a6ad-28a8-40ae-b846-7e22421c062b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:36:29.201225 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cc78a6ad-28a8-40ae-b846-7e22421c062b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:36:29.202184 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cc78a6ad-28a8-40ae-b846-7e22421c062b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:36:29.248055 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-cc78a6ad-28a8-40ae-b846-7e22421c062b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action" status: 200 len: 32635 microversion: 2.1 time: 0.060573 Jan 15 21:36:29.248774 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3811/7610] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:36:29 2022] POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action => generated 32635 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:36:30.260701 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ac275fa4-9dc5-436e-9225-2a6a421687f3 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:36:30.261737 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ac275fa4-9dc5-436e-9225-2a6a421687f3 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:36:30.269108 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ac275fa4-9dc5-436e-9225-2a6a421687f3 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:36:30.269570 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ac275fa4-9dc5-436e-9225-2a6a421687f3 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:36:30.270355 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ac275fa4-9dc5-436e-9225-2a6a421687f3 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:36:30.270799 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ac275fa4-9dc5-436e-9225-2a6a421687f3 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:36:30.316563 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ac275fa4-9dc5-436e-9225-2a6a421687f3 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action" status: 200 len: 32635 microversion: 2.1 time: 0.060067 Jan 15 21:36:30.319258 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3800/7611] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:36:30 2022] POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action => generated 32635 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:36:31.328114 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-668467d0-d48b-4951-bd17-44e070f90ad9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:36:31.329178 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-668467d0-d48b-4951-bd17-44e070f90ad9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:36:31.336573 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-668467d0-d48b-4951-bd17-44e070f90ad9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:36:31.337062 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-668467d0-d48b-4951-bd17-44e070f90ad9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:36:31.337837 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-668467d0-d48b-4951-bd17-44e070f90ad9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:36:31.338272 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-668467d0-d48b-4951-bd17-44e070f90ad9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:36:31.383890 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-668467d0-d48b-4951-bd17-44e070f90ad9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action" status: 200 len: 32635 microversion: 2.1 time: 0.059715 Jan 15 21:36:31.384651 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3812/7612] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:36:31 2022] POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action => generated 32635 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 21:36:32.396181 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b0d2126b-440f-4fc7-b170-bdbf6b7829eb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:36:32.397243 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b0d2126b-440f-4fc7-b170-bdbf6b7829eb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:36:32.404605 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b0d2126b-440f-4fc7-b170-bdbf6b7829eb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:36:32.405107 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b0d2126b-440f-4fc7-b170-bdbf6b7829eb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:36:32.405990 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b0d2126b-440f-4fc7-b170-bdbf6b7829eb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:36:32.406442 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b0d2126b-440f-4fc7-b170-bdbf6b7829eb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:36:32.449620 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b0d2126b-440f-4fc7-b170-bdbf6b7829eb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action" status: 200 len: 32635 microversion: 2.1 time: 0.057438 Jan 15 21:36:32.450534 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3801/7613] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:36:32 2022] POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action => generated 32635 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:36:33.464687 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-92eda68b-2fad-4e64-9d30-3143cad9d17c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:36:33.465634 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-92eda68b-2fad-4e64-9d30-3143cad9d17c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:36:33.473655 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-92eda68b-2fad-4e64-9d30-3143cad9d17c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:36:33.474106 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-92eda68b-2fad-4e64-9d30-3143cad9d17c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:36:33.474879 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-92eda68b-2fad-4e64-9d30-3143cad9d17c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:36:33.475312 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-92eda68b-2fad-4e64-9d30-3143cad9d17c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:36:33.519619 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-92eda68b-2fad-4e64-9d30-3143cad9d17c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action" status: 200 len: 32635 microversion: 2.1 time: 0.060079 Jan 15 21:36:33.520296 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3813/7614] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:36:33 2022] POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action => generated 32635 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:36:34.531851 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-1031d3c4-938c-4811-a547-870729d2cacc tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:36:34.532885 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-1031d3c4-938c-4811-a547-870729d2cacc tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:36:34.540739 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1031d3c4-938c-4811-a547-870729d2cacc tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:36:34.541245 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1031d3c4-938c-4811-a547-870729d2cacc tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:36:34.542026 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1031d3c4-938c-4811-a547-870729d2cacc tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:36:34.542480 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1031d3c4-938c-4811-a547-870729d2cacc tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:36:34.588074 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-1031d3c4-938c-4811-a547-870729d2cacc tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action" status: 200 len: 32635 microversion: 2.1 time: 0.060138 Jan 15 21:36:34.588984 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3802/7615] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:36:34 2022] POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action => generated 32635 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:36:35.600076 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-97b0b135-96ac-42be-a4f6-c7fd03f909b1 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:36:35.601111 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-97b0b135-96ac-42be-a4f6-c7fd03f909b1 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:36:35.608585 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-97b0b135-96ac-42be-a4f6-c7fd03f909b1 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:36:35.609073 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-97b0b135-96ac-42be-a4f6-c7fd03f909b1 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:36:35.609848 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-97b0b135-96ac-42be-a4f6-c7fd03f909b1 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:36:35.610286 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-97b0b135-96ac-42be-a4f6-c7fd03f909b1 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:36:35.656263 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-97b0b135-96ac-42be-a4f6-c7fd03f909b1 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action" status: 200 len: 32635 microversion: 2.1 time: 0.060178 Jan 15 21:36:35.656931 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3814/7616] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:36:35 2022] POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action => generated 32635 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:36:36.668639 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-06dbfb85-d93f-41fd-be6f-979239aea76d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:36:36.669676 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-06dbfb85-d93f-41fd-be6f-979239aea76d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:36:36.677670 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-06dbfb85-d93f-41fd-be6f-979239aea76d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:36:36.678130 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-06dbfb85-d93f-41fd-be6f-979239aea76d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:36:36.678917 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-06dbfb85-d93f-41fd-be6f-979239aea76d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:36:36.679362 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-06dbfb85-d93f-41fd-be6f-979239aea76d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:36:36.725782 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-06dbfb85-d93f-41fd-be6f-979239aea76d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action" status: 200 len: 32635 microversion: 2.1 time: 0.061112 Jan 15 21:36:36.726428 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3803/7617] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:36:36 2022] POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action => generated 32635 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:36:37.738962 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8bef8a37-313d-4282-bc5a-e814f886519e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:36:37.739956 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-8bef8a37-313d-4282-bc5a-e814f886519e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:36:37.747375 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8bef8a37-313d-4282-bc5a-e814f886519e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:36:37.747821 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8bef8a37-313d-4282-bc5a-e814f886519e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:36:37.749241 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8bef8a37-313d-4282-bc5a-e814f886519e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:36:37.749676 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8bef8a37-313d-4282-bc5a-e814f886519e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:36:37.793491 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-8bef8a37-313d-4282-bc5a-e814f886519e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action" status: 200 len: 32635 microversion: 2.1 time: 0.058518 Jan 15 21:36:37.794116 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3815/7618] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:36:37 2022] POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action => generated 32635 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 21:36:38.806344 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-740502b4-bd2f-4490-a90d-4cb099071217 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:36:38.807425 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-740502b4-bd2f-4490-a90d-4cb099071217 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:36:38.814859 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-740502b4-bd2f-4490-a90d-4cb099071217 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:36:38.815323 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-740502b4-bd2f-4490-a90d-4cb099071217 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:36:38.816117 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-740502b4-bd2f-4490-a90d-4cb099071217 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:36:38.816567 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-740502b4-bd2f-4490-a90d-4cb099071217 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:36:38.859440 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-740502b4-bd2f-4490-a90d-4cb099071217 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action" status: 200 len: 32635 microversion: 2.1 time: 0.057081 Jan 15 21:36:38.861631 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3804/7619] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:36:38 2022] POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action => generated 32635 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:36:39.871973 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-98d6f87b-12c7-4cb8-b43f-6325154573d0 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:36:39.873018 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-98d6f87b-12c7-4cb8-b43f-6325154573d0 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:36:39.880486 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-98d6f87b-12c7-4cb8-b43f-6325154573d0 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:36:39.881055 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-98d6f87b-12c7-4cb8-b43f-6325154573d0 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:36:39.881847 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-98d6f87b-12c7-4cb8-b43f-6325154573d0 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:36:39.882288 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-98d6f87b-12c7-4cb8-b43f-6325154573d0 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:36:39.927068 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-98d6f87b-12c7-4cb8-b43f-6325154573d0 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action" status: 200 len: 32635 microversion: 2.1 time: 0.059097 Jan 15 21:36:39.927704 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3816/7620] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:36:39 2022] POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action => generated 32635 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:36:40.939120 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e5dda46d-a777-4405-a8f3-be23151fa6ae tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:36:40.940163 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e5dda46d-a777-4405-a8f3-be23151fa6ae tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:36:40.947488 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e5dda46d-a777-4405-a8f3-be23151fa6ae tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:36:40.947956 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e5dda46d-a777-4405-a8f3-be23151fa6ae tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:36:40.948750 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e5dda46d-a777-4405-a8f3-be23151fa6ae tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:36:40.949231 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e5dda46d-a777-4405-a8f3-be23151fa6ae tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:36:40.994166 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e5dda46d-a777-4405-a8f3-be23151fa6ae tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action" status: 200 len: 32635 microversion: 2.1 time: 0.059077 Jan 15 21:36:40.994789 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3805/7621] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:36:40 2022] POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action => generated 32635 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:36:42.006442 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b4d5fbf5-54bf-42f1-b443-d0cfb0ec2bdf tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:36:42.007434 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b4d5fbf5-54bf-42f1-b443-d0cfb0ec2bdf tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:36:42.014785 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b4d5fbf5-54bf-42f1-b443-d0cfb0ec2bdf tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:36:42.015233 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b4d5fbf5-54bf-42f1-b443-d0cfb0ec2bdf tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:36:42.016006 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b4d5fbf5-54bf-42f1-b443-d0cfb0ec2bdf tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:36:42.016435 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b4d5fbf5-54bf-42f1-b443-d0cfb0ec2bdf tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:36:42.059810 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b4d5fbf5-54bf-42f1-b443-d0cfb0ec2bdf tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action" status: 200 len: 32635 microversion: 2.1 time: 0.057401 Jan 15 21:36:42.060449 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3817/7622] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:36:42 2022] POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action => generated 32635 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:36:43.072569 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-0791404a-babd-4e01-8742-21550356174d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:36:43.073604 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-0791404a-babd-4e01-8742-21550356174d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:36:43.081287 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0791404a-babd-4e01-8742-21550356174d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:36:43.081751 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0791404a-babd-4e01-8742-21550356174d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:36:43.082534 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0791404a-babd-4e01-8742-21550356174d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:36:43.082981 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0791404a-babd-4e01-8742-21550356174d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:36:43.128221 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-0791404a-babd-4e01-8742-21550356174d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action" status: 200 len: 32635 microversion: 2.1 time: 0.059650 Jan 15 21:36:43.128884 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3806/7623] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:36:43 2022] POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action => generated 32635 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:36:44.141233 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e00aa915-7e9c-4497-9f1f-555b63fbd75f tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:36:44.142241 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e00aa915-7e9c-4497-9f1f-555b63fbd75f tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:36:44.149349 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e00aa915-7e9c-4497-9f1f-555b63fbd75f tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:36:44.149807 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e00aa915-7e9c-4497-9f1f-555b63fbd75f tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:36:44.150591 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e00aa915-7e9c-4497-9f1f-555b63fbd75f tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:36:44.151029 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e00aa915-7e9c-4497-9f1f-555b63fbd75f tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:36:44.194767 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e00aa915-7e9c-4497-9f1f-555b63fbd75f tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action" status: 200 len: 32635 microversion: 2.1 time: 0.058669 Jan 15 21:36:44.195413 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3818/7624] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:36:44 2022] POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action => generated 32635 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:36:45.208043 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-85e08478-e44c-44da-a3b7-2d5a4a22de81 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:36:45.209102 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-85e08478-e44c-44da-a3b7-2d5a4a22de81 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:36:45.216288 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-85e08478-e44c-44da-a3b7-2d5a4a22de81 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:36:45.216761 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-85e08478-e44c-44da-a3b7-2d5a4a22de81 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:36:45.218225 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-85e08478-e44c-44da-a3b7-2d5a4a22de81 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:36:45.218797 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-85e08478-e44c-44da-a3b7-2d5a4a22de81 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:36:45.265106 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-85e08478-e44c-44da-a3b7-2d5a4a22de81 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action" status: 200 len: 32635 microversion: 2.1 time: 0.061056 Jan 15 21:36:45.265742 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3807/7625] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:36:45 2022] POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action => generated 32635 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:36:46.277246 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c9d89218-79b6-4670-ad3c-70a10da28605 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:36:46.278262 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c9d89218-79b6-4670-ad3c-70a10da28605 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:36:46.285701 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c9d89218-79b6-4670-ad3c-70a10da28605 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:36:46.286155 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c9d89218-79b6-4670-ad3c-70a10da28605 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:36:46.287189 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c9d89218-79b6-4670-ad3c-70a10da28605 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:36:46.287629 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c9d89218-79b6-4670-ad3c-70a10da28605 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:36:46.334373 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c9d89218-79b6-4670-ad3c-70a10da28605 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action" status: 200 len: 32635 microversion: 2.1 time: 0.061105 Jan 15 21:36:46.335041 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3819/7626] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:36:46 2022] POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action => generated 32635 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:36:47.347610 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a5f21d04-6c0a-43ab-8b26-11d81cae429b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:36:47.348629 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a5f21d04-6c0a-43ab-8b26-11d81cae429b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:36:47.356137 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a5f21d04-6c0a-43ab-8b26-11d81cae429b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:36:47.356603 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a5f21d04-6c0a-43ab-8b26-11d81cae429b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:36:47.357437 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a5f21d04-6c0a-43ab-8b26-11d81cae429b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:36:47.358019 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a5f21d04-6c0a-43ab-8b26-11d81cae429b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:36:47.402969 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a5f21d04-6c0a-43ab-8b26-11d81cae429b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action" status: 200 len: 32635 microversion: 2.1 time: 0.059378 Jan 15 21:36:47.403641 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3808/7627] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:36:47 2022] POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action => generated 32635 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:36:48.416170 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-2499e9c4-4ec1-4d9d-b7a6-2b4fbfd83b01 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:36:48.417227 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-2499e9c4-4ec1-4d9d-b7a6-2b4fbfd83b01 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:36:48.424782 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2499e9c4-4ec1-4d9d-b7a6-2b4fbfd83b01 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:36:48.425273 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2499e9c4-4ec1-4d9d-b7a6-2b4fbfd83b01 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:36:48.426042 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2499e9c4-4ec1-4d9d-b7a6-2b4fbfd83b01 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:36:48.426473 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2499e9c4-4ec1-4d9d-b7a6-2b4fbfd83b01 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:36:48.472012 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-2499e9c4-4ec1-4d9d-b7a6-2b4fbfd83b01 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action" status: 200 len: 32635 microversion: 2.1 time: 0.059769 Jan 15 21:36:48.472660 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3820/7628] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:36:48 2022] POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action => generated 32635 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:36:49.484553 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-28095109-fa06-4f39-b6f0-8ccad34a5feb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:36:49.485509 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-28095109-fa06-4f39-b6f0-8ccad34a5feb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:36:49.492821 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-28095109-fa06-4f39-b6f0-8ccad34a5feb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:36:49.493303 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-28095109-fa06-4f39-b6f0-8ccad34a5feb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:36:49.494097 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-28095109-fa06-4f39-b6f0-8ccad34a5feb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:36:49.494547 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-28095109-fa06-4f39-b6f0-8ccad34a5feb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:36:49.543529 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-28095109-fa06-4f39-b6f0-8ccad34a5feb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action" status: 200 len: 32635 microversion: 2.1 time: 0.063272 Jan 15 21:36:49.544182 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3809/7629] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:36:49 2022] POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action => generated 32635 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:36:50.555724 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c8a79060-c0ea-4926-9f0d-241b27b3f9de tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:36:50.556720 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c8a79060-c0ea-4926-9f0d-241b27b3f9de tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:36:50.564908 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c8a79060-c0ea-4926-9f0d-241b27b3f9de tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:36:50.565362 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c8a79060-c0ea-4926-9f0d-241b27b3f9de tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:36:50.566146 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c8a79060-c0ea-4926-9f0d-241b27b3f9de tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:36:50.566583 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c8a79060-c0ea-4926-9f0d-241b27b3f9de tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:36:50.609561 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c8a79060-c0ea-4926-9f0d-241b27b3f9de tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action" status: 200 len: 32635 microversion: 2.1 time: 0.057812 Jan 15 21:36:50.610198 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3821/7630] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:36:50 2022] POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action => generated 32635 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:36:50.982779 ncdv-master-1 devstack@n-api.service[129366]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 15 21:36:50.983005 ncdv-master-1 devstack@n-api.service[129366]: Sat Jan 15 21:36:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 15 21:36:51.313557 ncdv-master-1 devstack@n-api.service[129365]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 15 21:36:51.314106 ncdv-master-1 devstack@n-api.service[129365]: Sat Jan 15 21:36:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 15 21:36:51.621863 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ce543dc8-6225-40c2-b63b-e06fcbeb548f tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:36:51.622829 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ce543dc8-6225-40c2-b63b-e06fcbeb548f tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:36:51.630797 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ce543dc8-6225-40c2-b63b-e06fcbeb548f tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:36:51.631258 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ce543dc8-6225-40c2-b63b-e06fcbeb548f tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:36:51.632046 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ce543dc8-6225-40c2-b63b-e06fcbeb548f tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:36:51.632494 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ce543dc8-6225-40c2-b63b-e06fcbeb548f tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:36:51.676964 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ce543dc8-6225-40c2-b63b-e06fcbeb548f tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action" status: 200 len: 32635 microversion: 2.1 time: 0.059155 Jan 15 21:36:51.677572 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3810/7631] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:36:51 2022] POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action => generated 32635 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:36:52.689802 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-bcea5758-eeff-4ec3-bb23-0bbab814aeae tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:36:52.690819 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-bcea5758-eeff-4ec3-bb23-0bbab814aeae tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:36:52.698218 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bcea5758-eeff-4ec3-bb23-0bbab814aeae tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:36:52.698674 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bcea5758-eeff-4ec3-bb23-0bbab814aeae tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:36:52.699461 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bcea5758-eeff-4ec3-bb23-0bbab814aeae tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:36:52.699905 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bcea5758-eeff-4ec3-bb23-0bbab814aeae tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:36:52.744934 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-bcea5758-eeff-4ec3-bb23-0bbab814aeae tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action" status: 200 len: 32635 microversion: 2.1 time: 0.059686 Jan 15 21:36:52.745710 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3822/7632] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:36:52 2022] POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action => generated 32635 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:36:53.757264 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f4568377-31df-4efc-8bf3-dcd2a2dd528a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:36:53.758301 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f4568377-31df-4efc-8bf3-dcd2a2dd528a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:36:53.765691 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f4568377-31df-4efc-8bf3-dcd2a2dd528a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:36:53.766152 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f4568377-31df-4efc-8bf3-dcd2a2dd528a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:36:53.766940 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f4568377-31df-4efc-8bf3-dcd2a2dd528a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:36:53.767387 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f4568377-31df-4efc-8bf3-dcd2a2dd528a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:36:53.812868 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f4568377-31df-4efc-8bf3-dcd2a2dd528a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action" status: 200 len: 32635 microversion: 2.1 time: 0.059562 Jan 15 21:36:53.813517 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3811/7633] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:36:53 2022] POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action => generated 32635 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:36:54.823990 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-651876ba-2a77-4c7f-a7a6-a7686656a915 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:36:54.825007 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-651876ba-2a77-4c7f-a7a6-a7686656a915 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:36:54.832330 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-651876ba-2a77-4c7f-a7a6-a7686656a915 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:36:54.832784 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-651876ba-2a77-4c7f-a7a6-a7686656a915 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:36:54.833577 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-651876ba-2a77-4c7f-a7a6-a7686656a915 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:36:54.834012 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-651876ba-2a77-4c7f-a7a6-a7686656a915 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:36:54.879240 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-651876ba-2a77-4c7f-a7a6-a7686656a915 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action" status: 200 len: 32635 microversion: 2.1 time: 0.059176 Jan 15 21:36:54.879995 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3823/7634] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:36:54 2022] POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action => generated 32635 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:36:55.892116 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b0a37913-83fa-4c3b-a6cb-f2553037e423 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:36:55.893152 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b0a37913-83fa-4c3b-a6cb-f2553037e423 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:36:55.900431 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b0a37913-83fa-4c3b-a6cb-f2553037e423 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:36:55.900924 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b0a37913-83fa-4c3b-a6cb-f2553037e423 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:36:55.901715 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b0a37913-83fa-4c3b-a6cb-f2553037e423 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:36:55.902162 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b0a37913-83fa-4c3b-a6cb-f2553037e423 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:36:55.946342 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b0a37913-83fa-4c3b-a6cb-f2553037e423 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action" status: 200 len: 32635 microversion: 2.1 time: 0.058748 Jan 15 21:36:55.947011 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3812/7635] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:36:55 2022] POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action => generated 32635 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:36:56.959522 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e2c99a03-cc16-4f9c-86c1-322d5018eac7 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:36:56.960560 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e2c99a03-cc16-4f9c-86c1-322d5018eac7 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:36:56.968790 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e2c99a03-cc16-4f9c-86c1-322d5018eac7 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:36:56.969352 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e2c99a03-cc16-4f9c-86c1-322d5018eac7 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:36:56.970150 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e2c99a03-cc16-4f9c-86c1-322d5018eac7 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:36:56.970592 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e2c99a03-cc16-4f9c-86c1-322d5018eac7 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:36:57.015448 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e2c99a03-cc16-4f9c-86c1-322d5018eac7 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action" status: 200 len: 32635 microversion: 2.1 time: 0.059986 Jan 15 21:36:57.016087 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3824/7636] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:36:56 2022] POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action => generated 32635 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:36:58.027534 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-74f12d22-7ca6-4d6b-b29b-4154ea282554 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:36:58.028545 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-74f12d22-7ca6-4d6b-b29b-4154ea282554 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:36:58.036132 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-74f12d22-7ca6-4d6b-b29b-4154ea282554 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:36:58.036866 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-74f12d22-7ca6-4d6b-b29b-4154ea282554 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:36:58.037667 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-74f12d22-7ca6-4d6b-b29b-4154ea282554 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:36:58.038144 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-74f12d22-7ca6-4d6b-b29b-4154ea282554 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:36:58.083636 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-74f12d22-7ca6-4d6b-b29b-4154ea282554 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action" status: 200 len: 32635 microversion: 2.1 time: 0.060020 Jan 15 21:36:58.084290 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3813/7637] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:36:58 2022] POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action => generated 32635 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:36:59.096143 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e4226f1f-13cf-42b1-8fdc-65d9acb2cfb9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:36:59.097216 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e4226f1f-13cf-42b1-8fdc-65d9acb2cfb9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:36:59.104818 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e4226f1f-13cf-42b1-8fdc-65d9acb2cfb9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:36:59.105296 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e4226f1f-13cf-42b1-8fdc-65d9acb2cfb9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:36:59.106093 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e4226f1f-13cf-42b1-8fdc-65d9acb2cfb9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:36:59.106536 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e4226f1f-13cf-42b1-8fdc-65d9acb2cfb9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:36:59.155071 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e4226f1f-13cf-42b1-8fdc-65d9acb2cfb9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action" status: 200 len: 32635 microversion: 2.1 time: 0.062944 Jan 15 21:36:59.156017 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3825/7638] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:36:59 2022] POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action => generated 32635 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:37:00.167410 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-816a2aed-8838-4963-9f4d-4a953a4d3746 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:37:00.168466 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-816a2aed-8838-4963-9f4d-4a953a4d3746 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:37:00.175937 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-816a2aed-8838-4963-9f4d-4a953a4d3746 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:00.176411 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-816a2aed-8838-4963-9f4d-4a953a4d3746 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:00.177249 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-816a2aed-8838-4963-9f4d-4a953a4d3746 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:00.177703 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-816a2aed-8838-4963-9f4d-4a953a4d3746 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:00.222185 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-816a2aed-8838-4963-9f4d-4a953a4d3746 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action" status: 200 len: 32635 microversion: 2.1 time: 0.058770 Jan 15 21:37:00.223088 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3814/7639] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:37:00 2022] POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action => generated 32635 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:37:01.234605 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c7b933f7-7cfb-4d59-a8a8-f6d3be35feeb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:37:01.235638 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c7b933f7-7cfb-4d59-a8a8-f6d3be35feeb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:37:01.243041 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c7b933f7-7cfb-4d59-a8a8-f6d3be35feeb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:01.243492 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c7b933f7-7cfb-4d59-a8a8-f6d3be35feeb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:01.244266 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c7b933f7-7cfb-4d59-a8a8-f6d3be35feeb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:01.244702 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c7b933f7-7cfb-4d59-a8a8-f6d3be35feeb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:01.284147 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c7b933f7-7cfb-4d59-a8a8-f6d3be35feeb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action" status: 200 len: 32635 microversion: 2.1 time: 0.053528 Jan 15 21:37:01.285062 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3826/7640] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:37:01 2022] POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action => generated 32635 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:37:02.296902 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-7e03eabf-0cfa-4bca-b1c4-b083ac8d5f75 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:37:02.297911 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-7e03eabf-0cfa-4bca-b1c4-b083ac8d5f75 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:37:02.305258 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7e03eabf-0cfa-4bca-b1c4-b083ac8d5f75 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:02.305723 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7e03eabf-0cfa-4bca-b1c4-b083ac8d5f75 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:02.306507 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7e03eabf-0cfa-4bca-b1c4-b083ac8d5f75 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:02.306956 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7e03eabf-0cfa-4bca-b1c4-b083ac8d5f75 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:02.352901 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-7e03eabf-0cfa-4bca-b1c4-b083ac8d5f75 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action" status: 200 len: 32635 microversion: 2.1 time: 0.060124 Jan 15 21:37:02.353691 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3815/7641] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:37:02 2022] POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action => generated 32635 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:37:03.365372 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-3c9d4d8c-602a-414c-8889-e64519b9e359 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:37:03.366417 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-3c9d4d8c-602a-414c-8889-e64519b9e359 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:37:03.374165 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3c9d4d8c-602a-414c-8889-e64519b9e359 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:03.374624 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3c9d4d8c-602a-414c-8889-e64519b9e359 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:03.375422 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3c9d4d8c-602a-414c-8889-e64519b9e359 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:03.375870 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3c9d4d8c-602a-414c-8889-e64519b9e359 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:03.422419 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-3c9d4d8c-602a-414c-8889-e64519b9e359 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action" status: 200 len: 32635 microversion: 2.1 time: 0.061081 Jan 15 21:37:03.423078 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3827/7642] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:37:03 2022] POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action => generated 32635 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:37:04.434721 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-7de025f7-7ea0-4200-8ade-a0c9b697fe0b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:37:04.436379 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-7de025f7-7ea0-4200-8ade-a0c9b697fe0b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:37:04.443705 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7de025f7-7ea0-4200-8ade-a0c9b697fe0b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:04.444202 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7de025f7-7ea0-4200-8ade-a0c9b697fe0b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:04.445057 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7de025f7-7ea0-4200-8ade-a0c9b697fe0b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:04.445513 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7de025f7-7ea0-4200-8ade-a0c9b697fe0b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:04.494049 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-7de025f7-7ea0-4200-8ade-a0c9b697fe0b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action" status: 200 len: 32635 microversion: 2.1 time: 0.058911 Jan 15 21:37:04.496751 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3816/7643] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:37:04 2022] POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action => generated 32635 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:37:05.506652 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0e658ab1-3443-4a4d-8ffb-acb4810397bb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:37:05.507568 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-0e658ab1-3443-4a4d-8ffb-acb4810397bb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:37:05.515256 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0e658ab1-3443-4a4d-8ffb-acb4810397bb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:05.515702 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0e658ab1-3443-4a4d-8ffb-acb4810397bb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:05.516475 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0e658ab1-3443-4a4d-8ffb-acb4810397bb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:05.516934 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0e658ab1-3443-4a4d-8ffb-acb4810397bb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:05.562786 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0e658ab1-3443-4a4d-8ffb-acb4810397bb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action" status: 200 len: 32635 microversion: 2.1 time: 0.060241 Jan 15 21:37:05.563437 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3828/7644] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:37:05 2022] POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action => generated 32635 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:37:06.575094 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-7774a441-f08f-45ae-b718-ab6db869acc7 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:37:06.576743 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-7774a441-f08f-45ae-b718-ab6db869acc7 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:37:06.584076 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7774a441-f08f-45ae-b718-ab6db869acc7 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:06.584535 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7774a441-f08f-45ae-b718-ab6db869acc7 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:06.585359 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7774a441-f08f-45ae-b718-ab6db869acc7 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:06.585802 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7774a441-f08f-45ae-b718-ab6db869acc7 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:06.638313 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-7774a441-f08f-45ae-b718-ab6db869acc7 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action" status: 200 len: 32635 microversion: 2.1 time: 0.067024 Jan 15 21:37:06.639741 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3817/7645] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:37:06 2022] POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action => generated 32635 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:37:07.652501 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c67ae8be-e405-44e2-a428-d2603b59ce6c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:37:07.653455 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c67ae8be-e405-44e2-a428-d2603b59ce6c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:37:07.660865 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c67ae8be-e405-44e2-a428-d2603b59ce6c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:07.661305 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c67ae8be-e405-44e2-a428-d2603b59ce6c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:07.662334 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c67ae8be-e405-44e2-a428-d2603b59ce6c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:07.662766 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c67ae8be-e405-44e2-a428-d2603b59ce6c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:07.707923 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c67ae8be-e405-44e2-a428-d2603b59ce6c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action" status: 200 len: 32635 microversion: 2.1 time: 0.059572 Jan 15 21:37:07.708871 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3829/7646] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:37:07 2022] POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action => generated 32635 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:37:08.720554 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d10ca7de-b653-4971-a243-e47bdc774d3e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:37:08.721605 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d10ca7de-b653-4971-a243-e47bdc774d3e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:37:08.728880 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d10ca7de-b653-4971-a243-e47bdc774d3e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:08.729353 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d10ca7de-b653-4971-a243-e47bdc774d3e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:08.730144 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d10ca7de-b653-4971-a243-e47bdc774d3e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:08.730595 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d10ca7de-b653-4971-a243-e47bdc774d3e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:08.774378 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d10ca7de-b653-4971-a243-e47bdc774d3e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action" status: 200 len: 32635 microversion: 2.1 time: 0.058289 Jan 15 21:37:08.775039 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3818/7647] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:37:08 2022] POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action => generated 32635 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:37:09.787138 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0ff2bbd4-18b9-461f-8d95-5d900c0a4c99 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:37:09.788140 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-0ff2bbd4-18b9-461f-8d95-5d900c0a4c99 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:37:09.795959 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0ff2bbd4-18b9-461f-8d95-5d900c0a4c99 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:09.796412 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0ff2bbd4-18b9-461f-8d95-5d900c0a4c99 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:09.797224 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0ff2bbd4-18b9-461f-8d95-5d900c0a4c99 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:09.797666 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0ff2bbd4-18b9-461f-8d95-5d900c0a4c99 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:09.843171 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0ff2bbd4-18b9-461f-8d95-5d900c0a4c99 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action" status: 200 len: 32635 microversion: 2.1 time: 0.060389 Jan 15 21:37:09.844070 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3830/7648] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:37:09 2022] POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action => generated 32635 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:37:10.854853 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-4261d48b-8ead-426a-89b4-38c2ae8c8dbc tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:37:10.855871 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-4261d48b-8ead-426a-89b4-38c2ae8c8dbc tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:37:10.864055 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4261d48b-8ead-426a-89b4-38c2ae8c8dbc tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:10.864518 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4261d48b-8ead-426a-89b4-38c2ae8c8dbc tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:10.865341 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4261d48b-8ead-426a-89b4-38c2ae8c8dbc tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:10.865787 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4261d48b-8ead-426a-89b4-38c2ae8c8dbc tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:10.906852 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-4261d48b-8ead-426a-89b4-38c2ae8c8dbc tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action" status: 200 len: 32635 microversion: 2.1 time: 0.055925 Jan 15 21:37:10.908882 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3819/7649] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:37:10 2022] POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action => generated 32635 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:37:11.918817 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-829fadbb-10c6-492e-8b97-09e54161ad46 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:37:11.919825 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-829fadbb-10c6-492e-8b97-09e54161ad46 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:37:11.927291 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-829fadbb-10c6-492e-8b97-09e54161ad46 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:11.927750 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-829fadbb-10c6-492e-8b97-09e54161ad46 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:11.928535 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-829fadbb-10c6-492e-8b97-09e54161ad46 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:11.929017 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-829fadbb-10c6-492e-8b97-09e54161ad46 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:11.977110 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-829fadbb-10c6-492e-8b97-09e54161ad46 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action" status: 200 len: 32635 microversion: 2.1 time: 0.062174 Jan 15 21:37:11.977795 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3831/7650] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:37:11 2022] POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action => generated 32635 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:37:12.989954 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ae906bd8-6a1f-4031-9ede-a7023f9b458c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:37:12.990962 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ae906bd8-6a1f-4031-9ede-a7023f9b458c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:37:12.999022 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ae906bd8-6a1f-4031-9ede-a7023f9b458c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:12.999488 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ae906bd8-6a1f-4031-9ede-a7023f9b458c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:13.000291 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ae906bd8-6a1f-4031-9ede-a7023f9b458c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:13.000746 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ae906bd8-6a1f-4031-9ede-a7023f9b458c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:13.045255 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ae906bd8-6a1f-4031-9ede-a7023f9b458c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action" status: 200 len: 32635 microversion: 2.1 time: 0.058758 Jan 15 21:37:13.045979 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3820/7651] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:37:12 2022] POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action => generated 32635 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:37:14.057710 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-5c276ea1-dd25-40a2-80c3-461ddb489972 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:37:14.058710 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-5c276ea1-dd25-40a2-80c3-461ddb489972 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:37:14.066286 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5c276ea1-dd25-40a2-80c3-461ddb489972 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:14.066733 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5c276ea1-dd25-40a2-80c3-461ddb489972 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:14.067525 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5c276ea1-dd25-40a2-80c3-461ddb489972 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:14.067951 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5c276ea1-dd25-40a2-80c3-461ddb489972 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:14.114070 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-5c276ea1-dd25-40a2-80c3-461ddb489972 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action" status: 200 len: 32635 microversion: 2.1 time: 0.060332 Jan 15 21:37:14.118029 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3832/7652] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:37:14 2022] POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action => generated 32635 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:37:15.126645 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-57dee1ca-58fe-4af1-b653-dc365a74d902 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:37:15.127583 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-57dee1ca-58fe-4af1-b653-dc365a74d902 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:37:15.134643 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-57dee1ca-58fe-4af1-b653-dc365a74d902 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:15.135117 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-57dee1ca-58fe-4af1-b653-dc365a74d902 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:15.135913 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-57dee1ca-58fe-4af1-b653-dc365a74d902 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:15.136364 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-57dee1ca-58fe-4af1-b653-dc365a74d902 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:15.189986 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-57dee1ca-58fe-4af1-b653-dc365a74d902 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action" status: 200 len: 32635 microversion: 2.1 time: 0.068179 Jan 15 21:37:15.190633 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3821/7653] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:37:15 2022] POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action => generated 32635 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:37:16.202828 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-681ca0e9-2721-475e-81ef-ace1dbd53cbe tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:37:16.203830 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-681ca0e9-2721-475e-81ef-ace1dbd53cbe tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:37:16.211287 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-681ca0e9-2721-475e-81ef-ace1dbd53cbe tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:16.211745 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-681ca0e9-2721-475e-81ef-ace1dbd53cbe tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:16.212535 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-681ca0e9-2721-475e-81ef-ace1dbd53cbe tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:16.213007 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-681ca0e9-2721-475e-81ef-ace1dbd53cbe tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:16.255955 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-681ca0e9-2721-475e-81ef-ace1dbd53cbe tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action" status: 200 len: 32635 microversion: 2.1 time: 0.057725 Jan 15 21:37:16.256622 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3833/7654] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:37:16 2022] POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action => generated 32635 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:37:17.269015 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-1589ea9e-33a0-4c94-84e7-f3eaea4dba21 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:37:17.270029 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-1589ea9e-33a0-4c94-84e7-f3eaea4dba21 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:37:17.277369 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1589ea9e-33a0-4c94-84e7-f3eaea4dba21 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:17.277836 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1589ea9e-33a0-4c94-84e7-f3eaea4dba21 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:17.278631 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1589ea9e-33a0-4c94-84e7-f3eaea4dba21 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:17.279797 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1589ea9e-33a0-4c94-84e7-f3eaea4dba21 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:17.326459 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-1589ea9e-33a0-4c94-84e7-f3eaea4dba21 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action" status: 200 len: 32635 microversion: 2.1 time: 0.061240 Jan 15 21:37:17.327124 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3822/7655] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:37:17 2022] POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action => generated 32635 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:37:18.338678 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-25a17c51-cdc9-42b5-a55b-2d5a9fa8f0c0 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:37:18.339676 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-25a17c51-cdc9-42b5-a55b-2d5a9fa8f0c0 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:37:18.347736 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-25a17c51-cdc9-42b5-a55b-2d5a9fa8f0c0 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:18.348184 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-25a17c51-cdc9-42b5-a55b-2d5a9fa8f0c0 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:18.349001 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-25a17c51-cdc9-42b5-a55b-2d5a9fa8f0c0 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:18.349437 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-25a17c51-cdc9-42b5-a55b-2d5a9fa8f0c0 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:18.396223 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-25a17c51-cdc9-42b5-a55b-2d5a9fa8f0c0 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action" status: 200 len: 32635 microversion: 2.1 time: 0.061492 Jan 15 21:37:18.396896 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3834/7656] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:37:18 2022] POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action => generated 32635 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:37:19.408707 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-1813e9e4-f34c-41c5-8518-c4215e23e22a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:37:19.409785 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-1813e9e4-f34c-41c5-8518-c4215e23e22a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:37:19.417607 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1813e9e4-f34c-41c5-8518-c4215e23e22a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:19.418076 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1813e9e4-f34c-41c5-8518-c4215e23e22a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:19.418868 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1813e9e4-f34c-41c5-8518-c4215e23e22a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:19.419318 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1813e9e4-f34c-41c5-8518-c4215e23e22a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:19.463084 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-1813e9e4-f34c-41c5-8518-c4215e23e22a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action" status: 200 len: 32635 microversion: 2.1 time: 0.058609 Jan 15 21:37:19.463716 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3823/7657] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:37:19 2022] POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action => generated 32635 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:37:20.475260 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-6021b27a-bcd2-4d41-80b1-90a836e94f29 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:37:20.476267 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-6021b27a-bcd2-4d41-80b1-90a836e94f29 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:37:20.484157 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6021b27a-bcd2-4d41-80b1-90a836e94f29 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:20.484608 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6021b27a-bcd2-4d41-80b1-90a836e94f29 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:20.485440 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6021b27a-bcd2-4d41-80b1-90a836e94f29 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:20.485882 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6021b27a-bcd2-4d41-80b1-90a836e94f29 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:20.530891 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-6021b27a-bcd2-4d41-80b1-90a836e94f29 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action" status: 200 len: 32635 microversion: 2.1 time: 0.059657 Jan 15 21:37:20.531809 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3835/7658] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:37:20 2022] POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action => generated 32635 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 21:37:21.542609 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5ece6539-5010-4eb7-a25d-9535143e7988 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:37:21.543534 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-5ece6539-5010-4eb7-a25d-9535143e7988 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:37:21.551185 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5ece6539-5010-4eb7-a25d-9535143e7988 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:21.551645 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5ece6539-5010-4eb7-a25d-9535143e7988 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:21.552428 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5ece6539-5010-4eb7-a25d-9535143e7988 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:21.552904 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5ece6539-5010-4eb7-a25d-9535143e7988 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:21.600407 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5ece6539-5010-4eb7-a25d-9535143e7988 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action" status: 200 len: 32635 microversion: 2.1 time: 0.061830 Jan 15 21:37:21.601071 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3824/7659] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:37:21 2022] POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action => generated 32635 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:37:22.612886 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7703e402-9b39-4b21-8d0b-2944072799f4 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:37:22.613876 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-7703e402-9b39-4b21-8d0b-2944072799f4 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:37:22.621220 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7703e402-9b39-4b21-8d0b-2944072799f4 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:22.621674 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7703e402-9b39-4b21-8d0b-2944072799f4 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:22.622448 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7703e402-9b39-4b21-8d0b-2944072799f4 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:22.623671 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7703e402-9b39-4b21-8d0b-2944072799f4 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:22.663791 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7703e402-9b39-4b21-8d0b-2944072799f4 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action" status: 200 len: 32635 microversion: 2.1 time: 0.054901 Jan 15 21:37:22.664421 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3836/7660] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:37:22 2022] POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action => generated 32635 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:37:23.675317 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-4cf2ea41-2977-49a1-a1b3-ed9ae70b3aa0 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:37:23.676327 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-4cf2ea41-2977-49a1-a1b3-ed9ae70b3aa0 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:37:23.683836 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4cf2ea41-2977-49a1-a1b3-ed9ae70b3aa0 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:23.684305 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4cf2ea41-2977-49a1-a1b3-ed9ae70b3aa0 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:23.685656 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4cf2ea41-2977-49a1-a1b3-ed9ae70b3aa0 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:23.686103 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4cf2ea41-2977-49a1-a1b3-ed9ae70b3aa0 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:23.740329 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-4cf2ea41-2977-49a1-a1b3-ed9ae70b3aa0 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action" status: 200 len: 40786 microversion: 2.1 time: 0.068993 Jan 15 21:37:23.740990 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3825/7661] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:37:23 2022] POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action => generated 40786 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:37:23.752988 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ff3db599-e1e0-48ef-a7f7-51c407988fb3 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:37:23.754047 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ff3db599-e1e0-48ef-a7f7-51c407988fb3 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:37:23.761431 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ff3db599-e1e0-48ef-a7f7-51c407988fb3 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:23.761889 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ff3db599-e1e0-48ef-a7f7-51c407988fb3 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:23.762670 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ff3db599-e1e0-48ef-a7f7-51c407988fb3 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:23.763801 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ff3db599-e1e0-48ef-a7f7-51c407988fb3 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:23.795239 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-ff3db599-e1e0-48ef-a7f7-51c407988fb3 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:37:23.801332 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ff3db599-e1e0-48ef-a7f7-51c407988fb3 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Old instance type m1.heat2, new instance type m1.heat {{(pid=129366) resize /opt/stack/nova/nova/compute/api.py:4097}} Jan 15 21:37:23.807401 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-ff3db599-e1e0-48ef-a7f7-51c407988fb3 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Flavor limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 21:37:23.807821 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-ff3db599-e1e0-48ef-a7f7-51c407988fb3 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Image limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 21:37:23.808293 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-ff3db599-e1e0-48ef-a7f7-51c407988fb3 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Flavor pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 21:37:23.808702 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-ff3db599-e1e0-48ef-a7f7-51c407988fb3 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Image pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 21:37:23.809140 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-ff3db599-e1e0-48ef-a7f7-51c407988fb3 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 21:37:23.871684 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ff3db599-e1e0-48ef-a7f7-51c407988fb3 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action" status: 202 len: 0 microversion: 2.1 time: 0.123477 Jan 15 21:37:23.872383 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3837/7662] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:37:23 2022] POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:37:23.881818 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-1f7b16a1-5d2a-451c-86ff-8a15ac5ef7d3 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:37:23.882534 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-1f7b16a1-5d2a-451c-86ff-8a15ac5ef7d3 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:37:23.889948 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1f7b16a1-5d2a-451c-86ff-8a15ac5ef7d3 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:23.890412 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1f7b16a1-5d2a-451c-86ff-8a15ac5ef7d3 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:23.891206 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1f7b16a1-5d2a-451c-86ff-8a15ac5ef7d3 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:23.891840 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1f7b16a1-5d2a-451c-86ff-8a15ac5ef7d3 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:24.052250 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-1f7b16a1-5d2a-451c-86ff-8a15ac5ef7d3 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:37:24.059727 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-1f7b16a1-5d2a-451c-86ff-8a15ac5ef7d3 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af" status: 200 len: 1677 microversion: 2.1 time: 0.182001 Jan 15 21:37:24.061052 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3826/7663] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:37:23 2022] GET /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af => generated 1677 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:37:25.080212 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-2cc230ed-c837-4f2d-a217-5057fe0c8eea tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:37:25.081088 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-2cc230ed-c837-4f2d-a217-5057fe0c8eea tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:37:25.090009 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2cc230ed-c837-4f2d-a217-5057fe0c8eea tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:25.090567 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2cc230ed-c837-4f2d-a217-5057fe0c8eea tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:25.091990 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2cc230ed-c837-4f2d-a217-5057fe0c8eea tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:25.092440 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2cc230ed-c837-4f2d-a217-5057fe0c8eea tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:25.229199 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-2cc230ed-c837-4f2d-a217-5057fe0c8eea tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:37:25.238115 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-2cc230ed-c837-4f2d-a217-5057fe0c8eea tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af" status: 200 len: 1677 microversion: 2.1 time: 0.163281 Jan 15 21:37:25.238701 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3838/7664] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:37:25 2022] GET /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af => generated 1677 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:37:26.255760 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c664b70c-70e4-4303-9463-49a8a5eebb5f tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:37:26.256378 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c664b70c-70e4-4303-9463-49a8a5eebb5f tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:37:26.263886 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c664b70c-70e4-4303-9463-49a8a5eebb5f tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:26.264342 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c664b70c-70e4-4303-9463-49a8a5eebb5f tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:26.265157 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c664b70c-70e4-4303-9463-49a8a5eebb5f tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:26.265697 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c664b70c-70e4-4303-9463-49a8a5eebb5f tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:26.403063 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-c664b70c-70e4-4303-9463-49a8a5eebb5f tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:37:26.410855 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c664b70c-70e4-4303-9463-49a8a5eebb5f tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af" status: 200 len: 1682 microversion: 2.1 time: 0.158832 Jan 15 21:37:26.411696 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3827/7665] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:37:26 2022] GET /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:37:27.428773 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-96a3d240-4127-49b9-b847-8cd2bc6bdbca tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:37:27.429414 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-96a3d240-4127-49b9-b847-8cd2bc6bdbca tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:37:27.436803 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-96a3d240-4127-49b9-b847-8cd2bc6bdbca tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:27.437295 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-96a3d240-4127-49b9-b847-8cd2bc6bdbca tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:27.438123 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-96a3d240-4127-49b9-b847-8cd2bc6bdbca tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:27.438569 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-96a3d240-4127-49b9-b847-8cd2bc6bdbca tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:27.568563 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-96a3d240-4127-49b9-b847-8cd2bc6bdbca tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:37:27.577047 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-96a3d240-4127-49b9-b847-8cd2bc6bdbca tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af" status: 200 len: 1682 microversion: 2.1 time: 0.151847 Jan 15 21:37:27.577634 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3839/7666] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:37:27 2022] GET /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:37:28.594622 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ac11be0e-316d-45bf-a00f-c9c4e2af9ada tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:37:28.595241 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ac11be0e-316d-45bf-a00f-c9c4e2af9ada tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:37:28.602006 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ac11be0e-316d-45bf-a00f-c9c4e2af9ada tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:28.602465 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ac11be0e-316d-45bf-a00f-c9c4e2af9ada tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:28.603251 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ac11be0e-316d-45bf-a00f-c9c4e2af9ada tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:28.603696 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ac11be0e-316d-45bf-a00f-c9c4e2af9ada tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:28.735668 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-ac11be0e-316d-45bf-a00f-c9c4e2af9ada tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:37:28.743294 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ac11be0e-316d-45bf-a00f-c9c4e2af9ada tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af" status: 200 len: 1682 microversion: 2.1 time: 0.153218 Jan 15 21:37:28.743889 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3828/7667] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:37:28 2022] GET /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:37:29.760475 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-2004541c-0b68-4841-8f73-583b788d24cf tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:37:29.761113 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-2004541c-0b68-4841-8f73-583b788d24cf tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:37:29.768713 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2004541c-0b68-4841-8f73-583b788d24cf tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:29.769195 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2004541c-0b68-4841-8f73-583b788d24cf tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:29.769967 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2004541c-0b68-4841-8f73-583b788d24cf tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:29.770400 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2004541c-0b68-4841-8f73-583b788d24cf tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:29.898693 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-2004541c-0b68-4841-8f73-583b788d24cf tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:37:29.906327 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-2004541c-0b68-4841-8f73-583b788d24cf tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af" status: 200 len: 1682 microversion: 2.1 time: 0.149581 Jan 15 21:37:29.906916 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3840/7668] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:37:29 2022] GET /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:37:30.924294 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-756ca8ef-1377-4ece-a7ab-1bd4ac964116 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:37:30.924955 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-756ca8ef-1377-4ece-a7ab-1bd4ac964116 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:37:30.931898 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-756ca8ef-1377-4ece-a7ab-1bd4ac964116 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:30.932392 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-756ca8ef-1377-4ece-a7ab-1bd4ac964116 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:30.933224 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-756ca8ef-1377-4ece-a7ab-1bd4ac964116 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:30.933677 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-756ca8ef-1377-4ece-a7ab-1bd4ac964116 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:31.066588 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-756ca8ef-1377-4ece-a7ab-1bd4ac964116 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:37:31.074303 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-756ca8ef-1377-4ece-a7ab-1bd4ac964116 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af" status: 200 len: 1682 microversion: 2.1 time: 0.153799 Jan 15 21:37:31.074879 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3829/7669] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:37:30 2022] GET /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:37:32.092305 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-6a30578a-df94-448a-af87-0b1b945224cb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:37:32.093009 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-6a30578a-df94-448a-af87-0b1b945224cb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:37:32.099768 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6a30578a-df94-448a-af87-0b1b945224cb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:32.100224 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6a30578a-df94-448a-af87-0b1b945224cb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:32.101041 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6a30578a-df94-448a-af87-0b1b945224cb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:32.101484 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6a30578a-df94-448a-af87-0b1b945224cb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:32.236564 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-6a30578a-df94-448a-af87-0b1b945224cb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:37:32.243983 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-6a30578a-df94-448a-af87-0b1b945224cb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af" status: 200 len: 1682 microversion: 2.1 time: 0.156098 Jan 15 21:37:32.244558 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3841/7670] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:37:32 2022] GET /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:37:33.261461 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-834c8fad-e086-469d-ab26-1731bb6dfe11 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:37:33.262076 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-834c8fad-e086-469d-ab26-1731bb6dfe11 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:37:33.268971 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-834c8fad-e086-469d-ab26-1731bb6dfe11 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:33.269431 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-834c8fad-e086-469d-ab26-1731bb6dfe11 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:33.270214 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-834c8fad-e086-469d-ab26-1731bb6dfe11 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:33.270661 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-834c8fad-e086-469d-ab26-1731bb6dfe11 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:33.403998 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-834c8fad-e086-469d-ab26-1731bb6dfe11 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:37:33.412358 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-834c8fad-e086-469d-ab26-1731bb6dfe11 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af" status: 200 len: 1682 microversion: 2.1 time: 0.154611 Jan 15 21:37:33.412954 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3830/7671] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:37:33 2022] GET /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:37:34.430501 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-546e16d5-2ac1-4de5-a6e8-e25508afe655 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:37:34.431094 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-546e16d5-2ac1-4de5-a6e8-e25508afe655 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:37:34.438551 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-546e16d5-2ac1-4de5-a6e8-e25508afe655 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:34.438996 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-546e16d5-2ac1-4de5-a6e8-e25508afe655 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:34.439887 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-546e16d5-2ac1-4de5-a6e8-e25508afe655 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:34.440275 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-546e16d5-2ac1-4de5-a6e8-e25508afe655 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:34.577374 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-546e16d5-2ac1-4de5-a6e8-e25508afe655 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:37:34.584797 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-546e16d5-2ac1-4de5-a6e8-e25508afe655 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af" status: 200 len: 1682 microversion: 2.1 time: 0.158071 Jan 15 21:37:34.585403 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3842/7672] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:37:34 2022] GET /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:37:35.602031 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-df441ff1-1d4f-426d-950b-c34d20ccad5b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:37:35.602599 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-df441ff1-1d4f-426d-950b-c34d20ccad5b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:37:35.609615 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-df441ff1-1d4f-426d-950b-c34d20ccad5b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:35.610077 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-df441ff1-1d4f-426d-950b-c34d20ccad5b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:35.610899 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-df441ff1-1d4f-426d-950b-c34d20ccad5b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:35.611344 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-df441ff1-1d4f-426d-950b-c34d20ccad5b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:35.743642 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-df441ff1-1d4f-426d-950b-c34d20ccad5b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:37:35.751558 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-df441ff1-1d4f-426d-950b-c34d20ccad5b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af" status: 200 len: 1682 microversion: 2.1 time: 0.153390 Jan 15 21:37:35.752129 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3831/7673] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:37:35 2022] GET /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:37:36.768788 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-2cffac3a-9351-4814-98f3-f64737e3f3e9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:37:36.769418 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-2cffac3a-9351-4814-98f3-f64737e3f3e9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:37:36.776114 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2cffac3a-9351-4814-98f3-f64737e3f3e9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:36.776558 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2cffac3a-9351-4814-98f3-f64737e3f3e9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:36.777353 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2cffac3a-9351-4814-98f3-f64737e3f3e9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:36.777787 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2cffac3a-9351-4814-98f3-f64737e3f3e9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:36.910977 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-2cffac3a-9351-4814-98f3-f64737e3f3e9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:37:36.918727 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-2cffac3a-9351-4814-98f3-f64737e3f3e9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af" status: 200 len: 1682 microversion: 2.1 time: 0.153732 Jan 15 21:37:36.919986 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3843/7674] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:37:36 2022] GET /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:37:37.937602 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-531e0576-ed9e-4b98-bb4f-feb1f1d61162 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:37:37.938225 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-531e0576-ed9e-4b98-bb4f-feb1f1d61162 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:37:37.945875 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-531e0576-ed9e-4b98-bb4f-feb1f1d61162 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:37.946338 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-531e0576-ed9e-4b98-bb4f-feb1f1d61162 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:37.947150 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-531e0576-ed9e-4b98-bb4f-feb1f1d61162 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:37.947609 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-531e0576-ed9e-4b98-bb4f-feb1f1d61162 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:38.084551 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-531e0576-ed9e-4b98-bb4f-feb1f1d61162 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:37:38.092757 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-531e0576-ed9e-4b98-bb4f-feb1f1d61162 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af" status: 200 len: 1682 microversion: 2.1 time: 0.159748 Jan 15 21:37:38.093379 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3832/7675] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:37:37 2022] GET /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:37:38.588006 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-2c487d1b-5a08-443b-af29-d947df35a512 req-59547a3a-b0ee-4a86-80b7-54960b3d9191 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e727515-c789-4ce3-a870-c575fb06a6af", "name": "network-vif-unplugged", "status": "completed", "tag": "3eaece6a-5dd7-4b7d-96c5-3f1558d9320c"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:37:38.589816 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:37:38.589816 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:37:38.598704 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-2c487d1b-5a08-443b-af29-d947df35a512 req-59547a3a-b0ee-4a86-80b7-54960b3d9191 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:38.599425 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-2c487d1b-5a08-443b-af29-d947df35a512 req-59547a3a-b0ee-4a86-80b7-54960b3d9191 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:38.617661 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-2c487d1b-5a08-443b-af29-d947df35a512 req-59547a3a-b0ee-4a86-80b7-54960b3d9191 service nova] Creating event network-vif-unplugged:3eaece6a-5dd7-4b7d-96c5-3f1558d9320c for instance 8e727515-c789-4ce3-a870-c575fb06a6af on nch1-master-1 Jan 15 21:37:38.624602 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [req-2c487d1b-5a08-443b-af29-d947df35a512 req-59547a3a-b0ee-4a86-80b7-54960b3d9191 service nova] Instance 8e727515-c789-4ce3-a870-c575fb06a6af is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=129366) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Jan 15 21:37:38.637226 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-2c487d1b-5a08-443b-af29-d947df35a512 req-59547a3a-b0ee-4a86-80b7-54960b3d9191 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.121187 Jan 15 21:37:38.638101 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3844/7676] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:37:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 21:37:39.112368 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2e7f94d2-fbcf-4efa-bbbc-69481d0ad38a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:37:39.113032 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-2e7f94d2-fbcf-4efa-bbbc-69481d0ad38a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:37:39.119248 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2e7f94d2-fbcf-4efa-bbbc-69481d0ad38a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:39.119718 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2e7f94d2-fbcf-4efa-bbbc-69481d0ad38a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:39.120521 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2e7f94d2-fbcf-4efa-bbbc-69481d0ad38a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:39.121005 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2e7f94d2-fbcf-4efa-bbbc-69481d0ad38a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:39.256955 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-2e7f94d2-fbcf-4efa-bbbc-69481d0ad38a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:37:39.264477 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2e7f94d2-fbcf-4efa-bbbc-69481d0ad38a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af" status: 200 len: 1681 microversion: 2.1 time: 0.158277 Jan 15 21:37:39.265109 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3833/7677] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:37:39 2022] GET /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:37:40.282878 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-681c3a2c-bc70-421b-b4dd-db49d278ef40 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:37:40.283576 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-681c3a2c-bc70-421b-b4dd-db49d278ef40 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:37:40.290877 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-681c3a2c-bc70-421b-b4dd-db49d278ef40 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:40.291326 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-681c3a2c-bc70-421b-b4dd-db49d278ef40 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:40.292105 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-681c3a2c-bc70-421b-b4dd-db49d278ef40 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:40.292574 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-681c3a2c-bc70-421b-b4dd-db49d278ef40 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:40.428171 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-681c3a2c-bc70-421b-b4dd-db49d278ef40 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:37:40.436379 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-681c3a2c-bc70-421b-b4dd-db49d278ef40 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af" status: 200 len: 1679 microversion: 2.1 time: 0.157758 Jan 15 21:37:40.436967 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3845/7678] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:37:40 2022] GET /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:37:40.658803 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-11f5edfa-0657-4896-bce7-72e337b56ef0 req-57a725e9-b97f-40b2-94fb-ed31a07448da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e727515-c789-4ce3-a870-c575fb06a6af", "tag": "3eaece6a-5dd7-4b7d-96c5-3f1558d9320c"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:37:40.660310 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:37:40.660310 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:37:40.669656 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-11f5edfa-0657-4896-bce7-72e337b56ef0 req-57a725e9-b97f-40b2-94fb-ed31a07448da service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:40.670222 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-11f5edfa-0657-4896-bce7-72e337b56ef0 req-57a725e9-b97f-40b2-94fb-ed31a07448da service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:40.682035 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-11f5edfa-0657-4896-bce7-72e337b56ef0 req-57a725e9-b97f-40b2-94fb-ed31a07448da service nova] Creating event network-changed:3eaece6a-5dd7-4b7d-96c5-3f1558d9320c for instance 8e727515-c789-4ce3-a870-c575fb06a6af on nch1-master-1 Jan 15 21:37:40.688161 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [req-11f5edfa-0657-4896-bce7-72e337b56ef0 req-57a725e9-b97f-40b2-94fb-ed31a07448da service nova] Instance 8e727515-c789-4ce3-a870-c575fb06a6af is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=129365) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Jan 15 21:37:40.698625 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-11f5edfa-0657-4896-bce7-72e337b56ef0 req-57a725e9-b97f-40b2-94fb-ed31a07448da service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043506 Jan 15 21:37:40.699230 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3834/7679] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:37:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:37:41.454681 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f7a5d6ff-e8cf-47e1-a282-f829a19da17b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:37:41.455302 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f7a5d6ff-e8cf-47e1-a282-f829a19da17b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:37:41.462437 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f7a5d6ff-e8cf-47e1-a282-f829a19da17b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:41.462896 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f7a5d6ff-e8cf-47e1-a282-f829a19da17b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:41.463716 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f7a5d6ff-e8cf-47e1-a282-f829a19da17b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:41.464137 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f7a5d6ff-e8cf-47e1-a282-f829a19da17b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:41.607211 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-f7a5d6ff-e8cf-47e1-a282-f829a19da17b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:37:41.615124 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f7a5d6ff-e8cf-47e1-a282-f829a19da17b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af" status: 200 len: 1676 microversion: 2.1 time: 0.164775 Jan 15 21:37:41.615746 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3846/7680] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:37:41 2022] GET /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af => generated 1676 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:37:41.636759 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-92b32a90-c8ee-498c-a9fc-3b0003edf86c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:37:41.637420 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-92b32a90-c8ee-498c-a9fc-3b0003edf86c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:37:41.644800 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-92b32a90-c8ee-498c-a9fc-3b0003edf86c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:41.645349 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-92b32a90-c8ee-498c-a9fc-3b0003edf86c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:41.646230 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-92b32a90-c8ee-498c-a9fc-3b0003edf86c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:41.646688 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-92b32a90-c8ee-498c-a9fc-3b0003edf86c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:41.680736 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-92b32a90-c8ee-498c-a9fc-3b0003edf86c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:41.681456 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-92b32a90-c8ee-498c-a9fc-3b0003edf86c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:41.682076 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-92b32a90-c8ee-498c-a9fc-3b0003edf86c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:41.682525 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-92b32a90-c8ee-498c-a9fc-3b0003edf86c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:41.704369 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-92b32a90-c8ee-498c-a9fc-3b0003edf86c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Getting quotas for project 2d89bb23cded412ea3ca57cc844bfabf. Resources: {'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:37:41.710035 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-92b32a90-c8ee-498c-a9fc-3b0003edf86c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Getting quotas for user b3fbd604b5a640b480e5d115e469375e and project 2d89bb23cded412ea3ca57cc844bfabf. Resources: {'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:37:41.819690 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-92b32a90-c8ee-498c-a9fc-3b0003edf86c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action" status: 202 len: 0 microversion: 2.1 time: 0.186736 Jan 15 21:37:41.820491 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3835/7681] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:37:41 2022] POST /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af/action => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:37:41.830052 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-dc2b21dd-5c5f-4ffb-ac30-adc5df86d4c2 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:37:41.830771 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-dc2b21dd-5c5f-4ffb-ac30-adc5df86d4c2 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:37:41.837688 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dc2b21dd-5c5f-4ffb-ac30-adc5df86d4c2 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:41.838189 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dc2b21dd-5c5f-4ffb-ac30-adc5df86d4c2 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:41.839248 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dc2b21dd-5c5f-4ffb-ac30-adc5df86d4c2 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:41.839913 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dc2b21dd-5c5f-4ffb-ac30-adc5df86d4c2 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:41.982868 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-dc2b21dd-5c5f-4ffb-ac30-adc5df86d4c2 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:37:41.990485 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-dc2b21dd-5c5f-4ffb-ac30-adc5df86d4c2 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af" status: 200 len: 1675 microversion: 2.1 time: 0.165973 Jan 15 21:37:41.991075 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3847/7682] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:37:41 2022] GET /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af => generated 1675 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:37:43.010748 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-7400ca5e-123e-4fca-837c-f377ef3ebaf5 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:37:43.011847 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-7400ca5e-123e-4fca-837c-f377ef3ebaf5 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:37:43.019437 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7400ca5e-123e-4fca-837c-f377ef3ebaf5 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:43.019893 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7400ca5e-123e-4fca-837c-f377ef3ebaf5 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:43.020690 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7400ca5e-123e-4fca-837c-f377ef3ebaf5 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:43.021170 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7400ca5e-123e-4fca-837c-f377ef3ebaf5 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:43.156041 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-7400ca5e-123e-4fca-837c-f377ef3ebaf5 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:37:43.163965 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-7400ca5e-123e-4fca-837c-f377ef3ebaf5 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af" status: 200 len: 1675 microversion: 2.1 time: 0.158792 Jan 15 21:37:43.164931 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3836/7683] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:37:43 2022] GET /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af => generated 1675 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:37:44.181400 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f30f4fc6-b8ab-4fd4-9ebc-dc2aca1ab2c8 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:37:44.182141 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f30f4fc6-b8ab-4fd4-9ebc-dc2aca1ab2c8 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:37:44.189293 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f30f4fc6-b8ab-4fd4-9ebc-dc2aca1ab2c8 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:44.189740 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f30f4fc6-b8ab-4fd4-9ebc-dc2aca1ab2c8 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:44.190529 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f30f4fc6-b8ab-4fd4-9ebc-dc2aca1ab2c8 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:44.191041 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f30f4fc6-b8ab-4fd4-9ebc-dc2aca1ab2c8 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:44.331484 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-f30f4fc6-b8ab-4fd4-9ebc-dc2aca1ab2c8 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:37:44.338958 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f30f4fc6-b8ab-4fd4-9ebc-dc2aca1ab2c8 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af" status: 200 len: 1675 microversion: 2.1 time: 0.161450 Jan 15 21:37:44.339533 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3848/7684] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:37:44 2022] GET /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af => generated 1675 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:37:45.283239 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-55cbbbb1-bea0-48a0-9792-547d60beb6db req-30725e1c-db5d-4ee4-bbbd-2dc811de62a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e727515-c789-4ce3-a870-c575fb06a6af", "tag": "3eaece6a-5dd7-4b7d-96c5-3f1558d9320c"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:37:45.285747 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:37:45.285747 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:37:45.295572 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-55cbbbb1-bea0-48a0-9792-547d60beb6db req-30725e1c-db5d-4ee4-bbbd-2dc811de62a7 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:45.296321 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-55cbbbb1-bea0-48a0-9792-547d60beb6db req-30725e1c-db5d-4ee4-bbbd-2dc811de62a7 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:45.311619 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-55cbbbb1-bea0-48a0-9792-547d60beb6db req-30725e1c-db5d-4ee4-bbbd-2dc811de62a7 service nova] Creating event network-changed:3eaece6a-5dd7-4b7d-96c5-3f1558d9320c for instance 8e727515-c789-4ce3-a870-c575fb06a6af on nch2-master-1 Jan 15 21:37:45.318366 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [req-55cbbbb1-bea0-48a0-9792-547d60beb6db req-30725e1c-db5d-4ee4-bbbd-2dc811de62a7 service nova] Instance 8e727515-c789-4ce3-a870-c575fb06a6af is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=129365) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Jan 15 21:37:45.334478 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-55cbbbb1-bea0-48a0-9792-547d60beb6db req-30725e1c-db5d-4ee4-bbbd-2dc811de62a7 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064978 Jan 15 21:37:45.335132 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3837/7685] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:37:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:37:45.358632 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-10b12588-cdbb-4a7d-a545-03f6d4710cf4 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:37:45.359425 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-10b12588-cdbb-4a7d-a545-03f6d4710cf4 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:37:45.367161 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-10b12588-cdbb-4a7d-a545-03f6d4710cf4 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:45.367610 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-10b12588-cdbb-4a7d-a545-03f6d4710cf4 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:45.368448 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-10b12588-cdbb-4a7d-a545-03f6d4710cf4 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:45.368914 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-10b12588-cdbb-4a7d-a545-03f6d4710cf4 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:45.516228 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-10b12588-cdbb-4a7d-a545-03f6d4710cf4 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:37:45.524073 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-10b12588-cdbb-4a7d-a545-03f6d4710cf4 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af" status: 200 len: 1675 microversion: 2.1 time: 0.170759 Jan 15 21:37:45.524601 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3849/7686] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:37:45 2022] GET /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af => generated 1675 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:37:46.542668 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c6c68de5-fc3b-40f2-8482-b184c37cf66d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:37:46.543512 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c6c68de5-fc3b-40f2-8482-b184c37cf66d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:37:46.550300 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c6c68de5-fc3b-40f2-8482-b184c37cf66d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:46.550770 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c6c68de5-fc3b-40f2-8482-b184c37cf66d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:46.551580 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c6c68de5-fc3b-40f2-8482-b184c37cf66d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:46.552037 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c6c68de5-fc3b-40f2-8482-b184c37cf66d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:46.687771 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-c6c68de5-fc3b-40f2-8482-b184c37cf66d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:37:46.695300 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c6c68de5-fc3b-40f2-8482-b184c37cf66d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af" status: 200 len: 1675 microversion: 2.1 time: 0.157577 Jan 15 21:37:46.695914 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3838/7687] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:37:46 2022] GET /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af => generated 1675 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:37:47.711436 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a01fa3a1-c85a-4f8c-b7f8-b55e75381de7 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:37:47.712045 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a01fa3a1-c85a-4f8c-b7f8-b55e75381de7 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:37:47.719345 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a01fa3a1-c85a-4f8c-b7f8-b55e75381de7 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:47.719801 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a01fa3a1-c85a-4f8c-b7f8-b55e75381de7 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:47.720587 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a01fa3a1-c85a-4f8c-b7f8-b55e75381de7 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:47.721087 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a01fa3a1-c85a-4f8c-b7f8-b55e75381de7 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:47.864227 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-a01fa3a1-c85a-4f8c-b7f8-b55e75381de7 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:37:47.872617 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a01fa3a1-c85a-4f8c-b7f8-b55e75381de7 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af" status: 200 len: 1675 microversion: 2.1 time: 0.164310 Jan 15 21:37:47.873386 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3850/7688] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:37:47 2022] GET /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af => generated 1675 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:37:48.891995 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-0cc91ce3-b2f1-4837-813a-f2d1017a36ff tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:37:48.892617 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-0cc91ce3-b2f1-4837-813a-f2d1017a36ff tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:37:48.900134 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0cc91ce3-b2f1-4837-813a-f2d1017a36ff tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:48.900642 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0cc91ce3-b2f1-4837-813a-f2d1017a36ff tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:48.901419 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0cc91ce3-b2f1-4837-813a-f2d1017a36ff tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:48.901869 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0cc91ce3-b2f1-4837-813a-f2d1017a36ff tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:49.032628 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-0cc91ce3-b2f1-4837-813a-f2d1017a36ff tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:37:49.040362 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-0cc91ce3-b2f1-4837-813a-f2d1017a36ff tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af" status: 200 len: 1668 microversion: 2.1 time: 0.153103 Jan 15 21:37:49.040955 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3839/7689] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:37:48 2022] GET /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af => generated 1668 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:37:49.056333 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a4382912-1164-4112-954c-5d61bcd3d050 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:37:49.056963 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a4382912-1164-4112-954c-5d61bcd3d050 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:37:49.064238 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a4382912-1164-4112-954c-5d61bcd3d050 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:49.064684 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a4382912-1164-4112-954c-5d61bcd3d050 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:49.065491 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a4382912-1164-4112-954c-5d61bcd3d050 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:49.065926 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a4382912-1164-4112-954c-5d61bcd3d050 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:49.203668 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-a4382912-1164-4112-954c-5d61bcd3d050 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:37:49.211224 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a4382912-1164-4112-954c-5d61bcd3d050 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af" status: 200 len: 1668 microversion: 2.1 time: 0.158651 Jan 15 21:37:49.211790 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3851/7690] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:37:49 2022] GET /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af => generated 1668 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:37:49.227015 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a2c668ca-1d52-4b3d-939a-be3ba5695afd tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:37:49.227551 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a2c668ca-1d52-4b3d-939a-be3ba5695afd tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:37:49.234442 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a2c668ca-1d52-4b3d-939a-be3ba5695afd tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:49.234904 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a2c668ca-1d52-4b3d-939a-be3ba5695afd tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:49.235696 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a2c668ca-1d52-4b3d-939a-be3ba5695afd tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:49.236346 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a2c668ca-1d52-4b3d-939a-be3ba5695afd tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:49.372706 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-a2c668ca-1d52-4b3d-939a-be3ba5695afd tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:37:49.380646 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a2c668ca-1d52-4b3d-939a-be3ba5695afd tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af" status: 200 len: 1668 microversion: 2.1 time: 0.157207 Jan 15 21:37:49.381676 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3840/7691] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:37:49 2022] GET /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af => generated 1668 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:37:49.401045 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-fa7371a4-b074-4d00-9e5e-4cf2e6ff5483 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:37:49.401545 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-fa7371a4-b074-4d00-9e5e-4cf2e6ff5483 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:37:49.408428 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fa7371a4-b074-4d00-9e5e-4cf2e6ff5483 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:49.408908 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fa7371a4-b074-4d00-9e5e-4cf2e6ff5483 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:49.409691 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fa7371a4-b074-4d00-9e5e-4cf2e6ff5483 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:49.410127 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fa7371a4-b074-4d00-9e5e-4cf2e6ff5483 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:49.437205 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-fa7371a4-b074-4d00-9e5e-4cf2e6ff5483 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Going to try to terminate instance {{(pid=129366) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 21:37:49.510890 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-fa7371a4-b074-4d00-9e5e-4cf2e6ff5483 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "DELETE /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af" status: 204 len: 0 microversion: 2.1 time: 0.113266 Jan 15 21:37:49.511523 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3852/7692] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 21:37:49 2022] DELETE /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 21:37:49.520627 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-6af39d6f-2e2d-4fed-b136-a0a34cd934a1 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:37:49.521269 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-6af39d6f-2e2d-4fed-b136-a0a34cd934a1 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:37:49.527203 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6af39d6f-2e2d-4fed-b136-a0a34cd934a1 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:49.527664 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6af39d6f-2e2d-4fed-b136-a0a34cd934a1 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:49.529307 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6af39d6f-2e2d-4fed-b136-a0a34cd934a1 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:49.529545 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6af39d6f-2e2d-4fed-b136-a0a34cd934a1 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:49.662973 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-6af39d6f-2e2d-4fed-b136-a0a34cd934a1 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:37:49.671317 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-6af39d6f-2e2d-4fed-b136-a0a34cd934a1 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af" status: 200 len: 1674 microversion: 2.1 time: 0.154764 Jan 15 21:37:49.671902 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3841/7693] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:37:49 2022] GET /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af => generated 1674 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:37:50.689232 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-75d4639a-bd23-4098-90e9-e376f9183ab4 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:37:50.689957 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-75d4639a-bd23-4098-90e9-e376f9183ab4 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:37:50.696754 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-75d4639a-bd23-4098-90e9-e376f9183ab4 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:50.697255 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-75d4639a-bd23-4098-90e9-e376f9183ab4 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:50.698048 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-75d4639a-bd23-4098-90e9-e376f9183ab4 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:50.698484 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-75d4639a-bd23-4098-90e9-e376f9183ab4 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:50.841500 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-75d4639a-bd23-4098-90e9-e376f9183ab4 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:37:50.849059 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-75d4639a-bd23-4098-90e9-e376f9183ab4 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af" status: 200 len: 1674 microversion: 2.1 time: 0.163919 Jan 15 21:37:50.849645 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3853/7694] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:37:50 2022] GET /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af => generated 1674 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:37:50.953664 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-33cad8c3-01af-477d-aec8-c3852de2e799 req-2d1e1856-10ed-42a4-8cbb-a35aceb68562 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e727515-c789-4ce3-a870-c575fb06a6af", "name": "network-vif-plugged", "status": "completed", "tag": "3eaece6a-5dd7-4b7d-96c5-3f1558d9320c"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:37:50.955371 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:37:50.955371 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:37:50.962823 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-33cad8c3-01af-477d-aec8-c3852de2e799 req-2d1e1856-10ed-42a4-8cbb-a35aceb68562 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:50.963324 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-33cad8c3-01af-477d-aec8-c3852de2e799 req-2d1e1856-10ed-42a4-8cbb-a35aceb68562 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:50.975307 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-33cad8c3-01af-477d-aec8-c3852de2e799 req-2d1e1856-10ed-42a4-8cbb-a35aceb68562 service nova] Creating event network-vif-plugged:3eaece6a-5dd7-4b7d-96c5-3f1558d9320c for instance 8e727515-c789-4ce3-a870-c575fb06a6af on nch2-master-1 Jan 15 21:37:50.980124 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-33cad8c3-01af-477d-aec8-c3852de2e799 req-2d1e1856-10ed-42a4-8cbb-a35aceb68562 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094611 Jan 15 21:37:50.980923 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3842/7695] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:37:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:37:51.795811 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-cac2217c-c678-4d8e-b6d0-f543f4a8ad2a req-d5166249-22ee-4ada-81d1-b63862caba52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e727515-c789-4ce3-a870-c575fb06a6af", "name": "network-vif-deleted", "tag": "3eaece6a-5dd7-4b7d-96c5-3f1558d9320c"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:37:51.797917 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:37:51.797917 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:37:51.809422 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-cac2217c-c678-4d8e-b6d0-f543f4a8ad2a req-d5166249-22ee-4ada-81d1-b63862caba52 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:51.810265 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-cac2217c-c678-4d8e-b6d0-f543f4a8ad2a req-d5166249-22ee-4ada-81d1-b63862caba52 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:51.823734 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-cac2217c-c678-4d8e-b6d0-f543f4a8ad2a req-d5166249-22ee-4ada-81d1-b63862caba52 service nova] Creating event network-vif-deleted:3eaece6a-5dd7-4b7d-96c5-3f1558d9320c for instance 8e727515-c789-4ce3-a870-c575fb06a6af on nch2-master-1 Jan 15 21:37:51.830324 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-cac2217c-c678-4d8e-b6d0-f543f4a8ad2a req-d5166249-22ee-4ada-81d1-b63862caba52 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038945 Jan 15 21:37:51.830948 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3854/7696] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:37:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:37:51.867333 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e496dc0d-11c5-43b5-be21-5c84ff701deb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:37:51.868715 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e496dc0d-11c5-43b5-be21-5c84ff701deb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:37:51.876731 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e496dc0d-11c5-43b5-be21-5c84ff701deb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:51.877244 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e496dc0d-11c5-43b5-be21-5c84ff701deb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:51.878776 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e496dc0d-11c5-43b5-be21-5c84ff701deb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:51.879261 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e496dc0d-11c5-43b5-be21-5c84ff701deb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:51.922901 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e496dc0d-11c5-43b5-be21-5c84ff701deb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:51.923921 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e496dc0d-11c5-43b5-be21-5c84ff701deb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:51.925314 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.objects.instance [None req-e496dc0d-11c5-43b5-be21-5c84ff701deb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lazy-loading 'fault' on Instance uuid 8e727515-c789-4ce3-a870-c575fb06a6af {{(pid=129365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 21:37:51.964888 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-e496dc0d-11c5-43b5-be21-5c84ff701deb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:37:51.972958 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e496dc0d-11c5-43b5-be21-5c84ff701deb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af" status: 200 len: 1327 microversion: 2.1 time: 0.109805 Jan 15 21:37:51.973545 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3843/7697] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:37:51 2022] GET /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af => generated 1327 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:37:52.991637 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-324758e7-bad2-4dd5-96da-78008e6cb451 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:37:52.992345 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-324758e7-bad2-4dd5-96da-78008e6cb451 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:37:52.999843 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-324758e7-bad2-4dd5-96da-78008e6cb451 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:53.000298 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-324758e7-bad2-4dd5-96da-78008e6cb451 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:53.001122 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-324758e7-bad2-4dd5-96da-78008e6cb451 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:53.001567 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-324758e7-bad2-4dd5-96da-78008e6cb451 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:53.015612 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-324758e7-bad2-4dd5-96da-78008e6cb451 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] HTTP exception thrown: Instance 8e727515-c789-4ce3-a870-c575fb06a6af could not be found. Jan 15 21:37:53.016198 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-324758e7-bad2-4dd5-96da-78008e6cb451 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Returning 404 to user: Instance 8e727515-c789-4ce3-a870-c575fb06a6af could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:37:53.017053 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-324758e7-bad2-4dd5-96da-78008e6cb451 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af" status: 404 len: 111 microversion: 2.1 time: 0.029523 Jan 15 21:37:53.017590 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3855/7698] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:37:52 2022] GET /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:37:53.071157 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-4f1b6957-0deb-4583-8f2c-7d94c2bf9400 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:37:53.071788 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-4f1b6957-0deb-4583-8f2c-7d94c2bf9400 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:37:53.079321 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4f1b6957-0deb-4583-8f2c-7d94c2bf9400 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:53.079792 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4f1b6957-0deb-4583-8f2c-7d94c2bf9400 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:53.080596 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4f1b6957-0deb-4583-8f2c-7d94c2bf9400 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:53.081087 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4f1b6957-0deb-4583-8f2c-7d94c2bf9400 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:53.095239 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-4f1b6957-0deb-4583-8f2c-7d94c2bf9400 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] HTTP exception thrown: Instance 8e727515-c789-4ce3-a870-c575fb06a6af could not be found. Jan 15 21:37:53.095841 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-4f1b6957-0deb-4583-8f2c-7d94c2bf9400 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Returning 404 to user: Instance 8e727515-c789-4ce3-a870-c575fb06a6af could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:37:53.096681 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-4f1b6957-0deb-4583-8f2c-7d94c2bf9400 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af" status: 404 len: 111 microversion: 2.1 time: 0.029326 Jan 15 21:37:53.097257 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3844/7699] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:37:53 2022] GET /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:37:53.142751 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f0325b75-5465-413c-b896-522132939033 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-322859185", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "networks": [{"uuid": "72520288-27af-458f-aef8-ae08e1543c11"}], "security_groups": [{"name": "tempest-securitygroup--1432803138"}], "key_name": "tempest-keypair-176324375", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:37:53.242409 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.network.neutron [None req-f0325b75-5465-413c-b896-522132939033 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] validate_networks() for [('72520288-27af-458f-aef8-ae08e1543c11', None, None, None, None, None)] {{(pid=129366) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 21:37:53.706059 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-f0325b75-5465-413c-b896-522132939033 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Flavor limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 21:37:53.706482 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-f0325b75-5465-413c-b896-522132939033 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Image limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 21:37:53.706977 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-f0325b75-5465-413c-b896-522132939033 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Flavor pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 21:37:53.707383 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-f0325b75-5465-413c-b896-522132939033 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Image pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 21:37:53.707817 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-f0325b75-5465-413c-b896-522132939033 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 21:37:53.717221 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f0325b75-5465-413c-b896-522132939033 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:53.717669 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f0325b75-5465-413c-b896-522132939033 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:53.718480 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f0325b75-5465-413c-b896-522132939033 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:53.718912 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f0325b75-5465-413c-b896-522132939033 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:53.735932 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-f0325b75-5465-413c-b896-522132939033 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Getting quotas for project 2d89bb23cded412ea3ca57cc844bfabf. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:37:53.741221 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-f0325b75-5465-413c-b896-522132939033 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Getting quotas for user b3fbd604b5a640b480e5d115e469375e and project 2d89bb23cded412ea3ca57cc844bfabf. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:37:53.755190 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f0325b75-5465-413c-b896-522132939033 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Going to run 1 instances... {{(pid=129366) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 21:37:53.757501 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f0325b75-5465-413c-b896-522132939033 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 21:37:53.803919 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f0325b75-5465-413c-b896-522132939033 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.664861 Jan 15 21:37:53.805210 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3856/7700] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 21:37:53 2022] POST /compute/v2.1/servers => generated 406 bytes in 667 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 21:37:53.815121 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-630f9ee7-9797-4b84-890d-bd4c6dbcabc4 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:37:53.815734 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-630f9ee7-9797-4b84-890d-bd4c6dbcabc4 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:37:53.865846 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-630f9ee7-9797-4b84-890d-bd4c6dbcabc4 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:37:53.872964 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-630f9ee7-9797-4b84-890d-bd4c6dbcabc4 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af" status: 200 len: 1237 microversion: 2.1 time: 0.061562 Jan 15 21:37:53.873536 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3845/7701] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:37:53 2022] GET /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af => generated 1237 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:37:54.891045 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b049b0bf-8d6d-441c-b667-47e77e8b686c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:37:54.891772 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b049b0bf-8d6d-441c-b667-47e77e8b686c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:37:54.944313 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-b049b0bf-8d6d-441c-b667-47e77e8b686c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:37:54.951143 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b049b0bf-8d6d-441c-b667-47e77e8b686c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af" status: 200 len: 1237 microversion: 2.1 time: 0.064901 Jan 15 21:37:54.951804 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3857/7702] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:37:54 2022] GET /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af => generated 1237 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:37:55.968699 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ce5d004e-0fdb-43c4-adb0-d958f6098163 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:37:55.969368 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ce5d004e-0fdb-43c4-adb0-d958f6098163 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:37:56.028425 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-ce5d004e-0fdb-43c4-adb0-d958f6098163 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:37:56.036064 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ce5d004e-0fdb-43c4-adb0-d958f6098163 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af" status: 200 len: 1237 microversion: 2.1 time: 0.071214 Jan 15 21:37:56.036799 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3846/7703] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:37:55 2022] GET /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af => generated 1237 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:37:57.054373 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-631480f3-38d3-41c6-b013-2515217aab69 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:37:57.054987 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-631480f3-38d3-41c6-b013-2515217aab69 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:37:57.106948 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-631480f3-38d3-41c6-b013-2515217aab69 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:37:57.113528 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-631480f3-38d3-41c6-b013-2515217aab69 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af" status: 200 len: 1237 microversion: 2.1 time: 0.062991 Jan 15 21:37:57.114105 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3858/7704] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:37:57 2022] GET /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af => generated 1237 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:37:58.131571 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b4882d74-db00-47e7-8552-56020c757876 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:37:58.132190 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b4882d74-db00-47e7-8552-56020c757876 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:37:58.139854 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b4882d74-db00-47e7-8552-56020c757876 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:58.140313 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b4882d74-db00-47e7-8552-56020c757876 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:58.141134 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b4882d74-db00-47e7-8552-56020c757876 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:58.141583 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b4882d74-db00-47e7-8552-56020c757876 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:58.200903 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-b4882d74-db00-47e7-8552-56020c757876 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:37:58.208157 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b4882d74-db00-47e7-8552-56020c757876 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af" status: 200 len: 1241 microversion: 2.1 time: 0.080567 Jan 15 21:37:58.208717 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3847/7705] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:37:58 2022] GET /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af => generated 1241 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:37:59.226520 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1da999eb-ec9c-44b7-877b-0f3caa7a8a55 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:37:59.227141 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-1da999eb-ec9c-44b7-877b-0f3caa7a8a55 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:37:59.236022 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1da999eb-ec9c-44b7-877b-0f3caa7a8a55 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:59.236480 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1da999eb-ec9c-44b7-877b-0f3caa7a8a55 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:59.237306 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1da999eb-ec9c-44b7-877b-0f3caa7a8a55 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:37:59.237740 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1da999eb-ec9c-44b7-877b-0f3caa7a8a55 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:37:59.303745 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-1da999eb-ec9c-44b7-877b-0f3caa7a8a55 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:37:59.312524 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-1da999eb-ec9c-44b7-877b-0f3caa7a8a55 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af" status: 200 len: 1295 microversion: 2.1 time: 0.089640 Jan 15 21:37:59.313178 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3859/7706] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:37:59 2022] GET /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af => generated 1295 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:38:00.330798 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e4230e70-39e7-4e4d-a398-3f93c385e8c6 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:38:00.333366 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e4230e70-39e7-4e4d-a398-3f93c385e8c6 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:38:00.342363 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e4230e70-39e7-4e4d-a398-3f93c385e8c6 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:38:00.342929 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e4230e70-39e7-4e4d-a398-3f93c385e8c6 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:38:00.343856 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e4230e70-39e7-4e4d-a398-3f93c385e8c6 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:38:00.344379 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e4230e70-39e7-4e4d-a398-3f93c385e8c6 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:38:00.456094 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-5fd5f31e-dafa-4e8d-80ec-cbb0911d2947 req-cce87f41-b31a-4e10-8d0b-9de69a1b013e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af", "tag": "ee473c50-b3e4-41c2-8cc4-886638a28c50"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:38:00.458068 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:38:00.458068 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:38:00.487921 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-5fd5f31e-dafa-4e8d-80ec-cbb0911d2947 req-cce87f41-b31a-4e10-8d0b-9de69a1b013e service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:38:00.488373 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-5fd5f31e-dafa-4e8d-80ec-cbb0911d2947 req-cce87f41-b31a-4e10-8d0b-9de69a1b013e service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:38:00.515112 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-e4230e70-39e7-4e4d-a398-3f93c385e8c6 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:38:00.516478 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-5fd5f31e-dafa-4e8d-80ec-cbb0911d2947 req-cce87f41-b31a-4e10-8d0b-9de69a1b013e service nova] Creating event network-changed:ee473c50-b3e4-41c2-8cc4-886638a28c50 for instance 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af on nch1-master-1 Jan 15 21:38:00.522174 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-5fd5f31e-dafa-4e8d-80ec-cbb0911d2947 req-cce87f41-b31a-4e10-8d0b-9de69a1b013e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074721 Jan 15 21:38:00.523132 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e4230e70-39e7-4e4d-a398-3f93c385e8c6 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af" status: 200 len: 1363 microversion: 2.1 time: 0.196009 Jan 15 21:38:00.523552 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3860/7707] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:38:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:38:00.524127 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3848/7708] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:38:00 2022] GET /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af => generated 1363 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:38:01.541599 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-3c5fecfb-b78a-47fb-a67f-122d0cf9144f tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:38:01.542226 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-3c5fecfb-b78a-47fb-a67f-122d0cf9144f tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:38:01.549359 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3c5fecfb-b78a-47fb-a67f-122d0cf9144f tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:38:01.549816 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3c5fecfb-b78a-47fb-a67f-122d0cf9144f tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:38:01.550602 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3c5fecfb-b78a-47fb-a67f-122d0cf9144f tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:38:01.551044 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3c5fecfb-b78a-47fb-a67f-122d0cf9144f tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:38:01.683455 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-3c5fecfb-b78a-47fb-a67f-122d0cf9144f tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:38:01.691315 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-3c5fecfb-b78a-47fb-a67f-122d0cf9144f tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af" status: 200 len: 1363 microversion: 2.1 time: 0.153905 Jan 15 21:38:01.691892 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3861/7709] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:38:01 2022] GET /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:38:02.709256 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2fdc11fe-c872-4674-ba67-89353384b8f0 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:38:02.709885 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-2fdc11fe-c872-4674-ba67-89353384b8f0 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:38:02.716903 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2fdc11fe-c872-4674-ba67-89353384b8f0 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:38:02.717379 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2fdc11fe-c872-4674-ba67-89353384b8f0 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:38:02.718179 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2fdc11fe-c872-4674-ba67-89353384b8f0 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:38:02.718668 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2fdc11fe-c872-4674-ba67-89353384b8f0 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:38:02.849327 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-2fdc11fe-c872-4674-ba67-89353384b8f0 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:38:02.857245 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2fdc11fe-c872-4674-ba67-89353384b8f0 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af" status: 200 len: 1363 microversion: 2.1 time: 0.151746 Jan 15 21:38:02.857840 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3849/7710] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:38:02 2022] GET /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:38:03.874478 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b2e50a58-77d4-41f5-b100-0d4d614a5509 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:38:03.875075 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b2e50a58-77d4-41f5-b100-0d4d614a5509 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:38:03.881924 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b2e50a58-77d4-41f5-b100-0d4d614a5509 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:38:03.882373 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b2e50a58-77d4-41f5-b100-0d4d614a5509 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:38:03.883146 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b2e50a58-77d4-41f5-b100-0d4d614a5509 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:38:03.883578 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b2e50a58-77d4-41f5-b100-0d4d614a5509 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:38:04.014921 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-b2e50a58-77d4-41f5-b100-0d4d614a5509 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:38:04.022475 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b2e50a58-77d4-41f5-b100-0d4d614a5509 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af" status: 200 len: 1363 microversion: 2.1 time: 0.151716 Jan 15 21:38:04.023053 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3862/7711] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:38:03 2022] GET /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:38:05.041148 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-970bcad8-bfdd-4636-9f3d-345b8fb3666a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:38:05.041883 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-970bcad8-bfdd-4636-9f3d-345b8fb3666a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:38:05.049858 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-970bcad8-bfdd-4636-9f3d-345b8fb3666a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:38:05.050345 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-970bcad8-bfdd-4636-9f3d-345b8fb3666a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:38:05.051208 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-970bcad8-bfdd-4636-9f3d-345b8fb3666a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:38:05.051657 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-970bcad8-bfdd-4636-9f3d-345b8fb3666a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:38:05.183819 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-970bcad8-bfdd-4636-9f3d-345b8fb3666a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:38:05.186081 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-30570f24-80e0-476b-aea4-e5afcfd3302d req-fe9b17e1-7a7c-4c53-b605-15a852551a30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af", "name": "network-vif-plugged", "status": "completed", "tag": "ee473c50-b3e4-41c2-8cc4-886638a28c50"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:38:05.188191 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:38:05.188191 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:38:05.192273 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-970bcad8-bfdd-4636-9f3d-345b8fb3666a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af" status: 200 len: 1363 microversion: 2.1 time: 0.154786 Jan 15 21:38:05.193069 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3850/7712] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:38:05 2022] GET /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:38:05.196214 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-30570f24-80e0-476b-aea4-e5afcfd3302d req-fe9b17e1-7a7c-4c53-b605-15a852551a30 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:38:05.196867 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-30570f24-80e0-476b-aea4-e5afcfd3302d req-fe9b17e1-7a7c-4c53-b605-15a852551a30 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:38:05.208488 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-30570f24-80e0-476b-aea4-e5afcfd3302d req-fe9b17e1-7a7c-4c53-b605-15a852551a30 service nova] Creating event network-vif-plugged:ee473c50-b3e4-41c2-8cc4-886638a28c50 for instance 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af on nch1-master-1 Jan 15 21:38:05.213670 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-30570f24-80e0-476b-aea4-e5afcfd3302d req-fe9b17e1-7a7c-4c53-b605-15a852551a30 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031944 Jan 15 21:38:05.214829 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3863/7713] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:38:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 21:38:06.211592 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2696cb77-8e14-4e44-90a9-ed0f111b0336 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:38:06.212211 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-2696cb77-8e14-4e44-90a9-ed0f111b0336 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:38:06.219592 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2696cb77-8e14-4e44-90a9-ed0f111b0336 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:38:06.220055 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2696cb77-8e14-4e44-90a9-ed0f111b0336 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:38:06.220928 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2696cb77-8e14-4e44-90a9-ed0f111b0336 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:38:06.221310 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2696cb77-8e14-4e44-90a9-ed0f111b0336 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:38:06.354546 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-2696cb77-8e14-4e44-90a9-ed0f111b0336 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:38:06.367124 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2696cb77-8e14-4e44-90a9-ed0f111b0336 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af" status: 200 len: 1363 microversion: 2.1 time: 0.159211 Jan 15 21:38:06.367703 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3851/7714] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:38:06 2022] GET /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:38:07.385951 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0516c73e-aeb3-4ff0-a571-e57a7f1ebae9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:38:07.386646 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-0516c73e-aeb3-4ff0-a571-e57a7f1ebae9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:38:07.393613 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0516c73e-aeb3-4ff0-a571-e57a7f1ebae9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:38:07.394069 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0516c73e-aeb3-4ff0-a571-e57a7f1ebae9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:38:07.394841 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0516c73e-aeb3-4ff0-a571-e57a7f1ebae9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:38:07.395276 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0516c73e-aeb3-4ff0-a571-e57a7f1ebae9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:38:07.532016 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-0516c73e-aeb3-4ff0-a571-e57a7f1ebae9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:38:07.539782 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0516c73e-aeb3-4ff0-a571-e57a7f1ebae9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af" status: 200 len: 1549 microversion: 2.1 time: 0.158776 Jan 15 21:38:07.540364 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3864/7715] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:38:07 2022] GET /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af => generated 1549 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:38:07.556210 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d56ae324-a5c8-4986-bb19-6a728b3b0c5d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:38:07.556734 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d56ae324-a5c8-4986-bb19-6a728b3b0c5d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:38:07.564168 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d56ae324-a5c8-4986-bb19-6a728b3b0c5d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:38:07.564661 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d56ae324-a5c8-4986-bb19-6a728b3b0c5d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:38:07.565503 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d56ae324-a5c8-4986-bb19-6a728b3b0c5d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:38:07.565960 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d56ae324-a5c8-4986-bb19-6a728b3b0c5d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:38:07.645368 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d56ae324-a5c8-4986-bb19-6a728b3b0c5d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092723 Jan 15 21:38:07.645985 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3852/7716] 10.222.0.46 () {58 vars in 1274 bytes} [Sat Jan 15 21:38:07 2022] GET /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:38:08.600263 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-fcfd6422-6081-4389-bbf5-2afe858e69ec tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:38:08.601212 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-fcfd6422-6081-4389-bbf5-2afe858e69ec tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:38:08.609181 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fcfd6422-6081-4389-bbf5-2afe858e69ec tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:38:08.609770 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fcfd6422-6081-4389-bbf5-2afe858e69ec tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:38:08.610582 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fcfd6422-6081-4389-bbf5-2afe858e69ec tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:38:08.611029 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fcfd6422-6081-4389-bbf5-2afe858e69ec tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:38:08.650832 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-fcfd6422-6081-4389-bbf5-2afe858e69ec tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action" status: 200 len: 14 microversion: 2.1 time: 0.054072 Jan 15 21:38:08.651500 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3865/7717] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:38:08 2022] POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action => generated 14 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 21:38:08.667051 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-f9b4f7d7-cb94-4fb5-8f9d-5ef62b60838f req-c8b2b61e-a4d1-457e-9c64-750500e5c2ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af", "tag": "ee473c50-b3e4-41c2-8cc4-886638a28c50"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:38:08.669675 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:38:08.669675 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:38:08.678103 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-f9b4f7d7-cb94-4fb5-8f9d-5ef62b60838f req-c8b2b61e-a4d1-457e-9c64-750500e5c2ad service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:38:08.678561 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-f9b4f7d7-cb94-4fb5-8f9d-5ef62b60838f req-c8b2b61e-a4d1-457e-9c64-750500e5c2ad service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:38:08.690934 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-f9b4f7d7-cb94-4fb5-8f9d-5ef62b60838f req-c8b2b61e-a4d1-457e-9c64-750500e5c2ad service nova] Creating event network-changed:ee473c50-b3e4-41c2-8cc4-886638a28c50 for instance 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af on nch1-master-1 Jan 15 21:38:08.696258 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-f9b4f7d7-cb94-4fb5-8f9d-5ef62b60838f req-c8b2b61e-a4d1-457e-9c64-750500e5c2ad service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097275 Jan 15 21:38:08.697119 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3853/7718] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:38:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 21:38:09.662994 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4cbfe09a-fee1-4542-860a-20b62d981bec tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:38:09.670065 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-4cbfe09a-fee1-4542-860a-20b62d981bec tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:38:09.678553 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4cbfe09a-fee1-4542-860a-20b62d981bec tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:38:09.679055 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4cbfe09a-fee1-4542-860a-20b62d981bec tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:38:09.679866 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4cbfe09a-fee1-4542-860a-20b62d981bec tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:38:09.680310 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4cbfe09a-fee1-4542-860a-20b62d981bec tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:38:09.723985 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-4cbfe09a-fee1-4542-860a-20b62d981bec tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action" status: 200 len: 14 microversion: 2.1 time: 0.065230 Jan 15 21:38:09.727244 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3866/7719] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:38:09 2022] POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action => generated 14 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 21:38:10.735563 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-721b1eaf-6c32-4e6b-872b-3046cff643d0 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:38:10.736605 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-721b1eaf-6c32-4e6b-872b-3046cff643d0 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:38:10.743873 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-721b1eaf-6c32-4e6b-872b-3046cff643d0 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:38:10.744347 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-721b1eaf-6c32-4e6b-872b-3046cff643d0 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:38:10.745172 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-721b1eaf-6c32-4e6b-872b-3046cff643d0 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:38:10.745656 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-721b1eaf-6c32-4e6b-872b-3046cff643d0 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:38:10.783355 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-721b1eaf-6c32-4e6b-872b-3046cff643d0 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action" status: 200 len: 14 microversion: 2.1 time: 0.051753 Jan 15 21:38:10.783981 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3854/7720] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:38:10 2022] POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action => generated 14 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 21:38:11.795496 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9e0459c7-dbb3-45af-b4e3-3f69f1f49969 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:38:11.796491 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-9e0459c7-dbb3-45af-b4e3-3f69f1f49969 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:38:11.803777 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9e0459c7-dbb3-45af-b4e3-3f69f1f49969 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:38:11.804231 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9e0459c7-dbb3-45af-b4e3-3f69f1f49969 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:38:11.805037 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9e0459c7-dbb3-45af-b4e3-3f69f1f49969 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:38:11.805476 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9e0459c7-dbb3-45af-b4e3-3f69f1f49969 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:38:11.843124 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-9e0459c7-dbb3-45af-b4e3-3f69f1f49969 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action" status: 200 len: 14 microversion: 2.1 time: 0.051615 Jan 15 21:38:11.843740 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3867/7721] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:38:11 2022] POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action => generated 14 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 21:38:12.854471 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-6a28e506-7ea8-4051-ba1f-f3832e637cd6 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:38:12.855508 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-6a28e506-7ea8-4051-ba1f-f3832e637cd6 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:38:12.863520 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6a28e506-7ea8-4051-ba1f-f3832e637cd6 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:38:12.863983 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6a28e506-7ea8-4051-ba1f-f3832e637cd6 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:38:12.864770 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6a28e506-7ea8-4051-ba1f-f3832e637cd6 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:38:12.865241 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6a28e506-7ea8-4051-ba1f-f3832e637cd6 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:38:12.901373 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-6a28e506-7ea8-4051-ba1f-f3832e637cd6 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action" status: 200 len: 14 microversion: 2.1 time: 0.050823 Jan 15 21:38:12.902236 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3855/7722] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:38:12 2022] POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action => generated 14 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 15 21:38:13.913536 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-dcf6d01d-0d6a-43ce-8826-f2c3ce679581 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:38:13.914538 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-dcf6d01d-0d6a-43ce-8826-f2c3ce679581 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:38:13.922595 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dcf6d01d-0d6a-43ce-8826-f2c3ce679581 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:38:13.923050 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dcf6d01d-0d6a-43ce-8826-f2c3ce679581 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:38:13.923833 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dcf6d01d-0d6a-43ce-8826-f2c3ce679581 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:38:13.924271 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dcf6d01d-0d6a-43ce-8826-f2c3ce679581 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:38:13.961023 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-dcf6d01d-0d6a-43ce-8826-f2c3ce679581 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action" status: 200 len: 14 microversion: 2.1 time: 0.051694 Jan 15 21:38:13.961675 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3868/7723] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:38:13 2022] POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action => generated 14 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 21:38:14.972881 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-da690844-6e95-4469-b364-b11f004acd0b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:38:14.973804 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-da690844-6e95-4469-b364-b11f004acd0b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:38:14.981138 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-da690844-6e95-4469-b364-b11f004acd0b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:38:14.981592 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-da690844-6e95-4469-b364-b11f004acd0b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:38:14.982379 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-da690844-6e95-4469-b364-b11f004acd0b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:38:14.982825 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-da690844-6e95-4469-b364-b11f004acd0b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:38:15.023233 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-da690844-6e95-4469-b364-b11f004acd0b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action" status: 200 len: 14 microversion: 2.1 time: 0.054361 Jan 15 21:38:15.023886 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3856/7724] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:38:14 2022] POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action => generated 14 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 21:38:16.035210 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7d5eee02-e322-41b4-b70e-db3a0cfa0ddc tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:38:16.036222 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-7d5eee02-e322-41b4-b70e-db3a0cfa0ddc tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:38:16.044448 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7d5eee02-e322-41b4-b70e-db3a0cfa0ddc tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:38:16.044932 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7d5eee02-e322-41b4-b70e-db3a0cfa0ddc tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:38:16.045727 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7d5eee02-e322-41b4-b70e-db3a0cfa0ddc tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:38:16.046180 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7d5eee02-e322-41b4-b70e-db3a0cfa0ddc tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:38:16.083160 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7d5eee02-e322-41b4-b70e-db3a0cfa0ddc tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action" status: 200 len: 14 microversion: 2.1 time: 0.052002 Jan 15 21:38:16.083977 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3869/7725] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:38:16 2022] POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action => generated 14 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 21:38:17.094853 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5baa0d19-dca8-4af4-942b-e66d4185f5de tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:38:17.095965 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-5baa0d19-dca8-4af4-942b-e66d4185f5de tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:38:17.103171 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5baa0d19-dca8-4af4-942b-e66d4185f5de tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:38:17.103641 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5baa0d19-dca8-4af4-942b-e66d4185f5de tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:38:17.104433 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5baa0d19-dca8-4af4-942b-e66d4185f5de tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:38:17.104910 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5baa0d19-dca8-4af4-942b-e66d4185f5de tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:38:17.144790 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5baa0d19-dca8-4af4-942b-e66d4185f5de tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action" status: 200 len: 14 microversion: 2.1 time: 0.054152 Jan 15 21:38:17.145443 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3857/7726] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:38:17 2022] POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action => generated 14 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 21:38:18.156459 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d1da8cb4-ce19-4596-bf34-6304d0e4de07 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:38:18.157483 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-d1da8cb4-ce19-4596-bf34-6304d0e4de07 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:38:18.165074 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d1da8cb4-ce19-4596-bf34-6304d0e4de07 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:38:18.165522 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d1da8cb4-ce19-4596-bf34-6304d0e4de07 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:38:18.166287 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d1da8cb4-ce19-4596-bf34-6304d0e4de07 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:38:18.166718 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d1da8cb4-ce19-4596-bf34-6304d0e4de07 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:38:18.203457 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d1da8cb4-ce19-4596-bf34-6304d0e4de07 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action" status: 200 len: 14 microversion: 2.1 time: 0.050986 Jan 15 21:38:18.204083 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3870/7727] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:38:18 2022] POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action => generated 14 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 21:38:19.213944 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-40161a4a-1e04-4d98-ab33-7a36f8aa1397 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:38:19.214961 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-40161a4a-1e04-4d98-ab33-7a36f8aa1397 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:38:19.223162 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-40161a4a-1e04-4d98-ab33-7a36f8aa1397 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:38:19.223630 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-40161a4a-1e04-4d98-ab33-7a36f8aa1397 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:38:19.224431 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-40161a4a-1e04-4d98-ab33-7a36f8aa1397 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:38:19.224905 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-40161a4a-1e04-4d98-ab33-7a36f8aa1397 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:38:19.272531 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-40161a4a-1e04-4d98-ab33-7a36f8aa1397 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action" status: 200 len: 8208 microversion: 2.1 time: 0.062581 Jan 15 21:38:19.273247 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3858/7728] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:38:19 2022] POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action => generated 8208 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:38:20.284731 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-00ef3a6d-67a0-489d-9670-90325666f92f tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:38:20.285751 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-00ef3a6d-67a0-489d-9670-90325666f92f tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:38:20.293384 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-00ef3a6d-67a0-489d-9670-90325666f92f tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:38:20.294443 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-00ef3a6d-67a0-489d-9670-90325666f92f tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:38:20.295206 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-00ef3a6d-67a0-489d-9670-90325666f92f tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:38:20.295644 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-00ef3a6d-67a0-489d-9670-90325666f92f tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:38:20.344202 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-00ef3a6d-67a0-489d-9670-90325666f92f tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action" status: 200 len: 16400 microversion: 2.1 time: 0.063384 Jan 15 21:38:20.344848 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3871/7729] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:38:20 2022] POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action => generated 16400 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:38:21.355282 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-44215f2c-d277-4484-b215-220a93a79ec1 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:38:21.356534 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-44215f2c-d277-4484-b215-220a93a79ec1 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:38:21.363701 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-44215f2c-d277-4484-b215-220a93a79ec1 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:38:21.364162 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-44215f2c-d277-4484-b215-220a93a79ec1 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:38:21.364992 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-44215f2c-d277-4484-b215-220a93a79ec1 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:38:21.365439 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-44215f2c-d277-4484-b215-220a93a79ec1 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:38:21.405282 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-44215f2c-d277-4484-b215-220a93a79ec1 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action" status: 200 len: 16400 microversion: 2.1 time: 0.053981 Jan 15 21:38:21.405933 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3859/7730] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:38:21 2022] POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action => generated 16400 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:38:22.416444 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-122ba553-b5d2-4643-b283-4b0f5b24c01c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:38:22.417504 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-122ba553-b5d2-4643-b283-4b0f5b24c01c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:38:22.425765 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-122ba553-b5d2-4643-b283-4b0f5b24c01c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:38:22.426223 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-122ba553-b5d2-4643-b283-4b0f5b24c01c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:38:22.427010 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-122ba553-b5d2-4643-b283-4b0f5b24c01c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:38:22.427452 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-122ba553-b5d2-4643-b283-4b0f5b24c01c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:38:22.469336 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-122ba553-b5d2-4643-b283-4b0f5b24c01c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action" status: 200 len: 16400 microversion: 2.1 time: 0.057163 Jan 15 21:38:22.469992 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3872/7731] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:38:22 2022] POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action => generated 16400 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:38:23.480454 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-727c3ee4-7640-4b9b-8606-5fec9fc1a1a5 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:38:23.482170 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-727c3ee4-7640-4b9b-8606-5fec9fc1a1a5 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:38:23.489623 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-727c3ee4-7640-4b9b-8606-5fec9fc1a1a5 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:38:23.490094 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-727c3ee4-7640-4b9b-8606-5fec9fc1a1a5 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:38:23.490894 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-727c3ee4-7640-4b9b-8606-5fec9fc1a1a5 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:38:23.491348 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-727c3ee4-7640-4b9b-8606-5fec9fc1a1a5 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:38:23.531683 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-727c3ee4-7640-4b9b-8606-5fec9fc1a1a5 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action" status: 200 len: 16400 microversion: 2.1 time: 0.055215 Jan 15 21:38:23.532234 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3860/7732] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:38:23 2022] POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action => generated 16400 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:38:24.542905 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-bc0a89f6-3a02-49e6-abf0-e71f1304897a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:38:24.543890 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-bc0a89f6-3a02-49e6-abf0-e71f1304897a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:38:24.551254 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bc0a89f6-3a02-49e6-abf0-e71f1304897a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:38:24.551702 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bc0a89f6-3a02-49e6-abf0-e71f1304897a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:38:24.552474 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bc0a89f6-3a02-49e6-abf0-e71f1304897a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:38:24.552931 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bc0a89f6-3a02-49e6-abf0-e71f1304897a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:38:24.601955 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-bc0a89f6-3a02-49e6-abf0-e71f1304897a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action" status: 200 len: 24566 microversion: 2.1 time: 0.063059 Jan 15 21:38:24.602852 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3873/7733] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:38:24 2022] POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action => generated 24566 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:38:25.613633 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-6603293c-a6e7-43ae-ace6-ce05bd99cd4d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:38:25.614576 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-6603293c-a6e7-43ae-ace6-ce05bd99cd4d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:38:25.622651 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6603293c-a6e7-43ae-ace6-ce05bd99cd4d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:38:25.623153 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6603293c-a6e7-43ae-ace6-ce05bd99cd4d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:38:25.623950 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6603293c-a6e7-43ae-ace6-ce05bd99cd4d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:38:25.624402 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6603293c-a6e7-43ae-ace6-ce05bd99cd4d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:38:25.665511 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-6603293c-a6e7-43ae-ace6-ce05bd99cd4d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action" status: 200 len: 24566 microversion: 2.1 time: 0.055992 Jan 15 21:38:25.666159 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3861/7734] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:38:25 2022] POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action => generated 24566 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:38:26.676983 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-de2307ed-7379-498b-9a1b-63e409ddf7c0 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:38:26.677983 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-de2307ed-7379-498b-9a1b-63e409ddf7c0 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:38:26.685896 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-de2307ed-7379-498b-9a1b-63e409ddf7c0 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:38:26.686350 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-de2307ed-7379-498b-9a1b-63e409ddf7c0 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:38:26.687129 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-de2307ed-7379-498b-9a1b-63e409ddf7c0 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:38:26.687566 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-de2307ed-7379-498b-9a1b-63e409ddf7c0 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:38:26.730646 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-de2307ed-7379-498b-9a1b-63e409ddf7c0 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action" status: 200 len: 24566 microversion: 2.1 time: 0.057582 Jan 15 21:38:26.731466 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3874/7735] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:38:26 2022] POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action => generated 24566 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:38:27.742761 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c625e22a-7adf-46b4-a5fb-d5788e84be67 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:38:27.743794 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c625e22a-7adf-46b4-a5fb-d5788e84be67 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:38:27.751377 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c625e22a-7adf-46b4-a5fb-d5788e84be67 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:38:27.751846 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c625e22a-7adf-46b4-a5fb-d5788e84be67 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:38:27.752649 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c625e22a-7adf-46b4-a5fb-d5788e84be67 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:38:27.753201 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c625e22a-7adf-46b4-a5fb-d5788e84be67 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:38:27.794597 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c625e22a-7adf-46b4-a5fb-d5788e84be67 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action" status: 200 len: 24566 microversion: 2.1 time: 0.055818 Jan 15 21:38:27.795258 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3862/7736] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:38:27 2022] POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action => generated 24566 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:38:28.807208 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-feda4f42-4254-4fc1-9fb0-302e9d2e5522 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:38:28.808202 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-feda4f42-4254-4fc1-9fb0-302e9d2e5522 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:38:28.815533 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-feda4f42-4254-4fc1-9fb0-302e9d2e5522 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:38:28.815981 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-feda4f42-4254-4fc1-9fb0-302e9d2e5522 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:38:28.816755 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-feda4f42-4254-4fc1-9fb0-302e9d2e5522 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:38:28.817213 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-feda4f42-4254-4fc1-9fb0-302e9d2e5522 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:38:28.856383 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-feda4f42-4254-4fc1-9fb0-302e9d2e5522 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action" status: 200 len: 24566 microversion: 2.1 time: 0.053157 Jan 15 21:38:28.857058 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3875/7737] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:38:28 2022] POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action => generated 24566 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:38:29.868449 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-395e2a23-c718-4cef-9df6-910958d290c2 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:38:29.869523 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-395e2a23-c718-4cef-9df6-910958d290c2 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:38:29.877571 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-395e2a23-c718-4cef-9df6-910958d290c2 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:38:29.878041 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-395e2a23-c718-4cef-9df6-910958d290c2 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:38:29.878841 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-395e2a23-c718-4cef-9df6-910958d290c2 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:38:29.879295 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-395e2a23-c718-4cef-9df6-910958d290c2 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:38:29.918673 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-395e2a23-c718-4cef-9df6-910958d290c2 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action" status: 200 len: 24566 microversion: 2.1 time: 0.053776 Jan 15 21:38:29.919353 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3863/7738] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:38:29 2022] POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action => generated 24566 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:38:30.930782 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-cf716829-526a-49bc-a667-7095025d732a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:38:30.931791 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-cf716829-526a-49bc-a667-7095025d732a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:38:30.939685 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cf716829-526a-49bc-a667-7095025d732a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:38:30.940148 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cf716829-526a-49bc-a667-7095025d732a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:38:30.940964 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cf716829-526a-49bc-a667-7095025d732a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:38:30.941411 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cf716829-526a-49bc-a667-7095025d732a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:38:30.980649 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-cf716829-526a-49bc-a667-7095025d732a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action" status: 200 len: 24566 microversion: 2.1 time: 0.053865 Jan 15 21:38:30.981334 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3876/7739] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:38:30 2022] POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action => generated 24566 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:38:31.373701 ncdv-master-1 devstack@n-api.service[129365]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 15 21:38:31.374958 ncdv-master-1 devstack@n-api.service[129365]: Sat Jan 15 21:38:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 15 21:38:31.992853 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-280786d2-0fed-4c57-a70d-e9dc6f98849e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:38:31.993881 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-280786d2-0fed-4c57-a70d-e9dc6f98849e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:38:32.001336 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-280786d2-0fed-4c57-a70d-e9dc6f98849e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:38:32.001799 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-280786d2-0fed-4c57-a70d-e9dc6f98849e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:38:32.002587 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-280786d2-0fed-4c57-a70d-e9dc6f98849e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:38:32.003035 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-280786d2-0fed-4c57-a70d-e9dc6f98849e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:38:32.041699 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-280786d2-0fed-4c57-a70d-e9dc6f98849e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action" status: 200 len: 24566 microversion: 2.1 time: 0.052828 Jan 15 21:38:32.042373 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3864/7740] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:38:31 2022] POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action => generated 24566 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:38:33.053993 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8db0ed88-88d9-4af6-ad3e-a301c8798cf4 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:38:33.055023 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-8db0ed88-88d9-4af6-ad3e-a301c8798cf4 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:38:33.062887 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8db0ed88-88d9-4af6-ad3e-a301c8798cf4 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:38:33.063345 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8db0ed88-88d9-4af6-ad3e-a301c8798cf4 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:38:33.064128 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8db0ed88-88d9-4af6-ad3e-a301c8798cf4 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:38:33.064566 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8db0ed88-88d9-4af6-ad3e-a301c8798cf4 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:38:33.104460 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-8db0ed88-88d9-4af6-ad3e-a301c8798cf4 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action" status: 200 len: 24566 microversion: 2.1 time: 0.054563 Jan 15 21:38:33.105386 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3877/7741] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:38:33 2022] POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action => generated 24566 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:38:34.116547 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-33ea19cf-1d26-4e18-a792-3a0581dac5cb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:38:34.117586 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-33ea19cf-1d26-4e18-a792-3a0581dac5cb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:38:34.125711 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-33ea19cf-1d26-4e18-a792-3a0581dac5cb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:38:34.126173 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-33ea19cf-1d26-4e18-a792-3a0581dac5cb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:38:34.126972 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-33ea19cf-1d26-4e18-a792-3a0581dac5cb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:38:34.127421 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-33ea19cf-1d26-4e18-a792-3a0581dac5cb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:38:34.166076 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-33ea19cf-1d26-4e18-a792-3a0581dac5cb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action" status: 200 len: 24566 microversion: 2.1 time: 0.053641 Jan 15 21:38:34.166714 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3865/7742] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:38:34 2022] POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action => generated 24566 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:38:35.178421 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7743afcb-b44c-4d5c-8e7b-18c6ce4f2183 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:38:35.179462 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-7743afcb-b44c-4d5c-8e7b-18c6ce4f2183 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:38:35.187585 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7743afcb-b44c-4d5c-8e7b-18c6ce4f2183 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:38:35.188040 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7743afcb-b44c-4d5c-8e7b-18c6ce4f2183 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:38:35.188822 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7743afcb-b44c-4d5c-8e7b-18c6ce4f2183 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:38:35.189286 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7743afcb-b44c-4d5c-8e7b-18c6ce4f2183 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:38:35.231012 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7743afcb-b44c-4d5c-8e7b-18c6ce4f2183 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action" status: 200 len: 24566 microversion: 2.1 time: 0.056647 Jan 15 21:38:35.231660 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3878/7743] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:38:35 2022] POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action => generated 24566 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:38:36.243382 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f9d5d79b-20cc-4076-b739-f7884be19cb8 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:38:36.244386 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f9d5d79b-20cc-4076-b739-f7884be19cb8 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:38:36.252580 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f9d5d79b-20cc-4076-b739-f7884be19cb8 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:38:36.253071 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f9d5d79b-20cc-4076-b739-f7884be19cb8 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:38:36.253856 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f9d5d79b-20cc-4076-b739-f7884be19cb8 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:38:36.254304 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f9d5d79b-20cc-4076-b739-f7884be19cb8 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:38:36.302317 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f9d5d79b-20cc-4076-b739-f7884be19cb8 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action" status: 200 len: 32638 microversion: 2.1 time: 0.062925 Jan 15 21:38:36.302948 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3866/7744] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:38:36 2022] POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action => generated 32638 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:38:37.314495 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ee5ee263-1c65-48cb-a98d-ded0f1e9c664 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:38:37.315497 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ee5ee263-1c65-48cb-a98d-ded0f1e9c664 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:38:37.322943 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ee5ee263-1c65-48cb-a98d-ded0f1e9c664 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:38:37.323392 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ee5ee263-1c65-48cb-a98d-ded0f1e9c664 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:38:37.324167 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ee5ee263-1c65-48cb-a98d-ded0f1e9c664 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:38:37.324600 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ee5ee263-1c65-48cb-a98d-ded0f1e9c664 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:38:37.365555 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ee5ee263-1c65-48cb-a98d-ded0f1e9c664 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action" status: 200 len: 32638 microversion: 2.1 time: 0.055001 Jan 15 21:38:37.366203 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3879/7745] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:38:37 2022] POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action => generated 32638 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 21:38:38.377246 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8ba23dad-e8f1-4dd7-990b-4eba02cba345 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:38:38.378268 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-8ba23dad-e8f1-4dd7-990b-4eba02cba345 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:38:38.385721 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8ba23dad-e8f1-4dd7-990b-4eba02cba345 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:38:38.386222 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8ba23dad-e8f1-4dd7-990b-4eba02cba345 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:38:38.387015 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8ba23dad-e8f1-4dd7-990b-4eba02cba345 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:38:38.387468 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8ba23dad-e8f1-4dd7-990b-4eba02cba345 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:38:38.428079 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-8ba23dad-e8f1-4dd7-990b-4eba02cba345 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action" status: 200 len: 32638 microversion: 2.1 time: 0.054830 Jan 15 21:38:38.428712 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3867/7746] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:38:38 2022] POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action => generated 32638 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:38:39.441182 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1af3854b-8c56-409c-b9b2-fb23253ad1d9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:38:39.442225 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-1af3854b-8c56-409c-b9b2-fb23253ad1d9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:38:39.449286 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1af3854b-8c56-409c-b9b2-fb23253ad1d9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:38:39.449746 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1af3854b-8c56-409c-b9b2-fb23253ad1d9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:38:39.450532 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1af3854b-8c56-409c-b9b2-fb23253ad1d9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:38:39.450976 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1af3854b-8c56-409c-b9b2-fb23253ad1d9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:38:39.490497 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-1af3854b-8c56-409c-b9b2-fb23253ad1d9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action" status: 200 len: 32638 microversion: 2.1 time: 0.054176 Jan 15 21:38:39.491141 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3880/7747] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:38:39 2022] POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action => generated 32638 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:38:40.502773 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-0c79c392-8374-4934-97f0-297dfebef64d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:38:40.503825 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-0c79c392-8374-4934-97f0-297dfebef64d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:38:40.511556 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0c79c392-8374-4934-97f0-297dfebef64d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:38:40.512017 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0c79c392-8374-4934-97f0-297dfebef64d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:38:40.512805 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0c79c392-8374-4934-97f0-297dfebef64d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:38:40.513321 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0c79c392-8374-4934-97f0-297dfebef64d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:38:40.557819 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-0c79c392-8374-4934-97f0-297dfebef64d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action" status: 200 len: 32638 microversion: 2.1 time: 0.059110 Jan 15 21:38:40.558510 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3868/7748] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:38:40 2022] POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action => generated 32638 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:38:41.569912 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-22a74163-651b-4eb6-bf58-04c9658cce05 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:38:41.570811 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-22a74163-651b-4eb6-bf58-04c9658cce05 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:38:41.579396 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-22a74163-651b-4eb6-bf58-04c9658cce05 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:38:41.579850 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-22a74163-651b-4eb6-bf58-04c9658cce05 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:38:41.580642 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-22a74163-651b-4eb6-bf58-04c9658cce05 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:38:41.581114 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-22a74163-651b-4eb6-bf58-04c9658cce05 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:38:41.623514 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-22a74163-651b-4eb6-bf58-04c9658cce05 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action" status: 200 len: 32638 microversion: 2.1 time: 0.057796 Jan 15 21:38:41.624358 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3881/7749] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:38:41 2022] POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action => generated 32638 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:38:42.635921 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-cc1c17d8-7689-4f6c-a620-9fd67e94c0a4 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:38:42.636866 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-cc1c17d8-7689-4f6c-a620-9fd67e94c0a4 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:38:42.644521 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cc1c17d8-7689-4f6c-a620-9fd67e94c0a4 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:38:42.645044 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cc1c17d8-7689-4f6c-a620-9fd67e94c0a4 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:38:42.645834 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cc1c17d8-7689-4f6c-a620-9fd67e94c0a4 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:38:42.646284 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cc1c17d8-7689-4f6c-a620-9fd67e94c0a4 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:38:42.686969 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-cc1c17d8-7689-4f6c-a620-9fd67e94c0a4 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action" status: 200 len: 32638 microversion: 2.1 time: 0.054936 Jan 15 21:38:42.687783 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3869/7750] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:38:42 2022] POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action => generated 32638 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:38:43.699919 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7b094d7c-fc1c-46c3-9305-7402d9c740e8 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:38:43.701029 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-7b094d7c-fc1c-46c3-9305-7402d9c740e8 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:38:43.710507 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7b094d7c-fc1c-46c3-9305-7402d9c740e8 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:38:43.710973 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7b094d7c-fc1c-46c3-9305-7402d9c740e8 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:38:43.711776 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7b094d7c-fc1c-46c3-9305-7402d9c740e8 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:38:43.712221 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7b094d7c-fc1c-46c3-9305-7402d9c740e8 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:38:43.753859 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7b094d7c-fc1c-46c3-9305-7402d9c740e8 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action" status: 200 len: 32638 microversion: 2.1 time: 0.058045 Jan 15 21:38:43.754520 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3882/7751] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:38:43 2022] POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action => generated 32638 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 21:38:44.765645 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8fea8cc9-a7e2-4930-9c4c-eb96843249e2 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:38:44.766662 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-8fea8cc9-a7e2-4930-9c4c-eb96843249e2 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:38:44.774097 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8fea8cc9-a7e2-4930-9c4c-eb96843249e2 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:38:44.774584 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8fea8cc9-a7e2-4930-9c4c-eb96843249e2 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:38:44.775360 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8fea8cc9-a7e2-4930-9c4c-eb96843249e2 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:38:44.775810 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8fea8cc9-a7e2-4930-9c4c-eb96843249e2 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:38:44.815789 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-8fea8cc9-a7e2-4930-9c4c-eb96843249e2 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action" status: 200 len: 32638 microversion: 2.1 time: 0.054132 Jan 15 21:38:44.816425 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3870/7752] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:38:44 2022] POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action => generated 32638 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:38:45.828170 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1af68d27-b409-4d18-be9d-e420cea721bb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:38:45.829205 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-1af68d27-b409-4d18-be9d-e420cea721bb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:38:45.837070 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1af68d27-b409-4d18-be9d-e420cea721bb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:38:45.837528 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1af68d27-b409-4d18-be9d-e420cea721bb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:38:45.838315 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1af68d27-b409-4d18-be9d-e420cea721bb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:38:45.838750 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1af68d27-b409-4d18-be9d-e420cea721bb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:38:45.880243 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-1af68d27-b409-4d18-be9d-e420cea721bb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action" status: 200 len: 32638 microversion: 2.1 time: 0.056047 Jan 15 21:38:45.880937 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3883/7753] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:38:45 2022] POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action => generated 32638 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:38:46.892122 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-adac0da5-a786-4711-86ae-93dcd59e5ebb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:38:46.893713 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-adac0da5-a786-4711-86ae-93dcd59e5ebb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:38:46.900796 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-adac0da5-a786-4711-86ae-93dcd59e5ebb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:38:46.901281 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-adac0da5-a786-4711-86ae-93dcd59e5ebb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:38:46.902072 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-adac0da5-a786-4711-86ae-93dcd59e5ebb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:38:46.902521 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-adac0da5-a786-4711-86ae-93dcd59e5ebb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:38:46.942729 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-adac0da5-a786-4711-86ae-93dcd59e5ebb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action" status: 200 len: 32638 microversion: 2.1 time: 0.054595 Jan 15 21:38:46.943377 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3871/7754] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:38:46 2022] POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action => generated 32638 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:38:47.954858 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-40d1c80f-6fc2-4dd8-92fd-6b14c18ac68d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:38:47.956023 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-40d1c80f-6fc2-4dd8-92fd-6b14c18ac68d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:38:47.964357 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-40d1c80f-6fc2-4dd8-92fd-6b14c18ac68d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:38:47.964817 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-40d1c80f-6fc2-4dd8-92fd-6b14c18ac68d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:38:47.965668 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-40d1c80f-6fc2-4dd8-92fd-6b14c18ac68d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:38:47.966106 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-40d1c80f-6fc2-4dd8-92fd-6b14c18ac68d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:38:48.012422 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-40d1c80f-6fc2-4dd8-92fd-6b14c18ac68d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action" status: 200 len: 32638 microversion: 2.1 time: 0.061208 Jan 15 21:38:48.013142 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3884/7755] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:38:47 2022] POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action => generated 32638 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:38:49.024696 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-53316b47-de29-4474-b118-4b3d1035ea5f tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:38:49.025736 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-53316b47-de29-4474-b118-4b3d1035ea5f tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:38:49.032946 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-53316b47-de29-4474-b118-4b3d1035ea5f tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:38:49.033555 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-53316b47-de29-4474-b118-4b3d1035ea5f tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:38:49.034354 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-53316b47-de29-4474-b118-4b3d1035ea5f tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:38:49.034809 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-53316b47-de29-4474-b118-4b3d1035ea5f tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:38:49.073438 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-53316b47-de29-4474-b118-4b3d1035ea5f tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action" status: 200 len: 32638 microversion: 2.1 time: 0.052555 Jan 15 21:38:49.074101 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3872/7756] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:38:49 2022] POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action => generated 32638 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:38:50.086834 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-3bbda0e4-855f-4b91-beba-75832569b961 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:38:50.087851 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-3bbda0e4-855f-4b91-beba-75832569b961 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:38:50.095746 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3bbda0e4-855f-4b91-beba-75832569b961 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:38:50.096286 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3bbda0e4-855f-4b91-beba-75832569b961 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:38:50.097108 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3bbda0e4-855f-4b91-beba-75832569b961 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:38:50.097543 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3bbda0e4-855f-4b91-beba-75832569b961 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:38:50.142069 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-3bbda0e4-855f-4b91-beba-75832569b961 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action" status: 200 len: 32638 microversion: 2.1 time: 0.060035 Jan 15 21:38:50.142938 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3885/7757] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:38:50 2022] POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action => generated 32638 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:38:51.154361 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-1d59752a-a79e-400e-9e52-4f91ef1eedaa tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:38:51.155419 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-1d59752a-a79e-400e-9e52-4f91ef1eedaa tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:38:51.163297 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1d59752a-a79e-400e-9e52-4f91ef1eedaa tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:38:51.163768 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1d59752a-a79e-400e-9e52-4f91ef1eedaa tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:38:51.164566 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1d59752a-a79e-400e-9e52-4f91ef1eedaa tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:38:51.165066 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1d59752a-a79e-400e-9e52-4f91ef1eedaa tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:38:51.205457 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-1d59752a-a79e-400e-9e52-4f91ef1eedaa tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action" status: 200 len: 32638 microversion: 2.1 time: 0.054552 Jan 15 21:38:51.206099 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3873/7758] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:38:51 2022] POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action => generated 32638 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:38:52.216822 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9a1be40d-e555-48f9-af6b-e178e542595e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:38:52.217850 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-9a1be40d-e555-48f9-af6b-e178e542595e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:38:52.225377 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9a1be40d-e555-48f9-af6b-e178e542595e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:38:52.225835 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9a1be40d-e555-48f9-af6b-e178e542595e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:38:52.226626 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9a1be40d-e555-48f9-af6b-e178e542595e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:38:52.227087 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9a1be40d-e555-48f9-af6b-e178e542595e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:38:52.267669 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-9a1be40d-e555-48f9-af6b-e178e542595e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action" status: 200 len: 32638 microversion: 2.1 time: 0.054733 Jan 15 21:38:52.268554 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3886/7759] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:38:52 2022] POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action => generated 32638 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:38:53.280194 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-bc7a8101-ea9c-4e9c-9d0c-6ee64eca6a19 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:38:53.281732 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-bc7a8101-ea9c-4e9c-9d0c-6ee64eca6a19 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:38:53.289074 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bc7a8101-ea9c-4e9c-9d0c-6ee64eca6a19 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:38:53.289542 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bc7a8101-ea9c-4e9c-9d0c-6ee64eca6a19 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:38:53.290341 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bc7a8101-ea9c-4e9c-9d0c-6ee64eca6a19 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:38:53.290789 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bc7a8101-ea9c-4e9c-9d0c-6ee64eca6a19 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:38:53.333688 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-bc7a8101-ea9c-4e9c-9d0c-6ee64eca6a19 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action" status: 200 len: 32638 microversion: 2.1 time: 0.057455 Jan 15 21:38:53.334342 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3874/7760] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:38:53 2022] POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action => generated 32638 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:38:54.346771 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8f2ec5c6-235e-46eb-95db-033b60442a5d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:38:54.347786 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-8f2ec5c6-235e-46eb-95db-033b60442a5d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:38:54.355499 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8f2ec5c6-235e-46eb-95db-033b60442a5d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:38:54.355945 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8f2ec5c6-235e-46eb-95db-033b60442a5d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:38:54.356747 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8f2ec5c6-235e-46eb-95db-033b60442a5d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:38:54.357222 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8f2ec5c6-235e-46eb-95db-033b60442a5d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:38:54.399107 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-8f2ec5c6-235e-46eb-95db-033b60442a5d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action" status: 200 len: 32638 microversion: 2.1 time: 0.057043 Jan 15 21:38:54.399758 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3887/7761] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:38:54 2022] POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action => generated 32638 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:38:55.412114 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f894e942-807a-4d1a-bfe8-39704db67b24 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:38:55.413156 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f894e942-807a-4d1a-bfe8-39704db67b24 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:38:55.420421 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f894e942-807a-4d1a-bfe8-39704db67b24 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:38:55.420912 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f894e942-807a-4d1a-bfe8-39704db67b24 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:38:55.421700 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f894e942-807a-4d1a-bfe8-39704db67b24 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:38:55.422148 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f894e942-807a-4d1a-bfe8-39704db67b24 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:38:55.461939 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f894e942-807a-4d1a-bfe8-39704db67b24 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action" status: 200 len: 32638 microversion: 2.1 time: 0.054608 Jan 15 21:38:55.462602 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3875/7762] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:38:55 2022] POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action => generated 32638 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:38:56.474216 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-fdfe9b29-1daf-4ccc-9635-19df991e67de tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:38:56.475249 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-fdfe9b29-1daf-4ccc-9635-19df991e67de tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:38:56.482651 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fdfe9b29-1daf-4ccc-9635-19df991e67de tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:38:56.483114 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fdfe9b29-1daf-4ccc-9635-19df991e67de tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:38:56.483898 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fdfe9b29-1daf-4ccc-9635-19df991e67de tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:38:56.484341 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fdfe9b29-1daf-4ccc-9635-19df991e67de tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:38:56.525164 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-fdfe9b29-1daf-4ccc-9635-19df991e67de tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action" status: 200 len: 32638 microversion: 2.1 time: 0.054957 Jan 15 21:38:56.525815 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3888/7763] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:38:56 2022] POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action => generated 32638 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:38:57.538272 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ac6e9ca3-94f4-46a7-a21f-ea095d8386c2 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:38:57.539204 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ac6e9ca3-94f4-46a7-a21f-ea095d8386c2 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:38:57.546590 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ac6e9ca3-94f4-46a7-a21f-ea095d8386c2 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:38:57.547055 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ac6e9ca3-94f4-46a7-a21f-ea095d8386c2 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:38:57.547855 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ac6e9ca3-94f4-46a7-a21f-ea095d8386c2 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:38:57.548304 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ac6e9ca3-94f4-46a7-a21f-ea095d8386c2 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:38:57.588297 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ac6e9ca3-94f4-46a7-a21f-ea095d8386c2 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action" status: 200 len: 32638 microversion: 2.1 time: 0.054348 Jan 15 21:38:57.588956 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3876/7764] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:38:57 2022] POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action => generated 32638 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:38:58.600537 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e7f4dac3-3d59-4184-b30b-72c88ee9a20b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:38:58.601591 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e7f4dac3-3d59-4184-b30b-72c88ee9a20b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:38:58.609177 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e7f4dac3-3d59-4184-b30b-72c88ee9a20b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:38:58.609696 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e7f4dac3-3d59-4184-b30b-72c88ee9a20b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:38:58.610503 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e7f4dac3-3d59-4184-b30b-72c88ee9a20b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:38:58.611485 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e7f4dac3-3d59-4184-b30b-72c88ee9a20b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:38:58.650577 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e7f4dac3-3d59-4184-b30b-72c88ee9a20b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action" status: 200 len: 32638 microversion: 2.1 time: 0.053963 Jan 15 21:38:58.651153 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3889/7765] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:38:58 2022] POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action => generated 32638 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:38:59.664025 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-582cfe59-7812-4ff7-b30f-516a4574c75a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:38:59.665080 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-582cfe59-7812-4ff7-b30f-516a4574c75a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:38:59.672493 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-582cfe59-7812-4ff7-b30f-516a4574c75a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:38:59.672998 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-582cfe59-7812-4ff7-b30f-516a4574c75a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:38:59.674091 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-582cfe59-7812-4ff7-b30f-516a4574c75a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:38:59.674550 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-582cfe59-7812-4ff7-b30f-516a4574c75a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:38:59.714762 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-582cfe59-7812-4ff7-b30f-516a4574c75a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action" status: 200 len: 32638 microversion: 2.1 time: 0.055241 Jan 15 21:38:59.715417 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3877/7766] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:38:59 2022] POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action => generated 32638 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:39:00.726727 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9b73696b-0cec-4f4f-abc7-9100eb18f12b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:39:00.727767 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-9b73696b-0cec-4f4f-abc7-9100eb18f12b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:39:00.735231 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9b73696b-0cec-4f4f-abc7-9100eb18f12b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:39:00.736453 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9b73696b-0cec-4f4f-abc7-9100eb18f12b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:39:00.737529 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9b73696b-0cec-4f4f-abc7-9100eb18f12b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:39:00.738091 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9b73696b-0cec-4f4f-abc7-9100eb18f12b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:39:00.780301 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-9b73696b-0cec-4f4f-abc7-9100eb18f12b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action" status: 200 len: 32638 microversion: 2.1 time: 0.057642 Jan 15 21:39:00.780990 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3890/7767] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:39:00 2022] POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action => generated 32638 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:39:01.792421 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ce4625a3-ae02-4436-b17e-b031d6825f94 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:39:01.793458 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ce4625a3-ae02-4436-b17e-b031d6825f94 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:39:01.800964 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ce4625a3-ae02-4436-b17e-b031d6825f94 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:39:01.801436 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ce4625a3-ae02-4436-b17e-b031d6825f94 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:39:01.802224 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ce4625a3-ae02-4436-b17e-b031d6825f94 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:39:01.802667 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ce4625a3-ae02-4436-b17e-b031d6825f94 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:39:01.841993 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ce4625a3-ae02-4436-b17e-b031d6825f94 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action" status: 200 len: 32638 microversion: 2.1 time: 0.053588 Jan 15 21:39:01.842661 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3878/7768] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:39:01 2022] POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action => generated 32638 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:39:02.854739 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a47337e5-91d3-4176-aa84-2e911e2e3927 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:39:02.855734 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a47337e5-91d3-4176-aa84-2e911e2e3927 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:39:02.863593 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a47337e5-91d3-4176-aa84-2e911e2e3927 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:39:02.864032 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a47337e5-91d3-4176-aa84-2e911e2e3927 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:39:02.864805 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a47337e5-91d3-4176-aa84-2e911e2e3927 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:39:02.865267 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a47337e5-91d3-4176-aa84-2e911e2e3927 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:39:02.903562 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a47337e5-91d3-4176-aa84-2e911e2e3927 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action" status: 200 len: 32638 microversion: 2.1 time: 0.052765 Jan 15 21:39:02.904259 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3891/7769] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:39:02 2022] POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action => generated 32638 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:39:03.916412 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-4bd8d854-3073-43da-aa2c-e845ee94d118 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:39:03.917455 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-4bd8d854-3073-43da-aa2c-e845ee94d118 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:39:03.925472 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4bd8d854-3073-43da-aa2c-e845ee94d118 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:39:03.925935 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4bd8d854-3073-43da-aa2c-e845ee94d118 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:39:03.926750 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4bd8d854-3073-43da-aa2c-e845ee94d118 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:39:03.927194 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4bd8d854-3073-43da-aa2c-e845ee94d118 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:39:03.966547 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-4bd8d854-3073-43da-aa2c-e845ee94d118 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action" status: 200 len: 32638 microversion: 2.1 time: 0.054411 Jan 15 21:39:03.967193 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3879/7770] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:39:03 2022] POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action => generated 32638 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:39:04.979833 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-298850c3-68ca-4633-aa5c-577d8c0b1c4d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:39:04.980833 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-298850c3-68ca-4633-aa5c-577d8c0b1c4d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:39:04.988939 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-298850c3-68ca-4633-aa5c-577d8c0b1c4d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:39:04.989387 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-298850c3-68ca-4633-aa5c-577d8c0b1c4d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:39:04.990159 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-298850c3-68ca-4633-aa5c-577d8c0b1c4d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:39:04.990591 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-298850c3-68ca-4633-aa5c-577d8c0b1c4d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:39:05.029946 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-298850c3-68ca-4633-aa5c-577d8c0b1c4d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action" status: 200 len: 32638 microversion: 2.1 time: 0.054070 Jan 15 21:39:05.030600 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3892/7771] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:39:04 2022] POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action => generated 32638 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:39:06.043184 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d7b339e4-e204-461e-b4e8-9fcde6a88325 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:39:06.044245 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d7b339e4-e204-461e-b4e8-9fcde6a88325 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:39:06.051893 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d7b339e4-e204-461e-b4e8-9fcde6a88325 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:39:06.052366 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d7b339e4-e204-461e-b4e8-9fcde6a88325 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:39:06.053201 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d7b339e4-e204-461e-b4e8-9fcde6a88325 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:39:06.053661 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d7b339e4-e204-461e-b4e8-9fcde6a88325 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:39:06.096741 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d7b339e4-e204-461e-b4e8-9fcde6a88325 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action" status: 200 len: 32638 microversion: 2.1 time: 0.057618 Jan 15 21:39:06.097423 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3880/7772] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:39:06 2022] POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action => generated 32638 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 21:39:07.109482 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-48abbca7-dfbd-4496-b190-d7076da8d247 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:39:07.110583 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-48abbca7-dfbd-4496-b190-d7076da8d247 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:39:07.118456 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-48abbca7-dfbd-4496-b190-d7076da8d247 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:39:07.118905 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-48abbca7-dfbd-4496-b190-d7076da8d247 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:39:07.119682 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-48abbca7-dfbd-4496-b190-d7076da8d247 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:39:07.120119 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-48abbca7-dfbd-4496-b190-d7076da8d247 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:39:07.161026 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-48abbca7-dfbd-4496-b190-d7076da8d247 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action" status: 200 len: 32638 microversion: 2.1 time: 0.055978 Jan 15 21:39:07.161673 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3893/7773] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:39:07 2022] POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action => generated 32638 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:39:08.173186 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-6c40ad57-3deb-4f49-9282-7e7dd21c9a67 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:39:08.174240 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-6c40ad57-3deb-4f49-9282-7e7dd21c9a67 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:39:08.181784 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6c40ad57-3deb-4f49-9282-7e7dd21c9a67 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:39:08.182255 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6c40ad57-3deb-4f49-9282-7e7dd21c9a67 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:39:08.183054 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6c40ad57-3deb-4f49-9282-7e7dd21c9a67 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:39:08.183499 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6c40ad57-3deb-4f49-9282-7e7dd21c9a67 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:39:08.222866 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-6c40ad57-3deb-4f49-9282-7e7dd21c9a67 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action" status: 200 len: 32638 microversion: 2.1 time: 0.053748 Jan 15 21:39:08.223759 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3881/7774] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:39:08 2022] POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action => generated 32638 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 21:39:09.234550 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-640b6d1a-75b9-496b-8508-a749881436ff tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:39:09.235553 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-640b6d1a-75b9-496b-8508-a749881436ff tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:39:09.243504 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-640b6d1a-75b9-496b-8508-a749881436ff tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:39:09.243957 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-640b6d1a-75b9-496b-8508-a749881436ff tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:39:09.244738 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-640b6d1a-75b9-496b-8508-a749881436ff tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:39:09.245200 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-640b6d1a-75b9-496b-8508-a749881436ff tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:39:09.285578 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-640b6d1a-75b9-496b-8508-a749881436ff tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action" status: 200 len: 32638 microversion: 2.1 time: 0.055061 Jan 15 21:39:09.286212 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3894/7775] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:39:09 2022] POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action => generated 32638 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 21:39:10.297939 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-817ae36b-9f9f-4bbf-8494-59694e07b63b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:39:10.298887 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-817ae36b-9f9f-4bbf-8494-59694e07b63b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:39:10.306511 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-817ae36b-9f9f-4bbf-8494-59694e07b63b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:39:10.307024 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-817ae36b-9f9f-4bbf-8494-59694e07b63b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:39:10.308149 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-817ae36b-9f9f-4bbf-8494-59694e07b63b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:39:10.308602 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-817ae36b-9f9f-4bbf-8494-59694e07b63b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:39:10.349268 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-817ae36b-9f9f-4bbf-8494-59694e07b63b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action" status: 200 len: 32638 microversion: 2.1 time: 0.055391 Jan 15 21:39:10.353276 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3882/7776] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:39:10 2022] POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action => generated 32638 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:39:11.362131 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d535945a-0bbb-4d1b-8b4b-011593a11f28 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:39:11.363168 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-d535945a-0bbb-4d1b-8b4b-011593a11f28 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:39:11.370544 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d535945a-0bbb-4d1b-8b4b-011593a11f28 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:39:11.370997 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d535945a-0bbb-4d1b-8b4b-011593a11f28 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:39:11.371780 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d535945a-0bbb-4d1b-8b4b-011593a11f28 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:39:11.372222 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d535945a-0bbb-4d1b-8b4b-011593a11f28 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:39:11.415127 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d535945a-0bbb-4d1b-8b4b-011593a11f28 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action" status: 200 len: 32638 microversion: 2.1 time: 0.057601 Jan 15 21:39:11.415783 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3895/7777] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:39:11 2022] POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action => generated 32638 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:39:12.427942 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-833aa6fc-63fe-4d71-a27c-a6297c2052b3 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:39:12.429026 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-833aa6fc-63fe-4d71-a27c-a6297c2052b3 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:39:12.436506 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-833aa6fc-63fe-4d71-a27c-a6297c2052b3 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:39:12.437013 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-833aa6fc-63fe-4d71-a27c-a6297c2052b3 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:39:12.437819 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-833aa6fc-63fe-4d71-a27c-a6297c2052b3 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:39:12.438279 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-833aa6fc-63fe-4d71-a27c-a6297c2052b3 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:39:12.477620 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-833aa6fc-63fe-4d71-a27c-a6297c2052b3 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action" status: 200 len: 32638 microversion: 2.1 time: 0.054235 Jan 15 21:39:12.478271 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3883/7778] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:39:12 2022] POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action => generated 32638 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:39:13.490258 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d07143c3-b227-42f6-b7ca-c8d9d304feb5 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:39:13.491271 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-d07143c3-b227-42f6-b7ca-c8d9d304feb5 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:39:13.498634 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d07143c3-b227-42f6-b7ca-c8d9d304feb5 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:39:13.499086 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d07143c3-b227-42f6-b7ca-c8d9d304feb5 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:39:13.499873 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d07143c3-b227-42f6-b7ca-c8d9d304feb5 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:39:13.500309 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d07143c3-b227-42f6-b7ca-c8d9d304feb5 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:39:13.542874 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d07143c3-b227-42f6-b7ca-c8d9d304feb5 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action" status: 200 len: 32638 microversion: 2.1 time: 0.056806 Jan 15 21:39:13.543709 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3896/7779] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:39:13 2022] POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action => generated 32638 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:39:14.555463 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-1e80f8c2-f76d-43fb-b78a-a43cb5aaeadf tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:39:14.556491 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-1e80f8c2-f76d-43fb-b78a-a43cb5aaeadf tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:39:14.563946 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1e80f8c2-f76d-43fb-b78a-a43cb5aaeadf tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:39:14.564421 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1e80f8c2-f76d-43fb-b78a-a43cb5aaeadf tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:39:14.565440 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1e80f8c2-f76d-43fb-b78a-a43cb5aaeadf tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:39:14.566145 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1e80f8c2-f76d-43fb-b78a-a43cb5aaeadf tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:39:14.606643 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-1e80f8c2-f76d-43fb-b78a-a43cb5aaeadf tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action" status: 200 len: 32638 microversion: 2.1 time: 0.055224 Jan 15 21:39:14.607286 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3884/7780] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:39:14 2022] POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action => generated 32638 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 21:39:15.619635 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-6c52205d-b318-4c3d-b712-285813adf457 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:39:15.620582 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-6c52205d-b318-4c3d-b712-285813adf457 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:39:15.627966 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6c52205d-b318-4c3d-b712-285813adf457 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:39:15.629053 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6c52205d-b318-4c3d-b712-285813adf457 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:39:15.629873 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6c52205d-b318-4c3d-b712-285813adf457 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:39:15.630324 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6c52205d-b318-4c3d-b712-285813adf457 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:39:15.671774 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-6c52205d-b318-4c3d-b712-285813adf457 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action" status: 200 len: 32638 microversion: 2.1 time: 0.056316 Jan 15 21:39:15.672441 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3897/7781] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:39:15 2022] POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action => generated 32638 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 21:39:16.684490 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ae797737-931c-4d98-8aa7-2bea3a006c52 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:39:16.685564 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ae797737-931c-4d98-8aa7-2bea3a006c52 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:39:16.694553 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ae797737-931c-4d98-8aa7-2bea3a006c52 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:39:16.694767 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ae797737-931c-4d98-8aa7-2bea3a006c52 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:39:16.695550 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ae797737-931c-4d98-8aa7-2bea3a006c52 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:39:16.696183 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ae797737-931c-4d98-8aa7-2bea3a006c52 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:39:16.736219 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ae797737-931c-4d98-8aa7-2bea3a006c52 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action" status: 200 len: 32638 microversion: 2.1 time: 0.055990 Jan 15 21:39:16.737684 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3885/7782] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:39:16 2022] POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action => generated 32638 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:39:17.749117 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ce322ae5-aaa4-44ef-a878-901918c22245 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:39:17.750123 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ce322ae5-aaa4-44ef-a878-901918c22245 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:39:17.758056 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ce322ae5-aaa4-44ef-a878-901918c22245 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:39:17.758511 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ce322ae5-aaa4-44ef-a878-901918c22245 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:39:17.759438 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ce322ae5-aaa4-44ef-a878-901918c22245 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:39:17.759943 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ce322ae5-aaa4-44ef-a878-901918c22245 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:39:17.800620 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ce322ae5-aaa4-44ef-a878-901918c22245 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action" status: 200 len: 32638 microversion: 2.1 time: 0.055545 Jan 15 21:39:17.801286 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3898/7783] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:39:17 2022] POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action => generated 32638 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:39:18.812723 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-533d274f-c8f3-4f68-ab50-6e02050b2470 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:39:18.813817 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-533d274f-c8f3-4f68-ab50-6e02050b2470 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:39:18.822033 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-533d274f-c8f3-4f68-ab50-6e02050b2470 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:39:18.822504 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-533d274f-c8f3-4f68-ab50-6e02050b2470 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:39:18.823299 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-533d274f-c8f3-4f68-ab50-6e02050b2470 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:39:18.823750 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-533d274f-c8f3-4f68-ab50-6e02050b2470 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:39:18.868421 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-533d274f-c8f3-4f68-ab50-6e02050b2470 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action" status: 200 len: 32638 microversion: 2.1 time: 0.059812 Jan 15 21:39:18.869152 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3886/7784] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:39:18 2022] POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action => generated 32638 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 21:39:19.880871 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-40157d7e-e5f8-44d9-b425-213473b42099 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:39:19.881811 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-40157d7e-e5f8-44d9-b425-213473b42099 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:39:19.889208 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-40157d7e-e5f8-44d9-b425-213473b42099 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:39:19.889667 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-40157d7e-e5f8-44d9-b425-213473b42099 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:39:19.890454 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-40157d7e-e5f8-44d9-b425-213473b42099 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:39:19.890896 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-40157d7e-e5f8-44d9-b425-213473b42099 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:39:19.931046 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-40157d7e-e5f8-44d9-b425-213473b42099 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action" status: 200 len: 32638 microversion: 2.1 time: 0.054556 Jan 15 21:39:19.931689 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3899/7785] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:39:19 2022] POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action => generated 32638 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:39:20.943356 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-88daf788-6f01-4210-b4eb-ffb8a06eaa91 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:39:20.944328 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-88daf788-6f01-4210-b4eb-ffb8a06eaa91 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:39:20.951785 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-88daf788-6f01-4210-b4eb-ffb8a06eaa91 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:39:20.952261 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-88daf788-6f01-4210-b4eb-ffb8a06eaa91 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:39:20.953096 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-88daf788-6f01-4210-b4eb-ffb8a06eaa91 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:39:20.953553 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-88daf788-6f01-4210-b4eb-ffb8a06eaa91 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:39:20.992853 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-88daf788-6f01-4210-b4eb-ffb8a06eaa91 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action" status: 200 len: 32638 microversion: 2.1 time: 0.053835 Jan 15 21:39:20.993516 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3887/7786] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:39:20 2022] POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action => generated 32638 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 21:39:22.006459 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0eef51d5-ec24-45ea-951f-901f3c4b411d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:39:22.007464 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-0eef51d5-ec24-45ea-951f-901f3c4b411d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:39:22.014850 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0eef51d5-ec24-45ea-951f-901f3c4b411d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:39:22.015332 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0eef51d5-ec24-45ea-951f-901f3c4b411d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:39:22.016117 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0eef51d5-ec24-45ea-951f-901f3c4b411d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:39:22.016550 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0eef51d5-ec24-45ea-951f-901f3c4b411d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:39:22.057179 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0eef51d5-ec24-45ea-951f-901f3c4b411d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action" status: 200 len: 32638 microversion: 2.1 time: 0.055405 Jan 15 21:39:22.057827 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3900/7787] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:39:22 2022] POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action => generated 32638 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:39:23.070512 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-03ca3161-fc1d-47ac-b8d1-d881e8c9b688 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:39:23.071540 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-03ca3161-fc1d-47ac-b8d1-d881e8c9b688 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:39:23.078991 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-03ca3161-fc1d-47ac-b8d1-d881e8c9b688 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:39:23.079452 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-03ca3161-fc1d-47ac-b8d1-d881e8c9b688 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:39:23.080252 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-03ca3161-fc1d-47ac-b8d1-d881e8c9b688 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:39:23.081428 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-03ca3161-fc1d-47ac-b8d1-d881e8c9b688 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:39:23.120821 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-03ca3161-fc1d-47ac-b8d1-d881e8c9b688 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action" status: 200 len: 32638 microversion: 2.1 time: 0.054559 Jan 15 21:39:23.121479 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3888/7788] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:39:23 2022] POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action => generated 32638 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:39:24.133324 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-5f9d7aa6-153d-4ee3-a0e5-f0f234f74cfa tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:39:24.134449 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-5f9d7aa6-153d-4ee3-a0e5-f0f234f74cfa tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:39:24.141751 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5f9d7aa6-153d-4ee3-a0e5-f0f234f74cfa tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:39:24.142196 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5f9d7aa6-153d-4ee3-a0e5-f0f234f74cfa tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:39:24.143672 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5f9d7aa6-153d-4ee3-a0e5-f0f234f74cfa tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:39:24.144210 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5f9d7aa6-153d-4ee3-a0e5-f0f234f74cfa tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:39:24.185314 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-5f9d7aa6-153d-4ee3-a0e5-f0f234f74cfa tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action" status: 200 len: 32638 microversion: 2.1 time: 0.056050 Jan 15 21:39:24.185955 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3901/7789] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:39:24 2022] POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action => generated 32638 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:39:25.197803 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-53491833-3bbe-4283-a963-f81ae6efe570 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:39:25.198830 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-53491833-3bbe-4283-a963-f81ae6efe570 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:39:25.206237 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-53491833-3bbe-4283-a963-f81ae6efe570 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:39:25.207192 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-53491833-3bbe-4283-a963-f81ae6efe570 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:39:25.208131 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-53491833-3bbe-4283-a963-f81ae6efe570 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:39:25.208587 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-53491833-3bbe-4283-a963-f81ae6efe570 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:39:25.248289 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-53491833-3bbe-4283-a963-f81ae6efe570 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action" status: 200 len: 32638 microversion: 2.1 time: 0.054517 Jan 15 21:39:25.249195 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3889/7790] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:39:25 2022] POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action => generated 32638 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:39:26.260864 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e5870d27-de5e-46c5-ba66-bbcf928460dc tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:39:26.261856 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e5870d27-de5e-46c5-ba66-bbcf928460dc tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:39:26.270002 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e5870d27-de5e-46c5-ba66-bbcf928460dc tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:39:26.270455 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e5870d27-de5e-46c5-ba66-bbcf928460dc tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:39:26.271251 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e5870d27-de5e-46c5-ba66-bbcf928460dc tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:39:26.271688 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e5870d27-de5e-46c5-ba66-bbcf928460dc tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:39:26.312772 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e5870d27-de5e-46c5-ba66-bbcf928460dc tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action" status: 200 len: 32638 microversion: 2.1 time: 0.055848 Jan 15 21:39:26.313468 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3902/7791] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:39:26 2022] POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action => generated 32638 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:39:27.325559 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-63e2959d-a7b7-48e7-90b2-9005b041d10d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:39:27.326580 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-63e2959d-a7b7-48e7-90b2-9005b041d10d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:39:27.334572 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-63e2959d-a7b7-48e7-90b2-9005b041d10d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:39:27.335042 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-63e2959d-a7b7-48e7-90b2-9005b041d10d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:39:27.335825 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-63e2959d-a7b7-48e7-90b2-9005b041d10d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:39:27.336275 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-63e2959d-a7b7-48e7-90b2-9005b041d10d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:39:27.376883 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-63e2959d-a7b7-48e7-90b2-9005b041d10d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action" status: 200 len: 32638 microversion: 2.1 time: 0.055292 Jan 15 21:39:27.377768 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3890/7792] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:39:27 2022] POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action => generated 32638 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:39:28.387988 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-29c9f345-bb81-4a11-8c79-13a5fc9a6fc1 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:39:28.389070 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-29c9f345-bb81-4a11-8c79-13a5fc9a6fc1 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:39:28.396645 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-29c9f345-bb81-4a11-8c79-13a5fc9a6fc1 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:39:28.397116 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-29c9f345-bb81-4a11-8c79-13a5fc9a6fc1 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:39:28.397902 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-29c9f345-bb81-4a11-8c79-13a5fc9a6fc1 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:39:28.398350 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-29c9f345-bb81-4a11-8c79-13a5fc9a6fc1 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:39:28.438368 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-29c9f345-bb81-4a11-8c79-13a5fc9a6fc1 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action" status: 200 len: 32638 microversion: 2.1 time: 0.054323 Jan 15 21:39:28.439016 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3903/7793] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:39:28 2022] POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action => generated 32638 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:39:29.451913 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-178db15e-11f6-482d-abd5-914295084db8 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:39:29.452993 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-178db15e-11f6-482d-abd5-914295084db8 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:39:29.460631 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-178db15e-11f6-482d-abd5-914295084db8 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:39:29.461112 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-178db15e-11f6-482d-abd5-914295084db8 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:39:29.461905 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-178db15e-11f6-482d-abd5-914295084db8 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:39:29.462352 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-178db15e-11f6-482d-abd5-914295084db8 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:39:29.502640 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-178db15e-11f6-482d-abd5-914295084db8 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action" status: 200 len: 32638 microversion: 2.1 time: 0.055955 Jan 15 21:39:29.503291 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3891/7794] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:39:29 2022] POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action => generated 32638 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:39:30.515441 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a551a63f-3d37-4396-8e84-417687c16600 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:39:30.516433 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a551a63f-3d37-4396-8e84-417687c16600 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:39:30.524041 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a551a63f-3d37-4396-8e84-417687c16600 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:39:30.524495 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a551a63f-3d37-4396-8e84-417687c16600 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:39:30.525289 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a551a63f-3d37-4396-8e84-417687c16600 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:39:30.525725 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a551a63f-3d37-4396-8e84-417687c16600 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:39:30.564745 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a551a63f-3d37-4396-8e84-417687c16600 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action" status: 200 len: 32638 microversion: 2.1 time: 0.053252 Jan 15 21:39:30.565437 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3904/7795] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:39:30 2022] POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action => generated 32638 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:39:31.578984 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-0315e27b-6e58-44cb-9e90-4818f0f18f5b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:39:31.579925 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-0315e27b-6e58-44cb-9e90-4818f0f18f5b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:39:31.588153 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0315e27b-6e58-44cb-9e90-4818f0f18f5b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:39:31.588623 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0315e27b-6e58-44cb-9e90-4818f0f18f5b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:39:31.589486 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0315e27b-6e58-44cb-9e90-4818f0f18f5b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:39:31.589944 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0315e27b-6e58-44cb-9e90-4818f0f18f5b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:39:31.634443 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-0315e27b-6e58-44cb-9e90-4818f0f18f5b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action" status: 200 len: 32638 microversion: 2.1 time: 0.059546 Jan 15 21:39:31.635393 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3892/7796] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:39:31 2022] POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action => generated 32638 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:39:32.646772 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-61920db8-04c8-43d7-bf55-b417057c8821 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:39:32.647719 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-61920db8-04c8-43d7-bf55-b417057c8821 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:39:32.655579 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-61920db8-04c8-43d7-bf55-b417057c8821 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:39:32.656012 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-61920db8-04c8-43d7-bf55-b417057c8821 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:39:32.656798 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-61920db8-04c8-43d7-bf55-b417057c8821 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:39:32.657261 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-61920db8-04c8-43d7-bf55-b417057c8821 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:39:32.698103 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-61920db8-04c8-43d7-bf55-b417057c8821 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action" status: 200 len: 32638 microversion: 2.1 time: 0.055415 Jan 15 21:39:32.698765 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3905/7797] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:39:32 2022] POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action => generated 32638 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:39:33.711129 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-637ec387-5679-43ab-bee3-e0b85caac0fb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:39:33.712315 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-637ec387-5679-43ab-bee3-e0b85caac0fb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:39:33.719823 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-637ec387-5679-43ab-bee3-e0b85caac0fb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:39:33.720290 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-637ec387-5679-43ab-bee3-e0b85caac0fb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:39:33.721126 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-637ec387-5679-43ab-bee3-e0b85caac0fb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:39:33.721581 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-637ec387-5679-43ab-bee3-e0b85caac0fb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:39:33.762301 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-637ec387-5679-43ab-bee3-e0b85caac0fb tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action" status: 200 len: 32638 microversion: 2.1 time: 0.055808 Jan 15 21:39:33.762949 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3893/7798] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:39:33 2022] POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action => generated 32638 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:39:34.775430 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8683f3b9-1e81-465e-81ce-960bdbb61ea7 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:39:34.776437 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-8683f3b9-1e81-465e-81ce-960bdbb61ea7 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:39:34.784287 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8683f3b9-1e81-465e-81ce-960bdbb61ea7 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:39:34.785436 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8683f3b9-1e81-465e-81ce-960bdbb61ea7 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:39:34.786326 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8683f3b9-1e81-465e-81ce-960bdbb61ea7 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:39:34.787044 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8683f3b9-1e81-465e-81ce-960bdbb61ea7 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:39:34.826391 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-8683f3b9-1e81-465e-81ce-960bdbb61ea7 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action" status: 200 len: 32638 microversion: 2.1 time: 0.054961 Jan 15 21:39:34.827041 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3906/7799] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:39:34 2022] POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action => generated 32638 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 21:39:35.838378 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a624a07e-b06c-4666-9c70-43c4c401061b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:39:35.839436 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a624a07e-b06c-4666-9c70-43c4c401061b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:39:35.846897 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a624a07e-b06c-4666-9c70-43c4c401061b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:39:35.848252 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a624a07e-b06c-4666-9c70-43c4c401061b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:39:35.848908 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a624a07e-b06c-4666-9c70-43c4c401061b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:39:35.849372 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a624a07e-b06c-4666-9c70-43c4c401061b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:39:35.888580 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a624a07e-b06c-4666-9c70-43c4c401061b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action" status: 200 len: 32638 microversion: 2.1 time: 0.054166 Jan 15 21:39:35.889256 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3894/7800] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:39:35 2022] POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action => generated 32638 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:39:36.901104 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1437ac68-8db3-4d88-a569-8ae801190685 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:39:36.902112 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-1437ac68-8db3-4d88-a569-8ae801190685 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:39:36.909727 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1437ac68-8db3-4d88-a569-8ae801190685 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:39:36.910191 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1437ac68-8db3-4d88-a569-8ae801190685 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:39:36.911057 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1437ac68-8db3-4d88-a569-8ae801190685 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:39:36.911497 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1437ac68-8db3-4d88-a569-8ae801190685 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:39:36.950624 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-1437ac68-8db3-4d88-a569-8ae801190685 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action" status: 200 len: 32638 microversion: 2.1 time: 0.053499 Jan 15 21:39:36.951273 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3907/7801] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:39:36 2022] POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action => generated 32638 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:39:37.963248 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-eda6c22c-76c8-4166-9840-8272613f6eca tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:39:37.964314 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-eda6c22c-76c8-4166-9840-8272613f6eca tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:39:37.971963 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-eda6c22c-76c8-4166-9840-8272613f6eca tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:39:37.972454 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-eda6c22c-76c8-4166-9840-8272613f6eca tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:39:37.974013 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-eda6c22c-76c8-4166-9840-8272613f6eca tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:39:37.974514 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-eda6c22c-76c8-4166-9840-8272613f6eca tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:39:38.013220 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-eda6c22c-76c8-4166-9840-8272613f6eca tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action" status: 200 len: 32638 microversion: 2.1 time: 0.054000 Jan 15 21:39:38.013862 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3895/7802] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:39:37 2022] POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action => generated 32638 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:39:39.025437 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-eb8b8b8a-e432-49f2-adc5-a9edee1183f9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:39:39.026444 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-eb8b8b8a-e432-49f2-adc5-a9edee1183f9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:39:39.033811 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-eb8b8b8a-e432-49f2-adc5-a9edee1183f9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:39:39.034261 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-eb8b8b8a-e432-49f2-adc5-a9edee1183f9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:39:39.035669 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-eb8b8b8a-e432-49f2-adc5-a9edee1183f9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:39:39.036094 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-eb8b8b8a-e432-49f2-adc5-a9edee1183f9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:39:39.077996 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-eb8b8b8a-e432-49f2-adc5-a9edee1183f9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action" status: 200 len: 32638 microversion: 2.1 time: 0.056522 Jan 15 21:39:39.078655 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3908/7803] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:39:39 2022] POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action => generated 32638 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:39:40.090586 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d929625d-090d-4d50-9ece-8ddfcb5d57e4 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:39:40.091753 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d929625d-090d-4d50-9ece-8ddfcb5d57e4 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:39:40.099352 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d929625d-090d-4d50-9ece-8ddfcb5d57e4 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:39:40.099820 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d929625d-090d-4d50-9ece-8ddfcb5d57e4 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:39:40.100728 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d929625d-090d-4d50-9ece-8ddfcb5d57e4 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:39:40.101217 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d929625d-090d-4d50-9ece-8ddfcb5d57e4 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:39:40.141205 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d929625d-090d-4d50-9ece-8ddfcb5d57e4 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action" status: 200 len: 32638 microversion: 2.1 time: 0.054572 Jan 15 21:39:40.141780 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3896/7804] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:39:40 2022] POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action => generated 32638 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 21:39:41.153865 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4ca3b044-21ee-413f-968c-38815fe8a665 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:39:41.154857 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-4ca3b044-21ee-413f-968c-38815fe8a665 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:39:41.162532 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4ca3b044-21ee-413f-968c-38815fe8a665 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:39:41.162980 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4ca3b044-21ee-413f-968c-38815fe8a665 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:39:41.163753 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4ca3b044-21ee-413f-968c-38815fe8a665 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:39:41.164183 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4ca3b044-21ee-413f-968c-38815fe8a665 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:39:41.203122 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-4ca3b044-21ee-413f-968c-38815fe8a665 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action" status: 200 len: 32638 microversion: 2.1 time: 0.053462 Jan 15 21:39:41.203783 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3909/7805] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:39:41 2022] POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action => generated 32638 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:39:42.215492 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-411db2b7-481b-4dbd-a786-4366dab8aa8e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:39:42.216507 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-411db2b7-481b-4dbd-a786-4366dab8aa8e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:39:42.224041 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-411db2b7-481b-4dbd-a786-4366dab8aa8e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:39:42.224530 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-411db2b7-481b-4dbd-a786-4366dab8aa8e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:39:42.225350 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-411db2b7-481b-4dbd-a786-4366dab8aa8e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:39:42.225799 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-411db2b7-481b-4dbd-a786-4366dab8aa8e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:39:42.266207 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-411db2b7-481b-4dbd-a786-4366dab8aa8e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action" status: 200 len: 32638 microversion: 2.1 time: 0.054692 Jan 15 21:39:42.267049 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3897/7806] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:39:42 2022] POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action => generated 32638 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:39:43.279111 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c0a71428-40b1-4a07-a575-cdc234f91fd2 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:39:43.280117 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c0a71428-40b1-4a07-a575-cdc234f91fd2 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:39:43.288756 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c0a71428-40b1-4a07-a575-cdc234f91fd2 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:39:43.289238 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c0a71428-40b1-4a07-a575-cdc234f91fd2 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:39:43.290019 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c0a71428-40b1-4a07-a575-cdc234f91fd2 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:39:43.290459 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c0a71428-40b1-4a07-a575-cdc234f91fd2 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:39:43.336462 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c0a71428-40b1-4a07-a575-cdc234f91fd2 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action" status: 200 len: 32638 microversion: 2.1 time: 0.061353 Jan 15 21:39:43.337149 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3910/7807] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:39:43 2022] POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action => generated 32638 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:39:44.348165 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f569ec95-4048-4592-9b84-92e93d75be6d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:39:44.349417 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f569ec95-4048-4592-9b84-92e93d75be6d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:39:44.357069 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f569ec95-4048-4592-9b84-92e93d75be6d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:39:44.357535 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f569ec95-4048-4592-9b84-92e93d75be6d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:39:44.358337 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f569ec95-4048-4592-9b84-92e93d75be6d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:39:44.358785 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f569ec95-4048-4592-9b84-92e93d75be6d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:39:44.413862 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f569ec95-4048-4592-9b84-92e93d75be6d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action" status: 200 len: 40792 microversion: 2.1 time: 0.069704 Jan 15 21:39:44.414569 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3898/7808] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:39:44 2022] POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action => generated 40792 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:39:45.775780 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-3a08e768-ecb2-469d-99cd-e444b9596090 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:39:45.776481 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-3a08e768-ecb2-469d-99cd-e444b9596090 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:39:45.783451 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3a08e768-ecb2-469d-99cd-e444b9596090 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:39:45.783902 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3a08e768-ecb2-469d-99cd-e444b9596090 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:39:45.784684 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3a08e768-ecb2-469d-99cd-e444b9596090 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:39:45.785145 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3a08e768-ecb2-469d-99cd-e444b9596090 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:39:45.934327 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-3a08e768-ecb2-469d-99cd-e444b9596090 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:39:45.941658 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-3a08e768-ecb2-469d-99cd-e444b9596090 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af" status: 200 len: 1668 microversion: 2.1 time: 0.170070 Jan 15 21:39:45.942920 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3911/7809] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:39:45 2022] GET /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af => generated 1668 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:39:45.958985 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c8e8e409-001a-40ca-8341-fbbb1fcc2fd1 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a8b1aa16-195c-48c5-8c3a-219ddecd770a"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:39:45.960148 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c8e8e409-001a-40ca-8341-fbbb1fcc2fd1 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:39:45.967331 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c8e8e409-001a-40ca-8341-fbbb1fcc2fd1 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:39:45.967802 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c8e8e409-001a-40ca-8341-fbbb1fcc2fd1 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:39:45.968596 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c8e8e409-001a-40ca-8341-fbbb1fcc2fd1 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:39:45.969083 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c8e8e409-001a-40ca-8341-fbbb1fcc2fd1 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:39:46.202499 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c8e8e409-001a-40ca-8341-fbbb1fcc2fd1 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.247108 Jan 15 21:39:46.203177 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3899/7810] 10.222.0.46 () {60 vars in 1322 bytes} [Sat Jan 15 21:39:45 2022] POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/os-volume_attachments => generated 194 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:39:48.419621 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-879ff01e-00b0-4372-9fa3-db26a5b6cae9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:39:48.420589 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-879ff01e-00b0-4372-9fa3-db26a5b6cae9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:39:48.429187 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-879ff01e-00b0-4372-9fa3-db26a5b6cae9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:39:48.429643 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-879ff01e-00b0-4372-9fa3-db26a5b6cae9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:39:48.430426 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-879ff01e-00b0-4372-9fa3-db26a5b6cae9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:39:48.430872 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-879ff01e-00b0-4372-9fa3-db26a5b6cae9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:39:48.469683 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-879ff01e-00b0-4372-9fa3-db26a5b6cae9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:39:48.476730 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-879ff01e-00b0-4372-9fa3-db26a5b6cae9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Old instance type m1.heat2, new instance type m1.heat {{(pid=129366) resize /opt/stack/nova/nova/compute/api.py:4097}} Jan 15 21:39:48.483350 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-879ff01e-00b0-4372-9fa3-db26a5b6cae9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Flavor limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 21:39:48.483801 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-879ff01e-00b0-4372-9fa3-db26a5b6cae9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Image limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 21:39:48.484276 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-879ff01e-00b0-4372-9fa3-db26a5b6cae9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Flavor pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 21:39:48.484689 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-879ff01e-00b0-4372-9fa3-db26a5b6cae9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Image pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 21:39:48.485130 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-879ff01e-00b0-4372-9fa3-db26a5b6cae9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 21:39:48.548112 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-879ff01e-00b0-4372-9fa3-db26a5b6cae9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action" status: 202 len: 0 microversion: 2.1 time: 0.132171 Jan 15 21:39:48.552526 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3912/7811] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:39:48 2022] POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:39:48.557911 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a68542c1-62ed-431a-8d66-3ed4bb7e9cb1 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:39:48.558614 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a68542c1-62ed-431a-8d66-3ed4bb7e9cb1 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:39:48.565578 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a68542c1-62ed-431a-8d66-3ed4bb7e9cb1 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:39:48.566245 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a68542c1-62ed-431a-8d66-3ed4bb7e9cb1 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:39:48.567060 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a68542c1-62ed-431a-8d66-3ed4bb7e9cb1 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:39:48.567534 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a68542c1-62ed-431a-8d66-3ed4bb7e9cb1 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:39:48.729290 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-a68542c1-62ed-431a-8d66-3ed4bb7e9cb1 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:39:48.737427 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a68542c1-62ed-431a-8d66-3ed4bb7e9cb1 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af" status: 200 len: 1723 microversion: 2.1 time: 0.183570 Jan 15 21:39:48.738006 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3900/7812] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:39:48 2022] GET /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af => generated 1723 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:39:49.758433 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-572c3950-afdc-4625-8736-ff9cfa3d9f2a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:39:49.759053 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-572c3950-afdc-4625-8736-ff9cfa3d9f2a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:39:49.765905 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-572c3950-afdc-4625-8736-ff9cfa3d9f2a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:39:49.766385 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-572c3950-afdc-4625-8736-ff9cfa3d9f2a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:39:49.772907 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-572c3950-afdc-4625-8736-ff9cfa3d9f2a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:39:49.773374 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-572c3950-afdc-4625-8736-ff9cfa3d9f2a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:39:49.923733 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-572c3950-afdc-4625-8736-ff9cfa3d9f2a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:39:49.935792 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-572c3950-afdc-4625-8736-ff9cfa3d9f2a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af" status: 200 len: 1723 microversion: 2.1 time: 0.183859 Jan 15 21:39:49.937140 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3913/7813] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:39:49 2022] GET /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af => generated 1723 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:39:50.955481 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d79eee4b-94b0-4f1f-98c0-e21e02700ff8 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:39:50.956098 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d79eee4b-94b0-4f1f-98c0-e21e02700ff8 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:39:50.963487 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d79eee4b-94b0-4f1f-98c0-e21e02700ff8 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:39:50.963945 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d79eee4b-94b0-4f1f-98c0-e21e02700ff8 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:39:50.964742 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d79eee4b-94b0-4f1f-98c0-e21e02700ff8 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:39:50.965221 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d79eee4b-94b0-4f1f-98c0-e21e02700ff8 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:39:51.093695 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-d79eee4b-94b0-4f1f-98c0-e21e02700ff8 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:39:51.102056 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d79eee4b-94b0-4f1f-98c0-e21e02700ff8 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af" status: 200 len: 1728 microversion: 2.1 time: 0.151399 Jan 15 21:39:51.102644 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3901/7814] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:39:50 2022] GET /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:39:52.119442 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f5b0dc44-398c-40a5-a3d4-b791dd67ac38 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:39:52.120044 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f5b0dc44-398c-40a5-a3d4-b791dd67ac38 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:39:52.126803 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f5b0dc44-398c-40a5-a3d4-b791dd67ac38 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:39:52.127273 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f5b0dc44-398c-40a5-a3d4-b791dd67ac38 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:39:52.128047 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f5b0dc44-398c-40a5-a3d4-b791dd67ac38 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:39:52.128477 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f5b0dc44-398c-40a5-a3d4-b791dd67ac38 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:39:52.495961 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-f5b0dc44-398c-40a5-a3d4-b791dd67ac38 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:39:52.503913 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f5b0dc44-398c-40a5-a3d4-b791dd67ac38 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af" status: 200 len: 1728 microversion: 2.1 time: 0.388183 Jan 15 21:39:52.504501 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3914/7815] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:39:52 2022] GET /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af => generated 1728 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:39:53.521776 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-6f291aa1-9c00-4fa0-a232-7ed078264418 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:39:53.522409 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-6f291aa1-9c00-4fa0-a232-7ed078264418 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:39:53.529297 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6f291aa1-9c00-4fa0-a232-7ed078264418 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:39:53.529771 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6f291aa1-9c00-4fa0-a232-7ed078264418 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:39:53.530576 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6f291aa1-9c00-4fa0-a232-7ed078264418 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:39:53.531058 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6f291aa1-9c00-4fa0-a232-7ed078264418 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:39:53.659398 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-6f291aa1-9c00-4fa0-a232-7ed078264418 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:39:53.668202 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-6f291aa1-9c00-4fa0-a232-7ed078264418 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af" status: 200 len: 1728 microversion: 2.1 time: 0.151233 Jan 15 21:39:53.668818 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3902/7816] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:39:53 2022] GET /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:39:54.685629 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c6ddd735-5577-4ab7-bf32-39d847f6904d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:39:54.686242 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c6ddd735-5577-4ab7-bf32-39d847f6904d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:39:54.693282 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c6ddd735-5577-4ab7-bf32-39d847f6904d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:39:54.693734 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c6ddd735-5577-4ab7-bf32-39d847f6904d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:39:54.694515 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c6ddd735-5577-4ab7-bf32-39d847f6904d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:39:54.694950 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c6ddd735-5577-4ab7-bf32-39d847f6904d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:39:54.829964 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-c6ddd735-5577-4ab7-bf32-39d847f6904d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:39:54.838706 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c6ddd735-5577-4ab7-bf32-39d847f6904d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af" status: 200 len: 1728 microversion: 2.1 time: 0.156776 Jan 15 21:39:54.839305 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3915/7817] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:39:54 2022] GET /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:39:55.857446 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f6b88152-2dd5-446e-b660-2f74ff6ee4af tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:39:55.858060 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f6b88152-2dd5-446e-b660-2f74ff6ee4af tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:39:55.865831 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f6b88152-2dd5-446e-b660-2f74ff6ee4af tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:39:55.866305 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f6b88152-2dd5-446e-b660-2f74ff6ee4af tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:39:55.867106 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f6b88152-2dd5-446e-b660-2f74ff6ee4af tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:39:55.867563 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f6b88152-2dd5-446e-b660-2f74ff6ee4af tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:39:55.997551 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-f6b88152-2dd5-446e-b660-2f74ff6ee4af tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:39:56.006395 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f6b88152-2dd5-446e-b660-2f74ff6ee4af tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af" status: 200 len: 1728 microversion: 2.1 time: 0.152766 Jan 15 21:39:56.006979 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3903/7818] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:39:55 2022] GET /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:39:57.024192 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-57a18629-73a3-4443-95cb-37bfc2c719c5 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:39:57.024809 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-57a18629-73a3-4443-95cb-37bfc2c719c5 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:39:57.031860 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-57a18629-73a3-4443-95cb-37bfc2c719c5 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:39:57.032309 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-57a18629-73a3-4443-95cb-37bfc2c719c5 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:39:57.033195 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-57a18629-73a3-4443-95cb-37bfc2c719c5 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:39:57.033635 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-57a18629-73a3-4443-95cb-37bfc2c719c5 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:39:57.163754 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-57a18629-73a3-4443-95cb-37bfc2c719c5 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:39:57.171630 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-57a18629-73a3-4443-95cb-37bfc2c719c5 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af" status: 200 len: 1728 microversion: 2.1 time: 0.151713 Jan 15 21:39:57.172211 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3916/7819] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:39:57 2022] GET /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:39:58.188585 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-52b36879-5f36-4df1-8f24-dbe1e38055bd tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:39:58.189254 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-52b36879-5f36-4df1-8f24-dbe1e38055bd tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:39:58.197088 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-52b36879-5f36-4df1-8f24-dbe1e38055bd tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:39:58.197559 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-52b36879-5f36-4df1-8f24-dbe1e38055bd tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:39:58.198351 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-52b36879-5f36-4df1-8f24-dbe1e38055bd tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:39:58.198801 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-52b36879-5f36-4df1-8f24-dbe1e38055bd tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:39:58.335072 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-52b36879-5f36-4df1-8f24-dbe1e38055bd tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:39:58.342944 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-52b36879-5f36-4df1-8f24-dbe1e38055bd tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af" status: 200 len: 1728 microversion: 2.1 time: 0.158126 Jan 15 21:39:58.343538 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3904/7820] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:39:58 2022] GET /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af => generated 1728 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:39:59.359350 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b27c0765-7b77-4025-a4df-284ed52b1041 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:39:59.359964 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b27c0765-7b77-4025-a4df-284ed52b1041 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:39:59.368139 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b27c0765-7b77-4025-a4df-284ed52b1041 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:39:59.368588 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b27c0765-7b77-4025-a4df-284ed52b1041 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:39:59.369516 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b27c0765-7b77-4025-a4df-284ed52b1041 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:39:59.369954 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b27c0765-7b77-4025-a4df-284ed52b1041 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:39:59.499431 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-b27c0765-7b77-4025-a4df-284ed52b1041 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:39:59.507996 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b27c0765-7b77-4025-a4df-284ed52b1041 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af" status: 200 len: 1728 microversion: 2.1 time: 0.152452 Jan 15 21:39:59.508584 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3917/7821] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:39:59 2022] GET /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:40:00.525310 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9894e521-8ae1-4773-a836-8b86a6699a4e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:40:00.525939 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-9894e521-8ae1-4773-a836-8b86a6699a4e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:40:00.532734 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9894e521-8ae1-4773-a836-8b86a6699a4e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:00.533237 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9894e521-8ae1-4773-a836-8b86a6699a4e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:00.534036 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9894e521-8ae1-4773-a836-8b86a6699a4e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:00.534494 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9894e521-8ae1-4773-a836-8b86a6699a4e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:00.667103 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-9894e521-8ae1-4773-a836-8b86a6699a4e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:40:00.675016 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-9894e521-8ae1-4773-a836-8b86a6699a4e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af" status: 200 len: 1728 microversion: 2.1 time: 0.153440 Jan 15 21:40:00.675603 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3905/7822] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:40:00 2022] GET /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:40:01.693082 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-71faf2d6-4b7d-4786-8ae4-ec64060bbdb1 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:40:01.693864 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-71faf2d6-4b7d-4786-8ae4-ec64060bbdb1 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:40:01.700698 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-71faf2d6-4b7d-4786-8ae4-ec64060bbdb1 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:01.701183 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-71faf2d6-4b7d-4786-8ae4-ec64060bbdb1 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:01.701970 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-71faf2d6-4b7d-4786-8ae4-ec64060bbdb1 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:01.702412 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-71faf2d6-4b7d-4786-8ae4-ec64060bbdb1 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:01.832640 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-71faf2d6-4b7d-4786-8ae4-ec64060bbdb1 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:40:01.840792 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-71faf2d6-4b7d-4786-8ae4-ec64060bbdb1 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af" status: 200 len: 1728 microversion: 2.1 time: 0.152137 Jan 15 21:40:01.841405 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3918/7823] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:40:01 2022] GET /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:40:02.858047 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9b55820d-5883-4508-bec9-f9c2c0918ab5 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:40:02.858658 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-9b55820d-5883-4508-bec9-f9c2c0918ab5 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:40:02.867242 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9b55820d-5883-4508-bec9-f9c2c0918ab5 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:02.867716 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9b55820d-5883-4508-bec9-f9c2c0918ab5 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:02.868567 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9b55820d-5883-4508-bec9-f9c2c0918ab5 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:02.869284 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9b55820d-5883-4508-bec9-f9c2c0918ab5 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:03.005440 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-9b55820d-5883-4508-bec9-f9c2c0918ab5 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:40:03.013932 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-9b55820d-5883-4508-bec9-f9c2c0918ab5 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af" status: 200 len: 1728 microversion: 2.1 time: 0.159699 Jan 15 21:40:03.014722 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3906/7824] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:40:02 2022] GET /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af => generated 1728 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:40:03.830361 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-4f231905-fd80-48de-9c18-d3ecb93a9d57 req-943157ae-f746-4a0f-9f6c-a3e9b5340c2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af", "name": "network-vif-unplugged", "status": "completed", "tag": "ee473c50-b3e4-41c2-8cc4-886638a28c50"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:40:03.832025 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:40:03.832025 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:40:03.840741 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-4f231905-fd80-48de-9c18-d3ecb93a9d57 req-943157ae-f746-4a0f-9f6c-a3e9b5340c2c service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:03.841027 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-4f231905-fd80-48de-9c18-d3ecb93a9d57 req-943157ae-f746-4a0f-9f6c-a3e9b5340c2c service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:03.853541 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-4f231905-fd80-48de-9c18-d3ecb93a9d57 req-943157ae-f746-4a0f-9f6c-a3e9b5340c2c service nova] Creating event network-vif-unplugged:ee473c50-b3e4-41c2-8cc4-886638a28c50 for instance 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af on nch2-master-1 Jan 15 21:40:03.859269 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [req-4f231905-fd80-48de-9c18-d3ecb93a9d57 req-943157ae-f746-4a0f-9f6c-a3e9b5340c2c service nova] Instance 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=129366) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Jan 15 21:40:03.870861 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-4f231905-fd80-48de-9c18-d3ecb93a9d57 req-943157ae-f746-4a0f-9f6c-a3e9b5340c2c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044388 Jan 15 21:40:03.871759 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3919/7825] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:40:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 21:40:04.032906 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-45588425-baae-489d-a010-171258308b49 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:40:04.033537 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-45588425-baae-489d-a010-171258308b49 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:40:04.041681 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-45588425-baae-489d-a010-171258308b49 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:04.042157 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-45588425-baae-489d-a010-171258308b49 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:04.042982 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-45588425-baae-489d-a010-171258308b49 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:04.043436 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-45588425-baae-489d-a010-171258308b49 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:04.187480 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-45588425-baae-489d-a010-171258308b49 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:40:04.196492 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-45588425-baae-489d-a010-171258308b49 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af" status: 200 len: 1727 microversion: 2.1 time: 0.167341 Jan 15 21:40:04.197373 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3907/7826] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:40:04 2022] GET /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af => generated 1727 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:40:05.214020 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d23e9860-476e-4a74-98fa-cee4cf32f72c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:40:05.214638 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-d23e9860-476e-4a74-98fa-cee4cf32f72c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:40:05.222115 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d23e9860-476e-4a74-98fa-cee4cf32f72c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:05.222565 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d23e9860-476e-4a74-98fa-cee4cf32f72c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:05.223348 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d23e9860-476e-4a74-98fa-cee4cf32f72c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:05.224269 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d23e9860-476e-4a74-98fa-cee4cf32f72c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:05.361014 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-d23e9860-476e-4a74-98fa-cee4cf32f72c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:40:05.369094 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d23e9860-476e-4a74-98fa-cee4cf32f72c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af" status: 200 len: 1725 microversion: 2.1 time: 0.159119 Jan 15 21:40:05.369786 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3920/7827] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:40:05 2022] GET /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:40:05.887083 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-e3fd1559-147b-4ac8-a037-840828a03e1c req-61c13f08-3efb-4dbb-94b4-ef2abe9fad74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af", "tag": "ee473c50-b3e4-41c2-8cc4-886638a28c50"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:40:05.888693 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:40:05.888693 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:40:05.897413 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-e3fd1559-147b-4ac8-a037-840828a03e1c req-61c13f08-3efb-4dbb-94b4-ef2abe9fad74 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:05.897875 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-e3fd1559-147b-4ac8-a037-840828a03e1c req-61c13f08-3efb-4dbb-94b4-ef2abe9fad74 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:05.909409 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-e3fd1559-147b-4ac8-a037-840828a03e1c req-61c13f08-3efb-4dbb-94b4-ef2abe9fad74 service nova] Creating event network-changed:ee473c50-b3e4-41c2-8cc4-886638a28c50 for instance 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af on nch2-master-1 Jan 15 21:40:05.915220 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [req-e3fd1559-147b-4ac8-a037-840828a03e1c req-61c13f08-3efb-4dbb-94b4-ef2abe9fad74 service nova] Instance 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=129365) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Jan 15 21:40:05.925766 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-e3fd1559-147b-4ac8-a037-840828a03e1c req-61c13f08-3efb-4dbb-94b4-ef2abe9fad74 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042406 Jan 15 21:40:05.926359 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3908/7828] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:40:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:40:06.386936 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-fc0ae42c-92b3-4be5-99a6-ea90edb586f9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:40:06.387659 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-fc0ae42c-92b3-4be5-99a6-ea90edb586f9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:40:06.394614 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fc0ae42c-92b3-4be5-99a6-ea90edb586f9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:06.395141 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fc0ae42c-92b3-4be5-99a6-ea90edb586f9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:06.396196 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fc0ae42c-92b3-4be5-99a6-ea90edb586f9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:06.396645 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fc0ae42c-92b3-4be5-99a6-ea90edb586f9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:06.534223 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-fc0ae42c-92b3-4be5-99a6-ea90edb586f9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:40:06.543557 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-fc0ae42c-92b3-4be5-99a6-ea90edb586f9 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af" status: 200 len: 1725 microversion: 2.1 time: 0.160340 Jan 15 21:40:06.544271 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3921/7829] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:40:06 2022] GET /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:40:07.561980 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-71f4ffb3-69a7-4d4e-b322-bf2e655cb555 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:40:07.562680 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-71f4ffb3-69a7-4d4e-b322-bf2e655cb555 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:40:07.569422 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-71f4ffb3-69a7-4d4e-b322-bf2e655cb555 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:07.569882 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-71f4ffb3-69a7-4d4e-b322-bf2e655cb555 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:07.570665 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-71f4ffb3-69a7-4d4e-b322-bf2e655cb555 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:07.571109 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-71f4ffb3-69a7-4d4e-b322-bf2e655cb555 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:07.705569 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-71f4ffb3-69a7-4d4e-b322-bf2e655cb555 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:40:07.713496 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-71f4ffb3-69a7-4d4e-b322-bf2e655cb555 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af" status: 200 len: 1725 microversion: 2.1 time: 0.156458 Jan 15 21:40:07.714077 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3909/7830] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:40:07 2022] GET /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:40:08.730790 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ca866702-14d1-4fc2-901d-c6c52a49ddc2 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:40:08.731406 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ca866702-14d1-4fc2-901d-c6c52a49ddc2 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:40:08.738234 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ca866702-14d1-4fc2-901d-c6c52a49ddc2 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:08.738692 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ca866702-14d1-4fc2-901d-c6c52a49ddc2 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:08.740697 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ca866702-14d1-4fc2-901d-c6c52a49ddc2 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:08.741164 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ca866702-14d1-4fc2-901d-c6c52a49ddc2 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:08.873683 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-ca866702-14d1-4fc2-901d-c6c52a49ddc2 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:40:08.882228 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ca866702-14d1-4fc2-901d-c6c52a49ddc2 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af" status: 200 len: 1725 microversion: 2.1 time: 0.155224 Jan 15 21:40:08.882813 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3922/7831] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:40:08 2022] GET /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:40:09.900047 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8acf277f-cbf1-49d1-a303-2b2a7f24b67c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:40:09.900673 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-8acf277f-cbf1-49d1-a303-2b2a7f24b67c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:40:09.907631 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8acf277f-cbf1-49d1-a303-2b2a7f24b67c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:09.908099 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8acf277f-cbf1-49d1-a303-2b2a7f24b67c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:09.908918 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8acf277f-cbf1-49d1-a303-2b2a7f24b67c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:09.909376 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8acf277f-cbf1-49d1-a303-2b2a7f24b67c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:10.046516 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-8acf277f-cbf1-49d1-a303-2b2a7f24b67c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:40:10.055814 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-8acf277f-cbf1-49d1-a303-2b2a7f24b67c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af" status: 200 len: 1722 microversion: 2.1 time: 0.160127 Jan 15 21:40:10.056416 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3910/7832] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:40:09 2022] GET /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:40:10.072631 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e58c90d5-36c1-4a25-9a99-7c0316d095db tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:40:10.073203 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e58c90d5-36c1-4a25-9a99-7c0316d095db tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:40:10.079924 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e58c90d5-36c1-4a25-9a99-7c0316d095db tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:10.080387 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e58c90d5-36c1-4a25-9a99-7c0316d095db tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:10.081223 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e58c90d5-36c1-4a25-9a99-7c0316d095db tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:10.081668 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e58c90d5-36c1-4a25-9a99-7c0316d095db tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:10.112456 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e58c90d5-36c1-4a25-9a99-7c0316d095db tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:10.112950 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e58c90d5-36c1-4a25-9a99-7c0316d095db tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:10.113769 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e58c90d5-36c1-4a25-9a99-7c0316d095db tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:10.114926 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e58c90d5-36c1-4a25-9a99-7c0316d095db tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:10.135728 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-e58c90d5-36c1-4a25-9a99-7c0316d095db tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Getting quotas for project 2d89bb23cded412ea3ca57cc844bfabf. Resources: {'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:40:10.140814 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-e58c90d5-36c1-4a25-9a99-7c0316d095db tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Getting quotas for user b3fbd604b5a640b480e5d115e469375e and project 2d89bb23cded412ea3ca57cc844bfabf. Resources: {'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:40:10.247053 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e58c90d5-36c1-4a25-9a99-7c0316d095db tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action" status: 202 len: 0 microversion: 2.1 time: 0.177935 Jan 15 21:40:10.247672 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3923/7833] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:40:10 2022] POST /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/action => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:40:10.255863 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5d2b2e0b-701b-4a27-a5f2-f855e1de7cd1 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:40:10.256497 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-5d2b2e0b-701b-4a27-a5f2-f855e1de7cd1 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:40:10.262620 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5d2b2e0b-701b-4a27-a5f2-f855e1de7cd1 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:10.263096 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5d2b2e0b-701b-4a27-a5f2-f855e1de7cd1 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:10.263911 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5d2b2e0b-701b-4a27-a5f2-f855e1de7cd1 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:10.264372 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5d2b2e0b-701b-4a27-a5f2-f855e1de7cd1 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:10.404500 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-5d2b2e0b-701b-4a27-a5f2-f855e1de7cd1 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:40:10.414192 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5d2b2e0b-701b-4a27-a5f2-f855e1de7cd1 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af" status: 200 len: 1721 microversion: 2.1 time: 0.162251 Jan 15 21:40:10.414789 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3911/7834] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:40:10 2022] GET /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:40:10.991146 ncdv-master-1 devstack@n-api.service[129366]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 15 21:40:10.991391 ncdv-master-1 devstack@n-api.service[129366]: Sat Jan 15 21:40:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 15 21:40:11.321691 ncdv-master-1 devstack@n-api.service[129365]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 15 21:40:11.322256 ncdv-master-1 devstack@n-api.service[129365]: Sat Jan 15 21:40:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 15 21:40:11.433038 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8c6b64b3-ef43-49db-9fd9-6b10f03b1fee tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:40:11.433747 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-8c6b64b3-ef43-49db-9fd9-6b10f03b1fee tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:40:11.440856 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8c6b64b3-ef43-49db-9fd9-6b10f03b1fee tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:11.441323 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8c6b64b3-ef43-49db-9fd9-6b10f03b1fee tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:11.442187 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8c6b64b3-ef43-49db-9fd9-6b10f03b1fee tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:11.442704 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8c6b64b3-ef43-49db-9fd9-6b10f03b1fee tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:11.581435 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-8c6b64b3-ef43-49db-9fd9-6b10f03b1fee tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:40:11.589908 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-8c6b64b3-ef43-49db-9fd9-6b10f03b1fee tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af" status: 200 len: 1721 microversion: 2.1 time: 0.161946 Jan 15 21:40:11.590486 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3924/7835] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:40:11 2022] GET /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:40:12.607530 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3cad2b98-91cd-4e8b-a65d-d9a89c2c9309 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:40:12.608250 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-3cad2b98-91cd-4e8b-a65d-d9a89c2c9309 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:40:12.616390 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3cad2b98-91cd-4e8b-a65d-d9a89c2c9309 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:12.616981 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3cad2b98-91cd-4e8b-a65d-d9a89c2c9309 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:12.617777 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3cad2b98-91cd-4e8b-a65d-d9a89c2c9309 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:12.618223 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3cad2b98-91cd-4e8b-a65d-d9a89c2c9309 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:12.755648 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-3cad2b98-91cd-4e8b-a65d-d9a89c2c9309 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:40:12.764721 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3cad2b98-91cd-4e8b-a65d-d9a89c2c9309 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af" status: 200 len: 1721 microversion: 2.1 time: 0.160176 Jan 15 21:40:12.765510 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3912/7836] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:40:12 2022] GET /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:40:13.782820 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-94ab19ad-2315-447d-b241-a2d21298ab2e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:40:13.784004 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-94ab19ad-2315-447d-b241-a2d21298ab2e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:40:13.791916 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-94ab19ad-2315-447d-b241-a2d21298ab2e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:13.792373 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-94ab19ad-2315-447d-b241-a2d21298ab2e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:13.793189 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-94ab19ad-2315-447d-b241-a2d21298ab2e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:13.793623 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-94ab19ad-2315-447d-b241-a2d21298ab2e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:14.040903 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-94ab19ad-2315-447d-b241-a2d21298ab2e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:40:14.049748 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-94ab19ad-2315-447d-b241-a2d21298ab2e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af" status: 200 len: 1721 microversion: 2.1 time: 0.270826 Jan 15 21:40:14.050654 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3925/7837] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:40:13 2022] GET /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af => generated 1721 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:40:14.291024 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-ca910c56-04df-4d74-9b03-8b0662c97120 req-38d16e7c-b993-452f-bb0e-83dde7de072d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af", "tag": "ee473c50-b3e4-41c2-8cc4-886638a28c50"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:40:14.292774 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:40:14.292774 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:40:14.307985 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-ca910c56-04df-4d74-9b03-8b0662c97120 req-38d16e7c-b993-452f-bb0e-83dde7de072d service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:14.308452 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-ca910c56-04df-4d74-9b03-8b0662c97120 req-38d16e7c-b993-452f-bb0e-83dde7de072d service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:14.327355 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-ca910c56-04df-4d74-9b03-8b0662c97120 req-38d16e7c-b993-452f-bb0e-83dde7de072d service nova] Creating event network-changed:ee473c50-b3e4-41c2-8cc4-886638a28c50 for instance 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af on nch1-master-1 Jan 15 21:40:14.335517 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [req-ca910c56-04df-4d74-9b03-8b0662c97120 req-38d16e7c-b993-452f-bb0e-83dde7de072d service nova] Instance 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=129365) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Jan 15 21:40:14.351954 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-ca910c56-04df-4d74-9b03-8b0662c97120 req-38d16e7c-b993-452f-bb0e-83dde7de072d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065924 Jan 15 21:40:14.353561 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3913/7838] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:40:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:40:15.067277 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ec0eb68d-a346-4ef5-a314-91b6c954c4bd tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:40:15.068098 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ec0eb68d-a346-4ef5-a314-91b6c954c4bd tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:40:15.075436 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ec0eb68d-a346-4ef5-a314-91b6c954c4bd tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:15.076166 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ec0eb68d-a346-4ef5-a314-91b6c954c4bd tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:15.076999 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ec0eb68d-a346-4ef5-a314-91b6c954c4bd tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:15.077736 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ec0eb68d-a346-4ef5-a314-91b6c954c4bd tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:15.222436 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-ec0eb68d-a346-4ef5-a314-91b6c954c4bd tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:40:15.231692 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ec0eb68d-a346-4ef5-a314-91b6c954c4bd tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af" status: 200 len: 1721 microversion: 2.1 time: 0.168253 Jan 15 21:40:15.232291 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3926/7839] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:40:15 2022] GET /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af => generated 1721 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:40:16.251208 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d9125c15-8234-46e3-9796-5275e77eb841 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:40:16.251847 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d9125c15-8234-46e3-9796-5275e77eb841 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:40:16.258645 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d9125c15-8234-46e3-9796-5275e77eb841 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:16.259104 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d9125c15-8234-46e3-9796-5275e77eb841 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:16.259891 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d9125c15-8234-46e3-9796-5275e77eb841 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:16.260334 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d9125c15-8234-46e3-9796-5275e77eb841 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:16.440914 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-d9125c15-8234-46e3-9796-5275e77eb841 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:40:16.449464 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d9125c15-8234-46e3-9796-5275e77eb841 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af" status: 200 len: 1721 microversion: 2.1 time: 0.203269 Jan 15 21:40:16.450045 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3914/7840] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:40:16 2022] GET /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af => generated 1721 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:40:17.466323 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4fdfa905-a40a-4653-b3ec-8cd09542cba7 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:40:17.466940 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-4fdfa905-a40a-4653-b3ec-8cd09542cba7 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:40:17.474398 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4fdfa905-a40a-4653-b3ec-8cd09542cba7 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:17.474855 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4fdfa905-a40a-4653-b3ec-8cd09542cba7 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:17.475638 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4fdfa905-a40a-4653-b3ec-8cd09542cba7 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:17.476078 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4fdfa905-a40a-4653-b3ec-8cd09542cba7 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:17.616574 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-4fdfa905-a40a-4653-b3ec-8cd09542cba7 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:40:17.624797 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-4fdfa905-a40a-4653-b3ec-8cd09542cba7 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af" status: 200 len: 1721 microversion: 2.1 time: 0.162190 Jan 15 21:40:17.625450 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3927/7841] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:40:17 2022] GET /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:40:18.642344 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-4ae3998f-c778-40db-aa99-125270edc01b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:40:18.642894 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-4ae3998f-c778-40db-aa99-125270edc01b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:40:18.650476 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4ae3998f-c778-40db-aa99-125270edc01b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:18.650963 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4ae3998f-c778-40db-aa99-125270edc01b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:18.651744 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4ae3998f-c778-40db-aa99-125270edc01b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:18.652197 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4ae3998f-c778-40db-aa99-125270edc01b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:18.784317 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-4ae3998f-c778-40db-aa99-125270edc01b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:40:18.792723 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-4ae3998f-c778-40db-aa99-125270edc01b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af" status: 200 len: 1714 microversion: 2.1 time: 0.154573 Jan 15 21:40:18.793395 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3915/7842] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:40:18 2022] GET /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af => generated 1714 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:40:18.808884 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c5ffcadc-f17b-4ccf-99ac-0b09fb71d658 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:40:18.809495 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c5ffcadc-f17b-4ccf-99ac-0b09fb71d658 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:40:18.816288 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c5ffcadc-f17b-4ccf-99ac-0b09fb71d658 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:18.817266 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c5ffcadc-f17b-4ccf-99ac-0b09fb71d658 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:18.818259 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c5ffcadc-f17b-4ccf-99ac-0b09fb71d658 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:18.818572 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c5ffcadc-f17b-4ccf-99ac-0b09fb71d658 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:18.952180 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-c5ffcadc-f17b-4ccf-99ac-0b09fb71d658 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:40:18.960583 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c5ffcadc-f17b-4ccf-99ac-0b09fb71d658 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af" status: 200 len: 1714 microversion: 2.1 time: 0.155380 Jan 15 21:40:18.961196 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3928/7843] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:40:18 2022] GET /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af => generated 1714 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:40:18.976368 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-79bd8874-f3ff-49e6-8f13-acf08749575a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:40:18.977035 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-79bd8874-f3ff-49e6-8f13-acf08749575a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:40:18.983074 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-79bd8874-f3ff-49e6-8f13-acf08749575a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:18.983537 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-79bd8874-f3ff-49e6-8f13-acf08749575a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:18.984329 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-79bd8874-f3ff-49e6-8f13-acf08749575a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:18.984782 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-79bd8874-f3ff-49e6-8f13-acf08749575a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:19.111455 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-79bd8874-f3ff-49e6-8f13-acf08749575a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:40:19.119917 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-79bd8874-f3ff-49e6-8f13-acf08749575a tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af" status: 200 len: 1714 microversion: 2.1 time: 0.147267 Jan 15 21:40:19.120478 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3916/7844] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:40:18 2022] GET /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af => generated 1714 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:40:19.136356 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ec1a6bfc-bd49-4e1a-b6d8-fbbe019cc44e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:40:19.136872 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ec1a6bfc-bd49-4e1a-b6d8-fbbe019cc44e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:40:19.143065 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ec1a6bfc-bd49-4e1a-b6d8-fbbe019cc44e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:19.143585 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ec1a6bfc-bd49-4e1a-b6d8-fbbe019cc44e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:19.144569 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ec1a6bfc-bd49-4e1a-b6d8-fbbe019cc44e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:19.145240 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ec1a6bfc-bd49-4e1a-b6d8-fbbe019cc44e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:19.170194 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ec1a6bfc-bd49-4e1a-b6d8-fbbe019cc44e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Going to try to terminate instance {{(pid=129366) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 21:40:19.245955 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ec1a6bfc-bd49-4e1a-b6d8-fbbe019cc44e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "DELETE /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af" status: 204 len: 0 microversion: 2.1 time: 0.112934 Jan 15 21:40:19.246815 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3929/7845] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 21:40:19 2022] DELETE /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 21:40:19.254685 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-fad3c612-8c8f-4eff-bbdd-fdfd3211cf34 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:40:19.255337 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-fad3c612-8c8f-4eff-bbdd-fdfd3211cf34 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:40:19.261757 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fad3c612-8c8f-4eff-bbdd-fdfd3211cf34 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:19.262223 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fad3c612-8c8f-4eff-bbdd-fdfd3211cf34 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:19.263017 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fad3c612-8c8f-4eff-bbdd-fdfd3211cf34 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:19.263469 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fad3c612-8c8f-4eff-bbdd-fdfd3211cf34 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:19.396056 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-fad3c612-8c8f-4eff-bbdd-fdfd3211cf34 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:40:19.403981 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-fad3c612-8c8f-4eff-bbdd-fdfd3211cf34 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af" status: 200 len: 1720 microversion: 2.1 time: 0.153075 Jan 15 21:40:19.404562 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3917/7846] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:40:19 2022] GET /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:40:20.422626 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-6f8f77a1-6450-4044-8e9f-bbdac9c2efb4 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:40:20.423324 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-6f8f77a1-6450-4044-8e9f-bbdac9c2efb4 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:40:20.430501 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6f8f77a1-6450-4044-8e9f-bbdac9c2efb4 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:20.430952 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6f8f77a1-6450-4044-8e9f-bbdac9c2efb4 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:20.431740 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6f8f77a1-6450-4044-8e9f-bbdac9c2efb4 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:20.432172 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6f8f77a1-6450-4044-8e9f-bbdac9c2efb4 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:20.565104 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-6f8f77a1-6450-4044-8e9f-bbdac9c2efb4 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:40:20.574222 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-6f8f77a1-6450-4044-8e9f-bbdac9c2efb4 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af" status: 200 len: 1720 microversion: 2.1 time: 0.156490 Jan 15 21:40:20.574799 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3930/7847] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:40:20 2022] GET /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:40:21.591446 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5726d590-af86-4b35-bd8b-a5a6a5d56c6f tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:40:21.592215 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-5726d590-af86-4b35-bd8b-a5a6a5d56c6f tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:40:21.599243 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5726d590-af86-4b35-bd8b-a5a6a5d56c6f tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:21.599801 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5726d590-af86-4b35-bd8b-a5a6a5d56c6f tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:21.600657 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5726d590-af86-4b35-bd8b-a5a6a5d56c6f tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:21.601203 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5726d590-af86-4b35-bd8b-a5a6a5d56c6f tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:21.671885 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-5726d590-af86-4b35-bd8b-a5a6a5d56c6f tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fbd604b5a640b480e5d115e469375e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d89bb23cded412ea3ca57cc844bfabf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:40:21.682824 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5726d590-af86-4b35-bd8b-a5a6a5d56c6f tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af" status: 200 len: 1652 microversion: 2.1 time: 0.095032 Jan 15 21:40:21.683744 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3918/7848] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:40:21 2022] GET /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af => generated 1652 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:40:21.687258 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-cdc0bcaf-3881-4e30-8990-d93ca23e2228 req-36fe1345-d26e-49cc-87d2-d7f30a03b862 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af", "name": "network-vif-deleted", "tag": "ee473c50-b3e4-41c2-8cc4-886638a28c50"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:40:21.689365 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:40:21.689365 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:40:21.700192 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-cdc0bcaf-3881-4e30-8990-d93ca23e2228 req-36fe1345-d26e-49cc-87d2-d7f30a03b862 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:21.700764 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-cdc0bcaf-3881-4e30-8990-d93ca23e2228 req-36fe1345-d26e-49cc-87d2-d7f30a03b862 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:21.714664 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-cdc0bcaf-3881-4e30-8990-d93ca23e2228 req-36fe1345-d26e-49cc-87d2-d7f30a03b862 service nova] Creating event network-vif-deleted:ee473c50-b3e4-41c2-8cc4-886638a28c50 for instance 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af on nch1-master-1 Jan 15 21:40:21.719677 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-cdc0bcaf-3881-4e30-8990-d93ca23e2228 req-36fe1345-d26e-49cc-87d2-d7f30a03b862 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036268 Jan 15 21:40:21.720299 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3931/7849] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:40:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:40:22.701093 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-95152efa-dbbd-4e16-9149-d930cbb2785b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:40:22.701729 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-95152efa-dbbd-4e16-9149-d930cbb2785b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:40:22.710580 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-95152efa-dbbd-4e16-9149-d930cbb2785b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:22.711544 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-95152efa-dbbd-4e16-9149-d930cbb2785b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:22.712741 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-95152efa-dbbd-4e16-9149-d930cbb2785b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:22.713487 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-95152efa-dbbd-4e16-9149-d930cbb2785b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:22.727816 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-95152efa-dbbd-4e16-9149-d930cbb2785b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] HTTP exception thrown: Instance 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af could not be found. Jan 15 21:40:22.728470 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-95152efa-dbbd-4e16-9149-d930cbb2785b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Returning 404 to user: Instance 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:40:22.729465 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-95152efa-dbbd-4e16-9149-d930cbb2785b tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af" status: 404 len: 111 microversion: 2.1 time: 0.032642 Jan 15 21:40:22.730038 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3919/7850] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:40:22 2022] GET /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:40:22.787798 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-daaa06a6-1d70-406f-93f5-99119bfa07fe tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:40:22.788811 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-daaa06a6-1d70-406f-93f5-99119bfa07fe tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:40:22.795288 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-daaa06a6-1d70-406f-93f5-99119bfa07fe tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:22.795746 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-daaa06a6-1d70-406f-93f5-99119bfa07fe tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:22.796540 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-daaa06a6-1d70-406f-93f5-99119bfa07fe tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:22.797009 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-daaa06a6-1d70-406f-93f5-99119bfa07fe tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:22.811086 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-daaa06a6-1d70-406f-93f5-99119bfa07fe tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] HTTP exception thrown: Instance 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af could not be found. Jan 15 21:40:22.811762 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-daaa06a6-1d70-406f-93f5-99119bfa07fe tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Returning 404 to user: Instance 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:40:22.812606 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-daaa06a6-1d70-406f-93f5-99119bfa07fe tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.030502 Jan 15 21:40:22.813197 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3932/7851] 10.222.0.46 () {58 vars in 1301 bytes} [Sat Jan 15 21:40:22 2022] GET /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af/os-volume_attachments => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:40:24.032394 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2b295962-89c8-4bc5-b69b-bdd8a4178649 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:40:24.032921 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-2b295962-89c8-4bc5-b69b-bdd8a4178649 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:40:24.040617 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2b295962-89c8-4bc5-b69b-bdd8a4178649 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:24.041167 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2b295962-89c8-4bc5-b69b-bdd8a4178649 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:24.041957 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2b295962-89c8-4bc5-b69b-bdd8a4178649 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:24.042404 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2b295962-89c8-4bc5-b69b-bdd8a4178649 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:24.056202 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-2b295962-89c8-4bc5-b69b-bdd8a4178649 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] HTTP exception thrown: Instance 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af could not be found. Jan 15 21:40:24.056791 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2b295962-89c8-4bc5-b69b-bdd8a4178649 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Returning 404 to user: Instance 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:40:24.057639 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2b295962-89c8-4bc5-b69b-bdd8a4178649 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "DELETE /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af" status: 404 len: 111 microversion: 2.1 time: 0.028958 Jan 15 21:40:24.058174 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3920/7852] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 21:40:24 2022] DELETE /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:40:24.066225 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-6d11e27d-3eb2-48ca-b3d0-d5610d5d5e85 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:40:24.066922 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-6d11e27d-3eb2-48ca-b3d0-d5610d5d5e85 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:40:24.074019 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6d11e27d-3eb2-48ca-b3d0-d5610d5d5e85 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:24.074463 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6d11e27d-3eb2-48ca-b3d0-d5610d5d5e85 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:24.075236 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6d11e27d-3eb2-48ca-b3d0-d5610d5d5e85 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:24.075673 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6d11e27d-3eb2-48ca-b3d0-d5610d5d5e85 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:24.091984 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-6d11e27d-3eb2-48ca-b3d0-d5610d5d5e85 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] HTTP exception thrown: Instance 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af could not be found. Jan 15 21:40:24.092567 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-6d11e27d-3eb2-48ca-b3d0-d5610d5d5e85 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Returning 404 to user: Instance 31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:40:24.093408 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-6d11e27d-3eb2-48ca-b3d0-d5610d5d5e85 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af" status: 404 len: 111 microversion: 2.1 time: 0.031272 Jan 15 21:40:24.093947 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3933/7853] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:40:24 2022] GET /compute/v2.1/servers/31eaafe4-7e89-4d4e-8319-e1c9e9cfd8af => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:40:24.102351 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-85c44f25-69e7-4782-89c0-98a6a3084b6c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:40:24.102876 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-85c44f25-69e7-4782-89c0-98a6a3084b6c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:40:24.108892 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-85c44f25-69e7-4782-89c0-98a6a3084b6c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:24.109365 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-85c44f25-69e7-4782-89c0-98a6a3084b6c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:24.110186 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-85c44f25-69e7-4782-89c0-98a6a3084b6c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:24.110641 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-85c44f25-69e7-4782-89c0-98a6a3084b6c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:24.123844 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-85c44f25-69e7-4782-89c0-98a6a3084b6c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] HTTP exception thrown: Instance 8e727515-c789-4ce3-a870-c575fb06a6af could not be found. Jan 15 21:40:24.124469 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-85c44f25-69e7-4782-89c0-98a6a3084b6c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Returning 404 to user: Instance 8e727515-c789-4ce3-a870-c575fb06a6af could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:40:24.125331 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-85c44f25-69e7-4782-89c0-98a6a3084b6c tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "DELETE /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af" status: 404 len: 111 microversion: 2.1 time: 0.027383 Jan 15 21:40:24.125863 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3921/7854] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 21:40:24 2022] DELETE /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:40:24.133719 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a129c9a7-8c93-4d44-873a-2384ba1cf7f6 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:40:24.134341 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a129c9a7-8c93-4d44-873a-2384ba1cf7f6 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 8e727515-c789-4ce3-a870-c575fb06a6af] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:40:24.140184 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a129c9a7-8c93-4d44-873a-2384ba1cf7f6 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:24.140699 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a129c9a7-8c93-4d44-873a-2384ba1cf7f6 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:24.141511 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a129c9a7-8c93-4d44-873a-2384ba1cf7f6 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:24.141952 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a129c9a7-8c93-4d44-873a-2384ba1cf7f6 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:24.156319 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-a129c9a7-8c93-4d44-873a-2384ba1cf7f6 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] HTTP exception thrown: Instance 8e727515-c789-4ce3-a870-c575fb06a6af could not be found. Jan 15 21:40:24.156929 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a129c9a7-8c93-4d44-873a-2384ba1cf7f6 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Returning 404 to user: Instance 8e727515-c789-4ce3-a870-c575fb06a6af could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:40:24.157786 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a129c9a7-8c93-4d44-873a-2384ba1cf7f6 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af" status: 404 len: 111 microversion: 2.1 time: 0.027877 Jan 15 21:40:24.158326 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3934/7855] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:40:24 2022] GET /compute/v2.1/servers/8e727515-c789-4ce3-a870-c575fb06a6af => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:40:24.167129 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-67a657b2-17d4-448f-999a-b0cd8d4c7987 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:40:24.167638 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-67a657b2-17d4-448f-999a-b0cd8d4c7987 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:40:24.173653 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-67a657b2-17d4-448f-999a-b0cd8d4c7987 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:24.174114 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-67a657b2-17d4-448f-999a-b0cd8d4c7987 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:24.174894 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-67a657b2-17d4-448f-999a-b0cd8d4c7987 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:24.175339 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-67a657b2-17d4-448f-999a-b0cd8d4c7987 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:24.188393 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-67a657b2-17d4-448f-999a-b0cd8d4c7987 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] HTTP exception thrown: Instance 1c3971ed-826f-4ae9-812c-e1be325fa316 could not be found. Jan 15 21:40:24.189022 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-67a657b2-17d4-448f-999a-b0cd8d4c7987 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Returning 404 to user: Instance 1c3971ed-826f-4ae9-812c-e1be325fa316 could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:40:24.189840 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-67a657b2-17d4-448f-999a-b0cd8d4c7987 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "DELETE /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316" status: 404 len: 111 microversion: 2.1 time: 0.026522 Jan 15 21:40:24.190361 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3922/7856] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 21:40:24 2022] DELETE /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 15 21:40:24.197963 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4a1c7a1a-c0aa-4572-a79f-c98b40fbab02 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:40:24.198576 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-4a1c7a1a-c0aa-4572-a79f-c98b40fbab02 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: 1c3971ed-826f-4ae9-812c-e1be325fa316] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:40:24.204494 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4a1c7a1a-c0aa-4572-a79f-c98b40fbab02 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:24.204992 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4a1c7a1a-c0aa-4572-a79f-c98b40fbab02 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:24.205776 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4a1c7a1a-c0aa-4572-a79f-c98b40fbab02 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:24.206220 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4a1c7a1a-c0aa-4572-a79f-c98b40fbab02 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:24.220230 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-4a1c7a1a-c0aa-4572-a79f-c98b40fbab02 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] HTTP exception thrown: Instance 1c3971ed-826f-4ae9-812c-e1be325fa316 could not be found. Jan 15 21:40:24.220810 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4a1c7a1a-c0aa-4572-a79f-c98b40fbab02 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Returning 404 to user: Instance 1c3971ed-826f-4ae9-812c-e1be325fa316 could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:40:24.221654 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-4a1c7a1a-c0aa-4572-a79f-c98b40fbab02 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316" status: 404 len: 111 microversion: 2.1 time: 0.027362 Jan 15 21:40:24.222192 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3935/7857] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:40:24 2022] GET /compute/v2.1/servers/1c3971ed-826f-4ae9-812c-e1be325fa316 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:40:24.230698 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-36806fb3-a8bb-4b4d-a5ba-e5c05524665d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:40:24.231216 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-36806fb3-a8bb-4b4d-a5ba-e5c05524665d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:40:24.237182 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-36806fb3-a8bb-4b4d-a5ba-e5c05524665d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:24.237652 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-36806fb3-a8bb-4b4d-a5ba-e5c05524665d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:24.238448 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-36806fb3-a8bb-4b4d-a5ba-e5c05524665d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:24.239049 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-36806fb3-a8bb-4b4d-a5ba-e5c05524665d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:24.252204 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-36806fb3-a8bb-4b4d-a5ba-e5c05524665d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] HTTP exception thrown: Instance f63c13ee-f437-4649-8e7a-abb7909aa3df could not be found. Jan 15 21:40:24.252798 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-36806fb3-a8bb-4b4d-a5ba-e5c05524665d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Returning 404 to user: Instance f63c13ee-f437-4649-8e7a-abb7909aa3df could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:40:24.253683 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-36806fb3-a8bb-4b4d-a5ba-e5c05524665d tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "DELETE /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df" status: 404 len: 111 microversion: 2.1 time: 0.026677 Jan 15 21:40:24.254259 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3923/7858] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 21:40:24 2022] DELETE /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:40:24.261738 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4021be5a-ca9b-4334-9017-15d53162391e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:40:24.262337 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-4021be5a-ca9b-4334-9017-15d53162391e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] [instance: f63c13ee-f437-4649-8e7a-abb7909aa3df] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:40:24.269004 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4021be5a-ca9b-4334-9017-15d53162391e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:24.269397 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4021be5a-ca9b-4334-9017-15d53162391e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:24.270759 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4021be5a-ca9b-4334-9017-15d53162391e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:24.271192 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4021be5a-ca9b-4334-9017-15d53162391e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:24.286549 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-4021be5a-ca9b-4334-9017-15d53162391e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] HTTP exception thrown: Instance f63c13ee-f437-4649-8e7a-abb7909aa3df could not be found. Jan 15 21:40:24.287386 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4021be5a-ca9b-4334-9017-15d53162391e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Returning 404 to user: Instance f63c13ee-f437-4649-8e7a-abb7909aa3df could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:40:24.288207 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-4021be5a-ca9b-4334-9017-15d53162391e tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "GET /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df" status: 404 len: 111 microversion: 2.1 time: 0.030108 Jan 15 21:40:24.288874 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3936/7859] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:40:24 2022] GET /compute/v2.1/servers/f63c13ee-f437-4649-8e7a-abb7909aa3df => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:40:24.296876 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-28d05d39-a822-4217-a81d-8ed0b998cb32 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] Calling method '.version_select at 0x7f30c91c41f0>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:40:24.318647 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-28d05d39-a822-4217-a81d-8ed0b998cb32 tempest-ServerActionsTestJSON-1795151563 tempest-ServerActionsTestJSON-1795151563-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-176324375" status: 202 len: 0 microversion: 2.1 time: 0.025561 Jan 15 21:40:24.319230 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3924/7860] 10.222.0.46 () {58 vars in 1217 bytes} [Sat Jan 15 21:40:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-176324375 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:40:30.251457 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0639ecf0-16df-4de8-8615-b269577d856a tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1367445856", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "networks": [{"uuid": "8a5a4ddb-ee2b-490e-812e-e28d13f5025d"}]}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:40:30.307274 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.network.neutron [None req-0639ecf0-16df-4de8-8615-b269577d856a tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] validate_networks() for [('8a5a4ddb-ee2b-490e-812e-e28d13f5025d', None, None, None, None, None)] {{(pid=129366) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 21:40:30.656784 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-0639ecf0-16df-4de8-8615-b269577d856a tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Flavor limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 21:40:30.657241 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-0639ecf0-16df-4de8-8615-b269577d856a tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Image limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 21:40:30.657720 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-0639ecf0-16df-4de8-8615-b269577d856a tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Flavor pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 21:40:30.658130 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-0639ecf0-16df-4de8-8615-b269577d856a tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Image pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 21:40:30.658542 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-0639ecf0-16df-4de8-8615-b269577d856a tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 21:40:30.668163 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0639ecf0-16df-4de8-8615-b269577d856a tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:30.668609 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0639ecf0-16df-4de8-8615-b269577d856a tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:30.669506 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0639ecf0-16df-4de8-8615-b269577d856a tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:30.669939 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0639ecf0-16df-4de8-8615-b269577d856a tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:30.686162 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-0639ecf0-16df-4de8-8615-b269577d856a tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Getting quotas for project d3c66a0c450f46beaf0167fad183c643. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:40:30.691182 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-0639ecf0-16df-4de8-8615-b269577d856a tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Getting quotas for user 9f308027e399490ba3effc3417ccfffc and project d3c66a0c450f46beaf0167fad183c643. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:40:30.704264 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-0639ecf0-16df-4de8-8615-b269577d856a tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Going to run 1 instances... {{(pid=129366) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 21:40:30.706617 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-0639ecf0-16df-4de8-8615-b269577d856a tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] [instance: 61b546e0-8940-4423-b490-b006ec7d622b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 21:40:30.751286 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0639ecf0-16df-4de8-8615-b269577d856a tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.628253 Jan 15 21:40:30.751954 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3937/7861] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 21:40:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 630 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 21:40:30.763492 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-63615cb4-a105-4700-a6b4-8a71ff51af5b tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:40:30.764396 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-63615cb4-a105-4700-a6b4-8a71ff51af5b tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] [instance: 61b546e0-8940-4423-b490-b006ec7d622b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:40:30.822014 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-63615cb4-a105-4700-a6b4-8a71ff51af5b tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f308027e399490ba3effc3417ccfffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c66a0c450f46beaf0167fad183c643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:40:30.828685 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-63615cb4-a105-4700-a6b4-8a71ff51af5b tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] 10.222.0.46 "GET /compute/v2.1/servers/61b546e0-8940-4423-b490-b006ec7d622b" status: 200 len: 1217 microversion: 2.1 time: 0.069883 Jan 15 21:40:30.829303 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3925/7862] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:40:30 2022] GET /compute/v2.1/servers/61b546e0-8940-4423-b490-b006ec7d622b => generated 1217 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:40:31.846371 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-2aa5a505-0f25-4624-bd73-09460f8d2077 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:40:31.847096 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-2aa5a505-0f25-4624-bd73-09460f8d2077 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] [instance: 61b546e0-8940-4423-b490-b006ec7d622b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:40:31.855024 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2aa5a505-0f25-4624-bd73-09460f8d2077 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:31.855504 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2aa5a505-0f25-4624-bd73-09460f8d2077 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:31.856281 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2aa5a505-0f25-4624-bd73-09460f8d2077 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:31.856721 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2aa5a505-0f25-4624-bd73-09460f8d2077 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:31.918223 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-2aa5a505-0f25-4624-bd73-09460f8d2077 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f308027e399490ba3effc3417ccfffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c66a0c450f46beaf0167fad183c643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:40:31.925715 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-2aa5a505-0f25-4624-bd73-09460f8d2077 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] 10.222.0.46 "GET /compute/v2.1/servers/61b546e0-8940-4423-b490-b006ec7d622b" status: 200 len: 1275 microversion: 2.1 time: 0.083911 Jan 15 21:40:31.926266 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3938/7863] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:40:31 2022] GET /compute/v2.1/servers/61b546e0-8940-4423-b490-b006ec7d622b => generated 1275 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:40:32.943400 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d6fad724-dcd3-4379-8015-8747e25e2194 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:40:32.944026 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d6fad724-dcd3-4379-8015-8747e25e2194 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] [instance: 61b546e0-8940-4423-b490-b006ec7d622b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:40:32.952193 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d6fad724-dcd3-4379-8015-8747e25e2194 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:32.952673 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d6fad724-dcd3-4379-8015-8747e25e2194 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:32.953833 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d6fad724-dcd3-4379-8015-8747e25e2194 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:32.954379 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d6fad724-dcd3-4379-8015-8747e25e2194 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:32.983851 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-a18c405e-4831-4b13-b467-a438737ee7cc req-b54871d6-4be7-457e-920c-49d5fb8e9862 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61b546e0-8940-4423-b490-b006ec7d622b", "tag": "6d7d0606-d83d-4d88-ad26-a7e2eebdd81d"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:40:32.988925 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:40:32.988925 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:40:32.998494 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-a18c405e-4831-4b13-b467-a438737ee7cc req-b54871d6-4be7-457e-920c-49d5fb8e9862 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:32.999430 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-a18c405e-4831-4b13-b467-a438737ee7cc req-b54871d6-4be7-457e-920c-49d5fb8e9862 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:33.021178 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-a18c405e-4831-4b13-b467-a438737ee7cc req-b54871d6-4be7-457e-920c-49d5fb8e9862 service nova] Creating event network-changed:6d7d0606-d83d-4d88-ad26-a7e2eebdd81d for instance 61b546e0-8940-4423-b490-b006ec7d622b on nch2-master-1 Jan 15 21:40:33.026705 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-a18c405e-4831-4b13-b467-a438737ee7cc req-b54871d6-4be7-457e-920c-49d5fb8e9862 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051049 Jan 15 21:40:33.027858 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3939/7864] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:40:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:40:33.110673 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-d6fad724-dcd3-4379-8015-8747e25e2194 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f308027e399490ba3effc3417ccfffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c66a0c450f46beaf0167fad183c643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:40:33.118620 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d6fad724-dcd3-4379-8015-8747e25e2194 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] 10.222.0.46 "GET /compute/v2.1/servers/61b546e0-8940-4423-b490-b006ec7d622b" status: 200 len: 1317 microversion: 2.1 time: 0.179162 Jan 15 21:40:33.119212 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3926/7865] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:40:32 2022] GET /compute/v2.1/servers/61b546e0-8940-4423-b490-b006ec7d622b => generated 1317 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:40:34.137342 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9be44fcc-8452-41aa-81b3-c04a57288ba1 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:40:34.138040 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-9be44fcc-8452-41aa-81b3-c04a57288ba1 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] [instance: 61b546e0-8940-4423-b490-b006ec7d622b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:40:34.144178 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9be44fcc-8452-41aa-81b3-c04a57288ba1 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:34.144632 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9be44fcc-8452-41aa-81b3-c04a57288ba1 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:34.145437 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9be44fcc-8452-41aa-81b3-c04a57288ba1 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:34.145876 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9be44fcc-8452-41aa-81b3-c04a57288ba1 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:34.279322 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-9be44fcc-8452-41aa-81b3-c04a57288ba1 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f308027e399490ba3effc3417ccfffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c66a0c450f46beaf0167fad183c643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:40:34.286753 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-9be44fcc-8452-41aa-81b3-c04a57288ba1 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] 10.222.0.46 "GET /compute/v2.1/servers/61b546e0-8940-4423-b490-b006ec7d622b" status: 200 len: 1317 microversion: 2.1 time: 0.155401 Jan 15 21:40:34.287586 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3940/7866] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:40:34 2022] GET /compute/v2.1/servers/61b546e0-8940-4423-b490-b006ec7d622b => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:40:35.306123 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-582098ef-4129-4b26-b919-6bab2d3ebdac tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:40:35.306647 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-582098ef-4129-4b26-b919-6bab2d3ebdac tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] [instance: 61b546e0-8940-4423-b490-b006ec7d622b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:40:35.313524 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-582098ef-4129-4b26-b919-6bab2d3ebdac tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:35.313988 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-582098ef-4129-4b26-b919-6bab2d3ebdac tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:35.314776 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-582098ef-4129-4b26-b919-6bab2d3ebdac tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:35.315229 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-582098ef-4129-4b26-b919-6bab2d3ebdac tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:35.447288 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-582098ef-4129-4b26-b919-6bab2d3ebdac tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f308027e399490ba3effc3417ccfffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c66a0c450f46beaf0167fad183c643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:40:35.454986 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-582098ef-4129-4b26-b919-6bab2d3ebdac tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] 10.222.0.46 "GET /compute/v2.1/servers/61b546e0-8940-4423-b490-b006ec7d622b" status: 200 len: 1317 microversion: 2.1 time: 0.153462 Jan 15 21:40:35.455692 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3927/7867] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:40:35 2022] GET /compute/v2.1/servers/61b546e0-8940-4423-b490-b006ec7d622b => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:40:36.471403 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-dc3d8844-b539-4770-8cab-7bf90a938120 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:40:36.472011 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-dc3d8844-b539-4770-8cab-7bf90a938120 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] [instance: 61b546e0-8940-4423-b490-b006ec7d622b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:40:36.479016 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dc3d8844-b539-4770-8cab-7bf90a938120 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:36.479466 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dc3d8844-b539-4770-8cab-7bf90a938120 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:36.480269 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dc3d8844-b539-4770-8cab-7bf90a938120 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:36.480733 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dc3d8844-b539-4770-8cab-7bf90a938120 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:36.607675 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-dc3d8844-b539-4770-8cab-7bf90a938120 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f308027e399490ba3effc3417ccfffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c66a0c450f46beaf0167fad183c643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:40:36.615045 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-dc3d8844-b539-4770-8cab-7bf90a938120 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] 10.222.0.46 "GET /compute/v2.1/servers/61b546e0-8940-4423-b490-b006ec7d622b" status: 200 len: 1317 microversion: 2.1 time: 0.147403 Jan 15 21:40:36.615613 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3941/7868] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:40:36 2022] GET /compute/v2.1/servers/61b546e0-8940-4423-b490-b006ec7d622b => generated 1317 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:40:37.632672 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ddf960d4-63f1-4c4b-b530-7f0f11ee9926 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:40:37.633276 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ddf960d4-63f1-4c4b-b530-7f0f11ee9926 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] [instance: 61b546e0-8940-4423-b490-b006ec7d622b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:40:37.641098 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ddf960d4-63f1-4c4b-b530-7f0f11ee9926 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:37.641593 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ddf960d4-63f1-4c4b-b530-7f0f11ee9926 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:37.642413 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ddf960d4-63f1-4c4b-b530-7f0f11ee9926 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:37.642852 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ddf960d4-63f1-4c4b-b530-7f0f11ee9926 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:37.735754 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-8f73af7e-61c7-4a04-b066-06354d4795e6 req-cee584c0-bbc0-4098-8183-82f2ced10134 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61b546e0-8940-4423-b490-b006ec7d622b", "name": "network-vif-plugged", "status": "completed", "tag": "6d7d0606-d83d-4d88-ad26-a7e2eebdd81d"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:40:37.737428 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:40:37.737428 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:40:37.744980 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-8f73af7e-61c7-4a04-b066-06354d4795e6 req-cee584c0-bbc0-4098-8183-82f2ced10134 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:37.745532 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-8f73af7e-61c7-4a04-b066-06354d4795e6 req-cee584c0-bbc0-4098-8183-82f2ced10134 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:37.763848 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-8f73af7e-61c7-4a04-b066-06354d4795e6 req-cee584c0-bbc0-4098-8183-82f2ced10134 service nova] Creating event network-vif-plugged:6d7d0606-d83d-4d88-ad26-a7e2eebdd81d for instance 61b546e0-8940-4423-b490-b006ec7d622b on nch2-master-1 Jan 15 21:40:37.769167 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-8f73af7e-61c7-4a04-b066-06354d4795e6 req-cee584c0-bbc0-4098-8183-82f2ced10134 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037260 Jan 15 21:40:37.769792 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3942/7869] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:40:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 21:40:37.789190 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-ddf960d4-63f1-4c4b-b530-7f0f11ee9926 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f308027e399490ba3effc3417ccfffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c66a0c450f46beaf0167fad183c643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:40:37.796342 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ddf960d4-63f1-4c4b-b530-7f0f11ee9926 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] 10.222.0.46 "GET /compute/v2.1/servers/61b546e0-8940-4423-b490-b006ec7d622b" status: 200 len: 1317 microversion: 2.1 time: 0.168167 Jan 15 21:40:37.797749 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3928/7870] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:40:37 2022] GET /compute/v2.1/servers/61b546e0-8940-4423-b490-b006ec7d622b => generated 1317 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:40:38.813993 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-76c61878-accd-4a5d-a973-cf43e3c0affc tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:40:38.814684 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-76c61878-accd-4a5d-a973-cf43e3c0affc tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] [instance: 61b546e0-8940-4423-b490-b006ec7d622b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:40:38.822033 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-76c61878-accd-4a5d-a973-cf43e3c0affc tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:38.822486 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-76c61878-accd-4a5d-a973-cf43e3c0affc tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:38.823263 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-76c61878-accd-4a5d-a973-cf43e3c0affc tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:38.823726 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-76c61878-accd-4a5d-a973-cf43e3c0affc tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:38.956452 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-76c61878-accd-4a5d-a973-cf43e3c0affc tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f308027e399490ba3effc3417ccfffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c66a0c450f46beaf0167fad183c643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:40:38.964696 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-76c61878-accd-4a5d-a973-cf43e3c0affc tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] 10.222.0.46 "GET /compute/v2.1/servers/61b546e0-8940-4423-b490-b006ec7d622b" status: 200 len: 1317 microversion: 2.1 time: 0.155703 Jan 15 21:40:38.965296 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3943/7871] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:40:38 2022] GET /compute/v2.1/servers/61b546e0-8940-4423-b490-b006ec7d622b => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:40:39.981961 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-840878f7-b73a-4e97-a6c3-7f8a89c873a1 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:40:39.982620 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-840878f7-b73a-4e97-a6c3-7f8a89c873a1 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] [instance: 61b546e0-8940-4423-b490-b006ec7d622b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:40:39.989603 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-840878f7-b73a-4e97-a6c3-7f8a89c873a1 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:39.990073 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-840878f7-b73a-4e97-a6c3-7f8a89c873a1 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:39.990871 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-840878f7-b73a-4e97-a6c3-7f8a89c873a1 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:39.991536 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-840878f7-b73a-4e97-a6c3-7f8a89c873a1 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:40.126343 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-840878f7-b73a-4e97-a6c3-7f8a89c873a1 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f308027e399490ba3effc3417ccfffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c66a0c450f46beaf0167fad183c643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:40:40.134315 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-840878f7-b73a-4e97-a6c3-7f8a89c873a1 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] 10.222.0.46 "GET /compute/v2.1/servers/61b546e0-8940-4423-b490-b006ec7d622b" status: 200 len: 1506 microversion: 2.1 time: 0.156180 Jan 15 21:40:40.134888 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3929/7872] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:40:39 2022] GET /compute/v2.1/servers/61b546e0-8940-4423-b490-b006ec7d622b => generated 1506 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:40:40.187514 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c04baf4f-f49c-421c-a0e0-c9403214f05c tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1095559460", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "networks": [{"uuid": "8a5a4ddb-ee2b-490e-812e-e28d13f5025d"}]}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:40:40.238565 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.network.neutron [None req-c04baf4f-f49c-421c-a0e0-c9403214f05c tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] validate_networks() for [('8a5a4ddb-ee2b-490e-812e-e28d13f5025d', None, None, None, None, None)] {{(pid=129366) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 21:40:40.591371 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-c04baf4f-f49c-421c-a0e0-c9403214f05c tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Flavor limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 21:40:40.591790 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-c04baf4f-f49c-421c-a0e0-c9403214f05c tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Image limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 21:40:40.592262 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-c04baf4f-f49c-421c-a0e0-c9403214f05c tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Flavor pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 21:40:40.592667 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-c04baf4f-f49c-421c-a0e0-c9403214f05c tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Image pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 21:40:40.593102 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-c04baf4f-f49c-421c-a0e0-c9403214f05c tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 21:40:40.602438 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c04baf4f-f49c-421c-a0e0-c9403214f05c tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:40.602879 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c04baf4f-f49c-421c-a0e0-c9403214f05c tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:40.603684 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c04baf4f-f49c-421c-a0e0-c9403214f05c tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:40.604118 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c04baf4f-f49c-421c-a0e0-c9403214f05c tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:40.620272 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-c04baf4f-f49c-421c-a0e0-c9403214f05c tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Getting quotas for project d3c66a0c450f46beaf0167fad183c643. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:40:40.625267 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-c04baf4f-f49c-421c-a0e0-c9403214f05c tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Getting quotas for user 9f308027e399490ba3effc3417ccfffc and project d3c66a0c450f46beaf0167fad183c643. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:40:40.637403 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c04baf4f-f49c-421c-a0e0-c9403214f05c tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Going to run 1 instances... {{(pid=129366) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 21:40:40.639687 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c04baf4f-f49c-421c-a0e0-c9403214f05c tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] [instance: 86623b0c-475b-4374-b5c2-9fcb634b61ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 21:40:40.684675 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c04baf4f-f49c-421c-a0e0-c9403214f05c tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.500896 Jan 15 21:40:40.685400 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3944/7873] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 21:40:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 502 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 15 21:40:40.695537 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-48536a85-9772-47fb-b227-427bf73baac3 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:40:40.696292 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-48536a85-9772-47fb-b227-427bf73baac3 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] [instance: 86623b0c-475b-4374-b5c2-9fcb634b61ff] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:40:40.754901 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-48536a85-9772-47fb-b227-427bf73baac3 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f308027e399490ba3effc3417ccfffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c66a0c450f46beaf0167fad183c643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:40:40.761763 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-48536a85-9772-47fb-b227-427bf73baac3 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] 10.222.0.46 "GET /compute/v2.1/servers/86623b0c-475b-4374-b5c2-9fcb634b61ff" status: 200 len: 1217 microversion: 2.1 time: 0.070353 Jan 15 21:40:40.762342 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3930/7874] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:40:40 2022] GET /compute/v2.1/servers/86623b0c-475b-4374-b5c2-9fcb634b61ff => generated 1217 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:40:41.779430 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b9f1824e-4b61-4f1a-8781-1efc335dc1da tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:40:41.780021 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b9f1824e-4b61-4f1a-8781-1efc335dc1da tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] [instance: 86623b0c-475b-4374-b5c2-9fcb634b61ff] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:40:41.788228 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b9f1824e-4b61-4f1a-8781-1efc335dc1da tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:41.788721 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b9f1824e-4b61-4f1a-8781-1efc335dc1da tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:41.789597 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b9f1824e-4b61-4f1a-8781-1efc335dc1da tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:41.790028 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b9f1824e-4b61-4f1a-8781-1efc335dc1da tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:41.850956 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-b9f1824e-4b61-4f1a-8781-1efc335dc1da tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f308027e399490ba3effc3417ccfffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c66a0c450f46beaf0167fad183c643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:40:41.858632 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b9f1824e-4b61-4f1a-8781-1efc335dc1da tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] 10.222.0.46 "GET /compute/v2.1/servers/86623b0c-475b-4374-b5c2-9fcb634b61ff" status: 200 len: 1275 microversion: 2.1 time: 0.083065 Jan 15 21:40:41.859221 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3945/7875] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:40:41 2022] GET /compute/v2.1/servers/86623b0c-475b-4374-b5c2-9fcb634b61ff => generated 1275 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:40:42.876911 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-4482a7dc-4888-498b-8db1-459989ea320e tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:40:42.877655 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-4482a7dc-4888-498b-8db1-459989ea320e tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] [instance: 86623b0c-475b-4374-b5c2-9fcb634b61ff] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:40:42.885668 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4482a7dc-4888-498b-8db1-459989ea320e tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:42.886216 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4482a7dc-4888-498b-8db1-459989ea320e tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:42.887098 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4482a7dc-4888-498b-8db1-459989ea320e tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:42.887688 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4482a7dc-4888-498b-8db1-459989ea320e tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:43.024770 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-4482a7dc-4888-498b-8db1-459989ea320e tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f308027e399490ba3effc3417ccfffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c66a0c450f46beaf0167fad183c643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:40:43.032475 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-4482a7dc-4888-498b-8db1-459989ea320e tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] 10.222.0.46 "GET /compute/v2.1/servers/86623b0c-475b-4374-b5c2-9fcb634b61ff" status: 200 len: 1317 microversion: 2.1 time: 0.159407 Jan 15 21:40:43.033098 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3931/7876] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:40:42 2022] GET /compute/v2.1/servers/86623b0c-475b-4374-b5c2-9fcb634b61ff => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:40:43.154021 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-581d764c-2e23-4fb1-bbc5-cae079fc0eb1 req-f216d803-7d68-40b9-869c-2c6b7775218a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86623b0c-475b-4374-b5c2-9fcb634b61ff", "tag": "6aed951f-96ee-4f93-a73a-50522bbe175f"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:40:43.157486 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:40:43.157486 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:40:43.169148 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-581d764c-2e23-4fb1-bbc5-cae079fc0eb1 req-f216d803-7d68-40b9-869c-2c6b7775218a service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:43.169823 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-581d764c-2e23-4fb1-bbc5-cae079fc0eb1 req-f216d803-7d68-40b9-869c-2c6b7775218a service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:43.183116 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-581d764c-2e23-4fb1-bbc5-cae079fc0eb1 req-f216d803-7d68-40b9-869c-2c6b7775218a service nova] Creating event network-changed:6aed951f-96ee-4f93-a73a-50522bbe175f for instance 86623b0c-475b-4374-b5c2-9fcb634b61ff on nch1-master-1 Jan 15 21:40:43.187991 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-581d764c-2e23-4fb1-bbc5-cae079fc0eb1 req-f216d803-7d68-40b9-869c-2c6b7775218a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038317 Jan 15 21:40:43.188688 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3946/7877] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:40:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:40:44.049976 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d85aa69b-5c8d-45a0-9c06-d97c56d19756 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:40:44.050630 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d85aa69b-5c8d-45a0-9c06-d97c56d19756 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] [instance: 86623b0c-475b-4374-b5c2-9fcb634b61ff] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:40:44.057808 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d85aa69b-5c8d-45a0-9c06-d97c56d19756 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:44.058276 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d85aa69b-5c8d-45a0-9c06-d97c56d19756 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:44.059078 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d85aa69b-5c8d-45a0-9c06-d97c56d19756 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:44.059530 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d85aa69b-5c8d-45a0-9c06-d97c56d19756 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:44.198774 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-d85aa69b-5c8d-45a0-9c06-d97c56d19756 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f308027e399490ba3effc3417ccfffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c66a0c450f46beaf0167fad183c643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:40:44.206032 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d85aa69b-5c8d-45a0-9c06-d97c56d19756 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] 10.222.0.46 "GET /compute/v2.1/servers/86623b0c-475b-4374-b5c2-9fcb634b61ff" status: 200 len: 1317 microversion: 2.1 time: 0.159795 Jan 15 21:40:44.206608 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3932/7878] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:40:44 2022] GET /compute/v2.1/servers/86623b0c-475b-4374-b5c2-9fcb634b61ff => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:40:45.224902 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-44b087e2-2254-4660-ab3f-dbfa95a2e7c1 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:40:45.225598 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-44b087e2-2254-4660-ab3f-dbfa95a2e7c1 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] [instance: 86623b0c-475b-4374-b5c2-9fcb634b61ff] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:40:45.231832 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-44b087e2-2254-4660-ab3f-dbfa95a2e7c1 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:45.232280 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-44b087e2-2254-4660-ab3f-dbfa95a2e7c1 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:45.233088 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-44b087e2-2254-4660-ab3f-dbfa95a2e7c1 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:45.233522 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-44b087e2-2254-4660-ab3f-dbfa95a2e7c1 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:45.363249 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-44b087e2-2254-4660-ab3f-dbfa95a2e7c1 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f308027e399490ba3effc3417ccfffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c66a0c450f46beaf0167fad183c643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:40:45.371277 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-44b087e2-2254-4660-ab3f-dbfa95a2e7c1 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] 10.222.0.46 "GET /compute/v2.1/servers/86623b0c-475b-4374-b5c2-9fcb634b61ff" status: 200 len: 1317 microversion: 2.1 time: 0.151814 Jan 15 21:40:45.371894 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3947/7879] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:40:45 2022] GET /compute/v2.1/servers/86623b0c-475b-4374-b5c2-9fcb634b61ff => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:40:46.387680 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-1cf5e98c-2da8-424c-bafd-a9f4947568e6 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:40:46.388308 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-1cf5e98c-2da8-424c-bafd-a9f4947568e6 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] [instance: 86623b0c-475b-4374-b5c2-9fcb634b61ff] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:40:46.394695 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1cf5e98c-2da8-424c-bafd-a9f4947568e6 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:46.395224 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1cf5e98c-2da8-424c-bafd-a9f4947568e6 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:46.396085 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1cf5e98c-2da8-424c-bafd-a9f4947568e6 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:46.396848 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1cf5e98c-2da8-424c-bafd-a9f4947568e6 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:46.529304 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-1cf5e98c-2da8-424c-bafd-a9f4947568e6 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f308027e399490ba3effc3417ccfffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c66a0c450f46beaf0167fad183c643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:40:46.536561 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-1cf5e98c-2da8-424c-bafd-a9f4947568e6 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] 10.222.0.46 "GET /compute/v2.1/servers/86623b0c-475b-4374-b5c2-9fcb634b61ff" status: 200 len: 1317 microversion: 2.1 time: 0.152894 Jan 15 21:40:46.537500 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3933/7880] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:40:46 2022] GET /compute/v2.1/servers/86623b0c-475b-4374-b5c2-9fcb634b61ff => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:40:47.554726 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-63142904-6638-4a67-a8aa-855c5a615be7 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:40:47.555331 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-63142904-6638-4a67-a8aa-855c5a615be7 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] [instance: 86623b0c-475b-4374-b5c2-9fcb634b61ff] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:40:47.562074 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-63142904-6638-4a67-a8aa-855c5a615be7 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:47.562526 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-63142904-6638-4a67-a8aa-855c5a615be7 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:47.563304 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-63142904-6638-4a67-a8aa-855c5a615be7 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:47.563743 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-63142904-6638-4a67-a8aa-855c5a615be7 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:47.695593 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-63142904-6638-4a67-a8aa-855c5a615be7 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f308027e399490ba3effc3417ccfffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c66a0c450f46beaf0167fad183c643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:40:47.704054 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-63142904-6638-4a67-a8aa-855c5a615be7 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] 10.222.0.46 "GET /compute/v2.1/servers/86623b0c-475b-4374-b5c2-9fcb634b61ff" status: 200 len: 1317 microversion: 2.1 time: 0.153385 Jan 15 21:40:47.704661 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3948/7881] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:40:47 2022] GET /compute/v2.1/servers/86623b0c-475b-4374-b5c2-9fcb634b61ff => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:40:48.098345 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-f1856f8c-af42-44b1-9c85-9fe2d384e13f req-1383c89a-4205-4626-8f1f-23f3492bdc53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86623b0c-475b-4374-b5c2-9fcb634b61ff", "name": "network-vif-plugged", "status": "completed", "tag": "6aed951f-96ee-4f93-a73a-50522bbe175f"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:40:48.099946 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:40:48.099946 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:40:48.108451 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-f1856f8c-af42-44b1-9c85-9fe2d384e13f req-1383c89a-4205-4626-8f1f-23f3492bdc53 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:48.108943 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-f1856f8c-af42-44b1-9c85-9fe2d384e13f req-1383c89a-4205-4626-8f1f-23f3492bdc53 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:48.121162 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-f1856f8c-af42-44b1-9c85-9fe2d384e13f req-1383c89a-4205-4626-8f1f-23f3492bdc53 service nova] Creating event network-vif-plugged:6aed951f-96ee-4f93-a73a-50522bbe175f for instance 86623b0c-475b-4374-b5c2-9fcb634b61ff on nch1-master-1 Jan 15 21:40:48.126260 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-f1856f8c-af42-44b1-9c85-9fe2d384e13f req-1383c89a-4205-4626-8f1f-23f3492bdc53 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032097 Jan 15 21:40:48.126878 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3934/7882] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:40:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 21:40:48.720716 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-85684b41-e02d-4931-9c1f-c0d137f06a1d tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:40:48.721389 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-85684b41-e02d-4931-9c1f-c0d137f06a1d tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] [instance: 86623b0c-475b-4374-b5c2-9fcb634b61ff] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:40:48.728996 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-85684b41-e02d-4931-9c1f-c0d137f06a1d tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:48.729445 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-85684b41-e02d-4931-9c1f-c0d137f06a1d tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:48.730224 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-85684b41-e02d-4931-9c1f-c0d137f06a1d tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:48.730659 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-85684b41-e02d-4931-9c1f-c0d137f06a1d tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:48.865397 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-85684b41-e02d-4931-9c1f-c0d137f06a1d tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f308027e399490ba3effc3417ccfffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c66a0c450f46beaf0167fad183c643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:40:48.872741 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-85684b41-e02d-4931-9c1f-c0d137f06a1d tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] 10.222.0.46 "GET /compute/v2.1/servers/86623b0c-475b-4374-b5c2-9fcb634b61ff" status: 200 len: 1317 microversion: 2.1 time: 0.155747 Jan 15 21:40:48.873350 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3949/7883] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:40:48 2022] GET /compute/v2.1/servers/86623b0c-475b-4374-b5c2-9fcb634b61ff => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:40:49.890794 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9670cbda-2867-4962-afb7-12eb539d3f58 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:40:49.891523 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-9670cbda-2867-4962-afb7-12eb539d3f58 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] [instance: 86623b0c-475b-4374-b5c2-9fcb634b61ff] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:40:49.897984 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9670cbda-2867-4962-afb7-12eb539d3f58 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:49.898445 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9670cbda-2867-4962-afb7-12eb539d3f58 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:49.899231 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9670cbda-2867-4962-afb7-12eb539d3f58 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:49.899675 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9670cbda-2867-4962-afb7-12eb539d3f58 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:50.046086 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-9670cbda-2867-4962-afb7-12eb539d3f58 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f308027e399490ba3effc3417ccfffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c66a0c450f46beaf0167fad183c643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:40:50.054270 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-9670cbda-2867-4962-afb7-12eb539d3f58 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] 10.222.0.46 "GET /compute/v2.1/servers/86623b0c-475b-4374-b5c2-9fcb634b61ff" status: 200 len: 1506 microversion: 2.1 time: 0.167781 Jan 15 21:40:50.054860 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3935/7884] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:40:49 2022] GET /compute/v2.1/servers/86623b0c-475b-4374-b5c2-9fcb634b61ff => generated 1506 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:40:50.069925 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f0172530-43e6-4333-bb97-ab3b0fd24fe2 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:40:50.070463 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f0172530-43e6-4333-bb97-ab3b0fd24fe2 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] [instance: 86623b0c-475b-4374-b5c2-9fcb634b61ff] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:40:50.077143 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f0172530-43e6-4333-bb97-ab3b0fd24fe2 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:50.077597 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f0172530-43e6-4333-bb97-ab3b0fd24fe2 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:50.078375 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f0172530-43e6-4333-bb97-ab3b0fd24fe2 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:50.078814 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f0172530-43e6-4333-bb97-ab3b0fd24fe2 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:50.104154 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f0172530-43e6-4333-bb97-ab3b0fd24fe2 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] [instance: 86623b0c-475b-4374-b5c2-9fcb634b61ff] Going to try to terminate instance {{(pid=129366) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 21:40:50.179407 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f0172530-43e6-4333-bb97-ab3b0fd24fe2 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] 10.222.0.46 "DELETE /compute/v2.1/servers/86623b0c-475b-4374-b5c2-9fcb634b61ff" status: 204 len: 0 microversion: 2.1 time: 0.112243 Jan 15 21:40:50.180204 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3950/7885] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 21:40:50 2022] DELETE /compute/v2.1/servers/86623b0c-475b-4374-b5c2-9fcb634b61ff => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 21:40:50.188001 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-eb678506-d8c2-4226-a450-1361c830c4d2 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:40:50.188624 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-eb678506-d8c2-4226-a450-1361c830c4d2 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] [instance: 86623b0c-475b-4374-b5c2-9fcb634b61ff] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:40:50.194619 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-eb678506-d8c2-4226-a450-1361c830c4d2 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:50.195087 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-eb678506-d8c2-4226-a450-1361c830c4d2 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:50.195880 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-eb678506-d8c2-4226-a450-1361c830c4d2 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:50.196333 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-eb678506-d8c2-4226-a450-1361c830c4d2 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:50.329660 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-eb678506-d8c2-4226-a450-1361c830c4d2 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f308027e399490ba3effc3417ccfffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c66a0c450f46beaf0167fad183c643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:40:50.339611 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-eb678506-d8c2-4226-a450-1361c830c4d2 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] 10.222.0.46 "GET /compute/v2.1/servers/86623b0c-475b-4374-b5c2-9fcb634b61ff" status: 200 len: 1512 microversion: 2.1 time: 0.153508 Jan 15 21:40:50.339611 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3936/7886] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:40:50 2022] GET /compute/v2.1/servers/86623b0c-475b-4374-b5c2-9fcb634b61ff => generated 1512 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:40:51.355880 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-609e93c3-3c6b-4eb3-af09-68d4f75e7d1d tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:40:51.356730 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-609e93c3-3c6b-4eb3-af09-68d4f75e7d1d tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] [instance: 86623b0c-475b-4374-b5c2-9fcb634b61ff] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:40:51.363462 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-609e93c3-3c6b-4eb3-af09-68d4f75e7d1d tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:51.363927 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-609e93c3-3c6b-4eb3-af09-68d4f75e7d1d tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:51.364760 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-609e93c3-3c6b-4eb3-af09-68d4f75e7d1d tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:51.365237 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-609e93c3-3c6b-4eb3-af09-68d4f75e7d1d tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:51.502296 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-609e93c3-3c6b-4eb3-af09-68d4f75e7d1d tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f308027e399490ba3effc3417ccfffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c66a0c450f46beaf0167fad183c643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:40:51.510737 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-609e93c3-3c6b-4eb3-af09-68d4f75e7d1d tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] 10.222.0.46 "GET /compute/v2.1/servers/86623b0c-475b-4374-b5c2-9fcb634b61ff" status: 200 len: 1512 microversion: 2.1 time: 0.159011 Jan 15 21:40:51.511430 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3951/7887] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:40:51 2022] GET /compute/v2.1/servers/86623b0c-475b-4374-b5c2-9fcb634b61ff => generated 1512 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:40:52.015775 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-3f0b6406-cc76-464e-bd78-66befab307ba req-ae33b489-d7fa-49cd-be2b-11929c572c38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86623b0c-475b-4374-b5c2-9fcb634b61ff", "name": "network-vif-deleted", "tag": "6aed951f-96ee-4f93-a73a-50522bbe175f"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:40:52.019915 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:40:52.019915 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:40:52.033201 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-3f0b6406-cc76-464e-bd78-66befab307ba req-ae33b489-d7fa-49cd-be2b-11929c572c38 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:52.033754 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-3f0b6406-cc76-464e-bd78-66befab307ba req-ae33b489-d7fa-49cd-be2b-11929c572c38 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:52.050390 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-3f0b6406-cc76-464e-bd78-66befab307ba req-ae33b489-d7fa-49cd-be2b-11929c572c38 service nova] Creating event network-vif-deleted:6aed951f-96ee-4f93-a73a-50522bbe175f for instance 86623b0c-475b-4374-b5c2-9fcb634b61ff on nch1-master-1 Jan 15 21:40:52.057008 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-3f0b6406-cc76-464e-bd78-66befab307ba req-ae33b489-d7fa-49cd-be2b-11929c572c38 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047120 Jan 15 21:40:52.058080 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3937/7888] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:40:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:40:52.529460 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1e777472-c518-45b9-af45-147463a4d426 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:40:52.530054 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-1e777472-c518-45b9-af45-147463a4d426 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] [instance: 86623b0c-475b-4374-b5c2-9fcb634b61ff] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:40:52.537576 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1e777472-c518-45b9-af45-147463a4d426 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:52.538616 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1e777472-c518-45b9-af45-147463a4d426 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:52.539419 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1e777472-c518-45b9-af45-147463a4d426 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:52.539861 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1e777472-c518-45b9-af45-147463a4d426 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:52.553850 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-1e777472-c518-45b9-af45-147463a4d426 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] HTTP exception thrown: Instance 86623b0c-475b-4374-b5c2-9fcb634b61ff could not be found. Jan 15 21:40:52.554450 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1e777472-c518-45b9-af45-147463a4d426 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Returning 404 to user: Instance 86623b0c-475b-4374-b5c2-9fcb634b61ff could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:40:52.555295 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-1e777472-c518-45b9-af45-147463a4d426 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] 10.222.0.46 "GET /compute/v2.1/servers/86623b0c-475b-4374-b5c2-9fcb634b61ff" status: 404 len: 111 microversion: 2.1 time: 0.031056 Jan 15 21:40:52.555859 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3952/7889] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:40:52 2022] GET /compute/v2.1/servers/86623b0c-475b-4374-b5c2-9fcb634b61ff => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:40:52.565108 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-86454a3c-b6e8-4e88-ba64-5036805d7fd2 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:40:52.565826 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-86454a3c-b6e8-4e88-ba64-5036805d7fd2 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] [instance: 61b546e0-8940-4423-b490-b006ec7d622b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:40:52.572375 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-86454a3c-b6e8-4e88-ba64-5036805d7fd2 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:52.572851 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-86454a3c-b6e8-4e88-ba64-5036805d7fd2 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:52.573683 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-86454a3c-b6e8-4e88-ba64-5036805d7fd2 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:52.574136 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-86454a3c-b6e8-4e88-ba64-5036805d7fd2 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:52.704225 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-86454a3c-b6e8-4e88-ba64-5036805d7fd2 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f308027e399490ba3effc3417ccfffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c66a0c450f46beaf0167fad183c643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:40:52.715980 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-86454a3c-b6e8-4e88-ba64-5036805d7fd2 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] 10.222.0.46 "GET /compute/v2.1/servers/61b546e0-8940-4423-b490-b006ec7d622b" status: 200 len: 1506 microversion: 2.1 time: 0.154901 Jan 15 21:40:52.716565 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3938/7890] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:40:52 2022] GET /compute/v2.1/servers/61b546e0-8940-4423-b490-b006ec7d622b => generated 1506 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:40:52.732771 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b91be39c-6ec5-4775-aa9f-a27b8260fbcf tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:40:52.733792 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b91be39c-6ec5-4775-aa9f-a27b8260fbcf tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] [instance: dfaaa357-a107-442f-b406-02b9d8ad3fb2] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:40:52.739182 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-b91be39c-6ec5-4775-aa9f-a27b8260fbcf tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] HTTP exception thrown: Instance dfaaa357-a107-442f-b406-02b9d8ad3fb2 could not be found. Jan 15 21:40:52.739745 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b91be39c-6ec5-4775-aa9f-a27b8260fbcf tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Returning 404 to user: Instance dfaaa357-a107-442f-b406-02b9d8ad3fb2 could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:40:52.740534 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b91be39c-6ec5-4775-aa9f-a27b8260fbcf tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] 10.222.0.46 "POST /compute/v2.1/servers/dfaaa357-a107-442f-b406-02b9d8ad3fb2/action" status: 404 len: 111 microversion: 2.1 time: 0.011556 Jan 15 21:40:52.741120 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3953/7891] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:40:52 2022] POST /compute/v2.1/servers/dfaaa357-a107-442f-b406-02b9d8ad3fb2/action => generated 111 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:40:52.749110 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c36d40b5-9d9c-4ab2-aeac-ea0bf1c54474 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:40:52.749740 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c36d40b5-9d9c-4ab2-aeac-ea0bf1c54474 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] [instance: 61b546e0-8940-4423-b490-b006ec7d622b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:40:52.755818 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c36d40b5-9d9c-4ab2-aeac-ea0bf1c54474 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:52.756290 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c36d40b5-9d9c-4ab2-aeac-ea0bf1c54474 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:52.757344 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c36d40b5-9d9c-4ab2-aeac-ea0bf1c54474 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:52.757810 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c36d40b5-9d9c-4ab2-aeac-ea0bf1c54474 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:52.888670 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-c36d40b5-9d9c-4ab2-aeac-ea0bf1c54474 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f308027e399490ba3effc3417ccfffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c66a0c450f46beaf0167fad183c643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:40:52.896315 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c36d40b5-9d9c-4ab2-aeac-ea0bf1c54474 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] 10.222.0.46 "GET /compute/v2.1/servers/61b546e0-8940-4423-b490-b006ec7d622b" status: 200 len: 1506 microversion: 2.1 time: 0.150864 Jan 15 21:40:52.896992 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3939/7892] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:40:52 2022] GET /compute/v2.1/servers/61b546e0-8940-4423-b490-b006ec7d622b => generated 1506 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:40:52.915300 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ed4958a8-fb04-4e63-ab01-d6e19bf92887 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:40:52.915870 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ed4958a8-fb04-4e63-ab01-d6e19bf92887 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] [instance: 61b546e0-8940-4423-b490-b006ec7d622b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:40:52.922758 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ed4958a8-fb04-4e63-ab01-d6e19bf92887 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:52.923212 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ed4958a8-fb04-4e63-ab01-d6e19bf92887 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:52.924000 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ed4958a8-fb04-4e63-ab01-d6e19bf92887 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:52.924440 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ed4958a8-fb04-4e63-ab01-d6e19bf92887 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:53.059635 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-ed4958a8-fb04-4e63-ab01-d6e19bf92887 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f308027e399490ba3effc3417ccfffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c66a0c450f46beaf0167fad183c643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:40:53.067033 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ed4958a8-fb04-4e63-ab01-d6e19bf92887 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] 10.222.0.46 "GET /compute/v2.1/servers/61b546e0-8940-4423-b490-b006ec7d622b" status: 200 len: 1506 microversion: 2.1 time: 0.155823 Jan 15 21:40:53.067607 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3954/7893] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:40:52 2022] GET /compute/v2.1/servers/61b546e0-8940-4423-b490-b006ec7d622b => generated 1506 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:40:53.083687 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a8d2d0d1-804c-4e06-ba40-39d02d2c8d54 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "10739c74-411e-4e67-ac0c-370ca3ccbe11"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:40:53.085300 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a8d2d0d1-804c-4e06-ba40-39d02d2c8d54 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] [instance: 61b546e0-8940-4423-b490-b006ec7d622b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:40:53.092067 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a8d2d0d1-804c-4e06-ba40-39d02d2c8d54 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:53.092536 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a8d2d0d1-804c-4e06-ba40-39d02d2c8d54 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:53.093363 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a8d2d0d1-804c-4e06-ba40-39d02d2c8d54 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:53.093816 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a8d2d0d1-804c-4e06-ba40-39d02d2c8d54 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:53.183300 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-a8d2d0d1-804c-4e06-ba40-39d02d2c8d54 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '9f308027e399490ba3effc3417ccfffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c66a0c450f46beaf0167fad183c643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:40:53.188940 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-a8d2d0d1-804c-4e06-ba40-39d02d2c8d54 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] HTTP exception thrown: Flavor 10739c74-411e-4e67-ac0c-370ca3ccbe11 could not be found. Jan 15 21:40:53.189555 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a8d2d0d1-804c-4e06-ba40-39d02d2c8d54 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Returning 400 to user: Flavor 10739c74-411e-4e67-ac0c-370ca3ccbe11 could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:40:53.190412 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a8d2d0d1-804c-4e06-ba40-39d02d2c8d54 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] 10.222.0.46 "POST /compute/v2.1/servers/61b546e0-8940-4423-b490-b006ec7d622b/action" status: 400 len: 107 microversion: 2.1 time: 0.110570 Jan 15 21:40:53.190978 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3940/7894] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:40:53 2022] POST /compute/v2.1/servers/61b546e0-8940-4423-b490-b006ec7d622b/action => generated 107 bytes in 112 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 15 21:40:53.199415 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4c800a3a-ec0d-46b8-8bb7-c51d88945ed5 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:40:53.200059 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-4c800a3a-ec0d-46b8-8bb7-c51d88945ed5 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] [instance: 61b546e0-8940-4423-b490-b006ec7d622b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:40:53.206167 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4c800a3a-ec0d-46b8-8bb7-c51d88945ed5 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:53.206623 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4c800a3a-ec0d-46b8-8bb7-c51d88945ed5 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:53.207442 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4c800a3a-ec0d-46b8-8bb7-c51d88945ed5 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:53.207881 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4c800a3a-ec0d-46b8-8bb7-c51d88945ed5 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:53.337537 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-4c800a3a-ec0d-46b8-8bb7-c51d88945ed5 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f308027e399490ba3effc3417ccfffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c66a0c450f46beaf0167fad183c643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:40:53.345389 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-4c800a3a-ec0d-46b8-8bb7-c51d88945ed5 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] 10.222.0.46 "GET /compute/v2.1/servers/61b546e0-8940-4423-b490-b006ec7d622b" status: 200 len: 1506 microversion: 2.1 time: 0.149695 Jan 15 21:40:53.352922 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3955/7895] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:40:53 2022] GET /compute/v2.1/servers/61b546e0-8940-4423-b490-b006ec7d622b => generated 1506 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:40:53.362403 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a9000263-4916-4b18-962c-fffaa94d1091 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:40:53.363022 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a9000263-4916-4b18-962c-fffaa94d1091 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] [instance: 61b546e0-8940-4423-b490-b006ec7d622b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:40:53.369681 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a9000263-4916-4b18-962c-fffaa94d1091 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:53.370140 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a9000263-4916-4b18-962c-fffaa94d1091 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:53.370922 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a9000263-4916-4b18-962c-fffaa94d1091 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:53.371367 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a9000263-4916-4b18-962c-fffaa94d1091 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:53.505578 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-a9000263-4916-4b18-962c-fffaa94d1091 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f308027e399490ba3effc3417ccfffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c66a0c450f46beaf0167fad183c643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:40:53.513639 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a9000263-4916-4b18-962c-fffaa94d1091 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] 10.222.0.46 "GET /compute/v2.1/servers/61b546e0-8940-4423-b490-b006ec7d622b" status: 200 len: 1506 microversion: 2.1 time: 0.154999 Jan 15 21:40:53.514211 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3941/7896] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:40:53 2022] GET /compute/v2.1/servers/61b546e0-8940-4423-b490-b006ec7d622b => generated 1506 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:40:53.529495 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7e765142-d881-4fe7-8c4d-d6506d9ed200 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:40:53.530604 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7e765142-d881-4fe7-8c4d-d6506d9ed200 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:40:53.531391 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7e765142-d881-4fe7-8c4d-d6506d9ed200 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] 10.222.0.46 "POST /compute/v2.1/servers/61b546e0-8940-4423-b490-b006ec7d622b/action" status: 400 len: 113 microversion: 2.1 time: 0.005744 Jan 15 21:40:53.531906 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3956/7897] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:40:53 2022] POST /compute/v2.1/servers/61b546e0-8940-4423-b490-b006ec7d622b/action => generated 113 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 15 21:40:53.539532 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ef8ebf77-c642-45c4-9851-d7629af47631 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:40:53.540143 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ef8ebf77-c642-45c4-9851-d7629af47631 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] [instance: 61b546e0-8940-4423-b490-b006ec7d622b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:40:53.546028 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ef8ebf77-c642-45c4-9851-d7629af47631 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:53.546487 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ef8ebf77-c642-45c4-9851-d7629af47631 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:53.547296 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ef8ebf77-c642-45c4-9851-d7629af47631 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:53.547738 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ef8ebf77-c642-45c4-9851-d7629af47631 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:53.678368 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-ef8ebf77-c642-45c4-9851-d7629af47631 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f308027e399490ba3effc3417ccfffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c66a0c450f46beaf0167fad183c643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:40:53.687029 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ef8ebf77-c642-45c4-9851-d7629af47631 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] 10.222.0.46 "GET /compute/v2.1/servers/61b546e0-8940-4423-b490-b006ec7d622b" status: 200 len: 1506 microversion: 2.1 time: 0.151201 Jan 15 21:40:53.687542 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3942/7898] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:40:53 2022] GET /compute/v2.1/servers/61b546e0-8940-4423-b490-b006ec7d622b => generated 1506 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:40:53.707426 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b0caf251-4150-4638-9447-11a165dabb3b tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:40:53.707920 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b0caf251-4150-4638-9447-11a165dabb3b tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] [instance: 86623b0c-475b-4374-b5c2-9fcb634b61ff] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:40:53.715123 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b0caf251-4150-4638-9447-11a165dabb3b tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:53.715575 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b0caf251-4150-4638-9447-11a165dabb3b tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:53.716337 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b0caf251-4150-4638-9447-11a165dabb3b tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:53.716767 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b0caf251-4150-4638-9447-11a165dabb3b tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:53.730260 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-b0caf251-4150-4638-9447-11a165dabb3b tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] HTTP exception thrown: Instance 86623b0c-475b-4374-b5c2-9fcb634b61ff could not be found. Jan 15 21:40:53.730838 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b0caf251-4150-4638-9447-11a165dabb3b tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Returning 404 to user: Instance 86623b0c-475b-4374-b5c2-9fcb634b61ff could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:40:53.731673 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b0caf251-4150-4638-9447-11a165dabb3b tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] 10.222.0.46 "DELETE /compute/v2.1/servers/86623b0c-475b-4374-b5c2-9fcb634b61ff" status: 404 len: 111 microversion: 2.1 time: 0.028840 Jan 15 21:40:53.732200 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3957/7899] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 21:40:53 2022] DELETE /compute/v2.1/servers/86623b0c-475b-4374-b5c2-9fcb634b61ff => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:40:53.739889 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-70aa4c68-a7d2-48ba-9451-8e0ea0c8a865 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:40:53.740503 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-70aa4c68-a7d2-48ba-9451-8e0ea0c8a865 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] [instance: 86623b0c-475b-4374-b5c2-9fcb634b61ff] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:40:53.747004 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-70aa4c68-a7d2-48ba-9451-8e0ea0c8a865 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:53.747466 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-70aa4c68-a7d2-48ba-9451-8e0ea0c8a865 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:53.748246 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-70aa4c68-a7d2-48ba-9451-8e0ea0c8a865 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:53.748692 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-70aa4c68-a7d2-48ba-9451-8e0ea0c8a865 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:53.762465 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-70aa4c68-a7d2-48ba-9451-8e0ea0c8a865 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] HTTP exception thrown: Instance 86623b0c-475b-4374-b5c2-9fcb634b61ff could not be found. Jan 15 21:40:53.763059 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-70aa4c68-a7d2-48ba-9451-8e0ea0c8a865 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Returning 404 to user: Instance 86623b0c-475b-4374-b5c2-9fcb634b61ff could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:40:53.763926 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-70aa4c68-a7d2-48ba-9451-8e0ea0c8a865 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] 10.222.0.46 "GET /compute/v2.1/servers/86623b0c-475b-4374-b5c2-9fcb634b61ff" status: 404 len: 111 microversion: 2.1 time: 0.027724 Jan 15 21:40:53.764468 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3943/7900] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:40:53 2022] GET /compute/v2.1/servers/86623b0c-475b-4374-b5c2-9fcb634b61ff => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:40:53.772264 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-64dcff33-e96f-4294-b640-459c8b4e101e tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:40:53.772757 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-64dcff33-e96f-4294-b640-459c8b4e101e tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] [instance: 61b546e0-8940-4423-b490-b006ec7d622b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:40:53.778794 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-64dcff33-e96f-4294-b640-459c8b4e101e tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:53.779246 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-64dcff33-e96f-4294-b640-459c8b4e101e tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:53.780027 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-64dcff33-e96f-4294-b640-459c8b4e101e tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:53.780464 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-64dcff33-e96f-4294-b640-459c8b4e101e tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:53.808302 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-64dcff33-e96f-4294-b640-459c8b4e101e tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] [instance: 61b546e0-8940-4423-b490-b006ec7d622b] Going to try to terminate instance {{(pid=129366) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 21:40:53.881956 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-64dcff33-e96f-4294-b640-459c8b4e101e tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] 10.222.0.46 "DELETE /compute/v2.1/servers/61b546e0-8940-4423-b490-b006ec7d622b" status: 204 len: 0 microversion: 2.1 time: 0.113160 Jan 15 21:40:53.882583 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3958/7901] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 21:40:53 2022] DELETE /compute/v2.1/servers/61b546e0-8940-4423-b490-b006ec7d622b => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 21:40:53.891892 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a6270028-22af-4366-b141-e88d9663cd8e tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:40:53.892519 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a6270028-22af-4366-b141-e88d9663cd8e tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] [instance: 61b546e0-8940-4423-b490-b006ec7d622b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:40:53.899246 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a6270028-22af-4366-b141-e88d9663cd8e tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:53.899720 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a6270028-22af-4366-b141-e88d9663cd8e tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:53.900785 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a6270028-22af-4366-b141-e88d9663cd8e tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:53.901268 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a6270028-22af-4366-b141-e88d9663cd8e tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:54.031025 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-a6270028-22af-4366-b141-e88d9663cd8e tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f308027e399490ba3effc3417ccfffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c66a0c450f46beaf0167fad183c643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:40:54.038696 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a6270028-22af-4366-b141-e88d9663cd8e tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] 10.222.0.46 "GET /compute/v2.1/servers/61b546e0-8940-4423-b490-b006ec7d622b" status: 200 len: 1512 microversion: 2.1 time: 0.151739 Jan 15 21:40:54.040868 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3944/7902] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:40:53 2022] GET /compute/v2.1/servers/61b546e0-8940-4423-b490-b006ec7d622b => generated 1512 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:40:55.058332 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-3b569f30-5c37-46cd-9f2d-b00ba948b193 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:40:55.059058 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-3b569f30-5c37-46cd-9f2d-b00ba948b193 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] [instance: 61b546e0-8940-4423-b490-b006ec7d622b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:40:55.065857 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3b569f30-5c37-46cd-9f2d-b00ba948b193 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:55.066302 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3b569f30-5c37-46cd-9f2d-b00ba948b193 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:55.067068 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3b569f30-5c37-46cd-9f2d-b00ba948b193 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:55.067503 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3b569f30-5c37-46cd-9f2d-b00ba948b193 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:55.201976 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-3b569f30-5c37-46cd-9f2d-b00ba948b193 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f308027e399490ba3effc3417ccfffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c66a0c450f46beaf0167fad183c643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:40:55.209460 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-3b569f30-5c37-46cd-9f2d-b00ba948b193 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] 10.222.0.46 "GET /compute/v2.1/servers/61b546e0-8940-4423-b490-b006ec7d622b" status: 200 len: 1512 microversion: 2.1 time: 0.155811 Jan 15 21:40:55.210035 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3959/7903] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:40:55 2022] GET /compute/v2.1/servers/61b546e0-8940-4423-b490-b006ec7d622b => generated 1512 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:40:55.793627 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-1b19cd8b-c6d4-4b0d-a068-3bdb2c6a78ba req-d722376d-fff7-4cb4-aa17-74f95502c88b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61b546e0-8940-4423-b490-b006ec7d622b", "name": "network-vif-deleted", "tag": "6d7d0606-d83d-4d88-ad26-a7e2eebdd81d"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:40:55.795149 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:40:55.795149 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:40:55.804020 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-1b19cd8b-c6d4-4b0d-a068-3bdb2c6a78ba req-d722376d-fff7-4cb4-aa17-74f95502c88b service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:55.805200 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-1b19cd8b-c6d4-4b0d-a068-3bdb2c6a78ba req-d722376d-fff7-4cb4-aa17-74f95502c88b service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:55.817952 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-1b19cd8b-c6d4-4b0d-a068-3bdb2c6a78ba req-d722376d-fff7-4cb4-aa17-74f95502c88b service nova] Creating event network-vif-deleted:6d7d0606-d83d-4d88-ad26-a7e2eebdd81d for instance 61b546e0-8940-4423-b490-b006ec7d622b on nch2-master-1 Jan 15 21:40:55.825727 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-1b19cd8b-c6d4-4b0d-a068-3bdb2c6a78ba req-d722376d-fff7-4cb4-aa17-74f95502c88b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037478 Jan 15 21:40:55.826341 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3945/7904] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:40:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:40:56.227261 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c2718bbe-7ccb-46da-be4b-82850f67db9e tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:40:56.227873 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c2718bbe-7ccb-46da-be4b-82850f67db9e tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] [instance: 61b546e0-8940-4423-b490-b006ec7d622b] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:40:56.235981 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c2718bbe-7ccb-46da-be4b-82850f67db9e tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:56.236424 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c2718bbe-7ccb-46da-be4b-82850f67db9e tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:56.237248 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c2718bbe-7ccb-46da-be4b-82850f67db9e tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:56.237680 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c2718bbe-7ccb-46da-be4b-82850f67db9e tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:56.269853 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c2718bbe-7ccb-46da-be4b-82850f67db9e tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:56.270301 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c2718bbe-7ccb-46da-be4b-82850f67db9e tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:56.270752 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.objects.instance [None req-c2718bbe-7ccb-46da-be4b-82850f67db9e tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lazy-loading 'fault' on Instance uuid 61b546e0-8940-4423-b490-b006ec7d622b {{(pid=129366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 21:40:56.311917 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-c2718bbe-7ccb-46da-be4b-82850f67db9e tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f308027e399490ba3effc3417ccfffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c66a0c450f46beaf0167fad183c643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:40:56.318873 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c2718bbe-7ccb-46da-be4b-82850f67db9e tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] 10.222.0.46 "GET /compute/v2.1/servers/61b546e0-8940-4423-b490-b006ec7d622b" status: 200 len: 1307 microversion: 2.1 time: 0.096906 Jan 15 21:40:56.319460 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3960/7905] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:40:56 2022] GET /compute/v2.1/servers/61b546e0-8940-4423-b490-b006ec7d622b => generated 1307 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:40:57.336039 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e29aa1b0-e8af-454b-b880-13703d521671 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:40:57.336789 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e29aa1b0-e8af-454b-b880-13703d521671 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] [instance: 61b546e0-8940-4423-b490-b006ec7d622b] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:40:57.343956 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e29aa1b0-e8af-454b-b880-13703d521671 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:57.344425 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e29aa1b0-e8af-454b-b880-13703d521671 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:57.345265 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e29aa1b0-e8af-454b-b880-13703d521671 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:40:57.345725 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e29aa1b0-e8af-454b-b880-13703d521671 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:40:57.362137 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-e29aa1b0-e8af-454b-b880-13703d521671 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] HTTP exception thrown: Instance 61b546e0-8940-4423-b490-b006ec7d622b could not be found. Jan 15 21:40:57.362738 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e29aa1b0-e8af-454b-b880-13703d521671 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] Returning 404 to user: Instance 61b546e0-8940-4423-b490-b006ec7d622b could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:40:57.363579 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e29aa1b0-e8af-454b-b880-13703d521671 tempest-ServersNegativeTestJSON-1780821445 tempest-ServersNegativeTestJSON-1780821445-project] 10.222.0.46 "GET /compute/v2.1/servers/61b546e0-8940-4423-b490-b006ec7d622b" status: 404 len: 111 microversion: 2.1 time: 0.031756 Jan 15 21:40:57.364136 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3946/7906] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:40:57 2022] GET /compute/v2.1/servers/61b546e0-8940-4423-b490-b006ec7d622b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:41:37.416119 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d15b1acf-28c3-4f14-a317-1f4c49a2333f tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Action: 'create', calling method: .version_select at 0x7f30c8f3e310>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-2108988098"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:41:37.432790 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-d15b1acf-28c3-4f14-a317-1f4c49a2333f tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Getting quotas for project 7c3e3591eb6a485591b4e5b9dbf636ee. Resources: {'key_pairs'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:41:37.437934 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-d15b1acf-28c3-4f14-a317-1f4c49a2333f tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Getting quotas for user 82df3698420f49d495b7563b477680b2 and project 7c3e3591eb6a485591b4e5b9dbf636ee. Resources: {'key_pairs'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:41:37.550628 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-d15b1acf-28c3-4f14-a317-1f4c49a2333f tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Getting quotas for project 7c3e3591eb6a485591b4e5b9dbf636ee. Resources: {'key_pairs'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:41:37.556141 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-d15b1acf-28c3-4f14-a317-1f4c49a2333f tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Getting quotas for user 82df3698420f49d495b7563b477680b2 and project 7c3e3591eb6a485591b4e5b9dbf636ee. Resources: {'key_pairs'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:41:37.573846 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d15b1acf-28c3-4f14-a317-1f4c49a2333f tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 0.161811 Jan 15 21:41:37.574476 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3961/7907] 10.222.0.46 () {60 vars in 1157 bytes} [Sat Jan 15 21:41:37 2022] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:41:37.623542 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-83f60ed0-199b-4e4c-979d-6f297effb49b tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1678346176", "imageRef": "72fcbc25-bdd9-4a52-8dec-2cbbf74f305e", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-2108988098", "networks": [{"uuid": "db49f030-b94f-4947-8a67-4c6ce2ffda3f"}]}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:41:37.672928 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.network.neutron [None req-83f60ed0-199b-4e4c-979d-6f297effb49b tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] validate_networks() for [('db49f030-b94f-4947-8a67-4c6ce2ffda3f', None, None, None, None, None)] {{(pid=129365) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 21:41:38.042857 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-83f60ed0-199b-4e4c-979d-6f297effb49b tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Flavor limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 21:41:38.043293 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-83f60ed0-199b-4e4c-979d-6f297effb49b tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Image limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 21:41:38.043782 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-83f60ed0-199b-4e4c-979d-6f297effb49b tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Flavor pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 21:41:38.044202 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-83f60ed0-199b-4e4c-979d-6f297effb49b tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Image pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 21:41:38.044629 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-83f60ed0-199b-4e4c-979d-6f297effb49b tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 21:41:38.054135 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-83f60ed0-199b-4e4c-979d-6f297effb49b tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:41:38.054778 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-83f60ed0-199b-4e4c-979d-6f297effb49b tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:41:38.055627 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-83f60ed0-199b-4e4c-979d-6f297effb49b tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:41:38.056060 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-83f60ed0-199b-4e4c-979d-6f297effb49b tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:41:38.073633 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-83f60ed0-199b-4e4c-979d-6f297effb49b tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Getting quotas for project 7c3e3591eb6a485591b4e5b9dbf636ee. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:41:38.078695 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-83f60ed0-199b-4e4c-979d-6f297effb49b tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Getting quotas for user 82df3698420f49d495b7563b477680b2 and project 7c3e3591eb6a485591b4e5b9dbf636ee. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:41:38.090643 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-83f60ed0-199b-4e4c-979d-6f297effb49b tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Going to run 1 instances... {{(pid=129365) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 21:41:38.092925 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-83f60ed0-199b-4e4c-979d-6f297effb49b tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] [instance: 092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='72fcbc25-bdd9-4a52-8dec-2cbbf74f305e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129365) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 21:41:38.135009 ncdv-master-1 devstack@n-api.service[129365]: ERROR oslo.messaging._drivers.impl_rabbit [None req-83f60ed0-199b-4e4c-979d-6f297effb49b tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] [c9407883-f990-4a97-b813-b51b9ecbc106] AMQP server on 10.222.0.46:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 15 21:41:39.142365 ncdv-master-1 devstack@n-api.service[129365]: INFO oslo.messaging._drivers.impl_rabbit [None req-83f60ed0-199b-4e4c-979d-6f297effb49b tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] [c9407883-f990-4a97-b813-b51b9ecbc106] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 39964. Jan 15 21:41:39.146337 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-83f60ed0-199b-4e4c-979d-6f297effb49b tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.526620 Jan 15 21:41:39.148184 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3947/7908] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 21:41:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1529 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 21:41:39.158436 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-5fd8e790-821f-4ae8-a8a1-42c1bbbe1cf7 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:41:39.159041 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-5fd8e790-821f-4ae8-a8a1-42c1bbbe1cf7 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] [instance: 092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:41:39.211217 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-5fd8e790-821f-4ae8-a8a1-42c1bbbe1cf7 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82df3698420f49d495b7563b477680b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3e3591eb6a485591b4e5b9dbf636ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:41:39.218521 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-5fd8e790-821f-4ae8-a8a1-42c1bbbe1cf7 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] 10.222.0.46 "GET /compute/v2.1/servers/092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0" status: 200 len: 1259 microversion: 2.1 time: 0.064597 Jan 15 21:41:39.219082 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3962/7909] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:41:39 2022] GET /compute/v2.1/servers/092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0 => generated 1259 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:41:40.236799 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-85a2746e-c860-4577-92e2-1c7b563cc9aa tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:41:40.237457 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-85a2746e-c860-4577-92e2-1c7b563cc9aa tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] [instance: 092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:41:40.245658 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-85a2746e-c860-4577-92e2-1c7b563cc9aa tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:41:40.246128 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-85a2746e-c860-4577-92e2-1c7b563cc9aa tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:41:40.246929 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-85a2746e-c860-4577-92e2-1c7b563cc9aa tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:41:40.247383 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-85a2746e-c860-4577-92e2-1c7b563cc9aa tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:41:40.313217 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-85a2746e-c860-4577-92e2-1c7b563cc9aa tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82df3698420f49d495b7563b477680b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3e3591eb6a485591b4e5b9dbf636ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:41:40.322247 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-85a2746e-c860-4577-92e2-1c7b563cc9aa tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] 10.222.0.46 "GET /compute/v2.1/servers/092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0" status: 200 len: 1317 microversion: 2.1 time: 0.089914 Jan 15 21:41:40.324166 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3948/7910] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:41:40 2022] GET /compute/v2.1/servers/092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0 => generated 1317 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:41:41.342382 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f9743c28-58a2-4474-81f5-de5d573fcb1d tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:41:41.343006 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f9743c28-58a2-4474-81f5-de5d573fcb1d tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] [instance: 092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:41:41.354433 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f9743c28-58a2-4474-81f5-de5d573fcb1d tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:41:41.355014 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f9743c28-58a2-4474-81f5-de5d573fcb1d tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:41:41.355915 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f9743c28-58a2-4474-81f5-de5d573fcb1d tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:41:41.356448 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f9743c28-58a2-4474-81f5-de5d573fcb1d tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:41:41.540701 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-f9743c28-58a2-4474-81f5-de5d573fcb1d tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82df3698420f49d495b7563b477680b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3e3591eb6a485591b4e5b9dbf636ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:41:41.549850 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f9743c28-58a2-4474-81f5-de5d573fcb1d tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] 10.222.0.46 "GET /compute/v2.1/servers/092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0" status: 200 len: 1359 microversion: 2.1 time: 0.211789 Jan 15 21:41:41.550877 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3963/7911] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:41:41 2022] GET /compute/v2.1/servers/092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0 => generated 1359 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:41:42.569267 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5d075ce1-5f7a-49ca-8019-d3508604a181 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:41:42.570961 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-5d075ce1-5f7a-49ca-8019-d3508604a181 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] [instance: 092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:41:42.579331 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5d075ce1-5f7a-49ca-8019-d3508604a181 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:41:42.580153 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5d075ce1-5f7a-49ca-8019-d3508604a181 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:41:42.581476 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5d075ce1-5f7a-49ca-8019-d3508604a181 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:41:42.582166 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5d075ce1-5f7a-49ca-8019-d3508604a181 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:41:42.729217 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-5d075ce1-5f7a-49ca-8019-d3508604a181 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82df3698420f49d495b7563b477680b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3e3591eb6a485591b4e5b9dbf636ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:41:42.738272 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5d075ce1-5f7a-49ca-8019-d3508604a181 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] 10.222.0.46 "GET /compute/v2.1/servers/092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0" status: 200 len: 1359 microversion: 2.1 time: 0.174005 Jan 15 21:41:42.738969 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3949/7912] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:41:42 2022] GET /compute/v2.1/servers/092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0 => generated 1359 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:41:43.757110 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-2d7a1e10-464a-4eda-aa22-843009bc4b02 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:41:43.757891 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-2d7a1e10-464a-4eda-aa22-843009bc4b02 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] [instance: 092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:41:43.764654 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2d7a1e10-464a-4eda-aa22-843009bc4b02 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:41:43.765230 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2d7a1e10-464a-4eda-aa22-843009bc4b02 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:41:43.766012 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2d7a1e10-464a-4eda-aa22-843009bc4b02 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:41:43.766451 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2d7a1e10-464a-4eda-aa22-843009bc4b02 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:41:43.913519 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-2d7a1e10-464a-4eda-aa22-843009bc4b02 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82df3698420f49d495b7563b477680b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3e3591eb6a485591b4e5b9dbf636ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:41:43.921179 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-2d7a1e10-464a-4eda-aa22-843009bc4b02 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] 10.222.0.46 "GET /compute/v2.1/servers/092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0" status: 200 len: 1359 microversion: 2.1 time: 0.168333 Jan 15 21:41:43.921767 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3964/7913] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:41:43 2022] GET /compute/v2.1/servers/092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0 => generated 1359 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:41:44.938746 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-19025467-8b09-41e7-bfd1-d186e67e99c1 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:41:44.939501 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-19025467-8b09-41e7-bfd1-d186e67e99c1 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] [instance: 092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:41:44.947504 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-19025467-8b09-41e7-bfd1-d186e67e99c1 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:41:44.948054 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-19025467-8b09-41e7-bfd1-d186e67e99c1 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:41:44.949000 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-19025467-8b09-41e7-bfd1-d186e67e99c1 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:41:44.949545 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-19025467-8b09-41e7-bfd1-d186e67e99c1 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:41:45.102377 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-19025467-8b09-41e7-bfd1-d186e67e99c1 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82df3698420f49d495b7563b477680b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3e3591eb6a485591b4e5b9dbf636ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:41:45.109871 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-19025467-8b09-41e7-bfd1-d186e67e99c1 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] 10.222.0.46 "GET /compute/v2.1/servers/092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0" status: 200 len: 1359 microversion: 2.1 time: 0.175237 Jan 15 21:41:45.110447 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3950/7914] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:41:44 2022] GET /compute/v2.1/servers/092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0 => generated 1359 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:41:46.129931 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-caf45fe0-173b-4398-966a-b3eae7ebc38a tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:41:46.132193 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-caf45fe0-173b-4398-966a-b3eae7ebc38a tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] [instance: 092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:41:46.139713 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-caf45fe0-173b-4398-966a-b3eae7ebc38a tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:41:46.140462 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-caf45fe0-173b-4398-966a-b3eae7ebc38a tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:41:46.141313 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-caf45fe0-173b-4398-966a-b3eae7ebc38a tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:41:46.141755 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-caf45fe0-173b-4398-966a-b3eae7ebc38a tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:41:46.293399 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-caf45fe0-173b-4398-966a-b3eae7ebc38a tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82df3698420f49d495b7563b477680b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3e3591eb6a485591b4e5b9dbf636ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:41:46.302240 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-caf45fe0-173b-4398-966a-b3eae7ebc38a tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] 10.222.0.46 "GET /compute/v2.1/servers/092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0" status: 200 len: 1359 microversion: 2.1 time: 0.177780 Jan 15 21:41:46.303180 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3965/7915] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:41:46 2022] GET /compute/v2.1/servers/092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0 => generated 1359 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:41:47.319682 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a3ec7442-03ae-47c5-92a9-60bf14464a25 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:41:47.320604 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a3ec7442-03ae-47c5-92a9-60bf14464a25 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] [instance: 092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:41:47.327608 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a3ec7442-03ae-47c5-92a9-60bf14464a25 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:41:47.328076 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a3ec7442-03ae-47c5-92a9-60bf14464a25 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:41:47.328880 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a3ec7442-03ae-47c5-92a9-60bf14464a25 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:41:47.329330 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a3ec7442-03ae-47c5-92a9-60bf14464a25 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:41:47.480511 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-a3ec7442-03ae-47c5-92a9-60bf14464a25 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82df3698420f49d495b7563b477680b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3e3591eb6a485591b4e5b9dbf636ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:41:47.490217 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a3ec7442-03ae-47c5-92a9-60bf14464a25 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] 10.222.0.46 "GET /compute/v2.1/servers/092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0" status: 200 len: 1359 microversion: 2.1 time: 0.174459 Jan 15 21:41:47.500019 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3951/7916] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:41:47 2022] GET /compute/v2.1/servers/092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0 => generated 1359 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:41:48.507507 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-47119273-6ca4-40b0-915d-86ed8767b1e2 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:41:48.508247 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-47119273-6ca4-40b0-915d-86ed8767b1e2 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] [instance: 092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:41:48.515871 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-47119273-6ca4-40b0-915d-86ed8767b1e2 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:41:48.516395 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-47119273-6ca4-40b0-915d-86ed8767b1e2 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:41:48.517212 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-47119273-6ca4-40b0-915d-86ed8767b1e2 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:41:48.517646 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-47119273-6ca4-40b0-915d-86ed8767b1e2 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:41:48.660390 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-47119273-6ca4-40b0-915d-86ed8767b1e2 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82df3698420f49d495b7563b477680b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3e3591eb6a485591b4e5b9dbf636ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:41:48.669664 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-47119273-6ca4-40b0-915d-86ed8767b1e2 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] 10.222.0.46 "GET /compute/v2.1/servers/092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0" status: 200 len: 1359 microversion: 2.1 time: 0.165960 Jan 15 21:41:48.670260 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3966/7917] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:41:48 2022] GET /compute/v2.1/servers/092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0 => generated 1359 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:41:49.023679 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-3fefa31b-3641-4012-9668-650958fa3154 req-e857f21f-5526-4891-99c6-b7c7182be2f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0", "tag": "021182f9-1b1a-4c52-a3cc-64346bd7c5cb"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:41:49.033027 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:41:49.033027 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:41:49.043614 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-3fefa31b-3641-4012-9668-650958fa3154 req-e857f21f-5526-4891-99c6-b7c7182be2f8 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:41:49.043948 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-3fefa31b-3641-4012-9668-650958fa3154 req-e857f21f-5526-4891-99c6-b7c7182be2f8 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:41:49.063777 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-3fefa31b-3641-4012-9668-650958fa3154 req-e857f21f-5526-4891-99c6-b7c7182be2f8 service nova] Creating event network-changed:021182f9-1b1a-4c52-a3cc-64346bd7c5cb for instance 092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0 on nch2-master-1 Jan 15 21:41:49.072975 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-3fefa31b-3641-4012-9668-650958fa3154 req-e857f21f-5526-4891-99c6-b7c7182be2f8 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053483 Jan 15 21:41:49.073622 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3952/7918] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:41:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:41:49.687357 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-712f3a85-3eb8-4c2d-bc36-81659a0db7d5 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:41:49.687970 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-712f3a85-3eb8-4c2d-bc36-81659a0db7d5 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] [instance: 092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:41:49.695528 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-712f3a85-3eb8-4c2d-bc36-81659a0db7d5 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:41:49.695995 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-712f3a85-3eb8-4c2d-bc36-81659a0db7d5 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:41:49.696772 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-712f3a85-3eb8-4c2d-bc36-81659a0db7d5 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:41:49.697243 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-712f3a85-3eb8-4c2d-bc36-81659a0db7d5 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:41:49.836541 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-712f3a85-3eb8-4c2d-bc36-81659a0db7d5 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82df3698420f49d495b7563b477680b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3e3591eb6a485591b4e5b9dbf636ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:41:49.844069 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-712f3a85-3eb8-4c2d-bc36-81659a0db7d5 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] 10.222.0.46 "GET /compute/v2.1/servers/092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0" status: 200 len: 1359 microversion: 2.1 time: 0.160472 Jan 15 21:41:49.844653 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3967/7919] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:41:49 2022] GET /compute/v2.1/servers/092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0 => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:41:50.863233 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-11f8b7bf-96c7-4ec1-a813-da2bfc39ef19 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:41:50.863974 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-11f8b7bf-96c7-4ec1-a813-da2bfc39ef19 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] [instance: 092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:41:50.871180 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-11f8b7bf-96c7-4ec1-a813-da2bfc39ef19 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:41:50.871649 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-11f8b7bf-96c7-4ec1-a813-da2bfc39ef19 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:41:50.872437 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-11f8b7bf-96c7-4ec1-a813-da2bfc39ef19 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:41:50.872921 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-11f8b7bf-96c7-4ec1-a813-da2bfc39ef19 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:41:51.006794 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-11f8b7bf-96c7-4ec1-a813-da2bfc39ef19 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82df3698420f49d495b7563b477680b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3e3591eb6a485591b4e5b9dbf636ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:41:51.015107 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-11f8b7bf-96c7-4ec1-a813-da2bfc39ef19 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] 10.222.0.46 "GET /compute/v2.1/servers/092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0" status: 200 len: 1359 microversion: 2.1 time: 0.156908 Jan 15 21:41:51.015692 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3953/7920] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:41:50 2022] GET /compute/v2.1/servers/092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0 => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:41:52.032967 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7d5f9c3f-680a-4bb0-b658-347e388a729a tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:41:52.033577 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-7d5f9c3f-680a-4bb0-b658-347e388a729a tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] [instance: 092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:41:52.040654 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7d5f9c3f-680a-4bb0-b658-347e388a729a tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:41:52.041158 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7d5f9c3f-680a-4bb0-b658-347e388a729a tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:41:52.042287 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7d5f9c3f-680a-4bb0-b658-347e388a729a tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:41:52.042410 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7d5f9c3f-680a-4bb0-b658-347e388a729a tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:41:52.181523 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-7d5f9c3f-680a-4bb0-b658-347e388a729a tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82df3698420f49d495b7563b477680b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3e3591eb6a485591b4e5b9dbf636ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:41:52.189039 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7d5f9c3f-680a-4bb0-b658-347e388a729a tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] 10.222.0.46 "GET /compute/v2.1/servers/092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0" status: 200 len: 1359 microversion: 2.1 time: 0.159760 Jan 15 21:41:52.189614 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3968/7921] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:41:52 2022] GET /compute/v2.1/servers/092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0 => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:41:53.206301 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-26052d5c-8238-4812-8696-d1056cf7b5d8 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:41:53.206926 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-26052d5c-8238-4812-8696-d1056cf7b5d8 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] [instance: 092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:41:53.215599 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-26052d5c-8238-4812-8696-d1056cf7b5d8 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:41:53.216071 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-26052d5c-8238-4812-8696-d1056cf7b5d8 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:41:53.217592 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-26052d5c-8238-4812-8696-d1056cf7b5d8 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:41:53.218054 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-26052d5c-8238-4812-8696-d1056cf7b5d8 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:41:53.376994 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-26052d5c-8238-4812-8696-d1056cf7b5d8 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82df3698420f49d495b7563b477680b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3e3591eb6a485591b4e5b9dbf636ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:41:53.386722 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-26052d5c-8238-4812-8696-d1056cf7b5d8 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] 10.222.0.46 "GET /compute/v2.1/servers/092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0" status: 200 len: 1359 microversion: 2.1 time: 0.184080 Jan 15 21:41:53.387337 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3954/7922] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:41:53 2022] GET /compute/v2.1/servers/092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0 => generated 1359 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:41:53.860362 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-1631a4a0-80f0-41c1-92d4-7eab02f7214f req-429285ce-73d4-45f4-848d-38ac5f7795ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0", "name": "network-vif-plugged", "status": "completed", "tag": "021182f9-1b1a-4c52-a3cc-64346bd7c5cb"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:41:53.862054 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:41:53.862054 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:41:53.872036 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-1631a4a0-80f0-41c1-92d4-7eab02f7214f req-429285ce-73d4-45f4-848d-38ac5f7795ff service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:41:53.872487 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-1631a4a0-80f0-41c1-92d4-7eab02f7214f req-429285ce-73d4-45f4-848d-38ac5f7795ff service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:41:53.883834 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-1631a4a0-80f0-41c1-92d4-7eab02f7214f req-429285ce-73d4-45f4-848d-38ac5f7795ff service nova] Creating event network-vif-plugged:021182f9-1b1a-4c52-a3cc-64346bd7c5cb for instance 092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0 on nch2-master-1 Jan 15 21:41:53.889075 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-1631a4a0-80f0-41c1-92d4-7eab02f7214f req-429285ce-73d4-45f4-848d-38ac5f7795ff service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032832 Jan 15 21:41:53.889673 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3969/7923] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:41:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:41:54.403669 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-7dc43074-7069-4403-8aa6-1dc00233ecbd tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:41:54.404410 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-7dc43074-7069-4403-8aa6-1dc00233ecbd tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] [instance: 092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:41:54.412126 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7dc43074-7069-4403-8aa6-1dc00233ecbd tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:41:54.412620 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7dc43074-7069-4403-8aa6-1dc00233ecbd tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:41:54.413585 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7dc43074-7069-4403-8aa6-1dc00233ecbd tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:41:54.414033 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7dc43074-7069-4403-8aa6-1dc00233ecbd tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:41:54.549591 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-7dc43074-7069-4403-8aa6-1dc00233ecbd tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82df3698420f49d495b7563b477680b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3e3591eb6a485591b4e5b9dbf636ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:41:54.557310 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-7dc43074-7069-4403-8aa6-1dc00233ecbd tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] 10.222.0.46 "GET /compute/v2.1/servers/092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0" status: 200 len: 1359 microversion: 2.1 time: 0.157445 Jan 15 21:41:54.557904 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3955/7924] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:41:54 2022] GET /compute/v2.1/servers/092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0 => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:41:55.575045 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0892e1bd-57f1-4610-956f-53c1aaaac32a tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:41:55.575738 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-0892e1bd-57f1-4610-956f-53c1aaaac32a tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] [instance: 092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:41:55.582835 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0892e1bd-57f1-4610-956f-53c1aaaac32a tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:41:55.583286 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0892e1bd-57f1-4610-956f-53c1aaaac32a tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:41:55.584065 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0892e1bd-57f1-4610-956f-53c1aaaac32a tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:41:55.584512 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0892e1bd-57f1-4610-956f-53c1aaaac32a tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:41:55.713241 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-0892e1bd-57f1-4610-956f-53c1aaaac32a tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82df3698420f49d495b7563b477680b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3e3591eb6a485591b4e5b9dbf636ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:41:55.721340 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0892e1bd-57f1-4610-956f-53c1aaaac32a tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] 10.222.0.46 "GET /compute/v2.1/servers/092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0" status: 200 len: 1547 microversion: 2.1 time: 0.150352 Jan 15 21:41:55.721928 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3970/7925] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:41:55 2022] GET /compute/v2.1/servers/092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0 => generated 1547 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:41:55.737215 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9d0464ed-47ba-409d-8464-aa1f49039282 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:41:55.737950 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-9d0464ed-47ba-409d-8464-aa1f49039282 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] [instance: 092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:41:55.745181 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9d0464ed-47ba-409d-8464-aa1f49039282 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:41:55.745644 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9d0464ed-47ba-409d-8464-aa1f49039282 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:41:55.746424 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9d0464ed-47ba-409d-8464-aa1f49039282 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:41:55.746875 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9d0464ed-47ba-409d-8464-aa1f49039282 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:41:55.877436 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-9d0464ed-47ba-409d-8464-aa1f49039282 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82df3698420f49d495b7563b477680b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3e3591eb6a485591b4e5b9dbf636ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:41:55.884802 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-9d0464ed-47ba-409d-8464-aa1f49039282 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] 10.222.0.46 "GET /compute/v2.1/servers/092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0" status: 200 len: 1547 microversion: 2.1 time: 0.151323 Jan 15 21:41:55.885403 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3956/7926] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:41:55 2022] GET /compute/v2.1/servers/092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0 => generated 1547 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:41:55.900648 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-28f422e7-6732-45a8-91a3-864aeb116c86 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:41:55.904226 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:41:55.904226 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:41:55.905282 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-28f422e7-6732-45a8-91a3-864aeb116c86 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '82df3698420f49d495b7563b477680b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3e3591eb6a485591b4e5b9dbf636ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:41:55.906055 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-28f422e7-6732-45a8-91a3-864aeb116c86 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Searching by: {'deleted': False, 'project_id': '7c3e3591eb6a485591b4e5b9dbf636ee'} {{(pid=129366) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 15 21:41:55.911401 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-28f422e7-6732-45a8-91a3-864aeb116c86 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:41:55.912150 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-28f422e7-6732-45a8-91a3-864aeb116c86 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:41:55.913494 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-28f422e7-6732-45a8-91a3-864aeb116c86 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:41:55.914021 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-28f422e7-6732-45a8-91a3-864aeb116c86 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:41:55.938538 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.multi_cell_list [None req-28f422e7-6732-45a8-91a3-864aeb116c86 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=129366) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jan 15 21:41:55.964433 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-28f422e7-6732-45a8-91a3-864aeb116c86 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] 10.222.0.46 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.067791 Jan 15 21:41:55.965679 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3971/7927] 10.222.0.46 () {58 vars in 1124 bytes} [Sat Jan 15 21:41:55 2022] GET /compute/v2.1/servers => generated 343 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:41:55.976340 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-278d7e39-241c-43b9-be06-171d67d1ef4b tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:41:55.977042 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-278d7e39-241c-43b9-be06-171d67d1ef4b tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] [instance: 092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:41:55.983114 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-278d7e39-241c-43b9-be06-171d67d1ef4b tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:41:55.983586 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-278d7e39-241c-43b9-be06-171d67d1ef4b tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:41:55.984387 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-278d7e39-241c-43b9-be06-171d67d1ef4b tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:41:55.984861 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-278d7e39-241c-43b9-be06-171d67d1ef4b tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:41:56.119250 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-278d7e39-241c-43b9-be06-171d67d1ef4b tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82df3698420f49d495b7563b477680b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3e3591eb6a485591b4e5b9dbf636ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:41:56.126725 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-278d7e39-241c-43b9-be06-171d67d1ef4b tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] 10.222.0.46 "GET /compute/v2.1/servers/092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0" status: 200 len: 1547 microversion: 2.1 time: 0.154781 Jan 15 21:41:56.127297 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3957/7928] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:41:55 2022] GET /compute/v2.1/servers/092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0 => generated 1547 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:41:57.617972 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b9f7979a-e308-4952-bd0c-b160a6950601 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "468f2646-1daf-493d-a48e-0a5e36e57a61"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:41:57.619031 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b9f7979a-e308-4952-bd0c-b160a6950601 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] [instance: 092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:41:57.625732 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b9f7979a-e308-4952-bd0c-b160a6950601 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:41:57.626166 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b9f7979a-e308-4952-bd0c-b160a6950601 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:41:57.626941 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b9f7979a-e308-4952-bd0c-b160a6950601 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:41:57.627376 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b9f7979a-e308-4952-bd0c-b160a6950601 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:41:57.856451 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b9f7979a-e308-4952-bd0c-b160a6950601 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] 10.222.0.46 "POST /compute/v2.1/servers/092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.242240 Jan 15 21:41:57.857103 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3972/7929] 10.222.0.46 () {60 vars in 1322 bytes} [Sat Jan 15 21:41:57 2022] POST /compute/v2.1/servers/092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0/os-volume_attachments => generated 194 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:42:00.134381 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ca556a5e-fe0c-4f9b-9e43-5d8d48cbacf6 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:42:00.135000 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ca556a5e-fe0c-4f9b-9e43-5d8d48cbacf6 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] [instance: 092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:42:00.141784 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ca556a5e-fe0c-4f9b-9e43-5d8d48cbacf6 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:42:00.142244 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ca556a5e-fe0c-4f9b-9e43-5d8d48cbacf6 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:42:00.143029 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ca556a5e-fe0c-4f9b-9e43-5d8d48cbacf6 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:42:00.143481 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ca556a5e-fe0c-4f9b-9e43-5d8d48cbacf6 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:42:00.272647 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-ca556a5e-fe0c-4f9b-9e43-5d8d48cbacf6 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82df3698420f49d495b7563b477680b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3e3591eb6a485591b4e5b9dbf636ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:42:00.280710 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ca556a5e-fe0c-4f9b-9e43-5d8d48cbacf6 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] 10.222.0.46 "GET /compute/v2.1/servers/092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0" status: 200 len: 1593 microversion: 2.1 time: 0.150083 Jan 15 21:42:00.281331 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3958/7930] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:42:00 2022] GET /compute/v2.1/servers/092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0 => generated 1593 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:42:01.980540 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-4c0a3e90-4b06-4a78-b8e5-c3c536ee582f req-45c23cd1-73b9-4899-951b-d01d10501a0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0", "tag": "021182f9-1b1a-4c52-a3cc-64346bd7c5cb"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:42:01.982789 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:42:01.982789 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:42:01.991127 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-4c0a3e90-4b06-4a78-b8e5-c3c536ee582f req-45c23cd1-73b9-4899-951b-d01d10501a0e service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:42:01.991568 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-4c0a3e90-4b06-4a78-b8e5-c3c536ee582f req-45c23cd1-73b9-4899-951b-d01d10501a0e service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:42:02.003977 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-4c0a3e90-4b06-4a78-b8e5-c3c536ee582f req-45c23cd1-73b9-4899-951b-d01d10501a0e service nova] Creating event network-changed:021182f9-1b1a-4c52-a3cc-64346bd7c5cb for instance 092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0 on nch2-master-1 Jan 15 21:42:02.009773 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-4c0a3e90-4b06-4a78-b8e5-c3c536ee582f req-45c23cd1-73b9-4899-951b-d01d10501a0e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033267 Jan 15 21:42:02.010624 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3973/7931] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:42:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:42:03.082844 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c1c81a91-2012-4427-a437-372494dbf272 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-338849122"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:42:03.083550 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c1c81a91-2012-4427-a437-372494dbf272 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] [instance: 092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:42:03.090588 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c1c81a91-2012-4427-a437-372494dbf272 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:42:03.091176 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c1c81a91-2012-4427-a437-372494dbf272 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:42:03.092088 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c1c81a91-2012-4427-a437-372494dbf272 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:42:03.092611 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c1c81a91-2012-4427-a437-372494dbf272 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:42:03.237924 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.network.security_group_api [None req-c1c81a91-2012-4427-a437-372494dbf272 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Adding security group cb26bc60-6b4a-4f66-9990-212b5a56ad18 to port 021182f9-1b1a-4c52-a3cc-64346bd7c5cb Jan 15 21:42:03.626222 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c1c81a91-2012-4427-a437-372494dbf272 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] 10.222.0.46 "POST /compute/v2.1/servers/092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0/action" status: 202 len: 0 microversion: 2.1 time: 0.547557 Jan 15 21:42:03.627396 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3959/7932] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:42:03 2022] POST /compute/v2.1/servers/092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0/action => generated 0 bytes in 549 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:42:03.639250 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7c4265ce-e0a1-475f-94e4-cd3cf7f2a41a tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:42:03.639250 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-7c4265ce-e0a1-475f-94e4-cd3cf7f2a41a tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] [instance: 092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:42:03.646413 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7c4265ce-e0a1-475f-94e4-cd3cf7f2a41a tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:42:03.647585 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7c4265ce-e0a1-475f-94e4-cd3cf7f2a41a tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:42:03.648669 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7c4265ce-e0a1-475f-94e4-cd3cf7f2a41a tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:42:03.649217 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7c4265ce-e0a1-475f-94e4-cd3cf7f2a41a tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:42:03.649376 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-1a7eb4eb-d798-4d46-8302-0858e0347422 req-0106ae99-974d-4336-a8a1-fec29f6575f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0", "tag": "021182f9-1b1a-4c52-a3cc-64346bd7c5cb"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:42:03.651567 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:42:03.651567 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:42:03.671027 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-1a7eb4eb-d798-4d46-8302-0858e0347422 req-0106ae99-974d-4336-a8a1-fec29f6575f4 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:42:03.671544 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-1a7eb4eb-d798-4d46-8302-0858e0347422 req-0106ae99-974d-4336-a8a1-fec29f6575f4 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:42:03.699412 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-1a7eb4eb-d798-4d46-8302-0858e0347422 req-0106ae99-974d-4336-a8a1-fec29f6575f4 service nova] Creating event network-changed:021182f9-1b1a-4c52-a3cc-64346bd7c5cb for instance 092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0 on nch2-master-1 Jan 15 21:42:03.705082 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-1a7eb4eb-d798-4d46-8302-0858e0347422 req-0106ae99-974d-4336-a8a1-fec29f6575f4 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060830 Jan 15 21:42:03.706016 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3960/7933] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:42:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:42:03.848989 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-7c4265ce-e0a1-475f-94e4-cd3cf7f2a41a tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82df3698420f49d495b7563b477680b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3e3591eb6a485591b4e5b9dbf636ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:42:03.857676 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7c4265ce-e0a1-475f-94e4-cd3cf7f2a41a tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] 10.222.0.46 "GET /compute/v2.1/servers/092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0" status: 200 len: 1758 microversion: 2.1 time: 0.226172 Jan 15 21:42:03.858269 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3974/7934] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:42:03 2022] GET /compute/v2.1/servers/092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0 => generated 1758 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:42:29.478879 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-37ce83da-ffc3-4c5a-b3e9-c4641740ccba tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:42:29.479906 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-37ce83da-ffc3-4c5a-b3e9-c4641740ccba tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] [instance: 092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:42:29.486137 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-37ce83da-ffc3-4c5a-b3e9-c4641740ccba tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:42:29.486596 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-37ce83da-ffc3-4c5a-b3e9-c4641740ccba tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:42:29.487384 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-37ce83da-ffc3-4c5a-b3e9-c4641740ccba tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:42:29.487832 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-37ce83da-ffc3-4c5a-b3e9-c4641740ccba tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:42:29.560499 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-37ce83da-ffc3-4c5a-b3e9-c4641740ccba tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] 10.222.0.46 "POST /compute/v2.1/servers/092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0/action" status: 202 len: 0 microversion: 2.1 time: 0.086491 Jan 15 21:42:29.561443 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3961/7935] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:42:29 2022] POST /compute/v2.1/servers/092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:42:29.570857 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-782dc5d3-c634-4d03-8adb-5a469f5d9850 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:42:29.571452 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-782dc5d3-c634-4d03-8adb-5a469f5d9850 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] [instance: 092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:42:29.580193 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-782dc5d3-c634-4d03-8adb-5a469f5d9850 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:42:29.581388 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-782dc5d3-c634-4d03-8adb-5a469f5d9850 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:42:29.582204 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-782dc5d3-c634-4d03-8adb-5a469f5d9850 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:42:29.583019 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-782dc5d3-c634-4d03-8adb-5a469f5d9850 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:42:29.730196 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-782dc5d3-c634-4d03-8adb-5a469f5d9850 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82df3698420f49d495b7563b477680b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3e3591eb6a485591b4e5b9dbf636ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:42:29.738518 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-782dc5d3-c634-4d03-8adb-5a469f5d9850 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] 10.222.0.46 "GET /compute/v2.1/servers/092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0" status: 200 len: 1750 microversion: 2.1 time: 0.172444 Jan 15 21:42:29.739417 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3975/7936] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:42:29 2022] GET /compute/v2.1/servers/092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0 => generated 1750 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:42:30.758053 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-20fea0f6-d829-4b91-b1ff-302774c58eed tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:42:30.758776 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-20fea0f6-d829-4b91-b1ff-302774c58eed tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] [instance: 092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:42:30.765850 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-20fea0f6-d829-4b91-b1ff-302774c58eed tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:42:30.766326 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-20fea0f6-d829-4b91-b1ff-302774c58eed tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:42:30.767123 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-20fea0f6-d829-4b91-b1ff-302774c58eed tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:42:30.767576 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-20fea0f6-d829-4b91-b1ff-302774c58eed tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:42:30.916061 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-20fea0f6-d829-4b91-b1ff-302774c58eed tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82df3698420f49d495b7563b477680b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3e3591eb6a485591b4e5b9dbf636ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:42:30.924063 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-20fea0f6-d829-4b91-b1ff-302774c58eed tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] 10.222.0.46 "GET /compute/v2.1/servers/092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0" status: 200 len: 1755 microversion: 2.1 time: 0.170930 Jan 15 21:42:30.924643 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3962/7937] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:42:30 2022] GET /compute/v2.1/servers/092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0 => generated 1755 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:42:31.941441 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-6e226e29-4a27-4145-9109-fbaf8aedc420 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:42:31.942034 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-6e226e29-4a27-4145-9109-fbaf8aedc420 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] [instance: 092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:42:31.949432 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6e226e29-4a27-4145-9109-fbaf8aedc420 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:42:31.949885 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6e226e29-4a27-4145-9109-fbaf8aedc420 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:42:31.950658 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6e226e29-4a27-4145-9109-fbaf8aedc420 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:42:31.951095 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6e226e29-4a27-4145-9109-fbaf8aedc420 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:42:32.094177 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-6e226e29-4a27-4145-9109-fbaf8aedc420 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82df3698420f49d495b7563b477680b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3e3591eb6a485591b4e5b9dbf636ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:42:32.102394 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-6e226e29-4a27-4145-9109-fbaf8aedc420 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] 10.222.0.46 "GET /compute/v2.1/servers/092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0" status: 200 len: 1755 microversion: 2.1 time: 0.164667 Jan 15 21:42:32.102982 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3976/7938] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:42:31 2022] GET /compute/v2.1/servers/092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0 => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:42:33.120040 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a1a82348-bb1b-43f7-b979-a354b6bd03a7 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:42:33.120683 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a1a82348-bb1b-43f7-b979-a354b6bd03a7 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] [instance: 092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:42:33.127625 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a1a82348-bb1b-43f7-b979-a354b6bd03a7 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:42:33.128091 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a1a82348-bb1b-43f7-b979-a354b6bd03a7 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:42:33.128916 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a1a82348-bb1b-43f7-b979-a354b6bd03a7 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:42:33.129374 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a1a82348-bb1b-43f7-b979-a354b6bd03a7 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:42:33.272675 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-a1a82348-bb1b-43f7-b979-a354b6bd03a7 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82df3698420f49d495b7563b477680b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3e3591eb6a485591b4e5b9dbf636ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:42:33.280703 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a1a82348-bb1b-43f7-b979-a354b6bd03a7 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] 10.222.0.46 "GET /compute/v2.1/servers/092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0" status: 200 len: 1755 microversion: 2.1 time: 0.164414 Jan 15 21:42:33.281309 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3963/7939] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:42:33 2022] GET /compute/v2.1/servers/092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0 => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:42:34.297819 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e40cbdab-f33a-47b6-8e8a-f8ee9f90e07b tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:42:34.298417 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e40cbdab-f33a-47b6-8e8a-f8ee9f90e07b tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] [instance: 092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:42:34.306027 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e40cbdab-f33a-47b6-8e8a-f8ee9f90e07b tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:42:34.306486 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e40cbdab-f33a-47b6-8e8a-f8ee9f90e07b tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:42:34.307277 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e40cbdab-f33a-47b6-8e8a-f8ee9f90e07b tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:42:34.307716 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e40cbdab-f33a-47b6-8e8a-f8ee9f90e07b tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:42:34.451915 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-e40cbdab-f33a-47b6-8e8a-f8ee9f90e07b tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82df3698420f49d495b7563b477680b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3e3591eb6a485591b4e5b9dbf636ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:42:34.460613 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e40cbdab-f33a-47b6-8e8a-f8ee9f90e07b tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] 10.222.0.46 "GET /compute/v2.1/servers/092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0" status: 200 len: 1755 microversion: 2.1 time: 0.166536 Jan 15 21:42:34.461218 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3977/7940] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:42:34 2022] GET /compute/v2.1/servers/092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0 => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:42:35.477686 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-0b94a10a-75d2-4090-8564-d3c7dd2db5b8 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:42:35.478310 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-0b94a10a-75d2-4090-8564-d3c7dd2db5b8 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] [instance: 092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:42:35.485167 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0b94a10a-75d2-4090-8564-d3c7dd2db5b8 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:42:35.485629 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0b94a10a-75d2-4090-8564-d3c7dd2db5b8 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:42:35.486441 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0b94a10a-75d2-4090-8564-d3c7dd2db5b8 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:42:35.486888 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0b94a10a-75d2-4090-8564-d3c7dd2db5b8 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:42:35.628532 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-0b94a10a-75d2-4090-8564-d3c7dd2db5b8 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82df3698420f49d495b7563b477680b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3e3591eb6a485591b4e5b9dbf636ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:42:35.637088 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-0b94a10a-75d2-4090-8564-d3c7dd2db5b8 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] 10.222.0.46 "GET /compute/v2.1/servers/092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0" status: 200 len: 1755 microversion: 2.1 time: 0.163145 Jan 15 21:42:35.637674 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3964/7941] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:42:35 2022] GET /compute/v2.1/servers/092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0 => generated 1755 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:42:36.653323 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-fbfc8ce5-8206-4f61-b502-df465b1fda92 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:42:36.653941 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-fbfc8ce5-8206-4f61-b502-df465b1fda92 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] [instance: 092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:42:36.660762 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fbfc8ce5-8206-4f61-b502-df465b1fda92 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:42:36.661289 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fbfc8ce5-8206-4f61-b502-df465b1fda92 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:42:36.662782 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fbfc8ce5-8206-4f61-b502-df465b1fda92 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:42:36.663224 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fbfc8ce5-8206-4f61-b502-df465b1fda92 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:42:36.810285 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-fbfc8ce5-8206-4f61-b502-df465b1fda92 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82df3698420f49d495b7563b477680b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3e3591eb6a485591b4e5b9dbf636ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:42:36.818948 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-fbfc8ce5-8206-4f61-b502-df465b1fda92 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] 10.222.0.46 "GET /compute/v2.1/servers/092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0" status: 200 len: 1755 microversion: 2.1 time: 0.169319 Jan 15 21:42:36.819476 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3978/7942] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:42:36 2022] GET /compute/v2.1/servers/092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0 => generated 1755 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:42:37.836703 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-144a8825-3884-4c13-9769-854236717c2c tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:42:37.837374 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-144a8825-3884-4c13-9769-854236717c2c tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] [instance: 092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:42:37.844248 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-144a8825-3884-4c13-9769-854236717c2c tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:42:37.844721 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-144a8825-3884-4c13-9769-854236717c2c tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:42:37.845544 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-144a8825-3884-4c13-9769-854236717c2c tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:42:37.846003 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-144a8825-3884-4c13-9769-854236717c2c tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:42:37.989163 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-144a8825-3884-4c13-9769-854236717c2c tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82df3698420f49d495b7563b477680b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3e3591eb6a485591b4e5b9dbf636ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:42:37.997327 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-144a8825-3884-4c13-9769-854236717c2c tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] 10.222.0.46 "GET /compute/v2.1/servers/092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0" status: 200 len: 1755 microversion: 2.1 time: 0.164445 Jan 15 21:42:37.997898 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3965/7943] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:42:37 2022] GET /compute/v2.1/servers/092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0 => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:42:39.014539 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-254380fc-ad84-4469-9c68-caa3bfca4300 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:42:39.015139 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-254380fc-ad84-4469-9c68-caa3bfca4300 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] [instance: 092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:42:39.022506 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-254380fc-ad84-4469-9c68-caa3bfca4300 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:42:39.022943 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-254380fc-ad84-4469-9c68-caa3bfca4300 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:42:39.023715 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-254380fc-ad84-4469-9c68-caa3bfca4300 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:42:39.024149 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-254380fc-ad84-4469-9c68-caa3bfca4300 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:42:39.169064 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-254380fc-ad84-4469-9c68-caa3bfca4300 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82df3698420f49d495b7563b477680b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3e3591eb6a485591b4e5b9dbf636ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:42:39.176908 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-254380fc-ad84-4469-9c68-caa3bfca4300 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] 10.222.0.46 "GET /compute/v2.1/servers/092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0" status: 200 len: 1755 microversion: 2.1 time: 0.166121 Jan 15 21:42:39.177850 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3979/7944] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:42:39 2022] GET /compute/v2.1/servers/092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0 => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:42:40.194514 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-818549c8-f7ea-4003-a954-0d1557635e5c tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:42:40.195127 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-818549c8-f7ea-4003-a954-0d1557635e5c tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] [instance: 092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:42:40.202045 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-818549c8-f7ea-4003-a954-0d1557635e5c tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:42:40.202513 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-818549c8-f7ea-4003-a954-0d1557635e5c tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:42:40.203312 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-818549c8-f7ea-4003-a954-0d1557635e5c tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:42:40.203767 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-818549c8-f7ea-4003-a954-0d1557635e5c tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:42:40.346211 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-818549c8-f7ea-4003-a954-0d1557635e5c tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82df3698420f49d495b7563b477680b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3e3591eb6a485591b4e5b9dbf636ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:42:40.355785 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-818549c8-f7ea-4003-a954-0d1557635e5c tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] 10.222.0.46 "GET /compute/v2.1/servers/092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0" status: 200 len: 1755 microversion: 2.1 time: 0.164953 Jan 15 21:42:40.356386 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3966/7945] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:42:40 2022] GET /compute/v2.1/servers/092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0 => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:42:41.372758 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-be5c0cc2-b455-4274-a579-5d7b7b978f8e tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:42:41.373921 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-be5c0cc2-b455-4274-a579-5d7b7b978f8e tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] [instance: 092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:42:41.380333 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-be5c0cc2-b455-4274-a579-5d7b7b978f8e tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:42:41.380648 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-be5c0cc2-b455-4274-a579-5d7b7b978f8e tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:42:41.381472 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-be5c0cc2-b455-4274-a579-5d7b7b978f8e tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:42:41.381901 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-be5c0cc2-b455-4274-a579-5d7b7b978f8e tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:42:41.527094 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-be5c0cc2-b455-4274-a579-5d7b7b978f8e tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82df3698420f49d495b7563b477680b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3e3591eb6a485591b4e5b9dbf636ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:42:41.535051 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-be5c0cc2-b455-4274-a579-5d7b7b978f8e tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] 10.222.0.46 "GET /compute/v2.1/servers/092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0" status: 200 len: 1758 microversion: 2.1 time: 0.166095 Jan 15 21:42:41.535628 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3980/7946] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:42:41 2022] GET /compute/v2.1/servers/092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0 => generated 1758 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:43:13.974971 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-27c767fc-5479-43bd-9ecd-276a3f16b29e tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-338849122"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:43:13.975590 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-27c767fc-5479-43bd-9ecd-276a3f16b29e tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] [instance: 092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:43:13.982596 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-27c767fc-5479-43bd-9ecd-276a3f16b29e tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:43:13.983061 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-27c767fc-5479-43bd-9ecd-276a3f16b29e tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:43:13.983855 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-27c767fc-5479-43bd-9ecd-276a3f16b29e tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:43:13.984300 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-27c767fc-5479-43bd-9ecd-276a3f16b29e tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:43:14.118403 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.network.security_group_api [None req-27c767fc-5479-43bd-9ecd-276a3f16b29e tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Removing security group cb26bc60-6b4a-4f66-9990-212b5a56ad18 from port 021182f9-1b1a-4c52-a3cc-64346bd7c5cb Jan 15 21:43:14.452870 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-27c767fc-5479-43bd-9ecd-276a3f16b29e tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] 10.222.0.46 "POST /compute/v2.1/servers/092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0/action" status: 202 len: 0 microversion: 2.1 time: 0.481862 Jan 15 21:43:14.457444 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3967/7947] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:43:13 2022] POST /compute/v2.1/servers/092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0/action => generated 0 bytes in 484 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:43:14.618942 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-dcdbf8a0-5172-4156-9699-99a5f7829644 req-37e90880-d01a-456e-82a2-89ce99bca634 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0", "tag": "021182f9-1b1a-4c52-a3cc-64346bd7c5cb"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:43:14.620480 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:43:14.620480 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:43:14.631149 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-dcdbf8a0-5172-4156-9699-99a5f7829644 req-37e90880-d01a-456e-82a2-89ce99bca634 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:43:14.631599 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-dcdbf8a0-5172-4156-9699-99a5f7829644 req-37e90880-d01a-456e-82a2-89ce99bca634 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:43:14.651420 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-dcdbf8a0-5172-4156-9699-99a5f7829644 req-37e90880-d01a-456e-82a2-89ce99bca634 service nova] Creating event network-changed:021182f9-1b1a-4c52-a3cc-64346bd7c5cb for instance 092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0 on nch2-master-1 Jan 15 21:43:14.657998 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-dcdbf8a0-5172-4156-9699-99a5f7829644 req-37e90880-d01a-456e-82a2-89ce99bca634 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.201561 Jan 15 21:43:14.658623 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3981/7948] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:43:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 21:43:15.933160 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-daf3205d-6bce-4448-8410-f179e4e81f33 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:43:15.933879 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-daf3205d-6bce-4448-8410-f179e4e81f33 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] [instance: 092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:43:15.940526 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-daf3205d-6bce-4448-8410-f179e4e81f33 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:43:15.941021 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-daf3205d-6bce-4448-8410-f179e4e81f33 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:43:15.941990 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-daf3205d-6bce-4448-8410-f179e4e81f33 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:43:15.942444 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-daf3205d-6bce-4448-8410-f179e4e81f33 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:43:16.003215 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-f6ffcfbc-a093-434b-abed-f1e0e0a495f4 req-2eb903fa-44b2-4277-ad77-cbbd82083eeb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0", "tag": "021182f9-1b1a-4c52-a3cc-64346bd7c5cb"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:43:16.005625 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:43:16.005625 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:43:16.016587 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-f6ffcfbc-a093-434b-abed-f1e0e0a495f4 req-2eb903fa-44b2-4277-ad77-cbbd82083eeb service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:43:16.017188 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-f6ffcfbc-a093-434b-abed-f1e0e0a495f4 req-2eb903fa-44b2-4277-ad77-cbbd82083eeb service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:43:16.030364 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.objects.instance [None req-daf3205d-6bce-4448-8410-f179e4e81f33 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lazy-loading 'services' on Instance uuid 092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0 {{(pid=129365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 21:43:16.031481 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-f6ffcfbc-a093-434b-abed-f1e0e0a495f4 req-2eb903fa-44b2-4277-ad77-cbbd82083eeb service nova] Creating event network-changed:021182f9-1b1a-4c52-a3cc-64346bd7c5cb for instance 092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0 on nch2-master-1 Jan 15 21:43:16.036526 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-f6ffcfbc-a093-434b-abed-f1e0e0a495f4 req-2eb903fa-44b2-4277-ad77-cbbd82083eeb service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107318 Jan 15 21:43:16.037562 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3982/7949] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:43:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:43:16.109137 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-daf3205d-6bce-4448-8410-f179e4e81f33 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] 10.222.0.46 "DELETE /compute/v2.1/servers/092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0/os-volume_attachments/468f2646-1daf-493d-a48e-0a5e36e57a61" status: 202 len: 0 microversion: 2.1 time: 0.181458 Jan 15 21:43:16.109758 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3968/7950] 10.222.0.46 () {58 vars in 1415 bytes} [Sat Jan 15 21:43:15 2022] DELETE /compute/v2.1/servers/092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0/os-volume_attachments/468f2646-1daf-493d-a48e-0a5e36e57a61 => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:43:16.120079 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d1ae4949-5ecd-4f9b-95a8-30acc398af8c tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:43:16.121657 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-d1ae4949-5ecd-4f9b-95a8-30acc398af8c tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] [instance: 092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:43:16.130053 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d1ae4949-5ecd-4f9b-95a8-30acc398af8c tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:43:16.130917 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d1ae4949-5ecd-4f9b-95a8-30acc398af8c tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:43:16.132084 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d1ae4949-5ecd-4f9b-95a8-30acc398af8c tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:43:16.132794 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d1ae4949-5ecd-4f9b-95a8-30acc398af8c tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:43:16.170253 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d1ae4949-5ecd-4f9b-95a8-30acc398af8c tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] 10.222.0.46 "GET /compute/v2.1/servers/092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055482 Jan 15 21:43:16.171272 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3983/7951] 10.222.0.46 () {58 vars in 1301 bytes} [Sat Jan 15 21:43:16 2022] GET /compute/v2.1/servers/092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:43:17.183517 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-93d408de-0f4c-4475-89d6-4623ad5a08fe tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:43:17.184600 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-93d408de-0f4c-4475-89d6-4623ad5a08fe tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] [instance: 092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:43:17.191650 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-93d408de-0f4c-4475-89d6-4623ad5a08fe tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:43:17.192115 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-93d408de-0f4c-4475-89d6-4623ad5a08fe tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:43:17.192940 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-93d408de-0f4c-4475-89d6-4623ad5a08fe tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:43:17.193388 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-93d408de-0f4c-4475-89d6-4623ad5a08fe tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:43:17.221960 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-93d408de-0f4c-4475-89d6-4623ad5a08fe tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] 10.222.0.46 "GET /compute/v2.1/servers/092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043610 Jan 15 21:43:17.222514 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3969/7952] 10.222.0.46 () {58 vars in 1301 bytes} [Sat Jan 15 21:43:17 2022] GET /compute/v2.1/servers/092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 15 21:43:17.232797 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f9f8e07c-f582-4f2b-80f7-8ab20800a3c8 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:43:17.233333 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f9f8e07c-f582-4f2b-80f7-8ab20800a3c8 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] [instance: 092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:43:17.239942 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f9f8e07c-f582-4f2b-80f7-8ab20800a3c8 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:43:17.240385 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f9f8e07c-f582-4f2b-80f7-8ab20800a3c8 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:43:17.241171 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f9f8e07c-f582-4f2b-80f7-8ab20800a3c8 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:43:17.241598 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f9f8e07c-f582-4f2b-80f7-8ab20800a3c8 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:43:17.314026 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-f9f8e07c-f582-4f2b-80f7-8ab20800a3c8 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] HTTP exception thrown: Instance 092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0 is not attached to volume 468f2646-1daf-493d-a48e-0a5e36e57a61 Jan 15 21:43:17.314620 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f9f8e07c-f582-4f2b-80f7-8ab20800a3c8 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Returning 404 to user: Instance 092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0 is not attached to volume 468f2646-1daf-493d-a48e-0a5e36e57a61 {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:43:17.315453 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f9f8e07c-f582-4f2b-80f7-8ab20800a3c8 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] 10.222.0.46 "DELETE /compute/v2.1/servers/092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0/os-volume_attachments/468f2646-1daf-493d-a48e-0a5e36e57a61" status: 404 len: 154 microversion: 2.1 time: 0.086537 Jan 15 21:43:17.316005 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3984/7953] 10.222.0.46 () {58 vars in 1415 bytes} [Sat Jan 15 21:43:17 2022] DELETE /compute/v2.1/servers/092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0/os-volume_attachments/468f2646-1daf-493d-a48e-0a5e36e57a61 => generated 154 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:43:18.447267 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-0ce749d8-3e2a-459d-931c-79c6110abd7e tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:43:18.447776 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-0ce749d8-3e2a-459d-931c-79c6110abd7e tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] [instance: 092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:43:18.454650 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0ce749d8-3e2a-459d-931c-79c6110abd7e tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:43:18.455114 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0ce749d8-3e2a-459d-931c-79c6110abd7e tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:43:18.455899 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0ce749d8-3e2a-459d-931c-79c6110abd7e tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:43:18.456341 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0ce749d8-3e2a-459d-931c-79c6110abd7e tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:43:18.481960 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-0ce749d8-3e2a-459d-931c-79c6110abd7e tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] [instance: 092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0] Going to try to terminate instance {{(pid=129365) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 21:43:18.556305 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-0ce749d8-3e2a-459d-931c-79c6110abd7e tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] 10.222.0.46 "DELETE /compute/v2.1/servers/092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0" status: 204 len: 0 microversion: 2.1 time: 0.111840 Jan 15 21:43:18.557135 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3970/7954] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 21:43:18 2022] DELETE /compute/v2.1/servers/092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 21:43:18.565375 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-98dd4e3d-a67b-48bd-9f7e-f595e850c5cc tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:43:18.566709 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-98dd4e3d-a67b-48bd-9f7e-f595e850c5cc tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] [instance: 092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:43:18.574514 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-98dd4e3d-a67b-48bd-9f7e-f595e850c5cc tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:43:18.574960 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-98dd4e3d-a67b-48bd-9f7e-f595e850c5cc tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:43:18.575742 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-98dd4e3d-a67b-48bd-9f7e-f595e850c5cc tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:43:18.576182 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-98dd4e3d-a67b-48bd-9f7e-f595e850c5cc tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:43:18.714790 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-98dd4e3d-a67b-48bd-9f7e-f595e850c5cc tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82df3698420f49d495b7563b477680b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3e3591eb6a485591b4e5b9dbf636ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:43:18.722298 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-98dd4e3d-a67b-48bd-9f7e-f595e850c5cc tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] 10.222.0.46 "GET /compute/v2.1/servers/092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0" status: 200 len: 1553 microversion: 2.1 time: 0.161144 Jan 15 21:43:18.722874 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3985/7955] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:43:18 2022] GET /compute/v2.1/servers/092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0 => generated 1553 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:43:19.742035 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-624b4208-dba7-46b1-bf3c-cea721db3fa7 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:43:19.743368 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-624b4208-dba7-46b1-bf3c-cea721db3fa7 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] [instance: 092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:43:19.750237 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-624b4208-dba7-46b1-bf3c-cea721db3fa7 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:43:19.750709 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-624b4208-dba7-46b1-bf3c-cea721db3fa7 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:43:19.751506 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-624b4208-dba7-46b1-bf3c-cea721db3fa7 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:43:19.751960 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-624b4208-dba7-46b1-bf3c-cea721db3fa7 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:43:20.129659 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-624b4208-dba7-46b1-bf3c-cea721db3fa7 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82df3698420f49d495b7563b477680b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3e3591eb6a485591b4e5b9dbf636ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:43:20.137565 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-624b4208-dba7-46b1-bf3c-cea721db3fa7 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] 10.222.0.46 "GET /compute/v2.1/servers/092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0" status: 200 len: 1553 microversion: 2.1 time: 0.399702 Jan 15 21:43:20.138134 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3971/7956] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:43:19 2022] GET /compute/v2.1/servers/092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0 => generated 1553 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:43:20.931488 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-5b4d977d-cf83-4b05-932e-bcd418ea2855 req-b0a16ef9-b062-443d-922f-468bd5538e31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0", "name": "network-vif-deleted", "tag": "021182f9-1b1a-4c52-a3cc-64346bd7c5cb"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:43:20.933293 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:43:20.933293 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:43:20.944333 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-5b4d977d-cf83-4b05-932e-bcd418ea2855 req-b0a16ef9-b062-443d-922f-468bd5538e31 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:43:20.944793 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-5b4d977d-cf83-4b05-932e-bcd418ea2855 req-b0a16ef9-b062-443d-922f-468bd5538e31 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:43:20.957755 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-5b4d977d-cf83-4b05-932e-bcd418ea2855 req-b0a16ef9-b062-443d-922f-468bd5538e31 service nova] Creating event network-vif-deleted:021182f9-1b1a-4c52-a3cc-64346bd7c5cb for instance 092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0 on nch2-master-1 Jan 15 21:43:20.963827 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-5b4d977d-cf83-4b05-932e-bcd418ea2855 req-b0a16ef9-b062-443d-922f-468bd5538e31 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036126 Jan 15 21:43:20.964465 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3986/7957] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:43:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:43:21.154408 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-7a962aa5-7185-4306-8655-79ce2ffba1a7 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:43:21.155033 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-7a962aa5-7185-4306-8655-79ce2ffba1a7 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] [instance: 092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:43:21.162038 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7a962aa5-7185-4306-8655-79ce2ffba1a7 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:43:21.162498 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7a962aa5-7185-4306-8655-79ce2ffba1a7 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:43:21.163281 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7a962aa5-7185-4306-8655-79ce2ffba1a7 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:43:21.163726 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7a962aa5-7185-4306-8655-79ce2ffba1a7 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:43:21.195777 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7a962aa5-7185-4306-8655-79ce2ffba1a7 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:43:21.196161 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7a962aa5-7185-4306-8655-79ce2ffba1a7 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:43:21.196635 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.objects.instance [None req-7a962aa5-7185-4306-8655-79ce2ffba1a7 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lazy-loading 'fault' on Instance uuid 092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0 {{(pid=129365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 21:43:21.236104 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-7a962aa5-7185-4306-8655-79ce2ffba1a7 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82df3698420f49d495b7563b477680b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3e3591eb6a485591b4e5b9dbf636ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:43:21.244614 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-7a962aa5-7185-4306-8655-79ce2ffba1a7 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] 10.222.0.46 "GET /compute/v2.1/servers/092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0" status: 200 len: 1349 microversion: 2.1 time: 0.093822 Jan 15 21:43:21.245262 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3972/7958] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:43:21 2022] GET /compute/v2.1/servers/092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0 => generated 1349 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:43:22.263692 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-96bbe6c0-cf11-4dd8-b61b-70d842e35683 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:43:22.264506 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-96bbe6c0-cf11-4dd8-b61b-70d842e35683 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] [instance: 092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:43:22.270642 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-96bbe6c0-cf11-4dd8-b61b-70d842e35683 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:43:22.271106 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-96bbe6c0-cf11-4dd8-b61b-70d842e35683 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:43:22.271893 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-96bbe6c0-cf11-4dd8-b61b-70d842e35683 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:43:22.272335 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-96bbe6c0-cf11-4dd8-b61b-70d842e35683 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:43:22.285400 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-96bbe6c0-cf11-4dd8-b61b-70d842e35683 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] HTTP exception thrown: Instance 092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0 could not be found. Jan 15 21:43:22.285987 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-96bbe6c0-cf11-4dd8-b61b-70d842e35683 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Returning 404 to user: Instance 092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0 could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:43:22.287071 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-96bbe6c0-cf11-4dd8-b61b-70d842e35683 tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] 10.222.0.46 "GET /compute/v2.1/servers/092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0" status: 404 len: 111 microversion: 2.1 time: 0.028926 Jan 15 21:43:22.287609 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3987/7959] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:43:22 2022] GET /compute/v2.1/servers/092fe1aa-1ff7-4f74-87c4-e14e1df6b7a0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:43:22.295658 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2f1d7056-19e0-4cb0-b914-28d8b8c003da tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] Calling method '.version_select at 0x7f30c8508430>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:43:22.298977 ncdv-master-1 devstack@n-api.service[129365]: ERROR oslo.messaging._drivers.impl_rabbit [None req-2f1d7056-19e0-4cb0-b914-28d8b8c003da tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] [400b0649-1c0e-4ad9-a629-16a22f223001] AMQP server on 10.222.0.46:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 15 21:43:23.309712 ncdv-master-1 devstack@n-api.service[129365]: INFO oslo.messaging._drivers.impl_rabbit [None req-2f1d7056-19e0-4cb0-b914-28d8b8c003da tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] [400b0649-1c0e-4ad9-a629-16a22f223001] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 40282. Jan 15 21:43:23.329942 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2f1d7056-19e0-4cb0-b914-28d8b8c003da tempest-TestMinimumBasicScenario-659011030 tempest-TestMinimumBasicScenario-659011030-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2108988098" status: 202 len: 0 microversion: 2.1 time: 1.037837 Jan 15 21:43:23.330543 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3973/7960] 10.222.0.46 () {58 vars in 1271 bytes} [Sat Jan 15 21:43:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2108988098 => generated 0 bytes in 1039 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:43:31.042153 ncdv-master-1 devstack@n-api.service[129366]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 15 21:43:31.042662 ncdv-master-1 devstack@n-api.service[129366]: Sat Jan 15 21:43:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 15 21:43:32.612337 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-068245ba-0896-4789-8e74-609f2113bed1 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Action: 'create', calling method: .version_select at 0x7f30c85c2280>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1225295446"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:43:32.627537 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-068245ba-0896-4789-8e74-609f2113bed1 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Getting quotas for project 5f21548044704a2bbfc4ed1612c66fbc. Resources: {'key_pairs'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:43:32.632474 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-068245ba-0896-4789-8e74-609f2113bed1 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Getting quotas for user 9dd93f3b669e4901b2a805ce60ca057e and project 5f21548044704a2bbfc4ed1612c66fbc. Resources: {'key_pairs'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:43:32.798194 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-068245ba-0896-4789-8e74-609f2113bed1 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Getting quotas for project 5f21548044704a2bbfc4ed1612c66fbc. Resources: {'key_pairs'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:43:32.803427 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-068245ba-0896-4789-8e74-609f2113bed1 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Getting quotas for user 9dd93f3b669e4901b2a805ce60ca057e and project 5f21548044704a2bbfc4ed1612c66fbc. Resources: {'key_pairs'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:43:32.818055 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-068245ba-0896-4789-8e74-609f2113bed1 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 2322 microversion: 2.1 time: 0.365492 Jan 15 21:43:32.818658 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3988/7961] 10.222.0.46 () {60 vars in 1157 bytes} [Sat Jan 15 21:43:32 2022] POST /compute/v2.1/os-keypairs => generated 2322 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:43:38.541239 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-fc1aa44a-65cd-4d4c-9268-492a0b57b403 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-774392193", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "networks": [{"uuid": "0a6986c8-9a0a-4971-9315-fd8c941b4a08"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1225295446", "security_groups": [{"name": "tempest-secgroup-smoke-1249774727"}]}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:43:38.659923 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.network.neutron [None req-fc1aa44a-65cd-4d4c-9268-492a0b57b403 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] validate_networks() for [('0a6986c8-9a0a-4971-9315-fd8c941b4a08', None, None, None, None, None)] {{(pid=129365) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 21:43:39.130902 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-fc1aa44a-65cd-4d4c-9268-492a0b57b403 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Flavor limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 21:43:39.131351 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-fc1aa44a-65cd-4d4c-9268-492a0b57b403 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Image limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 21:43:39.131845 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-fc1aa44a-65cd-4d4c-9268-492a0b57b403 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Flavor pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 21:43:39.132299 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-fc1aa44a-65cd-4d4c-9268-492a0b57b403 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Image pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 21:43:39.133270 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-fc1aa44a-65cd-4d4c-9268-492a0b57b403 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 21:43:39.148407 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fc1aa44a-65cd-4d4c-9268-492a0b57b403 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:43:39.149183 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fc1aa44a-65cd-4d4c-9268-492a0b57b403 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:43:39.149878 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fc1aa44a-65cd-4d4c-9268-492a0b57b403 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:43:39.150342 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fc1aa44a-65cd-4d4c-9268-492a0b57b403 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:43:39.171702 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-fc1aa44a-65cd-4d4c-9268-492a0b57b403 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Getting quotas for project 5f21548044704a2bbfc4ed1612c66fbc. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:43:39.178323 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-fc1aa44a-65cd-4d4c-9268-492a0b57b403 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Getting quotas for user 9dd93f3b669e4901b2a805ce60ca057e and project 5f21548044704a2bbfc4ed1612c66fbc. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:43:39.193586 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-fc1aa44a-65cd-4d4c-9268-492a0b57b403 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Going to run 1 instances... {{(pid=129365) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 21:43:39.196926 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-fc1aa44a-65cd-4d4c-9268-492a0b57b403 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 5684f397-fdae-42f0-bcec-989ab9b20340] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129365) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 21:43:39.251144 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-fc1aa44a-65cd-4d4c-9268-492a0b57b403 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.715318 Jan 15 21:43:39.253046 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3974/7962] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 21:43:38 2022] POST /compute/v2.1/servers => generated 406 bytes in 717 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 21:43:39.263376 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-adabe156-d8ab-4832-b24c-85457ff4bba8 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:43:39.264407 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-adabe156-d8ab-4832-b24c-85457ff4bba8 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 5684f397-fdae-42f0-bcec-989ab9b20340] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:43:39.337146 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-adabe156-d8ab-4832-b24c-85457ff4bba8 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:43:39.345638 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-adabe156-d8ab-4832-b24c-85457ff4bba8 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/5684f397-fdae-42f0-bcec-989ab9b20340" status: 200 len: 1266 microversion: 2.1 time: 0.087031 Jan 15 21:43:39.347285 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3989/7963] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:43:39 2022] GET /compute/v2.1/servers/5684f397-fdae-42f0-bcec-989ab9b20340 => generated 1266 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:43:40.367013 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-388b8f2e-f71f-4f17-8255-137b043c7966 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:43:40.368567 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-388b8f2e-f71f-4f17-8255-137b043c7966 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 5684f397-fdae-42f0-bcec-989ab9b20340] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:43:40.436973 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-388b8f2e-f71f-4f17-8255-137b043c7966 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:43:40.447285 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-388b8f2e-f71f-4f17-8255-137b043c7966 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/5684f397-fdae-42f0-bcec-989ab9b20340" status: 200 len: 1266 microversion: 2.1 time: 0.087675 Jan 15 21:43:40.448818 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3975/7964] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:43:40 2022] GET /compute/v2.1/servers/5684f397-fdae-42f0-bcec-989ab9b20340 => generated 1266 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:43:41.465625 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c259e917-81cd-4255-9209-2b33191c6c2e tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:43:41.466330 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c259e917-81cd-4255-9209-2b33191c6c2e tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 5684f397-fdae-42f0-bcec-989ab9b20340] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:43:41.533676 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-c259e917-81cd-4255-9209-2b33191c6c2e tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:43:41.561290 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c259e917-81cd-4255-9209-2b33191c6c2e tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/5684f397-fdae-42f0-bcec-989ab9b20340" status: 200 len: 1266 microversion: 2.1 time: 0.088114 Jan 15 21:43:41.562001 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3990/7965] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:43:41 2022] GET /compute/v2.1/servers/5684f397-fdae-42f0-bcec-989ab9b20340 => generated 1266 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:43:42.578844 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2c7acb89-ea8c-45d4-bf2c-ffa5736be58f tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:43:42.579465 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-2c7acb89-ea8c-45d4-bf2c-ffa5736be58f tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 5684f397-fdae-42f0-bcec-989ab9b20340] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:43:42.630572 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-2c7acb89-ea8c-45d4-bf2c-ffa5736be58f tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:43:42.638343 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2c7acb89-ea8c-45d4-bf2c-ffa5736be58f tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/5684f397-fdae-42f0-bcec-989ab9b20340" status: 200 len: 1266 microversion: 2.1 time: 0.063207 Jan 15 21:43:42.638915 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3976/7966] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:43:42 2022] GET /compute/v2.1/servers/5684f397-fdae-42f0-bcec-989ab9b20340 => generated 1266 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:43:43.655429 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f2f22ac7-0220-4eba-84f8-6216ccde6e0d tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:43:43.656062 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f2f22ac7-0220-4eba-84f8-6216ccde6e0d tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 5684f397-fdae-42f0-bcec-989ab9b20340] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:43:43.663193 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f2f22ac7-0220-4eba-84f8-6216ccde6e0d tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:43:43.663638 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f2f22ac7-0220-4eba-84f8-6216ccde6e0d tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:43:43.664410 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f2f22ac7-0220-4eba-84f8-6216ccde6e0d tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:43:43.664859 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f2f22ac7-0220-4eba-84f8-6216ccde6e0d tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:43:43.726305 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-f2f22ac7-0220-4eba-84f8-6216ccde6e0d tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:43:43.734166 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f2f22ac7-0220-4eba-84f8-6216ccde6e0d tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/5684f397-fdae-42f0-bcec-989ab9b20340" status: 200 len: 1270 microversion: 2.1 time: 0.082555 Jan 15 21:43:43.734752 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3991/7967] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:43:43 2022] GET /compute/v2.1/servers/5684f397-fdae-42f0-bcec-989ab9b20340 => generated 1270 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:43:44.751384 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ed20fdfb-6ec9-4a92-af1f-3d6ebfcf6b89 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:43:44.752248 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ed20fdfb-6ec9-4a92-af1f-3d6ebfcf6b89 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 5684f397-fdae-42f0-bcec-989ab9b20340] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:43:44.760014 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ed20fdfb-6ec9-4a92-af1f-3d6ebfcf6b89 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:43:44.760564 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ed20fdfb-6ec9-4a92-af1f-3d6ebfcf6b89 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:43:44.761472 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ed20fdfb-6ec9-4a92-af1f-3d6ebfcf6b89 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:43:44.762023 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ed20fdfb-6ec9-4a92-af1f-3d6ebfcf6b89 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:43:44.826774 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-ed20fdfb-6ec9-4a92-af1f-3d6ebfcf6b89 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:43:44.834255 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ed20fdfb-6ec9-4a92-af1f-3d6ebfcf6b89 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/5684f397-fdae-42f0-bcec-989ab9b20340" status: 200 len: 1324 microversion: 2.1 time: 0.086652 Jan 15 21:43:44.834833 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3977/7968] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:43:44 2022] GET /compute/v2.1/servers/5684f397-fdae-42f0-bcec-989ab9b20340 => generated 1324 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:43:45.691522 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-d1d17635-7d73-4ac7-9aeb-e6f03cc21b46 req-be3cae91-1f5d-486b-8802-e2d388133fda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5684f397-fdae-42f0-bcec-989ab9b20340", "tag": "2c204f84-c862-41de-ae64-505b5a6c7154"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:43:45.696128 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:43:45.696128 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:43:45.708027 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-d1d17635-7d73-4ac7-9aeb-e6f03cc21b46 req-be3cae91-1f5d-486b-8802-e2d388133fda service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:43:45.709004 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-d1d17635-7d73-4ac7-9aeb-e6f03cc21b46 req-be3cae91-1f5d-486b-8802-e2d388133fda service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:43:45.730133 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-d1d17635-7d73-4ac7-9aeb-e6f03cc21b46 req-be3cae91-1f5d-486b-8802-e2d388133fda service nova] Creating event network-changed:2c204f84-c862-41de-ae64-505b5a6c7154 for instance 5684f397-fdae-42f0-bcec-989ab9b20340 on nch1-master-1 Jan 15 21:43:45.736016 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-d1d17635-7d73-4ac7-9aeb-e6f03cc21b46 req-be3cae91-1f5d-486b-8802-e2d388133fda service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050028 Jan 15 21:43:45.736713 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3992/7969] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:43:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:43:45.852664 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-6aa4aa1a-3332-436c-86ba-00f2de3fb2b6 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:43:45.853962 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-6aa4aa1a-3332-436c-86ba-00f2de3fb2b6 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 5684f397-fdae-42f0-bcec-989ab9b20340] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:43:45.868397 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6aa4aa1a-3332-436c-86ba-00f2de3fb2b6 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:43:45.868929 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6aa4aa1a-3332-436c-86ba-00f2de3fb2b6 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:43:45.869756 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6aa4aa1a-3332-436c-86ba-00f2de3fb2b6 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:43:45.870212 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6aa4aa1a-3332-436c-86ba-00f2de3fb2b6 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:43:46.006421 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-6aa4aa1a-3332-436c-86ba-00f2de3fb2b6 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:43:46.013863 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-6aa4aa1a-3332-436c-86ba-00f2de3fb2b6 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/5684f397-fdae-42f0-bcec-989ab9b20340" status: 200 len: 1392 microversion: 2.1 time: 0.166137 Jan 15 21:43:46.015126 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3978/7970] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:43:45 2022] GET /compute/v2.1/servers/5684f397-fdae-42f0-bcec-989ab9b20340 => generated 1392 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:43:47.030676 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1061f0a3-4f2d-445e-b719-d5299586af3e tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:43:47.031367 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-1061f0a3-4f2d-445e-b719-d5299586af3e tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 5684f397-fdae-42f0-bcec-989ab9b20340] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:43:47.038907 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1061f0a3-4f2d-445e-b719-d5299586af3e tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:43:47.039371 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1061f0a3-4f2d-445e-b719-d5299586af3e tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:43:47.040152 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1061f0a3-4f2d-445e-b719-d5299586af3e tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:43:47.040586 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1061f0a3-4f2d-445e-b719-d5299586af3e tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:43:47.176256 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-1061f0a3-4f2d-445e-b719-d5299586af3e tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:43:47.184482 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-1061f0a3-4f2d-445e-b719-d5299586af3e tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/5684f397-fdae-42f0-bcec-989ab9b20340" status: 200 len: 1392 microversion: 2.1 time: 0.157901 Jan 15 21:43:47.185092 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3993/7971] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:43:47 2022] GET /compute/v2.1/servers/5684f397-fdae-42f0-bcec-989ab9b20340 => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:43:48.200791 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-62b9f04e-19e9-421b-83dd-d463c3517859 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:43:48.201548 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-62b9f04e-19e9-421b-83dd-d463c3517859 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 5684f397-fdae-42f0-bcec-989ab9b20340] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:43:48.209422 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-62b9f04e-19e9-421b-83dd-d463c3517859 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:43:48.209880 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-62b9f04e-19e9-421b-83dd-d463c3517859 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:43:48.210661 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-62b9f04e-19e9-421b-83dd-d463c3517859 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:43:48.211107 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-62b9f04e-19e9-421b-83dd-d463c3517859 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:43:48.343087 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-62b9f04e-19e9-421b-83dd-d463c3517859 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:43:48.350443 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-62b9f04e-19e9-421b-83dd-d463c3517859 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/5684f397-fdae-42f0-bcec-989ab9b20340" status: 200 len: 1392 microversion: 2.1 time: 0.153991 Jan 15 21:43:48.351027 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3979/7972] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:43:48 2022] GET /compute/v2.1/servers/5684f397-fdae-42f0-bcec-989ab9b20340 => generated 1392 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:43:49.367051 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8178e60a-7f55-4446-b341-c5856e2e89b0 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:43:49.367657 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-8178e60a-7f55-4446-b341-c5856e2e89b0 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 5684f397-fdae-42f0-bcec-989ab9b20340] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:43:49.374678 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8178e60a-7f55-4446-b341-c5856e2e89b0 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:43:49.375126 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8178e60a-7f55-4446-b341-c5856e2e89b0 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:43:49.375906 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8178e60a-7f55-4446-b341-c5856e2e89b0 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:43:49.376347 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8178e60a-7f55-4446-b341-c5856e2e89b0 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:43:49.512382 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-8178e60a-7f55-4446-b341-c5856e2e89b0 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:43:49.519775 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-8178e60a-7f55-4446-b341-c5856e2e89b0 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/5684f397-fdae-42f0-bcec-989ab9b20340" status: 200 len: 1392 microversion: 2.1 time: 0.156393 Jan 15 21:43:49.520350 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3994/7973] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:43:49 2022] GET /compute/v2.1/servers/5684f397-fdae-42f0-bcec-989ab9b20340 => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:43:50.537308 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-bf7a2849-b048-47c5-a03b-56d7a3cb4b5d tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:43:50.537929 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-bf7a2849-b048-47c5-a03b-56d7a3cb4b5d tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 5684f397-fdae-42f0-bcec-989ab9b20340] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:43:50.545533 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bf7a2849-b048-47c5-a03b-56d7a3cb4b5d tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:43:50.546007 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bf7a2849-b048-47c5-a03b-56d7a3cb4b5d tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:43:50.546807 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bf7a2849-b048-47c5-a03b-56d7a3cb4b5d tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:43:50.547296 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bf7a2849-b048-47c5-a03b-56d7a3cb4b5d tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:43:50.678867 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-bf7a2849-b048-47c5-a03b-56d7a3cb4b5d tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:43:50.686739 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-bf7a2849-b048-47c5-a03b-56d7a3cb4b5d tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/5684f397-fdae-42f0-bcec-989ab9b20340" status: 200 len: 1392 microversion: 2.1 time: 0.153482 Jan 15 21:43:50.687323 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3980/7974] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:43:50 2022] GET /compute/v2.1/servers/5684f397-fdae-42f0-bcec-989ab9b20340 => generated 1392 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:43:51.029774 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-eafda1ec-e4c4-4fb8-b384-873c70326fdb req-08c597b7-863f-4b55-b26c-140725a1cda7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5684f397-fdae-42f0-bcec-989ab9b20340", "name": "network-vif-plugged", "status": "completed", "tag": "2c204f84-c862-41de-ae64-505b5a6c7154"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:43:51.031342 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:43:51.031342 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:43:51.038719 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-eafda1ec-e4c4-4fb8-b384-873c70326fdb req-08c597b7-863f-4b55-b26c-140725a1cda7 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:43:51.039165 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-eafda1ec-e4c4-4fb8-b384-873c70326fdb req-08c597b7-863f-4b55-b26c-140725a1cda7 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:43:51.050438 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-eafda1ec-e4c4-4fb8-b384-873c70326fdb req-08c597b7-863f-4b55-b26c-140725a1cda7 service nova] Creating event network-vif-plugged:2c204f84-c862-41de-ae64-505b5a6c7154 for instance 5684f397-fdae-42f0-bcec-989ab9b20340 on nch1-master-1 Jan 15 21:43:51.055281 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-eafda1ec-e4c4-4fb8-b384-873c70326fdb req-08c597b7-863f-4b55-b26c-140725a1cda7 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097441 Jan 15 21:43:51.056288 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3995/7975] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:43:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:43:51.703618 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8a27578f-525c-4b3b-9b83-72a4acd2f834 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:43:51.704158 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-8a27578f-525c-4b3b-9b83-72a4acd2f834 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 5684f397-fdae-42f0-bcec-989ab9b20340] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:43:51.710937 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8a27578f-525c-4b3b-9b83-72a4acd2f834 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:43:51.711399 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8a27578f-525c-4b3b-9b83-72a4acd2f834 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:43:51.712245 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8a27578f-525c-4b3b-9b83-72a4acd2f834 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:43:51.712724 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8a27578f-525c-4b3b-9b83-72a4acd2f834 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:43:51.846979 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-8a27578f-525c-4b3b-9b83-72a4acd2f834 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:43:51.855234 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-8a27578f-525c-4b3b-9b83-72a4acd2f834 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/5684f397-fdae-42f0-bcec-989ab9b20340" status: 200 len: 1392 microversion: 2.1 time: 0.155448 Jan 15 21:43:51.855810 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3981/7976] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:43:51 2022] GET /compute/v2.1/servers/5684f397-fdae-42f0-bcec-989ab9b20340 => generated 1392 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:43:52.873305 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-fedd0999-e99f-44a4-900f-68921f2c73cf tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:43:52.873994 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-fedd0999-e99f-44a4-900f-68921f2c73cf tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 5684f397-fdae-42f0-bcec-989ab9b20340] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:43:52.880173 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fedd0999-e99f-44a4-900f-68921f2c73cf tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:43:52.880625 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fedd0999-e99f-44a4-900f-68921f2c73cf tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:43:52.881438 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fedd0999-e99f-44a4-900f-68921f2c73cf tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:43:52.881873 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fedd0999-e99f-44a4-900f-68921f2c73cf tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:43:53.013843 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-fedd0999-e99f-44a4-900f-68921f2c73cf tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:43:53.021149 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-fedd0999-e99f-44a4-900f-68921f2c73cf tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/5684f397-fdae-42f0-bcec-989ab9b20340" status: 200 len: 1563 microversion: 2.1 time: 0.153289 Jan 15 21:43:53.021735 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3996/7977] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:43:52 2022] GET /compute/v2.1/servers/5684f397-fdae-42f0-bcec-989ab9b20340 => generated 1563 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:43:53.037685 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2e0b8b7b-fe20-470e-a6be-c128a89552f0 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:43:53.038303 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-2e0b8b7b-fe20-470e-a6be-c128a89552f0 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 5684f397-fdae-42f0-bcec-989ab9b20340] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:43:53.045132 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2e0b8b7b-fe20-470e-a6be-c128a89552f0 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:43:53.045593 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2e0b8b7b-fe20-470e-a6be-c128a89552f0 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:43:53.046381 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2e0b8b7b-fe20-470e-a6be-c128a89552f0 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:43:53.046829 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2e0b8b7b-fe20-470e-a6be-c128a89552f0 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:43:53.178853 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-2e0b8b7b-fe20-470e-a6be-c128a89552f0 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:43:53.187079 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2e0b8b7b-fe20-470e-a6be-c128a89552f0 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/5684f397-fdae-42f0-bcec-989ab9b20340" status: 200 len: 1563 microversion: 2.1 time: 0.153300 Jan 15 21:43:53.187670 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3982/7978] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:43:53 2022] GET /compute/v2.1/servers/5684f397-fdae-42f0-bcec-989ab9b20340 => generated 1563 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:43:55.050437 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-5011351c-f285-4a3d-9cab-a106376739ae tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:43:55.051052 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-5011351c-f285-4a3d-9cab-a106376739ae tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 5684f397-fdae-42f0-bcec-989ab9b20340] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:43:55.058415 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5011351c-f285-4a3d-9cab-a106376739ae tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:43:55.058870 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5011351c-f285-4a3d-9cab-a106376739ae tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:43:55.059656 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5011351c-f285-4a3d-9cab-a106376739ae tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:43:55.060095 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5011351c-f285-4a3d-9cab-a106376739ae tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:43:55.060241 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-0714e55a-5820-4eea-9eed-62610cf4a841 req-7ac18232-dab8-4c17-b4ab-2d377f7010b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5684f397-fdae-42f0-bcec-989ab9b20340", "tag": "2c204f84-c862-41de-ae64-505b5a6c7154"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:43:55.061837 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:43:55.061837 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:43:55.069248 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-0714e55a-5820-4eea-9eed-62610cf4a841 req-7ac18232-dab8-4c17-b4ab-2d377f7010b7 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:43:55.070271 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-0714e55a-5820-4eea-9eed-62610cf4a841 req-7ac18232-dab8-4c17-b4ab-2d377f7010b7 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:43:55.082566 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-0714e55a-5820-4eea-9eed-62610cf4a841 req-7ac18232-dab8-4c17-b4ab-2d377f7010b7 service nova] Creating event network-changed:2c204f84-c862-41de-ae64-505b5a6c7154 for instance 5684f397-fdae-42f0-bcec-989ab9b20340 on nch1-master-1 Jan 15 21:43:55.088419 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-0714e55a-5820-4eea-9eed-62610cf4a841 req-7ac18232-dab8-4c17-b4ab-2d377f7010b7 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032676 Jan 15 21:43:55.089454 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3983/7979] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:43:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 21:43:55.209017 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-5011351c-f285-4a3d-9cab-a106376739ae tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:43:55.220589 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-5011351c-f285-4a3d-9cab-a106376739ae tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/5684f397-fdae-42f0-bcec-989ab9b20340" status: 200 len: 1563 microversion: 2.1 time: 0.174028 Jan 15 21:43:55.222044 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3997/7980] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:43:55 2022] GET /compute/v2.1/servers/5684f397-fdae-42f0-bcec-989ab9b20340 => generated 1563 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:44:18.487238 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-eea1929d-30dc-4ada-8d5a-0a2133de8219 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:44:18.488239 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-eea1929d-30dc-4ada-8d5a-0a2133de8219 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 5684f397-fdae-42f0-bcec-989ab9b20340] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:44:18.494622 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-eea1929d-30dc-4ada-8d5a-0a2133de8219 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:44:18.495090 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-eea1929d-30dc-4ada-8d5a-0a2133de8219 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:44:18.496628 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-eea1929d-30dc-4ada-8d5a-0a2133de8219 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:44:18.497111 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-eea1929d-30dc-4ada-8d5a-0a2133de8219 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:44:18.550897 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-eea1929d-30dc-4ada-8d5a-0a2133de8219 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "POST /compute/v2.1/servers/5684f397-fdae-42f0-bcec-989ab9b20340/action" status: 200 len: 24574 microversion: 2.1 time: 0.068676 Jan 15 21:44:18.551836 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3984/7981] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:44:18 2022] POST /compute/v2.1/servers/5684f397-fdae-42f0-bcec-989ab9b20340/action => generated 24574 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:44:24.906869 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c9d778d2-c801-445d-b6ae-a9524896d6e2 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:44:24.907537 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c9d778d2-c801-445d-b6ae-a9524896d6e2 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 5684f397-fdae-42f0-bcec-989ab9b20340] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:44:24.913972 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c9d778d2-c801-445d-b6ae-a9524896d6e2 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:44:24.914415 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c9d778d2-c801-445d-b6ae-a9524896d6e2 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:44:24.915201 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c9d778d2-c801-445d-b6ae-a9524896d6e2 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:44:24.915644 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c9d778d2-c801-445d-b6ae-a9524896d6e2 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:44:24.984898 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c9d778d2-c801-445d-b6ae-a9524896d6e2 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "POST /compute/v2.1/servers/5684f397-fdae-42f0-bcec-989ab9b20340/action" status: 202 len: 0 microversion: 2.1 time: 0.082414 Jan 15 21:44:24.985928 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3998/7982] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:44:24 2022] POST /compute/v2.1/servers/5684f397-fdae-42f0-bcec-989ab9b20340/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:44:24.994541 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-6ba281d6-68f6-4664-8fbb-58972461e865 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:44:24.995262 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-6ba281d6-68f6-4664-8fbb-58972461e865 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 5684f397-fdae-42f0-bcec-989ab9b20340] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:44:25.004316 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6ba281d6-68f6-4664-8fbb-58972461e865 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:44:25.004789 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6ba281d6-68f6-4664-8fbb-58972461e865 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:44:25.005642 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6ba281d6-68f6-4664-8fbb-58972461e865 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:44:25.006097 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6ba281d6-68f6-4664-8fbb-58972461e865 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:44:25.145937 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-6ba281d6-68f6-4664-8fbb-58972461e865 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:44:25.154197 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-6ba281d6-68f6-4664-8fbb-58972461e865 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/5684f397-fdae-42f0-bcec-989ab9b20340" status: 200 len: 1686 microversion: 2.1 time: 0.163796 Jan 15 21:44:25.154774 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3985/7983] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:44:24 2022] GET /compute/v2.1/servers/5684f397-fdae-42f0-bcec-989ab9b20340 => generated 1686 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:44:26.173108 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c10cd4e3-f72a-4b66-947c-e651f7843231 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:44:26.173833 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c10cd4e3-f72a-4b66-947c-e651f7843231 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 5684f397-fdae-42f0-bcec-989ab9b20340] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:44:26.181132 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c10cd4e3-f72a-4b66-947c-e651f7843231 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:44:26.181585 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c10cd4e3-f72a-4b66-947c-e651f7843231 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:44:26.182358 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c10cd4e3-f72a-4b66-947c-e651f7843231 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:44:26.182792 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c10cd4e3-f72a-4b66-947c-e651f7843231 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:44:26.319567 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-c10cd4e3-f72a-4b66-947c-e651f7843231 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:44:26.327112 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c10cd4e3-f72a-4b66-947c-e651f7843231 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/5684f397-fdae-42f0-bcec-989ab9b20340" status: 200 len: 1666 microversion: 2.1 time: 0.158269 Jan 15 21:44:26.327688 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 3999/7984] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:44:26 2022] GET /compute/v2.1/servers/5684f397-fdae-42f0-bcec-989ab9b20340 => generated 1666 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:44:27.420090 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-edf3f3f4-9ca0-474a-becf-89985de48ea5 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:44:27.421548 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-edf3f3f4-9ca0-474a-becf-89985de48ea5 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 5684f397-fdae-42f0-bcec-989ab9b20340] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:44:27.429527 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-edf3f3f4-9ca0-474a-becf-89985de48ea5 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:44:27.429981 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-edf3f3f4-9ca0-474a-becf-89985de48ea5 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:44:27.431303 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-edf3f3f4-9ca0-474a-becf-89985de48ea5 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:44:27.431303 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-edf3f3f4-9ca0-474a-becf-89985de48ea5 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:44:27.484780 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-edf3f3f4-9ca0-474a-becf-89985de48ea5 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "POST /compute/v2.1/servers/5684f397-fdae-42f0-bcec-989ab9b20340/action" status: 200 len: 32641 microversion: 2.1 time: 0.069406 Jan 15 21:44:27.485492 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3986/7985] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:44:27 2022] POST /compute/v2.1/servers/5684f397-fdae-42f0-bcec-989ab9b20340/action => generated 32641 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:44:27.497037 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-eca5427a-d66a-4fae-b161-5b56c63e959c tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:44:27.497575 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-eca5427a-d66a-4fae-b161-5b56c63e959c tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 5684f397-fdae-42f0-bcec-989ab9b20340] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:44:27.504328 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-eca5427a-d66a-4fae-b161-5b56c63e959c tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:44:27.504783 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-eca5427a-d66a-4fae-b161-5b56c63e959c tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:44:27.505600 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-eca5427a-d66a-4fae-b161-5b56c63e959c tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:44:27.506043 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-eca5427a-d66a-4fae-b161-5b56c63e959c tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:44:27.571623 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-eca5427a-d66a-4fae-b161-5b56c63e959c tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "POST /compute/v2.1/servers/5684f397-fdae-42f0-bcec-989ab9b20340/action" status: 202 len: 0 microversion: 2.1 time: 0.078959 Jan 15 21:44:27.572474 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4000/7986] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:44:27 2022] POST /compute/v2.1/servers/5684f397-fdae-42f0-bcec-989ab9b20340/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:44:27.581082 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-95c46011-5abe-4ee7-ad56-a1c2fdca01f0 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:44:27.581796 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-95c46011-5abe-4ee7-ad56-a1c2fdca01f0 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 5684f397-fdae-42f0-bcec-989ab9b20340] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:44:27.589912 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-95c46011-5abe-4ee7-ad56-a1c2fdca01f0 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:44:27.590427 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-95c46011-5abe-4ee7-ad56-a1c2fdca01f0 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:44:27.591258 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-95c46011-5abe-4ee7-ad56-a1c2fdca01f0 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:44:27.591793 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-95c46011-5abe-4ee7-ad56-a1c2fdca01f0 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:44:27.734153 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-95c46011-5abe-4ee7-ad56-a1c2fdca01f0 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:44:27.742068 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-95c46011-5abe-4ee7-ad56-a1c2fdca01f0 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/5684f397-fdae-42f0-bcec-989ab9b20340" status: 200 len: 1673 microversion: 2.1 time: 0.165134 Jan 15 21:44:27.742873 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3987/7987] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:44:27 2022] GET /compute/v2.1/servers/5684f397-fdae-42f0-bcec-989ab9b20340 => generated 1673 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:44:28.761461 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-dcec2fe6-f24e-4ecd-b18a-428179c54a57 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:44:28.762255 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-dcec2fe6-f24e-4ecd-b18a-428179c54a57 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 5684f397-fdae-42f0-bcec-989ab9b20340] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:44:28.769240 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dcec2fe6-f24e-4ecd-b18a-428179c54a57 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:44:28.769693 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dcec2fe6-f24e-4ecd-b18a-428179c54a57 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:44:28.770468 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dcec2fe6-f24e-4ecd-b18a-428179c54a57 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:44:28.770900 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dcec2fe6-f24e-4ecd-b18a-428179c54a57 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:44:28.901689 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-dcec2fe6-f24e-4ecd-b18a-428179c54a57 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:44:28.909757 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-dcec2fe6-f24e-4ecd-b18a-428179c54a57 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/5684f397-fdae-42f0-bcec-989ab9b20340" status: 200 len: 1681 microversion: 2.1 time: 0.152589 Jan 15 21:44:28.910329 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4001/7988] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:44:28 2022] GET /compute/v2.1/servers/5684f397-fdae-42f0-bcec-989ab9b20340 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:44:29.013561 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-7df3068e-80dd-42f5-b4f9-3e92c40caf71 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:44:29.014415 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-7df3068e-80dd-42f5-b4f9-3e92c40caf71 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 5684f397-fdae-42f0-bcec-989ab9b20340] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:44:29.021900 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7df3068e-80dd-42f5-b4f9-3e92c40caf71 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:44:29.022363 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7df3068e-80dd-42f5-b4f9-3e92c40caf71 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:44:29.023238 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7df3068e-80dd-42f5-b4f9-3e92c40caf71 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:44:29.023794 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7df3068e-80dd-42f5-b4f9-3e92c40caf71 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:44:29.075287 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-7df3068e-80dd-42f5-b4f9-3e92c40caf71 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "POST /compute/v2.1/servers/5684f397-fdae-42f0-bcec-989ab9b20340/action" status: 200 len: 35312 microversion: 2.1 time: 0.065830 Jan 15 21:44:29.075978 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3988/7989] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:44:29 2022] POST /compute/v2.1/servers/5684f397-fdae-42f0-bcec-989ab9b20340/action => generated 35312 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:44:30.121520 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-6ca5c796-0f4f-47ce-8cdf-d080cc72f1eb tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:44:30.122449 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-6ca5c796-0f4f-47ce-8cdf-d080cc72f1eb tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 5684f397-fdae-42f0-bcec-989ab9b20340] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:44:30.124964 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-3e72bae9-22ca-4b1d-a6dc-b5c9a6423009 req-86a3e385-e34d-4f11-ad94-a90b40238114 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5684f397-fdae-42f0-bcec-989ab9b20340", "tag": "2c204f84-c862-41de-ae64-505b5a6c7154"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:44:30.126521 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:44:30.126521 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:44:30.130042 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6ca5c796-0f4f-47ce-8cdf-d080cc72f1eb tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:44:30.130750 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6ca5c796-0f4f-47ce-8cdf-d080cc72f1eb tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:44:30.131546 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6ca5c796-0f4f-47ce-8cdf-d080cc72f1eb tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:44:30.131978 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6ca5c796-0f4f-47ce-8cdf-d080cc72f1eb tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:44:30.134783 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-3e72bae9-22ca-4b1d-a6dc-b5c9a6423009 req-86a3e385-e34d-4f11-ad94-a90b40238114 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:44:30.135239 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-3e72bae9-22ca-4b1d-a6dc-b5c9a6423009 req-86a3e385-e34d-4f11-ad94-a90b40238114 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:44:30.149156 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-3e72bae9-22ca-4b1d-a6dc-b5c9a6423009 req-86a3e385-e34d-4f11-ad94-a90b40238114 service nova] Creating event network-changed:2c204f84-c862-41de-ae64-505b5a6c7154 for instance 5684f397-fdae-42f0-bcec-989ab9b20340 on nch1-master-1 Jan 15 21:44:30.154928 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-3e72bae9-22ca-4b1d-a6dc-b5c9a6423009 req-86a3e385-e34d-4f11-ad94-a90b40238114 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034847 Jan 15 21:44:30.155866 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3989/7990] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:44:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:44:30.161292 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-6ca5c796-0f4f-47ce-8cdf-d080cc72f1eb tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 5684f397-fdae-42f0-bcec-989ab9b20340] Going to try to terminate instance {{(pid=129366) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 21:44:30.253760 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-6ca5c796-0f4f-47ce-8cdf-d080cc72f1eb tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "DELETE /compute/v2.1/servers/5684f397-fdae-42f0-bcec-989ab9b20340" status: 204 len: 0 microversion: 2.1 time: 0.135951 Jan 15 21:44:30.254816 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4002/7991] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 21:44:30 2022] DELETE /compute/v2.1/servers/5684f397-fdae-42f0-bcec-989ab9b20340 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 21:44:30.264531 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-0392baa9-e64c-457d-914a-bb56572b252b tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:44:30.265299 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-0392baa9-e64c-457d-914a-bb56572b252b tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 5684f397-fdae-42f0-bcec-989ab9b20340] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:44:30.272172 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0392baa9-e64c-457d-914a-bb56572b252b tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:44:30.272634 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0392baa9-e64c-457d-914a-bb56572b252b tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:44:30.273484 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0392baa9-e64c-457d-914a-bb56572b252b tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:44:30.273939 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0392baa9-e64c-457d-914a-bb56572b252b tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:44:30.415666 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-0392baa9-e64c-457d-914a-bb56572b252b tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:44:30.424646 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-0392baa9-e64c-457d-914a-bb56572b252b tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/5684f397-fdae-42f0-bcec-989ab9b20340" status: 200 len: 1687 microversion: 2.1 time: 0.164841 Jan 15 21:44:30.425282 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3990/7992] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:44:30 2022] GET /compute/v2.1/servers/5684f397-fdae-42f0-bcec-989ab9b20340 => generated 1687 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:44:31.444366 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e469ee24-81e9-4729-bafb-59a1a66625da tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:44:31.445096 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e469ee24-81e9-4729-bafb-59a1a66625da tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 5684f397-fdae-42f0-bcec-989ab9b20340] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:44:31.452484 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e469ee24-81e9-4729-bafb-59a1a66625da tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:44:31.452976 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e469ee24-81e9-4729-bafb-59a1a66625da tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:44:31.453761 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e469ee24-81e9-4729-bafb-59a1a66625da tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:44:31.454210 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e469ee24-81e9-4729-bafb-59a1a66625da tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:44:31.594564 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-e469ee24-81e9-4729-bafb-59a1a66625da tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:44:31.601991 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e469ee24-81e9-4729-bafb-59a1a66625da tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/5684f397-fdae-42f0-bcec-989ab9b20340" status: 200 len: 1569 microversion: 2.1 time: 0.161754 Jan 15 21:44:31.602578 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4003/7993] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:44:31 2022] GET /compute/v2.1/servers/5684f397-fdae-42f0-bcec-989ab9b20340 => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:44:32.413768 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-ff67ef1c-74fc-4976-a1dd-2ba08c9300b1 req-a776b1bc-dc28-4b5c-b402-007881439fa4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5684f397-fdae-42f0-bcec-989ab9b20340", "name": "network-vif-deleted", "tag": "2c204f84-c862-41de-ae64-505b5a6c7154"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:44:32.415597 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:44:32.415597 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:44:32.426132 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-ff67ef1c-74fc-4976-a1dd-2ba08c9300b1 req-a776b1bc-dc28-4b5c-b402-007881439fa4 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:44:32.426590 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-ff67ef1c-74fc-4976-a1dd-2ba08c9300b1 req-a776b1bc-dc28-4b5c-b402-007881439fa4 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:44:32.440301 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-ff67ef1c-74fc-4976-a1dd-2ba08c9300b1 req-a776b1bc-dc28-4b5c-b402-007881439fa4 service nova] Creating event network-vif-deleted:2c204f84-c862-41de-ae64-505b5a6c7154 for instance 5684f397-fdae-42f0-bcec-989ab9b20340 on nch1-master-1 Jan 15 21:44:32.446722 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-ff67ef1c-74fc-4976-a1dd-2ba08c9300b1 req-a776b1bc-dc28-4b5c-b402-007881439fa4 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036997 Jan 15 21:44:32.447338 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3991/7994] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:44:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:44:32.619208 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-04474e97-be7b-40c9-9a3f-abb627f2e32d tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:44:32.619781 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-04474e97-be7b-40c9-9a3f-abb627f2e32d tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 5684f397-fdae-42f0-bcec-989ab9b20340] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:44:32.626469 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-04474e97-be7b-40c9-9a3f-abb627f2e32d tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:44:32.626922 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-04474e97-be7b-40c9-9a3f-abb627f2e32d tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:44:32.627704 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-04474e97-be7b-40c9-9a3f-abb627f2e32d tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:44:32.628142 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-04474e97-be7b-40c9-9a3f-abb627f2e32d tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:44:32.659928 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-04474e97-be7b-40c9-9a3f-abb627f2e32d tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:44:32.660377 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-04474e97-be7b-40c9-9a3f-abb627f2e32d tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:44:32.660822 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.objects.instance [None req-04474e97-be7b-40c9-9a3f-abb627f2e32d tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lazy-loading 'fault' on Instance uuid 5684f397-fdae-42f0-bcec-989ab9b20340 {{(pid=129366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 21:44:32.702222 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-04474e97-be7b-40c9-9a3f-abb627f2e32d tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:44:32.710362 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-04474e97-be7b-40c9-9a3f-abb627f2e32d tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/5684f397-fdae-42f0-bcec-989ab9b20340" status: 200 len: 1356 microversion: 2.1 time: 0.094911 Jan 15 21:44:32.710954 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4004/7995] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:44:32 2022] GET /compute/v2.1/servers/5684f397-fdae-42f0-bcec-989ab9b20340 => generated 1356 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:44:33.727900 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a6210086-60a6-4811-a91f-5178d092901d tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:44:33.728619 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a6210086-60a6-4811-a91f-5178d092901d tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 5684f397-fdae-42f0-bcec-989ab9b20340] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:44:33.736495 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a6210086-60a6-4811-a91f-5178d092901d tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:44:33.737067 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a6210086-60a6-4811-a91f-5178d092901d tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:44:33.738046 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a6210086-60a6-4811-a91f-5178d092901d tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:44:33.738527 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a6210086-60a6-4811-a91f-5178d092901d tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:44:33.751871 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-a6210086-60a6-4811-a91f-5178d092901d tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] HTTP exception thrown: Instance 5684f397-fdae-42f0-bcec-989ab9b20340 could not be found. Jan 15 21:44:33.752462 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a6210086-60a6-4811-a91f-5178d092901d tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Returning 404 to user: Instance 5684f397-fdae-42f0-bcec-989ab9b20340 could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:44:33.753324 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a6210086-60a6-4811-a91f-5178d092901d tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/5684f397-fdae-42f0-bcec-989ab9b20340" status: 404 len: 111 microversion: 2.1 time: 0.029551 Jan 15 21:44:33.753868 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3992/7996] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:44:33 2022] GET /compute/v2.1/servers/5684f397-fdae-42f0-bcec-989ab9b20340 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:44:37.040555 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b8a3d2f7-8835-4be7-8094-c0adccb56e03 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '.version_select at 0x7f30c983c430>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:44:37.072478 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b8a3d2f7-8835-4be7-8094-c0adccb56e03 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1225295446" status: 202 len: 0 microversion: 2.1 time: 0.037368 Jan 15 21:44:37.074348 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4005/7997] 10.222.0.46 () {58 vars in 1283 bytes} [Sat Jan 15 21:44:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1225295446 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:44:37.093066 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e8b9348d-aab4-4546-9134-4c9564f013fc tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Action: 'create', calling method: .version_select at 0x7f30c84385e0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-772309117"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:44:37.108095 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-e8b9348d-aab4-4546-9134-4c9564f013fc tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Getting quotas for project 5f21548044704a2bbfc4ed1612c66fbc. Resources: {'key_pairs'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:44:37.114014 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-e8b9348d-aab4-4546-9134-4c9564f013fc tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Getting quotas for user 9dd93f3b669e4901b2a805ce60ca057e and project 5f21548044704a2bbfc4ed1612c66fbc. Resources: {'key_pairs'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:44:37.308363 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-e8b9348d-aab4-4546-9134-4c9564f013fc tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Getting quotas for project 5f21548044704a2bbfc4ed1612c66fbc. Resources: {'key_pairs'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:44:37.313605 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-e8b9348d-aab4-4546-9134-4c9564f013fc tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Getting quotas for user 9dd93f3b669e4901b2a805ce60ca057e and project 5f21548044704a2bbfc4ed1612c66fbc. Resources: {'key_pairs'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:44:37.329150 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e8b9348d-aab4-4546-9134-4c9564f013fc tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 2325 microversion: 2.1 time: 0.240618 Jan 15 21:44:37.329793 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3993/7998] 10.222.0.46 () {60 vars in 1157 bytes} [Sat Jan 15 21:44:37 2022] POST /compute/v2.1/os-keypairs => generated 2325 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:44:43.295031 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b630d8b8-8d7d-4def-8666-7ca7ed7fed49 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-8036510", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "networks": [{"uuid": "32a605fb-941f-42fe-a7e4-f5c31502e0c9"}], "key_name": "tempest-TestNetworkAdvancedServerOps-772309117", "security_groups": [{"name": "tempest-secgroup-smoke-42684536"}]}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:44:43.410307 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.network.neutron [None req-b630d8b8-8d7d-4def-8666-7ca7ed7fed49 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] validate_networks() for [('32a605fb-941f-42fe-a7e4-f5c31502e0c9', None, None, None, None, None)] {{(pid=129366) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 21:44:43.881818 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-b630d8b8-8d7d-4def-8666-7ca7ed7fed49 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Flavor limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 21:44:43.882237 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-b630d8b8-8d7d-4def-8666-7ca7ed7fed49 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Image limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 21:44:43.882705 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-b630d8b8-8d7d-4def-8666-7ca7ed7fed49 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Flavor pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 21:44:43.883140 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-b630d8b8-8d7d-4def-8666-7ca7ed7fed49 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Image pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 21:44:43.883542 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-b630d8b8-8d7d-4def-8666-7ca7ed7fed49 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 21:44:43.894375 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b630d8b8-8d7d-4def-8666-7ca7ed7fed49 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:44:43.894823 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b630d8b8-8d7d-4def-8666-7ca7ed7fed49 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:44:43.895633 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b630d8b8-8d7d-4def-8666-7ca7ed7fed49 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:44:43.896095 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b630d8b8-8d7d-4def-8666-7ca7ed7fed49 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:44:43.914393 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-b630d8b8-8d7d-4def-8666-7ca7ed7fed49 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Getting quotas for project 5f21548044704a2bbfc4ed1612c66fbc. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:44:43.919717 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-b630d8b8-8d7d-4def-8666-7ca7ed7fed49 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Getting quotas for user 9dd93f3b669e4901b2a805ce60ca057e and project 5f21548044704a2bbfc4ed1612c66fbc. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:44:43.932113 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b630d8b8-8d7d-4def-8666-7ca7ed7fed49 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Going to run 1 instances... {{(pid=129366) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 21:44:43.934616 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b630d8b8-8d7d-4def-8666-7ca7ed7fed49 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 024e2ad3-f1f5-4797-9972-d48d8080ec8a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 21:44:43.982488 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b630d8b8-8d7d-4def-8666-7ca7ed7fed49 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.692382 Jan 15 21:44:43.983092 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4006/7999] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 21:44:43 2022] POST /compute/v2.1/servers => generated 404 bytes in 694 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 21:44:43.993444 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-7e4c7f87-6e12-4531-9ac0-66d34aa29a94 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:44:43.994057 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-7e4c7f87-6e12-4531-9ac0-66d34aa29a94 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 024e2ad3-f1f5-4797-9972-d48d8080ec8a] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:44:44.054431 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-7e4c7f87-6e12-4531-9ac0-66d34aa29a94 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:44:44.064114 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-7e4c7f87-6e12-4531-9ac0-66d34aa29a94 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/024e2ad3-f1f5-4797-9972-d48d8080ec8a" status: 200 len: 1263 microversion: 2.1 time: 0.075181 Jan 15 21:44:44.064929 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3994/8000] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:44:43 2022] GET /compute/v2.1/servers/024e2ad3-f1f5-4797-9972-d48d8080ec8a => generated 1263 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:44:45.082741 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-83704525-f464-4170-ba28-21d5d2196017 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:44:45.083344 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-83704525-f464-4170-ba28-21d5d2196017 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 024e2ad3-f1f5-4797-9972-d48d8080ec8a] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:44:45.092125 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-83704525-f464-4170-ba28-21d5d2196017 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:44:45.092898 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-83704525-f464-4170-ba28-21d5d2196017 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:44:45.094521 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-83704525-f464-4170-ba28-21d5d2196017 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:44:45.095213 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-83704525-f464-4170-ba28-21d5d2196017 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:44:45.172008 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-83704525-f464-4170-ba28-21d5d2196017 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:44:45.180592 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-83704525-f464-4170-ba28-21d5d2196017 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/024e2ad3-f1f5-4797-9972-d48d8080ec8a" status: 200 len: 1323 microversion: 2.1 time: 0.102362 Jan 15 21:44:45.181473 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4007/8001] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:44:45 2022] GET /compute/v2.1/servers/024e2ad3-f1f5-4797-9972-d48d8080ec8a => generated 1323 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:44:46.199702 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-12771c08-83f7-4960-b575-c1d2822471a0 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:44:46.200322 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-12771c08-83f7-4960-b575-c1d2822471a0 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 024e2ad3-f1f5-4797-9972-d48d8080ec8a] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:44:46.208071 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-12771c08-83f7-4960-b575-c1d2822471a0 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:44:46.208548 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-12771c08-83f7-4960-b575-c1d2822471a0 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:44:46.209676 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-12771c08-83f7-4960-b575-c1d2822471a0 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:44:46.210314 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-12771c08-83f7-4960-b575-c1d2822471a0 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:44:46.398349 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-12771c08-83f7-4960-b575-c1d2822471a0 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:44:46.413559 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-12771c08-83f7-4960-b575-c1d2822471a0 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/024e2ad3-f1f5-4797-9972-d48d8080ec8a" status: 200 len: 1387 microversion: 2.1 time: 0.218228 Jan 15 21:44:46.414168 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3995/8002] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:44:46 2022] GET /compute/v2.1/servers/024e2ad3-f1f5-4797-9972-d48d8080ec8a => generated 1387 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:44:46.671481 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-ea5fbc88-42f9-4adf-a287-8fc1904e20c4 req-e676419d-5749-41e9-adcf-3da8c6f98a39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "024e2ad3-f1f5-4797-9972-d48d8080ec8a", "tag": "9c58511b-30b1-4ca9-8b42-a55c342b60b6"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:44:46.675592 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:44:46.675592 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:44:46.694918 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-ea5fbc88-42f9-4adf-a287-8fc1904e20c4 req-e676419d-5749-41e9-adcf-3da8c6f98a39 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:44:46.695267 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-ea5fbc88-42f9-4adf-a287-8fc1904e20c4 req-e676419d-5749-41e9-adcf-3da8c6f98a39 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:44:46.710993 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-ea5fbc88-42f9-4adf-a287-8fc1904e20c4 req-e676419d-5749-41e9-adcf-3da8c6f98a39 service nova] Creating event network-changed:9c58511b-30b1-4ca9-8b42-a55c342b60b6 for instance 024e2ad3-f1f5-4797-9972-d48d8080ec8a on nch2-master-1 Jan 15 21:44:46.720917 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-ea5fbc88-42f9-4adf-a287-8fc1904e20c4 req-e676419d-5749-41e9-adcf-3da8c6f98a39 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058365 Jan 15 21:44:46.722243 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4008/8003] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:44:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:44:47.430607 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-45da3863-0283-4d93-a08d-1ed789324e8d tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:44:47.431223 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-45da3863-0283-4d93-a08d-1ed789324e8d tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 024e2ad3-f1f5-4797-9972-d48d8080ec8a] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:44:47.439965 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-45da3863-0283-4d93-a08d-1ed789324e8d tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:44:47.440426 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-45da3863-0283-4d93-a08d-1ed789324e8d tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:44:47.441564 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-45da3863-0283-4d93-a08d-1ed789324e8d tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:44:47.441967 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-45da3863-0283-4d93-a08d-1ed789324e8d tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:44:47.577833 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-45da3863-0283-4d93-a08d-1ed789324e8d tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:44:47.585247 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-45da3863-0283-4d93-a08d-1ed789324e8d tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/024e2ad3-f1f5-4797-9972-d48d8080ec8a" status: 200 len: 1387 microversion: 2.1 time: 0.158341 Jan 15 21:44:47.585824 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3996/8004] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:44:47 2022] GET /compute/v2.1/servers/024e2ad3-f1f5-4797-9972-d48d8080ec8a => generated 1387 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:44:48.602454 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-09322c19-58f9-4539-aac7-c6306984d9d3 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:44:48.603149 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-09322c19-58f9-4539-aac7-c6306984d9d3 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 024e2ad3-f1f5-4797-9972-d48d8080ec8a] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:44:48.610122 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-09322c19-58f9-4539-aac7-c6306984d9d3 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:44:48.610564 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-09322c19-58f9-4539-aac7-c6306984d9d3 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:44:48.611337 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-09322c19-58f9-4539-aac7-c6306984d9d3 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:44:48.611768 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-09322c19-58f9-4539-aac7-c6306984d9d3 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:44:48.747772 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-09322c19-58f9-4539-aac7-c6306984d9d3 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:44:48.755124 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-09322c19-58f9-4539-aac7-c6306984d9d3 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/024e2ad3-f1f5-4797-9972-d48d8080ec8a" status: 200 len: 1387 microversion: 2.1 time: 0.156718 Jan 15 21:44:48.755703 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4009/8005] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:44:48 2022] GET /compute/v2.1/servers/024e2ad3-f1f5-4797-9972-d48d8080ec8a => generated 1387 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:44:49.773826 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ee2d9e3d-fb3e-411b-a50b-558aad2ee8c6 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:44:49.774446 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ee2d9e3d-fb3e-411b-a50b-558aad2ee8c6 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 024e2ad3-f1f5-4797-9972-d48d8080ec8a] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:44:49.783068 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ee2d9e3d-fb3e-411b-a50b-558aad2ee8c6 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:44:49.783534 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ee2d9e3d-fb3e-411b-a50b-558aad2ee8c6 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:44:49.784371 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ee2d9e3d-fb3e-411b-a50b-558aad2ee8c6 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:44:49.784825 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ee2d9e3d-fb3e-411b-a50b-558aad2ee8c6 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:44:49.923194 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-ee2d9e3d-fb3e-411b-a50b-558aad2ee8c6 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:44:49.930518 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ee2d9e3d-fb3e-411b-a50b-558aad2ee8c6 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/024e2ad3-f1f5-4797-9972-d48d8080ec8a" status: 200 len: 1387 microversion: 2.1 time: 0.160668 Jan 15 21:44:49.931089 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3997/8006] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:44:49 2022] GET /compute/v2.1/servers/024e2ad3-f1f5-4797-9972-d48d8080ec8a => generated 1387 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:44:50.947510 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4a13d165-4702-4a80-a1c7-4714a83c1633 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:44:50.948802 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-4a13d165-4702-4a80-a1c7-4714a83c1633 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 024e2ad3-f1f5-4797-9972-d48d8080ec8a] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:44:50.955544 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4a13d165-4702-4a80-a1c7-4714a83c1633 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:44:50.955996 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4a13d165-4702-4a80-a1c7-4714a83c1633 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:44:50.956787 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4a13d165-4702-4a80-a1c7-4714a83c1633 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:44:50.957254 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4a13d165-4702-4a80-a1c7-4714a83c1633 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:44:51.091864 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-4a13d165-4702-4a80-a1c7-4714a83c1633 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:44:51.099703 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-4a13d165-4702-4a80-a1c7-4714a83c1633 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/024e2ad3-f1f5-4797-9972-d48d8080ec8a" status: 200 len: 1387 microversion: 2.1 time: 0.155966 Jan 15 21:44:51.100301 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4010/8007] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:44:50 2022] GET /compute/v2.1/servers/024e2ad3-f1f5-4797-9972-d48d8080ec8a => generated 1387 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:44:52.116608 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-592a0bc1-e01b-4d5e-8aa0-dacff0930cb9 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:44:52.117248 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-592a0bc1-e01b-4d5e-8aa0-dacff0930cb9 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 024e2ad3-f1f5-4797-9972-d48d8080ec8a] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:44:52.124307 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-592a0bc1-e01b-4d5e-8aa0-dacff0930cb9 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:44:52.124770 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-592a0bc1-e01b-4d5e-8aa0-dacff0930cb9 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:44:52.125592 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-592a0bc1-e01b-4d5e-8aa0-dacff0930cb9 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:44:52.126040 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-592a0bc1-e01b-4d5e-8aa0-dacff0930cb9 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:44:52.261842 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-592a0bc1-e01b-4d5e-8aa0-dacff0930cb9 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:44:52.269293 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-592a0bc1-e01b-4d5e-8aa0-dacff0930cb9 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/024e2ad3-f1f5-4797-9972-d48d8080ec8a" status: 200 len: 1387 microversion: 2.1 time: 0.156343 Jan 15 21:44:52.269921 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3998/8008] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:44:52 2022] GET /compute/v2.1/servers/024e2ad3-f1f5-4797-9972-d48d8080ec8a => generated 1387 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:44:52.619067 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-2ce1d8c7-cfe5-4c2f-8bef-39fa7d9bc3e6 req-b22511db-2dd9-4d31-8800-df750332bf1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "024e2ad3-f1f5-4797-9972-d48d8080ec8a", "name": "network-vif-plugged", "status": "completed", "tag": "9c58511b-30b1-4ca9-8b42-a55c342b60b6"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:44:52.621088 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:44:52.621088 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:44:52.629153 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-2ce1d8c7-cfe5-4c2f-8bef-39fa7d9bc3e6 req-b22511db-2dd9-4d31-8800-df750332bf1b service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:44:52.629602 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-2ce1d8c7-cfe5-4c2f-8bef-39fa7d9bc3e6 req-b22511db-2dd9-4d31-8800-df750332bf1b service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:44:52.641679 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-2ce1d8c7-cfe5-4c2f-8bef-39fa7d9bc3e6 req-b22511db-2dd9-4d31-8800-df750332bf1b service nova] Creating event network-vif-plugged:9c58511b-30b1-4ca9-8b42-a55c342b60b6 for instance 024e2ad3-f1f5-4797-9972-d48d8080ec8a on nch2-master-1 Jan 15 21:44:52.646551 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-2ce1d8c7-cfe5-4c2f-8bef-39fa7d9bc3e6 req-b22511db-2dd9-4d31-8800-df750332bf1b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031323 Jan 15 21:44:52.647147 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4011/8009] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:44:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:44:53.289617 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-40034a8a-ecb0-4eee-9969-58f2fd3626d9 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:44:53.290242 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-40034a8a-ecb0-4eee-9969-58f2fd3626d9 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 024e2ad3-f1f5-4797-9972-d48d8080ec8a] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:44:53.297678 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-40034a8a-ecb0-4eee-9969-58f2fd3626d9 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:44:53.298148 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-40034a8a-ecb0-4eee-9969-58f2fd3626d9 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:44:53.298943 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-40034a8a-ecb0-4eee-9969-58f2fd3626d9 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:44:53.299398 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-40034a8a-ecb0-4eee-9969-58f2fd3626d9 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:44:53.433181 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-40034a8a-ecb0-4eee-9969-58f2fd3626d9 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:44:53.440596 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-40034a8a-ecb0-4eee-9969-58f2fd3626d9 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/024e2ad3-f1f5-4797-9972-d48d8080ec8a" status: 200 len: 1387 microversion: 2.1 time: 0.154950 Jan 15 21:44:53.441187 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 3999/8010] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:44:53 2022] GET /compute/v2.1/servers/024e2ad3-f1f5-4797-9972-d48d8080ec8a => generated 1387 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:44:54.460150 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9ae2b606-664c-4e55-a410-6d1be29b1125 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:44:54.460861 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-9ae2b606-664c-4e55-a410-6d1be29b1125 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 024e2ad3-f1f5-4797-9972-d48d8080ec8a] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:44:54.467128 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9ae2b606-664c-4e55-a410-6d1be29b1125 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:44:54.467575 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9ae2b606-664c-4e55-a410-6d1be29b1125 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:44:54.468344 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9ae2b606-664c-4e55-a410-6d1be29b1125 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:44:54.468776 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9ae2b606-664c-4e55-a410-6d1be29b1125 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:44:54.605467 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-9ae2b606-664c-4e55-a410-6d1be29b1125 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:44:54.612859 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-9ae2b606-664c-4e55-a410-6d1be29b1125 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/024e2ad3-f1f5-4797-9972-d48d8080ec8a" status: 200 len: 1560 microversion: 2.1 time: 0.157616 Jan 15 21:44:54.613461 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4012/8011] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:44:54 2022] GET /compute/v2.1/servers/024e2ad3-f1f5-4797-9972-d48d8080ec8a => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:44:54.629023 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-385afe83-5bed-48f6-944d-ee0cb70a18bb tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:44:54.629647 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-385afe83-5bed-48f6-944d-ee0cb70a18bb tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 024e2ad3-f1f5-4797-9972-d48d8080ec8a] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:44:54.636413 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-385afe83-5bed-48f6-944d-ee0cb70a18bb tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:44:54.636903 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-385afe83-5bed-48f6-944d-ee0cb70a18bb tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:44:54.637689 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-385afe83-5bed-48f6-944d-ee0cb70a18bb tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:44:54.638133 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-385afe83-5bed-48f6-944d-ee0cb70a18bb tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:44:54.768911 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-385afe83-5bed-48f6-944d-ee0cb70a18bb tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:44:54.777316 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-385afe83-5bed-48f6-944d-ee0cb70a18bb tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/024e2ad3-f1f5-4797-9972-d48d8080ec8a" status: 200 len: 1560 microversion: 2.1 time: 0.150997 Jan 15 21:44:54.777895 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4000/8012] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:44:54 2022] GET /compute/v2.1/servers/024e2ad3-f1f5-4797-9972-d48d8080ec8a => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:44:56.642106 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f64bd4f3-608a-45d9-a7a7-5955fdb97459 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:44:56.642725 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f64bd4f3-608a-45d9-a7a7-5955fdb97459 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 024e2ad3-f1f5-4797-9972-d48d8080ec8a] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:44:56.651036 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-02d7e3a6-e95f-4121-8ae8-b5ec11411f83 req-c62c0407-c468-45e0-bcbc-96f4169c68e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "024e2ad3-f1f5-4797-9972-d48d8080ec8a", "tag": "9c58511b-30b1-4ca9-8b42-a55c342b60b6"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:44:56.652831 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:44:56.652831 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:44:56.660562 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f64bd4f3-608a-45d9-a7a7-5955fdb97459 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:44:56.665036 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-02d7e3a6-e95f-4121-8ae8-b5ec11411f83 req-c62c0407-c468-45e0-bcbc-96f4169c68e2 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:44:56.665523 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-02d7e3a6-e95f-4121-8ae8-b5ec11411f83 req-c62c0407-c468-45e0-bcbc-96f4169c68e2 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:44:56.670251 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f64bd4f3-608a-45d9-a7a7-5955fdb97459 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:44:56.671191 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f64bd4f3-608a-45d9-a7a7-5955fdb97459 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:44:56.671667 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f64bd4f3-608a-45d9-a7a7-5955fdb97459 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:44:56.683532 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-02d7e3a6-e95f-4121-8ae8-b5ec11411f83 req-c62c0407-c468-45e0-bcbc-96f4169c68e2 service nova] Creating event network-changed:9c58511b-30b1-4ca9-8b42-a55c342b60b6 for instance 024e2ad3-f1f5-4797-9972-d48d8080ec8a on nch2-master-1 Jan 15 21:44:56.688705 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-02d7e3a6-e95f-4121-8ae8-b5ec11411f83 req-c62c0407-c468-45e0-bcbc-96f4169c68e2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041334 Jan 15 21:44:56.689583 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4001/8013] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:44:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:44:56.834805 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-f64bd4f3-608a-45d9-a7a7-5955fdb97459 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:44:56.846945 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f64bd4f3-608a-45d9-a7a7-5955fdb97459 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/024e2ad3-f1f5-4797-9972-d48d8080ec8a" status: 200 len: 1560 microversion: 2.1 time: 0.208588 Jan 15 21:44:56.847543 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4013/8014] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:44:56 2022] GET /compute/v2.1/servers/024e2ad3-f1f5-4797-9972-d48d8080ec8a => generated 1560 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:45:20.147217 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ad5c663c-8a99-4411-9d34-dac278395ed8 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:45:20.148229 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ad5c663c-8a99-4411-9d34-dac278395ed8 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 024e2ad3-f1f5-4797-9972-d48d8080ec8a] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:45:20.155271 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ad5c663c-8a99-4411-9d34-dac278395ed8 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:45:20.155741 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ad5c663c-8a99-4411-9d34-dac278395ed8 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:45:20.156536 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ad5c663c-8a99-4411-9d34-dac278395ed8 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:45:20.157030 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ad5c663c-8a99-4411-9d34-dac278395ed8 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:45:20.209378 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ad5c663c-8a99-4411-9d34-dac278395ed8 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "POST /compute/v2.1/servers/024e2ad3-f1f5-4797-9972-d48d8080ec8a/action" status: 200 len: 24570 microversion: 2.1 time: 0.067022 Jan 15 21:45:20.210016 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4002/8015] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:45:20 2022] POST /compute/v2.1/servers/024e2ad3-f1f5-4797-9972-d48d8080ec8a/action => generated 24570 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:45:31.182419 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0ad68ea7-a31e-47ec-8dc7-42d83d36df19 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:45:31.183352 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-0ad68ea7-a31e-47ec-8dc7-42d83d36df19 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 024e2ad3-f1f5-4797-9972-d48d8080ec8a] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:45:31.190098 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0ad68ea7-a31e-47ec-8dc7-42d83d36df19 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:45:31.190546 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0ad68ea7-a31e-47ec-8dc7-42d83d36df19 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:45:31.191318 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0ad68ea7-a31e-47ec-8dc7-42d83d36df19 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:45:31.191747 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0ad68ea7-a31e-47ec-8dc7-42d83d36df19 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:45:31.265264 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0ad68ea7-a31e-47ec-8dc7-42d83d36df19 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "POST /compute/v2.1/servers/024e2ad3-f1f5-4797-9972-d48d8080ec8a/action" status: 202 len: 0 microversion: 2.1 time: 0.085011 Jan 15 21:45:31.266242 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4014/8016] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:45:31 2022] POST /compute/v2.1/servers/024e2ad3-f1f5-4797-9972-d48d8080ec8a/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:45:31.275220 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5f23891d-60c7-4b4d-9d3c-7c2925c3ca94 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:45:31.276350 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-5f23891d-60c7-4b4d-9d3c-7c2925c3ca94 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 024e2ad3-f1f5-4797-9972-d48d8080ec8a] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:45:31.284575 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5f23891d-60c7-4b4d-9d3c-7c2925c3ca94 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:45:31.285177 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5f23891d-60c7-4b4d-9d3c-7c2925c3ca94 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:45:31.286785 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5f23891d-60c7-4b4d-9d3c-7c2925c3ca94 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:45:31.287446 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5f23891d-60c7-4b4d-9d3c-7c2925c3ca94 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:45:31.490284 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-5f23891d-60c7-4b4d-9d3c-7c2925c3ca94 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:45:31.498307 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5f23891d-60c7-4b4d-9d3c-7c2925c3ca94 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/024e2ad3-f1f5-4797-9972-d48d8080ec8a" status: 200 len: 1671 microversion: 2.1 time: 0.226837 Jan 15 21:45:31.499010 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4003/8017] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:45:31 2022] GET /compute/v2.1/servers/024e2ad3-f1f5-4797-9972-d48d8080ec8a => generated 1671 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:45:32.517071 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-599ce03c-e9a1-49e7-8eb8-2c2c99232fe5 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:45:32.517894 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-599ce03c-e9a1-49e7-8eb8-2c2c99232fe5 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 024e2ad3-f1f5-4797-9972-d48d8080ec8a] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:45:32.525354 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-599ce03c-e9a1-49e7-8eb8-2c2c99232fe5 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:45:32.525826 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-599ce03c-e9a1-49e7-8eb8-2c2c99232fe5 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:45:32.526603 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-599ce03c-e9a1-49e7-8eb8-2c2c99232fe5 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:45:32.527033 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-599ce03c-e9a1-49e7-8eb8-2c2c99232fe5 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:45:32.718940 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-599ce03c-e9a1-49e7-8eb8-2c2c99232fe5 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:45:32.726455 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-599ce03c-e9a1-49e7-8eb8-2c2c99232fe5 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/024e2ad3-f1f5-4797-9972-d48d8080ec8a" status: 200 len: 1676 microversion: 2.1 time: 0.214487 Jan 15 21:45:32.727036 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4015/8018] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:45:32 2022] GET /compute/v2.1/servers/024e2ad3-f1f5-4797-9972-d48d8080ec8a => generated 1676 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:45:33.743300 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c9ef5ff0-ad1c-44d6-b50b-41455f24ce3c tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:45:33.743927 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c9ef5ff0-ad1c-44d6-b50b-41455f24ce3c tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 024e2ad3-f1f5-4797-9972-d48d8080ec8a] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:45:33.752037 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c9ef5ff0-ad1c-44d6-b50b-41455f24ce3c tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:45:33.752538 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c9ef5ff0-ad1c-44d6-b50b-41455f24ce3c tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:45:33.753484 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c9ef5ff0-ad1c-44d6-b50b-41455f24ce3c tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:45:33.753949 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c9ef5ff0-ad1c-44d6-b50b-41455f24ce3c tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:45:33.886634 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-c9ef5ff0-ad1c-44d6-b50b-41455f24ce3c tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:45:33.894915 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c9ef5ff0-ad1c-44d6-b50b-41455f24ce3c tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/024e2ad3-f1f5-4797-9972-d48d8080ec8a" status: 200 len: 1676 microversion: 2.1 time: 0.155348 Jan 15 21:45:33.895510 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4004/8019] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:45:33 2022] GET /compute/v2.1/servers/024e2ad3-f1f5-4797-9972-d48d8080ec8a => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:45:34.912278 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-565af086-dc74-4799-8694-3cf4c1ceb6cc tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:45:34.912895 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-565af086-dc74-4799-8694-3cf4c1ceb6cc tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 024e2ad3-f1f5-4797-9972-d48d8080ec8a] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:45:34.919605 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-565af086-dc74-4799-8694-3cf4c1ceb6cc tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:45:34.920051 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-565af086-dc74-4799-8694-3cf4c1ceb6cc tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:45:34.921615 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-565af086-dc74-4799-8694-3cf4c1ceb6cc tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:45:34.922045 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-565af086-dc74-4799-8694-3cf4c1ceb6cc tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:45:35.055773 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-565af086-dc74-4799-8694-3cf4c1ceb6cc tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:45:35.063711 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-565af086-dc74-4799-8694-3cf4c1ceb6cc tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/024e2ad3-f1f5-4797-9972-d48d8080ec8a" status: 200 len: 1676 microversion: 2.1 time: 0.155705 Jan 15 21:45:35.064285 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4016/8020] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:45:34 2022] GET /compute/v2.1/servers/024e2ad3-f1f5-4797-9972-d48d8080ec8a => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:45:36.080822 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-0c50e173-f5b1-4fa7-a402-a2905c305078 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:45:36.081449 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-0c50e173-f5b1-4fa7-a402-a2905c305078 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 024e2ad3-f1f5-4797-9972-d48d8080ec8a] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:45:36.088138 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0c50e173-f5b1-4fa7-a402-a2905c305078 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:45:36.088598 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0c50e173-f5b1-4fa7-a402-a2905c305078 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:45:36.089415 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0c50e173-f5b1-4fa7-a402-a2905c305078 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:45:36.089864 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0c50e173-f5b1-4fa7-a402-a2905c305078 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:45:36.220315 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-0c50e173-f5b1-4fa7-a402-a2905c305078 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:45:36.227678 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-0c50e173-f5b1-4fa7-a402-a2905c305078 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/024e2ad3-f1f5-4797-9972-d48d8080ec8a" status: 200 len: 1676 microversion: 2.1 time: 0.151118 Jan 15 21:45:36.228245 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4005/8021] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:45:36 2022] GET /compute/v2.1/servers/024e2ad3-f1f5-4797-9972-d48d8080ec8a => generated 1676 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:45:37.244754 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8f3e73c0-36f5-4a43-8e0a-6a59381e7f4d tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:45:37.245398 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-8f3e73c0-36f5-4a43-8e0a-6a59381e7f4d tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 024e2ad3-f1f5-4797-9972-d48d8080ec8a] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:45:37.252611 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8f3e73c0-36f5-4a43-8e0a-6a59381e7f4d tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:45:37.253094 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8f3e73c0-36f5-4a43-8e0a-6a59381e7f4d tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:45:37.253870 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8f3e73c0-36f5-4a43-8e0a-6a59381e7f4d tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:45:37.254307 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8f3e73c0-36f5-4a43-8e0a-6a59381e7f4d tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:45:37.388645 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-8f3e73c0-36f5-4a43-8e0a-6a59381e7f4d tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:45:37.396721 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-8f3e73c0-36f5-4a43-8e0a-6a59381e7f4d tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/024e2ad3-f1f5-4797-9972-d48d8080ec8a" status: 200 len: 1676 microversion: 2.1 time: 0.155673 Jan 15 21:45:37.397334 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4017/8022] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:45:37 2022] GET /compute/v2.1/servers/024e2ad3-f1f5-4797-9972-d48d8080ec8a => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:45:38.413494 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-fcf64c3a-d5c3-408b-a3b6-8601f2b1d186 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:45:38.414127 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-fcf64c3a-d5c3-408b-a3b6-8601f2b1d186 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 024e2ad3-f1f5-4797-9972-d48d8080ec8a] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:45:38.421179 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fcf64c3a-d5c3-408b-a3b6-8601f2b1d186 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:45:38.421904 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fcf64c3a-d5c3-408b-a3b6-8601f2b1d186 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:45:38.422718 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fcf64c3a-d5c3-408b-a3b6-8601f2b1d186 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:45:38.423178 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fcf64c3a-d5c3-408b-a3b6-8601f2b1d186 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:45:38.557760 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-fcf64c3a-d5c3-408b-a3b6-8601f2b1d186 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:45:38.565090 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-fcf64c3a-d5c3-408b-a3b6-8601f2b1d186 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/024e2ad3-f1f5-4797-9972-d48d8080ec8a" status: 200 len: 1676 microversion: 2.1 time: 0.155635 Jan 15 21:45:38.565667 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4006/8023] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:45:38 2022] GET /compute/v2.1/servers/024e2ad3-f1f5-4797-9972-d48d8080ec8a => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:45:39.581721 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ec889e4e-bf32-48dd-8c71-d9b05e08dda2 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:45:39.582300 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ec889e4e-bf32-48dd-8c71-d9b05e08dda2 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 024e2ad3-f1f5-4797-9972-d48d8080ec8a] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:45:39.589233 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ec889e4e-bf32-48dd-8c71-d9b05e08dda2 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:45:39.589677 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ec889e4e-bf32-48dd-8c71-d9b05e08dda2 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:45:39.590444 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ec889e4e-bf32-48dd-8c71-d9b05e08dda2 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:45:39.590910 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ec889e4e-bf32-48dd-8c71-d9b05e08dda2 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:45:39.721939 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-ec889e4e-bf32-48dd-8c71-d9b05e08dda2 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:45:39.729324 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ec889e4e-bf32-48dd-8c71-d9b05e08dda2 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/024e2ad3-f1f5-4797-9972-d48d8080ec8a" status: 200 len: 1676 microversion: 2.1 time: 0.151656 Jan 15 21:45:39.729910 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4018/8024] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:45:39 2022] GET /compute/v2.1/servers/024e2ad3-f1f5-4797-9972-d48d8080ec8a => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:45:40.747136 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-441b1f3a-c6d8-46f4-a45b-626a661d6639 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:45:40.747797 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-441b1f3a-c6d8-46f4-a45b-626a661d6639 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 024e2ad3-f1f5-4797-9972-d48d8080ec8a] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:45:40.755340 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-441b1f3a-c6d8-46f4-a45b-626a661d6639 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:45:40.755803 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-441b1f3a-c6d8-46f4-a45b-626a661d6639 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:45:40.756592 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-441b1f3a-c6d8-46f4-a45b-626a661d6639 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:45:40.757073 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-441b1f3a-c6d8-46f4-a45b-626a661d6639 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:45:40.890899 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-441b1f3a-c6d8-46f4-a45b-626a661d6639 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:45:40.898276 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-441b1f3a-c6d8-46f4-a45b-626a661d6639 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/024e2ad3-f1f5-4797-9972-d48d8080ec8a" status: 200 len: 1676 microversion: 2.1 time: 0.154933 Jan 15 21:45:40.898851 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4007/8025] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:45:40 2022] GET /compute/v2.1/servers/024e2ad3-f1f5-4797-9972-d48d8080ec8a => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:45:41.916161 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-112817f1-3f00-4dcd-b350-f30a7375fb21 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:45:41.916790 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-112817f1-3f00-4dcd-b350-f30a7375fb21 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 024e2ad3-f1f5-4797-9972-d48d8080ec8a] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:45:41.923864 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-112817f1-3f00-4dcd-b350-f30a7375fb21 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:45:41.924322 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-112817f1-3f00-4dcd-b350-f30a7375fb21 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:45:41.925158 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-112817f1-3f00-4dcd-b350-f30a7375fb21 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:45:41.925586 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-112817f1-3f00-4dcd-b350-f30a7375fb21 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:45:42.057454 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-112817f1-3f00-4dcd-b350-f30a7375fb21 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:45:42.065546 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-112817f1-3f00-4dcd-b350-f30a7375fb21 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/024e2ad3-f1f5-4797-9972-d48d8080ec8a" status: 200 len: 1676 microversion: 2.1 time: 0.153156 Jan 15 21:45:42.066127 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4019/8026] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:45:41 2022] GET /compute/v2.1/servers/024e2ad3-f1f5-4797-9972-d48d8080ec8a => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:45:43.083269 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-11033f6d-e7fb-4bd3-93e5-7b2c1e40d8b5 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:45:43.083900 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-11033f6d-e7fb-4bd3-93e5-7b2c1e40d8b5 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 024e2ad3-f1f5-4797-9972-d48d8080ec8a] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:45:43.090715 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-11033f6d-e7fb-4bd3-93e5-7b2c1e40d8b5 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:45:43.091188 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-11033f6d-e7fb-4bd3-93e5-7b2c1e40d8b5 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:45:43.091996 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-11033f6d-e7fb-4bd3-93e5-7b2c1e40d8b5 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:45:43.092483 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-11033f6d-e7fb-4bd3-93e5-7b2c1e40d8b5 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:45:43.223903 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-11033f6d-e7fb-4bd3-93e5-7b2c1e40d8b5 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:45:43.231417 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-11033f6d-e7fb-4bd3-93e5-7b2c1e40d8b5 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/024e2ad3-f1f5-4797-9972-d48d8080ec8a" status: 200 len: 1679 microversion: 2.1 time: 0.151945 Jan 15 21:45:43.231990 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4008/8027] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:45:43 2022] GET /compute/v2.1/servers/024e2ad3-f1f5-4797-9972-d48d8080ec8a => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:46:09.424132 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-fe712266-1a21-4fc9-9d8b-9cf21871477d tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:46:09.425089 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-fe712266-1a21-4fc9-9d8b-9cf21871477d tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 024e2ad3-f1f5-4797-9972-d48d8080ec8a] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:46:09.431160 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fe712266-1a21-4fc9-9d8b-9cf21871477d tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:46:09.431608 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fe712266-1a21-4fc9-9d8b-9cf21871477d tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:46:09.432393 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fe712266-1a21-4fc9-9d8b-9cf21871477d tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:46:09.432826 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fe712266-1a21-4fc9-9d8b-9cf21871477d tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:46:09.487948 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-fe712266-1a21-4fc9-9d8b-9cf21871477d tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "POST /compute/v2.1/servers/024e2ad3-f1f5-4797-9972-d48d8080ec8a/action" status: 200 len: 69082 microversion: 2.1 time: 0.068703 Jan 15 21:46:09.488598 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4020/8028] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:46:09 2022] POST /compute/v2.1/servers/024e2ad3-f1f5-4797-9972-d48d8080ec8a/action => generated 69082 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:46:16.548396 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e1ae5840-bd3f-4dc5-8e3e-7e3788c9333d tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:46:16.549060 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e1ae5840-bd3f-4dc5-8e3e-7e3788c9333d tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 024e2ad3-f1f5-4797-9972-d48d8080ec8a] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:46:16.552178 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-fff5bc4e-3b7d-4783-8ef3-8e5f50d107f4 req-8939b4cc-9ee7-48e4-9fa1-89b9476abc8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "024e2ad3-f1f5-4797-9972-d48d8080ec8a", "tag": "9c58511b-30b1-4ca9-8b42-a55c342b60b6"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:46:16.553930 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:46:16.553930 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:46:16.555899 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e1ae5840-bd3f-4dc5-8e3e-7e3788c9333d tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:46:16.556359 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e1ae5840-bd3f-4dc5-8e3e-7e3788c9333d tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:46:16.557381 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e1ae5840-bd3f-4dc5-8e3e-7e3788c9333d tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:46:16.557998 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e1ae5840-bd3f-4dc5-8e3e-7e3788c9333d tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:46:16.561981 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-fff5bc4e-3b7d-4783-8ef3-8e5f50d107f4 req-8939b4cc-9ee7-48e4-9fa1-89b9476abc8b service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:46:16.562501 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-fff5bc4e-3b7d-4783-8ef3-8e5f50d107f4 req-8939b4cc-9ee7-48e4-9fa1-89b9476abc8b service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:46:16.574631 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-fff5bc4e-3b7d-4783-8ef3-8e5f50d107f4 req-8939b4cc-9ee7-48e4-9fa1-89b9476abc8b service nova] Creating event network-changed:9c58511b-30b1-4ca9-8b42-a55c342b60b6 for instance 024e2ad3-f1f5-4797-9972-d48d8080ec8a on nch2-master-1 Jan 15 21:46:16.580302 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-fff5bc4e-3b7d-4783-8ef3-8e5f50d107f4 req-8939b4cc-9ee7-48e4-9fa1-89b9476abc8b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032477 Jan 15 21:46:16.581223 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4021/8029] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:46:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:46:16.586180 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e1ae5840-bd3f-4dc5-8e3e-7e3788c9333d tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 024e2ad3-f1f5-4797-9972-d48d8080ec8a] Going to try to terminate instance {{(pid=129365) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 21:46:16.674049 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e1ae5840-bd3f-4dc5-8e3e-7e3788c9333d tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "DELETE /compute/v2.1/servers/024e2ad3-f1f5-4797-9972-d48d8080ec8a" status: 204 len: 0 microversion: 2.1 time: 0.129343 Jan 15 21:46:16.674954 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4009/8030] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 21:46:16 2022] DELETE /compute/v2.1/servers/024e2ad3-f1f5-4797-9972-d48d8080ec8a => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 21:46:16.684286 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-bd1b39ac-726c-475f-be52-0af985384f36 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:46:16.685027 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-bd1b39ac-726c-475f-be52-0af985384f36 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 024e2ad3-f1f5-4797-9972-d48d8080ec8a] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:46:16.691254 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bd1b39ac-726c-475f-be52-0af985384f36 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:46:16.691732 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bd1b39ac-726c-475f-be52-0af985384f36 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:46:16.692734 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bd1b39ac-726c-475f-be52-0af985384f36 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:46:16.693196 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bd1b39ac-726c-475f-be52-0af985384f36 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:46:16.846444 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-bd1b39ac-726c-475f-be52-0af985384f36 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:46:16.855639 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-bd1b39ac-726c-475f-be52-0af985384f36 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/024e2ad3-f1f5-4797-9972-d48d8080ec8a" status: 200 len: 1685 microversion: 2.1 time: 0.176033 Jan 15 21:46:16.856748 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4022/8031] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:46:16 2022] GET /compute/v2.1/servers/024e2ad3-f1f5-4797-9972-d48d8080ec8a => generated 1685 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:46:17.873997 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-6f05e99e-1a03-4a3b-bb43-c8e04a5c7373 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:46:17.874806 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-6f05e99e-1a03-4a3b-bb43-c8e04a5c7373 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 024e2ad3-f1f5-4797-9972-d48d8080ec8a] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:46:17.881688 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6f05e99e-1a03-4a3b-bb43-c8e04a5c7373 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:46:17.882157 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6f05e99e-1a03-4a3b-bb43-c8e04a5c7373 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:46:17.882954 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6f05e99e-1a03-4a3b-bb43-c8e04a5c7373 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:46:17.883410 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-6f05e99e-1a03-4a3b-bb43-c8e04a5c7373 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:46:18.017687 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-6f05e99e-1a03-4a3b-bb43-c8e04a5c7373 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:46:18.025399 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-6f05e99e-1a03-4a3b-bb43-c8e04a5c7373 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/024e2ad3-f1f5-4797-9972-d48d8080ec8a" status: 200 len: 1566 microversion: 2.1 time: 0.155309 Jan 15 21:46:18.025995 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4010/8032] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:46:17 2022] GET /compute/v2.1/servers/024e2ad3-f1f5-4797-9972-d48d8080ec8a => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:46:19.044551 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f4437477-a3c4-4198-a854-a7bbc9f4083e tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:46:19.045264 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f4437477-a3c4-4198-a854-a7bbc9f4083e tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 024e2ad3-f1f5-4797-9972-d48d8080ec8a] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:46:19.052943 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f4437477-a3c4-4198-a854-a7bbc9f4083e tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:46:19.053613 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f4437477-a3c4-4198-a854-a7bbc9f4083e tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:46:19.054430 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f4437477-a3c4-4198-a854-a7bbc9f4083e tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:46:19.054906 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f4437477-a3c4-4198-a854-a7bbc9f4083e tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:46:19.124256 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-f4437477-a3c4-4198-a854-a7bbc9f4083e tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:46:19.132481 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f4437477-a3c4-4198-a854-a7bbc9f4083e tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/024e2ad3-f1f5-4797-9972-d48d8080ec8a" status: 200 len: 1500 microversion: 2.1 time: 0.091937 Jan 15 21:46:19.133091 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4023/8033] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:46:19 2022] GET /compute/v2.1/servers/024e2ad3-f1f5-4797-9972-d48d8080ec8a => generated 1500 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:46:19.157716 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-97ca1268-dc97-490b-b463-c8fdb9f9db15 req-a870072d-6444-4abe-890f-97f5dd6100da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "024e2ad3-f1f5-4797-9972-d48d8080ec8a", "name": "network-vif-deleted", "tag": "9c58511b-30b1-4ca9-8b42-a55c342b60b6"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:46:19.159462 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:46:19.159462 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:46:19.168274 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-97ca1268-dc97-490b-b463-c8fdb9f9db15 req-a870072d-6444-4abe-890f-97f5dd6100da service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:46:19.168800 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-97ca1268-dc97-490b-b463-c8fdb9f9db15 req-a870072d-6444-4abe-890f-97f5dd6100da service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:46:19.180851 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-97ca1268-dc97-490b-b463-c8fdb9f9db15 req-a870072d-6444-4abe-890f-97f5dd6100da service nova] Creating event network-vif-deleted:9c58511b-30b1-4ca9-8b42-a55c342b60b6 for instance 024e2ad3-f1f5-4797-9972-d48d8080ec8a on nch2-master-1 Jan 15 21:46:19.186271 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-97ca1268-dc97-490b-b463-c8fdb9f9db15 req-a870072d-6444-4abe-890f-97f5dd6100da service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032869 Jan 15 21:46:19.186965 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4011/8034] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:46:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:46:20.149714 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-422748d2-be16-49d9-90f8-6103d63802ec tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:46:20.150321 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-422748d2-be16-49d9-90f8-6103d63802ec tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 024e2ad3-f1f5-4797-9972-d48d8080ec8a] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:46:20.158125 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-422748d2-be16-49d9-90f8-6103d63802ec tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:46:20.158577 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-422748d2-be16-49d9-90f8-6103d63802ec tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:46:20.159360 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-422748d2-be16-49d9-90f8-6103d63802ec tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:46:20.159798 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-422748d2-be16-49d9-90f8-6103d63802ec tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:46:20.174413 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-422748d2-be16-49d9-90f8-6103d63802ec tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] HTTP exception thrown: Instance 024e2ad3-f1f5-4797-9972-d48d8080ec8a could not be found. Jan 15 21:46:20.175032 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-422748d2-be16-49d9-90f8-6103d63802ec tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Returning 404 to user: Instance 024e2ad3-f1f5-4797-9972-d48d8080ec8a could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:46:20.175840 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-422748d2-be16-49d9-90f8-6103d63802ec tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/024e2ad3-f1f5-4797-9972-d48d8080ec8a" status: 404 len: 111 microversion: 2.1 time: 0.029937 Jan 15 21:46:20.176372 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4024/8035] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:46:20 2022] GET /compute/v2.1/servers/024e2ad3-f1f5-4797-9972-d48d8080ec8a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:46:23.503644 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-805298d3-a5f0-4798-9cd6-bedec56fb32a tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '.version_select at 0x7f30c8fde3a0>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:46:23.524397 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-805298d3-a5f0-4798-9cd6-bedec56fb32a tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-772309117" status: 202 len: 0 microversion: 2.1 time: 0.026433 Jan 15 21:46:23.525422 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4012/8036] 10.222.0.46 () {58 vars in 1280 bytes} [Sat Jan 15 21:46:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-772309117 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:46:23.548723 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-42eb3b1a-b3fc-4aaf-9846-c5609f42cb41 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Action: 'create', calling method: .version_select at 0x7f30c8f40430>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-464193665"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:46:23.564488 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-42eb3b1a-b3fc-4aaf-9846-c5609f42cb41 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Getting quotas for project 5f21548044704a2bbfc4ed1612c66fbc. Resources: {'key_pairs'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:46:23.570700 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-42eb3b1a-b3fc-4aaf-9846-c5609f42cb41 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Getting quotas for user 9dd93f3b669e4901b2a805ce60ca057e and project 5f21548044704a2bbfc4ed1612c66fbc. Resources: {'key_pairs'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:46:23.693093 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-42eb3b1a-b3fc-4aaf-9846-c5609f42cb41 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Getting quotas for project 5f21548044704a2bbfc4ed1612c66fbc. Resources: {'key_pairs'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:46:23.698267 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-42eb3b1a-b3fc-4aaf-9846-c5609f42cb41 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Getting quotas for user 9dd93f3b669e4901b2a805ce60ca057e and project 5f21548044704a2bbfc4ed1612c66fbc. Resources: {'key_pairs'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:46:23.713975 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-42eb3b1a-b3fc-4aaf-9846-c5609f42cb41 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 2321 microversion: 2.1 time: 0.169378 Jan 15 21:46:23.714585 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4025/8037] 10.222.0.46 () {60 vars in 1157 bytes} [Sat Jan 15 21:46:23 2022] POST /compute/v2.1/os-keypairs => generated 2321 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:46:29.605001 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-7c03c36b-3b5b-451e-9a55-9ac9f67fc196 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-278807528", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "networks": [{"uuid": "5082283f-3c8b-4364-a390-e19158b4e3b5"}], "key_name": "tempest-TestNetworkAdvancedServerOps-464193665", "security_groups": [{"name": "tempest-secgroup-smoke-1505276896"}]}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:46:29.750146 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.network.neutron [None req-7c03c36b-3b5b-451e-9a55-9ac9f67fc196 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] validate_networks() for [('5082283f-3c8b-4364-a390-e19158b4e3b5', None, None, None, None, None)] {{(pid=129365) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 21:46:30.280494 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-7c03c36b-3b5b-451e-9a55-9ac9f67fc196 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Flavor limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 21:46:30.281275 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-7c03c36b-3b5b-451e-9a55-9ac9f67fc196 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Image limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 21:46:30.281766 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-7c03c36b-3b5b-451e-9a55-9ac9f67fc196 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Flavor pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 21:46:30.282186 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-7c03c36b-3b5b-451e-9a55-9ac9f67fc196 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Image pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 21:46:30.282845 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-7c03c36b-3b5b-451e-9a55-9ac9f67fc196 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 21:46:30.294004 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7c03c36b-3b5b-451e-9a55-9ac9f67fc196 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:46:30.294754 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7c03c36b-3b5b-451e-9a55-9ac9f67fc196 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:46:30.295837 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7c03c36b-3b5b-451e-9a55-9ac9f67fc196 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:46:30.296637 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7c03c36b-3b5b-451e-9a55-9ac9f67fc196 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:46:30.316523 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-7c03c36b-3b5b-451e-9a55-9ac9f67fc196 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Getting quotas for project 5f21548044704a2bbfc4ed1612c66fbc. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:46:30.321967 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-7c03c36b-3b5b-451e-9a55-9ac9f67fc196 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Getting quotas for user 9dd93f3b669e4901b2a805ce60ca057e and project 5f21548044704a2bbfc4ed1612c66fbc. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:46:30.335722 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-7c03c36b-3b5b-451e-9a55-9ac9f67fc196 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Going to run 1 instances... {{(pid=129365) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 21:46:30.338520 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-7c03c36b-3b5b-451e-9a55-9ac9f67fc196 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 26b0c340-0fd1-464b-89a0-32ffd4586c42] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129365) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 21:46:30.398386 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-7c03c36b-3b5b-451e-9a55-9ac9f67fc196 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.800190 Jan 15 21:46:30.399049 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4013/8038] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 21:46:29 2022] POST /compute/v2.1/servers => generated 406 bytes in 802 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 21:46:30.409987 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-53771dfa-6b4b-41a5-b51f-376b7f6bf92b tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:46:30.410608 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-53771dfa-6b4b-41a5-b51f-376b7f6bf92b tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 26b0c340-0fd1-464b-89a0-32ffd4586c42] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:46:30.554715 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-53771dfa-6b4b-41a5-b51f-376b7f6bf92b tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:46:30.562315 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-53771dfa-6b4b-41a5-b51f-376b7f6bf92b tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/26b0c340-0fd1-464b-89a0-32ffd4586c42" status: 200 len: 1265 microversion: 2.1 time: 0.156500 Jan 15 21:46:30.563226 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4026/8039] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:46:30 2022] GET /compute/v2.1/servers/26b0c340-0fd1-464b-89a0-32ffd4586c42 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:46:31.580911 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-93116347-c55e-4daf-beae-5263a6532ab6 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:46:31.581609 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-93116347-c55e-4daf-beae-5263a6532ab6 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 26b0c340-0fd1-464b-89a0-32ffd4586c42] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:46:31.590109 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-93116347-c55e-4daf-beae-5263a6532ab6 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:46:31.590960 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-93116347-c55e-4daf-beae-5263a6532ab6 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:46:31.592124 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-93116347-c55e-4daf-beae-5263a6532ab6 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:46:31.593371 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-93116347-c55e-4daf-beae-5263a6532ab6 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:46:31.758022 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-93116347-c55e-4daf-beae-5263a6532ab6 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:46:31.767737 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-93116347-c55e-4daf-beae-5263a6532ab6 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/26b0c340-0fd1-464b-89a0-32ffd4586c42" status: 200 len: 1323 microversion: 2.1 time: 0.192316 Jan 15 21:46:31.768647 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4014/8040] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:46:31 2022] GET /compute/v2.1/servers/26b0c340-0fd1-464b-89a0-32ffd4586c42 => generated 1323 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:46:32.785611 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1c6cac69-a067-47dc-b2b6-3fd656a30e4b tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:46:32.786472 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-1c6cac69-a067-47dc-b2b6-3fd656a30e4b tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 26b0c340-0fd1-464b-89a0-32ffd4586c42] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:46:32.804127 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1c6cac69-a067-47dc-b2b6-3fd656a30e4b tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:46:32.804644 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1c6cac69-a067-47dc-b2b6-3fd656a30e4b tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:46:32.805816 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1c6cac69-a067-47dc-b2b6-3fd656a30e4b tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:46:32.806264 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1c6cac69-a067-47dc-b2b6-3fd656a30e4b tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:46:32.958742 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-9b4d2310-9388-4d76-98fa-6e3211fb8927 req-f71a2eef-4b49-48fa-9df2-d6f96c492538 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26b0c340-0fd1-464b-89a0-32ffd4586c42", "tag": "f900af71-4c68-4032-81f3-9c78b98f2a65"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:46:32.960759 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:46:32.960759 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:46:32.973095 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-9b4d2310-9388-4d76-98fa-6e3211fb8927 req-f71a2eef-4b49-48fa-9df2-d6f96c492538 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:46:32.973856 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-9b4d2310-9388-4d76-98fa-6e3211fb8927 req-f71a2eef-4b49-48fa-9df2-d6f96c492538 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:46:32.979378 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-1c6cac69-a067-47dc-b2b6-3fd656a30e4b tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:46:32.987708 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-1c6cac69-a067-47dc-b2b6-3fd656a30e4b tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/26b0c340-0fd1-464b-89a0-32ffd4586c42" status: 200 len: 1391 microversion: 2.1 time: 0.205976 Jan 15 21:46:32.987908 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-9b4d2310-9388-4d76-98fa-6e3211fb8927 req-f71a2eef-4b49-48fa-9df2-d6f96c492538 service nova] Creating event network-changed:f900af71-4c68-4032-81f3-9c78b98f2a65 for instance 26b0c340-0fd1-464b-89a0-32ffd4586c42 on nch2-master-1 Jan 15 21:46:32.993050 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4027/8041] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:46:32 2022] GET /compute/v2.1/servers/26b0c340-0fd1-464b-89a0-32ffd4586c42 => generated 1391 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:46:32.994272 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-9b4d2310-9388-4d76-98fa-6e3211fb8927 req-f71a2eef-4b49-48fa-9df2-d6f96c492538 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041065 Jan 15 21:46:32.994873 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4015/8042] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:46:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:46:34.005165 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a43c938b-6d7c-4729-9221-30efa0b468aa tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:46:34.005702 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a43c938b-6d7c-4729-9221-30efa0b468aa tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 26b0c340-0fd1-464b-89a0-32ffd4586c42] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:46:34.012377 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a43c938b-6d7c-4729-9221-30efa0b468aa tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:46:34.012819 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a43c938b-6d7c-4729-9221-30efa0b468aa tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:46:34.013623 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a43c938b-6d7c-4729-9221-30efa0b468aa tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:46:34.014053 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a43c938b-6d7c-4729-9221-30efa0b468aa tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:46:34.230745 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-a43c938b-6d7c-4729-9221-30efa0b468aa tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:46:34.239001 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a43c938b-6d7c-4729-9221-30efa0b468aa tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/26b0c340-0fd1-464b-89a0-32ffd4586c42" status: 200 len: 1391 microversion: 2.1 time: 0.237564 Jan 15 21:46:34.239581 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4028/8043] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:46:34 2022] GET /compute/v2.1/servers/26b0c340-0fd1-464b-89a0-32ffd4586c42 => generated 1391 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:46:35.256480 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f13f717a-2e2f-4986-aa5b-a790231fb300 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:46:35.257238 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f13f717a-2e2f-4986-aa5b-a790231fb300 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 26b0c340-0fd1-464b-89a0-32ffd4586c42] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:46:35.264320 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f13f717a-2e2f-4986-aa5b-a790231fb300 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:46:35.265583 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f13f717a-2e2f-4986-aa5b-a790231fb300 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:46:35.266350 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f13f717a-2e2f-4986-aa5b-a790231fb300 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:46:35.266797 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f13f717a-2e2f-4986-aa5b-a790231fb300 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:46:35.484393 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-f13f717a-2e2f-4986-aa5b-a790231fb300 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:46:35.491888 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f13f717a-2e2f-4986-aa5b-a790231fb300 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/26b0c340-0fd1-464b-89a0-32ffd4586c42" status: 200 len: 1391 microversion: 2.1 time: 0.239459 Jan 15 21:46:35.492497 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4016/8044] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:46:35 2022] GET /compute/v2.1/servers/26b0c340-0fd1-464b-89a0-32ffd4586c42 => generated 1391 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:46:36.508774 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e3eb96e2-8c59-41c5-b9e8-9c0c938499a4 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:46:36.509403 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e3eb96e2-8c59-41c5-b9e8-9c0c938499a4 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 26b0c340-0fd1-464b-89a0-32ffd4586c42] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:46:36.517327 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e3eb96e2-8c59-41c5-b9e8-9c0c938499a4 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:46:36.517780 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e3eb96e2-8c59-41c5-b9e8-9c0c938499a4 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:46:36.518572 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e3eb96e2-8c59-41c5-b9e8-9c0c938499a4 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:46:36.519013 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e3eb96e2-8c59-41c5-b9e8-9c0c938499a4 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:46:36.652047 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-e3eb96e2-8c59-41c5-b9e8-9c0c938499a4 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:46:36.660296 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e3eb96e2-8c59-41c5-b9e8-9c0c938499a4 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/26b0c340-0fd1-464b-89a0-32ffd4586c42" status: 200 len: 1391 microversion: 2.1 time: 0.155218 Jan 15 21:46:36.660898 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4029/8045] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:46:36 2022] GET /compute/v2.1/servers/26b0c340-0fd1-464b-89a0-32ffd4586c42 => generated 1391 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:46:37.677368 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9f817198-0206-408e-8000-afbb3c978841 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:46:37.677970 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-9f817198-0206-408e-8000-afbb3c978841 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 26b0c340-0fd1-464b-89a0-32ffd4586c42] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:46:37.684765 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9f817198-0206-408e-8000-afbb3c978841 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:46:37.685254 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9f817198-0206-408e-8000-afbb3c978841 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:46:37.686067 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9f817198-0206-408e-8000-afbb3c978841 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:46:37.686781 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9f817198-0206-408e-8000-afbb3c978841 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:46:37.824270 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-9f817198-0206-408e-8000-afbb3c978841 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:46:37.831895 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-9f817198-0206-408e-8000-afbb3c978841 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/26b0c340-0fd1-464b-89a0-32ffd4586c42" status: 200 len: 1391 microversion: 2.1 time: 0.158271 Jan 15 21:46:37.832561 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4017/8046] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:46:37 2022] GET /compute/v2.1/servers/26b0c340-0fd1-464b-89a0-32ffd4586c42 => generated 1391 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:46:38.848980 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a532475b-cd19-4c77-9879-0d2ed4f5000d tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:46:38.849909 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a532475b-cd19-4c77-9879-0d2ed4f5000d tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 26b0c340-0fd1-464b-89a0-32ffd4586c42] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:46:38.856741 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a532475b-cd19-4c77-9879-0d2ed4f5000d tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:46:38.857227 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a532475b-cd19-4c77-9879-0d2ed4f5000d tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:46:38.858616 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a532475b-cd19-4c77-9879-0d2ed4f5000d tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:46:38.859104 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a532475b-cd19-4c77-9879-0d2ed4f5000d tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:46:38.992149 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-a532475b-cd19-4c77-9879-0d2ed4f5000d tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:46:39.003175 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a532475b-cd19-4c77-9879-0d2ed4f5000d tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/26b0c340-0fd1-464b-89a0-32ffd4586c42" status: 200 len: 1391 microversion: 2.1 time: 0.157938 Jan 15 21:46:39.012325 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4030/8047] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:46:38 2022] GET /compute/v2.1/servers/26b0c340-0fd1-464b-89a0-32ffd4586c42 => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:46:39.120609 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-9eae1149-8a5d-475e-ad04-7ddc393bfe51 req-54ccd649-e419-4a1c-b15d-c90d9bd97950 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26b0c340-0fd1-464b-89a0-32ffd4586c42", "name": "network-vif-plugged", "status": "completed", "tag": "f900af71-4c68-4032-81f3-9c78b98f2a65"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:46:39.122784 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:46:39.122784 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:46:39.130896 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-9eae1149-8a5d-475e-ad04-7ddc393bfe51 req-54ccd649-e419-4a1c-b15d-c90d9bd97950 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:46:39.131337 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-9eae1149-8a5d-475e-ad04-7ddc393bfe51 req-54ccd649-e419-4a1c-b15d-c90d9bd97950 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:46:39.142486 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-9eae1149-8a5d-475e-ad04-7ddc393bfe51 req-54ccd649-e419-4a1c-b15d-c90d9bd97950 service nova] Creating event network-vif-plugged:f900af71-4c68-4032-81f3-9c78b98f2a65 for instance 26b0c340-0fd1-464b-89a0-32ffd4586c42 on nch2-master-1 Jan 15 21:46:39.147257 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-9eae1149-8a5d-475e-ad04-7ddc393bfe51 req-54ccd649-e419-4a1c-b15d-c90d9bd97950 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030293 Jan 15 21:46:39.148014 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4018/8048] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:46:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:46:40.019325 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-bd3af357-80af-48c6-9222-766ece146980 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:46:40.019953 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-bd3af357-80af-48c6-9222-766ece146980 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 26b0c340-0fd1-464b-89a0-32ffd4586c42] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:46:40.026596 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bd3af357-80af-48c6-9222-766ece146980 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:46:40.027046 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bd3af357-80af-48c6-9222-766ece146980 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:46:40.027818 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bd3af357-80af-48c6-9222-766ece146980 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:46:40.028287 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bd3af357-80af-48c6-9222-766ece146980 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:46:40.159093 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-bd3af357-80af-48c6-9222-766ece146980 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:46:40.166925 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-bd3af357-80af-48c6-9222-766ece146980 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/26b0c340-0fd1-464b-89a0-32ffd4586c42" status: 200 len: 1391 microversion: 2.1 time: 0.151258 Jan 15 21:46:40.167556 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4031/8049] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:46:40 2022] GET /compute/v2.1/servers/26b0c340-0fd1-464b-89a0-32ffd4586c42 => generated 1391 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:46:41.185290 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e783054d-9b11-4c8d-b439-bd022eaab91f tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:46:41.186631 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e783054d-9b11-4c8d-b439-bd022eaab91f tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 26b0c340-0fd1-464b-89a0-32ffd4586c42] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:46:41.193151 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e783054d-9b11-4c8d-b439-bd022eaab91f tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:46:41.193613 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e783054d-9b11-4c8d-b439-bd022eaab91f tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:46:41.194398 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e783054d-9b11-4c8d-b439-bd022eaab91f tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:46:41.194842 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e783054d-9b11-4c8d-b439-bd022eaab91f tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:46:41.336863 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-e783054d-9b11-4c8d-b439-bd022eaab91f tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:46:41.345123 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e783054d-9b11-4c8d-b439-bd022eaab91f tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/26b0c340-0fd1-464b-89a0-32ffd4586c42" status: 200 len: 1564 microversion: 2.1 time: 0.164789 Jan 15 21:46:41.345717 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4019/8050] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:46:41 2022] GET /compute/v2.1/servers/26b0c340-0fd1-464b-89a0-32ffd4586c42 => generated 1564 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:46:41.361715 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-76a5b13f-7cdb-4d83-b99b-022ba29bcccc tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:46:41.362416 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-76a5b13f-7cdb-4d83-b99b-022ba29bcccc tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 26b0c340-0fd1-464b-89a0-32ffd4586c42] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:46:41.369085 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-76a5b13f-7cdb-4d83-b99b-022ba29bcccc tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:46:41.369533 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-76a5b13f-7cdb-4d83-b99b-022ba29bcccc tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:46:41.370304 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-76a5b13f-7cdb-4d83-b99b-022ba29bcccc tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:46:41.370740 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-76a5b13f-7cdb-4d83-b99b-022ba29bcccc tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:46:41.507071 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-76a5b13f-7cdb-4d83-b99b-022ba29bcccc tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:46:41.515607 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-76a5b13f-7cdb-4d83-b99b-022ba29bcccc tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/26b0c340-0fd1-464b-89a0-32ffd4586c42" status: 200 len: 1564 microversion: 2.1 time: 0.158299 Jan 15 21:46:41.516274 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4032/8051] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:46:41 2022] GET /compute/v2.1/servers/26b0c340-0fd1-464b-89a0-32ffd4586c42 => generated 1564 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:46:43.446488 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-11b1dbf9-6dcd-4f16-931d-ba739315dba9 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:46:43.447410 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-11b1dbf9-6dcd-4f16-931d-ba739315dba9 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 26b0c340-0fd1-464b-89a0-32ffd4586c42] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:46:43.455112 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-11b1dbf9-6dcd-4f16-931d-ba739315dba9 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:46:43.455736 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-9098d59a-e50a-4008-9561-ec3e69697ea8 req-d6b6009c-4daa-491f-ba70-a85aed10a904 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26b0c340-0fd1-464b-89a0-32ffd4586c42", "tag": "f900af71-4c68-4032-81f3-9c78b98f2a65"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:46:43.456422 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-11b1dbf9-6dcd-4f16-931d-ba739315dba9 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:46:43.457360 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:46:43.457360 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:46:43.457555 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-11b1dbf9-6dcd-4f16-931d-ba739315dba9 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:46:43.457899 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-11b1dbf9-6dcd-4f16-931d-ba739315dba9 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:46:43.465633 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-9098d59a-e50a-4008-9561-ec3e69697ea8 req-d6b6009c-4daa-491f-ba70-a85aed10a904 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:46:43.466356 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-9098d59a-e50a-4008-9561-ec3e69697ea8 req-d6b6009c-4daa-491f-ba70-a85aed10a904 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:46:43.481493 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-9098d59a-e50a-4008-9561-ec3e69697ea8 req-d6b6009c-4daa-491f-ba70-a85aed10a904 service nova] Creating event network-changed:f900af71-4c68-4032-81f3-9c78b98f2a65 for instance 26b0c340-0fd1-464b-89a0-32ffd4586c42 on nch2-master-1 Jan 15 21:46:43.487742 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-9098d59a-e50a-4008-9561-ec3e69697ea8 req-d6b6009c-4daa-491f-ba70-a85aed10a904 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035553 Jan 15 21:46:43.488370 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4033/8052] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:46:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:46:43.614537 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-11b1dbf9-6dcd-4f16-931d-ba739315dba9 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:46:43.622451 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-11b1dbf9-6dcd-4f16-931d-ba739315dba9 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/26b0c340-0fd1-464b-89a0-32ffd4586c42" status: 200 len: 1564 microversion: 2.1 time: 0.179812 Jan 15 21:46:43.624092 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4020/8053] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:46:43 2022] GET /compute/v2.1/servers/26b0c340-0fd1-464b-89a0-32ffd4586c42 => generated 1564 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:47:06.860630 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4ce87a3f-317a-4845-98fd-1d0e0d17341c tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:47:06.861671 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-4ce87a3f-317a-4845-98fd-1d0e0d17341c tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 26b0c340-0fd1-464b-89a0-32ffd4586c42] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:47:06.867984 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4ce87a3f-317a-4845-98fd-1d0e0d17341c tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:47:06.868437 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4ce87a3f-317a-4845-98fd-1d0e0d17341c tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:47:06.869256 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4ce87a3f-317a-4845-98fd-1d0e0d17341c tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:47:06.869698 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4ce87a3f-317a-4845-98fd-1d0e0d17341c tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:47:06.923807 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-4ce87a3f-317a-4845-98fd-1d0e0d17341c tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "POST /compute/v2.1/servers/26b0c340-0fd1-464b-89a0-32ffd4586c42/action" status: 200 len: 24567 microversion: 2.1 time: 0.068274 Jan 15 21:47:06.924435 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4034/8054] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:47:06 2022] POST /compute/v2.1/servers/26b0c340-0fd1-464b-89a0-32ffd4586c42/action => generated 24567 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 15 21:47:17.693963 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-01f93cc2-c885-4362-8169-607693b03aab tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:47:17.695096 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-01f93cc2-c885-4362-8169-607693b03aab tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 26b0c340-0fd1-464b-89a0-32ffd4586c42] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:47:17.701552 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-01f93cc2-c885-4362-8169-607693b03aab tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:47:17.702018 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-01f93cc2-c885-4362-8169-607693b03aab tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:47:17.702811 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-01f93cc2-c885-4362-8169-607693b03aab tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:47:17.703275 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-01f93cc2-c885-4362-8169-607693b03aab tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:47:17.730553 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-01f93cc2-c885-4362-8169-607693b03aab tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:47:17.737242 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-01f93cc2-c885-4362-8169-607693b03aab tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 26b0c340-0fd1-464b-89a0-32ffd4586c42] Old instance type m1.heat2, new instance type m1.heat {{(pid=129365) resize /opt/stack/nova/nova/compute/api.py:4097}} Jan 15 21:47:17.743437 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-01f93cc2-c885-4362-8169-607693b03aab tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Flavor limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 21:47:17.743870 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-01f93cc2-c885-4362-8169-607693b03aab tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Image limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 21:47:17.744349 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-01f93cc2-c885-4362-8169-607693b03aab tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Flavor pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 21:47:17.744766 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-01f93cc2-c885-4362-8169-607693b03aab tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Image pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 21:47:17.745210 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-01f93cc2-c885-4362-8169-607693b03aab tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 21:47:17.806291 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-01f93cc2-c885-4362-8169-607693b03aab tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "POST /compute/v2.1/servers/26b0c340-0fd1-464b-89a0-32ffd4586c42/action" status: 202 len: 0 microversion: 2.1 time: 0.116056 Jan 15 21:47:17.807104 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4021/8055] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:47:17 2022] POST /compute/v2.1/servers/26b0c340-0fd1-464b-89a0-32ffd4586c42/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:47:17.816158 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-66509343-8d78-49d2-a454-8ce9ca6a501b tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:47:17.816943 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-66509343-8d78-49d2-a454-8ce9ca6a501b tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 26b0c340-0fd1-464b-89a0-32ffd4586c42] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:47:17.823714 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-66509343-8d78-49d2-a454-8ce9ca6a501b tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:47:17.824190 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-66509343-8d78-49d2-a454-8ce9ca6a501b tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:47:17.825008 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-66509343-8d78-49d2-a454-8ce9ca6a501b tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:47:17.825443 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-66509343-8d78-49d2-a454-8ce9ca6a501b tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:47:17.965606 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-66509343-8d78-49d2-a454-8ce9ca6a501b tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:47:17.974810 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-66509343-8d78-49d2-a454-8ce9ca6a501b tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/26b0c340-0fd1-464b-89a0-32ffd4586c42" status: 200 len: 1692 microversion: 2.1 time: 0.163427 Jan 15 21:47:17.975396 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4035/8056] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:47:17 2022] GET /compute/v2.1/servers/26b0c340-0fd1-464b-89a0-32ffd4586c42 => generated 1692 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:47:18.992975 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-aaa998d0-e3a0-4a22-b4a6-c04270e08a56 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:47:18.993597 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-aaa998d0-e3a0-4a22-b4a6-c04270e08a56 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 26b0c340-0fd1-464b-89a0-32ffd4586c42] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:47:18.999648 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-aaa998d0-e3a0-4a22-b4a6-c04270e08a56 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:47:19.000116 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-aaa998d0-e3a0-4a22-b4a6-c04270e08a56 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:47:19.000977 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-aaa998d0-e3a0-4a22-b4a6-c04270e08a56 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:47:19.001617 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-aaa998d0-e3a0-4a22-b4a6-c04270e08a56 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:47:19.138214 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-aaa998d0-e3a0-4a22-b4a6-c04270e08a56 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:47:19.146619 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-aaa998d0-e3a0-4a22-b4a6-c04270e08a56 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/26b0c340-0fd1-464b-89a0-32ffd4586c42" status: 200 len: 1692 microversion: 2.1 time: 0.158197 Jan 15 21:47:19.147204 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4022/8057] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:47:18 2022] GET /compute/v2.1/servers/26b0c340-0fd1-464b-89a0-32ffd4586c42 => generated 1692 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:47:20.163560 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d5a467bc-ffb5-4cab-b54a-2cf13be3a241 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:47:20.164167 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-d5a467bc-ffb5-4cab-b54a-2cf13be3a241 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 26b0c340-0fd1-464b-89a0-32ffd4586c42] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:47:20.170945 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d5a467bc-ffb5-4cab-b54a-2cf13be3a241 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:47:20.171393 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d5a467bc-ffb5-4cab-b54a-2cf13be3a241 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:47:20.172165 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d5a467bc-ffb5-4cab-b54a-2cf13be3a241 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:47:20.172599 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d5a467bc-ffb5-4cab-b54a-2cf13be3a241 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:47:20.303048 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-d5a467bc-ffb5-4cab-b54a-2cf13be3a241 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:47:20.310543 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d5a467bc-ffb5-4cab-b54a-2cf13be3a241 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/26b0c340-0fd1-464b-89a0-32ffd4586c42" status: 200 len: 1697 microversion: 2.1 time: 0.150819 Jan 15 21:47:20.311110 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4036/8058] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:47:20 2022] GET /compute/v2.1/servers/26b0c340-0fd1-464b-89a0-32ffd4586c42 => generated 1697 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:47:21.327618 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-93c09e15-9ac5-4e54-9913-22a28a15bc8a tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:47:21.328238 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-93c09e15-9ac5-4e54-9913-22a28a15bc8a tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 26b0c340-0fd1-464b-89a0-32ffd4586c42] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:47:21.335649 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-93c09e15-9ac5-4e54-9913-22a28a15bc8a tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:47:21.336112 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-93c09e15-9ac5-4e54-9913-22a28a15bc8a tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:47:21.336937 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-93c09e15-9ac5-4e54-9913-22a28a15bc8a tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:47:21.337387 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-93c09e15-9ac5-4e54-9913-22a28a15bc8a tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:47:21.476574 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-93c09e15-9ac5-4e54-9913-22a28a15bc8a tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:47:21.483998 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-93c09e15-9ac5-4e54-9913-22a28a15bc8a tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/26b0c340-0fd1-464b-89a0-32ffd4586c42" status: 200 len: 1697 microversion: 2.1 time: 0.160200 Jan 15 21:47:21.484577 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4023/8059] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:47:21 2022] GET /compute/v2.1/servers/26b0c340-0fd1-464b-89a0-32ffd4586c42 => generated 1697 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:47:22.500375 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b98bdcc6-ec23-49b3-9ba5-c3b5a883cdfc tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:47:22.501572 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b98bdcc6-ec23-49b3-9ba5-c3b5a883cdfc tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 26b0c340-0fd1-464b-89a0-32ffd4586c42] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:47:22.508242 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b98bdcc6-ec23-49b3-9ba5-c3b5a883cdfc tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:47:22.508687 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b98bdcc6-ec23-49b3-9ba5-c3b5a883cdfc tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:47:22.509487 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b98bdcc6-ec23-49b3-9ba5-c3b5a883cdfc tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:47:22.509920 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b98bdcc6-ec23-49b3-9ba5-c3b5a883cdfc tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:47:22.639838 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-b98bdcc6-ec23-49b3-9ba5-c3b5a883cdfc tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:47:22.647924 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b98bdcc6-ec23-49b3-9ba5-c3b5a883cdfc tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/26b0c340-0fd1-464b-89a0-32ffd4586c42" status: 200 len: 1697 microversion: 2.1 time: 0.151257 Jan 15 21:47:22.648497 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4037/8060] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:47:22 2022] GET /compute/v2.1/servers/26b0c340-0fd1-464b-89a0-32ffd4586c42 => generated 1697 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:47:23.665390 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d5ed7822-144b-458c-811b-01d2419a7ab9 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:47:23.666035 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d5ed7822-144b-458c-811b-01d2419a7ab9 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 26b0c340-0fd1-464b-89a0-32ffd4586c42] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:47:23.672932 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d5ed7822-144b-458c-811b-01d2419a7ab9 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:47:23.673405 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d5ed7822-144b-458c-811b-01d2419a7ab9 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:47:23.674193 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d5ed7822-144b-458c-811b-01d2419a7ab9 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:47:23.674640 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d5ed7822-144b-458c-811b-01d2419a7ab9 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:47:23.812529 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-d5ed7822-144b-458c-811b-01d2419a7ab9 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:47:23.819891 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d5ed7822-144b-458c-811b-01d2419a7ab9 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/26b0c340-0fd1-464b-89a0-32ffd4586c42" status: 200 len: 1697 microversion: 2.1 time: 0.158235 Jan 15 21:47:23.820463 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4024/8061] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:47:23 2022] GET /compute/v2.1/servers/26b0c340-0fd1-464b-89a0-32ffd4586c42 => generated 1697 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:47:24.836691 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-de35417e-1343-4f79-84d3-903df4a29bc5 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:47:24.837398 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-de35417e-1343-4f79-84d3-903df4a29bc5 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 26b0c340-0fd1-464b-89a0-32ffd4586c42] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:47:24.844154 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-de35417e-1343-4f79-84d3-903df4a29bc5 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:47:24.845374 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-de35417e-1343-4f79-84d3-903df4a29bc5 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:47:24.846154 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-de35417e-1343-4f79-84d3-903df4a29bc5 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:47:24.846587 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-de35417e-1343-4f79-84d3-903df4a29bc5 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:47:24.976503 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-de35417e-1343-4f79-84d3-903df4a29bc5 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:47:24.983823 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-de35417e-1343-4f79-84d3-903df4a29bc5 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/26b0c340-0fd1-464b-89a0-32ffd4586c42" status: 200 len: 1697 microversion: 2.1 time: 0.150917 Jan 15 21:47:24.984387 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4038/8062] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:47:24 2022] GET /compute/v2.1/servers/26b0c340-0fd1-464b-89a0-32ffd4586c42 => generated 1697 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:47:26.001998 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8e0f4dcf-aa6b-41c6-ad69-fbaca96fbd5e tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:47:26.002678 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-8e0f4dcf-aa6b-41c6-ad69-fbaca96fbd5e tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 26b0c340-0fd1-464b-89a0-32ffd4586c42] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:47:26.009528 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8e0f4dcf-aa6b-41c6-ad69-fbaca96fbd5e tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:47:26.010063 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8e0f4dcf-aa6b-41c6-ad69-fbaca96fbd5e tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:47:26.010860 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8e0f4dcf-aa6b-41c6-ad69-fbaca96fbd5e tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:47:26.011314 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8e0f4dcf-aa6b-41c6-ad69-fbaca96fbd5e tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:47:26.144736 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-8e0f4dcf-aa6b-41c6-ad69-fbaca96fbd5e tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:47:26.152305 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-8e0f4dcf-aa6b-41c6-ad69-fbaca96fbd5e tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/26b0c340-0fd1-464b-89a0-32ffd4586c42" status: 200 len: 1697 microversion: 2.1 time: 0.154557 Jan 15 21:47:26.153020 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4025/8063] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:47:25 2022] GET /compute/v2.1/servers/26b0c340-0fd1-464b-89a0-32ffd4586c42 => generated 1697 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:47:27.170336 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-40505984-0d6d-42fe-8cde-947491143961 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:47:27.170928 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-40505984-0d6d-42fe-8cde-947491143961 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 26b0c340-0fd1-464b-89a0-32ffd4586c42] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:47:27.178149 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-40505984-0d6d-42fe-8cde-947491143961 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:47:27.178642 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-40505984-0d6d-42fe-8cde-947491143961 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:47:27.179468 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-40505984-0d6d-42fe-8cde-947491143961 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:47:27.179914 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-40505984-0d6d-42fe-8cde-947491143961 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:47:27.316509 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-40505984-0d6d-42fe-8cde-947491143961 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:47:27.323878 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-40505984-0d6d-42fe-8cde-947491143961 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/26b0c340-0fd1-464b-89a0-32ffd4586c42" status: 200 len: 1697 microversion: 2.1 time: 0.157377 Jan 15 21:47:27.324456 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4039/8064] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:47:27 2022] GET /compute/v2.1/servers/26b0c340-0fd1-464b-89a0-32ffd4586c42 => generated 1697 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:47:28.341230 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-40056534-3929-4490-b601-c372cebd6cea tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:47:28.341851 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-40056534-3929-4490-b601-c372cebd6cea tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 26b0c340-0fd1-464b-89a0-32ffd4586c42] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:47:28.349493 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-40056534-3929-4490-b601-c372cebd6cea tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:47:28.349966 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-40056534-3929-4490-b601-c372cebd6cea tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:47:28.350771 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-40056534-3929-4490-b601-c372cebd6cea tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:47:28.351226 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-40056534-3929-4490-b601-c372cebd6cea tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:47:28.484061 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-40056534-3929-4490-b601-c372cebd6cea tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:47:28.491890 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-40056534-3929-4490-b601-c372cebd6cea tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/26b0c340-0fd1-464b-89a0-32ffd4586c42" status: 200 len: 1697 microversion: 2.1 time: 0.154368 Jan 15 21:47:28.492478 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4026/8065] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:47:28 2022] GET /compute/v2.1/servers/26b0c340-0fd1-464b-89a0-32ffd4586c42 => generated 1697 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:47:29.509288 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-cd690862-f934-4de1-bc95-fe45d7cff98a tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:47:29.509890 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-cd690862-f934-4de1-bc95-fe45d7cff98a tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 26b0c340-0fd1-464b-89a0-32ffd4586c42] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:47:29.517113 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cd690862-f934-4de1-bc95-fe45d7cff98a tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:47:29.517708 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cd690862-f934-4de1-bc95-fe45d7cff98a tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:47:29.518483 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cd690862-f934-4de1-bc95-fe45d7cff98a tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:47:29.518916 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-cd690862-f934-4de1-bc95-fe45d7cff98a tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:47:29.656430 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-cd690862-f934-4de1-bc95-fe45d7cff98a tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:47:29.665229 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-cd690862-f934-4de1-bc95-fe45d7cff98a tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/26b0c340-0fd1-464b-89a0-32ffd4586c42" status: 200 len: 1697 microversion: 2.1 time: 0.159649 Jan 15 21:47:29.665812 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4040/8066] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:47:29 2022] GET /compute/v2.1/servers/26b0c340-0fd1-464b-89a0-32ffd4586c42 => generated 1697 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:47:30.682691 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-90d73298-af12-4d64-8301-3ea7f17e7ac6 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:47:30.683317 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-90d73298-af12-4d64-8301-3ea7f17e7ac6 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 26b0c340-0fd1-464b-89a0-32ffd4586c42] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:47:30.690154 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-90d73298-af12-4d64-8301-3ea7f17e7ac6 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:47:30.690613 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-90d73298-af12-4d64-8301-3ea7f17e7ac6 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:47:30.691408 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-90d73298-af12-4d64-8301-3ea7f17e7ac6 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:47:30.691851 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-90d73298-af12-4d64-8301-3ea7f17e7ac6 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:47:30.825506 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-90d73298-af12-4d64-8301-3ea7f17e7ac6 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:47:30.832776 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-90d73298-af12-4d64-8301-3ea7f17e7ac6 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/26b0c340-0fd1-464b-89a0-32ffd4586c42" status: 200 len: 1697 microversion: 2.1 time: 0.153782 Jan 15 21:47:30.833379 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4027/8067] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:47:30 2022] GET /compute/v2.1/servers/26b0c340-0fd1-464b-89a0-32ffd4586c42 => generated 1697 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:47:31.849854 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8aed0be3-f5d8-40ac-873c-a9a42b7f4787 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:47:31.850438 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-8aed0be3-f5d8-40ac-873c-a9a42b7f4787 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 26b0c340-0fd1-464b-89a0-32ffd4586c42] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:47:31.857175 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8aed0be3-f5d8-40ac-873c-a9a42b7f4787 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:47:31.857618 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8aed0be3-f5d8-40ac-873c-a9a42b7f4787 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:47:31.858391 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8aed0be3-f5d8-40ac-873c-a9a42b7f4787 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:47:31.858832 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8aed0be3-f5d8-40ac-873c-a9a42b7f4787 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:47:31.992472 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-8aed0be3-f5d8-40ac-873c-a9a42b7f4787 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:47:31.999922 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-8aed0be3-f5d8-40ac-873c-a9a42b7f4787 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/26b0c340-0fd1-464b-89a0-32ffd4586c42" status: 200 len: 1697 microversion: 2.1 time: 0.153777 Jan 15 21:47:32.001112 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4041/8068] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:47:31 2022] GET /compute/v2.1/servers/26b0c340-0fd1-464b-89a0-32ffd4586c42 => generated 1697 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:47:33.018454 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-4e9f74d3-dc0f-4064-a935-ede9bcfe1a2c tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:47:33.019073 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-4e9f74d3-dc0f-4064-a935-ede9bcfe1a2c tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 26b0c340-0fd1-464b-89a0-32ffd4586c42] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:47:33.026085 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4e9f74d3-dc0f-4064-a935-ede9bcfe1a2c tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:47:33.026551 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4e9f74d3-dc0f-4064-a935-ede9bcfe1a2c tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:47:33.027347 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4e9f74d3-dc0f-4064-a935-ede9bcfe1a2c tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:47:33.027800 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4e9f74d3-dc0f-4064-a935-ede9bcfe1a2c tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:47:33.158878 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-4e9f74d3-dc0f-4064-a935-ede9bcfe1a2c tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:47:33.166498 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-4e9f74d3-dc0f-4064-a935-ede9bcfe1a2c tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/26b0c340-0fd1-464b-89a0-32ffd4586c42" status: 200 len: 1697 microversion: 2.1 time: 0.152541 Jan 15 21:47:33.167113 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4028/8069] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:47:33 2022] GET /compute/v2.1/servers/26b0c340-0fd1-464b-89a0-32ffd4586c42 => generated 1697 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:47:34.183468 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-53ee3cb3-b107-4584-8eaa-b45dc690dbfe tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:47:34.184080 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-53ee3cb3-b107-4584-8eaa-b45dc690dbfe tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 26b0c340-0fd1-464b-89a0-32ffd4586c42] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:47:34.191648 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-53ee3cb3-b107-4584-8eaa-b45dc690dbfe tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:47:34.192104 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-53ee3cb3-b107-4584-8eaa-b45dc690dbfe tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:47:34.192920 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-53ee3cb3-b107-4584-8eaa-b45dc690dbfe tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:47:34.193363 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-53ee3cb3-b107-4584-8eaa-b45dc690dbfe tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:47:34.322979 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-53ee3cb3-b107-4584-8eaa-b45dc690dbfe tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:47:34.330397 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-53ee3cb3-b107-4584-8eaa-b45dc690dbfe tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/26b0c340-0fd1-464b-89a0-32ffd4586c42" status: 200 len: 1697 microversion: 2.1 time: 0.150661 Jan 15 21:47:34.330987 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4042/8070] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:47:34 2022] GET /compute/v2.1/servers/26b0c340-0fd1-464b-89a0-32ffd4586c42 => generated 1697 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:47:35.347370 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a45870d2-218e-47b6-ab43-46128284a52c tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:47:35.348011 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a45870d2-218e-47b6-ab43-46128284a52c tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 26b0c340-0fd1-464b-89a0-32ffd4586c42] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:47:35.354928 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a45870d2-218e-47b6-ab43-46128284a52c tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:47:35.355387 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a45870d2-218e-47b6-ab43-46128284a52c tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:47:35.356181 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a45870d2-218e-47b6-ab43-46128284a52c tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:47:35.356628 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a45870d2-218e-47b6-ab43-46128284a52c tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:47:35.491170 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-a45870d2-218e-47b6-ab43-46128284a52c tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:47:35.498566 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a45870d2-218e-47b6-ab43-46128284a52c tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/26b0c340-0fd1-464b-89a0-32ffd4586c42" status: 200 len: 1697 microversion: 2.1 time: 0.155013 Jan 15 21:47:35.499139 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4029/8071] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:47:35 2022] GET /compute/v2.1/servers/26b0c340-0fd1-464b-89a0-32ffd4586c42 => generated 1697 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:47:36.516525 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-5e0c1fac-0869-46aa-889b-83cbfa7abb72 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:47:36.517338 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-5e0c1fac-0869-46aa-889b-83cbfa7abb72 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 26b0c340-0fd1-464b-89a0-32ffd4586c42] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:47:36.524081 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5e0c1fac-0869-46aa-889b-83cbfa7abb72 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:47:36.524534 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5e0c1fac-0869-46aa-889b-83cbfa7abb72 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:47:36.525346 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5e0c1fac-0869-46aa-889b-83cbfa7abb72 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:47:36.525814 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5e0c1fac-0869-46aa-889b-83cbfa7abb72 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:47:36.659384 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-5e0c1fac-0869-46aa-889b-83cbfa7abb72 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:47:36.667078 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-5e0c1fac-0869-46aa-889b-83cbfa7abb72 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/26b0c340-0fd1-464b-89a0-32ffd4586c42" status: 200 len: 1697 microversion: 2.1 time: 0.154849 Jan 15 21:47:36.667653 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4043/8072] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:47:36 2022] GET /compute/v2.1/servers/26b0c340-0fd1-464b-89a0-32ffd4586c42 => generated 1697 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:47:37.484691 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-319becb9-2af3-4e03-af99-bb965028ead0 req-05c2fc0a-c660-452d-a973-c8185121a22b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26b0c340-0fd1-464b-89a0-32ffd4586c42", "name": "network-vif-unplugged", "status": "completed", "tag": "f900af71-4c68-4032-81f3-9c78b98f2a65"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:47:37.487509 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:47:37.487509 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:47:37.499692 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-319becb9-2af3-4e03-af99-bb965028ead0 req-05c2fc0a-c660-452d-a973-c8185121a22b service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:47:37.500156 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-319becb9-2af3-4e03-af99-bb965028ead0 req-05c2fc0a-c660-452d-a973-c8185121a22b service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:47:37.516896 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-319becb9-2af3-4e03-af99-bb965028ead0 req-05c2fc0a-c660-452d-a973-c8185121a22b service nova] Creating event network-vif-unplugged:f900af71-4c68-4032-81f3-9c78b98f2a65 for instance 26b0c340-0fd1-464b-89a0-32ffd4586c42 on nch1-master-1 Jan 15 21:47:37.523014 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [req-319becb9-2af3-4e03-af99-bb965028ead0 req-05c2fc0a-c660-452d-a973-c8185121a22b service nova] Instance 26b0c340-0fd1-464b-89a0-32ffd4586c42 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=129365) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Jan 15 21:47:37.535890 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-319becb9-2af3-4e03-af99-bb965028ead0 req-05c2fc0a-c660-452d-a973-c8185121a22b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.116046 Jan 15 21:47:37.536519 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4030/8073] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:47:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:47:37.684662 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-86dd315e-1e97-4478-8d7d-c35d973c847c tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:47:37.685584 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-86dd315e-1e97-4478-8d7d-c35d973c847c tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 26b0c340-0fd1-464b-89a0-32ffd4586c42] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:47:37.692646 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-86dd315e-1e97-4478-8d7d-c35d973c847c tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:47:37.693079 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-86dd315e-1e97-4478-8d7d-c35d973c847c tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:47:37.693884 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-86dd315e-1e97-4478-8d7d-c35d973c847c tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:47:37.694328 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-86dd315e-1e97-4478-8d7d-c35d973c847c tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:47:37.843773 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-86dd315e-1e97-4478-8d7d-c35d973c847c tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:47:37.853707 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-86dd315e-1e97-4478-8d7d-c35d973c847c tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/26b0c340-0fd1-464b-89a0-32ffd4586c42" status: 200 len: 1696 microversion: 2.1 time: 0.172716 Jan 15 21:47:37.854964 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4044/8074] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:47:37 2022] GET /compute/v2.1/servers/26b0c340-0fd1-464b-89a0-32ffd4586c42 => generated 1696 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:47:38.872708 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9b2c8442-ad1d-4828-935e-2bbda6de603a tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:47:38.873447 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-9b2c8442-ad1d-4828-935e-2bbda6de603a tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 26b0c340-0fd1-464b-89a0-32ffd4586c42] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:47:38.880326 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9b2c8442-ad1d-4828-935e-2bbda6de603a tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:47:38.880783 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9b2c8442-ad1d-4828-935e-2bbda6de603a tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:47:38.881592 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9b2c8442-ad1d-4828-935e-2bbda6de603a tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:47:38.882043 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9b2c8442-ad1d-4828-935e-2bbda6de603a tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:47:39.034025 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-9b2c8442-ad1d-4828-935e-2bbda6de603a tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:47:39.042132 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-9b2c8442-ad1d-4828-935e-2bbda6de603a tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/26b0c340-0fd1-464b-89a0-32ffd4586c42" status: 200 len: 1694 microversion: 2.1 time: 0.174481 Jan 15 21:47:39.042847 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4031/8075] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:47:38 2022] GET /compute/v2.1/servers/26b0c340-0fd1-464b-89a0-32ffd4586c42 => generated 1694 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:47:39.580716 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-dcce9bb1-8ada-456f-adf1-165d081b9897 req-8308067d-b576-47f6-b4ef-0964dd15ba2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26b0c340-0fd1-464b-89a0-32ffd4586c42", "tag": "f900af71-4c68-4032-81f3-9c78b98f2a65"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:47:39.582346 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:47:39.582346 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:47:39.590173 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-dcce9bb1-8ada-456f-adf1-165d081b9897 req-8308067d-b576-47f6-b4ef-0964dd15ba2f service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:47:39.590621 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-dcce9bb1-8ada-456f-adf1-165d081b9897 req-8308067d-b576-47f6-b4ef-0964dd15ba2f service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:47:39.602004 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-dcce9bb1-8ada-456f-adf1-165d081b9897 req-8308067d-b576-47f6-b4ef-0964dd15ba2f service nova] Creating event network-changed:f900af71-4c68-4032-81f3-9c78b98f2a65 for instance 26b0c340-0fd1-464b-89a0-32ffd4586c42 on nch1-master-1 Jan 15 21:47:39.607321 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [req-dcce9bb1-8ada-456f-adf1-165d081b9897 req-8308067d-b576-47f6-b4ef-0964dd15ba2f service nova] Instance 26b0c340-0fd1-464b-89a0-32ffd4586c42 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=129366) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Jan 15 21:47:39.618733 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-dcce9bb1-8ada-456f-adf1-165d081b9897 req-8308067d-b576-47f6-b4ef-0964dd15ba2f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042243 Jan 15 21:47:39.619365 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4045/8076] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:47:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:47:40.060743 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-0ebaa97c-e469-4a8a-ba1c-0002ae01d334 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:47:40.061985 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-0ebaa97c-e469-4a8a-ba1c-0002ae01d334 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 26b0c340-0fd1-464b-89a0-32ffd4586c42] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:47:40.071005 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0ebaa97c-e469-4a8a-ba1c-0002ae01d334 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:47:40.072331 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0ebaa97c-e469-4a8a-ba1c-0002ae01d334 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:47:40.074068 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0ebaa97c-e469-4a8a-ba1c-0002ae01d334 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:47:40.075241 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0ebaa97c-e469-4a8a-ba1c-0002ae01d334 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:47:40.224419 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-0ebaa97c-e469-4a8a-ba1c-0002ae01d334 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:47:40.231957 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-0ebaa97c-e469-4a8a-ba1c-0002ae01d334 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/26b0c340-0fd1-464b-89a0-32ffd4586c42" status: 200 len: 1691 microversion: 2.1 time: 0.175009 Jan 15 21:47:40.232535 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4032/8077] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:47:40 2022] GET /compute/v2.1/servers/26b0c340-0fd1-464b-89a0-32ffd4586c42 => generated 1691 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:47:40.249656 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ac1bb131-b9b6-4232-a866-077877d9b45e tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:47:40.250483 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ac1bb131-b9b6-4232-a866-077877d9b45e tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 26b0c340-0fd1-464b-89a0-32ffd4586c42] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:47:40.256711 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ac1bb131-b9b6-4232-a866-077877d9b45e tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:47:40.257193 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ac1bb131-b9b6-4232-a866-077877d9b45e tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:47:40.257966 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ac1bb131-b9b6-4232-a866-077877d9b45e tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:47:40.258403 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ac1bb131-b9b6-4232-a866-077877d9b45e tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:47:40.319622 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ac1bb131-b9b6-4232-a866-077877d9b45e tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "POST /compute/v2.1/servers/26b0c340-0fd1-464b-89a0-32ffd4586c42/action" status: 204 len: 0 microversion: 2.1 time: 0.073895 Jan 15 21:47:40.320314 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4046/8078] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:47:40 2022] POST /compute/v2.1/servers/26b0c340-0fd1-464b-89a0-32ffd4586c42/action => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 21:47:40.328936 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-99289a61-0165-446e-bc12-949b5f189fa3 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:47:40.329924 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-99289a61-0165-446e-bc12-949b5f189fa3 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 26b0c340-0fd1-464b-89a0-32ffd4586c42] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:47:40.337370 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-99289a61-0165-446e-bc12-949b5f189fa3 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:47:40.338099 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-99289a61-0165-446e-bc12-949b5f189fa3 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:47:40.339145 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-99289a61-0165-446e-bc12-949b5f189fa3 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:47:40.340473 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-99289a61-0165-446e-bc12-949b5f189fa3 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:47:40.605241 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-99289a61-0165-446e-bc12-949b5f189fa3 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:47:40.615545 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-99289a61-0165-446e-bc12-949b5f189fa3 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/26b0c340-0fd1-464b-89a0-32ffd4586c42" status: 200 len: 1691 microversion: 2.1 time: 0.290857 Jan 15 21:47:40.616173 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4033/8079] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:47:40 2022] GET /compute/v2.1/servers/26b0c340-0fd1-464b-89a0-32ffd4586c42 => generated 1691 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:47:40.632530 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9bceb87f-13ef-47c6-bb15-9cd395784efe tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:47:40.633552 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-9bceb87f-13ef-47c6-bb15-9cd395784efe tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 26b0c340-0fd1-464b-89a0-32ffd4586c42] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:47:40.640467 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9bceb87f-13ef-47c6-bb15-9cd395784efe tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:47:40.641680 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9bceb87f-13ef-47c6-bb15-9cd395784efe tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:47:40.642576 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9bceb87f-13ef-47c6-bb15-9cd395784efe tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:47:40.643103 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9bceb87f-13ef-47c6-bb15-9cd395784efe tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:47:41.148722 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-9bceb87f-13ef-47c6-bb15-9cd395784efe tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:47:41.156292 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-9bceb87f-13ef-47c6-bb15-9cd395784efe tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/26b0c340-0fd1-464b-89a0-32ffd4586c42" status: 200 len: 1691 microversion: 2.1 time: 0.527803 Jan 15 21:47:41.157419 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4047/8080] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:47:40 2022] GET /compute/v2.1/servers/26b0c340-0fd1-464b-89a0-32ffd4586c42 => generated 1691 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:47:42.175016 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-21835038-e69f-43bc-89fe-eadc6f6f7b69 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:47:42.175739 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-21835038-e69f-43bc-89fe-eadc6f6f7b69 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 26b0c340-0fd1-464b-89a0-32ffd4586c42] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:47:42.178235 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-56537744-855b-4cfd-b058-fccb7d506971 req-c6625d5b-b324-475c-9bb3-82cd8d594128 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26b0c340-0fd1-464b-89a0-32ffd4586c42", "name": "network-vif-plugged", "status": "completed", "tag": "f900af71-4c68-4032-81f3-9c78b98f2a65"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:47:42.179774 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:47:42.179774 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:47:42.182866 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-21835038-e69f-43bc-89fe-eadc6f6f7b69 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:47:42.183522 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-21835038-e69f-43bc-89fe-eadc6f6f7b69 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:47:42.184323 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-21835038-e69f-43bc-89fe-eadc6f6f7b69 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:47:42.184769 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-21835038-e69f-43bc-89fe-eadc6f6f7b69 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:47:42.189986 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-56537744-855b-4cfd-b058-fccb7d506971 req-c6625d5b-b324-475c-9bb3-82cd8d594128 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:47:42.190452 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-56537744-855b-4cfd-b058-fccb7d506971 req-c6625d5b-b324-475c-9bb3-82cd8d594128 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:47:42.202535 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-56537744-855b-4cfd-b058-fccb7d506971 req-c6625d5b-b324-475c-9bb3-82cd8d594128 service nova] Creating event network-vif-plugged:f900af71-4c68-4032-81f3-9c78b98f2a65 for instance 26b0c340-0fd1-464b-89a0-32ffd4586c42 on nch1-master-1 Jan 15 21:47:42.208766 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-56537744-855b-4cfd-b058-fccb7d506971 req-c6625d5b-b324-475c-9bb3-82cd8d594128 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086938 Jan 15 21:47:42.209472 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4034/8081] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:47:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 21:47:42.332940 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-21835038-e69f-43bc-89fe-eadc6f6f7b69 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:47:42.340239 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-21835038-e69f-43bc-89fe-eadc6f6f7b69 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/26b0c340-0fd1-464b-89a0-32ffd4586c42" status: 200 len: 1683 microversion: 2.1 time: 0.169853 Jan 15 21:47:42.340816 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4048/8082] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:47:42 2022] GET /compute/v2.1/servers/26b0c340-0fd1-464b-89a0-32ffd4586c42 => generated 1683 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:48:04.522815 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-04451fc5-e04c-4acb-b829-72d3a7397f42 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:48:04.523868 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-04451fc5-e04c-4acb-b829-72d3a7397f42 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 26b0c340-0fd1-464b-89a0-32ffd4586c42] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:48:04.530134 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-04451fc5-e04c-4acb-b829-72d3a7397f42 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:48:04.530602 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-04451fc5-e04c-4acb-b829-72d3a7397f42 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:48:04.532052 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-04451fc5-e04c-4acb-b829-72d3a7397f42 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:48:04.532683 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-04451fc5-e04c-4acb-b829-72d3a7397f42 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:48:04.591999 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-04451fc5-e04c-4acb-b829-72d3a7397f42 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "POST /compute/v2.1/servers/26b0c340-0fd1-464b-89a0-32ffd4586c42/action" status: 200 len: 24576 microversion: 2.1 time: 0.073988 Jan 15 21:48:04.592632 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4035/8083] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:48:04 2022] POST /compute/v2.1/servers/26b0c340-0fd1-464b-89a0-32ffd4586c42/action => generated 24576 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:48:12.098888 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-3a9f5e9e-432e-426e-bb89-c1ce70e58af7 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:48:12.100011 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-3a9f5e9e-432e-426e-bb89-c1ce70e58af7 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 26b0c340-0fd1-464b-89a0-32ffd4586c42] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:48:12.102296 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-067376ff-e5d2-40de-a1e1-d5522f75bf69 req-805b5b56-b7d2-41d7-9a26-c13ca460957c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26b0c340-0fd1-464b-89a0-32ffd4586c42", "tag": "f900af71-4c68-4032-81f3-9c78b98f2a65"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:48:12.103925 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:48:12.103925 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:48:12.107007 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3a9f5e9e-432e-426e-bb89-c1ce70e58af7 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:48:12.107671 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3a9f5e9e-432e-426e-bb89-c1ce70e58af7 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:48:12.108392 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3a9f5e9e-432e-426e-bb89-c1ce70e58af7 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:48:12.108935 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3a9f5e9e-432e-426e-bb89-c1ce70e58af7 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:48:12.116242 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-067376ff-e5d2-40de-a1e1-d5522f75bf69 req-805b5b56-b7d2-41d7-9a26-c13ca460957c service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:48:12.116696 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-067376ff-e5d2-40de-a1e1-d5522f75bf69 req-805b5b56-b7d2-41d7-9a26-c13ca460957c service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:48:12.129947 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-067376ff-e5d2-40de-a1e1-d5522f75bf69 req-805b5b56-b7d2-41d7-9a26-c13ca460957c service nova] Creating event network-changed:f900af71-4c68-4032-81f3-9c78b98f2a65 for instance 26b0c340-0fd1-464b-89a0-32ffd4586c42 on nch1-master-1 Jan 15 21:48:12.134930 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-067376ff-e5d2-40de-a1e1-d5522f75bf69 req-805b5b56-b7d2-41d7-9a26-c13ca460957c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036633 Jan 15 21:48:12.135541 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4036/8084] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:48:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:48:12.138323 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-3a9f5e9e-432e-426e-bb89-c1ce70e58af7 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 26b0c340-0fd1-464b-89a0-32ffd4586c42] Going to try to terminate instance {{(pid=129366) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 21:48:12.232953 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-3a9f5e9e-432e-426e-bb89-c1ce70e58af7 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "DELETE /compute/v2.1/servers/26b0c340-0fd1-464b-89a0-32ffd4586c42" status: 204 len: 0 microversion: 2.1 time: 0.136832 Jan 15 21:48:12.234762 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4049/8085] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 21:48:12 2022] DELETE /compute/v2.1/servers/26b0c340-0fd1-464b-89a0-32ffd4586c42 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 21:48:12.244592 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b26b242d-7f36-4cbe-afdd-2dcccc740a44 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:48:12.246556 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b26b242d-7f36-4cbe-afdd-2dcccc740a44 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 26b0c340-0fd1-464b-89a0-32ffd4586c42] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:48:12.254136 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b26b242d-7f36-4cbe-afdd-2dcccc740a44 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:48:12.254608 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b26b242d-7f36-4cbe-afdd-2dcccc740a44 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:48:12.255458 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b26b242d-7f36-4cbe-afdd-2dcccc740a44 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:48:12.255917 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b26b242d-7f36-4cbe-afdd-2dcccc740a44 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:48:12.409367 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-b26b242d-7f36-4cbe-afdd-2dcccc740a44 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:48:12.417862 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b26b242d-7f36-4cbe-afdd-2dcccc740a44 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/26b0c340-0fd1-464b-89a0-32ffd4586c42" status: 200 len: 1689 microversion: 2.1 time: 0.178252 Jan 15 21:48:12.424903 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4037/8086] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:48:12 2022] GET /compute/v2.1/servers/26b0c340-0fd1-464b-89a0-32ffd4586c42 => generated 1689 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:48:13.438664 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d5efdd07-8266-4173-b8d9-e9e70b19650c tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:48:13.439360 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-d5efdd07-8266-4173-b8d9-e9e70b19650c tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 26b0c340-0fd1-464b-89a0-32ffd4586c42] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:48:13.446174 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d5efdd07-8266-4173-b8d9-e9e70b19650c tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:48:13.446624 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d5efdd07-8266-4173-b8d9-e9e70b19650c tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:48:13.447410 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d5efdd07-8266-4173-b8d9-e9e70b19650c tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:48:13.447852 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d5efdd07-8266-4173-b8d9-e9e70b19650c tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:48:13.585323 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-d5efdd07-8266-4173-b8d9-e9e70b19650c tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:48:13.592694 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d5efdd07-8266-4173-b8d9-e9e70b19650c tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/26b0c340-0fd1-464b-89a0-32ffd4586c42" status: 200 len: 1570 microversion: 2.1 time: 0.159199 Jan 15 21:48:13.593504 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4050/8087] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:48:13 2022] GET /compute/v2.1/servers/26b0c340-0fd1-464b-89a0-32ffd4586c42 => generated 1570 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:48:14.149842 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-070479f5-3247-4016-b444-9cd19f844d9e req-2bf487ab-678f-46fb-b875-aff5b5d00403 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26b0c340-0fd1-464b-89a0-32ffd4586c42", "name": "network-vif-deleted", "tag": "f900af71-4c68-4032-81f3-9c78b98f2a65"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:48:14.151694 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:48:14.151694 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:48:14.161538 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-070479f5-3247-4016-b444-9cd19f844d9e req-2bf487ab-678f-46fb-b875-aff5b5d00403 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:48:14.162000 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-070479f5-3247-4016-b444-9cd19f844d9e req-2bf487ab-678f-46fb-b875-aff5b5d00403 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:48:14.179899 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-070479f5-3247-4016-b444-9cd19f844d9e req-2bf487ab-678f-46fb-b875-aff5b5d00403 service nova] Creating event network-vif-deleted:f900af71-4c68-4032-81f3-9c78b98f2a65 for instance 26b0c340-0fd1-464b-89a0-32ffd4586c42 on nch1-master-1 Jan 15 21:48:14.186254 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-070479f5-3247-4016-b444-9cd19f844d9e req-2bf487ab-678f-46fb-b875-aff5b5d00403 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040038 Jan 15 21:48:14.186858 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4038/8088] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:48:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:48:14.611184 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c257b7b0-48f3-46d2-a815-3fe00bf74c03 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:48:14.611733 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c257b7b0-48f3-46d2-a815-3fe00bf74c03 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 26b0c340-0fd1-464b-89a0-32ffd4586c42] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:48:14.617795 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c257b7b0-48f3-46d2-a815-3fe00bf74c03 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:48:14.618243 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c257b7b0-48f3-46d2-a815-3fe00bf74c03 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:48:14.619021 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c257b7b0-48f3-46d2-a815-3fe00bf74c03 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:48:14.619469 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c257b7b0-48f3-46d2-a815-3fe00bf74c03 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:48:14.633025 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-c257b7b0-48f3-46d2-a815-3fe00bf74c03 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] HTTP exception thrown: Instance 26b0c340-0fd1-464b-89a0-32ffd4586c42 could not be found. Jan 15 21:48:14.633641 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c257b7b0-48f3-46d2-a815-3fe00bf74c03 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Returning 404 to user: Instance 26b0c340-0fd1-464b-89a0-32ffd4586c42 could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:48:14.634462 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c257b7b0-48f3-46d2-a815-3fe00bf74c03 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/26b0c340-0fd1-464b-89a0-32ffd4586c42" status: 404 len: 111 microversion: 2.1 time: 0.028116 Jan 15 21:48:14.635004 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4051/8089] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:48:14 2022] GET /compute/v2.1/servers/26b0c340-0fd1-464b-89a0-32ffd4586c42 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:48:17.990542 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ec90cbfb-c23e-4073-9de4-d74618c5611b tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '.version_select at 0x7f30ceb5edc0>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:48:18.011457 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ec90cbfb-c23e-4073-9de4-d74618c5611b tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-464193665" status: 202 len: 0 microversion: 2.1 time: 0.025239 Jan 15 21:48:18.017214 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4039/8090] 10.222.0.46 () {58 vars in 1280 bytes} [Sat Jan 15 21:48:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-464193665 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:48:18.040201 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1ed923fd-475b-4f89-bc04-a14324fe93ad tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Action: 'create', calling method: .version_select at 0x7f30c85c4820>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-240566726"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:48:18.061601 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-1ed923fd-475b-4f89-bc04-a14324fe93ad tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Getting quotas for project 5f21548044704a2bbfc4ed1612c66fbc. Resources: {'key_pairs'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:48:18.068266 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-1ed923fd-475b-4f89-bc04-a14324fe93ad tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Getting quotas for user 9dd93f3b669e4901b2a805ce60ca057e and project 5f21548044704a2bbfc4ed1612c66fbc. Resources: {'key_pairs'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:48:18.225682 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-1ed923fd-475b-4f89-bc04-a14324fe93ad tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Getting quotas for project 5f21548044704a2bbfc4ed1612c66fbc. Resources: {'key_pairs'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:48:18.230500 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-1ed923fd-475b-4f89-bc04-a14324fe93ad tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Getting quotas for user 9dd93f3b669e4901b2a805ce60ca057e and project 5f21548044704a2bbfc4ed1612c66fbc. Resources: {'key_pairs'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:48:18.245812 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-1ed923fd-475b-4f89-bc04-a14324fe93ad tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 2321 microversion: 2.1 time: 0.209325 Jan 15 21:48:18.246338 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4052/8091] 10.222.0.46 () {60 vars in 1157 bytes} [Sat Jan 15 21:48:18 2022] POST /compute/v2.1/os-keypairs => generated 2321 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:48:23.475865 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-1536c59c-3457-44bb-aafd-17c3cfec8814 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-893504361", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "networks": [{"uuid": "8181e61b-281d-44d3-9d87-ee9cad1f211e"}], "key_name": "tempest-TestNetworkAdvancedServerOps-240566726", "security_groups": [{"name": "tempest-secgroup-smoke-1952529906"}]}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:48:23.587716 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.network.neutron [None req-1536c59c-3457-44bb-aafd-17c3cfec8814 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] validate_networks() for [('8181e61b-281d-44d3-9d87-ee9cad1f211e', None, None, None, None, None)] {{(pid=129365) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 21:48:24.180815 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-1536c59c-3457-44bb-aafd-17c3cfec8814 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Flavor limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 21:48:24.181280 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-1536c59c-3457-44bb-aafd-17c3cfec8814 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Image limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 21:48:24.181804 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-1536c59c-3457-44bb-aafd-17c3cfec8814 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Flavor pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 21:48:24.182225 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-1536c59c-3457-44bb-aafd-17c3cfec8814 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Image pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 21:48:24.182955 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-1536c59c-3457-44bb-aafd-17c3cfec8814 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 21:48:24.197177 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1536c59c-3457-44bb-aafd-17c3cfec8814 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:48:24.198001 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1536c59c-3457-44bb-aafd-17c3cfec8814 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:48:24.198919 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1536c59c-3457-44bb-aafd-17c3cfec8814 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:48:24.199909 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1536c59c-3457-44bb-aafd-17c3cfec8814 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:48:24.222559 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-1536c59c-3457-44bb-aafd-17c3cfec8814 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Getting quotas for project 5f21548044704a2bbfc4ed1612c66fbc. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:48:24.228337 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-1536c59c-3457-44bb-aafd-17c3cfec8814 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Getting quotas for user 9dd93f3b669e4901b2a805ce60ca057e and project 5f21548044704a2bbfc4ed1612c66fbc. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:48:24.244644 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-1536c59c-3457-44bb-aafd-17c3cfec8814 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Going to run 1 instances... {{(pid=129365) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 21:48:24.247910 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-1536c59c-3457-44bb-aafd-17c3cfec8814 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 391031bf-162c-4701-a570-7cc7054aa3b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129365) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 21:48:24.300283 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-1536c59c-3457-44bb-aafd-17c3cfec8814 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.828917 Jan 15 21:48:24.301674 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4040/8092] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 21:48:23 2022] POST /compute/v2.1/servers => generated 406 bytes in 831 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 21:48:24.313940 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-5ca8b2d2-7016-4e6e-b1d0-d74e6d3242eb tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:48:24.314681 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-5ca8b2d2-7016-4e6e-b1d0-d74e6d3242eb tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 391031bf-162c-4701-a570-7cc7054aa3b5] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:48:24.402375 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-5ca8b2d2-7016-4e6e-b1d0-d74e6d3242eb tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:48:24.412454 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-5ca8b2d2-7016-4e6e-b1d0-d74e6d3242eb tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/391031bf-162c-4701-a570-7cc7054aa3b5" status: 200 len: 1265 microversion: 2.1 time: 0.104870 Jan 15 21:48:24.413311 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4053/8093] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:48:24 2022] GET /compute/v2.1/servers/391031bf-162c-4701-a570-7cc7054aa3b5 => generated 1265 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:48:25.431841 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-dc3658a4-a37f-4a64-9008-031f9536726c tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:48:25.433769 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-dc3658a4-a37f-4a64-9008-031f9536726c tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 391031bf-162c-4701-a570-7cc7054aa3b5] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:48:25.471423 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dc3658a4-a37f-4a64-9008-031f9536726c tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:48:25.472423 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dc3658a4-a37f-4a64-9008-031f9536726c tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:48:25.474584 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dc3658a4-a37f-4a64-9008-031f9536726c tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:48:25.477673 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dc3658a4-a37f-4a64-9008-031f9536726c tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:48:25.759449 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-dc3658a4-a37f-4a64-9008-031f9536726c tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:48:25.768137 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-dc3658a4-a37f-4a64-9008-031f9536726c tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/391031bf-162c-4701-a570-7cc7054aa3b5" status: 200 len: 1335 microversion: 2.1 time: 0.342080 Jan 15 21:48:25.769080 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4041/8094] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:48:25 2022] GET /compute/v2.1/servers/391031bf-162c-4701-a570-7cc7054aa3b5 => generated 1335 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:48:26.787043 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-bc5719d1-90b7-4977-a4dd-199a5f67bce4 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:48:26.788414 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-bc5719d1-90b7-4977-a4dd-199a5f67bce4 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 391031bf-162c-4701-a570-7cc7054aa3b5] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:48:26.795254 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bc5719d1-90b7-4977-a4dd-199a5f67bce4 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:48:26.795710 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bc5719d1-90b7-4977-a4dd-199a5f67bce4 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:48:26.796740 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bc5719d1-90b7-4977-a4dd-199a5f67bce4 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:48:26.797254 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bc5719d1-90b7-4977-a4dd-199a5f67bce4 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:48:27.023274 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-bc5719d1-90b7-4977-a4dd-199a5f67bce4 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:48:27.031075 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-bc5719d1-90b7-4977-a4dd-199a5f67bce4 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/391031bf-162c-4701-a570-7cc7054aa3b5" status: 200 len: 1391 microversion: 2.1 time: 0.249391 Jan 15 21:48:27.031961 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4054/8095] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:48:26 2022] GET /compute/v2.1/servers/391031bf-162c-4701-a570-7cc7054aa3b5 => generated 1391 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:48:27.452814 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-7af2e46e-d7ea-4ffb-9c7a-d2868074a266 req-d1eb47a0-27bc-4b90-b6c5-d333044af953 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "391031bf-162c-4701-a570-7cc7054aa3b5", "tag": "c15e8e1e-3b40-4089-953f-40f1386b3d5f"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:48:27.457769 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:48:27.457769 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:48:27.465832 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-7af2e46e-d7ea-4ffb-9c7a-d2868074a266 req-d1eb47a0-27bc-4b90-b6c5-d333044af953 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:48:27.466293 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-7af2e46e-d7ea-4ffb-9c7a-d2868074a266 req-d1eb47a0-27bc-4b90-b6c5-d333044af953 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:48:27.480036 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-7af2e46e-d7ea-4ffb-9c7a-d2868074a266 req-d1eb47a0-27bc-4b90-b6c5-d333044af953 service nova] Creating event network-changed:c15e8e1e-3b40-4089-953f-40f1386b3d5f for instance 391031bf-162c-4701-a570-7cc7054aa3b5 on nch2-master-1 Jan 15 21:48:27.485760 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-7af2e46e-d7ea-4ffb-9c7a-d2868074a266 req-d1eb47a0-27bc-4b90-b6c5-d333044af953 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095806 Jan 15 21:48:27.486392 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4042/8096] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:48:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:48:28.049711 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-04661a49-aa89-4cc0-b8a9-54874e8de9d2 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:48:28.050419 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-04661a49-aa89-4cc0-b8a9-54874e8de9d2 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 391031bf-162c-4701-a570-7cc7054aa3b5] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:48:28.057108 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-04661a49-aa89-4cc0-b8a9-54874e8de9d2 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:48:28.057555 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-04661a49-aa89-4cc0-b8a9-54874e8de9d2 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:48:28.058531 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-04661a49-aa89-4cc0-b8a9-54874e8de9d2 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:48:28.058970 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-04661a49-aa89-4cc0-b8a9-54874e8de9d2 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:48:28.275676 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-04661a49-aa89-4cc0-b8a9-54874e8de9d2 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:48:28.283062 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-04661a49-aa89-4cc0-b8a9-54874e8de9d2 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/391031bf-162c-4701-a570-7cc7054aa3b5" status: 200 len: 1391 microversion: 2.1 time: 0.238021 Jan 15 21:48:28.283641 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4055/8097] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:48:28 2022] GET /compute/v2.1/servers/391031bf-162c-4701-a570-7cc7054aa3b5 => generated 1391 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:48:29.301334 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-81d3bf28-2598-4750-966d-e8c2d6388761 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:48:29.302050 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-81d3bf28-2598-4750-966d-e8c2d6388761 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 391031bf-162c-4701-a570-7cc7054aa3b5] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:48:29.308329 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-81d3bf28-2598-4750-966d-e8c2d6388761 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:48:29.308797 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-81d3bf28-2598-4750-966d-e8c2d6388761 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:48:29.309616 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-81d3bf28-2598-4750-966d-e8c2d6388761 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:48:29.310074 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-81d3bf28-2598-4750-966d-e8c2d6388761 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:48:29.447957 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-81d3bf28-2598-4750-966d-e8c2d6388761 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:48:29.456161 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-81d3bf28-2598-4750-966d-e8c2d6388761 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/391031bf-162c-4701-a570-7cc7054aa3b5" status: 200 len: 1391 microversion: 2.1 time: 0.159803 Jan 15 21:48:29.456729 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4043/8098] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:48:29 2022] GET /compute/v2.1/servers/391031bf-162c-4701-a570-7cc7054aa3b5 => generated 1391 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:48:30.473610 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a3d369aa-a7da-4ab5-b53b-2b9745a5870c tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:48:30.474271 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a3d369aa-a7da-4ab5-b53b-2b9745a5870c tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 391031bf-162c-4701-a570-7cc7054aa3b5] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:48:30.480937 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a3d369aa-a7da-4ab5-b53b-2b9745a5870c tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:48:30.481391 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a3d369aa-a7da-4ab5-b53b-2b9745a5870c tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:48:30.482162 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a3d369aa-a7da-4ab5-b53b-2b9745a5870c tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:48:30.482596 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a3d369aa-a7da-4ab5-b53b-2b9745a5870c tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:48:30.613685 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-a3d369aa-a7da-4ab5-b53b-2b9745a5870c tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:48:30.621063 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a3d369aa-a7da-4ab5-b53b-2b9745a5870c tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/391031bf-162c-4701-a570-7cc7054aa3b5" status: 200 len: 1391 microversion: 2.1 time: 0.151809 Jan 15 21:48:30.621630 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4056/8099] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:48:30 2022] GET /compute/v2.1/servers/391031bf-162c-4701-a570-7cc7054aa3b5 => generated 1391 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:48:31.638580 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9b89fcf9-0110-4048-9236-ef6bffce8930 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:48:31.639147 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-9b89fcf9-0110-4048-9236-ef6bffce8930 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 391031bf-162c-4701-a570-7cc7054aa3b5] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:48:31.646305 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9b89fcf9-0110-4048-9236-ef6bffce8930 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:48:31.646775 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9b89fcf9-0110-4048-9236-ef6bffce8930 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:48:31.647607 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9b89fcf9-0110-4048-9236-ef6bffce8930 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:48:31.648066 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9b89fcf9-0110-4048-9236-ef6bffce8930 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:48:31.791536 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-9b89fcf9-0110-4048-9236-ef6bffce8930 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:48:31.799264 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-9b89fcf9-0110-4048-9236-ef6bffce8930 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/391031bf-162c-4701-a570-7cc7054aa3b5" status: 200 len: 1391 microversion: 2.1 time: 0.164402 Jan 15 21:48:31.799854 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4044/8100] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:48:31 2022] GET /compute/v2.1/servers/391031bf-162c-4701-a570-7cc7054aa3b5 => generated 1391 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:48:31.823825 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-04f32194-7b7b-4a21-9e4c-fa7005036c13 req-988e4f67-0249-4eab-a113-fed5633f8e65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "391031bf-162c-4701-a570-7cc7054aa3b5", "name": "network-vif-plugged", "status": "completed", "tag": "c15e8e1e-3b40-4089-953f-40f1386b3d5f"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:48:31.825378 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:48:31.825378 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:48:31.834771 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-04f32194-7b7b-4a21-9e4c-fa7005036c13 req-988e4f67-0249-4eab-a113-fed5633f8e65 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:48:31.835230 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-04f32194-7b7b-4a21-9e4c-fa7005036c13 req-988e4f67-0249-4eab-a113-fed5633f8e65 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:48:31.847028 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-04f32194-7b7b-4a21-9e4c-fa7005036c13 req-988e4f67-0249-4eab-a113-fed5633f8e65 service nova] Creating event network-vif-plugged:c15e8e1e-3b40-4089-953f-40f1386b3d5f for instance 391031bf-162c-4701-a570-7cc7054aa3b5 on nch2-master-1 Jan 15 21:48:31.852025 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-04f32194-7b7b-4a21-9e4c-fa7005036c13 req-988e4f67-0249-4eab-a113-fed5633f8e65 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031771 Jan 15 21:48:31.852636 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4057/8101] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:48:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 21:48:32.865875 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2fd54552-97ab-4915-858c-6652ef297f25 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:48:32.866494 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-2fd54552-97ab-4915-858c-6652ef297f25 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 391031bf-162c-4701-a570-7cc7054aa3b5] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:48:32.874627 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2fd54552-97ab-4915-858c-6652ef297f25 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:48:32.875091 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2fd54552-97ab-4915-858c-6652ef297f25 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:48:32.875874 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2fd54552-97ab-4915-858c-6652ef297f25 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:48:32.876350 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2fd54552-97ab-4915-858c-6652ef297f25 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:48:33.007318 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-2fd54552-97ab-4915-858c-6652ef297f25 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:48:33.014949 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2fd54552-97ab-4915-858c-6652ef297f25 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/391031bf-162c-4701-a570-7cc7054aa3b5" status: 200 len: 1391 microversion: 2.1 time: 0.202736 Jan 15 21:48:33.015466 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4045/8102] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:48:32 2022] GET /compute/v2.1/servers/391031bf-162c-4701-a570-7cc7054aa3b5 => generated 1391 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:48:34.033543 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-92da39d4-91f4-47fa-a0cc-341bc30d17f3 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:48:34.034236 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-92da39d4-91f4-47fa-a0cc-341bc30d17f3 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 391031bf-162c-4701-a570-7cc7054aa3b5] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:48:34.041511 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-92da39d4-91f4-47fa-a0cc-341bc30d17f3 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:48:34.041958 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-92da39d4-91f4-47fa-a0cc-341bc30d17f3 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:48:34.042727 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-92da39d4-91f4-47fa-a0cc-341bc30d17f3 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:48:34.043160 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-92da39d4-91f4-47fa-a0cc-341bc30d17f3 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:48:34.179979 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-92da39d4-91f4-47fa-a0cc-341bc30d17f3 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:48:34.187306 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-92da39d4-91f4-47fa-a0cc-341bc30d17f3 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/391031bf-162c-4701-a570-7cc7054aa3b5" status: 200 len: 1562 microversion: 2.1 time: 0.158581 Jan 15 21:48:34.187961 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4058/8103] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:48:34 2022] GET /compute/v2.1/servers/391031bf-162c-4701-a570-7cc7054aa3b5 => generated 1562 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:48:34.203438 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b724cf7f-8cf0-44cb-aaad-c927a67d838c tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:48:34.204051 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b724cf7f-8cf0-44cb-aaad-c927a67d838c tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 391031bf-162c-4701-a570-7cc7054aa3b5] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:48:34.211264 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b724cf7f-8cf0-44cb-aaad-c927a67d838c tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:48:34.211724 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b724cf7f-8cf0-44cb-aaad-c927a67d838c tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:48:34.212551 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b724cf7f-8cf0-44cb-aaad-c927a67d838c tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:48:34.213027 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b724cf7f-8cf0-44cb-aaad-c927a67d838c tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:48:34.344237 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-b724cf7f-8cf0-44cb-aaad-c927a67d838c tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:48:34.352434 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b724cf7f-8cf0-44cb-aaad-c927a67d838c tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/391031bf-162c-4701-a570-7cc7054aa3b5" status: 200 len: 1562 microversion: 2.1 time: 0.152632 Jan 15 21:48:34.353051 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4046/8104] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:48:34 2022] GET /compute/v2.1/servers/391031bf-162c-4701-a570-7cc7054aa3b5 => generated 1562 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:48:36.231212 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e285bb41-df82-4cf2-83b2-c5589c368c17 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:48:36.231826 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e285bb41-df82-4cf2-83b2-c5589c368c17 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 391031bf-162c-4701-a570-7cc7054aa3b5] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:48:36.238455 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-a193741f-1d6d-47b6-bf1e-41e17216d28e req-3b29ad4d-a7d2-400e-9f11-7ceef2a90e25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "391031bf-162c-4701-a570-7cc7054aa3b5", "tag": "c15e8e1e-3b40-4089-953f-40f1386b3d5f"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:48:36.240032 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:48:36.240032 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:48:36.246896 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e285bb41-df82-4cf2-83b2-c5589c368c17 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:48:36.247344 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e285bb41-df82-4cf2-83b2-c5589c368c17 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:48:36.248142 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e285bb41-df82-4cf2-83b2-c5589c368c17 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:48:36.248581 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e285bb41-df82-4cf2-83b2-c5589c368c17 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:48:36.249720 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-a193741f-1d6d-47b6-bf1e-41e17216d28e req-3b29ad4d-a7d2-400e-9f11-7ceef2a90e25 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:48:36.250288 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-a193741f-1d6d-47b6-bf1e-41e17216d28e req-3b29ad4d-a7d2-400e-9f11-7ceef2a90e25 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:48:36.265165 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-a193741f-1d6d-47b6-bf1e-41e17216d28e req-3b29ad4d-a7d2-400e-9f11-7ceef2a90e25 service nova] Creating event network-changed:c15e8e1e-3b40-4089-953f-40f1386b3d5f for instance 391031bf-162c-4701-a570-7cc7054aa3b5 on nch2-master-1 Jan 15 21:48:36.272018 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-a193741f-1d6d-47b6-bf1e-41e17216d28e req-3b29ad4d-a7d2-400e-9f11-7ceef2a90e25 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037362 Jan 15 21:48:36.272970 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4047/8105] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:48:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:48:36.467695 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-e285bb41-df82-4cf2-83b2-c5589c368c17 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:48:36.476696 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e285bb41-df82-4cf2-83b2-c5589c368c17 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/391031bf-162c-4701-a570-7cc7054aa3b5" status: 200 len: 1562 microversion: 2.1 time: 0.249246 Jan 15 21:48:36.488808 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4059/8106] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:48:36 2022] GET /compute/v2.1/servers/391031bf-162c-4701-a570-7cc7054aa3b5 => generated 1562 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:48:59.762248 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3b898ef5-bd5b-491b-9e75-d5b6f6366aab tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:48:59.763270 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-3b898ef5-bd5b-491b-9e75-d5b6f6366aab tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 391031bf-162c-4701-a570-7cc7054aa3b5] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:48:59.769874 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3b898ef5-bd5b-491b-9e75-d5b6f6366aab tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:48:59.770346 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3b898ef5-bd5b-491b-9e75-d5b6f6366aab tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:48:59.771141 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3b898ef5-bd5b-491b-9e75-d5b6f6366aab tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:48:59.771600 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3b898ef5-bd5b-491b-9e75-d5b6f6366aab tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:48:59.829175 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3b898ef5-bd5b-491b-9e75-d5b6f6366aab tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "POST /compute/v2.1/servers/391031bf-162c-4701-a570-7cc7054aa3b5/action" status: 200 len: 24566 microversion: 2.1 time: 0.070939 Jan 15 21:48:59.834450 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4048/8107] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:48:59 2022] POST /compute/v2.1/servers/391031bf-162c-4701-a570-7cc7054aa3b5/action => generated 24566 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:49:10.822993 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-867027fc-8aee-473c-b5bc-697a8b06d827 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:49:10.829211 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-867027fc-8aee-473c-b5bc-697a8b06d827 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:49:10.829699 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-867027fc-8aee-473c-b5bc-697a8b06d827 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:49:10.851828 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-867027fc-8aee-473c-b5bc-697a8b06d827 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 391031bf-162c-4701-a570-7cc7054aa3b5] Going to try to stop instance {{(pid=129366) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Jan 15 21:49:10.891271 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-867027fc-8aee-473c-b5bc-697a8b06d827 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "POST /compute/v2.1/servers/391031bf-162c-4701-a570-7cc7054aa3b5/action" status: 202 len: 0 microversion: 2.1 time: 0.072109 Jan 15 21:49:10.891875 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4060/8108] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:49:10 2022] POST /compute/v2.1/servers/391031bf-162c-4701-a570-7cc7054aa3b5/action => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:49:10.900519 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-1582f7ac-61b4-446d-bd87-33fa3757958c tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:49:10.901295 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-1582f7ac-61b4-446d-bd87-33fa3757958c tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 391031bf-162c-4701-a570-7cc7054aa3b5] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:49:10.909198 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1582f7ac-61b4-446d-bd87-33fa3757958c tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:49:10.909687 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1582f7ac-61b4-446d-bd87-33fa3757958c tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:49:10.910745 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1582f7ac-61b4-446d-bd87-33fa3757958c tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:49:10.911206 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1582f7ac-61b4-446d-bd87-33fa3757958c tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:49:11.053627 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-1582f7ac-61b4-446d-bd87-33fa3757958c tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:49:11.060996 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-1582f7ac-61b4-446d-bd87-33fa3757958c tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/391031bf-162c-4701-a570-7cc7054aa3b5" status: 200 len: 1691 microversion: 2.1 time: 0.164635 Jan 15 21:49:11.061572 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4049/8109] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:49:10 2022] GET /compute/v2.1/servers/391031bf-162c-4701-a570-7cc7054aa3b5 => generated 1691 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:49:12.079801 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-02e15070-a092-48b5-a530-fa7c8dd09b5b tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:49:12.081210 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-02e15070-a092-48b5-a530-fa7c8dd09b5b tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 391031bf-162c-4701-a570-7cc7054aa3b5] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:49:12.087390 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-02e15070-a092-48b5-a530-fa7c8dd09b5b tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:49:12.087846 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-02e15070-a092-48b5-a530-fa7c8dd09b5b tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:49:12.088639 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-02e15070-a092-48b5-a530-fa7c8dd09b5b tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:49:12.089106 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-02e15070-a092-48b5-a530-fa7c8dd09b5b tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:49:12.226394 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-02e15070-a092-48b5-a530-fa7c8dd09b5b tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:49:12.234930 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-02e15070-a092-48b5-a530-fa7c8dd09b5b tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/391031bf-162c-4701-a570-7cc7054aa3b5" status: 200 len: 1691 microversion: 2.1 time: 0.160139 Jan 15 21:49:12.235518 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4061/8110] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:49:12 2022] GET /compute/v2.1/servers/391031bf-162c-4701-a570-7cc7054aa3b5 => generated 1691 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:49:13.253354 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-44bcfd61-a7a0-4d5b-bcd6-6c1e03cb137e tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:49:13.253977 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-44bcfd61-a7a0-4d5b-bcd6-6c1e03cb137e tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 391031bf-162c-4701-a570-7cc7054aa3b5] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:49:13.260777 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-44bcfd61-a7a0-4d5b-bcd6-6c1e03cb137e tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:49:13.261277 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-44bcfd61-a7a0-4d5b-bcd6-6c1e03cb137e tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:49:13.262072 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-44bcfd61-a7a0-4d5b-bcd6-6c1e03cb137e tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:49:13.262526 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-44bcfd61-a7a0-4d5b-bcd6-6c1e03cb137e tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:49:13.393888 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-44bcfd61-a7a0-4d5b-bcd6-6c1e03cb137e tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:49:13.401415 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-44bcfd61-a7a0-4d5b-bcd6-6c1e03cb137e tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/391031bf-162c-4701-a570-7cc7054aa3b5" status: 200 len: 1691 microversion: 2.1 time: 0.152562 Jan 15 21:49:13.401983 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4050/8111] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:49:13 2022] GET /compute/v2.1/servers/391031bf-162c-4701-a570-7cc7054aa3b5 => generated 1691 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:49:14.419317 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4f18a71f-b7c9-4200-b030-dea82a3e11f9 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:49:14.419913 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-4f18a71f-b7c9-4200-b030-dea82a3e11f9 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 391031bf-162c-4701-a570-7cc7054aa3b5] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:49:14.425964 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4f18a71f-b7c9-4200-b030-dea82a3e11f9 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:49:14.426410 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4f18a71f-b7c9-4200-b030-dea82a3e11f9 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:49:14.427182 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4f18a71f-b7c9-4200-b030-dea82a3e11f9 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:49:14.427614 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4f18a71f-b7c9-4200-b030-dea82a3e11f9 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:49:14.562935 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-4f18a71f-b7c9-4200-b030-dea82a3e11f9 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:49:14.570496 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-4f18a71f-b7c9-4200-b030-dea82a3e11f9 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/391031bf-162c-4701-a570-7cc7054aa3b5" status: 200 len: 1691 microversion: 2.1 time: 0.155142 Jan 15 21:49:14.571079 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4062/8112] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:49:14 2022] GET /compute/v2.1/servers/391031bf-162c-4701-a570-7cc7054aa3b5 => generated 1691 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:49:15.587416 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-84a7cc5d-fb64-4f0e-8dea-daab2a7da926 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:49:15.588030 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-84a7cc5d-fb64-4f0e-8dea-daab2a7da926 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 391031bf-162c-4701-a570-7cc7054aa3b5] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:49:15.594485 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-84a7cc5d-fb64-4f0e-8dea-daab2a7da926 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:49:15.594949 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-84a7cc5d-fb64-4f0e-8dea-daab2a7da926 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:49:15.596121 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-84a7cc5d-fb64-4f0e-8dea-daab2a7da926 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:49:15.596576 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-84a7cc5d-fb64-4f0e-8dea-daab2a7da926 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:49:15.726582 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-84a7cc5d-fb64-4f0e-8dea-daab2a7da926 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:49:15.734018 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-84a7cc5d-fb64-4f0e-8dea-daab2a7da926 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/391031bf-162c-4701-a570-7cc7054aa3b5" status: 200 len: 1691 microversion: 2.1 time: 0.150487 Jan 15 21:49:15.734618 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4051/8113] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:49:15 2022] GET /compute/v2.1/servers/391031bf-162c-4701-a570-7cc7054aa3b5 => generated 1691 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:49:16.751090 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-73e0e8bf-0ff9-46bb-b149-0f849ecc51b0 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:49:16.751728 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-73e0e8bf-0ff9-46bb-b149-0f849ecc51b0 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 391031bf-162c-4701-a570-7cc7054aa3b5] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:49:16.758592 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-73e0e8bf-0ff9-46bb-b149-0f849ecc51b0 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:49:16.759040 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-73e0e8bf-0ff9-46bb-b149-0f849ecc51b0 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:49:16.759824 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-73e0e8bf-0ff9-46bb-b149-0f849ecc51b0 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:49:16.760264 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-73e0e8bf-0ff9-46bb-b149-0f849ecc51b0 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:49:16.898556 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-73e0e8bf-0ff9-46bb-b149-0f849ecc51b0 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:49:16.906068 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-73e0e8bf-0ff9-46bb-b149-0f849ecc51b0 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/391031bf-162c-4701-a570-7cc7054aa3b5" status: 200 len: 1691 microversion: 2.1 time: 0.158668 Jan 15 21:49:16.906667 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4063/8114] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:49:16 2022] GET /compute/v2.1/servers/391031bf-162c-4701-a570-7cc7054aa3b5 => generated 1691 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:49:17.923939 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-7e792f27-7c2c-48a9-832d-9a2bbc176249 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:49:17.924682 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-7e792f27-7c2c-48a9-832d-9a2bbc176249 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 391031bf-162c-4701-a570-7cc7054aa3b5] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:49:17.931450 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7e792f27-7c2c-48a9-832d-9a2bbc176249 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:49:17.931915 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7e792f27-7c2c-48a9-832d-9a2bbc176249 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:49:17.932712 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7e792f27-7c2c-48a9-832d-9a2bbc176249 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:49:17.933190 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7e792f27-7c2c-48a9-832d-9a2bbc176249 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:49:18.067613 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-7e792f27-7c2c-48a9-832d-9a2bbc176249 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:49:18.074979 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-7e792f27-7c2c-48a9-832d-9a2bbc176249 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/391031bf-162c-4701-a570-7cc7054aa3b5" status: 200 len: 1691 microversion: 2.1 time: 0.154798 Jan 15 21:49:18.075558 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4052/8115] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:49:17 2022] GET /compute/v2.1/servers/391031bf-162c-4701-a570-7cc7054aa3b5 => generated 1691 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:49:19.092119 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-5449dd08-1c99-41da-a8b4-80ca8d82108a tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:49:19.092744 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-5449dd08-1c99-41da-a8b4-80ca8d82108a tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 391031bf-162c-4701-a570-7cc7054aa3b5] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:49:19.102740 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5449dd08-1c99-41da-a8b4-80ca8d82108a tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:49:19.103191 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5449dd08-1c99-41da-a8b4-80ca8d82108a tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:49:19.103977 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5449dd08-1c99-41da-a8b4-80ca8d82108a tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:49:19.104416 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5449dd08-1c99-41da-a8b4-80ca8d82108a tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:49:19.248037 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-5449dd08-1c99-41da-a8b4-80ca8d82108a tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:49:19.256635 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-5449dd08-1c99-41da-a8b4-80ca8d82108a tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/391031bf-162c-4701-a570-7cc7054aa3b5" status: 200 len: 1691 microversion: 2.1 time: 0.168326 Jan 15 21:49:19.257243 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4064/8116] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:49:19 2022] GET /compute/v2.1/servers/391031bf-162c-4701-a570-7cc7054aa3b5 => generated 1691 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:49:20.274545 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f93481bd-f81b-4bfa-b7cc-ba1eb30f5d3f tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:49:20.275164 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f93481bd-f81b-4bfa-b7cc-ba1eb30f5d3f tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 391031bf-162c-4701-a570-7cc7054aa3b5] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:49:20.281996 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f93481bd-f81b-4bfa-b7cc-ba1eb30f5d3f tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:49:20.282470 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f93481bd-f81b-4bfa-b7cc-ba1eb30f5d3f tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:49:20.283377 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f93481bd-f81b-4bfa-b7cc-ba1eb30f5d3f tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:49:20.283795 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f93481bd-f81b-4bfa-b7cc-ba1eb30f5d3f tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:49:20.418904 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-f93481bd-f81b-4bfa-b7cc-ba1eb30f5d3f tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:49:20.426875 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f93481bd-f81b-4bfa-b7cc-ba1eb30f5d3f tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/391031bf-162c-4701-a570-7cc7054aa3b5" status: 200 len: 1691 microversion: 2.1 time: 0.156084 Jan 15 21:49:20.427444 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4053/8117] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:49:20 2022] GET /compute/v2.1/servers/391031bf-162c-4701-a570-7cc7054aa3b5 => generated 1691 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:49:21.444559 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c8bf1698-4763-4367-870c-07c23f341e01 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:49:21.445201 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c8bf1698-4763-4367-870c-07c23f341e01 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 391031bf-162c-4701-a570-7cc7054aa3b5] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:49:21.451956 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c8bf1698-4763-4367-870c-07c23f341e01 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:49:21.452404 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c8bf1698-4763-4367-870c-07c23f341e01 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:49:21.453203 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c8bf1698-4763-4367-870c-07c23f341e01 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:49:21.453644 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c8bf1698-4763-4367-870c-07c23f341e01 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:49:21.587796 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-c8bf1698-4763-4367-870c-07c23f341e01 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:49:21.595700 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c8bf1698-4763-4367-870c-07c23f341e01 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/391031bf-162c-4701-a570-7cc7054aa3b5" status: 200 len: 1668 microversion: 2.1 time: 0.154397 Jan 15 21:49:21.596482 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4065/8118] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:49:21 2022] GET /compute/v2.1/servers/391031bf-162c-4701-a570-7cc7054aa3b5 => generated 1668 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:49:22.691209 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-707ff8c5-3dc5-4272-b0ee-c92d6cf00a26 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:49:22.692137 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-707ff8c5-3dc5-4272-b0ee-c92d6cf00a26 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 391031bf-162c-4701-a570-7cc7054aa3b5] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:49:22.699541 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-707ff8c5-3dc5-4272-b0ee-c92d6cf00a26 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:49:22.700008 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-707ff8c5-3dc5-4272-b0ee-c92d6cf00a26 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:49:22.700801 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-707ff8c5-3dc5-4272-b0ee-c92d6cf00a26 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:49:22.701275 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-707ff8c5-3dc5-4272-b0ee-c92d6cf00a26 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:49:22.760726 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-707ff8c5-3dc5-4272-b0ee-c92d6cf00a26 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "POST /compute/v2.1/servers/391031bf-162c-4701-a570-7cc7054aa3b5/action" status: 200 len: 38360 microversion: 2.1 time: 0.073155 Jan 15 21:49:22.762080 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4054/8119] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:49:22 2022] POST /compute/v2.1/servers/391031bf-162c-4701-a570-7cc7054aa3b5/action => generated 38360 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:49:22.772927 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-bf9886fd-c3dd-403e-a72b-a3b5ae609409 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:49:22.780026 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bf9886fd-c3dd-403e-a72b-a3b5ae609409 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:49:22.780475 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bf9886fd-c3dd-403e-a72b-a3b5ae609409 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:49:22.803252 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-bf9886fd-c3dd-403e-a72b-a3b5ae609409 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 391031bf-162c-4701-a570-7cc7054aa3b5] Going to try to start instance {{(pid=129366) start /opt/stack/nova/nova/compute/api.py:2677}} Jan 15 21:49:22.841934 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-bf9886fd-c3dd-403e-a72b-a3b5ae609409 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "POST /compute/v2.1/servers/391031bf-162c-4701-a570-7cc7054aa3b5/action" status: 202 len: 0 microversion: 2.1 time: 0.072627 Jan 15 21:49:22.842567 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4066/8120] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:49:22 2022] POST /compute/v2.1/servers/391031bf-162c-4701-a570-7cc7054aa3b5/action => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:49:22.851835 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d574679b-cd6c-4da1-bef5-cdb3d157248d tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:49:22.852545 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d574679b-cd6c-4da1-bef5-cdb3d157248d tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 391031bf-162c-4701-a570-7cc7054aa3b5] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:49:22.860922 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d574679b-cd6c-4da1-bef5-cdb3d157248d tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:49:22.861395 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d574679b-cd6c-4da1-bef5-cdb3d157248d tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:49:22.862212 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d574679b-cd6c-4da1-bef5-cdb3d157248d tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:49:22.862661 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d574679b-cd6c-4da1-bef5-cdb3d157248d tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:49:23.034889 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-d574679b-cd6c-4da1-bef5-cdb3d157248d tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:49:23.043425 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d574679b-cd6c-4da1-bef5-cdb3d157248d tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/391031bf-162c-4701-a570-7cc7054aa3b5" status: 200 len: 1677 microversion: 2.1 time: 0.195631 Jan 15 21:49:23.054274 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4055/8121] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:49:22 2022] GET /compute/v2.1/servers/391031bf-162c-4701-a570-7cc7054aa3b5 => generated 1677 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:49:24.062764 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d81a0a53-f8eb-4060-8b46-1883af4cc270 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:49:24.063456 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-d81a0a53-f8eb-4060-8b46-1883af4cc270 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 391031bf-162c-4701-a570-7cc7054aa3b5] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:49:24.070086 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d81a0a53-f8eb-4060-8b46-1883af4cc270 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:49:24.070532 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d81a0a53-f8eb-4060-8b46-1883af4cc270 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:49:24.071300 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d81a0a53-f8eb-4060-8b46-1883af4cc270 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:49:24.071742 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d81a0a53-f8eb-4060-8b46-1883af4cc270 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:49:24.211927 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-d81a0a53-f8eb-4060-8b46-1883af4cc270 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:49:24.219371 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d81a0a53-f8eb-4060-8b46-1883af4cc270 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/391031bf-162c-4701-a570-7cc7054aa3b5" status: 200 len: 1681 microversion: 2.1 time: 0.161400 Jan 15 21:49:24.219952 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4067/8122] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:49:24 2022] GET /compute/v2.1/servers/391031bf-162c-4701-a570-7cc7054aa3b5 => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:49:50.406704 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-46e024b8-2ddf-496f-8799-03ab009289e7 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:49:50.407622 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-46e024b8-2ddf-496f-8799-03ab009289e7 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 391031bf-162c-4701-a570-7cc7054aa3b5] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:49:50.414877 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-46e024b8-2ddf-496f-8799-03ab009289e7 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:49:50.415372 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-46e024b8-2ddf-496f-8799-03ab009289e7 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:49:50.416172 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-46e024b8-2ddf-496f-8799-03ab009289e7 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:49:50.416651 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-46e024b8-2ddf-496f-8799-03ab009289e7 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:49:50.478259 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-46e024b8-2ddf-496f-8799-03ab009289e7 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "POST /compute/v2.1/servers/391031bf-162c-4701-a570-7cc7054aa3b5/action" status: 200 len: 62923 microversion: 2.1 time: 0.075319 Jan 15 21:49:50.478927 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4056/8123] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:49:50 2022] POST /compute/v2.1/servers/391031bf-162c-4701-a570-7cc7054aa3b5/action => generated 62923 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:49:57.550201 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ce13189f-d02d-4b2b-968e-345d2e132375 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:49:57.550817 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ce13189f-d02d-4b2b-968e-345d2e132375 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 391031bf-162c-4701-a570-7cc7054aa3b5] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:49:57.553491 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-225bec45-8c8a-4918-9116-73b60faacf04 req-3d300579-3d65-4de3-ba9b-0e735aca21b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "391031bf-162c-4701-a570-7cc7054aa3b5", "tag": "c15e8e1e-3b40-4089-953f-40f1386b3d5f"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:49:57.555775 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:49:57.555775 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:49:57.557247 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ce13189f-d02d-4b2b-968e-345d2e132375 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:49:57.557695 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ce13189f-d02d-4b2b-968e-345d2e132375 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:49:57.558473 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ce13189f-d02d-4b2b-968e-345d2e132375 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:49:57.558906 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ce13189f-d02d-4b2b-968e-345d2e132375 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:49:57.563965 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-225bec45-8c8a-4918-9116-73b60faacf04 req-3d300579-3d65-4de3-ba9b-0e735aca21b9 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:49:57.564579 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-225bec45-8c8a-4918-9116-73b60faacf04 req-3d300579-3d65-4de3-ba9b-0e735aca21b9 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:49:57.577170 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-225bec45-8c8a-4918-9116-73b60faacf04 req-3d300579-3d65-4de3-ba9b-0e735aca21b9 service nova] Creating event network-changed:c15e8e1e-3b40-4089-953f-40f1386b3d5f for instance 391031bf-162c-4701-a570-7cc7054aa3b5 on nch2-master-1 Jan 15 21:49:57.583408 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-225bec45-8c8a-4918-9116-73b60faacf04 req-3d300579-3d65-4de3-ba9b-0e735aca21b9 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034241 Jan 15 21:49:57.584129 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4057/8124] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:49:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:49:57.584477 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ce13189f-d02d-4b2b-968e-345d2e132375 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 391031bf-162c-4701-a570-7cc7054aa3b5] Going to try to terminate instance {{(pid=129366) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 21:49:57.687587 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ce13189f-d02d-4b2b-968e-345d2e132375 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "DELETE /compute/v2.1/servers/391031bf-162c-4701-a570-7cc7054aa3b5" status: 204 len: 0 microversion: 2.1 time: 0.140901 Jan 15 21:49:57.688192 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4068/8125] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 21:49:57 2022] DELETE /compute/v2.1/servers/391031bf-162c-4701-a570-7cc7054aa3b5 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 21:49:57.696823 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8c2fbeb1-40b1-4ded-aa83-6614e124e074 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:49:57.697658 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-8c2fbeb1-40b1-4ded-aa83-6614e124e074 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 391031bf-162c-4701-a570-7cc7054aa3b5] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:49:57.704418 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8c2fbeb1-40b1-4ded-aa83-6614e124e074 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:49:57.705021 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8c2fbeb1-40b1-4ded-aa83-6614e124e074 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:49:57.706041 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8c2fbeb1-40b1-4ded-aa83-6614e124e074 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:49:57.707437 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8c2fbeb1-40b1-4ded-aa83-6614e124e074 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:49:57.937323 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-8c2fbeb1-40b1-4ded-aa83-6614e124e074 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:49:57.946004 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-8c2fbeb1-40b1-4ded-aa83-6614e124e074 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/391031bf-162c-4701-a570-7cc7054aa3b5" status: 200 len: 1687 microversion: 2.1 time: 0.253181 Jan 15 21:49:57.947566 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4058/8126] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:49:57 2022] GET /compute/v2.1/servers/391031bf-162c-4701-a570-7cc7054aa3b5 => generated 1687 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:49:58.966460 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7b4af6db-a0ae-46cc-8122-006016cb125b tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:49:58.967162 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-7b4af6db-a0ae-46cc-8122-006016cb125b tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 391031bf-162c-4701-a570-7cc7054aa3b5] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:49:58.974118 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7b4af6db-a0ae-46cc-8122-006016cb125b tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:49:58.974571 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7b4af6db-a0ae-46cc-8122-006016cb125b tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:49:58.975349 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7b4af6db-a0ae-46cc-8122-006016cb125b tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:49:58.975788 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7b4af6db-a0ae-46cc-8122-006016cb125b tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:49:59.110204 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-7b4af6db-a0ae-46cc-8122-006016cb125b tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:49:59.117665 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7b4af6db-a0ae-46cc-8122-006016cb125b tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/391031bf-162c-4701-a570-7cc7054aa3b5" status: 200 len: 1568 microversion: 2.1 time: 0.155322 Jan 15 21:49:59.118237 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4069/8127] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:49:58 2022] GET /compute/v2.1/servers/391031bf-162c-4701-a570-7cc7054aa3b5 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:49:59.830293 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-9bcd80a6-3565-468f-8348-b117d7b452af req-81442bfe-17be-40bc-b1ca-659534d3342a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "391031bf-162c-4701-a570-7cc7054aa3b5", "name": "network-vif-deleted", "tag": "c15e8e1e-3b40-4089-953f-40f1386b3d5f"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:49:59.832498 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:49:59.832498 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:49:59.841887 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-9bcd80a6-3565-468f-8348-b117d7b452af req-81442bfe-17be-40bc-b1ca-659534d3342a service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:49:59.842433 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-9bcd80a6-3565-468f-8348-b117d7b452af req-81442bfe-17be-40bc-b1ca-659534d3342a service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:49:59.854808 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-9bcd80a6-3565-468f-8348-b117d7b452af req-81442bfe-17be-40bc-b1ca-659534d3342a service nova] Creating event network-vif-deleted:c15e8e1e-3b40-4089-953f-40f1386b3d5f for instance 391031bf-162c-4701-a570-7cc7054aa3b5 on nch2-master-1 Jan 15 21:49:59.860540 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-9bcd80a6-3565-468f-8348-b117d7b452af req-81442bfe-17be-40bc-b1ca-659534d3342a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033931 Jan 15 21:49:59.861186 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4059/8128] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:49:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:50:00.134783 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-64b4be58-c21e-4060-9966-32c7aafb406b tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:50:00.135539 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-64b4be58-c21e-4060-9966-32c7aafb406b tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 391031bf-162c-4701-a570-7cc7054aa3b5] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:50:00.142786 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-64b4be58-c21e-4060-9966-32c7aafb406b tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:50:00.143229 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-64b4be58-c21e-4060-9966-32c7aafb406b tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:50:00.144025 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-64b4be58-c21e-4060-9966-32c7aafb406b tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:50:00.144454 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-64b4be58-c21e-4060-9966-32c7aafb406b tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:50:00.179313 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-64b4be58-c21e-4060-9966-32c7aafb406b tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:50:00.179770 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-64b4be58-c21e-4060-9966-32c7aafb406b tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:50:00.180229 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.objects.instance [None req-64b4be58-c21e-4060-9966-32c7aafb406b tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lazy-loading 'fault' on Instance uuid 391031bf-162c-4701-a570-7cc7054aa3b5 {{(pid=129366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 21:50:00.220657 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-64b4be58-c21e-4060-9966-32c7aafb406b tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:50:00.230424 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-64b4be58-c21e-4060-9966-32c7aafb406b tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/391031bf-162c-4701-a570-7cc7054aa3b5" status: 200 len: 1355 microversion: 2.1 time: 0.099259 Jan 15 21:50:00.231649 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4070/8129] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:50:00 2022] GET /compute/v2.1/servers/391031bf-162c-4701-a570-7cc7054aa3b5 => generated 1355 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:50:01.249491 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f7179db1-cabc-4d1d-acb7-8a09cc93c22b tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:50:01.250202 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f7179db1-cabc-4d1d-acb7-8a09cc93c22b tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 391031bf-162c-4701-a570-7cc7054aa3b5] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:50:01.256800 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f7179db1-cabc-4d1d-acb7-8a09cc93c22b tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:50:01.257295 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f7179db1-cabc-4d1d-acb7-8a09cc93c22b tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:50:01.258246 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f7179db1-cabc-4d1d-acb7-8a09cc93c22b tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:50:01.258799 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f7179db1-cabc-4d1d-acb7-8a09cc93c22b tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:50:01.273114 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.wsgi [None req-f7179db1-cabc-4d1d-acb7-8a09cc93c22b tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] HTTP exception thrown: Instance 391031bf-162c-4701-a570-7cc7054aa3b5 could not be found. Jan 15 21:50:01.273714 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f7179db1-cabc-4d1d-acb7-8a09cc93c22b tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Returning 404 to user: Instance 391031bf-162c-4701-a570-7cc7054aa3b5 could not be found. {{(pid=129365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:50:01.274533 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f7179db1-cabc-4d1d-acb7-8a09cc93c22b tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/391031bf-162c-4701-a570-7cc7054aa3b5" status: 404 len: 111 microversion: 2.1 time: 0.030024 Jan 15 21:50:01.275068 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4060/8130] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:50:01 2022] GET /compute/v2.1/servers/391031bf-162c-4701-a570-7cc7054aa3b5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 15 21:50:04.776977 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a07b147a-5fa1-4335-85a2-9d17cd897cda tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '.version_select at 0x7f30c8f44a60>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:50:04.796811 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a07b147a-5fa1-4335-85a2-9d17cd897cda tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-240566726" status: 202 len: 0 microversion: 2.1 time: 0.023577 Jan 15 21:50:04.797592 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4071/8131] 10.222.0.46 () {58 vars in 1280 bytes} [Sat Jan 15 21:50:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-240566726 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 15 21:50:04.826522 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-66a81be9-4a8d-4c75-a949-aa639a495f72 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Action: 'create', calling method: .version_select at 0x7f30c84b8ca0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-559864971"}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:50:04.843389 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-66a81be9-4a8d-4c75-a949-aa639a495f72 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Getting quotas for project 5f21548044704a2bbfc4ed1612c66fbc. Resources: {'key_pairs'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:50:04.849051 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-66a81be9-4a8d-4c75-a949-aa639a495f72 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Getting quotas for user 9dd93f3b669e4901b2a805ce60ca057e and project 5f21548044704a2bbfc4ed1612c66fbc. Resources: {'key_pairs'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:50:04.988198 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-66a81be9-4a8d-4c75-a949-aa639a495f72 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Getting quotas for project 5f21548044704a2bbfc4ed1612c66fbc. Resources: {'key_pairs'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:50:04.993274 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-66a81be9-4a8d-4c75-a949-aa639a495f72 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Getting quotas for user 9dd93f3b669e4901b2a805ce60ca057e and project 5f21548044704a2bbfc4ed1612c66fbc. Resources: {'key_pairs'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:50:05.009397 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-66a81be9-4a8d-4c75-a949-aa639a495f72 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 2325 microversion: 2.1 time: 0.186808 Jan 15 21:50:05.010097 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4061/8132] 10.222.0.46 () {60 vars in 1157 bytes} [Sat Jan 15 21:50:04 2022] POST /compute/v2.1/os-keypairs => generated 2325 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:50:10.830419 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e8de28c5-aee3-4a50-a38a-d5924a8171bb tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-554429320", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "networks": [{"uuid": "bd7810f9-2ba1-4950-806c-efcb1f6be274"}], "key_name": "tempest-TestNetworkAdvancedServerOps-559864971", "security_groups": [{"name": "tempest-secgroup-smoke-1439291443"}]}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:50:10.937842 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.network.neutron [None req-e8de28c5-aee3-4a50-a38a-d5924a8171bb tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] validate_networks() for [('bd7810f9-2ba1-4950-806c-efcb1f6be274', None, None, None, None, None)] {{(pid=129366) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 21:50:11.054313 ncdv-master-1 devstack@n-api.service[129366]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 15 21:50:11.054582 ncdv-master-1 devstack@n-api.service[129366]: Sat Jan 15 21:50:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.46) !!! Jan 15 21:50:11.496384 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-e8de28c5-aee3-4a50-a38a-d5924a8171bb tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Flavor limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 21:50:11.496809 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-e8de28c5-aee3-4a50-a38a-d5924a8171bb tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Image limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 21:50:11.497320 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-e8de28c5-aee3-4a50-a38a-d5924a8171bb tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Flavor pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 21:50:11.497730 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-e8de28c5-aee3-4a50-a38a-d5924a8171bb tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Image pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 21:50:11.498140 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-e8de28c5-aee3-4a50-a38a-d5924a8171bb tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 21:50:11.508614 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e8de28c5-aee3-4a50-a38a-d5924a8171bb tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:50:11.509840 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e8de28c5-aee3-4a50-a38a-d5924a8171bb tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:50:11.510906 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e8de28c5-aee3-4a50-a38a-d5924a8171bb tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:50:11.511525 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e8de28c5-aee3-4a50-a38a-d5924a8171bb tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:50:11.536042 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-e8de28c5-aee3-4a50-a38a-d5924a8171bb tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Getting quotas for project 5f21548044704a2bbfc4ed1612c66fbc. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:50:11.545706 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-e8de28c5-aee3-4a50-a38a-d5924a8171bb tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Getting quotas for user 9dd93f3b669e4901b2a805ce60ca057e and project 5f21548044704a2bbfc4ed1612c66fbc. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:50:11.565923 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e8de28c5-aee3-4a50-a38a-d5924a8171bb tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Going to run 1 instances... {{(pid=129366) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 21:50:11.569855 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e8de28c5-aee3-4a50-a38a-d5924a8171bb tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 0daacd99-d9da-4360-90c3-fe7d0ec4fbb0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 21:50:11.629749 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e8de28c5-aee3-4a50-a38a-d5924a8171bb tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.803014 Jan 15 21:50:11.631343 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4072/8133] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 21:50:10 2022] POST /compute/v2.1/servers => generated 406 bytes in 806 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 21:50:11.641552 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-856cc45e-8a45-426d-8c20-70b461beeb27 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:50:11.642182 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-856cc45e-8a45-426d-8c20-70b461beeb27 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 0daacd99-d9da-4360-90c3-fe7d0ec4fbb0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:50:11.729287 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-856cc45e-8a45-426d-8c20-70b461beeb27 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:50:11.740153 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-856cc45e-8a45-426d-8c20-70b461beeb27 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/0daacd99-d9da-4360-90c3-fe7d0ec4fbb0" status: 200 len: 1265 microversion: 2.1 time: 0.102479 Jan 15 21:50:11.740755 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4062/8134] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:50:11 2022] GET /compute/v2.1/servers/0daacd99-d9da-4360-90c3-fe7d0ec4fbb0 => generated 1265 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:50:12.757531 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-940e3cb9-bc46-4bb0-8dc1-3d4d4ab798e3 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:50:12.764456 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-940e3cb9-bc46-4bb0-8dc1-3d4d4ab798e3 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 0daacd99-d9da-4360-90c3-fe7d0ec4fbb0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:50:12.843558 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-940e3cb9-bc46-4bb0-8dc1-3d4d4ab798e3 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:50:12.853001 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-940e3cb9-bc46-4bb0-8dc1-3d4d4ab798e3 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/0daacd99-d9da-4360-90c3-fe7d0ec4fbb0" status: 200 len: 1265 microversion: 2.1 time: 0.098989 Jan 15 21:50:12.856873 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4073/8135] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:50:12 2022] GET /compute/v2.1/servers/0daacd99-d9da-4360-90c3-fe7d0ec4fbb0 => generated 1265 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:50:13.869705 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-00161798-a497-4ef6-b155-06570798f2e6 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:50:13.870332 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-00161798-a497-4ef6-b155-06570798f2e6 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 0daacd99-d9da-4360-90c3-fe7d0ec4fbb0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:50:13.929218 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-00161798-a497-4ef6-b155-06570798f2e6 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:50:13.937726 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-00161798-a497-4ef6-b155-06570798f2e6 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/0daacd99-d9da-4360-90c3-fe7d0ec4fbb0" status: 200 len: 1265 microversion: 2.1 time: 0.071991 Jan 15 21:50:13.938608 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4063/8136] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:50:13 2022] GET /compute/v2.1/servers/0daacd99-d9da-4360-90c3-fe7d0ec4fbb0 => generated 1265 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:50:14.956199 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-54cd0320-9c82-4cf9-b6bc-d1262e5560b6 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:50:14.957334 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-54cd0320-9c82-4cf9-b6bc-d1262e5560b6 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 0daacd99-d9da-4360-90c3-fe7d0ec4fbb0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:50:15.008470 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-54cd0320-9c82-4cf9-b6bc-d1262e5560b6 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:50:15.015540 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-54cd0320-9c82-4cf9-b6bc-d1262e5560b6 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/0daacd99-d9da-4360-90c3-fe7d0ec4fbb0" status: 200 len: 1265 microversion: 2.1 time: 0.063721 Jan 15 21:50:15.016320 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4074/8137] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:50:14 2022] GET /compute/v2.1/servers/0daacd99-d9da-4360-90c3-fe7d0ec4fbb0 => generated 1265 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:50:16.033324 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2227d85b-1846-4cc3-9ea6-2cc8d7c95843 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:50:16.033952 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-2227d85b-1846-4cc3-9ea6-2cc8d7c95843 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 0daacd99-d9da-4360-90c3-fe7d0ec4fbb0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:50:16.040949 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2227d85b-1846-4cc3-9ea6-2cc8d7c95843 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:50:16.041420 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2227d85b-1846-4cc3-9ea6-2cc8d7c95843 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:50:16.042217 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2227d85b-1846-4cc3-9ea6-2cc8d7c95843 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:50:16.042670 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2227d85b-1846-4cc3-9ea6-2cc8d7c95843 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:50:16.102575 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-2227d85b-1846-4cc3-9ea6-2cc8d7c95843 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:50:16.110040 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2227d85b-1846-4cc3-9ea6-2cc8d7c95843 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/0daacd99-d9da-4360-90c3-fe7d0ec4fbb0" status: 200 len: 1269 microversion: 2.1 time: 0.080586 Jan 15 21:50:16.110637 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4064/8138] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:50:16 2022] GET /compute/v2.1/servers/0daacd99-d9da-4360-90c3-fe7d0ec4fbb0 => generated 1269 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:50:17.127033 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1d86dfe9-50d8-45f6-a715-b996b7032d00 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:50:17.127632 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-1d86dfe9-50d8-45f6-a715-b996b7032d00 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 0daacd99-d9da-4360-90c3-fe7d0ec4fbb0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:50:17.134839 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1d86dfe9-50d8-45f6-a715-b996b7032d00 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:50:17.135285 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1d86dfe9-50d8-45f6-a715-b996b7032d00 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:50:17.136060 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1d86dfe9-50d8-45f6-a715-b996b7032d00 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:50:17.136490 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1d86dfe9-50d8-45f6-a715-b996b7032d00 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:50:17.201221 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-1d86dfe9-50d8-45f6-a715-b996b7032d00 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:50:17.209237 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-1d86dfe9-50d8-45f6-a715-b996b7032d00 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/0daacd99-d9da-4360-90c3-fe7d0ec4fbb0" status: 200 len: 1323 microversion: 2.1 time: 0.085894 Jan 15 21:50:17.209817 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4075/8139] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:50:17 2022] GET /compute/v2.1/servers/0daacd99-d9da-4360-90c3-fe7d0ec4fbb0 => generated 1323 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:50:18.160327 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-fc7c0f05-7dbd-442d-bd98-06827be5c181 req-863696a8-2638-4221-8e38-63b49318ab09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0daacd99-d9da-4360-90c3-fe7d0ec4fbb0", "tag": "5351998c-0901-482c-91a3-cf7c1f3de48f"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:50:18.162945 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:50:18.162945 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:50:18.172617 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-fc7c0f05-7dbd-442d-bd98-06827be5c181 req-863696a8-2638-4221-8e38-63b49318ab09 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:50:18.176262 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-fc7c0f05-7dbd-442d-bd98-06827be5c181 req-863696a8-2638-4221-8e38-63b49318ab09 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:50:18.188398 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-fc7c0f05-7dbd-442d-bd98-06827be5c181 req-863696a8-2638-4221-8e38-63b49318ab09 service nova] Creating event network-changed:5351998c-0901-482c-91a3-cf7c1f3de48f for instance 0daacd99-d9da-4360-90c3-fe7d0ec4fbb0 on nch2-master-1 Jan 15 21:50:18.197786 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-fc7c0f05-7dbd-442d-bd98-06827be5c181 req-863696a8-2638-4221-8e38-63b49318ab09 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041429 Jan 15 21:50:18.198764 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4065/8140] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:50:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:50:18.227283 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-fafe2da7-03cf-450f-8ef1-1cd6eb0e0cc9 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:50:18.228185 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-fafe2da7-03cf-450f-8ef1-1cd6eb0e0cc9 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 0daacd99-d9da-4360-90c3-fe7d0ec4fbb0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:50:18.235437 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fafe2da7-03cf-450f-8ef1-1cd6eb0e0cc9 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:50:18.235963 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fafe2da7-03cf-450f-8ef1-1cd6eb0e0cc9 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:50:18.236875 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fafe2da7-03cf-450f-8ef1-1cd6eb0e0cc9 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:50:18.237708 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fafe2da7-03cf-450f-8ef1-1cd6eb0e0cc9 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:50:18.475304 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-fafe2da7-03cf-450f-8ef1-1cd6eb0e0cc9 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:50:18.482937 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-fafe2da7-03cf-450f-8ef1-1cd6eb0e0cc9 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/0daacd99-d9da-4360-90c3-fe7d0ec4fbb0" status: 200 len: 1391 microversion: 2.1 time: 0.259657 Jan 15 21:50:18.483534 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4076/8141] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:50:18 2022] GET /compute/v2.1/servers/0daacd99-d9da-4360-90c3-fe7d0ec4fbb0 => generated 1391 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:50:19.501392 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-29442f92-bfb4-4b16-b4d7-84bbf8350508 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:50:19.502107 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-29442f92-bfb4-4b16-b4d7-84bbf8350508 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 0daacd99-d9da-4360-90c3-fe7d0ec4fbb0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:50:19.509038 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-29442f92-bfb4-4b16-b4d7-84bbf8350508 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:50:19.509536 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-29442f92-bfb4-4b16-b4d7-84bbf8350508 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:50:19.510341 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-29442f92-bfb4-4b16-b4d7-84bbf8350508 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:50:19.510798 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-29442f92-bfb4-4b16-b4d7-84bbf8350508 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:50:19.644274 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-29442f92-bfb4-4b16-b4d7-84bbf8350508 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:50:19.651624 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-29442f92-bfb4-4b16-b4d7-84bbf8350508 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/0daacd99-d9da-4360-90c3-fe7d0ec4fbb0" status: 200 len: 1391 microversion: 2.1 time: 0.155200 Jan 15 21:50:19.652178 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4066/8142] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:50:19 2022] GET /compute/v2.1/servers/0daacd99-d9da-4360-90c3-fe7d0ec4fbb0 => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:50:20.668911 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-74980a38-7922-45b0-8f02-c883b3154c8d tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:50:20.669518 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-74980a38-7922-45b0-8f02-c883b3154c8d tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 0daacd99-d9da-4360-90c3-fe7d0ec4fbb0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:50:20.676988 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-74980a38-7922-45b0-8f02-c883b3154c8d tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:50:20.677458 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-74980a38-7922-45b0-8f02-c883b3154c8d tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:50:20.678244 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-74980a38-7922-45b0-8f02-c883b3154c8d tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:50:20.678678 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-74980a38-7922-45b0-8f02-c883b3154c8d tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:50:20.831477 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-74980a38-7922-45b0-8f02-c883b3154c8d tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:50:20.838822 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-74980a38-7922-45b0-8f02-c883b3154c8d tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/0daacd99-d9da-4360-90c3-fe7d0ec4fbb0" status: 200 len: 1391 microversion: 2.1 time: 0.173630 Jan 15 21:50:20.839424 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4077/8143] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:50:20 2022] GET /compute/v2.1/servers/0daacd99-d9da-4360-90c3-fe7d0ec4fbb0 => generated 1391 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:50:21.855650 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-fcc8c3a0-2790-402d-9d92-e9e554ffd1b1 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:50:21.856264 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-fcc8c3a0-2790-402d-9d92-e9e554ffd1b1 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 0daacd99-d9da-4360-90c3-fe7d0ec4fbb0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:50:21.863272 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fcc8c3a0-2790-402d-9d92-e9e554ffd1b1 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:50:21.863739 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fcc8c3a0-2790-402d-9d92-e9e554ffd1b1 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:50:21.864537 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fcc8c3a0-2790-402d-9d92-e9e554ffd1b1 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:50:21.865023 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fcc8c3a0-2790-402d-9d92-e9e554ffd1b1 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:50:21.996925 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-fcc8c3a0-2790-402d-9d92-e9e554ffd1b1 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:50:22.004878 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-fcc8c3a0-2790-402d-9d92-e9e554ffd1b1 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/0daacd99-d9da-4360-90c3-fe7d0ec4fbb0" status: 200 len: 1391 microversion: 2.1 time: 0.152955 Jan 15 21:50:22.005461 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4067/8144] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:50:21 2022] GET /compute/v2.1/servers/0daacd99-d9da-4360-90c3-fe7d0ec4fbb0 => generated 1391 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:50:22.426191 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-62706fd2-305f-486c-9203-9f70034de90c req-05da3e4f-8012-41f1-8d22-bd5a36d26f0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0daacd99-d9da-4360-90c3-fe7d0ec4fbb0", "name": "network-vif-plugged", "status": "completed", "tag": "5351998c-0901-482c-91a3-cf7c1f3de48f"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:50:22.427881 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:50:22.427881 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:50:22.435761 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-62706fd2-305f-486c-9203-9f70034de90c req-05da3e4f-8012-41f1-8d22-bd5a36d26f0f service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:50:22.436279 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-62706fd2-305f-486c-9203-9f70034de90c req-05da3e4f-8012-41f1-8d22-bd5a36d26f0f service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:50:22.448725 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-62706fd2-305f-486c-9203-9f70034de90c req-05da3e4f-8012-41f1-8d22-bd5a36d26f0f service nova] Creating event network-vif-plugged:5351998c-0901-482c-91a3-cf7c1f3de48f for instance 0daacd99-d9da-4360-90c3-fe7d0ec4fbb0 on nch2-master-1 Jan 15 21:50:22.454350 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-62706fd2-305f-486c-9203-9f70034de90c req-05da3e4f-8012-41f1-8d22-bd5a36d26f0f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032508 Jan 15 21:50:22.454949 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4078/8145] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:50:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:50:23.022304 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2e3fa019-a8ec-4fe3-b593-6c49faa23cfe tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:50:23.022923 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-2e3fa019-a8ec-4fe3-b593-6c49faa23cfe tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 0daacd99-d9da-4360-90c3-fe7d0ec4fbb0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:50:23.029876 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2e3fa019-a8ec-4fe3-b593-6c49faa23cfe tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:50:23.030342 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2e3fa019-a8ec-4fe3-b593-6c49faa23cfe tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:50:23.031134 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2e3fa019-a8ec-4fe3-b593-6c49faa23cfe tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:50:23.031614 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2e3fa019-a8ec-4fe3-b593-6c49faa23cfe tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:50:23.171460 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-2e3fa019-a8ec-4fe3-b593-6c49faa23cfe tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:50:23.178909 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2e3fa019-a8ec-4fe3-b593-6c49faa23cfe tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/0daacd99-d9da-4360-90c3-fe7d0ec4fbb0" status: 200 len: 1391 microversion: 2.1 time: 0.161013 Jan 15 21:50:23.179493 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4068/8146] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:50:23 2022] GET /compute/v2.1/servers/0daacd99-d9da-4360-90c3-fe7d0ec4fbb0 => generated 1391 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:50:24.196086 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-743a39ba-5e28-47c0-baf4-3463d4b48844 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:50:24.196789 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-743a39ba-5e28-47c0-baf4-3463d4b48844 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 0daacd99-d9da-4360-90c3-fe7d0ec4fbb0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:50:24.204086 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-743a39ba-5e28-47c0-baf4-3463d4b48844 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:50:24.204537 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-743a39ba-5e28-47c0-baf4-3463d4b48844 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:50:24.205345 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-743a39ba-5e28-47c0-baf4-3463d4b48844 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:50:24.205779 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-743a39ba-5e28-47c0-baf4-3463d4b48844 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:50:24.340013 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-743a39ba-5e28-47c0-baf4-3463d4b48844 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:50:24.348515 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-743a39ba-5e28-47c0-baf4-3463d4b48844 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/0daacd99-d9da-4360-90c3-fe7d0ec4fbb0" status: 200 len: 1564 microversion: 2.1 time: 0.156333 Jan 15 21:50:24.349538 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4079/8147] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:50:24 2022] GET /compute/v2.1/servers/0daacd99-d9da-4360-90c3-fe7d0ec4fbb0 => generated 1564 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:50:24.365625 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-0e45d6c4-640d-414c-be7c-07b607962ffb tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:50:24.366332 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-0e45d6c4-640d-414c-be7c-07b607962ffb tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 0daacd99-d9da-4360-90c3-fe7d0ec4fbb0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:50:24.373478 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0e45d6c4-640d-414c-be7c-07b607962ffb tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:50:24.373879 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0e45d6c4-640d-414c-be7c-07b607962ffb tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:50:24.374771 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0e45d6c4-640d-414c-be7c-07b607962ffb tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:50:24.375471 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-0e45d6c4-640d-414c-be7c-07b607962ffb tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:50:24.515826 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-0e45d6c4-640d-414c-be7c-07b607962ffb tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:50:24.523859 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-0e45d6c4-640d-414c-be7c-07b607962ffb tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/0daacd99-d9da-4360-90c3-fe7d0ec4fbb0" status: 200 len: 1564 microversion: 2.1 time: 0.162841 Jan 15 21:50:24.524435 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4069/8148] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:50:24 2022] GET /compute/v2.1/servers/0daacd99-d9da-4360-90c3-fe7d0ec4fbb0 => generated 1564 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:50:26.147007 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f39556db-7640-44d0-b9dd-86e63500f346 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:50:26.147627 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f39556db-7640-44d0-b9dd-86e63500f346 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 0daacd99-d9da-4360-90c3-fe7d0ec4fbb0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:50:26.150089 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-52e43254-3487-4075-9aa2-72b870929104 req-09dceef7-f3f4-4cd7-bec0-21c05347735b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0daacd99-d9da-4360-90c3-fe7d0ec4fbb0", "tag": "5351998c-0901-482c-91a3-cf7c1f3de48f"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:50:26.151608 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:50:26.151608 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:50:26.155282 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f39556db-7640-44d0-b9dd-86e63500f346 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:50:26.155750 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f39556db-7640-44d0-b9dd-86e63500f346 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:50:26.156556 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f39556db-7640-44d0-b9dd-86e63500f346 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:50:26.157033 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f39556db-7640-44d0-b9dd-86e63500f346 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:50:26.160874 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-52e43254-3487-4075-9aa2-72b870929104 req-09dceef7-f3f4-4cd7-bec0-21c05347735b service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:50:26.161338 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-52e43254-3487-4075-9aa2-72b870929104 req-09dceef7-f3f4-4cd7-bec0-21c05347735b service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:50:26.176973 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-52e43254-3487-4075-9aa2-72b870929104 req-09dceef7-f3f4-4cd7-bec0-21c05347735b service nova] Creating event network-changed:5351998c-0901-482c-91a3-cf7c1f3de48f for instance 0daacd99-d9da-4360-90c3-fe7d0ec4fbb0 on nch2-master-1 Jan 15 21:50:26.182453 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-52e43254-3487-4075-9aa2-72b870929104 req-09dceef7-f3f4-4cd7-bec0-21c05347735b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035896 Jan 15 21:50:26.183301 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4070/8149] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:50:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 21:50:26.380588 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-f39556db-7640-44d0-b9dd-86e63500f346 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:50:26.388453 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f39556db-7640-44d0-b9dd-86e63500f346 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/0daacd99-d9da-4360-90c3-fe7d0ec4fbb0" status: 200 len: 1564 microversion: 2.1 time: 0.245262 Jan 15 21:50:26.399757 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4080/8150] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:50:26 2022] GET /compute/v2.1/servers/0daacd99-d9da-4360-90c3-fe7d0ec4fbb0 => generated 1564 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:50:49.963193 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-262326e8-3cc5-4847-bfc4-3cc81baab3a4 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:50:49.964113 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-262326e8-3cc5-4847-bfc4-3cc81baab3a4 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 0daacd99-d9da-4360-90c3-fe7d0ec4fbb0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:50:49.970482 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-262326e8-3cc5-4847-bfc4-3cc81baab3a4 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:50:49.970953 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-262326e8-3cc5-4847-bfc4-3cc81baab3a4 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:50:49.971737 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-262326e8-3cc5-4847-bfc4-3cc81baab3a4 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:50:49.972183 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-262326e8-3cc5-4847-bfc4-3cc81baab3a4 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:50:50.025346 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-262326e8-3cc5-4847-bfc4-3cc81baab3a4 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "POST /compute/v2.1/servers/0daacd99-d9da-4360-90c3-fe7d0ec4fbb0/action" status: 200 len: 24567 microversion: 2.1 time: 0.067035 Jan 15 21:50:50.025975 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4071/8151] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:50:49 2022] POST /compute/v2.1/servers/0daacd99-d9da-4360-90c3-fe7d0ec4fbb0/action => generated 24567 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:51:00.902599 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-5fed0f35-0e75-4c46-9394-7538ce0f4e15 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:51:00.903206 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-5fed0f35-0e75-4c46-9394-7538ce0f4e15 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 0daacd99-d9da-4360-90c3-fe7d0ec4fbb0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:51:00.911345 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5fed0f35-0e75-4c46-9394-7538ce0f4e15 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:51:00.911799 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5fed0f35-0e75-4c46-9394-7538ce0f4e15 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:51:00.912585 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5fed0f35-0e75-4c46-9394-7538ce0f4e15 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:51:00.913063 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5fed0f35-0e75-4c46-9394-7538ce0f4e15 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:51:00.935432 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.objects.instance [None req-5fed0f35-0e75-4c46-9394-7538ce0f4e15 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lazy-loading 'flavor' on Instance uuid 0daacd99-d9da-4360-90c3-fe7d0ec4fbb0 {{(pid=129366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 21:51:01.000444 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-5fed0f35-0e75-4c46-9394-7538ce0f4e15 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "POST /compute/v2.1/servers/0daacd99-d9da-4360-90c3-fe7d0ec4fbb0/action" status: 202 len: 0 microversion: 2.1 time: 0.101366 Jan 15 21:51:01.001187 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4081/8152] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:51:00 2022] POST /compute/v2.1/servers/0daacd99-d9da-4360-90c3-fe7d0ec4fbb0/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:51:01.010439 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-047f5466-fdf1-419d-a0bd-1a3cafb2db1c tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:51:01.011234 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-047f5466-fdf1-419d-a0bd-1a3cafb2db1c tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 0daacd99-d9da-4360-90c3-fe7d0ec4fbb0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:51:01.020467 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-047f5466-fdf1-419d-a0bd-1a3cafb2db1c tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:51:01.021410 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-047f5466-fdf1-419d-a0bd-1a3cafb2db1c tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:51:01.022356 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-047f5466-fdf1-419d-a0bd-1a3cafb2db1c tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:51:01.022944 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-047f5466-fdf1-419d-a0bd-1a3cafb2db1c tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:51:01.160007 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-047f5466-fdf1-419d-a0bd-1a3cafb2db1c tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:51:01.167434 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-047f5466-fdf1-419d-a0bd-1a3cafb2db1c tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/0daacd99-d9da-4360-90c3-fe7d0ec4fbb0" status: 200 len: 1691 microversion: 2.1 time: 0.161097 Jan 15 21:51:01.168021 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4072/8153] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:51:01 2022] GET /compute/v2.1/servers/0daacd99-d9da-4360-90c3-fe7d0ec4fbb0 => generated 1691 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:51:02.185900 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-44b394c0-5187-45b9-8248-204c6768e1a7 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:51:02.186631 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-44b394c0-5187-45b9-8248-204c6768e1a7 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 0daacd99-d9da-4360-90c3-fe7d0ec4fbb0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:51:02.193421 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-44b394c0-5187-45b9-8248-204c6768e1a7 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:51:02.193875 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-44b394c0-5187-45b9-8248-204c6768e1a7 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:51:02.194653 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-44b394c0-5187-45b9-8248-204c6768e1a7 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:51:02.195089 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-44b394c0-5187-45b9-8248-204c6768e1a7 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:51:02.335678 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-44b394c0-5187-45b9-8248-204c6768e1a7 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:51:02.343141 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-44b394c0-5187-45b9-8248-204c6768e1a7 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/0daacd99-d9da-4360-90c3-fe7d0ec4fbb0" status: 200 len: 1674 microversion: 2.1 time: 0.162220 Jan 15 21:51:02.343720 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4082/8154] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:51:02 2022] GET /compute/v2.1/servers/0daacd99-d9da-4360-90c3-fe7d0ec4fbb0 => generated 1674 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:51:03.433977 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-4e6863e2-88d9-4bb9-9790-aba076e15dd1 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:51:03.434907 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-4e6863e2-88d9-4bb9-9790-aba076e15dd1 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 0daacd99-d9da-4360-90c3-fe7d0ec4fbb0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:51:03.442695 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4e6863e2-88d9-4bb9-9790-aba076e15dd1 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:51:03.443165 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4e6863e2-88d9-4bb9-9790-aba076e15dd1 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:51:03.443956 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4e6863e2-88d9-4bb9-9790-aba076e15dd1 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:51:03.444413 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4e6863e2-88d9-4bb9-9790-aba076e15dd1 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:51:03.503783 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-4e6863e2-88d9-4bb9-9790-aba076e15dd1 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "POST /compute/v2.1/servers/0daacd99-d9da-4360-90c3-fe7d0ec4fbb0/action" status: 200 len: 38093 microversion: 2.1 time: 0.073442 Jan 15 21:51:03.504501 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4073/8155] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:51:03 2022] POST /compute/v2.1/servers/0daacd99-d9da-4360-90c3-fe7d0ec4fbb0/action => generated 38093 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:51:03.515245 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7b791150-751e-4307-9e58-1ac7e33da85b tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:51:03.515781 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-7b791150-751e-4307-9e58-1ac7e33da85b tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 0daacd99-d9da-4360-90c3-fe7d0ec4fbb0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:51:03.523556 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7b791150-751e-4307-9e58-1ac7e33da85b tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:51:03.524009 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7b791150-751e-4307-9e58-1ac7e33da85b tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:51:03.524796 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7b791150-751e-4307-9e58-1ac7e33da85b tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:51:03.525262 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7b791150-751e-4307-9e58-1ac7e33da85b tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:51:03.590596 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7b791150-751e-4307-9e58-1ac7e33da85b tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "POST /compute/v2.1/servers/0daacd99-d9da-4360-90c3-fe7d0ec4fbb0/action" status: 202 len: 0 microversion: 2.1 time: 0.078907 Jan 15 21:51:03.591231 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4083/8156] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:51:03 2022] POST /compute/v2.1/servers/0daacd99-d9da-4360-90c3-fe7d0ec4fbb0/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:51:03.601496 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2acb6a64-1a78-40a5-9a22-39242cdceb53 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:51:03.602209 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-2acb6a64-1a78-40a5-9a22-39242cdceb53 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 0daacd99-d9da-4360-90c3-fe7d0ec4fbb0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:51:03.609753 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2acb6a64-1a78-40a5-9a22-39242cdceb53 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:51:03.610251 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2acb6a64-1a78-40a5-9a22-39242cdceb53 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:51:03.611345 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2acb6a64-1a78-40a5-9a22-39242cdceb53 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:51:03.612628 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2acb6a64-1a78-40a5-9a22-39242cdceb53 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:51:04.123015 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-2acb6a64-1a78-40a5-9a22-39242cdceb53 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:51:04.131131 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2acb6a64-1a78-40a5-9a22-39242cdceb53 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/0daacd99-d9da-4360-90c3-fe7d0ec4fbb0" status: 200 len: 1680 microversion: 2.1 time: 0.535366 Jan 15 21:51:04.131718 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4074/8157] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:51:03 2022] GET /compute/v2.1/servers/0daacd99-d9da-4360-90c3-fe7d0ec4fbb0 => generated 1680 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:51:05.150121 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-2d4b4ad2-4e1c-4caa-aacd-8307a30861f7 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:51:05.150817 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-2d4b4ad2-4e1c-4caa-aacd-8307a30861f7 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 0daacd99-d9da-4360-90c3-fe7d0ec4fbb0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:51:05.160667 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2d4b4ad2-4e1c-4caa-aacd-8307a30861f7 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:51:05.161377 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2d4b4ad2-4e1c-4caa-aacd-8307a30861f7 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:51:05.162748 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2d4b4ad2-4e1c-4caa-aacd-8307a30861f7 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:51:05.163213 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2d4b4ad2-4e1c-4caa-aacd-8307a30861f7 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:51:05.343230 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-2d4b4ad2-4e1c-4caa-aacd-8307a30861f7 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:51:05.351813 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-2d4b4ad2-4e1c-4caa-aacd-8307a30861f7 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/0daacd99-d9da-4360-90c3-fe7d0ec4fbb0" status: 200 len: 1680 microversion: 2.1 time: 0.205668 Jan 15 21:51:05.359288 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4084/8158] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:51:05 2022] GET /compute/v2.1/servers/0daacd99-d9da-4360-90c3-fe7d0ec4fbb0 => generated 1680 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:51:06.369983 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5c5d01ed-d68e-460d-b589-bb1fb85bd09a tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:51:06.370610 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-5c5d01ed-d68e-460d-b589-bb1fb85bd09a tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 0daacd99-d9da-4360-90c3-fe7d0ec4fbb0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:51:06.378390 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5c5d01ed-d68e-460d-b589-bb1fb85bd09a tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:51:06.378712 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5c5d01ed-d68e-460d-b589-bb1fb85bd09a tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:51:06.379531 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5c5d01ed-d68e-460d-b589-bb1fb85bd09a tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:51:06.379987 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5c5d01ed-d68e-460d-b589-bb1fb85bd09a tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:51:06.509740 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-5c5d01ed-d68e-460d-b589-bb1fb85bd09a tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:51:06.517200 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5c5d01ed-d68e-460d-b589-bb1fb85bd09a tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/0daacd99-d9da-4360-90c3-fe7d0ec4fbb0" status: 200 len: 1683 microversion: 2.1 time: 0.151469 Jan 15 21:51:06.518313 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4075/8159] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:51:06 2022] GET /compute/v2.1/servers/0daacd99-d9da-4360-90c3-fe7d0ec4fbb0 => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:51:06.616039 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c7145927-136d-4387-b6d7-8e7a4854165a tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:51:06.617688 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c7145927-136d-4387-b6d7-8e7a4854165a tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 0daacd99-d9da-4360-90c3-fe7d0ec4fbb0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:51:06.624470 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c7145927-136d-4387-b6d7-8e7a4854165a tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:51:06.624934 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c7145927-136d-4387-b6d7-8e7a4854165a tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:51:06.625751 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c7145927-136d-4387-b6d7-8e7a4854165a tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:51:06.626186 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c7145927-136d-4387-b6d7-8e7a4854165a tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:51:06.668324 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c7145927-136d-4387-b6d7-8e7a4854165a tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "POST /compute/v2.1/servers/0daacd99-d9da-4360-90c3-fe7d0ec4fbb0/action" status: 200 len: 38093 microversion: 2.1 time: 0.056057 Jan 15 21:51:06.668982 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4085/8160] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:51:06 2022] POST /compute/v2.1/servers/0daacd99-d9da-4360-90c3-fe7d0ec4fbb0/action => generated 38093 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 15 21:51:07.705339 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e301f472-fe14-4588-a7b4-7aeecf36c0ac tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:51:07.706235 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e301f472-fe14-4588-a7b4-7aeecf36c0ac tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 0daacd99-d9da-4360-90c3-fe7d0ec4fbb0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:51:07.707124 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-c1edb4db-500c-434a-81aa-ef16f8857a61 req-b089b9e6-18f1-4e26-a720-ee874f56011d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0daacd99-d9da-4360-90c3-fe7d0ec4fbb0", "tag": "5351998c-0901-482c-91a3-cf7c1f3de48f"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:51:07.708628 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:51:07.708628 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:51:07.713735 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e301f472-fe14-4588-a7b4-7aeecf36c0ac tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:51:07.714463 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e301f472-fe14-4588-a7b4-7aeecf36c0ac tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:51:07.715739 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e301f472-fe14-4588-a7b4-7aeecf36c0ac tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:51:07.716264 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e301f472-fe14-4588-a7b4-7aeecf36c0ac tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:51:07.716966 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-c1edb4db-500c-434a-81aa-ef16f8857a61 req-b089b9e6-18f1-4e26-a720-ee874f56011d service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:51:07.717426 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-c1edb4db-500c-434a-81aa-ef16f8857a61 req-b089b9e6-18f1-4e26-a720-ee874f56011d service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:51:07.729455 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-c1edb4db-500c-434a-81aa-ef16f8857a61 req-b089b9e6-18f1-4e26-a720-ee874f56011d service nova] Creating event network-changed:5351998c-0901-482c-91a3-cf7c1f3de48f for instance 0daacd99-d9da-4360-90c3-fe7d0ec4fbb0 on nch2-master-1 Jan 15 21:51:07.734550 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-c1edb4db-500c-434a-81aa-ef16f8857a61 req-b089b9e6-18f1-4e26-a720-ee874f56011d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031474 Jan 15 21:51:07.735929 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4086/8161] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:51:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:51:07.745447 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e301f472-fe14-4588-a7b4-7aeecf36c0ac tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 0daacd99-d9da-4360-90c3-fe7d0ec4fbb0] Going to try to terminate instance {{(pid=129365) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 21:51:07.842233 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e301f472-fe14-4588-a7b4-7aeecf36c0ac tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "DELETE /compute/v2.1/servers/0daacd99-d9da-4360-90c3-fe7d0ec4fbb0" status: 204 len: 0 microversion: 2.1 time: 0.140616 Jan 15 21:51:07.842924 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4076/8162] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 21:51:07 2022] DELETE /compute/v2.1/servers/0daacd99-d9da-4360-90c3-fe7d0ec4fbb0 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 21:51:07.853674 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-fb52e58c-941b-44a8-a353-b50535cd924d tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:51:07.854430 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-fb52e58c-941b-44a8-a353-b50535cd924d tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 0daacd99-d9da-4360-90c3-fe7d0ec4fbb0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:51:07.862872 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fb52e58c-941b-44a8-a353-b50535cd924d tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:51:07.863386 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fb52e58c-941b-44a8-a353-b50535cd924d tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:51:07.864282 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fb52e58c-941b-44a8-a353-b50535cd924d tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:51:07.864723 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fb52e58c-941b-44a8-a353-b50535cd924d tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:51:08.101922 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-fb52e58c-941b-44a8-a353-b50535cd924d tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:51:08.109355 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-fb52e58c-941b-44a8-a353-b50535cd924d tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/0daacd99-d9da-4360-90c3-fe7d0ec4fbb0" status: 200 len: 1689 microversion: 2.1 time: 0.261093 Jan 15 21:51:08.110297 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4087/8163] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:51:07 2022] GET /compute/v2.1/servers/0daacd99-d9da-4360-90c3-fe7d0ec4fbb0 => generated 1689 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:51:09.127714 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b413a302-2fe5-4e1e-9cfa-026ab4864483 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:51:09.128427 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b413a302-2fe5-4e1e-9cfa-026ab4864483 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 0daacd99-d9da-4360-90c3-fe7d0ec4fbb0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:51:09.135467 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b413a302-2fe5-4e1e-9cfa-026ab4864483 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:51:09.135938 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b413a302-2fe5-4e1e-9cfa-026ab4864483 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:51:09.136734 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b413a302-2fe5-4e1e-9cfa-026ab4864483 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:51:09.137214 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b413a302-2fe5-4e1e-9cfa-026ab4864483 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:51:09.271246 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-b413a302-2fe5-4e1e-9cfa-026ab4864483 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:51:09.278678 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b413a302-2fe5-4e1e-9cfa-026ab4864483 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/0daacd99-d9da-4360-90c3-fe7d0ec4fbb0" status: 200 len: 1570 microversion: 2.1 time: 0.155362 Jan 15 21:51:09.279261 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4077/8164] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:51:09 2022] GET /compute/v2.1/servers/0daacd99-d9da-4360-90c3-fe7d0ec4fbb0 => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:51:10.023279 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-1ef68d01-1575-4095-a1a9-2685ffb805da req-5022de11-b24d-4364-9b57-103ac82ba5d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0daacd99-d9da-4360-90c3-fe7d0ec4fbb0", "name": "network-vif-deleted", "tag": "5351998c-0901-482c-91a3-cf7c1f3de48f"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:51:10.024916 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:51:10.024916 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:51:10.036539 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-1ef68d01-1575-4095-a1a9-2685ffb805da req-5022de11-b24d-4364-9b57-103ac82ba5d0 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:51:10.037351 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-1ef68d01-1575-4095-a1a9-2685ffb805da req-5022de11-b24d-4364-9b57-103ac82ba5d0 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:51:10.048293 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-1ef68d01-1575-4095-a1a9-2685ffb805da req-5022de11-b24d-4364-9b57-103ac82ba5d0 service nova] Creating event network-vif-deleted:5351998c-0901-482c-91a3-cf7c1f3de48f for instance 0daacd99-d9da-4360-90c3-fe7d0ec4fbb0 on nch2-master-1 Jan 15 21:51:10.054571 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-1ef68d01-1575-4095-a1a9-2685ffb805da req-5022de11-b24d-4364-9b57-103ac82ba5d0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035588 Jan 15 21:51:10.055726 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4088/8165] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:51:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:51:10.296959 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-eb4900be-0435-46c4-af72-f5e546dcafa9 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:51:10.297590 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-eb4900be-0435-46c4-af72-f5e546dcafa9 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 0daacd99-d9da-4360-90c3-fe7d0ec4fbb0] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:51:10.304716 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-eb4900be-0435-46c4-af72-f5e546dcafa9 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:51:10.305217 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-eb4900be-0435-46c4-af72-f5e546dcafa9 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:51:10.306036 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-eb4900be-0435-46c4-af72-f5e546dcafa9 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:51:10.306493 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-eb4900be-0435-46c4-af72-f5e546dcafa9 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:51:10.340410 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-eb4900be-0435-46c4-af72-f5e546dcafa9 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:51:10.340902 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-eb4900be-0435-46c4-af72-f5e546dcafa9 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:51:10.341384 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.objects.instance [None req-eb4900be-0435-46c4-af72-f5e546dcafa9 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lazy-loading 'fault' on Instance uuid 0daacd99-d9da-4360-90c3-fe7d0ec4fbb0 {{(pid=129365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 21:51:10.384131 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-eb4900be-0435-46c4-af72-f5e546dcafa9 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd93f3b669e4901b2a805ce60ca057e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21548044704a2bbfc4ed1612c66fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:51:10.393319 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-eb4900be-0435-46c4-af72-f5e546dcafa9 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/0daacd99-d9da-4360-90c3-fe7d0ec4fbb0" status: 200 len: 1355 microversion: 2.1 time: 0.100175 Jan 15 21:51:10.393917 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4078/8166] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:51:10 2022] GET /compute/v2.1/servers/0daacd99-d9da-4360-90c3-fe7d0ec4fbb0 => generated 1355 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:51:11.413427 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e0565a52-f5ad-4a18-9b25-41a54f569ea3 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:51:11.414472 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e0565a52-f5ad-4a18-9b25-41a54f569ea3 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] [instance: 0daacd99-d9da-4360-90c3-fe7d0ec4fbb0] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:51:11.420755 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e0565a52-f5ad-4a18-9b25-41a54f569ea3 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:51:11.421241 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e0565a52-f5ad-4a18-9b25-41a54f569ea3 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:51:11.422023 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e0565a52-f5ad-4a18-9b25-41a54f569ea3 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:51:11.422464 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e0565a52-f5ad-4a18-9b25-41a54f569ea3 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:51:11.436150 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-e0565a52-f5ad-4a18-9b25-41a54f569ea3 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] HTTP exception thrown: Instance 0daacd99-d9da-4360-90c3-fe7d0ec4fbb0 could not be found. Jan 15 21:51:11.436736 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e0565a52-f5ad-4a18-9b25-41a54f569ea3 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Returning 404 to user: Instance 0daacd99-d9da-4360-90c3-fe7d0ec4fbb0 could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:51:11.437605 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e0565a52-f5ad-4a18-9b25-41a54f569ea3 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "GET /compute/v2.1/servers/0daacd99-d9da-4360-90c3-fe7d0ec4fbb0" status: 404 len: 111 microversion: 2.1 time: 0.029817 Jan 15 21:51:11.438145 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4089/8167] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:51:11 2022] GET /compute/v2.1/servers/0daacd99-d9da-4360-90c3-fe7d0ec4fbb0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:51:14.610338 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a5ed09c2-fe80-4a11-bbdc-d6b338db80e5 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] Calling method '.version_select at 0x7f30c858a1f0>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:51:14.634609 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a5ed09c2-fe80-4a11-bbdc-d6b338db80e5 tempest-TestNetworkAdvancedServerOps-788050994 tempest-TestNetworkAdvancedServerOps-788050994-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-559864971" status: 202 len: 0 microversion: 2.1 time: 0.027954 Jan 15 21:51:14.635296 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4079/8168] 10.222.0.46 () {58 vars in 1280 bytes} [Sat Jan 15 21:51:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-559864971 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:51:26.607201 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-12be52a9-a6ef-49d9-812b-7310087f3b72 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Action: 'create', calling method: .version_select at 0x7f30c804e8b0>, body: {"keypair": {"name": "tempest-TestShelveInstance-46981826"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:51:26.622482 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-12be52a9-a6ef-49d9-812b-7310087f3b72 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Getting quotas for project 4cbeb500a7e84c5d8f6c765ef6530484. Resources: {'key_pairs'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:51:26.628802 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-12be52a9-a6ef-49d9-812b-7310087f3b72 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Getting quotas for user cd71ca21ce8c455a92db914d0c7e622f and project 4cbeb500a7e84c5d8f6c765ef6530484. Resources: {'key_pairs'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:51:26.962382 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-12be52a9-a6ef-49d9-812b-7310087f3b72 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Getting quotas for project 4cbeb500a7e84c5d8f6c765ef6530484. Resources: {'key_pairs'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:51:26.967241 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-12be52a9-a6ef-49d9-812b-7310087f3b72 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Getting quotas for user cd71ca21ce8c455a92db914d0c7e622f and project 4cbeb500a7e84c5d8f6c765ef6530484. Resources: {'key_pairs'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:51:26.986515 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-12be52a9-a6ef-49d9-812b-7310087f3b72 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 2310 microversion: 2.1 time: 0.600517 Jan 15 21:51:26.987618 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4090/8169] 10.222.0.46 () {60 vars in 1157 bytes} [Sat Jan 15 21:51:26 2022] POST /compute/v2.1/os-keypairs => generated 2310 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:51:27.941787 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ef8cfeed-e670-4d09-a6b5-191a1024d6d5 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1318200545", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-46981826", "security_groups": [{"name": "tempest-secgroup-smoke-480606199"}], "networks": [{"uuid": "f21819f5-21e2-4a05-8ef0-afdd46994d45"}]}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:51:28.048373 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.network.neutron [None req-ef8cfeed-e670-4d09-a6b5-191a1024d6d5 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] validate_networks() for [('f21819f5-21e2-4a05-8ef0-afdd46994d45', None, None, None, None, None)] {{(pid=129365) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 21:51:28.424608 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-ef8cfeed-e670-4d09-a6b5-191a1024d6d5 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Flavor limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 21:51:28.425084 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-ef8cfeed-e670-4d09-a6b5-191a1024d6d5 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Image limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 21:51:28.425616 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-ef8cfeed-e670-4d09-a6b5-191a1024d6d5 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Flavor pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 21:51:28.426114 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-ef8cfeed-e670-4d09-a6b5-191a1024d6d5 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Image pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 21:51:28.426547 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-ef8cfeed-e670-4d09-a6b5-191a1024d6d5 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 21:51:28.435333 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ef8cfeed-e670-4d09-a6b5-191a1024d6d5 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:51:28.435795 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ef8cfeed-e670-4d09-a6b5-191a1024d6d5 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:51:28.436620 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ef8cfeed-e670-4d09-a6b5-191a1024d6d5 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:51:28.437127 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ef8cfeed-e670-4d09-a6b5-191a1024d6d5 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:51:28.454491 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-ef8cfeed-e670-4d09-a6b5-191a1024d6d5 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Getting quotas for project 4cbeb500a7e84c5d8f6c765ef6530484. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:51:28.461072 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-ef8cfeed-e670-4d09-a6b5-191a1024d6d5 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Getting quotas for user cd71ca21ce8c455a92db914d0c7e622f and project 4cbeb500a7e84c5d8f6c765ef6530484. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:51:28.474413 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ef8cfeed-e670-4d09-a6b5-191a1024d6d5 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Going to run 1 instances... {{(pid=129365) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 21:51:28.476795 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ef8cfeed-e670-4d09-a6b5-191a1024d6d5 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] [instance: fcfdf5da-b32d-4782-869b-97d45817dd5c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129365) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 21:51:28.524822 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ef8cfeed-e670-4d09-a6b5-191a1024d6d5 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.586965 Jan 15 21:51:28.526067 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4080/8170] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 21:51:27 2022] POST /compute/v2.1/servers => generated 405 bytes in 589 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 21:51:28.538534 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7dcf4562-b721-4a36-8b7a-01943ee173ba tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:51:28.541832 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-7dcf4562-b721-4a36-8b7a-01943ee173ba tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] [instance: fcfdf5da-b32d-4782-869b-97d45817dd5c] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:51:28.650150 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-7dcf4562-b721-4a36-8b7a-01943ee173ba tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd71ca21ce8c455a92db914d0c7e622f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cbeb500a7e84c5d8f6c765ef6530484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:51:28.657227 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7dcf4562-b721-4a36-8b7a-01943ee173ba tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] 10.222.0.46 "GET /compute/v2.1/servers/fcfdf5da-b32d-4782-869b-97d45817dd5c" status: 200 len: 1245 microversion: 2.1 time: 0.125378 Jan 15 21:51:28.658402 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4091/8171] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:51:28 2022] GET /compute/v2.1/servers/fcfdf5da-b32d-4782-869b-97d45817dd5c => generated 1245 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:51:29.677632 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8a85f465-b0f4-4550-8223-244725224ce0 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:51:29.678397 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-8a85f465-b0f4-4550-8223-244725224ce0 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] [instance: fcfdf5da-b32d-4782-869b-97d45817dd5c] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:51:29.685667 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8a85f465-b0f4-4550-8223-244725224ce0 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:51:29.686220 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8a85f465-b0f4-4550-8223-244725224ce0 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:51:29.687105 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8a85f465-b0f4-4550-8223-244725224ce0 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:51:29.687565 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8a85f465-b0f4-4550-8223-244725224ce0 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:51:29.768879 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-8a85f465-b0f4-4550-8223-244725224ce0 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd71ca21ce8c455a92db914d0c7e622f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cbeb500a7e84c5d8f6c765ef6530484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:51:29.777804 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-8a85f465-b0f4-4550-8223-244725224ce0 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] 10.222.0.46 "GET /compute/v2.1/servers/fcfdf5da-b32d-4782-869b-97d45817dd5c" status: 200 len: 1297 microversion: 2.1 time: 0.105781 Jan 15 21:51:29.778590 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4081/8172] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:51:29 2022] GET /compute/v2.1/servers/fcfdf5da-b32d-4782-869b-97d45817dd5c => generated 1297 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:51:30.795824 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4905ee73-1b91-45df-89ae-93cb36a8c688 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:51:30.796704 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-4905ee73-1b91-45df-89ae-93cb36a8c688 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] [instance: fcfdf5da-b32d-4782-869b-97d45817dd5c] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:51:30.808504 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4905ee73-1b91-45df-89ae-93cb36a8c688 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:51:30.808881 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4905ee73-1b91-45df-89ae-93cb36a8c688 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:51:30.809692 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4905ee73-1b91-45df-89ae-93cb36a8c688 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:51:30.810125 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4905ee73-1b91-45df-89ae-93cb36a8c688 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:51:31.031725 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-4905ee73-1b91-45df-89ae-93cb36a8c688 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd71ca21ce8c455a92db914d0c7e622f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cbeb500a7e84c5d8f6c765ef6530484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:51:31.039970 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-4905ee73-1b91-45df-89ae-93cb36a8c688 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] 10.222.0.46 "GET /compute/v2.1/servers/fcfdf5da-b32d-4782-869b-97d45817dd5c" status: 200 len: 1370 microversion: 2.1 time: 0.247975 Jan 15 21:51:31.040569 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4092/8173] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:51:30 2022] GET /compute/v2.1/servers/fcfdf5da-b32d-4782-869b-97d45817dd5c => generated 1370 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:51:31.334242 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-1993fc9f-b45b-4df7-b4ba-ddfc0b78e30e req-10d0c5a5-a261-49e3-bd3d-32da7ed8ded0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fcfdf5da-b32d-4782-869b-97d45817dd5c", "tag": "b23ffb45-4fb8-4e27-8653-b756ce0ae1d5"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:51:31.336035 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:51:31.336035 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:51:31.345220 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-1993fc9f-b45b-4df7-b4ba-ddfc0b78e30e req-10d0c5a5-a261-49e3-bd3d-32da7ed8ded0 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:51:31.345881 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-1993fc9f-b45b-4df7-b4ba-ddfc0b78e30e req-10d0c5a5-a261-49e3-bd3d-32da7ed8ded0 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:51:31.359570 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-1993fc9f-b45b-4df7-b4ba-ddfc0b78e30e req-10d0c5a5-a261-49e3-bd3d-32da7ed8ded0 service nova] Creating event network-changed:b23ffb45-4fb8-4e27-8653-b756ce0ae1d5 for instance fcfdf5da-b32d-4782-869b-97d45817dd5c on nch2-master-1 Jan 15 21:51:31.365398 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-1993fc9f-b45b-4df7-b4ba-ddfc0b78e30e req-10d0c5a5-a261-49e3-bd3d-32da7ed8ded0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035412 Jan 15 21:51:31.369038 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4082/8174] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:51:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:51:32.057497 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-75e99fc2-f933-413e-9f9e-d16c0b0def65 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:51:32.058153 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-75e99fc2-f933-413e-9f9e-d16c0b0def65 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] [instance: fcfdf5da-b32d-4782-869b-97d45817dd5c] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:51:32.064804 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-75e99fc2-f933-413e-9f9e-d16c0b0def65 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:51:32.065283 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-75e99fc2-f933-413e-9f9e-d16c0b0def65 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:51:32.066068 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-75e99fc2-f933-413e-9f9e-d16c0b0def65 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:51:32.066534 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-75e99fc2-f933-413e-9f9e-d16c0b0def65 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:51:32.295666 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-75e99fc2-f933-413e-9f9e-d16c0b0def65 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd71ca21ce8c455a92db914d0c7e622f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cbeb500a7e84c5d8f6c765ef6530484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:51:32.304360 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-75e99fc2-f933-413e-9f9e-d16c0b0def65 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] 10.222.0.46 "GET /compute/v2.1/servers/fcfdf5da-b32d-4782-869b-97d45817dd5c" status: 200 len: 1370 microversion: 2.1 time: 0.250325 Jan 15 21:51:32.305679 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4093/8175] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:51:32 2022] GET /compute/v2.1/servers/fcfdf5da-b32d-4782-869b-97d45817dd5c => generated 1370 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:51:33.323132 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-fd52ac2c-5355-41aa-9811-5113e44f5e4d tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:51:33.323754 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-fd52ac2c-5355-41aa-9811-5113e44f5e4d tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] [instance: fcfdf5da-b32d-4782-869b-97d45817dd5c] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:51:33.329941 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fd52ac2c-5355-41aa-9811-5113e44f5e4d tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:51:33.330402 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fd52ac2c-5355-41aa-9811-5113e44f5e4d tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:51:33.331190 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fd52ac2c-5355-41aa-9811-5113e44f5e4d tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:51:33.331637 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fd52ac2c-5355-41aa-9811-5113e44f5e4d tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:51:33.465528 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-fd52ac2c-5355-41aa-9811-5113e44f5e4d tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd71ca21ce8c455a92db914d0c7e622f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cbeb500a7e84c5d8f6c765ef6530484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:51:33.473550 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-fd52ac2c-5355-41aa-9811-5113e44f5e4d tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] 10.222.0.46 "GET /compute/v2.1/servers/fcfdf5da-b32d-4782-869b-97d45817dd5c" status: 200 len: 1370 microversion: 2.1 time: 0.154754 Jan 15 21:51:33.474135 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4083/8176] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:51:33 2022] GET /compute/v2.1/servers/fcfdf5da-b32d-4782-869b-97d45817dd5c => generated 1370 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:51:34.491167 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7a56fb9c-6596-4ac9-83df-32dfec915214 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:51:34.491773 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-7a56fb9c-6596-4ac9-83df-32dfec915214 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] [instance: fcfdf5da-b32d-4782-869b-97d45817dd5c] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:51:34.498453 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7a56fb9c-6596-4ac9-83df-32dfec915214 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:51:34.498900 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7a56fb9c-6596-4ac9-83df-32dfec915214 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:51:34.499671 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7a56fb9c-6596-4ac9-83df-32dfec915214 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:51:34.500101 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7a56fb9c-6596-4ac9-83df-32dfec915214 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:51:34.725076 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-7a56fb9c-6596-4ac9-83df-32dfec915214 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd71ca21ce8c455a92db914d0c7e622f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cbeb500a7e84c5d8f6c765ef6530484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:51:34.732479 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7a56fb9c-6596-4ac9-83df-32dfec915214 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] 10.222.0.46 "GET /compute/v2.1/servers/fcfdf5da-b32d-4782-869b-97d45817dd5c" status: 200 len: 1370 microversion: 2.1 time: 0.245683 Jan 15 21:51:34.733099 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4094/8177] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:51:34 2022] GET /compute/v2.1/servers/fcfdf5da-b32d-4782-869b-97d45817dd5c => generated 1370 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:51:35.749257 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-b02b9e6d-36c3-4809-96e9-74d51e02c649 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:51:35.749910 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-b02b9e6d-36c3-4809-96e9-74d51e02c649 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] [instance: fcfdf5da-b32d-4782-869b-97d45817dd5c] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:51:35.757410 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b02b9e6d-36c3-4809-96e9-74d51e02c649 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:51:35.757872 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b02b9e6d-36c3-4809-96e9-74d51e02c649 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:51:35.758657 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b02b9e6d-36c3-4809-96e9-74d51e02c649 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:51:35.759102 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-b02b9e6d-36c3-4809-96e9-74d51e02c649 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:51:35.943133 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-b02b9e6d-36c3-4809-96e9-74d51e02c649 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd71ca21ce8c455a92db914d0c7e622f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cbeb500a7e84c5d8f6c765ef6530484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:51:35.950595 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-b02b9e6d-36c3-4809-96e9-74d51e02c649 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] 10.222.0.46 "GET /compute/v2.1/servers/fcfdf5da-b32d-4782-869b-97d45817dd5c" status: 200 len: 1370 microversion: 2.1 time: 0.204984 Jan 15 21:51:35.951106 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4084/8178] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:51:35 2022] GET /compute/v2.1/servers/fcfdf5da-b32d-4782-869b-97d45817dd5c => generated 1370 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:51:36.799249 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-f90ccb9b-a3bf-445b-aa1b-65fab3d367f1 req-871c41a0-2d02-4072-b353-e77d1851add8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcfdf5da-b32d-4782-869b-97d45817dd5c", "name": "network-vif-plugged", "status": "completed", "tag": "b23ffb45-4fb8-4e27-8653-b756ce0ae1d5"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:51:36.801782 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:51:36.801782 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:51:36.811187 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-f90ccb9b-a3bf-445b-aa1b-65fab3d367f1 req-871c41a0-2d02-4072-b353-e77d1851add8 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:51:36.811635 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-f90ccb9b-a3bf-445b-aa1b-65fab3d367f1 req-871c41a0-2d02-4072-b353-e77d1851add8 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:51:36.823930 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-f90ccb9b-a3bf-445b-aa1b-65fab3d367f1 req-871c41a0-2d02-4072-b353-e77d1851add8 service nova] Creating event network-vif-plugged:b23ffb45-4fb8-4e27-8653-b756ce0ae1d5 for instance fcfdf5da-b32d-4782-869b-97d45817dd5c on nch2-master-1 Jan 15 21:51:36.829170 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-f90ccb9b-a3bf-445b-aa1b-65fab3d367f1 req-871c41a0-2d02-4072-b353-e77d1851add8 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033600 Jan 15 21:51:36.829772 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4095/8179] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:51:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 21:51:36.967391 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e31dc6d3-ce01-47fc-8d75-fc5989cc20a4 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:51:36.968105 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e31dc6d3-ce01-47fc-8d75-fc5989cc20a4 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] [instance: fcfdf5da-b32d-4782-869b-97d45817dd5c] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:51:36.974987 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e31dc6d3-ce01-47fc-8d75-fc5989cc20a4 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:51:36.975455 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e31dc6d3-ce01-47fc-8d75-fc5989cc20a4 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:51:36.976255 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e31dc6d3-ce01-47fc-8d75-fc5989cc20a4 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:51:36.976706 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e31dc6d3-ce01-47fc-8d75-fc5989cc20a4 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:51:37.115340 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-e31dc6d3-ce01-47fc-8d75-fc5989cc20a4 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd71ca21ce8c455a92db914d0c7e622f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cbeb500a7e84c5d8f6c765ef6530484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:51:37.122807 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e31dc6d3-ce01-47fc-8d75-fc5989cc20a4 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] 10.222.0.46 "GET /compute/v2.1/servers/fcfdf5da-b32d-4782-869b-97d45817dd5c" status: 200 len: 1370 microversion: 2.1 time: 0.159068 Jan 15 21:51:37.123402 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4085/8180] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:51:36 2022] GET /compute/v2.1/servers/fcfdf5da-b32d-4782-869b-97d45817dd5c => generated 1370 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:51:38.139951 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-47169996-bbc0-414b-b94f-bf304a79549f tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:51:38.140678 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-47169996-bbc0-414b-b94f-bf304a79549f tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] [instance: fcfdf5da-b32d-4782-869b-97d45817dd5c] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:51:38.147675 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-47169996-bbc0-414b-b94f-bf304a79549f tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:51:38.148136 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-47169996-bbc0-414b-b94f-bf304a79549f tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:51:38.149112 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-47169996-bbc0-414b-b94f-bf304a79549f tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:51:38.149638 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-47169996-bbc0-414b-b94f-bf304a79549f tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:51:38.281633 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-47169996-bbc0-414b-b94f-bf304a79549f tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd71ca21ce8c455a92db914d0c7e622f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cbeb500a7e84c5d8f6c765ef6530484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:51:38.293790 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-47169996-bbc0-414b-b94f-bf304a79549f tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] 10.222.0.46 "GET /compute/v2.1/servers/fcfdf5da-b32d-4782-869b-97d45817dd5c" status: 200 len: 1555 microversion: 2.1 time: 0.157890 Jan 15 21:51:38.294642 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4096/8181] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:51:38 2022] GET /compute/v2.1/servers/fcfdf5da-b32d-4782-869b-97d45817dd5c => generated 1555 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:51:38.311559 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5e7a1b89-c13c-4f2e-9cbd-724777745909 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:51:38.312172 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-5e7a1b89-c13c-4f2e-9cbd-724777745909 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] [instance: fcfdf5da-b32d-4782-869b-97d45817dd5c] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:51:38.318980 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5e7a1b89-c13c-4f2e-9cbd-724777745909 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:51:38.319438 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5e7a1b89-c13c-4f2e-9cbd-724777745909 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:51:38.320223 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5e7a1b89-c13c-4f2e-9cbd-724777745909 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:51:38.320667 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5e7a1b89-c13c-4f2e-9cbd-724777745909 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:51:38.458187 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-5e7a1b89-c13c-4f2e-9cbd-724777745909 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd71ca21ce8c455a92db914d0c7e622f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cbeb500a7e84c5d8f6c765ef6530484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:51:38.465606 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5e7a1b89-c13c-4f2e-9cbd-724777745909 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] 10.222.0.46 "GET /compute/v2.1/servers/fcfdf5da-b32d-4782-869b-97d45817dd5c" status: 200 len: 1555 microversion: 2.1 time: 0.157730 Jan 15 21:51:38.466175 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4086/8182] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:51:38 2022] GET /compute/v2.1/servers/fcfdf5da-b32d-4782-869b-97d45817dd5c => generated 1555 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:51:40.122617 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-1075927c-56e3-41a0-8557-0d10d0109818 req-d80e4e78-7cdc-418d-8761-1ade8c95925a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fcfdf5da-b32d-4782-869b-97d45817dd5c", "tag": "b23ffb45-4fb8-4e27-8653-b756ce0ae1d5"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:51:40.124141 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:51:40.124141 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:51:40.133032 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-1075927c-56e3-41a0-8557-0d10d0109818 req-d80e4e78-7cdc-418d-8761-1ade8c95925a service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:51:40.133563 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-1075927c-56e3-41a0-8557-0d10d0109818 req-d80e4e78-7cdc-418d-8761-1ade8c95925a service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:51:40.145482 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-1075927c-56e3-41a0-8557-0d10d0109818 req-d80e4e78-7cdc-418d-8761-1ade8c95925a service nova] Creating event network-changed:b23ffb45-4fb8-4e27-8653-b756ce0ae1d5 for instance fcfdf5da-b32d-4782-869b-97d45817dd5c on nch2-master-1 Jan 15 21:51:40.150624 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-1075927c-56e3-41a0-8557-0d10d0109818 req-d80e4e78-7cdc-418d-8761-1ade8c95925a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031621 Jan 15 21:51:40.151224 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4097/8183] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:51:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:53:31.068389 ncdv-master-1 devstack@n-api.service[129366]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 15 21:53:31.069147 ncdv-master-1 devstack@n-api.service[129366]: Sat Jan 15 21:53:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 15 21:53:31.341371 ncdv-master-1 devstack@n-api.service[129365]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 15 21:53:31.341941 ncdv-master-1 devstack@n-api.service[129365]: Sat Jan 15 21:53:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 15 21:53:37.355188 ncdv-master-1 devstack@n-api.service[129365]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4ccfdfad-4291-4179-af77-e203370d1c4c] AMQP server on 10.222.0.46:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jan 15 21:53:37.358782 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-7eb30427-1b58-4720-a46c-e94a1d9f0803 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:53:37.359314 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-7eb30427-1b58-4720-a46c-e94a1d9f0803 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] [instance: fcfdf5da-b32d-4782-869b-97d45817dd5c] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:53:37.367478 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7eb30427-1b58-4720-a46c-e94a1d9f0803 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:53:37.367945 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7eb30427-1b58-4720-a46c-e94a1d9f0803 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:53:37.368747 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7eb30427-1b58-4720-a46c-e94a1d9f0803 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:53:37.369232 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-7eb30427-1b58-4720-a46c-e94a1d9f0803 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:53:37.393204 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.objects.instance [None req-7eb30427-1b58-4720-a46c-e94a1d9f0803 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lazy-loading 'flavor' on Instance uuid fcfdf5da-b32d-4782-869b-97d45817dd5c {{(pid=129365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 21:53:37.663144 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-7eb30427-1b58-4720-a46c-e94a1d9f0803 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] 10.222.0.46 "POST /compute/v2.1/servers/fcfdf5da-b32d-4782-869b-97d45817dd5c/action" status: 202 len: 0 microversion: 2.1 time: 0.308609 Jan 15 21:53:37.663774 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4087/8184] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:53:37 2022] POST /compute/v2.1/servers/fcfdf5da-b32d-4782-869b-97d45817dd5c/action => generated 0 bytes in 312 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:53:37.671602 ncdv-master-1 devstack@n-api.service[129366]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4346cd47-e793-4d94-9b2f-ad282883a042] AMQP server on 10.222.0.46:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jan 15 21:53:37.672590 ncdv-master-1 devstack@n-api.service[129366]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f3ab03e4-0e3e-4ca8-9e53-9b880d1e14ab] AMQP server on 10.222.0.46:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 15 21:53:37.676584 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e721f34b-1642-4d29-9d40-fcaec8b3a626 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:53:37.677410 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e721f34b-1642-4d29-9d40-fcaec8b3a626 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] [instance: fcfdf5da-b32d-4782-869b-97d45817dd5c] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:53:37.684214 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e721f34b-1642-4d29-9d40-fcaec8b3a626 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:53:37.684666 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e721f34b-1642-4d29-9d40-fcaec8b3a626 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:53:37.685482 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e721f34b-1642-4d29-9d40-fcaec8b3a626 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:53:37.685958 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e721f34b-1642-4d29-9d40-fcaec8b3a626 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:53:37.822454 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-e721f34b-1642-4d29-9d40-fcaec8b3a626 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd71ca21ce8c455a92db914d0c7e622f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cbeb500a7e84c5d8f6c765ef6530484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:53:37.830051 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e721f34b-1642-4d29-9d40-fcaec8b3a626 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] 10.222.0.46 "GET /compute/v2.1/servers/fcfdf5da-b32d-4782-869b-97d45817dd5c" status: 200 len: 1679 microversion: 2.1 time: 0.161578 Jan 15 21:53:37.830632 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4098/8185] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:53:37 2022] GET /compute/v2.1/servers/fcfdf5da-b32d-4782-869b-97d45817dd5c => generated 1679 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:53:38.851599 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ed57b60b-ccf8-4cb9-90a4-346e4a65b48f tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:53:38.852303 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ed57b60b-ccf8-4cb9-90a4-346e4a65b48f tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] [instance: fcfdf5da-b32d-4782-869b-97d45817dd5c] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:53:38.860337 ncdv-master-1 devstack@n-api.service[129365]: INFO oslo.messaging._drivers.impl_rabbit [-] [4ccfdfad-4291-4179-af77-e203370d1c4c] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 41814. Jan 15 21:53:38.865499 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ed57b60b-ccf8-4cb9-90a4-346e4a65b48f tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:53:38.865978 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ed57b60b-ccf8-4cb9-90a4-346e4a65b48f tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:53:38.866779 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ed57b60b-ccf8-4cb9-90a4-346e4a65b48f tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:53:38.867226 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ed57b60b-ccf8-4cb9-90a4-346e4a65b48f tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:53:39.007063 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-ed57b60b-ccf8-4cb9-90a4-346e4a65b48f tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd71ca21ce8c455a92db914d0c7e622f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cbeb500a7e84c5d8f6c765ef6530484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:53:39.014419 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ed57b60b-ccf8-4cb9-90a4-346e4a65b48f tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] 10.222.0.46 "GET /compute/v2.1/servers/fcfdf5da-b32d-4782-869b-97d45817dd5c" status: 200 len: 1679 microversion: 2.1 time: 0.170634 Jan 15 21:53:39.014990 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4088/8186] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:53:38 2022] GET /compute/v2.1/servers/fcfdf5da-b32d-4782-869b-97d45817dd5c => generated 1679 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:53:40.032348 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7a1ab073-a612-40e1-9557-f74791f4981d tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:53:40.032959 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-7a1ab073-a612-40e1-9557-f74791f4981d tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] [instance: fcfdf5da-b32d-4782-869b-97d45817dd5c] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:53:40.042958 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7a1ab073-a612-40e1-9557-f74791f4981d tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:53:40.043411 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7a1ab073-a612-40e1-9557-f74791f4981d tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:53:40.044199 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7a1ab073-a612-40e1-9557-f74791f4981d tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:53:40.044633 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7a1ab073-a612-40e1-9557-f74791f4981d tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:53:40.054236 ncdv-master-1 devstack@n-api.service[129366]: INFO oslo.messaging._drivers.impl_rabbit [-] [f3ab03e4-0e3e-4ca8-9e53-9b880d1e14ab] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 41820. Jan 15 21:53:40.063347 ncdv-master-1 devstack@n-api.service[129366]: INFO oslo.messaging._drivers.impl_rabbit [-] [4346cd47-e793-4d94-9b2f-ad282883a042] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 41818. Jan 15 21:53:40.182495 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-7a1ab073-a612-40e1-9557-f74791f4981d tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd71ca21ce8c455a92db914d0c7e622f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cbeb500a7e84c5d8f6c765ef6530484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:53:40.189962 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7a1ab073-a612-40e1-9557-f74791f4981d tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] 10.222.0.46 "GET /compute/v2.1/servers/fcfdf5da-b32d-4782-869b-97d45817dd5c" status: 200 len: 1679 microversion: 2.1 time: 0.161442 Jan 15 21:53:40.190545 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4099/8187] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:53:40 2022] GET /compute/v2.1/servers/fcfdf5da-b32d-4782-869b-97d45817dd5c => generated 1679 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:53:41.207611 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8428b99d-f837-4af3-89d8-c58e4aa52877 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:53:41.208236 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-8428b99d-f837-4af3-89d8-c58e4aa52877 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] [instance: fcfdf5da-b32d-4782-869b-97d45817dd5c] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:53:41.216316 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8428b99d-f837-4af3-89d8-c58e4aa52877 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:53:41.216780 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8428b99d-f837-4af3-89d8-c58e4aa52877 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:53:41.217607 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8428b99d-f837-4af3-89d8-c58e4aa52877 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:53:41.218053 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8428b99d-f837-4af3-89d8-c58e4aa52877 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:53:41.355237 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-8428b99d-f837-4af3-89d8-c58e4aa52877 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd71ca21ce8c455a92db914d0c7e622f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cbeb500a7e84c5d8f6c765ef6530484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:53:41.362819 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-8428b99d-f837-4af3-89d8-c58e4aa52877 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] 10.222.0.46 "GET /compute/v2.1/servers/fcfdf5da-b32d-4782-869b-97d45817dd5c" status: 200 len: 1679 microversion: 2.1 time: 0.158984 Jan 15 21:53:41.363389 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4089/8188] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:53:41 2022] GET /compute/v2.1/servers/fcfdf5da-b32d-4782-869b-97d45817dd5c => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:53:42.381107 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-bf7020d6-60b3-4358-b6c1-b9556fdc338b tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:53:42.381809 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-bf7020d6-60b3-4358-b6c1-b9556fdc338b tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] [instance: fcfdf5da-b32d-4782-869b-97d45817dd5c] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:53:42.388491 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bf7020d6-60b3-4358-b6c1-b9556fdc338b tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:53:42.388982 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bf7020d6-60b3-4358-b6c1-b9556fdc338b tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:53:42.389762 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bf7020d6-60b3-4358-b6c1-b9556fdc338b tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:53:42.390200 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bf7020d6-60b3-4358-b6c1-b9556fdc338b tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:53:42.523023 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-bf7020d6-60b3-4358-b6c1-b9556fdc338b tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd71ca21ce8c455a92db914d0c7e622f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cbeb500a7e84c5d8f6c765ef6530484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:53:42.531180 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-bf7020d6-60b3-4358-b6c1-b9556fdc338b tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] 10.222.0.46 "GET /compute/v2.1/servers/fcfdf5da-b32d-4782-869b-97d45817dd5c" status: 200 len: 1679 microversion: 2.1 time: 0.154397 Jan 15 21:53:42.531753 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4100/8189] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:53:42 2022] GET /compute/v2.1/servers/fcfdf5da-b32d-4782-869b-97d45817dd5c => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:53:43.550761 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-4a8438f8-a6b0-4255-aae6-bbc43a28489d tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:53:43.551375 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-4a8438f8-a6b0-4255-aae6-bbc43a28489d tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] [instance: fcfdf5da-b32d-4782-869b-97d45817dd5c] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:53:43.558790 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4a8438f8-a6b0-4255-aae6-bbc43a28489d tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:53:43.559248 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4a8438f8-a6b0-4255-aae6-bbc43a28489d tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:53:43.560035 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4a8438f8-a6b0-4255-aae6-bbc43a28489d tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:53:43.560481 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4a8438f8-a6b0-4255-aae6-bbc43a28489d tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:53:43.694197 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-4a8438f8-a6b0-4255-aae6-bbc43a28489d tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd71ca21ce8c455a92db914d0c7e622f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cbeb500a7e84c5d8f6c765ef6530484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:53:43.701890 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-4a8438f8-a6b0-4255-aae6-bbc43a28489d tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] 10.222.0.46 "GET /compute/v2.1/servers/fcfdf5da-b32d-4782-869b-97d45817dd5c" status: 200 len: 1679 microversion: 2.1 time: 0.154851 Jan 15 21:53:43.702694 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4090/8190] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:53:43 2022] GET /compute/v2.1/servers/fcfdf5da-b32d-4782-869b-97d45817dd5c => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:53:43.710070 ncdv-master-1 devstack@n-api.service[129366]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 15 21:53:43.710544 ncdv-master-1 devstack@n-api.service[129366]: Sat Jan 15 21:53:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 15 21:53:44.719385 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-565a3273-c839-4f87-b43c-8a870ff8fe16 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:53:44.720066 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-565a3273-c839-4f87-b43c-8a870ff8fe16 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] [instance: fcfdf5da-b32d-4782-869b-97d45817dd5c] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:53:44.726921 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-565a3273-c839-4f87-b43c-8a870ff8fe16 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:53:44.727369 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-565a3273-c839-4f87-b43c-8a870ff8fe16 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:53:44.728140 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-565a3273-c839-4f87-b43c-8a870ff8fe16 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:53:44.728571 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-565a3273-c839-4f87-b43c-8a870ff8fe16 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:53:44.864010 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-565a3273-c839-4f87-b43c-8a870ff8fe16 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd71ca21ce8c455a92db914d0c7e622f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cbeb500a7e84c5d8f6c765ef6530484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:53:44.871613 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-565a3273-c839-4f87-b43c-8a870ff8fe16 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] 10.222.0.46 "GET /compute/v2.1/servers/fcfdf5da-b32d-4782-869b-97d45817dd5c" status: 200 len: 1679 microversion: 2.1 time: 0.156059 Jan 15 21:53:44.872386 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4101/8191] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:53:44 2022] GET /compute/v2.1/servers/fcfdf5da-b32d-4782-869b-97d45817dd5c => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:53:45.889753 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5d9f0058-6440-4cb1-aa55-8cc853ce12bb tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:53:45.890374 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-5d9f0058-6440-4cb1-aa55-8cc853ce12bb tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] [instance: fcfdf5da-b32d-4782-869b-97d45817dd5c] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:53:45.899732 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5d9f0058-6440-4cb1-aa55-8cc853ce12bb tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:53:45.900199 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5d9f0058-6440-4cb1-aa55-8cc853ce12bb tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:53:45.901114 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5d9f0058-6440-4cb1-aa55-8cc853ce12bb tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:53:45.901568 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5d9f0058-6440-4cb1-aa55-8cc853ce12bb tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:53:46.033781 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-5d9f0058-6440-4cb1-aa55-8cc853ce12bb tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd71ca21ce8c455a92db914d0c7e622f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cbeb500a7e84c5d8f6c765ef6530484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:53:46.042260 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5d9f0058-6440-4cb1-aa55-8cc853ce12bb tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] 10.222.0.46 "GET /compute/v2.1/servers/fcfdf5da-b32d-4782-869b-97d45817dd5c" status: 200 len: 1679 microversion: 2.1 time: 0.156399 Jan 15 21:53:46.042833 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4091/8192] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:53:45 2022] GET /compute/v2.1/servers/fcfdf5da-b32d-4782-869b-97d45817dd5c => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:53:47.059190 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-5d84d277-f1a6-4d41-ba62-c6c4a7b2cba1 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:53:47.059784 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-5d84d277-f1a6-4d41-ba62-c6c4a7b2cba1 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] [instance: fcfdf5da-b32d-4782-869b-97d45817dd5c] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:53:47.066423 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5d84d277-f1a6-4d41-ba62-c6c4a7b2cba1 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:53:47.066869 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5d84d277-f1a6-4d41-ba62-c6c4a7b2cba1 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:53:47.067692 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5d84d277-f1a6-4d41-ba62-c6c4a7b2cba1 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:53:47.068131 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-5d84d277-f1a6-4d41-ba62-c6c4a7b2cba1 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:53:47.203316 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-5d84d277-f1a6-4d41-ba62-c6c4a7b2cba1 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd71ca21ce8c455a92db914d0c7e622f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cbeb500a7e84c5d8f6c765ef6530484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:53:47.210756 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-5d84d277-f1a6-4d41-ba62-c6c4a7b2cba1 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] 10.222.0.46 "GET /compute/v2.1/servers/fcfdf5da-b32d-4782-869b-97d45817dd5c" status: 200 len: 1679 microversion: 2.1 time: 0.155339 Jan 15 21:53:47.211323 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4102/8193] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:53:47 2022] GET /compute/v2.1/servers/fcfdf5da-b32d-4782-869b-97d45817dd5c => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:53:48.227146 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9e64d0dd-bbf2-4189-be47-844b01296a92 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:53:48.227747 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-9e64d0dd-bbf2-4189-be47-844b01296a92 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] [instance: fcfdf5da-b32d-4782-869b-97d45817dd5c] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:53:48.234571 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9e64d0dd-bbf2-4189-be47-844b01296a92 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:53:48.235051 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9e64d0dd-bbf2-4189-be47-844b01296a92 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:53:48.235831 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9e64d0dd-bbf2-4189-be47-844b01296a92 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:53:48.236278 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9e64d0dd-bbf2-4189-be47-844b01296a92 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:53:48.371468 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-9e64d0dd-bbf2-4189-be47-844b01296a92 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd71ca21ce8c455a92db914d0c7e622f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cbeb500a7e84c5d8f6c765ef6530484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:53:48.379193 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-9e64d0dd-bbf2-4189-be47-844b01296a92 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] 10.222.0.46 "GET /compute/v2.1/servers/fcfdf5da-b32d-4782-869b-97d45817dd5c" status: 200 len: 1700 microversion: 2.1 time: 0.155862 Jan 15 21:53:48.379769 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4092/8194] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:53:48 2022] GET /compute/v2.1/servers/fcfdf5da-b32d-4782-869b-97d45817dd5c => generated 1700 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:53:49.396921 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8d65e632-142a-45bb-837c-0d24b8990005 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:53:49.397626 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-8d65e632-142a-45bb-837c-0d24b8990005 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] [instance: fcfdf5da-b32d-4782-869b-97d45817dd5c] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:53:49.404224 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8d65e632-142a-45bb-837c-0d24b8990005 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:53:49.404682 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8d65e632-142a-45bb-837c-0d24b8990005 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:53:49.405484 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8d65e632-142a-45bb-837c-0d24b8990005 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:53:49.405920 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8d65e632-142a-45bb-837c-0d24b8990005 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:53:49.539934 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-8d65e632-142a-45bb-837c-0d24b8990005 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd71ca21ce8c455a92db914d0c7e622f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cbeb500a7e84c5d8f6c765ef6530484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:53:49.547725 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-8d65e632-142a-45bb-837c-0d24b8990005 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] 10.222.0.46 "GET /compute/v2.1/servers/fcfdf5da-b32d-4782-869b-97d45817dd5c" status: 200 len: 1700 microversion: 2.1 time: 0.155068 Jan 15 21:53:49.548311 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4103/8195] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:53:49 2022] GET /compute/v2.1/servers/fcfdf5da-b32d-4782-869b-97d45817dd5c => generated 1700 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:53:50.565796 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-eb16dc94-f015-4570-b56b-d126fa388043 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:53:50.566417 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-eb16dc94-f015-4570-b56b-d126fa388043 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] [instance: fcfdf5da-b32d-4782-869b-97d45817dd5c] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:53:50.573795 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-eb16dc94-f015-4570-b56b-d126fa388043 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:53:50.574070 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-eb16dc94-f015-4570-b56b-d126fa388043 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:53:50.574875 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-eb16dc94-f015-4570-b56b-d126fa388043 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:53:50.575325 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-eb16dc94-f015-4570-b56b-d126fa388043 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:53:50.716364 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-eb16dc94-f015-4570-b56b-d126fa388043 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd71ca21ce8c455a92db914d0c7e622f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cbeb500a7e84c5d8f6c765ef6530484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:53:50.726327 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-eb16dc94-f015-4570-b56b-d126fa388043 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] 10.222.0.46 "GET /compute/v2.1/servers/fcfdf5da-b32d-4782-869b-97d45817dd5c" status: 200 len: 1695 microversion: 2.1 time: 0.164084 Jan 15 21:53:50.727306 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4093/8196] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:53:50 2022] GET /compute/v2.1/servers/fcfdf5da-b32d-4782-869b-97d45817dd5c => generated 1695 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:53:51.444122 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-f3f0b148-1e01-43ea-a0f1-bee82621944b req-ae57acdc-f445-42c2-b334-0dd7c908c6fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcfdf5da-b32d-4782-869b-97d45817dd5c", "name": "network-vif-plugged", "status": "completed", "tag": "b23ffb45-4fb8-4e27-8653-b756ce0ae1d5"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:53:51.447938 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:53:51.447938 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:53:51.458934 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-f3f0b148-1e01-43ea-a0f1-bee82621944b req-ae57acdc-f445-42c2-b334-0dd7c908c6fa service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:53:51.460483 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-f3f0b148-1e01-43ea-a0f1-bee82621944b req-ae57acdc-f445-42c2-b334-0dd7c908c6fa service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:53:51.476650 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-f3f0b148-1e01-43ea-a0f1-bee82621944b req-ae57acdc-f445-42c2-b334-0dd7c908c6fa service nova] Creating event network-vif-plugged:b23ffb45-4fb8-4e27-8653-b756ce0ae1d5 for instance fcfdf5da-b32d-4782-869b-97d45817dd5c on nch2-master-1 Jan 15 21:53:51.487583 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-f3f0b148-1e01-43ea-a0f1-bee82621944b req-ae57acdc-f445-42c2-b334-0dd7c908c6fa service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114111 Jan 15 21:53:51.489244 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4104/8197] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:53:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:53:51.744414 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-62bc970a-e6da-404c-9fc2-4c0c705d1400 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:53:51.745151 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-62bc970a-e6da-404c-9fc2-4c0c705d1400 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] [instance: fcfdf5da-b32d-4782-869b-97d45817dd5c] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:53:51.754737 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-62bc970a-e6da-404c-9fc2-4c0c705d1400 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:53:51.755242 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-62bc970a-e6da-404c-9fc2-4c0c705d1400 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:53:51.756044 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-62bc970a-e6da-404c-9fc2-4c0c705d1400 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:53:51.756686 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-62bc970a-e6da-404c-9fc2-4c0c705d1400 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:53:51.914832 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-62bc970a-e6da-404c-9fc2-4c0c705d1400 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd71ca21ce8c455a92db914d0c7e622f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cbeb500a7e84c5d8f6c765ef6530484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:53:51.924305 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-62bc970a-e6da-404c-9fc2-4c0c705d1400 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] 10.222.0.46 "GET /compute/v2.1/servers/fcfdf5da-b32d-4782-869b-97d45817dd5c" status: 200 len: 1695 microversion: 2.1 time: 0.184464 Jan 15 21:53:51.925025 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4094/8198] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:53:51 2022] GET /compute/v2.1/servers/fcfdf5da-b32d-4782-869b-97d45817dd5c => generated 1695 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:53:52.943213 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f5f6cdeb-2872-42aa-b8be-8dd1b423bf3a tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:53:52.944692 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f5f6cdeb-2872-42aa-b8be-8dd1b423bf3a tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] [instance: fcfdf5da-b32d-4782-869b-97d45817dd5c] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:53:52.951158 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f5f6cdeb-2872-42aa-b8be-8dd1b423bf3a tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:53:52.951749 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f5f6cdeb-2872-42aa-b8be-8dd1b423bf3a tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:53:52.952775 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f5f6cdeb-2872-42aa-b8be-8dd1b423bf3a tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:53:52.953231 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f5f6cdeb-2872-42aa-b8be-8dd1b423bf3a tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:53:53.110581 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-f5f6cdeb-2872-42aa-b8be-8dd1b423bf3a tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd71ca21ce8c455a92db914d0c7e622f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cbeb500a7e84c5d8f6c765ef6530484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:53:53.119357 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f5f6cdeb-2872-42aa-b8be-8dd1b423bf3a tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] 10.222.0.46 "GET /compute/v2.1/servers/fcfdf5da-b32d-4782-869b-97d45817dd5c" status: 200 len: 1695 microversion: 2.1 time: 0.180929 Jan 15 21:53:53.119967 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4105/8199] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:53:52 2022] GET /compute/v2.1/servers/fcfdf5da-b32d-4782-869b-97d45817dd5c => generated 1695 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:53:54.136573 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-638f99ee-4332-43b3-80d2-c44e494bbb53 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:53:54.137331 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-638f99ee-4332-43b3-80d2-c44e494bbb53 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] [instance: fcfdf5da-b32d-4782-869b-97d45817dd5c] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:53:54.144603 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-638f99ee-4332-43b3-80d2-c44e494bbb53 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:53:54.145193 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-638f99ee-4332-43b3-80d2-c44e494bbb53 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:53:54.146910 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-638f99ee-4332-43b3-80d2-c44e494bbb53 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:53:54.147652 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-638f99ee-4332-43b3-80d2-c44e494bbb53 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:53:54.310229 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-638f99ee-4332-43b3-80d2-c44e494bbb53 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd71ca21ce8c455a92db914d0c7e622f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cbeb500a7e84c5d8f6c765ef6530484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:53:54.318927 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-638f99ee-4332-43b3-80d2-c44e494bbb53 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] 10.222.0.46 "GET /compute/v2.1/servers/fcfdf5da-b32d-4782-869b-97d45817dd5c" status: 200 len: 1695 microversion: 2.1 time: 0.186155 Jan 15 21:53:54.320122 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4095/8200] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:53:54 2022] GET /compute/v2.1/servers/fcfdf5da-b32d-4782-869b-97d45817dd5c => generated 1695 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:53:55.337283 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-0a03968e-9f94-4a0a-a78d-6ed25c479eec tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:53:55.337884 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-0a03968e-9f94-4a0a-a78d-6ed25c479eec tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] [instance: fcfdf5da-b32d-4782-869b-97d45817dd5c] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:53:55.345084 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0a03968e-9f94-4a0a-a78d-6ed25c479eec tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:53:55.345852 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0a03968e-9f94-4a0a-a78d-6ed25c479eec tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:53:55.346890 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0a03968e-9f94-4a0a-a78d-6ed25c479eec tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:53:55.347413 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-0a03968e-9f94-4a0a-a78d-6ed25c479eec tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:53:55.510194 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-0a03968e-9f94-4a0a-a78d-6ed25c479eec tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd71ca21ce8c455a92db914d0c7e622f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cbeb500a7e84c5d8f6c765ef6530484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:53:55.517981 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-0a03968e-9f94-4a0a-a78d-6ed25c479eec tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] 10.222.0.46 "GET /compute/v2.1/servers/fcfdf5da-b32d-4782-869b-97d45817dd5c" status: 200 len: 1695 microversion: 2.1 time: 0.185406 Jan 15 21:53:55.518567 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4106/8201] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:53:55 2022] GET /compute/v2.1/servers/fcfdf5da-b32d-4782-869b-97d45817dd5c => generated 1695 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:53:56.536476 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d795fc54-c8bc-4c14-8bfb-dabc8de6b673 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:53:56.537279 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d795fc54-c8bc-4c14-8bfb-dabc8de6b673 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] [instance: fcfdf5da-b32d-4782-869b-97d45817dd5c] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:53:56.545220 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d795fc54-c8bc-4c14-8bfb-dabc8de6b673 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:53:56.545773 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d795fc54-c8bc-4c14-8bfb-dabc8de6b673 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:53:56.546663 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d795fc54-c8bc-4c14-8bfb-dabc8de6b673 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:53:56.547188 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-d795fc54-c8bc-4c14-8bfb-dabc8de6b673 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:53:56.697595 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-d795fc54-c8bc-4c14-8bfb-dabc8de6b673 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd71ca21ce8c455a92db914d0c7e622f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cbeb500a7e84c5d8f6c765ef6530484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:53:56.707242 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d795fc54-c8bc-4c14-8bfb-dabc8de6b673 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] 10.222.0.46 "GET /compute/v2.1/servers/fcfdf5da-b32d-4782-869b-97d45817dd5c" status: 200 len: 1695 microversion: 2.1 time: 0.174867 Jan 15 21:53:56.707842 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4096/8202] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:53:56 2022] GET /compute/v2.1/servers/fcfdf5da-b32d-4782-869b-97d45817dd5c => generated 1695 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:53:57.726841 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a437f13a-d438-40ee-88de-9f4cd3b56aee tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:53:57.727438 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a437f13a-d438-40ee-88de-9f4cd3b56aee tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] [instance: fcfdf5da-b32d-4782-869b-97d45817dd5c] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:53:57.734713 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a437f13a-d438-40ee-88de-9f4cd3b56aee tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:53:57.735172 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a437f13a-d438-40ee-88de-9f4cd3b56aee tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:53:57.736003 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a437f13a-d438-40ee-88de-9f4cd3b56aee tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:53:57.736443 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a437f13a-d438-40ee-88de-9f4cd3b56aee tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:53:57.891600 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-a437f13a-d438-40ee-88de-9f4cd3b56aee tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd71ca21ce8c455a92db914d0c7e622f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cbeb500a7e84c5d8f6c765ef6530484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:53:57.901614 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a437f13a-d438-40ee-88de-9f4cd3b56aee tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] 10.222.0.46 "GET /compute/v2.1/servers/fcfdf5da-b32d-4782-869b-97d45817dd5c" status: 200 len: 1695 microversion: 2.1 time: 0.180489 Jan 15 21:53:57.916904 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4107/8203] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:53:57 2022] GET /compute/v2.1/servers/fcfdf5da-b32d-4782-869b-97d45817dd5c => generated 1695 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:53:58.919270 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-44851e4f-63c8-4c02-a28b-bb6c3ebfab78 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:53:58.920639 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-44851e4f-63c8-4c02-a28b-bb6c3ebfab78 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] [instance: fcfdf5da-b32d-4782-869b-97d45817dd5c] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:53:58.928786 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-44851e4f-63c8-4c02-a28b-bb6c3ebfab78 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:53:58.929688 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-44851e4f-63c8-4c02-a28b-bb6c3ebfab78 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:53:58.930649 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-44851e4f-63c8-4c02-a28b-bb6c3ebfab78 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:53:58.931323 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-44851e4f-63c8-4c02-a28b-bb6c3ebfab78 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:53:59.098344 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-44851e4f-63c8-4c02-a28b-bb6c3ebfab78 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd71ca21ce8c455a92db914d0c7e622f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cbeb500a7e84c5d8f6c765ef6530484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:53:59.106825 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-44851e4f-63c8-4c02-a28b-bb6c3ebfab78 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] 10.222.0.46 "GET /compute/v2.1/servers/fcfdf5da-b32d-4782-869b-97d45817dd5c" status: 200 len: 1695 microversion: 2.1 time: 0.191207 Jan 15 21:53:59.117684 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4097/8204] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:53:58 2022] GET /compute/v2.1/servers/fcfdf5da-b32d-4782-869b-97d45817dd5c => generated 1695 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:54:00.125107 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7e2ad7f3-5213-4a1b-8565-9994ce59284b tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:54:00.125712 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-7e2ad7f3-5213-4a1b-8565-9994ce59284b tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] [instance: fcfdf5da-b32d-4782-869b-97d45817dd5c] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:54:00.133755 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7e2ad7f3-5213-4a1b-8565-9994ce59284b tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:54:00.134207 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7e2ad7f3-5213-4a1b-8565-9994ce59284b tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:54:00.135010 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7e2ad7f3-5213-4a1b-8565-9994ce59284b tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:54:00.135432 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7e2ad7f3-5213-4a1b-8565-9994ce59284b tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:54:00.638925 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-7e2ad7f3-5213-4a1b-8565-9994ce59284b tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd71ca21ce8c455a92db914d0c7e622f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cbeb500a7e84c5d8f6c765ef6530484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:54:00.646431 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7e2ad7f3-5213-4a1b-8565-9994ce59284b tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] 10.222.0.46 "GET /compute/v2.1/servers/fcfdf5da-b32d-4782-869b-97d45817dd5c" status: 200 len: 1677 microversion: 2.1 time: 0.525061 Jan 15 21:54:00.647029 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4108/8205] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:54:00 2022] GET /compute/v2.1/servers/fcfdf5da-b32d-4782-869b-97d45817dd5c => generated 1677 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:54:01.664664 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9e425d9d-d255-4524-a3fc-36c7d052cf8c tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:54:01.665314 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-9e425d9d-d255-4524-a3fc-36c7d052cf8c tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] [instance: fcfdf5da-b32d-4782-869b-97d45817dd5c] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:54:01.672066 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9e425d9d-d255-4524-a3fc-36c7d052cf8c tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:54:01.672525 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9e425d9d-d255-4524-a3fc-36c7d052cf8c tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:54:01.673355 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9e425d9d-d255-4524-a3fc-36c7d052cf8c tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:54:01.673802 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9e425d9d-d255-4524-a3fc-36c7d052cf8c tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:54:01.810573 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-9e425d9d-d255-4524-a3fc-36c7d052cf8c tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd71ca21ce8c455a92db914d0c7e622f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cbeb500a7e84c5d8f6c765ef6530484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:54:01.818170 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-9e425d9d-d255-4524-a3fc-36c7d052cf8c tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] 10.222.0.46 "GET /compute/v2.1/servers/fcfdf5da-b32d-4782-869b-97d45817dd5c" status: 200 len: 1677 microversion: 2.1 time: 0.158049 Jan 15 21:54:01.818740 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4098/8206] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:54:01 2022] GET /compute/v2.1/servers/fcfdf5da-b32d-4782-869b-97d45817dd5c => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:54:02.835454 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f53fab60-c1c1-44dc-afa9-75eb1e98c9a4 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:54:02.836064 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f53fab60-c1c1-44dc-afa9-75eb1e98c9a4 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] [instance: fcfdf5da-b32d-4782-869b-97d45817dd5c] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:54:02.842844 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f53fab60-c1c1-44dc-afa9-75eb1e98c9a4 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:54:02.843298 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f53fab60-c1c1-44dc-afa9-75eb1e98c9a4 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:54:02.844079 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f53fab60-c1c1-44dc-afa9-75eb1e98c9a4 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:54:02.844520 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f53fab60-c1c1-44dc-afa9-75eb1e98c9a4 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:54:02.974968 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-f53fab60-c1c1-44dc-afa9-75eb1e98c9a4 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd71ca21ce8c455a92db914d0c7e622f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cbeb500a7e84c5d8f6c765ef6530484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:54:02.982412 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f53fab60-c1c1-44dc-afa9-75eb1e98c9a4 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] 10.222.0.46 "GET /compute/v2.1/servers/fcfdf5da-b32d-4782-869b-97d45817dd5c" status: 200 len: 1680 microversion: 2.1 time: 0.150928 Jan 15 21:54:02.982993 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4109/8207] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:54:02 2022] GET /compute/v2.1/servers/fcfdf5da-b32d-4782-869b-97d45817dd5c => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:54:03.000515 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-63dec132-a0e7-47cc-b16b-f6ffc4da2b67 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:54:03.001134 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-63dec132-a0e7-47cc-b16b-f6ffc4da2b67 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] [instance: fcfdf5da-b32d-4782-869b-97d45817dd5c] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:54:03.008768 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-63dec132-a0e7-47cc-b16b-f6ffc4da2b67 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:54:03.009242 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-63dec132-a0e7-47cc-b16b-f6ffc4da2b67 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:54:03.010077 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-63dec132-a0e7-47cc-b16b-f6ffc4da2b67 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:54:03.010522 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-63dec132-a0e7-47cc-b16b-f6ffc4da2b67 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:54:03.146749 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-63dec132-a0e7-47cc-b16b-f6ffc4da2b67 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] 10.222.0.46 "POST /compute/v2.1/servers/fcfdf5da-b32d-4782-869b-97d45817dd5c/action" status: 202 len: 0 microversion: 2.1 time: 0.151098 Jan 15 21:54:03.147374 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4099/8208] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:54:02 2022] POST /compute/v2.1/servers/fcfdf5da-b32d-4782-869b-97d45817dd5c/action => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:54:03.155225 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-3111b455-c88b-4a5f-b2e7-09f4a7078373 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:54:03.155838 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-3111b455-c88b-4a5f-b2e7-09f4a7078373 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] [instance: fcfdf5da-b32d-4782-869b-97d45817dd5c] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:54:03.162928 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3111b455-c88b-4a5f-b2e7-09f4a7078373 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:54:03.163387 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3111b455-c88b-4a5f-b2e7-09f4a7078373 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:54:03.164184 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3111b455-c88b-4a5f-b2e7-09f4a7078373 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:54:03.164626 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3111b455-c88b-4a5f-b2e7-09f4a7078373 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:54:03.300822 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-3111b455-c88b-4a5f-b2e7-09f4a7078373 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd71ca21ce8c455a92db914d0c7e622f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cbeb500a7e84c5d8f6c765ef6530484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:54:03.308449 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-3111b455-c88b-4a5f-b2e7-09f4a7078373 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] 10.222.0.46 "GET /compute/v2.1/servers/fcfdf5da-b32d-4782-869b-97d45817dd5c" status: 200 len: 1628 microversion: 2.1 time: 0.156878 Jan 15 21:54:03.309054 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4110/8209] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:54:03 2022] GET /compute/v2.1/servers/fcfdf5da-b32d-4782-869b-97d45817dd5c => generated 1628 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:54:04.332301 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3e060543-23fa-4d5d-a3b2-57179274b997 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:54:04.333027 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-3e060543-23fa-4d5d-a3b2-57179274b997 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] [instance: fcfdf5da-b32d-4782-869b-97d45817dd5c] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:54:04.339063 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3e060543-23fa-4d5d-a3b2-57179274b997 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:54:04.339514 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3e060543-23fa-4d5d-a3b2-57179274b997 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:54:04.340313 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3e060543-23fa-4d5d-a3b2-57179274b997 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:54:04.340764 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3e060543-23fa-4d5d-a3b2-57179274b997 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:54:04.483237 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-3e060543-23fa-4d5d-a3b2-57179274b997 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd71ca21ce8c455a92db914d0c7e622f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cbeb500a7e84c5d8f6c765ef6530484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:54:04.492162 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3e060543-23fa-4d5d-a3b2-57179274b997 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] 10.222.0.46 "GET /compute/v2.1/servers/fcfdf5da-b32d-4782-869b-97d45817dd5c" status: 200 len: 1686 microversion: 2.1 time: 0.164426 Jan 15 21:54:04.492856 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4100/8210] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:54:04 2022] GET /compute/v2.1/servers/fcfdf5da-b32d-4782-869b-97d45817dd5c => generated 1686 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:54:04.761358 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-5c30bf0f-f37a-4c65-a3c5-d9de16e03df1 req-d3bbec80-f6e9-42eb-b794-4b01f7ae6fbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcfdf5da-b32d-4782-869b-97d45817dd5c", "name": "network-vif-unplugged", "status": "completed", "tag": "b23ffb45-4fb8-4e27-8653-b756ce0ae1d5"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:54:04.766584 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:54:04.766584 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:54:04.774239 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-5c30bf0f-f37a-4c65-a3c5-d9de16e03df1 req-d3bbec80-f6e9-42eb-b794-4b01f7ae6fbc service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:54:04.774679 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-5c30bf0f-f37a-4c65-a3c5-d9de16e03df1 req-d3bbec80-f6e9-42eb-b794-4b01f7ae6fbc service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:54:04.787889 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-5c30bf0f-f37a-4c65-a3c5-d9de16e03df1 req-d3bbec80-f6e9-42eb-b794-4b01f7ae6fbc service nova] Creating event network-vif-unplugged:b23ffb45-4fb8-4e27-8653-b756ce0ae1d5 for instance fcfdf5da-b32d-4782-869b-97d45817dd5c on nch1-master-1 Jan 15 21:54:04.793008 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-5c30bf0f-f37a-4c65-a3c5-d9de16e03df1 req-d3bbec80-f6e9-42eb-b794-4b01f7ae6fbc service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.095340 Jan 15 21:54:04.793852 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4111/8211] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:54:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:54:05.510487 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-88d3ad2d-2376-4adf-8fa1-6c4750a8cd53 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:54:05.511104 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-88d3ad2d-2376-4adf-8fa1-6c4750a8cd53 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] [instance: fcfdf5da-b32d-4782-869b-97d45817dd5c] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:54:05.517987 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-88d3ad2d-2376-4adf-8fa1-6c4750a8cd53 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:54:05.518453 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-88d3ad2d-2376-4adf-8fa1-6c4750a8cd53 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:54:05.519254 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-88d3ad2d-2376-4adf-8fa1-6c4750a8cd53 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:54:05.519700 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-88d3ad2d-2376-4adf-8fa1-6c4750a8cd53 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:54:05.654408 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-88d3ad2d-2376-4adf-8fa1-6c4750a8cd53 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd71ca21ce8c455a92db914d0c7e622f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cbeb500a7e84c5d8f6c765ef6530484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:54:05.662876 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-88d3ad2d-2376-4adf-8fa1-6c4750a8cd53 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] 10.222.0.46 "GET /compute/v2.1/servers/fcfdf5da-b32d-4782-869b-97d45817dd5c" status: 200 len: 1686 microversion: 2.1 time: 0.155872 Jan 15 21:54:05.663388 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4101/8212] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:54:05 2022] GET /compute/v2.1/servers/fcfdf5da-b32d-4782-869b-97d45817dd5c => generated 1686 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:54:06.681918 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-42823a09-ca32-4745-9f78-33f28cd54c17 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:54:06.684073 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-42823a09-ca32-4745-9f78-33f28cd54c17 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] [instance: fcfdf5da-b32d-4782-869b-97d45817dd5c] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:54:06.690502 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-42823a09-ca32-4745-9f78-33f28cd54c17 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:54:06.691034 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-42823a09-ca32-4745-9f78-33f28cd54c17 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:54:06.692821 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-42823a09-ca32-4745-9f78-33f28cd54c17 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:54:06.693367 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-42823a09-ca32-4745-9f78-33f28cd54c17 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:54:06.826467 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-e58527bc-31ae-408b-9f94-e645210e6ba7 req-3553ab10-875d-4eff-82b4-fa93b3788c4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fcfdf5da-b32d-4782-869b-97d45817dd5c", "tag": "b23ffb45-4fb8-4e27-8653-b756ce0ae1d5"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:54:06.828062 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:54:06.828062 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:54:06.836606 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-e58527bc-31ae-408b-9f94-e645210e6ba7 req-3553ab10-875d-4eff-82b4-fa93b3788c4a service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:54:06.837099 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-e58527bc-31ae-408b-9f94-e645210e6ba7 req-3553ab10-875d-4eff-82b4-fa93b3788c4a service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:54:06.847742 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-42823a09-ca32-4745-9f78-33f28cd54c17 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd71ca21ce8c455a92db914d0c7e622f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cbeb500a7e84c5d8f6c765ef6530484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:54:06.851097 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-e58527bc-31ae-408b-9f94-e645210e6ba7 req-3553ab10-875d-4eff-82b4-fa93b3788c4a service nova] Creating event network-changed:b23ffb45-4fb8-4e27-8653-b756ce0ae1d5 for instance fcfdf5da-b32d-4782-869b-97d45817dd5c on nch1-master-1 Jan 15 21:54:06.858207 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-42823a09-ca32-4745-9f78-33f28cd54c17 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] 10.222.0.46 "GET /compute/v2.1/servers/fcfdf5da-b32d-4782-869b-97d45817dd5c" status: 200 len: 1686 microversion: 2.1 time: 0.182268 Jan 15 21:54:06.859021 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-e58527bc-31ae-408b-9f94-e645210e6ba7 req-3553ab10-875d-4eff-82b4-fa93b3788c4a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035037 Jan 15 21:54:06.859181 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4112/8213] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:54:06 2022] GET /compute/v2.1/servers/fcfdf5da-b32d-4782-869b-97d45817dd5c => generated 1686 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:54:06.859753 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4102/8214] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:54:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 21:54:07.875224 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e0b33ed9-46f5-4d49-89ab-19dac3a3c6b1 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:54:07.875935 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e0b33ed9-46f5-4d49-89ab-19dac3a3c6b1 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] [instance: fcfdf5da-b32d-4782-869b-97d45817dd5c] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:54:07.883743 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e0b33ed9-46f5-4d49-89ab-19dac3a3c6b1 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:54:07.884232 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e0b33ed9-46f5-4d49-89ab-19dac3a3c6b1 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:54:07.885086 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e0b33ed9-46f5-4d49-89ab-19dac3a3c6b1 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:54:07.885718 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e0b33ed9-46f5-4d49-89ab-19dac3a3c6b1 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:54:08.026384 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-e0b33ed9-46f5-4d49-89ab-19dac3a3c6b1 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd71ca21ce8c455a92db914d0c7e622f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cbeb500a7e84c5d8f6c765ef6530484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:54:08.034533 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e0b33ed9-46f5-4d49-89ab-19dac3a3c6b1 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] 10.222.0.46 "GET /compute/v2.1/servers/fcfdf5da-b32d-4782-869b-97d45817dd5c" status: 200 len: 1686 microversion: 2.1 time: 0.162939 Jan 15 21:54:08.035118 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4113/8215] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:54:07 2022] GET /compute/v2.1/servers/fcfdf5da-b32d-4782-869b-97d45817dd5c => generated 1686 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:54:09.053289 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3abf411a-f927-453b-a08b-3cc0c6896f44 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:54:09.055064 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-3abf411a-f927-453b-a08b-3cc0c6896f44 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] [instance: fcfdf5da-b32d-4782-869b-97d45817dd5c] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:54:09.063958 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3abf411a-f927-453b-a08b-3cc0c6896f44 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:54:09.065048 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3abf411a-f927-453b-a08b-3cc0c6896f44 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:54:09.066423 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3abf411a-f927-453b-a08b-3cc0c6896f44 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:54:09.067501 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3abf411a-f927-453b-a08b-3cc0c6896f44 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:54:09.235824 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-3abf411a-f927-453b-a08b-3cc0c6896f44 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd71ca21ce8c455a92db914d0c7e622f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cbeb500a7e84c5d8f6c765ef6530484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:54:09.243449 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3abf411a-f927-453b-a08b-3cc0c6896f44 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] 10.222.0.46 "GET /compute/v2.1/servers/fcfdf5da-b32d-4782-869b-97d45817dd5c" status: 200 len: 1686 microversion: 2.1 time: 0.194883 Jan 15 21:54:09.244020 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4103/8216] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:54:09 2022] GET /compute/v2.1/servers/fcfdf5da-b32d-4782-869b-97d45817dd5c => generated 1686 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:54:10.259986 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9f4f0b8e-ad14-49ca-bb7b-8c645c783001 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:54:10.260664 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-9f4f0b8e-ad14-49ca-bb7b-8c645c783001 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] [instance: fcfdf5da-b32d-4782-869b-97d45817dd5c] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:54:10.266805 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9f4f0b8e-ad14-49ca-bb7b-8c645c783001 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:54:10.267260 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9f4f0b8e-ad14-49ca-bb7b-8c645c783001 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:54:10.268067 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9f4f0b8e-ad14-49ca-bb7b-8c645c783001 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:54:10.268490 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9f4f0b8e-ad14-49ca-bb7b-8c645c783001 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:54:10.413884 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-9f4f0b8e-ad14-49ca-bb7b-8c645c783001 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd71ca21ce8c455a92db914d0c7e622f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cbeb500a7e84c5d8f6c765ef6530484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:54:10.421718 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-9f4f0b8e-ad14-49ca-bb7b-8c645c783001 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] 10.222.0.46 "GET /compute/v2.1/servers/fcfdf5da-b32d-4782-869b-97d45817dd5c" status: 200 len: 1686 microversion: 2.1 time: 0.166104 Jan 15 21:54:10.422305 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4114/8217] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:54:10 2022] GET /compute/v2.1/servers/fcfdf5da-b32d-4782-869b-97d45817dd5c => generated 1686 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:54:11.438668 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-198c14f6-c917-4fa5-9cd6-e78d70352bc7 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:54:11.439304 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-198c14f6-c917-4fa5-9cd6-e78d70352bc7 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] [instance: fcfdf5da-b32d-4782-869b-97d45817dd5c] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:54:11.446499 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-198c14f6-c917-4fa5-9cd6-e78d70352bc7 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:54:11.446960 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-198c14f6-c917-4fa5-9cd6-e78d70352bc7 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:54:11.447773 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-198c14f6-c917-4fa5-9cd6-e78d70352bc7 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:54:11.448216 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-198c14f6-c917-4fa5-9cd6-e78d70352bc7 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:54:11.587611 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-198c14f6-c917-4fa5-9cd6-e78d70352bc7 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd71ca21ce8c455a92db914d0c7e622f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cbeb500a7e84c5d8f6c765ef6530484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:54:11.595489 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-198c14f6-c917-4fa5-9cd6-e78d70352bc7 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] 10.222.0.46 "GET /compute/v2.1/servers/fcfdf5da-b32d-4782-869b-97d45817dd5c" status: 200 len: 1686 microversion: 2.1 time: 0.160406 Jan 15 21:54:11.596780 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4104/8218] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:54:11 2022] GET /compute/v2.1/servers/fcfdf5da-b32d-4782-869b-97d45817dd5c => generated 1686 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:54:12.616946 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-3f32eeda-2f04-46d4-8d44-b7864c1e67fc tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:54:12.617797 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-3f32eeda-2f04-46d4-8d44-b7864c1e67fc tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] [instance: fcfdf5da-b32d-4782-869b-97d45817dd5c] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:54:12.627947 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3f32eeda-2f04-46d4-8d44-b7864c1e67fc tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:54:12.628555 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3f32eeda-2f04-46d4-8d44-b7864c1e67fc tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:54:12.629781 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3f32eeda-2f04-46d4-8d44-b7864c1e67fc tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:54:12.630885 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3f32eeda-2f04-46d4-8d44-b7864c1e67fc tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:54:12.777115 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-3f32eeda-2f04-46d4-8d44-b7864c1e67fc tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd71ca21ce8c455a92db914d0c7e622f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cbeb500a7e84c5d8f6c765ef6530484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:54:12.784878 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-3f32eeda-2f04-46d4-8d44-b7864c1e67fc tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] 10.222.0.46 "GET /compute/v2.1/servers/fcfdf5da-b32d-4782-869b-97d45817dd5c" status: 200 len: 1686 microversion: 2.1 time: 0.174090 Jan 15 21:54:12.785472 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4115/8219] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:54:12 2022] GET /compute/v2.1/servers/fcfdf5da-b32d-4782-869b-97d45817dd5c => generated 1686 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:54:13.803595 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-94406b62-6cf7-45f4-be34-4eea6dff536f tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:54:13.804255 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-94406b62-6cf7-45f4-be34-4eea6dff536f tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] [instance: fcfdf5da-b32d-4782-869b-97d45817dd5c] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:54:13.811293 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-94406b62-6cf7-45f4-be34-4eea6dff536f tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:54:13.811765 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-94406b62-6cf7-45f4-be34-4eea6dff536f tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:54:13.812575 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-94406b62-6cf7-45f4-be34-4eea6dff536f tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:54:13.813074 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-94406b62-6cf7-45f4-be34-4eea6dff536f tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:54:13.948589 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-94406b62-6cf7-45f4-be34-4eea6dff536f tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd71ca21ce8c455a92db914d0c7e622f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cbeb500a7e84c5d8f6c765ef6530484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:54:13.957410 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-94406b62-6cf7-45f4-be34-4eea6dff536f tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] 10.222.0.46 "GET /compute/v2.1/servers/fcfdf5da-b32d-4782-869b-97d45817dd5c" status: 200 len: 1686 microversion: 2.1 time: 0.157655 Jan 15 21:54:13.958438 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4105/8220] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:54:13 2022] GET /compute/v2.1/servers/fcfdf5da-b32d-4782-869b-97d45817dd5c => generated 1686 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:54:14.974925 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-fd22db29-9051-408f-9867-4c1b88756880 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:54:14.975546 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-fd22db29-9051-408f-9867-4c1b88756880 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] [instance: fcfdf5da-b32d-4782-869b-97d45817dd5c] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:54:14.982562 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fd22db29-9051-408f-9867-4c1b88756880 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:54:14.983005 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fd22db29-9051-408f-9867-4c1b88756880 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:54:14.983782 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fd22db29-9051-408f-9867-4c1b88756880 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:54:14.984212 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-fd22db29-9051-408f-9867-4c1b88756880 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:54:15.120364 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-fd22db29-9051-408f-9867-4c1b88756880 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd71ca21ce8c455a92db914d0c7e622f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cbeb500a7e84c5d8f6c765ef6530484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:54:15.127813 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-fd22db29-9051-408f-9867-4c1b88756880 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] 10.222.0.46 "GET /compute/v2.1/servers/fcfdf5da-b32d-4782-869b-97d45817dd5c" status: 200 len: 1686 microversion: 2.1 time: 0.157161 Jan 15 21:54:15.128398 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4116/8221] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:54:14 2022] GET /compute/v2.1/servers/fcfdf5da-b32d-4782-869b-97d45817dd5c => generated 1686 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:54:16.146268 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-66ef0bd9-c447-45d9-9dc3-ecdc9786345e tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:54:16.146854 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-66ef0bd9-c447-45d9-9dc3-ecdc9786345e tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] [instance: fcfdf5da-b32d-4782-869b-97d45817dd5c] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:54:16.153482 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-66ef0bd9-c447-45d9-9dc3-ecdc9786345e tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:54:16.153954 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-66ef0bd9-c447-45d9-9dc3-ecdc9786345e tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:54:16.154767 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-66ef0bd9-c447-45d9-9dc3-ecdc9786345e tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:54:16.155225 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-66ef0bd9-c447-45d9-9dc3-ecdc9786345e tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:54:16.313494 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-66ef0bd9-c447-45d9-9dc3-ecdc9786345e tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd71ca21ce8c455a92db914d0c7e622f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cbeb500a7e84c5d8f6c765ef6530484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:54:16.323574 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-66ef0bd9-c447-45d9-9dc3-ecdc9786345e tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] 10.222.0.46 "GET /compute/v2.1/servers/fcfdf5da-b32d-4782-869b-97d45817dd5c" status: 200 len: 1686 microversion: 2.1 time: 0.181684 Jan 15 21:54:16.334284 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4106/8222] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:54:16 2022] GET /compute/v2.1/servers/fcfdf5da-b32d-4782-869b-97d45817dd5c => generated 1686 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:54:17.342186 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-a74c7c68-dd1b-4777-8e7c-02466251f18d tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:54:17.342825 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-a74c7c68-dd1b-4777-8e7c-02466251f18d tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] [instance: fcfdf5da-b32d-4782-869b-97d45817dd5c] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:54:17.350569 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a74c7c68-dd1b-4777-8e7c-02466251f18d tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:54:17.351020 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a74c7c68-dd1b-4777-8e7c-02466251f18d tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:54:17.351803 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a74c7c68-dd1b-4777-8e7c-02466251f18d tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:54:17.352583 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-a74c7c68-dd1b-4777-8e7c-02466251f18d tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:54:17.492369 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-a74c7c68-dd1b-4777-8e7c-02466251f18d tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd71ca21ce8c455a92db914d0c7e622f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cbeb500a7e84c5d8f6c765ef6530484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:54:17.499875 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-a74c7c68-dd1b-4777-8e7c-02466251f18d tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] 10.222.0.46 "GET /compute/v2.1/servers/fcfdf5da-b32d-4782-869b-97d45817dd5c" status: 200 len: 1686 microversion: 2.1 time: 0.161398 Jan 15 21:54:17.500463 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4117/8223] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:54:17 2022] GET /compute/v2.1/servers/fcfdf5da-b32d-4782-869b-97d45817dd5c => generated 1686 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:54:18.516877 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f26512e5-99be-4c5e-a007-4f387d5f17ee tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:54:18.517489 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f26512e5-99be-4c5e-a007-4f387d5f17ee tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] [instance: fcfdf5da-b32d-4782-869b-97d45817dd5c] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:54:18.524367 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f26512e5-99be-4c5e-a007-4f387d5f17ee tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:54:18.524825 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f26512e5-99be-4c5e-a007-4f387d5f17ee tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:54:18.525642 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f26512e5-99be-4c5e-a007-4f387d5f17ee tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:54:18.526088 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f26512e5-99be-4c5e-a007-4f387d5f17ee tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:54:18.661782 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-f26512e5-99be-4c5e-a007-4f387d5f17ee tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd71ca21ce8c455a92db914d0c7e622f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cbeb500a7e84c5d8f6c765ef6530484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:54:18.669011 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f26512e5-99be-4c5e-a007-4f387d5f17ee tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] 10.222.0.46 "GET /compute/v2.1/servers/fcfdf5da-b32d-4782-869b-97d45817dd5c" status: 200 len: 1686 microversion: 2.1 time: 0.155876 Jan 15 21:54:18.669599 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4107/8224] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:54:18 2022] GET /compute/v2.1/servers/fcfdf5da-b32d-4782-869b-97d45817dd5c => generated 1686 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:54:19.686485 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-700c9e39-8b2d-47f2-97d6-203cbeeff07c tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:54:19.687092 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-700c9e39-8b2d-47f2-97d6-203cbeeff07c tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] [instance: fcfdf5da-b32d-4782-869b-97d45817dd5c] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:54:19.694139 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-700c9e39-8b2d-47f2-97d6-203cbeeff07c tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:54:19.694591 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-700c9e39-8b2d-47f2-97d6-203cbeeff07c tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:54:19.695371 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-700c9e39-8b2d-47f2-97d6-203cbeeff07c tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:54:19.695806 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-700c9e39-8b2d-47f2-97d6-203cbeeff07c tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:54:19.828509 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-700c9e39-8b2d-47f2-97d6-203cbeeff07c tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd71ca21ce8c455a92db914d0c7e622f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cbeb500a7e84c5d8f6c765ef6530484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:54:19.836178 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-700c9e39-8b2d-47f2-97d6-203cbeeff07c tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] 10.222.0.46 "GET /compute/v2.1/servers/fcfdf5da-b32d-4782-869b-97d45817dd5c" status: 200 len: 1686 microversion: 2.1 time: 0.153340 Jan 15 21:54:19.836768 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4118/8225] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:54:19 2022] GET /compute/v2.1/servers/fcfdf5da-b32d-4782-869b-97d45817dd5c => generated 1686 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:54:20.854238 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-85fa48a0-685b-446a-a924-b2bde3f8f56d tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:54:20.854862 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-85fa48a0-685b-446a-a924-b2bde3f8f56d tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] [instance: fcfdf5da-b32d-4782-869b-97d45817dd5c] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:54:20.861624 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-85fa48a0-685b-446a-a924-b2bde3f8f56d tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:54:20.862093 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-85fa48a0-685b-446a-a924-b2bde3f8f56d tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:54:20.862890 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-85fa48a0-685b-446a-a924-b2bde3f8f56d tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:54:20.863342 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-85fa48a0-685b-446a-a924-b2bde3f8f56d tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:54:20.998426 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-85fa48a0-685b-446a-a924-b2bde3f8f56d tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd71ca21ce8c455a92db914d0c7e622f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cbeb500a7e84c5d8f6c765ef6530484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:54:21.006958 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-85fa48a0-685b-446a-a924-b2bde3f8f56d tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] 10.222.0.46 "GET /compute/v2.1/servers/fcfdf5da-b32d-4782-869b-97d45817dd5c" status: 200 len: 1686 microversion: 2.1 time: 0.156498 Jan 15 21:54:21.007537 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4108/8226] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:54:20 2022] GET /compute/v2.1/servers/fcfdf5da-b32d-4782-869b-97d45817dd5c => generated 1686 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:54:21.889624 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-1350d413-ff73-4c66-a13c-fab5844f4944 req-af0bbad3-2af0-439f-bbb1-0d442f2ea89a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcfdf5da-b32d-4782-869b-97d45817dd5c", "name": "network-vif-plugged", "status": "completed", "tag": "b23ffb45-4fb8-4e27-8653-b756ce0ae1d5"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:54:21.891363 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:54:21.891363 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:54:21.899960 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-1350d413-ff73-4c66-a13c-fab5844f4944 req-af0bbad3-2af0-439f-bbb1-0d442f2ea89a service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:54:21.900554 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-1350d413-ff73-4c66-a13c-fab5844f4944 req-af0bbad3-2af0-439f-bbb1-0d442f2ea89a service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:54:21.915979 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-1350d413-ff73-4c66-a13c-fab5844f4944 req-af0bbad3-2af0-439f-bbb1-0d442f2ea89a service nova] Creating event network-vif-plugged:b23ffb45-4fb8-4e27-8653-b756ce0ae1d5 for instance fcfdf5da-b32d-4782-869b-97d45817dd5c on nch1-master-1 Jan 15 21:54:21.921056 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-1350d413-ff73-4c66-a13c-fab5844f4944 req-af0bbad3-2af0-439f-bbb1-0d442f2ea89a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035395 Jan 15 21:54:21.921678 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4119/8227] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:54:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:54:22.023726 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-799b2ce5-e399-47f0-97a8-58a364b8488e tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:54:22.024288 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-799b2ce5-e399-47f0-97a8-58a364b8488e tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] [instance: fcfdf5da-b32d-4782-869b-97d45817dd5c] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:54:22.031102 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-799b2ce5-e399-47f0-97a8-58a364b8488e tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:54:22.031571 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-799b2ce5-e399-47f0-97a8-58a364b8488e tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:54:22.032410 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-799b2ce5-e399-47f0-97a8-58a364b8488e tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:54:22.032892 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-799b2ce5-e399-47f0-97a8-58a364b8488e tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:54:22.173846 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-799b2ce5-e399-47f0-97a8-58a364b8488e tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd71ca21ce8c455a92db914d0c7e622f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cbeb500a7e84c5d8f6c765ef6530484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:54:22.181391 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-799b2ce5-e399-47f0-97a8-58a364b8488e tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] 10.222.0.46 "GET /compute/v2.1/servers/fcfdf5da-b32d-4782-869b-97d45817dd5c" status: 200 len: 1686 microversion: 2.1 time: 0.161674 Jan 15 21:54:22.181964 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4109/8228] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:54:22 2022] GET /compute/v2.1/servers/fcfdf5da-b32d-4782-869b-97d45817dd5c => generated 1686 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:54:23.198526 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-bca2fe85-b90f-4374-9101-c8b557543faa tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:54:23.199320 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-bca2fe85-b90f-4374-9101-c8b557543faa tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] [instance: fcfdf5da-b32d-4782-869b-97d45817dd5c] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:54:23.206232 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bca2fe85-b90f-4374-9101-c8b557543faa tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:54:23.206680 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bca2fe85-b90f-4374-9101-c8b557543faa tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:54:23.207468 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bca2fe85-b90f-4374-9101-c8b557543faa tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:54:23.207904 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bca2fe85-b90f-4374-9101-c8b557543faa tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:54:23.351610 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-bca2fe85-b90f-4374-9101-c8b557543faa tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd71ca21ce8c455a92db914d0c7e622f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cbeb500a7e84c5d8f6c765ef6530484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:54:23.359042 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-bca2fe85-b90f-4374-9101-c8b557543faa tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] 10.222.0.46 "GET /compute/v2.1/servers/fcfdf5da-b32d-4782-869b-97d45817dd5c" status: 200 len: 1686 microversion: 2.1 time: 0.164499 Jan 15 21:54:23.359616 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4120/8229] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:54:23 2022] GET /compute/v2.1/servers/fcfdf5da-b32d-4782-869b-97d45817dd5c => generated 1686 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:54:24.380135 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-63d69946-e96c-4ebf-aa80-1353ee4e77eb tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:54:24.380762 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-63d69946-e96c-4ebf-aa80-1353ee4e77eb tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] [instance: fcfdf5da-b32d-4782-869b-97d45817dd5c] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:54:24.387991 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-63d69946-e96c-4ebf-aa80-1353ee4e77eb tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:54:24.388456 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-63d69946-e96c-4ebf-aa80-1353ee4e77eb tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:54:24.389281 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-63d69946-e96c-4ebf-aa80-1353ee4e77eb tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:54:24.389734 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-63d69946-e96c-4ebf-aa80-1353ee4e77eb tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:54:24.528683 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-63d69946-e96c-4ebf-aa80-1353ee4e77eb tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd71ca21ce8c455a92db914d0c7e622f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cbeb500a7e84c5d8f6c765ef6530484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:54:24.536399 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-63d69946-e96c-4ebf-aa80-1353ee4e77eb tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] 10.222.0.46 "GET /compute/v2.1/servers/fcfdf5da-b32d-4782-869b-97d45817dd5c" status: 200 len: 1673 microversion: 2.1 time: 0.164625 Jan 15 21:54:24.537004 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4110/8230] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:54:24 2022] GET /compute/v2.1/servers/fcfdf5da-b32d-4782-869b-97d45817dd5c => generated 1673 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:55:34.337759 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-51fb36a2-dba7-4f90-a33d-9e54ce425a90 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:55:34.338321 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-51fb36a2-dba7-4f90-a33d-9e54ce425a90 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] [instance: fcfdf5da-b32d-4782-869b-97d45817dd5c] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:55:34.344613 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-51fb36a2-dba7-4f90-a33d-9e54ce425a90 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:55:34.345099 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-51fb36a2-dba7-4f90-a33d-9e54ce425a90 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:55:34.346131 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-51fb36a2-dba7-4f90-a33d-9e54ce425a90 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:55:34.346739 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-51fb36a2-dba7-4f90-a33d-9e54ce425a90 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:55:34.378752 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-51fb36a2-dba7-4f90-a33d-9e54ce425a90 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] [instance: fcfdf5da-b32d-4782-869b-97d45817dd5c] Going to try to terminate instance {{(pid=129366) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 21:55:34.419006 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-589047c9-26ba-4512-bc68-1e75c84f1ec5 req-f34a79d7-687e-4b34-8977-60bad21911b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fcfdf5da-b32d-4782-869b-97d45817dd5c", "tag": "b23ffb45-4fb8-4e27-8653-b756ce0ae1d5"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:55:34.421335 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:55:34.421335 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:55:34.429412 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-589047c9-26ba-4512-bc68-1e75c84f1ec5 req-f34a79d7-687e-4b34-8977-60bad21911b2 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:55:34.429871 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-589047c9-26ba-4512-bc68-1e75c84f1ec5 req-f34a79d7-687e-4b34-8977-60bad21911b2 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:55:34.441301 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-589047c9-26ba-4512-bc68-1e75c84f1ec5 req-f34a79d7-687e-4b34-8977-60bad21911b2 service nova] Creating event network-changed:b23ffb45-4fb8-4e27-8653-b756ce0ae1d5 for instance fcfdf5da-b32d-4782-869b-97d45817dd5c on nch1-master-1 Jan 15 21:55:34.449095 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-589047c9-26ba-4512-bc68-1e75c84f1ec5 req-f34a79d7-687e-4b34-8977-60bad21911b2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113254 Jan 15 21:55:34.450001 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4111/8231] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:55:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 21:55:34.467922 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-51fb36a2-dba7-4f90-a33d-9e54ce425a90 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] 10.222.0.46 "DELETE /compute/v2.1/servers/fcfdf5da-b32d-4782-869b-97d45817dd5c" status: 204 len: 0 microversion: 2.1 time: 0.134685 Jan 15 21:55:34.468622 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4121/8232] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 21:55:34 2022] DELETE /compute/v2.1/servers/fcfdf5da-b32d-4782-869b-97d45817dd5c => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 15 21:55:34.478620 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-4482f91c-e8b0-4c49-8c15-1bf0622bd199 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:55:34.479467 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-4482f91c-e8b0-4c49-8c15-1bf0622bd199 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] [instance: fcfdf5da-b32d-4782-869b-97d45817dd5c] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:55:34.486544 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4482f91c-e8b0-4c49-8c15-1bf0622bd199 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:55:34.487086 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4482f91c-e8b0-4c49-8c15-1bf0622bd199 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:55:34.487972 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4482f91c-e8b0-4c49-8c15-1bf0622bd199 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:55:34.488477 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-4482f91c-e8b0-4c49-8c15-1bf0622bd199 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:55:34.641392 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-4482f91c-e8b0-4c49-8c15-1bf0622bd199 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd71ca21ce8c455a92db914d0c7e622f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cbeb500a7e84c5d8f6c765ef6530484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:55:34.651083 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-4482f91c-e8b0-4c49-8c15-1bf0622bd199 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] 10.222.0.46 "GET /compute/v2.1/servers/fcfdf5da-b32d-4782-869b-97d45817dd5c" status: 200 len: 1679 microversion: 2.1 time: 0.177701 Jan 15 21:55:34.651890 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4112/8233] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:55:34 2022] GET /compute/v2.1/servers/fcfdf5da-b32d-4782-869b-97d45817dd5c => generated 1679 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:55:35.670617 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b4738ba3-06f3-4769-96ab-a32c7643f218 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:55:35.671312 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b4738ba3-06f3-4769-96ab-a32c7643f218 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] [instance: fcfdf5da-b32d-4782-869b-97d45817dd5c] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:55:35.678447 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b4738ba3-06f3-4769-96ab-a32c7643f218 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:55:35.678927 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b4738ba3-06f3-4769-96ab-a32c7643f218 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:55:35.679711 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b4738ba3-06f3-4769-96ab-a32c7643f218 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:55:35.680151 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b4738ba3-06f3-4769-96ab-a32c7643f218 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:55:35.827891 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-b4738ba3-06f3-4769-96ab-a32c7643f218 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd71ca21ce8c455a92db914d0c7e622f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cbeb500a7e84c5d8f6c765ef6530484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:55:35.836077 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b4738ba3-06f3-4769-96ab-a32c7643f218 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] 10.222.0.46 "GET /compute/v2.1/servers/fcfdf5da-b32d-4782-869b-97d45817dd5c" status: 200 len: 1561 microversion: 2.1 time: 0.169518 Jan 15 21:55:35.836671 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4122/8234] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:55:35 2022] GET /compute/v2.1/servers/fcfdf5da-b32d-4782-869b-97d45817dd5c => generated 1561 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:55:36.256359 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-547a21d1-8784-4020-b8b9-0aec95fdf3fd req-78bb4e1e-c4bb-404f-a721-748ab521aee8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcfdf5da-b32d-4782-869b-97d45817dd5c", "name": "network-vif-deleted", "tag": "b23ffb45-4fb8-4e27-8653-b756ce0ae1d5"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:55:36.259173 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:55:36.259173 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:55:36.269059 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-547a21d1-8784-4020-b8b9-0aec95fdf3fd req-78bb4e1e-c4bb-404f-a721-748ab521aee8 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:55:36.269525 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-547a21d1-8784-4020-b8b9-0aec95fdf3fd req-78bb4e1e-c4bb-404f-a721-748ab521aee8 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:55:36.282536 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-547a21d1-8784-4020-b8b9-0aec95fdf3fd req-78bb4e1e-c4bb-404f-a721-748ab521aee8 service nova] Creating event network-vif-deleted:b23ffb45-4fb8-4e27-8653-b756ce0ae1d5 for instance fcfdf5da-b32d-4782-869b-97d45817dd5c on nch1-master-1 Jan 15 21:55:36.288179 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-547a21d1-8784-4020-b8b9-0aec95fdf3fd req-78bb4e1e-c4bb-404f-a721-748ab521aee8 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036125 Jan 15 21:55:36.289387 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4113/8235] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:55:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:55:36.853974 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-23627d23-14ab-488f-bd36-41d41df91820 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:55:36.854518 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-23627d23-14ab-488f-bd36-41d41df91820 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] [instance: fcfdf5da-b32d-4782-869b-97d45817dd5c] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:55:36.861187 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-23627d23-14ab-488f-bd36-41d41df91820 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:55:36.861640 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-23627d23-14ab-488f-bd36-41d41df91820 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:55:36.862413 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-23627d23-14ab-488f-bd36-41d41df91820 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:55:36.862848 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-23627d23-14ab-488f-bd36-41d41df91820 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:55:36.876247 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-23627d23-14ab-488f-bd36-41d41df91820 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] HTTP exception thrown: Instance fcfdf5da-b32d-4782-869b-97d45817dd5c could not be found. Jan 15 21:55:36.876825 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-23627d23-14ab-488f-bd36-41d41df91820 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Returning 404 to user: Instance fcfdf5da-b32d-4782-869b-97d45817dd5c could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:55:36.877669 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-23627d23-14ab-488f-bd36-41d41df91820 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] 10.222.0.46 "GET /compute/v2.1/servers/fcfdf5da-b32d-4782-869b-97d45817dd5c" status: 404 len: 111 microversion: 2.1 time: 0.028239 Jan 15 21:55:36.878203 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4123/8236] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:55:36 2022] GET /compute/v2.1/servers/fcfdf5da-b32d-4782-869b-97d45817dd5c => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:55:37.034710 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a1f55817-e8c8-4ca0-b1ff-0095906379a4 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Calling method '.version_select at 0x7f30c85098b0>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:55:37.059717 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a1f55817-e8c8-4ca0-b1ff-0095906379a4 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-46981826" status: 202 len: 0 microversion: 2.1 time: 0.029189 Jan 15 21:55:37.060301 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4114/8237] 10.222.0.46 () {58 vars in 1247 bytes} [Sat Jan 15 21:55:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-46981826 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:55:37.080916 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d08d5aeb-6ece-4834-9c32-524c891de8fe tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Action: 'create', calling method: .version_select at 0x7f30c8851310>, body: {"keypair": {"name": "tempest-TestShelveInstance-726047653"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:55:37.095167 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-d08d5aeb-6ece-4834-9c32-524c891de8fe tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Getting quotas for project 4cbeb500a7e84c5d8f6c765ef6530484. Resources: {'key_pairs'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:55:37.100585 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-d08d5aeb-6ece-4834-9c32-524c891de8fe tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Getting quotas for user cd71ca21ce8c455a92db914d0c7e622f and project 4cbeb500a7e84c5d8f6c765ef6530484. Resources: {'key_pairs'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:55:37.198688 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-d08d5aeb-6ece-4834-9c32-524c891de8fe tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Getting quotas for project 4cbeb500a7e84c5d8f6c765ef6530484. Resources: {'key_pairs'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:55:37.203485 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-d08d5aeb-6ece-4834-9c32-524c891de8fe tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Getting quotas for user cd71ca21ce8c455a92db914d0c7e622f and project 4cbeb500a7e84c5d8f6c765ef6530484. Resources: {'key_pairs'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:55:37.218186 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d08d5aeb-6ece-4834-9c32-524c891de8fe tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.141047 Jan 15 21:55:37.218784 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4124/8238] 10.222.0.46 () {60 vars in 1157 bytes} [Sat Jan 15 21:55:37 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:55:39.590476 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-81e78028-79be-46d9-917f-1e3b0bb84f77 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-37598119", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-726047653", "security_groups": [{"name": "tempest-secgroup-smoke-446502868"}], "networks": [{"uuid": "f21819f5-21e2-4a05-8ef0-afdd46994d45"}], "block_device_mapping_v2": [{"uuid": "e04f580c-dee4-4337-af0b-330444326234", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:55:39.702927 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.network.neutron [None req-81e78028-79be-46d9-917f-1e3b0bb84f77 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] validate_networks() for [('f21819f5-21e2-4a05-8ef0-afdd46994d45', None, None, None, None, None)] {{(pid=129365) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 21:55:40.073175 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-81e78028-79be-46d9-917f-1e3b0bb84f77 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Flavor limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 21:55:40.073613 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-81e78028-79be-46d9-917f-1e3b0bb84f77 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Image limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 21:55:40.074136 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-81e78028-79be-46d9-917f-1e3b0bb84f77 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Flavor pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 21:55:40.074583 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-81e78028-79be-46d9-917f-1e3b0bb84f77 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Image pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 21:55:40.075003 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-81e78028-79be-46d9-917f-1e3b0bb84f77 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 21:55:40.083646 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-81e78028-79be-46d9-917f-1e3b0bb84f77 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:55:40.084110 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-81e78028-79be-46d9-917f-1e3b0bb84f77 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:55:40.084991 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-81e78028-79be-46d9-917f-1e3b0bb84f77 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:55:40.085415 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-81e78028-79be-46d9-917f-1e3b0bb84f77 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:55:40.102257 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-81e78028-79be-46d9-917f-1e3b0bb84f77 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Getting quotas for project 4cbeb500a7e84c5d8f6c765ef6530484. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 21:55:40.107266 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-81e78028-79be-46d9-917f-1e3b0bb84f77 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Getting quotas for user cd71ca21ce8c455a92db914d0c7e622f and project 4cbeb500a7e84c5d8f6c765ef6530484. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 21:55:40.162937 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-81e78028-79be-46d9-917f-1e3b0bb84f77 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Going to run 1 instances... {{(pid=129365) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 21:55:40.165233 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-81e78028-79be-46d9-917f-1e3b0bb84f77 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] [instance: fdd61ce6-b2d3-4358-afd4-59cadea14a52] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e04f580c-dee4-4337-af0b-330444326234',volume_size=None,volume_type=None)] {{(pid=129365) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 21:55:40.286317 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-81e78028-79be-46d9-917f-1e3b0bb84f77 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.699520 Jan 15 21:55:40.286961 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4115/8239] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 21:55:39 2022] POST /compute/v2.1/servers => generated 405 bytes in 701 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 21:55:40.298518 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-6163fe1e-93e3-4c69-ad60-3c86ca959def tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:55:40.299130 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-6163fe1e-93e3-4c69-ad60-3c86ca959def tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] [instance: fdd61ce6-b2d3-4358-afd4-59cadea14a52] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:55:40.358017 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-6163fe1e-93e3-4c69-ad60-3c86ca959def tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd71ca21ce8c455a92db914d0c7e622f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cbeb500a7e84c5d8f6c765ef6530484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:55:40.364808 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-6163fe1e-93e3-4c69-ad60-3c86ca959def tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] 10.222.0.46 "GET /compute/v2.1/servers/fdd61ce6-b2d3-4358-afd4-59cadea14a52" status: 200 len: 1086 microversion: 2.1 time: 0.071022 Jan 15 21:55:40.365409 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4125/8240] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:55:40 2022] GET /compute/v2.1/servers/fdd61ce6-b2d3-4358-afd4-59cadea14a52 => generated 1086 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:55:41.384445 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-eb4ff80d-d4eb-4c85-b055-418d3a02d852 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:55:41.385223 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-eb4ff80d-d4eb-4c85-b055-418d3a02d852 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] [instance: fdd61ce6-b2d3-4358-afd4-59cadea14a52] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:55:41.391672 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-eb4ff80d-d4eb-4c85-b055-418d3a02d852 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:55:41.392246 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-eb4ff80d-d4eb-4c85-b055-418d3a02d852 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:55:41.393296 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-eb4ff80d-d4eb-4c85-b055-418d3a02d852 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:55:41.393740 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-eb4ff80d-d4eb-4c85-b055-418d3a02d852 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:55:41.495684 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-eb4ff80d-d4eb-4c85-b055-418d3a02d852 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd71ca21ce8c455a92db914d0c7e622f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cbeb500a7e84c5d8f6c765ef6530484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:55:41.504387 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-eb4ff80d-d4eb-4c85-b055-418d3a02d852 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] 10.222.0.46 "GET /compute/v2.1/servers/fdd61ce6-b2d3-4358-afd4-59cadea14a52" status: 200 len: 1202 microversion: 2.1 time: 0.125176 Jan 15 21:55:41.505151 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4116/8241] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:55:41 2022] GET /compute/v2.1/servers/fdd61ce6-b2d3-4358-afd4-59cadea14a52 => generated 1202 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:55:42.523569 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c67eadbb-5b0f-4aab-b654-27fed155e49a tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:55:42.524551 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c67eadbb-5b0f-4aab-b654-27fed155e49a tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] [instance: fdd61ce6-b2d3-4358-afd4-59cadea14a52] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:55:42.535920 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c67eadbb-5b0f-4aab-b654-27fed155e49a tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:55:42.537368 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c67eadbb-5b0f-4aab-b654-27fed155e49a tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:55:42.538560 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c67eadbb-5b0f-4aab-b654-27fed155e49a tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:55:42.539234 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c67eadbb-5b0f-4aab-b654-27fed155e49a tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:55:42.734336 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-a9dfa5e8-6090-4eed-8ea4-0fd71a67cbd8 req-d498c4b4-a298-4715-834d-9dd71565af13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdd61ce6-b2d3-4358-afd4-59cadea14a52", "tag": "729cd33b-96ce-4869-9f56-9ba9d5d7d05c"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:55:42.742479 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:55:42.742479 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:55:42.754071 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-a9dfa5e8-6090-4eed-8ea4-0fd71a67cbd8 req-d498c4b4-a298-4715-834d-9dd71565af13 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:55:42.755227 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-a9dfa5e8-6090-4eed-8ea4-0fd71a67cbd8 req-d498c4b4-a298-4715-834d-9dd71565af13 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:55:42.780588 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-a9dfa5e8-6090-4eed-8ea4-0fd71a67cbd8 req-d498c4b4-a298-4715-834d-9dd71565af13 service nova] Creating event network-changed:729cd33b-96ce-4869-9f56-9ba9d5d7d05c for instance fdd61ce6-b2d3-4358-afd4-59cadea14a52 on nch2-master-1 Jan 15 21:55:42.786469 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-a9dfa5e8-6090-4eed-8ea4-0fd71a67cbd8 req-d498c4b4-a298-4715-834d-9dd71565af13 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057015 Jan 15 21:55:42.787431 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4117/8242] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:55:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 21:55:42.814706 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-c67eadbb-5b0f-4aab-b654-27fed155e49a tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd71ca21ce8c455a92db914d0c7e622f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cbeb500a7e84c5d8f6c765ef6530484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:55:42.824271 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c67eadbb-5b0f-4aab-b654-27fed155e49a tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] 10.222.0.46 "GET /compute/v2.1/servers/fdd61ce6-b2d3-4358-afd4-59cadea14a52" status: 200 len: 1257 microversion: 2.1 time: 0.305387 Jan 15 21:55:42.825129 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4126/8243] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:55:42 2022] GET /compute/v2.1/servers/fdd61ce6-b2d3-4358-afd4-59cadea14a52 => generated 1257 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:55:43.842899 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-aab761b9-4533-4055-9b99-43046ba9dfbf tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:55:43.843607 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-aab761b9-4533-4055-9b99-43046ba9dfbf tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] [instance: fdd61ce6-b2d3-4358-afd4-59cadea14a52] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:55:43.850921 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-aab761b9-4533-4055-9b99-43046ba9dfbf tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:55:43.851229 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-aab761b9-4533-4055-9b99-43046ba9dfbf tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:55:43.852018 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-aab761b9-4533-4055-9b99-43046ba9dfbf tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:55:43.852467 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-aab761b9-4533-4055-9b99-43046ba9dfbf tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:55:43.987869 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-aab761b9-4533-4055-9b99-43046ba9dfbf tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd71ca21ce8c455a92db914d0c7e622f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cbeb500a7e84c5d8f6c765ef6530484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:55:43.996627 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-aab761b9-4533-4055-9b99-43046ba9dfbf tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] 10.222.0.46 "GET /compute/v2.1/servers/fdd61ce6-b2d3-4358-afd4-59cadea14a52" status: 200 len: 1257 microversion: 2.1 time: 0.158567 Jan 15 21:55:43.997232 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4118/8244] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:55:43 2022] GET /compute/v2.1/servers/fdd61ce6-b2d3-4358-afd4-59cadea14a52 => generated 1257 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:55:45.013364 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-3fa7821b-64b7-4959-8059-7a172e58ab05 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:55:45.014006 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-3fa7821b-64b7-4959-8059-7a172e58ab05 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] [instance: fdd61ce6-b2d3-4358-afd4-59cadea14a52] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:55:45.020682 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3fa7821b-64b7-4959-8059-7a172e58ab05 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:55:45.021168 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3fa7821b-64b7-4959-8059-7a172e58ab05 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:55:45.022092 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3fa7821b-64b7-4959-8059-7a172e58ab05 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:55:45.022653 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3fa7821b-64b7-4959-8059-7a172e58ab05 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:55:45.157528 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-3fa7821b-64b7-4959-8059-7a172e58ab05 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd71ca21ce8c455a92db914d0c7e622f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cbeb500a7e84c5d8f6c765ef6530484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:55:45.165146 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-3fa7821b-64b7-4959-8059-7a172e58ab05 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] 10.222.0.46 "GET /compute/v2.1/servers/fdd61ce6-b2d3-4358-afd4-59cadea14a52" status: 200 len: 1257 microversion: 2.1 time: 0.155505 Jan 15 21:55:45.165727 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4127/8245] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:55:45 2022] GET /compute/v2.1/servers/fdd61ce6-b2d3-4358-afd4-59cadea14a52 => generated 1257 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:55:46.183124 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c0da9eeb-64a0-4ff8-8814-c5656f2ac12b tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:55:46.183747 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c0da9eeb-64a0-4ff8-8814-c5656f2ac12b tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] [instance: fdd61ce6-b2d3-4358-afd4-59cadea14a52] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:55:46.190302 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c0da9eeb-64a0-4ff8-8814-c5656f2ac12b tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:55:46.190759 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c0da9eeb-64a0-4ff8-8814-c5656f2ac12b tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:55:46.191540 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c0da9eeb-64a0-4ff8-8814-c5656f2ac12b tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:55:46.191986 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c0da9eeb-64a0-4ff8-8814-c5656f2ac12b tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:55:46.325640 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-c0da9eeb-64a0-4ff8-8814-c5656f2ac12b tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd71ca21ce8c455a92db914d0c7e622f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cbeb500a7e84c5d8f6c765ef6530484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:55:46.333055 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c0da9eeb-64a0-4ff8-8814-c5656f2ac12b tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] 10.222.0.46 "GET /compute/v2.1/servers/fdd61ce6-b2d3-4358-afd4-59cadea14a52" status: 200 len: 1257 microversion: 2.1 time: 0.153820 Jan 15 21:55:46.333636 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4119/8246] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:55:46 2022] GET /compute/v2.1/servers/fdd61ce6-b2d3-4358-afd4-59cadea14a52 => generated 1257 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:55:47.350913 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-62920741-07f9-4c00-b1a3-f8ca5b701433 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:55:47.352329 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-62920741-07f9-4c00-b1a3-f8ca5b701433 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] [instance: fdd61ce6-b2d3-4358-afd4-59cadea14a52] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:55:47.359633 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-62920741-07f9-4c00-b1a3-f8ca5b701433 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:55:47.360163 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-62920741-07f9-4c00-b1a3-f8ca5b701433 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:55:47.361053 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-62920741-07f9-4c00-b1a3-f8ca5b701433 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:55:47.361550 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-62920741-07f9-4c00-b1a3-f8ca5b701433 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:55:47.493736 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-62920741-07f9-4c00-b1a3-f8ca5b701433 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd71ca21ce8c455a92db914d0c7e622f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cbeb500a7e84c5d8f6c765ef6530484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:55:47.501682 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-62920741-07f9-4c00-b1a3-f8ca5b701433 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] 10.222.0.46 "GET /compute/v2.1/servers/fdd61ce6-b2d3-4358-afd4-59cadea14a52" status: 200 len: 1257 microversion: 2.1 time: 0.155005 Jan 15 21:55:47.502266 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4128/8247] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:55:47 2022] GET /compute/v2.1/servers/fdd61ce6-b2d3-4358-afd4-59cadea14a52 => generated 1257 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:55:48.519184 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-bfa914f7-5a48-4d0e-a35e-46af68fc3189 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:55:48.519806 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-bfa914f7-5a48-4d0e-a35e-46af68fc3189 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] [instance: fdd61ce6-b2d3-4358-afd4-59cadea14a52] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:55:48.526551 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bfa914f7-5a48-4d0e-a35e-46af68fc3189 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:55:48.527020 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bfa914f7-5a48-4d0e-a35e-46af68fc3189 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:55:48.527848 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bfa914f7-5a48-4d0e-a35e-46af68fc3189 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:55:48.528306 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bfa914f7-5a48-4d0e-a35e-46af68fc3189 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:55:48.672683 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-bfa914f7-5a48-4d0e-a35e-46af68fc3189 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd71ca21ce8c455a92db914d0c7e622f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cbeb500a7e84c5d8f6c765ef6530484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:55:48.680201 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-bfa914f7-5a48-4d0e-a35e-46af68fc3189 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] 10.222.0.46 "GET /compute/v2.1/servers/fdd61ce6-b2d3-4358-afd4-59cadea14a52" status: 200 len: 1257 microversion: 2.1 time: 0.164816 Jan 15 21:55:48.680779 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4120/8248] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:55:48 2022] GET /compute/v2.1/servers/fdd61ce6-b2d3-4358-afd4-59cadea14a52 => generated 1257 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:55:49.696541 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ea4a5110-2529-417b-9fa3-59bae95138f9 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:55:49.697179 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ea4a5110-2529-417b-9fa3-59bae95138f9 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] [instance: fdd61ce6-b2d3-4358-afd4-59cadea14a52] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:55:49.704074 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ea4a5110-2529-417b-9fa3-59bae95138f9 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:55:49.704529 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ea4a5110-2529-417b-9fa3-59bae95138f9 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:55:49.705338 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ea4a5110-2529-417b-9fa3-59bae95138f9 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:55:49.705774 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ea4a5110-2529-417b-9fa3-59bae95138f9 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:55:49.847945 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-ea4a5110-2529-417b-9fa3-59bae95138f9 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd71ca21ce8c455a92db914d0c7e622f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cbeb500a7e84c5d8f6c765ef6530484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:55:49.855380 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ea4a5110-2529-417b-9fa3-59bae95138f9 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] 10.222.0.46 "GET /compute/v2.1/servers/fdd61ce6-b2d3-4358-afd4-59cadea14a52" status: 200 len: 1257 microversion: 2.1 time: 0.162515 Jan 15 21:55:49.855967 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4129/8249] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:55:49 2022] GET /compute/v2.1/servers/fdd61ce6-b2d3-4358-afd4-59cadea14a52 => generated 1257 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:55:49.876980 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-33b81c1a-d5f1-4ddc-ba1d-08911e655846 req-be8fb5e6-575a-4e4a-b13d-c314694a1a3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdd61ce6-b2d3-4358-afd4-59cadea14a52", "name": "network-vif-plugged", "status": "completed", "tag": "729cd33b-96ce-4869-9f56-9ba9d5d7d05c"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:55:49.878557 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:55:49.878557 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:55:49.888159 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-33b81c1a-d5f1-4ddc-ba1d-08911e655846 req-be8fb5e6-575a-4e4a-b13d-c314694a1a3d service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:55:49.888756 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-33b81c1a-d5f1-4ddc-ba1d-08911e655846 req-be8fb5e6-575a-4e4a-b13d-c314694a1a3d service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:55:49.903332 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-33b81c1a-d5f1-4ddc-ba1d-08911e655846 req-be8fb5e6-575a-4e4a-b13d-c314694a1a3d service nova] Creating event network-vif-plugged:729cd33b-96ce-4869-9f56-9ba9d5d7d05c for instance fdd61ce6-b2d3-4358-afd4-59cadea14a52 on nch2-master-1 Jan 15 21:55:49.909296 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-33b81c1a-d5f1-4ddc-ba1d-08911e655846 req-be8fb5e6-575a-4e4a-b13d-c314694a1a3d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035805 Jan 15 21:55:49.910086 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4121/8250] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:55:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:55:50.871748 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-30125415-a2da-4e04-9827-3afb81f9529b tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:55:50.872417 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-30125415-a2da-4e04-9827-3afb81f9529b tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] [instance: fdd61ce6-b2d3-4358-afd4-59cadea14a52] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:55:50.879198 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-30125415-a2da-4e04-9827-3afb81f9529b tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:55:50.879648 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-30125415-a2da-4e04-9827-3afb81f9529b tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:55:50.880429 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-30125415-a2da-4e04-9827-3afb81f9529b tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:55:50.881447 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-30125415-a2da-4e04-9827-3afb81f9529b tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:55:51.310887 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-30125415-a2da-4e04-9827-3afb81f9529b tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd71ca21ce8c455a92db914d0c7e622f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cbeb500a7e84c5d8f6c765ef6530484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:55:51.318874 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-30125415-a2da-4e04-9827-3afb81f9529b tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] 10.222.0.46 "GET /compute/v2.1/servers/fdd61ce6-b2d3-4358-afd4-59cadea14a52" status: 200 len: 1257 microversion: 2.1 time: 0.450675 Jan 15 21:55:51.319501 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4130/8251] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:55:50 2022] GET /compute/v2.1/servers/fdd61ce6-b2d3-4358-afd4-59cadea14a52 => generated 1257 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:55:52.336498 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-8863ee17-2f38-4ce8-88f2-3c76e52cb956 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:55:52.337240 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-8863ee17-2f38-4ce8-88f2-3c76e52cb956 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] [instance: fdd61ce6-b2d3-4358-afd4-59cadea14a52] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:55:52.344224 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8863ee17-2f38-4ce8-88f2-3c76e52cb956 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:55:52.344691 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8863ee17-2f38-4ce8-88f2-3c76e52cb956 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:55:52.345519 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8863ee17-2f38-4ce8-88f2-3c76e52cb956 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:55:52.346029 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-8863ee17-2f38-4ce8-88f2-3c76e52cb956 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:55:52.479795 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-8863ee17-2f38-4ce8-88f2-3c76e52cb956 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd71ca21ce8c455a92db914d0c7e622f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cbeb500a7e84c5d8f6c765ef6530484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:55:52.487228 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-8863ee17-2f38-4ce8-88f2-3c76e52cb956 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] 10.222.0.46 "GET /compute/v2.1/servers/fdd61ce6-b2d3-4358-afd4-59cadea14a52" status: 200 len: 1441 microversion: 2.1 time: 0.154984 Jan 15 21:55:52.487803 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4122/8252] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:55:52 2022] GET /compute/v2.1/servers/fdd61ce6-b2d3-4358-afd4-59cadea14a52 => generated 1441 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:55:52.503899 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-26628aa6-b9de-48a2-bea6-cdc5ba89a2f6 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:55:52.504528 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-26628aa6-b9de-48a2-bea6-cdc5ba89a2f6 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] [instance: fdd61ce6-b2d3-4358-afd4-59cadea14a52] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:55:52.511245 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-26628aa6-b9de-48a2-bea6-cdc5ba89a2f6 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:55:52.511688 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-26628aa6-b9de-48a2-bea6-cdc5ba89a2f6 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:55:52.512455 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-26628aa6-b9de-48a2-bea6-cdc5ba89a2f6 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:55:52.512910 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-26628aa6-b9de-48a2-bea6-cdc5ba89a2f6 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:55:52.647823 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-26628aa6-b9de-48a2-bea6-cdc5ba89a2f6 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd71ca21ce8c455a92db914d0c7e622f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cbeb500a7e84c5d8f6c765ef6530484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:55:52.655157 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-26628aa6-b9de-48a2-bea6-cdc5ba89a2f6 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] 10.222.0.46 "GET /compute/v2.1/servers/fdd61ce6-b2d3-4358-afd4-59cadea14a52" status: 200 len: 1441 microversion: 2.1 time: 0.154953 Jan 15 21:55:52.655728 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4131/8253] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:55:52 2022] GET /compute/v2.1/servers/fdd61ce6-b2d3-4358-afd4-59cadea14a52 => generated 1441 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:55:54.265568 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-886419d9-06a6-4133-b43e-ee6ceb03b64a req-00f1758a-42cc-4e1a-8bd8-760a0adfc468 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdd61ce6-b2d3-4358-afd4-59cadea14a52", "tag": "729cd33b-96ce-4869-9f56-9ba9d5d7d05c"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:55:54.267229 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:55:54.267229 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:55:54.276704 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-886419d9-06a6-4133-b43e-ee6ceb03b64a req-00f1758a-42cc-4e1a-8bd8-760a0adfc468 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:55:54.277188 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-886419d9-06a6-4133-b43e-ee6ceb03b64a req-00f1758a-42cc-4e1a-8bd8-760a0adfc468 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:55:54.288479 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-886419d9-06a6-4133-b43e-ee6ceb03b64a req-00f1758a-42cc-4e1a-8bd8-760a0adfc468 service nova] Creating event network-changed:729cd33b-96ce-4869-9f56-9ba9d5d7d05c for instance fdd61ce6-b2d3-4358-afd4-59cadea14a52 on nch2-master-1 Jan 15 21:55:54.293984 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-886419d9-06a6-4133-b43e-ee6ceb03b64a req-00f1758a-42cc-4e1a-8bd8-760a0adfc468 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031975 Jan 15 21:55:54.294953 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4123/8254] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:55:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:56:51.076541 ncdv-master-1 devstack@n-api.service[129366]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 15 21:56:51.077173 ncdv-master-1 devstack@n-api.service[129366]: Sat Jan 15 21:56:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 15 21:58:00.320657 ncdv-master-1 devstack@n-api.service[129366]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4346cd47-e793-4d94-9b2f-ad282883a042] AMQP server on 10.222.0.46:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jan 15 21:58:00.321749 ncdv-master-1 devstack@n-api.service[129366]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f3ab03e4-0e3e-4ca8-9e53-9b880d1e14ab] AMQP server on 10.222.0.46:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jan 15 21:58:00.371377 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e29f8870-2e16-4d56-b24f-541cde6eaa48 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:58:00.372002 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e29f8870-2e16-4d56-b24f-541cde6eaa48 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] [instance: fdd61ce6-b2d3-4358-afd4-59cadea14a52] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:58:00.378196 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e29f8870-2e16-4d56-b24f-541cde6eaa48 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:58:00.378653 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e29f8870-2e16-4d56-b24f-541cde6eaa48 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:58:00.379444 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e29f8870-2e16-4d56-b24f-541cde6eaa48 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:58:00.379884 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e29f8870-2e16-4d56-b24f-541cde6eaa48 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:58:00.403285 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.objects.instance [None req-e29f8870-2e16-4d56-b24f-541cde6eaa48 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lazy-loading 'flavor' on Instance uuid fdd61ce6-b2d3-4358-afd4-59cadea14a52 {{(pid=129366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 21:58:00.473140 ncdv-master-1 devstack@n-api.service[129366]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e29f8870-2e16-4d56-b24f-541cde6eaa48 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] [98b4e84b-17b9-42a1-9873-b55c6757aba8] AMQP server on 10.222.0.46:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 15 21:58:01.332168 ncdv-master-1 devstack@n-api.service[129366]: INFO oslo.messaging._drivers.impl_rabbit [-] [4346cd47-e793-4d94-9b2f-ad282883a042] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 42394. Jan 15 21:58:01.334152 ncdv-master-1 devstack@n-api.service[129366]: INFO oslo.messaging._drivers.impl_rabbit [-] [f3ab03e4-0e3e-4ca8-9e53-9b880d1e14ab] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 42396. Jan 15 21:58:01.480544 ncdv-master-1 devstack@n-api.service[129366]: INFO oslo.messaging._drivers.impl_rabbit [None req-e29f8870-2e16-4d56-b24f-541cde6eaa48 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] [98b4e84b-17b9-42a1-9873-b55c6757aba8] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 42398. Jan 15 21:58:01.483980 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e29f8870-2e16-4d56-b24f-541cde6eaa48 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] 10.222.0.46 "POST /compute/v2.1/servers/fdd61ce6-b2d3-4358-afd4-59cadea14a52/action" status: 202 len: 0 microversion: 2.1 time: 1.165087 Jan 15 21:58:01.484593 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4132/8255] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:58:00 2022] POST /compute/v2.1/servers/fdd61ce6-b2d3-4358-afd4-59cadea14a52/action => generated 0 bytes in 1166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:58:01.492675 ncdv-master-1 devstack@n-api.service[129365]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b9368858-1d3b-40ae-ba09-78025e088160] AMQP server on 10.222.0.46:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jan 15 21:58:01.494476 ncdv-master-1 devstack@n-api.service[129365]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4ccfdfad-4291-4179-af77-e203370d1c4c] AMQP server on 10.222.0.46:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 15 21:58:01.498523 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-bd26871f-15e1-40f6-a8f7-1ec072681e26 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:58:01.499277 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-bd26871f-15e1-40f6-a8f7-1ec072681e26 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] [instance: fdd61ce6-b2d3-4358-afd4-59cadea14a52] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:58:01.506018 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bd26871f-15e1-40f6-a8f7-1ec072681e26 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:58:01.506504 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bd26871f-15e1-40f6-a8f7-1ec072681e26 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:58:01.507457 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bd26871f-15e1-40f6-a8f7-1ec072681e26 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:58:01.508033 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-bd26871f-15e1-40f6-a8f7-1ec072681e26 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:58:01.701777 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-bd26871f-15e1-40f6-a8f7-1ec072681e26 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd71ca21ce8c455a92db914d0c7e622f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cbeb500a7e84c5d8f6c765ef6530484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:58:01.709470 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-bd26871f-15e1-40f6-a8f7-1ec072681e26 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] 10.222.0.46 "GET /compute/v2.1/servers/fdd61ce6-b2d3-4358-afd4-59cadea14a52" status: 200 len: 1565 microversion: 2.1 time: 0.220191 Jan 15 21:58:01.710150 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4124/8256] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:58:01 2022] GET /compute/v2.1/servers/fdd61ce6-b2d3-4358-afd4-59cadea14a52 => generated 1565 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:58:02.731483 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-4e1a5d89-19c7-4620-ae90-0a8d2eabb4ed tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:58:02.732190 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-4e1a5d89-19c7-4620-ae90-0a8d2eabb4ed tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] [instance: fdd61ce6-b2d3-4358-afd4-59cadea14a52] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:58:02.738406 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4e1a5d89-19c7-4620-ae90-0a8d2eabb4ed tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:58:02.738857 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4e1a5d89-19c7-4620-ae90-0a8d2eabb4ed tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:58:02.739636 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4e1a5d89-19c7-4620-ae90-0a8d2eabb4ed tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:58:02.740072 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-4e1a5d89-19c7-4620-ae90-0a8d2eabb4ed tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:58:02.916722 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-4e1a5d89-19c7-4620-ae90-0a8d2eabb4ed tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd71ca21ce8c455a92db914d0c7e622f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cbeb500a7e84c5d8f6c765ef6530484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:58:02.924088 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-4e1a5d89-19c7-4620-ae90-0a8d2eabb4ed tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] 10.222.0.46 "GET /compute/v2.1/servers/fdd61ce6-b2d3-4358-afd4-59cadea14a52" status: 200 len: 1565 microversion: 2.1 time: 0.198771 Jan 15 21:58:02.924653 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4133/8257] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:58:02 2022] GET /compute/v2.1/servers/fdd61ce6-b2d3-4358-afd4-59cadea14a52 => generated 1565 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:58:03.941828 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-da0b6a39-8ea7-4941-bc15-85b737e8da70 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:58:03.942445 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-da0b6a39-8ea7-4941-bc15-85b737e8da70 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] [instance: fdd61ce6-b2d3-4358-afd4-59cadea14a52] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:58:03.952834 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-da0b6a39-8ea7-4941-bc15-85b737e8da70 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:58:03.953322 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-da0b6a39-8ea7-4941-bc15-85b737e8da70 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:58:03.954132 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-da0b6a39-8ea7-4941-bc15-85b737e8da70 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:58:03.954581 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-da0b6a39-8ea7-4941-bc15-85b737e8da70 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:58:03.961007 ncdv-master-1 devstack@n-api.service[129365]: INFO oslo.messaging._drivers.impl_rabbit [-] [b9368858-1d3b-40ae-ba09-78025e088160] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 42412. Jan 15 21:58:03.970993 ncdv-master-1 devstack@n-api.service[129365]: INFO oslo.messaging._drivers.impl_rabbit [-] [4ccfdfad-4291-4179-af77-e203370d1c4c] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 42414. Jan 15 21:58:04.093947 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-da0b6a39-8ea7-4941-bc15-85b737e8da70 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd71ca21ce8c455a92db914d0c7e622f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cbeb500a7e84c5d8f6c765ef6530484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:58:04.101448 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-da0b6a39-8ea7-4941-bc15-85b737e8da70 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] 10.222.0.46 "GET /compute/v2.1/servers/fdd61ce6-b2d3-4358-afd4-59cadea14a52" status: 200 len: 1565 microversion: 2.1 time: 0.163364 Jan 15 21:58:04.102032 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4125/8258] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:58:03 2022] GET /compute/v2.1/servers/fdd61ce6-b2d3-4358-afd4-59cadea14a52 => generated 1565 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:58:05.118735 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-25bd67a7-71af-40d6-b5e1-9e5550c1931e tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:58:05.119437 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-25bd67a7-71af-40d6-b5e1-9e5550c1931e tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] [instance: fdd61ce6-b2d3-4358-afd4-59cadea14a52] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:58:05.126122 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-25bd67a7-71af-40d6-b5e1-9e5550c1931e tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:58:05.126575 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-25bd67a7-71af-40d6-b5e1-9e5550c1931e tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:58:05.127352 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-25bd67a7-71af-40d6-b5e1-9e5550c1931e tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:58:05.127790 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-25bd67a7-71af-40d6-b5e1-9e5550c1931e tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:58:05.262459 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-25bd67a7-71af-40d6-b5e1-9e5550c1931e tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd71ca21ce8c455a92db914d0c7e622f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cbeb500a7e84c5d8f6c765ef6530484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:58:05.270113 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-25bd67a7-71af-40d6-b5e1-9e5550c1931e tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] 10.222.0.46 "GET /compute/v2.1/servers/fdd61ce6-b2d3-4358-afd4-59cadea14a52" status: 200 len: 1565 microversion: 2.1 time: 0.155065 Jan 15 21:58:05.270703 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4134/8259] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:58:05 2022] GET /compute/v2.1/servers/fdd61ce6-b2d3-4358-afd4-59cadea14a52 => generated 1565 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:58:06.288270 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-cc2a7aec-8604-4d78-98f0-3981bc8f279d tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:58:06.288966 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-cc2a7aec-8604-4d78-98f0-3981bc8f279d tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] [instance: fdd61ce6-b2d3-4358-afd4-59cadea14a52] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:58:06.297045 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cc2a7aec-8604-4d78-98f0-3981bc8f279d tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:58:06.297503 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cc2a7aec-8604-4d78-98f0-3981bc8f279d tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:58:06.298431 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cc2a7aec-8604-4d78-98f0-3981bc8f279d tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:58:06.298933 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-cc2a7aec-8604-4d78-98f0-3981bc8f279d tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:58:06.432372 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-cc2a7aec-8604-4d78-98f0-3981bc8f279d tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd71ca21ce8c455a92db914d0c7e622f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cbeb500a7e84c5d8f6c765ef6530484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:58:06.440220 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-cc2a7aec-8604-4d78-98f0-3981bc8f279d tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] 10.222.0.46 "GET /compute/v2.1/servers/fdd61ce6-b2d3-4358-afd4-59cadea14a52" status: 200 len: 1565 microversion: 2.1 time: 0.156237 Jan 15 21:58:06.440801 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4126/8260] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:58:06 2022] GET /compute/v2.1/servers/fdd61ce6-b2d3-4358-afd4-59cadea14a52 => generated 1565 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:58:07.457201 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8e690aca-d6cb-4971-9038-5afce12bf3bb tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:58:07.457912 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-8e690aca-d6cb-4971-9038-5afce12bf3bb tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] [instance: fdd61ce6-b2d3-4358-afd4-59cadea14a52] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:58:07.465164 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8e690aca-d6cb-4971-9038-5afce12bf3bb tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:58:07.466348 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8e690aca-d6cb-4971-9038-5afce12bf3bb tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:58:07.467176 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8e690aca-d6cb-4971-9038-5afce12bf3bb tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:58:07.467636 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8e690aca-d6cb-4971-9038-5afce12bf3bb tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:58:07.606641 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-8e690aca-d6cb-4971-9038-5afce12bf3bb tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd71ca21ce8c455a92db914d0c7e622f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cbeb500a7e84c5d8f6c765ef6530484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:58:07.614131 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-8e690aca-d6cb-4971-9038-5afce12bf3bb tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] 10.222.0.46 "GET /compute/v2.1/servers/fdd61ce6-b2d3-4358-afd4-59cadea14a52" status: 200 len: 1565 microversion: 2.1 time: 0.160760 Jan 15 21:58:07.614710 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4135/8261] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:58:07 2022] GET /compute/v2.1/servers/fdd61ce6-b2d3-4358-afd4-59cadea14a52 => generated 1565 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:58:08.632272 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-fa375f2e-98d7-46bb-8012-03aa36444842 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:58:08.632823 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-fa375f2e-98d7-46bb-8012-03aa36444842 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] [instance: fdd61ce6-b2d3-4358-afd4-59cadea14a52] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:58:08.640195 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fa375f2e-98d7-46bb-8012-03aa36444842 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:58:08.640652 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fa375f2e-98d7-46bb-8012-03aa36444842 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:58:08.641480 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fa375f2e-98d7-46bb-8012-03aa36444842 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:58:08.641928 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-fa375f2e-98d7-46bb-8012-03aa36444842 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:58:08.771222 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-fa375f2e-98d7-46bb-8012-03aa36444842 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd71ca21ce8c455a92db914d0c7e622f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cbeb500a7e84c5d8f6c765ef6530484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:58:08.778763 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-fa375f2e-98d7-46bb-8012-03aa36444842 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] 10.222.0.46 "GET /compute/v2.1/servers/fdd61ce6-b2d3-4358-afd4-59cadea14a52" status: 200 len: 1565 microversion: 2.1 time: 0.150274 Jan 15 21:58:08.779339 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4127/8262] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:58:08 2022] GET /compute/v2.1/servers/fdd61ce6-b2d3-4358-afd4-59cadea14a52 => generated 1565 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:58:09.795575 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-219ca7dc-c350-4954-b980-e359d3088572 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:58:09.796207 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-219ca7dc-c350-4954-b980-e359d3088572 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] [instance: fdd61ce6-b2d3-4358-afd4-59cadea14a52] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:58:09.803094 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-219ca7dc-c350-4954-b980-e359d3088572 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:58:09.803541 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-219ca7dc-c350-4954-b980-e359d3088572 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:58:09.804306 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-219ca7dc-c350-4954-b980-e359d3088572 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:58:09.804737 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-219ca7dc-c350-4954-b980-e359d3088572 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:58:09.938963 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-219ca7dc-c350-4954-b980-e359d3088572 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd71ca21ce8c455a92db914d0c7e622f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cbeb500a7e84c5d8f6c765ef6530484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:58:09.946232 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-219ca7dc-c350-4954-b980-e359d3088572 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] 10.222.0.46 "GET /compute/v2.1/servers/fdd61ce6-b2d3-4358-afd4-59cadea14a52" status: 200 len: 1565 microversion: 2.1 time: 0.154674 Jan 15 21:58:09.946802 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4136/8263] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:58:09 2022] GET /compute/v2.1/servers/fdd61ce6-b2d3-4358-afd4-59cadea14a52 => generated 1565 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:58:10.963816 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-50c27ac2-142b-4d10-9996-02bdaa32f239 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:58:10.965013 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-50c27ac2-142b-4d10-9996-02bdaa32f239 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] [instance: fdd61ce6-b2d3-4358-afd4-59cadea14a52] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:58:10.973611 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-50c27ac2-142b-4d10-9996-02bdaa32f239 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:58:10.974077 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-50c27ac2-142b-4d10-9996-02bdaa32f239 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:58:10.974883 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-50c27ac2-142b-4d10-9996-02bdaa32f239 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:58:10.975333 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-50c27ac2-142b-4d10-9996-02bdaa32f239 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:58:11.109989 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-50c27ac2-142b-4d10-9996-02bdaa32f239 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd71ca21ce8c455a92db914d0c7e622f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cbeb500a7e84c5d8f6c765ef6530484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:58:11.117456 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-50c27ac2-142b-4d10-9996-02bdaa32f239 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] 10.222.0.46 "GET /compute/v2.1/servers/fdd61ce6-b2d3-4358-afd4-59cadea14a52" status: 200 len: 1565 microversion: 2.1 time: 0.157869 Jan 15 21:58:11.118029 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4128/8264] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:58:10 2022] GET /compute/v2.1/servers/fdd61ce6-b2d3-4358-afd4-59cadea14a52 => generated 1565 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:58:12.134317 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e08a86c9-d33c-47bd-ba1c-5b9199da801c tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:58:12.134920 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e08a86c9-d33c-47bd-ba1c-5b9199da801c tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] [instance: fdd61ce6-b2d3-4358-afd4-59cadea14a52] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:58:12.142412 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e08a86c9-d33c-47bd-ba1c-5b9199da801c tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:58:12.142863 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e08a86c9-d33c-47bd-ba1c-5b9199da801c tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:58:12.143650 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e08a86c9-d33c-47bd-ba1c-5b9199da801c tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:58:12.144090 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e08a86c9-d33c-47bd-ba1c-5b9199da801c tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:58:12.310185 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-e08a86c9-d33c-47bd-ba1c-5b9199da801c tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd71ca21ce8c455a92db914d0c7e622f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cbeb500a7e84c5d8f6c765ef6530484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:58:12.317661 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e08a86c9-d33c-47bd-ba1c-5b9199da801c tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] 10.222.0.46 "GET /compute/v2.1/servers/fdd61ce6-b2d3-4358-afd4-59cadea14a52" status: 200 len: 1565 microversion: 2.1 time: 0.187029 Jan 15 21:58:12.318232 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4137/8265] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:58:12 2022] GET /compute/v2.1/servers/fdd61ce6-b2d3-4358-afd4-59cadea14a52 => generated 1565 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:58:13.335217 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-ee41dd33-84a3-4b9a-b807-49f580ea529e tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:58:13.335844 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-ee41dd33-84a3-4b9a-b807-49f580ea529e tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] [instance: fdd61ce6-b2d3-4358-afd4-59cadea14a52] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:58:13.343240 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ee41dd33-84a3-4b9a-b807-49f580ea529e tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:58:13.343698 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ee41dd33-84a3-4b9a-b807-49f580ea529e tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:58:13.344484 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ee41dd33-84a3-4b9a-b807-49f580ea529e tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:58:13.344965 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-ee41dd33-84a3-4b9a-b807-49f580ea529e tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:58:13.768025 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-ee41dd33-84a3-4b9a-b807-49f580ea529e tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd71ca21ce8c455a92db914d0c7e622f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cbeb500a7e84c5d8f6c765ef6530484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:58:13.775499 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-ee41dd33-84a3-4b9a-b807-49f580ea529e tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] 10.222.0.46 "GET /compute/v2.1/servers/fdd61ce6-b2d3-4358-afd4-59cadea14a52" status: 200 len: 1565 microversion: 2.1 time: 0.444081 Jan 15 21:58:13.776096 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4129/8266] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:58:13 2022] GET /compute/v2.1/servers/fdd61ce6-b2d3-4358-afd4-59cadea14a52 => generated 1565 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:58:14.792677 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9d046666-cc0d-458c-8e9b-2707d616e605 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:58:14.793304 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-9d046666-cc0d-458c-8e9b-2707d616e605 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] [instance: fdd61ce6-b2d3-4358-afd4-59cadea14a52] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:58:14.800766 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9d046666-cc0d-458c-8e9b-2707d616e605 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:58:14.801257 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9d046666-cc0d-458c-8e9b-2707d616e605 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:58:14.802041 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9d046666-cc0d-458c-8e9b-2707d616e605 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:58:14.802471 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9d046666-cc0d-458c-8e9b-2707d616e605 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:58:14.954278 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-9d046666-cc0d-458c-8e9b-2707d616e605 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd71ca21ce8c455a92db914d0c7e622f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cbeb500a7e84c5d8f6c765ef6530484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:58:14.964946 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-9d046666-cc0d-458c-8e9b-2707d616e605 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] 10.222.0.46 "GET /compute/v2.1/servers/fdd61ce6-b2d3-4358-afd4-59cadea14a52" status: 200 len: 1506 microversion: 2.1 time: 0.175646 Jan 15 21:58:14.965911 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4138/8267] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:58:14 2022] GET /compute/v2.1/servers/fdd61ce6-b2d3-4358-afd4-59cadea14a52 => generated 1506 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:58:14.982790 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-eb097651-a371-4967-a46d-8aeb9d40df11 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:58:14.983382 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-eb097651-a371-4967-a46d-8aeb9d40df11 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] [instance: fdd61ce6-b2d3-4358-afd4-59cadea14a52] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:58:14.991492 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-eb097651-a371-4967-a46d-8aeb9d40df11 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:58:14.992068 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-eb097651-a371-4967-a46d-8aeb9d40df11 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:58:14.992904 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-eb097651-a371-4967-a46d-8aeb9d40df11 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:58:14.993395 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-eb097651-a371-4967-a46d-8aeb9d40df11 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:58:15.077903 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-eb097651-a371-4967-a46d-8aeb9d40df11 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] 10.222.0.46 "POST /compute/v2.1/servers/fdd61ce6-b2d3-4358-afd4-59cadea14a52/action" status: 202 len: 0 microversion: 2.1 time: 0.098700 Jan 15 21:58:15.078382 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4130/8268] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 21:58:14 2022] POST /compute/v2.1/servers/fdd61ce6-b2d3-4358-afd4-59cadea14a52/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 21:58:15.087848 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-afdb65c8-e04f-4575-aaeb-c7ce1a0b7763 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:58:15.088450 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-afdb65c8-e04f-4575-aaeb-c7ce1a0b7763 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] [instance: fdd61ce6-b2d3-4358-afd4-59cadea14a52] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:58:15.096880 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-afdb65c8-e04f-4575-aaeb-c7ce1a0b7763 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:58:15.097362 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-afdb65c8-e04f-4575-aaeb-c7ce1a0b7763 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:58:15.098151 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-afdb65c8-e04f-4575-aaeb-c7ce1a0b7763 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:58:15.098582 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-afdb65c8-e04f-4575-aaeb-c7ce1a0b7763 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:58:15.252047 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-afdb65c8-e04f-4575-aaeb-c7ce1a0b7763 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd71ca21ce8c455a92db914d0c7e622f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cbeb500a7e84c5d8f6c765ef6530484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:58:15.259888 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-afdb65c8-e04f-4575-aaeb-c7ce1a0b7763 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] 10.222.0.46 "GET /compute/v2.1/servers/fdd61ce6-b2d3-4358-afd4-59cadea14a52" status: 200 len: 1514 microversion: 2.1 time: 0.175782 Jan 15 21:58:15.260822 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4139/8269] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:58:15 2022] GET /compute/v2.1/servers/fdd61ce6-b2d3-4358-afd4-59cadea14a52 => generated 1514 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:58:16.279984 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3093dfae-ff40-442d-95ec-dcc94e54e5ae tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:58:16.280724 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-3093dfae-ff40-442d-95ec-dcc94e54e5ae tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] [instance: fdd61ce6-b2d3-4358-afd4-59cadea14a52] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:58:16.287728 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3093dfae-ff40-442d-95ec-dcc94e54e5ae tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:58:16.288184 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3093dfae-ff40-442d-95ec-dcc94e54e5ae tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:58:16.289001 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3093dfae-ff40-442d-95ec-dcc94e54e5ae tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:58:16.289452 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-3093dfae-ff40-442d-95ec-dcc94e54e5ae tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:58:16.429492 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-3093dfae-ff40-442d-95ec-dcc94e54e5ae tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd71ca21ce8c455a92db914d0c7e622f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cbeb500a7e84c5d8f6c765ef6530484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:58:16.437467 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3093dfae-ff40-442d-95ec-dcc94e54e5ae tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] 10.222.0.46 "GET /compute/v2.1/servers/fdd61ce6-b2d3-4358-afd4-59cadea14a52" status: 200 len: 1516 microversion: 2.1 time: 0.162099 Jan 15 21:58:16.438168 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4131/8270] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:58:16 2022] GET /compute/v2.1/servers/fdd61ce6-b2d3-4358-afd4-59cadea14a52 => generated 1516 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:58:17.353423 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-23abacff-6d2c-4191-9948-8e230f2f505e req-8d9256ae-0c91-435f-8995-fe17a79d72ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdd61ce6-b2d3-4358-afd4-59cadea14a52", "name": "network-vif-unplugged", "status": "completed", "tag": "729cd33b-96ce-4869-9f56-9ba9d5d7d05c"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:58:17.355109 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:58:17.355109 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:58:17.363997 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-23abacff-6d2c-4191-9948-8e230f2f505e req-8d9256ae-0c91-435f-8995-fe17a79d72ab service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:58:17.364464 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-23abacff-6d2c-4191-9948-8e230f2f505e req-8d9256ae-0c91-435f-8995-fe17a79d72ab service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:58:17.377662 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-23abacff-6d2c-4191-9948-8e230f2f505e req-8d9256ae-0c91-435f-8995-fe17a79d72ab service nova] Creating event network-vif-unplugged:729cd33b-96ce-4869-9f56-9ba9d5d7d05c for instance fdd61ce6-b2d3-4358-afd4-59cadea14a52 on nch1-master-1 Jan 15 21:58:17.382820 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-23abacff-6d2c-4191-9948-8e230f2f505e req-8d9256ae-0c91-435f-8995-fe17a79d72ab service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033442 Jan 15 21:58:17.383630 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4140/8271] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:58:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:58:17.455770 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e6c847ab-4238-4305-99bb-870b1dcd11fb tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:58:17.457030 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e6c847ab-4238-4305-99bb-870b1dcd11fb tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] [instance: fdd61ce6-b2d3-4358-afd4-59cadea14a52] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:58:17.464307 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e6c847ab-4238-4305-99bb-870b1dcd11fb tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:58:17.464783 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e6c847ab-4238-4305-99bb-870b1dcd11fb tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:58:17.465623 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e6c847ab-4238-4305-99bb-870b1dcd11fb tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:58:17.466078 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e6c847ab-4238-4305-99bb-870b1dcd11fb tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:58:17.633148 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-e6c847ab-4238-4305-99bb-870b1dcd11fb tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd71ca21ce8c455a92db914d0c7e622f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cbeb500a7e84c5d8f6c765ef6530484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:58:17.640623 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e6c847ab-4238-4305-99bb-870b1dcd11fb tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] 10.222.0.46 "GET /compute/v2.1/servers/fdd61ce6-b2d3-4358-afd4-59cadea14a52" status: 200 len: 1572 microversion: 2.1 time: 0.188755 Jan 15 21:58:17.641758 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4132/8272] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:58:17 2022] GET /compute/v2.1/servers/fdd61ce6-b2d3-4358-afd4-59cadea14a52 => generated 1572 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:58:18.661109 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b4c9d6f4-87c8-4a6e-8967-189096f6db59 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:58:18.661793 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b4c9d6f4-87c8-4a6e-8967-189096f6db59 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] [instance: fdd61ce6-b2d3-4358-afd4-59cadea14a52] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:58:18.667950 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b4c9d6f4-87c8-4a6e-8967-189096f6db59 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:58:18.668398 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b4c9d6f4-87c8-4a6e-8967-189096f6db59 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:58:18.669200 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b4c9d6f4-87c8-4a6e-8967-189096f6db59 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:58:18.669637 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b4c9d6f4-87c8-4a6e-8967-189096f6db59 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:58:18.807453 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-b4c9d6f4-87c8-4a6e-8967-189096f6db59 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd71ca21ce8c455a92db914d0c7e622f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cbeb500a7e84c5d8f6c765ef6530484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:58:18.815593 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b4c9d6f4-87c8-4a6e-8967-189096f6db59 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] 10.222.0.46 "GET /compute/v2.1/servers/fdd61ce6-b2d3-4358-afd4-59cadea14a52" status: 200 len: 1572 microversion: 2.1 time: 0.160589 Jan 15 21:58:18.816178 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4141/8273] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:58:18 2022] GET /compute/v2.1/servers/fdd61ce6-b2d3-4358-afd4-59cadea14a52 => generated 1572 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:58:19.409541 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-9f260d2d-d413-4513-ae45-847528712b52 req-40c97c50-ac79-4cb8-b428-74dd35c28285 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdd61ce6-b2d3-4358-afd4-59cadea14a52", "tag": "729cd33b-96ce-4869-9f56-9ba9d5d7d05c"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:58:19.411102 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:58:19.411102 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 21:58:19.418994 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-9f260d2d-d413-4513-ae45-847528712b52 req-40c97c50-ac79-4cb8-b428-74dd35c28285 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:58:19.419454 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-9f260d2d-d413-4513-ae45-847528712b52 req-40c97c50-ac79-4cb8-b428-74dd35c28285 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:58:19.431404 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-9f260d2d-d413-4513-ae45-847528712b52 req-40c97c50-ac79-4cb8-b428-74dd35c28285 service nova] Creating event network-changed:729cd33b-96ce-4869-9f56-9ba9d5d7d05c for instance fdd61ce6-b2d3-4358-afd4-59cadea14a52 on nch1-master-1 Jan 15 21:58:19.434878 ncdv-master-1 devstack@n-api.service[129365]: ERROR oslo.messaging._drivers.impl_rabbit [req-9f260d2d-d413-4513-ae45-847528712b52 req-40c97c50-ac79-4cb8-b428-74dd35c28285 service nova] [e5dabf05-3f1e-475b-87f7-56ca3f6bc23f] AMQP server on 10.222.0.46:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 15 21:58:19.833387 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-48cabb4e-a607-4bdd-b2f0-9fc00d9acd07 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:58:19.834001 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-48cabb4e-a607-4bdd-b2f0-9fc00d9acd07 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] [instance: fdd61ce6-b2d3-4358-afd4-59cadea14a52] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:58:19.840629 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-48cabb4e-a607-4bdd-b2f0-9fc00d9acd07 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:58:19.841142 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-48cabb4e-a607-4bdd-b2f0-9fc00d9acd07 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:58:19.841921 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-48cabb4e-a607-4bdd-b2f0-9fc00d9acd07 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:58:19.842356 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-48cabb4e-a607-4bdd-b2f0-9fc00d9acd07 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:58:19.973326 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-48cabb4e-a607-4bdd-b2f0-9fc00d9acd07 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd71ca21ce8c455a92db914d0c7e622f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cbeb500a7e84c5d8f6c765ef6530484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:58:19.980698 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-48cabb4e-a607-4bdd-b2f0-9fc00d9acd07 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] 10.222.0.46 "GET /compute/v2.1/servers/fdd61ce6-b2d3-4358-afd4-59cadea14a52" status: 200 len: 1572 microversion: 2.1 time: 0.152021 Jan 15 21:58:19.981292 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4142/8274] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:58:19 2022] GET /compute/v2.1/servers/fdd61ce6-b2d3-4358-afd4-59cadea14a52 => generated 1572 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:58:20.442200 ncdv-master-1 devstack@n-api.service[129365]: INFO oslo.messaging._drivers.impl_rabbit [req-9f260d2d-d413-4513-ae45-847528712b52 req-40c97c50-ac79-4cb8-b428-74dd35c28285 service nova] [e5dabf05-3f1e-475b-87f7-56ca3f6bc23f] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 42474. Jan 15 21:58:20.445508 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-9f260d2d-d413-4513-ae45-847528712b52 req-40c97c50-ac79-4cb8-b428-74dd35c28285 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.040781 Jan 15 21:58:20.446186 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4133/8275] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:58:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 21:58:20.998122 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-7cbf24ae-ec60-45ba-9aac-9b6e20066459 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:58:20.998740 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-7cbf24ae-ec60-45ba-9aac-9b6e20066459 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] [instance: fdd61ce6-b2d3-4358-afd4-59cadea14a52] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:58:21.006268 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7cbf24ae-ec60-45ba-9aac-9b6e20066459 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:58:21.006712 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7cbf24ae-ec60-45ba-9aac-9b6e20066459 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:58:21.007480 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7cbf24ae-ec60-45ba-9aac-9b6e20066459 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:58:21.007912 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-7cbf24ae-ec60-45ba-9aac-9b6e20066459 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:58:21.141520 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-7cbf24ae-ec60-45ba-9aac-9b6e20066459 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd71ca21ce8c455a92db914d0c7e622f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cbeb500a7e84c5d8f6c765ef6530484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:58:21.148944 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-7cbf24ae-ec60-45ba-9aac-9b6e20066459 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] 10.222.0.46 "GET /compute/v2.1/servers/fdd61ce6-b2d3-4358-afd4-59cadea14a52" status: 200 len: 1572 microversion: 2.1 time: 0.154465 Jan 15 21:58:21.149526 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4143/8276] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:58:20 2022] GET /compute/v2.1/servers/fdd61ce6-b2d3-4358-afd4-59cadea14a52 => generated 1572 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:58:22.167345 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f37d072b-2c1f-442b-b0c3-924ae8d81045 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:58:22.168046 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f37d072b-2c1f-442b-b0c3-924ae8d81045 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] [instance: fdd61ce6-b2d3-4358-afd4-59cadea14a52] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:58:22.174980 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f37d072b-2c1f-442b-b0c3-924ae8d81045 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:58:22.175432 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f37d072b-2c1f-442b-b0c3-924ae8d81045 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:58:22.176218 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f37d072b-2c1f-442b-b0c3-924ae8d81045 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:58:22.176660 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f37d072b-2c1f-442b-b0c3-924ae8d81045 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:58:22.315961 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-f37d072b-2c1f-442b-b0c3-924ae8d81045 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd71ca21ce8c455a92db914d0c7e622f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cbeb500a7e84c5d8f6c765ef6530484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:58:22.323550 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f37d072b-2c1f-442b-b0c3-924ae8d81045 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] 10.222.0.46 "GET /compute/v2.1/servers/fdd61ce6-b2d3-4358-afd4-59cadea14a52" status: 200 len: 1572 microversion: 2.1 time: 0.161111 Jan 15 21:58:22.324159 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4134/8277] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:58:22 2022] GET /compute/v2.1/servers/fdd61ce6-b2d3-4358-afd4-59cadea14a52 => generated 1572 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:58:23.341075 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e9c19d5b-4fbf-4157-a287-5bc332b1a004 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:58:23.341867 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e9c19d5b-4fbf-4157-a287-5bc332b1a004 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] [instance: fdd61ce6-b2d3-4358-afd4-59cadea14a52] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:58:23.348669 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e9c19d5b-4fbf-4157-a287-5bc332b1a004 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:58:23.349201 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e9c19d5b-4fbf-4157-a287-5bc332b1a004 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:58:23.354024 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e9c19d5b-4fbf-4157-a287-5bc332b1a004 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:58:23.354490 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e9c19d5b-4fbf-4157-a287-5bc332b1a004 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:58:23.491058 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-e9c19d5b-4fbf-4157-a287-5bc332b1a004 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd71ca21ce8c455a92db914d0c7e622f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cbeb500a7e84c5d8f6c765ef6530484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:58:23.498942 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e9c19d5b-4fbf-4157-a287-5bc332b1a004 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] 10.222.0.46 "GET /compute/v2.1/servers/fdd61ce6-b2d3-4358-afd4-59cadea14a52" status: 200 len: 1572 microversion: 2.1 time: 0.161637 Jan 15 21:58:23.499547 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4144/8278] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:58:23 2022] GET /compute/v2.1/servers/fdd61ce6-b2d3-4358-afd4-59cadea14a52 => generated 1572 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:58:24.516375 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-f79c3666-f8f4-4755-b3d8-33608df85fc6 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:58:24.517058 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-f79c3666-f8f4-4755-b3d8-33608df85fc6 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] [instance: fdd61ce6-b2d3-4358-afd4-59cadea14a52] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:58:24.524590 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f79c3666-f8f4-4755-b3d8-33608df85fc6 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:58:24.525110 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f79c3666-f8f4-4755-b3d8-33608df85fc6 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:58:24.525904 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f79c3666-f8f4-4755-b3d8-33608df85fc6 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:58:24.526357 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-f79c3666-f8f4-4755-b3d8-33608df85fc6 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:58:24.661160 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-f79c3666-f8f4-4755-b3d8-33608df85fc6 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd71ca21ce8c455a92db914d0c7e622f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cbeb500a7e84c5d8f6c765ef6530484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:58:24.668719 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-f79c3666-f8f4-4755-b3d8-33608df85fc6 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] 10.222.0.46 "GET /compute/v2.1/servers/fdd61ce6-b2d3-4358-afd4-59cadea14a52" status: 200 len: 1572 microversion: 2.1 time: 0.156363 Jan 15 21:58:24.669336 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4135/8279] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:58:24 2022] GET /compute/v2.1/servers/fdd61ce6-b2d3-4358-afd4-59cadea14a52 => generated 1572 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:58:25.078910 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-af25733a-b294-4570-9788-cd2d79dc5995 req-0a68dcc6-4271-4dfb-94f9-214ee22628ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdd61ce6-b2d3-4358-afd4-59cadea14a52", "name": "network-vif-plugged", "status": "completed", "tag": "729cd33b-96ce-4869-9f56-9ba9d5d7d05c"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:58:25.080523 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:58:25.080523 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:58:25.088530 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-af25733a-b294-4570-9788-cd2d79dc5995 req-0a68dcc6-4271-4dfb-94f9-214ee22628ae service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:58:25.089034 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-af25733a-b294-4570-9788-cd2d79dc5995 req-0a68dcc6-4271-4dfb-94f9-214ee22628ae service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:58:25.100526 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-af25733a-b294-4570-9788-cd2d79dc5995 req-0a68dcc6-4271-4dfb-94f9-214ee22628ae service nova] Creating event network-vif-plugged:729cd33b-96ce-4869-9f56-9ba9d5d7d05c for instance fdd61ce6-b2d3-4358-afd4-59cadea14a52 on nch1-master-1 Jan 15 21:58:25.105600 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-af25733a-b294-4570-9788-cd2d79dc5995 req-0a68dcc6-4271-4dfb-94f9-214ee22628ae service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030493 Jan 15 21:58:25.106243 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4145/8280] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:58:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 21:58:25.684603 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2c689802-eaac-4cdb-826f-2aa85c6932b2 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:58:25.685262 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-2c689802-eaac-4cdb-826f-2aa85c6932b2 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] [instance: fdd61ce6-b2d3-4358-afd4-59cadea14a52] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:58:25.692082 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2c689802-eaac-4cdb-826f-2aa85c6932b2 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:58:25.692611 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2c689802-eaac-4cdb-826f-2aa85c6932b2 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:58:25.693458 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2c689802-eaac-4cdb-826f-2aa85c6932b2 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:58:25.693909 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2c689802-eaac-4cdb-826f-2aa85c6932b2 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:58:25.824022 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-2c689802-eaac-4cdb-826f-2aa85c6932b2 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd71ca21ce8c455a92db914d0c7e622f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cbeb500a7e84c5d8f6c765ef6530484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:58:25.831458 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2c689802-eaac-4cdb-826f-2aa85c6932b2 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] 10.222.0.46 "GET /compute/v2.1/servers/fdd61ce6-b2d3-4358-afd4-59cadea14a52" status: 200 len: 1572 microversion: 2.1 time: 0.150635 Jan 15 21:58:25.832031 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4136/8281] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:58:25 2022] GET /compute/v2.1/servers/fdd61ce6-b2d3-4358-afd4-59cadea14a52 => generated 1572 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:58:26.849650 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-043790ed-5cfb-4b15-9a2a-baed9d9ee902 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:58:26.850335 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-043790ed-5cfb-4b15-9a2a-baed9d9ee902 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] [instance: fdd61ce6-b2d3-4358-afd4-59cadea14a52] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:58:26.856467 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-043790ed-5cfb-4b15-9a2a-baed9d9ee902 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:58:26.856981 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-043790ed-5cfb-4b15-9a2a-baed9d9ee902 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:58:26.857747 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-043790ed-5cfb-4b15-9a2a-baed9d9ee902 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:58:26.858179 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-043790ed-5cfb-4b15-9a2a-baed9d9ee902 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:58:26.999126 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-043790ed-5cfb-4b15-9a2a-baed9d9ee902 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd71ca21ce8c455a92db914d0c7e622f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cbeb500a7e84c5d8f6c765ef6530484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:58:27.007280 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-043790ed-5cfb-4b15-9a2a-baed9d9ee902 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] 10.222.0.46 "GET /compute/v2.1/servers/fdd61ce6-b2d3-4358-afd4-59cadea14a52" status: 200 len: 1559 microversion: 2.1 time: 0.162652 Jan 15 21:58:27.007872 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4146/8282] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:58:26 2022] GET /compute/v2.1/servers/fdd61ce6-b2d3-4358-afd4-59cadea14a52 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:58:31.014054 ncdv-master-1 devstack@n-api.service[129366]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 15 21:58:31.014833 ncdv-master-1 devstack@n-api.service[129366]: Sat Jan 15 21:58:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 15 21:59:46.747066 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-453bdaa5-498f-43c1-b1e7-02a54c165ae7 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:59:46.747602 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-453bdaa5-498f-43c1-b1e7-02a54c165ae7 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] [instance: fdd61ce6-b2d3-4358-afd4-59cadea14a52] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:59:46.749709 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-38fcf72c-f380-44d5-b91a-be0d6ce4e116 req-734a4e11-e24c-4fc7-9042-a1c2f0024a16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdd61ce6-b2d3-4358-afd4-59cadea14a52", "tag": "729cd33b-96ce-4869-9f56-9ba9d5d7d05c"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:59:46.751435 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:59:46.751435 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:59:46.754205 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-453bdaa5-498f-43c1-b1e7-02a54c165ae7 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:59:46.754929 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-453bdaa5-498f-43c1-b1e7-02a54c165ae7 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:59:46.755726 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-453bdaa5-498f-43c1-b1e7-02a54c165ae7 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:59:46.756171 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-453bdaa5-498f-43c1-b1e7-02a54c165ae7 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:59:46.759059 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-38fcf72c-f380-44d5-b91a-be0d6ce4e116 req-734a4e11-e24c-4fc7-9042-a1c2f0024a16 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:59:46.759766 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-38fcf72c-f380-44d5-b91a-be0d6ce4e116 req-734a4e11-e24c-4fc7-9042-a1c2f0024a16 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:59:46.772290 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-38fcf72c-f380-44d5-b91a-be0d6ce4e116 req-734a4e11-e24c-4fc7-9042-a1c2f0024a16 service nova] Creating event network-changed:729cd33b-96ce-4869-9f56-9ba9d5d7d05c for instance fdd61ce6-b2d3-4358-afd4-59cadea14a52 on nch1-master-1 Jan 15 21:59:46.777509 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-38fcf72c-f380-44d5-b91a-be0d6ce4e116 req-734a4e11-e24c-4fc7-9042-a1c2f0024a16 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032616 Jan 15 21:59:46.778320 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4147/8283] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:59:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 21:59:46.784125 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-453bdaa5-498f-43c1-b1e7-02a54c165ae7 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] [instance: fdd61ce6-b2d3-4358-afd4-59cadea14a52] Going to try to terminate instance {{(pid=129365) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 21:59:46.873445 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-453bdaa5-498f-43c1-b1e7-02a54c165ae7 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] 10.222.0.46 "DELETE /compute/v2.1/servers/fdd61ce6-b2d3-4358-afd4-59cadea14a52" status: 204 len: 0 microversion: 2.1 time: 0.131008 Jan 15 21:59:46.874691 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4137/8284] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 21:59:46 2022] DELETE /compute/v2.1/servers/fdd61ce6-b2d3-4358-afd4-59cadea14a52 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 21:59:46.884172 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-1d3ecea9-2084-4869-ae27-40b0e7a7bfb9 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:59:46.884894 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-1d3ecea9-2084-4869-ae27-40b0e7a7bfb9 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] [instance: fdd61ce6-b2d3-4358-afd4-59cadea14a52] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:59:46.891158 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1d3ecea9-2084-4869-ae27-40b0e7a7bfb9 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:59:46.891861 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1d3ecea9-2084-4869-ae27-40b0e7a7bfb9 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:59:46.894000 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1d3ecea9-2084-4869-ae27-40b0e7a7bfb9 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:59:46.894444 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-1d3ecea9-2084-4869-ae27-40b0e7a7bfb9 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:59:47.047591 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-1d3ecea9-2084-4869-ae27-40b0e7a7bfb9 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd71ca21ce8c455a92db914d0c7e622f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cbeb500a7e84c5d8f6c765ef6530484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:59:47.055533 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-1d3ecea9-2084-4869-ae27-40b0e7a7bfb9 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] 10.222.0.46 "GET /compute/v2.1/servers/fdd61ce6-b2d3-4358-afd4-59cadea14a52" status: 200 len: 1565 microversion: 2.1 time: 0.175558 Jan 15 21:59:47.056112 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4148/8285] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:59:46 2022] GET /compute/v2.1/servers/fdd61ce6-b2d3-4358-afd4-59cadea14a52 => generated 1565 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:59:48.074607 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-27a4a719-1da6-4f2a-83c5-c6987911fc89 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:59:48.075593 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-27a4a719-1da6-4f2a-83c5-c6987911fc89 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] [instance: fdd61ce6-b2d3-4358-afd4-59cadea14a52] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:59:48.084719 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-27a4a719-1da6-4f2a-83c5-c6987911fc89 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:59:48.085152 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-27a4a719-1da6-4f2a-83c5-c6987911fc89 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:59:48.085950 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-27a4a719-1da6-4f2a-83c5-c6987911fc89 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:59:48.086399 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-27a4a719-1da6-4f2a-83c5-c6987911fc89 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:59:48.225287 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-27a4a719-1da6-4f2a-83c5-c6987911fc89 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd71ca21ce8c455a92db914d0c7e622f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cbeb500a7e84c5d8f6c765ef6530484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:59:48.232734 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-27a4a719-1da6-4f2a-83c5-c6987911fc89 tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] 10.222.0.46 "GET /compute/v2.1/servers/fdd61ce6-b2d3-4358-afd4-59cadea14a52" status: 200 len: 1447 microversion: 2.1 time: 0.162681 Jan 15 21:59:48.233338 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4138/8286] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:59:48 2022] GET /compute/v2.1/servers/fdd61ce6-b2d3-4358-afd4-59cadea14a52 => generated 1447 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 21:59:48.991375 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-8782abf2-ee71-4d3d-b751-0674649c3e1c req-987a89d8-cf41-4b48-878a-c8460d30d491 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdd61ce6-b2d3-4358-afd4-59cadea14a52", "name": "network-vif-deleted", "tag": "729cd33b-96ce-4869-9f56-9ba9d5d7d05c"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 21:59:48.993167 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 21:59:48.993167 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 21:59:49.000158 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-8782abf2-ee71-4d3d-b751-0674649c3e1c req-987a89d8-cf41-4b48-878a-c8460d30d491 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:59:49.000601 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-8782abf2-ee71-4d3d-b751-0674649c3e1c req-987a89d8-cf41-4b48-878a-c8460d30d491 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:59:49.013325 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-8782abf2-ee71-4d3d-b751-0674649c3e1c req-987a89d8-cf41-4b48-878a-c8460d30d491 service nova] Creating event network-vif-deleted:729cd33b-96ce-4869-9f56-9ba9d5d7d05c for instance fdd61ce6-b2d3-4358-afd4-59cadea14a52 on nch1-master-1 Jan 15 21:59:49.019348 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-8782abf2-ee71-4d3d-b751-0674649c3e1c req-987a89d8-cf41-4b48-878a-c8460d30d491 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088857 Jan 15 21:59:49.019953 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4149/8287] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 21:59:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 21:59:49.250210 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-dac8fa9f-f5f0-46df-a0e3-144d3d2c9ace tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:59:49.250873 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-dac8fa9f-f5f0-46df-a0e3-144d3d2c9ace tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] [instance: fdd61ce6-b2d3-4358-afd4-59cadea14a52] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:59:49.259267 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dac8fa9f-f5f0-46df-a0e3-144d3d2c9ace tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:59:49.259730 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dac8fa9f-f5f0-46df-a0e3-144d3d2c9ace tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:59:49.260900 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dac8fa9f-f5f0-46df-a0e3-144d3d2c9ace tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:59:49.261526 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dac8fa9f-f5f0-46df-a0e3-144d3d2c9ace tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:59:49.298849 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dac8fa9f-f5f0-46df-a0e3-144d3d2c9ace tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:59:49.300011 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-dac8fa9f-f5f0-46df-a0e3-144d3d2c9ace tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:59:49.300492 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.objects.instance [None req-dac8fa9f-f5f0-46df-a0e3-144d3d2c9ace tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lazy-loading 'fault' on Instance uuid fdd61ce6-b2d3-4358-afd4-59cadea14a52 {{(pid=129365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 21:59:49.359697 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-dac8fa9f-f5f0-46df-a0e3-144d3d2c9ace tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd71ca21ce8c455a92db914d0c7e622f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cbeb500a7e84c5d8f6c765ef6530484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 21:59:49.370179 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-dac8fa9f-f5f0-46df-a0e3-144d3d2c9ace tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] 10.222.0.46 "GET /compute/v2.1/servers/fdd61ce6-b2d3-4358-afd4-59cadea14a52" status: 200 len: 1222 microversion: 2.1 time: 0.123809 Jan 15 21:59:49.371267 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4139/8288] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:59:49 2022] GET /compute/v2.1/servers/fdd61ce6-b2d3-4358-afd4-59cadea14a52 => generated 1222 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 21:59:50.389163 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f6348135-6969-4c66-9920-bd1a15b32d1c tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:59:50.389861 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f6348135-6969-4c66-9920-bd1a15b32d1c tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] [instance: fdd61ce6-b2d3-4358-afd4-59cadea14a52] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 21:59:50.396652 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f6348135-6969-4c66-9920-bd1a15b32d1c tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:59:50.397167 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f6348135-6969-4c66-9920-bd1a15b32d1c tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:59:50.397941 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f6348135-6969-4c66-9920-bd1a15b32d1c tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 21:59:50.398385 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-f6348135-6969-4c66-9920-bd1a15b32d1c tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 21:59:50.413554 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-f6348135-6969-4c66-9920-bd1a15b32d1c tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] HTTP exception thrown: Instance fdd61ce6-b2d3-4358-afd4-59cadea14a52 could not be found. Jan 15 21:59:50.414154 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f6348135-6969-4c66-9920-bd1a15b32d1c tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Returning 404 to user: Instance fdd61ce6-b2d3-4358-afd4-59cadea14a52 could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 21:59:50.414989 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f6348135-6969-4c66-9920-bd1a15b32d1c tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] 10.222.0.46 "GET /compute/v2.1/servers/fdd61ce6-b2d3-4358-afd4-59cadea14a52" status: 404 len: 111 microversion: 2.1 time: 0.030790 Jan 15 21:59:50.415716 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4150/8289] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 21:59:50 2022] GET /compute/v2.1/servers/fdd61ce6-b2d3-4358-afd4-59cadea14a52 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 21:59:50.577453 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-3bb8c630-db87-4145-a794-70bccce40b9d tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] Calling method '.version_select at 0x7f30c977baf0>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 21:59:50.601819 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-3bb8c630-db87-4145-a794-70bccce40b9d tempest-TestShelveInstance-623147722 tempest-TestShelveInstance-623147722-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-726047653" status: 202 len: 0 microversion: 2.1 time: 0.028262 Jan 15 21:59:50.602476 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4140/8290] 10.222.0.46 () {58 vars in 1250 bytes} [Sat Jan 15 21:59:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-726047653 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 22:00:09.094493 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-6ddbf909-12a6-4b6a-8c71-c5232c247218 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Action: 'create', calling method: .version_select at 0x7f30cae25b80>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-1045805389"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 22:00:09.109049 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-6ddbf909-12a6-4b6a-8c71-c5232c247218 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Getting quotas for project 733e7c15666c404a9e926edbcc0768e9. Resources: {'key_pairs'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 22:00:09.114817 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-6ddbf909-12a6-4b6a-8c71-c5232c247218 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Getting quotas for user 5e90847e86e5488f9b41aac93f5929c0 and project 733e7c15666c404a9e926edbcc0768e9. Resources: {'key_pairs'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 22:00:09.215216 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-6ddbf909-12a6-4b6a-8c71-c5232c247218 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Getting quotas for project 733e7c15666c404a9e926edbcc0768e9. Resources: {'key_pairs'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 22:00:09.220193 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-6ddbf909-12a6-4b6a-8c71-c5232c247218 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Getting quotas for user 5e90847e86e5488f9b41aac93f5929c0 and project 733e7c15666c404a9e926edbcc0768e9. Resources: {'key_pairs'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 22:00:09.235243 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-6ddbf909-12a6-4b6a-8c71-c5232c247218 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 2317 microversion: 2.1 time: 0.353482 Jan 15 22:00:09.235873 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4151/8291] 10.222.0.46 () {60 vars in 1157 bytes} [Sat Jan 15 22:00:08 2022] POST /compute/v2.1/os-keypairs => generated 2317 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 22:00:10.220822 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-be0e9fd6-d335-4e92-b610-4784a204557f tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1685524005", "imageRef": "1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1045805389", "security_groups": [{"name": "tempest-secgroup-smoke-873007183"}], "networks": [{"uuid": "c73c4a14-0781-4393-aa1e-9fcd878de814"}]}} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 22:00:10.327872 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.network.neutron [None req-be0e9fd6-d335-4e92-b610-4784a204557f tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] validate_networks() for [('c73c4a14-0781-4393-aa1e-9fcd878de814', None, None, None, None, None)] {{(pid=129365) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 22:00:10.817526 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-be0e9fd6-d335-4e92-b610-4784a204557f tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Flavor limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 22:00:10.817963 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-be0e9fd6-d335-4e92-b610-4784a204557f tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Image limits 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 22:00:10.818444 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-be0e9fd6-d335-4e92-b610-4784a204557f tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Flavor pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 22:00:10.818988 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-be0e9fd6-d335-4e92-b610-4784a204557f tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Image pref 0:0:0 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 22:00:10.819411 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.virt.hardware [None req-be0e9fd6-d335-4e92-b610-4784a204557f tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 22:00:10.828114 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-be0e9fd6-d335-4e92-b610-4784a204557f tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 22:00:10.828615 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-be0e9fd6-d335-4e92-b610-4784a204557f tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 22:00:10.829504 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-be0e9fd6-d335-4e92-b610-4784a204557f tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 22:00:10.829951 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-be0e9fd6-d335-4e92-b610-4784a204557f tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 22:00:10.846554 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-be0e9fd6-d335-4e92-b610-4784a204557f tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Getting quotas for project 733e7c15666c404a9e926edbcc0768e9. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 22:00:10.851655 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.quota [None req-be0e9fd6-d335-4e92-b610-4784a204557f tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Getting quotas for user 5e90847e86e5488f9b41aac93f5929c0 and project 733e7c15666c404a9e926edbcc0768e9. Resources: {'instances', 'cores', 'ram'} {{(pid=129365) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 22:00:10.864201 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-be0e9fd6-d335-4e92-b610-4784a204557f tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Going to run 1 instances... {{(pid=129365) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 22:00:10.866579 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-be0e9fd6-d335-4e92-b610-4784a204557f tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] [instance: b7d1b866-2a91-40b1-bca1-edfc57fbe871] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129365) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 22:00:10.912704 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-be0e9fd6-d335-4e92-b610-4784a204557f tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.696637 Jan 15 22:00:10.917169 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4141/8292] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 22:00:10 2022] POST /compute/v2.1/servers => generated 405 bytes in 698 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 22:00:10.924554 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-f663e35f-f565-4ce9-989a-8b3baf8f11a3 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 22:00:10.925197 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-f663e35f-f565-4ce9-989a-8b3baf8f11a3 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] [instance: b7d1b866-2a91-40b1-bca1-edfc57fbe871] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 22:00:10.982197 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-f663e35f-f565-4ce9-989a-8b3baf8f11a3 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e90847e86e5488f9b41aac93f5929c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733e7c15666c404a9e926edbcc0768e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 22:00:10.990284 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-f663e35f-f565-4ce9-989a-8b3baf8f11a3 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] 10.222.0.46 "GET /compute/v2.1/servers/b7d1b866-2a91-40b1-bca1-edfc57fbe871" status: 200 len: 1249 microversion: 2.1 time: 0.070734 Jan 15 22:00:10.991033 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4152/8293] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 22:00:10 2022] GET /compute/v2.1/servers/b7d1b866-2a91-40b1-bca1-edfc57fbe871 => generated 1249 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 22:00:11.084169 ncdv-master-1 devstack@n-api.service[129366]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 15 22:00:11.084399 ncdv-master-1 devstack@n-api.service[129366]: Sat Jan 15 22:00:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 15 22:00:12.007351 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-537c83b0-83f2-458f-b2dd-6d07228bd6dd tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 22:00:12.008604 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-537c83b0-83f2-458f-b2dd-6d07228bd6dd tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] [instance: b7d1b866-2a91-40b1-bca1-edfc57fbe871] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 22:00:12.017227 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-537c83b0-83f2-458f-b2dd-6d07228bd6dd tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 22:00:12.017903 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-537c83b0-83f2-458f-b2dd-6d07228bd6dd tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 22:00:12.019017 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-537c83b0-83f2-458f-b2dd-6d07228bd6dd tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 22:00:12.019798 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-537c83b0-83f2-458f-b2dd-6d07228bd6dd tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 22:00:12.129403 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-537c83b0-83f2-458f-b2dd-6d07228bd6dd tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e90847e86e5488f9b41aac93f5929c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733e7c15666c404a9e926edbcc0768e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 22:00:12.137227 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-537c83b0-83f2-458f-b2dd-6d07228bd6dd tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] 10.222.0.46 "GET /compute/v2.1/servers/b7d1b866-2a91-40b1-bca1-edfc57fbe871" status: 200 len: 1301 microversion: 2.1 time: 0.133527 Jan 15 22:00:12.137821 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4142/8294] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 22:00:12 2022] GET /compute/v2.1/servers/b7d1b866-2a91-40b1-bca1-edfc57fbe871 => generated 1301 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 22:00:13.154892 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-2927eb79-f0db-4238-89a0-f940e48f91b4 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 22:00:13.155736 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-2927eb79-f0db-4238-89a0-f940e48f91b4 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] [instance: b7d1b866-2a91-40b1-bca1-edfc57fbe871] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 22:00:13.163578 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2927eb79-f0db-4238-89a0-f940e48f91b4 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 22:00:13.164100 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2927eb79-f0db-4238-89a0-f940e48f91b4 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 22:00:13.165245 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2927eb79-f0db-4238-89a0-f940e48f91b4 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 22:00:13.165536 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-2927eb79-f0db-4238-89a0-f940e48f91b4 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 22:00:13.412808 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-2927eb79-f0db-4238-89a0-f940e48f91b4 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e90847e86e5488f9b41aac93f5929c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733e7c15666c404a9e926edbcc0768e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 22:00:13.426357 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-2927eb79-f0db-4238-89a0-f940e48f91b4 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] 10.222.0.46 "GET /compute/v2.1/servers/b7d1b866-2a91-40b1-bca1-edfc57fbe871" status: 200 len: 1374 microversion: 2.1 time: 0.276096 Jan 15 22:00:13.426981 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4153/8295] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 22:00:13 2022] GET /compute/v2.1/servers/b7d1b866-2a91-40b1-bca1-edfc57fbe871 => generated 1374 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 22:00:13.662841 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-27be78fa-7737-4b57-bc8d-07ca9aed7a07 req-349de87c-be4c-4f1b-9ffe-02dd1722e2ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7d1b866-2a91-40b1-bca1-edfc57fbe871", "tag": "d5a3c225-c762-4696-bdc3-580bf9e0a28f"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 22:00:13.664482 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 22:00:13.664482 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 22:00:13.680181 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-27be78fa-7737-4b57-bc8d-07ca9aed7a07 req-349de87c-be4c-4f1b-9ffe-02dd1722e2ae service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 22:00:13.681372 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-27be78fa-7737-4b57-bc8d-07ca9aed7a07 req-349de87c-be4c-4f1b-9ffe-02dd1722e2ae service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 22:00:13.695341 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-27be78fa-7737-4b57-bc8d-07ca9aed7a07 req-349de87c-be4c-4f1b-9ffe-02dd1722e2ae service nova] Creating event network-changed:d5a3c225-c762-4696-bdc3-580bf9e0a28f for instance b7d1b866-2a91-40b1-bca1-edfc57fbe871 on nch2-master-1 Jan 15 22:00:13.701475 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-27be78fa-7737-4b57-bc8d-07ca9aed7a07 req-349de87c-be4c-4f1b-9ffe-02dd1722e2ae service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047719 Jan 15 22:00:13.702083 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4143/8296] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 22:00:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 22:00:14.444264 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-bc268d79-2ea0-4b1b-bce5-44a1b097eabc tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 22:00:14.444867 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-bc268d79-2ea0-4b1b-bce5-44a1b097eabc tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] [instance: b7d1b866-2a91-40b1-bca1-edfc57fbe871] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 22:00:14.451545 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bc268d79-2ea0-4b1b-bce5-44a1b097eabc tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 22:00:14.452000 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bc268d79-2ea0-4b1b-bce5-44a1b097eabc tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 22:00:14.452798 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bc268d79-2ea0-4b1b-bce5-44a1b097eabc tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 22:00:14.453273 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-bc268d79-2ea0-4b1b-bce5-44a1b097eabc tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 22:00:14.708083 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-bc268d79-2ea0-4b1b-bce5-44a1b097eabc tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e90847e86e5488f9b41aac93f5929c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733e7c15666c404a9e926edbcc0768e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 22:00:14.716963 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-bc268d79-2ea0-4b1b-bce5-44a1b097eabc tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] 10.222.0.46 "GET /compute/v2.1/servers/b7d1b866-2a91-40b1-bca1-edfc57fbe871" status: 200 len: 1374 microversion: 2.1 time: 0.276636 Jan 15 22:00:14.717559 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4154/8297] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 22:00:14 2022] GET /compute/v2.1/servers/b7d1b866-2a91-40b1-bca1-edfc57fbe871 => generated 1374 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 22:00:15.734731 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-02af0099-c0cf-4670-9a82-eeea674939f8 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 22:00:15.735418 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-02af0099-c0cf-4670-9a82-eeea674939f8 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] [instance: b7d1b866-2a91-40b1-bca1-edfc57fbe871] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 22:00:15.742467 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-02af0099-c0cf-4670-9a82-eeea674939f8 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 22:00:15.742926 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-02af0099-c0cf-4670-9a82-eeea674939f8 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 22:00:15.743727 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-02af0099-c0cf-4670-9a82-eeea674939f8 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 22:00:15.744166 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-02af0099-c0cf-4670-9a82-eeea674939f8 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 22:00:15.880217 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-02af0099-c0cf-4670-9a82-eeea674939f8 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e90847e86e5488f9b41aac93f5929c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733e7c15666c404a9e926edbcc0768e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 22:00:15.887705 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-02af0099-c0cf-4670-9a82-eeea674939f8 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] 10.222.0.46 "GET /compute/v2.1/servers/b7d1b866-2a91-40b1-bca1-edfc57fbe871" status: 200 len: 1374 microversion: 2.1 time: 0.157035 Jan 15 22:00:15.888279 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4144/8298] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 22:00:15 2022] GET /compute/v2.1/servers/b7d1b866-2a91-40b1-bca1-edfc57fbe871 => generated 1374 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 22:00:16.905154 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-6f5ea7bd-163a-4e10-97d3-4234194cf653 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 22:00:16.906022 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-6f5ea7bd-163a-4e10-97d3-4234194cf653 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] [instance: b7d1b866-2a91-40b1-bca1-edfc57fbe871] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 22:00:16.912811 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6f5ea7bd-163a-4e10-97d3-4234194cf653 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 22:00:16.913294 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6f5ea7bd-163a-4e10-97d3-4234194cf653 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 22:00:16.914080 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6f5ea7bd-163a-4e10-97d3-4234194cf653 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 22:00:16.914517 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-6f5ea7bd-163a-4e10-97d3-4234194cf653 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 22:00:17.051603 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-6f5ea7bd-163a-4e10-97d3-4234194cf653 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e90847e86e5488f9b41aac93f5929c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733e7c15666c404a9e926edbcc0768e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 22:00:17.059047 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-6f5ea7bd-163a-4e10-97d3-4234194cf653 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] 10.222.0.46 "GET /compute/v2.1/servers/b7d1b866-2a91-40b1-bca1-edfc57fbe871" status: 200 len: 1374 microversion: 2.1 time: 0.157670 Jan 15 22:00:17.059629 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4155/8299] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 22:00:16 2022] GET /compute/v2.1/servers/b7d1b866-2a91-40b1-bca1-edfc57fbe871 => generated 1374 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 22:00:18.076873 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-9921b778-a094-4c5f-bd36-f8096735d4d9 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 22:00:18.077349 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-9921b778-a094-4c5f-bd36-f8096735d4d9 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] [instance: b7d1b866-2a91-40b1-bca1-edfc57fbe871] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 22:00:18.085474 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9921b778-a094-4c5f-bd36-f8096735d4d9 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 22:00:18.085940 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9921b778-a094-4c5f-bd36-f8096735d4d9 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 22:00:18.086742 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9921b778-a094-4c5f-bd36-f8096735d4d9 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 22:00:18.087222 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-9921b778-a094-4c5f-bd36-f8096735d4d9 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 22:00:18.223006 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-9921b778-a094-4c5f-bd36-f8096735d4d9 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e90847e86e5488f9b41aac93f5929c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733e7c15666c404a9e926edbcc0768e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 22:00:18.230256 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-9921b778-a094-4c5f-bd36-f8096735d4d9 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] 10.222.0.46 "GET /compute/v2.1/servers/b7d1b866-2a91-40b1-bca1-edfc57fbe871" status: 200 len: 1374 microversion: 2.1 time: 0.157495 Jan 15 22:00:18.230842 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4145/8300] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 22:00:18 2022] GET /compute/v2.1/servers/b7d1b866-2a91-40b1-bca1-edfc57fbe871 => generated 1374 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 22:00:19.246289 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-36b13c28-736c-4db3-98f5-88b7e0a0f6ba tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 22:00:19.246962 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-36b13c28-736c-4db3-98f5-88b7e0a0f6ba tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] [instance: b7d1b866-2a91-40b1-bca1-edfc57fbe871] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 22:00:19.254575 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-36b13c28-736c-4db3-98f5-88b7e0a0f6ba tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 22:00:19.255690 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-36b13c28-736c-4db3-98f5-88b7e0a0f6ba tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 22:00:19.256517 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-36b13c28-736c-4db3-98f5-88b7e0a0f6ba tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 22:00:19.257028 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-36b13c28-736c-4db3-98f5-88b7e0a0f6ba tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 22:00:19.281005 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-f14b42ce-5cfa-4655-91fb-2fc5056f768b req-5cddfd74-1166-4325-a008-98f8fab30e49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7d1b866-2a91-40b1-bca1-edfc57fbe871", "name": "network-vif-plugged", "status": "completed", "tag": "d5a3c225-c762-4696-bdc3-580bf9e0a28f"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 22:00:19.284234 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 22:00:19.284234 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 22:00:19.295814 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-f14b42ce-5cfa-4655-91fb-2fc5056f768b req-5cddfd74-1166-4325-a008-98f8fab30e49 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 22:00:19.296764 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-f14b42ce-5cfa-4655-91fb-2fc5056f768b req-5cddfd74-1166-4325-a008-98f8fab30e49 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 22:00:19.309308 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-f14b42ce-5cfa-4655-91fb-2fc5056f768b req-5cddfd74-1166-4325-a008-98f8fab30e49 service nova] Creating event network-vif-plugged:d5a3c225-c762-4696-bdc3-580bf9e0a28f for instance b7d1b866-2a91-40b1-bca1-edfc57fbe871 on nch2-master-1 Jan 15 22:00:19.314775 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-f14b42ce-5cfa-4655-91fb-2fc5056f768b req-5cddfd74-1166-4325-a008-98f8fab30e49 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097560 Jan 15 22:00:19.315372 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4156/8301] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 22:00:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 15 22:00:19.404506 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-36b13c28-736c-4db3-98f5-88b7e0a0f6ba tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e90847e86e5488f9b41aac93f5929c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733e7c15666c404a9e926edbcc0768e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 22:00:19.413071 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-36b13c28-736c-4db3-98f5-88b7e0a0f6ba tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] 10.222.0.46 "GET /compute/v2.1/servers/b7d1b866-2a91-40b1-bca1-edfc57fbe871" status: 200 len: 1374 microversion: 2.1 time: 0.170656 Jan 15 22:00:19.413857 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4146/8302] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 22:00:19 2022] GET /compute/v2.1/servers/b7d1b866-2a91-40b1-bca1-edfc57fbe871 => generated 1374 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 15 22:00:20.431904 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-3912cd8f-bc36-432b-ba0d-00f7c9462f15 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 22:00:20.432607 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-3912cd8f-bc36-432b-ba0d-00f7c9462f15 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] [instance: b7d1b866-2a91-40b1-bca1-edfc57fbe871] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 22:00:20.438809 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3912cd8f-bc36-432b-ba0d-00f7c9462f15 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 22:00:20.439278 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3912cd8f-bc36-432b-ba0d-00f7c9462f15 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 22:00:20.440076 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3912cd8f-bc36-432b-ba0d-00f7c9462f15 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 22:00:20.440514 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-3912cd8f-bc36-432b-ba0d-00f7c9462f15 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 22:00:20.581333 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-3912cd8f-bc36-432b-ba0d-00f7c9462f15 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e90847e86e5488f9b41aac93f5929c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733e7c15666c404a9e926edbcc0768e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 22:00:20.588772 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-3912cd8f-bc36-432b-ba0d-00f7c9462f15 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] 10.222.0.46 "GET /compute/v2.1/servers/b7d1b866-2a91-40b1-bca1-edfc57fbe871" status: 200 len: 1374 microversion: 2.1 time: 0.161829 Jan 15 22:00:20.589419 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4157/8303] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 22:00:20 2022] GET /compute/v2.1/servers/b7d1b866-2a91-40b1-bca1-edfc57fbe871 => generated 1374 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 22:00:21.606209 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-41e15c99-18f7-4018-a2bf-e7047ff315d4 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 22:00:21.606835 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-41e15c99-18f7-4018-a2bf-e7047ff315d4 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] [instance: b7d1b866-2a91-40b1-bca1-edfc57fbe871] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 22:00:21.613751 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-41e15c99-18f7-4018-a2bf-e7047ff315d4 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 22:00:21.614223 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-41e15c99-18f7-4018-a2bf-e7047ff315d4 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 22:00:21.615024 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-41e15c99-18f7-4018-a2bf-e7047ff315d4 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 22:00:21.615480 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-41e15c99-18f7-4018-a2bf-e7047ff315d4 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 22:00:21.748294 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-41e15c99-18f7-4018-a2bf-e7047ff315d4 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e90847e86e5488f9b41aac93f5929c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733e7c15666c404a9e926edbcc0768e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 22:00:21.756718 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-41e15c99-18f7-4018-a2bf-e7047ff315d4 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] 10.222.0.46 "GET /compute/v2.1/servers/b7d1b866-2a91-40b1-bca1-edfc57fbe871" status: 200 len: 1558 microversion: 2.1 time: 0.154245 Jan 15 22:00:21.757586 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4147/8304] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 22:00:21 2022] GET /compute/v2.1/servers/b7d1b866-2a91-40b1-bca1-edfc57fbe871 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 22:00:21.773625 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e6310b47-7c8a-4cc6-a515-5108a19d515f tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 22:00:21.774239 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e6310b47-7c8a-4cc6-a515-5108a19d515f tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] [instance: b7d1b866-2a91-40b1-bca1-edfc57fbe871] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 22:00:21.781279 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e6310b47-7c8a-4cc6-a515-5108a19d515f tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 22:00:21.781756 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e6310b47-7c8a-4cc6-a515-5108a19d515f tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 22:00:21.783073 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e6310b47-7c8a-4cc6-a515-5108a19d515f tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 22:00:21.783262 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e6310b47-7c8a-4cc6-a515-5108a19d515f tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 22:00:21.915038 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-e6310b47-7c8a-4cc6-a515-5108a19d515f tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e90847e86e5488f9b41aac93f5929c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733e7c15666c404a9e926edbcc0768e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 22:00:21.922349 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e6310b47-7c8a-4cc6-a515-5108a19d515f tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] 10.222.0.46 "GET /compute/v2.1/servers/b7d1b866-2a91-40b1-bca1-edfc57fbe871" status: 200 len: 1558 microversion: 2.1 time: 0.152412 Jan 15 22:00:21.922944 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4158/8305] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 22:00:21 2022] GET /compute/v2.1/servers/b7d1b866-2a91-40b1-bca1-edfc57fbe871 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 22:00:23.888403 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-98fa5d68-6692-4431-8532-b7dfde4379bc req-210fe2fa-4275-4b29-991e-a3de493859a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7d1b866-2a91-40b1-bca1-edfc57fbe871", "tag": "d5a3c225-c762-4696-bdc3-580bf9e0a28f"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 22:00:23.888403 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 22:00:23.888403 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 22:00:23.896040 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-98fa5d68-6692-4431-8532-b7dfde4379bc req-210fe2fa-4275-4b29-991e-a3de493859a5 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 22:00:23.897248 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-98fa5d68-6692-4431-8532-b7dfde4379bc req-210fe2fa-4275-4b29-991e-a3de493859a5 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 22:00:23.910234 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-98fa5d68-6692-4431-8532-b7dfde4379bc req-210fe2fa-4275-4b29-991e-a3de493859a5 service nova] Creating event network-changed:d5a3c225-c762-4696-bdc3-580bf9e0a28f for instance b7d1b866-2a91-40b1-bca1-edfc57fbe871 on nch2-master-1 Jan 15 22:00:23.915334 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-98fa5d68-6692-4431-8532-b7dfde4379bc req-210fe2fa-4275-4b29-991e-a3de493859a5 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034088 Jan 15 22:00:23.916018 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4148/8306] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 22:00:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 22:02:21.304469 ncdv-master-1 devstack@n-api.service[129366]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f3ab03e4-0e3e-4ca8-9e53-9b880d1e14ab] AMQP server on 10.222.0.46:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jan 15 22:02:21.305431 ncdv-master-1 devstack@n-api.service[129366]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4346cd47-e793-4d94-9b2f-ad282883a042] AMQP server on 10.222.0.46:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jan 15 22:02:21.309189 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-dc94ee2b-5b8f-4f14-8044-5afaaa8d4b24 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-910008646"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 22:02:21.310192 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-dc94ee2b-5b8f-4f14-8044-5afaaa8d4b24 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] [instance: b7d1b866-2a91-40b1-bca1-edfc57fbe871] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 22:02:21.316269 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dc94ee2b-5b8f-4f14-8044-5afaaa8d4b24 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 22:02:21.316729 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dc94ee2b-5b8f-4f14-8044-5afaaa8d4b24 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 22:02:21.317546 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dc94ee2b-5b8f-4f14-8044-5afaaa8d4b24 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 22:02:21.317987 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-dc94ee2b-5b8f-4f14-8044-5afaaa8d4b24 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 22:02:21.582576 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-dc94ee2b-5b8f-4f14-8044-5afaaa8d4b24 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] 10.222.0.46 "POST /compute/v2.1/servers/b7d1b866-2a91-40b1-bca1-edfc57fbe871/action" status: 202 len: 0 microversion: 2.1 time: 0.279730 Jan 15 22:02:21.583109 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4159/8307] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 22:02:21 2022] POST /compute/v2.1/servers/b7d1b866-2a91-40b1-bca1-edfc57fbe871/action => generated 0 bytes in 281 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jan 15 22:02:25.894829 ncdv-master-1 devstack@n-api.service[129365]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b9368858-1d3b-40ae-ba09-78025e088160] AMQP server on 10.222.0.46:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 15 22:02:25.895647 ncdv-master-1 devstack@n-api.service[129365]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4ccfdfad-4291-4179-af77-e203370d1c4c] AMQP server on 10.222.0.46:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 15 22:02:25.899750 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-37b73ceb-d4d7-4980-980d-5c01ccbaba2a req-6e3b27d6-8a38-4602-b33d-bb66929352e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7d1b866-2a91-40b1-bca1-edfc57fbe871", "name": "network-vif-plugged", "status": "completed", "tag": "d5a3c225-c762-4696-bdc3-580bf9e0a28f"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 22:02:25.901441 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 22:02:25.901441 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 22:02:25.909236 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-37b73ceb-d4d7-4980-980d-5c01ccbaba2a req-6e3b27d6-8a38-4602-b33d-bb66929352e9 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 22:02:25.909814 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-37b73ceb-d4d7-4980-980d-5c01ccbaba2a req-6e3b27d6-8a38-4602-b33d-bb66929352e9 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 22:02:25.922765 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-37b73ceb-d4d7-4980-980d-5c01ccbaba2a req-6e3b27d6-8a38-4602-b33d-bb66929352e9 service nova] Creating event network-vif-plugged:d5a3c225-c762-4696-bdc3-580bf9e0a28f for instance b7d1b866-2a91-40b1-bca1-edfc57fbe871 on nch2-master-1 Jan 15 22:02:25.927871 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-37b73ceb-d4d7-4980-980d-5c01ccbaba2a req-6e3b27d6-8a38-4602-b33d-bb66929352e9 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034814 Jan 15 22:02:25.928647 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4149/8308] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 22:02:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 22:02:35.188308 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-d727b16d-eb20-4820-b018-4ec78b86f96c tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-363637952", "imageRef": "11fe0be3-6339-41f0-bbe3-7d8cd2742f0a", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1045805389", "security_groups": [{"name": "tempest-secgroup-smoke-873007183"}], "networks": [{"uuid": "c73c4a14-0781-4393-aa1e-9fcd878de814"}]}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 22:02:35.204555 ncdv-master-1 devstack@n-api.service[129366]: INFO oslo.messaging._drivers.impl_rabbit [-] [4346cd47-e793-4d94-9b2f-ad282883a042] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 42984. Jan 15 22:02:35.212604 ncdv-master-1 devstack@n-api.service[129366]: INFO oslo.messaging._drivers.impl_rabbit [-] [f3ab03e4-0e3e-4ca8-9e53-9b880d1e14ab] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 42982. Jan 15 22:02:35.303199 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.network.neutron [None req-d727b16d-eb20-4820-b018-4ec78b86f96c tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] validate_networks() for [('c73c4a14-0781-4393-aa1e-9fcd878de814', None, None, None, None, None)] {{(pid=129366) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 15 22:02:35.732561 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-d727b16d-eb20-4820-b018-4ec78b86f96c tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Flavor limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 15 22:02:35.733022 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-d727b16d-eb20-4820-b018-4ec78b86f96c tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Image limits 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 15 22:02:35.733496 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-d727b16d-eb20-4820-b018-4ec78b86f96c tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Flavor pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 15 22:02:35.733907 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-d727b16d-eb20-4820-b018-4ec78b86f96c tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Image pref 0:0:0 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 15 22:02:35.734370 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.virt.hardware [None req-d727b16d-eb20-4820-b018-4ec78b86f96c tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 15 22:02:35.743095 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d727b16d-eb20-4820-b018-4ec78b86f96c tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 22:02:35.743542 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d727b16d-eb20-4820-b018-4ec78b86f96c tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 22:02:35.744356 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d727b16d-eb20-4820-b018-4ec78b86f96c tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 22:02:35.744789 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-d727b16d-eb20-4820-b018-4ec78b86f96c tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 22:02:35.760953 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-d727b16d-eb20-4820-b018-4ec78b86f96c tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Getting quotas for project 733e7c15666c404a9e926edbcc0768e9. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 15 22:02:35.766530 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.quota [None req-d727b16d-eb20-4820-b018-4ec78b86f96c tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Getting quotas for user 5e90847e86e5488f9b41aac93f5929c0 and project 733e7c15666c404a9e926edbcc0768e9. Resources: {'instances', 'cores', 'ram'} {{(pid=129366) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 15 22:02:35.778432 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-d727b16d-eb20-4820-b018-4ec78b86f96c tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Going to run 1 instances... {{(pid=129366) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 15 22:02:35.781901 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-d727b16d-eb20-4820-b018-4ec78b86f96c tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] [instance: 7f7145a1-8969-4677-a0e8-1ede6d95c025] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='11fe0be3-6339-41f0-bbe3-7d8cd2742f0a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 15 22:02:35.827544 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-d727b16d-eb20-4820-b018-4ec78b86f96c tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.647000 Jan 15 22:02:35.828187 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4160/8309] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jan 15 22:02:35 2022] POST /compute/v2.1/servers => generated 405 bytes in 648 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 15 22:02:35.840299 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-d5f4e76b-406d-47f5-a07e-48f6cf0376fb tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 22:02:35.841037 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-d5f4e76b-406d-47f5-a07e-48f6cf0376fb tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] [instance: 7f7145a1-8969-4677-a0e8-1ede6d95c025] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 22:02:35.854114 ncdv-master-1 devstack@n-api.service[129365]: INFO oslo.messaging._drivers.impl_rabbit [-] [b9368858-1d3b-40ae-ba09-78025e088160] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 42998. Jan 15 22:02:35.854874 ncdv-master-1 devstack@n-api.service[129365]: INFO oslo.messaging._drivers.impl_rabbit [-] [4ccfdfad-4291-4179-af77-e203370d1c4c] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 43000. Jan 15 22:02:35.906454 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-d5f4e76b-406d-47f5-a07e-48f6cf0376fb tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e90847e86e5488f9b41aac93f5929c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733e7c15666c404a9e926edbcc0768e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 22:02:35.913475 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-d5f4e76b-406d-47f5-a07e-48f6cf0376fb tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] 10.222.0.46 "GET /compute/v2.1/servers/7f7145a1-8969-4677-a0e8-1ede6d95c025" status: 200 len: 1248 microversion: 2.1 time: 0.079082 Jan 15 22:02:35.914046 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4150/8310] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 22:02:35 2022] GET /compute/v2.1/servers/7f7145a1-8969-4677-a0e8-1ede6d95c025 => generated 1248 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 22:02:36.930882 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-b7920c39-4775-4c06-9eb5-8bba3d536601 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 22:02:36.931487 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-b7920c39-4775-4c06-9eb5-8bba3d536601 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] [instance: 7f7145a1-8969-4677-a0e8-1ede6d95c025] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 22:02:36.938957 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b7920c39-4775-4c06-9eb5-8bba3d536601 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 22:02:36.939412 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b7920c39-4775-4c06-9eb5-8bba3d536601 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 22:02:36.940210 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b7920c39-4775-4c06-9eb5-8bba3d536601 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 22:02:36.940646 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-b7920c39-4775-4c06-9eb5-8bba3d536601 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 22:02:37.005790 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-b7920c39-4775-4c06-9eb5-8bba3d536601 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e90847e86e5488f9b41aac93f5929c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733e7c15666c404a9e926edbcc0768e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 22:02:37.015297 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-b7920c39-4775-4c06-9eb5-8bba3d536601 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] 10.222.0.46 "GET /compute/v2.1/servers/7f7145a1-8969-4677-a0e8-1ede6d95c025" status: 200 len: 1306 microversion: 2.1 time: 0.088802 Jan 15 22:02:37.024768 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4161/8311] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 22:02:36 2022] GET /compute/v2.1/servers/7f7145a1-8969-4677-a0e8-1ede6d95c025 => generated 1306 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 22:02:37.973489 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-a59733b1-8c05-4bd4-8c55-e75ff71ee469 req-5d5f9841-fe0f-40ae-9bec-6461ccb4809f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7d1b866-2a91-40b1-bca1-edfc57fbe871", "name": "network-vif-unplugged", "status": "completed", "tag": "d5a3c225-c762-4696-bdc3-580bf9e0a28f"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 22:02:37.975154 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 22:02:37.975154 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 22:02:37.984038 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-a59733b1-8c05-4bd4-8c55-e75ff71ee469 req-5d5f9841-fe0f-40ae-9bec-6461ccb4809f service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 22:02:37.984505 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-a59733b1-8c05-4bd4-8c55-e75ff71ee469 req-5d5f9841-fe0f-40ae-9bec-6461ccb4809f service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 22:02:38.000650 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-a59733b1-8c05-4bd4-8c55-e75ff71ee469 req-5d5f9841-fe0f-40ae-9bec-6461ccb4809f service nova] Creating event network-vif-unplugged:d5a3c225-c762-4696-bdc3-580bf9e0a28f for instance b7d1b866-2a91-40b1-bca1-edfc57fbe871 on nch2-master-1 Jan 15 22:02:38.006170 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-a59733b1-8c05-4bd4-8c55-e75ff71ee469 req-5d5f9841-fe0f-40ae-9bec-6461ccb4809f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036353 Jan 15 22:02:38.006786 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4151/8312] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 22:02:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 22:02:38.034703 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-61b2c614-201c-4773-aa75-8fa1e9723494 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 22:02:38.035675 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-61b2c614-201c-4773-aa75-8fa1e9723494 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] [instance: 7f7145a1-8969-4677-a0e8-1ede6d95c025] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 22:02:38.050039 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-61b2c614-201c-4773-aa75-8fa1e9723494 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 22:02:38.050619 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-61b2c614-201c-4773-aa75-8fa1e9723494 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 22:02:38.051377 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-61b2c614-201c-4773-aa75-8fa1e9723494 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 22:02:38.051953 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-61b2c614-201c-4773-aa75-8fa1e9723494 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 22:02:38.212719 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-61b2c614-201c-4773-aa75-8fa1e9723494 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e90847e86e5488f9b41aac93f5929c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733e7c15666c404a9e926edbcc0768e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 22:02:38.221078 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-61b2c614-201c-4773-aa75-8fa1e9723494 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] 10.222.0.46 "GET /compute/v2.1/servers/7f7145a1-8969-4677-a0e8-1ede6d95c025" status: 200 len: 1373 microversion: 2.1 time: 0.192439 Jan 15 22:02:38.221849 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4162/8313] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 22:02:38 2022] GET /compute/v2.1/servers/7f7145a1-8969-4677-a0e8-1ede6d95c025 => generated 1373 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 22:02:39.240637 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5259c58d-5f9a-4694-8204-ddd4a7d2cfb7 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 22:02:39.241372 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-5259c58d-5f9a-4694-8204-ddd4a7d2cfb7 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] [instance: 7f7145a1-8969-4677-a0e8-1ede6d95c025] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 22:02:39.250251 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5259c58d-5f9a-4694-8204-ddd4a7d2cfb7 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 22:02:39.251082 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5259c58d-5f9a-4694-8204-ddd4a7d2cfb7 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 22:02:39.252120 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5259c58d-5f9a-4694-8204-ddd4a7d2cfb7 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 22:02:39.252809 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5259c58d-5f9a-4694-8204-ddd4a7d2cfb7 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 22:02:39.427324 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-5259c58d-5f9a-4694-8204-ddd4a7d2cfb7 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e90847e86e5488f9b41aac93f5929c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733e7c15666c404a9e926edbcc0768e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 22:02:39.437992 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5259c58d-5f9a-4694-8204-ddd4a7d2cfb7 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] 10.222.0.46 "GET /compute/v2.1/servers/7f7145a1-8969-4677-a0e8-1ede6d95c025" status: 200 len: 1373 microversion: 2.1 time: 0.202083 Jan 15 22:02:39.438828 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4152/8314] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 22:02:39 2022] GET /compute/v2.1/servers/7f7145a1-8969-4677-a0e8-1ede6d95c025 => generated 1373 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 22:02:40.456883 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-ead3a3d8-5c54-40f6-85f0-371236c722ac tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 22:02:40.457682 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-ead3a3d8-5c54-40f6-85f0-371236c722ac tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] [instance: 7f7145a1-8969-4677-a0e8-1ede6d95c025] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 22:02:40.476573 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ead3a3d8-5c54-40f6-85f0-371236c722ac tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 22:02:40.479036 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ead3a3d8-5c54-40f6-85f0-371236c722ac tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 22:02:40.479963 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ead3a3d8-5c54-40f6-85f0-371236c722ac tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 22:02:40.480419 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-ead3a3d8-5c54-40f6-85f0-371236c722ac tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 22:02:40.640005 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-ead3a3d8-5c54-40f6-85f0-371236c722ac tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e90847e86e5488f9b41aac93f5929c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733e7c15666c404a9e926edbcc0768e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 22:02:40.647467 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-ead3a3d8-5c54-40f6-85f0-371236c722ac tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] 10.222.0.46 "GET /compute/v2.1/servers/7f7145a1-8969-4677-a0e8-1ede6d95c025" status: 200 len: 1373 microversion: 2.1 time: 0.195304 Jan 15 22:02:40.648039 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4163/8315] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 22:02:40 2022] GET /compute/v2.1/servers/7f7145a1-8969-4677-a0e8-1ede6d95c025 => generated 1373 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 22:02:41.665522 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-e648ed2a-64a6-4cf1-a103-497f70b10996 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 22:02:41.666164 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-e648ed2a-64a6-4cf1-a103-497f70b10996 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] [instance: 7f7145a1-8969-4677-a0e8-1ede6d95c025] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 22:02:41.673355 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e648ed2a-64a6-4cf1-a103-497f70b10996 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 22:02:41.673804 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e648ed2a-64a6-4cf1-a103-497f70b10996 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 22:02:41.674615 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e648ed2a-64a6-4cf1-a103-497f70b10996 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 22:02:41.675060 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-e648ed2a-64a6-4cf1-a103-497f70b10996 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 22:02:41.847027 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-e648ed2a-64a6-4cf1-a103-497f70b10996 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e90847e86e5488f9b41aac93f5929c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733e7c15666c404a9e926edbcc0768e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 22:02:41.867408 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-e648ed2a-64a6-4cf1-a103-497f70b10996 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] 10.222.0.46 "GET /compute/v2.1/servers/7f7145a1-8969-4677-a0e8-1ede6d95c025" status: 200 len: 1373 microversion: 2.1 time: 0.205426 Jan 15 22:02:41.868066 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4153/8316] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 22:02:41 2022] GET /compute/v2.1/servers/7f7145a1-8969-4677-a0e8-1ede6d95c025 => generated 1373 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 22:02:42.885079 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8221fcbc-a3ca-429f-92db-0dd6115578f6 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 22:02:42.886711 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-8221fcbc-a3ca-429f-92db-0dd6115578f6 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] [instance: 7f7145a1-8969-4677-a0e8-1ede6d95c025] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 22:02:42.894862 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8221fcbc-a3ca-429f-92db-0dd6115578f6 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 22:02:42.895435 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8221fcbc-a3ca-429f-92db-0dd6115578f6 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 22:02:42.896445 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8221fcbc-a3ca-429f-92db-0dd6115578f6 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 22:02:42.897003 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8221fcbc-a3ca-429f-92db-0dd6115578f6 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 22:02:43.052080 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-8221fcbc-a3ca-429f-92db-0dd6115578f6 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e90847e86e5488f9b41aac93f5929c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733e7c15666c404a9e926edbcc0768e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 22:02:43.060248 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-8221fcbc-a3ca-429f-92db-0dd6115578f6 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] 10.222.0.46 "GET /compute/v2.1/servers/7f7145a1-8969-4677-a0e8-1ede6d95c025" status: 200 len: 1373 microversion: 2.1 time: 0.180266 Jan 15 22:02:43.066020 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4164/8317] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 22:02:42 2022] GET /compute/v2.1/servers/7f7145a1-8969-4677-a0e8-1ede6d95c025 => generated 1373 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 22:02:44.079272 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a52c57b9-eef9-45a5-ac50-38ed23757d08 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 22:02:44.079919 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a52c57b9-eef9-45a5-ac50-38ed23757d08 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] [instance: 7f7145a1-8969-4677-a0e8-1ede6d95c025] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 22:02:44.089352 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a52c57b9-eef9-45a5-ac50-38ed23757d08 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 22:02:44.089821 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a52c57b9-eef9-45a5-ac50-38ed23757d08 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 22:02:44.090639 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a52c57b9-eef9-45a5-ac50-38ed23757d08 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 22:02:44.091091 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a52c57b9-eef9-45a5-ac50-38ed23757d08 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 22:02:44.259150 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-a52c57b9-eef9-45a5-ac50-38ed23757d08 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e90847e86e5488f9b41aac93f5929c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733e7c15666c404a9e926edbcc0768e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 22:02:44.269332 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a52c57b9-eef9-45a5-ac50-38ed23757d08 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] 10.222.0.46 "GET /compute/v2.1/servers/7f7145a1-8969-4677-a0e8-1ede6d95c025" status: 200 len: 1373 microversion: 2.1 time: 0.194653 Jan 15 22:02:44.270547 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4154/8318] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 22:02:44 2022] GET /compute/v2.1/servers/7f7145a1-8969-4677-a0e8-1ede6d95c025 => generated 1373 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 22:02:45.286704 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-8b256792-f218-438f-9925-e697b9c2d2fa tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 22:02:45.287334 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-8b256792-f218-438f-9925-e697b9c2d2fa tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] [instance: 7f7145a1-8969-4677-a0e8-1ede6d95c025] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 22:02:45.294277 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8b256792-f218-438f-9925-e697b9c2d2fa tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 22:02:45.294779 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8b256792-f218-438f-9925-e697b9c2d2fa tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 22:02:45.295773 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8b256792-f218-438f-9925-e697b9c2d2fa tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 22:02:45.296506 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-8b256792-f218-438f-9925-e697b9c2d2fa tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 22:02:45.446001 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-8b256792-f218-438f-9925-e697b9c2d2fa tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e90847e86e5488f9b41aac93f5929c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733e7c15666c404a9e926edbcc0768e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 22:02:45.454154 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-8b256792-f218-438f-9925-e697b9c2d2fa tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] 10.222.0.46 "GET /compute/v2.1/servers/7f7145a1-8969-4677-a0e8-1ede6d95c025" status: 200 len: 1373 microversion: 2.1 time: 0.171127 Jan 15 22:02:45.454742 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4165/8319] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 22:02:45 2022] GET /compute/v2.1/servers/7f7145a1-8969-4677-a0e8-1ede6d95c025 => generated 1373 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 22:02:45.804635 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-45b7d2e9-736d-449c-a39d-a4ff0781ce9e req-e3879530-d281-44c6-81fa-09f6064af756 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f7145a1-8969-4677-a0e8-1ede6d95c025", "tag": "0594f748-baf0-4dce-9a55-6ce6d7877e24"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 22:02:45.807286 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 22:02:45.807286 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 22:02:45.822873 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-45b7d2e9-736d-449c-a39d-a4ff0781ce9e req-e3879530-d281-44c6-81fa-09f6064af756 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 22:02:45.823334 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-45b7d2e9-736d-449c-a39d-a4ff0781ce9e req-e3879530-d281-44c6-81fa-09f6064af756 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 22:02:45.836531 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-45b7d2e9-736d-449c-a39d-a4ff0781ce9e req-e3879530-d281-44c6-81fa-09f6064af756 service nova] Creating event network-changed:0594f748-baf0-4dce-9a55-6ce6d7877e24 for instance 7f7145a1-8969-4677-a0e8-1ede6d95c025 on nch1-master-1 Jan 15 22:02:45.844263 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-45b7d2e9-736d-449c-a39d-a4ff0781ce9e req-e3879530-d281-44c6-81fa-09f6064af756 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043586 Jan 15 22:02:45.845201 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4155/8320] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 22:02:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 22:02:46.471175 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-c9e2c1e5-b94c-4fa6-a510-80efaa7b0661 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 22:02:46.471782 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-c9e2c1e5-b94c-4fa6-a510-80efaa7b0661 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] [instance: 7f7145a1-8969-4677-a0e8-1ede6d95c025] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 22:02:46.478447 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c9e2c1e5-b94c-4fa6-a510-80efaa7b0661 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 22:02:46.478893 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c9e2c1e5-b94c-4fa6-a510-80efaa7b0661 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 22:02:46.479695 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c9e2c1e5-b94c-4fa6-a510-80efaa7b0661 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 22:02:46.480128 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-c9e2c1e5-b94c-4fa6-a510-80efaa7b0661 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 22:02:46.613745 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-c9e2c1e5-b94c-4fa6-a510-80efaa7b0661 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e90847e86e5488f9b41aac93f5929c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733e7c15666c404a9e926edbcc0768e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 22:02:46.621123 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-c9e2c1e5-b94c-4fa6-a510-80efaa7b0661 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] 10.222.0.46 "GET /compute/v2.1/servers/7f7145a1-8969-4677-a0e8-1ede6d95c025" status: 200 len: 1373 microversion: 2.1 time: 0.153601 Jan 15 22:02:46.621698 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4166/8321] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 22:02:46 2022] GET /compute/v2.1/servers/7f7145a1-8969-4677-a0e8-1ede6d95c025 => generated 1373 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 22:02:47.640286 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-88a165d5-3277-4d14-a3ea-3eeccce6c8dd tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 22:02:47.640928 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-88a165d5-3277-4d14-a3ea-3eeccce6c8dd tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] [instance: 7f7145a1-8969-4677-a0e8-1ede6d95c025] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 22:02:47.647194 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-88a165d5-3277-4d14-a3ea-3eeccce6c8dd tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 22:02:47.647653 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-88a165d5-3277-4d14-a3ea-3eeccce6c8dd tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 22:02:47.648444 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-88a165d5-3277-4d14-a3ea-3eeccce6c8dd tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 22:02:47.648914 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-88a165d5-3277-4d14-a3ea-3eeccce6c8dd tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 22:02:47.785597 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-88a165d5-3277-4d14-a3ea-3eeccce6c8dd tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e90847e86e5488f9b41aac93f5929c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733e7c15666c404a9e926edbcc0768e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 22:02:47.792910 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-88a165d5-3277-4d14-a3ea-3eeccce6c8dd tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] 10.222.0.46 "GET /compute/v2.1/servers/7f7145a1-8969-4677-a0e8-1ede6d95c025" status: 200 len: 1373 microversion: 2.1 time: 0.158165 Jan 15 22:02:47.793479 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4156/8322] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 22:02:47 2022] GET /compute/v2.1/servers/7f7145a1-8969-4677-a0e8-1ede6d95c025 => generated 1373 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 22:02:48.809159 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-da5fe8aa-3d3e-4ccc-a319-c5c8bae220f6 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 22:02:48.809768 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-da5fe8aa-3d3e-4ccc-a319-c5c8bae220f6 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] [instance: 7f7145a1-8969-4677-a0e8-1ede6d95c025] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 22:02:48.816551 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-da5fe8aa-3d3e-4ccc-a319-c5c8bae220f6 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 22:02:48.817038 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-da5fe8aa-3d3e-4ccc-a319-c5c8bae220f6 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 22:02:48.817807 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-da5fe8aa-3d3e-4ccc-a319-c5c8bae220f6 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 22:02:48.818243 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-da5fe8aa-3d3e-4ccc-a319-c5c8bae220f6 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 22:02:48.949628 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-da5fe8aa-3d3e-4ccc-a319-c5c8bae220f6 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e90847e86e5488f9b41aac93f5929c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733e7c15666c404a9e926edbcc0768e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 22:02:48.957895 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-da5fe8aa-3d3e-4ccc-a319-c5c8bae220f6 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] 10.222.0.46 "GET /compute/v2.1/servers/7f7145a1-8969-4677-a0e8-1ede6d95c025" status: 200 len: 1373 microversion: 2.1 time: 0.152359 Jan 15 22:02:48.958473 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4167/8323] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 22:02:48 2022] GET /compute/v2.1/servers/7f7145a1-8969-4677-a0e8-1ede6d95c025 => generated 1373 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 22:02:49.974665 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-5c257503-2fd9-4585-a24f-4f29bdda182e tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 22:02:49.975315 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-5c257503-2fd9-4585-a24f-4f29bdda182e tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] [instance: 7f7145a1-8969-4677-a0e8-1ede6d95c025] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 22:02:49.982066 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5c257503-2fd9-4585-a24f-4f29bdda182e tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 22:02:49.982527 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5c257503-2fd9-4585-a24f-4f29bdda182e tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 22:02:49.983316 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5c257503-2fd9-4585-a24f-4f29bdda182e tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 22:02:49.983769 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-5c257503-2fd9-4585-a24f-4f29bdda182e tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 22:02:50.117499 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-5c257503-2fd9-4585-a24f-4f29bdda182e tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e90847e86e5488f9b41aac93f5929c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733e7c15666c404a9e926edbcc0768e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 22:02:50.125532 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-5c257503-2fd9-4585-a24f-4f29bdda182e tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] 10.222.0.46 "GET /compute/v2.1/servers/7f7145a1-8969-4677-a0e8-1ede6d95c025" status: 200 len: 1373 microversion: 2.1 time: 0.154552 Jan 15 22:02:50.126117 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4157/8324] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 22:02:49 2022] GET /compute/v2.1/servers/7f7145a1-8969-4677-a0e8-1ede6d95c025 => generated 1373 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 22:02:51.142818 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-200400f1-6a9a-48e2-b9b4-a2083feec4a0 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 22:02:51.143739 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-200400f1-6a9a-48e2-b9b4-a2083feec4a0 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] [instance: 7f7145a1-8969-4677-a0e8-1ede6d95c025] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 22:02:51.150808 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-200400f1-6a9a-48e2-b9b4-a2083feec4a0 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 22:02:51.151254 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-200400f1-6a9a-48e2-b9b4-a2083feec4a0 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 22:02:51.152059 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-200400f1-6a9a-48e2-b9b4-a2083feec4a0 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 22:02:51.152493 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-200400f1-6a9a-48e2-b9b4-a2083feec4a0 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 22:02:51.288659 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-200400f1-6a9a-48e2-b9b4-a2083feec4a0 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e90847e86e5488f9b41aac93f5929c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733e7c15666c404a9e926edbcc0768e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 22:02:51.296807 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-200400f1-6a9a-48e2-b9b4-a2083feec4a0 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] 10.222.0.46 "GET /compute/v2.1/servers/7f7145a1-8969-4677-a0e8-1ede6d95c025" status: 200 len: 1373 microversion: 2.1 time: 0.157315 Jan 15 22:02:51.297407 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4168/8325] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 22:02:51 2022] GET /compute/v2.1/servers/7f7145a1-8969-4677-a0e8-1ede6d95c025 => generated 1373 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 22:02:52.180594 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-4d2a99fa-946b-4657-87ec-979cade0edf1 req-a3fdb7c7-c264-4938-8108-48bf53693fbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f7145a1-8969-4677-a0e8-1ede6d95c025", "name": "network-vif-plugged", "status": "completed", "tag": "0594f748-baf0-4dce-9a55-6ce6d7877e24"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 22:02:52.182168 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 22:02:52.182168 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 22:02:52.191065 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-4d2a99fa-946b-4657-87ec-979cade0edf1 req-a3fdb7c7-c264-4938-8108-48bf53693fbf service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 22:02:52.191527 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-4d2a99fa-946b-4657-87ec-979cade0edf1 req-a3fdb7c7-c264-4938-8108-48bf53693fbf service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 22:02:52.203103 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-4d2a99fa-946b-4657-87ec-979cade0edf1 req-a3fdb7c7-c264-4938-8108-48bf53693fbf service nova] Creating event network-vif-plugged:0594f748-baf0-4dce-9a55-6ce6d7877e24 for instance 7f7145a1-8969-4677-a0e8-1ede6d95c025 on nch1-master-1 Jan 15 22:02:52.208176 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-4d2a99fa-946b-4657-87ec-979cade0edf1 req-a3fdb7c7-c264-4938-8108-48bf53693fbf service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031638 Jan 15 22:02:52.208788 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4158/8326] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 22:02:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 22:02:52.313701 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9b7fac44-dd38-4a9b-aa56-619a1b64cf84 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 22:02:52.314317 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-9b7fac44-dd38-4a9b-aa56-619a1b64cf84 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] [instance: 7f7145a1-8969-4677-a0e8-1ede6d95c025] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 22:02:52.321394 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9b7fac44-dd38-4a9b-aa56-619a1b64cf84 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 22:02:52.321936 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9b7fac44-dd38-4a9b-aa56-619a1b64cf84 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 22:02:52.322855 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9b7fac44-dd38-4a9b-aa56-619a1b64cf84 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 22:02:52.323400 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9b7fac44-dd38-4a9b-aa56-619a1b64cf84 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 22:02:52.458069 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-9b7fac44-dd38-4a9b-aa56-619a1b64cf84 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e90847e86e5488f9b41aac93f5929c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733e7c15666c404a9e926edbcc0768e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 22:02:52.468030 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-9b7fac44-dd38-4a9b-aa56-619a1b64cf84 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] 10.222.0.46 "GET /compute/v2.1/servers/7f7145a1-8969-4677-a0e8-1ede6d95c025" status: 200 len: 1373 microversion: 2.1 time: 0.158088 Jan 15 22:02:52.468695 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4169/8327] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 22:02:52 2022] GET /compute/v2.1/servers/7f7145a1-8969-4677-a0e8-1ede6d95c025 => generated 1373 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 22:02:53.486674 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-a490bd6f-6831-4a06-af50-88d579db3d56 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 22:02:53.487401 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-a490bd6f-6831-4a06-af50-88d579db3d56 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] [instance: 7f7145a1-8969-4677-a0e8-1ede6d95c025] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 22:02:53.494517 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a490bd6f-6831-4a06-af50-88d579db3d56 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 22:02:53.494983 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a490bd6f-6831-4a06-af50-88d579db3d56 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 22:02:53.495882 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a490bd6f-6831-4a06-af50-88d579db3d56 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 22:02:53.496436 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-a490bd6f-6831-4a06-af50-88d579db3d56 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 22:02:53.637186 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-a490bd6f-6831-4a06-af50-88d579db3d56 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e90847e86e5488f9b41aac93f5929c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733e7c15666c404a9e926edbcc0768e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 22:02:53.645254 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-a490bd6f-6831-4a06-af50-88d579db3d56 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] 10.222.0.46 "GET /compute/v2.1/servers/7f7145a1-8969-4677-a0e8-1ede6d95c025" status: 200 len: 1558 microversion: 2.1 time: 0.164040 Jan 15 22:02:53.645839 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4159/8328] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 22:02:53 2022] GET /compute/v2.1/servers/7f7145a1-8969-4677-a0e8-1ede6d95c025 => generated 1558 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 22:02:53.661438 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-33ffe0be-3c60-4b65-987a-af72770fefc6 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 22:02:53.662046 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-33ffe0be-3c60-4b65-987a-af72770fefc6 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] [instance: 7f7145a1-8969-4677-a0e8-1ede6d95c025] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 22:02:53.668708 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-33ffe0be-3c60-4b65-987a-af72770fefc6 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 22:02:53.669179 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-33ffe0be-3c60-4b65-987a-af72770fefc6 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 22:02:53.669957 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-33ffe0be-3c60-4b65-987a-af72770fefc6 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 22:02:53.670395 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-33ffe0be-3c60-4b65-987a-af72770fefc6 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 22:02:53.801721 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-33ffe0be-3c60-4b65-987a-af72770fefc6 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e90847e86e5488f9b41aac93f5929c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733e7c15666c404a9e926edbcc0768e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 22:02:53.808973 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-33ffe0be-3c60-4b65-987a-af72770fefc6 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] 10.222.0.46 "GET /compute/v2.1/servers/7f7145a1-8969-4677-a0e8-1ede6d95c025" status: 200 len: 1558 microversion: 2.1 time: 0.151098 Jan 15 22:02:53.809571 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4170/8329] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 22:02:53 2022] GET /compute/v2.1/servers/7f7145a1-8969-4677-a0e8-1ede6d95c025 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 22:02:55.814921 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-de357357-9ce8-4e91-8503-095c40ebbb6c req-5a26433c-fe2b-4ae7-8f49-1e9068523513 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f7145a1-8969-4677-a0e8-1ede6d95c025", "tag": "0594f748-baf0-4dce-9a55-6ce6d7877e24"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 22:02:55.816474 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 22:02:55.816474 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 22:02:55.823461 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-de357357-9ce8-4e91-8503-095c40ebbb6c req-5a26433c-fe2b-4ae7-8f49-1e9068523513 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 22:02:55.823921 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-de357357-9ce8-4e91-8503-095c40ebbb6c req-5a26433c-fe2b-4ae7-8f49-1e9068523513 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 22:02:55.834555 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-de357357-9ce8-4e91-8503-095c40ebbb6c req-5a26433c-fe2b-4ae7-8f49-1e9068523513 service nova] Creating event network-changed:0594f748-baf0-4dce-9a55-6ce6d7877e24 for instance 7f7145a1-8969-4677-a0e8-1ede6d95c025 on nch1-master-1 Jan 15 22:02:55.839419 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-de357357-9ce8-4e91-8503-095c40ebbb6c req-5a26433c-fe2b-4ae7-8f49-1e9068523513 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111389 Jan 15 22:02:55.840194 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4160/8330] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 22:02:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 22:04:22.913514 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-eef274d7-174c-4c5d-a14f-adb7e223e645 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1650641436"}} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 22:04:22.914618 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-eef274d7-174c-4c5d-a14f-adb7e223e645 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] [instance: 7f7145a1-8969-4677-a0e8-1ede6d95c025] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 22:04:22.920865 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-eef274d7-174c-4c5d-a14f-adb7e223e645 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 22:04:22.921451 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-eef274d7-174c-4c5d-a14f-adb7e223e645 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 22:04:22.922333 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-eef274d7-174c-4c5d-a14f-adb7e223e645 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 22:04:22.922826 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-eef274d7-174c-4c5d-a14f-adb7e223e645 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 22:04:23.314993 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-eef274d7-174c-4c5d-a14f-adb7e223e645 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] 10.222.0.46 "POST /compute/v2.1/servers/7f7145a1-8969-4677-a0e8-1ede6d95c025/action" status: 202 len: 0 microversion: 2.1 time: 0.406255 Jan 15 22:04:23.315641 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4171/8331] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jan 15 22:04:22 2022] POST /compute/v2.1/servers/7f7145a1-8969-4677-a0e8-1ede6d95c025/action => generated 0 bytes in 408 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jan 15 22:04:28.671918 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-e0b4803b-e34e-4936-998a-c9063c69b99b req-239bd6c2-b996-4939-ad68-521f3661b426 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f7145a1-8969-4677-a0e8-1ede6d95c025", "name": "network-vif-plugged", "status": "completed", "tag": "0594f748-baf0-4dce-9a55-6ce6d7877e24"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 22:04:28.674524 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 22:04:28.674524 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 22:04:28.686159 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-e0b4803b-e34e-4936-998a-c9063c69b99b req-239bd6c2-b996-4939-ad68-521f3661b426 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 22:04:28.687551 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-e0b4803b-e34e-4936-998a-c9063c69b99b req-239bd6c2-b996-4939-ad68-521f3661b426 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 22:04:28.706569 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-e0b4803b-e34e-4936-998a-c9063c69b99b req-239bd6c2-b996-4939-ad68-521f3661b426 service nova] Creating event network-vif-plugged:0594f748-baf0-4dce-9a55-6ce6d7877e24 for instance 7f7145a1-8969-4677-a0e8-1ede6d95c025 on nch1-master-1 Jan 15 22:04:28.715431 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-e0b4803b-e34e-4936-998a-c9063c69b99b req-239bd6c2-b996-4939-ad68-521f3661b426 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050647 Jan 15 22:04:28.716889 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4161/8332] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 22:04:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 22:04:36.921924 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-9376a2c4-fdca-49da-9900-687209d85e80 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 22:04:36.922650 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-9376a2c4-fdca-49da-9900-687209d85e80 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] [instance: 7f7145a1-8969-4677-a0e8-1ede6d95c025] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 22:04:36.924818 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-fcfb313e-b917-45f3-b3a3-a725210d4573 req-a181cf95-fafb-40ed-85e1-ea081d30a80d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f7145a1-8969-4677-a0e8-1ede6d95c025", "tag": "0594f748-baf0-4dce-9a55-6ce6d7877e24"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 22:04:36.926789 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 22:04:36.926789 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 22:04:36.929710 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9376a2c4-fdca-49da-9900-687209d85e80 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 22:04:36.930255 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9376a2c4-fdca-49da-9900-687209d85e80 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 22:04:36.931248 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9376a2c4-fdca-49da-9900-687209d85e80 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 22:04:36.931882 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-9376a2c4-fdca-49da-9900-687209d85e80 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 22:04:36.934668 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-fcfb313e-b917-45f3-b3a3-a725210d4573 req-a181cf95-fafb-40ed-85e1-ea081d30a80d service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 22:04:36.935267 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-fcfb313e-b917-45f3-b3a3-a725210d4573 req-a181cf95-fafb-40ed-85e1-ea081d30a80d service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 22:04:36.946766 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-fcfb313e-b917-45f3-b3a3-a725210d4573 req-a181cf95-fafb-40ed-85e1-ea081d30a80d service nova] Creating event network-changed:0594f748-baf0-4dce-9a55-6ce6d7877e24 for instance 7f7145a1-8969-4677-a0e8-1ede6d95c025 on nch1-master-1 Jan 15 22:04:36.953278 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-fcfb313e-b917-45f3-b3a3-a725210d4573 req-a181cf95-fafb-40ed-85e1-ea081d30a80d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034202 Jan 15 22:04:36.953984 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4162/8333] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 22:04:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 22:04:36.959501 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-9376a2c4-fdca-49da-9900-687209d85e80 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] [instance: 7f7145a1-8969-4677-a0e8-1ede6d95c025] Going to try to terminate instance {{(pid=129366) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 22:04:37.043589 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-9376a2c4-fdca-49da-9900-687209d85e80 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] 10.222.0.46 "DELETE /compute/v2.1/servers/7f7145a1-8969-4677-a0e8-1ede6d95c025" status: 204 len: 0 microversion: 2.1 time: 0.126692 Jan 15 22:04:37.044785 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4172/8334] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 22:04:36 2022] DELETE /compute/v2.1/servers/7f7145a1-8969-4677-a0e8-1ede6d95c025 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 22:04:37.056291 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-11a6c440-e1fc-47b1-b1f8-cf3b18f41985 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 22:04:37.057085 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-11a6c440-e1fc-47b1-b1f8-cf3b18f41985 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] [instance: 7f7145a1-8969-4677-a0e8-1ede6d95c025] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 22:04:37.068337 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-11a6c440-e1fc-47b1-b1f8-cf3b18f41985 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 22:04:37.068808 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-11a6c440-e1fc-47b1-b1f8-cf3b18f41985 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 22:04:37.069661 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-11a6c440-e1fc-47b1-b1f8-cf3b18f41985 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 22:04:37.070120 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-11a6c440-e1fc-47b1-b1f8-cf3b18f41985 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 22:04:37.275287 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-11a6c440-e1fc-47b1-b1f8-cf3b18f41985 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e90847e86e5488f9b41aac93f5929c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733e7c15666c404a9e926edbcc0768e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 22:04:37.284195 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-11a6c440-e1fc-47b1-b1f8-cf3b18f41985 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] 10.222.0.46 "GET /compute/v2.1/servers/7f7145a1-8969-4677-a0e8-1ede6d95c025" status: 200 len: 1683 microversion: 2.1 time: 0.233392 Jan 15 22:04:37.284792 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4163/8335] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 22:04:37 2022] GET /compute/v2.1/servers/7f7145a1-8969-4677-a0e8-1ede6d95c025 => generated 1683 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 22:04:38.302987 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-40c332f9-245e-4055-b3ac-05090fbaa80b tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 22:04:38.303597 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-40c332f9-245e-4055-b3ac-05090fbaa80b tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] [instance: 7f7145a1-8969-4677-a0e8-1ede6d95c025] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 22:04:38.311124 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-40c332f9-245e-4055-b3ac-05090fbaa80b tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 22:04:38.311566 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-40c332f9-245e-4055-b3ac-05090fbaa80b tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 22:04:38.312331 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-40c332f9-245e-4055-b3ac-05090fbaa80b tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 22:04:38.312760 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-40c332f9-245e-4055-b3ac-05090fbaa80b tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 22:04:38.449309 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-40c332f9-245e-4055-b3ac-05090fbaa80b tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e90847e86e5488f9b41aac93f5929c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733e7c15666c404a9e926edbcc0768e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 22:04:38.457192 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-40c332f9-245e-4055-b3ac-05090fbaa80b tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] 10.222.0.46 "GET /compute/v2.1/servers/7f7145a1-8969-4677-a0e8-1ede6d95c025" status: 200 len: 1564 microversion: 2.1 time: 0.158307 Jan 15 22:04:38.457773 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4173/8336] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 22:04:38 2022] GET /compute/v2.1/servers/7f7145a1-8969-4677-a0e8-1ede6d95c025 => generated 1564 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 22:04:38.646992 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [req-37e0c3b3-d407-49cf-ae55-0f1258c8bcff req-f564dc73-ba0d-49f5-a599-66fdc7925e40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f7145a1-8969-4677-a0e8-1ede6d95c025", "name": "network-vif-unplugged", "status": "completed", "tag": "0594f748-baf0-4dce-9a55-6ce6d7877e24"}]} {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 22:04:38.648654 ncdv-master-1 devstack@n-api.service[129365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 22:04:38.648654 ncdv-master-1 devstack@n-api.service[129365]: warnings.warn(msg) Jan 15 22:04:38.657266 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-37e0c3b3-d407-49cf-ae55-0f1258c8bcff req-f564dc73-ba0d-49f5-a599-66fdc7925e40 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 22:04:38.657789 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [req-37e0c3b3-d407-49cf-ae55-0f1258c8bcff req-f564dc73-ba0d-49f5-a599-66fdc7925e40 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 22:04:38.675299 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.compute.server_external_events [req-37e0c3b3-d407-49cf-ae55-0f1258c8bcff req-f564dc73-ba0d-49f5-a599-66fdc7925e40 service nova] Creating event network-vif-unplugged:0594f748-baf0-4dce-9a55-6ce6d7877e24 for instance 7f7145a1-8969-4677-a0e8-1ede6d95c025 on nch1-master-1 Jan 15 22:04:38.681069 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [req-37e0c3b3-d407-49cf-ae55-0f1258c8bcff req-f564dc73-ba0d-49f5-a599-66fdc7925e40 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037571 Jan 15 22:04:38.681871 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4164/8337] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 22:04:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 22:04:39.115555 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-2444a6e2-55bd-436c-b7fa-82745bb8b2fc req-bf9ef32e-ee54-4fbc-b453-826465d0bd67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f7145a1-8969-4677-a0e8-1ede6d95c025", "name": "network-vif-deleted", "tag": "0594f748-baf0-4dce-9a55-6ce6d7877e24"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 22:04:39.117266 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 22:04:39.117266 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 22:04:39.126046 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-2444a6e2-55bd-436c-b7fa-82745bb8b2fc req-bf9ef32e-ee54-4fbc-b453-826465d0bd67 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 22:04:39.126491 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-2444a6e2-55bd-436c-b7fa-82745bb8b2fc req-bf9ef32e-ee54-4fbc-b453-826465d0bd67 service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 22:04:39.138639 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-2444a6e2-55bd-436c-b7fa-82745bb8b2fc req-bf9ef32e-ee54-4fbc-b453-826465d0bd67 service nova] Creating event network-vif-deleted:0594f748-baf0-4dce-9a55-6ce6d7877e24 for instance 7f7145a1-8969-4677-a0e8-1ede6d95c025 on nch1-master-1 Jan 15 22:04:39.143722 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-2444a6e2-55bd-436c-b7fa-82745bb8b2fc req-bf9ef32e-ee54-4fbc-b453-826465d0bd67 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032173 Jan 15 22:04:39.144308 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4174/8338] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 22:04:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 22:04:39.475819 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-2459813d-7f33-4375-87d5-87e268a126a8 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 22:04:39.476996 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-2459813d-7f33-4375-87d5-87e268a126a8 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] [instance: 7f7145a1-8969-4677-a0e8-1ede6d95c025] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 22:04:39.485907 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2459813d-7f33-4375-87d5-87e268a126a8 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 22:04:39.486609 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2459813d-7f33-4375-87d5-87e268a126a8 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 22:04:39.488074 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2459813d-7f33-4375-87d5-87e268a126a8 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 22:04:39.488941 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2459813d-7f33-4375-87d5-87e268a126a8 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 22:04:39.536796 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2459813d-7f33-4375-87d5-87e268a126a8 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 22:04:39.537340 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-2459813d-7f33-4375-87d5-87e268a126a8 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 22:04:39.537816 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.objects.instance [None req-2459813d-7f33-4375-87d5-87e268a126a8 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lazy-loading 'fault' on Instance uuid 7f7145a1-8969-4677-a0e8-1ede6d95c025 {{(pid=129365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 22:04:39.587636 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-2459813d-7f33-4375-87d5-87e268a126a8 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e90847e86e5488f9b41aac93f5929c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733e7c15666c404a9e926edbcc0768e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 22:04:39.595350 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-2459813d-7f33-4375-87d5-87e268a126a8 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] 10.222.0.46 "GET /compute/v2.1/servers/7f7145a1-8969-4677-a0e8-1ede6d95c025" status: 200 len: 1338 microversion: 2.1 time: 0.124385 Jan 15 22:04:39.596744 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4165/8339] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 22:04:39 2022] GET /compute/v2.1/servers/7f7145a1-8969-4677-a0e8-1ede6d95c025 => generated 1338 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 22:04:40.615106 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e571d403-7c16-4f9c-957a-2e7dd55048a1 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 22:04:40.615798 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-e571d403-7c16-4f9c-957a-2e7dd55048a1 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] [instance: 7f7145a1-8969-4677-a0e8-1ede6d95c025] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 22:04:40.623687 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e571d403-7c16-4f9c-957a-2e7dd55048a1 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 22:04:40.624141 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e571d403-7c16-4f9c-957a-2e7dd55048a1 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 22:04:40.624970 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e571d403-7c16-4f9c-957a-2e7dd55048a1 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 22:04:40.625407 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-e571d403-7c16-4f9c-957a-2e7dd55048a1 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 22:04:40.639174 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-e571d403-7c16-4f9c-957a-2e7dd55048a1 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] HTTP exception thrown: Instance 7f7145a1-8969-4677-a0e8-1ede6d95c025 could not be found. Jan 15 22:04:40.639718 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-e571d403-7c16-4f9c-957a-2e7dd55048a1 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Returning 404 to user: Instance 7f7145a1-8969-4677-a0e8-1ede6d95c025 could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 22:04:40.640531 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-e571d403-7c16-4f9c-957a-2e7dd55048a1 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] 10.222.0.46 "GET /compute/v2.1/servers/7f7145a1-8969-4677-a0e8-1ede6d95c025" status: 404 len: 111 microversion: 2.1 time: 0.029892 Jan 15 22:04:40.641105 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4175/8340] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 22:04:40 2022] GET /compute/v2.1/servers/7f7145a1-8969-4677-a0e8-1ede6d95c025 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 22:04:42.193550 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-1ac94971-d132-4ec7-ae3c-136d24f9ea13 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 22:04:42.194096 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-1ac94971-d132-4ec7-ae3c-136d24f9ea13 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] [instance: b7d1b866-2a91-40b1-bca1-edfc57fbe871] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 22:04:42.200134 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-5de87e8d-642e-4e31-8d36-fe88cd997d34 req-c6f53089-77f9-4a63-86ed-a04b1140b70b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7d1b866-2a91-40b1-bca1-edfc57fbe871", "tag": "d5a3c225-c762-4696-bdc3-580bf9e0a28f"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 22:04:42.202626 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 22:04:42.202626 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 22:04:42.207444 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1ac94971-d132-4ec7-ae3c-136d24f9ea13 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 22:04:42.208120 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1ac94971-d132-4ec7-ae3c-136d24f9ea13 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 22:04:42.209006 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1ac94971-d132-4ec7-ae3c-136d24f9ea13 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 22:04:42.209722 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1ac94971-d132-4ec7-ae3c-136d24f9ea13 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 22:04:42.211735 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-5de87e8d-642e-4e31-8d36-fe88cd997d34 req-c6f53089-77f9-4a63-86ed-a04b1140b70b service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 22:04:42.212244 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-5de87e8d-642e-4e31-8d36-fe88cd997d34 req-c6f53089-77f9-4a63-86ed-a04b1140b70b service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 22:04:42.224660 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-5de87e8d-642e-4e31-8d36-fe88cd997d34 req-c6f53089-77f9-4a63-86ed-a04b1140b70b service nova] Creating event network-changed:d5a3c225-c762-4696-bdc3-580bf9e0a28f for instance b7d1b866-2a91-40b1-bca1-edfc57fbe871 on nch2-master-1 Jan 15 22:04:42.231061 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-5de87e8d-642e-4e31-8d36-fe88cd997d34 req-c6f53089-77f9-4a63-86ed-a04b1140b70b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034729 Jan 15 22:04:42.232102 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4176/8341] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 22:04:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 22:04:42.240273 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-1ac94971-d132-4ec7-ae3c-136d24f9ea13 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] [instance: b7d1b866-2a91-40b1-bca1-edfc57fbe871] Going to try to terminate instance {{(pid=129365) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 15 22:04:42.330093 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-1ac94971-d132-4ec7-ae3c-136d24f9ea13 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] 10.222.0.46 "DELETE /compute/v2.1/servers/b7d1b866-2a91-40b1-bca1-edfc57fbe871" status: 204 len: 0 microversion: 2.1 time: 0.139147 Jan 15 22:04:42.330772 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4166/8342] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jan 15 22:04:42 2022] DELETE /compute/v2.1/servers/b7d1b866-2a91-40b1-bca1-edfc57fbe871 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 15 22:04:42.341274 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-25a79503-b439-4401-9398-4ad8a6cc2916 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 22:04:42.342197 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-25a79503-b439-4401-9398-4ad8a6cc2916 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] [instance: b7d1b866-2a91-40b1-bca1-edfc57fbe871] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 22:04:42.348552 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-25a79503-b439-4401-9398-4ad8a6cc2916 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 22:04:42.349050 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-25a79503-b439-4401-9398-4ad8a6cc2916 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 22:04:42.349998 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-25a79503-b439-4401-9398-4ad8a6cc2916 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 22:04:42.350436 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-25a79503-b439-4401-9398-4ad8a6cc2916 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 22:04:42.568366 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.policy [None req-25a79503-b439-4401-9398-4ad8a6cc2916 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e90847e86e5488f9b41aac93f5929c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733e7c15666c404a9e926edbcc0768e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129366) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 22:04:42.576689 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-25a79503-b439-4401-9398-4ad8a6cc2916 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] 10.222.0.46 "GET /compute/v2.1/servers/b7d1b866-2a91-40b1-bca1-edfc57fbe871" status: 200 len: 1683 microversion: 2.1 time: 0.240984 Jan 15 22:04:42.591088 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4177/8343] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 22:04:42 2022] GET /compute/v2.1/servers/b7d1b866-2a91-40b1-bca1-edfc57fbe871 => generated 1683 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 22:04:43.605178 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-1e2ea89d-a631-47aa-b0ec-08c514b06c3e tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 22:04:43.606382 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-1e2ea89d-a631-47aa-b0ec-08c514b06c3e tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] [instance: b7d1b866-2a91-40b1-bca1-edfc57fbe871] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 22:04:43.613413 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1e2ea89d-a631-47aa-b0ec-08c514b06c3e tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 22:04:43.613883 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1e2ea89d-a631-47aa-b0ec-08c514b06c3e tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 22:04:43.614684 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1e2ea89d-a631-47aa-b0ec-08c514b06c3e tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 22:04:43.615133 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-1e2ea89d-a631-47aa-b0ec-08c514b06c3e tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 22:04:43.764037 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-1e2ea89d-a631-47aa-b0ec-08c514b06c3e tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e90847e86e5488f9b41aac93f5929c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733e7c15666c404a9e926edbcc0768e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 22:04:43.771634 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-1e2ea89d-a631-47aa-b0ec-08c514b06c3e tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] 10.222.0.46 "GET /compute/v2.1/servers/b7d1b866-2a91-40b1-bca1-edfc57fbe871" status: 200 len: 1564 microversion: 2.1 time: 0.170669 Jan 15 22:04:43.772214 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4167/8344] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 22:04:43 2022] GET /compute/v2.1/servers/b7d1b866-2a91-40b1-bca1-edfc57fbe871 => generated 1564 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 22:04:44.639016 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [req-76e9ff02-cd8d-4908-8879-cf4872209cba req-6459e8c1-d12e-4410-85bd-eb608184d6af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7d1b866-2a91-40b1-bca1-edfc57fbe871", "name": "network-vif-deleted", "tag": "d5a3c225-c762-4696-bdc3-580bf9e0a28f"}]} {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 15 22:04:44.640523 ncdv-master-1 devstack@n-api.service[129366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 15 22:04:44.640523 ncdv-master-1 devstack@n-api.service[129366]: warnings.warn(msg) Jan 15 22:04:44.649793 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-76e9ff02-cd8d-4908-8879-cf4872209cba req-6459e8c1-d12e-4410-85bd-eb608184d6af service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 22:04:44.650243 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [req-76e9ff02-cd8d-4908-8879-cf4872209cba req-6459e8c1-d12e-4410-85bd-eb608184d6af service nova] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 22:04:44.664303 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.compute.server_external_events [req-76e9ff02-cd8d-4908-8879-cf4872209cba req-6459e8c1-d12e-4410-85bd-eb608184d6af service nova] Creating event network-vif-deleted:d5a3c225-c762-4696-bdc3-580bf9e0a28f for instance b7d1b866-2a91-40b1-bca1-edfc57fbe871 on nch2-master-1 Jan 15 22:04:44.670211 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [req-76e9ff02-cd8d-4908-8879-cf4872209cba req-6459e8c1-d12e-4410-85bd-eb608184d6af service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035571 Jan 15 22:04:44.670805 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4178/8345] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jan 15 22:04:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 15 22:04:44.788793 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-c36f1313-8036-4a19-bb1b-660d682f9543 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Calling method '>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 22:04:44.789455 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.compute.api [None req-c36f1313-8036-4a19-bb1b-660d682f9543 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] [instance: b7d1b866-2a91-40b1-bca1-edfc57fbe871] Fetching instance by UUID {{(pid=129365) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 22:04:44.796150 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c36f1313-8036-4a19-bb1b-660d682f9543 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 22:04:44.796608 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c36f1313-8036-4a19-bb1b-660d682f9543 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 22:04:44.797670 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c36f1313-8036-4a19-bb1b-660d682f9543 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 22:04:44.798126 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c36f1313-8036-4a19-bb1b-660d682f9543 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 22:04:44.832192 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c36f1313-8036-4a19-bb1b-660d682f9543 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 22:04:44.832665 ncdv-master-1 devstack@n-api.service[129365]: DEBUG oslo_concurrency.lockutils [None req-c36f1313-8036-4a19-bb1b-660d682f9543 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 22:04:44.833152 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.objects.instance [None req-c36f1313-8036-4a19-bb1b-660d682f9543 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lazy-loading 'fault' on Instance uuid b7d1b866-2a91-40b1-bca1-edfc57fbe871 {{(pid=129365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 15 22:04:44.872783 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.policy [None req-c36f1313-8036-4a19-bb1b-660d682f9543 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e90847e86e5488f9b41aac93f5929c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733e7c15666c404a9e926edbcc0768e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129365) authorize /opt/stack/nova/nova/policy.py:199}} Jan 15 22:04:44.880235 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-c36f1313-8036-4a19-bb1b-660d682f9543 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] 10.222.0.46 "GET /compute/v2.1/servers/b7d1b866-2a91-40b1-bca1-edfc57fbe871" status: 200 len: 1339 microversion: 2.1 time: 0.095397 Jan 15 22:04:44.880763 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4168/8346] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 22:04:44 2022] GET /compute/v2.1/servers/b7d1b866-2a91-40b1-bca1-edfc57fbe871 => generated 1339 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 15 22:04:45.899053 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-efd8421e-798a-4dd7-ac5c-e877108009d1 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Calling method '>' {{(pid=129366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 22:04:45.899773 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.compute.api [None req-efd8421e-798a-4dd7-ac5c-e877108009d1 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] [instance: b7d1b866-2a91-40b1-bca1-edfc57fbe871] Fetching instance by UUID {{(pid=129366) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 15 22:04:45.907978 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-efd8421e-798a-4dd7-ac5c-e877108009d1 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 22:04:45.908423 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-efd8421e-798a-4dd7-ac5c-e877108009d1 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 22:04:45.909229 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-efd8421e-798a-4dd7-ac5c-e877108009d1 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 15 22:04:45.909660 ncdv-master-1 devstack@n-api.service[129366]: DEBUG oslo_concurrency.lockutils [None req-efd8421e-798a-4dd7-ac5c-e877108009d1 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Lock "2935be83-7c51-430d-8ff2-0a8179973c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 15 22:04:45.923830 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.wsgi [None req-efd8421e-798a-4dd7-ac5c-e877108009d1 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] HTTP exception thrown: Instance b7d1b866-2a91-40b1-bca1-edfc57fbe871 could not be found. Jan 15 22:04:45.924425 ncdv-master-1 devstack@n-api.service[129366]: DEBUG nova.api.openstack.wsgi [None req-efd8421e-798a-4dd7-ac5c-e877108009d1 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Returning 404 to user: Instance b7d1b866-2a91-40b1-bca1-edfc57fbe871 could not be found. {{(pid=129366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 15 22:04:45.925277 ncdv-master-1 devstack@n-api.service[129366]: INFO nova.api.openstack.requestlog [None req-efd8421e-798a-4dd7-ac5c-e877108009d1 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] 10.222.0.46 "GET /compute/v2.1/servers/b7d1b866-2a91-40b1-bca1-edfc57fbe871" status: 404 len: 111 microversion: 2.1 time: 0.030366 Jan 15 22:04:45.925831 ncdv-master-1 devstack@n-api.service[129366]: [pid: 129366|app: 0|req: 4179/8347] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jan 15 22:04:45 2022] GET /compute/v2.1/servers/b7d1b866-2a91-40b1-bca1-edfc57fbe871 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 15 22:04:46.088071 ncdv-master-1 devstack@n-api.service[129365]: DEBUG nova.api.openstack.wsgi [None req-bc0e0635-bcdd-41eb-be7b-e960e6afb933 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] Calling method '.version_select at 0x7f30c84b8670>' {{(pid=129365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 15 22:04:46.095627 ncdv-master-1 devstack@n-api.service[129365]: ERROR oslo.messaging._drivers.impl_rabbit [None req-bc0e0635-bcdd-41eb-be7b-e960e6afb933 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] [400b0649-1c0e-4ad9-a629-16a22f223001] AMQP server on 10.222.0.46:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 15 22:04:47.103932 ncdv-master-1 devstack@n-api.service[129365]: INFO oslo.messaging._drivers.impl_rabbit [None req-bc0e0635-bcdd-41eb-be7b-e960e6afb933 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] [400b0649-1c0e-4ad9-a629-16a22f223001] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 43400. Jan 15 22:04:47.123286 ncdv-master-1 devstack@n-api.service[129365]: INFO nova.api.openstack.requestlog [None req-bc0e0635-bcdd-41eb-be7b-e960e6afb933 tempest-TestSnapshotPattern-1803951984 tempest-TestSnapshotPattern-1803951984-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1045805389" status: 202 len: 0 microversion: 2.1 time: 1.039056 Jan 15 22:04:47.123900 ncdv-master-1 devstack@n-api.service[129365]: [pid: 129365|app: 0|req: 4169/8348] 10.222.0.46 () {58 vars in 1256 bytes} [Sat Jan 15 22:04:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1045805389 => generated 0 bytes in 1042 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 15 22:05:11.025665 ncdv-master-1 devstack@n-api.service[129366]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 15 22:05:11.026268 ncdv-master-1 devstack@n-api.service[129366]: Sat Jan 15 22:05:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 15 22:05:11.094493 ncdv-master-1 devstack@n-api.service[129366]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 15 22:05:11.094776 ncdv-master-1 devstack@n-api.service[129366]: Sat Jan 15 22:05:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 15 22:05:11.409344 ncdv-master-1 devstack@n-api.service[129365]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 15 22:05:11.410166 ncdv-master-1 devstack@n-api.service[129365]: Sat Jan 15 22:05:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 15 22:07:03.728681 ncdv-master-1 devstack@n-api.service[129366]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 15 22:07:03.729331 ncdv-master-1 devstack@n-api.service[129366]: Sat Jan 15 22:07:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 15 22:07:25.962586 ncdv-master-1 devstack@n-api.service[129365]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 15 22:07:25.963207 ncdv-master-1 devstack@n-api.service[129365]: Sat Jan 15 22:07:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 15 22:08:31.034875 ncdv-master-1 devstack@n-api.service[129366]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 15 22:08:31.035472 ncdv-master-1 devstack@n-api.service[129366]: Sat Jan 15 22:08:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 15 22:08:31.103046 ncdv-master-1 devstack@n-api.service[129366]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 15 22:08:31.103829 ncdv-master-1 devstack@n-api.service[129366]: Sat Jan 15 22:08:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 15 22:08:31.418127 ncdv-master-1 devstack@n-api.service[129365]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 15 22:08:31.418635 ncdv-master-1 devstack@n-api.service[129365]: Sat Jan 15 22:08:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 15 22:10:11.366324 ncdv-master-1 devstack@n-api.service[129365]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 15 22:10:11.366875 ncdv-master-1 devstack@n-api.service[129365]: Sat Jan 15 22:10:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 15 22:10:23.737062 ncdv-master-1 devstack@n-api.service[129366]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 15 22:10:23.737595 ncdv-master-1 devstack@n-api.service[129366]: Sat Jan 15 22:10:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 15 22:10:45.971149 ncdv-master-1 devstack@n-api.service[129365]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 15 22:10:45.971661 ncdv-master-1 devstack@n-api.service[129365]: Sat Jan 15 22:10:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 15 22:11:51.044033 ncdv-master-1 devstack@n-api.service[129366]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 15 22:11:51.044617 ncdv-master-1 devstack@n-api.service[129366]: Sat Jan 15 22:11:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 15 22:11:51.111219 ncdv-master-1 devstack@n-api.service[129366]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 15 22:11:51.111378 ncdv-master-1 devstack@n-api.service[129366]: Sat Jan 15 22:11:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 15 22:11:51.426786 ncdv-master-1 devstack@n-api.service[129365]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 15 22:11:51.427250 ncdv-master-1 devstack@n-api.service[129365]: Sat Jan 15 22:11:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!